[2025-10-02T17:00:01.725566] [INFO ] [MAIN ] Using last completed trading day: 2025-10-02 [2025-10-02T17:00:01.953399] [DEBUG] [R-STATUS ] Registered 'tdm' as a dependent service. [2025-10-02T17:00:01.953674] [INFO ] [STATE ] Waiting for all dependent services to be clear... [2025-10-02T17:00:02.261902] [WARN ] [tdm-status] Service 'tdm' is not running. [2025-10-02T17:00:02.262768] [WARN ] [STATE ] State set to: RUNNING [2025-10-02T17:00:02.262862] [INFO ] [MAIN ] Refreshing symbols list before update... [2025-10-02T17:00:02.262944] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-10-02T17:00:02.263111] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-10-02T17:00:02.263170] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-10-02T17:00:03.772898] [DEBUG] [SYMBOL ] Found 2422 valid NYSE symbols. [2025-10-02T17:00:03.773051] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-10-02T17:00:03.773254] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-10-02T17:00:03.773899] [INFO ] [LOCAL ] Symbols cache updated with 2370 symbols. [2025-10-02T17:00:03.773958] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-10-02T17:00:03.773991] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-10-02T17:00:03.774047] [INFO ] [MAIN ] Pruning stale symbols... [2025-10-02T17:00:03.774079] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-10-02T17:00:03.774109] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-02T17:00:03.774559] [DEBUG] [LOCAL ] Found 2370 symbols in cached list. [2025-10-02T17:00:03.774614] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-02T17:00:03.774803] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-10-02T17:00:03.774855] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2370 valid symbols. [2025-10-02T17:00:03.774889] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-10-02T17:00:03.774922] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-10-02T17:00:03.794443] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-10-02T17:00:03.814037] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-10-02T17:00:03.814126] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-10-02T17:00:03.814163] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-10-02T17:00:03.814193] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-10-02T17:00:03.814251] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-02T17:00:03.814602] [DEBUG] [LOCAL ] Found 2370 symbols in cached list. [2025-10-02T17:00:03.814637] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-02T17:00:03.814715] [INFO ] [MAIN ] Starting incremental update for 2370 symbols. [2025-10-02T17:00:03.814749] [INFO ] [MAIN ] Running in parallel mode [2025-10-02T17:00:03.814919] [INFO ] [MAIN ] Starting parallel primary update with 4 worker threads for 2370 symbols [2025-10-02T17:00:04.523025] [INFO ] [MAIN ] AA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:00:04.683916] [INFO ] [MAIN ] A: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:00:04.688137] [INFO ] [MAIN ] AAM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:00:04.692895] [INFO ] [MAIN ] AAMI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:00:04.695020] [DEBUG] [LOCAL ] AAM: No existing data file found in primary storage. [2025-10-02T17:00:04.695205] [DEBUG] [LOCAL ] AAMI: No existing data file found in primary storage. [2025-10-02T17:00:04.695290] [WARN ] [MAIN ] AAMI: No existing data found, performing full refresh instead. [2025-10-02T17:00:04.695370] [WARN ] [MAIN ] AAM: No existing data found, performing full refresh instead. [2025-10-02T17:00:04.695535] [INFO ] [MAIN ] AAMI: Wiping existing primary data before full refresh. [2025-10-02T17:00:04.695706] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-10-02T17:00:04.695901] [INFO ] [MAIN ] AAM: Wiping existing primary data before full refresh. [2025-10-02T17:00:04.696028] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-10-02T17:00:04.696118] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-02T17:00:04.696230] [INFO ] [MAIN ] AAMI: Starting full primary refresh. [2025-10-02T17:00:04.696345] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-02T17:00:04.696439] [INFO ] [MAIN ] AAM: Starting full primary refresh. [2025-10-02T17:00:05.189021] [DEBUG] [LOCAL ] AA: Loaded 53615 existing records from primary storage. [2025-10-02T17:00:05.247176] [INFO ] [MAIN ] AA: Loaded 53615 existing records. [2025-10-02T17:00:05.420491] [DEBUG] [LOCAL ] A: Loaded 50727 existing records from primary storage. [2025-10-02T17:00:05.486208] [INFO ] [MAIN ] A: Loaded 50727 existing records. [2025-10-02T17:00:05.841217] [INFO ] [REMOTE ] AAMI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:00:05.872865] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2024-12. [2025-10-02T17:00:06.055535] [WARN ] [MAIN ] AA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:00:06.134444] [INFO ] [MAIN ] AA: Wiping existing primary data before full refresh. [2025-10-02T17:00:06.188358] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-10-02T17:00:06.186822] [WARN ] [MAIN ] A: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:00:06.193511] [DEBUG] [LOCAL ] AA: Deleted primary data file. [2025-10-02T17:00:06.193380] [INFO ] [REMOTE ] AAM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:00:06.194024] [INFO ] [REMOTE ] AAM: Fetching primary data for 2024-12. [2025-10-02T17:00:06.194132] [INFO ] [MAIN ] AA: Starting full primary refresh. [2025-10-02T17:00:06.188823] [INFO ] [MAIN ] A: Wiping existing primary data before full refresh. [2025-10-02T17:00:06.200311] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-10-02T17:00:06.207564] [DEBUG] [LOCAL ] A: Deleted primary data file. [2025-10-02T17:00:06.218806] [INFO ] [MAIN ] A: Starting full primary refresh. [2025-10-02T17:00:06.266759] [DEBUG] [REMOTE ] AAMI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T17:00:06.351809] [WARN ] [REMOTE ] AAMI: No data returned for month 2024-12 [2025-10-02T17:00:06.418188] [FATAL] [REMOTE ] AAMI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T17:00:06.470832] [FATAL] [MAIN ] AAMI: Failed to fetch primary data. [2025-10-02T17:00:06.486625] [WARN ] [MAIN ] AAMI: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T17:00:06.535604] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-10-02T17:00:06.626955] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-10-02T17:00:06.709151] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-10-02T17:00:06.732305] [INFO ] [LOCAL ] AAMI: Starting deletion of derivative data. [2025-10-02T17:00:06.796635] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-01. [2025-10-02T17:00:06.812813] [DEBUG] [LOCAL ] AAMI: No derivative data file found to delete. [2025-10-02T17:00:06.819093] [INFO ] [MAIN ] Update Progress: 1/2370 symbols completed. AAMI took 3.0s. Estimated remaining: 1h 58m 37s. Rate: 20.0 symbols/min [2025-10-02T17:00:07.130859] [INFO ] [REMOTE ] AA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:00:07.163491] [INFO ] [REMOTE ] AA: Fetching primary data for 2024-12. [2025-10-02T17:00:07.300967] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-02T17:00:07.282164] [INFO ] [REMOTE ] A: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:00:07.324561] [INFO ] [REMOTE ] A: Fetching primary data for 2024-12. [2025-10-02T17:00:07.327288] [INFO ] [MAIN ] AAP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:00:07.326178] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-02. [2025-10-02T17:00:07.397528] [DEBUG] [LOCAL ] AAP: Loaded 51944 existing records from primary storage. [2025-10-02T17:00:07.397916] [INFO ] [MAIN ] AAP: Loaded 51944 existing records. [2025-10-02T17:00:07.594091] [WARN ] [MAIN ] AAP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:00:07.594311] [INFO ] [MAIN ] AAP: Wiping existing primary data before full refresh. [2025-10-02T17:00:07.594363] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-10-02T17:00:07.594749] [DEBUG] [LOCAL ] AAP: Deleted primary data file. [2025-10-02T17:00:07.594814] [INFO ] [MAIN ] AAP: Starting full primary refresh. [2025-10-02T17:00:07.705318] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-02T17:00:07.709931] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-03. [2025-10-02T17:00:08.003840] [INFO ] [REMOTE ] AAP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:00:08.004205] [INFO ] [REMOTE ] AAP: Fetching primary data for 2024-12. [2025-10-02T17:00:08.271783] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-02T17:00:08.273312] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-04. [2025-10-02T17:00:08.619478] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-02T17:00:08.620671] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-05. [2025-10-02T17:00:08.763606] [INFO ] [REMOTE ] A: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-02T17:00:08.773672] [INFO ] [REMOTE ] A: Fetching primary data for 2025-01. [2025-10-02T17:00:08.877171] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-10-02T17:00:08.878228] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-06. [2025-10-02T17:00:09.120421] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-10-02T17:00:09.121434] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-07. [2025-10-02T17:00:09.335821] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-10-02T17:00:09.347447] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-01. [2025-10-02T17:00:09.455405] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-02T17:00:09.456360] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-08. [2025-10-02T17:00:09.730360] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-08 (0.27 seconds). [2025-10-02T17:00:09.731839] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-09. [2025-10-02T17:00:09.765340] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-02T17:00:09.776020] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-01. [2025-10-02T17:00:10.168608] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-02T17:00:10.170110] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-10. [2025-10-02T17:00:10.599451] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-02T17:00:10.600305] [INFO ] [REMOTE ] AAM: Full fetch complete (956 records). [2025-10-02T17:00:10.600381] [DEBUG] [VALIDATOR ] AAM: Validating primary data. [2025-10-02T17:00:10.832415] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-02T17:00:10.857071] [WARN ] [VALIDATOR ] AAM: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-10-02T17:00:10.858250] [INFO ] [REMOTE ] A: Fetching primary data for 2025-02. [2025-10-02T17:00:10.858378] [FATAL] [MAIN ] AAM: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:00:10.859319] [WARN ] [MAIN ] AAM: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:00:10.859402] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-02T17:00:10.859470] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-02T17:00:10.859525] [INFO ] [LOCAL ] AAM: Starting deletion of derivative data. [2025-10-02T17:00:10.859589] [DEBUG] [LOCAL ] AAM: No derivative data file found to delete. [2025-10-02T17:00:10.859681] [INFO ] [MAIN ] Update Progress: 2/2370 symbols completed. AAM took 7.0s. Estimated remaining: 2h 19m 1s. Rate: 17.0 symbols/min [2025-10-02T17:00:11.048950] [INFO ] [MAIN ] AAT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:00:11.090250] [DEBUG] [LOCAL ] AAT: Loaded 30404 existing records from primary storage. [2025-10-02T17:00:11.090524] [INFO ] [MAIN ] AAT: Loaded 30404 existing records. [2025-10-02T17:00:11.291954] [WARN ] [MAIN ] AAT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:00:11.292268] [INFO ] [MAIN ] AAT: Wiping existing primary data before full refresh. [2025-10-02T17:00:11.292393] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-10-02T17:00:11.292889] [DEBUG] [LOCAL ] AAT: Deleted primary data file. [2025-10-02T17:00:11.292953] [INFO ] [MAIN ] AAT: Starting full primary refresh. [2025-10-02T17:00:11.744498] [INFO ] [REMOTE ] AAT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:00:11.745515] [INFO ] [REMOTE ] AAT: Fetching primary data for 2024-12. [2025-10-02T17:00:11.814547] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-01 (2.47 seconds). [2025-10-02T17:00:11.815582] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-02T17:00:11.839292] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-02. [2025-10-02T17:00:11.838871] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-02. [2025-10-02T17:00:12.490955] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-02T17:00:12.501075] [INFO ] [REMOTE ] A: Fetching primary data for 2025-03. [2025-10-02T17:00:13.153213] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-02T17:00:13.159133] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-01. [2025-10-02T17:00:13.632151] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-02T17:00:13.642806] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-03. [2025-10-02T17:00:13.815015] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-02T17:00:13.827558] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-03. [2025-10-02T17:00:14.079399] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-02T17:00:14.085406] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-02. [2025-10-02T17:00:14.340250] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-02T17:00:14.352191] [INFO ] [REMOTE ] A: Fetching primary data for 2025-04. [2025-10-02T17:00:15.315670] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-02T17:00:15.321718] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-03. [2025-10-02T17:00:16.020112] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-10-02T17:00:16.031889] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-04. [2025-10-02T17:00:16.107439] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-02T17:00:16.119000] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-04. [2025-10-02T17:00:16.692984] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-02T17:00:16.706825] [INFO ] [REMOTE ] A: Fetching primary data for 2025-05. [2025-10-02T17:00:17.700237] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-10-02T17:00:17.707607] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-04. [2025-10-02T17:00:17.744356] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-02T17:00:17.756983] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-05. [2025-10-02T17:00:19.168478] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-04 (3.14 seconds). [2025-10-02T17:00:19.180148] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-05. [2025-10-02T17:00:19.334472] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-02T17:00:19.347030] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-06. [2025-10-02T17:00:20.181818] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-05 (3.47 seconds). [2025-10-02T17:00:20.194323] [INFO ] [REMOTE ] A: Fetching primary data for 2025-06. [2025-10-02T17:00:21.229886] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-02T17:00:21.244012] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-07. [2025-10-02T17:00:21.740548] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-02T17:00:21.752237] [INFO ] [REMOTE ] A: Fetching primary data for 2025-07. [2025-10-02T17:00:21.783011] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-05 (2.60 seconds). [2025-10-02T17:00:21.795602] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-06. [2025-10-02T17:00:22.909595] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-02T17:00:22.924006] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-08. [2025-10-02T17:00:22.992372] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-04 (5.28 seconds). [2025-10-02T17:00:23.000559] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-05. [2025-10-02T17:00:23.313345] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-02T17:00:23.324854] [INFO ] [REMOTE ] A: Fetching primary data for 2025-08. [2025-10-02T17:00:23.644618] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-02T17:00:23.657807] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-07. [2025-10-02T17:00:24.342522] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-02T17:00:24.350351] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-06. [2025-10-02T17:00:24.821061] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-02T17:00:24.833378] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-09. [2025-10-02T17:00:25.236836] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-02T17:00:25.252056] [INFO ] [REMOTE ] A: Fetching primary data for 2025-09. [2025-10-02T17:00:25.653715] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-02T17:00:25.660912] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-07. [2025-10-02T17:00:26.914280] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-02T17:00:26.957965] [INFO ] [REMOTE ] A: Fetching primary data for 2025-10. [2025-10-02T17:00:26.960575] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-02T17:00:26.973340] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-10. [2025-10-02T17:00:27.016496] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-02T17:00:27.024838] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-08. [2025-10-02T17:00:27.821104] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-07 (4.16 seconds). [2025-10-02T17:00:27.833000] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-08. [2025-10-02T17:00:28.146673] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-02T17:00:28.154903] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-09. [2025-10-02T17:00:28.502630] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-02T17:00:28.507672] [INFO ] [REMOTE ] AA: Full fetch complete (77538 records). [2025-10-02T17:00:28.507887] [DEBUG] [VALIDATOR ] AA: Validating primary data. [2025-10-02T17:00:28.656409] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-02T17:00:28.694533] [INFO ] [REMOTE ] A: Full fetch complete (73134 records). [2025-10-02T17:00:28.699907] [DEBUG] [VALIDATOR ] A: Validating primary data. [2025-10-02T17:00:29.407869] [DEBUG] [VALIDATOR ] AA: All expected trading days are present. [2025-10-02T17:00:29.413283] [DEBUG] [VALIDATOR ] AA: Primary data validation passed. [2025-10-02T17:00:29.419832] [INFO ] [MAIN ] AA: Fetched primary data is valid. [2025-10-02T17:00:29.437630] [DEBUG] [LOCAL ] AA: Saving primary data. [2025-10-02T17:00:29.533809] [DEBUG] [LOCAL ] AA: Trimmed 77538 records to 54005 (keeping 200 days of data) [2025-10-02T17:00:29.567387] [DEBUG] [VALIDATOR ] A: All expected trading days are present. [2025-10-02T17:00:29.568678] [DEBUG] [VALIDATOR ] A: Primary data validation passed. [2025-10-02T17:00:29.570667] [INFO ] [MAIN ] A: Fetched primary data is valid. [2025-10-02T17:00:29.571427] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-02T17:00:29.577952] [DEBUG] [LOCAL ] A: Saving primary data. [2025-10-02T17:00:29.584454] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-10. [2025-10-02T17:00:29.695957] [DEBUG] [LOCAL ] A: Trimmed 73134 records to 51103 (keeping 200 days of data) [2025-10-02T17:00:29.863543] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-02T17:00:29.882363] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-09. [2025-10-02T17:00:30.355210] [DEBUG] [LOCAL ] A: Primary data saved (51103 records). [2025-10-02T17:00:30.357058] [INFO ] [MAIN ] A: Full history saved. [2025-10-02T17:00:30.357860] [INFO ] [MAIN ] Update Progress: 3/2370 symbols completed. A took 26.5s. Estimated remaining: 5h 49m 2s. Rate: 6.8 symbols/min [2025-10-02T17:00:30.565324] [INFO ] [MAIN ] AAUC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:00:30.570808] [DEBUG] [LOCAL ] AAUC: No existing data file found in primary storage. [2025-10-02T17:00:30.571607] [WARN ] [MAIN ] AAUC: No existing data found, performing full refresh instead. [2025-10-02T17:00:30.573433] [INFO ] [MAIN ] AAUC: Wiping existing primary data before full refresh. [2025-10-02T17:00:30.573906] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-02T17:00:30.574838] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-02T17:00:30.575228] [INFO ] [MAIN ] AAUC: Starting full primary refresh. [2025-10-02T17:00:30.701703] [DEBUG] [LOCAL ] AA: Primary data saved (54005 records). [2025-10-02T17:00:30.701956] [INFO ] [MAIN ] AA: Full history saved. [2025-10-02T17:00:30.702843] [INFO ] [MAIN ] Update Progress: 4/2370 symbols completed. AA took 26.9s. Estimated remaining: 4h 25m 4s. Rate: 8.9 symbols/min [2025-10-02T17:00:30.919601] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-02T17:00:30.971216] [INFO ] [REMOTE ] AAT: Full fetch complete (42730 records). [2025-10-02T17:00:31.023778] [DEBUG] [VALIDATOR ] AAT: Validating primary data. [2025-10-02T17:00:31.186844] [INFO ] [MAIN ] AB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:00:31.468755] [DEBUG] [LOCAL ] AB: Loaded 27393 existing records from primary storage. [2025-10-02T17:00:31.462004] [INFO ] [REMOTE ] AAUC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:00:31.482563] [INFO ] [MAIN ] AB: Loaded 27393 existing records. [2025-10-02T17:00:31.514178] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2024-12. [2025-10-02T17:00:31.936715] [DEBUG] [VALIDATOR ] AAT: All expected trading days are present. [2025-10-02T17:00:31.910530] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T17:00:31.946611] [WARN ] [REMOTE ] AAUC: No data returned for month 2024-12 [2025-10-02T17:00:31.980791] [WARN ] [MAIN ] AB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:00:31.946470] [DEBUG] [VALIDATOR ] AAT: Primary data validation passed. [2025-10-02T17:00:31.981314] [FATAL] [REMOTE ] AAUC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T17:00:31.982061] [INFO ] [MAIN ] AAT: Fetched primary data is valid. [2025-10-02T17:00:31.982344] [FATAL] [MAIN ] AAUC: Failed to fetch primary data. [2025-10-02T17:00:31.982760] [DEBUG] [LOCAL ] AAT: Saving primary data. [2025-10-02T17:00:31.982958] [WARN ] [MAIN ] AAUC: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T17:00:31.982705] [INFO ] [MAIN ] AB: Wiping existing primary data before full refresh. [2025-10-02T17:00:31.983445] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-10-02T17:00:31.983568] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-02T17:00:32.009780] [DEBUG] [LOCAL ] AB: Deleted primary data file. [2025-10-02T17:00:32.013175] [INFO ] [MAIN ] AB: Starting full primary refresh. [2025-10-02T17:00:32.025850] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-02T17:00:32.031477] [DEBUG] [LOCAL ] AAT: Trimmed 42730 records to 30621 (keeping 200 days of data) [2025-10-02T17:00:32.054318] [INFO ] [LOCAL ] AAUC: Starting deletion of derivative data. [2025-10-02T17:00:32.066791] [DEBUG] [LOCAL ] AAUC: No derivative data file found to delete. [2025-10-02T17:00:32.067226] [INFO ] [MAIN ] Update Progress: 5/2370 symbols completed. AAUC took 1.7s. Estimated remaining: 3h 42m 43s. Rate: 10.6 symbols/min [2025-10-02T17:00:32.066592] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-02T17:00:32.279268] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-10. [2025-10-02T17:00:32.649840] [INFO ] [MAIN ] ABBV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:00:32.676887] [DEBUG] [LOCAL ] ABBV: No existing data file found in primary storage. [2025-10-02T17:00:32.677426] [WARN ] [MAIN ] ABBV: No existing data found, performing full refresh instead. [2025-10-02T17:00:32.699133] [INFO ] [MAIN ] ABBV: Wiping existing primary data before full refresh. [2025-10-02T17:00:32.722032] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-10-02T17:00:32.744452] [DEBUG] [LOCAL ] ABBV: No primary data file found to delete. [2025-10-02T17:00:32.774699] [INFO ] [MAIN ] ABBV: Starting full primary refresh. [2025-10-02T17:00:32.771713] [INFO ] [REMOTE ] AB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:00:32.801982] [INFO ] [REMOTE ] AB: Fetching primary data for 2024-12. [2025-10-02T17:00:33.265506] [INFO ] [REMOTE ] ABBV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:00:33.266350] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2024-12. [2025-10-02T17:00:33.279149] [DEBUG] [LOCAL ] AAT: Primary data saved (30621 records). [2025-10-02T17:00:33.279262] [INFO ] [MAIN ] AAT: Full history saved. [2025-10-02T17:00:33.279353] [INFO ] [MAIN ] Update Progress: 6/2370 symbols completed. AAT took 22.4s. Estimated remaining: 3h 13m 29s. Rate: 12.2 symbols/min [2025-10-02T17:00:33.472747] [INFO ] [MAIN ] ABCB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:00:33.472946] [DEBUG] [LOCAL ] ABCB: No existing data file found in primary storage. [2025-10-02T17:00:33.472990] [WARN ] [MAIN ] ABCB: No existing data found, performing full refresh instead. [2025-10-02T17:00:33.473113] [INFO ] [MAIN ] ABCB: Wiping existing primary data before full refresh. [2025-10-02T17:00:33.473158] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-10-02T17:00:33.473205] [DEBUG] [LOCAL ] ABCB: No primary data file found to delete. [2025-10-02T17:00:33.473242] [INFO ] [MAIN ] ABCB: Starting full primary refresh. [2025-10-02T17:00:33.881793] [INFO ] [REMOTE ] ABCB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:00:33.874889] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-02T17:00:33.883627] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2024-12. [2025-10-02T17:00:33.885618] [INFO ] [REMOTE ] AAP: Full fetch complete (75012 records). [2025-10-02T17:00:33.885811] [DEBUG] [VALIDATOR ] AAP: Validating primary data. [2025-10-02T17:00:34.333526] [DEBUG] [VALIDATOR ] AAP: All expected trading days are present. [2025-10-02T17:00:34.333752] [DEBUG] [VALIDATOR ] AAP: Primary data validation passed. [2025-10-02T17:00:34.334701] [INFO ] [MAIN ] AAP: Fetched primary data is valid. [2025-10-02T17:00:34.334972] [DEBUG] [LOCAL ] AAP: Saving primary data. [2025-10-02T17:00:34.336767] [DEBUG] [LOCAL ] AAP: Trimmed 75012 records to 52300 (keeping 200 days of data) [2025-10-02T17:00:34.477931] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-02T17:00:34.487673] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-01. [2025-10-02T17:00:34.715255] [DEBUG] [LOCAL ] AAP: Primary data saved (52300 records). [2025-10-02T17:00:34.715409] [INFO ] [MAIN ] AAP: Full history saved. [2025-10-02T17:00:34.716866] [INFO ] [MAIN ] Update Progress: 7/2370 symbols completed. AAP took 27.9s. Estimated remaining: 2h 53m 52s. Rate: 13.6 symbols/min [2025-10-02T17:00:34.901985] [INFO ] [MAIN ] ABEV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:00:34.954399] [DEBUG] [LOCAL ] ABEV: Loaded 53278 existing records from primary storage. [2025-10-02T17:00:34.954778] [INFO ] [MAIN ] ABEV: Loaded 53278 existing records. [2025-10-02T17:00:35.160687] [WARN ] [MAIN ] ABEV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:00:35.161490] [INFO ] [MAIN ] ABEV: Wiping existing primary data before full refresh. [2025-10-02T17:00:35.161753] [INFO ] [LOCAL ] ABEV: Starting deletion of primary data. [2025-10-02T17:00:35.162601] [DEBUG] [LOCAL ] ABEV: Deleted primary data file. [2025-10-02T17:00:35.162896] [INFO ] [MAIN ] ABEV: Starting full primary refresh. [2025-10-02T17:00:35.275584] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-02T17:00:35.304531] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-01. [2025-10-02T17:00:35.555701] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-10-02T17:00:35.591410] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-01. [2025-10-02T17:00:35.675946] [INFO ] [REMOTE ] ABEV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:00:35.676433] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2024-12. [2025-10-02T17:00:35.920771] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-02T17:00:35.928754] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-02. [2025-10-02T17:00:36.582627] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-02T17:00:36.590398] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-02. [2025-10-02T17:00:37.425513] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-02T17:00:37.436603] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-02. [2025-10-02T17:00:37.487926] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-02T17:00:37.494779] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-03. [2025-10-02T17:00:37.577549] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-02T17:00:37.586799] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-03. [2025-10-02T17:00:37.641088] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-02T17:00:37.652477] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-01. [2025-10-02T17:00:38.768575] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-02T17:00:38.779048] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-04. [2025-10-02T17:00:38.953709] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-02T17:00:38.963480] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-04. [2025-10-02T17:00:39.227314] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-02T17:00:39.238045] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-03. [2025-10-02T17:00:39.553621] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-02T17:00:39.565270] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-02. [2025-10-02T17:00:40.150310] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-02T17:00:40.158996] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-05. [2025-10-02T17:00:40.510303] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-02T17:00:40.524582] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-05. [2025-10-02T17:00:41.262536] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-02T17:00:41.273939] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-03. [2025-10-02T17:00:41.293966] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-02T17:00:41.301119] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-06. [2025-10-02T17:00:41.423811] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-02T17:00:41.435802] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-04. [2025-10-02T17:00:41.659039] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-02T17:00:41.666574] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-06. [2025-10-02T17:00:42.399750] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-02T17:00:42.406042] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-07. [2025-10-02T17:00:42.720445] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-02T17:00:42.725888] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-07. [2025-10-02T17:00:43.246451] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-02T17:00:43.258175] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-04. [2025-10-02T17:00:43.292248] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-02T17:00:43.303832] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-05. [2025-10-02T17:00:43.580624] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-02T17:00:43.586459] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-08. [2025-10-02T17:00:44.653317] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-02T17:00:44.658665] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-09. [2025-10-02T17:00:44.984627] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-10-02T17:00:44.992941] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-08. [2025-10-02T17:00:45.304628] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-02T17:00:45.316853] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-05. [2025-10-02T17:00:45.586409] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-10-02T17:00:45.598314] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-06. [2025-10-02T17:00:45.806421] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-02T17:00:45.814873] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-10. [2025-10-02T17:00:46.052708] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-02T17:00:46.059389] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-09. [2025-10-02T17:00:46.772581] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-02T17:00:46.774135] [INFO ] [REMOTE ] AB: Full fetch complete (45606 records). [2025-10-02T17:00:46.774248] [DEBUG] [VALIDATOR ] AB: Validating primary data. [2025-10-02T17:00:46.978910] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-02T17:00:47.034473] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-06. [2025-10-02T17:00:47.298895] [DEBUG] [VALIDATOR ] AB: All expected trading days are present. [2025-10-02T17:00:47.299028] [DEBUG] [VALIDATOR ] AB: Primary data validation passed. [2025-10-02T17:00:47.299802] [INFO ] [MAIN ] AB: Fetched primary data is valid. [2025-10-02T17:00:47.300029] [DEBUG] [LOCAL ] AB: Saving primary data. [2025-10-02T17:00:47.301737] [DEBUG] [LOCAL ] AB: Trimmed 45606 records to 27632 (keeping 200 days of data) [2025-10-02T17:00:47.465852] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-02T17:00:47.514424] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-02T17:00:47.510210] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-07. [2025-10-02T17:00:47.545758] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-10. [2025-10-02T17:00:47.575055] [DEBUG] [LOCAL ] AB: Primary data saved (27632 records). [2025-10-02T17:00:47.575159] [INFO ] [MAIN ] AB: Full history saved. [2025-10-02T17:00:47.575240] [INFO ] [MAIN ] Update Progress: 8/2370 symbols completed. AB took 16.9s. Estimated remaining: 3h 35m 20s. Rate: 11.0 symbols/min [2025-10-02T17:00:47.772222] [INFO ] [MAIN ] ABG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:00:47.793784] [DEBUG] [LOCAL ] ABG: Loaded 18569 existing records from primary storage. [2025-10-02T17:00:47.794064] [INFO ] [MAIN ] ABG: Loaded 18569 existing records. [2025-10-02T17:00:47.990833] [WARN ] [MAIN ] ABG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:00:47.991140] [INFO ] [MAIN ] ABG: Wiping existing primary data before full refresh. [2025-10-02T17:00:47.991201] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-10-02T17:00:47.991551] [DEBUG] [LOCAL ] ABG: Deleted primary data file. [2025-10-02T17:00:47.991623] [INFO ] [MAIN ] ABG: Starting full primary refresh. [2025-10-02T17:00:48.380556] [INFO ] [REMOTE ] ABG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:00:48.380979] [INFO ] [REMOTE ] ABG: Fetching primary data for 2024-12. [2025-10-02T17:00:48.522805] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-02T17:00:48.524379] [INFO ] [REMOTE ] ABCB: Full fetch complete (44563 records). [2025-10-02T17:00:48.524470] [DEBUG] [VALIDATOR ] ABCB: Validating primary data. [2025-10-02T17:00:48.949379] [DEBUG] [VALIDATOR ] ABCB: All expected trading days are present. [2025-10-02T17:00:48.949591] [DEBUG] [VALIDATOR ] ABCB: Primary data validation passed. [2025-10-02T17:00:48.950156] [INFO ] [MAIN ] ABCB: Fetched primary data is valid. [2025-10-02T17:00:48.959907] [DEBUG] [LOCAL ] ABCB: Saving primary data. [2025-10-02T17:00:48.979303] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-02T17:00:48.979434] [DEBUG] [LOCAL ] ABCB: Trimmed 44563 records to 30713 (keeping 200 days of data) [2025-10-02T17:00:48.991495] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-07. [2025-10-02T17:00:49.193934] [DEBUG] [LOCAL ] ABCB: Primary data saved (30713 records). [2025-10-02T17:00:49.194069] [INFO ] [MAIN ] ABCB: Full history saved. [2025-10-02T17:00:49.194202] [INFO ] [MAIN ] Update Progress: 9/2370 symbols completed. ABCB took 15.9s. Estimated remaining: 3h 18m 25s. Rate: 11.9 symbols/min [2025-10-02T17:00:49.384179] [INFO ] [MAIN ] ABM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:00:49.384560] [DEBUG] [LOCAL ] ABM: No existing data file found in primary storage. [2025-10-02T17:00:49.384704] [WARN ] [MAIN ] ABM: No existing data found, performing full refresh instead. [2025-10-02T17:00:49.384871] [INFO ] [MAIN ] ABM: Wiping existing primary data before full refresh. [2025-10-02T17:00:49.385028] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-10-02T17:00:49.385341] [DEBUG] [LOCAL ] ABM: No primary data file found to delete. [2025-10-02T17:00:49.385483] [INFO ] [MAIN ] ABM: Starting full primary refresh. [2025-10-02T17:00:49.447095] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-02T17:00:49.491051] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-01. [2025-10-02T17:00:49.823290] [INFO ] [REMOTE ] ABM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:00:49.823698] [INFO ] [REMOTE ] ABM: Fetching primary data for 2024-12. [2025-10-02T17:00:49.826373] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-02T17:00:49.839278] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-08. [2025-10-02T17:00:50.377089] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-02T17:00:50.381553] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-02. [2025-10-02T17:00:51.014991] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-02T17:00:51.026978] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-08. [2025-10-02T17:00:51.239587] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-02T17:00:51.245841] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-01. [2025-10-02T17:00:51.397333] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-02T17:00:51.401282] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-03. [2025-10-02T17:00:51.596585] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-02T17:00:51.608388] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-09. [2025-10-02T17:00:52.403717] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-02T17:00:52.410180] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-02. [2025-10-02T17:00:52.480939] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-02T17:00:52.486096] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-04. [2025-10-02T17:00:52.885280] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-02T17:00:52.898170] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-09. [2025-10-02T17:00:53.268752] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-02T17:00:53.275178] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-03. [2025-10-02T17:00:53.370700] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-02T17:00:53.393123] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-10. [2025-10-02T17:00:53.903246] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-02T17:00:53.913630] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-05. [2025-10-02T17:00:54.394491] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-02T17:00:54.401976] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-04. [2025-10-02T17:00:54.739116] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-02T17:00:54.753465] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-10. [2025-10-02T17:00:54.884365] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-02T17:00:54.888137] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-06. [2025-10-02T17:00:54.940126] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-02T17:00:54.942170] [INFO ] [REMOTE ] ABBV: Full fetch complete (77720 records). [2025-10-02T17:00:54.942280] [DEBUG] [VALIDATOR ] ABBV: Validating primary data. [2025-10-02T17:00:55.382528] [DEBUG] [VALIDATOR ] ABBV: All expected trading days are present. [2025-10-02T17:00:55.382622] [DEBUG] [VALIDATOR ] ABBV: Primary data validation passed. [2025-10-02T17:00:55.383357] [INFO ] [MAIN ] ABBV: Fetched primary data is valid. [2025-10-02T17:00:55.383415] [DEBUG] [LOCAL ] ABBV: Saving primary data. [2025-10-02T17:00:55.385083] [DEBUG] [LOCAL ] ABBV: Trimmed 77720 records to 54074 (keeping 200 days of data) [2025-10-02T17:00:55.668737] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-02T17:00:55.674959] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-07. [2025-10-02T17:00:55.785053] [DEBUG] [LOCAL ] ABBV: Primary data saved (54074 records). [2025-10-02T17:00:55.785204] [INFO ] [MAIN ] ABBV: Full history saved. [2025-10-02T17:00:55.785281] [INFO ] [MAIN ] Update Progress: 10/2370 symbols completed. ABBV took 23.7s. Estimated remaining: 3h 24m 25s. Rate: 11.5 symbols/min [2025-10-02T17:00:55.985561] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-02T17:00:56.006357] [INFO ] [MAIN ] ABR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:00:56.015077] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-05. [2025-10-02T17:00:56.078392] [DEBUG] [LOCAL ] ABR: Loaded 51995 existing records from primary storage. [2025-10-02T17:00:56.078862] [INFO ] [MAIN ] ABR: Loaded 51995 existing records. [2025-10-02T17:00:56.237219] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-02T17:00:56.286859] [INFO ] [REMOTE ] ABEV: Full fetch complete (77210 records). [2025-10-02T17:00:56.310667] [DEBUG] [VALIDATOR ] ABEV: Validating primary data. [2025-10-02T17:00:56.310499] [WARN ] [MAIN ] ABR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:00:56.310875] [INFO ] [MAIN ] ABR: Wiping existing primary data before full refresh. [2025-10-02T17:00:56.311085] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-10-02T17:00:56.311637] [DEBUG] [LOCAL ] ABR: Deleted primary data file. [2025-10-02T17:00:56.311787] [INFO ] [MAIN ] ABR: Starting full primary refresh. [2025-10-02T17:00:57.017152] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-02T17:00:57.054492] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-08. [2025-10-02T17:00:57.175066] [INFO ] [REMOTE ] ABR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:00:57.199633] [INFO ] [REMOTE ] ABR: Fetching primary data for 2024-12. [2025-10-02T17:00:57.228964] [DEBUG] [VALIDATOR ] ABEV: All expected trading days are present. [2025-10-02T17:00:57.236200] [DEBUG] [VALIDATOR ] ABEV: Primary data validation passed. [2025-10-02T17:00:57.247027] [INFO ] [MAIN ] ABEV: Fetched primary data is valid. [2025-10-02T17:00:57.247421] [DEBUG] [LOCAL ] ABEV: Saving primary data. [2025-10-02T17:00:57.250626] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-02T17:00:57.261737] [DEBUG] [LOCAL ] ABEV: Trimmed 77210 records to 53668 (keeping 200 days of data) [2025-10-02T17:00:57.262297] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-06. [2025-10-02T17:00:57.590139] [DEBUG] [LOCAL ] ABEV: Primary data saved (53668 records). [2025-10-02T17:00:57.590325] [INFO ] [MAIN ] ABEV: Full history saved. [2025-10-02T17:00:57.594172] [INFO ] [MAIN ] Update Progress: 11/2370 symbols completed. ABEV took 22.9s. Estimated remaining: 3h 12m 13s. Rate: 12.3 symbols/min [2025-10-02T17:00:57.796020] [INFO ] [MAIN ] ABT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:00:57.868278] [DEBUG] [LOCAL ] ABT: Loaded 53620 existing records from primary storage. [2025-10-02T17:00:57.868622] [INFO ] [MAIN ] ABT: Loaded 53620 existing records. [2025-10-02T17:00:58.074723] [WARN ] [MAIN ] ABT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:00:58.074972] [INFO ] [MAIN ] ABT: Wiping existing primary data before full refresh. [2025-10-02T17:00:58.075178] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-10-02T17:00:58.080759] [DEBUG] [LOCAL ] ABT: Deleted primary data file. [2025-10-02T17:00:58.088405] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-02T17:00:58.087917] [INFO ] [MAIN ] ABT: Starting full primary refresh. [2025-10-02T17:00:58.142106] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-09. [2025-10-02T17:00:58.506276] [INFO ] [REMOTE ] ABT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:00:58.506788] [INFO ] [REMOTE ] ABT: Fetching primary data for 2024-12. [2025-10-02T17:00:58.656528] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-02T17:00:58.664873] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-07. [2025-10-02T17:00:58.764488] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-02T17:00:58.775345] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-01. [2025-10-02T17:00:59.193964] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-02T17:00:59.197921] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-10. [2025-10-02T17:01:00.063728] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-02T17:01:00.072738] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-08. [2025-10-02T17:01:00.083043] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-02T17:01:00.084849] [INFO ] [REMOTE ] ABG: Full fetch complete (26594 records). [2025-10-02T17:01:00.085018] [DEBUG] [VALIDATOR ] ABG: Validating primary data. [2025-10-02T17:01:00.542454] [DEBUG] [VALIDATOR ] ABG: All expected trading days are present. [2025-10-02T17:01:00.543603] [DEBUG] [VALIDATOR ] ABG: Primary data validation passed. [2025-10-02T17:01:00.545163] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-02T17:01:00.556298] [INFO ] [MAIN ] ABG: Fetched primary data is valid. [2025-10-02T17:01:00.557410] [DEBUG] [LOCAL ] ABG: Saving primary data. [2025-10-02T17:01:00.558061] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-01. [2025-10-02T17:01:00.561108] [DEBUG] [LOCAL ] ABG: Trimmed 26594 records to 18742 (keeping 200 days of data) [2025-10-02T17:01:00.675310] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-02T17:01:00.689431] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-02. [2025-10-02T17:01:00.721145] [DEBUG] [LOCAL ] ABG: Primary data saved (18742 records). [2025-10-02T17:01:00.721329] [INFO ] [MAIN ] ABG: Full history saved. [2025-10-02T17:01:00.721492] [INFO ] [MAIN ] Update Progress: 12/2370 symbols completed. ABG took 13.1s. Estimated remaining: 3h 6m 22s. Rate: 12.7 symbols/min [2025-10-02T17:01:00.906710] [INFO ] [MAIN ] ACA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:01:00.906956] [DEBUG] [LOCAL ] ACA: No existing data file found in primary storage. [2025-10-02T17:01:00.907004] [WARN ] [MAIN ] ACA: No existing data found, performing full refresh instead. [2025-10-02T17:01:00.907126] [INFO ] [MAIN ] ACA: Wiping existing primary data before full refresh. [2025-10-02T17:01:00.907174] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-10-02T17:01:00.907221] [DEBUG] [LOCAL ] ACA: No primary data file found to delete. [2025-10-02T17:01:00.907264] [INFO ] [MAIN ] ACA: Starting full primary refresh. [2025-10-02T17:01:01.299584] [INFO ] [REMOTE ] ACA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:01:01.299940] [INFO ] [REMOTE ] ACA: Fetching primary data for 2024-12. [2025-10-02T17:01:01.771190] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-02T17:01:01.778803] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-09. [2025-10-02T17:01:02.176208] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-02T17:01:02.181296] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-01. [2025-10-02T17:01:02.306569] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-02T17:01:02.316895] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-03. [2025-10-02T17:01:02.391389] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-02T17:01:02.402808] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-02. [2025-10-02T17:01:03.047809] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-02T17:01:03.052902] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-02. [2025-10-02T17:01:03.284779] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-02T17:01:03.293363] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-10. [2025-10-02T17:01:04.209220] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-02T17:01:04.215036] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-03. [2025-10-02T17:01:04.344614] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-02T17:01:04.347099] [INFO ] [REMOTE ] ABM: Full fetch complete (44639 records). [2025-10-02T17:01:04.347257] [DEBUG] [VALIDATOR ] ABM: Validating primary data. [2025-10-02T17:01:04.348187] [FATAL] [VALIDATOR ] ABM: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:01:04.348301] [FATAL] [MAIN ] ABM: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:01:04.348411] [WARN ] [MAIN ] ABM: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:01:04.348508] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-10-02T17:01:04.348616] [DEBUG] [LOCAL ] ABM: No primary data file found to delete. [2025-10-02T17:01:04.348715] [INFO ] [LOCAL ] ABM: Starting deletion of derivative data. [2025-10-02T17:01:04.348820] [DEBUG] [LOCAL ] ABM: No derivative data file found to delete. [2025-10-02T17:01:04.348948] [INFO ] [MAIN ] Update Progress: 13/2370 symbols completed. ABM took 15.2s. Estimated remaining: 3h 2m 55s. Rate: 12.9 symbols/min [2025-10-02T17:01:04.590477] [INFO ] [MAIN ] ACCO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:01:04.606258] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-10-02T17:01:04.648596] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-10-02T17:01:04.654846] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-04. [2025-10-02T17:01:04.666903] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-03. [2025-10-02T17:01:04.705700] [DEBUG] [LOCAL ] ACCO: Loaded 37359 existing records from primary storage. [2025-10-02T17:01:04.706114] [INFO ] [MAIN ] ACCO: Loaded 37359 existing records. [2025-10-02T17:01:04.916364] [WARN ] [MAIN ] ACCO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:01:04.916631] [INFO ] [MAIN ] ACCO: Wiping existing primary data before full refresh. [2025-10-02T17:01:04.916718] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-10-02T17:01:04.917562] [DEBUG] [LOCAL ] ACCO: Deleted primary data file. [2025-10-02T17:01:04.917629] [INFO ] [MAIN ] ACCO: Starting full primary refresh. [2025-10-02T17:01:05.330916] [INFO ] [REMOTE ] ACCO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:01:05.331387] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2024-12. [2025-10-02T17:01:05.629116] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-02T17:01:05.636087] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-04. [2025-10-02T17:01:06.335533] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-02T17:01:06.348145] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-05. [2025-10-02T17:01:06.422067] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-02T17:01:06.434315] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-04. [2025-10-02T17:01:06.844420] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-02T17:01:06.852547] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-01. [2025-10-02T17:01:06.913305] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-02T17:01:06.919776] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-05. [2025-10-02T17:01:07.793567] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-02T17:01:07.799504] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-06. [2025-10-02T17:01:07.962298] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-02T17:01:07.970972] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-02. [2025-10-02T17:01:08.355523] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-02T17:01:08.367235] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-06. [2025-10-02T17:01:08.469031] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-02T17:01:08.482095] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-05. [2025-10-02T17:01:08.754616] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-02T17:01:08.760064] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-07. [2025-10-02T17:01:09.386591] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-02T17:01:09.395028] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-03. [2025-10-02T17:01:09.943121] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-02T17:01:09.956432] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-06. [2025-10-02T17:01:10.003277] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-02T17:01:10.004426] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-02T17:01:10.022874] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-07. [2025-10-02T17:01:10.024856] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-08. [2025-10-02T17:01:10.805749] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-02T17:01:10.815288] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-04. [2025-10-02T17:01:11.243004] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-02T17:01:11.249023] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-09. [2025-10-02T17:01:11.434995] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-02T17:01:11.449514] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-08. [2025-10-02T17:01:11.481241] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-02T17:01:11.493307] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-07. [2025-10-02T17:01:12.302725] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-02T17:01:12.307777] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-10. [2025-10-02T17:01:12.377786] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-02T17:01:12.386959] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-05. [2025-10-02T17:01:13.044911] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-02T17:01:13.046212] [INFO ] [REMOTE ] ACA: Full fetch complete (34305 records). [2025-10-02T17:01:13.046350] [DEBUG] [VALIDATOR ] ACA: Validating primary data. [2025-10-02T17:01:13.354858] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-02T17:01:13.418372] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-09. [2025-10-02T17:01:13.504091] [DEBUG] [VALIDATOR ] ACA: All expected trading days are present. [2025-10-02T17:01:13.504819] [DEBUG] [VALIDATOR ] ACA: Primary data validation passed. [2025-10-02T17:01:13.505516] [INFO ] [MAIN ] ACA: Fetched primary data is valid. [2025-10-02T17:01:13.505682] [DEBUG] [LOCAL ] ACA: Saving primary data. [2025-10-02T17:01:13.507322] [DEBUG] [LOCAL ] ACA: Trimmed 34305 records to 23486 (keeping 200 days of data) [2025-10-02T17:01:13.641108] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-02T17:01:13.658025] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-08. [2025-10-02T17:01:13.712401] [DEBUG] [LOCAL ] ACA: Primary data saved (23486 records). [2025-10-02T17:01:13.712550] [INFO ] [MAIN ] ACA: Full history saved. [2025-10-02T17:01:13.712745] [INFO ] [MAIN ] Update Progress: 14/2370 symbols completed. ACA took 13.0s. Estimated remaining: 3h 16m 3s. Rate: 12.0 symbols/min [2025-10-02T17:01:13.910219] [INFO ] [MAIN ] ACEL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:01:13.910413] [DEBUG] [LOCAL ] ACEL: No existing data file found in primary storage. [2025-10-02T17:01:13.910561] [WARN ] [MAIN ] ACEL: No existing data found, performing full refresh instead. [2025-10-02T17:01:13.910718] [INFO ] [MAIN ] ACEL: Wiping existing primary data before full refresh. [2025-10-02T17:01:13.910914] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-10-02T17:01:13.911064] [DEBUG] [LOCAL ] ACEL: No primary data file found to delete. [2025-10-02T17:01:13.911286] [INFO ] [MAIN ] ACEL: Starting full primary refresh. [2025-10-02T17:01:14.054151] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-02T17:01:14.116825] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-06. [2025-10-02T17:01:14.335042] [INFO ] [REMOTE ] ACEL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:01:14.673077] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2024-12. [2025-10-02T17:01:15.164284] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-02T17:01:15.404951] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-02T17:01:15.473022] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-09. [2025-10-02T17:01:15.760164] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-02T17:01:15.859449] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-02T17:01:16.273013] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-07. [2025-10-02T17:01:17.072968] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-10. [2025-10-02T17:01:17.595747] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-02T17:01:17.692360] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-02T17:01:17.873032] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-10. [2025-10-02T17:01:18.508779] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-02T17:01:18.512766] [INFO ] [REMOTE ] ABR: Full fetch complete (75234 records). [2025-10-02T17:01:18.512988] [DEBUG] [VALIDATOR ] ABR: Validating primary data. [2025-10-02T17:01:18.689125] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-01. [2025-10-02T17:01:18.986103] [DEBUG] [VALIDATOR ] ABR: All expected trading days are present. [2025-10-02T17:01:18.986207] [DEBUG] [VALIDATOR ] ABR: Primary data validation passed. [2025-10-02T17:01:18.987173] [INFO ] [MAIN ] ABR: Fetched primary data is valid. [2025-10-02T17:01:18.987311] [DEBUG] [LOCAL ] ABR: Saving primary data. [2025-10-02T17:01:18.989334] [DEBUG] [LOCAL ] ABR: Trimmed 75234 records to 52372 (keeping 200 days of data) [2025-10-02T17:01:19.331113] [DEBUG] [LOCAL ] ABR: Primary data saved (52372 records). [2025-10-02T17:01:19.331426] [INFO ] [MAIN ] ABR: Full history saved. [2025-10-02T17:01:19.333636] [INFO ] [MAIN ] Update Progress: 15/2370 symbols completed. ABR took 23.5s. Estimated remaining: 3h 17m 36s. Rate: 11.9 symbols/min [2025-10-02T17:01:19.447989] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-02T17:01:19.464251] [INFO ] [REMOTE ] ABT: Full fetch complete (77595 records). [2025-10-02T17:01:19.474781] [DEBUG] [VALIDATOR ] ABT: Validating primary data. [2025-10-02T17:01:19.474629] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-08. [2025-10-02T17:01:19.571477] [INFO ] [MAIN ] ACHR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:01:19.949343] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-02T17:01:19.974899] [DEBUG] [LOCAL ] ACHR: Loaded 53818 existing records from primary storage. [2025-10-02T17:01:20.001447] [INFO ] [MAIN ] ACHR: Loaded 53818 existing records. [2025-10-02T17:01:20.296892] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-02. [2025-10-02T17:01:20.301996] [DEBUG] [VALIDATOR ] ABT: All expected trading days are present. [2025-10-02T17:01:20.302109] [DEBUG] [VALIDATOR ] ABT: Primary data validation passed. [2025-10-02T17:01:20.304741] [INFO ] [MAIN ] ABT: Fetched primary data is valid. [2025-10-02T17:01:20.320438] [DEBUG] [LOCAL ] ABT: Saving primary data. [2025-10-02T17:01:20.327815] [WARN ] [MAIN ] ACHR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:01:20.328610] [INFO ] [MAIN ] ACHR: Wiping existing primary data before full refresh. [2025-10-02T17:01:20.328712] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-10-02T17:01:20.329191] [DEBUG] [LOCAL ] ACHR: Deleted primary data file. [2025-10-02T17:01:20.329354] [INFO ] [MAIN ] ACHR: Starting full primary refresh. [2025-10-02T17:01:20.411359] [DEBUG] [LOCAL ] ABT: Trimmed 77595 records to 54010 (keeping 200 days of data) [2025-10-02T17:01:20.827060] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-02T17:01:20.909308] [INFO ] [REMOTE ] ACHR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:01:21.081859] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2024-12. [2025-10-02T17:01:21.135029] [DEBUG] [LOCAL ] ABT: Primary data saved (54010 records). [2025-10-02T17:01:21.135163] [INFO ] [MAIN ] ABT: Full history saved. [2025-10-02T17:01:21.136084] [INFO ] [MAIN ] Update Progress: 16/2370 symbols completed. ABT took 23.5s. Estimated remaining: 3h 9m 36s. Rate: 12.4 symbols/min [2025-10-02T17:01:21.328849] [INFO ] [MAIN ] ACI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:01:21.402918] [DEBUG] [LOCAL ] ACI: Loaded 53259 existing records from primary storage. [2025-10-02T17:01:21.403350] [INFO ] [MAIN ] ACI: Loaded 53259 existing records. [2025-10-02T17:01:21.655982] [WARN ] [MAIN ] ACI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:01:21.673411] [INFO ] [MAIN ] ACI: Wiping existing primary data before full refresh. [2025-10-02T17:01:21.673531] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-10-02T17:01:21.675074] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-02T17:01:21.681398] [DEBUG] [LOCAL ] ACI: Deleted primary data file. [2025-10-02T17:01:21.681600] [INFO ] [MAIN ] ACI: Starting full primary refresh. [2025-10-02T17:01:21.880983] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-09. [2025-10-02T17:01:22.072272] [INFO ] [REMOTE ] ACI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:01:22.673041] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-03. [2025-10-02T17:01:23.324448] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-02T17:01:23.472991] [INFO ] [REMOTE ] ACI: Fetching primary data for 2024-12. [2025-10-02T17:01:23.621254] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2024-12 (2.54 seconds). [2025-10-02T17:01:23.661597] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-02T17:01:24.273049] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-01. [2025-10-02T17:01:25.072982] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-02T17:01:25.073126] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-04. [2025-10-02T17:01:25.873059] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-01. [2025-10-02T17:01:26.536357] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-02T17:01:26.673972] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-05. [2025-10-02T17:01:26.676815] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-01 (2.40 seconds). [2025-10-02T17:01:27.478457] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-02. [2025-10-02T17:01:27.505281] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-02T17:01:27.790158] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-02T17:01:28.273043] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-10. [2025-10-02T17:01:29.073017] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-06. [2025-10-02T17:01:29.636396] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-02T17:01:29.638224] [INFO ] [REMOTE ] ACCO: Full fetch complete (54002 records). [2025-10-02T17:01:29.638354] [DEBUG] [VALIDATOR ] ACCO: Validating primary data. [2025-10-02T17:01:29.878126] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-02. [2025-10-02T17:01:30.157035] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-02 (2.68 seconds). [2025-10-02T17:01:30.157373] [DEBUG] [VALIDATOR ] ACCO: All expected trading days are present. [2025-10-02T17:01:30.158676] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-02T17:01:30.168260] [DEBUG] [VALIDATOR ] ACCO: Primary data validation passed. [2025-10-02T17:01:30.177170] [INFO ] [MAIN ] ACCO: Fetched primary data is valid. [2025-10-02T17:01:30.177736] [DEBUG] [LOCAL ] ACCO: Saving primary data. [2025-10-02T17:01:30.179406] [DEBUG] [LOCAL ] ACCO: Trimmed 54002 records to 37574 (keeping 200 days of data) [2025-10-02T17:01:30.412565] [DEBUG] [LOCAL ] ACCO: Primary data saved (37574 records). [2025-10-02T17:01:30.412746] [INFO ] [MAIN ] ACCO: Full history saved. [2025-10-02T17:01:30.412844] [INFO ] [MAIN ] Update Progress: 17/2370 symbols completed. ACCO took 26.1s. Estimated remaining: 3h 19m 46s. Rate: 11.8 symbols/min [2025-10-02T17:01:30.617929] [INFO ] [MAIN ] ACM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:01:30.672306] [DEBUG] [LOCAL ] ACM: Loaded 43000 existing records from primary storage. [2025-10-02T17:01:30.672702] [INFO ] [MAIN ] ACM: Loaded 43000 existing records. [2025-10-02T17:01:30.678392] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-03. [2025-10-02T17:01:30.893140] [WARN ] [MAIN ] ACM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:01:30.893401] [INFO ] [MAIN ] ACM: Wiping existing primary data before full refresh. [2025-10-02T17:01:30.893451] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-10-02T17:01:30.894470] [DEBUG] [LOCAL ] ACM: Deleted primary data file. [2025-10-02T17:01:30.894534] [INFO ] [MAIN ] ACM: Starting full primary refresh. [2025-10-02T17:01:31.303819] [INFO ] [REMOTE ] ACM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:01:31.473206] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-07. [2025-10-02T17:01:31.617789] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-02T17:01:32.272969] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-03. [2025-10-02T17:01:32.712738] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-02T17:01:33.073050] [INFO ] [REMOTE ] ACM: Fetching primary data for 2024-12. [2025-10-02T17:01:33.319743] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-03 (2.64 seconds). [2025-10-02T17:01:33.530165] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-02T17:01:33.873044] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-04. [2025-10-02T17:01:34.482720] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-02T17:01:34.673041] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-01. [2025-10-02T17:01:35.473059] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-08. [2025-10-02T17:01:36.216992] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-02T17:01:36.273046] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-04. [2025-10-02T17:01:36.582772] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-02T17:01:36.723328] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-02T17:01:37.073027] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-09. [2025-10-02T17:01:37.873019] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-05. [2025-10-02T17:01:38.140491] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-02T17:01:38.202587] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-02T17:01:38.673025] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-02. [2025-10-02T17:01:39.473035] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-05. [2025-10-02T17:01:40.272978] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-10. [2025-10-02T17:01:40.372192] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-02T17:01:40.622519] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-05 (2.75 seconds). [2025-10-02T17:01:41.073002] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-06. [2025-10-02T17:01:41.081620] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-02T17:01:41.082789] [INFO ] [REMOTE ] ACEL: Full fetch complete (38519 records). [2025-10-02T17:01:41.082878] [DEBUG] [VALIDATOR ] ACEL: Validating primary data. [2025-10-02T17:01:41.083414] [FATAL] [VALIDATOR ] ACEL: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:01:41.083504] [FATAL] [MAIN ] ACEL: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:01:41.083574] [WARN ] [MAIN ] ACEL: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:01:41.083718] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-10-02T17:01:41.083815] [DEBUG] [LOCAL ] ACEL: No primary data file found to delete. [2025-10-02T17:01:41.083878] [INFO ] [LOCAL ] ACEL: Starting deletion of derivative data. [2025-10-02T17:01:41.083933] [DEBUG] [LOCAL ] ACEL: No derivative data file found to delete. [2025-10-02T17:01:41.083999] [INFO ] [MAIN ] Update Progress: 18/2370 symbols completed. ACEL took 27.4s. Estimated remaining: 3h 31m 50s. Rate: 11.1 symbols/min [2025-10-02T17:01:41.322710] [INFO ] [MAIN ] ACN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:01:41.328507] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-02T17:01:41.408350] [DEBUG] [LOCAL ] ACN: Loaded 53426 existing records from primary storage. [2025-10-02T17:01:41.408737] [INFO ] [MAIN ] ACN: Loaded 53426 existing records. [2025-10-02T17:01:41.622411] [WARN ] [MAIN ] ACN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:01:41.622661] [INFO ] [MAIN ] ACN: Wiping existing primary data before full refresh. [2025-10-02T17:01:41.622737] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-10-02T17:01:41.623493] [DEBUG] [LOCAL ] ACN: Deleted primary data file. [2025-10-02T17:01:41.623557] [INFO ] [MAIN ] ACN: Starting full primary refresh. [2025-10-02T17:01:41.885008] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-03. [2025-10-02T17:01:42.029479] [INFO ] [REMOTE ] ACN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:01:42.673011] [INFO ] [REMOTE ] ACN: Fetching primary data for 2024-12. [2025-10-02T17:01:43.472997] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-06. [2025-10-02T17:01:43.561332] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-02T17:01:43.735162] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-06 (2.66 seconds). [2025-10-02T17:01:44.278249] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-07. [2025-10-02T17:01:44.293515] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-02T17:01:45.002960] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-02T17:01:45.073003] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-07. [2025-10-02T17:01:45.873011] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-01. [2025-10-02T17:01:46.673019] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-04. [2025-10-02T17:01:47.012686] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-07 (2.73 seconds). [2025-10-02T17:01:47.061795] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-02T17:01:47.473025] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-08. [2025-10-02T17:01:47.609254] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-02T17:01:48.015148] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-02T17:01:48.273051] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-08. [2025-10-02T17:01:49.049024] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-02T17:01:49.073057] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-09. [2025-10-02T17:01:49.873069] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-05. [2025-10-02T17:01:50.672981] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-02. [2025-10-02T17:01:50.968895] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-08 (2.70 seconds). [2025-10-02T17:01:51.033690] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-02T17:01:51.074154] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-02T17:01:51.473041] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-10. [2025-10-02T17:01:52.272990] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-09. [2025-10-02T17:01:52.475773] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-02T17:01:52.814255] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-02T17:01:52.816350] [INFO ] [REMOTE ] ACI: Full fetch complete (77048 records). [2025-10-02T17:01:52.816487] [DEBUG] [VALIDATOR ] ACI: Validating primary data. [2025-10-02T17:01:53.078078] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-03. [2025-10-02T17:01:53.261763] [DEBUG] [VALIDATOR ] ACI: All expected trading days are present. [2025-10-02T17:01:53.261862] [DEBUG] [VALIDATOR ] ACI: Primary data validation passed. [2025-10-02T17:01:53.262706] [INFO ] [MAIN ] ACI: Fetched primary data is valid. [2025-10-02T17:01:53.262792] [DEBUG] [LOCAL ] ACI: Saving primary data. [2025-10-02T17:01:53.264447] [DEBUG] [LOCAL ] ACI: Trimmed 77048 records to 53643 (keeping 200 days of data) [2025-10-02T17:01:53.610789] [DEBUG] [LOCAL ] ACI: Primary data saved (53643 records). [2025-10-02T17:01:53.610938] [INFO ] [MAIN ] ACI: Full history saved. [2025-10-02T17:01:53.611763] [INFO ] [MAIN ] Update Progress: 19/2370 symbols completed. ACI took 32.5s. Estimated remaining: 3h 46m 26s. Rate: 10.4 symbols/min [2025-10-02T17:01:53.806095] [INFO ] [MAIN ] ACP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:01:53.840982] [DEBUG] [LOCAL ] ACP: Loaded 30980 existing records from primary storage. [2025-10-02T17:01:53.841274] [INFO ] [MAIN ] ACP: Loaded 30980 existing records. [2025-10-02T17:01:53.878178] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-06. [2025-10-02T17:01:54.049908] [WARN ] [MAIN ] ACP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:01:54.050157] [INFO ] [MAIN ] ACP: Wiping existing primary data before full refresh. [2025-10-02T17:01:54.050208] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-10-02T17:01:54.051046] [DEBUG] [LOCAL ] ACP: Deleted primary data file. [2025-10-02T17:01:54.051108] [INFO ] [MAIN ] ACP: Starting full primary refresh. [2025-10-02T17:01:54.460254] [INFO ] [REMOTE ] ACP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:01:54.521753] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-02T17:01:54.673011] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-10. [2025-10-02T17:01:55.305408] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-02T17:01:55.472990] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-04. [2025-10-02T17:01:55.525440] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-02T17:01:56.273002] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-07. [2025-10-02T17:01:56.717287] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-02T17:01:56.719552] [INFO ] [REMOTE ] ACHR: Full fetch complete (77998 records). [2025-10-02T17:01:56.719705] [DEBUG] [VALIDATOR ] ACHR: Validating primary data. [2025-10-02T17:01:57.078754] [INFO ] [REMOTE ] ACP: Fetching primary data for 2024-12. [2025-10-02T17:01:57.210950] [DEBUG] [VALIDATOR ] ACHR: All expected trading days are present. [2025-10-02T17:01:57.211172] [DEBUG] [VALIDATOR ] ACHR: Primary data validation passed. [2025-10-02T17:01:57.212486] [INFO ] [MAIN ] ACHR: Fetched primary data is valid. [2025-10-02T17:01:57.212772] [DEBUG] [LOCAL ] ACHR: Saving primary data. [2025-10-02T17:01:57.215855] [DEBUG] [LOCAL ] ACHR: Trimmed 77998 records to 54208 (keeping 200 days of data) [2025-10-02T17:01:57.251466] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-02T17:01:57.660802] [DEBUG] [LOCAL ] ACHR: Primary data saved (54208 records). [2025-10-02T17:01:57.660985] [INFO ] [MAIN ] ACHR: Full history saved. [2025-10-02T17:01:57.661093] [INFO ] [MAIN ] Update Progress: 20/2370 symbols completed. ACHR took 38.3s. Estimated remaining: 3h 42m 57s. Rate: 10.5 symbols/min [2025-10-02T17:01:57.873899] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-05. [2025-10-02T17:01:57.915609] [INFO ] [MAIN ] ACR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:01:57.892368] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-02T17:01:57.936526] [DEBUG] [LOCAL ] ACR: Loaded 5949 existing records from primary storage. [2025-10-02T17:01:57.936796] [INFO ] [MAIN ] ACR: Loaded 5949 existing records. [2025-10-02T17:01:58.178734] [WARN ] [MAIN ] ACR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:01:58.178996] [INFO ] [MAIN ] ACR: Wiping existing primary data before full refresh. [2025-10-02T17:01:58.179057] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-10-02T17:01:58.179410] [DEBUG] [LOCAL ] ACR: Deleted primary data file. [2025-10-02T17:01:58.179475] [INFO ] [MAIN ] ACR: Starting full primary refresh. [2025-10-02T17:01:58.597509] [INFO ] [REMOTE ] ACR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:01:58.655724] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-02T17:01:58.672988] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-01. [2025-10-02T17:01:59.408931] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-02T17:01:59.473006] [INFO ] [REMOTE ] ACR: Fetching primary data for 2024-12. [2025-10-02T17:02:00.056560] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-02T17:02:00.190691] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-02T17:02:00.273000] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-01. [2025-10-02T17:02:01.073358] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-02. [2025-10-02T17:02:01.074195] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-02T17:02:01.872979] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-02. [2025-10-02T17:02:02.330432] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-02T17:02:02.454361] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-02T17:02:02.673050] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-03. [2025-10-02T17:02:03.473115] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-03. [2025-10-02T17:02:03.503074] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-02T17:02:04.273086] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-04. [2025-10-02T17:02:04.855172] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-02T17:02:04.874118] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-02T17:02:05.073052] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-08. [2025-10-02T17:02:05.873018] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-06. [2025-10-02T17:02:06.675214] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-04. [2025-10-02T17:02:06.681120] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-02T17:02:07.473054] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-09. [2025-10-02T17:02:07.847889] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-02T17:02:08.034190] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-02T17:02:08.273041] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-05. [2025-10-02T17:02:08.988712] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-02T17:02:09.073047] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-05. [2025-10-02T17:02:09.129736] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-02T17:02:09.873022] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-10. [2025-10-02T17:02:10.524173] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-02T17:02:10.673047] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-07. [2025-10-02T17:02:11.374228] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-02T17:02:11.376237] [INFO ] [REMOTE ] ACM: Full fetch complete (62797 records). [2025-10-02T17:02:11.376350] [DEBUG] [VALIDATOR ] ACM: Validating primary data. [2025-10-02T17:02:11.478204] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-06. [2025-10-02T17:02:11.827733] [DEBUG] [VALIDATOR ] ACM: All expected trading days are present. [2025-10-02T17:02:11.827833] [DEBUG] [VALIDATOR ] ACM: Primary data validation passed. [2025-10-02T17:02:11.828528] [INFO ] [MAIN ] ACM: Fetched primary data is valid. [2025-10-02T17:02:11.828599] [DEBUG] [LOCAL ] ACM: Saving primary data. [2025-10-02T17:02:11.829984] [DEBUG] [LOCAL ] ACM: Trimmed 62797 records to 43361 (keeping 200 days of data) [2025-10-02T17:02:12.118439] [DEBUG] [LOCAL ] ACM: Primary data saved (43361 records). [2025-10-02T17:02:12.118578] [INFO ] [MAIN ] ACM: Full history saved. [2025-10-02T17:02:12.120791] [INFO ] [MAIN ] Update Progress: 21/2370 symbols completed. ACM took 41.7s. Estimated remaining: 3h 59m 12s. Rate: 9.8 symbols/min [2025-10-02T17:02:12.282016] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-06. [2025-10-02T17:02:12.319763] [INFO ] [MAIN ] ACRE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:02:12.359267] [DEBUG] [LOCAL ] ACRE: Loaded 33578 existing records from primary storage. [2025-10-02T17:02:12.359720] [INFO ] [MAIN ] ACRE: Loaded 33578 existing records. [2025-10-02T17:02:12.481624] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-02T17:02:12.578704] [WARN ] [MAIN ] ACRE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:02:12.579036] [INFO ] [MAIN ] ACRE: Wiping existing primary data before full refresh. [2025-10-02T17:02:12.579147] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-10-02T17:02:12.579828] [DEBUG] [LOCAL ] ACRE: Deleted primary data file. [2025-10-02T17:02:12.579892] [INFO ] [MAIN ] ACRE: Starting full primary refresh. [2025-10-02T17:02:12.987903] [INFO ] [REMOTE ] ACRE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:02:13.020721] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-10-02T17:02:13.073003] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-08. [2025-10-02T17:02:13.179025] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-02T17:02:13.873028] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-07. [2025-10-02T17:02:14.603779] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-02T17:02:14.672975] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-08. [2025-10-02T17:02:14.990982] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-02T17:02:15.244580] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-02T17:02:15.473047] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-09. [2025-10-02T17:02:16.273005] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-09. [2025-10-02T17:02:16.698049] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-02T17:02:17.073022] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-07. [2025-10-02T17:02:17.365694] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-02T17:02:17.873055] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-10. [2025-10-02T17:02:18.323400] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-02T17:02:18.673061] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-10. [2025-10-02T17:02:19.177723] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-02T17:02:19.178725] [INFO ] [REMOTE ] ACR: Full fetch complete (8616 records). [2025-10-02T17:02:19.178805] [DEBUG] [VALIDATOR ] ACR: Validating primary data. [2025-10-02T17:02:19.474692] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2024-12. [2025-10-02T17:02:19.511838] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-02T17:02:19.581706] [INFO ] [REMOTE ] ACN: Full fetch complete (77126 records). [2025-10-02T17:02:19.609837] [DEBUG] [VALIDATOR ] ACN: Validating primary data. [2025-10-02T17:02:19.610120] [DEBUG] [VALIDATOR ] ACR: All expected trading days are present. [2025-10-02T17:02:19.610243] [DEBUG] [VALIDATOR ] ACR: Primary data validation passed. [2025-10-02T17:02:19.610633] [INFO ] [MAIN ] ACR: Fetched primary data is valid. [2025-10-02T17:02:19.645298] [DEBUG] [LOCAL ] ACR: Saving primary data. [2025-10-02T17:02:19.698574] [DEBUG] [LOCAL ] ACR: Trimmed 8616 records to 5990 (keeping 200 days of data) [2025-10-02T17:02:20.005095] [DEBUG] [LOCAL ] ACR: Primary data saved (5990 records). [2025-10-02T17:02:20.020835] [INFO ] [MAIN ] ACR: Full history saved. [2025-10-02T17:02:20.026091] [INFO ] [MAIN ] Update Progress: 22/2370 symbols completed. ACR took 22.4s. Estimated remaining: 4h 2m 17s. Rate: 9.7 symbols/min [2025-10-02T17:02:20.225087] [DEBUG] [VALIDATOR ] ACN: All expected trading days are present. [2025-10-02T17:02:20.230634] [DEBUG] [VALIDATOR ] ACN: Primary data validation passed. [2025-10-02T17:02:20.236789] [INFO ] [MAIN ] ACN: Fetched primary data is valid. [2025-10-02T17:02:20.247159] [DEBUG] [LOCAL ] ACN: Saving primary data. [2025-10-02T17:02:20.277531] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-08. [2025-10-02T17:02:20.306579] [INFO ] [MAIN ] ACV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:02:20.307114] [DEBUG] [LOCAL ] ACV: No existing data file found in primary storage. [2025-10-02T17:02:20.307235] [WARN ] [MAIN ] ACV: No existing data found, performing full refresh instead. [2025-10-02T17:02:20.308423] [INFO ] [MAIN ] ACV: Wiping existing primary data before full refresh. [2025-10-02T17:02:20.308604] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-10-02T17:02:20.308698] [DEBUG] [LOCAL ] ACV: No primary data file found to delete. [2025-10-02T17:02:20.308748] [INFO ] [MAIN ] ACV: Starting full primary refresh. [2025-10-02T17:02:20.314054] [DEBUG] [LOCAL ] ACN: Trimmed 77126 records to 53816 (keeping 200 days of data) [2025-10-02T17:02:20.889984] [INFO ] [REMOTE ] ACV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:02:21.031704] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-02T17:02:21.103592] [INFO ] [REMOTE ] ACV: Fetching primary data for 2024-12. [2025-10-02T17:02:21.160803] [DEBUG] [LOCAL ] ACN: Primary data saved (53816 records). [2025-10-02T17:02:21.160956] [INFO ] [MAIN ] ACN: Full history saved. [2025-10-02T17:02:21.161042] [INFO ] [MAIN ] Update Progress: 23/2370 symbols completed. ACN took 40.1s. Estimated remaining: 3h 53m 35s. Rate: 10.0 symbols/min [2025-10-02T17:02:21.356978] [INFO ] [MAIN ] ACVA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:02:21.404330] [DEBUG] [LOCAL ] ACVA: Loaded 49250 existing records from primary storage. [2025-10-02T17:02:21.404701] [INFO ] [MAIN ] ACVA: Loaded 49250 existing records. [2025-10-02T17:02:21.611581] [WARN ] [MAIN ] ACVA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:02:21.612081] [INFO ] [MAIN ] ACVA: Wiping existing primary data before full refresh. [2025-10-02T17:02:21.612161] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-10-02T17:02:21.612816] [DEBUG] [LOCAL ] ACVA: Deleted primary data file. [2025-10-02T17:02:21.612884] [INFO ] [MAIN ] ACVA: Starting full primary refresh. [2025-10-02T17:02:21.890582] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-01. [2025-10-02T17:02:22.013422] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-02T17:02:22.015564] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-02T17:02:22.116145] [INFO ] [REMOTE ] ACVA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:02:22.673021] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2024-12. [2025-10-02T17:02:23.291289] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-02T17:02:23.473036] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-02. [2025-10-02T17:02:24.015566] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-02T17:02:24.273017] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-09. [2025-10-02T17:02:25.045098] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-02T17:02:25.073086] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-03. [2025-10-02T17:02:25.162906] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-02T17:02:25.873053] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-01. [2025-10-02T17:02:26.600512] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-02T17:02:26.612714] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-02T17:02:26.673014] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-01. [2025-10-02T17:02:27.473055] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-04. [2025-10-02T17:02:27.980229] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-02T17:02:28.273055] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-02. [2025-10-02T17:02:28.859293] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-02T17:02:29.073019] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-03. [2025-10-02T17:02:29.140184] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-02T17:02:29.793361] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-02T17:02:29.873053] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-10. [2025-10-02T17:02:30.673018] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-04. [2025-10-02T17:02:30.933493] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-02T17:02:30.935476] [INFO ] [REMOTE ] ACP: Full fetch complete (47352 records). [2025-10-02T17:02:30.935564] [DEBUG] [VALIDATOR ] ACP: Validating primary data. [2025-10-02T17:02:31.330683] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-02T17:02:31.404548] [DEBUG] [VALIDATOR ] ACP: All expected trading days are present. [2025-10-02T17:02:31.404635] [DEBUG] [VALIDATOR ] ACP: Primary data validation passed. [2025-10-02T17:02:31.405159] [INFO ] [MAIN ] ACP: Fetched primary data is valid. [2025-10-02T17:02:31.405209] [DEBUG] [LOCAL ] ACP: Saving primary data. [2025-10-02T17:02:31.406216] [DEBUG] [LOCAL ] ACP: Trimmed 47352 records to 31272 (keeping 200 days of data) [2025-10-02T17:02:31.473202] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-05. [2025-10-02T17:02:31.609091] [DEBUG] [LOCAL ] ACP: Primary data saved (31272 records). [2025-10-02T17:02:31.609241] [INFO ] [MAIN ] ACP: Full history saved. [2025-10-02T17:02:31.609328] [INFO ] [MAIN ] Update Progress: 24/2370 symbols completed. ACP took 38.0s. Estimated remaining: 4h 0m 47s. Rate: 9.7 symbols/min [2025-10-02T17:02:31.802947] [INFO ] [MAIN ] AD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:02:31.803156] [DEBUG] [LOCAL ] AD: No existing data file found in primary storage. [2025-10-02T17:02:31.803208] [WARN ] [MAIN ] AD: No existing data found, performing full refresh instead. [2025-10-02T17:02:31.803343] [INFO ] [MAIN ] AD: Wiping existing primary data before full refresh. [2025-10-02T17:02:31.803435] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-02T17:02:31.803490] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-02T17:02:31.803528] [INFO ] [MAIN ] AD: Starting full primary refresh. [2025-10-02T17:02:32.227034] [INFO ] [REMOTE ] AD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:02:32.273026] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-02. [2025-10-02T17:02:32.924112] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-02T17:02:33.073035] [INFO ] [REMOTE ] AD: Fetching primary data for 2024-12. [2025-10-02T17:02:33.258892] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T17:02:33.259197] [WARN ] [REMOTE ] AD: No data returned for month 2024-12 [2025-10-02T17:02:33.259273] [FATAL] [REMOTE ] AD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T17:02:33.259317] [FATAL] [MAIN ] AD: Failed to fetch primary data. [2025-10-02T17:02:33.259401] [WARN ] [MAIN ] AD: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T17:02:33.259481] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-02T17:02:33.259552] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-02T17:02:33.259598] [INFO ] [LOCAL ] AD: Starting deletion of derivative data. [2025-10-02T17:02:33.259714] [DEBUG] [LOCAL ] AD: No derivative data file found to delete. [2025-10-02T17:02:33.259785] [INFO ] [MAIN ] Update Progress: 25/2370 symbols completed. AD took 1.7s. Estimated remaining: 3h 53m 38s. Rate: 10.0 symbols/min [2025-10-02T17:02:33.449246] [INFO ] [MAIN ] ADC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:02:33.499950] [DEBUG] [LOCAL ] ADC: Loaded 46164 existing records from primary storage. [2025-10-02T17:02:33.500285] [INFO ] [MAIN ] ADC: Loaded 46164 existing records. [2025-10-02T17:02:33.716594] [WARN ] [MAIN ] ADC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:02:33.716954] [INFO ] [MAIN ] ADC: Wiping existing primary data before full refresh. [2025-10-02T17:02:33.717038] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-10-02T17:02:33.717788] [DEBUG] [LOCAL ] ADC: Deleted primary data file. [2025-10-02T17:02:33.717857] [INFO ] [MAIN ] ADC: Starting full primary refresh. [2025-10-02T17:02:33.878464] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-06. [2025-10-02T17:02:33.951729] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-02T17:02:34.149717] [INFO ] [REMOTE ] ADC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:02:34.673007] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-05. [2025-10-02T17:02:34.885848] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-02T17:02:35.378801] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-02T17:02:35.473010] [INFO ] [REMOTE ] ADC: Fetching primary data for 2024-12. [2025-10-02T17:02:36.273037] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-06. [2025-10-02T17:02:36.726125] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-02T17:02:37.019254] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-02T17:02:37.072992] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-01. [2025-10-02T17:02:37.873021] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-03. [2025-10-02T17:02:38.672998] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-07. [2025-10-02T17:02:38.708360] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-02T17:02:39.127601] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-02T17:02:39.473010] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-07. [2025-10-02T17:02:39.941621] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-02T17:02:40.099941] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-02T17:02:40.273047] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-08. [2025-10-02T17:02:40.788241] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-02T17:02:41.073010] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-09. [2025-10-02T17:02:41.872986] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-04. [2025-10-02T17:02:41.889208] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-02T17:02:42.672998] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-02. [2025-10-02T17:02:43.473002] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-08. [2025-10-02T17:02:43.537760] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-02T17:02:44.267672] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-02T17:02:44.276361] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-05. [2025-10-02T17:02:44.925376] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-02T17:02:45.073026] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-03. [2025-10-02T17:02:45.643788] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-02T17:02:45.873037] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-10. [2025-10-02T17:02:46.621892] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-02T17:02:46.673014] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-06. [2025-10-02T17:02:46.684706] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-02T17:02:46.685986] [INFO ] [REMOTE ] ACV: Full fetch complete (10066 records). [2025-10-02T17:02:46.686079] [DEBUG] [VALIDATOR ] ACV: Validating primary data. [2025-10-02T17:02:47.084079] [DEBUG] [VALIDATOR ] ACV: All expected trading days are present. [2025-10-02T17:02:47.084161] [DEBUG] [VALIDATOR ] ACV: Primary data validation passed. [2025-10-02T17:02:47.084373] [INFO ] [MAIN ] ACV: Fetched primary data is valid. [2025-10-02T17:02:47.084414] [DEBUG] [LOCAL ] ACV: Saving primary data. [2025-10-02T17:02:47.084930] [DEBUG] [LOCAL ] ACV: Trimmed 10066 records to 7383 (keeping 200 days of data) [2025-10-02T17:02:47.133279] [DEBUG] [LOCAL ] ACV: Primary data saved (7383 records). [2025-10-02T17:02:47.133468] [INFO ] [MAIN ] ACV: Full history saved. [2025-10-02T17:02:47.133558] [INFO ] [MAIN ] Update Progress: 26/2370 symbols completed. ACV took 27.1s. Estimated remaining: 4h 5m 24s. Rate: 9.6 symbols/min [2025-10-02T17:02:47.325572] [INFO ] [MAIN ] ADCT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:02:47.365015] [DEBUG] [LOCAL ] ADCT: Loaded 34581 existing records from primary storage. [2025-10-02T17:02:47.365333] [INFO ] [MAIN ] ADCT: Loaded 34581 existing records. [2025-10-02T17:02:47.479015] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-09. [2025-10-02T17:02:47.586475] [WARN ] [MAIN ] ADCT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:02:47.586753] [INFO ] [MAIN ] ADCT: Wiping existing primary data before full refresh. [2025-10-02T17:02:47.586834] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-10-02T17:02:47.587758] [DEBUG] [LOCAL ] ADCT: Deleted primary data file. [2025-10-02T17:02:47.587819] [INFO ] [MAIN ] ADCT: Starting full primary refresh. [2025-10-02T17:02:47.985806] [INFO ] [REMOTE ] ADCT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:02:48.239523] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-02T17:02:48.273004] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-04. [2025-10-02T17:02:48.842066] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-02T17:02:49.073003] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-10. [2025-10-02T17:02:49.873026] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-07. [2025-10-02T17:02:50.166671] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-02T17:02:50.278545] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-02T17:02:50.282467] [INFO ] [REMOTE ] ACRE: Full fetch complete (50758 records). [2025-10-02T17:02:50.282586] [DEBUG] [VALIDATOR ] ACRE: Validating primary data. [2025-10-02T17:02:50.689535] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2024-12. [2025-10-02T17:02:50.752974] [DEBUG] [VALIDATOR ] ACRE: All expected trading days are present. [2025-10-02T17:02:50.753124] [DEBUG] [VALIDATOR ] ACRE: Primary data validation passed. [2025-10-02T17:02:50.753775] [INFO ] [MAIN ] ACRE: Fetched primary data is valid. [2025-10-02T17:02:50.753851] [DEBUG] [LOCAL ] ACRE: Saving primary data. [2025-10-02T17:02:50.755191] [DEBUG] [LOCAL ] ACRE: Trimmed 50758 records to 33897 (keeping 200 days of data) [2025-10-02T17:02:50.962391] [DEBUG] [LOCAL ] ACRE: Primary data saved (33897 records). [2025-10-02T17:02:50.962541] [INFO ] [MAIN ] ACRE: Full history saved. [2025-10-02T17:02:50.962629] [INFO ] [MAIN ] Update Progress: 27/2370 symbols completed. ACRE took 38.8s. Estimated remaining: 4h 1m 45s. Rate: 9.7 symbols/min [2025-10-02T17:02:51.171516] [INFO ] [MAIN ] ADM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:02:51.229403] [DEBUG] [LOCAL ] ADM: Loaded 53394 existing records from primary storage. [2025-10-02T17:02:51.229879] [INFO ] [MAIN ] ADM: Loaded 53394 existing records. [2025-10-02T17:02:51.446240] [WARN ] [MAIN ] ADM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:02:51.446554] [INFO ] [MAIN ] ADM: Wiping existing primary data before full refresh. [2025-10-02T17:02:51.446633] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-10-02T17:02:51.447507] [DEBUG] [LOCAL ] ADM: Deleted primary data file. [2025-10-02T17:02:51.447571] [INFO ] [MAIN ] ADM: Starting full primary refresh. [2025-10-02T17:02:51.472994] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-05. [2025-10-02T17:02:51.880844] [INFO ] [REMOTE ] ADM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:02:51.910632] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-02T17:02:52.111925] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-02T17:02:52.272998] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-08. [2025-10-02T17:02:53.024808] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-02T17:02:53.073147] [INFO ] [REMOTE ] ADM: Fetching primary data for 2024-12. [2025-10-02T17:02:53.604044] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-02T17:02:53.873048] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-01. [2025-10-02T17:02:54.672998] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-06. [2025-10-02T17:02:54.891490] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-02T17:02:54.976617] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-02T17:02:55.473007] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-02. [2025-10-02T17:02:56.192163] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-02T17:02:56.273034] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-01. [2025-10-02T17:02:56.319726] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-02T17:02:57.073051] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-07. [2025-10-02T17:02:57.873078] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-09. [2025-10-02T17:02:57.937956] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-02T17:02:58.474847] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-02T17:02:58.673053] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-03. [2025-10-02T17:02:59.438704] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-02T17:02:59.473020] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-10. [2025-10-02T17:02:59.923614] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-02T17:03:00.273078] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-02. [2025-10-02T17:03:01.012475] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-02T17:03:01.014792] [INFO ] [REMOTE ] ACVA: Full fetch complete (70382 records). [2025-10-02T17:03:01.014923] [DEBUG] [VALIDATOR ] ACVA: Validating primary data. [2025-10-02T17:03:01.078706] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-08. [2025-10-02T17:03:01.450836] [DEBUG] [VALIDATOR ] ACVA: All expected trading days are present. [2025-10-02T17:03:01.450942] [DEBUG] [VALIDATOR ] ACVA: Primary data validation passed. [2025-10-02T17:03:01.451752] [INFO ] [MAIN ] ACVA: Fetched primary data is valid. [2025-10-02T17:03:01.451821] [DEBUG] [LOCAL ] ACVA: Saving primary data. [2025-10-02T17:03:01.453535] [DEBUG] [LOCAL ] ACVA: Trimmed 70382 records to 49607 (keeping 200 days of data) [2025-10-02T17:03:01.775466] [DEBUG] [LOCAL ] ACVA: Primary data saved (49607 records). [2025-10-02T17:03:01.775710] [INFO ] [MAIN ] ACVA: Full history saved. [2025-10-02T17:03:01.777140] [INFO ] [MAIN ] Update Progress: 28/2370 symbols completed. ACVA took 40.6s. Estimated remaining: 4h 8m 5s. Rate: 9.4 symbols/min [2025-10-02T17:03:01.878350] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-04. [2025-10-02T17:03:01.983314] [INFO ] [MAIN ] ADNT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:03:02.037423] [DEBUG] [LOCAL ] ADNT: Loaded 47202 existing records from primary storage. [2025-10-02T17:03:02.037877] [INFO ] [MAIN ] ADNT: Loaded 47202 existing records. [2025-10-02T17:03:02.264508] [WARN ] [MAIN ] ADNT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:03:02.283067] [INFO ] [MAIN ] ADNT: Wiping existing primary data before full refresh. [2025-10-02T17:03:02.283245] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-10-02T17:03:02.285306] [DEBUG] [LOCAL ] ADNT: Deleted primary data file. [2025-10-02T17:03:02.285230] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-02T17:03:02.285573] [INFO ] [MAIN ] ADNT: Starting full primary refresh. [2025-10-02T17:03:02.681513] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-03. [2025-10-02T17:03:02.731257] [INFO ] [REMOTE ] ADNT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:03:02.767237] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-02T17:03:03.336301] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-02T17:03:03.473058] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-09. [2025-10-02T17:03:04.273074] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2024-12. [2025-10-02T17:03:04.787768] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-02T17:03:04.846134] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-02T17:03:05.073027] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-04. [2025-10-02T17:03:05.808028] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-02T17:03:05.872997] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-05. [2025-10-02T17:03:06.566239] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-02T17:03:06.673013] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-10. [2025-10-02T17:03:06.779536] [DEBUG] [REMOTE ] ADC: Error fetching primary data for 2025-10: 'API call returned an empty response.' [2025-10-02T17:03:06.779908] [WARN ] [REMOTE ] ADC: No data returned for month 2025-10 [2025-10-02T17:03:06.779999] [FATAL] [REMOTE ] ADC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T17:03:06.780082] [FATAL] [MAIN ] ADC: Failed to fetch primary data. [2025-10-02T17:03:06.780198] [WARN ] [MAIN ] ADC: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T17:03:06.780281] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-10-02T17:03:06.780370] [DEBUG] [LOCAL ] ADC: No primary data file found to delete. [2025-10-02T17:03:06.780459] [INFO ] [LOCAL ] ADC: Starting deletion of derivative data. [2025-10-02T17:03:06.780909] [DEBUG] [LOCAL ] ADC: Deleted derivative data file. [2025-10-02T17:03:06.782765] [INFO ] [MAIN ] Update Progress: 29/2370 symbols completed. ADC took 33.5s. Estimated remaining: 4h 6m 10s. Rate: 9.5 symbols/min [2025-10-02T17:03:06.987274] [INFO ] [MAIN ] ADT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:03:07.046431] [DEBUG] [LOCAL ] ADT: Loaded 53455 existing records from primary storage. [2025-10-02T17:03:07.046859] [INFO ] [MAIN ] ADT: Loaded 53455 existing records. [2025-10-02T17:03:07.263016] [WARN ] [MAIN ] ADT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:03:07.270580] [INFO ] [MAIN ] ADT: Wiping existing primary data before full refresh. [2025-10-02T17:03:07.271408] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-02T17:03:07.271491] [INFO ] [LOCAL ] ADT: Starting deletion of primary data. [2025-10-02T17:03:07.281365] [DEBUG] [LOCAL ] ADT: Deleted primary data file. [2025-10-02T17:03:07.281449] [INFO ] [MAIN ] ADT: Starting full primary refresh. [2025-10-02T17:03:07.478173] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-06. [2025-10-02T17:03:07.682937] [INFO ] [REMOTE ] ADT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:03:08.273023] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-01. [2025-10-02T17:03:09.057720] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-02T17:03:09.072983] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-07. [2025-10-02T17:03:09.505217] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-02T17:03:09.873044] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-02. [2025-10-02T17:03:10.568736] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-02T17:03:10.673044] [INFO ] [REMOTE ] ADT: Fetching primary data for 2024-12. [2025-10-02T17:03:11.219785] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-02T17:03:11.473049] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-08. [2025-10-02T17:03:12.273016] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-05. [2025-10-02T17:03:12.431270] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-02T17:03:12.550817] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-02T17:03:13.073062] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-01. [2025-10-02T17:03:13.873003] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-09. [2025-10-02T17:03:14.005676] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-02T17:03:14.583973] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-02T17:03:14.673057] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-02. [2025-10-02T17:03:15.406063] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-02T17:03:15.472986] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-03. [2025-10-02T17:03:16.181190] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-02T17:03:16.273004] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-03. [2025-10-02T17:03:17.012568] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-02T17:03:17.073031] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-10. [2025-10-02T17:03:17.872988] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-06. [2025-10-02T17:03:18.149581] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-02T17:03:18.170487] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-02T17:03:18.172247] [INFO ] [REMOTE ] ADCT: Full fetch complete (51432 records). [2025-10-02T17:03:18.172347] [DEBUG] [VALIDATOR ] ADCT: Validating primary data. [2025-10-02T17:03:18.606415] [DEBUG] [VALIDATOR ] ADCT: All expected trading days are present. [2025-10-02T17:03:18.606509] [DEBUG] [VALIDATOR ] ADCT: Primary data validation passed. [2025-10-02T17:03:18.607128] [INFO ] [MAIN ] ADCT: Fetched primary data is valid. [2025-10-02T17:03:18.607194] [DEBUG] [LOCAL ] ADCT: Saving primary data. [2025-10-02T17:03:18.608510] [DEBUG] [LOCAL ] ADCT: Trimmed 51432 records to 34861 (keeping 200 days of data) [2025-10-02T17:03:18.694775] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-04. [2025-10-02T17:03:18.822311] [DEBUG] [LOCAL ] ADCT: Primary data saved (34861 records). [2025-10-02T17:03:18.822463] [INFO ] [MAIN ] ADCT: Full history saved. [2025-10-02T17:03:18.827137] [INFO ] [MAIN ] Update Progress: 30/2370 symbols completed. ADCT took 31.7s. Estimated remaining: 4h 13m 31s. Rate: 9.2 symbols/min [2025-10-02T17:03:19.015281] [INFO ] [MAIN ] ADX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:03:19.044841] [DEBUG] [LOCAL ] ADX: Loaded 27468 existing records from primary storage. [2025-10-02T17:03:19.045117] [INFO ] [MAIN ] ADX: Loaded 27468 existing records. [2025-10-02T17:03:19.252335] [WARN ] [MAIN ] ADX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:03:19.252729] [INFO ] [MAIN ] ADX: Wiping existing primary data before full refresh. [2025-10-02T17:03:19.252809] [INFO ] [LOCAL ] ADX: Starting deletion of primary data. [2025-10-02T17:03:19.253682] [DEBUG] [LOCAL ] ADX: Deleted primary data file. [2025-10-02T17:03:19.253793] [INFO ] [MAIN ] ADX: Starting full primary refresh. [2025-10-02T17:03:19.476704] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-04. [2025-10-02T17:03:19.478470] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-02T17:03:19.740486] [INFO ] [REMOTE ] ADX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:03:20.244445] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-02T17:03:20.272979] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-05. [2025-10-02T17:03:21.073023] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-07. [2025-10-02T17:03:21.357719] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-02T17:03:21.810620] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-02T17:03:21.873065] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-06. [2025-10-02T17:03:22.661672] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-02T17:03:22.673147] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-05. [2025-10-02T17:03:23.422112] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-02T17:03:23.473003] [INFO ] [REMOTE ] ADX: Fetching primary data for 2024-12. [2025-10-02T17:03:24.273049] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-08. [2025-10-02T17:03:24.456440] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-02T17:03:24.562102] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-02T17:03:25.073001] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-01. [2025-10-02T17:03:25.873059] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-07. [2025-10-02T17:03:26.170267] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-02T17:03:26.376679] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-02T17:03:26.672993] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-02. [2025-10-02T17:03:27.344824] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-02T17:03:27.473008] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-08. [2025-10-02T17:03:27.650317] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-02T17:03:28.273041] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-06. [2025-10-02T17:03:29.071798] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-02T17:03:29.081020] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-03. [2025-10-02T17:03:29.873027] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-09. [2025-10-02T17:03:29.973233] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-02T17:03:30.295339] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-02T17:03:30.673045] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-09. [2025-10-02T17:03:31.286777] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-02T17:03:31.473015] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-10. [2025-10-02T17:03:32.273050] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-04. [2025-10-02T17:03:32.677813] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-02T17:03:32.821248] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-02T17:03:32.823451] [INFO ] [REMOTE ] ADNT: Full fetch complete (67932 records). [2025-10-02T17:03:32.823680] [DEBUG] [VALIDATOR ] ADNT: Validating primary data. [2025-10-02T17:03:33.081486] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-10. [2025-10-02T17:03:33.279430] [DEBUG] [VALIDATOR ] ADNT: All expected trading days are present. [2025-10-02T17:03:33.279556] [DEBUG] [VALIDATOR ] ADNT: Primary data validation passed. [2025-10-02T17:03:33.280558] [INFO ] [MAIN ] ADNT: Fetched primary data is valid. [2025-10-02T17:03:33.280671] [DEBUG] [LOCAL ] ADNT: Saving primary data. [2025-10-02T17:03:33.282470] [DEBUG] [LOCAL ] ADNT: Trimmed 67932 records to 47495 (keeping 200 days of data) [2025-10-02T17:03:33.619317] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-02T17:03:33.636769] [DEBUG] [LOCAL ] ADNT: Primary data saved (47495 records). [2025-10-02T17:03:33.636872] [INFO ] [MAIN ] ADNT: Full history saved. [2025-10-02T17:03:33.638334] [INFO ] [MAIN ] Update Progress: 31/2370 symbols completed. ADNT took 31.9s. Estimated remaining: 4h 23m 52s. Rate: 8.9 symbols/min [2025-10-02T17:03:33.818899] [INFO ] [MAIN ] AEE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:03:33.874539] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-05. [2025-10-02T17:03:33.876711] [DEBUG] [LOCAL ] AEE: Loaded 50091 existing records from primary storage. [2025-10-02T17:03:33.877099] [INFO ] [MAIN ] AEE: Loaded 50091 existing records. [2025-10-02T17:03:34.075424] [WARN ] [MAIN ] AEE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:03:34.075735] [INFO ] [MAIN ] AEE: Wiping existing primary data before full refresh. [2025-10-02T17:03:34.075804] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-10-02T17:03:34.077661] [DEBUG] [LOCAL ] AEE: Deleted primary data file. [2025-10-02T17:03:34.077748] [INFO ] [MAIN ] AEE: Starting full primary refresh. [2025-10-02T17:03:34.472179] [INFO ] [REMOTE ] AEE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:03:34.673044] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-07. [2025-10-02T17:03:34.760202] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-02T17:03:34.765671] [INFO ] [REMOTE ] ADM: Full fetch complete (77240 records). [2025-10-02T17:03:34.765833] [DEBUG] [VALIDATOR ] ADM: Validating primary data. [2025-10-02T17:03:35.288528] [DEBUG] [VALIDATOR ] ADM: All expected trading days are present. [2025-10-02T17:03:35.288758] [DEBUG] [VALIDATOR ] ADM: Primary data validation passed. [2025-10-02T17:03:35.295270] [INFO ] [MAIN ] ADM: Fetched primary data is valid. [2025-10-02T17:03:35.305934] [DEBUG] [LOCAL ] ADM: Saving primary data. [2025-10-02T17:03:35.307600] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-02T17:03:35.314548] [DEBUG] [LOCAL ] ADM: Trimmed 77240 records to 53777 (keeping 200 days of data) [2025-10-02T17:03:35.520962] [INFO ] [REMOTE ] AEE: Fetching primary data for 2024-12. [2025-10-02T17:03:35.681896] [DEBUG] [LOCAL ] ADM: Primary data saved (53777 records). [2025-10-02T17:03:35.682045] [INFO ] [MAIN ] ADM: Full history saved. [2025-10-02T17:03:35.682131] [INFO ] [MAIN ] Update Progress: 32/2370 symbols completed. ADM took 44.7s. Estimated remaining: 4h 17m 60s. Rate: 9.1 symbols/min [2025-10-02T17:03:35.864462] [INFO ] [MAIN ] AEFC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:03:35.875912] [DEBUG] [LOCAL ] AEFC: Loaded 8514 existing records from primary storage. [2025-10-02T17:03:35.876136] [INFO ] [MAIN ] AEFC: Loaded 8514 existing records. [2025-10-02T17:03:36.078509] [WARN ] [MAIN ] AEFC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:03:36.078844] [INFO ] [MAIN ] AEFC: Wiping existing primary data before full refresh. [2025-10-02T17:03:36.078914] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-10-02T17:03:36.079171] [DEBUG] [LOCAL ] AEFC: Deleted primary data file. [2025-10-02T17:03:36.079244] [INFO ] [MAIN ] AEFC: Starting full primary refresh. [2025-10-02T17:03:36.280682] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-06. [2025-10-02T17:03:36.487382] [INFO ] [REMOTE ] AEFC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:03:36.582414] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-02T17:03:37.072995] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2024-12. [2025-10-02T17:03:37.290967] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-02T17:03:37.707260] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-02T17:03:37.727591] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-02T17:03:37.873029] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-07. [2025-10-02T17:03:38.673042] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-01. [2025-10-02T17:03:39.037670] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-02T17:03:39.473027] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-08. [2025-10-02T17:03:40.272989] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-08. [2025-10-02T17:03:40.341138] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-02T17:03:40.828415] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-02T17:03:41.072996] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-09. [2025-10-02T17:03:41.560279] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-02T17:03:41.872995] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-01. [2025-10-02T17:03:42.594836] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-02T17:03:42.673028] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-02. [2025-10-02T17:03:42.708365] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-02T17:03:43.396769] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-02T17:03:43.473048] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-10. [2025-10-02T17:03:44.273006] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-02. [2025-10-02T17:03:44.975583] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-02T17:03:44.977693] [INFO ] [REMOTE ] ADT: Full fetch complete (77195 records). [2025-10-02T17:03:44.977841] [DEBUG] [VALIDATOR ] ADT: Validating primary data. [2025-10-02T17:03:45.078181] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-03. [2025-10-02T17:03:45.465232] [DEBUG] [VALIDATOR ] ADT: All expected trading days are present. [2025-10-02T17:03:45.465386] [DEBUG] [VALIDATOR ] ADT: Primary data validation passed. [2025-10-02T17:03:45.466704] [INFO ] [MAIN ] ADT: Fetched primary data is valid. [2025-10-02T17:03:45.466782] [DEBUG] [LOCAL ] ADT: Saving primary data. [2025-10-02T17:03:45.468769] [DEBUG] [LOCAL ] ADT: Trimmed 77195 records to 53842 (keeping 200 days of data) [2025-10-02T17:03:45.747751] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-02T17:03:45.874165] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-09. [2025-10-02T17:03:45.892195] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-02T17:03:45.924141] [DEBUG] [LOCAL ] ADT: Primary data saved (53842 records). [2025-10-02T17:03:45.924637] [INFO ] [MAIN ] ADT: Full history saved. [2025-10-02T17:03:45.926013] [INFO ] [MAIN ] Update Progress: 33/2370 symbols completed. ADT took 39.1s. Estimated remaining: 4h 22m 10s. Rate: 8.9 symbols/min [2025-10-02T17:03:46.117223] [INFO ] [MAIN ] AEG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:03:46.169591] [DEBUG] [LOCAL ] AEG: Loaded 49557 existing records from primary storage. [2025-10-02T17:03:46.169967] [INFO ] [MAIN ] AEG: Loaded 49557 existing records. [2025-10-02T17:03:46.368473] [WARN ] [MAIN ] AEG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:03:46.368755] [INFO ] [MAIN ] AEG: Wiping existing primary data before full refresh. [2025-10-02T17:03:46.368810] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-10-02T17:03:46.369754] [DEBUG] [LOCAL ] AEG: Deleted primary data file. [2025-10-02T17:03:46.369822] [INFO ] [MAIN ] AEG: Starting full primary refresh. [2025-10-02T17:03:46.678099] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-03. [2025-10-02T17:03:46.785083] [INFO ] [REMOTE ] AEG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:03:47.148849] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-02T17:03:47.473005] [INFO ] [REMOTE ] AEG: Fetching primary data for 2024-12. [2025-10-02T17:03:48.273005] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-04. [2025-10-02T17:03:48.368869] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-02T17:03:49.073310] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-04. [2025-10-02T17:03:49.206443] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-02T17:03:49.291860] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-02T17:03:49.873013] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-01. [2025-10-02T17:03:50.563531] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-02T17:03:50.672995] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-05. [2025-10-02T17:03:50.985615] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-02T17:03:51.473019] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-05. [2025-10-02T17:03:51.536664] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-02T17:03:52.273013] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-02. [2025-10-02T17:03:53.053804] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-02T17:03:53.072981] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-06. [2025-10-02T17:03:53.872992] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-06. [2025-10-02T17:03:54.052052] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-02T17:03:54.589615] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-02T17:03:54.672970] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-07. [2025-10-02T17:03:54.801620] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-02T17:03:55.218173] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-02T17:03:55.473036] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-08. [2025-10-02T17:03:56.229691] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-02T17:03:56.273039] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-03. [2025-10-02T17:03:57.073019] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-10. [2025-10-02T17:03:57.608736] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-02T17:03:57.873008] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-07. [2025-10-02T17:03:58.075970] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-02T17:03:58.078400] [INFO ] [REMOTE ] ADX: Full fetch complete (42041 records). [2025-10-02T17:03:58.078516] [DEBUG] [VALIDATOR ] ADX: Validating primary data. [2025-10-02T17:03:58.534515] [DEBUG] [VALIDATOR ] ADX: All expected trading days are present. [2025-10-02T17:03:58.534695] [DEBUG] [VALIDATOR ] ADX: Primary data validation passed. [2025-10-02T17:03:58.535245] [INFO ] [MAIN ] ADX: Fetched primary data is valid. [2025-10-02T17:03:58.535319] [DEBUG] [LOCAL ] ADX: Saving primary data. [2025-10-02T17:03:58.536773] [DEBUG] [LOCAL ] ADX: Trimmed 42041 records to 27720 (keeping 200 days of data) [2025-10-02T17:03:58.675706] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-04. [2025-10-02T17:03:58.741576] [DEBUG] [LOCAL ] ADX: Primary data saved (27720 records). [2025-10-02T17:03:58.741760] [INFO ] [MAIN ] ADX: Full history saved. [2025-10-02T17:03:58.741903] [INFO ] [MAIN ] Update Progress: 34/2370 symbols completed. ADX took 39.9s. Estimated remaining: 4h 29m 1s. Rate: 8.7 symbols/min [2025-10-02T17:03:58.954826] [INFO ] [MAIN ] AEM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:03:59.021323] [DEBUG] [LOCAL ] AEM: Loaded 53463 existing records from primary storage. [2025-10-02T17:03:59.021799] [INFO ] [MAIN ] AEM: Loaded 53463 existing records. [2025-10-02T17:03:59.237051] [WARN ] [MAIN ] AEM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:03:59.237325] [INFO ] [MAIN ] AEM: Wiping existing primary data before full refresh. [2025-10-02T17:03:59.237383] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-10-02T17:03:59.238681] [DEBUG] [LOCAL ] AEM: Deleted primary data file. [2025-10-02T17:03:59.238748] [INFO ] [MAIN ] AEM: Starting full primary refresh. [2025-10-02T17:03:59.478221] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-09. [2025-10-02T17:03:59.670703] [INFO ] [REMOTE ] AEM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:03:59.703500] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-02T17:04:00.190759] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-02T17:04:00.273007] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-08. [2025-10-02T17:04:00.573632] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-02T17:04:01.073013] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-10. [2025-10-02T17:04:01.872994] [INFO ] [REMOTE ] AEM: Fetching primary data for 2024-12. [2025-10-02T17:04:01.955596] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-02T17:04:01.959533] [INFO ] [REMOTE ] AEFC: Full fetch complete (12125 records). [2025-10-02T17:04:01.959374] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-02T17:04:01.959866] [DEBUG] [VALIDATOR ] AEFC: Validating primary data. [2025-10-02T17:04:02.396985] [DEBUG] [VALIDATOR ] AEFC: All expected trading days are present. [2025-10-02T17:04:02.397078] [DEBUG] [VALIDATOR ] AEFC: Primary data validation passed. [2025-10-02T17:04:02.397335] [INFO ] [MAIN ] AEFC: Fetched primary data is valid. [2025-10-02T17:04:02.397380] [DEBUG] [LOCAL ] AEFC: Saving primary data. [2025-10-02T17:04:02.397965] [DEBUG] [LOCAL ] AEFC: Trimmed 12125 records to 8541 (keeping 200 days of data) [2025-10-02T17:04:02.455927] [DEBUG] [LOCAL ] AEFC: Primary data saved (8541 records). [2025-10-02T17:04:02.456070] [INFO ] [MAIN ] AEFC: Full history saved. [2025-10-02T17:04:02.456178] [INFO ] [MAIN ] Update Progress: 35/2370 symbols completed. AEFC took 26.8s. Estimated remaining: 4h 25m 21s. Rate: 8.8 symbols/min [2025-10-02T17:04:02.649776] [INFO ] [MAIN ] AEO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:04:02.682095] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-05. [2025-10-02T17:04:02.720699] [DEBUG] [LOCAL ] AEO: Loaded 53557 existing records from primary storage. [2025-10-02T17:04:02.721174] [INFO ] [MAIN ] AEO: Loaded 53557 existing records. [2025-10-02T17:04:02.948811] [WARN ] [MAIN ] AEO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:04:02.949052] [INFO ] [MAIN ] AEO: Wiping existing primary data before full refresh. [2025-10-02T17:04:02.949101] [INFO ] [LOCAL ] AEO: Starting deletion of primary data. [2025-10-02T17:04:02.950149] [DEBUG] [LOCAL ] AEO: Deleted primary data file. [2025-10-02T17:04:02.950214] [INFO ] [MAIN ] AEO: Starting full primary refresh. [2025-10-02T17:04:03.372104] [INFO ] [REMOTE ] AEO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:04:03.478196] [INFO ] [REMOTE ] AEO: Fetching primary data for 2024-12. [2025-10-02T17:04:03.500084] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-02T17:04:04.273014] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-09. [2025-10-02T17:04:04.696614] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-02T17:04:05.073034] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-06. [2025-10-02T17:04:05.237200] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-02T17:04:05.873056] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-01. [2025-10-02T17:04:06.048349] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-02T17:04:06.678149] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-01. [2025-10-02T17:04:06.709269] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-02T17:04:07.473062] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-10. [2025-10-02T17:04:07.578006] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-02T17:04:08.273002] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-02. [2025-10-02T17:04:08.563451] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-02T17:04:08.881462] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-02T17:04:08.883687] [INFO ] [REMOTE ] AEE: Full fetch complete (72616 records). [2025-10-02T17:04:08.883863] [DEBUG] [VALIDATOR ] AEE: Validating primary data. [2025-10-02T17:04:09.079290] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-07. [2025-10-02T17:04:09.343332] [DEBUG] [VALIDATOR ] AEE: All expected trading days are present. [2025-10-02T17:04:09.343427] [DEBUG] [VALIDATOR ] AEE: Primary data validation passed. [2025-10-02T17:04:09.344248] [INFO ] [MAIN ] AEE: Fetched primary data is valid. [2025-10-02T17:04:09.344319] [DEBUG] [LOCAL ] AEE: Saving primary data. [2025-10-02T17:04:09.346038] [DEBUG] [LOCAL ] AEE: Trimmed 72616 records to 50446 (keeping 200 days of data) [2025-10-02T17:04:09.706346] [DEBUG] [LOCAL ] AEE: Primary data saved (50446 records). [2025-10-02T17:04:09.706543] [INFO ] [MAIN ] AEE: Full history saved. [2025-10-02T17:04:09.706639] [INFO ] [MAIN ] Update Progress: 36/2370 symbols completed. AEE took 36.1s. Estimated remaining: 4h 25m 42s. Rate: 8.8 symbols/min [2025-10-02T17:04:09.883740] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-02. [2025-10-02T17:04:09.914279] [INFO ] [MAIN ] AER: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:04:09.971394] [DEBUG] [LOCAL ] AER: Loaded 48362 existing records from primary storage. [2025-10-02T17:04:09.971745] [INFO ] [MAIN ] AER: Loaded 48362 existing records. [2025-10-02T17:04:10.195783] [WARN ] [MAIN ] AER: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:04:10.210072] [INFO ] [MAIN ] AER: Wiping existing primary data before full refresh. [2025-10-02T17:04:10.211697] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-02T17:04:10.210565] [INFO ] [LOCAL ] AER: Starting deletion of primary data. [2025-10-02T17:04:10.223879] [DEBUG] [LOCAL ] AER: Deleted primary data file. [2025-10-02T17:04:10.224003] [INFO ] [MAIN ] AER: Starting full primary refresh. [2025-10-02T17:04:10.623931] [INFO ] [REMOTE ] AER: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:04:10.673029] [INFO ] [REMOTE ] AER: Fetching primary data for 2024-12. [2025-10-02T17:04:11.070633] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-02T17:04:11.473062] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-08. [2025-10-02T17:04:11.879697] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-02T17:04:12.273053] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-03. [2025-10-02T17:04:12.436034] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-02T17:04:13.073038] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-03. [2025-10-02T17:04:13.204864] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-02T17:04:13.873031] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-09. [2025-10-02T17:04:14.094213] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-02T17:04:14.673017] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-04. [2025-10-02T17:04:15.019802] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-02T17:04:15.472984] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-04. [2025-10-02T17:04:15.776725] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-02T17:04:16.273038] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-01. [2025-10-02T17:04:16.588444] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-02T17:04:17.073288] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-10. [2025-10-02T17:04:17.363444] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-02T17:04:17.873069] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-05. [2025-10-02T17:04:18.153828] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-02T17:04:18.419239] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-02T17:04:18.424381] [INFO ] [REMOTE ] AEG: Full fetch complete (70350 records). [2025-10-02T17:04:18.424565] [DEBUG] [VALIDATOR ] AEG: Validating primary data. [2025-10-02T17:04:18.682749] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-05. [2025-10-02T17:04:18.850039] [DEBUG] [VALIDATOR ] AEG: All expected trading days are present. [2025-10-02T17:04:18.850162] [DEBUG] [VALIDATOR ] AEG: Primary data validation passed. [2025-10-02T17:04:18.850937] [INFO ] [MAIN ] AEG: Fetched primary data is valid. [2025-10-02T17:04:18.851012] [DEBUG] [LOCAL ] AEG: Saving primary data. [2025-10-02T17:04:18.852845] [DEBUG] [LOCAL ] AEG: Trimmed 70350 records to 49924 (keeping 200 days of data) [2025-10-02T17:04:19.178639] [DEBUG] [LOCAL ] AEG: Primary data saved (49924 records). [2025-10-02T17:04:19.178813] [INFO ] [MAIN ] AEG: Full history saved. [2025-10-02T17:04:19.179864] [INFO ] [MAIN ] Update Progress: 37/2370 symbols completed. AEG took 33.3s. Estimated remaining: 4h 28m 22s. Rate: 8.7 symbols/min [2025-10-02T17:04:19.451796] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-02T17:04:19.473039] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-06. [2025-10-02T17:04:20.273048] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-02. [2025-10-02T17:04:20.942808] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-02T17:04:21.073047] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-06. [2025-10-02T17:04:21.398893] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-02T17:04:21.491418] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-02T17:04:21.872994] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-07. [2025-10-02T17:04:22.673085] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-03. [2025-10-02T17:04:23.143699] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-02T17:04:23.473053] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-07. [2025-10-02T17:04:23.539062] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-02T17:04:24.273015] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-08. [2025-10-02T17:04:24.497912] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-02T17:04:25.073048] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-04. [2025-10-02T17:04:25.619617] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-02T17:04:25.873159] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-08. [2025-10-02T17:04:26.241631] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-02T17:04:26.524344] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-02T17:04:26.673036] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-05. [2025-10-02T17:04:27.473150] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-09. [2025-10-02T17:04:27.853190] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-02T17:04:28.273054] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-09. [2025-10-02T17:04:28.441440] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-02T17:04:29.073071] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-06. [2025-10-02T17:04:29.804173] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-10-02T17:04:29.873032] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-10. [2025-10-02T17:04:30.076749] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-02T17:04:30.673014] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-10. [2025-10-02T17:04:30.747456] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-02T17:04:31.473083] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-07. [2025-10-02T17:04:31.648288] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-02T17:04:31.650714] [INFO ] [REMOTE ] AEO: Full fetch complete (77445 records). [2025-10-02T17:04:31.650850] [DEBUG] [VALIDATOR ] AEO: Validating primary data. [2025-10-02T17:04:32.059536] [DEBUG] [VALIDATOR ] AEO: All expected trading days are present. [2025-10-02T17:04:32.059678] [DEBUG] [VALIDATOR ] AEO: Primary data validation passed. [2025-10-02T17:04:32.060725] [INFO ] [MAIN ] AEO: Fetched primary data is valid. [2025-10-02T17:04:32.060797] [DEBUG] [LOCAL ] AEO: Saving primary data. [2025-10-02T17:04:32.063085] [DEBUG] [LOCAL ] AEO: Trimmed 77445 records to 53947 (keeping 200 days of data) [2025-10-02T17:04:32.393756] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-02T17:04:32.403056] [INFO ] [REMOTE ] AEM: Full fetch complete (77160 records). [2025-10-02T17:04:32.406077] [DEBUG] [VALIDATOR ] AEM: Validating primary data. [2025-10-02T17:04:32.431993] [DEBUG] [LOCAL ] AEO: Primary data saved (53947 records). [2025-10-02T17:04:32.446283] [INFO ] [MAIN ] AEO: Full history saved. [2025-10-02T17:04:32.469385] [INFO ] [MAIN ] Update Progress: 38/2370 symbols completed. AEO took 30.0s. Estimated remaining: 4h 34m 47s. Rate: 8.5 symbols/min [2025-10-02T17:04:32.958708] [DEBUG] [VALIDATOR ] AEM: All expected trading days are present. [2025-10-02T17:04:32.958901] [DEBUG] [VALIDATOR ] AEM: Primary data validation passed. [2025-10-02T17:04:32.959851] [INFO ] [MAIN ] AEM: Fetched primary data is valid. [2025-10-02T17:04:32.959985] [DEBUG] [LOCAL ] AEM: Saving primary data. [2025-10-02T17:04:32.961788] [DEBUG] [LOCAL ] AEM: Trimmed 77160 records to 53853 (keeping 200 days of data) [2025-10-02T17:04:33.304606] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-02T17:04:33.342433] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-08. [2025-10-02T17:04:33.372884] [DEBUG] [LOCAL ] AEM: Primary data saved (53853 records). [2025-10-02T17:04:33.373064] [INFO ] [MAIN ] AEM: Full history saved. [2025-10-02T17:04:33.374722] [INFO ] [MAIN ] Update Progress: 39/2370 symbols completed. AEM took 34.6s. Estimated remaining: 4h 28m 31s. Rate: 8.7 symbols/min [2025-10-02T17:04:35.236760] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-02T17:04:35.247808] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-09. [2025-10-02T17:04:36.617995] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-02T17:04:36.632303] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-10. [2025-10-02T17:04:37.953458] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-02T17:04:37.955795] [INFO ] [REMOTE ] AER: Full fetch complete (69630 records). [2025-10-02T17:04:37.955966] [DEBUG] [VALIDATOR ] AER: Validating primary data. [2025-10-02T17:04:38.381523] [DEBUG] [VALIDATOR ] AER: All expected trading days are present. [2025-10-02T17:04:38.381621] [DEBUG] [VALIDATOR ] AER: Primary data validation passed. [2025-10-02T17:04:38.382365] [INFO ] [MAIN ] AER: Fetched primary data is valid. [2025-10-02T17:04:38.382455] [DEBUG] [LOCAL ] AER: Saving primary data. [2025-10-02T17:04:38.383986] [DEBUG] [LOCAL ] AER: Trimmed 69630 records to 48702 (keeping 200 days of data) [2025-10-02T17:04:38.705187] [DEBUG] [LOCAL ] AER: Primary data saved (48702 records). [2025-10-02T17:04:38.705339] [INFO ] [MAIN ] AER: Full history saved. [2025-10-02T17:04:38.705424] [INFO ] [MAIN ] Update Progress: 40/2370 symbols completed. AER took 29.0s. Estimated remaining: 4h 26m 52s. Rate: 8.7 symbols/min [2025-10-02T17:04:39.445128] [INFO ] [MAIN ] AES: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:04:39.517114] [INFO ] [MAIN ] AFB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:04:39.521228] [INFO ] [MAIN ] AESI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:04:39.560347] [INFO ] [MAIN ] AEXA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:04:39.561097] [DEBUG] [LOCAL ] AEXA: No existing data file found in primary storage. [2025-10-02T17:04:39.561247] [WARN ] [MAIN ] AEXA: No existing data found, performing full refresh instead. [2025-10-02T17:04:39.561414] [INFO ] [MAIN ] AEXA: Wiping existing primary data before full refresh. [2025-10-02T17:04:39.561580] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-02T17:04:39.561737] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-02T17:04:39.561788] [INFO ] [MAIN ] AEXA: Starting full primary refresh. [2025-10-02T17:04:39.698592] [DEBUG] [LOCAL ] AFB: Loaded 11341 existing records from primary storage. [2025-10-02T17:04:39.731360] [INFO ] [MAIN ] AFB: Loaded 11341 existing records. [2025-10-02T17:04:40.048017] [DEBUG] [LOCAL ] AESI: Loaded 49476 existing records from primary storage. [2025-10-02T17:04:40.156463] [DEBUG] [LOCAL ] AES: Loaded 53670 existing records from primary storage. [2025-10-02T17:04:40.161682] [INFO ] [MAIN ] AESI: Loaded 49476 existing records. [2025-10-02T17:04:40.183018] [INFO ] [MAIN ] AES: Loaded 53670 existing records. [2025-10-02T17:04:40.212671] [WARN ] [MAIN ] AFB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:04:40.235500] [INFO ] [MAIN ] AFB: Wiping existing primary data before full refresh. [2025-10-02T17:04:40.262820] [INFO ] [LOCAL ] AFB: Starting deletion of primary data. [2025-10-02T17:04:40.413473] [DEBUG] [LOCAL ] AFB: Deleted primary data file. [2025-10-02T17:04:40.423609] [INFO ] [REMOTE ] AEXA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:04:40.434076] [INFO ] [MAIN ] AFB: Starting full primary refresh. [2025-10-02T17:04:40.449937] [INFO ] [REMOTE ] AEXA: Fetching primary data for 2024-12. [2025-10-02T17:04:40.733222] [WARN ] [MAIN ] AESI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:04:40.808812] [INFO ] [MAIN ] AESI: Wiping existing primary data before full refresh. [2025-10-02T17:04:40.850149] [DEBUG] [REMOTE ] AEXA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T17:04:40.853638] [WARN ] [MAIN ] AES: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:04:40.859413] [INFO ] [LOCAL ] AESI: Starting deletion of primary data. [2025-10-02T17:04:40.859590] [INFO ] [MAIN ] AES: Wiping existing primary data before full refresh. [2025-10-02T17:04:40.868691] [INFO ] [LOCAL ] AES: Starting deletion of primary data. [2025-10-02T17:04:40.859295] [WARN ] [REMOTE ] AEXA: No data returned for month 2024-12 [2025-10-02T17:04:40.873056] [DEBUG] [LOCAL ] AESI: Deleted primary data file. [2025-10-02T17:04:40.872933] [FATAL] [REMOTE ] AEXA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T17:04:40.879242] [INFO ] [MAIN ] AESI: Starting full primary refresh. [2025-10-02T17:04:40.907637] [DEBUG] [LOCAL ] AES: Deleted primary data file. [2025-10-02T17:04:40.881211] [FATAL] [MAIN ] AEXA: Failed to fetch primary data. [2025-10-02T17:04:40.935381] [WARN ] [MAIN ] AEXA: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T17:04:40.935299] [INFO ] [MAIN ] AES: Starting full primary refresh. [2025-10-02T17:04:40.956492] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-02T17:04:41.091776] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-02T17:04:41.207869] [INFO ] [LOCAL ] AEXA: Starting deletion of derivative data. [2025-10-02T17:04:41.279598] [DEBUG] [LOCAL ] AEXA: No derivative data file found to delete. [2025-10-02T17:04:41.337988] [INFO ] [MAIN ] Update Progress: 41/2370 symbols completed. AEXA took 2.6s. Estimated remaining: 4h 22m 45s. Rate: 8.9 symbols/min [2025-10-02T17:04:41.516366] [INFO ] [REMOTE ] AFB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:04:41.604501] [INFO ] [REMOTE ] AFB: Fetching primary data for 2024-12. [2025-10-02T17:04:42.256003] [INFO ] [MAIN ] AFG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:04:42.393808] [INFO ] [REMOTE ] AESI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:04:42.430887] [INFO ] [REMOTE ] AES: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:04:42.431593] [INFO ] [REMOTE ] AESI: Fetching primary data for 2024-12. [2025-10-02T17:04:42.432860] [INFO ] [REMOTE ] AES: Fetching primary data for 2024-12. [2025-10-02T17:04:42.472815] [DEBUG] [LOCAL ] AFG: Loaded 32410 existing records from primary storage. [2025-10-02T17:04:42.473226] [INFO ] [MAIN ] AFG: Loaded 32410 existing records. [2025-10-02T17:04:42.601622] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-02T17:04:42.620865] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-01. [2025-10-02T17:04:42.692004] [WARN ] [MAIN ] AFG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:04:42.692418] [INFO ] [MAIN ] AFG: Wiping existing primary data before full refresh. [2025-10-02T17:04:42.692530] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-10-02T17:04:42.693141] [DEBUG] [LOCAL ] AFG: Deleted primary data file. [2025-10-02T17:04:42.693216] [INFO ] [MAIN ] AFG: Starting full primary refresh. [2025-10-02T17:04:43.117141] [INFO ] [REMOTE ] AFG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:04:43.117503] [INFO ] [REMOTE ] AFG: Fetching primary data for 2024-12. [2025-10-02T17:04:43.461765] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-02T17:04:43.464946] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-02. [2025-10-02T17:04:43.991586] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-02T17:04:44.001417] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-01. [2025-10-02T17:04:44.432354] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-02T17:04:44.444267] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-01. [2025-10-02T17:04:44.465803] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-02T17:04:44.468820] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-03. [2025-10-02T17:04:44.535826] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-02T17:04:44.541549] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-01. [2025-10-02T17:04:45.146200] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-02T17:04:45.149912] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-04. [2025-10-02T17:04:45.420632] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-02T17:04:45.426563] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-02. [2025-10-02T17:04:45.617257] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-02T17:04:45.626700] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-02. [2025-10-02T17:04:46.184677] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-02T17:04:46.195592] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-02. [2025-10-02T17:04:46.217617] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-02T17:04:46.672986] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-05. [2025-10-02T17:04:46.823193] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-02T17:04:47.239518] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-02T17:04:47.276065] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-02T17:04:47.473016] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-03. [2025-10-02T17:04:47.825246] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-02T17:04:48.273017] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-06. [2025-10-02T17:04:48.864300] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-02T17:04:49.012450] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-02T17:04:49.073012] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-03. [2025-10-02T17:04:49.873006] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-07. [2025-10-02T17:04:50.673037] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-04. [2025-10-02T17:04:50.729986] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-02T17:04:50.991742] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-02T17:04:51.473052] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-04. [2025-10-02T17:04:52.131256] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-02T17:04:52.273042] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-05. [2025-10-02T17:04:53.072982] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-03. [2025-10-02T17:04:53.260394] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-02T17:04:53.390977] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-02T17:04:53.873037] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-05. [2025-10-02T17:04:54.603778] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-02T17:04:54.673005] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-04. [2025-10-02T17:04:55.473016] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-06. [2025-10-02T17:04:55.686770] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-02T17:04:55.924813] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-02T17:04:56.273025] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-05. [2025-10-02T17:04:56.951486] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-02T17:04:57.073027] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-08. [2025-10-02T17:04:57.847783] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-02T17:04:57.872966] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-07. [2025-10-02T17:04:57.881707] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-02T17:04:58.673006] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-06. [2025-10-02T17:04:58.827361] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-02T17:04:59.473034] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-09. [2025-10-02T17:04:59.994716] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-02T17:05:00.273039] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-06. [2025-10-02T17:05:00.311083] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-02T17:05:01.073052] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-08. [2025-10-02T17:05:01.873053] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-07. [2025-10-02T17:05:02.410707] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-02T17:05:02.436469] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-02T17:05:02.673041] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-07. [2025-10-02T17:05:03.473037] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-10. [2025-10-02T17:05:03.803072] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-02T17:05:04.024694] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-02T17:05:04.026008] [INFO ] [REMOTE ] AFB: Full fetch complete (16696 records). [2025-10-02T17:05:04.026146] [DEBUG] [VALIDATOR ] AFB: Validating primary data. [2025-10-02T17:05:04.278153] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-08. [2025-10-02T17:05:04.441556] [DEBUG] [VALIDATOR ] AFB: All expected trading days are present. [2025-10-02T17:05:04.441664] [DEBUG] [VALIDATOR ] AFB: Primary data validation passed. [2025-10-02T17:05:04.441987] [INFO ] [MAIN ] AFB: Fetched primary data is valid. [2025-10-02T17:05:04.442045] [DEBUG] [LOCAL ] AFB: Saving primary data. [2025-10-02T17:05:04.442879] [DEBUG] [LOCAL ] AFB: Trimmed 16696 records to 11470 (keeping 200 days of data) [2025-10-02T17:05:04.513776] [DEBUG] [LOCAL ] AFB: Primary data saved (11470 records). [2025-10-02T17:05:04.513921] [INFO ] [MAIN ] AFB: Full history saved. [2025-10-02T17:05:04.514005] [INFO ] [MAIN ] Update Progress: 42/2370 symbols completed. AFB took 25.7s. Estimated remaining: 4h 37m 47s. Rate: 8.4 symbols/min [2025-10-02T17:05:04.700460] [INFO ] [MAIN ] AFGB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:05:04.700638] [DEBUG] [LOCAL ] AFGB: No existing data file found in primary storage. [2025-10-02T17:05:04.700720] [WARN ] [MAIN ] AFGB: No existing data found, performing full refresh instead. [2025-10-02T17:05:04.700911] [INFO ] [MAIN ] AFGB: Wiping existing primary data before full refresh. [2025-10-02T17:05:04.700990] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-10-02T17:05:04.701063] [DEBUG] [LOCAL ] AFGB: No primary data file found to delete. [2025-10-02T17:05:04.701152] [INFO ] [MAIN ] AFGB: Starting full primary refresh. [2025-10-02T17:05:05.072982] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-09. [2025-10-02T17:05:05.108663] [INFO ] [REMOTE ] AFGB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:05:05.146365] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-10-02T17:05:05.873063] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2024-12. [2025-10-02T17:05:06.188221] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-02T17:05:06.223131] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-02T17:05:06.315417] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-02T17:05:06.673013] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-10. [2025-10-02T17:05:07.473059] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-09. [2025-10-02T17:05:07.942936] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-02T17:05:07.945979] [INFO ] [REMOTE ] AFG: Full fetch complete (46011 records). [2025-10-02T17:05:07.946067] [DEBUG] [VALIDATOR ] AFG: Validating primary data. [2025-10-02T17:05:08.278269] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-08. [2025-10-02T17:05:08.414089] [DEBUG] [VALIDATOR ] AFG: All expected trading days are present. [2025-10-02T17:05:08.414183] [DEBUG] [VALIDATOR ] AFG: Primary data validation passed. [2025-10-02T17:05:08.414729] [INFO ] [MAIN ] AFG: Fetched primary data is valid. [2025-10-02T17:05:08.414792] [DEBUG] [LOCAL ] AFG: Saving primary data. [2025-10-02T17:05:08.415954] [DEBUG] [LOCAL ] AFG: Trimmed 46011 records to 32624 (keeping 200 days of data) [2025-10-02T17:05:08.629021] [DEBUG] [LOCAL ] AFG: Primary data saved (32624 records). [2025-10-02T17:05:08.629163] [INFO ] [MAIN ] AFG: Full history saved. [2025-10-02T17:05:08.630516] [INFO ] [MAIN ] Update Progress: 43/2370 symbols completed. AFG took 27.2s. Estimated remaining: 4h 34m 55s. Rate: 8.5 symbols/min [2025-10-02T17:05:08.826493] [INFO ] [MAIN ] AFGC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:05:08.860682] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-02T17:05:08.863801] [DEBUG] [LOCAL ] AFGC: Loaded 2555 existing records from primary storage. [2025-10-02T17:05:08.874876] [INFO ] [MAIN ] AFGC: Loaded 2555 existing records. [2025-10-02T17:05:09.073230] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-10. [2025-10-02T17:05:09.077399] [WARN ] [MAIN ] AFGC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:05:09.078738] [INFO ] [MAIN ] AFGC: Wiping existing primary data before full refresh. [2025-10-02T17:05:09.078795] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-10-02T17:05:09.079091] [DEBUG] [LOCAL ] AFGC: Deleted primary data file. [2025-10-02T17:05:09.079159] [INFO ] [MAIN ] AFGC: Starting full primary refresh. [2025-10-02T17:05:09.470492] [INFO ] [REMOTE ] AFGC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:05:09.873001] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-01. [2025-10-02T17:05:10.269260] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-02T17:05:10.385991] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-02T17:05:10.580955] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-02T17:05:10.583189] [INFO ] [REMOTE ] AESI: Full fetch complete (70477 records). [2025-10-02T17:05:10.583328] [DEBUG] [VALIDATOR ] AESI: Validating primary data. [2025-10-02T17:05:10.678192] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-02. [2025-10-02T17:05:11.020017] [DEBUG] [VALIDATOR ] AESI: All expected trading days are present. [2025-10-02T17:05:11.020133] [DEBUG] [VALIDATOR ] AESI: Primary data validation passed. [2025-10-02T17:05:11.020966] [INFO ] [MAIN ] AESI: Fetched primary data is valid. [2025-10-02T17:05:11.021044] [DEBUG] [LOCAL ] AESI: Saving primary data. [2025-10-02T17:05:11.022755] [DEBUG] [LOCAL ] AESI: Trimmed 70477 records to 49859 (keeping 200 days of data) [2025-10-02T17:05:11.146471] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-02T17:05:11.341132] [DEBUG] [LOCAL ] AESI: Primary data saved (49859 records). [2025-10-02T17:05:11.341276] [INFO ] [MAIN ] AESI: Full history saved. [2025-10-02T17:05:11.341369] [INFO ] [MAIN ] Update Progress: 44/2370 symbols completed. AESI took 32.6s. Estimated remaining: 4h 30m 57s. Rate: 8.6 symbols/min [2025-10-02T17:05:11.485028] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-03. [2025-10-02T17:05:11.520881] [INFO ] [MAIN ] AFGD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:05:11.521293] [DEBUG] [LOCAL ] AFGD: No existing data file found in primary storage. [2025-10-02T17:05:11.521352] [WARN ] [MAIN ] AFGD: No existing data found, performing full refresh instead. [2025-10-02T17:05:11.521469] [INFO ] [MAIN ] AFGD: Wiping existing primary data before full refresh. [2025-10-02T17:05:11.521513] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-10-02T17:05:11.521558] [DEBUG] [LOCAL ] AFGD: No primary data file found to delete. [2025-10-02T17:05:11.521592] [INFO ] [MAIN ] AFGD: Starting full primary refresh. [2025-10-02T17:05:11.918046] [INFO ] [REMOTE ] AFGD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:05:12.121442] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-02T17:05:12.273000] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-04. [2025-10-02T17:05:12.902029] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-02T17:05:13.073003] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-05. [2025-10-02T17:05:13.333139] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-10-02T17:05:13.872995] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2024-12. [2025-10-02T17:05:14.477577] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-02T17:05:14.673027] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-09. [2025-10-02T17:05:15.472999] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-06. [2025-10-02T17:05:16.039096] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-02T17:05:16.273022] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-01. [2025-10-02T17:05:16.731289] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-02T17:05:16.768043] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-02T17:05:17.073010] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-02. [2025-10-02T17:05:17.534025] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-02T17:05:17.873001] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-10. [2025-10-02T17:05:18.673034] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2024-12. [2025-10-02T17:05:19.384042] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-02T17:05:19.473044] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-03. [2025-10-02T17:05:19.560385] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-02T17:05:19.562769] [INFO ] [REMOTE ] AES: Full fetch complete (77722 records). [2025-10-02T17:05:19.562929] [DEBUG] [VALIDATOR ] AES: Validating primary data. [2025-10-02T17:05:19.918334] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-02T17:05:20.026391] [DEBUG] [VALIDATOR ] AES: All expected trading days are present. [2025-10-02T17:05:20.026491] [DEBUG] [VALIDATOR ] AES: Primary data validation passed. [2025-10-02T17:05:20.027327] [INFO ] [MAIN ] AES: Fetched primary data is valid. [2025-10-02T17:05:20.027408] [DEBUG] [LOCAL ] AES: Saving primary data. [2025-10-02T17:05:20.029432] [DEBUG] [LOCAL ] AES: Trimmed 77722 records to 54060 (keeping 200 days of data) [2025-10-02T17:05:20.273335] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-07. [2025-10-02T17:05:20.379428] [DEBUG] [LOCAL ] AES: Primary data saved (54060 records). [2025-10-02T17:05:20.379608] [INFO ] [MAIN ] AES: Full history saved. [2025-10-02T17:05:20.380926] [INFO ] [MAIN ] Update Progress: 45/2370 symbols completed. AES took 41.7s. Estimated remaining: 4h 32m 36s. Rate: 8.5 symbols/min [2025-10-02T17:05:20.581964] [INFO ] [MAIN ] AFGE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:05:20.587358] [DEBUG] [LOCAL ] AFGE: Loaded 2457 existing records from primary storage. [2025-10-02T17:05:20.587564] [INFO ] [MAIN ] AFGE: Loaded 2457 existing records. [2025-10-02T17:05:20.786510] [WARN ] [MAIN ] AFGE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:05:20.786780] [INFO ] [MAIN ] AFGE: Wiping existing primary data before full refresh. [2025-10-02T17:05:20.786831] [INFO ] [LOCAL ] AFGE: Starting deletion of primary data. [2025-10-02T17:05:20.787118] [DEBUG] [LOCAL ] AFGE: Deleted primary data file. [2025-10-02T17:05:20.787204] [INFO ] [MAIN ] AFGE: Starting full primary refresh. [2025-10-02T17:05:21.078629] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-04. [2025-10-02T17:05:21.147254] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-02T17:05:21.233566] [INFO ] [REMOTE ] AFGE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:05:21.560514] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-02T17:05:21.873018] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-05. [2025-10-02T17:05:22.341762] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-02T17:05:22.673065] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-01. [2025-10-02T17:05:23.140984] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-02T17:05:23.473000] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2024-12. [2025-10-02T17:05:23.945741] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-02T17:05:24.273041] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-08. [2025-10-02T17:05:24.789550] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-02T17:05:25.073005] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-09. [2025-10-02T17:05:25.432565] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-02T17:05:25.873007] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-01. [2025-10-02T17:05:26.346023] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-02T17:05:26.672999] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-10. [2025-10-02T17:05:27.134698] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-02T17:05:27.135401] [INFO ] [REMOTE ] AFGB: Full fetch complete (3679 records). [2025-10-02T17:05:27.135474] [DEBUG] [VALIDATOR ] AFGB: Validating primary data. [2025-10-02T17:05:27.486368] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-06. [2025-10-02T17:05:27.534826] [DEBUG] [VALIDATOR ] AFGB: All expected trading days are present. [2025-10-02T17:05:27.534912] [DEBUG] [VALIDATOR ] AFGB: Primary data validation passed. [2025-10-02T17:05:27.535192] [INFO ] [MAIN ] AFGB: Fetched primary data is valid. [2025-10-02T17:05:27.535253] [DEBUG] [LOCAL ] AFGB: Saving primary data. [2025-10-02T17:05:27.535606] [DEBUG] [LOCAL ] AFGB: Trimmed 3679 records to 2357 (keeping 200 days of data) [2025-10-02T17:05:27.551598] [DEBUG] [LOCAL ] AFGB: Primary data saved (2357 records). [2025-10-02T17:05:27.551709] [INFO ] [MAIN ] AFGB: Full history saved. [2025-10-02T17:05:27.551819] [INFO ] [MAIN ] Update Progress: 46/2370 symbols completed. AFGB took 23.0s. Estimated remaining: 4h 32m 36s. Rate: 8.5 symbols/min [2025-10-02T17:05:27.739130] [INFO ] [MAIN ] AFL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:05:27.796855] [DEBUG] [LOCAL ] AFL: Loaded 53146 existing records from primary storage. [2025-10-02T17:05:27.797207] [INFO ] [MAIN ] AFL: Loaded 53146 existing records. [2025-10-02T17:05:27.997098] [WARN ] [MAIN ] AFL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:05:27.997315] [INFO ] [MAIN ] AFL: Wiping existing primary data before full refresh. [2025-10-02T17:05:27.997398] [INFO ] [LOCAL ] AFL: Starting deletion of primary data. [2025-10-02T17:05:28.006190] [DEBUG] [LOCAL ] AFL: Deleted primary data file. [2025-10-02T17:05:28.006327] [INFO ] [MAIN ] AFL: Starting full primary refresh. [2025-10-02T17:05:28.120091] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-02T17:05:28.278173] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-02. [2025-10-02T17:05:28.406098] [INFO ] [REMOTE ] AFL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:05:28.711410] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-02T17:05:29.073001] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-03. [2025-10-02T17:05:29.352792] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-10-02T17:05:29.873004] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-07. [2025-10-02T17:05:30.491277] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-02T17:05:30.673007] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-02. [2025-10-02T17:05:31.143612] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-02T17:05:31.473001] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-08. [2025-10-02T17:05:32.178404] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-02T17:05:32.273000] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-03. [2025-10-02T17:05:32.629689] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-02T17:05:33.073013] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-04. [2025-10-02T17:05:33.534908] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-02T17:05:33.873015] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-04. [2025-10-02T17:05:34.320874] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-02T17:05:34.673012] [INFO ] [REMOTE ] AFL: Fetching primary data for 2024-12. [2025-10-02T17:05:35.473005] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-05. [2025-10-02T17:05:35.994838] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-02T17:05:36.272996] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-09. [2025-10-02T17:05:36.746965] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-02T17:05:36.833196] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-02T17:05:37.073004] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-01. [2025-10-02T17:05:37.873035] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-05. [2025-10-02T17:05:38.358454] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-02T17:05:38.673017] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-06. [2025-10-02T17:05:38.875870] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-02T17:05:39.139628] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-02T17:05:39.472993] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-07. [2025-10-02T17:05:39.928756] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-02T17:05:40.272998] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-06. [2025-10-02T17:05:40.717493] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-02T17:05:41.072996] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-10. [2025-10-02T17:05:41.547016] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-02T17:05:41.547755] [INFO ] [REMOTE ] AFGC: Full fetch complete (3736 records). [2025-10-02T17:05:41.547828] [DEBUG] [VALIDATOR ] AFGC: Validating primary data. [2025-10-02T17:05:41.878089] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-08. [2025-10-02T17:05:41.945476] [DEBUG] [VALIDATOR ] AFGC: All expected trading days are present. [2025-10-02T17:05:41.945601] [DEBUG] [VALIDATOR ] AFGC: Primary data validation passed. [2025-10-02T17:05:41.945770] [INFO ] [MAIN ] AFGC: Fetched primary data is valid. [2025-10-02T17:05:41.945831] [DEBUG] [LOCAL ] AFGC: Saving primary data. [2025-10-02T17:05:41.946294] [DEBUG] [LOCAL ] AFGC: Trimmed 3736 records to 2561 (keeping 200 days of data) [2025-10-02T17:05:41.964405] [DEBUG] [LOCAL ] AFGC: Primary data saved (2561 records). [2025-10-02T17:05:41.964528] [INFO ] [MAIN ] AFGC: Full history saved. [2025-10-02T17:05:41.964689] [INFO ] [MAIN ] Update Progress: 47/2370 symbols completed. AFGC took 33.3s. Estimated remaining: 4h 38m 33s. Rate: 8.3 symbols/min [2025-10-02T17:05:42.148239] [INFO ] [MAIN ] AG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:05:42.205041] [DEBUG] [LOCAL ] AG: Loaded 53643 existing records from primary storage. [2025-10-02T17:05:42.205394] [INFO ] [MAIN ] AG: Loaded 53643 existing records. [2025-10-02T17:05:42.424255] [WARN ] [MAIN ] AG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:05:42.424566] [INFO ] [MAIN ] AG: Wiping existing primary data before full refresh. [2025-10-02T17:05:42.424618] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-10-02T17:05:42.425485] [DEBUG] [LOCAL ] AG: Deleted primary data file. [2025-10-02T17:05:42.425551] [INFO ] [MAIN ] AG: Starting full primary refresh. [2025-10-02T17:05:42.549063] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-02T17:05:42.678663] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-02. [2025-10-02T17:05:42.832581] [INFO ] [REMOTE ] AG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:05:43.473005] [INFO ] [REMOTE ] AG: Fetching primary data for 2024-12. [2025-10-02T17:05:44.272984] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-09. [2025-10-02T17:05:44.381229] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-02T17:05:44.810189] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-02T17:05:45.073040] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-07. [2025-10-02T17:05:45.589885] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-02T17:05:45.655883] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-02T17:05:45.873042] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-01. [2025-10-02T17:05:46.673025] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-08. [2025-10-02T17:05:47.081150] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-02T17:05:47.473043] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-09. [2025-10-02T17:05:47.874955] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-02T17:05:47.956877] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-02T17:05:48.272989] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-10. [2025-10-02T17:05:48.718934] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-02T17:05:48.719697] [INFO ] [REMOTE ] AFGD: Full fetch complete (3131 records). [2025-10-02T17:05:48.719837] [DEBUG] [VALIDATOR ] AFGD: Validating primary data. [2025-10-02T17:05:49.079143] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-10. [2025-10-02T17:05:49.129510] [DEBUG] [VALIDATOR ] AFGD: All expected trading days are present. [2025-10-02T17:05:49.129591] [DEBUG] [VALIDATOR ] AFGD: Primary data validation passed. [2025-10-02T17:05:49.129777] [INFO ] [MAIN ] AFGD: Fetched primary data is valid. [2025-10-02T17:05:49.129870] [DEBUG] [LOCAL ] AFGD: Saving primary data. [2025-10-02T17:05:49.130258] [DEBUG] [LOCAL ] AFGD: Trimmed 3131 records to 1827 (keeping 200 days of data) [2025-10-02T17:05:49.142983] [DEBUG] [LOCAL ] AFGD: Primary data saved (1827 records). [2025-10-02T17:05:49.143319] [INFO ] [MAIN ] AFGD: Full history saved. [2025-10-02T17:05:49.143427] [INFO ] [MAIN ] Update Progress: 48/2370 symbols completed. AFGD took 37.8s. Estimated remaining: 4h 38m 25s. Rate: 8.3 symbols/min [2025-10-02T17:05:49.345195] [INFO ] [MAIN ] AGCO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:05:49.404296] [DEBUG] [LOCAL ] AGCO: Loaded 42377 existing records from primary storage. [2025-10-02T17:05:49.404870] [INFO ] [MAIN ] AGCO: Loaded 42377 existing records. [2025-10-02T17:05:49.608716] [WARN ] [MAIN ] AGCO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:05:49.612293] [INFO ] [MAIN ] AGCO: Wiping existing primary data before full refresh. [2025-10-02T17:05:49.612105] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-02T17:05:49.613471] [INFO ] [REMOTE ] AFGE: Full fetch complete (3482 records). [2025-10-02T17:05:49.613588] [INFO ] [LOCAL ] AGCO: Starting deletion of primary data. [2025-10-02T17:05:49.613766] [DEBUG] [VALIDATOR ] AFGE: Validating primary data. [2025-10-02T17:05:49.648680] [DEBUG] [LOCAL ] AGCO: Deleted primary data file. [2025-10-02T17:05:49.675610] [INFO ] [MAIN ] AGCO: Starting full primary refresh. [2025-10-02T17:05:49.881244] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-02. [2025-10-02T17:05:50.465055] [DEBUG] [VALIDATOR ] AFGE: All expected trading days are present. [2025-10-02T17:05:50.495397] [DEBUG] [VALIDATOR ] AFGE: Primary data validation passed. [2025-10-02T17:05:50.525032] [INFO ] [MAIN ] AFGE: Fetched primary data is valid. [2025-10-02T17:05:50.530567] [INFO ] [REMOTE ] AGCO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:05:50.531361] [DEBUG] [LOCAL ] AFGE: Saving primary data. [2025-10-02T17:05:50.532128] [DEBUG] [LOCAL ] AFGE: Trimmed 3482 records to 2467 (keeping 200 days of data) [2025-10-02T17:05:50.554006] [DEBUG] [LOCAL ] AFGE: Primary data saved (2467 records). [2025-10-02T17:05:50.554175] [INFO ] [MAIN ] AFGE: Full history saved. [2025-10-02T17:05:50.554313] [INFO ] [MAIN ] Update Progress: 49/2370 symbols completed. AFGE took 30.2s. Estimated remaining: 4h 33m 44s. Rate: 8.5 symbols/min [2025-10-02T17:05:50.678210] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2024-12. [2025-10-02T17:05:50.826968] [INFO ] [MAIN ] AGD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:05:50.864382] [DEBUG] [LOCAL ] AGD: Loaded 18028 existing records from primary storage. [2025-10-02T17:05:50.864759] [INFO ] [MAIN ] AGD: Loaded 18028 existing records. [2025-10-02T17:05:51.137928] [WARN ] [MAIN ] AGD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:05:51.138230] [INFO ] [MAIN ] AGD: Wiping existing primary data before full refresh. [2025-10-02T17:05:51.138310] [INFO ] [LOCAL ] AGD: Starting deletion of primary data. [2025-10-02T17:05:51.138607] [DEBUG] [LOCAL ] AGD: Deleted primary data file. [2025-10-02T17:05:51.138720] [INFO ] [MAIN ] AGD: Starting full primary refresh. [2025-10-02T17:05:51.480417] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-03. [2025-10-02T17:05:51.633562] [INFO ] [REMOTE ] AGD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:05:51.665778] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-02T17:05:52.272969] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-03. [2025-10-02T17:05:52.548133] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-02T17:05:53.072992] [INFO ] [REMOTE ] AGD: Fetching primary data for 2024-12. [2025-10-02T17:05:53.506775] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-02T17:05:53.883282] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-01. [2025-10-02T17:05:53.890803] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-02T17:05:54.053480] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-02T17:05:54.673001] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-04. [2025-10-02T17:05:55.383821] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-02T17:05:55.473017] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-04. [2025-10-02T17:05:56.273041] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-01. [2025-10-02T17:05:56.860932] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-02T17:05:56.933539] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-02T17:05:57.072971] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-05. [2025-10-02T17:05:57.481575] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-02T17:05:57.873052] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-02. [2025-10-02T17:05:58.672999] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-05. [2025-10-02T17:05:59.185076] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-02T17:05:59.226199] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-02T17:05:59.473053] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-02. [2025-10-02T17:06:00.091241] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-02T17:06:00.273037] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-06. [2025-10-02T17:06:00.348455] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-02T17:06:01.073042] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-03. [2025-10-02T17:06:01.873008] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-03. [2025-10-02T17:06:01.997053] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-02T17:06:02.271111] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-02T17:06:02.672994] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-06. [2025-10-02T17:06:03.473007] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-04. [2025-10-02T17:06:03.645365] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-02T17:06:04.272966] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-07. [2025-10-02T17:06:04.459856] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-02T17:06:04.569801] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-02T17:06:05.073005] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-05. [2025-10-02T17:06:05.872975] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-04. [2025-10-02T17:06:06.129718] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-02T17:06:06.360535] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-02T17:06:06.673039] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-08. [2025-10-02T17:06:07.472497] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-02T17:06:07.476278] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-06. [2025-10-02T17:06:08.273004] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-05. [2025-10-02T17:06:08.505237] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-02T17:06:08.754919] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-02T17:06:09.073085] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-07. [2025-10-02T17:06:09.404671] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-02T17:06:09.873038] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-06. [2025-10-02T17:06:10.673024] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-07. [2025-10-02T17:06:10.941637] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-02T17:06:11.178757] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-02T17:06:11.346293] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-02T17:06:11.473064] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-09. [2025-10-02T17:06:12.273001] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-08. [2025-10-02T17:06:13.072999] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-08. [2025-10-02T17:06:13.684795] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-02T17:06:13.872981] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-07. [2025-10-02T17:06:13.913379] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-02T17:06:13.990960] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-02T17:06:14.673052] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-09. [2025-10-02T17:06:15.473030] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-10. [2025-10-02T17:06:15.577495] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-02T17:06:15.705404] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-02T17:06:16.273019] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-10. [2025-10-02T17:06:17.073029] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-08. [2025-10-02T17:06:17.263830] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-02T17:06:17.265183] [INFO ] [REMOTE ] AGD: Full fetch complete (25564 records). [2025-10-02T17:06:17.265273] [DEBUG] [VALIDATOR ] AGD: Validating primary data. [2025-10-02T17:06:17.451540] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-02T17:06:17.486110] [INFO ] [REMOTE ] AG: Full fetch complete (77606 records). [2025-10-02T17:06:17.527768] [DEBUG] [VALIDATOR ] AG: Validating primary data. [2025-10-02T17:06:17.883181] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-09. [2025-10-02T17:06:17.900975] [DEBUG] [VALIDATOR ] AGD: All expected trading days are present. [2025-10-02T17:06:17.975113] [DEBUG] [VALIDATOR ] AGD: Primary data validation passed. [2025-10-02T17:06:17.990584] [INFO ] [MAIN ] AGD: Fetched primary data is valid. [2025-10-02T17:06:18.036512] [DEBUG] [LOCAL ] AGD: Saving primary data. [2025-10-02T17:06:18.100589] [DEBUG] [LOCAL ] AGD: Trimmed 25564 records to 18158 (keeping 200 days of data) [2025-10-02T17:06:18.245063] [DEBUG] [VALIDATOR ] AG: All expected trading days are present. [2025-10-02T17:06:18.245475] [DEBUG] [VALIDATOR ] AG: Primary data validation passed. [2025-10-02T17:06:18.279425] [INFO ] [MAIN ] AG: Fetched primary data is valid. [2025-10-02T17:06:18.280314] [DEBUG] [LOCAL ] AG: Saving primary data. [2025-10-02T17:06:18.285393] [DEBUG] [LOCAL ] AG: Trimmed 77606 records to 54032 (keeping 200 days of data) [2025-10-02T17:06:18.408517] [DEBUG] [LOCAL ] AGD: Primary data saved (18158 records). [2025-10-02T17:06:18.412259] [INFO ] [MAIN ] AGD: Full history saved. [2025-10-02T17:06:18.412416] [INFO ] [MAIN ] Update Progress: 50/2370 symbols completed. AGD took 27.9s. Estimated remaining: 4h 49m 41s. Rate: 8.0 symbols/min [2025-10-02T17:06:18.523681] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-02T17:06:18.656394] [INFO ] [MAIN ] AGI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:06:18.724972] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-09. [2025-10-02T17:06:18.836231] [DEBUG] [LOCAL ] AGI: Loaded 53416 existing records from primary storage. [2025-10-02T17:06:18.838573] [INFO ] [MAIN ] AGI: Loaded 53416 existing records. [2025-10-02T17:06:19.063267] [WARN ] [MAIN ] AGI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:06:19.067998] [INFO ] [MAIN ] AGI: Wiping existing primary data before full refresh. [2025-10-02T17:06:19.068197] [INFO ] [LOCAL ] AGI: Starting deletion of primary data. [2025-10-02T17:06:19.105527] [DEBUG] [LOCAL ] AGI: Deleted primary data file. [2025-10-02T17:06:19.111621] [INFO ] [MAIN ] AGI: Starting full primary refresh. [2025-10-02T17:06:19.587949] [INFO ] [REMOTE ] AGI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:06:19.591576] [INFO ] [REMOTE ] AGI: Fetching primary data for 2024-12. [2025-10-02T17:06:19.598865] [DEBUG] [LOCAL ] AG: Primary data saved (54032 records). [2025-10-02T17:06:19.599049] [INFO ] [MAIN ] AG: Full history saved. [2025-10-02T17:06:19.601196] [INFO ] [MAIN ] Update Progress: 51/2370 symbols completed. AG took 37.6s. Estimated remaining: 4h 44m 47s. Rate: 8.1 symbols/min [2025-10-02T17:06:19.792959] [INFO ] [MAIN ] AGL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:06:19.831047] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-02T17:06:19.909184] [DEBUG] [LOCAL ] AGL: Loaded 52447 existing records from primary storage. [2025-10-02T17:06:19.909557] [INFO ] [MAIN ] AGL: Loaded 52447 existing records. [2025-10-02T17:06:20.115932] [WARN ] [MAIN ] AGL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:06:20.116285] [INFO ] [MAIN ] AGL: Wiping existing primary data before full refresh. [2025-10-02T17:06:20.116390] [INFO ] [LOCAL ] AGL: Starting deletion of primary data. [2025-10-02T17:06:20.117577] [DEBUG] [LOCAL ] AGL: Deleted primary data file. [2025-10-02T17:06:20.117663] [INFO ] [MAIN ] AGL: Starting full primary refresh. [2025-10-02T17:06:20.209266] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-02T17:06:20.274729] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-10. [2025-10-02T17:06:20.571616] [INFO ] [REMOTE ] AGL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:06:21.072989] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-10. [2025-10-02T17:06:21.239342] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-02T17:06:21.604808] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-02T17:06:21.611409] [INFO ] [REMOTE ] AFL: Full fetch complete (76915 records). [2025-10-02T17:06:21.611717] [DEBUG] [VALIDATOR ] AFL: Validating primary data. [2025-10-02T17:06:21.878178] [INFO ] [REMOTE ] AGL: Fetching primary data for 2024-12. [2025-10-02T17:06:22.088858] [DEBUG] [VALIDATOR ] AFL: All expected trading days are present. [2025-10-02T17:06:22.088958] [DEBUG] [VALIDATOR ] AFL: Primary data validation passed. [2025-10-02T17:06:22.089726] [INFO ] [MAIN ] AFL: Fetched primary data is valid. [2025-10-02T17:06:22.089837] [DEBUG] [LOCAL ] AFL: Saving primary data. [2025-10-02T17:06:22.092273] [DEBUG] [LOCAL ] AFL: Trimmed 76915 records to 53536 (keeping 200 days of data) [2025-10-02T17:06:22.417773] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-02T17:06:22.443936] [INFO ] [REMOTE ] AGCO: Full fetch complete (61851 records). [2025-10-02T17:06:22.446772] [DEBUG] [VALIDATOR ] AGCO: Validating primary data. [2025-10-02T17:06:22.594246] [DEBUG] [LOCAL ] AFL: Primary data saved (53536 records). [2025-10-02T17:06:22.599634] [INFO ] [MAIN ] AFL: Full history saved. [2025-10-02T17:06:22.625116] [INFO ] [MAIN ] Update Progress: 52/2370 symbols completed. AFL took 55.1s. Estimated remaining: 4h 41m 26s. Rate: 8.2 symbols/min [2025-10-02T17:06:22.704201] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-01. [2025-10-02T17:06:23.058147] [INFO ] [MAIN ] AGM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:06:23.118453] [DEBUG] [VALIDATOR ] AGCO: All expected trading days are present. [2025-10-02T17:06:23.121319] [DEBUG] [VALIDATOR ] AGCO: Primary data validation passed. [2025-10-02T17:06:23.122099] [INFO ] [MAIN ] AGCO: Fetched primary data is valid. [2025-10-02T17:06:23.122180] [DEBUG] [LOCAL ] AGCO: Saving primary data. [2025-10-02T17:06:23.128871] [DEBUG] [LOCAL ] AGM: Loaded 10179 existing records from primary storage. [2025-10-02T17:06:23.128453] [DEBUG] [LOCAL ] AGCO: Trimmed 61851 records to 42677 (keeping 200 days of data) [2025-10-02T17:06:23.129297] [INFO ] [MAIN ] AGM: Loaded 10179 existing records. [2025-10-02T17:06:23.476884] [WARN ] [MAIN ] AGM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:06:23.587448] [INFO ] [MAIN ] AGM: Wiping existing primary data before full refresh. [2025-10-02T17:06:23.599249] [INFO ] [LOCAL ] AGM: Starting deletion of primary data. [2025-10-02T17:06:23.600835] [DEBUG] [LOCAL ] AGM: Deleted primary data file. [2025-10-02T17:06:23.601853] [INFO ] [MAIN ] AGM: Starting full primary refresh. [2025-10-02T17:06:23.720693] [DEBUG] [LOCAL ] AGCO: Primary data saved (42677 records). [2025-10-02T17:06:23.778699] [INFO ] [MAIN ] AGCO: Full history saved. [2025-10-02T17:06:23.802833] [INFO ] [MAIN ] Update Progress: 53/2370 symbols completed. AGCO took 34.7s. Estimated remaining: 4h 36m 52s. Rate: 8.4 symbols/min [2025-10-02T17:06:23.810049] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-02T17:06:23.941045] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-01. [2025-10-02T17:06:24.228199] [INFO ] [MAIN ] AGO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:06:24.308888] [INFO ] [REMOTE ] AGM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:06:24.309896] [INFO ] [REMOTE ] AGM: Fetching primary data for 2024-12. [2025-10-02T17:06:24.353674] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-02T17:06:24.373910] [DEBUG] [LOCAL ] AGO: Loaded 27914 existing records from primary storage. [2025-10-02T17:06:24.374175] [INFO ] [MAIN ] AGO: Loaded 27914 existing records. [2025-10-02T17:06:24.574208] [WARN ] [MAIN ] AGO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:06:24.574450] [INFO ] [MAIN ] AGO: Wiping existing primary data before full refresh. [2025-10-02T17:06:24.574575] [INFO ] [LOCAL ] AGO: Starting deletion of primary data. [2025-10-02T17:06:24.575670] [DEBUG] [LOCAL ] AGO: Deleted primary data file. [2025-10-02T17:06:24.575733] [INFO ] [MAIN ] AGO: Starting full primary refresh. [2025-10-02T17:06:24.963318] [INFO ] [REMOTE ] AGO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:06:25.073071] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-02. [2025-10-02T17:06:25.111487] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-02T17:06:25.873014] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-01. [2025-10-02T17:06:25.926680] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-02T17:06:26.501301] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-02T17:06:26.573170] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-02T17:06:26.673030] [INFO ] [REMOTE ] AGO: Fetching primary data for 2024-12. [2025-10-02T17:06:27.473012] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-02. [2025-10-02T17:06:27.956014] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-02T17:06:27.986164] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-02T17:06:28.273002] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-03. [2025-10-02T17:06:28.865218] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-02T17:06:29.073029] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-03. [2025-10-02T17:06:29.872998] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-02. [2025-10-02T17:06:30.673007] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-01. [2025-10-02T17:06:30.960680] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-02T17:06:31.276615] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-02T17:06:31.473001] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-04. [2025-10-02T17:06:31.618621] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-02T17:06:32.273002] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-04. [2025-10-02T17:06:33.036445] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-02T17:06:33.072957] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-05. [2025-10-02T17:06:33.326677] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-02T17:06:33.620578] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-02T17:06:33.872993] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-02. [2025-10-02T17:06:34.673028] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-05. [2025-10-02T17:06:34.945083] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-02T17:06:35.473008] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-06. [2025-10-02T17:06:36.273008] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-03. [2025-10-02T17:06:36.500335] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-02T17:06:36.680512] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-02T17:06:37.073016] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-07. [2025-10-02T17:06:37.763739] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-02T17:06:37.882146] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-03. [2025-10-02T17:06:37.903904] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-02T17:06:38.672991] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-06. [2025-10-02T17:06:39.235105] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-02T17:06:39.473004] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-04. [2025-10-02T17:06:40.272980] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-04. [2025-10-02T17:06:40.562623] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-02T17:06:40.972924] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-02T17:06:41.073046] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-07. [2025-10-02T17:06:41.873042] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-05. [2025-10-02T17:06:41.943479] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-02T17:06:42.673048] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-05. [2025-10-02T17:06:42.987666] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-02T17:06:43.104781] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-02T17:06:43.473075] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-08. [2025-10-02T17:06:44.272988] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-08. [2025-10-02T17:06:44.524615] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-02T17:06:45.023493] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-02T17:06:45.073015] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-06. [2025-10-02T17:06:45.140828] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-02T17:06:45.873046] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-09. [2025-10-02T17:06:46.206769] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-02T17:06:46.673006] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-07. [2025-10-02T17:06:47.473015] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-09. [2025-10-02T17:06:47.793747] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-02T17:06:48.065252] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-02T17:06:48.188326] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-02T17:06:48.273004] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-10. [2025-10-02T17:06:48.994351] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-02T17:06:48.995625] [INFO ] [REMOTE ] AGM: Full fetch complete (12835 records). [2025-10-02T17:06:48.995734] [DEBUG] [VALIDATOR ] AGM: Validating primary data. [2025-10-02T17:06:49.078204] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-06. [2025-10-02T17:06:49.436193] [DEBUG] [VALIDATOR ] AGM: All expected trading days are present. [2025-10-02T17:06:49.436335] [DEBUG] [VALIDATOR ] AGM: Primary data validation passed. [2025-10-02T17:06:49.436672] [INFO ] [MAIN ] AGM: Fetched primary data is valid. [2025-10-02T17:06:49.436739] [DEBUG] [LOCAL ] AGM: Saving primary data. [2025-10-02T17:06:49.437230] [DEBUG] [LOCAL ] AGM: Trimmed 12835 records to 10296 (keeping 200 days of data) [2025-10-02T17:06:49.502965] [DEBUG] [LOCAL ] AGM: Primary data saved (10296 records). [2025-10-02T17:06:49.503101] [INFO ] [MAIN ] AGM: Full history saved. [2025-10-02T17:06:49.503183] [INFO ] [MAIN ] Update Progress: 54/2370 symbols completed. AGM took 26.9s. Estimated remaining: 4h 49m 60s. Rate: 8.0 symbols/min [2025-10-02T17:06:49.694466] [INFO ] [MAIN ] AGRO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:06:49.695479] [DEBUG] [LOCAL ] AGRO: No existing data file found in primary storage. [2025-10-02T17:06:49.695537] [WARN ] [MAIN ] AGRO: No existing data found, performing full refresh instead. [2025-10-02T17:06:49.695760] [INFO ] [MAIN ] AGRO: Wiping existing primary data before full refresh. [2025-10-02T17:06:49.695831] [INFO ] [LOCAL ] AGRO: Starting deletion of primary data. [2025-10-02T17:06:49.696053] [DEBUG] [LOCAL ] AGRO: No primary data file found to delete. [2025-10-02T17:06:49.696108] [INFO ] [MAIN ] AGRO: Starting full primary refresh. [2025-10-02T17:06:49.884897] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-08. [2025-10-02T17:06:50.093278] [INFO ] [REMOTE ] AGRO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:06:50.672994] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2024-12. [2025-10-02T17:06:50.898042] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-02T17:06:51.267905] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-02T17:06:51.473056] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-07. [2025-10-02T17:06:52.225753] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-02T17:06:52.272997] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-10. [2025-10-02T17:06:53.073014] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-01. [2025-10-02T17:06:53.270836] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-02T17:06:53.719147] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-02T17:06:53.720884] [INFO ] [REMOTE ] AGI: Full fetch complete (76421 records). [2025-10-02T17:06:53.721010] [DEBUG] [VALIDATOR ] AGI: Validating primary data. [2025-10-02T17:06:53.721923] [FATAL] [VALIDATOR ] AGI: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:06:53.722024] [FATAL] [MAIN ] AGI: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:06:53.722070] [WARN ] [MAIN ] AGI: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:06:53.722142] [INFO ] [LOCAL ] AGI: Starting deletion of primary data. [2025-10-02T17:06:53.722209] [DEBUG] [LOCAL ] AGI: No primary data file found to delete. [2025-10-02T17:06:53.722248] [INFO ] [LOCAL ] AGI: Starting deletion of derivative data. [2025-10-02T17:06:53.722703] [DEBUG] [LOCAL ] AGI: Deleted derivative data file. [2025-10-02T17:06:53.722802] [INFO ] [MAIN ] Update Progress: 55/2370 symbols completed. AGI took 35.3s. Estimated remaining: 4h 47m 33s. Rate: 8.1 symbols/min [2025-10-02T17:06:53.884405] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-09. [2025-10-02T17:06:53.923914] [INFO ] [MAIN ] AGX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:06:53.964667] [DEBUG] [LOCAL ] AGX: Loaded 33195 existing records from primary storage. [2025-10-02T17:06:53.964968] [INFO ] [MAIN ] AGX: Loaded 33195 existing records. [2025-10-02T17:06:54.164271] [WARN ] [MAIN ] AGX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:06:54.164565] [INFO ] [MAIN ] AGX: Wiping existing primary data before full refresh. [2025-10-02T17:06:54.164706] [INFO ] [LOCAL ] AGX: Starting deletion of primary data. [2025-10-02T17:06:54.167234] [DEBUG] [LOCAL ] AGX: Deleted primary data file. [2025-10-02T17:06:54.167300] [INFO ] [MAIN ] AGX: Starting full primary refresh. [2025-10-02T17:06:54.587174] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-02T17:06:54.585963] [INFO ] [REMOTE ] AGX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:06:54.672976] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-02. [2025-10-02T17:06:55.014141] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-02T17:06:55.473015] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-10. [2025-10-02T17:06:55.898888] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-02T17:06:56.273020] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-03. [2025-10-02T17:06:56.553585] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-02T17:06:56.555753] [INFO ] [REMOTE ] AGO: Full fetch complete (39419 records). [2025-10-02T17:06:56.555886] [DEBUG] [VALIDATOR ] AGO: Validating primary data. [2025-10-02T17:06:56.985876] [DEBUG] [VALIDATOR ] AGO: All expected trading days are present. [2025-10-02T17:06:56.985962] [DEBUG] [VALIDATOR ] AGO: Primary data validation passed. [2025-10-02T17:06:56.986412] [INFO ] [MAIN ] AGO: Fetched primary data is valid. [2025-10-02T17:06:56.986479] [DEBUG] [LOCAL ] AGO: Saving primary data. [2025-10-02T17:06:56.987537] [DEBUG] [LOCAL ] AGO: Trimmed 39419 records to 28176 (keeping 200 days of data) [2025-10-02T17:06:57.084382] [INFO ] [REMOTE ] AGX: Fetching primary data for 2024-12. [2025-10-02T17:06:57.174151] [DEBUG] [LOCAL ] AGO: Primary data saved (28176 records). [2025-10-02T17:06:57.174304] [INFO ] [MAIN ] AGO: Full history saved. [2025-10-02T17:06:57.174399] [INFO ] [MAIN ] Update Progress: 56/2370 symbols completed. AGO took 33.3s. Estimated remaining: 4h 44m 41s. Rate: 8.1 symbols/min [2025-10-02T17:06:57.359128] [INFO ] [MAIN ] AHH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:06:57.397997] [DEBUG] [LOCAL ] AHH: Loaded 41122 existing records from primary storage. [2025-10-02T17:06:57.398572] [INFO ] [MAIN ] AHH: Loaded 41122 existing records. [2025-10-02T17:06:57.648728] [WARN ] [MAIN ] AHH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:06:57.649005] [INFO ] [MAIN ] AHH: Wiping existing primary data before full refresh. [2025-10-02T17:06:57.649075] [INFO ] [LOCAL ] AHH: Starting deletion of primary data. [2025-10-02T17:06:57.658953] [DEBUG] [LOCAL ] AHH: Deleted primary data file. [2025-10-02T17:06:57.670409] [INFO ] [MAIN ] AHH: Starting full primary refresh. [2025-10-02T17:06:57.740268] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-02T17:06:57.878741] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-08. [2025-10-02T17:06:58.078421] [INFO ] [REMOTE ] AHH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:06:58.673001] [INFO ] [REMOTE ] AHH: Fetching primary data for 2024-12. [2025-10-02T17:06:58.711064] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-02T17:06:59.473008] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-04. [2025-10-02T17:06:59.917451] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-02T17:07:00.179834] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-02T17:07:00.273055] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-09. [2025-10-02T17:07:01.073011] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-01. [2025-10-02T17:07:01.290353] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-02T17:07:01.873021] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-05. [2025-10-02T17:07:02.069313] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-02T17:07:02.181069] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-02T17:07:02.672990] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-01. [2025-10-02T17:07:03.399386] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-02T17:07:03.473030] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-06. [2025-10-02T17:07:04.273011] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-10. [2025-10-02T17:07:04.444743] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-02T17:07:04.504314] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-02T17:07:05.073012] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-02. [2025-10-02T17:07:05.725245] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-02T17:07:05.727403] [INFO ] [REMOTE ] AGL: Full fetch complete (75522 records). [2025-10-02T17:07:05.727520] [DEBUG] [VALIDATOR ] AGL: Validating primary data. [2025-10-02T17:07:05.888002] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-02. [2025-10-02T17:07:06.180879] [DEBUG] [VALIDATOR ] AGL: All expected trading days are present. [2025-10-02T17:07:06.180972] [DEBUG] [VALIDATOR ] AGL: Primary data validation passed. [2025-10-02T17:07:06.181790] [INFO ] [MAIN ] AGL: Fetched primary data is valid. [2025-10-02T17:07:06.181861] [DEBUG] [LOCAL ] AGL: Saving primary data. [2025-10-02T17:07:06.183471] [DEBUG] [LOCAL ] AGL: Trimmed 75522 records to 52833 (keeping 200 days of data) [2025-10-02T17:07:06.501244] [DEBUG] [LOCAL ] AGL: Primary data saved (52833 records). [2025-10-02T17:07:06.501388] [INFO ] [MAIN ] AGL: Full history saved. [2025-10-02T17:07:06.503054] [INFO ] [MAIN ] Update Progress: 57/2370 symbols completed. AGL took 46.9s. Estimated remaining: 4h 45m 52s. Rate: 8.1 symbols/min [2025-10-02T17:07:06.655710] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-02T17:07:06.682090] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-07. [2025-10-02T17:07:06.729464] [INFO ] [MAIN ] AHL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:07:06.729692] [DEBUG] [LOCAL ] AHL: No existing data file found in primary storage. [2025-10-02T17:07:06.729747] [WARN ] [MAIN ] AHL: No existing data found, performing full refresh instead. [2025-10-02T17:07:06.729861] [INFO ] [MAIN ] AHL: Wiping existing primary data before full refresh. [2025-10-02T17:07:06.729908] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-02T17:07:06.729958] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-02T17:07:06.730002] [INFO ] [MAIN ] AHL: Starting full primary refresh. [2025-10-02T17:07:07.125847] [INFO ] [REMOTE ] AHL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:07:07.335054] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-02T17:07:07.473022] [INFO ] [REMOTE ] AHL: Fetching primary data for 2024-12. [2025-10-02T17:07:07.684176] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T17:07:07.684524] [WARN ] [REMOTE ] AHL: No data returned for month 2024-12 [2025-10-02T17:07:07.684677] [FATAL] [REMOTE ] AHL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T17:07:07.684768] [FATAL] [MAIN ] AHL: Failed to fetch primary data. [2025-10-02T17:07:07.684859] [WARN ] [MAIN ] AHL: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T17:07:07.684947] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-02T17:07:07.685023] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-02T17:07:07.685062] [INFO ] [LOCAL ] AHL: Starting deletion of derivative data. [2025-10-02T17:07:07.685103] [DEBUG] [LOCAL ] AHL: No derivative data file found to delete. [2025-10-02T17:07:07.685150] [INFO ] [MAIN ] Update Progress: 58/2370 symbols completed. AHL took 1.2s. Estimated remaining: 4h 41m 36s. Rate: 8.2 symbols/min [2025-10-02T17:07:07.900230] [INFO ] [MAIN ] AHR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:07:07.921946] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-02T17:07:07.978847] [DEBUG] [LOCAL ] AHR: Loaded 49165 existing records from primary storage. [2025-10-02T17:07:07.979197] [INFO ] [MAIN ] AHR: Loaded 49165 existing records. [2025-10-02T17:07:08.172793] [WARN ] [MAIN ] AHR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:07:08.173001] [INFO ] [MAIN ] AHR: Wiping existing primary data before full refresh. [2025-10-02T17:07:08.173050] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-10-02T17:07:08.174437] [DEBUG] [LOCAL ] AHR: Deleted primary data file. [2025-10-02T17:07:08.174501] [INFO ] [MAIN ] AHR: Starting full primary refresh. [2025-10-02T17:07:08.278176] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-03. [2025-10-02T17:07:08.558270] [INFO ] [REMOTE ] AHR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:07:09.073021] [INFO ] [REMOTE ] AHR: Fetching primary data for 2024-12. [2025-10-02T17:07:09.872987] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-03. [2025-10-02T17:07:09.978278] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-02T17:07:10.672987] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-04. [2025-10-02T17:07:10.790096] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-02T17:07:11.473018] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-01. [2025-10-02T17:07:11.674221] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-02T17:07:12.273009] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-08. [2025-10-02T17:07:12.405702] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-02T17:07:12.807606] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-02T17:07:13.073009] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-05. [2025-10-02T17:07:13.293625] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-02T17:07:13.873009] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-09. [2025-10-02T17:07:14.247575] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-02T17:07:14.673004] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-04. [2025-10-02T17:07:15.138843] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-02T17:07:15.472999] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-10. [2025-10-02T17:07:16.031385] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-02T17:07:16.273044] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-06. [2025-10-02T17:07:16.513259] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-02T17:07:16.514784] [INFO ] [REMOTE ] AGRO: Full fetch complete (49644 records). [2025-10-02T17:07:16.514879] [DEBUG] [VALIDATOR ] AGRO: Validating primary data. [2025-10-02T17:07:16.938283] [DEBUG] [VALIDATOR ] AGRO: All expected trading days are present. [2025-10-02T17:07:16.938381] [DEBUG] [VALIDATOR ] AGRO: Primary data validation passed. [2025-10-02T17:07:16.939019] [INFO ] [MAIN ] AGRO: Fetched primary data is valid. [2025-10-02T17:07:16.939091] [DEBUG] [LOCAL ] AGRO: Saving primary data. [2025-10-02T17:07:16.940390] [DEBUG] [LOCAL ] AGRO: Trimmed 49644 records to 33687 (keeping 200 days of data) [2025-10-02T17:07:17.102213] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-02. [2025-10-02T17:07:17.150793] [DEBUG] [LOCAL ] AGRO: Primary data saved (33687 records). [2025-10-02T17:07:17.150928] [INFO ] [MAIN ] AGRO: Full history saved. [2025-10-02T17:07:17.151001] [INFO ] [MAIN ] Update Progress: 59/2370 symbols completed. AGRO took 27.6s. Estimated remaining: 4h 42m 54s. Rate: 8.2 symbols/min [2025-10-02T17:07:17.338616] [INFO ] [MAIN ] AHT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:07:17.346299] [DEBUG] [LOCAL ] AHT: Loaded 6134 existing records from primary storage. [2025-10-02T17:07:17.346505] [INFO ] [MAIN ] AHT: Loaded 6134 existing records. [2025-10-02T17:07:17.542686] [WARN ] [MAIN ] AHT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:07:17.543023] [INFO ] [MAIN ] AHT: Wiping existing primary data before full refresh. [2025-10-02T17:07:17.543087] [INFO ] [LOCAL ] AHT: Starting deletion of primary data. [2025-10-02T17:07:17.543414] [DEBUG] [LOCAL ] AHT: Deleted primary data file. [2025-10-02T17:07:17.543474] [INFO ] [MAIN ] AHT: Starting full primary refresh. [2025-10-02T17:07:17.881211] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-05. [2025-10-02T17:07:17.982139] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-02T17:07:17.980660] [INFO ] [REMOTE ] AHT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:07:18.673005] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-07. [2025-10-02T17:07:18.731148] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-02T17:07:19.473020] [INFO ] [REMOTE ] AHT: Fetching primary data for 2024-12. [2025-10-02T17:07:19.527939] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-02T17:07:20.147440] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-02T17:07:20.170200] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-02T17:07:20.272995] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-01. [2025-10-02T17:07:20.929461] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-02T17:07:21.073009] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-08. [2025-10-02T17:07:21.873012] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-06. [2025-10-02T17:07:22.635829] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-02T17:07:22.672994] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-02. [2025-10-02T17:07:23.307473] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-02T17:07:23.472998] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-09. [2025-10-02T17:07:23.570744] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-02T17:07:24.273009] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-07. [2025-10-02T17:07:25.072983] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-03. [2025-10-02T17:07:25.222085] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-02T17:07:25.873003] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-10. [2025-10-02T17:07:25.920458] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-02T17:07:26.673027] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-08. [2025-10-02T17:07:26.809855] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-02T17:07:26.960365] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-02T17:07:26.962144] [INFO ] [REMOTE ] AHH: Full fetch complete (60186 records). [2025-10-02T17:07:26.962257] [DEBUG] [VALIDATOR ] AHH: Validating primary data. [2025-10-02T17:07:27.386505] [DEBUG] [VALIDATOR ] AHH: All expected trading days are present. [2025-10-02T17:07:27.386596] [DEBUG] [VALIDATOR ] AHH: Primary data validation passed. [2025-10-02T17:07:27.387278] [INFO ] [MAIN ] AHH: Fetched primary data is valid. [2025-10-02T17:07:27.387350] [DEBUG] [LOCAL ] AHH: Saving primary data. [2025-10-02T17:07:27.388812] [DEBUG] [LOCAL ] AHH: Trimmed 60186 records to 41379 (keeping 200 days of data) [2025-10-02T17:07:27.477421] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-04. [2025-10-02T17:07:27.650437] [DEBUG] [LOCAL ] AHH: Primary data saved (41379 records). [2025-10-02T17:07:27.650576] [INFO ] [MAIN ] AHH: Full history saved. [2025-10-02T17:07:27.650680] [INFO ] [MAIN ] Update Progress: 60/2370 symbols completed. AHH took 30.5s. Estimated remaining: 4h 44m 48s. Rate: 8.1 symbols/min [2025-10-02T17:07:27.844872] [INFO ] [MAIN ] AI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:07:27.864893] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-02T17:07:27.926149] [DEBUG] [LOCAL ] AI: Loaded 53750 existing records from primary storage. [2025-10-02T17:07:27.926490] [INFO ] [MAIN ] AI: Loaded 53750 existing records. [2025-10-02T17:07:28.131772] [WARN ] [MAIN ] AI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:07:28.132043] [INFO ] [MAIN ] AI: Wiping existing primary data before full refresh. [2025-10-02T17:07:28.132103] [INFO ] [LOCAL ] AI: Starting deletion of primary data. [2025-10-02T17:07:28.133271] [DEBUG] [LOCAL ] AI: Deleted primary data file. [2025-10-02T17:07:28.133363] [INFO ] [MAIN ] AI: Starting full primary refresh. [2025-10-02T17:07:28.278190] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-09. [2025-10-02T17:07:28.540486] [INFO ] [REMOTE ] AI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:07:28.986173] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-02T17:07:29.073002] [INFO ] [REMOTE ] AI: Fetching primary data for 2024-12. [2025-10-02T17:07:29.873007] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-03. [2025-10-02T17:07:29.937938] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-02T17:07:30.520021] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-02T17:07:30.673000] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-04. [2025-10-02T17:07:31.297401] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-10-02T17:07:31.351144] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-02T17:07:31.472997] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-05. [2025-10-02T17:07:32.272993] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-05. [2025-10-02T17:07:32.778545] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-02T17:07:33.078056] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-01. [2025-10-02T17:07:33.097255] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-02T17:07:33.872996] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-06. [2025-10-02T17:07:34.673004] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-10. [2025-10-02T17:07:35.358058] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-02T17:07:35.473080] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-06. [2025-10-02T17:07:35.633270] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-01 (2.56 seconds). [2025-10-02T17:07:36.224966] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-02T17:07:36.226566] [INFO ] [REMOTE ] AGX: Full fetch complete (48823 records). [2025-10-02T17:07:36.226751] [DEBUG] [VALIDATOR ] AGX: Validating primary data. [2025-10-02T17:07:36.277748] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-02. [2025-10-02T17:07:36.358747] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-02T17:07:36.665413] [DEBUG] [VALIDATOR ] AGX: All expected trading days are present. [2025-10-02T17:07:36.665507] [DEBUG] [VALIDATOR ] AGX: Primary data validation passed. [2025-10-02T17:07:36.666117] [INFO ] [MAIN ] AGX: Fetched primary data is valid. [2025-10-02T17:07:36.666182] [DEBUG] [LOCAL ] AGX: Saving primary data. [2025-10-02T17:07:36.667467] [DEBUG] [LOCAL ] AGX: Trimmed 48823 records to 33402 (keeping 200 days of data) [2025-10-02T17:07:36.888006] [DEBUG] [LOCAL ] AGX: Primary data saved (33402 records). [2025-10-02T17:07:36.888175] [INFO ] [MAIN ] AGX: Full history saved. [2025-10-02T17:07:36.888264] [INFO ] [MAIN ] Update Progress: 61/2370 symbols completed. AGX took 43.2s. Estimated remaining: 4h 45m 50s. Rate: 8.1 symbols/min [2025-10-02T17:07:37.068052] [INFO ] [MAIN ] AIG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:07:37.073021] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-07. [2025-10-02T17:07:37.124886] [DEBUG] [LOCAL ] AIG: Loaded 53472 existing records from primary storage. [2025-10-02T17:07:37.125290] [INFO ] [MAIN ] AIG: Loaded 53472 existing records. [2025-10-02T17:07:37.314269] [WARN ] [MAIN ] AIG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:07:37.314501] [INFO ] [MAIN ] AIG: Wiping existing primary data before full refresh. [2025-10-02T17:07:37.314551] [INFO ] [LOCAL ] AIG: Starting deletion of primary data. [2025-10-02T17:07:37.315854] [DEBUG] [LOCAL ] AIG: Deleted primary data file. [2025-10-02T17:07:37.315917] [INFO ] [MAIN ] AIG: Starting full primary refresh. [2025-10-02T17:07:37.705248] [INFO ] [REMOTE ] AIG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:07:37.841947] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-02T17:07:37.872978] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-07. [2025-10-02T17:07:38.376437] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-02T17:07:38.673029] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-08. [2025-10-02T17:07:39.387281] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-02T17:07:39.473011] [INFO ] [REMOTE ] AIG: Fetching primary data for 2024-12. [2025-10-02T17:07:39.796864] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-02T17:07:40.273052] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-03. [2025-10-02T17:07:41.072982] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-09. [2025-10-02T17:07:41.348556] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-02T17:07:41.876623] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-08. [2025-10-02T17:07:41.878983] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-02T17:07:42.451696] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-02T17:07:42.673003] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-10. [2025-10-02T17:07:43.301980] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-02T17:07:43.302879] [INFO ] [REMOTE ] AHT: Full fetch complete (9332 records). [2025-10-02T17:07:43.302953] [DEBUG] [VALIDATOR ] AHT: Validating primary data. [2025-10-02T17:07:43.482081] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-04. [2025-10-02T17:07:43.743045] [DEBUG] [VALIDATOR ] AHT: All expected trading days are present. [2025-10-02T17:07:43.743221] [DEBUG] [VALIDATOR ] AHT: Primary data validation passed. [2025-10-02T17:07:43.743454] [INFO ] [MAIN ] AHT: Fetched primary data is valid. [2025-10-02T17:07:43.743526] [DEBUG] [LOCAL ] AHT: Saving primary data. [2025-10-02T17:07:43.744217] [DEBUG] [LOCAL ] AHT: Trimmed 9332 records to 6188 (keeping 200 days of data) [2025-10-02T17:07:43.809338] [DEBUG] [LOCAL ] AHT: Primary data saved (6188 records). [2025-10-02T17:07:43.809874] [INFO ] [MAIN ] AHT: Full history saved. [2025-10-02T17:07:43.811772] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-02T17:07:43.810267] [INFO ] [MAIN ] Update Progress: 62/2370 symbols completed. AHT took 26.7s. Estimated remaining: 4h 45m 24s. Rate: 8.1 symbols/min [2025-10-02T17:07:44.011532] [INFO ] [MAIN ] AII: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:07:44.011741] [DEBUG] [LOCAL ] AII: No existing data file found in primary storage. [2025-10-02T17:07:44.011791] [WARN ] [MAIN ] AII: No existing data found, performing full refresh instead. [2025-10-02T17:07:44.011912] [INFO ] [MAIN ] AII: Wiping existing primary data before full refresh. [2025-10-02T17:07:44.011956] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-02T17:07:44.012000] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-02T17:07:44.012035] [INFO ] [MAIN ] AII: Starting full primary refresh. [2025-10-02T17:07:44.281381] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-09. [2025-10-02T17:07:44.415974] [INFO ] [REMOTE ] AII: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:07:45.073033] [INFO ] [REMOTE ] AII: Fetching primary data for 2024-12. [2025-10-02T17:07:45.277893] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T17:07:45.278246] [WARN ] [REMOTE ] AII: No data returned for month 2024-12 [2025-10-02T17:07:45.278339] [FATAL] [REMOTE ] AII: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T17:07:45.278386] [FATAL] [MAIN ] AII: Failed to fetch primary data. [2025-10-02T17:07:45.278447] [WARN ] [MAIN ] AII: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T17:07:45.278520] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-02T17:07:45.278582] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-02T17:07:45.278617] [INFO ] [LOCAL ] AII: Starting deletion of derivative data. [2025-10-02T17:07:45.278693] [DEBUG] [LOCAL ] AII: No derivative data file found to delete. [2025-10-02T17:07:45.278792] [INFO ] [MAIN ] Update Progress: 63/2370 symbols completed. AII took 1.5s. Estimated remaining: 4h 41m 38s. Rate: 8.2 symbols/min [2025-10-02T17:07:45.504723] [INFO ] [MAIN ] AIN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:07:45.529812] [DEBUG] [LOCAL ] AIN: Loaded 24554 existing records from primary storage. [2025-10-02T17:07:45.530128] [INFO ] [MAIN ] AIN: Loaded 24554 existing records. [2025-10-02T17:07:45.766211] [WARN ] [MAIN ] AIN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:07:45.766558] [INFO ] [MAIN ] AIN: Wiping existing primary data before full refresh. [2025-10-02T17:07:45.766661] [INFO ] [LOCAL ] AIN: Starting deletion of primary data. [2025-10-02T17:07:45.767408] [DEBUG] [LOCAL ] AIN: Deleted primary data file. [2025-10-02T17:07:45.767493] [INFO ] [MAIN ] AIN: Starting full primary refresh. [2025-10-02T17:07:45.890525] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-01. [2025-10-02T17:07:46.197340] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-02T17:07:46.336226] [INFO ] [REMOTE ] AIN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:07:46.338391] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-04 (2.86 seconds). [2025-10-02T17:07:46.673045] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-10. [2025-10-02T17:07:47.473048] [INFO ] [REMOTE ] AIN: Fetching primary data for 2024-12. [2025-10-02T17:07:47.739911] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-02T17:07:47.889244] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-02T17:07:47.891412] [INFO ] [REMOTE ] AHR: Full fetch complete (70817 records). [2025-10-02T17:07:47.891536] [DEBUG] [VALIDATOR ] AHR: Validating primary data. [2025-10-02T17:07:48.283960] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-02. [2025-10-02T17:07:48.334969] [DEBUG] [VALIDATOR ] AHR: All expected trading days are present. [2025-10-02T17:07:48.335109] [DEBUG] [VALIDATOR ] AHR: Primary data validation passed. [2025-10-02T17:07:48.335828] [INFO ] [MAIN ] AHR: Fetched primary data is valid. [2025-10-02T17:07:48.336007] [DEBUG] [LOCAL ] AHR: Saving primary data. [2025-10-02T17:07:48.350757] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-02T17:07:48.355428] [DEBUG] [LOCAL ] AHR: Trimmed 70817 records to 49515 (keeping 200 days of data) [2025-10-02T17:07:48.680471] [DEBUG] [LOCAL ] AHR: Primary data saved (49515 records). [2025-10-02T17:07:48.680681] [INFO ] [MAIN ] AHR: Full history saved. [2025-10-02T17:07:48.682243] [INFO ] [MAIN ] Update Progress: 64/2370 symbols completed. AHR took 41.0s. Estimated remaining: 4h 39m 10s. Rate: 8.3 symbols/min [2025-10-02T17:07:48.863695] [INFO ] [MAIN ] AIO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:07:48.863926] [DEBUG] [LOCAL ] AIO: No existing data file found in primary storage. [2025-10-02T17:07:48.863985] [WARN ] [MAIN ] AIO: No existing data found, performing full refresh instead. [2025-10-02T17:07:48.864100] [INFO ] [MAIN ] AIO: Wiping existing primary data before full refresh. [2025-10-02T17:07:48.864143] [INFO ] [LOCAL ] AIO: Starting deletion of primary data. [2025-10-02T17:07:48.864188] [DEBUG] [LOCAL ] AIO: No primary data file found to delete. [2025-10-02T17:07:48.864222] [INFO ] [MAIN ] AIO: Starting full primary refresh. [2025-10-02T17:07:49.078196] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-01. [2025-10-02T17:07:49.298138] [INFO ] [REMOTE ] AIO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:07:49.873002] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-05. [2025-10-02T17:07:50.013376] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-02T17:07:50.190438] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-02T17:07:50.673055] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-02. [2025-10-02T17:07:51.473028] [INFO ] [REMOTE ] AIO: Fetching primary data for 2024-12. [2025-10-02T17:07:51.647817] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-02T17:07:51.855506] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-02T17:07:52.273015] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-03. [2025-10-02T17:07:52.289754] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-02T17:07:53.072998] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-01. [2025-10-02T17:07:53.337041] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-02T17:07:53.868809] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-02T17:07:53.873281] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-04. [2025-10-02T17:07:54.673010] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-06. [2025-10-02T17:07:54.884441] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-02T17:07:55.473060] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-05. [2025-10-02T17:07:56.273022] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-02. [2025-10-02T17:07:56.607032] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-02T17:07:56.804779] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-02T17:07:57.072979] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-06. [2025-10-02T17:07:57.144105] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-02T17:07:57.873004] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-03. [2025-10-02T17:07:57.978567] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-02T17:07:58.672997] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-07. [2025-10-02T17:07:58.774000] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-02T17:07:59.473012] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-07. [2025-10-02T17:08:00.273032] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-03. [2025-10-02T17:08:00.879144] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-02T17:08:01.073033] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-08. [2025-10-02T17:08:01.137510] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-10-02T17:08:01.873051] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-08. [2025-10-02T17:08:01.983713] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-02T17:08:02.181290] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-02T17:08:02.673053] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-04. [2025-10-02T17:08:03.473014] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-09. [2025-10-02T17:08:04.273170] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-04. [2025-10-02T17:08:04.445184] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-02T17:08:04.510489] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-08 (2.64 seconds). [2025-10-02T17:08:04.537211] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-02T17:08:05.073006] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-05. [2025-10-02T17:08:05.394803] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-02T17:08:05.873012] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-09. [2025-10-02T17:08:06.673032] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-05. [2025-10-02T17:08:06.731065] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-02T17:08:07.473029] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-06. [2025-10-02T17:08:07.513130] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-02T17:08:08.099427] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-02T17:08:08.273026] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-06. [2025-10-02T17:08:09.073013] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-10. [2025-10-02T17:08:09.092345] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-02T17:08:09.386278] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-02T17:08:09.873021] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-07. [2025-10-02T17:08:10.673011] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-07. [2025-10-02T17:08:10.855691] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-02T17:08:10.857770] [INFO ] [REMOTE ] AI: Full fetch complete (77896 records). [2025-10-02T17:08:10.857873] [DEBUG] [VALIDATOR ] AI: Validating primary data. [2025-10-02T17:08:11.282930] [DEBUG] [VALIDATOR ] AI: All expected trading days are present. [2025-10-02T17:08:11.283049] [DEBUG] [VALIDATOR ] AI: Primary data validation passed. [2025-10-02T17:08:11.283922] [INFO ] [MAIN ] AI: Fetched primary data is valid. [2025-10-02T17:08:11.284040] [DEBUG] [LOCAL ] AI: Saving primary data. [2025-10-02T17:08:11.285731] [DEBUG] [LOCAL ] AI: Trimmed 77896 records to 54140 (keeping 200 days of data) [2025-10-02T17:08:11.443103] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-02T17:08:11.516411] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-10. [2025-10-02T17:08:11.564377] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-02T17:08:11.694231] [DEBUG] [LOCAL ] AI: Primary data saved (54140 records). [2025-10-02T17:08:11.694382] [INFO ] [MAIN ] AI: Full history saved. [2025-10-02T17:08:11.694482] [INFO ] [MAIN ] Update Progress: 65/2370 symbols completed. AI took 44.0s. Estimated remaining: 4h 48m 21s. Rate: 8.0 symbols/min [2025-10-02T17:08:11.883232] [INFO ] [MAIN ] AIR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:08:11.911133] [DEBUG] [LOCAL ] AIR: Loaded 28191 existing records from primary storage. [2025-10-02T17:08:11.911448] [INFO ] [MAIN ] AIR: Loaded 28191 existing records. [2025-10-02T17:08:12.128227] [WARN ] [MAIN ] AIR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:08:12.128503] [INFO ] [MAIN ] AIR: Wiping existing primary data before full refresh. [2025-10-02T17:08:12.128555] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-10-02T17:08:12.129465] [DEBUG] [LOCAL ] AIR: Deleted primary data file. [2025-10-02T17:08:12.129530] [INFO ] [MAIN ] AIR: Starting full primary refresh. [2025-10-02T17:08:12.278189] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-08. [2025-10-02T17:08:12.562171] [INFO ] [REMOTE ] AIR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:08:12.566799] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-02T17:08:12.568443] [INFO ] [REMOTE ] AIN: Full fetch complete (33421 records). [2025-10-02T17:08:12.568570] [DEBUG] [VALIDATOR ] AIN: Validating primary data. [2025-10-02T17:08:12.987684] [DEBUG] [VALIDATOR ] AIN: All expected trading days are present. [2025-10-02T17:08:12.987785] [DEBUG] [VALIDATOR ] AIN: Primary data validation passed. [2025-10-02T17:08:12.988260] [INFO ] [MAIN ] AIN: Fetched primary data is valid. [2025-10-02T17:08:12.988347] [DEBUG] [LOCAL ] AIN: Saving primary data. [2025-10-02T17:08:12.989261] [DEBUG] [LOCAL ] AIN: Trimmed 33421 records to 24750 (keeping 200 days of data) [2025-10-02T17:08:13.089982] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-08. [2025-10-02T17:08:13.158326] [DEBUG] [LOCAL ] AIN: Primary data saved (24750 records). [2025-10-02T17:08:13.158459] [INFO ] [MAIN ] AIN: Full history saved. [2025-10-02T17:08:13.158565] [INFO ] [MAIN ] Update Progress: 66/2370 symbols completed. AIN took 27.9s. Estimated remaining: 4h 44m 43s. Rate: 8.1 symbols/min [2025-10-02T17:08:13.370081] [INFO ] [MAIN ] AIT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:08:13.400421] [DEBUG] [LOCAL ] AIT: Loaded 27516 existing records from primary storage. [2025-10-02T17:08:13.400766] [INFO ] [MAIN ] AIT: Loaded 27516 existing records. [2025-10-02T17:08:13.652400] [WARN ] [MAIN ] AIT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:08:13.652711] [INFO ] [MAIN ] AIT: Wiping existing primary data before full refresh. [2025-10-02T17:08:13.652792] [INFO ] [LOCAL ] AIT: Starting deletion of primary data. [2025-10-02T17:08:13.654264] [DEBUG] [LOCAL ] AIT: Deleted primary data file. [2025-10-02T17:08:13.654340] [INFO ] [MAIN ] AIT: Starting full primary refresh. [2025-10-02T17:08:13.874056] [INFO ] [REMOTE ] AIR: Fetching primary data for 2024-12. [2025-10-02T17:08:13.959933] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-02T17:08:14.094886] [INFO ] [REMOTE ] AIT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:08:14.130997] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-02T17:08:14.673020] [INFO ] [REMOTE ] AIT: Fetching primary data for 2024-12. [2025-10-02T17:08:15.181387] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-02T17:08:15.472969] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-01. [2025-10-02T17:08:15.905198] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-02T17:08:16.273051] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-09. [2025-10-02T17:08:16.533281] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-02T17:08:17.073069] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-02. [2025-10-02T17:08:17.304507] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-02T17:08:17.726848] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-02T17:08:17.873036] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-09. [2025-10-02T17:08:18.673064] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-03. [2025-10-02T17:08:19.410499] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-02T17:08:19.473042] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-01. [2025-10-02T17:08:19.622598] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-02T17:08:20.273004] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-04. [2025-10-02T17:08:20.521917] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-02T17:08:21.073012] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-10. [2025-10-02T17:08:21.598495] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-02T17:08:21.872997] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-05. [2025-10-02T17:08:22.656194] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-02T17:08:22.662947] [INFO ] [REMOTE ] AIG: Full fetch complete (77379 records). [2025-10-02T17:08:22.663092] [DEBUG] [VALIDATOR ] AIG: Validating primary data. [2025-10-02T17:08:22.678538] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-02. [2025-10-02T17:08:23.112058] [DEBUG] [VALIDATOR ] AIG: All expected trading days are present. [2025-10-02T17:08:23.117369] [DEBUG] [VALIDATOR ] AIG: Primary data validation passed. [2025-10-02T17:08:23.125270] [INFO ] [MAIN ] AIG: Fetched primary data is valid. [2025-10-02T17:08:23.125435] [DEBUG] [LOCAL ] AIG: Saving primary data. [2025-10-02T17:08:23.127155] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-02T17:08:23.133600] [DEBUG] [LOCAL ] AIG: Trimmed 77379 records to 53862 (keeping 200 days of data) [2025-10-02T17:08:23.473041] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-10. [2025-10-02T17:08:23.489256] [DEBUG] [LOCAL ] AIG: Primary data saved (53862 records). [2025-10-02T17:08:23.489454] [INFO ] [MAIN ] AIG: Full history saved. [2025-10-02T17:08:23.491593] [INFO ] [MAIN ] Update Progress: 67/2370 symbols completed. AIG took 46.6s. Estimated remaining: 4h 46m 15s. Rate: 8.0 symbols/min [2025-10-02T17:08:23.682074] [INFO ] [MAIN ] AIV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:08:23.727038] [DEBUG] [LOCAL ] AIV: Loaded 40387 existing records from primary storage. [2025-10-02T17:08:23.727387] [INFO ] [MAIN ] AIV: Loaded 40387 existing records. [2025-10-02T17:08:23.946117] [WARN ] [MAIN ] AIV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:08:23.946539] [INFO ] [MAIN ] AIV: Wiping existing primary data before full refresh. [2025-10-02T17:08:23.946688] [INFO ] [LOCAL ] AIV: Starting deletion of primary data. [2025-10-02T17:08:23.956501] [DEBUG] [LOCAL ] AIV: Deleted primary data file. [2025-10-02T17:08:23.968979] [INFO ] [MAIN ] AIV: Starting full primary refresh. [2025-10-02T17:08:23.975919] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-02T17:08:24.278142] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-03. [2025-10-02T17:08:24.401946] [INFO ] [REMOTE ] AIV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:08:24.457315] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-02T17:08:24.459075] [INFO ] [REMOTE ] AIO: Full fetch complete (20173 records). [2025-10-02T17:08:24.459188] [DEBUG] [VALIDATOR ] AIO: Validating primary data. [2025-10-02T17:08:24.874231] [DEBUG] [VALIDATOR ] AIO: All expected trading days are present. [2025-10-02T17:08:24.874311] [DEBUG] [VALIDATOR ] AIO: Primary data validation passed. [2025-10-02T17:08:24.874619] [INFO ] [MAIN ] AIO: Fetched primary data is valid. [2025-10-02T17:08:24.874704] [DEBUG] [LOCAL ] AIO: Saving primary data. [2025-10-02T17:08:24.875931] [DEBUG] [LOCAL ] AIO: Trimmed 20173 records to 13422 (keeping 200 days of data) [2025-10-02T17:08:24.967465] [DEBUG] [LOCAL ] AIO: Primary data saved (13422 records). [2025-10-02T17:08:24.967609] [INFO ] [MAIN ] AIO: Full history saved. [2025-10-02T17:08:24.967715] [INFO ] [MAIN ] Update Progress: 68/2370 symbols completed. AIO took 36.3s. Estimated remaining: 4h 42m 45s. Rate: 8.1 symbols/min [2025-10-02T17:08:25.074841] [INFO ] [REMOTE ] AIV: Fetching primary data for 2024-12. [2025-10-02T17:08:25.150369] [INFO ] [MAIN ] AIZ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:08:25.187885] [DEBUG] [LOCAL ] AIZ: Loaded 29857 existing records from primary storage. [2025-10-02T17:08:25.188224] [INFO ] [MAIN ] AIZ: Loaded 29857 existing records. [2025-10-02T17:08:25.391458] [WARN ] [MAIN ] AIZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:08:25.391841] [INFO ] [MAIN ] AIZ: Wiping existing primary data before full refresh. [2025-10-02T17:08:25.391899] [INFO ] [LOCAL ] AIZ: Starting deletion of primary data. [2025-10-02T17:08:25.392601] [DEBUG] [LOCAL ] AIZ: Deleted primary data file. [2025-10-02T17:08:25.392706] [INFO ] [MAIN ] AIZ: Starting full primary refresh. [2025-10-02T17:08:25.813118] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-02T17:08:25.819574] [INFO ] [REMOTE ] AIZ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:08:25.873011] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2024-12. [2025-10-02T17:08:26.235935] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-02T17:08:26.673026] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-01. [2025-10-02T17:08:27.007389] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-02T17:08:27.473030] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-01. [2025-10-02T17:08:28.182285] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-02T17:08:28.273068] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-06. [2025-10-02T17:08:28.795183] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-02T17:08:29.073091] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-02. [2025-10-02T17:08:29.483710] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-02T17:08:29.873015] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-07. [2025-10-02T17:08:30.330148] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-02T17:08:30.672994] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-03. [2025-10-02T17:08:31.127122] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-02T17:08:31.472998] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-08. [2025-10-02T17:08:32.160673] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-02T17:08:32.273008] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-04. [2025-10-02T17:08:32.980981] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-02T17:08:33.073002] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-02. [2025-10-02T17:08:33.873850] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-04. [2025-10-02T17:08:33.873748] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-02T17:08:34.188425] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-02T17:08:34.672995] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-05. [2025-10-02T17:08:35.326734] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-02T17:08:35.473002] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-09. [2025-10-02T17:08:35.961574] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-02T17:08:36.273015] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-03. [2025-10-02T17:08:36.978865] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-02T17:08:37.073047] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-06. [2025-10-02T17:08:37.861306] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-02T17:08:37.873145] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-10. [2025-10-02T17:08:37.954804] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-02T17:08:38.673025] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-07. [2025-10-02T17:08:38.994965] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-02T17:08:38.997072] [INFO ] [REMOTE ] AIR: Full fetch complete (39105 records). [2025-10-02T17:08:38.997252] [DEBUG] [VALIDATOR ] AIR: Validating primary data. [2025-10-02T17:08:39.427118] [DEBUG] [VALIDATOR ] AIR: All expected trading days are present. [2025-10-02T17:08:39.427209] [DEBUG] [VALIDATOR ] AIR: Primary data validation passed. [2025-10-02T17:08:39.427686] [INFO ] [MAIN ] AIR: Fetched primary data is valid. [2025-10-02T17:08:39.427760] [DEBUG] [LOCAL ] AIR: Saving primary data. [2025-10-02T17:08:39.428912] [DEBUG] [LOCAL ] AIR: Trimmed 39105 records to 28562 (keeping 200 days of data) [2025-10-02T17:08:39.489855] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-05. [2025-10-02T17:08:39.617114] [DEBUG] [LOCAL ] AIR: Primary data saved (28562 records). [2025-10-02T17:08:39.617269] [INFO ] [MAIN ] AIR: Full history saved. [2025-10-02T17:08:39.617386] [INFO ] [MAIN ] Update Progress: 69/2370 symbols completed. AIR took 27.9s. Estimated remaining: 4h 46m 41s. Rate: 8.0 symbols/min [2025-10-02T17:08:39.822402] [INFO ] [MAIN ] AIZN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:08:39.829471] [DEBUG] [LOCAL ] AIZN: Loaded 4025 existing records from primary storage. [2025-10-02T17:08:39.829764] [INFO ] [MAIN ] AIZN: Loaded 4025 existing records. [2025-10-02T17:08:40.043859] [WARN ] [MAIN ] AIZN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:08:40.070542] [INFO ] [MAIN ] AIZN: Wiping existing primary data before full refresh. [2025-10-02T17:08:40.071428] [INFO ] [LOCAL ] AIZN: Starting deletion of primary data. [2025-10-02T17:08:40.072359] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-02T17:08:40.082775] [DEBUG] [LOCAL ] AIZN: Deleted primary data file. [2025-10-02T17:08:40.083739] [INFO ] [MAIN ] AIZN: Starting full primary refresh. [2025-10-02T17:08:40.283365] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-04. [2025-10-02T17:08:40.503593] [INFO ] [REMOTE ] AIZN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:08:41.069466] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-02T17:08:41.076972] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2024-12. [2025-10-02T17:08:41.827092] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-02T17:08:41.876469] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-01. [2025-10-02T17:08:41.882130] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-02T17:08:42.488452] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-02T17:08:42.673017] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-06. [2025-10-02T17:08:43.473013] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-05. [2025-10-02T17:08:44.071204] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-02T17:08:44.273002] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-08. [2025-10-02T17:08:44.804608] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-02T17:08:45.073024] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-02. [2025-10-02T17:08:45.553796] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-02T17:08:45.564214] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-02T17:08:45.873011] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-06. [2025-10-02T17:08:46.673081] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-03. [2025-10-02T17:08:47.097900] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-02T17:08:47.423303] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-02T17:08:47.473037] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-07. [2025-10-02T17:08:48.273026] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-09. [2025-10-02T17:08:48.883601] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-02T17:08:49.073026] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-04. [2025-10-02T17:08:49.347091] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-02T17:08:49.438954] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-02T17:08:49.873013] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-05. [2025-10-02T17:08:50.442843] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-02T17:08:50.673019] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-06. [2025-10-02T17:08:51.204498] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-02T17:08:51.473014] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-07. [2025-10-02T17:08:52.073778] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-02T17:08:52.273048] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-08. [2025-10-02T17:08:52.731133] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-02T17:08:53.073016] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-09. [2025-10-02T17:08:53.678309] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-02T17:08:53.873001] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-08. [2025-10-02T17:08:54.673063] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-10. [2025-10-02T17:08:55.472980] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-10. [2025-10-02T17:08:55.519447] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-02T17:08:55.604342] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-02T17:08:55.605729] [INFO ] [REMOTE ] AIT: Full fetch complete (39380 records). [2025-10-02T17:08:55.605833] [DEBUG] [VALIDATOR ] AIT: Validating primary data. [2025-10-02T17:08:56.039463] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-02T17:08:56.039799] [DEBUG] [VALIDATOR ] AIT: All expected trading days are present. [2025-10-02T17:08:56.040734] [DEBUG] [VALIDATOR ] AIT: Primary data validation passed. [2025-10-02T17:08:56.040831] [INFO ] [REMOTE ] AIZN: Full fetch complete (5907 records). [2025-10-02T17:08:56.041030] [DEBUG] [VALIDATOR ] AIZN: Validating primary data. [2025-10-02T17:08:56.041619] [INFO ] [MAIN ] AIT: Fetched primary data is valid. [2025-10-02T17:08:56.064373] [DEBUG] [LOCAL ] AIT: Saving primary data. [2025-10-02T17:08:56.159730] [DEBUG] [LOCAL ] AIT: Trimmed 39380 records to 27668 (keeping 200 days of data) [2025-10-02T17:08:56.278101] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-07. [2025-10-02T17:08:56.568490] [DEBUG] [VALIDATOR ] AIZN: All expected trading days are present. [2025-10-02T17:08:56.568910] [DEBUG] [VALIDATOR ] AIZN: Primary data validation passed. [2025-10-02T17:08:56.569496] [INFO ] [MAIN ] AIZN: Fetched primary data is valid. [2025-10-02T17:08:56.571397] [DEBUG] [LOCAL ] AIZN: Saving primary data. [2025-10-02T17:08:56.573533] [DEBUG] [LOCAL ] AIZN: Trimmed 5907 records to 4082 (keeping 200 days of data) [2025-10-02T17:08:56.608903] [DEBUG] [LOCAL ] AIZN: Primary data saved (4082 records). [2025-10-02T17:08:56.609608] [INFO ] [MAIN ] AIZN: Full history saved. [2025-10-02T17:08:56.611468] [INFO ] [MAIN ] Update Progress: 70/2370 symbols completed. AIZN took 17.0s. Estimated remaining: 4h 51m 46s. Rate: 7.9 symbols/min [2025-10-02T17:08:56.814595] [INFO ] [MAIN ] AJG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:08:56.894351] [DEBUG] [LOCAL ] AIT: Primary data saved (27668 records). [2025-10-02T17:08:56.894495] [INFO ] [MAIN ] AIT: Full history saved. [2025-10-02T17:08:56.894579] [INFO ] [MAIN ] Update Progress: 71/2370 symbols completed. AIT took 43.7s. Estimated remaining: 4h 47m 41s. Rate: 8.0 symbols/min [2025-10-02T17:08:57.020151] [DEBUG] [LOCAL ] AJG: Loaded 46880 existing records from primary storage. [2025-10-02T17:08:57.031297] [INFO ] [MAIN ] AJG: Loaded 46880 existing records. [2025-10-02T17:08:57.078119] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-09. [2025-10-02T17:08:57.197428] [INFO ] [MAIN ] AKA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:08:57.209876] [DEBUG] [LOCAL ] AKA: No existing data file found in primary storage. [2025-10-02T17:08:57.229472] [WARN ] [MAIN ] AKA: No existing data found, performing full refresh instead. [2025-10-02T17:08:57.230210] [INFO ] [MAIN ] AKA: Wiping existing primary data before full refresh. [2025-10-02T17:08:57.241014] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-02T17:08:57.272537] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-02T17:08:57.277784] [INFO ] [MAIN ] AKA: Starting full primary refresh. [2025-10-02T17:08:57.394693] [WARN ] [MAIN ] AJG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:08:57.418173] [INFO ] [MAIN ] AJG: Wiping existing primary data before full refresh. [2025-10-02T17:08:57.436456] [INFO ] [LOCAL ] AJG: Starting deletion of primary data. [2025-10-02T17:08:57.458030] [DEBUG] [LOCAL ] AJG: Deleted primary data file. [2025-10-02T17:08:57.462901] [INFO ] [MAIN ] AJG: Starting full primary refresh. [2025-10-02T17:08:57.991032] [INFO ] [REMOTE ] AKA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:08:58.017843] [INFO ] [REMOTE ] AKA: Fetching primary data for 2024-12. [2025-10-02T17:08:58.145553] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-02T17:08:58.208636] [INFO ] [REMOTE ] AJG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:08:58.515624] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-02T17:08:58.673011] [INFO ] [REMOTE ] AJG: Fetching primary data for 2024-12. [2025-10-02T17:08:58.910351] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-02T17:08:59.473002] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-01. [2025-10-02T17:08:59.829264] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-02T17:09:00.273052] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-10. [2025-10-02T17:09:00.544495] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-02T17:09:01.073023] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-02. [2025-10-02T17:09:01.611510] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-02T17:09:01.624944] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-02T17:09:01.626357] [INFO ] [REMOTE ] AIV: Full fetch complete (59511 records). [2025-10-02T17:09:01.626446] [DEBUG] [VALIDATOR ] AIV: Validating primary data. [2025-10-02T17:09:01.627240] [FATAL] [VALIDATOR ] AIV: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:09:01.627376] [FATAL] [MAIN ] AIV: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:09:01.627459] [WARN ] [MAIN ] AIV: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:09:01.627551] [INFO ] [LOCAL ] AIV: Starting deletion of primary data. [2025-10-02T17:09:01.627628] [DEBUG] [LOCAL ] AIV: No primary data file found to delete. [2025-10-02T17:09:01.627711] [INFO ] [LOCAL ] AIV: Starting deletion of derivative data. [2025-10-02T17:09:01.628145] [DEBUG] [LOCAL ] AIV: Deleted derivative data file. [2025-10-02T17:09:01.628953] [INFO ] [MAIN ] Update Progress: 72/2370 symbols completed. AIV took 38.1s. Estimated remaining: 4h 46m 5s. Rate: 8.0 symbols/min [2025-10-02T17:09:01.826500] [INFO ] [MAIN ] AKR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:09:01.872975] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-03. [2025-10-02T17:09:01.892058] [DEBUG] [LOCAL ] AKR: Loaded 45714 existing records from primary storage. [2025-10-02T17:09:01.892439] [INFO ] [MAIN ] AKR: Loaded 45714 existing records. [2025-10-02T17:09:02.099097] [WARN ] [MAIN ] AKR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:09:02.099407] [INFO ] [MAIN ] AKR: Wiping existing primary data before full refresh. [2025-10-02T17:09:02.099459] [INFO ] [LOCAL ] AKR: Starting deletion of primary data. [2025-10-02T17:09:02.103043] [DEBUG] [LOCAL ] AKR: Deleted primary data file. [2025-10-02T17:09:02.103111] [INFO ] [MAIN ] AKR: Starting full primary refresh. [2025-10-02T17:09:02.510481] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-02T17:09:02.526596] [INFO ] [REMOTE ] AKR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:09:02.673007] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-04. [2025-10-02T17:09:03.139740] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-02T17:09:03.473051] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-01. [2025-10-02T17:09:04.273045] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-08. [2025-10-02T17:09:05.073035] [INFO ] [REMOTE ] AKR: Fetching primary data for 2024-12. [2025-10-02T17:09:05.263290] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-02T17:09:05.684306] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-02T17:09:05.872989] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-02. [2025-10-02T17:09:06.419150] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-02T17:09:06.673023] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-09. [2025-10-02T17:09:07.473010] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-01. [2025-10-02T17:09:07.613420] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-02T17:09:08.047734] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-02T17:09:08.273011] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-10. [2025-10-02T17:09:08.996268] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-02T17:09:09.073046] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-03. [2025-10-02T17:09:09.149496] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-02T17:09:09.151138] [INFO ] [REMOTE ] AIZ: Full fetch complete (42906 records). [2025-10-02T17:09:09.151264] [DEBUG] [VALIDATOR ] AIZ: Validating primary data. [2025-10-02T17:09:09.555361] [DEBUG] [VALIDATOR ] AIZ: All expected trading days are present. [2025-10-02T17:09:09.555467] [DEBUG] [VALIDATOR ] AIZ: Primary data validation passed. [2025-10-02T17:09:09.556027] [INFO ] [MAIN ] AIZ: Fetched primary data is valid. [2025-10-02T17:09:09.556097] [DEBUG] [LOCAL ] AIZ: Saving primary data. [2025-10-02T17:09:09.557405] [DEBUG] [LOCAL ] AIZ: Trimmed 42906 records to 30062 (keeping 200 days of data) [2025-10-02T17:09:09.759851] [DEBUG] [LOCAL ] AIZ: Primary data saved (30062 records). [2025-10-02T17:09:09.760014] [INFO ] [MAIN ] AIZ: Full history saved. [2025-10-02T17:09:09.761278] [INFO ] [MAIN ] Update Progress: 73/2370 symbols completed. AIZ took 44.8s. Estimated remaining: 4h 46m 19s. Rate: 8.0 symbols/min [2025-10-02T17:09:09.877256] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-02. [2025-10-02T17:09:09.953230] [INFO ] [MAIN ] AL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:09:10.000222] [DEBUG] [LOCAL ] AL: Loaded 44286 existing records from primary storage. [2025-10-02T17:09:10.000596] [INFO ] [MAIN ] AL: Loaded 44286 existing records. [2025-10-02T17:09:10.194443] [WARN ] [MAIN ] AL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:09:10.194782] [INFO ] [MAIN ] AL: Wiping existing primary data before full refresh. [2025-10-02T17:09:10.194844] [INFO ] [LOCAL ] AL: Starting deletion of primary data. [2025-10-02T17:09:10.201007] [DEBUG] [LOCAL ] AL: Deleted primary data file. [2025-10-02T17:09:10.201083] [INFO ] [MAIN ] AL: Starting full primary refresh. [2025-10-02T17:09:10.585313] [INFO ] [REMOTE ] AL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:09:10.672983] [INFO ] [REMOTE ] AL: Fetching primary data for 2024-12. [2025-10-02T17:09:10.927224] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-02T17:09:11.394582] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-02T17:09:11.472981] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-04. [2025-10-02T17:09:11.964563] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-02T17:09:12.272998] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-03. [2025-10-02T17:09:13.073051] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-05. [2025-10-02T17:09:13.363896] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-02T17:09:13.685848] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-02T17:09:13.799617] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-02T17:09:13.872977] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-04. [2025-10-02T17:09:14.673006] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-05. [2025-10-02T17:09:15.257037] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-02T17:09:15.473016] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-05. [2025-10-02T17:09:16.054939] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-02T17:09:16.272996] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-06. [2025-10-02T17:09:16.696355] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-02T17:09:17.073017] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-06. [2025-10-02T17:09:17.864304] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-02T17:09:17.874547] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-06. [2025-10-02T17:09:18.178224] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-10-02T17:09:18.587363] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-02T17:09:18.673011] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-01. [2025-10-02T17:09:19.472994] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-07. [2025-10-02T17:09:20.273017] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-07. [2025-10-02T17:09:20.336845] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-02T17:09:21.073013] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-02. [2025-10-02T17:09:21.254838] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-02T17:09:21.872992] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-07. [2025-10-02T17:09:22.068722] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-02T17:09:22.161200] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-10-02T17:09:22.499405] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-02T17:09:22.672990] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-03. [2025-10-02T17:09:23.472998] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-08. [2025-10-02T17:09:24.182926] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-02T17:09:24.273017] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-04. [2025-10-02T17:09:25.073003] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-08. [2025-10-02T17:09:25.217775] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-02T17:09:25.479547] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-02T17:09:25.873018] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-09. [2025-10-02T17:09:26.673005] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-08. [2025-10-02T17:09:26.745114] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-02T17:09:27.193833] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-02T17:09:27.404573] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-02T17:09:27.472967] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-10. [2025-10-02T17:09:28.273005] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-09. [2025-10-02T17:09:28.716690] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-02T17:09:28.718728] [INFO ] [REMOTE ] AJG: Full fetch complete (69532 records). [2025-10-02T17:09:28.718832] [DEBUG] [VALIDATOR ] AJG: Validating primary data. [2025-10-02T17:09:29.078211] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-09. [2025-10-02T17:09:29.144096] [DEBUG] [VALIDATOR ] AJG: All expected trading days are present. [2025-10-02T17:09:29.144198] [DEBUG] [VALIDATOR ] AJG: Primary data validation passed. [2025-10-02T17:09:29.145035] [INFO ] [MAIN ] AJG: Fetched primary data is valid. [2025-10-02T17:09:29.145108] [DEBUG] [LOCAL ] AJG: Saving primary data. [2025-10-02T17:09:29.146789] [DEBUG] [LOCAL ] AJG: Trimmed 69532 records to 47189 (keeping 200 days of data) [2025-10-02T17:09:29.458294] [DEBUG] [LOCAL ] AJG: Primary data saved (47189 records). [2025-10-02T17:09:29.458432] [INFO ] [MAIN ] AJG: Full history saved. [2025-10-02T17:09:29.459305] [INFO ] [MAIN ] Update Progress: 74/2370 symbols completed. AJG took 32.8s. Estimated remaining: 4h 52m 30s. Rate: 7.8 symbols/min [2025-10-02T17:09:29.546891] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-02T17:09:29.653979] [INFO ] [MAIN ] ALB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:09:29.710639] [DEBUG] [LOCAL ] ALB: Loaded 53234 existing records from primary storage. [2025-10-02T17:09:29.710998] [INFO ] [MAIN ] ALB: Loaded 53234 existing records. [2025-10-02T17:09:29.883011] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-05. [2025-10-02T17:09:29.916042] [WARN ] [MAIN ] ALB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:09:29.917503] [INFO ] [MAIN ] ALB: Wiping existing primary data before full refresh. [2025-10-02T17:09:29.917592] [INFO ] [LOCAL ] ALB: Starting deletion of primary data. [2025-10-02T17:09:29.921578] [DEBUG] [LOCAL ] ALB: Deleted primary data file. [2025-10-02T17:09:29.921714] [INFO ] [MAIN ] ALB: Starting full primary refresh. [2025-10-02T17:09:30.371757] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-02T17:09:30.378256] [INFO ] [REMOTE ] ALB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:09:30.673001] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-10. [2025-10-02T17:09:31.198318] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-02T17:09:31.473005] [INFO ] [REMOTE ] ALB: Fetching primary data for 2024-12. [2025-10-02T17:09:32.091530] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-02T17:09:32.093540] [INFO ] [REMOTE ] AKR: Full fetch complete (65490 records). [2025-10-02T17:09:32.093632] [DEBUG] [VALIDATOR ] AKR: Validating primary data. [2025-10-02T17:09:32.283087] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-10. [2025-10-02T17:09:32.565448] [DEBUG] [VALIDATOR ] AKR: All expected trading days are present. [2025-10-02T17:09:32.565539] [DEBUG] [VALIDATOR ] AKR: Primary data validation passed. [2025-10-02T17:09:32.566202] [INFO ] [MAIN ] AKR: Fetched primary data is valid. [2025-10-02T17:09:32.566268] [DEBUG] [LOCAL ] AKR: Saving primary data. [2025-10-02T17:09:32.567914] [DEBUG] [LOCAL ] AKR: Trimmed 65490 records to 46065 (keeping 200 days of data) [2025-10-02T17:09:32.755162] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-02T17:09:32.764744] [INFO ] [REMOTE ] AKA: Full fetch complete (2407 records). [2025-10-02T17:09:32.792223] [DEBUG] [VALIDATOR ] AKA: Validating primary data. [2025-10-02T17:09:33.011424] [WARN ] [VALIDATOR ] AKA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-02T17:09:33.013791] [FATAL] [MAIN ] AKA: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:09:33.014514] [WARN ] [MAIN ] AKA: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:09:33.017224] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-02T17:09:33.017999] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-02T17:09:33.018359] [INFO ] [LOCAL ] AKA: Starting deletion of derivative data. [2025-10-02T17:09:33.019782] [DEBUG] [LOCAL ] AKA: No derivative data file found to delete. [2025-10-02T17:09:33.020709] [INFO ] [MAIN ] Update Progress: 75/2370 symbols completed. AKA took 36.1s. Estimated remaining: 4h 50m 18s. Rate: 7.9 symbols/min [2025-10-02T17:09:33.084432] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-06. [2025-10-02T17:09:33.230999] [INFO ] [MAIN ] ALC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:09:33.279217] [DEBUG] [LOCAL ] AKR: Primary data saved (46065 records). [2025-10-02T17:09:33.279463] [INFO ] [MAIN ] AKR: Full history saved. [2025-10-02T17:09:33.280804] [INFO ] [MAIN ] Update Progress: 76/2370 symbols completed. AKR took 31.7s. Estimated remaining: 4h 46m 29s. Rate: 8.0 symbols/min [2025-10-02T17:09:33.503638] [INFO ] [MAIN ] ALE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:09:33.506207] [DEBUG] [LOCAL ] ALC: Loaded 50825 existing records from primary storage. [2025-10-02T17:09:33.506566] [INFO ] [MAIN ] ALC: Loaded 50825 existing records. [2025-10-02T17:09:33.723479] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-10-02T17:09:33.801410] [DEBUG] [LOCAL ] ALE: Loaded 30653 existing records from primary storage. [2025-10-02T17:09:33.810580] [INFO ] [MAIN ] ALE: Loaded 30653 existing records. [2025-10-02T17:09:33.824117] [WARN ] [MAIN ] ALC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:09:33.829450] [INFO ] [MAIN ] ALC: Wiping existing primary data before full refresh. [2025-10-02T17:09:33.849688] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-10-02T17:09:33.894545] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-01. [2025-10-02T17:09:33.894469] [DEBUG] [LOCAL ] ALC: Deleted primary data file. [2025-10-02T17:09:33.914001] [INFO ] [MAIN ] ALC: Starting full primary refresh. [2025-10-02T17:09:34.170595] [WARN ] [MAIN ] ALE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:09:34.198472] [INFO ] [MAIN ] ALE: Wiping existing primary data before full refresh. [2025-10-02T17:09:34.208374] [INFO ] [LOCAL ] ALE: Starting deletion of primary data. [2025-10-02T17:09:34.291421] [DEBUG] [LOCAL ] ALE: Deleted primary data file. [2025-10-02T17:09:34.307542] [INFO ] [MAIN ] ALE: Starting full primary refresh. [2025-10-02T17:09:34.538427] [INFO ] [REMOTE ] ALC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:09:34.682421] [INFO ] [REMOTE ] ALC: Fetching primary data for 2024-12. [2025-10-02T17:09:34.843193] [INFO ] [REMOTE ] ALE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:09:34.866295] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-02T17:09:35.473014] [INFO ] [REMOTE ] ALE: Fetching primary data for 2024-12. [2025-10-02T17:09:35.893580] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-02T17:09:36.272972] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-07. [2025-10-02T17:09:36.426912] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-02T17:09:36.578110] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-02T17:09:37.073013] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-01. [2025-10-02T17:09:37.494572] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-02T17:09:37.873052] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-02. [2025-10-02T17:09:38.056740] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-02T17:09:38.673049] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-08. [2025-10-02T17:09:39.473024] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-01. [2025-10-02T17:09:39.615614] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-02T17:09:39.774168] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-02T17:09:40.273033] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-02. [2025-10-02T17:09:41.073012] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-03. [2025-10-02T17:09:41.182299] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-02T17:09:41.239743] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-02T17:09:41.873050] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-09. [2025-10-02T17:09:42.615991] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-02T17:09:42.673041] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-04. [2025-10-02T17:09:43.473001] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-03. [2025-10-02T17:09:43.557989] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-02T17:09:44.272985] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-10. [2025-10-02T17:09:44.668108] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-02T17:09:45.073038] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-02. [2025-10-02T17:09:45.107144] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-10-02T17:09:45.774875] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-02T17:09:45.776930] [INFO ] [REMOTE ] AL: Full fetch complete (62715 records). [2025-10-02T17:09:45.777072] [DEBUG] [VALIDATOR ] AL: Validating primary data. [2025-10-02T17:09:45.881850] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-05. [2025-10-02T17:09:46.196671] [DEBUG] [VALIDATOR ] AL: All expected trading days are present. [2025-10-02T17:09:46.196775] [DEBUG] [VALIDATOR ] AL: Primary data validation passed. [2025-10-02T17:09:46.197429] [INFO ] [MAIN ] AL: Fetched primary data is valid. [2025-10-02T17:09:46.197476] [DEBUG] [LOCAL ] AL: Saving primary data. [2025-10-02T17:09:46.199732] [DEBUG] [LOCAL ] AL: Trimmed 62715 records to 44640 (keeping 200 days of data) [2025-10-02T17:09:46.492111] [DEBUG] [LOCAL ] AL: Primary data saved (44640 records). [2025-10-02T17:09:46.492356] [INFO ] [MAIN ] AL: Full history saved. [2025-10-02T17:09:46.493304] [INFO ] [MAIN ] Update Progress: 77/2370 symbols completed. AL took 36.7s. Estimated remaining: 4h 49m 12s. Rate: 7.9 symbols/min [2025-10-02T17:09:46.521945] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-02T17:09:46.673088] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-03. [2025-10-02T17:09:47.473012] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-04. [2025-10-02T17:09:47.552370] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-02T17:09:48.272990] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-06. [2025-10-02T17:09:48.375551] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-02T17:09:48.531401] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-02T17:09:49.073028] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-04. [2025-10-02T17:09:49.873058] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-05. [2025-10-02T17:09:50.416307] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-02T17:09:50.673005] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-07. [2025-10-02T17:09:50.801900] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-02T17:09:50.830161] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-02T17:09:51.473024] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-06. [2025-10-02T17:09:52.273083] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-05. [2025-10-02T17:09:52.641819] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-02T17:09:53.073032] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-07. [2025-10-02T17:09:53.132045] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-10-02T17:09:53.873012] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-08. [2025-10-02T17:09:54.064592] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-02T17:09:54.459467] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-02T17:09:54.673050] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-08. [2025-10-02T17:09:55.473008] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-06. [2025-10-02T17:09:55.800959] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-02T17:09:56.048195] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-02T17:09:56.273002] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-09. [2025-10-02T17:09:57.073037] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-09. [2025-10-02T17:09:57.424273] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-02T17:09:57.873049] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-07. [2025-10-02T17:09:58.516147] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-02T17:09:58.541528] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-02T17:09:58.672998] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-10. [2025-10-02T17:09:59.473015] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-10. [2025-10-02T17:09:59.766435] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-02T17:09:59.984951] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-02T17:09:59.987760] [INFO ] [REMOTE ] ALE: Full fetch complete (42934 records). [2025-10-02T17:09:59.987923] [DEBUG] [VALIDATOR ] ALE: Validating primary data. [2025-10-02T17:10:00.278196] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-08. [2025-10-02T17:10:00.418504] [DEBUG] [VALIDATOR ] ALE: All expected trading days are present. [2025-10-02T17:10:00.418586] [DEBUG] [VALIDATOR ] ALE: Primary data validation passed. [2025-10-02T17:10:00.419069] [INFO ] [MAIN ] ALE: Fetched primary data is valid. [2025-10-02T17:10:00.419131] [DEBUG] [LOCAL ] ALE: Saving primary data. [2025-10-02T17:10:00.420218] [DEBUG] [LOCAL ] ALE: Trimmed 42934 records to 30960 (keeping 200 days of data) [2025-10-02T17:10:00.608167] [DEBUG] [LOCAL ] ALE: Primary data saved (30960 records). [2025-10-02T17:10:00.608306] [INFO ] [MAIN ] ALE: Full history saved. [2025-10-02T17:10:00.608391] [INFO ] [MAIN ] Update Progress: 78/2370 symbols completed. ALE took 27.3s. Estimated remaining: 4h 52m 17s. Rate: 7.8 symbols/min [2025-10-02T17:10:01.440470] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-02T17:10:01.442946] [INFO ] [REMOTE ] ALB: Full fetch complete (76848 records). [2025-10-02T17:10:01.443126] [DEBUG] [VALIDATOR ] ALB: Validating primary data. [2025-10-02T17:10:01.922846] [DEBUG] [VALIDATOR ] ALB: All expected trading days are present. [2025-10-02T17:10:01.923101] [DEBUG] [VALIDATOR ] ALB: Primary data validation passed. [2025-10-02T17:10:01.923908] [INFO ] [MAIN ] ALB: Fetched primary data is valid. [2025-10-02T17:10:01.923974] [DEBUG] [LOCAL ] ALB: Saving primary data. [2025-10-02T17:10:01.925614] [DEBUG] [LOCAL ] ALB: Trimmed 76848 records to 53622 (keeping 200 days of data) [2025-10-02T17:10:02.207376] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-02T17:10:02.221935] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-09. [2025-10-02T17:10:02.332865] [DEBUG] [LOCAL ] ALB: Primary data saved (53622 records). [2025-10-02T17:10:02.333023] [INFO ] [MAIN ] ALB: Full history saved. [2025-10-02T17:10:02.333123] [INFO ] [MAIN ] Update Progress: 79/2370 symbols completed. ALB took 32.9s. Estimated remaining: 4h 49m 17s. Rate: 7.9 symbols/min [2025-10-02T17:10:03.784631] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-02T17:10:03.796423] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-10. [2025-10-02T17:10:05.588100] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-02T17:10:05.590288] [INFO ] [REMOTE ] ALC: Full fetch complete (72604 records). [2025-10-02T17:10:05.590537] [DEBUG] [VALIDATOR ] ALC: Validating primary data. [2025-10-02T17:10:05.591960] [FATAL] [VALIDATOR ] ALC: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:10:05.592105] [FATAL] [MAIN ] ALC: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:10:05.592191] [WARN ] [MAIN ] ALC: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:10:05.592280] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-10-02T17:10:05.592359] [DEBUG] [LOCAL ] ALC: No primary data file found to delete. [2025-10-02T17:10:05.592404] [INFO ] [LOCAL ] ALC: Starting deletion of derivative data. [2025-10-02T17:10:05.592767] [DEBUG] [LOCAL ] ALC: Deleted derivative data file. [2025-10-02T17:10:05.592907] [INFO ] [MAIN ] Update Progress: 80/2370 symbols completed. ALC took 32.6s. Estimated remaining: 4h 47m 6s. Rate: 8.0 symbols/min [2025-10-02T17:10:06.404226] [INFO ] [MAIN ] ALEX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:10:06.453006] [INFO ] [MAIN ] ALIT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:10:06.421398] [INFO ] [MAIN ] ALG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:10:06.457353] [INFO ] [MAIN ] ALK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:10:06.473926] [DEBUG] [LOCAL ] ALG: Loaded 10239 existing records from primary storage. [2025-10-02T17:10:06.474387] [INFO ] [MAIN ] ALG: Loaded 10239 existing records. [2025-10-02T17:10:06.624483] [DEBUG] [LOCAL ] ALEX: Loaded 31083 existing records from primary storage. [2025-10-02T17:10:06.635231] [INFO ] [MAIN ] ALEX: Loaded 31083 existing records. [2025-10-02T17:10:06.862362] [DEBUG] [LOCAL ] ALK: Loaded 53054 existing records from primary storage. [2025-10-02T17:10:06.835115] [WARN ] [MAIN ] ALG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:10:06.873254] [INFO ] [MAIN ] ALK: Loaded 53054 existing records. [2025-10-02T17:10:06.879786] [DEBUG] [LOCAL ] ALIT: Loaded 52766 existing records from primary storage. [2025-10-02T17:10:06.873437] [INFO ] [MAIN ] ALG: Wiping existing primary data before full refresh. [2025-10-02T17:10:06.896739] [INFO ] [LOCAL ] ALG: Starting deletion of primary data. [2025-10-02T17:10:06.905853] [INFO ] [MAIN ] ALIT: Loaded 52766 existing records. [2025-10-02T17:10:06.927283] [DEBUG] [LOCAL ] ALG: Deleted primary data file. [2025-10-02T17:10:06.985788] [INFO ] [MAIN ] ALG: Starting full primary refresh. [2025-10-02T17:10:07.300037] [WARN ] [MAIN ] ALEX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:10:07.339709] [INFO ] [MAIN ] ALEX: Wiping existing primary data before full refresh. [2025-10-02T17:10:07.354129] [INFO ] [LOCAL ] ALEX: Starting deletion of primary data. [2025-10-02T17:10:07.389703] [DEBUG] [LOCAL ] ALEX: Deleted primary data file. [2025-10-02T17:10:07.415995] [INFO ] [MAIN ] ALEX: Starting full primary refresh. [2025-10-02T17:10:07.518576] [WARN ] [MAIN ] ALK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:10:07.551256] [INFO ] [MAIN ] ALK: Wiping existing primary data before full refresh. [2025-10-02T17:10:07.626752] [INFO ] [LOCAL ] ALK: Starting deletion of primary data. [2025-10-02T17:10:07.690555] [WARN ] [MAIN ] ALIT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:10:07.714453] [DEBUG] [LOCAL ] ALK: Deleted primary data file. [2025-10-02T17:10:07.734623] [INFO ] [MAIN ] ALIT: Wiping existing primary data before full refresh. [2025-10-02T17:10:07.745245] [INFO ] [LOCAL ] ALIT: Starting deletion of primary data. [2025-10-02T17:10:07.755759] [INFO ] [MAIN ] ALK: Starting full primary refresh. [2025-10-02T17:10:07.793524] [DEBUG] [LOCAL ] ALIT: Deleted primary data file. [2025-10-02T17:10:07.810367] [INFO ] [MAIN ] ALIT: Starting full primary refresh. [2025-10-02T17:10:08.306425] [INFO ] [REMOTE ] ALG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:10:08.348480] [INFO ] [REMOTE ] ALG: Fetching primary data for 2024-12. [2025-10-02T17:10:08.966960] [INFO ] [REMOTE ] ALEX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:10:08.986852] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2024-12. [2025-10-02T17:10:09.042411] [INFO ] [REMOTE ] ALK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:10:09.078412] [INFO ] [REMOTE ] ALIT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:10:09.080183] [INFO ] [REMOTE ] ALK: Fetching primary data for 2024-12. [2025-10-02T17:10:09.080559] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2024-12. [2025-10-02T17:10:09.841013] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-02T17:10:09.844400] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-01. [2025-10-02T17:10:10.222886] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-02T17:10:10.230142] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-01. [2025-10-02T17:10:10.742599] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-02T17:10:10.745800] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-02. [2025-10-02T17:10:10.818386] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-02T17:10:10.829760] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-01. [2025-10-02T17:10:11.010700] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-02T17:10:11.022718] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-01. [2025-10-02T17:10:11.217078] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-02T17:10:11.223589] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-02. [2025-10-02T17:10:11.629083] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-02T17:10:11.632198] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-03. [2025-10-02T17:10:12.311896] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-02T17:10:12.318379] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-03. [2025-10-02T17:10:12.392399] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-02T17:10:12.396332] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-04. [2025-10-02T17:10:12.432592] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-02T17:10:12.793364] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-02T17:10:13.073072] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-02. [2025-10-02T17:10:13.594430] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-02T17:10:13.743457] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-02T17:10:13.873012] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-04. [2025-10-02T17:10:14.673015] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-02. [2025-10-02T17:10:14.744983] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-02T17:10:15.473016] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-03. [2025-10-02T17:10:15.546621] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-02T17:10:16.168224] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-02T17:10:16.273037] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-05. [2025-10-02T17:10:16.946694] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-02T17:10:17.073017] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-04. [2025-10-02T17:10:17.187709] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-02T17:10:17.872995] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-05. [2025-10-02T17:10:18.673026] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-06. [2025-10-02T17:10:18.723358] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-02T17:10:18.852423] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-02T17:10:19.473003] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-03. [2025-10-02T17:10:19.660046] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-02T17:10:20.273003] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-06. [2025-10-02T17:10:21.073002] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-05. [2025-10-02T17:10:21.347995] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-02T17:10:21.433911] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-02T17:10:21.873007] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-04. [2025-10-02T17:10:22.672994] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-07. [2025-10-02T17:10:22.900917] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-02T17:10:23.472981] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-06. [2025-10-02T17:10:23.483196] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-02T17:10:23.654005] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-02T17:10:24.272996] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-05. [2025-10-02T17:10:24.854866] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-02T17:10:25.072989] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-07. [2025-10-02T17:10:25.872980] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-08. [2025-10-02T17:10:26.131335] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-02T17:10:26.173335] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-02T17:10:26.502026] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-02T17:10:26.673020] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-09. [2025-10-02T17:10:27.228039] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-02T17:10:27.472999] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-08. [2025-10-02T17:10:28.273028] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-10. [2025-10-02T17:10:28.722813] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-02T17:10:28.926451] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-02T17:10:28.927484] [INFO ] [REMOTE ] ALG: Full fetch complete (15892 records). [2025-10-02T17:10:28.927594] [DEBUG] [VALIDATOR ] ALG: Validating primary data. [2025-10-02T17:10:29.078084] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-07. [2025-10-02T17:10:29.367708] [DEBUG] [VALIDATOR ] ALG: All expected trading days are present. [2025-10-02T17:10:29.367811] [DEBUG] [VALIDATOR ] ALG: Primary data validation passed. [2025-10-02T17:10:29.368149] [INFO ] [MAIN ] ALG: Fetched primary data is valid. [2025-10-02T17:10:29.368214] [DEBUG] [LOCAL ] ALG: Saving primary data. [2025-10-02T17:10:29.369057] [DEBUG] [LOCAL ] ALG: Trimmed 15892 records to 10293 (keeping 200 days of data) [2025-10-02T17:10:29.451128] [DEBUG] [LOCAL ] ALG: Primary data saved (10293 records). [2025-10-02T17:10:29.451290] [INFO ] [MAIN ] ALG: Full history saved. [2025-10-02T17:10:29.451457] [INFO ] [MAIN ] Update Progress: 81/2370 symbols completed. ALG took 23.9s. Estimated remaining: 4h 54m 40s. Rate: 7.8 symbols/min [2025-10-02T17:10:29.670002] [INFO ] [MAIN ] ALL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:10:29.730329] [DEBUG] [LOCAL ] ALL: Loaded 50049 existing records from primary storage. [2025-10-02T17:10:29.730830] [INFO ] [MAIN ] ALL: Loaded 50049 existing records. [2025-10-02T17:10:29.878359] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-09. [2025-10-02T17:10:30.051681] [WARN ] [MAIN ] ALL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:10:30.051985] [INFO ] [MAIN ] ALL: Wiping existing primary data before full refresh. [2025-10-02T17:10:30.052050] [INFO ] [LOCAL ] ALL: Starting deletion of primary data. [2025-10-02T17:10:30.053369] [DEBUG] [LOCAL ] ALL: Deleted primary data file. [2025-10-02T17:10:30.053452] [INFO ] [MAIN ] ALL: Starting full primary refresh. [2025-10-02T17:10:30.659078] [INFO ] [REMOTE ] ALL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:10:30.672995] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-06. [2025-10-02T17:10:30.720284] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-02T17:10:31.128817] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-02T17:10:31.472995] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-08. [2025-10-02T17:10:32.272984] [INFO ] [REMOTE ] ALL: Fetching primary data for 2024-12. [2025-10-02T17:10:32.588913] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-02T17:10:33.037032] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-02T17:10:33.073024] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-09. [2025-10-02T17:10:33.872993] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-07. [2025-10-02T17:10:34.100301] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-02T17:10:34.672987] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-10. [2025-10-02T17:10:34.920899] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-02T17:10:35.397920] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-02T17:10:35.472992] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-08. [2025-10-02T17:10:35.549576] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-02T17:10:35.551219] [INFO ] [REMOTE ] ALEX: Full fetch complete (44583 records). [2025-10-02T17:10:35.551306] [DEBUG] [VALIDATOR ] ALEX: Validating primary data. [2025-10-02T17:10:35.986755] [DEBUG] [VALIDATOR ] ALEX: All expected trading days are present. [2025-10-02T17:10:35.986847] [DEBUG] [VALIDATOR ] ALEX: Primary data validation passed. [2025-10-02T17:10:35.987394] [INFO ] [MAIN ] ALEX: Fetched primary data is valid. [2025-10-02T17:10:35.987449] [DEBUG] [LOCAL ] ALEX: Saving primary data. [2025-10-02T17:10:35.988822] [DEBUG] [LOCAL ] ALEX: Trimmed 44583 records to 31342 (keeping 200 days of data) [2025-10-02T17:10:36.192472] [DEBUG] [LOCAL ] ALEX: Primary data saved (31342 records). [2025-10-02T17:10:36.192614] [INFO ] [MAIN ] ALEX: Full history saved. [2025-10-02T17:10:36.192725] [INFO ] [MAIN ] Update Progress: 82/2370 symbols completed. ALEX took 30.6s. Estimated remaining: 4h 54m 5s. Rate: 7.8 symbols/min [2025-10-02T17:10:36.278127] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-10. [2025-10-02T17:10:36.378221] [INFO ] [MAIN ] ALLE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:10:36.427190] [DEBUG] [LOCAL ] ALLE: Loaded 44729 existing records from primary storage. [2025-10-02T17:10:36.427535] [INFO ] [MAIN ] ALLE: Loaded 44729 existing records. [2025-10-02T17:10:36.626629] [WARN ] [MAIN ] ALLE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:10:36.626958] [INFO ] [MAIN ] ALLE: Wiping existing primary data before full refresh. [2025-10-02T17:10:36.627023] [INFO ] [LOCAL ] ALLE: Starting deletion of primary data. [2025-10-02T17:10:36.628428] [DEBUG] [LOCAL ] ALLE: Deleted primary data file. [2025-10-02T17:10:36.628491] [INFO ] [MAIN ] ALLE: Starting full primary refresh. [2025-10-02T17:10:37.018304] [INFO ] [REMOTE ] ALLE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:10:37.073007] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2024-12. [2025-10-02T17:10:37.214607] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-02T17:10:37.837478] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-02T17:10:37.840024] [INFO ] [REMOTE ] ALIT: Full fetch complete (76426 records). [2025-10-02T17:10:37.840211] [DEBUG] [VALIDATOR ] ALIT: Validating primary data. [2025-10-02T17:10:37.880434] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-01. [2025-10-02T17:10:38.289733] [DEBUG] [VALIDATOR ] ALIT: All expected trading days are present. [2025-10-02T17:10:38.289871] [DEBUG] [VALIDATOR ] ALIT: Primary data validation passed. [2025-10-02T17:10:38.290677] [INFO ] [MAIN ] ALIT: Fetched primary data is valid. [2025-10-02T17:10:38.290743] [DEBUG] [LOCAL ] ALIT: Saving primary data. [2025-10-02T17:10:38.292276] [DEBUG] [LOCAL ] ALIT: Trimmed 76426 records to 53155 (keeping 200 days of data) [2025-10-02T17:10:38.627071] [DEBUG] [LOCAL ] ALIT: Primary data saved (53155 records). [2025-10-02T17:10:38.627223] [INFO ] [MAIN ] ALIT: Full history saved. [2025-10-02T17:10:38.628422] [INFO ] [MAIN ] Update Progress: 83/2370 symbols completed. ALIT took 33.0s. Estimated remaining: 4h 51m 32s. Rate: 7.8 symbols/min [2025-10-02T17:10:38.678234] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-09. [2025-10-02T17:10:38.837699] [INFO ] [MAIN ] ALLY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:10:38.865017] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-02T17:10:38.925823] [DEBUG] [LOCAL ] ALLY: Loaded 53217 existing records from primary storage. [2025-10-02T17:10:38.926224] [INFO ] [MAIN ] ALLY: Loaded 53217 existing records. [2025-10-02T17:10:39.118749] [WARN ] [MAIN ] ALLY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:10:39.119028] [INFO ] [MAIN ] ALLY: Wiping existing primary data before full refresh. [2025-10-02T17:10:39.119091] [INFO ] [LOCAL ] ALLY: Starting deletion of primary data. [2025-10-02T17:10:39.120408] [DEBUG] [LOCAL ] ALLY: Deleted primary data file. [2025-10-02T17:10:39.120471] [INFO ] [MAIN ] ALLY: Starting full primary refresh. [2025-10-02T17:10:39.474709] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-01. [2025-10-02T17:10:39.530298] [INFO ] [REMOTE ] ALLY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:10:39.562594] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-02T17:10:40.273008] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2024-12. [2025-10-02T17:10:40.321074] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-02T17:10:41.073021] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-02. [2025-10-02T17:10:41.124501] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-02T17:10:41.836673] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-02T17:10:41.872966] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-01. [2025-10-02T17:10:42.564393] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-02T17:10:42.672988] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-10. [2025-10-02T17:10:43.400011] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-02T17:10:43.473068] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-03. [2025-10-02T17:10:44.273024] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-02. [2025-10-02T17:10:44.454288] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-02T17:10:44.456520] [INFO ] [REMOTE ] ALK: Full fetch complete (76834 records). [2025-10-02T17:10:44.456719] [DEBUG] [VALIDATOR ] ALK: Validating primary data. [2025-10-02T17:10:44.911874] [DEBUG] [VALIDATOR ] ALK: All expected trading days are present. [2025-10-02T17:10:44.911968] [DEBUG] [VALIDATOR ] ALK: Primary data validation passed. [2025-10-02T17:10:44.912737] [INFO ] [MAIN ] ALK: Fetched primary data is valid. [2025-10-02T17:10:44.912801] [DEBUG] [LOCAL ] ALK: Saving primary data. [2025-10-02T17:10:44.914438] [DEBUG] [LOCAL ] ALK: Trimmed 76834 records to 53444 (keeping 200 days of data) [2025-10-02T17:10:45.091180] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-02. [2025-10-02T17:10:45.258239] [DEBUG] [LOCAL ] ALK: Primary data saved (53444 records). [2025-10-02T17:10:45.258402] [INFO ] [MAIN ] ALK: Full history saved. [2025-10-02T17:10:45.258605] [INFO ] [MAIN ] Update Progress: 84/2370 symbols completed. ALK took 39.7s. Estimated remaining: 4h 50m 56s. Rate: 7.9 symbols/min [2025-10-02T17:10:45.482184] [INFO ] [MAIN ] ALSN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:10:45.515918] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-02T17:10:45.567293] [DEBUG] [LOCAL ] ALSN: Loaded 43288 existing records from primary storage. [2025-10-02T17:10:45.567601] [INFO ] [MAIN ] ALSN: Loaded 43288 existing records. [2025-10-02T17:10:45.772991] [WARN ] [MAIN ] ALSN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:10:45.773448] [INFO ] [MAIN ] ALSN: Wiping existing primary data before full refresh. [2025-10-02T17:10:45.773567] [INFO ] [LOCAL ] ALSN: Starting deletion of primary data. [2025-10-02T17:10:45.774866] [DEBUG] [LOCAL ] ALSN: Deleted primary data file. [2025-10-02T17:10:45.774928] [INFO ] [MAIN ] ALSN: Starting full primary refresh. [2025-10-02T17:10:45.879905] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-04. [2025-10-02T17:10:46.192784] [INFO ] [REMOTE ] ALSN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:10:46.221074] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-02T17:10:46.552566] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-02T17:10:46.673010] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2024-12. [2025-10-02T17:10:47.473012] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-03. [2025-10-02T17:10:47.634228] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-02T17:10:48.273015] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-05. [2025-10-02T17:10:48.486869] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-02T17:10:49.073011] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-01. [2025-10-02T17:10:49.451829] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-02T17:10:49.743695] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-02T17:10:49.873001] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-06. [2025-10-02T17:10:50.567380] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-02T17:10:50.673052] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-03. [2025-10-02T17:10:51.473047] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-04. [2025-10-02T17:10:51.642805] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-02T17:10:52.273037] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-07. [2025-10-02T17:10:52.403464] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-02T17:10:53.072968] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-04. [2025-10-02T17:10:53.417098] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-02T17:10:53.873034] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-05. [2025-10-02T17:10:54.258500] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-02T17:10:54.673356] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-08. [2025-10-02T17:10:54.676796] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-02T17:10:55.473012] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-05. [2025-10-02T17:10:55.722443] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-02T17:10:56.273000] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-06. [2025-10-02T17:10:56.366342] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-02T17:10:56.768200] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-02T17:10:57.073048] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-02. [2025-10-02T17:10:57.872999] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-06. [2025-10-02T17:10:58.061860] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-02T17:10:58.673050] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-09. [2025-10-02T17:10:58.801354] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-02T17:10:59.187545] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-02T17:10:59.473051] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-07. [2025-10-02T17:11:00.206151] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-02T17:11:00.272978] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-07. [2025-10-02T17:11:01.073046] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-10. [2025-10-02T17:11:01.523739] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-02T17:11:01.873043] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-08. [2025-10-02T17:11:02.468660] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-02T17:11:02.626512] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-02T17:11:02.629348] [INFO ] [REMOTE ] ALL: Full fetch complete (72464 records). [2025-10-02T17:11:02.629558] [DEBUG] [VALIDATOR ] ALL: Validating primary data. [2025-10-02T17:11:02.678148] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-08. [2025-10-02T17:11:03.070347] [DEBUG] [VALIDATOR ] ALL: All expected trading days are present. [2025-10-02T17:11:03.070472] [DEBUG] [VALIDATOR ] ALL: Primary data validation passed. [2025-10-02T17:11:03.071398] [INFO ] [MAIN ] ALL: Fetched primary data is valid. [2025-10-02T17:11:03.071498] [DEBUG] [LOCAL ] ALL: Saving primary data. [2025-10-02T17:11:03.073243] [DEBUG] [LOCAL ] ALL: Trimmed 72464 records to 50411 (keeping 200 days of data) [2025-10-02T17:11:03.423742] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-02T17:11:03.450350] [DEBUG] [LOCAL ] ALL: Primary data saved (50411 records). [2025-10-02T17:11:03.450478] [INFO ] [MAIN ] ALL: Full history saved. [2025-10-02T17:11:03.453340] [INFO ] [MAIN ] Update Progress: 85/2370 symbols completed. ALL took 34.0s. Estimated remaining: 4h 55m 33s. Rate: 7.7 symbols/min [2025-10-02T17:11:03.478194] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-03. [2025-10-02T17:11:03.643176] [INFO ] [MAIN ] ALTG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:11:03.671041] [DEBUG] [LOCAL ] ALTG: Loaded 23483 existing records from primary storage. [2025-10-02T17:11:03.671323] [INFO ] [MAIN ] ALTG: Loaded 23483 existing records. [2025-10-02T17:11:03.874935] [WARN ] [MAIN ] ALTG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:11:03.875214] [INFO ] [MAIN ] ALTG: Wiping existing primary data before full refresh. [2025-10-02T17:11:03.875276] [INFO ] [LOCAL ] ALTG: Starting deletion of primary data. [2025-10-02T17:11:03.876066] [DEBUG] [LOCAL ] ALTG: Deleted primary data file. [2025-10-02T17:11:03.876161] [INFO ] [MAIN ] ALTG: Starting full primary refresh. [2025-10-02T17:11:04.295282] [INFO ] [REMOTE ] ALTG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:11:04.286023] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-09. [2025-10-02T17:11:04.471047] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-02T17:11:04.990504] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-02T17:11:05.072999] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-04. [2025-10-02T17:11:05.819459] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-02T17:11:05.873044] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2024-12. [2025-10-02T17:11:06.673020] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-10. [2025-10-02T17:11:06.782332] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-02T17:11:07.188323] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-02T17:11:07.473043] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-05. [2025-10-02T17:11:08.070151] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-02T17:11:08.073809] [INFO ] [REMOTE ] ALLE: Full fetch complete (64767 records). [2025-10-02T17:11:08.073955] [DEBUG] [VALIDATOR ] ALLE: Validating primary data. [2025-10-02T17:11:08.278243] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-01. [2025-10-02T17:11:08.514371] [DEBUG] [VALIDATOR ] ALLE: All expected trading days are present. [2025-10-02T17:11:08.514462] [DEBUG] [VALIDATOR ] ALLE: Primary data validation passed. [2025-10-02T17:11:08.515187] [INFO ] [MAIN ] ALLE: Fetched primary data is valid. [2025-10-02T17:11:08.515252] [DEBUG] [LOCAL ] ALLE: Saving primary data. [2025-10-02T17:11:08.516639] [DEBUG] [LOCAL ] ALLE: Trimmed 64767 records to 45033 (keeping 200 days of data) [2025-10-02T17:11:08.821829] [DEBUG] [LOCAL ] ALLE: Primary data saved (45033 records). [2025-10-02T17:11:08.821971] [INFO ] [MAIN ] ALLE: Full history saved. [2025-10-02T17:11:08.825505] [INFO ] [MAIN ] Update Progress: 86/2370 symbols completed. ALLE took 32.6s. Estimated remaining: 4h 54m 21s. Rate: 7.8 symbols/min [2025-10-02T17:11:09.033050] [INFO ] [MAIN ] ALUR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:11:09.052405] [DEBUG] [LOCAL ] ALUR: Loaded 10774 existing records from primary storage. [2025-10-02T17:11:09.052757] [INFO ] [MAIN ] ALUR: Loaded 10774 existing records. [2025-10-02T17:11:09.078109] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-09. [2025-10-02T17:11:09.295362] [WARN ] [MAIN ] ALUR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:11:09.295923] [INFO ] [MAIN ] ALUR: Wiping existing primary data before full refresh. [2025-10-02T17:11:09.299145] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-02T17:11:09.296509] [INFO ] [LOCAL ] ALUR: Starting deletion of primary data. [2025-10-02T17:11:09.308903] [DEBUG] [LOCAL ] ALUR: Deleted primary data file. [2025-10-02T17:11:09.309063] [INFO ] [MAIN ] ALUR: Starting full primary refresh. [2025-10-02T17:11:09.479626] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-02T17:11:09.721586] [INFO ] [REMOTE ] ALUR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:11:09.873010] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2024-12. [2025-10-02T17:11:10.672996] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-06. [2025-10-02T17:11:11.023352] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-02T17:11:11.275473] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-02T17:11:11.473010] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-10. [2025-10-02T17:11:11.833890] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-02T17:11:12.273042] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-07. [2025-10-02T17:11:13.073031] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-02. [2025-10-02T17:11:13.280163] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-02T17:11:13.282254] [INFO ] [REMOTE ] ALLY: Full fetch complete (76912 records). [2025-10-02T17:11:13.282377] [DEBUG] [VALIDATOR ] ALLY: Validating primary data. [2025-10-02T17:11:13.745951] [DEBUG] [VALIDATOR ] ALLY: All expected trading days are present. [2025-10-02T17:11:13.746053] [DEBUG] [VALIDATOR ] ALLY: Primary data validation passed. [2025-10-02T17:11:13.746869] [INFO ] [MAIN ] ALLY: Fetched primary data is valid. [2025-10-02T17:11:13.746942] [DEBUG] [LOCAL ] ALLY: Saving primary data. [2025-10-02T17:11:13.748631] [DEBUG] [LOCAL ] ALLY: Trimmed 76912 records to 53605 (keeping 200 days of data) [2025-10-02T17:11:13.873482] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-01. [2025-10-02T17:11:14.050228] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-02T17:11:14.162930] [DEBUG] [LOCAL ] ALLY: Primary data saved (53605 records). [2025-10-02T17:11:14.163078] [INFO ] [MAIN ] ALLY: Full history saved. [2025-10-02T17:11:14.163213] [INFO ] [MAIN ] Update Progress: 87/2370 symbols completed. ALLY took 35.5s. Estimated remaining: 4h 53m 11s. Rate: 7.8 symbols/min [2025-10-02T17:11:14.303858] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-02T17:11:14.385442] [INFO ] [MAIN ] ALV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:11:14.442345] [DEBUG] [LOCAL ] ALV: Loaded 42369 existing records from primary storage. [2025-10-02T17:11:14.442668] [INFO ] [MAIN ] ALV: Loaded 42369 existing records. [2025-10-02T17:11:14.642399] [WARN ] [MAIN ] ALV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:11:14.642658] [INFO ] [MAIN ] ALV: Wiping existing primary data before full refresh. [2025-10-02T17:11:14.642724] [INFO ] [LOCAL ] ALV: Starting deletion of primary data. [2025-10-02T17:11:14.643892] [DEBUG] [LOCAL ] ALV: Deleted primary data file. [2025-10-02T17:11:14.643956] [INFO ] [MAIN ] ALV: Starting full primary refresh. [2025-10-02T17:11:14.678166] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-03. [2025-10-02T17:11:15.030502] [INFO ] [REMOTE ] ALV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:11:15.280806] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-02T17:11:15.472997] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-02. [2025-10-02T17:11:15.846869] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-02T17:11:16.273062] [INFO ] [REMOTE ] ALV: Fetching primary data for 2024-12. [2025-10-02T17:11:16.339169] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-02T17:11:17.073000] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-03. [2025-10-02T17:11:17.873016] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-08. [2025-10-02T17:11:17.931942] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-02T17:11:18.338383] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-02T17:11:18.672992] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-01. [2025-10-02T17:11:19.309606] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-02T17:11:19.473013] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-04. [2025-10-02T17:11:20.272989] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-09. [2025-10-02T17:11:20.308185] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-02T17:11:20.763734] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-02T17:11:21.072999] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-05. [2025-10-02T17:11:21.809334] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-02T17:11:21.873025] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-02. [2025-10-02T17:11:21.916525] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-02T17:11:22.673081] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-04. [2025-10-02T17:11:23.481949] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-06. [2025-10-02T17:11:23.487237] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-02T17:11:23.596137] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-02T17:11:24.272981] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-10. [2025-10-02T17:11:24.510201] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-02T17:11:25.073065] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-07. [2025-10-02T17:11:25.533609] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-02T17:11:25.535756] [INFO ] [REMOTE ] ALSN: Full fetch complete (62191 records). [2025-10-02T17:11:25.535914] [DEBUG] [VALIDATOR ] ALSN: Validating primary data. [2025-10-02T17:11:25.874098] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-03. [2025-10-02T17:11:26.002767] [DEBUG] [VALIDATOR ] ALSN: All expected trading days are present. [2025-10-02T17:11:26.002929] [DEBUG] [VALIDATOR ] ALSN: Primary data validation passed. [2025-10-02T17:11:26.003743] [INFO ] [MAIN ] ALSN: Fetched primary data is valid. [2025-10-02T17:11:26.003885] [DEBUG] [LOCAL ] ALSN: Saving primary data. [2025-10-02T17:11:26.012122] [DEBUG] [LOCAL ] ALSN: Trimmed 62191 records to 43607 (keeping 200 days of data) [2025-10-02T17:11:26.024480] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-02T17:11:26.323197] [DEBUG] [LOCAL ] ALSN: Primary data saved (43607 records). [2025-10-02T17:11:26.323331] [INFO ] [MAIN ] ALSN: Full history saved. [2025-10-02T17:11:26.323430] [INFO ] [MAIN ] Update Progress: 88/2370 symbols completed. ALSN took 41.1s. Estimated remaining: 4h 54m 59s. Rate: 7.7 symbols/min [2025-10-02T17:11:26.514966] [INFO ] [MAIN ] ALX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:11:26.526362] [DEBUG] [LOCAL ] ALX: Loaded 6227 existing records from primary storage. [2025-10-02T17:11:26.526592] [INFO ] [MAIN ] ALX: Loaded 6227 existing records. [2025-10-02T17:11:26.678151] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-05. [2025-10-02T17:11:26.724795] [WARN ] [MAIN ] ALX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:11:26.725014] [INFO ] [MAIN ] ALX: Wiping existing primary data before full refresh. [2025-10-02T17:11:26.725065] [INFO ] [LOCAL ] ALX: Starting deletion of primary data. [2025-10-02T17:11:26.725503] [DEBUG] [LOCAL ] ALX: Deleted primary data file. [2025-10-02T17:11:26.725564] [INFO ] [MAIN ] ALX: Starting full primary refresh. [2025-10-02T17:11:27.125552] [INFO ] [REMOTE ] ALX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:11:27.472988] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-08. [2025-10-02T17:11:27.664989] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-02T17:11:27.708494] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-02T17:11:28.270160] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-02T17:11:28.275701] [INFO ] [REMOTE ] ALX: Fetching primary data for 2024-12. [2025-10-02T17:11:28.934413] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-02T17:11:29.073008] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-04. [2025-10-02T17:11:29.873007] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-09. [2025-10-02T17:11:30.673048] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-06. [2025-10-02T17:11:30.836740] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-02T17:11:31.105871] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-02T17:11:31.175445] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-02T17:11:31.473032] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-01. [2025-10-02T17:11:32.013333] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-02T17:11:32.273007] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-10. [2025-10-02T17:11:33.073027] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-05. [2025-10-02T17:11:33.157511] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-02T17:11:33.160238] [INFO ] [REMOTE ] ALTG: Full fetch complete (33698 records). [2025-10-02T17:11:33.160369] [DEBUG] [VALIDATOR ] ALTG: Validating primary data. [2025-10-02T17:11:33.600068] [DEBUG] [VALIDATOR ] ALTG: All expected trading days are present. [2025-10-02T17:11:33.600404] [DEBUG] [VALIDATOR ] ALTG: Primary data validation passed. [2025-10-02T17:11:33.600930] [INFO ] [MAIN ] ALTG: Fetched primary data is valid. [2025-10-02T17:11:33.600998] [DEBUG] [LOCAL ] ALTG: Saving primary data. [2025-10-02T17:11:33.602034] [DEBUG] [LOCAL ] ALTG: Trimmed 33698 records to 23685 (keeping 200 days of data) [2025-10-02T17:11:33.741573] [DEBUG] [LOCAL ] ALTG: Primary data saved (23685 records). [2025-10-02T17:11:33.741732] [INFO ] [MAIN ] ALTG: Full history saved. [2025-10-02T17:11:33.741823] [INFO ] [MAIN ] Update Progress: 89/2370 symbols completed. ALTG took 30.3s. Estimated remaining: 4h 54m 42s. Rate: 7.7 symbols/min [2025-10-02T17:11:33.878178] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-07. [2025-10-02T17:11:33.940699] [INFO ] [MAIN ] AM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:11:33.998146] [DEBUG] [LOCAL ] AM: Loaded 52063 existing records from primary storage. [2025-10-02T17:11:33.998535] [INFO ] [MAIN ] AM: Loaded 52063 existing records. [2025-10-02T17:11:34.194663] [WARN ] [MAIN ] AM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:11:34.194887] [INFO ] [MAIN ] AM: Wiping existing primary data before full refresh. [2025-10-02T17:11:34.194970] [INFO ] [LOCAL ] AM: Starting deletion of primary data. [2025-10-02T17:11:34.196542] [DEBUG] [LOCAL ] AM: Deleted primary data file. [2025-10-02T17:11:34.196604] [INFO ] [MAIN ] AM: Starting full primary refresh. [2025-10-02T17:11:34.623060] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-02T17:11:34.629545] [INFO ] [REMOTE ] AM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:11:34.672977] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-06. [2025-10-02T17:11:34.748004] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-02T17:11:35.473040] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-08. [2025-10-02T17:11:35.935867] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-02T17:11:35.951314] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-02T17:11:36.273029] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-02. [2025-10-02T17:11:36.796636] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-02T17:11:37.073057] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-07. [2025-10-02T17:11:37.873010] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-09. [2025-10-02T17:11:38.550700] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-02T17:11:38.573875] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-02T17:11:38.673066] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-03. [2025-10-02T17:11:39.415587] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-02T17:11:39.473028] [INFO ] [REMOTE ] AM: Fetching primary data for 2024-12. [2025-10-02T17:11:40.273022] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-10. [2025-10-02T17:11:41.000351] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-02T17:11:41.001957] [INFO ] [REMOTE ] ALUR: Full fetch complete (20295 records). [2025-10-02T17:11:41.002102] [DEBUG] [VALIDATOR ] ALUR: Validating primary data. [2025-10-02T17:11:41.078903] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-08. [2025-10-02T17:11:41.434086] [DEBUG] [VALIDATOR ] ALUR: All expected trading days are present. [2025-10-02T17:11:41.434291] [DEBUG] [VALIDATOR ] ALUR: Primary data validation passed. [2025-10-02T17:11:41.434710] [INFO ] [MAIN ] ALUR: Fetched primary data is valid. [2025-10-02T17:11:41.434817] [DEBUG] [LOCAL ] ALUR: Saving primary data. [2025-10-02T17:11:41.435777] [DEBUG] [LOCAL ] ALUR: Trimmed 20295 records to 10816 (keeping 200 days of data) [2025-10-02T17:11:41.536052] [DEBUG] [LOCAL ] ALUR: Primary data saved (10816 records). [2025-10-02T17:11:41.523191] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-02T17:11:41.536359] [INFO ] [MAIN ] ALUR: Full history saved. [2025-10-02T17:11:41.549200] [INFO ] [MAIN ] Update Progress: 90/2370 symbols completed. ALUR took 32.7s. Estimated remaining: 4h 54m 36s. Rate: 7.7 symbols/min [2025-10-02T17:11:41.743776] [INFO ] [MAIN ] AMBC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:11:41.786718] [DEBUG] [LOCAL ] AMBC: Loaded 36580 existing records from primary storage. [2025-10-02T17:11:41.787003] [INFO ] [MAIN ] AMBC: Loaded 36580 existing records. [2025-10-02T17:11:41.878190] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-04. [2025-10-02T17:11:41.985997] [WARN ] [MAIN ] AMBC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:11:41.986216] [INFO ] [MAIN ] AMBC: Wiping existing primary data before full refresh. [2025-10-02T17:11:41.986269] [INFO ] [LOCAL ] AMBC: Starting deletion of primary data. [2025-10-02T17:11:41.987224] [DEBUG] [LOCAL ] AMBC: Deleted primary data file. [2025-10-02T17:11:41.987287] [INFO ] [MAIN ] AMBC: Starting full primary refresh. [2025-10-02T17:11:42.425476] [INFO ] [REMOTE ] AMBC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:11:42.429735] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-02T17:11:42.672981] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-01. [2025-10-02T17:11:42.781158] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-02T17:11:43.473043] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-05. [2025-10-02T17:11:44.094322] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-02T17:11:44.126146] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-02T17:11:44.273035] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2024-12. [2025-10-02T17:11:45.073020] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-02. [2025-10-02T17:11:45.610988] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-02T17:11:45.872990] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-01. [2025-10-02T17:11:46.672978] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-09. [2025-10-02T17:11:46.782579] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-02T17:11:47.105617] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-02T17:11:47.473023] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-06. [2025-10-02T17:11:48.043861] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-02T17:11:48.273006] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-03. [2025-10-02T17:11:48.387726] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-02T17:11:49.073035] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-07. [2025-10-02T17:11:49.851895] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-02T17:11:49.870242] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-02T17:11:49.872940] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-08. [2025-10-02T17:11:50.638934] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-02T17:11:50.672976] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-10. [2025-10-02T17:11:51.473033] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-04. [2025-10-02T17:11:51.922170] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-02T17:11:51.924093] [INFO ] [REMOTE ] ALV: Full fetch complete (61807 records). [2025-10-02T17:11:51.924205] [DEBUG] [VALIDATOR ] ALV: Validating primary data. [2025-10-02T17:11:52.278407] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-09. [2025-10-02T17:11:52.363107] [DEBUG] [VALIDATOR ] ALV: All expected trading days are present. [2025-10-02T17:11:52.363195] [DEBUG] [VALIDATOR ] ALV: Primary data validation passed. [2025-10-02T17:11:52.363872] [INFO ] [MAIN ] ALV: Fetched primary data is valid. [2025-10-02T17:11:52.363936] [DEBUG] [LOCAL ] ALV: Saving primary data. [2025-10-02T17:11:52.365278] [DEBUG] [LOCAL ] ALV: Trimmed 61807 records to 42666 (keeping 200 days of data) [2025-10-02T17:11:52.650918] [DEBUG] [LOCAL ] ALV: Primary data saved (42666 records). [2025-10-02T17:11:52.651050] [INFO ] [MAIN ] ALV: Full history saved. [2025-10-02T17:11:52.651134] [INFO ] [MAIN ] Update Progress: 91/2370 symbols completed. ALV took 38.5s. Estimated remaining: 4h 55m 52s. Rate: 7.7 symbols/min [2025-10-02T17:11:52.853171] [INFO ] [MAIN ] AMBP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:11:52.853992] [DEBUG] [LOCAL ] AMBP: No existing data file found in primary storage. [2025-10-02T17:11:52.854062] [WARN ] [MAIN ] AMBP: No existing data found, performing full refresh instead. [2025-10-02T17:11:52.854224] [INFO ] [MAIN ] AMBP: Wiping existing primary data before full refresh. [2025-10-02T17:11:52.854280] [INFO ] [LOCAL ] AMBP: Starting deletion of primary data. [2025-10-02T17:11:52.854335] [DEBUG] [LOCAL ] AMBP: No primary data file found to delete. [2025-10-02T17:11:52.854392] [INFO ] [MAIN ] AMBP: Starting full primary refresh. [2025-10-02T17:11:53.051586] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-02T17:11:53.078917] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-02. [2025-10-02T17:11:53.291789] [INFO ] [REMOTE ] AMBP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:11:53.350766] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-02T17:11:53.873004] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-05. [2025-10-02T17:11:54.396033] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-02T17:11:54.673054] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-10. [2025-10-02T17:11:55.357821] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-02T17:11:55.358980] [INFO ] [REMOTE ] ALX: Full fetch complete (7160 records). [2025-10-02T17:11:55.359066] [DEBUG] [VALIDATOR ] ALX: Validating primary data. [2025-10-02T17:11:55.475801] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-03. [2025-10-02T17:11:55.783581] [DEBUG] [VALIDATOR ] ALX: All expected trading days are present. [2025-10-02T17:11:55.783802] [DEBUG] [VALIDATOR ] ALX: Primary data validation passed. [2025-10-02T17:11:55.784024] [INFO ] [MAIN ] ALX: Fetched primary data is valid. [2025-10-02T17:11:55.784141] [DEBUG] [LOCAL ] ALX: Saving primary data. [2025-10-02T17:11:55.794694] [DEBUG] [LOCAL ] ALX: Trimmed 7160 records to 6303 (keeping 200 days of data) [2025-10-02T17:11:55.832458] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-02T17:11:55.867754] [DEBUG] [LOCAL ] ALX: Primary data saved (6303 records). [2025-10-02T17:11:55.867890] [INFO ] [MAIN ] ALX: Full history saved. [2025-10-02T17:11:55.867971] [INFO ] [MAIN ] Update Progress: 92/2370 symbols completed. ALX took 29.5s. Estimated remaining: 4h 53m 51s. Rate: 7.8 symbols/min [2025-10-02T17:11:56.053412] [INFO ] [MAIN ] AMBQ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:11:56.053568] [DEBUG] [LOCAL ] AMBQ: No existing data file found in primary storage. [2025-10-02T17:11:56.053608] [WARN ] [MAIN ] AMBQ: No existing data found, performing full refresh instead. [2025-10-02T17:11:56.053742] [INFO ] [MAIN ] AMBQ: Wiping existing primary data before full refresh. [2025-10-02T17:11:56.053790] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-02T17:11:56.053833] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-02T17:11:56.053866] [INFO ] [MAIN ] AMBQ: Starting full primary refresh. [2025-10-02T17:11:56.282862] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2024-12. [2025-10-02T17:11:56.443241] [INFO ] [REMOTE ] AMBQ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:11:56.990919] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-02T17:11:57.073045] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2024-12. [2025-10-02T17:11:57.330142] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T17:11:57.330460] [WARN ] [REMOTE ] AMBQ: No data returned for month 2024-12 [2025-10-02T17:11:57.330552] [FATAL] [REMOTE ] AMBQ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T17:11:57.330609] [FATAL] [MAIN ] AMBQ: Failed to fetch primary data. [2025-10-02T17:11:57.330703] [WARN ] [MAIN ] AMBQ: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T17:11:57.330780] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-02T17:11:57.330845] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-02T17:11:57.330882] [INFO ] [LOCAL ] AMBQ: Starting deletion of derivative data. [2025-10-02T17:11:57.330924] [DEBUG] [LOCAL ] AMBQ: No derivative data file found to delete. [2025-10-02T17:11:57.330974] [INFO ] [MAIN ] Update Progress: 93/2370 symbols completed. AMBQ took 1.5s. Estimated remaining: 4h 51m 10s. Rate: 7.8 symbols/min [2025-10-02T17:11:57.518324] [INFO ] [MAIN ] AMC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:11:57.575445] [DEBUG] [LOCAL ] AMC: Loaded 53760 existing records from primary storage. [2025-10-02T17:11:57.575842] [INFO ] [MAIN ] AMC: Loaded 53760 existing records. [2025-10-02T17:11:57.785480] [WARN ] [MAIN ] AMC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:11:57.785789] [INFO ] [MAIN ] AMC: Wiping existing primary data before full refresh. [2025-10-02T17:11:57.785864] [INFO ] [LOCAL ] AMC: Starting deletion of primary data. [2025-10-02T17:11:57.796388] [DEBUG] [LOCAL ] AMC: Deleted primary data file. [2025-10-02T17:11:57.812798] [INFO ] [MAIN ] AMC: Starting full primary refresh. [2025-10-02T17:11:57.849549] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-02T17:11:57.875268] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-04. [2025-10-02T17:11:58.223166] [INFO ] [REMOTE ] AMC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:11:58.673023] [INFO ] [REMOTE ] AMC: Fetching primary data for 2024-12. [2025-10-02T17:11:59.472986] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-01. [2025-10-02T17:11:59.576501] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-02T17:12:00.273038] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-05. [2025-10-02T17:12:01.073004] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-06. [2025-10-02T17:12:01.104768] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-02T17:12:01.517337] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2024-12 (2.84 seconds). [2025-10-02T17:12:01.873883] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-02. [2025-10-02T17:12:01.877709] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-02T17:12:02.425764] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-02T17:12:02.673054] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-06. [2025-10-02T17:12:03.446041] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-02T17:12:03.472965] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-01. [2025-10-02T17:12:04.035176] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-02T17:12:04.273010] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-07. [2025-10-02T17:12:05.073048] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-07. [2025-10-02T17:12:05.633594] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-02T17:12:05.873013] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-03. [2025-10-02T17:12:05.942487] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-01 (2.47 seconds). [2025-10-02T17:12:06.673036] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-02. [2025-10-02T17:12:07.417951] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-02T17:12:07.472983] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-04. [2025-10-02T17:12:07.557023] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-10-02T17:12:08.273003] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-08. [2025-10-02T17:12:08.655587] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-02T17:12:08.860195] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-02T17:12:09.073007] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-05. [2025-10-02T17:12:09.717399] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-02T17:12:09.873031] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-09. [2025-10-02T17:12:10.469466] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-02T17:12:10.673044] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-08. [2025-10-02T17:12:10.780396] [DEBUG] [REMOTE ] AMBC: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-10-02T17:12:10.780938] [WARN ] [REMOTE ] AMBC: No data returned for month 2025-08 [2025-10-02T17:12:10.781093] [FATAL] [REMOTE ] AMBC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T17:12:10.781266] [FATAL] [MAIN ] AMBC: Failed to fetch primary data. [2025-10-02T17:12:10.781341] [WARN ] [MAIN ] AMBC: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T17:12:10.781429] [INFO ] [LOCAL ] AMBC: Starting deletion of primary data. [2025-10-02T17:12:10.781499] [DEBUG] [LOCAL ] AMBC: No primary data file found to delete. [2025-10-02T17:12:10.781539] [INFO ] [LOCAL ] AMBC: Starting deletion of derivative data. [2025-10-02T17:12:10.782078] [DEBUG] [LOCAL ] AMBC: Deleted derivative data file. [2025-10-02T17:12:10.783624] [INFO ] [MAIN ] Update Progress: 94/2370 symbols completed. AMBC took 29.2s. Estimated remaining: 4h 53m 22s. Rate: 7.8 symbols/min [2025-10-02T17:12:10.972359] [INFO ] [MAIN ] AMCR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:12:11.034485] [DEBUG] [LOCAL ] AMCR: Loaded 53669 existing records from primary storage. [2025-10-02T17:12:11.034857] [INFO ] [MAIN ] AMCR: Loaded 53669 existing records. [2025-10-02T17:12:11.244844] [WARN ] [MAIN ] AMCR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:12:11.245217] [INFO ] [MAIN ] AMCR: Wiping existing primary data before full refresh. [2025-10-02T17:12:11.245274] [INFO ] [LOCAL ] AMCR: Starting deletion of primary data. [2025-10-02T17:12:11.246789] [DEBUG] [LOCAL ] AMCR: Deleted primary data file. [2025-10-02T17:12:11.246853] [INFO ] [MAIN ] AMCR: Starting full primary refresh. [2025-10-02T17:12:11.480707] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-06. [2025-10-02T17:12:11.647343] [INFO ] [REMOTE ] AMCR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:12:11.677821] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-02T17:12:12.273017] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-03. [2025-10-02T17:12:12.796099] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-02T17:12:13.073017] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-10. [2025-10-02T17:12:13.872986] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-07. [2025-10-02T17:12:14.242350] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-02T17:12:14.244411] [INFO ] [REMOTE ] AM: Full fetch complete (75588 records). [2025-10-02T17:12:14.244513] [DEBUG] [VALIDATOR ] AM: Validating primary data. [2025-10-02T17:12:14.678212] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2024-12. [2025-10-02T17:12:14.706115] [DEBUG] [VALIDATOR ] AM: All expected trading days are present. [2025-10-02T17:12:14.706207] [DEBUG] [VALIDATOR ] AM: Primary data validation passed. [2025-10-02T17:12:14.707118] [INFO ] [MAIN ] AM: Fetched primary data is valid. [2025-10-02T17:12:14.707305] [DEBUG] [LOCAL ] AM: Saving primary data. [2025-10-02T17:12:14.709068] [DEBUG] [LOCAL ] AM: Trimmed 75588 records to 52439 (keeping 200 days of data) [2025-10-02T17:12:15.211414] [DEBUG] [LOCAL ] AM: Primary data saved (52439 records). [2025-10-02T17:12:15.211606] [INFO ] [MAIN ] AM: Full history saved. [2025-10-02T17:12:15.212552] [INFO ] [MAIN ] Update Progress: 95/2370 symbols completed. AM took 41.5s. Estimated remaining: 4h 51m 55s. Rate: 7.8 symbols/min [2025-10-02T17:12:15.491549] [INFO ] [MAIN ] AME: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:12:15.531904] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-03 (3.26 seconds). [2025-10-02T17:12:15.548761] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-04. [2025-10-02T17:12:15.600822] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-02T17:12:15.662598] [DEBUG] [LOCAL ] AME: Loaded 48490 existing records from primary storage. [2025-10-02T17:12:15.662985] [INFO ] [MAIN ] AME: Loaded 48490 existing records. [2025-10-02T17:12:15.886715] [WARN ] [MAIN ] AME: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:12:15.887004] [INFO ] [MAIN ] AME: Wiping existing primary data before full refresh. [2025-10-02T17:12:15.887062] [INFO ] [LOCAL ] AME: Starting deletion of primary data. [2025-10-02T17:12:15.888729] [DEBUG] [LOCAL ] AME: Deleted primary data file. [2025-10-02T17:12:15.888810] [INFO ] [MAIN ] AME: Starting full primary refresh. [2025-10-02T17:12:16.279833] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-08. [2025-10-02T17:12:16.287148] [INFO ] [REMOTE ] AME: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:12:16.742143] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-02T17:12:17.073030] [INFO ] [REMOTE ] AME: Fetching primary data for 2024-12. [2025-10-02T17:12:17.877633] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-01. [2025-10-02T17:12:17.880915] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-02T17:12:18.002369] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-10-02T17:12:18.672962] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-09. [2025-10-02T17:12:18.787549] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-02T17:12:19.093518] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-02T17:12:19.473006] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-01. [2025-10-02T17:12:20.130593] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-02T17:12:20.273021] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-10. [2025-10-02T17:12:21.072978] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-02. [2025-10-02T17:12:21.230743] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-02T17:12:21.499943] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-02T17:12:21.501768] [INFO ] [REMOTE ] AMBP: Full fetch complete (65665 records). [2025-10-02T17:12:21.501888] [DEBUG] [VALIDATOR ] AMBP: Validating primary data. [2025-10-02T17:12:21.878105] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-05. [2025-10-02T17:12:22.031159] [DEBUG] [VALIDATOR ] AMBP: All expected trading days are present. [2025-10-02T17:12:22.031274] [DEBUG] [VALIDATOR ] AMBP: Primary data validation passed. [2025-10-02T17:12:22.031963] [INFO ] [MAIN ] AMBP: Fetched primary data is valid. [2025-10-02T17:12:22.032029] [DEBUG] [LOCAL ] AMBP: Saving primary data. [2025-10-02T17:12:22.033397] [DEBUG] [LOCAL ] AMBP: Trimmed 65665 records to 45246 (keeping 200 days of data) [2025-10-02T17:12:22.314236] [DEBUG] [LOCAL ] AMBP: Primary data saved (45246 records). [2025-10-02T17:12:22.314408] [INFO ] [MAIN ] AMBP: Full history saved. [2025-10-02T17:12:22.314504] [INFO ] [MAIN ] Update Progress: 96/2370 symbols completed. AMBP took 29.7s. Estimated remaining: 4h 51m 33s. Rate: 7.8 symbols/min [2025-10-02T17:12:22.507065] [INFO ] [MAIN ] AMG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:12:22.532946] [DEBUG] [LOCAL ] AMG: Loaded 20419 existing records from primary storage. [2025-10-02T17:12:22.533570] [INFO ] [MAIN ] AMG: Loaded 20419 existing records. [2025-10-02T17:12:22.682416] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-02. [2025-10-02T17:12:22.796102] [WARN ] [MAIN ] AMG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:12:22.796509] [INFO ] [MAIN ] AMG: Wiping existing primary data before full refresh. [2025-10-02T17:12:22.796749] [INFO ] [LOCAL ] AMG: Starting deletion of primary data. [2025-10-02T17:12:22.797538] [DEBUG] [LOCAL ] AMG: Deleted primary data file. [2025-10-02T17:12:22.797604] [INFO ] [MAIN ] AMG: Starting full primary refresh. [2025-10-02T17:12:22.948488] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-02T17:12:23.242233] [INFO ] [REMOTE ] AMG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:12:23.472994] [INFO ] [REMOTE ] AMG: Fetching primary data for 2024-12. [2025-10-02T17:12:24.250535] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-10-02T17:12:24.278831] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-06. [2025-10-02T17:12:24.292076] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-02T17:12:24.591262] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-02T17:12:25.073046] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-03. [2025-10-02T17:12:25.873001] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-01. [2025-10-02T17:12:26.673015] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-03. [2025-10-02T17:12:26.859991] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-06 (2.58 seconds). [2025-10-02T17:12:26.904031] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-02T17:12:27.069536] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-02T17:12:27.473042] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-04. [2025-10-02T17:12:28.222391] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-02T17:12:28.273022] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-07. [2025-10-02T17:12:29.072999] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-02. [2025-10-02T17:12:29.430827] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-02T17:12:29.872964] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-05. [2025-10-02T17:12:30.191543] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-02T17:12:30.369302] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-02T17:12:30.673039] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-03. [2025-10-02T17:12:31.473024] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-08. [2025-10-02T17:12:31.699762] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-02T17:12:31.738581] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-02T17:12:32.273008] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-06. [2025-10-02T17:12:33.073025] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-04. [2025-10-02T17:12:33.871063] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-10-02T17:12:33.881834] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-04. [2025-10-02T17:12:34.103039] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-02T17:12:34.673042] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-07. [2025-10-02T17:12:34.920333] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-02T17:12:34.965721] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-02T17:12:35.473042] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-05. [2025-10-02T17:12:36.259323] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-02T17:12:36.278112] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-08. [2025-10-02T17:12:36.288760] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-02T17:12:37.073011] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-09. [2025-10-02T17:12:37.872990] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-05. [2025-10-02T17:12:38.282556] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-02T17:12:38.673050] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-06. [2025-10-02T17:12:38.977190] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-02T17:12:39.380973] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-02T17:12:39.473060] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-07. [2025-10-02T17:12:39.640971] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-02T17:12:40.273003] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-06. [2025-10-02T17:12:40.576125] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-02T17:12:41.073010] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-09. [2025-10-02T17:12:41.761320] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-02T17:12:41.873013] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-07. [2025-10-02T17:12:42.673059] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-08. [2025-10-02T17:12:43.145723] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-02T17:12:43.417890] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-02T17:12:43.473043] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-10. [2025-10-02T17:12:43.621383] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-02T17:12:44.273008] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-10. [2025-10-02T17:12:45.072978] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-08. [2025-10-02T17:12:45.304559] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-02T17:12:45.306837] [INFO ] [REMOTE ] AMC: Full fetch complete (77924 records). [2025-10-02T17:12:45.307003] [DEBUG] [VALIDATOR ] AMC: Validating primary data. [2025-10-02T17:12:45.736769] [DEBUG] [VALIDATOR ] AMC: All expected trading days are present. [2025-10-02T17:12:45.736860] [DEBUG] [VALIDATOR ] AMC: Primary data validation passed. [2025-10-02T17:12:45.737679] [INFO ] [MAIN ] AMC: Fetched primary data is valid. [2025-10-02T17:12:45.737746] [DEBUG] [LOCAL ] AMC: Saving primary data. [2025-10-02T17:12:45.739343] [DEBUG] [LOCAL ] AMC: Trimmed 77924 records to 54150 (keeping 200 days of data) [2025-10-02T17:12:45.908036] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-09. [2025-10-02T17:12:45.924189] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-02T17:12:45.954031] [INFO ] [REMOTE ] AMCR: Full fetch complete (77677 records). [2025-10-02T17:12:45.954677] [DEBUG] [VALIDATOR ] AMCR: Validating primary data. [2025-10-02T17:12:46.425548] [DEBUG] [VALIDATOR ] AMCR: All expected trading days are present. [2025-10-02T17:12:46.429238] [DEBUG] [VALIDATOR ] AMCR: Primary data validation passed. [2025-10-02T17:12:46.430331] [INFO ] [MAIN ] AMCR: Fetched primary data is valid. [2025-10-02T17:12:46.463952] [DEBUG] [LOCAL ] AMCR: Saving primary data. [2025-10-02T17:12:46.518106] [DEBUG] [LOCAL ] AMC: Primary data saved (54150 records). [2025-10-02T17:12:46.518320] [DEBUG] [LOCAL ] AMCR: Trimmed 77677 records to 54059 (keeping 200 days of data) [2025-10-02T17:12:46.518681] [INFO ] [MAIN ] AMC: Full history saved. [2025-10-02T17:12:46.519446] [INFO ] [MAIN ] Update Progress: 97/2370 symbols completed. AMC took 49.2s. Estimated remaining: 4h 57m 52s. Rate: 7.6 symbols/min [2025-10-02T17:12:46.815263] [INFO ] [MAIN ] AMH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:12:46.853543] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-02T17:12:46.867478] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-09. [2025-10-02T17:12:47.018039] [DEBUG] [LOCAL ] AMH: Loaded 51715 existing records from primary storage. [2025-10-02T17:12:47.019948] [INFO ] [MAIN ] AMH: Loaded 51715 existing records. [2025-10-02T17:12:47.184480] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-02T17:12:47.266628] [WARN ] [MAIN ] AMH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:12:47.273703] [INFO ] [MAIN ] AMH: Wiping existing primary data before full refresh. [2025-10-02T17:12:47.273984] [INFO ] [LOCAL ] AMH: Starting deletion of primary data. [2025-10-02T17:12:47.310499] [DEBUG] [LOCAL ] AMH: Deleted primary data file. [2025-10-02T17:12:47.335443] [INFO ] [MAIN ] AMH: Starting full primary refresh. [2025-10-02T17:12:47.474950] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-10. [2025-10-02T17:12:47.500331] [DEBUG] [LOCAL ] AMCR: Primary data saved (54059 records). [2025-10-02T17:12:47.514038] [INFO ] [MAIN ] AMCR: Full history saved. [2025-10-02T17:12:47.544674] [INFO ] [MAIN ] Update Progress: 98/2370 symbols completed. AMCR took 36.8s. Estimated remaining: 4h 55m 6s. Rate: 7.7 symbols/min [2025-10-02T17:12:47.966868] [INFO ] [REMOTE ] AMH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:12:47.986511] [INFO ] [MAIN ] AMN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:12:48.032260] [DEBUG] [LOCAL ] AMN: Loaded 41777 existing records from primary storage. [2025-10-02T17:12:48.032548] [INFO ] [MAIN ] AMN: Loaded 41777 existing records. [2025-10-02T17:12:48.229551] [WARN ] [MAIN ] AMN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:12:48.229949] [INFO ] [MAIN ] AMN: Wiping existing primary data before full refresh. [2025-10-02T17:12:48.230099] [INFO ] [LOCAL ] AMN: Starting deletion of primary data. [2025-10-02T17:12:48.231143] [DEBUG] [LOCAL ] AMN: Deleted primary data file. [2025-10-02T17:12:48.231205] [INFO ] [MAIN ] AMN: Starting full primary refresh. [2025-10-02T17:12:48.279483] [INFO ] [REMOTE ] AMH: Fetching primary data for 2024-12. [2025-10-02T17:12:48.360885] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-02T17:12:48.425710] [INFO ] [REMOTE ] AMG: Full fetch complete (29801 records). [2025-10-02T17:12:48.500629] [DEBUG] [VALIDATOR ] AMG: Validating primary data. [2025-10-02T17:12:48.772403] [INFO ] [REMOTE ] AMN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:12:49.074684] [INFO ] [REMOTE ] AMN: Fetching primary data for 2024-12. [2025-10-02T17:12:49.080553] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-02T17:12:49.134569] [DEBUG] [VALIDATOR ] AMG: All expected trading days are present. [2025-10-02T17:12:49.134678] [DEBUG] [VALIDATOR ] AMG: Primary data validation passed. [2025-10-02T17:12:49.135129] [INFO ] [MAIN ] AMG: Fetched primary data is valid. [2025-10-02T17:12:49.135192] [DEBUG] [LOCAL ] AMG: Saving primary data. [2025-10-02T17:12:49.136158] [DEBUG] [LOCAL ] AMG: Trimmed 29801 records to 20522 (keeping 200 days of data) [2025-10-02T17:12:49.273087] [DEBUG] [LOCAL ] AMG: Primary data saved (20522 records). [2025-10-02T17:12:49.273234] [INFO ] [MAIN ] AMG: Full history saved. [2025-10-02T17:12:49.273326] [INFO ] [MAIN ] Update Progress: 99/2370 symbols completed. AMG took 27.0s. Estimated remaining: 4h 52m 39s. Rate: 7.8 symbols/min [2025-10-02T17:12:49.477777] [INFO ] [MAIN ] AMP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:12:49.515119] [DEBUG] [LOCAL ] AMP: Loaded 32225 existing records from primary storage. [2025-10-02T17:12:49.515427] [INFO ] [MAIN ] AMP: Loaded 32225 existing records. [2025-10-02T17:12:49.711511] [WARN ] [MAIN ] AMP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:12:49.711953] [INFO ] [MAIN ] AMP: Wiping existing primary data before full refresh. [2025-10-02T17:12:49.712020] [INFO ] [LOCAL ] AMP: Starting deletion of primary data. [2025-10-02T17:12:49.713229] [DEBUG] [LOCAL ] AMP: Deleted primary data file. [2025-10-02T17:12:49.713295] [INFO ] [MAIN ] AMP: Starting full primary refresh. [2025-10-02T17:12:49.877098] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-10. [2025-10-02T17:12:50.138595] [INFO ] [REMOTE ] AMP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:12:50.169672] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-02T17:12:50.674475] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-01. [2025-10-02T17:12:50.680098] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-02T17:12:51.472969] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-01. [2025-10-02T17:12:51.553245] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-02T17:12:51.555308] [INFO ] [REMOTE ] AME: Full fetch complete (69859 records). [2025-10-02T17:12:51.555410] [DEBUG] [VALIDATOR ] AME: Validating primary data. [2025-10-02T17:12:52.003857] [DEBUG] [VALIDATOR ] AME: All expected trading days are present. [2025-10-02T17:12:52.004003] [DEBUG] [VALIDATOR ] AME: Primary data validation passed. [2025-10-02T17:12:52.004925] [INFO ] [MAIN ] AME: Fetched primary data is valid. [2025-10-02T17:12:52.005015] [DEBUG] [LOCAL ] AME: Saving primary data. [2025-10-02T17:12:52.006508] [DEBUG] [LOCAL ] AME: Trimmed 69859 records to 48837 (keeping 200 days of data) [2025-10-02T17:12:52.273168] [INFO ] [REMOTE ] AMP: Fetching primary data for 2024-12. [2025-10-02T17:12:52.361172] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-02T17:12:52.382769] [DEBUG] [LOCAL ] AME: Primary data saved (48837 records). [2025-10-02T17:12:52.382923] [INFO ] [MAIN ] AME: Full history saved. [2025-10-02T17:12:52.384559] [INFO ] [MAIN ] Update Progress: 100/2370 symbols completed. AME took 37.2s. Estimated remaining: 4h 50m 47s. Rate: 7.8 symbols/min [2025-10-02T17:12:52.571275] [INFO ] [MAIN ] AMPX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:12:52.628777] [DEBUG] [LOCAL ] AMPX: Loaded 52297 existing records from primary storage. [2025-10-02T17:12:52.629135] [INFO ] [MAIN ] AMPX: Loaded 52297 existing records. [2025-10-02T17:12:52.842539] [WARN ] [MAIN ] AMPX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:12:52.842872] [INFO ] [MAIN ] AMPX: Wiping existing primary data before full refresh. [2025-10-02T17:12:52.842997] [INFO ] [LOCAL ] AMPX: Starting deletion of primary data. [2025-10-02T17:12:52.844450] [DEBUG] [LOCAL ] AMPX: Deleted primary data file. [2025-10-02T17:12:52.844530] [INFO ] [MAIN ] AMPX: Starting full primary refresh. [2025-10-02T17:12:53.066904] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-02T17:12:53.073723] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-02. [2025-10-02T17:12:53.314324] [INFO ] [REMOTE ] AMPX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:12:53.545911] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-02T17:12:53.872988] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-02. [2025-10-02T17:12:54.673040] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2024-12. [2025-10-02T17:12:54.734818] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-02T17:12:55.002635] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-02T17:12:55.473046] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-03. [2025-10-02T17:12:56.272985] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-03. [2025-10-02T17:12:56.674572] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-02T17:12:56.807789] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-02T17:12:57.073023] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-04. [2025-10-02T17:12:57.872984] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-01. [2025-10-02T17:12:58.135006] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-02T17:12:58.495675] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-02T17:12:58.673047] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-04. [2025-10-02T17:12:59.072342] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-02T17:12:59.473012] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-05. [2025-10-02T17:13:00.273004] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-02. [2025-10-02T17:13:00.434875] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-02T17:13:01.072998] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-05. [2025-10-02T17:13:01.309933] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-02T17:13:01.796974] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-02T17:13:01.873041] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-06. [2025-10-02T17:13:02.673005] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-03. [2025-10-02T17:13:02.887911] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-02T17:13:03.281946] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-02T17:13:03.473051] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-01. [2025-10-02T17:13:04.272986] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-06. [2025-10-02T17:13:04.306128] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-02T17:13:05.073906] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-07. [2025-10-02T17:13:05.076665] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-02T17:13:05.839075] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-02T17:13:05.872963] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-02. [2025-10-02T17:13:06.388943] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-02T17:13:06.673029] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-07. [2025-10-02T17:13:07.472979] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-08. [2025-10-02T17:13:07.659895] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-02T17:13:08.148963] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-02T17:13:08.273024] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-04. [2025-10-02T17:13:09.049384] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-02T17:13:09.072987] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-09. [2025-10-02T17:13:09.446576] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-02T17:13:09.873035] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-08. [2025-10-02T17:13:10.609947] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-02T17:13:10.673031] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-05. [2025-10-02T17:13:11.472974] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-10. [2025-10-02T17:13:11.653877] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-02T17:13:11.736617] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-02T17:13:12.273020] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-06. [2025-10-02T17:13:12.882280] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-02T17:13:12.890063] [INFO ] [REMOTE ] AMN: Full fetch complete (60379 records). [2025-10-02T17:13:12.890382] [DEBUG] [VALIDATOR ] AMN: Validating primary data. [2025-10-02T17:13:13.078240] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-09. [2025-10-02T17:13:13.339316] [DEBUG] [VALIDATOR ] AMN: All expected trading days are present. [2025-10-02T17:13:13.339406] [DEBUG] [VALIDATOR ] AMN: Primary data validation passed. [2025-10-02T17:13:13.340043] [INFO ] [MAIN ] AMN: Fetched primary data is valid. [2025-10-02T17:13:13.340132] [DEBUG] [LOCAL ] AMN: Saving primary data. [2025-10-02T17:13:13.342388] [DEBUG] [LOCAL ] AMN: Trimmed 60379 records to 42097 (keeping 200 days of data) [2025-10-02T17:13:13.610814] [DEBUG] [LOCAL ] AMN: Primary data saved (42097 records). [2025-10-02T17:13:13.610956] [INFO ] [MAIN ] AMN: Full history saved. [2025-10-02T17:13:13.611088] [INFO ] [MAIN ] Update Progress: 101/2370 symbols completed. AMN took 26.0s. Estimated remaining: 4h 55m 43s. Rate: 7.7 symbols/min [2025-10-02T17:13:13.807352] [INFO ] [MAIN ] AMPY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:13:13.830568] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-02T17:13:13.883225] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-03. [2025-10-02T17:13:13.887575] [DEBUG] [LOCAL ] AMPY: Loaded 37804 existing records from primary storage. [2025-10-02T17:13:13.888141] [INFO ] [MAIN ] AMPY: Loaded 37804 existing records. [2025-10-02T17:13:14.091590] [WARN ] [MAIN ] AMPY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:13:14.091841] [INFO ] [MAIN ] AMPY: Wiping existing primary data before full refresh. [2025-10-02T17:13:14.091891] [INFO ] [LOCAL ] AMPY: Starting deletion of primary data. [2025-10-02T17:13:14.092879] [DEBUG] [LOCAL ] AMPY: Deleted primary data file. [2025-10-02T17:13:14.092958] [INFO ] [MAIN ] AMPY: Starting full primary refresh. [2025-10-02T17:13:14.500584] [INFO ] [REMOTE ] AMPY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:13:14.672986] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-07. [2025-10-02T17:13:14.777087] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-02T17:13:15.472983] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-10. [2025-10-02T17:13:15.536369] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-02T17:13:16.135683] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-02T17:13:16.273018] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-08. [2025-10-02T17:13:16.869518] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-02T17:13:16.872046] [INFO ] [REMOTE ] AMH: Full fetch complete (74797 records). [2025-10-02T17:13:16.872168] [DEBUG] [VALIDATOR ] AMH: Validating primary data. [2025-10-02T17:13:17.073440] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-04. [2025-10-02T17:13:17.321539] [DEBUG] [VALIDATOR ] AMH: All expected trading days are present. [2025-10-02T17:13:17.321628] [DEBUG] [VALIDATOR ] AMH: Primary data validation passed. [2025-10-02T17:13:17.322775] [INFO ] [MAIN ] AMH: Fetched primary data is valid. [2025-10-02T17:13:17.322847] [DEBUG] [LOCAL ] AMH: Saving primary data. [2025-10-02T17:13:17.324633] [DEBUG] [LOCAL ] AMH: Trimmed 74797 records to 52100 (keeping 200 days of data) [2025-10-02T17:13:17.643523] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-02T17:13:17.694955] [DEBUG] [LOCAL ] AMH: Primary data saved (52100 records). [2025-10-02T17:13:17.695107] [INFO ] [MAIN ] AMH: Full history saved. [2025-10-02T17:13:17.695194] [INFO ] [MAIN ] Update Progress: 102/2370 symbols completed. AMH took 31.2s. Estimated remaining: 4h 54m 12s. Rate: 7.7 symbols/min [2025-10-02T17:13:17.878404] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2024-12. [2025-10-02T17:13:17.880964] [INFO ] [MAIN ] AMR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:13:17.926397] [DEBUG] [LOCAL ] AMR: Loaded 28962 existing records from primary storage. [2025-10-02T17:13:17.926755] [INFO ] [MAIN ] AMR: Loaded 28962 existing records. [2025-10-02T17:13:18.126734] [WARN ] [MAIN ] AMR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:13:18.126984] [INFO ] [MAIN ] AMR: Wiping existing primary data before full refresh. [2025-10-02T17:13:18.127086] [INFO ] [LOCAL ] AMR: Starting deletion of primary data. [2025-10-02T17:13:18.127826] [DEBUG] [LOCAL ] AMR: Deleted primary data file. [2025-10-02T17:13:18.127899] [INFO ] [MAIN ] AMR: Starting full primary refresh. [2025-10-02T17:13:18.511863] [INFO ] [REMOTE ] AMR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:13:18.672999] [INFO ] [REMOTE ] AMR: Fetching primary data for 2024-12. [2025-10-02T17:13:18.983861] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-02T17:13:19.247701] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-02T17:13:19.472993] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-05. [2025-10-02T17:13:19.837831] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-02T17:13:20.273011] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-09. [2025-10-02T17:13:21.072978] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-01. [2025-10-02T17:13:21.322720] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-02T17:13:21.534415] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-02T17:13:21.872974] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-06. [2025-10-02T17:13:22.228410] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-02T17:13:22.673113] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-10. [2025-10-02T17:13:23.472985] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-02. [2025-10-02T17:13:23.671067] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-02T17:13:23.861817] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-02T17:13:23.863396] [INFO ] [REMOTE ] AMP: Full fetch complete (47621 records). [2025-10-02T17:13:23.863497] [DEBUG] [VALIDATOR ] AMP: Validating primary data. [2025-10-02T17:13:24.282461] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-07. [2025-10-02T17:13:24.379716] [DEBUG] [VALIDATOR ] AMP: All expected trading days are present. [2025-10-02T17:13:24.380733] [DEBUG] [VALIDATOR ] AMP: Primary data validation passed. [2025-10-02T17:13:24.382238] [INFO ] [MAIN ] AMP: Fetched primary data is valid. [2025-10-02T17:13:24.382381] [DEBUG] [LOCAL ] AMP: Saving primary data. [2025-10-02T17:13:24.404926] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-02T17:13:24.413064] [DEBUG] [LOCAL ] AMP: Trimmed 47621 records to 32439 (keeping 200 days of data) [2025-10-02T17:13:24.709488] [DEBUG] [LOCAL ] AMP: Primary data saved (32439 records). [2025-10-02T17:13:24.709721] [INFO ] [MAIN ] AMP: Full history saved. [2025-10-02T17:13:24.711201] [INFO ] [MAIN ] Update Progress: 103/2370 symbols completed. AMP took 35.4s. Estimated remaining: 4h 53m 47s. Rate: 7.7 symbols/min [2025-10-02T17:13:24.945012] [INFO ] [MAIN ] AMRC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:13:25.004839] [DEBUG] [LOCAL ] AMRC: Loaded 38146 existing records from primary storage. [2025-10-02T17:13:25.005321] [INFO ] [MAIN ] AMRC: Loaded 38146 existing records. [2025-10-02T17:13:25.078268] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-01. [2025-10-02T17:13:25.247337] [WARN ] [MAIN ] AMRC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:13:25.247631] [INFO ] [MAIN ] AMRC: Wiping existing primary data before full refresh. [2025-10-02T17:13:25.247720] [INFO ] [LOCAL ] AMRC: Starting deletion of primary data. [2025-10-02T17:13:25.248867] [DEBUG] [LOCAL ] AMRC: Deleted primary data file. [2025-10-02T17:13:25.249000] [INFO ] [MAIN ] AMRC: Starting full primary refresh. [2025-10-02T17:13:25.715208] [INFO ] [REMOTE ] AMRC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:13:25.872979] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2024-12. [2025-10-02T17:13:26.156326] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-02T17:13:26.184550] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-02T17:13:26.673003] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-02. [2025-10-02T17:13:27.359033] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-02T17:13:27.472993] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-01. [2025-10-02T17:13:27.830590] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-02T17:13:28.273031] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-03. [2025-10-02T17:13:28.756705] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-02T17:13:29.073052] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-08. [2025-10-02T17:13:29.317985] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-02T17:13:29.873000] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-04. [2025-10-02T17:13:30.673040] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-02. [2025-10-02T17:13:31.291333] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-02T17:13:31.473030] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-09. [2025-10-02T17:13:31.544463] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-02T17:13:31.691487] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-02T17:13:32.273003] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-03. [2025-10-02T17:13:33.073044] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-03. [2025-10-02T17:13:33.564981] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-02T17:13:33.863298] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-02T17:13:33.872949] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-04. [2025-10-02T17:13:34.636679] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-02T17:13:34.673005] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-10. [2025-10-02T17:13:35.446231] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-02T17:13:35.472964] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-05. [2025-10-02T17:13:36.272989] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-05. [2025-10-02T17:13:36.431276] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-02T17:13:36.434198] [INFO ] [REMOTE ] AMPX: Full fetch complete (74712 records). [2025-10-02T17:13:36.434375] [DEBUG] [VALIDATOR ] AMPX: Validating primary data. [2025-10-02T17:13:36.906449] [DEBUG] [VALIDATOR ] AMPX: All expected trading days are present. [2025-10-02T17:13:36.906627] [DEBUG] [VALIDATOR ] AMPX: Primary data validation passed. [2025-10-02T17:13:36.907489] [INFO ] [MAIN ] AMPX: Fetched primary data is valid. [2025-10-02T17:13:36.907542] [DEBUG] [LOCAL ] AMPX: Saving primary data. [2025-10-02T17:13:36.909113] [DEBUG] [LOCAL ] AMPX: Trimmed 74712 records to 52687 (keeping 200 days of data) [2025-10-02T17:13:37.097625] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-04. [2025-10-02T17:13:37.153298] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-02T17:13:37.270837] [DEBUG] [LOCAL ] AMPX: Primary data saved (52687 records). [2025-10-02T17:13:37.270983] [INFO ] [MAIN ] AMPX: Full history saved. [2025-10-02T17:13:37.271727] [INFO ] [MAIN ] Update Progress: 104/2370 symbols completed. AMPX took 44.9s. Estimated remaining: 4h 55m 24s. Rate: 7.7 symbols/min [2025-10-02T17:13:37.462615] [INFO ] [MAIN ] AMRZ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:13:37.462974] [DEBUG] [LOCAL ] AMRZ: No existing data file found in primary storage. [2025-10-02T17:13:37.463068] [WARN ] [MAIN ] AMRZ: No existing data found, performing full refresh instead. [2025-10-02T17:13:37.463253] [INFO ] [MAIN ] AMRZ: Wiping existing primary data before full refresh. [2025-10-02T17:13:37.463304] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-02T17:13:37.463368] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-02T17:13:37.463432] [INFO ] [MAIN ] AMRZ: Starting full primary refresh. [2025-10-02T17:13:37.881548] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-06. [2025-10-02T17:13:37.941318] [INFO ] [REMOTE ] AMRZ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:13:37.965149] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-02T17:13:38.176575] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-02T17:13:38.673036] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2024-12. [2025-10-02T17:13:38.884531] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T17:13:38.884923] [WARN ] [REMOTE ] AMRZ: No data returned for month 2024-12 [2025-10-02T17:13:38.885027] [FATAL] [REMOTE ] AMRZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T17:13:38.885078] [FATAL] [MAIN ] AMRZ: Failed to fetch primary data. [2025-10-02T17:13:38.885113] [WARN ] [MAIN ] AMRZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T17:13:38.885187] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-02T17:13:38.885271] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-02T17:13:38.885327] [INFO ] [LOCAL ] AMRZ: Starting deletion of derivative data. [2025-10-02T17:13:38.885389] [DEBUG] [LOCAL ] AMRZ: No derivative data file found to delete. [2025-10-02T17:13:38.885457] [INFO ] [MAIN ] Update Progress: 105/2370 symbols completed. AMRZ took 1.6s. Estimated remaining: 4h 53m 2s. Rate: 7.7 symbols/min [2025-10-02T17:13:39.081226] [INFO ] [MAIN ] AMT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:13:39.140481] [DEBUG] [LOCAL ] AMT: Loaded 52425 existing records from primary storage. [2025-10-02T17:13:39.140867] [INFO ] [MAIN ] AMT: Loaded 52425 existing records. [2025-10-02T17:13:39.349424] [WARN ] [MAIN ] AMT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:13:39.366865] [INFO ] [MAIN ] AMT: Wiping existing primary data before full refresh. [2025-10-02T17:13:39.367573] [INFO ] [LOCAL ] AMT: Starting deletion of primary data. [2025-10-02T17:13:39.368310] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-02T17:13:39.370741] [DEBUG] [LOCAL ] AMT: Deleted primary data file. [2025-10-02T17:13:39.375255] [INFO ] [MAIN ] AMT: Starting full primary refresh. [2025-10-02T17:13:39.478147] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-05. [2025-10-02T17:13:39.804276] [INFO ] [REMOTE ] AMT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:13:40.273043] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-07. [2025-10-02T17:13:40.828399] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-02T17:13:41.072998] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-06. [2025-10-02T17:13:41.674579] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-02T17:13:41.872995] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-06. [2025-10-02T17:13:42.457078] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-02T17:13:42.672999] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-08. [2025-10-02T17:13:43.435948] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-02T17:13:43.472963] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-07. [2025-10-02T17:13:44.069311] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-02T17:13:44.273015] [INFO ] [REMOTE ] AMT: Fetching primary data for 2024-12. [2025-10-02T17:13:45.065499] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-02T17:13:45.073638] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-07. [2025-10-02T17:13:45.650430] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-02T17:13:45.872984] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-01. [2025-10-02T17:13:46.672991] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-09. [2025-10-02T17:13:46.768244] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-02T17:13:47.473036] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-08. [2025-10-02T17:13:47.867619] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-02T17:13:47.955270] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-02T17:13:48.273011] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-08. [2025-10-02T17:13:48.860828] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-02T17:13:49.073000] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-10. [2025-10-02T17:13:49.143344] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-02T17:13:49.872998] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-09. [2025-10-02T17:13:50.259736] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-02T17:13:50.261426] [INFO ] [REMOTE ] AMRC: Full fetch complete (53061 records). [2025-10-02T17:13:50.261511] [DEBUG] [VALIDATOR ] AMRC: Validating primary data. [2025-10-02T17:13:50.667091] [DEBUG] [VALIDATOR ] AMRC: All expected trading days are present. [2025-10-02T17:13:50.667405] [DEBUG] [VALIDATOR ] AMRC: Primary data validation passed. [2025-10-02T17:13:50.668122] [INFO ] [MAIN ] AMRC: Fetched primary data is valid. [2025-10-02T17:13:50.668188] [DEBUG] [LOCAL ] AMRC: Saving primary data. [2025-10-02T17:13:50.669423] [DEBUG] [LOCAL ] AMRC: Trimmed 53061 records to 38431 (keeping 200 days of data) [2025-10-02T17:13:50.673012] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-09. [2025-10-02T17:13:50.904866] [DEBUG] [LOCAL ] AMRC: Primary data saved (38431 records). [2025-10-02T17:13:50.905069] [INFO ] [MAIN ] AMRC: Full history saved. [2025-10-02T17:13:50.905237] [INFO ] [MAIN ] Update Progress: 106/2370 symbols completed. AMRC took 26.2s. Estimated remaining: 4h 54m 25s. Rate: 7.7 symbols/min [2025-10-02T17:13:51.107728] [INFO ] [MAIN ] AMTB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:13:51.109570] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-02T17:13:51.137845] [DEBUG] [LOCAL ] AMTB: Loaded 20347 existing records from primary storage. [2025-10-02T17:13:51.138190] [INFO ] [MAIN ] AMTB: Loaded 20347 existing records. [2025-10-02T17:13:51.345131] [WARN ] [MAIN ] AMTB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:13:51.345357] [INFO ] [MAIN ] AMTB: Wiping existing primary data before full refresh. [2025-10-02T17:13:51.345408] [INFO ] [LOCAL ] AMTB: Starting deletion of primary data. [2025-10-02T17:13:51.346233] [DEBUG] [LOCAL ] AMTB: Deleted primary data file. [2025-10-02T17:13:51.346297] [INFO ] [MAIN ] AMTB: Starting full primary refresh. [2025-10-02T17:13:51.478142] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-10. [2025-10-02T17:13:51.773007] [INFO ] [REMOTE ] AMTB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:13:52.273001] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2024-12. [2025-10-02T17:13:52.306197] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-02T17:13:52.445801] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-02T17:13:52.447249] [INFO ] [REMOTE ] AMR: Full fetch complete (40101 records). [2025-10-02T17:13:52.447334] [DEBUG] [VALIDATOR ] AMR: Validating primary data. [2025-10-02T17:13:52.866531] [DEBUG] [VALIDATOR ] AMR: All expected trading days are present. [2025-10-02T17:13:52.866615] [DEBUG] [VALIDATOR ] AMR: Primary data validation passed. [2025-10-02T17:13:52.867146] [INFO ] [MAIN ] AMR: Fetched primary data is valid. [2025-10-02T17:13:52.867206] [DEBUG] [LOCAL ] AMR: Saving primary data. [2025-10-02T17:13:52.868284] [DEBUG] [LOCAL ] AMR: Trimmed 40101 records to 29181 (keeping 200 days of data) [2025-10-02T17:13:53.051851] [DEBUG] [LOCAL ] AMR: Primary data saved (29181 records). [2025-10-02T17:13:53.052003] [INFO ] [MAIN ] AMR: Full history saved. [2025-10-02T17:13:53.052134] [INFO ] [MAIN ] Update Progress: 107/2370 symbols completed. AMR took 35.4s. Estimated remaining: 4h 52m 18s. Rate: 7.7 symbols/min [2025-10-02T17:13:53.083440] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-10. [2025-10-02T17:13:53.248620] [INFO ] [MAIN ] AMTD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:13:53.254722] [DEBUG] [LOCAL ] AMTD: Loaded 3610 existing records from primary storage. [2025-10-02T17:13:53.254944] [INFO ] [MAIN ] AMTD: Loaded 3610 existing records. [2025-10-02T17:13:53.477671] [WARN ] [MAIN ] AMTD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:13:53.477968] [INFO ] [MAIN ] AMTD: Wiping existing primary data before full refresh. [2025-10-02T17:13:53.478109] [INFO ] [LOCAL ] AMTD: Starting deletion of primary data. [2025-10-02T17:13:53.478489] [DEBUG] [LOCAL ] AMTD: Deleted primary data file. [2025-10-02T17:13:53.478552] [INFO ] [MAIN ] AMTD: Starting full primary refresh. [2025-10-02T17:13:53.696468] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-02T17:13:53.878092] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-02. [2025-10-02T17:13:53.909284] [INFO ] [REMOTE ] AMTD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:13:54.221785] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-02T17:13:54.224519] [INFO ] [REMOTE ] AMPY: Full fetch complete (51441 records). [2025-10-02T17:13:54.224618] [DEBUG] [VALIDATOR ] AMPY: Validating primary data. [2025-10-02T17:13:54.664850] [DEBUG] [VALIDATOR ] AMPY: All expected trading days are present. [2025-10-02T17:13:54.664969] [DEBUG] [VALIDATOR ] AMPY: Primary data validation passed. [2025-10-02T17:13:54.665575] [INFO ] [MAIN ] AMPY: Fetched primary data is valid. [2025-10-02T17:13:54.665692] [DEBUG] [LOCAL ] AMPY: Saving primary data. [2025-10-02T17:13:54.667436] [DEBUG] [LOCAL ] AMPY: Trimmed 51441 records to 38186 (keeping 200 days of data) [2025-10-02T17:13:54.673049] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2024-12. [2025-10-02T17:13:54.902943] [DEBUG] [LOCAL ] AMPY: Primary data saved (38186 records). [2025-10-02T17:13:54.903092] [INFO ] [MAIN ] AMPY: Full history saved. [2025-10-02T17:13:54.904270] [INFO ] [MAIN ] Update Progress: 108/2370 symbols completed. AMPY took 41.3s. Estimated remaining: 4h 50m 7s. Rate: 7.8 symbols/min [2025-10-02T17:13:55.091440] [INFO ] [MAIN ] AMTM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:13:55.150154] [DEBUG] [LOCAL ] AMTM: Loaded 50643 existing records from primary storage. [2025-10-02T17:13:55.150494] [INFO ] [MAIN ] AMTM: Loaded 50643 existing records. [2025-10-02T17:13:55.353865] [WARN ] [MAIN ] AMTM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:13:55.354185] [INFO ] [MAIN ] AMTM: Wiping existing primary data before full refresh. [2025-10-02T17:13:55.354252] [INFO ] [LOCAL ] AMTM: Starting deletion of primary data. [2025-10-02T17:13:55.355489] [DEBUG] [LOCAL ] AMTM: Deleted primary data file. [2025-10-02T17:13:55.355553] [INFO ] [MAIN ] AMTM: Starting full primary refresh. [2025-10-02T17:13:55.472928] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-02T17:13:55.473037] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-01. [2025-10-02T17:13:55.751679] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-02T17:13:55.843947] [INFO ] [REMOTE ] AMTM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:13:56.273047] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2024-12. [2025-10-02T17:13:56.578266] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-02T17:13:57.073017] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-02. [2025-10-02T17:13:57.873006] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-03. [2025-10-02T17:13:58.184312] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-02T17:13:58.185412] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-02T17:13:58.673046] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-01. [2025-10-02T17:13:59.132037] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-02T17:13:59.472972] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-02. [2025-10-02T17:13:59.511081] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-02T17:14:00.061758] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-02T17:14:00.273010] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-01. [2025-10-02T17:14:01.073014] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-04. [2025-10-02T17:14:01.872980] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-03. [2025-10-02T17:14:02.025754] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-02T17:14:02.338152] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-02T17:14:02.651306] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-02T17:14:02.672969] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-05. [2025-10-02T17:14:03.473003] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-02. [2025-10-02T17:14:04.273028] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-03. [2025-10-02T17:14:04.557501] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-02T17:14:05.072976] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-06. [2025-10-02T17:14:05.152613] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-02T17:14:05.177515] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-02T17:14:05.872999] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-03. [2025-10-02T17:14:06.645057] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-02T17:14:06.672967] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-07. [2025-10-02T17:14:07.275258] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-02T17:14:07.473004] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-04. [2025-10-02T17:14:08.273001] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-04. [2025-10-02T17:14:08.576624] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-02T17:14:08.751713] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-02T17:14:08.767133] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-02T17:14:09.072997] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-05. [2025-10-02T17:14:09.872998] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-05. [2025-10-02T17:14:10.406623] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-02T17:14:10.494983] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-02T17:14:10.672998] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-04. [2025-10-02T17:14:11.473021] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-08. [2025-10-02T17:14:11.761577] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-02T17:14:12.273014] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-06. [2025-10-02T17:14:13.072963] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-05. [2025-10-02T17:14:13.297595] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-02T17:14:13.872976] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-06. [2025-10-02T17:14:14.074246] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-02T17:14:14.131302] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-02T17:14:14.616054] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-02T17:14:14.673004] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-07. [2025-10-02T17:14:15.473005] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-06. [2025-10-02T17:14:16.197341] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-02T17:14:16.272988] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-07. [2025-10-02T17:14:16.544693] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-02T17:14:16.809921] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-02T17:14:17.073049] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-08. [2025-10-02T17:14:17.659605] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-02T17:14:17.872999] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-07. [2025-10-02T17:14:18.673012] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-08. [2025-10-02T17:14:19.167427] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-02T17:14:19.473017] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-08. [2025-10-02T17:14:20.271206] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-02T17:14:20.281324] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-09. [2025-10-02T17:14:20.534225] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-02T17:14:21.073016] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-09. [2025-10-02T17:14:21.829687] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-02T17:14:21.872984] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-10. [2025-10-02T17:14:21.976591] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-02T17:14:22.586841] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-02T17:14:22.588201] [INFO ] [REMOTE ] AMTB: Full fetch complete (29908 records). [2025-10-02T17:14:22.588278] [DEBUG] [VALIDATOR ] AMTB: Validating primary data. [2025-10-02T17:14:22.678189] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-10. [2025-10-02T17:14:23.002470] [DEBUG] [VALIDATOR ] AMTB: All expected trading days are present. [2025-10-02T17:14:23.002582] [DEBUG] [VALIDATOR ] AMTB: Primary data validation passed. [2025-10-02T17:14:23.003018] [INFO ] [MAIN ] AMTB: Fetched primary data is valid. [2025-10-02T17:14:23.003081] [DEBUG] [LOCAL ] AMTB: Saving primary data. [2025-10-02T17:14:23.004146] [DEBUG] [LOCAL ] AMTB: Trimmed 29908 records to 20465 (keeping 200 days of data) [2025-10-02T17:14:23.133093] [DEBUG] [LOCAL ] AMTB: Primary data saved (20465 records). [2025-10-02T17:14:23.133222] [INFO ] [MAIN ] AMTB: Full history saved. [2025-10-02T17:14:23.133305] [INFO ] [MAIN ] Update Progress: 109/2370 symbols completed. AMTB took 32.2s. Estimated remaining: 4h 57m 5s. Rate: 7.6 symbols/min [2025-10-02T17:14:23.324167] [INFO ] [MAIN ] AMWL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:14:23.334186] [DEBUG] [LOCAL ] AMWL: Loaded 8847 existing records from primary storage. [2025-10-02T17:14:23.334406] [INFO ] [MAIN ] AMWL: Loaded 8847 existing records. [2025-10-02T17:14:23.478149] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-09. [2025-10-02T17:14:23.537730] [WARN ] [MAIN ] AMWL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:14:23.538240] [INFO ] [MAIN ] AMWL: Wiping existing primary data before full refresh. [2025-10-02T17:14:23.538298] [INFO ] [LOCAL ] AMWL: Starting deletion of primary data. [2025-10-02T17:14:23.538639] [DEBUG] [LOCAL ] AMWL: Deleted primary data file. [2025-10-02T17:14:23.538728] [INFO ] [MAIN ] AMWL: Starting full primary refresh. [2025-10-02T17:14:23.947424] [INFO ] [REMOTE ] AMWL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:14:24.273005] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2024-12. [2025-10-02T17:14:24.313881] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-02T17:14:24.449093] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-02T17:14:24.454050] [INFO ] [REMOTE ] AMT: Full fetch complete (76012 records). [2025-10-02T17:14:24.454194] [DEBUG] [VALIDATOR ] AMT: Validating primary data. [2025-10-02T17:14:24.894071] [DEBUG] [VALIDATOR ] AMT: All expected trading days are present. [2025-10-02T17:14:24.894169] [DEBUG] [VALIDATOR ] AMT: Primary data validation passed. [2025-10-02T17:14:24.895010] [INFO ] [MAIN ] AMT: Fetched primary data is valid. [2025-10-02T17:14:24.895079] [DEBUG] [LOCAL ] AMT: Saving primary data. [2025-10-02T17:14:24.896766] [DEBUG] [LOCAL ] AMT: Trimmed 76012 records to 52808 (keeping 200 days of data) [2025-10-02T17:14:25.008450] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-02T17:14:25.108305] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-10. [2025-10-02T17:14:25.273616] [DEBUG] [LOCAL ] AMT: Primary data saved (52808 records). [2025-10-02T17:14:25.273800] [INFO ] [MAIN ] AMT: Full history saved. [2025-10-02T17:14:25.274460] [INFO ] [MAIN ] Update Progress: 110/2370 symbols completed. AMT took 46.4s. Estimated remaining: 4h 54m 59s. Rate: 7.7 symbols/min [2025-10-02T17:14:25.466814] [INFO ] [MAIN ] AMX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:14:25.517568] [DEBUG] [LOCAL ] AMX: Loaded 49131 existing records from primary storage. [2025-10-02T17:14:25.517941] [INFO ] [MAIN ] AMX: Loaded 49131 existing records. [2025-10-02T17:14:25.729327] [WARN ] [MAIN ] AMX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:14:25.729620] [INFO ] [MAIN ] AMX: Wiping existing primary data before full refresh. [2025-10-02T17:14:25.729723] [INFO ] [LOCAL ] AMX: Starting deletion of primary data. [2025-10-02T17:14:25.731102] [DEBUG] [LOCAL ] AMX: Deleted primary data file. [2025-10-02T17:14:25.731167] [INFO ] [MAIN ] AMX: Starting full primary refresh. [2025-10-02T17:14:25.774544] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-02T17:14:25.805285] [INFO ] [REMOTE ] AMTD: Full fetch complete (5587 records). [2025-10-02T17:14:25.833303] [DEBUG] [VALIDATOR ] AMTD: Validating primary data. [2025-10-02T17:14:25.882434] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-09. [2025-10-02T17:14:26.529501] [INFO ] [REMOTE ] AMX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:14:26.618340] [DEBUG] [VALIDATOR ] AMTD: All expected trading days are present. [2025-10-02T17:14:26.618426] [DEBUG] [VALIDATOR ] AMTD: Primary data validation passed. [2025-10-02T17:14:26.618583] [INFO ] [MAIN ] AMTD: Fetched primary data is valid. [2025-10-02T17:14:26.618622] [DEBUG] [LOCAL ] AMTD: Saving primary data. [2025-10-02T17:14:26.619101] [DEBUG] [LOCAL ] AMTD: Trimmed 5587 records to 3668 (keeping 200 days of data) [2025-10-02T17:14:26.640370] [DEBUG] [LOCAL ] AMTD: Primary data saved (3668 records). [2025-10-02T17:14:26.640488] [INFO ] [MAIN ] AMTD: Full history saved. [2025-10-02T17:14:26.640572] [INFO ] [MAIN ] Update Progress: 111/2370 symbols completed. AMTD took 33.6s. Estimated remaining: 4h 52m 40s. Rate: 7.7 symbols/min [2025-10-02T17:14:26.678289] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-01. [2025-10-02T17:14:26.859337] [INFO ] [MAIN ] AN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:14:26.859528] [DEBUG] [LOCAL ] AN: No existing data file found in primary storage. [2025-10-02T17:14:26.859580] [WARN ] [MAIN ] AN: No existing data found, performing full refresh instead. [2025-10-02T17:14:26.859722] [INFO ] [MAIN ] AN: Wiping existing primary data before full refresh. [2025-10-02T17:14:26.859771] [INFO ] [LOCAL ] AN: Starting deletion of primary data. [2025-10-02T17:14:26.859823] [DEBUG] [LOCAL ] AN: No primary data file found to delete. [2025-10-02T17:14:26.859871] [INFO ] [MAIN ] AN: Starting full primary refresh. [2025-10-02T17:14:27.303620] [INFO ] [REMOTE ] AN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:14:27.472983] [INFO ] [REMOTE ] AN: Fetching primary data for 2024-12. [2025-10-02T17:14:27.625067] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-02T17:14:27.660002] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-02T17:14:28.273007] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-10. [2025-10-02T17:14:28.679720] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-02T17:14:29.073000] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-01. [2025-10-02T17:14:29.593416] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-02T17:14:29.595582] [INFO ] [REMOTE ] AMTM: Full fetch complete (73983 records). [2025-10-02T17:14:29.595791] [DEBUG] [VALIDATOR ] AMTM: Validating primary data. [2025-10-02T17:14:29.884503] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-02. [2025-10-02T17:14:30.038571] [DEBUG] [VALIDATOR ] AMTM: All expected trading days are present. [2025-10-02T17:14:30.038692] [DEBUG] [VALIDATOR ] AMTM: Primary data validation passed. [2025-10-02T17:14:30.039489] [INFO ] [MAIN ] AMTM: Fetched primary data is valid. [2025-10-02T17:14:30.039560] [DEBUG] [LOCAL ] AMTM: Saving primary data. [2025-10-02T17:14:30.041271] [DEBUG] [LOCAL ] AMTM: Trimmed 73983 records to 51033 (keeping 200 days of data) [2025-10-02T17:14:30.358693] [DEBUG] [LOCAL ] AMTM: Primary data saved (51033 records). [2025-10-02T17:14:30.358842] [INFO ] [MAIN ] AMTM: Full history saved. [2025-10-02T17:14:30.359871] [INFO ] [MAIN ] Update Progress: 112/2370 symbols completed. AMTM took 35.5s. Estimated remaining: 4h 51m 10s. Rate: 7.8 symbols/min [2025-10-02T17:14:30.563442] [INFO ] [MAIN ] ANET: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:14:30.594617] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-02T17:14:30.661111] [DEBUG] [LOCAL ] ANET: Loaded 53766 existing records from primary storage. [2025-10-02T17:14:30.661441] [INFO ] [MAIN ] ANET: Loaded 53766 existing records. [2025-10-02T17:14:30.682790] [INFO ] [REMOTE ] AMX: Fetching primary data for 2024-12. [2025-10-02T17:14:30.810863] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-02T17:14:30.877621] [WARN ] [MAIN ] ANET: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:14:30.877862] [INFO ] [MAIN ] ANET: Wiping existing primary data before full refresh. [2025-10-02T17:14:30.877911] [INFO ] [LOCAL ] ANET: Starting deletion of primary data. [2025-10-02T17:14:30.879298] [DEBUG] [LOCAL ] ANET: Deleted primary data file. [2025-10-02T17:14:30.879359] [INFO ] [MAIN ] ANET: Starting full primary refresh. [2025-10-02T17:14:31.271633] [INFO ] [REMOTE ] ANET: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:14:31.473042] [INFO ] [REMOTE ] ANET: Fetching primary data for 2024-12. [2025-10-02T17:14:32.273039] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-03. [2025-10-02T17:14:32.335565] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-02T17:14:32.973678] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-02T17:14:33.073021] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-04. [2025-10-02T17:14:33.760979] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-10-02T17:14:33.872976] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-01. [2025-10-02T17:14:33.887401] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-02T17:14:34.673002] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-02. [2025-10-02T17:14:35.473026] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-05. [2025-10-02T17:14:35.879926] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-02T17:14:36.137792] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-02T17:14:36.273034] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-02. [2025-10-02T17:14:36.460375] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-02T17:14:37.073013] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-01. [2025-10-02T17:14:37.873013] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-06. [2025-10-02T17:14:38.527729] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-10-02T17:14:38.610284] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-02T17:14:38.645013] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-02T17:14:38.672985] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-07. [2025-10-02T17:14:39.253312] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-02T17:14:39.473002] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-08. [2025-10-02T17:14:40.228316] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-02T17:14:40.273060] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-03. [2025-10-02T17:14:41.073044] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-03. [2025-10-02T17:14:41.873023] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-09. [2025-10-02T17:14:42.022718] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-02T17:14:42.607541] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-02T17:14:42.673037] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-02. [2025-10-02T17:14:43.128413] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-02T17:14:43.473044] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-04. [2025-10-02T17:14:44.231559] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-02T17:14:44.273032] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-04. [2025-10-02T17:14:45.073049] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-10. [2025-10-02T17:14:45.726984] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-02T17:14:45.728215] [INFO ] [REMOTE ] AMWL: Full fetch complete (14114 records). [2025-10-02T17:14:45.728290] [DEBUG] [VALIDATOR ] AMWL: Validating primary data. [2025-10-02T17:14:45.884302] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-03. [2025-10-02T17:14:45.928958] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-02T17:14:46.179246] [DEBUG] [VALIDATOR ] AMWL: All expected trading days are present. [2025-10-02T17:14:46.179516] [DEBUG] [VALIDATOR ] AMWL: Primary data validation passed. [2025-10-02T17:14:46.180121] [INFO ] [MAIN ] AMWL: Fetched primary data is valid. [2025-10-02T17:14:46.180206] [DEBUG] [LOCAL ] AMWL: Saving primary data. [2025-10-02T17:14:46.181098] [DEBUG] [LOCAL ] AMWL: Trimmed 14114 records to 8926 (keeping 200 days of data) [2025-10-02T17:14:46.260108] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-04 (2.79 seconds). [2025-10-02T17:14:46.288085] [DEBUG] [LOCAL ] AMWL: Primary data saved (8926 records). [2025-10-02T17:14:46.288313] [INFO ] [MAIN ] AMWL: Full history saved. [2025-10-02T17:14:46.288431] [INFO ] [MAIN ] Update Progress: 113/2370 symbols completed. AMWL took 23.2s. Estimated remaining: 4h 53m 46s. Rate: 7.7 symbols/min [2025-10-02T17:14:46.475589] [INFO ] [MAIN ] ANF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:14:46.533928] [DEBUG] [LOCAL ] ANF: Loaded 52129 existing records from primary storage. [2025-10-02T17:14:46.534349] [INFO ] [MAIN ] ANF: Loaded 52129 existing records. [2025-10-02T17:14:46.678191] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-05. [2025-10-02T17:14:46.756320] [WARN ] [MAIN ] ANF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:14:46.756569] [INFO ] [MAIN ] ANF: Wiping existing primary data before full refresh. [2025-10-02T17:14:46.756620] [INFO ] [LOCAL ] ANF: Starting deletion of primary data. [2025-10-02T17:14:46.757889] [DEBUG] [LOCAL ] ANF: Deleted primary data file. [2025-10-02T17:14:46.757999] [INFO ] [MAIN ] ANF: Starting full primary refresh. [2025-10-02T17:14:47.158704] [INFO ] [REMOTE ] ANF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:14:47.418907] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-02T17:14:47.473009] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-04. [2025-10-02T17:14:48.273026] [INFO ] [REMOTE ] ANF: Fetching primary data for 2024-12. [2025-10-02T17:14:48.805483] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-02T17:14:49.072989] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-06. [2025-10-02T17:14:49.173288] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-02T17:14:49.873031] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-05. [2025-10-02T17:14:50.341125] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-02T17:14:50.673112] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-01. [2025-10-02T17:14:51.102443] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-02T17:14:51.364986] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-02T17:14:51.473029] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-05. [2025-10-02T17:14:52.214724] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-02T17:14:52.272979] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-02. [2025-10-02T17:14:52.972427] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-02T17:14:53.073034] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-07. [2025-10-02T17:14:53.804666] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-02T17:14:53.872980] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-03. [2025-10-02T17:14:54.673046] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-06. [2025-10-02T17:14:55.480692] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-06. [2025-10-02T17:14:55.489104] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-10-02T17:14:55.921732] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-02T17:14:56.133385] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-02T17:14:56.273041] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-04. [2025-10-02T17:14:56.894847] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-02T17:14:57.073031] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-07. [2025-10-02T17:14:57.834810] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-02T17:14:57.872954] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-05. [2025-10-02T17:14:58.681596] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-08. [2025-10-02T17:14:58.686334] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-02T17:14:59.472991] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-08. [2025-10-02T17:14:59.816882] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-02T17:15:00.273028] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-06. [2025-10-02T17:15:01.073073] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-07. [2025-10-02T17:15:01.501198] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-02T17:15:01.570759] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-08 (2.89 seconds). [2025-10-02T17:15:01.873037] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-09. [2025-10-02T17:15:02.146059] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-02T17:15:02.354839] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-02T17:15:02.673005] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-09. [2025-10-02T17:15:03.473012] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-07. [2025-10-02T17:15:04.114869] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-02T17:15:04.273001] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-08. [2025-10-02T17:15:04.500778] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-09 (2.63 seconds). [2025-10-02T17:15:05.010147] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-02T17:15:05.073011] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-08. [2025-10-02T17:15:05.712451] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-02T17:15:05.872996] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-09. [2025-10-02T17:15:06.673031] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-10. [2025-10-02T17:15:06.999868] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-02T17:15:07.110455] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-02T17:15:07.473013] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-10. [2025-10-02T17:15:08.273036] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-10. [2025-10-02T17:15:08.405879] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-02T17:15:08.407203] [INFO ] [REMOTE ] AN: Full fetch complete (47439 records). [2025-10-02T17:15:08.407288] [DEBUG] [VALIDATOR ] AN: Validating primary data. [2025-10-02T17:15:08.407947] [FATAL] [VALIDATOR ] AN: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:15:08.408080] [FATAL] [MAIN ] AN: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:15:08.408148] [WARN ] [MAIN ] AN: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:15:08.408218] [INFO ] [LOCAL ] AN: Starting deletion of primary data. [2025-10-02T17:15:08.408281] [DEBUG] [LOCAL ] AN: No primary data file found to delete. [2025-10-02T17:15:08.408317] [INFO ] [LOCAL ] AN: Starting deletion of derivative data. [2025-10-02T17:15:08.408374] [DEBUG] [LOCAL ] AN: No derivative data file found to delete. [2025-10-02T17:15:08.408466] [INFO ] [MAIN ] Update Progress: 114/2370 symbols completed. AN took 41.8s. Estimated remaining: 4h 58m 21s. Rate: 7.6 symbols/min [2025-10-02T17:15:08.622031] [INFO ] [MAIN ] ANGX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:15:08.622236] [DEBUG] [LOCAL ] ANGX: No existing data file found in primary storage. [2025-10-02T17:15:08.622421] [WARN ] [MAIN ] ANGX: No existing data found, performing full refresh instead. [2025-10-02T17:15:08.627381] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-02T17:15:08.629210] [INFO ] [MAIN ] ANGX: Wiping existing primary data before full refresh. [2025-10-02T17:15:08.629974] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-02T17:15:08.630223] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-02T17:15:08.630338] [INFO ] [MAIN ] ANGX: Starting full primary refresh. [2025-10-02T17:15:08.635889] [INFO ] [REMOTE ] ANET: Full fetch complete (77860 records). [2025-10-02T17:15:08.684987] [DEBUG] [VALIDATOR ] ANET: Validating primary data. [2025-10-02T17:15:09.103720] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-09. [2025-10-02T17:15:09.615737] [INFO ] [REMOTE ] ANGX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:15:09.631172] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-02T17:15:09.661897] [INFO ] [REMOTE ] AMX: Full fetch complete (70751 records). [2025-10-02T17:15:09.683399] [DEBUG] [VALIDATOR ] AMX: Validating primary data. [2025-10-02T17:15:09.884150] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2024-12. [2025-10-02T17:15:09.901056] [DEBUG] [VALIDATOR ] ANET: All expected trading days are present. [2025-10-02T17:15:09.916053] [DEBUG] [VALIDATOR ] ANET: Primary data validation passed. [2025-10-02T17:15:09.946061] [INFO ] [MAIN ] ANET: Fetched primary data is valid. [2025-10-02T17:15:09.958327] [DEBUG] [LOCAL ] ANET: Saving primary data. [2025-10-02T17:15:10.028520] [DEBUG] [LOCAL ] ANET: Trimmed 77860 records to 54156 (keeping 200 days of data) [2025-10-02T17:15:10.232168] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T17:15:10.277248] [WARN ] [REMOTE ] ANGX: No data returned for month 2024-12 [2025-10-02T17:15:10.301511] [FATAL] [REMOTE ] ANGX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T17:15:10.303800] [FATAL] [MAIN ] ANGX: Failed to fetch primary data. [2025-10-02T17:15:10.329041] [WARN ] [MAIN ] ANGX: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T17:15:10.336473] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-02T17:15:10.399036] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-02T17:15:10.424402] [INFO ] [LOCAL ] ANGX: Starting deletion of derivative data. [2025-10-02T17:15:10.432278] [DEBUG] [LOCAL ] ANGX: No derivative data file found to delete. [2025-10-02T17:15:10.432720] [DEBUG] [VALIDATOR ] AMX: All expected trading days are present. [2025-10-02T17:15:10.432856] [INFO ] [MAIN ] Update Progress: 115/2370 symbols completed. ANGX took 2.0s. Estimated remaining: 4h 56m 18s. Rate: 7.6 symbols/min [2025-10-02T17:15:10.432997] [DEBUG] [VALIDATOR ] AMX: Primary data validation passed. [2025-10-02T17:15:10.443295] [INFO ] [MAIN ] AMX: Fetched primary data is valid. [2025-10-02T17:15:10.452411] [DEBUG] [LOCAL ] AMX: Saving primary data. [2025-10-02T17:15:10.556701] [DEBUG] [LOCAL ] AMX: Trimmed 70751 records to 49493 (keeping 200 days of data) [2025-10-02T17:15:10.838310] [INFO ] [MAIN ] ANRO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:15:10.886466] [DEBUG] [LOCAL ] ANRO: Loaded 18746 existing records from primary storage. [2025-10-02T17:15:10.890503] [INFO ] [MAIN ] ANRO: Loaded 18746 existing records. [2025-10-02T17:15:11.135850] [WARN ] [MAIN ] ANRO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:15:11.183198] [INFO ] [MAIN ] ANRO: Wiping existing primary data before full refresh. [2025-10-02T17:15:11.203276] [INFO ] [LOCAL ] ANRO: Starting deletion of primary data. [2025-10-02T17:15:11.206700] [DEBUG] [LOCAL ] ANRO: Deleted primary data file. [2025-10-02T17:15:11.207582] [INFO ] [MAIN ] ANRO: Starting full primary refresh. [2025-10-02T17:15:11.395438] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-10-02T17:15:11.461085] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-10. [2025-10-02T17:15:11.834448] [INFO ] [REMOTE ] ANRO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:15:11.835955] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2024-12. [2025-10-02T17:15:11.843956] [DEBUG] [LOCAL ] ANET: Primary data saved (54156 records). [2025-10-02T17:15:11.844573] [INFO ] [MAIN ] ANET: Full history saved. [2025-10-02T17:15:11.849002] [INFO ] [MAIN ] Update Progress: 116/2370 symbols completed. ANET took 41.5s. Estimated remaining: 4h 54m 4s. Rate: 7.7 symbols/min [2025-10-02T17:15:12.076976] [INFO ] [MAIN ] ANVS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:15:12.162595] [DEBUG] [LOCAL ] AMX: Primary data saved (49493 records). [2025-10-02T17:15:12.170720] [INFO ] [MAIN ] AMX: Full history saved. [2025-10-02T17:15:12.170944] [INFO ] [MAIN ] Update Progress: 117/2370 symbols completed. AMX took 46.9s. Estimated remaining: 4h 51m 32s. Rate: 7.7 symbols/min [2025-10-02T17:15:12.172737] [DEBUG] [LOCAL ] ANVS: Loaded 23194 existing records from primary storage. [2025-10-02T17:15:12.172959] [INFO ] [MAIN ] ANVS: Loaded 23194 existing records. [2025-10-02T17:15:12.365033] [WARN ] [MAIN ] ANVS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:15:12.365248] [INFO ] [MAIN ] ANVS: Wiping existing primary data before full refresh. [2025-10-02T17:15:12.365298] [INFO ] [LOCAL ] ANVS: Starting deletion of primary data. [2025-10-02T17:15:12.366266] [DEBUG] [LOCAL ] ANVS: Deleted primary data file. [2025-10-02T17:15:12.366331] [INFO ] [MAIN ] ANVS: Starting full primary refresh. [2025-10-02T17:15:12.751888] [INFO ] [REMOTE ] ANVS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:15:12.752218] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2024-12. [2025-10-02T17:15:12.911980] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-02T17:15:12.913575] [INFO ] [REMOTE ] ANF: Full fetch complete (75226 records). [2025-10-02T17:15:12.913733] [DEBUG] [VALIDATOR ] ANF: Validating primary data. [2025-10-02T17:15:12.914618] [FATAL] [VALIDATOR ] ANF: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:15:12.914739] [FATAL] [MAIN ] ANF: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:15:12.914783] [WARN ] [MAIN ] ANF: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:15:12.914854] [INFO ] [LOCAL ] ANF: Starting deletion of primary data. [2025-10-02T17:15:12.914921] [DEBUG] [LOCAL ] ANF: No primary data file found to delete. [2025-10-02T17:15:12.914963] [INFO ] [LOCAL ] ANF: Starting deletion of derivative data. [2025-10-02T17:15:12.915567] [DEBUG] [LOCAL ] ANF: Deleted derivative data file. [2025-10-02T17:15:12.915690] [INFO ] [MAIN ] Update Progress: 118/2370 symbols completed. ANF took 26.6s. Estimated remaining: 4h 49m 10s. Rate: 7.8 symbols/min [2025-10-02T17:15:13.312252] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-02T17:15:13.319295] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-01. [2025-10-02T17:15:14.310728] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-02T17:15:14.315358] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-02. [2025-10-02T17:15:14.430888] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-02T17:15:14.673000] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-01. [2025-10-02T17:15:15.380220] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-02T17:15:15.473031] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-03. [2025-10-02T17:15:15.989893] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-02T17:15:16.273116] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-02. [2025-10-02T17:15:16.652717] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-02T17:15:17.073021] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-04. [2025-10-02T17:15:17.559578] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-02T17:15:17.872984] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-03. [2025-10-02T17:15:17.914982] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-02T17:15:18.673009] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-05. [2025-10-02T17:15:18.922408] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-02T17:15:19.472980] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-04. [2025-10-02T17:15:19.686106] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-02T17:15:20.273063] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-06. [2025-10-02T17:15:20.625530] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-02T17:15:21.073019] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-05. [2025-10-02T17:15:21.537419] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-02T17:15:21.873031] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-07. [2025-10-02T17:15:22.388004] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-02T17:15:22.632159] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-02T17:15:22.673014] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-08. [2025-10-02T17:15:23.473044] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-06. [2025-10-02T17:15:23.808595] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-02T17:15:24.273053] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-09. [2025-10-02T17:15:24.816849] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-02T17:15:25.073022] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-07. [2025-10-02T17:15:25.268424] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-02T17:15:25.873109] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-10. [2025-10-02T17:15:26.250071] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-02T17:15:26.402279] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-02T17:15:26.403440] [INFO ] [REMOTE ] ANRO: Full fetch complete (29217 records). [2025-10-02T17:15:26.403579] [DEBUG] [VALIDATOR ] ANRO: Validating primary data. [2025-10-02T17:15:26.690491] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-08. [2025-10-02T17:15:26.835638] [DEBUG] [VALIDATOR ] ANRO: All expected trading days are present. [2025-10-02T17:15:26.835776] [DEBUG] [VALIDATOR ] ANRO: Primary data validation passed. [2025-10-02T17:15:26.836293] [INFO ] [MAIN ] ANRO: Fetched primary data is valid. [2025-10-02T17:15:26.836366] [DEBUG] [LOCAL ] ANRO: Saving primary data. [2025-10-02T17:15:26.837281] [DEBUG] [LOCAL ] ANRO: Trimmed 29217 records to 18833 (keeping 200 days of data) [2025-10-02T17:15:26.949605] [DEBUG] [LOCAL ] ANRO: Primary data saved (18833 records). [2025-10-02T17:15:26.949796] [INFO ] [MAIN ] ANRO: Full history saved. [2025-10-02T17:15:26.949887] [INFO ] [MAIN ] Update Progress: 119/2370 symbols completed. ANRO took 16.5s. Estimated remaining: 4h 51m 2s. Rate: 7.7 symbols/min [2025-10-02T17:15:27.795572] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-02T17:15:27.801717] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-09. [2025-10-02T17:15:28.688003] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-02T17:15:28.697425] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-10. [2025-10-02T17:15:29.531859] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-02T17:15:29.533210] [INFO ] [REMOTE ] ANVS: Full fetch complete (36357 records). [2025-10-02T17:15:29.533294] [DEBUG] [VALIDATOR ] ANVS: Validating primary data. [2025-10-02T17:15:29.952923] [DEBUG] [VALIDATOR ] ANVS: All expected trading days are present. [2025-10-02T17:15:29.953015] [DEBUG] [VALIDATOR ] ANVS: Primary data validation passed. [2025-10-02T17:15:29.953590] [INFO ] [MAIN ] ANVS: Fetched primary data is valid. [2025-10-02T17:15:29.953687] [DEBUG] [LOCAL ] ANVS: Saving primary data. [2025-10-02T17:15:29.954678] [DEBUG] [LOCAL ] ANVS: Trimmed 36357 records to 23369 (keeping 200 days of data) [2025-10-02T17:15:30.097202] [DEBUG] [LOCAL ] ANVS: Primary data saved (23369 records). [2025-10-02T17:15:30.097363] [INFO ] [MAIN ] ANVS: Full history saved. [2025-10-02T17:15:30.097455] [INFO ] [MAIN ] Update Progress: 120/2370 symbols completed. ANVS took 18.2s. Estimated remaining: 4h 49m 28s. Rate: 7.8 symbols/min [2025-10-02T17:15:30.703370] [INFO ] [MAIN ] AOD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:15:30.906235] [INFO ] [MAIN ] AOMD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:15:30.908141] [DEBUG] [LOCAL ] AOMD: No existing data file found in primary storage. [2025-10-02T17:15:30.935670] [WARN ] [MAIN ] AOMD: No existing data found, performing full refresh instead. [2025-10-02T17:15:30.975087] [INFO ] [MAIN ] AON: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:15:30.975310] [INFO ] [MAIN ] AOMD: Wiping existing primary data before full refresh. [2025-10-02T17:15:30.967610] [INFO ] [MAIN ] AOMR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:15:30.975612] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-02T17:15:30.975978] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-02T17:15:30.976468] [INFO ] [MAIN ] AOMD: Starting full primary refresh. [2025-10-02T17:15:31.112891] [DEBUG] [LOCAL ] AOD: Loaded 30194 existing records from primary storage. [2025-10-02T17:15:31.131960] [INFO ] [MAIN ] AOD: Loaded 30194 existing records. [2025-10-02T17:15:31.132444] [DEBUG] [LOCAL ] AOMR: Loaded 16542 existing records from primary storage. [2025-10-02T17:15:31.176134] [INFO ] [MAIN ] AOMR: Loaded 16542 existing records. [2025-10-02T17:15:31.692589] [DEBUG] [LOCAL ] AON: Loaded 45428 existing records from primary storage. [2025-10-02T17:15:31.715430] [INFO ] [MAIN ] AON: Loaded 45428 existing records. [2025-10-02T17:15:31.740145] [WARN ] [MAIN ] AOD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:15:31.890252] [INFO ] [MAIN ] AOD: Wiping existing primary data before full refresh. [2025-10-02T17:15:31.912221] [WARN ] [MAIN ] AOMR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:15:31.945073] [INFO ] [MAIN ] AOMR: Wiping existing primary data before full refresh. [2025-10-02T17:15:31.927288] [INFO ] [LOCAL ] AOD: Starting deletion of primary data. [2025-10-02T17:15:31.984722] [INFO ] [LOCAL ] AOMR: Starting deletion of primary data. [2025-10-02T17:15:31.998922] [INFO ] [REMOTE ] AOMD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:15:32.010520] [DEBUG] [LOCAL ] AOMR: Deleted primary data file. [2025-10-02T17:15:32.017268] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2024-12. [2025-10-02T17:15:32.022095] [INFO ] [MAIN ] AOMR: Starting full primary refresh. [2025-10-02T17:15:32.010586] [DEBUG] [LOCAL ] AOD: Deleted primary data file. [2025-10-02T17:15:32.028479] [INFO ] [MAIN ] AOD: Starting full primary refresh. [2025-10-02T17:15:32.298936] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T17:15:32.307629] [WARN ] [MAIN ] AON: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:15:32.333233] [WARN ] [REMOTE ] AOMD: No data returned for month 2024-12 [2025-10-02T17:15:32.345788] [INFO ] [MAIN ] AON: Wiping existing primary data before full refresh. [2025-10-02T17:15:32.356425] [INFO ] [LOCAL ] AON: Starting deletion of primary data. [2025-10-02T17:15:32.356522] [FATAL] [REMOTE ] AOMD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T17:15:32.398443] [FATAL] [MAIN ] AOMD: Failed to fetch primary data. [2025-10-02T17:15:32.453068] [DEBUG] [LOCAL ] AON: Deleted primary data file. [2025-10-02T17:15:32.495069] [WARN ] [MAIN ] AOMD: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T17:15:32.495330] [INFO ] [MAIN ] AON: Starting full primary refresh. [2025-10-02T17:15:32.498007] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-02T17:15:32.540243] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-02T17:15:32.580804] [INFO ] [LOCAL ] AOMD: Starting deletion of derivative data. [2025-10-02T17:15:32.634338] [DEBUG] [LOCAL ] AOMD: No derivative data file found to delete. [2025-10-02T17:15:32.761603] [INFO ] [MAIN ] Update Progress: 121/2370 symbols completed. AOMD took 2.7s. Estimated remaining: 4h 47m 46s. Rate: 7.8 symbols/min [2025-10-02T17:15:33.200225] [INFO ] [REMOTE ] AOD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:15:33.284203] [INFO ] [REMOTE ] AOD: Fetching primary data for 2024-12. [2025-10-02T17:15:33.323941] [INFO ] [REMOTE ] AOMR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:15:33.374362] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2024-12. [2025-10-02T17:15:33.428260] [INFO ] [MAIN ] AORT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:15:33.453561] [DEBUG] [LOCAL ] AORT: No existing data file found in primary storage. [2025-10-02T17:15:33.453985] [WARN ] [MAIN ] AORT: No existing data found, performing full refresh instead. [2025-10-02T17:15:33.495751] [INFO ] [MAIN ] AORT: Wiping existing primary data before full refresh. [2025-10-02T17:15:33.501001] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-10-02T17:15:33.519365] [DEBUG] [LOCAL ] AORT: No primary data file found to delete. [2025-10-02T17:15:33.535912] [INFO ] [MAIN ] AORT: Starting full primary refresh. [2025-10-02T17:15:33.574809] [INFO ] [REMOTE ] AON: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:15:33.612110] [INFO ] [REMOTE ] AON: Fetching primary data for 2024-12. [2025-10-02T17:15:33.953381] [INFO ] [REMOTE ] AORT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:15:33.953793] [INFO ] [REMOTE ] AORT: Fetching primary data for 2024-12. [2025-10-02T17:15:34.517283] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-02T17:15:34.520849] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-01. [2025-10-02T17:15:34.565139] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-02T17:15:34.571595] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-01. [2025-10-02T17:15:35.051424] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-02T17:15:35.056512] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-01. [2025-10-02T17:15:35.335731] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-02T17:15:35.473070] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-02. [2025-10-02T17:15:35.622036] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-02T17:15:35.869426] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-02T17:15:35.993577] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-02T17:15:36.273037] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-02. [2025-10-02T17:15:36.527148] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-02T17:15:37.072977] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-02. [2025-10-02T17:15:37.336745] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-02T17:15:37.873022] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-03. [2025-10-02T17:15:38.355123] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-02T17:15:38.672977] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-03. [2025-10-02T17:15:38.908876] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-02T17:15:39.473018] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-01. [2025-10-02T17:15:40.012716] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-02T17:15:40.273020] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-03. [2025-10-02T17:15:40.846408] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-02T17:15:41.073016] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-02. [2025-10-02T17:15:41.391781] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-02T17:15:41.873049] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-04. [2025-10-02T17:15:42.543465] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-02T17:15:42.673023] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-04. [2025-10-02T17:15:43.176571] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-02T17:15:43.472976] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-05. [2025-10-02T17:15:43.704312] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-02T17:15:44.272994] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-05. [2025-10-02T17:15:44.889048] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-02T17:15:45.073007] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-04. [2025-10-02T17:15:45.511040] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-02T17:15:45.873024] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-06. [2025-10-02T17:15:46.250619] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-02T17:15:46.673005] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-05. [2025-10-02T17:15:46.786142] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-02T17:15:47.472976] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-03. [2025-10-02T17:15:47.639394] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-02T17:15:48.273021] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-06. [2025-10-02T17:15:49.072999] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-07. [2025-10-02T17:15:49.237313] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-02T17:15:49.277083] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-02T17:15:49.873003] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-04. [2025-10-02T17:15:50.371349] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-02T17:15:50.673024] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-08. [2025-10-02T17:15:51.473014] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-07. [2025-10-02T17:15:51.669183] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-02T17:15:52.004491] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-02T17:15:52.273061] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-05. [2025-10-02T17:15:52.305185] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-02T17:15:53.073040] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-09. [2025-10-02T17:15:53.752527] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-02T17:15:53.872992] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-08. [2025-10-02T17:15:54.335855] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-02T17:15:54.673040] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-06. [2025-10-02T17:15:55.042465] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-02T17:15:55.473058] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-06. [2025-10-02T17:15:55.849744] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-02T17:15:56.273018] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-10. [2025-10-02T17:15:56.817404] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-02T17:15:57.073007] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-07. [2025-10-02T17:15:57.352939] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-02T17:15:57.354480] [INFO ] [REMOTE ] AORT: Full fetch complete (41759 records). [2025-10-02T17:15:57.354630] [DEBUG] [VALIDATOR ] AORT: Validating primary data. [2025-10-02T17:15:57.355414] [FATAL] [VALIDATOR ] AORT: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:15:57.355540] [FATAL] [MAIN ] AORT: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:15:57.355596] [WARN ] [MAIN ] AORT: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:15:57.355700] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-10-02T17:15:57.355779] [DEBUG] [LOCAL ] AORT: No primary data file found to delete. [2025-10-02T17:15:57.355857] [INFO ] [LOCAL ] AORT: Starting deletion of derivative data. [2025-10-02T17:15:57.355925] [DEBUG] [LOCAL ] AORT: No derivative data file found to delete. [2025-10-02T17:15:57.356044] [INFO ] [MAIN ] Update Progress: 122/2370 symbols completed. AORT took 24.5s. Estimated remaining: 4h 52m 50s. Rate: 7.7 symbols/min [2025-10-02T17:15:57.561196] [INFO ] [MAIN ] AOS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:15:57.612327] [DEBUG] [LOCAL ] AOS: Loaded 48840 existing records from primary storage. [2025-10-02T17:15:57.612721] [INFO ] [MAIN ] AOS: Loaded 48840 existing records. [2025-10-02T17:15:57.809364] [WARN ] [MAIN ] AOS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:15:57.809662] [INFO ] [MAIN ] AOS: Wiping existing primary data before full refresh. [2025-10-02T17:15:57.809732] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-10-02T17:15:57.811147] [DEBUG] [LOCAL ] AOS: Deleted primary data file. [2025-10-02T17:15:57.811210] [INFO ] [MAIN ] AOS: Starting full primary refresh. [2025-10-02T17:15:57.882691] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-07. [2025-10-02T17:15:58.247190] [INFO ] [REMOTE ] AOS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:15:58.469705] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-02T17:15:58.673014] [INFO ] [REMOTE ] AOS: Fetching primary data for 2024-12. [2025-10-02T17:15:59.379199] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-02T17:15:59.473031] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-09. [2025-10-02T17:16:00.273023] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-08. [2025-10-02T17:16:00.365322] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-02T17:16:00.413593] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-02T17:16:01.073030] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-10. [2025-10-02T17:16:01.873274] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-08. [2025-10-02T17:16:02.088146] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-02T17:16:02.089714] [INFO ] [REMOTE ] AOMR: Full fetch complete (23198 records). [2025-10-02T17:16:02.089839] [DEBUG] [VALIDATOR ] AOMR: Validating primary data. [2025-10-02T17:16:02.251620] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-02T17:16:02.679712] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-01. [2025-10-02T17:16:02.708328] [DEBUG] [VALIDATOR ] AOMR: All expected trading days are present. [2025-10-02T17:16:02.708453] [DEBUG] [VALIDATOR ] AOMR: Primary data validation passed. [2025-10-02T17:16:02.709017] [INFO ] [MAIN ] AOMR: Fetched primary data is valid. [2025-10-02T17:16:02.709099] [DEBUG] [LOCAL ] AOMR: Saving primary data. [2025-10-02T17:16:02.710255] [DEBUG] [LOCAL ] AOMR: Trimmed 23198 records to 16644 (keeping 200 days of data) [2025-10-02T17:16:02.847295] [DEBUG] [LOCAL ] AOMR: Primary data saved (16644 records). [2025-10-02T17:16:02.847473] [INFO ] [MAIN ] AOMR: Full history saved. [2025-10-02T17:16:02.847570] [INFO ] [MAIN ] Update Progress: 123/2370 symbols completed. AOMR took 32.7s. Estimated remaining: 4h 51m 60s. Rate: 7.7 symbols/min [2025-10-02T17:16:03.067914] [INFO ] [MAIN ] AP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:16:03.080163] [DEBUG] [LOCAL ] AP: Loaded 7180 existing records from primary storage. [2025-10-02T17:16:03.080617] [INFO ] [MAIN ] AP: Loaded 7180 existing records. [2025-10-02T17:16:03.304049] [WARN ] [MAIN ] AP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:16:03.306519] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-02T17:16:03.306732] [INFO ] [MAIN ] AP: Wiping existing primary data before full refresh. [2025-10-02T17:16:03.314346] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-10-02T17:16:03.314931] [DEBUG] [LOCAL ] AP: Deleted primary data file. [2025-10-02T17:16:03.315006] [INFO ] [MAIN ] AP: Starting full primary refresh. [2025-10-02T17:16:03.480677] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-09. [2025-10-02T17:16:03.750004] [INFO ] [REMOTE ] AP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:16:04.272973] [INFO ] [REMOTE ] AP: Fetching primary data for 2024-12. [2025-10-02T17:16:04.377508] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-02T17:16:04.838514] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-02T17:16:05.073001] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-10. [2025-10-02T17:16:05.120461] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-02T17:16:05.873000] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-01. [2025-10-02T17:16:06.283511] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-02T17:16:06.285075] [INFO ] [REMOTE ] AOD: Full fetch complete (44227 records). [2025-10-02T17:16:06.285216] [DEBUG] [VALIDATOR ] AOD: Validating primary data. [2025-10-02T17:16:06.618603] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-02T17:16:06.678112] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-02. [2025-10-02T17:16:06.761344] [DEBUG] [VALIDATOR ] AOD: All expected trading days are present. [2025-10-02T17:16:06.761435] [DEBUG] [VALIDATOR ] AOD: Primary data validation passed. [2025-10-02T17:16:06.761997] [INFO ] [MAIN ] AOD: Fetched primary data is valid. [2025-10-02T17:16:06.762097] [DEBUG] [LOCAL ] AOD: Saving primary data. [2025-10-02T17:16:06.763237] [DEBUG] [LOCAL ] AOD: Trimmed 44227 records to 30406 (keeping 200 days of data) [2025-10-02T17:16:06.971006] [DEBUG] [LOCAL ] AOD: Primary data saved (30406 records). [2025-10-02T17:16:06.971152] [INFO ] [MAIN ] AOD: Full history saved. [2025-10-02T17:16:06.971281] [INFO ] [MAIN ] Update Progress: 124/2370 symbols completed. AOD took 36.9s. Estimated remaining: 4h 50m 46s. Rate: 7.7 symbols/min [2025-10-02T17:16:07.157734] [INFO ] [MAIN ] APAM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:16:07.157947] [DEBUG] [LOCAL ] APAM: No existing data file found in primary storage. [2025-10-02T17:16:07.158004] [WARN ] [MAIN ] APAM: No existing data found, performing full refresh instead. [2025-10-02T17:16:07.158158] [INFO ] [MAIN ] APAM: Wiping existing primary data before full refresh. [2025-10-02T17:16:07.158202] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-10-02T17:16:07.158245] [DEBUG] [LOCAL ] APAM: No primary data file found to delete. [2025-10-02T17:16:07.158302] [INFO ] [MAIN ] APAM: Starting full primary refresh. [2025-10-02T17:16:07.478129] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-09. [2025-10-02T17:16:07.554351] [INFO ] [REMOTE ] APAM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:16:08.273003] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-02. [2025-10-02T17:16:08.418377] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-02T17:16:08.664843] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-02T17:16:09.073012] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-03. [2025-10-02T17:16:09.222804] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-02T17:16:09.872999] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-03. [2025-10-02T17:16:10.337215] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-02T17:16:10.533178] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-02T17:16:10.672999] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-04. [2025-10-02T17:16:11.473013] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-10. [2025-10-02T17:16:12.273008] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-04. [2025-10-02T17:16:12.469164] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-02T17:16:12.767481] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-02T17:16:13.033444] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-02T17:16:13.035503] [INFO ] [REMOTE ] AON: Full fetch complete (64769 records). [2025-10-02T17:16:13.035677] [DEBUG] [VALIDATOR ] AON: Validating primary data. [2025-10-02T17:16:13.078126] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-05. [2025-10-02T17:16:13.477837] [DEBUG] [VALIDATOR ] AON: All expected trading days are present. [2025-10-02T17:16:13.477936] [DEBUG] [VALIDATOR ] AON: Primary data validation passed. [2025-10-02T17:16:13.478716] [INFO ] [MAIN ] AON: Fetched primary data is valid. [2025-10-02T17:16:13.478791] [DEBUG] [LOCAL ] AON: Saving primary data. [2025-10-02T17:16:13.480261] [DEBUG] [LOCAL ] AON: Trimmed 64769 records to 45726 (keeping 200 days of data) [2025-10-02T17:16:13.830036] [DEBUG] [LOCAL ] AON: Primary data saved (45726 records). [2025-10-02T17:16:13.830218] [INFO ] [MAIN ] AON: Full history saved. [2025-10-02T17:16:13.831784] [INFO ] [MAIN ] Update Progress: 125/2370 symbols completed. AON took 43.7s. Estimated remaining: 4h 50m 22s. Rate: 7.7 symbols/min [2025-10-02T17:16:13.878939] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-05. [2025-10-02T17:16:14.057848] [INFO ] [MAIN ] APD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:16:14.117285] [DEBUG] [LOCAL ] APD: Loaded 45389 existing records from primary storage. [2025-10-02T17:16:14.117711] [INFO ] [MAIN ] APD: Loaded 45389 existing records. [2025-10-02T17:16:14.339412] [WARN ] [MAIN ] APD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:16:14.339765] [INFO ] [MAIN ] APD: Wiping existing primary data before full refresh. [2025-10-02T17:16:14.339858] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-10-02T17:16:14.341370] [DEBUG] [LOCAL ] APD: Deleted primary data file. [2025-10-02T17:16:14.341434] [INFO ] [MAIN ] APD: Starting full primary refresh. [2025-10-02T17:16:14.677275] [INFO ] [REMOTE ] APAM: Fetching primary data for 2024-12. [2025-10-02T17:16:14.770465] [INFO ] [REMOTE ] APD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:16:14.801605] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-02T17:16:14.820839] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-02T17:16:15.473034] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-06. [2025-10-02T17:16:15.785001] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-02T17:16:16.273023] [INFO ] [REMOTE ] APD: Fetching primary data for 2024-12. [2025-10-02T17:16:16.495825] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-02T17:16:17.073010] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-01. [2025-10-02T17:16:17.765624] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-02T17:16:17.873007] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-01. [2025-10-02T17:16:18.383978] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-02T17:16:18.673043] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-07. [2025-10-02T17:16:19.402213] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-02T17:16:19.473014] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-02. [2025-10-02T17:16:19.543563] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-02T17:16:20.273007] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-08. [2025-10-02T17:16:20.883978] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-02T17:16:20.928454] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-02T17:16:21.072995] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-06. [2025-10-02T17:16:21.873032] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-02. [2025-10-02T17:16:22.673006] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-03. [2025-10-02T17:16:22.908367] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-02T17:16:23.310813] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-02T17:16:23.473053] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-03. [2025-10-02T17:16:23.807577] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-02T17:16:24.273022] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-09. [2025-10-02T17:16:25.044175] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-02T17:16:25.072975] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-04. [2025-10-02T17:16:25.097945] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-02T17:16:25.873012] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-10. [2025-10-02T17:16:26.641575] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-02T17:16:26.642882] [INFO ] [REMOTE ] AP: Full fetch complete (8945 records). [2025-10-02T17:16:26.642977] [DEBUG] [VALIDATOR ] AP: Validating primary data. [2025-10-02T17:16:26.678162] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-07. [2025-10-02T17:16:27.057692] [DEBUG] [VALIDATOR ] AP: All expected trading days are present. [2025-10-02T17:16:27.058087] [DEBUG] [VALIDATOR ] AP: Primary data validation passed. [2025-10-02T17:16:27.058374] [INFO ] [MAIN ] AP: Fetched primary data is valid. [2025-10-02T17:16:27.073423] [DEBUG] [LOCAL ] AP: Saving primary data. [2025-10-02T17:16:27.086438] [DEBUG] [LOCAL ] AP: Trimmed 8945 records to 7211 (keeping 200 days of data) [2025-10-02T17:16:27.088423] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-02T17:16:27.141571] [DEBUG] [LOCAL ] AP: Primary data saved (7211 records). [2025-10-02T17:16:27.141751] [INFO ] [MAIN ] AP: Full history saved. [2025-10-02T17:16:27.141844] [INFO ] [MAIN ] Update Progress: 126/2370 symbols completed. AP took 24.3s. Estimated remaining: 4h 51m 53s. Rate: 7.7 symbols/min [2025-10-02T17:16:27.336136] [INFO ] [MAIN ] APG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:16:27.336335] [DEBUG] [LOCAL ] APG: No existing data file found in primary storage. [2025-10-02T17:16:27.336379] [WARN ] [MAIN ] APG: No existing data found, performing full refresh instead. [2025-10-02T17:16:27.336500] [INFO ] [MAIN ] APG: Wiping existing primary data before full refresh. [2025-10-02T17:16:27.336543] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-10-02T17:16:27.336585] [DEBUG] [LOCAL ] APG: No primary data file found to delete. [2025-10-02T17:16:27.336618] [INFO ] [MAIN ] APG: Starting full primary refresh. [2025-10-02T17:16:27.478166] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-04. [2025-10-02T17:16:27.739147] [INFO ] [REMOTE ] APG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:16:28.273055] [INFO ] [REMOTE ] APG: Fetching primary data for 2024-12. [2025-10-02T17:16:28.503115] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-02T17:16:29.072997] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-05. [2025-10-02T17:16:29.279349] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-02T17:16:29.873008] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-08. [2025-10-02T17:16:30.190638] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-02T17:16:30.543111] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-02T17:16:30.673111] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-05. [2025-10-02T17:16:31.399996] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-02T17:16:31.473006] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-06. [2025-10-02T17:16:31.853724] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-02T17:16:32.273045] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-09. [2025-10-02T17:16:33.073063] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-01. [2025-10-02T17:16:33.140431] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-02T17:16:33.716247] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-02T17:16:33.873000] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-06. [2025-10-02T17:16:34.672976] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-10. [2025-10-02T17:16:34.763157] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-02T17:16:35.204539] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-02T17:16:35.473046] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-07. [2025-10-02T17:16:35.916229] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-02T17:16:35.919630] [INFO ] [REMOTE ] AOS: Full fetch complete (70654 records). [2025-10-02T17:16:35.919806] [DEBUG] [VALIDATOR ] AOS: Validating primary data. [2025-10-02T17:16:36.285716] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-02. [2025-10-02T17:16:36.349198] [DEBUG] [VALIDATOR ] AOS: All expected trading days are present. [2025-10-02T17:16:36.349292] [DEBUG] [VALIDATOR ] AOS: Primary data validation passed. [2025-10-02T17:16:36.350152] [INFO ] [MAIN ] AOS: Fetched primary data is valid. [2025-10-02T17:16:36.350226] [DEBUG] [LOCAL ] AOS: Saving primary data. [2025-10-02T17:16:36.351714] [DEBUG] [LOCAL ] AOS: Trimmed 70654 records to 49194 (keeping 200 days of data) [2025-10-02T17:16:36.697965] [DEBUG] [LOCAL ] AOS: Primary data saved (49194 records). [2025-10-02T17:16:36.698157] [INFO ] [MAIN ] AOS: Full history saved. [2025-10-02T17:16:36.698258] [INFO ] [MAIN ] Update Progress: 127/2370 symbols completed. AOS took 39.3s. Estimated remaining: 4h 52m 16s. Rate: 7.7 symbols/min [2025-10-02T17:16:36.764113] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-02T17:16:36.902846] [INFO ] [MAIN ] APH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:16:36.959290] [DEBUG] [LOCAL ] APH: Loaded 53691 existing records from primary storage. [2025-10-02T17:16:36.959629] [INFO ] [MAIN ] APH: Loaded 53691 existing records. [2025-10-02T17:16:37.078362] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-08. [2025-10-02T17:16:37.167671] [WARN ] [MAIN ] APH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:16:37.167885] [INFO ] [MAIN ] APH: Wiping existing primary data before full refresh. [2025-10-02T17:16:37.167935] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-10-02T17:16:37.169814] [DEBUG] [LOCAL ] APH: Deleted primary data file. [2025-10-02T17:16:37.169879] [INFO ] [MAIN ] APH: Starting full primary refresh. [2025-10-02T17:16:37.556539] [INFO ] [REMOTE ] APH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:16:37.873015] [INFO ] [REMOTE ] APH: Fetching primary data for 2024-12. [2025-10-02T17:16:37.926694] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-02T17:16:38.474105] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-02T17:16:38.673035] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-07. [2025-10-02T17:16:39.473028] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-09. [2025-10-02T17:16:39.713239] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-02T17:16:40.273050] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-03. [2025-10-02T17:16:40.443763] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-02T17:16:40.669598] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-02T17:16:41.073015] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-08. [2025-10-02T17:16:41.873020] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-01. [2025-10-02T17:16:41.992068] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-02T17:16:42.673033] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-04. [2025-10-02T17:16:42.877075] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-02T17:16:43.473022] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-10. [2025-10-02T17:16:43.980601] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-02T17:16:44.272983] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-02. [2025-10-02T17:16:44.436538] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-02T17:16:44.562583] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-02T17:16:44.564260] [INFO ] [REMOTE ] APAM: Full fetch complete (51725 records). [2025-10-02T17:16:44.564373] [DEBUG] [VALIDATOR ] APAM: Validating primary data. [2025-10-02T17:16:45.000211] [DEBUG] [VALIDATOR ] APAM: All expected trading days are present. [2025-10-02T17:16:45.000331] [DEBUG] [VALIDATOR ] APAM: Primary data validation passed. [2025-10-02T17:16:45.001049] [INFO ] [MAIN ] APAM: Fetched primary data is valid. [2025-10-02T17:16:45.001117] [DEBUG] [LOCAL ] APAM: Saving primary data. [2025-10-02T17:16:45.002256] [DEBUG] [LOCAL ] APAM: Trimmed 51725 records to 36350 (keeping 200 days of data) [2025-10-02T17:16:45.091737] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-05. [2025-10-02T17:16:45.238127] [DEBUG] [LOCAL ] APAM: Primary data saved (36350 records). [2025-10-02T17:16:45.238279] [INFO ] [MAIN ] APAM: Full history saved. [2025-10-02T17:16:45.238354] [INFO ] [MAIN ] Update Progress: 128/2370 symbols completed. APAM took 38.3s. Estimated remaining: 4h 52m 21s. Rate: 7.7 symbols/min [2025-10-02T17:16:45.436261] [INFO ] [MAIN ] APLE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:16:45.494225] [DEBUG] [LOCAL ] APLE: Loaded 51925 existing records from primary storage. [2025-10-02T17:16:45.494589] [INFO ] [MAIN ] APLE: Loaded 51925 existing records. [2025-10-02T17:16:45.697036] [WARN ] [MAIN ] APLE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:16:45.697499] [INFO ] [MAIN ] APLE: Wiping existing primary data before full refresh. [2025-10-02T17:16:45.697665] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-10-02T17:16:45.699258] [DEBUG] [LOCAL ] APLE: Deleted primary data file. [2025-10-02T17:16:45.699324] [INFO ] [MAIN ] APLE: Starting full primary refresh. [2025-10-02T17:16:45.844749] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-02T17:16:45.876230] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-09. [2025-10-02T17:16:46.139062] [INFO ] [REMOTE ] APLE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:16:46.672979] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-03. [2025-10-02T17:16:46.894371] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-02T17:16:47.473021] [INFO ] [REMOTE ] APLE: Fetching primary data for 2024-12. [2025-10-02T17:16:47.649490] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-02T17:16:48.145362] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-02T17:16:48.273009] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-06. [2025-10-02T17:16:49.073003] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-04. [2025-10-02T17:16:49.505896] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-02T17:16:49.683235] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-02T17:16:49.873000] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-10. [2025-10-02T17:16:50.672983] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-07. [2025-10-02T17:16:50.950891] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-02T17:16:51.050882] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-02T17:16:51.052848] [INFO ] [REMOTE ] APD: Full fetch complete (66796 records). [2025-10-02T17:16:51.052964] [DEBUG] [VALIDATOR ] APD: Validating primary data. [2025-10-02T17:16:51.476671] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-01. [2025-10-02T17:16:51.476910] [DEBUG] [VALIDATOR ] APD: All expected trading days are present. [2025-10-02T17:16:51.477814] [DEBUG] [VALIDATOR ] APD: Primary data validation passed. [2025-10-02T17:16:51.478592] [INFO ] [MAIN ] APD: Fetched primary data is valid. [2025-10-02T17:16:51.478785] [DEBUG] [LOCAL ] APD: Saving primary data. [2025-10-02T17:16:51.480372] [DEBUG] [LOCAL ] APD: Trimmed 66796 records to 45731 (keeping 200 days of data) [2025-10-02T17:16:51.785498] [DEBUG] [LOCAL ] APD: Primary data saved (45731 records). [2025-10-02T17:16:51.785632] [INFO ] [MAIN ] APD: Full history saved. [2025-10-02T17:16:51.786631] [INFO ] [MAIN ] Update Progress: 129/2370 symbols completed. APD took 38.0s. Estimated remaining: 4h 51m 51s. Rate: 7.7 symbols/min [2025-10-02T17:16:51.974160] [INFO ] [MAIN ] APO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:16:51.974363] [DEBUG] [LOCAL ] APO: No existing data file found in primary storage. [2025-10-02T17:16:51.974406] [WARN ] [MAIN ] APO: No existing data found, performing full refresh instead. [2025-10-02T17:16:51.974581] [INFO ] [MAIN ] APO: Wiping existing primary data before full refresh. [2025-10-02T17:16:51.974636] [INFO ] [LOCAL ] APO: Starting deletion of primary data. [2025-10-02T17:16:51.974724] [DEBUG] [LOCAL ] APO: No primary data file found to delete. [2025-10-02T17:16:51.974764] [INFO ] [MAIN ] APO: Starting full primary refresh. [2025-10-02T17:16:52.278144] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-05. [2025-10-02T17:16:52.377028] [INFO ] [REMOTE ] APO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:16:52.565979] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-02T17:16:53.072974] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-08. [2025-10-02T17:16:53.177780] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-02T17:16:53.873005] [INFO ] [REMOTE ] APO: Fetching primary data for 2024-12. [2025-10-02T17:16:54.603430] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-02T17:16:54.672983] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-02. [2025-10-02T17:16:54.731979] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-02T17:16:55.472998] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-09. [2025-10-02T17:16:56.015880] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-10-02T17:16:56.058807] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-02T17:16:56.273047] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-03. [2025-10-02T17:16:57.072999] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-06. [2025-10-02T17:16:57.172721] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-02T17:16:57.872986] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-10. [2025-10-02T17:16:57.982075] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-02T17:16:58.496921] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-02T17:16:58.673035] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-04. [2025-10-02T17:16:59.316237] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-02T17:16:59.318365] [INFO ] [REMOTE ] APG: Full fetch complete (71671 records). [2025-10-02T17:16:59.318482] [DEBUG] [VALIDATOR ] APG: Validating primary data. [2025-10-02T17:16:59.478162] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-07. [2025-10-02T17:16:59.765217] [DEBUG] [VALIDATOR ] APG: All expected trading days are present. [2025-10-02T17:16:59.765307] [DEBUG] [VALIDATOR ] APG: Primary data validation passed. [2025-10-02T17:16:59.766099] [INFO ] [MAIN ] APG: Fetched primary data is valid. [2025-10-02T17:16:59.766193] [DEBUG] [LOCAL ] APG: Saving primary data. [2025-10-02T17:16:59.767701] [DEBUG] [LOCAL ] APG: Trimmed 71671 records to 50572 (keeping 200 days of data) [2025-10-02T17:17:00.081923] [DEBUG] [LOCAL ] APG: Primary data saved (50572 records). [2025-10-02T17:17:00.082073] [INFO ] [MAIN ] APG: Full history saved. [2025-10-02T17:17:00.082150] [INFO ] [MAIN ] Update Progress: 130/2370 symbols completed. APG took 32.9s. Estimated remaining: 4h 51m 51s. Rate: 7.7 symbols/min [2025-10-02T17:17:00.273325] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-01. [2025-10-02T17:17:00.278483] [INFO ] [MAIN ] APOS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:17:00.279882] [DEBUG] [LOCAL ] APOS: No existing data file found in primary storage. [2025-10-02T17:17:00.280001] [WARN ] [MAIN ] APOS: No existing data found, performing full refresh instead. [2025-10-02T17:17:00.280166] [INFO ] [MAIN ] APOS: Wiping existing primary data before full refresh. [2025-10-02T17:17:00.280250] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-10-02T17:17:00.280488] [DEBUG] [LOCAL ] APOS: No primary data file found to delete. [2025-10-02T17:17:00.280587] [INFO ] [MAIN ] APOS: Starting full primary refresh. [2025-10-02T17:17:00.654504] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-02T17:17:00.722111] [INFO ] [REMOTE ] APOS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:17:01.073154] [INFO ] [REMOTE ] APOS: Fetching primary data for 2024-12. [2025-10-02T17:17:01.783321] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-02T17:17:01.784447] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-02T17:17:01.872998] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-01. [2025-10-02T17:17:02.251301] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-02T17:17:02.553623] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-02T17:17:02.672991] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-02. [2025-10-02T17:17:03.378701] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-02T17:17:03.473013] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-08. [2025-10-02T17:17:04.273011] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-02. [2025-10-02T17:17:05.073004] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-03. [2025-10-02T17:17:05.731254] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-02T17:17:05.799406] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-02T17:17:05.879101] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-03. [2025-10-02T17:17:05.910124] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-10-02T17:17:06.672996] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-09. [2025-10-02T17:17:07.446846] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-02T17:17:07.473005] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-05. [2025-10-02T17:17:08.273001] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-04. [2025-10-02T17:17:08.692763] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-02T17:17:09.033576] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-02T17:17:09.073001] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-05. [2025-10-02T17:17:09.467454] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-02T17:17:09.806905] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-02T17:17:09.872995] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-04. [2025-10-02T17:17:10.673006] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-06. [2025-10-02T17:17:11.473020] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-10. [2025-10-02T17:17:11.904838] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-02T17:17:12.273058] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-05. [2025-10-02T17:17:12.811408] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-02T17:17:13.072967] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-06. [2025-10-02T17:17:13.297793] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-02T17:17:13.299921] [INFO ] [REMOTE ] APH: Full fetch complete (77689 records). [2025-10-02T17:17:13.300044] [DEBUG] [VALIDATOR ] APH: Validating primary data. [2025-10-02T17:17:13.761127] [DEBUG] [VALIDATOR ] APH: All expected trading days are present. [2025-10-02T17:17:13.761248] [DEBUG] [VALIDATOR ] APH: Primary data validation passed. [2025-10-02T17:17:13.762143] [INFO ] [MAIN ] APH: Fetched primary data is valid. [2025-10-02T17:17:13.762350] [DEBUG] [LOCAL ] APH: Saving primary data. [2025-10-02T17:17:13.770869] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-02T17:17:13.774981] [DEBUG] [LOCAL ] APH: Trimmed 77689 records to 54081 (keeping 200 days of data) [2025-10-02T17:17:13.873442] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-07. [2025-10-02T17:17:14.138529] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-02T17:17:14.203316] [DEBUG] [LOCAL ] APH: Primary data saved (54081 records). [2025-10-02T17:17:14.203464] [INFO ] [MAIN ] APH: Full history saved. [2025-10-02T17:17:14.203555] [INFO ] [MAIN ] Update Progress: 131/2370 symbols completed. APH took 37.5s. Estimated remaining: 4h 53m 31s. Rate: 7.6 symbols/min [2025-10-02T17:17:14.392024] [INFO ] [MAIN ] APTV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:17:14.392199] [DEBUG] [LOCAL ] APTV: No existing data file found in primary storage. [2025-10-02T17:17:14.392239] [WARN ] [MAIN ] APTV: No existing data found, performing full refresh instead. [2025-10-02T17:17:14.392379] [INFO ] [MAIN ] APTV: Wiping existing primary data before full refresh. [2025-10-02T17:17:14.392452] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-10-02T17:17:14.392515] [DEBUG] [LOCAL ] APTV: No primary data file found to delete. [2025-10-02T17:17:14.392551] [INFO ] [MAIN ] APTV: Starting full primary refresh. [2025-10-02T17:17:14.678229] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-07. [2025-10-02T17:17:14.801331] [INFO ] [REMOTE ] APTV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:17:15.313630] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-02T17:17:15.470937] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-02T17:17:15.478499] [INFO ] [REMOTE ] APTV: Fetching primary data for 2024-12. [2025-10-02T17:17:16.273044] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-06. [2025-10-02T17:17:17.073036] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-08. [2025-10-02T17:17:17.323292] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-02T17:17:17.722815] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-02T17:17:17.872969] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-01. [2025-10-02T17:17:18.059749] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-02T17:17:18.673049] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-08. [2025-10-02T17:17:19.472976] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-07. [2025-10-02T17:17:19.680936] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-02T17:17:20.255229] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-02T17:17:20.272984] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-09. [2025-10-02T17:17:21.073013] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-09. [2025-10-02T17:17:21.185594] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-02T17:17:21.564394] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-02T17:17:21.872975] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-08. [2025-10-02T17:17:22.106464] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-02T17:17:22.673022] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-02. [2025-10-02T17:17:23.380386] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-02T17:17:23.473009] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-10. [2025-10-02T17:17:24.275254] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-10. [2025-10-02T17:17:24.275452] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-02T17:17:24.277199] [INFO ] [REMOTE ] APOS: Full fetch complete (10444 records). [2025-10-02T17:17:24.277319] [DEBUG] [VALIDATOR ] APOS: Validating primary data. [2025-10-02T17:17:24.277790] [FATAL] [VALIDATOR ] APOS: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:17:24.277875] [FATAL] [MAIN ] APOS: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:17:24.277942] [WARN ] [MAIN ] APOS: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:17:24.278022] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-10-02T17:17:24.278141] [DEBUG] [LOCAL ] APOS: No primary data file found to delete. [2025-10-02T17:17:24.278214] [INFO ] [LOCAL ] APOS: Starting deletion of derivative data. [2025-10-02T17:17:24.278307] [DEBUG] [LOCAL ] APOS: No derivative data file found to delete. [2025-10-02T17:17:24.278385] [INFO ] [MAIN ] Update Progress: 132/2370 symbols completed. APOS took 24.2s. Estimated remaining: 4h 54m 1s. Rate: 7.6 symbols/min [2025-10-02T17:17:24.485440] [INFO ] [MAIN ] AQN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:17:24.519871] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-02T17:17:24.582425] [DEBUG] [LOCAL ] AQN: Loaded 51909 existing records from primary storage. [2025-10-02T17:17:24.582794] [INFO ] [MAIN ] AQN: Loaded 51909 existing records. [2025-10-02T17:17:24.795915] [WARN ] [MAIN ] AQN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:17:24.796154] [INFO ] [MAIN ] AQN: Wiping existing primary data before full refresh. [2025-10-02T17:17:24.796210] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-10-02T17:17:24.797919] [DEBUG] [LOCAL ] AQN: Deleted primary data file. [2025-10-02T17:17:24.797984] [INFO ] [MAIN ] AQN: Starting full primary refresh. [2025-10-02T17:17:25.078235] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-09. [2025-10-02T17:17:25.204112] [INFO ] [REMOTE ] AQN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:17:25.754520] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-02T17:17:25.756186] [INFO ] [REMOTE ] APLE: Full fetch complete (73915 records). [2025-10-02T17:17:25.756343] [DEBUG] [VALIDATOR ] APLE: Validating primary data. [2025-10-02T17:17:25.757286] [FATAL] [VALIDATOR ] APLE: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:17:25.757441] [FATAL] [MAIN ] APLE: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:17:25.757510] [WARN ] [MAIN ] APLE: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:17:25.757586] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-10-02T17:17:25.757678] [DEBUG] [LOCAL ] APLE: No primary data file found to delete. [2025-10-02T17:17:25.757736] [INFO ] [LOCAL ] APLE: Starting deletion of derivative data. [2025-10-02T17:17:25.758389] [DEBUG] [LOCAL ] APLE: Deleted derivative data file. [2025-10-02T17:17:25.758803] [INFO ] [MAIN ] Update Progress: 133/2370 symbols completed. APLE took 40.5s. Estimated remaining: 4h 52m 5s. Rate: 7.7 symbols/min [2025-10-02T17:17:25.873721] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-03. [2025-10-02T17:17:25.950332] [INFO ] [MAIN ] AQNB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:17:25.958612] [DEBUG] [LOCAL ] AQNB: Loaded 4164 existing records from primary storage. [2025-10-02T17:17:25.958918] [INFO ] [MAIN ] AQNB: Loaded 4164 existing records. [2025-10-02T17:17:26.158706] [WARN ] [MAIN ] AQNB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:17:26.158988] [INFO ] [MAIN ] AQNB: Wiping existing primary data before full refresh. [2025-10-02T17:17:26.159049] [INFO ] [LOCAL ] AQNB: Starting deletion of primary data. [2025-10-02T17:17:26.159412] [DEBUG] [LOCAL ] AQNB: Deleted primary data file. [2025-10-02T17:17:26.159475] [INFO ] [MAIN ] AQNB: Starting full primary refresh. [2025-10-02T17:17:26.582774] [INFO ] [REMOTE ] AQNB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:17:26.673053] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2024-12. [2025-10-02T17:17:26.993077] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-02T17:17:27.473018] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-10. [2025-10-02T17:17:27.561938] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-02T17:17:27.930959] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-02T17:17:28.273017] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-01. [2025-10-02T17:17:28.758383] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-02T17:17:29.057194] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-02T17:17:29.059541] [INFO ] [REMOTE ] APO: Full fetch complete (77291 records). [2025-10-02T17:17:29.059762] [DEBUG] [VALIDATOR ] APO: Validating primary data. [2025-10-02T17:17:29.078133] [INFO ] [REMOTE ] AQN: Fetching primary data for 2024-12. [2025-10-02T17:17:29.536190] [DEBUG] [VALIDATOR ] APO: All expected trading days are present. [2025-10-02T17:17:29.536283] [DEBUG] [VALIDATOR ] APO: Primary data validation passed. [2025-10-02T17:17:29.537185] [INFO ] [MAIN ] APO: Fetched primary data is valid. [2025-10-02T17:17:29.537259] [DEBUG] [LOCAL ] APO: Saving primary data. [2025-10-02T17:17:29.539065] [DEBUG] [LOCAL ] APO: Trimmed 77291 records to 53773 (keeping 200 days of data) [2025-10-02T17:17:29.883133] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-04. [2025-10-02T17:17:29.910744] [DEBUG] [LOCAL ] APO: Primary data saved (53773 records). [2025-10-02T17:17:29.911336] [INFO ] [MAIN ] APO: Full history saved. [2025-10-02T17:17:29.911593] [INFO ] [MAIN ] Update Progress: 134/2370 symbols completed. APO took 38.1s. Estimated remaining: 4h 50m 56s. Rate: 7.7 symbols/min [2025-10-02T17:17:30.097678] [INFO ] [MAIN ] AR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:17:30.153078] [DEBUG] [LOCAL ] AR: Loaded 53583 existing records from primary storage. [2025-10-02T17:17:30.153494] [INFO ] [MAIN ] AR: Loaded 53583 existing records. [2025-10-02T17:17:30.354181] [WARN ] [MAIN ] AR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:17:30.354421] [INFO ] [MAIN ] AR: Wiping existing primary data before full refresh. [2025-10-02T17:17:30.354471] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-10-02T17:17:30.356223] [DEBUG] [LOCAL ] AR: Deleted primary data file. [2025-10-02T17:17:30.356289] [INFO ] [MAIN ] AR: Starting full primary refresh. [2025-10-02T17:17:30.678107] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-02. [2025-10-02T17:17:30.760620] [INFO ] [REMOTE ] AR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:17:31.049859] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-02T17:17:31.219720] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-02T17:17:31.473014] [INFO ] [REMOTE ] AR: Fetching primary data for 2024-12. [2025-10-02T17:17:31.850515] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-02T17:17:32.273022] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-03. [2025-10-02T17:17:32.888683] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-02T17:17:33.073006] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-01. [2025-10-02T17:17:33.404805] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-02T17:17:33.872998] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-04. [2025-10-02T17:17:34.377566] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-02T17:17:34.469250] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-02T17:17:34.673009] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-05. [2025-10-02T17:17:35.161895] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-02T17:17:35.473012] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-02. [2025-10-02T17:17:36.273047] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-05. [2025-10-02T17:17:36.958516] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-02T17:17:37.073029] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-06. [2025-10-02T17:17:37.778560] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-02T17:17:37.851954] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-02T17:17:37.872957] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-06. [2025-10-02T17:17:38.673049] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-01. [2025-10-02T17:17:39.179610] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-02T17:17:39.473026] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-03. [2025-10-02T17:17:40.272994] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-07. [2025-10-02T17:17:40.325380] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-02T17:17:40.856378] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-02T17:17:41.073044] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-07. [2025-10-02T17:17:41.873000] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-04. [2025-10-02T17:17:42.027900] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-02T17:17:42.673046] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-08. [2025-10-02T17:17:43.088356] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-02T17:17:43.088204] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-02T17:17:43.473031] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-02. [2025-10-02T17:17:44.272980] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-08. [2025-10-02T17:17:44.414615] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-02T17:17:44.872385] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-02T17:17:44.911971] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-02T17:17:45.072999] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-09. [2025-10-02T17:17:45.665354] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-02T17:17:45.873008] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-05. [2025-10-02T17:17:46.673018] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-10. [2025-10-02T17:17:47.459971] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-02T17:17:47.460817] [INFO ] [REMOTE ] AQNB: Full fetch complete (5750 records). [2025-10-02T17:17:47.460892] [DEBUG] [VALIDATOR ] AQNB: Validating primary data. [2025-10-02T17:17:47.482275] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-09. [2025-10-02T17:17:47.907120] [DEBUG] [VALIDATOR ] AQNB: All expected trading days are present. [2025-10-02T17:17:47.907222] [DEBUG] [VALIDATOR ] AQNB: Primary data validation passed. [2025-10-02T17:17:47.907794] [INFO ] [MAIN ] AQNB: Fetched primary data is valid. [2025-10-02T17:17:47.907880] [DEBUG] [LOCAL ] AQNB: Saving primary data. [2025-10-02T17:17:47.912322] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-02T17:17:47.913022] [DEBUG] [LOCAL ] AQNB: Trimmed 5750 records to 4183 (keeping 200 days of data) [2025-10-02T17:17:47.960001] [DEBUG] [LOCAL ] AQNB: Primary data saved (4183 records). [2025-10-02T17:17:47.960174] [INFO ] [MAIN ] AQNB: Full history saved. [2025-10-02T17:17:47.960267] [INFO ] [MAIN ] Update Progress: 135/2370 symbols completed. AQNB took 22.2s. Estimated remaining: 4h 53m 38s. Rate: 7.6 symbols/min [2025-10-02T17:17:48.149786] [INFO ] [MAIN ] ARCO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:17:48.207849] [DEBUG] [LOCAL ] ARCO: Loaded 44450 existing records from primary storage. [2025-10-02T17:17:48.208210] [INFO ] [MAIN ] ARCO: Loaded 44450 existing records. [2025-10-02T17:17:48.278240] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-03. [2025-10-02T17:17:48.410824] [WARN ] [MAIN ] ARCO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:17:48.411036] [INFO ] [MAIN ] ARCO: Wiping existing primary data before full refresh. [2025-10-02T17:17:48.411084] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-10-02T17:17:48.412734] [DEBUG] [LOCAL ] ARCO: Deleted primary data file. [2025-10-02T17:17:48.412799] [INFO ] [MAIN ] ARCO: Starting full primary refresh. [2025-10-02T17:17:48.803814] [INFO ] [REMOTE ] ARCO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:17:49.073015] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-06. [2025-10-02T17:17:49.393947] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-02T17:17:49.676237] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-02T17:17:49.873013] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-04. [2025-10-02T17:17:50.673043] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2024-12. [2025-10-02T17:17:50.762147] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-02T17:17:51.473001] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-10. [2025-10-02T17:17:51.806461] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-02T17:17:51.995888] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-02T17:17:52.273035] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-05. [2025-10-02T17:17:52.895505] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-02T17:17:52.898293] [INFO ] [REMOTE ] APTV: Full fetch complete (75922 records). [2025-10-02T17:17:52.898576] [DEBUG] [VALIDATOR ] APTV: Validating primary data. [2025-10-02T17:17:53.073109] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-01. [2025-10-02T17:17:53.365210] [DEBUG] [VALIDATOR ] APTV: All expected trading days are present. [2025-10-02T17:17:53.365316] [DEBUG] [VALIDATOR ] APTV: Primary data validation passed. [2025-10-02T17:17:53.366134] [INFO ] [MAIN ] APTV: Fetched primary data is valid. [2025-10-02T17:17:53.366202] [DEBUG] [LOCAL ] APTV: Saving primary data. [2025-10-02T17:17:53.367904] [DEBUG] [LOCAL ] APTV: Trimmed 75922 records to 52472 (keeping 200 days of data) [2025-10-02T17:17:53.702557] [DEBUG] [LOCAL ] APTV: Primary data saved (52472 records). [2025-10-02T17:17:53.702747] [INFO ] [MAIN ] APTV: Full history saved. [2025-10-02T17:17:53.702841] [INFO ] [MAIN ] Update Progress: 136/2370 symbols completed. APTV took 39.5s. Estimated remaining: 4h 52m 54s. Rate: 7.6 symbols/min [2025-10-02T17:17:53.888070] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-07. [2025-10-02T17:17:53.891914] [INFO ] [MAIN ] ARDC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:17:53.911702] [DEBUG] [LOCAL ] ARDC: Loaded 14775 existing records from primary storage. [2025-10-02T17:17:53.911977] [INFO ] [MAIN ] ARDC: Loaded 14775 existing records. [2025-10-02T17:17:54.112844] [WARN ] [MAIN ] ARDC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:17:54.113225] [INFO ] [MAIN ] ARDC: Wiping existing primary data before full refresh. [2025-10-02T17:17:54.113414] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-10-02T17:17:54.114056] [DEBUG] [LOCAL ] ARDC: Deleted primary data file. [2025-10-02T17:17:54.114121] [INFO ] [MAIN ] ARDC: Starting full primary refresh. [2025-10-02T17:17:54.420585] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-02T17:17:54.654966] [INFO ] [REMOTE ] ARDC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:17:54.673022] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2024-12. [2025-10-02T17:17:54.811364] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-02T17:17:55.182461] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-02T17:17:55.383942] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-02T17:17:55.473072] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-06. [2025-10-02T17:17:56.273000] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-02. [2025-10-02T17:17:57.072965] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-01. [2025-10-02T17:17:57.381364] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-02T17:17:57.423885] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-02T17:17:57.873054] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-08. [2025-10-02T17:17:57.890029] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-02T17:17:58.673092] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-02. [2025-10-02T17:17:59.479383] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-07. [2025-10-02T17:17:59.480871] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-02T17:17:59.742935] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-02T17:18:00.273041] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-03. [2025-10-02T17:18:01.073039] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-09. [2025-10-02T17:18:01.454589] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-02T17:18:01.872981] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-08. [2025-10-02T17:18:01.976033] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-02T17:18:02.673042] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-03. [2025-10-02T17:18:02.926374] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-02T17:18:03.434245] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-02T17:18:03.473090] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-10. [2025-10-02T17:18:03.567246] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-02T17:18:04.273025] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-09. [2025-10-02T17:18:05.060522] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-02T17:18:05.063502] [INFO ] [REMOTE ] AQN: Full fetch complete (75303 records). [2025-10-02T17:18:05.063753] [DEBUG] [VALIDATOR ] AQN: Validating primary data. [2025-10-02T17:18:05.080063] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-04. [2025-10-02T17:18:05.487601] [DEBUG] [VALIDATOR ] AQN: All expected trading days are present. [2025-10-02T17:18:05.487784] [DEBUG] [VALIDATOR ] AQN: Primary data validation passed. [2025-10-02T17:18:05.488934] [INFO ] [MAIN ] AQN: Fetched primary data is valid. [2025-10-02T17:18:05.489043] [DEBUG] [LOCAL ] AQN: Saving primary data. [2025-10-02T17:18:05.491201] [DEBUG] [LOCAL ] AQN: Trimmed 75303 records to 52288 (keeping 200 days of data) [2025-10-02T17:18:05.847030] [DEBUG] [LOCAL ] AQN: Primary data saved (52288 records). [2025-10-02T17:18:05.847258] [INFO ] [MAIN ] AQN: Full history saved. [2025-10-02T17:18:05.847368] [INFO ] [MAIN ] Update Progress: 137/2370 symbols completed. AQN took 41.6s. Estimated remaining: 4h 53m 56s. Rate: 7.6 symbols/min [2025-10-02T17:18:05.882343] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-04. [2025-10-02T17:18:06.042867] [INFO ] [MAIN ] ARDT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:18:06.080861] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-02T17:18:06.117704] [DEBUG] [LOCAL ] ARDT: Loaded 27653 existing records from primary storage. [2025-10-02T17:18:06.118104] [INFO ] [MAIN ] ARDT: Loaded 27653 existing records. [2025-10-02T17:18:06.299244] [WARN ] [MAIN ] ARDT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:18:06.299574] [INFO ] [MAIN ] ARDT: Wiping existing primary data before full refresh. [2025-10-02T17:18:06.299701] [INFO ] [LOCAL ] ARDT: Starting deletion of primary data. [2025-10-02T17:18:06.300712] [DEBUG] [LOCAL ] ARDT: Deleted primary data file. [2025-10-02T17:18:06.300778] [INFO ] [MAIN ] ARDT: Starting full primary refresh. [2025-10-02T17:18:06.673687] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-10. [2025-10-02T17:18:06.749534] [INFO ] [REMOTE ] ARDT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:18:06.790739] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-02T17:18:06.999981] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-02T17:18:07.473037] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-05. [2025-10-02T17:18:08.149122] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-02T17:18:08.152188] [INFO ] [REMOTE ] AR: Full fetch complete (77533 records). [2025-10-02T17:18:08.152470] [DEBUG] [VALIDATOR ] AR: Validating primary data. [2025-10-02T17:18:08.278246] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2024-12. [2025-10-02T17:18:08.580232] [DEBUG] [VALIDATOR ] AR: All expected trading days are present. [2025-10-02T17:18:08.580339] [DEBUG] [VALIDATOR ] AR: Primary data validation passed. [2025-10-02T17:18:08.581276] [INFO ] [MAIN ] AR: Fetched primary data is valid. [2025-10-02T17:18:08.581353] [DEBUG] [LOCAL ] AR: Saving primary data. [2025-10-02T17:18:08.583213] [DEBUG] [LOCAL ] AR: Trimmed 77533 records to 53973 (keeping 200 days of data) [2025-10-02T17:18:08.946765] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-02T17:18:08.982492] [DEBUG] [LOCAL ] AR: Primary data saved (53973 records). [2025-10-02T17:18:08.982692] [INFO ] [MAIN ] AR: Full history saved. [2025-10-02T17:18:08.983775] [INFO ] [MAIN ] Update Progress: 138/2370 symbols completed. AR took 39.1s. Estimated remaining: 4h 52m 31s. Rate: 7.6 symbols/min [2025-10-02T17:18:09.078104] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-06. [2025-10-02T17:18:09.181487] [INFO ] [MAIN ] ARE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:18:09.242090] [DEBUG] [LOCAL ] ARE: Loaded 50634 existing records from primary storage. [2025-10-02T17:18:09.242444] [INFO ] [MAIN ] ARE: Loaded 50634 existing records. [2025-10-02T17:18:09.444713] [WARN ] [MAIN ] ARE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:18:09.445066] [INFO ] [MAIN ] ARE: Wiping existing primary data before full refresh. [2025-10-02T17:18:09.445251] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-10-02T17:18:09.447560] [DEBUG] [LOCAL ] ARE: Deleted primary data file. [2025-10-02T17:18:09.447629] [INFO ] [MAIN ] ARE: Starting full primary refresh. [2025-10-02T17:18:09.638258] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-02T17:18:09.870629] [INFO ] [REMOTE ] ARE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:18:09.872975] [INFO ] [REMOTE ] ARE: Fetching primary data for 2024-12. [2025-10-02T17:18:10.648021] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-02T17:18:10.672983] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-07. [2025-10-02T17:18:11.473031] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-05. [2025-10-02T17:18:11.873663] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-02T17:18:12.203262] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-02T17:18:12.273039] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-01. [2025-10-02T17:18:12.407149] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-02T17:18:13.073000] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-06. [2025-10-02T17:18:13.460020] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-02T17:18:13.637456] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-02T17:18:13.873067] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-01. [2025-10-02T17:18:14.673004] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-02. [2025-10-02T17:18:15.370504] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-02T17:18:15.472993] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-02. [2025-10-02T17:18:15.822036] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-02T17:18:16.273043] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-07. [2025-10-02T17:18:16.818983] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-02T17:18:17.072981] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-03. [2025-10-02T17:18:17.486551] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-02T17:18:17.873032] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-08. [2025-10-02T17:18:18.523739] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-02T17:18:18.672980] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-04. [2025-10-02T17:18:18.820632] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-02T17:18:19.473014] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-03. [2025-10-02T17:18:20.272964] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-08. [2025-10-02T17:18:20.650618] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-02T17:18:20.969684] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-02T17:18:21.072969] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-04. [2025-10-02T17:18:21.872232] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-02T17:18:21.875771] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-09. [2025-10-02T17:18:21.932030] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-02T17:18:22.673043] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-05. [2025-10-02T17:18:22.714820] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-02T17:18:23.473036] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-05. [2025-10-02T17:18:23.798926] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-02T17:18:24.273074] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-09. [2025-10-02T17:18:25.072971] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-06. [2025-10-02T17:18:25.289473] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-02T17:18:25.866819] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-02T17:18:25.875669] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-10. [2025-10-02T17:18:25.892287] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-02T17:18:26.673044] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-06. [2025-10-02T17:18:26.692487] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-02T17:18:26.693948] [INFO ] [REMOTE ] ARDC: Full fetch complete (20672 records). [2025-10-02T17:18:26.694042] [DEBUG] [VALIDATOR ] ARDC: Validating primary data. [2025-10-02T17:18:27.148147] [DEBUG] [VALIDATOR ] ARDC: All expected trading days are present. [2025-10-02T17:18:27.148386] [DEBUG] [VALIDATOR ] ARDC: Primary data validation passed. [2025-10-02T17:18:27.148802] [INFO ] [MAIN ] ARDC: Fetched primary data is valid. [2025-10-02T17:18:27.148865] [DEBUG] [LOCAL ] ARDC: Saving primary data. [2025-10-02T17:18:27.149823] [DEBUG] [LOCAL ] ARDC: Trimmed 20672 records to 14882 (keeping 200 days of data) [2025-10-02T17:18:27.249392] [DEBUG] [LOCAL ] ARDC: Primary data saved (14882 records). [2025-10-02T17:18:27.249546] [INFO ] [MAIN ] ARDC: Full history saved. [2025-10-02T17:18:27.249696] [INFO ] [MAIN ] Update Progress: 139/2370 symbols completed. ARDC took 33.5s. Estimated remaining: 4h 55m 11s. Rate: 7.6 symbols/min [2025-10-02T17:18:27.443384] [INFO ] [MAIN ] ARES: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:18:27.443622] [DEBUG] [LOCAL ] ARES: No existing data file found in primary storage. [2025-10-02T17:18:27.443700] [WARN ] [MAIN ] ARES: No existing data found, performing full refresh instead. [2025-10-02T17:18:27.443878] [INFO ] [MAIN ] ARES: Wiping existing primary data before full refresh. [2025-10-02T17:18:27.443932] [INFO ] [LOCAL ] ARES: Starting deletion of primary data. [2025-10-02T17:18:27.443976] [DEBUG] [LOCAL ] ARES: No primary data file found to delete. [2025-10-02T17:18:27.444009] [INFO ] [MAIN ] ARES: Starting full primary refresh. [2025-10-02T17:18:27.479210] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-10. [2025-10-02T17:18:27.858809] [INFO ] [REMOTE ] ARES: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:18:28.273000] [INFO ] [REMOTE ] ARES: Fetching primary data for 2024-12. [2025-10-02T17:18:28.481225] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-02T17:18:28.849779] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-02T17:18:28.851734] [INFO ] [REMOTE ] ARCO: Full fetch complete (65498 records). [2025-10-02T17:18:28.851865] [DEBUG] [VALIDATOR ] ARCO: Validating primary data. [2025-10-02T17:18:29.079338] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-07. [2025-10-02T17:18:29.287188] [DEBUG] [VALIDATOR ] ARCO: All expected trading days are present. [2025-10-02T17:18:29.287286] [DEBUG] [VALIDATOR ] ARCO: Primary data validation passed. [2025-10-02T17:18:29.288168] [INFO ] [MAIN ] ARCO: Fetched primary data is valid. [2025-10-02T17:18:29.288246] [DEBUG] [LOCAL ] ARCO: Saving primary data. [2025-10-02T17:18:29.289820] [DEBUG] [LOCAL ] ARCO: Trimmed 65498 records to 44724 (keeping 200 days of data) [2025-10-02T17:18:29.572845] [DEBUG] [LOCAL ] ARCO: Primary data saved (44724 records). [2025-10-02T17:18:29.572980] [INFO ] [MAIN ] ARCO: Full history saved. [2025-10-02T17:18:29.574860] [INFO ] [MAIN ] Update Progress: 140/2370 symbols completed. ARCO took 41.6s. Estimated remaining: 4h 53m 33s. Rate: 7.6 symbols/min [2025-10-02T17:18:29.770199] [INFO ] [MAIN ] ARI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:18:29.800703] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-02T17:18:29.850355] [DEBUG] [LOCAL ] ARI: Loaded 43522 existing records from primary storage. [2025-10-02T17:18:29.850773] [INFO ] [MAIN ] ARI: Loaded 43522 existing records. [2025-10-02T17:18:29.882875] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-01. [2025-10-02T17:18:30.044581] [WARN ] [MAIN ] ARI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:18:30.044870] [INFO ] [MAIN ] ARI: Wiping existing primary data before full refresh. [2025-10-02T17:18:30.044922] [INFO ] [LOCAL ] ARI: Starting deletion of primary data. [2025-10-02T17:18:30.046223] [DEBUG] [LOCAL ] ARI: Deleted primary data file. [2025-10-02T17:18:30.046287] [INFO ] [MAIN ] ARI: Starting full primary refresh. [2025-10-02T17:18:30.444159] [INFO ] [REMOTE ] ARI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:18:30.616035] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-02T17:18:30.673048] [INFO ] [REMOTE ] ARI: Fetching primary data for 2024-12. [2025-10-02T17:18:31.225888] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-02T17:18:31.473042] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-08. [2025-10-02T17:18:32.175730] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-02T17:18:32.273004] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-02. [2025-10-02T17:18:32.904293] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-02T17:18:33.073012] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-01. [2025-10-02T17:18:33.872982] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-07. [2025-10-02T17:18:33.913577] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-02T17:18:34.587545] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-02T17:18:34.672999] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-02. [2025-10-02T17:18:35.472994] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-03. [2025-10-02T17:18:35.579164] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-02T17:18:36.222516] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-02T17:18:36.272968] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-03. [2025-10-02T17:18:37.073094] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-09. [2025-10-02T17:18:37.154456] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-02T17:18:37.873003] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-08. [2025-10-02T17:18:37.910763] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-02T17:18:38.174336] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-02T17:18:38.673003] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-10. [2025-10-02T17:18:39.472972] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-04. [2025-10-02T17:18:39.629175] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-02T17:18:39.631038] [INFO ] [REMOTE ] ARDT: Full fetch complete (41228 records). [2025-10-02T17:18:39.631270] [DEBUG] [VALIDATOR ] ARDT: Validating primary data. [2025-10-02T17:18:39.841451] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-02T17:18:40.082675] [DEBUG] [VALIDATOR ] ARDT: All expected trading days are present. [2025-10-02T17:18:40.082768] [DEBUG] [VALIDATOR ] ARDT: Primary data validation passed. [2025-10-02T17:18:40.083280] [INFO ] [MAIN ] ARDT: Fetched primary data is valid. [2025-10-02T17:18:40.083322] [DEBUG] [LOCAL ] ARDT: Saving primary data. [2025-10-02T17:18:40.084289] [DEBUG] [LOCAL ] ARDT: Trimmed 41228 records to 27847 (keeping 200 days of data) [2025-10-02T17:18:40.252053] [DEBUG] [LOCAL ] ARDT: Primary data saved (27847 records). [2025-10-02T17:18:40.252192] [INFO ] [MAIN ] ARDT: Full history saved. [2025-10-02T17:18:40.252377] [INFO ] [MAIN ] Update Progress: 141/2370 symbols completed. ARDT took 34.4s. Estimated remaining: 4h 54m 9s. Rate: 7.6 symbols/min [2025-10-02T17:18:40.278139] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-04. [2025-10-02T17:18:40.446923] [INFO ] [MAIN ] ARIS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:18:40.491229] [DEBUG] [LOCAL ] ARIS: Loaded 42157 existing records from primary storage. [2025-10-02T17:18:40.491551] [INFO ] [MAIN ] ARIS: Loaded 42157 existing records. [2025-10-02T17:18:40.683013] [WARN ] [MAIN ] ARIS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:18:40.683239] [INFO ] [MAIN ] ARIS: Wiping existing primary data before full refresh. [2025-10-02T17:18:40.683289] [INFO ] [LOCAL ] ARIS: Starting deletion of primary data. [2025-10-02T17:18:40.684802] [DEBUG] [LOCAL ] ARIS: Deleted primary data file. [2025-10-02T17:18:40.684865] [INFO ] [MAIN ] ARIS: Starting full primary refresh. [2025-10-02T17:18:41.076217] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-09. [2025-10-02T17:18:41.076122] [INFO ] [REMOTE ] ARIS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:18:41.466921] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-02T17:18:41.872997] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2024-12. [2025-10-02T17:18:42.673011] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-05. [2025-10-02T17:18:42.802214] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-10-02T17:18:42.879624] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-02T17:18:42.912357] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-02T17:18:43.473040] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-10. [2025-10-02T17:18:44.157108] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-02T17:18:44.273026] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-06. [2025-10-02T17:18:44.924807] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-02T17:18:44.928762] [INFO ] [REMOTE ] ARE: Full fetch complete (72644 records). [2025-10-02T17:18:44.928964] [DEBUG] [VALIDATOR ] ARE: Validating primary data. [2025-10-02T17:18:45.078118] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-05. [2025-10-02T17:18:45.376434] [DEBUG] [VALIDATOR ] ARE: All expected trading days are present. [2025-10-02T17:18:45.376529] [DEBUG] [VALIDATOR ] ARE: Primary data validation passed. [2025-10-02T17:18:45.377370] [INFO ] [MAIN ] ARE: Fetched primary data is valid. [2025-10-02T17:18:45.377464] [DEBUG] [LOCAL ] ARE: Saving primary data. [2025-10-02T17:18:45.379416] [DEBUG] [LOCAL ] ARE: Trimmed 72644 records to 51001 (keeping 200 days of data) [2025-10-02T17:18:45.732096] [DEBUG] [LOCAL ] ARE: Primary data saved (51001 records). [2025-10-02T17:18:45.732390] [INFO ] [MAIN ] ARE: Full history saved. [2025-10-02T17:18:45.734744] [INFO ] [MAIN ] Update Progress: 142/2370 symbols completed. ARE took 36.8s. Estimated remaining: 4h 53m 23s. Rate: 7.6 symbols/min [2025-10-02T17:18:45.874057] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-01. [2025-10-02T17:18:45.927850] [INFO ] [MAIN ] ARLO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:18:45.961353] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-02T17:18:46.019026] [DEBUG] [LOCAL ] ARLO: Loaded 43792 existing records from primary storage. [2025-10-02T17:18:46.019367] [INFO ] [MAIN ] ARLO: Loaded 43792 existing records. [2025-10-02T17:18:46.216292] [WARN ] [MAIN ] ARLO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:18:46.216559] [INFO ] [MAIN ] ARLO: Wiping existing primary data before full refresh. [2025-10-02T17:18:46.216623] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-10-02T17:18:46.218070] [DEBUG] [LOCAL ] ARLO: Deleted primary data file. [2025-10-02T17:18:46.218145] [INFO ] [MAIN ] ARLO: Starting full primary refresh. [2025-10-02T17:18:46.690744] [INFO ] [REMOTE ] ARLO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:18:46.679576] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-07. [2025-10-02T17:18:46.704974] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-02T17:18:47.473054] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-06. [2025-10-02T17:18:47.596885] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-02T17:18:48.273020] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-02. [2025-10-02T17:18:48.480164] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-02T17:18:48.775640] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-02T17:18:49.073007] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2024-12. [2025-10-02T17:18:49.788826] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-02T17:18:49.873005] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-08. [2025-10-02T17:18:50.509173] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-02T17:18:50.672998] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-01. [2025-10-02T17:18:51.386823] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-02T17:18:51.473009] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-03. [2025-10-02T17:18:52.173165] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-02T17:18:52.273007] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-07. [2025-10-02T17:18:53.041883] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-02T17:18:53.073004] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-09. [2025-10-02T17:18:53.546757] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-02T17:18:53.873019] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-04. [2025-10-02T17:18:54.664043] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-02T17:18:54.674714] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-02. [2025-10-02T17:18:55.473066] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-08. [2025-10-02T17:18:55.511929] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-02T17:18:55.707558] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-02T17:18:56.273010] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-05. [2025-10-02T17:18:56.658960] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-02T17:18:57.073006] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-03. [2025-10-02T17:18:57.872948] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-02T17:18:57.873091] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-10. [2025-10-02T17:18:58.672977] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-06. [2025-10-02T17:18:58.707202] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-02T17:18:59.421606] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-02T17:18:59.424023] [INFO ] [REMOTE ] ARES: Full fetch complete (70745 records). [2025-10-02T17:18:59.424139] [DEBUG] [VALIDATOR ] ARES: Validating primary data. [2025-10-02T17:18:59.484469] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-04. [2025-10-02T17:18:59.870627] [DEBUG] [VALIDATOR ] ARES: All expected trading days are present. [2025-10-02T17:18:59.870851] [DEBUG] [VALIDATOR ] ARES: Primary data validation passed. [2025-10-02T17:18:59.871712] [INFO ] [MAIN ] ARES: Fetched primary data is valid. [2025-10-02T17:18:59.871823] [DEBUG] [LOCAL ] ARES: Saving primary data. [2025-10-02T17:18:59.873483] [DEBUG] [LOCAL ] ARES: Trimmed 70745 records to 49934 (keeping 200 days of data) [2025-10-02T17:19:00.128540] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-02T17:19:00.274298] [DEBUG] [LOCAL ] ARES: Primary data saved (49934 records). [2025-10-02T17:19:00.274389] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-07. [2025-10-02T17:19:00.274730] [INFO ] [MAIN ] ARES: Full history saved. [2025-10-02T17:19:00.275904] [INFO ] [MAIN ] Update Progress: 143/2370 symbols completed. ARES took 33.0s. Estimated remaining: 4h 54m 59s. Rate: 7.5 symbols/min [2025-10-02T17:19:00.480888] [INFO ] [MAIN ] ARMK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:19:00.529899] [DEBUG] [LOCAL ] ARMK: Loaded 50366 existing records from primary storage. [2025-10-02T17:19:00.530289] [INFO ] [MAIN ] ARMK: Loaded 50366 existing records. [2025-10-02T17:19:00.722163] [WARN ] [MAIN ] ARMK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:19:00.722392] [INFO ] [MAIN ] ARMK: Wiping existing primary data before full refresh. [2025-10-02T17:19:00.722461] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-10-02T17:19:00.723905] [DEBUG] [LOCAL ] ARMK: Deleted primary data file. [2025-10-02T17:19:00.723978] [INFO ] [MAIN ] ARMK: Starting full primary refresh. [2025-10-02T17:19:01.087630] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-09. [2025-10-02T17:19:01.141738] [INFO ] [REMOTE ] ARMK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:19:01.171923] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-02T17:19:01.873000] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2024-12. [2025-10-02T17:19:02.302664] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-02T17:19:02.381761] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-02T17:19:02.672990] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-08. [2025-10-02T17:19:03.236965] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-02T17:19:03.472969] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-01. [2025-10-02T17:19:04.272994] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-10. [2025-10-02T17:19:04.353520] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-02T17:19:05.078159] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-09. [2025-10-02T17:19:05.101357] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-02T17:19:05.380082] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-02T17:19:05.382007] [INFO ] [REMOTE ] ARI: Full fetch complete (62856 records). [2025-10-02T17:19:05.382119] [DEBUG] [VALIDATOR ] ARI: Validating primary data. [2025-10-02T17:19:05.821248] [DEBUG] [VALIDATOR ] ARI: All expected trading days are present. [2025-10-02T17:19:05.821337] [DEBUG] [VALIDATOR ] ARI: Primary data validation passed. [2025-10-02T17:19:05.822068] [INFO ] [MAIN ] ARI: Fetched primary data is valid. [2025-10-02T17:19:05.822138] [DEBUG] [LOCAL ] ARI: Saving primary data. [2025-10-02T17:19:05.823457] [DEBUG] [LOCAL ] ARI: Trimmed 62856 records to 43834 (keeping 200 days of data) [2025-10-02T17:19:05.888981] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-02. [2025-10-02T17:19:06.135862] [DEBUG] [LOCAL ] ARI: Primary data saved (43834 records). [2025-10-02T17:19:06.136004] [INFO ] [MAIN ] ARI: Full history saved. [2025-10-02T17:19:06.136918] [INFO ] [MAIN ] Update Progress: 144/2370 symbols completed. ARI took 36.6s. Estimated remaining: 4h 54m 18s. Rate: 7.6 symbols/min [2025-10-02T17:19:06.339800] [INFO ] [MAIN ] AROC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:19:06.401404] [DEBUG] [LOCAL ] AROC: Loaded 48961 existing records from primary storage. [2025-10-02T17:19:06.401774] [INFO ] [MAIN ] AROC: Loaded 48961 existing records. [2025-10-02T17:19:06.612267] [WARN ] [MAIN ] AROC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:19:06.612808] [INFO ] [MAIN ] AROC: Wiping existing primary data before full refresh. [2025-10-02T17:19:06.612898] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-10-02T17:19:06.614493] [DEBUG] [LOCAL ] AROC: Deleted primary data file. [2025-10-02T17:19:06.614559] [INFO ] [MAIN ] AROC: Starting full primary refresh. [2025-10-02T17:19:06.692012] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-05. [2025-10-02T17:19:06.931172] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-02T17:19:07.073079] [INFO ] [REMOTE ] AROC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:19:07.472974] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-10. [2025-10-02T17:19:07.641629] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-02T17:19:08.210757] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-02T17:19:08.272982] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-03. [2025-10-02T17:19:08.740738] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-02T17:19:08.742493] [INFO ] [REMOTE ] ARIS: Full fetch complete (60223 records). [2025-10-02T17:19:08.742608] [DEBUG] [VALIDATOR ] ARIS: Validating primary data. [2025-10-02T17:19:08.743347] [FATAL] [VALIDATOR ] ARIS: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:19:08.743441] [FATAL] [MAIN ] ARIS: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:19:08.743486] [WARN ] [MAIN ] ARIS: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:19:08.743557] [INFO ] [LOCAL ] ARIS: Starting deletion of primary data. [2025-10-02T17:19:08.743628] [DEBUG] [LOCAL ] ARIS: No primary data file found to delete. [2025-10-02T17:19:08.743710] [INFO ] [LOCAL ] ARIS: Starting deletion of derivative data. [2025-10-02T17:19:08.744414] [DEBUG] [LOCAL ] ARIS: Deleted derivative data file. [2025-10-02T17:19:08.744555] [INFO ] [MAIN ] Update Progress: 145/2370 symbols completed. ARIS took 28.5s. Estimated remaining: 4h 52m 49s. Rate: 7.6 symbols/min [2025-10-02T17:19:08.926491] [INFO ] [MAIN ] ARR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:19:08.926694] [DEBUG] [LOCAL ] ARR: No existing data file found in primary storage. [2025-10-02T17:19:08.926749] [WARN ] [MAIN ] ARR: No existing data found, performing full refresh instead. [2025-10-02T17:19:08.926863] [INFO ] [MAIN ] ARR: Wiping existing primary data before full refresh. [2025-10-02T17:19:08.926906] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-10-02T17:19:08.926950] [DEBUG] [LOCAL ] ARR: No primary data file found to delete. [2025-10-02T17:19:08.926983] [INFO ] [MAIN ] ARR: Starting full primary refresh. [2025-10-02T17:19:09.080325] [INFO ] [REMOTE ] AROC: Fetching primary data for 2024-12. [2025-10-02T17:19:09.322877] [INFO ] [REMOTE ] ARR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:19:09.872978] [INFO ] [REMOTE ] ARR: Fetching primary data for 2024-12. [2025-10-02T17:19:10.056734] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-02T17:19:10.673002] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-06. [2025-10-02T17:19:10.749826] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-02T17:19:11.473049] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-04. [2025-10-02T17:19:12.012630] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-02T17:19:12.094090] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-10-02T17:19:12.272998] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-01. [2025-10-02T17:19:13.073011] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-07. [2025-10-02T17:19:13.227739] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-02T17:19:13.873014] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-01. [2025-10-02T17:19:14.084847] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-02T17:19:14.439412] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-02T17:19:14.673023] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-02. [2025-10-02T17:19:15.129133] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-02T17:19:15.473063] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-08. [2025-10-02T17:19:16.198984] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-02T17:19:16.273016] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-02. [2025-10-02T17:19:16.879419] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-02T17:19:17.073023] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-03. [2025-10-02T17:19:17.652752] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-02T17:19:17.873014] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-03. [2025-10-02T17:19:18.673011] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-05. [2025-10-02T17:19:19.057440] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-02T17:19:19.472978] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-04. [2025-10-02T17:19:19.650165] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-02T17:19:20.273018] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-04. [2025-10-02T17:19:20.664213] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-02T17:19:21.073019] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-09. [2025-10-02T17:19:21.535684] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-02T17:19:21.873013] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-05. [2025-10-02T17:19:22.238488] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-02T17:19:22.673024] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-06. [2025-10-02T17:19:22.819143] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-02T17:19:23.472980] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-10. [2025-10-02T17:19:23.670260] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-02T17:19:24.029020] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-02T17:19:24.272997] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-07. [2025-10-02T17:19:24.896160] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-02T17:19:24.899110] [INFO ] [REMOTE ] ARLO: Full fetch complete (62819 records). [2025-10-02T17:19:24.899330] [DEBUG] [VALIDATOR ] ARLO: Validating primary data. [2025-10-02T17:19:25.086272] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-05. [2025-10-02T17:19:25.337787] [DEBUG] [VALIDATOR ] ARLO: All expected trading days are present. [2025-10-02T17:19:25.337907] [DEBUG] [VALIDATOR ] ARLO: Primary data validation passed. [2025-10-02T17:19:25.338682] [INFO ] [MAIN ] ARLO: Fetched primary data is valid. [2025-10-02T17:19:25.338750] [DEBUG] [LOCAL ] ARLO: Saving primary data. [2025-10-02T17:19:25.340303] [DEBUG] [LOCAL ] ARLO: Trimmed 62819 records to 44159 (keeping 200 days of data) [2025-10-02T17:19:25.612733] [DEBUG] [LOCAL ] ARLO: Primary data saved (44159 records). [2025-10-02T17:19:25.612876] [INFO ] [MAIN ] ARLO: Full history saved. [2025-10-02T17:19:25.613962] [INFO ] [MAIN ] Update Progress: 146/2370 symbols completed. ARLO took 39.9s. Estimated remaining: 4h 54m 58s. Rate: 7.5 symbols/min [2025-10-02T17:19:25.808609] [INFO ] [MAIN ] ARW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:19:25.850027] [DEBUG] [LOCAL ] ARW: Loaded 33095 existing records from primary storage. [2025-10-02T17:19:25.850413] [INFO ] [MAIN ] ARW: Loaded 33095 existing records. [2025-10-02T17:19:25.878143] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-06. [2025-10-02T17:19:26.089258] [WARN ] [MAIN ] ARW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:19:26.090055] [INFO ] [MAIN ] ARW: Wiping existing primary data before full refresh. [2025-10-02T17:19:26.090117] [INFO ] [LOCAL ] ARW: Starting deletion of primary data. [2025-10-02T17:19:26.091607] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-02T17:19:26.103163] [DEBUG] [LOCAL ] ARW: Deleted primary data file. [2025-10-02T17:19:26.103252] [INFO ] [MAIN ] ARW: Starting full primary refresh. [2025-10-02T17:19:26.492757] [INFO ] [REMOTE ] ARW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:19:26.672967] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-08. [2025-10-02T17:19:26.780130] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-02T17:19:27.472981] [INFO ] [REMOTE ] ARW: Fetching primary data for 2024-12. [2025-10-02T17:19:27.811827] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-02T17:19:28.272970] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-07. [2025-10-02T17:19:28.378857] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-02T17:19:28.735475] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-02T17:19:29.073030] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-06. [2025-10-02T17:19:29.864126] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-02T17:19:29.875366] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-09. [2025-10-02T17:19:30.673000] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-01. [2025-10-02T17:19:30.711727] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-02T17:19:31.473017] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-07. [2025-10-02T17:19:31.618959] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-02T17:19:31.686863] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-02T17:19:32.273044] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-08. [2025-10-02T17:19:33.072984] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-02. [2025-10-02T17:19:33.259114] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-02T17:19:33.872998] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-08. [2025-10-02T17:19:34.274660] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-02T17:19:34.489101] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-02T17:19:34.673017] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-10. [2025-10-02T17:19:35.473029] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-09. [2025-10-02T17:19:35.582058] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-02T17:19:36.057996] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-02T17:19:36.060096] [INFO ] [REMOTE ] ARMK: Full fetch complete (72568 records). [2025-10-02T17:19:36.060219] [DEBUG] [VALIDATOR ] ARMK: Validating primary data. [2025-10-02T17:19:36.278198] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-03. [2025-10-02T17:19:36.510313] [DEBUG] [VALIDATOR ] ARMK: All expected trading days are present. [2025-10-02T17:19:36.510405] [DEBUG] [VALIDATOR ] ARMK: Primary data validation passed. [2025-10-02T17:19:36.511207] [INFO ] [MAIN ] ARMK: Fetched primary data is valid. [2025-10-02T17:19:36.511283] [DEBUG] [LOCAL ] ARMK: Saving primary data. [2025-10-02T17:19:36.513071] [DEBUG] [LOCAL ] ARMK: Trimmed 72568 records to 50699 (keeping 200 days of data) [2025-10-02T17:19:36.844825] [DEBUG] [LOCAL ] ARMK: Primary data saved (50699 records). [2025-10-02T17:19:36.845012] [INFO ] [MAIN ] ARMK: Full history saved. [2025-10-02T17:19:36.845140] [INFO ] [MAIN ] Update Progress: 147/2370 symbols completed. ARMK took 36.6s. Estimated remaining: 4h 55m 39s. Rate: 7.5 symbols/min [2025-10-02T17:19:37.056760] [INFO ] [MAIN ] ARX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:19:37.056959] [DEBUG] [LOCAL ] ARX: No existing data file found in primary storage. [2025-10-02T17:19:37.057003] [WARN ] [MAIN ] ARX: No existing data found, performing full refresh instead. [2025-10-02T17:19:37.057133] [INFO ] [MAIN ] ARX: Wiping existing primary data before full refresh. [2025-10-02T17:19:37.057177] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-02T17:19:37.057219] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-02T17:19:37.057251] [INFO ] [MAIN ] ARX: Starting full primary refresh. [2025-10-02T17:19:37.092014] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-09. [2025-10-02T17:19:37.488244] [INFO ] [REMOTE ] ARX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:19:37.521883] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-02T17:19:37.659701] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-02T17:19:37.873001] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-10. [2025-10-02T17:19:38.673001] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-04. [2025-10-02T17:19:38.951923] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-02T17:19:39.473040] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-10. [2025-10-02T17:19:39.734825] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-02T17:19:39.737825] [INFO ] [REMOTE ] ARR: Full fetch complete (75228 records). [2025-10-02T17:19:39.737986] [DEBUG] [VALIDATOR ] ARR: Validating primary data. [2025-10-02T17:19:40.194155] [DEBUG] [VALIDATOR ] ARR: All expected trading days are present. [2025-10-02T17:19:40.194254] [DEBUG] [VALIDATOR ] ARR: Primary data validation passed. [2025-10-02T17:19:40.195205] [INFO ] [MAIN ] ARR: Fetched primary data is valid. [2025-10-02T17:19:40.195273] [DEBUG] [LOCAL ] ARR: Saving primary data. [2025-10-02T17:19:40.196979] [DEBUG] [LOCAL ] ARR: Trimmed 75228 records to 52419 (keeping 200 days of data) [2025-10-02T17:19:40.299432] [INFO ] [REMOTE ] ARX: Fetching primary data for 2024-12. [2025-10-02T17:19:40.354812] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-02T17:19:40.542360] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T17:19:40.564214] [WARN ] [REMOTE ] ARX: No data returned for month 2024-12 [2025-10-02T17:19:40.565498] [FATAL] [REMOTE ] ARX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T17:19:40.565862] [FATAL] [MAIN ] ARX: Failed to fetch primary data. [2025-10-02T17:19:40.567464] [WARN ] [MAIN ] ARX: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T17:19:40.568104] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-02T17:19:40.569921] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-02T17:19:40.571958] [INFO ] [LOCAL ] ARX: Starting deletion of derivative data. [2025-10-02T17:19:40.573548] [DEBUG] [LOCAL ] ARX: No derivative data file found to delete. [2025-10-02T17:19:40.574572] [INFO ] [MAIN ] Update Progress: 148/2370 symbols completed. ARX took 3.7s. Estimated remaining: 4h 54m 27s. Rate: 7.5 symbols/min [2025-10-02T17:19:40.680323] [DEBUG] [LOCAL ] ARR: Primary data saved (52419 records). [2025-10-02T17:19:40.696784] [INFO ] [MAIN ] ARR: Full history saved. [2025-10-02T17:19:40.701263] [INFO ] [MAIN ] Update Progress: 149/2370 symbols completed. ARR took 32.0s. Estimated remaining: 4h 52m 23s. Rate: 7.6 symbols/min [2025-10-02T17:19:40.867954] [INFO ] [MAIN ] AS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:19:40.973515] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-02T17:19:40.977877] [INFO ] [MAIN ] ASA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:19:40.980716] [INFO ] [REMOTE ] AROC: Full fetch complete (70806 records). [2025-10-02T17:19:40.980889] [DEBUG] [VALIDATOR ] AROC: Validating primary data. [2025-10-02T17:19:41.073505] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-05. [2025-10-02T17:19:41.105669] [DEBUG] [LOCAL ] ASA: Loaded 14164 existing records from primary storage. [2025-10-02T17:19:41.162962] [INFO ] [MAIN ] ASA: Loaded 14164 existing records. [2025-10-02T17:19:41.363248] [DEBUG] [LOCAL ] AS: Loaded 53087 existing records from primary storage. [2025-10-02T17:19:41.454074] [INFO ] [MAIN ] AS: Loaded 53087 existing records. [2025-10-02T17:19:41.684585] [WARN ] [MAIN ] ASA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:19:41.745961] [INFO ] [MAIN ] ASA: Wiping existing primary data before full refresh. [2025-10-02T17:19:41.774007] [INFO ] [LOCAL ] ASA: Starting deletion of primary data. [2025-10-02T17:19:41.808376] [DEBUG] [VALIDATOR ] AROC: All expected trading days are present. [2025-10-02T17:19:41.824257] [DEBUG] [LOCAL ] ASA: Deleted primary data file. [2025-10-02T17:19:41.849334] [INFO ] [MAIN ] ASA: Starting full primary refresh. [2025-10-02T17:19:41.849438] [DEBUG] [VALIDATOR ] AROC: Primary data validation passed. [2025-10-02T17:19:41.897366] [WARN ] [MAIN ] AS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:19:41.942449] [INFO ] [MAIN ] AROC: Fetched primary data is valid. [2025-10-02T17:19:41.970398] [INFO ] [MAIN ] AS: Wiping existing primary data before full refresh. [2025-10-02T17:19:41.990398] [INFO ] [LOCAL ] AS: Starting deletion of primary data. [2025-10-02T17:19:41.990528] [DEBUG] [LOCAL ] AROC: Saving primary data. [2025-10-02T17:19:42.012703] [DEBUG] [LOCAL ] AS: Deleted primary data file. [2025-10-02T17:19:42.019325] [INFO ] [MAIN ] AS: Starting full primary refresh. [2025-10-02T17:19:42.109917] [DEBUG] [LOCAL ] AROC: Trimmed 70806 records to 49327 (keeping 200 days of data) [2025-10-02T17:19:42.779917] [INFO ] [REMOTE ] ASA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:19:42.813368] [INFO ] [REMOTE ] ASA: Fetching primary data for 2024-12. [2025-10-02T17:19:42.969598] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-02T17:19:42.983780] [INFO ] [REMOTE ] AS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:19:43.014905] [INFO ] [REMOTE ] AS: Fetching primary data for 2024-12. [2025-10-02T17:19:43.118239] [DEBUG] [LOCAL ] AROC: Primary data saved (49327 records). [2025-10-02T17:19:43.118385] [INFO ] [MAIN ] AROC: Full history saved. [2025-10-02T17:19:43.118470] [INFO ] [MAIN ] Update Progress: 150/2370 symbols completed. AROC took 37.0s. Estimated remaining: 4h 50m 54s. Rate: 7.6 symbols/min [2025-10-02T17:19:43.304015] [INFO ] [MAIN ] ASAN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:19:43.369194] [DEBUG] [LOCAL ] ASAN: Loaded 52722 existing records from primary storage. [2025-10-02T17:19:43.369603] [INFO ] [MAIN ] ASAN: Loaded 52722 existing records. [2025-10-02T17:19:43.478294] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-06. [2025-10-02T17:19:43.597951] [WARN ] [MAIN ] ASAN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:19:43.598244] [INFO ] [MAIN ] ASAN: Wiping existing primary data before full refresh. [2025-10-02T17:19:43.598300] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-10-02T17:19:43.599363] [DEBUG] [LOCAL ] ASAN: Deleted primary data file. [2025-10-02T17:19:43.599423] [INFO ] [MAIN ] ASAN: Starting full primary refresh. [2025-10-02T17:19:43.878493] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-02T17:19:43.992786] [INFO ] [REMOTE ] ASAN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:19:44.273005] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-01. [2025-10-02T17:19:44.617079] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-02T17:19:44.814121] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-02T17:19:45.076541] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-07. [2025-10-02T17:19:45.079623] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-02T17:19:45.873030] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-01. [2025-10-02T17:19:46.161898] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-02T17:19:46.673014] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2024-12. [2025-10-02T17:19:47.473013] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-08. [2025-10-02T17:19:47.512267] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-02T17:19:48.273034] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-02. [2025-10-02T17:19:48.489370] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-02T17:19:48.940229] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-02T17:19:49.073005] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-01. [2025-10-02T17:19:49.880883] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-02. [2025-10-02T17:19:49.905281] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-02T17:19:50.476940] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-02T17:19:50.673016] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-03. [2025-10-02T17:19:50.690320] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-02T17:19:51.473009] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-03. [2025-10-02T17:19:52.176792] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-02T17:19:52.197757] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-02T17:19:52.273002] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-04. [2025-10-02T17:19:53.073026] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-09. [2025-10-02T17:19:53.709265] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-02T17:19:53.873018] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-02. [2025-10-02T17:19:54.246379] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-02T17:19:54.672999] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-10. [2025-10-02T17:19:55.472995] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-04. [2025-10-02T17:19:55.588558] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-02T17:19:55.866255] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-02T17:19:55.868481] [INFO ] [REMOTE ] ARW: Full fetch complete (47988 records). [2025-10-02T17:19:55.868702] [DEBUG] [VALIDATOR ] ARW: Validating primary data. [2025-10-02T17:19:56.301208] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-03. [2025-10-02T17:19:56.320225] [DEBUG] [VALIDATOR ] ARW: All expected trading days are present. [2025-10-02T17:19:56.320345] [DEBUG] [VALIDATOR ] ARW: Primary data validation passed. [2025-10-02T17:19:56.321200] [INFO ] [MAIN ] ARW: Fetched primary data is valid. [2025-10-02T17:19:56.321285] [DEBUG] [LOCAL ] ARW: Saving primary data. [2025-10-02T17:19:56.333108] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-02T17:19:56.333220] [DEBUG] [LOCAL ] ARW: Trimmed 47988 records to 33339 (keeping 200 days of data) [2025-10-02T17:19:56.555144] [DEBUG] [LOCAL ] ARW: Primary data saved (33339 records). [2025-10-02T17:19:56.555290] [INFO ] [MAIN ] ARW: Full history saved. [2025-10-02T17:19:56.556441] [INFO ] [MAIN ] Update Progress: 151/2370 symbols completed. ARW took 30.9s. Estimated remaining: 4h 52m 8s. Rate: 7.6 symbols/min [2025-10-02T17:19:56.744595] [INFO ] [MAIN ] ASB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:19:56.798895] [DEBUG] [LOCAL ] ASB: Loaded 49511 existing records from primary storage. [2025-10-02T17:19:56.799308] [INFO ] [MAIN ] ASB: Loaded 49511 existing records. [2025-10-02T17:19:56.990088] [WARN ] [MAIN ] ASB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:19:56.990354] [INFO ] [MAIN ] ASB: Wiping existing primary data before full refresh. [2025-10-02T17:19:56.990404] [INFO ] [LOCAL ] ASB: Starting deletion of primary data. [2025-10-02T17:19:56.991550] [DEBUG] [LOCAL ] ASB: Deleted primary data file. [2025-10-02T17:19:56.991612] [INFO ] [MAIN ] ASB: Starting full primary refresh. [2025-10-02T17:19:57.078262] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-05. [2025-10-02T17:19:57.387616] [INFO ] [REMOTE ] ASB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:19:57.872999] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-05. [2025-10-02T17:19:58.326585] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-02T17:19:58.676436] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-04. [2025-10-02T17:19:58.685180] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-02T17:19:58.707430] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-02T17:19:59.473035] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-06. [2025-10-02T17:20:00.262215] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-02T17:20:00.272976] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-06. [2025-10-02T17:20:01.073059] [INFO ] [REMOTE ] ASB: Fetching primary data for 2024-12. [2025-10-02T17:20:01.243940] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-02T17:20:01.376383] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-02T17:20:01.873004] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-07. [2025-10-02T17:20:02.672999] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-07. [2025-10-02T17:20:02.943000] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-02T17:20:03.472967] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-01. [2025-10-02T17:20:03.697030] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-02T17:20:03.746191] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-02T17:20:04.273008] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-08. [2025-10-02T17:20:05.072989] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-05. [2025-10-02T17:20:05.194989] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-02T17:20:05.289266] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-02T17:20:05.873013] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-09. [2025-10-02T17:20:06.673031] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-08. [2025-10-02T17:20:06.949032] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-02T17:20:07.102365] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-02T17:20:07.473043] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-06. [2025-10-02T17:20:08.286179] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-02. [2025-10-02T17:20:08.292926] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-02T17:20:09.072965] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-09. [2025-10-02T17:20:09.346887] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-02T17:20:09.671257] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-02T17:20:09.873034] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-10. [2025-10-02T17:20:10.673029] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-07. [2025-10-02T17:20:10.853244] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-02T17:20:10.870272] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-02T17:20:10.871708] [INFO ] [REMOTE ] ASA: Full fetch complete (18960 records). [2025-10-02T17:20:10.871846] [DEBUG] [VALIDATOR ] ASA: Validating primary data. [2025-10-02T17:20:11.345810] [DEBUG] [VALIDATOR ] ASA: All expected trading days are present. [2025-10-02T17:20:11.345893] [DEBUG] [VALIDATOR ] ASA: Primary data validation passed. [2025-10-02T17:20:11.346231] [INFO ] [MAIN ] ASA: Fetched primary data is valid. [2025-10-02T17:20:11.346279] [DEBUG] [LOCAL ] ASA: Saving primary data. [2025-10-02T17:20:11.346975] [DEBUG] [LOCAL ] ASA: Trimmed 18960 records to 14321 (keeping 200 days of data) [2025-10-02T17:20:11.437062] [DEBUG] [LOCAL ] ASA: Primary data saved (14321 records). [2025-10-02T17:20:11.437254] [INFO ] [MAIN ] ASA: Full history saved. [2025-10-02T17:20:11.437357] [INFO ] [MAIN ] Update Progress: 152/2370 symbols completed. ASA took 30.7s. Estimated remaining: 4h 53m 42s. Rate: 7.6 symbols/min [2025-10-02T17:20:11.478161] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-03. [2025-10-02T17:20:11.653239] [INFO ] [MAIN ] ASBA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:20:11.653435] [DEBUG] [LOCAL ] ASBA: No existing data file found in primary storage. [2025-10-02T17:20:11.653475] [WARN ] [MAIN ] ASBA: No existing data found, performing full refresh instead. [2025-10-02T17:20:11.653617] [INFO ] [MAIN ] ASBA: Wiping existing primary data before full refresh. [2025-10-02T17:20:11.653707] [INFO ] [LOCAL ] ASBA: Starting deletion of primary data. [2025-10-02T17:20:11.653764] [DEBUG] [LOCAL ] ASBA: No primary data file found to delete. [2025-10-02T17:20:11.653800] [INFO ] [MAIN ] ASBA: Starting full primary refresh. [2025-10-02T17:20:12.061627] [INFO ] [REMOTE ] ASBA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:20:12.272962] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-10. [2025-10-02T17:20:12.761108] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-02T17:20:13.073008] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-08. [2025-10-02T17:20:13.873067] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2024-12. [2025-10-02T17:20:14.276252] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-02T17:20:14.278709] [INFO ] [REMOTE ] AS: Full fetch complete (76550 records). [2025-10-02T17:20:14.278858] [DEBUG] [VALIDATOR ] AS: Validating primary data. [2025-10-02T17:20:14.521763] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-02T17:20:14.681975] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-01. [2025-10-02T17:20:14.735249] [DEBUG] [VALIDATOR ] AS: All expected trading days are present. [2025-10-02T17:20:14.735351] [DEBUG] [VALIDATOR ] AS: Primary data validation passed. [2025-10-02T17:20:14.736174] [INFO ] [MAIN ] AS: Fetched primary data is valid. [2025-10-02T17:20:14.736398] [DEBUG] [LOCAL ] AS: Saving primary data. [2025-10-02T17:20:14.738524] [DEBUG] [LOCAL ] AS: Trimmed 76550 records to 53472 (keeping 200 days of data) [2025-10-02T17:20:14.866787] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-02T17:20:15.115850] [DEBUG] [LOCAL ] AS: Primary data saved (53472 records). [2025-10-02T17:20:15.115997] [INFO ] [MAIN ] AS: Full history saved. [2025-10-02T17:20:15.116085] [INFO ] [MAIN ] Update Progress: 153/2370 symbols completed. AS took 34.5s. Estimated remaining: 4h 52m 32s. Rate: 7.6 symbols/min [2025-10-02T17:20:15.310395] [INFO ] [MAIN ] ASC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:20:15.349848] [DEBUG] [LOCAL ] ASC: Loaded 37387 existing records from primary storage. [2025-10-02T17:20:15.350150] [INFO ] [MAIN ] ASC: Loaded 37387 existing records. [2025-10-02T17:20:15.474985] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-09. [2025-10-02T17:20:15.477048] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-02T17:20:15.598762] [WARN ] [MAIN ] ASC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:20:15.599087] [INFO ] [MAIN ] ASC: Wiping existing primary data before full refresh. [2025-10-02T17:20:15.601404] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-03 (4.12 seconds). [2025-10-02T17:20:15.599874] [INFO ] [LOCAL ] ASC: Starting deletion of primary data. [2025-10-02T17:20:15.612011] [DEBUG] [LOCAL ] ASC: Deleted primary data file. [2025-10-02T17:20:15.612595] [INFO ] [MAIN ] ASC: Starting full primary refresh. [2025-10-02T17:20:16.015831] [INFO ] [REMOTE ] ASC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:20:16.273010] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-02. [2025-10-02T17:20:17.073016] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-04. [2025-10-02T17:20:17.159036] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-02T17:20:17.332986] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-02T17:20:17.873044] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-03. [2025-10-02T17:20:18.495906] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-02T17:20:18.673005] [INFO ] [REMOTE ] ASC: Fetching primary data for 2024-12. [2025-10-02T17:20:18.811469] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-02T17:20:19.473053] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-05. [2025-10-02T17:20:20.278424] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-04. [2025-10-02T17:20:20.290985] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-02T17:20:21.073002] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-10. [2025-10-02T17:20:21.177728] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-02T17:20:21.210962] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-02T17:20:21.873002] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-05. [2025-10-02T17:20:22.455155] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-02T17:20:22.672970] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-06. [2025-10-02T17:20:22.911629] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-02T17:20:22.913851] [INFO ] [REMOTE ] ASAN: Full fetch complete (76529 records). [2025-10-02T17:20:22.913979] [DEBUG] [VALIDATOR ] ASAN: Validating primary data. [2025-10-02T17:20:23.354045] [DEBUG] [VALIDATOR ] ASAN: All expected trading days are present. [2025-10-02T17:20:23.354143] [DEBUG] [VALIDATOR ] ASAN: Primary data validation passed. [2025-10-02T17:20:23.354946] [INFO ] [MAIN ] ASAN: Fetched primary data is valid. [2025-10-02T17:20:23.355023] [DEBUG] [LOCAL ] ASAN: Saving primary data. [2025-10-02T17:20:23.356525] [DEBUG] [LOCAL ] ASAN: Trimmed 76529 records to 53110 (keeping 200 days of data) [2025-10-02T17:20:23.474754] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-01. [2025-10-02T17:20:23.700009] [DEBUG] [LOCAL ] ASAN: Primary data saved (53110 records). [2025-10-02T17:20:23.700188] [INFO ] [MAIN ] ASAN: Full history saved. [2025-10-02T17:20:23.701420] [INFO ] [MAIN ] Update Progress: 154/2370 symbols completed. ASAN took 40.6s. Estimated remaining: 4h 52m 34s. Rate: 7.6 symbols/min [2025-10-02T17:20:23.894303] [INFO ] [MAIN ] ASG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:20:23.916149] [DEBUG] [LOCAL ] ASG: Loaded 19882 existing records from primary storage. [2025-10-02T17:20:23.916425] [INFO ] [MAIN ] ASG: Loaded 19882 existing records. [2025-10-02T17:20:24.122092] [WARN ] [MAIN ] ASG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:20:24.122474] [INFO ] [MAIN ] ASG: Wiping existing primary data before full refresh. [2025-10-02T17:20:24.122572] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-10-02T17:20:24.123217] [DEBUG] [LOCAL ] ASG: Deleted primary data file. [2025-10-02T17:20:24.123288] [INFO ] [MAIN ] ASG: Starting full primary refresh. [2025-10-02T17:20:24.281851] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-06. [2025-10-02T17:20:24.322069] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-02T17:20:24.561683] [INFO ] [REMOTE ] ASG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:20:25.072959] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-07. [2025-10-02T17:20:25.173584] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-02T17:20:25.263037] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-02T17:20:25.873013] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-07. [2025-10-02T17:20:26.525594] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-02T17:20:26.672980] [INFO ] [REMOTE ] ASG: Fetching primary data for 2024-12. [2025-10-02T17:20:26.962537] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-02T17:20:27.473010] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-08. [2025-10-02T17:20:27.877427] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-02T17:20:28.273025] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-01. [2025-10-02T17:20:28.749923] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-02T17:20:29.073030] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-08. [2025-10-02T17:20:29.474482] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-02T17:20:29.494056] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-02T17:20:29.873036] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-09. [2025-10-02T17:20:30.422819] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-02T17:20:30.673038] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-10. [2025-10-02T17:20:31.131821] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-02T17:20:31.132639] [INFO ] [REMOTE ] ASBA: Full fetch complete (5268 records). [2025-10-02T17:20:31.132769] [DEBUG] [VALIDATOR ] ASBA: Validating primary data. [2025-10-02T17:20:31.481251] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-02. [2025-10-02T17:20:31.519175] [DEBUG] [VALIDATOR ] ASBA: All expected trading days are present. [2025-10-02T17:20:31.519269] [DEBUG] [VALIDATOR ] ASBA: Primary data validation passed. [2025-10-02T17:20:31.519560] [INFO ] [MAIN ] ASBA: Fetched primary data is valid. [2025-10-02T17:20:31.519603] [DEBUG] [LOCAL ] ASBA: Saving primary data. [2025-10-02T17:20:31.520045] [DEBUG] [LOCAL ] ASBA: Trimmed 5268 records to 3476 (keeping 200 days of data) [2025-10-02T17:20:31.542584] [DEBUG] [LOCAL ] ASBA: Primary data saved (3476 records). [2025-10-02T17:20:31.543202] [INFO ] [MAIN ] ASBA: Full history saved. [2025-10-02T17:20:31.543483] [INFO ] [MAIN ] Update Progress: 155/2370 symbols completed. ASBA took 20.1s. Estimated remaining: 4h 52m 25s. Rate: 7.6 symbols/min [2025-10-02T17:20:31.716511] [INFO ] [MAIN ] ASGI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:20:31.742292] [DEBUG] [LOCAL ] ASGI: Loaded 22690 existing records from primary storage. [2025-10-02T17:20:31.742736] [INFO ] [MAIN ] ASGI: Loaded 22690 existing records. [2025-10-02T17:20:31.936765] [WARN ] [MAIN ] ASGI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:20:31.937016] [INFO ] [MAIN ] ASGI: Wiping existing primary data before full refresh. [2025-10-02T17:20:31.937068] [INFO ] [LOCAL ] ASGI: Starting deletion of primary data. [2025-10-02T17:20:31.937706] [DEBUG] [LOCAL ] ASGI: Deleted primary data file. [2025-10-02T17:20:31.937769] [INFO ] [MAIN ] ASGI: Starting full primary refresh. [2025-10-02T17:20:32.278171] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-02. [2025-10-02T17:20:32.353688] [INFO ] [REMOTE ] ASGI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:20:32.649670] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-02T17:20:33.072995] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-03. [2025-10-02T17:20:33.731537] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-02T17:20:33.872995] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-03. [2025-10-02T17:20:34.358808] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-02T17:20:34.673036] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-09. [2025-10-02T17:20:35.382817] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-02T17:20:35.473013] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-04. [2025-10-02T17:20:36.272979] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-04. [2025-10-02T17:20:36.472906] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-02T17:20:36.584376] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-02T17:20:37.073056] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-10. [2025-10-02T17:20:37.553615] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-02T17:20:37.873003] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-05. [2025-10-02T17:20:38.550563] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-02T17:20:38.552634] [INFO ] [REMOTE ] ASB: Full fetch complete (71657 records). [2025-10-02T17:20:38.552803] [DEBUG] [VALIDATOR ] ASB: Validating primary data. [2025-10-02T17:20:38.678113] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2024-12. [2025-10-02T17:20:39.018563] [DEBUG] [VALIDATOR ] ASB: All expected trading days are present. [2025-10-02T17:20:39.018721] [DEBUG] [VALIDATOR ] ASB: Primary data validation passed. [2025-10-02T17:20:39.019495] [INFO ] [MAIN ] ASB: Fetched primary data is valid. [2025-10-02T17:20:39.019672] [DEBUG] [LOCAL ] ASB: Saving primary data. [2025-10-02T17:20:39.021152] [DEBUG] [LOCAL ] ASB: Trimmed 71657 records to 49883 (keeping 200 days of data) [2025-10-02T17:20:39.149962] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-02T17:20:39.361161] [DEBUG] [LOCAL ] ASB: Primary data saved (49883 records). [2025-10-02T17:20:39.361313] [INFO ] [MAIN ] ASB: Full history saved. [2025-10-02T17:20:39.362279] [INFO ] [MAIN ] Update Progress: 156/2370 symbols completed. ASB took 42.8s. Estimated remaining: 4h 52m 15s. Rate: 7.6 symbols/min [2025-10-02T17:20:39.475822] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-06. [2025-10-02T17:20:39.558819] [INFO ] [MAIN ] ASGN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:20:39.603563] [DEBUG] [LOCAL ] ASGN: Loaded 36096 existing records from primary storage. [2025-10-02T17:20:39.603893] [INFO ] [MAIN ] ASGN: Loaded 36096 existing records. [2025-10-02T17:20:39.810154] [WARN ] [MAIN ] ASGN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:20:39.810381] [INFO ] [MAIN ] ASGN: Wiping existing primary data before full refresh. [2025-10-02T17:20:39.810433] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-10-02T17:20:39.811562] [DEBUG] [LOCAL ] ASGN: Deleted primary data file. [2025-10-02T17:20:39.811628] [INFO ] [MAIN ] ASGN: Starting full primary refresh. [2025-10-02T17:20:40.127476] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-02T17:20:40.245476] [INFO ] [REMOTE ] ASGN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:20:40.272962] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2024-12. [2025-10-02T17:20:40.398925] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-02T17:20:41.073010] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-05. [2025-10-02T17:20:41.873021] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-07. [2025-10-02T17:20:41.994504] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-02T17:20:42.651879] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-02T17:20:42.672965] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-06. [2025-10-02T17:20:42.712547] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-02T17:20:43.473004] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-08. [2025-10-02T17:20:44.272973] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-01. [2025-10-02T17:20:44.358529] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-02T17:20:44.482797] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-02T17:20:45.073005] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-09. [2025-10-02T17:20:45.622100] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-02T17:20:45.872971] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-02. [2025-10-02T17:20:46.180286] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-02T17:20:46.672995] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-01. [2025-10-02T17:20:47.349334] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-02T17:20:47.472967] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-07. [2025-10-02T17:20:47.928879] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-02T17:20:48.272994] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-03. [2025-10-02T17:20:49.018075] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-02T17:20:49.073019] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-10. [2025-10-02T17:20:49.778734] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-02T17:20:49.872992] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-04. [2025-10-02T17:20:49.930476] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-02T17:20:49.931557] [INFO ] [REMOTE ] ASG: Full fetch complete (31233 records). [2025-10-02T17:20:49.931634] [DEBUG] [VALIDATOR ] ASG: Validating primary data. [2025-10-02T17:20:50.350767] [DEBUG] [VALIDATOR ] ASG: All expected trading days are present. [2025-10-02T17:20:50.350877] [DEBUG] [VALIDATOR ] ASG: Primary data validation passed. [2025-10-02T17:20:50.351384] [INFO ] [MAIN ] ASG: Fetched primary data is valid. [2025-10-02T17:20:50.351452] [DEBUG] [LOCAL ] ASG: Saving primary data. [2025-10-02T17:20:50.352488] [DEBUG] [LOCAL ] ASG: Trimmed 31233 records to 19972 (keeping 200 days of data) [2025-10-02T17:20:50.471673] [DEBUG] [LOCAL ] ASG: Primary data saved (19972 records). [2025-10-02T17:20:50.471828] [INFO ] [MAIN ] ASG: Full history saved. [2025-10-02T17:20:50.471914] [INFO ] [MAIN ] Update Progress: 157/2370 symbols completed. ASG took 26.8s. Estimated remaining: 4h 52m 52s. Rate: 7.6 symbols/min [2025-10-02T17:20:50.673010] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-08. [2025-10-02T17:20:51.139494] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-02T17:20:51.473029] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-05. [2025-10-02T17:20:51.842718] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-02T17:20:52.273003] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-02. [2025-10-02T17:20:52.626001] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-02T17:20:53.073034] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-09. [2025-10-02T17:20:53.390736] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-02T17:20:53.872996] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-06. [2025-10-02T17:20:54.335766] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-02T17:20:54.673002] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-10. [2025-10-02T17:20:55.295774] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-02T17:20:55.473000] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-07. [2025-10-02T17:20:56.010232] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-02T17:20:56.012127] [INFO ] [REMOTE ] ASC: Full fetch complete (56604 records). [2025-10-02T17:20:56.012224] [DEBUG] [VALIDATOR ] ASC: Validating primary data. [2025-10-02T17:20:56.282096] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-03. [2025-10-02T17:20:56.435971] [DEBUG] [VALIDATOR ] ASC: All expected trading days are present. [2025-10-02T17:20:56.436100] [DEBUG] [VALIDATOR ] ASC: Primary data validation passed. [2025-10-02T17:20:56.436894] [INFO ] [MAIN ] ASC: Fetched primary data is valid. [2025-10-02T17:20:56.436963] [DEBUG] [LOCAL ] ASC: Saving primary data. [2025-10-02T17:20:56.438548] [DEBUG] [LOCAL ] ASC: Trimmed 56604 records to 37698 (keeping 200 days of data) [2025-10-02T17:20:56.673250] [DEBUG] [LOCAL ] ASC: Primary data saved (37698 records). [2025-10-02T17:20:56.673408] [INFO ] [MAIN ] ASC: Full history saved. [2025-10-02T17:20:56.673532] [INFO ] [MAIN ] Update Progress: 158/2370 symbols completed. ASC took 41.6s. Estimated remaining: 4h 52m 20s. Rate: 7.6 symbols/min [2025-10-02T17:20:56.981067] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-02T17:20:57.073066] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-08. [2025-10-02T17:20:57.157989] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-02T17:20:57.873118] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-04. [2025-10-02T17:20:58.495101] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-02T17:20:58.673063] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-09. [2025-10-02T17:20:58.995801] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-02T17:20:59.473032] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-05. [2025-10-02T17:20:59.902094] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-02T17:21:00.272982] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-10. [2025-10-02T17:21:00.472361] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-02T17:21:01.073034] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-06. [2025-10-02T17:21:01.334461] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-02T17:21:01.335941] [INFO ] [REMOTE ] ASGN: Full fetch complete (52069 records). [2025-10-02T17:21:01.336031] [DEBUG] [VALIDATOR ] ASGN: Validating primary data. [2025-10-02T17:21:01.336636] [FATAL] [VALIDATOR ] ASGN: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:21:01.336750] [FATAL] [MAIN ] ASGN: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:21:01.336794] [WARN ] [MAIN ] ASGN: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:21:01.336860] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-10-02T17:21:01.336915] [DEBUG] [LOCAL ] ASGN: No primary data file found to delete. [2025-10-02T17:21:01.336952] [INFO ] [LOCAL ] ASGN: Starting deletion of derivative data. [2025-10-02T17:21:01.337632] [DEBUG] [LOCAL ] ASGN: Deleted derivative data file. [2025-10-02T17:21:01.340623] [INFO ] [MAIN ] Update Progress: 159/2370 symbols completed. ASGN took 22.0s. Estimated remaining: 4h 51m 27s. Rate: 7.6 symbols/min [2025-10-02T17:21:05.788793] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-06 (4.72 seconds). [2025-10-02T17:21:05.794060] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-07. [2025-10-02T17:21:06.865407] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-02T17:21:06.871613] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-08. [2025-10-02T17:21:07.992011] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-02T17:21:07.997422] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-09. [2025-10-02T17:21:08.844758] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-02T17:21:08.851099] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-10. [2025-10-02T17:21:09.755215] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-02T17:21:09.756602] [INFO ] [REMOTE ] ASGI: Full fetch complete (33630 records). [2025-10-02T17:21:09.756763] [DEBUG] [VALIDATOR ] ASGI: Validating primary data. [2025-10-02T17:21:10.171882] [DEBUG] [VALIDATOR ] ASGI: All expected trading days are present. [2025-10-02T17:21:10.171969] [DEBUG] [VALIDATOR ] ASGI: Primary data validation passed. [2025-10-02T17:21:10.172442] [INFO ] [MAIN ] ASGI: Fetched primary data is valid. [2025-10-02T17:21:10.172494] [DEBUG] [LOCAL ] ASGI: Saving primary data. [2025-10-02T17:21:10.173544] [DEBUG] [LOCAL ] ASGI: Trimmed 33630 records to 22922 (keeping 200 days of data) [2025-10-02T17:21:10.315841] [DEBUG] [LOCAL ] ASGI: Primary data saved (22922 records). [2025-10-02T17:21:10.315993] [INFO ] [MAIN ] ASGI: Full history saved. [2025-10-02T17:21:10.316080] [INFO ] [MAIN ] Update Progress: 160/2370 symbols completed. ASGI took 38.8s. Estimated remaining: 4h 51m 34s. Rate: 7.6 symbols/min [2025-10-02T17:21:11.002772] [INFO ] [MAIN ] ASPN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:21:11.050026] [INFO ] [MAIN ] ASIX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:21:11.117431] [INFO ] [MAIN ] ASR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:21:11.131119] [INFO ] [MAIN ] ASH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:21:11.144012] [DEBUG] [LOCAL ] ASR: Loaded 9345 existing records from primary storage. [2025-10-02T17:21:11.144502] [INFO ] [MAIN ] ASR: Loaded 9345 existing records. [2025-10-02T17:21:11.299063] [DEBUG] [LOCAL ] ASIX: Loaded 22665 existing records from primary storage. [2025-10-02T17:21:11.311123] [INFO ] [MAIN ] ASIX: Loaded 22665 existing records. [2025-10-02T17:21:11.410266] [DEBUG] [LOCAL ] ASH: Loaded 37770 existing records from primary storage. [2025-10-02T17:21:11.458682] [DEBUG] [LOCAL ] ASPN: Loaded 49592 existing records from primary storage. [2025-10-02T17:21:11.464183] [INFO ] [MAIN ] ASH: Loaded 37770 existing records. [2025-10-02T17:21:11.510336] [INFO ] [MAIN ] ASPN: Loaded 49592 existing records. [2025-10-02T17:21:11.499145] [WARN ] [MAIN ] ASR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:21:11.558121] [INFO ] [MAIN ] ASR: Wiping existing primary data before full refresh. [2025-10-02T17:21:11.598777] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-10-02T17:21:11.755265] [DEBUG] [LOCAL ] ASR: Deleted primary data file. [2025-10-02T17:21:11.820354] [INFO ] [MAIN ] ASR: Starting full primary refresh. [2025-10-02T17:21:12.067433] [WARN ] [MAIN ] ASH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:21:12.064309] [WARN ] [MAIN ] ASIX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:21:12.125787] [INFO ] [MAIN ] ASIX: Wiping existing primary data before full refresh. [2025-10-02T17:21:12.125518] [INFO ] [MAIN ] ASH: Wiping existing primary data before full refresh. [2025-10-02T17:21:12.136432] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-10-02T17:21:12.166047] [DEBUG] [LOCAL ] ASIX: Deleted primary data file. [2025-10-02T17:21:12.154532] [INFO ] [LOCAL ] ASH: Starting deletion of primary data. [2025-10-02T17:21:12.170281] [WARN ] [MAIN ] ASPN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:21:12.196969] [DEBUG] [LOCAL ] ASH: Deleted primary data file. [2025-10-02T17:21:12.197138] [INFO ] [MAIN ] ASH: Starting full primary refresh. [2025-10-02T17:21:12.191682] [INFO ] [MAIN ] ASIX: Starting full primary refresh. [2025-10-02T17:21:12.196892] [INFO ] [MAIN ] ASPN: Wiping existing primary data before full refresh. [2025-10-02T17:21:12.230304] [INFO ] [LOCAL ] ASPN: Starting deletion of primary data. [2025-10-02T17:21:12.299181] [DEBUG] [LOCAL ] ASPN: Deleted primary data file. [2025-10-02T17:21:12.358188] [INFO ] [MAIN ] ASPN: Starting full primary refresh. [2025-10-02T17:21:13.308631] [INFO ] [REMOTE ] ASR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:21:13.427169] [INFO ] [REMOTE ] ASR: Fetching primary data for 2024-12. [2025-10-02T17:21:13.686506] [INFO ] [REMOTE ] ASH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:21:13.758519] [INFO ] [REMOTE ] ASIX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:21:13.764217] [INFO ] [REMOTE ] ASH: Fetching primary data for 2024-12. [2025-10-02T17:21:13.785525] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2024-12. [2025-10-02T17:21:13.881834] [INFO ] [REMOTE ] ASPN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:21:13.882204] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2024-12. [2025-10-02T17:21:14.573837] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-02T17:21:14.576562] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-01. [2025-10-02T17:21:14.866824] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-02T17:21:14.870749] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-01. [2025-10-02T17:21:14.987343] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-02T17:21:14.994768] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-01. [2025-10-02T17:21:15.107732] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-02T17:21:15.109972] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-02. [2025-10-02T17:21:15.526986] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-02T17:21:15.534355] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-02. [2025-10-02T17:21:15.786212] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-02T17:21:15.796994] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-01. [2025-10-02T17:21:15.892608] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-02T17:21:15.895092] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-03. [2025-10-02T17:21:16.273542] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-02T17:21:16.278438] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-03. [2025-10-02T17:21:16.374481] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-02T17:21:16.383044] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-02. [2025-10-02T17:21:16.390038] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-02T17:21:16.392513] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-04. [2025-10-02T17:21:17.170906] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-02T17:21:17.181348] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-02. [2025-10-02T17:21:17.315034] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-02T17:21:17.318377] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-05. [2025-10-02T17:21:17.377741] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-02T17:21:17.539188] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-02T17:21:17.873023] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-04. [2025-10-02T17:21:17.930205] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-02T17:21:18.482210] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-02T17:21:18.673083] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-06. [2025-10-02T17:21:18.817188] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-02T17:21:19.181299] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-02T17:21:19.473003] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-07. [2025-10-02T17:21:20.270797] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-02T17:21:20.273028] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-05. [2025-10-02T17:21:21.073028] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-03. [2025-10-02T17:21:21.190186] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-02T17:21:21.873007] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-03. [2025-10-02T17:21:22.428838] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-02T17:21:22.673026] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-04. [2025-10-02T17:21:23.473039] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-08. [2025-10-02T17:21:23.587781] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-02T17:21:24.102021] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-02T17:21:24.273015] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-05. [2025-10-02T17:21:24.309457] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-02T17:21:25.072998] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-06. [2025-10-02T17:21:25.873041] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-04. [2025-10-02T17:21:25.950937] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-02T17:21:26.008541] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-02T17:21:26.673032] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-09. [2025-10-02T17:21:27.473006] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-07. [2025-10-02T17:21:27.576854] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-02T17:21:27.657954] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-02T17:21:28.273008] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-10. [2025-10-02T17:21:28.351300] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-02T17:21:28.925477] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-02T17:21:28.926354] [INFO ] [REMOTE ] ASR: Full fetch complete (12506 records). [2025-10-02T17:21:28.926481] [DEBUG] [VALIDATOR ] ASR: Validating primary data. [2025-10-02T17:21:29.078170] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-06. [2025-10-02T17:21:29.360462] [DEBUG] [VALIDATOR ] ASR: All expected trading days are present. [2025-10-02T17:21:29.360540] [DEBUG] [VALIDATOR ] ASR: Primary data validation passed. [2025-10-02T17:21:29.360837] [INFO ] [MAIN ] ASR: Fetched primary data is valid. [2025-10-02T17:21:29.360925] [DEBUG] [LOCAL ] ASR: Saving primary data. [2025-10-02T17:21:29.361464] [DEBUG] [LOCAL ] ASR: Trimmed 12506 records to 9377 (keeping 200 days of data) [2025-10-02T17:21:29.425025] [DEBUG] [LOCAL ] ASR: Primary data saved (9377 records). [2025-10-02T17:21:29.425345] [INFO ] [MAIN ] ASR: Full history saved. [2025-10-02T17:21:29.425461] [INFO ] [MAIN ] Update Progress: 161/2370 symbols completed. ASR took 19.1s. Estimated remaining: 4h 53m 59s. Rate: 7.5 symbols/min [2025-10-02T17:21:29.607801] [INFO ] [MAIN ] ASX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:21:29.674710] [DEBUG] [LOCAL ] ASX: Loaded 52844 existing records from primary storage. [2025-10-02T17:21:29.675025] [INFO ] [MAIN ] ASX: Loaded 52844 existing records. [2025-10-02T17:21:29.871844] [WARN ] [MAIN ] ASX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:21:29.872090] [INFO ] [MAIN ] ASX: Wiping existing primary data before full refresh. [2025-10-02T17:21:29.872140] [INFO ] [LOCAL ] ASX: Starting deletion of primary data. [2025-10-02T17:21:29.873001] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-05. [2025-10-02T17:21:29.874187] [DEBUG] [LOCAL ] ASX: Deleted primary data file. [2025-10-02T17:21:29.874306] [INFO ] [MAIN ] ASX: Starting full primary refresh. [2025-10-02T17:21:30.278170] [INFO ] [REMOTE ] ASX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:21:30.515769] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-02T17:21:30.673019] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-08. [2025-10-02T17:21:31.472997] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-07. [2025-10-02T17:21:31.667232] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-02T17:21:31.758985] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-02T17:21:32.273008] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-06. [2025-10-02T17:21:32.781683] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-02T17:21:33.072997] [INFO ] [REMOTE ] ASX: Fetching primary data for 2024-12. [2025-10-02T17:21:33.608120] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-02T17:21:33.873009] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-09. [2025-10-02T17:21:34.672995] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-08. [2025-10-02T17:21:34.849075] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-02T17:21:34.962741] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-02T17:21:35.473037] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-10. [2025-10-02T17:21:36.236227] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-02T17:21:36.273042] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-09. [2025-10-02T17:21:36.607393] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-02T17:21:36.608903] [INFO ] [REMOTE ] ASIX: Full fetch complete (30192 records). [2025-10-02T17:21:36.608986] [DEBUG] [VALIDATOR ] ASIX: Validating primary data. [2025-10-02T17:21:37.009702] [DEBUG] [VALIDATOR ] ASIX: All expected trading days are present. [2025-10-02T17:21:37.009808] [DEBUG] [VALIDATOR ] ASIX: Primary data validation passed. [2025-10-02T17:21:37.010246] [INFO ] [MAIN ] ASIX: Fetched primary data is valid. [2025-10-02T17:21:37.010298] [DEBUG] [LOCAL ] ASIX: Saving primary data. [2025-10-02T17:21:37.011334] [DEBUG] [LOCAL ] ASIX: Trimmed 30192 records to 22820 (keeping 200 days of data) [2025-10-02T17:21:37.076686] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-07. [2025-10-02T17:21:37.158751] [DEBUG] [LOCAL ] ASIX: Primary data saved (22820 records). [2025-10-02T17:21:37.158894] [INFO ] [MAIN ] ASIX: Full history saved. [2025-10-02T17:21:37.158980] [INFO ] [MAIN ] Update Progress: 162/2370 symbols completed. ASIX took 26.8s. Estimated remaining: 4h 53m 48s. Rate: 7.5 symbols/min [2025-10-02T17:21:37.343163] [INFO ] [MAIN ] ATEN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:21:37.390040] [DEBUG] [LOCAL ] ATEN: Loaded 39400 existing records from primary storage. [2025-10-02T17:21:37.390387] [INFO ] [MAIN ] ATEN: Loaded 39400 existing records. [2025-10-02T17:21:37.595921] [WARN ] [MAIN ] ATEN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:21:37.596205] [INFO ] [MAIN ] ATEN: Wiping existing primary data before full refresh. [2025-10-02T17:21:37.596297] [INFO ] [LOCAL ] ATEN: Starting deletion of primary data. [2025-10-02T17:21:37.599399] [DEBUG] [LOCAL ] ATEN: Deleted primary data file. [2025-10-02T17:21:37.599485] [INFO ] [MAIN ] ATEN: Starting full primary refresh. [2025-10-02T17:21:37.879619] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-01. [2025-10-02T17:21:37.947796] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-02T17:21:38.039479] [INFO ] [REMOTE ] ATEN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:21:38.673022] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-10. [2025-10-02T17:21:39.473001] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2024-12. [2025-10-02T17:21:39.544704] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-10-02T17:21:39.587399] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-02T17:21:39.870957] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-02T17:21:39.872629] [INFO ] [REMOTE ] ASH: Full fetch complete (55115 records). [2025-10-02T17:21:39.872748] [DEBUG] [VALIDATOR ] ASH: Validating primary data. [2025-10-02T17:21:40.283683] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-08. [2025-10-02T17:21:40.304912] [DEBUG] [VALIDATOR ] ASH: All expected trading days are present. [2025-10-02T17:21:40.305070] [DEBUG] [VALIDATOR ] ASH: Primary data validation passed. [2025-10-02T17:21:40.305694] [INFO ] [MAIN ] ASH: Fetched primary data is valid. [2025-10-02T17:21:40.305761] [DEBUG] [LOCAL ] ASH: Saving primary data. [2025-10-02T17:21:40.307128] [DEBUG] [LOCAL ] ASH: Trimmed 55115 records to 38041 (keeping 200 days of data) [2025-10-02T17:21:40.566909] [DEBUG] [LOCAL ] ASH: Primary data saved (38041 records). [2025-10-02T17:21:40.567082] [INFO ] [MAIN ] ASH: Full history saved. [2025-10-02T17:21:40.567206] [INFO ] [MAIN ] Update Progress: 163/2370 symbols completed. ASH took 30.3s. Estimated remaining: 4h 52m 38s. Rate: 7.5 symbols/min [2025-10-02T17:21:40.751702] [INFO ] [MAIN ] ATGE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:21:40.792517] [DEBUG] [LOCAL ] ATGE: Loaded 31426 existing records from primary storage. [2025-10-02T17:21:40.792917] [INFO ] [MAIN ] ATGE: Loaded 31426 existing records. [2025-10-02T17:21:40.996310] [WARN ] [MAIN ] ATGE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:21:40.996774] [INFO ] [MAIN ] ATGE: Wiping existing primary data before full refresh. [2025-10-02T17:21:40.997060] [INFO ] [LOCAL ] ATGE: Starting deletion of primary data. [2025-10-02T17:21:40.998085] [DEBUG] [LOCAL ] ATGE: Deleted primary data file. [2025-10-02T17:21:40.998153] [INFO ] [MAIN ] ATGE: Starting full primary refresh. [2025-10-02T17:21:41.073880] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-02. [2025-10-02T17:21:41.206749] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-02T17:21:41.455186] [INFO ] [REMOTE ] ATGE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:21:41.885098] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-01. [2025-10-02T17:21:41.891444] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-02T17:21:42.673001] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2024-12. [2025-10-02T17:21:42.897923] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-02T17:21:43.285477] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-02T17:21:43.473031] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-03. [2025-10-02T17:21:44.094469] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-02T17:21:44.272996] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-02. [2025-10-02T17:21:45.073016] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-01. [2025-10-02T17:21:45.396706] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-02T17:21:45.696982] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-02T17:21:45.872998] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-04. [2025-10-02T17:21:46.046457] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-02T17:21:46.673000] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-09. [2025-10-02T17:21:47.453526] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-02T17:21:47.472960] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-05. [2025-10-02T17:21:48.222162] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-02T17:21:48.272982] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-10. [2025-10-02T17:21:48.827167] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-02T17:21:49.072994] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-02. [2025-10-02T17:21:49.532763] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-02T17:21:49.537732] [INFO ] [REMOTE ] ASPN: Full fetch complete (72296 records). [2025-10-02T17:21:49.537866] [DEBUG] [VALIDATOR ] ASPN: Validating primary data. [2025-10-02T17:21:49.878107] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-06. [2025-10-02T17:21:49.977535] [DEBUG] [VALIDATOR ] ASPN: All expected trading days are present. [2025-10-02T17:21:49.977632] [DEBUG] [VALIDATOR ] ASPN: Primary data validation passed. [2025-10-02T17:21:49.978590] [INFO ] [MAIN ] ASPN: Fetched primary data is valid. [2025-10-02T17:21:49.978687] [DEBUG] [LOCAL ] ASPN: Saving primary data. [2025-10-02T17:21:49.980475] [DEBUG] [LOCAL ] ASPN: Trimmed 72296 records to 49942 (keeping 200 days of data) [2025-10-02T17:21:50.287881] [DEBUG] [LOCAL ] ASPN: Primary data saved (49942 records). [2025-10-02T17:21:50.288147] [INFO ] [MAIN ] ASPN: Full history saved. [2025-10-02T17:21:50.288256] [INFO ] [MAIN ] Update Progress: 164/2370 symbols completed. ASPN took 40.0s. Estimated remaining: 4h 52m 54s. Rate: 7.5 symbols/min [2025-10-02T17:21:50.428684] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-02T17:21:50.530177] [INFO ] [MAIN ] ATHM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:21:50.568054] [DEBUG] [LOCAL ] ATHM: Loaded 32173 existing records from primary storage. [2025-10-02T17:21:50.568665] [INFO ] [MAIN ] ATHM: Loaded 32173 existing records. [2025-10-02T17:21:50.678219] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-03. [2025-10-02T17:21:50.819116] [WARN ] [MAIN ] ATHM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:21:50.819393] [INFO ] [MAIN ] ATHM: Wiping existing primary data before full refresh. [2025-10-02T17:21:50.819463] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-10-02T17:21:50.820371] [DEBUG] [LOCAL ] ATHM: Deleted primary data file. [2025-10-02T17:21:50.820437] [INFO ] [MAIN ] ATHM: Starting full primary refresh. [2025-10-02T17:21:51.435919] [INFO ] [REMOTE ] ATHM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:21:51.464072] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-02T17:21:51.480718] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-07. [2025-10-02T17:21:52.148910] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-02T17:21:52.273035] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-04. [2025-10-02T17:21:53.078131] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2024-12. [2025-10-02T17:21:53.097453] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-02T17:21:53.286520] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-02T17:21:53.873014] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-03. [2025-10-02T17:21:54.489571] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-02T17:21:54.673075] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-08. [2025-10-02T17:21:55.373499] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-02T17:21:55.473009] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-04. [2025-10-02T17:21:56.272973] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-01. [2025-10-02T17:21:56.472724] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-02T17:21:57.072971] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-09. [2025-10-02T17:21:57.104876] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-02T17:21:57.475968] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-02T17:21:57.873053] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-05. [2025-10-02T17:21:58.673013] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-05. [2025-10-02T17:21:58.888455] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-02T17:21:59.321487] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-02T17:21:59.473063] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-02. [2025-10-02T17:22:00.197635] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-02T17:22:00.272994] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-06. [2025-10-02T17:22:00.876296] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-02T17:22:01.073018] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-06. [2025-10-02T17:22:01.593204] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-02T17:22:01.873068] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-10. [2025-10-02T17:22:02.395404] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-02T17:22:02.673122] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-07. [2025-10-02T17:22:03.210343] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-02T17:22:03.212263] [INFO ] [REMOTE ] ASX: Full fetch complete (76208 records). [2025-10-02T17:22:03.212389] [DEBUG] [VALIDATOR ] ASX: Validating primary data. [2025-10-02T17:22:03.213450] [FATAL] [VALIDATOR ] ASX: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:22:03.213546] [FATAL] [MAIN ] ASX: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:22:03.213591] [WARN ] [MAIN ] ASX: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:22:03.213634] [INFO ] [LOCAL ] ASX: Starting deletion of primary data. [2025-10-02T17:22:03.213734] [DEBUG] [LOCAL ] ASX: No primary data file found to delete. [2025-10-02T17:22:03.213779] [INFO ] [LOCAL ] ASX: Starting deletion of derivative data. [2025-10-02T17:22:03.214505] [DEBUG] [LOCAL ] ASX: Deleted derivative data file. [2025-10-02T17:22:03.214607] [INFO ] [MAIN ] Update Progress: 165/2370 symbols completed. ASX took 33.8s. Estimated remaining: 4h 53m 52s. Rate: 7.5 symbols/min [2025-10-02T17:22:03.404342] [INFO ] [MAIN ] ATHS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:22:03.413382] [DEBUG] [LOCAL ] ATHS: Loaded 6972 existing records from primary storage. [2025-10-02T17:22:03.413605] [INFO ] [MAIN ] ATHS: Loaded 6972 existing records. [2025-10-02T17:22:03.483844] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-03. [2025-10-02T17:22:03.621135] [WARN ] [MAIN ] ATHS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:22:03.621432] [INFO ] [MAIN ] ATHS: Wiping existing primary data before full refresh. [2025-10-02T17:22:03.621505] [INFO ] [LOCAL ] ATHS: Starting deletion of primary data. [2025-10-02T17:22:03.621828] [DEBUG] [LOCAL ] ATHS: Deleted primary data file. [2025-10-02T17:22:03.621891] [INFO ] [MAIN ] ATHS: Starting full primary refresh. [2025-10-02T17:22:04.019421] [INFO ] [REMOTE ] ATHS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:22:04.144747] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-02T17:22:04.273053] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-08. [2025-10-02T17:22:05.072962] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-07. [2025-10-02T17:22:05.278775] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-02T17:22:05.423833] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-02T17:22:05.873010] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2024-12. [2025-10-02T17:22:06.599259] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-02T17:22:06.673065] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-04. [2025-10-02T17:22:06.708390] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-02T17:22:07.473042] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-01. [2025-10-02T17:22:08.093675] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-02T17:22:08.140728] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-02T17:22:08.273003] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-02. [2025-10-02T17:22:08.738677] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-02T17:22:09.073038] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-09. [2025-10-02T17:22:09.873009] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-05. [2025-10-02T17:22:10.292520] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-02T17:22:10.673044] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-10. [2025-10-02T17:22:10.947164] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-02T17:22:11.473000] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-08. [2025-10-02T17:22:11.744704] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-02T17:22:11.746470] [INFO ] [REMOTE ] ATGE: Full fetch complete (46308 records). [2025-10-02T17:22:11.746594] [DEBUG] [VALIDATOR ] ATGE: Validating primary data. [2025-10-02T17:22:12.205907] [DEBUG] [VALIDATOR ] ATGE: All expected trading days are present. [2025-10-02T17:22:12.206004] [DEBUG] [VALIDATOR ] ATGE: Primary data validation passed. [2025-10-02T17:22:12.206592] [INFO ] [MAIN ] ATGE: Fetched primary data is valid. [2025-10-02T17:22:12.206679] [DEBUG] [LOCAL ] ATGE: Saving primary data. [2025-10-02T17:22:12.207956] [DEBUG] [LOCAL ] ATGE: Trimmed 46308 records to 31630 (keeping 200 days of data) [2025-10-02T17:22:12.298103] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-03. [2025-10-02T17:22:12.415521] [DEBUG] [LOCAL ] ATGE: Primary data saved (31630 records). [2025-10-02T17:22:12.415703] [INFO ] [MAIN ] ATGE: Full history saved. [2025-10-02T17:22:12.415827] [INFO ] [MAIN ] Update Progress: 166/2370 symbols completed. ATGE took 31.8s. Estimated remaining: 4h 53m 60s. Rate: 7.5 symbols/min [2025-10-02T17:22:12.615955] [INFO ] [MAIN ] ATI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:22:12.676216] [DEBUG] [LOCAL ] ATI: Loaded 51502 existing records from primary storage. [2025-10-02T17:22:12.676592] [INFO ] [MAIN ] ATI: Loaded 51502 existing records. [2025-10-02T17:22:12.907698] [WARN ] [MAIN ] ATI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:22:12.916399] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-02T17:22:12.916580] [INFO ] [MAIN ] ATI: Wiping existing primary data before full refresh. [2025-10-02T17:22:12.919813] [INFO ] [LOCAL ] ATI: Starting deletion of primary data. [2025-10-02T17:22:12.921000] [DEBUG] [LOCAL ] ATI: Deleted primary data file. [2025-10-02T17:22:12.921071] [INFO ] [MAIN ] ATI: Starting full primary refresh. [2025-10-02T17:22:13.076721] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-04. [2025-10-02T17:22:13.374934] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-02T17:22:13.405275] [INFO ] [REMOTE ] ATI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:22:13.854914] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-02T17:22:13.873019] [INFO ] [REMOTE ] ATI: Fetching primary data for 2024-12. [2025-10-02T17:22:14.673051] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-09. [2025-10-02T17:22:15.473022] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-06. [2025-10-02T17:22:15.660013] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-02T17:22:16.068299] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-02T17:22:16.273013] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-01. [2025-10-02T17:22:17.073027] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-10. [2025-10-02T17:22:17.116725] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-02T17:22:17.763096] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-02T17:22:17.873056] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-07. [2025-10-02T17:22:18.299847] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-02T17:22:18.302115] [INFO ] [REMOTE ] ATEN: Full fetch complete (57402 records). [2025-10-02T17:22:18.302251] [DEBUG] [VALIDATOR ] ATEN: Validating primary data. [2025-10-02T17:22:18.684054] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-02. [2025-10-02T17:22:18.755220] [DEBUG] [VALIDATOR ] ATEN: All expected trading days are present. [2025-10-02T17:22:18.755407] [DEBUG] [VALIDATOR ] ATEN: Primary data validation passed. [2025-10-02T17:22:18.756157] [INFO ] [MAIN ] ATEN: Fetched primary data is valid. [2025-10-02T17:22:18.756285] [DEBUG] [LOCAL ] ATEN: Saving primary data. [2025-10-02T17:22:18.759730] [DEBUG] [LOCAL ] ATEN: Trimmed 57402 records to 39637 (keeping 200 days of data) [2025-10-02T17:22:19.026534] [DEBUG] [LOCAL ] ATEN: Primary data saved (39637 records). [2025-10-02T17:22:19.026716] [INFO ] [MAIN ] ATEN: Full history saved. [2025-10-02T17:22:19.029032] [INFO ] [MAIN ] Update Progress: 167/2370 symbols completed. ATEN took 41.9s. Estimated remaining: 4h 53m 34s. Rate: 7.5 symbols/min [2025-10-02T17:22:19.196954] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-02T17:22:19.261560] [INFO ] [MAIN ] ATKR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:22:19.302977] [DEBUG] [LOCAL ] ATKR: Loaded 35682 existing records from primary storage. [2025-10-02T17:22:19.303312] [INFO ] [MAIN ] ATKR: Loaded 35682 existing records. [2025-10-02T17:22:19.478105] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-05. [2025-10-02T17:22:19.508632] [WARN ] [MAIN ] ATKR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:22:19.509895] [INFO ] [MAIN ] ATKR: Wiping existing primary data before full refresh. [2025-10-02T17:22:19.509958] [INFO ] [LOCAL ] ATKR: Starting deletion of primary data. [2025-10-02T17:22:19.511090] [DEBUG] [LOCAL ] ATKR: Deleted primary data file. [2025-10-02T17:22:19.511151] [INFO ] [MAIN ] ATKR: Starting full primary refresh. [2025-10-02T17:22:19.904485] [INFO ] [REMOTE ] ATKR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:22:20.272968] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2024-12. [2025-10-02T17:22:20.337293] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-02T17:22:20.559843] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-02T17:22:21.073012] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-06. [2025-10-02T17:22:21.671132] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-02T17:22:21.769527] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-02T17:22:21.873008] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-07. [2025-10-02T17:22:22.566411] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-02T17:22:22.673070] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-08. [2025-10-02T17:22:23.216180] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-02T17:22:23.473079] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-01. [2025-10-02T17:22:24.273017] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-08. [2025-10-02T17:22:24.895446] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-02T17:22:25.073013] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-03. [2025-10-02T17:22:25.586164] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-02T17:22:25.873016] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-09. [2025-10-02T17:22:26.673027] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-02. [2025-10-02T17:22:27.034291] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-02T17:22:27.109342] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-02T17:22:27.473030] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-04. [2025-10-02T17:22:28.066988] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-02T17:22:28.273028] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-09. [2025-10-02T17:22:28.609947] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-02T17:22:28.901917] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-02T17:22:29.073010] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-05. [2025-10-02T17:22:29.872997] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-03. [2025-10-02T17:22:30.433632] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-02T17:22:30.673009] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-10. [2025-10-02T17:22:31.165371] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-02T17:22:31.166399] [INFO ] [REMOTE ] ATHS: Full fetch complete (9983 records). [2025-10-02T17:22:31.166490] [DEBUG] [VALIDATOR ] ATHS: Validating primary data. [2025-10-02T17:22:31.477940] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-10. [2025-10-02T17:22:31.611995] [DEBUG] [VALIDATOR ] ATHS: All expected trading days are present. [2025-10-02T17:22:31.612129] [DEBUG] [VALIDATOR ] ATHS: Primary data validation passed. [2025-10-02T17:22:31.612592] [INFO ] [MAIN ] ATHS: Fetched primary data is valid. [2025-10-02T17:22:31.612706] [DEBUG] [LOCAL ] ATHS: Saving primary data. [2025-10-02T17:22:31.613545] [DEBUG] [LOCAL ] ATHS: Trimmed 9983 records to 6987 (keeping 200 days of data) [2025-10-02T17:22:31.671442] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-02T17:22:31.694473] [DEBUG] [LOCAL ] ATHS: Primary data saved (6987 records). [2025-10-02T17:22:31.694622] [INFO ] [MAIN ] ATHS: Full history saved. [2025-10-02T17:22:31.694747] [INFO ] [MAIN ] Update Progress: 168/2370 symbols completed. ATHS took 28.5s. Estimated remaining: 4h 54m 27s. Rate: 7.5 symbols/min [2025-10-02T17:22:31.888138] [INFO ] [MAIN ] ATMU: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:22:31.930130] [DEBUG] [LOCAL ] ATMU: Loaded 39344 existing records from primary storage. [2025-10-02T17:22:31.930436] [INFO ] [MAIN ] ATMU: Loaded 39344 existing records. [2025-10-02T17:22:32.129393] [WARN ] [MAIN ] ATMU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:22:32.129717] [INFO ] [MAIN ] ATMU: Wiping existing primary data before full refresh. [2025-10-02T17:22:32.129791] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-10-02T17:22:32.130763] [DEBUG] [LOCAL ] ATMU: Deleted primary data file. [2025-10-02T17:22:32.130824] [INFO ] [MAIN ] ATMU: Starting full primary refresh. [2025-10-02T17:22:32.286220] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-04. [2025-10-02T17:22:32.542203] [INFO ] [REMOTE ] ATMU: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:22:32.546482] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-02T17:22:32.547969] [INFO ] [REMOTE ] ATHM: Full fetch complete (51071 records). [2025-10-02T17:22:32.548108] [DEBUG] [VALIDATOR ] ATHM: Validating primary data. [2025-10-02T17:22:32.966607] [DEBUG] [VALIDATOR ] ATHM: All expected trading days are present. [2025-10-02T17:22:32.966726] [DEBUG] [VALIDATOR ] ATHM: Primary data validation passed. [2025-10-02T17:22:32.967356] [INFO ] [MAIN ] ATHM: Fetched primary data is valid. [2025-10-02T17:22:32.967423] [DEBUG] [LOCAL ] ATHM: Saving primary data. [2025-10-02T17:22:32.968732] [DEBUG] [LOCAL ] ATHM: Trimmed 51071 records to 32341 (keeping 200 days of data) [2025-10-02T17:22:33.073084] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-06. [2025-10-02T17:22:33.170882] [DEBUG] [LOCAL ] ATHM: Primary data saved (32341 records). [2025-10-02T17:22:33.171060] [INFO ] [MAIN ] ATHM: Full history saved. [2025-10-02T17:22:33.171149] [INFO ] [MAIN ] Update Progress: 169/2370 symbols completed. ATHM took 42.9s. Estimated remaining: 4h 52m 54s. Rate: 7.5 symbols/min [2025-10-02T17:22:33.361057] [INFO ] [MAIN ] ATO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:22:33.361278] [DEBUG] [LOCAL ] ATO: No existing data file found in primary storage. [2025-10-02T17:22:33.361328] [WARN ] [MAIN ] ATO: No existing data found, performing full refresh instead. [2025-10-02T17:22:33.361444] [INFO ] [MAIN ] ATO: Wiping existing primary data before full refresh. [2025-10-02T17:22:33.361488] [INFO ] [LOCAL ] ATO: Starting deletion of primary data. [2025-10-02T17:22:33.361533] [DEBUG] [LOCAL ] ATO: No primary data file found to delete. [2025-10-02T17:22:33.361567] [INFO ] [MAIN ] ATO: Starting full primary refresh. [2025-10-02T17:22:33.765581] [INFO ] [REMOTE ] ATO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:22:33.873006] [INFO ] [REMOTE ] ATO: Fetching primary data for 2024-12. [2025-10-02T17:22:34.272007] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-02T17:22:34.672988] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-05. [2025-10-02T17:22:34.862403] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-02T17:22:35.174172] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-02T17:22:35.473001] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2024-12. [2025-10-02T17:22:35.667287] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-02T17:22:36.273020] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-06. [2025-10-02T17:22:37.073007] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-07. [2025-10-02T17:22:37.270150] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-02T17:22:37.576246] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-02T17:22:37.873017] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-07. [2025-10-02T17:22:38.672975] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-01. [2025-10-02T17:22:38.931613] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-02T17:22:38.969140] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-02T17:22:39.473055] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-08. [2025-10-02T17:22:40.069295] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-02T17:22:40.272997] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-01. [2025-10-02T17:22:41.073025] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-08. [2025-10-02T17:22:41.222353] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-02T17:22:41.873016] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-02. [2025-10-02T17:22:41.941962] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-02T17:22:42.498966] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-02T17:22:42.672998] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-09. [2025-10-02T17:22:43.009404] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-02T17:22:43.473058] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-03. [2025-10-02T17:22:44.093450] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-02T17:22:44.273016] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-09. [2025-10-02T17:22:45.064852] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-02T17:22:45.074613] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-02. [2025-10-02T17:22:45.872984] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-10. [2025-10-02T17:22:45.960615] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-02T17:22:46.320347] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-02T17:22:46.673006] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-04. [2025-10-02T17:22:46.884012] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-02T17:22:46.885818] [INFO ] [REMOTE ] ATKR: Full fetch complete (53806 records). [2025-10-02T17:22:46.885913] [DEBUG] [VALIDATOR ] ATKR: Validating primary data. [2025-10-02T17:22:47.320728] [DEBUG] [VALIDATOR ] ATKR: All expected trading days are present. [2025-10-02T17:22:47.320823] [DEBUG] [VALIDATOR ] ATKR: Primary data validation passed. [2025-10-02T17:22:47.321458] [INFO ] [MAIN ] ATKR: Fetched primary data is valid. [2025-10-02T17:22:47.321526] [DEBUG] [LOCAL ] ATKR: Saving primary data. [2025-10-02T17:22:47.322852] [DEBUG] [LOCAL ] ATKR: Trimmed 53806 records to 35963 (keeping 200 days of data) [2025-10-02T17:22:47.506602] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-10. [2025-10-02T17:22:47.571406] [DEBUG] [LOCAL ] ATKR: Primary data saved (35963 records). [2025-10-02T17:22:47.571536] [INFO ] [MAIN ] ATKR: Full history saved. [2025-10-02T17:22:47.572474] [INFO ] [MAIN ] Update Progress: 170/2370 symbols completed. ATKR took 28.5s. Estimated remaining: 4h 54m 9s. Rate: 7.5 symbols/min [2025-10-02T17:22:47.771320] [INFO ] [MAIN ] ATR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:22:47.807138] [DEBUG] [LOCAL ] ATR: Loaded 30432 existing records from primary storage. [2025-10-02T17:22:47.807481] [INFO ] [MAIN ] ATR: Loaded 30432 existing records. [2025-10-02T17:22:48.024796] [WARN ] [MAIN ] ATR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:22:48.025391] [INFO ] [MAIN ] ATR: Wiping existing primary data before full refresh. [2025-10-02T17:22:48.025482] [INFO ] [LOCAL ] ATR: Starting deletion of primary data. [2025-10-02T17:22:48.035629] [DEBUG] [LOCAL ] ATR: Deleted primary data file. [2025-10-02T17:22:48.040884] [INFO ] [MAIN ] ATR: Starting full primary refresh. [2025-10-02T17:22:48.130866] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-02T17:22:48.283238] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-05. [2025-10-02T17:22:48.476768] [INFO ] [REMOTE ] ATR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:22:48.929067] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-02T17:22:48.932019] [INFO ] [REMOTE ] ATI: Full fetch complete (73969 records). [2025-10-02T17:22:48.932202] [DEBUG] [VALIDATOR ] ATI: Validating primary data. [2025-10-02T17:22:49.073457] [INFO ] [REMOTE ] ATR: Fetching primary data for 2024-12. [2025-10-02T17:22:49.420805] [DEBUG] [VALIDATOR ] ATI: All expected trading days are present. [2025-10-02T17:22:49.420973] [DEBUG] [VALIDATOR ] ATI: Primary data validation passed. [2025-10-02T17:22:49.421842] [INFO ] [MAIN ] ATI: Fetched primary data is valid. [2025-10-02T17:22:49.421913] [DEBUG] [LOCAL ] ATI: Saving primary data. [2025-10-02T17:22:49.423667] [DEBUG] [LOCAL ] ATI: Trimmed 73969 records to 51863 (keeping 200 days of data) [2025-10-02T17:22:49.768834] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-02T17:22:49.793215] [DEBUG] [LOCAL ] ATI: Primary data saved (51863 records). [2025-10-02T17:22:49.793518] [INFO ] [MAIN ] ATI: Full history saved. [2025-10-02T17:22:49.794919] [INFO ] [MAIN ] Update Progress: 171/2370 symbols completed. ATI took 37.4s. Estimated remaining: 4h 52m 46s. Rate: 7.5 symbols/min [2025-10-02T17:22:49.878112] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-06. [2025-10-02T17:22:50.000340] [INFO ] [MAIN ] ATS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:22:50.021398] [DEBUG] [LOCAL ] ATS: Loaded 17831 existing records from primary storage. [2025-10-02T17:22:50.021706] [INFO ] [MAIN ] ATS: Loaded 17831 existing records. [2025-10-02T17:22:50.222762] [WARN ] [MAIN ] ATS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:22:50.223048] [INFO ] [MAIN ] ATS: Wiping existing primary data before full refresh. [2025-10-02T17:22:50.223338] [INFO ] [LOCAL ] ATS: Starting deletion of primary data. [2025-10-02T17:22:50.223982] [DEBUG] [LOCAL ] ATS: Deleted primary data file. [2025-10-02T17:22:50.224044] [INFO ] [MAIN ] ATS: Starting full primary refresh. [2025-10-02T17:22:50.648095] [INFO ] [REMOTE ] ATS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:22:50.650827] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-02T17:22:50.672985] [INFO ] [REMOTE ] ATS: Fetching primary data for 2024-12. [2025-10-02T17:22:50.966094] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-02T17:22:51.473047] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-07. [2025-10-02T17:22:51.652286] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-02T17:22:52.273039] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-01. [2025-10-02T17:22:52.385032] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-02T17:22:53.073004] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-08. [2025-10-02T17:22:53.873050] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-01. [2025-10-02T17:22:54.673016] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-03. [2025-10-02T17:23:04.950287] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-01 (11.08 seconds). [2025-10-02T17:23:04.954998] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-02. [2025-10-02T17:23:05.104289] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-08 (12.03 seconds). [2025-10-02T17:23:05.114621] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-09. [2025-10-02T17:23:05.131822] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-01 (12.86 seconds). [2025-10-02T17:23:05.138482] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-02. [2025-10-02T17:23:05.999332] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-02T17:23:06.004674] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-03. [2025-10-02T17:23:06.115014] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-02T17:23:06.125350] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-10. [2025-10-02T17:23:06.505061] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-02T17:23:06.513503] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-03. [2025-10-02T17:23:06.937888] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-02T17:23:06.942577] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-04. [2025-10-02T17:23:07.315132] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-02T17:23:07.317291] [INFO ] [REMOTE ] ATMU: Full fetch complete (56720 records). [2025-10-02T17:23:07.317427] [DEBUG] [VALIDATOR ] ATMU: Validating primary data. [2025-10-02T17:23:07.796607] [DEBUG] [VALIDATOR ] ATMU: All expected trading days are present. [2025-10-02T17:23:07.823829] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-02T17:23:07.825730] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-03 (13.15 seconds). [2025-10-02T17:23:07.840075] [DEBUG] [VALIDATOR ] ATMU: Primary data validation passed. [2025-10-02T17:23:07.841762] [INFO ] [MAIN ] ATMU: Fetched primary data is valid. [2025-10-02T17:23:07.840840] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-05. [2025-10-02T17:23:07.843662] [DEBUG] [LOCAL ] ATMU: Saving primary data. [2025-10-02T17:23:07.843518] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-04. [2025-10-02T17:23:07.852708] [DEBUG] [LOCAL ] ATMU: Trimmed 56720 records to 39581 (keeping 200 days of data) [2025-10-02T17:23:07.864996] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-02T17:23:07.927802] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-04. [2025-10-02T17:23:08.123733] [DEBUG] [LOCAL ] ATMU: Primary data saved (39581 records). [2025-10-02T17:23:08.123886] [INFO ] [MAIN ] ATMU: Full history saved. [2025-10-02T17:23:08.123973] [INFO ] [MAIN ] Update Progress: 172/2370 symbols completed. ATMU took 36.4s. Estimated remaining: 4h 54m 50s. Rate: 7.5 symbols/min [2025-10-02T17:23:08.306820] [INFO ] [MAIN ] ATUS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:23:08.354217] [DEBUG] [LOCAL ] ATUS: Loaded 49261 existing records from primary storage. [2025-10-02T17:23:08.354554] [INFO ] [MAIN ] ATUS: Loaded 49261 existing records. [2025-10-02T17:23:08.567098] [WARN ] [MAIN ] ATUS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:23:08.567358] [INFO ] [MAIN ] ATUS: Wiping existing primary data before full refresh. [2025-10-02T17:23:08.567429] [INFO ] [LOCAL ] ATUS: Starting deletion of primary data. [2025-10-02T17:23:08.568296] [DEBUG] [LOCAL ] ATUS: Deleted primary data file. [2025-10-02T17:23:08.568360] [INFO ] [MAIN ] ATUS: Starting full primary refresh. [2025-10-02T17:23:08.966080] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-02T17:23:09.006557] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-06. [2025-10-02T17:23:09.028826] [INFO ] [REMOTE ] ATUS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:23:09.030034] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2024-12. [2025-10-02T17:23:09.181793] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-02T17:23:09.188293] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-05. [2025-10-02T17:23:09.645710] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-02T17:23:09.655772] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-05. [2025-10-02T17:23:09.808574] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-02T17:23:09.814472] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-07. [2025-10-02T17:23:10.309345] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-02T17:23:10.316535] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-06. [2025-10-02T17:23:10.764326] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-02T17:23:10.774478] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-01. [2025-10-02T17:23:11.456457] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-02T17:23:11.467182] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-06. [2025-10-02T17:23:11.529786] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-02T17:23:11.536893] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-07. [2025-10-02T17:23:12.409194] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-02T17:23:12.419458] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-02. [2025-10-02T17:23:12.825916] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-02T17:23:12.832632] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-08. [2025-10-02T17:23:12.875731] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-02T17:23:12.884470] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-07. [2025-10-02T17:23:13.733273] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-02T17:23:13.743169] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-03. [2025-10-02T17:23:14.010814] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-02T17:23:14.019551] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-08. [2025-10-02T17:23:14.232820] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-02T17:23:14.673038] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-09. [2025-10-02T17:23:15.232831] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-02T17:23:15.473049] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-04. [2025-10-02T17:23:15.685086] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-02T17:23:16.112915] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-02T17:23:16.273014] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-09. [2025-10-02T17:23:16.665569] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-02T17:23:17.073016] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-05. [2025-10-02T17:23:17.101058] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-07 (7.29 seconds). [2025-10-02T17:23:17.849164] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-02T17:23:17.872980] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-10. [2025-10-02T17:23:18.446960] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-02T17:23:18.672997] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-08. [2025-10-02T17:23:19.055501] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-02T17:23:19.057532] [INFO ] [REMOTE ] ATO: Full fetch complete (60526 records). [2025-10-02T17:23:19.057623] [DEBUG] [VALIDATOR ] ATO: Validating primary data. [2025-10-02T17:23:19.486971] [DEBUG] [VALIDATOR ] ATO: All expected trading days are present. [2025-10-02T17:23:19.483785] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-10. [2025-10-02T17:23:19.488127] [DEBUG] [VALIDATOR ] ATO: Primary data validation passed. [2025-10-02T17:23:19.489018] [INFO ] [MAIN ] ATO: Fetched primary data is valid. [2025-10-02T17:23:19.489306] [DEBUG] [LOCAL ] ATO: Saving primary data. [2025-10-02T17:23:19.491071] [DEBUG] [LOCAL ] ATO: Trimmed 60526 records to 42177 (keeping 200 days of data) [2025-10-02T17:23:19.708667] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-02T17:23:19.792512] [DEBUG] [LOCAL ] ATO: Primary data saved (42177 records). [2025-10-02T17:23:19.792673] [INFO ] [MAIN ] ATO: Full history saved. [2025-10-02T17:23:19.792775] [INFO ] [MAIN ] Update Progress: 173/2370 symbols completed. ATO took 46.6s. Estimated remaining: 4h 55m 28s. Rate: 7.4 symbols/min [2025-10-02T17:23:19.981170] [INFO ] [MAIN ] AU: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:23:20.052187] [DEBUG] [LOCAL ] AU: Loaded 52993 existing records from primary storage. [2025-10-02T17:23:20.052707] [INFO ] [MAIN ] AU: Loaded 52993 existing records. [2025-10-02T17:23:20.279534] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-06. [2025-10-02T17:23:20.286425] [WARN ] [MAIN ] AU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:23:20.287666] [INFO ] [MAIN ] AU: Wiping existing primary data before full refresh. [2025-10-02T17:23:20.287778] [INFO ] [LOCAL ] AU: Starting deletion of primary data. [2025-10-02T17:23:20.288876] [DEBUG] [LOCAL ] AU: Deleted primary data file. [2025-10-02T17:23:20.288941] [INFO ] [MAIN ] AU: Starting full primary refresh. [2025-10-02T17:23:20.607918] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-02T17:23:20.641564] [INFO ] [REMOTE ] ATR: Full fetch complete (43539 records). [2025-10-02T17:23:20.657408] [DEBUG] [VALIDATOR ] ATR: Validating primary data. [2025-10-02T17:23:20.822203] [INFO ] [REMOTE ] AU: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:23:21.078117] [INFO ] [REMOTE ] AU: Fetching primary data for 2024-12. [2025-10-02T17:23:21.166787] [DEBUG] [VALIDATOR ] ATR: All expected trading days are present. [2025-10-02T17:23:21.166870] [DEBUG] [VALIDATOR ] ATR: Primary data validation passed. [2025-10-02T17:23:21.167364] [INFO ] [MAIN ] ATR: Fetched primary data is valid. [2025-10-02T17:23:21.167407] [DEBUG] [LOCAL ] ATR: Saving primary data. [2025-10-02T17:23:21.168704] [DEBUG] [LOCAL ] ATR: Trimmed 43539 records to 30648 (keeping 200 days of data) [2025-10-02T17:23:21.380087] [DEBUG] [LOCAL ] ATR: Primary data saved (30648 records). [2025-10-02T17:23:21.380247] [INFO ] [MAIN ] ATR: Full history saved. [2025-10-02T17:23:21.380336] [INFO ] [MAIN ] Update Progress: 174/2370 symbols completed. ATR took 33.8s. Estimated remaining: 4h 53m 58s. Rate: 7.5 symbols/min [2025-10-02T17:23:21.578440] [INFO ] [MAIN ] AUB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:23:21.627463] [DEBUG] [LOCAL ] AUB: Loaded 46326 existing records from primary storage. [2025-10-02T17:23:21.627938] [INFO ] [MAIN ] AUB: Loaded 46326 existing records. [2025-10-02T17:23:21.849718] [WARN ] [MAIN ] AUB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:23:21.850285] [INFO ] [MAIN ] AUB: Wiping existing primary data before full refresh. [2025-10-02T17:23:21.850350] [INFO ] [LOCAL ] AUB: Starting deletion of primary data. [2025-10-02T17:23:21.851343] [DEBUG] [LOCAL ] AUB: Deleted primary data file. [2025-10-02T17:23:21.851410] [INFO ] [MAIN ] AUB: Starting full primary refresh. [2025-10-02T17:23:21.876578] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-09. [2025-10-02T17:23:22.084968] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-02T17:23:22.350553] [INFO ] [REMOTE ] AUB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:23:22.673018] [INFO ] [REMOTE ] AUB: Fetching primary data for 2024-12. [2025-10-02T17:23:22.823753] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-02T17:23:23.237148] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-02T17:23:23.473011] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-07. [2025-10-02T17:23:23.864254] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-02T17:23:24.273019] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-01. [2025-10-02T17:23:25.072973] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-01. [2025-10-02T17:23:25.107369] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-02T17:23:25.873015] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-10. [2025-10-02T17:23:26.076756] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-02T17:23:26.511695] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-02T17:23:26.672636] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-02T17:23:26.673761] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-02. [2025-10-02T17:23:26.674930] [INFO ] [REMOTE ] ATS: Full fetch complete (25680 records). [2025-10-02T17:23:26.675030] [DEBUG] [VALIDATOR ] ATS: Validating primary data. [2025-10-02T17:23:27.081615] [DEBUG] [VALIDATOR ] ATS: All expected trading days are present. [2025-10-02T17:23:27.081738] [DEBUG] [VALIDATOR ] ATS: Primary data validation passed. [2025-10-02T17:23:27.082137] [INFO ] [MAIN ] ATS: Fetched primary data is valid. [2025-10-02T17:23:27.082180] [DEBUG] [LOCAL ] ATS: Saving primary data. [2025-10-02T17:23:27.083074] [DEBUG] [LOCAL ] ATS: Trimmed 25680 records to 17921 (keeping 200 days of data) [2025-10-02T17:23:27.191197] [DEBUG] [LOCAL ] ATS: Primary data saved (17921 records). [2025-10-02T17:23:27.191344] [INFO ] [MAIN ] ATS: Full history saved. [2025-10-02T17:23:27.191427] [INFO ] [MAIN ] Update Progress: 175/2370 symbols completed. ATS took 37.4s. Estimated remaining: 4h 53m 22s. Rate: 7.5 symbols/min [2025-10-02T17:23:27.379609] [INFO ] [MAIN ] AUNA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:23:27.387192] [DEBUG] [LOCAL ] AUNA: Loaded 4886 existing records from primary storage. [2025-10-02T17:23:27.387422] [INFO ] [MAIN ] AUNA: Loaded 4886 existing records. [2025-10-02T17:23:27.480272] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-08. [2025-10-02T17:23:27.604102] [WARN ] [MAIN ] AUNA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:23:27.604419] [INFO ] [MAIN ] AUNA: Wiping existing primary data before full refresh. [2025-10-02T17:23:27.604490] [INFO ] [LOCAL ] AUNA: Starting deletion of primary data. [2025-10-02T17:23:27.604948] [DEBUG] [LOCAL ] AUNA: Deleted primary data file. [2025-10-02T17:23:27.605028] [INFO ] [MAIN ] AUNA: Starting full primary refresh. [2025-10-02T17:23:27.985497] [INFO ] [REMOTE ] AUNA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:23:28.272983] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2024-12. [2025-10-02T17:23:28.396488] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-02T17:23:28.592560] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-02T17:23:28.768501] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-02T17:23:29.073028] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-09. [2025-10-02T17:23:29.873033] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-02. [2025-10-02T17:23:30.673020] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-01. [2025-10-02T17:23:30.852254] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-02T17:23:31.320335] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-02T17:23:31.346634] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-02T17:23:31.473030] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-10. [2025-10-02T17:23:32.272999] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-02. [2025-10-02T17:23:32.587383] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-02T17:23:32.589455] [INFO ] [REMOTE ] ATUS: Full fetch complete (71001 records). [2025-10-02T17:23:32.589565] [DEBUG] [VALIDATOR ] ATUS: Validating primary data. [2025-10-02T17:23:32.939924] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-02T17:23:33.075091] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-03. [2025-10-02T17:23:33.076346] [DEBUG] [VALIDATOR ] ATUS: All expected trading days are present. [2025-10-02T17:23:33.076455] [DEBUG] [VALIDATOR ] ATUS: Primary data validation passed. [2025-10-02T17:23:33.077513] [INFO ] [MAIN ] ATUS: Fetched primary data is valid. [2025-10-02T17:23:33.077714] [DEBUG] [LOCAL ] ATUS: Saving primary data. [2025-10-02T17:23:33.079577] [DEBUG] [LOCAL ] ATUS: Trimmed 71001 records to 49646 (keeping 200 days of data) [2025-10-02T17:23:33.373926] [DEBUG] [LOCAL ] ATUS: Primary data saved (49646 records). [2025-10-02T17:23:33.374083] [INFO ] [MAIN ] ATUS: Full history saved. [2025-10-02T17:23:33.374178] [INFO ] [MAIN ] Update Progress: 176/2370 symbols completed. ATUS took 25.3s. Estimated remaining: 4h 52m 51s. Rate: 7.5 symbols/min [2025-10-02T17:23:33.573819] [INFO ] [MAIN ] AVA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:23:33.618603] [DEBUG] [LOCAL ] AVA: Loaded 39411 existing records from primary storage. [2025-10-02T17:23:33.618979] [INFO ] [MAIN ] AVA: Loaded 39411 existing records. [2025-10-02T17:23:33.748951] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-02T17:23:33.854598] [WARN ] [MAIN ] AVA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:23:33.854854] [INFO ] [MAIN ] AVA: Wiping existing primary data before full refresh. [2025-10-02T17:23:33.854911] [INFO ] [LOCAL ] AVA: Starting deletion of primary data. [2025-10-02T17:23:33.855782] [DEBUG] [LOCAL ] AVA: Deleted primary data file. [2025-10-02T17:23:33.855845] [INFO ] [MAIN ] AVA: Starting full primary refresh. [2025-10-02T17:23:33.881459] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-03. [2025-10-02T17:23:34.248863] [INFO ] [REMOTE ] AVA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:23:34.672997] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-03. [2025-10-02T17:23:35.473033] [INFO ] [REMOTE ] AVA: Fetching primary data for 2024-12. [2025-10-02T17:23:36.152277] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-02T17:23:36.282892] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-04. [2025-10-02T17:23:36.294799] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-02T17:23:36.659865] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-02T17:23:37.073019] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-01. [2025-10-02T17:23:37.872982] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-04. [2025-10-02T17:23:38.111997] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-02T17:23:38.197224] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-02T17:23:38.673032] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-05. [2025-10-02T17:23:39.466078] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-02T17:23:39.476942] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-02. [2025-10-02T17:23:40.273031] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-04. [2025-10-02T17:23:40.663692] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-02T17:23:40.819551] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-02T17:23:40.836783] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-02T17:23:41.073015] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-06. [2025-10-02T17:23:41.873010] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-05. [2025-10-02T17:23:42.432299] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-02T17:23:42.673051] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-03. [2025-10-02T17:23:42.829309] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-02T17:23:43.473041] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-05. [2025-10-02T17:23:43.949676] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-02T17:23:44.273021] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-06. [2025-10-02T17:23:44.655700] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-02T17:23:45.073045] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-07. [2025-10-02T17:23:45.102676] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-02T17:23:45.873050] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-06. [2025-10-02T17:23:46.673027] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-07. [2025-10-02T17:23:47.312089] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-02T17:23:47.351318] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-02T17:23:47.473025] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-04. [2025-10-02T17:23:47.761716] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-02T17:23:48.273057] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-07. [2025-10-02T17:23:49.065192] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-02T17:23:49.073621] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-08. [2025-10-02T17:23:49.872999] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-05. [2025-10-02T17:23:49.916632] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-02T17:23:50.673059] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-08. [2025-10-02T17:23:51.049256] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-02T17:23:51.120059] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-02T17:23:51.473071] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-09. [2025-10-02T17:23:52.224829] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-02T17:23:52.273009] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-09. [2025-10-02T17:23:53.072980] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-06. [2025-10-02T17:23:53.176243] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-02T17:23:53.309794] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-02T17:23:53.873026] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-08. [2025-10-02T17:23:54.485230] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-02T17:23:54.542543] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-02T17:23:54.673065] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-10. [2025-10-02T17:23:55.473014] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-10. [2025-10-02T17:23:56.273006] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-07. [2025-10-02T17:23:56.306155] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-02T17:23:56.308441] [INFO ] [REMOTE ] AU: Full fetch complete (76279 records). [2025-10-02T17:23:56.308572] [DEBUG] [VALIDATOR ] AU: Validating primary data. [2025-10-02T17:23:56.763351] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-02T17:23:56.809180] [INFO ] [REMOTE ] AUB: Full fetch complete (65723 records). [2025-10-02T17:23:56.809393] [DEBUG] [VALIDATOR ] AUB: Validating primary data. [2025-10-02T17:23:56.809512] [DEBUG] [VALIDATOR ] AU: All expected trading days are present. [2025-10-02T17:23:56.810028] [DEBUG] [VALIDATOR ] AU: Primary data validation passed. [2025-10-02T17:23:56.810955] [INFO ] [MAIN ] AU: Fetched primary data is valid. [2025-10-02T17:23:56.811137] [DEBUG] [LOCAL ] AU: Saving primary data. [2025-10-02T17:23:56.933186] [DEBUG] [LOCAL ] AU: Trimmed 76279 records to 53383 (keeping 200 days of data) [2025-10-02T17:23:57.087359] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-09. [2025-10-02T17:23:57.518202] [DEBUG] [VALIDATOR ] AUB: All expected trading days are present. [2025-10-02T17:23:57.519294] [DEBUG] [VALIDATOR ] AUB: Primary data validation passed. [2025-10-02T17:23:57.530024] [INFO ] [MAIN ] AUB: Fetched primary data is valid. [2025-10-02T17:23:57.531456] [DEBUG] [LOCAL ] AUB: Saving primary data. [2025-10-02T17:23:57.554903] [DEBUG] [LOCAL ] AUB: Trimmed 65723 records to 46648 (keeping 200 days of data) [2025-10-02T17:23:57.707358] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-02T17:23:57.708898] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-02T17:23:57.881991] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-10. [2025-10-02T17:23:57.972284] [DEBUG] [LOCAL ] AU: Primary data saved (53383 records). [2025-10-02T17:23:57.973247] [INFO ] [MAIN ] AU: Full history saved. [2025-10-02T17:23:57.974411] [INFO ] [MAIN ] Update Progress: 177/2370 symbols completed. AU took 38.2s. Estimated remaining: 4h 56m 9s. Rate: 7.4 symbols/min [2025-10-02T17:23:58.222074] [INFO ] [MAIN ] AVAL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:23:58.222775] [DEBUG] [LOCAL ] AVAL: No existing data file found in primary storage. [2025-10-02T17:23:58.222854] [WARN ] [MAIN ] AVAL: No existing data found, performing full refresh instead. [2025-10-02T17:23:58.225677] [INFO ] [MAIN ] AVAL: Wiping existing primary data before full refresh. [2025-10-02T17:23:58.228753] [INFO ] [LOCAL ] AVAL: Starting deletion of primary data. [2025-10-02T17:23:58.229852] [DEBUG] [LOCAL ] AVAL: No primary data file found to delete. [2025-10-02T17:23:58.232123] [INFO ] [MAIN ] AVAL: Starting full primary refresh. [2025-10-02T17:23:58.272681] [DEBUG] [LOCAL ] AUB: Primary data saved (46648 records). [2025-10-02T17:23:58.314328] [INFO ] [MAIN ] AUB: Full history saved. [2025-10-02T17:23:58.326190] [INFO ] [MAIN ] Update Progress: 178/2370 symbols completed. AUB took 36.9s. Estimated remaining: 4h 54m 25s. Rate: 7.4 symbols/min [2025-10-02T17:23:58.563304] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-02T17:23:58.617494] [INFO ] [REMOTE ] AUNA: Full fetch complete (7767 records). [2025-10-02T17:23:58.696880] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-08. [2025-10-02T17:23:58.674021] [DEBUG] [VALIDATOR ] AUNA: Validating primary data. [2025-10-02T17:23:58.760890] [INFO ] [MAIN ] AVB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:23:59.182770] [INFO ] [REMOTE ] AVAL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:23:59.273811] [DEBUG] [LOCAL ] AVB: Loaded 41937 existing records from primary storage. [2025-10-02T17:23:59.274135] [INFO ] [MAIN ] AVB: Loaded 41937 existing records. [2025-10-02T17:23:59.474836] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2024-12. [2025-10-02T17:23:59.494470] [DEBUG] [VALIDATOR ] AUNA: All expected trading days are present. [2025-10-02T17:23:59.504921] [DEBUG] [VALIDATOR ] AUNA: Primary data validation passed. [2025-10-02T17:23:59.506054] [INFO ] [MAIN ] AUNA: Fetched primary data is valid. [2025-10-02T17:23:59.511264] [DEBUG] [LOCAL ] AUNA: Saving primary data. [2025-10-02T17:23:59.517308] [DEBUG] [LOCAL ] AUNA: Trimmed 7767 records to 4958 (keeping 200 days of data) [2025-10-02T17:23:59.579900] [WARN ] [MAIN ] AVB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:23:59.580420] [INFO ] [MAIN ] AVB: Wiping existing primary data before full refresh. [2025-10-02T17:23:59.580482] [INFO ] [LOCAL ] AVB: Starting deletion of primary data. [2025-10-02T17:23:59.591107] [DEBUG] [LOCAL ] AVB: Deleted primary data file. [2025-10-02T17:23:59.593849] [INFO ] [MAIN ] AVB: Starting full primary refresh. [2025-10-02T17:23:59.802829] [DEBUG] [LOCAL ] AUNA: Primary data saved (4958 records). [2025-10-02T17:23:59.804943] [INFO ] [MAIN ] AUNA: Full history saved. [2025-10-02T17:23:59.805058] [INFO ] [MAIN ] Update Progress: 179/2370 symbols completed. AUNA took 32.6s. Estimated remaining: 4h 52m 57s. Rate: 7.5 symbols/min [2025-10-02T17:24:00.161672] [INFO ] [MAIN ] AVBC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:24:00.184905] [DEBUG] [LOCAL ] AVBC: No existing data file found in primary storage. [2025-10-02T17:24:00.197959] [WARN ] [MAIN ] AVBC: No existing data found, performing full refresh instead. [2025-10-02T17:24:00.236229] [INFO ] [MAIN ] AVBC: Wiping existing primary data before full refresh. [2025-10-02T17:24:00.236054] [INFO ] [REMOTE ] AVB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:24:00.236769] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-02T17:24:00.241933] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-02T17:24:00.242488] [INFO ] [MAIN ] AVBC: Starting full primary refresh. [2025-10-02T17:24:00.242901] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-02T17:24:00.278160] [INFO ] [REMOTE ] AVB: Fetching primary data for 2024-12. [2025-10-02T17:24:00.680153] [INFO ] [REMOTE ] AVBC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:24:00.682519] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-02T17:24:01.073071] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-01. [2025-10-02T17:24:01.878120] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-09. [2025-10-02T17:24:01.898782] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-02T17:24:01.938827] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-02T17:24:02.673037] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-02. [2025-10-02T17:24:03.271954] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-02T17:24:03.472993] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-10. [2025-10-02T17:24:03.631947] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-02T17:24:04.273038] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2024-12. [2025-10-02T17:24:04.450493] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-02T17:24:04.452420] [INFO ] [REMOTE ] AVA: Full fetch complete (55788 records). [2025-10-02T17:24:04.452535] [DEBUG] [VALIDATOR ] AVA: Validating primary data. [2025-10-02T17:24:04.503369] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T17:24:04.546350] [WARN ] [REMOTE ] AVBC: No data returned for month 2024-12 [2025-10-02T17:24:04.569888] [FATAL] [REMOTE ] AVBC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T17:24:04.573492] [FATAL] [MAIN ] AVBC: Failed to fetch primary data. [2025-10-02T17:24:04.573913] [WARN ] [MAIN ] AVBC: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T17:24:04.584480] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-02T17:24:04.594809] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-02T17:24:04.600010] [INFO ] [LOCAL ] AVBC: Starting deletion of derivative data. [2025-10-02T17:24:04.621978] [DEBUG] [LOCAL ] AVBC: No derivative data file found to delete. [2025-10-02T17:24:04.640574] [INFO ] [MAIN ] Update Progress: 180/2370 symbols completed. AVBC took 4.8s. Estimated remaining: 4h 52m 10s. Rate: 7.5 symbols/min [2025-10-02T17:24:05.077798] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-01. [2025-10-02T17:24:05.100626] [INFO ] [MAIN ] AVD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:24:05.102407] [DEBUG] [VALIDATOR ] AVA: All expected trading days are present. [2025-10-02T17:24:05.102521] [DEBUG] [VALIDATOR ] AVA: Primary data validation passed. [2025-10-02T17:24:05.103316] [INFO ] [MAIN ] AVA: Fetched primary data is valid. [2025-10-02T17:24:05.103681] [DEBUG] [LOCAL ] AVA: Saving primary data. [2025-10-02T17:24:05.105193] [DEBUG] [LOCAL ] AVA: Trimmed 55788 records to 39686 (keeping 200 days of data) [2025-10-02T17:24:05.240111] [DEBUG] [LOCAL ] AVD: Loaded 22593 existing records from primary storage. [2025-10-02T17:24:05.248318] [INFO ] [MAIN ] AVD: Loaded 22593 existing records. [2025-10-02T17:24:05.556239] [WARN ] [MAIN ] AVD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:24:05.561266] [INFO ] [MAIN ] AVD: Wiping existing primary data before full refresh. [2025-10-02T17:24:05.562697] [INFO ] [LOCAL ] AVD: Starting deletion of primary data. [2025-10-02T17:24:05.564924] [DEBUG] [LOCAL ] AVD: Deleted primary data file. [2025-10-02T17:24:05.566231] [INFO ] [MAIN ] AVD: Starting full primary refresh. [2025-10-02T17:24:05.752008] [DEBUG] [LOCAL ] AVA: Primary data saved (39686 records). [2025-10-02T17:24:05.769496] [INFO ] [MAIN ] AVA: Full history saved. [2025-10-02T17:24:05.770698] [INFO ] [MAIN ] Update Progress: 181/2370 symbols completed. AVA took 32.4s. Estimated remaining: 4h 50m 39s. Rate: 7.5 symbols/min [2025-10-02T17:24:05.876374] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-03. [2025-10-02T17:24:06.148149] [INFO ] [MAIN ] AVK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:24:06.188331] [INFO ] [REMOTE ] AVD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:24:06.208310] [DEBUG] [LOCAL ] AVK: Loaded 17956 existing records from primary storage. [2025-10-02T17:24:06.208774] [INFO ] [MAIN ] AVK: Loaded 17956 existing records. [2025-10-02T17:24:06.433534] [WARN ] [MAIN ] AVK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:24:06.433864] [INFO ] [MAIN ] AVK: Wiping existing primary data before full refresh. [2025-10-02T17:24:06.433943] [INFO ] [LOCAL ] AVK: Starting deletion of primary data. [2025-10-02T17:24:06.441851] [DEBUG] [LOCAL ] AVK: Deleted primary data file. [2025-10-02T17:24:06.455487] [INFO ] [MAIN ] AVK: Starting full primary refresh. [2025-10-02T17:24:06.462664] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-02T17:24:06.674694] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-02. [2025-10-02T17:24:06.881935] [INFO ] [REMOTE ] AVK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:24:06.894194] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-02T17:24:07.473038] [INFO ] [REMOTE ] AVK: Fetching primary data for 2024-12. [2025-10-02T17:24:07.854948] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-02T17:24:08.273026] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-04. [2025-10-02T17:24:08.750235] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-02T17:24:08.867960] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-02T17:24:09.073053] [INFO ] [REMOTE ] AVD: Fetching primary data for 2024-12. [2025-10-02T17:24:09.873059] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-05. [2025-10-02T17:24:10.405136] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-02T17:24:10.443195] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-02T17:24:10.673025] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-01. [2025-10-02T17:24:11.473052] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-01. [2025-10-02T17:24:11.856394] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-02T17:24:12.243992] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-02T17:24:12.273011] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-03. [2025-10-02T17:24:13.073015] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-02. [2025-10-02T17:24:13.871143] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-02T17:24:13.875060] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-02. [2025-10-02T17:24:13.966286] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-02T17:24:14.673005] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-03. [2025-10-02T17:24:14.830109] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-02T17:24:15.473056] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-04. [2025-10-02T17:24:15.995478] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-02T17:24:16.273002] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-04. [2025-10-02T17:24:16.992640] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-02T17:24:17.072970] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-03. [2025-10-02T17:24:17.144939] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-02T17:24:17.873013] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-05. [2025-10-02T17:24:18.087920] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-02T17:24:18.672982] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-04. [2025-10-02T17:24:18.797583] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-02T17:24:19.473022] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-06. [2025-10-02T17:24:19.908696] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-02T17:24:20.273045] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-05. [2025-10-02T17:24:20.685582] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-02T17:24:21.073015] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-07. [2025-10-02T17:24:21.822633] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-02T17:24:21.872988] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-05. [2025-10-02T17:24:22.261422] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-02T17:24:22.673030] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-08. [2025-10-02T17:24:22.805600] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-02T17:24:23.473071] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-06. [2025-10-02T17:24:23.774444] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-02T17:24:24.273009] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-06. [2025-10-02T17:24:24.840312] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-02T17:24:25.078404] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-09. [2025-10-02T17:24:25.090489] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-02T17:24:25.873007] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-06. [2025-10-02T17:24:26.184409] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-02T17:24:26.672972] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-07. [2025-10-02T17:24:26.899698] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-02T17:24:27.473006] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-10. [2025-10-02T17:24:28.121025] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-02T17:24:28.122446] [INFO ] [REMOTE ] AVD: Full fetch complete (33661 records). [2025-10-02T17:24:28.122616] [DEBUG] [VALIDATOR ] AVD: Validating primary data. [2025-10-02T17:24:28.276115] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-07. [2025-10-02T17:24:28.514444] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-02T17:24:28.628490] [DEBUG] [VALIDATOR ] AVD: All expected trading days are present. [2025-10-02T17:24:28.628586] [DEBUG] [VALIDATOR ] AVD: Primary data validation passed. [2025-10-02T17:24:28.629023] [INFO ] [MAIN ] AVD: Fetched primary data is valid. [2025-10-02T17:24:28.629088] [DEBUG] [LOCAL ] AVD: Saving primary data. [2025-10-02T17:24:28.630158] [DEBUG] [LOCAL ] AVD: Trimmed 33661 records to 22716 (keeping 200 days of data) [2025-10-02T17:24:28.773291] [DEBUG] [LOCAL ] AVD: Primary data saved (22716 records). [2025-10-02T17:24:28.773923] [INFO ] [MAIN ] AVD: Full history saved. [2025-10-02T17:24:28.774137] [INFO ] [MAIN ] Update Progress: 182/2370 symbols completed. AVD took 24.1s. Estimated remaining: 4h 53m 32s. Rate: 7.5 symbols/min [2025-10-02T17:24:28.986226] [INFO ] [MAIN ] AVNS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:24:29.026934] [DEBUG] [LOCAL ] AVNS: Loaded 33718 existing records from primary storage. [2025-10-02T17:24:29.027248] [INFO ] [MAIN ] AVNS: Loaded 33718 existing records. [2025-10-02T17:24:29.075715] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-08. [2025-10-02T17:24:29.249397] [WARN ] [MAIN ] AVNS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:24:29.249704] [INFO ] [MAIN ] AVNS: Wiping existing primary data before full refresh. [2025-10-02T17:24:29.249835] [INFO ] [LOCAL ] AVNS: Starting deletion of primary data. [2025-10-02T17:24:29.251150] [DEBUG] [LOCAL ] AVNS: Deleted primary data file. [2025-10-02T17:24:29.251214] [INFO ] [MAIN ] AVNS: Starting full primary refresh. [2025-10-02T17:24:29.619006] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-02T17:24:29.712124] [INFO ] [REMOTE ] AVNS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:24:29.872997] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-08. [2025-10-02T17:24:30.672989] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2024-12. [2025-10-02T17:24:30.746707] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-02T17:24:30.776099] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-02T17:24:31.473019] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-09. [2025-10-02T17:24:32.026621] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-02T17:24:32.272989] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-07. [2025-10-02T17:24:32.508288] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-02T17:24:32.892013] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-02T17:24:33.072997] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-09. [2025-10-02T17:24:33.872998] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-08. [2025-10-02T17:24:34.362776] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-02T17:24:34.665501] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-02T17:24:34.672960] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-09. [2025-10-02T17:24:35.473020] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-01. [2025-10-02T17:24:35.821162] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-02T17:24:36.273057] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-10. [2025-10-02T17:24:36.802455] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-02T17:24:37.072994] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-10. [2025-10-02T17:24:37.445623] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-02T17:24:37.447608] [INFO ] [REMOTE ] AVB: Full fetch complete (58642 records). [2025-10-02T17:24:37.447760] [DEBUG] [VALIDATOR ] AVB: Validating primary data. [2025-10-02T17:24:37.883306] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-02. [2025-10-02T17:24:37.948314] [DEBUG] [VALIDATOR ] AVB: All expected trading days are present. [2025-10-02T17:24:37.948417] [DEBUG] [VALIDATOR ] AVB: Primary data validation passed. [2025-10-02T17:24:37.949141] [INFO ] [MAIN ] AVB: Fetched primary data is valid. [2025-10-02T17:24:37.949209] [DEBUG] [LOCAL ] AVB: Saving primary data. [2025-10-02T17:24:37.950584] [DEBUG] [LOCAL ] AVB: Trimmed 58642 records to 42269 (keeping 200 days of data) [2025-10-02T17:24:38.059100] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-02T17:24:38.062961] [INFO ] [REMOTE ] AVK: Full fetch complete (26735 records). [2025-10-02T17:24:38.063905] [DEBUG] [VALIDATOR ] AVK: Validating primary data. [2025-10-02T17:24:38.525933] [DEBUG] [VALIDATOR ] AVK: All expected trading days are present. [2025-10-02T17:24:38.530881] [DEBUG] [VALIDATOR ] AVK: Primary data validation passed. [2025-10-02T17:24:38.538633] [INFO ] [MAIN ] AVK: Fetched primary data is valid. [2025-10-02T17:24:38.538836] [DEBUG] [LOCAL ] AVK: Saving primary data. [2025-10-02T17:24:38.613134] [DEBUG] [LOCAL ] AVK: Trimmed 26735 records to 18153 (keeping 200 days of data) [2025-10-02T17:24:38.710454] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-10. [2025-10-02T17:24:38.862626] [DEBUG] [LOCAL ] AVK: Primary data saved (18153 records). [2025-10-02T17:24:38.863365] [INFO ] [MAIN ] AVK: Full history saved. [2025-10-02T17:24:38.864024] [INFO ] [MAIN ] Update Progress: 183/2370 symbols completed. AVK took 33.1s. Estimated remaining: 4h 53m 48s. Rate: 7.4 symbols/min [2025-10-02T17:24:38.913006] [DEBUG] [LOCAL ] AVB: Primary data saved (42269 records). [2025-10-02T17:24:38.935903] [INFO ] [MAIN ] AVB: Full history saved. [2025-10-02T17:24:38.936060] [INFO ] [MAIN ] Update Progress: 184/2370 symbols completed. AVB took 40.6s. Estimated remaining: 4h 52m 5s. Rate: 7.5 symbols/min [2025-10-02T17:24:39.206201] [INFO ] [MAIN ] AVNT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:24:39.287236] [INFO ] [MAIN ] AVTR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:24:39.287615] [DEBUG] [LOCAL ] AVTR: No existing data file found in primary storage. [2025-10-02T17:24:39.287836] [WARN ] [MAIN ] AVTR: No existing data found, performing full refresh instead. [2025-10-02T17:24:39.288207] [INFO ] [MAIN ] AVTR: Wiping existing primary data before full refresh. [2025-10-02T17:24:39.288344] [INFO ] [LOCAL ] AVTR: Starting deletion of primary data. [2025-10-02T17:24:39.305747] [DEBUG] [LOCAL ] AVTR: No primary data file found to delete. [2025-10-02T17:24:39.305928] [INFO ] [MAIN ] AVTR: Starting full primary refresh. [2025-10-02T17:24:39.322730] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-02T17:24:39.329577] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-02T17:24:39.356879] [INFO ] [REMOTE ] AVAL: Full fetch complete (14673 records). [2025-10-02T17:24:39.391897] [DEBUG] [VALIDATOR ] AVAL: Validating primary data. [2025-10-02T17:24:39.474857] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-03. [2025-10-02T17:24:39.699869] [DEBUG] [LOCAL ] AVNT: Loaded 39175 existing records from primary storage. [2025-10-02T17:24:39.739105] [INFO ] [MAIN ] AVNT: Loaded 39175 existing records. [2025-10-02T17:24:40.240517] [INFO ] [REMOTE ] AVTR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:24:40.291733] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2024-12. [2025-10-02T17:24:40.396507] [WARN ] [MAIN ] AVNT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:24:40.433994] [DEBUG] [VALIDATOR ] AVAL: All expected trading days are present. [2025-10-02T17:24:40.433780] [INFO ] [MAIN ] AVNT: Wiping existing primary data before full refresh. [2025-10-02T17:24:40.434207] [DEBUG] [VALIDATOR ] AVAL: Primary data validation passed. [2025-10-02T17:24:40.434741] [INFO ] [MAIN ] AVAL: Fetched primary data is valid. [2025-10-02T17:24:40.434816] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-10-02T17:24:40.434891] [DEBUG] [LOCAL ] AVAL: Saving primary data. [2025-10-02T17:24:40.435574] [DEBUG] [LOCAL ] AVAL: Trimmed 14673 records to 8795 (keeping 200 days of data) [2025-10-02T17:24:40.436204] [DEBUG] [LOCAL ] AVNT: Deleted primary data file. [2025-10-02T17:24:40.436475] [INFO ] [MAIN ] AVNT: Starting full primary refresh. [2025-10-02T17:24:40.820988] [DEBUG] [LOCAL ] AVAL: Primary data saved (8795 records). [2025-10-02T17:24:40.839419] [INFO ] [MAIN ] AVAL: Full history saved. [2025-10-02T17:24:40.859731] [INFO ] [MAIN ] Update Progress: 185/2370 symbols completed. AVAL took 42.9s. Estimated remaining: 4h 50m 45s. Rate: 7.5 symbols/min [2025-10-02T17:24:40.891767] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-02T17:24:41.089133] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-04. [2025-10-02T17:24:41.099519] [INFO ] [REMOTE ] AVNT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:24:41.178827] [INFO ] [MAIN ] AVY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:24:41.226334] [DEBUG] [LOCAL ] AVY: Loaded 37474 existing records from primary storage. [2025-10-02T17:24:41.226637] [INFO ] [MAIN ] AVY: Loaded 37474 existing records. [2025-10-02T17:24:41.430455] [WARN ] [MAIN ] AVY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:24:41.430919] [INFO ] [MAIN ] AVY: Wiping existing primary data before full refresh. [2025-10-02T17:24:41.430975] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-10-02T17:24:41.432120] [DEBUG] [LOCAL ] AVY: Deleted primary data file. [2025-10-02T17:24:41.432183] [INFO ] [MAIN ] AVY: Starting full primary refresh. [2025-10-02T17:24:41.833048] [INFO ] [REMOTE ] AVY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:24:41.872984] [INFO ] [REMOTE ] AVY: Fetching primary data for 2024-12. [2025-10-02T17:24:42.354830] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-02T17:24:42.673033] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2024-12. [2025-10-02T17:24:42.718032] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-02T17:24:43.388034] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-02T17:24:43.473009] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-01. [2025-10-02T17:24:43.841054] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-02T17:24:44.273008] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-01. [2025-10-02T17:24:45.072992] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-01. [2025-10-02T17:24:45.127233] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-02T17:24:45.244811] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-02T17:24:45.873060] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-02. [2025-10-02T17:24:46.664107] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-02T17:24:46.673438] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-05. [2025-10-02T17:24:47.472973] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-02. [2025-10-02T17:24:47.517394] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-02T17:24:47.968567] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-02T17:24:48.273099] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-06. [2025-10-02T17:24:49.072858] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-02T17:24:49.073012] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-03. [2025-10-02T17:24:49.511292] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-02T17:24:49.873000] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-03. [2025-10-02T17:24:50.527108] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-02T17:24:50.673007] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-07. [2025-10-02T17:24:51.038366] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-02T17:24:51.473001] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-04. [2025-10-02T17:24:51.958266] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-02T17:24:52.273011] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-04. [2025-10-02T17:24:52.812247] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-02T17:24:53.073013] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-08. [2025-10-02T17:24:53.872983] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-02. [2025-10-02T17:24:54.112257] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-02T17:24:54.673962] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-05. [2025-10-02T17:24:54.677556] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-02T17:24:55.243248] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-02T17:24:55.473025] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-03. [2025-10-02T17:24:56.267554] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-02T17:24:56.278111] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-05. [2025-10-02T17:24:57.033343] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-02T17:24:57.073004] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-06. [2025-10-02T17:24:57.272008] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-02T17:24:57.873046] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-06. [2025-10-02T17:24:58.640012] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-02T17:24:58.672980] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-07. [2025-10-02T17:24:59.260899] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-02T17:24:59.473081] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-09. [2025-10-02T17:25:00.273156] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-04. [2025-10-02T17:25:00.584593] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-02T17:25:00.938207] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-02T17:25:01.073011] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-07. [2025-10-02T17:25:01.688387] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-02T17:25:01.873028] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-08. [2025-10-02T17:25:02.662245] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-02T17:25:02.672970] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-08. [2025-10-02T17:25:03.473055] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-05. [2025-10-02T17:25:03.763482] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-02T17:25:04.174426] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-02T17:25:04.273038] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-09. [2025-10-02T17:25:05.073016] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-10. [2025-10-02T17:25:05.131202] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-02T17:25:05.873028] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-09. [2025-10-02T17:25:06.214234] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-02T17:25:06.232393] [INFO ] [REMOTE ] AVNS: Full fetch complete (48295 records). [2025-10-02T17:25:06.247564] [DEBUG] [VALIDATOR ] AVNS: Validating primary data. [2025-10-02T17:25:06.253595] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-02T17:25:06.675146] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-10. [2025-10-02T17:25:06.692218] [DEBUG] [VALIDATOR ] AVNS: All expected trading days are present. [2025-10-02T17:25:06.692303] [DEBUG] [VALIDATOR ] AVNS: Primary data validation passed. [2025-10-02T17:25:06.692872] [INFO ] [MAIN ] AVNS: Fetched primary data is valid. [2025-10-02T17:25:06.692935] [DEBUG] [LOCAL ] AVNS: Saving primary data. [2025-10-02T17:25:06.694153] [DEBUG] [LOCAL ] AVNS: Trimmed 48295 records to 33967 (keeping 200 days of data) [2025-10-02T17:25:06.916556] [DEBUG] [LOCAL ] AVNS: Primary data saved (33967 records). [2025-10-02T17:25:06.916735] [INFO ] [MAIN ] AVNS: Full history saved. [2025-10-02T17:25:06.916888] [INFO ] [MAIN ] Update Progress: 186/2370 symbols completed. AVNS took 38.1s. Estimated remaining: 4h 54m 9s. Rate: 7.4 symbols/min [2025-10-02T17:25:07.107987] [INFO ] [MAIN ] AWF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:25:07.135565] [DEBUG] [LOCAL ] AWF: Loaded 24390 existing records from primary storage. [2025-10-02T17:25:07.135892] [INFO ] [MAIN ] AWF: Loaded 24390 existing records. [2025-10-02T17:25:07.342881] [WARN ] [MAIN ] AWF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:25:07.343164] [INFO ] [MAIN ] AWF: Wiping existing primary data before full refresh. [2025-10-02T17:25:07.343228] [INFO ] [LOCAL ] AWF: Starting deletion of primary data. [2025-10-02T17:25:07.344085] [DEBUG] [LOCAL ] AWF: Deleted primary data file. [2025-10-02T17:25:07.344160] [INFO ] [MAIN ] AWF: Starting full primary refresh. [2025-10-02T17:25:07.475049] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-06. [2025-10-02T17:25:07.711738] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-02T17:25:07.830286] [INFO ] [REMOTE ] AWF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:25:08.190491] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-02T17:25:08.192564] [INFO ] [REMOTE ] AVTR: Full fetch complete (77439 records). [2025-10-02T17:25:08.192734] [DEBUG] [VALIDATOR ] AVTR: Validating primary data. [2025-10-02T17:25:08.278200] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-10. [2025-10-02T17:25:08.626296] [DEBUG] [VALIDATOR ] AVTR: All expected trading days are present. [2025-10-02T17:25:08.626381] [DEBUG] [VALIDATOR ] AVTR: Primary data validation passed. [2025-10-02T17:25:08.627163] [INFO ] [MAIN ] AVTR: Fetched primary data is valid. [2025-10-02T17:25:08.627227] [DEBUG] [LOCAL ] AVTR: Saving primary data. [2025-10-02T17:25:08.629003] [DEBUG] [LOCAL ] AVTR: Trimmed 77439 records to 53952 (keeping 200 days of data) [2025-10-02T17:25:08.999132] [DEBUG] [LOCAL ] AVTR: Primary data saved (53952 records). [2025-10-02T17:25:08.999299] [INFO ] [MAIN ] AVTR: Full history saved. [2025-10-02T17:25:08.999502] [INFO ] [MAIN ] Update Progress: 187/2370 symbols completed. AVTR took 30.0s. Estimated remaining: 4h 52m 51s. Rate: 7.5 symbols/min [2025-10-02T17:25:09.080810] [INFO ] [REMOTE ] AWF: Fetching primary data for 2024-12. [2025-10-02T17:25:09.224153] [INFO ] [MAIN ] AWI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:25:09.253176] [DEBUG] [LOCAL ] AWI: Loaded 25337 existing records from primary storage. [2025-10-02T17:25:09.253573] [INFO ] [MAIN ] AWI: Loaded 25337 existing records. [2025-10-02T17:25:09.398042] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-02T17:25:09.493702] [WARN ] [MAIN ] AWI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:25:09.493936] [INFO ] [MAIN ] AWI: Wiping existing primary data before full refresh. [2025-10-02T17:25:09.494024] [INFO ] [LOCAL ] AWI: Starting deletion of primary data. [2025-10-02T17:25:09.494766] [DEBUG] [LOCAL ] AWI: Deleted primary data file. [2025-10-02T17:25:09.494828] [INFO ] [MAIN ] AWI: Starting full primary refresh. [2025-10-02T17:25:09.837525] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-02T17:25:09.856482] [INFO ] [REMOTE ] AVY: Full fetch complete (56304 records). [2025-10-02T17:25:09.883179] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-07. [2025-10-02T17:25:09.867025] [DEBUG] [VALIDATOR ] AVY: Validating primary data. [2025-10-02T17:25:09.977485] [INFO ] [REMOTE ] AWI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:25:10.370632] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-02T17:25:10.399306] [DEBUG] [VALIDATOR ] AVY: All expected trading days are present. [2025-10-02T17:25:10.399395] [DEBUG] [VALIDATOR ] AVY: Primary data validation passed. [2025-10-02T17:25:10.400099] [INFO ] [MAIN ] AVY: Fetched primary data is valid. [2025-10-02T17:25:10.400171] [DEBUG] [LOCAL ] AVY: Saving primary data. [2025-10-02T17:25:10.401369] [DEBUG] [LOCAL ] AVY: Trimmed 56304 records to 37777 (keeping 200 days of data) [2025-10-02T17:25:10.662831] [DEBUG] [LOCAL ] AVY: Primary data saved (37777 records). [2025-10-02T17:25:10.662983] [INFO ] [MAIN ] AVY: Full history saved. [2025-10-02T17:25:10.665126] [INFO ] [MAIN ] Update Progress: 188/2370 symbols completed. AVY took 29.8s. Estimated remaining: 4h 51m 29s. Rate: 7.5 symbols/min [2025-10-02T17:25:10.678185] [INFO ] [REMOTE ] AWI: Fetching primary data for 2024-12. [2025-10-02T17:25:10.872913] [INFO ] [MAIN ] AWK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:25:10.933474] [DEBUG] [LOCAL ] AWK: Loaded 48703 existing records from primary storage. [2025-10-02T17:25:10.933937] [INFO ] [MAIN ] AWK: Loaded 48703 existing records. [2025-10-02T17:25:11.147827] [WARN ] [MAIN ] AWK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:25:11.148294] [INFO ] [MAIN ] AWK: Wiping existing primary data before full refresh. [2025-10-02T17:25:11.148353] [INFO ] [LOCAL ] AWK: Starting deletion of primary data. [2025-10-02T17:25:11.150546] [DEBUG] [LOCAL ] AWK: Deleted primary data file. [2025-10-02T17:25:11.150620] [INFO ] [MAIN ] AWK: Starting full primary refresh. [2025-10-02T17:25:11.479363] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-01. [2025-10-02T17:25:11.555892] [INFO ] [REMOTE ] AWK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:25:11.590786] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-02T17:25:11.607250] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-02T17:25:12.273040] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-08. [2025-10-02T17:25:12.642529] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-02T17:25:13.073010] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-02. [2025-10-02T17:25:13.287945] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-02T17:25:13.872991] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-09. [2025-10-02T17:25:14.150256] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-02T17:25:14.673021] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-03. [2025-10-02T17:25:15.045841] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-02T17:25:15.473028] [INFO ] [REMOTE ] AWK: Fetching primary data for 2024-12. [2025-10-02T17:25:15.930312] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-02T17:25:16.273052] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-04. [2025-10-02T17:25:16.992035] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-02T17:25:17.072996] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-01. [2025-10-02T17:25:17.424035] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-02T17:25:17.873010] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-05. [2025-10-02T17:25:18.475030] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-02T17:25:18.673021] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-02. [2025-10-02T17:25:19.021250] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-02T17:25:19.473001] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-06. [2025-10-02T17:25:20.272968] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-10. [2025-10-02T17:25:20.475319] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-02T17:25:20.582782] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-02T17:25:21.073006] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-01. [2025-10-02T17:25:21.379401] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-02T17:25:21.381223] [INFO ] [REMOTE ] AVNT: Full fetch complete (56422 records). [2025-10-02T17:25:21.381319] [DEBUG] [VALIDATOR ] AVNT: Validating primary data. [2025-10-02T17:25:21.830133] [DEBUG] [VALIDATOR ] AVNT: All expected trading days are present. [2025-10-02T17:25:21.830464] [DEBUG] [VALIDATOR ] AVNT: Primary data validation passed. [2025-10-02T17:25:21.831202] [INFO ] [MAIN ] AVNT: Fetched primary data is valid. [2025-10-02T17:25:21.831390] [DEBUG] [LOCAL ] AVNT: Saving primary data. [2025-10-02T17:25:21.833102] [DEBUG] [LOCAL ] AVNT: Trimmed 56422 records to 39453 (keeping 200 days of data) [2025-10-02T17:25:21.900468] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-07. [2025-10-02T17:25:21.994550] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-02T17:25:22.122897] [DEBUG] [LOCAL ] AVNT: Primary data saved (39453 records). [2025-10-02T17:25:22.123057] [INFO ] [MAIN ] AVNT: Full history saved. [2025-10-02T17:25:22.123156] [INFO ] [MAIN ] Update Progress: 189/2370 symbols completed. AVNT took 43.3s. Estimated remaining: 4h 52m 1s. Rate: 7.5 symbols/min [2025-10-02T17:25:22.299085] [INFO ] [MAIN ] AWP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:25:22.322016] [DEBUG] [LOCAL ] AWP: Loaded 21493 existing records from primary storage. [2025-10-02T17:25:22.322306] [INFO ] [MAIN ] AWP: Loaded 21493 existing records. [2025-10-02T17:25:22.521761] [WARN ] [MAIN ] AWP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:25:22.522046] [INFO ] [MAIN ] AWP: Wiping existing primary data before full refresh. [2025-10-02T17:25:22.522095] [INFO ] [LOCAL ] AWP: Starting deletion of primary data. [2025-10-02T17:25:22.522931] [DEBUG] [LOCAL ] AWP: Deleted primary data file. [2025-10-02T17:25:22.522992] [INFO ] [MAIN ] AWP: Starting full primary refresh. [2025-10-02T17:25:22.679262] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-03. [2025-10-02T17:25:22.885510] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-02T17:25:22.950961] [INFO ] [REMOTE ] AWP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:25:23.473022] [INFO ] [REMOTE ] AWP: Fetching primary data for 2024-12. [2025-10-02T17:25:24.272995] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-08. [2025-10-02T17:25:24.522482] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-02T17:25:24.557637] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-02T17:25:25.072984] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-02. [2025-10-02T17:25:25.450842] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-02T17:25:25.873004] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-01. [2025-10-02T17:25:26.197528] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-02T17:25:26.673023] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-04. [2025-10-02T17:25:27.092776] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-02T17:25:27.473012] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-09. [2025-10-02T17:25:28.273004] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-03. [2025-10-02T17:25:28.509836] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-02T17:25:28.643398] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-02T17:25:29.072966] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-02. [2025-10-02T17:25:29.468739] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-02T17:25:29.873004] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-10. [2025-10-02T17:25:30.058060] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-02T17:25:30.672990] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-03. [2025-10-02T17:25:31.063427] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-02T17:25:31.065170] [INFO ] [REMOTE ] AWF: Full fetch complete (36117 records). [2025-10-02T17:25:31.065267] [DEBUG] [VALIDATOR ] AWF: Validating primary data. [2025-10-02T17:25:31.471889] [DEBUG] [VALIDATOR ] AWF: All expected trading days are present. [2025-10-02T17:25:31.472075] [DEBUG] [VALIDATOR ] AWF: Primary data validation passed. [2025-10-02T17:25:31.472857] [INFO ] [MAIN ] AWF: Fetched primary data is valid. [2025-10-02T17:25:31.472943] [DEBUG] [LOCAL ] AWF: Saving primary data. [2025-10-02T17:25:31.473105] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-04. [2025-10-02T17:25:31.475587] [DEBUG] [LOCAL ] AWF: Trimmed 36117 records to 24560 (keeping 200 days of data) [2025-10-02T17:25:31.583497] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-02T17:25:31.658145] [DEBUG] [LOCAL ] AWF: Primary data saved (24560 records). [2025-10-02T17:25:31.658327] [INFO ] [MAIN ] AWF: Full history saved. [2025-10-02T17:25:31.658445] [INFO ] [MAIN ] Update Progress: 190/2370 symbols completed. AWF took 24.7s. Estimated remaining: 4h 52m 10s. Rate: 7.5 symbols/min [2025-10-02T17:25:31.867222] [INFO ] [MAIN ] AWR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:25:31.890602] [DEBUG] [LOCAL ] AWR: Loaded 22600 existing records from primary storage. [2025-10-02T17:25:31.890950] [INFO ] [MAIN ] AWR: Loaded 22600 existing records. [2025-10-02T17:25:32.097003] [WARN ] [MAIN ] AWR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:25:32.097264] [INFO ] [MAIN ] AWR: Wiping existing primary data before full refresh. [2025-10-02T17:25:32.097316] [INFO ] [LOCAL ] AWR: Starting deletion of primary data. [2025-10-02T17:25:32.098038] [DEBUG] [LOCAL ] AWR: Deleted primary data file. [2025-10-02T17:25:32.098102] [INFO ] [MAIN ] AWR: Starting full primary refresh. [2025-10-02T17:25:32.285337] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-05. [2025-10-02T17:25:32.488287] [INFO ] [REMOTE ] AWR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:25:33.007681] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-02T17:25:33.073018] [INFO ] [REMOTE ] AWR: Fetching primary data for 2024-12. [2025-10-02T17:25:33.872972] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-05. [2025-10-02T17:25:34.013284] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-02T17:25:34.155918] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-02T17:25:34.673032] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-06. [2025-10-02T17:25:34.955964] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-02T17:25:35.473024] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-01. [2025-10-02T17:25:36.273031] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-06. [2025-10-02T17:25:36.376069] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-02T17:25:36.586473] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-02T17:25:37.019746] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-02T17:25:37.073055] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-07. [2025-10-02T17:25:37.873068] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-02. [2025-10-02T17:25:38.288733] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-02T17:25:38.585579] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-02T17:25:38.673048] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-07. [2025-10-02T17:25:39.473012] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-03. [2025-10-02T17:25:40.116710] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-02T17:25:40.273010] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-08. [2025-10-02T17:25:40.640708] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-02T17:25:41.073033] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-04. [2025-10-02T17:25:41.873014] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-04. [2025-10-02T17:25:41.963361] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-02T17:25:41.988777] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-02T17:25:42.673017] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-05. [2025-10-02T17:25:43.108525] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-02T17:25:43.472974] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-09. [2025-10-02T17:25:43.631070] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-02T17:25:44.273015] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-06. [2025-10-02T17:25:45.072985] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-08. [2025-10-02T17:25:45.231532] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-02T17:25:45.362832] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-02T17:25:45.873068] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-05. [2025-10-02T17:25:46.244872] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-02T17:25:46.673050] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-09. [2025-10-02T17:25:47.093188] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-02T17:25:47.352211] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-02T17:25:47.473004] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-10. [2025-10-02T17:25:48.273022] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-07. [2025-10-02T17:25:48.295067] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-02T17:25:48.296427] [INFO ] [REMOTE ] AWI: Full fetch complete (35354 records). [2025-10-02T17:25:48.296524] [DEBUG] [VALIDATOR ] AWI: Validating primary data. [2025-10-02T17:25:48.297148] [FATAL] [VALIDATOR ] AWI: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:25:48.297237] [FATAL] [MAIN ] AWI: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:25:48.297281] [WARN ] [MAIN ] AWI: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:25:48.297326] [INFO ] [LOCAL ] AWI: Starting deletion of primary data. [2025-10-02T17:25:48.297389] [DEBUG] [LOCAL ] AWI: No primary data file found to delete. [2025-10-02T17:25:48.297425] [INFO ] [LOCAL ] AWI: Starting deletion of derivative data. [2025-10-02T17:25:48.298268] [DEBUG] [LOCAL ] AWI: Deleted derivative data file. [2025-10-02T17:25:48.298375] [INFO ] [MAIN ] Update Progress: 191/2370 symbols completed. AWI took 39.3s. Estimated remaining: 4h 53m 40s. Rate: 7.4 symbols/min [2025-10-02T17:25:48.487608] [INFO ] [MAIN ] AX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:25:48.520739] [DEBUG] [LOCAL ] AX: Loaded 28317 existing records from primary storage. [2025-10-02T17:25:48.521051] [INFO ] [MAIN ] AX: Loaded 28317 existing records. [2025-10-02T17:25:48.755368] [WARN ] [MAIN ] AX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:25:48.755608] [INFO ] [MAIN ] AX: Wiping existing primary data before full refresh. [2025-10-02T17:25:48.755715] [INFO ] [LOCAL ] AX: Starting deletion of primary data. [2025-10-02T17:25:48.756609] [DEBUG] [LOCAL ] AX: Deleted primary data file. [2025-10-02T17:25:48.756706] [INFO ] [MAIN ] AX: Starting full primary refresh. [2025-10-02T17:25:49.078207] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-06. [2025-10-02T17:25:49.197461] [INFO ] [REMOTE ] AX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:25:49.676133] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-02T17:25:49.873009] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-10. [2025-10-02T17:25:50.331514] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-02T17:25:50.673026] [INFO ] [REMOTE ] AX: Fetching primary data for 2024-12. [2025-10-02T17:25:51.379584] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-02T17:25:51.381758] [INFO ] [REMOTE ] AWK: Full fetch complete (70638 records). [2025-10-02T17:25:51.381867] [DEBUG] [VALIDATOR ] AWK: Validating primary data. [2025-10-02T17:25:51.478103] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-07. [2025-10-02T17:25:51.814961] [DEBUG] [VALIDATOR ] AWK: All expected trading days are present. [2025-10-02T17:25:51.815135] [DEBUG] [VALIDATOR ] AWK: Primary data validation passed. [2025-10-02T17:25:51.815988] [INFO ] [MAIN ] AWK: Fetched primary data is valid. [2025-10-02T17:25:51.816054] [DEBUG] [LOCAL ] AWK: Saving primary data. [2025-10-02T17:25:51.817727] [DEBUG] [LOCAL ] AWK: Trimmed 70638 records to 49037 (keeping 200 days of data) [2025-10-02T17:25:52.122701] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-02T17:25:52.197242] [DEBUG] [LOCAL ] AWK: Primary data saved (49037 records). [2025-10-02T17:25:52.197407] [INFO ] [MAIN ] AWK: Full history saved. [2025-10-02T17:25:52.198710] [INFO ] [MAIN ] Update Progress: 192/2370 symbols completed. AWK took 41.5s. Estimated remaining: 4h 52m 44s. Rate: 7.4 symbols/min [2025-10-02T17:25:52.281478] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-01. [2025-10-02T17:25:52.440511] [INFO ] [MAIN ] AXL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:25:52.502136] [DEBUG] [LOCAL ] AXL: Loaded 50496 existing records from primary storage. [2025-10-02T17:25:52.502477] [INFO ] [MAIN ] AXL: Loaded 50496 existing records. [2025-10-02T17:25:52.720346] [WARN ] [MAIN ] AXL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:25:52.720872] [INFO ] [MAIN ] AXL: Wiping existing primary data before full refresh. [2025-10-02T17:25:52.720955] [INFO ] [LOCAL ] AXL: Starting deletion of primary data. [2025-10-02T17:25:52.727451] [DEBUG] [LOCAL ] AXL: Deleted primary data file. [2025-10-02T17:25:52.736232] [INFO ] [MAIN ] AXL: Starting full primary refresh. [2025-10-02T17:25:52.801805] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-02T17:25:53.078200] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-08. [2025-10-02T17:25:53.212217] [INFO ] [REMOTE ] AXL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:25:53.652603] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-02T17:25:53.872971] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-02. [2025-10-02T17:25:53.964133] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-02T17:25:54.672995] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-09. [2025-10-02T17:25:55.002429] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-02T17:25:55.472977] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-03. [2025-10-02T17:25:55.586415] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-02T17:25:56.272982] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-10. [2025-10-02T17:25:56.868043] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-02T17:25:57.073003] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-04. [2025-10-02T17:25:57.127160] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-02T17:25:57.129048] [INFO ] [REMOTE ] AWR: Full fetch complete (32125 records). [2025-10-02T17:25:57.129139] [DEBUG] [VALIDATOR ] AWR: Validating primary data. [2025-10-02T17:25:57.555928] [DEBUG] [VALIDATOR ] AWR: All expected trading days are present. [2025-10-02T17:25:57.556046] [DEBUG] [VALIDATOR ] AWR: Primary data validation passed. [2025-10-02T17:25:57.556466] [INFO ] [MAIN ] AWR: Fetched primary data is valid. [2025-10-02T17:25:57.556511] [DEBUG] [LOCAL ] AWR: Saving primary data. [2025-10-02T17:25:57.557398] [DEBUG] [LOCAL ] AWR: Trimmed 32125 records to 22776 (keeping 200 days of data) [2025-10-02T17:25:57.702396] [DEBUG] [LOCAL ] AWR: Primary data saved (22776 records). [2025-10-02T17:25:57.702534] [INFO ] [MAIN ] AWR: Full history saved. [2025-10-02T17:25:57.702623] [INFO ] [MAIN ] Update Progress: 193/2370 symbols completed. AWR took 26.0s. Estimated remaining: 4h 52m 8s. Rate: 7.5 symbols/min [2025-10-02T17:25:57.886855] [INFO ] [MAIN ] AXP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:25:57.882244] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-08. [2025-10-02T17:25:57.946599] [DEBUG] [LOCAL ] AXP: Loaded 53197 existing records from primary storage. [2025-10-02T17:25:57.946952] [INFO ] [MAIN ] AXP: Loaded 53197 existing records. [2025-10-02T17:25:58.147595] [WARN ] [MAIN ] AXP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:25:58.147938] [INFO ] [MAIN ] AXP: Wiping existing primary data before full refresh. [2025-10-02T17:25:58.148054] [INFO ] [LOCAL ] AXP: Starting deletion of primary data. [2025-10-02T17:25:58.150043] [DEBUG] [LOCAL ] AXP: Deleted primary data file. [2025-10-02T17:25:58.150205] [INFO ] [MAIN ] AXP: Starting full primary refresh. [2025-10-02T17:25:58.491191] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-02T17:25:58.581920] [INFO ] [REMOTE ] AXP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:25:58.672994] [INFO ] [REMOTE ] AXP: Fetching primary data for 2024-12. [2025-10-02T17:25:59.059376] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-02T17:25:59.473068] [INFO ] [REMOTE ] AXL: Fetching primary data for 2024-12. [2025-10-02T17:26:00.273056] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-05. [2025-10-02T17:26:01.072991] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-09. [2025-10-02T17:26:01.204750] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2024-12 (2.53 seconds). [2025-10-02T17:26:01.264847] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-02T17:26:01.292252] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-02T17:26:01.873043] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-01. [2025-10-02T17:26:02.129375] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-02T17:26:02.672998] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-01. [2025-10-02T17:26:03.112776] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-02T17:26:03.473041] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-02. [2025-10-02T17:26:04.273012] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-06. [2025-10-02T17:26:04.577021] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-02T17:26:04.998509] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-02T17:26:05.073003] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-02. [2025-10-02T17:26:05.592393] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-02T17:26:05.873007] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-10. [2025-10-02T17:26:06.550157] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-02T17:26:06.551471] [INFO ] [REMOTE ] AWP: Full fetch complete (32235 records). [2025-10-02T17:26:06.551547] [DEBUG] [VALIDATOR ] AWP: Validating primary data. [2025-10-02T17:26:06.675685] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-03. [2025-10-02T17:26:06.965223] [DEBUG] [VALIDATOR ] AWP: All expected trading days are present. [2025-10-02T17:26:06.965499] [DEBUG] [VALIDATOR ] AWP: Primary data validation passed. [2025-10-02T17:26:06.966190] [INFO ] [MAIN ] AWP: Fetched primary data is valid. [2025-10-02T17:26:06.966278] [DEBUG] [LOCAL ] AWP: Saving primary data. [2025-10-02T17:26:06.967593] [DEBUG] [LOCAL ] AWP: Trimmed 32235 records to 21611 (keeping 200 days of data) [2025-10-02T17:26:07.085239] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-02T17:26:07.139938] [DEBUG] [LOCAL ] AWP: Primary data saved (21611 records). [2025-10-02T17:26:07.140074] [INFO ] [MAIN ] AWP: Full history saved. [2025-10-02T17:26:07.140161] [INFO ] [MAIN ] Update Progress: 194/2370 symbols completed. AWP took 45.0s. Estimated remaining: 4h 52m 15s. Rate: 7.4 symbols/min [2025-10-02T17:26:07.329122] [INFO ] [MAIN ] AXR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:26:07.333943] [DEBUG] [LOCAL ] AXR: Loaded 3037 existing records from primary storage. [2025-10-02T17:26:07.334109] [INFO ] [MAIN ] AXR: Loaded 3037 existing records. [2025-10-02T17:26:07.484210] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-07. [2025-10-02T17:26:07.530969] [WARN ] [MAIN ] AXR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:26:07.531238] [INFO ] [MAIN ] AXR: Wiping existing primary data before full refresh. [2025-10-02T17:26:07.531334] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-10-02T17:26:07.531623] [DEBUG] [LOCAL ] AXR: Deleted primary data file. [2025-10-02T17:26:07.531722] [INFO ] [MAIN ] AXR: Starting full primary refresh. [2025-10-02T17:26:07.967311] [INFO ] [REMOTE ] AXR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:26:08.273027] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-03. [2025-10-02T17:26:08.427429] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-02T17:26:08.801862] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-02T17:26:09.073017] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-08. [2025-10-02T17:26:09.872968] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-04. [2025-10-02T17:26:09.980139] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-02T17:26:10.217753] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-02T17:26:10.673038] [INFO ] [REMOTE ] AXR: Fetching primary data for 2024-12. [2025-10-02T17:26:11.473060] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-02T17:26:11.473175] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-09. [2025-10-02T17:26:11.746516] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-02T17:26:12.273005] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-05. [2025-10-02T17:26:12.608052] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-02T17:26:13.073070] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-04. [2025-10-02T17:26:13.873011] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-10. [2025-10-02T17:26:14.049369] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-02T17:26:14.673007] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-06. [2025-10-02T17:26:14.748127] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-02T17:26:14.749765] [INFO ] [REMOTE ] AX: Full fetch complete (42672 records). [2025-10-02T17:26:14.749872] [DEBUG] [VALIDATOR ] AX: Validating primary data. [2025-10-02T17:26:15.180367] [DEBUG] [VALIDATOR ] AX: All expected trading days are present. [2025-10-02T17:26:15.180448] [DEBUG] [VALIDATOR ] AX: Primary data validation passed. [2025-10-02T17:26:15.180969] [INFO ] [MAIN ] AX: Fetched primary data is valid. [2025-10-02T17:26:15.181033] [DEBUG] [LOCAL ] AX: Saving primary data. [2025-10-02T17:26:15.182036] [DEBUG] [LOCAL ] AX: Trimmed 42672 records to 28542 (keeping 200 days of data) [2025-10-02T17:26:15.363629] [DEBUG] [LOCAL ] AX: Primary data saved (28542 records). [2025-10-02T17:26:15.363918] [INFO ] [MAIN ] AX: Full history saved. [2025-10-02T17:26:15.364083] [INFO ] [MAIN ] Update Progress: 195/2370 symbols completed. AX took 27.1s. Estimated remaining: 4h 52m 9s. Rate: 7.4 symbols/min [2025-10-02T17:26:15.478094] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-01. [2025-10-02T17:26:15.586377] [INFO ] [MAIN ] AXS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:26:15.631207] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-04 (2.56 seconds). [2025-10-02T17:26:15.684144] [DEBUG] [LOCAL ] AXS: Loaded 38383 existing records from primary storage. [2025-10-02T17:26:15.684502] [INFO ] [MAIN ] AXS: Loaded 38383 existing records. [2025-10-02T17:26:15.886910] [WARN ] [MAIN ] AXS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:26:15.887127] [INFO ] [MAIN ] AXS: Wiping existing primary data before full refresh. [2025-10-02T17:26:15.887187] [INFO ] [LOCAL ] AXS: Starting deletion of primary data. [2025-10-02T17:26:15.888682] [DEBUG] [LOCAL ] AXS: Deleted primary data file. [2025-10-02T17:26:15.888746] [INFO ] [MAIN ] AXS: Starting full primary refresh. [2025-10-02T17:26:16.298452] [INFO ] [REMOTE ] AXS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:26:16.292008] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-05. [2025-10-02T17:26:16.311839] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-02T17:26:16.345859] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-02T17:26:17.073015] [INFO ] [REMOTE ] AXS: Fetching primary data for 2024-12. [2025-10-02T17:26:17.873014] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-02. [2025-10-02T17:26:18.366795] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-02T17:26:18.623513] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-02T17:26:18.652626] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-02T17:26:18.672965] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-01. [2025-10-02T17:26:19.473028] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-06. [2025-10-02T17:26:20.105709] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-02T17:26:20.273005] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-02. [2025-10-02T17:26:21.072999] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-07. [2025-10-02T17:26:21.549998] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-02T17:26:21.692533] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-02T17:26:21.873024] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-03. [2025-10-02T17:26:22.358602] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-02T17:26:22.673000] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-04. [2025-10-02T17:26:22.803625] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-02T17:26:23.290040] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-02T17:26:23.473004] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-03. [2025-10-02T17:26:24.273000] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-07. [2025-10-02T17:26:25.073007] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-08. [2025-10-02T17:26:25.107403] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-02T17:26:25.873004] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-05. [2025-10-02T17:26:26.343599] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-02T17:26:26.504016] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-02T17:26:26.673001] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-06. [2025-10-02T17:26:26.722715] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-02T17:26:27.043408] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-02T17:26:27.473003] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-04. [2025-10-02T17:26:28.273004] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-09. [2025-10-02T17:26:28.936401] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-02T17:26:29.072991] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-05. [2025-10-02T17:26:29.372012] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-02T17:26:29.873056] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-07. [2025-10-02T17:26:30.233734] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-02T17:26:30.411755] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-02T17:26:30.673044] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-06. [2025-10-02T17:26:31.472999] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-08. [2025-10-02T17:26:32.086110] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-02T17:26:32.113339] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-02T17:26:32.273015] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-09. [2025-10-02T17:26:33.053924] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-02T17:26:33.072990] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-10. [2025-10-02T17:26:33.510562] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-02T17:26:33.511425] [INFO ] [REMOTE ] AXR: Full fetch complete (4834 records). [2025-10-02T17:26:33.511511] [DEBUG] [VALIDATOR ] AXR: Validating primary data. [2025-10-02T17:26:33.512023] [FATAL] [VALIDATOR ] AXR: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:26:33.512124] [FATAL] [MAIN ] AXR: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:26:33.512176] [WARN ] [MAIN ] AXR: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:26:33.512225] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-10-02T17:26:33.512332] [DEBUG] [LOCAL ] AXR: No primary data file found to delete. [2025-10-02T17:26:33.512396] [INFO ] [LOCAL ] AXR: Starting deletion of derivative data. [2025-10-02T17:26:33.512933] [DEBUG] [LOCAL ] AXR: Deleted derivative data file. [2025-10-02T17:26:33.513054] [INFO ] [MAIN ] Update Progress: 196/2370 symbols completed. AXR took 26.4s. Estimated remaining: 4h 53m 53s. Rate: 7.4 symbols/min [2025-10-02T17:26:33.720095] [INFO ] [MAIN ] AXTA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:26:33.781413] [DEBUG] [LOCAL ] AXTA: Loaded 52067 existing records from primary storage. [2025-10-02T17:26:33.781772] [INFO ] [MAIN ] AXTA: Loaded 52067 existing records. [2025-10-02T17:26:33.878102] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-08. [2025-10-02T17:26:33.984794] [WARN ] [MAIN ] AXTA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:26:33.984997] [INFO ] [MAIN ] AXTA: Wiping existing primary data before full refresh. [2025-10-02T17:26:33.985047] [INFO ] [LOCAL ] AXTA: Starting deletion of primary data. [2025-10-02T17:26:33.986667] [DEBUG] [LOCAL ] AXTA: Deleted primary data file. [2025-10-02T17:26:33.986731] [INFO ] [MAIN ] AXTA: Starting full primary refresh. [2025-10-02T17:26:34.396376] [INFO ] [REMOTE ] AXTA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:26:34.673030] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-07. [2025-10-02T17:26:35.472987] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2024-12. [2025-10-02T17:26:35.733963] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-02T17:26:35.794494] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-02T17:26:36.273011] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-10. [2025-10-02T17:26:37.073051] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-08. [2025-10-02T17:26:37.166976] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-02T17:26:37.690807] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-02T17:26:37.693010] [INFO ] [REMOTE ] AXL: Full fetch complete (72677 records). [2025-10-02T17:26:37.693144] [DEBUG] [VALIDATOR ] AXL: Validating primary data. [2025-10-02T17:26:37.879196] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-09. [2025-10-02T17:26:38.123685] [DEBUG] [VALIDATOR ] AXL: All expected trading days are present. [2025-10-02T17:26:38.123793] [DEBUG] [VALIDATOR ] AXL: Primary data validation passed. [2025-10-02T17:26:38.124585] [INFO ] [MAIN ] AXL: Fetched primary data is valid. [2025-10-02T17:26:38.124632] [DEBUG] [LOCAL ] AXL: Saving primary data. [2025-10-02T17:26:38.126251] [DEBUG] [LOCAL ] AXL: Trimmed 72677 records to 50866 (keeping 200 days of data) [2025-10-02T17:26:38.447755] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-02T17:26:38.463758] [DEBUG] [LOCAL ] AXL: Primary data saved (50866 records). [2025-10-02T17:26:38.463882] [INFO ] [MAIN ] AXL: Full history saved. [2025-10-02T17:26:38.465317] [INFO ] [MAIN ] Update Progress: 197/2370 symbols completed. AXL took 46.3s. Estimated remaining: 4h 53m 10s. Rate: 7.4 symbols/min [2025-10-02T17:26:38.673060] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-01. [2025-10-02T17:26:39.473103] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-09. [2025-10-02T17:26:40.025736] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-02T17:26:40.075735] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-02T17:26:40.273056] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-10. [2025-10-02T17:26:40.708390] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-02T17:26:41.073008] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-02. [2025-10-02T17:26:41.873030] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-10. [2025-10-02T17:26:42.065115] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-02T17:26:42.068208] [INFO ] [REMOTE ] AXP: Full fetch complete (76913 records). [2025-10-02T17:26:42.068467] [DEBUG] [VALIDATOR ] AXP: Validating primary data. [2025-10-02T17:26:42.497143] [DEBUG] [VALIDATOR ] AXP: All expected trading days are present. [2025-10-02T17:26:42.497388] [DEBUG] [VALIDATOR ] AXP: Primary data validation passed. [2025-10-02T17:26:42.498543] [INFO ] [MAIN ] AXP: Fetched primary data is valid. [2025-10-02T17:26:42.498631] [DEBUG] [LOCAL ] AXP: Saving primary data. [2025-10-02T17:26:42.500722] [DEBUG] [LOCAL ] AXP: Trimmed 76913 records to 53579 (keeping 200 days of data) [2025-10-02T17:26:42.800540] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-02T17:26:42.812732] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-03. [2025-10-02T17:26:42.909596] [DEBUG] [LOCAL ] AXP: Primary data saved (53579 records). [2025-10-02T17:26:42.909769] [INFO ] [MAIN ] AXP: Full history saved. [2025-10-02T17:26:42.912326] [INFO ] [MAIN ] Update Progress: 198/2370 symbols completed. AXP took 45.2s. Estimated remaining: 4h 52m 22s. Rate: 7.4 symbols/min [2025-10-02T17:26:42.970089] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-02T17:26:42.971969] [INFO ] [REMOTE ] AXS: Full fetch complete (55720 records). [2025-10-02T17:26:42.972107] [DEBUG] [VALIDATOR ] AXS: Validating primary data. [2025-10-02T17:26:43.392114] [DEBUG] [VALIDATOR ] AXS: All expected trading days are present. [2025-10-02T17:26:43.392213] [DEBUG] [VALIDATOR ] AXS: Primary data validation passed. [2025-10-02T17:26:43.393001] [INFO ] [MAIN ] AXS: Fetched primary data is valid. [2025-10-02T17:26:43.393082] [DEBUG] [LOCAL ] AXS: Saving primary data. [2025-10-02T17:26:43.394527] [DEBUG] [LOCAL ] AXS: Trimmed 55720 records to 38703 (keeping 200 days of data) [2025-10-02T17:26:43.667016] [DEBUG] [LOCAL ] AXS: Primary data saved (38703 records). [2025-10-02T17:26:43.667188] [INFO ] [MAIN ] AXS: Full history saved. [2025-10-02T17:26:43.667287] [INFO ] [MAIN ] Update Progress: 199/2370 symbols completed. AXS took 28.3s. Estimated remaining: 4h 50m 54s. Rate: 7.5 symbols/min [2025-10-02T17:26:44.065613] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-02T17:26:44.077044] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-04. [2025-10-02T17:26:45.855029] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-02T17:26:45.866879] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-05. [2025-10-02T17:26:47.696800] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-02T17:26:47.708770] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-06. [2025-10-02T17:26:49.169198] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-02T17:26:49.181260] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-07. [2025-10-02T17:26:50.835094] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-02T17:26:50.846726] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-08. [2025-10-02T17:26:52.300569] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-02T17:26:52.312305] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-09. [2025-10-02T17:26:53.531847] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-02T17:26:53.544242] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-10. [2025-10-02T17:26:54.819149] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-02T17:26:54.821282] [INFO ] [REMOTE ] AXTA: Full fetch complete (75088 records). [2025-10-02T17:26:54.821416] [DEBUG] [VALIDATOR ] AXTA: Validating primary data. [2025-10-02T17:26:55.261423] [DEBUG] [VALIDATOR ] AXTA: All expected trading days are present. [2025-10-02T17:26:55.261561] [DEBUG] [VALIDATOR ] AXTA: Primary data validation passed. [2025-10-02T17:26:55.262391] [INFO ] [MAIN ] AXTA: Fetched primary data is valid. [2025-10-02T17:26:55.262460] [DEBUG] [LOCAL ] AXTA: Saving primary data. [2025-10-02T17:26:55.264144] [DEBUG] [LOCAL ] AXTA: Trimmed 75088 records to 52453 (keeping 200 days of data) [2025-10-02T17:26:55.585934] [DEBUG] [LOCAL ] AXTA: Primary data saved (52453 records). [2025-10-02T17:26:55.586085] [INFO ] [MAIN ] AXTA: Full history saved. [2025-10-02T17:26:55.586174] [INFO ] [MAIN ] Update Progress: 200/2370 symbols completed. AXTA took 22.1s. Estimated remaining: 4h 51m 28s. Rate: 7.4 symbols/min [2025-10-02T17:26:56.151504] [INFO ] [MAIN ] AYI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:26:56.346132] [INFO ] [MAIN ] AZO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:26:56.377111] [INFO ] [MAIN ] B: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:26:56.405688] [INFO ] [MAIN ] AZZ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:26:56.406180] [DEBUG] [LOCAL ] B: No existing data file found in primary storage. [2025-10-02T17:26:56.406485] [WARN ] [MAIN ] B: No existing data found, performing full refresh instead. [2025-10-02T17:26:56.406883] [INFO ] [MAIN ] B: Wiping existing primary data before full refresh. [2025-10-02T17:26:56.407016] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-02T17:26:56.407109] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-02T17:26:56.407573] [INFO ] [MAIN ] B: Starting full primary refresh. [2025-10-02T17:26:56.500932] [DEBUG] [LOCAL ] AYI: Loaded 25181 existing records from primary storage. [2025-10-02T17:26:56.517008] [INFO ] [MAIN ] AYI: Loaded 25181 existing records. [2025-10-02T17:26:56.539816] [DEBUG] [LOCAL ] AZO: Loaded 11278 existing records from primary storage. [2025-10-02T17:26:56.574296] [INFO ] [MAIN ] AZO: Loaded 11278 existing records. [2025-10-02T17:26:56.651958] [DEBUG] [LOCAL ] AZZ: Loaded 21975 existing records from primary storage. [2025-10-02T17:26:56.782373] [INFO ] [MAIN ] AZZ: Loaded 21975 existing records. [2025-10-02T17:26:57.171624] [WARN ] [MAIN ] AYI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:26:57.201071] [INFO ] [MAIN ] AYI: Wiping existing primary data before full refresh. [2025-10-02T17:26:57.237333] [INFO ] [LOCAL ] AYI: Starting deletion of primary data. [2025-10-02T17:26:57.332404] [DEBUG] [LOCAL ] AYI: Deleted primary data file. [2025-10-02T17:26:57.333457] [INFO ] [MAIN ] AYI: Starting full primary refresh. [2025-10-02T17:26:57.385821] [WARN ] [MAIN ] AZO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:26:57.431950] [INFO ] [REMOTE ] B: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:26:57.442490] [INFO ] [MAIN ] AZO: Wiping existing primary data before full refresh. [2025-10-02T17:26:57.464923] [INFO ] [LOCAL ] AZO: Starting deletion of primary data. [2025-10-02T17:26:57.490515] [INFO ] [REMOTE ] B: Fetching primary data for 2024-12. [2025-10-02T17:26:57.546735] [DEBUG] [LOCAL ] AZO: Deleted primary data file. [2025-10-02T17:26:57.574572] [INFO ] [MAIN ] AZO: Starting full primary refresh. [2025-10-02T17:26:57.587123] [WARN ] [MAIN ] AZZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:26:57.656215] [INFO ] [MAIN ] AZZ: Wiping existing primary data before full refresh. [2025-10-02T17:26:57.678476] [INFO ] [LOCAL ] AZZ: Starting deletion of primary data. [2025-10-02T17:26:57.745843] [DEBUG] [LOCAL ] AZZ: Deleted primary data file. [2025-10-02T17:26:57.792004] [INFO ] [MAIN ] AZZ: Starting full primary refresh. [2025-10-02T17:26:58.475822] [INFO ] [REMOTE ] AYI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:26:58.530770] [INFO ] [REMOTE ] AYI: Fetching primary data for 2024-12. [2025-10-02T17:26:58.736371] [INFO ] [REMOTE ] AZO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:26:58.765297] [INFO ] [REMOTE ] AZO: Fetching primary data for 2024-12. [2025-10-02T17:26:58.849802] [INFO ] [REMOTE ] AZZ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:26:58.850300] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2024-12. [2025-10-02T17:26:58.989151] [INFO ] [REMOTE ] B: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-02T17:26:58.996415] [INFO ] [REMOTE ] B: Fetching primary data for 2025-01. [2025-10-02T17:26:59.749431] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-02T17:26:59.753303] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-01. [2025-10-02T17:26:59.809348] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-02T17:26:59.814052] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-01. [2025-10-02T17:26:59.864125] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-02T17:26:59.869893] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-01. [2025-10-02T17:26:59.908884] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-02T17:26:59.915610] [INFO ] [REMOTE ] B: Fetching primary data for 2025-02. [2025-10-02T17:27:00.132357] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T17:27:00.133293] [WARN ] [REMOTE ] B: No data returned for month 2025-02 [2025-10-02T17:27:00.133401] [FATAL] [REMOTE ] B: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T17:27:00.133719] [FATAL] [MAIN ] B: Failed to fetch primary data. [2025-10-02T17:27:00.133794] [WARN ] [MAIN ] B: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T17:27:00.133903] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-02T17:27:00.134001] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-02T17:27:00.134092] [INFO ] [LOCAL ] B: Starting deletion of derivative data. [2025-10-02T17:27:00.134193] [DEBUG] [LOCAL ] B: No derivative data file found to delete. [2025-10-02T17:27:00.134302] [INFO ] [MAIN ] Update Progress: 201/2370 symbols completed. B took 4.5s. Estimated remaining: 4h 50m 42s. Rate: 7.5 symbols/min [2025-10-02T17:27:00.322235] [INFO ] [MAIN ] BA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:27:00.348493] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-02T17:27:00.351554] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-02. [2025-10-02T17:27:00.398601] [DEBUG] [LOCAL ] BA: Loaded 53790 existing records from primary storage. [2025-10-02T17:27:00.398999] [INFO ] [MAIN ] BA: Loaded 53790 existing records. [2025-10-02T17:27:00.599399] [WARN ] [MAIN ] BA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:27:00.599669] [INFO ] [MAIN ] BA: Wiping existing primary data before full refresh. [2025-10-02T17:27:00.599734] [INFO ] [LOCAL ] BA: Starting deletion of primary data. [2025-10-02T17:27:00.601758] [DEBUG] [LOCAL ] BA: Deleted primary data file. [2025-10-02T17:27:00.601830] [INFO ] [MAIN ] BA: Starting full primary refresh. [2025-10-02T17:27:01.054676] [INFO ] [REMOTE ] BA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:27:01.060477] [INFO ] [REMOTE ] BA: Fetching primary data for 2024-12. [2025-10-02T17:27:01.068952] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-02T17:27:01.076761] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-02. [2025-10-02T17:27:01.084920] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-02T17:27:01.087798] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-03. [2025-10-02T17:27:01.398509] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-02T17:27:01.405163] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-02. [2025-10-02T17:27:01.982973] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-02T17:27:01.988360] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-04. [2025-10-02T17:27:02.072511] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-02T17:27:02.078065] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-03. [2025-10-02T17:27:02.532510] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-02T17:27:02.539901] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-03. [2025-10-02T17:27:02.684145] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-02T17:27:02.687714] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-05. [2025-10-02T17:27:02.871804] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-02T17:27:03.350362] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-02T17:27:03.472985] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-04. [2025-10-02T17:27:03.506111] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-02T17:27:03.702102] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2024-12 (2.64 seconds). [2025-10-02T17:27:04.273020] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-04. [2025-10-02T17:27:04.689042] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-02T17:27:05.073037] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-01. [2025-10-02T17:27:05.754311] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-02T17:27:05.873037] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-05. [2025-10-02T17:27:06.672995] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-05. [2025-10-02T17:27:06.985360] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-02T17:27:07.299442] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-02T17:27:07.473026] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-06. [2025-10-02T17:27:07.504672] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-02T17:27:08.273006] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-06. [2025-10-02T17:27:08.391577] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-02T17:27:09.073006] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-02. [2025-10-02T17:27:09.301019] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-02T17:27:09.873019] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-06. [2025-10-02T17:27:10.673033] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-07. [2025-10-02T17:27:10.985474] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-02T17:27:11.140756] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-02T17:27:11.473002] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-03. [2025-10-02T17:27:11.627151] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-02T17:27:12.273006] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-07. [2025-10-02T17:27:13.072988] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-08. [2025-10-02T17:27:13.213933] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-02T17:27:13.645273] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-02T17:27:13.750761] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-02T17:27:13.873000] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-08. [2025-10-02T17:27:14.672968] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-07. [2025-10-02T17:27:14.945260] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-02T17:27:15.473007] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-04. [2025-10-02T17:27:16.021989] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-02T17:27:16.273017] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-09. [2025-10-02T17:27:17.073004] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-09. [2025-10-02T17:27:17.453867] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-02T17:27:17.873012] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-10. [2025-10-02T17:27:17.936291] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-02T17:27:18.070561] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-04 (2.60 seconds). [2025-10-02T17:27:18.576852] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-02T17:27:18.578554] [INFO ] [REMOTE ] AYI: Full fetch complete (37106 records). [2025-10-02T17:27:18.578684] [DEBUG] [VALIDATOR ] AYI: Validating primary data. [2025-10-02T17:27:18.678120] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-10. [2025-10-02T17:27:18.991450] [DEBUG] [VALIDATOR ] AYI: All expected trading days are present. [2025-10-02T17:27:18.991531] [DEBUG] [VALIDATOR ] AYI: Primary data validation passed. [2025-10-02T17:27:18.992097] [INFO ] [MAIN ] AYI: Fetched primary data is valid. [2025-10-02T17:27:18.992181] [DEBUG] [LOCAL ] AYI: Saving primary data. [2025-10-02T17:27:18.993317] [DEBUG] [LOCAL ] AYI: Trimmed 37106 records to 25458 (keeping 200 days of data) [2025-10-02T17:27:19.162678] [DEBUG] [LOCAL ] AYI: Primary data saved (25458 records). [2025-10-02T17:27:19.162814] [INFO ] [MAIN ] AYI: Full history saved. [2025-10-02T17:27:19.162957] [INFO ] [MAIN ] Update Progress: 202/2370 symbols completed. AYI took 23.6s. Estimated remaining: 4h 52m 32s. Rate: 7.4 symbols/min [2025-10-02T17:27:19.349426] [INFO ] [MAIN ] BABA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:27:19.415458] [DEBUG] [LOCAL ] BABA: Loaded 53820 existing records from primary storage. [2025-10-02T17:27:19.415876] [INFO ] [MAIN ] BABA: Loaded 53820 existing records. [2025-10-02T17:27:19.478245] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-05. [2025-10-02T17:27:19.510866] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-02T17:27:19.554693] [INFO ] [REMOTE ] AZO: Full fetch complete (16177 records). [2025-10-02T17:27:19.563466] [DEBUG] [VALIDATOR ] AZO: Validating primary data. [2025-10-02T17:27:19.795073] [WARN ] [MAIN ] BABA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:27:19.830873] [INFO ] [MAIN ] BABA: Wiping existing primary data before full refresh. [2025-10-02T17:27:19.849331] [INFO ] [LOCAL ] BABA: Starting deletion of primary data. [2025-10-02T17:27:19.876408] [DEBUG] [LOCAL ] BABA: Deleted primary data file. [2025-10-02T17:27:19.942682] [INFO ] [MAIN ] BABA: Starting full primary refresh. [2025-10-02T17:27:20.241068] [DEBUG] [VALIDATOR ] AZO: All expected trading days are present. [2025-10-02T17:27:20.251529] [DEBUG] [VALIDATOR ] AZO: Primary data validation passed. [2025-10-02T17:27:20.253036] [INFO ] [MAIN ] AZO: Fetched primary data is valid. [2025-10-02T17:27:20.260428] [DEBUG] [LOCAL ] AZO: Saving primary data. [2025-10-02T17:27:20.281798] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-08. [2025-10-02T17:27:20.340843] [DEBUG] [LOCAL ] AZO: Trimmed 16177 records to 11370 (keeping 200 days of data) [2025-10-02T17:27:20.559133] [INFO ] [REMOTE ] BABA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:27:20.574361] [DEBUG] [LOCAL ] AZO: Primary data saved (11370 records). [2025-10-02T17:27:20.574524] [INFO ] [MAIN ] AZO: Full history saved. [2025-10-02T17:27:20.574670] [INFO ] [MAIN ] Update Progress: 203/2370 symbols completed. AZO took 25.0s. Estimated remaining: 4h 51m 12s. Rate: 7.4 symbols/min [2025-10-02T17:27:20.783043] [INFO ] [MAIN ] BAC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:27:20.853595] [DEBUG] [LOCAL ] BAC: Loaded 53808 existing records from primary storage. [2025-10-02T17:27:20.853965] [INFO ] [MAIN ] BAC: Loaded 53808 existing records. [2025-10-02T17:27:21.064779] [WARN ] [MAIN ] BAC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:27:21.065021] [INFO ] [MAIN ] BAC: Wiping existing primary data before full refresh. [2025-10-02T17:27:21.065088] [INFO ] [LOCAL ] BAC: Starting deletion of primary data. [2025-10-02T17:27:21.066924] [DEBUG] [LOCAL ] BAC: Deleted primary data file. [2025-10-02T17:27:21.066989] [INFO ] [MAIN ] BAC: Starting full primary refresh. [2025-10-02T17:27:21.100927] [INFO ] [REMOTE ] BABA: Fetching primary data for 2024-12. [2025-10-02T17:27:21.495989] [INFO ] [REMOTE ] BAC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:27:21.511105] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-02T17:27:21.763091] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-10-02T17:27:21.873014] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-09. [2025-10-02T17:27:22.673037] [INFO ] [REMOTE ] BAC: Fetching primary data for 2024-12. [2025-10-02T17:27:22.921881] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-02T17:27:23.472994] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-10. [2025-10-02T17:27:24.163564] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2024-12 (3.06 seconds). [2025-10-02T17:27:24.273000] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-01. [2025-10-02T17:27:24.280586] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-02T17:27:24.281947] [INFO ] [REMOTE ] AZZ: Full fetch complete (30916 records). [2025-10-02T17:27:24.282079] [DEBUG] [VALIDATOR ] AZZ: Validating primary data. [2025-10-02T17:27:24.701141] [DEBUG] [VALIDATOR ] AZZ: All expected trading days are present. [2025-10-02T17:27:24.701277] [DEBUG] [VALIDATOR ] AZZ: Primary data validation passed. [2025-10-02T17:27:24.701841] [INFO ] [MAIN ] AZZ: Fetched primary data is valid. [2025-10-02T17:27:24.701905] [DEBUG] [LOCAL ] AZZ: Saving primary data. [2025-10-02T17:27:24.702777] [DEBUG] [LOCAL ] AZZ: Trimmed 30916 records to 22158 (keeping 200 days of data) [2025-10-02T17:27:24.847417] [DEBUG] [LOCAL ] AZZ: Primary data saved (22158 records). [2025-10-02T17:27:24.847620] [INFO ] [MAIN ] AZZ: Full history saved. [2025-10-02T17:27:24.847930] [INFO ] [MAIN ] Update Progress: 204/2370 symbols completed. AZZ took 29.3s. Estimated remaining: 4h 50m 24s. Rate: 7.5 symbols/min [2025-10-02T17:27:25.031147] [INFO ] [MAIN ] BAH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:27:25.066368] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-10-02T17:27:25.077781] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-06. [2025-10-02T17:27:25.139086] [DEBUG] [LOCAL ] BAH: Loaded 51669 existing records from primary storage. [2025-10-02T17:27:25.139485] [INFO ] [MAIN ] BAH: Loaded 51669 existing records. [2025-10-02T17:27:25.349296] [WARN ] [MAIN ] BAH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:27:25.349553] [INFO ] [MAIN ] BAH: Wiping existing primary data before full refresh. [2025-10-02T17:27:25.349607] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-10-02T17:27:25.351667] [DEBUG] [LOCAL ] BAH: Deleted primary data file. [2025-10-02T17:27:25.351736] [INFO ] [MAIN ] BAH: Starting full primary refresh. [2025-10-02T17:27:25.782735] [INFO ] [REMOTE ] BAH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:27:25.873040] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-01. [2025-10-02T17:27:26.466753] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-02T17:27:26.673069] [INFO ] [REMOTE ] BAH: Fetching primary data for 2024-12. [2025-10-02T17:27:27.106948] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-02T17:27:27.473043] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-02. [2025-10-02T17:27:28.272995] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-07. [2025-10-02T17:27:28.312599] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-01 (2.44 seconds). [2025-10-02T17:27:28.631617] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-02T17:27:29.073039] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-01. [2025-10-02T17:27:29.301080] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-02T17:27:29.873002] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-03. [2025-10-02T17:27:30.406042] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-02T17:27:30.673004] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-02. [2025-10-02T17:27:30.766407] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-10-02T17:27:31.473034] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-08. [2025-10-02T17:27:32.272978] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-02. [2025-10-02T17:27:32.608220] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-03 (2.74 seconds). [2025-10-02T17:27:32.656178] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-02T17:27:33.073045] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-04. [2025-10-02T17:27:33.803710] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-10-02T17:27:33.873004] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-03. [2025-10-02T17:27:34.039037] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-02T17:27:34.673066] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-03. [2025-10-02T17:27:35.458305] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-10-02T17:27:35.472959] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-05. [2025-10-02T17:27:36.272994] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-09. [2025-10-02T17:27:36.541145] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-02T17:27:36.559146] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-03 (2.69 seconds). [2025-10-02T17:27:37.073066] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-04. [2025-10-02T17:27:37.524261] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-02T17:27:37.872985] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-06. [2025-10-02T17:27:38.202593] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-02T17:27:38.673011] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-04. [2025-10-02T17:27:39.472980] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-10. [2025-10-02T17:27:39.642120] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-04 (2.57 seconds). [2025-10-02T17:27:39.769078] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-02T17:27:40.273831] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-05. [2025-10-02T17:27:40.279879] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-02T17:27:41.072993] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-07. [2025-10-02T17:27:41.714980] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-10 (2.24 seconds). [2025-10-02T17:27:41.717186] [INFO ] [REMOTE ] BA: Full fetch complete (77924 records). [2025-10-02T17:27:41.717349] [DEBUG] [VALIDATOR ] BA: Validating primary data. [2025-10-02T17:27:41.878163] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-05. [2025-10-02T17:27:42.170067] [DEBUG] [VALIDATOR ] BA: All expected trading days are present. [2025-10-02T17:27:42.170294] [DEBUG] [VALIDATOR ] BA: Primary data validation passed. [2025-10-02T17:27:42.171219] [INFO ] [MAIN ] BA: Fetched primary data is valid. [2025-10-02T17:27:42.171337] [DEBUG] [LOCAL ] BA: Saving primary data. [2025-10-02T17:27:42.173352] [DEBUG] [LOCAL ] BA: Trimmed 77924 records to 54180 (keeping 200 days of data) [2025-10-02T17:27:42.451639] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-02T17:27:42.585281] [DEBUG] [LOCAL ] BA: Primary data saved (54180 records). [2025-10-02T17:27:42.585451] [INFO ] [MAIN ] BA: Full history saved. [2025-10-02T17:27:42.585571] [INFO ] [MAIN ] Update Progress: 205/2370 symbols completed. BA took 42.5s. Estimated remaining: 4h 51m 58s. Rate: 7.4 symbols/min [2025-10-02T17:27:42.686098] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-06. [2025-10-02T17:27:42.773103] [INFO ] [MAIN ] BAK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:27:42.812824] [DEBUG] [LOCAL ] BAK: Loaded 39146 existing records from primary storage. [2025-10-02T17:27:42.813150] [INFO ] [MAIN ] BAK: Loaded 39146 existing records. [2025-10-02T17:27:43.003935] [WARN ] [MAIN ] BAK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:27:43.004300] [INFO ] [MAIN ] BAK: Wiping existing primary data before full refresh. [2025-10-02T17:27:43.004379] [INFO ] [LOCAL ] BAK: Starting deletion of primary data. [2025-10-02T17:27:43.006264] [DEBUG] [LOCAL ] BAK: Deleted primary data file. [2025-10-02T17:27:43.006343] [INFO ] [MAIN ] BAK: Starting full primary refresh. [2025-10-02T17:27:43.440303] [INFO ] [REMOTE ] BAK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:27:43.482395] [INFO ] [REMOTE ] BAK: Fetching primary data for 2024-12. [2025-10-02T17:27:43.516859] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-02T17:27:43.585794] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-10-02T17:27:44.272998] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-06. [2025-10-02T17:27:44.939548] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-02T17:27:45.035285] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-06 (2.35 seconds). [2025-10-02T17:27:45.073027] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-07. [2025-10-02T17:27:45.641589] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-02T17:27:45.873012] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-01. [2025-10-02T17:27:46.673051] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-07. [2025-10-02T17:27:47.174839] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-02T17:27:47.331414] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-02T17:27:47.473020] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-02. [2025-10-02T17:27:48.075030] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-02T17:27:48.273042] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-08. [2025-10-02T17:27:48.876212] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-02T17:27:49.073025] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-08. [2025-10-02T17:27:49.872993] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-03. [2025-10-02T17:27:50.157396] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-02T17:27:50.673021] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-09. [2025-10-02T17:27:51.344841] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-02T17:27:51.472963] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-04. [2025-10-02T17:27:51.956379] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-08 (2.88 seconds). [2025-10-02T17:27:52.273002] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-08. [2025-10-02T17:27:52.435086] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-02T17:27:52.825536] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-02T17:27:53.073008] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-05. [2025-10-02T17:27:53.700183] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-02T17:27:53.872991] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-10. [2025-10-02T17:27:54.066382] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-02T17:27:54.673005] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-06. [2025-10-02T17:27:55.473020] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-09. [2025-10-02T17:27:55.707417] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-02T17:27:55.709666] [INFO ] [REMOTE ] BAC: Full fetch complete (77943 records). [2025-10-02T17:27:55.709795] [DEBUG] [VALIDATOR ] BAC: Validating primary data. [2025-10-02T17:27:56.139263] [DEBUG] [VALIDATOR ] BAC: All expected trading days are present. [2025-10-02T17:27:56.139372] [DEBUG] [VALIDATOR ] BAC: Primary data validation passed. [2025-10-02T17:27:56.140187] [INFO ] [MAIN ] BAC: Fetched primary data is valid. [2025-10-02T17:27:56.140263] [DEBUG] [LOCAL ] BAC: Saving primary data. [2025-10-02T17:27:56.141822] [DEBUG] [LOCAL ] BAC: Trimmed 77943 records to 54198 (keeping 200 days of data) [2025-10-02T17:27:56.273834] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-09. [2025-10-02T17:27:56.282111] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-02T17:27:56.515313] [DEBUG] [LOCAL ] BAC: Primary data saved (54198 records). [2025-10-02T17:27:56.515447] [INFO ] [MAIN ] BAC: Full history saved. [2025-10-02T17:27:56.517574] [INFO ] [MAIN ] Update Progress: 206/2370 symbols completed. BAC took 35.9s. Estimated remaining: 4h 52m 51s. Rate: 7.4 symbols/min [2025-10-02T17:27:56.709707] [INFO ] [MAIN ] BALL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:27:56.770988] [DEBUG] [LOCAL ] BALL: Loaded 51797 existing records from primary storage. [2025-10-02T17:27:56.771340] [INFO ] [MAIN ] BALL: Loaded 51797 existing records. [2025-10-02T17:27:56.975612] [WARN ] [MAIN ] BALL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:27:56.976028] [INFO ] [MAIN ] BALL: Wiping existing primary data before full refresh. [2025-10-02T17:27:56.976092] [INFO ] [LOCAL ] BALL: Starting deletion of primary data. [2025-10-02T17:27:56.977958] [DEBUG] [LOCAL ] BALL: Deleted primary data file. [2025-10-02T17:27:56.978058] [INFO ] [MAIN ] BALL: Starting full primary refresh. [2025-10-02T17:27:57.075278] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-07. [2025-10-02T17:27:57.404246] [INFO ] [REMOTE ] BALL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:27:57.450296] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-02T17:27:57.873043] [INFO ] [REMOTE ] BALL: Fetching primary data for 2024-12. [2025-10-02T17:27:58.383413] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-02T17:27:58.634886] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-02T17:27:58.672988] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-08. [2025-10-02T17:27:59.473007] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-10. [2025-10-02T17:27:59.771302] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-02T17:27:59.939865] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-02T17:28:00.273052] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-09. [2025-10-02T17:28:00.941139] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-02T17:28:00.945139] [INFO ] [REMOTE ] BAH: Full fetch complete (74803 records). [2025-10-02T17:28:00.945285] [DEBUG] [VALIDATOR ] BAH: Validating primary data. [2025-10-02T17:28:01.078201] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-01. [2025-10-02T17:28:01.389804] [DEBUG] [VALIDATOR ] BAH: All expected trading days are present. [2025-10-02T17:28:01.389898] [DEBUG] [VALIDATOR ] BAH: Primary data validation passed. [2025-10-02T17:28:01.390704] [INFO ] [MAIN ] BAH: Fetched primary data is valid. [2025-10-02T17:28:01.390776] [DEBUG] [LOCAL ] BAH: Saving primary data. [2025-10-02T17:28:01.392336] [DEBUG] [LOCAL ] BAH: Trimmed 74803 records to 52055 (keeping 200 days of data) [2025-10-02T17:28:01.776795] [DEBUG] [LOCAL ] BAH: Primary data saved (52055 records). [2025-10-02T17:28:01.776959] [INFO ] [MAIN ] BAH: Full history saved. [2025-10-02T17:28:01.778582] [INFO ] [MAIN ] Update Progress: 207/2370 symbols completed. BAH took 36.9s. Estimated remaining: 4h 52m 14s. Rate: 7.4 symbols/min [2025-10-02T17:28:01.888466] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-10. [2025-10-02T17:28:01.973840] [INFO ] [MAIN ] BALY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:28:01.974403] [DEBUG] [LOCAL ] BALY: No existing data file found in primary storage. [2025-10-02T17:28:01.974489] [WARN ] [MAIN ] BALY: No existing data found, performing full refresh instead. [2025-10-02T17:28:01.974819] [INFO ] [MAIN ] BALY: Wiping existing primary data before full refresh. [2025-10-02T17:28:01.974879] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-02T17:28:01.983137] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-02T17:28:01.989808] [INFO ] [MAIN ] BALY: Starting full primary refresh. [2025-10-02T17:28:02.060064] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-02T17:28:02.402140] [INFO ] [REMOTE ] BALY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:28:02.497107] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-02T17:28:02.673042] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-02. [2025-10-02T17:28:03.473013] [INFO ] [REMOTE ] BALY: Fetching primary data for 2024-12. [2025-10-02T17:28:04.026712] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-02T17:28:04.029011] [INFO ] [REMOTE ] BABA: Full fetch complete (77983 records). [2025-10-02T17:28:04.029161] [DEBUG] [VALIDATOR ] BABA: Validating primary data. [2025-10-02T17:28:04.278601] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-10. [2025-10-02T17:28:04.503934] [DEBUG] [VALIDATOR ] BABA: All expected trading days are present. [2025-10-02T17:28:04.518925] [DEBUG] [VALIDATOR ] BABA: Primary data validation passed. [2025-10-02T17:28:04.523250] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-02T17:28:04.520851] [INFO ] [MAIN ] BABA: Fetched primary data is valid. [2025-10-02T17:28:04.534405] [DEBUG] [LOCAL ] BABA: Saving primary data. [2025-10-02T17:28:04.536482] [DEBUG] [LOCAL ] BABA: Trimmed 77983 records to 54210 (keeping 200 days of data) [2025-10-02T17:28:04.784494] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-02T17:28:04.915542] [DEBUG] [LOCAL ] BABA: Primary data saved (54210 records). [2025-10-02T17:28:04.915723] [INFO ] [MAIN ] BABA: Full history saved. [2025-10-02T17:28:04.915820] [INFO ] [MAIN ] Update Progress: 208/2370 symbols completed. BABA took 45.8s. Estimated remaining: 4h 51m 14s. Rate: 7.4 symbols/min [2025-10-02T17:28:05.076202] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-01. [2025-10-02T17:28:05.104935] [INFO ] [MAIN ] BAM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:28:05.158968] [DEBUG] [LOCAL ] BAM: Loaded 51995 existing records from primary storage. [2025-10-02T17:28:05.159357] [INFO ] [MAIN ] BAM: Loaded 51995 existing records. [2025-10-02T17:28:05.378899] [WARN ] [MAIN ] BAM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:28:05.379564] [INFO ] [MAIN ] BAM: Wiping existing primary data before full refresh. [2025-10-02T17:28:05.379745] [INFO ] [LOCAL ] BAM: Starting deletion of primary data. [2025-10-02T17:28:05.381512] [DEBUG] [LOCAL ] BAM: Deleted primary data file. [2025-10-02T17:28:05.381662] [INFO ] [MAIN ] BAM: Starting full primary refresh. [2025-10-02T17:28:05.509913] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-02T17:28:05.523026] [INFO ] [REMOTE ] BAK: Full fetch complete (57198 records). [2025-10-02T17:28:05.554530] [DEBUG] [VALIDATOR ] BAK: Validating primary data. [2025-10-02T17:28:05.874598] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-03. [2025-10-02T17:28:06.050174] [INFO ] [REMOTE ] BAM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:28:06.253521] [DEBUG] [VALIDATOR ] BAK: All expected trading days are present. [2025-10-02T17:28:06.254139] [DEBUG] [VALIDATOR ] BAK: Primary data validation passed. [2025-10-02T17:28:06.255576] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-02T17:28:06.254807] [INFO ] [MAIN ] BAK: Fetched primary data is valid. [2025-10-02T17:28:06.261592] [DEBUG] [LOCAL ] BAK: Saving primary data. [2025-10-02T17:28:06.263403] [DEBUG] [LOCAL ] BAK: Trimmed 57198 records to 39471 (keeping 200 days of data) [2025-10-02T17:28:06.482228] [DEBUG] [LOCAL ] BAK: Primary data saved (39471 records). [2025-10-02T17:28:06.482373] [INFO ] [MAIN ] BAK: Full history saved. [2025-10-02T17:28:06.482456] [INFO ] [MAIN ] Update Progress: 209/2370 symbols completed. BAK took 23.9s. Estimated remaining: 4h 49m 58s. Rate: 7.5 symbols/min [2025-10-02T17:28:06.663698] [INFO ] [MAIN ] BANC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:28:06.673014] [INFO ] [REMOTE ] BAM: Fetching primary data for 2024-12. [2025-10-02T17:28:06.724356] [DEBUG] [LOCAL ] BANC: Loaded 51240 existing records from primary storage. [2025-10-02T17:28:06.724751] [INFO ] [MAIN ] BANC: Loaded 51240 existing records. [2025-10-02T17:28:06.921824] [WARN ] [MAIN ] BANC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:28:06.922057] [INFO ] [MAIN ] BANC: Wiping existing primary data before full refresh. [2025-10-02T17:28:06.922107] [INFO ] [LOCAL ] BANC: Starting deletion of primary data. [2025-10-02T17:28:06.923445] [DEBUG] [LOCAL ] BANC: Deleted primary data file. [2025-10-02T17:28:06.923509] [INFO ] [MAIN ] BANC: Starting full primary refresh. [2025-10-02T17:28:07.309479] [INFO ] [REMOTE ] BANC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:28:07.472978] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-02. [2025-10-02T17:28:07.777154] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-02T17:28:07.916086] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-02T17:28:08.272992] [INFO ] [REMOTE ] BANC: Fetching primary data for 2024-12. [2025-10-02T17:28:08.347234] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-02T17:28:09.073008] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-03. [2025-10-02T17:28:09.798665] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-02T17:28:09.875161] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-04. [2025-10-02T17:28:09.876798] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-02T17:28:10.673000] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-01. [2025-10-02T17:28:11.473015] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-04. [2025-10-02T17:28:11.679011] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-02T17:28:12.257225] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-02T17:28:12.266177] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-02T17:28:12.276006] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-05. [2025-10-02T17:28:13.073020] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-01. [2025-10-02T17:28:13.694975] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-02T17:28:13.873015] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-06. [2025-10-02T17:28:14.517498] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-02T17:28:14.673051] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-05. [2025-10-02T17:28:15.333845] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-02T17:28:15.472971] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-02. [2025-10-02T17:28:15.603980] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-02T17:28:16.273017] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-02. [2025-10-02T17:28:17.041822] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-02T17:28:17.072983] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-03. [2025-10-02T17:28:17.864527] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-02T17:28:17.874628] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-06. [2025-10-02T17:28:18.674839] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-03. [2025-10-02T17:28:18.681783] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-02T17:28:18.734206] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-02T17:28:19.473001] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-07. [2025-10-02T17:28:20.272997] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-04. [2025-10-02T17:28:20.306589] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-02T17:28:20.500403] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-02T17:28:21.073003] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-04. [2025-10-02T17:28:21.872979] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-07. [2025-10-02T17:28:22.033365] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-02T17:28:22.672968] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-08. [2025-10-02T17:28:22.780605] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-02T17:28:23.364809] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-02T17:28:23.473020] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-05. [2025-10-02T17:28:23.703407] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-02T17:28:24.272981] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-08. [2025-10-02T17:28:25.072977] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-09. [2025-10-02T17:28:25.200025] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-02T17:28:25.872992] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-06. [2025-10-02T17:28:25.926272] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-02T17:28:25.975575] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-02T17:28:26.673041] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-10. [2025-10-02T17:28:27.264236] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-02T17:28:27.265259] [INFO ] [REMOTE ] BALY: Full fetch complete (16884 records). [2025-10-02T17:28:27.265333] [DEBUG] [VALIDATOR ] BALY: Validating primary data. [2025-10-02T17:28:27.475315] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-05. [2025-10-02T17:28:27.483325] [WARN ] [VALIDATOR ] BALY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-02T17:28:27.484422] [FATAL] [MAIN ] BALY: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:28:27.485820] [WARN ] [MAIN ] BALY: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:28:27.485944] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-02T17:28:27.486062] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-02T17:28:27.486118] [INFO ] [LOCAL ] BALY: Starting deletion of derivative data. [2025-10-02T17:28:27.486326] [DEBUG] [LOCAL ] BALY: No derivative data file found to delete. [2025-10-02T17:28:27.486491] [INFO ] [MAIN ] Update Progress: 210/2370 symbols completed. BALY took 25.7s. Estimated remaining: 4h 52m 3s. Rate: 7.4 symbols/min [2025-10-02T17:28:27.737770] [INFO ] [MAIN ] BAP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:28:27.755555] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-02T17:28:27.793300] [DEBUG] [LOCAL ] BAP: Loaded 26187 existing records from primary storage. [2025-10-02T17:28:27.793578] [INFO ] [MAIN ] BAP: Loaded 26187 existing records. [2025-10-02T17:28:27.981230] [WARN ] [MAIN ] BAP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:28:27.981451] [INFO ] [MAIN ] BAP: Wiping existing primary data before full refresh. [2025-10-02T17:28:27.981503] [INFO ] [LOCAL ] BAP: Starting deletion of primary data. [2025-10-02T17:28:27.982398] [DEBUG] [LOCAL ] BAP: Deleted primary data file. [2025-10-02T17:28:27.982462] [INFO ] [MAIN ] BAP: Starting full primary refresh. [2025-10-02T17:28:28.281301] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-07. [2025-10-02T17:28:28.372356] [INFO ] [REMOTE ] BAP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:28:28.919347] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-02T17:28:29.073051] [INFO ] [REMOTE ] BAP: Fetching primary data for 2024-12. [2025-10-02T17:28:29.873000] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-06. [2025-10-02T17:28:30.058198] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-02T17:28:30.373719] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-02T17:28:30.672995] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-01. [2025-10-02T17:28:31.473052] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-09. [2025-10-02T17:28:31.620612] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-02T17:28:31.853540] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-02T17:28:32.272981] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-02. [2025-10-02T17:28:32.877511] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-02T17:28:33.073020] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-08. [2025-10-02T17:28:33.351564] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-02T17:28:33.873023] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-07. [2025-10-02T17:28:34.566380] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-02T17:28:34.673036] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-10. [2025-10-02T17:28:35.278872] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-02T17:28:35.473050] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-08. [2025-10-02T17:28:36.272993] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-09. [2025-10-02T17:28:36.488276] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-02T17:28:36.490618] [INFO ] [REMOTE ] BALL: Full fetch complete (75359 records). [2025-10-02T17:28:36.490783] [DEBUG] [VALIDATOR ] BALL: Validating primary data. [2025-10-02T17:28:36.926524] [DEBUG] [VALIDATOR ] BALL: All expected trading days are present. [2025-10-02T17:28:36.926695] [DEBUG] [VALIDATOR ] BALL: Primary data validation passed. [2025-10-02T17:28:36.927546] [INFO ] [MAIN ] BALL: Fetched primary data is valid. [2025-10-02T17:28:36.927595] [DEBUG] [LOCAL ] BALL: Saving primary data. [2025-10-02T17:28:36.929106] [DEBUG] [LOCAL ] BALL: Trimmed 75359 records to 52177 (keeping 200 days of data) [2025-10-02T17:28:37.068936] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-02T17:28:37.079689] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-03. [2025-10-02T17:28:37.313992] [DEBUG] [LOCAL ] BALL: Primary data saved (52177 records). [2025-10-02T17:28:37.314135] [INFO ] [MAIN ] BALL: Full history saved. [2025-10-02T17:28:37.314763] [INFO ] [MAIN ] Update Progress: 211/2370 symbols completed. BALL took 40.8s. Estimated remaining: 4h 52m 13s. Rate: 7.4 symbols/min [2025-10-02T17:28:37.502150] [INFO ] [MAIN ] BARK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:28:37.544308] [DEBUG] [LOCAL ] BARK: Loaded 38105 existing records from primary storage. [2025-10-02T17:28:37.544637] [INFO ] [MAIN ] BARK: Loaded 38105 existing records. [2025-10-02T17:28:37.781144] [WARN ] [MAIN ] BARK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:28:37.783835] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-02T17:28:37.781967] [INFO ] [MAIN ] BARK: Wiping existing primary data before full refresh. [2025-10-02T17:28:37.795251] [INFO ] [LOCAL ] BARK: Starting deletion of primary data. [2025-10-02T17:28:37.796823] [DEBUG] [LOCAL ] BARK: Deleted primary data file. [2025-10-02T17:28:37.796896] [INFO ] [MAIN ] BARK: Starting full primary refresh. [2025-10-02T17:28:37.882761] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-09. [2025-10-02T17:28:38.227013] [INFO ] [REMOTE ] BARK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:28:38.422685] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-02T17:28:38.673007] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-04. [2025-10-02T17:28:39.281232] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-02T17:28:39.473037] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-10. [2025-10-02T17:28:40.035132] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-02T17:28:40.273011] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-10. [2025-10-02T17:28:40.923495] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-02T17:28:40.925565] [INFO ] [REMOTE ] BANC: Full fetch complete (74266 records). [2025-10-02T17:28:40.925710] [DEBUG] [VALIDATOR ] BANC: Validating primary data. [2025-10-02T17:28:41.086000] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-05. [2025-10-02T17:28:41.376459] [DEBUG] [VALIDATOR ] BANC: All expected trading days are present. [2025-10-02T17:28:41.376564] [DEBUG] [VALIDATOR ] BANC: Primary data validation passed. [2025-10-02T17:28:41.377381] [INFO ] [MAIN ] BANC: Fetched primary data is valid. [2025-10-02T17:28:41.377454] [DEBUG] [LOCAL ] BANC: Saving primary data. [2025-10-02T17:28:41.379093] [DEBUG] [LOCAL ] BANC: Trimmed 74266 records to 51623 (keeping 200 days of data) [2025-10-02T17:28:41.713560] [DEBUG] [LOCAL ] BANC: Primary data saved (51623 records). [2025-10-02T17:28:41.713736] [INFO ] [MAIN ] BANC: Full history saved. [2025-10-02T17:28:41.713863] [INFO ] [MAIN ] Update Progress: 212/2370 symbols completed. BANC took 35.2s. Estimated remaining: 4h 51m 27s. Rate: 7.4 symbols/min [2025-10-02T17:28:41.838290] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-02T17:28:41.858026] [INFO ] [REMOTE ] BAM: Full fetch complete (74336 records). [2025-10-02T17:28:41.868514] [DEBUG] [VALIDATOR ] BAM: Validating primary data. [2025-10-02T17:28:41.893855] [INFO ] [REMOTE ] BARK: Fetching primary data for 2024-12. [2025-10-02T17:28:41.946889] [INFO ] [MAIN ] BAX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:28:42.399066] [DEBUG] [VALIDATOR ] BAM: All expected trading days are present. [2025-10-02T17:28:42.400823] [DEBUG] [LOCAL ] BAX: Loaded 53493 existing records from primary storage. [2025-10-02T17:28:42.401255] [INFO ] [MAIN ] BAX: Loaded 53493 existing records. [2025-10-02T17:28:42.401085] [DEBUG] [VALIDATOR ] BAM: Primary data validation passed. [2025-10-02T17:28:42.424222] [INFO ] [MAIN ] BAM: Fetched primary data is valid. [2025-10-02T17:28:42.488671] [DEBUG] [LOCAL ] BAM: Saving primary data. [2025-10-02T17:28:42.542863] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-02T17:28:42.592748] [DEBUG] [LOCAL ] BAM: Trimmed 74336 records to 52385 (keeping 200 days of data) [2025-10-02T17:28:42.633080] [WARN ] [MAIN ] BAX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:28:42.634399] [INFO ] [MAIN ] BAX: Wiping existing primary data before full refresh. [2025-10-02T17:28:42.634455] [INFO ] [LOCAL ] BAX: Starting deletion of primary data. [2025-10-02T17:28:42.636211] [DEBUG] [LOCAL ] BAX: Deleted primary data file. [2025-10-02T17:28:42.636282] [INFO ] [MAIN ] BAX: Starting full primary refresh. [2025-10-02T17:28:42.744635] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-06. [2025-10-02T17:28:43.162026] [INFO ] [REMOTE ] BAX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:28:43.386453] [DEBUG] [LOCAL ] BAM: Primary data saved (52385 records). [2025-10-02T17:28:43.386595] [INFO ] [MAIN ] BAM: Full history saved. [2025-10-02T17:28:43.387597] [INFO ] [MAIN ] Update Progress: 213/2370 symbols completed. BAM took 38.5s. Estimated remaining: 4h 50m 14s. Rate: 7.4 symbols/min [2025-10-02T17:28:43.478271] [INFO ] [REMOTE ] BAX: Fetching primary data for 2024-12. [2025-10-02T17:28:43.580118] [INFO ] [MAIN ] BB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:28:43.626126] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-02T17:28:43.682852] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-02T17:28:43.707235] [DEBUG] [LOCAL ] BB: Loaded 52930 existing records from primary storage. [2025-10-02T17:28:43.707601] [INFO ] [MAIN ] BB: Loaded 52930 existing records. [2025-10-02T17:28:43.898267] [WARN ] [MAIN ] BB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:28:43.898499] [INFO ] [MAIN ] BB: Wiping existing primary data before full refresh. [2025-10-02T17:28:43.898547] [INFO ] [LOCAL ] BB: Starting deletion of primary data. [2025-10-02T17:28:43.899954] [DEBUG] [LOCAL ] BB: Deleted primary data file. [2025-10-02T17:28:43.900020] [INFO ] [MAIN ] BB: Starting full primary refresh. [2025-10-02T17:28:44.275868] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-01. [2025-10-02T17:28:44.281433] [INFO ] [REMOTE ] BB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:28:45.078093] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-07. [2025-10-02T17:28:45.101069] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-02T17:28:45.803911] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-02T17:28:45.873046] [INFO ] [REMOTE ] BB: Fetching primary data for 2024-12. [2025-10-02T17:28:45.993027] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-02T17:28:46.673015] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-02. [2025-10-02T17:28:47.473031] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-08. [2025-10-02T17:28:47.847668] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-02T17:28:48.050553] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-02T17:28:48.273044] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-03. [2025-10-02T17:28:48.663801] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-02T17:28:49.073012] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-09. [2025-10-02T17:28:49.788587] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-02T17:28:49.873011] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-01. [2025-10-02T17:28:50.300094] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-02T17:28:50.673047] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-10. [2025-10-02T17:28:51.358058] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-02T17:28:51.473043] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-04. [2025-10-02T17:28:51.966895] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-02T17:28:51.968593] [INFO ] [REMOTE ] BAP: Full fetch complete (37613 records). [2025-10-02T17:28:51.968731] [DEBUG] [VALIDATOR ] BAP: Validating primary data. [2025-10-02T17:28:52.278182] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-02. [2025-10-02T17:28:52.400384] [DEBUG] [VALIDATOR ] BAP: All expected trading days are present. [2025-10-02T17:28:52.400463] [DEBUG] [VALIDATOR ] BAP: Primary data validation passed. [2025-10-02T17:28:52.400957] [INFO ] [MAIN ] BAP: Fetched primary data is valid. [2025-10-02T17:28:52.401019] [DEBUG] [LOCAL ] BAP: Saving primary data. [2025-10-02T17:28:52.401865] [DEBUG] [LOCAL ] BAP: Trimmed 37613 records to 26325 (keeping 200 days of data) [2025-10-02T17:28:52.569166] [DEBUG] [LOCAL ] BAP: Primary data saved (26325 records). [2025-10-02T17:28:52.569304] [INFO ] [MAIN ] BAP: Full history saved. [2025-10-02T17:28:52.569402] [INFO ] [MAIN ] Update Progress: 214/2370 symbols completed. BAP took 25.1s. Estimated remaining: 4h 50m 17s. Rate: 7.4 symbols/min [2025-10-02T17:28:52.762205] [INFO ] [MAIN ] BBAI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:28:52.820794] [DEBUG] [LOCAL ] BBAI: Loaded 53820 existing records from primary storage. [2025-10-02T17:28:52.821155] [INFO ] [MAIN ] BBAI: Loaded 53820 existing records. [2025-10-02T17:28:53.011033] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-02T17:28:53.053187] [WARN ] [MAIN ] BBAI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:28:53.053789] [INFO ] [MAIN ] BBAI: Wiping existing primary data before full refresh. [2025-10-02T17:28:53.053842] [INFO ] [LOCAL ] BBAI: Starting deletion of primary data. [2025-10-02T17:28:53.055241] [DEBUG] [LOCAL ] BBAI: Deleted primary data file. [2025-10-02T17:28:53.055305] [INFO ] [MAIN ] BBAI: Starting full primary refresh. [2025-10-02T17:28:53.078112] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-01. [2025-10-02T17:28:53.450777] [INFO ] [REMOTE ] BBAI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:28:53.732618] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-02T17:28:53.873016] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2024-12. [2025-10-02T17:28:54.678102] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-05. [2025-10-02T17:28:54.703418] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-02T17:28:55.473060] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-02. [2025-10-02T17:28:56.145911] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-02T17:28:56.273054] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-06. [2025-10-02T17:28:56.779202] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2024-12 (2.91 seconds). [2025-10-02T17:28:57.072999] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-03. [2025-10-02T17:28:57.503949] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-02T17:28:57.873008] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-03. [2025-10-02T17:28:57.998280] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-02T17:28:58.672984] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-07. [2025-10-02T17:28:59.033875] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-02T17:28:59.472977] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-04. [2025-10-02T17:28:59.644133] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-02T17:29:00.142595] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-02T17:29:00.273055] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-08. [2025-10-02T17:29:01.073035] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-01. [2025-10-02T17:29:01.571405] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-02T17:29:01.625333] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-02T17:29:01.873013] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-09. [2025-10-02T17:29:02.672996] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-04. [2025-10-02T17:29:03.003710] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-02T17:29:03.114827] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-02T17:29:03.473005] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-02. [2025-10-02T17:29:04.115924] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-02T17:29:04.273046] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-05. [2025-10-02T17:29:05.073009] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-05. [2025-10-02T17:29:05.635529] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-02T17:29:05.865002] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-02 (2.39 seconds). [2025-10-02T17:29:05.875601] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-10. [2025-10-02T17:29:06.672972] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-06. [2025-10-02T17:29:06.793506] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-02T17:29:06.812633] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-02T17:29:06.814106] [INFO ] [REMOTE ] BARK: Full fetch complete (56316 records). [2025-10-02T17:29:06.814262] [DEBUG] [VALIDATOR ] BARK: Validating primary data. [2025-10-02T17:29:07.248174] [DEBUG] [VALIDATOR ] BARK: All expected trading days are present. [2025-10-02T17:29:07.248281] [DEBUG] [VALIDATOR ] BARK: Primary data validation passed. [2025-10-02T17:29:07.248997] [INFO ] [MAIN ] BARK: Fetched primary data is valid. [2025-10-02T17:29:07.249105] [DEBUG] [LOCAL ] BARK: Saving primary data. [2025-10-02T17:29:07.250323] [DEBUG] [LOCAL ] BARK: Trimmed 56316 records to 38304 (keeping 200 days of data) [2025-10-02T17:29:07.473432] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-03. [2025-10-02T17:29:07.479391] [DEBUG] [LOCAL ] BARK: Primary data saved (38304 records). [2025-10-02T17:29:07.479575] [INFO ] [MAIN ] BARK: Full history saved. [2025-10-02T17:29:07.481067] [INFO ] [MAIN ] Update Progress: 215/2370 symbols completed. BARK took 30.2s. Estimated remaining: 4h 51m 17s. Rate: 7.4 symbols/min [2025-10-02T17:29:07.663712] [INFO ] [MAIN ] BBAR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:29:07.721622] [DEBUG] [LOCAL ] BBAR: Loaded 41510 existing records from primary storage. [2025-10-02T17:29:07.722459] [INFO ] [MAIN ] BBAR: Loaded 41510 existing records. [2025-10-02T17:29:07.923375] [WARN ] [MAIN ] BBAR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:29:07.923701] [INFO ] [MAIN ] BBAR: Wiping existing primary data before full refresh. [2025-10-02T17:29:07.923772] [INFO ] [LOCAL ] BBAR: Starting deletion of primary data. [2025-10-02T17:29:07.925298] [DEBUG] [LOCAL ] BBAR: Deleted primary data file. [2025-10-02T17:29:07.925370] [INFO ] [MAIN ] BBAR: Starting full primary refresh. [2025-10-02T17:29:08.296137] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-06. [2025-10-02T17:29:08.331628] [INFO ] [REMOTE ] BBAR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:29:08.366878] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-02T17:29:09.073008] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-07. [2025-10-02T17:29:09.872979] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2024-12. [2025-10-02T17:29:10.140540] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-03 (2.67 seconds). [2025-10-02T17:29:10.381377] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-02T17:29:10.672989] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-07. [2025-10-02T17:29:10.966257] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-02T17:29:11.473023] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-04. [2025-10-02T17:29:11.720221] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-02T17:29:12.273005] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-01. [2025-10-02T17:29:12.524403] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-02T17:29:13.073028] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-08. [2025-10-02T17:29:13.581828] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-02T17:29:13.660371] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-02T17:29:13.873007] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-05. [2025-10-02T17:29:14.669399] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-02T17:29:14.680093] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-08. [2025-10-02T17:29:15.473001] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-02. [2025-10-02T17:29:16.075940] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-02T17:29:16.272999] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-06. [2025-10-02T17:29:16.452601] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-02T17:29:16.529783] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-02T17:29:17.072987] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-03. [2025-10-02T17:29:17.873005] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-09. [2025-10-02T17:29:17.984793] [DEBUG] [REMOTE ] BAX: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-10-02T17:29:17.985195] [WARN ] [REMOTE ] BAX: No data returned for month 2025-09 [2025-10-02T17:29:17.985307] [FATAL] [REMOTE ] BAX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T17:29:17.985436] [FATAL] [MAIN ] BAX: Failed to fetch primary data. [2025-10-02T17:29:17.985524] [WARN ] [MAIN ] BAX: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T17:29:17.985621] [INFO ] [LOCAL ] BAX: Starting deletion of primary data. [2025-10-02T17:29:17.985741] [DEBUG] [LOCAL ] BAX: No primary data file found to delete. [2025-10-02T17:29:17.985797] [INFO ] [LOCAL ] BAX: Starting deletion of derivative data. [2025-10-02T17:29:17.986229] [DEBUG] [LOCAL ] BAX: Deleted derivative data file. [2025-10-02T17:29:17.986330] [INFO ] [MAIN ] Update Progress: 216/2370 symbols completed. BAX took 36.3s. Estimated remaining: 4h 51m 33s. Rate: 7.4 symbols/min [2025-10-02T17:29:18.177419] [INFO ] [MAIN ] BBD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:29:18.230183] [DEBUG] [LOCAL ] BBD: Loaded 53197 existing records from primary storage. [2025-10-02T17:29:18.230543] [INFO ] [MAIN ] BBD: Loaded 53197 existing records. [2025-10-02T17:29:18.433186] [WARN ] [MAIN ] BBD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:29:18.433821] [INFO ] [MAIN ] BBD: Wiping existing primary data before full refresh. [2025-10-02T17:29:18.433936] [INFO ] [LOCAL ] BBD: Starting deletion of primary data. [2025-10-02T17:29:18.435704] [DEBUG] [LOCAL ] BBD: Deleted primary data file. [2025-10-02T17:29:18.435770] [INFO ] [MAIN ] BBD: Starting full primary refresh. [2025-10-02T17:29:18.691137] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-09. [2025-10-02T17:29:18.703270] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-06 (2.43 seconds). [2025-10-02T17:29:18.909817] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-02T17:29:18.913868] [INFO ] [REMOTE ] BBD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:29:19.472954] [INFO ] [REMOTE ] BBD: Fetching primary data for 2024-12. [2025-10-02T17:29:20.273015] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-07. [2025-10-02T17:29:20.821142] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-02T17:29:21.072980] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-04. [2025-10-02T17:29:21.502725] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-02T17:29:21.873044] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-10. [2025-10-02T17:29:22.429907] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-02T17:29:22.493385] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-02T17:29:22.673027] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-08. [2025-10-02T17:29:23.473041] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-05. [2025-10-02T17:29:23.863720] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-02T17:29:23.866949] [INFO ] [REMOTE ] BB: Full fetch complete (76995 records). [2025-10-02T17:29:23.867170] [DEBUG] [VALIDATOR ] BB: Validating primary data. [2025-10-02T17:29:24.282283] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-01. [2025-10-02T17:29:24.516977] [DEBUG] [VALIDATOR ] BB: All expected trading days are present. [2025-10-02T17:29:24.517122] [DEBUG] [VALIDATOR ] BB: Primary data validation passed. [2025-10-02T17:29:24.524360] [INFO ] [MAIN ] BB: Fetched primary data is valid. [2025-10-02T17:29:24.524718] [DEBUG] [LOCAL ] BB: Saving primary data. [2025-10-02T17:29:24.531410] [DEBUG] [LOCAL ] BB: Trimmed 76995 records to 53320 (keeping 200 days of data) [2025-10-02T17:29:24.921815] [DEBUG] [LOCAL ] BB: Primary data saved (53320 records). [2025-10-02T17:29:24.922002] [INFO ] [MAIN ] BB: Full history saved. [2025-10-02T17:29:24.922231] [INFO ] [MAIN ] Update Progress: 217/2370 symbols completed. BB took 41.5s. Estimated remaining: 4h 51m 13s. Rate: 7.4 symbols/min [2025-10-02T17:29:25.173593] [INFO ] [MAIN ] BBDC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:29:25.204724] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-02T17:29:25.215052] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-06. [2025-10-02T17:29:25.245400] [DEBUG] [LOCAL ] BBDC: Loaded 32973 existing records from primary storage. [2025-10-02T17:29:25.245728] [INFO ] [MAIN ] BBDC: Loaded 32973 existing records. [2025-10-02T17:29:25.443523] [WARN ] [MAIN ] BBDC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:29:25.443808] [INFO ] [MAIN ] BBDC: Wiping existing primary data before full refresh. [2025-10-02T17:29:25.443913] [INFO ] [LOCAL ] BBDC: Starting deletion of primary data. [2025-10-02T17:29:25.445022] [DEBUG] [LOCAL ] BBDC: Deleted primary data file. [2025-10-02T17:29:25.445166] [INFO ] [MAIN ] BBDC: Starting full primary refresh. [2025-10-02T17:29:25.582592] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-08 (2.91 seconds). [2025-10-02T17:29:25.895312] [INFO ] [REMOTE ] BBDC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:29:25.895417] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-09. [2025-10-02T17:29:25.990477] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-02T17:29:26.420719] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-02T17:29:26.673067] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-07. [2025-10-02T17:29:27.473037] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-02. [2025-10-02T17:29:27.916692] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-02T17:29:28.273051] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-08. [2025-10-02T17:29:28.777492] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-09 (2.88 seconds). [2025-10-02T17:29:29.073124] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-10. [2025-10-02T17:29:29.075058] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-02T17:29:29.289981] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-02T17:29:29.873004] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-03. [2025-10-02T17:29:30.673010] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2024-12. [2025-10-02T17:29:31.473010] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-09. [2025-10-02T17:29:31.524377] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-02T17:29:31.610061] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-10 (2.54 seconds). [2025-10-02T17:29:31.612270] [INFO ] [REMOTE ] BBAI: Full fetch complete (77999 records). [2025-10-02T17:29:31.612397] [DEBUG] [VALIDATOR ] BBAI: Validating primary data. [2025-10-02T17:29:32.057491] [DEBUG] [VALIDATOR ] BBAI: All expected trading days are present. [2025-10-02T17:29:32.057767] [DEBUG] [VALIDATOR ] BBAI: Primary data validation passed. [2025-10-02T17:29:32.058747] [INFO ] [MAIN ] BBAI: Fetched primary data is valid. [2025-10-02T17:29:32.058859] [DEBUG] [LOCAL ] BBAI: Saving primary data. [2025-10-02T17:29:32.060595] [DEBUG] [LOCAL ] BBAI: Trimmed 77999 records to 54210 (keeping 200 days of data) [2025-10-02T17:29:32.274048] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-04. [2025-10-02T17:29:32.325365] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-02T17:29:32.433448] [DEBUG] [LOCAL ] BBAI: Primary data saved (54210 records). [2025-10-02T17:29:32.433607] [INFO ] [MAIN ] BBAI: Full history saved. [2025-10-02T17:29:32.433729] [INFO ] [MAIN ] Update Progress: 218/2370 symbols completed. BBAI took 39.9s. Estimated remaining: 4h 50m 59s. Rate: 7.4 symbols/min [2025-10-02T17:29:32.622365] [INFO ] [MAIN ] BBDO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:29:32.629316] [DEBUG] [LOCAL ] BBDO: Loaded 4975 existing records from primary storage. [2025-10-02T17:29:32.629559] [INFO ] [MAIN ] BBDO: Loaded 4975 existing records. [2025-10-02T17:29:32.853033] [WARN ] [MAIN ] BBDO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:29:32.853418] [INFO ] [MAIN ] BBDO: Wiping existing primary data before full refresh. [2025-10-02T17:29:32.853496] [INFO ] [LOCAL ] BBDO: Starting deletion of primary data. [2025-10-02T17:29:32.853922] [DEBUG] [LOCAL ] BBDO: Deleted primary data file. [2025-10-02T17:29:32.853991] [INFO ] [MAIN ] BBDO: Starting full primary refresh. [2025-10-02T17:29:33.078442] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-01. [2025-10-02T17:29:33.288214] [INFO ] [REMOTE ] BBDO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:29:33.618881] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-02T17:29:33.768676] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-02T17:29:33.872995] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-05. [2025-10-02T17:29:34.483333] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-02T17:29:34.673033] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2024-12. [2025-10-02T17:29:35.271212] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-02T17:29:35.472985] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-10. [2025-10-02T17:29:35.664419] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-02T17:29:36.273024] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-01. [2025-10-02T17:29:36.845097] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-02T17:29:36.847027] [INFO ] [REMOTE ] BBAR: Full fetch complete (60943 records). [2025-10-02T17:29:36.847155] [DEBUG] [VALIDATOR ] BBAR: Validating primary data. [2025-10-02T17:29:36.976569] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-02T17:29:37.083169] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-06. [2025-10-02T17:29:37.304042] [DEBUG] [VALIDATOR ] BBAR: All expected trading days are present. [2025-10-02T17:29:37.304138] [DEBUG] [VALIDATOR ] BBAR: Primary data validation passed. [2025-10-02T17:29:37.304920] [INFO ] [MAIN ] BBAR: Fetched primary data is valid. [2025-10-02T17:29:37.304999] [DEBUG] [LOCAL ] BBAR: Saving primary data. [2025-10-02T17:29:37.306583] [DEBUG] [LOCAL ] BBAR: Trimmed 60943 records to 41882 (keeping 200 days of data) [2025-10-02T17:29:37.585532] [DEBUG] [LOCAL ] BBAR: Primary data saved (41882 records). [2025-10-02T17:29:37.585691] [INFO ] [MAIN ] BBAR: Full history saved. [2025-10-02T17:29:37.587124] [INFO ] [MAIN ] Update Progress: 219/2370 symbols completed. BBAR took 30.1s. Estimated remaining: 4h 50m 22s. Rate: 7.4 symbols/min [2025-10-02T17:29:37.777546] [INFO ] [MAIN ] BBN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:29:37.805079] [DEBUG] [LOCAL ] BBN: Loaded 18077 existing records from primary storage. [2025-10-02T17:29:37.805352] [INFO ] [MAIN ] BBN: Loaded 18077 existing records. [2025-10-02T17:29:37.878206] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-02. [2025-10-02T17:29:38.006482] [WARN ] [MAIN ] BBN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:29:38.006773] [INFO ] [MAIN ] BBN: Wiping existing primary data before full refresh. [2025-10-02T17:29:38.006830] [INFO ] [LOCAL ] BBN: Starting deletion of primary data. [2025-10-02T17:29:38.007461] [DEBUG] [LOCAL ] BBN: Deleted primary data file. [2025-10-02T17:29:38.007525] [INFO ] [MAIN ] BBN: Starting full primary refresh. [2025-10-02T17:29:38.407145] [INFO ] [REMOTE ] BBN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:29:38.530615] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-02T17:29:38.672987] [INFO ] [REMOTE ] BBN: Fetching primary data for 2024-12. [2025-10-02T17:29:38.935682] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-02T17:29:39.472986] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-07. [2025-10-02T17:29:39.924530] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-02T17:29:40.273034] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-01. [2025-10-02T17:29:41.067215] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-02T17:29:41.072944] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-02. [2025-10-02T17:29:41.134086] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-02T17:29:41.873009] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-03. [2025-10-02T17:29:41.990326] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-02T17:29:42.473587] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-02T17:29:42.673040] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-02. [2025-10-02T17:29:43.473015] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-04. [2025-10-02T17:29:44.057938] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-02T17:29:44.193162] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-02T17:29:44.273003] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-03. [2025-10-02T17:29:45.072981] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-03. [2025-10-02T17:29:45.126920] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-02T17:29:45.873040] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-04. [2025-10-02T17:29:46.550162] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-02T17:29:46.589122] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-02T17:29:46.673052] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-05. [2025-10-02T17:29:47.475585] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-05. [2025-10-02T17:29:47.477256] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-02T17:29:48.273001] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-06. [2025-10-02T17:29:48.445176] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-02T17:29:48.897314] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-02T17:29:49.073007] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-07. [2025-10-02T17:29:49.753148] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-02T17:29:49.873039] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-04. [2025-10-02T17:29:50.673075] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-08. [2025-10-02T17:29:51.401531] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-02T17:29:51.472996] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-05. [2025-10-02T17:29:52.273022] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-06. [2025-10-02T17:29:52.326554] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-02T17:29:52.481200] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-02T17:29:53.072989] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-06. [2025-10-02T17:29:53.225381] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-02T17:29:53.873052] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-09. [2025-10-02T17:29:54.539632] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-02T17:29:54.673034] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-07. [2025-10-02T17:29:55.472964] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-08. [2025-10-02T17:29:55.546766] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-02T17:29:55.684335] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-02T17:29:56.004843] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-02T17:29:56.273026] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-07. [2025-10-02T17:29:57.072986] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-08. [2025-10-02T17:29:57.504048] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-02T17:29:57.872982] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-08. [2025-10-02T17:29:58.038761] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-02T17:29:58.673024] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-10. [2025-10-02T17:29:58.975189] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-02T17:29:59.473008] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-09. [2025-10-02T17:30:00.052120] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-02T17:30:00.056883] [INFO ] [REMOTE ] BBD: Full fetch complete (77112 records). [2025-10-02T17:30:00.057025] [DEBUG] [VALIDATOR ] BBD: Validating primary data. [2025-10-02T17:30:00.288160] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-09. [2025-10-02T17:30:00.304157] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-02T17:30:00.540469] [DEBUG] [VALIDATOR ] BBD: All expected trading days are present. [2025-10-02T17:30:00.540560] [DEBUG] [VALIDATOR ] BBD: Primary data validation passed. [2025-10-02T17:30:00.541527] [INFO ] [MAIN ] BBD: Fetched primary data is valid. [2025-10-02T17:30:00.541600] [DEBUG] [LOCAL ] BBD: Saving primary data. [2025-10-02T17:30:00.543347] [DEBUG] [LOCAL ] BBD: Trimmed 77112 records to 53587 (keeping 200 days of data) [2025-10-02T17:30:00.895736] [DEBUG] [LOCAL ] BBD: Primary data saved (53587 records). [2025-10-02T17:30:00.896004] [INFO ] [MAIN ] BBD: Full history saved. [2025-10-02T17:30:00.896154] [INFO ] [MAIN ] Update Progress: 220/2370 symbols completed. BBD took 42.9s. Estimated remaining: 4h 52m 42s. Rate: 7.3 symbols/min [2025-10-02T17:30:01.073079] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-10. [2025-10-02T17:30:01.093571] [INFO ] [MAIN ] BBT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:30:01.094986] [DEBUG] [LOCAL ] BBT: No existing data file found in primary storage. [2025-10-02T17:30:01.095040] [WARN ] [MAIN ] BBT: No existing data found, performing full refresh instead. [2025-10-02T17:30:01.095162] [INFO ] [MAIN ] BBT: Wiping existing primary data before full refresh. [2025-10-02T17:30:01.095207] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-02T17:30:01.095254] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-02T17:30:01.095356] [INFO ] [MAIN ] BBT: Starting full primary refresh. [2025-10-02T17:30:01.534979] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-02T17:30:01.559323] [INFO ] [REMOTE ] BBT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:30:01.873019] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-10. [2025-10-02T17:30:02.109452] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-02T17:30:02.110553] [INFO ] [REMOTE ] BBN: Full fetch complete (26529 records). [2025-10-02T17:30:02.110637] [DEBUG] [VALIDATOR ] BBN: Validating primary data. [2025-10-02T17:30:02.450692] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-02T17:30:02.468607] [INFO ] [REMOTE ] BBDO: Full fetch complete (7632 records). [2025-10-02T17:30:02.479064] [DEBUG] [VALIDATOR ] BBDO: Validating primary data. [2025-10-02T17:30:02.498474] [FATAL] [VALIDATOR ] BBDO: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:30:02.520223] [FATAL] [MAIN ] BBDO: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:30:02.556823] [DEBUG] [VALIDATOR ] BBN: All expected trading days are present. [2025-10-02T17:30:02.545207] [WARN ] [MAIN ] BBDO: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:30:02.556960] [INFO ] [LOCAL ] BBDO: Starting deletion of primary data. [2025-10-02T17:30:02.557043] [DEBUG] [VALIDATOR ] BBN: Primary data validation passed. [2025-10-02T17:30:02.557157] [DEBUG] [LOCAL ] BBDO: No primary data file found to delete. [2025-10-02T17:30:02.557570] [INFO ] [MAIN ] BBN: Fetched primary data is valid. [2025-10-02T17:30:02.557673] [DEBUG] [LOCAL ] BBN: Saving primary data. [2025-10-02T17:30:02.557758] [INFO ] [LOCAL ] BBDO: Starting deletion of derivative data. [2025-10-02T17:30:02.558228] [DEBUG] [LOCAL ] BBDO: Deleted derivative data file. [2025-10-02T17:30:02.558400] [INFO ] [MAIN ] Update Progress: 221/2370 symbols completed. BBDO took 30.1s. Estimated remaining: 4h 51m 31s. Rate: 7.4 symbols/min [2025-10-02T17:30:02.627960] [DEBUG] [LOCAL ] BBN: Trimmed 26529 records to 18177 (keeping 200 days of data) [2025-10-02T17:30:02.678443] [INFO ] [REMOTE ] BBT: Fetching primary data for 2024-12. [2025-10-02T17:30:02.857977] [INFO ] [MAIN ] BBU: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:30:02.868037] [DEBUG] [LOCAL ] BBU: Loaded 4720 existing records from primary storage. [2025-10-02T17:30:02.868612] [INFO ] [MAIN ] BBU: Loaded 4720 existing records. [2025-10-02T17:30:03.021682] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T17:30:03.061300] [WARN ] [REMOTE ] BBT: No data returned for month 2024-12 [2025-10-02T17:30:03.109426] [WARN ] [MAIN ] BBU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:30:03.109621] [FATAL] [REMOTE ] BBT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T17:30:03.110356] [INFO ] [MAIN ] BBU: Wiping existing primary data before full refresh. [2025-10-02T17:30:03.110202] [FATAL] [MAIN ] BBT: Failed to fetch primary data. [2025-10-02T17:30:03.112376] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-10-02T17:30:03.113867] [DEBUG] [LOCAL ] BBU: Deleted primary data file. [2025-10-02T17:30:03.114793] [INFO ] [MAIN ] BBU: Starting full primary refresh. [2025-10-02T17:30:03.113487] [WARN ] [MAIN ] BBT: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T17:30:03.121200] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-02T17:30:03.139518] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-02T17:30:03.165272] [INFO ] [LOCAL ] BBT: Starting deletion of derivative data. [2025-10-02T17:30:03.173835] [DEBUG] [LOCAL ] BBT: No derivative data file found to delete. [2025-10-02T17:30:03.191142] [INFO ] [MAIN ] Update Progress: 222/2370 symbols completed. BBT took 2.3s. Estimated remaining: 4h 50m 10s. Rate: 7.4 symbols/min [2025-10-02T17:30:03.479756] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-09. [2025-10-02T17:30:03.612848] [INFO ] [MAIN ] BBUC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:30:03.643213] [DEBUG] [LOCAL ] BBN: Primary data saved (18177 records). [2025-10-02T17:30:03.654402] [INFO ] [MAIN ] BBN: Full history saved. [2025-10-02T17:30:03.677321] [INFO ] [MAIN ] Update Progress: 223/2370 symbols completed. BBN took 26.1s. Estimated remaining: 4h 48m 49s. Rate: 7.4 symbols/min [2025-10-02T17:30:03.873541] [DEBUG] [LOCAL ] BBUC: Loaded 13313 existing records from primary storage. [2025-10-02T17:30:03.867825] [INFO ] [REMOTE ] BBU: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:30:03.887973] [INFO ] [MAIN ] BBUC: Loaded 13313 existing records. [2025-10-02T17:30:04.106367] [INFO ] [MAIN ] BBVA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:30:04.193841] [WARN ] [MAIN ] BBUC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:30:04.194116] [INFO ] [MAIN ] BBUC: Wiping existing primary data before full refresh. [2025-10-02T17:30:04.194166] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-10-02T17:30:04.194739] [DEBUG] [LOCAL ] BBUC: Deleted primary data file. [2025-10-02T17:30:04.194808] [INFO ] [MAIN ] BBUC: Starting full primary refresh. [2025-10-02T17:30:04.275895] [INFO ] [REMOTE ] BBU: Fetching primary data for 2024-12. [2025-10-02T17:30:04.530882] [DEBUG] [LOCAL ] BBVA: Loaded 49276 existing records from primary storage. [2025-10-02T17:30:04.550504] [INFO ] [MAIN ] BBVA: Loaded 49276 existing records. [2025-10-02T17:30:04.812851] [INFO ] [REMOTE ] BBUC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:30:04.878304] [WARN ] [MAIN ] BBVA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:30:04.878626] [INFO ] [MAIN ] BBVA: Wiping existing primary data before full refresh. [2025-10-02T17:30:04.878714] [INFO ] [LOCAL ] BBVA: Starting deletion of primary data. [2025-10-02T17:30:04.880305] [DEBUG] [LOCAL ] BBVA: Deleted primary data file. [2025-10-02T17:30:04.880370] [INFO ] [MAIN ] BBVA: Starting full primary refresh. [2025-10-02T17:30:05.005986] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-02T17:30:05.086729] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-01. [2025-10-02T17:30:05.318223] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-02T17:30:05.324331] [INFO ] [REMOTE ] BBVA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:30:05.697160] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-02T17:30:05.873003] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2024-12. [2025-10-02T17:30:06.658835] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-02T17:30:06.672989] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-01. [2025-10-02T17:30:07.473008] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-02. [2025-10-02T17:30:07.507246] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-02T17:30:08.014929] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-02T17:30:08.273021] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-10. [2025-10-02T17:30:09.072991] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2024-12. [2025-10-02T17:30:09.291211] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-02T17:30:09.292495] [INFO ] [REMOTE ] BBDC: Full fetch complete (48430 records). [2025-10-02T17:30:09.292618] [DEBUG] [VALIDATOR ] BBDC: Validating primary data. [2025-10-02T17:30:09.293331] [FATAL] [VALIDATOR ] BBDC: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:30:09.293416] [FATAL] [MAIN ] BBDC: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:30:09.293460] [WARN ] [MAIN ] BBDC: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:30:09.293528] [INFO ] [LOCAL ] BBDC: Starting deletion of primary data. [2025-10-02T17:30:09.293590] [DEBUG] [LOCAL ] BBDC: No primary data file found to delete. [2025-10-02T17:30:09.293626] [INFO ] [LOCAL ] BBDC: Starting deletion of derivative data. [2025-10-02T17:30:09.293927] [DEBUG] [LOCAL ] BBDC: Deleted derivative data file. [2025-10-02T17:30:09.294024] [INFO ] [MAIN ] Update Progress: 224/2370 symbols completed. BBDC took 44.4s. Estimated remaining: 4h 48m 17s. Rate: 7.4 symbols/min [2025-10-02T17:30:09.483992] [INFO ] [MAIN ] BBW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:30:09.515161] [DEBUG] [LOCAL ] BBW: Loaded 26701 existing records from primary storage. [2025-10-02T17:30:09.515514] [INFO ] [MAIN ] BBW: Loaded 26701 existing records. [2025-10-02T17:30:09.718793] [WARN ] [MAIN ] BBW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:30:09.719024] [INFO ] [MAIN ] BBW: Wiping existing primary data before full refresh. [2025-10-02T17:30:09.719079] [INFO ] [LOCAL ] BBW: Starting deletion of primary data. [2025-10-02T17:30:09.720050] [DEBUG] [LOCAL ] BBW: Deleted primary data file. [2025-10-02T17:30:09.720120] [INFO ] [MAIN ] BBW: Starting full primary refresh. [2025-10-02T17:30:09.878157] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-02. [2025-10-02T17:30:10.130247] [INFO ] [REMOTE ] BBW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:30:10.653190] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-02T17:30:10.688276] [INFO ] [REMOTE ] BBW: Fetching primary data for 2024-12. [2025-10-02T17:30:10.692017] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-02T17:30:11.472977] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-01. [2025-10-02T17:30:11.709422] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-02T17:30:12.273003] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-03. [2025-10-02T17:30:13.072986] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-03. [2025-10-02T17:30:13.163318] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-02T17:30:13.203283] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-02T17:30:13.626472] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-02T17:30:13.872998] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-04. [2025-10-02T17:30:14.365265] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-02T17:30:14.673000] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-02. [2025-10-02T17:30:15.472993] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-05. [2025-10-02T17:30:16.086438] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-02T17:30:16.273047] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-04. [2025-10-02T17:30:16.334430] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-02T17:30:17.073066] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-03. [2025-10-02T17:30:17.352758] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-02T17:30:17.873054] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-01. [2025-10-02T17:30:18.672977] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-05. [2025-10-02T17:30:18.862994] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-02T17:30:18.893409] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-02T17:30:19.473014] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-04. [2025-10-02T17:30:19.578493] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-02T17:30:20.273036] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-06. [2025-10-02T17:30:21.072987] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-06. [2025-10-02T17:30:21.255400] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-02T17:30:21.562993] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-02T17:30:21.873052] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-07. [2025-10-02T17:30:22.460503] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-02T17:30:22.672979] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-02. [2025-10-02T17:30:23.160391] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-04 (3.69 seconds). [2025-10-02T17:30:23.473037] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-08. [2025-10-02T17:30:24.052862] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-02T17:30:24.065083] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-02T17:30:24.273031] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-03. [2025-10-02T17:30:25.072988] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-05. [2025-10-02T17:30:25.687506] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-02T17:30:25.873049] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-07. [2025-10-02T17:30:26.634170] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-02T17:30:26.672996] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-08. [2025-10-02T17:30:26.792696] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-02T17:30:27.473002] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-04. [2025-10-02T17:30:27.540105] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-02T17:30:28.273053] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-06. [2025-10-02T17:30:29.002009] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-02T17:30:29.073048] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-05. [2025-10-02T17:30:29.872991] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-09. [2025-10-02T17:30:29.904582] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-02T17:30:29.975565] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-02T17:30:30.673030] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-07. [2025-10-02T17:30:30.866617] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-02T17:30:31.473009] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-09. [2025-10-02T17:30:32.236624] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-02T17:30:32.273024] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-10. [2025-10-02T17:30:32.341011] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-02T17:30:32.819182] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-02T17:30:32.820186] [INFO ] [REMOTE ] BBUC: Full fetch complete (17976 records). [2025-10-02T17:30:32.820281] [DEBUG] [VALIDATOR ] BBUC: Validating primary data. [2025-10-02T17:30:32.821112] [FATAL] [VALIDATOR ] BBUC: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:30:32.821203] [FATAL] [MAIN ] BBUC: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:30:32.821247] [WARN ] [MAIN ] BBUC: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:30:32.821331] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-10-02T17:30:32.821415] [DEBUG] [LOCAL ] BBUC: No primary data file found to delete. [2025-10-02T17:30:32.821455] [INFO ] [LOCAL ] BBUC: Starting deletion of derivative data. [2025-10-02T17:30:32.821742] [DEBUG] [LOCAL ] BBUC: Deleted derivative data file. [2025-10-02T17:30:32.821869] [INFO ] [MAIN ] Update Progress: 225/2370 symbols completed. BBUC took 29.6s. Estimated remaining: 4h 50m 37s. Rate: 7.4 symbols/min [2025-10-02T17:30:33.034888] [INFO ] [MAIN ] BBWI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:30:33.073478] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-06. [2025-10-02T17:30:33.090989] [DEBUG] [LOCAL ] BBWI: Loaded 53580 existing records from primary storage. [2025-10-02T17:30:33.091329] [INFO ] [MAIN ] BBWI: Loaded 53580 existing records. [2025-10-02T17:30:33.323239] [WARN ] [MAIN ] BBWI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:30:33.323473] [INFO ] [MAIN ] BBWI: Wiping existing primary data before full refresh. [2025-10-02T17:30:33.323520] [INFO ] [LOCAL ] BBWI: Starting deletion of primary data. [2025-10-02T17:30:33.325057] [DEBUG] [LOCAL ] BBWI: Deleted primary data file. [2025-10-02T17:30:33.325118] [INFO ] [MAIN ] BBWI: Starting full primary refresh. [2025-10-02T17:30:33.712036] [INFO ] [REMOTE ] BBWI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:30:33.873028] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-08. [2025-10-02T17:30:34.220129] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-02T17:30:34.673038] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-07. [2025-10-02T17:30:35.473003] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-10. [2025-10-02T17:30:35.540316] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-02T17:30:35.873385] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-02T17:30:36.273048] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-09. [2025-10-02T17:30:36.400353] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-02T17:30:36.401229] [INFO ] [REMOTE ] BBU: Full fetch complete (6614 records). [2025-10-02T17:30:36.401326] [DEBUG] [VALIDATOR ] BBU: Validating primary data. [2025-10-02T17:30:36.401744] [FATAL] [VALIDATOR ] BBU: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:30:36.401866] [FATAL] [MAIN ] BBU: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:30:36.401911] [WARN ] [MAIN ] BBU: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:30:36.401953] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-10-02T17:30:36.402102] [DEBUG] [LOCAL ] BBU: No primary data file found to delete. [2025-10-02T17:30:36.402156] [INFO ] [LOCAL ] BBU: Starting deletion of derivative data. [2025-10-02T17:30:36.402471] [DEBUG] [LOCAL ] BBU: Deleted derivative data file. [2025-10-02T17:30:36.402578] [INFO ] [MAIN ] Update Progress: 226/2370 symbols completed. BBU took 33.8s. Estimated remaining: 4h 49m 45s. Rate: 7.4 symbols/min [2025-10-02T17:30:36.584186] [INFO ] [MAIN ] BBY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:30:36.651145] [DEBUG] [LOCAL ] BBY: Loaded 53466 existing records from primary storage. [2025-10-02T17:30:36.651547] [INFO ] [MAIN ] BBY: Loaded 53466 existing records. [2025-10-02T17:30:36.842875] [WARN ] [MAIN ] BBY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:30:36.843106] [INFO ] [MAIN ] BBY: Wiping existing primary data before full refresh. [2025-10-02T17:30:36.843156] [INFO ] [LOCAL ] BBY: Starting deletion of primary data. [2025-10-02T17:30:36.844895] [DEBUG] [LOCAL ] BBY: Deleted primary data file. [2025-10-02T17:30:36.844963] [INFO ] [MAIN ] BBY: Starting full primary refresh. [2025-10-02T17:30:37.078146] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2024-12. [2025-10-02T17:30:37.236318] [INFO ] [REMOTE ] BBY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:30:37.873027] [INFO ] [REMOTE ] BBY: Fetching primary data for 2024-12. [2025-10-02T17:30:38.088090] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-02T17:30:38.318141] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-02T17:30:38.673057] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-08. [2025-10-02T17:30:39.473020] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-01. [2025-10-02T17:30:39.807601] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-02T17:30:39.856372] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-02T17:30:40.273009] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-09. [2025-10-02T17:30:41.072971] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-10. [2025-10-02T17:30:41.374820] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-02T17:30:41.444621] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-02T17:30:41.873028] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-01. [2025-10-02T17:30:42.376199] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-02T17:30:42.378250] [INFO ] [REMOTE ] BBVA: Full fetch complete (71606 records). [2025-10-02T17:30:42.378381] [DEBUG] [VALIDATOR ] BBVA: Validating primary data. [2025-10-02T17:30:42.679453] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-02. [2025-10-02T17:30:42.817104] [DEBUG] [VALIDATOR ] BBVA: All expected trading days are present. [2025-10-02T17:30:42.817208] [DEBUG] [VALIDATOR ] BBVA: Primary data validation passed. [2025-10-02T17:30:42.818199] [INFO ] [MAIN ] BBVA: Fetched primary data is valid. [2025-10-02T17:30:42.818287] [DEBUG] [LOCAL ] BBVA: Saving primary data. [2025-10-02T17:30:42.820172] [DEBUG] [LOCAL ] BBVA: Trimmed 71606 records to 49642 (keeping 200 days of data) [2025-10-02T17:30:43.147074] [DEBUG] [LOCAL ] BBVA: Primary data saved (49642 records). [2025-10-02T17:30:43.147235] [INFO ] [MAIN ] BBVA: Full history saved. [2025-10-02T17:30:43.147328] [INFO ] [MAIN ] Update Progress: 227/2370 symbols completed. BBVA took 39.5s. Estimated remaining: 4h 49m 24s. Rate: 7.4 symbols/min [2025-10-02T17:30:43.339993] [INFO ] [MAIN ] BC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:30:43.341437] [DEBUG] [LOCAL ] BC: No existing data file found in primary storage. [2025-10-02T17:30:43.341495] [WARN ] [MAIN ] BC: No existing data found, performing full refresh instead. [2025-10-02T17:30:43.341718] [INFO ] [MAIN ] BC: Wiping existing primary data before full refresh. [2025-10-02T17:30:43.341775] [INFO ] [LOCAL ] BC: Starting deletion of primary data. [2025-10-02T17:30:43.341820] [DEBUG] [LOCAL ] BC: No primary data file found to delete. [2025-10-02T17:30:43.341863] [INFO ] [MAIN ] BC: Starting full primary refresh. [2025-10-02T17:30:43.485928] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-10. [2025-10-02T17:30:43.548418] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-02T17:30:43.799627] [INFO ] [REMOTE ] BC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:30:44.278108] [INFO ] [REMOTE ] BC: Fetching primary data for 2024-12. [2025-10-02T17:30:44.294902] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-02T17:30:45.000855] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-02T17:30:45.002361] [INFO ] [REMOTE ] BBW: Full fetch complete (39188 records). [2025-10-02T17:30:45.002440] [DEBUG] [VALIDATOR ] BBW: Validating primary data. [2025-10-02T17:30:45.078134] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-03. [2025-10-02T17:30:45.421322] [DEBUG] [VALIDATOR ] BBW: All expected trading days are present. [2025-10-02T17:30:45.421459] [DEBUG] [VALIDATOR ] BBW: Primary data validation passed. [2025-10-02T17:30:45.421974] [INFO ] [MAIN ] BBW: Fetched primary data is valid. [2025-10-02T17:30:45.422037] [DEBUG] [LOCAL ] BBW: Saving primary data. [2025-10-02T17:30:45.423015] [DEBUG] [LOCAL ] BBW: Trimmed 39188 records to 26905 (keeping 200 days of data) [2025-10-02T17:30:45.614847] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-02T17:30:45.635848] [DEBUG] [LOCAL ] BBW: Primary data saved (26905 records). [2025-10-02T17:30:45.635958] [INFO ] [MAIN ] BBW: Full history saved. [2025-10-02T17:30:45.636034] [INFO ] [MAIN ] Update Progress: 228/2370 symbols completed. BBW took 36.3s. Estimated remaining: 4h 48m 23s. Rate: 7.4 symbols/min [2025-10-02T17:30:45.836370] [INFO ] [MAIN ] BCAT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:30:45.875884] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-02. [2025-10-02T17:30:45.877712] [DEBUG] [LOCAL ] BCAT: Loaded 34251 existing records from primary storage. [2025-10-02T17:30:45.877968] [INFO ] [MAIN ] BCAT: Loaded 34251 existing records. [2025-10-02T17:30:46.087670] [WARN ] [MAIN ] BCAT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:30:46.087908] [INFO ] [MAIN ] BCAT: Wiping existing primary data before full refresh. [2025-10-02T17:30:46.087962] [INFO ] [LOCAL ] BCAT: Starting deletion of primary data. [2025-10-02T17:30:46.089104] [DEBUG] [LOCAL ] BCAT: Deleted primary data file. [2025-10-02T17:30:46.089194] [INFO ] [MAIN ] BCAT: Starting full primary refresh. [2025-10-02T17:30:46.489936] [INFO ] [REMOTE ] BCAT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:30:46.672969] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2024-12. [2025-10-02T17:30:47.000288] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-02T17:30:47.472986] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-04. [2025-10-02T17:30:47.862516] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-02T17:30:47.902301] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-02T17:30:48.273005] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-01. [2025-10-02T17:30:49.073047] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-03. [2025-10-02T17:30:49.603934] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-02T17:30:49.645329] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-02T17:30:49.873057] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-02. [2025-10-02T17:30:50.673006] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-01. [2025-10-02T17:30:50.892505] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-02T17:30:51.130384] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-02T17:30:51.473051] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-04. [2025-10-02T17:30:52.267815] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-02T17:30:52.276796] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-05. [2025-10-02T17:30:53.079680] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-02. [2025-10-02T17:30:53.086501] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-02T17:30:53.873001] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-05. [2025-10-02T17:30:54.026898] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-02T17:30:54.193742] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-02T17:30:54.673039] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-03. [2025-10-02T17:30:55.473026] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-03. [2025-10-02T17:30:56.213833] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-10-02T17:30:56.273003] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-06. [2025-10-02T17:30:56.434024] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-02T17:30:57.072985] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-04. [2025-10-02T17:30:57.189298] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-02T17:30:57.569726] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-02T17:30:57.873005] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-07. [2025-10-02T17:30:58.673039] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-06. [2025-10-02T17:30:58.704913] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-02T17:30:59.472972] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-05. [2025-10-02T17:30:59.713127] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-02T17:31:00.272994] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-04. [2025-10-02T17:31:00.396729] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-02T17:31:00.724997] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-02T17:31:01.072995] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-08. [2025-10-02T17:31:01.873015] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-06. [2025-10-02T17:31:01.916186] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-02T17:31:02.672996] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-05. [2025-10-02T17:31:03.134022] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-02T17:31:03.284969] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-02T17:31:03.473015] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-07. [2025-10-02T17:31:03.928276] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-02T17:31:04.272998] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-07. [2025-10-02T17:31:05.072962] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-09. [2025-10-02T17:31:05.337091] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-02T17:31:05.431490] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-02T17:31:05.873000] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-08. [2025-10-02T17:31:06.673016] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-06. [2025-10-02T17:31:06.775215] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-02T17:31:07.472998] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-10. [2025-10-02T17:31:07.702915] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-02T17:31:08.272995] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-08. [2025-10-02T17:31:08.302569] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-02T17:31:09.034853] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-02T17:31:09.037194] [INFO ] [REMOTE ] BBY: Full fetch complete (77238 records). [2025-10-02T17:31:09.037362] [DEBUG] [VALIDATOR ] BBY: Validating primary data. [2025-10-02T17:31:09.078149] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-09. [2025-10-02T17:31:09.719411] [DEBUG] [VALIDATOR ] BBY: All expected trading days are present. [2025-10-02T17:31:09.719588] [DEBUG] [VALIDATOR ] BBY: Primary data validation passed. [2025-10-02T17:31:09.720983] [INFO ] [MAIN ] BBY: Fetched primary data is valid. [2025-10-02T17:31:09.721094] [DEBUG] [LOCAL ] BBY: Saving primary data. [2025-10-02T17:31:09.723356] [DEBUG] [LOCAL ] BBY: Trimmed 77238 records to 53854 (keeping 200 days of data) [2025-10-02T17:31:09.877463] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-07. [2025-10-02T17:31:09.949851] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-02T17:31:10.216140] [DEBUG] [LOCAL ] BBY: Primary data saved (53854 records). [2025-10-02T17:31:10.216318] [INFO ] [MAIN ] BBY: Full history saved. [2025-10-02T17:31:10.216424] [INFO ] [MAIN ] Update Progress: 229/2370 symbols completed. BBY took 33.8s. Estimated remaining: 4h 50m 50s. Rate: 7.4 symbols/min [2025-10-02T17:31:10.432340] [INFO ] [MAIN ] BCC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:31:10.461537] [DEBUG] [LOCAL ] BCC: Loaded 28212 existing records from primary storage. [2025-10-02T17:31:10.461854] [INFO ] [MAIN ] BCC: Loaded 28212 existing records. [2025-10-02T17:31:10.665171] [WARN ] [MAIN ] BCC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:31:10.665429] [INFO ] [MAIN ] BCC: Wiping existing primary data before full refresh. [2025-10-02T17:31:10.665484] [INFO ] [LOCAL ] BCC: Starting deletion of primary data. [2025-10-02T17:31:10.666580] [DEBUG] [LOCAL ] BCC: Deleted primary data file. [2025-10-02T17:31:10.666676] [INFO ] [MAIN ] BCC: Starting full primary refresh. [2025-10-02T17:31:10.702511] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-09. [2025-10-02T17:31:11.057534] [INFO ] [REMOTE ] BCC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:31:11.473004] [INFO ] [REMOTE ] BCC: Fetching primary data for 2024-12. [2025-10-02T17:31:11.613236] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-02T17:31:11.691997] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-09 (2.61 seconds). [2025-10-02T17:31:11.832199] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-02T17:31:12.273029] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-08. [2025-10-02T17:31:12.377068] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-02T17:31:13.073066] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-01. [2025-10-02T17:31:13.608547] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-02T17:31:13.873012] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-10. [2025-10-02T17:31:14.073688] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-02T17:31:14.673044] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-02. [2025-10-02T17:31:15.473011] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-09. [2025-10-02T17:31:15.556881] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-02T17:31:15.560146] [INFO ] [REMOTE ] BBWI: Full fetch complete (77427 records). [2025-10-02T17:31:15.560339] [DEBUG] [VALIDATOR ] BBWI: Validating primary data. [2025-10-02T17:31:16.064590] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-02T17:31:16.095388] [DEBUG] [VALIDATOR ] BBWI: All expected trading days are present. [2025-10-02T17:31:16.095884] [DEBUG] [VALIDATOR ] BBWI: Primary data validation passed. [2025-10-02T17:31:16.096860] [INFO ] [MAIN ] BBWI: Fetched primary data is valid. [2025-10-02T17:31:16.096994] [DEBUG] [LOCAL ] BBWI: Saving primary data. [2025-10-02T17:31:16.098609] [DEBUG] [LOCAL ] BBWI: Trimmed 77427 records to 53970 (keeping 200 days of data) [2025-10-02T17:31:16.293430] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-10. [2025-10-02T17:31:16.464128] [DEBUG] [LOCAL ] BBWI: Primary data saved (53970 records). [2025-10-02T17:31:16.464281] [INFO ] [MAIN ] BBWI: Full history saved. [2025-10-02T17:31:16.464372] [INFO ] [MAIN ] Update Progress: 230/2370 symbols completed. BBWI took 43.6s. Estimated remaining: 4h 50m 24s. Rate: 7.4 symbols/min [2025-10-02T17:31:16.674521] [INFO ] [MAIN ] BCE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:31:16.730148] [DEBUG] [LOCAL ] BCE: Loaded 52287 existing records from primary storage. [2025-10-02T17:31:16.730524] [INFO ] [MAIN ] BCE: Loaded 52287 existing records. [2025-10-02T17:31:16.942285] [WARN ] [MAIN ] BCE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:31:16.942567] [INFO ] [MAIN ] BCE: Wiping existing primary data before full refresh. [2025-10-02T17:31:16.942623] [INFO ] [LOCAL ] BCE: Starting deletion of primary data. [2025-10-02T17:31:16.944691] [DEBUG] [LOCAL ] BCE: Deleted primary data file. [2025-10-02T17:31:16.944756] [INFO ] [MAIN ] BCE: Starting full primary refresh. [2025-10-02T17:31:17.084684] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-03. [2025-10-02T17:31:17.333454] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-02T17:31:17.415061] [INFO ] [REMOTE ] BCE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:31:17.418590] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-02T17:31:17.419943] [INFO ] [REMOTE ] BCAT: Full fetch complete (49901 records). [2025-10-02T17:31:17.420040] [DEBUG] [VALIDATOR ] BCAT: Validating primary data. [2025-10-02T17:31:17.420732] [FATAL] [VALIDATOR ] BCAT: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:31:17.420824] [FATAL] [MAIN ] BCAT: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:31:17.420870] [WARN ] [MAIN ] BCAT: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:31:17.420912] [INFO ] [LOCAL ] BCAT: Starting deletion of primary data. [2025-10-02T17:31:17.420969] [DEBUG] [LOCAL ] BCAT: No primary data file found to delete. [2025-10-02T17:31:17.421004] [INFO ] [LOCAL ] BCAT: Starting deletion of derivative data. [2025-10-02T17:31:17.421375] [DEBUG] [LOCAL ] BCAT: Deleted derivative data file. [2025-10-02T17:31:17.421508] [INFO ] [MAIN ] Update Progress: 231/2370 symbols completed. BCAT took 31.8s. Estimated remaining: 4h 49m 9s. Rate: 7.4 symbols/min [2025-10-02T17:31:17.629343] [INFO ] [MAIN ] BCH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:31:17.660103] [DEBUG] [LOCAL ] BCH: Loaded 29569 existing records from primary storage. [2025-10-02T17:31:17.660389] [INFO ] [MAIN ] BCH: Loaded 29569 existing records. [2025-10-02T17:31:17.861469] [WARN ] [MAIN ] BCH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:31:17.861715] [INFO ] [MAIN ] BCH: Wiping existing primary data before full refresh. [2025-10-02T17:31:17.861803] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-10-02T17:31:17.862723] [DEBUG] [LOCAL ] BCH: Deleted primary data file. [2025-10-02T17:31:17.862784] [INFO ] [MAIN ] BCH: Starting full primary refresh. [2025-10-02T17:31:17.878157] [INFO ] [REMOTE ] BCE: Fetching primary data for 2024-12. [2025-10-02T17:31:18.306626] [INFO ] [REMOTE ] BCH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:31:18.538899] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-02T17:31:18.673069] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-04. [2025-10-02T17:31:19.472963] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-10. [2025-10-02T17:31:19.729556] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-02T17:31:20.059364] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-02T17:31:20.273009] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-05. [2025-10-02T17:31:21.054570] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-02T17:31:21.056841] [INFO ] [REMOTE ] BC: Full fetch complete (63761 records). [2025-10-02T17:31:21.057188] [DEBUG] [VALIDATOR ] BC: Validating primary data. [2025-10-02T17:31:21.081332] [INFO ] [REMOTE ] BCH: Fetching primary data for 2024-12. [2025-10-02T17:31:21.523914] [DEBUG] [VALIDATOR ] BC: All expected trading days are present. [2025-10-02T17:31:21.524033] [DEBUG] [VALIDATOR ] BC: Primary data validation passed. [2025-10-02T17:31:21.524967] [INFO ] [MAIN ] BC: Fetched primary data is valid. [2025-10-02T17:31:21.525232] [DEBUG] [LOCAL ] BC: Saving primary data. [2025-10-02T17:31:21.546867] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-02T17:31:21.554511] [DEBUG] [LOCAL ] BC: Trimmed 63761 records to 44455 (keeping 200 days of data) [2025-10-02T17:31:21.848117] [DEBUG] [LOCAL ] BC: Primary data saved (44455 records). [2025-10-02T17:31:21.848255] [INFO ] [MAIN ] BC: Full history saved. [2025-10-02T17:31:21.848331] [INFO ] [MAIN ] Update Progress: 232/2370 symbols completed. BC took 38.7s. Estimated remaining: 4h 48m 27s. Rate: 7.4 symbols/min [2025-10-02T17:31:21.883631] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-01. [2025-10-02T17:31:22.045046] [INFO ] [MAIN ] BCO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:31:22.072256] [DEBUG] [LOCAL ] BCO: Loaded 26080 existing records from primary storage. [2025-10-02T17:31:22.072559] [INFO ] [MAIN ] BCO: Loaded 26080 existing records. [2025-10-02T17:31:22.271722] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-02T17:31:22.295116] [WARN ] [MAIN ] BCO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:31:22.301794] [INFO ] [MAIN ] BCO: Wiping existing primary data before full refresh. [2025-10-02T17:31:22.301885] [INFO ] [LOCAL ] BCO: Starting deletion of primary data. [2025-10-02T17:31:22.303086] [DEBUG] [LOCAL ] BCO: Deleted primary data file. [2025-10-02T17:31:22.303149] [INFO ] [MAIN ] BCO: Starting full primary refresh. [2025-10-02T17:31:22.683016] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-01. [2025-10-02T17:31:22.736481] [INFO ] [REMOTE ] BCO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:31:23.460047] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-02T17:31:23.472969] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-02. [2025-10-02T17:31:23.844867] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-02T17:31:24.273240] [INFO ] [REMOTE ] BCO: Fetching primary data for 2024-12. [2025-10-02T17:31:25.073040] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-02. [2025-10-02T17:31:25.245693] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-02T17:31:25.762818] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-02T17:31:25.872974] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-01. [2025-10-02T17:31:26.093153] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-02T17:31:26.672997] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-03. [2025-10-02T17:31:27.068788] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-02T17:31:27.473005] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-06. [2025-10-02T17:31:28.290792] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-02. [2025-10-02T17:31:28.294586] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-02T17:31:28.686807] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-02T17:31:29.072986] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-04. [2025-10-02T17:31:29.393263] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-02T17:31:29.873011] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-07. [2025-10-02T17:31:30.673011] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-03. [2025-10-02T17:31:31.044426] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-02T17:31:31.389846] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-02T17:31:31.473060] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-05. [2025-10-02T17:31:31.763547] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-02T17:31:32.273021] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-04. [2025-10-02T17:31:33.072976] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-03. [2025-10-02T17:31:33.352407] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-02T17:31:33.742379] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-02T17:31:33.873017] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-06. [2025-10-02T17:31:34.443752] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-02T17:31:34.673004] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-04. [2025-10-02T17:31:35.206348] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-02T17:31:35.473015] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-08. [2025-10-02T17:31:36.021501] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-02T17:31:36.273019] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-07. [2025-10-02T17:31:36.524383] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-02T17:31:37.073039] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-05. [2025-10-02T17:31:37.873010] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-05. [2025-10-02T17:31:38.066717] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-02T17:31:38.350117] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-02T17:31:38.673009] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-09. [2025-10-02T17:31:39.209818] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-02T17:31:39.473000] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-08. [2025-10-02T17:31:40.024550] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-02T17:31:40.273039] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-10. [2025-10-02T17:31:41.041316] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-02T17:31:41.073004] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-09. [2025-10-02T17:31:41.305771] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-02T17:31:41.307745] [INFO ] [REMOTE ] BCC: Full fetch complete (40617 records). [2025-10-02T17:31:41.307840] [DEBUG] [VALIDATOR ] BCC: Validating primary data. [2025-10-02T17:31:41.753301] [DEBUG] [VALIDATOR ] BCC: All expected trading days are present. [2025-10-02T17:31:41.753393] [DEBUG] [VALIDATOR ] BCC: Primary data validation passed. [2025-10-02T17:31:41.753916] [INFO ] [MAIN ] BCC: Fetched primary data is valid. [2025-10-02T17:31:41.753982] [DEBUG] [LOCAL ] BCC: Saving primary data. [2025-10-02T17:31:41.755164] [DEBUG] [LOCAL ] BCC: Trimmed 40617 records to 28408 (keeping 200 days of data) [2025-10-02T17:31:41.873778] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-06. [2025-10-02T17:31:41.948472] [DEBUG] [LOCAL ] BCC: Primary data saved (28408 records). [2025-10-02T17:31:41.948620] [INFO ] [MAIN ] BCC: Full history saved. [2025-10-02T17:31:41.948749] [INFO ] [MAIN ] Update Progress: 233/2370 symbols completed. BCC took 31.7s. Estimated remaining: 4h 50m 9s. Rate: 7.4 symbols/min [2025-10-02T17:31:42.142103] [INFO ] [MAIN ] BCS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:31:42.142296] [DEBUG] [LOCAL ] BCS: No existing data file found in primary storage. [2025-10-02T17:31:42.142336] [WARN ] [MAIN ] BCS: No existing data found, performing full refresh instead. [2025-10-02T17:31:42.142457] [INFO ] [MAIN ] BCS: Wiping existing primary data before full refresh. [2025-10-02T17:31:42.142500] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-10-02T17:31:42.142543] [DEBUG] [LOCAL ] BCS: No primary data file found to delete. [2025-10-02T17:31:42.142577] [INFO ] [MAIN ] BCS: Starting full primary refresh. [2025-10-02T17:31:42.582380] [INFO ] [REMOTE ] BCS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:31:42.624537] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-02T17:31:42.672995] [INFO ] [REMOTE ] BCS: Fetching primary data for 2024-12. [2025-10-02T17:31:43.131285] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-02T17:31:43.473025] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-10. [2025-10-02T17:31:44.272976] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-07. [2025-10-02T17:31:44.659298] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-02T17:31:45.072996] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-01. [2025-10-02T17:31:45.092888] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-02T17:31:45.095004] [INFO ] [REMOTE ] BCE: Full fetch complete (76031 records). [2025-10-02T17:31:45.095119] [DEBUG] [VALIDATOR ] BCE: Validating primary data. [2025-10-02T17:31:45.493437] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-02T17:31:45.578556] [DEBUG] [VALIDATOR ] BCE: All expected trading days are present. [2025-10-02T17:31:45.578739] [DEBUG] [VALIDATOR ] BCE: Primary data validation passed. [2025-10-02T17:31:45.579594] [INFO ] [MAIN ] BCE: Fetched primary data is valid. [2025-10-02T17:31:45.579667] [DEBUG] [LOCAL ] BCE: Saving primary data. [2025-10-02T17:31:45.581333] [DEBUG] [LOCAL ] BCE: Trimmed 76031 records to 52641 (keeping 200 days of data) [2025-10-02T17:31:45.888857] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-06. [2025-10-02T17:31:45.941495] [DEBUG] [LOCAL ] BCE: Primary data saved (52641 records). [2025-10-02T17:31:45.941669] [INFO ] [MAIN ] BCE: Full history saved. [2025-10-02T17:31:45.941776] [INFO ] [MAIN ] Update Progress: 234/2370 symbols completed. BCE took 29.5s. Estimated remaining: 4h 49m 23s. Rate: 7.4 symbols/min [2025-10-02T17:31:46.133386] [INFO ] [MAIN ] BCSF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:31:46.165291] [DEBUG] [LOCAL ] BCSF: Loaded 27746 existing records from primary storage. [2025-10-02T17:31:46.165576] [INFO ] [MAIN ] BCSF: Loaded 27746 existing records. [2025-10-02T17:31:46.371809] [WARN ] [MAIN ] BCSF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:31:46.372096] [INFO ] [MAIN ] BCSF: Wiping existing primary data before full refresh. [2025-10-02T17:31:46.372169] [INFO ] [LOCAL ] BCSF: Starting deletion of primary data. [2025-10-02T17:31:46.373251] [DEBUG] [LOCAL ] BCSF: Deleted primary data file. [2025-10-02T17:31:46.373349] [INFO ] [MAIN ] BCSF: Starting full primary refresh. [2025-10-02T17:31:46.681980] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-08. [2025-10-02T17:31:46.839205] [INFO ] [REMOTE ] BCSF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:31:47.201766] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-02T17:31:47.363242] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-02T17:31:47.473048] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-02. [2025-10-02T17:31:47.690479] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-02T17:31:48.273007] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-07. [2025-10-02T17:31:49.073077] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2024-12. [2025-10-02T17:31:49.260143] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-02T17:31:49.590751] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-02T17:31:49.873002] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-03. [2025-10-02T17:31:50.039205] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-02T17:31:50.673031] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-09. [2025-10-02T17:31:51.473066] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-08. [2025-10-02T17:31:51.629910] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-02T17:31:51.860297] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-02T17:31:52.272983] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-04. [2025-10-02T17:31:52.384178] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-02T17:31:53.073011] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-09. [2025-10-02T17:31:53.872996] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-10. [2025-10-02T17:31:54.228298] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-02T17:31:54.323498] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-02T17:31:54.653163] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-02T17:31:54.654664] [INFO ] [REMOTE ] BCO: Full fetch complete (36710 records). [2025-10-02T17:31:54.654816] [DEBUG] [VALIDATOR ] BCO: Validating primary data. [2025-10-02T17:31:54.678324] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-10. [2025-10-02T17:31:55.090819] [DEBUG] [VALIDATOR ] BCO: All expected trading days are present. [2025-10-02T17:31:55.090920] [DEBUG] [VALIDATOR ] BCO: Primary data validation passed. [2025-10-02T17:31:55.091413] [INFO ] [MAIN ] BCO: Fetched primary data is valid. [2025-10-02T17:31:55.091459] [DEBUG] [LOCAL ] BCO: Saving primary data. [2025-10-02T17:31:55.092514] [DEBUG] [LOCAL ] BCO: Trimmed 36710 records to 26183 (keeping 200 days of data) [2025-10-02T17:31:55.276600] [DEBUG] [LOCAL ] BCO: Primary data saved (26183 records). [2025-10-02T17:31:55.276775] [INFO ] [MAIN ] BCO: Full history saved. [2025-10-02T17:31:55.276882] [INFO ] [MAIN ] Update Progress: 235/2370 symbols completed. BCO took 33.4s. Estimated remaining: 4h 49m 26s. Rate: 7.4 symbols/min [2025-10-02T17:31:55.469479] [INFO ] [MAIN ] BCX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:31:55.473056] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-05. [2025-10-02T17:31:55.495079] [DEBUG] [LOCAL ] BCX: Loaded 21685 existing records from primary storage. [2025-10-02T17:31:55.495370] [INFO ] [MAIN ] BCX: Loaded 21685 existing records. [2025-10-02T17:31:55.699974] [WARN ] [MAIN ] BCX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:31:55.700262] [INFO ] [MAIN ] BCX: Wiping existing primary data before full refresh. [2025-10-02T17:31:55.700328] [INFO ] [LOCAL ] BCX: Starting deletion of primary data. [2025-10-02T17:31:55.701105] [DEBUG] [LOCAL ] BCX: Deleted primary data file. [2025-10-02T17:31:55.701170] [INFO ] [MAIN ] BCX: Starting full primary refresh. [2025-10-02T17:31:55.918546] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-02T17:31:56.008840] [INFO ] [REMOTE ] BCH: Full fetch complete (40937 records). [2025-10-02T17:31:56.028225] [DEBUG] [VALIDATOR ] BCH: Validating primary data. [2025-10-02T17:31:56.268389] [INFO ] [REMOTE ] BCX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:31:56.273973] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-01. [2025-10-02T17:31:56.593106] [DEBUG] [VALIDATOR ] BCH: All expected trading days are present. [2025-10-02T17:31:56.593196] [DEBUG] [VALIDATOR ] BCH: Primary data validation passed. [2025-10-02T17:31:56.593729] [INFO ] [MAIN ] BCH: Fetched primary data is valid. [2025-10-02T17:31:56.593794] [DEBUG] [LOCAL ] BCH: Saving primary data. [2025-10-02T17:31:56.595049] [DEBUG] [LOCAL ] BCH: Trimmed 40937 records to 29843 (keeping 200 days of data) [2025-10-02T17:31:56.782495] [DEBUG] [LOCAL ] BCH: Primary data saved (29843 records). [2025-10-02T17:31:56.782638] [INFO ] [MAIN ] BCH: Full history saved. [2025-10-02T17:31:56.782782] [INFO ] [MAIN ] Update Progress: 236/2370 symbols completed. BCH took 39.4s. Estimated remaining: 4h 48m 18s. Rate: 7.4 symbols/min [2025-10-02T17:31:56.972037] [INFO ] [MAIN ] BDC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:31:56.998059] [DEBUG] [LOCAL ] BDC: Loaded 24616 existing records from primary storage. [2025-10-02T17:31:56.998365] [INFO ] [MAIN ] BDC: Loaded 24616 existing records. [2025-10-02T17:31:57.074481] [INFO ] [REMOTE ] BCX: Fetching primary data for 2024-12. [2025-10-02T17:31:57.202988] [WARN ] [MAIN ] BDC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:31:57.215339] [INFO ] [MAIN ] BDC: Wiping existing primary data before full refresh. [2025-10-02T17:31:57.215496] [INFO ] [LOCAL ] BDC: Starting deletion of primary data. [2025-10-02T17:31:57.216598] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-02T17:31:57.222102] [DEBUG] [LOCAL ] BDC: Deleted primary data file. [2025-10-02T17:31:57.222192] [INFO ] [MAIN ] BDC: Starting full primary refresh. [2025-10-02T17:31:57.674255] [INFO ] [REMOTE ] BDC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:31:57.695862] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-10-02T17:31:57.873005] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-06. [2025-10-02T17:31:58.352472] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-02T17:31:58.672996] [INFO ] [REMOTE ] BDC: Fetching primary data for 2024-12. [2025-10-02T17:31:59.473170] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-01. [2025-10-02T17:31:59.755691] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-02T17:31:59.900950] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-02T17:32:00.273001] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-07. [2025-10-02T17:32:00.947173] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-02T17:32:01.073010] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-02. [2025-10-02T17:32:01.872974] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-01. [2025-10-02T17:32:02.315525] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-02T17:32:02.357769] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-02T17:32:02.673003] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-02. [2025-10-02T17:32:03.101756] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-02T17:32:03.473013] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-03. [2025-10-02T17:32:04.272998] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-08. [2025-10-02T17:32:04.547797] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-02T17:32:04.922089] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-10-02T17:32:05.072991] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-04. [2025-10-02T17:32:05.760719] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-02T17:32:05.873014] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-03. [2025-10-02T17:32:06.350289] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-02T17:32:06.672996] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-05. [2025-10-02T17:32:07.269077] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-02T17:32:07.472994] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-09. [2025-10-02T17:32:07.775710] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-02T17:32:08.273107] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-06. [2025-10-02T17:32:09.072970] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-02. [2025-10-02T17:32:09.497408] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-02T17:32:09.539619] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-02T17:32:09.873037] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-04. [2025-10-02T17:32:10.553784] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-02T17:32:10.673034] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-03. [2025-10-02T17:32:11.275535] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-02T17:32:11.473056] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-07. [2025-10-02T17:32:11.531135] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-02T17:32:12.273050] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-10. [2025-10-02T17:32:12.746405] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-02T17:32:13.073002] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-05. [2025-10-02T17:32:13.872969] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-04. [2025-10-02T17:32:14.078682] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-02T17:32:14.081614] [INFO ] [REMOTE ] BCS: Full fetch complete (77319 records). [2025-10-02T17:32:14.081807] [DEBUG] [VALIDATOR ] BCS: Validating primary data. [2025-10-02T17:32:14.547294] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-02T17:32:14.547495] [DEBUG] [VALIDATOR ] BCS: All expected trading days are present. [2025-10-02T17:32:14.553170] [DEBUG] [VALIDATOR ] BCS: Primary data validation passed. [2025-10-02T17:32:14.554560] [INFO ] [MAIN ] BCS: Fetched primary data is valid. [2025-10-02T17:32:14.554979] [DEBUG] [LOCAL ] BCS: Saving primary data. [2025-10-02T17:32:14.556476] [DEBUG] [LOCAL ] BCS: Trimmed 77319 records to 53841 (keeping 200 days of data) [2025-10-02T17:32:14.672964] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-08. [2025-10-02T17:32:14.901340] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-02T17:32:14.934304] [DEBUG] [LOCAL ] BCS: Primary data saved (53841 records). [2025-10-02T17:32:14.934449] [INFO ] [MAIN ] BCS: Full history saved. [2025-10-02T17:32:14.934525] [INFO ] [MAIN ] Update Progress: 237/2370 symbols completed. BCS took 33.0s. Estimated remaining: 4h 49m 40s. Rate: 7.4 symbols/min [2025-10-02T17:32:15.473049] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-05. [2025-10-02T17:32:15.776030] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-02T17:32:16.273009] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-06. [2025-10-02T17:32:16.629893] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-02T17:32:17.073016] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-09. [2025-10-02T17:32:17.651749] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-02T17:32:17.872995] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-06. [2025-10-02T17:32:18.223316] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-02T17:32:18.673022] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-10. [2025-10-02T17:32:18.938340] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-02T17:32:19.473078] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-07. [2025-10-02T17:32:19.495382] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-02T17:32:19.497394] [INFO ] [REMOTE ] BCX: Full fetch complete (34089 records). [2025-10-02T17:32:19.497550] [DEBUG] [VALIDATOR ] BCX: Validating primary data. [2025-10-02T17:32:20.136871] [DEBUG] [VALIDATOR ] BCX: All expected trading days are present. [2025-10-02T17:32:20.136966] [DEBUG] [VALIDATOR ] BCX: Primary data validation passed. [2025-10-02T17:32:20.137503] [INFO ] [MAIN ] BCX: Fetched primary data is valid. [2025-10-02T17:32:20.137600] [DEBUG] [LOCAL ] BCX: Saving primary data. [2025-10-02T17:32:20.139624] [DEBUG] [LOCAL ] BCX: Trimmed 34089 records to 21876 (keeping 200 days of data) [2025-10-02T17:32:20.277759] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-07. [2025-10-02T17:32:20.286921] [DEBUG] [LOCAL ] BCX: Primary data saved (21876 records). [2025-10-02T17:32:20.287080] [INFO ] [MAIN ] BCX: Full history saved. [2025-10-02T17:32:20.287207] [INFO ] [MAIN ] Update Progress: 238/2370 symbols completed. BCX took 25.0s. Estimated remaining: 4h 49m 7s. Rate: 7.4 symbols/min [2025-10-02T17:32:20.644537] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-02T17:32:21.073059] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-08. [2025-10-02T17:32:21.234081] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-02T17:32:21.872975] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-08. [2025-10-02T17:32:22.273083] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-02T17:32:22.673083] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-09. [2025-10-02T17:32:22.934013] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-02T17:32:23.472977] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-09. [2025-10-02T17:32:23.745036] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-02T17:32:24.273148] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-10. [2025-10-02T17:32:24.643156] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-02T17:32:25.073078] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-10. [2025-10-02T17:32:25.534841] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-02T17:32:25.536695] [INFO ] [REMOTE ] BCSF: Full fetch complete (38481 records). [2025-10-02T17:32:25.536785] [DEBUG] [VALIDATOR ] BCSF: Validating primary data. [2025-10-02T17:32:25.948217] [DEBUG] [VALIDATOR ] BCSF: All expected trading days are present. [2025-10-02T17:32:25.948336] [DEBUG] [VALIDATOR ] BCSF: Primary data validation passed. [2025-10-02T17:32:25.949315] [INFO ] [MAIN ] BCSF: Fetched primary data is valid. [2025-10-02T17:32:25.949383] [DEBUG] [LOCAL ] BCSF: Saving primary data. [2025-10-02T17:32:25.956410] [DEBUG] [LOCAL ] BCSF: Trimmed 38481 records to 27982 (keeping 200 days of data) [2025-10-02T17:32:25.956638] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-02T17:32:25.959949] [INFO ] [REMOTE ] BDC: Full fetch complete (35732 records). [2025-10-02T17:32:25.960111] [DEBUG] [VALIDATOR ] BDC: Validating primary data. [2025-10-02T17:32:25.960889] [FATAL] [VALIDATOR ] BDC: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:32:25.961009] [FATAL] [MAIN ] BDC: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:32:25.961055] [WARN ] [MAIN ] BDC: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:32:25.961111] [INFO ] [LOCAL ] BDC: Starting deletion of primary data. [2025-10-02T17:32:25.961227] [DEBUG] [LOCAL ] BDC: No primary data file found to delete. [2025-10-02T17:32:25.961295] [INFO ] [LOCAL ] BDC: Starting deletion of derivative data. [2025-10-02T17:32:25.961770] [DEBUG] [LOCAL ] BDC: Deleted derivative data file. [2025-10-02T17:32:25.961891] [INFO ] [MAIN ] Update Progress: 239/2370 symbols completed. BDC took 29.2s. Estimated remaining: 4h 48m 37s. Rate: 7.4 symbols/min [2025-10-02T17:32:26.161068] [DEBUG] [LOCAL ] BCSF: Primary data saved (27982 records). [2025-10-02T17:32:26.161328] [INFO ] [MAIN ] BCSF: Full history saved. [2025-10-02T17:32:26.161460] [INFO ] [MAIN ] Update Progress: 240/2370 symbols completed. BCSF took 40.2s. Estimated remaining: 4h 47m 18s. Rate: 7.4 symbols/min [2025-10-02T17:32:26.893881] [INFO ] [MAIN ] BDX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:32:27.087255] [INFO ] [MAIN ] BDN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:32:27.089358] [INFO ] [MAIN ] BDJ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:32:27.122786] [INFO ] [MAIN ] BE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:32:27.172957] [DEBUG] [LOCAL ] BDJ: Loaded 28985 existing records from primary storage. [2025-10-02T17:32:27.173489] [INFO ] [MAIN ] BDJ: Loaded 28985 existing records. [2025-10-02T17:32:27.368485] [DEBUG] [LOCAL ] BDX: Loaded 52388 existing records from primary storage. [2025-10-02T17:32:27.418524] [INFO ] [MAIN ] BDX: Loaded 52388 existing records. [2025-10-02T17:32:27.447718] [DEBUG] [LOCAL ] BE: Loaded 53653 existing records from primary storage. [2025-10-02T17:32:27.446895] [DEBUG] [LOCAL ] BDN: Loaded 47488 existing records from primary storage. [2025-10-02T17:32:27.499164] [INFO ] [MAIN ] BE: Loaded 53653 existing records. [2025-10-02T17:32:27.499049] [WARN ] [MAIN ] BDJ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:32:27.525420] [INFO ] [MAIN ] BDJ: Wiping existing primary data before full refresh. [2025-10-02T17:32:27.525515] [INFO ] [MAIN ] BDN: Loaded 47488 existing records. [2025-10-02T17:32:27.584877] [INFO ] [LOCAL ] BDJ: Starting deletion of primary data. [2025-10-02T17:32:27.709803] [DEBUG] [LOCAL ] BDJ: Deleted primary data file. [2025-10-02T17:32:27.813618] [INFO ] [MAIN ] BDJ: Starting full primary refresh. [2025-10-02T17:32:28.167746] [WARN ] [MAIN ] BDN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:32:28.198175] [WARN ] [MAIN ] BE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:32:28.215080] [WARN ] [MAIN ] BDX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:32:28.215283] [INFO ] [MAIN ] BDN: Wiping existing primary data before full refresh. [2025-10-02T17:32:28.215527] [INFO ] [MAIN ] BDX: Wiping existing primary data before full refresh. [2025-10-02T17:32:28.215391] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-10-02T17:32:28.224332] [INFO ] [LOCAL ] BDX: Starting deletion of primary data. [2025-10-02T17:32:28.228279] [INFO ] [MAIN ] BE: Wiping existing primary data before full refresh. [2025-10-02T17:32:28.228379] [DEBUG] [LOCAL ] BDN: Deleted primary data file. [2025-10-02T17:32:28.228904] [INFO ] [MAIN ] BDN: Starting full primary refresh. [2025-10-02T17:32:28.228629] [INFO ] [LOCAL ] BE: Starting deletion of primary data. [2025-10-02T17:32:28.234561] [DEBUG] [LOCAL ] BDX: Deleted primary data file. [2025-10-02T17:32:28.255304] [INFO ] [MAIN ] BDX: Starting full primary refresh. [2025-10-02T17:32:28.298225] [DEBUG] [LOCAL ] BE: Deleted primary data file. [2025-10-02T17:32:28.318902] [INFO ] [MAIN ] BE: Starting full primary refresh. [2025-10-02T17:32:29.504028] [INFO ] [REMOTE ] BDJ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:32:29.548227] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2024-12. [2025-10-02T17:32:29.658900] [INFO ] [REMOTE ] BE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:32:29.769062] [INFO ] [REMOTE ] BE: Fetching primary data for 2024-12. [2025-10-02T17:32:29.857250] [INFO ] [REMOTE ] BDX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:32:29.870846] [INFO ] [REMOTE ] BDX: Fetching primary data for 2024-12. [2025-10-02T17:32:29.914238] [INFO ] [REMOTE ] BDN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:32:29.914885] [INFO ] [REMOTE ] BDN: Fetching primary data for 2024-12. [2025-10-02T17:32:30.915844] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-02T17:32:30.922349] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-01. [2025-10-02T17:32:31.210598] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-02T17:32:31.221999] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-01. [2025-10-02T17:32:31.917920] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-02T17:32:31.943445] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-01. [2025-10-02T17:32:31.944836] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-02T17:32:31.953256] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-02. [2025-10-02T17:32:32.050618] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-10-02T17:32:32.273078] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-01. [2025-10-02T17:32:32.812994] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-02T17:32:32.863930] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-02T17:32:33.073000] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-02. [2025-10-02T17:32:33.532106] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-02T17:32:33.873002] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-02. [2025-10-02T17:32:34.232569] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-02T17:32:34.673031] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-02. [2025-10-02T17:32:34.723622] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-02T17:32:35.416911] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-02T17:32:35.473027] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-03. [2025-10-02T17:32:36.273058] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-03. [2025-10-02T17:32:36.340780] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-02T17:32:36.962445] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-02T17:32:37.073042] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-04. [2025-10-02T17:32:37.702702] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-02T17:32:37.873066] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-03. [2025-10-02T17:32:38.673010] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-04. [2025-10-02T17:32:39.030636] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-02T17:32:39.473020] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-05. [2025-10-02T17:32:39.857297] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-02T17:32:40.013904] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-02T17:32:40.272970] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-03. [2025-10-02T17:32:41.072968] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-04. [2025-10-02T17:32:41.127201] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-02T17:32:41.733236] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-02T17:32:41.873036] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-05. [2025-10-02T17:32:42.672989] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-04. [2025-10-02T17:32:43.265920] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-02T17:32:43.473038] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-06. [2025-10-02T17:32:43.541168] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-02T17:32:43.625211] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-02T17:32:44.273026] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-05. [2025-10-02T17:32:45.073176] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-05. [2025-10-02T17:32:45.205319] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-02T17:32:45.357271] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-02T17:32:45.873007] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-06. [2025-10-02T17:32:46.673014] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-07. [2025-10-02T17:32:46.894370] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-02T17:32:47.425633] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-02T17:32:47.473003] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-07. [2025-10-02T17:32:48.272992] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-06. [2025-10-02T17:32:48.324118] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-02T17:32:48.798340] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-02T17:32:49.073082] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-08. [2025-10-02T17:32:49.872982] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-06. [2025-10-02T17:32:50.241888] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-02T17:32:50.485106] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-02T17:32:50.672972] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-07. [2025-10-02T17:32:50.758285] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-02T17:32:51.473025] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-09. [2025-10-02T17:32:52.273026] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-07. [2025-10-02T17:32:52.825009] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-02T17:32:53.073020] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-08. [2025-10-02T17:32:53.143553] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-02T17:32:53.545447] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-02T17:32:53.873007] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-08. [2025-10-02T17:32:54.673002] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-08. [2025-10-02T17:32:55.489337] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-10. [2025-10-02T17:32:55.492853] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-10-02T17:32:55.583001] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-02T17:32:56.041411] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-02T17:32:56.273010] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-09. [2025-10-02T17:32:56.871847] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-02T17:32:56.873747] [INFO ] [REMOTE ] BDN: Full fetch complete (69252 records). [2025-10-02T17:32:56.873870] [DEBUG] [VALIDATOR ] BDN: Validating primary data. [2025-10-02T17:32:57.074513] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-09. [2025-10-02T17:32:57.318761] [DEBUG] [VALIDATOR ] BDN: All expected trading days are present. [2025-10-02T17:32:57.318912] [DEBUG] [VALIDATOR ] BDN: Primary data validation passed. [2025-10-02T17:32:57.319732] [INFO ] [MAIN ] BDN: Fetched primary data is valid. [2025-10-02T17:32:57.319804] [DEBUG] [LOCAL ] BDN: Saving primary data. [2025-10-02T17:32:57.321492] [DEBUG] [LOCAL ] BDN: Trimmed 69252 records to 47839 (keeping 200 days of data) [2025-10-02T17:32:57.630981] [DEBUG] [LOCAL ] BDN: Primary data saved (47839 records). [2025-10-02T17:32:57.631128] [INFO ] [MAIN ] BDN: Full history saved. [2025-10-02T17:32:57.631242] [INFO ] [MAIN ] Update Progress: 241/2370 symbols completed. BDN took 31.5s. Estimated remaining: 4h 50m 37s. Rate: 7.3 symbols/min [2025-10-02T17:32:57.821252] [INFO ] [MAIN ] BEDU: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:32:57.821445] [DEBUG] [LOCAL ] BEDU: No existing data file found in primary storage. [2025-10-02T17:32:57.821504] [WARN ] [MAIN ] BEDU: No existing data found, performing full refresh instead. [2025-10-02T17:32:57.821703] [INFO ] [MAIN ] BEDU: Wiping existing primary data before full refresh. [2025-10-02T17:32:57.821758] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-02T17:32:57.821804] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-02T17:32:57.821837] [INFO ] [MAIN ] BEDU: Starting full primary refresh. [2025-10-02T17:32:57.877249] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-09. [2025-10-02T17:32:58.241200] [INFO ] [REMOTE ] BEDU: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:32:58.274335] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-02T17:32:58.308044] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-02T17:32:58.673006] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2024-12. [2025-10-02T17:32:59.314052] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-02T17:32:59.473000] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-10. [2025-10-02T17:33:00.273000] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-01. [2025-10-02T17:33:00.431504] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-09 (2.55 seconds). [2025-10-02T17:33:00.447730] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-02T17:33:00.450561] [INFO ] [REMOTE ] BDJ: Full fetch complete (42927 records). [2025-10-02T17:33:00.450844] [DEBUG] [VALIDATOR ] BDJ: Validating primary data. [2025-10-02T17:33:00.767148] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-02T17:33:00.933886] [DEBUG] [VALIDATOR ] BDJ: All expected trading days are present. [2025-10-02T17:33:00.934006] [DEBUG] [VALIDATOR ] BDJ: Primary data validation passed. [2025-10-02T17:33:00.934707] [INFO ] [MAIN ] BDJ: Fetched primary data is valid. [2025-10-02T17:33:00.934781] [DEBUG] [LOCAL ] BDJ: Saving primary data. [2025-10-02T17:33:00.936002] [DEBUG] [LOCAL ] BDJ: Trimmed 42927 records to 29159 (keeping 200 days of data) [2025-10-02T17:33:01.073013] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-10. [2025-10-02T17:33:01.143533] [DEBUG] [LOCAL ] BDJ: Primary data saved (29159 records). [2025-10-02T17:33:01.143869] [INFO ] [MAIN ] BDJ: Full history saved. [2025-10-02T17:33:01.143994] [INFO ] [MAIN ] Update Progress: 242/2370 symbols completed. BDJ took 35.0s. Estimated remaining: 4h 49m 47s. Rate: 7.3 symbols/min [2025-10-02T17:33:01.352944] [INFO ] [MAIN ] BEKE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:33:01.418633] [DEBUG] [LOCAL ] BEKE: Loaded 53239 existing records from primary storage. [2025-10-02T17:33:01.419010] [INFO ] [MAIN ] BEKE: Loaded 53239 existing records. [2025-10-02T17:33:01.623555] [WARN ] [MAIN ] BEKE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:33:01.623804] [INFO ] [MAIN ] BEKE: Wiping existing primary data before full refresh. [2025-10-02T17:33:01.623854] [INFO ] [LOCAL ] BEKE: Starting deletion of primary data. [2025-10-02T17:33:01.625546] [DEBUG] [LOCAL ] BEKE: Deleted primary data file. [2025-10-02T17:33:01.625615] [INFO ] [MAIN ] BEKE: Starting full primary refresh. [2025-10-02T17:33:01.881104] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-02. [2025-10-02T17:33:02.031092] [INFO ] [REMOTE ] BEKE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:33:02.281809] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-02T17:33:02.462293] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-02T17:33:02.466155] [INFO ] [REMOTE ] BDX: Full fetch complete (75744 records). [2025-10-02T17:33:02.466342] [DEBUG] [VALIDATOR ] BDX: Validating primary data. [2025-10-02T17:33:02.681752] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2024-12. [2025-10-02T17:33:02.974880] [DEBUG] [VALIDATOR ] BDX: All expected trading days are present. [2025-10-02T17:33:02.975212] [DEBUG] [VALIDATOR ] BDX: Primary data validation passed. [2025-10-02T17:33:02.976045] [INFO ] [MAIN ] BDX: Fetched primary data is valid. [2025-10-02T17:33:02.976114] [DEBUG] [LOCAL ] BDX: Saving primary data. [2025-10-02T17:33:02.977604] [DEBUG] [LOCAL ] BDX: Trimmed 75744 records to 52730 (keeping 200 days of data) [2025-10-02T17:33:03.344695] [DEBUG] [LOCAL ] BDX: Primary data saved (52730 records). [2025-10-02T17:33:03.344842] [INFO ] [MAIN ] BDX: Full history saved. [2025-10-02T17:33:03.344928] [INFO ] [MAIN ] Update Progress: 243/2370 symbols completed. BDX took 37.2s. Estimated remaining: 4h 48m 47s. Rate: 7.4 symbols/min [2025-10-02T17:33:03.478175] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-10. [2025-10-02T17:33:03.550994] [INFO ] [MAIN ] BEN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:33:03.605639] [DEBUG] [LOCAL ] BEN: Loaded 53049 existing records from primary storage. [2025-10-02T17:33:03.606035] [INFO ] [MAIN ] BEN: Loaded 53049 existing records. [2025-10-02T17:33:03.817271] [WARN ] [MAIN ] BEN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:33:03.817544] [INFO ] [MAIN ] BEN: Wiping existing primary data before full refresh. [2025-10-02T17:33:03.817594] [INFO ] [LOCAL ] BEN: Starting deletion of primary data. [2025-10-02T17:33:03.819425] [DEBUG] [LOCAL ] BEN: Deleted primary data file. [2025-10-02T17:33:03.819490] [INFO ] [MAIN ] BEN: Starting full primary refresh. [2025-10-02T17:33:04.230588] [INFO ] [REMOTE ] BEN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:33:04.272988] [INFO ] [REMOTE ] BEN: Fetching primary data for 2024-12. [2025-10-02T17:33:04.377823] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-02T17:33:05.073062] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-01. [2025-10-02T17:33:05.873050] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-03. [2025-10-02T17:33:05.988494] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-10 (2.51 seconds). [2025-10-02T17:33:05.990809] [INFO ] [REMOTE ] BE: Full fetch complete (77662 records). [2025-10-02T17:33:05.990953] [DEBUG] [VALIDATOR ] BE: Validating primary data. [2025-10-02T17:33:06.316515] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-02T17:33:06.503467] [DEBUG] [VALIDATOR ] BE: All expected trading days are present. [2025-10-02T17:33:06.504477] [DEBUG] [VALIDATOR ] BE: Primary data validation passed. [2025-10-02T17:33:06.507754] [INFO ] [MAIN ] BE: Fetched primary data is valid. [2025-10-02T17:33:06.506750] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-10-02T17:33:06.518430] [DEBUG] [LOCAL ] BE: Saving primary data. [2025-10-02T17:33:06.522088] [DEBUG] [LOCAL ] BE: Trimmed 77662 records to 54043 (keeping 200 days of data) [2025-10-02T17:33:06.659262] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-02T17:33:06.673785] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-01. [2025-10-02T17:33:06.937743] [DEBUG] [LOCAL ] BE: Primary data saved (54043 records). [2025-10-02T17:33:06.937925] [INFO ] [MAIN ] BE: Full history saved. [2025-10-02T17:33:06.938045] [INFO ] [MAIN ] Update Progress: 244/2370 symbols completed. BE took 40.8s. Estimated remaining: 4h 47m 59s. Rate: 7.4 symbols/min [2025-10-02T17:33:07.139272] [INFO ] [MAIN ] BEP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:33:07.139440] [DEBUG] [LOCAL ] BEP: No existing data file found in primary storage. [2025-10-02T17:33:07.139479] [WARN ] [MAIN ] BEP: No existing data found, performing full refresh instead. [2025-10-02T17:33:07.139594] [INFO ] [MAIN ] BEP: Wiping existing primary data before full refresh. [2025-10-02T17:33:07.139638] [INFO ] [LOCAL ] BEP: Starting deletion of primary data. [2025-10-02T17:33:07.139728] [DEBUG] [LOCAL ] BEP: No primary data file found to delete. [2025-10-02T17:33:07.139765] [INFO ] [MAIN ] BEP: Starting full primary refresh. [2025-10-02T17:33:07.481622] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-04. [2025-10-02T17:33:07.565792] [INFO ] [REMOTE ] BEP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:33:08.030327] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-02T17:33:08.092293] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-02T17:33:08.273038] [INFO ] [REMOTE ] BEP: Fetching primary data for 2024-12. [2025-10-02T17:33:09.073041] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-02. [2025-10-02T17:33:09.810461] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-02T17:33:09.873041] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-05. [2025-10-02T17:33:10.330697] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-02T17:33:10.673018] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-02. [2025-10-02T17:33:10.821169] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-02T17:33:11.473028] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-01. [2025-10-02T17:33:12.273038] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-03. [2025-10-02T17:33:12.667095] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-02T17:33:13.073055] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-06. [2025-10-02T17:33:13.134966] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-02T17:33:13.402057] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-02T17:33:13.843881] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-02T17:33:13.873017] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-04. [2025-10-02T17:33:14.673065] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-03. [2025-10-02T17:33:15.472977] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-07. [2025-10-02T17:33:15.726754] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-07 (0.25 seconds). [2025-10-02T17:33:15.892787] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-02T17:33:16.272988] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-05. [2025-10-02T17:33:16.673159] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-02T17:33:17.073055] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-08. [2025-10-02T17:33:17.266292] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-08 (0.19 seconds). [2025-10-02T17:33:17.873010] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-02. [2025-10-02T17:33:18.271170] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-02T17:33:18.673046] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-09. [2025-10-02T17:33:19.000953] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-02T17:33:19.403198] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-02T17:33:19.473067] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-06. [2025-10-02T17:33:20.273021] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-10. [2025-10-02T17:33:20.726090] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-02T17:33:20.726859] [INFO ] [REMOTE ] BEDU: Full fetch complete (1385 records). [2025-10-02T17:33:20.726935] [DEBUG] [VALIDATOR ] BEDU: Validating primary data. [2025-10-02T17:33:20.727368] [FATAL] [VALIDATOR ] BEDU: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:33:20.727476] [FATAL] [MAIN ] BEDU: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:33:20.727530] [WARN ] [MAIN ] BEDU: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:33:20.727574] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-02T17:33:20.727632] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-02T17:33:20.727709] [INFO ] [LOCAL ] BEDU: Starting deletion of derivative data. [2025-10-02T17:33:20.727764] [DEBUG] [LOCAL ] BEDU: No derivative data file found to delete. [2025-10-02T17:33:20.727824] [INFO ] [MAIN ] Update Progress: 245/2370 symbols completed. BEDU took 23.1s. Estimated remaining: 4h 48m 40s. Rate: 7.4 symbols/min [2025-10-02T17:33:20.920694] [INFO ] [MAIN ] BEPC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:33:20.968324] [DEBUG] [LOCAL ] BEPC: Loaded 46451 existing records from primary storage. [2025-10-02T17:33:20.968675] [INFO ] [MAIN ] BEPC: Loaded 46451 existing records. [2025-10-02T17:33:21.078102] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-04. [2025-10-02T17:33:21.173014] [WARN ] [MAIN ] BEPC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:33:21.173371] [INFO ] [MAIN ] BEPC: Wiping existing primary data before full refresh. [2025-10-02T17:33:21.173449] [INFO ] [LOCAL ] BEPC: Starting deletion of primary data. [2025-10-02T17:33:21.184421] [DEBUG] [LOCAL ] BEPC: Deleted primary data file. [2025-10-02T17:33:21.202694] [INFO ] [MAIN ] BEPC: Starting full primary refresh. [2025-10-02T17:33:21.278611] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-02T17:33:21.629160] [INFO ] [REMOTE ] BEPC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:33:21.873014] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-03. [2025-10-02T17:33:22.673026] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-07. [2025-10-02T17:33:23.024455] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-02T17:33:23.125672] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-02T17:33:23.473053] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-04. [2025-10-02T17:33:24.240057] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-02T17:33:24.273002] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-08. [2025-10-02T17:33:25.027790] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-02T17:33:25.073006] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-05. [2025-10-02T17:33:25.872981] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-05. [2025-10-02T17:33:26.064348] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-02T17:33:26.521720] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-02T17:33:26.673016] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-09. [2025-10-02T17:33:27.472967] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-06. [2025-10-02T17:33:27.852475] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-02T17:33:28.202275] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-02T17:33:28.273042] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-06. [2025-10-02T17:33:28.966881] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-02T17:33:29.073017] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-10. [2025-10-02T17:33:29.873014] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-07. [2025-10-02T17:33:30.005894] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-02T17:33:30.535555] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-02T17:33:30.537554] [INFO ] [REMOTE ] BEN: Full fetch complete (76886 records). [2025-10-02T17:33:30.537713] [DEBUG] [VALIDATOR ] BEN: Validating primary data. [2025-10-02T17:33:30.678161] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2024-12. [2025-10-02T17:33:30.977019] [DEBUG] [VALIDATOR ] BEN: All expected trading days are present. [2025-10-02T17:33:30.977107] [DEBUG] [VALIDATOR ] BEN: Primary data validation passed. [2025-10-02T17:33:30.977960] [INFO ] [MAIN ] BEN: Fetched primary data is valid. [2025-10-02T17:33:30.978087] [DEBUG] [LOCAL ] BEN: Saving primary data. [2025-10-02T17:33:30.979628] [DEBUG] [LOCAL ] BEN: Trimmed 76886 records to 53426 (keeping 200 days of data) [2025-10-02T17:33:31.335723] [DEBUG] [LOCAL ] BEN: Primary data saved (53426 records). [2025-10-02T17:33:31.335868] [INFO ] [MAIN ] BEN: Full history saved. [2025-10-02T17:33:31.335953] [INFO ] [MAIN ] Update Progress: 246/2370 symbols completed. BEN took 28.0s. Estimated remaining: 4h 48m 53s. Rate: 7.4 symbols/min [2025-10-02T17:33:31.482605] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-07. [2025-10-02T17:33:31.555764] [INFO ] [MAIN ] BEPH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:33:31.585418] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-02T17:33:31.601020] [DEBUG] [LOCAL ] BEPH: Loaded 5335 existing records from primary storage. [2025-10-02T17:33:31.601313] [INFO ] [MAIN ] BEPH: Loaded 5335 existing records. [2025-10-02T17:33:31.866191] [WARN ] [MAIN ] BEPH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:33:31.866457] [INFO ] [MAIN ] BEPH: Wiping existing primary data before full refresh. [2025-10-02T17:33:31.866509] [INFO ] [LOCAL ] BEPH: Starting deletion of primary data. [2025-10-02T17:33:31.866913] [DEBUG] [LOCAL ] BEPH: Deleted primary data file. [2025-10-02T17:33:31.866977] [INFO ] [MAIN ] BEPH: Starting full primary refresh. [2025-10-02T17:33:32.273048] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-08. [2025-10-02T17:33:32.277869] [INFO ] [REMOTE ] BEPH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:33:32.314196] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-02T17:33:33.073002] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-01. [2025-10-02T17:33:33.145686] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-02T17:33:33.420737] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-02T17:33:33.873004] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-09. [2025-10-02T17:33:34.672986] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2024-12. [2025-10-02T17:33:34.816865] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-02T17:33:35.377131] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-02T17:33:35.472998] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-02. [2025-10-02T17:33:35.562411] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-02T17:33:36.273024] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-08. [2025-10-02T17:33:36.839020] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-02T17:33:37.073009] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-03. [2025-10-02T17:33:37.873002] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-10. [2025-10-02T17:33:38.160734] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-02T17:33:38.524960] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-02T17:33:38.673048] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-01. [2025-10-02T17:33:39.023553] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-02T17:33:39.025710] [INFO ] [REMOTE ] BEP: Full fetch complete (58339 records). [2025-10-02T17:33:39.025825] [DEBUG] [VALIDATOR ] BEP: Validating primary data. [2025-10-02T17:33:39.174467] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-02T17:33:39.479549] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-02. [2025-10-02T17:33:39.481382] [DEBUG] [VALIDATOR ] BEP: All expected trading days are present. [2025-10-02T17:33:39.481481] [DEBUG] [VALIDATOR ] BEP: Primary data validation passed. [2025-10-02T17:33:39.482283] [INFO ] [MAIN ] BEP: Fetched primary data is valid. [2025-10-02T17:33:39.482480] [DEBUG] [LOCAL ] BEP: Saving primary data. [2025-10-02T17:33:39.484377] [DEBUG] [LOCAL ] BEP: Trimmed 58339 records to 38963 (keeping 200 days of data) [2025-10-02T17:33:39.735607] [DEBUG] [LOCAL ] BEP: Primary data saved (38963 records). [2025-10-02T17:33:39.735775] [INFO ] [MAIN ] BEP: Full history saved. [2025-10-02T17:33:39.735853] [INFO ] [MAIN ] Update Progress: 247/2370 symbols completed. BEP took 32.8s. Estimated remaining: 4h 48m 47s. Rate: 7.4 symbols/min [2025-10-02T17:33:39.919925] [INFO ] [MAIN ] BEPI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:33:39.925994] [DEBUG] [LOCAL ] BEPI: Loaded 3536 existing records from primary storage. [2025-10-02T17:33:39.926210] [INFO ] [MAIN ] BEPI: Loaded 3536 existing records. [2025-10-02T17:33:40.119826] [WARN ] [MAIN ] BEPI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:33:40.125023] [INFO ] [MAIN ] BEPI: Wiping existing primary data before full refresh. [2025-10-02T17:33:40.125234] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-02T17:33:40.125511] [INFO ] [LOCAL ] BEPI: Starting deletion of primary data. [2025-10-02T17:33:40.128134] [DEBUG] [LOCAL ] BEPI: Deleted primary data file. [2025-10-02T17:33:40.128199] [INFO ] [MAIN ] BEPI: Starting full primary refresh. [2025-10-02T17:33:40.278160] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-03. [2025-10-02T17:33:40.546780] [INFO ] [REMOTE ] BEPI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:33:41.004390] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-02T17:33:41.073053] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-04. [2025-10-02T17:33:41.704625] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-02T17:33:41.873038] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-09. [2025-10-02T17:33:42.672995] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-04. [2025-10-02T17:33:43.472980] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-05. [2025-10-02T17:33:43.730331] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-02T17:33:44.109608] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-02T17:33:44.273001] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2024-12. [2025-10-02T17:33:44.404240] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-02T17:33:44.979244] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-02T17:33:45.073014] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-01. [2025-10-02T17:33:45.536489] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-02T17:33:45.873042] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-02. [2025-10-02T17:33:46.239167] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-02T17:33:46.673034] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-03. [2025-10-02T17:33:47.122229] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-02T17:33:47.473015] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-10. [2025-10-02T17:33:48.273011] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-04. [2025-10-02T17:33:48.806632] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-02T17:33:49.073020] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-06. [2025-10-02T17:33:49.208859] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-02T17:33:49.211095] [INFO ] [REMOTE ] BEKE: Full fetch complete (77193 records). [2025-10-02T17:33:49.211245] [DEBUG] [VALIDATOR ] BEKE: Validating primary data. [2025-10-02T17:33:49.649722] [DEBUG] [VALIDATOR ] BEKE: All expected trading days are present. [2025-10-02T17:33:49.649825] [DEBUG] [VALIDATOR ] BEKE: Primary data validation passed. [2025-10-02T17:33:49.650680] [INFO ] [MAIN ] BEKE: Fetched primary data is valid. [2025-10-02T17:33:49.650750] [DEBUG] [LOCAL ] BEKE: Saving primary data. [2025-10-02T17:33:49.652526] [DEBUG] [LOCAL ] BEKE: Trimmed 77193 records to 53629 (keeping 200 days of data) [2025-10-02T17:33:49.875411] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-05. [2025-10-02T17:33:49.877254] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-02T17:33:50.007259] [DEBUG] [LOCAL ] BEKE: Primary data saved (53629 records). [2025-10-02T17:33:50.007431] [INFO ] [MAIN ] BEKE: Full history saved. [2025-10-02T17:33:50.007528] [INFO ] [MAIN ] Update Progress: 248/2370 symbols completed. BEKE took 48.9s. Estimated remaining: 4h 48m 57s. Rate: 7.3 symbols/min [2025-10-02T17:33:50.190381] [INFO ] [MAIN ] BEPJ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:33:50.194973] [DEBUG] [LOCAL ] BEPJ: Loaded 3149 existing records from primary storage. [2025-10-02T17:33:50.195125] [INFO ] [MAIN ] BEPJ: Loaded 3149 existing records. [2025-10-02T17:33:50.385268] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-02T17:33:50.400827] [WARN ] [MAIN ] BEPJ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:33:50.404263] [INFO ] [MAIN ] BEPJ: Wiping existing primary data before full refresh. [2025-10-02T17:33:50.404339] [INFO ] [LOCAL ] BEPJ: Starting deletion of primary data. [2025-10-02T17:33:50.404633] [DEBUG] [LOCAL ] BEPJ: Deleted primary data file. [2025-10-02T17:33:50.404737] [INFO ] [MAIN ] BEPJ: Starting full primary refresh. [2025-10-02T17:33:50.678189] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-06. [2025-10-02T17:33:50.853940] [INFO ] [REMOTE ] BEPJ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:33:51.306350] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-02T17:33:51.473014] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-07. [2025-10-02T17:33:52.048758] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-02T17:33:52.272999] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-08. [2025-10-02T17:33:52.644859] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-02T17:33:53.073007] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-09. [2025-10-02T17:33:53.450496] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-02T17:33:53.872994] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-10. [2025-10-02T17:33:54.339349] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-02T17:33:54.340150] [INFO ] [REMOTE ] BEPI: Full fetch complete (4981 records). [2025-10-02T17:33:54.340223] [DEBUG] [VALIDATOR ] BEPI: Validating primary data. [2025-10-02T17:33:54.685615] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-07. [2025-10-02T17:33:54.733233] [DEBUG] [VALIDATOR ] BEPI: All expected trading days are present. [2025-10-02T17:33:54.733315] [DEBUG] [VALIDATOR ] BEPI: Primary data validation passed. [2025-10-02T17:33:54.733470] [INFO ] [MAIN ] BEPI: Fetched primary data is valid. [2025-10-02T17:33:54.733511] [DEBUG] [LOCAL ] BEPI: Saving primary data. [2025-10-02T17:33:54.733925] [DEBUG] [LOCAL ] BEPI: Trimmed 4981 records to 3556 (keeping 200 days of data) [2025-10-02T17:33:54.756195] [DEBUG] [LOCAL ] BEPI: Primary data saved (3556 records). [2025-10-02T17:33:54.756294] [INFO ] [MAIN ] BEPI: Full history saved. [2025-10-02T17:33:54.756371] [INFO ] [MAIN ] Update Progress: 249/2370 symbols completed. BEPI took 15.0s. Estimated remaining: 4h 48m 20s. Rate: 7.4 symbols/min [2025-10-02T17:33:54.941996] [INFO ] [MAIN ] BFAM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:33:54.979332] [DEBUG] [LOCAL ] BFAM: Loaded 33171 existing records from primary storage. [2025-10-02T17:33:54.979695] [INFO ] [MAIN ] BFAM: Loaded 33171 existing records. [2025-10-02T17:33:55.178755] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-02T17:33:55.185187] [WARN ] [MAIN ] BFAM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:33:55.186942] [INFO ] [MAIN ] BFAM: Wiping existing primary data before full refresh. [2025-10-02T17:33:55.187266] [INFO ] [LOCAL ] BFAM: Starting deletion of primary data. [2025-10-02T17:33:55.188461] [DEBUG] [LOCAL ] BFAM: Deleted primary data file. [2025-10-02T17:33:55.188523] [INFO ] [MAIN ] BFAM: Starting full primary refresh. [2025-10-02T17:33:55.478137] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-08. [2025-10-02T17:33:55.578472] [INFO ] [REMOTE ] BFAM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:33:56.117538] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-02T17:33:56.273009] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-05. [2025-10-02T17:33:57.073000] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-09. [2025-10-02T17:33:57.732260] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-02T17:33:57.873005] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2024-12. [2025-10-02T17:33:58.102209] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-02T17:33:58.482978] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-02T17:33:58.673036] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2024-12. [2025-10-02T17:33:59.473132] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-10. [2025-10-02T17:34:00.084225] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-02T17:34:00.085470] [INFO ] [REMOTE ] BEPH: Full fetch complete (7705 records). [2025-10-02T17:34:00.085665] [DEBUG] [VALIDATOR ] BEPH: Validating primary data. [2025-10-02T17:34:00.086326] [FATAL] [VALIDATOR ] BEPH: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:34:00.086462] [FATAL] [MAIN ] BEPH: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:34:00.086548] [WARN ] [MAIN ] BEPH: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:34:00.086673] [INFO ] [LOCAL ] BEPH: Starting deletion of primary data. [2025-10-02T17:34:00.086802] [DEBUG] [LOCAL ] BEPH: No primary data file found to delete. [2025-10-02T17:34:00.086880] [INFO ] [LOCAL ] BEPH: Starting deletion of derivative data. [2025-10-02T17:34:00.087375] [DEBUG] [LOCAL ] BEPH: Deleted derivative data file. [2025-10-02T17:34:00.087516] [INFO ] [MAIN ] Update Progress: 250/2370 symbols completed. BEPH took 28.8s. Estimated remaining: 4h 47m 48s. Rate: 7.4 symbols/min [2025-10-02T17:34:00.292125] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-06. [2025-10-02T17:34:00.323563] [INFO ] [MAIN ] BFH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:34:00.347188] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-02T17:34:00.394865] [DEBUG] [LOCAL ] BFH: Loaded 41602 existing records from primary storage. [2025-10-02T17:34:00.395164] [INFO ] [MAIN ] BFH: Loaded 41602 existing records. [2025-10-02T17:34:00.599575] [WARN ] [MAIN ] BFH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:34:00.599894] [INFO ] [MAIN ] BFH: Wiping existing primary data before full refresh. [2025-10-02T17:34:00.599979] [INFO ] [LOCAL ] BFH: Starting deletion of primary data. [2025-10-02T17:34:00.601279] [DEBUG] [LOCAL ] BFH: Deleted primary data file. [2025-10-02T17:34:00.601345] [INFO ] [MAIN ] BFH: Starting full primary refresh. [2025-10-02T17:34:01.000937] [INFO ] [REMOTE ] BFH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:34:01.072988] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-01. [2025-10-02T17:34:01.872996] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-01. [2025-10-02T17:34:01.928352] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-02T17:34:02.437881] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-02T17:34:02.673048] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-02. [2025-10-02T17:34:03.137978] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-02T17:34:03.301000] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-02T17:34:03.473002] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-03. [2025-10-02T17:34:04.000924] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-02T17:34:04.273054] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-02. [2025-10-02T17:34:05.073020] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-07. [2025-10-02T17:34:05.465453] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-02T17:34:05.873021] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-04. [2025-10-02T17:34:06.520293] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-02T17:34:06.672978] [INFO ] [REMOTE ] BFH: Fetching primary data for 2024-12. [2025-10-02T17:34:06.705033] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-02T17:34:07.473014] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-03. [2025-10-02T17:34:08.272974] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-05. [2025-10-02T17:34:08.507237] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-02T17:34:08.836344] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-02T17:34:08.870780] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-02T17:34:09.073021] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-06. [2025-10-02T17:34:09.673808] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-02T17:34:09.873034] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-08. [2025-10-02T17:34:10.673014] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-04. [2025-10-02T17:34:11.431673] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-02T17:34:11.473044] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-09. [2025-10-02T17:34:12.074902] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-02T17:34:12.273045] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-05. [2025-10-02T17:34:13.072051] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-02T17:34:13.083774] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-07. [2025-10-02T17:34:13.621294] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-02T17:34:13.696609] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-02T17:34:13.872998] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-10. [2025-10-02T17:34:14.673035] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-06. [2025-10-02T17:34:15.178319] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-02T17:34:15.180559] [INFO ] [REMOTE ] BEPC: Full fetch complete (68505 records). [2025-10-02T17:34:15.180712] [DEBUG] [VALIDATOR ] BEPC: Validating primary data. [2025-10-02T17:34:15.478314] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-08. [2025-10-02T17:34:15.678753] [DEBUG] [VALIDATOR ] BEPC: All expected trading days are present. [2025-10-02T17:34:15.678912] [DEBUG] [VALIDATOR ] BEPC: Primary data validation passed. [2025-10-02T17:34:15.679747] [INFO ] [MAIN ] BEPC: Fetched primary data is valid. [2025-10-02T17:34:15.679821] [DEBUG] [LOCAL ] BEPC: Saving primary data. [2025-10-02T17:34:15.681408] [DEBUG] [LOCAL ] BEPC: Trimmed 68505 records to 46818 (keeping 200 days of data) [2025-10-02T17:34:15.984756] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-02T17:34:16.000031] [DEBUG] [LOCAL ] BEPC: Primary data saved (46818 records). [2025-10-02T17:34:16.000184] [INFO ] [MAIN ] BEPC: Full history saved. [2025-10-02T17:34:16.001811] [INFO ] [MAIN ] Update Progress: 251/2370 symbols completed. BEPC took 55.3s. Estimated remaining: 4h 48m 45s. Rate: 7.3 symbols/min [2025-10-02T17:34:16.145707] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-02T17:34:16.234577] [INFO ] [MAIN ] BFK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:34:16.252128] [DEBUG] [LOCAL ] BFK: Loaded 13896 existing records from primary storage. [2025-10-02T17:34:16.252407] [INFO ] [MAIN ] BFK: Loaded 13896 existing records. [2025-10-02T17:34:16.283145] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-09. [2025-10-02T17:34:16.489160] [WARN ] [MAIN ] BFK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:34:16.489518] [INFO ] [MAIN ] BFK: Wiping existing primary data before full refresh. [2025-10-02T17:34:16.489579] [INFO ] [LOCAL ] BFK: Starting deletion of primary data. [2025-10-02T17:34:16.490840] [DEBUG] [LOCAL ] BFK: Deleted primary data file. [2025-10-02T17:34:16.490903] [INFO ] [MAIN ] BFK: Starting full primary refresh. [2025-10-02T17:34:16.747327] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-02T17:34:16.951102] [INFO ] [REMOTE ] BFK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:34:17.073051] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-07. [2025-10-02T17:34:17.873025] [INFO ] [REMOTE ] BFK: Fetching primary data for 2024-12. [2025-10-02T17:34:18.114198] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-02T17:34:18.672978] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-08. [2025-10-02T17:34:18.940967] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-02T17:34:19.473042] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-01. [2025-10-02T17:34:20.081747] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-02T17:34:20.272979] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-09. [2025-10-02T17:34:20.339027] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-02T17:34:21.073039] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-01. [2025-10-02T17:34:21.670888] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-02T17:34:21.873026] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-02. [2025-10-02T17:34:22.544915] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-02T17:34:22.590230] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-02T17:34:22.673074] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-10. [2025-10-02T17:34:23.237157] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-02T17:34:23.237948] [INFO ] [REMOTE ] BEPJ: Full fetch complete (4492 records). [2025-10-02T17:34:23.238057] [DEBUG] [VALIDATOR ] BEPJ: Validating primary data. [2025-10-02T17:34:23.478230] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-10. [2025-10-02T17:34:23.653089] [DEBUG] [VALIDATOR ] BEPJ: All expected trading days are present. [2025-10-02T17:34:23.653170] [DEBUG] [VALIDATOR ] BEPJ: Primary data validation passed. [2025-10-02T17:34:23.653313] [INFO ] [MAIN ] BEPJ: Fetched primary data is valid. [2025-10-02T17:34:23.653354] [DEBUG] [LOCAL ] BEPJ: Saving primary data. [2025-10-02T17:34:23.653813] [DEBUG] [LOCAL ] BEPJ: Trimmed 4492 records to 3156 (keeping 200 days of data) [2025-10-02T17:34:23.676268] [DEBUG] [LOCAL ] BEPJ: Primary data saved (3156 records). [2025-10-02T17:34:23.676425] [INFO ] [MAIN ] BEPJ: Full history saved. [2025-10-02T17:34:23.676522] [INFO ] [MAIN ] Update Progress: 252/2370 symbols completed. BEPJ took 33.7s. Estimated remaining: 4h 48m 33s. Rate: 7.3 symbols/min [2025-10-02T17:34:23.877485] [INFO ] [MAIN ] BFLY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:34:23.931885] [DEBUG] [LOCAL ] BFLY: Loaded 51781 existing records from primary storage. [2025-10-02T17:34:23.932260] [INFO ] [MAIN ] BFLY: Loaded 51781 existing records. [2025-10-02T17:34:24.133825] [WARN ] [MAIN ] BFLY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:34:24.134036] [INFO ] [MAIN ] BFLY: Wiping existing primary data before full refresh. [2025-10-02T17:34:24.134088] [INFO ] [LOCAL ] BFLY: Starting deletion of primary data. [2025-10-02T17:34:24.135739] [DEBUG] [LOCAL ] BFLY: Deleted primary data file. [2025-10-02T17:34:24.135805] [INFO ] [MAIN ] BFLY: Starting full primary refresh. [2025-10-02T17:34:24.287438] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-03. [2025-10-02T17:34:24.548961] [INFO ] [REMOTE ] BFLY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:34:24.612537] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-02T17:34:24.614202] [INFO ] [REMOTE ] BFAM: Full fetch complete (46968 records). [2025-10-02T17:34:24.614291] [DEBUG] [VALIDATOR ] BFAM: Validating primary data. [2025-10-02T17:34:25.030810] [DEBUG] [VALIDATOR ] BFAM: All expected trading days are present. [2025-10-02T17:34:25.030969] [DEBUG] [VALIDATOR ] BFAM: Primary data validation passed. [2025-10-02T17:34:25.031691] [INFO ] [MAIN ] BFAM: Fetched primary data is valid. [2025-10-02T17:34:25.031795] [DEBUG] [LOCAL ] BFAM: Saving primary data. [2025-10-02T17:34:25.033288] [DEBUG] [LOCAL ] BFAM: Trimmed 46968 records to 33413 (keeping 200 days of data) [2025-10-02T17:34:25.086516] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-02. [2025-10-02T17:34:25.236070] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-02T17:34:25.264967] [DEBUG] [LOCAL ] BFAM: Primary data saved (33413 records). [2025-10-02T17:34:25.265107] [INFO ] [MAIN ] BFAM: Full history saved. [2025-10-02T17:34:25.265202] [INFO ] [MAIN ] Update Progress: 253/2370 symbols completed. BFAM took 30.5s. Estimated remaining: 4h 47m 29s. Rate: 7.4 symbols/min [2025-10-02T17:34:25.452156] [INFO ] [MAIN ] BFS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:34:25.463466] [DEBUG] [LOCAL ] BFS: Loaded 9143 existing records from primary storage. [2025-10-02T17:34:25.463728] [INFO ] [MAIN ] BFS: Loaded 9143 existing records. [2025-10-02T17:34:25.654906] [WARN ] [MAIN ] BFS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:34:25.655156] [INFO ] [MAIN ] BFS: Wiping existing primary data before full refresh. [2025-10-02T17:34:25.655209] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-10-02T17:34:25.655583] [DEBUG] [LOCAL ] BFS: Deleted primary data file. [2025-10-02T17:34:25.655683] [INFO ] [MAIN ] BFS: Starting full primary refresh. [2025-10-02T17:34:25.881193] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2024-12. [2025-10-02T17:34:26.058324] [INFO ] [REMOTE ] BFS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:34:26.552936] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-02T17:34:26.672994] [INFO ] [REMOTE ] BFS: Fetching primary data for 2024-12. [2025-10-02T17:34:27.472979] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-04. [2025-10-02T17:34:27.707672] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-02T17:34:27.725672] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-02T17:34:28.142970] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-02T17:34:28.273058] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-03. [2025-10-02T17:34:29.073043] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-01. [2025-10-02T17:34:29.873012] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-05. [2025-10-02T17:34:29.908187] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-02T17:34:30.604860] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-02T17:34:30.672978] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-02. [2025-10-02T17:34:30.821743] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-02T17:34:31.473043] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-04. [2025-10-02T17:34:32.273017] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-01. [2025-10-02T17:34:32.392607] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-02T17:34:32.736917] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-02T17:34:33.072983] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-03. [2025-10-02T17:34:33.284670] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-02T17:34:33.873022] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-05. [2025-10-02T17:34:34.673007] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-06. [2025-10-02T17:34:34.737337] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-02T17:34:35.170446] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-02T17:34:35.327550] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-02T17:34:35.472992] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-07. [2025-10-02T17:34:36.251970] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-02T17:34:36.273033] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-02. [2025-10-02T17:34:36.813628] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-02T17:34:37.073000] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-03. [2025-10-02T17:34:37.873000] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-08. [2025-10-02T17:34:37.953016] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-02T17:34:38.672989] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-06. [2025-10-02T17:34:38.751228] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-02T17:34:39.473017] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-04. [2025-10-02T17:34:40.272986] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-09. [2025-10-02T17:34:40.315291] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-02T17:34:40.316979] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-02T17:34:41.072969] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-07. [2025-10-02T17:34:41.315825] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-02T17:34:41.873009] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-10. [2025-10-02T17:34:42.241266] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-02T17:34:42.595111] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-02T17:34:42.596210] [INFO ] [REMOTE ] BFK: Full fetch complete (19295 records). [2025-10-02T17:34:42.596286] [DEBUG] [VALIDATOR ] BFK: Validating primary data. [2025-10-02T17:34:42.678121] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-08. [2025-10-02T17:34:42.997674] [DEBUG] [VALIDATOR ] BFK: All expected trading days are present. [2025-10-02T17:34:42.997792] [DEBUG] [VALIDATOR ] BFK: Primary data validation passed. [2025-10-02T17:34:42.998171] [INFO ] [MAIN ] BFK: Fetched primary data is valid. [2025-10-02T17:34:42.998233] [DEBUG] [LOCAL ] BFK: Saving primary data. [2025-10-02T17:34:42.998925] [DEBUG] [LOCAL ] BFK: Trimmed 19295 records to 13980 (keeping 200 days of data) [2025-10-02T17:34:43.085064] [DEBUG] [LOCAL ] BFK: Primary data saved (13980 records). [2025-10-02T17:34:43.085206] [INFO ] [MAIN ] BFK: Full history saved. [2025-10-02T17:34:43.085292] [INFO ] [MAIN ] Update Progress: 254/2370 symbols completed. BFK took 27.1s. Estimated remaining: 4h 48m 42s. Rate: 7.3 symbols/min [2025-10-02T17:34:43.270231] [INFO ] [MAIN ] BFZ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:34:43.284633] [DEBUG] [LOCAL ] BFZ: Loaded 12123 existing records from primary storage. [2025-10-02T17:34:43.284930] [INFO ] [MAIN ] BFZ: Loaded 12123 existing records. [2025-10-02T17:34:43.501381] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-05. [2025-10-02T17:34:43.508678] [WARN ] [MAIN ] BFZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:34:43.510715] [INFO ] [MAIN ] BFZ: Wiping existing primary data before full refresh. [2025-10-02T17:34:43.510808] [INFO ] [LOCAL ] BFZ: Starting deletion of primary data. [2025-10-02T17:34:43.511294] [DEBUG] [LOCAL ] BFZ: Deleted primary data file. [2025-10-02T17:34:43.511369] [INFO ] [MAIN ] BFZ: Starting full primary refresh. [2025-10-02T17:34:43.905912] [INFO ] [REMOTE ] BFZ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:34:44.262399] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-02T17:34:44.272972] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2024-12. [2025-10-02T17:34:44.348979] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-02T17:34:45.053155] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-02T17:34:45.072961] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-01. [2025-10-02T17:34:45.834439] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-02T17:34:45.872988] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-09. [2025-10-02T17:34:46.673012] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-04. [2025-10-02T17:34:47.472983] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-06. [2025-10-02T17:34:47.508966] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-02T17:34:48.272998] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-02. [2025-10-02T17:34:48.317166] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-02T17:34:48.349278] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-02T17:34:49.073006] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-07. [2025-10-02T17:34:49.248095] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-02T17:34:49.873016] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-03. [2025-10-02T17:34:49.917050] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-02T17:34:50.374121] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-02T17:34:50.672998] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-08. [2025-10-02T17:34:51.473013] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-10. [2025-10-02T17:34:51.516295] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-02T17:34:52.272999] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-04. [2025-10-02T17:34:52.687696] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-02T17:34:52.689779] [INFO ] [REMOTE ] BFH: Full fetch complete (59673 records). [2025-10-02T17:34:52.689905] [DEBUG] [VALIDATOR ] BFH: Validating primary data. [2025-10-02T17:34:53.091633] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-09. [2025-10-02T17:34:53.125896] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-02T17:34:53.144624] [DEBUG] [VALIDATOR ] BFH: All expected trading days are present. [2025-10-02T17:34:53.147686] [DEBUG] [VALIDATOR ] BFH: Primary data validation passed. [2025-10-02T17:34:53.149434] [INFO ] [MAIN ] BFH: Fetched primary data is valid. [2025-10-02T17:34:53.149509] [DEBUG] [LOCAL ] BFH: Saving primary data. [2025-10-02T17:34:53.150967] [DEBUG] [LOCAL ] BFH: Trimmed 59673 records to 41897 (keeping 200 days of data) [2025-10-02T17:34:53.419926] [DEBUG] [LOCAL ] BFH: Primary data saved (41897 records). [2025-10-02T17:34:53.420056] [INFO ] [MAIN ] BFH: Full history saved. [2025-10-02T17:34:53.420198] [INFO ] [MAIN ] Update Progress: 255/2370 symbols completed. BFH took 53.3s. Estimated remaining: 4h 48m 51s. Rate: 7.3 symbols/min [2025-10-02T17:34:53.612672] [INFO ] [MAIN ] BG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:34:53.666249] [DEBUG] [LOCAL ] BG: Loaded 50413 existing records from primary storage. [2025-10-02T17:34:53.666623] [INFO ] [MAIN ] BG: Loaded 50413 existing records. [2025-10-02T17:34:53.873072] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-05. [2025-10-02T17:34:53.901924] [WARN ] [MAIN ] BG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:34:53.902399] [INFO ] [MAIN ] BG: Wiping existing primary data before full refresh. [2025-10-02T17:34:53.902551] [INFO ] [LOCAL ] BG: Starting deletion of primary data. [2025-10-02T17:34:53.911769] [DEBUG] [LOCAL ] BG: Deleted primary data file. [2025-10-02T17:34:53.913489] [INFO ] [MAIN ] BG: Starting full primary refresh. [2025-10-02T17:34:53.914342] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-02T17:34:54.334405] [INFO ] [REMOTE ] BG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:34:54.673007] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-10. [2025-10-02T17:34:55.382146] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-02T17:34:55.383063] [INFO ] [REMOTE ] BFS: Full fetch complete (12701 records). [2025-10-02T17:34:55.383134] [DEBUG] [VALIDATOR ] BFS: Validating primary data. [2025-10-02T17:34:55.476246] [INFO ] [REMOTE ] BG: Fetching primary data for 2024-12. [2025-10-02T17:34:55.800396] [DEBUG] [VALIDATOR ] BFS: All expected trading days are present. [2025-10-02T17:34:55.800497] [DEBUG] [VALIDATOR ] BFS: Primary data validation passed. [2025-10-02T17:34:55.800914] [INFO ] [MAIN ] BFS: Fetched primary data is valid. [2025-10-02T17:34:55.801025] [DEBUG] [LOCAL ] BFS: Saving primary data. [2025-10-02T17:34:55.813375] [DEBUG] [LOCAL ] BFS: Trimmed 12701 records to 9213 (keeping 200 days of data) [2025-10-02T17:34:55.835625] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-02T17:34:55.905052] [DEBUG] [LOCAL ] BFS: Primary data saved (9213 records). [2025-10-02T17:34:55.905198] [INFO ] [MAIN ] BFS: Full history saved. [2025-10-02T17:34:55.905322] [INFO ] [MAIN ] Update Progress: 256/2370 symbols completed. BFS took 30.6s. Estimated remaining: 4h 47m 56s. Rate: 7.3 symbols/min [2025-10-02T17:34:56.102057] [INFO ] [MAIN ] BGB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:34:56.127366] [DEBUG] [LOCAL ] BGB: Loaded 17523 existing records from primary storage. [2025-10-02T17:34:56.127621] [INFO ] [MAIN ] BGB: Loaded 17523 existing records. [2025-10-02T17:34:56.278134] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-05. [2025-10-02T17:34:56.359044] [WARN ] [MAIN ] BGB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:34:56.359282] [INFO ] [MAIN ] BGB: Wiping existing primary data before full refresh. [2025-10-02T17:34:56.359350] [INFO ] [LOCAL ] BGB: Starting deletion of primary data. [2025-10-02T17:34:56.360129] [DEBUG] [LOCAL ] BGB: Deleted primary data file. [2025-10-02T17:34:56.360191] [INFO ] [MAIN ] BGB: Starting full primary refresh. [2025-10-02T17:34:56.966566] [INFO ] [REMOTE ] BGB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:34:57.073023] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-06. [2025-10-02T17:34:57.253366] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-02T17:34:57.324328] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-02T17:34:57.873006] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-06. [2025-10-02T17:34:58.672967] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-01. [2025-10-02T17:34:58.760072] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-02T17:34:58.914275] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-02T17:34:59.472993] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-07. [2025-10-02T17:34:59.995044] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-02T17:35:00.095756] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-02T17:35:00.273041] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-08. [2025-10-02T17:35:01.073026] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-07. [2025-10-02T17:35:01.274114] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-02T17:35:01.873010] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-09. [2025-10-02T17:35:02.672994] [INFO ] [REMOTE ] BGB: Fetching primary data for 2024-12. [2025-10-02T17:35:02.932182] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-02T17:35:03.222549] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-02T17:35:03.473053] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-08. [2025-10-02T17:35:03.875858] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-02T17:35:04.273010] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-02. [2025-10-02T17:35:05.072971] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-10. [2025-10-02T17:35:05.274235] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-02T17:35:05.538111] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-02T17:35:05.872995] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-03. [2025-10-02T17:35:05.881220] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-02T17:35:05.882361] [INFO ] [REMOTE ] BFZ: Full fetch complete (18038 records). [2025-10-02T17:35:05.882437] [DEBUG] [VALIDATOR ] BFZ: Validating primary data. [2025-10-02T17:35:06.284814] [DEBUG] [VALIDATOR ] BFZ: All expected trading days are present. [2025-10-02T17:35:06.284896] [DEBUG] [VALIDATOR ] BFZ: Primary data validation passed. [2025-10-02T17:35:06.285231] [INFO ] [MAIN ] BFZ: Fetched primary data is valid. [2025-10-02T17:35:06.285275] [DEBUG] [LOCAL ] BFZ: Saving primary data. [2025-10-02T17:35:06.285929] [DEBUG] [LOCAL ] BFZ: Trimmed 18038 records to 12227 (keeping 200 days of data) [2025-10-02T17:35:06.374384] [DEBUG] [LOCAL ] BFZ: Primary data saved (12227 records). [2025-10-02T17:35:06.374525] [INFO ] [MAIN ] BFZ: Full history saved. [2025-10-02T17:35:06.374667] [INFO ] [MAIN ] Update Progress: 257/2370 symbols completed. BFZ took 23.3s. Estimated remaining: 4h 48m 7s. Rate: 7.3 symbols/min [2025-10-02T17:35:06.557948] [INFO ] [MAIN ] BGH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:35:06.577766] [DEBUG] [LOCAL ] BGH: Loaded 16856 existing records from primary storage. [2025-10-02T17:35:06.578066] [INFO ] [MAIN ] BGH: Loaded 16856 existing records. [2025-10-02T17:35:06.682442] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-09. [2025-10-02T17:35:06.771669] [WARN ] [MAIN ] BGH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:35:06.771875] [INFO ] [MAIN ] BGH: Wiping existing primary data before full refresh. [2025-10-02T17:35:06.771922] [INFO ] [LOCAL ] BGH: Starting deletion of primary data. [2025-10-02T17:35:06.772614] [DEBUG] [LOCAL ] BGH: Deleted primary data file. [2025-10-02T17:35:06.772711] [INFO ] [MAIN ] BGH: Starting full primary refresh. [2025-10-02T17:35:07.162755] [INFO ] [REMOTE ] BGH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:35:07.473004] [INFO ] [REMOTE ] BGH: Fetching primary data for 2024-12. [2025-10-02T17:35:07.729401] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-02T17:35:08.273002] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-04. [2025-10-02T17:35:08.450049] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-02T17:35:08.598683] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-02T17:35:09.073052] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-10. [2025-10-02T17:35:09.872980] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-01. [2025-10-02T17:35:10.003184] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-02T17:35:10.417069] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-02T17:35:10.629223] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-02T17:35:10.632310] [INFO ] [REMOTE ] BFLY: Full fetch complete (75261 records). [2025-10-02T17:35:10.632534] [DEBUG] [VALIDATOR ] BFLY: Validating primary data. [2025-10-02T17:35:10.682064] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-05. [2025-10-02T17:35:11.127937] [DEBUG] [VALIDATOR ] BFLY: All expected trading days are present. [2025-10-02T17:35:11.128055] [DEBUG] [VALIDATOR ] BFLY: Primary data validation passed. [2025-10-02T17:35:11.128915] [INFO ] [MAIN ] BFLY: Fetched primary data is valid. [2025-10-02T17:35:11.128981] [DEBUG] [LOCAL ] BFLY: Saving primary data. [2025-10-02T17:35:11.130527] [DEBUG] [LOCAL ] BFLY: Trimmed 75261 records to 52160 (keeping 200 days of data) [2025-10-02T17:35:11.449192] [DEBUG] [LOCAL ] BFLY: Primary data saved (52160 records). [2025-10-02T17:35:11.449337] [INFO ] [MAIN ] BFLY: Full history saved. [2025-10-02T17:35:11.449434] [INFO ] [MAIN ] Update Progress: 258/2370 symbols completed. BFLY took 47.8s. Estimated remaining: 4h 47m 33s. Rate: 7.3 symbols/min [2025-10-02T17:35:11.478098] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-01. [2025-10-02T17:35:11.648607] [INFO ] [MAIN ] BGR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:35:11.664463] [DEBUG] [LOCAL ] BGR: Loaded 13508 existing records from primary storage. [2025-10-02T17:35:11.664792] [INFO ] [MAIN ] BGR: Loaded 13508 existing records. [2025-10-02T17:35:11.866429] [WARN ] [MAIN ] BGR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:35:11.866900] [INFO ] [MAIN ] BGR: Wiping existing primary data before full refresh. [2025-10-02T17:35:11.866962] [INFO ] [LOCAL ] BGR: Starting deletion of primary data. [2025-10-02T17:35:11.867806] [DEBUG] [LOCAL ] BGR: Deleted primary data file. [2025-10-02T17:35:11.867873] [INFO ] [MAIN ] BGR: Starting full primary refresh. [2025-10-02T17:35:12.252253] [INFO ] [REMOTE ] BGR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:35:12.272957] [INFO ] [REMOTE ] BGR: Fetching primary data for 2024-12. [2025-10-02T17:35:12.465405] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-02T17:35:12.507832] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-02T17:35:12.968229] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-02T17:35:13.073034] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-02. [2025-10-02T17:35:13.873042] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-06. [2025-10-02T17:35:13.897553] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-02T17:35:14.673057] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-01. [2025-10-02T17:35:15.472984] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-02. [2025-10-02T17:35:15.624328] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-02T17:35:15.645500] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-02T17:35:16.273009] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-07. [2025-10-02T17:35:16.693667] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-02T17:35:17.073006] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-03. [2025-10-02T17:35:17.872967] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-02. [2025-10-02T17:35:18.092961] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-02T17:35:18.190503] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-02T17:35:18.513869] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-02T17:35:18.673015] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-08. [2025-10-02T17:35:19.473051] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-03. [2025-10-02T17:35:20.272993] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-04. [2025-10-02T17:35:20.445057] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-02T17:35:20.507286] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-02T17:35:21.072981] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-09. [2025-10-02T17:35:21.561190] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-02T17:35:21.873007] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-03. [2025-10-02T17:35:21.980044] [DEBUG] [REMOTE ] BGR: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-10-02T17:35:21.980396] [WARN ] [REMOTE ] BGR: No data returned for month 2025-03 [2025-10-02T17:35:21.980507] [FATAL] [REMOTE ] BGR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T17:35:21.980627] [FATAL] [MAIN ] BGR: Failed to fetch primary data. [2025-10-02T17:35:21.980734] [WARN ] [MAIN ] BGR: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T17:35:21.980870] [INFO ] [LOCAL ] BGR: Starting deletion of primary data. [2025-10-02T17:35:21.980937] [DEBUG] [LOCAL ] BGR: No primary data file found to delete. [2025-10-02T17:35:21.980975] [INFO ] [LOCAL ] BGR: Starting deletion of derivative data. [2025-10-02T17:35:21.981328] [DEBUG] [LOCAL ] BGR: Deleted derivative data file. [2025-10-02T17:35:21.981421] [INFO ] [MAIN ] Update Progress: 259/2370 symbols completed. BGR took 10.5s. Estimated remaining: 4h 47m 44s. Rate: 7.3 symbols/min [2025-10-02T17:35:22.174803] [INFO ] [MAIN ] BGS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:35:22.229140] [DEBUG] [LOCAL ] BGS: Loaded 50455 existing records from primary storage. [2025-10-02T17:35:22.229530] [INFO ] [MAIN ] BGS: Loaded 50455 existing records. [2025-10-02T17:35:22.432852] [WARN ] [MAIN ] BGS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:35:22.433187] [INFO ] [MAIN ] BGS: Wiping existing primary data before full refresh. [2025-10-02T17:35:22.433240] [INFO ] [LOCAL ] BGS: Starting deletion of primary data. [2025-10-02T17:35:22.434572] [DEBUG] [LOCAL ] BGS: Deleted primary data file. [2025-10-02T17:35:22.434634] [INFO ] [MAIN ] BGS: Starting full primary refresh. [2025-10-02T17:35:22.678324] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-05. [2025-10-02T17:35:22.836433] [INFO ] [REMOTE ] BGS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:35:22.866895] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-02T17:35:23.472997] [INFO ] [REMOTE ] BGS: Fetching primary data for 2024-12. [2025-10-02T17:35:23.760584] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-02T17:35:24.272996] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-10. [2025-10-02T17:35:25.072991] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-06. [2025-10-02T17:35:25.342984] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-02T17:35:25.560314] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-02T17:35:25.562307] [INFO ] [REMOTE ] BG: Full fetch complete (72801 records). [2025-10-02T17:35:25.562404] [DEBUG] [VALIDATOR ] BG: Validating primary data. [2025-10-02T17:35:25.883186] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-04. [2025-10-02T17:35:25.974313] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-02T17:35:26.002528] [DEBUG] [VALIDATOR ] BG: All expected trading days are present. [2025-10-02T17:35:26.003236] [DEBUG] [VALIDATOR ] BG: Primary data validation passed. [2025-10-02T17:35:26.004599] [INFO ] [MAIN ] BG: Fetched primary data is valid. [2025-10-02T17:35:26.004698] [DEBUG] [LOCAL ] BG: Saving primary data. [2025-10-02T17:35:26.006328] [DEBUG] [LOCAL ] BG: Trimmed 72801 records to 50788 (keeping 200 days of data) [2025-10-02T17:35:26.335728] [DEBUG] [LOCAL ] BG: Primary data saved (50788 records). [2025-10-02T17:35:26.335880] [INFO ] [MAIN ] BG: Full history saved. [2025-10-02T17:35:26.335964] [INFO ] [MAIN ] Update Progress: 260/2370 symbols completed. BG took 32.9s. Estimated remaining: 4h 47m 5s. Rate: 7.3 symbols/min [2025-10-02T17:35:26.527004] [INFO ] [MAIN ] BGSF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:35:26.536227] [DEBUG] [LOCAL ] BGSF: Loaded 7403 existing records from primary storage. [2025-10-02T17:35:26.536443] [INFO ] [MAIN ] BGSF: Loaded 7403 existing records. [2025-10-02T17:35:26.678212] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-07. [2025-10-02T17:35:26.750025] [WARN ] [MAIN ] BGSF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:35:26.750227] [INFO ] [MAIN ] BGSF: Wiping existing primary data before full refresh. [2025-10-02T17:35:26.750331] [INFO ] [LOCAL ] BGSF: Starting deletion of primary data. [2025-10-02T17:35:26.750774] [DEBUG] [LOCAL ] BGSF: Deleted primary data file. [2025-10-02T17:35:26.750838] [INFO ] [MAIN ] BGSF: Starting full primary refresh. [2025-10-02T17:35:27.171941] [INFO ] [REMOTE ] BGSF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:35:27.188415] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-02T17:35:27.473046] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2024-12. [2025-10-02T17:35:27.779927] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-02T17:35:28.063101] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-02T17:35:28.273000] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-01. [2025-10-02T17:35:28.630638] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-02T17:35:29.073004] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-02. [2025-10-02T17:35:29.404487] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-02T17:35:29.873008] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-08. [2025-10-02T17:35:30.672981] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-05. [2025-10-02T17:35:30.814874] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-02T17:35:31.440677] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-02T17:35:31.473010] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-09. [2025-10-02T17:35:32.273012] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-03. [2025-10-02T17:35:32.670713] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-02T17:35:32.848290] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-02T17:35:33.073027] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-06. [2025-10-02T17:35:33.873004] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-10. [2025-10-02T17:35:34.042185] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-02T17:35:34.567720] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-02T17:35:34.569019] [INFO ] [REMOTE ] BGH: Full fetch complete (22455 records). [2025-10-02T17:35:34.569101] [DEBUG] [VALIDATOR ] BGH: Validating primary data. [2025-10-02T17:35:34.678181] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-04. [2025-10-02T17:35:34.987926] [DEBUG] [VALIDATOR ] BGH: All expected trading days are present. [2025-10-02T17:35:34.988036] [DEBUG] [VALIDATOR ] BGH: Primary data validation passed. [2025-10-02T17:35:34.988429] [INFO ] [MAIN ] BGH: Fetched primary data is valid. [2025-10-02T17:35:34.988483] [DEBUG] [LOCAL ] BGH: Saving primary data. [2025-10-02T17:35:34.989250] [DEBUG] [LOCAL ] BGH: Trimmed 22455 records to 17043 (keeping 200 days of data) [2025-10-02T17:35:35.101984] [DEBUG] [LOCAL ] BGH: Primary data saved (17043 records). [2025-10-02T17:35:35.102132] [INFO ] [MAIN ] BGH: Full history saved. [2025-10-02T17:35:35.102215] [INFO ] [MAIN ] Update Progress: 261/2370 symbols completed. BGH took 28.7s. Estimated remaining: 4h 47m 2s. Rate: 7.3 symbols/min [2025-10-02T17:35:35.295007] [INFO ] [MAIN ] BGT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:35:35.314150] [DEBUG] [LOCAL ] BGT: Loaded 16603 existing records from primary storage. [2025-10-02T17:35:35.314466] [INFO ] [MAIN ] BGT: Loaded 16603 existing records. [2025-10-02T17:35:35.416830] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-02T17:35:35.484890] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-01. [2025-10-02T17:35:35.537943] [WARN ] [MAIN ] BGT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:35:35.538194] [INFO ] [MAIN ] BGT: Wiping existing primary data before full refresh. [2025-10-02T17:35:35.538246] [INFO ] [LOCAL ] BGT: Starting deletion of primary data. [2025-10-02T17:35:35.538893] [DEBUG] [LOCAL ] BGT: Deleted primary data file. [2025-10-02T17:35:35.538958] [INFO ] [MAIN ] BGT: Starting full primary refresh. [2025-10-02T17:35:35.951264] [INFO ] [REMOTE ] BGT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:35:36.273022] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-05. [2025-10-02T17:35:36.720575] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-02T17:35:37.073010] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-07. [2025-10-02T17:35:37.344004] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-02T17:35:37.873042] [INFO ] [REMOTE ] BGT: Fetching primary data for 2024-12. [2025-10-02T17:35:38.127359] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-02T17:35:38.584596] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-02T17:35:38.673064] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-01. [2025-10-02T17:35:39.473052] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-06. [2025-10-02T17:35:39.741612] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-02T17:35:40.273904] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-02. [2025-10-02T17:35:40.275980] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-02T17:35:41.073040] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-02. [2025-10-02T17:35:41.872978] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-07. [2025-10-02T17:35:41.931855] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-02T17:35:41.991860] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-02T17:35:42.673013] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-08. [2025-10-02T17:35:43.472993] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-03. [2025-10-02T17:35:43.614625] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-02T17:35:44.273016] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-09. [2025-10-02T17:35:44.456391] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-02T17:35:45.072997] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-04. [2025-10-02T17:35:45.201677] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-02T17:35:45.215297] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-07 (3.34 seconds). [2025-10-02T17:35:45.873059] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-03. [2025-10-02T17:35:46.045971] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-02T17:35:46.672989] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-08. [2025-10-02T17:35:47.464294] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-02T17:35:47.472957] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-09. [2025-10-02T17:35:47.694604] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-02T17:35:48.273011] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-10. [2025-10-02T17:35:48.748151] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-02T17:35:49.073040] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-04. [2025-10-02T17:35:49.123393] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-02T17:35:49.125036] [INFO ] [REMOTE ] BGB: Full fetch complete (27013 records). [2025-10-02T17:35:49.125134] [DEBUG] [VALIDATOR ] BGB: Validating primary data. [2025-10-02T17:35:49.536253] [DEBUG] [VALIDATOR ] BGB: All expected trading days are present. [2025-10-02T17:35:49.536344] [DEBUG] [VALIDATOR ] BGB: Primary data validation passed. [2025-10-02T17:35:49.536793] [INFO ] [MAIN ] BGB: Fetched primary data is valid. [2025-10-02T17:35:49.536857] [DEBUG] [LOCAL ] BGB: Saving primary data. [2025-10-02T17:35:49.537777] [DEBUG] [LOCAL ] BGB: Trimmed 27013 records to 17717 (keeping 200 days of data) [2025-10-02T17:35:49.659769] [DEBUG] [LOCAL ] BGB: Primary data saved (17717 records). [2025-10-02T17:35:49.659930] [INFO ] [MAIN ] BGB: Full history saved. [2025-10-02T17:35:49.660019] [INFO ] [MAIN ] Update Progress: 262/2370 symbols completed. BGB took 53.8s. Estimated remaining: 4h 47m 45s. Rate: 7.3 symbols/min [2025-10-02T17:35:49.847364] [INFO ] [MAIN ] BGX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:35:49.861799] [DEBUG] [LOCAL ] BGX: Loaded 10935 existing records from primary storage. [2025-10-02T17:35:49.862113] [INFO ] [MAIN ] BGX: Loaded 10935 existing records. [2025-10-02T17:35:49.878266] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-05. [2025-10-02T17:35:50.067734] [WARN ] [MAIN ] BGX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:35:50.067985] [INFO ] [MAIN ] BGX: Wiping existing primary data before full refresh. [2025-10-02T17:35:50.068074] [INFO ] [LOCAL ] BGX: Starting deletion of primary data. [2025-10-02T17:35:50.068632] [DEBUG] [LOCAL ] BGX: Deleted primary data file. [2025-10-02T17:35:50.068751] [INFO ] [MAIN ] BGX: Starting full primary refresh. [2025-10-02T17:35:50.455064] [INFO ] [REMOTE ] BGX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:35:50.673005] [INFO ] [REMOTE ] BGX: Fetching primary data for 2024-12. [2025-10-02T17:35:50.863811] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-02T17:35:51.249210] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-02T17:35:51.473014] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-10. [2025-10-02T17:35:51.549060] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-02T17:35:52.273005] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-05. [2025-10-02T17:35:52.483079] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-02T17:35:52.484363] [INFO ] [REMOTE ] BGSF: Full fetch complete (8891 records). [2025-10-02T17:35:52.484434] [DEBUG] [VALIDATOR ] BGSF: Validating primary data. [2025-10-02T17:35:52.912210] [DEBUG] [VALIDATOR ] BGSF: All expected trading days are present. [2025-10-02T17:35:52.912288] [DEBUG] [VALIDATOR ] BGSF: Primary data validation passed. [2025-10-02T17:35:52.912530] [INFO ] [MAIN ] BGSF: Fetched primary data is valid. [2025-10-02T17:35:52.912571] [DEBUG] [LOCAL ] BGSF: Saving primary data. [2025-10-02T17:35:52.913050] [DEBUG] [LOCAL ] BGSF: Trimmed 8891 records to 7557 (keeping 200 days of data) [2025-10-02T17:35:52.962142] [DEBUG] [LOCAL ] BGSF: Primary data saved (7557 records). [2025-10-02T17:35:52.962345] [INFO ] [MAIN ] BGSF: Full history saved. [2025-10-02T17:35:52.962468] [INFO ] [MAIN ] Update Progress: 263/2370 symbols completed. BGSF took 26.6s. Estimated remaining: 4h 46m 58s. Rate: 7.3 symbols/min [2025-10-02T17:35:53.078166] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-06. [2025-10-02T17:35:53.171095] [INFO ] [MAIN ] BGY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:35:53.194396] [DEBUG] [LOCAL ] BGY: Loaded 22399 existing records from primary storage. [2025-10-02T17:35:53.194788] [INFO ] [MAIN ] BGY: Loaded 22399 existing records. [2025-10-02T17:35:53.393919] [WARN ] [MAIN ] BGY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:35:53.394145] [INFO ] [MAIN ] BGY: Wiping existing primary data before full refresh. [2025-10-02T17:35:53.394213] [INFO ] [LOCAL ] BGY: Starting deletion of primary data. [2025-10-02T17:35:53.395119] [DEBUG] [LOCAL ] BGY: Deleted primary data file. [2025-10-02T17:35:53.395184] [INFO ] [MAIN ] BGY: Starting full primary refresh. [2025-10-02T17:35:53.801154] [INFO ] [REMOTE ] BGY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:35:53.872971] [INFO ] [REMOTE ] BGY: Fetching primary data for 2024-12. [2025-10-02T17:35:54.110965] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-02T17:35:54.221571] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-02T17:35:54.672997] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-07. [2025-10-02T17:35:55.040449] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-02T17:35:55.472990] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-01. [2025-10-02T17:35:55.845094] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-02T17:35:56.272984] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-01. [2025-10-02T17:35:56.585590] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-02T17:35:57.072959] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-06. [2025-10-02T17:35:57.082827] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-02T17:35:57.872990] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-02. [2025-10-02T17:35:58.672974] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-08. [2025-10-02T17:35:58.861838] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-02T17:35:58.903073] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-02T17:35:59.472977] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-07. [2025-10-02T17:35:59.625681] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-02T17:36:00.273006] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-09. [2025-10-02T17:36:01.073044] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-02. [2025-10-02T17:36:01.638183] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-02T17:36:01.765608] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-02T17:36:01.840089] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-02T17:36:01.873024] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-03. [2025-10-02T17:36:02.673014] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-03. [2025-10-02T17:36:02.855839] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-02T17:36:03.473023] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-08. [2025-10-02T17:36:04.011227] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-02T17:36:04.273007] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-10. [2025-10-02T17:36:05.073003] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-04. [2025-10-02T17:36:05.273701] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-02T17:36:05.873040] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-04. [2025-10-02T17:36:05.990903] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-02T17:36:05.991989] [INFO ] [REMOTE ] BGT: Full fetch complete (24329 records). [2025-10-02T17:36:05.992068] [DEBUG] [VALIDATOR ] BGT: Validating primary data. [2025-10-02T17:36:06.406363] [DEBUG] [VALIDATOR ] BGT: All expected trading days are present. [2025-10-02T17:36:06.406480] [DEBUG] [VALIDATOR ] BGT: Primary data validation passed. [2025-10-02T17:36:06.407014] [INFO ] [MAIN ] BGT: Fetched primary data is valid. [2025-10-02T17:36:06.407146] [DEBUG] [LOCAL ] BGT: Saving primary data. [2025-10-02T17:36:06.408283] [DEBUG] [LOCAL ] BGT: Trimmed 24329 records to 16702 (keeping 200 days of data) [2025-10-02T17:36:06.529383] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-02T17:36:06.570058] [DEBUG] [LOCAL ] BGT: Primary data saved (16702 records). [2025-10-02T17:36:06.570212] [INFO ] [MAIN ] BGT: Full history saved. [2025-10-02T17:36:06.570298] [INFO ] [MAIN ] Update Progress: 264/2370 symbols completed. BGT took 31.5s. Estimated remaining: 4h 47m 33s. Rate: 7.3 symbols/min [2025-10-02T17:36:06.682510] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-05. [2025-10-02T17:36:06.769521] [INFO ] [MAIN ] BH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:36:06.770142] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-02T17:36:06.789714] [DEBUG] [LOCAL ] BH: Loaded 15869 existing records from primary storage. [2025-10-02T17:36:06.789966] [INFO ] [MAIN ] BH: Loaded 15869 existing records. [2025-10-02T17:36:06.979326] [WARN ] [MAIN ] BH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:36:06.979584] [INFO ] [MAIN ] BH: Wiping existing primary data before full refresh. [2025-10-02T17:36:06.979721] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-10-02T17:36:06.980291] [DEBUG] [LOCAL ] BH: Deleted primary data file. [2025-10-02T17:36:06.980350] [INFO ] [MAIN ] BH: Starting full primary refresh. [2025-10-02T17:36:07.391159] [INFO ] [REMOTE ] BH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:36:07.473027] [INFO ] [REMOTE ] BH: Fetching primary data for 2024-12. [2025-10-02T17:36:07.780131] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-02T17:36:08.272994] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-06. [2025-10-02T17:36:08.515165] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-02T17:36:09.073052] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-01. [2025-10-02T17:36:09.356873] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-02T17:36:09.531951] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-02T17:36:09.873067] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-07. [2025-10-02T17:36:10.672998] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-02. [2025-10-02T17:36:11.115623] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-02T17:36:11.320877] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-02T17:36:11.473065] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-03. [2025-10-02T17:36:12.273019] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-05. [2025-10-02T17:36:12.297897] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-02T17:36:13.072985] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-04. [2025-10-02T17:36:13.299223] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-02T17:36:13.580779] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-02T17:36:13.872998] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-08. [2025-10-02T17:36:14.673050] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-05. [2025-10-02T17:36:15.047193] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-02T17:36:15.260913] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-02T17:36:15.473058] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-06. [2025-10-02T17:36:15.980201] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-02T17:36:16.273049] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-09. [2025-10-02T17:36:17.073046] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-06. [2025-10-02T17:36:17.370266] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-02T17:36:17.873029] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-07. [2025-10-02T17:36:18.097777] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-02T17:36:18.626729] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-02T17:36:18.672985] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-07. [2025-10-02T17:36:19.473004] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-08. [2025-10-02T17:36:19.962300] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-02T17:36:20.257960] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-02T17:36:20.273011] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-09. [2025-10-02T17:36:21.073012] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-08. [2025-10-02T17:36:21.872995] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-10. [2025-10-02T17:36:22.090023] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-02T17:36:22.210967] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-02T17:36:22.583283] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-02T17:36:22.584617] [INFO ] [REMOTE ] BGY: Full fetch complete (33163 records). [2025-10-02T17:36:22.584776] [DEBUG] [VALIDATOR ] BGY: Validating primary data. [2025-10-02T17:36:22.678178] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-09. [2025-10-02T17:36:23.005593] [DEBUG] [VALIDATOR ] BGY: All expected trading days are present. [2025-10-02T17:36:23.005719] [DEBUG] [VALIDATOR ] BGY: Primary data validation passed. [2025-10-02T17:36:23.006234] [INFO ] [MAIN ] BGY: Fetched primary data is valid. [2025-10-02T17:36:23.006301] [DEBUG] [LOCAL ] BGY: Saving primary data. [2025-10-02T17:36:23.007285] [DEBUG] [LOCAL ] BGY: Trimmed 33163 records to 22528 (keeping 200 days of data) [2025-10-02T17:36:23.141366] [DEBUG] [LOCAL ] BGY: Primary data saved (22528 records). [2025-10-02T17:36:23.141491] [INFO ] [MAIN ] BGY: Full history saved. [2025-10-02T17:36:23.141570] [INFO ] [MAIN ] Update Progress: 265/2370 symbols completed. BGY took 30.2s. Estimated remaining: 4h 48m 31s. Rate: 7.3 symbols/min [2025-10-02T17:36:23.322621] [INFO ] [MAIN ] BHC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:36:23.366516] [DEBUG] [LOCAL ] BHC: Loaded 46844 existing records from primary storage. [2025-10-02T17:36:23.366888] [INFO ] [MAIN ] BHC: Loaded 46844 existing records. [2025-10-02T17:36:23.478754] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-10. [2025-10-02T17:36:23.564462] [WARN ] [MAIN ] BHC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:36:23.564709] [INFO ] [MAIN ] BHC: Wiping existing primary data before full refresh. [2025-10-02T17:36:23.564768] [INFO ] [LOCAL ] BHC: Starting deletion of primary data. [2025-10-02T17:36:23.566320] [DEBUG] [LOCAL ] BHC: Deleted primary data file. [2025-10-02T17:36:23.566388] [INFO ] [MAIN ] BHC: Starting full primary refresh. [2025-10-02T17:36:23.904070] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-02T17:36:23.974634] [INFO ] [REMOTE ] BHC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:36:24.273028] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-10. [2025-10-02T17:36:24.806283] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-02T17:36:24.810028] [INFO ] [REMOTE ] BGS: Full fetch complete (72492 records). [2025-10-02T17:36:24.810165] [DEBUG] [VALIDATOR ] BGS: Validating primary data. [2025-10-02T17:36:25.081478] [INFO ] [REMOTE ] BHC: Fetching primary data for 2024-12. [2025-10-02T17:36:25.130085] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-02T17:36:25.172126] [INFO ] [REMOTE ] BH: Full fetch complete (19597 records). [2025-10-02T17:36:25.178164] [DEBUG] [VALIDATOR ] BH: Validating primary data. [2025-10-02T17:36:25.436950] [DEBUG] [VALIDATOR ] BGS: All expected trading days are present. [2025-10-02T17:36:25.437176] [DEBUG] [VALIDATOR ] BGS: Primary data validation passed. [2025-10-02T17:36:25.438802] [INFO ] [MAIN ] BGS: Fetched primary data is valid. [2025-10-02T17:36:25.444704] [DEBUG] [LOCAL ] BGS: Saving primary data. [2025-10-02T17:36:25.505738] [DEBUG] [LOCAL ] BGS: Trimmed 72492 records to 50795 (keeping 200 days of data) [2025-10-02T17:36:25.882869] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-09. [2025-10-02T17:36:25.886374] [DEBUG] [VALIDATOR ] BH: All expected trading days are present. [2025-10-02T17:36:25.890860] [DEBUG] [VALIDATOR ] BH: Primary data validation passed. [2025-10-02T17:36:25.891399] [INFO ] [MAIN ] BH: Fetched primary data is valid. [2025-10-02T17:36:25.892109] [DEBUG] [LOCAL ] BH: Saving primary data. [2025-10-02T17:36:25.896327] [DEBUG] [LOCAL ] BH: Trimmed 19597 records to 15980 (keeping 200 days of data) [2025-10-02T17:36:26.143615] [DEBUG] [LOCAL ] BH: Primary data saved (15980 records). [2025-10-02T17:36:26.144291] [INFO ] [MAIN ] BH: Full history saved. [2025-10-02T17:36:26.144698] [INFO ] [MAIN ] Update Progress: 266/2370 symbols completed. BH took 19.6s. Estimated remaining: 4h 47m 42s. Rate: 7.3 symbols/min [2025-10-02T17:36:26.347113] [INFO ] [MAIN ] BHE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:36:26.380859] [DEBUG] [LOCAL ] BHE: Loaded 24657 existing records from primary storage. [2025-10-02T17:36:26.406884] [INFO ] [MAIN ] BHE: Loaded 24657 existing records. [2025-10-02T17:36:26.640477] [WARN ] [MAIN ] BHE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:36:26.642676] [INFO ] [MAIN ] BHE: Wiping existing primary data before full refresh. [2025-10-02T17:36:26.643209] [INFO ] [LOCAL ] BHE: Starting deletion of primary data. [2025-10-02T17:36:26.646494] [DEBUG] [LOCAL ] BHE: Deleted primary data file. [2025-10-02T17:36:26.646708] [INFO ] [MAIN ] BHE: Starting full primary refresh. [2025-10-02T17:36:26.775106] [DEBUG] [LOCAL ] BGS: Primary data saved (50795 records). [2025-10-02T17:36:26.800896] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-02T17:36:26.801148] [INFO ] [MAIN ] BGS: Full history saved. [2025-10-02T17:36:26.810318] [INFO ] [MAIN ] Update Progress: 267/2370 symbols completed. BGS took 1m 5s. Estimated remaining: 4h 46m 34s. Rate: 7.3 symbols/min [2025-10-02T17:36:26.822164] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-01. [2025-10-02T17:36:27.285039] [INFO ] [REMOTE ] BHE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:36:27.256353] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-02T17:36:27.303010] [INFO ] [MAIN ] BHK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:36:27.308122] [DEBUG] [LOCAL ] BHK: No existing data file found in primary storage. [2025-10-02T17:36:27.308186] [WARN ] [MAIN ] BHK: No existing data found, performing full refresh instead. [2025-10-02T17:36:27.308298] [INFO ] [MAIN ] BHK: Wiping existing primary data before full refresh. [2025-10-02T17:36:27.308342] [INFO ] [LOCAL ] BHK: Starting deletion of primary data. [2025-10-02T17:36:27.308384] [DEBUG] [LOCAL ] BHK: No primary data file found to delete. [2025-10-02T17:36:27.308417] [INFO ] [MAIN ] BHK: Starting full primary refresh. [2025-10-02T17:36:27.477929] [INFO ] [REMOTE ] BHE: Fetching primary data for 2024-12. [2025-10-02T17:36:27.693209] [INFO ] [REMOTE ] BHK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:36:28.273019] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-10. [2025-10-02T17:36:28.493603] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-02T17:36:28.852182] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-02T17:36:28.873862] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-02T17:36:28.875096] [INFO ] [REMOTE ] BGX: Full fetch complete (16208 records). [2025-10-02T17:36:28.875172] [DEBUG] [VALIDATOR ] BGX: Validating primary data. [2025-10-02T17:36:29.078136] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-02. [2025-10-02T17:36:29.277711] [DEBUG] [VALIDATOR ] BGX: All expected trading days are present. [2025-10-02T17:36:29.277816] [DEBUG] [VALIDATOR ] BGX: Primary data validation passed. [2025-10-02T17:36:29.278218] [INFO ] [MAIN ] BGX: Fetched primary data is valid. [2025-10-02T17:36:29.278283] [DEBUG] [LOCAL ] BGX: Saving primary data. [2025-10-02T17:36:29.278990] [DEBUG] [LOCAL ] BGX: Trimmed 16208 records to 11102 (keeping 200 days of data) [2025-10-02T17:36:29.350138] [DEBUG] [LOCAL ] BGX: Primary data saved (11102 records). [2025-10-02T17:36:29.350292] [INFO ] [MAIN ] BGX: Full history saved. [2025-10-02T17:36:29.350387] [INFO ] [MAIN ] Update Progress: 268/2370 symbols completed. BGX took 39.7s. Estimated remaining: 4h 45m 42s. Rate: 7.4 symbols/min [2025-10-02T17:36:29.536700] [INFO ] [MAIN ] BHP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:36:29.596107] [DEBUG] [LOCAL ] BHP: Loaded 53373 existing records from primary storage. [2025-10-02T17:36:29.596530] [INFO ] [MAIN ] BHP: Loaded 53373 existing records. [2025-10-02T17:36:29.791192] [WARN ] [MAIN ] BHP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:36:29.791451] [INFO ] [MAIN ] BHP: Wiping existing primary data before full refresh. [2025-10-02T17:36:29.791507] [INFO ] [LOCAL ] BHP: Starting deletion of primary data. [2025-10-02T17:36:29.793157] [DEBUG] [LOCAL ] BHP: Deleted primary data file. [2025-10-02T17:36:29.793221] [INFO ] [MAIN ] BHP: Starting full primary refresh. [2025-10-02T17:36:29.878165] [INFO ] [REMOTE ] BHK: Fetching primary data for 2024-12. [2025-10-02T17:36:30.180917] [INFO ] [REMOTE ] BHP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:36:30.672994] [INFO ] [REMOTE ] BHP: Fetching primary data for 2024-12. [2025-10-02T17:36:30.787121] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-02T17:36:31.024295] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-02T17:36:31.473038] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-03. [2025-10-02T17:36:32.273059] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-01. [2025-10-02T17:36:32.769225] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-02T17:36:33.029352] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-02T17:36:33.073015] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-01. [2025-10-02T17:36:33.437251] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-02T17:36:33.873031] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-01. [2025-10-02T17:36:34.631556] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-02T17:36:34.673009] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-02. [2025-10-02T17:36:34.998187] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-02T17:36:35.473006] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-02. [2025-10-02T17:36:35.856146] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-02T17:36:36.273001] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-03. [2025-10-02T17:36:37.073000] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-04. [2025-10-02T17:36:37.304983] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-02T17:36:37.669252] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-02T17:36:37.873027] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-02. [2025-10-02T17:36:38.673026] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-04. [2025-10-02T17:36:38.786454] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-02T17:36:38.968314] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-02T17:36:39.473047] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-03. [2025-10-02T17:36:40.168586] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-02T17:36:40.251016] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-02T17:36:40.272976] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-04. [2025-10-02T17:36:41.073000] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-05. [2025-10-02T17:36:41.269905] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-02T17:36:41.873006] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-05. [2025-10-02T17:36:42.451700] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-02T17:36:42.672974] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-06. [2025-10-02T17:36:42.990163] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-02T17:36:43.472995] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-03. [2025-10-02T17:36:43.917633] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-02T17:36:44.273012] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-07. [2025-10-02T17:36:45.073020] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-05. [2025-10-02T17:36:45.660237] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-02T17:36:45.707416] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-02T17:36:45.873052] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-08. [2025-10-02T17:36:46.228423] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-02T17:36:46.673011] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-06. [2025-10-02T17:36:47.469343] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-02T17:36:47.479478] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-04. [2025-10-02T17:36:47.725343] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-02T17:36:48.273020] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-09. [2025-10-02T17:36:49.073028] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-06. [2025-10-02T17:36:49.496068] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-02T17:36:49.788576] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-02T17:36:49.872987] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-05. [2025-10-02T17:36:49.968939] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-02T17:36:50.673001] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-10. [2025-10-02T17:36:51.473002] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-07. [2025-10-02T17:36:51.936595] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-02T17:36:52.018039] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-02T17:36:52.019982] [INFO ] [REMOTE ] BHC: Full fetch complete (66902 records). [2025-10-02T17:36:52.020120] [DEBUG] [VALIDATOR ] BHC: Validating primary data. [2025-10-02T17:36:52.278126] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-06. [2025-10-02T17:36:52.462826] [DEBUG] [VALIDATOR ] BHC: All expected trading days are present. [2025-10-02T17:36:52.462982] [DEBUG] [VALIDATOR ] BHC: Primary data validation passed. [2025-10-02T17:36:52.463816] [INFO ] [MAIN ] BHC: Fetched primary data is valid. [2025-10-02T17:36:52.463891] [DEBUG] [LOCAL ] BHC: Saving primary data. [2025-10-02T17:36:52.465392] [DEBUG] [LOCAL ] BHC: Trimmed 66902 records to 47149 (keeping 200 days of data) [2025-10-02T17:36:52.697164] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-02T17:36:52.772335] [DEBUG] [LOCAL ] BHC: Primary data saved (47149 records). [2025-10-02T17:36:52.772496] [INFO ] [MAIN ] BHC: Full history saved. [2025-10-02T17:36:52.772599] [INFO ] [MAIN ] Update Progress: 269/2370 symbols completed. BHC took 29.6s. Estimated remaining: 4h 47m 33s. Rate: 7.3 symbols/min [2025-10-02T17:36:52.959257] [INFO ] [MAIN ] BHR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:36:52.981016] [DEBUG] [LOCAL ] BHR: Loaded 21361 existing records from primary storage. [2025-10-02T17:36:52.981296] [INFO ] [MAIN ] BHR: Loaded 21361 existing records. [2025-10-02T17:36:53.078973] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-07. [2025-10-02T17:36:53.179591] [WARN ] [MAIN ] BHR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:36:53.179836] [INFO ] [MAIN ] BHR: Wiping existing primary data before full refresh. [2025-10-02T17:36:53.179887] [INFO ] [LOCAL ] BHR: Starting deletion of primary data. [2025-10-02T17:36:53.180941] [DEBUG] [LOCAL ] BHR: Deleted primary data file. [2025-10-02T17:36:53.181010] [INFO ] [MAIN ] BHR: Starting full primary refresh. [2025-10-02T17:36:53.592433] [INFO ] [REMOTE ] BHR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:36:53.873005] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-08. [2025-10-02T17:36:54.100291] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-02T17:36:54.482080] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-02T17:36:54.673069] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-07. [2025-10-02T17:36:55.101070] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-02T17:36:55.473054] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-08. [2025-10-02T17:36:56.273061] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-09. [2025-10-02T17:36:56.677168] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-02T17:36:56.763803] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-02T17:36:57.073019] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-09. [2025-10-02T17:36:57.328201] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-02T17:36:57.873013] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-08. [2025-10-02T17:36:58.281247] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-02T17:36:58.673062] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-10. [2025-10-02T17:36:59.473005] [INFO ] [REMOTE ] BHR: Fetching primary data for 2024-12. [2025-10-02T17:36:59.500431] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-02T17:36:59.501819] [INFO ] [REMOTE ] BHK: Full fetch complete (30270 records). [2025-10-02T17:36:59.501944] [DEBUG] [VALIDATOR ] BHK: Validating primary data. [2025-10-02T17:36:59.928595] [DEBUG] [VALIDATOR ] BHK: All expected trading days are present. [2025-10-02T17:36:59.928764] [DEBUG] [VALIDATOR ] BHK: Primary data validation passed. [2025-10-02T17:36:59.929284] [INFO ] [MAIN ] BHK: Fetched primary data is valid. [2025-10-02T17:36:59.929408] [DEBUG] [LOCAL ] BHK: Saving primary data. [2025-10-02T17:36:59.941214] [DEBUG] [LOCAL ] BHK: Trimmed 30270 records to 23155 (keeping 200 days of data) [2025-10-02T17:36:59.963824] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-02T17:37:00.140347] [DEBUG] [LOCAL ] BHK: Primary data saved (23155 records). [2025-10-02T17:37:00.140535] [INFO ] [MAIN ] BHK: Full history saved. [2025-10-02T17:37:00.140667] [INFO ] [MAIN ] Update Progress: 270/2370 symbols completed. BHK took 33.3s. Estimated remaining: 4h 47m 18s. Rate: 7.3 symbols/min [2025-10-02T17:37:00.278124] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-10. [2025-10-02T17:37:00.340269] [INFO ] [MAIN ] BHV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:37:00.340458] [DEBUG] [LOCAL ] BHV: No existing data file found in primary storage. [2025-10-02T17:37:00.340513] [WARN ] [MAIN ] BHV: No existing data found, performing full refresh instead. [2025-10-02T17:37:00.340630] [INFO ] [MAIN ] BHV: Wiping existing primary data before full refresh. [2025-10-02T17:37:00.340830] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-02T17:37:00.340950] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-02T17:37:00.341003] [INFO ] [MAIN ] BHV: Starting full primary refresh. [2025-10-02T17:37:00.749113] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-02T17:37:00.840914] [INFO ] [REMOTE ] BHV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:37:01.073112] [INFO ] [REMOTE ] BHV: Fetching primary data for 2024-12. [2025-10-02T17:37:01.099501] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-02T17:37:01.101018] [INFO ] [REMOTE ] BHE: Full fetch complete (36502 records). [2025-10-02T17:37:01.101145] [DEBUG] [VALIDATOR ] BHE: Validating primary data. [2025-10-02T17:37:01.710891] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-02T17:37:01.760573] [DEBUG] [VALIDATOR ] BHE: All expected trading days are present. [2025-10-02T17:37:01.760715] [DEBUG] [VALIDATOR ] BHE: Primary data validation passed. [2025-10-02T17:37:01.761358] [INFO ] [MAIN ] BHE: Fetched primary data is valid. [2025-10-02T17:37:01.761419] [DEBUG] [LOCAL ] BHE: Saving primary data. [2025-10-02T17:37:01.762496] [DEBUG] [LOCAL ] BHE: Trimmed 36502 records to 24774 (keeping 200 days of data) [2025-10-02T17:37:01.878856] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-09. [2025-10-02T17:37:01.960217] [DEBUG] [LOCAL ] BHE: Primary data saved (24774 records). [2025-10-02T17:37:01.960381] [INFO ] [MAIN ] BHE: Full history saved. [2025-10-02T17:37:01.960520] [INFO ] [MAIN ] Update Progress: 271/2370 symbols completed. BHE took 35.8s. Estimated remaining: 4h 46m 20s. Rate: 7.3 symbols/min [2025-10-02T17:37:02.212234] [INFO ] [MAIN ] BHVN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:37:02.269338] [DEBUG] [LOCAL ] BHVN: Loaded 49802 existing records from primary storage. [2025-10-02T17:37:02.269781] [INFO ] [MAIN ] BHVN: Loaded 49802 existing records. [2025-10-02T17:37:02.479059] [WARN ] [MAIN ] BHVN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:37:02.479350] [INFO ] [MAIN ] BHVN: Wiping existing primary data before full refresh. [2025-10-02T17:37:02.479412] [INFO ] [LOCAL ] BHVN: Starting deletion of primary data. [2025-10-02T17:37:02.481288] [DEBUG] [LOCAL ] BHVN: Deleted primary data file. [2025-10-02T17:37:02.481371] [INFO ] [MAIN ] BHVN: Starting full primary refresh. [2025-10-02T17:37:02.673008] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-01. [2025-10-02T17:37:02.897434] [INFO ] [REMOTE ] BHVN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:37:03.133528] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-02T17:37:03.473047] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-01. [2025-10-02T17:37:03.919877] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-02T17:37:04.273026] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-02. [2025-10-02T17:37:04.655438] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-02T17:37:04.813759] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-02T17:37:05.073045] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-10. [2025-10-02T17:37:05.873038] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2024-12. [2025-10-02T17:37:06.673025] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-03. [2025-10-02T17:37:06.781092] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-02T17:37:06.783229] [INFO ] [REMOTE ] BHP: Full fetch complete (77248 records). [2025-10-02T17:37:06.783362] [DEBUG] [VALIDATOR ] BHP: Validating primary data. [2025-10-02T17:37:07.086856] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-02T17:37:07.221847] [DEBUG] [VALIDATOR ] BHP: All expected trading days are present. [2025-10-02T17:37:07.221945] [DEBUG] [VALIDATOR ] BHP: Primary data validation passed. [2025-10-02T17:37:07.222812] [INFO ] [MAIN ] BHP: Fetched primary data is valid. [2025-10-02T17:37:07.222881] [DEBUG] [LOCAL ] BHP: Saving primary data. [2025-10-02T17:37:07.224554] [DEBUG] [LOCAL ] BHP: Trimmed 77248 records to 53758 (keeping 200 days of data) [2025-10-02T17:37:07.473112] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-02. [2025-10-02T17:37:07.604553] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-02T17:37:07.621598] [DEBUG] [LOCAL ] BHP: Primary data saved (53758 records). [2025-10-02T17:37:07.621770] [INFO ] [MAIN ] BHP: Full history saved. [2025-10-02T17:37:07.621861] [INFO ] [MAIN ] Update Progress: 272/2370 symbols completed. BHP took 38.3s. Estimated remaining: 4h 45m 53s. Rate: 7.3 symbols/min [2025-10-02T17:37:07.806011] [INFO ] [MAIN ] BILL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:37:07.857128] [DEBUG] [LOCAL ] BILL: Loaded 52336 existing records from primary storage. [2025-10-02T17:37:07.857466] [INFO ] [MAIN ] BILL: Loaded 52336 existing records. [2025-10-02T17:37:08.046945] [WARN ] [MAIN ] BILL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:37:08.047245] [INFO ] [MAIN ] BILL: Wiping existing primary data before full refresh. [2025-10-02T17:37:08.047304] [INFO ] [LOCAL ] BILL: Starting deletion of primary data. [2025-10-02T17:37:08.048838] [DEBUG] [LOCAL ] BILL: Deleted primary data file. [2025-10-02T17:37:08.048985] [INFO ] [MAIN ] BILL: Starting full primary refresh. [2025-10-02T17:37:08.280222] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-04. [2025-10-02T17:37:08.451947] [INFO ] [REMOTE ] BILL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:37:08.471165] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-02T17:37:08.690674] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-02T17:37:09.073041] [INFO ] [REMOTE ] BILL: Fetching primary data for 2024-12. [2025-10-02T17:37:09.873024] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-05. [2025-10-02T17:37:10.160531] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-02T17:37:10.672993] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-01. [2025-10-02T17:37:10.937548] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-02T17:37:11.473042] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-01. [2025-10-02T17:37:12.124822] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-02T17:37:12.273027] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-03. [2025-10-02T17:37:13.072979] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-06. [2025-10-02T17:37:13.116946] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-02T17:37:13.416973] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-02T17:37:13.573230] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-02T17:37:13.873025] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-04. [2025-10-02T17:37:14.673044] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-02. [2025-10-02T17:37:15.123185] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-02T17:37:15.473038] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-02. [2025-10-02T17:37:16.273007] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-07. [2025-10-02T17:37:16.644854] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-02T17:37:16.695681] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-02T17:37:16.894723] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-02T17:37:17.073015] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-03. [2025-10-02T17:37:17.873008] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-05. [2025-10-02T17:37:18.672974] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-08. [2025-10-02T17:37:18.869830] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-02T17:37:18.994272] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-02T17:37:19.107600] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-02T17:37:19.473049] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-09. [2025-10-02T17:37:19.939179] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-02T17:37:20.273036] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-03. [2025-10-02T17:37:21.073010] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-10. [2025-10-02T17:37:21.496578] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-02T17:37:21.497296] [INFO ] [REMOTE ] BHV: Full fetch complete (1373 records). [2025-10-02T17:37:21.497369] [DEBUG] [VALIDATOR ] BHV: Validating primary data. [2025-10-02T17:37:21.703624] [WARN ] [VALIDATOR ] BHV: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-02T17:37:21.703873] [FATAL] [MAIN ] BHV: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:37:21.703946] [WARN ] [MAIN ] BHV: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:37:21.704030] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-02T17:37:21.704149] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-02T17:37:21.704208] [INFO ] [LOCAL ] BHV: Starting deletion of derivative data. [2025-10-02T17:37:21.704270] [DEBUG] [LOCAL ] BHV: No derivative data file found to delete. [2025-10-02T17:37:21.704359] [INFO ] [MAIN ] Update Progress: 273/2370 symbols completed. BHV took 21.6s. Estimated remaining: 4h 46m 30s. Rate: 7.3 symbols/min [2025-10-02T17:37:21.878184] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-06. [2025-10-02T17:37:21.908776] [INFO ] [MAIN ] BIO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:37:21.935436] [DEBUG] [LOCAL ] BIO: Loaded 24947 existing records from primary storage. [2025-10-02T17:37:21.935741] [INFO ] [MAIN ] BIO: Loaded 24947 existing records. [2025-10-02T17:37:22.161787] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-02T17:37:22.185070] [WARN ] [MAIN ] BIO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:37:22.185557] [INFO ] [MAIN ] BIO: Wiping existing primary data before full refresh. [2025-10-02T17:37:22.185703] [INFO ] [LOCAL ] BIO: Starting deletion of primary data. [2025-10-02T17:37:22.196554] [DEBUG] [LOCAL ] BIO: Deleted primary data file. [2025-10-02T17:37:22.196690] [INFO ] [MAIN ] BIO: Starting full primary refresh. [2025-10-02T17:37:22.587093] [INFO ] [REMOTE ] BIO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:37:22.649763] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-02T17:37:22.673021] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-04. [2025-10-02T17:37:23.473028] [INFO ] [REMOTE ] BIO: Fetching primary data for 2024-12. [2025-10-02T17:37:24.273008] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-07. [2025-10-02T17:37:24.560807] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-02T17:37:24.593335] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-02T17:37:25.073005] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-01. [2025-10-02T17:37:25.127292] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-02T17:37:25.872983] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-08. [2025-10-02T17:37:26.109730] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-02T17:37:26.673023] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-02. [2025-10-02T17:37:26.926973] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-02T17:37:27.473001] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-04. [2025-10-02T17:37:27.815473] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-02T17:37:28.273061] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-05. [2025-10-02T17:37:29.072978] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-09. [2025-10-02T17:37:29.207612] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-02T17:37:29.873004] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-05. [2025-10-02T17:37:30.030939] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-02T17:37:30.274887] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-02T17:37:30.673036] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-10. [2025-10-02T17:37:31.316607] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-02T17:37:31.473022] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-06. [2025-10-02T17:37:31.566485] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-02T17:37:31.567978] [INFO ] [REMOTE ] BHR: Full fetch complete (30803 records). [2025-10-02T17:37:31.568198] [DEBUG] [VALIDATOR ] BHR: Validating primary data. [2025-10-02T17:37:32.031870] [DEBUG] [VALIDATOR ] BHR: All expected trading days are present. [2025-10-02T17:37:32.031960] [DEBUG] [VALIDATOR ] BHR: Primary data validation passed. [2025-10-02T17:37:32.032481] [INFO ] [MAIN ] BHR: Fetched primary data is valid. [2025-10-02T17:37:32.032550] [DEBUG] [LOCAL ] BHR: Saving primary data. [2025-10-02T17:37:32.033631] [DEBUG] [LOCAL ] BHR: Trimmed 30803 records to 21586 (keeping 200 days of data) [2025-10-02T17:37:32.171032] [DEBUG] [LOCAL ] BHR: Primary data saved (21586 records). [2025-10-02T17:37:32.171158] [INFO ] [MAIN ] BHR: Full history saved. [2025-10-02T17:37:32.171270] [INFO ] [MAIN ] Update Progress: 274/2370 symbols completed. BHR took 39.4s. Estimated remaining: 4h 46m 39s. Rate: 7.3 symbols/min [2025-10-02T17:37:32.282889] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-06. [2025-10-02T17:37:32.364070] [INFO ] [MAIN ] BIP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:37:32.409301] [DEBUG] [LOCAL ] BIP: Loaded 39543 existing records from primary storage. [2025-10-02T17:37:32.409622] [INFO ] [MAIN ] BIP: Loaded 39543 existing records. [2025-10-02T17:37:32.605058] [WARN ] [MAIN ] BIP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:37:32.605336] [INFO ] [MAIN ] BIP: Wiping existing primary data before full refresh. [2025-10-02T17:37:32.605452] [INFO ] [LOCAL ] BIP: Starting deletion of primary data. [2025-10-02T17:37:32.606821] [DEBUG] [LOCAL ] BIP: Deleted primary data file. [2025-10-02T17:37:32.606885] [INFO ] [MAIN ] BIP: Starting full primary refresh. [2025-10-02T17:37:32.999492] [INFO ] [REMOTE ] BIP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:37:33.073038] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-03. [2025-10-02T17:37:33.233418] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-02T17:37:33.873021] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-07. [2025-10-02T17:37:33.954441] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-02T17:37:34.028218] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-02T17:37:34.673000] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-04. [2025-10-02T17:37:35.361327] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-02T17:37:35.473042] [INFO ] [REMOTE ] BIP: Fetching primary data for 2024-12. [2025-10-02T17:37:36.099367] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-02T17:37:36.273030] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-08. [2025-10-02T17:37:36.645129] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-02T17:37:37.073113] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-01. [2025-10-02T17:37:37.873026] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-07. [2025-10-02T17:37:38.214858] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-02T17:37:38.249429] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-02T17:37:38.673021] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-05. [2025-10-02T17:37:39.472993] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-09. [2025-10-02T17:37:39.790817] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-02T17:37:39.979902] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-02T17:37:40.273034] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-06. [2025-10-02T17:37:41.058984] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-02T17:37:41.072989] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-08. [2025-10-02T17:37:41.534313] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-02T17:37:41.872992] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-07. [2025-10-02T17:37:42.458531] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-02T17:37:42.672983] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-09. [2025-10-02T17:37:42.831524] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-02T17:37:43.473025] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-08. [2025-10-02T17:37:44.272999] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-10. [2025-10-02T17:37:44.579265] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-02T17:37:44.607854] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-02T17:37:45.073032] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-02. [2025-10-02T17:37:45.873023] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-10. [2025-10-02T17:37:45.994996] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-02T17:37:45.997425] [INFO ] [REMOTE ] BHVN: Full fetch complete (69987 records). [2025-10-02T17:37:45.997546] [DEBUG] [VALIDATOR ] BHVN: Validating primary data. [2025-10-02T17:37:46.433188] [DEBUG] [VALIDATOR ] BHVN: All expected trading days are present. [2025-10-02T17:37:46.433337] [DEBUG] [VALIDATOR ] BHVN: Primary data validation passed. [2025-10-02T17:37:46.434453] [INFO ] [MAIN ] BHVN: Fetched primary data is valid. [2025-10-02T17:37:46.434550] [DEBUG] [LOCAL ] BHVN: Saving primary data. [2025-10-02T17:37:46.436819] [DEBUG] [LOCAL ] BHVN: Trimmed 69987 records to 50165 (keeping 200 days of data) [2025-10-02T17:37:46.608016] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-02T17:37:46.676461] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-09. [2025-10-02T17:37:46.823960] [DEBUG] [LOCAL ] BHVN: Primary data saved (50165 records). [2025-10-02T17:37:46.824173] [INFO ] [MAIN ] BHVN: Full history saved. [2025-10-02T17:37:46.825221] [INFO ] [MAIN ] Update Progress: 275/2370 symbols completed. BHVN took 44.9s. Estimated remaining: 4h 47m 20s. Rate: 7.3 symbols/min [2025-10-02T17:37:47.023372] [INFO ] [MAIN ] BIPC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:37:47.023666] [DEBUG] [LOCAL ] BIPC: No existing data file found in primary storage. [2025-10-02T17:37:47.023735] [WARN ] [MAIN ] BIPC: No existing data found, performing full refresh instead. [2025-10-02T17:37:47.023872] [INFO ] [MAIN ] BIPC: Wiping existing primary data before full refresh. [2025-10-02T17:37:47.023925] [INFO ] [LOCAL ] BIPC: Starting deletion of primary data. [2025-10-02T17:37:47.023971] [DEBUG] [LOCAL ] BIPC: No primary data file found to delete. [2025-10-02T17:37:47.024007] [INFO ] [MAIN ] BIPC: Starting full primary refresh. [2025-10-02T17:37:47.408495] [INFO ] [REMOTE ] BIPC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:37:47.472965] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2024-12. [2025-10-02T17:37:47.504321] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-02T17:37:47.994706] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-02T17:37:47.997419] [INFO ] [REMOTE ] BILL: Full fetch complete (75691 records). [2025-10-02T17:37:47.997560] [DEBUG] [VALIDATOR ] BILL: Validating primary data. [2025-10-02T17:37:48.282868] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-10. [2025-10-02T17:37:48.443346] [DEBUG] [VALIDATOR ] BILL: All expected trading days are present. [2025-10-02T17:37:48.443457] [DEBUG] [VALIDATOR ] BILL: Primary data validation passed. [2025-10-02T17:37:48.444362] [INFO ] [MAIN ] BILL: Fetched primary data is valid. [2025-10-02T17:37:48.444447] [DEBUG] [LOCAL ] BILL: Saving primary data. [2025-10-02T17:37:48.446138] [DEBUG] [LOCAL ] BILL: Trimmed 75691 records to 52726 (keeping 200 days of data) [2025-10-02T17:37:48.777076] [DEBUG] [LOCAL ] BILL: Primary data saved (52726 records). [2025-10-02T17:37:48.777269] [INFO ] [MAIN ] BILL: Full history saved. [2025-10-02T17:37:48.777398] [INFO ] [MAIN ] Update Progress: 276/2370 symbols completed. BILL took 41.2s. Estimated remaining: 4h 46m 24s. Rate: 7.3 symbols/min [2025-10-02T17:37:48.967143] [INFO ] [MAIN ] BIPH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:37:48.972712] [DEBUG] [LOCAL ] BIPH: Loaded 2578 existing records from primary storage. [2025-10-02T17:37:48.973014] [INFO ] [MAIN ] BIPH: Loaded 2578 existing records. [2025-10-02T17:37:49.075763] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-03. [2025-10-02T17:37:49.210092] [WARN ] [MAIN ] BIPH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:37:49.203288] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-02T17:37:49.210830] [INFO ] [MAIN ] BIPH: Wiping existing primary data before full refresh. [2025-10-02T17:37:49.221185] [INFO ] [LOCAL ] BIPH: Starting deletion of primary data. [2025-10-02T17:37:49.226539] [DEBUG] [LOCAL ] BIPH: Deleted primary data file. [2025-10-02T17:37:49.226639] [INFO ] [MAIN ] BIPH: Starting full primary refresh. [2025-10-02T17:37:49.226911] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-02T17:37:49.303150] [INFO ] [REMOTE ] BIO: Full fetch complete (34226 records). [2025-10-02T17:37:49.316387] [DEBUG] [VALIDATOR ] BIO: Validating primary data. [2025-10-02T17:37:49.875861] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-01. [2025-10-02T17:37:50.065165] [DEBUG] [VALIDATOR ] BIO: All expected trading days are present. [2025-10-02T17:37:50.071874] [DEBUG] [VALIDATOR ] BIO: Primary data validation passed. [2025-10-02T17:37:50.071791] [INFO ] [REMOTE ] BIPH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:37:50.072699] [INFO ] [MAIN ] BIO: Fetched primary data is valid. [2025-10-02T17:37:50.072798] [DEBUG] [LOCAL ] BIO: Saving primary data. [2025-10-02T17:37:50.074099] [DEBUG] [LOCAL ] BIO: Trimmed 34226 records to 25067 (keeping 200 days of data) [2025-10-02T17:37:50.247672] [DEBUG] [LOCAL ] BIO: Primary data saved (25067 records). [2025-10-02T17:37:50.247821] [INFO ] [MAIN ] BIO: Full history saved. [2025-10-02T17:37:50.247911] [INFO ] [MAIN ] Update Progress: 277/2370 symbols completed. BIO took 28.5s. Estimated remaining: 4h 45m 25s. Rate: 7.3 symbols/min [2025-10-02T17:37:50.673023] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2024-12. [2025-10-02T17:37:50.935034] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-02T17:37:51.421576] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-02T17:37:51.423289] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-02T17:37:51.472988] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-01. [2025-10-02T17:37:51.871105] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-02T17:37:52.272998] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-02. [2025-10-02T17:37:52.762208] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-02T17:37:53.073075] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-03. [2025-10-02T17:37:53.655982] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-02T17:37:53.873065] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-04. [2025-10-02T17:37:54.673025] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-04. [2025-10-02T17:37:55.072882] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-02T17:37:55.478080] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-05. [2025-10-02T17:37:55.492264] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-02T17:37:55.956501] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-02T17:37:56.273034] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-05. [2025-10-02T17:37:57.073013] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-02. [2025-10-02T17:37:57.666934] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-02T17:37:57.873014] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-06. [2025-10-02T17:37:58.119054] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-02T17:37:58.307750] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-02T17:37:58.672998] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-07. [2025-10-02T17:37:59.130759] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-02T17:37:59.473007] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-06. [2025-10-02T17:38:00.273064] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-03. [2025-10-02T17:38:01.073007] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-08. [2025-10-02T17:38:01.304635] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-02T17:38:01.627783] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-02T17:38:01.872970] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-09. [2025-10-02T17:38:01.927009] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-02T17:38:02.185470] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-02T17:38:02.672995] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-10. [2025-10-02T17:38:03.095780] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-02T17:38:03.096536] [INFO ] [REMOTE ] BIPH: Full fetch complete (4296 records). [2025-10-02T17:38:03.096609] [DEBUG] [VALIDATOR ] BIPH: Validating primary data. [2025-10-02T17:38:03.097046] [FATAL] [VALIDATOR ] BIPH: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:38:03.097131] [FATAL] [MAIN ] BIPH: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:38:03.097183] [WARN ] [MAIN ] BIPH: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:38:03.097276] [INFO ] [LOCAL ] BIPH: Starting deletion of primary data. [2025-10-02T17:38:03.097389] [DEBUG] [LOCAL ] BIPH: No primary data file found to delete. [2025-10-02T17:38:03.097476] [INFO ] [LOCAL ] BIPH: Starting deletion of derivative data. [2025-10-02T17:38:03.097977] [DEBUG] [LOCAL ] BIPH: Deleted derivative data file. [2025-10-02T17:38:03.098099] [INFO ] [MAIN ] Update Progress: 278/2370 symbols completed. BIPH took 14.3s. Estimated remaining: 4h 45m 52s. Rate: 7.3 symbols/min [2025-10-02T17:38:03.473030] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-07. [2025-10-02T17:38:04.273034] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-04. [2025-10-02T17:38:04.969349] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-02T17:38:05.073016] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-08. [2025-10-02T17:38:05.889580] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-02T17:38:05.899592] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-05. [2025-10-02T17:38:06.544092] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-02T17:38:06.672976] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-09. [2025-10-02T17:38:07.475843] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-02T17:38:07.485184] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-06. [2025-10-02T17:38:08.122136] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-02T17:38:08.273033] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-10. [2025-10-02T17:38:08.696258] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-02T17:38:09.073048] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-07. [2025-10-02T17:38:09.555710] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-02T17:38:09.557474] [INFO ] [REMOTE ] BIP: Full fetch complete (56929 records). [2025-10-02T17:38:09.557574] [DEBUG] [VALIDATOR ] BIP: Validating primary data. [2025-10-02T17:38:09.981600] [DEBUG] [VALIDATOR ] BIP: All expected trading days are present. [2025-10-02T17:38:09.981711] [DEBUG] [VALIDATOR ] BIP: Primary data validation passed. [2025-10-02T17:38:09.982336] [INFO ] [MAIN ] BIP: Fetched primary data is valid. [2025-10-02T17:38:09.982379] [DEBUG] [LOCAL ] BIP: Saving primary data. [2025-10-02T17:38:09.983560] [DEBUG] [LOCAL ] BIP: Trimmed 56929 records to 39822 (keeping 200 days of data) [2025-10-02T17:38:10.234044] [DEBUG] [LOCAL ] BIP: Primary data saved (39822 records). [2025-10-02T17:38:10.234191] [INFO ] [MAIN ] BIP: Full history saved. [2025-10-02T17:38:10.234275] [INFO ] [MAIN ] Update Progress: 279/2370 symbols completed. BIP took 38.1s. Estimated remaining: 4h 45m 36s. Rate: 7.3 symbols/min [2025-10-02T17:38:10.616947] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-02T17:38:10.628375] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-08. [2025-10-02T17:38:11.807281] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-02T17:38:11.816684] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-09. [2025-10-02T17:38:13.485859] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-02T17:38:13.495169] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-10. [2025-10-02T17:38:14.737744] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-02T17:38:14.744344] [INFO ] [REMOTE ] BIPC: Full fetch complete (59899 records). [2025-10-02T17:38:14.745285] [DEBUG] [VALIDATOR ] BIPC: Validating primary data. [2025-10-02T17:38:15.165522] [DEBUG] [VALIDATOR ] BIPC: All expected trading days are present. [2025-10-02T17:38:15.165619] [DEBUG] [VALIDATOR ] BIPC: Primary data validation passed. [2025-10-02T17:38:15.166369] [INFO ] [MAIN ] BIPC: Fetched primary data is valid. [2025-10-02T17:38:15.166430] [DEBUG] [LOCAL ] BIPC: Saving primary data. [2025-10-02T17:38:15.167857] [DEBUG] [LOCAL ] BIPC: Trimmed 59899 records to 41695 (keeping 200 days of data) [2025-10-02T17:38:15.439536] [DEBUG] [LOCAL ] BIPC: Primary data saved (41695 records). [2025-10-02T17:38:15.439693] [INFO ] [MAIN ] BIPC: Full history saved. [2025-10-02T17:38:15.439777] [INFO ] [MAIN ] Update Progress: 280/2370 symbols completed. BIPC took 28.6s. Estimated remaining: 4h 45m 5s. Rate: 7.3 symbols/min [2025-10-02T17:38:16.035945] [INFO ] [MAIN ] BIPJ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:38:16.162927] [INFO ] [MAIN ] BIRK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:38:16.190045] [INFO ] [MAIN ] BIT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:38:16.226120] [INFO ] [MAIN ] BIPI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:38:16.229670] [DEBUG] [LOCAL ] BIPJ: Loaded 3132 existing records from primary storage. [2025-10-02T17:38:16.230036] [INFO ] [MAIN ] BIPJ: Loaded 3132 existing records. [2025-10-02T17:38:16.306231] [DEBUG] [LOCAL ] BIPI: Loaded 3202 existing records from primary storage. [2025-10-02T17:38:16.322622] [INFO ] [MAIN ] BIPI: Loaded 3202 existing records. [2025-10-02T17:38:16.538895] [DEBUG] [LOCAL ] BIT: Loaded 22791 existing records from primary storage. [2025-10-02T17:38:16.609495] [INFO ] [MAIN ] BIT: Loaded 22791 existing records. [2025-10-02T17:38:16.609050] [WARN ] [MAIN ] BIPJ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:38:16.648470] [INFO ] [MAIN ] BIPJ: Wiping existing primary data before full refresh. [2025-10-02T17:38:16.684145] [INFO ] [LOCAL ] BIPJ: Starting deletion of primary data. [2025-10-02T17:38:16.797123] [DEBUG] [LOCAL ] BIPJ: Deleted primary data file. [2025-10-02T17:38:16.791898] [DEBUG] [LOCAL ] BIRK: Loaded 50925 existing records from primary storage. [2025-10-02T17:38:16.818825] [INFO ] [MAIN ] BIRK: Loaded 50925 existing records. [2025-10-02T17:38:16.818632] [INFO ] [MAIN ] BIPJ: Starting full primary refresh. [2025-10-02T17:38:16.908272] [WARN ] [MAIN ] BIPI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:38:16.933214] [INFO ] [MAIN ] BIPI: Wiping existing primary data before full refresh. [2025-10-02T17:38:16.972778] [INFO ] [LOCAL ] BIPI: Starting deletion of primary data. [2025-10-02T17:38:17.036603] [WARN ] [MAIN ] BIT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:38:17.042101] [DEBUG] [LOCAL ] BIPI: Deleted primary data file. [2025-10-02T17:38:17.095778] [INFO ] [MAIN ] BIT: Wiping existing primary data before full refresh. [2025-10-02T17:38:17.106176] [INFO ] [MAIN ] BIPI: Starting full primary refresh. [2025-10-02T17:38:17.127132] [INFO ] [LOCAL ] BIT: Starting deletion of primary data. [2025-10-02T17:38:17.216720] [DEBUG] [LOCAL ] BIT: Deleted primary data file. [2025-10-02T17:38:17.330108] [INFO ] [MAIN ] BIT: Starting full primary refresh. [2025-10-02T17:38:17.476216] [WARN ] [MAIN ] BIRK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:38:17.732408] [INFO ] [MAIN ] BIRK: Wiping existing primary data before full refresh. [2025-10-02T17:38:17.790396] [INFO ] [LOCAL ] BIRK: Starting deletion of primary data. [2025-10-02T17:38:17.836976] [DEBUG] [LOCAL ] BIRK: Deleted primary data file. [2025-10-02T17:38:17.880310] [INFO ] [MAIN ] BIRK: Starting full primary refresh. [2025-10-02T17:38:18.247633] [INFO ] [REMOTE ] BIPJ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:38:18.310867] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2024-12. [2025-10-02T17:38:18.547237] [INFO ] [REMOTE ] BIPI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:38:18.628961] [INFO ] [REMOTE ] BIT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:38:18.624898] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2024-12. [2025-10-02T17:38:18.653129] [INFO ] [REMOTE ] BIT: Fetching primary data for 2024-12. [2025-10-02T17:38:18.796304] [INFO ] [REMOTE ] BIRK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:38:18.796669] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2024-12. [2025-10-02T17:38:19.048356] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-02T17:38:19.050156] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-01. [2025-10-02T17:38:19.394718] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-02T17:38:19.396934] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-01. [2025-10-02T17:38:19.534055] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-02T17:38:19.535453] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-02. [2025-10-02T17:38:19.604070] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-02T17:38:19.609295] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-01. [2025-10-02T17:38:19.916366] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-02T17:38:19.917915] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-02. [2025-10-02T17:38:20.020842] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-02T17:38:20.022436] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-03. [2025-10-02T17:38:20.427827] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-02T17:38:20.429402] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-03. [2025-10-02T17:38:20.460215] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-02T17:38:20.586559] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-02T17:38:20.599194] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-02T17:38:21.073010] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-02. [2025-10-02T17:38:21.142551] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-02T17:38:21.758626] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-02T17:38:21.872992] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-03. [2025-10-02T17:38:22.673006] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-04. [2025-10-02T17:38:22.974820] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-02T17:38:23.234108] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-02T17:38:23.473001] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-04. [2025-10-02T17:38:24.057827] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-02T17:38:24.273014] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-05. [2025-10-02T17:38:24.583764] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-02T17:38:25.073005] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-05. [2025-10-02T17:38:25.516066] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-02T17:38:25.873014] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-04. [2025-10-02T17:38:26.672996] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-06. [2025-10-02T17:38:26.926624] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-02T17:38:27.137506] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-02T17:38:27.472997] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-07. [2025-10-02T17:38:28.053267] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-02T17:38:28.273011] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-01. [2025-10-02T17:38:29.073012] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-06. [2025-10-02T17:38:29.741290] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-02T17:38:29.873033] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-07. [2025-10-02T17:38:29.994832] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-02T17:38:30.448244] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-02T17:38:30.673011] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-05. [2025-10-02T17:38:31.473009] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-02. [2025-10-02T17:38:31.754264] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-02T17:38:32.273027] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-08. [2025-10-02T17:38:32.755258] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-02T17:38:33.072996] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-09. [2025-10-02T17:38:33.155761] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-02T17:38:33.527909] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-02T17:38:33.872986] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-03. [2025-10-02T17:38:34.673028] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-10. [2025-10-02T17:38:35.157725] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-02T17:38:35.158675] [INFO ] [REMOTE ] BIPJ: Full fetch complete (4436 records). [2025-10-02T17:38:35.158763] [DEBUG] [VALIDATOR ] BIPJ: Validating primary data. [2025-10-02T17:38:35.475058] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-06. [2025-10-02T17:38:35.589912] [DEBUG] [VALIDATOR ] BIPJ: All expected trading days are present. [2025-10-02T17:38:35.590047] [DEBUG] [VALIDATOR ] BIPJ: Primary data validation passed. [2025-10-02T17:38:35.590203] [INFO ] [MAIN ] BIPJ: Fetched primary data is valid. [2025-10-02T17:38:35.590494] [DEBUG] [LOCAL ] BIPJ: Saving primary data. [2025-10-02T17:38:35.591269] [DEBUG] [LOCAL ] BIPJ: Trimmed 4436 records to 3136 (keeping 200 days of data) [2025-10-02T17:38:35.613149] [DEBUG] [LOCAL ] BIPJ: Primary data saved (3136 records). [2025-10-02T17:38:35.613301] [INFO ] [MAIN ] BIPJ: Full history saved. [2025-10-02T17:38:35.613417] [INFO ] [MAIN ] Update Progress: 281/2370 symbols completed. BIPJ took 20.2s. Estimated remaining: 4h 46m 26s. Rate: 7.3 symbols/min [2025-10-02T17:38:35.750706] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-02T17:38:35.882886] [INFO ] [MAIN ] BJ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:38:35.936928] [DEBUG] [LOCAL ] BJ: Loaded 51373 existing records from primary storage. [2025-10-02T17:38:35.937237] [INFO ] [MAIN ] BJ: Loaded 51373 existing records. [2025-10-02T17:38:36.134972] [WARN ] [MAIN ] BJ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:38:36.135190] [INFO ] [MAIN ] BJ: Wiping existing primary data before full refresh. [2025-10-02T17:38:36.135239] [INFO ] [LOCAL ] BJ: Starting deletion of primary data. [2025-10-02T17:38:36.136941] [DEBUG] [LOCAL ] BJ: Deleted primary data file. [2025-10-02T17:38:36.137005] [INFO ] [MAIN ] BJ: Starting full primary refresh. [2025-10-02T17:38:36.278097] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-08. [2025-10-02T17:38:36.459976] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-02T17:38:36.579165] [INFO ] [REMOTE ] BJ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:38:36.932840] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-02T17:38:37.073001] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-09. [2025-10-02T17:38:37.703827] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-02T17:38:37.873001] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-10. [2025-10-02T17:38:38.316319] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-02T17:38:38.317064] [INFO ] [REMOTE ] BIPI: Full fetch complete (5116 records). [2025-10-02T17:38:38.317136] [DEBUG] [VALIDATOR ] BIPI: Validating primary data. [2025-10-02T17:38:38.678152] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-04. [2025-10-02T17:38:38.712242] [DEBUG] [VALIDATOR ] BIPI: All expected trading days are present. [2025-10-02T17:38:38.712332] [DEBUG] [VALIDATOR ] BIPI: Primary data validation passed. [2025-10-02T17:38:38.712500] [INFO ] [MAIN ] BIPI: Fetched primary data is valid. [2025-10-02T17:38:38.712541] [DEBUG] [LOCAL ] BIPI: Saving primary data. [2025-10-02T17:38:38.713046] [DEBUG] [LOCAL ] BIPI: Trimmed 5116 records to 3215 (keeping 200 days of data) [2025-10-02T17:38:38.734714] [DEBUG] [LOCAL ] BIPI: Primary data saved (3215 records). [2025-10-02T17:38:38.734830] [INFO ] [MAIN ] BIPI: Full history saved. [2025-10-02T17:38:38.734914] [INFO ] [MAIN ] Update Progress: 282/2370 symbols completed. BIPI took 23.3s. Estimated remaining: 4h 45m 40s. Rate: 7.3 symbols/min [2025-10-02T17:38:38.917669] [INFO ] [MAIN ] BK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:38:38.975072] [DEBUG] [LOCAL ] BK: Loaded 53537 existing records from primary storage. [2025-10-02T17:38:38.975464] [INFO ] [MAIN ] BK: Loaded 53537 existing records. [2025-10-02T17:38:39.175019] [WARN ] [MAIN ] BK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:38:39.175311] [INFO ] [MAIN ] BK: Wiping existing primary data before full refresh. [2025-10-02T17:38:39.175403] [INFO ] [LOCAL ] BK: Starting deletion of primary data. [2025-10-02T17:38:39.177124] [DEBUG] [LOCAL ] BK: Deleted primary data file. [2025-10-02T17:38:39.177216] [INFO ] [MAIN ] BK: Starting full primary refresh. [2025-10-02T17:38:39.478678] [INFO ] [REMOTE ] BJ: Fetching primary data for 2024-12. [2025-10-02T17:38:39.577792] [INFO ] [REMOTE ] BK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:38:40.273017] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-07. [2025-10-02T17:38:40.391109] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-02T17:38:41.073000] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-05. [2025-10-02T17:38:41.150725] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-02T17:38:41.408858] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-02T17:38:41.873001] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-01. [2025-10-02T17:38:42.673020] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-08. [2025-10-02T17:38:42.896290] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-02T17:38:43.196818] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-02T17:38:43.473001] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-06. [2025-10-02T17:38:43.897946] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-02T17:38:44.272991] [INFO ] [REMOTE ] BK: Fetching primary data for 2024-12. [2025-10-02T17:38:45.072975] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-09. [2025-10-02T17:38:45.113418] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-02T17:38:45.757819] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-02T17:38:45.873024] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-07. [2025-10-02T17:38:46.507726] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-02T17:38:46.673054] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-01. [2025-10-02T17:38:47.473040] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-02. [2025-10-02T17:38:47.723045] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-02T17:38:48.272976] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-08. [2025-10-02T17:38:48.466663] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-02T17:38:49.049024] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-02T17:38:49.072966] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-03. [2025-10-02T17:38:49.568217] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-02T17:38:49.873011] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-10. [2025-10-02T17:38:50.673004] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-02. [2025-10-02T17:38:50.808067] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-02T17:38:50.959525] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-02T17:38:50.961060] [INFO ] [REMOTE ] BIT: Full fetch complete (31781 records). [2025-10-02T17:38:50.961157] [DEBUG] [VALIDATOR ] BIT: Validating primary data. [2025-10-02T17:38:51.353909] [DEBUG] [VALIDATOR ] BIT: All expected trading days are present. [2025-10-02T17:38:51.354001] [DEBUG] [VALIDATOR ] BIT: Primary data validation passed. [2025-10-02T17:38:51.354453] [INFO ] [MAIN ] BIT: Fetched primary data is valid. [2025-10-02T17:38:51.354605] [DEBUG] [LOCAL ] BIT: Saving primary data. [2025-10-02T17:38:51.355704] [DEBUG] [LOCAL ] BIT: Trimmed 31781 records to 23002 (keeping 200 days of data) [2025-10-02T17:38:51.473694] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-09. [2025-10-02T17:38:51.502500] [DEBUG] [LOCAL ] BIT: Primary data saved (23002 records). [2025-10-02T17:38:51.502631] [INFO ] [MAIN ] BIT: Full history saved. [2025-10-02T17:38:51.502784] [INFO ] [MAIN ] Update Progress: 283/2370 symbols completed. BIT took 36.1s. Estimated remaining: 4h 46m 6s. Rate: 7.3 symbols/min [2025-10-02T17:38:51.689732] [INFO ] [MAIN ] BKD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:38:51.736741] [DEBUG] [LOCAL ] BKD: Loaded 50196 existing records from primary storage. [2025-10-02T17:38:51.737193] [INFO ] [MAIN ] BKD: Loaded 50196 existing records. [2025-10-02T17:38:51.950213] [WARN ] [MAIN ] BKD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:38:51.950434] [INFO ] [MAIN ] BKD: Wiping existing primary data before full refresh. [2025-10-02T17:38:51.950484] [INFO ] [LOCAL ] BKD: Starting deletion of primary data. [2025-10-02T17:38:51.951985] [DEBUG] [LOCAL ] BKD: Deleted primary data file. [2025-10-02T17:38:51.952052] [INFO ] [MAIN ] BKD: Starting full primary refresh. [2025-10-02T17:38:52.274225] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-04. [2025-10-02T17:38:52.397897] [INFO ] [REMOTE ] BKD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:38:52.430258] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-02T17:38:53.073008] [INFO ] [REMOTE ] BKD: Fetching primary data for 2024-12. [2025-10-02T17:38:53.168864] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-02T17:38:53.873023] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-10. [2025-10-02T17:38:54.315091] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-02T17:38:54.651444] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-02T17:38:54.672958] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-05. [2025-10-02T17:38:55.149844] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-02T17:38:55.151904] [INFO ] [REMOTE ] BIRK: Full fetch complete (73043 records). [2025-10-02T17:38:55.152019] [DEBUG] [VALIDATOR ] BIRK: Validating primary data. [2025-10-02T17:38:55.481227] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-01. [2025-10-02T17:38:55.601279] [DEBUG] [VALIDATOR ] BIRK: All expected trading days are present. [2025-10-02T17:38:55.601375] [DEBUG] [VALIDATOR ] BIRK: Primary data validation passed. [2025-10-02T17:38:55.602184] [INFO ] [MAIN ] BIRK: Fetched primary data is valid. [2025-10-02T17:38:55.602256] [DEBUG] [LOCAL ] BIRK: Saving primary data. [2025-10-02T17:38:55.603995] [DEBUG] [LOCAL ] BIRK: Trimmed 73043 records to 51310 (keeping 200 days of data) [2025-10-02T17:38:55.926638] [DEBUG] [LOCAL ] BIRK: Primary data saved (51310 records). [2025-10-02T17:38:55.926808] [INFO ] [MAIN ] BIRK: Full history saved. [2025-10-02T17:38:55.926898] [INFO ] [MAIN ] Update Progress: 284/2370 symbols completed. BIRK took 40.5s. Estimated remaining: 4h 45m 30s. Rate: 7.3 symbols/min [2025-10-02T17:38:56.118126] [INFO ] [MAIN ] BKE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:38:56.152282] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-02T17:38:56.192004] [DEBUG] [LOCAL ] BKE: Loaded 34453 existing records from primary storage. [2025-10-02T17:38:56.192356] [INFO ] [MAIN ] BKE: Loaded 34453 existing records. [2025-10-02T17:38:56.278102] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-03. [2025-10-02T17:38:56.397420] [WARN ] [MAIN ] BKE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:38:56.397712] [INFO ] [MAIN ] BKE: Wiping existing primary data before full refresh. [2025-10-02T17:38:56.397772] [INFO ] [LOCAL ] BKE: Starting deletion of primary data. [2025-10-02T17:38:56.399219] [DEBUG] [LOCAL ] BKE: Deleted primary data file. [2025-10-02T17:38:56.399310] [INFO ] [MAIN ] BKE: Starting full primary refresh. [2025-10-02T17:38:56.812481] [INFO ] [REMOTE ] BKE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:38:57.079864] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-06. [2025-10-02T17:38:57.086067] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-02T17:38:57.873005] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-02. [2025-10-02T17:38:58.672988] [INFO ] [REMOTE ] BKE: Fetching primary data for 2024-12. [2025-10-02T17:38:58.717719] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-10-02T17:38:58.770926] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-02T17:38:59.480849] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-04. [2025-10-02T17:38:59.487615] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-02T17:39:00.120756] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-02T17:39:00.273058] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-03. [2025-10-02T17:39:01.072994] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-07. [2025-10-02T17:39:01.687099] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-02T17:39:01.873001] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-05. [2025-10-02T17:39:01.931926] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-02T17:39:02.673005] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-04. [2025-10-02T17:39:03.064973] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-02T17:39:03.343686] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-02T17:39:03.473012] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-08. [2025-10-02T17:39:04.272976] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-01. [2025-10-02T17:39:04.406314] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-02T17:39:05.072975] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-05. [2025-10-02T17:39:05.163824] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-02T17:39:05.728894] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-02T17:39:05.872991] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-02. [2025-10-02T17:39:06.537790] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-02T17:39:06.673046] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-06. [2025-10-02T17:39:06.887005] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-02T17:39:07.473008] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-06. [2025-10-02T17:39:08.229813] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-02T17:39:08.272975] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-07. [2025-10-02T17:39:09.073031] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-03. [2025-10-02T17:39:09.300853] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-02T17:39:09.872740] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-02T17:39:09.876582] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-09. [2025-10-02T17:39:10.673023] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-08. [2025-10-02T17:39:10.748535] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-02T17:39:11.472997] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-04. [2025-10-02T17:39:11.569513] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-02T17:39:12.273021] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-07. [2025-10-02T17:39:12.960639] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-02T17:39:13.073076] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-05. [2025-10-02T17:39:13.872993] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-10. [2025-10-02T17:39:14.201905] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-02T17:39:14.237013] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-02T17:39:14.673034] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-06. [2025-10-02T17:39:15.188296] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-02T17:39:15.190462] [INFO ] [REMOTE ] BJ: Full fetch complete (73859 records). [2025-10-02T17:39:15.190568] [DEBUG] [VALIDATOR ] BJ: Validating primary data. [2025-10-02T17:39:15.473749] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-08. [2025-10-02T17:39:15.626486] [DEBUG] [VALIDATOR ] BJ: All expected trading days are present. [2025-10-02T17:39:15.626628] [DEBUG] [VALIDATOR ] BJ: Primary data validation passed. [2025-10-02T17:39:15.627782] [INFO ] [MAIN ] BJ: Fetched primary data is valid. [2025-10-02T17:39:15.628060] [DEBUG] [LOCAL ] BJ: Saving primary data. [2025-10-02T17:39:15.666587] [DEBUG] [LOCAL ] BJ: Trimmed 73859 records to 51762 (keeping 200 days of data) [2025-10-02T17:39:15.671675] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-08 (5.00 seconds). [2025-10-02T17:39:16.024767] [DEBUG] [LOCAL ] BJ: Primary data saved (51762 records). [2025-10-02T17:39:16.024929] [INFO ] [MAIN ] BJ: Full history saved. [2025-10-02T17:39:16.025020] [INFO ] [MAIN ] Update Progress: 285/2370 symbols completed. BJ took 40.4s. Estimated remaining: 4h 46m 48s. Rate: 7.3 symbols/min [2025-10-02T17:39:16.175875] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-02T17:39:16.265810] [INFO ] [MAIN ] BKH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:39:16.273037] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-07. [2025-10-02T17:39:16.307248] [DEBUG] [LOCAL ] BKH: Loaded 36630 existing records from primary storage. [2025-10-02T17:39:16.307631] [INFO ] [MAIN ] BKH: Loaded 36630 existing records. [2025-10-02T17:39:16.522163] [WARN ] [MAIN ] BKH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:39:16.522441] [INFO ] [MAIN ] BKH: Wiping existing primary data before full refresh. [2025-10-02T17:39:16.522494] [INFO ] [LOCAL ] BKH: Starting deletion of primary data. [2025-10-02T17:39:16.524039] [DEBUG] [LOCAL ] BKH: Deleted primary data file. [2025-10-02T17:39:16.524104] [INFO ] [MAIN ] BKH: Starting full primary refresh. [2025-10-02T17:39:16.987268] [INFO ] [REMOTE ] BKH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:39:17.073016] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-09. [2025-10-02T17:39:17.396678] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-02T17:39:17.676742] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-02T17:39:17.873022] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-08. [2025-10-02T17:39:18.549798] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-02T17:39:18.673018] [INFO ] [REMOTE ] BKH: Fetching primary data for 2024-12. [2025-10-02T17:39:18.963395] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-02T17:39:19.473046] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-09. [2025-10-02T17:39:20.112823] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-02T17:39:20.273046] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-10. [2025-10-02T17:39:20.537262] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-02T17:39:21.073034] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-10. [2025-10-02T17:39:21.648919] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-02T17:39:21.651021] [INFO ] [REMOTE ] BKD: Full fetch complete (71674 records). [2025-10-02T17:39:21.651146] [DEBUG] [VALIDATOR ] BKD: Validating primary data. [2025-10-02T17:39:21.878133] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-09. [2025-10-02T17:39:22.080449] [DEBUG] [VALIDATOR ] BKD: All expected trading days are present. [2025-10-02T17:39:22.080549] [DEBUG] [VALIDATOR ] BKD: Primary data validation passed. [2025-10-02T17:39:22.081303] [INFO ] [MAIN ] BKD: Fetched primary data is valid. [2025-10-02T17:39:22.081369] [DEBUG] [LOCAL ] BKD: Saving primary data. [2025-10-02T17:39:22.082855] [DEBUG] [LOCAL ] BKD: Trimmed 71674 records to 50577 (keeping 200 days of data) [2025-10-02T17:39:22.280129] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-02T17:39:22.310962] [INFO ] [REMOTE ] BKE: Full fetch complete (50179 records). [2025-10-02T17:39:22.312311] [DEBUG] [VALIDATOR ] BKE: Validating primary data. [2025-10-02T17:39:22.676435] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-01. [2025-10-02T17:39:22.886631] [DEBUG] [VALIDATOR ] BKE: All expected trading days are present. [2025-10-02T17:39:22.892031] [DEBUG] [VALIDATOR ] BKE: Primary data validation passed. [2025-10-02T17:39:22.892154] [DEBUG] [LOCAL ] BKD: Primary data saved (50577 records). [2025-10-02T17:39:22.892960] [INFO ] [MAIN ] BKD: Full history saved. [2025-10-02T17:39:22.894216] [INFO ] [MAIN ] Update Progress: 286/2370 symbols completed. BKD took 31.4s. Estimated remaining: 4h 46m 30s. Rate: 7.3 symbols/min [2025-10-02T17:39:22.892863] [INFO ] [MAIN ] BKE: Fetched primary data is valid. [2025-10-02T17:39:22.894343] [DEBUG] [LOCAL ] BKE: Saving primary data. [2025-10-02T17:39:23.006720] [DEBUG] [LOCAL ] BKE: Trimmed 50179 records to 34657 (keeping 200 days of data) [2025-10-02T17:39:23.177368] [INFO ] [MAIN ] BKKT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:39:23.324695] [DEBUG] [LOCAL ] BKKT: Loaded 35253 existing records from primary storage. [2025-10-02T17:39:23.330624] [DEBUG] [LOCAL ] BKE: Primary data saved (34657 records). [2025-10-02T17:39:23.330970] [INFO ] [MAIN ] BKKT: Loaded 35253 existing records. [2025-10-02T17:39:23.336230] [INFO ] [MAIN ] BKE: Full history saved. [2025-10-02T17:39:23.364860] [INFO ] [MAIN ] Update Progress: 287/2370 symbols completed. BKE took 27.4s. Estimated remaining: 4h 45m 25s. Rate: 7.3 symbols/min [2025-10-02T17:39:23.687512] [WARN ] [MAIN ] BKKT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:39:23.698218] [INFO ] [MAIN ] BKKT: Wiping existing primary data before full refresh. [2025-10-02T17:39:23.719630] [INFO ] [LOCAL ] BKKT: Starting deletion of primary data. [2025-10-02T17:39:23.732357] [DEBUG] [LOCAL ] BKKT: Deleted primary data file. [2025-10-02T17:39:23.734669] [INFO ] [MAIN ] BKKT: Starting full primary refresh. [2025-10-02T17:39:23.790443] [INFO ] [MAIN ] BKN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:39:23.987156] [DEBUG] [LOCAL ] BKN: Loaded 7730 existing records from primary storage. [2025-10-02T17:39:23.998789] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-02T17:39:24.032837] [INFO ] [MAIN ] BKN: Loaded 7730 existing records. [2025-10-02T17:39:24.145027] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-10. [2025-10-02T17:39:24.455938] [WARN ] [MAIN ] BKN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:39:24.499472] [INFO ] [REMOTE ] BKKT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:39:24.499842] [INFO ] [MAIN ] BKN: Wiping existing primary data before full refresh. [2025-10-02T17:39:24.500104] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2024-12. [2025-10-02T17:39:24.501193] [INFO ] [LOCAL ] BKN: Starting deletion of primary data. [2025-10-02T17:39:24.508896] [DEBUG] [LOCAL ] BKN: Deleted primary data file. [2025-10-02T17:39:24.509122] [INFO ] [MAIN ] BKN: Starting full primary refresh. [2025-10-02T17:39:24.608856] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-02T17:39:24.928548] [INFO ] [REMOTE ] BKN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:39:25.073019] [INFO ] [REMOTE ] BKN: Fetching primary data for 2024-12. [2025-10-02T17:39:25.798675] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-02T17:39:25.801610] [INFO ] [REMOTE ] BK: Full fetch complete (77479 records). [2025-10-02T17:39:25.801858] [DEBUG] [VALIDATOR ] BK: Validating primary data. [2025-10-02T17:39:25.878159] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-02. [2025-10-02T17:39:26.067976] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-02T17:39:26.266107] [DEBUG] [VALIDATOR ] BK: All expected trading days are present. [2025-10-02T17:39:26.266203] [DEBUG] [VALIDATOR ] BK: Primary data validation passed. [2025-10-02T17:39:26.267170] [INFO ] [MAIN ] BK: Fetched primary data is valid. [2025-10-02T17:39:26.267241] [DEBUG] [LOCAL ] BK: Saving primary data. [2025-10-02T17:39:26.268958] [DEBUG] [LOCAL ] BK: Trimmed 77479 records to 53927 (keeping 200 days of data) [2025-10-02T17:39:26.554589] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-02T17:39:26.668826] [DEBUG] [LOCAL ] BK: Primary data saved (53927 records). [2025-10-02T17:39:26.668975] [INFO ] [MAIN ] BK: Full history saved. [2025-10-02T17:39:26.669059] [INFO ] [MAIN ] Update Progress: 288/2370 symbols completed. BK took 47.9s. Estimated remaining: 4h 44m 41s. Rate: 7.3 symbols/min [2025-10-02T17:39:26.674463] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-01. [2025-10-02T17:39:26.880721] [INFO ] [MAIN ] BKSY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:39:26.932146] [DEBUG] [LOCAL ] BKSY: Loaded 48210 existing records from primary storage. [2025-10-02T17:39:26.932549] [INFO ] [MAIN ] BKSY: Loaded 48210 existing records. [2025-10-02T17:39:27.168134] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-02T17:39:27.176608] [WARN ] [MAIN ] BKSY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:39:27.176962] [INFO ] [MAIN ] BKSY: Wiping existing primary data before full refresh. [2025-10-02T17:39:27.177044] [INFO ] [LOCAL ] BKSY: Starting deletion of primary data. [2025-10-02T17:39:27.179489] [DEBUG] [LOCAL ] BKSY: Deleted primary data file. [2025-10-02T17:39:27.184243] [INFO ] [MAIN ] BKSY: Starting full primary refresh. [2025-10-02T17:39:27.478258] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-01. [2025-10-02T17:39:27.614872] [INFO ] [REMOTE ] BKSY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:39:28.272998] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2024-12. [2025-10-02T17:39:28.292067] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-02T17:39:28.317014] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-02T17:39:29.073022] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-02. [2025-10-02T17:39:29.872975] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-03. [2025-10-02T17:39:29.887478] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-02T17:39:29.917690] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-02T17:39:30.673006] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-03. [2025-10-02T17:39:31.301959] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-02T17:39:31.403061] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-02T17:39:31.473056] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-02. [2025-10-02T17:39:32.273025] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-04. [2025-10-02T17:39:32.395515] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-02T17:39:33.073028] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-01. [2025-10-02T17:39:33.093394] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-02T17:39:33.872994] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-05. [2025-10-02T17:39:34.615088] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-02T17:39:34.645762] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-02T17:39:34.672985] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-02. [2025-10-02T17:39:35.473012] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-06. [2025-10-02T17:39:36.272964] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-04. [2025-10-02T17:39:36.391376] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-02T17:39:36.656786] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-02T17:39:37.072995] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-03. [2025-10-02T17:39:37.719239] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-02T17:39:37.872995] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-03. [2025-10-02T17:39:38.673012] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-07. [2025-10-02T17:39:39.092575] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-02T17:39:39.233460] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-02T17:39:39.433922] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-02T17:39:39.472994] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-08. [2025-10-02T17:39:40.090843] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-02T17:39:40.273007] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-09. [2025-10-02T17:39:40.764420] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-02T17:39:41.072995] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-04. [2025-10-02T17:39:41.873007] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-04. [2025-10-02T17:39:42.349891] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-02T17:39:42.672991] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-10. [2025-10-02T17:39:43.278962] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-02T17:39:43.279963] [INFO ] [REMOTE ] BKN: Full fetch complete (11916 records). [2025-10-02T17:39:43.280128] [DEBUG] [VALIDATOR ] BKN: Validating primary data. [2025-10-02T17:39:43.478252] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-05. [2025-10-02T17:39:43.686842] [DEBUG] [VALIDATOR ] BKN: All expected trading days are present. [2025-10-02T17:39:43.686941] [DEBUG] [VALIDATOR ] BKN: Primary data validation passed. [2025-10-02T17:39:43.687225] [INFO ] [MAIN ] BKN: Fetched primary data is valid. [2025-10-02T17:39:43.687356] [DEBUG] [LOCAL ] BKN: Saving primary data. [2025-10-02T17:39:43.688113] [DEBUG] [LOCAL ] BKN: Trimmed 11916 records to 7808 (keeping 200 days of data) [2025-10-02T17:39:43.752578] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-02T17:39:43.776333] [DEBUG] [LOCAL ] BKN: Primary data saved (7808 records). [2025-10-02T17:39:43.776466] [INFO ] [MAIN ] BKN: Full history saved. [2025-10-02T17:39:43.776588] [INFO ] [MAIN ] Update Progress: 289/2370 symbols completed. BKN took 20.4s. Estimated remaining: 4h 45m 37s. Rate: 7.3 symbols/min [2025-10-02T17:39:43.973684] [INFO ] [MAIN ] BKT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:39:43.992803] [DEBUG] [LOCAL ] BKT: Loaded 11379 existing records from primary storage. [2025-10-02T17:39:43.993132] [INFO ] [MAIN ] BKT: Loaded 11379 existing records. [2025-10-02T17:39:44.198632] [WARN ] [MAIN ] BKT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:39:44.198950] [INFO ] [MAIN ] BKT: Wiping existing primary data before full refresh. [2025-10-02T17:39:44.199030] [INFO ] [LOCAL ] BKT: Starting deletion of primary data. [2025-10-02T17:39:44.199883] [DEBUG] [LOCAL ] BKT: Deleted primary data file. [2025-10-02T17:39:44.199959] [INFO ] [MAIN ] BKT: Starting full primary refresh. [2025-10-02T17:39:44.278083] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-05. [2025-10-02T17:39:44.598744] [INFO ] [REMOTE ] BKT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:39:44.719242] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-02T17:39:45.073006] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-06. [2025-10-02T17:39:45.482521] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-02T17:39:45.873006] [INFO ] [REMOTE ] BKT: Fetching primary data for 2024-12. [2025-10-02T17:39:46.099105] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-02T17:39:46.461928] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-02T17:39:46.672999] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-05. [2025-10-02T17:39:47.473047] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-07. [2025-10-02T17:39:48.144961] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-02T17:39:48.273021] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-06. [2025-10-02T17:39:49.037388] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-02T17:39:49.072968] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-08. [2025-10-02T17:39:49.329015] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-02T17:39:49.873000] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-06. [2025-10-02T17:39:50.398560] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-02T17:39:50.673009] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-09. [2025-10-02T17:39:51.472977] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-01. [2025-10-02T17:39:51.668577] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-02T17:39:52.012257] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-02T17:39:52.157500] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-02T17:39:52.272994] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-07. [2025-10-02T17:39:53.073043] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-10. [2025-10-02T17:39:53.872999] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-07. [2025-10-02T17:39:54.278943] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-02T17:39:54.280740] [INFO ] [REMOTE ] BKH: Full fetch complete (52393 records). [2025-10-02T17:39:54.280858] [DEBUG] [VALIDATOR ] BKH: Validating primary data. [2025-10-02T17:39:54.674912] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-02. [2025-10-02T17:39:54.775878] [DEBUG] [VALIDATOR ] BKH: All expected trading days are present. [2025-10-02T17:39:54.792536] [DEBUG] [VALIDATOR ] BKH: Primary data validation passed. [2025-10-02T17:39:54.808185] [INFO ] [MAIN ] BKH: Fetched primary data is valid. [2025-10-02T17:39:54.808361] [DEBUG] [LOCAL ] BKH: Saving primary data. [2025-10-02T17:39:54.810967] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-10-02T17:39:54.823438] [DEBUG] [LOCAL ] BKH: Trimmed 52393 records to 36907 (keeping 200 days of data) [2025-10-02T17:39:55.063999] [DEBUG] [LOCAL ] BKH: Primary data saved (36907 records). [2025-10-02T17:39:55.064147] [INFO ] [MAIN ] BKH: Full history saved. [2025-10-02T17:39:55.064232] [INFO ] [MAIN ] Update Progress: 290/2370 symbols completed. BKH took 39.0s. Estimated remaining: 4h 45m 51s. Rate: 7.3 symbols/min [2025-10-02T17:39:55.257106] [INFO ] [MAIN ] BKU: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:39:55.303913] [DEBUG] [LOCAL ] BKU: Loaded 41412 existing records from primary storage. [2025-10-02T17:39:55.304237] [INFO ] [MAIN ] BKU: Loaded 41412 existing records. [2025-10-02T17:39:55.484837] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-08. [2025-10-02T17:39:55.508864] [WARN ] [MAIN ] BKU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:39:55.510398] [INFO ] [MAIN ] BKU: Wiping existing primary data before full refresh. [2025-10-02T17:39:55.510557] [INFO ] [LOCAL ] BKU: Starting deletion of primary data. [2025-10-02T17:39:55.512100] [DEBUG] [LOCAL ] BKU: Deleted primary data file. [2025-10-02T17:39:55.512165] [INFO ] [MAIN ] BKU: Starting full primary refresh. [2025-10-02T17:39:55.744865] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-02T17:39:55.955872] [INFO ] [REMOTE ] BKU: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:39:55.987275] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-02T17:39:56.273078] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-08. [2025-10-02T17:39:57.073010] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-03. [2025-10-02T17:39:57.507537] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-02T17:39:57.873006] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-09. [2025-10-02T17:39:58.002395] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-02T17:39:58.072815] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-02T17:39:58.673033] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-04. [2025-10-02T17:39:59.350875] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-02T17:39:59.472986] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-05. [2025-10-02T17:39:59.954619] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-02T17:40:00.218945] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-02T17:40:00.272976] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-06. [2025-10-02T17:40:01.073043] [INFO ] [REMOTE ] BKU: Fetching primary data for 2024-12. [2025-10-02T17:40:01.243162] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-02T17:40:01.873020] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-09. [2025-10-02T17:40:02.663299] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-02T17:40:02.672975] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-07. [2025-10-02T17:40:03.459606] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-02T17:40:03.472958] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-08. [2025-10-02T17:40:04.081509] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-02T17:40:04.272997] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-10. [2025-10-02T17:40:04.324825] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-02T17:40:05.073040] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-10. [2025-10-02T17:40:05.873052] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-09. [2025-10-02T17:40:06.148290] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-02T17:40:06.150246] [INFO ] [REMOTE ] BKKT: Full fetch complete (50327 records). [2025-10-02T17:40:06.150342] [DEBUG] [VALIDATOR ] BKKT: Validating primary data. [2025-10-02T17:40:06.573621] [DEBUG] [VALIDATOR ] BKKT: All expected trading days are present. [2025-10-02T17:40:06.573744] [DEBUG] [VALIDATOR ] BKKT: Primary data validation passed. [2025-10-02T17:40:06.574368] [INFO ] [MAIN ] BKKT: Fetched primary data is valid. [2025-10-02T17:40:06.574416] [DEBUG] [LOCAL ] BKKT: Saving primary data. [2025-10-02T17:40:06.575672] [DEBUG] [LOCAL ] BKKT: Trimmed 50327 records to 35643 (keeping 200 days of data) [2025-10-02T17:40:06.673026] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-01. [2025-10-02T17:40:06.810103] [DEBUG] [LOCAL ] BKKT: Primary data saved (35643 records). [2025-10-02T17:40:06.810255] [INFO ] [MAIN ] BKKT: Full history saved. [2025-10-02T17:40:06.811051] [INFO ] [MAIN ] Update Progress: 291/2370 symbols completed. BKKT took 43.9s. Estimated remaining: 4h 46m 8s. Rate: 7.3 symbols/min [2025-10-02T17:40:06.895929] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-02T17:40:06.936229] [INFO ] [REMOTE ] BKSY: Full fetch complete (69271 records). [2025-10-02T17:40:06.947284] [DEBUG] [VALIDATOR ] BKSY: Validating primary data. [2025-10-02T17:40:06.969309] [FATAL] [VALIDATOR ] BKSY: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:40:07.000064] [FATAL] [MAIN ] BKSY: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:40:07.012704] [WARN ] [MAIN ] BKSY: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:40:07.047546] [INFO ] [LOCAL ] BKSY: Starting deletion of primary data. [2025-10-02T17:40:07.047254] [INFO ] [MAIN ] BKV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:40:07.048438] [DEBUG] [LOCAL ] BKSY: No primary data file found to delete. [2025-10-02T17:40:07.063415] [INFO ] [LOCAL ] BKSY: Starting deletion of derivative data. [2025-10-02T17:40:07.065906] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-02T17:40:07.072177] [DEBUG] [LOCAL ] BKSY: Deleted derivative data file. [2025-10-02T17:40:07.072916] [INFO ] [MAIN ] Update Progress: 292/2370 symbols completed. BKSY took 40.4s. Estimated remaining: 4h 45m 3s. Rate: 7.3 symbols/min [2025-10-02T17:40:07.267830] [DEBUG] [LOCAL ] BKV: Loaded 29752 existing records from primary storage. [2025-10-02T17:40:07.289188] [INFO ] [MAIN ] BKV: Loaded 29752 existing records. [2025-10-02T17:40:07.363350] [INFO ] [MAIN ] BLCO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:40:07.477024] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-10. [2025-10-02T17:40:07.554034] [WARN ] [MAIN ] BKV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:40:07.554259] [INFO ] [MAIN ] BKV: Wiping existing primary data before full refresh. [2025-10-02T17:40:07.554308] [INFO ] [LOCAL ] BKV: Starting deletion of primary data. [2025-10-02T17:40:07.555249] [DEBUG] [LOCAL ] BKV: Deleted primary data file. [2025-10-02T17:40:07.555320] [INFO ] [MAIN ] BKV: Starting full primary refresh. [2025-10-02T17:40:07.770469] [DEBUG] [LOCAL ] BLCO: Loaded 35433 existing records from primary storage. [2025-10-02T17:40:07.798878] [INFO ] [MAIN ] BLCO: Loaded 35433 existing records. [2025-10-02T17:40:08.144159] [INFO ] [REMOTE ] BKV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:40:08.215036] [WARN ] [MAIN ] BLCO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:40:08.215418] [INFO ] [MAIN ] BLCO: Wiping existing primary data before full refresh. [2025-10-02T17:40:08.215492] [INFO ] [LOCAL ] BLCO: Starting deletion of primary data. [2025-10-02T17:40:08.225661] [DEBUG] [LOCAL ] BLCO: Deleted primary data file. [2025-10-02T17:40:08.241102] [INFO ] [MAIN ] BLCO: Starting full primary refresh. [2025-10-02T17:40:08.242778] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-02T17:40:08.289281] [INFO ] [REMOTE ] BKV: Fetching primary data for 2024-12. [2025-10-02T17:40:08.596822] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-02T17:40:08.609874] [INFO ] [REMOTE ] BKT: Full fetch complete (15517 records). [2025-10-02T17:40:08.644266] [DEBUG] [VALIDATOR ] BKT: Validating primary data. [2025-10-02T17:40:08.758386] [INFO ] [REMOTE ] BLCO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:40:09.081566] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-02. [2025-10-02T17:40:09.128062] [DEBUG] [VALIDATOR ] BKT: All expected trading days are present. [2025-10-02T17:40:09.128165] [DEBUG] [VALIDATOR ] BKT: Primary data validation passed. [2025-10-02T17:40:09.128819] [INFO ] [MAIN ] BKT: Fetched primary data is valid. [2025-10-02T17:40:09.128900] [DEBUG] [LOCAL ] BKT: Saving primary data. [2025-10-02T17:40:09.129722] [DEBUG] [LOCAL ] BKT: Trimmed 15517 records to 11524 (keeping 200 days of data) [2025-10-02T17:40:09.207070] [DEBUG] [LOCAL ] BKT: Primary data saved (11524 records). [2025-10-02T17:40:09.207272] [INFO ] [MAIN ] BKT: Full history saved. [2025-10-02T17:40:09.207432] [INFO ] [MAIN ] Update Progress: 293/2370 symbols completed. BKT took 25.4s. Estimated remaining: 4h 44m 11s. Rate: 7.3 symbols/min [2025-10-02T17:40:09.402549] [INFO ] [MAIN ] BLD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:40:09.431192] [DEBUG] [LOCAL ] BLD: Loaded 27631 existing records from primary storage. [2025-10-02T17:40:09.431463] [INFO ] [MAIN ] BLD: Loaded 27631 existing records. [2025-10-02T17:40:09.625363] [WARN ] [MAIN ] BLD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:40:09.625596] [INFO ] [MAIN ] BLD: Wiping existing primary data before full refresh. [2025-10-02T17:40:09.625693] [INFO ] [LOCAL ] BLD: Starting deletion of primary data. [2025-10-02T17:40:09.626597] [DEBUG] [LOCAL ] BLD: Deleted primary data file. [2025-10-02T17:40:09.626691] [INFO ] [MAIN ] BLD: Starting full primary refresh. [2025-10-02T17:40:09.874293] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2024-12. [2025-10-02T17:40:09.981435] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-02T17:40:10.110209] [INFO ] [REMOTE ] BLD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:40:10.532435] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-02T17:40:10.673037] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-01. [2025-10-02T17:40:11.121063] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-02T17:40:11.473000] [INFO ] [REMOTE ] BLD: Fetching primary data for 2024-12. [2025-10-02T17:40:11.911855] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-02T17:40:12.273000] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-02. [2025-10-02T17:40:13.039392] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-02T17:40:13.072976] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-01. [2025-10-02T17:40:13.569923] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-02T17:40:13.873000] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-03. [2025-10-02T17:40:14.053127] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-02T17:40:14.673007] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-02. [2025-10-02T17:40:15.473015] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-01. [2025-10-02T17:40:15.781833] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-02T17:40:16.273019] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-03. [2025-10-02T17:40:16.592239] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-03 (2.72 seconds). [2025-10-02T17:40:16.831783] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-02T17:40:17.073013] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-04. [2025-10-02T17:40:17.722473] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-02T17:40:17.873004] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-03. [2025-10-02T17:40:18.681604] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-02. [2025-10-02T17:40:18.701632] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-02T17:40:19.236883] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-02T17:40:19.473031] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-05. [2025-10-02T17:40:19.855429] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-02T17:40:20.273005] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-04. [2025-10-02T17:40:20.960215] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-02T17:40:21.073015] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-03. [2025-10-02T17:40:21.454736] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-02T17:40:21.873046] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-06. [2025-10-02T17:40:22.673027] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-04. [2025-10-02T17:40:23.346356] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-02T17:40:23.473004] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-07. [2025-10-02T17:40:23.906434] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-02T17:40:23.993920] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-03 (2.92 seconds). [2025-10-02T17:40:24.273047] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-05. [2025-10-02T17:40:25.039999] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-02T17:40:25.073027] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-04. [2025-10-02T17:40:25.530524] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-02T17:40:25.873003] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-06. [2025-10-02T17:40:26.563598] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-02T17:40:26.672999] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-08. [2025-10-02T17:40:27.118802] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-02T17:40:27.472998] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-07. [2025-10-02T17:40:27.857294] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-02T17:40:28.273009] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-05. [2025-10-02T17:40:28.770542] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-02T17:40:29.073047] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-05. [2025-10-02T17:40:29.824245] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-02T17:40:29.872984] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-09. [2025-10-02T17:40:29.972103] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-02T17:40:30.673012] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-06. [2025-10-02T17:40:31.062678] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-02T17:40:31.473032] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-10. [2025-10-02T17:40:31.981000] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-02T17:40:32.273004] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-06. [2025-10-02T17:40:32.724959] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-02T17:40:32.728864] [INFO ] [REMOTE ] BKU: Full fetch complete (59834 records). [2025-10-02T17:40:32.729038] [DEBUG] [VALIDATOR ] BKU: Validating primary data. [2025-10-02T17:40:33.078113] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-07. [2025-10-02T17:40:33.171810] [DEBUG] [VALIDATOR ] BKU: All expected trading days are present. [2025-10-02T17:40:33.171893] [DEBUG] [VALIDATOR ] BKU: Primary data validation passed. [2025-10-02T17:40:33.172518] [INFO ] [MAIN ] BKU: Fetched primary data is valid. [2025-10-02T17:40:33.172564] [DEBUG] [LOCAL ] BKU: Saving primary data. [2025-10-02T17:40:33.174005] [DEBUG] [LOCAL ] BKU: Trimmed 59834 records to 41707 (keeping 200 days of data) [2025-10-02T17:40:33.437862] [DEBUG] [LOCAL ] BKU: Primary data saved (41707 records). [2025-10-02T17:40:33.438148] [INFO ] [MAIN ] BKU: Full history saved. [2025-10-02T17:40:33.438263] [INFO ] [MAIN ] Update Progress: 294/2370 symbols completed. BKU took 38.4s. Estimated remaining: 4h 45m 56s. Rate: 7.3 symbols/min [2025-10-02T17:40:33.625419] [INFO ] [MAIN ] BLDR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:40:33.685406] [DEBUG] [LOCAL ] BLDR: Loaded 51639 existing records from primary storage. [2025-10-02T17:40:33.685990] [INFO ] [MAIN ] BLDR: Loaded 51639 existing records. [2025-10-02T17:40:33.786437] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-02T17:40:33.878173] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-08. [2025-10-02T17:40:33.925987] [WARN ] [MAIN ] BLDR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:40:33.926297] [INFO ] [MAIN ] BLDR: Wiping existing primary data before full refresh. [2025-10-02T17:40:33.926348] [INFO ] [LOCAL ] BLDR: Starting deletion of primary data. [2025-10-02T17:40:33.927810] [DEBUG] [LOCAL ] BLDR: Deleted primary data file. [2025-10-02T17:40:33.927873] [INFO ] [MAIN ] BLDR: Starting full primary refresh. [2025-10-02T17:40:34.324499] [INFO ] [REMOTE ] BLDR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:40:34.345041] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-02T17:40:34.673018] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-08. [2025-10-02T17:40:35.197204] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-02T17:40:35.472971] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2024-12. [2025-10-02T17:40:35.720181] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-02T17:40:36.272997] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-07. [2025-10-02T17:40:37.072978] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-09. [2025-10-02T17:40:37.229491] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-02T17:40:37.413103] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-02T17:40:37.872977] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-09. [2025-10-02T17:40:38.056183] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-02T17:40:38.672999] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-01. [2025-10-02T17:40:39.377888] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-02T17:40:39.472991] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-10. [2025-10-02T17:40:40.272989] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-10. [2025-10-02T17:40:40.401309] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-02T17:40:40.401520] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-02T17:40:40.413251] [INFO ] [REMOTE ] BLD: Full fetch complete (40090 records). [2025-10-02T17:40:40.414189] [DEBUG] [VALIDATOR ] BLD: Validating primary data. [2025-10-02T17:40:40.415805] [FATAL] [VALIDATOR ] BLD: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:40:40.415929] [FATAL] [MAIN ] BLD: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:40:40.415977] [WARN ] [MAIN ] BLD: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:40:40.416025] [INFO ] [LOCAL ] BLD: Starting deletion of primary data. [2025-10-02T17:40:40.416087] [DEBUG] [LOCAL ] BLD: No primary data file found to delete. [2025-10-02T17:40:40.416171] [INFO ] [LOCAL ] BLD: Starting deletion of derivative data. [2025-10-02T17:40:40.416615] [DEBUG] [LOCAL ] BLD: Deleted derivative data file. [2025-10-02T17:40:40.416757] [INFO ] [MAIN ] Update Progress: 295/2370 symbols completed. BLD took 31.2s. Estimated remaining: 4h 45m 39s. Rate: 7.3 symbols/min [2025-10-02T17:40:40.607333] [INFO ] [MAIN ] BLE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:40:40.623309] [DEBUG] [LOCAL ] BLE: Loaded 14294 existing records from primary storage. [2025-10-02T17:40:40.623570] [INFO ] [MAIN ] BLE: Loaded 14294 existing records. [2025-10-02T17:40:40.811421] [WARN ] [MAIN ] BLE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:40:40.811687] [INFO ] [MAIN ] BLE: Wiping existing primary data before full refresh. [2025-10-02T17:40:40.811755] [INFO ] [LOCAL ] BLE: Starting deletion of primary data. [2025-10-02T17:40:40.812294] [DEBUG] [LOCAL ] BLE: Deleted primary data file. [2025-10-02T17:40:40.812355] [INFO ] [MAIN ] BLE: Starting full primary refresh. [2025-10-02T17:40:41.085337] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-08. [2025-10-02T17:40:41.198262] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-02T17:40:41.210901] [INFO ] [REMOTE ] BKV: Full fetch complete (44669 records). [2025-10-02T17:40:41.227398] [DEBUG] [VALIDATOR ] BKV: Validating primary data. [2025-10-02T17:40:41.233395] [INFO ] [REMOTE ] BLE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:40:41.234581] [FATAL] [VALIDATOR ] BKV: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:40:41.234759] [FATAL] [MAIN ] BKV: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:40:41.234810] [WARN ] [MAIN ] BKV: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:40:41.234885] [INFO ] [LOCAL ] BKV: Starting deletion of primary data. [2025-10-02T17:40:41.234975] [DEBUG] [LOCAL ] BKV: No primary data file found to delete. [2025-10-02T17:40:41.235035] [INFO ] [LOCAL ] BKV: Starting deletion of derivative data. [2025-10-02T17:40:41.235759] [DEBUG] [LOCAL ] BKV: Deleted derivative data file. [2025-10-02T17:40:41.235871] [INFO ] [MAIN ] Update Progress: 296/2370 symbols completed. BKV took 34.4s. Estimated remaining: 4h 44m 38s. Rate: 7.3 symbols/min [2025-10-02T17:40:41.430856] [INFO ] [MAIN ] BLK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:40:41.468606] [DEBUG] [LOCAL ] BLK: Loaded 34407 existing records from primary storage. [2025-10-02T17:40:41.468935] [INFO ] [MAIN ] BLK: Loaded 34407 existing records. [2025-10-02T17:40:41.665137] [WARN ] [MAIN ] BLK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:40:41.665397] [INFO ] [MAIN ] BLK: Wiping existing primary data before full refresh. [2025-10-02T17:40:41.665454] [INFO ] [LOCAL ] BLK: Starting deletion of primary data. [2025-10-02T17:40:41.666869] [DEBUG] [LOCAL ] BLK: Deleted primary data file. [2025-10-02T17:40:41.666933] [INFO ] [MAIN ] BLK: Starting full primary refresh. [2025-10-02T17:40:41.878122] [INFO ] [REMOTE ] BLE: Fetching primary data for 2024-12. [2025-10-02T17:40:42.089619] [INFO ] [REMOTE ] BLK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:40:42.482819] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-02T17:40:42.671493] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-02T17:40:42.675329] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-09. [2025-10-02T17:40:43.473002] [INFO ] [REMOTE ] BLK: Fetching primary data for 2024-12. [2025-10-02T17:40:43.986752] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-02T17:40:44.273040] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-02. [2025-10-02T17:40:45.072986] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-10. [2025-10-02T17:40:45.319455] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-02T17:40:45.872962] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-01. [2025-10-02T17:40:45.990163] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-02T17:40:46.350398] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-02T17:40:46.352348] [INFO ] [REMOTE ] BLCO: Full fetch complete (52627 records). [2025-10-02T17:40:46.352507] [DEBUG] [VALIDATOR ] BLCO: Validating primary data. [2025-10-02T17:40:46.678228] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-01. [2025-10-02T17:40:46.814043] [DEBUG] [VALIDATOR ] BLCO: All expected trading days are present. [2025-10-02T17:40:46.814136] [DEBUG] [VALIDATOR ] BLCO: Primary data validation passed. [2025-10-02T17:40:46.814834] [INFO ] [MAIN ] BLCO: Fetched primary data is valid. [2025-10-02T17:40:46.814901] [DEBUG] [LOCAL ] BLCO: Saving primary data. [2025-10-02T17:40:46.816869] [DEBUG] [LOCAL ] BLCO: Trimmed 52627 records to 35657 (keeping 200 days of data) [2025-10-02T17:40:47.040517] [DEBUG] [LOCAL ] BLCO: Primary data saved (35657 records). [2025-10-02T17:40:47.040680] [INFO ] [MAIN ] BLCO: Full history saved. [2025-10-02T17:40:47.040787] [INFO ] [MAIN ] Update Progress: 297/2370 symbols completed. BLCO took 40.0s. Estimated remaining: 4h 44m 13s. Rate: 7.3 symbols/min [2025-10-02T17:40:47.227040] [INFO ] [MAIN ] BLND: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:40:47.275631] [DEBUG] [LOCAL ] BLND: Loaded 49264 existing records from primary storage. [2025-10-02T17:40:47.276030] [INFO ] [MAIN ] BLND: Loaded 49264 existing records. [2025-10-02T17:40:47.472971] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-03. [2025-10-02T17:40:47.477144] [WARN ] [MAIN ] BLND: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:40:47.478953] [INFO ] [MAIN ] BLND: Wiping existing primary data before full refresh. [2025-10-02T17:40:47.479071] [INFO ] [LOCAL ] BLND: Starting deletion of primary data. [2025-10-02T17:40:47.480557] [DEBUG] [LOCAL ] BLND: Deleted primary data file. [2025-10-02T17:40:47.480622] [INFO ] [MAIN ] BLND: Starting full primary refresh. [2025-10-02T17:40:47.626962] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-02T17:40:47.913967] [INFO ] [REMOTE ] BLND: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:40:47.942456] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-02T17:40:48.273006] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-02. [2025-10-02T17:40:48.781370] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-02T17:40:49.073004] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-02. [2025-10-02T17:40:49.338074] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-02T17:40:49.873015] [INFO ] [REMOTE ] BLND: Fetching primary data for 2024-12. [2025-10-02T17:40:50.548409] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-02T17:40:50.673092] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-03. [2025-10-02T17:40:51.473032] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-03. [2025-10-02T17:40:51.547505] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-02T17:40:51.748426] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-02T17:40:52.273054] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-04. [2025-10-02T17:40:53.072979] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-01. [2025-10-02T17:40:53.315680] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-02T17:40:53.872978] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-04. [2025-10-02T17:40:54.182059] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-02T17:40:54.649041] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-02T17:40:54.673000] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-05. [2025-10-02T17:40:55.459863] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-02T17:40:55.472966] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-05. [2025-10-02T17:40:56.273015] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-04. [2025-10-02T17:40:56.637283] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-02T17:40:56.927247] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-02T17:40:57.073037] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-06. [2025-10-02T17:40:57.527534] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-02T17:40:57.873004] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-05. [2025-10-02T17:40:58.424223] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-02T17:40:58.443978] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-02T17:40:58.673045] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-02. [2025-10-02T17:40:59.473057] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-06. [2025-10-02T17:41:00.204540] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-02T17:41:00.273004] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-07. [2025-10-02T17:41:00.321612] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-02T17:41:01.072982] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-06. [2025-10-02T17:41:01.155768] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-02T17:41:01.873030] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-07. [2025-10-02T17:41:02.672999] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-03. [2025-10-02T17:41:03.473064] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-08. [2025-10-02T17:41:03.784846] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-02T17:41:04.132905] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-02T17:41:04.273016] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-08. [2025-10-02T17:41:04.459830] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-02T17:41:05.073027] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-04. [2025-10-02T17:41:05.730220] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-02T17:41:05.873021] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-09. [2025-10-02T17:41:06.425006] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-02T17:41:06.460692] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-06 (5.39 seconds). [2025-10-02T17:41:06.673028] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-07. [2025-10-02T17:41:07.472988] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-09. [2025-10-02T17:41:07.603294] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-02T17:41:08.272972] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-10. [2025-10-02T17:41:08.511363] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-02T17:41:08.615129] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-02T17:41:09.073029] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-08. [2025-10-02T17:41:09.642239] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-02T17:41:09.643947] [INFO ] [REMOTE ] BLK: Full fetch complete (52678 records). [2025-10-02T17:41:09.644045] [DEBUG] [VALIDATOR ] BLK: Validating primary data. [2025-10-02T17:41:09.885218] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-05. [2025-10-02T17:41:10.062478] [DEBUG] [VALIDATOR ] BLK: All expected trading days are present. [2025-10-02T17:41:10.062561] [DEBUG] [VALIDATOR ] BLK: Primary data validation passed. [2025-10-02T17:41:10.063198] [INFO ] [MAIN ] BLK: Fetched primary data is valid. [2025-10-02T17:41:10.063264] [DEBUG] [LOCAL ] BLK: Saving primary data. [2025-10-02T17:41:10.064497] [DEBUG] [LOCAL ] BLK: Trimmed 52678 records to 34684 (keeping 200 days of data) [2025-10-02T17:41:10.312484] [DEBUG] [LOCAL ] BLK: Primary data saved (34684 records). [2025-10-02T17:41:10.312709] [INFO ] [MAIN ] BLK: Full history saved. [2025-10-02T17:41:10.313684] [INFO ] [MAIN ] Update Progress: 298/2370 symbols completed. BLK took 29.1s. Estimated remaining: 4h 45m 50s. Rate: 7.2 symbols/min [2025-10-02T17:41:10.532402] [INFO ] [MAIN ] BLSH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:41:10.532820] [DEBUG] [LOCAL ] BLSH: No existing data file found in primary storage. [2025-10-02T17:41:10.532913] [WARN ] [MAIN ] BLSH: No existing data found, performing full refresh instead. [2025-10-02T17:41:10.533097] [INFO ] [MAIN ] BLSH: Wiping existing primary data before full refresh. [2025-10-02T17:41:10.533373] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-02T17:41:10.533491] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-02T17:41:10.533582] [INFO ] [MAIN ] BLSH: Starting full primary refresh. [2025-10-02T17:41:10.675959] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-10. [2025-10-02T17:41:10.976106] [INFO ] [REMOTE ] BLSH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:41:10.970360] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-02T17:41:11.336917] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-02T17:41:11.473011] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-09. [2025-10-02T17:41:11.644082] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-02T17:41:11.645309] [INFO ] [REMOTE ] BLE: Full fetch complete (20379 records). [2025-10-02T17:41:11.645391] [DEBUG] [VALIDATOR ] BLE: Validating primary data. [2025-10-02T17:41:12.069004] [DEBUG] [VALIDATOR ] BLE: All expected trading days are present. [2025-10-02T17:41:12.069119] [DEBUG] [VALIDATOR ] BLE: Primary data validation passed. [2025-10-02T17:41:12.069491] [INFO ] [MAIN ] BLE: Fetched primary data is valid. [2025-10-02T17:41:12.069541] [DEBUG] [LOCAL ] BLE: Saving primary data. [2025-10-02T17:41:12.070262] [DEBUG] [LOCAL ] BLE: Trimmed 20379 records to 14402 (keeping 200 days of data) [2025-10-02T17:41:12.161397] [DEBUG] [LOCAL ] BLE: Primary data saved (14402 records). [2025-10-02T17:41:12.161537] [INFO ] [MAIN ] BLE: Full history saved. [2025-10-02T17:41:12.161620] [INFO ] [MAIN ] Update Progress: 299/2370 symbols completed. BLE took 31.7s. Estimated remaining: 4h 44m 57s. Rate: 7.3 symbols/min [2025-10-02T17:41:12.278428] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2024-12. [2025-10-02T17:41:12.353487] [INFO ] [MAIN ] BLW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:41:12.368846] [DEBUG] [LOCAL ] BLW: Loaded 13110 existing records from primary storage. [2025-10-02T17:41:12.369089] [INFO ] [MAIN ] BLW: Loaded 13110 existing records. [2025-10-02T17:41:12.529274] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T17:41:12.539027] [WARN ] [REMOTE ] BLSH: No data returned for month 2024-12 [2025-10-02T17:41:12.570262] [WARN ] [MAIN ] BLW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:41:12.570462] [FATAL] [REMOTE ] BLSH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T17:41:12.570908] [INFO ] [MAIN ] BLW: Wiping existing primary data before full refresh. [2025-10-02T17:41:12.571002] [INFO ] [LOCAL ] BLW: Starting deletion of primary data. [2025-10-02T17:41:12.570827] [FATAL] [MAIN ] BLSH: Failed to fetch primary data. [2025-10-02T17:41:12.571176] [WARN ] [MAIN ] BLSH: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T17:41:12.571276] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-02T17:41:12.571374] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-02T17:41:12.571432] [INFO ] [LOCAL ] BLSH: Starting deletion of derivative data. [2025-10-02T17:41:12.571537] [DEBUG] [LOCAL ] BLSH: No derivative data file found to delete. [2025-10-02T17:41:12.571594] [DEBUG] [LOCAL ] BLW: Deleted primary data file. [2025-10-02T17:41:12.571856] [INFO ] [MAIN ] BLW: Starting full primary refresh. [2025-10-02T17:41:12.571782] [INFO ] [MAIN ] Update Progress: 300/2370 symbols completed. BLSH took 2.3s. Estimated remaining: 4h 43m 54s. Rate: 7.3 symbols/min [2025-10-02T17:41:13.047323] [INFO ] [MAIN ] BLX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:41:13.078129] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-06. [2025-10-02T17:41:13.204806] [DEBUG] [LOCAL ] BLX: Loaded 15623 existing records from primary storage. [2025-10-02T17:41:13.217733] [INFO ] [MAIN ] BLX: Loaded 15623 existing records. [2025-10-02T17:41:13.298233] [INFO ] [REMOTE ] BLW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:41:13.457047] [WARN ] [MAIN ] BLX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:41:13.457794] [INFO ] [MAIN ] BLX: Wiping existing primary data before full refresh. [2025-10-02T17:41:13.457921] [INFO ] [LOCAL ] BLX: Starting deletion of primary data. [2025-10-02T17:41:13.458811] [DEBUG] [LOCAL ] BLX: Deleted primary data file. [2025-10-02T17:41:13.458878] [INFO ] [MAIN ] BLX: Starting full primary refresh. [2025-10-02T17:41:13.769375] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-10-02T17:41:13.881514] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-10. [2025-10-02T17:41:13.969226] [INFO ] [REMOTE ] BLX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:41:14.673023] [INFO ] [REMOTE ] BLW: Fetching primary data for 2024-12. [2025-10-02T17:41:14.810383] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-02T17:41:15.473001] [INFO ] [REMOTE ] BLX: Fetching primary data for 2024-12. [2025-10-02T17:41:15.674319] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-02T17:41:15.684186] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-02T17:41:15.686480] [INFO ] [REMOTE ] BLDR: Full fetch complete (74465 records). [2025-10-02T17:41:15.686616] [DEBUG] [VALIDATOR ] BLDR: Validating primary data. [2025-10-02T17:41:16.143987] [DEBUG] [VALIDATOR ] BLDR: All expected trading days are present. [2025-10-02T17:41:16.144074] [DEBUG] [VALIDATOR ] BLDR: Primary data validation passed. [2025-10-02T17:41:16.144954] [INFO ] [MAIN ] BLDR: Fetched primary data is valid. [2025-10-02T17:41:16.145024] [DEBUG] [LOCAL ] BLDR: Saving primary data. [2025-10-02T17:41:16.146633] [DEBUG] [LOCAL ] BLDR: Trimmed 74465 records to 52007 (keeping 200 days of data) [2025-10-02T17:41:16.272971] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-07. [2025-10-02T17:41:16.391075] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-02T17:41:16.505632] [DEBUG] [LOCAL ] BLDR: Primary data saved (52007 records). [2025-10-02T17:41:16.505862] [INFO ] [MAIN ] BLDR: Full history saved. [2025-10-02T17:41:16.505955] [INFO ] [MAIN ] Update Progress: 301/2370 symbols completed. BLDR took 43.1s. Estimated remaining: 4h 43m 17s. Rate: 7.3 symbols/min [2025-10-02T17:41:16.697352] [INFO ] [MAIN ] BMA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:41:16.733062] [DEBUG] [LOCAL ] BMA: Loaded 35306 existing records from primary storage. [2025-10-02T17:41:16.733356] [INFO ] [MAIN ] BMA: Loaded 35306 existing records. [2025-10-02T17:41:16.921840] [WARN ] [MAIN ] BMA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:41:16.922099] [INFO ] [MAIN ] BMA: Wiping existing primary data before full refresh. [2025-10-02T17:41:16.922155] [INFO ] [LOCAL ] BMA: Starting deletion of primary data. [2025-10-02T17:41:16.923312] [DEBUG] [LOCAL ] BMA: Deleted primary data file. [2025-10-02T17:41:16.923375] [INFO ] [MAIN ] BMA: Starting full primary refresh. [2025-10-02T17:41:17.076167] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-01. [2025-10-02T17:41:17.303755] [INFO ] [REMOTE ] BMA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:41:17.872972] [INFO ] [REMOTE ] BMA: Fetching primary data for 2024-12. [2025-10-02T17:41:17.967365] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-02T17:41:18.032841] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-02T17:41:18.673015] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-02. [2025-10-02T17:41:19.362562] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-02T17:41:19.472975] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-01. [2025-10-02T17:41:19.562210] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-02T17:41:20.272991] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-03. [2025-10-02T17:41:20.583612] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-02T17:41:21.073045] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-08. [2025-10-02T17:41:21.122586] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-02T17:41:21.873006] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-04. [2025-10-02T17:41:22.673013] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-02. [2025-10-02T17:41:22.754304] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-02T17:41:22.800845] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-02T17:41:23.473014] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-05. [2025-10-02T17:41:23.488154] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-02T17:41:24.258810] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-02T17:41:24.272966] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-06. [2025-10-02T17:41:25.072997] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-09. [2025-10-02T17:41:25.139760] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-02T17:41:25.873004] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-07. [2025-10-02T17:41:26.673014] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-03. [2025-10-02T17:41:26.737702] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-02T17:41:26.845544] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-02T17:41:27.473853] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-02T17:41:27.473435] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-01. [2025-10-02T17:41:28.273007] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-04. [2025-10-02T17:41:28.810075] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-02T17:41:29.073000] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-02. [2025-10-02T17:41:29.296565] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-02T17:41:29.873011] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-08. [2025-10-02T17:41:30.323391] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-02T17:41:30.379803] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-02T17:41:30.673002] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-03. [2025-10-02T17:41:31.473004] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-09. [2025-10-02T17:41:31.995369] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-02T17:41:32.272986] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-04. [2025-10-02T17:41:32.417378] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-02T17:41:33.073000] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-10. [2025-10-02T17:41:33.781010] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-02T17:41:33.781217] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-02T17:41:33.791300] [INFO ] [REMOTE ] BLW: Full fetch complete (19198 records). [2025-10-02T17:41:33.791964] [DEBUG] [VALIDATOR ] BLW: Validating primary data. [2025-10-02T17:41:33.878154] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-05. [2025-10-02T17:41:34.209515] [DEBUG] [VALIDATOR ] BLW: All expected trading days are present. [2025-10-02T17:41:34.209595] [DEBUG] [VALIDATOR ] BLW: Primary data validation passed. [2025-10-02T17:41:34.209939] [INFO ] [MAIN ] BLW: Fetched primary data is valid. [2025-10-02T17:41:34.210001] [DEBUG] [LOCAL ] BLW: Saving primary data. [2025-10-02T17:41:34.210606] [DEBUG] [LOCAL ] BLW: Trimmed 19198 records to 13258 (keeping 200 days of data) [2025-10-02T17:41:34.297956] [DEBUG] [LOCAL ] BLW: Primary data saved (13258 records). [2025-10-02T17:41:34.298134] [INFO ] [MAIN ] BLW: Full history saved. [2025-10-02T17:41:34.298224] [INFO ] [MAIN ] Update Progress: 302/2370 symbols completed. BLW took 22.1s. Estimated remaining: 4h 44m 14s. Rate: 7.3 symbols/min [2025-10-02T17:41:34.488156] [INFO ] [MAIN ] BME: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:41:34.501951] [DEBUG] [LOCAL ] BME: Loaded 10934 existing records from primary storage. [2025-10-02T17:41:34.502205] [INFO ] [MAIN ] BME: Loaded 10934 existing records. [2025-10-02T17:41:34.673764] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-10. [2025-10-02T17:41:34.703202] [WARN ] [MAIN ] BME: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:41:34.703576] [INFO ] [MAIN ] BME: Wiping existing primary data before full refresh. [2025-10-02T17:41:34.703681] [INFO ] [LOCAL ] BME: Starting deletion of primary data. [2025-10-02T17:41:34.704327] [DEBUG] [LOCAL ] BME: Deleted primary data file. [2025-10-02T17:41:34.704391] [INFO ] [MAIN ] BME: Starting full primary refresh. [2025-10-02T17:41:35.056190] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-02T17:41:35.148056] [INFO ] [REMOTE ] BME: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:41:35.473014] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-05. [2025-10-02T17:41:36.087119] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-02T17:41:36.089763] [INFO ] [REMOTE ] BLND: Full fetch complete (72255 records). [2025-10-02T17:41:36.089885] [DEBUG] [VALIDATOR ] BLND: Validating primary data. [2025-10-02T17:41:36.284688] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-06. [2025-10-02T17:41:36.533352] [DEBUG] [VALIDATOR ] BLND: All expected trading days are present. [2025-10-02T17:41:36.533432] [DEBUG] [VALIDATOR ] BLND: Primary data validation passed. [2025-10-02T17:41:36.534181] [INFO ] [MAIN ] BLND: Fetched primary data is valid. [2025-10-02T17:41:36.534246] [DEBUG] [LOCAL ] BLND: Saving primary data. [2025-10-02T17:41:36.535702] [DEBUG] [LOCAL ] BLND: Trimmed 72255 records to 49624 (keeping 200 days of data) [2025-10-02T17:41:36.801382] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-02T17:41:36.886208] [DEBUG] [LOCAL ] BLND: Primary data saved (49624 records). [2025-10-02T17:41:36.886384] [INFO ] [MAIN ] BLND: Full history saved. [2025-10-02T17:41:36.886500] [INFO ] [MAIN ] Update Progress: 303/2370 symbols completed. BLND took 49.8s. Estimated remaining: 4h 43m 27s. Rate: 7.3 symbols/min [2025-10-02T17:41:36.945078] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-02T17:41:37.078173] [INFO ] [REMOTE ] BME: Fetching primary data for 2024-12. [2025-10-02T17:41:37.092084] [INFO ] [MAIN ] BMEZ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:41:37.123229] [DEBUG] [LOCAL ] BMEZ: Loaded 26275 existing records from primary storage. [2025-10-02T17:41:37.123515] [INFO ] [MAIN ] BMEZ: Loaded 26275 existing records. [2025-10-02T17:41:37.320921] [WARN ] [MAIN ] BMEZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:41:37.321139] [INFO ] [MAIN ] BMEZ: Wiping existing primary data before full refresh. [2025-10-02T17:41:37.321194] [INFO ] [LOCAL ] BMEZ: Starting deletion of primary data. [2025-10-02T17:41:37.322088] [DEBUG] [LOCAL ] BMEZ: Deleted primary data file. [2025-10-02T17:41:37.322150] [INFO ] [MAIN ] BMEZ: Starting full primary refresh. [2025-10-02T17:41:37.737886] [INFO ] [REMOTE ] BMEZ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:41:37.873049] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-06. [2025-10-02T17:41:38.126547] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-02T17:41:38.673046] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2024-12. [2025-10-02T17:41:39.327286] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-02T17:41:39.473062] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-07. [2025-10-02T17:41:40.022384] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-02T17:41:40.273000] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-07. [2025-10-02T17:41:40.698295] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-02T17:41:41.073001] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-01. [2025-10-02T17:41:41.278229] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-02T17:41:41.700882] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-02T17:41:41.873029] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-08. [2025-10-02T17:41:42.673034] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-01. [2025-10-02T17:41:43.212125] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-02T17:41:43.473053] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-09. [2025-10-02T17:41:43.917634] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-02T17:41:44.273029] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-02. [2025-10-02T17:41:44.960503] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-02T17:41:45.072994] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-08. [2025-10-02T17:41:45.409257] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-02T17:41:45.719069] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-02T17:41:45.873009] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-10. [2025-10-02T17:41:46.673060] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-03. [2025-10-02T17:41:46.910951] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-02T17:41:46.913497] [INFO ] [REMOTE ] BMA: Full fetch complete (51514 records). [2025-10-02T17:41:46.913736] [DEBUG] [VALIDATOR ] BMA: Validating primary data. [2025-10-02T17:41:47.363005] [DEBUG] [VALIDATOR ] BMA: All expected trading days are present. [2025-10-02T17:41:47.363119] [DEBUG] [VALIDATOR ] BMA: Primary data validation passed. [2025-10-02T17:41:47.363853] [INFO ] [MAIN ] BMA: Fetched primary data is valid. [2025-10-02T17:41:47.363919] [DEBUG] [LOCAL ] BMA: Saving primary data. [2025-10-02T17:41:47.365237] [DEBUG] [LOCAL ] BMA: Trimmed 51514 records to 35644 (keeping 200 days of data) [2025-10-02T17:41:47.473160] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-09. [2025-10-02T17:41:47.605762] [DEBUG] [LOCAL ] BMA: Primary data saved (35644 records). [2025-10-02T17:41:47.605927] [INFO ] [MAIN ] BMA: Full history saved. [2025-10-02T17:41:47.606023] [INFO ] [MAIN ] Update Progress: 304/2370 symbols completed. BMA took 31.1s. Estimated remaining: 4h 43m 36s. Rate: 7.3 symbols/min [2025-10-02T17:41:47.802034] [INFO ] [MAIN ] BMI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:41:47.829039] [DEBUG] [LOCAL ] BMI: Loaded 24194 existing records from primary storage. [2025-10-02T17:41:47.829318] [INFO ] [MAIN ] BMI: Loaded 24194 existing records. [2025-10-02T17:41:48.028694] [WARN ] [MAIN ] BMI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:41:48.028931] [INFO ] [MAIN ] BMI: Wiping existing primary data before full refresh. [2025-10-02T17:41:48.028980] [INFO ] [LOCAL ] BMI: Starting deletion of primary data. [2025-10-02T17:41:48.029991] [DEBUG] [LOCAL ] BMI: Deleted primary data file. [2025-10-02T17:41:48.030071] [INFO ] [MAIN ] BMI: Starting full primary refresh. [2025-10-02T17:41:48.280414] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-02. [2025-10-02T17:41:48.425538] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-02T17:41:48.505767] [INFO ] [REMOTE ] BMI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:41:48.517427] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-02T17:41:49.073041] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-10. [2025-10-02T17:41:49.205190] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-02T17:41:49.783303] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-02T17:41:49.784460] [INFO ] [REMOTE ] BLX: Full fetch complete (22762 records). [2025-10-02T17:41:49.784537] [DEBUG] [VALIDATOR ] BLX: Validating primary data. [2025-10-02T17:41:49.878184] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-04. [2025-10-02T17:41:50.192158] [DEBUG] [VALIDATOR ] BLX: All expected trading days are present. [2025-10-02T17:41:50.192275] [DEBUG] [VALIDATOR ] BLX: Primary data validation passed. [2025-10-02T17:41:50.192672] [INFO ] [MAIN ] BLX: Fetched primary data is valid. [2025-10-02T17:41:50.192735] [DEBUG] [LOCAL ] BLX: Saving primary data. [2025-10-02T17:41:50.193354] [DEBUG] [LOCAL ] BLX: Trimmed 22762 records to 15738 (keeping 200 days of data) [2025-10-02T17:41:50.294688] [DEBUG] [LOCAL ] BLX: Primary data saved (15738 records). [2025-10-02T17:41:50.294835] [INFO ] [MAIN ] BLX: Full history saved. [2025-10-02T17:41:50.294923] [INFO ] [MAIN ] Update Progress: 305/2370 symbols completed. BLX took 37.7s. Estimated remaining: 4h 42m 50s. Rate: 7.3 symbols/min [2025-10-02T17:41:50.488044] [INFO ] [MAIN ] BMN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:41:50.492763] [DEBUG] [LOCAL ] BMN: Loaded 2576 existing records from primary storage. [2025-10-02T17:41:50.493127] [INFO ] [MAIN ] BMN: Loaded 2576 existing records. [2025-10-02T17:41:50.678098] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-03. [2025-10-02T17:41:50.683825] [WARN ] [MAIN ] BMN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:41:50.684813] [INFO ] [MAIN ] BMN: Wiping existing primary data before full refresh. [2025-10-02T17:41:50.684872] [INFO ] [LOCAL ] BMN: Starting deletion of primary data. [2025-10-02T17:41:50.685153] [DEBUG] [LOCAL ] BMN: Deleted primary data file. [2025-10-02T17:41:50.685213] [INFO ] [MAIN ] BMN: Starting full primary refresh. [2025-10-02T17:41:51.138471] [INFO ] [REMOTE ] BMN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:41:51.157829] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-02T17:41:51.472995] [INFO ] [REMOTE ] BMI: Fetching primary data for 2024-12. [2025-10-02T17:41:51.585589] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-02T17:41:52.273122] [INFO ] [REMOTE ] BMN: Fetching primary data for 2024-12. [2025-10-02T17:41:52.576025] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-02T17:41:52.895254] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-02T17:41:53.073036] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-04. [2025-10-02T17:41:53.724747] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-02T17:41:53.872997] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-01. [2025-10-02T17:41:54.341893] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-02T17:41:54.673057] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-05. [2025-10-02T17:41:55.473051] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-01. [2025-10-02T17:41:55.809218] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-02T17:41:56.273194] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-02. [2025-10-02T17:41:56.516038] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-02T17:41:56.575196] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-02T17:41:57.073244] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-05. [2025-10-02T17:41:57.633199] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-02T17:41:57.873013] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-06. [2025-10-02T17:41:58.673008] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-03. [2025-10-02T17:41:58.929927] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-02T17:41:58.998447] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-02T17:41:59.473043] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-04. [2025-10-02T17:42:00.099054] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-02T17:42:00.273016] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-06. [2025-10-02T17:42:01.073060] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-02. [2025-10-02T17:42:01.257916] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-02T17:42:01.873057] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-05. [2025-10-02T17:42:02.347605] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-02T17:42:02.673031] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-06. [2025-10-02T17:42:03.087807] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-02T17:42:03.473026] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-07. [2025-10-02T17:42:04.273037] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-07. [2025-10-02T17:42:04.291396] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-02T17:42:05.073019] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-08. [2025-10-02T17:42:05.843335] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-02T17:42:05.866166] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-02 (4.79 seconds). [2025-10-02T17:42:05.872942] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-03. [2025-10-02T17:42:05.963750] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-02T17:42:06.673039] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-08. [2025-10-02T17:42:06.866949] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-02T17:42:07.473069] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-09. [2025-10-02T17:42:07.704192] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-02T17:42:08.279219] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-07. [2025-10-02T17:42:08.283243] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-02T17:42:08.752207] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-02T17:42:09.073029] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-08. [2025-10-02T17:42:09.552094] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-02T17:42:09.873004] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-09. [2025-10-02T17:42:10.406832] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-02T17:42:10.673022] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-10. [2025-10-02T17:42:11.473052] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-10. [2025-10-02T17:42:11.561636] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-02T17:42:11.562594] [INFO ] [REMOTE ] BME: Full fetch complete (16128 records). [2025-10-02T17:42:11.562688] [DEBUG] [VALIDATOR ] BME: Validating primary data. [2025-10-02T17:42:12.009881] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-02T17:42:12.009755] [DEBUG] [VALIDATOR ] BME: All expected trading days are present. [2025-10-02T17:42:12.010848] [INFO ] [REMOTE ] BMN: Full fetch complete (3748 records). [2025-10-02T17:42:12.010943] [DEBUG] [VALIDATOR ] BMN: Validating primary data. [2025-10-02T17:42:12.011056] [DEBUG] [VALIDATOR ] BME: Primary data validation passed. [2025-10-02T17:42:12.017131] [INFO ] [MAIN ] BME: Fetched primary data is valid. [2025-10-02T17:42:12.051019] [DEBUG] [LOCAL ] BME: Saving primary data. [2025-10-02T17:42:12.135126] [DEBUG] [LOCAL ] BME: Trimmed 16128 records to 11009 (keeping 200 days of data) [2025-10-02T17:42:12.275178] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-09. [2025-10-02T17:42:12.481864] [DEBUG] [LOCAL ] BME: Primary data saved (11009 records). [2025-10-02T17:42:12.492372] [INFO ] [MAIN ] BME: Full history saved. [2025-10-02T17:42:12.494035] [INFO ] [MAIN ] Update Progress: 306/2370 symbols completed. BME took 38.2s. Estimated remaining: 4h 44m 16s. Rate: 7.3 symbols/min [2025-10-02T17:42:12.593486] [DEBUG] [VALIDATOR ] BMN: All expected trading days are present. [2025-10-02T17:42:12.613051] [DEBUG] [VALIDATOR ] BMN: Primary data validation passed. [2025-10-02T17:42:12.647587] [INFO ] [MAIN ] BMN: Fetched primary data is valid. [2025-10-02T17:42:12.647964] [DEBUG] [LOCAL ] BMN: Saving primary data. [2025-10-02T17:42:12.649269] [DEBUG] [LOCAL ] BMN: Trimmed 3748 records to 2594 (keeping 200 days of data) [2025-10-02T17:42:12.731100] [DEBUG] [LOCAL ] BMN: Primary data saved (2594 records). [2025-10-02T17:42:12.753448] [INFO ] [MAIN ] BMN: Full history saved. [2025-10-02T17:42:12.753725] [INFO ] [MAIN ] Update Progress: 307/2370 symbols completed. BMN took 22.5s. Estimated remaining: 4h 43m 14s. Rate: 7.3 symbols/min [2025-10-02T17:42:12.753326] [INFO ] [MAIN ] BMO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:42:12.959736] [INFO ] [MAIN ] BMY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:42:12.992321] [DEBUG] [LOCAL ] BMO: Loaded 41214 existing records from primary storage. [2025-10-02T17:42:12.992853] [INFO ] [MAIN ] BMO: Loaded 41214 existing records. [2025-10-02T17:42:13.089948] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-04. [2025-10-02T17:42:13.235662] [WARN ] [MAIN ] BMO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:42:13.237008] [INFO ] [MAIN ] BMO: Wiping existing primary data before full refresh. [2025-10-02T17:42:13.237083] [INFO ] [LOCAL ] BMO: Starting deletion of primary data. [2025-10-02T17:42:13.238239] [DEBUG] [LOCAL ] BMY: Loaded 53757 existing records from primary storage. [2025-10-02T17:42:13.238518] [INFO ] [MAIN ] BMY: Loaded 53757 existing records. [2025-10-02T17:42:13.243701] [DEBUG] [LOCAL ] BMO: Deleted primary data file. [2025-10-02T17:42:13.271273] [INFO ] [MAIN ] BMO: Starting full primary refresh. [2025-10-02T17:42:13.585921] [WARN ] [MAIN ] BMY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:42:13.632250] [INFO ] [MAIN ] BMY: Wiping existing primary data before full refresh. [2025-10-02T17:42:13.649159] [INFO ] [LOCAL ] BMY: Starting deletion of primary data. [2025-10-02T17:42:13.696993] [DEBUG] [LOCAL ] BMY: Deleted primary data file. [2025-10-02T17:42:13.707148] [INFO ] [MAIN ] BMY: Starting full primary refresh. [2025-10-02T17:42:13.937339] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-02T17:42:14.076091] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-10. [2025-10-02T17:42:14.179489] [INFO ] [REMOTE ] BMO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:42:14.324247] [INFO ] [REMOTE ] BMY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:42:14.532852] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-02T17:42:14.672985] [INFO ] [REMOTE ] BMY: Fetching primary data for 2024-12. [2025-10-02T17:42:15.132583] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-02T17:42:15.134210] [INFO ] [REMOTE ] BMEZ: Full fetch complete (40800 records). [2025-10-02T17:42:15.134296] [DEBUG] [VALIDATOR ] BMEZ: Validating primary data. [2025-10-02T17:42:15.478216] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-05. [2025-10-02T17:42:15.562767] [DEBUG] [VALIDATOR ] BMEZ: All expected trading days are present. [2025-10-02T17:42:15.562858] [DEBUG] [VALIDATOR ] BMEZ: Primary data validation passed. [2025-10-02T17:42:15.563378] [INFO ] [MAIN ] BMEZ: Fetched primary data is valid. [2025-10-02T17:42:15.563421] [DEBUG] [LOCAL ] BMEZ: Saving primary data. [2025-10-02T17:42:15.564471] [DEBUG] [LOCAL ] BMEZ: Trimmed 40800 records to 26437 (keeping 200 days of data) [2025-10-02T17:42:15.731156] [DEBUG] [LOCAL ] BMEZ: Primary data saved (26437 records). [2025-10-02T17:42:15.731308] [INFO ] [MAIN ] BMEZ: Full history saved. [2025-10-02T17:42:15.731396] [INFO ] [MAIN ] Update Progress: 308/2370 symbols completed. BMEZ took 38.8s. Estimated remaining: 4h 42m 31s. Rate: 7.3 symbols/min [2025-10-02T17:42:15.919442] [INFO ] [MAIN ] BN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:42:15.972885] [DEBUG] [LOCAL ] BN: Loaded 52993 existing records from primary storage. [2025-10-02T17:42:15.973370] [INFO ] [MAIN ] BN: Loaded 52993 existing records. [2025-10-02T17:42:16.171478] [WARN ] [MAIN ] BN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:42:16.171804] [INFO ] [MAIN ] BN: Wiping existing primary data before full refresh. [2025-10-02T17:42:16.171861] [INFO ] [LOCAL ] BN: Starting deletion of primary data. [2025-10-02T17:42:16.173823] [DEBUG] [LOCAL ] BN: Deleted primary data file. [2025-10-02T17:42:16.173899] [INFO ] [MAIN ] BN: Starting full primary refresh. [2025-10-02T17:42:16.283055] [INFO ] [REMOTE ] BMO: Fetching primary data for 2024-12. [2025-10-02T17:42:16.575443] [INFO ] [REMOTE ] BN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:42:16.767343] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-02T17:42:16.838379] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-10-02T17:42:17.073026] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-06. [2025-10-02T17:42:17.873010] [INFO ] [REMOTE ] BN: Fetching primary data for 2024-12. [2025-10-02T17:42:18.039165] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-02T17:42:18.115564] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-02T17:42:18.673048] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-01. [2025-10-02T17:42:19.472991] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-01. [2025-10-02T17:42:19.661219] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-02T17:42:20.171385] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-02T17:42:20.272992] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-02. [2025-10-02T17:42:21.080704] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-07. [2025-10-02T17:42:21.105403] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-02T17:42:21.806431] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-02T17:42:21.872994] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-03. [2025-10-02T17:42:22.207558] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-02T17:42:22.673113] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-02. [2025-10-02T17:42:23.473059] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-01. [2025-10-02T17:42:23.586387] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-02T17:42:24.272990] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-04. [2025-10-02T17:42:24.778916] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-02T17:42:24.884152] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-02T17:42:25.072994] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-03. [2025-10-02T17:42:25.872979] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-08. [2025-10-02T17:42:25.927316] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-02T17:42:26.672987] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-05. [2025-10-02T17:42:27.088729] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-02T17:42:27.274890] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-02T17:42:27.473013] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-09. [2025-10-02T17:42:28.254612] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-02T17:42:28.272955] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-06. [2025-10-02T17:42:28.724554] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-02T17:42:29.073010] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-10. [2025-10-02T17:42:29.283288] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-02T17:42:29.873007] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-04. [2025-10-02T17:42:30.228203] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-02T17:42:30.230002] [INFO ] [REMOTE ] BMI: Full fetch complete (32960 records). [2025-10-02T17:42:30.230142] [DEBUG] [VALIDATOR ] BMI: Validating primary data. [2025-10-02T17:42:30.658274] [DEBUG] [VALIDATOR ] BMI: All expected trading days are present. [2025-10-02T17:42:30.658357] [DEBUG] [VALIDATOR ] BMI: Primary data validation passed. [2025-10-02T17:42:30.658797] [INFO ] [MAIN ] BMI: Fetched primary data is valid. [2025-10-02T17:42:30.658888] [DEBUG] [LOCAL ] BMI: Saving primary data. [2025-10-02T17:42:30.659738] [DEBUG] [LOCAL ] BMI: Trimmed 32960 records to 24385 (keeping 200 days of data) [2025-10-02T17:42:30.730453] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-07. [2025-10-02T17:42:30.840334] [DEBUG] [LOCAL ] BMI: Primary data saved (24385 records). [2025-10-02T17:42:30.840484] [INFO ] [MAIN ] BMI: Full history saved. [2025-10-02T17:42:30.840592] [INFO ] [MAIN ] Update Progress: 309/2370 symbols completed. BMI took 43.2s. Estimated remaining: 4h 43m 8s. Rate: 7.3 symbols/min [2025-10-02T17:42:31.049196] [INFO ] [MAIN ] BNED: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:42:31.085489] [DEBUG] [LOCAL ] BNED: Loaded 29491 existing records from primary storage. [2025-10-02T17:42:31.085820] [INFO ] [MAIN ] BNED: Loaded 29491 existing records. [2025-10-02T17:42:31.300364] [WARN ] [MAIN ] BNED: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:42:31.300727] [INFO ] [MAIN ] BNED: Wiping existing primary data before full refresh. [2025-10-02T17:42:31.300836] [INFO ] [LOCAL ] BNED: Starting deletion of primary data. [2025-10-02T17:42:31.301940] [DEBUG] [LOCAL ] BNED: Deleted primary data file. [2025-10-02T17:42:31.302035] [INFO ] [MAIN ] BNED: Starting full primary refresh. [2025-10-02T17:42:31.478174] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-02. [2025-10-02T17:42:31.758358] [INFO ] [REMOTE ] BNED: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:42:31.903946] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-02T17:42:31.974510] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-02T17:42:32.273010] [INFO ] [REMOTE ] BNED: Fetching primary data for 2024-12. [2025-10-02T17:42:33.073023] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-05. [2025-10-02T17:42:33.446516] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-02T17:42:33.873123] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-08. [2025-10-02T17:42:33.966638] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-02T17:42:34.673001] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-03. [2025-10-02T17:42:34.896191] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-02T17:42:35.451542] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-02T17:42:35.473030] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-06. [2025-10-02T17:42:36.273038] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-01. [2025-10-02T17:42:36.568463] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-02T17:42:37.073127] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-09. [2025-10-02T17:42:37.483889] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-02T17:42:37.550102] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-02T17:42:37.873027] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-07. [2025-10-02T17:42:38.629977] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-02T17:42:38.673019] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-10. [2025-10-02T17:42:39.473207] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-04. [2025-10-02T17:42:39.903845] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-02T17:42:39.906500] [INFO ] [REMOTE ] BMO: Full fetch complete (59653 records). [2025-10-02T17:42:39.906626] [DEBUG] [VALIDATOR ] BMO: Validating primary data. [2025-10-02T17:42:40.274836] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-02. [2025-10-02T17:42:40.314543] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-02T17:42:40.473735] [DEBUG] [VALIDATOR ] BMO: All expected trading days are present. [2025-10-02T17:42:40.473858] [DEBUG] [VALIDATOR ] BMO: Primary data validation passed. [2025-10-02T17:42:40.474699] [INFO ] [MAIN ] BMO: Fetched primary data is valid. [2025-10-02T17:42:40.474766] [DEBUG] [LOCAL ] BMO: Saving primary data. [2025-10-02T17:42:40.476186] [DEBUG] [LOCAL ] BMO: Trimmed 59653 records to 41494 (keeping 200 days of data) [2025-10-02T17:42:40.759470] [DEBUG] [LOCAL ] BMO: Primary data saved (41494 records). [2025-10-02T17:42:40.759601] [INFO ] [MAIN ] BMO: Full history saved. [2025-10-02T17:42:40.759735] [INFO ] [MAIN ] Update Progress: 310/2370 symbols completed. BMO took 28.2s. Estimated remaining: 4h 43m 11s. Rate: 7.3 symbols/min [2025-10-02T17:42:40.942342] [INFO ] [MAIN ] BNH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:42:40.951294] [DEBUG] [LOCAL ] BNH: Loaded 5106 existing records from primary storage. [2025-10-02T17:42:40.951503] [INFO ] [MAIN ] BNH: Loaded 5106 existing records. [2025-10-02T17:42:41.078265] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-08. [2025-10-02T17:42:41.175178] [WARN ] [MAIN ] BNH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:42:41.176609] [INFO ] [MAIN ] BNH: Wiping existing primary data before full refresh. [2025-10-02T17:42:41.176713] [INFO ] [LOCAL ] BNH: Starting deletion of primary data. [2025-10-02T17:42:41.177071] [DEBUG] [LOCAL ] BNH: Deleted primary data file. [2025-10-02T17:42:41.177138] [INFO ] [MAIN ] BNH: Starting full primary refresh. [2025-10-02T17:42:41.594466] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-02T17:42:41.701463] [INFO ] [REMOTE ] BNH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:42:41.703443] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-02T17:42:41.872980] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-03. [2025-10-02T17:42:42.673017] [INFO ] [REMOTE ] BNH: Fetching primary data for 2024-12. [2025-10-02T17:42:42.808422] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-02T17:42:43.150303] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-02T17:42:43.267524] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-02T17:42:43.473012] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-04. [2025-10-02T17:42:44.273051] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-05. [2025-10-02T17:42:44.794682] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-02T17:42:45.073046] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-05. [2025-10-02T17:42:45.873066] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-01. [2025-10-02T17:42:46.240477] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-02T17:42:46.310663] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-02T17:42:46.379166] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-02T17:42:46.673067] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-06. [2025-10-02T17:42:47.472981] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-06. [2025-10-02T17:42:47.927281] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-02T17:42:48.272987] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-02. [2025-10-02T17:42:48.631834] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-02T17:42:49.069849] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-02T17:42:49.073784] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-03. [2025-10-02T17:42:49.751637] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-02T17:42:49.873081] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-09. [2025-10-02T17:42:50.673018] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-04. [2025-10-02T17:42:51.409977] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-02T17:42:51.473015] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-07. [2025-10-02T17:42:52.086119] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-02T17:42:52.273052] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-10. [2025-10-02T17:42:52.848093] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-02T17:42:52.850398] [INFO ] [REMOTE ] BMY: Full fetch complete (77795 records). [2025-10-02T17:42:52.850515] [DEBUG] [VALIDATOR ] BMY: Validating primary data. [2025-10-02T17:42:53.014786] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-02T17:42:53.080065] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-05. [2025-10-02T17:42:53.328795] [DEBUG] [VALIDATOR ] BMY: All expected trading days are present. [2025-10-02T17:42:53.328908] [DEBUG] [VALIDATOR ] BMY: Primary data validation passed. [2025-10-02T17:42:53.329762] [INFO ] [MAIN ] BMY: Fetched primary data is valid. [2025-10-02T17:42:53.329830] [DEBUG] [LOCAL ] BMY: Saving primary data. [2025-10-02T17:42:53.331999] [DEBUG] [LOCAL ] BMY: Trimmed 77795 records to 54147 (keeping 200 days of data) [2025-10-02T17:42:53.703571] [DEBUG] [LOCAL ] BMY: Primary data saved (54147 records). [2025-10-02T17:42:53.703781] [INFO ] [MAIN ] BMY: Full history saved. [2025-10-02T17:42:53.705287] [INFO ] [MAIN ] Update Progress: 311/2370 symbols completed. BMY took 41.0s. Estimated remaining: 4h 43m 34s. Rate: 7.3 symbols/min [2025-10-02T17:42:53.879025] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-08. [2025-10-02T17:42:53.894385] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-02T17:42:53.924700] [INFO ] [MAIN ] BNJ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:42:53.931177] [DEBUG] [LOCAL ] BNJ: Loaded 2630 existing records from primary storage. [2025-10-02T17:42:53.931379] [INFO ] [MAIN ] BNJ: Loaded 2630 existing records. [2025-10-02T17:42:54.136679] [WARN ] [MAIN ] BNJ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:42:54.136950] [INFO ] [MAIN ] BNJ: Wiping existing primary data before full refresh. [2025-10-02T17:42:54.137011] [INFO ] [LOCAL ] BNJ: Starting deletion of primary data. [2025-10-02T17:42:54.137220] [DEBUG] [LOCAL ] BNJ: Deleted primary data file. [2025-10-02T17:42:54.137300] [INFO ] [MAIN ] BNJ: Starting full primary refresh. [2025-10-02T17:42:54.542147] [INFO ] [REMOTE ] BNJ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:42:54.673053] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-07. [2025-10-02T17:42:55.412436] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-02T17:42:55.473029] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2024-12. [2025-10-02T17:42:56.276479] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-09. [2025-10-02T17:42:56.280017] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-02T17:42:56.284661] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-02T17:42:57.072996] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-08. [2025-10-02T17:42:57.451743] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-02T17:42:57.873025] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-01. [2025-10-02T17:42:58.246920] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-02T17:42:58.491188] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-02T17:42:58.672998] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-09. [2025-10-02T17:42:59.473039] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-02. [2025-10-02T17:43:00.003331] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-02T17:43:00.273036] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-10. [2025-10-02T17:43:00.461934] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-02T17:43:01.073041] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-03. [2025-10-02T17:43:01.131995] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-02T17:43:01.133518] [INFO ] [REMOTE ] BNED: Full fetch complete (43842 records). [2025-10-02T17:43:01.133630] [DEBUG] [VALIDATOR ] BNED: Validating primary data. [2025-10-02T17:43:01.576455] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-02T17:43:01.613185] [DEBUG] [VALIDATOR ] BNED: All expected trading days are present. [2025-10-02T17:43:01.613274] [DEBUG] [VALIDATOR ] BNED: Primary data validation passed. [2025-10-02T17:43:01.613869] [INFO ] [MAIN ] BNED: Fetched primary data is valid. [2025-10-02T17:43:01.613934] [DEBUG] [LOCAL ] BNED: Saving primary data. [2025-10-02T17:43:01.614930] [DEBUG] [LOCAL ] BNED: Trimmed 43842 records to 29657 (keeping 200 days of data) [2025-10-02T17:43:01.799713] [DEBUG] [LOCAL ] BNED: Primary data saved (29657 records). [2025-10-02T17:43:01.799865] [INFO ] [MAIN ] BNED: Full history saved. [2025-10-02T17:43:01.799950] [INFO ] [MAIN ] Update Progress: 312/2370 symbols completed. BNED took 31.0s. Estimated remaining: 4h 43m 25s. Rate: 7.3 symbols/min [2025-10-02T17:43:01.878123] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-06. [2025-10-02T17:43:02.002485] [INFO ] [MAIN ] BNL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:43:02.057586] [DEBUG] [LOCAL ] BNL: Loaded 46913 existing records from primary storage. [2025-10-02T17:43:02.057936] [INFO ] [MAIN ] BNL: Loaded 46913 existing records. [2025-10-02T17:43:02.265403] [WARN ] [MAIN ] BNL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:43:02.265683] [INFO ] [MAIN ] BNL: Wiping existing primary data before full refresh. [2025-10-02T17:43:02.265761] [INFO ] [LOCAL ] BNL: Starting deletion of primary data. [2025-10-02T17:43:02.267556] [DEBUG] [LOCAL ] BNL: Deleted primary data file. [2025-10-02T17:43:02.267621] [INFO ] [MAIN ] BNL: Starting full primary refresh. [2025-10-02T17:43:02.589552] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-02T17:43:02.678138] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-10. [2025-10-02T17:43:02.722275] [INFO ] [REMOTE ] BNL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:43:03.473016] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-04. [2025-10-02T17:43:04.070195] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-02T17:43:04.139829] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-02T17:43:04.148292] [INFO ] [REMOTE ] BN: Full fetch complete (76693 records). [2025-10-02T17:43:04.148477] [DEBUG] [VALIDATOR ] BN: Validating primary data. [2025-10-02T17:43:04.278124] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-07. [2025-10-02T17:43:04.660900] [DEBUG] [VALIDATOR ] BN: All expected trading days are present. [2025-10-02T17:43:04.660996] [DEBUG] [VALIDATOR ] BN: Primary data validation passed. [2025-10-02T17:43:04.661843] [INFO ] [MAIN ] BN: Fetched primary data is valid. [2025-10-02T17:43:04.661921] [DEBUG] [LOCAL ] BN: Saving primary data. [2025-10-02T17:43:04.663582] [DEBUG] [LOCAL ] BN: Trimmed 76693 records to 53383 (keeping 200 days of data) [2025-10-02T17:43:05.036121] [DEBUG] [LOCAL ] BN: Primary data saved (53383 records). [2025-10-02T17:43:05.036333] [INFO ] [MAIN ] BN: Full history saved. [2025-10-02T17:43:05.036446] [INFO ] [MAIN ] Update Progress: 313/2370 symbols completed. BN took 49.3s. Estimated remaining: 4h 42m 43s. Rate: 7.3 symbols/min [2025-10-02T17:43:05.073013] [INFO ] [REMOTE ] BNL: Fetching primary data for 2024-12. [2025-10-02T17:43:05.132469] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-02T17:43:05.249163] [INFO ] [MAIN ] BNS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:43:05.304935] [DEBUG] [LOCAL ] BNS: Loaded 51486 existing records from primary storage. [2025-10-02T17:43:05.305275] [INFO ] [MAIN ] BNS: Loaded 51486 existing records. [2025-10-02T17:43:05.504545] [WARN ] [MAIN ] BNS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:43:05.504803] [INFO ] [MAIN ] BNS: Wiping existing primary data before full refresh. [2025-10-02T17:43:05.504854] [INFO ] [LOCAL ] BNS: Starting deletion of primary data. [2025-10-02T17:43:05.506509] [DEBUG] [LOCAL ] BNS: Deleted primary data file. [2025-10-02T17:43:05.506574] [INFO ] [MAIN ] BNS: Starting full primary refresh. [2025-10-02T17:43:05.878265] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-05. [2025-10-02T17:43:05.955772] [INFO ] [REMOTE ] BNS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:43:06.365732] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-02T17:43:06.672989] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-06. [2025-10-02T17:43:06.785065] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-02T17:43:07.112986] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-02T17:43:07.473044] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-07. [2025-10-02T17:43:07.765023] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-10-02T17:43:08.273036] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-01. [2025-10-02T17:43:09.073017] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-08. [2025-10-02T17:43:09.470424] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-02T17:43:09.784972] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-02T17:43:09.873034] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-09. [2025-10-02T17:43:10.489421] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-02T17:43:10.673015] [INFO ] [REMOTE ] BNS: Fetching primary data for 2024-12. [2025-10-02T17:43:11.473014] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-10. [2025-10-02T17:43:12.073763] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-02T17:43:12.074660] [INFO ] [REMOTE ] BNH: Full fetch complete (7002 records). [2025-10-02T17:43:12.074742] [DEBUG] [VALIDATOR ] BNH: Validating primary data. [2025-10-02T17:43:12.285817] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-02. [2025-10-02T17:43:12.520282] [DEBUG] [VALIDATOR ] BNH: All expected trading days are present. [2025-10-02T17:43:12.520388] [DEBUG] [VALIDATOR ] BNH: Primary data validation passed. [2025-10-02T17:43:12.520678] [INFO ] [MAIN ] BNH: Fetched primary data is valid. [2025-10-02T17:43:12.520884] [DEBUG] [LOCAL ] BNH: Saving primary data. [2025-10-02T17:43:12.521588] [DEBUG] [LOCAL ] BNH: Trimmed 7002 records to 5161 (keeping 200 days of data) [2025-10-02T17:43:12.578346] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-02T17:43:12.597783] [DEBUG] [LOCAL ] BNH: Primary data saved (5161 records). [2025-10-02T17:43:12.597944] [INFO ] [MAIN ] BNH: Full history saved. [2025-10-02T17:43:12.598091] [INFO ] [MAIN ] Update Progress: 314/2370 symbols completed. BNH took 31.8s. Estimated remaining: 4h 42m 31s. Rate: 7.3 symbols/min [2025-10-02T17:43:12.806718] [INFO ] [MAIN ] BNT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:43:12.812223] [DEBUG] [LOCAL ] BNT: Loaded 3373 existing records from primary storage. [2025-10-02T17:43:12.812448] [INFO ] [MAIN ] BNT: Loaded 3373 existing records. [2025-10-02T17:43:13.014107] [WARN ] [MAIN ] BNT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:43:13.014325] [INFO ] [MAIN ] BNT: Wiping existing primary data before full refresh. [2025-10-02T17:43:13.014376] [INFO ] [LOCAL ] BNT: Starting deletion of primary data. [2025-10-02T17:43:13.014620] [DEBUG] [LOCAL ] BNT: Deleted primary data file. [2025-10-02T17:43:13.014718] [INFO ] [MAIN ] BNT: Starting full primary refresh. [2025-10-02T17:43:13.082510] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-01. [2025-10-02T17:43:13.469763] [INFO ] [REMOTE ] BNT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:43:13.859863] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-02T17:43:13.872955] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-03. [2025-10-02T17:43:14.673209] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-08. [2025-10-02T17:43:14.810202] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-02T17:43:14.990634] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-02T17:43:15.448299] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-02T17:43:15.473005] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-04. [2025-10-02T17:43:16.272998] [INFO ] [REMOTE ] BNT: Fetching primary data for 2024-12. [2025-10-02T17:43:16.764601] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-10-02T17:43:17.072970] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-09. [2025-10-02T17:43:17.107255] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-02T17:43:17.720372] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-02T17:43:17.872982] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-10. [2025-10-02T17:43:18.295803] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-02T17:43:18.296508] [INFO ] [REMOTE ] BNJ: Full fetch complete (4322 records). [2025-10-02T17:43:18.296583] [DEBUG] [VALIDATOR ] BNJ: Validating primary data. [2025-10-02T17:43:18.297012] [FATAL] [VALIDATOR ] BNJ: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:43:18.297165] [FATAL] [MAIN ] BNJ: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:43:18.297250] [WARN ] [MAIN ] BNJ: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:43:18.297340] [INFO ] [LOCAL ] BNJ: Starting deletion of primary data. [2025-10-02T17:43:18.297420] [DEBUG] [LOCAL ] BNJ: No primary data file found to delete. [2025-10-02T17:43:18.297465] [INFO ] [LOCAL ] BNJ: Starting deletion of derivative data. [2025-10-02T17:43:18.297909] [DEBUG] [LOCAL ] BNJ: Deleted derivative data file. [2025-10-02T17:43:18.298304] [INFO ] [MAIN ] Update Progress: 315/2370 symbols completed. BNJ took 24.6s. Estimated remaining: 4h 42m 6s. Rate: 7.3 symbols/min [2025-10-02T17:43:18.491481] [INFO ] [MAIN ] BNY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:43:18.501245] [DEBUG] [LOCAL ] BNY: Loaded 7113 existing records from primary storage. [2025-10-02T17:43:18.501476] [INFO ] [MAIN ] BNY: Loaded 7113 existing records. [2025-10-02T17:43:18.675284] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-02. [2025-10-02T17:43:18.706814] [WARN ] [MAIN ] BNY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:43:18.707048] [INFO ] [MAIN ] BNY: Wiping existing primary data before full refresh. [2025-10-02T17:43:18.707301] [INFO ] [LOCAL ] BNY: Starting deletion of primary data. [2025-10-02T17:43:18.708504] [DEBUG] [LOCAL ] BNY: Deleted primary data file. [2025-10-02T17:43:18.708565] [INFO ] [MAIN ] BNY: Starting full primary refresh. [2025-10-02T17:43:19.112496] [INFO ] [REMOTE ] BNY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:43:19.473024] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-01. [2025-10-02T17:43:19.978449] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-02T17:43:20.273048] [INFO ] [REMOTE ] BNY: Fetching primary data for 2024-12. [2025-10-02T17:43:20.401135] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-02T17:43:21.073025] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-02. [2025-10-02T17:43:21.205394] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-02T17:43:21.385626] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-02T17:43:21.872992] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-03. [2025-10-02T17:43:22.327169] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-02T17:43:22.673005] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-04. [2025-10-02T17:43:23.306080] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-02T17:43:23.472999] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-05. [2025-10-02T17:43:24.273191] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-01. [2025-10-02T17:43:24.874011] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-02T17:43:25.072973] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-03. [2025-10-02T17:43:25.185353] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-02T17:43:25.872998] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-05. [2025-10-02T17:43:26.358705] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-02T17:43:26.672973] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-02. [2025-10-02T17:43:27.034909] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-02T17:43:27.064536] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-02T17:43:27.473019] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-03. [2025-10-02T17:43:28.223888] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-02T17:43:28.273044] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-06. [2025-10-02T17:43:28.783942] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-02T17:43:29.073042] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-04. [2025-10-02T17:43:29.873026] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-04. [2025-10-02T17:43:30.499279] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-02T17:43:30.673028] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-05. [2025-10-02T17:43:30.899815] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-02T17:43:31.403851] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-02T17:43:31.473060] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-05. [2025-10-02T17:43:32.273039] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-06. [2025-10-02T17:43:33.073021] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-06. [2025-10-02T17:43:33.223018] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-02T17:43:33.820059] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-02T17:43:33.849221] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-02T17:43:33.872969] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-07. [2025-10-02T17:43:34.673063] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-06. [2025-10-02T17:43:34.704628] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-02T17:43:35.473049] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-07. [2025-10-02T17:43:36.256031] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-02T17:43:36.272956] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-08. [2025-10-02T17:43:37.026262] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-02T17:43:37.072996] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-07. [2025-10-02T17:43:37.156219] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-02T17:43:37.670355] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-02T17:43:37.872997] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-08. [2025-10-02T17:43:38.323968] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-02T17:43:38.673052] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-08. [2025-10-02T17:43:39.473021] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-09. [2025-10-02T17:43:40.170968] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-02T17:43:40.208539] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-02T17:43:40.273004] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-07. [2025-10-02T17:43:41.073054] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-10. [2025-10-02T17:43:41.871778] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-02T17:43:41.872807] [INFO ] [REMOTE ] BNY: Full fetch complete (10459 records). [2025-10-02T17:43:41.872889] [DEBUG] [VALIDATOR ] BNY: Validating primary data. [2025-10-02T17:43:41.873101] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-09. [2025-10-02T17:43:42.334242] [DEBUG] [VALIDATOR ] BNY: All expected trading days are present. [2025-10-02T17:43:42.334591] [DEBUG] [VALIDATOR ] BNY: Primary data validation passed. [2025-10-02T17:43:42.337142] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-02T17:43:42.335382] [INFO ] [MAIN ] BNY: Fetched primary data is valid. [2025-10-02T17:43:42.347974] [DEBUG] [LOCAL ] BNY: Saving primary data. [2025-10-02T17:43:42.349509] [DEBUG] [LOCAL ] BNY: Trimmed 10459 records to 7174 (keeping 200 days of data) [2025-10-02T17:43:42.396706] [DEBUG] [LOCAL ] BNY: Primary data saved (7174 records). [2025-10-02T17:43:42.396857] [INFO ] [MAIN ] BNY: Full history saved. [2025-10-02T17:43:42.396945] [INFO ] [MAIN ] Update Progress: 316/2370 symbols completed. BNY took 24.1s. Estimated remaining: 4h 43m 41s. Rate: 7.2 symbols/min [2025-10-02T17:43:42.589847] [INFO ] [MAIN ] BOC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:43:42.611162] [DEBUG] [LOCAL ] BOC: Loaded 18283 existing records from primary storage. [2025-10-02T17:43:42.611702] [INFO ] [MAIN ] BOC: Loaded 18283 existing records. [2025-10-02T17:43:42.682404] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-09. [2025-10-02T17:43:42.816022] [WARN ] [MAIN ] BOC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:43:42.816257] [INFO ] [MAIN ] BOC: Wiping existing primary data before full refresh. [2025-10-02T17:43:42.816305] [INFO ] [LOCAL ] BOC: Starting deletion of primary data. [2025-10-02T17:43:42.816972] [DEBUG] [LOCAL ] BOC: Deleted primary data file. [2025-10-02T17:43:42.817031] [INFO ] [MAIN ] BOC: Starting full primary refresh. [2025-10-02T17:43:43.215282] [INFO ] [REMOTE ] BOC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:43:43.423575] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-02T17:43:43.473022] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-10. [2025-10-02T17:43:43.626845] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-02T17:43:44.039997] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-02T17:43:44.040966] [INFO ] [REMOTE ] BNT: Full fetch complete (4495 records). [2025-10-02T17:43:44.041037] [DEBUG] [VALIDATOR ] BNT: Validating primary data. [2025-10-02T17:43:44.278109] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-08. [2025-10-02T17:43:44.440582] [DEBUG] [VALIDATOR ] BNT: All expected trading days are present. [2025-10-02T17:43:44.440693] [DEBUG] [VALIDATOR ] BNT: Primary data validation passed. [2025-10-02T17:43:44.440869] [INFO ] [MAIN ] BNT: Fetched primary data is valid. [2025-10-02T17:43:44.440923] [DEBUG] [LOCAL ] BNT: Saving primary data. [2025-10-02T17:43:44.441337] [DEBUG] [LOCAL ] BNT: Trimmed 4495 records to 3393 (keeping 200 days of data) [2025-10-02T17:43:44.463034] [DEBUG] [LOCAL ] BNT: Primary data saved (3393 records). [2025-10-02T17:43:44.463150] [INFO ] [MAIN ] BNT: Full history saved. [2025-10-02T17:43:44.463234] [INFO ] [MAIN ] Update Progress: 317/2370 symbols completed. BNT took 31.9s. Estimated remaining: 4h 42m 52s. Rate: 7.3 symbols/min [2025-10-02T17:43:45.073129] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-10. [2025-10-02T17:43:45.873072] [INFO ] [REMOTE ] BOC: Fetching primary data for 2024-12. [2025-10-02T17:43:46.030034] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-02T17:43:46.291871] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-02T17:43:46.294390] [INFO ] [REMOTE ] BNL: Full fetch complete (66984 records). [2025-10-02T17:43:46.294520] [DEBUG] [VALIDATOR ] BNL: Validating primary data. [2025-10-02T17:43:46.683046] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-09. [2025-10-02T17:43:46.758216] [DEBUG] [VALIDATOR ] BNL: All expected trading days are present. [2025-10-02T17:43:46.758361] [DEBUG] [VALIDATOR ] BNL: Primary data validation passed. [2025-10-02T17:43:46.759173] [INFO ] [MAIN ] BNL: Fetched primary data is valid. [2025-10-02T17:43:46.759252] [DEBUG] [LOCAL ] BNL: Saving primary data. [2025-10-02T17:43:46.760723] [DEBUG] [LOCAL ] BNL: Trimmed 66984 records to 47291 (keeping 200 days of data) [2025-10-02T17:43:47.005683] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-02T17:43:47.097635] [DEBUG] [LOCAL ] BNL: Primary data saved (47291 records). [2025-10-02T17:43:47.097799] [INFO ] [MAIN ] BNL: Full history saved. [2025-10-02T17:43:47.097883] [INFO ] [MAIN ] Update Progress: 318/2370 symbols completed. BNL took 45.3s. Estimated remaining: 4h 42m 8s. Rate: 7.3 symbols/min [2025-10-02T17:43:47.473055] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-01. [2025-10-02T17:43:48.257956] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-02T17:43:48.272958] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-10. [2025-10-02T17:43:48.459207] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-02T17:43:49.073022] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-02. [2025-10-02T17:43:49.613140] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-02T17:43:49.615449] [INFO ] [REMOTE ] BNS: Full fetch complete (74246 records). [2025-10-02T17:43:49.615602] [DEBUG] [VALIDATOR ] BNS: Validating primary data. [2025-10-02T17:43:50.067727] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-02T17:43:50.091693] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-03. [2025-10-02T17:43:50.119322] [DEBUG] [VALIDATOR ] BNS: All expected trading days are present. [2025-10-02T17:43:50.119432] [DEBUG] [VALIDATOR ] BNS: Primary data validation passed. [2025-10-02T17:43:50.120572] [INFO ] [MAIN ] BNS: Fetched primary data is valid. [2025-10-02T17:43:50.120700] [DEBUG] [LOCAL ] BNS: Saving primary data. [2025-10-02T17:43:50.122496] [DEBUG] [LOCAL ] BNS: Trimmed 74246 records to 51859 (keeping 200 days of data) [2025-10-02T17:43:50.469632] [DEBUG] [LOCAL ] BNS: Primary data saved (51859 records). [2025-10-02T17:43:50.469998] [INFO ] [MAIN ] BNS: Full history saved. [2025-10-02T17:43:50.470084] [INFO ] [MAIN ] Update Progress: 319/2370 symbols completed. BNS took 45.4s. Estimated remaining: 4h 41m 28s. Rate: 7.3 symbols/min [2025-10-02T17:43:51.203527] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-02T17:43:51.207690] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-04. [2025-10-02T17:43:52.084511] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-02T17:43:52.090283] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-05. [2025-10-02T17:43:52.935514] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-02T17:43:52.940243] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-06. [2025-10-02T17:43:53.972587] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-02T17:43:53.976619] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-07. [2025-10-02T17:43:54.999290] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-02T17:43:55.004373] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-08. [2025-10-02T17:43:55.856906] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-02T17:43:55.862576] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-09. [2025-10-02T17:43:56.875711] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-02T17:43:56.879878] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-10. [2025-10-02T17:43:57.701332] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-02T17:43:57.702535] [INFO ] [REMOTE ] BOC: Full fetch complete (25792 records). [2025-10-02T17:43:57.702609] [DEBUG] [VALIDATOR ] BOC: Validating primary data. [2025-10-02T17:43:58.104140] [DEBUG] [VALIDATOR ] BOC: All expected trading days are present. [2025-10-02T17:43:58.104264] [DEBUG] [VALIDATOR ] BOC: Primary data validation passed. [2025-10-02T17:43:58.104734] [INFO ] [MAIN ] BOC: Fetched primary data is valid. [2025-10-02T17:43:58.104798] [DEBUG] [LOCAL ] BOC: Saving primary data. [2025-10-02T17:43:58.105736] [DEBUG] [LOCAL ] BOC: Trimmed 25792 records to 18384 (keeping 200 days of data) [2025-10-02T17:43:58.217152] [DEBUG] [LOCAL ] BOC: Primary data saved (18384 records). [2025-10-02T17:43:58.217303] [INFO ] [MAIN ] BOC: Full history saved. [2025-10-02T17:43:58.217393] [INFO ] [MAIN ] Update Progress: 320/2370 symbols completed. BOC took 15.8s. Estimated remaining: 4h 41m 17s. Rate: 7.3 symbols/min [2025-10-02T17:43:58.909610] [INFO ] [MAIN ] BOOT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:43:58.970444] [INFO ] [MAIN ] BOE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:43:58.997392] [INFO ] [MAIN ] BOND: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:43:59.024737] [INFO ] [MAIN ] BOH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:43:59.049290] [DEBUG] [LOCAL ] BOE: Loaded 17689 existing records from primary storage. [2025-10-02T17:43:59.049845] [INFO ] [MAIN ] BOE: Loaded 17689 existing records. [2025-10-02T17:43:59.224781] [DEBUG] [LOCAL ] BOND: Loaded 32203 existing records from primary storage. [2025-10-02T17:43:59.253617] [DEBUG] [LOCAL ] BOOT: Loaded 40532 existing records from primary storage. [2025-10-02T17:43:59.254556] [INFO ] [MAIN ] BOND: Loaded 32203 existing records. [2025-10-02T17:43:59.212012] [DEBUG] [LOCAL ] BOH: Loaded 30758 existing records from primary storage. [2025-10-02T17:43:59.289103] [INFO ] [MAIN ] BOOT: Loaded 40532 existing records. [2025-10-02T17:43:59.360717] [INFO ] [MAIN ] BOH: Loaded 30758 existing records. [2025-10-02T17:43:59.411721] [WARN ] [MAIN ] BOE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:43:59.497603] [INFO ] [MAIN ] BOE: Wiping existing primary data before full refresh. [2025-10-02T17:43:59.615742] [INFO ] [LOCAL ] BOE: Starting deletion of primary data. [2025-10-02T17:43:59.667380] [DEBUG] [LOCAL ] BOE: Deleted primary data file. [2025-10-02T17:43:59.740910] [INFO ] [MAIN ] BOE: Starting full primary refresh. [2025-10-02T17:43:59.850503] [WARN ] [MAIN ] BOND: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:43:59.979185] [WARN ] [MAIN ] BOOT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:44:00.022900] [WARN ] [MAIN ] BOH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:43:59.972179] [INFO ] [MAIN ] BOND: Wiping existing primary data before full refresh. [2025-10-02T17:44:00.043847] [INFO ] [LOCAL ] BOND: Starting deletion of primary data. [2025-10-02T17:44:00.043969] [INFO ] [MAIN ] BOOT: Wiping existing primary data before full refresh. [2025-10-02T17:44:00.054454] [INFO ] [MAIN ] BOH: Wiping existing primary data before full refresh. [2025-10-02T17:44:00.068818] [INFO ] [LOCAL ] BOH: Starting deletion of primary data. [2025-10-02T17:44:00.068665] [INFO ] [LOCAL ] BOOT: Starting deletion of primary data. [2025-10-02T17:44:00.074893] [DEBUG] [LOCAL ] BOH: Deleted primary data file. [2025-10-02T17:44:00.074973] [DEBUG] [LOCAL ] BOND: Deleted primary data file. [2025-10-02T17:44:00.080237] [DEBUG] [LOCAL ] BOOT: Deleted primary data file. [2025-10-02T17:44:00.085474] [INFO ] [MAIN ] BOH: Starting full primary refresh. [2025-10-02T17:44:00.101200] [INFO ] [MAIN ] BOND: Starting full primary refresh. [2025-10-02T17:44:00.135273] [INFO ] [MAIN ] BOOT: Starting full primary refresh. [2025-10-02T17:44:01.128349] [INFO ] [REMOTE ] BOE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:44:01.168389] [INFO ] [REMOTE ] BOE: Fetching primary data for 2024-12. [2025-10-02T17:44:01.550216] [INFO ] [REMOTE ] BOH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:44:01.603887] [INFO ] [REMOTE ] BOH: Fetching primary data for 2024-12. [2025-10-02T17:44:01.647050] [INFO ] [REMOTE ] BOOT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:44:01.694298] [INFO ] [REMOTE ] BOND: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:44:01.688303] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2024-12. [2025-10-02T17:44:01.695778] [INFO ] [REMOTE ] BOND: Fetching primary data for 2024-12. [2025-10-02T17:44:02.391697] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-02T17:44:02.397862] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-01. [2025-10-02T17:44:03.026578] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-02T17:44:03.033519] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-01. [2025-10-02T17:44:03.187112] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-02T17:44:03.196124] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-01. [2025-10-02T17:44:03.298068] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-02T17:44:03.305632] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-01. [2025-10-02T17:44:03.322756] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-02T17:44:03.329280] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-02. [2025-10-02T17:44:04.299045] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-02T17:44:04.303820] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-03. [2025-10-02T17:44:04.442182] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-02T17:44:04.449602] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-02. [2025-10-02T17:44:04.665384] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-02T17:44:04.848138] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-02T17:44:05.072972] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-02. [2025-10-02T17:44:05.152385] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-02T17:44:05.728432] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-02T17:44:05.873033] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-04. [2025-10-02T17:44:06.656604] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-02T17:44:06.672980] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-02. [2025-10-02T17:44:06.721947] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-02T17:44:07.473008] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-03. [2025-10-02T17:44:07.923232] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-02T17:44:08.272998] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-03. [2025-10-02T17:44:08.983568] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-02T17:44:09.073002] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-04. [2025-10-02T17:44:09.635315] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-02T17:44:09.873025] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-04. [2025-10-02T17:44:10.588146] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-02T17:44:10.672974] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-05. [2025-10-02T17:44:11.478491] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-05. [2025-10-02T17:44:11.494323] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-02T17:44:11.970912] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-02T17:44:12.121923] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-02T17:44:12.273010] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-03. [2025-10-02T17:44:13.073045] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-05. [2025-10-02T17:44:13.710801] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-02T17:44:13.873026] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-06. [2025-10-02T17:44:14.673009] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-04. [2025-10-02T17:44:15.011132] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-02T17:44:15.041022] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-02T17:44:15.473001] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-07. [2025-10-02T17:44:16.044276] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-02T17:44:16.273015] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-06. [2025-10-02T17:44:16.818301] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-02T17:44:17.073024] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-06. [2025-10-02T17:44:17.345848] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-02T17:44:17.756765] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-02T17:44:17.873001] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-07. [2025-10-02T17:44:18.672979] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-08. [2025-10-02T17:44:18.907310] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-02T17:44:19.472995] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-08. [2025-10-02T17:44:20.187756] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-02T17:44:20.272991] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-07. [2025-10-02T17:44:20.387970] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-02T17:44:21.073031] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-05. [2025-10-02T17:44:21.767578] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-02T17:44:21.873015] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-08. [2025-10-02T17:44:22.524971] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-02T17:44:22.673024] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-06. [2025-10-02T17:44:22.935142] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-02T17:44:23.473217] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-09. [2025-10-02T17:44:24.186716] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-02T17:44:24.273016] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-07. [2025-10-02T17:44:24.574551] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-02T17:44:25.073028] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-09. [2025-10-02T17:44:25.660455] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-02T17:44:25.873027] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-08. [2025-10-02T17:44:26.103812] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-02T17:44:26.673044] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-09. [2025-10-02T17:44:27.268580] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-02T17:44:27.473051] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-10. [2025-10-02T17:44:28.108309] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-02T17:44:28.273000] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-10. [2025-10-02T17:44:28.589714] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-02T17:44:28.591123] [INFO ] [REMOTE ] BOE: Full fetch complete (26713 records). [2025-10-02T17:44:28.591242] [DEBUG] [VALIDATOR ] BOE: Validating primary data. [2025-10-02T17:44:29.050511] [DEBUG] [VALIDATOR ] BOE: All expected trading days are present. [2025-10-02T17:44:29.050600] [DEBUG] [VALIDATOR ] BOE: Primary data validation passed. [2025-10-02T17:44:29.051055] [INFO ] [MAIN ] BOE: Fetched primary data is valid. [2025-10-02T17:44:29.051117] [DEBUG] [LOCAL ] BOE: Saving primary data. [2025-10-02T17:44:29.051880] [DEBUG] [LOCAL ] BOE: Trimmed 26713 records to 17889 (keeping 200 days of data) [2025-10-02T17:44:29.106032] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-09. [2025-10-02T17:44:29.178231] [DEBUG] [LOCAL ] BOE: Primary data saved (17889 records). [2025-10-02T17:44:29.178430] [INFO ] [MAIN ] BOE: Full history saved. [2025-10-02T17:44:29.178610] [INFO ] [MAIN ] Update Progress: 321/2370 symbols completed. BOE took 31.0s. Estimated remaining: 4h 43m 33s. Rate: 7.2 symbols/min [2025-10-02T17:44:29.285906] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-02T17:44:29.320824] [INFO ] [REMOTE ] BOH: Full fetch complete (44780 records). [2025-10-02T17:44:29.324776] [DEBUG] [VALIDATOR ] BOH: Validating primary data. [2025-10-02T17:44:29.502747] [INFO ] [MAIN ] BORR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:44:29.877829] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-10. [2025-10-02T17:44:29.892544] [DEBUG] [VALIDATOR ] BOH: All expected trading days are present. [2025-10-02T17:44:29.893822] [DEBUG] [VALIDATOR ] BOH: Primary data validation passed. [2025-10-02T17:44:29.896261] [INFO ] [MAIN ] BOH: Fetched primary data is valid. [2025-10-02T17:44:29.895413] [DEBUG] [LOCAL ] BORR: Loaded 51122 existing records from primary storage. [2025-10-02T17:44:29.896500] [DEBUG] [LOCAL ] BOH: Saving primary data. [2025-10-02T17:44:29.897373] [INFO ] [MAIN ] BORR: Loaded 51122 existing records. [2025-10-02T17:44:29.994027] [DEBUG] [LOCAL ] BOH: Trimmed 44780 records to 30959 (keeping 200 days of data) [2025-10-02T17:44:30.219938] [WARN ] [MAIN ] BORR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:44:30.222154] [INFO ] [MAIN ] BORR: Wiping existing primary data before full refresh. [2025-10-02T17:44:30.225090] [INFO ] [LOCAL ] BORR: Starting deletion of primary data. [2025-10-02T17:44:30.226718] [DEBUG] [LOCAL ] BORR: Deleted primary data file. [2025-10-02T17:44:30.227230] [INFO ] [MAIN ] BORR: Starting full primary refresh. [2025-10-02T17:44:30.706891] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-02T17:44:30.720971] [INFO ] [REMOTE ] BORR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:44:30.722180] [INFO ] [REMOTE ] BORR: Fetching primary data for 2024-12. [2025-10-02T17:44:30.814807] [DEBUG] [LOCAL ] BOH: Primary data saved (30959 records). [2025-10-02T17:44:30.814992] [INFO ] [MAIN ] BOH: Full history saved. [2025-10-02T17:44:30.815096] [INFO ] [MAIN ] Update Progress: 322/2370 symbols completed. BOH took 32.6s. Estimated remaining: 4h 42m 43s. Rate: 7.2 symbols/min [2025-10-02T17:44:30.999475] [INFO ] [MAIN ] BOW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:44:30.999666] [DEBUG] [LOCAL ] BOW: No existing data file found in primary storage. [2025-10-02T17:44:30.999725] [WARN ] [MAIN ] BOW: No existing data found, performing full refresh instead. [2025-10-02T17:44:30.999877] [INFO ] [MAIN ] BOW: Wiping existing primary data before full refresh. [2025-10-02T17:44:30.999921] [INFO ] [LOCAL ] BOW: Starting deletion of primary data. [2025-10-02T17:44:30.999966] [DEBUG] [LOCAL ] BOW: No primary data file found to delete. [2025-10-02T17:44:31.000001] [INFO ] [MAIN ] BOW: Starting full primary refresh. [2025-10-02T17:44:31.168936] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-02T17:44:31.205780] [INFO ] [REMOTE ] BOOT: Full fetch complete (60200 records). [2025-10-02T17:44:31.275117] [DEBUG] [VALIDATOR ] BOOT: Validating primary data. [2025-10-02T17:44:31.475356] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-10. [2025-10-02T17:44:31.553881] [INFO ] [REMOTE ] BOW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:44:31.905466] [DEBUG] [VALIDATOR ] BOOT: All expected trading days are present. [2025-10-02T17:44:31.905611] [DEBUG] [VALIDATOR ] BOOT: Primary data validation passed. [2025-10-02T17:44:31.906870] [INFO ] [MAIN ] BOOT: Fetched primary data is valid. [2025-10-02T17:44:31.906963] [DEBUG] [LOCAL ] BOOT: Saving primary data. [2025-10-02T17:44:31.908889] [DEBUG] [LOCAL ] BOOT: Trimmed 60200 records to 40795 (keeping 200 days of data) [2025-10-02T17:44:32.184160] [DEBUG] [LOCAL ] BOOT: Primary data saved (40795 records). [2025-10-02T17:44:32.184303] [INFO ] [MAIN ] BOOT: Full history saved. [2025-10-02T17:44:32.184425] [INFO ] [MAIN ] Update Progress: 323/2370 symbols completed. BOOT took 34.0s. Estimated remaining: 4h 41m 51s. Rate: 7.3 symbols/min [2025-10-02T17:44:32.280759] [INFO ] [REMOTE ] BOW: Fetching primary data for 2024-12. [2025-10-02T17:44:32.381977] [INFO ] [MAIN ] BOX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:44:32.382193] [DEBUG] [LOCAL ] BOX: No existing data file found in primary storage. [2025-10-02T17:44:32.382233] [WARN ] [MAIN ] BOX: No existing data found, performing full refresh instead. [2025-10-02T17:44:32.382354] [INFO ] [MAIN ] BOX: Wiping existing primary data before full refresh. [2025-10-02T17:44:32.382399] [INFO ] [LOCAL ] BOX: Starting deletion of primary data. [2025-10-02T17:44:32.382442] [DEBUG] [LOCAL ] BOX: No primary data file found to delete. [2025-10-02T17:44:32.382477] [INFO ] [MAIN ] BOX: Starting full primary refresh. [2025-10-02T17:44:32.765614] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-02T17:44:32.800360] [INFO ] [REMOTE ] BOX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:44:32.803279] [INFO ] [REMOTE ] BOND: Full fetch complete (46484 records). [2025-10-02T17:44:32.803557] [DEBUG] [VALIDATOR ] BOND: Validating primary data. [2025-10-02T17:44:32.953957] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-10-02T17:44:33.087095] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-01. [2025-10-02T17:44:33.294943] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-02T17:44:33.329424] [DEBUG] [VALIDATOR ] BOND: All expected trading days are present. [2025-10-02T17:44:33.329522] [DEBUG] [VALIDATOR ] BOND: Primary data validation passed. [2025-10-02T17:44:33.330211] [INFO ] [MAIN ] BOND: Fetched primary data is valid. [2025-10-02T17:44:33.330282] [DEBUG] [LOCAL ] BOND: Saving primary data. [2025-10-02T17:44:33.331543] [DEBUG] [LOCAL ] BOND: Trimmed 46484 records to 32444 (keeping 200 days of data) [2025-10-02T17:44:33.550145] [DEBUG] [LOCAL ] BOND: Primary data saved (32444 records). [2025-10-02T17:44:33.550308] [INFO ] [MAIN ] BOND: Full history saved. [2025-10-02T17:44:33.550400] [INFO ] [MAIN ] Update Progress: 324/2370 symbols completed. BOND took 35.3s. Estimated remaining: 4h 40m 59s. Rate: 7.3 symbols/min [2025-10-02T17:44:33.743452] [INFO ] [MAIN ] BP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:44:33.797887] [DEBUG] [LOCAL ] BP: Loaded 53711 existing records from primary storage. [2025-10-02T17:44:33.798281] [INFO ] [MAIN ] BP: Loaded 53711 existing records. [2025-10-02T17:44:33.878150] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-01. [2025-10-02T17:44:33.992316] [WARN ] [MAIN ] BP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:44:33.992546] [INFO ] [MAIN ] BP: Wiping existing primary data before full refresh. [2025-10-02T17:44:33.992596] [INFO ] [LOCAL ] BP: Starting deletion of primary data. [2025-10-02T17:44:33.994082] [DEBUG] [LOCAL ] BP: Deleted primary data file. [2025-10-02T17:44:33.994144] [INFO ] [MAIN ] BP: Starting full primary refresh. [2025-10-02T17:44:34.372578] [INFO ] [REMOTE ] BP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:44:34.653299] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-02T17:44:34.672980] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-02. [2025-10-02T17:44:34.925845] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-02T17:44:35.473059] [INFO ] [REMOTE ] BOX: Fetching primary data for 2024-12. [2025-10-02T17:44:36.273116] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-02. [2025-10-02T17:44:36.379305] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-02T17:44:37.073023] [INFO ] [REMOTE ] BP: Fetching primary data for 2024-12. [2025-10-02T17:44:37.184745] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-02T17:44:37.305581] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-02T17:44:37.873025] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-03. [2025-10-02T17:44:38.673083] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-01. [2025-10-02T17:44:39.158790] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-02T17:44:39.219917] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-02T17:44:39.473067] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-03. [2025-10-02T17:44:40.273000] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-01. [2025-10-02T17:44:40.304119] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-02T17:44:40.942791] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-02T17:44:41.073048] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-04. [2025-10-02T17:44:41.873044] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-02. [2025-10-02T17:44:42.379277] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-02T17:44:42.672983] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-04. [2025-10-02T17:44:42.965607] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-02T17:44:43.094254] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-02T17:44:43.473067] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-03. [2025-10-02T17:44:43.885594] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-02T17:44:44.273049] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-02. [2025-10-02T17:44:45.073021] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-05. [2025-10-02T17:44:45.305716] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-02T17:44:45.873026] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-05. [2025-10-02T17:44:46.014042] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-02T17:44:46.049370] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-02T17:44:46.673031] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-03. [2025-10-02T17:44:47.473051] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-06. [2025-10-02T17:44:47.571692] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-02T17:44:48.273070] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-06. [2025-10-02T17:44:48.540252] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-02T17:44:48.741781] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-02T17:44:49.073056] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-07. [2025-10-02T17:44:49.827189] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-02T17:44:49.873014] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-08. [2025-10-02T17:44:50.001669] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-02T17:44:50.672982] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-07. [2025-10-02T17:44:50.813240] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-02T17:44:51.473075] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-09. [2025-10-02T17:44:52.272971] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-04. [2025-10-02T17:44:52.596112] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-02T17:44:52.729001] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-02T17:44:53.073036] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-08. [2025-10-02T17:44:53.872999] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-04. [2025-10-02T17:44:54.180488] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-02T17:44:54.672983] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-10. [2025-10-02T17:44:55.036193] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-02T17:44:55.472974] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-05. [2025-10-02T17:44:55.613825] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-02T17:44:55.615490] [INFO ] [REMOTE ] BOW: Full fetch complete (31552 records). [2025-10-02T17:44:55.615578] [DEBUG] [VALIDATOR ] BOW: Validating primary data. [2025-10-02T17:44:56.031229] [DEBUG] [VALIDATOR ] BOW: All expected trading days are present. [2025-10-02T17:44:56.031396] [DEBUG] [VALIDATOR ] BOW: Primary data validation passed. [2025-10-02T17:44:56.031962] [INFO ] [MAIN ] BOW: Fetched primary data is valid. [2025-10-02T17:44:56.032077] [DEBUG] [LOCAL ] BOW: Saving primary data. [2025-10-02T17:44:56.033286] [DEBUG] [LOCAL ] BOW: Trimmed 31552 records to 23861 (keeping 200 days of data) [2025-10-02T17:44:56.153854] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-02T17:44:56.224203] [DEBUG] [LOCAL ] BOW: Primary data saved (23861 records). [2025-10-02T17:44:56.224340] [INFO ] [MAIN ] BOW: Full history saved. [2025-10-02T17:44:56.224426] [INFO ] [MAIN ] Update Progress: 325/2370 symbols completed. BOW took 25.4s. Estimated remaining: 4h 42m 21s. Rate: 7.2 symbols/min [2025-10-02T17:44:56.278212] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-09. [2025-10-02T17:44:56.419246] [INFO ] [MAIN ] BR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:44:56.456277] [DEBUG] [LOCAL ] BR: Loaded 34667 existing records from primary storage. [2025-10-02T17:44:56.456695] [INFO ] [MAIN ] BR: Loaded 34667 existing records. [2025-10-02T17:44:56.653935] [WARN ] [MAIN ] BR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:44:56.654139] [INFO ] [MAIN ] BR: Wiping existing primary data before full refresh. [2025-10-02T17:44:56.654187] [INFO ] [LOCAL ] BR: Starting deletion of primary data. [2025-10-02T17:44:56.656916] [DEBUG] [LOCAL ] BR: Deleted primary data file. [2025-10-02T17:44:56.656979] [INFO ] [MAIN ] BR: Starting full primary refresh. [2025-10-02T17:44:57.056897] [INFO ] [REMOTE ] BR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:44:57.072960] [INFO ] [REMOTE ] BR: Fetching primary data for 2024-12. [2025-10-02T17:44:57.189703] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-02T17:44:57.873017] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-06. [2025-10-02T17:44:58.269468] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-02T17:44:58.592984] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-02T17:44:58.672974] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-01. [2025-10-02T17:44:59.473028] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-05. [2025-10-02T17:44:59.529933] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-02T17:45:00.151501] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-02T17:45:00.273046] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-02. [2025-10-02T17:45:01.073032] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-10. [2025-10-02T17:45:01.601404] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-02T17:45:01.873034] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-07. [2025-10-02T17:45:02.094222] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-05 (2.62 seconds). [2025-10-02T17:45:02.673002] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-03. [2025-10-02T17:45:02.853901] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-02T17:45:02.856624] [INFO ] [REMOTE ] BORR: Full fetch complete (74650 records). [2025-10-02T17:45:02.856839] [DEBUG] [VALIDATOR ] BORR: Validating primary data. [2025-10-02T17:45:03.331410] [DEBUG] [VALIDATOR ] BORR: All expected trading days are present. [2025-10-02T17:45:03.331509] [DEBUG] [VALIDATOR ] BORR: Primary data validation passed. [2025-10-02T17:45:03.332348] [INFO ] [MAIN ] BORR: Fetched primary data is valid. [2025-10-02T17:45:03.332423] [DEBUG] [LOCAL ] BORR: Saving primary data. [2025-10-02T17:45:03.334069] [DEBUG] [LOCAL ] BORR: Trimmed 74650 records to 51498 (keeping 200 days of data) [2025-10-02T17:45:03.502095] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-06. [2025-10-02T17:45:03.674521] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-02T17:45:03.689499] [DEBUG] [LOCAL ] BORR: Primary data saved (51498 records). [2025-10-02T17:45:03.689870] [INFO ] [MAIN ] BORR: Full history saved. [2025-10-02T17:45:03.689977] [INFO ] [MAIN ] Update Progress: 326/2370 symbols completed. BORR took 34.5s. Estimated remaining: 4h 42m 8s. Rate: 7.2 symbols/min [2025-10-02T17:45:03.882189] [INFO ] [MAIN ] BRBR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:45:03.882407] [DEBUG] [LOCAL ] BRBR: No existing data file found in primary storage. [2025-10-02T17:45:03.882502] [WARN ] [MAIN ] BRBR: No existing data found, performing full refresh instead. [2025-10-02T17:45:03.882620] [INFO ] [MAIN ] BRBR: Wiping existing primary data before full refresh. [2025-10-02T17:45:03.882723] [INFO ] [LOCAL ] BRBR: Starting deletion of primary data. [2025-10-02T17:45:03.882832] [DEBUG] [LOCAL ] BRBR: No primary data file found to delete. [2025-10-02T17:45:03.882882] [INFO ] [MAIN ] BRBR: Starting full primary refresh. [2025-10-02T17:45:04.286374] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-08. [2025-10-02T17:45:04.335462] [INFO ] [REMOTE ] BRBR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:45:04.338316] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-02T17:45:05.073001] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2024-12. [2025-10-02T17:45:05.598783] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-02T17:45:05.873032] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-04. [2025-10-02T17:45:06.226571] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-02T17:45:06.563595] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-02T17:45:06.673043] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-01. [2025-10-02T17:45:07.429768] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-02T17:45:07.473017] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-07. [2025-10-02T17:45:08.272974] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-09. [2025-10-02T17:45:08.366145] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-02T17:45:09.073035] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-02. [2025-10-02T17:45:09.774670] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-02T17:45:09.872986] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-08. [2025-10-02T17:45:09.969319] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-02T17:45:10.662007] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-02T17:45:10.672966] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-03. [2025-10-02T17:45:11.473010] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-05. [2025-10-02T17:45:11.803330] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-02T17:45:12.273012] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-09. [2025-10-02T17:45:12.404786] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-02T17:45:13.073724] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-04. [2025-10-02T17:45:13.076332] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-02T17:45:13.873027] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-10. [2025-10-02T17:45:14.494439] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-02T17:45:14.672970] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-10. [2025-10-02T17:45:14.775399] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-02T17:45:15.077729] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-02T17:45:15.080469] [INFO ] [REMOTE ] BOX: Full fetch complete (72070 records). [2025-10-02T17:45:15.080674] [DEBUG] [VALIDATOR ] BOX: Validating primary data. [2025-10-02T17:45:15.481600] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-06. [2025-10-02T17:45:15.539503] [DEBUG] [VALIDATOR ] BOX: All expected trading days are present. [2025-10-02T17:45:15.539587] [DEBUG] [VALIDATOR ] BOX: Primary data validation passed. [2025-10-02T17:45:15.540341] [INFO ] [MAIN ] BOX: Fetched primary data is valid. [2025-10-02T17:45:15.540491] [DEBUG] [LOCAL ] BOX: Saving primary data. [2025-10-02T17:45:15.547183] [DEBUG] [LOCAL ] BOX: Trimmed 72070 records to 50593 (keeping 200 days of data) [2025-10-02T17:45:15.871251] [DEBUG] [LOCAL ] BOX: Primary data saved (50593 records). [2025-10-02T17:45:15.871458] [INFO ] [MAIN ] BOX: Full history saved. [2025-10-02T17:45:15.871598] [INFO ] [MAIN ] Update Progress: 327/2370 symbols completed. BOX took 43.7s. Estimated remaining: 4h 42m 24s. Rate: 7.2 symbols/min [2025-10-02T17:45:16.073801] [INFO ] [MAIN ] BRC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:45:16.094137] [DEBUG] [LOCAL ] BRC: Loaded 19040 existing records from primary storage. [2025-10-02T17:45:16.094420] [INFO ] [MAIN ] BRC: Loaded 19040 existing records. [2025-10-02T17:45:16.285690] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-05. [2025-10-02T17:45:16.292366] [WARN ] [MAIN ] BRC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:45:16.292668] [INFO ] [MAIN ] BRC: Wiping existing primary data before full refresh. [2025-10-02T17:45:16.293570] [INFO ] [LOCAL ] BRC: Starting deletion of primary data. [2025-10-02T17:45:16.294377] [DEBUG] [LOCAL ] BRC: Deleted primary data file. [2025-10-02T17:45:16.294549] [INFO ] [MAIN ] BRC: Starting full primary refresh. [2025-10-02T17:45:16.726592] [INFO ] [REMOTE ] BRC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:45:16.763541] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-02T17:45:16.765847] [INFO ] [REMOTE ] BP: Full fetch complete (77763 records). [2025-10-02T17:45:16.766100] [DEBUG] [VALIDATOR ] BP: Validating primary data. [2025-10-02T17:45:17.077622] [INFO ] [REMOTE ] BRC: Fetching primary data for 2024-12. [2025-10-02T17:45:17.241290] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-02T17:45:17.275969] [DEBUG] [VALIDATOR ] BP: All expected trading days are present. [2025-10-02T17:45:17.276538] [DEBUG] [VALIDATOR ] BP: Primary data validation passed. [2025-10-02T17:45:17.277901] [INFO ] [MAIN ] BP: Fetched primary data is valid. [2025-10-02T17:45:17.278020] [DEBUG] [LOCAL ] BP: Saving primary data. [2025-10-02T17:45:17.280240] [DEBUG] [LOCAL ] BP: Trimmed 77763 records to 54101 (keeping 200 days of data) [2025-10-02T17:45:17.666998] [DEBUG] [LOCAL ] BP: Primary data saved (54101 records). [2025-10-02T17:45:17.667262] [INFO ] [MAIN ] BP: Full history saved. [2025-10-02T17:45:17.667416] [INFO ] [MAIN ] Update Progress: 328/2370 symbols completed. BP took 44.1s. Estimated remaining: 4h 41m 35s. Rate: 7.3 symbols/min [2025-10-02T17:45:17.868278] [INFO ] [MAIN ] BRCC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:45:17.883217] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-07. [2025-10-02T17:45:17.909026] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-02T17:45:17.967158] [DEBUG] [LOCAL ] BRCC: Loaded 40209 existing records from primary storage. [2025-10-02T17:45:17.967589] [INFO ] [MAIN ] BRCC: Loaded 40209 existing records. [2025-10-02T17:45:18.166300] [WARN ] [MAIN ] BRCC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:45:18.166800] [INFO ] [MAIN ] BRCC: Wiping existing primary data before full refresh. [2025-10-02T17:45:18.166883] [INFO ] [LOCAL ] BRCC: Starting deletion of primary data. [2025-10-02T17:45:18.168372] [DEBUG] [LOCAL ] BRCC: Deleted primary data file. [2025-10-02T17:45:18.168449] [INFO ] [MAIN ] BRCC: Starting full primary refresh. [2025-10-02T17:45:18.516592] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-02T17:45:18.616595] [INFO ] [REMOTE ] BRCC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:45:18.673035] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2024-12. [2025-10-02T17:45:18.999978] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-02T17:45:19.473087] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-06. [2025-10-02T17:45:20.193413] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-02T17:45:20.273009] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-08. [2025-10-02T17:45:21.073028] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-01. [2025-10-02T17:45:21.220776] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-02T17:45:21.727938] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-02T17:45:21.872998] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-01. [2025-10-02T17:45:22.418851] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-02T17:45:22.673051] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-07. [2025-10-02T17:45:22.922872] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-02T17:45:23.473007] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-02. [2025-10-02T17:45:24.238136] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-02T17:45:24.272962] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-03. [2025-10-02T17:45:24.461279] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-02T17:45:25.073042] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-08. [2025-10-02T17:45:25.555351] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-02T17:45:25.872997] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-04. [2025-10-02T17:45:26.673048] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-02. [2025-10-02T17:45:26.890537] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-02T17:45:27.072636] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-02T17:45:27.473017] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-09. [2025-10-02T17:45:28.021503] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-02T17:45:28.273021] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-03. [2025-10-02T17:45:29.072998] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-09. [2025-10-02T17:45:29.385690] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-02T17:45:29.761282] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-02T17:45:29.873022] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-04. [2025-10-02T17:45:30.368439] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-02T17:45:30.673067] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-10. [2025-10-02T17:45:31.130237] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-02T17:45:31.473063] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-05. [2025-10-02T17:45:31.965482] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-02T17:45:31.967292] [INFO ] [REMOTE ] BR: Full fetch complete (49298 records). [2025-10-02T17:45:31.967381] [DEBUG] [VALIDATOR ] BR: Validating primary data. [2025-10-02T17:45:32.278179] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-05. [2025-10-02T17:45:32.399873] [DEBUG] [VALIDATOR ] BR: All expected trading days are present. [2025-10-02T17:45:32.399969] [DEBUG] [VALIDATOR ] BR: Primary data validation passed. [2025-10-02T17:45:32.400662] [INFO ] [MAIN ] BR: Fetched primary data is valid. [2025-10-02T17:45:32.400739] [DEBUG] [LOCAL ] BR: Saving primary data. [2025-10-02T17:45:32.402506] [DEBUG] [LOCAL ] BR: Trimmed 49298 records to 34933 (keeping 200 days of data) [2025-10-02T17:45:32.642292] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-02T17:45:32.665904] [DEBUG] [LOCAL ] BR: Primary data saved (34933 records). [2025-10-02T17:45:32.666059] [INFO ] [MAIN ] BR: Full history saved. [2025-10-02T17:45:32.666151] [INFO ] [MAIN ] Update Progress: 329/2370 symbols completed. BR took 36.4s. Estimated remaining: 4h 42m 9s. Rate: 7.2 symbols/min [2025-10-02T17:45:32.851793] [INFO ] [MAIN ] BRO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:45:32.914337] [DEBUG] [LOCAL ] BRO: Loaded 51893 existing records from primary storage. [2025-10-02T17:45:32.914730] [INFO ] [MAIN ] BRO: Loaded 51893 existing records. [2025-10-02T17:45:33.079932] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-10. [2025-10-02T17:45:33.103360] [WARN ] [MAIN ] BRO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:45:33.104567] [INFO ] [MAIN ] BRO: Wiping existing primary data before full refresh. [2025-10-02T17:45:33.104622] [INFO ] [LOCAL ] BRO: Starting deletion of primary data. [2025-10-02T17:45:33.105775] [DEBUG] [LOCAL ] BRO: Deleted primary data file. [2025-10-02T17:45:33.105875] [INFO ] [MAIN ] BRO: Starting full primary refresh. [2025-10-02T17:45:33.506229] [INFO ] [REMOTE ] BRO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:45:33.731960] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-02T17:45:33.872993] [INFO ] [REMOTE ] BRO: Fetching primary data for 2024-12. [2025-10-02T17:45:34.518816] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-02T17:45:34.524157] [INFO ] [REMOTE ] BRBR: Full fetch complete (72071 records). [2025-10-02T17:45:34.524301] [DEBUG] [VALIDATOR ] BRBR: Validating primary data. [2025-10-02T17:45:34.686626] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-06. [2025-10-02T17:45:34.985625] [DEBUG] [VALIDATOR ] BRBR: All expected trading days are present. [2025-10-02T17:45:34.985748] [DEBUG] [VALIDATOR ] BRBR: Primary data validation passed. [2025-10-02T17:45:34.986571] [INFO ] [MAIN ] BRBR: Fetched primary data is valid. [2025-10-02T17:45:34.986622] [DEBUG] [LOCAL ] BRBR: Saving primary data. [2025-10-02T17:45:34.988225] [DEBUG] [LOCAL ] BRBR: Trimmed 72071 records to 51682 (keeping 200 days of data) [2025-10-02T17:45:35.319024] [DEBUG] [LOCAL ] BRBR: Primary data saved (51682 records). [2025-10-02T17:45:35.319215] [INFO ] [MAIN ] BRBR: Full history saved. [2025-10-02T17:45:35.319339] [INFO ] [MAIN ] Update Progress: 330/2370 symbols completed. BRBR took 31.6s. Estimated remaining: 4h 41m 26s. Rate: 7.2 symbols/min [2025-10-02T17:45:35.482589] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-06. [2025-10-02T17:45:35.513546] [INFO ] [MAIN ] BROS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:45:35.572261] [DEBUG] [LOCAL ] BROS: Loaded 53292 existing records from primary storage. [2025-10-02T17:45:35.572597] [INFO ] [MAIN ] BROS: Loaded 53292 existing records. [2025-10-02T17:45:35.771969] [WARN ] [MAIN ] BROS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:45:35.772364] [INFO ] [MAIN ] BROS: Wiping existing primary data before full refresh. [2025-10-02T17:45:35.772529] [INFO ] [LOCAL ] BROS: Starting deletion of primary data. [2025-10-02T17:45:35.773794] [DEBUG] [LOCAL ] BROS: Deleted primary data file. [2025-10-02T17:45:35.773864] [INFO ] [MAIN ] BROS: Starting full primary refresh. [2025-10-02T17:45:36.125397] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-10-02T17:45:36.215511] [INFO ] [REMOTE ] BROS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:45:36.239396] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-02T17:45:36.272978] [INFO ] [REMOTE ] BROS: Fetching primary data for 2024-12. [2025-10-02T17:45:36.618180] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-02T17:45:37.073004] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-01. [2025-10-02T17:45:37.873027] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-07. [2025-10-02T17:45:38.526551] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-10-02T17:45:38.673005] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-01. [2025-10-02T17:45:38.837152] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-02T17:45:38.926450] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-02T17:45:39.473002] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-07. [2025-10-02T17:45:40.271991] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-02T17:45:40.281984] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-02. [2025-10-02T17:45:40.763923] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-02T17:45:41.073008] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-08. [2025-10-02T17:45:41.872976] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-02. [2025-10-02T17:45:42.020427] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-02T17:45:42.040515] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-02T17:45:42.673023] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-03. [2025-10-02T17:45:43.472979] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-09. [2025-10-02T17:45:43.553457] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-02T17:45:44.137872] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-02T17:45:44.273036] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-03. [2025-10-02T17:45:44.575306] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-02T17:45:45.073014] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-10. [2025-10-02T17:45:45.872986] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-04. [2025-10-02T17:45:45.974272] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-02T17:45:45.975492] [INFO ] [REMOTE ] BRC: Full fetch complete (29026 records). [2025-10-02T17:45:45.975590] [DEBUG] [VALIDATOR ] BRC: Validating primary data. [2025-10-02T17:45:46.405383] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-02T17:45:46.452758] [DEBUG] [VALIDATOR ] BRC: All expected trading days are present. [2025-10-02T17:45:46.453169] [DEBUG] [VALIDATOR ] BRC: Primary data validation passed. [2025-10-02T17:45:46.453623] [INFO ] [MAIN ] BRC: Fetched primary data is valid. [2025-10-02T17:45:46.453715] [DEBUG] [LOCAL ] BRC: Saving primary data. [2025-10-02T17:45:46.454432] [DEBUG] [LOCAL ] BRC: Trimmed 29026 records to 19152 (keeping 200 days of data) [2025-10-02T17:45:46.574757] [DEBUG] [LOCAL ] BRC: Primary data saved (19152 records). [2025-10-02T17:45:46.574904] [INFO ] [MAIN ] BRC: Full history saved. [2025-10-02T17:45:46.574987] [INFO ] [MAIN ] Update Progress: 331/2370 symbols completed. BRC took 30.7s. Estimated remaining: 4h 41m 36s. Rate: 7.2 symbols/min [2025-10-02T17:45:46.678102] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-08. [2025-10-02T17:45:46.767850] [INFO ] [MAIN ] BRSL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:45:46.768138] [DEBUG] [LOCAL ] BRSL: No existing data file found in primary storage. [2025-10-02T17:45:46.768198] [WARN ] [MAIN ] BRSL: No existing data found, performing full refresh instead. [2025-10-02T17:45:46.768337] [INFO ] [MAIN ] BRSL: Wiping existing primary data before full refresh. [2025-10-02T17:45:46.768381] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-02T17:45:46.768425] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-02T17:45:46.768459] [INFO ] [MAIN ] BRSL: Starting full primary refresh. [2025-10-02T17:45:47.175819] [INFO ] [REMOTE ] BRSL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:45:47.473021] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2024-12. [2025-10-02T17:45:47.667283] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T17:45:47.667605] [WARN ] [REMOTE ] BRSL: No data returned for month 2024-12 [2025-10-02T17:45:47.667721] [FATAL] [REMOTE ] BRSL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T17:45:47.667792] [FATAL] [MAIN ] BRSL: Failed to fetch primary data. [2025-10-02T17:45:47.667862] [WARN ] [MAIN ] BRSL: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T17:45:47.667941] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-02T17:45:47.668038] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-02T17:45:47.668114] [INFO ] [LOCAL ] BRSL: Starting deletion of derivative data. [2025-10-02T17:45:47.668224] [DEBUG] [LOCAL ] BRSL: No derivative data file found to delete. [2025-10-02T17:45:47.668310] [INFO ] [MAIN ] Update Progress: 332/2370 symbols completed. BRSL took 1.1s. Estimated remaining: 4h 40m 43s. Rate: 7.3 symbols/min [2025-10-02T17:45:47.894986] [INFO ] [MAIN ] BRSP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:45:47.934724] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-02T17:45:47.978436] [DEBUG] [LOCAL ] BRSP: Loaded 36857 existing records from primary storage. [2025-10-02T17:45:47.979111] [INFO ] [MAIN ] BRSP: Loaded 36857 existing records. [2025-10-02T17:45:48.186164] [WARN ] [MAIN ] BRSP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:45:48.186475] [INFO ] [MAIN ] BRSP: Wiping existing primary data before full refresh. [2025-10-02T17:45:48.186540] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-10-02T17:45:48.196663] [DEBUG] [LOCAL ] BRSP: Deleted primary data file. [2025-10-02T17:45:48.213776] [INFO ] [MAIN ] BRSP: Starting full primary refresh. [2025-10-02T17:45:48.291475] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-02T17:45:48.278687] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-05. [2025-10-02T17:45:48.626881] [INFO ] [REMOTE ] BRSP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:45:49.073044] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-04. [2025-10-02T17:45:49.872976] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-09. [2025-10-02T17:45:50.201036] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-02T17:45:50.673010] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-06. [2025-10-02T17:45:51.285697] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-02T17:45:51.472823] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-02T17:45:51.473021] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-05. [2025-10-02T17:45:52.272982] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-10. [2025-10-02T17:45:52.318517] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-02T17:45:53.073008] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-07. [2025-10-02T17:45:53.325729] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-02T17:45:53.614879] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-02T17:45:53.616518] [INFO ] [REMOTE ] BRCC: Full fetch complete (57689 records). [2025-10-02T17:45:53.616674] [DEBUG] [VALIDATOR ] BRCC: Validating primary data. [2025-10-02T17:45:53.885341] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-06. [2025-10-02T17:45:54.025908] [DEBUG] [VALIDATOR ] BRCC: All expected trading days are present. [2025-10-02T17:45:54.026064] [DEBUG] [VALIDATOR ] BRCC: Primary data validation passed. [2025-10-02T17:45:54.027002] [INFO ] [MAIN ] BRCC: Fetched primary data is valid. [2025-10-02T17:45:54.027087] [DEBUG] [LOCAL ] BRCC: Saving primary data. [2025-10-02T17:45:54.028898] [DEBUG] [LOCAL ] BRCC: Trimmed 57689 records to 40474 (keeping 200 days of data) [2025-10-02T17:45:54.267074] [DEBUG] [LOCAL ] BRCC: Primary data saved (40474 records). [2025-10-02T17:45:54.267202] [INFO ] [MAIN ] BRCC: Full history saved. [2025-10-02T17:45:54.267295] [INFO ] [MAIN ] Update Progress: 333/2370 symbols completed. BRCC took 36.6s. Estimated remaining: 4h 40m 25s. Rate: 7.3 symbols/min [2025-10-02T17:45:54.447466] [INFO ] [MAIN ] BRT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:45:54.453931] [DEBUG] [LOCAL ] BRT: Loaded 4950 existing records from primary storage. [2025-10-02T17:45:54.454104] [INFO ] [MAIN ] BRT: Loaded 4950 existing records. [2025-10-02T17:45:54.648529] [WARN ] [MAIN ] BRT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:45:54.648826] [INFO ] [MAIN ] BRT: Wiping existing primary data before full refresh. [2025-10-02T17:45:54.648876] [INFO ] [LOCAL ] BRT: Starting deletion of primary data. [2025-10-02T17:45:54.649166] [DEBUG] [LOCAL ] BRT: Deleted primary data file. [2025-10-02T17:45:54.649227] [INFO ] [MAIN ] BRT: Starting full primary refresh. [2025-10-02T17:45:54.682717] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2024-12. [2025-10-02T17:45:55.048898] [INFO ] [REMOTE ] BRT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:45:55.121050] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-02T17:45:55.472968] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-08. [2025-10-02T17:45:55.934933] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-02T17:45:56.258844] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-02T17:45:56.272958] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-01. [2025-10-02T17:45:57.072978] [INFO ] [REMOTE ] BRT: Fetching primary data for 2024-12. [2025-10-02T17:45:57.296705] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-02T17:45:57.550376] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-02T17:45:57.665493] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-02T17:45:57.873049] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-02. [2025-10-02T17:45:58.673047] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-01. [2025-10-02T17:45:59.148033] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-02T17:45:59.298078] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-02T17:45:59.473014] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-07. [2025-10-02T17:46:00.272987] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-09. [2025-10-02T17:46:01.073046] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-03. [2025-10-02T17:46:01.807918] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-10-02T17:46:01.873002] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-02. [2025-10-02T17:46:02.400760] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-02T17:46:02.601846] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-02T17:46:02.673003] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-03. [2025-10-02T17:46:02.891033] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-09 (2.62 seconds). [2025-10-02T17:46:03.435564] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-02T17:46:03.472995] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-04. [2025-10-02T17:46:04.273041] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-10. [2025-10-02T17:46:04.898829] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-02T17:46:05.073031] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-08. [2025-10-02T17:46:05.763505] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-02T17:46:05.765552] [INFO ] [REMOTE ] BRO: Full fetch complete (74231 records). [2025-10-02T17:46:05.765691] [DEBUG] [VALIDATOR ] BRO: Validating primary data. [2025-10-02T17:46:05.881292] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-05. [2025-10-02T17:46:06.213685] [DEBUG] [VALIDATOR ] BRO: All expected trading days are present. [2025-10-02T17:46:06.214028] [DEBUG] [VALIDATOR ] BRO: Primary data validation passed. [2025-10-02T17:46:06.214876] [INFO ] [MAIN ] BRO: Fetched primary data is valid. [2025-10-02T17:46:06.214947] [DEBUG] [LOCAL ] BRO: Saving primary data. [2025-10-02T17:46:06.216476] [DEBUG] [LOCAL ] BRO: Trimmed 74231 records to 52266 (keeping 200 days of data) [2025-10-02T17:46:06.556228] [DEBUG] [LOCAL ] BRO: Primary data saved (52266 records). [2025-10-02T17:46:06.556373] [INFO ] [MAIN ] BRO: Full history saved. [2025-10-02T17:46:06.556455] [INFO ] [MAIN ] Update Progress: 334/2370 symbols completed. BRO took 33.9s. Estimated remaining: 4h 40m 41s. Rate: 7.3 symbols/min [2025-10-02T17:46:06.673559] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-04. [2025-10-02T17:46:06.742144] [INFO ] [MAIN ] BRW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:46:06.742416] [DEBUG] [LOCAL ] BRW: No existing data file found in primary storage. [2025-10-02T17:46:06.742475] [WARN ] [MAIN ] BRW: No existing data found, performing full refresh instead. [2025-10-02T17:46:06.742666] [INFO ] [MAIN ] BRW: Wiping existing primary data before full refresh. [2025-10-02T17:46:06.742732] [INFO ] [LOCAL ] BRW: Starting deletion of primary data. [2025-10-02T17:46:06.742789] [DEBUG] [LOCAL ] BRW: No primary data file found to delete. [2025-10-02T17:46:06.742831] [INFO ] [MAIN ] BRW: Starting full primary refresh. [2025-10-02T17:46:07.151011] [INFO ] [REMOTE ] BRW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:46:07.219859] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-02T17:46:07.477701] [INFO ] [REMOTE ] BRW: Fetching primary data for 2024-12. [2025-10-02T17:46:07.489882] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-02T17:46:07.502624] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-02T17:46:08.272987] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-06. [2025-10-02T17:46:08.947238] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-02T17:46:09.073008] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-05. [2025-10-02T17:46:09.246255] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-02T17:46:09.873007] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-09. [2025-10-02T17:46:10.087420] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-02T17:46:10.672992] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-01. [2025-10-02T17:46:11.472968] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-07. [2025-10-02T17:46:11.863670] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-02T17:46:12.053812] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-02T17:46:12.272980] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-10. [2025-10-02T17:46:12.880452] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-02T17:46:13.073072] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-08. [2025-10-02T17:46:13.872997] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-02. [2025-10-02T17:46:13.933842] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-02T17:46:13.936972] [INFO ] [REMOTE ] BROS: Full fetch complete (77047 records). [2025-10-02T17:46:13.937192] [DEBUG] [VALIDATOR ] BROS: Validating primary data. [2025-10-02T17:46:14.372732] [DEBUG] [VALIDATOR ] BROS: All expected trading days are present. [2025-10-02T17:46:14.372893] [DEBUG] [VALIDATOR ] BROS: Primary data validation passed. [2025-10-02T17:46:14.373810] [INFO ] [MAIN ] BROS: Fetched primary data is valid. [2025-10-02T17:46:14.373966] [DEBUG] [LOCAL ] BROS: Saving primary data. [2025-10-02T17:46:14.375707] [DEBUG] [LOCAL ] BROS: Trimmed 77047 records to 53681 (keeping 200 days of data) [2025-10-02T17:46:14.500968] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-02T17:46:14.703069] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-09. [2025-10-02T17:46:14.755598] [DEBUG] [LOCAL ] BROS: Primary data saved (53681 records). [2025-10-02T17:46:14.755759] [INFO ] [MAIN ] BROS: Full history saved. [2025-10-02T17:46:14.755855] [INFO ] [MAIN ] Update Progress: 335/2370 symbols completed. BROS took 39.4s. Estimated remaining: 4h 40m 32s. Rate: 7.3 symbols/min [2025-10-02T17:46:14.962614] [INFO ] [MAIN ] BRX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:46:14.964362] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-02T17:46:15.021374] [DEBUG] [LOCAL ] BRX: Loaded 51713 existing records from primary storage. [2025-10-02T17:46:15.021826] [INFO ] [MAIN ] BRX: Loaded 51713 existing records. [2025-10-02T17:46:15.225491] [WARN ] [MAIN ] BRX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:46:15.225764] [INFO ] [MAIN ] BRX: Wiping existing primary data before full refresh. [2025-10-02T17:46:15.225820] [INFO ] [LOCAL ] BRX: Starting deletion of primary data. [2025-10-02T17:46:15.227439] [DEBUG] [LOCAL ] BRX: Deleted primary data file. [2025-10-02T17:46:15.227521] [INFO ] [MAIN ] BRX: Starting full primary refresh. [2025-10-02T17:46:15.478843] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-06. [2025-10-02T17:46:15.634259] [INFO ] [REMOTE ] BRX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:46:15.889524] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-02T17:46:16.142902] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-02T17:46:16.273026] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-03. [2025-10-02T17:46:17.072995] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-07. [2025-10-02T17:46:17.227785] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-02T17:46:17.557802] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-02T17:46:17.873033] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-04. [2025-10-02T17:46:18.673035] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-08. [2025-10-02T17:46:18.854530] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-02T17:46:19.320660] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-02T17:46:19.473024] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-05. [2025-10-02T17:46:20.273023] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-10. [2025-10-02T17:46:20.523310] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-02T17:46:21.073023] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-06. [2025-10-02T17:46:21.416575] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-02T17:46:21.418115] [INFO ] [REMOTE ] BRSP: Full fetch complete (53950 records). [2025-10-02T17:46:21.418217] [DEBUG] [VALIDATOR ] BRSP: Validating primary data. [2025-10-02T17:46:21.419084] [FATAL] [VALIDATOR ] BRSP: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:46:21.419177] [FATAL] [MAIN ] BRSP: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:46:21.419221] [WARN ] [MAIN ] BRSP: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:46:21.419287] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-10-02T17:46:21.419352] [DEBUG] [LOCAL ] BRSP: No primary data file found to delete. [2025-10-02T17:46:21.419387] [INFO ] [LOCAL ] BRSP: Starting deletion of derivative data. [2025-10-02T17:46:21.419809] [DEBUG] [LOCAL ] BRSP: Deleted derivative data file. [2025-10-02T17:46:21.420940] [INFO ] [MAIN ] Update Progress: 336/2370 symbols completed. BRSP took 33.8s. Estimated remaining: 4h 40m 14s. Rate: 7.3 symbols/min [2025-10-02T17:46:21.614808] [INFO ] [MAIN ] BSAC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:46:21.615385] [DEBUG] [LOCAL ] BSAC: No existing data file found in primary storage. [2025-10-02T17:46:21.615578] [WARN ] [MAIN ] BSAC: No existing data found, performing full refresh instead. [2025-10-02T17:46:21.615786] [INFO ] [MAIN ] BSAC: Wiping existing primary data before full refresh. [2025-10-02T17:46:21.615840] [INFO ] [LOCAL ] BSAC: Starting deletion of primary data. [2025-10-02T17:46:21.615885] [DEBUG] [LOCAL ] BSAC: No primary data file found to delete. [2025-10-02T17:46:21.615918] [INFO ] [MAIN ] BSAC: Starting full primary refresh. [2025-10-02T17:46:21.873421] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-02T17:46:21.883800] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-09. [2025-10-02T17:46:22.044889] [INFO ] [REMOTE ] BSAC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:46:22.611316] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-02T17:46:22.673008] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-10. [2025-10-02T17:46:23.387244] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-02T17:46:23.388481] [INFO ] [REMOTE ] BRT: Full fetch complete (6760 records). [2025-10-02T17:46:23.388622] [DEBUG] [VALIDATOR ] BRT: Validating primary data. [2025-10-02T17:46:23.389427] [FATAL] [VALIDATOR ] BRT: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:46:23.389546] [FATAL] [MAIN ] BRT: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:46:23.389616] [WARN ] [MAIN ] BRT: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:46:23.389718] [INFO ] [LOCAL ] BRT: Starting deletion of primary data. [2025-10-02T17:46:23.389844] [DEBUG] [LOCAL ] BRT: No primary data file found to delete. [2025-10-02T17:46:23.389982] [INFO ] [LOCAL ] BRT: Starting deletion of derivative data. [2025-10-02T17:46:23.390285] [DEBUG] [LOCAL ] BRT: Deleted derivative data file. [2025-10-02T17:46:23.390389] [INFO ] [MAIN ] Update Progress: 337/2370 symbols completed. BRT took 29.1s. Estimated remaining: 4h 39m 28s. Rate: 7.3 symbols/min [2025-10-02T17:46:23.478364] [INFO ] [REMOTE ] BRX: Fetching primary data for 2024-12. [2025-10-02T17:46:23.674373] [INFO ] [MAIN ] BSBR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:46:23.725990] [DEBUG] [LOCAL ] BSBR: Loaded 35400 existing records from primary storage. [2025-10-02T17:46:23.726493] [INFO ] [MAIN ] BSBR: Loaded 35400 existing records. [2025-10-02T17:46:24.042192] [WARN ] [MAIN ] BSBR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:46:24.042491] [INFO ] [MAIN ] BSBR: Wiping existing primary data before full refresh. [2025-10-02T17:46:24.042551] [INFO ] [LOCAL ] BSBR: Starting deletion of primary data. [2025-10-02T17:46:24.043835] [DEBUG] [LOCAL ] BSBR: Deleted primary data file. [2025-10-02T17:46:24.043912] [INFO ] [MAIN ] BSBR: Starting full primary refresh. [2025-10-02T17:46:24.277872] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-07. [2025-10-02T17:46:24.546570] [INFO ] [REMOTE ] BSBR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:46:25.073045] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2024-12. [2025-10-02T17:46:25.337584] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-02T17:46:25.647451] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-02T17:46:25.873031] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-08. [2025-10-02T17:46:26.223809] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-02T17:46:26.673008] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-01. [2025-10-02T17:46:26.859197] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-02T17:46:27.472996] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2024-12. [2025-10-02T17:46:28.272994] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-01. [2025-10-02T17:46:28.384506] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-02T17:46:28.436430] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-02T17:46:28.961223] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-02T17:46:29.073020] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-02. [2025-10-02T17:46:29.873030] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-02. [2025-10-02T17:46:30.330549] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-02T17:46:30.673022] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-01. [2025-10-02T17:46:31.482047] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-09. [2025-10-02T17:46:31.490117] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-02T17:46:31.908238] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-02T17:46:32.272999] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-03. [2025-10-02T17:46:32.584340] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-02T17:46:33.073011] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-10. [2025-10-02T17:46:33.645731] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-02T17:46:33.873039] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-02. [2025-10-02T17:46:34.132849] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-02T17:46:34.134514] [INFO ] [REMOTE ] BRW: Full fetch complete (30373 records). [2025-10-02T17:46:34.134598] [DEBUG] [VALIDATOR ] BRW: Validating primary data. [2025-10-02T17:46:34.556708] [DEBUG] [VALIDATOR ] BRW: All expected trading days are present. [2025-10-02T17:46:34.556804] [DEBUG] [VALIDATOR ] BRW: Primary data validation passed. [2025-10-02T17:46:34.557275] [INFO ] [MAIN ] BRW: Fetched primary data is valid. [2025-10-02T17:46:34.557320] [DEBUG] [LOCAL ] BRW: Saving primary data. [2025-10-02T17:46:34.558303] [DEBUG] [LOCAL ] BRW: Trimmed 30373 records to 20369 (keeping 200 days of data) [2025-10-02T17:46:34.673959] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-03. [2025-10-02T17:46:34.693636] [DEBUG] [LOCAL ] BRW: Primary data saved (20369 records). [2025-10-02T17:46:34.693810] [INFO ] [MAIN ] BRW: Full history saved. [2025-10-02T17:46:34.693900] [INFO ] [MAIN ] Update Progress: 338/2370 symbols completed. BRW took 28.1s. Estimated remaining: 4h 39m 38s. Rate: 7.3 symbols/min [2025-10-02T17:46:34.900997] [INFO ] [MAIN ] BSL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:46:34.911963] [DEBUG] [LOCAL ] BSL: Loaded 8243 existing records from primary storage. [2025-10-02T17:46:34.912394] [INFO ] [MAIN ] BSL: Loaded 8243 existing records. [2025-10-02T17:46:35.109055] [WARN ] [MAIN ] BSL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:46:35.109352] [INFO ] [MAIN ] BSL: Wiping existing primary data before full refresh. [2025-10-02T17:46:35.109535] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-10-02T17:46:35.110185] [DEBUG] [LOCAL ] BSL: Deleted primary data file. [2025-10-02T17:46:35.110249] [INFO ] [MAIN ] BSL: Starting full primary refresh. [2025-10-02T17:46:35.267790] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-02T17:46:35.485154] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-03. [2025-10-02T17:46:35.529877] [INFO ] [REMOTE ] BSL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:46:36.273023] [INFO ] [REMOTE ] BSL: Fetching primary data for 2024-12. [2025-10-02T17:46:36.549156] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-02T17:46:36.905432] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-02T17:46:37.072967] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-04. [2025-10-02T17:46:37.388473] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-02T17:46:37.873049] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-01. [2025-10-02T17:46:38.363658] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-02T17:46:38.673008] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-04. [2025-10-02T17:46:38.972513] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-02T17:46:39.473063] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-04. [2025-10-02T17:46:39.840184] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-02T17:46:40.273010] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-05. [2025-10-02T17:46:41.073367] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-02T17:46:41.073451] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-05. [2025-10-02T17:46:41.658228] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-02T17:46:41.872990] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-06. [2025-10-02T17:46:42.396626] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-02T17:46:42.673001] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-05. [2025-10-02T17:46:43.463077] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-02T17:46:43.473184] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-06. [2025-10-02T17:46:43.986274] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-02T17:46:44.272960] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-06. [2025-10-02T17:46:44.374871] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-02T17:46:45.073041] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-02. [2025-10-02T17:46:45.681031] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-02T17:46:45.741688] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-02T17:46:45.873019] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-07. [2025-10-02T17:46:46.673027] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-03. [2025-10-02T17:46:47.473019] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-07. [2025-10-02T17:46:47.651573] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-02T17:46:47.685544] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-02T17:46:48.273000] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-07. [2025-10-02T17:46:48.488918] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-02T17:46:49.073020] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-08. [2025-10-02T17:46:49.719062] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-02T17:46:49.873001] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-04. [2025-10-02T17:46:50.352576] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-02T17:46:50.672984] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-09. [2025-10-02T17:46:50.752547] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-02T17:46:51.473030] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-05. [2025-10-02T17:46:52.089621] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-02T17:46:52.097292] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-02T17:46:52.272983] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-10. [2025-10-02T17:46:53.073001] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-06. [2025-10-02T17:46:53.386540] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-02T17:46:53.388217] [INFO ] [REMOTE ] BSAC: Full fetch complete (43902 records). [2025-10-02T17:46:53.388341] [DEBUG] [VALIDATOR ] BSAC: Validating primary data. [2025-10-02T17:46:53.603408] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-02T17:46:53.835329] [DEBUG] [VALIDATOR ] BSAC: All expected trading days are present. [2025-10-02T17:46:53.835409] [DEBUG] [VALIDATOR ] BSAC: Primary data validation passed. [2025-10-02T17:46:53.835953] [INFO ] [MAIN ] BSAC: Fetched primary data is valid. [2025-10-02T17:46:53.836025] [DEBUG] [LOCAL ] BSAC: Saving primary data. [2025-10-02T17:46:53.837058] [DEBUG] [LOCAL ] BSAC: Trimmed 43902 records to 33243 (keeping 200 days of data) [2025-10-02T17:46:53.888924] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-08. [2025-10-02T17:46:54.043867] [DEBUG] [LOCAL ] BSAC: Primary data saved (33243 records). [2025-10-02T17:46:54.044022] [INFO ] [MAIN ] BSAC: Full history saved. [2025-10-02T17:46:54.044098] [INFO ] [MAIN ] Update Progress: 339/2370 symbols completed. BSAC took 32.6s. Estimated remaining: 4h 40m 37s. Rate: 7.2 symbols/min [2025-10-02T17:46:54.229612] [INFO ] [MAIN ] BSM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:46:54.264357] [DEBUG] [LOCAL ] BSM: Loaded 32181 existing records from primary storage. [2025-10-02T17:46:54.264707] [INFO ] [MAIN ] BSM: Loaded 32181 existing records. [2025-10-02T17:46:54.469217] [WARN ] [MAIN ] BSM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:46:54.469469] [INFO ] [MAIN ] BSM: Wiping existing primary data before full refresh. [2025-10-02T17:46:54.469520] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-10-02T17:46:54.470498] [DEBUG] [LOCAL ] BSM: Deleted primary data file. [2025-10-02T17:46:54.470559] [INFO ] [MAIN ] BSM: Starting full primary refresh. [2025-10-02T17:46:54.683048] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-08. [2025-10-02T17:46:54.870338] [INFO ] [REMOTE ] BSM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:46:55.473029] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-07. [2025-10-02T17:46:55.639861] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-02T17:46:56.244826] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-02T17:46:56.271359] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-02T17:46:56.273008] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-09. [2025-10-02T17:46:57.073028] [INFO ] [REMOTE ] BSM: Fetching primary data for 2024-12. [2025-10-02T17:46:57.834766] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-02T17:46:57.872965] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-10. [2025-10-02T17:46:58.630759] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-02T17:46:58.672987] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-01. [2025-10-02T17:46:59.251662] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-02T17:46:59.253742] [INFO ] [REMOTE ] BRX: Full fetch complete (74907 records). [2025-10-02T17:46:59.253876] [DEBUG] [VALIDATOR ] BRX: Validating primary data. [2025-10-02T17:46:59.479075] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-09. [2025-10-02T17:46:59.721320] [DEBUG] [VALIDATOR ] BRX: All expected trading days are present. [2025-10-02T17:46:59.721425] [DEBUG] [VALIDATOR ] BRX: Primary data validation passed. [2025-10-02T17:46:59.722212] [INFO ] [MAIN ] BRX: Fetched primary data is valid. [2025-10-02T17:46:59.722279] [DEBUG] [LOCAL ] BRX: Saving primary data. [2025-10-02T17:46:59.723798] [DEBUG] [LOCAL ] BRX: Trimmed 74907 records to 52084 (keeping 200 days of data) [2025-10-02T17:47:00.001599] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-02T17:47:00.084819] [DEBUG] [LOCAL ] BRX: Primary data saved (52084 records). [2025-10-02T17:47:00.084965] [INFO ] [MAIN ] BRX: Full history saved. [2025-10-02T17:47:00.085052] [INFO ] [MAIN ] Update Progress: 340/2370 symbols completed. BRX took 45.3s. Estimated remaining: 4h 40m 15s. Rate: 7.2 symbols/min [2025-10-02T17:47:00.264762] [INFO ] [MAIN ] BST: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:47:00.265002] [DEBUG] [LOCAL ] BST: No existing data file found in primary storage. [2025-10-02T17:47:00.265086] [WARN ] [MAIN ] BST: No existing data found, performing full refresh instead. [2025-10-02T17:47:00.265236] [INFO ] [MAIN ] BST: Wiping existing primary data before full refresh. [2025-10-02T17:47:00.265280] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-10-02T17:47:00.265328] [DEBUG] [LOCAL ] BST: No primary data file found to delete. [2025-10-02T17:47:00.265368] [INFO ] [MAIN ] BST: Starting full primary refresh. [2025-10-02T17:47:00.278459] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-08. [2025-10-02T17:47:00.647889] [INFO ] [REMOTE ] BST: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:47:01.072998] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-02. [2025-10-02T17:47:01.311555] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-02T17:47:01.361256] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-02T17:47:01.873009] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-09. [2025-10-02T17:47:02.492991] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-02T17:47:02.673007] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-10. [2025-10-02T17:47:02.725180] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-02T17:47:03.311085] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-02T17:47:03.311934] [INFO ] [REMOTE ] BSL: Full fetch complete (12656 records). [2025-10-02T17:47:03.312005] [DEBUG] [VALIDATOR ] BSL: Validating primary data. [2025-10-02T17:47:03.312475] [FATAL] [VALIDATOR ] BSL: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:47:03.312593] [FATAL] [MAIN ] BSL: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:47:03.312638] [WARN ] [MAIN ] BSL: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:47:03.312740] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-10-02T17:47:03.312816] [DEBUG] [LOCAL ] BSL: No primary data file found to delete. [2025-10-02T17:47:03.312861] [INFO ] [LOCAL ] BSL: Starting deletion of derivative data. [2025-10-02T17:47:03.313149] [DEBUG] [LOCAL ] BSL: Deleted derivative data file. [2025-10-02T17:47:03.313251] [INFO ] [MAIN ] Update Progress: 341/2370 symbols completed. BSL took 28.6s. Estimated remaining: 4h 39m 36s. Rate: 7.3 symbols/min [2025-10-02T17:47:03.478162] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-10. [2025-10-02T17:47:03.533115] [INFO ] [MAIN ] BSTZ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:47:03.533305] [DEBUG] [LOCAL ] BSTZ: No existing data file found in primary storage. [2025-10-02T17:47:03.533350] [WARN ] [MAIN ] BSTZ: No existing data found, performing full refresh instead. [2025-10-02T17:47:03.533460] [INFO ] [MAIN ] BSTZ: Wiping existing primary data before full refresh. [2025-10-02T17:47:03.533503] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-10-02T17:47:03.533547] [DEBUG] [LOCAL ] BSTZ: No primary data file found to delete. [2025-10-02T17:47:03.533581] [INFO ] [MAIN ] BSTZ: Starting full primary refresh. [2025-10-02T17:47:03.924705] [INFO ] [REMOTE ] BSTZ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:47:04.273022] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-03. [2025-10-02T17:47:04.721420] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-02T17:47:04.723792] [INFO ] [REMOTE ] BSBR: Full fetch complete (50688 records). [2025-10-02T17:47:04.723922] [DEBUG] [VALIDATOR ] BSBR: Validating primary data. [2025-10-02T17:47:05.078141] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2024-12. [2025-10-02T17:47:05.157177] [DEBUG] [VALIDATOR ] BSBR: All expected trading days are present. [2025-10-02T17:47:05.157282] [DEBUG] [VALIDATOR ] BSBR: Primary data validation passed. [2025-10-02T17:47:05.158133] [INFO ] [MAIN ] BSBR: Fetched primary data is valid. [2025-10-02T17:47:05.158208] [DEBUG] [LOCAL ] BSBR: Saving primary data. [2025-10-02T17:47:05.159588] [DEBUG] [LOCAL ] BSBR: Trimmed 50688 records to 35696 (keeping 200 days of data) [2025-10-02T17:47:05.375418] [DEBUG] [LOCAL ] BSBR: Primary data saved (35696 records). [2025-10-02T17:47:05.375601] [INFO ] [MAIN ] BSBR: Full history saved. [2025-10-02T17:47:05.375786] [INFO ] [MAIN ] Update Progress: 342/2370 symbols completed. BSBR took 42.0s. Estimated remaining: 4h 38m 51s. Rate: 7.3 symbols/min [2025-10-02T17:47:05.563494] [INFO ] [MAIN ] BSX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:47:05.563681] [DEBUG] [LOCAL ] BSX: No existing data file found in primary storage. [2025-10-02T17:47:05.563737] [WARN ] [MAIN ] BSX: No existing data found, performing full refresh instead. [2025-10-02T17:47:05.563848] [INFO ] [MAIN ] BSX: Wiping existing primary data before full refresh. [2025-10-02T17:47:05.563897] [INFO ] [LOCAL ] BSX: Starting deletion of primary data. [2025-10-02T17:47:05.563941] [DEBUG] [LOCAL ] BSX: No primary data file found to delete. [2025-10-02T17:47:05.563975] [INFO ] [MAIN ] BSX: Starting full primary refresh. [2025-10-02T17:47:05.853504] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-02T17:47:05.873247] [INFO ] [REMOTE ] BST: Fetching primary data for 2024-12. [2025-10-02T17:47:05.989466] [INFO ] [REMOTE ] BSX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:47:06.588983] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-02T17:47:06.672985] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-04. [2025-10-02T17:47:07.102975] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-02T17:47:07.473017] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-01. [2025-10-02T17:47:07.605305] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-02T17:47:08.273004] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-01. [2025-10-02T17:47:08.712890] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-02T17:47:09.003853] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-02T17:47:09.072993] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-02. [2025-10-02T17:47:09.872967] [INFO ] [REMOTE ] BSX: Fetching primary data for 2024-12. [2025-10-02T17:47:10.212592] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-02T17:47:10.673023] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-05. [2025-10-02T17:47:11.472967] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-03. [2025-10-02T17:47:11.662569] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-02T17:47:12.130560] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-02T17:47:12.273041] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-01. [2025-10-02T17:47:12.602685] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-02T17:47:13.073069] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-04. [2025-10-02T17:47:13.872974] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-02. [2025-10-02T17:47:14.107627] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-02T17:47:14.254606] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-02T17:47:14.566732] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-02T17:47:14.673027] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-06. [2025-10-02T17:47:15.473029] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-03. [2025-10-02T17:47:15.915373] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-02T17:47:16.272978] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-02. [2025-10-02T17:47:16.490009] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-02T17:47:17.073069] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-07. [2025-10-02T17:47:17.873026] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-05. [2025-10-02T17:47:17.954805] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-02T17:47:18.560395] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-02T17:47:18.673023] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-04. [2025-10-02T17:47:19.017415] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-02T17:47:19.473012] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-08. [2025-10-02T17:47:19.898049] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-02T17:47:20.272981] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-05. [2025-10-02T17:47:21.014720] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-02T17:47:21.081466] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-06. [2025-10-02T17:47:21.083031] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-02T17:47:21.872983] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-03. [2025-10-02T17:47:22.113697] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-02T17:47:22.673001] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-09. [2025-10-02T17:47:23.472991] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-06. [2025-10-02T17:47:23.964973] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-02T17:47:24.138419] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-02T17:47:24.272983] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-04. [2025-10-02T17:47:24.613140] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-02T17:47:25.073004] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-10. [2025-10-02T17:47:25.873000] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-07. [2025-10-02T17:47:26.035690] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-02T17:47:26.148960] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-02T17:47:26.150150] [INFO ] [REMOTE ] BSM: Full fetch complete (47249 records). [2025-10-02T17:47:26.150260] [DEBUG] [VALIDATOR ] BSM: Validating primary data. [2025-10-02T17:47:26.150981] [FATAL] [VALIDATOR ] BSM: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:47:26.151072] [FATAL] [MAIN ] BSM: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:47:26.151119] [WARN ] [MAIN ] BSM: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:47:26.151186] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-10-02T17:47:26.151267] [DEBUG] [LOCAL ] BSM: No primary data file found to delete. [2025-10-02T17:47:26.151324] [INFO ] [LOCAL ] BSM: Starting deletion of derivative data. [2025-10-02T17:47:26.151607] [DEBUG] [LOCAL ] BSM: Deleted derivative data file. [2025-10-02T17:47:26.151904] [INFO ] [MAIN ] Update Progress: 343/2370 symbols completed. BSM took 32.1s. Estimated remaining: 4h 39m 57s. Rate: 7.2 symbols/min [2025-10-02T17:47:26.340699] [INFO ] [MAIN ] BTA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:47:26.349608] [DEBUG] [LOCAL ] BTA: Loaded 5410 existing records from primary storage. [2025-10-02T17:47:26.349921] [INFO ] [MAIN ] BTA: Loaded 5410 existing records. [2025-10-02T17:47:26.553281] [WARN ] [MAIN ] BTA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:47:26.553506] [INFO ] [MAIN ] BTA: Wiping existing primary data before full refresh. [2025-10-02T17:47:26.553567] [INFO ] [LOCAL ] BTA: Starting deletion of primary data. [2025-10-02T17:47:26.553987] [DEBUG] [LOCAL ] BTA: Deleted primary data file. [2025-10-02T17:47:26.554049] [INFO ] [MAIN ] BTA: Starting full primary refresh. [2025-10-02T17:47:26.678120] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-05. [2025-10-02T17:47:26.961378] [INFO ] [REMOTE ] BTA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:47:26.972947] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-02T17:47:27.473030] [INFO ] [REMOTE ] BTA: Fetching primary data for 2024-12. [2025-10-02T17:47:28.272854] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-02T17:47:28.273005] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-08. [2025-10-02T17:47:28.328929] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-02T17:47:29.072977] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-07. [2025-10-02T17:47:29.446483] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-02T17:47:29.873039] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-01. [2025-10-02T17:47:30.356048] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-02T17:47:30.640360] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-02T17:47:30.673040] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-09. [2025-10-02T17:47:31.473010] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-02. [2025-10-02T17:47:31.689101] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-02T17:47:32.280446] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-08. [2025-10-02T17:47:32.283529] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-02T17:47:33.073026] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-10. [2025-10-02T17:47:33.460536] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-02T17:47:33.873004] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-03. [2025-10-02T17:47:33.880963] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-02T17:47:33.882126] [INFO ] [REMOTE ] BST: Full fetch complete (28666 records). [2025-10-02T17:47:33.882239] [DEBUG] [VALIDATOR ] BST: Validating primary data. [2025-10-02T17:47:33.883350] [FATAL] [VALIDATOR ] BST: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:47:33.883460] [FATAL] [MAIN ] BST: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:47:33.883528] [WARN ] [MAIN ] BST: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:47:33.883695] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-10-02T17:47:33.883798] [DEBUG] [LOCAL ] BST: No primary data file found to delete. [2025-10-02T17:47:33.883858] [INFO ] [LOCAL ] BST: Starting deletion of derivative data. [2025-10-02T17:47:33.883907] [DEBUG] [LOCAL ] BST: No derivative data file found to delete. [2025-10-02T17:47:33.883982] [INFO ] [MAIN ] Update Progress: 344/2370 symbols completed. BST took 33.8s. Estimated remaining: 4h 39m 46s. Rate: 7.2 symbols/min [2025-10-02T17:47:34.084046] [INFO ] [MAIN ] BTCM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:47:34.084241] [DEBUG] [LOCAL ] BTCM: No existing data file found in primary storage. [2025-10-02T17:47:34.084283] [WARN ] [MAIN ] BTCM: No existing data found, performing full refresh instead. [2025-10-02T17:47:34.084439] [INFO ] [MAIN ] BTCM: Wiping existing primary data before full refresh. [2025-10-02T17:47:34.084483] [INFO ] [LOCAL ] BTCM: Starting deletion of primary data. [2025-10-02T17:47:34.084527] [DEBUG] [LOCAL ] BTCM: No primary data file found to delete. [2025-10-02T17:47:34.084675] [INFO ] [MAIN ] BTCM: Starting full primary refresh. [2025-10-02T17:47:34.506215] [INFO ] [REMOTE ] BTCM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:47:34.513247] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-02T17:47:34.673016] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-06. [2025-10-02T17:47:35.473022] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2024-12. [2025-10-02T17:47:36.272983] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-09. [2025-10-02T17:47:36.569193] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-02T17:47:36.769686] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-02T17:47:37.073006] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-01. [2025-10-02T17:47:37.872985] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-04. [2025-10-02T17:47:37.916377] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-02T17:47:38.072020] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-02T17:47:38.660000] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-02T17:47:38.673007] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-10. [2025-10-02T17:47:39.473025] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-07. [2025-10-02T17:47:39.687763] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-02T17:47:39.688972] [INFO ] [REMOTE ] BSTZ: Full fetch complete (36552 records). [2025-10-02T17:47:39.689057] [DEBUG] [VALIDATOR ] BSTZ: Validating primary data. [2025-10-02T17:47:39.689719] [FATAL] [VALIDATOR ] BSTZ: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:47:39.689816] [FATAL] [MAIN ] BSTZ: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:47:39.689869] [WARN ] [MAIN ] BSTZ: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:47:39.689918] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-10-02T17:47:39.689984] [DEBUG] [LOCAL ] BSTZ: No primary data file found to delete. [2025-10-02T17:47:39.690023] [INFO ] [LOCAL ] BSTZ: Starting deletion of derivative data. [2025-10-02T17:47:39.690071] [DEBUG] [LOCAL ] BSTZ: No derivative data file found to delete. [2025-10-02T17:47:39.690148] [INFO ] [MAIN ] Update Progress: 345/2370 symbols completed. BSTZ took 36.4s. Estimated remaining: 4h 39m 23s. Rate: 7.2 symbols/min [2025-10-02T17:47:39.871734] [INFO ] [MAIN ] BTE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:47:39.926672] [DEBUG] [LOCAL ] BTE: Loaded 52720 existing records from primary storage. [2025-10-02T17:47:39.926993] [INFO ] [MAIN ] BTE: Loaded 52720 existing records. [2025-10-02T17:47:40.124626] [WARN ] [MAIN ] BTE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:47:40.124905] [INFO ] [MAIN ] BTE: Wiping existing primary data before full refresh. [2025-10-02T17:47:40.124965] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-10-02T17:47:40.128718] [DEBUG] [LOCAL ] BTE: Deleted primary data file. [2025-10-02T17:47:40.128781] [INFO ] [MAIN ] BTE: Starting full primary refresh. [2025-10-02T17:47:40.278096] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-02. [2025-10-02T17:47:40.507698] [INFO ] [REMOTE ] BTE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:47:41.055230] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-02T17:47:41.072951] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-03. [2025-10-02T17:47:41.151215] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-02T17:47:41.687309] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-02T17:47:41.873042] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-04. [2025-10-02T17:47:42.593870] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-02T17:47:42.672999] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-08. [2025-10-02T17:47:43.473027] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-05. [2025-10-02T17:47:44.195864] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-02T17:47:44.272974] [INFO ] [REMOTE ] BTE: Fetching primary data for 2024-12. [2025-10-02T17:47:44.461683] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-02T17:47:45.072981] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-09. [2025-10-02T17:47:45.872980] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-06. [2025-10-02T17:47:46.204176] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-02T17:47:46.459276] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-02T17:47:46.672986] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-05. [2025-10-02T17:47:46.840160] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-02T17:47:47.106785] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-02T17:47:47.472991] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-06. [2025-10-02T17:47:47.982290] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-02T17:47:48.273027] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-07. [2025-10-02T17:47:49.073040] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-01. [2025-10-02T17:47:49.873033] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-10. [2025-10-02T17:47:50.126443] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-02T17:47:50.673009] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-07. [2025-10-02T17:47:50.747332] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-02T17:47:51.286299] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-02T17:47:51.381118] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-02T17:47:51.383185] [INFO ] [REMOTE ] BSX: Full fetch complete (77697 records). [2025-10-02T17:47:51.383334] [DEBUG] [VALIDATOR ] BSX: Validating primary data. [2025-10-02T17:47:51.478197] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-08. [2025-10-02T17:47:51.836143] [DEBUG] [VALIDATOR ] BSX: All expected trading days are present. [2025-10-02T17:47:51.836241] [DEBUG] [VALIDATOR ] BSX: Primary data validation passed. [2025-10-02T17:47:51.837611] [INFO ] [MAIN ] BSX: Fetched primary data is valid. [2025-10-02T17:47:51.837718] [DEBUG] [LOCAL ] BSX: Saving primary data. [2025-10-02T17:47:51.839726] [DEBUG] [LOCAL ] BSX: Trimmed 77697 records to 54078 (keeping 200 days of data) [2025-10-02T17:47:52.176209] [DEBUG] [LOCAL ] BSX: Primary data saved (54078 records). [2025-10-02T17:47:52.176345] [INFO ] [MAIN ] BSX: Full history saved. [2025-10-02T17:47:52.176420] [INFO ] [MAIN ] Update Progress: 346/2370 symbols completed. BSX took 46.8s. Estimated remaining: 4h 39m 39s. Rate: 7.2 symbols/min [2025-10-02T17:47:52.278106] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-08. [2025-10-02T17:47:52.384064] [INFO ] [MAIN ] BTI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:47:52.445081] [DEBUG] [LOCAL ] BTI: Loaded 53556 existing records from primary storage. [2025-10-02T17:47:52.445529] [INFO ] [MAIN ] BTI: Loaded 53556 existing records. [2025-10-02T17:47:52.656745] [WARN ] [MAIN ] BTI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:47:52.656985] [INFO ] [MAIN ] BTI: Wiping existing primary data before full refresh. [2025-10-02T17:47:52.657043] [INFO ] [LOCAL ] BTI: Starting deletion of primary data. [2025-10-02T17:47:52.661322] [DEBUG] [LOCAL ] BTI: Deleted primary data file. [2025-10-02T17:47:52.661405] [INFO ] [MAIN ] BTI: Starting full primary refresh. [2025-10-02T17:47:52.994868] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-02T17:47:53.078311] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-09. [2025-10-02T17:47:53.100278] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-02T17:47:53.107975] [INFO ] [REMOTE ] BTI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:47:53.791410] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-02T17:47:53.873000] [INFO ] [REMOTE ] BTI: Fetching primary data for 2024-12. [2025-10-02T17:47:54.673009] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-10. [2025-10-02T17:47:55.123247] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-02T17:47:55.124082] [INFO ] [REMOTE ] BTA: Full fetch complete (9456 records). [2025-10-02T17:47:55.124174] [DEBUG] [VALIDATOR ] BTA: Validating primary data. [2025-10-02T17:47:55.124605] [FATAL] [VALIDATOR ] BTA: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:47:55.124714] [FATAL] [MAIN ] BTA: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:47:55.124761] [WARN ] [MAIN ] BTA: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:47:55.124830] [INFO ] [LOCAL ] BTA: Starting deletion of primary data. [2025-10-02T17:47:55.124897] [DEBUG] [LOCAL ] BTA: No primary data file found to delete. [2025-10-02T17:47:55.124933] [INFO ] [LOCAL ] BTA: Starting deletion of derivative data. [2025-10-02T17:47:55.125486] [DEBUG] [LOCAL ] BTA: Deleted derivative data file. [2025-10-02T17:47:55.125614] [INFO ] [MAIN ] Update Progress: 347/2370 symbols completed. BTA took 29.0s. Estimated remaining: 4h 38m 60s. Rate: 7.3 symbols/min [2025-10-02T17:47:55.313162] [INFO ] [MAIN ] BTO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:47:55.325122] [DEBUG] [LOCAL ] BTO: Loaded 8767 existing records from primary storage. [2025-10-02T17:47:55.325347] [INFO ] [MAIN ] BTO: Loaded 8767 existing records. [2025-10-02T17:47:55.488884] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-09. [2025-10-02T17:47:55.534548] [WARN ] [MAIN ] BTO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:47:55.534788] [INFO ] [MAIN ] BTO: Wiping existing primary data before full refresh. [2025-10-02T17:47:55.534839] [INFO ] [LOCAL ] BTO: Starting deletion of primary data. [2025-10-02T17:47:55.536332] [DEBUG] [LOCAL ] BTO: Deleted primary data file. [2025-10-02T17:47:55.536396] [INFO ] [MAIN ] BTO: Starting full primary refresh. [2025-10-02T17:47:55.933377] [INFO ] [REMOTE ] BTO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:47:55.965844] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-02T17:47:56.273051] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-02. [2025-10-02T17:47:56.836094] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-02T17:47:57.072998] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-10. [2025-10-02T17:47:57.872990] [INFO ] [REMOTE ] BTO: Fetching primary data for 2024-12. [2025-10-02T17:47:58.288681] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-02T17:47:58.523886] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-02T17:47:58.525557] [INFO ] [REMOTE ] BTCM: Full fetch complete (19363 records). [2025-10-02T17:47:58.525703] [DEBUG] [VALIDATOR ] BTCM: Validating primary data. [2025-10-02T17:47:58.678105] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-03. [2025-10-02T17:47:58.979615] [DEBUG] [VALIDATOR ] BTCM: All expected trading days are present. [2025-10-02T17:47:58.979866] [DEBUG] [VALIDATOR ] BTCM: Primary data validation passed. [2025-10-02T17:47:58.980955] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-02T17:47:58.980705] [INFO ] [MAIN ] BTCM: Fetched primary data is valid. [2025-10-02T17:47:58.983412] [DEBUG] [LOCAL ] BTCM: Saving primary data. [2025-10-02T17:47:58.984881] [DEBUG] [LOCAL ] BTCM: Trimmed 19363 records to 15505 (keeping 200 days of data) [2025-10-02T17:47:59.086174] [DEBUG] [LOCAL ] BTCM: Primary data saved (15505 records). [2025-10-02T17:47:59.086317] [INFO ] [MAIN ] BTCM: Full history saved. [2025-10-02T17:47:59.086392] [INFO ] [MAIN ] Update Progress: 348/2370 symbols completed. BTCM took 25.2s. Estimated remaining: 4h 38m 26s. Rate: 7.3 symbols/min [2025-10-02T17:47:59.268877] [INFO ] [MAIN ] BTT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:47:59.269095] [DEBUG] [LOCAL ] BTT: No existing data file found in primary storage. [2025-10-02T17:47:59.269151] [WARN ] [MAIN ] BTT: No existing data found, performing full refresh instead. [2025-10-02T17:47:59.269293] [INFO ] [MAIN ] BTT: Wiping existing primary data before full refresh. [2025-10-02T17:47:59.269358] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-10-02T17:47:59.269407] [DEBUG] [LOCAL ] BTT: No primary data file found to delete. [2025-10-02T17:47:59.269442] [INFO ] [MAIN ] BTT: Starting full primary refresh. [2025-10-02T17:47:59.478125] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-01. [2025-10-02T17:47:59.683928] [INFO ] [REMOTE ] BTT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:48:00.247373] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-02T17:48:00.272968] [INFO ] [REMOTE ] BTT: Fetching primary data for 2024-12. [2025-10-02T17:48:01.072995] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-04. [2025-10-02T17:48:01.836138] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-02T17:48:01.872973] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-01. [2025-10-02T17:48:01.980156] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-01 (2.50 seconds). [2025-10-02T17:48:02.672982] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-01. [2025-10-02T17:48:02.809763] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-02T17:48:03.005462] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-02T17:48:03.310287] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-02T17:48:03.473003] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-02. [2025-10-02T17:48:04.273003] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-05. [2025-10-02T17:48:04.393049] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-02T17:48:05.072993] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-03. [2025-10-02T17:48:05.742826] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-02T17:48:05.872978] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-04. [2025-10-02T17:48:06.092129] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-02T17:48:06.672971] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-06. [2025-10-02T17:48:06.735576] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-02T17:48:07.472994] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-05. [2025-10-02T17:48:08.022922] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-02T17:48:08.262694] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-02T17:48:08.272960] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-06. [2025-10-02T17:48:08.921539] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-02T17:48:09.073046] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-07. [2025-10-02T17:48:09.872986] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-07. [2025-10-02T17:48:10.030889] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-02T17:48:10.673015] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-02. [2025-10-02T17:48:11.472969] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-08. [2025-10-02T17:48:11.587460] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-02T17:48:11.833286] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-02T17:48:12.273068] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-08. [2025-10-02T17:48:12.310108] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-02T17:48:13.073005] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-09. [2025-10-02T17:48:13.680182] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-02T17:48:13.873030] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-02. [2025-10-02T17:48:13.964343] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-02T17:48:14.673031] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-09. [2025-10-02T17:48:15.473017] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-10. [2025-10-02T17:48:15.861390] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-02T17:48:16.052899] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-02T17:48:16.053880] [INFO ] [REMOTE ] BTO: Full fetch complete (13254 records). [2025-10-02T17:48:16.053959] [DEBUG] [VALIDATOR ] BTO: Validating primary data. [2025-10-02T17:48:16.281366] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-03. [2025-10-02T17:48:16.476347] [DEBUG] [VALIDATOR ] BTO: All expected trading days are present. [2025-10-02T17:48:16.476549] [DEBUG] [VALIDATOR ] BTO: Primary data validation passed. [2025-10-02T17:48:16.476983] [INFO ] [MAIN ] BTO: Fetched primary data is valid. [2025-10-02T17:48:16.477047] [DEBUG] [LOCAL ] BTO: Saving primary data. [2025-10-02T17:48:16.477567] [DEBUG] [LOCAL ] BTO: Trimmed 13254 records to 8811 (keeping 200 days of data) [2025-10-02T17:48:16.540021] [DEBUG] [LOCAL ] BTO: Primary data saved (8811 records). [2025-10-02T17:48:16.540278] [INFO ] [MAIN ] BTO: Full history saved. [2025-10-02T17:48:16.540427] [INFO ] [MAIN ] Update Progress: 349/2370 symbols completed. BTO took 21.4s. Estimated remaining: 4h 39m 11s. Rate: 7.2 symbols/min [2025-10-02T17:48:16.711429] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-02T17:48:16.783395] [INFO ] [MAIN ] BTU: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:48:16.850612] [DEBUG] [LOCAL ] BTU: Loaded 53311 existing records from primary storage. [2025-10-02T17:48:16.851007] [INFO ] [MAIN ] BTU: Loaded 53311 existing records. [2025-10-02T17:48:17.042069] [WARN ] [MAIN ] BTU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:48:17.042368] [INFO ] [MAIN ] BTU: Wiping existing primary data before full refresh. [2025-10-02T17:48:17.042479] [INFO ] [LOCAL ] BTU: Starting deletion of primary data. [2025-10-02T17:48:17.044682] [DEBUG] [LOCAL ] BTU: Deleted primary data file. [2025-10-02T17:48:17.044767] [INFO ] [MAIN ] BTU: Starting full primary refresh. [2025-10-02T17:48:17.079124] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-10. [2025-10-02T17:48:17.256609] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-02T17:48:17.470955] [INFO ] [REMOTE ] BTU: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:48:17.873004] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-04. [2025-10-02T17:48:18.672978] [INFO ] [REMOTE ] BTU: Fetching primary data for 2024-12. [2025-10-02T17:48:18.699919] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-02T17:48:18.702331] [INFO ] [REMOTE ] BTE: Full fetch complete (76053 records). [2025-10-02T17:48:18.702446] [DEBUG] [VALIDATOR ] BTE: Validating primary data. [2025-10-02T17:48:19.066157] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-02T17:48:19.175830] [DEBUG] [VALIDATOR ] BTE: All expected trading days are present. [2025-10-02T17:48:19.175928] [DEBUG] [VALIDATOR ] BTE: Primary data validation passed. [2025-10-02T17:48:19.177091] [INFO ] [MAIN ] BTE: Fetched primary data is valid. [2025-10-02T17:48:19.177180] [DEBUG] [LOCAL ] BTE: Saving primary data. [2025-10-02T17:48:19.178756] [DEBUG] [LOCAL ] BTE: Trimmed 76053 records to 53107 (keeping 200 days of data) [2025-10-02T17:48:19.474895] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-03. [2025-10-02T17:48:19.518995] [DEBUG] [LOCAL ] BTE: Primary data saved (53107 records). [2025-10-02T17:48:19.519182] [INFO ] [MAIN ] BTE: Full history saved. [2025-10-02T17:48:19.519274] [INFO ] [MAIN ] Update Progress: 350/2370 symbols completed. BTE took 39.8s. Estimated remaining: 4h 38m 32s. Rate: 7.3 symbols/min [2025-10-02T17:48:19.706871] [INFO ] [MAIN ] BTX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:48:19.707099] [DEBUG] [LOCAL ] BTX: No existing data file found in primary storage. [2025-10-02T17:48:19.707142] [WARN ] [MAIN ] BTX: No existing data found, performing full refresh instead. [2025-10-02T17:48:19.707286] [INFO ] [MAIN ] BTX: Wiping existing primary data before full refresh. [2025-10-02T17:48:19.707337] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-02T17:48:19.707388] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-02T17:48:19.707422] [INFO ] [MAIN ] BTX: Starting full primary refresh. [2025-10-02T17:48:20.093380] [INFO ] [REMOTE ] BTX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:48:20.272970] [INFO ] [REMOTE ] BTX: Fetching primary data for 2024-12. [2025-10-02T17:48:20.474905] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T17:48:20.475212] [WARN ] [REMOTE ] BTX: No data returned for month 2024-12 [2025-10-02T17:48:20.475301] [FATAL] [REMOTE ] BTX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T17:48:20.475354] [FATAL] [MAIN ] BTX: Failed to fetch primary data. [2025-10-02T17:48:20.475416] [WARN ] [MAIN ] BTX: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T17:48:20.475490] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-02T17:48:20.475559] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-02T17:48:20.475602] [INFO ] [LOCAL ] BTX: Starting deletion of derivative data. [2025-10-02T17:48:20.475723] [DEBUG] [LOCAL ] BTX: No derivative data file found to delete. [2025-10-02T17:48:20.475798] [INFO ] [MAIN ] Update Progress: 351/2370 symbols completed. BTX took 1.0s. Estimated remaining: 4h 37m 42s. Rate: 7.3 symbols/min [2025-10-02T17:48:20.680215] [INFO ] [MAIN ] BTZ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:48:20.680444] [DEBUG] [LOCAL ] BTZ: No existing data file found in primary storage. [2025-10-02T17:48:20.680540] [WARN ] [MAIN ] BTZ: No existing data found, performing full refresh instead. [2025-10-02T17:48:20.680727] [INFO ] [MAIN ] BTZ: Wiping existing primary data before full refresh. [2025-10-02T17:48:20.680842] [INFO ] [LOCAL ] BTZ: Starting deletion of primary data. [2025-10-02T17:48:20.680978] [DEBUG] [LOCAL ] BTZ: No primary data file found to delete. [2025-10-02T17:48:20.681049] [INFO ] [MAIN ] BTZ: Starting full primary refresh. [2025-10-02T17:48:20.842834] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-10-02T17:48:21.078102] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-05. [2025-10-02T17:48:21.148084] [INFO ] [REMOTE ] BTZ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:48:21.767478] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-10-02T17:48:21.873029] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2024-12. [2025-10-02T17:48:22.118472] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-02T17:48:22.673043] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-06. [2025-10-02T17:48:23.184134] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-02T17:48:23.473043] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-01. [2025-10-02T17:48:23.771564] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-02T17:48:24.273020] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-04. [2025-10-02T17:48:25.073066] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-07. [2025-10-02T17:48:25.259786] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-02T17:48:25.873056] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-01. [2025-10-02T17:48:26.126172] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-02T17:48:26.458990] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-02T17:48:26.673008] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-08. [2025-10-02T17:48:26.936906] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-02T17:48:27.364053] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-02T17:48:27.473050] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-09. [2025-10-02T17:48:28.273014] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-02. [2025-10-02T17:48:28.416930] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-02T17:48:29.072972] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-10. [2025-10-02T17:48:29.138412] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-02T17:48:29.873025] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-02. [2025-10-02T17:48:29.884554] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-02T17:48:29.885634] [INFO ] [REMOTE ] BTT: Full fetch complete (24027 records). [2025-10-02T17:48:29.885746] [DEBUG] [VALIDATOR ] BTT: Validating primary data. [2025-10-02T17:48:29.886451] [FATAL] [VALIDATOR ] BTT: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:48:29.886562] [FATAL] [MAIN ] BTT: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:48:29.886802] [WARN ] [MAIN ] BTT: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:48:29.886904] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-10-02T17:48:29.886981] [DEBUG] [LOCAL ] BTT: No primary data file found to delete. [2025-10-02T17:48:29.887019] [INFO ] [LOCAL ] BTT: Starting deletion of derivative data. [2025-10-02T17:48:29.887059] [DEBUG] [LOCAL ] BTT: No derivative data file found to delete. [2025-10-02T17:48:29.887199] [INFO ] [MAIN ] Update Progress: 352/2370 symbols completed. BTT took 30.8s. Estimated remaining: 4h 37m 40s. Rate: 7.3 symbols/min [2025-10-02T17:48:30.074538] [INFO ] [MAIN ] BUD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:48:30.137924] [DEBUG] [LOCAL ] BUD: Loaded 52716 existing records from primary storage. [2025-10-02T17:48:30.138390] [INFO ] [MAIN ] BUD: Loaded 52716 existing records. [2025-10-02T17:48:30.342527] [WARN ] [MAIN ] BUD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:48:30.342799] [INFO ] [MAIN ] BUD: Wiping existing primary data before full refresh. [2025-10-02T17:48:30.342892] [INFO ] [LOCAL ] BUD: Starting deletion of primary data. [2025-10-02T17:48:30.344755] [DEBUG] [LOCAL ] BUD: Deleted primary data file. [2025-10-02T17:48:30.344825] [INFO ] [MAIN ] BUD: Starting full primary refresh. [2025-10-02T17:48:30.673240] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-05. [2025-10-02T17:48:30.760748] [INFO ] [REMOTE ] BUD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:48:31.473041] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-03. [2025-10-02T17:48:32.272977] [INFO ] [REMOTE ] BUD: Fetching primary data for 2024-12. [2025-10-02T17:48:32.451552] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-02T17:48:32.541190] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-02T17:48:33.073016] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-06. [2025-10-02T17:48:33.873059] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-04. [2025-10-02T17:48:34.547874] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-10-02T17:48:34.673054] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-01. [2025-10-02T17:48:34.743768] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-02T17:48:35.086664] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-02T17:48:35.473057] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-07. [2025-10-02T17:48:36.273013] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-05. [2025-10-02T17:48:36.626460] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-02 (6.75 seconds). [2025-10-02T17:48:36.670790] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-02T17:48:37.073042] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-03. [2025-10-02T17:48:37.399639] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-02T17:48:37.693410] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-02T17:48:37.873014] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-06. [2025-10-02T17:48:38.672976] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-08. [2025-10-02T17:48:39.027297] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-02T17:48:39.106160] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-02T17:48:39.472991] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-04. [2025-10-02T17:48:40.272987] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-02. [2025-10-02T17:48:40.807452] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-02T17:48:41.073019] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-09. [2025-10-02T17:48:41.520771] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-02T17:48:41.872964] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-05. [2025-10-02T17:48:41.909173] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-02T17:48:42.672974] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-07. [2025-10-02T17:48:42.781816] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-02T17:48:43.473039] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-03. [2025-10-02T17:48:43.753190] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-02T17:48:43.798332] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-02T17:48:44.273002] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-08. [2025-10-02T17:48:45.073020] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-10. [2025-10-02T17:48:45.442856] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-02T17:48:45.872998] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-09. [2025-10-02T17:48:46.059328] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-03 (2.59 seconds). [2025-10-02T17:48:46.673015] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-06. [2025-10-02T17:48:46.804699] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-02T17:48:46.807197] [INFO ] [REMOTE ] BTI: Full fetch complete (77448 records). [2025-10-02T17:48:46.807352] [DEBUG] [VALIDATOR ] BTI: Validating primary data. [2025-10-02T17:48:47.185564] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-02T17:48:47.330770] [DEBUG] [VALIDATOR ] BTI: All expected trading days are present. [2025-10-02T17:48:47.330865] [DEBUG] [VALIDATOR ] BTI: Primary data validation passed. [2025-10-02T17:48:47.331671] [INFO ] [MAIN ] BTI: Fetched primary data is valid. [2025-10-02T17:48:47.331739] [DEBUG] [LOCAL ] BTI: Saving primary data. [2025-10-02T17:48:47.333221] [DEBUG] [LOCAL ] BTI: Trimmed 77448 records to 53946 (keeping 200 days of data) [2025-10-02T17:48:47.522484] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-10. [2025-10-02T17:48:47.682365] [DEBUG] [LOCAL ] BTI: Primary data saved (53946 records). [2025-10-02T17:48:47.682532] [INFO ] [MAIN ] BTI: Full history saved. [2025-10-02T17:48:47.682632] [INFO ] [MAIN ] Update Progress: 353/2370 symbols completed. BTI took 55.5s. Estimated remaining: 4h 38m 27s. Rate: 7.2 symbols/min [2025-10-02T17:48:47.866293] [INFO ] [MAIN ] BUI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:48:47.866461] [DEBUG] [LOCAL ] BUI: No existing data file found in primary storage. [2025-10-02T17:48:47.866499] [WARN ] [MAIN ] BUI: No existing data found, performing full refresh instead. [2025-10-02T17:48:47.866679] [INFO ] [MAIN ] BUI: Wiping existing primary data before full refresh. [2025-10-02T17:48:47.866733] [INFO ] [LOCAL ] BUI: Starting deletion of primary data. [2025-10-02T17:48:47.866776] [DEBUG] [LOCAL ] BUI: No primary data file found to delete. [2025-10-02T17:48:47.866809] [INFO ] [MAIN ] BUI: Starting full primary refresh. [2025-10-02T17:48:48.251375] [INFO ] [REMOTE ] BUI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:48:48.273029] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-04. [2025-10-02T17:48:48.479032] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-02T17:48:48.481582] [INFO ] [REMOTE ] BTZ: Full fetch complete (33894 records). [2025-10-02T17:48:48.481821] [DEBUG] [VALIDATOR ] BTZ: Validating primary data. [2025-10-02T17:48:48.714043] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-02T17:48:48.959790] [DEBUG] [VALIDATOR ] BTZ: All expected trading days are present. [2025-10-02T17:48:48.959961] [DEBUG] [VALIDATOR ] BTZ: Primary data validation passed. [2025-10-02T17:48:48.960769] [INFO ] [MAIN ] BTZ: Fetched primary data is valid. [2025-10-02T17:48:48.960842] [DEBUG] [LOCAL ] BTZ: Saving primary data. [2025-10-02T17:48:48.961937] [DEBUG] [LOCAL ] BTZ: Trimmed 33894 records to 22996 (keeping 200 days of data) [2025-10-02T17:48:49.074707] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-07. [2025-10-02T17:48:49.112596] [DEBUG] [LOCAL ] BTZ: Primary data saved (22996 records). [2025-10-02T17:48:49.112805] [INFO ] [MAIN ] BTZ: Full history saved. [2025-10-02T17:48:49.112895] [INFO ] [MAIN ] Update Progress: 354/2370 symbols completed. BTZ took 28.6s. Estimated remaining: 4h 37m 39s. Rate: 7.3 symbols/min [2025-10-02T17:48:49.318887] [INFO ] [MAIN ] BUR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:48:49.363623] [DEBUG] [LOCAL ] BUR: Loaded 45140 existing records from primary storage. [2025-10-02T17:48:49.363986] [INFO ] [MAIN ] BUR: Loaded 45140 existing records. [2025-10-02T17:48:49.565552] [WARN ] [MAIN ] BUR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:48:49.565850] [INFO ] [MAIN ] BUR: Wiping existing primary data before full refresh. [2025-10-02T17:48:49.565911] [INFO ] [LOCAL ] BUR: Starting deletion of primary data. [2025-10-02T17:48:49.567948] [DEBUG] [LOCAL ] BUR: Deleted primary data file. [2025-10-02T17:48:49.568045] [INFO ] [MAIN ] BUR: Starting full primary refresh. [2025-10-02T17:48:49.885030] [INFO ] [REMOTE ] BUI: Fetching primary data for 2024-12. [2025-10-02T17:48:49.978136] [INFO ] [REMOTE ] BUR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:48:50.010994] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-02T17:48:50.672973] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-05. [2025-10-02T17:48:50.827443] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-02T17:48:51.079329] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-02T17:48:51.473015] [INFO ] [REMOTE ] BUR: Fetching primary data for 2024-12. [2025-10-02T17:48:52.255374] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-02T17:48:52.272964] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-08. [2025-10-02T17:48:52.984001] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-02T17:48:53.073052] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-01. [2025-10-02T17:48:53.639587] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-02T17:48:53.872988] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-06. [2025-10-02T17:48:54.086240] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-02T17:48:54.673023] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-09. [2025-10-02T17:48:55.224471] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-02T17:48:55.473004] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-01. [2025-10-02T17:48:56.272982] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-02. [2025-10-02T17:48:56.318003] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-02T17:48:57.038985] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-02T17:48:57.073062] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-10. [2025-10-02T17:48:57.112144] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-02T17:48:57.872988] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-03. [2025-10-02T17:48:58.505083] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-02T17:48:58.672998] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-07. [2025-10-02T17:48:58.687285] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-02T17:48:58.689548] [INFO ] [REMOTE ] BTU: Full fetch complete (76564 records). [2025-10-02T17:48:58.689721] [DEBUG] [VALIDATOR ] BTU: Validating primary data. [2025-10-02T17:48:58.690693] [FATAL] [VALIDATOR ] BTU: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:48:58.690807] [FATAL] [MAIN ] BTU: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:48:58.690876] [WARN ] [MAIN ] BTU: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:48:58.690964] [INFO ] [LOCAL ] BTU: Starting deletion of primary data. [2025-10-02T17:48:58.691096] [DEBUG] [LOCAL ] BTU: No primary data file found to delete. [2025-10-02T17:48:58.691174] [INFO ] [LOCAL ] BTU: Starting deletion of derivative data. [2025-10-02T17:48:58.691840] [DEBUG] [LOCAL ] BTU: Deleted derivative data file. [2025-10-02T17:48:58.691970] [INFO ] [MAIN ] Update Progress: 355/2370 symbols completed. BTU took 42.2s. Estimated remaining: 4h 37m 39s. Rate: 7.3 symbols/min [2025-10-02T17:48:58.893757] [INFO ] [MAIN ] BURL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:48:58.942462] [DEBUG] [LOCAL ] BURL: Loaded 45991 existing records from primary storage. [2025-10-02T17:48:58.942843] [INFO ] [MAIN ] BURL: Loaded 45991 existing records. [2025-10-02T17:48:59.136281] [WARN ] [MAIN ] BURL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:48:59.136517] [INFO ] [MAIN ] BURL: Wiping existing primary data before full refresh. [2025-10-02T17:48:59.136568] [INFO ] [LOCAL ] BURL: Starting deletion of primary data. [2025-10-02T17:48:59.138900] [DEBUG] [LOCAL ] BURL: Deleted primary data file. [2025-10-02T17:48:59.138972] [INFO ] [MAIN ] BURL: Starting full primary refresh. [2025-10-02T17:48:59.480472] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-04. [2025-10-02T17:48:59.524678] [INFO ] [REMOTE ] BURL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:49:00.272998] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-02. [2025-10-02T17:49:00.319416] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-02T17:49:01.023717] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-10-02T17:49:01.072992] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-05. [2025-10-02T17:49:01.579352] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-02T17:49:01.873060] [INFO ] [REMOTE ] BURL: Fetching primary data for 2024-12. [2025-10-02T17:49:01.988767] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-02T17:49:02.672999] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-06. [2025-10-02T17:49:03.472976] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-03. [2025-10-02T17:49:03.730977] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-02T17:49:03.749401] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-02T17:49:04.273041] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-01. [2025-10-02T17:49:05.073035] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-08. [2025-10-02T17:49:05.522785] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-02T17:49:05.872981] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-04. [2025-10-02T17:49:05.928157] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-02T17:49:06.673042] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-07. [2025-10-02T17:49:06.976558] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-02T17:49:07.478183] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-02. [2025-10-02T17:49:07.498905] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-02T17:49:07.586462] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-02T17:49:08.272999] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-08. [2025-10-02T17:49:09.075833] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-05. [2025-10-02T17:49:09.077828] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-02T17:49:09.170863] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-02T17:49:09.873004] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-03. [2025-10-02T17:49:10.612916] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-02T17:49:10.672987] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-09. [2025-10-02T17:49:11.472978] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-06. [2025-10-02T17:49:11.704250] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-02T17:49:11.783216] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-02T17:49:12.273005] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-09. [2025-10-02T17:49:13.005253] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-02T17:49:13.072984] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-04. [2025-10-02T17:49:13.873002] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-10. [2025-10-02T17:49:14.009960] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-02T17:49:14.529054] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-02T17:49:14.530080] [INFO ] [REMOTE ] BUI: Full fetch complete (16308 records). [2025-10-02T17:49:14.530160] [DEBUG] [VALIDATOR ] BUI: Validating primary data. [2025-10-02T17:49:14.530623] [FATAL] [VALIDATOR ] BUI: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:49:14.530734] [FATAL] [MAIN ] BUI: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:49:14.530781] [WARN ] [MAIN ] BUI: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:49:14.530848] [INFO ] [LOCAL ] BUI: Starting deletion of primary data. [2025-10-02T17:49:14.530916] [DEBUG] [LOCAL ] BUI: No primary data file found to delete. [2025-10-02T17:49:14.530953] [INFO ] [LOCAL ] BUI: Starting deletion of derivative data. [2025-10-02T17:49:14.530995] [DEBUG] [LOCAL ] BUI: No derivative data file found to delete. [2025-10-02T17:49:14.531066] [INFO ] [MAIN ] Update Progress: 356/2370 symbols completed. BUI took 26.8s. Estimated remaining: 4h 38m 13s. Rate: 7.2 symbols/min [2025-10-02T17:49:14.678209] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-07. [2025-10-02T17:49:14.735358] [INFO ] [MAIN ] BUXX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:49:14.735562] [DEBUG] [LOCAL ] BUXX: No existing data file found in primary storage. [2025-10-02T17:49:14.735617] [WARN ] [MAIN ] BUXX: No existing data found, performing full refresh instead. [2025-10-02T17:49:14.735751] [INFO ] [MAIN ] BUXX: Wiping existing primary data before full refresh. [2025-10-02T17:49:14.735794] [INFO ] [LOCAL ] BUXX: Starting deletion of primary data. [2025-10-02T17:49:14.735857] [DEBUG] [LOCAL ] BUXX: No primary data file found to delete. [2025-10-02T17:49:14.735893] [INFO ] [MAIN ] BUXX: Starting full primary refresh. [2025-10-02T17:49:15.164689] [INFO ] [REMOTE ] BUXX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:49:15.193627] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-02T17:49:15.473045] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-10. [2025-10-02T17:49:16.238297] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-02T17:49:16.272982] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-08. [2025-10-02T17:49:16.882252] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-02T17:49:16.883878] [INFO ] [REMOTE ] BUD: Full fetch complete (76097 records). [2025-10-02T17:49:16.884011] [DEBUG] [VALIDATOR ] BUD: Validating primary data. [2025-10-02T17:49:16.884769] [FATAL] [VALIDATOR ] BUD: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:49:16.884859] [FATAL] [MAIN ] BUD: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:49:16.884913] [WARN ] [MAIN ] BUD: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:49:16.884979] [INFO ] [LOCAL ] BUD: Starting deletion of primary data. [2025-10-02T17:49:16.885042] [DEBUG] [LOCAL ] BUD: No primary data file found to delete. [2025-10-02T17:49:16.885078] [INFO ] [LOCAL ] BUD: Starting deletion of derivative data. [2025-10-02T17:49:16.885332] [DEBUG] [LOCAL ] BUD: Deleted derivative data file. [2025-10-02T17:49:16.885425] [INFO ] [MAIN ] Update Progress: 357/2370 symbols completed. BUD took 47.0s. Estimated remaining: 4h 37m 31s. Rate: 7.3 symbols/min [2025-10-02T17:49:17.073008] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-05. [2025-10-02T17:49:17.517692] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-02T17:49:17.873050] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2024-12. [2025-10-02T17:49:18.350343] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-02T17:49:18.535047] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-02T17:49:18.673059] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-06. [2025-10-02T17:49:19.473070] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-09. [2025-10-02T17:49:20.188807] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-02T17:49:20.273010] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-07. [2025-10-02T17:49:21.025458] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-02T17:49:21.072968] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-10. [2025-10-02T17:49:21.872980] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-01. [2025-10-02T17:49:21.990345] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-02T17:49:22.443342] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-02T17:49:22.445324] [INFO ] [REMOTE ] BUR: Full fetch complete (63523 records). [2025-10-02T17:49:22.445453] [DEBUG] [VALIDATOR ] BUR: Validating primary data. [2025-10-02T17:49:22.674465] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-08. [2025-10-02T17:49:22.757832] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-02T17:49:22.918198] [DEBUG] [VALIDATOR ] BUR: All expected trading days are present. [2025-10-02T17:49:22.918287] [DEBUG] [VALIDATOR ] BUR: Primary data validation passed. [2025-10-02T17:49:22.919054] [INFO ] [MAIN ] BUR: Fetched primary data is valid. [2025-10-02T17:49:22.919142] [DEBUG] [LOCAL ] BUR: Saving primary data. [2025-10-02T17:49:22.920760] [DEBUG] [LOCAL ] BUR: Trimmed 63523 records to 45456 (keeping 200 days of data) [2025-10-02T17:49:23.202783] [DEBUG] [LOCAL ] BUR: Primary data saved (45456 records). [2025-10-02T17:49:23.202917] [INFO ] [MAIN ] BUR: Full history saved. [2025-10-02T17:49:23.202999] [INFO ] [MAIN ] Update Progress: 358/2370 symbols completed. BUR took 34.1s. Estimated remaining: 4h 37m 12s. Rate: 7.3 symbols/min [2025-10-02T17:49:23.473035] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-02. [2025-10-02T17:49:24.354392] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-02T17:49:24.358250] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-03. [2025-10-02T17:49:24.441048] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-02T17:49:24.892729] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-02T17:49:25.073012] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-04. [2025-10-02T17:49:25.873030] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-09. [2025-10-02T17:49:26.103882] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-02T17:49:26.673063] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-05. [2025-10-02T17:49:27.596595] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-02T17:49:27.607708] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-10. [2025-10-02T17:49:27.754200] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-02T17:49:28.273066] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-06. [2025-10-02T17:49:28.756981] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-02T17:49:28.758950] [INFO ] [REMOTE ] BURL: Full fetch complete (65667 records). [2025-10-02T17:49:28.759067] [DEBUG] [VALIDATOR ] BURL: Validating primary data. [2025-10-02T17:49:29.119302] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-02T17:49:29.172852] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-07. [2025-10-02T17:49:29.213172] [DEBUG] [VALIDATOR ] BURL: All expected trading days are present. [2025-10-02T17:49:29.213279] [DEBUG] [VALIDATOR ] BURL: Primary data validation passed. [2025-10-02T17:49:29.214046] [INFO ] [MAIN ] BURL: Fetched primary data is valid. [2025-10-02T17:49:29.214114] [DEBUG] [LOCAL ] BURL: Saving primary data. [2025-10-02T17:49:29.215611] [DEBUG] [LOCAL ] BURL: Trimmed 65667 records to 46323 (keeping 200 days of data) [2025-10-02T17:49:29.506199] [DEBUG] [LOCAL ] BURL: Primary data saved (46323 records). [2025-10-02T17:49:29.506345] [INFO ] [MAIN ] BURL: Full history saved. [2025-10-02T17:49:29.507496] [INFO ] [MAIN ] Update Progress: 359/2370 symbols completed. BURL took 30.8s. Estimated remaining: 4h 36m 53s. Rate: 7.3 symbols/min [2025-10-02T17:49:30.246763] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-02T17:49:30.250616] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-08. [2025-10-02T17:49:31.059512] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-02T17:49:31.062984] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-09. [2025-10-02T17:49:31.942008] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-02T17:49:31.945786] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-10. [2025-10-02T17:49:32.829269] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-02T17:49:32.830420] [INFO ] [REMOTE ] BUXX: Full fetch complete (20364 records). [2025-10-02T17:49:32.830534] [DEBUG] [VALIDATOR ] BUXX: Validating primary data. [2025-10-02T17:49:33.231694] [DEBUG] [VALIDATOR ] BUXX: All expected trading days are present. [2025-10-02T17:49:33.231850] [DEBUG] [VALIDATOR ] BUXX: Primary data validation passed. [2025-10-02T17:49:33.232210] [INFO ] [MAIN ] BUXX: Fetched primary data is valid. [2025-10-02T17:49:33.232252] [DEBUG] [LOCAL ] BUXX: Saving primary data. [2025-10-02T17:49:33.232854] [DEBUG] [LOCAL ] BUXX: Trimmed 20364 records to 15276 (keeping 200 days of data) [2025-10-02T17:49:33.336933] [DEBUG] [LOCAL ] BUXX: Primary data saved (15276 records). [2025-10-02T17:49:33.337088] [INFO ] [MAIN ] BUXX: Full history saved. [2025-10-02T17:49:33.337168] [INFO ] [MAIN ] Update Progress: 360/2370 symbols completed. BUXX took 18.8s. Estimated remaining: 4h 36m 20s. Rate: 7.3 symbols/min [2025-10-02T17:49:34.065200] [INFO ] [MAIN ] BV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:49:34.153766] [DEBUG] [LOCAL ] BV: No existing data file found in primary storage. [2025-10-02T17:49:34.153597] [INFO ] [MAIN ] BVN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:49:34.149782] [INFO ] [MAIN ] BW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:49:34.154110] [WARN ] [MAIN ] BV: No existing data found, performing full refresh instead. [2025-10-02T17:49:34.158496] [INFO ] [MAIN ] BV: Wiping existing primary data before full refresh. [2025-10-02T17:49:34.158399] [INFO ] [MAIN ] BWA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:49:34.159484] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-10-02T17:49:34.160110] [DEBUG] [LOCAL ] BV: No primary data file found to delete. [2025-10-02T17:49:34.160166] [INFO ] [MAIN ] BV: Starting full primary refresh. [2025-10-02T17:49:34.485101] [DEBUG] [LOCAL ] BW: Loaded 39882 existing records from primary storage. [2025-10-02T17:49:34.485747] [DEBUG] [LOCAL ] BVN: Loaded 44017 existing records from primary storage. [2025-10-02T17:49:34.510138] [INFO ] [MAIN ] BVN: Loaded 44017 existing records. [2025-10-02T17:49:34.510021] [INFO ] [MAIN ] BW: Loaded 39882 existing records. [2025-10-02T17:49:34.574372] [DEBUG] [LOCAL ] BWA: Loaded 52184 existing records from primary storage. [2025-10-02T17:49:34.716841] [INFO ] [MAIN ] BWA: Loaded 52184 existing records. [2025-10-02T17:49:34.977252] [INFO ] [REMOTE ] BV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:49:35.075249] [INFO ] [REMOTE ] BV: Fetching primary data for 2024-12. [2025-10-02T17:49:35.260139] [WARN ] [MAIN ] BW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:49:35.290989] [INFO ] [MAIN ] BW: Wiping existing primary data before full refresh. [2025-10-02T17:49:35.315903] [WARN ] [MAIN ] BVN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:49:35.309844] [WARN ] [MAIN ] BWA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:49:35.316267] [INFO ] [MAIN ] BWA: Wiping existing primary data before full refresh. [2025-10-02T17:49:35.316436] [INFO ] [LOCAL ] BW: Starting deletion of primary data. [2025-10-02T17:49:35.316509] [INFO ] [LOCAL ] BWA: Starting deletion of primary data. [2025-10-02T17:49:35.316359] [INFO ] [MAIN ] BVN: Wiping existing primary data before full refresh. [2025-10-02T17:49:35.316685] [INFO ] [LOCAL ] BVN: Starting deletion of primary data. [2025-10-02T17:49:35.318236] [DEBUG] [LOCAL ] BW: Deleted primary data file. [2025-10-02T17:49:35.318305] [INFO ] [MAIN ] BW: Starting full primary refresh. [2025-10-02T17:49:35.318347] [DEBUG] [LOCAL ] BWA: Deleted primary data file. [2025-10-02T17:49:35.318480] [INFO ] [MAIN ] BWA: Starting full primary refresh. [2025-10-02T17:49:35.332664] [DEBUG] [LOCAL ] BVN: Deleted primary data file. [2025-10-02T17:49:35.401242] [INFO ] [MAIN ] BVN: Starting full primary refresh. [2025-10-02T17:49:36.482341] [INFO ] [REMOTE ] BW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:49:36.506905] [INFO ] [REMOTE ] BWA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:49:36.531366] [INFO ] [REMOTE ] BW: Fetching primary data for 2024-12. [2025-10-02T17:49:36.531945] [INFO ] [REMOTE ] BWA: Fetching primary data for 2024-12. [2025-10-02T17:49:36.582601] [INFO ] [REMOTE ] BVN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:49:36.583693] [INFO ] [REMOTE ] BVN: Fetching primary data for 2024-12. [2025-10-02T17:49:36.760936] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-02T17:49:36.767903] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-01. [2025-10-02T17:49:38.062633] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-02T17:49:38.070218] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-02. [2025-10-02T17:49:38.117116] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-02T17:49:38.127049] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-01. [2025-10-02T17:49:38.226757] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-02T17:49:38.238500] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-01. [2025-10-02T17:49:38.390630] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-02T17:49:38.673060] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-01. [2025-10-02T17:49:39.459928] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-02T17:49:39.472979] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-03. [2025-10-02T17:49:39.597265] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-02T17:49:39.629930] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-02T17:49:40.050107] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-02T17:49:40.273008] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-02. [2025-10-02T17:49:40.986962] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-02T17:49:41.073010] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-04. [2025-10-02T17:49:41.655799] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-02T17:49:41.872999] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-02. [2025-10-02T17:49:42.493840] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-02T17:49:42.673067] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-02. [2025-10-02T17:49:43.170687] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-02T17:49:43.473048] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-03. [2025-10-02T17:49:44.069072] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-02T17:49:44.273007] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-03. [2025-10-02T17:49:44.753461] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-02T17:49:45.073052] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-05. [2025-10-02T17:49:45.553681] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-02T17:49:45.873008] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-03. [2025-10-02T17:49:46.524621] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-02T17:49:46.673006] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-06. [2025-10-02T17:49:47.382268] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-02T17:49:47.473006] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-04. [2025-10-02T17:49:47.915958] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-02T17:49:48.273015] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-04. [2025-10-02T17:49:49.073002] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-07. [2025-10-02T17:49:49.141584] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-02T17:49:49.837459] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-02T17:49:49.872960] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-05. [2025-10-02T17:49:50.552511] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-02T17:49:50.672990] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-05. [2025-10-02T17:49:50.994887] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-02T17:49:51.473015] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-06. [2025-10-02T17:49:51.970681] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-02T17:49:52.272997] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-06. [2025-10-02T17:49:53.078098] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-08. [2025-10-02T17:49:53.091468] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-02T17:49:53.817886] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-02T17:49:53.873019] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-04. [2025-10-02T17:49:54.338813] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-02T17:49:54.672997] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-07. [2025-10-02T17:49:55.473001] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-09. [2025-10-02T17:49:55.858578] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-02T17:49:55.892441] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-02T17:49:56.273002] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-05. [2025-10-02T17:49:57.018552] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-02T17:49:57.072989] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-10. [2025-10-02T17:49:57.872980] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-07. [2025-10-02T17:49:58.152551] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-02T17:49:58.346387] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-02T17:49:58.348269] [INFO ] [REMOTE ] BV: Full fetch complete (54159 records). [2025-10-02T17:49:58.348389] [DEBUG] [VALIDATOR ] BV: Validating primary data. [2025-10-02T17:49:58.678099] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-06. [2025-10-02T17:49:58.783755] [DEBUG] [VALIDATOR ] BV: All expected trading days are present. [2025-10-02T17:49:58.783863] [DEBUG] [VALIDATOR ] BV: Primary data validation passed. [2025-10-02T17:49:58.784577] [INFO ] [MAIN ] BV: Fetched primary data is valid. [2025-10-02T17:49:58.784666] [DEBUG] [LOCAL ] BV: Saving primary data. [2025-10-02T17:49:58.785950] [DEBUG] [LOCAL ] BV: Trimmed 54159 records to 38582 (keeping 200 days of data) [2025-10-02T17:49:59.028116] [DEBUG] [LOCAL ] BV: Primary data saved (38582 records). [2025-10-02T17:49:59.028269] [INFO ] [MAIN ] BV: Full history saved. [2025-10-02T17:49:59.028349] [INFO ] [MAIN ] Update Progress: 361/2370 symbols completed. BV took 25.7s. Estimated remaining: 4h 37m 49s. Rate: 7.2 symbols/min [2025-10-02T17:49:59.222299] [INFO ] [MAIN ] BWG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:49:59.236748] [DEBUG] [LOCAL ] BWG: Loaded 12509 existing records from primary storage. [2025-10-02T17:49:59.237013] [INFO ] [MAIN ] BWG: Loaded 12509 existing records. [2025-10-02T17:49:59.436248] [WARN ] [MAIN ] BWG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:49:59.436534] [INFO ] [MAIN ] BWG: Wiping existing primary data before full refresh. [2025-10-02T17:49:59.436671] [INFO ] [LOCAL ] BWG: Starting deletion of primary data. [2025-10-02T17:49:59.437337] [DEBUG] [LOCAL ] BWG: Deleted primary data file. [2025-10-02T17:49:59.437400] [INFO ] [MAIN ] BWG: Starting full primary refresh. [2025-10-02T17:49:59.480995] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-08. [2025-10-02T17:49:59.676902] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-02T17:49:59.903030] [INFO ] [REMOTE ] BWG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:50:00.272990] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-08. [2025-10-02T17:50:00.426507] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-02T17:50:01.073050] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-07. [2025-10-02T17:50:01.616112] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-02T17:50:01.873093] [INFO ] [REMOTE ] BWG: Fetching primary data for 2024-12. [2025-10-02T17:50:02.041087] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-02T17:50:02.672981] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-09. [2025-10-02T17:50:02.912019] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-02T17:50:03.189620] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-02T17:50:03.473045] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-08. [2025-10-02T17:50:04.273028] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-09. [2025-10-02T17:50:04.414798] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-02T17:50:05.072983] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-10. [2025-10-02T17:50:05.437902] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-02T17:50:05.873009] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-01. [2025-10-02T17:50:05.920038] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-02T17:50:06.498396] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-02T17:50:06.500345] [INFO ] [REMOTE ] BVN: Full fetch complete (62921 records). [2025-10-02T17:50:06.500455] [DEBUG] [VALIDATOR ] BVN: Validating primary data. [2025-10-02T17:50:06.674422] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-09. [2025-10-02T17:50:06.914285] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-02T17:50:06.966245] [DEBUG] [VALIDATOR ] BVN: All expected trading days are present. [2025-10-02T17:50:06.966326] [DEBUG] [VALIDATOR ] BVN: Primary data validation passed. [2025-10-02T17:50:06.967080] [INFO ] [MAIN ] BVN: Fetched primary data is valid. [2025-10-02T17:50:06.967148] [DEBUG] [LOCAL ] BVN: Saving primary data. [2025-10-02T17:50:06.968513] [DEBUG] [LOCAL ] BVN: Trimmed 62921 records to 44365 (keeping 200 days of data) [2025-10-02T17:50:07.238156] [DEBUG] [LOCAL ] BVN: Primary data saved (44365 records). [2025-10-02T17:50:07.238302] [INFO ] [MAIN ] BVN: Full history saved. [2025-10-02T17:50:07.238406] [INFO ] [MAIN ] Update Progress: 362/2370 symbols completed. BVN took 33.9s. Estimated remaining: 4h 37m 40s. Rate: 7.2 symbols/min [2025-10-02T17:50:07.451693] [INFO ] [MAIN ] BWLP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:50:07.473039] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-02. [2025-10-02T17:50:07.486008] [DEBUG] [LOCAL ] BWLP: Loaded 32416 existing records from primary storage. [2025-10-02T17:50:07.486318] [INFO ] [MAIN ] BWLP: Loaded 32416 existing records. [2025-10-02T17:50:07.681219] [WARN ] [MAIN ] BWLP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:50:07.681464] [INFO ] [MAIN ] BWLP: Wiping existing primary data before full refresh. [2025-10-02T17:50:07.681515] [INFO ] [LOCAL ] BWLP: Starting deletion of primary data. [2025-10-02T17:50:07.682371] [DEBUG] [LOCAL ] BWLP: Deleted primary data file. [2025-10-02T17:50:07.682432] [INFO ] [MAIN ] BWLP: Starting full primary refresh. [2025-10-02T17:50:08.092911] [INFO ] [REMOTE ] BWLP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:50:08.246944] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-02T17:50:08.279239] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-10. [2025-10-02T17:50:08.305561] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-02T17:50:09.073044] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2024-12. [2025-10-02T17:50:09.624633] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-02T17:50:09.626475] [INFO ] [REMOTE ] BW: Full fetch complete (58840 records). [2025-10-02T17:50:09.626577] [DEBUG] [VALIDATOR ] BW: Validating primary data. [2025-10-02T17:50:09.878109] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-03. [2025-10-02T17:50:10.054905] [DEBUG] [VALIDATOR ] BW: All expected trading days are present. [2025-10-02T17:50:10.055283] [DEBUG] [VALIDATOR ] BW: Primary data validation passed. [2025-10-02T17:50:10.055991] [INFO ] [MAIN ] BW: Fetched primary data is valid. [2025-10-02T17:50:10.056057] [DEBUG] [LOCAL ] BW: Saving primary data. [2025-10-02T17:50:10.058578] [DEBUG] [LOCAL ] BW: Trimmed 58840 records to 40202 (keeping 200 days of data) [2025-10-02T17:50:10.298478] [DEBUG] [LOCAL ] BW: Primary data saved (40202 records). [2025-10-02T17:50:10.298679] [INFO ] [MAIN ] BW: Full history saved. [2025-10-02T17:50:10.299685] [INFO ] [MAIN ] Update Progress: 363/2370 symbols completed. BW took 36.9s. Estimated remaining: 4h 37m 3s. Rate: 7.2 symbols/min [2025-10-02T17:50:10.507392] [INFO ] [MAIN ] BWMX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:50:10.519044] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-02T17:50:10.530545] [DEBUG] [LOCAL ] BWMX: Loaded 7699 existing records from primary storage. [2025-10-02T17:50:10.530907] [INFO ] [MAIN ] BWMX: Loaded 7699 existing records. [2025-10-02T17:50:10.679614] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-10. [2025-10-02T17:50:10.792146] [WARN ] [MAIN ] BWMX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:50:10.792515] [INFO ] [MAIN ] BWMX: Wiping existing primary data before full refresh. [2025-10-02T17:50:10.792696] [INFO ] [LOCAL ] BWMX: Starting deletion of primary data. [2025-10-02T17:50:10.793198] [DEBUG] [LOCAL ] BWMX: Deleted primary data file. [2025-10-02T17:50:10.793276] [INFO ] [MAIN ] BWMX: Starting full primary refresh. [2025-10-02T17:50:10.990435] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-02T17:50:11.407209] [INFO ] [REMOTE ] BWMX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:50:11.473076] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2024-12. [2025-10-02T17:50:12.246821] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-02T17:50:12.273316] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-04. [2025-10-02T17:50:12.275885] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-02T17:50:12.278270] [INFO ] [REMOTE ] BWA: Full fetch complete (75721 records). [2025-10-02T17:50:12.278389] [DEBUG] [VALIDATOR ] BWA: Validating primary data. [2025-10-02T17:50:12.733739] [DEBUG] [VALIDATOR ] BWA: All expected trading days are present. [2025-10-02T17:50:12.733838] [DEBUG] [VALIDATOR ] BWA: Primary data validation passed. [2025-10-02T17:50:12.734717] [INFO ] [MAIN ] BWA: Fetched primary data is valid. [2025-10-02T17:50:12.734786] [DEBUG] [LOCAL ] BWA: Saving primary data. [2025-10-02T17:50:12.736477] [DEBUG] [LOCAL ] BWA: Trimmed 75721 records to 52569 (keeping 200 days of data) [2025-10-02T17:50:13.073310] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-01. [2025-10-02T17:50:13.091833] [DEBUG] [LOCAL ] BWA: Primary data saved (52569 records). [2025-10-02T17:50:13.091979] [INFO ] [MAIN ] BWA: Full history saved. [2025-10-02T17:50:13.092089] [INFO ] [MAIN ] Update Progress: 364/2370 symbols completed. BWA took 39.7s. Estimated remaining: 4h 36m 24s. Rate: 7.3 symbols/min [2025-10-02T17:50:13.279445] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-02T17:50:13.319634] [INFO ] [MAIN ] BWNB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:50:13.327244] [DEBUG] [LOCAL ] BWNB: Loaded 4444 existing records from primary storage. [2025-10-02T17:50:13.327477] [INFO ] [MAIN ] BWNB: Loaded 4444 existing records. [2025-10-02T17:50:13.524688] [WARN ] [MAIN ] BWNB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:50:13.524966] [INFO ] [MAIN ] BWNB: Wiping existing primary data before full refresh. [2025-10-02T17:50:13.525018] [INFO ] [LOCAL ] BWNB: Starting deletion of primary data. [2025-10-02T17:50:13.525358] [DEBUG] [LOCAL ] BWNB: Deleted primary data file. [2025-10-02T17:50:13.525418] [INFO ] [MAIN ] BWNB: Starting full primary refresh. [2025-10-02T17:50:13.878084] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-05. [2025-10-02T17:50:13.962813] [INFO ] [REMOTE ] BWNB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:50:14.405774] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-02T17:50:14.511580] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-02T17:50:14.673057] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-02. [2025-10-02T17:50:15.472989] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-06. [2025-10-02T17:50:16.049780] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-02T17:50:16.273016] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2024-12. [2025-10-02T17:50:16.297611] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-02T17:50:16.833325] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-02T17:50:17.073032] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-01. [2025-10-02T17:50:17.503702] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-02T17:50:17.873000] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-02. [2025-10-02T17:50:18.415599] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-02T17:50:18.673016] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-03. [2025-10-02T17:50:19.473051] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-03. [2025-10-02T17:50:19.707449] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-02T17:50:20.113182] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-02T17:50:20.273054] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-01. [2025-10-02T17:50:20.956540] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-02T17:50:21.073030] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-07. [2025-10-02T17:50:21.867686] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-02T17:50:21.872950] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-08. [2025-10-02T17:50:22.609779] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-02T17:50:22.673012] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-04. [2025-10-02T17:50:22.998094] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-02T17:50:23.473009] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-02. [2025-10-02T17:50:24.088141] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-02T17:50:24.272998] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-03. [2025-10-02T17:50:24.916874] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-02T17:50:25.072998] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-05. [2025-10-02T17:50:25.765913] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-02T17:50:25.873073] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-06. [2025-10-02T17:50:26.333709] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-02T17:50:26.673042] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-04. [2025-10-02T17:50:27.317240] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-02T17:50:27.473059] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-04. [2025-10-02T17:50:28.272997] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-05. [2025-10-02T17:50:29.030144] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-02T17:50:29.054261] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-02T17:50:29.073009] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-05. [2025-10-02T17:50:29.873015] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-06. [2025-10-02T17:50:30.672975] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-09. [2025-10-02T17:50:30.706612] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-02T17:50:30.707404] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-02T17:50:31.473040] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-06. [2025-10-02T17:50:31.681473] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-02T17:50:32.273011] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-10. [2025-10-02T17:50:32.870383] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-02T17:50:32.979008] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-02T17:50:32.980578] [INFO ] [REMOTE ] BWG: Full fetch complete (17952 records). [2025-10-02T17:50:32.980701] [DEBUG] [VALIDATOR ] BWG: Validating primary data. [2025-10-02T17:50:33.078194] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-07. [2025-10-02T17:50:33.394755] [DEBUG] [VALIDATOR ] BWG: All expected trading days are present. [2025-10-02T17:50:33.394857] [DEBUG] [VALIDATOR ] BWG: Primary data validation passed. [2025-10-02T17:50:33.395248] [INFO ] [MAIN ] BWG: Fetched primary data is valid. [2025-10-02T17:50:33.395370] [DEBUG] [LOCAL ] BWG: Saving primary data. [2025-10-02T17:50:33.396236] [DEBUG] [LOCAL ] BWG: Trimmed 17952 records to 12660 (keeping 200 days of data) [2025-10-02T17:50:33.479978] [DEBUG] [LOCAL ] BWG: Primary data saved (12660 records). [2025-10-02T17:50:33.480133] [INFO ] [MAIN ] BWG: Full history saved. [2025-10-02T17:50:33.480296] [INFO ] [MAIN ] Update Progress: 365/2370 symbols completed. BWG took 34.5s. Estimated remaining: 4h 37m 22s. Rate: 7.2 symbols/min [2025-10-02T17:50:33.656437] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-02T17:50:33.682700] [INFO ] [MAIN ] BWSN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:50:33.696224] [DEBUG] [LOCAL ] BWSN: Loaded 5090 existing records from primary storage. [2025-10-02T17:50:33.696503] [INFO ] [MAIN ] BWSN: Loaded 5090 existing records. [2025-10-02T17:50:33.876927] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-07. [2025-10-02T17:50:33.901827] [WARN ] [MAIN ] BWSN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:50:33.903141] [INFO ] [MAIN ] BWSN: Wiping existing primary data before full refresh. [2025-10-02T17:50:33.903207] [INFO ] [LOCAL ] BWSN: Starting deletion of primary data. [2025-10-02T17:50:33.903588] [DEBUG] [LOCAL ] BWSN: Deleted primary data file. [2025-10-02T17:50:33.903692] [INFO ] [MAIN ] BWSN: Starting full primary refresh. [2025-10-02T17:50:34.307457] [INFO ] [REMOTE ] BWSN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:50:34.673012] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-07. [2025-10-02T17:50:35.098372] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-02T17:50:35.472997] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2024-12. [2025-10-02T17:50:35.657182] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-02T17:50:36.272996] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-08. [2025-10-02T17:50:36.299138] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-02T17:50:36.870160] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-02T17:50:37.073009] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-01. [2025-10-02T17:50:37.510955] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-02T17:50:37.873037] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-02. [2025-10-02T17:50:38.321518] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-02T17:50:38.673020] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-08. [2025-10-02T17:50:39.473032] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-09. [2025-10-02T17:50:40.183426] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-02T17:50:40.273047] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-10. [2025-10-02T17:50:40.715707] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-02T17:50:40.716415] [INFO ] [REMOTE ] BWNB: Full fetch complete (5747 records). [2025-10-02T17:50:40.716487] [DEBUG] [VALIDATOR ] BWNB: Validating primary data. [2025-10-02T17:50:41.078099] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-08. [2025-10-02T17:50:41.127016] [DEBUG] [VALIDATOR ] BWNB: All expected trading days are present. [2025-10-02T17:50:41.127148] [DEBUG] [VALIDATOR ] BWNB: Primary data validation passed. [2025-10-02T17:50:41.127357] [INFO ] [MAIN ] BWNB: Fetched primary data is valid. [2025-10-02T17:50:41.127420] [DEBUG] [LOCAL ] BWNB: Saving primary data. [2025-10-02T17:50:41.127918] [DEBUG] [LOCAL ] BWNB: Trimmed 5747 records to 4466 (keeping 200 days of data) [2025-10-02T17:50:41.158265] [DEBUG] [LOCAL ] BWNB: Primary data saved (4466 records). [2025-10-02T17:50:41.158429] [INFO ] [MAIN ] BWNB: Full history saved. [2025-10-02T17:50:41.158552] [INFO ] [MAIN ] Update Progress: 366/2370 symbols completed. BWNB took 28.1s. Estimated remaining: 4h 37m 11s. Rate: 7.2 symbols/min [2025-10-02T17:50:41.337754] [INFO ] [MAIN ] BWXT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:50:41.394510] [DEBUG] [LOCAL ] BWXT: Loaded 46870 existing records from primary storage. [2025-10-02T17:50:41.394953] [INFO ] [MAIN ] BWXT: Loaded 46870 existing records. [2025-10-02T17:50:41.575287] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-08 (2.90 seconds). [2025-10-02T17:50:41.607623] [WARN ] [MAIN ] BWXT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:50:41.614885] [INFO ] [MAIN ] BWXT: Wiping existing primary data before full refresh. [2025-10-02T17:50:41.615419] [INFO ] [LOCAL ] BWXT: Starting deletion of primary data. [2025-10-02T17:50:41.616934] [DEBUG] [LOCAL ] BWXT: Deleted primary data file. [2025-10-02T17:50:41.617011] [INFO ] [MAIN ] BWXT: Starting full primary refresh. [2025-10-02T17:50:41.748885] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-02T17:50:41.878196] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-03. [2025-10-02T17:50:42.040412] [INFO ] [REMOTE ] BWXT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:50:42.555790] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-02T17:50:42.672997] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2024-12. [2025-10-02T17:50:43.473061] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-04. [2025-10-02T17:50:43.872001] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-02T17:50:44.272978] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-09. [2025-10-02T17:50:44.450314] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-02T17:50:45.073011] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-05. [2025-10-02T17:50:45.651872] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-02T17:50:45.819289] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-02T17:50:45.872998] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-06. [2025-10-02T17:50:46.673021] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-10. [2025-10-02T17:50:46.697607] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-02T17:50:47.473041] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-07. [2025-10-02T17:50:47.819771] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-02T17:50:47.826249] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-02T17:50:47.828190] [INFO ] [REMOTE ] BWLP: Full fetch complete (48204 records). [2025-10-02T17:50:47.828298] [DEBUG] [VALIDATOR ] BWLP: Validating primary data. [2025-10-02T17:50:48.254130] [DEBUG] [VALIDATOR ] BWLP: All expected trading days are present. [2025-10-02T17:50:48.254211] [DEBUG] [VALIDATOR ] BWLP: Primary data validation passed. [2025-10-02T17:50:48.254796] [INFO ] [MAIN ] BWLP: Fetched primary data is valid. [2025-10-02T17:50:48.254860] [DEBUG] [LOCAL ] BWLP: Saving primary data. [2025-10-02T17:50:48.256147] [DEBUG] [LOCAL ] BWLP: Trimmed 48204 records to 32667 (keeping 200 days of data) [2025-10-02T17:50:48.321059] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-01. [2025-10-02T17:50:48.479336] [DEBUG] [LOCAL ] BWLP: Primary data saved (32667 records). [2025-10-02T17:50:48.479486] [INFO ] [MAIN ] BWLP: Full history saved. [2025-10-02T17:50:48.479602] [INFO ] [MAIN ] Update Progress: 367/2370 symbols completed. BWLP took 41.2s. Estimated remaining: 4h 36m 57s. Rate: 7.2 symbols/min [2025-10-02T17:50:48.679079] [INFO ] [MAIN ] BX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:50:48.747324] [DEBUG] [LOCAL ] BX: Loaded 53489 existing records from primary storage. [2025-10-02T17:50:48.747775] [INFO ] [MAIN ] BX: Loaded 53489 existing records. [2025-10-02T17:50:48.949093] [WARN ] [MAIN ] BX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:50:48.949301] [INFO ] [MAIN ] BX: Wiping existing primary data before full refresh. [2025-10-02T17:50:48.949351] [INFO ] [LOCAL ] BX: Starting deletion of primary data. [2025-10-02T17:50:48.950866] [DEBUG] [LOCAL ] BX: Deleted primary data file. [2025-10-02T17:50:48.950929] [INFO ] [MAIN ] BX: Starting full primary refresh. [2025-10-02T17:50:49.078134] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-08. [2025-10-02T17:50:49.369558] [INFO ] [REMOTE ] BX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:50:49.707447] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-02T17:50:49.849030] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-02T17:50:49.872977] [INFO ] [REMOTE ] BX: Fetching primary data for 2024-12. [2025-10-02T17:50:50.673016] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-02. [2025-10-02T17:50:51.472997] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-09. [2025-10-02T17:50:51.854886] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-02T17:50:51.938175] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-02T17:50:51.981120] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-02T17:50:52.272996] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-03. [2025-10-02T17:50:53.072999] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-10. [2025-10-02T17:50:53.484761] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-02T17:50:53.485509] [INFO ] [REMOTE ] BWSN: Full fetch complete (6154 records). [2025-10-02T17:50:53.485817] [DEBUG] [VALIDATOR ] BWSN: Validating primary data. [2025-10-02T17:50:53.877199] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-01. [2025-10-02T17:50:53.913700] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-02T17:50:53.962876] [DEBUG] [VALIDATOR ] BWSN: All expected trading days are present. [2025-10-02T17:50:53.962957] [DEBUG] [VALIDATOR ] BWSN: Primary data validation passed. [2025-10-02T17:50:53.963141] [INFO ] [MAIN ] BWSN: Fetched primary data is valid. [2025-10-02T17:50:53.963201] [DEBUG] [LOCAL ] BWSN: Saving primary data. [2025-10-02T17:50:53.963724] [DEBUG] [LOCAL ] BWSN: Trimmed 6154 records to 5127 (keeping 200 days of data) [2025-10-02T17:50:53.996710] [DEBUG] [LOCAL ] BWSN: Primary data saved (5127 records). [2025-10-02T17:50:53.996854] [INFO ] [MAIN ] BWSN: Full history saved. [2025-10-02T17:50:53.996952] [INFO ] [MAIN ] Update Progress: 368/2370 symbols completed. BWSN took 20.5s. Estimated remaining: 4h 36m 34s. Rate: 7.2 symbols/min [2025-10-02T17:50:54.192671] [INFO ] [MAIN ] BXC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:50:54.208669] [DEBUG] [LOCAL ] BXC: Loaded 13649 existing records from primary storage. [2025-10-02T17:50:54.208941] [INFO ] [MAIN ] BXC: Loaded 13649 existing records. [2025-10-02T17:50:54.408704] [WARN ] [MAIN ] BXC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:50:54.409068] [INFO ] [MAIN ] BXC: Wiping existing primary data before full refresh. [2025-10-02T17:50:54.409130] [INFO ] [LOCAL ] BXC: Starting deletion of primary data. [2025-10-02T17:50:54.409750] [DEBUG] [LOCAL ] BXC: Deleted primary data file. [2025-10-02T17:50:54.409813] [INFO ] [MAIN ] BXC: Starting full primary refresh. [2025-10-02T17:50:54.681724] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-09. [2025-10-02T17:50:54.809435] [INFO ] [REMOTE ] BXC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:50:55.457886] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-02T17:50:55.472960] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-10. [2025-10-02T17:50:55.936923] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-02T17:50:56.036357] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-02T17:50:56.037874] [INFO ] [REMOTE ] BWMX: Full fetch complete (10081 records). [2025-10-02T17:50:56.037951] [DEBUG] [VALIDATOR ] BWMX: Validating primary data. [2025-10-02T17:50:56.278082] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-04. [2025-10-02T17:50:56.422165] [DEBUG] [VALIDATOR ] BWMX: All expected trading days are present. [2025-10-02T17:50:56.422247] [DEBUG] [VALIDATOR ] BWMX: Primary data validation passed. [2025-10-02T17:50:56.422514] [INFO ] [MAIN ] BWMX: Fetched primary data is valid. [2025-10-02T17:50:56.422557] [DEBUG] [LOCAL ] BWMX: Saving primary data. [2025-10-02T17:50:56.423023] [DEBUG] [LOCAL ] BWMX: Trimmed 10081 records to 7725 (keeping 200 days of data) [2025-10-02T17:50:56.477158] [DEBUG] [LOCAL ] BWMX: Primary data saved (7725 records). [2025-10-02T17:50:56.477312] [INFO ] [MAIN ] BWMX: Full history saved. [2025-10-02T17:50:56.477468] [INFO ] [MAIN ] Update Progress: 369/2370 symbols completed. BWMX took 46.2s. Estimated remaining: 4h 35m 54s. Rate: 7.3 symbols/min [2025-10-02T17:50:56.659927] [INFO ] [MAIN ] BXMT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:50:56.717811] [DEBUG] [LOCAL ] BXMT: Loaded 47227 existing records from primary storage. [2025-10-02T17:50:56.718245] [INFO ] [MAIN ] BXMT: Loaded 47227 existing records. [2025-10-02T17:50:56.904146] [WARN ] [MAIN ] BXMT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:50:56.904378] [INFO ] [MAIN ] BXMT: Wiping existing primary data before full refresh. [2025-10-02T17:50:56.904426] [INFO ] [LOCAL ] BXMT: Starting deletion of primary data. [2025-10-02T17:50:56.905785] [DEBUG] [LOCAL ] BXMT: Deleted primary data file. [2025-10-02T17:50:56.905851] [INFO ] [MAIN ] BXMT: Starting full primary refresh. [2025-10-02T17:50:57.078258] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-02. [2025-10-02T17:50:57.301128] [INFO ] [REMOTE ] BXMT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:50:57.873055] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2024-12. [2025-10-02T17:50:58.230773] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-02T17:50:58.673001] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-05. [2025-10-02T17:50:58.737179] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-02T17:50:59.462193] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-02T17:50:59.472963] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-01. [2025-10-02T17:51:00.273029] [INFO ] [REMOTE ] BXC: Fetching primary data for 2024-12. [2025-10-02T17:51:00.492334] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-02T17:51:01.072972] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-03. [2025-10-02T17:51:01.151667] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-02T17:51:01.441601] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-02T17:51:01.873014] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-02. [2025-10-02T17:51:02.672993] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-06. [2025-10-02T17:51:03.105947] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-02T17:51:03.473045] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-01. [2025-10-02T17:51:03.673021] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-02T17:51:04.029246] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-02T17:51:04.273000] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-02. [2025-10-02T17:51:04.606538] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-02T17:51:05.073606] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-03. [2025-10-02T17:51:05.075334] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-02T17:51:05.873022] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-03. [2025-10-02T17:51:06.673006] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-07. [2025-10-02T17:51:06.775970] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-02T17:51:06.816185] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-02T17:51:07.473016] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-04. [2025-10-02T17:51:08.272979] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-04. [2025-10-02T17:51:08.451034] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-02T17:51:08.679505] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-02T17:51:09.073007] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-08. [2025-10-02T17:51:09.872985] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-04. [2025-10-02T17:51:10.582961] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-02T17:51:10.673066] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-05. [2025-10-02T17:51:11.100425] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-02T17:51:11.473052] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-09. [2025-10-02T17:51:11.776481] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-02T17:51:11.845761] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-02T17:51:12.273025] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-06. [2025-10-02T17:51:13.072969] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-05. [2025-10-02T17:51:13.147580] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-02T17:51:13.270975] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-02T17:51:13.873030] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-07. [2025-10-02T17:51:14.673017] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-10. [2025-10-02T17:51:14.933133] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-02T17:51:14.992544] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-02T17:51:15.473008] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-08. [2025-10-02T17:51:16.138037] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-02T17:51:16.273029] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-09. [2025-10-02T17:51:17.072988] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-06. [2025-10-02T17:51:17.107708] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-02T17:51:17.873017] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-10. [2025-10-02T17:51:18.647126] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-02T17:51:18.673016] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-07. [2025-10-02T17:51:19.473059] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-05. [2025-10-02T17:51:20.469193] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-02T17:51:20.486272] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-08. [2025-10-02T17:51:21.345115] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-02T17:51:21.357029] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-06. [2025-10-02T17:51:22.216766] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-02T17:51:22.227593] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-09. [2025-10-02T17:51:22.782058] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-02T17:51:22.793624] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-07. [2025-10-02T17:51:23.876335] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-02T17:51:23.887116] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-10. [2025-10-02T17:51:24.914007] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-02T17:51:24.926416] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-08. [2025-10-02T17:51:25.289012] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-02T17:51:25.291626] [INFO ] [REMOTE ] BXMT: Full fetch complete (69670 records). [2025-10-02T17:51:25.291806] [DEBUG] [VALIDATOR ] BXMT: Validating primary data. [2025-10-02T17:51:25.718773] [DEBUG] [VALIDATOR ] BXMT: All expected trading days are present. [2025-10-02T17:51:25.718872] [DEBUG] [VALIDATOR ] BXMT: Primary data validation passed. [2025-10-02T17:51:25.719611] [INFO ] [MAIN ] BXMT: Fetched primary data is valid. [2025-10-02T17:51:25.719687] [DEBUG] [LOCAL ] BXMT: Saving primary data. [2025-10-02T17:51:25.721165] [DEBUG] [LOCAL ] BXMT: Trimmed 69670 records to 47578 (keeping 200 days of data) [2025-10-02T17:51:26.026531] [DEBUG] [LOCAL ] BXMT: Primary data saved (47578 records). [2025-10-02T17:51:26.026701] [INFO ] [MAIN ] BXMT: Full history saved. [2025-10-02T17:51:26.027284] [INFO ] [MAIN ] Update Progress: 370/2370 symbols completed. BXMT took 29.5s. Estimated remaining: 4h 37m 41s. Rate: 7.2 symbols/min [2025-10-02T17:51:26.262323] [INFO ] [MAIN ] BXMX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:51:26.284570] [DEBUG] [LOCAL ] BXMX: Loaded 19559 existing records from primary storage. [2025-10-02T17:51:26.284855] [INFO ] [MAIN ] BXMX: Loaded 19559 existing records. [2025-10-02T17:51:26.504704] [WARN ] [MAIN ] BXMX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:51:26.505016] [INFO ] [MAIN ] BXMX: Wiping existing primary data before full refresh. [2025-10-02T17:51:26.505157] [INFO ] [LOCAL ] BXMX: Starting deletion of primary data. [2025-10-02T17:51:26.506079] [DEBUG] [LOCAL ] BXMX: Deleted primary data file. [2025-10-02T17:51:26.506141] [INFO ] [MAIN ] BXMX: Starting full primary refresh. [2025-10-02T17:51:26.950736] [INFO ] [REMOTE ] BXMX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:51:26.951449] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2024-12. [2025-10-02T17:51:26.986762] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-02T17:51:26.998521] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-09. [2025-10-02T17:51:28.196522] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-02T17:51:28.201439] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-01. [2025-10-02T17:51:28.848116] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-02T17:51:28.861148] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-10. [2025-10-02T17:51:28.876500] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-02T17:51:28.881032] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-02. [2025-10-02T17:51:29.651722] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-02T17:51:29.656469] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-03. [2025-10-02T17:51:30.413798] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-02T17:51:30.416552] [INFO ] [REMOTE ] BX: Full fetch complete (77406 records). [2025-10-02T17:51:30.416769] [DEBUG] [VALIDATOR ] BX: Validating primary data. [2025-10-02T17:51:30.888233] [DEBUG] [VALIDATOR ] BX: All expected trading days are present. [2025-10-02T17:51:30.889351] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-02T17:51:30.889433] [DEBUG] [VALIDATOR ] BX: Primary data validation passed. [2025-10-02T17:51:30.896035] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-04. [2025-10-02T17:51:30.897072] [INFO ] [MAIN ] BX: Fetched primary data is valid. [2025-10-02T17:51:30.897243] [DEBUG] [LOCAL ] BX: Saving primary data. [2025-10-02T17:51:30.900144] [DEBUG] [LOCAL ] BX: Trimmed 77406 records to 53877 (keeping 200 days of data) [2025-10-02T17:51:31.254902] [DEBUG] [LOCAL ] BX: Primary data saved (53877 records). [2025-10-02T17:51:31.255061] [INFO ] [MAIN ] BX: Full history saved. [2025-10-02T17:51:31.255160] [INFO ] [MAIN ] Update Progress: 371/2370 symbols completed. BX took 42.8s. Estimated remaining: 4h 37m 16s. Rate: 7.2 symbols/min [2025-10-02T17:51:31.438667] [INFO ] [MAIN ] BXP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:51:31.486844] [DEBUG] [LOCAL ] BXP: Loaded 49856 existing records from primary storage. [2025-10-02T17:51:31.487217] [INFO ] [MAIN ] BXP: Loaded 49856 existing records. [2025-10-02T17:51:31.688947] [WARN ] [MAIN ] BXP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:51:31.689183] [INFO ] [MAIN ] BXP: Wiping existing primary data before full refresh. [2025-10-02T17:51:31.689234] [INFO ] [LOCAL ] BXP: Starting deletion of primary data. [2025-10-02T17:51:31.690538] [DEBUG] [LOCAL ] BXP: Deleted primary data file. [2025-10-02T17:51:31.690598] [INFO ] [MAIN ] BXP: Starting full primary refresh. [2025-10-02T17:51:32.102528] [INFO ] [REMOTE ] BXP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:51:32.103056] [INFO ] [REMOTE ] BXP: Fetching primary data for 2024-12. [2025-10-02T17:51:32.121466] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-02T17:51:32.127621] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-05. [2025-10-02T17:51:33.135001] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-02T17:51:33.141149] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-06. [2025-10-02T17:51:33.632075] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-02T17:51:33.646445] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-01. [2025-10-02T17:51:34.180826] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-02T17:51:34.185740] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-07. [2025-10-02T17:51:34.919114] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-02T17:51:34.924250] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-08. [2025-10-02T17:51:35.149026] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-02T17:51:35.473004] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-02. [2025-10-02T17:51:35.545556] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-02T17:51:36.273034] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-09. [2025-10-02T17:51:36.381817] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-10 (21.71 seconds). [2025-10-02T17:51:36.383907] [INFO ] [REMOTE ] BWXT: Full fetch complete (67512 records). [2025-10-02T17:51:36.384018] [DEBUG] [VALIDATOR ] BWXT: Validating primary data. [2025-10-02T17:51:36.819865] [DEBUG] [VALIDATOR ] BWXT: All expected trading days are present. [2025-10-02T17:51:36.820003] [DEBUG] [VALIDATOR ] BWXT: Primary data validation passed. [2025-10-02T17:51:36.820804] [INFO ] [MAIN ] BWXT: Fetched primary data is valid. [2025-10-02T17:51:36.820987] [DEBUG] [LOCAL ] BWXT: Saving primary data. [2025-10-02T17:51:36.822974] [DEBUG] [LOCAL ] BWXT: Trimmed 67512 records to 47232 (keeping 200 days of data) [2025-10-02T17:51:36.944503] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-02T17:51:37.087225] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-03. [2025-10-02T17:51:37.116081] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-02T17:51:37.193419] [DEBUG] [LOCAL ] BWXT: Primary data saved (47232 records). [2025-10-02T17:51:37.193567] [INFO ] [MAIN ] BWXT: Full history saved. [2025-10-02T17:51:37.193864] [INFO ] [MAIN ] Update Progress: 372/2370 symbols completed. BWXT took 56.0s. Estimated remaining: 4h 36m 54s. Rate: 7.2 symbols/min [2025-10-02T17:51:37.377926] [INFO ] [MAIN ] BXSL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:51:37.425681] [DEBUG] [LOCAL ] BXSL: Loaded 47639 existing records from primary storage. [2025-10-02T17:51:37.426048] [INFO ] [MAIN ] BXSL: Loaded 47639 existing records. [2025-10-02T17:51:37.614132] [WARN ] [MAIN ] BXSL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:51:37.614339] [INFO ] [MAIN ] BXSL: Wiping existing primary data before full refresh. [2025-10-02T17:51:37.614387] [INFO ] [LOCAL ] BXSL: Starting deletion of primary data. [2025-10-02T17:51:37.616004] [DEBUG] [LOCAL ] BXSL: Deleted primary data file. [2025-10-02T17:51:37.616067] [INFO ] [MAIN ] BXSL: Starting full primary refresh. [2025-10-02T17:51:37.879129] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-10. [2025-10-02T17:51:38.004916] [INFO ] [REMOTE ] BXSL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:51:38.672987] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2024-12. [2025-10-02T17:51:38.838473] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-02T17:51:38.863473] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-02T17:51:38.864970] [INFO ] [REMOTE ] BXMX: Full fetch complete (29085 records). [2025-10-02T17:51:38.865052] [DEBUG] [VALIDATOR ] BXMX: Validating primary data. [2025-10-02T17:51:39.281343] [DEBUG] [VALIDATOR ] BXMX: All expected trading days are present. [2025-10-02T17:51:39.281436] [DEBUG] [VALIDATOR ] BXMX: Primary data validation passed. [2025-10-02T17:51:39.281919] [INFO ] [MAIN ] BXMX: Fetched primary data is valid. [2025-10-02T17:51:39.281987] [DEBUG] [LOCAL ] BXMX: Saving primary data. [2025-10-02T17:51:39.282907] [DEBUG] [LOCAL ] BXMX: Trimmed 29085 records to 19738 (keeping 200 days of data) [2025-10-02T17:51:39.405605] [DEBUG] [LOCAL ] BXMX: Primary data saved (19738 records). [2025-10-02T17:51:39.405780] [INFO ] [MAIN ] BXMX: Full history saved. [2025-10-02T17:51:39.405869] [INFO ] [MAIN ] Update Progress: 373/2370 symbols completed. BXMX took 13.4s. Estimated remaining: 4h 36m 13s. Rate: 7.2 symbols/min [2025-10-02T17:51:39.485346] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-04. [2025-10-02T17:51:39.611375] [INFO ] [MAIN ] BY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:51:39.633393] [DEBUG] [LOCAL ] BY: Loaded 21678 existing records from primary storage. [2025-10-02T17:51:39.633683] [INFO ] [MAIN ] BY: Loaded 21678 existing records. [2025-10-02T17:51:39.829561] [WARN ] [MAIN ] BY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:51:39.829831] [INFO ] [MAIN ] BY: Wiping existing primary data before full refresh. [2025-10-02T17:51:39.829889] [INFO ] [LOCAL ] BY: Starting deletion of primary data. [2025-10-02T17:51:39.830567] [DEBUG] [LOCAL ] BY: Deleted primary data file. [2025-10-02T17:51:39.830629] [INFO ] [MAIN ] BY: Starting full primary refresh. [2025-10-02T17:51:40.220498] [INFO ] [REMOTE ] BY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:51:40.273016] [INFO ] [REMOTE ] BY: Fetching primary data for 2024-12. [2025-10-02T17:51:40.358795] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-02T17:51:41.032462] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-02T17:51:41.073023] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-01. [2025-10-02T17:51:41.365584] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-02T17:51:41.873012] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-05. [2025-10-02T17:51:42.682082] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-01. [2025-10-02T17:51:42.685109] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-02T17:51:42.994743] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-10 (25.12 seconds). [2025-10-02T17:51:42.995856] [INFO ] [REMOTE ] BXC: Full fetch complete (17930 records). [2025-10-02T17:51:42.995936] [DEBUG] [VALIDATOR ] BXC: Validating primary data. [2025-10-02T17:51:43.399807] [DEBUG] [VALIDATOR ] BXC: All expected trading days are present. [2025-10-02T17:51:43.400089] [DEBUG] [VALIDATOR ] BXC: Primary data validation passed. [2025-10-02T17:51:43.400493] [INFO ] [MAIN ] BXC: Fetched primary data is valid. [2025-10-02T17:51:43.400565] [DEBUG] [LOCAL ] BXC: Saving primary data. [2025-10-02T17:51:43.401430] [DEBUG] [LOCAL ] BXC: Trimmed 17930 records to 13732 (keeping 200 days of data) [2025-10-02T17:51:43.473996] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-02. [2025-10-02T17:51:43.493899] [DEBUG] [LOCAL ] BXC: Primary data saved (13732 records). [2025-10-02T17:51:43.494333] [INFO ] [MAIN ] BXC: Full history saved. [2025-10-02T17:51:43.494460] [INFO ] [MAIN ] Update Progress: 374/2370 symbols completed. BXC took 49.5s. Estimated remaining: 4h 35m 43s. Rate: 7.2 symbols/min [2025-10-02T17:51:43.717725] [INFO ] [MAIN ] BYD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:51:43.720774] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-02T17:51:43.744721] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-02T17:51:43.796371] [DEBUG] [LOCAL ] BYD: Loaded 44923 existing records from primary storage. [2025-10-02T17:51:43.796726] [INFO ] [MAIN ] BYD: Loaded 44923 existing records. [2025-10-02T17:51:43.996588] [WARN ] [MAIN ] BYD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:51:43.996847] [INFO ] [MAIN ] BYD: Wiping existing primary data before full refresh. [2025-10-02T17:51:43.996898] [INFO ] [LOCAL ] BYD: Starting deletion of primary data. [2025-10-02T17:51:43.998222] [DEBUG] [LOCAL ] BYD: Deleted primary data file. [2025-10-02T17:51:43.998289] [INFO ] [MAIN ] BYD: Starting full primary refresh. [2025-10-02T17:51:44.278133] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-06. [2025-10-02T17:51:44.400429] [INFO ] [REMOTE ] BYD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:51:45.073086] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-02. [2025-10-02T17:51:45.076305] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-02T17:51:45.872982] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-03. [2025-10-02T17:51:45.909295] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-02T17:51:46.053402] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-02T17:51:46.673004] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-07. [2025-10-02T17:51:47.473006] [INFO ] [REMOTE ] BYD: Fetching primary data for 2024-12. [2025-10-02T17:51:47.515854] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-02T17:51:48.149860] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-02T17:51:48.273006] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-04. [2025-10-02T17:51:49.015166] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-02T17:51:49.072982] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-01. [2025-10-02T17:51:49.872979] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-08. [2025-10-02T17:51:50.035055] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-02T17:51:50.678145] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-05. [2025-10-02T17:51:50.696305] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-02T17:51:51.295211] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-02T17:51:51.473015] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-09. [2025-10-02T17:51:52.272981] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-03. [2025-10-02T17:51:52.378207] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-02T17:51:53.072998] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-06. [2025-10-02T17:51:53.133963] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-02T17:51:53.158881] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-02T17:51:53.873004] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-04. [2025-10-02T17:51:54.634042] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-02T17:51:54.672975] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-07. [2025-10-02T17:51:55.472987] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-02. [2025-10-02T17:51:56.272966] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-10. [2025-10-02T17:51:56.322636] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-02T17:51:57.077412] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-08. [2025-10-02T17:51:57.080498] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-02T17:51:57.790736] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-02T17:51:57.792876] [INFO ] [REMOTE ] BXP: Full fetch complete (71537 records). [2025-10-02T17:51:57.792996] [DEBUG] [VALIDATOR ] BXP: Validating primary data. [2025-10-02T17:51:57.880992] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-03. [2025-10-02T17:51:58.223947] [DEBUG] [VALIDATOR ] BXP: All expected trading days are present. [2025-10-02T17:51:58.224038] [DEBUG] [VALIDATOR ] BXP: Primary data validation passed. [2025-10-02T17:51:58.224878] [INFO ] [MAIN ] BXP: Fetched primary data is valid. [2025-10-02T17:51:58.224941] [DEBUG] [LOCAL ] BXP: Saving primary data. [2025-10-02T17:51:58.226436] [DEBUG] [LOCAL ] BXP: Trimmed 71537 records to 50225 (keeping 200 days of data) [2025-10-02T17:51:58.567412] [DEBUG] [LOCAL ] BXP: Primary data saved (50225 records). [2025-10-02T17:51:58.567589] [INFO ] [MAIN ] BXP: Full history saved. [2025-10-02T17:51:58.567713] [INFO ] [MAIN ] Update Progress: 375/2370 symbols completed. BXP took 27.3s. Estimated remaining: 4h 36m 10s. Rate: 7.2 symbols/min [2025-10-02T17:51:58.767429] [INFO ] [MAIN ] BYM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:51:58.782086] [DEBUG] [LOCAL ] BYM: Loaded 12042 existing records from primary storage. [2025-10-02T17:51:58.782376] [INFO ] [MAIN ] BYM: Loaded 12042 existing records. [2025-10-02T17:51:58.977136] [WARN ] [MAIN ] BYM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:51:58.977365] [INFO ] [MAIN ] BYM: Wiping existing primary data before full refresh. [2025-10-02T17:51:58.977412] [INFO ] [LOCAL ] BYM: Starting deletion of primary data. [2025-10-02T17:51:58.978094] [DEBUG] [LOCAL ] BYM: Deleted primary data file. [2025-10-02T17:51:58.978155] [INFO ] [MAIN ] BYM: Starting full primary refresh. [2025-10-02T17:51:59.362439] [INFO ] [REMOTE ] BYM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:51:59.362800] [INFO ] [REMOTE ] BYM: Fetching primary data for 2024-12. [2025-10-02T17:51:59.561533] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-02T17:51:59.572189] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-04. [2025-10-02T17:52:00.534925] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-02T17:52:00.538820] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-01. [2025-10-02T17:52:01.342132] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-02T17:52:01.345782] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-02. [2025-10-02T17:52:02.150072] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-02T17:52:02.152910] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-03. [2025-10-02T17:52:02.996481] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-02T17:52:03.000623] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-04. [2025-10-02T17:52:03.968670] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-02T17:52:03.972633] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-05. [2025-10-02T17:52:04.817463] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-02T17:52:04.821113] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-06. [2025-10-02T17:52:17.880684] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-04 (24.01 seconds). [2025-10-02T17:52:17.887247] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-05. [2025-10-02T17:52:18.806304] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-02T17:52:18.810292] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-06. [2025-10-02T17:52:19.296811] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-08 (22.22 seconds). [2025-10-02T17:52:19.308625] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-09. [2025-10-02T17:52:19.821049] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-02T17:52:19.827044] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-07. [2025-10-02T17:52:20.711358] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-02T17:52:20.717950] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-08. [2025-10-02T17:52:20.763591] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-02T17:52:20.781631] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-10. [2025-10-02T17:52:22.003443] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-02T17:52:22.008291] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-09. [2025-10-02T17:52:22.295096] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-02T17:52:22.297245] [INFO ] [REMOTE ] BXSL: Full fetch complete (69469 records). [2025-10-02T17:52:22.297358] [DEBUG] [VALIDATOR ] BXSL: Validating primary data. [2025-10-02T17:52:22.737909] [DEBUG] [VALIDATOR ] BXSL: All expected trading days are present. [2025-10-02T17:52:22.738026] [DEBUG] [VALIDATOR ] BXSL: Primary data validation passed. [2025-10-02T17:52:22.738823] [INFO ] [MAIN ] BXSL: Fetched primary data is valid. [2025-10-02T17:52:22.738890] [DEBUG] [LOCAL ] BXSL: Saving primary data. [2025-10-02T17:52:22.740534] [DEBUG] [LOCAL ] BXSL: Trimmed 69469 records to 48025 (keeping 200 days of data) [2025-10-02T17:52:23.049331] [DEBUG] [LOCAL ] BXSL: Primary data saved (48025 records). [2025-10-02T17:52:23.049483] [INFO ] [MAIN ] BXSL: Full history saved. [2025-10-02T17:52:23.049572] [INFO ] [MAIN ] Update Progress: 376/2370 symbols completed. BXSL took 45.9s. Estimated remaining: 4h 37m 28s. Rate: 7.2 symbols/min [2025-10-02T17:52:23.250674] [INFO ] [MAIN ] BZH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:52:23.247109] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-02T17:52:23.256597] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-10. [2025-10-02T17:52:23.289172] [DEBUG] [LOCAL ] BZH: Loaded 32356 existing records from primary storage. [2025-10-02T17:52:23.289455] [INFO ] [MAIN ] BZH: Loaded 32356 existing records. [2025-10-02T17:52:23.486521] [WARN ] [MAIN ] BZH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:52:23.486791] [INFO ] [MAIN ] BZH: Wiping existing primary data before full refresh. [2025-10-02T17:52:23.486843] [INFO ] [LOCAL ] BZH: Starting deletion of primary data. [2025-10-02T17:52:23.487950] [DEBUG] [LOCAL ] BZH: Deleted primary data file. [2025-10-02T17:52:23.488047] [INFO ] [MAIN ] BZH: Starting full primary refresh. [2025-10-02T17:52:23.883863] [INFO ] [REMOTE ] BZH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:52:23.884172] [INFO ] [REMOTE ] BZH: Fetching primary data for 2024-12. [2025-10-02T17:52:24.124443] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-02T17:52:24.125814] [INFO ] [REMOTE ] BY: Full fetch complete (29532 records). [2025-10-02T17:52:24.125908] [DEBUG] [VALIDATOR ] BY: Validating primary data. [2025-10-02T17:52:24.526198] [DEBUG] [VALIDATOR ] BY: All expected trading days are present. [2025-10-02T17:52:24.526280] [DEBUG] [VALIDATOR ] BY: Primary data validation passed. [2025-10-02T17:52:24.527004] [INFO ] [MAIN ] BY: Fetched primary data is valid. [2025-10-02T17:52:24.527070] [DEBUG] [LOCAL ] BY: Saving primary data. [2025-10-02T17:52:24.527885] [DEBUG] [LOCAL ] BY: Trimmed 29532 records to 21841 (keeping 200 days of data) [2025-10-02T17:52:24.671127] [DEBUG] [LOCAL ] BY: Primary data saved (21841 records). [2025-10-02T17:52:24.671256] [INFO ] [MAIN ] BY: Full history saved. [2025-10-02T17:52:24.671354] [INFO ] [MAIN ] Update Progress: 377/2370 symbols completed. BY took 45.3s. Estimated remaining: 4h 36m 44s. Rate: 7.2 symbols/min [2025-10-02T17:52:24.889953] [INFO ] [MAIN ] C: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:52:24.944949] [DEBUG] [LOCAL ] C: Loaded 53741 existing records from primary storage. [2025-10-02T17:52:24.945271] [INFO ] [MAIN ] C: Loaded 53741 existing records. [2025-10-02T17:52:25.147761] [WARN ] [MAIN ] C: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:52:25.148219] [INFO ] [MAIN ] C: Wiping existing primary data before full refresh. [2025-10-02T17:52:25.148430] [INFO ] [LOCAL ] C: Starting deletion of primary data. [2025-10-02T17:52:25.150383] [DEBUG] [LOCAL ] C: Deleted primary data file. [2025-10-02T17:52:25.150455] [INFO ] [MAIN ] C: Starting full primary refresh. [2025-10-02T17:52:25.360008] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-02T17:52:25.423332] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-01. [2025-10-02T17:52:25.561948] [INFO ] [REMOTE ] C: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:52:25.562244] [INFO ] [REMOTE ] C: Fetching primary data for 2024-12. [2025-10-02T17:52:26.382110] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-02T17:52:26.388564] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-02. [2025-10-02T17:52:26.815543] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-04 (27.24 seconds). [2025-10-02T17:52:26.826314] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-05. [2025-10-02T17:52:27.388505] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-02T17:52:27.397146] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-03. [2025-10-02T17:52:27.669836] [INFO ] [REMOTE ] C: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-02T17:52:27.681681] [INFO ] [REMOTE ] C: Fetching primary data for 2025-01. [2025-10-02T17:52:28.498816] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-02T17:52:28.509954] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-06. [2025-10-02T17:52:29.843192] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-02T17:52:29.855342] [INFO ] [REMOTE ] C: Fetching primary data for 2025-02. [2025-10-02T17:52:30.191796] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-02T17:52:30.201730] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-07. [2025-10-02T17:52:31.684947] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-02T17:52:31.697345] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-08. [2025-10-02T17:52:31.884512] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-02T17:52:31.895244] [INFO ] [REMOTE ] C: Fetching primary data for 2025-03. [2025-10-02T17:52:33.037948] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-02T17:52:33.048312] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-09. [2025-10-02T17:52:33.980138] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-02T17:52:33.992729] [INFO ] [REMOTE ] C: Fetching primary data for 2025-04. [2025-10-02T17:52:34.521736] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-02T17:52:34.532019] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-10. [2025-10-02T17:52:34.884330] [DEBUG] [REMOTE ] BYM: Error fetching primary data for 2025-06: Server request status code is 503. [2025-10-02T17:52:34.884794] [WARN ] [REMOTE ] BYM: No data returned for month 2025-06 [2025-10-02T17:52:34.884916] [FATAL] [REMOTE ] BYM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T17:52:34.885055] [FATAL] [MAIN ] BYM: Failed to fetch primary data. [2025-10-02T17:52:34.885143] [WARN ] [MAIN ] BYM: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T17:52:34.885250] [INFO ] [LOCAL ] BYM: Starting deletion of primary data. [2025-10-02T17:52:34.885337] [DEBUG] [LOCAL ] BYM: No primary data file found to delete. [2025-10-02T17:52:34.885376] [INFO ] [LOCAL ] BYM: Starting deletion of derivative data. [2025-10-02T17:52:34.886082] [DEBUG] [LOCAL ] BYM: Deleted derivative data file. [2025-10-02T17:52:34.886406] [INFO ] [MAIN ] Update Progress: 378/2370 symbols completed. BYM took 36.3s. Estimated remaining: 4h 36m 46s. Rate: 7.2 symbols/min [2025-10-02T17:52:35.102294] [INFO ] [MAIN ] CAAP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:52:35.126360] [DEBUG] [LOCAL ] CAAP: Loaded 19995 existing records from primary storage. [2025-10-02T17:52:35.126711] [INFO ] [MAIN ] CAAP: Loaded 19995 existing records. [2025-10-02T17:52:35.329158] [WARN ] [MAIN ] CAAP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:52:35.329389] [INFO ] [MAIN ] CAAP: Wiping existing primary data before full refresh. [2025-10-02T17:52:35.329441] [INFO ] [LOCAL ] CAAP: Starting deletion of primary data. [2025-10-02T17:52:35.330391] [DEBUG] [LOCAL ] CAAP: Deleted primary data file. [2025-10-02T17:52:35.330455] [INFO ] [MAIN ] CAAP: Starting full primary refresh. [2025-10-02T17:52:35.759450] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-02T17:52:35.758948] [INFO ] [REMOTE ] CAAP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:52:35.760516] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2024-12. [2025-10-02T17:52:35.763889] [INFO ] [REMOTE ] BYD: Full fetch complete (65082 records). [2025-10-02T17:52:35.764069] [DEBUG] [VALIDATOR ] BYD: Validating primary data. [2025-10-02T17:52:36.198019] [DEBUG] [VALIDATOR ] BYD: All expected trading days are present. [2025-10-02T17:52:36.198166] [DEBUG] [VALIDATOR ] BYD: Primary data validation passed. [2025-10-02T17:52:36.199212] [INFO ] [MAIN ] BYD: Fetched primary data is valid. [2025-10-02T17:52:36.199346] [DEBUG] [LOCAL ] BYD: Saving primary data. [2025-10-02T17:52:36.201734] [DEBUG] [LOCAL ] BYD: Trimmed 65082 records to 45277 (keeping 200 days of data) [2025-10-02T17:52:36.331578] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-02T17:52:36.369768] [INFO ] [REMOTE ] C: Fetching primary data for 2025-05. [2025-10-02T17:52:36.544169] [DEBUG] [LOCAL ] BYD: Primary data saved (45277 records). [2025-10-02T17:52:36.544324] [INFO ] [MAIN ] BYD: Full history saved. [2025-10-02T17:52:36.544482] [INFO ] [MAIN ] Update Progress: 379/2370 symbols completed. BYD took 53.0s. Estimated remaining: 4h 36m 2s. Rate: 7.2 symbols/min [2025-10-02T17:52:36.743037] [INFO ] [MAIN ] CABO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:52:36.765636] [DEBUG] [LOCAL ] CABO: Loaded 17049 existing records from primary storage. [2025-10-02T17:52:36.765977] [INFO ] [MAIN ] CABO: Loaded 17049 existing records. [2025-10-02T17:52:36.987439] [WARN ] [MAIN ] CABO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:52:36.987758] [INFO ] [MAIN ] CABO: Wiping existing primary data before full refresh. [2025-10-02T17:52:36.987844] [INFO ] [LOCAL ] CABO: Starting deletion of primary data. [2025-10-02T17:52:36.988725] [DEBUG] [LOCAL ] CABO: Deleted primary data file. [2025-10-02T17:52:36.988787] [INFO ] [MAIN ] CABO: Starting full primary refresh. [2025-10-02T17:52:37.399213] [INFO ] [REMOTE ] CABO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:52:37.399529] [INFO ] [REMOTE ] CABO: Fetching primary data for 2024-12. [2025-10-02T17:52:38.313696] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-02T17:52:38.316330] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-01. [2025-10-02T17:52:38.602831] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-02T17:52:38.614623] [INFO ] [REMOTE ] C: Fetching primary data for 2025-06. [2025-10-02T17:52:39.119711] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-02T17:52:39.122447] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-02. [2025-10-02T17:52:39.810501] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-02T17:52:39.814240] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-03. [2025-10-02T17:52:40.523900] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-02T17:52:40.535957] [INFO ] [REMOTE ] C: Fetching primary data for 2025-07. [2025-10-02T17:52:40.766384] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-02T17:52:40.770985] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-04. [2025-10-02T17:52:41.364529] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-02T17:52:41.368443] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-05. [2025-10-02T17:52:42.508864] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-02T17:52:42.515080] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-06. [2025-10-02T17:52:42.826751] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-02T17:52:42.838894] [INFO ] [REMOTE ] C: Fetching primary data for 2025-08. [2025-10-02T17:52:43.618702] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-02T17:52:43.623600] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-07. [2025-10-02T17:52:44.475053] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-02T17:52:44.483597] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-08. [2025-10-02T17:52:45.393016] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-02T17:52:45.397165] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-09. [2025-10-02T17:52:46.168003] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-02T17:52:46.171440] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-10. [2025-10-02T17:52:46.869586] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-02T17:52:46.871154] [INFO ] [REMOTE ] CABO: Full fetch complete (23134 records). [2025-10-02T17:52:46.871301] [DEBUG] [VALIDATOR ] CABO: Validating primary data. [2025-10-02T17:52:47.294499] [DEBUG] [VALIDATOR ] CABO: All expected trading days are present. [2025-10-02T17:52:47.294591] [DEBUG] [VALIDATOR ] CABO: Primary data validation passed. [2025-10-02T17:52:47.295016] [INFO ] [MAIN ] CABO: Fetched primary data is valid. [2025-10-02T17:52:47.295080] [DEBUG] [LOCAL ] CABO: Saving primary data. [2025-10-02T17:52:47.296010] [DEBUG] [LOCAL ] CABO: Trimmed 23134 records to 17118 (keeping 200 days of data) [2025-10-02T17:52:47.401408] [DEBUG] [LOCAL ] CABO: Primary data saved (17118 records). [2025-10-02T17:52:47.401564] [INFO ] [MAIN ] CABO: Full history saved. [2025-10-02T17:52:47.401673] [INFO ] [MAIN ] Update Progress: 380/2370 symbols completed. CABO took 10.9s. Estimated remaining: 4h 36m 7s. Rate: 7.2 symbols/min [2025-10-02T17:52:47.635535] [INFO ] [MAIN ] CACI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:52:47.673787] [DEBUG] [LOCAL ] CACI: Loaded 24519 existing records from primary storage. [2025-10-02T17:52:47.674110] [INFO ] [MAIN ] CACI: Loaded 24519 existing records. [2025-10-02T17:52:47.870369] [WARN ] [MAIN ] CACI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:52:47.870717] [INFO ] [MAIN ] CACI: Wiping existing primary data before full refresh. [2025-10-02T17:52:47.870781] [INFO ] [LOCAL ] CACI: Starting deletion of primary data. [2025-10-02T17:52:47.871848] [DEBUG] [LOCAL ] CACI: Deleted primary data file. [2025-10-02T17:52:47.871959] [INFO ] [MAIN ] CACI: Starting full primary refresh. [2025-10-02T17:52:48.257106] [INFO ] [REMOTE ] CACI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:52:48.257619] [INFO ] [REMOTE ] CACI: Fetching primary data for 2024-12. [2025-10-02T17:52:56.050572] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-03 (28.65 seconds). [2025-10-02T17:52:56.058839] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-04. [2025-10-02T17:52:57.431900] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-02T17:52:57.440227] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-05. [2025-10-02T17:52:58.570310] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-02T17:52:58.578512] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-06. [2025-10-02T17:52:59.813011] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-02T17:52:59.820251] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-07. [2025-10-02T17:52:59.838567] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2024-12 (24.08 seconds). [2025-10-02T17:52:59.844007] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-01. [2025-10-02T17:53:00.864908] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-02T17:53:00.869602] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-02. [2025-10-02T17:53:01.175962] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-08 (18.34 seconds). [2025-10-02T17:53:01.196192] [INFO ] [REMOTE ] C: Fetching primary data for 2025-09. [2025-10-02T17:53:01.332611] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-02T17:53:01.340432] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-08. [2025-10-02T17:53:01.830890] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-02T17:53:01.834922] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-03. [2025-10-02T17:53:02.848413] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-02T17:53:02.856693] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-09. [2025-10-02T17:53:02.873438] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2024-12 (14.62 seconds). [2025-10-02T17:53:02.880402] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-01. [2025-10-02T17:53:02.934011] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-02T17:53:02.938984] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-04. [2025-10-02T17:53:02.982855] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-02T17:53:02.994917] [INFO ] [REMOTE ] C: Fetching primary data for 2025-10. [2025-10-02T17:53:03.879796] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-02T17:53:03.884757] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-05. [2025-10-02T17:53:04.058457] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-02T17:53:04.065724] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-02. [2025-10-02T17:53:04.206187] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-02T17:53:04.214084] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-10. [2025-10-02T17:53:04.777110] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-02T17:53:04.780374] [INFO ] [REMOTE ] C: Full fetch complete (77784 records). [2025-10-02T17:53:04.796857] [DEBUG] [VALIDATOR ] C: Validating primary data. [2025-10-02T17:53:04.801626] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-02T17:53:04.857347] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-06. [2025-10-02T17:53:05.165018] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-02T17:53:05.200395] [INFO ] [REMOTE ] BZH: Full fetch complete (46979 records). [2025-10-02T17:53:05.227615] [DEBUG] [VALIDATOR ] BZH: Validating primary data. [2025-10-02T17:53:05.558119] [DEBUG] [VALIDATOR ] C: All expected trading days are present. [2025-10-02T17:53:05.558533] [DEBUG] [VALIDATOR ] C: Primary data validation passed. [2025-10-02T17:53:05.560673] [INFO ] [MAIN ] C: Fetched primary data is valid. [2025-10-02T17:53:05.560815] [DEBUG] [LOCAL ] C: Saving primary data. [2025-10-02T17:53:05.612314] [DEBUG] [LOCAL ] C: Trimmed 77784 records to 54130 (keeping 200 days of data) [2025-10-02T17:53:06.052131] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-02T17:53:06.115304] [DEBUG] [VALIDATOR ] BZH: All expected trading days are present. [2025-10-02T17:53:06.114867] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-07. [2025-10-02T17:53:06.117573] [DEBUG] [VALIDATOR ] BZH: Primary data validation passed. [2025-10-02T17:53:06.120419] [INFO ] [MAIN ] BZH: Fetched primary data is valid. [2025-10-02T17:53:06.120550] [DEBUG] [LOCAL ] BZH: Saving primary data. [2025-10-02T17:53:06.127481] [DEBUG] [LOCAL ] BZH: Trimmed 46979 records to 32621 (keeping 200 days of data) [2025-10-02T17:53:06.533832] [DEBUG] [LOCAL ] BZH: Primary data saved (32621 records). [2025-10-02T17:53:06.540805] [INFO ] [MAIN ] BZH: Full history saved. [2025-10-02T17:53:06.560954] [INFO ] [MAIN ] Update Progress: 381/2370 symbols completed. BZH took 43.5s. Estimated remaining: 4h 36m 55s. Rate: 7.2 symbols/min [2025-10-02T17:53:06.768479] [INFO ] [MAIN ] CADE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:53:06.787845] [DEBUG] [LOCAL ] C: Primary data saved (54130 records). [2025-10-02T17:53:06.788039] [INFO ] [MAIN ] C: Full history saved. [2025-10-02T17:53:06.789467] [INFO ] [MAIN ] Update Progress: 382/2370 symbols completed. C took 42.1s. Estimated remaining: 4h 36m 5s. Rate: 7.2 symbols/min [2025-10-02T17:53:07.018036] [INFO ] [MAIN ] CAE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:53:07.019884] [DEBUG] [LOCAL ] CADE: Loaded 48856 existing records from primary storage. [2025-10-02T17:53:07.020221] [INFO ] [MAIN ] CADE: Loaded 48856 existing records. [2025-10-02T17:53:07.231630] [WARN ] [MAIN ] CADE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:53:07.231995] [INFO ] [MAIN ] CADE: Wiping existing primary data before full refresh. [2025-10-02T17:53:07.232072] [INFO ] [LOCAL ] CADE: Starting deletion of primary data. [2025-10-02T17:53:07.234265] [DEBUG] [LOCAL ] CADE: Deleted primary data file. [2025-10-02T17:53:07.234362] [INFO ] [MAIN ] CADE: Starting full primary refresh. [2025-10-02T17:53:07.363151] [DEBUG] [LOCAL ] CAE: Loaded 39036 existing records from primary storage. [2025-10-02T17:53:07.379728] [INFO ] [MAIN ] CAE: Loaded 39036 existing records. [2025-10-02T17:53:07.866205] [INFO ] [REMOTE ] CADE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:53:07.869547] [WARN ] [MAIN ] CAE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:53:07.870024] [INFO ] [REMOTE ] CADE: Fetching primary data for 2024-12. [2025-10-02T17:53:07.870217] [INFO ] [MAIN ] CAE: Wiping existing primary data before full refresh. [2025-10-02T17:53:07.871161] [INFO ] [LOCAL ] CAE: Starting deletion of primary data. [2025-10-02T17:53:07.880356] [DEBUG] [LOCAL ] CAE: Deleted primary data file. [2025-10-02T17:53:07.880689] [INFO ] [MAIN ] CAE: Starting full primary refresh. [2025-10-02T17:53:07.895743] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-02T17:53:07.958901] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-08. [2025-10-02T17:53:08.025223] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-02 (3.96 seconds). [2025-10-02T17:53:08.102236] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-03. [2025-10-02T17:53:08.319885] [INFO ] [REMOTE ] CAE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:53:08.320195] [INFO ] [REMOTE ] CAE: Fetching primary data for 2024-12. [2025-10-02T17:53:08.996686] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-02T17:53:09.001991] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-09. [2025-10-02T17:53:09.328329] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-02T17:53:09.338633] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-01. [2025-10-02T17:53:09.781478] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-02T17:53:09.790361] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-04. [2025-10-02T17:53:10.053289] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-02T17:53:10.061030] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-01. [2025-10-02T17:53:10.350144] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-02T17:53:10.356834] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-10. [2025-10-02T17:53:10.960723] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-02T17:53:10.971179] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-02. [2025-10-02T17:53:11.038519] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-02T17:53:11.048631] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-02. [2025-10-02T17:53:11.078288] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-02T17:53:11.080177] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-02T17:53:11.091524] [INFO ] [REMOTE ] CAAP: Full fetch complete (27843 records). [2025-10-02T17:53:11.092570] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-05. [2025-10-02T17:53:11.092251] [DEBUG] [VALIDATOR ] CAAP: Validating primary data. [2025-10-02T17:53:11.568307] [DEBUG] [VALIDATOR ] CAAP: All expected trading days are present. [2025-10-02T17:53:11.568445] [DEBUG] [VALIDATOR ] CAAP: Primary data validation passed. [2025-10-02T17:53:11.569356] [INFO ] [MAIN ] CAAP: Fetched primary data is valid. [2025-10-02T17:53:11.569435] [DEBUG] [LOCAL ] CAAP: Saving primary data. [2025-10-02T17:53:11.570778] [DEBUG] [LOCAL ] CAAP: Trimmed 27843 records to 20146 (keeping 200 days of data) [2025-10-02T17:53:11.714032] [DEBUG] [LOCAL ] CAAP: Primary data saved (20146 records). [2025-10-02T17:53:11.714163] [INFO ] [MAIN ] CAAP: Full history saved. [2025-10-02T17:53:11.714309] [INFO ] [MAIN ] Update Progress: 383/2370 symbols completed. CAAP took 36.8s. Estimated remaining: 4h 35m 39s. Rate: 7.2 symbols/min [2025-10-02T17:53:11.926472] [INFO ] [MAIN ] CAF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:53:11.934091] [DEBUG] [LOCAL ] CAF: Loaded 3394 existing records from primary storage. [2025-10-02T17:53:11.934328] [INFO ] [MAIN ] CAF: Loaded 3394 existing records. [2025-10-02T17:53:12.144396] [WARN ] [MAIN ] CAF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:53:12.145019] [INFO ] [MAIN ] CAF: Wiping existing primary data before full refresh. [2025-10-02T17:53:12.145267] [INFO ] [LOCAL ] CAF: Starting deletion of primary data. [2025-10-02T17:53:12.145754] [DEBUG] [LOCAL ] CAF: Deleted primary data file. [2025-10-02T17:53:12.145952] [INFO ] [MAIN ] CAF: Starting full primary refresh. [2025-10-02T17:53:12.349907] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-02T17:53:12.428181] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-06. [2025-10-02T17:53:12.616949] [INFO ] [REMOTE ] CAF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:53:12.632333] [INFO ] [REMOTE ] CAF: Fetching primary data for 2024-12. [2025-10-02T17:53:12.634121] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-02T17:53:12.654067] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-03. [2025-10-02T17:53:12.655232] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-02T17:53:12.665908] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-03. [2025-10-02T17:53:13.445258] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-02T17:53:13.448561] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-01. [2025-10-02T17:53:13.464279] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-02T17:53:13.470064] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-07. [2025-10-02T17:53:13.634562] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-02T17:53:13.643502] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-04. [2025-10-02T17:53:13.784243] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-02T17:53:13.786097] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-02. [2025-10-02T17:53:14.337408] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-02T17:53:14.339404] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-03. [2025-10-02T17:53:14.394209] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-02T17:53:14.405209] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-04. [2025-10-02T17:53:14.586592] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-02T17:53:14.592077] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-08. [2025-10-02T17:53:14.760191] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-02T17:53:14.761835] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-04. [2025-10-02T17:53:14.939162] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-02T17:53:14.949013] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-05. [2025-10-02T17:53:15.214445] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-02T17:53:15.216224] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-05. [2025-10-02T17:53:15.571802] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-02T17:53:15.573633] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-06. [2025-10-02T17:53:15.660734] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-02T17:53:15.665997] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-09. [2025-10-02T17:53:16.045304] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-02T17:53:16.046798] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-07. [2025-10-02T17:53:16.186248] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-02T17:53:16.195712] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-06. [2025-10-02T17:53:16.231932] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-02T17:53:16.243566] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-05. [2025-10-02T17:53:16.384339] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-02T17:53:16.389286] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-10. [2025-10-02T17:53:16.422723] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-02T17:53:17.073020] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-08. [2025-10-02T17:53:17.221780] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-02T17:53:17.379375] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-02T17:53:17.380693] [INFO ] [REMOTE ] CACI: Full fetch complete (38866 records). [2025-10-02T17:53:17.380783] [DEBUG] [VALIDATOR ] CACI: Validating primary data. [2025-10-02T17:53:17.497168] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-02T17:53:17.793319] [DEBUG] [VALIDATOR ] CACI: All expected trading days are present. [2025-10-02T17:53:17.793514] [DEBUG] [VALIDATOR ] CACI: Primary data validation passed. [2025-10-02T17:53:17.794190] [INFO ] [MAIN ] CACI: Fetched primary data is valid. [2025-10-02T17:53:17.794272] [DEBUG] [LOCAL ] CACI: Saving primary data. [2025-10-02T17:53:17.795533] [DEBUG] [LOCAL ] CACI: Trimmed 38866 records to 24689 (keeping 200 days of data) [2025-10-02T17:53:17.885638] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-09. [2025-10-02T17:53:17.998230] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-02T17:53:18.017212] [DEBUG] [LOCAL ] CACI: Primary data saved (24689 records). [2025-10-02T17:53:18.017936] [INFO ] [MAIN ] CACI: Full history saved. [2025-10-02T17:53:18.018097] [INFO ] [MAIN ] Update Progress: 384/2370 symbols completed. CACI took 30.6s. Estimated remaining: 4h 35m 20s. Rate: 7.2 symbols/min [2025-10-02T17:53:18.220749] [INFO ] [MAIN ] CAG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:53:18.279373] [DEBUG] [LOCAL ] CAG: Loaded 53663 existing records from primary storage. [2025-10-02T17:53:18.279774] [INFO ] [MAIN ] CAG: Loaded 53663 existing records. [2025-10-02T17:53:18.488595] [WARN ] [MAIN ] CAG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:53:18.489004] [INFO ] [MAIN ] CAG: Wiping existing primary data before full refresh. [2025-10-02T17:53:18.489059] [INFO ] [LOCAL ] CAG: Starting deletion of primary data. [2025-10-02T17:53:18.491114] [DEBUG] [LOCAL ] CAG: Deleted primary data file. [2025-10-02T17:53:18.491184] [INFO ] [MAIN ] CAG: Starting full primary refresh. [2025-10-02T17:53:18.601802] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-02T17:53:18.674666] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-10. [2025-10-02T17:53:18.941291] [INFO ] [REMOTE ] CAG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:53:19.195437] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-02T17:53:19.196284] [INFO ] [REMOTE ] CAF: Full fetch complete (5562 records). [2025-10-02T17:53:19.196358] [DEBUG] [VALIDATOR ] CAF: Validating primary data. [2025-10-02T17:53:19.478224] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-07. [2025-10-02T17:53:19.601578] [DEBUG] [VALIDATOR ] CAF: All expected trading days are present. [2025-10-02T17:53:19.601689] [DEBUG] [VALIDATOR ] CAF: Primary data validation passed. [2025-10-02T17:53:19.601893] [INFO ] [MAIN ] CAF: Fetched primary data is valid. [2025-10-02T17:53:19.601937] [DEBUG] [LOCAL ] CAF: Saving primary data. [2025-10-02T17:53:19.602346] [DEBUG] [LOCAL ] CAF: Trimmed 5562 records to 3421 (keeping 200 days of data) [2025-10-02T17:53:19.623143] [DEBUG] [LOCAL ] CAF: Primary data saved (3421 records). [2025-10-02T17:53:19.623292] [INFO ] [MAIN ] CAF: Full history saved. [2025-10-02T17:53:19.623398] [INFO ] [MAIN ] Update Progress: 385/2370 symbols completed. CAF took 7.9s. Estimated remaining: 4h 34m 37s. Rate: 7.2 symbols/min [2025-10-02T17:53:19.811225] [INFO ] [MAIN ] CAH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:53:19.876473] [DEBUG] [LOCAL ] CAH: Loaded 51417 existing records from primary storage. [2025-10-02T17:53:19.876865] [INFO ] [MAIN ] CAH: Loaded 51417 existing records. [2025-10-02T17:53:20.079002] [WARN ] [MAIN ] CAH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:53:20.079275] [INFO ] [MAIN ] CAH: Wiping existing primary data before full refresh. [2025-10-02T17:53:20.079338] [INFO ] [LOCAL ] CAH: Starting deletion of primary data. [2025-10-02T17:53:20.081667] [DEBUG] [LOCAL ] CAH: Deleted primary data file. [2025-10-02T17:53:20.081746] [INFO ] [MAIN ] CAH: Starting full primary refresh. [2025-10-02T17:53:20.279482] [INFO ] [REMOTE ] CAG: Fetching primary data for 2024-12. [2025-10-02T17:53:20.470625] [INFO ] [REMOTE ] CAH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:53:21.073070] [INFO ] [REMOTE ] CAH: Fetching primary data for 2024-12. [2025-10-02T17:53:21.189076] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-02T17:53:21.815872] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-02T17:53:21.872967] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-01. [2025-10-02T17:53:22.672977] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-08. [2025-10-02T17:53:22.786771] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-02T17:53:23.473059] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-06. [2025-10-02T17:53:23.559856] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-02T17:53:24.184584] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-02T17:53:24.273020] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-01. [2025-10-02T17:53:25.063228] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-02T17:53:25.074703] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-02. [2025-10-02T17:53:25.873036] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-09. [2025-10-02T17:53:25.923617] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-02T17:53:26.673056] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-02. [2025-10-02T17:53:27.001101] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-02T17:53:27.306707] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-02T17:53:27.473001] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-10. [2025-10-02T17:53:27.945989] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-02T17:53:28.273034] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-07. [2025-10-02T17:53:28.651024] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-02T17:53:28.653006] [INFO ] [REMOTE ] CAE: Full fetch complete (56071 records). [2025-10-02T17:53:28.653143] [DEBUG] [VALIDATOR ] CAE: Validating primary data. [2025-10-02T17:53:29.092802] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-03. [2025-10-02T17:53:29.096100] [DEBUG] [VALIDATOR ] CAE: All expected trading days are present. [2025-10-02T17:53:29.097092] [DEBUG] [VALIDATOR ] CAE: Primary data validation passed. [2025-10-02T17:53:29.097883] [INFO ] [MAIN ] CAE: Fetched primary data is valid. [2025-10-02T17:53:29.097953] [DEBUG] [LOCAL ] CAE: Saving primary data. [2025-10-02T17:53:29.099551] [DEBUG] [LOCAL ] CAE: Trimmed 56071 records to 39353 (keeping 200 days of data) [2025-10-02T17:53:29.340921] [DEBUG] [LOCAL ] CAE: Primary data saved (39353 records). [2025-10-02T17:53:29.341075] [INFO ] [MAIN ] CAE: Full history saved. [2025-10-02T17:53:29.341166] [INFO ] [MAIN ] Update Progress: 386/2370 symbols completed. CAE took 22.6s. Estimated remaining: 4h 34m 36s. Rate: 7.2 symbols/min [2025-10-02T17:53:29.528949] [INFO ] [MAIN ] CAL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:53:29.573827] [DEBUG] [LOCAL ] CAL: Loaded 43156 existing records from primary storage. [2025-10-02T17:53:29.574180] [INFO ] [MAIN ] CAL: Loaded 43156 existing records. [2025-10-02T17:53:29.785662] [WARN ] [MAIN ] CAL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:53:29.785928] [INFO ] [MAIN ] CAL: Wiping existing primary data before full refresh. [2025-10-02T17:53:29.785980] [INFO ] [LOCAL ] CAL: Starting deletion of primary data. [2025-10-02T17:53:29.787507] [DEBUG] [LOCAL ] CAL: Deleted primary data file. [2025-10-02T17:53:29.787586] [INFO ] [MAIN ] CAL: Starting full primary refresh. [2025-10-02T17:53:29.901259] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-03. [2025-10-02T17:53:29.979243] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-02T17:53:30.255029] [INFO ] [REMOTE ] CAL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:53:30.672988] [INFO ] [REMOTE ] CAL: Fetching primary data for 2024-12. [2025-10-02T17:53:30.711397] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-02T17:53:31.473079] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-04. [2025-10-02T17:53:31.722506] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-02T17:53:32.273034] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-04. [2025-10-02T17:53:32.345219] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-02T17:53:33.073015] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-01. [2025-10-02T17:53:33.231083] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-02T17:53:33.873029] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-05. [2025-10-02T17:53:34.063948] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-02T17:53:34.137517] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-02T17:53:34.673015] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-02. [2025-10-02T17:53:35.472972] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-08. [2025-10-02T17:53:35.823435] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-02T17:53:35.872758] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-02T17:53:36.273036] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-06. [2025-10-02T17:53:37.073014] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-03. [2025-10-02T17:53:37.335504] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-02T17:53:37.872973] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-05. [2025-10-02T17:53:38.054368] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-02T17:53:38.602438] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-02T17:53:38.673003] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-07. [2025-10-02T17:53:39.472970] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-04. [2025-10-02T17:53:39.541985] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-02T17:53:40.273010] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-06. [2025-10-02T17:53:40.593042] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-02T17:53:41.073028] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-09. [2025-10-02T17:53:41.112801] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-02T17:53:41.634609] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-02T17:53:41.872997] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-05. [2025-10-02T17:53:42.672961] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-07. [2025-10-02T17:53:42.805185] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-02T17:53:43.185786] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-02T17:53:43.472999] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-08. [2025-10-02T17:53:44.273041] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-06. [2025-10-02T17:53:44.732197] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-02T17:53:45.072984] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-08. [2025-10-02T17:53:45.392069] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-02T17:53:45.469251] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-02T17:53:45.873004] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-10. [2025-10-02T17:53:46.673001] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-07. [2025-10-02T17:53:46.928184] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-02T17:53:47.243676] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-02T17:53:47.245704] [INFO ] [REMOTE ] CADE: Full fetch complete (69922 records). [2025-10-02T17:53:47.245813] [DEBUG] [VALIDATOR ] CADE: Validating primary data. [2025-10-02T17:53:47.478964] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-09. [2025-10-02T17:53:47.666589] [DEBUG] [VALIDATOR ] CADE: All expected trading days are present. [2025-10-02T17:53:47.666704] [DEBUG] [VALIDATOR ] CADE: Primary data validation passed. [2025-10-02T17:53:47.667531] [INFO ] [MAIN ] CADE: Fetched primary data is valid. [2025-10-02T17:53:47.667593] [DEBUG] [LOCAL ] CADE: Saving primary data. [2025-10-02T17:53:47.669586] [DEBUG] [LOCAL ] CADE: Trimmed 69922 records to 49221 (keeping 200 days of data) [2025-10-02T17:53:47.942781] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-02T17:53:48.026599] [DEBUG] [LOCAL ] CADE: Primary data saved (49221 records). [2025-10-02T17:53:48.026772] [INFO ] [MAIN ] CADE: Full history saved. [2025-10-02T17:53:48.026864] [INFO ] [MAIN ] Update Progress: 387/2370 symbols completed. CADE took 41.5s. Estimated remaining: 4h 35m 21s. Rate: 7.2 symbols/min [2025-10-02T17:53:48.206876] [INFO ] [MAIN ] CALX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:53:48.245117] [DEBUG] [LOCAL ] CALX: Loaded 37899 existing records from primary storage. [2025-10-02T17:53:48.245414] [INFO ] [MAIN ] CALX: Loaded 37899 existing records. [2025-10-02T17:53:48.278094] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-08. [2025-10-02T17:53:48.438892] [WARN ] [MAIN ] CALX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:53:48.439134] [INFO ] [MAIN ] CALX: Wiping existing primary data before full refresh. [2025-10-02T17:53:48.439185] [INFO ] [LOCAL ] CALX: Starting deletion of primary data. [2025-10-02T17:53:48.440477] [DEBUG] [LOCAL ] CALX: Deleted primary data file. [2025-10-02T17:53:48.440540] [INFO ] [MAIN ] CALX: Starting full primary refresh. [2025-10-02T17:53:48.832683] [INFO ] [REMOTE ] CALX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:53:49.072980] [INFO ] [REMOTE ] CALX: Fetching primary data for 2024-12. [2025-10-02T17:53:49.262854] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-02T17:53:49.438035] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-02T17:53:49.873017] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-09. [2025-10-02T17:53:50.503110] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-02T17:53:50.672992] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-01. [2025-10-02T17:53:51.396493] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-02T17:53:51.473040] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-10. [2025-10-02T17:53:52.124063] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-02T17:53:52.273038] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-09. [2025-10-02T17:53:52.883927] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-02T17:53:52.886029] [INFO ] [REMOTE ] CAH: Full fetch complete (74616 records). [2025-10-02T17:53:52.886140] [DEBUG] [VALIDATOR ] CAH: Validating primary data. [2025-10-02T17:53:53.078141] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-10. [2025-10-02T17:53:53.319875] [DEBUG] [VALIDATOR ] CAH: All expected trading days are present. [2025-10-02T17:53:53.319961] [DEBUG] [VALIDATOR ] CAH: Primary data validation passed. [2025-10-02T17:53:53.320759] [INFO ] [MAIN ] CAH: Fetched primary data is valid. [2025-10-02T17:53:53.320828] [DEBUG] [LOCAL ] CAH: Saving primary data. [2025-10-02T17:53:53.322365] [DEBUG] [LOCAL ] CAH: Trimmed 74616 records to 51794 (keeping 200 days of data) [2025-10-02T17:53:53.672117] [DEBUG] [LOCAL ] CAH: Primary data saved (51794 records). [2025-10-02T17:53:53.672260] [INFO ] [MAIN ] CAH: Full history saved. [2025-10-02T17:53:53.672347] [INFO ] [MAIN ] Update Progress: 388/2370 symbols completed. CAH took 34.0s. Estimated remaining: 4h 34m 59s. Rate: 7.2 symbols/min [2025-10-02T17:53:53.854779] [INFO ] [MAIN ] CANG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:53:53.880006] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-02. [2025-10-02T17:53:53.881939] [DEBUG] [LOCAL ] CANG: Loaded 26966 existing records from primary storage. [2025-10-02T17:53:53.882959] [INFO ] [MAIN ] CANG: Loaded 26966 existing records. [2025-10-02T17:53:54.097158] [WARN ] [MAIN ] CANG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:53:54.097487] [INFO ] [MAIN ] CANG: Wiping existing primary data before full refresh. [2025-10-02T17:53:54.097627] [INFO ] [LOCAL ] CANG: Starting deletion of primary data. [2025-10-02T17:53:54.098687] [DEBUG] [LOCAL ] CANG: Deleted primary data file. [2025-10-02T17:53:54.098750] [INFO ] [MAIN ] CANG: Starting full primary refresh. [2025-10-02T17:53:54.501999] [INFO ] [REMOTE ] CANG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:53:54.537209] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-02T17:53:54.553483] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-02T17:53:54.556862] [INFO ] [REMOTE ] CAL: Full fetch complete (61833 records). [2025-10-02T17:53:54.556983] [DEBUG] [VALIDATOR ] CAL: Validating primary data. [2025-10-02T17:53:54.674225] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-10. [2025-10-02T17:53:55.007898] [DEBUG] [VALIDATOR ] CAL: All expected trading days are present. [2025-10-02T17:53:55.008075] [DEBUG] [VALIDATOR ] CAL: Primary data validation passed. [2025-10-02T17:53:55.008993] [INFO ] [MAIN ] CAL: Fetched primary data is valid. [2025-10-02T17:53:55.009159] [DEBUG] [LOCAL ] CAL: Saving primary data. [2025-10-02T17:53:55.039454] [DEBUG] [LOCAL ] CAL: Trimmed 61833 records to 43440 (keeping 200 days of data) [2025-10-02T17:53:55.040366] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-02T17:53:55.332435] [DEBUG] [LOCAL ] CAL: Primary data saved (43440 records). [2025-10-02T17:53:55.332610] [INFO ] [MAIN ] CAL: Full history saved. [2025-10-02T17:53:55.333251] [INFO ] [MAIN ] Update Progress: 389/2370 symbols completed. CAL took 26.0s. Estimated remaining: 4h 34m 17s. Rate: 7.2 symbols/min [2025-10-02T17:53:55.482892] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-03. [2025-10-02T17:53:55.518289] [INFO ] [MAIN ] CAPL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:53:55.529315] [DEBUG] [LOCAL ] CAPL: Loaded 5747 existing records from primary storage. [2025-10-02T17:53:55.530183] [INFO ] [MAIN ] CAPL: Loaded 5747 existing records. [2025-10-02T17:53:55.731866] [WARN ] [MAIN ] CAPL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:53:55.732074] [INFO ] [MAIN ] CAPL: Wiping existing primary data before full refresh. [2025-10-02T17:53:55.732122] [INFO ] [LOCAL ] CAPL: Starting deletion of primary data. [2025-10-02T17:53:55.732475] [DEBUG] [LOCAL ] CAPL: Deleted primary data file. [2025-10-02T17:53:55.732537] [INFO ] [MAIN ] CAPL: Starting full primary refresh. [2025-10-02T17:53:56.125621] [INFO ] [REMOTE ] CAPL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:53:56.273015] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2024-12. [2025-10-02T17:53:56.402773] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-02T17:53:56.404866] [INFO ] [REMOTE ] CAG: Full fetch complete (77652 records). [2025-10-02T17:53:56.404987] [DEBUG] [VALIDATOR ] CAG: Validating primary data. [2025-10-02T17:53:56.859113] [DEBUG] [VALIDATOR ] CAG: All expected trading days are present. [2025-10-02T17:53:56.859227] [DEBUG] [VALIDATOR ] CAG: Primary data validation passed. [2025-10-02T17:53:56.860116] [INFO ] [MAIN ] CAG: Fetched primary data is valid. [2025-10-02T17:53:56.860316] [DEBUG] [LOCAL ] CAG: Saving primary data. [2025-10-02T17:53:56.888263] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-02T17:53:56.896926] [DEBUG] [LOCAL ] CAG: Trimmed 77652 records to 54053 (keeping 200 days of data) [2025-10-02T17:53:57.090276] [INFO ] [REMOTE ] CANG: Fetching primary data for 2024-12. [2025-10-02T17:53:57.136898] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-02T17:53:57.263907] [DEBUG] [LOCAL ] CAG: Primary data saved (54053 records). [2025-10-02T17:53:57.264058] [INFO ] [MAIN ] CAG: Full history saved. [2025-10-02T17:53:57.264152] [INFO ] [MAIN ] Update Progress: 390/2370 symbols completed. CAG took 39.2s. Estimated remaining: 4h 33m 36s. Rate: 7.2 symbols/min [2025-10-02T17:53:57.451026] [INFO ] [MAIN ] CARR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:53:57.508744] [DEBUG] [LOCAL ] CARR: Loaded 53594 existing records from primary storage. [2025-10-02T17:53:57.509108] [INFO ] [MAIN ] CARR: Loaded 53594 existing records. [2025-10-02T17:53:57.736155] [WARN ] [MAIN ] CARR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:53:57.736428] [INFO ] [MAIN ] CARR: Wiping existing primary data before full refresh. [2025-10-02T17:53:57.736477] [INFO ] [LOCAL ] CARR: Starting deletion of primary data. [2025-10-02T17:53:57.739327] [DEBUG] [LOCAL ] CARR: Deleted primary data file. [2025-10-02T17:53:57.739393] [INFO ] [MAIN ] CARR: Starting full primary refresh. [2025-10-02T17:53:57.878258] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-04. [2025-10-02T17:53:58.239803] [INFO ] [REMOTE ] CARR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:53:58.673059] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-01. [2025-10-02T17:53:58.727278] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-02T17:53:59.191588] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-02T17:53:59.472987] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-02. [2025-10-02T17:53:59.549601] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-02T17:54:00.060519] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-02T17:54:00.273044] [INFO ] [REMOTE ] CARR: Fetching primary data for 2024-12. [2025-10-02T17:54:01.073013] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-03. [2025-10-02T17:54:01.873002] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-01. [2025-10-02T17:54:02.188688] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-02T17:54:02.326932] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-02T17:54:02.673025] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-05. [2025-10-02T17:54:02.846802] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-02T17:54:03.473013] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-01. [2025-10-02T17:54:04.145782] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-02T17:54:04.273079] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-04. [2025-10-02T17:54:04.900526] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-02T17:54:04.976365] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-02T17:54:05.073011] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-05. [2025-10-02T17:54:05.748390] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-02T17:54:05.873000] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-06. [2025-10-02T17:54:06.673001] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-02. [2025-10-02T17:54:07.278319] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-02T17:54:07.473012] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-07. [2025-10-02T17:54:08.273007] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-02. [2025-10-02T17:54:08.400045] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-02T17:54:09.014379] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-02T17:54:09.072970] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-08. [2025-10-02T17:54:09.564459] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-02T17:54:09.872999] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-03. [2025-10-02T17:54:10.166217] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-02T17:54:10.673059] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-09. [2025-10-02T17:54:11.237517] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-02T17:54:11.473035] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-06. [2025-10-02T17:54:12.045013] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-02T17:54:12.206408] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-02T17:54:12.273022] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-10. [2025-10-02T17:54:13.073011] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-03. [2025-10-02T17:54:13.491892] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-02T17:54:13.493482] [INFO ] [REMOTE ] CALX: Full fetch complete (54030 records). [2025-10-02T17:54:13.493580] [DEBUG] [VALIDATOR ] CALX: Validating primary data. [2025-10-02T17:54:13.880399] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-07. [2025-10-02T17:54:13.916710] [DEBUG] [VALIDATOR ] CALX: All expected trading days are present. [2025-10-02T17:54:13.916825] [DEBUG] [VALIDATOR ] CALX: Primary data validation passed. [2025-10-02T17:54:13.917760] [INFO ] [MAIN ] CALX: Fetched primary data is valid. [2025-10-02T17:54:13.917929] [DEBUG] [LOCAL ] CALX: Saving primary data. [2025-10-02T17:54:13.919561] [DEBUG] [LOCAL ] CALX: Trimmed 54030 records to 38123 (keeping 200 days of data) [2025-10-02T17:54:14.151528] [DEBUG] [LOCAL ] CALX: Primary data saved (38123 records). [2025-10-02T17:54:14.151706] [INFO ] [MAIN ] CALX: Full history saved. [2025-10-02T17:54:14.151809] [INFO ] [MAIN ] Update Progress: 391/2370 symbols completed. CALX took 26.1s. Estimated remaining: 4h 34m 11s. Rate: 7.2 symbols/min [2025-10-02T17:54:14.335724] [INFO ] [MAIN ] CARS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:54:14.376194] [DEBUG] [LOCAL ] CARS: Loaded 39803 existing records from primary storage. [2025-10-02T17:54:14.376528] [INFO ] [MAIN ] CARS: Loaded 39803 existing records. [2025-10-02T17:54:14.585290] [WARN ] [MAIN ] CARS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:54:14.585626] [INFO ] [MAIN ] CARS: Wiping existing primary data before full refresh. [2025-10-02T17:54:14.585720] [INFO ] [LOCAL ] CARS: Starting deletion of primary data. [2025-10-02T17:54:14.587124] [DEBUG] [LOCAL ] CARS: Deleted primary data file. [2025-10-02T17:54:14.587192] [INFO ] [MAIN ] CARS: Starting full primary refresh. [2025-10-02T17:54:14.676145] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-04. [2025-10-02T17:54:14.709040] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-02T17:54:15.024311] [INFO ] [REMOTE ] CARS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:54:15.056828] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-02T17:54:15.473024] [INFO ] [REMOTE ] CARS: Fetching primary data for 2024-12. [2025-10-02T17:54:15.867564] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-02T17:54:16.273006] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-05. [2025-10-02T17:54:16.927671] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-02T17:54:17.072981] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-08. [2025-10-02T17:54:17.124479] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-02T17:54:17.680337] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-02T17:54:17.873010] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-09. [2025-10-02T17:54:18.444904] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-02T17:54:18.673008] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-06. [2025-10-02T17:54:19.473019] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-04. [2025-10-02T17:54:20.058852] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-02T17:54:20.273005] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-10. [2025-10-02T17:54:20.914060] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-02T17:54:20.915015] [INFO ] [REMOTE ] CAPL: Full fetch complete (8829 records). [2025-10-02T17:54:20.915097] [DEBUG] [VALIDATOR ] CAPL: Validating primary data. [2025-10-02T17:54:21.080059] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-07. [2025-10-02T17:54:21.333302] [DEBUG] [VALIDATOR ] CAPL: All expected trading days are present. [2025-10-02T17:54:21.333554] [DEBUG] [VALIDATOR ] CAPL: Primary data validation passed. [2025-10-02T17:54:21.333853] [INFO ] [MAIN ] CAPL: Fetched primary data is valid. [2025-10-02T17:54:21.333933] [DEBUG] [LOCAL ] CAPL: Saving primary data. [2025-10-02T17:54:21.334892] [DEBUG] [LOCAL ] CAPL: Trimmed 8829 records to 5818 (keeping 200 days of data) [2025-10-02T17:54:21.373461] [DEBUG] [LOCAL ] CAPL: Primary data saved (5818 records). [2025-10-02T17:54:21.373773] [INFO ] [MAIN ] CAPL: Full history saved. [2025-10-02T17:54:21.373889] [INFO ] [MAIN ] Update Progress: 392/2370 symbols completed. CAPL took 26.0s. Estimated remaining: 4h 33m 57s. Rate: 7.2 symbols/min [2025-10-02T17:54:21.562074] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-02T17:54:21.649224] [INFO ] [MAIN ] CAT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:54:21.706595] [DEBUG] [LOCAL ] CAT: Loaded 52920 existing records from primary storage. [2025-10-02T17:54:21.706993] [INFO ] [MAIN ] CAT: Loaded 52920 existing records. [2025-10-02T17:54:21.881704] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-05. [2025-10-02T17:54:21.914593] [WARN ] [MAIN ] CAT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:54:21.914825] [INFO ] [MAIN ] CAT: Wiping existing primary data before full refresh. [2025-10-02T17:54:21.914874] [INFO ] [LOCAL ] CAT: Starting deletion of primary data. [2025-10-02T17:54:21.917111] [DEBUG] [LOCAL ] CAT: Deleted primary data file. [2025-10-02T17:54:21.917178] [INFO ] [MAIN ] CAT: Starting full primary refresh. [2025-10-02T17:54:22.336891] [INFO ] [REMOTE ] CAT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:54:22.565046] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-02T17:54:22.673019] [INFO ] [REMOTE ] CAT: Fetching primary data for 2024-12. [2025-10-02T17:54:23.473011] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-01. [2025-10-02T17:54:23.689523] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-02T17:54:24.273007] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-08. [2025-10-02T17:54:24.463576] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-02T17:54:24.743063] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-02T17:54:25.072975] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-02. [2025-10-02T17:54:25.114576] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-02T17:54:25.873027] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-09. [2025-10-02T17:54:26.393607] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-02T17:54:26.672985] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-01. [2025-10-02T17:54:26.834227] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-02T17:54:27.472992] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-10. [2025-10-02T17:54:28.273013] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-06. [2025-10-02T17:54:28.577621] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-02T17:54:28.579082] [INFO ] [REMOTE ] CANG: Full fetch complete (40533 records). [2025-10-02T17:54:28.579164] [DEBUG] [VALIDATOR ] CANG: Validating primary data. [2025-10-02T17:54:29.016369] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-10-02T17:54:29.051883] [DEBUG] [VALIDATOR ] CANG: All expected trading days are present. [2025-10-02T17:54:29.051980] [DEBUG] [VALIDATOR ] CANG: Primary data validation passed. [2025-10-02T17:54:29.052534] [INFO ] [MAIN ] CANG: Fetched primary data is valid. [2025-10-02T17:54:29.052576] [DEBUG] [LOCAL ] CANG: Saving primary data. [2025-10-02T17:54:29.053546] [DEBUG] [LOCAL ] CANG: Trimmed 40533 records to 27199 (keeping 200 days of data) [2025-10-02T17:54:29.097955] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-02. [2025-10-02T17:54:29.210916] [DEBUG] [LOCAL ] CANG: Primary data saved (27199 records). [2025-10-02T17:54:29.211066] [INFO ] [MAIN ] CANG: Full history saved. [2025-10-02T17:54:29.211150] [INFO ] [MAIN ] Update Progress: 393/2370 symbols completed. CANG took 35.5s. Estimated remaining: 4h 33m 47s. Rate: 7.2 symbols/min [2025-10-02T17:54:29.392090] [INFO ] [MAIN ] CATO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:54:29.401559] [DEBUG] [LOCAL ] CATO: Loaded 7016 existing records from primary storage. [2025-10-02T17:54:29.401810] [INFO ] [MAIN ] CATO: Loaded 7016 existing records. [2025-10-02T17:54:29.599575] [WARN ] [MAIN ] CATO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:54:29.600111] [INFO ] [MAIN ] CATO: Wiping existing primary data before full refresh. [2025-10-02T17:54:29.600173] [INFO ] [LOCAL ] CATO: Starting deletion of primary data. [2025-10-02T17:54:29.600562] [DEBUG] [LOCAL ] CATO: Deleted primary data file. [2025-10-02T17:54:29.600688] [INFO ] [MAIN ] CATO: Starting full primary refresh. [2025-10-02T17:54:29.878865] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-03. [2025-10-02T17:54:30.012946] [INFO ] [REMOTE ] CATO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:54:30.046683] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-02T17:54:30.673003] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-07. [2025-10-02T17:54:31.197752] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-02T17:54:31.245153] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-02T17:54:31.472987] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-04. [2025-10-02T17:54:32.272975] [INFO ] [REMOTE ] CATO: Fetching primary data for 2024-12. [2025-10-02T17:54:32.685068] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-02T17:54:33.019077] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-02T17:54:33.072994] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-03. [2025-10-02T17:54:33.119753] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-02T17:54:33.872993] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-01. [2025-10-02T17:54:34.603020] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-02T17:54:34.673009] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-08. [2025-10-02T17:54:35.377486] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-10-02T17:54:35.472997] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-04. [2025-10-02T17:54:36.272976] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-02. [2025-10-02T17:54:36.469482] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-02T17:54:36.686738] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-02T17:54:37.073004] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-09. [2025-10-02T17:54:37.743159] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-02T17:54:37.873030] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-03. [2025-10-02T17:54:38.663022] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-02T17:54:38.672950] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-05. [2025-10-02T17:54:39.027060] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-02T17:54:39.472988] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-04. [2025-10-02T17:54:39.750061] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-02T17:54:40.218163] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-02T17:54:40.272991] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-05. [2025-10-02T17:54:40.906807] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-02T17:54:41.072980] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-06. [2025-10-02T17:54:41.553701] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-02T17:54:41.872999] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-10. [2025-10-02T17:54:42.673038] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-05. [2025-10-02T17:54:43.472999] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-07. [2025-10-02T17:54:43.547614] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-02T17:54:43.550195] [INFO ] [REMOTE ] CARR: Full fetch complete (77607 records). [2025-10-02T17:54:43.550344] [DEBUG] [VALIDATOR ] CARR: Validating primary data. [2025-10-02T17:54:43.972541] [DEBUG] [VALIDATOR ] CARR: All expected trading days are present. [2025-10-02T17:54:43.972890] [DEBUG] [VALIDATOR ] CARR: Primary data validation passed. [2025-10-02T17:54:43.974096] [INFO ] [MAIN ] CARR: Fetched primary data is valid. [2025-10-02T17:54:43.974172] [DEBUG] [LOCAL ] CARR: Saving primary data. [2025-10-02T17:54:43.977063] [DEBUG] [LOCAL ] CARR: Trimmed 77607 records to 53984 (keeping 200 days of data) [2025-10-02T17:54:44.081694] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-02T17:54:44.285331] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-08. [2025-10-02T17:54:44.342069] [DEBUG] [LOCAL ] CARR: Primary data saved (53984 records). [2025-10-02T17:54:44.342226] [INFO ] [MAIN ] CARR: Full history saved. [2025-10-02T17:54:44.342326] [INFO ] [MAIN ] Update Progress: 394/2370 symbols completed. CARR took 47.1s. Estimated remaining: 4h 34m 13s. Rate: 7.2 symbols/min [2025-10-02T17:54:44.528950] [INFO ] [MAIN ] CAVA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:54:44.566947] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-02T17:54:44.628434] [DEBUG] [LOCAL ] CAVA: Loaded 53552 existing records from primary storage. [2025-10-02T17:54:44.628799] [INFO ] [MAIN ] CAVA: Loaded 53552 existing records. [2025-10-02T17:54:44.816003] [WARN ] [MAIN ] CAVA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:54:44.816402] [INFO ] [MAIN ] CAVA: Wiping existing primary data before full refresh. [2025-10-02T17:54:44.816466] [INFO ] [LOCAL ] CAVA: Starting deletion of primary data. [2025-10-02T17:54:44.818572] [DEBUG] [LOCAL ] CAVA: Deleted primary data file. [2025-10-02T17:54:44.818636] [INFO ] [MAIN ] CAVA: Starting full primary refresh. [2025-10-02T17:54:45.073095] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-06. [2025-10-02T17:54:45.060246] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-02T17:54:45.225952] [INFO ] [REMOTE ] CAVA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:54:45.873007] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-06. [2025-10-02T17:54:46.664355] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-02T17:54:46.672962] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-07. [2025-10-02T17:54:47.473014] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-09. [2025-10-02T17:54:47.790158] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-02T17:54:47.952156] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-02T17:54:48.223760] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-02T17:54:48.272995] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-10. [2025-10-02T17:54:48.967151] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-02T17:54:48.968070] [INFO ] [REMOTE ] CATO: Full fetch complete (11518 records). [2025-10-02T17:54:48.968143] [DEBUG] [VALIDATOR ] CATO: Validating primary data. [2025-10-02T17:54:49.076723] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-07. [2025-10-02T17:54:49.362466] [DEBUG] [VALIDATOR ] CATO: All expected trading days are present. [2025-10-02T17:54:49.362581] [DEBUG] [VALIDATOR ] CATO: Primary data validation passed. [2025-10-02T17:54:49.362929] [INFO ] [MAIN ] CATO: Fetched primary data is valid. [2025-10-02T17:54:49.363001] [DEBUG] [LOCAL ] CATO: Saving primary data. [2025-10-02T17:54:49.363478] [DEBUG] [LOCAL ] CATO: Trimmed 11518 records to 7127 (keeping 200 days of data) [2025-10-02T17:54:49.404484] [DEBUG] [LOCAL ] CATO: Primary data saved (7127 records). [2025-10-02T17:54:49.404601] [INFO ] [MAIN ] CATO: Full history saved. [2025-10-02T17:54:49.404711] [INFO ] [MAIN ] Update Progress: 395/2370 symbols completed. CATO took 20.2s. Estimated remaining: 4h 33m 48s. Rate: 7.2 symbols/min [2025-10-02T17:54:49.597479] [INFO ] [MAIN ] CB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:54:49.662280] [DEBUG] [LOCAL ] CB: Loaded 49947 existing records from primary storage. [2025-10-02T17:54:49.662634] [INFO ] [MAIN ] CB: Loaded 49947 existing records. [2025-10-02T17:54:49.859048] [WARN ] [MAIN ] CB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:54:49.859315] [INFO ] [MAIN ] CB: Wiping existing primary data before full refresh. [2025-10-02T17:54:49.859378] [INFO ] [LOCAL ] CB: Starting deletion of primary data. [2025-10-02T17:54:49.861338] [DEBUG] [LOCAL ] CB: Deleted primary data file. [2025-10-02T17:54:49.861415] [INFO ] [MAIN ] CB: Starting full primary refresh. [2025-10-02T17:54:49.883385] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-08. [2025-10-02T17:54:50.253992] [INFO ] [REMOTE ] CB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:54:50.673053] [INFO ] [REMOTE ] CB: Fetching primary data for 2024-12. [2025-10-02T17:54:51.324006] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-02T17:54:51.472309] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-02T17:54:51.480513] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-08. [2025-10-02T17:54:52.132543] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-02T17:54:52.273043] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2024-12. [2025-10-02T17:54:53.073001] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-09. [2025-10-02T17:54:53.701856] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-02T17:54:53.873000] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-09. [2025-10-02T17:54:54.521515] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-10-02T17:54:54.535799] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-02T17:54:54.673008] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-01. [2025-10-02T17:54:55.473021] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-01. [2025-10-02T17:54:55.896909] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-02T17:54:56.154928] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-02T17:54:56.273060] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-10. [2025-10-02T17:54:57.073064] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-10. [2025-10-02T17:54:57.272580] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-02T17:54:57.873026] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-02. [2025-10-02T17:54:58.192446] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-02T17:54:58.194571] [INFO ] [REMOTE ] CAT: Full fetch complete (76685 records). [2025-10-02T17:54:58.194759] [DEBUG] [VALIDATOR ] CAT: Validating primary data. [2025-10-02T17:54:58.331502] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-02T17:54:58.354592] [INFO ] [REMOTE ] CARS: Full fetch complete (55453 records). [2025-10-02T17:54:58.383163] [DEBUG] [VALIDATOR ] CARS: Validating primary data. [2025-10-02T17:54:58.673670] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-02. [2025-10-02T17:54:58.881024] [DEBUG] [VALIDATOR ] CAT: All expected trading days are present. [2025-10-02T17:54:58.896833] [DEBUG] [VALIDATOR ] CAT: Primary data validation passed. [2025-10-02T17:54:58.897947] [INFO ] [MAIN ] CAT: Fetched primary data is valid. [2025-10-02T17:54:58.903203] [DEBUG] [LOCAL ] CAT: Saving primary data. [2025-10-02T17:54:59.023500] [DEBUG] [LOCAL ] CAT: Trimmed 76685 records to 53308 (keeping 200 days of data) [2025-10-02T17:54:59.211139] [DEBUG] [VALIDATOR ] CARS: All expected trading days are present. [2025-10-02T17:54:59.212518] [DEBUG] [VALIDATOR ] CARS: Primary data validation passed. [2025-10-02T17:54:59.213124] [INFO ] [MAIN ] CARS: Fetched primary data is valid. [2025-10-02T17:54:59.213203] [DEBUG] [LOCAL ] CARS: Saving primary data. [2025-10-02T17:54:59.219208] [DEBUG] [LOCAL ] CARS: Trimmed 55453 records to 40093 (keeping 200 days of data) [2025-10-02T17:54:59.707412] [DEBUG] [LOCAL ] CARS: Primary data saved (40093 records). [2025-10-02T17:54:59.708441] [INFO ] [MAIN ] CARS: Full history saved. [2025-10-02T17:54:59.708918] [INFO ] [MAIN ] Update Progress: 396/2370 symbols completed. CARS took 45.6s. Estimated remaining: 4h 33m 50s. Rate: 7.2 symbols/min [2025-10-02T17:54:59.912412] [INFO ] [MAIN ] CBAN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:54:59.925476] [DEBUG] [LOCAL ] CAT: Primary data saved (53308 records). [2025-10-02T17:54:59.925736] [INFO ] [MAIN ] CAT: Full history saved. [2025-10-02T17:54:59.927180] [INFO ] [MAIN ] Update Progress: 397/2370 symbols completed. CAT took 38.6s. Estimated remaining: 4h 33m 1s. Rate: 7.2 symbols/min [2025-10-02T17:54:59.932501] [DEBUG] [LOCAL ] CBAN: Loaded 10857 existing records from primary storage. [2025-10-02T17:54:59.932779] [INFO ] [MAIN ] CBAN: Loaded 10857 existing records. [2025-10-02T17:55:00.132881] [WARN ] [MAIN ] CBAN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:55:00.133519] [INFO ] [MAIN ] CBAN: Wiping existing primary data before full refresh. [2025-10-02T17:55:00.172153] [INFO ] [LOCAL ] CBAN: Starting deletion of primary data. [2025-10-02T17:55:00.173291] [DEBUG] [LOCAL ] CBAN: Deleted primary data file. [2025-10-02T17:55:00.174557] [INFO ] [MAIN ] CBAN: Starting full primary refresh. [2025-10-02T17:55:00.174433] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-10-02T17:55:00.245937] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-03. [2025-10-02T17:55:00.262789] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-02T17:55:00.325071] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-03. [2025-10-02T17:55:00.626869] [INFO ] [REMOTE ] CBAN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:55:01.072991] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2024-12. [2025-10-02T17:55:02.079876] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-02T17:55:02.082484] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-01. [2025-10-02T17:55:02.515498] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-02T17:55:02.663316] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-10-02T17:55:02.675430] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-04. [2025-10-02T17:55:02.687499] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-02T17:55:03.473006] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-02. [2025-10-02T17:55:04.273046] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-04. [2025-10-02T17:55:04.342351] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-02T17:55:04.986585] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-02T17:55:05.073016] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-03. [2025-10-02T17:55:05.873002] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-05. [2025-10-02T17:55:06.083937] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-02T17:55:06.448839] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-02T17:55:06.673043] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-04. [2025-10-02T17:55:07.474452] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-05. [2025-10-02T17:55:07.653689] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-02T17:55:07.654251] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-02T17:55:08.273030] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-05. [2025-10-02T17:55:09.072967] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-06. [2025-10-02T17:55:09.102360] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-02T17:55:09.582355] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-02T17:55:09.873023] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-06. [2025-10-02T17:55:10.559057] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-02T17:55:10.649529] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-02T17:55:10.672961] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-07. [2025-10-02T17:55:11.453676] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-02T17:55:11.472973] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-08. [2025-10-02T17:55:12.181114] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-02T17:55:12.273001] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-07. [2025-10-02T17:55:13.073060] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-06. [2025-10-02T17:55:13.872983] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-09. [2025-10-02T17:55:14.211709] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-02T17:55:14.642314] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-02T17:55:14.672962] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-08. [2025-10-02T17:55:15.075236] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-02T17:55:15.473045] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-10. [2025-10-02T17:55:16.015617] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-02T17:55:16.016464] [INFO ] [REMOTE ] CBAN: Full fetch complete (16082 records). [2025-10-02T17:55:16.016539] [DEBUG] [VALIDATOR ] CBAN: Validating primary data. [2025-10-02T17:55:16.017038] [FATAL] [VALIDATOR ] CBAN: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:55:16.017147] [FATAL] [MAIN ] CBAN: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:55:16.017221] [WARN ] [MAIN ] CBAN: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:55:16.017291] [INFO ] [LOCAL ] CBAN: Starting deletion of primary data. [2025-10-02T17:55:16.017356] [DEBUG] [LOCAL ] CBAN: No primary data file found to delete. [2025-10-02T17:55:16.017396] [INFO ] [LOCAL ] CBAN: Starting deletion of derivative data. [2025-10-02T17:55:16.017797] [DEBUG] [LOCAL ] CBAN: Deleted derivative data file. [2025-10-02T17:55:16.017892] [INFO ] [MAIN ] Update Progress: 398/2370 symbols completed. CBAN took 16.3s. Estimated remaining: 4h 33m 31s. Rate: 7.2 symbols/min [2025-10-02T17:55:16.273045] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-07. [2025-10-02T17:55:16.523727] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-02T17:55:17.073044] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-09. [2025-10-02T17:55:18.191102] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-02T17:55:18.202900] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-08. [2025-10-02T17:55:18.513273] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-02T17:55:18.673032] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-10. [2025-10-02T17:55:20.167724] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-02T17:55:20.169924] [INFO ] [REMOTE ] CB: Full fetch complete (72650 records). [2025-10-02T17:55:20.170023] [DEBUG] [VALIDATOR ] CB: Validating primary data. [2025-10-02T17:55:20.677351] [DEBUG] [VALIDATOR ] CB: All expected trading days are present. [2025-10-02T17:55:20.677238] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-10-02T17:55:20.677503] [DEBUG] [VALIDATOR ] CB: Primary data validation passed. [2025-10-02T17:55:20.690236] [INFO ] [MAIN ] CB: Fetched primary data is valid. [2025-10-02T17:55:20.690866] [DEBUG] [LOCAL ] CB: Saving primary data. [2025-10-02T17:55:20.692765] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-09. [2025-10-02T17:55:20.694389] [DEBUG] [LOCAL ] CB: Trimmed 72650 records to 50296 (keeping 200 days of data) [2025-10-02T17:55:21.034451] [DEBUG] [LOCAL ] CB: Primary data saved (50296 records). [2025-10-02T17:55:21.034596] [INFO ] [MAIN ] CB: Full history saved. [2025-10-02T17:55:21.034738] [INFO ] [MAIN ] Update Progress: 399/2370 symbols completed. CB took 31.6s. Estimated remaining: 4h 33m 7s. Rate: 7.2 symbols/min [2025-10-02T17:55:22.763524] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-02T17:55:22.778046] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-10. [2025-10-02T17:55:24.641447] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-02T17:55:24.644236] [INFO ] [REMOTE ] CAVA: Full fetch complete (77298 records). [2025-10-02T17:55:24.644388] [DEBUG] [VALIDATOR ] CAVA: Validating primary data. [2025-10-02T17:55:25.079997] [DEBUG] [VALIDATOR ] CAVA: All expected trading days are present. [2025-10-02T17:55:25.080091] [DEBUG] [VALIDATOR ] CAVA: Primary data validation passed. [2025-10-02T17:55:25.080921] [INFO ] [MAIN ] CAVA: Fetched primary data is valid. [2025-10-02T17:55:25.081046] [DEBUG] [LOCAL ] CAVA: Saving primary data. [2025-10-02T17:55:25.082633] [DEBUG] [LOCAL ] CAVA: Trimmed 77298 records to 53942 (keeping 200 days of data) [2025-10-02T17:55:25.428676] [DEBUG] [LOCAL ] CAVA: Primary data saved (53942 records). [2025-10-02T17:55:25.428848] [INFO ] [MAIN ] CAVA: Full history saved. [2025-10-02T17:55:25.429081] [INFO ] [MAIN ] Update Progress: 400/2370 symbols completed. CAVA took 41.1s. Estimated remaining: 4h 32m 39s. Rate: 7.2 symbols/min [2025-10-02T17:55:26.133390] [INFO ] [MAIN ] CBO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:55:26.126782] [INFO ] [MAIN ] CBRE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:55:26.181822] [DEBUG] [LOCAL ] CBO: No existing data file found in primary storage. [2025-10-02T17:55:26.235167] [WARN ] [MAIN ] CBO: No existing data found, performing full refresh instead. [2025-10-02T17:55:26.240701] [INFO ] [MAIN ] CBNA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:55:26.255620] [INFO ] [MAIN ] CBO: Wiping existing primary data before full refresh. [2025-10-02T17:55:26.335515] [INFO ] [MAIN ] CBL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:55:26.335798] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-02T17:55:26.336596] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-02T17:55:26.337292] [INFO ] [MAIN ] CBO: Starting full primary refresh. [2025-10-02T17:55:26.421918] [DEBUG] [LOCAL ] CBNA: Loaded 2915 existing records from primary storage. [2025-10-02T17:55:26.455283] [INFO ] [MAIN ] CBNA: Loaded 2915 existing records. [2025-10-02T17:55:26.589174] [DEBUG] [LOCAL ] CBL: Loaded 16243 existing records from primary storage. [2025-10-02T17:55:26.660062] [INFO ] [MAIN ] CBL: Loaded 16243 existing records. [2025-10-02T17:55:26.748479] [DEBUG] [LOCAL ] CBRE: Loaded 50580 existing records from primary storage. [2025-10-02T17:55:26.841596] [INFO ] [MAIN ] CBRE: Loaded 50580 existing records. [2025-10-02T17:55:27.117234] [WARN ] [MAIN ] CBNA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:55:27.136963] [INFO ] [MAIN ] CBNA: Wiping existing primary data before full refresh. [2025-10-02T17:55:27.190781] [INFO ] [LOCAL ] CBNA: Starting deletion of primary data. [2025-10-02T17:55:27.277399] [DEBUG] [LOCAL ] CBNA: Deleted primary data file. [2025-10-02T17:55:27.314352] [INFO ] [MAIN ] CBNA: Starting full primary refresh. [2025-10-02T17:55:27.392577] [INFO ] [REMOTE ] CBO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:55:27.436220] [INFO ] [REMOTE ] CBO: Fetching primary data for 2024-12. [2025-10-02T17:55:27.500169] [WARN ] [MAIN ] CBL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:55:27.581879] [INFO ] [MAIN ] CBL: Wiping existing primary data before full refresh. [2025-10-02T17:55:27.598380] [INFO ] [LOCAL ] CBL: Starting deletion of primary data. [2025-10-02T17:55:27.608454] [DEBUG] [LOCAL ] CBL: Deleted primary data file. [2025-10-02T17:55:27.576420] [WARN ] [MAIN ] CBRE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:55:27.608621] [INFO ] [MAIN ] CBL: Starting full primary refresh. [2025-10-02T17:55:27.614268] [INFO ] [MAIN ] CBRE: Wiping existing primary data before full refresh. [2025-10-02T17:55:27.678547] [INFO ] [LOCAL ] CBRE: Starting deletion of primary data. [2025-10-02T17:55:27.792122] [DEBUG] [LOCAL ] CBRE: Deleted primary data file. [2025-10-02T17:55:27.843159] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T17:55:27.861371] [INFO ] [MAIN ] CBRE: Starting full primary refresh. [2025-10-02T17:55:27.885608] [WARN ] [REMOTE ] CBO: No data returned for month 2024-12 [2025-10-02T17:55:28.139025] [FATAL] [REMOTE ] CBO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T17:55:28.181700] [FATAL] [MAIN ] CBO: Failed to fetch primary data. [2025-10-02T17:55:28.193576] [WARN ] [MAIN ] CBO: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T17:55:28.209362] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-02T17:55:28.295941] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-02T17:55:28.301738] [INFO ] [LOCAL ] CBO: Starting deletion of derivative data. [2025-10-02T17:55:28.405973] [INFO ] [REMOTE ] CBNA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:55:28.353623] [DEBUG] [LOCAL ] CBO: No derivative data file found to delete. [2025-10-02T17:55:28.411673] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2024-12. [2025-10-02T17:55:28.412600] [INFO ] [MAIN ] Update Progress: 401/2370 symbols completed. CBO took 3.0s. Estimated remaining: 4h 32m 5s. Rate: 7.2 symbols/min [2025-10-02T17:55:28.678135] [INFO ] [REMOTE ] CBL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:55:28.751824] [INFO ] [REMOTE ] CBL: Fetching primary data for 2024-12. [2025-10-02T17:55:28.969779] [INFO ] [MAIN ] CBT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:55:29.020554] [INFO ] [REMOTE ] CBRE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:55:29.021038] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2024-12. [2025-10-02T17:55:29.049891] [DEBUG] [LOCAL ] CBT: Loaded 30845 existing records from primary storage. [2025-10-02T17:55:29.050256] [INFO ] [MAIN ] CBT: Loaded 30845 existing records. [2025-10-02T17:55:29.255185] [WARN ] [MAIN ] CBT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:55:29.260843] [INFO ] [MAIN ] CBT: Wiping existing primary data before full refresh. [2025-10-02T17:55:29.260971] [INFO ] [LOCAL ] CBT: Starting deletion of primary data. [2025-10-02T17:55:29.260717] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-02T17:55:29.262957] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-01. [2025-10-02T17:55:29.263044] [DEBUG] [LOCAL ] CBT: Deleted primary data file. [2025-10-02T17:55:29.263976] [INFO ] [MAIN ] CBT: Starting full primary refresh. [2025-10-02T17:55:29.674210] [INFO ] [REMOTE ] CBT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:55:29.674717] [INFO ] [REMOTE ] CBT: Fetching primary data for 2024-12. [2025-10-02T17:55:29.760053] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-02T17:55:29.761948] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-02. [2025-10-02T17:55:30.045505] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-02T17:55:30.050557] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-01. [2025-10-02T17:55:30.225725] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-02T17:55:30.227103] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-03. [2025-10-02T17:55:30.882632] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-02T17:55:30.893484] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-01. [2025-10-02T17:55:30.906458] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-02T17:55:30.907890] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-04. [2025-10-02T17:55:31.007163] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-02T17:55:31.012191] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-02. [2025-10-02T17:55:31.104613] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-02T17:55:31.111583] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-01. [2025-10-02T17:55:31.357567] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-02T17:55:31.472998] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-05. [2025-10-02T17:55:32.052357] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-02T17:55:32.060812] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-02T17:55:32.272967] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-06. [2025-10-02T17:55:32.355313] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-02T17:55:32.559016] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-02T17:55:32.606064] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-02T17:55:33.073004] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-02. [2025-10-02T17:55:33.873007] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-03. [2025-10-02T17:55:34.678124] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-07. [2025-10-02T17:55:34.696901] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-02T17:55:34.884804] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-02T17:55:35.159768] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-02T17:55:35.473004] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-08. [2025-10-02T17:55:36.026874] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-02T17:55:36.272994] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-02. [2025-10-02T17:55:37.072987] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-03. [2025-10-02T17:55:37.515693] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-02T17:55:37.872995] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-04. [2025-10-02T17:55:38.656631] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-02T17:55:38.672960] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-05. [2025-10-02T17:55:39.040005] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-02T17:55:39.472974] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-03. [2025-10-02T17:55:39.639493] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-02T17:55:40.273017] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-09. [2025-10-02T17:55:40.782791] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-02T17:55:40.804106] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-02T17:55:41.073063] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-04. [2025-10-02T17:55:41.873045] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-04. [2025-10-02T17:55:42.606778] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-02T17:55:42.673012] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-05. [2025-10-02T17:55:43.472987] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-10. [2025-10-02T17:55:43.796780] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-02T17:55:43.862230] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-02T17:55:44.178611] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-02T17:55:44.179409] [INFO ] [REMOTE ] CBNA: Full fetch complete (4581 records). [2025-10-02T17:55:44.179485] [DEBUG] [VALIDATOR ] CBNA: Validating primary data. [2025-10-02T17:55:44.278102] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-05. [2025-10-02T17:55:44.591120] [DEBUG] [VALIDATOR ] CBNA: All expected trading days are present. [2025-10-02T17:55:44.591202] [DEBUG] [VALIDATOR ] CBNA: Primary data validation passed. [2025-10-02T17:55:44.591359] [INFO ] [MAIN ] CBNA: Fetched primary data is valid. [2025-10-02T17:55:44.591403] [DEBUG] [LOCAL ] CBNA: Saving primary data. [2025-10-02T17:55:44.591893] [DEBUG] [LOCAL ] CBNA: Trimmed 4581 records to 2927 (keeping 200 days of data) [2025-10-02T17:55:44.609554] [DEBUG] [LOCAL ] CBNA: Primary data saved (2927 records). [2025-10-02T17:55:44.609687] [INFO ] [MAIN ] CBNA: Full history saved. [2025-10-02T17:55:44.609785] [INFO ] [MAIN ] Update Progress: 402/2370 symbols completed. CBNA took 19.2s. Estimated remaining: 4h 32m 35s. Rate: 7.2 symbols/min [2025-10-02T17:55:44.800211] [INFO ] [MAIN ] CBU: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:55:44.824078] [DEBUG] [LOCAL ] CBU: Loaded 22654 existing records from primary storage. [2025-10-02T17:55:44.824341] [INFO ] [MAIN ] CBU: Loaded 22654 existing records. [2025-10-02T17:55:45.028787] [WARN ] [MAIN ] CBU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:55:45.029053] [INFO ] [MAIN ] CBU: Wiping existing primary data before full refresh. [2025-10-02T17:55:45.029103] [INFO ] [LOCAL ] CBU: Starting deletion of primary data. [2025-10-02T17:55:45.029783] [DEBUG] [LOCAL ] CBU: Deleted primary data file. [2025-10-02T17:55:45.029845] [INFO ] [MAIN ] CBU: Starting full primary refresh. [2025-10-02T17:55:45.078196] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-06. [2025-10-02T17:55:45.440846] [INFO ] [REMOTE ] CBU: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:55:45.872971] [INFO ] [REMOTE ] CBU: Fetching primary data for 2024-12. [2025-10-02T17:55:46.097465] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-02T17:55:46.161402] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-02T17:55:46.673047] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-06. [2025-10-02T17:55:46.963410] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-02T17:55:47.473025] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-01. [2025-10-02T17:55:48.272990] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-06. [2025-10-02T17:55:48.321350] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-02T17:55:48.554674] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-02T17:55:49.073016] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-02. [2025-10-02T17:55:49.325830] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-02T17:55:49.872994] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-07. [2025-10-02T17:55:50.090801] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-02T17:55:50.672996] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-07. [2025-10-02T17:55:51.478172] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-07. [2025-10-02T17:55:51.509452] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-02T17:55:51.937301] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-02T17:55:52.273015] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-08. [2025-10-02T17:55:52.486336] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-02T17:55:53.073005] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-03. [2025-10-02T17:55:53.873003] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-08. [2025-10-02T17:55:54.003493] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-02T17:55:54.034077] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-02T17:55:54.673079] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-09. [2025-10-02T17:55:54.979233] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-02T17:55:55.473023] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-04. [2025-10-02T17:55:56.272976] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-08. [2025-10-02T17:55:56.389176] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-02T17:55:56.553999] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-02T17:55:57.073013] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-09. [2025-10-02T17:55:57.444981] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-02T17:55:57.873033] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-09. [2025-10-02T17:55:58.030778] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-02T17:55:58.672974] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-10. [2025-10-02T17:55:59.072050] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-02T17:55:59.473061] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-05. [2025-10-02T17:55:59.571689] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-02T17:55:59.573019] [INFO ] [REMOTE ] CBL: Full fetch complete (25495 records). [2025-10-02T17:55:59.573133] [DEBUG] [VALIDATOR ] CBL: Validating primary data. [2025-10-02T17:56:00.123271] [DEBUG] [VALIDATOR ] CBL: All expected trading days are present. [2025-10-02T17:56:00.123366] [DEBUG] [VALIDATOR ] CBL: Primary data validation passed. [2025-10-02T17:56:00.123905] [INFO ] [MAIN ] CBL: Fetched primary data is valid. [2025-10-02T17:56:00.123974] [DEBUG] [LOCAL ] CBL: Saving primary data. [2025-10-02T17:56:00.124916] [DEBUG] [LOCAL ] CBL: Trimmed 25495 records to 16371 (keeping 200 days of data) [2025-10-02T17:56:00.259996] [DEBUG] [LOCAL ] CBL: Primary data saved (16371 records). [2025-10-02T17:56:00.260185] [INFO ] [MAIN ] CBL: Full history saved. [2025-10-02T17:56:00.260303] [INFO ] [MAIN ] Update Progress: 403/2370 symbols completed. CBL took 34.8s. Estimated remaining: 4h 33m 2s. Rate: 7.2 symbols/min [2025-10-02T17:56:00.278248] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-10. [2025-10-02T17:56:00.466152] [INFO ] [MAIN ] CBX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:56:00.466383] [DEBUG] [LOCAL ] CBX: No existing data file found in primary storage. [2025-10-02T17:56:00.466439] [WARN ] [MAIN ] CBX: No existing data found, performing full refresh instead. [2025-10-02T17:56:00.466562] [INFO ] [MAIN ] CBX: Wiping existing primary data before full refresh. [2025-10-02T17:56:00.466604] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-02T17:56:00.466691] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-02T17:56:00.466763] [INFO ] [MAIN ] CBX: Starting full primary refresh. [2025-10-02T17:56:00.873506] [INFO ] [REMOTE ] CBX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:56:00.915345] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-02T17:56:01.072997] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-06. [2025-10-02T17:56:01.873059] [INFO ] [REMOTE ] CBX: Fetching primary data for 2024-12. [2025-10-02T17:56:01.974785] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-02T17:56:01.989898] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-02T17:56:01.989384] [INFO ] [REMOTE ] CBRE: Full fetch complete (73940 records). [2025-10-02T17:56:01.994157] [DEBUG] [VALIDATOR ] CBRE: Validating primary data. [2025-10-02T17:56:02.092840] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T17:56:02.130214] [WARN ] [REMOTE ] CBX: No data returned for month 2024-12 [2025-10-02T17:56:02.134511] [FATAL] [REMOTE ] CBX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T17:56:02.134962] [FATAL] [MAIN ] CBX: Failed to fetch primary data. [2025-10-02T17:56:02.145693] [WARN ] [MAIN ] CBX: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T17:56:02.156023] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-02T17:56:02.183623] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-02T17:56:02.200473] [INFO ] [LOCAL ] CBX: Starting deletion of derivative data. [2025-10-02T17:56:02.209913] [DEBUG] [LOCAL ] CBX: No derivative data file found to delete. [2025-10-02T17:56:02.239617] [INFO ] [MAIN ] Update Progress: 404/2370 symbols completed. CBX took 2.0s. Estimated remaining: 4h 32m 23s. Rate: 7.2 symbols/min [2025-10-02T17:56:02.671000] [DEBUG] [VALIDATOR ] CBRE: All expected trading days are present. [2025-10-02T17:56:02.674622] [INFO ] [MAIN ] CBZ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:56:02.674819] [DEBUG] [VALIDATOR ] CBRE: Primary data validation passed. [2025-10-02T17:56:02.675892] [INFO ] [MAIN ] CBRE: Fetched primary data is valid. [2025-10-02T17:56:02.676317] [DEBUG] [LOCAL ] CBRE: Saving primary data. [2025-10-02T17:56:02.672972] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-10. [2025-10-02T17:56:02.678977] [DEBUG] [LOCAL ] CBRE: Trimmed 73940 records to 50924 (keeping 200 days of data) [2025-10-02T17:56:02.821457] [DEBUG] [LOCAL ] CBZ: Loaded 33691 existing records from primary storage. [2025-10-02T17:56:02.831393] [INFO ] [MAIN ] CBZ: Loaded 33691 existing records. [2025-10-02T17:56:03.136025] [WARN ] [MAIN ] CBZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:56:03.140416] [INFO ] [MAIN ] CBZ: Wiping existing primary data before full refresh. [2025-10-02T17:56:03.152504] [INFO ] [LOCAL ] CBZ: Starting deletion of primary data. [2025-10-02T17:56:03.154606] [DEBUG] [LOCAL ] CBZ: Deleted primary data file. [2025-10-02T17:56:03.155807] [INFO ] [MAIN ] CBZ: Starting full primary refresh. [2025-10-02T17:56:03.474045] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-07. [2025-10-02T17:56:03.659793] [INFO ] [REMOTE ] CBZ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:56:03.666597] [DEBUG] [LOCAL ] CBRE: Primary data saved (50924 records). [2025-10-02T17:56:03.666738] [INFO ] [MAIN ] CBRE: Full history saved. [2025-10-02T17:56:03.666829] [INFO ] [MAIN ] Update Progress: 405/2370 symbols completed. CBRE took 38.2s. Estimated remaining: 4h 31m 42s. Rate: 7.2 symbols/min [2025-10-02T17:56:03.843609] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-02T17:56:03.865132] [INFO ] [MAIN ] CC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:56:03.867293] [INFO ] [REMOTE ] CBT: Full fetch complete (45741 records). [2025-10-02T17:56:03.867428] [DEBUG] [VALIDATOR ] CBT: Validating primary data. [2025-10-02T17:56:04.282081] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2024-12. [2025-10-02T17:56:04.290918] [DEBUG] [LOCAL ] CC: Loaded 53000 existing records from primary storage. [2025-10-02T17:56:04.329126] [INFO ] [MAIN ] CC: Loaded 53000 existing records. [2025-10-02T17:56:04.347953] [DEBUG] [VALIDATOR ] CBT: All expected trading days are present. [2025-10-02T17:56:04.348079] [DEBUG] [VALIDATOR ] CBT: Primary data validation passed. [2025-10-02T17:56:04.348861] [INFO ] [MAIN ] CBT: Fetched primary data is valid. [2025-10-02T17:56:04.348948] [DEBUG] [LOCAL ] CBT: Saving primary data. [2025-10-02T17:56:04.471828] [DEBUG] [LOCAL ] CBT: Trimmed 45741 records to 31073 (keeping 200 days of data) [2025-10-02T17:56:04.665031] [WARN ] [MAIN ] CC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:56:04.674066] [INFO ] [MAIN ] CC: Wiping existing primary data before full refresh. [2025-10-02T17:56:04.674299] [INFO ] [LOCAL ] CC: Starting deletion of primary data. [2025-10-02T17:56:04.696189] [DEBUG] [LOCAL ] CC: Deleted primary data file. [2025-10-02T17:56:04.696841] [INFO ] [MAIN ] CC: Starting full primary refresh. [2025-10-02T17:56:04.866400] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-02T17:56:05.080195] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-08. [2025-10-02T17:56:05.227347] [INFO ] [REMOTE ] CC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:56:05.230479] [DEBUG] [LOCAL ] CBT: Primary data saved (31073 records). [2025-10-02T17:56:05.230976] [INFO ] [MAIN ] CBT: Full history saved. [2025-10-02T17:56:05.231095] [INFO ] [MAIN ] Update Progress: 406/2370 symbols completed. CBT took 36.8s. Estimated remaining: 4h 31m 1s. Rate: 7.2 symbols/min [2025-10-02T17:56:05.446519] [INFO ] [MAIN ] CCI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:56:05.501317] [DEBUG] [LOCAL ] CCI: Loaded 53139 existing records from primary storage. [2025-10-02T17:56:05.501902] [INFO ] [MAIN ] CCI: Loaded 53139 existing records. [2025-10-02T17:56:05.732003] [WARN ] [MAIN ] CCI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:56:05.732365] [INFO ] [MAIN ] CCI: Wiping existing primary data before full refresh. [2025-10-02T17:56:05.732471] [INFO ] [LOCAL ] CCI: Starting deletion of primary data. [2025-10-02T17:56:05.740454] [DEBUG] [LOCAL ] CCI: Deleted primary data file. [2025-10-02T17:56:05.755047] [INFO ] [MAIN ] CCI: Starting full primary refresh. [2025-10-02T17:56:05.781706] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-02T17:56:05.878143] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-01. [2025-10-02T17:56:06.200574] [INFO ] [REMOTE ] CCI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:56:06.212552] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-02T17:56:06.673014] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-09. [2025-10-02T17:56:07.040479] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-02T17:56:07.473043] [INFO ] [REMOTE ] CC: Fetching primary data for 2024-12. [2025-10-02T17:56:07.556391] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-02T17:56:08.273044] [INFO ] [REMOTE ] CCI: Fetching primary data for 2024-12. [2025-10-02T17:56:09.003008] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-02T17:56:09.073040] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-01. [2025-10-02T17:56:09.872998] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-02. [2025-10-02T17:56:10.236097] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-02T17:56:10.673011] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-10. [2025-10-02T17:56:10.797823] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-02T17:56:11.058002] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-02T17:56:11.473018] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-03. [2025-10-02T17:56:11.842310] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-02T17:56:11.843968] [INFO ] [REMOTE ] CBU: Full fetch complete (32339 records). [2025-10-02T17:56:11.844088] [DEBUG] [VALIDATOR ] CBU: Validating primary data. [2025-10-02T17:56:12.278173] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-01. [2025-10-02T17:56:12.330016] [DEBUG] [VALIDATOR ] CBU: All expected trading days are present. [2025-10-02T17:56:12.330114] [DEBUG] [VALIDATOR ] CBU: Primary data validation passed. [2025-10-02T17:56:12.330741] [INFO ] [MAIN ] CBU: Fetched primary data is valid. [2025-10-02T17:56:12.330841] [DEBUG] [LOCAL ] CBU: Saving primary data. [2025-10-02T17:56:12.332729] [DEBUG] [LOCAL ] CBU: Trimmed 32339 records to 22817 (keeping 200 days of data) [2025-10-02T17:56:12.482575] [DEBUG] [LOCAL ] CBU: Primary data saved (22817 records). [2025-10-02T17:56:12.482740] [INFO ] [MAIN ] CBU: Full history saved. [2025-10-02T17:56:12.482836] [INFO ] [MAIN ] Update Progress: 407/2370 symbols completed. CBU took 27.9s. Estimated remaining: 4h 30m 47s. Rate: 7.2 symbols/min [2025-10-02T17:56:12.670999] [INFO ] [MAIN ] CCIA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:56:12.671428] [DEBUG] [LOCAL ] CCIA: No existing data file found in primary storage. [2025-10-02T17:56:12.671528] [WARN ] [MAIN ] CCIA: No existing data found, performing full refresh instead. [2025-10-02T17:56:12.671782] [INFO ] [MAIN ] CCIA: Wiping existing primary data before full refresh. [2025-10-02T17:56:12.671835] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-02T17:56:12.671879] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-02T17:56:12.671912] [INFO ] [MAIN ] CCIA: Starting full primary refresh. [2025-10-02T17:56:12.837829] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-02T17:56:13.082951] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-04. [2025-10-02T17:56:13.117873] [INFO ] [REMOTE ] CCIA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:56:13.872999] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2024-12. [2025-10-02T17:56:14.245517] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-10-02T17:56:14.251986] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-02T17:56:14.528314] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-02T17:56:14.673032] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-02. [2025-10-02T17:56:15.473062] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-01. [2025-10-02T17:56:15.758925] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-01 (0.29 seconds). [2025-10-02T17:56:16.062475] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-02T17:56:16.273057] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-03. [2025-10-02T17:56:17.073055] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-02. [2025-10-02T17:56:17.405495] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-02T17:56:17.873103] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-05. [2025-10-02T17:56:18.191892] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-02T17:56:18.673103] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-03. [2025-10-02T17:56:18.932953] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-02T17:56:18.994909] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-02T17:56:19.473040] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-04. [2025-10-02T17:56:19.886913] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-02T17:56:20.273084] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-04. [2025-10-02T17:56:21.073072] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-06. [2025-10-02T17:56:21.873049] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-05. [2025-10-02T17:56:22.037237] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-02T17:56:22.202527] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-02T17:56:22.485632] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-02T17:56:22.673027] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-05. [2025-10-02T17:56:23.473017] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-02. [2025-10-02T17:56:24.273008] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-06. [2025-10-02T17:56:24.556552] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-02T17:56:24.621898] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-02T17:56:25.073038] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-07. [2025-10-02T17:56:25.292297] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-02T17:56:25.429952] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-02T17:56:25.873001] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-08. [2025-10-02T17:56:26.310975] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-02T17:56:26.673004] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-07. [2025-10-02T17:56:27.473000] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-03. [2025-10-02T17:56:28.146769] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-02T17:56:28.273017] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-08. [2025-10-02T17:56:28.979938] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-02T17:56:29.073000] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-04. [2025-10-02T17:56:29.550603] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-02T17:56:29.872996] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-06. [2025-10-02T17:56:30.672996] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-09. [2025-10-02T17:56:30.958861] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-02T17:56:31.472996] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-09. [2025-10-02T17:56:31.552398] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-02T17:56:31.740527] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-10-02T17:56:31.871468] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-02T17:56:32.272996] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-05. [2025-10-02T17:56:33.073005] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-10. [2025-10-02T17:56:33.461890] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-02T17:56:33.462567] [INFO ] [REMOTE ] CCIA: Full fetch complete (2068 records). [2025-10-02T17:56:33.462663] [DEBUG] [VALIDATOR ] CCIA: Validating primary data. [2025-10-02T17:56:33.676200] [WARN ] [VALIDATOR ] CCIA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-02T17:56:33.676496] [FATAL] [MAIN ] CCIA: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:56:33.676669] [WARN ] [MAIN ] CCIA: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:56:33.676884] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-02T17:56:33.677025] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-02T17:56:33.677197] [INFO ] [LOCAL ] CCIA: Starting deletion of derivative data. [2025-10-02T17:56:33.677378] [DEBUG] [LOCAL ] CCIA: No derivative data file found to delete. [2025-10-02T17:56:33.677469] [INFO ] [MAIN ] Update Progress: 408/2370 symbols completed. CCIA took 21.2s. Estimated remaining: 4h 31m 41s. Rate: 7.2 symbols/min [2025-10-02T17:56:33.871542] [INFO ] [MAIN ] CCIF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:56:33.872992] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-10. [2025-10-02T17:56:33.914004] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-02T17:56:33.931786] [DEBUG] [LOCAL ] CCIF: Loaded 15750 existing records from primary storage. [2025-10-02T17:56:33.932035] [INFO ] [MAIN ] CCIF: Loaded 15750 existing records. [2025-10-02T17:56:34.121424] [WARN ] [MAIN ] CCIF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:56:34.121638] [INFO ] [MAIN ] CCIF: Wiping existing primary data before full refresh. [2025-10-02T17:56:34.121723] [INFO ] [LOCAL ] CCIF: Starting deletion of primary data. [2025-10-02T17:56:34.122387] [DEBUG] [LOCAL ] CCIF: Deleted primary data file. [2025-10-02T17:56:34.122470] [INFO ] [MAIN ] CCIF: Starting full primary refresh. [2025-10-02T17:56:34.522453] [INFO ] [REMOTE ] CCIF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:56:34.673002] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-06. [2025-10-02T17:56:35.143509] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-02T17:56:35.145191] [INFO ] [REMOTE ] CBZ: Full fetch complete (45528 records). [2025-10-02T17:56:35.145303] [DEBUG] [VALIDATOR ] CBZ: Validating primary data. [2025-10-02T17:56:35.478085] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-07. [2025-10-02T17:56:35.555140] [DEBUG] [VALIDATOR ] CBZ: All expected trading days are present. [2025-10-02T17:56:35.555219] [DEBUG] [VALIDATOR ] CBZ: Primary data validation passed. [2025-10-02T17:56:35.555874] [INFO ] [MAIN ] CBZ: Fetched primary data is valid. [2025-10-02T17:56:35.555938] [DEBUG] [LOCAL ] CBZ: Saving primary data. [2025-10-02T17:56:35.556979] [DEBUG] [LOCAL ] CBZ: Trimmed 45528 records to 33974 (keeping 200 days of data) [2025-10-02T17:56:35.760395] [DEBUG] [LOCAL ] CBZ: Primary data saved (33974 records). [2025-10-02T17:56:35.760562] [INFO ] [MAIN ] CBZ: Full history saved. [2025-10-02T17:56:35.760685] [INFO ] [MAIN ] Update Progress: 409/2370 symbols completed. CBZ took 33.5s. Estimated remaining: 4h 31m 3s. Rate: 7.2 symbols/min [2025-10-02T17:56:35.943860] [INFO ] [MAIN ] CCJ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:56:35.996461] [DEBUG] [LOCAL ] CCJ: Loaded 53674 existing records from primary storage. [2025-10-02T17:56:35.996878] [INFO ] [MAIN ] CCJ: Loaded 53674 existing records. [2025-10-02T17:56:36.210301] [WARN ] [MAIN ] CCJ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:56:36.210666] [INFO ] [MAIN ] CCJ: Wiping existing primary data before full refresh. [2025-10-02T17:56:36.210747] [INFO ] [LOCAL ] CCJ: Starting deletion of primary data. [2025-10-02T17:56:36.212087] [DEBUG] [LOCAL ] CCJ: Deleted primary data file. [2025-10-02T17:56:36.212242] [INFO ] [MAIN ] CCJ: Starting full primary refresh. [2025-10-02T17:56:36.277450] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2024-12. [2025-10-02T17:56:36.401618] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-02T17:56:36.636285] [INFO ] [REMOTE ] CCJ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:56:37.073073] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2024-12. [2025-10-02T17:56:37.296487] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-02T17:56:37.400676] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-02T17:56:37.873020] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-08. [2025-10-02T17:56:38.672973] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-07. [2025-10-02T17:56:38.998711] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-02T17:56:39.473006] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-01. [2025-10-02T17:56:39.746391] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-02T17:56:40.272970] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-01. [2025-10-02T17:56:40.624126] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-02T17:56:40.964892] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-02T17:56:41.072990] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-02. [2025-10-02T17:56:41.560956] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-02T17:56:41.872970] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-08. [2025-10-02T17:56:42.012986] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-02T17:56:42.672994] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-02. [2025-10-02T17:56:43.473008] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-03. [2025-10-02T17:56:43.728937] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-02T17:56:44.272996] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-09. [2025-10-02T17:56:44.378884] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-02T17:56:44.898954] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-10-02T17:56:45.072995] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-03. [2025-10-02T17:56:45.872980] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-04. [2025-10-02T17:56:46.145556] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-02T17:56:46.672996] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-10. [2025-10-02T17:56:46.882817] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-02T17:56:47.035254] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-02T17:56:47.473002] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-09. [2025-10-02T17:56:48.272977] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-04. [2025-10-02T17:56:48.347750] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-02T17:56:48.349939] [INFO ] [REMOTE ] CCI: Full fetch complete (76998 records). [2025-10-02T17:56:48.350043] [DEBUG] [VALIDATOR ] CCI: Validating primary data. [2025-10-02T17:56:48.788727] [DEBUG] [VALIDATOR ] CCI: All expected trading days are present. [2025-10-02T17:56:48.788897] [DEBUG] [VALIDATOR ] CCI: Primary data validation passed. [2025-10-02T17:56:48.789756] [INFO ] [MAIN ] CCI: Fetched primary data is valid. [2025-10-02T17:56:48.789823] [DEBUG] [LOCAL ] CCI: Saving primary data. [2025-10-02T17:56:48.791298] [DEBUG] [LOCAL ] CCI: Trimmed 76998 records to 53529 (keeping 200 days of data) [2025-10-02T17:56:49.096126] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-05. [2025-10-02T17:56:49.154870] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-02T17:56:49.191943] [DEBUG] [LOCAL ] CCI: Primary data saved (53529 records). [2025-10-02T17:56:49.192102] [INFO ] [MAIN ] CCI: Full history saved. [2025-10-02T17:56:49.192192] [INFO ] [MAIN ] Update Progress: 410/2370 symbols completed. CCI took 44.0s. Estimated remaining: 4h 31m 19s. Rate: 7.2 symbols/min [2025-10-02T17:56:49.382133] [INFO ] [MAIN ] CCK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:56:49.428929] [DEBUG] [LOCAL ] CCK: Loaded 46232 existing records from primary storage. [2025-10-02T17:56:49.429247] [INFO ] [MAIN ] CCK: Loaded 46232 existing records. [2025-10-02T17:56:49.616259] [WARN ] [MAIN ] CCK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:56:49.616503] [INFO ] [MAIN ] CCK: Wiping existing primary data before full refresh. [2025-10-02T17:56:49.616564] [INFO ] [LOCAL ] CCK: Starting deletion of primary data. [2025-10-02T17:56:49.617768] [DEBUG] [LOCAL ] CCK: Deleted primary data file. [2025-10-02T17:56:49.617831] [INFO ] [MAIN ] CCK: Starting full primary refresh. [2025-10-02T17:56:49.881127] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-10. [2025-10-02T17:56:50.000171] [INFO ] [REMOTE ] CCK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:56:50.276113] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-02T17:56:50.313938] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-02T17:56:50.673021] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-06. [2025-10-02T17:56:51.304209] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-02T17:56:51.306992] [INFO ] [REMOTE ] CC: Full fetch complete (75600 records). [2025-10-02T17:56:51.307129] [DEBUG] [VALIDATOR ] CC: Validating primary data. [2025-10-02T17:56:51.480902] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-05. [2025-10-02T17:56:51.776477] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-02T17:56:51.803242] [DEBUG] [VALIDATOR ] CC: All expected trading days are present. [2025-10-02T17:56:51.803370] [DEBUG] [VALIDATOR ] CC: Primary data validation passed. [2025-10-02T17:56:51.804911] [INFO ] [MAIN ] CC: Fetched primary data is valid. [2025-10-02T17:56:51.805001] [DEBUG] [LOCAL ] CC: Saving primary data. [2025-10-02T17:56:51.807218] [DEBUG] [LOCAL ] CC: Trimmed 75600 records to 53386 (keeping 200 days of data) [2025-10-02T17:56:52.245414] [DEBUG] [LOCAL ] CC: Primary data saved (53386 records). [2025-10-02T17:56:52.245618] [INFO ] [MAIN ] CC: Full history saved. [2025-10-02T17:56:52.245814] [INFO ] [MAIN ] Update Progress: 411/2370 symbols completed. CC took 48.6s. Estimated remaining: 4h 30m 46s. Rate: 7.2 symbols/min [2025-10-02T17:56:52.281618] [INFO ] [REMOTE ] CCK: Fetching primary data for 2024-12. [2025-10-02T17:56:52.504955] [INFO ] [MAIN ] CCL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:56:52.576151] [DEBUG] [LOCAL ] CCL: Loaded 53800 existing records from primary storage. [2025-10-02T17:56:52.576624] [INFO ] [MAIN ] CCL: Loaded 53800 existing records. [2025-10-02T17:56:52.790770] [WARN ] [MAIN ] CCL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:56:52.791045] [INFO ] [MAIN ] CCL: Wiping existing primary data before full refresh. [2025-10-02T17:56:52.791121] [INFO ] [LOCAL ] CCL: Starting deletion of primary data. [2025-10-02T17:56:52.792848] [DEBUG] [LOCAL ] CCL: Deleted primary data file. [2025-10-02T17:56:52.792930] [INFO ] [MAIN ] CCL: Starting full primary refresh. [2025-10-02T17:56:53.085342] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-07. [2025-10-02T17:56:53.224525] [INFO ] [REMOTE ] CCL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:56:53.656587] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-02T17:56:53.743305] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-02T17:56:53.873006] [INFO ] [REMOTE ] CCL: Fetching primary data for 2024-12. [2025-10-02T17:56:54.088616] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-02T17:56:54.673004] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-08. [2025-10-02T17:56:55.473280] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-01. [2025-10-02T17:56:55.762503] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-02T17:56:56.212201] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-10-02T17:56:56.272968] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-01. [2025-10-02T17:56:56.777547] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-02T17:56:57.073039] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-02. [2025-10-02T17:56:57.873002] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-09. [2025-10-02T17:56:58.514728] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-10-02T17:56:58.678501] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-02. [2025-10-02T17:56:58.697849] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-02T17:56:58.837335] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-02T17:56:59.473009] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-03. [2025-10-02T17:57:00.273049] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-06. [2025-10-02T17:57:01.072982] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-10. [2025-10-02T17:57:01.364792] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-02 (2.69 seconds). [2025-10-02T17:57:01.405811] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-02T17:57:01.873028] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-03. [2025-10-02T17:57:02.168344] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-02T17:57:02.169542] [INFO ] [REMOTE ] CCIF: Full fetch complete (21915 records). [2025-10-02T17:57:02.169616] [DEBUG] [VALIDATOR ] CCIF: Validating primary data. [2025-10-02T17:57:02.617968] [DEBUG] [VALIDATOR ] CCIF: All expected trading days are present. [2025-10-02T17:57:02.618224] [DEBUG] [VALIDATOR ] CCIF: Primary data validation passed. [2025-10-02T17:57:02.618735] [INFO ] [MAIN ] CCIF: Fetched primary data is valid. [2025-10-02T17:57:02.618849] [DEBUG] [LOCAL ] CCIF: Saving primary data. [2025-10-02T17:57:02.619929] [DEBUG] [LOCAL ] CCIF: Trimmed 21915 records to 15844 (keeping 200 days of data) [2025-10-02T17:57:02.687180] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-04. [2025-10-02T17:57:02.724149] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-06 (2.45 seconds). [2025-10-02T17:57:02.764782] [DEBUG] [LOCAL ] CCIF: Primary data saved (15844 records). [2025-10-02T17:57:02.764933] [INFO ] [MAIN ] CCIF: Full history saved. [2025-10-02T17:57:02.765045] [INFO ] [MAIN ] Update Progress: 412/2370 symbols completed. CCIF took 29.1s. Estimated remaining: 4h 30m 48s. Rate: 7.2 symbols/min [2025-10-02T17:57:02.957735] [INFO ] [MAIN ] CCO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:57:03.009955] [DEBUG] [LOCAL ] CCO: Loaded 47896 existing records from primary storage. [2025-10-02T17:57:03.010318] [INFO ] [MAIN ] CCO: Loaded 47896 existing records. [2025-10-02T17:57:03.206106] [WARN ] [MAIN ] CCO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:57:03.206366] [INFO ] [MAIN ] CCO: Wiping existing primary data before full refresh. [2025-10-02T17:57:03.206418] [INFO ] [LOCAL ] CCO: Starting deletion of primary data. [2025-10-02T17:57:03.208168] [DEBUG] [LOCAL ] CCO: Deleted primary data file. [2025-10-02T17:57:03.208244] [INFO ] [MAIN ] CCO: Starting full primary refresh. [2025-10-02T17:57:03.480583] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-07. [2025-10-02T17:57:03.596448] [INFO ] [REMOTE ] CCO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:57:04.124977] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-02T17:57:04.255091] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-02T17:57:04.272966] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-05. [2025-10-02T17:57:05.073050] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-04. [2025-10-02T17:57:05.719560] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-02T17:57:05.873020] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-08. [2025-10-02T17:57:05.936492] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-02T17:57:06.673008] [INFO ] [REMOTE ] CCO: Fetching primary data for 2024-12. [2025-10-02T17:57:07.367497] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-02T17:57:07.473013] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-06. [2025-10-02T17:57:08.088155] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-02T17:57:08.279422] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-05. [2025-10-02T17:57:08.295481] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-02T17:57:08.755925] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-02T17:57:09.073027] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-01. [2025-10-02T17:57:09.873006] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-09. [2025-10-02T17:57:10.347577] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-02T17:57:10.672996] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-07. [2025-10-02T17:57:10.713454] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-10-02T17:57:11.473047] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-06. [2025-10-02T17:57:12.131936] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-02T17:57:12.258962] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-02T17:57:12.272953] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-08. [2025-10-02T17:57:13.073005] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-10. [2025-10-02T17:57:13.780044] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-10-02T17:57:13.873004] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-07. [2025-10-02T17:57:13.926807] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-02T17:57:14.672999] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-02. [2025-10-02T17:57:14.888849] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-02T17:57:14.890967] [INFO ] [REMOTE ] CCJ: Full fetch complete (77684 records). [2025-10-02T17:57:14.891088] [DEBUG] [VALIDATOR ] CCJ: Validating primary data. [2025-10-02T17:57:15.314958] [DEBUG] [VALIDATOR ] CCJ: All expected trading days are present. [2025-10-02T17:57:15.315061] [DEBUG] [VALIDATOR ] CCJ: Primary data validation passed. [2025-10-02T17:57:15.316144] [INFO ] [MAIN ] CCJ: Fetched primary data is valid. [2025-10-02T17:57:15.316215] [DEBUG] [LOCAL ] CCJ: Saving primary data. [2025-10-02T17:57:15.317870] [DEBUG] [LOCAL ] CCJ: Trimmed 77684 records to 54063 (keeping 200 days of data) [2025-10-02T17:57:15.500178] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-09. [2025-10-02T17:57:15.659886] [DEBUG] [LOCAL ] CCJ: Primary data saved (54063 records). [2025-10-02T17:57:15.660082] [INFO ] [MAIN ] CCJ: Full history saved. [2025-10-02T17:57:15.662431] [INFO ] [MAIN ] Update Progress: 413/2370 symbols completed. CCJ took 39.9s. Estimated remaining: 4h 31m 2s. Rate: 7.2 symbols/min [2025-10-02T17:57:15.848851] [INFO ] [MAIN ] CCRD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:57:15.862232] [DEBUG] [LOCAL ] CCRD: Loaded 9107 existing records from primary storage. [2025-10-02T17:57:15.862462] [INFO ] [MAIN ] CCRD: Loaded 9107 existing records. [2025-10-02T17:57:16.051879] [WARN ] [MAIN ] CCRD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:57:16.052353] [INFO ] [MAIN ] CCRD: Wiping existing primary data before full refresh. [2025-10-02T17:57:16.052439] [INFO ] [LOCAL ] CCRD: Starting deletion of primary data. [2025-10-02T17:57:16.052849] [DEBUG] [LOCAL ] CCRD: Deleted primary data file. [2025-10-02T17:57:16.052921] [INFO ] [MAIN ] CCRD: Starting full primary refresh. [2025-10-02T17:57:16.471958] [INFO ] [REMOTE ] CCRD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:57:16.486823] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2024-12. [2025-10-02T17:57:16.493406] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-02T17:57:16.545591] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-07 (2.67 seconds). [2025-10-02T17:57:17.072990] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-08. [2025-10-02T17:57:17.127266] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-02T17:57:17.165422] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-02T17:57:17.873009] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-10. [2025-10-02T17:57:18.673005] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-03. [2025-10-02T17:57:19.364884] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-02T17:57:19.369284] [INFO ] [REMOTE ] CCK: Full fetch complete (67577 records). [2025-10-02T17:57:19.369453] [DEBUG] [VALIDATOR ] CCK: Validating primary data. [2025-10-02T17:57:19.479339] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-01. [2025-10-02T17:57:19.699733] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-08 (2.63 seconds). [2025-10-02T17:57:19.891707] [DEBUG] [VALIDATOR ] CCK: All expected trading days are present. [2025-10-02T17:57:19.891835] [DEBUG] [VALIDATOR ] CCK: Primary data validation passed. [2025-10-02T17:57:19.892787] [INFO ] [MAIN ] CCK: Fetched primary data is valid. [2025-10-02T17:57:19.892934] [DEBUG] [LOCAL ] CCK: Saving primary data. [2025-10-02T17:57:19.894573] [DEBUG] [LOCAL ] CCK: Trimmed 67577 records to 46518 (keeping 200 days of data) [2025-10-02T17:57:20.205930] [DEBUG] [LOCAL ] CCK: Primary data saved (46518 records). [2025-10-02T17:57:20.238787] [INFO ] [MAIN ] CCK: Full history saved. [2025-10-02T17:57:20.240092] [INFO ] [MAIN ] Update Progress: 414/2370 symbols completed. CCK took 31.0s. Estimated remaining: 4h 30m 36s. Rate: 7.2 symbols/min [2025-10-02T17:57:20.239771] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-02T17:57:20.246716] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-02T17:57:20.278144] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-09. [2025-10-02T17:57:20.446197] [INFO ] [MAIN ] CCS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:57:20.480557] [DEBUG] [LOCAL ] CCS: Loaded 30499 existing records from primary storage. [2025-10-02T17:57:20.480860] [INFO ] [MAIN ] CCS: Loaded 30499 existing records. [2025-10-02T17:57:20.670512] [WARN ] [MAIN ] CCS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:57:20.670835] [INFO ] [MAIN ] CCS: Wiping existing primary data before full refresh. [2025-10-02T17:57:20.670897] [INFO ] [LOCAL ] CCS: Starting deletion of primary data. [2025-10-02T17:57:20.671893] [DEBUG] [LOCAL ] CCS: Deleted primary data file. [2025-10-02T17:57:20.671955] [INFO ] [MAIN ] CCS: Starting full primary refresh. [2025-10-02T17:57:21.081186] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-04. [2025-10-02T17:57:21.081062] [INFO ] [REMOTE ] CCS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:57:21.873001] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-02. [2025-10-02T17:57:22.477451] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-02T17:57:22.672976] [INFO ] [REMOTE ] CCS: Fetching primary data for 2024-12. [2025-10-02T17:57:22.741619] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-02T17:57:22.848234] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-09 (2.57 seconds). [2025-10-02T17:57:23.473012] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-05. [2025-10-02T17:57:24.088121] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-02T17:57:24.273003] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-10. [2025-10-02T17:57:24.822255] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-02T17:57:25.073025] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-03. [2025-10-02T17:57:25.615432] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-02T17:57:25.873015] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-04. [2025-10-02T17:57:26.450378] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-02T17:57:26.452523] [INFO ] [REMOTE ] CCL: Full fetch complete (77920 records). [2025-10-02T17:57:26.452698] [DEBUG] [VALIDATOR ] CCL: Validating primary data. [2025-10-02T17:57:26.573264] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-02T17:57:26.678193] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-06. [2025-10-02T17:57:26.912068] [DEBUG] [VALIDATOR ] CCL: All expected trading days are present. [2025-10-02T17:57:26.912161] [DEBUG] [VALIDATOR ] CCL: Primary data validation passed. [2025-10-02T17:57:26.913206] [INFO ] [MAIN ] CCL: Fetched primary data is valid. [2025-10-02T17:57:26.913300] [DEBUG] [LOCAL ] CCL: Saving primary data. [2025-10-02T17:57:26.914926] [DEBUG] [LOCAL ] CCL: Trimmed 77920 records to 54190 (keeping 200 days of data) [2025-10-02T17:57:27.279058] [DEBUG] [LOCAL ] CCL: Primary data saved (54190 records). [2025-10-02T17:57:27.279276] [INFO ] [MAIN ] CCL: Full history saved. [2025-10-02T17:57:27.279452] [INFO ] [MAIN ] Update Progress: 415/2370 symbols completed. CCL took 35.0s. Estimated remaining: 4h 30m 22s. Rate: 7.2 symbols/min [2025-10-02T17:57:27.460030] [INFO ] [MAIN ] CCU: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:57:27.474340] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-05. [2025-10-02T17:57:27.487076] [DEBUG] [LOCAL ] CCU: Loaded 23246 existing records from primary storage. [2025-10-02T17:57:27.487390] [INFO ] [MAIN ] CCU: Loaded 23246 existing records. [2025-10-02T17:57:27.676908] [WARN ] [MAIN ] CCU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:57:27.677123] [INFO ] [MAIN ] CCU: Wiping existing primary data before full refresh. [2025-10-02T17:57:27.677210] [INFO ] [LOCAL ] CCU: Starting deletion of primary data. [2025-10-02T17:57:27.677873] [DEBUG] [LOCAL ] CCU: Deleted primary data file. [2025-10-02T17:57:27.677959] [INFO ] [MAIN ] CCU: Starting full primary refresh. [2025-10-02T17:57:28.075128] [INFO ] [REMOTE ] CCU: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:57:28.210287] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-02T17:57:28.272977] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-06. [2025-10-02T17:57:28.359454] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-02T17:57:29.072970] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-07. [2025-10-02T17:57:29.087020] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-02T17:57:29.872994] [INFO ] [REMOTE ] CCU: Fetching primary data for 2024-12. [2025-10-02T17:57:30.672966] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-07. [2025-10-02T17:57:30.810918] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-02T17:57:31.090394] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-02T17:57:31.437322] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-02T17:57:31.472991] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-08. [2025-10-02T17:57:32.273001] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-01. [2025-10-02T17:57:33.052971] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-02T17:57:33.072953] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-09. [2025-10-02T17:57:33.197329] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-02T17:57:33.873011] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-02. [2025-10-02T17:57:34.406294] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-02T17:57:34.673001] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-01. [2025-10-02T17:57:35.418581] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-02T17:57:35.472985] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-03. [2025-10-02T17:57:35.648124] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-02T17:57:36.273005] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-10. [2025-10-02T17:57:36.564451] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-02T17:57:37.073006] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-04. [2025-10-02T17:57:37.401873] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-02T17:57:37.406342] [INFO ] [REMOTE ] CCO: Full fetch complete (66707 records). [2025-10-02T17:57:37.406485] [DEBUG] [VALIDATOR ] CCO: Validating primary data. [2025-10-02T17:57:37.824800] [DEBUG] [VALIDATOR ] CCO: All expected trading days are present. [2025-10-02T17:57:37.824896] [DEBUG] [VALIDATOR ] CCO: Primary data validation passed. [2025-10-02T17:57:37.825681] [INFO ] [MAIN ] CCO: Fetched primary data is valid. [2025-10-02T17:57:37.825748] [DEBUG] [LOCAL ] CCO: Saving primary data. [2025-10-02T17:57:37.827173] [DEBUG] [LOCAL ] CCO: Trimmed 66707 records to 48249 (keeping 200 days of data) [2025-10-02T17:57:37.885570] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-02. [2025-10-02T17:57:38.123545] [DEBUG] [LOCAL ] CCO: Primary data saved (48249 records). [2025-10-02T17:57:38.123785] [INFO ] [MAIN ] CCO: Full history saved. [2025-10-02T17:57:38.123879] [INFO ] [MAIN ] Update Progress: 416/2370 symbols completed. CCO took 35.4s. Estimated remaining: 4h 30m 25s. Rate: 7.2 symbols/min [2025-10-02T17:57:38.310783] [INFO ] [MAIN ] CCZ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:57:38.311101] [DEBUG] [LOCAL ] CCZ: No existing data file found in primary storage. [2025-10-02T17:57:38.311236] [WARN ] [MAIN ] CCZ: No existing data found, performing full refresh instead. [2025-10-02T17:57:38.311400] [INFO ] [MAIN ] CCZ: Wiping existing primary data before full refresh. [2025-10-02T17:57:38.311573] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-02T17:57:38.311698] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-02T17:57:38.311767] [INFO ] [MAIN ] CCZ: Starting full primary refresh. [2025-10-02T17:57:38.678456] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-08. [2025-10-02T17:57:38.736146] [INFO ] [REMOTE ] CCZ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:57:38.744771] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-02T17:57:38.761557] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-02T17:57:39.424385] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-02T17:57:39.472978] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-03. [2025-10-02T17:57:40.273044] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2024-12. [2025-10-02T17:57:40.696482] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-02T17:57:40.698585] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-02T17:57:41.073008] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-09. [2025-10-02T17:57:41.873033] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-01. [2025-10-02T17:57:41.881761] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-02T17:57:42.108136] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-01 (0.24 seconds). [2025-10-02T17:57:42.673041] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-10. [2025-10-02T17:57:43.267889] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-02T17:57:43.268854] [INFO ] [REMOTE ] CCRD: Full fetch complete (11848 records). [2025-10-02T17:57:43.268931] [DEBUG] [VALIDATOR ] CCRD: Validating primary data. [2025-10-02T17:57:43.480503] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-05. [2025-10-02T17:57:43.672350] [DEBUG] [VALIDATOR ] CCRD: All expected trading days are present. [2025-10-02T17:57:43.672474] [DEBUG] [VALIDATOR ] CCRD: Primary data validation passed. [2025-10-02T17:57:43.672881] [INFO ] [MAIN ] CCRD: Fetched primary data is valid. [2025-10-02T17:57:43.672945] [DEBUG] [LOCAL ] CCRD: Saving primary data. [2025-10-02T17:57:43.673500] [DEBUG] [LOCAL ] CCRD: Trimmed 11848 records to 9134 (keeping 200 days of data) [2025-10-02T17:57:43.732674] [DEBUG] [LOCAL ] CCRD: Primary data saved (9134 records). [2025-10-02T17:57:43.732828] [INFO ] [MAIN ] CCRD: Full history saved. [2025-10-02T17:57:43.733022] [INFO ] [MAIN ] Update Progress: 417/2370 symbols completed. CCRD took 28.1s. Estimated remaining: 4h 30m 4s. Rate: 7.2 symbols/min [2025-10-02T17:57:43.938794] [INFO ] [MAIN ] CDE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:57:44.011134] [DEBUG] [LOCAL ] CDE: Loaded 53642 existing records from primary storage. [2025-10-02T17:57:44.011565] [INFO ] [MAIN ] CDE: Loaded 53642 existing records. [2025-10-02T17:57:44.233843] [WARN ] [MAIN ] CDE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:57:44.234099] [INFO ] [MAIN ] CDE: Wiping existing primary data before full refresh. [2025-10-02T17:57:44.234158] [INFO ] [LOCAL ] CDE: Starting deletion of primary data. [2025-10-02T17:57:44.236111] [DEBUG] [LOCAL ] CDE: Deleted primary data file. [2025-10-02T17:57:44.236223] [INFO ] [MAIN ] CDE: Starting full primary refresh. [2025-10-02T17:57:44.278257] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-04. [2025-10-02T17:57:44.881984] [INFO ] [REMOTE ] CDE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:57:44.933354] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-02T17:57:45.073012] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-02. [2025-10-02T17:57:45.282853] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-02 (0.21 seconds). [2025-10-02T17:57:45.607916] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-02T17:57:45.873040] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-03. [2025-10-02T17:57:46.106079] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-03 (0.23 seconds). [2025-10-02T17:57:46.673030] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-06. [2025-10-02T17:57:47.473001] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-05. [2025-10-02T17:57:48.089946] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-02T17:57:48.267497] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-02T17:57:48.273045] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-07. [2025-10-02T17:57:49.073057] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-06. [2025-10-02T17:57:49.622143] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-02T17:57:49.873024] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-08. [2025-10-02T17:57:50.056152] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-02T17:57:50.672999] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-07. [2025-10-02T17:57:51.031269] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-02T17:57:51.473048] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-09. [2025-10-02T17:57:51.755364] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-02T17:57:52.273049] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-04. [2025-10-02T17:57:52.688298] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-02T17:57:52.837448] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-02T17:57:53.073011] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-10. [2025-10-02T17:57:53.873028] [INFO ] [REMOTE ] CDE: Fetching primary data for 2024-12. [2025-10-02T17:57:54.088384] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-02T17:57:54.090229] [INFO ] [REMOTE ] CCS: Full fetch complete (45069 records). [2025-10-02T17:57:54.090331] [DEBUG] [VALIDATOR ] CCS: Validating primary data. [2025-10-02T17:57:54.519098] [DEBUG] [VALIDATOR ] CCS: All expected trading days are present. [2025-10-02T17:57:54.519247] [DEBUG] [VALIDATOR ] CCS: Primary data validation passed. [2025-10-02T17:57:54.519989] [INFO ] [MAIN ] CCS: Fetched primary data is valid. [2025-10-02T17:57:54.520059] [DEBUG] [LOCAL ] CCS: Saving primary data. [2025-10-02T17:57:54.521253] [DEBUG] [LOCAL ] CCS: Trimmed 45069 records to 30685 (keeping 200 days of data) [2025-10-02T17:57:54.680860] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-08. [2025-10-02T17:57:54.721996] [DEBUG] [LOCAL ] CCS: Primary data saved (30685 records). [2025-10-02T17:57:54.722141] [INFO ] [MAIN ] CCS: Full history saved. [2025-10-02T17:57:54.722226] [INFO ] [MAIN ] Update Progress: 418/2370 symbols completed. CCS took 34.5s. Estimated remaining: 4h 30m 9s. Rate: 7.2 symbols/min [2025-10-02T17:57:54.914476] [INFO ] [MAIN ] CDLR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:57:54.926874] [DEBUG] [LOCAL ] CDLR: Loaded 9854 existing records from primary storage. [2025-10-02T17:57:54.927131] [INFO ] [MAIN ] CDLR: Loaded 9854 existing records. [2025-10-02T17:57:55.120169] [WARN ] [MAIN ] CDLR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:57:55.120385] [INFO ] [MAIN ] CDLR: Wiping existing primary data before full refresh. [2025-10-02T17:57:55.120441] [INFO ] [LOCAL ] CDLR: Starting deletion of primary data. [2025-10-02T17:57:55.120878] [DEBUG] [LOCAL ] CDLR: Deleted primary data file. [2025-10-02T17:57:55.120941] [INFO ] [MAIN ] CDLR: Starting full primary refresh. [2025-10-02T17:57:55.480920] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-05. [2025-10-02T17:57:55.534066] [INFO ] [REMOTE ] CDLR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:57:55.787909] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-02T17:57:55.938831] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-02T17:57:55.985638] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-02T17:57:56.273007] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-06. [2025-10-02T17:57:56.539433] [DEBUG] [REMOTE ] CCZ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T17:57:56.539790] [WARN ] [REMOTE ] CCZ: No data returned for month 2025-06 [2025-10-02T17:57:56.539880] [FATAL] [REMOTE ] CCZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T17:57:56.539997] [FATAL] [MAIN ] CCZ: Failed to fetch primary data. [2025-10-02T17:57:56.540079] [WARN ] [MAIN ] CCZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T17:57:56.540167] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-02T17:57:56.540242] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-02T17:57:56.540282] [INFO ] [LOCAL ] CCZ: Starting deletion of derivative data. [2025-10-02T17:57:56.540344] [DEBUG] [LOCAL ] CCZ: No derivative data file found to delete. [2025-10-02T17:57:56.540430] [INFO ] [MAIN ] Update Progress: 419/2370 symbols completed. CCZ took 18.4s. Estimated remaining: 4h 29m 30s. Rate: 7.2 symbols/min [2025-10-02T17:57:56.737950] [INFO ] [MAIN ] CDP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:57:56.781759] [DEBUG] [LOCAL ] CDP: Loaded 42586 existing records from primary storage. [2025-10-02T17:57:56.782130] [INFO ] [MAIN ] CDP: Loaded 42586 existing records. [2025-10-02T17:57:56.982225] [WARN ] [MAIN ] CDP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:57:56.982465] [INFO ] [MAIN ] CDP: Wiping existing primary data before full refresh. [2025-10-02T17:57:56.982515] [INFO ] [LOCAL ] CDP: Starting deletion of primary data. [2025-10-02T17:57:56.983913] [DEBUG] [LOCAL ] CDP: Deleted primary data file. [2025-10-02T17:57:56.983982] [INFO ] [MAIN ] CDP: Starting full primary refresh. [2025-10-02T17:57:57.078204] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-01. [2025-10-02T17:57:57.378520] [INFO ] [REMOTE ] CDP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:57:57.872985] [INFO ] [REMOTE ] CDP: Fetching primary data for 2024-12. [2025-10-02T17:57:58.672999] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-09. [2025-10-02T17:57:58.817385] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-02T17:57:59.386623] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-02T17:57:59.473066] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2024-12. [2025-10-02T17:57:59.659095] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-02T17:58:00.024922] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-02T17:58:00.273043] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-01. [2025-10-02T17:58:01.073040] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-02. [2025-10-02T17:58:01.879394] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-01. [2025-10-02T17:58:01.886274] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-02T17:58:02.392029] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-02T17:58:02.568725] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-02T17:58:02.673080] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-10. [2025-10-02T17:58:03.417474] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-02T17:58:03.418625] [INFO ] [REMOTE ] CCU: Full fetch complete (32921 records). [2025-10-02T17:58:03.418809] [DEBUG] [VALIDATOR ] CCU: Validating primary data. [2025-10-02T17:58:03.419429] [FATAL] [VALIDATOR ] CCU: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:58:03.419571] [FATAL] [MAIN ] CCU: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:58:03.419618] [WARN ] [MAIN ] CCU: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:58:03.419698] [INFO ] [LOCAL ] CCU: Starting deletion of primary data. [2025-10-02T17:58:03.419771] [DEBUG] [LOCAL ] CCU: No primary data file found to delete. [2025-10-02T17:58:03.419809] [INFO ] [LOCAL ] CCU: Starting deletion of derivative data. [2025-10-02T17:58:03.420237] [DEBUG] [LOCAL ] CCU: Deleted derivative data file. [2025-10-02T17:58:03.420351] [INFO ] [MAIN ] Update Progress: 420/2370 symbols completed. CCU took 36.1s. Estimated remaining: 4h 29m 15s. Rate: 7.2 symbols/min [2025-10-02T17:58:03.480949] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-02. [2025-10-02T17:58:03.614547] [INFO ] [MAIN ] CDRE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:58:03.638720] [DEBUG] [LOCAL ] CDRE: Loaded 24990 existing records from primary storage. [2025-10-02T17:58:03.639005] [INFO ] [MAIN ] CDRE: Loaded 24990 existing records. [2025-10-02T17:58:03.838541] [WARN ] [MAIN ] CDRE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:58:03.838799] [INFO ] [MAIN ] CDRE: Wiping existing primary data before full refresh. [2025-10-02T17:58:03.838863] [INFO ] [LOCAL ] CDRE: Starting deletion of primary data. [2025-10-02T17:58:03.839715] [DEBUG] [LOCAL ] CDRE: Deleted primary data file. [2025-10-02T17:58:03.839793] [INFO ] [MAIN ] CDRE: Starting full primary refresh. [2025-10-02T17:58:04.165266] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-02T17:58:04.251849] [INFO ] [REMOTE ] CDRE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:58:04.273028] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-03. [2025-10-02T17:58:05.072984] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-02. [2025-10-02T17:58:05.301167] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-02T17:58:05.873000] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-04. [2025-10-02T17:58:06.573041] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-02T17:58:06.646970] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-02T17:58:06.673060] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-03. [2025-10-02T17:58:07.473041] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-05. [2025-10-02T17:58:08.255529] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-02T17:58:08.272994] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-06. [2025-10-02T17:58:08.802813] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-02T17:58:08.832092] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-02T17:58:09.073007] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-04. [2025-10-02T17:58:09.873038] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2024-12. [2025-10-02T17:58:10.673003] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-07. [2025-10-02T17:58:10.733686] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-02T17:58:11.288341] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-02T17:58:11.473045] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-05. [2025-10-02T17:58:11.572095] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-02T17:58:12.273047] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-01. [2025-10-02T17:58:13.024954] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-02T17:58:13.073023] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-08. [2025-10-02T17:58:13.472184] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-02T17:58:13.591292] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-02T17:58:13.873004] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-02. [2025-10-02T17:58:14.672970] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-03. [2025-10-02T17:58:14.848576] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-02T17:58:15.473002] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-09. [2025-10-02T17:58:16.094763] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-02T17:58:16.273003] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-10. [2025-10-02T17:58:16.342316] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-02T17:58:16.804470] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-02T17:58:16.805506] [INFO ] [REMOTE ] CDLR: Full fetch complete (13334 records). [2025-10-02T17:58:16.805578] [DEBUG] [VALIDATOR ] CDLR: Validating primary data. [2025-10-02T17:58:17.078284] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-06. [2025-10-02T17:58:17.208893] [DEBUG] [VALIDATOR ] CDLR: All expected trading days are present. [2025-10-02T17:58:17.208975] [DEBUG] [VALIDATOR ] CDLR: Primary data validation passed. [2025-10-02T17:58:17.209277] [INFO ] [MAIN ] CDLR: Fetched primary data is valid. [2025-10-02T17:58:17.209316] [DEBUG] [LOCAL ] CDLR: Saving primary data. [2025-10-02T17:58:17.209883] [DEBUG] [LOCAL ] CDLR: Trimmed 13334 records to 9932 (keeping 200 days of data) [2025-10-02T17:58:17.270957] [DEBUG] [LOCAL ] CDLR: Primary data saved (9932 records). [2025-10-02T17:58:17.271096] [INFO ] [MAIN ] CDLR: Full history saved. [2025-10-02T17:58:17.271209] [INFO ] [MAIN ] Update Progress: 421/2370 symbols completed. CDLR took 22.5s. Estimated remaining: 4h 29m 33s. Rate: 7.2 symbols/min [2025-10-02T17:58:17.456841] [INFO ] [MAIN ] CE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:58:17.512024] [DEBUG] [LOCAL ] CE: Loaded 51501 existing records from primary storage. [2025-10-02T17:58:17.512395] [INFO ] [MAIN ] CE: Loaded 51501 existing records. [2025-10-02T17:58:17.708200] [WARN ] [MAIN ] CE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:58:17.708446] [INFO ] [MAIN ] CE: Wiping existing primary data before full refresh. [2025-10-02T17:58:17.708513] [INFO ] [LOCAL ] CE: Starting deletion of primary data. [2025-10-02T17:58:17.710346] [DEBUG] [LOCAL ] CE: Deleted primary data file. [2025-10-02T17:58:17.710433] [INFO ] [MAIN ] CE: Starting full primary refresh. [2025-10-02T17:58:17.881617] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-03. [2025-10-02T17:58:18.118028] [INFO ] [REMOTE ] CE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:58:18.672980] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-04. [2025-10-02T17:58:19.004396] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-02T17:58:19.135976] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-02T17:58:19.472994] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-07. [2025-10-02T17:58:20.273050] [INFO ] [REMOTE ] CE: Fetching primary data for 2024-12. [2025-10-02T17:58:20.439810] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-02T17:58:21.073019] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-05. [2025-10-02T17:58:21.537309] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-02T17:58:21.873008] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-04. [2025-10-02T17:58:22.107583] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-02T17:58:22.317724] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-02T17:58:22.672969] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-08. [2025-10-02T17:58:23.076220] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-02T17:58:23.472993] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-06. [2025-10-02T17:58:24.273026] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-01. [2025-10-02T17:58:24.473725] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-02T17:58:25.012702] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-02T17:58:25.073016] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-07. [2025-10-02T17:58:25.873001] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-09. [2025-10-02T17:58:25.999734] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-02T17:58:26.672996] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-02. [2025-10-02T17:58:26.872216] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-02T17:58:27.473002] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-05. [2025-10-02T17:58:28.193062] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-10-02T17:58:28.273002] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-10. [2025-10-02T17:58:28.309096] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-02T17:58:28.447633] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-02T17:58:29.073037] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-06. [2025-10-02T17:58:29.873024] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-03. [2025-10-02T17:58:30.299026] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-02T17:58:30.301964] [INFO ] [REMOTE ] CDE: Full fetch complete (77584 records). [2025-10-02T17:58:30.302154] [DEBUG] [VALIDATOR ] CDE: Validating primary data. [2025-10-02T17:58:30.433373] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-02T17:58:30.678132] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-07. [2025-10-02T17:58:30.788890] [DEBUG] [VALIDATOR ] CDE: All expected trading days are present. [2025-10-02T17:58:30.788991] [DEBUG] [VALIDATOR ] CDE: Primary data validation passed. [2025-10-02T17:58:30.789886] [INFO ] [MAIN ] CDE: Fetched primary data is valid. [2025-10-02T17:58:30.789959] [DEBUG] [LOCAL ] CDE: Saving primary data. [2025-10-02T17:58:30.791546] [DEBUG] [LOCAL ] CDE: Trimmed 77584 records to 54032 (keeping 200 days of data) [2025-10-02T17:58:31.120128] [DEBUG] [LOCAL ] CDE: Primary data saved (54032 records). [2025-10-02T17:58:31.120289] [INFO ] [MAIN ] CDE: Full history saved. [2025-10-02T17:58:31.121698] [INFO ] [MAIN ] Update Progress: 422/2370 symbols completed. CDE took 47.4s. Estimated remaining: 4h 29m 50s. Rate: 7.2 symbols/min [2025-10-02T17:58:31.325580] [INFO ] [MAIN ] CEE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:58:31.334754] [DEBUG] [LOCAL ] CEE: Loaded 5946 existing records from primary storage. [2025-10-02T17:58:31.335029] [INFO ] [MAIN ] CEE: Loaded 5946 existing records. [2025-10-02T17:58:31.478121] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-08. [2025-10-02T17:58:31.537005] [WARN ] [MAIN ] CEE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:58:31.537664] [INFO ] [MAIN ] CEE: Wiping existing primary data before full refresh. [2025-10-02T17:58:31.537778] [INFO ] [LOCAL ] CEE: Starting deletion of primary data. [2025-10-02T17:58:31.538499] [DEBUG] [LOCAL ] CEE: Deleted primary data file. [2025-10-02T17:58:31.538562] [INFO ] [MAIN ] CEE: Starting full primary refresh. [2025-10-02T17:58:31.960857] [INFO ] [REMOTE ] CEE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:58:31.994933] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-02T17:58:32.023229] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-02T17:58:32.273049] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-08. [2025-10-02T17:58:33.044824] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-02T17:58:33.073019] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-09. [2025-10-02T17:58:33.677207] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-02T17:58:33.873003] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-04. [2025-10-02T17:58:34.635507] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-02T17:58:34.673041] [INFO ] [REMOTE ] CEE: Fetching primary data for 2024-12. [2025-10-02T17:58:35.353545] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-02T17:58:35.473041] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-01. [2025-10-02T17:58:35.702340] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-02T17:58:35.847263] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-02T17:58:36.273019] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-09. [2025-10-02T17:58:37.072996] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-05. [2025-10-02T17:58:37.338604] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-02T17:58:37.873045] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-10. [2025-10-02T17:58:38.556391] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-02T17:58:38.673029] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-10. [2025-10-02T17:58:38.778731] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-02T17:58:38.780004] [INFO ] [REMOTE ] CDRE: Full fetch complete (35217 records). [2025-10-02T17:58:38.780087] [DEBUG] [VALIDATOR ] CDRE: Validating primary data. [2025-10-02T17:58:39.189884] [DEBUG] [VALIDATOR ] CDRE: All expected trading days are present. [2025-10-02T17:58:39.189976] [DEBUG] [VALIDATOR ] CDRE: Primary data validation passed. [2025-10-02T17:58:39.190488] [INFO ] [MAIN ] CDRE: Fetched primary data is valid. [2025-10-02T17:58:39.190535] [DEBUG] [LOCAL ] CDRE: Saving primary data. [2025-10-02T17:58:39.191431] [DEBUG] [LOCAL ] CDRE: Trimmed 35217 records to 25140 (keeping 200 days of data) [2025-10-02T17:58:39.346944] [DEBUG] [LOCAL ] CDRE: Primary data saved (25140 records). [2025-10-02T17:58:39.347078] [INFO ] [MAIN ] CDRE: Full history saved. [2025-10-02T17:58:39.347164] [INFO ] [MAIN ] Update Progress: 423/2370 symbols completed. CDRE took 35.9s. Estimated remaining: 4h 29m 41s. Rate: 7.2 symbols/min [2025-10-02T17:58:39.478098] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-06. [2025-10-02T17:58:39.557417] [INFO ] [MAIN ] CEPU: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:58:39.584162] [DEBUG] [LOCAL ] CEPU: Loaded 25885 existing records from primary storage. [2025-10-02T17:58:39.584470] [INFO ] [MAIN ] CEPU: Loaded 25885 existing records. [2025-10-02T17:58:39.774894] [WARN ] [MAIN ] CEPU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:58:39.775124] [INFO ] [MAIN ] CEPU: Wiping existing primary data before full refresh. [2025-10-02T17:58:39.775187] [INFO ] [LOCAL ] CEPU: Starting deletion of primary data. [2025-10-02T17:58:39.775971] [DEBUG] [LOCAL ] CEPU: Deleted primary data file. [2025-10-02T17:58:39.776034] [INFO ] [MAIN ] CEPU: Starting full primary refresh. [2025-10-02T17:58:39.898600] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-02T17:58:39.937324] [INFO ] [REMOTE ] CDP: Full fetch complete (61941 records). [2025-10-02T17:58:39.948861] [DEBUG] [VALIDATOR ] CDP: Validating primary data. [2025-10-02T17:58:40.276390] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-02. [2025-10-02T17:58:40.341693] [INFO ] [REMOTE ] CEPU: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:58:40.637682] [DEBUG] [VALIDATOR ] CDP: All expected trading days are present. [2025-10-02T17:58:40.637811] [DEBUG] [VALIDATOR ] CDP: Primary data validation passed. [2025-10-02T17:58:40.638532] [INFO ] [MAIN ] CDP: Fetched primary data is valid. [2025-10-02T17:58:40.638596] [DEBUG] [LOCAL ] CDP: Saving primary data. [2025-10-02T17:58:40.639996] [DEBUG] [LOCAL ] CDP: Trimmed 61941 records to 42936 (keeping 200 days of data) [2025-10-02T17:58:40.911125] [DEBUG] [LOCAL ] CDP: Primary data saved (42936 records). [2025-10-02T17:58:40.911290] [INFO ] [MAIN ] CDP: Full history saved. [2025-10-02T17:58:40.911479] [INFO ] [MAIN ] Update Progress: 424/2370 symbols completed. CDP took 44.4s. Estimated remaining: 4h 29m 2s. Rate: 7.2 symbols/min [2025-10-02T17:58:41.098704] [INFO ] [MAIN ] CF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:58:41.097583] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2024-12. [2025-10-02T17:58:41.130106] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-02T17:58:41.189124] [DEBUG] [LOCAL ] CF: Loaded 52176 existing records from primary storage. [2025-10-02T17:58:41.189465] [INFO ] [MAIN ] CF: Loaded 52176 existing records. [2025-10-02T17:58:41.366751] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-02T17:58:41.411577] [WARN ] [MAIN ] CF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:58:41.411864] [INFO ] [MAIN ] CF: Wiping existing primary data before full refresh. [2025-10-02T17:58:41.411917] [INFO ] [LOCAL ] CF: Starting deletion of primary data. [2025-10-02T17:58:41.413437] [DEBUG] [LOCAL ] CF: Deleted primary data file. [2025-10-02T17:58:41.413501] [INFO ] [MAIN ] CF: Starting full primary refresh. [2025-10-02T17:58:41.799957] [INFO ] [REMOTE ] CF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:58:41.872996] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-07. [2025-10-02T17:58:42.393494] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-02T17:58:42.673059] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-01. [2025-10-02T17:58:43.472973] [INFO ] [REMOTE ] CF: Fetching primary data for 2024-12. [2025-10-02T17:58:43.625186] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-02T17:58:43.801526] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-02T17:58:44.272999] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-02. [2025-10-02T17:58:45.073008] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-03. [2025-10-02T17:58:45.140803] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-02T17:58:45.415300] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-02T17:58:45.873008] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-03. [2025-10-02T17:58:46.160951] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-02T17:58:46.673008] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-04. [2025-10-02T17:58:46.858023] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-02T17:58:47.388323] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-02T17:58:47.473003] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-08. [2025-10-02T17:58:48.273042] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-01. [2025-10-02T17:58:49.054843] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-02T17:58:49.072963] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-09. [2025-10-02T17:58:49.873002] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-04. [2025-10-02T17:58:50.081019] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-02T17:58:50.417796] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-02T17:58:50.672980] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-05. [2025-10-02T17:58:50.901063] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-02T17:58:51.192624] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-02T17:58:51.473040] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-05. [2025-10-02T17:58:52.272999] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-06. [2025-10-02T17:58:52.779635] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-02T17:58:52.888747] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-02T17:58:53.073070] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-10. [2025-10-02T17:58:53.873064] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-02. [2025-10-02T17:58:54.421739] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-02T17:58:54.423925] [INFO ] [REMOTE ] CE: Full fetch complete (74841 records). [2025-10-02T17:58:54.424084] [DEBUG] [VALIDATOR ] CE: Validating primary data. [2025-10-02T17:58:54.678156] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-06. [2025-10-02T17:58:54.975292] [DEBUG] [VALIDATOR ] CE: All expected trading days are present. [2025-10-02T17:58:54.975414] [DEBUG] [VALIDATOR ] CE: Primary data validation passed. [2025-10-02T17:58:54.976964] [INFO ] [MAIN ] CE: Fetched primary data is valid. [2025-10-02T17:58:54.977063] [DEBUG] [LOCAL ] CE: Saving primary data. [2025-10-02T17:58:54.979169] [DEBUG] [LOCAL ] CE: Trimmed 74841 records to 51874 (keeping 200 days of data) [2025-10-02T17:58:55.461579] [DEBUG] [LOCAL ] CE: Primary data saved (51874 records). [2025-10-02T17:58:55.461769] [INFO ] [MAIN ] CE: Full history saved. [2025-10-02T17:58:55.461906] [INFO ] [MAIN ] Update Progress: 425/2370 symbols completed. CE took 38.2s. Estimated remaining: 4h 29m 22s. Rate: 7.2 symbols/min [2025-10-02T17:58:55.487352] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-07. [2025-10-02T17:58:55.699229] [INFO ] [MAIN ] CFG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:58:55.736472] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-02T17:58:55.768440] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-02T17:58:55.812011] [DEBUG] [LOCAL ] CFG: Loaded 53624 existing records from primary storage. [2025-10-02T17:58:55.812378] [INFO ] [MAIN ] CFG: Loaded 53624 existing records. [2025-10-02T17:58:56.031441] [WARN ] [MAIN ] CFG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:58:56.031638] [INFO ] [MAIN ] CFG: Wiping existing primary data before full refresh. [2025-10-02T17:58:56.031723] [INFO ] [LOCAL ] CFG: Starting deletion of primary data. [2025-10-02T17:58:56.033261] [DEBUG] [LOCAL ] CFG: Deleted primary data file. [2025-10-02T17:58:56.033325] [INFO ] [MAIN ] CFG: Starting full primary refresh. [2025-10-02T17:58:56.154986] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-02T17:58:56.278158] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-07. [2025-10-02T17:58:56.445586] [INFO ] [REMOTE ] CFG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:58:57.073252] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-03. [2025-10-02T17:58:57.253721] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-02T17:58:57.872996] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-08. [2025-10-02T17:58:58.673025] [INFO ] [REMOTE ] CFG: Fetching primary data for 2024-12. [2025-10-02T17:58:58.862978] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-02T17:58:58.933447] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-02T17:58:59.473011] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-04. [2025-10-02T17:59:00.205328] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-02T17:59:00.272996] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-09. [2025-10-02T17:59:01.073029] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-01. [2025-10-02T17:59:01.656707] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-02T17:59:01.691923] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-02T17:59:01.873035] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-10. [2025-10-02T17:59:02.481758] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-02T17:59:02.673037] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-05. [2025-10-02T17:59:02.948787] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-02T17:59:02.950240] [INFO ] [REMOTE ] CEPU: Full fetch complete (39628 records). [2025-10-02T17:59:02.950325] [DEBUG] [VALIDATOR ] CEPU: Validating primary data. [2025-10-02T17:59:03.364235] [DEBUG] [VALIDATOR ] CEPU: All expected trading days are present. [2025-10-02T17:59:03.364326] [DEBUG] [VALIDATOR ] CEPU: Primary data validation passed. [2025-10-02T17:59:03.365044] [INFO ] [MAIN ] CEPU: Fetched primary data is valid. [2025-10-02T17:59:03.365142] [DEBUG] [LOCAL ] CEPU: Saving primary data. [2025-10-02T17:59:03.366153] [DEBUG] [LOCAL ] CEPU: Trimmed 39628 records to 26149 (keeping 200 days of data) [2025-10-02T17:59:03.473082] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-08. [2025-10-02T17:59:03.528190] [DEBUG] [LOCAL ] CEPU: Primary data saved (26149 records). [2025-10-02T17:59:03.528328] [INFO ] [MAIN ] CEPU: Full history saved. [2025-10-02T17:59:03.528424] [INFO ] [MAIN ] Update Progress: 426/2370 symbols completed. CEPU took 24.2s. Estimated remaining: 4h 29m 13s. Rate: 7.2 symbols/min [2025-10-02T17:59:03.727113] [INFO ] [MAIN ] CFND: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:59:03.727310] [DEBUG] [LOCAL ] CFND: No existing data file found in primary storage. [2025-10-02T17:59:03.727349] [WARN ] [MAIN ] CFND: No existing data found, performing full refresh instead. [2025-10-02T17:59:03.727476] [INFO ] [MAIN ] CFND: Wiping existing primary data before full refresh. [2025-10-02T17:59:03.727521] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-02T17:59:03.727565] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-02T17:59:03.727600] [INFO ] [MAIN ] CFND: Starting full primary refresh. [2025-10-02T17:59:04.043245] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-02T17:59:04.129728] [INFO ] [REMOTE ] CFND: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:59:04.272968] [INFO ] [REMOTE ] CFND: Fetching primary data for 2024-12. [2025-10-02T17:59:04.407943] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-02T17:59:04.494267] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T17:59:04.494572] [WARN ] [REMOTE ] CFND: No data returned for month 2024-12 [2025-10-02T17:59:04.494689] [FATAL] [REMOTE ] CFND: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T17:59:04.494753] [FATAL] [MAIN ] CFND: Failed to fetch primary data. [2025-10-02T17:59:04.494814] [WARN ] [MAIN ] CFND: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T17:59:04.494888] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-02T17:59:04.494951] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-02T17:59:04.494987] [INFO ] [LOCAL ] CFND: Starting deletion of derivative data. [2025-10-02T17:59:04.495078] [DEBUG] [LOCAL ] CFND: No derivative data file found to delete. [2025-10-02T17:59:04.495150] [INFO ] [MAIN ] Update Progress: 427/2370 symbols completed. CFND took 1.0s. Estimated remaining: 4h 28m 31s. Rate: 7.2 symbols/min [2025-10-02T17:59:04.709116] [INFO ] [MAIN ] CFR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:59:04.747833] [DEBUG] [LOCAL ] CFR: Loaded 33188 existing records from primary storage. [2025-10-02T17:59:04.748158] [INFO ] [MAIN ] CFR: Loaded 33188 existing records. [2025-10-02T17:59:04.954328] [WARN ] [MAIN ] CFR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:59:04.954578] [INFO ] [MAIN ] CFR: Wiping existing primary data before full refresh. [2025-10-02T17:59:04.954635] [INFO ] [LOCAL ] CFR: Starting deletion of primary data. [2025-10-02T17:59:04.955829] [DEBUG] [LOCAL ] CFR: Deleted primary data file. [2025-10-02T17:59:04.955893] [INFO ] [MAIN ] CFR: Starting full primary refresh. [2025-10-02T17:59:05.073012] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-06. [2025-10-02T17:59:05.354592] [INFO ] [REMOTE ] CFR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:59:05.873029] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-02. [2025-10-02T17:59:06.673000] [INFO ] [REMOTE ] CFR: Fetching primary data for 2024-12. [2025-10-02T17:59:06.914460] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-02T17:59:07.279239] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-02T17:59:07.473070] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-03. [2025-10-02T17:59:08.157691] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-02T17:59:08.273015] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-07. [2025-10-02T17:59:09.073013] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-01. [2025-10-02T17:59:09.287425] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-02T17:59:09.709083] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-02T17:59:09.873003] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-08. [2025-10-02T17:59:10.568990] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-02T17:59:10.673005] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-09. [2025-10-02T17:59:11.381302] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-02T17:59:11.473023] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-04. [2025-10-02T17:59:11.693582] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-02T17:59:12.273005] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-10. [2025-10-02T17:59:12.773054] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-02T17:59:12.773855] [INFO ] [REMOTE ] CEE: Full fetch complete (10190 records). [2025-10-02T17:59:12.773933] [DEBUG] [VALIDATOR ] CEE: Validating primary data. [2025-10-02T17:59:13.075734] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-02. [2025-10-02T17:59:13.204009] [DEBUG] [VALIDATOR ] CEE: All expected trading days are present. [2025-10-02T17:59:13.204155] [DEBUG] [VALIDATOR ] CEE: Primary data validation passed. [2025-10-02T17:59:13.204515] [INFO ] [MAIN ] CEE: Fetched primary data is valid. [2025-10-02T17:59:13.204675] [DEBUG] [LOCAL ] CEE: Saving primary data. [2025-10-02T17:59:13.205868] [DEBUG] [LOCAL ] CEE: Trimmed 10190 records to 5968 (keeping 200 days of data) [2025-10-02T17:59:13.241773] [DEBUG] [LOCAL ] CEE: Primary data saved (5968 records). [2025-10-02T17:59:13.242045] [INFO ] [MAIN ] CEE: Full history saved. [2025-10-02T17:59:13.242163] [INFO ] [MAIN ] Update Progress: 428/2370 symbols completed. CEE took 42.1s. Estimated remaining: 4h 28m 25s. Rate: 7.2 symbols/min [2025-10-02T17:59:13.448897] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-02T17:59:13.477831] [INFO ] [MAIN ] CGAU: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:59:13.533058] [DEBUG] [LOCAL ] CGAU: Loaded 42721 existing records from primary storage. [2025-10-02T17:59:13.533386] [INFO ] [MAIN ] CGAU: Loaded 42721 existing records. [2025-10-02T17:59:13.722938] [WARN ] [MAIN ] CGAU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:59:13.723171] [INFO ] [MAIN ] CGAU: Wiping existing primary data before full refresh. [2025-10-02T17:59:13.723227] [INFO ] [LOCAL ] CGAU: Starting deletion of primary data. [2025-10-02T17:59:13.724440] [DEBUG] [LOCAL ] CGAU: Deleted primary data file. [2025-10-02T17:59:13.724503] [INFO ] [MAIN ] CGAU: Starting full primary refresh. [2025-10-02T17:59:13.881690] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-05. [2025-10-02T17:59:14.147678] [INFO ] [REMOTE ] CGAU: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:59:14.509365] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-02T17:59:14.673018] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-03. [2025-10-02T17:59:15.473007] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-09. [2025-10-02T17:59:15.580430] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-02T17:59:16.190408] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-02T17:59:16.273023] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-06. [2025-10-02T17:59:17.072997] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-04. [2025-10-02T17:59:17.271031] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-02T17:59:17.872994] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2024-12. [2025-10-02T17:59:17.975880] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-02T17:59:18.566121] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-02T17:59:18.672993] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-05. [2025-10-02T17:59:19.473109] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-02T17:59:19.473229] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-10. [2025-10-02T17:59:19.895109] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-02T17:59:20.273009] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-01. [2025-10-02T17:59:20.846823] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-02T17:59:20.849255] [INFO ] [REMOTE ] CF: Full fetch complete (75261 records). [2025-10-02T17:59:20.849405] [DEBUG] [VALIDATOR ] CF: Validating primary data. [2025-10-02T17:59:21.078106] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-07. [2025-10-02T17:59:21.280008] [DEBUG] [VALIDATOR ] CF: All expected trading days are present. [2025-10-02T17:59:21.280123] [DEBUG] [VALIDATOR ] CF: Primary data validation passed. [2025-10-02T17:59:21.281026] [INFO ] [MAIN ] CF: Fetched primary data is valid. [2025-10-02T17:59:21.281095] [DEBUG] [LOCAL ] CF: Saving primary data. [2025-10-02T17:59:21.282697] [DEBUG] [LOCAL ] CF: Trimmed 75261 records to 52560 (keeping 200 days of data) [2025-10-02T17:59:21.628309] [DEBUG] [LOCAL ] CF: Primary data saved (52560 records). [2025-10-02T17:59:21.628521] [INFO ] [MAIN ] CF: Full history saved. [2025-10-02T17:59:21.628679] [INFO ] [MAIN ] Update Progress: 429/2370 symbols completed. CF took 40.7s. Estimated remaining: 4h 28m 17s. Rate: 7.2 symbols/min [2025-10-02T17:59:21.821006] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-02T17:59:21.868343] [INFO ] [MAIN ] CGV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:59:21.871800] [DEBUG] [LOCAL ] CGV: Loaded 1400 existing records from primary storage. [2025-10-02T17:59:21.871962] [INFO ] [MAIN ] CGV: Loaded 1400 existing records. [2025-10-02T17:59:21.883714] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-06. [2025-10-02T17:59:22.076360] [WARN ] [MAIN ] CGV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:59:22.076574] [INFO ] [MAIN ] CGV: Wiping existing primary data before full refresh. [2025-10-02T17:59:22.076626] [INFO ] [LOCAL ] CGV: Starting deletion of primary data. [2025-10-02T17:59:22.076893] [DEBUG] [LOCAL ] CGV: Deleted primary data file. [2025-10-02T17:59:22.076956] [INFO ] [MAIN ] CGV: Starting full primary refresh. [2025-10-02T17:59:22.475536] [INFO ] [REMOTE ] CGV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:59:22.672992] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-02. [2025-10-02T17:59:23.017077] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-02T17:59:23.047120] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-02T17:59:23.472994] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-08. [2025-10-02T17:59:23.978521] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-02T17:59:24.273003] [INFO ] [REMOTE ] CGV: Fetching primary data for 2024-12. [2025-10-02T17:59:24.802294] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-02T17:59:25.073027] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-01. [2025-10-02T17:59:25.123486] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-02T17:59:25.471637] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-02T17:59:25.873011] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-07. [2025-10-02T17:59:26.673028] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-03. [2025-10-02T17:59:27.224407] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-02T17:59:27.473036] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-08. [2025-10-02T17:59:27.940189] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-02T17:59:28.273018] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-04. [2025-10-02T17:59:28.651408] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-02T17:59:29.072999] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-09. [2025-10-02T17:59:29.776349] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-02T17:59:29.873029] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-09. [2025-10-02T17:59:30.512606] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-02T17:59:30.673049] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-05. [2025-10-02T17:59:31.193422] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-02T17:59:31.473001] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-10. [2025-10-02T17:59:32.155352] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-02T17:59:32.273019] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-10. [2025-10-02T17:59:32.514394] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-02T17:59:32.515914] [INFO ] [REMOTE ] CFR: Full fetch complete (48520 records). [2025-10-02T17:59:32.516045] [DEBUG] [VALIDATOR ] CFR: Validating primary data. [2025-10-02T17:59:32.943948] [DEBUG] [VALIDATOR ] CFR: All expected trading days are present. [2025-10-02T17:59:32.944051] [DEBUG] [VALIDATOR ] CFR: Primary data validation passed. [2025-10-02T17:59:32.944749] [INFO ] [MAIN ] CFR: Fetched primary data is valid. [2025-10-02T17:59:32.944818] [DEBUG] [LOCAL ] CFR: Saving primary data. [2025-10-02T17:59:32.946051] [DEBUG] [LOCAL ] CFR: Trimmed 48520 records to 33393 (keeping 200 days of data) [2025-10-02T17:59:33.075756] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-06. [2025-10-02T17:59:33.171404] [DEBUG] [LOCAL ] CFR: Primary data saved (33393 records). [2025-10-02T17:59:33.171553] [INFO ] [MAIN ] CFR: Full history saved. [2025-10-02T17:59:33.171661] [INFO ] [MAIN ] Update Progress: 430/2370 symbols completed. CFR took 28.7s. Estimated remaining: 4h 28m 24s. Rate: 7.2 symbols/min [2025-10-02T17:59:33.347773] [INFO ] [MAIN ] CHCT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:59:33.347998] [DEBUG] [LOCAL ] CHCT: No existing data file found in primary storage. [2025-10-02T17:59:33.348056] [WARN ] [MAIN ] CHCT: No existing data found, performing full refresh instead. [2025-10-02T17:59:33.348175] [INFO ] [MAIN ] CHCT: Wiping existing primary data before full refresh. [2025-10-02T17:59:33.348216] [INFO ] [LOCAL ] CHCT: Starting deletion of primary data. [2025-10-02T17:59:33.348257] [DEBUG] [LOCAL ] CHCT: No primary data file found to delete. [2025-10-02T17:59:33.348290] [INFO ] [MAIN ] CHCT: Starting full primary refresh. [2025-10-02T17:59:33.765194] [INFO ] [REMOTE ] CHCT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:59:33.770820] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-02T17:59:33.773140] [INFO ] [REMOTE ] CFG: Full fetch complete (77575 records). [2025-10-02T17:59:33.773250] [DEBUG] [VALIDATOR ] CFG: Validating primary data. [2025-10-02T17:59:33.880115] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2024-12. [2025-10-02T17:59:34.209501] [DEBUG] [VALIDATOR ] CFG: All expected trading days are present. [2025-10-02T17:59:34.209746] [DEBUG] [VALIDATOR ] CFG: Primary data validation passed. [2025-10-02T17:59:34.210636] [INFO ] [MAIN ] CFG: Fetched primary data is valid. [2025-10-02T17:59:34.210786] [DEBUG] [LOCAL ] CFG: Saving primary data. [2025-10-02T17:59:34.224454] [DEBUG] [LOCAL ] CFG: Trimmed 77575 records to 54014 (keeping 200 days of data) [2025-10-02T17:59:34.250355] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-02T17:59:34.600137] [DEBUG] [LOCAL ] CFG: Primary data saved (54014 records). [2025-10-02T17:59:34.600288] [INFO ] [MAIN ] CFG: Full history saved. [2025-10-02T17:59:34.600373] [INFO ] [MAIN ] Update Progress: 431/2370 symbols completed. CFG took 39.1s. Estimated remaining: 4h 27m 44s. Rate: 7.2 symbols/min [2025-10-02T17:59:34.678186] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-02. [2025-10-02T17:59:34.813025] [INFO ] [MAIN ] CHD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:59:34.871305] [DEBUG] [LOCAL ] CHD: Loaded 52113 existing records from primary storage. [2025-10-02T17:59:34.871623] [INFO ] [MAIN ] CHD: Loaded 52113 existing records. [2025-10-02T17:59:35.085885] [WARN ] [MAIN ] CHD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:59:35.089044] [INFO ] [MAIN ] CHD: Wiping existing primary data before full refresh. [2025-10-02T17:59:35.089196] [INFO ] [LOCAL ] CHD: Starting deletion of primary data. [2025-10-02T17:59:35.088743] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-02T17:59:35.092625] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-02T17:59:35.100957] [DEBUG] [LOCAL ] CHD: Deleted primary data file. [2025-10-02T17:59:35.101188] [INFO ] [MAIN ] CHD: Starting full primary refresh. [2025-10-02T17:59:35.473630] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-01. [2025-10-02T17:59:35.488636] [INFO ] [REMOTE ] CHD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:59:36.273005] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-07. [2025-10-02T17:59:36.331230] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-02T17:59:37.073031] [INFO ] [REMOTE ] CHD: Fetching primary data for 2024-12. [2025-10-02T17:59:37.745578] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-02T17:59:37.873010] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-03. [2025-10-02T17:59:38.315314] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-02T17:59:38.672974] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-02. [2025-10-02T17:59:38.791692] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-02T17:59:39.473004] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-01. [2025-10-02T17:59:39.694000] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-02T17:59:40.273044] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-04. [2025-10-02T17:59:40.690514] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-02T17:59:41.043444] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-02T17:59:41.072979] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-02. [2025-10-02T17:59:41.873009] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-05. [2025-10-02T17:59:42.201190] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-02T17:59:42.458290] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-02T17:59:42.673006] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-08. [2025-10-02T17:59:43.473039] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-06. [2025-10-02T17:59:43.889553] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-02T17:59:44.046825] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-02T17:59:44.273033] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-03. [2025-10-02T17:59:45.072992] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-03. [2025-10-02T17:59:45.154131] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-02T17:59:45.873021] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-04. [2025-10-02T17:59:46.672973] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-07. [2025-10-02T17:59:46.732989] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-02T17:59:47.040291] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-02T17:59:47.268861] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-02T17:59:47.473066] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-04. [2025-10-02T17:59:48.273068] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-05. [2025-10-02T17:59:49.072969] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-09. [2025-10-02T17:59:49.231367] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-02T17:59:49.489456] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-02T17:59:49.872995] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-08. [2025-10-02T17:59:50.204690] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-02T17:59:50.384838] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-02T17:59:50.673004] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-06. [2025-10-02T17:59:51.473017] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-09. [2025-10-02T17:59:51.555030] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-02T17:59:51.840512] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-02T17:59:52.272997] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-05. [2025-10-02T17:59:53.073026] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-10. [2025-10-02T17:59:53.519582] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-02T17:59:53.520368] [INFO ] [REMOTE ] CGV: Full fetch complete (2276 records). [2025-10-02T17:59:53.520448] [DEBUG] [VALIDATOR ] CGV: Validating primary data. [2025-10-02T17:59:53.879103] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-07. [2025-10-02T17:59:53.916516] [DEBUG] [VALIDATOR ] CGV: All expected trading days are present. [2025-10-02T17:59:53.916778] [DEBUG] [VALIDATOR ] CGV: Primary data validation passed. [2025-10-02T17:59:53.916940] [INFO ] [MAIN ] CGV: Fetched primary data is valid. [2025-10-02T17:59:53.917020] [DEBUG] [LOCAL ] CGV: Saving primary data. [2025-10-02T17:59:53.917828] [DEBUG] [LOCAL ] CGV: Trimmed 2276 records to 1408 (keeping 200 days of data) [2025-10-02T17:59:53.928049] [DEBUG] [LOCAL ] CGV: Primary data saved (1408 records). [2025-10-02T17:59:53.928196] [INFO ] [MAIN ] CGV: Full history saved. [2025-10-02T17:59:53.928772] [INFO ] [MAIN ] Update Progress: 432/2370 symbols completed. CGV took 32.3s. Estimated remaining: 4h 28m 26s. Rate: 7.2 symbols/min [2025-10-02T17:59:54.080022] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-02T17:59:54.166736] [INFO ] [MAIN ] CHE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:59:54.183761] [DEBUG] [LOCAL ] CHE: Loaded 15044 existing records from primary storage. [2025-10-02T17:59:54.184032] [INFO ] [MAIN ] CHE: Loaded 15044 existing records. [2025-10-02T17:59:54.377969] [WARN ] [MAIN ] CHE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:59:54.378244] [INFO ] [MAIN ] CHE: Wiping existing primary data before full refresh. [2025-10-02T17:59:54.378295] [INFO ] [LOCAL ] CHE: Starting deletion of primary data. [2025-10-02T17:59:54.378855] [DEBUG] [LOCAL ] CHE: Deleted primary data file. [2025-10-02T17:59:54.378916] [INFO ] [MAIN ] CHE: Starting full primary refresh. [2025-10-02T17:59:54.681200] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-06. [2025-10-02T17:59:54.777134] [INFO ] [REMOTE ] CHE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:59:55.071031] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-02T17:59:55.473049] [INFO ] [REMOTE ] CHE: Fetching primary data for 2024-12. [2025-10-02T17:59:56.191755] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-02T17:59:56.273034] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-07. [2025-10-02T17:59:56.290891] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-02T17:59:57.073022] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-10. [2025-10-02T17:59:57.873022] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-01. [2025-10-02T17:59:58.090408] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-02T17:59:58.334547] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-02T17:59:58.336113] [INFO ] [REMOTE ] CGAU: Full fetch complete (60568 records). [2025-10-02T17:59:58.336216] [DEBUG] [VALIDATOR ] CGAU: Validating primary data. [2025-10-02T17:59:58.336982] [FATAL] [VALIDATOR ] CGAU: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:59:58.337076] [FATAL] [MAIN ] CGAU: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:59:58.337123] [WARN ] [MAIN ] CGAU: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:59:58.337175] [INFO ] [LOCAL ] CGAU: Starting deletion of primary data. [2025-10-02T17:59:58.337236] [DEBUG] [LOCAL ] CGAU: No primary data file found to delete. [2025-10-02T17:59:58.337273] [INFO ] [LOCAL ] CGAU: Starting deletion of derivative data. [2025-10-02T17:59:58.337731] [DEBUG] [LOCAL ] CGAU: Deleted derivative data file. [2025-10-02T17:59:58.338145] [INFO ] [MAIN ] Update Progress: 433/2370 symbols completed. CGAU took 45.1s. Estimated remaining: 4h 27m 60s. Rate: 7.2 symbols/min [2025-10-02T17:59:58.525208] [INFO ] [MAIN ] CHGG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:59:58.577011] [DEBUG] [LOCAL ] CHGG: Loaded 47653 existing records from primary storage. [2025-10-02T17:59:58.577325] [INFO ] [MAIN ] CHGG: Loaded 47653 existing records. [2025-10-02T17:59:58.682356] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-08. [2025-10-02T17:59:58.779527] [WARN ] [MAIN ] CHGG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:59:58.780037] [INFO ] [MAIN ] CHGG: Wiping existing primary data before full refresh. [2025-10-02T17:59:58.780102] [INFO ] [LOCAL ] CHGG: Starting deletion of primary data. [2025-10-02T17:59:58.781335] [DEBUG] [LOCAL ] CHGG: Deleted primary data file. [2025-10-02T17:59:58.781399] [INFO ] [MAIN ] CHGG: Starting full primary refresh. [2025-10-02T17:59:58.927351] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-02T17:59:59.204464] [INFO ] [REMOTE ] CHGG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:59:59.473047] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-08. [2025-10-02T18:00:00.273040] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2024-12. [2025-10-02T18:00:00.591248] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-02T18:00:00.857419] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-02T18:00:01.073017] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-02. [2025-10-02T18:00:01.873016] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-09. [2025-10-02T18:00:01.970365] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-02T18:00:02.673026] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-03. [2025-10-02T18:00:02.802873] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2024-12 (2.53 seconds). [2025-10-02T18:00:03.473011] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-09. [2025-10-02T18:00:03.734845] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-02T18:00:03.861862] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-02T18:00:04.273035] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-10. [2025-10-02T18:00:04.395400] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-02T18:00:05.073013] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-10. [2025-10-02T18:00:05.873021] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-04. [2025-10-02T18:00:05.925674] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-02T18:00:05.929179] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-02T18:00:05.930980] [INFO ] [REMOTE ] CHCT: Full fetch complete (34788 records). [2025-10-02T18:00:05.931153] [DEBUG] [VALIDATOR ] CHCT: Validating primary data. [2025-10-02T18:00:05.931469] [INFO ] [REMOTE ] CHD: Full fetch complete (74420 records). [2025-10-02T18:00:05.931887] [FATAL] [VALIDATOR ] CHCT: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:00:05.932105] [FATAL] [MAIN ] CHCT: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:00:05.932045] [DEBUG] [VALIDATOR ] CHD: Validating primary data. [2025-10-02T18:00:05.932318] [WARN ] [MAIN ] CHCT: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:00:05.932398] [INFO ] [LOCAL ] CHCT: Starting deletion of primary data. [2025-10-02T18:00:05.932547] [DEBUG] [LOCAL ] CHCT: No primary data file found to delete. [2025-10-02T18:00:05.932608] [INFO ] [LOCAL ] CHCT: Starting deletion of derivative data. [2025-10-02T18:00:05.932739] [DEBUG] [LOCAL ] CHCT: No derivative data file found to delete. [2025-10-02T18:00:05.960316] [INFO ] [MAIN ] Update Progress: 434/2370 symbols completed. CHCT took 32.8s. Estimated remaining: 4h 27m 49s. Rate: 7.2 symbols/min [2025-10-02T18:00:06.343833] [INFO ] [MAIN ] CHH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:00:06.598259] [DEBUG] [VALIDATOR ] CHD: All expected trading days are present. [2025-10-02T18:00:06.598387] [DEBUG] [VALIDATOR ] CHD: Primary data validation passed. [2025-10-02T18:00:06.599335] [INFO ] [MAIN ] CHD: Fetched primary data is valid. [2025-10-02T18:00:06.599423] [DEBUG] [LOCAL ] CHD: Saving primary data. [2025-10-02T18:00:06.601113] [DEBUG] [LOCAL ] CHD: Trimmed 74420 records to 52490 (keeping 200 days of data) [2025-10-02T18:00:06.679860] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-01. [2025-10-02T18:00:06.707252] [DEBUG] [LOCAL ] CHH: Loaded 32022 existing records from primary storage. [2025-10-02T18:00:06.709638] [INFO ] [MAIN ] CHH: Loaded 32022 existing records. [2025-10-02T18:00:06.951068] [WARN ] [MAIN ] CHH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:00:06.952474] [INFO ] [MAIN ] CHH: Wiping existing primary data before full refresh. [2025-10-02T18:00:06.953018] [INFO ] [LOCAL ] CHH: Starting deletion of primary data. [2025-10-02T18:00:06.955477] [DEBUG] [LOCAL ] CHH: Deleted primary data file. [2025-10-02T18:00:06.955979] [INFO ] [MAIN ] CHH: Starting full primary refresh. [2025-10-02T18:00:07.067930] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-02T18:00:07.473355] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-05. [2025-10-02T18:00:07.516721] [INFO ] [REMOTE ] CHH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:00:07.629259] [DEBUG] [LOCAL ] CHD: Primary data saved (52490 records). [2025-10-02T18:00:07.629418] [INFO ] [MAIN ] CHD: Full history saved. [2025-10-02T18:00:07.629505] [INFO ] [MAIN ] Update Progress: 435/2370 symbols completed. CHD took 33.0s. Estimated remaining: 4h 27m 11s. Rate: 7.2 symbols/min [2025-10-02T18:00:07.831025] [INFO ] [MAIN ] CHMI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:00:07.853134] [DEBUG] [LOCAL ] CHMI: Loaded 21894 existing records from primary storage. [2025-10-02T18:00:07.853404] [INFO ] [MAIN ] CHMI: Loaded 21894 existing records. [2025-10-02T18:00:08.083671] [WARN ] [MAIN ] CHMI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:00:08.083916] [INFO ] [MAIN ] CHMI: Wiping existing primary data before full refresh. [2025-10-02T18:00:08.083969] [INFO ] [LOCAL ] CHMI: Starting deletion of primary data. [2025-10-02T18:00:08.084769] [DEBUG] [LOCAL ] CHMI: Deleted primary data file. [2025-10-02T18:00:08.084833] [INFO ] [MAIN ] CHMI: Starting full primary refresh. [2025-10-02T18:00:08.299014] [INFO ] [REMOTE ] CHH: Fetching primary data for 2024-12. [2025-10-02T18:00:08.502535] [INFO ] [REMOTE ] CHMI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:00:08.550234] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-02T18:00:08.553445] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-02T18:00:09.073013] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-06. [2025-10-02T18:00:09.549120] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-02T18:00:09.872982] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-02. [2025-10-02T18:00:10.141638] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-02T18:00:10.673001] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-07. [2025-10-02T18:00:11.283485] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-02T18:00:11.473009] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-01. [2025-10-02T18:00:11.688757] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-02T18:00:12.273027] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-08. [2025-10-02T18:00:12.838114] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-02T18:00:13.002067] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-02T18:00:13.073027] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-09. [2025-10-02T18:00:13.872997] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-03. [2025-10-02T18:00:14.224282] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-02T18:00:14.673017] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-10. [2025-10-02T18:00:15.472982] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2024-12. [2025-10-02T18:00:15.609586] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-02T18:00:16.273027] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-04. [2025-10-02T18:00:16.832579] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-02T18:00:17.073029] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-02. [2025-10-02T18:00:17.416114] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-10 (2.74 seconds). [2025-10-02T18:00:17.417416] [INFO ] [REMOTE ] CHE: Full fetch complete (20052 records). [2025-10-02T18:00:17.417507] [DEBUG] [VALIDATOR ] CHE: Validating primary data. [2025-10-02T18:00:17.849832] [DEBUG] [VALIDATOR ] CHE: All expected trading days are present. [2025-10-02T18:00:17.849999] [DEBUG] [VALIDATOR ] CHE: Primary data validation passed. [2025-10-02T18:00:17.850497] [INFO ] [MAIN ] CHE: Fetched primary data is valid. [2025-10-02T18:00:17.850587] [DEBUG] [LOCAL ] CHE: Saving primary data. [2025-10-02T18:00:17.851788] [DEBUG] [LOCAL ] CHE: Trimmed 20052 records to 15178 (keeping 200 days of data) [2025-10-02T18:00:17.895862] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-01. [2025-10-02T18:00:17.985625] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-02T18:00:18.019800] [DEBUG] [LOCAL ] CHE: Primary data saved (15178 records). [2025-10-02T18:00:18.020001] [INFO ] [MAIN ] CHE: Full history saved. [2025-10-02T18:00:18.020197] [INFO ] [MAIN ] Update Progress: 436/2370 symbols completed. CHE took 24.1s. Estimated remaining: 4h 27m 12s. Rate: 7.2 symbols/min [2025-10-02T18:00:18.224247] [INFO ] [MAIN ] CHN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:00:18.232433] [DEBUG] [LOCAL ] CHN: Loaded 4818 existing records from primary storage. [2025-10-02T18:00:18.232847] [INFO ] [MAIN ] CHN: Loaded 4818 existing records. [2025-10-02T18:00:18.427726] [WARN ] [MAIN ] CHN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:00:18.428028] [INFO ] [MAIN ] CHN: Wiping existing primary data before full refresh. [2025-10-02T18:00:18.428133] [INFO ] [LOCAL ] CHN: Starting deletion of primary data. [2025-10-02T18:00:18.428540] [DEBUG] [LOCAL ] CHN: Deleted primary data file. [2025-10-02T18:00:18.428637] [INFO ] [MAIN ] CHN: Starting full primary refresh. [2025-10-02T18:00:18.556894] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-02T18:00:18.678091] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-03. [2025-10-02T18:00:18.870619] [INFO ] [REMOTE ] CHN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:00:19.061086] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-02T18:00:19.472994] [INFO ] [REMOTE ] CHN: Fetching primary data for 2024-12. [2025-10-02T18:00:20.095752] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-02T18:00:20.272981] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-05. [2025-10-02T18:00:20.424555] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-02T18:00:21.072999] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-01. [2025-10-02T18:00:21.863390] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-02T18:00:21.873904] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-04. [2025-10-02T18:00:22.538744] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-02T18:00:22.672988] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-02. [2025-10-02T18:00:23.290678] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-02T18:00:23.472998] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-03. [2025-10-02T18:00:23.738037] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-02T18:00:24.095831] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-02T18:00:24.273010] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-04. [2025-10-02T18:00:24.883191] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-02T18:00:25.073037] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-02. [2025-10-02T18:00:25.873029] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-05. [2025-10-02T18:00:26.145857] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-02T18:00:26.466693] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-02T18:00:26.673056] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-06. [2025-10-02T18:00:27.473206] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-05. [2025-10-02T18:00:28.272995] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-03. [2025-10-02T18:00:28.748892] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-02T18:00:28.791584] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-02T18:00:29.073036] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-07. [2025-10-02T18:00:29.444400] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-02T18:00:29.873014] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-06. [2025-10-02T18:00:30.295516] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-02T18:00:30.628833] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-02T18:00:30.673002] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-08. [2025-10-02T18:00:31.473010] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-04. [2025-10-02T18:00:32.168503] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-02T18:00:32.272997] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-09. [2025-10-02T18:00:32.886860] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-02T18:00:33.073030] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-07. [2025-10-02T18:00:33.510315] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-02T18:00:33.873016] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-06. [2025-10-02T18:00:34.291120] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-02T18:00:34.673002] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-10. [2025-10-02T18:00:35.096161] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-02T18:00:35.473031] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-07. [2025-10-02T18:00:35.805863] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-02T18:00:35.808037] [INFO ] [REMOTE ] CHGG: Full fetch complete (70453 records). [2025-10-02T18:00:35.808203] [DEBUG] [VALIDATOR ] CHGG: Validating primary data. [2025-10-02T18:00:36.232845] [DEBUG] [VALIDATOR ] CHGG: All expected trading days are present. [2025-10-02T18:00:36.232965] [DEBUG] [VALIDATOR ] CHGG: Primary data validation passed. [2025-10-02T18:00:36.233860] [INFO ] [MAIN ] CHGG: Fetched primary data is valid. [2025-10-02T18:00:36.233930] [DEBUG] [LOCAL ] CHGG: Saving primary data. [2025-10-02T18:00:36.235518] [DEBUG] [LOCAL ] CHGG: Trimmed 70453 records to 47996 (keeping 200 days of data) [2025-10-02T18:00:36.292580] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-08. [2025-10-02T18:00:36.490452] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-02T18:00:36.563548] [DEBUG] [LOCAL ] CHGG: Primary data saved (47996 records). [2025-10-02T18:00:36.563768] [INFO ] [MAIN ] CHGG: Full history saved. [2025-10-02T18:00:36.565523] [INFO ] [MAIN ] Update Progress: 437/2370 symbols completed. CHGG took 38.2s. Estimated remaining: 4h 27m 49s. Rate: 7.2 symbols/min [2025-10-02T18:00:37.063048] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-02T18:00:37.073013] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-05. [2025-10-02T18:00:37.873051] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-09. [2025-10-02T18:00:38.213301] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-02T18:00:38.478931] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-02T18:00:38.673012] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-08. [2025-10-02T18:00:39.473071] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-10. [2025-10-02T18:00:39.993165] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-02T18:00:39.999963] [INFO ] [REMOTE ] CHN: Full fetch complete (7446 records). [2025-10-02T18:00:40.000115] [DEBUG] [VALIDATOR ] CHN: Validating primary data. [2025-10-02T18:00:40.041509] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-02T18:00:40.279156] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-09. [2025-10-02T18:00:40.541157] [DEBUG] [VALIDATOR ] CHN: All expected trading days are present. [2025-10-02T18:00:40.541244] [DEBUG] [VALIDATOR ] CHN: Primary data validation passed. [2025-10-02T18:00:40.541522] [INFO ] [MAIN ] CHN: Fetched primary data is valid. [2025-10-02T18:00:40.541618] [DEBUG] [LOCAL ] CHN: Saving primary data. [2025-10-02T18:00:40.542665] [DEBUG] [LOCAL ] CHN: Trimmed 7446 records to 4849 (keeping 200 days of data) [2025-10-02T18:00:40.581192] [DEBUG] [LOCAL ] CHN: Primary data saved (4849 records). [2025-10-02T18:00:40.581379] [INFO ] [MAIN ] CHN: Full history saved. [2025-10-02T18:00:40.581603] [INFO ] [MAIN ] Update Progress: 438/2370 symbols completed. CHN took 22.6s. Estimated remaining: 4h 27m 22s. Rate: 7.2 symbols/min [2025-10-02T18:00:41.073068] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-06. [2025-10-02T18:00:41.552162] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-02T18:00:41.873008] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-10. [2025-10-02T18:00:42.203815] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-02T18:00:42.673010] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-07. [2025-10-02T18:00:43.084928] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-02T18:00:43.086866] [INFO ] [REMOTE ] CHH: Full fetch complete (46571 records). [2025-10-02T18:00:43.086997] [DEBUG] [VALIDATOR ] CHH: Validating primary data. [2025-10-02T18:00:43.545971] [DEBUG] [VALIDATOR ] CHH: All expected trading days are present. [2025-10-02T18:00:43.546782] [DEBUG] [VALIDATOR ] CHH: Primary data validation passed. [2025-10-02T18:00:43.547617] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-02T18:00:43.548452] [INFO ] [MAIN ] CHH: Fetched primary data is valid. [2025-10-02T18:00:43.553562] [DEBUG] [LOCAL ] CHH: Saving primary data. [2025-10-02T18:00:43.554341] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-08. [2025-10-02T18:00:43.557062] [DEBUG] [LOCAL ] CHH: Trimmed 46571 records to 32209 (keeping 200 days of data) [2025-10-02T18:00:43.789703] [DEBUG] [LOCAL ] CHH: Primary data saved (32209 records). [2025-10-02T18:00:43.789900] [INFO ] [MAIN ] CHH: Full history saved. [2025-10-02T18:00:43.790047] [INFO ] [MAIN ] Update Progress: 439/2370 symbols completed. CHH took 37.8s. Estimated remaining: 4h 26m 51s. Rate: 7.2 symbols/min [2025-10-02T18:00:44.640040] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-02T18:00:44.644759] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-09. [2025-10-02T18:00:45.614771] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-02T18:00:45.620832] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-10. [2025-10-02T18:00:46.311856] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-02T18:00:46.313440] [INFO ] [REMOTE ] CHMI: Full fetch complete (31812 records). [2025-10-02T18:00:46.313553] [DEBUG] [VALIDATOR ] CHMI: Validating primary data. [2025-10-02T18:00:46.731888] [DEBUG] [VALIDATOR ] CHMI: All expected trading days are present. [2025-10-02T18:00:46.731976] [DEBUG] [VALIDATOR ] CHMI: Primary data validation passed. [2025-10-02T18:00:46.732512] [INFO ] [MAIN ] CHMI: Fetched primary data is valid. [2025-10-02T18:00:46.732566] [DEBUG] [LOCAL ] CHMI: Saving primary data. [2025-10-02T18:00:46.733462] [DEBUG] [LOCAL ] CHMI: Trimmed 31812 records to 22017 (keeping 200 days of data) [2025-10-02T18:00:46.882894] [DEBUG] [LOCAL ] CHMI: Primary data saved (22017 records). [2025-10-02T18:00:46.883080] [INFO ] [MAIN ] CHMI: Full history saved. [2025-10-02T18:00:46.883214] [INFO ] [MAIN ] Update Progress: 440/2370 symbols completed. CHMI took 39.3s. Estimated remaining: 4h 26m 20s. Rate: 7.2 symbols/min [2025-10-02T18:00:47.525055] [INFO ] [MAIN ] CI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:00:47.601913] [DEBUG] [LOCAL ] CI: No existing data file found in primary storage. [2025-10-02T18:00:47.742538] [INFO ] [MAIN ] CHPT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:00:47.741225] [WARN ] [MAIN ] CI: No existing data found, performing full refresh instead. [2025-10-02T18:00:47.731904] [INFO ] [MAIN ] CHT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:00:47.760422] [DEBUG] [LOCAL ] CHT: No existing data file found in primary storage. [2025-10-02T18:00:47.760237] [INFO ] [MAIN ] CI: Wiping existing primary data before full refresh. [2025-10-02T18:00:47.765281] [INFO ] [MAIN ] CHWY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:00:47.765393] [WARN ] [MAIN ] CHT: No existing data found, performing full refresh instead. [2025-10-02T18:00:47.760946] [INFO ] [LOCAL ] CI: Starting deletion of primary data. [2025-10-02T18:00:47.765817] [DEBUG] [LOCAL ] CI: No primary data file found to delete. [2025-10-02T18:00:47.765886] [INFO ] [MAIN ] CI: Starting full primary refresh. [2025-10-02T18:00:47.782809] [INFO ] [MAIN ] CHT: Wiping existing primary data before full refresh. [2025-10-02T18:00:47.796442] [DEBUG] [LOCAL ] CHWY: No existing data file found in primary storage. [2025-10-02T18:00:47.796795] [INFO ] [LOCAL ] CHT: Starting deletion of primary data. [2025-10-02T18:00:47.796900] [DEBUG] [LOCAL ] CHT: No primary data file found to delete. [2025-10-02T18:00:47.796962] [WARN ] [MAIN ] CHWY: No existing data found, performing full refresh instead. [2025-10-02T18:00:47.797095] [INFO ] [MAIN ] CHT: Starting full primary refresh. [2025-10-02T18:00:47.797237] [INFO ] [MAIN ] CHWY: Wiping existing primary data before full refresh. [2025-10-02T18:00:47.850111] [INFO ] [LOCAL ] CHWY: Starting deletion of primary data. [2025-10-02T18:00:47.962484] [DEBUG] [LOCAL ] CHWY: No primary data file found to delete. [2025-10-02T18:00:48.001701] [INFO ] [MAIN ] CHWY: Starting full primary refresh. [2025-10-02T18:00:48.318792] [DEBUG] [LOCAL ] CHPT: Loaded 48646 existing records from primary storage. [2025-10-02T18:00:48.353995] [INFO ] [MAIN ] CHPT: Loaded 48646 existing records. [2025-10-02T18:00:49.006535] [INFO ] [REMOTE ] CI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:00:49.043301] [INFO ] [REMOTE ] CI: Fetching primary data for 2024-12. [2025-10-02T18:00:49.109018] [INFO ] [REMOTE ] CHT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:00:49.120867] [INFO ] [REMOTE ] CHT: Fetching primary data for 2024-12. [2025-10-02T18:00:49.211481] [WARN ] [MAIN ] CHPT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:00:49.238335] [INFO ] [MAIN ] CHPT: Wiping existing primary data before full refresh. [2025-10-02T18:00:49.246860] [INFO ] [LOCAL ] CHPT: Starting deletion of primary data. [2025-10-02T18:00:49.253714] [DEBUG] [LOCAL ] CHPT: Deleted primary data file. [2025-10-02T18:00:49.258988] [INFO ] [MAIN ] CHPT: Starting full primary refresh. [2025-10-02T18:00:49.467524] [INFO ] [REMOTE ] CHWY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:00:49.468604] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2024-12. [2025-10-02T18:00:49.762692] [INFO ] [REMOTE ] CHPT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:00:49.763024] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2024-12. [2025-10-02T18:00:50.136097] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-02T18:00:50.140541] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-01. [2025-10-02T18:00:50.785117] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-02T18:00:50.797017] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-01. [2025-10-02T18:00:51.111565] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-02T18:00:51.115485] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-02. [2025-10-02T18:00:51.711778] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-10-02T18:00:51.723725] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-01. [2025-10-02T18:00:51.984123] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-10-02T18:00:52.067535] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-02T18:00:52.272973] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-03. [2025-10-02T18:00:52.365272] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-02T18:00:53.072996] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-02. [2025-10-02T18:00:53.227430] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-02T18:00:53.329414] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-02T18:00:53.873037] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-02. [2025-10-02T18:00:54.594421] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-02T18:00:54.673052] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-03. [2025-10-02T18:00:55.473028] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-01. [2025-10-02T18:00:55.549207] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-02T18:00:56.273020] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-03. [2025-10-02T18:00:56.346106] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-02T18:00:57.073013] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-04. [2025-10-02T18:00:57.430823] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-02T18:00:57.873016] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-04. [2025-10-02T18:00:58.361071] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-02T18:00:58.672966] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-04. [2025-10-02T18:00:58.961033] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-02T18:00:59.053999] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-02T18:00:59.473012] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-05. [2025-10-02T18:01:00.272986] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-02. [2025-10-02T18:01:00.444224] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-02T18:01:01.073010] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-05. [2025-10-02T18:01:01.593841] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-02T18:01:01.873195] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-06. [2025-10-02T18:01:02.587229] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-10-02T18:01:02.673023] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-03. [2025-10-02T18:01:03.352363] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-10-02T18:01:03.473017] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-06. [2025-10-02T18:01:03.700527] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-02T18:01:04.273043] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-07. [2025-10-02T18:01:04.904212] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-02T18:01:05.073027] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-04. [2025-10-02T18:01:05.566268] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-02T18:01:05.872982] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-07. [2025-10-02T18:01:06.235734] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-02T18:01:06.673002] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-08. [2025-10-02T18:01:07.338674] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-02T18:01:07.472989] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-05. [2025-10-02T18:01:07.879723] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-02T18:01:08.273016] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-05. [2025-10-02T18:01:08.509872] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-02T18:01:09.073046] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-09. [2025-10-02T18:01:09.406704] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-02T18:01:09.669897] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-02T18:01:09.873003] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-06. [2025-10-02T18:01:10.334877] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-02T18:01:10.672996] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-06. [2025-10-02T18:01:11.473051] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-08. [2025-10-02T18:01:11.649977] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-02T18:01:11.831752] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-02T18:01:12.273016] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-07. [2025-10-02T18:01:13.072970] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-10. [2025-10-02T18:01:13.145071] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-02T18:01:13.269235] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-02T18:01:13.872996] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-09. [2025-10-02T18:01:14.672972] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-07. [2025-10-02T18:01:14.754766] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-02T18:01:14.760178] [INFO ] [REMOTE ] CI: Full fetch complete (72358 records). [2025-10-02T18:01:14.760366] [DEBUG] [VALIDATOR ] CI: Validating primary data. [2025-10-02T18:01:15.198519] [DEBUG] [VALIDATOR ] CI: All expected trading days are present. [2025-10-02T18:01:15.198605] [DEBUG] [VALIDATOR ] CI: Primary data validation passed. [2025-10-02T18:01:15.199384] [INFO ] [MAIN ] CI: Fetched primary data is valid. [2025-10-02T18:01:15.199452] [DEBUG] [LOCAL ] CI: Saving primary data. [2025-10-02T18:01:15.200882] [DEBUG] [LOCAL ] CI: Trimmed 72358 records to 50086 (keeping 200 days of data) [2025-10-02T18:01:15.487261] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-08. [2025-10-02T18:01:15.527770] [DEBUG] [LOCAL ] CI: Primary data saved (50086 records). [2025-10-02T18:01:15.527900] [INFO ] [MAIN ] CI: Full history saved. [2025-10-02T18:01:15.528040] [INFO ] [MAIN ] Update Progress: 441/2370 symbols completed. CI took 28.6s. Estimated remaining: 4h 27m 41s. Rate: 7.2 symbols/min [2025-10-02T18:01:15.716684] [INFO ] [MAIN ] CIA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:01:15.735154] [DEBUG] [LOCAL ] CIA: Loaded 17039 existing records from primary storage. [2025-10-02T18:01:15.735410] [INFO ] [MAIN ] CIA: Loaded 17039 existing records. [2025-10-02T18:01:15.942439] [WARN ] [MAIN ] CIA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:01:15.942844] [INFO ] [MAIN ] CIA: Wiping existing primary data before full refresh. [2025-10-02T18:01:15.942928] [INFO ] [LOCAL ] CIA: Starting deletion of primary data. [2025-10-02T18:01:15.954142] [DEBUG] [LOCAL ] CIA: Deleted primary data file. [2025-10-02T18:01:15.975181] [INFO ] [MAIN ] CIA: Starting full primary refresh. [2025-10-02T18:01:16.053778] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-02T18:01:16.284572] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-10. [2025-10-02T18:01:16.391146] [INFO ] [REMOTE ] CIA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:01:16.495331] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-02T18:01:17.072994] [INFO ] [REMOTE ] CIA: Fetching primary data for 2024-12. [2025-10-02T18:01:17.179421] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-10-02T18:01:17.872997] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-08. [2025-10-02T18:01:18.084104] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-02T18:01:18.274621] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-02T18:01:18.277019] [INFO ] [REMOTE ] CHWY: Full fetch complete (77633 records). [2025-10-02T18:01:18.277195] [DEBUG] [VALIDATOR ] CHWY: Validating primary data. [2025-10-02T18:01:18.686706] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-09. [2025-10-02T18:01:18.729955] [DEBUG] [VALIDATOR ] CHWY: All expected trading days are present. [2025-10-02T18:01:18.730045] [DEBUG] [VALIDATOR ] CHWY: Primary data validation passed. [2025-10-02T18:01:18.730922] [INFO ] [MAIN ] CHWY: Fetched primary data is valid. [2025-10-02T18:01:18.730990] [DEBUG] [LOCAL ] CHWY: Saving primary data. [2025-10-02T18:01:18.732811] [DEBUG] [LOCAL ] CHWY: Trimmed 77633 records to 54044 (keeping 200 days of data) [2025-10-02T18:01:19.085483] [DEBUG] [LOCAL ] CHWY: Primary data saved (54044 records). [2025-10-02T18:01:19.085976] [INFO ] [MAIN ] CHWY: Full history saved. [2025-10-02T18:01:19.086121] [INFO ] [MAIN ] Update Progress: 442/2370 symbols completed. CHWY took 32.2s. Estimated remaining: 4h 27m 12s. Rate: 7.2 symbols/min [2025-10-02T18:01:19.273113] [INFO ] [MAIN ] CIB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:01:19.273639] [DEBUG] [LOCAL ] CIB: No existing data file found in primary storage. [2025-10-02T18:01:19.273899] [WARN ] [MAIN ] CIB: No existing data found, performing full refresh instead. [2025-10-02T18:01:19.274123] [INFO ] [MAIN ] CIB: Wiping existing primary data before full refresh. [2025-10-02T18:01:19.274187] [INFO ] [LOCAL ] CIB: Starting deletion of primary data. [2025-10-02T18:01:19.274272] [DEBUG] [LOCAL ] CIB: No primary data file found to delete. [2025-10-02T18:01:19.274344] [INFO ] [MAIN ] CIB: Starting full primary refresh. [2025-10-02T18:01:19.503521] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-01. [2025-10-02T18:01:19.697114] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-02T18:01:19.733437] [INFO ] [REMOTE ] CIB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:01:19.963998] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-02T18:01:20.273027] [INFO ] [REMOTE ] CIB: Fetching primary data for 2024-12. [2025-10-02T18:01:20.609869] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-02T18:01:21.072963] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-02. [2025-10-02T18:01:21.208133] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-02T18:01:21.873035] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-10. [2025-10-02T18:01:22.092531] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-02T18:01:22.673049] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-09. [2025-10-02T18:01:22.701747] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-02T18:01:22.704086] [INFO ] [REMOTE ] CHT: Full fetch complete (27487 records). [2025-10-02T18:01:22.704209] [DEBUG] [VALIDATOR ] CHT: Validating primary data. [2025-10-02T18:01:23.145414] [DEBUG] [VALIDATOR ] CHT: All expected trading days are present. [2025-10-02T18:01:23.145504] [DEBUG] [VALIDATOR ] CHT: Primary data validation passed. [2025-10-02T18:01:23.146022] [INFO ] [MAIN ] CHT: Fetched primary data is valid. [2025-10-02T18:01:23.146088] [DEBUG] [LOCAL ] CHT: Saving primary data. [2025-10-02T18:01:23.146993] [DEBUG] [LOCAL ] CHT: Trimmed 27487 records to 19829 (keeping 200 days of data) [2025-10-02T18:01:23.293395] [DEBUG] [LOCAL ] CHT: Primary data saved (19829 records). [2025-10-02T18:01:23.293546] [INFO ] [MAIN ] CHT: Full history saved. [2025-10-02T18:01:23.293625] [INFO ] [MAIN ] Update Progress: 443/2370 symbols completed. CHT took 36.4s. Estimated remaining: 4h 26m 45s. Rate: 7.2 symbols/min [2025-10-02T18:01:23.477527] [INFO ] [MAIN ] CICB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:01:23.477708] [DEBUG] [LOCAL ] CICB: No existing data file found in primary storage. [2025-10-02T18:01:23.476829] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-01. [2025-10-02T18:01:23.478676] [WARN ] [MAIN ] CICB: No existing data found, performing full refresh instead. [2025-10-02T18:01:23.478844] [INFO ] [MAIN ] CICB: Wiping existing primary data before full refresh. [2025-10-02T18:01:23.478911] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-02T18:01:23.479015] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-02T18:01:23.479078] [INFO ] [MAIN ] CICB: Starting full primary refresh. [2025-10-02T18:01:23.898075] [INFO ] [REMOTE ] CICB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:01:24.095836] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-02T18:01:24.272995] [INFO ] [REMOTE ] CICB: Fetching primary data for 2024-12. [2025-10-02T18:01:24.795496] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-10-02T18:01:24.890899] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-02T18:01:25.073008] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-01. [2025-10-02T18:01:25.496233] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-02T18:01:25.872995] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-03. [2025-10-02T18:01:26.673089] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-02. [2025-10-02T18:01:26.804364] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-02T18:01:26.936098] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-10-02T18:01:27.473071] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-03. [2025-10-02T18:01:27.746696] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-10-02T18:01:28.272997] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-04. [2025-10-02T18:01:28.707938] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-02T18:01:29.073038] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-02. [2025-10-02T18:01:29.873019] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-10. [2025-10-02T18:01:30.326220] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-02T18:01:30.673003] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-03. [2025-10-02T18:01:31.130012] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-02T18:01:31.131428] [INFO ] [REMOTE ] CHPT: Full fetch complete (72386 records). [2025-10-02T18:01:31.131526] [DEBUG] [VALIDATOR ] CHPT: Validating primary data. [2025-10-02T18:01:31.132229] [FATAL] [VALIDATOR ] CHPT: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:01:31.132319] [FATAL] [MAIN ] CHPT: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:01:31.132364] [WARN ] [MAIN ] CHPT: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:01:31.132425] [INFO ] [LOCAL ] CHPT: Starting deletion of primary data. [2025-10-02T18:01:31.132529] [DEBUG] [LOCAL ] CHPT: No primary data file found to delete. [2025-10-02T18:01:31.132600] [INFO ] [LOCAL ] CHPT: Starting deletion of derivative data. [2025-10-02T18:01:31.133330] [DEBUG] [LOCAL ] CHPT: Deleted derivative data file. [2025-10-02T18:01:31.133473] [INFO ] [MAIN ] Update Progress: 444/2370 symbols completed. CHPT took 44.2s. Estimated remaining: 4h 26m 35s. Rate: 7.2 symbols/min [2025-10-02T18:01:31.322663] [INFO ] [MAIN ] CIEN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:01:31.381491] [DEBUG] [LOCAL ] CIEN: Loaded 52071 existing records from primary storage. [2025-10-02T18:01:31.381864] [INFO ] [MAIN ] CIEN: Loaded 52071 existing records. [2025-10-02T18:01:31.478183] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-04. [2025-10-02T18:01:31.596851] [WARN ] [MAIN ] CIEN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:01:31.597113] [INFO ] [MAIN ] CIEN: Wiping existing primary data before full refresh. [2025-10-02T18:01:31.597187] [INFO ] [LOCAL ] CIEN: Starting deletion of primary data. [2025-10-02T18:01:31.598474] [DEBUG] [LOCAL ] CIEN: Deleted primary data file. [2025-10-02T18:01:31.598538] [INFO ] [MAIN ] CIEN: Starting full primary refresh. [2025-10-02T18:01:32.041376] [INFO ] [REMOTE ] CIEN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:01:32.157965] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-02T18:01:32.273086] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-05. [2025-10-02T18:01:32.622526] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-02T18:01:32.626367] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-02T18:01:33.073054] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2024-12. [2025-10-02T18:01:33.873033] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-04. [2025-10-02T18:01:34.601686] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-02T18:01:34.673040] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-06. [2025-10-02T18:01:35.194236] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-02T18:01:35.239487] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-02T18:01:35.473052] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-07. [2025-10-02T18:01:35.717055] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-07 (0.24 seconds). [2025-10-02T18:01:36.272994] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-08. [2025-10-02T18:01:36.633689] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-02T18:01:37.073025] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-05. [2025-10-02T18:01:37.873010] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-01. [2025-10-02T18:01:38.350324] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-02T18:01:38.673003] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-05. [2025-10-02T18:01:39.472984] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-06. [2025-10-02T18:01:39.555889] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-02T18:01:39.681961] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-02T18:01:40.273024] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-02. [2025-10-02T18:01:40.800624] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-02T18:01:41.073005] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-09. [2025-10-02T18:01:41.410026] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-02T18:01:41.687852] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-02T18:01:41.873037] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-10. [2025-10-02T18:01:42.263203] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-02T18:01:42.264066] [INFO ] [REMOTE ] CICB: Full fetch complete (2059 records). [2025-10-02T18:01:42.264142] [DEBUG] [VALIDATOR ] CICB: Validating primary data. [2025-10-02T18:01:42.470130] [WARN ] [VALIDATOR ] CICB: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-02T18:01:42.470331] [FATAL] [MAIN ] CICB: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:01:42.470382] [WARN ] [MAIN ] CICB: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:01:42.470464] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-02T18:01:42.470544] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-02T18:01:42.470583] [INFO ] [LOCAL ] CICB: Starting deletion of derivative data. [2025-10-02T18:01:42.470624] [DEBUG] [LOCAL ] CICB: No derivative data file found to delete. [2025-10-02T18:01:42.470721] [INFO ] [MAIN ] Update Progress: 445/2370 symbols completed. CICB took 19.2s. Estimated remaining: 4h 26m 40s. Rate: 7.2 symbols/min [2025-10-02T18:01:42.665789] [INFO ] [MAIN ] CIF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:01:42.672412] [DEBUG] [LOCAL ] CIF: Loaded 4204 existing records from primary storage. [2025-10-02T18:01:42.672623] [INFO ] [MAIN ] CIF: Loaded 4204 existing records. [2025-10-02T18:01:42.678291] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-03. [2025-10-02T18:01:42.875858] [WARN ] [MAIN ] CIF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:01:42.876090] [INFO ] [MAIN ] CIF: Wiping existing primary data before full refresh. [2025-10-02T18:01:42.876138] [INFO ] [LOCAL ] CIF: Starting deletion of primary data. [2025-10-02T18:01:42.876439] [DEBUG] [LOCAL ] CIF: Deleted primary data file. [2025-10-02T18:01:42.876504] [INFO ] [MAIN ] CIF: Starting full primary refresh. [2025-10-02T18:01:43.269441] [INFO ] [REMOTE ] CIF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:01:43.473024] [INFO ] [REMOTE ] CIF: Fetching primary data for 2024-12. [2025-10-02T18:01:44.165807] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-02T18:01:44.272971] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-01. [2025-10-02T18:01:44.328118] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-02T18:01:44.747765] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-02T18:01:45.073045] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-07. [2025-10-02T18:01:45.873027] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-06. [2025-10-02T18:01:46.355942] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-02T18:01:46.673000] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-04. [2025-10-02T18:01:47.216694] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-02T18:01:47.473212] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-02. [2025-10-02T18:01:48.096819] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-02T18:01:48.149700] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-02T18:01:48.273044] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-07. [2025-10-02T18:01:49.073004] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-08. [2025-10-02T18:01:49.306317] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-02T18:01:49.873018] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-08. [2025-10-02T18:01:50.280985] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-02T18:01:50.537528] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-02T18:01:50.673054] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-05. [2025-10-02T18:01:51.473043] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-09. [2025-10-02T18:01:52.203165] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-02T18:01:52.272986] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-06. [2025-10-02T18:01:52.346338] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-02T18:01:53.073049] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-09. [2025-10-02T18:01:53.773387] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-02T18:01:53.873030] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-03. [2025-10-02T18:01:54.045962] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-02T18:01:54.520421] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-02T18:01:54.673008] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-10. [2025-10-02T18:01:55.473032] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-10. [2025-10-02T18:01:55.633163] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-02T18:01:55.634583] [INFO ] [REMOTE ] CIB: Full fetch complete (44321 records). [2025-10-02T18:01:55.634747] [DEBUG] [VALIDATOR ] CIB: Validating primary data. [2025-10-02T18:01:55.635676] [FATAL] [VALIDATOR ] CIB: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:01:55.635782] [FATAL] [MAIN ] CIB: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:01:55.635829] [WARN ] [MAIN ] CIB: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:01:55.635905] [INFO ] [LOCAL ] CIB: Starting deletion of primary data. [2025-10-02T18:01:55.635980] [DEBUG] [LOCAL ] CIB: No primary data file found to delete. [2025-10-02T18:01:55.636019] [INFO ] [LOCAL ] CIB: Starting deletion of derivative data. [2025-10-02T18:01:55.636090] [DEBUG] [LOCAL ] CIB: No derivative data file found to delete. [2025-10-02T18:01:55.636175] [INFO ] [MAIN ] Update Progress: 446/2370 symbols completed. CIB took 36.5s. Estimated remaining: 4h 26m 52s. Rate: 7.2 symbols/min [2025-10-02T18:01:55.839896] [INFO ] [MAIN ] CIG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:01:55.889025] [DEBUG] [LOCAL ] CIG: Loaded 43824 existing records from primary storage. [2025-10-02T18:01:55.889374] [INFO ] [MAIN ] CIG: Loaded 43824 existing records. [2025-10-02T18:01:56.099599] [WARN ] [MAIN ] CIG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:01:56.099863] [INFO ] [MAIN ] CIG: Wiping existing primary data before full refresh. [2025-10-02T18:01:56.099913] [INFO ] [LOCAL ] CIG: Starting deletion of primary data. [2025-10-02T18:01:56.101695] [DEBUG] [LOCAL ] CIG: Deleted primary data file. [2025-10-02T18:01:56.101761] [INFO ] [MAIN ] CIG: Starting full primary refresh. [2025-10-02T18:01:56.283557] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-04. [2025-10-02T18:01:56.334922] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-02T18:01:56.390228] [INFO ] [REMOTE ] CIA: Full fetch complete (23642 records). [2025-10-02T18:01:56.407320] [DEBUG] [VALIDATOR ] CIA: Validating primary data. [2025-10-02T18:01:56.669624] [INFO ] [REMOTE ] CIG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:01:57.005553] [DEBUG] [VALIDATOR ] CIA: All expected trading days are present. [2025-10-02T18:01:57.006614] [DEBUG] [VALIDATOR ] CIA: Primary data validation passed. [2025-10-02T18:01:57.007365] [INFO ] [MAIN ] CIA: Fetched primary data is valid. [2025-10-02T18:01:57.006533] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-02T18:01:57.007474] [DEBUG] [LOCAL ] CIA: Saving primary data. [2025-10-02T18:01:57.011038] [DEBUG] [LOCAL ] CIA: Trimmed 23642 records to 17134 (keeping 200 days of data) [2025-10-02T18:01:57.084015] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-07. [2025-10-02T18:01:57.118902] [DEBUG] [LOCAL ] CIA: Primary data saved (17134 records). [2025-10-02T18:01:57.119075] [INFO ] [MAIN ] CIA: Full history saved. [2025-10-02T18:01:57.119167] [INFO ] [MAIN ] Update Progress: 447/2370 symbols completed. CIA took 41.6s. Estimated remaining: 4h 26m 15s. Rate: 7.2 symbols/min [2025-10-02T18:01:57.307147] [INFO ] [MAIN ] CII: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:01:57.325788] [DEBUG] [LOCAL ] CII: Loaded 15206 existing records from primary storage. [2025-10-02T18:01:57.326040] [INFO ] [MAIN ] CII: Loaded 15206 existing records. [2025-10-02T18:01:57.536704] [WARN ] [MAIN ] CII: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:01:57.537006] [INFO ] [MAIN ] CII: Wiping existing primary data before full refresh. [2025-10-02T18:01:57.537067] [INFO ] [LOCAL ] CII: Starting deletion of primary data. [2025-10-02T18:01:57.537741] [DEBUG] [LOCAL ] CII: Deleted primary data file. [2025-10-02T18:01:57.537806] [INFO ] [MAIN ] CII: Starting full primary refresh. [2025-10-02T18:01:57.885479] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-05. [2025-10-02T18:01:57.934803] [INFO ] [REMOTE ] CII: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:01:58.336342] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-02T18:01:58.673048] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-06. [2025-10-02T18:01:58.902704] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-02T18:01:59.179129] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-02T18:01:59.473003] [INFO ] [REMOTE ] CIG: Fetching primary data for 2024-12. [2025-10-02T18:02:00.273002] [INFO ] [REMOTE ] CII: Fetching primary data for 2024-12. [2025-10-02T18:02:01.072999] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-08. [2025-10-02T18:02:01.587679] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-02T18:02:01.744223] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-02T18:02:01.873005] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-01. [2025-10-02T18:02:02.673030] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-07. [2025-10-02T18:02:02.917257] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-02T18:02:03.032091] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-02T18:02:03.414690] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-02T18:02:03.473029] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-09. [2025-10-02T18:02:04.273025] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-02. [2025-10-02T18:02:04.953712] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-02T18:02:05.073001] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-01. [2025-10-02T18:02:05.545296] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-02T18:02:05.873029] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-03. [2025-10-02T18:02:06.581046] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-02T18:02:06.673019] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-10. [2025-10-02T18:02:06.703599] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-02T18:02:07.472993] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-02. [2025-10-02T18:02:08.087930] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-02T18:02:08.089699] [INFO ] [REMOTE ] CIEN: Full fetch complete (75191 records). [2025-10-02T18:02:08.089849] [DEBUG] [VALIDATOR ] CIEN: Validating primary data. [2025-10-02T18:02:08.090856] [FATAL] [VALIDATOR ] CIEN: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:02:08.090958] [FATAL] [MAIN ] CIEN: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:02:08.091003] [WARN ] [MAIN ] CIEN: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:02:08.091072] [INFO ] [LOCAL ] CIEN: Starting deletion of primary data. [2025-10-02T18:02:08.091139] [DEBUG] [LOCAL ] CIEN: No primary data file found to delete. [2025-10-02T18:02:08.091177] [INFO ] [LOCAL ] CIEN: Starting deletion of derivative data. [2025-10-02T18:02:08.091715] [DEBUG] [LOCAL ] CIEN: Deleted derivative data file. [2025-10-02T18:02:08.092065] [INFO ] [MAIN ] Update Progress: 448/2370 symbols completed. CIEN took 37.0s. Estimated remaining: 4h 26m 18s. Rate: 7.2 symbols/min [2025-10-02T18:02:08.284428] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-08. [2025-10-02T18:02:08.289015] [INFO ] [MAIN ] CIM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:02:08.289990] [DEBUG] [LOCAL ] CIM: No existing data file found in primary storage. [2025-10-02T18:02:08.290052] [WARN ] [MAIN ] CIM: No existing data found, performing full refresh instead. [2025-10-02T18:02:08.290240] [INFO ] [MAIN ] CIM: Wiping existing primary data before full refresh. [2025-10-02T18:02:08.290309] [INFO ] [LOCAL ] CIM: Starting deletion of primary data. [2025-10-02T18:02:08.290370] [DEBUG] [LOCAL ] CIM: No primary data file found to delete. [2025-10-02T18:02:08.290415] [INFO ] [MAIN ] CIM: Starting full primary refresh. [2025-10-02T18:02:08.751077] [INFO ] [REMOTE ] CIM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:02:08.918352] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-02T18:02:09.072979] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-03. [2025-10-02T18:02:09.105297] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-02T18:02:09.873004] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-09. [2025-10-02T18:02:10.673013] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-04. [2025-10-02T18:02:10.687245] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-02T18:02:10.724091] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-02T18:02:11.472999] [INFO ] [REMOTE ] CIM: Fetching primary data for 2024-12. [2025-10-02T18:02:12.080430] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-02T18:02:12.273000] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-04. [2025-10-02T18:02:12.743637] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-02T18:02:13.073003] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-01. [2025-10-02T18:02:13.873027] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-10. [2025-10-02T18:02:14.024776] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-02T18:02:14.433138] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-02T18:02:14.534142] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-02T18:02:14.535055] [INFO ] [REMOTE ] CIF: Full fetch complete (6615 records). [2025-10-02T18:02:14.535132] [DEBUG] [VALIDATOR ] CIF: Validating primary data. [2025-10-02T18:02:14.689038] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-05. [2025-10-02T18:02:14.951863] [DEBUG] [VALIDATOR ] CIF: All expected trading days are present. [2025-10-02T18:02:14.951967] [DEBUG] [VALIDATOR ] CIF: Primary data validation passed. [2025-10-02T18:02:14.952194] [INFO ] [MAIN ] CIF: Fetched primary data is valid. [2025-10-02T18:02:14.952246] [DEBUG] [LOCAL ] CIF: Saving primary data. [2025-10-02T18:02:14.952748] [DEBUG] [LOCAL ] CIF: Trimmed 6615 records to 4220 (keeping 200 days of data) [2025-10-02T18:02:14.981576] [DEBUG] [LOCAL ] CIF: Primary data saved (4220 records). [2025-10-02T18:02:14.981743] [INFO ] [MAIN ] CIF: Full history saved. [2025-10-02T18:02:14.981841] [INFO ] [MAIN ] Update Progress: 449/2370 symbols completed. CIF took 32.5s. Estimated remaining: 4h 26m 3s. Rate: 7.2 symbols/min [2025-10-02T18:02:15.176554] [INFO ] [MAIN ] CIMN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:02:15.181947] [DEBUG] [LOCAL ] CIMN: Loaded 2682 existing records from primary storage. [2025-10-02T18:02:15.182214] [INFO ] [MAIN ] CIMN: Loaded 2682 existing records. [2025-10-02T18:02:15.380447] [WARN ] [MAIN ] CIMN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:02:15.380690] [INFO ] [MAIN ] CIMN: Wiping existing primary data before full refresh. [2025-10-02T18:02:15.380752] [INFO ] [LOCAL ] CIMN: Starting deletion of primary data. [2025-10-02T18:02:15.380989] [DEBUG] [LOCAL ] CIMN: Deleted primary data file. [2025-10-02T18:02:15.381054] [INFO ] [MAIN ] CIMN: Starting full primary refresh. [2025-10-02T18:02:15.481707] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-05. [2025-10-02T18:02:15.783904] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-02T18:02:15.824673] [INFO ] [REMOTE ] CIMN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:02:16.273015] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2024-12. [2025-10-02T18:02:16.923932] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-02T18:02:17.055322] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-02T18:02:17.072984] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-06. [2025-10-02T18:02:17.873000] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-01. [2025-10-02T18:02:18.210037] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-02T18:02:18.682471] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-02. [2025-10-02T18:02:18.688892] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-02T18:02:19.473039] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-07. [2025-10-02T18:02:19.759613] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-02T18:02:20.273034] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-03. [2025-10-02T18:02:21.072978] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-02. [2025-10-02T18:02:21.179090] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-02T18:02:21.310007] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-02T18:02:21.740763] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-02T18:02:21.873003] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-08. [2025-10-02T18:02:22.673026] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-03. [2025-10-02T18:02:23.169265] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-02T18:02:23.354327] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-02T18:02:23.472988] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-04. [2025-10-02T18:02:24.023835] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-02T18:02:24.273010] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-05. [2025-10-02T18:02:24.846799] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-02T18:02:25.073040] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-06. [2025-10-02T18:02:25.873042] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-06. [2025-10-02T18:02:25.966627] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-02T18:02:26.153473] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-10-02T18:02:26.673037] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-04. [2025-10-02T18:02:27.472975] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-07. [2025-10-02T18:02:28.001079] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-02T18:02:28.272997] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-09. [2025-10-02T18:02:28.349311] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-02T18:02:29.073006] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-05. [2025-10-02T18:02:29.518442] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-02T18:02:29.873048] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-07. [2025-10-02T18:02:30.569581] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-02T18:02:30.673036] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-10. [2025-10-02T18:02:30.767624] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-02T18:02:31.473038] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-08. [2025-10-02T18:02:31.831740] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-02T18:02:31.838813] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-02T18:02:31.840280] [INFO ] [REMOTE ] CIG: Full fetch complete (60883 records). [2025-10-02T18:02:31.840372] [DEBUG] [VALIDATOR ] CIG: Validating primary data. [2025-10-02T18:02:31.841532] [FATAL] [VALIDATOR ] CIG: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:02:31.841622] [FATAL] [MAIN ] CIG: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:02:31.841712] [WARN ] [MAIN ] CIG: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:02:31.841789] [INFO ] [LOCAL ] CIG: Starting deletion of primary data. [2025-10-02T18:02:31.841871] [DEBUG] [LOCAL ] CIG: No primary data file found to delete. [2025-10-02T18:02:31.841928] [INFO ] [LOCAL ] CIG: Starting deletion of derivative data. [2025-10-02T18:02:31.842211] [DEBUG] [LOCAL ] CIG: Deleted derivative data file. [2025-10-02T18:02:31.842324] [INFO ] [MAIN ] Update Progress: 450/2370 symbols completed. CIG took 36.2s. Estimated remaining: 4h 26m 32s. Rate: 7.2 symbols/min [2025-10-02T18:02:32.039442] [INFO ] [MAIN ] CIMO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:02:32.039639] [DEBUG] [LOCAL ] CIMO: No existing data file found in primary storage. [2025-10-02T18:02:32.039721] [WARN ] [MAIN ] CIMO: No existing data found, performing full refresh instead. [2025-10-02T18:02:32.039843] [INFO ] [MAIN ] CIMO: Wiping existing primary data before full refresh. [2025-10-02T18:02:32.039886] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-02T18:02:32.039930] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-02T18:02:32.039963] [INFO ] [MAIN ] CIMO: Starting full primary refresh. [2025-10-02T18:02:32.281893] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-08. [2025-10-02T18:02:32.516050] [INFO ] [REMOTE ] CIMO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:02:33.073036] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-09. [2025-10-02T18:02:33.121503] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-02T18:02:33.386502] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-02T18:02:33.873024] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-06. [2025-10-02T18:02:34.673077] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2024-12. [2025-10-02T18:02:35.384870] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-02T18:02:35.473000] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-09. [2025-10-02T18:02:35.506700] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-02T18:02:36.272974] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-10. [2025-10-02T18:02:36.508355] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-02T18:02:36.625330] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-02T18:02:36.626141] [INFO ] [REMOTE ] CIMN: Full fetch complete (3910 records). [2025-10-02T18:02:36.626214] [DEBUG] [VALIDATOR ] CIMN: Validating primary data. [2025-10-02T18:02:37.018942] [DEBUG] [VALIDATOR ] CIMN: All expected trading days are present. [2025-10-02T18:02:37.019048] [DEBUG] [VALIDATOR ] CIMN: Primary data validation passed. [2025-10-02T18:02:37.019236] [INFO ] [MAIN ] CIMN: Fetched primary data is valid. [2025-10-02T18:02:37.019281] [DEBUG] [LOCAL ] CIMN: Saving primary data. [2025-10-02T18:02:37.019877] [DEBUG] [LOCAL ] CIMN: Trimmed 3910 records to 2697 (keeping 200 days of data) [2025-10-02T18:02:37.038242] [DEBUG] [LOCAL ] CIMN: Primary data saved (2697 records). [2025-10-02T18:02:37.038378] [INFO ] [MAIN ] CIMN: Full history saved. [2025-10-02T18:02:37.038465] [INFO ] [MAIN ] Update Progress: 451/2370 symbols completed. CIMN took 22.1s. Estimated remaining: 4h 26m 10s. Rate: 7.2 symbols/min [2025-10-02T18:02:37.078106] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-07. [2025-10-02T18:02:37.228508] [INFO ] [MAIN ] CIMP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:02:37.228820] [DEBUG] [LOCAL ] CIMP: No existing data file found in primary storage. [2025-10-02T18:02:37.228893] [WARN ] [MAIN ] CIMP: No existing data found, performing full refresh instead. [2025-10-02T18:02:37.229041] [INFO ] [MAIN ] CIMP: Wiping existing primary data before full refresh. [2025-10-02T18:02:37.229143] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-02T18:02:37.229197] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-02T18:02:37.229232] [INFO ] [MAIN ] CIMP: Starting full primary refresh. [2025-10-02T18:02:37.662391] [INFO ] [REMOTE ] CIMP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:02:37.873024] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2024-12. [2025-10-02T18:02:38.078134] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T18:02:38.078588] [WARN ] [REMOTE ] CIMP: No data returned for month 2024-12 [2025-10-02T18:02:38.078738] [FATAL] [REMOTE ] CIMP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T18:02:38.078811] [FATAL] [MAIN ] CIMP: Failed to fetch primary data. [2025-10-02T18:02:38.078891] [WARN ] [MAIN ] CIMP: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T18:02:38.078984] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-02T18:02:38.079091] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-02T18:02:38.079158] [INFO ] [LOCAL ] CIMP: Starting deletion of derivative data. [2025-10-02T18:02:38.079245] [DEBUG] [LOCAL ] CIMP: No derivative data file found to delete. [2025-10-02T18:02:38.079375] [INFO ] [MAIN ] Update Progress: 452/2370 symbols completed. CIMP took 1.0s. Estimated remaining: 4h 25m 31s. Rate: 7.2 symbols/min [2025-10-02T18:02:38.278918] [INFO ] [MAIN ] CINT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:02:38.279238] [DEBUG] [LOCAL ] CINT: No existing data file found in primary storage. [2025-10-02T18:02:38.279311] [WARN ] [MAIN ] CINT: No existing data found, performing full refresh instead. [2025-10-02T18:02:38.279482] [INFO ] [MAIN ] CINT: Wiping existing primary data before full refresh. [2025-10-02T18:02:38.279549] [INFO ] [LOCAL ] CINT: Starting deletion of primary data. [2025-10-02T18:02:38.279726] [DEBUG] [LOCAL ] CINT: No primary data file found to delete. [2025-10-02T18:02:38.279856] [INFO ] [MAIN ] CINT: Starting full primary refresh. [2025-10-02T18:02:38.667602] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-02T18:02:38.673037] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-10. [2025-10-02T18:02:38.722012] [INFO ] [REMOTE ] CINT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:02:39.366042] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-02T18:02:39.367084] [INFO ] [REMOTE ] CII: Full fetch complete (22909 records). [2025-10-02T18:02:39.367166] [DEBUG] [VALIDATOR ] CII: Validating primary data. [2025-10-02T18:02:39.367676] [FATAL] [VALIDATOR ] CII: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:02:39.367768] [FATAL] [MAIN ] CII: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:02:39.367815] [WARN ] [MAIN ] CII: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:02:39.367856] [INFO ] [LOCAL ] CII: Starting deletion of primary data. [2025-10-02T18:02:39.367953] [DEBUG] [LOCAL ] CII: No primary data file found to delete. [2025-10-02T18:02:39.368117] [INFO ] [LOCAL ] CII: Starting deletion of derivative data. [2025-10-02T18:02:39.368510] [DEBUG] [LOCAL ] CII: Deleted derivative data file. [2025-10-02T18:02:39.368630] [INFO ] [MAIN ] Update Progress: 453/2370 symbols completed. CII took 42.2s. Estimated remaining: 4h 24m 53s. Rate: 7.2 symbols/min [2025-10-02T18:02:39.478147] [INFO ] [REMOTE ] CINT: Fetching primary data for 2024-12. [2025-10-02T18:02:39.558670] [INFO ] [MAIN ] CIO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:02:39.579878] [DEBUG] [LOCAL ] CIO: Loaded 20291 existing records from primary storage. [2025-10-02T18:02:39.580154] [INFO ] [MAIN ] CIO: Loaded 20291 existing records. [2025-10-02T18:02:39.813662] [WARN ] [MAIN ] CIO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:02:39.814065] [INFO ] [MAIN ] CIO: Wiping existing primary data before full refresh. [2025-10-02T18:02:39.814131] [INFO ] [LOCAL ] CIO: Starting deletion of primary data. [2025-10-02T18:02:39.815146] [DEBUG] [LOCAL ] CIO: Deleted primary data file. [2025-10-02T18:02:39.815209] [INFO ] [MAIN ] CIO: Starting full primary refresh. [2025-10-02T18:02:40.196298] [INFO ] [REMOTE ] CIO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:02:40.208676] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-02T18:02:40.273016] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-01. [2025-10-02T18:02:40.637352] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-02T18:02:41.073053] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-08. [2025-10-02T18:02:41.873040] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-02. [2025-10-02T18:02:42.327826] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-02T18:02:42.356848] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-02T18:02:42.673045] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-09. [2025-10-02T18:02:43.473012] [INFO ] [REMOTE ] CIO: Fetching primary data for 2024-12. [2025-10-02T18:02:44.048549] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-02T18:02:44.273047] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-03. [2025-10-02T18:02:44.688209] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-02T18:02:44.704848] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-02T18:02:45.073017] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-04. [2025-10-02T18:02:45.747749] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-02T18:02:45.873027] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-01. [2025-10-02T18:02:46.672997] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-10. [2025-10-02T18:02:46.827332] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-02T18:02:47.473068] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-05. [2025-10-02T18:02:47.887940] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-02T18:02:47.891033] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-02T18:02:47.894838] [INFO ] [REMOTE ] CIM: Full fetch complete (54940 records). [2025-10-02T18:02:47.895041] [DEBUG] [VALIDATOR ] CIM: Validating primary data. [2025-10-02T18:02:48.273228] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-06. [2025-10-02T18:02:48.396219] [DEBUG] [VALIDATOR ] CIM: All expected trading days are present. [2025-10-02T18:02:48.396325] [DEBUG] [VALIDATOR ] CIM: Primary data validation passed. [2025-10-02T18:02:48.397106] [INFO ] [MAIN ] CIM: Fetched primary data is valid. [2025-10-02T18:02:48.397300] [DEBUG] [LOCAL ] CIM: Saving primary data. [2025-10-02T18:02:48.398981] [DEBUG] [LOCAL ] CIM: Trimmed 54940 records to 37813 (keeping 200 days of data) [2025-10-02T18:02:48.633776] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-02T18:02:48.669772] [DEBUG] [LOCAL ] CIM: Primary data saved (37813 records). [2025-10-02T18:02:48.669997] [INFO ] [MAIN ] CIM: Full history saved. [2025-10-02T18:02:48.670160] [INFO ] [MAIN ] Update Progress: 454/2370 symbols completed. CIM took 40.6s. Estimated remaining: 4h 24m 49s. Rate: 7.2 symbols/min [2025-10-02T18:02:48.861911] [INFO ] [MAIN ] CION: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:02:48.862090] [DEBUG] [LOCAL ] CION: No existing data file found in primary storage. [2025-10-02T18:02:48.862130] [WARN ] [MAIN ] CION: No existing data found, performing full refresh instead. [2025-10-02T18:02:48.862246] [INFO ] [MAIN ] CION: Wiping existing primary data before full refresh. [2025-10-02T18:02:48.862343] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-10-02T18:02:48.862396] [DEBUG] [LOCAL ] CION: No primary data file found to delete. [2025-10-02T18:02:48.862447] [INFO ] [MAIN ] CION: Starting full primary refresh. [2025-10-02T18:02:49.078240] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-02. [2025-10-02T18:02:49.265148] [INFO ] [REMOTE ] CION: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:02:49.873045] [INFO ] [REMOTE ] CION: Fetching primary data for 2024-12. [2025-10-02T18:02:50.202528] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-02T18:02:50.673044] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-03. [2025-10-02T18:02:51.294325] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-02T18:02:51.450219] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-02T18:02:51.473010] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-01. [2025-10-02T18:02:52.273007] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-01. [2025-10-02T18:02:52.593904] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-02T18:02:53.072993] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-04. [2025-10-02T18:02:53.075302] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-02T18:02:53.872990] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-02. [2025-10-02T18:02:54.028744] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-02T18:02:54.672988] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-05. [2025-10-02T18:02:54.748691] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-02T18:02:55.473059] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-07. [2025-10-02T18:02:55.750102] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-02T18:02:55.985137] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-02T18:02:56.273066] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-02. [2025-10-02T18:02:57.073055] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-06. [2025-10-02T18:02:57.283287] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-02T18:02:57.873008] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-08. [2025-10-02T18:02:58.025427] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-02T18:02:58.506286] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-02T18:02:58.672998] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-03. [2025-10-02T18:02:59.473041] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-07. [2025-10-02T18:03:00.103980] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-02T18:03:00.137342] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-02T18:03:00.273000] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-09. [2025-10-02T18:03:00.940926] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-02T18:03:01.072999] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-03. [2025-10-02T18:03:01.873020] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-08. [2025-10-02T18:03:02.038022] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-02T18:03:02.673008] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-10. [2025-10-02T18:03:03.094390] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-02T18:03:03.132908] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-02T18:03:03.134181] [INFO ] [REMOTE ] CIMO: Full fetch complete (5269 records). [2025-10-02T18:03:03.134273] [DEBUG] [VALIDATOR ] CIMO: Validating primary data. [2025-10-02T18:03:03.134864] [FATAL] [VALIDATOR ] CIMO: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:03:03.134962] [FATAL] [MAIN ] CIMO: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:03:03.135007] [WARN ] [MAIN ] CIMO: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:03:03.135129] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-02T18:03:03.135223] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-02T18:03:03.135274] [INFO ] [LOCAL ] CIMO: Starting deletion of derivative data. [2025-10-02T18:03:03.135334] [DEBUG] [LOCAL ] CIMO: No derivative data file found to delete. [2025-10-02T18:03:03.135416] [INFO ] [MAIN ] Update Progress: 455/2370 symbols completed. CIMO took 31.3s. Estimated remaining: 4h 25m 6s. Rate: 7.2 symbols/min [2025-10-02T18:03:03.341938] [INFO ] [MAIN ] CIVI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:03:03.416989] [DEBUG] [LOCAL ] CIVI: Loaded 52597 existing records from primary storage. [2025-10-02T18:03:03.417436] [INFO ] [MAIN ] CIVI: Loaded 52597 existing records. [2025-10-02T18:03:03.478165] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-04. [2025-10-02T18:03:03.624621] [WARN ] [MAIN ] CIVI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:03:03.624882] [INFO ] [MAIN ] CIVI: Wiping existing primary data before full refresh. [2025-10-02T18:03:03.624933] [INFO ] [LOCAL ] CIVI: Starting deletion of primary data. [2025-10-02T18:03:03.626475] [DEBUG] [LOCAL ] CIVI: Deleted primary data file. [2025-10-02T18:03:03.626579] [INFO ] [MAIN ] CIVI: Starting full primary refresh. [2025-10-02T18:03:04.042032] [INFO ] [REMOTE ] CIVI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:03:04.273044] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2024-12. [2025-10-02T18:03:05.066368] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-02T18:03:05.074369] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-04. [2025-10-02T18:03:05.872974] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-05. [2025-10-02T18:03:06.106709] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-02T18:03:06.164390] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-02T18:03:06.673001] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-01. [2025-10-02T18:03:06.982416] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-02T18:03:07.472998] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-09. [2025-10-02T18:03:08.153627] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-02T18:03:08.272992] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-02. [2025-10-02T18:03:08.718968] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-02T18:03:09.073044] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-05. [2025-10-02T18:03:09.615514] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-02T18:03:09.873012] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-10. [2025-10-02T18:03:10.062711] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-02T18:03:10.676387] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-02T18:03:10.676143] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-06. [2025-10-02T18:03:10.679263] [INFO ] [REMOTE ] CINT: Full fetch complete (26684 records). [2025-10-02T18:03:10.679354] [DEBUG] [VALIDATOR ] CINT: Validating primary data. [2025-10-02T18:03:11.130684] [DEBUG] [VALIDATOR ] CINT: All expected trading days are present. [2025-10-02T18:03:11.130823] [DEBUG] [VALIDATOR ] CINT: Primary data validation passed. [2025-10-02T18:03:11.131420] [INFO ] [MAIN ] CINT: Fetched primary data is valid. [2025-10-02T18:03:11.131489] [DEBUG] [LOCAL ] CINT: Saving primary data. [2025-10-02T18:03:11.132509] [DEBUG] [LOCAL ] CINT: Trimmed 26684 records to 18940 (keeping 200 days of data) [2025-10-02T18:03:11.257843] [DEBUG] [LOCAL ] CINT: Primary data saved (18940 records). [2025-10-02T18:03:11.258007] [INFO ] [MAIN ] CINT: Full history saved. [2025-10-02T18:03:11.258140] [INFO ] [MAIN ] Update Progress: 456/2370 symbols completed. CINT took 33.2s. Estimated remaining: 4h 24m 57s. Rate: 7.2 symbols/min [2025-10-02T18:03:11.450135] [INFO ] [MAIN ] CL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:03:11.450344] [DEBUG] [LOCAL ] CL: No existing data file found in primary storage. [2025-10-02T18:03:11.450417] [WARN ] [MAIN ] CL: No existing data found, performing full refresh instead. [2025-10-02T18:03:11.450592] [INFO ] [MAIN ] CL: Wiping existing primary data before full refresh. [2025-10-02T18:03:11.450681] [INFO ] [LOCAL ] CL: Starting deletion of primary data. [2025-10-02T18:03:11.450746] [DEBUG] [LOCAL ] CL: No primary data file found to delete. [2025-10-02T18:03:11.450784] [INFO ] [MAIN ] CL: Starting full primary refresh. [2025-10-02T18:03:11.478126] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-06. [2025-10-02T18:03:11.867256] [INFO ] [REMOTE ] CL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:03:11.985112] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-02T18:03:12.272973] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-03. [2025-10-02T18:03:12.431225] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-02T18:03:13.073037] [INFO ] [REMOTE ] CL: Fetching primary data for 2024-12. [2025-10-02T18:03:13.873007] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-07. [2025-10-02T18:03:14.253179] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-02T18:03:14.616379] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-02T18:03:14.643632] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-02T18:03:14.672960] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-08. [2025-10-02T18:03:15.473039] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-07. [2025-10-02T18:03:15.977961] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-02T18:03:16.273043] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-09. [2025-10-02T18:03:16.602111] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-02T18:03:17.073029] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-04. [2025-10-02T18:03:17.582389] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-02T18:03:17.873052] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-01. [2025-10-02T18:03:18.673009] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-08. [2025-10-02T18:03:19.127432] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-02T18:03:19.370967] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-02T18:03:19.473045] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-05. [2025-10-02T18:03:19.875595] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-02T18:03:20.273006] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-02. [2025-10-02T18:03:21.073053] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-10. [2025-10-02T18:03:21.684031] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-02T18:03:21.747500] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-02T18:03:21.872983] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-03. [2025-10-02T18:03:22.124781] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-02T18:03:22.127780] [INFO ] [REMOTE ] CION: Full fetch complete (41069 records). [2025-10-02T18:03:22.127910] [DEBUG] [VALIDATOR ] CION: Validating primary data. [2025-10-02T18:03:22.556588] [DEBUG] [VALIDATOR ] CION: All expected trading days are present. [2025-10-02T18:03:22.556725] [DEBUG] [VALIDATOR ] CION: Primary data validation passed. [2025-10-02T18:03:22.557332] [INFO ] [MAIN ] CION: Fetched primary data is valid. [2025-10-02T18:03:22.557383] [DEBUG] [LOCAL ] CION: Saving primary data. [2025-10-02T18:03:22.558512] [DEBUG] [LOCAL ] CION: Trimmed 41069 records to 29036 (keeping 200 days of data) [2025-10-02T18:03:22.674816] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-06. [2025-10-02T18:03:22.770203] [DEBUG] [LOCAL ] CION: Primary data saved (29036 records). [2025-10-02T18:03:22.770352] [INFO ] [MAIN ] CION: Full history saved. [2025-10-02T18:03:22.770443] [INFO ] [MAIN ] Update Progress: 457/2370 symbols completed. CION took 34.1s. Estimated remaining: 4h 25m 2s. Rate: 7.2 symbols/min [2025-10-02T18:03:22.961773] [INFO ] [MAIN ] CLB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:03:22.962055] [DEBUG] [LOCAL ] CLB: No existing data file found in primary storage. [2025-10-02T18:03:22.962114] [WARN ] [MAIN ] CLB: No existing data found, performing full refresh instead. [2025-10-02T18:03:22.962233] [INFO ] [MAIN ] CLB: Wiping existing primary data before full refresh. [2025-10-02T18:03:22.962276] [INFO ] [LOCAL ] CLB: Starting deletion of primary data. [2025-10-02T18:03:22.962321] [DEBUG] [LOCAL ] CLB: No primary data file found to delete. [2025-10-02T18:03:22.962355] [INFO ] [MAIN ] CLB: Starting full primary refresh. [2025-10-02T18:03:23.362597] [INFO ] [REMOTE ] CLB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:03:23.473051] [INFO ] [REMOTE ] CLB: Fetching primary data for 2024-12. [2025-10-02T18:03:23.920354] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-02T18:03:24.273047] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-04. [2025-10-02T18:03:24.434628] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-02T18:03:24.828068] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-02T18:03:25.072993] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-09. [2025-10-02T18:03:25.873024] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-07. [2025-10-02T18:03:26.134844] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-02T18:03:26.184939] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-02T18:03:26.673024] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-05. [2025-10-02T18:03:27.444679] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-02T18:03:27.472967] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-08. [2025-10-02T18:03:28.322863] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-01. [2025-10-02T18:03:28.347766] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-02T18:03:29.072980] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-06. [2025-10-02T18:03:29.245234] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-02T18:03:29.686999] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-02T18:03:29.873062] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-09. [2025-10-02T18:03:30.585638] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-02T18:03:30.673056] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-02. [2025-10-02T18:03:31.473004] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-07. [2025-10-02T18:03:31.662963] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-02T18:03:31.778484] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-02T18:03:32.273034] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-10. [2025-10-02T18:03:33.073009] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-03. [2025-10-02T18:03:33.424403] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-02T18:03:33.426919] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-02T18:03:33.440278] [INFO ] [REMOTE ] CIO: Full fetch complete (29159 records). [2025-10-02T18:03:33.440824] [DEBUG] [VALIDATOR ] CIO: Validating primary data. [2025-10-02T18:03:33.861306] [DEBUG] [VALIDATOR ] CIO: All expected trading days are present. [2025-10-02T18:03:33.861442] [DEBUG] [VALIDATOR ] CIO: Primary data validation passed. [2025-10-02T18:03:33.862219] [INFO ] [MAIN ] CIO: Fetched primary data is valid. [2025-10-02T18:03:33.862296] [DEBUG] [LOCAL ] CIO: Saving primary data. [2025-10-02T18:03:33.863689] [DEBUG] [LOCAL ] CIO: Trimmed 29159 records to 20557 (keeping 200 days of data) [2025-10-02T18:03:33.873070] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-10. [2025-10-02T18:03:34.059043] [DEBUG] [LOCAL ] CIO: Primary data saved (20557 records). [2025-10-02T18:03:34.059216] [INFO ] [MAIN ] CIO: Full history saved. [2025-10-02T18:03:34.059337] [INFO ] [MAIN ] Update Progress: 458/2370 symbols completed. CIO took 54.7s. Estimated remaining: 4h 25m 7s. Rate: 7.2 symbols/min [2025-10-02T18:03:34.232110] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-02T18:03:34.403322] [INFO ] [MAIN ] CLCO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:03:34.427950] [DEBUG] [LOCAL ] CLCO: Loaded 12678 existing records from primary storage. [2025-10-02T18:03:34.428424] [INFO ] [MAIN ] CLCO: Loaded 12678 existing records. [2025-10-02T18:03:34.670673] [WARN ] [MAIN ] CLCO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:03:34.670941] [INFO ] [MAIN ] CLCO: Wiping existing primary data before full refresh. [2025-10-02T18:03:34.670999] [INFO ] [LOCAL ] CLCO: Starting deletion of primary data. [2025-10-02T18:03:34.671526] [DEBUG] [LOCAL ] CLCO: Deleted primary data file. [2025-10-02T18:03:34.671593] [INFO ] [MAIN ] CLCO: Starting full primary refresh. [2025-10-02T18:03:34.684432] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-08. [2025-10-02T18:03:35.104897] [INFO ] [REMOTE ] CLCO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:03:35.158144] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-02T18:03:35.160521] [INFO ] [REMOTE ] CIVI: Full fetch complete (75709 records). [2025-10-02T18:03:35.160725] [DEBUG] [VALIDATOR ] CIVI: Validating primary data. [2025-10-02T18:03:35.478154] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-04. [2025-10-02T18:03:35.613957] [DEBUG] [VALIDATOR ] CIVI: All expected trading days are present. [2025-10-02T18:03:35.614056] [DEBUG] [VALIDATOR ] CIVI: Primary data validation passed. [2025-10-02T18:03:35.614976] [INFO ] [MAIN ] CIVI: Fetched primary data is valid. [2025-10-02T18:03:35.615050] [DEBUG] [LOCAL ] CIVI: Saving primary data. [2025-10-02T18:03:35.617070] [DEBUG] [LOCAL ] CIVI: Trimmed 75709 records to 52985 (keeping 200 days of data) [2025-10-02T18:03:35.995042] [DEBUG] [LOCAL ] CIVI: Primary data saved (52985 records). [2025-10-02T18:03:35.995457] [INFO ] [MAIN ] CIVI: Full history saved. [2025-10-02T18:03:35.995554] [INFO ] [MAIN ] Update Progress: 459/2370 symbols completed. CIVI took 32.9s. Estimated remaining: 4h 24m 32s. Rate: 7.2 symbols/min [2025-10-02T18:03:36.196732] [INFO ] [MAIN ] CLDT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:03:36.196971] [DEBUG] [LOCAL ] CLDT: No existing data file found in primary storage. [2025-10-02T18:03:36.197017] [WARN ] [MAIN ] CLDT: No existing data found, performing full refresh instead. [2025-10-02T18:03:36.197164] [INFO ] [MAIN ] CLDT: Wiping existing primary data before full refresh. [2025-10-02T18:03:36.197207] [INFO ] [LOCAL ] CLDT: Starting deletion of primary data. [2025-10-02T18:03:36.197252] [DEBUG] [LOCAL ] CLDT: No primary data file found to delete. [2025-10-02T18:03:36.197286] [INFO ] [MAIN ] CLDT: Starting full primary refresh. [2025-10-02T18:03:36.282619] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2024-12. [2025-10-02T18:03:36.657605] [INFO ] [REMOTE ] CLDT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:03:36.928864] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-10-02T18:03:37.073054] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-09. [2025-10-02T18:03:37.196667] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-02T18:03:37.429147] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-02T18:03:37.873028] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-05. [2025-10-02T18:03:38.672997] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-01. [2025-10-02T18:03:38.775263] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-02T18:03:39.109796] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-02T18:03:39.378116] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-02T18:03:39.472996] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-06. [2025-10-02T18:03:40.273015] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-10. [2025-10-02T18:03:40.639443] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-02T18:03:41.073047] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2024-12. [2025-10-02T18:03:41.626062] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-02T18:03:41.627816] [INFO ] [REMOTE ] CL: Full fetch complete (77229 records). [2025-10-02T18:03:41.627965] [DEBUG] [VALIDATOR ] CL: Validating primary data. [2025-10-02T18:03:41.629525] [FATAL] [VALIDATOR ] CL: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:03:41.629683] [FATAL] [MAIN ] CL: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:03:41.629752] [WARN ] [MAIN ] CL: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:03:41.629831] [INFO ] [LOCAL ] CL: Starting deletion of primary data. [2025-10-02T18:03:41.629899] [DEBUG] [LOCAL ] CL: No primary data file found to delete. [2025-10-02T18:03:41.629940] [INFO ] [LOCAL ] CL: Starting deletion of derivative data. [2025-10-02T18:03:41.629982] [DEBUG] [LOCAL ] CL: No derivative data file found to delete. [2025-10-02T18:03:41.630110] [INFO ] [MAIN ] Update Progress: 460/2370 symbols completed. CL took 30.4s. Estimated remaining: 4h 24m 12s. Rate: 7.2 symbols/min [2025-10-02T18:03:41.826275] [INFO ] [MAIN ] CLF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:03:41.883664] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-07. [2025-10-02T18:03:41.887314] [DEBUG] [LOCAL ] CLF: Loaded 53741 existing records from primary storage. [2025-10-02T18:03:41.887756] [INFO ] [MAIN ] CLF: Loaded 53741 existing records. [2025-10-02T18:03:42.105092] [WARN ] [MAIN ] CLF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:03:42.105458] [INFO ] [MAIN ] CLF: Wiping existing primary data before full refresh. [2025-10-02T18:03:42.105700] [INFO ] [LOCAL ] CLF: Starting deletion of primary data. [2025-10-02T18:03:42.107307] [DEBUG] [LOCAL ] CLF: Deleted primary data file. [2025-10-02T18:03:42.107380] [INFO ] [MAIN ] CLF: Starting full primary refresh. [2025-10-02T18:03:42.496402] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-02T18:03:42.563969] [INFO ] [REMOTE ] CLF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:03:42.673019] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-02. [2025-10-02T18:03:42.930870] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-02T18:03:43.472977] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-01. [2025-10-02T18:03:43.749145] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-02T18:03:44.272992] [INFO ] [REMOTE ] CLF: Fetching primary data for 2024-12. [2025-10-02T18:03:44.440014] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-02T18:03:45.073018] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-03. [2025-10-02T18:03:45.872996] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-08. [2025-10-02T18:03:46.063824] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-02T18:03:46.250774] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-02T18:03:46.673028] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-02. [2025-10-02T18:03:47.316337] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-02T18:03:47.473041] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-01. [2025-10-02T18:03:47.754591] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-02T18:03:48.273001] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-03. [2025-10-02T18:03:49.072996] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-09. [2025-10-02T18:03:49.525861] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-02T18:03:49.611535] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-02T18:03:49.873063] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-04. [2025-10-02T18:03:50.337496] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-02T18:03:50.673053] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-10. [2025-10-02T18:03:50.698052] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-02T18:03:51.473022] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-02. [2025-10-02T18:03:51.884865] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-02T18:03:51.886364] [INFO ] [REMOTE ] CLB: Full fetch complete (46714 records). [2025-10-02T18:03:51.886483] [DEBUG] [VALIDATOR ] CLB: Validating primary data. [2025-10-02T18:03:52.278105] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-04. [2025-10-02T18:03:52.325339] [DEBUG] [VALIDATOR ] CLB: All expected trading days are present. [2025-10-02T18:03:52.325410] [DEBUG] [VALIDATOR ] CLB: Primary data validation passed. [2025-10-02T18:03:52.326025] [INFO ] [MAIN ] CLB: Fetched primary data is valid. [2025-10-02T18:03:52.326185] [DEBUG] [LOCAL ] CLB: Saving primary data. [2025-10-02T18:03:52.327365] [DEBUG] [LOCAL ] CLB: Trimmed 46714 records to 33203 (keeping 200 days of data) [2025-10-02T18:03:52.566568] [DEBUG] [LOCAL ] CLB: Primary data saved (33203 records). [2025-10-02T18:03:52.566787] [INFO ] [MAIN ] CLB: Full history saved. [2025-10-02T18:03:52.566877] [INFO ] [MAIN ] Update Progress: 461/2370 symbols completed. CLB took 29.8s. Estimated remaining: 4h 24m 15s. Rate: 7.2 symbols/min [2025-10-02T18:03:52.762387] [INFO ] [MAIN ] CLH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:03:52.796414] [DEBUG] [LOCAL ] CLH: Loaded 27798 existing records from primary storage. [2025-10-02T18:03:52.796787] [INFO ] [MAIN ] CLH: Loaded 27798 existing records. [2025-10-02T18:03:52.990234] [WARN ] [MAIN ] CLH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:03:52.990464] [INFO ] [MAIN ] CLH: Wiping existing primary data before full refresh. [2025-10-02T18:03:52.990515] [INFO ] [LOCAL ] CLH: Starting deletion of primary data. [2025-10-02T18:03:52.991466] [DEBUG] [LOCAL ] CLH: Deleted primary data file. [2025-10-02T18:03:52.991528] [INFO ] [MAIN ] CLH: Starting full primary refresh. [2025-10-02T18:03:53.078131] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-05. [2025-10-02T18:03:53.413422] [INFO ] [REMOTE ] CLH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:03:53.443971] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-02T18:03:53.796173] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-02T18:03:53.872995] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-03. [2025-10-02T18:03:53.958171] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-02T18:03:54.672997] [INFO ] [REMOTE ] CLH: Fetching primary data for 2024-12. [2025-10-02T18:03:55.473004] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-05. [2025-10-02T18:03:55.633537] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-02T18:03:55.992623] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-02T18:03:56.273008] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-04. [2025-10-02T18:03:56.382694] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-02T18:03:57.073052] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-06. [2025-10-02T18:03:57.873223] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-06. [2025-10-02T18:03:58.177041] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-02T18:03:58.593153] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-10-02T18:03:58.654100] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-02T18:03:58.673017] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-07. [2025-10-02T18:03:59.403240] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-02T18:03:59.472985] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-08. [2025-10-02T18:04:00.134765] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-02T18:04:00.273003] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-01. [2025-10-02T18:04:01.073009] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-07. [2025-10-02T18:04:01.729106] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-02T18:04:01.872967] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-05. [2025-10-02T18:04:02.218022] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-02T18:04:02.673010] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-09. [2025-10-02T18:04:03.472953] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-08. [2025-10-02T18:04:03.526690] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-02T18:04:03.634165] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-02T18:04:04.272997] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-10. [2025-10-02T18:04:04.547332] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-02T18:04:05.028351] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-02T18:04:05.029722] [INFO ] [REMOTE ] CLCO: Full fetch complete (22777 records). [2025-10-02T18:04:05.029816] [DEBUG] [VALIDATOR ] CLCO: Validating primary data. [2025-10-02T18:04:05.078188] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-02. [2025-10-02T18:04:05.472047] [DEBUG] [VALIDATOR ] CLCO: All expected trading days are present. [2025-10-02T18:04:05.472137] [DEBUG] [VALIDATOR ] CLCO: Primary data validation passed. [2025-10-02T18:04:05.472596] [INFO ] [MAIN ] CLCO: Fetched primary data is valid. [2025-10-02T18:04:05.472686] [DEBUG] [LOCAL ] CLCO: Saving primary data. [2025-10-02T18:04:05.473541] [DEBUG] [LOCAL ] CLCO: Trimmed 22777 records to 12817 (keeping 200 days of data) [2025-10-02T18:04:05.562988] [DEBUG] [LOCAL ] CLCO: Primary data saved (12817 records). [2025-10-02T18:04:05.563136] [INFO ] [MAIN ] CLCO: Full history saved. [2025-10-02T18:04:05.563224] [INFO ] [MAIN ] Update Progress: 462/2370 symbols completed. CLCO took 31.5s. Estimated remaining: 4h 24m 26s. Rate: 7.2 symbols/min [2025-10-02T18:04:05.767073] [INFO ] [MAIN ] CLPR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:04:05.767259] [DEBUG] [LOCAL ] CLPR: No existing data file found in primary storage. [2025-10-02T18:04:05.767299] [WARN ] [MAIN ] CLPR: No existing data found, performing full refresh instead. [2025-10-02T18:04:05.767416] [INFO ] [MAIN ] CLPR: Wiping existing primary data before full refresh. [2025-10-02T18:04:05.767458] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-10-02T18:04:05.767500] [DEBUG] [LOCAL ] CLPR: No primary data file found to delete. [2025-10-02T18:04:05.767533] [INFO ] [MAIN ] CLPR: Starting full primary refresh. [2025-10-02T18:04:05.878245] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-09. [2025-10-02T18:04:06.163011] [INFO ] [REMOTE ] CLPR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:04:06.369380] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-02T18:04:06.678142] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-03. [2025-10-02T18:04:06.689705] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-02T18:04:07.472991] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-10. [2025-10-02T18:04:08.135085] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-02T18:04:08.273049] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-06. [2025-10-02T18:04:08.324082] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-02T18:04:08.325486] [INFO ] [REMOTE ] CLDT: Full fetch complete (37075 records). [2025-10-02T18:04:08.325573] [DEBUG] [VALIDATOR ] CLDT: Validating primary data. [2025-10-02T18:04:08.750266] [DEBUG] [VALIDATOR ] CLDT: All expected trading days are present. [2025-10-02T18:04:08.750347] [DEBUG] [VALIDATOR ] CLDT: Primary data validation passed. [2025-10-02T18:04:08.750906] [INFO ] [MAIN ] CLDT: Fetched primary data is valid. [2025-10-02T18:04:08.750969] [DEBUG] [LOCAL ] CLDT: Saving primary data. [2025-10-02T18:04:08.751924] [DEBUG] [LOCAL ] CLDT: Trimmed 37075 records to 25578 (keeping 200 days of data) [2025-10-02T18:04:08.903943] [DEBUG] [LOCAL ] CLDT: Primary data saved (25578 records). [2025-10-02T18:04:08.904155] [INFO ] [MAIN ] CLDT: Full history saved. [2025-10-02T18:04:08.904243] [INFO ] [MAIN ] Update Progress: 463/2370 symbols completed. CLDT took 32.9s. Estimated remaining: 4h 23m 57s. Rate: 7.2 symbols/min [2025-10-02T18:04:09.079630] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2024-12. [2025-10-02T18:04:09.098730] [INFO ] [MAIN ] CLS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:04:09.158694] [DEBUG] [LOCAL ] CLS: Loaded 53619 existing records from primary storage. [2025-10-02T18:04:09.159032] [INFO ] [MAIN ] CLS: Loaded 53619 existing records. [2025-10-02T18:04:09.355548] [WARN ] [MAIN ] CLS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:04:09.355776] [INFO ] [MAIN ] CLS: Wiping existing primary data before full refresh. [2025-10-02T18:04:09.355828] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-10-02T18:04:09.357307] [DEBUG] [LOCAL ] CLS: Deleted primary data file. [2025-10-02T18:04:09.357368] [INFO ] [MAIN ] CLS: Starting full primary refresh. [2025-10-02T18:04:09.750457] [INFO ] [REMOTE ] CLS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:04:09.872994] [INFO ] [REMOTE ] CLS: Fetching primary data for 2024-12. [2025-10-02T18:04:10.141433] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-02T18:04:10.279985] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-02T18:04:10.673023] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-07. [2025-10-02T18:04:11.472986] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-01. [2025-10-02T18:04:12.089206] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-02T18:04:12.273006] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-04. [2025-10-02T18:04:12.724569] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2024-12 (2.85 seconds). [2025-10-02T18:04:12.770611] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-02T18:04:13.073035] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-01. [2025-10-02T18:04:13.690426] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-02T18:04:13.873028] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-08. [2025-10-02T18:04:14.672999] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-05. [2025-10-02T18:04:15.072053] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-02T18:04:15.472968] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-02. [2025-10-02T18:04:15.840515] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-02T18:04:15.996175] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-02T18:04:16.273251] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-02. [2025-10-02T18:04:16.330556] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-02T18:04:17.073002] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-06. [2025-10-02T18:04:17.873026] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-03. [2025-10-02T18:04:18.315211] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-02T18:04:18.356515] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-02T18:04:18.673040] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-03. [2025-10-02T18:04:18.852319] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-02T18:04:19.472992] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-09. [2025-10-02T18:04:20.273050] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-04. [2025-10-02T18:04:21.021425] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-10-02T18:04:21.072987] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-04. [2025-10-02T18:04:21.452947] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-02T18:04:21.622317] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-02T18:04:21.873023] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-10. [2025-10-02T18:04:22.673044] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-05. [2025-10-02T18:04:23.472984] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-07. [2025-10-02T18:04:23.486564] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-02T18:04:23.495194] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-02T18:04:23.528840] [INFO ] [REMOTE ] CLF: Full fetch complete (77809 records). [2025-10-02T18:04:23.530847] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-04 (2.46 seconds). [2025-10-02T18:04:23.529497] [DEBUG] [VALIDATOR ] CLF: Validating primary data. [2025-10-02T18:04:23.988504] [DEBUG] [VALIDATOR ] CLF: All expected trading days are present. [2025-10-02T18:04:23.988592] [DEBUG] [VALIDATOR ] CLF: Primary data validation passed. [2025-10-02T18:04:23.989459] [INFO ] [MAIN ] CLF: Fetched primary data is valid. [2025-10-02T18:04:23.989526] [DEBUG] [LOCAL ] CLF: Saving primary data. [2025-10-02T18:04:23.991075] [DEBUG] [LOCAL ] CLF: Trimmed 77809 records to 54131 (keeping 200 days of data) [2025-10-02T18:04:24.292609] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-06. [2025-10-02T18:04:24.352603] [DEBUG] [LOCAL ] CLF: Primary data saved (54131 records). [2025-10-02T18:04:24.352783] [INFO ] [MAIN ] CLF: Full history saved. [2025-10-02T18:04:24.352875] [INFO ] [MAIN ] Update Progress: 464/2370 symbols completed. CLF took 42.7s. Estimated remaining: 4h 24m 18s. Rate: 7.2 symbols/min [2025-10-02T18:04:24.552840] [INFO ] [MAIN ] CLVT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:04:24.604443] [DEBUG] [LOCAL ] CLVT: Loaded 51961 existing records from primary storage. [2025-10-02T18:04:24.604929] [INFO ] [MAIN ] CLVT: Loaded 51961 existing records. [2025-10-02T18:04:24.813623] [WARN ] [MAIN ] CLVT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:04:24.813916] [INFO ] [MAIN ] CLVT: Wiping existing primary data before full refresh. [2025-10-02T18:04:24.814000] [INFO ] [LOCAL ] CLVT: Starting deletion of primary data. [2025-10-02T18:04:24.815461] [DEBUG] [LOCAL ] CLVT: Deleted primary data file. [2025-10-02T18:04:24.815530] [INFO ] [MAIN ] CLVT: Starting full primary refresh. [2025-10-02T18:04:24.942901] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-02T18:04:25.080419] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-08. [2025-10-02T18:04:25.312757] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-02T18:04:25.319320] [INFO ] [REMOTE ] CLVT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:04:25.873015] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2024-12. [2025-10-02T18:04:26.388675] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-02T18:04:26.673092] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-05. [2025-10-02T18:04:27.344593] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-02T18:04:27.473010] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-09. [2025-10-02T18:04:28.273009] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-07. [2025-10-02T18:04:28.607943] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-02T18:04:28.809073] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-02T18:04:29.073034] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-10. [2025-10-02T18:04:29.188214] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-02T18:04:29.873017] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-08. [2025-10-02T18:04:30.221925] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-02T18:04:30.223537] [INFO ] [REMOTE ] CLH: Full fetch complete (41812 records). [2025-10-02T18:04:30.223671] [DEBUG] [VALIDATOR ] CLH: Validating primary data. [2025-10-02T18:04:30.684165] [DEBUG] [VALIDATOR ] CLH: All expected trading days are present. [2025-10-02T18:04:30.680633] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-01. [2025-10-02T18:04:30.684427] [DEBUG] [VALIDATOR ] CLH: Primary data validation passed. [2025-10-02T18:04:30.685531] [INFO ] [MAIN ] CLH: Fetched primary data is valid. [2025-10-02T18:04:30.685632] [DEBUG] [LOCAL ] CLH: Saving primary data. [2025-10-02T18:04:30.688149] [DEBUG] [LOCAL ] CLH: Trimmed 41812 records to 28009 (keeping 200 days of data) [2025-10-02T18:04:30.794128] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-02T18:04:30.885788] [DEBUG] [LOCAL ] CLH: Primary data saved (28009 records). [2025-10-02T18:04:30.885939] [INFO ] [MAIN ] CLH: Full history saved. [2025-10-02T18:04:30.886027] [INFO ] [MAIN ] Update Progress: 465/2370 symbols completed. CLH took 38.3s. Estimated remaining: 4h 24m 3s. Rate: 7.2 symbols/min [2025-10-02T18:04:31.070066] [INFO ] [MAIN ] CLW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:04:31.092042] [DEBUG] [LOCAL ] CLW: Loaded 21778 existing records from primary storage. [2025-10-02T18:04:31.092310] [INFO ] [MAIN ] CLW: Loaded 21778 existing records. [2025-10-02T18:04:31.289068] [WARN ] [MAIN ] CLW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:04:31.289326] [INFO ] [MAIN ] CLW: Wiping existing primary data before full refresh. [2025-10-02T18:04:31.289375] [INFO ] [LOCAL ] CLW: Starting deletion of primary data. [2025-10-02T18:04:31.289947] [DEBUG] [LOCAL ] CLW: Deleted primary data file. [2025-10-02T18:04:31.290010] [INFO ] [MAIN ] CLW: Starting full primary refresh. [2025-10-02T18:04:31.480392] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-09. [2025-10-02T18:04:31.748514] [INFO ] [REMOTE ] CLW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:04:32.199453] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-02T18:04:32.272974] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-06. [2025-10-02T18:04:32.362158] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-02T18:04:33.073021] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-02. [2025-10-02T18:04:33.873013] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-10. [2025-10-02T18:04:34.357139] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-02T18:04:34.358280] [INFO ] [REMOTE ] CLPR: Full fetch complete (17520 records). [2025-10-02T18:04:34.358552] [DEBUG] [VALIDATOR ] CLPR: Validating primary data. [2025-10-02T18:04:34.359199] [FATAL] [VALIDATOR ] CLPR: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:04:34.359286] [FATAL] [MAIN ] CLPR: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:04:34.359354] [WARN ] [MAIN ] CLPR: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:04:34.359428] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-10-02T18:04:34.359493] [DEBUG] [LOCAL ] CLPR: No primary data file found to delete. [2025-10-02T18:04:34.359530] [INFO ] [LOCAL ] CLPR: Starting deletion of derivative data. [2025-10-02T18:04:34.359572] [DEBUG] [LOCAL ] CLPR: No derivative data file found to delete. [2025-10-02T18:04:34.359630] [INFO ] [MAIN ] Update Progress: 466/2370 symbols completed. CLPR took 28.8s. Estimated remaining: 4h 23m 34s. Rate: 7.2 symbols/min [2025-10-02T18:04:34.564138] [INFO ] [MAIN ] CLX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:04:34.621702] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-02T18:04:34.639043] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-10-02T18:04:34.672980] [INFO ] [REMOTE ] CLW: Fetching primary data for 2024-12. [2025-10-02T18:04:34.714857] [DEBUG] [LOCAL ] CLX: Loaded 51491 existing records from primary storage. [2025-10-02T18:04:34.715178] [INFO ] [MAIN ] CLX: Loaded 51491 existing records. [2025-10-02T18:04:34.920294] [WARN ] [MAIN ] CLX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:04:34.920512] [INFO ] [MAIN ] CLX: Wiping existing primary data before full refresh. [2025-10-02T18:04:34.920561] [INFO ] [LOCAL ] CLX: Starting deletion of primary data. [2025-10-02T18:04:34.922128] [DEBUG] [LOCAL ] CLX: Deleted primary data file. [2025-10-02T18:04:34.922192] [INFO ] [MAIN ] CLX: Starting full primary refresh. [2025-10-02T18:04:35.358335] [INFO ] [REMOTE ] CLX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:04:35.473005] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-07. [2025-10-02T18:04:36.126765] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-02T18:04:36.273036] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-01. [2025-10-02T18:04:37.073025] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-03. [2025-10-02T18:04:37.575231] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-02T18:04:37.878101] [INFO ] [REMOTE ] CLX: Fetching primary data for 2024-12. [2025-10-02T18:04:37.907943] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-10-02T18:04:38.672988] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-08. [2025-10-02T18:04:38.803667] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-02T18:04:39.472988] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-04. [2025-10-02T18:04:39.805286] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-02T18:04:40.272997] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-02. [2025-10-02T18:04:40.953559] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-02T18:04:41.047337] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-10-02T18:04:41.072973] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-01. [2025-10-02T18:04:41.467572] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-02T18:04:41.873005] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-03. [2025-10-02T18:04:42.649278] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-02T18:04:42.672985] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-02. [2025-10-02T18:04:42.708790] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-02T18:04:43.473012] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-09. [2025-10-02T18:04:44.272987] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-05. [2025-10-02T18:04:44.377465] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-02T18:04:45.073003] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-04. [2025-10-02T18:04:45.737000] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-02T18:04:45.835519] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-02T18:04:45.872996] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-10. [2025-10-02T18:04:46.551976] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-02T18:04:46.673006] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-03. [2025-10-02T18:04:47.473003] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-06. [2025-10-02T18:04:47.792920] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-02T18:04:47.794582] [INFO ] [REMOTE ] CLS: Full fetch complete (77077 records). [2025-10-02T18:04:47.794722] [DEBUG] [VALIDATOR ] CLS: Validating primary data. [2025-10-02T18:04:47.795536] [FATAL] [VALIDATOR ] CLS: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:04:47.795631] [FATAL] [MAIN ] CLS: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:04:47.795715] [WARN ] [MAIN ] CLS: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:04:47.795766] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-10-02T18:04:47.795825] [DEBUG] [LOCAL ] CLS: No primary data file found to delete. [2025-10-02T18:04:47.795864] [INFO ] [LOCAL ] CLS: Starting deletion of derivative data. [2025-10-02T18:04:47.796315] [DEBUG] [LOCAL ] CLS: Deleted derivative data file. [2025-10-02T18:04:47.796426] [INFO ] [MAIN ] Update Progress: 467/2370 symbols completed. CLS took 38.9s. Estimated remaining: 4h 23m 47s. Rate: 7.2 symbols/min [2025-10-02T18:04:47.990284] [INFO ] [MAIN ] CM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:04:48.037815] [DEBUG] [LOCAL ] CM: Loaded 48556 existing records from primary storage. [2025-10-02T18:04:48.038175] [INFO ] [MAIN ] CM: Loaded 48556 existing records. [2025-10-02T18:04:48.235519] [WARN ] [MAIN ] CM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:04:48.235935] [INFO ] [MAIN ] CM: Wiping existing primary data before full refresh. [2025-10-02T18:04:48.236056] [INFO ] [LOCAL ] CM: Starting deletion of primary data. [2025-10-02T18:04:48.237604] [DEBUG] [LOCAL ] CM: Deleted primary data file. [2025-10-02T18:04:48.237698] [INFO ] [MAIN ] CM: Starting full primary refresh. [2025-10-02T18:04:48.274180] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-05. [2025-10-02T18:04:48.643323] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-02T18:04:48.673893] [INFO ] [REMOTE ] CM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:04:49.073009] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-04. [2025-10-02T18:04:49.408957] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-02T18:04:49.512472] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-02T18:04:49.873029] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-06. [2025-10-02T18:04:50.673041] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-07. [2025-10-02T18:04:50.848170] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-02T18:04:51.004110] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-02T18:04:51.473059] [INFO ] [REMOTE ] CM: Fetching primary data for 2024-12. [2025-10-02T18:04:52.272977] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-05. [2025-10-02T18:04:52.497351] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-02T18:04:53.055305] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-02T18:04:53.072960] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-07. [2025-10-02T18:04:53.872996] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-08. [2025-10-02T18:04:54.190704] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-02T18:04:54.216180] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-02T18:04:54.673017] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-08. [2025-10-02T18:04:55.472970] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-06. [2025-10-02T18:04:55.697914] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-02T18:04:55.732822] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-02T18:04:56.272990] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-09. [2025-10-02T18:04:57.072996] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-01. [2025-10-02T18:04:57.430617] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-02T18:04:57.489426] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-02T18:04:57.872990] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-10. [2025-10-02T18:04:58.372974] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-02T18:04:58.672979] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-07. [2025-10-02T18:04:58.818861] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-02T18:04:58.820263] [INFO ] [REMOTE ] CLW: Full fetch complete (34977 records). [2025-10-02T18:04:58.820354] [DEBUG] [VALIDATOR ] CLW: Validating primary data. [2025-10-02T18:04:59.242228] [DEBUG] [VALIDATOR ] CLW: All expected trading days are present. [2025-10-02T18:04:59.242437] [DEBUG] [VALIDATOR ] CLW: Primary data validation passed. [2025-10-02T18:04:59.243029] [INFO ] [MAIN ] CLW: Fetched primary data is valid. [2025-10-02T18:04:59.243094] [DEBUG] [LOCAL ] CLW: Saving primary data. [2025-10-02T18:04:59.244043] [DEBUG] [LOCAL ] CLW: Trimmed 34977 records to 21887 (keeping 200 days of data) [2025-10-02T18:04:59.370093] [DEBUG] [LOCAL ] CLW: Primary data saved (21887 records). [2025-10-02T18:04:59.370232] [INFO ] [MAIN ] CLW: Full history saved. [2025-10-02T18:04:59.370351] [INFO ] [MAIN ] Update Progress: 468/2370 symbols completed. CLW took 28.5s. Estimated remaining: 4h 23m 52s. Rate: 7.2 symbols/min [2025-10-02T18:04:59.474309] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-09. [2025-10-02T18:04:59.550222] [INFO ] [MAIN ] CMA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:04:59.604027] [DEBUG] [LOCAL ] CMA: Loaded 49871 existing records from primary storage. [2025-10-02T18:04:59.604436] [INFO ] [MAIN ] CMA: Loaded 49871 existing records. [2025-10-02T18:04:59.795759] [WARN ] [MAIN ] CMA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:04:59.796023] [INFO ] [MAIN ] CMA: Wiping existing primary data before full refresh. [2025-10-02T18:04:59.796073] [INFO ] [LOCAL ] CMA: Starting deletion of primary data. [2025-10-02T18:04:59.797538] [DEBUG] [LOCAL ] CMA: Deleted primary data file. [2025-10-02T18:04:59.797602] [INFO ] [MAIN ] CMA: Starting full primary refresh. [2025-10-02T18:05:00.200292] [INFO ] [REMOTE ] CMA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:05:00.273026] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-02. [2025-10-02T18:05:00.551101] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-02T18:05:01.073010] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-08. [2025-10-02T18:05:01.360001] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-02T18:05:01.800366] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-02T18:05:01.872991] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-03. [2025-10-02T18:05:02.673053] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-10. [2025-10-02T18:05:03.436978] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-02T18:05:03.472996] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-09. [2025-10-02T18:05:03.704360] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-02T18:05:04.169230] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-02T18:05:04.171497] [INFO ] [REMOTE ] CLVT: Full fetch complete (75241 records). [2025-10-02T18:05:04.171687] [DEBUG] [VALIDATOR ] CLVT: Validating primary data. [2025-10-02T18:05:04.281396] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-04. [2025-10-02T18:05:04.624100] [DEBUG] [VALIDATOR ] CLVT: All expected trading days are present. [2025-10-02T18:05:04.624221] [DEBUG] [VALIDATOR ] CLVT: Primary data validation passed. [2025-10-02T18:05:04.625271] [INFO ] [MAIN ] CLVT: Fetched primary data is valid. [2025-10-02T18:05:04.625361] [DEBUG] [LOCAL ] CLVT: Saving primary data. [2025-10-02T18:05:04.626997] [DEBUG] [LOCAL ] CLVT: Trimmed 75241 records to 52342 (keeping 200 days of data) [2025-10-02T18:05:04.948124] [DEBUG] [LOCAL ] CLVT: Primary data saved (52342 records). [2025-10-02T18:05:04.948306] [INFO ] [MAIN ] CLVT: Full history saved. [2025-10-02T18:05:04.948410] [INFO ] [MAIN ] Update Progress: 469/2370 symbols completed. CLVT took 40.6s. Estimated remaining: 4h 23m 32s. Rate: 7.2 symbols/min [2025-10-02T18:05:05.078136] [INFO ] [REMOTE ] CMA: Fetching primary data for 2024-12. [2025-10-02T18:05:05.139430] [INFO ] [MAIN ] CMBT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:05:05.164098] [DEBUG] [LOCAL ] CMBT: Loaded 23471 existing records from primary storage. [2025-10-02T18:05:05.164513] [INFO ] [MAIN ] CMBT: Loaded 23471 existing records. [2025-10-02T18:05:05.379632] [WARN ] [MAIN ] CMBT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:05:05.380115] [INFO ] [MAIN ] CMBT: Wiping existing primary data before full refresh. [2025-10-02T18:05:05.380326] [INFO ] [LOCAL ] CMBT: Starting deletion of primary data. [2025-10-02T18:05:05.381111] [DEBUG] [LOCAL ] CMBT: Deleted primary data file. [2025-10-02T18:05:05.381175] [INFO ] [MAIN ] CMBT: Starting full primary refresh. [2025-10-02T18:05:05.756633] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-02T18:05:05.836634] [INFO ] [REMOTE ] CMBT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:05:05.872967] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2024-12. [2025-10-02T18:05:06.025603] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-02T18:05:06.673010] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-05. [2025-10-02T18:05:06.954816] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-02T18:05:07.093801] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-02T18:05:07.473036] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-01. [2025-10-02T18:05:08.065320] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-02T18:05:08.273057] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-01. [2025-10-02T18:05:08.717960] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-02T18:05:08.864840] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-02T18:05:09.073003] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-06. [2025-10-02T18:05:09.873002] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-02. [2025-10-02T18:05:10.672996] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-10. [2025-10-02T18:05:10.774368] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-02T18:05:10.800909] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-02T18:05:11.473028] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-02. [2025-10-02T18:05:12.136819] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-02T18:05:12.139120] [INFO ] [REMOTE ] CLX: Full fetch complete (73078 records). [2025-10-02T18:05:12.139242] [DEBUG] [VALIDATOR ] CLX: Validating primary data. [2025-10-02T18:05:12.285849] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-03. [2025-10-02T18:05:12.575140] [DEBUG] [VALIDATOR ] CLX: All expected trading days are present. [2025-10-02T18:05:12.575230] [DEBUG] [VALIDATOR ] CLX: Primary data validation passed. [2025-10-02T18:05:12.576024] [INFO ] [MAIN ] CLX: Fetched primary data is valid. [2025-10-02T18:05:12.576091] [DEBUG] [LOCAL ] CLX: Saving primary data. [2025-10-02T18:05:12.577678] [DEBUG] [LOCAL ] CLX: Trimmed 73078 records to 51852 (keeping 200 days of data) [2025-10-02T18:05:12.941978] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-02T18:05:12.971124] [DEBUG] [LOCAL ] CLX: Primary data saved (51852 records). [2025-10-02T18:05:12.971297] [INFO ] [MAIN ] CLX: Full history saved. [2025-10-02T18:05:12.971406] [INFO ] [MAIN ] Update Progress: 470/2370 symbols completed. CLX took 38.6s. Estimated remaining: 4h 23m 23s. Rate: 7.2 symbols/min [2025-10-02T18:05:13.077588] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-07. [2025-10-02T18:05:13.174712] [INFO ] [MAIN ] CMC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:05:13.218764] [DEBUG] [LOCAL ] CMC: Loaded 45589 existing records from primary storage. [2025-10-02T18:05:13.219087] [INFO ] [MAIN ] CMC: Loaded 45589 existing records. [2025-10-02T18:05:13.435099] [WARN ] [MAIN ] CMC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:05:13.445270] [INFO ] [MAIN ] CMC: Wiping existing primary data before full refresh. [2025-10-02T18:05:13.446023] [INFO ] [LOCAL ] CMC: Starting deletion of primary data. [2025-10-02T18:05:13.446345] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-02T18:05:13.449972] [DEBUG] [LOCAL ] CMC: Deleted primary data file. [2025-10-02T18:05:13.450565] [INFO ] [MAIN ] CMC: Starting full primary refresh. [2025-10-02T18:05:13.877226] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-03. [2025-10-02T18:05:13.877111] [INFO ] [REMOTE ] CMC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:05:14.673061] [INFO ] [REMOTE ] CMC: Fetching primary data for 2024-12. [2025-10-02T18:05:15.046256] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-02T18:05:15.473025] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-08. [2025-10-02T18:05:15.620816] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-02T18:05:16.098059] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-02T18:05:16.273018] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-04. [2025-10-02T18:05:16.648938] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-02T18:05:17.073006] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-04. [2025-10-02T18:05:17.817264] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-02T18:05:17.873027] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-09. [2025-10-02T18:05:18.087568] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-02T18:05:18.673133] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-05. [2025-10-02T18:05:19.437826] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-02T18:05:19.473058] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-05. [2025-10-02T18:05:19.541421] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-02T18:05:20.272991] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-10. [2025-10-02T18:05:20.977833] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-02T18:05:21.073050] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-01. [2025-10-02T18:05:21.497350] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-02T18:05:21.501297] [INFO ] [REMOTE ] CM: Full fetch complete (69394 records). [2025-10-02T18:05:21.501493] [DEBUG] [VALIDATOR ] CM: Validating primary data. [2025-10-02T18:05:21.878199] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-06. [2025-10-02T18:05:21.982789] [DEBUG] [VALIDATOR ] CM: All expected trading days are present. [2025-10-02T18:05:21.982896] [DEBUG] [VALIDATOR ] CM: Primary data validation passed. [2025-10-02T18:05:21.983916] [INFO ] [MAIN ] CM: Fetched primary data is valid. [2025-10-02T18:05:21.984018] [DEBUG] [LOCAL ] CM: Saving primary data. [2025-10-02T18:05:21.986014] [DEBUG] [LOCAL ] CM: Trimmed 69394 records to 48929 (keeping 200 days of data) [2025-10-02T18:05:22.315777] [DEBUG] [LOCAL ] CM: Primary data saved (48929 records). [2025-10-02T18:05:22.315922] [INFO ] [MAIN ] CM: Full history saved. [2025-10-02T18:05:22.316053] [INFO ] [MAIN ] Update Progress: 471/2370 symbols completed. CM took 34.5s. Estimated remaining: 4h 23m 19s. Rate: 7.2 symbols/min [2025-10-02T18:05:22.519007] [INFO ] [MAIN ] CMCM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:05:22.527218] [DEBUG] [LOCAL ] CMCM: Loaded 4726 existing records from primary storage. [2025-10-02T18:05:22.527585] [INFO ] [MAIN ] CMCM: Loaded 4726 existing records. [2025-10-02T18:05:22.676390] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-06. [2025-10-02T18:05:22.746484] [WARN ] [MAIN ] CMCM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:05:22.747605] [INFO ] [MAIN ] CMCM: Wiping existing primary data before full refresh. [2025-10-02T18:05:22.747949] [INFO ] [LOCAL ] CMCM: Starting deletion of primary data. [2025-10-02T18:05:22.748365] [DEBUG] [LOCAL ] CMCM: Deleted primary data file. [2025-10-02T18:05:22.748484] [INFO ] [MAIN ] CMCM: Starting full primary refresh. [2025-10-02T18:05:22.980558] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-02T18:05:23.011885] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-02T18:05:23.223865] [INFO ] [REMOTE ] CMCM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:05:23.472983] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2024-12. [2025-10-02T18:05:24.183485] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-02T18:05:24.272976] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-02. [2025-10-02T18:05:24.367291] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-02T18:05:25.073035] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-01. [2025-10-02T18:05:25.549246] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-02T18:05:25.769389] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-02T18:05:25.873016] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-02. [2025-10-02T18:05:26.532024] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-02T18:05:26.673011] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-03. [2025-10-02T18:05:27.473027] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-07. [2025-10-02T18:05:28.272978] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-03. [2025-10-02T18:05:28.551489] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-02T18:05:28.680185] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-02T18:05:29.072968] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-04. [2025-10-02T18:05:29.265277] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-02T18:05:29.873041] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-07. [2025-10-02T18:05:30.678136] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-04. [2025-10-02T18:05:30.696303] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-02T18:05:31.032816] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-02T18:05:31.266930] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-02T18:05:31.472999] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-08. [2025-10-02T18:05:32.273014] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-05. [2025-10-02T18:05:33.073024] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-08. [2025-10-02T18:05:33.151813] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-02T18:05:33.873048] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-09. [2025-10-02T18:05:33.936328] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-02T18:05:34.667170] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-02T18:05:34.674037] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-05. [2025-10-02T18:05:35.375846] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-02T18:05:35.420393] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-02T18:05:35.472978] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-06. [2025-10-02T18:05:36.273019] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-10. [2025-10-02T18:05:36.978348] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-02T18:05:37.073073] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-09. [2025-10-02T18:05:37.472386] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-02T18:05:37.473924] [INFO ] [REMOTE ] CMA: Full fetch complete (72738 records). [2025-10-02T18:05:37.474097] [DEBUG] [VALIDATOR ] CMA: Validating primary data. [2025-10-02T18:05:37.474998] [FATAL] [VALIDATOR ] CMA: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:05:37.475096] [FATAL] [MAIN ] CMA: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:05:37.475141] [WARN ] [MAIN ] CMA: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:05:37.475201] [INFO ] [LOCAL ] CMA: Starting deletion of primary data. [2025-10-02T18:05:37.475294] [DEBUG] [LOCAL ] CMA: No primary data file found to delete. [2025-10-02T18:05:37.475351] [INFO ] [LOCAL ] CMA: Starting deletion of derivative data. [2025-10-02T18:05:37.475760] [DEBUG] [LOCAL ] CMA: Deleted derivative data file. [2025-10-02T18:05:37.477330] [INFO ] [MAIN ] Update Progress: 472/2370 symbols completed. CMA took 38.1s. Estimated remaining: 4h 23m 38s. Rate: 7.2 symbols/min [2025-10-02T18:05:37.668272] [INFO ] [MAIN ] CMDB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:05:37.668517] [DEBUG] [LOCAL ] CMDB: No existing data file found in primary storage. [2025-10-02T18:05:37.668574] [WARN ] [MAIN ] CMDB: No existing data found, performing full refresh instead. [2025-10-02T18:05:37.668716] [INFO ] [MAIN ] CMDB: Wiping existing primary data before full refresh. [2025-10-02T18:05:37.668767] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-02T18:05:37.668813] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-02T18:05:37.668858] [INFO ] [MAIN ] CMDB: Starting full primary refresh. [2025-10-02T18:05:37.881072] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-07. [2025-10-02T18:05:38.074556] [INFO ] [REMOTE ] CMDB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:05:38.672999] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2024-12. [2025-10-02T18:05:38.893096] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T18:05:38.893633] [WARN ] [REMOTE ] CMDB: No data returned for month 2024-12 [2025-10-02T18:05:38.893913] [FATAL] [REMOTE ] CMDB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T18:05:38.896631] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-02T18:05:38.894483] [FATAL] [MAIN ] CMDB: Failed to fetch primary data. [2025-10-02T18:05:38.908533] [WARN ] [MAIN ] CMDB: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T18:05:38.909193] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-02T18:05:38.909306] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-02T18:05:38.909795] [INFO ] [LOCAL ] CMDB: Starting deletion of derivative data. [2025-10-02T18:05:38.909870] [DEBUG] [LOCAL ] CMDB: No derivative data file found to delete. [2025-10-02T18:05:38.909947] [INFO ] [MAIN ] Update Progress: 473/2370 symbols completed. CMDB took 1.4s. Estimated remaining: 4h 23m 2s. Rate: 7.2 symbols/min [2025-10-02T18:05:39.094290] [INFO ] [MAIN ] CMG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:05:39.167164] [DEBUG] [LOCAL ] CMG: Loaded 53721 existing records from primary storage. [2025-10-02T18:05:39.167492] [INFO ] [MAIN ] CMG: Loaded 53721 existing records. [2025-10-02T18:05:39.414715] [WARN ] [MAIN ] CMG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:05:39.414959] [INFO ] [MAIN ] CMG: Wiping existing primary data before full refresh. [2025-10-02T18:05:39.415089] [INFO ] [LOCAL ] CMG: Starting deletion of primary data. [2025-10-02T18:05:39.416875] [DEBUG] [LOCAL ] CMG: Deleted primary data file. [2025-10-02T18:05:39.417010] [INFO ] [MAIN ] CMG: Starting full primary refresh. [2025-10-02T18:05:39.478122] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-10. [2025-10-02T18:05:39.580268] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-02T18:05:39.850498] [INFO ] [REMOTE ] CMG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:05:40.272998] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-08. [2025-10-02T18:05:41.073009] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-06. [2025-10-02T18:05:41.143904] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-02T18:05:41.146087] [INFO ] [REMOTE ] CMBT: Full fetch complete (30527 records). [2025-10-02T18:05:41.146182] [DEBUG] [VALIDATOR ] CMBT: Validating primary data. [2025-10-02T18:05:41.578454] [DEBUG] [VALIDATOR ] CMBT: All expected trading days are present. [2025-10-02T18:05:41.578580] [DEBUG] [VALIDATOR ] CMBT: Primary data validation passed. [2025-10-02T18:05:41.579188] [INFO ] [MAIN ] CMBT: Fetched primary data is valid. [2025-10-02T18:05:41.579306] [DEBUG] [LOCAL ] CMBT: Saving primary data. [2025-10-02T18:05:41.580626] [DEBUG] [LOCAL ] CMBT: Trimmed 30527 records to 23828 (keeping 200 days of data) [2025-10-02T18:05:41.709020] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-02T18:05:41.725799] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-02T18:05:41.783520] [DEBUG] [LOCAL ] CMBT: Primary data saved (23828 records). [2025-10-02T18:05:41.783690] [INFO ] [MAIN ] CMBT: Full history saved. [2025-10-02T18:05:41.783816] [INFO ] [MAIN ] Update Progress: 474/2370 symbols completed. CMBT took 36.8s. Estimated remaining: 4h 22m 32s. Rate: 7.2 symbols/min [2025-10-02T18:05:41.878119] [INFO ] [REMOTE ] CMG: Fetching primary data for 2024-12. [2025-10-02T18:05:41.972944] [INFO ] [MAIN ] CMI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:05:42.013939] [DEBUG] [LOCAL ] CMI: Loaded 41704 existing records from primary storage. [2025-10-02T18:05:42.014258] [INFO ] [MAIN ] CMI: Loaded 41704 existing records. [2025-10-02T18:05:42.206755] [WARN ] [MAIN ] CMI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:05:42.207000] [INFO ] [MAIN ] CMI: Wiping existing primary data before full refresh. [2025-10-02T18:05:42.207094] [INFO ] [LOCAL ] CMI: Starting deletion of primary data. [2025-10-02T18:05:42.208412] [DEBUG] [LOCAL ] CMI: Deleted primary data file. [2025-10-02T18:05:42.208477] [INFO ] [MAIN ] CMI: Starting full primary refresh. [2025-10-02T18:05:42.607872] [INFO ] [REMOTE ] CMI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:05:42.673030] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-07. [2025-10-02T18:05:43.473048] [INFO ] [REMOTE ] CMI: Fetching primary data for 2024-12. [2025-10-02T18:05:43.489380] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-02T18:05:44.239381] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2024-12 (2.36 seconds). [2025-10-02T18:05:44.272955] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-01. [2025-10-02T18:05:44.785756] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-02T18:05:45.073020] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-08. [2025-10-02T18:05:45.766816] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-02T18:05:45.873011] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-09. [2025-10-02T18:05:46.335207] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-02T18:05:46.647046] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-02T18:05:46.672995] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-02. [2025-10-02T18:05:47.473011] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-10. [2025-10-02T18:05:47.997281] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-02T18:05:47.998388] [INFO ] [REMOTE ] CMCM: Full fetch complete (6955 records). [2025-10-02T18:05:47.998480] [DEBUG] [VALIDATOR ] CMCM: Validating primary data. [2025-10-02T18:05:48.278140] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-01. [2025-10-02T18:05:48.409187] [DEBUG] [VALIDATOR ] CMCM: All expected trading days are present. [2025-10-02T18:05:48.409272] [DEBUG] [VALIDATOR ] CMCM: Primary data validation passed. [2025-10-02T18:05:48.409465] [INFO ] [MAIN ] CMCM: Fetched primary data is valid. [2025-10-02T18:05:48.409508] [DEBUG] [LOCAL ] CMCM: Saving primary data. [2025-10-02T18:05:48.409967] [DEBUG] [LOCAL ] CMCM: Trimmed 6955 records to 4758 (keeping 200 days of data) [2025-10-02T18:05:48.437761] [DEBUG] [LOCAL ] CMCM: Primary data saved (4758 records). [2025-10-02T18:05:48.437880] [INFO ] [MAIN ] CMCM: Full history saved. [2025-10-02T18:05:48.437962] [INFO ] [MAIN ] Update Progress: 475/2370 symbols completed. CMCM took 26.1s. Estimated remaining: 4h 22m 17s. Rate: 7.2 symbols/min [2025-10-02T18:05:48.629087] [INFO ] [MAIN ] CMP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:05:48.672006] [DEBUG] [LOCAL ] CMP: Loaded 36257 existing records from primary storage. [2025-10-02T18:05:48.672403] [INFO ] [MAIN ] CMP: Loaded 36257 existing records. [2025-10-02T18:05:48.868124] [WARN ] [MAIN ] CMP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:05:48.868585] [INFO ] [MAIN ] CMP: Wiping existing primary data before full refresh. [2025-10-02T18:05:48.868778] [INFO ] [LOCAL ] CMP: Starting deletion of primary data. [2025-10-02T18:05:48.879205] [DEBUG] [LOCAL ] CMP: Deleted primary data file. [2025-10-02T18:05:48.893795] [INFO ] [MAIN ] CMP: Starting full primary refresh. [2025-10-02T18:05:48.978429] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-10-02T18:05:49.078083] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-09. [2025-10-02T18:05:49.316115] [INFO ] [REMOTE ] CMP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:05:49.648526] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-02T18:05:49.872995] [INFO ] [REMOTE ] CMP: Fetching primary data for 2024-12. [2025-10-02T18:05:50.672993] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-02. [2025-10-02T18:05:51.084351] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-02T18:05:51.322206] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-02T18:05:51.472999] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-01. [2025-10-02T18:05:51.976693] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-02T18:05:52.272999] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-03. [2025-10-02T18:05:52.813312] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-02T18:05:53.072990] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-02. [2025-10-02T18:05:53.649190] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-02T18:05:53.873022] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-04. [2025-10-02T18:05:54.498398] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-02T18:05:54.673011] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-03. [2025-10-02T18:05:55.473015] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-10. [2025-10-02T18:05:55.595057] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-02T18:05:56.075699] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-02T18:05:56.272993] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-03. [2025-10-02T18:05:56.688115] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-02T18:05:56.693191] [INFO ] [REMOTE ] CMC: Full fetch complete (67009 records). [2025-10-02T18:05:56.693476] [DEBUG] [VALIDATOR ] CMC: Validating primary data. [2025-10-02T18:05:57.078294] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-05. [2025-10-02T18:05:57.162434] [DEBUG] [VALIDATOR ] CMC: All expected trading days are present. [2025-10-02T18:05:57.162544] [DEBUG] [VALIDATOR ] CMC: Primary data validation passed. [2025-10-02T18:05:57.163950] [INFO ] [MAIN ] CMC: Fetched primary data is valid. [2025-10-02T18:05:57.164025] [DEBUG] [LOCAL ] CMC: Saving primary data. [2025-10-02T18:05:57.165980] [DEBUG] [LOCAL ] CMC: Trimmed 67009 records to 45898 (keeping 200 days of data) [2025-10-02T18:05:57.459334] [DEBUG] [LOCAL ] CMC: Primary data saved (45898 records). [2025-10-02T18:05:57.459479] [INFO ] [MAIN ] CMC: Full history saved. [2025-10-02T18:05:57.459596] [INFO ] [MAIN ] Update Progress: 476/2370 symbols completed. CMC took 44.5s. Estimated remaining: 4h 22m 12s. Rate: 7.2 symbols/min [2025-10-02T18:05:57.646175] [INFO ] [MAIN ] CMPO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:05:57.687282] [DEBUG] [LOCAL ] CMPO: Loaded 39242 existing records from primary storage. [2025-10-02T18:05:57.687595] [INFO ] [MAIN ] CMPO: Loaded 39242 existing records. [2025-10-02T18:05:57.878479] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-04. [2025-10-02T18:05:57.882909] [WARN ] [MAIN ] CMPO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:05:57.884360] [INFO ] [MAIN ] CMPO: Wiping existing primary data before full refresh. [2025-10-02T18:05:57.884424] [INFO ] [LOCAL ] CMPO: Starting deletion of primary data. [2025-10-02T18:05:57.885833] [DEBUG] [LOCAL ] CMPO: Deleted primary data file. [2025-10-02T18:05:57.885908] [INFO ] [MAIN ] CMPO: Starting full primary refresh. [2025-10-02T18:05:58.285714] [INFO ] [REMOTE ] CMPO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:05:58.551434] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-02T18:05:58.635975] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-02T18:05:58.672964] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-06. [2025-10-02T18:05:59.300578] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-02T18:05:59.473033] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2024-12. [2025-10-02T18:06:00.252397] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-02T18:06:00.272971] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-07. [2025-10-02T18:06:00.937402] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-02T18:06:01.073023] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-05. [2025-10-02T18:06:01.873041] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-01. [2025-10-02T18:06:02.111381] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-02T18:06:02.673017] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-04. [2025-10-02T18:06:02.735275] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-02T18:06:03.382721] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-02T18:06:03.473045] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-02. [2025-10-02T18:06:04.273068] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-06. [2025-10-02T18:06:04.576361] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-02T18:06:04.930397] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-02T18:06:05.073027] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-03. [2025-10-02T18:06:05.564240] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-02T18:06:05.873032] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-07. [2025-10-02T18:06:06.637227] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-02T18:06:06.673018] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-04. [2025-10-02T18:06:07.473025] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-05. [2025-10-02T18:06:07.522030] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-02T18:06:08.213784] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-02T18:06:08.273038] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-05. [2025-10-02T18:06:09.073007] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-08. [2025-10-02T18:06:09.760854] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-10-02T18:06:09.799571] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-02T18:06:09.873047] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-06. [2025-10-02T18:06:10.586117] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-02T18:06:10.673045] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-09. [2025-10-02T18:06:11.473020] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-06. [2025-10-02T18:06:11.946007] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-02T18:06:11.947046] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-02T18:06:12.273031] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-07. [2025-10-02T18:06:13.077619] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-08. [2025-10-02T18:06:13.083467] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-02T18:06:13.873024] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-10. [2025-10-02T18:06:14.631826] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-10-02T18:06:14.672989] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-07. [2025-10-02T18:06:14.789433] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-02T18:06:15.016980] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-02T18:06:15.018566] [INFO ] [REMOTE ] CMP: Full fetch complete (52536 records). [2025-10-02T18:06:15.018720] [DEBUG] [VALIDATOR ] CMP: Validating primary data. [2025-10-02T18:06:15.439939] [DEBUG] [VALIDATOR ] CMP: All expected trading days are present. [2025-10-02T18:06:15.440336] [DEBUG] [VALIDATOR ] CMP: Primary data validation passed. [2025-10-02T18:06:15.441174] [INFO ] [MAIN ] CMP: Fetched primary data is valid. [2025-10-02T18:06:15.441260] [DEBUG] [LOCAL ] CMP: Saving primary data. [2025-10-02T18:06:15.442613] [DEBUG] [LOCAL ] CMP: Trimmed 52536 records to 36460 (keeping 200 days of data) [2025-10-02T18:06:15.497138] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-08. [2025-10-02T18:06:15.673155] [DEBUG] [LOCAL ] CMP: Primary data saved (36460 records). [2025-10-02T18:06:15.673412] [INFO ] [MAIN ] CMP: Full history saved. [2025-10-02T18:06:15.673513] [INFO ] [MAIN ] Update Progress: 477/2370 symbols completed. CMP took 27.2s. Estimated remaining: 4h 22m 43s. Rate: 7.2 symbols/min [2025-10-02T18:06:15.909786] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-02T18:06:16.272997] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-09. [2025-10-02T18:06:17.073003] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-08. [2025-10-02T18:06:17.766278] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-02T18:06:17.872990] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-09. [2025-10-02T18:06:17.933760] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-02T18:06:18.177682] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-02T18:06:18.673033] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-09. [2025-10-02T18:06:19.473001] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-10. [2025-10-02T18:06:19.710958] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-02T18:06:20.166791] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-02T18:06:20.273009] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-10. [2025-10-02T18:06:20.789809] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-02T18:06:20.792201] [INFO ] [REMOTE ] CMI: Full fetch complete (60087 records). [2025-10-02T18:06:20.792312] [DEBUG] [VALIDATOR ] CMI: Validating primary data. [2025-10-02T18:06:21.079035] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-10. [2025-10-02T18:06:21.215955] [DEBUG] [VALIDATOR ] CMI: All expected trading days are present. [2025-10-02T18:06:21.216054] [DEBUG] [VALIDATOR ] CMI: Primary data validation passed. [2025-10-02T18:06:21.216842] [INFO ] [MAIN ] CMI: Fetched primary data is valid. [2025-10-02T18:06:21.216911] [DEBUG] [LOCAL ] CMI: Saving primary data. [2025-10-02T18:06:21.219044] [DEBUG] [LOCAL ] CMI: Trimmed 60087 records to 42060 (keeping 200 days of data) [2025-10-02T18:06:21.496302] [DEBUG] [LOCAL ] CMI: Primary data saved (42060 records). [2025-10-02T18:06:21.496460] [INFO ] [MAIN ] CMI: Full history saved. [2025-10-02T18:06:21.496550] [INFO ] [MAIN ] Update Progress: 478/2370 symbols completed. CMI took 39.7s. Estimated remaining: 4h 22m 24s. Rate: 7.2 symbols/min [2025-10-02T18:06:22.393352] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-02T18:06:22.395277] [INFO ] [REMOTE ] CMPO: Full fetch complete (59000 records). [2025-10-02T18:06:22.395410] [DEBUG] [VALIDATOR ] CMPO: Validating primary data. [2025-10-02T18:06:22.521202] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-02T18:06:22.544710] [INFO ] [REMOTE ] CMG: Full fetch complete (77795 records). [2025-10-02T18:06:22.555205] [DEBUG] [VALIDATOR ] CMG: Validating primary data. [2025-10-02T18:06:23.185336] [DEBUG] [VALIDATOR ] CMPO: All expected trading days are present. [2025-10-02T18:06:23.209490] [DEBUG] [VALIDATOR ] CMPO: Primary data validation passed. [2025-10-02T18:06:23.223908] [INFO ] [MAIN ] CMPO: Fetched primary data is valid. [2025-10-02T18:06:23.243096] [DEBUG] [LOCAL ] CMPO: Saving primary data. [2025-10-02T18:06:23.310411] [DEBUG] [LOCAL ] CMPO: Trimmed 59000 records to 39512 (keeping 200 days of data) [2025-10-02T18:06:23.355827] [DEBUG] [VALIDATOR ] CMG: All expected trading days are present. [2025-10-02T18:06:23.355928] [DEBUG] [VALIDATOR ] CMG: Primary data validation passed. [2025-10-02T18:06:23.356687] [INFO ] [MAIN ] CMG: Fetched primary data is valid. [2025-10-02T18:06:23.356755] [DEBUG] [LOCAL ] CMG: Saving primary data. [2025-10-02T18:06:23.444547] [DEBUG] [LOCAL ] CMG: Trimmed 77795 records to 54111 (keeping 200 days of data) [2025-10-02T18:06:23.721831] [DEBUG] [LOCAL ] CMPO: Primary data saved (39512 records). [2025-10-02T18:06:23.729810] [INFO ] [MAIN ] CMPO: Full history saved. [2025-10-02T18:06:23.730279] [INFO ] [MAIN ] Update Progress: 479/2370 symbols completed. CMPO took 26.3s. Estimated remaining: 4h 21m 52s. Rate: 7.2 symbols/min [2025-10-02T18:06:23.950938] [DEBUG] [LOCAL ] CMG: Primary data saved (54111 records). [2025-10-02T18:06:23.951103] [INFO ] [MAIN ] CMG: Full history saved. [2025-10-02T18:06:23.952251] [INFO ] [MAIN ] Update Progress: 480/2370 symbols completed. CMG took 45.0s. Estimated remaining: 4h 21m 12s. Rate: 7.2 symbols/min [2025-10-02T18:06:24.659912] [INFO ] [MAIN ] CMSC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:06:24.818201] [INFO ] [MAIN ] CMRE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:06:24.819259] [INFO ] [MAIN ] CMS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:06:24.825313] [DEBUG] [LOCAL ] CMS: No existing data file found in primary storage. [2025-10-02T18:06:24.828463] [WARN ] [MAIN ] CMS: No existing data found, performing full refresh instead. [2025-10-02T18:06:24.828135] [INFO ] [MAIN ] CMSA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:06:24.830444] [INFO ] [MAIN ] CMS: Wiping existing primary data before full refresh. [2025-10-02T18:06:24.830559] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-10-02T18:06:24.832316] [DEBUG] [LOCAL ] CMS: No primary data file found to delete. [2025-10-02T18:06:24.832496] [INFO ] [MAIN ] CMS: Starting full primary refresh. [2025-10-02T18:06:24.894333] [DEBUG] [LOCAL ] CMSC: Loaded 5075 existing records from primary storage. [2025-10-02T18:06:24.925598] [DEBUG] [LOCAL ] CMSA: Loaded 3509 existing records from primary storage. [2025-10-02T18:06:24.926110] [INFO ] [MAIN ] CMSC: Loaded 5075 existing records. [2025-10-02T18:06:24.932168] [INFO ] [MAIN ] CMSA: Loaded 3509 existing records. [2025-10-02T18:06:25.160851] [DEBUG] [LOCAL ] CMRE: Loaded 35458 existing records from primary storage. [2025-10-02T18:06:25.275357] [INFO ] [MAIN ] CMRE: Loaded 35458 existing records. [2025-10-02T18:06:25.719296] [WARN ] [MAIN ] CMSA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:06:25.747903] [INFO ] [MAIN ] CMSA: Wiping existing primary data before full refresh. [2025-10-02T18:06:25.808559] [INFO ] [LOCAL ] CMSA: Starting deletion of primary data. [2025-10-02T18:06:25.933747] [WARN ] [MAIN ] CMSC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:06:25.938178] [WARN ] [MAIN ] CMRE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:06:25.942575] [INFO ] [MAIN ] CMSC: Wiping existing primary data before full refresh. [2025-10-02T18:06:25.942750] [INFO ] [MAIN ] CMRE: Wiping existing primary data before full refresh. [2025-10-02T18:06:25.945000] [INFO ] [LOCAL ] CMSC: Starting deletion of primary data. [2025-10-02T18:06:25.945262] [INFO ] [LOCAL ] CMRE: Starting deletion of primary data. [2025-10-02T18:06:25.963683] [DEBUG] [LOCAL ] CMRE: Deleted primary data file. [2025-10-02T18:06:25.945116] [DEBUG] [LOCAL ] CMSA: Deleted primary data file. [2025-10-02T18:06:25.963754] [DEBUG] [LOCAL ] CMSC: Deleted primary data file. [2025-10-02T18:06:25.964150] [INFO ] [MAIN ] CMSA: Starting full primary refresh. [2025-10-02T18:06:25.964072] [INFO ] [MAIN ] CMRE: Starting full primary refresh. [2025-10-02T18:06:25.967188] [INFO ] [MAIN ] CMSC: Starting full primary refresh. [2025-10-02T18:06:25.974473] [INFO ] [REMOTE ] CMS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:06:26.076899] [INFO ] [REMOTE ] CMS: Fetching primary data for 2024-12. [2025-10-02T18:06:27.221029] [INFO ] [REMOTE ] CMSC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:06:27.303218] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2024-12. [2025-10-02T18:06:27.317259] [INFO ] [REMOTE ] CMSA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:06:27.327036] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2024-12. [2025-10-02T18:06:27.368880] [INFO ] [REMOTE ] CMRE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:06:27.369980] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2024-12. [2025-10-02T18:06:28.078428] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-02T18:06:28.081453] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-01. [2025-10-02T18:06:28.119559] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-02T18:06:28.122465] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-01. [2025-10-02T18:06:28.297349] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-10-02T18:06:28.310817] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-01. [2025-10-02T18:06:28.541912] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-02T18:06:28.543947] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-02. [2025-10-02T18:06:28.660691] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-02T18:06:28.666853] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-01. [2025-10-02T18:06:28.715297] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-02T18:06:28.966213] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-02T18:06:29.073060] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-02. [2025-10-02T18:06:29.523001] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-02T18:06:29.751263] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-02T18:06:29.872971] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-02. [2025-10-02T18:06:29.906758] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-02T18:06:30.673022] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-03. [2025-10-02T18:06:31.220320] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-02T18:06:31.248574] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-02T18:06:31.473025] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-02. [2025-10-02T18:06:32.273016] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-03. [2025-10-02T18:06:33.072981] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-03. [2025-10-02T18:06:33.165618] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-02T18:06:33.652129] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-02T18:06:33.667059] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-02T18:06:33.873015] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-04. [2025-10-02T18:06:34.572039] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-02T18:06:34.673001] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-04. [2025-10-02T18:06:35.112675] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-02T18:06:35.473032] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-04. [2025-10-02T18:06:36.273003] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-05. [2025-10-02T18:06:36.675976] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-02T18:06:36.879515] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-02T18:06:37.073019] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-06. [2025-10-02T18:06:37.791432] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-02T18:06:37.873018] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-07. [2025-10-02T18:06:38.602207] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-02T18:06:38.673001] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-08. [2025-10-02T18:06:39.194373] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-02T18:06:39.473011] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-03. [2025-10-02T18:06:40.272993] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-05. [2025-10-02T18:06:41.073033] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-05. [2025-10-02T18:06:41.430990] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-02T18:06:41.873228] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-09. [2025-10-02T18:06:41.876016] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-02T18:06:42.245398] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-02T18:06:42.318103] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-02T18:06:42.673002] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-06. [2025-10-02T18:06:43.473003] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-04. [2025-10-02T18:06:43.847159] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-02T18:06:44.273013] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-10. [2025-10-02T18:06:44.778534] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-02T18:06:44.779341] [INFO ] [REMOTE ] CMSA: Full fetch complete (5158 records). [2025-10-02T18:06:44.779415] [DEBUG] [VALIDATOR ] CMSA: Validating primary data. [2025-10-02T18:06:45.078542] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-07. [2025-10-02T18:06:45.185378] [DEBUG] [VALIDATOR ] CMSA: All expected trading days are present. [2025-10-02T18:06:45.185513] [DEBUG] [VALIDATOR ] CMSA: Primary data validation passed. [2025-10-02T18:06:45.185789] [INFO ] [MAIN ] CMSA: Fetched primary data is valid. [2025-10-02T18:06:45.185874] [DEBUG] [LOCAL ] CMSA: Saving primary data. [2025-10-02T18:06:45.186527] [DEBUG] [LOCAL ] CMSA: Trimmed 5158 records to 3530 (keeping 200 days of data) [2025-10-02T18:06:45.209228] [DEBUG] [LOCAL ] CMSA: Primary data saved (3530 records). [2025-10-02T18:06:45.209349] [INFO ] [MAIN ] CMSA: Full history saved. [2025-10-02T18:06:45.209431] [INFO ] [MAIN ] Update Progress: 481/2370 symbols completed. CMSA took 21.2s. Estimated remaining: 4h 21m 54s. Rate: 7.2 symbols/min [2025-10-02T18:06:45.393860] [INFO ] [MAIN ] CMSD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:06:45.430777] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-02T18:06:45.447398] [DEBUG] [LOCAL ] CMSD: Loaded 8099 existing records from primary storage. [2025-10-02T18:06:45.448333] [INFO ] [MAIN ] CMSD: Loaded 8099 existing records. [2025-10-02T18:06:45.638033] [WARN ] [MAIN ] CMSD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:06:45.638252] [INFO ] [MAIN ] CMSD: Wiping existing primary data before full refresh. [2025-10-02T18:06:45.638304] [INFO ] [LOCAL ] CMSD: Starting deletion of primary data. [2025-10-02T18:06:45.638788] [DEBUG] [LOCAL ] CMSD: Deleted primary data file. [2025-10-02T18:06:45.638854] [INFO ] [MAIN ] CMSD: Starting full primary refresh. [2025-10-02T18:06:45.878229] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-06. [2025-10-02T18:06:46.030724] [INFO ] [REMOTE ] CMSD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:06:46.273960] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-02T18:06:46.533175] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-02T18:06:46.672986] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-07. [2025-10-02T18:06:47.102502] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-02T18:06:47.472999] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-08. [2025-10-02T18:06:48.273007] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-08. [2025-10-02T18:06:48.610776] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-02T18:06:48.643617] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-02T18:06:49.073006] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-09. [2025-10-02T18:06:49.872998] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-05. [2025-10-02T18:06:50.544513] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-02T18:06:50.673003] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2024-12. [2025-10-02T18:06:51.472997] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-10. [2025-10-02T18:06:51.758928] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-02T18:06:51.970419] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-02T18:06:52.273013] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-06. [2025-10-02T18:06:52.595446] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-02T18:06:52.597216] [INFO ] [REMOTE ] CMRE: Full fetch complete (50008 records). [2025-10-02T18:06:52.597321] [DEBUG] [VALIDATOR ] CMRE: Validating primary data. [2025-10-02T18:06:53.046073] [DEBUG] [VALIDATOR ] CMRE: All expected trading days are present. [2025-10-02T18:06:53.046169] [DEBUG] [VALIDATOR ] CMRE: Primary data validation passed. [2025-10-02T18:06:53.046829] [INFO ] [MAIN ] CMRE: Fetched primary data is valid. [2025-10-02T18:06:53.046896] [DEBUG] [LOCAL ] CMRE: Saving primary data. [2025-10-02T18:06:53.048154] [DEBUG] [LOCAL ] CMRE: Trimmed 50008 records to 35698 (keeping 200 days of data) [2025-10-02T18:06:53.104404] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-09. [2025-10-02T18:06:53.278093] [DEBUG] [LOCAL ] CMRE: Primary data saved (35698 records). [2025-10-02T18:06:53.278273] [INFO ] [MAIN ] CMRE: Full history saved. [2025-10-02T18:06:53.278410] [INFO ] [MAIN ] Update Progress: 482/2370 symbols completed. CMRE took 29.3s. Estimated remaining: 4h 21m 45s. Rate: 7.2 symbols/min [2025-10-02T18:06:53.469521] [INFO ] [MAIN ] CMTG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:06:53.505403] [DEBUG] [LOCAL ] CMTG: Loaded 36836 existing records from primary storage. [2025-10-02T18:06:53.505732] [INFO ] [MAIN ] CMTG: Loaded 36836 existing records. [2025-10-02T18:06:53.724898] [WARN ] [MAIN ] CMTG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:06:53.725324] [INFO ] [MAIN ] CMTG: Wiping existing primary data before full refresh. [2025-10-02T18:06:53.725400] [INFO ] [LOCAL ] CMTG: Starting deletion of primary data. [2025-10-02T18:06:53.726452] [DEBUG] [LOCAL ] CMTG: Deleted primary data file. [2025-10-02T18:06:53.726534] [INFO ] [MAIN ] CMTG: Starting full primary refresh. [2025-10-02T18:06:53.890885] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-01. [2025-10-02T18:06:53.916190] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-02T18:06:54.084891] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-02T18:06:54.238435] [INFO ] [REMOTE ] CMTG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:06:54.672962] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-10. [2025-10-02T18:06:54.756180] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-02T18:06:55.126619] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-02T18:06:55.127444] [INFO ] [REMOTE ] CMSC: Full fetch complete (7189 records). [2025-10-02T18:06:55.127514] [DEBUG] [VALIDATOR ] CMSC: Validating primary data. [2025-10-02T18:06:55.478183] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-07. [2025-10-02T18:06:55.522878] [DEBUG] [VALIDATOR ] CMSC: All expected trading days are present. [2025-10-02T18:06:55.522974] [DEBUG] [VALIDATOR ] CMSC: Primary data validation passed. [2025-10-02T18:06:55.523272] [INFO ] [MAIN ] CMSC: Fetched primary data is valid. [2025-10-02T18:06:55.523342] [DEBUG] [LOCAL ] CMSC: Saving primary data. [2025-10-02T18:06:55.523949] [DEBUG] [LOCAL ] CMSC: Trimmed 7189 records to 5108 (keeping 200 days of data) [2025-10-02T18:06:55.559059] [DEBUG] [LOCAL ] CMSC: Primary data saved (5108 records). [2025-10-02T18:06:55.559210] [INFO ] [MAIN ] CMSC: Full history saved. [2025-10-02T18:06:55.559306] [INFO ] [MAIN ] Update Progress: 483/2370 symbols completed. CMSC took 31.6s. Estimated remaining: 4h 21m 13s. Rate: 7.2 symbols/min [2025-10-02T18:06:55.746466] [INFO ] [MAIN ] CMU: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:06:55.746636] [DEBUG] [LOCAL ] CMU: No existing data file found in primary storage. [2025-10-02T18:06:55.746745] [WARN ] [MAIN ] CMU: No existing data found, performing full refresh instead. [2025-10-02T18:06:55.746873] [INFO ] [MAIN ] CMU: Wiping existing primary data before full refresh. [2025-10-02T18:06:55.746920] [INFO ] [LOCAL ] CMU: Starting deletion of primary data. [2025-10-02T18:06:55.746966] [DEBUG] [LOCAL ] CMU: No primary data file found to delete. [2025-10-02T18:06:55.747003] [INFO ] [MAIN ] CMU: Starting full primary refresh. [2025-10-02T18:06:56.129317] [INFO ] [REMOTE ] CMU: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:06:56.272995] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-02. [2025-10-02T18:06:56.706563] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-02T18:06:57.073010] [INFO ] [REMOTE ] CMU: Fetching primary data for 2024-12. [2025-10-02T18:06:57.413848] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-02T18:06:57.873008] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2024-12. [2025-10-02T18:06:57.879697] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-02T18:06:58.673004] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-01. [2025-10-02T18:06:59.277042] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-02T18:06:59.449312] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-02T18:06:59.472985] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-01. [2025-10-02T18:07:00.273016] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-03. [2025-10-02T18:07:00.893184] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-02T18:07:00.908627] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-02T18:07:01.072996] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-02. [2025-10-02T18:07:01.873060] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-08. [2025-10-02T18:07:02.473499] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-02T18:07:02.672994] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-04. [2025-10-02T18:07:03.353173] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-02T18:07:03.472966] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-03. [2025-10-02T18:07:03.554299] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-02T18:07:04.273010] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-09. [2025-10-02T18:07:05.072990] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-05. [2025-10-02T18:07:05.184033] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-02T18:07:05.805592] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-02T18:07:05.873036] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-04. [2025-10-02T18:07:06.196035] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-02T18:07:06.673047] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-10. [2025-10-02T18:07:07.380361] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-02T18:07:07.472999] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-06. [2025-10-02T18:07:07.966748] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-02T18:07:07.969145] [INFO ] [REMOTE ] CMS: Full fetch complete (76023 records). [2025-10-02T18:07:07.969297] [DEBUG] [VALIDATOR ] CMS: Validating primary data. [2025-10-02T18:07:08.280144] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-02. [2025-10-02T18:07:08.311053] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-02T18:07:08.436147] [DEBUG] [VALIDATOR ] CMS: All expected trading days are present. [2025-10-02T18:07:08.436294] [DEBUG] [VALIDATOR ] CMS: Primary data validation passed. [2025-10-02T18:07:08.437412] [INFO ] [MAIN ] CMS: Fetched primary data is valid. [2025-10-02T18:07:08.437507] [DEBUG] [LOCAL ] CMS: Saving primary data. [2025-10-02T18:07:08.439157] [DEBUG] [LOCAL ] CMS: Trimmed 76023 records to 52995 (keeping 200 days of data) [2025-10-02T18:07:08.841084] [DEBUG] [LOCAL ] CMS: Primary data saved (52995 records). [2025-10-02T18:07:08.841268] [INFO ] [MAIN ] CMS: Full history saved. [2025-10-02T18:07:08.841362] [INFO ] [MAIN ] Update Progress: 484/2370 symbols completed. CMS took 44.9s. Estimated remaining: 4h 21m 24s. Rate: 7.2 symbols/min [2025-10-02T18:07:09.049169] [INFO ] [MAIN ] CNA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:07:09.054055] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-02T18:07:09.075161] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-03. [2025-10-02T18:07:09.091312] [DEBUG] [LOCAL ] CNA: Loaded 32776 existing records from primary storage. [2025-10-02T18:07:09.091701] [INFO ] [MAIN ] CNA: Loaded 32776 existing records. [2025-10-02T18:07:09.331768] [WARN ] [MAIN ] CNA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:07:09.332010] [INFO ] [MAIN ] CNA: Wiping existing primary data before full refresh. [2025-10-02T18:07:09.332060] [INFO ] [LOCAL ] CNA: Starting deletion of primary data. [2025-10-02T18:07:09.333019] [DEBUG] [LOCAL ] CNA: Deleted primary data file. [2025-10-02T18:07:09.333083] [INFO ] [MAIN ] CNA: Starting full primary refresh. [2025-10-02T18:07:09.767760] [INFO ] [REMOTE ] CNA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:07:09.844031] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-02T18:07:09.872972] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-04. [2025-10-02T18:07:10.669997] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-02T18:07:10.673053] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-07. [2025-10-02T18:07:11.392306] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-02T18:07:11.473006] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-05. [2025-10-02T18:07:12.053144] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-02T18:07:12.273011] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-05. [2025-10-02T18:07:13.073038] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-08. [2025-10-02T18:07:13.728813] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-02T18:07:13.770371] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-02T18:07:13.873000] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-06. [2025-10-02T18:07:14.673008] [INFO ] [REMOTE ] CNA: Fetching primary data for 2024-12. [2025-10-02T18:07:15.248827] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-02T18:07:15.473034] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-09. [2025-10-02T18:07:15.951573] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-02T18:07:16.144395] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-02T18:07:16.272994] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-10. [2025-10-02T18:07:16.775448] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-02T18:07:16.776478] [INFO ] [REMOTE ] CMSD: Full fetch complete (12404 records). [2025-10-02T18:07:16.776560] [DEBUG] [VALIDATOR ] CMSD: Validating primary data. [2025-10-02T18:07:17.081753] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-07. [2025-10-02T18:07:17.175845] [DEBUG] [VALIDATOR ] CMSD: All expected trading days are present. [2025-10-02T18:07:17.175939] [DEBUG] [VALIDATOR ] CMSD: Primary data validation passed. [2025-10-02T18:07:17.176320] [INFO ] [MAIN ] CMSD: Fetched primary data is valid. [2025-10-02T18:07:17.176365] [DEBUG] [LOCAL ] CMSD: Saving primary data. [2025-10-02T18:07:17.176898] [DEBUG] [LOCAL ] CMSD: Trimmed 12404 records to 8137 (keeping 200 days of data) [2025-10-02T18:07:17.229839] [DEBUG] [LOCAL ] CMSD: Primary data saved (8137 records). [2025-10-02T18:07:17.230003] [INFO ] [MAIN ] CMSD: Full history saved. [2025-10-02T18:07:17.230097] [INFO ] [MAIN ] Update Progress: 485/2370 symbols completed. CMSD took 32.0s. Estimated remaining: 4h 21m 16s. Rate: 7.2 symbols/min [2025-10-02T18:07:17.424477] [INFO ] [MAIN ] CNC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:07:17.481349] [DEBUG] [LOCAL ] CNC: Loaded 53739 existing records from primary storage. [2025-10-02T18:07:17.481726] [INFO ] [MAIN ] CNC: Loaded 53739 existing records. [2025-10-02T18:07:17.675491] [WARN ] [MAIN ] CNC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:07:17.675781] [INFO ] [MAIN ] CNC: Wiping existing primary data before full refresh. [2025-10-02T18:07:17.675846] [INFO ] [LOCAL ] CNC: Starting deletion of primary data. [2025-10-02T18:07:17.677346] [DEBUG] [LOCAL ] CNC: Deleted primary data file. [2025-10-02T18:07:17.677439] [INFO ] [MAIN ] CNC: Starting full primary refresh. [2025-10-02T18:07:17.874632] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-01. [2025-10-02T18:07:18.079190] [INFO ] [REMOTE ] CNC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:07:18.476929] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-02T18:07:18.673056] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-06. [2025-10-02T18:07:19.169920] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-02T18:07:19.309293] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-02T18:07:19.473071] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-02. [2025-10-02T18:07:20.273075] [INFO ] [REMOTE ] CNC: Fetching primary data for 2024-12. [2025-10-02T18:07:20.797134] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-02T18:07:21.073038] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-03. [2025-10-02T18:07:21.872967] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-07. [2025-10-02T18:07:22.142521] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-02T18:07:22.372594] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-02T18:07:22.543234] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-02T18:07:22.673086] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-04. [2025-10-02T18:07:23.473133] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-08. [2025-10-02T18:07:23.735279] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-02T18:07:24.273017] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-05. [2025-10-02T18:07:24.861369] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-02T18:07:25.072983] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-09. [2025-10-02T18:07:25.348940] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-02T18:07:25.873042] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-06. [2025-10-02T18:07:26.017790] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-02T18:07:26.673045] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-08. [2025-10-02T18:07:27.330191] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-02T18:07:27.437315] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-02T18:07:27.473034] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-07. [2025-10-02T18:07:28.273046] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-01. [2025-10-02T18:07:28.924581] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-02T18:07:29.073037] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-10. [2025-10-02T18:07:29.848799] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-02T18:07:29.872989] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-02. [2025-10-02T18:07:30.054049] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-02T18:07:30.056142] [INFO ] [REMOTE ] CMTG: Full fetch complete (53590 records). [2025-10-02T18:07:30.056277] [DEBUG] [VALIDATOR ] CMTG: Validating primary data. [2025-10-02T18:07:30.553053] [DEBUG] [VALIDATOR ] CMTG: All expected trading days are present. [2025-10-02T18:07:30.553159] [DEBUG] [VALIDATOR ] CMTG: Primary data validation passed. [2025-10-02T18:07:30.553898] [INFO ] [MAIN ] CMTG: Fetched primary data is valid. [2025-10-02T18:07:30.553961] [DEBUG] [LOCAL ] CMTG: Saving primary data. [2025-10-02T18:07:30.555240] [DEBUG] [LOCAL ] CMTG: Trimmed 53590 records to 37088 (keeping 200 days of data) [2025-10-02T18:07:30.673295] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-08. [2025-10-02T18:07:30.771587] [DEBUG] [LOCAL ] CMTG: Primary data saved (37088 records). [2025-10-02T18:07:30.771770] [INFO ] [MAIN ] CMTG: Full history saved. [2025-10-02T18:07:30.771877] [INFO ] [MAIN ] Update Progress: 486/2370 symbols completed. CMTG took 37.5s. Estimated remaining: 4h 21m 28s. Rate: 7.2 symbols/min [2025-10-02T18:07:30.960361] [INFO ] [MAIN ] CNF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:07:30.973131] [DEBUG] [LOCAL ] CNF: Loaded 10716 existing records from primary storage. [2025-10-02T18:07:30.973362] [INFO ] [MAIN ] CNF: Loaded 10716 existing records. [2025-10-02T18:07:31.171825] [WARN ] [MAIN ] CNF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:07:31.172180] [INFO ] [MAIN ] CNF: Wiping existing primary data before full refresh. [2025-10-02T18:07:31.172261] [INFO ] [LOCAL ] CNF: Starting deletion of primary data. [2025-10-02T18:07:31.172805] [DEBUG] [LOCAL ] CNF: Deleted primary data file. [2025-10-02T18:07:31.172868] [INFO ] [MAIN ] CNF: Starting full primary refresh. [2025-10-02T18:07:31.478189] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-09. [2025-10-02T18:07:31.609070] [INFO ] [REMOTE ] CNF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:07:31.756523] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-02T18:07:31.990793] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-02T18:07:32.117874] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-02T18:07:32.273011] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-03. [2025-10-02T18:07:33.073095] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-10. [2025-10-02T18:07:33.560799] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-02T18:07:33.561700] [INFO ] [REMOTE ] CMU: Full fetch complete (9671 records). [2025-10-02T18:07:33.561819] [DEBUG] [VALIDATOR ] CMU: Validating primary data. [2025-10-02T18:07:33.878442] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-09. [2025-10-02T18:07:33.972942] [DEBUG] [VALIDATOR ] CMU: All expected trading days are present. [2025-10-02T18:07:33.973050] [DEBUG] [VALIDATOR ] CMU: Primary data validation passed. [2025-10-02T18:07:33.973378] [INFO ] [MAIN ] CMU: Fetched primary data is valid. [2025-10-02T18:07:33.973555] [DEBUG] [LOCAL ] CMU: Saving primary data. [2025-10-02T18:07:33.974193] [DEBUG] [LOCAL ] CMU: Trimmed 9671 records to 6891 (keeping 200 days of data) [2025-10-02T18:07:34.019475] [DEBUG] [LOCAL ] CMU: Primary data saved (6891 records). [2025-10-02T18:07:34.019736] [INFO ] [MAIN ] CMU: Full history saved. [2025-10-02T18:07:34.019890] [INFO ] [MAIN ] Update Progress: 487/2370 symbols completed. CMU took 38.5s. Estimated remaining: 4h 21m 0s. Rate: 7.2 symbols/min [2025-10-02T18:07:34.208231] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-02T18:07:34.253269] [INFO ] [MAIN ] CNH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:07:34.312469] [DEBUG] [LOCAL ] CNH: Loaded 53555 existing records from primary storage. [2025-10-02T18:07:34.312856] [INFO ] [MAIN ] CNH: Loaded 53555 existing records. [2025-10-02T18:07:34.519264] [WARN ] [MAIN ] CNH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:07:34.519492] [INFO ] [MAIN ] CNH: Wiping existing primary data before full refresh. [2025-10-02T18:07:34.519544] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-10-02T18:07:34.521290] [DEBUG] [LOCAL ] CNH: Deleted primary data file. [2025-10-02T18:07:34.521377] [INFO ] [MAIN ] CNH: Starting full primary refresh. [2025-10-02T18:07:34.678145] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-04. [2025-10-02T18:07:34.952617] [INFO ] [REMOTE ] CNH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:07:35.190253] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-02T18:07:35.473004] [INFO ] [REMOTE ] CNH: Fetching primary data for 2024-12. [2025-10-02T18:07:36.273038] [INFO ] [REMOTE ] CNF: Fetching primary data for 2024-12. [2025-10-02T18:07:36.580103] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-02T18:07:36.913624] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-02T18:07:37.073005] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-01. [2025-10-02T18:07:37.367409] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-02T18:07:37.488994] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-02T18:07:37.873009] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-02. [2025-10-02T18:07:38.308934] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-02T18:07:38.673051] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-10. [2025-10-02T18:07:39.473005] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-01. [2025-10-02T18:07:39.564165] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-02T18:07:39.565862] [INFO ] [REMOTE ] CNA: Full fetch complete (45557 records). [2025-10-02T18:07:39.566002] [DEBUG] [VALIDATOR ] CNA: Validating primary data. [2025-10-02T18:07:40.011375] [DEBUG] [VALIDATOR ] CNA: All expected trading days are present. [2025-10-02T18:07:40.011472] [DEBUG] [VALIDATOR ] CNA: Primary data validation passed. [2025-10-02T18:07:40.012130] [INFO ] [MAIN ] CNA: Fetched primary data is valid. [2025-10-02T18:07:40.012198] [DEBUG] [LOCAL ] CNA: Saving primary data. [2025-10-02T18:07:40.013608] [DEBUG] [LOCAL ] CNA: Trimmed 45557 records to 33010 (keeping 200 days of data) [2025-10-02T18:07:40.227435] [DEBUG] [LOCAL ] CNA: Primary data saved (33010 records). [2025-10-02T18:07:40.227583] [INFO ] [MAIN ] CNA: Full history saved. [2025-10-02T18:07:40.227691] [INFO ] [MAIN ] Update Progress: 488/2370 symbols completed. CNA took 31.4s. Estimated remaining: 4h 20m 44s. Rate: 7.2 symbols/min [2025-10-02T18:07:40.278118] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-03. [2025-10-02T18:07:40.424263] [INFO ] [MAIN ] CNI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:07:40.480572] [DEBUG] [LOCAL ] CNI: Loaded 51668 existing records from primary storage. [2025-10-02T18:07:40.480935] [INFO ] [MAIN ] CNI: Loaded 51668 existing records. [2025-10-02T18:07:40.676222] [WARN ] [MAIN ] CNI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:07:40.676453] [INFO ] [MAIN ] CNI: Wiping existing primary data before full refresh. [2025-10-02T18:07:40.676514] [INFO ] [LOCAL ] CNI: Starting deletion of primary data. [2025-10-02T18:07:40.678289] [DEBUG] [LOCAL ] CNI: Deleted primary data file. [2025-10-02T18:07:40.678351] [INFO ] [MAIN ] CNI: Starting full primary refresh. [2025-10-02T18:07:41.074781] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-05. [2025-10-02T18:07:41.090869] [INFO ] [REMOTE ] CNI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:07:41.137789] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-02T18:07:41.212014] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-02T18:07:41.873014] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-02. [2025-10-02T18:07:42.673016] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-04. [2025-10-02T18:07:42.990029] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-02T18:07:43.255488] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-02T18:07:43.472997] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-05. [2025-10-02T18:07:43.580862] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-02T18:07:44.262789] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-02T18:07:44.272981] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-03. [2025-10-02T18:07:45.073000] [INFO ] [REMOTE ] CNI: Fetching primary data for 2024-12. [2025-10-02T18:07:45.872984] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-06. [2025-10-02T18:07:46.192946] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-02T18:07:46.672994] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-04. [2025-10-02T18:07:46.764747] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-02T18:07:46.974594] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-02T18:07:47.472997] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-07. [2025-10-02T18:07:48.147891] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-02T18:07:48.272960] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-08. [2025-10-02T18:07:48.604619] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-02T18:07:49.072977] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-01. [2025-10-02T18:07:49.272470] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-02T18:07:49.872993] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-06. [2025-10-02T18:07:50.673046] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-09. [2025-10-02T18:07:50.972701] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-02T18:07:51.473032] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-02. [2025-10-02T18:07:51.678862] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-02T18:07:51.872901] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-02T18:07:52.273024] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-05. [2025-10-02T18:07:53.039833] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-02T18:07:53.072987] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-03. [2025-10-02T18:07:53.872986] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-07. [2025-10-02T18:07:54.115843] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-02T18:07:54.672992] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-06. [2025-10-02T18:07:54.724018] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-02T18:07:55.473038] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-10. [2025-10-02T18:07:56.176927] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-02T18:07:56.178027] [INFO ] [REMOTE ] CNF: Full fetch complete (12940 records). [2025-10-02T18:07:56.178117] [DEBUG] [VALIDATOR ] CNF: Validating primary data. [2025-10-02T18:07:56.178693] [FATAL] [VALIDATOR ] CNF: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:07:56.178782] [FATAL] [MAIN ] CNF: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:07:56.178836] [WARN ] [MAIN ] CNF: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:07:56.178922] [INFO ] [LOCAL ] CNF: Starting deletion of primary data. [2025-10-02T18:07:56.179016] [DEBUG] [LOCAL ] CNF: No primary data file found to delete. [2025-10-02T18:07:56.179086] [INFO ] [LOCAL ] CNF: Starting deletion of derivative data. [2025-10-02T18:07:56.179593] [DEBUG] [LOCAL ] CNF: Deleted derivative data file. [2025-10-02T18:07:56.179739] [INFO ] [MAIN ] Update Progress: 489/2370 symbols completed. CNF took 25.4s. Estimated remaining: 4h 21m 5s. Rate: 7.2 symbols/min [2025-10-02T18:07:56.281859] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-04. [2025-10-02T18:07:56.379825] [INFO ] [MAIN ] CNK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:07:56.455664] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-02T18:07:56.505497] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-07 (2.63 seconds). [2025-10-02T18:07:56.556578] [DEBUG] [LOCAL ] CNK: Loaded 52876 existing records from primary storage. [2025-10-02T18:07:56.556948] [INFO ] [MAIN ] CNK: Loaded 52876 existing records. [2025-10-02T18:07:56.752491] [WARN ] [MAIN ] CNK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:07:56.752743] [INFO ] [MAIN ] CNK: Wiping existing primary data before full refresh. [2025-10-02T18:07:56.752796] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-10-02T18:07:56.754365] [DEBUG] [LOCAL ] CNK: Deleted primary data file. [2025-10-02T18:07:56.754426] [INFO ] [MAIN ] CNK: Starting full primary refresh. [2025-10-02T18:07:57.078135] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-07. [2025-10-02T18:07:57.146189] [INFO ] [REMOTE ] CNK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:07:57.872975] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-08. [2025-10-02T18:07:58.433942] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-02T18:07:58.672968] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-05. [2025-10-02T18:07:58.740584] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-02T18:07:59.473053] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-08. [2025-10-02T18:08:00.000475] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-02T18:08:00.273057] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-09. [2025-10-02T18:08:00.587554] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-02T18:08:01.034504] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-02T18:08:01.073015] [INFO ] [REMOTE ] CNK: Fetching primary data for 2024-12. [2025-10-02T18:08:01.873013] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-06. [2025-10-02T18:08:02.631465] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-10-02T18:08:02.673024] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-10. [2025-10-02T18:08:02.948584] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-02T18:08:03.472986] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-01. [2025-10-02T18:08:03.734229] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-02T18:08:04.273088] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-07. [2025-10-02T18:08:04.594856] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-02T18:08:04.596994] [INFO ] [REMOTE ] CNC: Full fetch complete (77674 records). [2025-10-02T18:08:04.597110] [DEBUG] [VALIDATOR ] CNC: Validating primary data. [2025-10-02T18:08:05.051086] [DEBUG] [VALIDATOR ] CNC: All expected trading days are present. [2025-10-02T18:08:05.051188] [DEBUG] [VALIDATOR ] CNC: Primary data validation passed. [2025-10-02T18:08:05.052138] [INFO ] [MAIN ] CNC: Fetched primary data is valid. [2025-10-02T18:08:05.052242] [DEBUG] [LOCAL ] CNC: Saving primary data. [2025-10-02T18:08:05.053801] [DEBUG] [LOCAL ] CNC: Trimmed 77674 records to 54129 (keeping 200 days of data) [2025-10-02T18:08:05.114435] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-09. [2025-10-02T18:08:05.197326] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-02T18:08:05.437918] [DEBUG] [LOCAL ] CNC: Primary data saved (54129 records). [2025-10-02T18:08:05.438095] [INFO ] [MAIN ] CNC: Full history saved. [2025-10-02T18:08:05.438220] [INFO ] [MAIN ] Update Progress: 490/2370 symbols completed. CNC took 48.2s. Estimated remaining: 4h 21m 0s. Rate: 7.2 symbols/min [2025-10-02T18:08:05.638748] [INFO ] [MAIN ] CNM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:08:05.689889] [DEBUG] [LOCAL ] CNM: Loaded 50990 existing records from primary storage. [2025-10-02T18:08:05.690255] [INFO ] [MAIN ] CNM: Loaded 50990 existing records. [2025-10-02T18:08:05.897151] [WARN ] [MAIN ] CNM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:08:05.889692] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-02. [2025-10-02T18:08:05.898610] [INFO ] [MAIN ] CNM: Wiping existing primary data before full refresh. [2025-10-02T18:08:05.898713] [INFO ] [LOCAL ] CNM: Starting deletion of primary data. [2025-10-02T18:08:05.900178] [DEBUG] [LOCAL ] CNM: Deleted primary data file. [2025-10-02T18:08:05.900241] [INFO ] [MAIN ] CNM: Starting full primary refresh. [2025-10-02T18:08:06.312819] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-02T18:08:06.369223] [INFO ] [REMOTE ] CNM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:08:06.672994] [INFO ] [REMOTE ] CNM: Fetching primary data for 2024-12. [2025-10-02T18:08:06.985993] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-02T18:08:07.126046] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-02T18:08:07.473029] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-10. [2025-10-02T18:08:08.273011] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-03. [2025-10-02T18:08:08.665930] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-02T18:08:08.983802] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-02T18:08:08.985927] [INFO ] [REMOTE ] CNH: Full fetch complete (77534 records). [2025-10-02T18:08:08.986053] [DEBUG] [VALIDATOR ] CNH: Validating primary data. [2025-10-02T18:08:09.078213] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-01. [2025-10-02T18:08:09.443937] [DEBUG] [VALIDATOR ] CNH: All expected trading days are present. [2025-10-02T18:08:09.444098] [DEBUG] [VALIDATOR ] CNH: Primary data validation passed. [2025-10-02T18:08:09.445071] [INFO ] [MAIN ] CNH: Fetched primary data is valid. [2025-10-02T18:08:09.445150] [DEBUG] [LOCAL ] CNH: Saving primary data. [2025-10-02T18:08:09.446916] [DEBUG] [LOCAL ] CNH: Trimmed 77534 records to 53944 (keeping 200 days of data) [2025-10-02T18:08:09.805489] [DEBUG] [LOCAL ] CNH: Primary data saved (53944 records). [2025-10-02T18:08:09.805694] [INFO ] [MAIN ] CNH: Full history saved. [2025-10-02T18:08:09.807005] [INFO ] [MAIN ] Update Progress: 491/2370 symbols completed. CNH took 35.8s. Estimated remaining: 4h 20m 37s. Rate: 7.2 symbols/min [2025-10-02T18:08:09.877411] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-08. [2025-10-02T18:08:10.004346] [INFO ] [MAIN ] CNMD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:08:10.039930] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-02T18:08:10.079741] [DEBUG] [LOCAL ] CNMD: Loaded 32280 existing records from primary storage. [2025-10-02T18:08:10.080044] [INFO ] [MAIN ] CNMD: Loaded 32280 existing records. [2025-10-02T18:08:10.275367] [WARN ] [MAIN ] CNMD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:08:10.275607] [INFO ] [MAIN ] CNMD: Wiping existing primary data before full refresh. [2025-10-02T18:08:10.275687] [INFO ] [LOCAL ] CNMD: Starting deletion of primary data. [2025-10-02T18:08:10.276635] [DEBUG] [LOCAL ] CNMD: Deleted primary data file. [2025-10-02T18:08:10.276743] [INFO ] [MAIN ] CNMD: Starting full primary refresh. [2025-10-02T18:08:10.670199] [INFO ] [REMOTE ] CNMD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:08:10.672955] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2024-12. [2025-10-02T18:08:10.853845] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-02T18:08:11.333505] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-02T18:08:11.472967] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-09. [2025-10-02T18:08:11.630464] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-02T18:08:12.273020] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-02. [2025-10-02T18:08:13.073021] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-01. [2025-10-02T18:08:13.145771] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-02T18:08:13.826702] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-02T18:08:13.873023] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-03. [2025-10-02T18:08:14.409160] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-02T18:08:14.673023] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-04. [2025-10-02T18:08:15.473053] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-10. [2025-10-02T18:08:15.628937] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-02T18:08:16.062928] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-02T18:08:16.273073] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-05. [2025-10-02T18:08:16.765577] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-02T18:08:16.767226] [INFO ] [REMOTE ] CNI: Full fetch complete (74244 records). [2025-10-02T18:08:16.767381] [DEBUG] [VALIDATOR ] CNI: Validating primary data. [2025-10-02T18:08:16.768508] [FATAL] [VALIDATOR ] CNI: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:08:16.768632] [FATAL] [MAIN ] CNI: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:08:16.768729] [WARN ] [MAIN ] CNI: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:08:16.768812] [INFO ] [LOCAL ] CNI: Starting deletion of primary data. [2025-10-02T18:08:16.768922] [DEBUG] [LOCAL ] CNI: No primary data file found to delete. [2025-10-02T18:08:16.769018] [INFO ] [LOCAL ] CNI: Starting deletion of derivative data. [2025-10-02T18:08:16.769304] [DEBUG] [LOCAL ] CNI: Deleted derivative data file. [2025-10-02T18:08:16.769415] [INFO ] [MAIN ] Update Progress: 492/2370 symbols completed. CNI took 36.5s. Estimated remaining: 4h 20m 23s. Rate: 7.2 symbols/min [2025-10-02T18:08:16.966713] [INFO ] [MAIN ] CNNE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:08:17.004807] [DEBUG] [LOCAL ] CNNE: Loaded 36373 existing records from primary storage. [2025-10-02T18:08:17.005140] [INFO ] [MAIN ] CNNE: Loaded 36373 existing records. [2025-10-02T18:08:17.078106] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-04. [2025-10-02T18:08:17.214017] [WARN ] [MAIN ] CNNE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:08:17.214241] [INFO ] [MAIN ] CNNE: Wiping existing primary data before full refresh. [2025-10-02T18:08:17.214289] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-10-02T18:08:17.215403] [DEBUG] [LOCAL ] CNNE: Deleted primary data file. [2025-10-02T18:08:17.215465] [INFO ] [MAIN ] CNNE: Starting full primary refresh. [2025-10-02T18:08:17.633715] [INFO ] [REMOTE ] CNNE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:08:17.857466] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-02T18:08:17.872955] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-06. [2025-10-02T18:08:18.673035] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-02. [2025-10-02T18:08:18.843906] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-02T18:08:19.213602] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-02T18:08:19.473055] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-07. [2025-10-02T18:08:19.638971] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-02T18:08:20.273055] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-05. [2025-10-02T18:08:21.072986] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-03. [2025-10-02T18:08:21.258348] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-02T18:08:21.872988] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2024-12. [2025-10-02T18:08:21.990493] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-02T18:08:22.298637] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-02T18:08:22.672991] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-04. [2025-10-02T18:08:23.086030] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-02T18:08:23.473109] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-01. [2025-10-02T18:08:24.252284] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-02T18:08:24.272995] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-05. [2025-10-02T18:08:24.564434] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-02T18:08:25.073009] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-08. [2025-10-02T18:08:25.641807] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-02T18:08:25.873019] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-06. [2025-10-02T18:08:26.573272] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-02T18:08:26.672968] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-06. [2025-10-02T18:08:26.774161] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-02T18:08:27.473001] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-07. [2025-10-02T18:08:28.272984] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-09. [2025-10-02T18:08:28.429165] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-02T18:08:28.912187] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-02T18:08:29.073040] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-08. [2025-10-02T18:08:29.873003] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-07. [2025-10-02T18:08:30.061463] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-02T18:08:30.444138] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-02T18:08:30.673029] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-02. [2025-10-02T18:08:31.473009] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-09. [2025-10-02T18:08:31.534242] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-02T18:08:31.610570] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-02T18:08:32.273003] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-03. [2025-10-02T18:08:32.546226] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-02T18:08:33.072995] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-08. [2025-10-02T18:08:33.708204] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-02T18:08:33.873009] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-04. [2025-10-02T18:08:34.651076] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-02T18:08:34.672959] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-09. [2025-10-02T18:08:35.210951] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-02T18:08:35.473011] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-10. [2025-10-02T18:08:36.273072] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-05. [2025-10-02T18:08:36.364829] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-02T18:08:36.366950] [INFO ] [REMOTE ] CNMD: Full fetch complete (47321 records). [2025-10-02T18:08:36.379468] [DEBUG] [VALIDATOR ] CNMD: Validating primary data. [2025-10-02T18:08:36.407669] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-02T18:08:36.833784] [DEBUG] [VALIDATOR ] CNMD: All expected trading days are present. [2025-10-02T18:08:36.833873] [DEBUG] [VALIDATOR ] CNMD: Primary data validation passed. [2025-10-02T18:08:36.834561] [INFO ] [MAIN ] CNMD: Fetched primary data is valid. [2025-10-02T18:08:36.834627] [DEBUG] [LOCAL ] CNMD: Saving primary data. [2025-10-02T18:08:36.835748] [DEBUG] [LOCAL ] CNMD: Trimmed 47321 records to 32498 (keeping 200 days of data) [2025-10-02T18:08:37.051117] [DEBUG] [LOCAL ] CNMD: Primary data saved (32498 records). [2025-10-02T18:08:37.051305] [INFO ] [MAIN ] CNMD: Full history saved. [2025-10-02T18:08:37.052330] [INFO ] [MAIN ] Update Progress: 493/2370 symbols completed. CNMD took 27.2s. Estimated remaining: 4h 21m 0s. Rate: 7.2 symbols/min [2025-10-02T18:08:37.078175] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-10. [2025-10-02T18:08:37.245701] [INFO ] [MAIN ] CNO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:08:37.245909] [DEBUG] [LOCAL ] CNO: No existing data file found in primary storage. [2025-10-02T18:08:37.245967] [WARN ] [MAIN ] CNO: No existing data found, performing full refresh instead. [2025-10-02T18:08:37.246083] [INFO ] [MAIN ] CNO: Wiping existing primary data before full refresh. [2025-10-02T18:08:37.246129] [INFO ] [LOCAL ] CNO: Starting deletion of primary data. [2025-10-02T18:08:37.246173] [DEBUG] [LOCAL ] CNO: No primary data file found to delete. [2025-10-02T18:08:37.246208] [INFO ] [MAIN ] CNO: Starting full primary refresh. [2025-10-02T18:08:37.630708] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-02T18:08:37.688274] [INFO ] [REMOTE ] CNO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:08:37.873003] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-06. [2025-10-02T18:08:38.628759] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-02T18:08:38.631353] [INFO ] [REMOTE ] CNK: Full fetch complete (75806 records). [2025-10-02T18:08:38.631978] [DEBUG] [VALIDATOR ] CNK: Validating primary data. [2025-10-02T18:08:38.678994] [INFO ] [REMOTE ] CNO: Fetching primary data for 2024-12. [2025-10-02T18:08:39.188092] [DEBUG] [VALIDATOR ] CNK: All expected trading days are present. [2025-10-02T18:08:39.188509] [DEBUG] [VALIDATOR ] CNK: Primary data validation passed. [2025-10-02T18:08:39.189871] [INFO ] [MAIN ] CNK: Fetched primary data is valid. [2025-10-02T18:08:39.210452] [DEBUG] [LOCAL ] CNK: Saving primary data. [2025-10-02T18:08:39.213182] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-02T18:08:39.222161] [DEBUG] [LOCAL ] CNK: Trimmed 75806 records to 53264 (keeping 200 days of data) [2025-10-02T18:08:39.473699] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-07. [2025-10-02T18:08:39.586596] [DEBUG] [LOCAL ] CNK: Primary data saved (53264 records). [2025-10-02T18:08:39.586790] [INFO ] [MAIN ] CNK: Full history saved. [2025-10-02T18:08:39.586902] [INFO ] [MAIN ] Update Progress: 494/2370 symbols completed. CNK took 43.4s. Estimated remaining: 4h 20m 30s. Rate: 7.2 symbols/min [2025-10-02T18:08:39.771974] [INFO ] [MAIN ] CNP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:08:39.823950] [DEBUG] [LOCAL ] CNP: Loaded 53469 existing records from primary storage. [2025-10-02T18:08:39.824273] [INFO ] [MAIN ] CNP: Loaded 53469 existing records. [2025-10-02T18:08:40.019783] [WARN ] [MAIN ] CNP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:08:40.020189] [INFO ] [MAIN ] CNP: Wiping existing primary data before full refresh. [2025-10-02T18:08:40.020352] [INFO ] [LOCAL ] CNP: Starting deletion of primary data. [2025-10-02T18:08:40.022268] [DEBUG] [LOCAL ] CNP: Deleted primary data file. [2025-10-02T18:08:40.022343] [INFO ] [MAIN ] CNP: Starting full primary refresh. [2025-10-02T18:08:40.156289] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-02T18:08:40.279760] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-01. [2025-10-02T18:08:40.455288] [INFO ] [REMOTE ] CNP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:08:41.046917] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-02T18:08:41.072986] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-08. [2025-10-02T18:08:41.325992] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-02T18:08:41.872996] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-02. [2025-10-02T18:08:42.622144] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-02T18:08:42.673006] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-09. [2025-10-02T18:08:43.472944] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-02T18:08:43.473071] [INFO ] [REMOTE ] CNP: Fetching primary data for 2024-12. [2025-10-02T18:08:44.113413] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-02T18:08:44.273006] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-10. [2025-10-02T18:08:44.956469] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-02T18:08:45.073003] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-03. [2025-10-02T18:08:45.187497] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-02T18:08:45.189709] [INFO ] [REMOTE ] CNNE: Full fetch complete (49873 records). [2025-10-02T18:08:45.189838] [DEBUG] [VALIDATOR ] CNNE: Validating primary data. [2025-10-02T18:08:45.609261] [DEBUG] [VALIDATOR ] CNNE: All expected trading days are present. [2025-10-02T18:08:45.609352] [DEBUG] [VALIDATOR ] CNNE: Primary data validation passed. [2025-10-02T18:08:45.610052] [INFO ] [MAIN ] CNNE: Fetched primary data is valid. [2025-10-02T18:08:45.610119] [DEBUG] [LOCAL ] CNNE: Saving primary data. [2025-10-02T18:08:45.612714] [DEBUG] [LOCAL ] CNNE: Trimmed 49873 records to 36641 (keeping 200 days of data) [2025-10-02T18:08:45.850176] [DEBUG] [LOCAL ] CNNE: Primary data saved (36641 records). [2025-10-02T18:08:45.850349] [INFO ] [MAIN ] CNNE: Full history saved. [2025-10-02T18:08:45.850448] [INFO ] [MAIN ] Update Progress: 495/2370 symbols completed. CNNE took 29.1s. Estimated remaining: 4h 20m 14s. Rate: 7.2 symbols/min [2025-10-02T18:08:45.885190] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-10. [2025-10-02T18:08:46.041595] [INFO ] [MAIN ] CNQ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:08:46.097157] [DEBUG] [LOCAL ] CNQ: Loaded 53581 existing records from primary storage. [2025-10-02T18:08:46.097507] [INFO ] [MAIN ] CNQ: Loaded 53581 existing records. [2025-10-02T18:08:46.292078] [WARN ] [MAIN ] CNQ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:08:46.292400] [INFO ] [MAIN ] CNQ: Wiping existing primary data before full refresh. [2025-10-02T18:08:46.292528] [INFO ] [LOCAL ] CNQ: Starting deletion of primary data. [2025-10-02T18:08:46.294432] [DEBUG] [LOCAL ] CNQ: Deleted primary data file. [2025-10-02T18:08:46.294496] [INFO ] [MAIN ] CNQ: Starting full primary refresh. [2025-10-02T18:08:46.680092] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-01. [2025-10-02T18:08:46.693809] [INFO ] [REMOTE ] CNQ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:08:46.727085] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-02T18:08:47.412469] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-02T18:08:47.414581] [INFO ] [REMOTE ] CNM: Full fetch complete (73645 records). [2025-10-02T18:08:47.414733] [DEBUG] [VALIDATOR ] CNM: Validating primary data. [2025-10-02T18:08:47.482178] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2024-12. [2025-10-02T18:08:47.847330] [DEBUG] [VALIDATOR ] CNM: All expected trading days are present. [2025-10-02T18:08:47.847427] [DEBUG] [VALIDATOR ] CNM: Primary data validation passed. [2025-10-02T18:08:47.848381] [INFO ] [MAIN ] CNM: Fetched primary data is valid. [2025-10-02T18:08:47.848454] [DEBUG] [LOCAL ] CNM: Saving primary data. [2025-10-02T18:08:47.850054] [DEBUG] [LOCAL ] CNM: Trimmed 73645 records to 51367 (keeping 200 days of data) [2025-10-02T18:08:48.190251] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-02T18:08:48.215345] [DEBUG] [LOCAL ] CNM: Primary data saved (51367 records). [2025-10-02T18:08:48.215507] [INFO ] [MAIN ] CNM: Full history saved. [2025-10-02T18:08:48.215597] [INFO ] [MAIN ] Update Progress: 496/2370 symbols completed. CNM took 42.8s. Estimated remaining: 4h 19m 43s. Rate: 7.2 symbols/min [2025-10-02T18:08:48.282567] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-04. [2025-10-02T18:08:48.405256] [INFO ] [MAIN ] CNR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:08:48.405457] [DEBUG] [LOCAL ] CNR: No existing data file found in primary storage. [2025-10-02T18:08:48.405552] [WARN ] [MAIN ] CNR: No existing data found, performing full refresh instead. [2025-10-02T18:08:48.405701] [INFO ] [MAIN ] CNR: Wiping existing primary data before full refresh. [2025-10-02T18:08:48.405755] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-10-02T18:08:48.405798] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-10-02T18:08:48.405832] [INFO ] [MAIN ] CNR: Starting full primary refresh. [2025-10-02T18:08:48.810881] [INFO ] [REMOTE ] CNR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:08:49.073005] [INFO ] [REMOTE ] CNR: Fetching primary data for 2024-12. [2025-10-02T18:08:49.282495] [DEBUG] [REMOTE ] CNR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T18:08:49.282891] [WARN ] [REMOTE ] CNR: No data returned for month 2024-12 [2025-10-02T18:08:49.282978] [FATAL] [REMOTE ] CNR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T18:08:49.283048] [FATAL] [MAIN ] CNR: Failed to fetch primary data. [2025-10-02T18:08:49.283116] [WARN ] [MAIN ] CNR: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T18:08:49.283189] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-10-02T18:08:49.283252] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-10-02T18:08:49.283287] [INFO ] [LOCAL ] CNR: Starting deletion of derivative data. [2025-10-02T18:08:49.283327] [DEBUG] [LOCAL ] CNR: No derivative data file found to delete. [2025-10-02T18:08:49.283390] [INFO ] [MAIN ] Update Progress: 497/2370 symbols completed. CNR took 1.1s. Estimated remaining: 4h 19m 7s. Rate: 7.2 symbols/min [2025-10-02T18:08:49.505209] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-02T18:08:49.503499] [INFO ] [MAIN ] CNS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:08:49.548704] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-02T18:08:49.577023] [DEBUG] [LOCAL ] CNS: Loaded 20584 existing records from primary storage. [2025-10-02T18:08:49.577306] [INFO ] [MAIN ] CNS: Loaded 20584 existing records. [2025-10-02T18:08:49.765637] [WARN ] [MAIN ] CNS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:08:49.765887] [INFO ] [MAIN ] CNS: Wiping existing primary data before full refresh. [2025-10-02T18:08:49.765937] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-10-02T18:08:49.766692] [DEBUG] [LOCAL ] CNS: Deleted primary data file. [2025-10-02T18:08:49.766755] [INFO ] [MAIN ] CNS: Starting full primary refresh. [2025-10-02T18:08:49.882012] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-05. [2025-10-02T18:08:50.173863] [INFO ] [REMOTE ] CNS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:08:50.673034] [INFO ] [REMOTE ] CNS: Fetching primary data for 2024-12. [2025-10-02T18:08:51.472976] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-01. [2025-10-02T18:08:51.619015] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-02T18:08:51.757632] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-02T18:08:52.273038] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-02. [2025-10-02T18:08:53.072970] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-01. [2025-10-02T18:08:53.263696] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-02T18:08:53.542746] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-02T18:08:53.872987] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-06. [2025-10-02T18:08:54.071385] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-02T18:08:54.673052] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-03. [2025-10-02T18:08:54.914661] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-02T18:08:55.472983] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-02. [2025-10-02T18:08:56.273054] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-02. [2025-10-02T18:08:56.489359] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-02T18:08:57.046166] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-02T18:08:57.072967] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-03. [2025-10-02T18:08:57.266350] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-02T18:08:57.873028] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-04. [2025-10-02T18:08:58.605000] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-02T18:08:58.673024] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-03. [2025-10-02T18:08:59.473015] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-07. [2025-10-02T18:08:59.713245] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-02T18:08:59.741786] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-02T18:09:00.273024] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-04. [2025-10-02T18:09:00.902158] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-02T18:09:01.073058] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-04. [2025-10-02T18:09:01.873019] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-08. [2025-10-02T18:09:02.381796] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-02T18:09:02.518856] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-02T18:09:02.673040] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-05. [2025-10-02T18:09:03.414097] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-02T18:09:03.473048] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-05. [2025-10-02T18:09:04.272972] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-05. [2025-10-02T18:09:04.377298] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-02T18:09:05.073055] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-09. [2025-10-02T18:09:05.873010] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-06. [2025-10-02T18:09:06.141218] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-02T18:09:06.214746] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-02T18:09:06.673034] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-06. [2025-10-02T18:09:07.473045] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-10. [2025-10-02T18:09:07.645900] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-02T18:09:07.821958] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-05 (4.35 seconds). [2025-10-02T18:09:08.241309] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-02T18:09:08.273006] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-06. [2025-10-02T18:09:08.684780] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-02T18:09:08.686941] [INFO ] [REMOTE ] CNO: Full fetch complete (60636 records). [2025-10-02T18:09:08.687075] [DEBUG] [VALIDATOR ] CNO: Validating primary data. [2025-10-02T18:09:09.074783] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-07. [2025-10-02T18:09:09.146018] [DEBUG] [VALIDATOR ] CNO: All expected trading days are present. [2025-10-02T18:09:09.149348] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-02T18:09:09.148739] [DEBUG] [VALIDATOR ] CNO: Primary data validation passed. [2025-10-02T18:09:09.154922] [INFO ] [MAIN ] CNO: Fetched primary data is valid. [2025-10-02T18:09:09.155391] [DEBUG] [LOCAL ] CNO: Saving primary data. [2025-10-02T18:09:09.156704] [DEBUG] [LOCAL ] CNO: Trimmed 60636 records to 41454 (keeping 200 days of data) [2025-10-02T18:09:09.441828] [DEBUG] [LOCAL ] CNO: Primary data saved (41454 records). [2025-10-02T18:09:09.441958] [INFO ] [MAIN ] CNO: Full history saved. [2025-10-02T18:09:09.442061] [INFO ] [MAIN ] Update Progress: 498/2370 symbols completed. CNO took 32.4s. Estimated remaining: 4h 19m 44s. Rate: 7.2 symbols/min [2025-10-02T18:09:09.638275] [INFO ] [MAIN ] CNX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:09:09.689735] [DEBUG] [LOCAL ] CNX: Loaded 51372 existing records from primary storage. [2025-10-02T18:09:09.690128] [INFO ] [MAIN ] CNX: Loaded 51372 existing records. [2025-10-02T18:09:09.878163] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-07. [2025-10-02T18:09:09.965581] [WARN ] [MAIN ] CNX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:09:09.966249] [INFO ] [MAIN ] CNX: Wiping existing primary data before full refresh. [2025-10-02T18:09:09.966314] [INFO ] [LOCAL ] CNX: Starting deletion of primary data. [2025-10-02T18:09:09.968014] [DEBUG] [LOCAL ] CNX: Deleted primary data file. [2025-10-02T18:09:09.968081] [INFO ] [MAIN ] CNX: Starting full primary refresh. [2025-10-02T18:09:10.366222] [INFO ] [REMOTE ] CNX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:09:10.562176] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-02T18:09:10.673004] [INFO ] [REMOTE ] CNX: Fetching primary data for 2024-12. [2025-10-02T18:09:11.472981] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-07. [2025-10-02T18:09:11.946809] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-02T18:09:12.272965] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-08. [2025-10-02T18:09:12.466891] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-02T18:09:12.671429] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-02T18:09:13.073025] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-08. [2025-10-02T18:09:13.872979] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-01. [2025-10-02T18:09:14.174991] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-02T18:09:14.673023] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-08. [2025-10-02T18:09:15.473031] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-09. [2025-10-02T18:09:15.549464] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-02T18:09:16.110222] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-08 (3.84 seconds). [2025-10-02T18:09:16.273025] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-09. [2025-10-02T18:09:16.553732] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-02T18:09:16.621806] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-02T18:09:17.073038] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-10. [2025-10-02T18:09:17.872989] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-02. [2025-10-02T18:09:17.929125] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-02T18:09:17.930462] [INFO ] [REMOTE ] CNS: Full fetch complete (30197 records). [2025-10-02T18:09:17.930541] [DEBUG] [VALIDATOR ] CNS: Validating primary data. [2025-10-02T18:09:18.384857] [DEBUG] [VALIDATOR ] CNS: All expected trading days are present. [2025-10-02T18:09:18.385155] [DEBUG] [VALIDATOR ] CNS: Primary data validation passed. [2025-10-02T18:09:18.386128] [INFO ] [MAIN ] CNS: Fetched primary data is valid. [2025-10-02T18:09:18.387505] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-02T18:09:18.387693] [DEBUG] [LOCAL ] CNS: Saving primary data. [2025-10-02T18:09:18.399960] [DEBUG] [LOCAL ] CNS: Trimmed 30197 records to 20779 (keeping 200 days of data) [2025-10-02T18:09:18.530199] [DEBUG] [LOCAL ] CNS: Primary data saved (20779 records). [2025-10-02T18:09:18.530322] [INFO ] [MAIN ] CNS: Full history saved. [2025-10-02T18:09:18.530407] [INFO ] [MAIN ] Update Progress: 499/2370 symbols completed. CNS took 29.2s. Estimated remaining: 4h 19m 38s. Rate: 7.2 symbols/min [2025-10-02T18:09:18.678105] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-09. [2025-10-02T18:09:18.727529] [INFO ] [MAIN ] CODI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:09:18.767104] [DEBUG] [LOCAL ] CODI: Loaded 40010 existing records from primary storage. [2025-10-02T18:09:18.767399] [INFO ] [MAIN ] CODI: Loaded 40010 existing records. [2025-10-02T18:09:18.965977] [WARN ] [MAIN ] CODI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:09:18.966212] [INFO ] [MAIN ] CODI: Wiping existing primary data before full refresh. [2025-10-02T18:09:18.966261] [INFO ] [LOCAL ] CODI: Starting deletion of primary data. [2025-10-02T18:09:18.967415] [DEBUG] [LOCAL ] CODI: Deleted primary data file. [2025-10-02T18:09:18.967512] [INFO ] [MAIN ] CODI: Starting full primary refresh. [2025-10-02T18:09:19.373159] [INFO ] [REMOTE ] CODI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:09:19.472985] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-10. [2025-10-02T18:09:19.558468] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-02T18:09:20.253900] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-02T18:09:20.272966] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-03. [2025-10-02T18:09:20.949735] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-02T18:09:20.951897] [INFO ] [REMOTE ] CNQ: Full fetch complete (77553 records). [2025-10-02T18:09:20.952017] [DEBUG] [VALIDATOR ] CNQ: Validating primary data. [2025-10-02T18:09:21.079287] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-10. [2025-10-02T18:09:21.410229] [DEBUG] [VALIDATOR ] CNQ: All expected trading days are present. [2025-10-02T18:09:21.410320] [DEBUG] [VALIDATOR ] CNQ: Primary data validation passed. [2025-10-02T18:09:21.411223] [INFO ] [MAIN ] CNQ: Fetched primary data is valid. [2025-10-02T18:09:21.411291] [DEBUG] [LOCAL ] CNQ: Saving primary data. [2025-10-02T18:09:21.413246] [DEBUG] [LOCAL ] CNQ: Trimmed 77553 records to 53970 (keeping 200 days of data) [2025-10-02T18:09:21.777717] [DEBUG] [LOCAL ] CNQ: Primary data saved (53970 records). [2025-10-02T18:09:21.777935] [INFO ] [MAIN ] CNQ: Full history saved. [2025-10-02T18:09:21.778097] [INFO ] [MAIN ] Update Progress: 500/2370 symbols completed. CNQ took 35.9s. Estimated remaining: 4h 19m 11s. Rate: 7.2 symbols/min [2025-10-02T18:09:21.880279] [INFO ] [REMOTE ] CODI: Fetching primary data for 2024-12. [2025-10-02T18:09:21.972029] [INFO ] [MAIN ] COF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:09:22.039388] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-02T18:09:22.068456] [DEBUG] [LOCAL ] COF: Loaded 53609 existing records from primary storage. [2025-10-02T18:09:22.068808] [INFO ] [MAIN ] COF: Loaded 53609 existing records. [2025-10-02T18:09:22.262843] [WARN ] [MAIN ] COF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:09:22.263094] [INFO ] [MAIN ] COF: Wiping existing primary data before full refresh. [2025-10-02T18:09:22.263163] [INFO ] [LOCAL ] COF: Starting deletion of primary data. [2025-10-02T18:09:22.265036] [DEBUG] [LOCAL ] COF: Deleted primary data file. [2025-10-02T18:09:22.265101] [INFO ] [MAIN ] COF: Starting full primary refresh. [2025-10-02T18:09:22.680385] [INFO ] [REMOTE ] COF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:09:22.676994] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-04. [2025-10-02T18:09:22.681128] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-02T18:09:22.684543] [INFO ] [REMOTE ] CNP: Full fetch complete (77370 records). [2025-10-02T18:09:22.684697] [DEBUG] [VALIDATOR ] CNP: Validating primary data. [2025-10-02T18:09:23.108567] [DEBUG] [VALIDATOR ] CNP: All expected trading days are present. [2025-10-02T18:09:23.108719] [DEBUG] [VALIDATOR ] CNP: Primary data validation passed. [2025-10-02T18:09:23.109597] [INFO ] [MAIN ] CNP: Fetched primary data is valid. [2025-10-02T18:09:23.109767] [DEBUG] [LOCAL ] CNP: Saving primary data. [2025-10-02T18:09:23.111717] [DEBUG] [LOCAL ] CNP: Trimmed 77370 records to 53859 (keeping 200 days of data) [2025-10-02T18:09:23.254323] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-02T18:09:23.473059] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-01. [2025-10-02T18:09:23.482463] [DEBUG] [LOCAL ] CNP: Primary data saved (53859 records). [2025-10-02T18:09:23.482564] [INFO ] [MAIN ] CNP: Full history saved. [2025-10-02T18:09:23.482676] [INFO ] [MAIN ] Update Progress: 501/2370 symbols completed. CNP took 43.9s. Estimated remaining: 4h 18m 38s. Rate: 7.2 symbols/min [2025-10-02T18:09:23.668984] [INFO ] [MAIN ] COHR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:09:23.669190] [DEBUG] [LOCAL ] COHR: No existing data file found in primary storage. [2025-10-02T18:09:23.669237] [WARN ] [MAIN ] COHR: No existing data found, performing full refresh instead. [2025-10-02T18:09:23.669371] [INFO ] [MAIN ] COHR: Wiping existing primary data before full refresh. [2025-10-02T18:09:23.669418] [INFO ] [LOCAL ] COHR: Starting deletion of primary data. [2025-10-02T18:09:23.669462] [DEBUG] [LOCAL ] COHR: No primary data file found to delete. [2025-10-02T18:09:23.669497] [INFO ] [MAIN ] COHR: Starting full primary refresh. [2025-10-02T18:09:24.073088] [INFO ] [REMOTE ] COHR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:09:24.273041] [INFO ] [REMOTE ] COHR: Fetching primary data for 2024-12. [2025-10-02T18:09:24.779372] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-02T18:09:24.920533] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-02T18:09:25.072993] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-05. [2025-10-02T18:09:25.872992] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-02. [2025-10-02T18:09:26.192759] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-02T18:09:26.683094] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-01. [2025-10-02T18:09:26.705473] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-02T18:09:26.907156] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-02T18:09:27.473039] [INFO ] [REMOTE ] COF: Fetching primary data for 2024-12. [2025-10-02T18:09:28.273026] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-06. [2025-10-02T18:09:28.590330] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-02T18:09:29.073033] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-03. [2025-10-02T18:09:29.552356] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-02T18:09:29.843671] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-02T18:09:29.872972] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-07. [2025-10-02T18:09:30.025388] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-02T18:09:30.673006] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-04. [2025-10-02T18:09:31.202916] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-02T18:09:31.473055] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-08. [2025-10-02T18:09:32.170301] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-02T18:09:32.273014] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-05. [2025-10-02T18:09:33.072978] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-01. [2025-10-02T18:09:33.243060] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-02T18:09:33.872981] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-02. [2025-10-02T18:09:34.025435] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-02T18:09:34.673045] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-06. [2025-10-02T18:09:34.905435] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-02T18:09:35.472977] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-09. [2025-10-02T18:09:35.861043] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-02T18:09:36.210198] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-02T18:09:36.273031] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-03. [2025-10-02T18:09:37.072977] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-07. [2025-10-02T18:09:37.105195] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-02T18:09:37.872999] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-02. [2025-10-02T18:09:38.351238] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-02T18:09:38.678452] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-04. [2025-10-02T18:09:38.684122] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-02T18:09:39.472996] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-10. [2025-10-02T18:09:39.620495] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-02T18:09:40.272999] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-03. [2025-10-02T18:09:40.754010] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-02T18:09:40.755906] [INFO ] [REMOTE ] CNX: Full fetch complete (74373 records). [2025-10-02T18:09:40.756087] [DEBUG] [VALIDATOR ] CNX: Validating primary data. [2025-10-02T18:09:40.757281] [FATAL] [VALIDATOR ] CNX: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:09:40.757398] [FATAL] [MAIN ] CNX: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:09:40.757444] [WARN ] [MAIN ] CNX: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:09:40.757519] [INFO ] [LOCAL ] CNX: Starting deletion of primary data. [2025-10-02T18:09:40.757618] [DEBUG] [LOCAL ] CNX: No primary data file found to delete. [2025-10-02T18:09:40.757715] [INFO ] [LOCAL ] CNX: Starting deletion of derivative data. [2025-10-02T18:09:40.758097] [DEBUG] [LOCAL ] CNX: Deleted derivative data file. [2025-10-02T18:09:40.758882] [INFO ] [MAIN ] Update Progress: 502/2370 symbols completed. CNX took 31.3s. Estimated remaining: 4h 19m 3s. Rate: 7.2 symbols/min [2025-10-02T18:09:40.948896] [INFO ] [MAIN ] COLD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:09:41.011711] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-02T18:09:41.041177] [DEBUG] [LOCAL ] COLD: Loaded 52075 existing records from primary storage. [2025-10-02T18:09:41.041561] [INFO ] [MAIN ] COLD: Loaded 52075 existing records. [2025-10-02T18:09:41.078129] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-08. [2025-10-02T18:09:41.242308] [WARN ] [MAIN ] COLD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:09:41.242574] [INFO ] [MAIN ] COLD: Wiping existing primary data before full refresh. [2025-10-02T18:09:41.242628] [INFO ] [LOCAL ] COLD: Starting deletion of primary data. [2025-10-02T18:09:41.244396] [DEBUG] [LOCAL ] COLD: Deleted primary data file. [2025-10-02T18:09:41.244471] [INFO ] [MAIN ] COLD: Starting full primary refresh. [2025-10-02T18:09:41.648356] [INFO ] [REMOTE ] COLD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:09:41.872997] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-05. [2025-10-02T18:09:42.268501] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-02T18:09:42.402537] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-02T18:09:42.673006] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-09. [2025-10-02T18:09:43.472973] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-04. [2025-10-02T18:09:43.863277] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-02T18:09:44.157228] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-02T18:09:44.272997] [INFO ] [REMOTE ] COLD: Fetching primary data for 2024-12. [2025-10-02T18:09:45.072971] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-10. [2025-10-02T18:09:45.545069] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-02T18:09:45.872970] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-05. [2025-10-02T18:09:46.018766] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-02T18:09:46.245858] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-02T18:09:46.247483] [INFO ] [REMOTE ] CODI: Full fetch complete (50992 records). [2025-10-02T18:09:46.247568] [DEBUG] [VALIDATOR ] CODI: Validating primary data. [2025-10-02T18:09:46.662629] [DEBUG] [VALIDATOR ] CODI: All expected trading days are present. [2025-10-02T18:09:46.662751] [DEBUG] [VALIDATOR ] CODI: Primary data validation passed. [2025-10-02T18:09:46.663451] [INFO ] [MAIN ] CODI: Fetched primary data is valid. [2025-10-02T18:09:46.663512] [DEBUG] [LOCAL ] CODI: Saving primary data. [2025-10-02T18:09:46.664737] [DEBUG] [LOCAL ] CODI: Trimmed 50992 records to 40283 (keeping 200 days of data) [2025-10-02T18:09:46.713481] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-01. [2025-10-02T18:09:46.900212] [DEBUG] [LOCAL ] CODI: Primary data saved (40283 records). [2025-10-02T18:09:46.900341] [INFO ] [MAIN ] CODI: Full history saved. [2025-10-02T18:09:46.900420] [INFO ] [MAIN ] Update Progress: 503/2370 symbols completed. CODI took 28.4s. Estimated remaining: 4h 18m 46s. Rate: 7.2 symbols/min [2025-10-02T18:09:47.089423] [INFO ] [MAIN ] COMP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:09:47.140667] [DEBUG] [LOCAL ] COMP: Loaded 53389 existing records from primary storage. [2025-10-02T18:09:47.141063] [INFO ] [MAIN ] COMP: Loaded 53389 existing records. [2025-10-02T18:09:47.333133] [WARN ] [MAIN ] COMP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:09:47.333346] [INFO ] [MAIN ] COMP: Wiping existing primary data before full refresh. [2025-10-02T18:09:47.333397] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-10-02T18:09:47.334854] [DEBUG] [LOCAL ] COMP: Deleted primary data file. [2025-10-02T18:09:47.334915] [INFO ] [MAIN ] COMP: Starting full primary refresh. [2025-10-02T18:09:47.488902] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-06. [2025-10-02T18:09:47.734054] [INFO ] [REMOTE ] COMP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:09:47.949377] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-02T18:09:48.137374] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-02T18:09:48.273042] [INFO ] [REMOTE ] COMP: Fetching primary data for 2024-12. [2025-10-02T18:09:49.073039] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-06. [2025-10-02T18:09:49.674968] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-02T18:09:49.873020] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-02. [2025-10-02T18:09:49.967463] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-02T18:09:50.672995] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-07. [2025-10-02T18:09:50.734998] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-02T18:09:51.473010] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-07. [2025-10-02T18:09:51.571898] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-02T18:09:52.272990] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-01. [2025-10-02T18:09:52.466845] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-02T18:09:53.072978] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-08. [2025-10-02T18:09:53.529947] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-02T18:09:53.872985] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-08. [2025-10-02T18:09:54.061936] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-02T18:09:54.673070] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-03. [2025-10-02T18:09:55.127210] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-02T18:09:55.473015] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-02. [2025-10-02T18:09:55.742165] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-02T18:09:56.060895] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-02T18:09:56.273022] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-09. [2025-10-02T18:09:57.073004] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-09. [2025-10-02T18:09:57.139243] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-02T18:09:57.798728] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-02T18:09:57.872999] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-10. [2025-10-02T18:09:58.673018] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-03. [2025-10-02T18:09:59.263339] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-02T18:09:59.417864] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-02T18:09:59.420021] [INFO ] [REMOTE ] COF: Full fetch complete (77417 records). [2025-10-02T18:09:59.420160] [DEBUG] [VALIDATOR ] COF: Validating primary data. [2025-10-02T18:09:59.481519] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-10. [2025-10-02T18:09:59.849317] [DEBUG] [VALIDATOR ] COF: All expected trading days are present. [2025-10-02T18:09:59.849443] [DEBUG] [VALIDATOR ] COF: Primary data validation passed. [2025-10-02T18:09:59.850330] [INFO ] [MAIN ] COF: Fetched primary data is valid. [2025-10-02T18:09:59.850423] [DEBUG] [LOCAL ] COF: Saving primary data. [2025-10-02T18:09:59.852025] [DEBUG] [LOCAL ] COF: Trimmed 77417 records to 53999 (keeping 200 days of data) [2025-10-02T18:10:00.228368] [DEBUG] [LOCAL ] COF: Primary data saved (53999 records). [2025-10-02T18:10:00.228521] [INFO ] [MAIN ] COF: Full history saved. [2025-10-02T18:10:00.228666] [INFO ] [MAIN ] Update Progress: 504/2370 symbols completed. COF took 38.5s. Estimated remaining: 4h 18m 57s. Rate: 7.2 symbols/min [2025-10-02T18:10:00.278072] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-04. [2025-10-02T18:10:00.440847] [INFO ] [MAIN ] CON: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:10:00.441064] [DEBUG] [LOCAL ] CON: No existing data file found in primary storage. [2025-10-02T18:10:00.441171] [WARN ] [MAIN ] CON: No existing data found, performing full refresh instead. [2025-10-02T18:10:00.441357] [INFO ] [MAIN ] CON: Wiping existing primary data before full refresh. [2025-10-02T18:10:00.441542] [INFO ] [LOCAL ] CON: Starting deletion of primary data. [2025-10-02T18:10:00.441615] [DEBUG] [LOCAL ] CON: No primary data file found to delete. [2025-10-02T18:10:00.441709] [INFO ] [MAIN ] CON: Starting full primary refresh. [2025-10-02T18:10:00.798801] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-02T18:10:00.897403] [INFO ] [REMOTE ] CON: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:10:01.073010] [INFO ] [REMOTE ] CON: Fetching primary data for 2024-12. [2025-10-02T18:10:01.227182] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-02T18:10:01.229127] [INFO ] [REMOTE ] COHR: Full fetch complete (76740 records). [2025-10-02T18:10:01.229344] [DEBUG] [VALIDATOR ] COHR: Validating primary data. [2025-10-02T18:10:01.230378] [FATAL] [VALIDATOR ] COHR: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:10:01.230519] [FATAL] [MAIN ] COHR: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:10:01.230607] [WARN ] [MAIN ] COHR: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:10:01.230730] [INFO ] [LOCAL ] COHR: Starting deletion of primary data. [2025-10-02T18:10:01.230809] [DEBUG] [LOCAL ] COHR: No primary data file found to delete. [2025-10-02T18:10:01.230847] [INFO ] [LOCAL ] COHR: Starting deletion of derivative data. [2025-10-02T18:10:01.230889] [DEBUG] [LOCAL ] COHR: No derivative data file found to delete. [2025-10-02T18:10:01.230968] [INFO ] [MAIN ] Update Progress: 505/2370 symbols completed. COHR took 37.7s. Estimated remaining: 4h 18m 21s. Rate: 7.2 symbols/min [2025-10-02T18:10:01.421974] [INFO ] [MAIN ] COOK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:10:01.447675] [DEBUG] [LOCAL ] COOK: Loaded 24333 existing records from primary storage. [2025-10-02T18:10:01.448027] [INFO ] [MAIN ] COOK: Loaded 24333 existing records. [2025-10-02T18:10:01.642715] [WARN ] [MAIN ] COOK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:10:01.643020] [INFO ] [MAIN ] COOK: Wiping existing primary data before full refresh. [2025-10-02T18:10:01.643080] [INFO ] [LOCAL ] COOK: Starting deletion of primary data. [2025-10-02T18:10:01.643977] [DEBUG] [LOCAL ] COOK: Deleted primary data file. [2025-10-02T18:10:01.644040] [INFO ] [MAIN ] COOK: Starting full primary refresh. [2025-10-02T18:10:01.877685] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-04. [2025-10-02T18:10:02.095874] [INFO ] [REMOTE ] COOK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:10:02.132040] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-02T18:10:02.672978] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-05. [2025-10-02T18:10:02.795298] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-02T18:10:03.459945] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-02T18:10:03.472952] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-05. [2025-10-02T18:10:04.273011] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-01. [2025-10-02T18:10:04.515723] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-02T18:10:04.819769] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-02T18:10:05.073010] [INFO ] [REMOTE ] COOK: Fetching primary data for 2024-12. [2025-10-02T18:10:05.873022] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-06. [2025-10-02T18:10:06.247700] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-02T18:10:06.510482] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-02T18:10:06.672979] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-02. [2025-10-02T18:10:07.473034] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-06. [2025-10-02T18:10:07.702053] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-02T18:10:08.089739] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-02T18:10:08.273050] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-01. [2025-10-02T18:10:09.072995] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-07. [2025-10-02T18:10:09.276126] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-02T18:10:09.306406] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-02T18:10:09.873016] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-03. [2025-10-02T18:10:10.673019] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-02. [2025-10-02T18:10:11.063384] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-02T18:10:11.259013] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-02T18:10:11.354063] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-02T18:10:11.473051] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-03. [2025-10-02T18:10:12.273018] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-04. [2025-10-02T18:10:12.593718] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-02T18:10:13.073047] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-04. [2025-10-02T18:10:13.873181] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-08. [2025-10-02T18:10:13.999902] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-02T18:10:14.113662] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-02T18:10:14.673078] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-05. [2025-10-02T18:10:15.473043] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-05. [2025-10-02T18:10:15.803952] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-02T18:10:16.113378] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-02T18:10:16.273000] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-09. [2025-10-02T18:10:16.322713] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-02T18:10:17.073007] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-06. [2025-10-02T18:10:17.878110] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-06. [2025-10-02T18:10:17.895797] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-02T18:10:18.176541] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-02T18:10:18.673016] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-07. [2025-10-02T18:10:19.330574] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-02T18:10:19.472994] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-10. [2025-10-02T18:10:19.724901] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-02T18:10:20.273048] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-07. [2025-10-02T18:10:21.073001] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-08. [2025-10-02T18:10:21.132889] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-02T18:10:21.137446] [INFO ] [REMOTE ] COMP: Full fetch complete (76781 records). [2025-10-02T18:10:21.137667] [DEBUG] [VALIDATOR ] COMP: Validating primary data. [2025-10-02T18:10:21.138792] [FATAL] [VALIDATOR ] COMP: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:10:21.138887] [FATAL] [MAIN ] COMP: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:10:21.138934] [WARN ] [MAIN ] COMP: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:10:21.138978] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-10-02T18:10:21.139052] [DEBUG] [LOCAL ] COMP: No primary data file found to delete. [2025-10-02T18:10:21.139109] [INFO ] [LOCAL ] COMP: Starting deletion of derivative data. [2025-10-02T18:10:21.139506] [DEBUG] [LOCAL ] COMP: Deleted derivative data file. [2025-10-02T18:10:21.139678] [INFO ] [MAIN ] Update Progress: 506/2370 symbols completed. COMP took 34.2s. Estimated remaining: 4h 18m 56s. Rate: 7.2 symbols/min [2025-10-02T18:10:21.324913] [INFO ] [MAIN ] COP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:10:21.382720] [DEBUG] [LOCAL ] COP: Loaded 53727 existing records from primary storage. [2025-10-02T18:10:21.383119] [INFO ] [MAIN ] COP: Loaded 53727 existing records. [2025-10-02T18:10:21.581826] [WARN ] [MAIN ] COP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:10:21.582081] [INFO ] [MAIN ] COP: Wiping existing primary data before full refresh. [2025-10-02T18:10:21.582140] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-10-02T18:10:21.583668] [DEBUG] [LOCAL ] COP: Deleted primary data file. [2025-10-02T18:10:21.583744] [INFO ] [MAIN ] COP: Starting full primary refresh. [2025-10-02T18:10:21.879183] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-07. [2025-10-02T18:10:21.994795] [INFO ] [REMOTE ] COP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:10:22.197383] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-02T18:10:22.556119] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-02T18:10:22.664800] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-02T18:10:22.672957] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-09. [2025-10-02T18:10:23.473019] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-08. [2025-10-02T18:10:24.198573] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-02T18:10:24.273017] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-08. [2025-10-02T18:10:25.073030] [INFO ] [REMOTE ] COP: Fetching primary data for 2024-12. [2025-10-02T18:10:25.279837] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-02T18:10:25.381390] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-02T18:10:25.873005] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-09. [2025-10-02T18:10:26.673053] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-10. [2025-10-02T18:10:27.114752] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-02T18:10:27.183424] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-02T18:10:27.472994] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-10. [2025-10-02T18:10:27.741699] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-02T18:10:27.743466] [INFO ] [REMOTE ] CON: Full fetch complete (56884 records). [2025-10-02T18:10:27.743561] [DEBUG] [VALIDATOR ] CON: Validating primary data. [2025-10-02T18:10:28.165968] [DEBUG] [VALIDATOR ] CON: All expected trading days are present. [2025-10-02T18:10:28.166059] [DEBUG] [VALIDATOR ] CON: Primary data validation passed. [2025-10-02T18:10:28.166792] [INFO ] [MAIN ] CON: Fetched primary data is valid. [2025-10-02T18:10:28.166859] [DEBUG] [LOCAL ] CON: Saving primary data. [2025-10-02T18:10:28.168234] [DEBUG] [LOCAL ] CON: Trimmed 56884 records to 39102 (keeping 200 days of data) [2025-10-02T18:10:28.273299] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-01. [2025-10-02T18:10:28.426181] [DEBUG] [LOCAL ] CON: Primary data saved (39102 records). [2025-10-02T18:10:28.426339] [INFO ] [MAIN ] CON: Full history saved. [2025-10-02T18:10:28.426455] [INFO ] [MAIN ] Update Progress: 507/2370 symbols completed. CON took 28.2s. Estimated remaining: 4h 18m 44s. Rate: 7.2 symbols/min [2025-10-02T18:10:28.478392] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-02T18:10:28.516615] [INFO ] [REMOTE ] COOK: Full fetch complete (32509 records). [2025-10-02T18:10:28.547372] [DEBUG] [VALIDATOR ] COOK: Validating primary data. [2025-10-02T18:10:28.760335] [INFO ] [MAIN ] COR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:10:29.075732] [DEBUG] [VALIDATOR ] COOK: All expected trading days are present. [2025-10-02T18:10:29.073633] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-09. [2025-10-02T18:10:29.075920] [DEBUG] [VALIDATOR ] COOK: Primary data validation passed. [2025-10-02T18:10:29.076849] [INFO ] [MAIN ] COOK: Fetched primary data is valid. [2025-10-02T18:10:29.077741] [DEBUG] [LOCAL ] COOK: Saving primary data. [2025-10-02T18:10:29.078633] [DEBUG] [LOCAL ] COOK: Trimmed 32509 records to 24479 (keeping 200 days of data) [2025-10-02T18:10:29.184844] [DEBUG] [LOCAL ] COR: Loaded 47080 existing records from primary storage. [2025-10-02T18:10:29.186805] [INFO ] [MAIN ] COR: Loaded 47080 existing records. [2025-10-02T18:10:29.435306] [WARN ] [MAIN ] COR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:10:29.436060] [INFO ] [MAIN ] COR: Wiping existing primary data before full refresh. [2025-10-02T18:10:29.436628] [INFO ] [LOCAL ] COR: Starting deletion of primary data. [2025-10-02T18:10:29.438869] [DEBUG] [LOCAL ] COR: Deleted primary data file. [2025-10-02T18:10:29.439768] [INFO ] [MAIN ] COR: Starting full primary refresh. [2025-10-02T18:10:29.806004] [DEBUG] [LOCAL ] COOK: Primary data saved (24479 records). [2025-10-02T18:10:29.811856] [INFO ] [MAIN ] COOK: Full history saved. [2025-10-02T18:10:29.822299] [INFO ] [MAIN ] Update Progress: 508/2370 symbols completed. COOK took 28.6s. Estimated remaining: 4h 18m 10s. Rate: 7.2 symbols/min [2025-10-02T18:10:29.984225] [INFO ] [REMOTE ] COR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:10:30.012589] [INFO ] [REMOTE ] COR: Fetching primary data for 2024-12. [2025-10-02T18:10:30.094467] [INFO ] [MAIN ] COTY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:10:30.127887] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-02T18:10:30.184603] [DEBUG] [LOCAL ] COTY: Loaded 53229 existing records from primary storage. [2025-10-02T18:10:30.184994] [INFO ] [MAIN ] COTY: Loaded 53229 existing records. [2025-10-02T18:10:30.374815] [WARN ] [MAIN ] COTY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:10:30.375052] [INFO ] [MAIN ] COTY: Wiping existing primary data before full refresh. [2025-10-02T18:10:30.375103] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-10-02T18:10:30.376465] [DEBUG] [LOCAL ] COTY: Deleted primary data file. [2025-10-02T18:10:30.376528] [INFO ] [MAIN ] COTY: Starting full primary refresh. [2025-10-02T18:10:30.684219] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-02. [2025-10-02T18:10:30.772925] [INFO ] [REMOTE ] COTY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:10:30.951847] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-02T18:10:31.472988] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-10. [2025-10-02T18:10:31.700132] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-02T18:10:32.175536] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-02T18:10:32.273048] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-03. [2025-10-02T18:10:33.073005] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-01. [2025-10-02T18:10:33.175181] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-02T18:10:33.177356] [INFO ] [REMOTE ] COLD: Full fetch complete (74283 records). [2025-10-02T18:10:33.177476] [DEBUG] [VALIDATOR ] COLD: Validating primary data. [2025-10-02T18:10:33.624467] [DEBUG] [VALIDATOR ] COLD: All expected trading days are present. [2025-10-02T18:10:33.624677] [DEBUG] [VALIDATOR ] COLD: Primary data validation passed. [2025-10-02T18:10:33.625631] [INFO ] [MAIN ] COLD: Fetched primary data is valid. [2025-10-02T18:10:33.625752] [DEBUG] [LOCAL ] COLD: Saving primary data. [2025-10-02T18:10:33.627379] [DEBUG] [LOCAL ] COLD: Trimmed 74283 records to 52465 (keeping 200 days of data) [2025-10-02T18:10:33.874737] [INFO ] [REMOTE ] COTY: Fetching primary data for 2024-12. [2025-10-02T18:10:33.944364] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-02T18:10:34.044556] [DEBUG] [LOCAL ] COLD: Primary data saved (52465 records). [2025-10-02T18:10:34.044733] [INFO ] [MAIN ] COLD: Full history saved. [2025-10-02T18:10:34.045546] [INFO ] [MAIN ] Update Progress: 509/2370 symbols completed. COLD took 53.3s. Estimated remaining: 4h 17m 47s. Rate: 7.2 symbols/min [2025-10-02T18:10:34.241486] [INFO ] [MAIN ] COUR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:10:34.290813] [DEBUG] [LOCAL ] COUR: Loaded 48918 existing records from primary storage. [2025-10-02T18:10:34.291162] [INFO ] [MAIN ] COUR: Loaded 48918 existing records. [2025-10-02T18:10:34.488292] [WARN ] [MAIN ] COUR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:10:34.488515] [INFO ] [MAIN ] COUR: Wiping existing primary data before full refresh. [2025-10-02T18:10:34.488567] [INFO ] [LOCAL ] COUR: Starting deletion of primary data. [2025-10-02T18:10:34.489913] [DEBUG] [LOCAL ] COUR: Deleted primary data file. [2025-10-02T18:10:34.489978] [INFO ] [MAIN ] COUR: Starting full primary refresh. [2025-10-02T18:10:34.686721] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-04. [2025-10-02T18:10:34.916616] [INFO ] [REMOTE ] COUR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:10:34.947156] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-02T18:10:35.473013] [INFO ] [REMOTE ] COUR: Fetching primary data for 2024-12. [2025-10-02T18:10:35.601257] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-02T18:10:36.272965] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-01. [2025-10-02T18:10:36.834192] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-02T18:10:37.072976] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-05. [2025-10-02T18:10:37.484263] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-02T18:10:37.872998] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-01. [2025-10-02T18:10:38.006904] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-02T18:10:38.673017] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-02. [2025-10-02T18:10:39.197932] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-02T18:10:39.245971] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-02T18:10:39.473041] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-02. [2025-10-02T18:10:40.272984] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-02. [2025-10-02T18:10:40.399719] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-02T18:10:40.991109] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-02T18:10:41.073004] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-03. [2025-10-02T18:10:41.783565] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-02T18:10:41.872997] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-06. [2025-10-02T18:10:42.672997] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-03. [2025-10-02T18:10:42.807107] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-02T18:10:43.472970] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-04. [2025-10-02T18:10:43.667132] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-02T18:10:44.273001] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-03. [2025-10-02T18:10:44.441949] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-02T18:10:45.073072] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-04. [2025-10-02T18:10:45.369432] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-02T18:10:45.874136] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-07. [2025-10-02T18:10:45.877122] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-02T18:10:46.673004] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-04. [2025-10-02T18:10:46.798328] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-02T18:10:47.473013] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-05. [2025-10-02T18:10:47.871673] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-02T18:10:48.273006] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-05. [2025-10-02T18:10:48.605806] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-02T18:10:49.073010] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-05. [2025-10-02T18:10:49.363730] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-02T18:10:49.873014] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-06. [2025-10-02T18:10:50.104818] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-02T18:10:50.303185] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-02T18:10:50.673019] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-08. [2025-10-02T18:10:51.473024] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-06. [2025-10-02T18:10:51.546164] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-02T18:10:52.272985] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-07. [2025-10-02T18:10:52.353331] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-02T18:10:53.073003] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-09. [2025-10-02T18:10:53.202854] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-02T18:10:53.873030] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-07. [2025-10-02T18:10:53.983545] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-02T18:10:54.672973] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-06. [2025-10-02T18:10:54.752692] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-02T18:10:55.081490] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-02T18:10:55.473047] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-10. [2025-10-02T18:10:56.220229] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-02T18:10:56.273000] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-07. [2025-10-02T18:10:57.077102] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-08. [2025-10-02T18:10:57.079037] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-02T18:10:57.081510] [INFO ] [REMOTE ] COP: Full fetch complete (77769 records). [2025-10-02T18:10:57.081769] [DEBUG] [VALIDATOR ] COP: Validating primary data. [2025-10-02T18:10:57.526667] [DEBUG] [VALIDATOR ] COP: All expected trading days are present. [2025-10-02T18:10:57.526772] [DEBUG] [VALIDATOR ] COP: Primary data validation passed. [2025-10-02T18:10:57.527751] [INFO ] [MAIN ] COP: Fetched primary data is valid. [2025-10-02T18:10:57.527821] [DEBUG] [LOCAL ] COP: Saving primary data. [2025-10-02T18:10:57.529483] [DEBUG] [LOCAL ] COP: Trimmed 77769 records to 54117 (keeping 200 days of data) [2025-10-02T18:10:57.873019] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-08. [2025-10-02T18:10:57.894621] [DEBUG] [LOCAL ] COP: Primary data saved (54117 records). [2025-10-02T18:10:57.894821] [INFO ] [MAIN ] COP: Full history saved. [2025-10-02T18:10:57.894935] [INFO ] [MAIN ] Update Progress: 510/2370 symbols completed. COP took 36.8s. Estimated remaining: 4h 18m 35s. Rate: 7.2 symbols/min [2025-10-02T18:10:58.100079] [INFO ] [MAIN ] CP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:10:58.135374] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-02T18:10:58.197857] [DEBUG] [LOCAL ] CP: Loaded 53267 existing records from primary storage. [2025-10-02T18:10:58.198373] [INFO ] [MAIN ] CP: Loaded 53267 existing records. [2025-10-02T18:10:58.403219] [WARN ] [MAIN ] CP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:10:58.403719] [INFO ] [MAIN ] CP: Wiping existing primary data before full refresh. [2025-10-02T18:10:58.404049] [INFO ] [LOCAL ] CP: Starting deletion of primary data. [2025-10-02T18:10:58.406429] [DEBUG] [LOCAL ] CP: Deleted primary data file. [2025-10-02T18:10:58.406494] [INFO ] [MAIN ] CP: Starting full primary refresh. [2025-10-02T18:10:58.680254] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-08. [2025-10-02T18:10:58.825143] [INFO ] [REMOTE ] CP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:10:58.857664] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-02T18:10:59.473000] [INFO ] [REMOTE ] CP: Fetching primary data for 2024-12. [2025-10-02T18:11:00.002787] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-02T18:11:00.176247] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-02T18:11:00.273046] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-09. [2025-10-02T18:11:01.073004] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-09. [2025-10-02T18:11:01.112175] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-02T18:11:01.872999] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-01. [2025-10-02T18:11:02.014492] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-02T18:11:02.506925] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-02T18:11:02.673004] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-10. [2025-10-02T18:11:03.473021] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-10. [2025-10-02T18:11:03.643734] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-02T18:11:04.273062] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-02. [2025-10-02T18:11:04.340150] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-02T18:11:04.342222] [INFO ] [REMOTE ] COTY: Full fetch complete (77091 records). [2025-10-02T18:11:04.342385] [DEBUG] [VALIDATOR ] COTY: Validating primary data. [2025-10-02T18:11:04.816233] [DEBUG] [VALIDATOR ] COTY: All expected trading days are present. [2025-10-02T18:11:04.816352] [DEBUG] [VALIDATOR ] COTY: Primary data validation passed. [2025-10-02T18:11:04.817299] [INFO ] [MAIN ] COTY: Fetched primary data is valid. [2025-10-02T18:11:04.817387] [DEBUG] [LOCAL ] COTY: Saving primary data. [2025-10-02T18:11:04.819228] [DEBUG] [LOCAL ] COTY: Trimmed 77091 records to 53616 (keeping 200 days of data) [2025-10-02T18:11:05.029708] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-02T18:11:05.044504] [INFO ] [REMOTE ] COUR: Full fetch complete (70846 records). [2025-10-02T18:11:05.057562] [DEBUG] [VALIDATOR ] COUR: Validating primary data. [2025-10-02T18:11:05.073843] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-09. [2025-10-02T18:11:05.366779] [DEBUG] [LOCAL ] COTY: Primary data saved (53616 records). [2025-10-02T18:11:05.386288] [INFO ] [MAIN ] COTY: Full history saved. [2025-10-02T18:11:05.433065] [INFO ] [MAIN ] Update Progress: 511/2370 symbols completed. COTY took 35.6s. Estimated remaining: 4h 18m 24s. Rate: 7.2 symbols/min [2025-10-02T18:11:05.770620] [DEBUG] [VALIDATOR ] COUR: All expected trading days are present. [2025-10-02T18:11:05.784363] [DEBUG] [VALIDATOR ] COUR: Primary data validation passed. [2025-10-02T18:11:05.820376] [INFO ] [MAIN ] CPA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:11:05.821432] [INFO ] [MAIN ] COUR: Fetched primary data is valid. [2025-10-02T18:11:05.821807] [DEBUG] [LOCAL ] CPA: No existing data file found in primary storage. [2025-10-02T18:11:05.821940] [DEBUG] [LOCAL ] COUR: Saving primary data. [2025-10-02T18:11:05.821895] [WARN ] [MAIN ] CPA: No existing data found, performing full refresh instead. [2025-10-02T18:11:05.822533] [INFO ] [MAIN ] CPA: Wiping existing primary data before full refresh. [2025-10-02T18:11:05.822611] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-10-02T18:11:05.823028] [DEBUG] [LOCAL ] CPA: No primary data file found to delete. [2025-10-02T18:11:05.823137] [INFO ] [MAIN ] CPA: Starting full primary refresh. [2025-10-02T18:11:05.893068] [DEBUG] [LOCAL ] COUR: Trimmed 70846 records to 49263 (keeping 200 days of data) [2025-10-02T18:11:06.472140] [INFO ] [REMOTE ] CPA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:11:06.475155] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-02T18:11:06.475757] [INFO ] [REMOTE ] CPA: Fetching primary data for 2024-12. [2025-10-02T18:11:06.677208] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-03. [2025-10-02T18:11:06.719857] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-02T18:11:06.841893] [DEBUG] [LOCAL ] COUR: Primary data saved (49263 records). [2025-10-02T18:11:06.842135] [INFO ] [MAIN ] COUR: Full history saved. [2025-10-02T18:11:06.843121] [INFO ] [MAIN ] Update Progress: 512/2370 symbols completed. COUR took 32.8s. Estimated remaining: 4h 17m 50s. Rate: 7.2 symbols/min [2025-10-02T18:11:07.123177] [INFO ] [MAIN ] CPAC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:11:07.123433] [DEBUG] [LOCAL ] CPAC: No existing data file found in primary storage. [2025-10-02T18:11:07.123508] [WARN ] [MAIN ] CPAC: No existing data found, performing full refresh instead. [2025-10-02T18:11:07.123669] [INFO ] [MAIN ] CPAC: Wiping existing primary data before full refresh. [2025-10-02T18:11:07.123735] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-02T18:11:07.123788] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-02T18:11:07.123834] [INFO ] [MAIN ] CPAC: Starting full primary refresh. [2025-10-02T18:11:07.477142] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-10. [2025-10-02T18:11:07.643766] [INFO ] [REMOTE ] CPAC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:11:07.664471] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-02T18:11:08.178923] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-02T18:11:08.272976] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-01. [2025-10-02T18:11:08.973517] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-02T18:11:08.976176] [INFO ] [REMOTE ] COR: Full fetch complete (68772 records). [2025-10-02T18:11:08.976373] [DEBUG] [VALIDATOR ] COR: Validating primary data. [2025-10-02T18:11:09.078180] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-04. [2025-10-02T18:11:09.418956] [DEBUG] [VALIDATOR ] COR: All expected trading days are present. [2025-10-02T18:11:09.419045] [DEBUG] [VALIDATOR ] COR: Primary data validation passed. [2025-10-02T18:11:09.419887] [INFO ] [MAIN ] COR: Fetched primary data is valid. [2025-10-02T18:11:09.419953] [DEBUG] [LOCAL ] COR: Saving primary data. [2025-10-02T18:11:09.421444] [DEBUG] [LOCAL ] COR: Trimmed 68772 records to 47382 (keeping 200 days of data) [2025-10-02T18:11:09.683182] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-02T18:11:09.765382] [DEBUG] [LOCAL ] COR: Primary data saved (47382 records). [2025-10-02T18:11:09.765523] [INFO ] [MAIN ] COR: Full history saved. [2025-10-02T18:11:09.765606] [INFO ] [MAIN ] Update Progress: 513/2370 symbols completed. COR took 41.3s. Estimated remaining: 4h 17m 22s. Rate: 7.2 symbols/min [2025-10-02T18:11:09.877367] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2024-12. [2025-10-02T18:11:09.955096] [INFO ] [MAIN ] CPAY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:11:09.987158] [DEBUG] [LOCAL ] CPAY: Loaded 30628 existing records from primary storage. [2025-10-02T18:11:09.987463] [INFO ] [MAIN ] CPAY: Loaded 30628 existing records. [2025-10-02T18:11:10.185860] [WARN ] [MAIN ] CPAY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:11:10.186120] [INFO ] [MAIN ] CPAY: Wiping existing primary data before full refresh. [2025-10-02T18:11:10.186171] [INFO ] [LOCAL ] CPAY: Starting deletion of primary data. [2025-10-02T18:11:10.187201] [DEBUG] [LOCAL ] CPAY: Deleted primary data file. [2025-10-02T18:11:10.187265] [INFO ] [MAIN ] CPAY: Starting full primary refresh. [2025-10-02T18:11:10.522803] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-02T18:11:10.612522] [INFO ] [REMOTE ] CPAY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:11:10.673029] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-02. [2025-10-02T18:11:10.902024] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-02T18:11:11.473035] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-05. [2025-10-02T18:11:11.949038] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-02T18:11:12.273008] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-03. [2025-10-02T18:11:13.073009] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-01. [2025-10-02T18:11:13.360772] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-01 (0.29 seconds). [2025-10-02T18:11:13.364164] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-02T18:11:13.750579] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-02T18:11:13.873015] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-04. [2025-10-02T18:11:14.673018] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2024-12. [2025-10-02T18:11:15.238812] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-02T18:11:15.473005] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-02. [2025-10-02T18:11:15.856153] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-02T18:11:16.197376] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-02T18:11:16.273037] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-06. [2025-10-02T18:11:17.073024] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-05. [2025-10-02T18:11:17.873032] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-01. [2025-10-02T18:11:18.062974] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-02T18:11:18.203614] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-02T18:11:18.673011] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-06. [2025-10-02T18:11:19.248810] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-02T18:11:19.472964] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-02. [2025-10-02T18:11:19.556680] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-02T18:11:20.273019] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-03. [2025-10-02T18:11:20.642101] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-02T18:11:20.888685] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-02T18:11:21.073054] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-04. [2025-10-02T18:11:21.435022] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-02T18:11:21.872995] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-05. [2025-10-02T18:11:22.243544] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-02T18:11:22.673023] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-06. [2025-10-02T18:11:23.053111] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-02T18:11:23.473001] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-07. [2025-10-02T18:11:23.901789] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-02T18:11:24.273036] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-08. [2025-10-02T18:11:24.613033] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-02T18:11:25.072998] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-07. [2025-10-02T18:11:25.873009] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-07. [2025-10-02T18:11:26.310637] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-02T18:11:26.673046] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-03. [2025-10-02T18:11:27.473017] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-09. [2025-10-02T18:11:27.700603] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-02T18:11:27.955636] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-02T18:11:27.957284] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-02T18:11:28.272996] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-08. [2025-10-02T18:11:29.072999] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-10. [2025-10-02T18:11:29.532508] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-02T18:11:29.533450] [INFO ] [REMOTE ] CPAC: Full fetch complete (1875 records). [2025-10-02T18:11:29.533525] [DEBUG] [VALIDATOR ] CPAC: Validating primary data. [2025-10-02T18:11:29.737406] [WARN ] [VALIDATOR ] CPAC: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-02T18:11:29.737833] [FATAL] [MAIN ] CPAC: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:11:29.738102] [WARN ] [MAIN ] CPAC: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:11:29.738211] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-02T18:11:29.738451] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-02T18:11:29.738564] [INFO ] [LOCAL ] CPAC: Starting deletion of derivative data. [2025-10-02T18:11:29.738714] [DEBUG] [LOCAL ] CPAC: No derivative data file found to delete. [2025-10-02T18:11:29.738797] [INFO ] [MAIN ] Update Progress: 514/2370 symbols completed. CPAC took 22.9s. Estimated remaining: 4h 17m 56s. Rate: 7.2 symbols/min [2025-10-02T18:11:29.874607] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-04. [2025-10-02T18:11:29.924074] [INFO ] [MAIN ] CPF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:11:29.960392] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-02T18:11:29.985926] [DEBUG] [LOCAL ] CPF: Loaded 15158 existing records from primary storage. [2025-10-02T18:11:29.986186] [INFO ] [MAIN ] CPF: Loaded 15158 existing records. [2025-10-02T18:11:30.168398] [WARN ] [MAIN ] CPF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:11:30.168664] [INFO ] [MAIN ] CPF: Wiping existing primary data before full refresh. [2025-10-02T18:11:30.168728] [INFO ] [LOCAL ] CPF: Starting deletion of primary data. [2025-10-02T18:11:30.169261] [DEBUG] [LOCAL ] CPF: Deleted primary data file. [2025-10-02T18:11:30.169323] [INFO ] [MAIN ] CPF: Starting full primary refresh. [2025-10-02T18:11:30.554100] [INFO ] [REMOTE ] CPF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:11:30.673002] [INFO ] [REMOTE ] CPF: Fetching primary data for 2024-12. [2025-10-02T18:11:31.409314] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-02T18:11:31.473053] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-09. [2025-10-02T18:11:31.933401] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-02T18:11:32.272996] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-05. [2025-10-02T18:11:33.019521] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-02T18:11:33.072996] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-01. [2025-10-02T18:11:33.730733] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-02T18:11:33.872991] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-06. [2025-10-02T18:11:34.174929] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-02T18:11:34.672973] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-02. [2025-10-02T18:11:35.253315] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-02T18:11:35.271043] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-02T18:11:35.473005] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-08. [2025-10-02T18:11:36.272998] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-03. [2025-10-02T18:11:36.880131] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-02T18:11:36.982315] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-02T18:11:37.072996] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-10. [2025-10-02T18:11:37.872980] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-07. [2025-10-02T18:11:38.636185] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-02T18:11:38.639243] [INFO ] [REMOTE ] CP: Full fetch complete (77128 records). [2025-10-02T18:11:38.639420] [DEBUG] [VALIDATOR ] CP: Validating primary data. [2025-10-02T18:11:38.678172] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-04. [2025-10-02T18:11:39.113220] [DEBUG] [VALIDATOR ] CP: All expected trading days are present. [2025-10-02T18:11:39.113410] [DEBUG] [VALIDATOR ] CP: Primary data validation passed. [2025-10-02T18:11:39.114506] [INFO ] [MAIN ] CP: Fetched primary data is valid. [2025-10-02T18:11:39.114709] [DEBUG] [LOCAL ] CP: Saving primary data. [2025-10-02T18:11:39.116429] [DEBUG] [LOCAL ] CP: Trimmed 77128 records to 53656 (keeping 200 days of data) [2025-10-02T18:11:39.229932] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-02T18:11:39.478797] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-09. [2025-10-02T18:11:39.507205] [DEBUG] [LOCAL ] CP: Primary data saved (53656 records). [2025-10-02T18:11:39.507374] [INFO ] [MAIN ] CP: Full history saved. [2025-10-02T18:11:39.507467] [INFO ] [MAIN ] Update Progress: 515/2370 symbols completed. CP took 41.6s. Estimated remaining: 4h 17m 53s. Rate: 7.2 symbols/min [2025-10-02T18:11:39.693994] [INFO ] [MAIN ] CPK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:11:39.710016] [DEBUG] [LOCAL ] CPK: Loaded 13479 existing records from primary storage. [2025-10-02T18:11:39.710309] [INFO ] [MAIN ] CPK: Loaded 13479 existing records. [2025-10-02T18:11:39.877819] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-02T18:11:39.921736] [WARN ] [MAIN ] CPK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:11:39.922571] [INFO ] [MAIN ] CPK: Wiping existing primary data before full refresh. [2025-10-02T18:11:39.922683] [INFO ] [LOCAL ] CPK: Starting deletion of primary data. [2025-10-02T18:11:39.923306] [DEBUG] [LOCAL ] CPK: Deleted primary data file. [2025-10-02T18:11:39.923370] [INFO ] [MAIN ] CPK: Starting full primary refresh. [2025-10-02T18:11:40.278703] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-05. [2025-10-02T18:11:40.323436] [INFO ] [REMOTE ] CPK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:11:40.869684] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-02T18:11:41.072987] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-08. [2025-10-02T18:11:41.209981] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-02T18:11:41.873041] [INFO ] [REMOTE ] CPK: Fetching primary data for 2024-12. [2025-10-02T18:11:42.440448] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-02T18:11:42.673050] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-06. [2025-10-02T18:11:42.846323] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-02T18:11:43.473002] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-01. [2025-10-02T18:11:43.701325] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-02T18:11:44.193907] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-02T18:11:44.273054] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-07. [2025-10-02T18:11:45.073020] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-10. [2025-10-02T18:11:45.250838] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-02T18:11:45.872999] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-08. [2025-10-02T18:11:46.072450] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-02T18:11:46.073679] [INFO ] [REMOTE ] CPA: Full fetch complete (41573 records). [2025-10-02T18:11:46.073772] [DEBUG] [VALIDATOR ] CPA: Validating primary data. [2025-10-02T18:11:46.074296] [FATAL] [VALIDATOR ] CPA: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:11:46.074419] [FATAL] [MAIN ] CPA: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:11:46.074509] [WARN ] [MAIN ] CPA: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:11:46.074599] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-10-02T18:11:46.074724] [DEBUG] [LOCAL ] CPA: No primary data file found to delete. [2025-10-02T18:11:46.074784] [INFO ] [LOCAL ] CPA: Starting deletion of derivative data. [2025-10-02T18:11:46.074830] [DEBUG] [LOCAL ] CPA: No derivative data file found to delete. [2025-10-02T18:11:46.074888] [INFO ] [MAIN ] Update Progress: 516/2370 symbols completed. CPA took 40.6s. Estimated remaining: 4h 17m 38s. Rate: 7.2 symbols/min [2025-10-02T18:11:46.260343] [INFO ] [MAIN ] CPNG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:11:46.316296] [DEBUG] [LOCAL ] CPNG: Loaded 53671 existing records from primary storage. [2025-10-02T18:11:46.316785] [INFO ] [MAIN ] CPNG: Loaded 53671 existing records. [2025-10-02T18:11:46.522310] [WARN ] [MAIN ] CPNG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:11:46.522539] [INFO ] [MAIN ] CPNG: Wiping existing primary data before full refresh. [2025-10-02T18:11:46.522591] [INFO ] [LOCAL ] CPNG: Starting deletion of primary data. [2025-10-02T18:11:46.524448] [DEBUG] [LOCAL ] CPNG: Deleted primary data file. [2025-10-02T18:11:46.524637] [INFO ] [MAIN ] CPNG: Starting full primary refresh. [2025-10-02T18:11:46.678120] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-09. [2025-10-02T18:11:46.959048] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-02T18:11:46.965537] [INFO ] [REMOTE ] CPNG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:11:47.473012] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-02. [2025-10-02T18:11:47.963740] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-02T18:11:48.272979] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-09. [2025-10-02T18:11:48.341793] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-02T18:11:48.992544] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-02T18:11:49.072999] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-10. [2025-10-02T18:11:49.873021] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-10. [2025-10-02T18:11:50.239100] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-02T18:11:50.240837] [INFO ] [REMOTE ] CPAY: Full fetch complete (45030 records). [2025-10-02T18:11:50.240940] [DEBUG] [VALIDATOR ] CPAY: Validating primary data. [2025-10-02T18:11:50.665070] [DEBUG] [VALIDATOR ] CPAY: All expected trading days are present. [2025-10-02T18:11:50.665182] [DEBUG] [VALIDATOR ] CPAY: Primary data validation passed. [2025-10-02T18:11:50.665788] [INFO ] [MAIN ] CPAY: Fetched primary data is valid. [2025-10-02T18:11:50.665853] [DEBUG] [LOCAL ] CPAY: Saving primary data. [2025-10-02T18:11:50.667076] [DEBUG] [LOCAL ] CPAY: Trimmed 45030 records to 30849 (keeping 200 days of data) [2025-10-02T18:11:50.724603] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-03. [2025-10-02T18:11:50.766907] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-02T18:11:50.769307] [INFO ] [REMOTE ] CPF: Full fetch complete (24135 records). [2025-10-02T18:11:50.771393] [DEBUG] [VALIDATOR ] CPF: Validating primary data. [2025-10-02T18:11:51.251632] [DEBUG] [VALIDATOR ] CPF: All expected trading days are present. [2025-10-02T18:11:51.257330] [DEBUG] [VALIDATOR ] CPF: Primary data validation passed. [2025-10-02T18:11:51.258059] [INFO ] [MAIN ] CPF: Fetched primary data is valid. [2025-10-02T18:11:51.258192] [DEBUG] [LOCAL ] CPF: Saving primary data. [2025-10-02T18:11:51.279440] [DEBUG] [LOCAL ] CPF: Trimmed 24135 records to 15271 (keeping 200 days of data) [2025-10-02T18:11:51.373891] [DEBUG] [LOCAL ] CPAY: Primary data saved (30849 records). [2025-10-02T18:11:51.375542] [INFO ] [MAIN ] CPAY: Full history saved. [2025-10-02T18:11:51.376237] [INFO ] [MAIN ] Update Progress: 517/2370 symbols completed. CPAY took 41.6s. Estimated remaining: 4h 17m 19s. Rate: 7.2 symbols/min [2025-10-02T18:11:51.401257] [DEBUG] [LOCAL ] CPF: Primary data saved (15271 records). [2025-10-02T18:11:51.401454] [INFO ] [MAIN ] CPF: Full history saved. [2025-10-02T18:11:51.401570] [INFO ] [MAIN ] Update Progress: 518/2370 symbols completed. CPF took 21.7s. Estimated remaining: 4h 16m 41s. Rate: 7.2 symbols/min [2025-10-02T18:11:51.472990] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2024-12. [2025-10-02T18:11:51.615096] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-02T18:11:52.273020] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-04. [2025-10-02T18:11:53.428615] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-02T18:11:53.433340] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-05. [2025-10-02T18:11:53.620543] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-02T18:11:53.872998] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-01. [2025-10-02T18:11:54.506245] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-02T18:11:54.673048] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-06. [2025-10-02T18:11:55.662355] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-02T18:11:55.665987] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-07. [2025-10-02T18:11:55.975889] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-02T18:11:56.273008] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-02. [2025-10-02T18:11:56.419428] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-02T18:11:57.073004] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-08. [2025-10-02T18:11:57.583549] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-02T18:11:57.873011] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-09. [2025-10-02T18:11:58.270558] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-02T18:11:58.673077] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-03. [2025-10-02T18:11:58.793877] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-02T18:11:59.473071] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-10. [2025-10-02T18:12:01.218850] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-03 (2.55 seconds). [2025-10-02T18:12:01.230759] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-04. [2025-10-02T18:12:01.419784] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-02T18:12:01.421210] [INFO ] [REMOTE ] CPK: Full fetch complete (17874 records). [2025-10-02T18:12:01.421316] [DEBUG] [VALIDATOR ] CPK: Validating primary data. [2025-10-02T18:12:01.846617] [DEBUG] [VALIDATOR ] CPK: All expected trading days are present. [2025-10-02T18:12:01.846745] [DEBUG] [VALIDATOR ] CPK: Primary data validation passed. [2025-10-02T18:12:01.847159] [INFO ] [MAIN ] CPK: Fetched primary data is valid. [2025-10-02T18:12:01.847204] [DEBUG] [LOCAL ] CPK: Saving primary data. [2025-10-02T18:12:01.848038] [DEBUG] [LOCAL ] CPK: Trimmed 17874 records to 13609 (keeping 200 days of data) [2025-10-02T18:12:01.951210] [DEBUG] [LOCAL ] CPK: Primary data saved (13609 records). [2025-10-02T18:12:01.951371] [INFO ] [MAIN ] CPK: Full history saved. [2025-10-02T18:12:01.951513] [INFO ] [MAIN ] Update Progress: 519/2370 symbols completed. CPK took 22.4s. Estimated remaining: 4h 16m 41s. Rate: 7.2 symbols/min [2025-10-02T18:12:03.468056] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-02T18:12:03.480036] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-05. [2025-10-02T18:12:05.982072] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-10-02T18:12:05.993589] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-06. [2025-10-02T18:12:08.104984] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-02T18:12:08.118149] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-07. [2025-10-02T18:12:12.806351] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-07 (4.69 seconds). [2025-10-02T18:12:12.818669] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-08. [2025-10-02T18:12:14.399470] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-02T18:12:14.414948] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-09. [2025-10-02T18:12:16.806170] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-10-02T18:12:16.819401] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-10. [2025-10-02T18:12:19.079262] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-10 (2.26 seconds). [2025-10-02T18:12:19.081419] [INFO ] [REMOTE ] CPNG: Full fetch complete (77674 records). [2025-10-02T18:12:19.081525] [DEBUG] [VALIDATOR ] CPNG: Validating primary data. [2025-10-02T18:12:19.511791] [DEBUG] [VALIDATOR ] CPNG: All expected trading days are present. [2025-10-02T18:12:19.511888] [DEBUG] [VALIDATOR ] CPNG: Primary data validation passed. [2025-10-02T18:12:19.512866] [INFO ] [MAIN ] CPNG: Fetched primary data is valid. [2025-10-02T18:12:19.512936] [DEBUG] [LOCAL ] CPNG: Saving primary data. [2025-10-02T18:12:19.514589] [DEBUG] [LOCAL ] CPNG: Trimmed 77674 records to 54061 (keeping 200 days of data) [2025-10-02T18:12:19.853379] [DEBUG] [LOCAL ] CPNG: Primary data saved (54061 records). [2025-10-02T18:12:19.853528] [INFO ] [MAIN ] CPNG: Full history saved. [2025-10-02T18:12:19.853671] [INFO ] [MAIN ] Update Progress: 520/2370 symbols completed. CPNG took 33.8s. Estimated remaining: 4h 17m 6s. Rate: 7.2 symbols/min [2025-10-02T18:12:20.434305] [INFO ] [MAIN ] CPS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:12:20.608937] [INFO ] [MAIN ] CQP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:12:20.571012] [INFO ] [MAIN ] CPT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:12:20.685931] [INFO ] [MAIN ] CPRI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:12:20.719989] [DEBUG] [LOCAL ] CQP: Loaded 19493 existing records from primary storage. [2025-10-02T18:12:20.721540] [INFO ] [MAIN ] CQP: Loaded 19493 existing records. [2025-10-02T18:12:20.721326] [DEBUG] [LOCAL ] CPS: Loaded 25887 existing records from primary storage. [2025-10-02T18:12:20.745949] [INFO ] [MAIN ] CPS: Loaded 25887 existing records. [2025-10-02T18:12:21.013889] [DEBUG] [LOCAL ] CPT: Loaded 44368 existing records from primary storage. [2025-10-02T18:12:21.111749] [INFO ] [MAIN ] CPT: Loaded 44368 existing records. [2025-10-02T18:12:21.123225] [WARN ] [MAIN ] CQP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:12:21.159779] [INFO ] [MAIN ] CQP: Wiping existing primary data before full refresh. [2025-10-02T18:12:21.199367] [INFO ] [LOCAL ] CQP: Starting deletion of primary data. [2025-10-02T18:12:21.244436] [DEBUG] [LOCAL ] CQP: Deleted primary data file. [2025-10-02T18:12:21.250251] [INFO ] [MAIN ] CQP: Starting full primary refresh. [2025-10-02T18:12:21.292757] [DEBUG] [LOCAL ] CPRI: Loaded 52548 existing records from primary storage. [2025-10-02T18:12:21.280358] [WARN ] [MAIN ] CPS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:12:21.340953] [INFO ] [MAIN ] CPRI: Loaded 52548 existing records. [2025-10-02T18:12:21.356438] [INFO ] [MAIN ] CPS: Wiping existing primary data before full refresh. [2025-10-02T18:12:21.429216] [INFO ] [LOCAL ] CPS: Starting deletion of primary data. [2025-10-02T18:12:21.525504] [DEBUG] [LOCAL ] CPS: Deleted primary data file. [2025-10-02T18:12:21.612792] [INFO ] [MAIN ] CPS: Starting full primary refresh. [2025-10-02T18:12:21.964729] [WARN ] [MAIN ] CPT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:12:22.000552] [INFO ] [MAIN ] CPT: Wiping existing primary data before full refresh. [2025-10-02T18:12:22.020559] [INFO ] [LOCAL ] CPT: Starting deletion of primary data. [2025-10-02T18:12:22.094370] [DEBUG] [LOCAL ] CPT: Deleted primary data file. [2025-10-02T18:12:22.061677] [WARN ] [MAIN ] CPRI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:12:22.130029] [INFO ] [MAIN ] CPT: Starting full primary refresh. [2025-10-02T18:12:22.124521] [INFO ] [MAIN ] CPRI: Wiping existing primary data before full refresh. [2025-10-02T18:12:22.215438] [INFO ] [LOCAL ] CPRI: Starting deletion of primary data. [2025-10-02T18:12:22.366818] [INFO ] [REMOTE ] CQP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:12:22.360698] [DEBUG] [LOCAL ] CPRI: Deleted primary data file. [2025-10-02T18:12:22.382809] [INFO ] [MAIN ] CPRI: Starting full primary refresh. [2025-10-02T18:12:22.392321] [INFO ] [REMOTE ] CQP: Fetching primary data for 2024-12. [2025-10-02T18:12:22.886016] [INFO ] [REMOTE ] CPS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:12:22.916015] [INFO ] [REMOTE ] CPS: Fetching primary data for 2024-12. [2025-10-02T18:12:23.305782] [INFO ] [REMOTE ] CPT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:12:23.341518] [INFO ] [REMOTE ] CPT: Fetching primary data for 2024-12. [2025-10-02T18:12:23.364341] [INFO ] [REMOTE ] CPRI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:12:23.365424] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2024-12. [2025-10-02T18:12:23.706173] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-02T18:12:23.711012] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-01. [2025-10-02T18:12:24.137799] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-02T18:12:24.142352] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-01. [2025-10-02T18:12:24.654234] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-02T18:12:24.662895] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-01. [2025-10-02T18:12:24.805302] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-02T18:12:24.812150] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-02. [2025-10-02T18:12:24.851185] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-02T18:12:24.864332] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-01. [2025-10-02T18:12:24.880054] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-02T18:12:24.885410] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-02. [2025-10-02T18:12:25.657748] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-02T18:12:25.663614] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-03. [2025-10-02T18:12:25.915522] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-02T18:12:25.925776] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-02. [2025-10-02T18:12:25.957514] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-02T18:12:25.963687] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-03. [2025-10-02T18:12:26.191271] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-02T18:12:26.202299] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-02. [2025-10-02T18:12:26.945304] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-02T18:12:26.951754] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-04. [2025-10-02T18:12:26.999066] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-02T18:12:27.003978] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-04. [2025-10-02T18:12:27.147435] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-02T18:12:27.156805] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-03. [2025-10-02T18:12:27.493013] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-02T18:12:27.503707] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-03. [2025-10-02T18:12:27.641478] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-02T18:12:27.646835] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-05. [2025-10-02T18:12:28.163967] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-02T18:12:28.171571] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-05. [2025-10-02T18:12:28.447814] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-02T18:12:28.458222] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-04. [2025-10-02T18:12:29.032538] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-02T18:12:29.038440] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-06. [2025-10-02T18:12:29.204106] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-02T18:12:29.215502] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-04. [2025-10-02T18:12:29.391395] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-02T18:12:29.398799] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-06. [2025-10-02T18:12:29.917810] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-02T18:12:29.924042] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-07. [2025-10-02T18:12:30.318127] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-02T18:12:30.329467] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-05. [2025-10-02T18:12:30.434810] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-02T18:12:30.440249] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-07. [2025-10-02T18:12:30.864845] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-02T18:12:30.876698] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-05. [2025-10-02T18:12:31.052135] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-02T18:12:31.057925] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-08. [2025-10-02T18:12:31.252015] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-02T18:12:31.257685] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-08. [2025-10-02T18:12:31.534376] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-02T18:12:31.544181] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-06. [2025-10-02T18:12:32.211756] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-02T18:12:32.216150] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-09. [2025-10-02T18:12:32.309102] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-02T18:12:32.317162] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-09. [2025-10-02T18:12:32.621160] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-02T18:12:32.632836] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-06. [2025-10-02T18:12:33.003717] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-02T18:12:33.011208] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-02T18:12:33.073008] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-07. [2025-10-02T18:12:33.160833] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-02T18:12:33.872997] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-10. [2025-10-02T18:12:34.291084] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-02T18:12:34.673014] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-07. [2025-10-02T18:12:34.684710] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-02T18:12:34.685995] [INFO ] [REMOTE ] CPS: Full fetch complete (36305 records). [2025-10-02T18:12:34.686077] [DEBUG] [VALIDATOR ] CPS: Validating primary data. [2025-10-02T18:12:34.938971] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-02T18:12:35.167534] [DEBUG] [VALIDATOR ] CPS: All expected trading days are present. [2025-10-02T18:12:35.167623] [DEBUG] [VALIDATOR ] CPS: Primary data validation passed. [2025-10-02T18:12:35.168210] [INFO ] [MAIN ] CPS: Fetched primary data is valid. [2025-10-02T18:12:35.168274] [DEBUG] [LOCAL ] CPS: Saving primary data. [2025-10-02T18:12:35.169172] [DEBUG] [LOCAL ] CPS: Trimmed 36305 records to 26039 (keeping 200 days of data) [2025-10-02T18:12:35.326360] [DEBUG] [LOCAL ] CPS: Primary data saved (26039 records). [2025-10-02T18:12:35.326528] [INFO ] [MAIN ] CPS: Full history saved. [2025-10-02T18:12:35.326640] [INFO ] [MAIN ] Update Progress: 521/2370 symbols completed. CPS took 15.5s. Estimated remaining: 4h 17m 23s. Rate: 7.2 symbols/min [2025-10-02T18:12:35.482527] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-10. [2025-10-02T18:12:35.517824] [INFO ] [MAIN ] CR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:12:35.547469] [DEBUG] [LOCAL ] CR: Loaded 24428 existing records from primary storage. [2025-10-02T18:12:35.547860] [INFO ] [MAIN ] CR: Loaded 24428 existing records. [2025-10-02T18:12:35.787835] [WARN ] [MAIN ] CR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:12:35.788069] [INFO ] [MAIN ] CR: Wiping existing primary data before full refresh. [2025-10-02T18:12:35.788128] [INFO ] [LOCAL ] CR: Starting deletion of primary data. [2025-10-02T18:12:35.789191] [DEBUG] [LOCAL ] CR: Deleted primary data file. [2025-10-02T18:12:35.789259] [INFO ] [MAIN ] CR: Starting full primary refresh. [2025-10-02T18:12:36.170445] [INFO ] [REMOTE ] CR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:12:36.272990] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-08. [2025-10-02T18:12:36.291487] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-02T18:12:36.292575] [INFO ] [REMOTE ] CQP: Full fetch complete (30640 records). [2025-10-02T18:12:36.292673] [DEBUG] [VALIDATOR ] CQP: Validating primary data. [2025-10-02T18:12:36.651630] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-02T18:12:36.749705] [DEBUG] [VALIDATOR ] CQP: All expected trading days are present. [2025-10-02T18:12:36.749805] [DEBUG] [VALIDATOR ] CQP: Primary data validation passed. [2025-10-02T18:12:36.750269] [INFO ] [MAIN ] CQP: Fetched primary data is valid. [2025-10-02T18:12:36.750366] [DEBUG] [LOCAL ] CQP: Saving primary data. [2025-10-02T18:12:36.751288] [DEBUG] [LOCAL ] CQP: Trimmed 30640 records to 19574 (keeping 200 days of data) [2025-10-02T18:12:36.874914] [DEBUG] [LOCAL ] CQP: Primary data saved (19574 records). [2025-10-02T18:12:36.875073] [INFO ] [MAIN ] CQP: Full history saved. [2025-10-02T18:12:36.875161] [INFO ] [MAIN ] Update Progress: 522/2370 symbols completed. CQP took 17.0s. Estimated remaining: 4h 16m 51s. Rate: 7.2 symbols/min [2025-10-02T18:12:37.062463] [INFO ] [MAIN ] CRBD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:12:37.062623] [DEBUG] [LOCAL ] CRBD: No existing data file found in primary storage. [2025-10-02T18:12:37.062693] [WARN ] [MAIN ] CRBD: No existing data found, performing full refresh instead. [2025-10-02T18:12:37.062810] [INFO ] [MAIN ] CRBD: Wiping existing primary data before full refresh. [2025-10-02T18:12:37.062853] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-10-02T18:12:37.062896] [DEBUG] [LOCAL ] CRBD: No primary data file found to delete. [2025-10-02T18:12:37.062929] [INFO ] [MAIN ] CRBD: Starting full primary refresh. [2025-10-02T18:12:37.078134] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-08. [2025-10-02T18:12:37.461180] [INFO ] [REMOTE ] CRBD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:12:37.872977] [INFO ] [REMOTE ] CR: Fetching primary data for 2024-12. [2025-10-02T18:12:38.064444] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-02T18:12:38.672981] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2024-12. [2025-10-02T18:12:38.776127] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-02T18:12:39.019372] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-02T18:12:39.472969] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-09. [2025-10-02T18:12:39.563108] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-02T18:12:40.273001] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-01. [2025-10-02T18:12:41.055012] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-02T18:12:41.077599] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-01. [2025-10-02T18:12:41.092232] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-02T18:12:41.872994] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-02. [2025-10-02T18:12:42.164939] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-02T18:12:42.439895] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-02T18:12:42.672945] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-10. [2025-10-02T18:12:43.473027] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-03. [2025-10-02T18:12:44.140631] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-02T18:12:44.142735] [INFO ] [REMOTE ] CPRI: Full fetch complete (76149 records). [2025-10-02T18:12:44.142843] [DEBUG] [VALIDATOR ] CPRI: Validating primary data. [2025-10-02T18:12:44.286436] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-02. [2025-10-02T18:12:44.335254] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-02T18:12:44.640201] [DEBUG] [VALIDATOR ] CPRI: All expected trading days are present. [2025-10-02T18:12:44.640293] [DEBUG] [VALIDATOR ] CPRI: Primary data validation passed. [2025-10-02T18:12:44.641207] [INFO ] [MAIN ] CPRI: Fetched primary data is valid. [2025-10-02T18:12:44.641315] [DEBUG] [LOCAL ] CPRI: Saving primary data. [2025-10-02T18:12:44.643406] [DEBUG] [LOCAL ] CPRI: Trimmed 76149 records to 52920 (keeping 200 days of data) [2025-10-02T18:12:44.963461] [DEBUG] [LOCAL ] CPRI: Primary data saved (52920 records). [2025-10-02T18:12:44.963612] [INFO ] [MAIN ] CPRI: Full history saved. [2025-10-02T18:12:44.963845] [INFO ] [MAIN ] Update Progress: 523/2370 symbols completed. CPRI took 25.1s. Estimated remaining: 4h 16m 42s. Rate: 7.2 symbols/min [2025-10-02T18:12:45.078079] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-04. [2025-10-02T18:12:45.166123] [INFO ] [MAIN ] CRBG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:12:45.230812] [DEBUG] [LOCAL ] CRBG: Loaded 52361 existing records from primary storage. [2025-10-02T18:12:45.231236] [INFO ] [MAIN ] CRBG: Loaded 52361 existing records. [2025-10-02T18:12:45.441569] [WARN ] [MAIN ] CRBG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:12:45.442052] [INFO ] [MAIN ] CRBG: Wiping existing primary data before full refresh. [2025-10-02T18:12:45.442174] [INFO ] [LOCAL ] CRBG: Starting deletion of primary data. [2025-10-02T18:12:45.443970] [DEBUG] [LOCAL ] CRBG: Deleted primary data file. [2025-10-02T18:12:45.444047] [INFO ] [MAIN ] CRBG: Starting full primary refresh. [2025-10-02T18:12:45.631385] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-02T18:12:45.866579] [INFO ] [REMOTE ] CRBG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:12:45.872975] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2024-12. [2025-10-02T18:12:45.926060] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-02T18:12:46.673054] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-09. [2025-10-02T18:12:47.473081] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-03. [2025-10-02T18:12:47.759375] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-02T18:12:48.120096] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-02T18:12:48.278106] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-01. [2025-10-02T18:12:48.289198] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-02T18:12:49.073013] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-10. [2025-10-02T18:12:49.872979] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-05. [2025-10-02T18:12:50.075248] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-02T18:12:50.453618] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-02T18:12:50.459098] [INFO ] [REMOTE ] CPT: Full fetch complete (63930 records). [2025-10-02T18:12:50.459275] [DEBUG] [VALIDATOR ] CPT: Validating primary data. [2025-10-02T18:12:50.675102] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-04. [2025-10-02T18:12:50.914246] [DEBUG] [VALIDATOR ] CPT: All expected trading days are present. [2025-10-02T18:12:50.914346] [DEBUG] [VALIDATOR ] CPT: Primary data validation passed. [2025-10-02T18:12:50.915117] [INFO ] [MAIN ] CPT: Fetched primary data is valid. [2025-10-02T18:12:50.915182] [DEBUG] [LOCAL ] CPT: Saving primary data. [2025-10-02T18:12:50.916717] [DEBUG] [LOCAL ] CPT: Trimmed 63930 records to 44684 (keeping 200 days of data) [2025-10-02T18:12:51.026288] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-02T18:12:51.262149] [DEBUG] [LOCAL ] CPT: Primary data saved (44684 records). [2025-10-02T18:12:51.262312] [INFO ] [MAIN ] CPT: Full history saved. [2025-10-02T18:12:51.262716] [INFO ] [MAIN ] Update Progress: 524/2370 symbols completed. CPT took 31.4s. Estimated remaining: 4h 16m 26s. Rate: 7.2 symbols/min [2025-10-02T18:12:51.467568] [INFO ] [MAIN ] CRC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:12:51.473034] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-06. [2025-10-02T18:12:51.523068] [DEBUG] [LOCAL ] CRC: Loaded 44050 existing records from primary storage. [2025-10-02T18:12:51.523534] [INFO ] [MAIN ] CRC: Loaded 44050 existing records. [2025-10-02T18:12:51.806362] [WARN ] [MAIN ] CRC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:12:51.808071] [INFO ] [MAIN ] CRC: Wiping existing primary data before full refresh. [2025-10-02T18:12:51.808196] [INFO ] [LOCAL ] CRC: Starting deletion of primary data. [2025-10-02T18:12:51.809750] [DEBUG] [LOCAL ] CRC: Deleted primary data file. [2025-10-02T18:12:51.809837] [INFO ] [MAIN ] CRC: Starting full primary refresh. [2025-10-02T18:12:52.277512] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-02. [2025-10-02T18:12:52.299864] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-02T18:12:52.409154] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-02T18:12:52.433367] [INFO ] [REMOTE ] CRC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:12:53.073000] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-05. [2025-10-02T18:12:53.851801] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-02T18:12:53.874705] [INFO ] [REMOTE ] CRC: Fetching primary data for 2024-12. [2025-10-02T18:12:53.878566] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-02T18:12:54.673049] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-07. [2025-10-02T18:12:55.095100] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-02T18:12:55.473004] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-01. [2025-10-02T18:12:55.542682] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-02T18:12:56.273003] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-08. [2025-10-02T18:12:56.983549] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-02T18:12:57.041493] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-02T18:12:57.072987] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-09. [2025-10-02T18:12:57.758891] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-02T18:12:57.873016] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-02. [2025-10-02T18:12:58.673029] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-06. [2025-10-02T18:12:59.157439] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-02T18:12:59.473010] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-03. [2025-10-02T18:12:59.622863] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-02T18:13:00.273053] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-07. [2025-10-02T18:13:01.073067] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-10. [2025-10-02T18:13:01.457537] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-02T18:13:01.623281] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-02T18:13:01.731449] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-02T18:13:01.732806] [INFO ] [REMOTE ] CRBD: Full fetch complete (14608 records). [2025-10-02T18:13:01.732889] [DEBUG] [VALIDATOR ] CRBD: Validating primary data. [2025-10-02T18:13:01.886450] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-03. [2025-10-02T18:13:02.162075] [DEBUG] [VALIDATOR ] CRBD: All expected trading days are present. [2025-10-02T18:13:02.162223] [DEBUG] [VALIDATOR ] CRBD: Primary data validation passed. [2025-10-02T18:13:02.162712] [INFO ] [MAIN ] CRBD: Fetched primary data is valid. [2025-10-02T18:13:02.162777] [DEBUG] [LOCAL ] CRBD: Saving primary data. [2025-10-02T18:13:02.163522] [DEBUG] [LOCAL ] CRBD: Trimmed 14608 records to 9065 (keeping 200 days of data) [2025-10-02T18:13:02.226413] [DEBUG] [LOCAL ] CRBD: Primary data saved (9065 records). [2025-10-02T18:13:02.226560] [INFO ] [MAIN ] CRBD: Full history saved. [2025-10-02T18:13:02.226691] [INFO ] [MAIN ] Update Progress: 525/2370 symbols completed. CRBD took 25.4s. Estimated remaining: 4h 16m 27s. Rate: 7.2 symbols/min [2025-10-02T18:13:02.413687] [INFO ] [MAIN ] CRCL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:13:02.413897] [DEBUG] [LOCAL ] CRCL: No existing data file found in primary storage. [2025-10-02T18:13:02.413963] [WARN ] [MAIN ] CRCL: No existing data found, performing full refresh instead. [2025-10-02T18:13:02.414084] [INFO ] [MAIN ] CRCL: Wiping existing primary data before full refresh. [2025-10-02T18:13:02.414128] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-02T18:13:02.414173] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-02T18:13:02.414208] [INFO ] [MAIN ] CRCL: Starting full primary refresh. [2025-10-02T18:13:02.681254] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-08. [2025-10-02T18:13:02.819073] [INFO ] [REMOTE ] CRCL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:13:03.473005] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-04. [2025-10-02T18:13:04.045237] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-02T18:13:04.121832] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-10-02T18:13:04.273033] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-04. [2025-10-02T18:13:04.916958] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-02T18:13:05.073014] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2024-12. [2025-10-02T18:13:05.281971] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T18:13:05.282280] [WARN ] [REMOTE ] CRCL: No data returned for month 2024-12 [2025-10-02T18:13:05.282371] [FATAL] [REMOTE ] CRCL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T18:13:05.282419] [FATAL] [MAIN ] CRCL: Failed to fetch primary data. [2025-10-02T18:13:05.282484] [WARN ] [MAIN ] CRCL: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T18:13:05.282559] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-02T18:13:05.282622] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-02T18:13:05.282708] [INFO ] [LOCAL ] CRCL: Starting deletion of derivative data. [2025-10-02T18:13:05.282773] [DEBUG] [LOCAL ] CRCL: No derivative data file found to delete. [2025-10-02T18:13:05.282840] [INFO ] [MAIN ] Update Progress: 526/2370 symbols completed. CRCL took 3.1s. Estimated remaining: 4h 16m 0s. Rate: 7.2 symbols/min [2025-10-02T18:13:05.474629] [INFO ] [MAIN ] CRGY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:13:05.542789] [DEBUG] [LOCAL ] CRGY: Loaded 52509 existing records from primary storage. [2025-10-02T18:13:05.543229] [INFO ] [MAIN ] CRGY: Loaded 52509 existing records. [2025-10-02T18:13:05.750786] [WARN ] [MAIN ] CRGY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:13:05.751148] [INFO ] [MAIN ] CRGY: Wiping existing primary data before full refresh. [2025-10-02T18:13:05.751268] [INFO ] [LOCAL ] CRGY: Starting deletion of primary data. [2025-10-02T18:13:05.753485] [DEBUG] [LOCAL ] CRGY: Deleted primary data file. [2025-10-02T18:13:05.777706] [INFO ] [MAIN ] CRGY: Starting full primary refresh. [2025-10-02T18:13:05.878152] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-09. [2025-10-02T18:13:05.862057] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-02T18:13:06.231843] [INFO ] [REMOTE ] CRGY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:13:06.673024] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-05. [2025-10-02T18:13:07.049744] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-02T18:13:07.473006] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-05. [2025-10-02T18:13:08.201928] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-02T18:13:08.272971] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-06. [2025-10-02T18:13:09.046002] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-02T18:13:09.072982] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-06. [2025-10-02T18:13:09.873002] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2024-12. [2025-10-02T18:13:10.014384] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-02T18:13:10.573028] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-02T18:13:10.673000] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-07. [2025-10-02T18:13:11.472986] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-07. [2025-10-02T18:13:11.752277] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-02T18:13:12.230847] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-02T18:13:12.272967] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-08. [2025-10-02T18:13:13.073022] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-10. [2025-10-02T18:13:13.134870] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-02T18:13:13.625570] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-02T18:13:13.872989] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-09. [2025-10-02T18:13:14.147559] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-02T18:13:14.148824] [INFO ] [REMOTE ] CR: Full fetch complete (34708 records). [2025-10-02T18:13:14.148928] [DEBUG] [VALIDATOR ] CR: Validating primary data. [2025-10-02T18:13:14.606376] [DEBUG] [VALIDATOR ] CR: All expected trading days are present. [2025-10-02T18:13:14.606575] [DEBUG] [VALIDATOR ] CR: Primary data validation passed. [2025-10-02T18:13:14.607251] [INFO ] [MAIN ] CR: Fetched primary data is valid. [2025-10-02T18:13:14.607353] [DEBUG] [LOCAL ] CR: Saving primary data. [2025-10-02T18:13:14.608797] [DEBUG] [LOCAL ] CR: Trimmed 34708 records to 24566 (keeping 200 days of data) [2025-10-02T18:13:14.678280] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-01. [2025-10-02T18:13:14.786107] [DEBUG] [LOCAL ] CR: Primary data saved (24566 records). [2025-10-02T18:13:14.786265] [INFO ] [MAIN ] CR: Full history saved. [2025-10-02T18:13:14.786375] [INFO ] [MAIN ] Update Progress: 527/2370 symbols completed. CR took 39.5s. Estimated remaining: 4h 15m 56s. Rate: 7.2 symbols/min [2025-10-02T18:13:14.967013] [INFO ] [MAIN ] CRH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:13:15.030171] [DEBUG] [LOCAL ] CRH: Loaded 53462 existing records from primary storage. [2025-10-02T18:13:15.030510] [INFO ] [MAIN ] CRH: Loaded 53462 existing records. [2025-10-02T18:13:15.236813] [WARN ] [MAIN ] CRH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:13:15.237109] [INFO ] [MAIN ] CRH: Wiping existing primary data before full refresh. [2025-10-02T18:13:15.237164] [INFO ] [LOCAL ] CRH: Starting deletion of primary data. [2025-10-02T18:13:15.239086] [DEBUG] [LOCAL ] CRH: Deleted primary data file. [2025-10-02T18:13:15.239150] [INFO ] [MAIN ] CRH: Starting full primary refresh. [2025-10-02T18:13:15.477814] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-08. [2025-10-02T18:13:15.648139] [INFO ] [REMOTE ] CRH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:13:15.674391] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-02T18:13:16.272974] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-10. [2025-10-02T18:13:16.382752] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-02T18:13:17.073047] [INFO ] [REMOTE ] CRH: Fetching primary data for 2024-12. [2025-10-02T18:13:17.383592] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-02T18:13:17.383360] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-02T18:13:17.396311] [INFO ] [REMOTE ] CRC: Full fetch complete (62399 records). [2025-10-02T18:13:17.396569] [DEBUG] [VALIDATOR ] CRC: Validating primary data. [2025-10-02T18:13:17.818542] [DEBUG] [VALIDATOR ] CRC: All expected trading days are present. [2025-10-02T18:13:17.818627] [DEBUG] [VALIDATOR ] CRC: Primary data validation passed. [2025-10-02T18:13:17.819373] [INFO ] [MAIN ] CRC: Fetched primary data is valid. [2025-10-02T18:13:17.819422] [DEBUG] [LOCAL ] CRC: Saving primary data. [2025-10-02T18:13:17.820774] [DEBUG] [LOCAL ] CRC: Trimmed 62399 records to 44370 (keeping 200 days of data) [2025-10-02T18:13:17.875497] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-02. [2025-10-02T18:13:18.100479] [DEBUG] [LOCAL ] CRC: Primary data saved (44370 records). [2025-10-02T18:13:18.100660] [INFO ] [MAIN ] CRC: Full history saved. [2025-10-02T18:13:18.100769] [INFO ] [MAIN ] Update Progress: 528/2370 symbols completed. CRC took 26.8s. Estimated remaining: 4h 15m 30s. Rate: 7.2 symbols/min [2025-10-02T18:13:18.284613] [INFO ] [MAIN ] CRI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:13:18.344011] [DEBUG] [LOCAL ] CRI: Loaded 49912 existing records from primary storage. [2025-10-02T18:13:18.344434] [INFO ] [MAIN ] CRI: Loaded 49912 existing records. [2025-10-02T18:13:18.537638] [WARN ] [MAIN ] CRI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:13:18.538024] [INFO ] [MAIN ] CRI: Wiping existing primary data before full refresh. [2025-10-02T18:13:18.538162] [INFO ] [LOCAL ] CRI: Starting deletion of primary data. [2025-10-02T18:13:18.540575] [DEBUG] [LOCAL ] CRI: Deleted primary data file. [2025-10-02T18:13:18.540668] [INFO ] [MAIN ] CRI: Starting full primary refresh. [2025-10-02T18:13:18.675441] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-09. [2025-10-02T18:13:18.776701] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-02T18:13:18.999035] [INFO ] [REMOTE ] CRI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:13:19.257792] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-02T18:13:19.473060] [INFO ] [REMOTE ] CRI: Fetching primary data for 2024-12. [2025-10-02T18:13:20.272971] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-03. [2025-10-02T18:13:20.434516] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-02T18:13:20.711089] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-02T18:13:21.073003] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-01. [2025-10-02T18:13:21.873032] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-10. [2025-10-02T18:13:22.004184] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-02T18:13:22.601640] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-02T18:13:22.673054] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-02. [2025-10-02T18:13:23.246589] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-02T18:13:23.251192] [INFO ] [REMOTE ] CRBG: Full fetch complete (75703 records). [2025-10-02T18:13:23.251333] [DEBUG] [VALIDATOR ] CRBG: Validating primary data. [2025-10-02T18:13:23.478169] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-01. [2025-10-02T18:13:23.700479] [DEBUG] [VALIDATOR ] CRBG: All expected trading days are present. [2025-10-02T18:13:23.700573] [DEBUG] [VALIDATOR ] CRBG: Primary data validation passed. [2025-10-02T18:13:23.701477] [INFO ] [MAIN ] CRBG: Fetched primary data is valid. [2025-10-02T18:13:23.701549] [DEBUG] [LOCAL ] CRBG: Saving primary data. [2025-10-02T18:13:23.703143] [DEBUG] [LOCAL ] CRBG: Trimmed 75703 records to 52747 (keeping 200 days of data) [2025-10-02T18:13:24.035745] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-02T18:13:24.094662] [DEBUG] [LOCAL ] CRBG: Primary data saved (52747 records). [2025-10-02T18:13:24.094818] [INFO ] [MAIN ] CRBG: Full history saved. [2025-10-02T18:13:24.094903] [INFO ] [MAIN ] Update Progress: 529/2370 symbols completed. CRBG took 39.1s. Estimated remaining: 4h 15m 14s. Rate: 7.2 symbols/min [2025-10-02T18:13:24.279528] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-04. [2025-10-02T18:13:24.283625] [INFO ] [MAIN ] CRK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:13:24.342387] [DEBUG] [LOCAL ] CRK: Loaded 52153 existing records from primary storage. [2025-10-02T18:13:24.342772] [INFO ] [MAIN ] CRK: Loaded 52153 existing records. [2025-10-02T18:13:24.536526] [WARN ] [MAIN ] CRK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:13:24.536802] [INFO ] [MAIN ] CRK: Wiping existing primary data before full refresh. [2025-10-02T18:13:24.536860] [INFO ] [LOCAL ] CRK: Starting deletion of primary data. [2025-10-02T18:13:24.538371] [DEBUG] [LOCAL ] CRK: Deleted primary data file. [2025-10-02T18:13:24.538435] [INFO ] [MAIN ] CRK: Starting full primary refresh. [2025-10-02T18:13:24.941169] [INFO ] [REMOTE ] CRK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:13:25.072996] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-03. [2025-10-02T18:13:25.430454] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-02T18:13:25.873019] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-02. [2025-10-02T18:13:26.031263] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-02T18:13:26.673012] [INFO ] [REMOTE ] CRK: Fetching primary data for 2024-12. [2025-10-02T18:13:26.984547] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-02T18:13:27.274207] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-02T18:13:27.473018] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-05. [2025-10-02T18:13:28.272999] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-03. [2025-10-02T18:13:28.472802] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-02T18:13:28.937547] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-02T18:13:29.073015] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-01. [2025-10-02T18:13:29.873475] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-06. [2025-10-02T18:13:30.137053] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-02T18:13:30.672983] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-04. [2025-10-02T18:13:30.769042] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-02T18:13:31.431477] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-02T18:13:31.472959] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-02. [2025-10-02T18:13:32.273003] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-04. [2025-10-02T18:13:32.533368] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-02T18:13:33.079864] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-07. [2025-10-02T18:13:33.100175] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-02T18:13:33.874690] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-05. [2025-10-02T18:13:33.877690] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-02T18:13:34.672998] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-03. [2025-10-02T18:13:34.881106] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-02T18:13:35.472970] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-08. [2025-10-02T18:13:35.745438] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-02T18:13:36.274553] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-06. [2025-10-02T18:13:36.280723] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-02T18:13:37.046093] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-02T18:13:37.072959] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-04. [2025-10-02T18:13:37.872988] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-05. [2025-10-02T18:13:38.044033] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-02T18:13:38.673038] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-09. [2025-10-02T18:13:38.993800] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-02T18:13:39.216498] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-02T18:13:39.472996] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-05. [2025-10-02T18:13:40.273040] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-07. [2025-10-02T18:13:40.463820] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-02T18:13:41.073075] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-06. [2025-10-02T18:13:41.243194] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-02T18:13:41.873002] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-06. [2025-10-02T18:13:42.189505] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-02T18:13:42.598441] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-02T18:13:42.673007] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-08. [2025-10-02T18:13:43.472980] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-07. [2025-10-02T18:13:43.552368] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-02T18:13:44.235802] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-02T18:13:44.273060] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-10. [2025-10-02T18:13:45.073014] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-09. [2025-10-02T18:13:45.234140] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-02T18:13:45.872979] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-07. [2025-10-02T18:13:45.938629] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-02T18:13:45.941225] [INFO ] [REMOTE ] CRGY: Full fetch complete (75977 records). [2025-10-02T18:13:45.941367] [DEBUG] [VALIDATOR ] CRGY: Validating primary data. [2025-10-02T18:13:46.367237] [DEBUG] [VALIDATOR ] CRGY: All expected trading days are present. [2025-10-02T18:13:46.367332] [DEBUG] [VALIDATOR ] CRGY: Primary data validation passed. [2025-10-02T18:13:46.368317] [INFO ] [MAIN ] CRGY: Fetched primary data is valid. [2025-10-02T18:13:46.368388] [DEBUG] [LOCAL ] CRGY: Saving primary data. [2025-10-02T18:13:46.370166] [DEBUG] [LOCAL ] CRGY: Trimmed 75977 records to 52894 (keeping 200 days of data) [2025-10-02T18:13:46.686718] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-08. [2025-10-02T18:13:46.715179] [DEBUG] [LOCAL ] CRGY: Primary data saved (52894 records). [2025-10-02T18:13:46.715338] [INFO ] [MAIN ] CRGY: Full history saved. [2025-10-02T18:13:46.715427] [INFO ] [MAIN ] Update Progress: 530/2370 symbols completed. CRGY took 41.4s. Estimated remaining: 4h 15m 55s. Rate: 7.2 symbols/min [2025-10-02T18:13:46.917607] [INFO ] [MAIN ] CRL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:13:46.952740] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-02T18:13:47.004262] [DEBUG] [LOCAL ] CRL: Loaded 42959 existing records from primary storage. [2025-10-02T18:13:47.004639] [INFO ] [MAIN ] CRL: Loaded 42959 existing records. [2025-10-02T18:13:47.199269] [WARN ] [MAIN ] CRL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:13:47.199611] [INFO ] [MAIN ] CRL: Wiping existing primary data before full refresh. [2025-10-02T18:13:47.199762] [INFO ] [LOCAL ] CRL: Starting deletion of primary data. [2025-10-02T18:13:47.201686] [DEBUG] [LOCAL ] CRL: Deleted primary data file. [2025-10-02T18:13:47.201753] [INFO ] [MAIN ] CRL: Starting full primary refresh. [2025-10-02T18:13:47.475637] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-10. [2025-10-02T18:13:47.611546] [INFO ] [REMOTE ] CRL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:13:47.646320] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-02T18:13:48.273045] [INFO ] [REMOTE ] CRL: Fetching primary data for 2024-12. [2025-10-02T18:13:48.359387] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-02T18:13:49.072980] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-09. [2025-10-02T18:13:49.096441] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-02T18:13:49.098698] [INFO ] [REMOTE ] CRH: Full fetch complete (77299 records). [2025-10-02T18:13:49.098807] [DEBUG] [VALIDATOR ] CRH: Validating primary data. [2025-10-02T18:13:49.535290] [DEBUG] [VALIDATOR ] CRH: All expected trading days are present. [2025-10-02T18:13:49.535479] [DEBUG] [VALIDATOR ] CRH: Primary data validation passed. [2025-10-02T18:13:49.536416] [INFO ] [MAIN ] CRH: Fetched primary data is valid. [2025-10-02T18:13:49.536532] [DEBUG] [LOCAL ] CRH: Saving primary data. [2025-10-02T18:13:49.538512] [DEBUG] [LOCAL ] CRH: Trimmed 77299 records to 53852 (keeping 200 days of data) [2025-10-02T18:13:49.876699] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-08. [2025-10-02T18:13:49.906300] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-02T18:13:49.936535] [DEBUG] [LOCAL ] CRH: Primary data saved (53852 records). [2025-10-02T18:13:49.936721] [INFO ] [MAIN ] CRH: Full history saved. [2025-10-02T18:13:49.938325] [INFO ] [MAIN ] Update Progress: 531/2370 symbols completed. CRH took 35.2s. Estimated remaining: 4h 15m 29s. Rate: 7.2 symbols/min [2025-10-02T18:13:50.128152] [INFO ] [MAIN ] CRM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:13:50.128353] [DEBUG] [LOCAL ] CRM: No existing data file found in primary storage. [2025-10-02T18:13:50.128428] [WARN ] [MAIN ] CRM: No existing data found, performing full refresh instead. [2025-10-02T18:13:50.128547] [INFO ] [MAIN ] CRM: Wiping existing primary data before full refresh. [2025-10-02T18:13:50.128588] [INFO ] [LOCAL ] CRM: Starting deletion of primary data. [2025-10-02T18:13:50.128629] [DEBUG] [LOCAL ] CRM: No primary data file found to delete. [2025-10-02T18:13:50.128699] [INFO ] [MAIN ] CRM: Starting full primary refresh. [2025-10-02T18:13:50.523792] [INFO ] [REMOTE ] CRM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:13:50.673932] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-02T18:13:50.674009] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-01. [2025-10-02T18:13:51.472978] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-10. [2025-10-02T18:13:51.569666] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-02T18:13:52.273033] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-09. [2025-10-02T18:13:52.389710] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-02T18:13:52.613453] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-02T18:13:52.615506] [INFO ] [REMOTE ] CRI: Full fetch complete (70915 records). [2025-10-02T18:13:52.615713] [DEBUG] [VALIDATOR ] CRI: Validating primary data. [2025-10-02T18:13:53.068671] [DEBUG] [VALIDATOR ] CRI: All expected trading days are present. [2025-10-02T18:13:53.068773] [DEBUG] [VALIDATOR ] CRI: Primary data validation passed. [2025-10-02T18:13:53.069613] [INFO ] [MAIN ] CRI: Fetched primary data is valid. [2025-10-02T18:13:53.069695] [DEBUG] [LOCAL ] CRI: Saving primary data. [2025-10-02T18:13:53.071337] [DEBUG] [LOCAL ] CRI: Trimmed 70915 records to 50218 (keeping 200 days of data) [2025-10-02T18:13:53.073002] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-02. [2025-10-02T18:13:53.398699] [DEBUG] [LOCAL ] CRI: Primary data saved (50218 records). [2025-10-02T18:13:53.398858] [INFO ] [MAIN ] CRI: Full history saved. [2025-10-02T18:13:53.398958] [INFO ] [MAIN ] Update Progress: 532/2370 symbols completed. CRI took 35.3s. Estimated remaining: 4h 15m 4s. Rate: 7.2 symbols/min [2025-10-02T18:13:53.581556] [INFO ] [MAIN ] CRS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:13:53.581749] [DEBUG] [LOCAL ] CRS: No existing data file found in primary storage. [2025-10-02T18:13:53.581799] [WARN ] [MAIN ] CRS: No existing data found, performing full refresh instead. [2025-10-02T18:13:53.581950] [INFO ] [MAIN ] CRS: Wiping existing primary data before full refresh. [2025-10-02T18:13:53.582003] [INFO ] [LOCAL ] CRS: Starting deletion of primary data. [2025-10-02T18:13:53.582049] [DEBUG] [LOCAL ] CRS: No primary data file found to delete. [2025-10-02T18:13:53.582139] [INFO ] [MAIN ] CRS: Starting full primary refresh. [2025-10-02T18:13:53.878116] [INFO ] [REMOTE ] CRM: Fetching primary data for 2024-12. [2025-10-02T18:13:53.993821] [INFO ] [REMOTE ] CRS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:13:54.029542] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-02T18:13:54.673046] [INFO ] [REMOTE ] CRS: Fetching primary data for 2024-12. [2025-10-02T18:13:54.814733] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-02T18:13:55.473012] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-03. [2025-10-02T18:13:56.232053] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-02T18:13:56.272966] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-01. [2025-10-02T18:13:56.476162] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2024-12 (2.60 seconds). [2025-10-02T18:13:57.073015] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-01. [2025-10-02T18:13:57.235088] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-02T18:13:57.873022] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-04. [2025-10-02T18:13:57.928947] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-02T18:13:58.672974] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-10. [2025-10-02T18:13:59.165866] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-02T18:13:59.273967] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-02T18:13:59.473048] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-02. [2025-10-02T18:13:59.944676] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-02T18:13:59.946969] [INFO ] [REMOTE ] CRK: Full fetch complete (75595 records). [2025-10-02T18:13:59.947139] [DEBUG] [VALIDATOR ] CRK: Validating primary data. [2025-10-02T18:14:00.280584] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-02. [2025-10-02T18:14:00.450874] [DEBUG] [VALIDATOR ] CRK: All expected trading days are present. [2025-10-02T18:14:00.450989] [DEBUG] [VALIDATOR ] CRK: Primary data validation passed. [2025-10-02T18:14:00.452494] [INFO ] [MAIN ] CRK: Fetched primary data is valid. [2025-10-02T18:14:00.452586] [DEBUG] [LOCAL ] CRK: Saving primary data. [2025-10-02T18:14:00.454325] [DEBUG] [LOCAL ] CRK: Trimmed 75595 records to 52539 (keeping 200 days of data) [2025-10-02T18:14:00.919296] [DEBUG] [LOCAL ] CRK: Primary data saved (52539 records). [2025-10-02T18:14:00.919489] [INFO ] [MAIN ] CRK: Full history saved. [2025-10-02T18:14:00.919591] [INFO ] [MAIN ] Update Progress: 533/2370 symbols completed. CRK took 36.8s. Estimated remaining: 4h 14m 53s. Rate: 7.2 symbols/min [2025-10-02T18:14:01.078220] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-05. [2025-10-02T18:14:01.135901] [INFO ] [MAIN ] CRT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:14:01.143950] [DEBUG] [LOCAL ] CRT: Loaded 4988 existing records from primary storage. [2025-10-02T18:14:01.144799] [INFO ] [MAIN ] CRT: Loaded 4988 existing records. [2025-10-02T18:14:01.403471] [WARN ] [MAIN ] CRT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:14:01.403859] [INFO ] [MAIN ] CRT: Wiping existing primary data before full refresh. [2025-10-02T18:14:01.403929] [INFO ] [LOCAL ] CRT: Starting deletion of primary data. [2025-10-02T18:14:01.404696] [DEBUG] [LOCAL ] CRT: Deleted primary data file. [2025-10-02T18:14:01.404770] [INFO ] [MAIN ] CRT: Starting full primary refresh. [2025-10-02T18:14:01.886933] [INFO ] [REMOTE ] CRT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:14:01.887594] [INFO ] [REMOTE ] CRT: Fetching primary data for 2024-12. [2025-10-02T18:14:01.920391] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-02 (2.45 seconds). [2025-10-02T18:14:02.090281] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-02T18:14:02.365184] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-02T18:14:02.433466] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-02T18:14:02.673009] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-03. [2025-10-02T18:14:03.473017] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-03. [2025-10-02T18:14:04.273032] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-01. [2025-10-02T18:14:04.394712] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-02T18:14:04.925143] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-02T18:14:05.073058] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-02. [2025-10-02T18:14:05.856523] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-02T18:14:05.859084] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-10-02T18:14:05.873020] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-04. [2025-10-02T18:14:06.673040] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-03. [2025-10-02T18:14:07.304527] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-02T18:14:07.473026] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-04. [2025-10-02T18:14:08.073681] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-02T18:14:08.272986] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-05. [2025-10-02T18:14:09.073004] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-04. [2025-10-02T18:14:09.442305] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-02T18:14:09.747389] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-02T18:14:09.873040] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-06. [2025-10-02T18:14:10.297332] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-02T18:14:10.673016] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-05. [2025-10-02T18:14:10.989792] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-02T18:14:11.323906] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-02T18:14:11.473024] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-07. [2025-10-02T18:14:12.273025] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-06. [2025-10-02T18:14:13.072974] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-06. [2025-10-02T18:14:13.112123] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-02T18:14:13.761346] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-02T18:14:13.873020] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-07. [2025-10-02T18:14:14.351259] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-02T18:14:14.476953] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-02T18:14:14.673008] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-08. [2025-10-02T18:14:15.290223] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-02T18:14:15.473020] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-09. [2025-10-02T18:14:16.093027] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-02T18:14:16.272997] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-07. [2025-10-02T18:14:17.073010] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-08. [2025-10-02T18:14:17.873039] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-05. [2025-10-02T18:14:18.489427] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-02T18:14:18.672979] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-09. [2025-10-02T18:14:18.905185] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-07 (2.63 seconds). [2025-10-02T18:14:19.312810] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-02T18:14:19.473005] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-08. [2025-10-02T18:14:20.208901] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-02T18:14:20.273020] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-10. [2025-10-02T18:14:21.072976] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-10. [2025-10-02T18:14:21.096065] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-02T18:14:21.097087] [INFO ] [REMOTE ] CRT: Full fetch complete (7557 records). [2025-10-02T18:14:21.097180] [DEBUG] [VALIDATOR ] CRT: Validating primary data. [2025-10-02T18:14:21.510201] [DEBUG] [VALIDATOR ] CRT: All expected trading days are present. [2025-10-02T18:14:21.510348] [DEBUG] [VALIDATOR ] CRT: Primary data validation passed. [2025-10-02T18:14:21.510590] [INFO ] [MAIN ] CRT: Fetched primary data is valid. [2025-10-02T18:14:21.510663] [DEBUG] [LOCAL ] CRT: Saving primary data. [2025-10-02T18:14:21.511138] [DEBUG] [LOCAL ] CRT: Trimmed 7557 records to 5011 (keeping 200 days of data) [2025-10-02T18:14:21.544387] [DEBUG] [LOCAL ] CRT: Primary data saved (5011 records). [2025-10-02T18:14:21.544525] [INFO ] [MAIN ] CRT: Full history saved. [2025-10-02T18:14:21.544610] [INFO ] [MAIN ] Update Progress: 534/2370 symbols completed. CRT took 20.6s. Estimated remaining: 4h 15m 27s. Rate: 7.2 symbols/min [2025-10-02T18:14:21.740996] [INFO ] [MAIN ] CSAN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:14:21.783561] [DEBUG] [LOCAL ] CSAN: Loaded 42343 existing records from primary storage. [2025-10-02T18:14:21.783967] [INFO ] [MAIN ] CSAN: Loaded 42343 existing records. [2025-10-02T18:14:21.881739] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-06. [2025-10-02T18:14:21.998508] [WARN ] [MAIN ] CSAN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:14:21.998962] [INFO ] [MAIN ] CSAN: Wiping existing primary data before full refresh. [2025-10-02T18:14:21.999029] [INFO ] [LOCAL ] CSAN: Starting deletion of primary data. [2025-10-02T18:14:22.000521] [DEBUG] [LOCAL ] CSAN: Deleted primary data file. [2025-10-02T18:14:22.000601] [INFO ] [MAIN ] CSAN: Starting full primary refresh. [2025-10-02T18:14:22.137722] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-08 (2.66 seconds). [2025-10-02T18:14:22.453026] [INFO ] [REMOTE ] CSAN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:14:22.446902] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-02T18:14:22.456706] [INFO ] [REMOTE ] CRL: Full fetch complete (63022 records). [2025-10-02T18:14:22.456918] [DEBUG] [VALIDATOR ] CRL: Validating primary data. [2025-10-02T18:14:22.673524] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-09. [2025-10-02T18:14:22.890817] [DEBUG] [VALIDATOR ] CRL: All expected trading days are present. [2025-10-02T18:14:22.890905] [DEBUG] [VALIDATOR ] CRL: Primary data validation passed. [2025-10-02T18:14:22.891731] [INFO ] [MAIN ] CRL: Fetched primary data is valid. [2025-10-02T18:14:22.891800] [DEBUG] [LOCAL ] CRL: Saving primary data. [2025-10-02T18:14:22.893204] [DEBUG] [LOCAL ] CRL: Trimmed 63022 records to 43331 (keeping 200 days of data) [2025-10-02T18:14:23.182328] [DEBUG] [LOCAL ] CRL: Primary data saved (43331 records). [2025-10-02T18:14:23.182481] [INFO ] [MAIN ] CRL: Full history saved. [2025-10-02T18:14:23.182672] [INFO ] [MAIN ] Update Progress: 535/2370 symbols completed. CRL took 36.5s. Estimated remaining: 4h 14m 55s. Rate: 7.2 symbols/min [2025-10-02T18:14:23.390170] [INFO ] [MAIN ] CSL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:14:23.420537] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-02T18:14:23.461153] [DEBUG] [LOCAL ] CSL: Loaded 31471 existing records from primary storage. [2025-10-02T18:14:23.461455] [INFO ] [MAIN ] CSL: Loaded 31471 existing records. [2025-10-02T18:14:23.478180] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2024-12. [2025-10-02T18:14:23.668280] [WARN ] [MAIN ] CSL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:14:23.668526] [INFO ] [MAIN ] CSL: Wiping existing primary data before full refresh. [2025-10-02T18:14:23.668584] [INFO ] [LOCAL ] CSL: Starting deletion of primary data. [2025-10-02T18:14:23.669682] [DEBUG] [LOCAL ] CSL: Deleted primary data file. [2025-10-02T18:14:23.669749] [INFO ] [MAIN ] CSL: Starting full primary refresh. [2025-10-02T18:14:24.073094] [INFO ] [REMOTE ] CSL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:14:24.273013] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-07. [2025-10-02T18:14:25.073026] [INFO ] [REMOTE ] CSL: Fetching primary data for 2024-12. [2025-10-02T18:14:25.251702] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-02T18:14:25.292859] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-09 (2.62 seconds). [2025-10-02T18:14:25.873390] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-10. [2025-10-02T18:14:25.876313] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-02T18:14:26.340993] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-02T18:14:26.673021] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-08. [2025-10-02T18:14:27.473067] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-01. [2025-10-02T18:14:28.139084] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-10-02T18:14:28.141206] [INFO ] [REMOTE ] CRM: Full fetch complete (77844 records). [2025-10-02T18:14:28.141338] [DEBUG] [VALIDATOR ] CRM: Validating primary data. [2025-10-02T18:14:28.276123] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-01. [2025-10-02T18:14:28.577220] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-02T18:14:28.644873] [DEBUG] [VALIDATOR ] CRM: All expected trading days are present. [2025-10-02T18:14:28.645149] [DEBUG] [VALIDATOR ] CRM: Primary data validation passed. [2025-10-02T18:14:28.646162] [INFO ] [MAIN ] CRM: Fetched primary data is valid. [2025-10-02T18:14:28.646253] [DEBUG] [LOCAL ] CRM: Saving primary data. [2025-10-02T18:14:28.648255] [DEBUG] [LOCAL ] CRM: Trimmed 77844 records to 54160 (keeping 200 days of data) [2025-10-02T18:14:28.915332] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-02T18:14:29.062443] [DEBUG] [LOCAL ] CRM: Primary data saved (54160 records). [2025-10-02T18:14:29.062603] [INFO ] [MAIN ] CRM: Full history saved. [2025-10-02T18:14:29.062722] [INFO ] [MAIN ] Update Progress: 536/2370 symbols completed. CRM took 39.1s. Estimated remaining: 4h 14m 38s. Rate: 7.2 symbols/min [2025-10-02T18:14:29.078135] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-02. [2025-10-02T18:14:29.256045] [INFO ] [MAIN ] CSR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:14:29.271146] [DEBUG] [LOCAL ] CSR: Loaded 12788 existing records from primary storage. [2025-10-02T18:14:29.271395] [INFO ] [MAIN ] CSR: Loaded 12788 existing records. [2025-10-02T18:14:29.490269] [WARN ] [MAIN ] CSR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:14:29.490801] [INFO ] [MAIN ] CSR: Wiping existing primary data before full refresh. [2025-10-02T18:14:29.491013] [INFO ] [LOCAL ] CSR: Starting deletion of primary data. [2025-10-02T18:14:29.499304] [DEBUG] [LOCAL ] CSR: Deleted primary data file. [2025-10-02T18:14:29.513456] [INFO ] [MAIN ] CSR: Starting full primary refresh. [2025-10-02T18:14:29.550121] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-02T18:14:29.880962] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-02. [2025-10-02T18:14:29.927521] [INFO ] [REMOTE ] CSR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:14:30.196372] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-02T18:14:30.673026] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-03. [2025-10-02T18:14:31.434825] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-02T18:14:31.472980] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-09. [2025-10-02T18:14:31.801063] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-02T18:14:32.273002] [INFO ] [REMOTE ] CSR: Fetching primary data for 2024-12. [2025-10-02T18:14:33.072971] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-04. [2025-10-02T18:14:33.102431] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-02T18:14:33.303081] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-02T18:14:33.872996] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-01. [2025-10-02T18:14:34.576111] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-02T18:14:34.672973] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-05. [2025-10-02T18:14:34.750231] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-02T18:14:35.472996] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-10. [2025-10-02T18:14:35.946022] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-02T18:14:36.273031] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-02. [2025-10-02T18:14:36.768762] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-02T18:14:36.770697] [INFO ] [REMOTE ] CRS: Full fetch complete (62716 records). [2025-10-02T18:14:36.770810] [DEBUG] [VALIDATOR ] CRS: Validating primary data. [2025-10-02T18:14:36.981757] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-02T18:14:37.078084] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-03. [2025-10-02T18:14:37.227413] [DEBUG] [VALIDATOR ] CRS: All expected trading days are present. [2025-10-02T18:14:37.227497] [DEBUG] [VALIDATOR ] CRS: Primary data validation passed. [2025-10-02T18:14:37.228304] [INFO ] [MAIN ] CRS: Fetched primary data is valid. [2025-10-02T18:14:37.228380] [DEBUG] [LOCAL ] CRS: Saving primary data. [2025-10-02T18:14:37.229822] [DEBUG] [LOCAL ] CRS: Trimmed 62716 records to 43533 (keeping 200 days of data) [2025-10-02T18:14:37.524197] [DEBUG] [LOCAL ] CRS: Primary data saved (43533 records). [2025-10-02T18:14:37.524330] [INFO ] [MAIN ] CRS: Full history saved. [2025-10-02T18:14:37.524407] [INFO ] [MAIN ] Update Progress: 537/2370 symbols completed. CRS took 44.1s. Estimated remaining: 4h 14m 31s. Rate: 7.2 symbols/min [2025-10-02T18:14:37.715197] [INFO ] [MAIN ] CSTM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:14:37.715384] [DEBUG] [LOCAL ] CSTM: No existing data file found in primary storage. [2025-10-02T18:14:37.715441] [WARN ] [MAIN ] CSTM: No existing data found, performing full refresh instead. [2025-10-02T18:14:37.715559] [INFO ] [MAIN ] CSTM: Wiping existing primary data before full refresh. [2025-10-02T18:14:37.715602] [INFO ] [LOCAL ] CSTM: Starting deletion of primary data. [2025-10-02T18:14:37.715672] [DEBUG] [LOCAL ] CSTM: No primary data file found to delete. [2025-10-02T18:14:37.715729] [INFO ] [MAIN ] CSTM: Starting full primary refresh. [2025-10-02T18:14:37.878127] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-06. [2025-10-02T18:14:38.106638] [INFO ] [REMOTE ] CSTM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:14:38.664328] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-02T18:14:38.673786] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-03. [2025-10-02T18:14:39.348377] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-02T18:14:39.473028] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2024-12. [2025-10-02T18:14:39.482569] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-02T18:14:40.273031] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-04. [2025-10-02T18:14:41.072986] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-04. [2025-10-02T18:14:41.314040] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-02T18:14:41.854781] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-02T18:14:41.872954] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-05. [2025-10-02T18:14:42.169706] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-02T18:14:42.673014] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-01. [2025-10-02T18:14:43.414126] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-02T18:14:43.472964] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-06. [2025-10-02T18:14:44.222407] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-02T18:14:44.272978] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-02. [2025-10-02T18:14:44.604582] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-02T18:14:45.073026] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-05. [2025-10-02T18:14:45.746711] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-02T18:14:45.872997] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-07. [2025-10-02T18:14:45.977429] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-02T18:14:46.673006] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-07. [2025-10-02T18:14:47.445561] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-02T18:14:47.472946] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-08. [2025-10-02T18:14:48.041593] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-02T18:14:48.273002] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-03. [2025-10-02T18:14:49.015537] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-02T18:14:49.073047] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-06. [2025-10-02T18:14:49.874957] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-09. [2025-10-02T18:14:49.898963] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-02T18:14:50.035059] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-02T18:14:50.673046] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-07. [2025-10-02T18:14:51.118778] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-02T18:14:51.284960] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-02T18:14:51.473006] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-08. [2025-10-02T18:14:52.110357] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-02T18:14:52.273015] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-04. [2025-10-02T18:14:53.073069] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-08. [2025-10-02T18:14:53.872978] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-10. [2025-10-02T18:14:54.008816] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-02T18:14:54.515846] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-02T18:14:54.673008] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-09. [2025-10-02T18:14:54.932796] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-02T18:14:54.934441] [INFO ] [REMOTE ] CSAN: Full fetch complete (60649 records). [2025-10-02T18:14:54.934530] [DEBUG] [VALIDATOR ] CSAN: Validating primary data. [2025-10-02T18:14:55.378783] [DEBUG] [VALIDATOR ] CSAN: All expected trading days are present. [2025-10-02T18:14:55.378901] [DEBUG] [VALIDATOR ] CSAN: Primary data validation passed. [2025-10-02T18:14:55.379923] [INFO ] [MAIN ] CSAN: Fetched primary data is valid. [2025-10-02T18:14:55.380004] [DEBUG] [LOCAL ] CSAN: Saving primary data. [2025-10-02T18:14:55.381797] [DEBUG] [LOCAL ] CSAN: Trimmed 60649 records to 42614 (keeping 200 days of data) [2025-10-02T18:14:55.479333] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-05. [2025-10-02T18:14:55.645722] [DEBUG] [LOCAL ] CSAN: Primary data saved (42614 records). [2025-10-02T18:14:55.645853] [INFO ] [MAIN ] CSAN: Full history saved. [2025-10-02T18:14:55.645931] [INFO ] [MAIN ] Update Progress: 538/2370 symbols completed. CSAN took 34.1s. Estimated remaining: 4h 14m 56s. Rate: 7.2 symbols/min [2025-10-02T18:14:55.848114] [INFO ] [MAIN ] CSV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:14:55.863496] [DEBUG] [LOCAL ] CSV: Loaded 12774 existing records from primary storage. [2025-10-02T18:14:55.864007] [INFO ] [MAIN ] CSV: Loaded 12774 existing records. [2025-10-02T18:14:56.103959] [WARN ] [MAIN ] CSV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:14:56.104530] [INFO ] [MAIN ] CSV: Wiping existing primary data before full refresh. [2025-10-02T18:14:56.104730] [INFO ] [LOCAL ] CSV: Starting deletion of primary data. [2025-10-02T18:14:56.105695] [DEBUG] [LOCAL ] CSV: Deleted primary data file. [2025-10-02T18:14:56.105762] [INFO ] [MAIN ] CSV: Starting full primary refresh. [2025-10-02T18:14:56.277485] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-09. [2025-10-02T18:14:56.364885] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-02T18:14:56.557530] [INFO ] [REMOTE ] CSV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:14:57.071264] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-02T18:14:57.081505] [INFO ] [REMOTE ] CSV: Fetching primary data for 2024-12. [2025-10-02T18:14:57.446602] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-02T18:14:57.872965] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-10. [2025-10-02T18:14:58.046821] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-02T18:14:58.491837] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-02T18:14:58.492936] [INFO ] [REMOTE ] CSR: Full fetch complete (17702 records). [2025-10-02T18:14:58.493012] [DEBUG] [VALIDATOR ] CSR: Validating primary data. [2025-10-02T18:14:58.682035] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-10. [2025-10-02T18:14:58.903493] [DEBUG] [VALIDATOR ] CSR: All expected trading days are present. [2025-10-02T18:14:58.903571] [DEBUG] [VALIDATOR ] CSR: Primary data validation passed. [2025-10-02T18:14:58.903999] [INFO ] [MAIN ] CSR: Fetched primary data is valid. [2025-10-02T18:14:58.904064] [DEBUG] [LOCAL ] CSR: Saving primary data. [2025-10-02T18:14:58.904662] [DEBUG] [LOCAL ] CSR: Trimmed 17702 records to 12887 (keeping 200 days of data) [2025-10-02T18:14:59.002842] [DEBUG] [LOCAL ] CSR: Primary data saved (12887 records). [2025-10-02T18:14:59.003078] [INFO ] [MAIN ] CSR: Full history saved. [2025-10-02T18:14:59.003418] [INFO ] [MAIN ] Update Progress: 539/2370 symbols completed. CSR took 29.9s. Estimated remaining: 4h 14m 30s. Rate: 7.2 symbols/min [2025-10-02T18:14:59.188802] [INFO ] [MAIN ] CSW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:14:59.189011] [DEBUG] [LOCAL ] CSW: No existing data file found in primary storage. [2025-10-02T18:14:59.189065] [WARN ] [MAIN ] CSW: No existing data found, performing full refresh instead. [2025-10-02T18:14:59.189179] [INFO ] [MAIN ] CSW: Wiping existing primary data before full refresh. [2025-10-02T18:14:59.189221] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-02T18:14:59.189262] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-02T18:14:59.189306] [INFO ] [MAIN ] CSW: Starting full primary refresh. [2025-10-02T18:14:59.483414] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-06. [2025-10-02T18:14:59.574346] [INFO ] [REMOTE ] CSW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:14:59.848825] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-02T18:14:59.853522] [INFO ] [REMOTE ] CSL: Full fetch complete (45335 records). [2025-10-02T18:14:59.853665] [DEBUG] [VALIDATOR ] CSL: Validating primary data. [2025-10-02T18:15:00.266505] [DEBUG] [VALIDATOR ] CSL: All expected trading days are present. [2025-10-02T18:15:00.266594] [DEBUG] [VALIDATOR ] CSL: Primary data validation passed. [2025-10-02T18:15:00.267268] [INFO ] [MAIN ] CSL: Fetched primary data is valid. [2025-10-02T18:15:00.267341] [DEBUG] [LOCAL ] CSL: Saving primary data. [2025-10-02T18:15:00.269357] [DEBUG] [LOCAL ] CSL: Trimmed 45335 records to 31700 (keeping 200 days of data) [2025-10-02T18:15:00.327531] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-01. [2025-10-02T18:15:00.485141] [DEBUG] [LOCAL ] CSL: Primary data saved (31700 records). [2025-10-02T18:15:00.485290] [INFO ] [MAIN ] CSL: Full history saved. [2025-10-02T18:15:00.485419] [INFO ] [MAIN ] Update Progress: 540/2370 symbols completed. CSL took 37.3s. Estimated remaining: 4h 13m 59s. Rate: 7.2 symbols/min [2025-10-02T18:15:00.674360] [INFO ] [MAIN ] CTBB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:15:00.690304] [DEBUG] [LOCAL ] CTBB: Loaded 7070 existing records from primary storage. [2025-10-02T18:15:00.690581] [INFO ] [MAIN ] CTBB: Loaded 7070 existing records. [2025-10-02T18:15:00.891287] [WARN ] [MAIN ] CTBB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:15:00.891511] [INFO ] [MAIN ] CTBB: Wiping existing primary data before full refresh. [2025-10-02T18:15:00.891562] [INFO ] [LOCAL ] CTBB: Starting deletion of primary data. [2025-10-02T18:15:00.891994] [DEBUG] [LOCAL ] CTBB: Deleted primary data file. [2025-10-02T18:15:00.892058] [INFO ] [MAIN ] CTBB: Starting full primary refresh. [2025-10-02T18:15:01.079159] [INFO ] [REMOTE ] CSW: Fetching primary data for 2024-12. [2025-10-02T18:15:01.331589] [INFO ] [REMOTE ] CTBB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:15:01.366621] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-02T18:15:01.391115] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T18:15:01.391565] [WARN ] [REMOTE ] CSW: No data returned for month 2024-12 [2025-10-02T18:15:01.391715] [FATAL] [REMOTE ] CSW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T18:15:01.391820] [FATAL] [MAIN ] CSW: Failed to fetch primary data. [2025-10-02T18:15:01.391882] [WARN ] [MAIN ] CSW: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T18:15:01.391928] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-02T18:15:01.391987] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-02T18:15:01.392025] [INFO ] [LOCAL ] CSW: Starting deletion of derivative data. [2025-10-02T18:15:01.392098] [DEBUG] [LOCAL ] CSW: No derivative data file found to delete. [2025-10-02T18:15:01.392177] [INFO ] [MAIN ] Update Progress: 541/2370 symbols completed. CSW took 2.4s. Estimated remaining: 4h 13m 25s. Rate: 7.2 symbols/min [2025-10-02T18:15:01.532460] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-02T18:15:01.629759] [INFO ] [MAIN ] CTDD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:15:01.629995] [DEBUG] [LOCAL ] CTDD: No existing data file found in primary storage. [2025-10-02T18:15:01.630044] [WARN ] [MAIN ] CTDD: No existing data found, performing full refresh instead. [2025-10-02T18:15:01.630190] [INFO ] [MAIN ] CTDD: Wiping existing primary data before full refresh. [2025-10-02T18:15:01.630260] [INFO ] [LOCAL ] CTDD: Starting deletion of primary data. [2025-10-02T18:15:01.630317] [DEBUG] [LOCAL ] CTDD: No primary data file found to delete. [2025-10-02T18:15:01.630354] [INFO ] [MAIN ] CTDD: Starting full primary refresh. [2025-10-02T18:15:01.879451] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-07. [2025-10-02T18:15:02.060309] [INFO ] [REMOTE ] CTDD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:15:02.673043] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2024-12. [2025-10-02T18:15:03.473006] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2024-12. [2025-10-02T18:15:03.574468] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-02T18:15:03.671525] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-02T18:15:04.273006] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-02. [2025-10-02T18:15:04.319609] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-02T18:15:05.073059] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-08. [2025-10-02T18:15:05.321506] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-02T18:15:05.873050] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-01. [2025-10-02T18:15:06.363305] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-02T18:15:06.666910] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-02T18:15:06.676165] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-01. [2025-10-02T18:15:07.408853] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-02T18:15:07.473033] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-02. [2025-10-02T18:15:08.040630] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-02T18:15:08.273002] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-03. [2025-10-02T18:15:08.923197] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-02T18:15:09.073009] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-09. [2025-10-02T18:15:09.872999] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-03. [2025-10-02T18:15:10.423013] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-02T18:15:10.673051] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-10. [2025-10-02T18:15:11.018583] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-02T18:15:11.473006] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-04. [2025-10-02T18:15:11.949375] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-02T18:15:11.953241] [INFO ] [REMOTE ] CSTM: Full fetch complete (69257 records). [2025-10-02T18:15:11.953357] [DEBUG] [VALIDATOR ] CSTM: Validating primary data. [2025-10-02T18:15:12.276537] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-04. [2025-10-02T18:15:12.310980] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-02T18:15:12.420246] [DEBUG] [VALIDATOR ] CSTM: All expected trading days are present. [2025-10-02T18:15:12.420334] [DEBUG] [VALIDATOR ] CSTM: Primary data validation passed. [2025-10-02T18:15:12.421333] [INFO ] [MAIN ] CSTM: Fetched primary data is valid. [2025-10-02T18:15:12.421400] [DEBUG] [LOCAL ] CSTM: Saving primary data. [2025-10-02T18:15:12.422864] [DEBUG] [LOCAL ] CSTM: Trimmed 69257 records to 47784 (keeping 200 days of data) [2025-10-02T18:15:12.721965] [DEBUG] [LOCAL ] CSTM: Primary data saved (47784 records). [2025-10-02T18:15:12.722119] [INFO ] [MAIN ] CSTM: Full history saved. [2025-10-02T18:15:12.722199] [INFO ] [MAIN ] Update Progress: 542/2370 symbols completed. CSTM took 35.2s. Estimated remaining: 4h 13m 27s. Rate: 7.2 symbols/min [2025-10-02T18:15:12.906383] [INFO ] [MAIN ] CTEST: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:15:12.906688] [DEBUG] [LOCAL ] CTEST: No existing data file found in primary storage. [2025-10-02T18:15:12.906749] [WARN ] [MAIN ] CTEST: No existing data found, performing full refresh instead. [2025-10-02T18:15:12.906873] [INFO ] [MAIN ] CTEST: Wiping existing primary data before full refresh. [2025-10-02T18:15:12.906930] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-10-02T18:15:12.907001] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-10-02T18:15:12.907053] [INFO ] [MAIN ] CTEST: Starting full primary refresh. [2025-10-02T18:15:13.075409] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-05. [2025-10-02T18:15:13.298370] [INFO ] [REMOTE ] CTEST: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:15:13.342963] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-02T18:15:13.707088] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-02T18:15:13.873015] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-05. [2025-10-02T18:15:14.503607] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-02T18:15:14.673024] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-02. [2025-10-02T18:15:15.415262] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-02T18:15:15.473039] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-06. [2025-10-02T18:15:16.272999] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2024-12. [2025-10-02T18:15:16.346248] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-02T18:15:16.846450] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T18:15:16.846827] [WARN ] [REMOTE ] CTEST: No data returned for month 2024-12 [2025-10-02T18:15:16.846914] [FATAL] [REMOTE ] CTEST: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T18:15:16.846965] [FATAL] [MAIN ] CTEST: Failed to fetch primary data. [2025-10-02T18:15:16.847028] [WARN ] [MAIN ] CTEST: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T18:15:16.847102] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-10-02T18:15:16.847190] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-10-02T18:15:16.847247] [INFO ] [LOCAL ] CTEST: Starting deletion of derivative data. [2025-10-02T18:15:16.847293] [DEBUG] [LOCAL ] CTEST: No derivative data file found to delete. [2025-10-02T18:15:16.847341] [INFO ] [MAIN ] Update Progress: 543/2370 symbols completed. CTEST took 4.1s. Estimated remaining: 4h 13m 5s. Rate: 7.2 symbols/min [2025-10-02T18:15:17.041538] [INFO ] [MAIN ] CTEV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:15:17.041748] [DEBUG] [LOCAL ] CTEV: No existing data file found in primary storage. [2025-10-02T18:15:17.041805] [WARN ] [MAIN ] CTEV: No existing data found, performing full refresh instead. [2025-10-02T18:15:17.041962] [INFO ] [MAIN ] CTEV: Wiping existing primary data before full refresh. [2025-10-02T18:15:17.042008] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-02T18:15:17.042050] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-02T18:15:17.042083] [INFO ] [MAIN ] CTEV: Starting full primary refresh. [2025-10-02T18:15:17.078237] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-06. [2025-10-02T18:15:17.450558] [INFO ] [REMOTE ] CTEV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:15:17.758124] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-02T18:15:17.873034] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-07. [2025-10-02T18:15:18.295791] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-02T18:15:18.673015] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-07. [2025-10-02T18:15:19.476800] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2024-12. [2025-10-02T18:15:19.479253] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-02T18:15:19.677625] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T18:15:19.678326] [WARN ] [REMOTE ] CTEV: No data returned for month 2024-12 [2025-10-02T18:15:19.678576] [FATAL] [REMOTE ] CTEV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T18:15:19.678860] [FATAL] [MAIN ] CTEV: Failed to fetch primary data. [2025-10-02T18:15:19.678961] [WARN ] [MAIN ] CTEV: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T18:15:19.679209] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-02T18:15:19.679406] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-02T18:15:19.679543] [INFO ] [LOCAL ] CTEV: Starting deletion of derivative data. [2025-10-02T18:15:19.679607] [DEBUG] [LOCAL ] CTEV: No derivative data file found to delete. [2025-10-02T18:15:19.679704] [INFO ] [MAIN ] Update Progress: 544/2370 symbols completed. CTEV took 2.8s. Estimated remaining: 4h 12m 38s. Rate: 7.2 symbols/min [2025-10-02T18:15:19.938369] [INFO ] [MAIN ] CTO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:15:19.973206] [DEBUG] [LOCAL ] CTO: Loaded 27816 existing records from primary storage. [2025-10-02T18:15:19.973470] [INFO ] [MAIN ] CTO: Loaded 27816 existing records. [2025-10-02T18:15:20.186798] [WARN ] [MAIN ] CTO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:15:20.187041] [INFO ] [MAIN ] CTO: Wiping existing primary data before full refresh. [2025-10-02T18:15:20.187130] [INFO ] [LOCAL ] CTO: Starting deletion of primary data. [2025-10-02T18:15:20.188286] [DEBUG] [LOCAL ] CTO: Deleted primary data file. [2025-10-02T18:15:20.188352] [INFO ] [MAIN ] CTO: Starting full primary refresh. [2025-10-02T18:15:20.278165] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-08. [2025-10-02T18:15:20.625324] [INFO ] [REMOTE ] CTO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:15:20.979736] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-02T18:15:21.073006] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-03. [2025-10-02T18:15:21.872994] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-09. [2025-10-02T18:15:21.900504] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-02T18:15:22.566629] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-02T18:15:22.673036] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-08. [2025-10-02T18:15:23.473013] [INFO ] [REMOTE ] CTO: Fetching primary data for 2024-12. [2025-10-02T18:15:23.572047] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-02T18:15:24.273041] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-04. [2025-10-02T18:15:24.954706] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-02T18:15:25.053289] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-02T18:15:25.072966] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-01. [2025-10-02T18:15:25.872975] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-09. [2025-10-02T18:15:26.202914] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-02T18:15:26.672997] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-10. [2025-10-02T18:15:26.883609] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-02T18:15:27.124179] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-02T18:15:27.125570] [INFO ] [REMOTE ] CTDD: Full fetch complete (8458 records). [2025-10-02T18:15:27.125672] [DEBUG] [VALIDATOR ] CTDD: Validating primary data. [2025-10-02T18:15:27.480164] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-10. [2025-10-02T18:15:27.527595] [DEBUG] [VALIDATOR ] CTDD: All expected trading days are present. [2025-10-02T18:15:27.527702] [DEBUG] [VALIDATOR ] CTDD: Primary data validation passed. [2025-10-02T18:15:27.527958] [INFO ] [MAIN ] CTDD: Fetched primary data is valid. [2025-10-02T18:15:27.528089] [DEBUG] [LOCAL ] CTDD: Saving primary data. [2025-10-02T18:15:27.528602] [DEBUG] [LOCAL ] CTDD: Trimmed 8458 records to 5926 (keeping 200 days of data) [2025-10-02T18:15:27.573780] [DEBUG] [LOCAL ] CTDD: Primary data saved (5926 records). [2025-10-02T18:15:27.573913] [INFO ] [MAIN ] CTDD: Full history saved. [2025-10-02T18:15:27.573999] [INFO ] [MAIN ] Update Progress: 545/2370 symbols completed. CTDD took 26.2s. Estimated remaining: 4h 12m 28s. Rate: 7.2 symbols/min [2025-10-02T18:15:27.774332] [INFO ] [MAIN ] CTOS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:15:27.818222] [DEBUG] [LOCAL ] CTOS: Loaded 36522 existing records from primary storage. [2025-10-02T18:15:27.818551] [INFO ] [MAIN ] CTOS: Loaded 36522 existing records. [2025-10-02T18:15:28.031276] [WARN ] [MAIN ] CTOS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:15:28.031585] [INFO ] [MAIN ] CTOS: Wiping existing primary data before full refresh. [2025-10-02T18:15:28.031702] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-10-02T18:15:28.033904] [DEBUG] [LOCAL ] CTOS: Deleted primary data file. [2025-10-02T18:15:28.033969] [INFO ] [MAIN ] CTOS: Starting full primary refresh. [2025-10-02T18:15:28.161597] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-02T18:15:28.178757] [INFO ] [REMOTE ] CSV: Full fetch complete (19556 records). [2025-10-02T18:15:28.191936] [DEBUG] [VALIDATOR ] CSV: Validating primary data. [2025-10-02T18:15:28.278965] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-02. [2025-10-02T18:15:28.823273] [INFO ] [REMOTE ] CTOS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:15:28.929110] [DEBUG] [VALIDATOR ] CSV: All expected trading days are present. [2025-10-02T18:15:28.929190] [DEBUG] [VALIDATOR ] CSV: Primary data validation passed. [2025-10-02T18:15:28.929537] [INFO ] [MAIN ] CSV: Fetched primary data is valid. [2025-10-02T18:15:28.929586] [DEBUG] [LOCAL ] CSV: Saving primary data. [2025-10-02T18:15:28.930287] [DEBUG] [LOCAL ] CSV: Trimmed 19556 records to 12924 (keeping 200 days of data) [2025-10-02T18:15:29.022951] [DEBUG] [LOCAL ] CSV: Primary data saved (12924 records). [2025-10-02T18:15:29.023093] [INFO ] [MAIN ] CSV: Full history saved. [2025-10-02T18:15:29.023206] [INFO ] [MAIN ] Update Progress: 546/2370 symbols completed. CSV took 33.4s. Estimated remaining: 4h 11m 57s. Rate: 7.2 symbols/min [2025-10-02T18:15:29.081505] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-05. [2025-10-02T18:15:29.212897] [INFO ] [MAIN ] CTRA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:15:29.272860] [DEBUG] [LOCAL ] CTRA: Loaded 53648 existing records from primary storage. [2025-10-02T18:15:29.273266] [INFO ] [MAIN ] CTRA: Loaded 53648 existing records. [2025-10-02T18:15:29.468148] [WARN ] [MAIN ] CTRA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:15:29.468381] [INFO ] [MAIN ] CTRA: Wiping existing primary data before full refresh. [2025-10-02T18:15:29.468435] [INFO ] [LOCAL ] CTRA: Starting deletion of primary data. [2025-10-02T18:15:29.471344] [DEBUG] [LOCAL ] CTRA: Deleted primary data file. [2025-10-02T18:15:29.471410] [INFO ] [MAIN ] CTRA: Starting full primary refresh. [2025-10-02T18:15:29.807419] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-02T18:15:29.895935] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2024-12. [2025-10-02T18:15:29.904065] [INFO ] [REMOTE ] CTRA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:15:29.917335] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-02T18:15:30.673019] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-03. [2025-10-02T18:15:31.318609] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-02T18:15:31.472992] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-01. [2025-10-02T18:15:32.161417] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-02T18:15:32.272995] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-06. [2025-10-02T18:15:32.522709] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-02T18:15:32.984209] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-02T18:15:33.073027] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-07. [2025-10-02T18:15:33.675367] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-02T18:15:33.873012] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-02. [2025-10-02T18:15:34.673020] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-04. [2025-10-02T18:15:35.262054] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-02T18:15:35.472998] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-08. [2025-10-02T18:15:36.168596] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-02T18:15:36.207860] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-02T18:15:36.272998] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-09. [2025-10-02T18:15:36.945525] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-02T18:15:37.073069] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-05. [2025-10-02T18:15:37.872997] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2024-12. [2025-10-02T18:15:38.195367] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-02T18:15:38.673011] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-03. [2025-10-02T18:15:39.473014] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-06. [2025-10-02T18:15:39.756997] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-02T18:15:39.827244] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-02T18:15:40.273112] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-10. [2025-10-02T18:15:40.434407] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-02T18:15:40.961120] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-02T18:15:40.962198] [INFO ] [REMOTE ] CTBB: Full fetch complete (10777 records). [2025-10-02T18:15:40.962322] [DEBUG] [VALIDATOR ] CTBB: Validating primary data. [2025-10-02T18:15:41.079311] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-04. [2025-10-02T18:15:41.392448] [DEBUG] [VALIDATOR ] CTBB: All expected trading days are present. [2025-10-02T18:15:41.392533] [DEBUG] [VALIDATOR ] CTBB: Primary data validation passed. [2025-10-02T18:15:41.392920] [INFO ] [MAIN ] CTBB: Fetched primary data is valid. [2025-10-02T18:15:41.392984] [DEBUG] [LOCAL ] CTBB: Saving primary data. [2025-10-02T18:15:41.393480] [DEBUG] [LOCAL ] CTBB: Trimmed 10777 records to 7097 (keeping 200 days of data) [2025-10-02T18:15:41.441119] [DEBUG] [LOCAL ] CTBB: Primary data saved (7097 records). [2025-10-02T18:15:41.441281] [INFO ] [MAIN ] CTBB: Full history saved. [2025-10-02T18:15:41.441429] [INFO ] [MAIN ] Update Progress: 547/2370 symbols completed. CTBB took 41.0s. Estimated remaining: 4h 12m 3s. Rate: 7.2 symbols/min [2025-10-02T18:15:41.631924] [INFO ] [MAIN ] CTRE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:15:41.632169] [DEBUG] [LOCAL ] CTRE: No existing data file found in primary storage. [2025-10-02T18:15:41.632275] [WARN ] [MAIN ] CTRE: No existing data found, performing full refresh instead. [2025-10-02T18:15:41.632457] [INFO ] [MAIN ] CTRE: Wiping existing primary data before full refresh. [2025-10-02T18:15:41.632506] [INFO ] [LOCAL ] CTRE: Starting deletion of primary data. [2025-10-02T18:15:41.632553] [DEBUG] [LOCAL ] CTRE: No primary data file found to delete. [2025-10-02T18:15:41.632600] [INFO ] [MAIN ] CTRE: Starting full primary refresh. [2025-10-02T18:15:41.879468] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-07. [2025-10-02T18:15:42.035801] [INFO ] [REMOTE ] CTRE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:15:42.673049] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-01. [2025-10-02T18:15:42.724860] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-02T18:15:43.239391] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-02T18:15:43.473096] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2024-12. [2025-10-02T18:15:44.272976] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-08. [2025-10-02T18:15:44.372515] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-02T18:15:45.073082] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-05. [2025-10-02T18:15:45.253380] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-02T18:15:45.293096] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-02T18:15:45.873018] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-02. [2025-10-02T18:15:46.320146] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-02T18:15:46.673057] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-09. [2025-10-02T18:15:47.473011] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-01. [2025-10-02T18:15:47.659325] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-02T18:15:48.282154] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-06. [2025-10-02T18:15:48.286490] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-02T18:15:49.073000] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-10. [2025-10-02T18:15:49.295198] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-02T18:15:49.651793] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-02T18:15:49.872961] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-02. [2025-10-02T18:15:50.152267] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-02T18:15:50.153792] [INFO ] [REMOTE ] CTO: Full fetch complete (41775 records). [2025-10-02T18:15:50.153878] [DEBUG] [VALIDATOR ] CTO: Validating primary data. [2025-10-02T18:15:50.573538] [DEBUG] [VALIDATOR ] CTO: All expected trading days are present. [2025-10-02T18:15:50.573916] [DEBUG] [VALIDATOR ] CTO: Primary data validation passed. [2025-10-02T18:15:50.574566] [INFO ] [MAIN ] CTO: Fetched primary data is valid. [2025-10-02T18:15:50.574632] [DEBUG] [LOCAL ] CTO: Saving primary data. [2025-10-02T18:15:50.575750] [DEBUG] [LOCAL ] CTO: Trimmed 41775 records to 28044 (keeping 200 days of data) [2025-10-02T18:15:50.673451] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-03. [2025-10-02T18:15:50.765363] [DEBUG] [LOCAL ] CTO: Primary data saved (28044 records). [2025-10-02T18:15:50.765516] [INFO ] [MAIN ] CTO: Full history saved. [2025-10-02T18:15:50.765606] [INFO ] [MAIN ] Update Progress: 548/2370 symbols completed. CTO took 31.1s. Estimated remaining: 4h 11m 58s. Rate: 7.2 symbols/min [2025-10-02T18:15:50.956524] [INFO ] [MAIN ] CTRI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:15:50.995921] [DEBUG] [LOCAL ] CTRI: Loaded 38669 existing records from primary storage. [2025-10-02T18:15:50.996286] [INFO ] [MAIN ] CTRI: Loaded 38669 existing records. [2025-10-02T18:15:51.201385] [WARN ] [MAIN ] CTRI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:15:51.201935] [INFO ] [MAIN ] CTRI: Wiping existing primary data before full refresh. [2025-10-02T18:15:51.202020] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-10-02T18:15:51.213505] [DEBUG] [LOCAL ] CTRI: Deleted primary data file. [2025-10-02T18:15:51.230856] [INFO ] [MAIN ] CTRI: Starting full primary refresh. [2025-10-02T18:15:51.238276] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-02T18:15:51.478540] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-07. [2025-10-02T18:15:51.650168] [INFO ] [REMOTE ] CTRI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:15:52.273055] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2024-12. [2025-10-02T18:15:52.689797] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-02T18:15:53.041705] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-02T18:15:53.072994] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-08. [2025-10-02T18:15:53.319282] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-02T18:15:53.872962] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-01. [2025-10-02T18:15:54.354199] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-02T18:15:54.673038] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-04. [2025-10-02T18:15:55.108408] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-02T18:15:55.473050] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-03. [2025-10-02T18:15:56.173929] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-02T18:15:56.273032] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-09. [2025-10-02T18:15:57.073019] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-05. [2025-10-02T18:15:57.273874] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-02T18:15:57.361172] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-02T18:15:57.873013] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-10. [2025-10-02T18:15:58.673009] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-04. [2025-10-02T18:15:59.006722] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-02T18:15:59.009016] [INFO ] [REMOTE ] CTOS: Full fetch complete (53573 records). [2025-10-02T18:15:59.009146] [DEBUG] [VALIDATOR ] CTOS: Validating primary data. [2025-10-02T18:15:59.169695] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-02T18:15:59.478517] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-06. [2025-10-02T18:15:59.497242] [DEBUG] [VALIDATOR ] CTOS: All expected trading days are present. [2025-10-02T18:15:59.497333] [DEBUG] [VALIDATOR ] CTOS: Primary data validation passed. [2025-10-02T18:15:59.499028] [INFO ] [MAIN ] CTOS: Fetched primary data is valid. [2025-10-02T18:15:59.499105] [DEBUG] [LOCAL ] CTOS: Saving primary data. [2025-10-02T18:15:59.500511] [DEBUG] [LOCAL ] CTOS: Trimmed 53573 records to 36860 (keeping 200 days of data) [2025-10-02T18:15:59.718295] [DEBUG] [LOCAL ] CTOS: Primary data saved (36860 records). [2025-10-02T18:15:59.718446] [INFO ] [MAIN ] CTOS: Full history saved. [2025-10-02T18:15:59.720488] [INFO ] [MAIN ] Update Progress: 549/2370 symbols completed. CTOS took 32.1s. Estimated remaining: 4h 11m 52s. Rate: 7.2 symbols/min [2025-10-02T18:15:59.915956] [INFO ] [MAIN ] CTS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:15:59.951043] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-02T18:15:59.976942] [DEBUG] [LOCAL ] CTS: Loaded 19374 existing records from primary storage. [2025-10-02T18:15:59.977197] [INFO ] [MAIN ] CTS: Loaded 19374 existing records. [2025-10-02T18:16:00.181263] [WARN ] [MAIN ] CTS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:16:00.181493] [INFO ] [MAIN ] CTS: Wiping existing primary data before full refresh. [2025-10-02T18:16:00.181548] [INFO ] [LOCAL ] CTS: Starting deletion of primary data. [2025-10-02T18:16:00.182366] [DEBUG] [LOCAL ] CTS: Deleted primary data file. [2025-10-02T18:16:00.182431] [INFO ] [MAIN ] CTS: Starting full primary refresh. [2025-10-02T18:16:00.278118] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-02. [2025-10-02T18:16:00.599678] [INFO ] [REMOTE ] CTS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:16:01.072970] [INFO ] [REMOTE ] CTS: Fetching primary data for 2024-12. [2025-10-02T18:16:01.232407] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-02T18:16:01.574747] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-02T18:16:01.873023] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-03. [2025-10-02T18:16:02.123899] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-02T18:16:02.673036] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-05. [2025-10-02T18:16:03.127425] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-02T18:16:03.473003] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-01. [2025-10-02T18:16:04.273247] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-07. [2025-10-02T18:16:04.504029] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-02T18:16:04.553556] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-02T18:16:05.073015] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-04. [2025-10-02T18:16:05.872973] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-06. [2025-10-02T18:16:06.216319] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-02T18:16:06.247678] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-02T18:16:06.673051] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-08. [2025-10-02T18:16:07.289963] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-02T18:16:07.473044] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-05. [2025-10-02T18:16:08.273023] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-07. [2025-10-02T18:16:08.554851] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-02T18:16:08.817752] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-02T18:16:09.073000] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-09. [2025-10-02T18:16:09.873049] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-06. [2025-10-02T18:16:10.200486] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-02T18:16:10.673009] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-08. [2025-10-02T18:16:10.925007] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-02T18:16:11.251733] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-02T18:16:11.473023] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-07. [2025-10-02T18:16:12.109974] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-02T18:16:12.273027] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-09. [2025-10-02T18:16:12.923043] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-02T18:16:13.073004] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-02. [2025-10-02T18:16:13.873007] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-08. [2025-10-02T18:16:13.944119] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-02T18:16:13.979609] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-02T18:16:14.672999] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-03. [2025-10-02T18:16:15.431054] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-02T18:16:15.473047] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-10. [2025-10-02T18:16:15.829211] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-02T18:16:16.273011] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-09. [2025-10-02T18:16:17.073004] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-04. [2025-10-02T18:16:17.164829] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-02T18:16:17.169888] [INFO ] [REMOTE ] CTRA: Full fetch complete (77663 records). [2025-10-02T18:16:17.170119] [DEBUG] [VALIDATOR ] CTRA: Validating primary data. [2025-10-02T18:16:17.623566] [DEBUG] [VALIDATOR ] CTRA: All expected trading days are present. [2025-10-02T18:16:17.623699] [DEBUG] [VALIDATOR ] CTRA: Primary data validation passed. [2025-10-02T18:16:17.624568] [INFO ] [MAIN ] CTRA: Fetched primary data is valid. [2025-10-02T18:16:17.624622] [DEBUG] [LOCAL ] CTRA: Saving primary data. [2025-10-02T18:16:17.626214] [DEBUG] [LOCAL ] CTRA: Trimmed 77663 records to 54038 (keeping 200 days of data) [2025-10-02T18:16:17.874541] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-10. [2025-10-02T18:16:17.985364] [DEBUG] [LOCAL ] CTRA: Primary data saved (54038 records). [2025-10-02T18:16:17.985772] [INFO ] [MAIN ] CTRA: Full history saved. [2025-10-02T18:16:17.985866] [INFO ] [MAIN ] Update Progress: 550/2370 symbols completed. CTRA took 49.0s. Estimated remaining: 4h 12m 16s. Rate: 7.2 symbols/min [2025-10-02T18:16:18.178516] [INFO ] [MAIN ] CTVA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:16:18.195981] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-02T18:16:18.233394] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-02T18:16:18.290341] [DEBUG] [LOCAL ] CTVA: Loaded 53239 existing records from primary storage. [2025-10-02T18:16:18.290704] [INFO ] [MAIN ] CTVA: Loaded 53239 existing records. [2025-10-02T18:16:18.485414] [WARN ] [MAIN ] CTVA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:16:18.485680] [INFO ] [MAIN ] CTVA: Wiping existing primary data before full refresh. [2025-10-02T18:16:18.485742] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-10-02T18:16:18.487364] [DEBUG] [LOCAL ] CTVA: Deleted primary data file. [2025-10-02T18:16:18.487428] [INFO ] [MAIN ] CTVA: Starting full primary refresh. [2025-10-02T18:16:18.672993] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-10. [2025-10-02T18:16:18.875152] [INFO ] [REMOTE ] CTVA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:16:19.472961] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2024-12. [2025-10-02T18:16:19.541695] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-02T18:16:19.544909] [INFO ] [REMOTE ] CTRE: Full fetch complete (71194 records). [2025-10-02T18:16:19.545021] [DEBUG] [VALIDATOR ] CTRE: Validating primary data. [2025-10-02T18:16:19.990232] [DEBUG] [VALIDATOR ] CTRE: All expected trading days are present. [2025-10-02T18:16:19.990314] [DEBUG] [VALIDATOR ] CTRE: Primary data validation passed. [2025-10-02T18:16:19.991106] [INFO ] [MAIN ] CTRE: Fetched primary data is valid. [2025-10-02T18:16:19.991170] [DEBUG] [LOCAL ] CTRE: Saving primary data. [2025-10-02T18:16:19.992557] [DEBUG] [LOCAL ] CTRE: Trimmed 71194 records to 49617 (keeping 200 days of data) [2025-10-02T18:16:20.119792] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-02T18:16:20.127909] [INFO ] [REMOTE ] CTRI: Full fetch complete (51935 records). [2025-10-02T18:16:20.128938] [DEBUG] [VALIDATOR ] CTRI: Validating primary data. [2025-10-02T18:16:20.277535] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-05. [2025-10-02T18:16:20.677328] [DEBUG] [VALIDATOR ] CTRI: All expected trading days are present. [2025-10-02T18:16:20.677431] [DEBUG] [VALIDATOR ] CTRI: Primary data validation passed. [2025-10-02T18:16:20.678638] [INFO ] [MAIN ] CTRI: Fetched primary data is valid. [2025-10-02T18:16:20.678746] [DEBUG] [LOCAL ] CTRI: Saving primary data. [2025-10-02T18:16:20.682850] [DEBUG] [LOCAL ] CTRI: Trimmed 51935 records to 39023 (keeping 200 days of data) [2025-10-02T18:16:20.995270] [DEBUG] [LOCAL ] CTRE: Primary data saved (49617 records). [2025-10-02T18:16:20.995991] [INFO ] [MAIN ] CTRE: Full history saved. [2025-10-02T18:16:20.996940] [INFO ] [MAIN ] Update Progress: 551/2370 symbols completed. CTRE took 39.6s. Estimated remaining: 4h 11m 51s. Rate: 7.2 symbols/min [2025-10-02T18:16:21.124330] [DEBUG] [LOCAL ] CTRI: Primary data saved (39023 records). [2025-10-02T18:16:21.125065] [INFO ] [MAIN ] CTRI: Full history saved. [2025-10-02T18:16:21.125197] [INFO ] [MAIN ] Update Progress: 552/2370 symbols completed. CTRI took 30.4s. Estimated remaining: 4h 11m 15s. Rate: 7.2 symbols/min [2025-10-02T18:16:21.244330] [INFO ] [MAIN ] CUBB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:16:21.249929] [DEBUG] [LOCAL ] CUBB: No existing data file found in primary storage. [2025-10-02T18:16:21.263719] [WARN ] [MAIN ] CUBB: No existing data found, performing full refresh instead. [2025-10-02T18:16:21.264063] [INFO ] [MAIN ] CUBB: Wiping existing primary data before full refresh. [2025-10-02T18:16:21.264466] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-02T18:16:21.287930] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-02T18:16:21.329193] [INFO ] [MAIN ] CUBB: Starting full primary refresh. [2025-10-02T18:16:21.509638] [INFO ] [MAIN ] CUBE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:16:21.562608] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-02T18:16:21.602785] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-06. [2025-10-02T18:16:21.827681] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2024-12 (2.35 seconds). [2025-10-02T18:16:21.881999] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-01. [2025-10-02T18:16:21.942475] [INFO ] [REMOTE ] CUBB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:16:21.943586] [DEBUG] [LOCAL ] CUBE: Loaded 50642 existing records from primary storage. [2025-10-02T18:16:21.944302] [INFO ] [MAIN ] CUBE: Loaded 50642 existing records. [2025-10-02T18:16:22.151326] [WARN ] [MAIN ] CUBE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:16:22.151493] [INFO ] [MAIN ] CUBE: Wiping existing primary data before full refresh. [2025-10-02T18:16:22.151554] [INFO ] [LOCAL ] CUBE: Starting deletion of primary data. [2025-10-02T18:16:22.153508] [DEBUG] [LOCAL ] CUBE: Deleted primary data file. [2025-10-02T18:16:22.153618] [INFO ] [MAIN ] CUBE: Starting full primary refresh. [2025-10-02T18:16:22.553965] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-02T18:16:22.559933] [INFO ] [REMOTE ] CUBE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:16:22.673001] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2024-12. [2025-10-02T18:16:23.092139] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-02T18:16:23.472992] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-07. [2025-10-02T18:16:23.921002] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-02T18:16:24.273023] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-01. [2025-10-02T18:16:24.600348] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-02T18:16:24.618354] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-02T18:16:25.073008] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2024-12. [2025-10-02T18:16:25.873009] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-08. [2025-10-02T18:16:26.673175] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-02. [2025-10-02T18:16:26.673099] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-02T18:16:27.006799] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-02T18:16:27.054983] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-02T18:16:27.473003] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-03. [2025-10-02T18:16:27.797323] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-02T18:16:28.272995] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-09. [2025-10-02T18:16:29.072973] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-04. [2025-10-02T18:16:29.317800] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-02T18:16:29.403321] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-02T18:16:29.872990] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-05. [2025-10-02T18:16:30.122710] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-10-02T18:16:30.673018] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-01. [2025-10-02T18:16:31.472993] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-06. [2025-10-02T18:16:31.684976] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-06 (0.21 seconds). [2025-10-02T18:16:32.280628] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-10. [2025-10-02T18:16:32.286895] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-02T18:16:33.073025] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-02. [2025-10-02T18:16:33.141554] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-02T18:16:33.142879] [INFO ] [REMOTE ] CTS: Full fetch complete (26799 records). [2025-10-02T18:16:33.142961] [DEBUG] [VALIDATOR ] CTS: Validating primary data. [2025-10-02T18:16:33.573714] [DEBUG] [VALIDATOR ] CTS: All expected trading days are present. [2025-10-02T18:16:33.573857] [DEBUG] [VALIDATOR ] CTS: Primary data validation passed. [2025-10-02T18:16:33.574396] [INFO ] [MAIN ] CTS: Fetched primary data is valid. [2025-10-02T18:16:33.574469] [DEBUG] [LOCAL ] CTS: Saving primary data. [2025-10-02T18:16:33.575208] [DEBUG] [LOCAL ] CTS: Trimmed 26799 records to 19508 (keeping 200 days of data) [2025-10-02T18:16:33.705458] [DEBUG] [LOCAL ] CTS: Primary data saved (19508 records). [2025-10-02T18:16:33.705605] [INFO ] [MAIN ] CTS: Full history saved. [2025-10-02T18:16:33.705713] [INFO ] [MAIN ] Update Progress: 553/2370 symbols completed. CTS took 34.0s. Estimated remaining: 4h 11m 21s. Rate: 7.2 symbols/min [2025-10-02T18:16:33.878134] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-07. [2025-10-02T18:16:33.898673] [INFO ] [MAIN ] CUBI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:16:33.899001] [DEBUG] [LOCAL ] CUBI: No existing data file found in primary storage. [2025-10-02T18:16:33.900064] [WARN ] [MAIN ] CUBI: No existing data found, performing full refresh instead. [2025-10-02T18:16:33.900235] [INFO ] [MAIN ] CUBI: Wiping existing primary data before full refresh. [2025-10-02T18:16:33.900282] [INFO ] [LOCAL ] CUBI: Starting deletion of primary data. [2025-10-02T18:16:33.900326] [DEBUG] [LOCAL ] CUBI: No primary data file found to delete. [2025-10-02T18:16:33.900362] [INFO ] [MAIN ] CUBI: Starting full primary refresh. [2025-10-02T18:16:34.291272] [INFO ] [REMOTE ] CUBI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:16:34.311152] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-02T18:16:34.568478] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-02T18:16:34.673000] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-08. [2025-10-02T18:16:35.011725] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-02T18:16:35.473041] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2024-12. [2025-10-02T18:16:36.272997] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-09. [2025-10-02T18:16:36.601835] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-02T18:16:36.662088] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-02T18:16:37.073004] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-10. [2025-10-02T18:16:37.447915] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-02T18:16:37.448944] [INFO ] [REMOTE ] CUBB: Full fetch complete (926 records). [2025-10-02T18:16:37.449036] [DEBUG] [VALIDATOR ] CUBB: Validating primary data. [2025-10-02T18:16:37.697524] [WARN ] [VALIDATOR ] CUBB: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-10-02T18:16:37.697884] [FATAL] [MAIN ] CUBB: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:16:37.697977] [WARN ] [MAIN ] CUBB: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:16:37.698109] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-02T18:16:37.698204] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-02T18:16:37.698263] [INFO ] [LOCAL ] CUBB: Starting deletion of derivative data. [2025-10-02T18:16:37.698337] [DEBUG] [LOCAL ] CUBB: No derivative data file found to delete. [2025-10-02T18:16:37.698429] [INFO ] [MAIN ] Update Progress: 554/2370 symbols completed. CUBB took 16.7s. Estimated remaining: 4h 10m 59s. Rate: 7.2 symbols/min [2025-10-02T18:16:37.878253] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-01. [2025-10-02T18:16:37.960864] [INFO ] [MAIN ] CUK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:16:38.041816] [DEBUG] [LOCAL ] CUK: Loaded 51001 existing records from primary storage. [2025-10-02T18:16:38.042340] [INFO ] [MAIN ] CUK: Loaded 51001 existing records. [2025-10-02T18:16:38.300858] [WARN ] [MAIN ] CUK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:16:38.301118] [INFO ] [MAIN ] CUK: Wiping existing primary data before full refresh. [2025-10-02T18:16:38.301169] [INFO ] [LOCAL ] CUK: Starting deletion of primary data. [2025-10-02T18:16:38.302530] [DEBUG] [LOCAL ] CUK: Deleted primary data file. [2025-10-02T18:16:38.302619] [INFO ] [MAIN ] CUK: Starting full primary refresh. [2025-10-02T18:16:38.678286] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-03. [2025-10-02T18:16:38.751861] [INFO ] [REMOTE ] CUK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:16:39.277480] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-02T18:16:39.473066] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-02. [2025-10-02T18:16:40.224576] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-02T18:16:40.272967] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-04. [2025-10-02T18:16:40.916042] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-02T18:16:41.073023] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-03. [2025-10-02T18:16:41.872995] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-02. [2025-10-02T18:16:42.127293] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-02T18:16:42.631564] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-02T18:16:42.673022] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-03. [2025-10-02T18:16:42.836469] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-02T18:16:43.472987] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-05. [2025-10-02T18:16:43.574871] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-02T18:16:44.273019] [INFO ] [REMOTE ] CUK: Fetching primary data for 2024-12. [2025-10-02T18:16:45.072999] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-04. [2025-10-02T18:16:45.440775] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-02T18:16:45.843430] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-02T18:16:45.872981] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-01. [2025-10-02T18:16:46.099882] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-02T18:16:46.673028] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-04. [2025-10-02T18:16:47.472984] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-06. [2025-10-02T18:16:47.564768] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-02T18:16:48.273039] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-02. [2025-10-02T18:16:48.502599] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-02T18:16:49.073054] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-05. [2025-10-02T18:16:49.285934] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-02T18:16:49.873159] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-05. [2025-10-02T18:16:50.063054] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-02T18:16:50.445934] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-02T18:16:50.672975] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-03. [2025-10-02T18:16:51.052084] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-02T18:16:51.473012] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-06. [2025-10-02T18:16:52.272986] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-07. [2025-10-02T18:16:52.559470] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-02T18:16:52.943961] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-02T18:16:53.073004] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-07. [2025-10-02T18:16:53.873007] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-06. [2025-10-02T18:16:54.303948] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-02T18:16:54.606418] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-02T18:16:54.673031] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-04. [2025-10-02T18:16:54.914112] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-02T18:16:55.473015] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-07. [2025-10-02T18:16:56.273007] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-08. [2025-10-02T18:16:56.776098] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-02T18:16:56.902727] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-02T18:16:57.073028] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-08. [2025-10-02T18:16:57.872973] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-05. [2025-10-02T18:16:58.000386] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-02T18:16:58.672986] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-09. [2025-10-02T18:16:59.060052] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-02T18:16:59.473019] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-08. [2025-10-02T18:16:59.833722] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-02T18:16:59.976576] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-02T18:17:00.186190] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-02T18:17:00.273018] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-10. [2025-10-02T18:17:01.072996] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-09. [2025-10-02T18:17:01.734381] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-02T18:17:01.736495] [INFO ] [REMOTE ] CUBE: Full fetch complete (73034 records). [2025-10-02T18:17:01.736677] [DEBUG] [VALIDATOR ] CUBE: Validating primary data. [2025-10-02T18:17:01.878232] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-09. [2025-10-02T18:17:02.281843] [DEBUG] [VALIDATOR ] CUBE: All expected trading days are present. [2025-10-02T18:17:02.281950] [DEBUG] [VALIDATOR ] CUBE: Primary data validation passed. [2025-10-02T18:17:02.283003] [INFO ] [MAIN ] CUBE: Fetched primary data is valid. [2025-10-02T18:17:02.283074] [DEBUG] [LOCAL ] CUBE: Saving primary data. [2025-10-02T18:17:02.284694] [DEBUG] [LOCAL ] CUBE: Trimmed 73034 records to 51004 (keeping 200 days of data) [2025-10-02T18:17:02.633452] [DEBUG] [LOCAL ] CUBE: Primary data saved (51004 records). [2025-10-02T18:17:02.633597] [INFO ] [MAIN ] CUBE: Full history saved. [2025-10-02T18:17:02.633711] [INFO ] [MAIN ] Update Progress: 555/2370 symbols completed. CUBE took 41.5s. Estimated remaining: 4h 11m 45s. Rate: 7.2 symbols/min [2025-10-02T18:17:02.677595] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-06. [2025-10-02T18:17:02.836703] [INFO ] [MAIN ] CULP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:17:02.836992] [DEBUG] [LOCAL ] CULP: No existing data file found in primary storage. [2025-10-02T18:17:02.837169] [WARN ] [MAIN ] CULP: No existing data found, performing full refresh instead. [2025-10-02T18:17:02.837395] [INFO ] [MAIN ] CULP: Wiping existing primary data before full refresh. [2025-10-02T18:17:02.837469] [INFO ] [LOCAL ] CULP: Starting deletion of primary data. [2025-10-02T18:17:02.837541] [DEBUG] [LOCAL ] CULP: No primary data file found to delete. [2025-10-02T18:17:02.837696] [INFO ] [MAIN ] CULP: Starting full primary refresh. [2025-10-02T18:17:03.091496] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-02T18:17:03.298775] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-02T18:17:03.339395] [INFO ] [REMOTE ] CULP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:17:03.473014] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-10. [2025-10-02T18:17:04.273017] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-10. [2025-10-02T18:17:04.647236] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-02T18:17:04.937705] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-02T18:17:04.939563] [INFO ] [REMOTE ] CTVA: Full fetch complete (76592 records). [2025-10-02T18:17:04.939759] [DEBUG] [VALIDATOR ] CTVA: Validating primary data. [2025-10-02T18:17:04.940582] [FATAL] [VALIDATOR ] CTVA: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:17:04.940721] [FATAL] [MAIN ] CTVA: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:17:04.940770] [WARN ] [MAIN ] CTVA: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:17:04.940813] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-10-02T18:17:04.940917] [DEBUG] [LOCAL ] CTVA: No primary data file found to delete. [2025-10-02T18:17:04.940976] [INFO ] [LOCAL ] CTVA: Starting deletion of derivative data. [2025-10-02T18:17:04.941534] [DEBUG] [LOCAL ] CTVA: Deleted derivative data file. [2025-10-02T18:17:04.941684] [INFO ] [MAIN ] Update Progress: 556/2370 symbols completed. CTVA took 47.0s. Estimated remaining: 4h 11m 17s. Rate: 7.2 symbols/min [2025-10-02T18:17:05.078106] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-07. [2025-10-02T18:17:05.132885] [INFO ] [MAIN ] CURB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:17:05.167720] [DEBUG] [LOCAL ] CURB: Loaded 32632 existing records from primary storage. [2025-10-02T18:17:05.168046] [INFO ] [MAIN ] CURB: Loaded 32632 existing records. [2025-10-02T18:17:05.288248] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-02T18:17:05.306263] [INFO ] [REMOTE ] CUBI: Full fetch complete (39356 records). [2025-10-02T18:17:05.321870] [DEBUG] [VALIDATOR ] CUBI: Validating primary data. [2025-10-02T18:17:05.461612] [WARN ] [MAIN ] CURB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:17:05.494992] [INFO ] [MAIN ] CURB: Wiping existing primary data before full refresh. [2025-10-02T18:17:05.500723] [INFO ] [LOCAL ] CURB: Starting deletion of primary data. [2025-10-02T18:17:05.517198] [DEBUG] [LOCAL ] CURB: Deleted primary data file. [2025-10-02T18:17:05.522392] [INFO ] [MAIN ] CURB: Starting full primary refresh. [2025-10-02T18:17:05.877095] [INFO ] [REMOTE ] CULP: Fetching primary data for 2024-12. [2025-10-02T18:17:06.175579] [DEBUG] [VALIDATOR ] CUBI: All expected trading days are present. [2025-10-02T18:17:06.178929] [DEBUG] [VALIDATOR ] CUBI: Primary data validation passed. [2025-10-02T18:17:06.179530] [INFO ] [MAIN ] CUBI: Fetched primary data is valid. [2025-10-02T18:17:06.179611] [DEBUG] [LOCAL ] CUBI: Saving primary data. [2025-10-02T18:17:06.228239] [DEBUG] [LOCAL ] CUBI: Trimmed 39356 records to 27296 (keeping 200 days of data) [2025-10-02T18:17:06.267873] [INFO ] [REMOTE ] CURB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:17:06.443796] [DEBUG] [LOCAL ] CUBI: Primary data saved (27296 records). [2025-10-02T18:17:06.443991] [INFO ] [MAIN ] CUBI: Full history saved. [2025-10-02T18:17:06.444074] [INFO ] [MAIN ] Update Progress: 557/2370 symbols completed. CUBI took 32.7s. Estimated remaining: 4h 10m 46s. Rate: 7.2 symbols/min [2025-10-02T18:17:06.606887] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-02T18:17:06.673045] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-01. [2025-10-02T18:17:07.090879] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-02T18:17:07.174521] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-02T18:17:07.472991] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-02. [2025-10-02T18:17:08.273005] [INFO ] [REMOTE ] CURB: Fetching primary data for 2024-12. [2025-10-02T18:17:09.073050] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-08. [2025-10-02T18:17:09.078735] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-02T18:17:09.782468] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-02T18:17:09.873041] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-03. [2025-10-02T18:17:10.352216] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-02T18:17:10.673003] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-01. [2025-10-02T18:17:11.141312] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-02T18:17:11.472992] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-09. [2025-10-02T18:17:11.988678] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-02T18:17:12.273082] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-04. [2025-10-02T18:17:12.938278] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-02T18:17:13.073020] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-05. [2025-10-02T18:17:13.163460] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-02T18:17:13.639185] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-02T18:17:13.873003] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-10. [2025-10-02T18:17:14.673045] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-06. [2025-10-02T18:17:15.176690] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-02T18:17:15.473036] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-07. [2025-10-02T18:17:15.565584] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-02T18:17:15.567740] [INFO ] [REMOTE ] CUK: Full fetch complete (73937 records). [2025-10-02T18:17:15.567894] [DEBUG] [VALIDATOR ] CUK: Validating primary data. [2025-10-02T18:17:16.002537] [DEBUG] [VALIDATOR ] CUK: All expected trading days are present. [2025-10-02T18:17:16.002723] [DEBUG] [VALIDATOR ] CUK: Primary data validation passed. [2025-10-02T18:17:16.003689] [INFO ] [MAIN ] CUK: Fetched primary data is valid. [2025-10-02T18:17:16.003768] [DEBUG] [LOCAL ] CUK: Saving primary data. [2025-10-02T18:17:16.005560] [DEBUG] [LOCAL ] CUK: Trimmed 73937 records to 51371 (keeping 200 days of data) [2025-10-02T18:17:16.099343] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-02T18:17:16.292202] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-08. [2025-10-02T18:17:16.338065] [DEBUG] [LOCAL ] CUK: Primary data saved (51371 records). [2025-10-02T18:17:16.338223] [INFO ] [MAIN ] CUK: Full history saved. [2025-10-02T18:17:16.338313] [INFO ] [MAIN ] Update Progress: 558/2370 symbols completed. CUK took 38.6s. Estimated remaining: 4h 10m 43s. Rate: 7.2 symbols/min [2025-10-02T18:17:16.921858] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-02T18:17:17.073005] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-09. [2025-10-02T18:17:17.750196] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-02T18:17:17.873014] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-10. [2025-10-02T18:17:18.441882] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-02T18:17:18.442593] [INFO ] [REMOTE ] CULP: Full fetch complete (4659 records). [2025-10-02T18:17:18.442715] [DEBUG] [VALIDATOR ] CULP: Validating primary data. [2025-10-02T18:17:18.684830] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-02. [2025-10-02T18:17:18.848898] [DEBUG] [VALIDATOR ] CULP: All expected trading days are present. [2025-10-02T18:17:18.849009] [DEBUG] [VALIDATOR ] CULP: Primary data validation passed. [2025-10-02T18:17:18.849200] [INFO ] [MAIN ] CULP: Fetched primary data is valid. [2025-10-02T18:17:18.849244] [DEBUG] [LOCAL ] CULP: Saving primary data. [2025-10-02T18:17:18.849757] [DEBUG] [LOCAL ] CULP: Trimmed 4659 records to 2954 (keeping 200 days of data) [2025-10-02T18:17:18.867494] [DEBUG] [LOCAL ] CULP: Primary data saved (2954 records). [2025-10-02T18:17:18.867592] [INFO ] [MAIN ] CULP: Full history saved. [2025-10-02T18:17:18.867728] [INFO ] [MAIN ] Update Progress: 559/2370 symbols completed. CULP took 16.2s. Estimated remaining: 4h 10m 16s. Rate: 7.2 symbols/min [2025-10-02T18:17:20.158870] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-02T18:17:20.165493] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-03. [2025-10-02T18:17:21.511960] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-02T18:17:21.520003] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-04. [2025-10-02T18:17:23.048118] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-02T18:17:23.056751] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-05. [2025-10-02T18:17:24.069359] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-02T18:17:24.077334] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-06. [2025-10-02T18:17:24.999959] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-02T18:17:25.007825] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-07. [2025-10-02T18:17:26.347318] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-02T18:17:26.355192] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-08. [2025-10-02T18:17:27.680261] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-02T18:17:27.687913] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-09. [2025-10-02T18:17:28.982330] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-02T18:17:28.990246] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-10. [2025-10-02T18:17:30.184852] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-02T18:17:30.186527] [INFO ] [REMOTE ] CURB: Full fetch complete (47303 records). [2025-10-02T18:17:30.186609] [DEBUG] [VALIDATOR ] CURB: Validating primary data. [2025-10-02T18:17:30.614742] [DEBUG] [VALIDATOR ] CURB: All expected trading days are present. [2025-10-02T18:17:30.614876] [DEBUG] [VALIDATOR ] CURB: Primary data validation passed. [2025-10-02T18:17:30.615670] [INFO ] [MAIN ] CURB: Fetched primary data is valid. [2025-10-02T18:17:30.615738] [DEBUG] [LOCAL ] CURB: Saving primary data. [2025-10-02T18:17:30.617131] [DEBUG] [LOCAL ] CURB: Trimmed 47303 records to 32869 (keeping 200 days of data) [2025-10-02T18:17:30.833661] [DEBUG] [LOCAL ] CURB: Primary data saved (32869 records). [2025-10-02T18:17:30.833823] [INFO ] [MAIN ] CURB: Full history saved. [2025-10-02T18:17:30.833908] [INFO ] [MAIN ] Update Progress: 560/2370 symbols completed. CURB took 25.9s. Estimated remaining: 4h 10m 20s. Rate: 7.2 symbols/min [2025-10-02T18:17:31.559155] [INFO ] [MAIN ] CVE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:17:31.666137] [INFO ] [MAIN ] CURV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:17:31.664603] [INFO ] [MAIN ] CVEO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:17:31.702170] [DEBUG] [LOCAL ] CVEO: No existing data file found in primary storage. [2025-10-02T18:17:31.704205] [INFO ] [MAIN ] CUZ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:17:31.704811] [WARN ] [MAIN ] CVEO: No existing data found, performing full refresh instead. [2025-10-02T18:17:31.705932] [INFO ] [MAIN ] CVEO: Wiping existing primary data before full refresh. [2025-10-02T18:17:31.705994] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-10-02T18:17:31.706043] [DEBUG] [LOCAL ] CVEO: No primary data file found to delete. [2025-10-02T18:17:31.706077] [INFO ] [MAIN ] CVEO: Starting full primary refresh. [2025-10-02T18:17:31.873763] [DEBUG] [LOCAL ] CURV: Loaded 26720 existing records from primary storage. [2025-10-02T18:17:31.928277] [INFO ] [MAIN ] CURV: Loaded 26720 existing records. [2025-10-02T18:17:32.174012] [DEBUG] [LOCAL ] CVE: Loaded 53556 existing records from primary storage. [2025-10-02T18:17:32.214623] [DEBUG] [LOCAL ] CUZ: Loaded 49353 existing records from primary storage. [2025-10-02T18:17:32.230904] [INFO ] [MAIN ] CVE: Loaded 53556 existing records. [2025-10-02T18:17:32.230576] [INFO ] [MAIN ] CUZ: Loaded 49353 existing records. [2025-10-02T18:17:32.672137] [WARN ] [MAIN ] CURV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:17:32.662737] [INFO ] [REMOTE ] CVEO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:17:32.687555] [INFO ] [MAIN ] CURV: Wiping existing primary data before full refresh. [2025-10-02T18:17:32.714474] [INFO ] [LOCAL ] CURV: Starting deletion of primary data. [2025-10-02T18:17:32.714350] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2024-12. [2025-10-02T18:17:32.756706] [DEBUG] [LOCAL ] CURV: Deleted primary data file. [2025-10-02T18:17:32.831352] [INFO ] [MAIN ] CURV: Starting full primary refresh. [2025-10-02T18:17:32.831230] [WARN ] [MAIN ] CUZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:17:32.906794] [INFO ] [MAIN ] CUZ: Wiping existing primary data before full refresh. [2025-10-02T18:17:32.901518] [WARN ] [MAIN ] CVE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:17:32.906959] [INFO ] [LOCAL ] CUZ: Starting deletion of primary data. [2025-10-02T18:17:32.938421] [DEBUG] [LOCAL ] CUZ: Deleted primary data file. [2025-10-02T18:17:32.943798] [INFO ] [MAIN ] CVE: Wiping existing primary data before full refresh. [2025-10-02T18:17:32.956261] [INFO ] [MAIN ] CUZ: Starting full primary refresh. [2025-10-02T18:17:32.961575] [INFO ] [LOCAL ] CVE: Starting deletion of primary data. [2025-10-02T18:17:33.041687] [DEBUG] [LOCAL ] CVE: Deleted primary data file. [2025-10-02T18:17:33.066868] [INFO ] [MAIN ] CVE: Starting full primary refresh. [2025-10-02T18:17:33.813178] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-02T18:17:33.935309] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-01. [2025-10-02T18:17:33.970994] [INFO ] [REMOTE ] CURV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:17:34.022604] [INFO ] [REMOTE ] CURV: Fetching primary data for 2024-12. [2025-10-02T18:17:34.026138] [INFO ] [REMOTE ] CUZ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:17:34.044175] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2024-12. [2025-10-02T18:17:34.121456] [INFO ] [REMOTE ] CVE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:17:34.121924] [INFO ] [REMOTE ] CVE: Fetching primary data for 2024-12. [2025-10-02T18:17:34.874612] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-02T18:17:34.876952] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-02. [2025-10-02T18:17:35.656015] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-02T18:17:35.664673] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-01. [2025-10-02T18:17:35.749037] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-02T18:17:35.759139] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-01. [2025-10-02T18:17:35.775704] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-02T18:17:35.779476] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-03. [2025-10-02T18:17:35.982398] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-02T18:17:35.994125] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-01. [2025-10-02T18:17:36.518803] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-02T18:17:36.523261] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-04. [2025-10-02T18:17:36.863542] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-02T18:17:36.869850] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-02. [2025-10-02T18:17:37.046067] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-02T18:17:37.056273] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-02. [2025-10-02T18:17:37.447568] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-02T18:17:37.452578] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-05. [2025-10-02T18:17:37.995991] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-02T18:17:38.002113] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-03. [2025-10-02T18:17:38.280257] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-02T18:17:38.290522] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-03. [2025-10-02T18:17:38.482113] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-02T18:17:38.673022] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-06. [2025-10-02T18:17:38.814988] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-02T18:17:39.472999] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-04. [2025-10-02T18:17:39.580400] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-02T18:17:39.816983] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-02T18:17:40.273033] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-07. [2025-10-02T18:17:40.832067] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-02T18:17:41.072997] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-05. [2025-10-02T18:17:41.354560] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-02T18:17:41.491449] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-01 (5.50 seconds). [2025-10-02T18:17:41.873010] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-04. [2025-10-02T18:17:42.074949] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-02T18:17:42.673016] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-08. [2025-10-02T18:17:43.448403] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-02T18:17:43.472968] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-05. [2025-10-02T18:17:43.645380] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-02T18:17:44.273018] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-06. [2025-10-02T18:17:45.073029] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-09. [2025-10-02T18:17:45.193230] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-02T18:17:45.458474] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-02T18:17:45.872991] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-07. [2025-10-02T18:17:46.068790] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-02T18:17:46.673002] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-02. [2025-10-02T18:17:47.363945] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-02T18:17:47.473023] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-06. [2025-10-02T18:17:48.273068] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-08. [2025-10-02T18:17:48.528702] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-02T18:17:49.073047] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-10. [2025-10-02T18:17:49.111398] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-02T18:17:49.562876] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-02T18:17:49.706331] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-02T18:17:49.707776] [INFO ] [REMOTE ] CVEO: Full fetch complete (20306 records). [2025-10-02T18:17:49.707908] [DEBUG] [VALIDATOR ] CVEO: Validating primary data. [2025-10-02T18:17:49.878154] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-09. [2025-10-02T18:17:50.174253] [DEBUG] [VALIDATOR ] CVEO: All expected trading days are present. [2025-10-02T18:17:50.174387] [DEBUG] [VALIDATOR ] CVEO: Primary data validation passed. [2025-10-02T18:17:50.174954] [INFO ] [MAIN ] CVEO: Fetched primary data is valid. [2025-10-02T18:17:50.175065] [DEBUG] [LOCAL ] CVEO: Saving primary data. [2025-10-02T18:17:50.175989] [DEBUG] [LOCAL ] CVEO: Trimmed 20306 records to 15211 (keeping 200 days of data) [2025-10-02T18:17:50.272208] [DEBUG] [LOCAL ] CVEO: Primary data saved (15211 records). [2025-10-02T18:17:50.272365] [INFO ] [MAIN ] CVEO: Full history saved. [2025-10-02T18:17:50.272446] [INFO ] [MAIN ] Update Progress: 561/2370 symbols completed. CVEO took 19.4s. Estimated remaining: 4h 10m 47s. Rate: 7.2 symbols/min [2025-10-02T18:17:50.489338] [INFO ] [MAIN ] CVI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:17:50.489557] [DEBUG] [LOCAL ] CVI: No existing data file found in primary storage. [2025-10-02T18:17:50.489604] [WARN ] [MAIN ] CVI: No existing data found, performing full refresh instead. [2025-10-02T18:17:50.489747] [INFO ] [MAIN ] CVI: Wiping existing primary data before full refresh. [2025-10-02T18:17:50.489794] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-10-02T18:17:50.489839] [DEBUG] [LOCAL ] CVI: No primary data file found to delete. [2025-10-02T18:17:50.489873] [INFO ] [MAIN ] CVI: Starting full primary refresh. [2025-10-02T18:17:50.687639] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-03. [2025-10-02T18:17:50.921903] [INFO ] [REMOTE ] CVI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:17:51.473096] [INFO ] [REMOTE ] CVI: Fetching primary data for 2024-12. [2025-10-02T18:17:51.553080] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-02T18:17:52.273022] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-07. [2025-10-02T18:17:52.564864] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-02T18:17:53.073007] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-04. [2025-10-02T18:17:53.284566] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-02T18:17:53.873044] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-10. [2025-10-02T18:17:54.007855] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-02T18:17:54.673021] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-01. [2025-10-02T18:17:54.740635] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-02T18:17:54.842429] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-02T18:17:54.844446] [INFO ] [REMOTE ] CURV: Full fetch complete (38837 records). [2025-10-02T18:17:54.844678] [DEBUG] [VALIDATOR ] CURV: Validating primary data. [2025-10-02T18:17:54.845503] [FATAL] [VALIDATOR ] CURV: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:17:54.845619] [FATAL] [MAIN ] CURV: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:17:54.845713] [WARN ] [MAIN ] CURV: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:17:54.845860] [INFO ] [LOCAL ] CURV: Starting deletion of primary data. [2025-10-02T18:17:54.845958] [DEBUG] [LOCAL ] CURV: No primary data file found to delete. [2025-10-02T18:17:54.846018] [INFO ] [LOCAL ] CURV: Starting deletion of derivative data. [2025-10-02T18:17:54.846704] [DEBUG] [LOCAL ] CURV: Deleted derivative data file. [2025-10-02T18:17:54.846930] [INFO ] [MAIN ] Update Progress: 562/2370 symbols completed. CURV took 24.0s. Estimated remaining: 4h 10m 27s. Rate: 7.2 symbols/min [2025-10-02T18:17:55.045076] [INFO ] [MAIN ] CVLG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:17:55.065381] [DEBUG] [LOCAL ] CVLG: Loaded 15428 existing records from primary storage. [2025-10-02T18:17:55.065754] [INFO ] [MAIN ] CVLG: Loaded 15428 existing records. [2025-10-02T18:17:55.260259] [WARN ] [MAIN ] CVLG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:17:55.260487] [INFO ] [MAIN ] CVLG: Wiping existing primary data before full refresh. [2025-10-02T18:17:55.260535] [INFO ] [LOCAL ] CVLG: Starting deletion of primary data. [2025-10-02T18:17:55.261101] [DEBUG] [LOCAL ] CVLG: Deleted primary data file. [2025-10-02T18:17:55.261164] [INFO ] [MAIN ] CVLG: Starting full primary refresh. [2025-10-02T18:17:55.482711] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-08. [2025-10-02T18:17:55.653432] [INFO ] [REMOTE ] CVLG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:17:56.110343] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-02T18:17:56.273037] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-05. [2025-10-02T18:17:57.073033] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-02. [2025-10-02T18:17:57.162141] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-02T18:17:57.873013] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-09. [2025-10-02T18:17:58.037730] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-02T18:17:58.678109] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-06. [2025-10-02T18:17:58.693064] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-02T18:17:59.472981] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2024-12. [2025-10-02T18:17:59.517877] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-02T18:18:00.273004] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-10. [2025-10-02T18:18:00.291789] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-02T18:18:00.632955] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-02T18:18:01.073041] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-01. [2025-10-02T18:18:01.873023] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-03. [2025-10-02T18:18:02.137364] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-02T18:18:02.147736] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-02T18:18:02.150037] [INFO ] [REMOTE ] CUZ: Full fetch complete (70797 records). [2025-10-02T18:18:02.150232] [DEBUG] [VALIDATOR ] CUZ: Validating primary data. [2025-10-02T18:18:02.593589] [DEBUG] [VALIDATOR ] CUZ: All expected trading days are present. [2025-10-02T18:18:02.593716] [DEBUG] [VALIDATOR ] CUZ: Primary data validation passed. [2025-10-02T18:18:02.594598] [INFO ] [MAIN ] CUZ: Fetched primary data is valid. [2025-10-02T18:18:02.594696] [DEBUG] [LOCAL ] CUZ: Saving primary data. [2025-10-02T18:18:02.599057] [DEBUG] [LOCAL ] CUZ: Trimmed 70797 records to 49712 (keeping 200 days of data) [2025-10-02T18:18:02.690670] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-02. [2025-10-02T18:18:02.930251] [DEBUG] [LOCAL ] CUZ: Primary data saved (49712 records). [2025-10-02T18:18:02.930499] [INFO ] [MAIN ] CUZ: Full history saved. [2025-10-02T18:18:02.930634] [INFO ] [MAIN ] Update Progress: 563/2370 symbols completed. CUZ took 32.1s. Estimated remaining: 4h 10m 18s. Rate: 7.2 symbols/min [2025-10-02T18:18:03.121446] [INFO ] [MAIN ] CVNA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:18:03.181242] [DEBUG] [LOCAL ] CVNA: Loaded 52972 existing records from primary storage. [2025-10-02T18:18:03.181605] [INFO ] [MAIN ] CVNA: Loaded 52972 existing records. [2025-10-02T18:18:03.371408] [WARN ] [MAIN ] CVNA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:18:03.371669] [INFO ] [MAIN ] CVNA: Wiping existing primary data before full refresh. [2025-10-02T18:18:03.371741] [INFO ] [LOCAL ] CVNA: Starting deletion of primary data. [2025-10-02T18:18:03.373229] [DEBUG] [LOCAL ] CVNA: Deleted primary data file. [2025-10-02T18:18:03.373290] [INFO ] [MAIN ] CVNA: Starting full primary refresh. [2025-10-02T18:18:03.478143] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-07. [2025-10-02T18:18:03.577429] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-02T18:18:03.793175] [INFO ] [REMOTE ] CVNA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:18:03.830328] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-02T18:18:04.273038] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-03. [2025-10-02T18:18:05.072977] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-04. [2025-10-02T18:18:05.188839] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-02T18:18:05.400562] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-02T18:18:05.873000] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2024-12. [2025-10-02T18:18:06.672976] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-08. [2025-10-02T18:18:06.704225] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-02T18:18:07.473073] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-05. [2025-10-02T18:18:07.954549] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-02T18:18:08.272989] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-01. [2025-10-02T18:18:08.410154] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-02T18:18:09.073671] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-09. [2025-10-02T18:18:09.076556] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-02T18:18:09.872972] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-04. [2025-10-02T18:18:10.375877] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-02T18:18:10.673021] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-02. [2025-10-02T18:18:10.981698] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-02T18:18:11.162842] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-02T18:18:11.473016] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-06. [2025-10-02T18:18:12.273032] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-10. [2025-10-02T18:18:12.684444] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-02T18:18:12.830211] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-02T18:18:13.072998] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-05. [2025-10-02T18:18:13.775274] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-02T18:18:13.776825] [INFO ] [REMOTE ] CVE: Full fetch complete (77169 records). [2025-10-02T18:18:13.776925] [DEBUG] [VALIDATOR ] CVE: Validating primary data. [2025-10-02T18:18:13.777806] [FATAL] [VALIDATOR ] CVE: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:18:13.777894] [FATAL] [MAIN ] CVE: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:18:13.777945] [WARN ] [MAIN ] CVE: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:18:13.778046] [INFO ] [LOCAL ] CVE: Starting deletion of primary data. [2025-10-02T18:18:13.778116] [DEBUG] [LOCAL ] CVE: No primary data file found to delete. [2025-10-02T18:18:13.778151] [INFO ] [LOCAL ] CVE: Starting deletion of derivative data. [2025-10-02T18:18:13.778668] [DEBUG] [LOCAL ] CVE: Deleted derivative data file. [2025-10-02T18:18:13.778767] [INFO ] [MAIN ] Update Progress: 564/2370 symbols completed. CVE took 42.9s. Estimated remaining: 4h 10m 18s. Rate: 7.2 symbols/min [2025-10-02T18:18:13.882534] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-07. [2025-10-02T18:18:13.965745] [INFO ] [MAIN ] CVS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:18:14.027378] [DEBUG] [LOCAL ] CVS: Loaded 53696 existing records from primary storage. [2025-10-02T18:18:14.027728] [INFO ] [MAIN ] CVS: Loaded 53696 existing records. [2025-10-02T18:18:14.226781] [WARN ] [MAIN ] CVS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:18:14.227086] [INFO ] [MAIN ] CVS: Wiping existing primary data before full refresh. [2025-10-02T18:18:14.227159] [INFO ] [LOCAL ] CVS: Starting deletion of primary data. [2025-10-02T18:18:14.228717] [DEBUG] [LOCAL ] CVS: Deleted primary data file. [2025-10-02T18:18:14.228785] [INFO ] [MAIN ] CVS: Starting full primary refresh. [2025-10-02T18:18:14.383139] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-02T18:18:14.654071] [INFO ] [REMOTE ] CVS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:18:14.672996] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-03. [2025-10-02T18:18:15.472959] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-06. [2025-10-02T18:18:15.591070] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-02T18:18:16.272973] [INFO ] [REMOTE ] CVS: Fetching primary data for 2024-12. [2025-10-02T18:18:16.514176] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-02T18:18:17.072975] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-07. [2025-10-02T18:18:17.108584] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-10-02T18:18:17.872976] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-08. [2025-10-02T18:18:18.166048] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-02T18:18:18.672970] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-04. [2025-10-02T18:18:18.869099] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2024-12 (2.60 seconds). [2025-10-02T18:18:19.104851] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-02T18:18:19.473025] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-09. [2025-10-02T18:18:20.272993] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-01. [2025-10-02T18:18:20.953537] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-02T18:18:21.022604] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-02T18:18:21.073008] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-08. [2025-10-02T18:18:21.872985] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-05. [2025-10-02T18:18:22.053481] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-02T18:18:22.090637] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-02T18:18:22.672994] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-02. [2025-10-02T18:18:23.472994] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-09. [2025-10-02T18:18:24.170444] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-10-02T18:18:24.272957] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-10. [2025-10-02T18:18:24.273836] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-02T18:18:24.709564] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-02T18:18:25.073036] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-10. [2025-10-02T18:18:25.704743] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-02T18:18:25.707040] [INFO ] [REMOTE ] CVLG: Full fetch complete (20862 records). [2025-10-02T18:18:25.707142] [DEBUG] [VALIDATOR ] CVLG: Validating primary data. [2025-10-02T18:18:25.707836] [FATAL] [VALIDATOR ] CVLG: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:18:25.707926] [FATAL] [MAIN ] CVLG: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:18:25.707970] [WARN ] [MAIN ] CVLG: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:18:25.708093] [INFO ] [LOCAL ] CVLG: Starting deletion of primary data. [2025-10-02T18:18:25.708189] [DEBUG] [LOCAL ] CVLG: No primary data file found to delete. [2025-10-02T18:18:25.708248] [INFO ] [LOCAL ] CVLG: Starting deletion of derivative data. [2025-10-02T18:18:25.708796] [DEBUG] [LOCAL ] CVLG: Deleted derivative data file. [2025-10-02T18:18:25.708929] [INFO ] [MAIN ] Update Progress: 565/2370 symbols completed. CVLG took 30.9s. Estimated remaining: 4h 10m 21s. Rate: 7.2 symbols/min [2025-10-02T18:18:25.835275] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-02T18:18:25.863380] [INFO ] [REMOTE ] CVI: Full fetch complete (66991 records). [2025-10-02T18:18:25.880917] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-03. [2025-10-02T18:18:25.894740] [DEBUG] [VALIDATOR ] CVI: Validating primary data. [2025-10-02T18:18:25.919593] [INFO ] [MAIN ] CVX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:18:25.920026] [DEBUG] [LOCAL ] CVX: No existing data file found in primary storage. [2025-10-02T18:18:25.920888] [WARN ] [MAIN ] CVX: No existing data found, performing full refresh instead. [2025-10-02T18:18:25.921034] [INFO ] [MAIN ] CVX: Wiping existing primary data before full refresh. [2025-10-02T18:18:25.921127] [INFO ] [LOCAL ] CVX: Starting deletion of primary data. [2025-10-02T18:18:25.921193] [DEBUG] [LOCAL ] CVX: No primary data file found to delete. [2025-10-02T18:18:25.921277] [INFO ] [MAIN ] CVX: Starting full primary refresh. [2025-10-02T18:18:25.933837] [FATAL] [VALIDATOR ] CVI: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:18:25.990079] [FATAL] [MAIN ] CVI: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:18:26.018231] [WARN ] [MAIN ] CVI: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:18:26.044731] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-10-02T18:18:26.055937] [DEBUG] [LOCAL ] CVI: No primary data file found to delete. [2025-10-02T18:18:26.061159] [INFO ] [LOCAL ] CVI: Starting deletion of derivative data. [2025-10-02T18:18:26.061252] [DEBUG] [LOCAL ] CVI: No derivative data file found to delete. [2025-10-02T18:18:26.066525] [INFO ] [MAIN ] Update Progress: 566/2370 symbols completed. CVI took 35.8s. Estimated remaining: 4h 9m 47s. Rate: 7.2 symbols/min [2025-10-02T18:18:26.477131] [INFO ] [MAIN ] CW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:18:26.541019] [INFO ] [REMOTE ] CVX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:18:26.564709] [DEBUG] [LOCAL ] CW: Loaded 22276 existing records from primary storage. [2025-10-02T18:18:26.565104] [INFO ] [MAIN ] CW: Loaded 22276 existing records. [2025-10-02T18:18:26.678446] [INFO ] [REMOTE ] CVX: Fetching primary data for 2024-12. [2025-10-02T18:18:26.765203] [WARN ] [MAIN ] CW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:18:26.765435] [INFO ] [MAIN ] CW: Wiping existing primary data before full refresh. [2025-10-02T18:18:26.765484] [INFO ] [LOCAL ] CW: Starting deletion of primary data. [2025-10-02T18:18:26.766338] [DEBUG] [LOCAL ] CW: Deleted primary data file. [2025-10-02T18:18:26.766402] [INFO ] [MAIN ] CW: Starting full primary refresh. [2025-10-02T18:18:27.155866] [INFO ] [REMOTE ] CW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:18:27.473048] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-06. [2025-10-02T18:18:28.100726] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-02T18:18:28.273041] [INFO ] [REMOTE ] CW: Fetching primary data for 2024-12. [2025-10-02T18:18:28.588320] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-02T18:18:29.073024] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-04. [2025-10-02T18:18:29.420716] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-02T18:18:29.490828] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-02T18:18:29.873048] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-01. [2025-10-02T18:18:30.672995] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-07. [2025-10-02T18:18:30.807904] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-02T18:18:31.035363] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-02T18:18:31.473012] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-05. [2025-10-02T18:18:32.272998] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-02. [2025-10-02T18:18:32.932424] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-02T18:18:33.073039] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-01. [2025-10-02T18:18:33.719665] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-10-02T18:18:33.821147] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-02T18:18:33.872989] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-06. [2025-10-02T18:18:34.673001] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-08. [2025-10-02T18:18:34.955594] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-02T18:18:35.472981] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-02. [2025-10-02T18:18:35.679774] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-02T18:18:36.273007] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-07. [2025-10-02T18:18:36.896572] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-02T18:18:37.073444] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-03. [2025-10-02T18:18:37.073361] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-02T18:18:37.872977] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-09. [2025-10-02T18:18:38.318396] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-02T18:18:38.392325] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-02T18:18:38.673032] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-08. [2025-10-02T18:18:39.473037] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-04. [2025-10-02T18:18:39.932161] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-02T18:18:40.273470] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-03. [2025-10-02T18:18:40.690324] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-02T18:18:40.798708] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-02T18:18:41.072985] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-05. [2025-10-02T18:18:41.873055] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-09. [2025-10-02T18:18:42.052194] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-02T18:18:42.423400] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-02T18:18:42.673016] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-10. [2025-10-02T18:18:43.473027] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-04. [2025-10-02T18:18:43.555940] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-02T18:18:44.273038] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-10. [2025-10-02T18:18:44.426530] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-02T18:18:44.429037] [INFO ] [REMOTE ] CVNA: Full fetch complete (76649 records). [2025-10-02T18:18:44.429171] [DEBUG] [VALIDATOR ] CVNA: Validating primary data. [2025-10-02T18:18:44.878943] [DEBUG] [VALIDATOR ] CVNA: All expected trading days are present. [2025-10-02T18:18:44.879038] [DEBUG] [VALIDATOR ] CVNA: Primary data validation passed. [2025-10-02T18:18:44.879980] [INFO ] [MAIN ] CVNA: Fetched primary data is valid. [2025-10-02T18:18:44.880050] [DEBUG] [LOCAL ] CVNA: Saving primary data. [2025-10-02T18:18:44.881822] [DEBUG] [LOCAL ] CVNA: Trimmed 76649 records to 53343 (keeping 200 days of data) [2025-10-02T18:18:45.076282] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-06. [2025-10-02T18:18:45.240135] [DEBUG] [LOCAL ] CVNA: Primary data saved (53343 records). [2025-10-02T18:18:45.240293] [INFO ] [MAIN ] CVNA: Full history saved. [2025-10-02T18:18:45.240391] [INFO ] [MAIN ] Update Progress: 567/2370 symbols completed. CVNA took 42.3s. Estimated remaining: 4h 10m 14s. Rate: 7.2 symbols/min [2025-10-02T18:18:45.435587] [INFO ] [MAIN ] CWAN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:18:45.435779] [DEBUG] [LOCAL ] CWAN: No existing data file found in primary storage. [2025-10-02T18:18:45.435877] [WARN ] [MAIN ] CWAN: No existing data found, performing full refresh instead. [2025-10-02T18:18:45.435999] [INFO ] [MAIN ] CWAN: Wiping existing primary data before full refresh. [2025-10-02T18:18:45.436043] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-10-02T18:18:45.436087] [DEBUG] [LOCAL ] CWAN: No primary data file found to delete. [2025-10-02T18:18:45.436125] [INFO ] [MAIN ] CWAN: Starting full primary refresh. [2025-10-02T18:18:45.841260] [INFO ] [REMOTE ] CWAN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:18:45.873048] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2024-12. [2025-10-02T18:18:46.013887] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-04 (2.54 seconds). [2025-10-02T18:18:46.042130] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-02T18:18:46.045020] [INFO ] [REMOTE ] CVS: Full fetch complete (77813 records). [2025-10-02T18:18:46.045135] [DEBUG] [VALIDATOR ] CVS: Validating primary data. [2025-10-02T18:18:46.503116] [DEBUG] [VALIDATOR ] CVS: All expected trading days are present. [2025-10-02T18:18:46.502982] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-02T18:18:46.503326] [DEBUG] [VALIDATOR ] CVS: Primary data validation passed. [2025-10-02T18:18:46.510347] [INFO ] [MAIN ] CVS: Fetched primary data is valid. [2025-10-02T18:18:46.510452] [DEBUG] [LOCAL ] CVS: Saving primary data. [2025-10-02T18:18:46.512595] [DEBUG] [LOCAL ] CVS: Trimmed 77813 records to 54086 (keeping 200 days of data) [2025-10-02T18:18:46.705237] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-05. [2025-10-02T18:18:46.871232] [DEBUG] [LOCAL ] CVS: Primary data saved (54086 records). [2025-10-02T18:18:46.871388] [INFO ] [MAIN ] CVS: Full history saved. [2025-10-02T18:18:46.871477] [INFO ] [MAIN ] Update Progress: 568/2370 symbols completed. CVS took 33.1s. Estimated remaining: 4h 9m 44s. Rate: 7.2 symbols/min [2025-10-02T18:18:47.076362] [INFO ] [MAIN ] CWEN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:18:47.076591] [DEBUG] [LOCAL ] CWEN: No existing data file found in primary storage. [2025-10-02T18:18:47.076683] [WARN ] [MAIN ] CWEN: No existing data found, performing full refresh instead. [2025-10-02T18:18:47.076811] [INFO ] [MAIN ] CWEN: Wiping existing primary data before full refresh. [2025-10-02T18:18:47.076855] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-10-02T18:18:47.076899] [DEBUG] [LOCAL ] CWEN: No primary data file found to delete. [2025-10-02T18:18:47.076934] [INFO ] [MAIN ] CWEN: Starting full primary refresh. [2025-10-02T18:18:47.479732] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-07. [2025-10-02T18:18:47.505233] [INFO ] [REMOTE ] CWEN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:18:47.583794] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-02T18:18:48.273013] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-01. [2025-10-02T18:18:48.274185] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-02T18:18:49.073030] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2024-12. [2025-10-02T18:18:49.204820] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-10-02T18:18:49.873027] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-08. [2025-10-02T18:18:49.907618] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-02T18:18:50.412119] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-02T18:18:50.673052] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-01. [2025-10-02T18:18:51.143567] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-02T18:18:51.473046] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-09. [2025-10-02T18:18:52.246176] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-02T18:18:52.272996] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-06. [2025-10-02T18:18:52.510579] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-02T18:18:53.073014] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-02. [2025-10-02T18:18:53.873013] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-10. [2025-10-02T18:18:54.453872] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-10-02T18:18:54.613350] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-02T18:18:54.634368] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-02T18:18:54.635747] [INFO ] [REMOTE ] CW: Full fetch complete (33333 records). [2025-10-02T18:18:54.635841] [DEBUG] [VALIDATOR ] CW: Validating primary data. [2025-10-02T18:18:54.678201] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-02. [2025-10-02T18:18:55.031594] [DEBUG] [VALIDATOR ] CW: All expected trading days are present. [2025-10-02T18:18:55.031703] [DEBUG] [VALIDATOR ] CW: Primary data validation passed. [2025-10-02T18:18:55.032283] [INFO ] [MAIN ] CW: Fetched primary data is valid. [2025-10-02T18:18:55.032350] [DEBUG] [LOCAL ] CW: Saving primary data. [2025-10-02T18:18:55.033252] [DEBUG] [LOCAL ] CW: Trimmed 33333 records to 22388 (keeping 200 days of data) [2025-10-02T18:18:55.195433] [DEBUG] [LOCAL ] CW: Primary data saved (22388 records). [2025-10-02T18:18:55.195566] [INFO ] [MAIN ] CW: Full history saved. [2025-10-02T18:18:55.195669] [INFO ] [MAIN ] Update Progress: 569/2370 symbols completed. CW took 29.1s. Estimated remaining: 4h 9m 36s. Rate: 7.2 symbols/min [2025-10-02T18:18:55.383192] [INFO ] [MAIN ] CWH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:18:55.442714] [DEBUG] [LOCAL ] CWH: Loaded 51374 existing records from primary storage. [2025-10-02T18:18:55.443064] [INFO ] [MAIN ] CWH: Loaded 51374 existing records. [2025-10-02T18:18:55.478110] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-07. [2025-10-02T18:18:55.658206] [WARN ] [MAIN ] CWH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:18:55.658425] [INFO ] [MAIN ] CWH: Wiping existing primary data before full refresh. [2025-10-02T18:18:55.658475] [INFO ] [LOCAL ] CWH: Starting deletion of primary data. [2025-10-02T18:18:55.661152] [DEBUG] [LOCAL ] CWH: Deleted primary data file. [2025-10-02T18:18:55.661251] [INFO ] [MAIN ] CWH: Starting full primary refresh. [2025-10-02T18:18:56.069110] [INFO ] [REMOTE ] CWH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:18:56.273027] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-03. [2025-10-02T18:18:56.398464] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-02T18:18:57.072987] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-03. [2025-10-02T18:18:57.870996] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-02T18:18:57.882584] [INFO ] [REMOTE ] CWH: Fetching primary data for 2024-12. [2025-10-02T18:18:57.959819] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-02T18:18:58.581806] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-02T18:18:58.673031] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-08. [2025-10-02T18:18:59.472996] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-04. [2025-10-02T18:18:59.618754] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-02T18:19:00.273022] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-01. [2025-10-02T18:19:01.073107] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-04. [2025-10-02T18:19:01.074532] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-10-02T18:19:01.135584] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-02T18:19:01.644383] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-02T18:19:01.873033] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-05. [2025-10-02T18:19:02.464778] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-02T18:19:02.672996] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-05. [2025-10-02T18:19:03.472982] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-02. [2025-10-02T18:19:03.637407] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-02T18:19:04.278109] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-09. [2025-10-02T18:19:04.293757] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-02T18:19:05.055405] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-02T18:19:05.072955] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-03. [2025-10-02T18:19:05.873021] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-06. [2025-10-02T18:19:06.599011] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-10-02T18:19:06.673003] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-10. [2025-10-02T18:19:06.823508] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-02T18:19:07.473031] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-04. [2025-10-02T18:19:07.515263] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-02T18:19:08.272981] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-06. [2025-10-02T18:19:08.485751] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-02T18:19:08.487876] [INFO ] [REMOTE ] CVX: Full fetch complete (77845 records). [2025-10-02T18:19:08.491365] [DEBUG] [VALIDATOR ] CVX: Validating primary data. [2025-10-02T18:19:08.924500] [DEBUG] [VALIDATOR ] CVX: All expected trading days are present. [2025-10-02T18:19:08.924717] [DEBUG] [VALIDATOR ] CVX: Primary data validation passed. [2025-10-02T18:19:08.925976] [INFO ] [MAIN ] CVX: Fetched primary data is valid. [2025-10-02T18:19:08.926165] [DEBUG] [LOCAL ] CVX: Saving primary data. [2025-10-02T18:19:08.928151] [DEBUG] [LOCAL ] CVX: Trimmed 77845 records to 54150 (keeping 200 days of data) [2025-10-02T18:19:09.081831] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-07. [2025-10-02T18:19:09.089765] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-02T18:19:09.363446] [DEBUG] [LOCAL ] CVX: Primary data saved (54150 records). [2025-10-02T18:19:09.363802] [INFO ] [MAIN ] CVX: Full history saved. [2025-10-02T18:19:09.363906] [INFO ] [MAIN ] Update Progress: 570/2370 symbols completed. CVX took 43.7s. Estimated remaining: 4h 9m 46s. Rate: 7.2 symbols/min [2025-10-02T18:19:09.552103] [INFO ] [MAIN ] CWK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:19:09.601262] [DEBUG] [LOCAL ] CWK: Loaded 49410 existing records from primary storage. [2025-10-02T18:19:09.601592] [INFO ] [MAIN ] CWK: Loaded 49410 existing records. [2025-10-02T18:19:09.806856] [WARN ] [MAIN ] CWK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:19:09.807237] [INFO ] [MAIN ] CWK: Wiping existing primary data before full refresh. [2025-10-02T18:19:09.807321] [INFO ] [LOCAL ] CWK: Starting deletion of primary data. [2025-10-02T18:19:09.809364] [DEBUG] [LOCAL ] CWK: Deleted primary data file. [2025-10-02T18:19:09.809431] [INFO ] [MAIN ] CWK: Starting full primary refresh. [2025-10-02T18:19:09.873679] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-05. [2025-10-02T18:19:09.968930] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-02T18:19:10.280554] [INFO ] [REMOTE ] CWK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:19:10.673008] [INFO ] [REMOTE ] CWK: Fetching primary data for 2024-12. [2025-10-02T18:19:10.989554] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-02T18:19:11.472999] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-08. [2025-10-02T18:19:11.573569] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-02T18:19:12.280801] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-06. [2025-10-02T18:19:12.287187] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-02T18:19:13.073009] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-01. [2025-10-02T18:19:13.337015] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-02T18:19:13.873006] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-07. [2025-10-02T18:19:14.182412] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-02T18:19:14.581699] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-02T18:19:14.672991] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-02. [2025-10-02T18:19:15.235710] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-02T18:19:15.473007] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-08. [2025-10-02T18:19:16.272968] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-07. [2025-10-02T18:19:16.307700] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-02T18:19:17.040777] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-02T18:19:17.072996] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-09. [2025-10-02T18:19:17.753504] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-02T18:19:17.872995] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-03. [2025-10-02T18:19:18.593232] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-02T18:19:18.672981] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-08. [2025-10-02T18:19:19.382531] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-02T18:19:19.472986] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-04. [2025-10-02T18:19:19.916063] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-02T18:19:20.273056] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-09. [2025-10-02T18:19:21.070120] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-02T18:19:21.080119] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-09. [2025-10-02T18:19:21.873009] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-05. [2025-10-02T18:19:22.207216] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-02T18:19:22.672986] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-10. [2025-10-02T18:19:22.926887] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-02T18:19:23.473006] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-10. [2025-10-02T18:19:23.655220] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-02T18:19:24.174270] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-02T18:19:24.176485] [INFO ] [REMOTE ] CWEN: Full fetch complete (64684 records). [2025-10-02T18:19:24.176728] [DEBUG] [VALIDATOR ] CWEN: Validating primary data. [2025-10-02T18:19:24.278212] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-10. [2025-10-02T18:19:24.614145] [DEBUG] [VALIDATOR ] CWEN: All expected trading days are present. [2025-10-02T18:19:24.614228] [DEBUG] [VALIDATOR ] CWEN: Primary data validation passed. [2025-10-02T18:19:24.615081] [INFO ] [MAIN ] CWEN: Fetched primary data is valid. [2025-10-02T18:19:24.615149] [DEBUG] [LOCAL ] CWEN: Saving primary data. [2025-10-02T18:19:24.616523] [DEBUG] [LOCAL ] CWEN: Trimmed 64684 records to 45415 (keeping 200 days of data) [2025-10-02T18:19:24.858008] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-02T18:19:24.863401] [INFO ] [REMOTE ] CWH: Full fetch complete (72959 records). [2025-10-02T18:19:24.864430] [DEBUG] [VALIDATOR ] CWH: Validating primary data. [2025-10-02T18:19:25.083273] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-06. [2025-10-02T18:19:25.347599] [DEBUG] [VALIDATOR ] CWH: All expected trading days are present. [2025-10-02T18:19:25.348041] [DEBUG] [VALIDATOR ] CWH: Primary data validation passed. [2025-10-02T18:19:25.349429] [INFO ] [MAIN ] CWH: Fetched primary data is valid. [2025-10-02T18:19:25.349511] [DEBUG] [LOCAL ] CWH: Saving primary data. [2025-10-02T18:19:25.356086] [DEBUG] [LOCAL ] CWH: Trimmed 72959 records to 51715 (keeping 200 days of data) [2025-10-02T18:19:25.489227] [DEBUG] [LOCAL ] CWEN: Primary data saved (45415 records). [2025-10-02T18:19:25.489933] [INFO ] [MAIN ] CWEN: Full history saved. [2025-10-02T18:19:25.490264] [INFO ] [MAIN ] Update Progress: 571/2370 symbols completed. CWEN took 38.6s. Estimated remaining: 4h 10m 2s. Rate: 7.2 symbols/min [2025-10-02T18:19:25.694191] [INFO ] [MAIN ] CWT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:19:25.690519] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-02T18:19:25.699849] [INFO ] [REMOTE ] CWAN: Full fetch complete (74746 records). [2025-10-02T18:19:25.700283] [DEBUG] [VALIDATOR ] CWAN: Validating primary data. [2025-10-02T18:19:25.704015] [FATAL] [VALIDATOR ] CWAN: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:19:25.704960] [FATAL] [MAIN ] CWAN: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:19:25.705800] [WARN ] [MAIN ] CWAN: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:19:25.706431] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-10-02T18:19:25.706920] [DEBUG] [LOCAL ] CWAN: No primary data file found to delete. [2025-10-02T18:19:25.707610] [INFO ] [LOCAL ] CWAN: Starting deletion of derivative data. [2025-10-02T18:19:25.708475] [DEBUG] [LOCAL ] CWAN: No derivative data file found to delete. [2025-10-02T18:19:25.708915] [INFO ] [MAIN ] Update Progress: 572/2370 symbols completed. CWAN took 40.5s. Estimated remaining: 4h 9m 28s. Rate: 7.2 symbols/min [2025-10-02T18:19:25.851001] [DEBUG] [LOCAL ] CWT: Loaded 27897 existing records from primary storage. [2025-10-02T18:19:25.852283] [INFO ] [MAIN ] CWT: Loaded 27897 existing records. [2025-10-02T18:19:26.074953] [INFO ] [MAIN ] CX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:19:26.238479] [WARN ] [MAIN ] CWT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:19:26.239210] [INFO ] [MAIN ] CWT: Wiping existing primary data before full refresh. [2025-10-02T18:19:26.241187] [INFO ] [LOCAL ] CWT: Starting deletion of primary data. [2025-10-02T18:19:26.244943] [DEBUG] [LOCAL ] CWT: Deleted primary data file. [2025-10-02T18:19:26.245398] [INFO ] [MAIN ] CWT: Starting full primary refresh. [2025-10-02T18:19:26.467100] [DEBUG] [LOCAL ] CX: Loaded 52827 existing records from primary storage. [2025-10-02T18:19:26.502012] [INFO ] [MAIN ] CX: Loaded 52827 existing records. [2025-10-02T18:19:26.844243] [INFO ] [REMOTE ] CWT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:19:26.860571] [INFO ] [REMOTE ] CWT: Fetching primary data for 2024-12. [2025-10-02T18:19:27.038132] [WARN ] [MAIN ] CX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:19:27.041155] [INFO ] [MAIN ] CX: Wiping existing primary data before full refresh. [2025-10-02T18:19:27.042733] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-02T18:19:27.046739] [INFO ] [LOCAL ] CX: Starting deletion of primary data. [2025-10-02T18:19:27.056345] [DEBUG] [LOCAL ] CX: Deleted primary data file. [2025-10-02T18:19:27.056743] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-07. [2025-10-02T18:19:27.057123] [INFO ] [MAIN ] CX: Starting full primary refresh. [2025-10-02T18:19:27.209267] [DEBUG] [LOCAL ] CWH: Primary data saved (51715 records). [2025-10-02T18:19:27.235751] [INFO ] [MAIN ] CWH: Full history saved. [2025-10-02T18:19:27.241059] [INFO ] [MAIN ] Update Progress: 573/2370 symbols completed. CWH took 32.0s. Estimated remaining: 4h 8m 59s. Rate: 7.2 symbols/min [2025-10-02T18:19:27.679154] [INFO ] [MAIN ] CXE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:19:27.724271] [INFO ] [REMOTE ] CX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:19:27.724712] [INFO ] [REMOTE ] CX: Fetching primary data for 2024-12. [2025-10-02T18:19:27.733532] [DEBUG] [LOCAL ] CXE: Loaded 6571 existing records from primary storage. [2025-10-02T18:19:27.733807] [INFO ] [MAIN ] CXE: Loaded 6571 existing records. [2025-10-02T18:19:27.922558] [WARN ] [MAIN ] CXE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:19:27.922846] [INFO ] [MAIN ] CXE: Wiping existing primary data before full refresh. [2025-10-02T18:19:27.922908] [INFO ] [LOCAL ] CXE: Starting deletion of primary data. [2025-10-02T18:19:27.923405] [DEBUG] [LOCAL ] CXE: Deleted primary data file. [2025-10-02T18:19:27.923467] [INFO ] [MAIN ] CXE: Starting full primary refresh. [2025-10-02T18:19:28.310372] [INFO ] [REMOTE ] CXE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:19:28.310854] [INFO ] [REMOTE ] CXE: Fetching primary data for 2024-12. [2025-10-02T18:19:28.331072] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-02T18:19:28.897509] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-02T18:19:28.904019] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-02T18:19:29.073002] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-01. [2025-10-02T18:19:29.553432] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-02T18:19:29.873014] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-08. [2025-10-02T18:19:30.027558] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-02T18:19:30.673051] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-01. [2025-10-02T18:19:31.473018] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-02. [2025-10-02T18:19:31.588225] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-02T18:19:32.165509] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-02T18:19:32.273031] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-02. [2025-10-02T18:19:32.680519] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-02T18:19:33.073071] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-09. [2025-10-02T18:19:33.629918] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-02T18:19:33.873032] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-01. [2025-10-02T18:19:34.672985] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-03. [2025-10-02T18:19:34.771898] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-02T18:19:35.014142] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-02T18:19:35.473011] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-10. [2025-10-02T18:19:35.958789] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-02T18:19:36.273032] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-04. [2025-10-02T18:19:36.901386] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-02T18:19:36.903427] [INFO ] [REMOTE ] CWK: Full fetch complete (71007 records). [2025-10-02T18:19:36.903527] [DEBUG] [VALIDATOR ] CWK: Validating primary data. [2025-10-02T18:19:37.086360] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-02. [2025-10-02T18:19:37.323636] [DEBUG] [VALIDATOR ] CWK: All expected trading days are present. [2025-10-02T18:19:37.323755] [DEBUG] [VALIDATOR ] CWK: Primary data validation passed. [2025-10-02T18:19:37.324702] [INFO ] [MAIN ] CWK: Fetched primary data is valid. [2025-10-02T18:19:37.324769] [DEBUG] [LOCAL ] CWK: Saving primary data. [2025-10-02T18:19:37.326234] [DEBUG] [LOCAL ] CWK: Trimmed 71007 records to 49782 (keeping 200 days of data) [2025-10-02T18:19:37.658245] [DEBUG] [LOCAL ] CWK: Primary data saved (49782 records). [2025-10-02T18:19:37.659224] [INFO ] [MAIN ] CWK: Full history saved. [2025-10-02T18:19:37.660111] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-02T18:19:37.661495] [INFO ] [MAIN ] Update Progress: 574/2370 symbols completed. CWK took 28.3s. Estimated remaining: 4h 8m 57s. Rate: 7.2 symbols/min [2025-10-02T18:19:37.817738] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-02T18:19:37.872967] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-03. [2025-10-02T18:19:37.874978] [INFO ] [MAIN ] CXH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:19:37.883418] [DEBUG] [LOCAL ] CXH: Loaded 4413 existing records from primary storage. [2025-10-02T18:19:37.884051] [INFO ] [MAIN ] CXH: Loaded 4413 existing records. [2025-10-02T18:19:38.069669] [WARN ] [MAIN ] CXH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:19:38.069882] [INFO ] [MAIN ] CXH: Wiping existing primary data before full refresh. [2025-10-02T18:19:38.069932] [INFO ] [LOCAL ] CXH: Starting deletion of primary data. [2025-10-02T18:19:38.070322] [DEBUG] [LOCAL ] CXH: Deleted primary data file. [2025-10-02T18:19:38.070382] [INFO ] [MAIN ] CXH: Starting full primary refresh. [2025-10-02T18:19:38.453405] [INFO ] [REMOTE ] CXH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:19:38.673006] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-05. [2025-10-02T18:19:38.731568] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-02T18:19:39.473020] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-04. [2025-10-02T18:19:40.101885] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-02T18:19:40.220450] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-02T18:19:40.273005] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-05. [2025-10-02T18:19:41.066832] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-02T18:19:41.072951] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-06. [2025-10-02T18:19:41.655662] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-02T18:19:41.873028] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-07. [2025-10-02T18:19:42.531270] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-02T18:19:42.673022] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-06. [2025-10-02T18:19:43.473012] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-03. [2025-10-02T18:19:43.867395] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-02T18:19:44.273054] [INFO ] [REMOTE ] CXH: Fetching primary data for 2024-12. [2025-10-02T18:19:44.949880] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-02T18:19:45.072973] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-01. [2025-10-02T18:19:45.258097] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-02T18:19:45.455957] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-02T18:19:45.873010] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-08. [2025-10-02T18:19:46.459906] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-02T18:19:46.673006] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-07. [2025-10-02T18:19:47.473026] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-02. [2025-10-02T18:19:47.870681] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-02T18:19:47.922386] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-02T18:19:48.272999] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-03. [2025-10-02T18:19:48.716489] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-02T18:19:49.072948] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-08. [2025-10-02T18:19:49.873005] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-04. [2025-10-02T18:19:50.361413] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-02T18:19:50.375756] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-02T18:19:50.673027] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-09. [2025-10-02T18:19:51.473030] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-09. [2025-10-02T18:19:51.522381] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-02T18:19:52.273015] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-10. [2025-10-02T18:19:52.744939] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-02T18:19:52.806628] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-02T18:19:52.807543] [INFO ] [REMOTE ] CXE: Full fetch complete (11776 records). [2025-10-02T18:19:52.807617] [DEBUG] [VALIDATOR ] CXE: Validating primary data. [2025-10-02T18:19:53.078137] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-10. [2025-10-02T18:19:53.220771] [DEBUG] [VALIDATOR ] CXE: All expected trading days are present. [2025-10-02T18:19:53.220855] [DEBUG] [VALIDATOR ] CXE: Primary data validation passed. [2025-10-02T18:19:53.221167] [INFO ] [MAIN ] CXE: Fetched primary data is valid. [2025-10-02T18:19:53.221213] [DEBUG] [LOCAL ] CXE: Saving primary data. [2025-10-02T18:19:53.221705] [DEBUG] [LOCAL ] CXE: Trimmed 11776 records to 6615 (keeping 200 days of data) [2025-10-02T18:19:53.263958] [DEBUG] [LOCAL ] CXE: Primary data saved (6615 records). [2025-10-02T18:19:53.264128] [INFO ] [MAIN ] CXE: Full history saved. [2025-10-02T18:19:53.264227] [INFO ] [MAIN ] Update Progress: 575/2370 symbols completed. CXE took 26.0s. Estimated remaining: 4h 9m 11s. Rate: 7.2 symbols/min [2025-10-02T18:19:53.454155] [INFO ] [MAIN ] CXM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:19:53.503096] [DEBUG] [LOCAL ] CXM: Loaded 47646 existing records from primary storage. [2025-10-02T18:19:53.503426] [INFO ] [MAIN ] CXM: Loaded 47646 existing records. [2025-10-02T18:19:53.723341] [WARN ] [MAIN ] CXM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:19:53.723578] [INFO ] [MAIN ] CXM: Wiping existing primary data before full refresh. [2025-10-02T18:19:53.723627] [INFO ] [LOCAL ] CXM: Starting deletion of primary data. [2025-10-02T18:19:53.725467] [DEBUG] [LOCAL ] CXM: Deleted primary data file. [2025-10-02T18:19:53.725540] [INFO ] [MAIN ] CXM: Starting full primary refresh. [2025-10-02T18:19:53.878156] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-05. [2025-10-02T18:19:54.119275] [INFO ] [REMOTE ] CXM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:19:54.125056] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-02T18:19:54.127434] [INFO ] [REMOTE ] CWT: Full fetch complete (40461 records). [2025-10-02T18:19:54.127576] [DEBUG] [VALIDATOR ] CWT: Validating primary data. [2025-10-02T18:19:54.560938] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-02T18:19:54.561180] [DEBUG] [VALIDATOR ] CWT: All expected trading days are present. [2025-10-02T18:19:54.562691] [DEBUG] [VALIDATOR ] CWT: Primary data validation passed. [2025-10-02T18:19:54.564194] [INFO ] [MAIN ] CWT: Fetched primary data is valid. [2025-10-02T18:19:54.564264] [DEBUG] [LOCAL ] CWT: Saving primary data. [2025-10-02T18:19:54.565294] [DEBUG] [LOCAL ] CWT: Trimmed 40461 records to 28121 (keeping 200 days of data) [2025-10-02T18:19:54.673635] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-06. [2025-10-02T18:19:54.742858] [DEBUG] [LOCAL ] CWT: Primary data saved (28121 records). [2025-10-02T18:19:54.742992] [INFO ] [MAIN ] CWT: Full history saved. [2025-10-02T18:19:54.743074] [INFO ] [MAIN ] Update Progress: 576/2370 symbols completed. CWT took 29.3s. Estimated remaining: 4h 8m 42s. Rate: 7.2 symbols/min [2025-10-02T18:19:54.925108] [INFO ] [MAIN ] CXT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:19:54.958493] [DEBUG] [LOCAL ] CXT: Loaded 30989 existing records from primary storage. [2025-10-02T18:19:54.958873] [INFO ] [MAIN ] CXT: Loaded 30989 existing records. [2025-10-02T18:19:55.184730] [WARN ] [MAIN ] CXT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:19:55.185006] [INFO ] [MAIN ] CXT: Wiping existing primary data before full refresh. [2025-10-02T18:19:55.185066] [INFO ] [LOCAL ] CXT: Starting deletion of primary data. [2025-10-02T18:19:55.188037] [DEBUG] [LOCAL ] CXT: Deleted primary data file. [2025-10-02T18:19:55.188126] [INFO ] [MAIN ] CXT: Starting full primary refresh. [2025-10-02T18:19:55.324743] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-02T18:19:55.479154] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-07. [2025-10-02T18:19:55.615571] [INFO ] [REMOTE ] CXT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:19:56.273010] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-04. [2025-10-02T18:19:56.297023] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-02T18:19:57.072979] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-08. [2025-10-02T18:19:57.653467] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-02T18:19:57.873129] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-09. [2025-10-02T18:19:58.132228] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-02T18:19:58.517528] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-02T18:19:58.672998] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-05. [2025-10-02T18:19:59.473015] [INFO ] [REMOTE ] CXM: Fetching primary data for 2024-12. [2025-10-02T18:20:00.273043] [INFO ] [REMOTE ] CXT: Fetching primary data for 2024-12. [2025-10-02T18:20:00.325980] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-02T18:20:01.073012] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-06. [2025-10-02T18:20:01.251106] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-02T18:20:01.734597] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-02T18:20:01.873056] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-01. [2025-10-02T18:20:02.563609] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-02T18:20:02.672996] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-07. [2025-10-02T18:20:03.359617] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-02T18:20:03.473031] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-01. [2025-10-02T18:20:04.272989] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-10. [2025-10-02T18:20:04.589478] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-02T18:20:04.749936] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-02T18:20:04.750932] [INFO ] [REMOTE ] CXH: Full fetch complete (5467 records). [2025-10-02T18:20:04.751018] [DEBUG] [VALIDATOR ] CXH: Validating primary data. [2025-10-02T18:20:05.073633] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-08. [2025-10-02T18:20:05.202817] [DEBUG] [VALIDATOR ] CXH: All expected trading days are present. [2025-10-02T18:20:05.203022] [DEBUG] [VALIDATOR ] CXH: Primary data validation passed. [2025-10-02T18:20:05.203247] [INFO ] [MAIN ] CXH: Fetched primary data is valid. [2025-10-02T18:20:05.203327] [DEBUG] [LOCAL ] CXH: Saving primary data. [2025-10-02T18:20:05.203987] [DEBUG] [LOCAL ] CXH: Trimmed 5467 records to 4422 (keeping 200 days of data) [2025-10-02T18:20:05.262905] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-02T18:20:05.281657] [DEBUG] [LOCAL ] CXH: Primary data saved (4422 records). [2025-10-02T18:20:05.281809] [INFO ] [MAIN ] CXH: Full history saved. [2025-10-02T18:20:05.281904] [INFO ] [MAIN ] Update Progress: 577/2370 symbols completed. CXH took 27.6s. Estimated remaining: 4h 8m 40s. Rate: 7.2 symbols/min [2025-10-02T18:20:05.468727] [INFO ] [MAIN ] CXW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:20:05.512327] [DEBUG] [LOCAL ] CXW: Loaded 44030 existing records from primary storage. [2025-10-02T18:20:05.512690] [INFO ] [MAIN ] CXW: Loaded 44030 existing records. [2025-10-02T18:20:05.718743] [WARN ] [MAIN ] CXW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:20:05.718982] [INFO ] [MAIN ] CXW: Wiping existing primary data before full refresh. [2025-10-02T18:20:05.719035] [INFO ] [LOCAL ] CXW: Starting deletion of primary data. [2025-10-02T18:20:05.720401] [DEBUG] [LOCAL ] CXW: Deleted primary data file. [2025-10-02T18:20:05.720464] [INFO ] [MAIN ] CXW: Starting full primary refresh. [2025-10-02T18:20:05.878124] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-02. [2025-10-02T18:20:06.121969] [INFO ] [REMOTE ] CXW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:20:06.673000] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-02. [2025-10-02T18:20:06.981736] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-02T18:20:07.103065] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-02T18:20:07.473015] [INFO ] [REMOTE ] CXW: Fetching primary data for 2024-12. [2025-10-02T18:20:08.212215] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-02T18:20:08.273020] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-09. [2025-10-02T18:20:09.073003] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-03. [2025-10-02T18:20:09.447184] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-02T18:20:09.872971] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-03. [2025-10-02T18:20:10.054595] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-02T18:20:10.673038] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-01. [2025-10-02T18:20:11.069497] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-02T18:20:11.472998] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-04. [2025-10-02T18:20:12.052912] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-02T18:20:12.272998] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-10. [2025-10-02T18:20:13.015293] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-02T18:20:13.072992] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-05. [2025-10-02T18:20:13.378587] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-03 (4.31 seconds). [2025-10-02T18:20:13.616205] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-02T18:20:13.618562] [INFO ] [REMOTE ] CX: Full fetch complete (76393 records). [2025-10-02T18:20:13.618726] [DEBUG] [VALIDATOR ] CX: Validating primary data. [2025-10-02T18:20:13.877577] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-04. [2025-10-02T18:20:14.052277] [DEBUG] [VALIDATOR ] CX: All expected trading days are present. [2025-10-02T18:20:14.052406] [DEBUG] [VALIDATOR ] CX: Primary data validation passed. [2025-10-02T18:20:14.053437] [INFO ] [MAIN ] CX: Fetched primary data is valid. [2025-10-02T18:20:14.053667] [DEBUG] [LOCAL ] CX: Saving primary data. [2025-10-02T18:20:14.073289] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-02T18:20:14.080458] [DEBUG] [LOCAL ] CX: Trimmed 76393 records to 53213 (keeping 200 days of data) [2025-10-02T18:20:14.431273] [DEBUG] [LOCAL ] CX: Primary data saved (53213 records). [2025-10-02T18:20:14.431423] [INFO ] [MAIN ] CX: Full history saved. [2025-10-02T18:20:14.431510] [INFO ] [MAIN ] Update Progress: 578/2370 symbols completed. CX took 48.7s. Estimated remaining: 4h 8m 35s. Rate: 7.2 symbols/min [2025-10-02T18:20:14.621897] [INFO ] [MAIN ] CYD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:20:14.649527] [DEBUG] [LOCAL ] CYD: Loaded 26522 existing records from primary storage. [2025-10-02T18:20:14.649837] [INFO ] [MAIN ] CYD: Loaded 26522 existing records. [2025-10-02T18:20:14.683293] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-06. [2025-10-02T18:20:14.848042] [WARN ] [MAIN ] CYD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:20:14.848285] [INFO ] [MAIN ] CYD: Wiping existing primary data before full refresh. [2025-10-02T18:20:14.848332] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-10-02T18:20:14.849282] [DEBUG] [LOCAL ] CYD: Deleted primary data file. [2025-10-02T18:20:14.849344] [INFO ] [MAIN ] CYD: Starting full primary refresh. [2025-10-02T18:20:15.238667] [INFO ] [REMOTE ] CYD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:20:15.473003] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-02. [2025-10-02T18:20:15.629218] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-02T18:20:16.044512] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-02T18:20:16.273006] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-07. [2025-10-02T18:20:17.072971] [INFO ] [REMOTE ] CYD: Fetching primary data for 2024-12. [2025-10-02T18:20:17.265081] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-02T18:20:17.623587] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-02T18:20:17.872991] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-03. [2025-10-02T18:20:18.472636] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-02T18:20:18.672980] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-08. [2025-10-02T18:20:19.473050] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-01. [2025-10-02T18:20:19.698345] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-02T18:20:20.046060] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-02T18:20:20.158283] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-02T18:20:20.273033] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-04. [2025-10-02T18:20:21.073018] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-05. [2025-10-02T18:20:21.669911] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-02T18:20:21.873003] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-09. [2025-10-02T18:20:22.641761] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-02T18:20:22.673036] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-02. [2025-10-02T18:20:23.324300] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-02T18:20:23.473015] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-05. [2025-10-02T18:20:23.772696] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-02T18:20:24.273017] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-10. [2025-10-02T18:20:24.872958] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-02T18:20:25.073028] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-06. [2025-10-02T18:20:25.630030] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-02T18:20:25.631815] [INFO ] [REMOTE ] CXT: Full fetch complete (45298 records). [2025-10-02T18:20:25.631975] [DEBUG] [VALIDATOR ] CXT: Validating primary data. [2025-10-02T18:20:25.633085] [FATAL] [VALIDATOR ] CXT: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:20:25.633206] [FATAL] [MAIN ] CXT: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:20:25.633290] [WARN ] [MAIN ] CXT: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:20:25.633383] [INFO ] [LOCAL ] CXT: Starting deletion of primary data. [2025-10-02T18:20:25.633487] [DEBUG] [LOCAL ] CXT: No primary data file found to delete. [2025-10-02T18:20:25.633556] [INFO ] [LOCAL ] CXT: Starting deletion of derivative data. [2025-10-02T18:20:25.634124] [DEBUG] [LOCAL ] CXT: Deleted derivative data file. [2025-10-02T18:20:25.634254] [INFO ] [MAIN ] Update Progress: 579/2370 symbols completed. CXT took 30.9s. Estimated remaining: 4h 8m 35s. Rate: 7.2 symbols/min [2025-10-02T18:20:25.878321] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-06. [2025-10-02T18:20:25.884345] [INFO ] [MAIN ] CYH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:20:25.939975] [DEBUG] [LOCAL ] CYH: Loaded 47530 existing records from primary storage. [2025-10-02T18:20:25.940603] [INFO ] [MAIN ] CYH: Loaded 47530 existing records. [2025-10-02T18:20:26.240546] [WARN ] [MAIN ] CYH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:20:26.241020] [INFO ] [MAIN ] CYH: Wiping existing primary data before full refresh. [2025-10-02T18:20:26.241126] [INFO ] [LOCAL ] CYH: Starting deletion of primary data. [2025-10-02T18:20:26.242812] [DEBUG] [LOCAL ] CYH: Deleted primary data file. [2025-10-02T18:20:26.242893] [INFO ] [MAIN ] CYH: Starting full primary refresh. [2025-10-02T18:20:26.639236] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-02T18:20:26.683623] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-07. [2025-10-02T18:20:26.907926] [INFO ] [REMOTE ] CYH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:20:27.472986] [INFO ] [REMOTE ] CYH: Fetching primary data for 2024-12. [2025-10-02T18:20:27.577543] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-02T18:20:28.273034] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-07. [2025-10-02T18:20:28.565697] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-02T18:20:29.073007] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-08. [2025-10-02T18:20:29.371278] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-02T18:20:29.865931] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-02T18:20:29.876206] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-01. [2025-10-02T18:20:30.497577] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-02T18:20:30.672997] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-08. [2025-10-02T18:20:31.472971] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-09. [2025-10-02T18:20:31.572216] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-02T18:20:32.255063] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-02T18:20:32.272970] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-03. [2025-10-02T18:20:32.705914] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-02T18:20:33.073045] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-02. [2025-10-02T18:20:33.726262] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-02T18:20:33.873008] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-09. [2025-10-02T18:20:34.678507] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-10. [2025-10-02T18:20:34.684481] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-02T18:20:35.374577] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-02T18:20:35.473035] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-03. [2025-10-02T18:20:36.052426] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-02T18:20:36.054439] [INFO ] [REMOTE ] CXW: Full fetch complete (64847 records). [2025-10-02T18:20:36.054591] [DEBUG] [VALIDATOR ] CXW: Validating primary data. [2025-10-02T18:20:36.280625] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-04. [2025-10-02T18:20:36.498669] [DEBUG] [VALIDATOR ] CXW: All expected trading days are present. [2025-10-02T18:20:36.498851] [DEBUG] [VALIDATOR ] CXW: Primary data validation passed. [2025-10-02T18:20:36.499948] [INFO ] [MAIN ] CXW: Fetched primary data is valid. [2025-10-02T18:20:36.500020] [DEBUG] [LOCAL ] CXW: Saving primary data. [2025-10-02T18:20:36.501973] [DEBUG] [LOCAL ] CXW: Trimmed 64847 records to 44355 (keeping 200 days of data) [2025-10-02T18:20:36.783793] [DEBUG] [LOCAL ] CXW: Primary data saved (44355 records). [2025-10-02T18:20:36.783928] [INFO ] [MAIN ] CXW: Full history saved. [2025-10-02T18:20:36.785470] [INFO ] [MAIN ] Update Progress: 580/2370 symbols completed. CXW took 31.5s. Estimated remaining: 4h 8m 36s. Rate: 7.2 symbols/min [2025-10-02T18:20:36.976581] [INFO ] [MAIN ] D: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:20:36.976941] [DEBUG] [LOCAL ] D: No existing data file found in primary storage. [2025-10-02T18:20:36.977011] [WARN ] [MAIN ] D: No existing data found, performing full refresh instead. [2025-10-02T18:20:36.977165] [INFO ] [MAIN ] D: Wiping existing primary data before full refresh. [2025-10-02T18:20:36.977210] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-10-02T18:20:36.977254] [DEBUG] [LOCAL ] D: No primary data file found to delete. [2025-10-02T18:20:36.977288] [INFO ] [MAIN ] D: Starting full primary refresh. [2025-10-02T18:20:37.078256] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-10. [2025-10-02T18:20:37.355514] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-02T18:20:37.462208] [INFO ] [REMOTE ] D: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:20:37.757955] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-02T18:20:37.873052] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-05. [2025-10-02T18:20:38.294900] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-02T18:20:38.297079] [INFO ] [REMOTE ] CXM: Full fetch complete (68743 records). [2025-10-02T18:20:38.297210] [DEBUG] [VALIDATOR ] CXM: Validating primary data. [2025-10-02T18:20:38.682933] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-04. [2025-10-02T18:20:38.749761] [DEBUG] [VALIDATOR ] CXM: All expected trading days are present. [2025-10-02T18:20:38.749866] [DEBUG] [VALIDATOR ] CXM: Primary data validation passed. [2025-10-02T18:20:38.750859] [INFO ] [MAIN ] CXM: Fetched primary data is valid. [2025-10-02T18:20:38.750928] [DEBUG] [LOCAL ] CXM: Saving primary data. [2025-10-02T18:20:38.752549] [DEBUG] [LOCAL ] CXM: Trimmed 68743 records to 47964 (keeping 200 days of data) [2025-10-02T18:20:38.983088] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-02T18:20:39.066256] [DEBUG] [LOCAL ] CXM: Primary data saved (47964 records). [2025-10-02T18:20:39.066403] [INFO ] [MAIN ] CXM: Full history saved. [2025-10-02T18:20:39.066491] [INFO ] [MAIN ] Update Progress: 581/2370 symbols completed. CXM took 45.8s. Estimated remaining: 4h 8m 9s. Rate: 7.2 symbols/min [2025-10-02T18:20:39.245579] [INFO ] [MAIN ] DAC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:20:39.260328] [DEBUG] [LOCAL ] DAC: Loaded 12526 existing records from primary storage. [2025-10-02T18:20:39.260585] [INFO ] [MAIN ] DAC: Loaded 12526 existing records. [2025-10-02T18:20:39.450455] [WARN ] [MAIN ] DAC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:20:39.450699] [INFO ] [MAIN ] DAC: Wiping existing primary data before full refresh. [2025-10-02T18:20:39.450761] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-10-02T18:20:39.451288] [DEBUG] [LOCAL ] DAC: Deleted primary data file. [2025-10-02T18:20:39.451351] [INFO ] [MAIN ] DAC: Starting full primary refresh. [2025-10-02T18:20:39.483883] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-06. [2025-10-02T18:20:39.875661] [INFO ] [REMOTE ] DAC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:20:40.156544] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-02T18:20:40.273036] [INFO ] [REMOTE ] DAC: Fetching primary data for 2024-12. [2025-10-02T18:20:40.814926] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-02T18:20:41.073024] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-05. [2025-10-02T18:20:41.406746] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-02T18:20:41.873005] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-07. [2025-10-02T18:20:42.455956] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-02T18:20:42.672974] [INFO ] [REMOTE ] D: Fetching primary data for 2024-12. [2025-10-02T18:20:43.051587] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-02T18:20:43.473015] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-06. [2025-10-02T18:20:44.272997] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-01. [2025-10-02T18:20:44.785045] [INFO ] [REMOTE ] D: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-02T18:20:45.053451] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-02T18:20:45.072971] [INFO ] [REMOTE ] D: Fetching primary data for 2025-01. [2025-10-02T18:20:45.312340] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-02T18:20:45.873017] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-08. [2025-10-02T18:20:46.523055] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-02T18:20:46.673003] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-02. [2025-10-02T18:20:47.466194] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-02T18:20:47.472902] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-09. [2025-10-02T18:20:47.617325] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-02T18:20:48.273039] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-03. [2025-10-02T18:20:48.423013] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-02T18:20:49.073047] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-10. [2025-10-02T18:20:49.163097] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-02T18:20:49.873003] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-07. [2025-10-02T18:20:50.191760] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-02T18:20:50.193156] [INFO ] [REMOTE ] CYD: Full fetch complete (33328 records). [2025-10-02T18:20:50.193247] [DEBUG] [VALIDATOR ] CYD: Validating primary data. [2025-10-02T18:20:50.607705] [DEBUG] [VALIDATOR ] CYD: All expected trading days are present. [2025-10-02T18:20:50.607811] [DEBUG] [VALIDATOR ] CYD: Primary data validation passed. [2025-10-02T18:20:50.608430] [INFO ] [MAIN ] CYD: Fetched primary data is valid. [2025-10-02T18:20:50.608498] [DEBUG] [LOCAL ] CYD: Saving primary data. [2025-10-02T18:20:50.609593] [DEBUG] [LOCAL ] CYD: Trimmed 33328 records to 26748 (keeping 200 days of data) [2025-10-02T18:20:50.673935] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-04. [2025-10-02T18:20:50.783387] [DEBUG] [LOCAL ] CYD: Primary data saved (26748 records). [2025-10-02T18:20:50.783532] [INFO ] [MAIN ] CYD: Full history saved. [2025-10-02T18:20:50.783619] [INFO ] [MAIN ] Update Progress: 582/2370 symbols completed. CYD took 36.4s. Estimated remaining: 4h 8m 11s. Rate: 7.2 symbols/min [2025-10-02T18:20:50.979684] [INFO ] [MAIN ] DAL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:20:51.036193] [DEBUG] [LOCAL ] DAL: Loaded 53753 existing records from primary storage. [2025-10-02T18:20:51.036675] [INFO ] [MAIN ] DAL: Loaded 53753 existing records. [2025-10-02T18:20:51.238486] [WARN ] [MAIN ] DAL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:20:51.239193] [INFO ] [MAIN ] DAL: Wiping existing primary data before full refresh. [2025-10-02T18:20:51.239244] [INFO ] [LOCAL ] DAL: Starting deletion of primary data. [2025-10-02T18:20:51.241120] [DEBUG] [LOCAL ] DAL: Deleted primary data file. [2025-10-02T18:20:51.241185] [INFO ] [MAIN ] DAL: Starting full primary refresh. [2025-10-02T18:20:51.480582] [INFO ] [REMOTE ] D: Fetching primary data for 2025-02. [2025-10-02T18:20:51.641780] [INFO ] [REMOTE ] DAL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:20:51.737365] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-02T18:20:51.882275] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-02T18:20:52.272998] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-05. [2025-10-02T18:20:53.072133] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-02T18:20:53.075312] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-08. [2025-10-02T18:20:53.267886] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-02T18:20:53.873029] [INFO ] [REMOTE ] D: Fetching primary data for 2025-03. [2025-10-02T18:20:54.672974] [INFO ] [REMOTE ] DAL: Fetching primary data for 2024-12. [2025-10-02T18:20:54.839148] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-02T18:20:55.473100] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-06. [2025-10-02T18:20:55.858031] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-02T18:20:56.115205] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-02T18:20:56.273009] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-07. [2025-10-02T18:20:56.852763] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-02T18:20:56.986918] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-10-02T18:20:57.073021] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-09. [2025-10-02T18:20:57.872997] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-08. [2025-10-02T18:20:58.344287] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-02T18:20:58.672986] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-10. [2025-10-02T18:20:58.692249] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-02T18:20:59.473043] [INFO ] [REMOTE ] D: Fetching primary data for 2025-04. [2025-10-02T18:20:59.833727] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-02T18:20:59.835716] [INFO ] [REMOTE ] CYH: Full fetch complete (69977 records). [2025-10-02T18:20:59.835827] [DEBUG] [VALIDATOR ] CYH: Validating primary data. [2025-10-02T18:21:00.275491] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-09. [2025-10-02T18:21:00.276538] [DEBUG] [VALIDATOR ] CYH: All expected trading days are present. [2025-10-02T18:21:00.276600] [DEBUG] [VALIDATOR ] CYH: Primary data validation passed. [2025-10-02T18:21:00.277549] [INFO ] [MAIN ] CYH: Fetched primary data is valid. [2025-10-02T18:21:00.277733] [DEBUG] [LOCAL ] CYH: Saving primary data. [2025-10-02T18:21:00.279454] [DEBUG] [LOCAL ] CYH: Trimmed 69977 records to 47856 (keeping 200 days of data) [2025-10-02T18:21:00.576225] [DEBUG] [LOCAL ] CYH: Primary data saved (47856 records). [2025-10-02T18:21:00.576440] [INFO ] [MAIN ] CYH: Full history saved. [2025-10-02T18:21:00.576693] [INFO ] [MAIN ] Update Progress: 583/2370 symbols completed. CYH took 34.9s. Estimated remaining: 4h 8m 7s. Rate: 7.2 symbols/min [2025-10-02T18:21:00.766876] [INFO ] [MAIN ] DAN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:21:00.823717] [DEBUG] [LOCAL ] DAN: Loaded 48976 existing records from primary storage. [2025-10-02T18:21:00.824097] [INFO ] [MAIN ] DAN: Loaded 48976 existing records. [2025-10-02T18:21:01.026983] [WARN ] [MAIN ] DAN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:21:01.027359] [INFO ] [MAIN ] DAN: Wiping existing primary data before full refresh. [2025-10-02T18:21:01.027729] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-10-02T18:21:01.029505] [DEBUG] [LOCAL ] DAN: Deleted primary data file. [2025-10-02T18:21:01.029584] [INFO ] [MAIN ] DAN: Starting full primary refresh. [2025-10-02T18:21:01.078184] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-01. [2025-10-02T18:21:01.170547] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-02T18:21:01.243324] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-02T18:21:01.530160] [INFO ] [REMOTE ] DAN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:21:01.873002] [INFO ] [REMOTE ] DAN: Fetching primary data for 2024-12. [2025-10-02T18:21:02.672972] [INFO ] [REMOTE ] D: Fetching primary data for 2025-05. [2025-10-02T18:21:02.826884] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-02T18:21:03.473007] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-02. [2025-10-02T18:21:03.752146] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-02T18:21:04.273014] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-01. [2025-10-02T18:21:04.575326] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-02T18:21:05.072998] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-10. [2025-10-02T18:21:05.387716] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-02T18:21:05.732554] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-02T18:21:05.733692] [INFO ] [REMOTE ] DAC: Full fetch complete (19359 records). [2025-10-02T18:21:05.733782] [DEBUG] [VALIDATOR ] DAC: Validating primary data. [2025-10-02T18:21:05.734363] [FATAL] [VALIDATOR ] DAC: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:21:05.734461] [FATAL] [MAIN ] DAC: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:21:05.734509] [WARN ] [MAIN ] DAC: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:21:05.734603] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-10-02T18:21:05.734763] [DEBUG] [LOCAL ] DAC: No primary data file found to delete. [2025-10-02T18:21:05.734821] [INFO ] [LOCAL ] DAC: Starting deletion of derivative data. [2025-10-02T18:21:05.735219] [DEBUG] [LOCAL ] DAC: Deleted derivative data file. [2025-10-02T18:21:05.735324] [INFO ] [MAIN ] Update Progress: 584/2370 symbols completed. DAC took 26.7s. Estimated remaining: 4h 7m 49s. Rate: 7.2 symbols/min [2025-10-02T18:21:05.875210] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-03. [2025-10-02T18:21:05.935611] [INFO ] [MAIN ] DAO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:21:05.967708] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-02T18:21:05.995507] [DEBUG] [LOCAL ] DAO: Loaded 20913 existing records from primary storage. [2025-10-02T18:21:05.995815] [INFO ] [MAIN ] DAO: Loaded 20913 existing records. [2025-10-02T18:21:06.190442] [WARN ] [MAIN ] DAO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:21:06.190615] [INFO ] [MAIN ] DAO: Wiping existing primary data before full refresh. [2025-10-02T18:21:06.190761] [INFO ] [LOCAL ] DAO: Starting deletion of primary data. [2025-10-02T18:21:06.191621] [DEBUG] [LOCAL ] DAO: Deleted primary data file. [2025-10-02T18:21:06.191721] [INFO ] [MAIN ] DAO: Starting full primary refresh. [2025-10-02T18:21:06.584571] [INFO ] [REMOTE ] DAO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:21:06.672982] [INFO ] [REMOTE ] DAO: Fetching primary data for 2024-12. [2025-10-02T18:21:07.473003] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-02. [2025-10-02T18:21:07.924181] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-02T18:21:08.264771] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-10-02T18:21:08.275516] [INFO ] [REMOTE ] D: Fetching primary data for 2025-06. [2025-10-02T18:21:08.896074] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-02T18:21:09.072996] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-04. [2025-10-02T18:21:09.872987] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-03. [2025-10-02T18:21:10.236182] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-02T18:21:10.672979] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-01. [2025-10-02T18:21:11.449677] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-10-02T18:21:11.472948] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-05. [2025-10-02T18:21:11.568906] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-02T18:21:11.622238] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-02T18:21:12.272987] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-04. [2025-10-02T18:21:13.073012] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-02. [2025-10-02T18:21:13.792009] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-10-02T18:21:13.872529] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-02T18:21:13.876501] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-06. [2025-10-02T18:21:14.035161] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-02T18:21:14.672981] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-05. [2025-10-02T18:21:15.472995] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-03. [2025-10-02T18:21:16.091706] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-10-02T18:21:16.273046] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-07. [2025-10-02T18:21:16.396998] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-02T18:21:17.069543] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-02T18:21:17.076825] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-06. [2025-10-02T18:21:17.873043] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-04. [2025-10-02T18:21:18.594478] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-02T18:21:18.643957] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-02T18:21:18.672962] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-07. [2025-10-02T18:21:19.377332] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-02T18:21:19.473005] [INFO ] [REMOTE ] D: Fetching primary data for 2025-07. [2025-10-02T18:21:20.097012] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-02T18:21:20.273000] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-05. [2025-10-02T18:21:21.072977] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-08. [2025-10-02T18:21:21.379713] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-02T18:21:21.558565] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-02T18:21:21.873022] [INFO ] [REMOTE ] D: Fetching primary data for 2025-08. [2025-10-02T18:21:22.673016] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-08. [2025-10-02T18:21:22.723206] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-02T18:21:23.473035] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-06. [2025-10-02T18:21:23.802847] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-02T18:21:24.078096] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-02T18:21:24.272966] [INFO ] [REMOTE ] D: Fetching primary data for 2025-09. [2025-10-02T18:21:24.467055] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-02T18:21:25.073035] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-09. [2025-10-02T18:21:25.872972] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-09. [2025-10-02T18:21:26.141779] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-02T18:21:26.672997] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-07. [2025-10-02T18:21:26.751860] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-02T18:21:27.473020] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-10. [2025-10-02T18:21:27.581613] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-02T18:21:27.980344] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-02T18:21:28.273002] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-08. [2025-10-02T18:21:28.559430] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-02T18:21:28.561032] [INFO ] [REMOTE ] DAN: Full fetch complete (70470 records). [2025-10-02T18:21:28.561246] [DEBUG] [VALIDATOR ] DAN: Validating primary data. [2025-10-02T18:21:28.562200] [FATAL] [VALIDATOR ] DAN: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:21:28.562299] [FATAL] [MAIN ] DAN: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:21:28.562373] [WARN ] [MAIN ] DAN: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:21:28.562454] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-10-02T18:21:28.562522] [DEBUG] [LOCAL ] DAN: No primary data file found to delete. [2025-10-02T18:21:28.562561] [INFO ] [LOCAL ] DAN: Starting deletion of derivative data. [2025-10-02T18:21:28.562964] [DEBUG] [LOCAL ] DAN: Deleted derivative data file. [2025-10-02T18:21:28.563102] [INFO ] [MAIN ] Update Progress: 585/2370 symbols completed. DAN took 28.0s. Estimated remaining: 4h 8m 25s. Rate: 7.2 symbols/min [2025-10-02T18:21:28.757228] [INFO ] [MAIN ] DAR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:21:28.810441] [DEBUG] [LOCAL ] DAR: Loaded 51846 existing records from primary storage. [2025-10-02T18:21:28.810876] [INFO ] [MAIN ] DAR: Loaded 51846 existing records. [2025-10-02T18:21:29.023561] [WARN ] [MAIN ] DAR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:21:29.023843] [INFO ] [MAIN ] DAR: Wiping existing primary data before full refresh. [2025-10-02T18:21:29.023895] [INFO ] [LOCAL ] DAR: Starting deletion of primary data. [2025-10-02T18:21:29.025355] [DEBUG] [LOCAL ] DAR: Deleted primary data file. [2025-10-02T18:21:29.025430] [INFO ] [MAIN ] DAR: Starting full primary refresh. [2025-10-02T18:21:29.078107] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-10. [2025-10-02T18:21:29.453434] [INFO ] [REMOTE ] DAR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:21:29.486121] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-02T18:21:29.873060] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-09. [2025-10-02T18:21:30.672983] [INFO ] [REMOTE ] D: Fetching primary data for 2025-10. [2025-10-02T18:21:31.005617] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-02T18:21:31.104104] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-02T18:21:31.106201] [INFO ] [REMOTE ] DAL: Full fetch complete (77823 records). [2025-10-02T18:21:31.106316] [DEBUG] [VALIDATOR ] DAL: Validating primary data. [2025-10-02T18:21:31.482221] [INFO ] [REMOTE ] DAR: Fetching primary data for 2024-12. [2025-10-02T18:21:31.547337] [DEBUG] [VALIDATOR ] DAL: All expected trading days are present. [2025-10-02T18:21:31.547431] [DEBUG] [VALIDATOR ] DAL: Primary data validation passed. [2025-10-02T18:21:31.548468] [INFO ] [MAIN ] DAL: Fetched primary data is valid. [2025-10-02T18:21:31.548547] [DEBUG] [LOCAL ] DAL: Saving primary data. [2025-10-02T18:21:31.550351] [DEBUG] [LOCAL ] DAL: Trimmed 77823 records to 54143 (keeping 200 days of data) [2025-10-02T18:21:31.919207] [DEBUG] [LOCAL ] DAL: Primary data saved (54143 records). [2025-10-02T18:21:31.919356] [INFO ] [MAIN ] DAL: Full history saved. [2025-10-02T18:21:31.919469] [INFO ] [MAIN ] Update Progress: 586/2370 symbols completed. DAL took 41.1s. Estimated remaining: 4h 8m 1s. Rate: 7.2 symbols/min [2025-10-02T18:21:32.114854] [INFO ] [MAIN ] DAVA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:21:32.115092] [DEBUG] [LOCAL ] DAVA: No existing data file found in primary storage. [2025-10-02T18:21:32.115146] [WARN ] [MAIN ] DAVA: No existing data found, performing full refresh instead. [2025-10-02T18:21:32.115263] [INFO ] [MAIN ] DAVA: Wiping existing primary data before full refresh. [2025-10-02T18:21:32.115309] [INFO ] [LOCAL ] DAVA: Starting deletion of primary data. [2025-10-02T18:21:32.115354] [DEBUG] [LOCAL ] DAVA: No primary data file found to delete. [2025-10-02T18:21:32.115389] [INFO ] [MAIN ] DAVA: Starting full primary refresh. [2025-10-02T18:21:32.278144] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-10. [2025-10-02T18:21:32.336616] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-02T18:21:32.413027] [INFO ] [REMOTE ] D: Full fetch complete (77265 records). [2025-10-02T18:21:32.426096] [DEBUG] [VALIDATOR ] D: Validating primary data. [2025-10-02T18:21:32.457264] [FATAL] [VALIDATOR ] D: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:21:32.472842] [FATAL] [MAIN ] D: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:21:32.497978] [WARN ] [MAIN ] D: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:21:32.504230] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-10-02T18:21:32.529916] [DEBUG] [LOCAL ] D: No primary data file found to delete. [2025-10-02T18:21:32.535364] [INFO ] [REMOTE ] DAVA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:21:32.535488] [INFO ] [LOCAL ] D: Starting deletion of derivative data. [2025-10-02T18:21:32.535833] [DEBUG] [LOCAL ] D: No derivative data file found to delete. [2025-10-02T18:21:32.535917] [INFO ] [MAIN ] Update Progress: 587/2370 symbols completed. D took 55.8s. Estimated remaining: 4h 7m 29s. Rate: 7.2 symbols/min [2025-10-02T18:21:32.719622] [INFO ] [MAIN ] DAY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:21:32.788521] [DEBUG] [LOCAL ] DAY: Loaded 49528 existing records from primary storage. [2025-10-02T18:21:32.788938] [INFO ] [MAIN ] DAY: Loaded 49528 existing records. [2025-10-02T18:21:32.982542] [WARN ] [MAIN ] DAY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:21:32.982778] [INFO ] [MAIN ] DAY: Wiping existing primary data before full refresh. [2025-10-02T18:21:32.982853] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-10-02T18:21:32.984831] [DEBUG] [LOCAL ] DAY: Deleted primary data file. [2025-10-02T18:21:32.984895] [INFO ] [MAIN ] DAY: Starting full primary refresh. [2025-10-02T18:21:33.081907] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2024-12. [2025-10-02T18:21:33.104112] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-02T18:21:33.110974] [INFO ] [REMOTE ] DAO: Full fetch complete (32838 records). [2025-10-02T18:21:33.121461] [DEBUG] [VALIDATOR ] DAO: Validating primary data. [2025-10-02T18:21:33.155974] [FATAL] [VALIDATOR ] DAO: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:21:33.167779] [FATAL] [MAIN ] DAO: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:21:33.200030] [WARN ] [MAIN ] DAO: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:21:33.258538] [INFO ] [LOCAL ] DAO: Starting deletion of primary data. [2025-10-02T18:21:33.298411] [DEBUG] [LOCAL ] DAO: No primary data file found to delete. [2025-10-02T18:21:33.311381] [INFO ] [LOCAL ] DAO: Starting deletion of derivative data. [2025-10-02T18:21:33.337746] [DEBUG] [LOCAL ] DAO: Deleted derivative data file. [2025-10-02T18:21:33.365800] [INFO ] [MAIN ] Update Progress: 588/2370 symbols completed. DAO took 27.6s. Estimated remaining: 4h 6m 58s. Rate: 7.2 symbols/min [2025-10-02T18:21:33.426632] [INFO ] [REMOTE ] DAY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:21:33.639896] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-02T18:21:33.643556] [INFO ] [MAIN ] DB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:21:33.720860] [DEBUG] [LOCAL ] DB: Loaded 52580 existing records from primary storage. [2025-10-02T18:21:33.721354] [INFO ] [MAIN ] DB: Loaded 52580 existing records. [2025-10-02T18:21:33.878199] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-01. [2025-10-02T18:21:33.943134] [WARN ] [MAIN ] DB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:21:33.943352] [INFO ] [MAIN ] DB: Wiping existing primary data before full refresh. [2025-10-02T18:21:33.943411] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-10-02T18:21:33.944989] [DEBUG] [LOCAL ] DB: Deleted primary data file. [2025-10-02T18:21:33.945055] [INFO ] [MAIN ] DB: Starting full primary refresh. [2025-10-02T18:21:34.370282] [INFO ] [REMOTE ] DB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:21:34.546891] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-02T18:21:34.673001] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-01. [2025-10-02T18:21:35.473054] [INFO ] [REMOTE ] DAY: Fetching primary data for 2024-12. [2025-10-02T18:21:35.601625] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-02T18:21:35.964589] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-02T18:21:36.273038] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-02. [2025-10-02T18:21:37.016053] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-02T18:21:37.072966] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-01. [2025-10-02T18:21:37.555110] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-02T18:21:37.873044] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-03. [2025-10-02T18:21:38.323243] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-02T18:21:38.672984] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-02. [2025-10-02T18:21:39.093094] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-02T18:21:39.472991] [INFO ] [REMOTE ] DB: Fetching primary data for 2024-12. [2025-10-02T18:21:40.272992] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-02. [2025-10-02T18:21:40.385878] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-02T18:21:41.073007] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-03. [2025-10-02T18:21:41.211411] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-02T18:21:41.474365] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-02T18:21:41.873045] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-01. [2025-10-02T18:21:42.672976] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-03. [2025-10-02T18:21:42.843574] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-02T18:21:43.187064] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-02T18:21:43.472941] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-04. [2025-10-02T18:21:44.147980] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-02T18:21:44.273021] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-04. [2025-10-02T18:21:45.073012] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-04. [2025-10-02T18:21:45.136467] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-02T18:21:45.571288] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-02T18:21:45.873000] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-05. [2025-10-02T18:21:46.569426] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-02T18:21:46.673028] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-02. [2025-10-02T18:21:47.474330] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-05. [2025-10-02T18:21:47.480015] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-02T18:21:48.272997] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-05. [2025-10-02T18:21:48.332234] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-02T18:21:49.073022] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-03. [2025-10-02T18:21:49.125607] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-02T18:21:49.832611] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-02T18:21:49.873014] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-06. [2025-10-02T18:21:50.678119] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-06. [2025-10-02T18:21:50.701720] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-02T18:21:51.379159] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-02T18:21:51.472994] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-07. [2025-10-02T18:21:52.273059] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-06. [2025-10-02T18:21:52.354741] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-02T18:21:52.879085] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-02T18:21:53.073034] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-08. [2025-10-02T18:21:53.610670] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-02T18:21:53.873001] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-04. [2025-10-02T18:21:54.304531] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-02T18:21:54.672996] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-07. [2025-10-02T18:21:55.473048] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-07. [2025-10-02T18:21:55.945781] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-02T18:21:56.272995] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-05. [2025-10-02T18:21:56.501088] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-02T18:21:56.609332] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-02T18:21:57.073013] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-09. [2025-10-02T18:21:57.877910] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-08. [2025-10-02T18:21:57.883752] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-02T18:21:58.673037] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-06. [2025-10-02T18:21:58.979487] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-02T18:21:59.472987] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-10. [2025-10-02T18:21:59.525364] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-02T18:22:00.273027] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-09. [2025-10-02T18:22:00.670950] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-02T18:22:01.014298] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-02T18:22:01.016877] [INFO ] [REMOTE ] DAVA: Full fetch complete (55967 records). [2025-10-02T18:22:01.017044] [DEBUG] [VALIDATOR ] DAVA: Validating primary data. [2025-10-02T18:22:01.078075] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-07. [2025-10-02T18:22:01.479843] [DEBUG] [VALIDATOR ] DAVA: All expected trading days are present. [2025-10-02T18:22:01.479939] [DEBUG] [VALIDATOR ] DAVA: Primary data validation passed. [2025-10-02T18:22:01.480625] [INFO ] [MAIN ] DAVA: Fetched primary data is valid. [2025-10-02T18:22:01.480711] [DEBUG] [LOCAL ] DAVA: Saving primary data. [2025-10-02T18:22:01.482011] [DEBUG] [LOCAL ] DAVA: Trimmed 55967 records to 41312 (keeping 200 days of data) [2025-10-02T18:22:01.794580] [DEBUG] [LOCAL ] DAVA: Primary data saved (41312 records). [2025-10-02T18:22:01.794765] [INFO ] [MAIN ] DAVA: Full history saved. [2025-10-02T18:22:01.794862] [INFO ] [MAIN ] Update Progress: 589/2370 symbols completed. DAVA took 29.9s. Estimated remaining: 4h 7m 51s. Rate: 7.2 symbols/min [2025-10-02T18:22:01.875314] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-08. [2025-10-02T18:22:02.008592] [INFO ] [MAIN ] DBD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:22:02.009263] [DEBUG] [LOCAL ] DBD: No existing data file found in primary storage. [2025-10-02T18:22:02.009415] [WARN ] [MAIN ] DBD: No existing data found, performing full refresh instead. [2025-10-02T18:22:02.009720] [INFO ] [MAIN ] DBD: Wiping existing primary data before full refresh. [2025-10-02T18:22:02.009837] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-10-02T18:22:02.009972] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-10-02T18:22:02.010021] [INFO ] [MAIN ] DBD: Starting full primary refresh. [2025-10-02T18:22:02.483988] [INFO ] [REMOTE ] DBD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:22:02.479743] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-02T18:22:02.673003] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-10. [2025-10-02T18:22:03.112523] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-02T18:22:03.473046] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-08. [2025-10-02T18:22:03.713486] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-02T18:22:04.112988] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-02T18:22:04.116033] [INFO ] [REMOTE ] DAR: Full fetch complete (74632 records). [2025-10-02T18:22:04.116221] [DEBUG] [VALIDATOR ] DAR: Validating primary data. [2025-10-02T18:22:04.275922] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-09. [2025-10-02T18:22:04.649907] [DEBUG] [VALIDATOR ] DAR: All expected trading days are present. [2025-10-02T18:22:04.650085] [DEBUG] [VALIDATOR ] DAR: Primary data validation passed. [2025-10-02T18:22:04.650953] [INFO ] [MAIN ] DAR: Fetched primary data is valid. [2025-10-02T18:22:04.651018] [DEBUG] [LOCAL ] DAR: Saving primary data. [2025-10-02T18:22:04.652623] [DEBUG] [LOCAL ] DAR: Trimmed 74632 records to 52218 (keeping 200 days of data) [2025-10-02T18:22:04.989564] [DEBUG] [LOCAL ] DAR: Primary data saved (52218 records). [2025-10-02T18:22:04.989762] [INFO ] [MAIN ] DAR: Full history saved. [2025-10-02T18:22:04.989899] [INFO ] [MAIN ] Update Progress: 590/2370 symbols completed. DAR took 36.4s. Estimated remaining: 4h 7m 27s. Rate: 7.2 symbols/min [2025-10-02T18:22:05.073912] [INFO ] [REMOTE ] DBD: Fetching primary data for 2024-12. [2025-10-02T18:22:05.182865] [INFO ] [MAIN ] DBI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:22:05.226296] [DEBUG] [LOCAL ] DBI: Loaded 44591 existing records from primary storage. [2025-10-02T18:22:05.226627] [INFO ] [MAIN ] DBI: Loaded 44591 existing records. [2025-10-02T18:22:05.433330] [WARN ] [MAIN ] DBI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:22:05.433819] [INFO ] [MAIN ] DBI: Wiping existing primary data before full refresh. [2025-10-02T18:22:05.433900] [INFO ] [LOCAL ] DBI: Starting deletion of primary data. [2025-10-02T18:22:05.435401] [DEBUG] [LOCAL ] DBI: Deleted primary data file. [2025-10-02T18:22:05.435468] [INFO ] [MAIN ] DBI: Starting full primary refresh. [2025-10-02T18:22:05.565345] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-02T18:22:05.879855] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-09. [2025-10-02T18:22:05.950604] [INFO ] [REMOTE ] DBI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:22:05.982215] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-02T18:22:06.098111] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-02T18:22:06.673005] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-10. [2025-10-02T18:22:07.473009] [INFO ] [REMOTE ] DBI: Fetching primary data for 2024-12. [2025-10-02T18:22:08.055114] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-02T18:22:08.166462] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-02T18:22:08.168375] [INFO ] [REMOTE ] DAY: Full fetch complete (71573 records). [2025-10-02T18:22:08.168520] [DEBUG] [VALIDATOR ] DAY: Validating primary data. [2025-10-02T18:22:08.278906] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-01. [2025-10-02T18:22:08.609590] [DEBUG] [VALIDATOR ] DAY: All expected trading days are present. [2025-10-02T18:22:08.609700] [DEBUG] [VALIDATOR ] DAY: Primary data validation passed. [2025-10-02T18:22:08.610552] [INFO ] [MAIN ] DAY: Fetched primary data is valid. [2025-10-02T18:22:08.610617] [DEBUG] [LOCAL ] DAY: Saving primary data. [2025-10-02T18:22:08.612140] [DEBUG] [LOCAL ] DAY: Trimmed 71573 records to 49792 (keeping 200 days of data) [2025-10-02T18:22:08.934415] [DEBUG] [LOCAL ] DAY: Primary data saved (49792 records). [2025-10-02T18:22:08.934713] [INFO ] [MAIN ] DAY: Full history saved. [2025-10-02T18:22:08.935712] [INFO ] [MAIN ] Update Progress: 591/2370 symbols completed. DAY took 36.4s. Estimated remaining: 4h 7m 5s. Rate: 7.2 symbols/min [2025-10-02T18:22:09.078158] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-10. [2025-10-02T18:22:09.136094] [INFO ] [MAIN ] DBL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:22:09.137387] [DEBUG] [LOCAL ] DBL: No existing data file found in primary storage. [2025-10-02T18:22:09.137556] [WARN ] [MAIN ] DBL: No existing data found, performing full refresh instead. [2025-10-02T18:22:09.137753] [INFO ] [MAIN ] DBL: Wiping existing primary data before full refresh. [2025-10-02T18:22:09.137801] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-10-02T18:22:09.137862] [DEBUG] [LOCAL ] DBL: No primary data file found to delete. [2025-10-02T18:22:09.137939] [INFO ] [MAIN ] DBL: Starting full primary refresh. [2025-10-02T18:22:09.288888] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-02T18:22:09.594068] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-02T18:22:09.600939] [INFO ] [REMOTE ] DBL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:22:09.873000] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-01. [2025-10-02T18:22:10.662909] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-02T18:22:10.664620] [INFO ] [REMOTE ] DB: Full fetch complete (74224 records). [2025-10-02T18:22:10.664773] [DEBUG] [VALIDATOR ] DB: Validating primary data. [2025-10-02T18:22:10.665628] [FATAL] [VALIDATOR ] DB: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:22:10.665785] [FATAL] [MAIN ] DB: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:22:10.665847] [WARN ] [MAIN ] DB: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:22:10.665929] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-10-02T18:22:10.666010] [DEBUG] [LOCAL ] DB: No primary data file found to delete. [2025-10-02T18:22:10.666059] [INFO ] [LOCAL ] DB: Starting deletion of derivative data. [2025-10-02T18:22:10.666638] [DEBUG] [LOCAL ] DB: Deleted derivative data file. [2025-10-02T18:22:10.666788] [INFO ] [MAIN ] Update Progress: 592/2370 symbols completed. DB took 37.3s. Estimated remaining: 4h 6m 37s. Rate: 7.2 symbols/min [2025-10-02T18:22:10.682684] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-02. [2025-10-02T18:22:10.864329] [INFO ] [MAIN ] DBRG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:22:10.914516] [DEBUG] [LOCAL ] DBRG: Loaded 49736 existing records from primary storage. [2025-10-02T18:22:10.914912] [INFO ] [MAIN ] DBRG: Loaded 49736 existing records. [2025-10-02T18:22:11.116097] [WARN ] [MAIN ] DBRG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:22:11.116436] [INFO ] [MAIN ] DBRG: Wiping existing primary data before full refresh. [2025-10-02T18:22:11.116613] [INFO ] [LOCAL ] DBRG: Starting deletion of primary data. [2025-10-02T18:22:11.119032] [DEBUG] [LOCAL ] DBRG: Deleted primary data file. [2025-10-02T18:22:11.119096] [INFO ] [MAIN ] DBRG: Starting full primary refresh. [2025-10-02T18:22:11.477354] [INFO ] [REMOTE ] DBL: Fetching primary data for 2024-12. [2025-10-02T18:22:11.518390] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-02T18:22:11.553127] [INFO ] [REMOTE ] DBRG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:22:11.640716] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-02T18:22:12.272988] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-03. [2025-10-02T18:22:12.404079] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-02T18:22:13.072996] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-01. [2025-10-02T18:22:13.310945] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-02T18:22:13.805459] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-02T18:22:13.873029] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-04. [2025-10-02T18:22:14.673056] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-02. [2025-10-02T18:22:15.155674] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-02T18:22:15.393290] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-02T18:22:15.472996] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-03. [2025-10-02T18:22:16.273020] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-02. [2025-10-02T18:22:16.297496] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-02T18:22:17.073022] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2024-12. [2025-10-02T18:22:17.778374] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-02T18:22:17.872972] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-03. [2025-10-02T18:22:18.624835] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-02T18:22:18.672966] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-04. [2025-10-02T18:22:19.446101] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-02T18:22:19.473014] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-01. [2025-10-02T18:22:19.717506] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-02T18:22:20.273019] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-05. [2025-10-02T18:22:21.073038] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-05. [2025-10-02T18:22:21.129617] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-02T18:22:21.470448] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-02T18:22:21.866573] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-02T18:22:21.872970] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-06. [2025-10-02T18:22:22.452738] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-02T18:22:22.673049] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-02. [2025-10-02T18:22:23.473056] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-07. [2025-10-02T18:22:24.153889] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-02T18:22:24.273011] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-06. [2025-10-02T18:22:24.318544] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-02T18:22:25.073019] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-08. [2025-10-02T18:22:25.385189] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-02T18:22:25.794896] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-02T18:22:25.872999] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-09. [2025-10-02T18:22:26.611275] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-02T18:22:26.673255] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-04. [2025-10-02T18:22:27.473015] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-07. [2025-10-02T18:22:27.995090] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-02T18:22:28.273071] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-10. [2025-10-02T18:22:28.895629] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-02T18:22:28.896900] [INFO ] [REMOTE ] DBL: Full fetch complete (12557 records). [2025-10-02T18:22:28.897006] [DEBUG] [VALIDATOR ] DBL: Validating primary data. [2025-10-02T18:22:29.064765] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-02T18:22:29.077832] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-03. [2025-10-02T18:22:29.387520] [DEBUG] [VALIDATOR ] DBL: All expected trading days are present. [2025-10-02T18:22:29.387609] [DEBUG] [VALIDATOR ] DBL: Primary data validation passed. [2025-10-02T18:22:29.387976] [INFO ] [MAIN ] DBL: Fetched primary data is valid. [2025-10-02T18:22:29.388068] [DEBUG] [LOCAL ] DBL: Saving primary data. [2025-10-02T18:22:29.388693] [DEBUG] [LOCAL ] DBL: Trimmed 12557 records to 9352 (keeping 200 days of data) [2025-10-02T18:22:29.452337] [DEBUG] [LOCAL ] DBL: Primary data saved (9352 records). [2025-10-02T18:22:29.452496] [INFO ] [MAIN ] DBL: Full history saved. [2025-10-02T18:22:29.452611] [INFO ] [MAIN ] Update Progress: 593/2370 symbols completed. DBL took 20.5s. Estimated remaining: 4h 7m 0s. Rate: 7.2 symbols/min [2025-10-02T18:22:29.645261] [INFO ] [MAIN ] DCI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:22:29.684824] [DEBUG] [LOCAL ] DCI: Loaded 37344 existing records from primary storage. [2025-10-02T18:22:29.685171] [INFO ] [MAIN ] DCI: Loaded 37344 existing records. [2025-10-02T18:22:29.898340] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-08. [2025-10-02T18:22:29.907475] [WARN ] [MAIN ] DCI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:22:29.908805] [INFO ] [MAIN ] DCI: Wiping existing primary data before full refresh. [2025-10-02T18:22:29.908872] [INFO ] [LOCAL ] DCI: Starting deletion of primary data. [2025-10-02T18:22:29.910234] [DEBUG] [LOCAL ] DCI: Deleted primary data file. [2025-10-02T18:22:29.910299] [INFO ] [MAIN ] DCI: Starting full primary refresh. [2025-10-02T18:22:30.302753] [INFO ] [REMOTE ] DCI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:22:30.673066] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-05. [2025-10-02T18:22:30.998828] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-02T18:22:31.175998] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-02T18:22:31.473073] [INFO ] [REMOTE ] DCI: Fetching primary data for 2024-12. [2025-10-02T18:22:32.273006] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-09. [2025-10-02T18:22:32.332202] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-02T18:22:32.749394] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-02T18:22:33.064131] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-02T18:22:33.072966] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-10. [2025-10-02T18:22:33.835962] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-02T18:22:33.837068] [INFO ] [REMOTE ] DBD: Full fetch complete (30817 records). [2025-10-02T18:22:33.837147] [DEBUG] [VALIDATOR ] DBD: Validating primary data. [2025-10-02T18:22:33.837666] [FATAL] [VALIDATOR ] DBD: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:22:33.837760] [FATAL] [MAIN ] DBD: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:22:33.837807] [WARN ] [MAIN ] DBD: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:22:33.837928] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-10-02T18:22:33.838038] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-10-02T18:22:33.838097] [INFO ] [LOCAL ] DBD: Starting deletion of derivative data. [2025-10-02T18:22:33.838164] [DEBUG] [LOCAL ] DBD: No derivative data file found to delete. [2025-10-02T18:22:33.838247] [INFO ] [MAIN ] Update Progress: 594/2370 symbols completed. DBD took 32.0s. Estimated remaining: 4h 6m 40s. Rate: 7.2 symbols/min [2025-10-02T18:22:33.878108] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-04. [2025-10-02T18:22:34.028162] [INFO ] [MAIN ] DCO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:22:34.045244] [DEBUG] [LOCAL ] DCO: Loaded 13871 existing records from primary storage. [2025-10-02T18:22:34.045563] [INFO ] [MAIN ] DCO: Loaded 13871 existing records. [2025-10-02T18:22:34.253320] [WARN ] [MAIN ] DCO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:22:34.253560] [INFO ] [MAIN ] DCO: Wiping existing primary data before full refresh. [2025-10-02T18:22:34.253631] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-10-02T18:22:34.254238] [DEBUG] [LOCAL ] DCO: Deleted primary data file. [2025-10-02T18:22:34.254302] [INFO ] [MAIN ] DCO: Starting full primary refresh. [2025-10-02T18:22:34.678270] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-01. [2025-10-02T18:22:34.684330] [INFO ] [REMOTE ] DCO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:22:35.473000] [INFO ] [REMOTE ] DCO: Fetching primary data for 2024-12. [2025-10-02T18:22:35.716800] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-02T18:22:36.072251] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-02T18:22:36.240573] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-02T18:22:36.272960] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-01. [2025-10-02T18:22:37.066231] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-02T18:22:37.072944] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-02. [2025-10-02T18:22:37.611818] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-02T18:22:37.873068] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-06. [2025-10-02T18:22:38.673021] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-02. [2025-10-02T18:22:39.270089] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-02T18:22:39.473054] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-05. [2025-10-02T18:22:39.982245] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-02T18:22:40.273007] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-03. [2025-10-02T18:22:41.072990] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-07. [2025-10-02T18:22:41.218388] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-02T18:22:41.287379] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-02T18:22:41.873060] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-03. [2025-10-02T18:22:42.584243] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-02T18:22:42.619578] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-02T18:22:42.673051] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-04. [2025-10-02T18:22:43.473021] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-08. [2025-10-02T18:22:43.552339] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-02T18:22:44.273028] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-05. [2025-10-02T18:22:44.630911] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-02T18:22:45.073002] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-09. [2025-10-02T18:22:45.115490] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-02T18:22:45.872979] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-04. [2025-10-02T18:22:46.550215] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-02T18:22:46.672998] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-10. [2025-10-02T18:22:47.478379] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-06. [2025-10-02T18:22:47.490974] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-02T18:22:47.557153] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-02T18:22:47.559090] [INFO ] [REMOTE ] DBI: Full fetch complete (65809 records). [2025-10-02T18:22:47.559228] [DEBUG] [VALIDATOR ] DBI: Validating primary data. [2025-10-02T18:22:47.989601] [DEBUG] [VALIDATOR ] DBI: All expected trading days are present. [2025-10-02T18:22:47.989728] [DEBUG] [VALIDATOR ] DBI: Primary data validation passed. [2025-10-02T18:22:47.990633] [INFO ] [MAIN ] DBI: Fetched primary data is valid. [2025-10-02T18:22:47.990734] [DEBUG] [LOCAL ] DBI: Saving primary data. [2025-10-02T18:22:47.992504] [DEBUG] [LOCAL ] DBI: Trimmed 65809 records to 44841 (keeping 200 days of data) [2025-10-02T18:22:48.267085] [DEBUG] [LOCAL ] DBI: Primary data saved (44841 records). [2025-10-02T18:22:48.267220] [INFO ] [MAIN ] DBI: Full history saved. [2025-10-02T18:22:48.267333] [INFO ] [MAIN ] Update Progress: 595/2370 symbols completed. DBI took 43.3s. Estimated remaining: 4h 6m 50s. Rate: 7.2 symbols/min [2025-10-02T18:22:48.279821] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-06. [2025-10-02T18:22:48.460109] [INFO ] [MAIN ] DD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:22:48.516304] [DEBUG] [LOCAL ] DD: Loaded 52826 existing records from primary storage. [2025-10-02T18:22:48.516670] [INFO ] [MAIN ] DD: Loaded 52826 existing records. [2025-10-02T18:22:48.733169] [WARN ] [MAIN ] DD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:22:48.733561] [INFO ] [MAIN ] DD: Wiping existing primary data before full refresh. [2025-10-02T18:22:48.733706] [INFO ] [LOCAL ] DD: Starting deletion of primary data. [2025-10-02T18:22:48.735565] [DEBUG] [LOCAL ] DD: Deleted primary data file. [2025-10-02T18:22:48.735636] [INFO ] [MAIN ] DD: Starting full primary refresh. [2025-10-02T18:22:49.075419] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-05. [2025-10-02T18:22:49.205846] [INFO ] [REMOTE ] DD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:22:49.208513] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-02T18:22:49.229904] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-02T18:22:49.873033] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-07. [2025-10-02T18:22:50.486099] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-02T18:22:50.673038] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-07. [2025-10-02T18:22:50.866351] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-02T18:22:51.473028] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-08. [2025-10-02T18:22:52.117817] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-02T18:22:52.273009] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-08. [2025-10-02T18:22:53.073007] [INFO ] [REMOTE ] DD: Fetching primary data for 2024-12. [2025-10-02T18:22:53.873003] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-06. [2025-10-02T18:23:05.037576] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-08 (13.56 seconds). [2025-10-02T18:23:05.042856] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-09. [2025-10-02T18:23:05.625548] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2024-12 (12.55 seconds). [2025-10-02T18:23:05.637144] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-01. [2025-10-02T18:23:05.685208] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-06 (11.81 seconds). [2025-10-02T18:23:05.693501] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-07. [2025-10-02T18:23:06.090379] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-08 (13.82 seconds). [2025-10-02T18:23:06.102856] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-09. [2025-10-02T18:23:06.490560] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-02T18:23:06.495004] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-10. [2025-10-02T18:23:07.384584] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-02T18:23:07.395587] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-02. [2025-10-02T18:23:08.104721] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-02T18:23:08.108710] [INFO ] [REMOTE ] DCO: Full fetch complete (19112 records). [2025-10-02T18:23:08.108502] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-02T18:23:08.120239] [DEBUG] [VALIDATOR ] DCO: Validating primary data. [2025-10-02T18:23:08.140316] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-10. [2025-10-02T18:23:08.159182] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-10-02T18:23:08.236824] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-08. [2025-10-02T18:23:08.560072] [DEBUG] [VALIDATOR ] DCO: All expected trading days are present. [2025-10-02T18:23:08.560146] [DEBUG] [VALIDATOR ] DCO: Primary data validation passed. [2025-10-02T18:23:08.560538] [INFO ] [MAIN ] DCO: Fetched primary data is valid. [2025-10-02T18:23:08.560580] [DEBUG] [LOCAL ] DCO: Saving primary data. [2025-10-02T18:23:08.561172] [DEBUG] [LOCAL ] DCO: Trimmed 19112 records to 13948 (keeping 200 days of data) [2025-10-02T18:23:08.650660] [DEBUG] [LOCAL ] DCO: Primary data saved (13948 records). [2025-10-02T18:23:08.650817] [INFO ] [MAIN ] DCO: Full history saved. [2025-10-02T18:23:08.650909] [INFO ] [MAIN ] Update Progress: 596/2370 symbols completed. DCO took 34.8s. Estimated remaining: 4h 7m 17s. Rate: 7.2 symbols/min [2025-10-02T18:23:08.842275] [INFO ] [MAIN ] DDD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:23:08.900283] [DEBUG] [LOCAL ] DDD: Loaded 50889 existing records from primary storage. [2025-10-02T18:23:08.900701] [INFO ] [MAIN ] DDD: Loaded 50889 existing records. [2025-10-02T18:23:09.120682] [WARN ] [MAIN ] DDD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:23:09.121032] [INFO ] [MAIN ] DDD: Wiping existing primary data before full refresh. [2025-10-02T18:23:09.121181] [INFO ] [LOCAL ] DDD: Starting deletion of primary data. [2025-10-02T18:23:09.122807] [DEBUG] [LOCAL ] DDD: Deleted primary data file. [2025-10-02T18:23:09.122871] [INFO ] [MAIN ] DDD: Starting full primary refresh. [2025-10-02T18:23:09.206699] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-02T18:23:09.246346] [INFO ] [REMOTE ] DBRG: Full fetch complete (71963 records). [2025-10-02T18:23:09.247072] [DEBUG] [VALIDATOR ] DBRG: Validating primary data. [2025-10-02T18:23:09.279361] [FATAL] [VALIDATOR ] DBRG: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:23:09.279694] [FATAL] [MAIN ] DBRG: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:23:09.279778] [WARN ] [MAIN ] DBRG: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:23:09.279867] [INFO ] [LOCAL ] DBRG: Starting deletion of primary data. [2025-10-02T18:23:09.279986] [DEBUG] [LOCAL ] DBRG: No primary data file found to delete. [2025-10-02T18:23:09.325217] [INFO ] [LOCAL ] DBRG: Starting deletion of derivative data. [2025-10-02T18:23:09.364566] [DEBUG] [LOCAL ] DBRG: Deleted derivative data file. [2025-10-02T18:23:09.389782] [INFO ] [MAIN ] Update Progress: 597/2370 symbols completed. DBRG took 58.7s. Estimated remaining: 4h 6m 46s. Rate: 7.2 symbols/min [2025-10-02T18:23:09.409122] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-02T18:23:09.487166] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-03. [2025-10-02T18:23:09.586503] [INFO ] [REMOTE ] DDD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:23:09.586909] [INFO ] [REMOTE ] DDD: Fetching primary data for 2024-12. [2025-10-02T18:23:09.903146] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-02T18:23:09.912572] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-09. [2025-10-02T18:23:11.125401] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-02T18:23:11.137236] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-04. [2025-10-02T18:23:11.260273] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-02T18:23:11.269535] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-10. [2025-10-02T18:23:11.591492] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-02T18:23:11.602586] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-01. [2025-10-02T18:23:12.256432] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-02T18:23:12.258062] [INFO ] [REMOTE ] DCI: Full fetch complete (53667 records). [2025-10-02T18:23:12.258185] [DEBUG] [VALIDATOR ] DCI: Validating primary data. [2025-10-02T18:23:12.258905] [FATAL] [VALIDATOR ] DCI: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:23:12.258994] [FATAL] [MAIN ] DCI: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:23:12.259040] [WARN ] [MAIN ] DCI: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:23:12.259083] [INFO ] [LOCAL ] DCI: Starting deletion of primary data. [2025-10-02T18:23:12.259141] [DEBUG] [LOCAL ] DCI: No primary data file found to delete. [2025-10-02T18:23:12.259230] [INFO ] [LOCAL ] DCI: Starting deletion of derivative data. [2025-10-02T18:23:12.259695] [DEBUG] [LOCAL ] DCI: Deleted derivative data file. [2025-10-02T18:23:12.260107] [INFO ] [MAIN ] Update Progress: 598/2370 symbols completed. DCI took 42.8s. Estimated remaining: 4h 6m 22s. Rate: 7.2 symbols/min [2025-10-02T18:23:12.686547] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-02T18:23:12.698078] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-05. [2025-10-02T18:23:13.046344] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-02T18:23:13.057408] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-02. [2025-10-02T18:23:14.180509] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-02T18:23:14.192213] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-06. [2025-10-02T18:23:14.409017] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-02T18:23:14.419555] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-03. [2025-10-02T18:23:16.035997] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-02T18:23:16.047561] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-07. [2025-10-02T18:23:16.123167] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-02T18:23:16.135024] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-04. [2025-10-02T18:23:17.838178] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-02T18:23:17.851407] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-08. [2025-10-02T18:23:17.886594] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-02T18:23:17.899263] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-05. [2025-10-02T18:23:19.740184] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-02T18:23:19.752250] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-09. [2025-10-02T18:23:19.804919] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-02T18:23:19.816301] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-06. [2025-10-02T18:23:21.474831] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-02T18:23:21.487914] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-10. [2025-10-02T18:23:21.595001] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-02T18:23:21.606268] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-07. [2025-10-02T18:23:23.012447] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-02T18:23:23.015268] [INFO ] [REMOTE ] DD: Full fetch complete (76335 records). [2025-10-02T18:23:23.015437] [DEBUG] [VALIDATOR ] DD: Validating primary data. [2025-10-02T18:23:23.480601] [DEBUG] [VALIDATOR ] DD: All expected trading days are present. [2025-10-02T18:23:23.480750] [DEBUG] [VALIDATOR ] DD: Primary data validation passed. [2025-10-02T18:23:23.481796] [INFO ] [MAIN ] DD: Fetched primary data is valid. [2025-10-02T18:23:23.481896] [DEBUG] [LOCAL ] DD: Saving primary data. [2025-10-02T18:23:23.515798] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-02T18:23:23.514183] [DEBUG] [LOCAL ] DD: Trimmed 76335 records to 53213 (keeping 200 days of data) [2025-10-02T18:23:23.527971] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-08. [2025-10-02T18:23:23.878302] [DEBUG] [LOCAL ] DD: Primary data saved (53213 records). [2025-10-02T18:23:23.878452] [INFO ] [MAIN ] DD: Full history saved. [2025-10-02T18:23:23.878535] [INFO ] [MAIN ] Update Progress: 599/2370 symbols completed. DD took 35.6s. Estimated remaining: 4h 6m 23s. Rate: 7.2 symbols/min [2025-10-02T18:23:25.509729] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-02T18:23:25.527390] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-09. [2025-10-02T18:23:27.134053] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-02T18:23:27.146121] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-10. [2025-10-02T18:23:28.807050] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-02T18:23:28.809235] [INFO ] [REMOTE ] DDD: Full fetch complete (73693 records). [2025-10-02T18:23:28.809377] [DEBUG] [VALIDATOR ] DDD: Validating primary data. [2025-10-02T18:23:29.248595] [DEBUG] [VALIDATOR ] DDD: All expected trading days are present. [2025-10-02T18:23:29.248729] [DEBUG] [VALIDATOR ] DDD: Primary data validation passed. [2025-10-02T18:23:29.249564] [INFO ] [MAIN ] DDD: Fetched primary data is valid. [2025-10-02T18:23:29.249614] [DEBUG] [LOCAL ] DDD: Saving primary data. [2025-10-02T18:23:29.251247] [DEBUG] [LOCAL ] DDD: Trimmed 73693 records to 51270 (keeping 200 days of data) [2025-10-02T18:23:29.564265] [DEBUG] [LOCAL ] DDD: Primary data saved (51270 records). [2025-10-02T18:23:29.564427] [INFO ] [MAIN ] DDD: Full history saved. [2025-10-02T18:23:29.564515] [INFO ] [MAIN ] Update Progress: 600/2370 symbols completed. DDD took 20.9s. Estimated remaining: 4h 6m 7s. Rate: 7.2 symbols/min [2025-10-02T18:23:30.275058] [INFO ] [MAIN ] DE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:23:30.430293] [INFO ] [MAIN ] DDT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:23:30.556619] [INFO ] [MAIN ] DDS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:23:30.559168] [INFO ] [MAIN ] DDL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:23:30.562859] [DEBUG] [LOCAL ] DDT: Loaded 2079 existing records from primary storage. [2025-10-02T18:23:30.563266] [INFO ] [MAIN ] DDT: Loaded 2079 existing records. [2025-10-02T18:23:30.700136] [DEBUG] [LOCAL ] DDS: Loaded 13050 existing records from primary storage. [2025-10-02T18:23:30.715502] [INFO ] [MAIN ] DDS: Loaded 13050 existing records. [2025-10-02T18:23:30.856878] [DEBUG] [LOCAL ] DDL: Loaded 36749 existing records from primary storage. [2025-10-02T18:23:30.855914] [WARN ] [MAIN ] DDT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:23:30.889880] [INFO ] [MAIN ] DDL: Loaded 36749 existing records. [2025-10-02T18:23:30.896703] [DEBUG] [LOCAL ] DE: Loaded 47563 existing records from primary storage. [2025-10-02T18:23:30.922214] [INFO ] [MAIN ] DDT: Wiping existing primary data before full refresh. [2025-10-02T18:23:30.944584] [INFO ] [MAIN ] DE: Loaded 47563 existing records. [2025-10-02T18:23:30.949854] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-10-02T18:23:31.097764] [DEBUG] [LOCAL ] DDT: Deleted primary data file. [2025-10-02T18:23:31.168881] [INFO ] [MAIN ] DDT: Starting full primary refresh. [2025-10-02T18:23:31.194464] [WARN ] [MAIN ] DDS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:23:31.318735] [INFO ] [MAIN ] DDS: Wiping existing primary data before full refresh. [2025-10-02T18:23:31.360335] [INFO ] [LOCAL ] DDS: Starting deletion of primary data. [2025-10-02T18:23:31.533781] [WARN ] [MAIN ] DDL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:23:31.530259] [DEBUG] [LOCAL ] DDS: Deleted primary data file. [2025-10-02T18:23:31.565113] [INFO ] [MAIN ] DDL: Wiping existing primary data before full refresh. [2025-10-02T18:23:31.565037] [INFO ] [MAIN ] DDS: Starting full primary refresh. [2025-10-02T18:23:31.654635] [INFO ] [LOCAL ] DDL: Starting deletion of primary data. [2025-10-02T18:23:31.736601] [DEBUG] [LOCAL ] DDL: Deleted primary data file. [2025-10-02T18:23:31.803099] [INFO ] [MAIN ] DDL: Starting full primary refresh. [2025-10-02T18:23:31.809256] [WARN ] [MAIN ] DE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:23:31.876315] [INFO ] [MAIN ] DE: Wiping existing primary data before full refresh. [2025-10-02T18:23:31.939141] [INFO ] [LOCAL ] DE: Starting deletion of primary data. [2025-10-02T18:23:32.058818] [DEBUG] [LOCAL ] DE: Deleted primary data file. [2025-10-02T18:23:32.085669] [INFO ] [MAIN ] DE: Starting full primary refresh. [2025-10-02T18:23:32.721230] [INFO ] [REMOTE ] DDT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:23:32.819355] [INFO ] [REMOTE ] DDT: Fetching primary data for 2024-12. [2025-10-02T18:23:32.988970] [INFO ] [REMOTE ] DDS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:23:33.032787] [INFO ] [REMOTE ] DDS: Fetching primary data for 2024-12. [2025-10-02T18:23:33.226027] [INFO ] [REMOTE ] DDL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:23:33.242134] [INFO ] [REMOTE ] DDL: Fetching primary data for 2024-12. [2025-10-02T18:23:33.286441] [INFO ] [REMOTE ] DE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:23:33.286873] [INFO ] [REMOTE ] DE: Fetching primary data for 2024-12. [2025-10-02T18:23:33.493001] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-02T18:23:33.494210] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-01. [2025-10-02T18:23:33.898364] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-02T18:23:33.902227] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-01. [2025-10-02T18:23:33.945217] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-02T18:23:33.946899] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-02. [2025-10-02T18:23:34.393864] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-02T18:23:34.395480] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-03. [2025-10-02T18:23:34.664970] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-02T18:23:34.668608] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-02. [2025-10-02T18:23:34.751779] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-02T18:23:34.762086] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-01. [2025-10-02T18:23:34.855946] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-02T18:23:34.857238] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-04. [2025-10-02T18:23:35.031950] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-02T18:23:35.041507] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-01. [2025-10-02T18:23:35.435042] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-02T18:23:35.436753] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-05. [2025-10-02T18:23:35.631246] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-02T18:23:35.634746] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-03. [2025-10-02T18:23:35.731067] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-02T18:23:35.732267] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-06. [2025-10-02T18:23:36.174446] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-02T18:23:36.175722] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-07. [2025-10-02T18:23:36.212811] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-02T18:23:36.220603] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-02. [2025-10-02T18:23:36.297710] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-02T18:23:36.309256] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-02. [2025-10-02T18:23:36.391049] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-02T18:23:36.395009] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-04. [2025-10-02T18:23:36.699414] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-02T18:23:36.700974] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-08. [2025-10-02T18:23:37.158168] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-02T18:23:37.159270] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-09. [2025-10-02T18:23:37.283202] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-02T18:23:37.291065] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-03. [2025-10-02T18:23:37.485943] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-02T18:23:37.495901] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-03. [2025-10-02T18:23:37.577357] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-02T18:23:37.578597] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-10. [2025-10-02T18:23:37.647739] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-02T18:23:37.653812] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-05. [2025-10-02T18:23:37.985551] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-02T18:23:37.986480] [INFO ] [REMOTE ] DDT: Full fetch complete (2902 records). [2025-10-02T18:23:37.986577] [DEBUG] [VALIDATOR ] DDT: Validating primary data. [2025-10-02T18:23:38.418451] [DEBUG] [VALIDATOR ] DDT: All expected trading days are present. [2025-10-02T18:23:38.418561] [DEBUG] [VALIDATOR ] DDT: Primary data validation passed. [2025-10-02T18:23:38.418745] [INFO ] [MAIN ] DDT: Fetched primary data is valid. [2025-10-02T18:23:38.418909] [DEBUG] [LOCAL ] DDT: Saving primary data. [2025-10-02T18:23:38.419625] [DEBUG] [LOCAL ] DDT: Trimmed 2902 records to 2086 (keeping 200 days of data) [2025-10-02T18:23:38.462517] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-02T18:23:38.463261] [DEBUG] [LOCAL ] DDT: Primary data saved (2086 records). [2025-10-02T18:23:38.472297] [INFO ] [MAIN ] DDT: Full history saved. [2025-10-02T18:23:38.472455] [INFO ] [MAIN ] Update Progress: 601/2370 symbols completed. DDT took 8.9s. Estimated remaining: 4h 6m 0s. Rate: 7.2 symbols/min [2025-10-02T18:23:38.478347] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-04. [2025-10-02T18:23:38.666972] [INFO ] [MAIN ] DEA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:23:38.678605] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-02T18:23:38.682850] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-06. [2025-10-02T18:23:38.722749] [DEBUG] [LOCAL ] DEA: Loaded 40853 existing records from primary storage. [2025-10-02T18:23:38.723078] [INFO ] [MAIN ] DEA: Loaded 40853 existing records. [2025-10-02T18:23:38.930126] [WARN ] [MAIN ] DEA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:23:38.930521] [INFO ] [MAIN ] DEA: Wiping existing primary data before full refresh. [2025-10-02T18:23:38.930592] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-10-02T18:23:38.931906] [DEBUG] [LOCAL ] DEA: Deleted primary data file. [2025-10-02T18:23:38.931985] [INFO ] [MAIN ] DEA: Starting full primary refresh. [2025-10-02T18:23:39.366426] [INFO ] [REMOTE ] DEA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:23:39.402073] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-02T18:23:39.423768] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-02T18:23:39.473071] [INFO ] [REMOTE ] DEA: Fetching primary data for 2024-12. [2025-10-02T18:23:40.109348] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-02T18:23:40.273023] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-04. [2025-10-02T18:23:41.073095] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-07. [2025-10-02T18:23:41.076538] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-02T18:23:41.709841] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-02T18:23:41.750133] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-02T18:23:41.873039] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-08. [2025-10-02T18:23:42.617823] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-02T18:23:42.673024] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-01. [2025-10-02T18:23:43.473081] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-09. [2025-10-02T18:23:44.110054] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-02T18:23:44.166319] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-02T18:23:44.273189] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-05. [2025-10-02T18:23:45.073067] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-02. [2025-10-02T18:23:45.873006] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-10. [2025-10-02T18:23:46.202930] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-02T18:23:46.240877] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-02T18:23:46.673039] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-06. [2025-10-02T18:23:47.164127] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-02T18:23:47.165164] [INFO ] [REMOTE ] DDS: Full fetch complete (18977 records). [2025-10-02T18:23:47.165274] [DEBUG] [VALIDATOR ] DDS: Validating primary data. [2025-10-02T18:23:47.165898] [FATAL] [VALIDATOR ] DDS: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:23:47.165985] [FATAL] [MAIN ] DDS: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:23:47.166030] [WARN ] [MAIN ] DDS: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:23:47.166098] [INFO ] [LOCAL ] DDS: Starting deletion of primary data. [2025-10-02T18:23:47.166163] [DEBUG] [LOCAL ] DDS: No primary data file found to delete. [2025-10-02T18:23:47.166202] [INFO ] [LOCAL ] DDS: Starting deletion of derivative data. [2025-10-02T18:23:47.166531] [DEBUG] [LOCAL ] DDS: Deleted derivative data file. [2025-10-02T18:23:47.166628] [INFO ] [MAIN ] Update Progress: 602/2370 symbols completed. DDS took 17.6s. Estimated remaining: 4h 5m 53s. Rate: 7.2 symbols/min [2025-10-02T18:23:47.369934] [INFO ] [MAIN ] DEC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:23:47.411301] [DEBUG] [LOCAL ] DEC: Loaded 30451 existing records from primary storage. [2025-10-02T18:23:47.411628] [INFO ] [MAIN ] DEC: Loaded 30451 existing records. [2025-10-02T18:23:47.479437] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-05. [2025-10-02T18:23:47.608565] [WARN ] [MAIN ] DEC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:23:47.608830] [INFO ] [MAIN ] DEC: Wiping existing primary data before full refresh. [2025-10-02T18:23:47.608880] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-10-02T18:23:47.609830] [DEBUG] [LOCAL ] DEC: Deleted primary data file. [2025-10-02T18:23:47.609891] [INFO ] [MAIN ] DEC: Starting full primary refresh. [2025-10-02T18:23:48.005635] [INFO ] [REMOTE ] DEC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:23:48.036932] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-02T18:23:48.273005] [INFO ] [REMOTE ] DEC: Fetching primary data for 2024-12. [2025-10-02T18:23:49.073016] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-03. [2025-10-02T18:23:49.118534] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-02T18:23:49.616058] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-02T18:23:49.872996] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-06. [2025-10-02T18:23:50.428248] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-02T18:23:50.672969] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-04. [2025-10-02T18:23:51.130369] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-02T18:23:51.473037] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-01. [2025-10-02T18:23:52.273046] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-07. [2025-10-02T18:23:52.462040] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-02T18:23:52.501599] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-02T18:23:53.073000] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-02. [2025-10-02T18:23:53.563909] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-02T18:23:53.873008] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-07. [2025-10-02T18:23:54.020223] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-02T18:23:54.673051] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-08. [2025-10-02T18:23:55.423700] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-02T18:23:55.472983] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-03. [2025-10-02T18:23:55.946530] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-02T18:23:56.273004] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-08. [2025-10-02T18:23:56.884440] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-02T18:23:57.073024] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-05. [2025-10-02T18:23:57.873003] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-09. [2025-10-02T18:23:58.505812] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-02T18:23:58.554415] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-02T18:23:58.673005] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-06. [2025-10-02T18:23:59.201092] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-02T18:23:59.473009] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-10. [2025-10-02T18:24:00.101826] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-02T18:24:00.273007] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-09. [2025-10-02T18:24:00.623689] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-02T18:24:00.626062] [INFO ] [REMOTE ] DDL: Full fetch complete (53236 records). [2025-10-02T18:24:00.626371] [DEBUG] [VALIDATOR ] DDL: Validating primary data. [2025-10-02T18:24:01.072759] [DEBUG] [VALIDATOR ] DDL: All expected trading days are present. [2025-10-02T18:24:01.072933] [DEBUG] [VALIDATOR ] DDL: Primary data validation passed. [2025-10-02T18:24:01.073799] [INFO ] [MAIN ] DDL: Fetched primary data is valid. [2025-10-02T18:24:01.073879] [DEBUG] [LOCAL ] DDL: Saving primary data. [2025-10-02T18:24:01.072972] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-07. [2025-10-02T18:24:01.075946] [DEBUG] [LOCAL ] DDL: Trimmed 53236 records to 37057 (keeping 200 days of data) [2025-10-02T18:24:01.315041] [DEBUG] [LOCAL ] DDL: Primary data saved (37057 records). [2025-10-02T18:24:01.315203] [INFO ] [MAIN ] DDL: Full history saved. [2025-10-02T18:24:01.315316] [INFO ] [MAIN ] Update Progress: 603/2370 symbols completed. DDL took 31.7s. Estimated remaining: 4h 6m 2s. Rate: 7.2 symbols/min [2025-10-02T18:24:01.521624] [INFO ] [MAIN ] DECK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:24:01.521924] [DEBUG] [LOCAL ] DECK: No existing data file found in primary storage. [2025-10-02T18:24:01.522007] [WARN ] [MAIN ] DECK: No existing data found, performing full refresh instead. [2025-10-02T18:24:01.522135] [INFO ] [MAIN ] DECK: Wiping existing primary data before full refresh. [2025-10-02T18:24:01.522182] [INFO ] [LOCAL ] DECK: Starting deletion of primary data. [2025-10-02T18:24:01.522252] [DEBUG] [LOCAL ] DECK: No primary data file found to delete. [2025-10-02T18:24:01.522316] [INFO ] [MAIN ] DECK: Starting full primary refresh. [2025-10-02T18:24:01.873273] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-04. [2025-10-02T18:24:01.944924] [INFO ] [REMOTE ] DECK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:24:02.226935] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-02T18:24:02.673004] [INFO ] [REMOTE ] DECK: Fetching primary data for 2024-12. [2025-10-02T18:24:02.830224] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-02T18:24:03.075542] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-02T18:24:03.473018] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-08. [2025-10-02T18:24:04.272992] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-10. [2025-10-02T18:24:04.390134] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-02T18:24:04.720272] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-02T18:24:05.073045] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-01. [2025-10-02T18:24:05.831367] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-02T18:24:05.833403] [INFO ] [REMOTE ] DE: Full fetch complete (69596 records). [2025-10-02T18:24:05.833535] [DEBUG] [VALIDATOR ] DE: Validating primary data. [2025-10-02T18:24:05.881114] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-05. [2025-10-02T18:24:06.282293] [DEBUG] [VALIDATOR ] DE: All expected trading days are present. [2025-10-02T18:24:06.282474] [DEBUG] [VALIDATOR ] DE: Primary data validation passed. [2025-10-02T18:24:06.283320] [INFO ] [MAIN ] DE: Fetched primary data is valid. [2025-10-02T18:24:06.283390] [DEBUG] [LOCAL ] DE: Saving primary data. [2025-10-02T18:24:06.284924] [DEBUG] [LOCAL ] DE: Trimmed 69596 records to 47908 (keeping 200 days of data) [2025-10-02T18:24:06.625908] [DEBUG] [LOCAL ] DE: Primary data saved (47908 records). [2025-10-02T18:24:06.626067] [INFO ] [MAIN ] DE: Full history saved. [2025-10-02T18:24:06.626157] [INFO ] [MAIN ] Update Progress: 604/2370 symbols completed. DE took 37.1s. Estimated remaining: 4h 5m 44s. Rate: 7.2 symbols/min [2025-10-02T18:24:06.675154] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-09. [2025-10-02T18:24:06.831180] [INFO ] [MAIN ] DEI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:24:06.881286] [DEBUG] [LOCAL ] DEI: Loaded 48359 existing records from primary storage. [2025-10-02T18:24:06.881626] [INFO ] [MAIN ] DEI: Loaded 48359 existing records. [2025-10-02T18:24:07.106891] [WARN ] [MAIN ] DEI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:24:07.107782] [INFO ] [MAIN ] DEI: Wiping existing primary data before full refresh. [2025-10-02T18:24:07.108158] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-10-02T18:24:07.111811] [DEBUG] [LOCAL ] DEI: Deleted primary data file. [2025-10-02T18:24:07.111920] [INFO ] [MAIN ] DEI: Starting full primary refresh. [2025-10-02T18:24:07.222405] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-02T18:24:07.333485] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-02T18:24:07.478812] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-02. [2025-10-02T18:24:07.642929] [INFO ] [REMOTE ] DEI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:24:07.838056] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-02T18:24:08.273002] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-06. [2025-10-02T18:24:09.072994] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-10. [2025-10-02T18:24:09.361441] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-02T18:24:09.749924] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-02T18:24:09.872999] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-03. [2025-10-02T18:24:10.081446] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-02T18:24:10.085834] [INFO ] [REMOTE ] DEA: Full fetch complete (62192 records). [2025-10-02T18:24:10.086011] [DEBUG] [VALIDATOR ] DEA: Validating primary data. [2025-10-02T18:24:10.087046] [FATAL] [VALIDATOR ] DEA: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:24:10.087154] [FATAL] [MAIN ] DEA: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:24:10.087220] [WARN ] [MAIN ] DEA: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:24:10.087308] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-10-02T18:24:10.087401] [DEBUG] [LOCAL ] DEA: No primary data file found to delete. [2025-10-02T18:24:10.087480] [INFO ] [LOCAL ] DEA: Starting deletion of derivative data. [2025-10-02T18:24:10.087930] [DEBUG] [LOCAL ] DEA: Deleted derivative data file. [2025-10-02T18:24:10.088103] [INFO ] [MAIN ] Update Progress: 605/2370 symbols completed. DEA took 31.6s. Estimated remaining: 4h 5m 22s. Rate: 7.2 symbols/min [2025-10-02T18:24:10.285237] [INFO ] [MAIN ] DELL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:24:10.357407] [DEBUG] [LOCAL ] DELL: Loaded 53735 existing records from primary storage. [2025-10-02T18:24:10.357754] [INFO ] [MAIN ] DELL: Loaded 53735 existing records. [2025-10-02T18:24:10.566454] [WARN ] [MAIN ] DELL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:24:10.566687] [INFO ] [MAIN ] DELL: Wiping existing primary data before full refresh. [2025-10-02T18:24:10.566748] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-10-02T18:24:10.569021] [DEBUG] [LOCAL ] DELL: Deleted primary data file. [2025-10-02T18:24:10.569087] [INFO ] [MAIN ] DELL: Starting full primary refresh. [2025-10-02T18:24:10.682561] [INFO ] [REMOTE ] DEI: Fetching primary data for 2024-12. [2025-10-02T18:24:10.972170] [INFO ] [REMOTE ] DELL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:24:11.473046] [INFO ] [REMOTE ] DELL: Fetching primary data for 2024-12. [2025-10-02T18:24:12.086394] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-02T18:24:12.278134] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-04. [2025-10-02T18:24:12.301806] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-02T18:24:13.073081] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-07. [2025-10-02T18:24:13.873048] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-01. [2025-10-02T18:24:14.001967] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2024-12 (2.53 seconds). [2025-10-02T18:24:14.041952] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-02T18:24:14.173044] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-02T18:24:14.673012] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-01. [2025-10-02T18:24:15.473000] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-08. [2025-10-02T18:24:15.523856] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-02T18:24:16.273061] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-05. [2025-10-02T18:24:16.651472] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-02T18:24:17.073009] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-09. [2025-10-02T18:24:17.262738] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-01 (2.59 seconds). [2025-10-02T18:24:17.873001] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-02. [2025-10-02T18:24:18.181376] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-02T18:24:18.410899] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-02T18:24:18.673066] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-06. [2025-10-02T18:24:18.967443] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-02T18:24:19.473014] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-02. [2025-10-02T18:24:20.272999] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-03. [2025-10-02T18:24:20.729160] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-02T18:24:21.073078] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-10. [2025-10-02T18:24:21.214803] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-02T18:24:21.569131] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-02T18:24:21.873035] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-04. [2025-10-02T18:24:22.461075] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-02T18:24:22.463359] [INFO ] [REMOTE ] DEC: Full fetch complete (43318 records). [2025-10-02T18:24:22.463499] [DEBUG] [VALIDATOR ] DEC: Validating primary data. [2025-10-02T18:24:22.716405] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-07. [2025-10-02T18:24:22.957116] [DEBUG] [VALIDATOR ] DEC: All expected trading days are present. [2025-10-02T18:24:22.957209] [DEBUG] [VALIDATOR ] DEC: Primary data validation passed. [2025-10-02T18:24:22.958070] [INFO ] [MAIN ] DEC: Fetched primary data is valid. [2025-10-02T18:24:22.958134] [DEBUG] [LOCAL ] DEC: Saving primary data. [2025-10-02T18:24:22.959565] [DEBUG] [LOCAL ] DEC: Trimmed 43318 records to 30765 (keeping 200 days of data) [2025-10-02T18:24:23.179409] [DEBUG] [LOCAL ] DEC: Primary data saved (30765 records). [2025-10-02T18:24:23.179559] [INFO ] [MAIN ] DEC: Full history saved. [2025-10-02T18:24:23.180558] [INFO ] [MAIN ] Update Progress: 606/2370 symbols completed. DEC took 36.0s. Estimated remaining: 4h 5m 27s. Rate: 7.2 symbols/min [2025-10-02T18:24:23.379777] [INFO ] [MAIN ] DEO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:24:23.379980] [DEBUG] [LOCAL ] DEO: No existing data file found in primary storage. [2025-10-02T18:24:23.380058] [WARN ] [MAIN ] DEO: No existing data found, performing full refresh instead. [2025-10-02T18:24:23.380458] [INFO ] [MAIN ] DEO: Wiping existing primary data before full refresh. [2025-10-02T18:24:23.380539] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-10-02T18:24:23.380672] [DEBUG] [LOCAL ] DEO: No primary data file found to delete. [2025-10-02T18:24:23.380827] [INFO ] [MAIN ] DEO: Starting full primary refresh. [2025-10-02T18:24:23.474190] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-03. [2025-10-02T18:24:23.759816] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-02T18:24:23.865261] [INFO ] [REMOTE ] DEO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:24:24.273047] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-05. [2025-10-02T18:24:25.058513] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-02T18:24:25.072963] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-08. [2025-10-02T18:24:25.627420] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-02T18:24:25.739310] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-02T18:24:25.873017] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-04. [2025-10-02T18:24:26.673061] [INFO ] [REMOTE ] DEO: Fetching primary data for 2024-12. [2025-10-02T18:24:26.978692] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-02T18:24:27.473026] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-06. [2025-10-02T18:24:28.035944] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-02T18:24:28.273040] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-09. [2025-10-02T18:24:28.413400] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-02T18:24:29.014557] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-02T18:24:29.073027] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-01. [2025-10-02T18:24:29.872968] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-05. [2025-10-02T18:24:30.129419] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-02T18:24:30.484730] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-02T18:24:30.673185] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-02. [2025-10-02T18:24:31.473068] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-07. [2025-10-02T18:24:32.180716] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-10-02T18:24:32.272974] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-06. [2025-10-02T18:24:32.464397] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-02T18:24:32.922693] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-02T18:24:33.073004] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-08. [2025-10-02T18:24:33.873040] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-03. [2025-10-02T18:24:34.525681] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-10-02T18:24:34.678360] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-10. [2025-10-02T18:24:34.701827] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-02T18:24:35.472985] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-07. [2025-10-02T18:24:35.601817] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-02T18:24:36.273023] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-04. [2025-10-02T18:24:36.494635] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-02T18:24:36.497009] [INFO ] [REMOTE ] DECK: Full fetch complete (76699 records). [2025-10-02T18:24:36.497206] [DEBUG] [VALIDATOR ] DECK: Validating primary data. [2025-10-02T18:24:36.937388] [DEBUG] [VALIDATOR ] DECK: All expected trading days are present. [2025-10-02T18:24:36.937485] [DEBUG] [VALIDATOR ] DECK: Primary data validation passed. [2025-10-02T18:24:36.938454] [INFO ] [MAIN ] DECK: Fetched primary data is valid. [2025-10-02T18:24:36.938522] [DEBUG] [LOCAL ] DECK: Saving primary data. [2025-10-02T18:24:36.940082] [DEBUG] [LOCAL ] DECK: Trimmed 76699 records to 53683 (keeping 200 days of data) [2025-10-02T18:24:37.073075] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-09. [2025-10-02T18:24:37.304765] [DEBUG] [LOCAL ] DECK: Primary data saved (53683 records). [2025-10-02T18:24:37.304921] [INFO ] [MAIN ] DECK: Full history saved. [2025-10-02T18:24:37.305100] [INFO ] [MAIN ] Update Progress: 607/2370 symbols completed. DECK took 36.0s. Estimated remaining: 4h 5m 36s. Rate: 7.2 symbols/min [2025-10-02T18:24:37.502182] [INFO ] [MAIN ] DFH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:24:37.534956] [DEBUG] [LOCAL ] DFH: Loaded 32278 existing records from primary storage. [2025-10-02T18:24:37.535288] [INFO ] [MAIN ] DFH: Loaded 32278 existing records. [2025-10-02T18:24:37.737335] [WARN ] [MAIN ] DFH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:24:37.738193] [INFO ] [MAIN ] DFH: Wiping existing primary data before full refresh. [2025-10-02T18:24:37.738282] [INFO ] [LOCAL ] DFH: Starting deletion of primary data. [2025-10-02T18:24:37.739454] [DEBUG] [LOCAL ] DFH: Deleted primary data file. [2025-10-02T18:24:37.739520] [INFO ] [MAIN ] DFH: Starting full primary refresh. [2025-10-02T18:24:38.190221] [INFO ] [REMOTE ] DFH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:24:38.220977] [INFO ] [REMOTE ] DFH: Fetching primary data for 2024-12. [2025-10-02T18:24:38.228274] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-07 (2.76 seconds). [2025-10-02T18:24:38.241290] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-02T18:24:38.678142] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-08. [2025-10-02T18:24:38.691770] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-02T18:24:39.472986] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-10. [2025-10-02T18:24:39.571387] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-02T18:24:40.273003] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-01. [2025-10-02T18:24:40.700252] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-02T18:24:40.711880] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-02T18:24:40.714706] [INFO ] [REMOTE ] DEI: Full fetch complete (69699 records). [2025-10-02T18:24:40.714858] [DEBUG] [VALIDATOR ] DEI: Validating primary data. [2025-10-02T18:24:41.078123] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-09. [2025-10-02T18:24:41.142382] [DEBUG] [VALIDATOR ] DEI: All expected trading days are present. [2025-10-02T18:24:41.142470] [DEBUG] [VALIDATOR ] DEI: Primary data validation passed. [2025-10-02T18:24:41.143388] [INFO ] [MAIN ] DEI: Fetched primary data is valid. [2025-10-02T18:24:41.143473] [DEBUG] [LOCAL ] DEI: Saving primary data. [2025-10-02T18:24:41.145437] [DEBUG] [LOCAL ] DEI: Trimmed 69699 records to 48684 (keeping 200 days of data) [2025-10-02T18:24:41.483896] [DEBUG] [LOCAL ] DEI: Primary data saved (48684 records). [2025-10-02T18:24:41.484095] [INFO ] [MAIN ] DEI: Full history saved. [2025-10-02T18:24:41.484270] [INFO ] [MAIN ] Update Progress: 608/2370 symbols completed. DEI took 34.9s. Estimated remaining: 4h 5m 15s. Rate: 7.2 symbols/min [2025-10-02T18:24:41.695705] [INFO ] [MAIN ] DFIN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:24:41.720200] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-02T18:24:41.750179] [DEBUG] [LOCAL ] DFIN: Loaded 23029 existing records from primary storage. [2025-10-02T18:24:41.750455] [INFO ] [MAIN ] DFIN: Loaded 23029 existing records. [2025-10-02T18:24:41.878094] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-02. [2025-10-02T18:24:41.946614] [WARN ] [MAIN ] DFIN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:24:41.946992] [INFO ] [MAIN ] DFIN: Wiping existing primary data before full refresh. [2025-10-02T18:24:41.947050] [INFO ] [LOCAL ] DFIN: Starting deletion of primary data. [2025-10-02T18:24:41.947877] [DEBUG] [LOCAL ] DFIN: Deleted primary data file. [2025-10-02T18:24:41.947941] [INFO ] [MAIN ] DFIN: Starting full primary refresh. [2025-10-02T18:24:42.363066] [INFO ] [REMOTE ] DFIN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:24:42.673029] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-05. [2025-10-02T18:24:43.251573] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-02T18:24:43.456925] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-10-02T18:24:43.472956] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-10. [2025-10-02T18:24:43.988682] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-02T18:24:44.273004] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-06. [2025-10-02T18:24:45.073017] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2024-12. [2025-10-02T18:24:45.338664] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-02T18:24:45.341375] [INFO ] [REMOTE ] DELL: Full fetch complete (77820 records). [2025-10-02T18:24:45.341495] [DEBUG] [VALIDATOR ] DELL: Validating primary data. [2025-10-02T18:24:45.817263] [DEBUG] [VALIDATOR ] DELL: All expected trading days are present. [2025-10-02T18:24:45.817356] [DEBUG] [VALIDATOR ] DELL: Primary data validation passed. [2025-10-02T18:24:45.818397] [INFO ] [MAIN ] DELL: Fetched primary data is valid. [2025-10-02T18:24:45.818472] [DEBUG] [LOCAL ] DELL: Saving primary data. [2025-10-02T18:24:45.820216] [DEBUG] [LOCAL ] DELL: Trimmed 77820 records to 54125 (keeping 200 days of data) [2025-10-02T18:24:45.894757] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-03. [2025-10-02T18:24:46.129896] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-02T18:24:46.251615] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-02T18:24:46.282317] [DEBUG] [LOCAL ] DELL: Primary data saved (54125 records). [2025-10-02T18:24:46.282450] [INFO ] [MAIN ] DELL: Full history saved. [2025-10-02T18:24:46.282627] [INFO ] [MAIN ] Update Progress: 609/2370 symbols completed. DELL took 36.2s. Estimated remaining: 4h 4m 57s. Rate: 7.2 symbols/min [2025-10-02T18:24:46.468665] [INFO ] [MAIN ] DFP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:24:46.481795] [DEBUG] [LOCAL ] DFP: Loaded 11445 existing records from primary storage. [2025-10-02T18:24:46.482047] [INFO ] [MAIN ] DFP: Loaded 11445 existing records. [2025-10-02T18:24:46.675793] [WARN ] [MAIN ] DFP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:24:46.676342] [INFO ] [MAIN ] DFP: Wiping existing primary data before full refresh. [2025-10-02T18:24:46.675909] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-07. [2025-10-02T18:24:46.676456] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-10-02T18:24:46.678615] [DEBUG] [LOCAL ] DFP: Deleted primary data file. [2025-10-02T18:24:46.678735] [INFO ] [MAIN ] DFP: Starting full primary refresh. [2025-10-02T18:24:47.122877] [INFO ] [REMOTE ] DFP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:24:47.473020] [INFO ] [REMOTE ] DFP: Fetching primary data for 2024-12. [2025-10-02T18:24:47.523327] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-02T18:24:48.264441] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-02T18:24:48.275069] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-01. [2025-10-02T18:24:48.895559] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-02T18:24:49.073008] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-04. [2025-10-02T18:24:49.229461] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-02T18:24:49.873011] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-08. [2025-10-02T18:24:50.489533] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-02T18:24:50.673013] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-01. [2025-10-02T18:24:51.341686] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-02T18:24:51.469456] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-02T18:24:51.479775] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-05. [2025-10-02T18:24:52.272981] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-02. [2025-10-02T18:24:52.767783] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-02T18:24:52.792189] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-02T18:24:53.073020] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-03. [2025-10-02T18:24:53.859483] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-02T18:24:53.872974] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-04. [2025-10-02T18:24:54.673002] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-09. [2025-10-02T18:24:55.172853] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-02T18:24:55.473016] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-02. [2025-10-02T18:24:56.272973] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-06. [2025-10-02T18:24:56.693182] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-02T18:24:56.722422] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-02T18:24:57.073011] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-05. [2025-10-02T18:24:57.389242] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-02T18:24:57.872999] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-07. [2025-10-02T18:24:58.293301] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-02T18:24:58.673000] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-06. [2025-10-02T18:24:59.309515] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-02T18:24:59.473000] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-10. [2025-10-02T18:24:59.528331] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-02T18:25:00.272989] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-03. [2025-10-02T18:25:00.823617] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-02T18:25:00.825376] [INFO ] [REMOTE ] DEO: Full fetch complete (71126 records). [2025-10-02T18:25:00.825567] [DEBUG] [VALIDATOR ] DEO: Validating primary data. [2025-10-02T18:25:00.826595] [FATAL] [VALIDATOR ] DEO: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:25:00.826735] [FATAL] [MAIN ] DEO: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:25:00.826783] [WARN ] [MAIN ] DEO: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:25:00.826856] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-10-02T18:25:00.826948] [DEBUG] [LOCAL ] DEO: No primary data file found to delete. [2025-10-02T18:25:00.827012] [INFO ] [LOCAL ] DEO: Starting deletion of derivative data. [2025-10-02T18:25:00.827060] [DEBUG] [LOCAL ] DEO: No derivative data file found to delete. [2025-10-02T18:25:00.827122] [INFO ] [MAIN ] Update Progress: 610/2370 symbols completed. DEO took 37.6s. Estimated remaining: 4h 5m 6s. Rate: 7.2 symbols/min [2025-10-02T18:25:01.015704] [INFO ] [MAIN ] DG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:25:01.073744] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-08. [2025-10-02T18:25:01.076012] [DEBUG] [LOCAL ] DG: Loaded 53283 existing records from primary storage. [2025-10-02T18:25:01.076533] [INFO ] [MAIN ] DG: Loaded 53283 existing records. [2025-10-02T18:25:01.283559] [WARN ] [MAIN ] DG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:25:01.283787] [INFO ] [MAIN ] DG: Wiping existing primary data before full refresh. [2025-10-02T18:25:01.283841] [INFO ] [LOCAL ] DG: Starting deletion of primary data. [2025-10-02T18:25:01.285594] [DEBUG] [LOCAL ] DG: Deleted primary data file. [2025-10-02T18:25:01.285692] [INFO ] [MAIN ] DG: Starting full primary refresh. [2025-10-02T18:25:01.726296] [INFO ] [REMOTE ] DG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:25:01.747343] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-02T18:25:01.873000] [INFO ] [REMOTE ] DG: Fetching primary data for 2024-12. [2025-10-02T18:25:02.672999] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-04. [2025-10-02T18:25:03.473056] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-07. [2025-10-02T18:25:03.569440] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-08 (2.50 seconds). [2025-10-02T18:25:04.023275] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-02T18:25:04.043477] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-02T18:25:04.143901] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-02T18:25:04.273004] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-08. [2025-10-02T18:25:05.073030] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-01. [2025-10-02T18:25:05.175799] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-02T18:25:05.873019] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-09. [2025-10-02T18:25:06.673032] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-05. [2025-10-02T18:25:06.738888] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-02T18:25:07.012194] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-02T18:25:07.472992] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-02. [2025-10-02T18:25:07.651600] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-02T18:25:08.273020] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-09. [2025-10-02T18:25:09.073028] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-06. [2025-10-02T18:25:09.236992] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-02T18:25:09.312495] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-02T18:25:09.873102] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-03. [2025-10-02T18:25:10.385882] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-02T18:25:10.673012] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-07. [2025-10-02T18:25:11.472965] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-10. [2025-10-02T18:25:11.868251] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-02T18:25:12.195384] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-02T18:25:12.272980] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-04. [2025-10-02T18:25:12.314434] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-02T18:25:12.315861] [INFO ] [REMOTE ] DFH: Full fetch complete (48642 records). [2025-10-02T18:25:12.315949] [DEBUG] [VALIDATOR ] DFH: Validating primary data. [2025-10-02T18:25:12.771397] [DEBUG] [VALIDATOR ] DFH: All expected trading days are present. [2025-10-02T18:25:12.771494] [DEBUG] [VALIDATOR ] DFH: Primary data validation passed. [2025-10-02T18:25:12.772202] [INFO ] [MAIN ] DFH: Fetched primary data is valid. [2025-10-02T18:25:12.772271] [DEBUG] [LOCAL ] DFH: Saving primary data. [2025-10-02T18:25:12.773502] [DEBUG] [LOCAL ] DFH: Trimmed 48642 records to 32447 (keeping 200 days of data) [2025-10-02T18:25:12.984349] [DEBUG] [LOCAL ] DFH: Primary data saved (32447 records). [2025-10-02T18:25:12.984501] [INFO ] [MAIN ] DFH: Full history saved. [2025-10-02T18:25:12.984588] [INFO ] [MAIN ] Update Progress: 611/2370 symbols completed. DFH took 35.7s. Estimated remaining: 4h 5m 9s. Rate: 7.2 symbols/min [2025-10-02T18:25:13.078250] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-08. [2025-10-02T18:25:13.186794] [INFO ] [MAIN ] DGX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:25:13.232699] [DEBUG] [LOCAL ] DGX: Loaded 44915 existing records from primary storage. [2025-10-02T18:25:13.233063] [INFO ] [MAIN ] DGX: Loaded 44915 existing records. [2025-10-02T18:25:13.432404] [WARN ] [MAIN ] DGX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:25:13.432669] [INFO ] [MAIN ] DGX: Wiping existing primary data before full refresh. [2025-10-02T18:25:13.432735] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-10-02T18:25:13.434845] [DEBUG] [LOCAL ] DGX: Deleted primary data file. [2025-10-02T18:25:13.434910] [INFO ] [MAIN ] DGX: Starting full primary refresh. [2025-10-02T18:25:13.842992] [INFO ] [REMOTE ] DGX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:25:13.872977] [INFO ] [REMOTE ] DGX: Fetching primary data for 2024-12. [2025-10-02T18:25:14.236446] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-02T18:25:14.399398] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-02T18:25:14.673010] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-10. [2025-10-02T18:25:15.455436] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-02T18:25:15.456487] [INFO ] [REMOTE ] DFP: Full fetch complete (16117 records). [2025-10-02T18:25:15.456572] [DEBUG] [VALIDATOR ] DFP: Validating primary data. [2025-10-02T18:25:15.480682] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-09. [2025-10-02T18:25:15.668291] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-02T18:25:15.914506] [DEBUG] [VALIDATOR ] DFP: All expected trading days are present. [2025-10-02T18:25:15.914584] [DEBUG] [VALIDATOR ] DFP: Primary data validation passed. [2025-10-02T18:25:15.914989] [INFO ] [MAIN ] DFP: Fetched primary data is valid. [2025-10-02T18:25:15.915053] [DEBUG] [LOCAL ] DFP: Saving primary data. [2025-10-02T18:25:15.915559] [DEBUG] [LOCAL ] DFP: Trimmed 16117 records to 11492 (keeping 200 days of data) [2025-10-02T18:25:15.988613] [DEBUG] [LOCAL ] DFP: Primary data saved (11492 records). [2025-10-02T18:25:15.988778] [INFO ] [MAIN ] DFP: Full history saved. [2025-10-02T18:25:15.988864] [INFO ] [MAIN ] Update Progress: 612/2370 symbols completed. DFP took 29.7s. Estimated remaining: 4h 4m 45s. Rate: 7.2 symbols/min [2025-10-02T18:25:16.170239] [INFO ] [MAIN ] DHF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:25:16.192433] [DEBUG] [LOCAL ] DHF: Loaded 20944 existing records from primary storage. [2025-10-02T18:25:16.192786] [INFO ] [MAIN ] DHF: Loaded 20944 existing records. [2025-10-02T18:25:16.278768] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-05. [2025-10-02T18:25:16.393448] [WARN ] [MAIN ] DHF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:25:16.393694] [INFO ] [MAIN ] DHF: Wiping existing primary data before full refresh. [2025-10-02T18:25:16.393755] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-10-02T18:25:16.394632] [DEBUG] [LOCAL ] DHF: Deleted primary data file. [2025-10-02T18:25:16.394726] [INFO ] [MAIN ] DHF: Starting full primary refresh. [2025-10-02T18:25:16.807028] [INFO ] [REMOTE ] DHF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:25:17.073001] [INFO ] [REMOTE ] DHF: Fetching primary data for 2024-12. [2025-10-02T18:25:17.143281] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-02T18:25:17.872975] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-10. [2025-10-02T18:25:18.213410] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-02T18:25:18.350491] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-02T18:25:18.673043] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-06. [2025-10-02T18:25:18.885797] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-02T18:25:18.887101] [INFO ] [REMOTE ] DFIN: Full fetch complete (33635 records). [2025-10-02T18:25:18.887187] [DEBUG] [VALIDATOR ] DFIN: Validating primary data. [2025-10-02T18:25:19.293328] [DEBUG] [VALIDATOR ] DFIN: All expected trading days are present. [2025-10-02T18:25:19.293425] [DEBUG] [VALIDATOR ] DFIN: Primary data validation passed. [2025-10-02T18:25:19.294007] [INFO ] [MAIN ] DFIN: Fetched primary data is valid. [2025-10-02T18:25:19.294072] [DEBUG] [LOCAL ] DFIN: Saving primary data. [2025-10-02T18:25:19.295042] [DEBUG] [LOCAL ] DFIN: Trimmed 33635 records to 23174 (keeping 200 days of data) [2025-10-02T18:25:19.438591] [DEBUG] [LOCAL ] DFIN: Primary data saved (23174 records). [2025-10-02T18:25:19.438830] [INFO ] [MAIN ] DFIN: Full history saved. [2025-10-02T18:25:19.438955] [INFO ] [MAIN ] Update Progress: 613/2370 symbols completed. DFIN took 38.0s. Estimated remaining: 4h 4m 23s. Rate: 7.2 symbols/min [2025-10-02T18:25:19.478150] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-01. [2025-10-02T18:25:19.629376] [INFO ] [MAIN ] DHI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:25:19.629553] [DEBUG] [LOCAL ] DHI: No existing data file found in primary storage. [2025-10-02T18:25:19.629607] [WARN ] [MAIN ] DHI: No existing data found, performing full refresh instead. [2025-10-02T18:25:19.629741] [INFO ] [MAIN ] DHI: Wiping existing primary data before full refresh. [2025-10-02T18:25:19.629784] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-10-02T18:25:19.629827] [DEBUG] [LOCAL ] DHI: No primary data file found to delete. [2025-10-02T18:25:19.629862] [INFO ] [MAIN ] DHI: Starting full primary refresh. [2025-10-02T18:25:20.021747] [INFO ] [REMOTE ] DHI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:25:20.272973] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-01. [2025-10-02T18:25:21.072986] [INFO ] [REMOTE ] DHI: Fetching primary data for 2024-12. [2025-10-02T18:25:21.174824] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-02T18:25:21.223174] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-02T18:25:21.873009] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-02. [2025-10-02T18:25:21.963616] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-06 (3.29 seconds). [2025-10-02T18:25:22.672963] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-02. [2025-10-02T18:25:22.988172] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-02T18:25:23.027379] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-02T18:25:23.472987] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-03. [2025-10-02T18:25:23.709159] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-02T18:25:24.273018] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-07. [2025-10-02T18:25:25.081685] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-01. [2025-10-02T18:25:25.105539] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-02T18:25:25.872987] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-04. [2025-10-02T18:25:26.289167] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-02T18:25:26.673062] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-03. [2025-10-02T18:25:27.473021] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-08. [2025-10-02T18:25:27.525936] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-01 (2.44 seconds). [2025-10-02T18:25:27.673223] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-02T18:25:27.699794] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-02T18:25:28.273041] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-05. [2025-10-02T18:25:29.072982] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-04. [2025-10-02T18:25:29.264208] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-02T18:25:29.835014] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-02T18:25:29.873047] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-05. [2025-10-02T18:25:30.272332] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-02T18:25:30.673053] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-06. [2025-10-02T18:25:30.847759] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-02T18:25:31.473046] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-06. [2025-10-02T18:25:31.993371] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-02T18:25:32.272977] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-09. [2025-10-02T18:25:32.501108] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-02T18:25:33.072996] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-07. [2025-10-02T18:25:33.873022] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-07. [2025-10-02T18:25:33.924041] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-02T18:25:34.252001] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-02T18:25:34.651204] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-02T18:25:34.672968] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-08. [2025-10-02T18:25:35.472987] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-02. [2025-10-02T18:25:35.795547] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-02T18:25:36.273024] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-09. [2025-10-02T18:25:37.010875] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-02T18:25:37.072974] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-10. [2025-10-02T18:25:37.422229] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-02T18:25:37.873003] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-03. [2025-10-02T18:25:37.948787] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-02T18:25:37.950384] [INFO ] [REMOTE ] DHF: Full fetch complete (30021 records). [2025-10-02T18:25:37.950552] [DEBUG] [VALIDATOR ] DHF: Validating primary data. [2025-10-02T18:25:38.359798] [DEBUG] [VALIDATOR ] DHF: All expected trading days are present. [2025-10-02T18:25:38.359882] [DEBUG] [VALIDATOR ] DHF: Primary data validation passed. [2025-10-02T18:25:38.360403] [INFO ] [MAIN ] DHF: Fetched primary data is valid. [2025-10-02T18:25:38.360444] [DEBUG] [LOCAL ] DHF: Saving primary data. [2025-10-02T18:25:38.361315] [DEBUG] [LOCAL ] DHF: Trimmed 30021 records to 21198 (keeping 200 days of data) [2025-10-02T18:25:38.491127] [DEBUG] [LOCAL ] DHF: Primary data saved (21198 records). [2025-10-02T18:25:38.491264] [INFO ] [MAIN ] DHF: Full history saved. [2025-10-02T18:25:38.491356] [INFO ] [MAIN ] Update Progress: 614/2370 symbols completed. DHF took 22.5s. Estimated remaining: 4h 4m 45s. Rate: 7.2 symbols/min [2025-10-02T18:25:38.684996] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-08. [2025-10-02T18:25:38.689546] [INFO ] [MAIN ] DHR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:25:38.749880] [DEBUG] [LOCAL ] DHR: Loaded 53366 existing records from primary storage. [2025-10-02T18:25:38.750246] [INFO ] [MAIN ] DHR: Loaded 53366 existing records. [2025-10-02T18:25:38.955946] [WARN ] [MAIN ] DHR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:25:38.956206] [INFO ] [MAIN ] DHR: Wiping existing primary data before full refresh. [2025-10-02T18:25:38.956310] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-10-02T18:25:38.957976] [DEBUG] [LOCAL ] DHR: Deleted primary data file. [2025-10-02T18:25:38.958082] [INFO ] [MAIN ] DHR: Starting full primary refresh. [2025-10-02T18:25:39.346297] [INFO ] [REMOTE ] DHR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:25:39.472999] [INFO ] [REMOTE ] DHR: Fetching primary data for 2024-12. [2025-10-02T18:25:40.119391] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-02T18:25:40.273750] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-04. [2025-10-02T18:25:40.276927] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-02T18:25:41.073003] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-09. [2025-10-02T18:25:41.152710] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-02T18:25:41.872995] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-10. [2025-10-02T18:25:42.301956] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-02T18:25:42.346278] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-02T18:25:42.672998] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-10. [2025-10-02T18:25:43.231563] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-02T18:25:43.234022] [INFO ] [REMOTE ] DG: Full fetch complete (77215 records). [2025-10-02T18:25:43.234150] [DEBUG] [VALIDATOR ] DG: Validating primary data. [2025-10-02T18:25:43.479249] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-05. [2025-10-02T18:25:43.673826] [DEBUG] [VALIDATOR ] DG: All expected trading days are present. [2025-10-02T18:25:43.673924] [DEBUG] [VALIDATOR ] DG: Primary data validation passed. [2025-10-02T18:25:43.674790] [INFO ] [MAIN ] DG: Fetched primary data is valid. [2025-10-02T18:25:43.674860] [DEBUG] [LOCAL ] DG: Saving primary data. [2025-10-02T18:25:43.676540] [DEBUG] [LOCAL ] DG: Trimmed 77215 records to 53672 (keeping 200 days of data) [2025-10-02T18:25:43.922633] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-02T18:25:43.926628] [INFO ] [REMOTE ] DGX: Full fetch complete (65120 records). [2025-10-02T18:25:43.927331] [DEBUG] [VALIDATOR ] DGX: Validating primary data. [2025-10-02T18:25:44.274743] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-01. [2025-10-02T18:25:44.388901] [DEBUG] [VALIDATOR ] DGX: All expected trading days are present. [2025-10-02T18:25:44.390660] [DEBUG] [VALIDATOR ] DGX: Primary data validation passed. [2025-10-02T18:25:44.392712] [INFO ] [MAIN ] DGX: Fetched primary data is valid. [2025-10-02T18:25:44.394897] [DEBUG] [LOCAL ] DGX: Saving primary data. [2025-10-02T18:25:44.409214] [DEBUG] [LOCAL ] DGX: Trimmed 65120 records to 45232 (keeping 200 days of data) [2025-10-02T18:25:44.592354] [DEBUG] [LOCAL ] DG: Primary data saved (53672 records). [2025-10-02T18:25:44.592763] [INFO ] [MAIN ] DG: Full history saved. [2025-10-02T18:25:44.594240] [INFO ] [MAIN ] Update Progress: 615/2370 symbols completed. DG took 43.8s. Estimated remaining: 4h 4m 30s. Rate: 7.2 symbols/min [2025-10-02T18:25:44.838714] [INFO ] [MAIN ] DHT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:25:44.911260] [DEBUG] [LOCAL ] DHT: Loaded 47876 existing records from primary storage. [2025-10-02T18:25:44.913886] [INFO ] [MAIN ] DHT: Loaded 47876 existing records. [2025-10-02T18:25:45.218123] [WARN ] [MAIN ] DHT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:25:45.219948] [INFO ] [MAIN ] DHT: Wiping existing primary data before full refresh. [2025-10-02T18:25:45.221504] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-10-02T18:25:45.224786] [DEBUG] [LOCAL ] DHT: Deleted primary data file. [2025-10-02T18:25:45.227936] [INFO ] [MAIN ] DHT: Starting full primary refresh. [2025-10-02T18:25:45.778581] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-10-02T18:25:45.780043] [DEBUG] [LOCAL ] DGX: Primary data saved (45232 records). [2025-10-02T18:25:45.785365] [INFO ] [REMOTE ] DHT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:25:45.785570] [INFO ] [MAIN ] DGX: Full history saved. [2025-10-02T18:25:45.797483] [INFO ] [REMOTE ] DHT: Fetching primary data for 2024-12. [2025-10-02T18:25:45.797099] [INFO ] [MAIN ] Update Progress: 616/2370 symbols completed. DGX took 32.8s. Estimated remaining: 4h 4m 1s. Rate: 7.2 symbols/min [2025-10-02T18:25:45.873745] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-06. [2025-10-02T18:25:45.996519] [INFO ] [MAIN ] DHX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:25:46.011689] [DEBUG] [LOCAL ] DHX: Loaded 13054 existing records from primary storage. [2025-10-02T18:25:46.011952] [INFO ] [MAIN ] DHX: Loaded 13054 existing records. [2025-10-02T18:25:46.214587] [WARN ] [MAIN ] DHX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:25:46.214932] [INFO ] [MAIN ] DHX: Wiping existing primary data before full refresh. [2025-10-02T18:25:46.215004] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-10-02T18:25:46.215523] [DEBUG] [LOCAL ] DHX: Deleted primary data file. [2025-10-02T18:25:46.215587] [INFO ] [MAIN ] DHX: Starting full primary refresh. [2025-10-02T18:25:46.371550] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-02T18:25:46.668027] [INFO ] [REMOTE ] DHX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:25:46.672959] [INFO ] [REMOTE ] DHX: Fetching primary data for 2024-12. [2025-10-02T18:25:47.225769] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-02T18:25:47.322860] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-02T18:25:47.472971] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-02. [2025-10-02T18:25:47.499953] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-02T18:25:48.273043] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-01. [2025-10-02T18:25:49.072993] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-01. [2025-10-02T18:25:49.145083] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-02T18:25:49.360746] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-02T18:25:49.873018] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-03. [2025-10-02T18:25:50.646134] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-02T18:25:50.673025] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-07. [2025-10-02T18:25:51.472983] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-02. [2025-10-02T18:25:51.713741] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-02T18:25:52.077670] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-02T18:25:52.273003] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-04. [2025-10-02T18:25:52.578682] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-02T18:25:53.072996] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-02. [2025-10-02T18:25:53.873011] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-08. [2025-10-02T18:25:54.072819] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-02T18:25:54.104336] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-02T18:25:54.673003] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-05. [2025-10-02T18:25:55.473170] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-03. [2025-10-02T18:25:55.927481] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-02T18:25:56.272986] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-09. [2025-10-02T18:25:56.547543] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-02T18:25:57.008271] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-02T18:25:57.072987] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-03. [2025-10-02T18:25:57.873047] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-04. [2025-10-02T18:25:57.985883] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-02T18:25:58.063458] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-02T18:25:58.673020] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-10. [2025-10-02T18:25:59.473027] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-06. [2025-10-02T18:25:59.673687] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-02T18:26:00.273070] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-05. [2025-10-02T18:26:00.576393] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-02T18:26:00.579283] [INFO ] [REMOTE ] DHI: Full fetch complete (77212 records). [2025-10-02T18:26:00.579481] [DEBUG] [VALIDATOR ] DHI: Validating primary data. [2025-10-02T18:26:01.039804] [DEBUG] [VALIDATOR ] DHI: All expected trading days are present. [2025-10-02T18:26:01.040109] [DEBUG] [VALIDATOR ] DHI: Primary data validation passed. [2025-10-02T18:26:01.041100] [INFO ] [MAIN ] DHI: Fetched primary data is valid. [2025-10-02T18:26:01.041238] [DEBUG] [LOCAL ] DHI: Saving primary data. [2025-10-02T18:26:01.043429] [DEBUG] [LOCAL ] DHI: Trimmed 77212 records to 53731 (keeping 200 days of data) [2025-10-02T18:26:01.107788] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-04. [2025-10-02T18:26:01.449398] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-02T18:26:01.474297] [DEBUG] [LOCAL ] DHI: Primary data saved (53731 records). [2025-10-02T18:26:01.474525] [INFO ] [MAIN ] DHI: Full history saved. [2025-10-02T18:26:01.474623] [INFO ] [MAIN ] Update Progress: 617/2370 symbols completed. DHI took 42.0s. Estimated remaining: 4h 4m 14s. Rate: 7.2 symbols/min [2025-10-02T18:26:01.719743] [INFO ] [MAIN ] DIAX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:26:01.719987] [DEBUG] [LOCAL ] DIAX: No existing data file found in primary storage. [2025-10-02T18:26:01.720034] [WARN ] [MAIN ] DIAX: No existing data found, performing full refresh instead. [2025-10-02T18:26:01.720148] [INFO ] [MAIN ] DIAX: Wiping existing primary data before full refresh. [2025-10-02T18:26:01.720191] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-10-02T18:26:01.720277] [DEBUG] [LOCAL ] DIAX: No primary data file found to delete. [2025-10-02T18:26:01.720335] [INFO ] [MAIN ] DIAX: Starting full primary refresh. [2025-10-02T18:26:01.878396] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-07. [2025-10-02T18:26:02.169076] [INFO ] [REMOTE ] DIAX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:26:02.199391] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-02T18:26:02.226452] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-02T18:26:02.673043] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-05. [2025-10-02T18:26:03.397609] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-02T18:26:03.473001] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-06. [2025-10-02T18:26:04.105731] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-02T18:26:04.272997] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-08. [2025-10-02T18:26:05.072971] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-06. [2025-10-02T18:26:05.157477] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-02T18:26:05.872976] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2024-12. [2025-10-02T18:26:05.948526] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-02T18:26:06.203511] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-02T18:26:06.673006] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-07. [2025-10-02T18:26:06.901067] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-02T18:26:07.472991] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-01. [2025-10-02T18:26:08.256319] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-02T18:26:08.274586] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-08. [2025-10-02T18:26:08.276781] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-02T18:26:09.073011] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-09. [2025-10-02T18:26:09.784698] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-02T18:26:09.873064] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-02. [2025-10-02T18:26:10.384444] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-02T18:26:10.673012] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-03. [2025-10-02T18:26:10.915523] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-02T18:26:11.193289] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-02T18:26:11.473007] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-09. [2025-10-02T18:26:12.273063] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-07. [2025-10-02T18:26:12.836204] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-02T18:26:13.073002] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-08. [2025-10-02T18:26:13.259254] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-02T18:26:13.618065] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-02T18:26:13.872998] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-09. [2025-10-02T18:26:14.643720] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-02T18:26:14.673006] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-10. [2025-10-02T18:26:15.473053] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-04. [2025-10-02T18:26:16.156793] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-02T18:26:16.158906] [INFO ] [REMOTE ] DHT: Full fetch complete (69982 records). [2025-10-02T18:26:16.159054] [DEBUG] [VALIDATOR ] DHT: Validating primary data. [2025-10-02T18:26:16.273553] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-10. [2025-10-02T18:26:16.561438] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-02T18:26:16.630952] [DEBUG] [VALIDATOR ] DHT: All expected trading days are present. [2025-10-02T18:26:16.631062] [DEBUG] [VALIDATOR ] DHT: Primary data validation passed. [2025-10-02T18:26:16.632021] [INFO ] [MAIN ] DHT: Fetched primary data is valid. [2025-10-02T18:26:16.632097] [DEBUG] [LOCAL ] DHT: Saving primary data. [2025-10-02T18:26:16.633797] [DEBUG] [LOCAL ] DHT: Trimmed 69982 records to 48248 (keeping 200 days of data) [2025-10-02T18:26:16.963448] [DEBUG] [LOCAL ] DHT: Primary data saved (48248 records). [2025-10-02T18:26:16.963598] [INFO ] [MAIN ] DHT: Full history saved. [2025-10-02T18:26:16.964574] [INFO ] [MAIN ] Update Progress: 618/2370 symbols completed. DHT took 32.4s. Estimated remaining: 4h 4m 26s. Rate: 7.2 symbols/min [2025-10-02T18:26:17.079039] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-10. [2025-10-02T18:26:17.168332] [INFO ] [MAIN ] DIN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:26:17.209688] [DEBUG] [LOCAL ] DIN: Loaded 37210 existing records from primary storage. [2025-10-02T18:26:17.210009] [INFO ] [MAIN ] DIN: Loaded 37210 existing records. [2025-10-02T18:26:17.432414] [WARN ] [MAIN ] DIN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:26:17.432624] [INFO ] [MAIN ] DIN: Wiping existing primary data before full refresh. [2025-10-02T18:26:17.432704] [INFO ] [LOCAL ] DIN: Starting deletion of primary data. [2025-10-02T18:26:17.433984] [DEBUG] [LOCAL ] DIN: Deleted primary data file. [2025-10-02T18:26:17.434046] [INFO ] [MAIN ] DIN: Starting full primary refresh. [2025-10-02T18:26:17.834148] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-02T18:26:17.857907] [INFO ] [REMOTE ] DIN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:26:17.860533] [INFO ] [REMOTE ] DHR: Full fetch complete (77275 records). [2025-10-02T18:26:17.860668] [DEBUG] [VALIDATOR ] DHR: Validating primary data. [2025-10-02T18:26:17.878120] [INFO ] [REMOTE ] DIN: Fetching primary data for 2024-12. [2025-10-02T18:26:17.962113] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-02T18:26:17.990694] [INFO ] [REMOTE ] DHX: Full fetch complete (20693 records). [2025-10-02T18:26:18.001141] [DEBUG] [VALIDATOR ] DHX: Validating primary data. [2025-10-02T18:26:18.032921] [FATAL] [VALIDATOR ] DHX: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:26:18.074979] [FATAL] [MAIN ] DHX: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:26:18.143577] [WARN ] [MAIN ] DHX: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:26:18.188928] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-10-02T18:26:18.219027] [DEBUG] [LOCAL ] DHX: No primary data file found to delete. [2025-10-02T18:26:18.225103] [INFO ] [LOCAL ] DHX: Starting deletion of derivative data. [2025-10-02T18:26:18.246727] [DEBUG] [LOCAL ] DHX: Deleted derivative data file. [2025-10-02T18:26:18.273457] [INFO ] [MAIN ] Update Progress: 619/2370 symbols completed. DHX took 32.5s. Estimated remaining: 4h 3m 57s. Rate: 7.2 symbols/min [2025-10-02T18:26:18.432559] [DEBUG] [VALIDATOR ] DHR: All expected trading days are present. [2025-10-02T18:26:18.447639] [DEBUG] [VALIDATOR ] DHR: Primary data validation passed. [2025-10-02T18:26:18.466318] [INFO ] [MAIN ] DHR: Fetched primary data is valid. [2025-10-02T18:26:18.470496] [DEBUG] [LOCAL ] DHR: Saving primary data. [2025-10-02T18:26:18.515046] [DEBUG] [LOCAL ] DHR: Trimmed 77275 records to 53756 (keeping 200 days of data) [2025-10-02T18:26:18.555210] [INFO ] [MAIN ] DINO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:26:18.673307] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-05. [2025-10-02T18:26:18.726121] [DEBUG] [LOCAL ] DINO: Loaded 52932 existing records from primary storage. [2025-10-02T18:26:18.726549] [INFO ] [MAIN ] DINO: Loaded 52932 existing records. [2025-10-02T18:26:19.041867] [WARN ] [MAIN ] DINO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:26:19.042876] [INFO ] [MAIN ] DINO: Wiping existing primary data before full refresh. [2025-10-02T18:26:19.043464] [INFO ] [LOCAL ] DINO: Starting deletion of primary data. [2025-10-02T18:26:19.046995] [DEBUG] [LOCAL ] DINO: Deleted primary data file. [2025-10-02T18:26:19.047516] [INFO ] [MAIN ] DINO: Starting full primary refresh. [2025-10-02T18:26:19.532828] [INFO ] [REMOTE ] DINO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:26:19.540064] [INFO ] [REMOTE ] DINO: Fetching primary data for 2024-12. [2025-10-02T18:26:19.571109] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-02T18:26:19.624267] [DEBUG] [LOCAL ] DHR: Primary data saved (53756 records). [2025-10-02T18:26:19.622097] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-02T18:26:19.632676] [INFO ] [MAIN ] DHR: Full history saved. [2025-10-02T18:26:19.633463] [INFO ] [MAIN ] Update Progress: 620/2370 symbols completed. DHR took 41.1s. Estimated remaining: 4h 3m 29s. Rate: 7.2 symbols/min [2025-10-02T18:26:19.820869] [INFO ] [MAIN ] DIS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:26:19.879269] [DEBUG] [LOCAL ] DIS: Loaded 53788 existing records from primary storage. [2025-10-02T18:26:19.879707] [INFO ] [MAIN ] DIS: Loaded 53788 existing records. [2025-10-02T18:26:20.081314] [WARN ] [MAIN ] DIS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:26:20.081570] [INFO ] [MAIN ] DIS: Wiping existing primary data before full refresh. [2025-10-02T18:26:20.081621] [INFO ] [LOCAL ] DIS: Starting deletion of primary data. [2025-10-02T18:26:20.084069] [DEBUG] [LOCAL ] DIS: Deleted primary data file. [2025-10-02T18:26:20.084138] [INFO ] [MAIN ] DIS: Starting full primary refresh. [2025-10-02T18:26:20.285772] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-06. [2025-10-02T18:26:20.493040] [INFO ] [REMOTE ] DIS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:26:21.072972] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-01. [2025-10-02T18:26:21.159772] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-02T18:26:21.554702] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-02T18:26:21.873041] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-01. [2025-10-02T18:26:22.180373] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-02T18:26:22.673018] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-02. [2025-10-02T18:26:23.224348] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-02T18:26:23.473086] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-07. [2025-10-02T18:26:24.023144] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-02T18:26:24.049280] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-02T18:26:24.272989] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-03. [2025-10-02T18:26:25.073004] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-08. [2025-10-02T18:26:25.621960] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-02T18:26:25.795064] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-02T18:26:25.873009] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-09. [2025-10-02T18:26:26.672985] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-04. [2025-10-02T18:26:26.852572] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-02T18:26:27.473012] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-10. [2025-10-02T18:26:28.042273] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-02T18:26:28.043680] [INFO ] [REMOTE ] DIAX: Full fetch complete (17747 records). [2025-10-02T18:26:28.043801] [DEBUG] [VALIDATOR ] DIAX: Validating primary data. [2025-10-02T18:26:28.219054] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-02T18:26:28.279187] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-02. [2025-10-02T18:26:28.536068] [DEBUG] [VALIDATOR ] DIAX: All expected trading days are present. [2025-10-02T18:26:28.536151] [DEBUG] [VALIDATOR ] DIAX: Primary data validation passed. [2025-10-02T18:26:28.536663] [INFO ] [MAIN ] DIAX: Fetched primary data is valid. [2025-10-02T18:26:28.536805] [DEBUG] [LOCAL ] DIAX: Saving primary data. [2025-10-02T18:26:28.537465] [DEBUG] [LOCAL ] DIAX: Trimmed 17747 records to 13011 (keeping 200 days of data) [2025-10-02T18:26:28.628600] [DEBUG] [LOCAL ] DIAX: Primary data saved (13011 records). [2025-10-02T18:26:28.628785] [INFO ] [MAIN ] DIAX: Full history saved. [2025-10-02T18:26:28.628915] [INFO ] [MAIN ] Update Progress: 621/2370 symbols completed. DIAX took 27.2s. Estimated remaining: 4h 3m 23s. Rate: 7.2 symbols/min [2025-10-02T18:26:28.822554] [INFO ] [MAIN ] DIVY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:26:28.822886] [DEBUG] [LOCAL ] DIVY: No existing data file found in primary storage. [2025-10-02T18:26:28.822945] [WARN ] [MAIN ] DIVY: No existing data found, performing full refresh instead. [2025-10-02T18:26:28.823074] [INFO ] [MAIN ] DIVY: Wiping existing primary data before full refresh. [2025-10-02T18:26:28.823130] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-02T18:26:28.823200] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-02T18:26:28.823250] [INFO ] [MAIN ] DIVY: Starting full primary refresh. [2025-10-02T18:26:29.083218] [INFO ] [REMOTE ] DIS: Fetching primary data for 2024-12. [2025-10-02T18:26:29.209257] [INFO ] [REMOTE ] DIVY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:26:29.873038] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-05. [2025-10-02T18:26:30.030473] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-02T18:26:30.673045] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2024-12. [2025-10-02T18:26:31.046914] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-10-02T18:26:31.473025] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-03. [2025-10-02T18:26:31.558954] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-02T18:26:31.678407] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2024-12 (2.60 seconds). [2025-10-02T18:26:32.273038] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-01. [2025-10-02T18:26:33.073062] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-06. [2025-10-02T18:26:33.374347] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-02T18:26:33.873021] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-01. [2025-10-02T18:26:34.323376] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-02T18:26:34.477167] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-02T18:26:34.586562] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-10-02T18:26:34.672994] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-02. [2025-10-02T18:26:35.472997] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-07. [2025-10-02T18:26:36.273056] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-04. [2025-10-02T18:26:36.899454] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-02T18:26:36.943777] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-10-02T18:26:37.073005] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-03. [2025-10-02T18:26:37.712252] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-02T18:26:37.873004] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-05. [2025-10-02T18:26:38.673036] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-08. [2025-10-02T18:26:39.095597] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-02T18:26:39.473016] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-04. [2025-10-02T18:26:39.604594] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-02T18:26:40.180716] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-02T18:26:40.273100] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-06. [2025-10-02T18:26:41.073028] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-09. [2025-10-02T18:26:41.873003] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-02. [2025-10-02T18:26:41.949759] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-10-02T18:26:42.114351] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-02T18:26:42.575749] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-02T18:26:42.608604] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-02T18:26:42.673061] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-05. [2025-10-02T18:26:43.473031] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-07. [2025-10-02T18:26:44.273110] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-03. [2025-10-02T18:26:44.709933] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-02T18:26:45.073004] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-10. [2025-10-02T18:26:45.189758] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-05 (2.52 seconds). [2025-10-02T18:26:45.389368] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-02T18:26:45.873027] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-06. [2025-10-02T18:26:46.127160] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-02T18:26:46.129826] [INFO ] [REMOTE ] DIN: Full fetch complete (55236 records). [2025-10-02T18:26:46.129963] [DEBUG] [VALIDATOR ] DIN: Validating primary data. [2025-10-02T18:26:46.604104] [DEBUG] [VALIDATOR ] DIN: All expected trading days are present. [2025-10-02T18:26:46.604237] [DEBUG] [VALIDATOR ] DIN: Primary data validation passed. [2025-10-02T18:26:46.605267] [INFO ] [MAIN ] DIN: Fetched primary data is valid. [2025-10-02T18:26:46.605341] [DEBUG] [LOCAL ] DIN: Saving primary data. [2025-10-02T18:26:46.607416] [DEBUG] [LOCAL ] DIN: Trimmed 55236 records to 37507 (keeping 200 days of data) [2025-10-02T18:26:46.677896] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-08. [2025-10-02T18:26:46.854214] [DEBUG] [LOCAL ] DIN: Primary data saved (37507 records). [2025-10-02T18:26:46.854430] [INFO ] [MAIN ] DIN: Full history saved. [2025-10-02T18:26:46.855179] [INFO ] [MAIN ] Update Progress: 622/2370 symbols completed. DIN took 29.9s. Estimated remaining: 4h 3m 42s. Rate: 7.2 symbols/min [2025-10-02T18:26:47.033059] [INFO ] [MAIN ] DK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:26:47.097789] [DEBUG] [LOCAL ] DK: Loaded 49338 existing records from primary storage. [2025-10-02T18:26:47.098223] [INFO ] [MAIN ] DK: Loaded 49338 existing records. [2025-10-02T18:26:47.275171] [WARN ] [MAIN ] DK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:26:47.275470] [INFO ] [MAIN ] DK: Wiping existing primary data before full refresh. [2025-10-02T18:26:47.275531] [INFO ] [LOCAL ] DK: Starting deletion of primary data. [2025-10-02T18:26:47.276985] [DEBUG] [LOCAL ] DK: Deleted primary data file. [2025-10-02T18:26:47.277059] [INFO ] [MAIN ] DK: Starting full primary refresh. [2025-10-02T18:26:47.484699] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-04. [2025-10-02T18:26:47.638192] [INFO ] [REMOTE ] DK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:26:47.994274] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-02T18:26:48.273004] [INFO ] [REMOTE ] DK: Fetching primary data for 2024-12. [2025-10-02T18:26:48.331977] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-06 (2.46 seconds). [2025-10-02T18:26:48.542665] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-02T18:26:49.073043] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-05. [2025-10-02T18:26:49.331336] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-10-02T18:26:49.764129] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-02T18:26:49.873017] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-07. [2025-10-02T18:26:49.975182] [DEBUG] [REMOTE ] DIS: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-02T18:26:49.975575] [WARN ] [REMOTE ] DIS: No data returned for month 2025-07 [2025-10-02T18:26:49.975748] [FATAL] [REMOTE ] DIS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T18:26:49.975864] [FATAL] [MAIN ] DIS: Failed to fetch primary data. [2025-10-02T18:26:49.975935] [WARN ] [MAIN ] DIS: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T18:26:49.976008] [INFO ] [LOCAL ] DIS: Starting deletion of primary data. [2025-10-02T18:26:49.976084] [DEBUG] [LOCAL ] DIS: No primary data file found to delete. [2025-10-02T18:26:49.976140] [INFO ] [LOCAL ] DIS: Starting deletion of derivative data. [2025-10-02T18:26:49.976751] [DEBUG] [LOCAL ] DIS: Deleted derivative data file. [2025-10-02T18:26:49.976840] [INFO ] [MAIN ] Update Progress: 623/2370 symbols completed. DIS took 30.3s. Estimated remaining: 4h 3m 19s. Rate: 7.2 symbols/min [2025-10-02T18:26:50.159682] [INFO ] [MAIN ] DKL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:26:50.181804] [DEBUG] [LOCAL ] DKL: Loaded 18651 existing records from primary storage. [2025-10-02T18:26:50.182057] [INFO ] [MAIN ] DKL: Loaded 18651 existing records. [2025-10-02T18:26:50.379570] [WARN ] [MAIN ] DKL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:26:50.379820] [INFO ] [MAIN ] DKL: Wiping existing primary data before full refresh. [2025-10-02T18:26:50.379872] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-10-02T18:26:50.380525] [DEBUG] [LOCAL ] DKL: Deleted primary data file. [2025-10-02T18:26:50.380589] [INFO ] [MAIN ] DKL: Starting full primary refresh. [2025-10-02T18:26:50.678268] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-06. [2025-10-02T18:26:50.786719] [INFO ] [REMOTE ] DKL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:26:51.065195] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-02T18:26:51.473037] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-07. [2025-10-02T18:26:51.822967] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-02T18:26:52.273045] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-08. [2025-10-02T18:26:52.886200] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-02T18:26:53.073082] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-09. [2025-10-02T18:26:53.456823] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-02T18:26:53.872988] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-10. [2025-10-02T18:26:54.275045] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-02T18:26:54.275927] [INFO ] [REMOTE ] DIVY: Full fetch complete (1727 records). [2025-10-02T18:26:54.276037] [DEBUG] [VALIDATOR ] DIVY: Validating primary data. [2025-10-02T18:26:54.486660] [WARN ] [VALIDATOR ] DIVY: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-02T18:26:54.486862] [FATAL] [MAIN ] DIVY: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:26:54.486932] [WARN ] [MAIN ] DIVY: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:26:54.487007] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-02T18:26:54.487106] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-02T18:26:54.487165] [INFO ] [LOCAL ] DIVY: Starting deletion of derivative data. [2025-10-02T18:26:54.487240] [DEBUG] [LOCAL ] DIVY: No derivative data file found to delete. [2025-10-02T18:26:54.487343] [INFO ] [MAIN ] Update Progress: 624/2370 symbols completed. DIVY took 25.9s. Estimated remaining: 4h 2m 60s. Rate: 7.2 symbols/min [2025-10-02T18:26:54.678319] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-09. [2025-10-02T18:26:54.678250] [INFO ] [MAIN ] DKS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:26:54.743102] [DEBUG] [LOCAL ] DKS: Loaded 49749 existing records from primary storage. [2025-10-02T18:26:54.743445] [INFO ] [MAIN ] DKS: Loaded 49749 existing records. [2025-10-02T18:26:54.974534] [WARN ] [MAIN ] DKS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:26:54.974823] [INFO ] [MAIN ] DKS: Wiping existing primary data before full refresh. [2025-10-02T18:26:54.974881] [INFO ] [LOCAL ] DKS: Starting deletion of primary data. [2025-10-02T18:26:54.976487] [DEBUG] [LOCAL ] DKS: Deleted primary data file. [2025-10-02T18:26:54.976551] [INFO ] [MAIN ] DKS: Starting full primary refresh. [2025-10-02T18:26:55.432550] [INFO ] [REMOTE ] DKS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:26:55.472958] [INFO ] [REMOTE ] DKS: Fetching primary data for 2024-12. [2025-10-02T18:26:56.272981] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-01. [2025-10-02T18:26:56.369304] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-02T18:26:57.072995] [INFO ] [REMOTE ] DKL: Fetching primary data for 2024-12. [2025-10-02T18:26:57.345636] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-02T18:26:57.445630] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-02T18:26:57.873002] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-01. [2025-10-02T18:26:58.018164] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-02T18:26:58.673008] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-01. [2025-10-02T18:26:59.472995] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-10. [2025-10-02T18:26:59.566709] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-02T18:26:59.661312] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-02T18:27:00.273120] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-02. [2025-10-02T18:27:00.943743] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-02T18:27:00.947254] [INFO ] [REMOTE ] DINO: Full fetch complete (76288 records). [2025-10-02T18:27:00.947477] [DEBUG] [VALIDATOR ] DINO: Validating primary data. [2025-10-02T18:27:00.948854] [FATAL] [VALIDATOR ] DINO: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:27:00.949004] [FATAL] [MAIN ] DINO: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:27:00.949077] [WARN ] [MAIN ] DINO: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:27:00.949158] [INFO ] [LOCAL ] DINO: Starting deletion of primary data. [2025-10-02T18:27:00.949272] [DEBUG] [LOCAL ] DINO: No primary data file found to delete. [2025-10-02T18:27:00.949322] [INFO ] [LOCAL ] DINO: Starting deletion of derivative data. [2025-10-02T18:27:00.949890] [DEBUG] [LOCAL ] DINO: Deleted derivative data file. [2025-10-02T18:27:00.950016] [INFO ] [MAIN ] Update Progress: 625/2370 symbols completed. DINO took 42.7s. Estimated remaining: 4h 2m 46s. Rate: 7.2 symbols/min [2025-10-02T18:27:01.078130] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-02. [2025-10-02T18:27:01.151180] [INFO ] [MAIN ] DLB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:27:01.190753] [DEBUG] [LOCAL ] DLB: Loaded 32001 existing records from primary storage. [2025-10-02T18:27:01.191175] [INFO ] [MAIN ] DLB: Loaded 32001 existing records. [2025-10-02T18:27:01.409686] [WARN ] [MAIN ] DLB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:27:01.409952] [INFO ] [MAIN ] DLB: Wiping existing primary data before full refresh. [2025-10-02T18:27:01.410004] [INFO ] [LOCAL ] DLB: Starting deletion of primary data. [2025-10-02T18:27:01.411058] [DEBUG] [LOCAL ] DLB: Deleted primary data file. [2025-10-02T18:27:01.411122] [INFO ] [MAIN ] DLB: Starting full primary refresh. [2025-10-02T18:27:01.867019] [INFO ] [REMOTE ] DLB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:27:01.873013] [INFO ] [REMOTE ] DLB: Fetching primary data for 2024-12. [2025-10-02T18:27:02.110396] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-02T18:27:02.212287] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-02T18:27:02.673045] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-03. [2025-10-02T18:27:03.362312] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-02T18:27:03.472997] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-01. [2025-10-02T18:27:04.272995] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-02. [2025-10-02T18:27:04.487138] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-02T18:27:04.810739] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-02T18:27:05.073025] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-04. [2025-10-02T18:27:05.873058] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-03. [2025-10-02T18:27:05.936336] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-02T18:27:06.633532] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-02T18:27:06.672996] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-05. [2025-10-02T18:27:06.710894] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-02T18:27:07.473051] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-03. [2025-10-02T18:27:08.273077] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-04. [2025-10-02T18:27:08.688126] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-02T18:27:09.037840] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-02T18:27:09.072972] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-04. [2025-10-02T18:27:09.698803] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-02T18:27:09.873032] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-05. [2025-10-02T18:27:10.353916] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-02T18:27:10.672986] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-02. [2025-10-02T18:27:10.877172] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-02T18:27:11.472968] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-06. [2025-10-02T18:27:11.876269] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-02T18:27:12.273054] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-06. [2025-10-02T18:27:12.998881] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-02T18:27:13.072997] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-03. [2025-10-02T18:27:13.161460] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-02T18:27:13.873005] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-05. [2025-10-02T18:27:14.587727] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-02T18:27:14.673054] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-07. [2025-10-02T18:27:15.134008] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-02T18:27:15.380593] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-02T18:27:15.473024] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-08. [2025-10-02T18:27:16.273009] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-07. [2025-10-02T18:27:16.437866] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-02T18:27:17.073045] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-09. [2025-10-02T18:27:17.795421] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-02T18:27:17.873108] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-04. [2025-10-02T18:27:17.991618] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-02T18:27:18.673061] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-10. [2025-10-02T18:27:19.365434] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-02T18:27:19.391379] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-02T18:27:19.392833] [INFO ] [REMOTE ] DKL: Full fetch complete (28709 records). [2025-10-02T18:27:19.392991] [DEBUG] [VALIDATOR ] DKL: Validating primary data. [2025-10-02T18:27:19.478112] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-08. [2025-10-02T18:27:19.785231] [DEBUG] [VALIDATOR ] DKL: All expected trading days are present. [2025-10-02T18:27:19.785323] [DEBUG] [VALIDATOR ] DKL: Primary data validation passed. [2025-10-02T18:27:19.785866] [INFO ] [MAIN ] DKL: Fetched primary data is valid. [2025-10-02T18:27:19.785932] [DEBUG] [LOCAL ] DKL: Saving primary data. [2025-10-02T18:27:19.786661] [DEBUG] [LOCAL ] DKL: Trimmed 28709 records to 18727 (keeping 200 days of data) [2025-10-02T18:27:19.909919] [DEBUG] [LOCAL ] DKL: Primary data saved (18727 records). [2025-10-02T18:27:19.910075] [INFO ] [MAIN ] DKL: Full history saved. [2025-10-02T18:27:19.910162] [INFO ] [MAIN ] Update Progress: 626/2370 symbols completed. DKL took 29.9s. Estimated remaining: 4h 3m 7s. Rate: 7.2 symbols/min [2025-10-02T18:27:20.099171] [INFO ] [MAIN ] DLNG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:27:20.108381] [DEBUG] [LOCAL ] DLNG: Loaded 6106 existing records from primary storage. [2025-10-02T18:27:20.108607] [INFO ] [MAIN ] DLNG: Loaded 6106 existing records. [2025-10-02T18:27:20.279890] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-06. [2025-10-02T18:27:20.313561] [WARN ] [MAIN ] DLNG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:27:20.314103] [INFO ] [MAIN ] DLNG: Wiping existing primary data before full refresh. [2025-10-02T18:27:20.314219] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-10-02T18:27:20.314879] [DEBUG] [LOCAL ] DLNG: Deleted primary data file. [2025-10-02T18:27:20.314944] [INFO ] [MAIN ] DLNG: Starting full primary refresh. [2025-10-02T18:27:20.712483] [INFO ] [REMOTE ] DLNG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:27:21.073055] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-05. [2025-10-02T18:27:21.712624] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-02T18:27:21.873046] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-09. [2025-10-02T18:27:22.157711] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-02T18:27:22.486472] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-02T18:27:22.673081] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-06. [2025-10-02T18:27:23.473030] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-07. [2025-10-02T18:27:23.667263] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-02T18:27:23.733920] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-02T18:27:24.272999] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-10. [2025-10-02T18:27:25.072980] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2024-12. [2025-10-02T18:27:25.263628] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-02T18:27:25.682694] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-02T18:27:25.685219] [INFO ] [REMOTE ] DKS: Full fetch complete (71618 records). [2025-10-02T18:27:25.685478] [DEBUG] [VALIDATOR ] DKS: Validating primary data. [2025-10-02T18:27:25.889192] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-08. [2025-10-02T18:27:26.089548] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-02T18:27:26.143925] [DEBUG] [VALIDATOR ] DKS: All expected trading days are present. [2025-10-02T18:27:26.144060] [DEBUG] [VALIDATOR ] DKS: Primary data validation passed. [2025-10-02T18:27:26.145107] [INFO ] [MAIN ] DKS: Fetched primary data is valid. [2025-10-02T18:27:26.145176] [DEBUG] [LOCAL ] DKS: Saving primary data. [2025-10-02T18:27:26.146817] [DEBUG] [LOCAL ] DKS: Trimmed 71618 records to 50084 (keeping 200 days of data) [2025-10-02T18:27:26.584403] [DEBUG] [LOCAL ] DKS: Primary data saved (50084 records). [2025-10-02T18:27:26.584549] [INFO ] [MAIN ] DKS: Full history saved. [2025-10-02T18:27:26.584638] [INFO ] [MAIN ] Update Progress: 627/2370 symbols completed. DKS took 32.1s. Estimated remaining: 4h 2m 54s. Rate: 7.2 symbols/min [2025-10-02T18:27:26.678216] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-07. [2025-10-02T18:27:26.776598] [INFO ] [MAIN ] DLR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:27:26.838721] [DEBUG] [LOCAL ] DLR: Loaded 50958 existing records from primary storage. [2025-10-02T18:27:26.839142] [INFO ] [MAIN ] DLR: Loaded 50958 existing records. [2025-10-02T18:27:27.042425] [WARN ] [MAIN ] DLR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:27:27.042714] [INFO ] [MAIN ] DLR: Wiping existing primary data before full refresh. [2025-10-02T18:27:27.042778] [INFO ] [LOCAL ] DLR: Starting deletion of primary data. [2025-10-02T18:27:27.044678] [DEBUG] [LOCAL ] DLR: Deleted primary data file. [2025-10-02T18:27:27.044742] [INFO ] [MAIN ] DLR: Starting full primary refresh. [2025-10-02T18:27:27.452086] [INFO ] [REMOTE ] DLR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:27:27.479265] [INFO ] [REMOTE ] DLR: Fetching primary data for 2024-12. [2025-10-02T18:27:27.485895] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-02T18:27:27.978404] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-02T18:27:28.273017] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-01. [2025-10-02T18:27:29.075568] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-08. [2025-10-02T18:27:29.082693] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-02T18:27:29.229069] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-02T18:27:29.873015] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-02. [2025-10-02T18:27:30.303716] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-02T18:27:30.604359] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-02T18:27:30.673037] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-03. [2025-10-02T18:27:31.359013] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-02T18:27:31.473023] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-04. [2025-10-02T18:27:32.273017] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-09. [2025-10-02T18:27:32.309801] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-02T18:27:33.073018] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-09. [2025-10-02T18:27:33.872993] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-05. [2025-10-02T18:27:33.934908] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-02T18:27:34.639564] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-02T18:27:34.672964] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-10. [2025-10-02T18:27:35.473001] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-01. [2025-10-02T18:27:35.896219] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-02T18:27:35.898549] [INFO ] [REMOTE ] DK: Full fetch complete (70846 records). [2025-10-02T18:27:35.898742] [DEBUG] [VALIDATOR ] DK: Validating primary data. [2025-10-02T18:27:36.278142] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-06. [2025-10-02T18:27:36.338425] [DEBUG] [VALIDATOR ] DK: All expected trading days are present. [2025-10-02T18:27:36.338699] [DEBUG] [VALIDATOR ] DK: Primary data validation passed. [2025-10-02T18:27:36.339615] [INFO ] [MAIN ] DK: Fetched primary data is valid. [2025-10-02T18:27:36.339704] [DEBUG] [LOCAL ] DK: Saving primary data. [2025-10-02T18:27:36.341221] [DEBUG] [LOCAL ] DK: Trimmed 70846 records to 49690 (keeping 200 days of data) [2025-10-02T18:27:36.603600] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-09 (3.53 seconds). [2025-10-02T18:27:36.713014] [DEBUG] [LOCAL ] DK: Primary data saved (49690 records). [2025-10-02T18:27:36.713164] [INFO ] [MAIN ] DK: Full history saved. [2025-10-02T18:27:36.714164] [INFO ] [MAIN ] Update Progress: 628/2370 symbols completed. DK took 49.9s. Estimated remaining: 4h 2m 51s. Rate: 7.2 symbols/min [2025-10-02T18:27:36.921360] [INFO ] [MAIN ] DLX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:27:36.954681] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-02T18:27:36.991141] [DEBUG] [LOCAL ] DLX: Loaded 28490 existing records from primary storage. [2025-10-02T18:27:36.991525] [INFO ] [MAIN ] DLX: Loaded 28490 existing records. [2025-10-02T18:27:37.075681] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-02. [2025-10-02T18:27:37.113963] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-02T18:27:37.202363] [WARN ] [MAIN ] DLX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:27:37.202609] [INFO ] [MAIN ] DLX: Wiping existing primary data before full refresh. [2025-10-02T18:27:37.202689] [INFO ] [LOCAL ] DLX: Starting deletion of primary data. [2025-10-02T18:27:37.203717] [DEBUG] [LOCAL ] DLX: Deleted primary data file. [2025-10-02T18:27:37.203779] [INFO ] [MAIN ] DLX: Starting full primary refresh. [2025-10-02T18:27:37.604846] [INFO ] [REMOTE ] DLX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:27:37.872999] [INFO ] [REMOTE ] DLX: Fetching primary data for 2024-12. [2025-10-02T18:27:38.672992] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-07. [2025-10-02T18:27:38.908115] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-02T18:27:39.078955] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-02T18:27:39.274863] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-02T18:27:39.473016] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-01. [2025-10-02T18:27:40.273029] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-03. [2025-10-02T18:27:40.603901] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-02T18:27:41.072995] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-08. [2025-10-02T18:27:41.646392] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-02T18:27:41.872979] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-09. [2025-10-02T18:27:42.283498] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-02T18:27:42.489618] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-02T18:27:42.673009] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-10. [2025-10-02T18:27:43.473018] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-04. [2025-10-02T18:27:44.029149] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-02T18:27:44.031922] [INFO ] [REMOTE ] DLB: Full fetch complete (46931 records). [2025-10-02T18:27:44.032128] [DEBUG] [VALIDATOR ] DLB: Validating primary data. [2025-10-02T18:27:44.278134] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-10. [2025-10-02T18:27:44.452914] [DEBUG] [VALIDATOR ] DLB: All expected trading days are present. [2025-10-02T18:27:44.453000] [DEBUG] [VALIDATOR ] DLB: Primary data validation passed. [2025-10-02T18:27:44.453776] [INFO ] [MAIN ] DLB: Fetched primary data is valid. [2025-10-02T18:27:44.453846] [DEBUG] [LOCAL ] DLB: Saving primary data. [2025-10-02T18:27:44.455032] [DEBUG] [LOCAL ] DLB: Trimmed 46931 records to 32228 (keeping 200 days of data) [2025-10-02T18:27:44.676921] [DEBUG] [LOCAL ] DLB: Primary data saved (32228 records). [2025-10-02T18:27:44.677075] [INFO ] [MAIN ] DLB: Full history saved. [2025-10-02T18:27:44.677163] [INFO ] [MAIN ] Update Progress: 629/2370 symbols completed. DLB took 43.7s. Estimated remaining: 4h 2m 41s. Rate: 7.2 symbols/min [2025-10-02T18:27:44.789743] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-02T18:27:44.815036] [INFO ] [REMOTE ] DLNG: Full fetch complete (11957 records). [2025-10-02T18:27:44.825846] [DEBUG] [VALIDATOR ] DLNG: Validating primary data. [2025-10-02T18:27:44.972611] [INFO ] [MAIN ] DLY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:27:45.075333] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-02. [2025-10-02T18:27:45.176154] [DEBUG] [LOCAL ] DLY: Loaded 19878 existing records from primary storage. [2025-10-02T18:27:45.181731] [INFO ] [MAIN ] DLY: Loaded 19878 existing records. [2025-10-02T18:27:45.544990] [WARN ] [MAIN ] DLY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:27:45.545385] [INFO ] [MAIN ] DLY: Wiping existing primary data before full refresh. [2025-10-02T18:27:45.545800] [DEBUG] [VALIDATOR ] DLNG: All expected trading days are present. [2025-10-02T18:27:45.545597] [INFO ] [LOCAL ] DLY: Starting deletion of primary data. [2025-10-02T18:27:45.546019] [DEBUG] [VALIDATOR ] DLNG: Primary data validation passed. [2025-10-02T18:27:45.546725] [INFO ] [MAIN ] DLNG: Fetched primary data is valid. [2025-10-02T18:27:45.546945] [DEBUG] [LOCAL ] DLNG: Saving primary data. [2025-10-02T18:27:45.547628] [DEBUG] [LOCAL ] DLY: Deleted primary data file. [2025-10-02T18:27:45.548090] [INFO ] [MAIN ] DLY: Starting full primary refresh. [2025-10-02T18:27:45.548341] [DEBUG] [LOCAL ] DLNG: Trimmed 11957 records to 6130 (keeping 200 days of data) [2025-10-02T18:27:45.744510] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-02T18:27:45.878152] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-05. [2025-10-02T18:27:45.958488] [DEBUG] [LOCAL ] DLNG: Primary data saved (6130 records). [2025-10-02T18:27:45.977980] [INFO ] [MAIN ] DLNG: Full history saved. [2025-10-02T18:27:45.983069] [INFO ] [MAIN ] Update Progress: 630/2370 symbols completed. DLNG took 26.1s. Estimated remaining: 4h 2m 14s. Rate: 7.2 symbols/min [2025-10-02T18:27:46.201993] [INFO ] [REMOTE ] DLY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:27:46.295138] [INFO ] [MAIN ] DMA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:27:46.316204] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-02T18:27:46.327950] [DEBUG] [LOCAL ] DMA: Loaded 4559 existing records from primary storage. [2025-10-02T18:27:46.328592] [INFO ] [MAIN ] DMA: Loaded 4559 existing records. [2025-10-02T18:27:46.526608] [WARN ] [MAIN ] DMA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:27:46.526892] [INFO ] [MAIN ] DMA: Wiping existing primary data before full refresh. [2025-10-02T18:27:46.527021] [INFO ] [LOCAL ] DMA: Starting deletion of primary data. [2025-10-02T18:27:46.527360] [DEBUG] [LOCAL ] DMA: Deleted primary data file. [2025-10-02T18:27:46.527432] [INFO ] [MAIN ] DMA: Starting full primary refresh. [2025-10-02T18:27:46.678116] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-03. [2025-10-02T18:27:46.947542] [INFO ] [REMOTE ] DMA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:27:47.473005] [INFO ] [REMOTE ] DLY: Fetching primary data for 2024-12. [2025-10-02T18:27:47.651171] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-02T18:27:47.700147] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-02T18:27:48.273001] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-04. [2025-10-02T18:27:48.450950] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-02T18:27:49.072992] [INFO ] [REMOTE ] DMA: Fetching primary data for 2024-12. [2025-10-02T18:27:49.602846] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-02T18:27:49.796246] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-02T18:27:49.873008] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-01. [2025-10-02T18:27:50.672990] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-05. [2025-10-02T18:27:50.923973] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-02T18:27:51.472971] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-06. [2025-10-02T18:27:51.964703] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-02T18:27:52.273003] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-01. [2025-10-02T18:27:52.583265] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-10-02T18:27:53.072970] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-02. [2025-10-02T18:27:53.196117] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-02T18:27:53.665730] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-02T18:27:53.873021] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-07. [2025-10-02T18:27:54.673041] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-06. [2025-10-02T18:27:55.473016] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-02. [2025-10-02T18:27:55.521022] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-02T18:27:55.870524] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-02T18:27:56.009798] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-02T18:27:56.273009] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-08. [2025-10-02T18:27:57.073030] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-03. [2025-10-02T18:27:57.452821] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-02T18:27:57.873006] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-07. [2025-10-02T18:27:58.673004] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-03. [2025-10-02T18:27:58.741862] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-02T18:27:59.318610] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-08 (3.05 seconds). [2025-10-02T18:27:59.472993] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-04. [2025-10-02T18:27:59.856117] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-02T18:28:00.117192] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-02T18:28:00.273073] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-05. [2025-10-02T18:28:01.073001] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-04. [2025-10-02T18:28:01.165631] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-02T18:28:01.872988] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-06. [2025-10-02T18:28:02.118936] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-02T18:28:02.318393] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-02T18:28:02.673011] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-09. [2025-10-02T18:28:03.473211] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-05. [2025-10-02T18:28:04.272976] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-08. [2025-10-02T18:28:04.398931] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-02T18:28:04.587144] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-02T18:28:05.073004] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-06. [2025-10-02T18:28:05.599422] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-02T18:28:05.873053] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-09. [2025-10-02T18:28:06.078373] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-02T18:28:06.673035] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-07. [2025-10-02T18:28:07.178685] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-02T18:28:07.473006] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-10. [2025-10-02T18:28:07.768378] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-02T18:28:08.273000] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-08. [2025-10-02T18:28:08.781799] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-02T18:28:08.783780] [INFO ] [REMOTE ] DLR: Full fetch complete (74064 records). [2025-10-02T18:28:08.783887] [DEBUG] [VALIDATOR ] DLR: Validating primary data. [2025-10-02T18:28:09.080187] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-07. [2025-10-02T18:28:09.255532] [DEBUG] [VALIDATOR ] DLR: All expected trading days are present. [2025-10-02T18:28:09.255669] [DEBUG] [VALIDATOR ] DLR: Primary data validation passed. [2025-10-02T18:28:09.256854] [INFO ] [MAIN ] DLR: Fetched primary data is valid. [2025-10-02T18:28:09.256941] [DEBUG] [LOCAL ] DLR: Saving primary data. [2025-10-02T18:28:09.269432] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-02T18:28:09.274697] [DEBUG] [LOCAL ] DLR: Trimmed 74064 records to 51291 (keeping 200 days of data) [2025-10-02T18:28:09.625888] [DEBUG] [LOCAL ] DLR: Primary data saved (51291 records). [2025-10-02T18:28:09.626032] [INFO ] [MAIN ] DLR: Full history saved. [2025-10-02T18:28:09.626119] [INFO ] [MAIN ] Update Progress: 631/2370 symbols completed. DLR took 43.0s. Estimated remaining: 4h 2m 47s. Rate: 7.2 symbols/min [2025-10-02T18:28:09.705103] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-02T18:28:09.826835] [INFO ] [MAIN ] DMB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:28:09.841587] [DEBUG] [LOCAL ] DMB: Loaded 10218 existing records from primary storage. [2025-10-02T18:28:09.841878] [INFO ] [MAIN ] DMB: Loaded 10218 existing records. [2025-10-02T18:28:09.878105] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-10. [2025-10-02T18:28:10.042231] [WARN ] [MAIN ] DMB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:28:10.042454] [INFO ] [MAIN ] DMB: Wiping existing primary data before full refresh. [2025-10-02T18:28:10.042502] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-10-02T18:28:10.042991] [DEBUG] [LOCAL ] DMB: Deleted primary data file. [2025-10-02T18:28:10.043066] [INFO ] [MAIN ] DMB: Starting full primary refresh. [2025-10-02T18:28:10.442015] [INFO ] [REMOTE ] DMB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:28:10.673009] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-08. [2025-10-02T18:28:10.792719] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-02T18:28:10.794034] [INFO ] [REMOTE ] DLX: Full fetch complete (41381 records). [2025-10-02T18:28:10.794116] [DEBUG] [VALIDATOR ] DLX: Validating primary data. [2025-10-02T18:28:11.233231] [DEBUG] [VALIDATOR ] DLX: All expected trading days are present. [2025-10-02T18:28:11.233334] [DEBUG] [VALIDATOR ] DLX: Primary data validation passed. [2025-10-02T18:28:11.234017] [INFO ] [MAIN ] DLX: Fetched primary data is valid. [2025-10-02T18:28:11.234116] [DEBUG] [LOCAL ] DLX: Saving primary data. [2025-10-02T18:28:11.235188] [DEBUG] [LOCAL ] DLX: Trimmed 41381 records to 28713 (keeping 200 days of data) [2025-10-02T18:28:11.342405] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-02T18:28:11.442479] [DEBUG] [LOCAL ] DLX: Primary data saved (28713 records). [2025-10-02T18:28:11.442623] [INFO ] [MAIN ] DLX: Full history saved. [2025-10-02T18:28:11.443497] [INFO ] [MAIN ] Update Progress: 632/2370 symbols completed. DLX took 34.7s. Estimated remaining: 4h 2m 21s. Rate: 7.2 symbols/min [2025-10-02T18:28:11.478083] [INFO ] [REMOTE ] DMB: Fetching primary data for 2024-12. [2025-10-02T18:28:11.638281] [INFO ] [MAIN ] DMO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:28:11.638457] [DEBUG] [LOCAL ] DMO: No existing data file found in primary storage. [2025-10-02T18:28:11.638496] [WARN ] [MAIN ] DMO: No existing data found, performing full refresh instead. [2025-10-02T18:28:11.638611] [INFO ] [MAIN ] DMO: Wiping existing primary data before full refresh. [2025-10-02T18:28:11.638682] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-10-02T18:28:11.638745] [DEBUG] [LOCAL ] DMO: No primary data file found to delete. [2025-10-02T18:28:11.638781] [INFO ] [MAIN ] DMO: Starting full primary refresh. [2025-10-02T18:28:12.039950] [INFO ] [REMOTE ] DMO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:28:12.273001] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-09. [2025-10-02T18:28:12.470140] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-02T18:28:12.639177] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-02T18:28:13.073013] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-09. [2025-10-02T18:28:13.873029] [INFO ] [REMOTE ] DMO: Fetching primary data for 2024-12. [2025-10-02T18:28:13.976671] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-02T18:28:14.673019] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-10. [2025-10-02T18:28:14.705779] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-02T18:28:15.473026] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-01. [2025-10-02T18:28:15.600767] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-02T18:28:15.602500] [INFO ] [REMOTE ] DLY: Full fetch complete (28439 records). [2025-10-02T18:28:15.602633] [DEBUG] [VALIDATOR ] DLY: Validating primary data. [2025-10-02T18:28:16.030220] [DEBUG] [VALIDATOR ] DLY: All expected trading days are present. [2025-10-02T18:28:16.030328] [DEBUG] [VALIDATOR ] DLY: Primary data validation passed. [2025-10-02T18:28:16.030917] [INFO ] [MAIN ] DLY: Fetched primary data is valid. [2025-10-02T18:28:16.030984] [DEBUG] [LOCAL ] DLY: Saving primary data. [2025-10-02T18:28:16.031972] [DEBUG] [LOCAL ] DLY: Trimmed 28439 records to 20149 (keeping 200 days of data) [2025-10-02T18:28:16.164075] [DEBUG] [LOCAL ] DLY: Primary data saved (20149 records). [2025-10-02T18:28:16.164203] [INFO ] [MAIN ] DLY: Full history saved. [2025-10-02T18:28:16.164284] [INFO ] [MAIN ] Update Progress: 633/2370 symbols completed. DLY took 31.5s. Estimated remaining: 4h 2m 3s. Rate: 7.2 symbols/min [2025-10-02T18:28:16.274222] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-01. [2025-10-02T18:28:16.384100] [INFO ] [MAIN ] DNA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:28:16.384418] [DEBUG] [LOCAL ] DNA: No existing data file found in primary storage. [2025-10-02T18:28:16.384518] [WARN ] [MAIN ] DNA: No existing data found, performing full refresh instead. [2025-10-02T18:28:16.384931] [INFO ] [MAIN ] DNA: Wiping existing primary data before full refresh. [2025-10-02T18:28:16.393601] [INFO ] [LOCAL ] DNA: Starting deletion of primary data. [2025-10-02T18:28:16.394731] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-02T18:28:16.398518] [DEBUG] [LOCAL ] DNA: No primary data file found to delete. [2025-10-02T18:28:16.398639] [INFO ] [MAIN ] DNA: Starting full primary refresh. [2025-10-02T18:28:16.825005] [INFO ] [REMOTE ] DNA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:28:17.072987] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-02. [2025-10-02T18:28:17.228746] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-02T18:28:17.831057] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-02T18:28:17.873054] [INFO ] [REMOTE ] DNA: Fetching primary data for 2024-12. [2025-10-02T18:28:18.673000] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-02. [2025-10-02T18:28:19.396336] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-02T18:28:19.472981] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-03. [2025-10-02T18:28:19.602339] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-02T18:28:20.259106] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-02T18:28:20.272958] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-04. [2025-10-02T18:28:21.073004] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-01. [2025-10-02T18:28:21.168085] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-02T18:28:21.872998] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-03. [2025-10-02T18:28:22.527336] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-02T18:28:22.563389] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-02T18:28:22.673013] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-04. [2025-10-02T18:28:23.473036] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-10. [2025-10-02T18:28:23.604863] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-02T18:28:24.056322] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-02T18:28:24.057214] [INFO ] [REMOTE ] DMA: Full fetch complete (6637 records). [2025-10-02T18:28:24.057368] [DEBUG] [VALIDATOR ] DMA: Validating primary data. [2025-10-02T18:28:24.278183] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-05. [2025-10-02T18:28:24.465515] [DEBUG] [VALIDATOR ] DMA: All expected trading days are present. [2025-10-02T18:28:24.465613] [DEBUG] [VALIDATOR ] DMA: Primary data validation passed. [2025-10-02T18:28:24.465836] [INFO ] [MAIN ] DMA: Fetched primary data is valid. [2025-10-02T18:28:24.465894] [DEBUG] [LOCAL ] DMA: Saving primary data. [2025-10-02T18:28:24.466376] [DEBUG] [LOCAL ] DMA: Trimmed 6637 records to 4570 (keeping 200 days of data) [2025-10-02T18:28:24.494935] [DEBUG] [LOCAL ] DMA: Primary data saved (4570 records). [2025-10-02T18:28:24.495069] [INFO ] [MAIN ] DMA: Full history saved. [2025-10-02T18:28:24.495171] [INFO ] [MAIN ] Update Progress: 634/2370 symbols completed. DMA took 38.5s. Estimated remaining: 4h 1m 54s. Rate: 7.2 symbols/min [2025-10-02T18:28:24.677925] [INFO ] [MAIN ] DNOW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:28:24.678117] [DEBUG] [LOCAL ] DNOW: No existing data file found in primary storage. [2025-10-02T18:28:24.678208] [WARN ] [MAIN ] DNOW: No existing data found, performing full refresh instead. [2025-10-02T18:28:24.678293] [INFO ] [MAIN ] DNOW: Wiping existing primary data before full refresh. [2025-10-02T18:28:24.678331] [INFO ] [LOCAL ] DNOW: Starting deletion of primary data. [2025-10-02T18:28:24.678374] [DEBUG] [LOCAL ] DNOW: No primary data file found to delete. [2025-10-02T18:28:24.678407] [INFO ] [MAIN ] DNOW: Starting full primary refresh. [2025-10-02T18:28:25.061812] [INFO ] [REMOTE ] DNOW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:28:25.072961] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2024-12. [2025-10-02T18:28:25.274592] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-02T18:28:25.873021] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-05. [2025-10-02T18:28:26.366214] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-02T18:28:26.487493] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-02T18:28:26.673031] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-01. [2025-10-02T18:28:27.473015] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-02. [2025-10-02T18:28:28.273034] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-06. [2025-10-02T18:28:28.590038] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-02T18:28:28.997274] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-02T18:28:29.072997] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-07. [2025-10-02T18:28:29.629214] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-10-02T18:28:29.791437] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-02T18:28:29.873002] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-02. [2025-10-02T18:28:30.673005] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-06. [2025-10-02T18:28:31.324306] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-02T18:28:31.472998] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-03. [2025-10-02T18:28:31.528464] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-02T18:28:32.273009] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-07. [2025-10-02T18:28:33.072997] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-08. [2025-10-02T18:28:33.110878] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-02T18:28:33.515202] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-02T18:28:33.605016] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-02T18:28:33.873037] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-09. [2025-10-02T18:28:34.651198] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-02T18:28:34.672974] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-10. [2025-10-02T18:28:35.438546] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-02T18:28:35.439509] [INFO ] [REMOTE ] DMO: Full fetch complete (14461 records). [2025-10-02T18:28:35.439581] [DEBUG] [VALIDATOR ] DMO: Validating primary data. [2025-10-02T18:28:35.478102] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-08. [2025-10-02T18:28:35.832243] [DEBUG] [VALIDATOR ] DMO: All expected trading days are present. [2025-10-02T18:28:35.832324] [DEBUG] [VALIDATOR ] DMO: Primary data validation passed. [2025-10-02T18:28:35.832699] [INFO ] [MAIN ] DMO: Fetched primary data is valid. [2025-10-02T18:28:35.832761] [DEBUG] [LOCAL ] DMO: Saving primary data. [2025-10-02T18:28:35.833298] [DEBUG] [LOCAL ] DMO: Trimmed 14461 records to 9961 (keeping 200 days of data) [2025-10-02T18:28:35.897492] [DEBUG] [LOCAL ] DMO: Primary data saved (9961 records). [2025-10-02T18:28:35.897638] [INFO ] [MAIN ] DMO: Full history saved. [2025-10-02T18:28:35.897755] [INFO ] [MAIN ] Update Progress: 635/2370 symbols completed. DMO took 24.5s. Estimated remaining: 4h 1m 54s. Rate: 7.2 symbols/min [2025-10-02T18:28:36.084166] [INFO ] [MAIN ] DNP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:28:36.119633] [DEBUG] [LOCAL ] DNP: Loaded 33239 existing records from primary storage. [2025-10-02T18:28:36.119978] [INFO ] [MAIN ] DNP: Loaded 33239 existing records. [2025-10-02T18:28:36.281132] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-04. [2025-10-02T18:28:36.316799] [WARN ] [MAIN ] DNP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:28:36.317414] [INFO ] [MAIN ] DNP: Wiping existing primary data before full refresh. [2025-10-02T18:28:36.317502] [INFO ] [LOCAL ] DNP: Starting deletion of primary data. [2025-10-02T18:28:36.319035] [DEBUG] [LOCAL ] DNP: Deleted primary data file. [2025-10-02T18:28:36.319109] [INFO ] [MAIN ] DNP: Starting full primary refresh. [2025-10-02T18:28:36.498869] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-02T18:28:36.737163] [INFO ] [REMOTE ] DNP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:28:37.073032] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-09. [2025-10-02T18:28:37.830774] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-02T18:28:37.873003] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-10. [2025-10-02T18:28:38.118753] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-02T18:28:38.392135] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-02T18:28:38.393057] [INFO ] [REMOTE ] DMB: Full fetch complete (15004 records). [2025-10-02T18:28:38.393132] [DEBUG] [VALIDATOR ] DMB: Validating primary data. [2025-10-02T18:28:38.678907] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-05. [2025-10-02T18:28:38.814880] [DEBUG] [VALIDATOR ] DMB: All expected trading days are present. [2025-10-02T18:28:38.814957] [DEBUG] [VALIDATOR ] DMB: Primary data validation passed. [2025-10-02T18:28:38.815403] [INFO ] [MAIN ] DMB: Fetched primary data is valid. [2025-10-02T18:28:38.815521] [DEBUG] [LOCAL ] DMB: Saving primary data. [2025-10-02T18:28:38.818779] [DEBUG] [LOCAL ] DMB: Trimmed 15004 records to 10281 (keeping 200 days of data) [2025-10-02T18:28:38.889030] [DEBUG] [LOCAL ] DMB: Primary data saved (10281 records). [2025-10-02T18:28:38.889176] [INFO ] [MAIN ] DMB: Full history saved. [2025-10-02T18:28:38.889311] [INFO ] [MAIN ] Update Progress: 636/2370 symbols completed. DMB took 29.3s. Estimated remaining: 4h 1m 31s. Rate: 7.2 symbols/min [2025-10-02T18:28:39.071913] [INFO ] [MAIN ] DOC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:28:39.135876] [DEBUG] [LOCAL ] DOC: Loaded 53542 existing records from primary storage. [2025-10-02T18:28:39.136219] [INFO ] [MAIN ] DOC: Loaded 53542 existing records. [2025-10-02T18:28:39.330272] [WARN ] [MAIN ] DOC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:28:39.330590] [INFO ] [MAIN ] DOC: Wiping existing primary data before full refresh. [2025-10-02T18:28:39.330669] [INFO ] [LOCAL ] DOC: Starting deletion of primary data. [2025-10-02T18:28:39.333722] [DEBUG] [LOCAL ] DOC: Deleted primary data file. [2025-10-02T18:28:39.333836] [INFO ] [MAIN ] DOC: Starting full primary refresh. [2025-10-02T18:28:39.478073] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-03. [2025-10-02T18:28:39.749724] [INFO ] [REMOTE ] DOC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:28:40.272978] [INFO ] [REMOTE ] DNP: Fetching primary data for 2024-12. [2025-10-02T18:28:40.303920] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-02T18:28:41.073004] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-06. [2025-10-02T18:28:41.132613] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-02T18:28:41.841261] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-02T18:28:41.872962] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-01. [2025-10-02T18:28:42.672993] [INFO ] [REMOTE ] DOC: Fetching primary data for 2024-12. [2025-10-02T18:28:42.894515] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-02T18:28:43.259489] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-02T18:28:43.473001] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-02. [2025-10-02T18:28:44.272987] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-07. [2025-10-02T18:28:44.485548] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-02T18:28:44.590767] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-02T18:28:45.072995] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-03. [2025-10-02T18:28:45.873012] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-01. [2025-10-02T18:28:46.300456] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-02T18:28:46.506912] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-02T18:28:46.673039] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-08. [2025-10-02T18:28:47.405402] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-02T18:28:47.473032] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-02. [2025-10-02T18:28:48.272985] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-04. [2025-10-02T18:28:48.428423] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-02T18:28:49.073028] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-09. [2025-10-02T18:28:49.739037] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-02T18:28:49.873006] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-05. [2025-10-02T18:28:50.673053] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-04. [2025-10-02T18:28:50.827481] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-02T18:28:50.993624] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-02T18:28:51.473054] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-10. [2025-10-02T18:28:52.273031] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-06. [2025-10-02T18:28:52.358972] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-02 (4.89 seconds). [2025-10-02T18:28:52.418755] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-02T18:28:52.880061] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-02T18:28:52.882155] [INFO ] [REMOTE ] DNA: Full fetch complete (70952 records). [2025-10-02T18:28:52.882331] [DEBUG] [VALIDATOR ] DNA: Validating primary data. [2025-10-02T18:28:53.079140] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-03. [2025-10-02T18:28:53.312966] [DEBUG] [VALIDATOR ] DNA: All expected trading days are present. [2025-10-02T18:28:53.313155] [DEBUG] [VALIDATOR ] DNA: Primary data validation passed. [2025-10-02T18:28:53.314212] [INFO ] [MAIN ] DNA: Fetched primary data is valid. [2025-10-02T18:28:53.314346] [DEBUG] [LOCAL ] DNA: Saving primary data. [2025-10-02T18:28:53.316155] [DEBUG] [LOCAL ] DNA: Trimmed 70952 records to 48642 (keeping 200 days of data) [2025-10-02T18:28:53.445366] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-02T18:28:53.656049] [DEBUG] [LOCAL ] DNA: Primary data saved (48642 records). [2025-10-02T18:28:53.656199] [INFO ] [MAIN ] DNA: Full history saved. [2025-10-02T18:28:53.656276] [INFO ] [MAIN ] Update Progress: 637/2370 symbols completed. DNA took 37.5s. Estimated remaining: 4h 1m 40s. Rate: 7.2 symbols/min [2025-10-02T18:28:53.872999] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-07. [2025-10-02T18:28:54.672985] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-05. [2025-10-02T18:28:55.139144] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-02T18:28:55.170898] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-02T18:28:55.473006] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-04. [2025-10-02T18:28:56.044882] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-02T18:28:56.273042] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-06. [2025-10-02T18:28:57.053285] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-02T18:28:57.073003] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-08. [2025-10-02T18:28:57.667091] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-02T18:28:57.873003] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-05. [2025-10-02T18:28:58.211766] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-02T18:28:58.673000] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-07. [2025-10-02T18:28:59.473023] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-09. [2025-10-02T18:28:59.759955] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-02T18:29:00.271686] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-02T18:29:00.282140] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-06. [2025-10-02T18:29:00.516735] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-02T18:29:01.073019] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-08. [2025-10-02T18:29:01.873072] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-10. [2025-10-02T18:29:02.099571] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-02T18:29:02.446078] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-02T18:29:02.673027] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-07. [2025-10-02T18:29:03.028352] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-02T18:29:03.029944] [INFO ] [REMOTE ] DNP: Full fetch complete (49309 records). [2025-10-02T18:29:03.030038] [DEBUG] [VALIDATOR ] DNP: Validating primary data. [2025-10-02T18:29:03.467801] [DEBUG] [VALIDATOR ] DNP: All expected trading days are present. [2025-10-02T18:29:03.467897] [DEBUG] [VALIDATOR ] DNP: Primary data validation passed. [2025-10-02T18:29:03.468676] [INFO ] [MAIN ] DNP: Fetched primary data is valid. [2025-10-02T18:29:03.468800] [DEBUG] [LOCAL ] DNP: Saving primary data. [2025-10-02T18:29:03.470204] [DEBUG] [LOCAL ] DNP: Trimmed 49309 records to 33447 (keeping 200 days of data) [2025-10-02T18:29:03.473004] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-09. [2025-10-02T18:29:03.720584] [DEBUG] [LOCAL ] DNP: Primary data saved (33447 records). [2025-10-02T18:29:03.720798] [INFO ] [MAIN ] DNP: Full history saved. [2025-10-02T18:29:03.721994] [INFO ] [MAIN ] Update Progress: 638/2370 symbols completed. DNP took 27.8s. Estimated remaining: 4h 1m 36s. Rate: 7.2 symbols/min [2025-10-02T18:29:04.698766] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-02T18:29:04.711286] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-08. [2025-10-02T18:29:05.023204] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-02T18:29:05.072994] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-10. [2025-10-02T18:29:06.219980] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-02T18:29:06.222002] [INFO ] [REMOTE ] DNOW: Full fetch complete (63011 records). [2025-10-02T18:29:06.222105] [DEBUG] [VALIDATOR ] DNOW: Validating primary data. [2025-10-02T18:29:06.674955] [DEBUG] [VALIDATOR ] DNOW: All expected trading days are present. [2025-10-02T18:29:06.675165] [DEBUG] [VALIDATOR ] DNOW: Primary data validation passed. [2025-10-02T18:29:06.676017] [INFO ] [MAIN ] DNOW: Fetched primary data is valid. [2025-10-02T18:29:06.676101] [DEBUG] [LOCAL ] DNOW: Saving primary data. [2025-10-02T18:29:06.689101] [DEBUG] [LOCAL ] DNOW: Trimmed 63011 records to 44016 (keeping 200 days of data) [2025-10-02T18:29:06.712143] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-02T18:29:06.782754] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-09. [2025-10-02T18:29:07.018282] [DEBUG] [LOCAL ] DNOW: Primary data saved (44016 records). [2025-10-02T18:29:07.018427] [INFO ] [MAIN ] DNOW: Full history saved. [2025-10-02T18:29:07.018508] [INFO ] [MAIN ] Update Progress: 639/2370 symbols completed. DNOW took 42.5s. Estimated remaining: 4h 1m 14s. Rate: 7.2 symbols/min [2025-10-02T18:29:08.624582] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-02T18:29:08.644251] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-10. [2025-10-02T18:29:10.244491] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-02T18:29:10.246605] [INFO ] [REMOTE ] DOC: Full fetch complete (77390 records). [2025-10-02T18:29:10.246756] [DEBUG] [VALIDATOR ] DOC: Validating primary data. [2025-10-02T18:29:10.665266] [DEBUG] [VALIDATOR ] DOC: All expected trading days are present. [2025-10-02T18:29:10.665350] [DEBUG] [VALIDATOR ] DOC: Primary data validation passed. [2025-10-02T18:29:10.666252] [INFO ] [MAIN ] DOC: Fetched primary data is valid. [2025-10-02T18:29:10.666317] [DEBUG] [LOCAL ] DOC: Saving primary data. [2025-10-02T18:29:10.668033] [DEBUG] [LOCAL ] DOC: Trimmed 77390 records to 53930 (keeping 200 days of data) [2025-10-02T18:29:11.035443] [DEBUG] [LOCAL ] DOC: Primary data saved (53930 records). [2025-10-02T18:29:11.035589] [INFO ] [MAIN ] DOC: Full history saved. [2025-10-02T18:29:11.035699] [INFO ] [MAIN ] Update Progress: 640/2370 symbols completed. DOC took 32.1s. Estimated remaining: 4h 0m 54s. Rate: 7.2 symbols/min [2025-10-02T18:29:11.841771] [INFO ] [MAIN ] DOCS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:29:11.808154] [INFO ] [MAIN ] DOUG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:29:11.849326] [INFO ] [MAIN ] DOLE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:29:11.901945] [INFO ] [MAIN ] DOCN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:29:11.938625] [DEBUG] [LOCAL ] DOUG: Loaded 34405 existing records from primary storage. [2025-10-02T18:29:11.939122] [INFO ] [MAIN ] DOUG: Loaded 34405 existing records. [2025-10-02T18:29:12.109245] [DEBUG] [LOCAL ] DOLE: Loaded 38416 existing records from primary storage. [2025-10-02T18:29:12.137376] [DEBUG] [LOCAL ] DOCN: Loaded 50567 existing records from primary storage. [2025-10-02T18:29:12.146043] [DEBUG] [LOCAL ] DOCS: Loaded 51126 existing records from primary storage. [2025-10-02T18:29:12.150922] [INFO ] [MAIN ] DOCS: Loaded 51126 existing records. [2025-10-02T18:29:12.151241] [INFO ] [MAIN ] DOCN: Loaded 50567 existing records. [2025-10-02T18:29:12.151059] [INFO ] [MAIN ] DOLE: Loaded 38416 existing records. [2025-10-02T18:29:12.576477] [WARN ] [MAIN ] DOUG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:29:12.592610] [INFO ] [MAIN ] DOUG: Wiping existing primary data before full refresh. [2025-10-02T18:29:12.641858] [INFO ] [LOCAL ] DOUG: Starting deletion of primary data. [2025-10-02T18:29:12.721579] [WARN ] [MAIN ] DOCS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:29:12.752669] [INFO ] [MAIN ] DOCS: Wiping existing primary data before full refresh. [2025-10-02T18:29:12.748440] [DEBUG] [LOCAL ] DOUG: Deleted primary data file. [2025-10-02T18:29:12.784983] [INFO ] [LOCAL ] DOCS: Starting deletion of primary data. [2025-10-02T18:29:12.784894] [INFO ] [MAIN ] DOUG: Starting full primary refresh. [2025-10-02T18:29:12.816352] [DEBUG] [LOCAL ] DOCS: Deleted primary data file. [2025-10-02T18:29:12.864358] [INFO ] [MAIN ] DOCS: Starting full primary refresh. [2025-10-02T18:29:12.864266] [WARN ] [MAIN ] DOCN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:29:12.829207] [WARN ] [MAIN ] DOLE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:29:12.895056] [INFO ] [MAIN ] DOCN: Wiping existing primary data before full refresh. [2025-10-02T18:29:12.943735] [INFO ] [LOCAL ] DOCN: Starting deletion of primary data. [2025-10-02T18:29:12.963437] [INFO ] [MAIN ] DOLE: Wiping existing primary data before full refresh. [2025-10-02T18:29:12.968760] [INFO ] [LOCAL ] DOLE: Starting deletion of primary data. [2025-10-02T18:29:12.984279] [DEBUG] [LOCAL ] DOCN: Deleted primary data file. [2025-10-02T18:29:13.010061] [DEBUG] [LOCAL ] DOLE: Deleted primary data file. [2025-10-02T18:29:13.002282] [INFO ] [MAIN ] DOCN: Starting full primary refresh. [2025-10-02T18:29:13.020785] [INFO ] [MAIN ] DOLE: Starting full primary refresh. [2025-10-02T18:29:14.227786] [INFO ] [REMOTE ] DOUG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:29:14.343811] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2024-12. [2025-10-02T18:29:14.439345] [INFO ] [REMOTE ] DOCS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:29:14.482836] [INFO ] [REMOTE ] DOCN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:29:14.467764] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2024-12. [2025-10-02T18:29:14.483355] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2024-12. [2025-10-02T18:29:14.565815] [INFO ] [REMOTE ] DOLE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:29:14.566133] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2024-12. [2025-10-02T18:29:16.004720] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-02T18:29:16.013786] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-01. [2025-10-02T18:29:16.050790] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-02T18:29:16.063682] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-01. [2025-10-02T18:29:16.143623] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-02T18:29:16.151270] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-01. [2025-10-02T18:29:16.179307] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-02T18:29:16.188173] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-01. [2025-10-02T18:29:17.255074] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-02T18:29:17.262828] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-02. [2025-10-02T18:29:17.538187] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-02T18:29:17.547166] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-02. [2025-10-02T18:29:17.633150] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-02T18:29:17.643554] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-02. [2025-10-02T18:29:17.884985] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-02T18:29:17.894743] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-02. [2025-10-02T18:29:18.827212] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-02T18:29:18.835425] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-03. [2025-10-02T18:29:19.132610] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-02T18:29:19.143451] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-03. [2025-10-02T18:29:19.610540] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-02T18:29:19.620735] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-03. [2025-10-02T18:29:20.177853] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-02T18:29:20.185890] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-04. [2025-10-02T18:29:20.634024] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-02T18:29:20.645763] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-04. [2025-10-02T18:29:21.211340] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-02 (3.95 seconds). [2025-10-02T18:29:21.219565] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-03. [2025-10-02T18:29:21.310272] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-02T18:29:21.377748] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-02T18:29:21.873001] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-04. [2025-10-02T18:29:22.186389] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-02T18:29:22.302398] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-02T18:29:22.673018] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-04. [2025-10-02T18:29:23.472989] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-05. [2025-10-02T18:29:23.563688] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-02T18:29:23.781130] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-02T18:29:24.273046] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-05. [2025-10-02T18:29:24.912845] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-02T18:29:25.073011] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-05. [2025-10-02T18:29:25.374537] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-02T18:29:25.873014] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-06. [2025-10-02T18:29:26.673011] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-06. [2025-10-02T18:29:27.099497] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-02T18:29:27.147453] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-02T18:29:27.473037] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-05. [2025-10-02T18:29:28.218938] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-02T18:29:28.273021] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-06. [2025-10-02T18:29:29.073004] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-07. [2025-10-02T18:29:29.380103] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-02T18:29:29.873074] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-07. [2025-10-02T18:29:30.078320] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-02T18:29:30.345909] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-02T18:29:30.673038] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-08. [2025-10-02T18:29:30.951475] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-02T18:29:31.473006] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-08. [2025-10-02T18:29:32.051463] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-02T18:29:32.273023] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-09. [2025-10-02T18:29:32.892475] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-02T18:29:33.072998] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-06. [2025-10-02T18:29:33.621948] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-02T18:29:33.872999] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-10. [2025-10-02T18:29:34.672988] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-07. [2025-10-02T18:29:34.784145] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-02T18:29:34.979223] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-02T18:29:34.980701] [INFO ] [REMOTE ] DOUG: Full fetch complete (51108 records). [2025-10-02T18:29:34.980798] [DEBUG] [VALIDATOR ] DOUG: Validating primary data. [2025-10-02T18:29:35.428299] [DEBUG] [VALIDATOR ] DOUG: All expected trading days are present. [2025-10-02T18:29:35.428429] [DEBUG] [VALIDATOR ] DOUG: Primary data validation passed. [2025-10-02T18:29:35.429387] [INFO ] [MAIN ] DOUG: Fetched primary data is valid. [2025-10-02T18:29:35.429455] [DEBUG] [LOCAL ] DOUG: Saving primary data. [2025-10-02T18:29:35.430711] [DEBUG] [LOCAL ] DOUG: Trimmed 51108 records to 34608 (keeping 200 days of data) [2025-10-02T18:29:35.476967] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-07. [2025-10-02T18:29:35.631264] [DEBUG] [LOCAL ] DOUG: Primary data saved (34608 records). [2025-10-02T18:29:35.631407] [INFO ] [MAIN ] DOUG: Full history saved. [2025-10-02T18:29:35.631531] [INFO ] [MAIN ] Update Progress: 641/2370 symbols completed. DOUG took 24.6s. Estimated remaining: 4h 1m 30s. Rate: 7.2 symbols/min [2025-10-02T18:29:35.821351] [INFO ] [MAIN ] DOV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:29:35.867115] [DEBUG] [LOCAL ] DOV: Loaded 45454 existing records from primary storage. [2025-10-02T18:29:35.867418] [INFO ] [MAIN ] DOV: Loaded 45454 existing records. [2025-10-02T18:29:36.056464] [WARN ] [MAIN ] DOV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:29:36.056753] [INFO ] [MAIN ] DOV: Wiping existing primary data before full refresh. [2025-10-02T18:29:36.056807] [INFO ] [LOCAL ] DOV: Starting deletion of primary data. [2025-10-02T18:29:36.058619] [DEBUG] [LOCAL ] DOV: Deleted primary data file. [2025-10-02T18:29:36.058722] [INFO ] [MAIN ] DOV: Starting full primary refresh. [2025-10-02T18:29:36.286899] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-09. [2025-10-02T18:29:36.453026] [INFO ] [REMOTE ] DOV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:29:36.494933] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-02T18:29:37.055910] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-02T18:29:37.072994] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-08. [2025-10-02T18:29:37.873008] [INFO ] [REMOTE ] DOV: Fetching primary data for 2024-12. [2025-10-02T18:29:37.929069] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-02T18:29:38.673001] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-10. [2025-10-02T18:29:38.975929] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-02T18:29:39.067422] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-02T18:29:39.473022] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-09. [2025-10-02T18:29:40.241078] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-02T18:29:40.243487] [INFO ] [REMOTE ] DOLE: Full fetch complete (53894 records). [2025-10-02T18:29:40.243599] [DEBUG] [VALIDATOR ] DOLE: Validating primary data. [2025-10-02T18:29:40.278164] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-01. [2025-10-02T18:29:40.684128] [DEBUG] [VALIDATOR ] DOLE: All expected trading days are present. [2025-10-02T18:29:40.684213] [DEBUG] [VALIDATOR ] DOLE: Primary data validation passed. [2025-10-02T18:29:40.685247] [INFO ] [MAIN ] DOLE: Fetched primary data is valid. [2025-10-02T18:29:40.685331] [DEBUG] [LOCAL ] DOLE: Saving primary data. [2025-10-02T18:29:40.687812] [DEBUG] [LOCAL ] DOLE: Trimmed 53894 records to 38730 (keeping 200 days of data) [2025-10-02T18:29:40.948553] [DEBUG] [LOCAL ] DOLE: Primary data saved (38730 records). [2025-10-02T18:29:40.948728] [INFO ] [MAIN ] DOLE: Full history saved. [2025-10-02T18:29:40.948845] [INFO ] [MAIN ] Update Progress: 642/2370 symbols completed. DOLE took 29.9s. Estimated remaining: 4h 1m 13s. Rate: 7.2 symbols/min [2025-10-02T18:29:41.074601] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-08. [2025-10-02T18:29:41.152320] [INFO ] [MAIN ] DOW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:29:41.190360] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-02T18:29:41.246689] [DEBUG] [LOCAL ] DOW: Loaded 53733 existing records from primary storage. [2025-10-02T18:29:41.247077] [INFO ] [MAIN ] DOW: Loaded 53733 existing records. [2025-10-02T18:29:41.452741] [WARN ] [MAIN ] DOW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:29:41.452996] [INFO ] [MAIN ] DOW: Wiping existing primary data before full refresh. [2025-10-02T18:29:41.453068] [INFO ] [LOCAL ] DOW: Starting deletion of primary data. [2025-10-02T18:29:41.454949] [DEBUG] [LOCAL ] DOW: Deleted primary data file. [2025-10-02T18:29:41.455014] [INFO ] [MAIN ] DOW: Starting full primary refresh. [2025-10-02T18:29:41.875040] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-10. [2025-10-02T18:29:41.889106] [INFO ] [REMOTE ] DOW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:29:42.070816] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-02T18:29:42.672964] [INFO ] [REMOTE ] DOW: Fetching primary data for 2024-12. [2025-10-02T18:29:43.193447] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-02T18:29:43.473065] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-02. [2025-10-02T18:29:44.273010] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-09. [2025-10-02T18:29:44.783172] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-02T18:29:44.823980] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-02T18:29:45.073018] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-03. [2025-10-02T18:29:45.872978] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-01. [2025-10-02T18:29:46.170207] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-02T18:29:46.221724] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-02T18:29:46.258981] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-10 (4.38 seconds). [2025-10-02T18:29:46.261160] [INFO ] [REMOTE ] DOCS: Full fetch complete (74196 records). [2025-10-02T18:29:46.261281] [DEBUG] [VALIDATOR ] DOCS: Validating primary data. [2025-10-02T18:29:46.682348] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-04. [2025-10-02T18:29:46.710371] [DEBUG] [VALIDATOR ] DOCS: All expected trading days are present. [2025-10-02T18:29:46.710470] [DEBUG] [VALIDATOR ] DOCS: Primary data validation passed. [2025-10-02T18:29:46.711475] [INFO ] [MAIN ] DOCS: Fetched primary data is valid. [2025-10-02T18:29:46.711568] [DEBUG] [LOCAL ] DOCS: Saving primary data. [2025-10-02T18:29:46.713385] [DEBUG] [LOCAL ] DOCS: Trimmed 74196 records to 51492 (keeping 200 days of data) [2025-10-02T18:29:47.034216] [DEBUG] [LOCAL ] DOCS: Primary data saved (51492 records). [2025-10-02T18:29:47.034368] [INFO ] [MAIN ] DOCS: Full history saved. [2025-10-02T18:29:47.035395] [INFO ] [MAIN ] Update Progress: 643/2370 symbols completed. DOCS took 36.0s. Estimated remaining: 4h 0m 59s. Rate: 7.2 symbols/min [2025-10-02T18:29:47.223251] [INFO ] [MAIN ] DPG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:29:47.240932] [DEBUG] [LOCAL ] DPG: Loaded 13579 existing records from primary storage. [2025-10-02T18:29:47.241181] [INFO ] [MAIN ] DPG: Loaded 13579 existing records. [2025-10-02T18:29:47.456999] [WARN ] [MAIN ] DPG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:29:47.457537] [INFO ] [MAIN ] DPG: Wiping existing primary data before full refresh. [2025-10-02T18:29:47.457710] [INFO ] [LOCAL ] DPG: Starting deletion of primary data. [2025-10-02T18:29:47.458278] [DEBUG] [LOCAL ] DPG: Deleted primary data file. [2025-10-02T18:29:47.458340] [INFO ] [MAIN ] DPG: Starting full primary refresh. [2025-10-02T18:29:47.480958] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-10. [2025-10-02T18:29:47.877172] [INFO ] [REMOTE ] DPG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:29:47.909024] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-02T18:29:48.273083] [INFO ] [REMOTE ] DPG: Fetching primary data for 2024-12. [2025-10-02T18:29:48.580141] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-02T18:29:48.827346] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-02T18:29:48.830390] [INFO ] [REMOTE ] DOCN: Full fetch complete (71766 records). [2025-10-02T18:29:48.830548] [DEBUG] [VALIDATOR ] DOCN: Validating primary data. [2025-10-02T18:29:49.079067] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-02. [2025-10-02T18:29:49.297554] [DEBUG] [VALIDATOR ] DOCN: All expected trading days are present. [2025-10-02T18:29:49.297731] [DEBUG] [VALIDATOR ] DOCN: Primary data validation passed. [2025-10-02T18:29:49.299418] [INFO ] [MAIN ] DOCN: Fetched primary data is valid. [2025-10-02T18:29:49.299955] [DEBUG] [LOCAL ] DOCN: Saving primary data. [2025-10-02T18:29:49.299855] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-02T18:29:49.305140] [DEBUG] [LOCAL ] DOCN: Trimmed 71766 records to 50952 (keeping 200 days of data) [2025-10-02T18:29:49.614178] [DEBUG] [LOCAL ] DOCN: Primary data saved (50952 records). [2025-10-02T18:29:49.614315] [INFO ] [MAIN ] DOCN: Full history saved. [2025-10-02T18:29:49.614410] [INFO ] [MAIN ] Update Progress: 644/2370 symbols completed. DOCN took 38.6s. Estimated remaining: 4h 0m 35s. Rate: 7.2 symbols/min [2025-10-02T18:29:49.793444] [INFO ] [MAIN ] DQ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:29:49.793611] [DEBUG] [LOCAL ] DQ: No existing data file found in primary storage. [2025-10-02T18:29:49.793677] [WARN ] [MAIN ] DQ: No existing data found, performing full refresh instead. [2025-10-02T18:29:49.793861] [INFO ] [MAIN ] DQ: Wiping existing primary data before full refresh. [2025-10-02T18:29:49.793903] [INFO ] [LOCAL ] DQ: Starting deletion of primary data. [2025-10-02T18:29:49.793946] [DEBUG] [LOCAL ] DQ: No primary data file found to delete. [2025-10-02T18:29:49.793980] [INFO ] [MAIN ] DQ: Starting full primary refresh. [2025-10-02T18:29:49.878120] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-05. [2025-10-02T18:29:50.174711] [INFO ] [REMOTE ] DQ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:29:50.673065] [INFO ] [REMOTE ] DQ: Fetching primary data for 2024-12. [2025-10-02T18:29:50.728970] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-02T18:29:51.478148] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-03. [2025-10-02T18:29:51.494187] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-02T18:29:52.273008] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-06. [2025-10-02T18:29:52.361195] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-02T18:29:53.073026] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-01. [2025-10-02T18:29:53.322756] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-02T18:29:53.675207] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-02T18:29:53.838385] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-02T18:29:53.873036] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-02. [2025-10-02T18:29:54.318995] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-02T18:29:54.673061] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-03. [2025-10-02T18:29:55.280849] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-02T18:29:55.472999] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-04. [2025-10-02T18:29:56.272978] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-04. [2025-10-02T18:29:56.354810] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-02T18:29:57.073043] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-07. [2025-10-02T18:29:57.873007] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-05. [2025-10-02T18:29:58.603272] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-02T18:29:58.668879] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-10-02T18:29:58.672973] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-08. [2025-10-02T18:29:58.726423] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-02T18:29:59.473034] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-06. [2025-10-02T18:30:00.107736] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-02T18:30:00.273037] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-09. [2025-10-02T18:30:00.296702] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-02T18:30:01.073057] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-01. [2025-10-02T18:30:01.873080] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-05. [2025-10-02T18:30:01.953682] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-02T18:30:02.673035] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-10. [2025-10-02T18:30:03.167568] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-02T18:30:03.473022] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-02. [2025-10-02T18:30:03.882328] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-02T18:30:04.132520] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-02T18:30:04.134488] [INFO ] [REMOTE ] DOV: Full fetch complete (65229 records). [2025-10-02T18:30:04.134633] [DEBUG] [VALIDATOR ] DOV: Validating primary data. [2025-10-02T18:30:04.278134] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-06. [2025-10-02T18:30:04.575189] [DEBUG] [VALIDATOR ] DOV: All expected trading days are present. [2025-10-02T18:30:04.575275] [DEBUG] [VALIDATOR ] DOV: Primary data validation passed. [2025-10-02T18:30:04.576115] [INFO ] [MAIN ] DOV: Fetched primary data is valid. [2025-10-02T18:30:04.576183] [DEBUG] [LOCAL ] DOV: Saving primary data. [2025-10-02T18:30:04.577617] [DEBUG] [LOCAL ] DOV: Trimmed 65229 records to 45755 (keeping 200 days of data) [2025-10-02T18:30:04.850689] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-02T18:30:04.924817] [DEBUG] [LOCAL ] DOV: Primary data saved (45755 records). [2025-10-02T18:30:04.924967] [INFO ] [MAIN ] DOV: Full history saved. [2025-10-02T18:30:04.925055] [INFO ] [MAIN ] Update Progress: 645/2370 symbols completed. DOV took 29.3s. Estimated remaining: 4h 0m 45s. Rate: 7.2 symbols/min [2025-10-02T18:30:05.078295] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-07. [2025-10-02T18:30:05.113741] [INFO ] [MAIN ] DRD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:30:05.152962] [DEBUG] [LOCAL ] DRD: Loaded 36953 existing records from primary storage. [2025-10-02T18:30:05.153299] [INFO ] [MAIN ] DRD: Loaded 36953 existing records. [2025-10-02T18:30:05.350134] [WARN ] [MAIN ] DRD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:30:05.350431] [INFO ] [MAIN ] DRD: Wiping existing primary data before full refresh. [2025-10-02T18:30:05.350499] [INFO ] [LOCAL ] DRD: Starting deletion of primary data. [2025-10-02T18:30:05.351861] [DEBUG] [LOCAL ] DRD: Deleted primary data file. [2025-10-02T18:30:05.351924] [INFO ] [MAIN ] DRD: Starting full primary refresh. [2025-10-02T18:30:05.763907] [INFO ] [REMOTE ] DRD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:30:05.873018] [INFO ] [REMOTE ] DRD: Fetching primary data for 2024-12. [2025-10-02T18:30:06.119203] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-02T18:30:06.483772] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-10-02T18:30:06.673013] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-07. [2025-10-02T18:30:07.031866] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-02T18:30:07.473030] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-08. [2025-10-02T18:30:08.272997] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-01. [2025-10-02T18:30:08.411426] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-02T18:30:08.920737] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-02T18:30:09.073022] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-03. [2025-10-02T18:30:09.478154] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-02T18:30:09.873025] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-02. [2025-10-02T18:30:10.673017] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-08. [2025-10-02T18:30:10.727940] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-02T18:30:11.077731] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-02T18:30:11.473038] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-03. [2025-10-02T18:30:12.272974] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-09. [2025-10-02T18:30:12.323791] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-02T18:30:12.938669] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-02T18:30:13.073008] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-09. [2025-10-02T18:30:13.330414] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-02T18:30:13.873067] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-10. [2025-10-02T18:30:14.548837] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-02T18:30:14.550314] [INFO ] [REMOTE ] DPG: Full fetch complete (18961 records). [2025-10-02T18:30:14.550430] [DEBUG] [VALIDATOR ] DPG: Validating primary data. [2025-10-02T18:30:14.550987] [FATAL] [VALIDATOR ] DPG: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:30:14.551107] [FATAL] [MAIN ] DPG: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:30:14.551153] [WARN ] [MAIN ] DPG: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:30:14.551204] [INFO ] [LOCAL ] DPG: Starting deletion of primary data. [2025-10-02T18:30:14.551307] [DEBUG] [LOCAL ] DPG: No primary data file found to delete. [2025-10-02T18:30:14.551361] [INFO ] [LOCAL ] DPG: Starting deletion of derivative data. [2025-10-02T18:30:14.552248] [DEBUG] [LOCAL ] DPG: Deleted derivative data file. [2025-10-02T18:30:14.552348] [INFO ] [MAIN ] Update Progress: 646/2370 symbols completed. DPG took 27.5s. Estimated remaining: 4h 0m 40s. Rate: 7.2 symbols/min [2025-10-02T18:30:14.678092] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-04. [2025-10-02T18:30:14.768155] [INFO ] [MAIN ] DRH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:30:14.820301] [DEBUG] [LOCAL ] DRH: Loaded 50489 existing records from primary storage. [2025-10-02T18:30:14.820736] [INFO ] [MAIN ] DRH: Loaded 50489 existing records. [2025-10-02T18:30:15.033467] [WARN ] [MAIN ] DRH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:30:15.033746] [INFO ] [MAIN ] DRH: Wiping existing primary data before full refresh. [2025-10-02T18:30:15.033803] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-10-02T18:30:15.035509] [DEBUG] [LOCAL ] DRH: Deleted primary data file. [2025-10-02T18:30:15.035573] [INFO ] [MAIN ] DRH: Starting full primary refresh. [2025-10-02T18:30:15.437055] [INFO ] [REMOTE ] DRH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:30:15.472313] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-10-02T18:30:15.479971] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-04. [2025-10-02T18:30:16.272965] [INFO ] [REMOTE ] DRH: Fetching primary data for 2024-12. [2025-10-02T18:30:16.299145] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-02T18:30:17.012868] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-02T18:30:17.073043] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-05. [2025-10-02T18:30:17.707312] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-02T18:30:17.873000] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-05. [2025-10-02T18:30:18.430200] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-02T18:30:18.673006] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-10. [2025-10-02T18:30:19.320875] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-02T18:30:19.473010] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-06. [2025-10-02T18:30:20.273035] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-06. [2025-10-02T18:30:20.573874] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-02T18:30:20.611252] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-02T18:30:20.613845] [INFO ] [REMOTE ] DOW: Full fetch complete (77791 records). [2025-10-02T18:30:20.613972] [DEBUG] [VALIDATOR ] DOW: Validating primary data. [2025-10-02T18:30:21.040524] [DEBUG] [VALIDATOR ] DOW: All expected trading days are present. [2025-10-02T18:30:21.040611] [DEBUG] [VALIDATOR ] DOW: Primary data validation passed. [2025-10-02T18:30:21.041607] [INFO ] [MAIN ] DOW: Fetched primary data is valid. [2025-10-02T18:30:21.041701] [DEBUG] [LOCAL ] DOW: Saving primary data. [2025-10-02T18:30:21.043270] [DEBUG] [LOCAL ] DOW: Trimmed 77791 records to 54123 (keeping 200 days of data) [2025-10-02T18:30:21.100791] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-01. [2025-10-02T18:30:21.397686] [DEBUG] [LOCAL ] DOW: Primary data saved (54123 records). [2025-10-02T18:30:21.397842] [INFO ] [MAIN ] DOW: Full history saved. [2025-10-02T18:30:21.397929] [INFO ] [MAIN ] Update Progress: 647/2370 symbols completed. DOW took 40.4s. Estimated remaining: 4h 0m 27s. Rate: 7.2 symbols/min [2025-10-02T18:30:21.593623] [INFO ] [MAIN ] DRI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:30:21.593895] [DEBUG] [LOCAL ] DRI: No existing data file found in primary storage. [2025-10-02T18:30:21.594001] [WARN ] [MAIN ] DRI: No existing data found, performing full refresh instead. [2025-10-02T18:30:21.594177] [INFO ] [MAIN ] DRI: Wiping existing primary data before full refresh. [2025-10-02T18:30:21.594333] [INFO ] [LOCAL ] DRI: Starting deletion of primary data. [2025-10-02T18:30:21.594394] [DEBUG] [LOCAL ] DRI: No primary data file found to delete. [2025-10-02T18:30:21.594433] [INFO ] [MAIN ] DRI: Starting full primary refresh. [2025-10-02T18:30:21.881594] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-07. [2025-10-02T18:30:21.911123] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-02T18:30:22.092815] [INFO ] [REMOTE ] DRI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:30:22.673032] [INFO ] [REMOTE ] DRI: Fetching primary data for 2024-12. [2025-10-02T18:30:23.446176] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-02T18:30:23.472993] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-08. [2025-10-02T18:30:24.273028] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-07. [2025-10-02T18:30:24.511675] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-02T18:30:25.073015] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-01. [2025-10-02T18:30:25.111740] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-01 (4.01 seconds). [2025-10-02T18:30:25.432280] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-02T18:30:25.872995] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-09. [2025-10-02T18:30:26.039604] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-02T18:30:26.672981] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-08. [2025-10-02T18:30:26.804777] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-02T18:30:27.358758] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-02T18:30:27.473005] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-10. [2025-10-02T18:30:28.273001] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-02. [2025-10-02T18:30:28.609567] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-02T18:30:28.846843] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-02T18:30:28.848267] [INFO ] [REMOTE ] DRD: Full fetch complete (49583 records). [2025-10-02T18:30:28.848377] [DEBUG] [VALIDATOR ] DRD: Validating primary data. [2025-10-02T18:30:28.849111] [FATAL] [VALIDATOR ] DRD: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:30:28.849208] [FATAL] [MAIN ] DRD: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:30:28.849253] [WARN ] [MAIN ] DRD: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:30:28.849294] [INFO ] [LOCAL ] DRD: Starting deletion of primary data. [2025-10-02T18:30:28.849353] [DEBUG] [LOCAL ] DRD: No primary data file found to delete. [2025-10-02T18:30:28.849390] [INFO ] [LOCAL ] DRD: Starting deletion of derivative data. [2025-10-02T18:30:28.849808] [DEBUG] [LOCAL ] DRD: Deleted derivative data file. [2025-10-02T18:30:28.849915] [INFO ] [MAIN ] Update Progress: 648/2370 symbols completed. DRD took 23.9s. Estimated remaining: 4h 0m 17s. Rate: 7.2 symbols/min [2025-10-02T18:30:29.043296] [INFO ] [MAIN ] DRLL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:30:29.055346] [DEBUG] [LOCAL ] DRLL: Loaded 9443 existing records from primary storage. [2025-10-02T18:30:29.055598] [INFO ] [MAIN ] DRLL: Loaded 9443 existing records. [2025-10-02T18:30:29.079011] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-09. [2025-10-02T18:30:29.251793] [WARN ] [MAIN ] DRLL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:30:29.251999] [INFO ] [MAIN ] DRLL: Wiping existing primary data before full refresh. [2025-10-02T18:30:29.252049] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-10-02T18:30:29.252436] [DEBUG] [LOCAL ] DRLL: Deleted primary data file. [2025-10-02T18:30:29.252498] [INFO ] [MAIN ] DRLL: Starting full primary refresh. [2025-10-02T18:30:29.637980] [INFO ] [REMOTE ] DRLL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:30:29.667350] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-02T18:30:29.873018] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2024-12. [2025-10-02T18:30:30.673004] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-02. [2025-10-02T18:30:30.919372] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-02T18:30:30.964432] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-02T18:30:31.472986] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-01. [2025-10-02T18:30:32.143667] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-02T18:30:32.264950] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-02T18:30:32.272942] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-02. [2025-10-02T18:30:33.073024] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-03. [2025-10-02T18:30:33.100809] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-02T18:30:33.873006] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-03. [2025-10-02T18:30:34.449708] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-02T18:30:34.673016] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-04. [2025-10-02T18:30:34.853158] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-02T18:30:35.472997] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-10. [2025-10-02T18:30:36.272990] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-04. [2025-10-02T18:30:36.448245] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-02T18:30:36.884464] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-02T18:30:36.886851] [INFO ] [REMOTE ] DQ: Full fetch complete (63085 records). [2025-10-02T18:30:36.886978] [DEBUG] [VALIDATOR ] DQ: Validating primary data. [2025-10-02T18:30:37.080056] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-05. [2025-10-02T18:30:37.234494] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-02T18:30:37.326175] [DEBUG] [VALIDATOR ] DQ: All expected trading days are present. [2025-10-02T18:30:37.326265] [DEBUG] [VALIDATOR ] DQ: Primary data validation passed. [2025-10-02T18:30:37.327102] [INFO ] [MAIN ] DQ: Fetched primary data is valid. [2025-10-02T18:30:37.327170] [DEBUG] [LOCAL ] DQ: Saving primary data. [2025-10-02T18:30:37.329263] [DEBUG] [LOCAL ] DQ: Trimmed 63085 records to 43712 (keeping 200 days of data) [2025-10-02T18:30:37.595421] [DEBUG] [LOCAL ] DQ: Primary data saved (43712 records). [2025-10-02T18:30:37.595597] [INFO ] [MAIN ] DQ: Full history saved. [2025-10-02T18:30:37.595721] [INFO ] [MAIN ] Update Progress: 649/2370 symbols completed. DQ took 48.0s. Estimated remaining: 4h 0m 9s. Rate: 7.2 symbols/min [2025-10-02T18:30:37.849840] [INFO ] [MAIN ] DSL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:30:37.873136] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-05. [2025-10-02T18:30:37.890786] [DEBUG] [LOCAL ] DSL: Loaded 28410 existing records from primary storage. [2025-10-02T18:30:37.891135] [INFO ] [MAIN ] DSL: Loaded 28410 existing records. [2025-10-02T18:30:38.133400] [WARN ] [MAIN ] DSL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:30:38.133617] [INFO ] [MAIN ] DSL: Wiping existing primary data before full refresh. [2025-10-02T18:30:38.133707] [INFO ] [LOCAL ] DSL: Starting deletion of primary data. [2025-10-02T18:30:38.134708] [DEBUG] [LOCAL ] DSL: Deleted primary data file. [2025-10-02T18:30:38.134770] [INFO ] [MAIN ] DSL: Starting full primary refresh. [2025-10-02T18:30:38.527492] [INFO ] [REMOTE ] DSL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:30:38.626894] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-02T18:30:38.672984] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-06. [2025-10-02T18:30:38.875584] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-02T18:30:39.444204] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-02T18:30:39.472997] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-07. [2025-10-02T18:30:40.272997] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-06. [2025-10-02T18:30:40.299988] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-02T18:30:41.072998] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-08. [2025-10-02T18:30:41.753511] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-02T18:30:41.873016] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-07. [2025-10-02T18:30:41.918721] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-02T18:30:42.673070] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-03. [2025-10-02T18:30:43.473045] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-09. [2025-10-02T18:30:43.676070] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-02T18:30:44.024629] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-02T18:30:44.273008] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-10. [2025-10-02T18:30:44.442559] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-02T18:30:44.853036] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-02T18:30:44.854162] [INFO ] [REMOTE ] DRLL: Full fetch complete (15377 records). [2025-10-02T18:30:44.854273] [DEBUG] [VALIDATOR ] DRLL: Validating primary data. [2025-10-02T18:30:45.083123] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-08. [2025-10-02T18:30:45.254539] [DEBUG] [VALIDATOR ] DRLL: All expected trading days are present. [2025-10-02T18:30:45.254620] [DEBUG] [VALIDATOR ] DRLL: Primary data validation passed. [2025-10-02T18:30:45.255034] [INFO ] [MAIN ] DRLL: Fetched primary data is valid. [2025-10-02T18:30:45.255095] [DEBUG] [LOCAL ] DRLL: Saving primary data. [2025-10-02T18:30:45.255636] [DEBUG] [LOCAL ] DRLL: Trimmed 15377 records to 9485 (keeping 200 days of data) [2025-10-02T18:30:45.314270] [DEBUG] [LOCAL ] DRLL: Primary data saved (9485 records). [2025-10-02T18:30:45.314412] [INFO ] [MAIN ] DRLL: Full history saved. [2025-10-02T18:30:45.314498] [INFO ] [MAIN ] Update Progress: 650/2370 symbols completed. DRLL took 16.5s. Estimated remaining: 3h 59m 59s. Rate: 7.2 symbols/min [2025-10-02T18:30:45.498498] [INFO ] [MAIN ] DSM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:30:45.498752] [DEBUG] [LOCAL ] DSM: No existing data file found in primary storage. [2025-10-02T18:30:45.498803] [WARN ] [MAIN ] DSM: No existing data found, performing full refresh instead. [2025-10-02T18:30:45.498932] [INFO ] [MAIN ] DSM: Wiping existing primary data before full refresh. [2025-10-02T18:30:45.498988] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-10-02T18:30:45.499034] [DEBUG] [LOCAL ] DSM: No primary data file found to delete. [2025-10-02T18:30:45.499070] [INFO ] [MAIN ] DSM: Starting full primary refresh. [2025-10-02T18:30:45.882160] [INFO ] [REMOTE ] DSL: Fetching primary data for 2024-12. [2025-10-02T18:30:45.888109] [INFO ] [REMOTE ] DSM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:30:46.672979] [INFO ] [REMOTE ] DSM: Fetching primary data for 2024-12. [2025-10-02T18:30:46.795091] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-02T18:30:47.320679] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-02T18:30:47.472955] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-01. [2025-10-02T18:30:47.857197] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-02T18:30:48.272995] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-04. [2025-10-02T18:30:48.351359] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-02T18:30:49.073017] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-01. [2025-10-02T18:30:49.872970] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-09. [2025-10-02T18:30:50.047896] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-02T18:30:50.195196] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-02T18:30:50.673007] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-02. [2025-10-02T18:30:51.473019] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-05. [2025-10-02T18:30:51.518984] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-02T18:30:51.988539] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-02T18:30:52.273014] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-02. [2025-10-02T18:30:53.072984] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-10. [2025-10-02T18:30:53.121868] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-02T18:30:53.327914] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-02T18:30:53.873076] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-03. [2025-10-02T18:30:54.484862] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-02T18:30:54.487863] [INFO ] [REMOTE ] DRH: Full fetch complete (71881 records). [2025-10-02T18:30:54.488098] [DEBUG] [VALIDATOR ] DRH: Validating primary data. [2025-10-02T18:30:54.678343] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-03. [2025-10-02T18:30:54.795427] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-02T18:30:55.153174] [DEBUG] [VALIDATOR ] DRH: All expected trading days are present. [2025-10-02T18:30:55.153315] [DEBUG] [VALIDATOR ] DRH: Primary data validation passed. [2025-10-02T18:30:55.154295] [INFO ] [MAIN ] DRH: Fetched primary data is valid. [2025-10-02T18:30:55.154364] [DEBUG] [LOCAL ] DRH: Saving primary data. [2025-10-02T18:30:55.155965] [DEBUG] [LOCAL ] DRH: Trimmed 71881 records to 50844 (keeping 200 days of data) [2025-10-02T18:30:55.486053] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-04. [2025-10-02T18:30:55.512671] [DEBUG] [LOCAL ] DRH: Primary data saved (50844 records). [2025-10-02T18:30:55.512847] [INFO ] [MAIN ] DRH: Full history saved. [2025-10-02T18:30:55.513731] [INFO ] [MAIN ] Update Progress: 651/2370 symbols completed. DRH took 41.0s. Estimated remaining: 3h 59m 55s. Rate: 7.2 symbols/min [2025-10-02T18:30:55.740961] [INFO ] [MAIN ] DSMC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:30:55.742524] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-02T18:30:55.753372] [DEBUG] [LOCAL ] DSMC: Loaded 1887 existing records from primary storage. [2025-10-02T18:30:55.753592] [INFO ] [MAIN ] DSMC: Loaded 1887 existing records. [2025-10-02T18:30:55.953302] [WARN ] [MAIN ] DSMC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:30:55.953513] [INFO ] [MAIN ] DSMC: Wiping existing primary data before full refresh. [2025-10-02T18:30:55.953565] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-10-02T18:30:55.953926] [DEBUG] [LOCAL ] DSMC: Deleted primary data file. [2025-10-02T18:30:55.953986] [INFO ] [MAIN ] DSMC: Starting full primary refresh. [2025-10-02T18:30:56.278377] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-04. [2025-10-02T18:30:56.366541] [INFO ] [REMOTE ] DSMC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:30:56.576791] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-02T18:30:57.073043] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-05. [2025-10-02T18:30:57.813094] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-02T18:30:57.828270] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-02T18:30:57.872986] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-06. [2025-10-02T18:30:58.441174] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-02T18:30:58.672994] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-07. [2025-10-02T18:30:59.472973] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2024-12. [2025-10-02T18:30:59.606108] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-02T18:30:59.864839] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-10-02T18:31:00.273014] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-05. [2025-10-02T18:31:01.073069] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-08. [2025-10-02T18:31:01.213081] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-02T18:31:01.597527] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-02T18:31:01.873051] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-01. [2025-10-02T18:31:02.343139] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-02T18:31:02.673001] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-02. [2025-10-02T18:31:03.106003] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-02T18:31:03.473056] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-03. [2025-10-02T18:31:03.781260] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-02T18:31:04.273001] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-09. [2025-10-02T18:31:04.919481] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-02T18:31:05.072936] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-10. [2025-10-02T18:31:05.799734] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-02T18:31:05.800779] [INFO ] [REMOTE ] DSM: Full fetch complete (24532 records). [2025-10-02T18:31:05.800858] [DEBUG] [VALIDATOR ] DSM: Validating primary data. [2025-10-02T18:31:05.878165] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-06. [2025-10-02T18:31:06.254911] [DEBUG] [VALIDATOR ] DSM: All expected trading days are present. [2025-10-02T18:31:06.254999] [DEBUG] [VALIDATOR ] DSM: Primary data validation passed. [2025-10-02T18:31:06.255454] [INFO ] [MAIN ] DSM: Fetched primary data is valid. [2025-10-02T18:31:06.255496] [DEBUG] [LOCAL ] DSM: Saving primary data. [2025-10-02T18:31:06.256354] [DEBUG] [LOCAL ] DSM: Trimmed 24532 records to 15196 (keeping 200 days of data) [2025-10-02T18:31:06.348286] [DEBUG] [LOCAL ] DSM: Primary data saved (15196 records). [2025-10-02T18:31:06.348435] [INFO ] [MAIN ] DSM: Full history saved. [2025-10-02T18:31:06.348513] [INFO ] [MAIN ] Update Progress: 652/2370 symbols completed. DSM took 21.0s. Estimated remaining: 3h 59m 54s. Rate: 7.2 symbols/min [2025-10-02T18:31:06.535917] [INFO ] [MAIN ] DSU: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:31:06.559727] [DEBUG] [LOCAL ] DSU: Loaded 22542 existing records from primary storage. [2025-10-02T18:31:06.559994] [INFO ] [MAIN ] DSU: Loaded 22542 existing records. [2025-10-02T18:31:06.680684] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-06. [2025-10-02T18:31:06.806502] [WARN ] [MAIN ] DSU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:31:06.806835] [INFO ] [MAIN ] DSU: Wiping existing primary data before full refresh. [2025-10-02T18:31:06.806942] [INFO ] [LOCAL ] DSU: Starting deletion of primary data. [2025-10-02T18:31:06.807881] [DEBUG] [LOCAL ] DSU: Deleted primary data file. [2025-10-02T18:31:06.821944] [INFO ] [MAIN ] DSU: Starting full primary refresh. [2025-10-02T18:31:06.851715] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-02T18:31:07.254932] [INFO ] [REMOTE ] DSU: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:31:07.472999] [INFO ] [REMOTE ] DSU: Fetching primary data for 2024-12. [2025-10-02T18:31:08.272991] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-04. [2025-10-02T18:31:08.484144] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-02T18:31:08.541701] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-02T18:31:08.592116] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-02T18:31:09.073014] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-07. [2025-10-02T18:31:09.873031] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-05. [2025-10-02T18:31:10.405397] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-02T18:31:10.673009] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-07. [2025-10-02T18:31:10.791877] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-02T18:31:11.473002] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-08. [2025-10-02T18:31:12.120336] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-02T18:31:12.273033] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-08. [2025-10-02T18:31:12.589260] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-02T18:31:13.073014] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-01. [2025-10-02T18:31:13.433588] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-02T18:31:13.873002] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-09. [2025-10-02T18:31:14.199086] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-02T18:31:14.673038] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-09. [2025-10-02T18:31:15.015067] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-02T18:31:15.473008] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-06. [2025-10-02T18:31:15.828054] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-02T18:31:16.273010] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-07. [2025-10-02T18:31:16.418831] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-02T18:31:16.709180] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-02T18:31:17.073019] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-10. [2025-10-02T18:31:17.872998] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-10. [2025-10-02T18:31:18.567614] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-02T18:31:18.569829] [INFO ] [REMOTE ] DRI: Full fetch complete (69616 records). [2025-10-02T18:31:18.570006] [DEBUG] [VALIDATOR ] DRI: Validating primary data. [2025-10-02T18:31:18.682229] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-02. [2025-10-02T18:31:18.959521] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-02T18:31:18.982340] [INFO ] [REMOTE ] DSL: Full fetch complete (41459 records). [2025-10-02T18:31:19.002760] [DEBUG] [VALIDATOR ] DSL: Validating primary data. [2025-10-02T18:31:19.187626] [DEBUG] [VALIDATOR ] DRI: All expected trading days are present. [2025-10-02T18:31:19.192573] [DEBUG] [VALIDATOR ] DRI: Primary data validation passed. [2025-10-02T18:31:19.193577] [INFO ] [MAIN ] DRI: Fetched primary data is valid. [2025-10-02T18:31:19.194003] [DEBUG] [LOCAL ] DRI: Saving primary data. [2025-10-02T18:31:19.260066] [DEBUG] [LOCAL ] DRI: Trimmed 69616 records to 48135 (keeping 200 days of data) [2025-10-02T18:31:19.483194] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-08. [2025-10-02T18:31:19.624536] [DEBUG] [VALIDATOR ] DSL: All expected trading days are present. [2025-10-02T18:31:19.625004] [DEBUG] [VALIDATOR ] DSL: Primary data validation passed. [2025-10-02T18:31:19.626113] [INFO ] [MAIN ] DSL: Fetched primary data is valid. [2025-10-02T18:31:19.626204] [DEBUG] [LOCAL ] DSL: Saving primary data. [2025-10-02T18:31:19.631170] [DEBUG] [LOCAL ] DSL: Trimmed 41459 records to 28612 (keeping 200 days of data) [2025-10-02T18:31:19.904861] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-02T18:31:19.992938] [DEBUG] [LOCAL ] DSL: Primary data saved (28612 records). [2025-10-02T18:31:19.994515] [INFO ] [MAIN ] DSL: Full history saved. [2025-10-02T18:31:19.994976] [INFO ] [MAIN ] Update Progress: 653/2370 symbols completed. DSL took 42.4s. Estimated remaining: 3h 59m 59s. Rate: 7.2 symbols/min [2025-10-02T18:31:20.060253] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-02T18:31:20.261205] [INFO ] [MAIN ] DSX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:31:20.273058] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-03. [2025-10-02T18:31:20.287822] [DEBUG] [LOCAL ] DRI: Primary data saved (48135 records). [2025-10-02T18:31:20.288366] [INFO ] [MAIN ] DRI: Full history saved. [2025-10-02T18:31:20.288469] [INFO ] [MAIN ] Update Progress: 654/2370 symbols completed. DRI took 58.9s. Estimated remaining: 3h 59m 29s. Rate: 7.2 symbols/min [2025-10-02T18:31:20.367262] [DEBUG] [LOCAL ] DSX: Loaded 24050 existing records from primary storage. [2025-10-02T18:31:20.390972] [INFO ] [MAIN ] DSX: Loaded 24050 existing records. [2025-10-02T18:31:20.643042] [INFO ] [MAIN ] DT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:31:20.760515] [WARN ] [MAIN ] DSX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:31:20.760917] [INFO ] [MAIN ] DSX: Wiping existing primary data before full refresh. [2025-10-02T18:31:20.760976] [INFO ] [LOCAL ] DSX: Starting deletion of primary data. [2025-10-02T18:31:20.761926] [DEBUG] [LOCAL ] DSX: Deleted primary data file. [2025-10-02T18:31:20.761999] [INFO ] [MAIN ] DSX: Starting full primary refresh. [2025-10-02T18:31:21.000859] [DEBUG] [LOCAL ] DT: Loaded 52927 existing records from primary storage. [2025-10-02T18:31:21.075361] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-09. [2025-10-02T18:31:21.062347] [INFO ] [MAIN ] DT: Loaded 52927 existing records. [2025-10-02T18:31:21.382571] [INFO ] [REMOTE ] DSX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:31:21.428509] [WARN ] [MAIN ] DT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:31:21.428843] [INFO ] [MAIN ] DT: Wiping existing primary data before full refresh. [2025-10-02T18:31:21.428975] [INFO ] [LOCAL ] DT: Starting deletion of primary data. [2025-10-02T18:31:21.435822] [DEBUG] [LOCAL ] DT: Deleted primary data file. [2025-10-02T18:31:21.440252] [INFO ] [MAIN ] DT: Starting full primary refresh. [2025-10-02T18:31:21.503493] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-02T18:31:21.726335] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-02T18:31:21.836724] [INFO ] [REMOTE ] DT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:31:21.873008] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-10. [2025-10-02T18:31:22.247321] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-02T18:31:22.248150] [INFO ] [REMOTE ] DSMC: Full fetch complete (2880 records). [2025-10-02T18:31:22.248241] [DEBUG] [VALIDATOR ] DSMC: Validating primary data. [2025-10-02T18:31:22.248707] [FATAL] [VALIDATOR ] DSMC: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:31:22.248796] [FATAL] [MAIN ] DSMC: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:31:22.248926] [WARN ] [MAIN ] DSMC: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:31:22.249008] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-10-02T18:31:22.249073] [DEBUG] [LOCAL ] DSMC: No primary data file found to delete. [2025-10-02T18:31:22.249111] [INFO ] [LOCAL ] DSMC: Starting deletion of derivative data. [2025-10-02T18:31:22.249382] [DEBUG] [LOCAL ] DSMC: Deleted derivative data file. [2025-10-02T18:31:22.249488] [INFO ] [MAIN ] Update Progress: 655/2370 symbols completed. DSMC took 26.7s. Estimated remaining: 3h 59m 4s. Rate: 7.2 symbols/min [2025-10-02T18:31:22.445870] [INFO ] [MAIN ] DTB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:31:22.454502] [DEBUG] [LOCAL ] DTB: Loaded 4913 existing records from primary storage. [2025-10-02T18:31:22.454784] [INFO ] [MAIN ] DTB: Loaded 4913 existing records. [2025-10-02T18:31:22.652292] [WARN ] [MAIN ] DTB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:31:22.652533] [INFO ] [MAIN ] DTB: Wiping existing primary data before full refresh. [2025-10-02T18:31:22.652581] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-10-02T18:31:22.652951] [DEBUG] [LOCAL ] DTB: Deleted primary data file. [2025-10-02T18:31:22.653042] [INFO ] [MAIN ] DTB: Starting full primary refresh. [2025-10-02T18:31:22.678136] [INFO ] [REMOTE ] DSX: Fetching primary data for 2024-12. [2025-10-02T18:31:23.048283] [INFO ] [REMOTE ] DTB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:31:23.472998] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-04. [2025-10-02T18:31:24.272989] [INFO ] [REMOTE ] DT: Fetching primary data for 2024-12. [2025-10-02T18:31:24.394161] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-02T18:31:24.422403] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-02T18:31:25.073001] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-01. [2025-10-02T18:31:25.873010] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-05. [2025-10-02T18:31:26.112899] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-02T18:31:26.303762] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-02T18:31:26.673014] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-02. [2025-10-02T18:31:26.899442] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-02T18:31:27.473005] [INFO ] [REMOTE ] DTB: Fetching primary data for 2024-12. [2025-10-02T18:31:27.806814] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-02T18:31:28.155240] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-02T18:31:28.272997] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-01. [2025-10-02T18:31:29.072996] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-06. [2025-10-02T18:31:29.846108] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-02T18:31:29.872994] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-03. [2025-10-02T18:31:30.191434] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-02T18:31:30.673012] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-02. [2025-10-02T18:31:31.215905] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-02T18:31:31.473015] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-04. [2025-10-02T18:31:32.283264] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-01. [2025-10-02T18:31:32.313008] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-02T18:31:32.723546] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-02T18:31:32.869391] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-02T18:31:33.073005] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-05. [2025-10-02T18:31:33.872994] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-03. [2025-10-02T18:31:34.025703] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-02T18:31:34.673002] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-06. [2025-10-02T18:31:35.472991] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-07. [2025-10-02T18:31:35.683073] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-02T18:31:35.712498] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-02T18:31:36.273000] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-04. [2025-10-02T18:31:36.725860] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-02T18:31:37.073004] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-07. [2025-10-02T18:31:37.872969] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-08. [2025-10-02T18:31:37.913354] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-02T18:31:38.070857] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-02T18:31:38.672995] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-05. [2025-10-02T18:31:38.915828] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-02T18:31:39.473016] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-09. [2025-10-02T18:31:40.272985] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-02. [2025-10-02T18:31:40.584062] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-02T18:31:40.864197] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-02T18:31:40.946189] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-02T18:31:41.073042] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-10. [2025-10-02T18:31:41.872992] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-08. [2025-10-02T18:31:42.030438] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-02T18:31:42.031851] [INFO ] [REMOTE ] DSU: Full fetch complete (32822 records). [2025-10-02T18:31:42.031950] [DEBUG] [VALIDATOR ] DSU: Validating primary data. [2025-10-02T18:31:42.474456] [DEBUG] [VALIDATOR ] DSU: All expected trading days are present. [2025-10-02T18:31:42.474537] [DEBUG] [VALIDATOR ] DSU: Primary data validation passed. [2025-10-02T18:31:42.475118] [INFO ] [MAIN ] DSU: Fetched primary data is valid. [2025-10-02T18:31:42.475181] [DEBUG] [LOCAL ] DSU: Saving primary data. [2025-10-02T18:31:42.476025] [DEBUG] [LOCAL ] DSU: Trimmed 32822 records to 22729 (keeping 200 days of data) [2025-10-02T18:31:42.628261] [DEBUG] [LOCAL ] DSU: Primary data saved (22729 records). [2025-10-02T18:31:42.628407] [INFO ] [MAIN ] DSU: Full history saved. [2025-10-02T18:31:42.628493] [INFO ] [MAIN ] Update Progress: 656/2370 symbols completed. DSU took 36.3s. Estimated remaining: 3h 59m 27s. Rate: 7.2 symbols/min [2025-10-02T18:31:42.676898] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-06. [2025-10-02T18:31:42.827073] [INFO ] [MAIN ] DTE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:31:42.875118] [DEBUG] [LOCAL ] DTE: Loaded 47740 existing records from primary storage. [2025-10-02T18:31:42.880777] [INFO ] [MAIN ] DTE: Loaded 47740 existing records. [2025-10-02T18:31:42.950927] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-02T18:31:43.088106] [WARN ] [MAIN ] DTE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:31:43.088351] [INFO ] [MAIN ] DTE: Wiping existing primary data before full refresh. [2025-10-02T18:31:43.088410] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-10-02T18:31:43.089975] [DEBUG] [LOCAL ] DTE: Deleted primary data file. [2025-10-02T18:31:43.090038] [INFO ] [MAIN ] DTE: Starting full primary refresh. [2025-10-02T18:31:43.475843] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-03. [2025-10-02T18:31:43.490165] [INFO ] [REMOTE ] DTE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:31:44.082899] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-02T18:31:44.273003] [INFO ] [REMOTE ] DTE: Fetching primary data for 2024-12. [2025-10-02T18:31:44.370261] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-02T18:31:45.073035] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-09. [2025-10-02T18:31:45.873015] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-07. [2025-10-02T18:31:46.083813] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-02T18:31:46.137614] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-02T18:31:46.672999] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-10. [2025-10-02T18:31:47.484815] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-04. [2025-10-02T18:31:47.514091] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-02T18:31:47.515871] [INFO ] [REMOTE ] DSX: Full fetch complete (36519 records). [2025-10-02T18:31:47.519030] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-02T18:31:47.519281] [DEBUG] [VALIDATOR ] DSX: Validating primary data. [2025-10-02T18:31:48.024473] [DEBUG] [VALIDATOR ] DSX: All expected trading days are present. [2025-10-02T18:31:48.024666] [DEBUG] [VALIDATOR ] DSX: Primary data validation passed. [2025-10-02T18:31:48.025269] [INFO ] [MAIN ] DSX: Fetched primary data is valid. [2025-10-02T18:31:48.025315] [DEBUG] [LOCAL ] DSX: Saving primary data. [2025-10-02T18:31:48.026368] [DEBUG] [LOCAL ] DSX: Trimmed 36519 records to 24147 (keeping 200 days of data) [2025-10-02T18:31:48.089575] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-02T18:31:48.178025] [DEBUG] [LOCAL ] DSX: Primary data saved (24147 records). [2025-10-02T18:31:48.178174] [INFO ] [MAIN ] DSX: Full history saved. [2025-10-02T18:31:48.178274] [INFO ] [MAIN ] Update Progress: 657/2370 symbols completed. DSX took 28.2s. Estimated remaining: 3h 59m 12s. Rate: 7.2 symbols/min [2025-10-02T18:31:48.278089] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-01. [2025-10-02T18:31:48.372692] [INFO ] [MAIN ] DTF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:31:48.372882] [DEBUG] [LOCAL ] DTF: No existing data file found in primary storage. [2025-10-02T18:31:48.372948] [WARN ] [MAIN ] DTF: No existing data found, performing full refresh instead. [2025-10-02T18:31:48.373078] [INFO ] [MAIN ] DTF: Wiping existing primary data before full refresh. [2025-10-02T18:31:48.373129] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-02T18:31:48.373183] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-02T18:31:48.373224] [INFO ] [MAIN ] DTF: Starting full primary refresh. [2025-10-02T18:31:48.770301] [INFO ] [REMOTE ] DTF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:31:49.073024] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-05. [2025-10-02T18:31:49.700098] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-02T18:31:49.863443] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-02T18:31:49.873023] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-06. [2025-10-02T18:31:50.331810] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-02T18:31:50.673017] [INFO ] [REMOTE ] DTF: Fetching primary data for 2024-12. [2025-10-02T18:31:51.392601] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-02T18:31:51.473030] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-02. [2025-10-02T18:31:52.273017] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-07. [2025-10-02T18:31:52.917152] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-02T18:31:52.995454] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-02T18:31:53.073028] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-03. [2025-10-02T18:31:53.873002] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-08. [2025-10-02T18:31:54.675390] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-08. [2025-10-02T18:31:54.681593] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-02T18:31:54.708491] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-02T18:31:55.473017] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-01. [2025-10-02T18:31:55.777830] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-01 (0.30 seconds). [2025-10-02T18:31:56.030884] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-02T18:31:56.273079] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-02. [2025-10-02T18:31:56.638487] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-02T18:31:57.073012] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-09. [2025-10-02T18:31:57.729569] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-02T18:31:57.873009] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-10. [2025-10-02T18:31:58.363954] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-02T18:31:58.364785] [INFO ] [REMOTE ] DTB: Full fetch complete (6864 records). [2025-10-02T18:31:58.364861] [DEBUG] [VALIDATOR ] DTB: Validating primary data. [2025-10-02T18:31:58.678091] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-09. [2025-10-02T18:31:58.754262] [DEBUG] [VALIDATOR ] DTB: All expected trading days are present. [2025-10-02T18:31:58.754343] [DEBUG] [VALIDATOR ] DTB: Primary data validation passed. [2025-10-02T18:31:58.754533] [INFO ] [MAIN ] DTB: Fetched primary data is valid. [2025-10-02T18:31:58.754576] [DEBUG] [LOCAL ] DTB: Saving primary data. [2025-10-02T18:31:58.755005] [DEBUG] [LOCAL ] DTB: Trimmed 6864 records to 4947 (keeping 200 days of data) [2025-10-02T18:31:58.788806] [DEBUG] [LOCAL ] DTB: Primary data saved (4947 records). [2025-10-02T18:31:58.788987] [INFO ] [MAIN ] DTB: Full history saved. [2025-10-02T18:31:58.789126] [INFO ] [MAIN ] Update Progress: 658/2370 symbols completed. DTB took 36.5s. Estimated remaining: 3h 59m 9s. Rate: 7.2 symbols/min [2025-10-02T18:31:58.975815] [INFO ] [MAIN ] DTG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:31:58.984728] [DEBUG] [LOCAL ] DTG: Loaded 5956 existing records from primary storage. [2025-10-02T18:31:58.984982] [INFO ] [MAIN ] DTG: Loaded 5956 existing records. [2025-10-02T18:31:59.188705] [WARN ] [MAIN ] DTG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:31:59.188929] [INFO ] [MAIN ] DTG: Wiping existing primary data before full refresh. [2025-10-02T18:31:59.188981] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-10-02T18:31:59.189363] [DEBUG] [LOCAL ] DTG: Deleted primary data file. [2025-10-02T18:31:59.189441] [INFO ] [MAIN ] DTG: Starting full primary refresh. [2025-10-02T18:31:59.479138] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-04. [2025-10-02T18:31:59.583736] [INFO ] [REMOTE ] DTG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:32:00.273003] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-03. [2025-10-02T18:32:00.390545] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-02T18:32:01.073052] [INFO ] [REMOTE ] DTG: Fetching primary data for 2024-12. [2025-10-02T18:32:01.426317] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-02T18:32:01.696278] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-02T18:32:01.722822] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-02T18:32:01.873046] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-01. [2025-10-02T18:32:02.579448] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-02T18:32:02.672997] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-10. [2025-10-02T18:32:03.473012] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-04. [2025-10-02T18:32:03.955052] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-02T18:32:04.181806] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-02T18:32:04.186474] [INFO ] [REMOTE ] DT: Full fetch complete (76670 records). [2025-10-02T18:32:04.186680] [DEBUG] [VALIDATOR ] DT: Validating primary data. [2025-10-02T18:32:04.278106] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-05. [2025-10-02T18:32:04.643402] [DEBUG] [VALIDATOR ] DT: All expected trading days are present. [2025-10-02T18:32:04.643498] [DEBUG] [VALIDATOR ] DT: Primary data validation passed. [2025-10-02T18:32:04.644545] [INFO ] [MAIN ] DT: Fetched primary data is valid. [2025-10-02T18:32:04.644681] [DEBUG] [LOCAL ] DT: Saving primary data. [2025-10-02T18:32:04.646955] [DEBUG] [LOCAL ] DT: Trimmed 76670 records to 53316 (keeping 200 days of data) [2025-10-02T18:32:04.986210] [DEBUG] [LOCAL ] DT: Primary data saved (53316 records). [2025-10-02T18:32:04.986364] [INFO ] [MAIN ] DT: Full history saved. [2025-10-02T18:32:04.986501] [INFO ] [MAIN ] Update Progress: 659/2370 symbols completed. DT took 44.7s. Estimated remaining: 3h 58m 55s. Rate: 7.2 symbols/min [2025-10-02T18:32:05.078234] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-05. [2025-10-02T18:32:05.178545] [INFO ] [MAIN ] DTK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:32:05.178771] [DEBUG] [LOCAL ] DTK: No existing data file found in primary storage. [2025-10-02T18:32:05.178817] [WARN ] [MAIN ] DTK: No existing data found, performing full refresh instead. [2025-10-02T18:32:05.178928] [INFO ] [MAIN ] DTK: Wiping existing primary data before full refresh. [2025-10-02T18:32:05.178970] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-02T18:32:05.179011] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-02T18:32:05.179057] [INFO ] [MAIN ] DTK: Starting full primary refresh. [2025-10-02T18:32:05.561269] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-02T18:32:05.589753] [INFO ] [REMOTE ] DTK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:32:05.873040] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-06. [2025-10-02T18:32:05.913603] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-02T18:32:06.186054] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-02T18:32:06.673027] [INFO ] [REMOTE ] DTK: Fetching primary data for 2024-12. [2025-10-02T18:32:06.895434] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T18:32:06.895906] [WARN ] [REMOTE ] DTK: No data returned for month 2024-12 [2025-10-02T18:32:06.896001] [FATAL] [REMOTE ] DTK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T18:32:06.896052] [FATAL] [MAIN ] DTK: Failed to fetch primary data. [2025-10-02T18:32:06.896115] [WARN ] [MAIN ] DTK: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T18:32:06.896193] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-02T18:32:06.896259] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-02T18:32:06.896298] [INFO ] [LOCAL ] DTK: Starting deletion of derivative data. [2025-10-02T18:32:06.896357] [DEBUG] [LOCAL ] DTK: No derivative data file found to delete. [2025-10-02T18:32:06.896428] [INFO ] [MAIN ] Update Progress: 660/2370 symbols completed. DTK took 1.9s. Estimated remaining: 3h 58m 30s. Rate: 7.2 symbols/min [2025-10-02T18:32:07.087120] [INFO ] [MAIN ] DTM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:32:07.087385] [DEBUG] [LOCAL ] DTM: No existing data file found in primary storage. [2025-10-02T18:32:07.087444] [WARN ] [MAIN ] DTM: No existing data found, performing full refresh instead. [2025-10-02T18:32:07.087571] [INFO ] [MAIN ] DTM: Wiping existing primary data before full refresh. [2025-10-02T18:32:07.087624] [INFO ] [LOCAL ] DTM: Starting deletion of primary data. [2025-10-02T18:32:07.087718] [DEBUG] [LOCAL ] DTM: No primary data file found to delete. [2025-10-02T18:32:07.087760] [INFO ] [MAIN ] DTM: Starting full primary refresh. [2025-10-02T18:32:07.470945] [INFO ] [REMOTE ] DTM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:32:07.472955] [INFO ] [REMOTE ] DTM: Fetching primary data for 2024-12. [2025-10-02T18:32:08.273010] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-06. [2025-10-02T18:32:09.072974] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-02. [2025-10-02T18:32:09.193935] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-02T18:32:09.459614] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-02T18:32:09.664910] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-02T18:32:09.872997] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-03. [2025-10-02T18:32:10.557665] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-02T18:32:10.673013] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-04. [2025-10-02T18:32:11.023473] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-02T18:32:11.472996] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-07. [2025-10-02T18:32:11.955868] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-02T18:32:12.273007] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-01. [2025-10-02T18:32:13.073002] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-07. [2025-10-02T18:32:13.871624] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-02T18:32:13.880638] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-08. [2025-10-02T18:32:14.673008] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-05. [2025-10-02T18:32:14.801626] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-02T18:32:14.955514] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-02T18:32:15.473004] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-08. [2025-10-02T18:32:15.504574] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-02T18:32:16.273054] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-02. [2025-10-02T18:32:17.051254] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-02T18:32:17.072986] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-09. [2025-10-02T18:32:17.872994] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-09. [2025-10-02T18:32:18.296184] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-02T18:32:18.395695] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-02T18:32:18.398769] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-02T18:32:18.673023] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-03. [2025-10-02T18:32:19.473048] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-06. [2025-10-02T18:32:20.176729] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-02T18:32:20.273008] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-07. [2025-10-02T18:32:20.799605] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-02T18:32:20.959026] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-10-02T18:32:21.072995] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-10. [2025-10-02T18:32:21.873021] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-10. [2025-10-02T18:32:22.569560] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-02T18:32:22.573532] [INFO ] [REMOTE ] DTE: Full fetch complete (68930 records). [2025-10-02T18:32:22.573687] [DEBUG] [VALIDATOR ] DTE: Validating primary data. [2025-10-02T18:32:22.682456] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-04. [2025-10-02T18:32:22.957820] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-02T18:32:22.992320] [INFO ] [REMOTE ] DTF: Full fetch complete (2074 records). [2025-10-02T18:32:23.010392] [DEBUG] [VALIDATOR ] DTE: All expected trading days are present. [2025-10-02T18:32:23.010558] [DEBUG] [VALIDATOR ] DTE: Primary data validation passed. [2025-10-02T18:32:23.011495] [INFO ] [MAIN ] DTE: Fetched primary data is valid. [2025-10-02T18:32:23.010506] [DEBUG] [VALIDATOR ] DTF: Validating primary data. [2025-10-02T18:32:23.011579] [DEBUG] [LOCAL ] DTE: Saving primary data. [2025-10-02T18:32:23.012515] [FATAL] [VALIDATOR ] DTF: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:32:23.012923] [FATAL] [MAIN ] DTF: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:32:23.013072] [WARN ] [MAIN ] DTF: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:32:23.013259] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-02T18:32:23.013703] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-02T18:32:23.013794] [INFO ] [LOCAL ] DTF: Starting deletion of derivative data. [2025-10-02T18:32:23.013924] [DEBUG] [LOCAL ] DTF: No derivative data file found to delete. [2025-10-02T18:32:23.014010] [INFO ] [MAIN ] Update Progress: 661/2370 symbols completed. DTF took 34.8s. Estimated remaining: 3h 58m 41s. Rate: 7.2 symbols/min [2025-10-02T18:32:23.051008] [DEBUG] [LOCAL ] DTE: Trimmed 68930 records to 48040 (keeping 200 days of data) [2025-10-02T18:32:23.308804] [INFO ] [MAIN ] DTW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:32:23.309765] [DEBUG] [LOCAL ] DTW: No existing data file found in primary storage. [2025-10-02T18:32:23.309836] [WARN ] [MAIN ] DTW: No existing data found, performing full refresh instead. [2025-10-02T18:32:23.310220] [INFO ] [MAIN ] DTW: Wiping existing primary data before full refresh. [2025-10-02T18:32:23.311072] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-10-02T18:32:23.311440] [DEBUG] [LOCAL ] DTW: No primary data file found to delete. [2025-10-02T18:32:23.311508] [INFO ] [MAIN ] DTW: Starting full primary refresh. [2025-10-02T18:32:23.475684] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-08. [2025-10-02T18:32:23.753789] [INFO ] [REMOTE ] DTW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:32:23.950363] [DEBUG] [LOCAL ] DTE: Primary data saved (48040 records). [2025-10-02T18:32:23.950511] [INFO ] [MAIN ] DTE: Full history saved. [2025-10-02T18:32:23.950618] [INFO ] [MAIN ] Update Progress: 662/2370 symbols completed. DTE took 41.3s. Estimated remaining: 3h 58m 14s. Rate: 7.2 symbols/min [2025-10-02T18:32:24.140861] [INFO ] [MAIN ] DUK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:32:24.141220] [DEBUG] [LOCAL ] DUK: No existing data file found in primary storage. [2025-10-02T18:32:24.141297] [WARN ] [MAIN ] DUK: No existing data found, performing full refresh instead. [2025-10-02T18:32:24.141571] [INFO ] [MAIN ] DUK: Wiping existing primary data before full refresh. [2025-10-02T18:32:24.141637] [INFO ] [LOCAL ] DUK: Starting deletion of primary data. [2025-10-02T18:32:24.141754] [DEBUG] [LOCAL ] DUK: No primary data file found to delete. [2025-10-02T18:32:24.141807] [INFO ] [MAIN ] DUK: Starting full primary refresh. [2025-10-02T18:32:24.265003] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-02T18:32:24.276831] [INFO ] [REMOTE ] DTW: Fetching primary data for 2024-12. [2025-10-02T18:32:24.579001] [INFO ] [REMOTE ] DUK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:32:24.611922] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-02T18:32:25.017451] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-02T18:32:25.072962] [INFO ] [REMOTE ] DUK: Fetching primary data for 2024-12. [2025-10-02T18:32:25.873007] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-09. [2025-10-02T18:32:26.635738] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-02T18:32:26.673027] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-10. [2025-10-02T18:32:27.027958] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-02T18:32:27.240514] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-02T18:32:27.241476] [INFO ] [REMOTE ] DTG: Full fetch complete (8955 records). [2025-10-02T18:32:27.241573] [DEBUG] [VALIDATOR ] DTG: Validating primary data. [2025-10-02T18:32:27.242084] [FATAL] [VALIDATOR ] DTG: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:32:27.242212] [FATAL] [MAIN ] DTG: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:32:27.242318] [WARN ] [MAIN ] DTG: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:32:27.242406] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-10-02T18:32:27.242512] [DEBUG] [LOCAL ] DTG: No primary data file found to delete. [2025-10-02T18:32:27.242582] [INFO ] [LOCAL ] DTG: Starting deletion of derivative data. [2025-10-02T18:32:27.243040] [DEBUG] [LOCAL ] DTG: Deleted derivative data file. [2025-10-02T18:32:27.243146] [INFO ] [MAIN ] Update Progress: 663/2370 symbols completed. DTG took 28.5s. Estimated remaining: 3h 57m 52s. Rate: 7.2 symbols/min [2025-10-02T18:32:27.425337] [INFO ] [MAIN ] DUKB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:32:27.425557] [DEBUG] [LOCAL ] DUKB: No existing data file found in primary storage. [2025-10-02T18:32:27.425605] [WARN ] [MAIN ] DUKB: No existing data found, performing full refresh instead. [2025-10-02T18:32:27.425791] [INFO ] [MAIN ] DUKB: Wiping existing primary data before full refresh. [2025-10-02T18:32:27.425843] [INFO ] [LOCAL ] DUKB: Starting deletion of primary data. [2025-10-02T18:32:27.425886] [DEBUG] [LOCAL ] DUKB: No primary data file found to delete. [2025-10-02T18:32:27.425919] [INFO ] [MAIN ] DUKB: Starting full primary refresh. [2025-10-02T18:32:27.483563] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-01. [2025-10-02T18:32:27.814249] [INFO ] [REMOTE ] DUKB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:32:28.272992] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2024-12. [2025-10-02T18:32:29.072982] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-05. [2025-10-02T18:32:29.226816] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-02T18:32:29.426863] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-02T18:32:29.873010] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-01. [2025-10-02T18:32:30.307226] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-02T18:32:30.548487] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-02T18:32:30.673008] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-02. [2025-10-02T18:32:31.267576] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-02T18:32:31.472997] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-03. [2025-10-02T18:32:32.272996] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-02. [2025-10-02T18:32:32.719424] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-02T18:32:33.072989] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-04. [2025-10-02T18:32:33.683268] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-02T18:32:33.872972] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-06. [2025-10-02T18:32:33.982587] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-02T18:32:34.673002] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-01. [2025-10-02T18:32:35.472145] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-02T18:32:35.474976] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-05. [2025-10-02T18:32:35.673572] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-02T18:32:36.030825] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-02T18:32:36.273045] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-07. [2025-10-02T18:32:37.073023] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-03. [2025-10-02T18:32:37.873004] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-02. [2025-10-02T18:32:38.443686] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-02T18:32:38.475379] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-02T18:32:38.673006] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-03. [2025-10-02T18:32:38.817958] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-02T18:32:39.345236] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-02T18:32:39.473060] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-06. [2025-10-02T18:32:39.916021] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-02T18:32:40.273009] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-07. [2025-10-02T18:32:41.059403] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-02T18:32:41.072957] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-08. [2025-10-02T18:32:41.741579] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-02T18:32:41.872985] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-04. [2025-10-02T18:32:42.572139] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-02T18:32:42.673053] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-09. [2025-10-02T18:32:43.473055] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-04. [2025-10-02T18:32:44.031780] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-02T18:32:44.273001] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-05. [2025-10-02T18:32:45.073055] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-08. [2025-10-02T18:32:45.453921] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-02T18:32:45.873011] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-10. [2025-10-02T18:32:46.257913] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-04 (2.78 seconds). [2025-10-02T18:32:46.673017] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-05. [2025-10-02T18:32:47.234023] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-02T18:32:47.458454] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-02T18:32:47.459412] [INFO ] [REMOTE ] DTW: Full fetch complete (7609 records). [2025-10-02T18:32:47.459489] [DEBUG] [VALIDATOR ] DTW: Validating primary data. [2025-10-02T18:32:47.483164] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-09. [2025-10-02T18:32:47.856450] [DEBUG] [VALIDATOR ] DTW: All expected trading days are present. [2025-10-02T18:32:47.856533] [DEBUG] [VALIDATOR ] DTW: Primary data validation passed. [2025-10-02T18:32:47.856816] [INFO ] [MAIN ] DTW: Fetched primary data is valid. [2025-10-02T18:32:47.856880] [DEBUG] [LOCAL ] DTW: Saving primary data. [2025-10-02T18:32:47.857329] [DEBUG] [LOCAL ] DTW: Trimmed 7609 records to 4936 (keeping 200 days of data) [2025-10-02T18:32:47.893444] [DEBUG] [LOCAL ] DTW: Primary data saved (4936 records). [2025-10-02T18:32:47.893573] [INFO ] [MAIN ] DTW: Full history saved. [2025-10-02T18:32:47.893680] [INFO ] [MAIN ] Update Progress: 664/2370 symbols completed. DTW took 24.9s. Estimated remaining: 3h 58m 16s. Rate: 7.2 symbols/min [2025-10-02T18:32:48.074759] [INFO ] [MAIN ] DV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:32:48.136198] [DEBUG] [LOCAL ] DV: Loaded 51286 existing records from primary storage. [2025-10-02T18:32:48.136572] [INFO ] [MAIN ] DV: Loaded 51286 existing records. [2025-10-02T18:32:48.278185] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-06. [2025-10-02T18:32:48.340601] [WARN ] [MAIN ] DV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:32:48.341056] [INFO ] [MAIN ] DV: Wiping existing primary data before full refresh. [2025-10-02T18:32:48.341109] [INFO ] [LOCAL ] DV: Starting deletion of primary data. [2025-10-02T18:32:48.342604] [DEBUG] [LOCAL ] DV: Deleted primary data file. [2025-10-02T18:32:48.342703] [INFO ] [MAIN ] DV: Starting full primary refresh. [2025-10-02T18:32:48.756162] [INFO ] [REMOTE ] DV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:32:48.793621] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-02T18:32:49.073011] [INFO ] [REMOTE ] DV: Fetching primary data for 2024-12. [2025-10-02T18:32:49.114363] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-02T18:32:49.248863] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-02T18:32:49.873004] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-07. [2025-10-02T18:32:50.673006] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-06. [2025-10-02T18:32:50.794108] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-02T18:32:50.797037] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-02T18:32:51.473088] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-08. [2025-10-02T18:32:52.064342] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-02T18:32:52.272974] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-10. [2025-10-02T18:32:52.418997] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-02T18:32:53.073026] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-07. [2025-10-02T18:32:53.625487] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-02T18:32:53.627476] [INFO ] [REMOTE ] DTM: Full fetch complete (64801 records). [2025-10-02T18:32:53.627599] [DEBUG] [VALIDATOR ] DTM: Validating primary data. [2025-10-02T18:32:53.878142] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-09. [2025-10-02T18:32:54.072134] [DEBUG] [VALIDATOR ] DTM: All expected trading days are present. [2025-10-02T18:32:54.072221] [DEBUG] [VALIDATOR ] DTM: Primary data validation passed. [2025-10-02T18:32:54.073104] [INFO ] [MAIN ] DTM: Fetched primary data is valid. [2025-10-02T18:32:54.073175] [DEBUG] [LOCAL ] DTM: Saving primary data. [2025-10-02T18:32:54.074867] [DEBUG] [LOCAL ] DTM: Trimmed 64801 records to 44445 (keeping 200 days of data) [2025-10-02T18:32:54.391600] [DEBUG] [LOCAL ] DTM: Primary data saved (44445 records). [2025-10-02T18:32:54.391819] [INFO ] [MAIN ] DTM: Full history saved. [2025-10-02T18:32:54.391951] [INFO ] [MAIN ] Update Progress: 665/2370 symbols completed. DTM took 47.5s. Estimated remaining: 3h 58m 2s. Rate: 7.2 symbols/min [2025-10-02T18:32:54.593795] [INFO ] [MAIN ] DVA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:32:54.599438] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-02T18:32:54.650001] [DEBUG] [LOCAL ] DVA: Loaded 41054 existing records from primary storage. [2025-10-02T18:32:54.650302] [INFO ] [MAIN ] DVA: Loaded 41054 existing records. [2025-10-02T18:32:54.685505] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-01. [2025-10-02T18:32:54.861593] [WARN ] [MAIN ] DVA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:32:54.861926] [INFO ] [MAIN ] DVA: Wiping existing primary data before full refresh. [2025-10-02T18:32:54.862001] [INFO ] [LOCAL ] DVA: Starting deletion of primary data. [2025-10-02T18:32:54.863448] [DEBUG] [LOCAL ] DVA: Deleted primary data file. [2025-10-02T18:32:54.863514] [INFO ] [MAIN ] DVA: Starting full primary refresh. [2025-10-02T18:32:55.018855] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-02T18:32:55.290382] [INFO ] [REMOTE ] DVA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:32:55.473002] [INFO ] [REMOTE ] DVA: Fetching primary data for 2024-12. [2025-10-02T18:32:56.273013] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-10. [2025-10-02T18:32:56.408827] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-02T18:32:56.854588] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-02T18:32:56.855555] [INFO ] [REMOTE ] DUKB: Full fetch complete (9517 records). [2025-10-02T18:32:56.855704] [DEBUG] [VALIDATOR ] DUKB: Validating primary data. [2025-10-02T18:32:57.080549] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-02. [2025-10-02T18:32:57.362317] [DEBUG] [VALIDATOR ] DUKB: All expected trading days are present. [2025-10-02T18:32:57.385148] [DEBUG] [VALIDATOR ] DUKB: Primary data validation passed. [2025-10-02T18:32:57.385840] [INFO ] [MAIN ] DUKB: Fetched primary data is valid. [2025-10-02T18:32:57.386332] [DEBUG] [LOCAL ] DUKB: Saving primary data. [2025-10-02T18:32:57.387821] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-02T18:32:57.397306] [DEBUG] [LOCAL ] DUKB: Trimmed 9517 records to 6410 (keeping 200 days of data) [2025-10-02T18:32:57.446361] [DEBUG] [LOCAL ] DUKB: Primary data saved (6410 records). [2025-10-02T18:32:57.446509] [INFO ] [MAIN ] DUKB: Full history saved. [2025-10-02T18:32:57.446588] [INFO ] [MAIN ] Update Progress: 666/2370 symbols completed. DUKB took 30.2s. Estimated remaining: 3h 57m 40s. Rate: 7.2 symbols/min [2025-10-02T18:32:57.645324] [INFO ] [MAIN ] DVN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:32:57.717918] [DEBUG] [LOCAL ] DVN: Loaded 53699 existing records from primary storage. [2025-10-02T18:32:57.718439] [INFO ] [MAIN ] DVN: Loaded 53699 existing records. [2025-10-02T18:32:57.878094] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-01. [2025-10-02T18:32:57.917086] [WARN ] [MAIN ] DVN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:32:57.917296] [INFO ] [MAIN ] DVN: Wiping existing primary data before full refresh. [2025-10-02T18:32:57.917344] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-10-02T18:32:57.919381] [DEBUG] [LOCAL ] DVN: Deleted primary data file. [2025-10-02T18:32:57.919451] [INFO ] [MAIN ] DVN: Starting full primary refresh. [2025-10-02T18:32:58.306212] [INFO ] [REMOTE ] DVN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:32:58.672982] [INFO ] [REMOTE ] DVN: Fetching primary data for 2024-12. [2025-10-02T18:32:58.787536] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-02T18:32:59.416927] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-02T18:32:59.473002] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-02. [2025-10-02T18:33:00.273005] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-03. [2025-10-02T18:33:00.805958] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-02T18:33:01.073051] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-01. [2025-10-02T18:33:01.211776] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-02T18:33:01.870413] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-02T18:33:01.880986] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-03. [2025-10-02T18:33:02.673001] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-08. [2025-10-02T18:33:03.181278] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-02T18:33:03.472981] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-04. [2025-10-02T18:33:03.570915] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-02T18:33:04.273021] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-02. [2025-10-02T18:33:04.776175] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-02T18:33:04.863415] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-02T18:33:05.073035] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-09. [2025-10-02T18:33:05.873053] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-05. [2025-10-02T18:33:06.468982] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-02T18:33:06.673039] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-04. [2025-10-02T18:33:07.179300] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-02T18:33:07.473059] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-10. [2025-10-02T18:33:07.610420] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-02T18:33:08.273001] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-06. [2025-10-02T18:33:08.424862] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-02T18:33:08.693141] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-02T18:33:08.695276] [INFO ] [REMOTE ] DUK: Full fetch complete (77405 records). [2025-10-02T18:33:08.695402] [DEBUG] [VALIDATOR ] DUK: Validating primary data. [2025-10-02T18:33:09.078156] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-03. [2025-10-02T18:33:09.145085] [DEBUG] [VALIDATOR ] DUK: All expected trading days are present. [2025-10-02T18:33:09.145179] [DEBUG] [VALIDATOR ] DUK: Primary data validation passed. [2025-10-02T18:33:09.146159] [INFO ] [MAIN ] DUK: Fetched primary data is valid. [2025-10-02T18:33:09.146230] [DEBUG] [LOCAL ] DUK: Saving primary data. [2025-10-02T18:33:09.147822] [DEBUG] [LOCAL ] DUK: Trimmed 77405 records to 53845 (keeping 200 days of data) [2025-10-02T18:33:09.510729] [DEBUG] [LOCAL ] DUK: Primary data saved (53845 records). [2025-10-02T18:33:09.510896] [INFO ] [MAIN ] DUK: Full history saved. [2025-10-02T18:33:09.511042] [INFO ] [MAIN ] Update Progress: 667/2370 symbols completed. DUK took 45.6s. Estimated remaining: 3h 57m 42s. Rate: 7.2 symbols/min [2025-10-02T18:33:09.715361] [INFO ] [MAIN ] DX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:33:09.748577] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-02T18:33:09.814445] [DEBUG] [LOCAL ] DX: Loaded 52464 existing records from primary storage. [2025-10-02T18:33:09.814849] [INFO ] [MAIN ] DX: Loaded 52464 existing records. [2025-10-02T18:33:09.884860] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-07. [2025-10-02T18:33:10.012925] [WARN ] [MAIN ] DX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:33:10.013164] [INFO ] [MAIN ] DX: Wiping existing primary data before full refresh. [2025-10-02T18:33:10.013214] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-10-02T18:33:10.015337] [DEBUG] [LOCAL ] DX: Deleted primary data file. [2025-10-02T18:33:10.015405] [INFO ] [MAIN ] DX: Starting full primary refresh. [2025-10-02T18:33:10.423074] [INFO ] [REMOTE ] DX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:33:10.672979] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-05. [2025-10-02T18:33:11.165246] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-02T18:33:11.473078] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-04. [2025-10-02T18:33:11.476080] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-02T18:33:11.884983] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-02T18:33:12.273045] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-06. [2025-10-02T18:33:13.072964] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-08. [2025-10-02T18:33:13.663575] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-02T18:33:13.819009] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-02T18:33:13.873012] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-07. [2025-10-02T18:33:14.381759] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-02T18:33:14.673001] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-09. [2025-10-02T18:33:14.967056] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-02T18:33:15.473030] [INFO ] [REMOTE ] DX: Fetching primary data for 2024-12. [2025-10-02T18:33:16.032268] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-02T18:33:16.273010] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-10. [2025-10-02T18:33:17.073024] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-05. [2025-10-02T18:33:17.369412] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-02T18:33:17.704331] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-02T18:33:17.706624] [INFO ] [REMOTE ] DV: Full fetch complete (73488 records). [2025-10-02T18:33:17.706805] [DEBUG] [VALIDATOR ] DV: Validating primary data. [2025-10-02T18:33:17.878125] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-01. [2025-10-02T18:33:18.160570] [DEBUG] [VALIDATOR ] DV: All expected trading days are present. [2025-10-02T18:33:18.160689] [DEBUG] [VALIDATOR ] DV: Primary data validation passed. [2025-10-02T18:33:18.161556] [INFO ] [MAIN ] DV: Fetched primary data is valid. [2025-10-02T18:33:18.161623] [DEBUG] [LOCAL ] DV: Saving primary data. [2025-10-02T18:33:18.163216] [DEBUG] [LOCAL ] DV: Trimmed 73488 records to 51670 (keeping 200 days of data) [2025-10-02T18:33:18.489849] [DEBUG] [LOCAL ] DV: Primary data saved (51670 records). [2025-10-02T18:33:18.490049] [INFO ] [MAIN ] DV: Full history saved. [2025-10-02T18:33:18.490264] [INFO ] [MAIN ] Update Progress: 668/2370 symbols completed. DV took 30.6s. Estimated remaining: 3h 57m 35s. Rate: 7.2 symbols/min [2025-10-02T18:33:18.679583] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-08. [2025-10-02T18:33:18.684783] [INFO ] [MAIN ] DXC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:33:18.741601] [DEBUG] [LOCAL ] DXC: Loaded 49790 existing records from primary storage. [2025-10-02T18:33:18.741968] [INFO ] [MAIN ] DXC: Loaded 49790 existing records. [2025-10-02T18:33:18.951356] [WARN ] [MAIN ] DXC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:33:18.951858] [INFO ] [MAIN ] DXC: Wiping existing primary data before full refresh. [2025-10-02T18:33:18.952052] [INFO ] [LOCAL ] DXC: Starting deletion of primary data. [2025-10-02T18:33:18.953879] [DEBUG] [LOCAL ] DXC: Deleted primary data file. [2025-10-02T18:33:18.953945] [INFO ] [MAIN ] DXC: Starting full primary refresh. [2025-10-02T18:33:19.198431] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-02T18:33:19.435522] [INFO ] [REMOTE ] DXC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:33:19.472954] [INFO ] [REMOTE ] DXC: Fetching primary data for 2024-12. [2025-10-02T18:33:19.824084] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-02T18:33:19.997075] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-02T18:33:20.273004] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-02. [2025-10-02T18:33:20.936587] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-02T18:33:21.073012] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-01. [2025-10-02T18:33:21.692155] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-02T18:33:21.873020] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-06. [2025-10-02T18:33:22.220387] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-02T18:33:22.673012] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-03. [2025-10-02T18:33:23.472980] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-02. [2025-10-02T18:33:23.873482] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-02T18:33:24.272985] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-09. [2025-10-02T18:33:24.360435] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-02T18:33:24.515384] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-02T18:33:25.073014] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-07. [2025-10-02T18:33:25.870764] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-02T18:33:25.879430] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-03. [2025-10-02T18:33:26.672976] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-04. [2025-10-02T18:33:26.951893] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-02T18:33:27.432426] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-02T18:33:27.472961] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-04. [2025-10-02T18:33:28.273002] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-10. [2025-10-02T18:33:28.482042] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-02T18:33:29.075633] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-08. [2025-10-02T18:33:29.081765] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-02T18:33:29.586555] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-02T18:33:29.588724] [INFO ] [REMOTE ] DVA: Full fetch complete (59775 records). [2025-10-02T18:33:29.588816] [DEBUG] [VALIDATOR ] DVA: Validating primary data. [2025-10-02T18:33:29.878099] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-05. [2025-10-02T18:33:30.012527] [DEBUG] [VALIDATOR ] DVA: All expected trading days are present. [2025-10-02T18:33:30.012606] [DEBUG] [VALIDATOR ] DVA: Primary data validation passed. [2025-10-02T18:33:30.013569] [INFO ] [MAIN ] DVA: Fetched primary data is valid. [2025-10-02T18:33:30.013635] [DEBUG] [LOCAL ] DVA: Saving primary data. [2025-10-02T18:33:30.014875] [DEBUG] [LOCAL ] DVA: Trimmed 59775 records to 41335 (keeping 200 days of data) [2025-10-02T18:33:30.269278] [DEBUG] [LOCAL ] DVA: Primary data saved (41335 records). [2025-10-02T18:33:30.269411] [INFO ] [MAIN ] DVA: Full history saved. [2025-10-02T18:33:30.269490] [INFO ] [MAIN ] Update Progress: 669/2370 symbols completed. DVA took 35.9s. Estimated remaining: 3h 57m 35s. Rate: 7.2 symbols/min [2025-10-02T18:33:30.457829] [INFO ] [MAIN ] DXYZ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:33:30.495001] [DEBUG] [LOCAL ] DXYZ: Loaded 36866 existing records from primary storage. [2025-10-02T18:33:30.495300] [INFO ] [MAIN ] DXYZ: Loaded 36866 existing records. [2025-10-02T18:33:30.678091] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-05. [2025-10-02T18:33:30.682099] [WARN ] [MAIN ] DXYZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:33:30.683095] [INFO ] [MAIN ] DXYZ: Wiping existing primary data before full refresh. [2025-10-02T18:33:30.683160] [INFO ] [LOCAL ] DXYZ: Starting deletion of primary data. [2025-10-02T18:33:30.684428] [DEBUG] [LOCAL ] DXYZ: Deleted primary data file. [2025-10-02T18:33:30.684493] [INFO ] [MAIN ] DXYZ: Starting full primary refresh. [2025-10-02T18:33:31.088153] [INFO ] [REMOTE ] DXYZ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:33:31.323411] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-02T18:33:31.473003] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-09. [2025-10-02T18:33:31.640948] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-02T18:33:32.272986] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-06. [2025-10-02T18:33:32.630793] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-02T18:33:33.072943] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-06. [2025-10-02T18:33:33.364617] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-02T18:33:33.717932] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-02T18:33:33.872999] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-07. [2025-10-02T18:33:34.537196] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-02T18:33:34.672997] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2024-12. [2025-10-02T18:33:35.473025] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-10. [2025-10-02T18:33:35.592981] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-02T18:33:36.273010] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-07. [2025-10-02T18:33:37.073030] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-08. [2025-10-02T18:33:37.343363] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2024-12 (2.67 seconds). [2025-10-02T18:33:37.343700] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-02T18:33:37.357724] [INFO ] [REMOTE ] DVN: Full fetch complete (77766 records). [2025-10-02T18:33:37.357868] [DEBUG] [VALIDATOR ] DVN: Validating primary data. [2025-10-02T18:33:37.782476] [DEBUG] [VALIDATOR ] DVN: All expected trading days are present. [2025-10-02T18:33:37.782568] [DEBUG] [VALIDATOR ] DVN: Primary data validation passed. [2025-10-02T18:33:37.783488] [INFO ] [MAIN ] DVN: Fetched primary data is valid. [2025-10-02T18:33:37.783567] [DEBUG] [LOCAL ] DVN: Saving primary data. [2025-10-02T18:33:37.785184] [DEBUG] [LOCAL ] DVN: Trimmed 77766 records to 54089 (keeping 200 days of data) [2025-10-02T18:33:37.888328] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-01. [2025-10-02T18:33:38.162301] [DEBUG] [LOCAL ] DVN: Primary data saved (54089 records). [2025-10-02T18:33:38.162504] [INFO ] [MAIN ] DVN: Full history saved. [2025-10-02T18:33:38.164108] [INFO ] [MAIN ] Update Progress: 670/2370 symbols completed. DVN took 40.7s. Estimated remaining: 3h 57m 25s. Rate: 7.2 symbols/min [2025-10-02T18:33:38.353903] [INFO ] [MAIN ] DY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:33:38.392825] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-02T18:33:38.432336] [DEBUG] [LOCAL ] DY: Loaded 29088 existing records from primary storage. [2025-10-02T18:33:38.432633] [INFO ] [MAIN ] DY: Loaded 29088 existing records. [2025-10-02T18:33:38.594369] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-02T18:33:38.678697] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-09. [2025-10-02T18:33:38.685638] [WARN ] [MAIN ] DY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:33:38.686703] [INFO ] [MAIN ] DY: Wiping existing primary data before full refresh. [2025-10-02T18:33:38.686783] [INFO ] [LOCAL ] DY: Starting deletion of primary data. [2025-10-02T18:33:38.688139] [DEBUG] [LOCAL ] DY: Deleted primary data file. [2025-10-02T18:33:38.688204] [INFO ] [MAIN ] DY: Starting full primary refresh. [2025-10-02T18:33:39.077921] [INFO ] [REMOTE ] DY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:33:39.473038] [INFO ] [REMOTE ] DY: Fetching primary data for 2024-12. [2025-10-02T18:33:40.266838] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-10-02T18:33:40.277500] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-08. [2025-10-02T18:33:40.313180] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-02T18:33:40.685877] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-02T18:33:41.072998] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-02. [2025-10-02T18:33:41.873016] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-10. [2025-10-02T18:33:42.257200] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-02T18:33:42.673038] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-09. [2025-10-02T18:33:42.804826] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-02T18:33:43.190539] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-02T18:33:43.192201] [INFO ] [REMOTE ] DXC: Full fetch complete (68921 records). [2025-10-02T18:33:43.192318] [DEBUG] [VALIDATOR ] DXC: Validating primary data. [2025-10-02T18:33:43.193175] [FATAL] [VALIDATOR ] DXC: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:33:43.193320] [FATAL] [MAIN ] DXC: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:33:43.193403] [WARN ] [MAIN ] DXC: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:33:43.193527] [INFO ] [LOCAL ] DXC: Starting deletion of primary data. [2025-10-02T18:33:43.193608] [DEBUG] [LOCAL ] DXC: No primary data file found to delete. [2025-10-02T18:33:43.193677] [INFO ] [LOCAL ] DXC: Starting deletion of derivative data. [2025-10-02T18:33:43.194252] [DEBUG] [LOCAL ] DXC: Deleted derivative data file. [2025-10-02T18:33:43.194353] [INFO ] [MAIN ] Update Progress: 671/2370 symbols completed. DXC took 24.7s. Estimated remaining: 3h 57m 9s. Rate: 7.2 symbols/min [2025-10-02T18:33:43.383691] [INFO ] [MAIN ] E: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:33:43.417562] [DEBUG] [LOCAL ] E: Loaded 33300 existing records from primary storage. [2025-10-02T18:33:43.417902] [INFO ] [MAIN ] E: Loaded 33300 existing records. [2025-10-02T18:33:43.485599] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-03. [2025-10-02T18:33:43.620526] [WARN ] [MAIN ] E: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:33:43.620782] [INFO ] [MAIN ] E: Wiping existing primary data before full refresh. [2025-10-02T18:33:43.620836] [INFO ] [LOCAL ] E: Starting deletion of primary data. [2025-10-02T18:33:43.621977] [DEBUG] [LOCAL ] E: Deleted primary data file. [2025-10-02T18:33:43.622040] [INFO ] [MAIN ] E: Starting full primary refresh. [2025-10-02T18:33:44.008618] [INFO ] [REMOTE ] E: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:33:44.272977] [INFO ] [REMOTE ] E: Fetching primary data for 2024-12. [2025-10-02T18:33:44.548882] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-02T18:33:45.073031] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-10. [2025-10-02T18:33:45.592719] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-02T18:33:45.873002] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-01. [2025-10-02T18:33:45.953590] [INFO ] [REMOTE ] E: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-02T18:33:46.673037] [INFO ] [REMOTE ] E: Fetching primary data for 2025-01. [2025-10-02T18:33:47.011338] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-02T18:33:47.013431] [INFO ] [REMOTE ] DX: Full fetch complete (75462 records). [2025-10-02T18:33:47.013553] [DEBUG] [VALIDATOR ] DX: Validating primary data. [2025-10-02T18:33:47.450494] [DEBUG] [VALIDATOR ] DX: All expected trading days are present. [2025-10-02T18:33:47.450715] [DEBUG] [VALIDATOR ] DX: Primary data validation passed. [2025-10-02T18:33:47.451769] [INFO ] [MAIN ] DX: Fetched primary data is valid. [2025-10-02T18:33:47.451957] [DEBUG] [LOCAL ] DX: Saving primary data. [2025-10-02T18:33:47.470917] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-02T18:33:47.478125] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-02. [2025-10-02T18:33:47.479804] [DEBUG] [LOCAL ] DX: Trimmed 75462 records to 52848 (keeping 200 days of data) [2025-10-02T18:33:47.830469] [DEBUG] [LOCAL ] DX: Primary data saved (52848 records). [2025-10-02T18:33:47.830622] [INFO ] [MAIN ] DX: Full history saved. [2025-10-02T18:33:47.830743] [INFO ] [MAIN ] Update Progress: 672/2370 symbols completed. DX took 38.3s. Estimated remaining: 3h 56m 51s. Rate: 7.2 symbols/min [2025-10-02T18:33:48.041669] [INFO ] [MAIN ] EAF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:33:48.041948] [DEBUG] [LOCAL ] EAF: No existing data file found in primary storage. [2025-10-02T18:33:48.042118] [WARN ] [MAIN ] EAF: No existing data found, performing full refresh instead. [2025-10-02T18:33:48.042386] [INFO ] [MAIN ] EAF: Wiping existing primary data before full refresh. [2025-10-02T18:33:48.042602] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-10-02T18:33:48.042799] [DEBUG] [LOCAL ] EAF: No primary data file found to delete. [2025-10-02T18:33:48.043001] [INFO ] [MAIN ] EAF: Starting full primary refresh. [2025-10-02T18:33:48.145515] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-02T18:33:48.279457] [INFO ] [REMOTE ] E: Fetching primary data for 2025-02. [2025-10-02T18:33:48.563035] [INFO ] [REMOTE ] EAF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:33:48.910110] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-02T18:33:49.073041] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-03. [2025-10-02T18:33:49.691589] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-02T18:33:49.873017] [INFO ] [REMOTE ] E: Fetching primary data for 2025-03. [2025-10-02T18:33:50.600473] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-02T18:33:50.673024] [INFO ] [REMOTE ] EAF: Fetching primary data for 2024-12. [2025-10-02T18:33:51.304688] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-02T18:33:51.473016] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-04. [2025-10-02T18:33:52.272987] [INFO ] [REMOTE ] E: Fetching primary data for 2025-04. [2025-10-02T18:33:52.369893] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-02T18:33:53.072982] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-04. [2025-10-02T18:33:53.195828] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-02T18:33:53.750067] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-02T18:33:53.873006] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-01. [2025-10-02T18:33:54.335144] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-02T18:33:54.673017] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-05. [2025-10-02T18:33:55.234789] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-02T18:33:55.473060] [INFO ] [REMOTE ] E: Fetching primary data for 2025-05. [2025-10-02T18:33:56.052102] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-02T18:33:56.272999] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-02. [2025-10-02T18:33:56.998362] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-02T18:33:57.073007] [INFO ] [REMOTE ] E: Fetching primary data for 2025-06. [2025-10-02T18:33:57.873041] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-06. [2025-10-02T18:33:57.876314] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-02T18:33:57.988375] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-02T18:33:58.672999] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-05. [2025-10-02T18:33:59.017588] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-02T18:33:59.473012] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-03. [2025-10-02T18:34:00.273017] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-07. [2025-10-02T18:34:00.636432] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-02T18:34:01.073027] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-06. [2025-10-02T18:34:01.224601] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-02T18:34:01.306980] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-02T18:34:01.872976] [INFO ] [REMOTE ] E: Fetching primary data for 2025-07. [2025-10-02T18:34:02.673027] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-08. [2025-10-02T18:34:02.794175] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-02T18:34:03.050686] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-02T18:34:03.472997] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-04. [2025-10-02T18:34:03.980239] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-02T18:34:04.273015] [INFO ] [REMOTE ] E: Fetching primary data for 2025-08. [2025-10-02T18:34:04.849672] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-02T18:34:05.073044] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-07. [2025-10-02T18:34:05.577733] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-02T18:34:05.873013] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-05. [2025-10-02T18:34:06.673061] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-09. [2025-10-02T18:34:07.365212] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-02T18:34:07.473026] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-08. [2025-10-02T18:34:07.512474] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-02T18:34:08.151799] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-02T18:34:08.273009] [INFO ] [REMOTE ] E: Fetching primary data for 2025-09. [2025-10-02T18:34:09.073058] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-10. [2025-10-02T18:34:09.352560] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-02T18:34:09.794399] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-02T18:34:09.873032] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-09. [2025-10-02T18:34:10.109006] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-02T18:34:10.110461] [INFO ] [REMOTE ] DY: Full fetch complete (44552 records). [2025-10-02T18:34:10.110558] [DEBUG] [VALIDATOR ] DY: Validating primary data. [2025-10-02T18:34:10.543434] [DEBUG] [VALIDATOR ] DY: All expected trading days are present. [2025-10-02T18:34:10.543520] [DEBUG] [VALIDATOR ] DY: Primary data validation passed. [2025-10-02T18:34:10.544152] [INFO ] [MAIN ] DY: Fetched primary data is valid. [2025-10-02T18:34:10.544218] [DEBUG] [LOCAL ] DY: Saving primary data. [2025-10-02T18:34:10.545472] [DEBUG] [LOCAL ] DY: Trimmed 44552 records to 29225 (keeping 200 days of data) [2025-10-02T18:34:10.673558] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-06. [2025-10-02T18:34:10.734163] [DEBUG] [LOCAL ] DY: Primary data saved (29225 records). [2025-10-02T18:34:10.734291] [INFO ] [MAIN ] DY: Full history saved. [2025-10-02T18:34:10.735095] [INFO ] [MAIN ] Update Progress: 673/2370 symbols completed. DY took 32.6s. Estimated remaining: 3h 57m 19s. Rate: 7.2 symbols/min [2025-10-02T18:34:10.910172] [INFO ] [MAIN ] EAI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:34:10.917225] [DEBUG] [LOCAL ] EAI: Loaded 3969 existing records from primary storage. [2025-10-02T18:34:10.917447] [INFO ] [MAIN ] EAI: Loaded 3969 existing records. [2025-10-02T18:34:11.115688] [WARN ] [MAIN ] EAI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:34:11.115994] [INFO ] [MAIN ] EAI: Wiping existing primary data before full refresh. [2025-10-02T18:34:11.116062] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-10-02T18:34:11.116508] [DEBUG] [LOCAL ] EAI: Deleted primary data file. [2025-10-02T18:34:11.116587] [INFO ] [MAIN ] EAI: Starting full primary refresh. [2025-10-02T18:34:11.473382] [INFO ] [REMOTE ] E: Fetching primary data for 2025-10. [2025-10-02T18:34:11.512977] [INFO ] [REMOTE ] EAI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:34:11.953621] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-02T18:34:12.272999] [INFO ] [REMOTE ] EAI: Fetching primary data for 2024-12. [2025-10-02T18:34:12.499737] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-02T18:34:12.713856] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-02T18:34:12.715601] [INFO ] [REMOTE ] E: Full fetch complete (48268 records). [2025-10-02T18:34:12.715731] [DEBUG] [VALIDATOR ] E: Validating primary data. [2025-10-02T18:34:13.059572] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-02T18:34:13.092399] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-01. [2025-10-02T18:34:13.150082] [DEBUG] [VALIDATOR ] E: All expected trading days are present. [2025-10-02T18:34:13.150166] [DEBUG] [VALIDATOR ] E: Primary data validation passed. [2025-10-02T18:34:13.150842] [INFO ] [MAIN ] E: Fetched primary data is valid. [2025-10-02T18:34:13.150906] [DEBUG] [LOCAL ] E: Saving primary data. [2025-10-02T18:34:13.152167] [DEBUG] [LOCAL ] E: Trimmed 48268 records to 33524 (keeping 200 days of data) [2025-10-02T18:34:13.365327] [DEBUG] [LOCAL ] E: Primary data saved (33524 records). [2025-10-02T18:34:13.365474] [INFO ] [MAIN ] E: Full history saved. [2025-10-02T18:34:13.365558] [INFO ] [MAIN ] Update Progress: 674/2370 symbols completed. E took 30.2s. Estimated remaining: 3h 56m 56s. Rate: 7.2 symbols/min [2025-10-02T18:34:13.566787] [INFO ] [MAIN ] EARN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:34:13.598455] [DEBUG] [LOCAL ] EARN: Loaded 29659 existing records from primary storage. [2025-10-02T18:34:13.598791] [INFO ] [MAIN ] EARN: Loaded 29659 existing records. [2025-10-02T18:34:13.713163] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-02T18:34:13.816696] [WARN ] [MAIN ] EARN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:34:13.816930] [INFO ] [MAIN ] EARN: Wiping existing primary data before full refresh. [2025-10-02T18:34:13.816980] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-10-02T18:34:13.818050] [DEBUG] [LOCAL ] EARN: Deleted primary data file. [2025-10-02T18:34:13.818129] [INFO ] [MAIN ] EARN: Starting full primary refresh. [2025-10-02T18:34:13.879438] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-10. [2025-10-02T18:34:14.258543] [INFO ] [REMOTE ] EARN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:34:14.673025] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-07. [2025-10-02T18:34:15.473015] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-02. [2025-10-02T18:34:15.887885] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-02T18:34:15.890132] [INFO ] [REMOTE ] DXYZ: Full fetch complete (57789 records). [2025-10-02T18:34:15.890232] [DEBUG] [VALIDATOR ] DXYZ: Validating primary data. [2025-10-02T18:34:16.084626] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-02T18:34:16.281071] [INFO ] [REMOTE ] EARN: Fetching primary data for 2024-12. [2025-10-02T18:34:16.318627] [DEBUG] [VALIDATOR ] DXYZ: All expected trading days are present. [2025-10-02T18:34:16.318732] [DEBUG] [VALIDATOR ] DXYZ: Primary data validation passed. [2025-10-02T18:34:16.319440] [INFO ] [MAIN ] DXYZ: Fetched primary data is valid. [2025-10-02T18:34:16.319609] [DEBUG] [LOCAL ] DXYZ: Saving primary data. [2025-10-02T18:34:16.320960] [DEBUG] [LOCAL ] DXYZ: Trimmed 57789 records to 37235 (keeping 200 days of data) [2025-10-02T18:34:16.548512] [DEBUG] [LOCAL ] DXYZ: Primary data saved (37235 records). [2025-10-02T18:34:16.548678] [INFO ] [MAIN ] DXYZ: Full history saved. [2025-10-02T18:34:16.548797] [INFO ] [MAIN ] Update Progress: 675/2370 symbols completed. DXYZ took 46.3s. Estimated remaining: 3h 56m 35s. Rate: 7.2 symbols/min [2025-10-02T18:34:16.746540] [INFO ] [MAIN ] EAT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:34:16.836697] [DEBUG] [LOCAL ] EAT: Loaded 49771 existing records from primary storage. [2025-10-02T18:34:16.839169] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-02T18:34:16.839507] [INFO ] [MAIN ] EAT: Loaded 49771 existing records. [2025-10-02T18:34:17.091817] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-03. [2025-10-02T18:34:17.097211] [WARN ] [MAIN ] EAT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:34:17.098525] [INFO ] [MAIN ] EAT: Wiping existing primary data before full refresh. [2025-10-02T18:34:17.098626] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-10-02T18:34:17.100271] [DEBUG] [LOCAL ] EAT: Deleted primary data file. [2025-10-02T18:34:17.100337] [INFO ] [MAIN ] EAT: Starting full primary refresh. [2025-10-02T18:34:17.496114] [INFO ] [REMOTE ] EAT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:34:17.722434] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-02T18:34:17.873010] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-04. [2025-10-02T18:34:18.318155] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-02T18:34:18.535665] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-02T18:34:18.673016] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-08. [2025-10-02T18:34:19.473037] [INFO ] [REMOTE ] EAT: Fetching primary data for 2024-12. [2025-10-02T18:34:20.150176] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-02T18:34:20.273000] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-09. [2025-10-02T18:34:21.073002] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-05. [2025-10-02T18:34:21.527374] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-02T18:34:21.592509] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-02T18:34:21.635320] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-02T18:34:21.872999] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-01. [2025-10-02T18:34:22.673008] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-10. [2025-10-02T18:34:23.473011] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-01. [2025-10-02T18:34:23.552572] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-02T18:34:23.629209] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-02T18:34:23.630982] [INFO ] [REMOTE ] EAF: Full fetch complete (63579 records). [2025-10-02T18:34:23.631102] [DEBUG] [VALIDATOR ] EAF: Validating primary data. [2025-10-02T18:34:24.089003] [DEBUG] [VALIDATOR ] EAF: All expected trading days are present. [2025-10-02T18:34:24.089084] [DEBUG] [VALIDATOR ] EAF: Primary data validation passed. [2025-10-02T18:34:24.089842] [INFO ] [MAIN ] EAF: Fetched primary data is valid. [2025-10-02T18:34:24.089905] [DEBUG] [LOCAL ] EAF: Saving primary data. [2025-10-02T18:34:24.091230] [DEBUG] [LOCAL ] EAF: Trimmed 63579 records to 42985 (keeping 200 days of data) [2025-10-02T18:34:24.294022] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-02. [2025-10-02T18:34:24.356150] [DEBUG] [LOCAL ] EAF: Primary data saved (42985 records). [2025-10-02T18:34:24.356355] [INFO ] [MAIN ] EAF: Full history saved. [2025-10-02T18:34:24.356503] [INFO ] [MAIN ] Update Progress: 676/2370 symbols completed. EAF took 36.5s. Estimated remaining: 3h 56m 25s. Rate: 7.2 symbols/min [2025-10-02T18:34:24.576053] [INFO ] [MAIN ] EB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:34:24.613795] [DEBUG] [LOCAL ] EB: Loaded 37100 existing records from primary storage. [2025-10-02T18:34:24.614180] [INFO ] [MAIN ] EB: Loaded 37100 existing records. [2025-10-02T18:34:24.837024] [WARN ] [MAIN ] EB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:34:24.837244] [INFO ] [MAIN ] EB: Wiping existing primary data before full refresh. [2025-10-02T18:34:24.837295] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-10-02T18:34:24.838513] [DEBUG] [LOCAL ] EB: Deleted primary data file. [2025-10-02T18:34:24.838592] [INFO ] [MAIN ] EB: Starting full primary refresh. [2025-10-02T18:34:25.081098] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-06. [2025-10-02T18:34:25.203104] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-02T18:34:25.296961] [INFO ] [REMOTE ] EB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:34:25.832574] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-02T18:34:25.873014] [INFO ] [REMOTE ] EB: Fetching primary data for 2024-12. [2025-10-02T18:34:26.235381] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-02T18:34:26.673010] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-07. [2025-10-02T18:34:27.250625] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-02T18:34:27.472968] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-08. [2025-10-02T18:34:27.669508] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-02T18:34:27.869291] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-02T18:34:28.272999] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-09. [2025-10-02T18:34:28.862840] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-02T18:34:29.072999] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-10. [2025-10-02T18:34:29.458618] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-02T18:34:29.459600] [INFO ] [REMOTE ] EAI: Full fetch complete (6131 records). [2025-10-02T18:34:29.459700] [DEBUG] [VALIDATOR ] EAI: Validating primary data. [2025-10-02T18:34:29.460129] [FATAL] [VALIDATOR ] EAI: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:34:29.460214] [FATAL] [MAIN ] EAI: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:34:29.460323] [WARN ] [MAIN ] EAI: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:34:29.460400] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-10-02T18:34:29.460490] [DEBUG] [LOCAL ] EAI: No primary data file found to delete. [2025-10-02T18:34:29.460553] [INFO ] [LOCAL ] EAI: Starting deletion of derivative data. [2025-10-02T18:34:29.461029] [DEBUG] [LOCAL ] EAI: Deleted derivative data file. [2025-10-02T18:34:29.461122] [INFO ] [MAIN ] Update Progress: 677/2370 symbols completed. EAI took 18.7s. Estimated remaining: 3h 56m 8s. Rate: 7.2 symbols/min [2025-10-02T18:34:29.872986] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-02. [2025-10-02T18:34:30.673004] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-03. [2025-10-02T18:34:31.423604] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-02T18:34:31.472989] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-03. [2025-10-02T18:34:32.239534] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-02T18:34:32.273030] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-01. [2025-10-02T18:34:33.073175] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-04. [2025-10-02T18:34:33.074550] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-02T18:34:33.759985] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-02T18:34:33.872997] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-02. [2025-10-02T18:34:34.672982] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-04. [2025-10-02T18:34:34.854558] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-02T18:34:35.306808] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-02T18:34:35.473012] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-03. [2025-10-02T18:34:36.258949] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-02T18:34:36.272974] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-05. [2025-10-02T18:34:36.945903] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-02T18:34:37.073056] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-04. [2025-10-02T18:34:37.748367] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-02T18:34:37.873067] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-06. [2025-10-02T18:34:38.661864] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-02T18:34:38.672952] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-05. [2025-10-02T18:34:38.994434] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-02T18:34:39.472995] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-07. [2025-10-02T18:34:40.070794] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-02T18:34:40.273124] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-06. [2025-10-02T18:34:40.980718] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-02T18:34:41.073066] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-05. [2025-10-02T18:34:41.629940] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-02T18:34:41.873051] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-08. [2025-10-02T18:34:42.673042] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-07. [2025-10-02T18:34:43.139861] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-02T18:34:43.300881] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-02T18:34:43.472965] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-06. [2025-10-02T18:34:44.275128] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-09. [2025-10-02T18:34:44.276869] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-02T18:34:45.015175] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-02T18:34:45.073028] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-07. [2025-10-02T18:34:45.417144] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-02T18:34:45.873002] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-08. [2025-10-02T18:34:46.673056] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-10. [2025-10-02T18:34:46.971351] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-02T18:34:47.285791] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-02T18:34:47.473051] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-08. [2025-10-02T18:34:47.590887] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-02T18:34:47.592489] [INFO ] [REMOTE ] EARN: Full fetch complete (46022 records). [2025-10-02T18:34:47.592590] [DEBUG] [VALIDATOR ] EARN: Validating primary data. [2025-10-02T18:34:47.999792] [DEBUG] [VALIDATOR ] EARN: All expected trading days are present. [2025-10-02T18:34:47.999888] [DEBUG] [VALIDATOR ] EARN: Primary data validation passed. [2025-10-02T18:34:48.000524] [INFO ] [MAIN ] EARN: Fetched primary data is valid. [2025-10-02T18:34:48.000574] [DEBUG] [LOCAL ] EARN: Saving primary data. [2025-10-02T18:34:48.001762] [DEBUG] [LOCAL ] EARN: Trimmed 46022 records to 29843 (keeping 200 days of data) [2025-10-02T18:34:48.191505] [DEBUG] [LOCAL ] EARN: Primary data saved (29843 records). [2025-10-02T18:34:48.191686] [INFO ] [MAIN ] EARN: Full history saved. [2025-10-02T18:34:48.191788] [INFO ] [MAIN ] Update Progress: 678/2370 symbols completed. EARN took 34.8s. Estimated remaining: 3h 56m 26s. Rate: 7.2 symbols/min [2025-10-02T18:34:48.273019] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-09. [2025-10-02T18:34:49.163575] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-02T18:34:49.174406] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-09. [2025-10-02T18:34:49.717449] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-02T18:34:49.873003] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-10. [2025-10-02T18:34:50.943719] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-02T18:34:50.945447] [INFO ] [REMOTE ] EB: Full fetch complete (55971 records). [2025-10-02T18:34:50.945569] [DEBUG] [VALIDATOR ] EB: Validating primary data. [2025-10-02T18:34:50.946453] [FATAL] [VALIDATOR ] EB: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:34:50.946580] [FATAL] [MAIN ] EB: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:34:50.946637] [WARN ] [MAIN ] EB: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:34:50.946752] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-10-02T18:34:50.946833] [DEBUG] [LOCAL ] EB: No primary data file found to delete. [2025-10-02T18:34:50.946883] [INFO ] [LOCAL ] EB: Starting deletion of derivative data. [2025-10-02T18:34:50.947534] [DEBUG] [LOCAL ] EB: Deleted derivative data file. [2025-10-02T18:34:50.947686] [INFO ] [MAIN ] Update Progress: 679/2370 symbols completed. EB took 26.6s. Estimated remaining: 3h 56m 3s. Rate: 7.2 symbols/min [2025-10-02T18:34:51.063536] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-02T18:34:51.075205] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-10. [2025-10-02T18:34:52.587844] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-02T18:34:52.589965] [INFO ] [REMOTE ] EAT: Full fetch complete (71954 records). [2025-10-02T18:34:52.590131] [DEBUG] [VALIDATOR ] EAT: Validating primary data. [2025-10-02T18:34:53.019141] [DEBUG] [VALIDATOR ] EAT: All expected trading days are present. [2025-10-02T18:34:53.019248] [DEBUG] [VALIDATOR ] EAT: Primary data validation passed. [2025-10-02T18:34:53.020244] [INFO ] [MAIN ] EAT: Fetched primary data is valid. [2025-10-02T18:34:53.020316] [DEBUG] [LOCAL ] EAT: Saving primary data. [2025-10-02T18:34:53.022000] [DEBUG] [LOCAL ] EAT: Trimmed 71954 records to 50148 (keeping 200 days of data) [2025-10-02T18:34:53.341349] [DEBUG] [LOCAL ] EAT: Primary data saved (50148 records). [2025-10-02T18:34:53.341512] [INFO ] [MAIN ] EAT: Full history saved. [2025-10-02T18:34:53.341614] [INFO ] [MAIN ] Update Progress: 680/2370 symbols completed. EAT took 36.8s. Estimated remaining: 3h 55m 40s. Rate: 7.2 symbols/min [2025-10-02T18:34:53.977170] [INFO ] [MAIN ] EBF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:34:54.060095] [INFO ] [MAIN ] EBS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:34:54.095406] [DEBUG] [LOCAL ] EBS: No existing data file found in primary storage. [2025-10-02T18:34:54.110456] [WARN ] [MAIN ] EBS: No existing data found, performing full refresh instead. [2025-10-02T18:34:54.136424] [INFO ] [MAIN ] EBS: Wiping existing primary data before full refresh. [2025-10-02T18:34:54.137674] [INFO ] [MAIN ] EBR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:34:54.158786] [INFO ] [LOCAL ] EBS: Starting deletion of primary data. [2025-10-02T18:34:54.159213] [DEBUG] [LOCAL ] EBS: No primary data file found to delete. [2025-10-02T18:34:54.158687] [INFO ] [MAIN ] EC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:34:54.159838] [INFO ] [MAIN ] EBS: Starting full primary refresh. [2025-10-02T18:34:54.159957] [DEBUG] [LOCAL ] EC: No existing data file found in primary storage. [2025-10-02T18:34:54.187471] [WARN ] [MAIN ] EC: No existing data found, performing full refresh instead. [2025-10-02T18:34:54.187811] [INFO ] [MAIN ] EC: Wiping existing primary data before full refresh. [2025-10-02T18:34:54.187870] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-10-02T18:34:54.200202] [DEBUG] [LOCAL ] EC: No primary data file found to delete. [2025-10-02T18:34:54.200409] [INFO ] [MAIN ] EC: Starting full primary refresh. [2025-10-02T18:34:54.274370] [DEBUG] [LOCAL ] EBF: Loaded 19238 existing records from primary storage. [2025-10-02T18:34:54.322369] [INFO ] [MAIN ] EBF: Loaded 19238 existing records. [2025-10-02T18:34:54.759229] [DEBUG] [LOCAL ] EBR: Loaded 43061 existing records from primary storage. [2025-10-02T18:34:54.878082] [INFO ] [MAIN ] EBR: Loaded 43061 existing records. [2025-10-02T18:34:55.044226] [WARN ] [MAIN ] EBF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:34:55.102330] [INFO ] [MAIN ] EBF: Wiping existing primary data before full refresh. [2025-10-02T18:34:55.132075] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-10-02T18:34:55.267314] [INFO ] [REMOTE ] EBS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:34:55.274778] [INFO ] [REMOTE ] EBS: Fetching primary data for 2024-12. [2025-10-02T18:34:55.274453] [DEBUG] [LOCAL ] EBF: Deleted primary data file. [2025-10-02T18:34:55.302539] [INFO ] [MAIN ] EBF: Starting full primary refresh. [2025-10-02T18:34:55.473476] [INFO ] [REMOTE ] EC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:34:55.518634] [INFO ] [REMOTE ] EC: Fetching primary data for 2024-12. [2025-10-02T18:34:55.562997] [WARN ] [MAIN ] EBR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:34:55.573200] [INFO ] [MAIN ] EBR: Wiping existing primary data before full refresh. [2025-10-02T18:34:55.582975] [INFO ] [LOCAL ] EBR: Starting deletion of primary data. [2025-10-02T18:34:55.592892] [DEBUG] [LOCAL ] EBR: Deleted primary data file. [2025-10-02T18:34:55.592995] [INFO ] [MAIN ] EBR: Starting full primary refresh. [2025-10-02T18:34:56.191006] [INFO ] [REMOTE ] EBF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:34:56.204253] [INFO ] [REMOTE ] EBF: Fetching primary data for 2024-12. [2025-10-02T18:34:56.295871] [INFO ] [REMOTE ] EBR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:34:56.296239] [INFO ] [REMOTE ] EBR: Fetching primary data for 2024-12. [2025-10-02T18:34:57.092761] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-02T18:34:57.102597] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-01. [2025-10-02T18:34:57.567839] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-02T18:34:57.578860] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-01. [2025-10-02T18:34:57.662090] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-02T18:34:57.665903] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-01. [2025-10-02T18:34:58.171540] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-02T18:34:58.181835] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-01. [2025-10-02T18:34:58.209188] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-02T18:34:58.219699] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-02. [2025-10-02T18:34:58.603121] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-02T18:34:58.673018] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-02. [2025-10-02T18:34:58.862005] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-02T18:34:59.457839] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-02T18:34:59.472957] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-02. [2025-10-02T18:34:59.502313] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-02T18:34:59.551563] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-02T18:35:00.273033] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-03. [2025-10-02T18:35:01.072973] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-03. [2025-10-02T18:35:01.503909] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-02T18:35:01.557273] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-02T18:35:01.873022] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-03. [2025-10-02T18:35:02.673032] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-02. [2025-10-02T18:35:03.099027] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-02T18:35:03.473001] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-04. [2025-10-02T18:35:03.826829] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-02T18:35:04.043813] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-02T18:35:04.272972] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-03. [2025-10-02T18:35:04.597717] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-02T18:35:05.073016] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-04. [2025-10-02T18:35:05.872980] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-04. [2025-10-02T18:35:05.942081] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-02T18:35:06.683234] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-04. [2025-10-02T18:35:06.705901] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-02T18:35:07.473013] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-05. [2025-10-02T18:35:07.654490] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-02T18:35:08.100791] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-02T18:35:08.272994] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-05. [2025-10-02T18:35:08.616602] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-02T18:35:09.073009] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-05. [2025-10-02T18:35:09.852030] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-02T18:35:09.872964] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-06. [2025-10-02T18:35:10.533449] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-02T18:35:10.673013] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-06. [2025-10-02T18:35:11.472987] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-05. [2025-10-02T18:35:11.516083] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-02T18:35:11.750318] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-02T18:35:12.273003] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-06. [2025-10-02T18:35:12.958323] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-02T18:35:13.073030] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-07. [2025-10-02T18:35:13.575245] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-02T18:35:13.872995] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-06. [2025-10-02T18:35:14.396476] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-02T18:35:14.672994] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-08. [2025-10-02T18:35:15.269591] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-02T18:35:15.473029] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-07. [2025-10-02T18:35:16.249419] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-02T18:35:16.280761] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-08. [2025-10-02T18:35:16.286883] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-02T18:35:17.072960] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-07. [2025-10-02T18:35:17.389476] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-02T18:35:17.873010] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-09. [2025-10-02T18:35:18.442368] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-02T18:35:18.673057] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-07. [2025-10-02T18:35:19.472983] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-08. [2025-10-02T18:35:19.571548] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-02T18:35:20.272972] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-10. [2025-10-02T18:35:20.344059] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-02T18:35:21.073013] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-09. [2025-10-02T18:35:21.392130] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-02T18:35:21.442604] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-02T18:35:21.444138] [INFO ] [REMOTE ] EBS: Full fetch complete (67029 records). [2025-10-02T18:35:21.444305] [DEBUG] [VALIDATOR ] EBS: Validating primary data. [2025-10-02T18:35:21.445229] [FATAL] [VALIDATOR ] EBS: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:35:21.445339] [FATAL] [MAIN ] EBS: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:35:21.445401] [WARN ] [MAIN ] EBS: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:35:21.445479] [INFO ] [LOCAL ] EBS: Starting deletion of primary data. [2025-10-02T18:35:21.445554] [DEBUG] [LOCAL ] EBS: No primary data file found to delete. [2025-10-02T18:35:21.445603] [INFO ] [LOCAL ] EBS: Starting deletion of derivative data. [2025-10-02T18:35:21.445708] [DEBUG] [LOCAL ] EBS: No derivative data file found to delete. [2025-10-02T18:35:21.445804] [INFO ] [MAIN ] Update Progress: 681/2370 symbols completed. EBS took 28.1s. Estimated remaining: 3h 56m 21s. Rate: 7.1 symbols/min [2025-10-02T18:35:21.630634] [INFO ] [MAIN ] ECAT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:35:21.672998] [DEBUG] [LOCAL ] ECAT: Loaded 29543 existing records from primary storage. [2025-10-02T18:35:21.673257] [INFO ] [MAIN ] ECAT: Loaded 29543 existing records. [2025-10-02T18:35:21.870429] [WARN ] [MAIN ] ECAT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:35:21.871064] [INFO ] [MAIN ] ECAT: Wiping existing primary data before full refresh. [2025-10-02T18:35:21.871115] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-10-02T18:35:21.872209] [DEBUG] [LOCAL ] ECAT: Deleted primary data file. [2025-10-02T18:35:21.872274] [INFO ] [MAIN ] ECAT: Starting full primary refresh. [2025-10-02T18:35:21.884189] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-08. [2025-10-02T18:35:22.324631] [INFO ] [REMOTE ] ECAT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:35:22.325876] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-02T18:35:22.673000] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-09. [2025-10-02T18:35:23.460939] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-02T18:35:23.472967] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-09. [2025-10-02T18:35:24.273010] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-10. [2025-10-02T18:35:24.319183] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-02T18:35:24.736847] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-02T18:35:24.900812] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-02T18:35:24.901826] [INFO ] [REMOTE ] EBF: Full fetch complete (27347 records). [2025-10-02T18:35:24.901903] [DEBUG] [VALIDATOR ] EBF: Validating primary data. [2025-10-02T18:35:24.902450] [FATAL] [VALIDATOR ] EBF: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:35:24.902535] [FATAL] [MAIN ] EBF: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:35:24.902580] [WARN ] [MAIN ] EBF: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:35:24.902621] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-10-02T18:35:24.902711] [DEBUG] [LOCAL ] EBF: No primary data file found to delete. [2025-10-02T18:35:24.902761] [INFO ] [LOCAL ] EBF: Starting deletion of derivative data. [2025-10-02T18:35:24.903158] [DEBUG] [LOCAL ] EBF: Deleted derivative data file. [2025-10-02T18:35:24.903248] [INFO ] [MAIN ] Update Progress: 682/2370 symbols completed. EBF took 31.6s. Estimated remaining: 3h 56m 0s. Rate: 7.2 symbols/min [2025-10-02T18:35:25.082161] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-10. [2025-10-02T18:35:25.115057] [INFO ] [MAIN ] ECC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:35:25.159786] [DEBUG] [LOCAL ] ECC: Loaded 43320 existing records from primary storage. [2025-10-02T18:35:25.160105] [INFO ] [MAIN ] ECC: Loaded 43320 existing records. [2025-10-02T18:35:25.406931] [WARN ] [MAIN ] ECC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:35:25.407202] [INFO ] [MAIN ] ECC: Wiping existing primary data before full refresh. [2025-10-02T18:35:25.407262] [INFO ] [LOCAL ] ECC: Starting deletion of primary data. [2025-10-02T18:35:25.408612] [DEBUG] [LOCAL ] ECC: Deleted primary data file. [2025-10-02T18:35:25.408708] [INFO ] [MAIN ] ECC: Starting full primary refresh. [2025-10-02T18:35:25.817275] [INFO ] [REMOTE ] ECC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:35:25.872984] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-10. [2025-10-02T18:35:26.365977] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-02T18:35:26.367760] [INFO ] [REMOTE ] EBR: Full fetch complete (62615 records). [2025-10-02T18:35:26.367852] [DEBUG] [VALIDATOR ] EBR: Validating primary data. [2025-10-02T18:35:26.678095] [INFO ] [REMOTE ] ECC: Fetching primary data for 2024-12. [2025-10-02T18:35:26.803599] [DEBUG] [VALIDATOR ] EBR: All expected trading days are present. [2025-10-02T18:35:26.803724] [DEBUG] [VALIDATOR ] EBR: Primary data validation passed. [2025-10-02T18:35:26.804616] [INFO ] [MAIN ] EBR: Fetched primary data is valid. [2025-10-02T18:35:26.804743] [DEBUG] [LOCAL ] EBR: Saving primary data. [2025-10-02T18:35:26.806125] [DEBUG] [LOCAL ] EBR: Trimmed 62615 records to 43379 (keeping 200 days of data) [2025-10-02T18:35:27.075291] [DEBUG] [LOCAL ] EBR: Primary data saved (43379 records). [2025-10-02T18:35:27.075460] [INFO ] [MAIN ] EBR: Full history saved. [2025-10-02T18:35:27.075578] [INFO ] [MAIN ] Update Progress: 683/2370 symbols completed. EBR took 33.7s. Estimated remaining: 3h 55m 36s. Rate: 7.2 symbols/min [2025-10-02T18:35:27.279768] [INFO ] [MAIN ] ECCC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:35:27.280104] [DEBUG] [LOCAL ] ECCC: No existing data file found in primary storage. [2025-10-02T18:35:27.280164] [WARN ] [MAIN ] ECCC: No existing data found, performing full refresh instead. [2025-10-02T18:35:27.280284] [INFO ] [MAIN ] ECCC: Wiping existing primary data before full refresh. [2025-10-02T18:35:27.280338] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-02T18:35:27.280392] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-02T18:35:27.280434] [INFO ] [MAIN ] ECCC: Starting full primary refresh. [2025-10-02T18:35:27.385989] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-02T18:35:27.410339] [INFO ] [REMOTE ] EC: Full fetch complete (71911 records). [2025-10-02T18:35:27.420770] [DEBUG] [VALIDATOR ] EC: Validating primary data. [2025-10-02T18:35:27.483569] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2024-12. [2025-10-02T18:35:27.997669] [INFO ] [REMOTE ] ECCC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:35:28.227401] [DEBUG] [VALIDATOR ] EC: All expected trading days are present. [2025-10-02T18:35:28.227517] [DEBUG] [VALIDATOR ] EC: Primary data validation passed. [2025-10-02T18:35:28.228527] [INFO ] [MAIN ] EC: Fetched primary data is valid. [2025-10-02T18:35:28.228636] [DEBUG] [LOCAL ] EC: Saving primary data. [2025-10-02T18:35:28.230326] [DEBUG] [LOCAL ] EC: Trimmed 71911 records to 49591 (keeping 200 days of data) [2025-10-02T18:35:28.283775] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2024-12. [2025-10-02T18:35:28.476223] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-02T18:35:28.578725] [DEBUG] [LOCAL ] EC: Primary data saved (49591 records). [2025-10-02T18:35:28.578873] [INFO ] [MAIN ] EC: Full history saved. [2025-10-02T18:35:28.578966] [INFO ] [MAIN ] Update Progress: 684/2370 symbols completed. EC took 35.2s. Estimated remaining: 3h 55m 11s. Rate: 7.2 symbols/min [2025-10-02T18:35:28.776058] [INFO ] [MAIN ] ECCU: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:35:28.776439] [DEBUG] [LOCAL ] ECCU: No existing data file found in primary storage. [2025-10-02T18:35:28.776602] [WARN ] [MAIN ] ECCU: No existing data found, performing full refresh instead. [2025-10-02T18:35:28.776806] [INFO ] [MAIN ] ECCU: Wiping existing primary data before full refresh. [2025-10-02T18:35:28.776875] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-10-02T18:35:28.777039] [DEBUG] [LOCAL ] ECCU: No primary data file found to delete. [2025-10-02T18:35:28.777181] [INFO ] [MAIN ] ECCU: Starting full primary refresh. [2025-10-02T18:35:28.911790] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-02T18:35:29.015887] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-02T18:35:29.078578] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-01. [2025-10-02T18:35:29.207487] [INFO ] [REMOTE ] ECCU: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:35:29.872997] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2024-12. [2025-10-02T18:35:30.411204] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-02T18:35:30.429773] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-02T18:35:30.673004] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-01. [2025-10-02T18:35:31.071667] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-02T18:35:31.473048] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-02. [2025-10-02T18:35:31.900419] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-02T18:35:32.273055] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-02. [2025-10-02T18:35:33.073072] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-01. [2025-10-02T18:35:33.589963] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-02T18:35:33.873002] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-03. [2025-10-02T18:35:34.201443] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-02T18:35:34.633264] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-02T18:35:34.672977] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-03. [2025-10-02T18:35:35.472947] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-02. [2025-10-02T18:35:36.025281] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-02T18:35:36.273047] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-01. [2025-10-02T18:35:36.904738] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-02T18:35:36.904540] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-02T18:35:37.073025] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-02. [2025-10-02T18:35:37.596755] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-02T18:35:37.872998] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-04. [2025-10-02T18:35:38.673014] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-03. [2025-10-02T18:35:39.263285] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-02T18:35:39.473027] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-05. [2025-10-02T18:35:40.273011] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-04. [2025-10-02T18:35:40.323162] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-02T18:35:40.507475] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-02T18:35:40.645241] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-02T18:35:41.073010] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-05. [2025-10-02T18:35:41.553220] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-02T18:35:41.873018] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-06. [2025-10-02T18:35:42.230084] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-02T18:35:42.673036] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-06. [2025-10-02T18:35:43.473016] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-04. [2025-10-02T18:35:43.929422] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-02T18:35:44.273060] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-07. [2025-10-02T18:35:45.073009] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-07. [2025-10-02T18:35:45.410322] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-02T18:35:45.616546] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-02T18:35:45.637795] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-02T18:35:45.872989] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-05. [2025-10-02T18:35:46.673095] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-08. [2025-10-02T18:35:47.035036] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-02T18:35:47.478122] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-03. [2025-10-02T18:35:47.491491] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-02T18:35:48.258152] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-02T18:35:48.272990] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-04. [2025-10-02T18:35:48.637932] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-02T18:35:49.073042] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-08. [2025-10-02T18:35:49.872990] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-09. [2025-10-02T18:35:50.185473] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-02T18:35:50.573375] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-02T18:35:50.673020] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-06. [2025-10-02T18:35:51.473000] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-05. [2025-10-02T18:35:51.921608] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-02T18:35:52.229738] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-02T18:35:52.272967] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-07. [2025-10-02T18:35:53.073007] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-10. [2025-10-02T18:35:53.511871] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-02T18:35:53.513118] [INFO ] [REMOTE ] ECCC: Full fetch complete (1296 records). [2025-10-02T18:35:53.513206] [DEBUG] [VALIDATOR ] ECCC: Validating primary data. [2025-10-02T18:35:53.728832] [WARN ] [VALIDATOR ] ECCC: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-02T18:35:53.729026] [FATAL] [MAIN ] ECCC: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:35:53.729218] [WARN ] [MAIN ] ECCC: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:35:53.729417] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-02T18:35:53.729516] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-02T18:35:53.729584] [INFO ] [LOCAL ] ECCC: Starting deletion of derivative data. [2025-10-02T18:35:53.729674] [DEBUG] [LOCAL ] ECCC: No derivative data file found to delete. [2025-10-02T18:35:53.729871] [INFO ] [MAIN ] Update Progress: 685/2370 symbols completed. ECCC took 26.7s. Estimated remaining: 3h 55m 44s. Rate: 7.1 symbols/min [2025-10-02T18:35:53.892984] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-09. [2025-10-02T18:35:53.925454] [INFO ] [MAIN ] ECCW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:35:53.925836] [DEBUG] [LOCAL ] ECCW: No existing data file found in primary storage. [2025-10-02T18:35:53.927180] [WARN ] [MAIN ] ECCW: No existing data found, performing full refresh instead. [2025-10-02T18:35:53.955346] [INFO ] [MAIN ] ECCW: Wiping existing primary data before full refresh. [2025-10-02T18:35:53.955694] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-02T18:35:53.957503] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-02T18:35:53.956187] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-02T18:35:53.968245] [INFO ] [MAIN ] ECCW: Starting full primary refresh. [2025-10-02T18:35:54.372468] [INFO ] [REMOTE ] ECCW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:35:54.673058] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-06. [2025-10-02T18:35:55.125741] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-02T18:35:55.127168] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-02T18:35:55.473052] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-08. [2025-10-02T18:35:56.273041] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2024-12. [2025-10-02T18:35:56.905350] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-02T18:35:57.073074] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-01. [2025-10-02T18:35:57.303491] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-02T18:35:57.402198] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-02T18:35:57.873002] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-07. [2025-10-02T18:35:58.420350] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-02T18:35:58.673002] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-09. [2025-10-02T18:35:59.473046] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-08. [2025-10-02T18:35:59.999316] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-02T18:36:00.273012] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-09. [2025-10-02T18:36:00.351368] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-02T18:36:00.948899] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-02T18:36:01.072986] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-10. [2025-10-02T18:36:01.873013] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-10. [2025-10-02T18:36:02.522813] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-02T18:36:02.524822] [INFO ] [REMOTE ] ECC: Full fetch complete (61061 records). [2025-10-02T18:36:02.525004] [DEBUG] [VALIDATOR ] ECC: Validating primary data. [2025-10-02T18:36:02.680108] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-02. [2025-10-02T18:36:02.950170] [DEBUG] [VALIDATOR ] ECC: All expected trading days are present. [2025-10-02T18:36:02.950263] [DEBUG] [VALIDATOR ] ECC: Primary data validation passed. [2025-10-02T18:36:02.951088] [INFO ] [MAIN ] ECC: Fetched primary data is valid. [2025-10-02T18:36:02.951186] [DEBUG] [LOCAL ] ECC: Saving primary data. [2025-10-02T18:36:02.952736] [DEBUG] [LOCAL ] ECC: Trimmed 61061 records to 43668 (keeping 200 days of data) [2025-10-02T18:36:03.048800] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-02T18:36:03.055134] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-02T18:36:03.062049] [INFO ] [REMOTE ] ECAT: Full fetch complete (42721 records). [2025-10-02T18:36:03.063685] [DEBUG] [VALIDATOR ] ECAT: Validating primary data. [2025-10-02T18:36:03.067267] [FATAL] [VALIDATOR ] ECAT: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:36:03.068303] [FATAL] [MAIN ] ECAT: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:36:03.069242] [WARN ] [MAIN ] ECAT: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:36:03.069327] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-10-02T18:36:03.070252] [DEBUG] [LOCAL ] ECAT: No primary data file found to delete. [2025-10-02T18:36:03.070952] [INFO ] [LOCAL ] ECAT: Starting deletion of derivative data. [2025-10-02T18:36:03.071868] [DEBUG] [LOCAL ] ECAT: Deleted derivative data file. [2025-10-02T18:36:03.072680] [INFO ] [MAIN ] Update Progress: 686/2370 symbols completed. ECAT took 41.6s. Estimated remaining: 3h 55m 38s. Rate: 7.1 symbols/min [2025-10-02T18:36:03.308478] [INFO ] [MAIN ] ECCX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:36:03.309411] [DEBUG] [LOCAL ] ECCX: No existing data file found in primary storage. [2025-10-02T18:36:03.310071] [WARN ] [MAIN ] ECCX: No existing data found, performing full refresh instead. [2025-10-02T18:36:03.310774] [INFO ] [MAIN ] ECCX: Wiping existing primary data before full refresh. [2025-10-02T18:36:03.311135] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-02T18:36:03.311685] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-02T18:36:03.312376] [INFO ] [MAIN ] ECCX: Starting full primary refresh. [2025-10-02T18:36:03.504032] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-03. [2025-10-02T18:36:03.832226] [INFO ] [REMOTE ] ECCX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:36:03.878288] [DEBUG] [LOCAL ] ECC: Primary data saved (43668 records). [2025-10-02T18:36:03.878453] [INFO ] [MAIN ] ECC: Full history saved. [2025-10-02T18:36:03.879348] [INFO ] [MAIN ] Update Progress: 687/2370 symbols completed. ECC took 39.0s. Estimated remaining: 3h 55m 11s. Rate: 7.2 symbols/min [2025-10-02T18:36:04.062254] [INFO ] [MAIN ] ECG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:36:04.109140] [DEBUG] [LOCAL ] ECG: Loaded 33834 existing records from primary storage. [2025-10-02T18:36:04.109427] [INFO ] [MAIN ] ECG: Loaded 33834 existing records. [2025-10-02T18:36:04.278235] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2024-12. [2025-10-02T18:36:04.310026] [WARN ] [MAIN ] ECG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:36:04.310540] [INFO ] [MAIN ] ECG: Wiping existing primary data before full refresh. [2025-10-02T18:36:04.310603] [INFO ] [LOCAL ] ECG: Starting deletion of primary data. [2025-10-02T18:36:04.311752] [DEBUG] [LOCAL ] ECG: Deleted primary data file. [2025-10-02T18:36:04.311815] [INFO ] [MAIN ] ECG: Starting full primary refresh. [2025-10-02T18:36:04.592368] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-02T18:36:04.717277] [INFO ] [REMOTE ] ECG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:36:04.991586] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-02T18:36:05.072998] [INFO ] [REMOTE ] ECG: Fetching primary data for 2024-12. [2025-10-02T18:36:05.872988] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-04. [2025-10-02T18:36:06.315677] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-02T18:36:06.472553] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-02T18:36:06.672999] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-01. [2025-10-02T18:36:07.075422] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-02T18:36:07.473009] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-05. [2025-10-02T18:36:07.982488] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-02T18:36:08.273004] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-10. [2025-10-02T18:36:08.774037] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-02T18:36:08.774791] [INFO ] [REMOTE ] ECCU: Full fetch complete (4487 records). [2025-10-02T18:36:08.774864] [DEBUG] [VALIDATOR ] ECCU: Validating primary data. [2025-10-02T18:36:08.968510] [WARN ] [VALIDATOR ] ECCU: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-02T18:36:08.968744] [FATAL] [MAIN ] ECCU: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:36:08.968815] [WARN ] [MAIN ] ECCU: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:36:08.968887] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-10-02T18:36:08.968986] [DEBUG] [LOCAL ] ECCU: No primary data file found to delete. [2025-10-02T18:36:08.969043] [INFO ] [LOCAL ] ECCU: Starting deletion of derivative data. [2025-10-02T18:36:08.969088] [DEBUG] [LOCAL ] ECCU: No derivative data file found to delete. [2025-10-02T18:36:08.969147] [INFO ] [MAIN ] Update Progress: 688/2370 symbols completed. ECCU took 40.4s. Estimated remaining: 3h 54m 54s. Rate: 7.2 symbols/min [2025-10-02T18:36:09.078169] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-01. [2025-10-02T18:36:09.156456] [INFO ] [MAIN ] ECL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:36:09.231133] [DEBUG] [LOCAL ] ECL: Loaded 46734 existing records from primary storage. [2025-10-02T18:36:09.231473] [INFO ] [MAIN ] ECL: Loaded 46734 existing records. [2025-10-02T18:36:09.452436] [WARN ] [MAIN ] ECL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:36:09.452681] [INFO ] [MAIN ] ECL: Wiping existing primary data before full refresh. [2025-10-02T18:36:09.452742] [INFO ] [LOCAL ] ECL: Starting deletion of primary data. [2025-10-02T18:36:09.454280] [DEBUG] [LOCAL ] ECL: Deleted primary data file. [2025-10-02T18:36:09.454362] [INFO ] [MAIN ] ECL: Starting full primary refresh. [2025-10-02T18:36:09.867149] [INFO ] [REMOTE ] ECL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:36:09.872957] [INFO ] [REMOTE ] ECL: Fetching primary data for 2024-12. [2025-10-02T18:36:10.457015] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-02T18:36:10.673027] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-06. [2025-10-02T18:36:11.071881] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-02T18:36:11.472984] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-07. [2025-10-02T18:36:11.784975] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-02T18:36:11.805458] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-02T18:36:12.272998] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-02. [2025-10-02T18:36:13.072985] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-02. [2025-10-02T18:36:13.403543] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-02T18:36:13.872996] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-03. [2025-10-02T18:36:13.971200] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-02T18:36:14.567496] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-02T18:36:14.673017] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-03. [2025-10-02T18:36:15.473047] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-01. [2025-10-02T18:36:16.147619] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-02T18:36:16.273024] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-04. [2025-10-02T18:36:16.824882] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-02T18:36:16.827888] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-02T18:36:17.072992] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-05. [2025-10-02T18:36:17.562325] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-02T18:36:17.873005] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-04. [2025-10-02T18:36:18.673007] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-08. [2025-10-02T18:36:19.257402] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-02T18:36:19.420069] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-02T18:36:19.472996] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-09. [2025-10-02T18:36:19.810326] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-02T18:36:20.272995] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-06. [2025-10-02T18:36:20.596001] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-02T18:36:21.072999] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-02. [2025-10-02T18:36:21.872995] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-07. [2025-10-02T18:36:22.291938] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-02T18:36:22.673001] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-08. [2025-10-02T18:36:22.859042] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-02T18:36:22.991901] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-02T18:36:23.473006] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-09. [2025-10-02T18:36:23.887715] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-02T18:36:24.273008] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-10. [2025-10-02T18:36:24.638879] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-02T18:36:24.639564] [INFO ] [REMOTE ] ECCX: Full fetch complete (1523 records). [2025-10-02T18:36:24.639634] [DEBUG] [VALIDATOR ] ECCX: Validating primary data. [2025-10-02T18:36:24.855061] [WARN ] [VALIDATOR ] ECCX: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-02T18:36:24.855257] [FATAL] [MAIN ] ECCX: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:36:24.855320] [WARN ] [MAIN ] ECCX: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:36:24.855389] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-02T18:36:24.855502] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-02T18:36:24.855555] [INFO ] [LOCAL ] ECCX: Starting deletion of derivative data. [2025-10-02T18:36:24.855599] [DEBUG] [LOCAL ] ECCX: No derivative data file found to delete. [2025-10-02T18:36:24.855756] [INFO ] [MAIN ] Update Progress: 689/2370 symbols completed. ECCX took 21.8s. Estimated remaining: 3h 55m 4s. Rate: 7.2 symbols/min [2025-10-02T18:36:25.040193] [INFO ] [MAIN ] ECO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:36:25.068426] [DEBUG] [LOCAL ] ECO: Loaded 18402 existing records from primary storage. [2025-10-02T18:36:25.068796] [INFO ] [MAIN ] ECO: Loaded 18402 existing records. [2025-10-02T18:36:25.081597] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-10. [2025-10-02T18:36:25.273405] [WARN ] [MAIN ] ECO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:36:25.273698] [INFO ] [MAIN ] ECO: Wiping existing primary data before full refresh. [2025-10-02T18:36:25.273763] [INFO ] [LOCAL ] ECO: Starting deletion of primary data. [2025-10-02T18:36:25.274509] [DEBUG] [LOCAL ] ECO: Deleted primary data file. [2025-10-02T18:36:25.274569] [INFO ] [MAIN ] ECO: Starting full primary refresh. [2025-10-02T18:36:25.574563] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-02T18:36:25.575776] [INFO ] [REMOTE ] ECCW: Full fetch complete (1424 records). [2025-10-02T18:36:25.591623] [DEBUG] [VALIDATOR ] ECCW: Validating primary data. [2025-10-02T18:36:25.782831] [INFO ] [REMOTE ] ECO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:36:25.863911] [WARN ] [VALIDATOR ] ECCW: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-10-02T18:36:25.864103] [FATAL] [MAIN ] ECCW: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:36:25.864172] [WARN ] [MAIN ] ECCW: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:36:25.864245] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-02T18:36:25.864311] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-02T18:36:25.864348] [INFO ] [LOCAL ] ECCW: Starting deletion of derivative data. [2025-10-02T18:36:25.864388] [DEBUG] [LOCAL ] ECCW: No derivative data file found to delete. [2025-10-02T18:36:25.864446] [INFO ] [MAIN ] Update Progress: 690/2370 symbols completed. ECCW took 32.1s. Estimated remaining: 3h 54m 38s. Rate: 7.2 symbols/min [2025-10-02T18:36:25.878095] [INFO ] [REMOTE ] ECO: Fetching primary data for 2024-12. [2025-10-02T18:36:26.048382] [INFO ] [MAIN ] ECVT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:36:26.048546] [DEBUG] [LOCAL ] ECVT: No existing data file found in primary storage. [2025-10-02T18:36:26.048583] [WARN ] [MAIN ] ECVT: No existing data found, performing full refresh instead. [2025-10-02T18:36:26.048724] [INFO ] [MAIN ] ECVT: Wiping existing primary data before full refresh. [2025-10-02T18:36:26.048807] [INFO ] [LOCAL ] ECVT: Starting deletion of primary data. [2025-10-02T18:36:26.048866] [DEBUG] [LOCAL ] ECVT: No primary data file found to delete. [2025-10-02T18:36:26.048901] [INFO ] [MAIN ] ECVT: Starting full primary refresh. [2025-10-02T18:36:26.434059] [INFO ] [REMOTE ] ECVT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:36:26.673046] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2024-12. [2025-10-02T18:36:27.384637] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-02T18:36:27.472942] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-05. [2025-10-02T18:36:28.278377] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-01. [2025-10-02T18:36:28.290121] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-02T18:36:29.046491] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-02T18:36:29.072962] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-06. [2025-10-02T18:36:29.304897] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-02T18:36:29.872999] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-02. [2025-10-02T18:36:30.314318] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-02T18:36:30.673014] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-07. [2025-10-02T18:36:31.035529] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-02T18:36:31.473039] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-03. [2025-10-02T18:36:31.724509] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-02T18:36:32.273003] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-08. [2025-10-02T18:36:32.341402] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-02T18:36:33.072995] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-04. [2025-10-02T18:36:33.708399] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-02T18:36:33.873000] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-01. [2025-10-02T18:36:34.139459] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-02T18:36:34.673006] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-05. [2025-10-02T18:36:35.292590] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-02T18:36:35.416951] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-02T18:36:35.473006] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-06. [2025-10-02T18:36:36.273022] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-09. [2025-10-02T18:36:36.664141] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-02T18:36:37.073007] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-07. [2025-10-02T18:36:37.509505] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-02T18:36:37.872966] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-03. [2025-10-02T18:36:38.179198] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-02T18:36:38.673050] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-10. [2025-10-02T18:36:39.473008] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-02. [2025-10-02T18:36:39.881309] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-02T18:36:39.896385] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-02T18:36:39.898139] [INFO ] [REMOTE ] ECG: Full fetch complete (51308 records). [2025-10-02T18:36:39.898249] [DEBUG] [VALIDATOR ] ECG: Validating primary data. [2025-10-02T18:36:40.279507] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-08. [2025-10-02T18:36:40.328808] [DEBUG] [VALIDATOR ] ECG: All expected trading days are present. [2025-10-02T18:36:40.328891] [DEBUG] [VALIDATOR ] ECG: Primary data validation passed. [2025-10-02T18:36:40.329783] [INFO ] [MAIN ] ECG: Fetched primary data is valid. [2025-10-02T18:36:40.329853] [DEBUG] [LOCAL ] ECG: Saving primary data. [2025-10-02T18:36:40.331246] [DEBUG] [LOCAL ] ECG: Trimmed 51308 records to 34056 (keeping 200 days of data) [2025-10-02T18:36:40.550553] [DEBUG] [LOCAL ] ECG: Primary data saved (34056 records). [2025-10-02T18:36:40.550746] [INFO ] [MAIN ] ECG: Full history saved. [2025-10-02T18:36:40.551627] [INFO ] [MAIN ] Update Progress: 691/2370 symbols completed. ECG took 36.7s. Estimated remaining: 3h 54m 45s. Rate: 7.2 symbols/min [2025-10-02T18:36:40.738254] [INFO ] [MAIN ] ED: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:36:40.795704] [DEBUG] [LOCAL ] ED: Loaded 52758 existing records from primary storage. [2025-10-02T18:36:40.796025] [INFO ] [MAIN ] ED: Loaded 52758 existing records. [2025-10-02T18:36:41.016752] [WARN ] [MAIN ] ED: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:36:41.018690] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-02T18:36:41.026298] [INFO ] [MAIN ] ED: Wiping existing primary data before full refresh. [2025-10-02T18:36:41.026769] [INFO ] [LOCAL ] ED: Starting deletion of primary data. [2025-10-02T18:36:41.028415] [DEBUG] [LOCAL ] ED: Deleted primary data file. [2025-10-02T18:36:41.028476] [INFO ] [MAIN ] ED: Starting full primary refresh. [2025-10-02T18:36:41.078138] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-03. [2025-10-02T18:36:41.510868] [INFO ] [REMOTE ] ED: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:36:41.512017] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-02T18:36:41.872985] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-04. [2025-10-02T18:36:42.678169] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-09. [2025-10-02T18:36:42.698280] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-02T18:36:43.473088] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-04. [2025-10-02T18:36:43.778901] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-02T18:36:43.831065] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-02T18:36:44.273044] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-05. [2025-10-02T18:36:44.728450] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-02T18:36:45.073013] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-10. [2025-10-02T18:36:45.872984] [INFO ] [REMOTE ] ED: Fetching primary data for 2024-12. [2025-10-02T18:36:45.950948] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-02T18:36:45.983818] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-02T18:36:45.985040] [INFO ] [REMOTE ] ECO: Full fetch complete (28986 records). [2025-10-02T18:36:45.985122] [DEBUG] [VALIDATOR ] ECO: Validating primary data. [2025-10-02T18:36:46.418503] [DEBUG] [VALIDATOR ] ECO: All expected trading days are present. [2025-10-02T18:36:46.418595] [DEBUG] [VALIDATOR ] ECO: Primary data validation passed. [2025-10-02T18:36:46.419223] [INFO ] [MAIN ] ECO: Fetched primary data is valid. [2025-10-02T18:36:46.419295] [DEBUG] [LOCAL ] ECO: Saving primary data. [2025-10-02T18:36:46.420116] [DEBUG] [LOCAL ] ECO: Trimmed 28986 records to 18558 (keeping 200 days of data) [2025-10-02T18:36:46.543338] [DEBUG] [LOCAL ] ECO: Primary data saved (18558 records). [2025-10-02T18:36:46.543507] [INFO ] [MAIN ] ECO: Full history saved. [2025-10-02T18:36:46.543605] [INFO ] [MAIN ] Update Progress: 692/2370 symbols completed. ECO took 21.7s. Estimated remaining: 3h 54m 31s. Rate: 7.2 symbols/min [2025-10-02T18:36:46.678120] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-06. [2025-10-02T18:36:46.737699] [INFO ] [MAIN ] EDD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:36:46.765247] [DEBUG] [LOCAL ] EDD: Loaded 27172 existing records from primary storage. [2025-10-02T18:36:46.765521] [INFO ] [MAIN ] EDD: Loaded 27172 existing records. [2025-10-02T18:36:46.953569] [WARN ] [MAIN ] EDD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:36:46.953862] [INFO ] [MAIN ] EDD: Wiping existing primary data before full refresh. [2025-10-02T18:36:46.953916] [INFO ] [LOCAL ] EDD: Starting deletion of primary data. [2025-10-02T18:36:46.955002] [DEBUG] [LOCAL ] EDD: Deleted primary data file. [2025-10-02T18:36:46.955062] [INFO ] [MAIN ] EDD: Starting full primary refresh. [2025-10-02T18:36:47.396740] [INFO ] [REMOTE ] EDD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:36:47.473022] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-05. [2025-10-02T18:36:47.762813] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-02T18:36:48.272968] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-01. [2025-10-02T18:36:48.507846] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-02T18:36:48.730961] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-02T18:36:49.073029] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-06. [2025-10-02T18:36:49.754816] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-02T18:36:49.873015] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-07. [2025-10-02T18:36:50.268065] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-02T18:36:50.673028] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-02. [2025-10-02T18:36:51.333983] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-02T18:36:51.473028] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-08. [2025-10-02T18:36:52.273024] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-07. [2025-10-02T18:36:52.337893] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-02T18:36:52.908980] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-02T18:36:53.073027] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-09. [2025-10-02T18:36:53.872980] [INFO ] [REMOTE ] EDD: Fetching primary data for 2024-12. [2025-10-02T18:36:54.132720] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-02T18:36:54.673015] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-08. [2025-10-02T18:36:54.825928] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-02T18:36:55.198344] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-02T18:36:55.473053] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-10. [2025-10-02T18:36:56.208462] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-02T18:36:56.272974] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-09. [2025-10-02T18:36:56.853751] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-02T18:36:56.857548] [INFO ] [REMOTE ] ECL: Full fetch complete (68023 records). [2025-10-02T18:36:56.857687] [DEBUG] [VALIDATOR ] ECL: Validating primary data. [2025-10-02T18:36:57.080518] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-03. [2025-10-02T18:36:57.296126] [DEBUG] [VALIDATOR ] ECL: All expected trading days are present. [2025-10-02T18:36:57.296252] [DEBUG] [VALIDATOR ] ECL: Primary data validation passed. [2025-10-02T18:36:57.297110] [INFO ] [MAIN ] ECL: Fetched primary data is valid. [2025-10-02T18:36:57.297174] [DEBUG] [LOCAL ] ECL: Saving primary data. [2025-10-02T18:36:57.298624] [DEBUG] [LOCAL ] ECL: Trimmed 68023 records to 47096 (keeping 200 days of data) [2025-10-02T18:36:57.559597] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-02T18:36:57.646868] [DEBUG] [LOCAL ] ECL: Primary data saved (47096 records). [2025-10-02T18:36:57.647005] [INFO ] [MAIN ] ECL: Full history saved. [2025-10-02T18:36:57.647090] [INFO ] [MAIN ] Update Progress: 693/2370 symbols completed. ECL took 48.7s. Estimated remaining: 3h 54m 29s. Rate: 7.2 symbols/min [2025-10-02T18:36:57.849563] [INFO ] [MAIN ] EDF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:36:57.864398] [DEBUG] [LOCAL ] EDF: Loaded 13369 existing records from primary storage. [2025-10-02T18:36:57.864660] [INFO ] [MAIN ] EDF: Loaded 13369 existing records. [2025-10-02T18:36:57.878226] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-10. [2025-10-02T18:36:58.070559] [WARN ] [MAIN ] EDF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:36:58.070834] [INFO ] [MAIN ] EDF: Wiping existing primary data before full refresh. [2025-10-02T18:36:58.070900] [INFO ] [LOCAL ] EDF: Starting deletion of primary data. [2025-10-02T18:36:58.071512] [DEBUG] [LOCAL ] EDF: Deleted primary data file. [2025-10-02T18:36:58.071577] [INFO ] [MAIN ] EDF: Starting full primary refresh. [2025-10-02T18:36:58.455812] [INFO ] [REMOTE ] EDF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:36:58.672989] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-01. [2025-10-02T18:36:59.033223] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-02T18:36:59.301947] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-02T18:36:59.304300] [INFO ] [REMOTE ] ECVT: Full fetch complete (60184 records). [2025-10-02T18:36:59.304402] [DEBUG] [VALIDATOR ] ECVT: Validating primary data. [2025-10-02T18:36:59.473752] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-04. [2025-10-02T18:36:59.732301] [DEBUG] [VALIDATOR ] ECVT: All expected trading days are present. [2025-10-02T18:36:59.732420] [DEBUG] [VALIDATOR ] ECVT: Primary data validation passed. [2025-10-02T18:36:59.733189] [INFO ] [MAIN ] ECVT: Fetched primary data is valid. [2025-10-02T18:36:59.733253] [DEBUG] [LOCAL ] ECVT: Saving primary data. [2025-10-02T18:36:59.735499] [DEBUG] [LOCAL ] ECVT: Trimmed 60184 records to 43382 (keeping 200 days of data) [2025-10-02T18:36:59.852080] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-02T18:37:00.022497] [DEBUG] [LOCAL ] ECVT: Primary data saved (43382 records). [2025-10-02T18:37:00.022665] [INFO ] [MAIN ] ECVT: Full history saved. [2025-10-02T18:37:00.022760] [INFO ] [MAIN ] Update Progress: 694/2370 symbols completed. ECVT took 34.2s. Estimated remaining: 3h 54m 6s. Rate: 7.2 symbols/min [2025-10-02T18:37:00.208779] [INFO ] [MAIN ] EDN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:37:00.229370] [DEBUG] [LOCAL ] EDN: Loaded 18154 existing records from primary storage. [2025-10-02T18:37:00.229701] [INFO ] [MAIN ] EDN: Loaded 18154 existing records. [2025-10-02T18:37:00.278200] [INFO ] [REMOTE ] EDF: Fetching primary data for 2024-12. [2025-10-02T18:37:00.437572] [WARN ] [MAIN ] EDN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:37:00.437864] [INFO ] [MAIN ] EDN: Wiping existing primary data before full refresh. [2025-10-02T18:37:00.437927] [INFO ] [LOCAL ] EDN: Starting deletion of primary data. [2025-10-02T18:37:00.438689] [DEBUG] [LOCAL ] EDN: Deleted primary data file. [2025-10-02T18:37:00.438752] [INFO ] [MAIN ] EDN: Starting full primary refresh. [2025-10-02T18:37:00.854726] [INFO ] [REMOTE ] EDN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:37:01.072990] [INFO ] [REMOTE ] EDN: Fetching primary data for 2024-12. [2025-10-02T18:37:01.570573] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-02T18:37:01.583917] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-02T18:37:01.872994] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-05. [2025-10-02T18:37:02.638219] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-02T18:37:02.673035] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-02. [2025-10-02T18:37:03.472973] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-01. [2025-10-02T18:37:03.713408] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-02T18:37:03.756748] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-02T18:37:04.272986] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-01. [2025-10-02T18:37:04.375016] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-02T18:37:05.073015] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-03. [2025-10-02T18:37:05.675008] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-02T18:37:05.873014] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-02. [2025-10-02T18:37:06.266143] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-02T18:37:06.673023] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-06. [2025-10-02T18:37:06.952854] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-02T18:37:07.473003] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-03. [2025-10-02T18:37:08.177900] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-02T18:37:08.219400] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-02T18:37:08.273028] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-04. [2025-10-02T18:37:09.073009] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-04. [2025-10-02T18:37:09.419266] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-02T18:37:09.858344] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-02T18:37:09.872959] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-05. [2025-10-02T18:37:10.673005] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-02. [2025-10-02T18:37:11.147534] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-02T18:37:11.473015] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-06. [2025-10-02T18:37:11.811549] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-02T18:37:12.272990] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-03. [2025-10-02T18:37:12.567762] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-02T18:37:13.073000] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-07. [2025-10-02T18:37:13.445006] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-02T18:37:13.873010] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-05. [2025-10-02T18:37:14.672985] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-04. [2025-10-02T18:37:14.863238] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-02T18:37:15.006047] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-02T18:37:15.421084] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-02T18:37:15.473001] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-06. [2025-10-02T18:37:16.272986] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-07. [2025-10-02T18:37:16.295329] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-02T18:37:17.072997] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-05. [2025-10-02T18:37:17.615170] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-02T18:37:17.872984] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-07. [2025-10-02T18:37:18.194129] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-02T18:37:18.673012] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-06. [2025-10-02T18:37:18.850482] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-02T18:37:19.411090] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-02T18:37:19.472988] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-08. [2025-10-02T18:37:20.246271] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-02T18:37:20.272956] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-08. [2025-10-02T18:37:21.073003] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-08. [2025-10-02T18:37:21.652808] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-02T18:37:21.872988] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-09. [2025-10-02T18:37:22.672995] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-07. [2025-10-02T18:37:22.837099] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-02T18:37:23.162864] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-02T18:37:23.472993] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-09. [2025-10-02T18:37:23.528742] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-02T18:37:24.273927] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-08. [2025-10-02T18:37:24.277288] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-02T18:37:25.072976] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-10. [2025-10-02T18:37:25.235526] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-02T18:37:25.872999] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-09. [2025-10-02T18:37:26.069227] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-02T18:37:26.070782] [INFO ] [REMOTE ] EDD: Full fetch complete (38815 records). [2025-10-02T18:37:26.070864] [DEBUG] [VALIDATOR ] EDD: Validating primary data. [2025-10-02T18:37:26.482475] [DEBUG] [VALIDATOR ] EDD: All expected trading days are present. [2025-10-02T18:37:26.482612] [DEBUG] [VALIDATOR ] EDD: Primary data validation passed. [2025-10-02T18:37:26.483498] [INFO ] [MAIN ] EDD: Fetched primary data is valid. [2025-10-02T18:37:26.483578] [DEBUG] [LOCAL ] EDD: Saving primary data. [2025-10-02T18:37:26.485002] [DEBUG] [LOCAL ] EDD: Trimmed 38815 records to 27357 (keeping 200 days of data) [2025-10-02T18:37:26.663593] [DEBUG] [LOCAL ] EDD: Primary data saved (27357 records). [2025-10-02T18:37:26.663782] [INFO ] [MAIN ] EDD: Full history saved. [2025-10-02T18:37:26.663876] [INFO ] [MAIN ] Update Progress: 695/2370 symbols completed. EDD took 40.1s. Estimated remaining: 3h 54m 42s. Rate: 7.1 symbols/min [2025-10-02T18:37:26.678841] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-09. [2025-10-02T18:37:26.855248] [INFO ] [MAIN ] EDU: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:37:26.901679] [DEBUG] [LOCAL ] EDU: Loaded 44983 existing records from primary storage. [2025-10-02T18:37:26.902076] [INFO ] [MAIN ] EDU: Loaded 44983 existing records. [2025-10-02T18:37:27.115911] [WARN ] [MAIN ] EDU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:37:27.116291] [INFO ] [MAIN ] EDU: Wiping existing primary data before full refresh. [2025-10-02T18:37:27.116477] [INFO ] [LOCAL ] EDU: Starting deletion of primary data. [2025-10-02T18:37:27.118784] [DEBUG] [LOCAL ] EDU: Deleted primary data file. [2025-10-02T18:37:27.118912] [INFO ] [MAIN ] EDU: Starting full primary refresh. [2025-10-02T18:37:27.260088] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-02T18:37:27.478186] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-10. [2025-10-02T18:37:27.553327] [INFO ] [REMOTE ] EDU: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:37:28.273106] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-10. [2025-10-02T18:37:28.304773] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-02T18:37:28.305724] [INFO ] [REMOTE ] EDF: Full fetch complete (20847 records). [2025-10-02T18:37:28.305799] [DEBUG] [VALIDATOR ] EDF: Validating primary data. [2025-10-02T18:37:28.747889] [DEBUG] [VALIDATOR ] EDF: All expected trading days are present. [2025-10-02T18:37:28.748050] [DEBUG] [VALIDATOR ] EDF: Primary data validation passed. [2025-10-02T18:37:28.748833] [INFO ] [MAIN ] EDF: Fetched primary data is valid. [2025-10-02T18:37:28.749002] [DEBUG] [LOCAL ] EDF: Saving primary data. [2025-10-02T18:37:28.750461] [DEBUG] [LOCAL ] EDF: Trimmed 20847 records to 13420 (keeping 200 days of data) [2025-10-02T18:37:28.844994] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-02T18:37:28.879854] [DEBUG] [LOCAL ] EDF: Primary data saved (13420 records). [2025-10-02T18:37:28.879997] [INFO ] [MAIN ] EDF: Full history saved. [2025-10-02T18:37:28.880125] [INFO ] [MAIN ] Update Progress: 696/2370 symbols completed. EDF took 31.2s. Estimated remaining: 3h 54m 18s. Rate: 7.1 symbols/min [2025-10-02T18:37:29.078197] [INFO ] [REMOTE ] EDU: Fetching primary data for 2024-12. [2025-10-02T18:37:29.082056] [INFO ] [MAIN ] EE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:37:29.117469] [DEBUG] [LOCAL ] EE: Loaded 32474 existing records from primary storage. [2025-10-02T18:37:29.117810] [INFO ] [MAIN ] EE: Loaded 32474 existing records. [2025-10-02T18:37:29.311415] [WARN ] [MAIN ] EE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:37:29.311679] [INFO ] [MAIN ] EE: Wiping existing primary data before full refresh. [2025-10-02T18:37:29.311741] [INFO ] [LOCAL ] EE: Starting deletion of primary data. [2025-10-02T18:37:29.314142] [DEBUG] [LOCAL ] EE: Deleted primary data file. [2025-10-02T18:37:29.314204] [INFO ] [MAIN ] EE: Starting full primary refresh. [2025-10-02T18:37:29.433487] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-02T18:37:29.435258] [INFO ] [REMOTE ] EDN: Full fetch complete (30141 records). [2025-10-02T18:37:29.445870] [DEBUG] [VALIDATOR ] EDN: Validating primary data. [2025-10-02T18:37:29.885731] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-10. [2025-10-02T18:37:30.011928] [INFO ] [REMOTE ] EE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:37:30.138140] [DEBUG] [VALIDATOR ] EDN: All expected trading days are present. [2025-10-02T18:37:30.138233] [DEBUG] [VALIDATOR ] EDN: Primary data validation passed. [2025-10-02T18:37:30.138832] [INFO ] [MAIN ] EDN: Fetched primary data is valid. [2025-10-02T18:37:30.138901] [DEBUG] [LOCAL ] EDN: Saving primary data. [2025-10-02T18:37:30.139768] [DEBUG] [LOCAL ] EDN: Trimmed 30141 records to 18336 (keeping 200 days of data) [2025-10-02T18:37:30.252438] [DEBUG] [LOCAL ] EDN: Primary data saved (18336 records). [2025-10-02T18:37:30.252589] [INFO ] [MAIN ] EDN: Full history saved. [2025-10-02T18:37:30.252703] [INFO ] [MAIN ] Update Progress: 697/2370 symbols completed. EDN took 30.2s. Estimated remaining: 3h 53m 53s. Rate: 7.2 symbols/min [2025-10-02T18:37:30.446594] [INFO ] [MAIN ] EEA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:37:30.446969] [DEBUG] [LOCAL ] EEA: No existing data file found in primary storage. [2025-10-02T18:37:30.447092] [WARN ] [MAIN ] EEA: No existing data found, performing full refresh instead. [2025-10-02T18:37:30.447226] [INFO ] [MAIN ] EEA: Wiping existing primary data before full refresh. [2025-10-02T18:37:30.447270] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-02T18:37:30.447314] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-02T18:37:30.447347] [INFO ] [MAIN ] EEA: Starting full primary refresh. [2025-10-02T18:37:30.681906] [INFO ] [REMOTE ] EE: Fetching primary data for 2024-12. [2025-10-02T18:37:30.890563] [INFO ] [REMOTE ] EEA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:37:30.909780] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-02T18:37:31.473023] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-01. [2025-10-02T18:37:31.526442] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-02T18:37:31.528864] [INFO ] [REMOTE ] ED: Full fetch complete (76332 records). [2025-10-02T18:37:31.528995] [DEBUG] [VALIDATOR ] ED: Validating primary data. [2025-10-02T18:37:31.999463] [DEBUG] [VALIDATOR ] ED: All expected trading days are present. [2025-10-02T18:37:31.999690] [DEBUG] [VALIDATOR ] ED: Primary data validation passed. [2025-10-02T18:37:32.000735] [INFO ] [MAIN ] ED: Fetched primary data is valid. [2025-10-02T18:37:32.000822] [DEBUG] [LOCAL ] ED: Saving primary data. [2025-10-02T18:37:32.019573] [DEBUG] [LOCAL ] ED: Trimmed 76332 records to 53131 (keeping 200 days of data) [2025-10-02T18:37:32.019432] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-02T18:37:32.274688] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-01. [2025-10-02T18:37:32.378976] [DEBUG] [LOCAL ] ED: Primary data saved (53131 records). [2025-10-02T18:37:32.379123] [INFO ] [MAIN ] ED: Full history saved. [2025-10-02T18:37:32.379979] [INFO ] [MAIN ] Update Progress: 698/2370 symbols completed. ED took 51.8s. Estimated remaining: 3h 53m 30s. Rate: 7.2 symbols/min [2025-10-02T18:37:32.566897] [INFO ] [MAIN ] EEX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:37:32.581012] [DEBUG] [LOCAL ] EEX: Loaded 11493 existing records from primary storage. [2025-10-02T18:37:32.581269] [INFO ] [MAIN ] EEX: Loaded 11493 existing records. [2025-10-02T18:37:32.799381] [WARN ] [MAIN ] EEX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:37:32.799839] [INFO ] [MAIN ] EEX: Wiping existing primary data before full refresh. [2025-10-02T18:37:32.799897] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-10-02T18:37:32.800798] [DEBUG] [LOCAL ] EEX: Deleted primary data file. [2025-10-02T18:37:32.800862] [INFO ] [MAIN ] EEX: Starting full primary refresh. [2025-10-02T18:37:33.079177] [INFO ] [REMOTE ] EEA: Fetching primary data for 2024-12. [2025-10-02T18:37:33.202177] [INFO ] [REMOTE ] EEX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:37:33.234751] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-02T18:37:33.335964] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-02T18:37:33.742582] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-02T18:37:33.873017] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-02. [2025-10-02T18:37:34.673001] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-01. [2025-10-02T18:37:35.024089] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-02T18:37:35.473030] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-02. [2025-10-02T18:37:35.581877] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-02T18:37:36.273022] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-02. [2025-10-02T18:37:36.529441] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-02T18:37:36.720959] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-02T18:37:37.073010] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-03. [2025-10-02T18:37:37.395180] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-02T18:37:37.873006] [INFO ] [REMOTE ] EEX: Fetching primary data for 2024-12. [2025-10-02T18:37:38.673014] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-03. [2025-10-02T18:37:38.963213] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-02T18:37:39.473041] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-01. [2025-10-02T18:37:40.273018] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-04. [2025-10-02T18:37:40.360860] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-02T18:37:40.403437] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-02T18:37:40.853373] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-02T18:37:41.073025] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-05. [2025-10-02T18:37:41.549317] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-02T18:37:41.872993] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-06. [2025-10-02T18:37:42.404528] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-02T18:37:42.673000] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-07. [2025-10-02T18:37:43.288159] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-02T18:37:43.473030] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-08. [2025-10-02T18:37:44.047264] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-02T18:37:44.273038] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-03. [2025-10-02T18:37:45.073004] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-09. [2025-10-02T18:37:45.675197] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-02T18:37:45.694333] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-02T18:37:45.872982] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-10. [2025-10-02T18:37:46.271610] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-02T18:37:46.272732] [INFO ] [REMOTE ] EEA: Full fetch complete (3908 records). [2025-10-02T18:37:46.272835] [DEBUG] [VALIDATOR ] EEA: Validating primary data. [2025-10-02T18:37:46.479224] [WARN ] [VALIDATOR ] EEA: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-02T18:37:46.479454] [FATAL] [MAIN ] EEA: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:37:46.479525] [WARN ] [MAIN ] EEA: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:37:46.479627] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-02T18:37:46.479753] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-02T18:37:46.479810] [INFO ] [LOCAL ] EEA: Starting deletion of derivative data. [2025-10-02T18:37:46.479855] [DEBUG] [LOCAL ] EEA: No derivative data file found to delete. [2025-10-02T18:37:46.479921] [INFO ] [MAIN ] Update Progress: 699/2370 symbols completed. EEA took 16.2s. Estimated remaining: 3h 53m 35s. Rate: 7.2 symbols/min [2025-10-02T18:37:46.667952] [INFO ] [MAIN ] EFC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:37:46.668117] [DEBUG] [LOCAL ] EFC: No existing data file found in primary storage. [2025-10-02T18:37:46.668190] [WARN ] [MAIN ] EFC: No existing data found, performing full refresh instead. [2025-10-02T18:37:46.668436] [INFO ] [MAIN ] EFC: Wiping existing primary data before full refresh. [2025-10-02T18:37:46.668490] [INFO ] [LOCAL ] EFC: Starting deletion of primary data. [2025-10-02T18:37:46.668538] [DEBUG] [LOCAL ] EFC: No primary data file found to delete. [2025-10-02T18:37:46.668572] [INFO ] [MAIN ] EFC: Starting full primary refresh. [2025-10-02T18:37:46.681733] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-04. [2025-10-02T18:37:47.063698] [INFO ] [REMOTE ] EFC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:37:47.473012] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-04. [2025-10-02T18:37:48.273014] [INFO ] [REMOTE ] EFC: Fetching primary data for 2024-12. [2025-10-02T18:37:48.513704] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-02T18:37:48.954378] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-02T18:37:49.073024] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-05. [2025-10-02T18:37:49.872990] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-02. [2025-10-02T18:37:49.973344] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-02T18:37:50.586916] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-02T18:37:50.672979] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-01. [2025-10-02T18:37:50.775341] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-02T18:37:51.473039] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-03. [2025-10-02T18:37:52.110360] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-02T18:37:52.273024] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-05. [2025-10-02T18:37:52.551442] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-02T18:37:53.073050] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-06. [2025-10-02T18:37:53.277579] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-02T18:37:53.872998] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-06. [2025-10-02T18:37:54.470402] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-02T18:37:54.673024] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-07. [2025-10-02T18:37:55.148184] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-02T18:37:55.473012] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-04. [2025-10-02T18:37:56.273004] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-02. [2025-10-02T18:37:56.374209] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-02T18:37:56.545275] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-02T18:37:57.072996] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-05. [2025-10-02T18:37:57.854719] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-02T18:37:57.881079] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-08. [2025-10-02T18:37:57.886459] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-02T18:37:58.673021] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-03. [2025-10-02T18:37:59.443442] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-02T18:37:59.473033] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-06. [2025-10-02T18:37:59.948593] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-02T18:38:00.121270] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-02T18:38:00.273015] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-07. [2025-10-02T18:38:01.072991] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-04. [2025-10-02T18:38:01.872986] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-07. [2025-10-02T18:38:01.938668] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-02T18:38:02.673897] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-09. [2025-10-02T18:38:02.680108] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-02T18:38:02.733820] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-02T18:38:03.473016] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-08. [2025-10-02T18:38:04.178052] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-02T18:38:04.273000] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-10. [2025-10-02T18:38:04.419392] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-02T18:38:05.073012] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-09. [2025-10-02T18:38:05.466354] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-02T18:38:05.468191] [INFO ] [REMOTE ] EDU: Full fetch complete (66486 records). [2025-10-02T18:38:05.468329] [DEBUG] [VALIDATOR ] EDU: Validating primary data. [2025-10-02T18:38:05.873132] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-08. [2025-10-02T18:38:05.890597] [DEBUG] [VALIDATOR ] EDU: All expected trading days are present. [2025-10-02T18:38:05.890739] [DEBUG] [VALIDATOR ] EDU: Primary data validation passed. [2025-10-02T18:38:05.891600] [INFO ] [MAIN ] EDU: Fetched primary data is valid. [2025-10-02T18:38:05.891801] [DEBUG] [LOCAL ] EDU: Saving primary data. [2025-10-02T18:38:05.893235] [DEBUG] [LOCAL ] EDU: Trimmed 66486 records to 45267 (keeping 200 days of data) [2025-10-02T18:38:06.175781] [DEBUG] [LOCAL ] EDU: Primary data saved (45267 records). [2025-10-02T18:38:06.175923] [INFO ] [MAIN ] EDU: Full history saved. [2025-10-02T18:38:06.176020] [INFO ] [MAIN ] Update Progress: 700/2370 symbols completed. EDU took 39.5s. Estimated remaining: 3h 53m 54s. Rate: 7.1 symbols/min [2025-10-02T18:38:06.367344] [INFO ] [MAIN ] EFR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:38:06.386139] [DEBUG] [LOCAL ] EFR: Loaded 14641 existing records from primary storage. [2025-10-02T18:38:06.386402] [INFO ] [MAIN ] EFR: Loaded 14641 existing records. [2025-10-02T18:38:06.539035] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-02T18:38:06.545931] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-02T18:38:06.640537] [WARN ] [MAIN ] EFR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:38:06.640871] [INFO ] [MAIN ] EFR: Wiping existing primary data before full refresh. [2025-10-02T18:38:06.640963] [INFO ] [LOCAL ] EFR: Starting deletion of primary data. [2025-10-02T18:38:06.641904] [DEBUG] [LOCAL ] EFR: Deleted primary data file. [2025-10-02T18:38:06.641975] [INFO ] [MAIN ] EFR: Starting full primary refresh. [2025-10-02T18:38:06.678145] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-09. [2025-10-02T18:38:07.049487] [INFO ] [REMOTE ] EFR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:38:07.472998] [INFO ] [REMOTE ] EFR: Fetching primary data for 2024-12. [2025-10-02T18:38:07.491469] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-02T18:38:08.273006] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-10. [2025-10-02T18:38:08.622020] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-02T18:38:09.073011] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-05. [2025-10-02T18:38:09.159605] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-02T18:38:09.161616] [INFO ] [REMOTE ] EE: Full fetch complete (43608 records). [2025-10-02T18:38:09.161805] [DEBUG] [VALIDATOR ] EE: Validating primary data. [2025-10-02T18:38:09.610538] [DEBUG] [VALIDATOR ] EE: All expected trading days are present. [2025-10-02T18:38:09.610618] [DEBUG] [VALIDATOR ] EE: Primary data validation passed. [2025-10-02T18:38:09.611334] [INFO ] [MAIN ] EE: Fetched primary data is valid. [2025-10-02T18:38:09.611395] [DEBUG] [LOCAL ] EE: Saving primary data. [2025-10-02T18:38:09.612472] [DEBUG] [LOCAL ] EE: Trimmed 43608 records to 32660 (keeping 200 days of data) [2025-10-02T18:38:09.828812] [DEBUG] [LOCAL ] EE: Primary data saved (32660 records). [2025-10-02T18:38:09.828970] [INFO ] [MAIN ] EE: Full history saved. [2025-10-02T18:38:09.829064] [INFO ] [MAIN ] Update Progress: 701/2370 symbols completed. EE took 40.9s. Estimated remaining: 3h 53m 34s. Rate: 7.1 symbols/min [2025-10-02T18:38:09.878249] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-01. [2025-10-02T18:38:10.022042] [INFO ] [MAIN ] EFT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:38:10.036982] [DEBUG] [LOCAL ] EFT: Loaded 12910 existing records from primary storage. [2025-10-02T18:38:10.037222] [INFO ] [MAIN ] EFT: Loaded 12910 existing records. [2025-10-02T18:38:10.237191] [WARN ] [MAIN ] EFT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:38:10.237494] [INFO ] [MAIN ] EFT: Wiping existing primary data before full refresh. [2025-10-02T18:38:10.237548] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-10-02T18:38:10.238229] [DEBUG] [LOCAL ] EFT: Deleted primary data file. [2025-10-02T18:38:10.238292] [INFO ] [MAIN ] EFT: Starting full primary refresh. [2025-10-02T18:38:10.643114] [INFO ] [REMOTE ] EFT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:38:10.672976] [INFO ] [REMOTE ] EFT: Fetching primary data for 2024-12. [2025-10-02T18:38:10.712888] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-02T18:38:10.730337] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-02T18:38:11.406315] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-02T18:38:11.472976] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-06. [2025-10-02T18:38:12.273004] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-02. [2025-10-02T18:38:13.007379] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-02T18:38:13.072974] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-07. [2025-10-02T18:38:13.120897] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-02T18:38:13.872986] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-03. [2025-10-02T18:38:14.506683] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-02T18:38:14.673039] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-01. [2025-10-02T18:38:14.705162] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-02T18:38:15.473006] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-08. [2025-10-02T18:38:15.527902] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-02T18:38:16.273006] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-02. [2025-10-02T18:38:17.072967] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-10. [2025-10-02T18:38:17.092730] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-02T18:38:17.182846] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-02T18:38:17.869205] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-02T18:38:17.870118] [INFO ] [REMOTE ] EEX: Full fetch complete (19251 records). [2025-10-02T18:38:17.870203] [DEBUG] [VALIDATOR ] EEX: Validating primary data. [2025-10-02T18:38:17.870738] [FATAL] [VALIDATOR ] EEX: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:38:17.870830] [FATAL] [MAIN ] EEX: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:38:17.870874] [WARN ] [MAIN ] EEX: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:38:17.870914] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-10-02T18:38:17.870970] [DEBUG] [LOCAL ] EEX: No primary data file found to delete. [2025-10-02T18:38:17.871004] [INFO ] [LOCAL ] EEX: Starting deletion of derivative data. [2025-10-02T18:38:17.871564] [DEBUG] [LOCAL ] EEX: Deleted derivative data file. [2025-10-02T18:38:17.871697] [INFO ] [MAIN ] Update Progress: 702/2370 symbols completed. EEX took 45.5s. Estimated remaining: 3h 53m 25s. Rate: 7.1 symbols/min [2025-10-02T18:38:17.876988] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-09. [2025-10-02T18:38:18.066305] [INFO ] [MAIN ] EFX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:38:18.119444] [DEBUG] [LOCAL ] EFX: Loaded 44522 existing records from primary storage. [2025-10-02T18:38:18.119808] [INFO ] [MAIN ] EFX: Loaded 44522 existing records. [2025-10-02T18:38:18.315256] [WARN ] [MAIN ] EFX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:38:18.315506] [INFO ] [MAIN ] EFX: Wiping existing primary data before full refresh. [2025-10-02T18:38:18.315567] [INFO ] [LOCAL ] EFX: Starting deletion of primary data. [2025-10-02T18:38:18.317082] [DEBUG] [LOCAL ] EFX: Deleted primary data file. [2025-10-02T18:38:18.317145] [INFO ] [MAIN ] EFX: Starting full primary refresh. [2025-10-02T18:38:18.681166] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-04. [2025-10-02T18:38:18.715919] [INFO ] [REMOTE ] EFX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:38:19.473001] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-03. [2025-10-02T18:38:19.755138] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-02T18:38:19.808315] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-02T18:38:19.963592] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-02T18:38:20.272932] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-04. [2025-10-02T18:38:21.073018] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-10. [2025-10-02T18:38:21.257203] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-02T18:38:21.872987] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-05. [2025-10-02T18:38:22.675912] [INFO ] [REMOTE ] EFX: Fetching primary data for 2024-12. [2025-10-02T18:38:22.677783] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-02T18:38:22.680002] [INFO ] [REMOTE ] EFC: Full fetch complete (66490 records). [2025-10-02T18:38:22.680116] [DEBUG] [VALIDATOR ] EFC: Validating primary data. [2025-10-02T18:38:23.033449] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-02T18:38:23.139664] [DEBUG] [VALIDATOR ] EFC: All expected trading days are present. [2025-10-02T18:38:23.139754] [DEBUG] [VALIDATOR ] EFC: Primary data validation passed. [2025-10-02T18:38:23.140564] [INFO ] [MAIN ] EFC: Fetched primary data is valid. [2025-10-02T18:38:23.140686] [DEBUG] [LOCAL ] EFC: Saving primary data. [2025-10-02T18:38:23.144703] [DEBUG] [LOCAL ] EFC: Trimmed 66490 records to 46536 (keeping 200 days of data) [2025-10-02T18:38:23.445198] [DEBUG] [LOCAL ] EFC: Primary data saved (46536 records). [2025-10-02T18:38:23.445339] [INFO ] [MAIN ] EFC: Full history saved. [2025-10-02T18:38:23.445449] [INFO ] [MAIN ] Update Progress: 703/2370 symbols completed. EFC took 37.0s. Estimated remaining: 3h 53m 10s. Rate: 7.1 symbols/min [2025-10-02T18:38:23.479462] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-05. [2025-10-02T18:38:23.633768] [INFO ] [MAIN ] EFXT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:38:23.664357] [DEBUG] [LOCAL ] EFXT: Loaded 29191 existing records from primary storage. [2025-10-02T18:38:23.664632] [INFO ] [MAIN ] EFXT: Loaded 29191 existing records. [2025-10-02T18:38:23.852814] [WARN ] [MAIN ] EFXT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:38:23.853052] [INFO ] [MAIN ] EFXT: Wiping existing primary data before full refresh. [2025-10-02T18:38:23.853111] [INFO ] [LOCAL ] EFXT: Starting deletion of primary data. [2025-10-02T18:38:23.854297] [DEBUG] [LOCAL ] EFXT: Deleted primary data file. [2025-10-02T18:38:23.854370] [INFO ] [MAIN ] EFXT: Starting full primary refresh. [2025-10-02T18:38:24.272479] [INFO ] [REMOTE ] EFXT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:38:24.273180] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-06. [2025-10-02T18:38:24.371326] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-02T18:38:24.390074] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-02T18:38:24.983858] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-02T18:38:25.073015] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-07. [2025-10-02T18:38:25.872976] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-01. [2025-10-02T18:38:26.005710] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-02T18:38:26.673022] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-06. [2025-10-02T18:38:27.308051] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-02T18:38:27.462290] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-02T18:38:27.472944] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-02. [2025-10-02T18:38:28.273076] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-07. [2025-10-02T18:38:28.910637] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-02T18:38:29.073000] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-08. [2025-10-02T18:38:29.124539] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-02T18:38:29.873006] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-03. [2025-10-02T18:38:29.883317] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-02T18:38:30.673077] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2024-12. [2025-10-02T18:38:31.473031] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-08. [2025-10-02T18:38:31.665510] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-02T18:38:31.786936] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-02T18:38:32.272968] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-04. [2025-10-02T18:38:32.316305] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-02T18:38:33.073020] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-09. [2025-10-02T18:38:33.872991] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-09. [2025-10-02T18:38:33.940000] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-02T18:38:34.077337] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-02T18:38:34.611698] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-02T18:38:34.673002] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-05. [2025-10-02T18:38:35.473039] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-10. [2025-10-02T18:38:36.273046] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-01. [2025-10-02T18:38:36.384208] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-02T18:38:36.385340] [INFO ] [REMOTE ] EFR: Full fetch complete (18971 records). [2025-10-02T18:38:36.385416] [DEBUG] [VALIDATOR ] EFR: Validating primary data. [2025-10-02T18:38:36.808738] [DEBUG] [VALIDATOR ] EFR: All expected trading days are present. [2025-10-02T18:38:36.808936] [DEBUG] [VALIDATOR ] EFR: Primary data validation passed. [2025-10-02T18:38:36.809422] [INFO ] [MAIN ] EFR: Fetched primary data is valid. [2025-10-02T18:38:36.809515] [DEBUG] [LOCAL ] EFR: Saving primary data. [2025-10-02T18:38:36.810391] [DEBUG] [LOCAL ] EFR: Trimmed 18971 records to 14752 (keeping 200 days of data) [2025-10-02T18:38:36.904871] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-02T18:38:36.949371] [DEBUG] [LOCAL ] EFR: Primary data saved (14752 records). [2025-10-02T18:38:36.949531] [INFO ] [MAIN ] EFR: Full history saved. [2025-10-02T18:38:36.949700] [INFO ] [MAIN ] Update Progress: 704/2370 symbols completed. EFR took 30.8s. Estimated remaining: 3h 53m 13s. Rate: 7.1 symbols/min [2025-10-02T18:38:37.078165] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-10. [2025-10-02T18:38:37.150348] [INFO ] [MAIN ] EG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:38:37.150548] [DEBUG] [LOCAL ] EG: No existing data file found in primary storage. [2025-10-02T18:38:37.150605] [WARN ] [MAIN ] EG: No existing data found, performing full refresh instead. [2025-10-02T18:38:37.150747] [INFO ] [MAIN ] EG: Wiping existing primary data before full refresh. [2025-10-02T18:38:37.150801] [INFO ] [LOCAL ] EG: Starting deletion of primary data. [2025-10-02T18:38:37.150872] [DEBUG] [LOCAL ] EG: No primary data file found to delete. [2025-10-02T18:38:37.150910] [INFO ] [MAIN ] EG: Starting full primary refresh. [2025-10-02T18:38:37.540733] [INFO ] [REMOTE ] EG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:38:37.872985] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-06. [2025-10-02T18:38:37.971634] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-02T18:38:37.973206] [INFO ] [REMOTE ] EFT: Full fetch complete (17943 records). [2025-10-02T18:38:37.973295] [DEBUG] [VALIDATOR ] EFT: Validating primary data. [2025-10-02T18:38:38.295401] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-02T18:38:38.434090] [DEBUG] [VALIDATOR ] EFT: All expected trading days are present. [2025-10-02T18:38:38.434183] [DEBUG] [VALIDATOR ] EFT: Primary data validation passed. [2025-10-02T18:38:38.434679] [INFO ] [MAIN ] EFT: Fetched primary data is valid. [2025-10-02T18:38:38.434761] [DEBUG] [LOCAL ] EFT: Saving primary data. [2025-10-02T18:38:38.435537] [DEBUG] [LOCAL ] EFT: Trimmed 17943 records to 13189 (keeping 200 days of data) [2025-10-02T18:38:38.546352] [DEBUG] [LOCAL ] EFT: Primary data saved (13189 records). [2025-10-02T18:38:38.546498] [INFO ] [MAIN ] EFT: Full history saved. [2025-10-02T18:38:38.546585] [INFO ] [MAIN ] Update Progress: 705/2370 symbols completed. EFT took 28.7s. Estimated remaining: 3h 52m 49s. Rate: 7.2 symbols/min [2025-10-02T18:38:38.678184] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-02. [2025-10-02T18:38:38.743598] [INFO ] [MAIN ] EGO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:38:38.806044] [DEBUG] [LOCAL ] EGO: Loaded 51595 existing records from primary storage. [2025-10-02T18:38:38.806391] [INFO ] [MAIN ] EGO: Loaded 51595 existing records. [2025-10-02T18:38:39.010128] [WARN ] [MAIN ] EGO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:38:39.010408] [INFO ] [MAIN ] EGO: Wiping existing primary data before full refresh. [2025-10-02T18:38:39.010539] [INFO ] [LOCAL ] EGO: Starting deletion of primary data. [2025-10-02T18:38:39.013673] [DEBUG] [LOCAL ] EGO: Deleted primary data file. [2025-10-02T18:38:39.013747] [INFO ] [MAIN ] EGO: Starting full primary refresh. [2025-10-02T18:38:39.453926] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-02T18:38:39.458179] [INFO ] [REMOTE ] EGO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:38:39.472963] [INFO ] [REMOTE ] EGO: Fetching primary data for 2024-12. [2025-10-02T18:38:40.075216] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-02T18:38:40.272990] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-07. [2025-10-02T18:38:40.856714] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-02T18:38:41.073043] [INFO ] [REMOTE ] EG: Fetching primary data for 2024-12. [2025-10-02T18:38:41.560147] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-02T18:38:41.873001] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-08. [2025-10-02T18:38:42.510380] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-02T18:38:42.673031] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-03. [2025-10-02T18:38:43.473002] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-01. [2025-10-02T18:38:43.600381] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-02T18:38:43.848382] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-02T18:38:44.273036] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-04. [2025-10-02T18:38:45.073233] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-09. [2025-10-02T18:38:45.163201] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-02T18:38:45.238410] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-02T18:38:45.873006] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-02. [2025-10-02T18:38:46.672974] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-01. [2025-10-02T18:38:46.864635] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-02T18:38:47.472979] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-05. [2025-10-02T18:38:47.526301] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-02T18:38:48.211328] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-02T18:38:48.273022] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-02. [2025-10-02T18:38:48.719709] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-02T18:38:49.073033] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-03. [2025-10-02T18:38:49.340579] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-02T18:38:49.873017] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-10. [2025-10-02T18:38:50.556207] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-02T18:38:50.672999] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-03. [2025-10-02T18:38:51.309916] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-02T18:38:51.313058] [INFO ] [REMOTE ] EFX: Full fetch complete (64499 records). [2025-10-02T18:38:51.313214] [DEBUG] [VALIDATOR ] EFX: Validating primary data. [2025-10-02T18:38:51.478968] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-06. [2025-10-02T18:38:51.757825] [DEBUG] [VALIDATOR ] EFX: All expected trading days are present. [2025-10-02T18:38:51.758091] [DEBUG] [VALIDATOR ] EFX: Primary data validation passed. [2025-10-02T18:38:51.759159] [INFO ] [MAIN ] EFX: Fetched primary data is valid. [2025-10-02T18:38:51.759296] [DEBUG] [LOCAL ] EFX: Saving primary data. [2025-10-02T18:38:51.760865] [DEBUG] [LOCAL ] EFX: Trimmed 64499 records to 44908 (keeping 200 days of data) [2025-10-02T18:38:52.080359] [DEBUG] [LOCAL ] EFX: Primary data saved (44908 records). [2025-10-02T18:38:52.080560] [INFO ] [MAIN ] EFX: Full history saved. [2025-10-02T18:38:52.081870] [INFO ] [MAIN ] Update Progress: 706/2370 symbols completed. EFX took 34.2s. Estimated remaining: 3h 52m 53s. Rate: 7.1 symbols/min [2025-10-02T18:38:52.136730] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-02T18:38:52.289871] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-04. [2025-10-02T18:38:52.326235] [INFO ] [MAIN ] EGP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:38:52.366425] [DEBUG] [LOCAL ] EGP: Loaded 30897 existing records from primary storage. [2025-10-02T18:38:52.366733] [INFO ] [MAIN ] EGP: Loaded 30897 existing records. [2025-10-02T18:38:52.580389] [WARN ] [MAIN ] EGP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:38:52.580702] [INFO ] [MAIN ] EGP: Wiping existing primary data before full refresh. [2025-10-02T18:38:52.580870] [INFO ] [LOCAL ] EGP: Starting deletion of primary data. [2025-10-02T18:38:52.582491] [DEBUG] [LOCAL ] EGP: Deleted primary data file. [2025-10-02T18:38:52.582572] [INFO ] [MAIN ] EGP: Starting full primary refresh. [2025-10-02T18:38:52.806346] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-02T18:38:53.015182] [INFO ] [REMOTE ] EGP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:38:53.072996] [INFO ] [REMOTE ] EGP: Fetching primary data for 2024-12. [2025-10-02T18:38:53.823688] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-02T18:38:53.872963] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-07. [2025-10-02T18:38:54.412773] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-02T18:38:54.673041] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-04. [2025-10-02T18:38:55.125277] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-02T18:38:55.473022] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-08. [2025-10-02T18:38:56.272985] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-01. [2025-10-02T18:38:56.587790] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-02T18:38:56.737853] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-02T18:38:57.073055] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-09. [2025-10-02T18:38:57.388519] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-02T18:38:57.873017] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-05. [2025-10-02T18:38:58.319334] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-02T18:38:58.673068] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-05. [2025-10-02T18:38:58.925485] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-02T18:38:59.473045] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-02. [2025-10-02T18:39:00.273005] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-06. [2025-10-02T18:39:00.480542] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-02T18:39:00.989788] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-02T18:39:01.073006] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-06. [2025-10-02T18:39:01.748886] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-02T18:39:01.873036] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-07. [2025-10-02T18:39:02.672994] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-10. [2025-10-02T18:39:03.026607] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-02T18:39:03.091434] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-02T18:39:03.472998] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-08. [2025-10-02T18:39:03.587242] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-02T18:39:03.588715] [INFO ] [REMOTE ] EFXT: Full fetch complete (43934 records). [2025-10-02T18:39:03.588817] [DEBUG] [VALIDATOR ] EFXT: Validating primary data. [2025-10-02T18:39:03.589489] [FATAL] [VALIDATOR ] EFXT: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:39:03.589605] [FATAL] [MAIN ] EFXT: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:39:03.589698] [WARN ] [MAIN ] EFXT: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:39:03.589758] [INFO ] [LOCAL ] EFXT: Starting deletion of primary data. [2025-10-02T18:39:03.589851] [DEBUG] [LOCAL ] EFXT: No primary data file found to delete. [2025-10-02T18:39:03.589911] [INFO ] [LOCAL ] EFXT: Starting deletion of derivative data. [2025-10-02T18:39:03.590350] [DEBUG] [LOCAL ] EFXT: Deleted derivative data file. [2025-10-02T18:39:03.590475] [INFO ] [MAIN ] Update Progress: 707/2370 symbols completed. EFXT took 40.1s. Estimated remaining: 3h 52m 51s. Rate: 7.1 symbols/min [2025-10-02T18:39:03.789677] [INFO ] [MAIN ] EGY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:39:03.836338] [DEBUG] [LOCAL ] EGY: Loaded 42122 existing records from primary storage. [2025-10-02T18:39:03.836698] [INFO ] [MAIN ] EGY: Loaded 42122 existing records. [2025-10-02T18:39:04.028905] [WARN ] [MAIN ] EGY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:39:04.029204] [INFO ] [MAIN ] EGY: Wiping existing primary data before full refresh. [2025-10-02T18:39:04.029277] [INFO ] [LOCAL ] EGY: Starting deletion of primary data. [2025-10-02T18:39:04.030668] [DEBUG] [LOCAL ] EGY: Deleted primary data file. [2025-10-02T18:39:04.030732] [INFO ] [MAIN ] EGY: Starting full primary refresh. [2025-10-02T18:39:04.278247] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-03. [2025-10-02T18:39:04.444062] [INFO ] [REMOTE ] EGY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:39:04.738291] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-02T18:39:05.072997] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-09. [2025-10-02T18:39:05.605479] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-02T18:39:05.873003] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-04. [2025-10-02T18:39:06.317790] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-02T18:39:06.673022] [INFO ] [REMOTE ] EGY: Fetching primary data for 2024-12. [2025-10-02T18:39:07.079576] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-02T18:39:07.473017] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-07. [2025-10-02T18:39:08.273016] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-05. [2025-10-02T18:39:08.331318] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-02T18:39:09.073001] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-10. [2025-10-02T18:39:09.247282] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-02T18:39:09.460957] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-02T18:39:09.872996] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-08. [2025-10-02T18:39:09.966333] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-02T18:39:09.967774] [INFO ] [REMOTE ] EG: Full fetch complete (43566 records). [2025-10-02T18:39:09.967879] [DEBUG] [VALIDATOR ] EG: Validating primary data. [2025-10-02T18:39:10.378740] [DEBUG] [VALIDATOR ] EG: All expected trading days are present. [2025-10-02T18:39:10.378876] [DEBUG] [VALIDATOR ] EG: Primary data validation passed. [2025-10-02T18:39:10.379490] [INFO ] [MAIN ] EG: Fetched primary data is valid. [2025-10-02T18:39:10.379565] [DEBUG] [LOCAL ] EG: Saving primary data. [2025-10-02T18:39:10.380686] [DEBUG] [LOCAL ] EG: Trimmed 43566 records to 28356 (keeping 200 days of data) [2025-10-02T18:39:10.573828] [DEBUG] [LOCAL ] EG: Primary data saved (28356 records). [2025-10-02T18:39:10.573966] [INFO ] [MAIN ] EG: Full history saved. [2025-10-02T18:39:10.574064] [INFO ] [MAIN ] Update Progress: 708/2370 symbols completed. EG took 33.6s. Estimated remaining: 3h 52m 40s. Rate: 7.1 symbols/min [2025-10-02T18:39:10.678073] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-01. [2025-10-02T18:39:10.763312] [INFO ] [MAIN ] EHAB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:39:10.791952] [DEBUG] [LOCAL ] EHAB: Loaded 29662 existing records from primary storage. [2025-10-02T18:39:10.792229] [INFO ] [MAIN ] EHAB: Loaded 29662 existing records. [2025-10-02T18:39:10.980073] [WARN ] [MAIN ] EHAB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:39:10.980273] [INFO ] [MAIN ] EHAB: Wiping existing primary data before full refresh. [2025-10-02T18:39:10.980322] [INFO ] [LOCAL ] EHAB: Starting deletion of primary data. [2025-10-02T18:39:10.981167] [DEBUG] [LOCAL ] EHAB: Deleted primary data file. [2025-10-02T18:39:10.981228] [INFO ] [MAIN ] EHAB: Starting full primary refresh. [2025-10-02T18:39:11.409511] [INFO ] [REMOTE ] EHAB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:39:11.441257] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-02T18:39:11.472952] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2024-12. [2025-10-02T18:39:12.130239] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-02T18:39:12.273009] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-06. [2025-10-02T18:39:12.515857] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-02T18:39:13.073049] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-09. [2025-10-02T18:39:13.207632] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-02T18:39:13.873002] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-01. [2025-10-02T18:39:14.672975] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-07. [2025-10-02T18:39:14.881532] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-02T18:39:14.935808] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-02T18:39:15.472998] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-02. [2025-10-02T18:39:16.272991] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-02. [2025-10-02T18:39:16.478939] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-02T18:39:16.978304] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-02T18:39:17.072974] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-03. [2025-10-02T18:39:17.309422] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-02T18:39:17.872993] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-03. [2025-10-02T18:39:18.673079] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-08. [2025-10-02T18:39:18.804920] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-02T18:39:18.996949] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-02T18:39:19.473009] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-04. [2025-10-02T18:39:20.051443] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-02T18:39:20.272999] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-09. [2025-10-02T18:39:20.677867] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-02T18:39:21.073061] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-05. [2025-10-02T18:39:21.607609] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-02T18:39:21.873003] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-10. [2025-10-02T18:39:22.138347] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-02T18:39:22.673047] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-10. [2025-10-02T18:39:22.850265] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-02T18:39:22.851865] [INFO ] [REMOTE ] EGP: Full fetch complete (45457 records). [2025-10-02T18:39:22.851964] [DEBUG] [VALIDATOR ] EGP: Validating primary data. [2025-10-02T18:39:23.280773] [DEBUG] [VALIDATOR ] EGP: All expected trading days are present. [2025-10-02T18:39:23.280904] [DEBUG] [VALIDATOR ] EGP: Primary data validation passed. [2025-10-02T18:39:23.281832] [INFO ] [MAIN ] EGP: Fetched primary data is valid. [2025-10-02T18:39:23.281899] [DEBUG] [LOCAL ] EGP: Saving primary data. [2025-10-02T18:39:23.283224] [DEBUG] [LOCAL ] EGP: Trimmed 45457 records to 31092 (keeping 200 days of data) [2025-10-02T18:39:23.477808] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-06. [2025-10-02T18:39:23.492297] [DEBUG] [LOCAL ] EGP: Primary data saved (31092 records). [2025-10-02T18:39:23.492489] [INFO ] [MAIN ] EGP: Full history saved. [2025-10-02T18:39:23.493364] [INFO ] [MAIN ] Update Progress: 709/2370 symbols completed. EGP took 31.4s. Estimated remaining: 3h 52m 42s. Rate: 7.1 symbols/min [2025-10-02T18:39:23.679396] [INFO ] [MAIN ] EHC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:39:23.728386] [DEBUG] [LOCAL ] EHC: Loaded 41099 existing records from primary storage. [2025-10-02T18:39:23.728783] [INFO ] [MAIN ] EHC: Loaded 41099 existing records. [2025-10-02T18:39:23.929671] [WARN ] [MAIN ] EHC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:39:23.929885] [INFO ] [MAIN ] EHC: Wiping existing primary data before full refresh. [2025-10-02T18:39:23.929934] [INFO ] [LOCAL ] EHC: Starting deletion of primary data. [2025-10-02T18:39:23.931360] [DEBUG] [LOCAL ] EHC: Deleted primary data file. [2025-10-02T18:39:23.931425] [INFO ] [MAIN ] EHC: Starting full primary refresh. [2025-10-02T18:39:24.150906] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-02T18:39:24.233733] [INFO ] [REMOTE ] EGO: Full fetch complete (73707 records). [2025-10-02T18:39:24.246358] [DEBUG] [VALIDATOR ] EGO: Validating primary data. [2025-10-02T18:39:24.293104] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-04. [2025-10-02T18:39:24.461387] [INFO ] [REMOTE ] EHC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:39:24.797911] [DEBUG] [VALIDATOR ] EGO: All expected trading days are present. [2025-10-02T18:39:24.798093] [DEBUG] [VALIDATOR ] EGO: Primary data validation passed. [2025-10-02T18:39:24.799121] [INFO ] [MAIN ] EGO: Fetched primary data is valid. [2025-10-02T18:39:24.799278] [DEBUG] [LOCAL ] EGO: Saving primary data. [2025-10-02T18:39:24.801126] [DEBUG] [LOCAL ] EGO: Trimmed 73707 records to 51982 (keeping 200 days of data) [2025-10-02T18:39:25.070880] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-02T18:39:25.075115] [INFO ] [REMOTE ] EHC: Fetching primary data for 2024-12. [2025-10-02T18:39:25.180727] [DEBUG] [LOCAL ] EGO: Primary data saved (51982 records). [2025-10-02T18:39:25.180889] [INFO ] [MAIN ] EGO: Full history saved. [2025-10-02T18:39:25.180977] [INFO ] [MAIN ] Update Progress: 710/2370 symbols completed. EGO took 46.6s. Estimated remaining: 3h 52m 18s. Rate: 7.1 symbols/min [2025-10-02T18:39:25.374709] [INFO ] [MAIN ] EHI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:39:25.394605] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-02T18:39:25.410500] [DEBUG] [LOCAL ] EHI: Loaded 10613 existing records from primary storage. [2025-10-02T18:39:25.410807] [INFO ] [MAIN ] EHI: Loaded 10613 existing records. [2025-10-02T18:39:25.609273] [WARN ] [MAIN ] EHI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:39:25.609524] [INFO ] [MAIN ] EHI: Wiping existing primary data before full refresh. [2025-10-02T18:39:25.609581] [INFO ] [LOCAL ] EHI: Starting deletion of primary data. [2025-10-02T18:39:25.610162] [DEBUG] [LOCAL ] EHI: Deleted primary data file. [2025-10-02T18:39:25.610226] [INFO ] [MAIN ] EHI: Starting full primary refresh. [2025-10-02T18:39:25.878176] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-07. [2025-10-02T18:39:26.007183] [INFO ] [REMOTE ] EHI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:39:26.650604] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-02T18:39:26.672989] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-01. [2025-10-02T18:39:27.455622] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-02T18:39:27.473025] [INFO ] [REMOTE ] EHI: Fetching primary data for 2024-12. [2025-10-02T18:39:28.151265] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-02T18:39:28.273025] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-08. [2025-10-02T18:39:28.966741] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-02T18:39:29.073078] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-05. [2025-10-02T18:39:29.702687] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-02T18:39:29.873051] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-09. [2025-10-02T18:39:30.232627] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-02T18:39:30.673009] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-02. [2025-10-02T18:39:31.471828] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-02T18:39:31.480268] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-01. [2025-10-02T18:39:32.213784] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-02T18:39:32.272979] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-03. [2025-10-02T18:39:32.283092] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-02T18:39:33.073069] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-02. [2025-10-02T18:39:33.532665] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-02T18:39:33.603899] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-02T18:39:33.873014] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-03. [2025-10-02T18:39:34.615206] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-02T18:39:34.673004] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-04. [2025-10-02T18:39:35.266813] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-02T18:39:35.473091] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-04. [2025-10-02T18:39:36.273006] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-05. [2025-10-02T18:39:37.073052] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-10. [2025-10-02T18:39:37.103850] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-02T18:39:37.226819] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-02T18:39:37.873039] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-06. [2025-10-02T18:39:38.268779] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-02T18:39:38.270586] [INFO ] [REMOTE ] EGY: Full fetch complete (61444 records). [2025-10-02T18:39:38.270733] [DEBUG] [VALIDATOR ] EGY: Validating primary data. [2025-10-02T18:39:38.684974] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-06. [2025-10-02T18:39:38.708394] [DEBUG] [VALIDATOR ] EGY: All expected trading days are present. [2025-10-02T18:39:38.708499] [DEBUG] [VALIDATOR ] EGY: Primary data validation passed. [2025-10-02T18:39:38.709317] [INFO ] [MAIN ] EGY: Fetched primary data is valid. [2025-10-02T18:39:38.709384] [DEBUG] [LOCAL ] EGY: Saving primary data. [2025-10-02T18:39:38.712247] [DEBUG] [LOCAL ] EGY: Trimmed 61444 records to 42435 (keeping 200 days of data) [2025-10-02T18:39:38.974279] [DEBUG] [LOCAL ] EGY: Primary data saved (42435 records). [2025-10-02T18:39:38.974413] [INFO ] [MAIN ] EGY: Full history saved. [2025-10-02T18:39:38.974515] [INFO ] [MAIN ] Update Progress: 711/2370 symbols completed. EGY took 35.4s. Estimated remaining: 3h 52m 22s. Rate: 7.1 symbols/min [2025-10-02T18:39:39.153242] [INFO ] [MAIN ] EIC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:39:39.153441] [DEBUG] [LOCAL ] EIC: No existing data file found in primary storage. [2025-10-02T18:39:39.153514] [WARN ] [MAIN ] EIC: No existing data found, performing full refresh instead. [2025-10-02T18:39:39.153832] [INFO ] [MAIN ] EIC: Wiping existing primary data before full refresh. [2025-10-02T18:39:39.153985] [INFO ] [LOCAL ] EIC: Starting deletion of primary data. [2025-10-02T18:39:39.154114] [DEBUG] [LOCAL ] EIC: No primary data file found to delete. [2025-10-02T18:39:39.154171] [INFO ] [MAIN ] EIC: Starting full primary refresh. [2025-10-02T18:39:39.309472] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-02T18:39:39.482506] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-07. [2025-10-02T18:39:39.571833] [INFO ] [REMOTE ] EIC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:39:39.640322] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-02T18:39:40.272996] [INFO ] [REMOTE ] EIC: Fetching primary data for 2024-12. [2025-10-02T18:39:40.924601] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-02T18:39:41.073069] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-08. [2025-10-02T18:39:41.676694] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-02T18:39:41.873006] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-07. [2025-10-02T18:39:42.480221] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-02T18:39:42.673011] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-09. [2025-10-02T18:39:42.728614] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-02T18:39:43.472970] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-05. [2025-10-02T18:39:43.515796] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-02T18:39:44.273018] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-01. [2025-10-02T18:39:45.072986] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-10. [2025-10-02T18:39:45.128483] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-02T18:39:45.523587] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-02T18:39:45.873015] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-06. [2025-10-02T18:39:46.078351] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-02T18:39:46.079681] [INFO ] [REMOTE ] EHAB: Full fetch complete (41068 records). [2025-10-02T18:39:46.079763] [DEBUG] [VALIDATOR ] EHAB: Validating primary data. [2025-10-02T18:39:46.490339] [DEBUG] [VALIDATOR ] EHAB: All expected trading days are present. [2025-10-02T18:39:46.490428] [DEBUG] [VALIDATOR ] EHAB: Primary data validation passed. [2025-10-02T18:39:46.491093] [INFO ] [MAIN ] EHAB: Fetched primary data is valid. [2025-10-02T18:39:46.491169] [DEBUG] [LOCAL ] EHAB: Saving primary data. [2025-10-02T18:39:46.492305] [DEBUG] [LOCAL ] EHAB: Trimmed 41068 records to 29810 (keeping 200 days of data) [2025-10-02T18:39:46.667341] [DEBUG] [LOCAL ] EHAB: Primary data saved (29810 records). [2025-10-02T18:39:46.667486] [INFO ] [MAIN ] EHAB: Full history saved. [2025-10-02T18:39:46.667571] [INFO ] [MAIN ] Update Progress: 712/2370 symbols completed. EHAB took 36.1s. Estimated remaining: 3h 52m 12s. Rate: 7.1 symbols/min [2025-10-02T18:39:46.680844] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-02. [2025-10-02T18:39:46.871158] [INFO ] [MAIN ] EICA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:39:46.871415] [DEBUG] [LOCAL ] EICA: No existing data file found in primary storage. [2025-10-02T18:39:46.871467] [WARN ] [MAIN ] EICA: No existing data found, performing full refresh instead. [2025-10-02T18:39:46.871586] [INFO ] [MAIN ] EICA: Wiping existing primary data before full refresh. [2025-10-02T18:39:46.871631] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-02T18:39:46.871718] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-02T18:39:46.871762] [INFO ] [MAIN ] EICA: Starting full primary refresh. [2025-10-02T18:39:47.291546] [INFO ] [REMOTE ] EICA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:39:47.315728] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-02T18:39:47.473005] [INFO ] [REMOTE ] EICA: Fetching primary data for 2024-12. [2025-10-02T18:39:47.790192] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-02T18:39:48.027989] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-02T18:39:48.273035] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-08. [2025-10-02T18:39:49.013378] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-02T18:39:49.072991] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-09. [2025-10-02T18:39:49.872968] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-01. [2025-10-02T18:39:49.964218] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-02T18:39:50.294956] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-02T18:39:50.673003] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-03. [2025-10-02T18:39:51.473020] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-10. [2025-10-02T18:39:52.040839] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-02T18:39:52.091374] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-02T18:39:52.092843] [INFO ] [REMOTE ] EHI: Full fetch complete (16319 records). [2025-10-02T18:39:52.092959] [DEBUG] [VALIDATOR ] EHI: Validating primary data. [2025-10-02T18:39:52.282498] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-04. [2025-10-02T18:39:52.542174] [DEBUG] [VALIDATOR ] EHI: All expected trading days are present. [2025-10-02T18:39:52.542253] [DEBUG] [VALIDATOR ] EHI: Primary data validation passed. [2025-10-02T18:39:52.542639] [INFO ] [MAIN ] EHI: Fetched primary data is valid. [2025-10-02T18:39:52.542724] [DEBUG] [LOCAL ] EHI: Saving primary data. [2025-10-02T18:39:52.543381] [DEBUG] [LOCAL ] EHI: Trimmed 16319 records to 10681 (keeping 200 days of data) [2025-10-02T18:39:52.606680] [DEBUG] [LOCAL ] EHI: Primary data saved (10681 records). [2025-10-02T18:39:52.606819] [INFO ] [MAIN ] EHI: Full history saved. [2025-10-02T18:39:52.606904] [INFO ] [MAIN ] Update Progress: 713/2370 symbols completed. EHI took 27.4s. Estimated remaining: 3h 51m 58s. Rate: 7.1 symbols/min [2025-10-02T18:39:52.792783] [INFO ] [MAIN ] EICB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:39:52.792953] [DEBUG] [LOCAL ] EICB: No existing data file found in primary storage. [2025-10-02T18:39:52.792991] [WARN ] [MAIN ] EICB: No existing data found, performing full refresh instead. [2025-10-02T18:39:52.793106] [INFO ] [MAIN ] EICB: Wiping existing primary data before full refresh. [2025-10-02T18:39:52.793148] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-02T18:39:52.793193] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-02T18:39:52.793226] [INFO ] [MAIN ] EICB: Starting full primary refresh. [2025-10-02T18:39:53.081334] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-07. [2025-10-02T18:39:53.195932] [INFO ] [REMOTE ] EICB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:39:53.529779] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-02T18:39:53.873005] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-02. [2025-10-02T18:39:54.113604] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-10-02T18:39:54.630708] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-02T18:39:54.672977] [INFO ] [REMOTE ] EICB: Fetching primary data for 2024-12. [2025-10-02T18:39:55.244856] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-02T18:39:55.472961] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-05. [2025-10-02T18:39:56.273093] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-01. [2025-10-02T18:39:56.685912] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-02T18:39:56.722905] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-02T18:39:57.073012] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-06. [2025-10-02T18:39:57.872991] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-08. [2025-10-02T18:39:58.222419] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-02T18:39:58.673039] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-03. [2025-10-02T18:39:59.174956] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-02T18:39:59.441937] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-02T18:39:59.473004] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-09. [2025-10-02T18:40:00.273002] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-04. [2025-10-02T18:40:00.732130] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-02T18:40:01.079783] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-05. [2025-10-02T18:40:01.096225] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-02T18:40:01.582936] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-02T18:40:01.873067] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-07. [2025-10-02T18:40:02.672994] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-10. [2025-10-02T18:40:03.221639] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-02T18:40:03.473038] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-06. [2025-10-02T18:40:03.821112] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-02T18:40:03.937965] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-02T18:40:03.939736] [INFO ] [REMOTE ] EHC: Full fetch complete (58898 records). [2025-10-02T18:40:03.939824] [DEBUG] [VALIDATOR ] EHC: Validating primary data. [2025-10-02T18:40:04.278112] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-08. [2025-10-02T18:40:04.372612] [DEBUG] [VALIDATOR ] EHC: All expected trading days are present. [2025-10-02T18:40:04.372735] [DEBUG] [VALIDATOR ] EHC: Primary data validation passed. [2025-10-02T18:40:04.373597] [INFO ] [MAIN ] EHC: Fetched primary data is valid. [2025-10-02T18:40:04.373696] [DEBUG] [LOCAL ] EHC: Saving primary data. [2025-10-02T18:40:04.375110] [DEBUG] [LOCAL ] EHC: Trimmed 58898 records to 41398 (keeping 200 days of data) [2025-10-02T18:40:04.653116] [DEBUG] [LOCAL ] EHC: Primary data saved (41398 records). [2025-10-02T18:40:04.653255] [INFO ] [MAIN ] EHC: Full history saved. [2025-10-02T18:40:04.654099] [INFO ] [MAIN ] Update Progress: 714/2370 symbols completed. EHC took 41.2s. Estimated remaining: 3h 51m 58s. Rate: 7.1 symbols/min [2025-10-02T18:40:04.839213] [INFO ] [MAIN ] EICC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:40:04.839433] [DEBUG] [LOCAL ] EICC: No existing data file found in primary storage. [2025-10-02T18:40:04.839507] [WARN ] [MAIN ] EICC: No existing data found, performing full refresh instead. [2025-10-02T18:40:04.839718] [INFO ] [MAIN ] EICC: Wiping existing primary data before full refresh. [2025-10-02T18:40:04.839816] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-10-02T18:40:04.839880] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-10-02T18:40:04.839918] [INFO ] [MAIN ] EICC: Starting full primary refresh. [2025-10-02T18:40:05.078141] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-02. [2025-10-02T18:40:05.234715] [INFO ] [REMOTE ] EICC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:40:05.491444] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-02T18:40:05.703979] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-02T18:40:05.873006] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-03. [2025-10-02T18:40:06.317502] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-02T18:40:06.673008] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-07. [2025-10-02T18:40:07.097809] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-02T18:40:07.473036] [INFO ] [REMOTE ] EICC: Fetching primary data for 2024-12. [2025-10-02T18:40:08.179164] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-02T18:40:08.272997] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-01. [2025-10-02T18:40:08.675965] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-02T18:40:09.073004] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-04. [2025-10-02T18:40:09.513353] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-02T18:40:09.873043] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-09. [2025-10-02T18:40:10.672972] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-02. [2025-10-02T18:40:10.826734] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-02T18:40:11.266840] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-02T18:40:11.473002] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-03. [2025-10-02T18:40:12.054343] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-02T18:40:12.272997] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-05. [2025-10-02T18:40:12.715411] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-02T18:40:13.073010] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-10. [2025-10-02T18:40:13.872997] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-06. [2025-10-02T18:40:14.302498] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-02T18:40:14.672997] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-04. [2025-10-02T18:40:15.207524] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-02T18:40:15.209739] [INFO ] [REMOTE ] EIC: Full fetch complete (34824 records). [2025-10-02T18:40:15.209917] [DEBUG] [VALIDATOR ] EIC: Validating primary data. [2025-10-02T18:40:15.478141] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-07. [2025-10-02T18:40:15.556325] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-02T18:40:15.663471] [DEBUG] [VALIDATOR ] EIC: All expected trading days are present. [2025-10-02T18:40:15.663576] [DEBUG] [VALIDATOR ] EIC: Primary data validation passed. [2025-10-02T18:40:15.664249] [INFO ] [MAIN ] EIC: Fetched primary data is valid. [2025-10-02T18:40:15.664313] [DEBUG] [LOCAL ] EIC: Saving primary data. [2025-10-02T18:40:15.665216] [DEBUG] [LOCAL ] EIC: Trimmed 34824 records to 23651 (keeping 200 days of data) [2025-10-02T18:40:15.825254] [DEBUG] [LOCAL ] EIC: Primary data saved (23651 records). [2025-10-02T18:40:15.825709] [INFO ] [MAIN ] EIC: Full history saved. [2025-10-02T18:40:15.825801] [INFO ] [MAIN ] Update Progress: 715/2370 symbols completed. EIC took 36.9s. Estimated remaining: 3h 51m 56s. Rate: 7.1 symbols/min [2025-10-02T18:40:15.948344] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-02T18:40:16.020229] [INFO ] [MAIN ] EIG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:40:16.040805] [DEBUG] [LOCAL ] EIG: Loaded 20325 existing records from primary storage. [2025-10-02T18:40:16.041076] [INFO ] [MAIN ] EIG: Loaded 20325 existing records. [2025-10-02T18:40:16.234076] [WARN ] [MAIN ] EIG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:40:16.234394] [INFO ] [MAIN ] EIG: Wiping existing primary data before full refresh. [2025-10-02T18:40:16.234444] [INFO ] [LOCAL ] EIG: Starting deletion of primary data. [2025-10-02T18:40:16.236391] [DEBUG] [LOCAL ] EIG: Deleted primary data file. [2025-10-02T18:40:16.236465] [INFO ] [MAIN ] EIG: Starting full primary refresh. [2025-10-02T18:40:16.278435] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-08. [2025-10-02T18:40:16.636485] [INFO ] [REMOTE ] EIG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:40:16.806270] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-02T18:40:17.073038] [INFO ] [REMOTE ] EIG: Fetching primary data for 2024-12. [2025-10-02T18:40:17.872999] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-08. [2025-10-02T18:40:18.137255] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-02T18:40:18.271960] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-02T18:40:18.673025] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-09. [2025-10-02T18:40:19.286135] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-02T18:40:19.473052] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-05. [2025-10-02T18:40:20.071724] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-02T18:40:20.273039] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-01. [2025-10-02T18:40:20.995541] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-02T18:40:21.073052] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-06. [2025-10-02T18:40:21.652592] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-02T18:40:21.873047] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-02. [2025-10-02T18:40:22.673053] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-09. [2025-10-02T18:40:22.844356] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-02T18:40:22.987477] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-02T18:40:23.473040] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-07. [2025-10-02T18:40:24.175829] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-02T18:40:24.273006] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-08. [2025-10-02T18:40:25.011963] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-02T18:40:25.073002] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-10. [2025-10-02T18:40:25.523533] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-02T18:40:25.524328] [INFO ] [REMOTE ] EICB: Full fetch complete (2725 records). [2025-10-02T18:40:25.524404] [DEBUG] [VALIDATOR ] EICB: Validating primary data. [2025-10-02T18:40:25.752917] [WARN ] [VALIDATOR ] EICB: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-02T18:40:25.753132] [FATAL] [MAIN ] EICB: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:40:25.753199] [WARN ] [MAIN ] EICB: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:40:25.753268] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-02T18:40:25.753332] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-02T18:40:25.753367] [INFO ] [LOCAL ] EICB: Starting deletion of derivative data. [2025-10-02T18:40:25.753408] [DEBUG] [LOCAL ] EICB: No derivative data file found to delete. [2025-10-02T18:40:25.753462] [INFO ] [MAIN ] Update Progress: 716/2370 symbols completed. EICB took 33.1s. Estimated remaining: 3h 51m 51s. Rate: 7.1 symbols/min [2025-10-02T18:40:25.878101] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-09. [2025-10-02T18:40:25.938912] [INFO ] [MAIN ] EIX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:40:25.993107] [DEBUG] [LOCAL ] EIX: Loaded 53338 existing records from primary storage. [2025-10-02T18:40:25.993469] [INFO ] [MAIN ] EIX: Loaded 53338 existing records. [2025-10-02T18:40:26.178702] [WARN ] [MAIN ] EIX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:40:26.178926] [INFO ] [MAIN ] EIX: Wiping existing primary data before full refresh. [2025-10-02T18:40:26.179135] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-10-02T18:40:26.180715] [DEBUG] [LOCAL ] EIX: Deleted primary data file. [2025-10-02T18:40:26.180777] [INFO ] [MAIN ] EIX: Starting full primary refresh. [2025-10-02T18:40:26.555511] [INFO ] [REMOTE ] EIX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:40:26.641806] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-02T18:40:26.673002] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-03. [2025-10-02T18:40:27.472984] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-10. [2025-10-02T18:40:27.693514] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-02T18:40:27.935374] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-02T18:40:27.936224] [INFO ] [REMOTE ] EICC: Full fetch complete (8212 records). [2025-10-02T18:40:27.936300] [DEBUG] [VALIDATOR ] EICC: Validating primary data. [2025-10-02T18:40:27.936720] [FATAL] [VALIDATOR ] EICC: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:40:27.936811] [FATAL] [MAIN ] EICC: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:40:27.936865] [WARN ] [MAIN ] EICC: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:40:27.936917] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-10-02T18:40:27.936977] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-10-02T18:40:27.937014] [INFO ] [LOCAL ] EICC: Starting deletion of derivative data. [2025-10-02T18:40:27.937087] [DEBUG] [LOCAL ] EICC: No derivative data file found to delete. [2025-10-02T18:40:27.937180] [INFO ] [MAIN ] Update Progress: 717/2370 symbols completed. EICC took 23.3s. Estimated remaining: 3h 51m 28s. Rate: 7.1 symbols/min [2025-10-02T18:40:28.273055] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-04. [2025-10-02T18:40:29.073072] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-10. [2025-10-02T18:40:29.506178] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-02T18:40:29.526116] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-02T18:40:29.527051] [INFO ] [REMOTE ] EICA: Full fetch complete (1281 records). [2025-10-02T18:40:29.527141] [DEBUG] [VALIDATOR ] EICA: Validating primary data. [2025-10-02T18:40:29.527636] [FATAL] [VALIDATOR ] EICA: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:40:29.527782] [FATAL] [MAIN ] EICA: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:40:29.527834] [WARN ] [MAIN ] EICA: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:40:29.527893] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-02T18:40:29.527967] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-02T18:40:29.528079] [INFO ] [LOCAL ] EICA: Starting deletion of derivative data. [2025-10-02T18:40:29.528157] [DEBUG] [LOCAL ] EICA: No derivative data file found to delete. [2025-10-02T18:40:29.528307] [INFO ] [MAIN ] Update Progress: 718/2370 symbols completed. EICA took 42.9s. Estimated remaining: 3h 51m 4s. Rate: 7.1 symbols/min [2025-10-02T18:40:29.873003] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-05. [2025-10-02T18:40:30.672982] [INFO ] [REMOTE ] EIX: Fetching primary data for 2024-12. [2025-10-02T18:40:31.092217] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-02T18:40:31.473053] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-06. [2025-10-02T18:40:32.497131] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-02T18:40:32.501760] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-07. [2025-10-02T18:40:32.587370] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-02T18:40:33.073033] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-01. [2025-10-02T18:40:33.538938] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-02T18:40:33.873008] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-08. [2025-10-02T18:40:34.756592] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-02T18:40:34.768593] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-02. [2025-10-02T18:40:34.785802] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-02T18:40:35.473048] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-09. [2025-10-02T18:40:36.427264] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-02T18:40:36.432985] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-10. [2025-10-02T18:40:36.622994] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-02T18:40:37.073039] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-03. [2025-10-02T18:40:37.382512] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-02T18:40:37.383797] [INFO ] [REMOTE ] EIG: Full fetch complete (27079 records). [2025-10-02T18:40:37.383888] [DEBUG] [VALIDATOR ] EIG: Validating primary data. [2025-10-02T18:40:37.791589] [DEBUG] [VALIDATOR ] EIG: All expected trading days are present. [2025-10-02T18:40:37.791698] [DEBUG] [VALIDATOR ] EIG: Primary data validation passed. [2025-10-02T18:40:37.792273] [INFO ] [MAIN ] EIG: Fetched primary data is valid. [2025-10-02T18:40:37.792324] [DEBUG] [LOCAL ] EIG: Saving primary data. [2025-10-02T18:40:37.793180] [DEBUG] [LOCAL ] EIG: Trimmed 27079 records to 20444 (keeping 200 days of data) [2025-10-02T18:40:37.920848] [DEBUG] [LOCAL ] EIG: Primary data saved (20444 records). [2025-10-02T18:40:37.920977] [INFO ] [MAIN ] EIG: Full history saved. [2025-10-02T18:40:37.921059] [INFO ] [MAIN ] Update Progress: 719/2370 symbols completed. EIG took 22.1s. Estimated remaining: 3h 50m 56s. Rate: 7.1 symbols/min [2025-10-02T18:40:38.812675] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-02T18:40:38.824835] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-04. [2025-10-02T18:40:40.793902] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-02T18:40:40.805752] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-05. [2025-10-02T18:40:42.819786] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-02T18:40:42.831672] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-06. [2025-10-02T18:40:44.555825] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-02T18:40:44.571593] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-07. [2025-10-02T18:40:46.572310] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-02T18:40:46.584389] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-08. [2025-10-02T18:40:47.969327] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-02T18:40:47.981128] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-09. [2025-10-02T18:40:49.783099] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-02T18:40:49.795288] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-10. [2025-10-02T18:40:51.238232] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-02T18:40:51.240429] [INFO ] [REMOTE ] EIX: Full fetch complete (77027 records). [2025-10-02T18:40:51.240570] [DEBUG] [VALIDATOR ] EIX: Validating primary data. [2025-10-02T18:40:51.683696] [DEBUG] [VALIDATOR ] EIX: All expected trading days are present. [2025-10-02T18:40:51.683802] [DEBUG] [VALIDATOR ] EIX: Primary data validation passed. [2025-10-02T18:40:51.684827] [INFO ] [MAIN ] EIX: Fetched primary data is valid. [2025-10-02T18:40:51.684906] [DEBUG] [LOCAL ] EIX: Saving primary data. [2025-10-02T18:40:51.686621] [DEBUG] [LOCAL ] EIX: Trimmed 77027 records to 53730 (keeping 200 days of data) [2025-10-02T18:40:52.033933] [DEBUG] [LOCAL ] EIX: Primary data saved (53730 records). [2025-10-02T18:40:52.034088] [INFO ] [MAIN ] EIX: Full history saved. [2025-10-02T18:40:52.034186] [INFO ] [MAIN ] Update Progress: 720/2370 symbols completed. EIX took 26.3s. Estimated remaining: 3h 51m 1s. Rate: 7.1 symbols/min [2025-10-02T18:40:52.756589] [INFO ] [MAIN ] EL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:40:52.791690] [INFO ] [MAIN ] ELF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:40:52.828283] [INFO ] [MAIN ] ELC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:40:52.852444] [INFO ] [MAIN ] ELAN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:40:52.859116] [DEBUG] [LOCAL ] ELC: Loaded 3482 existing records from primary storage. [2025-10-02T18:40:52.859598] [INFO ] [MAIN ] ELC: Loaded 3482 existing records. [2025-10-02T18:40:53.135034] [WARN ] [MAIN ] ELC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:40:53.151920] [INFO ] [MAIN ] ELC: Wiping existing primary data before full refresh. [2025-10-02T18:40:53.153785] [DEBUG] [LOCAL ] ELF: Loaded 52195 existing records from primary storage. [2025-10-02T18:40:53.154761] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-10-02T18:40:53.155436] [INFO ] [MAIN ] ELF: Loaded 52195 existing records. [2025-10-02T18:40:53.208789] [DEBUG] [LOCAL ] ELAN: Loaded 53254 existing records from primary storage. [2025-10-02T18:40:53.182514] [DEBUG] [LOCAL ] ELC: Deleted primary data file. [2025-10-02T18:40:53.235578] [INFO ] [MAIN ] ELC: Starting full primary refresh. [2025-10-02T18:40:53.248349] [INFO ] [MAIN ] ELAN: Loaded 53254 existing records. [2025-10-02T18:40:53.369946] [DEBUG] [LOCAL ] EL: Loaded 53392 existing records from primary storage. [2025-10-02T18:40:53.403556] [INFO ] [MAIN ] EL: Loaded 53392 existing records. [2025-10-02T18:40:53.830880] [WARN ] [MAIN ] ELF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:40:53.952400] [INFO ] [MAIN ] ELF: Wiping existing primary data before full refresh. [2025-10-02T18:40:53.957094] [WARN ] [MAIN ] ELAN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:40:54.002350] [INFO ] [LOCAL ] ELF: Starting deletion of primary data. [2025-10-02T18:40:54.029513] [INFO ] [MAIN ] ELAN: Wiping existing primary data before full refresh. [2025-10-02T18:40:54.029279] [DEBUG] [LOCAL ] ELF: Deleted primary data file. [2025-10-02T18:40:54.029680] [INFO ] [LOCAL ] ELAN: Starting deletion of primary data. [2025-10-02T18:40:54.102255] [WARN ] [MAIN ] EL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:40:54.102614] [INFO ] [MAIN ] ELF: Starting full primary refresh. [2025-10-02T18:40:54.126033] [INFO ] [MAIN ] EL: Wiping existing primary data before full refresh. [2025-10-02T18:40:54.153930] [INFO ] [LOCAL ] EL: Starting deletion of primary data. [2025-10-02T18:40:54.108425] [DEBUG] [LOCAL ] ELAN: Deleted primary data file. [2025-10-02T18:40:54.205148] [INFO ] [MAIN ] ELAN: Starting full primary refresh. [2025-10-02T18:40:54.210445] [DEBUG] [LOCAL ] EL: Deleted primary data file. [2025-10-02T18:40:54.241946] [INFO ] [MAIN ] EL: Starting full primary refresh. [2025-10-02T18:40:54.704488] [INFO ] [REMOTE ] ELC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:40:54.776872] [INFO ] [REMOTE ] ELC: Fetching primary data for 2024-12. [2025-10-02T18:40:55.348257] [INFO ] [REMOTE ] ELF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:40:55.407533] [INFO ] [REMOTE ] ELF: Fetching primary data for 2024-12. [2025-10-02T18:40:55.536996] [INFO ] [REMOTE ] ELAN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:40:55.537382] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2024-12. [2025-10-02T18:40:55.533585] [INFO ] [REMOTE ] EL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:40:55.537805] [INFO ] [REMOTE ] EL: Fetching primary data for 2024-12. [2025-10-02T18:40:55.607435] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-02T18:40:55.609252] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-01. [2025-10-02T18:40:56.162710] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-02T18:40:56.164148] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-02. [2025-10-02T18:40:56.690034] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-02T18:40:56.691476] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-03. [2025-10-02T18:40:57.151225] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-02T18:40:57.162030] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-01. [2025-10-02T18:40:57.246871] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-02T18:40:57.248383] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-04. [2025-10-02T18:40:57.468257] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-02T18:40:57.479131] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-01. [2025-10-02T18:40:57.578140] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-02T18:40:57.591131] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-01. [2025-10-02T18:40:57.814159] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-02T18:40:57.815755] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-05. [2025-10-02T18:40:58.382629] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-02T18:40:58.384357] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-06. [2025-10-02T18:40:58.622808] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-02T18:40:58.634137] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-02. [2025-10-02T18:40:58.926812] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-02T18:40:58.928427] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-07. [2025-10-02T18:40:59.140056] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-02T18:40:59.151905] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-02. [2025-10-02T18:40:59.182968] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-02T18:40:59.193987] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-02. [2025-10-02T18:40:59.497220] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-02T18:40:59.498904] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-08. [2025-10-02T18:41:00.022622] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-02T18:41:00.033439] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-03. [2025-10-02T18:41:00.091478] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-02T18:41:00.093420] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-09. [2025-10-02T18:41:00.668419] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-02T18:41:00.670139] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-10. [2025-10-02T18:41:01.186820] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-02T18:41:01.197222] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-03. [2025-10-02T18:41:01.285470] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-02T18:41:01.287394] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-02T18:41:01.292182] [INFO ] [REMOTE ] ELC: Full fetch complete (5101 records). [2025-10-02T18:41:01.302936] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-03. [2025-10-02T18:41:01.303064] [DEBUG] [VALIDATOR ] ELC: Validating primary data. [2025-10-02T18:41:01.756046] [DEBUG] [VALIDATOR ] ELC: All expected trading days are present. [2025-10-02T18:41:01.756260] [DEBUG] [VALIDATOR ] ELC: Primary data validation passed. [2025-10-02T18:41:01.756672] [INFO ] [MAIN ] ELC: Fetched primary data is valid. [2025-10-02T18:41:01.756750] [DEBUG] [LOCAL ] ELC: Saving primary data. [2025-10-02T18:41:01.785545] [DEBUG] [LOCAL ] ELC: Trimmed 5101 records to 3504 (keeping 200 days of data) [2025-10-02T18:41:01.791846] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-02T18:41:01.836742] [DEBUG] [LOCAL ] ELC: Primary data saved (3504 records). [2025-10-02T18:41:01.837388] [INFO ] [MAIN ] ELC: Full history saved. [2025-10-02T18:41:01.837476] [INFO ] [MAIN ] Update Progress: 721/2370 symbols completed. ELC took 9.8s. Estimated remaining: 3h 50m 55s. Rate: 7.1 symbols/min [2025-10-02T18:41:01.885722] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-04. [2025-10-02T18:41:02.026564] [INFO ] [MAIN ] ELME: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:41:02.068319] [DEBUG] [LOCAL ] ELME: Loaded 39181 existing records from primary storage. [2025-10-02T18:41:02.068617] [INFO ] [MAIN ] ELME: Loaded 39181 existing records. [2025-10-02T18:41:02.263217] [WARN ] [MAIN ] ELME: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:41:02.263447] [INFO ] [MAIN ] ELME: Wiping existing primary data before full refresh. [2025-10-02T18:41:02.263506] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-10-02T18:41:02.264817] [DEBUG] [LOCAL ] ELME: Deleted primary data file. [2025-10-02T18:41:02.264890] [INFO ] [MAIN ] ELME: Starting full primary refresh. [2025-10-02T18:41:02.689017] [INFO ] [REMOTE ] ELME: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:41:02.689359] [INFO ] [REMOTE ] ELME: Fetching primary data for 2024-12. [2025-10-02T18:41:02.990040] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-02T18:41:03.472974] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-04. [2025-10-02T18:41:03.658972] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-10-02T18:41:03.785468] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-02T18:41:04.146491] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-02T18:41:04.273031] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-01. [2025-10-02T18:41:05.073005] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-04. [2025-10-02T18:41:05.411015] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-02T18:41:05.466021] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-02T18:41:05.873006] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-05. [2025-10-02T18:41:06.673007] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-05. [2025-10-02T18:41:07.249930] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-02T18:41:07.473003] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-02. [2025-10-02T18:41:07.770207] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-02T18:41:08.273032] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-06. [2025-10-02T18:41:08.905664] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-02T18:41:09.036739] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-02T18:41:09.072996] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-03. [2025-10-02T18:41:09.581604] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-02T18:41:09.873004] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-06. [2025-10-02T18:41:10.556171] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-02T18:41:10.673007] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-07. [2025-10-02T18:41:11.473005] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-04. [2025-10-02T18:41:11.856126] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-02T18:41:12.272980] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-07. [2025-10-02T18:41:12.581176] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-02T18:41:12.970253] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-02T18:41:13.073013] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-08. [2025-10-02T18:41:13.873013] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-05. [2025-10-02T18:41:14.315758] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-02T18:41:14.673057] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-05. [2025-10-02T18:41:14.838995] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-02T18:41:15.473009] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-09. [2025-10-02T18:41:15.850902] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-02T18:41:16.260465] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-02T18:41:16.272959] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-06. [2025-10-02T18:41:17.073029] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-08. [2025-10-02T18:41:17.304102] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-02T18:41:17.573754] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-02T18:41:17.873049] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-10. [2025-10-02T18:41:18.673000] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-07. [2025-10-02T18:41:19.225599] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-02T18:41:19.473017] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-06. [2025-10-02T18:41:19.528061] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-02T18:41:19.530138] [INFO ] [REMOTE ] ELAN: Full fetch complete (76870 records). [2025-10-02T18:41:19.530254] [DEBUG] [VALIDATOR ] ELAN: Validating primary data. [2025-10-02T18:41:19.981252] [DEBUG] [VALIDATOR ] ELAN: All expected trading days are present. [2025-10-02T18:41:19.981341] [DEBUG] [VALIDATOR ] ELAN: Primary data validation passed. [2025-10-02T18:41:19.982309] [INFO ] [MAIN ] ELAN: Fetched primary data is valid. [2025-10-02T18:41:19.982380] [DEBUG] [LOCAL ] ELAN: Saving primary data. [2025-10-02T18:41:19.984197] [DEBUG] [LOCAL ] ELAN: Trimmed 76870 records to 53643 (keeping 200 days of data) [2025-10-02T18:41:20.259604] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-02T18:41:20.273042] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-09. [2025-10-02T18:41:20.363832] [DEBUG] [LOCAL ] ELAN: Primary data saved (53643 records). [2025-10-02T18:41:20.364000] [INFO ] [MAIN ] ELAN: Full history saved. [2025-10-02T18:41:20.366213] [INFO ] [MAIN ] Update Progress: 722/2370 symbols completed. ELAN took 28.3s. Estimated remaining: 3h 51m 10s. Rate: 7.1 symbols/min [2025-10-02T18:41:20.552756] [INFO ] [MAIN ] ELP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:41:20.579545] [DEBUG] [LOCAL ] ELP: Loaded 25670 existing records from primary storage. [2025-10-02T18:41:20.579850] [INFO ] [MAIN ] ELP: Loaded 25670 existing records. [2025-10-02T18:41:20.781184] [WARN ] [MAIN ] ELP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:41:20.781385] [INFO ] [MAIN ] ELP: Wiping existing primary data before full refresh. [2025-10-02T18:41:20.781433] [INFO ] [LOCAL ] ELP: Starting deletion of primary data. [2025-10-02T18:41:20.782624] [DEBUG] [LOCAL ] ELP: Deleted primary data file. [2025-10-02T18:41:20.782715] [INFO ] [MAIN ] ELP: Starting full primary refresh. [2025-10-02T18:41:21.073718] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-08. [2025-10-02T18:41:21.179835] [INFO ] [REMOTE ] ELP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:41:21.220146] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-02T18:41:21.873068] [INFO ] [REMOTE ] ELP: Fetching primary data for 2024-12. [2025-10-02T18:41:22.320250] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-02T18:41:22.418566] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-02T18:41:22.673083] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-09. [2025-10-02T18:41:23.331695] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-02T18:41:23.473020] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-07. [2025-10-02T18:41:23.929681] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-02T18:41:24.273007] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-10. [2025-10-02T18:41:25.072986] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-01. [2025-10-02T18:41:25.161422] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-02T18:41:25.811457] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-02T18:41:25.813537] [INFO ] [REMOTE ] EL: Full fetch complete (77312 records). [2025-10-02T18:41:25.813683] [DEBUG] [VALIDATOR ] EL: Validating primary data. [2025-10-02T18:41:25.874704] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-10. [2025-10-02T18:41:26.180626] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-02T18:41:26.318179] [DEBUG] [VALIDATOR ] EL: All expected trading days are present. [2025-10-02T18:41:26.318270] [DEBUG] [VALIDATOR ] EL: Primary data validation passed. [2025-10-02T18:41:26.319164] [INFO ] [MAIN ] EL: Fetched primary data is valid. [2025-10-02T18:41:26.319230] [DEBUG] [LOCAL ] EL: Saving primary data. [2025-10-02T18:41:26.320790] [DEBUG] [LOCAL ] EL: Trimmed 77312 records to 53778 (keeping 200 days of data) [2025-10-02T18:41:26.676203] [DEBUG] [LOCAL ] EL: Primary data saved (53778 records). [2025-10-02T18:41:26.676370] [INFO ] [MAIN ] EL: Full history saved. [2025-10-02T18:41:26.677550] [INFO ] [MAIN ] Update Progress: 723/2370 symbols completed. EL took 34.6s. Estimated remaining: 3h 50m 57s. Rate: 7.1 symbols/min [2025-10-02T18:41:26.674756] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-08. [2025-10-02T18:41:26.875182] [INFO ] [MAIN ] ELPC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:41:26.875361] [DEBUG] [LOCAL ] ELPC: No existing data file found in primary storage. [2025-10-02T18:41:26.875411] [WARN ] [MAIN ] ELPC: No existing data found, performing full refresh instead. [2025-10-02T18:41:26.875528] [INFO ] [MAIN ] ELPC: Wiping existing primary data before full refresh. [2025-10-02T18:41:26.875573] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-02T18:41:26.875617] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-02T18:41:26.875680] [INFO ] [MAIN ] ELPC: Starting full primary refresh. [2025-10-02T18:41:27.283319] [INFO ] [REMOTE ] ELPC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:41:27.313280] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-02T18:41:27.315056] [INFO ] [REMOTE ] ELME: Full fetch complete (56115 records). [2025-10-02T18:41:27.315151] [DEBUG] [VALIDATOR ] ELME: Validating primary data. [2025-10-02T18:41:27.478115] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-02. [2025-10-02T18:41:27.755682] [DEBUG] [VALIDATOR ] ELME: All expected trading days are present. [2025-10-02T18:41:27.755787] [DEBUG] [VALIDATOR ] ELME: Primary data validation passed. [2025-10-02T18:41:27.756550] [INFO ] [MAIN ] ELME: Fetched primary data is valid. [2025-10-02T18:41:27.756621] [DEBUG] [LOCAL ] ELME: Saving primary data. [2025-10-02T18:41:27.758129] [DEBUG] [LOCAL ] ELME: Trimmed 56115 records to 39517 (keeping 200 days of data) [2025-10-02T18:41:28.015557] [DEBUG] [LOCAL ] ELME: Primary data saved (39517 records). [2025-10-02T18:41:28.015759] [INFO ] [MAIN ] ELME: Full history saved. [2025-10-02T18:41:28.015853] [INFO ] [MAIN ] Update Progress: 724/2370 symbols completed. ELME took 26.2s. Estimated remaining: 3h 50m 32s. Rate: 7.1 symbols/min [2025-10-02T18:41:28.197616] [INFO ] [MAIN ] ELS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:41:28.247154] [DEBUG] [LOCAL ] ELS: Loaded 49457 existing records from primary storage. [2025-10-02T18:41:28.247497] [INFO ] [MAIN ] ELS: Loaded 49457 existing records. [2025-10-02T18:41:28.279961] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2024-12. [2025-10-02T18:41:28.463931] [WARN ] [MAIN ] ELS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:41:28.464379] [INFO ] [MAIN ] ELS: Wiping existing primary data before full refresh. [2025-10-02T18:41:28.464440] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-10-02T18:41:28.465861] [DEBUG] [LOCAL ] ELS: Deleted primary data file. [2025-10-02T18:41:28.465924] [INFO ] [MAIN ] ELS: Starting full primary refresh. [2025-10-02T18:41:28.812012] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-02T18:41:28.831599] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-02T18:41:28.916474] [INFO ] [REMOTE ] ELS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:41:28.951748] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-10-02T18:41:29.072992] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-01. [2025-10-02T18:41:29.533837] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-02T18:41:29.873035] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-09. [2025-10-02T18:41:30.673016] [INFO ] [REMOTE ] ELS: Fetching primary data for 2024-12. [2025-10-02T18:41:31.473052] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-03. [2025-10-02T18:41:31.778139] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-02T18:41:32.273007] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-10. [2025-10-02T18:41:32.450118] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-02T18:41:32.582803] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-02T18:41:33.073048] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-01. [2025-10-02T18:41:33.873013] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-02. [2025-10-02T18:41:34.039801] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-02T18:41:34.042008] [INFO ] [REMOTE ] ELF: Full fetch complete (75328 records). [2025-10-02T18:41:34.042190] [DEBUG] [VALIDATOR ] ELF: Validating primary data. [2025-10-02T18:41:34.252478] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-02T18:41:34.501682] [DEBUG] [VALIDATOR ] ELF: All expected trading days are present. [2025-10-02T18:41:34.501954] [DEBUG] [VALIDATOR ] ELF: Primary data validation passed. [2025-10-02T18:41:34.502858] [INFO ] [MAIN ] ELF: Fetched primary data is valid. [2025-10-02T18:41:34.503004] [DEBUG] [LOCAL ] ELF: Saving primary data. [2025-10-02T18:41:34.531186] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-02T18:41:34.529716] [DEBUG] [LOCAL ] ELF: Trimmed 75328 records to 52560 (keeping 200 days of data) [2025-10-02T18:41:34.718615] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-03. [2025-10-02T18:41:34.872458] [DEBUG] [LOCAL ] ELF: Primary data saved (52560 records). [2025-10-02T18:41:34.872708] [INFO ] [MAIN ] ELF: Full history saved. [2025-10-02T18:41:34.872802] [INFO ] [MAIN ] Update Progress: 725/2370 symbols completed. ELF took 42.8s. Estimated remaining: 3h 50m 20s. Rate: 7.1 symbols/min [2025-10-02T18:41:35.063315] [INFO ] [MAIN ] ELV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:41:35.100950] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-02T18:41:35.121444] [DEBUG] [LOCAL ] ELV: Loaded 50546 existing records from primary storage. [2025-10-02T18:41:35.121823] [INFO ] [MAIN ] ELV: Loaded 50546 existing records. [2025-10-02T18:41:35.329567] [WARN ] [MAIN ] ELV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:41:35.329863] [INFO ] [MAIN ] ELV: Wiping existing primary data before full refresh. [2025-10-02T18:41:35.329939] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-10-02T18:41:35.331599] [DEBUG] [LOCAL ] ELV: Deleted primary data file. [2025-10-02T18:41:35.331693] [INFO ] [MAIN ] ELV: Starting full primary refresh. [2025-10-02T18:41:35.485633] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-04. [2025-10-02T18:41:35.724915] [INFO ] [REMOTE ] ELV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:41:36.273024] [INFO ] [REMOTE ] ELV: Fetching primary data for 2024-12. [2025-10-02T18:41:36.920253] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-02T18:41:37.072992] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-04. [2025-10-02T18:41:37.531922] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-02T18:41:37.872997] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-05. [2025-10-02T18:41:38.592955] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2024-12 (2.32 seconds). [2025-10-02T18:41:38.673022] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-01. [2025-10-02T18:41:39.139007] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-02T18:41:39.473023] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-05. [2025-10-02T18:41:40.015993] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-02T18:41:40.134057] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-02T18:41:40.273022] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-06. [2025-10-02T18:41:40.619494] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-02T18:41:41.073043] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-02. [2025-10-02T18:41:41.873027] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-06. [2025-10-02T18:41:42.471597] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-02T18:41:42.673019] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-02. [2025-10-02T18:41:42.993175] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-02T18:41:43.473005] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-07. [2025-10-02T18:41:43.876436] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-02T18:41:44.273000] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-07. [2025-10-02T18:41:44.320675] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-02T18:41:45.072968] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-03. [2025-10-02T18:41:45.523862] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-02T18:41:45.872999] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-03. [2025-10-02T18:41:46.672982] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-08. [2025-10-02T18:41:46.794971] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-02T18:41:47.006534] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-02T18:41:47.473011] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-08. [2025-10-02T18:41:47.587122] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-02T18:41:48.273004] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-04. [2025-10-02T18:41:48.608569] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-02T18:41:49.073006] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-04. [2025-10-02T18:41:49.872984] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-09. [2025-10-02T18:41:50.273806] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-02T18:41:50.597735] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-02T18:41:50.672978] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-05. [2025-10-02T18:41:50.797527] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-02T18:41:51.473009] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-10. [2025-10-02T18:41:52.273008] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-09. [2025-10-02T18:41:52.368710] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-02T18:41:52.370120] [INFO ] [REMOTE ] ELP: Full fetch complete (37115 records). [2025-10-02T18:41:52.370229] [DEBUG] [VALIDATOR ] ELP: Validating primary data. [2025-10-02T18:41:52.661947] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-02T18:41:52.818081] [DEBUG] [VALIDATOR ] ELP: All expected trading days are present. [2025-10-02T18:41:52.818220] [DEBUG] [VALIDATOR ] ELP: Primary data validation passed. [2025-10-02T18:41:52.819093] [INFO ] [MAIN ] ELP: Fetched primary data is valid. [2025-10-02T18:41:52.819160] [DEBUG] [LOCAL ] ELP: Saving primary data. [2025-10-02T18:41:52.820150] [DEBUG] [LOCAL ] ELP: Trimmed 37115 records to 25797 (keeping 200 days of data) [2025-10-02T18:41:52.953995] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-10-02T18:41:53.021566] [DEBUG] [LOCAL ] ELP: Primary data saved (25797 records). [2025-10-02T18:41:53.021740] [INFO ] [MAIN ] ELP: Full history saved. [2025-10-02T18:41:53.021837] [INFO ] [MAIN ] Update Progress: 726/2370 symbols completed. ELP took 32.7s. Estimated remaining: 3h 50m 34s. Rate: 7.1 symbols/min [2025-10-02T18:41:53.078985] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-06. [2025-10-02T18:41:53.211810] [INFO ] [MAIN ] EMA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:41:53.211982] [DEBUG] [LOCAL ] EMA: No existing data file found in primary storage. [2025-10-02T18:41:53.212020] [WARN ] [MAIN ] EMA: No existing data found, performing full refresh instead. [2025-10-02T18:41:53.212162] [INFO ] [MAIN ] EMA: Wiping existing primary data before full refresh. [2025-10-02T18:41:53.212205] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-02T18:41:53.212247] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-02T18:41:53.212279] [INFO ] [MAIN ] EMA: Starting full primary refresh. [2025-10-02T18:41:53.590600] [INFO ] [REMOTE ] EMA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:41:53.873001] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-05. [2025-10-02T18:41:54.673028] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-10. [2025-10-02T18:41:54.818793] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-02T18:41:55.472978] [INFO ] [REMOTE ] EMA: Fetching primary data for 2024-12. [2025-10-02T18:41:55.555144] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-02T18:41:55.555925] [INFO ] [REMOTE ] ELPC: Full fetch complete (1433 records). [2025-10-02T18:41:55.555997] [DEBUG] [VALIDATOR ] ELPC: Validating primary data. [2025-10-02T18:41:55.698469] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T18:41:55.721840] [WARN ] [REMOTE ] EMA: No data returned for month 2024-12 [2025-10-02T18:41:55.733527] [FATAL] [REMOTE ] EMA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T18:41:55.770435] [FATAL] [MAIN ] EMA: Failed to fetch primary data. [2025-10-02T18:41:55.770089] [WARN ] [VALIDATOR ] ELPC: Validation failed - insufficient historical data. Have 191 unique days, need 200 days [2025-10-02T18:41:55.770956] [FATAL] [MAIN ] ELPC: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:41:55.771091] [WARN ] [MAIN ] EMA: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T18:41:55.771249] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-02T18:41:55.786333] [WARN ] [MAIN ] ELPC: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:41:55.798734] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-02T18:41:55.799150] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-02T18:41:55.799063] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-02T18:41:55.799878] [INFO ] [LOCAL ] ELPC: Starting deletion of derivative data. [2025-10-02T18:41:55.801756] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-02T18:41:55.799304] [INFO ] [LOCAL ] EMA: Starting deletion of derivative data. [2025-10-02T18:41:55.812822] [DEBUG] [LOCAL ] ELPC: No derivative data file found to delete. [2025-10-02T18:41:55.812357] [DEBUG] [LOCAL ] EMA: No derivative data file found to delete. [2025-10-02T18:41:55.813111] [INFO ] [MAIN ] Update Progress: 727/2370 symbols completed. EMA took 2.8s. Estimated remaining: 3h 50m 13s. Rate: 7.1 symbols/min [2025-10-02T18:41:55.835545] [INFO ] [MAIN ] Update Progress: 728/2370 symbols completed. ELPC took 29.2s. Estimated remaining: 3h 49m 46s. Rate: 7.1 symbols/min [2025-10-02T18:41:56.184339] [INFO ] [MAIN ] EME: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:41:56.203638] [DEBUG] [LOCAL ] EME: No existing data file found in primary storage. [2025-10-02T18:41:56.205046] [WARN ] [MAIN ] EME: No existing data found, performing full refresh instead. [2025-10-02T18:41:56.205222] [INFO ] [MAIN ] EME: Wiping existing primary data before full refresh. [2025-10-02T18:41:56.205294] [INFO ] [LOCAL ] EME: Starting deletion of primary data. [2025-10-02T18:41:56.204969] [INFO ] [MAIN ] EMD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:41:56.205459] [DEBUG] [LOCAL ] EME: No primary data file found to delete. [2025-10-02T18:41:56.205624] [INFO ] [MAIN ] EME: Starting full primary refresh. [2025-10-02T18:41:56.205570] [DEBUG] [LOCAL ] EMD: No existing data file found in primary storage. [2025-10-02T18:41:56.240848] [WARN ] [MAIN ] EMD: No existing data found, performing full refresh instead. [2025-10-02T18:41:56.266310] [INFO ] [MAIN ] EMD: Wiping existing primary data before full refresh. [2025-10-02T18:41:56.276032] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-07. [2025-10-02T18:41:56.277132] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-10-02T18:41:56.290059] [DEBUG] [LOCAL ] EMD: No primary data file found to delete. [2025-10-02T18:41:56.317081] [INFO ] [MAIN ] EMD: Starting full primary refresh. [2025-10-02T18:41:57.019468] [INFO ] [REMOTE ] EME: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:41:57.065783] [INFO ] [REMOTE ] EMD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:41:57.072996] [INFO ] [REMOTE ] EMD: Fetching primary data for 2024-12. [2025-10-02T18:41:57.872990] [INFO ] [REMOTE ] EME: Fetching primary data for 2024-12. [2025-10-02T18:41:58.517547] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-02T18:41:58.551453] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-02T18:41:58.673025] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-08. [2025-10-02T18:41:59.344686] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-02T18:41:59.473060] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-06. [2025-10-02T18:42:00.273020] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-01. [2025-10-02T18:42:00.669613] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-02T18:42:01.072978] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-09. [2025-10-02T18:42:01.216607] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-02T18:42:01.873022] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-01. [2025-10-02T18:42:01.932146] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-02T18:42:02.673032] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-02. [2025-10-02T18:42:02.892335] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-02T18:42:03.063589] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-02T18:42:03.473014] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-10. [2025-10-02T18:42:03.853141] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-02T18:42:04.273004] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-02. [2025-10-02T18:42:04.847336] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-02T18:42:04.849635] [INFO ] [REMOTE ] ELV: Full fetch complete (73182 records). [2025-10-02T18:42:04.849975] [DEBUG] [VALIDATOR ] ELV: Validating primary data. [2025-10-02T18:42:05.096556] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-07. [2025-10-02T18:42:05.344453] [DEBUG] [VALIDATOR ] ELV: All expected trading days are present. [2025-10-02T18:42:05.344547] [DEBUG] [VALIDATOR ] ELV: Primary data validation passed. [2025-10-02T18:42:05.345491] [INFO ] [MAIN ] ELV: Fetched primary data is valid. [2025-10-02T18:42:05.345559] [DEBUG] [LOCAL ] ELV: Saving primary data. [2025-10-02T18:42:05.347145] [DEBUG] [LOCAL ] ELV: Trimmed 73182 records to 50927 (keeping 200 days of data) [2025-10-02T18:42:05.653039] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-02T18:42:05.739667] [DEBUG] [LOCAL ] ELV: Primary data saved (50927 records). [2025-10-02T18:42:05.739826] [INFO ] [MAIN ] ELV: Full history saved. [2025-10-02T18:42:05.739911] [INFO ] [MAIN ] Update Progress: 729/2370 symbols completed. ELV took 30.9s. Estimated remaining: 3h 49m 41s. Rate: 7.1 symbols/min [2025-10-02T18:42:05.878167] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-03. [2025-10-02T18:42:05.936803] [INFO ] [MAIN ] EMF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:42:05.942939] [DEBUG] [LOCAL ] EMF: Loaded 3414 existing records from primary storage. [2025-10-02T18:42:05.943118] [INFO ] [MAIN ] EMF: Loaded 3414 existing records. [2025-10-02T18:42:06.150116] [WARN ] [MAIN ] EMF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:42:06.150330] [INFO ] [MAIN ] EMF: Wiping existing primary data before full refresh. [2025-10-02T18:42:06.150387] [INFO ] [LOCAL ] EMF: Starting deletion of primary data. [2025-10-02T18:42:06.150742] [DEBUG] [LOCAL ] EMF: Deleted primary data file. [2025-10-02T18:42:06.150812] [INFO ] [MAIN ] EMF: Starting full primary refresh. [2025-10-02T18:42:06.601998] [INFO ] [REMOTE ] EMF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:42:06.673083] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-03. [2025-10-02T18:42:06.754020] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-02T18:42:06.814969] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-02T18:42:07.473009] [INFO ] [REMOTE ] EMF: Fetching primary data for 2024-12. [2025-10-02T18:42:08.273008] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-08. [2025-10-02T18:42:08.328114] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-02T18:42:08.345444] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-02T18:42:09.072993] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-04. [2025-10-02T18:42:09.872993] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-01. [2025-10-02T18:42:10.027513] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-02T18:42:10.300364] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-02T18:42:10.672988] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-02. [2025-10-02T18:42:10.747888] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-02T18:42:11.305547] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-02T18:42:11.473033] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-04. [2025-10-02T18:42:12.273048] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-09. [2025-10-02T18:42:13.073012] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-03. [2025-10-02T18:42:13.790714] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-02T18:42:13.873253] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-04. [2025-10-02T18:42:14.202662] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-02T18:42:14.258472] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-04 (2.79 seconds). [2025-10-02T18:42:14.432946] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-02T18:42:14.673083] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-10. [2025-10-02T18:42:15.473009] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-05. [2025-10-02T18:42:16.076284] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-02T18:42:16.078946] [INFO ] [REMOTE ] ELS: Full fetch complete (70808 records). [2025-10-02T18:42:16.079088] [DEBUG] [VALIDATOR ] ELS: Validating primary data. [2025-10-02T18:42:16.278594] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-05. [2025-10-02T18:42:16.553597] [DEBUG] [VALIDATOR ] ELS: All expected trading days are present. [2025-10-02T18:42:16.553782] [DEBUG] [VALIDATOR ] ELS: Primary data validation passed. [2025-10-02T18:42:16.555030] [INFO ] [MAIN ] ELS: Fetched primary data is valid. [2025-10-02T18:42:16.555120] [DEBUG] [LOCAL ] ELS: Saving primary data. [2025-10-02T18:42:16.557032] [DEBUG] [LOCAL ] ELS: Trimmed 70808 records to 49822 (keeping 200 days of data) [2025-10-02T18:42:16.931629] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-02T18:42:16.930526] [DEBUG] [LOCAL ] ELS: Primary data saved (49822 records). [2025-10-02T18:42:16.931926] [INFO ] [MAIN ] ELS: Full history saved. [2025-10-02T18:42:16.932073] [INFO ] [MAIN ] Update Progress: 730/2370 symbols completed. ELS took 48.9s. Estimated remaining: 3h 49m 39s. Rate: 7.1 symbols/min [2025-10-02T18:42:17.078122] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-06. [2025-10-02T18:42:17.170569] [INFO ] [MAIN ] EMN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:42:17.221208] [DEBUG] [LOCAL ] EMN: Loaded 50458 existing records from primary storage. [2025-10-02T18:42:17.221564] [INFO ] [MAIN ] EMN: Loaded 50458 existing records. [2025-10-02T18:42:17.423426] [WARN ] [MAIN ] EMN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:42:17.423843] [INFO ] [MAIN ] EMN: Wiping existing primary data before full refresh. [2025-10-02T18:42:17.423958] [INFO ] [LOCAL ] EMN: Starting deletion of primary data. [2025-10-02T18:42:17.425549] [DEBUG] [LOCAL ] EMN: Deleted primary data file. [2025-10-02T18:42:17.425680] [INFO ] [MAIN ] EMN: Starting full primary refresh. [2025-10-02T18:42:17.569262] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-02T18:42:17.847110] [INFO ] [REMOTE ] EMN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:42:17.873040] [INFO ] [REMOTE ] EMN: Fetching primary data for 2024-12. [2025-10-02T18:42:18.517122] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-02T18:42:18.673009] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-06. [2025-10-02T18:42:19.473001] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-05. [2025-10-02T18:42:19.665635] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-02T18:42:19.711777] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-02T18:42:20.152752] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-02T18:42:20.273017] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-07. [2025-10-02T18:42:21.080134] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-06. [2025-10-02T18:42:21.082834] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-02T18:42:21.627934] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-02T18:42:21.873019] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-07. [2025-10-02T18:42:22.673071] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-08. [2025-10-02T18:42:23.313890] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-02T18:42:23.473001] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-01. [2025-10-02T18:42:23.541498] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-02T18:42:24.273045] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-08. [2025-10-02T18:42:25.073075] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-09. [2025-10-02T18:42:25.195877] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-02T18:42:25.508398] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-02T18:42:25.873024] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-02. [2025-10-02T18:42:26.217873] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-02T18:42:26.673048] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-09. [2025-10-02T18:42:27.473016] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-07. [2025-10-02T18:42:27.508757] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-02T18:42:27.780601] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-02T18:42:28.095521] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-02T18:42:28.273016] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-08. [2025-10-02T18:42:28.749103] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-02T18:42:29.073004] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-03. [2025-10-02T18:42:29.873034] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-09. [2025-10-02T18:42:30.582060] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-02T18:42:30.672970] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-10. [2025-10-02T18:42:30.944579] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-02T18:42:31.472119] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-02T18:42:31.473586] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-04. [2025-10-02T18:42:31.474855] [INFO ] [REMOTE ] EMD: Full fetch complete (32476 records). [2025-10-02T18:42:31.474933] [DEBUG] [VALIDATOR ] EMD: Validating primary data. [2025-10-02T18:42:31.945963] [DEBUG] [VALIDATOR ] EMD: All expected trading days are present. [2025-10-02T18:42:31.946051] [DEBUG] [VALIDATOR ] EMD: Primary data validation passed. [2025-10-02T18:42:31.946759] [INFO ] [MAIN ] EMD: Fetched primary data is valid. [2025-10-02T18:42:31.946831] [DEBUG] [LOCAL ] EMD: Saving primary data. [2025-10-02T18:42:31.948008] [DEBUG] [LOCAL ] EMD: Trimmed 32476 records to 21348 (keeping 200 days of data) [2025-10-02T18:42:32.085979] [DEBUG] [LOCAL ] EMD: Primary data saved (21348 records). [2025-10-02T18:42:32.086160] [INFO ] [MAIN ] EMD: Full history saved. [2025-10-02T18:42:32.086284] [INFO ] [MAIN ] Update Progress: 731/2370 symbols completed. EMD took 36.3s. Estimated remaining: 3h 49m 45s. Rate: 7.1 symbols/min [2025-10-02T18:42:32.268803] [INFO ] [MAIN ] EMO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:42:32.272990] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-10. [2025-10-02T18:42:32.282941] [DEBUG] [LOCAL ] EMO: Loaded 12527 existing records from primary storage. [2025-10-02T18:42:32.283190] [INFO ] [MAIN ] EMO: Loaded 12527 existing records. [2025-10-02T18:42:32.474284] [WARN ] [MAIN ] EMO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:42:32.474518] [INFO ] [MAIN ] EMO: Wiping existing primary data before full refresh. [2025-10-02T18:42:32.474588] [INFO ] [LOCAL ] EMO: Starting deletion of primary data. [2025-10-02T18:42:32.475111] [DEBUG] [LOCAL ] EMO: Deleted primary data file. [2025-10-02T18:42:32.475173] [INFO ] [MAIN ] EMO: Starting full primary refresh. [2025-10-02T18:42:32.872879] [INFO ] [REMOTE ] EMO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:42:33.073027] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-10. [2025-10-02T18:42:33.315224] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-02T18:42:33.477183] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-02T18:42:33.477961] [INFO ] [REMOTE ] EMF: Full fetch complete (7105 records). [2025-10-02T18:42:33.478085] [DEBUG] [VALIDATOR ] EMF: Validating primary data. [2025-10-02T18:42:33.591149] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-02T18:42:33.636096] [INFO ] [REMOTE ] EME: Full fetch complete (46868 records). [2025-10-02T18:42:33.636395] [DEBUG] [VALIDATOR ] EME: Validating primary data. [2025-10-02T18:42:33.876992] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-05. [2025-10-02T18:42:34.225145] [DEBUG] [VALIDATOR ] EMF: All expected trading days are present. [2025-10-02T18:42:34.237194] [DEBUG] [VALIDATOR ] EMF: Primary data validation passed. [2025-10-02T18:42:34.253221] [INFO ] [MAIN ] EMF: Fetched primary data is valid. [2025-10-02T18:42:34.267872] [DEBUG] [LOCAL ] EMF: Saving primary data. [2025-10-02T18:42:34.285784] [DEBUG] [LOCAL ] EMF: Trimmed 7105 records to 3431 (keeping 200 days of data) [2025-10-02T18:42:34.414785] [DEBUG] [LOCAL ] EMF: Primary data saved (3431 records). [2025-10-02T18:42:34.417780] [DEBUG] [VALIDATOR ] EME: All expected trading days are present. [2025-10-02T18:42:34.417923] [INFO ] [MAIN ] EMF: Full history saved. [2025-10-02T18:42:34.418057] [DEBUG] [VALIDATOR ] EME: Primary data validation passed. [2025-10-02T18:42:34.418931] [INFO ] [MAIN ] EME: Fetched primary data is valid. [2025-10-02T18:42:34.419038] [DEBUG] [LOCAL ] EME: Saving primary data. [2025-10-02T18:42:34.418225] [INFO ] [MAIN ] Update Progress: 732/2370 symbols completed. EMF took 28.7s. Estimated remaining: 3h 49m 23s. Rate: 7.1 symbols/min [2025-10-02T18:42:34.512268] [DEBUG] [LOCAL ] EME: Trimmed 46868 records to 31497 (keeping 200 days of data) [2025-10-02T18:42:34.684109] [INFO ] [REMOTE ] EMO: Fetching primary data for 2024-12. [2025-10-02T18:42:34.722570] [INFO ] [MAIN ] EMP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:42:34.754177] [DEBUG] [LOCAL ] EMP: Loaded 3063 existing records from primary storage. [2025-10-02T18:42:34.754929] [INFO ] [MAIN ] EMP: Loaded 3063 existing records. [2025-10-02T18:42:35.042404] [WARN ] [MAIN ] EMP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:42:35.052064] [INFO ] [MAIN ] EMP: Wiping existing primary data before full refresh. [2025-10-02T18:42:35.060777] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-10-02T18:42:35.065375] [DEBUG] [LOCAL ] EME: Primary data saved (31497 records). [2025-10-02T18:42:35.065489] [INFO ] [MAIN ] EME: Full history saved. [2025-10-02T18:42:35.065551] [DEBUG] [LOCAL ] EMP: Deleted primary data file. [2025-10-02T18:42:35.065678] [INFO ] [MAIN ] Update Progress: 733/2370 symbols completed. EME took 39.2s. Estimated remaining: 3h 48m 58s. Rate: 7.1 symbols/min [2025-10-02T18:42:35.065792] [INFO ] [MAIN ] EMP: Starting full primary refresh. [2025-10-02T18:42:35.517180] [INFO ] [MAIN ] EMR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:42:35.678819] [INFO ] [REMOTE ] EMP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:42:35.679718] [INFO ] [REMOTE ] EMP: Fetching primary data for 2024-12. [2025-10-02T18:42:35.730960] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-02T18:42:35.764054] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-02T18:42:35.787058] [DEBUG] [LOCAL ] EMR: Loaded 53250 existing records from primary storage. [2025-10-02T18:42:35.787561] [INFO ] [MAIN ] EMR: Loaded 53250 existing records. [2025-10-02T18:42:35.986019] [WARN ] [MAIN ] EMR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:42:35.986352] [INFO ] [MAIN ] EMR: Wiping existing primary data before full refresh. [2025-10-02T18:42:35.986413] [INFO ] [LOCAL ] EMR: Starting deletion of primary data. [2025-10-02T18:42:35.989237] [DEBUG] [LOCAL ] EMR: Deleted primary data file. [2025-10-02T18:42:35.989320] [INFO ] [MAIN ] EMR: Starting full primary refresh. [2025-10-02T18:42:36.274288] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-06. [2025-10-02T18:42:36.390396] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-02T18:42:36.416175] [INFO ] [REMOTE ] EMR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:42:37.073023] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-01. [2025-10-02T18:42:37.769779] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-02T18:42:37.873023] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-02. [2025-10-02T18:42:38.080610] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-02T18:42:38.612986] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-02T18:42:38.673030] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-01. [2025-10-02T18:42:39.473006] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-07. [2025-10-02T18:42:40.273024] [INFO ] [REMOTE ] EMR: Fetching primary data for 2024-12. [2025-10-02T18:42:40.291381] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-02T18:42:41.073014] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-03. [2025-10-02T18:42:41.429279] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-02T18:42:41.873017] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-08. [2025-10-02T18:42:41.891117] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-02T18:42:42.086949] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-02T18:42:42.673041] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-04. [2025-10-02T18:42:43.472985] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-02. [2025-10-02T18:42:43.569266] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-02T18:42:43.650407] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-02T18:42:43.926768] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-02T18:42:44.273047] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-01. [2025-10-02T18:42:45.073014] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-05. [2025-10-02T18:42:45.873030] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-03. [2025-10-02T18:42:46.093091] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-02T18:42:46.508268] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-02T18:42:46.673048] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-02. [2025-10-02T18:42:47.473037] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-09. [2025-10-02T18:42:48.120447] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-05 (3.05 seconds). [2025-10-02T18:42:48.272997] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-06. [2025-10-02T18:42:48.404845] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-02T18:42:49.040741] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-02T18:42:49.073014] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-04. [2025-10-02T18:42:49.262927] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-02T18:42:49.630352] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-02T18:42:49.872997] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-05. [2025-10-02T18:42:50.242400] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-02T18:42:50.673009] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-10. [2025-10-02T18:42:51.473011] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-03. [2025-10-02T18:42:51.999107] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-02T18:42:52.001255] [INFO ] [REMOTE ] EMN: Full fetch complete (72087 records). [2025-10-02T18:42:52.001380] [DEBUG] [VALIDATOR ] EMN: Validating primary data. [2025-10-02T18:42:52.279279] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-07. [2025-10-02T18:42:52.438356] [DEBUG] [VALIDATOR ] EMN: All expected trading days are present. [2025-10-02T18:42:52.438490] [DEBUG] [VALIDATOR ] EMN: Primary data validation passed. [2025-10-02T18:42:52.439412] [INFO ] [MAIN ] EMN: Fetched primary data is valid. [2025-10-02T18:42:52.439479] [DEBUG] [LOCAL ] EMN: Saving primary data. [2025-10-02T18:42:52.441021] [DEBUG] [LOCAL ] EMN: Trimmed 72087 records to 50840 (keeping 200 days of data) [2025-10-02T18:42:52.774292] [DEBUG] [LOCAL ] EMN: Primary data saved (50840 records). [2025-10-02T18:42:52.774429] [INFO ] [MAIN ] EMN: Full history saved. [2025-10-02T18:42:52.774527] [INFO ] [MAIN ] Update Progress: 734/2370 symbols completed. EMN took 35.8s. Estimated remaining: 3h 49m 10s. Rate: 7.1 symbols/min [2025-10-02T18:42:52.957084] [INFO ] [MAIN ] ENB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:42:53.011787] [DEBUG] [LOCAL ] ENB: Loaded 53512 existing records from primary storage. [2025-10-02T18:42:53.012134] [INFO ] [MAIN ] ENB: Loaded 53512 existing records. [2025-10-02T18:42:53.079111] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-06. [2025-10-02T18:42:53.210100] [WARN ] [MAIN ] ENB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:42:53.210622] [INFO ] [MAIN ] ENB: Wiping existing primary data before full refresh. [2025-10-02T18:42:53.210902] [INFO ] [LOCAL ] ENB: Starting deletion of primary data. [2025-10-02T18:42:53.214118] [DEBUG] [LOCAL ] ENB: Deleted primary data file. [2025-10-02T18:42:53.214184] [INFO ] [MAIN ] ENB: Starting full primary refresh. [2025-10-02T18:42:53.350278] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-02T18:42:53.529294] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-02T18:42:53.651412] [INFO ] [REMOTE ] ENB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:42:53.683844] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-02T18:42:53.873021] [INFO ] [REMOTE ] ENB: Fetching primary data for 2024-12. [2025-10-02T18:42:54.673014] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-08. [2025-10-02T18:42:55.255151] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-02T18:42:55.472999] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-04. [2025-10-02T18:42:55.847051] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-02T18:42:56.272996] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-07. [2025-10-02T18:42:56.959607] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-02T18:42:57.072998] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-08. [2025-10-02T18:42:57.356804] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-02T18:42:57.525759] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-02T18:42:57.873775] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-05. [2025-10-02T18:42:58.673005] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-09. [2025-10-02T18:42:59.314961] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-02T18:42:59.473007] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-01. [2025-10-02T18:42:59.709912] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-02T18:43:00.273000] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-09. [2025-10-02T18:43:00.848976] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-02T18:43:00.988286] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-02T18:43:01.073198] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-10. [2025-10-02T18:43:01.604327] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-02T18:43:01.605797] [INFO ] [REMOTE ] EMP: Full fetch complete (4293 records). [2025-10-02T18:43:01.605963] [DEBUG] [VALIDATOR ] EMP: Validating primary data. [2025-10-02T18:43:01.606865] [FATAL] [VALIDATOR ] EMP: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:43:01.606976] [FATAL] [MAIN ] EMP: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:43:01.607039] [WARN ] [MAIN ] EMP: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:43:01.607134] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-10-02T18:43:01.607244] [DEBUG] [LOCAL ] EMP: No primary data file found to delete. [2025-10-02T18:43:01.607347] [INFO ] [LOCAL ] EMP: Starting deletion of derivative data. [2025-10-02T18:43:01.608018] [DEBUG] [LOCAL ] EMP: Deleted derivative data file. [2025-10-02T18:43:01.608212] [INFO ] [MAIN ] Update Progress: 735/2370 symbols completed. EMP took 27.2s. Estimated remaining: 3h 49m 2s. Rate: 7.1 symbols/min [2025-10-02T18:43:01.825487] [INFO ] [MAIN ] ENFY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:43:01.831312] [DEBUG] [LOCAL ] ENFY: Loaded 3099 existing records from primary storage. [2025-10-02T18:43:01.831512] [INFO ] [MAIN ] ENFY: Loaded 3099 existing records. [2025-10-02T18:43:01.878188] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-10. [2025-10-02T18:43:02.033417] [WARN ] [MAIN ] ENFY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:43:02.033627] [INFO ] [MAIN ] ENFY: Wiping existing primary data before full refresh. [2025-10-02T18:43:02.033714] [INFO ] [LOCAL ] ENFY: Starting deletion of primary data. [2025-10-02T18:43:02.033976] [DEBUG] [LOCAL ] ENFY: Deleted primary data file. [2025-10-02T18:43:02.034040] [INFO ] [MAIN ] ENFY: Starting full primary refresh. [2025-10-02T18:43:02.483710] [INFO ] [REMOTE ] ENFY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:43:02.672992] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-02. [2025-10-02T18:43:02.853742] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-02T18:43:02.854926] [INFO ] [REMOTE ] EMO: Full fetch complete (17222 records). [2025-10-02T18:43:02.855003] [DEBUG] [VALIDATOR ] EMO: Validating primary data. [2025-10-02T18:43:03.257806] [DEBUG] [VALIDATOR ] EMO: All expected trading days are present. [2025-10-02T18:43:03.257892] [DEBUG] [VALIDATOR ] EMO: Primary data validation passed. [2025-10-02T18:43:03.258330] [INFO ] [MAIN ] EMO: Fetched primary data is valid. [2025-10-02T18:43:03.258393] [DEBUG] [LOCAL ] EMO: Saving primary data. [2025-10-02T18:43:03.259088] [DEBUG] [LOCAL ] EMO: Trimmed 17222 records to 12644 (keeping 200 days of data) [2025-10-02T18:43:03.343375] [DEBUG] [LOCAL ] EMO: Primary data saved (12644 records). [2025-10-02T18:43:03.343515] [INFO ] [MAIN ] EMO: Full history saved. [2025-10-02T18:43:03.343626] [INFO ] [MAIN ] Update Progress: 736/2370 symbols completed. EMO took 31.3s. Estimated remaining: 3h 48m 39s. Rate: 7.1 symbols/min [2025-10-02T18:43:03.478165] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2024-12. [2025-10-02T18:43:03.546912] [INFO ] [MAIN ] ENIC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:43:03.547187] [DEBUG] [LOCAL ] ENIC: No existing data file found in primary storage. [2025-10-02T18:43:03.547239] [WARN ] [MAIN ] ENIC: No existing data found, performing full refresh instead. [2025-10-02T18:43:03.547354] [INFO ] [MAIN ] ENIC: Wiping existing primary data before full refresh. [2025-10-02T18:43:03.547397] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-10-02T18:43:03.547442] [DEBUG] [LOCAL ] ENIC: No primary data file found to delete. [2025-10-02T18:43:03.547475] [INFO ] [MAIN ] ENIC: Starting full primary refresh. [2025-10-02T18:43:03.976731] [INFO ] [REMOTE ] ENIC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:43:04.273000] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-06. [2025-10-02T18:43:04.360381] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-02T18:43:04.423077] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-02T18:43:05.072991] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-01. [2025-10-02T18:43:05.845985] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-02T18:43:05.872990] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-02. [2025-10-02T18:43:06.093954] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-02T18:43:06.458895] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-02T18:43:06.673067] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-03. [2025-10-02T18:43:07.051265] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-02T18:43:07.473096] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2024-12. [2025-10-02T18:43:08.273053] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-07. [2025-10-02T18:43:09.040876] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-02T18:43:09.073034] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-01. [2025-10-02T18:43:09.873035] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-03. [2025-10-02T18:43:10.063738] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-02T18:43:10.113006] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-02T18:43:10.673003] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-02. [2025-10-02T18:43:11.473004] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-08. [2025-10-02T18:43:11.712832] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-02T18:43:11.889944] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-02T18:43:12.273013] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-04. [2025-10-02T18:43:12.617048] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-02T18:43:12.911247] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-02T18:43:13.072997] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-03. [2025-10-02T18:43:13.872997] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-04. [2025-10-02T18:43:14.529245] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-02T18:43:14.673045] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-05. [2025-10-02T18:43:15.287936] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-02T18:43:15.473019] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-06. [2025-10-02T18:43:16.128349] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-02T18:43:16.273050] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-09. [2025-10-02T18:43:16.785613] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-04 (2.91 seconds). [2025-10-02T18:43:17.073012] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-04. [2025-10-02T18:43:17.873036] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-07. [2025-10-02T18:43:18.172900] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-02T18:43:18.488905] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-02T18:43:18.663701] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-02T18:43:18.672956] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-08. [2025-10-02T18:43:19.184442] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-02T18:43:19.473041] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-09. [2025-10-02T18:43:20.066255] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-02T18:43:20.272981] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-10. [2025-10-02T18:43:20.938475] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-02T18:43:20.939190] [INFO ] [REMOTE ] ENFY: Full fetch complete (5602 records). [2025-10-02T18:43:20.939260] [DEBUG] [VALIDATOR ] ENFY: Validating primary data. [2025-10-02T18:43:20.939629] [FATAL] [VALIDATOR ] ENFY: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:43:20.939746] [FATAL] [MAIN ] ENFY: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:43:20.939790] [WARN ] [MAIN ] ENFY: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:43:20.939829] [INFO ] [LOCAL ] ENFY: Starting deletion of primary data. [2025-10-02T18:43:20.939884] [DEBUG] [LOCAL ] ENFY: No primary data file found to delete. [2025-10-02T18:43:20.939919] [INFO ] [LOCAL ] ENFY: Starting deletion of derivative data. [2025-10-02T18:43:20.940288] [DEBUG] [LOCAL ] ENFY: Deleted derivative data file. [2025-10-02T18:43:20.940377] [INFO ] [MAIN ] Update Progress: 737/2370 symbols completed. ENFY took 19.3s. Estimated remaining: 3h 48m 51s. Rate: 7.1 symbols/min [2025-10-02T18:43:21.078121] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-05. [2025-10-02T18:43:21.134775] [INFO ] [MAIN ] ENO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:43:21.138990] [DEBUG] [LOCAL ] ENO: Loaded 1915 existing records from primary storage. [2025-10-02T18:43:21.139232] [INFO ] [MAIN ] ENO: Loaded 1915 existing records. [2025-10-02T18:43:21.356708] [WARN ] [MAIN ] ENO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:43:21.357043] [INFO ] [MAIN ] ENO: Wiping existing primary data before full refresh. [2025-10-02T18:43:21.357113] [INFO ] [LOCAL ] ENO: Starting deletion of primary data. [2025-10-02T18:43:21.357401] [DEBUG] [LOCAL ] ENO: Deleted primary data file. [2025-10-02T18:43:21.357463] [INFO ] [MAIN ] ENO: Starting full primary refresh. [2025-10-02T18:43:21.756098] [INFO ] [REMOTE ] ENO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:43:21.872998] [INFO ] [REMOTE ] ENO: Fetching primary data for 2024-12. [2025-10-02T18:43:22.261175] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-10-02T18:43:22.672998] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-05. [2025-10-02T18:43:22.734246] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-02T18:43:23.473006] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-01. [2025-10-02T18:43:24.106044] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-02T18:43:24.273029] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-10. [2025-10-02T18:43:24.756197] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-02T18:43:25.072987] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-06. [2025-10-02T18:43:25.850270] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-02T18:43:25.853050] [INFO ] [REMOTE ] EMR: Full fetch complete (77103 records). [2025-10-02T18:43:25.853190] [DEBUG] [VALIDATOR ] EMR: Validating primary data. [2025-10-02T18:43:25.878176] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-06. [2025-10-02T18:43:26.316935] [DEBUG] [VALIDATOR ] EMR: All expected trading days are present. [2025-10-02T18:43:26.317032] [DEBUG] [VALIDATOR ] EMR: Primary data validation passed. [2025-10-02T18:43:26.318160] [INFO ] [MAIN ] EMR: Fetched primary data is valid. [2025-10-02T18:43:26.318229] [DEBUG] [LOCAL ] EMR: Saving primary data. [2025-10-02T18:43:26.323023] [DEBUG] [LOCAL ] EMR: Trimmed 77103 records to 53633 (keeping 200 days of data) [2025-10-02T18:43:26.597810] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-02T18:43:26.692119] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-07. [2025-10-02T18:43:26.754945] [DEBUG] [LOCAL ] EMR: Primary data saved (53633 records). [2025-10-02T18:43:26.755156] [INFO ] [MAIN ] EMR: Full history saved. [2025-10-02T18:43:26.756266] [INFO ] [MAIN ] Update Progress: 738/2370 symbols completed. EMR took 51.7s. Estimated remaining: 3h 48m 37s. Rate: 7.1 symbols/min [2025-10-02T18:43:26.953075] [INFO ] [MAIN ] ENOV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:43:27.006505] [DEBUG] [LOCAL ] ENOV: Loaded 44921 existing records from primary storage. [2025-10-02T18:43:27.006896] [INFO ] [MAIN ] ENOV: Loaded 44921 existing records. [2025-10-02T18:43:27.218331] [WARN ] [MAIN ] ENOV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:43:27.218539] [INFO ] [MAIN ] ENOV: Wiping existing primary data before full refresh. [2025-10-02T18:43:27.218589] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-10-02T18:43:27.220518] [DEBUG] [LOCAL ] ENOV: Deleted primary data file. [2025-10-02T18:43:27.220591] [INFO ] [MAIN ] ENOV: Starting full primary refresh. [2025-10-02T18:43:27.483707] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-02. [2025-10-02T18:43:27.612468] [INFO ] [REMOTE ] ENOV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:43:27.697489] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-02T18:43:27.861068] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-02T18:43:28.004382] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-02T18:43:28.273009] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-07. [2025-10-02T18:43:29.073022] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-03. [2025-10-02T18:43:29.556350] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-02T18:43:29.873037] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2024-12. [2025-10-02T18:43:30.184089] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-02T18:43:30.673045] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-08. [2025-10-02T18:43:31.473017] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-04. [2025-10-02T18:43:31.601982] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-02T18:43:32.026627] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-02T18:43:32.118741] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-02T18:43:32.273050] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-05. [2025-10-02T18:43:32.861663] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-02T18:43:33.073017] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-09. [2025-10-02T18:43:33.873001] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-01. [2025-10-02T18:43:34.462588] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-02T18:43:34.673013] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-08. [2025-10-02T18:43:35.404458] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-02T18:43:35.473057] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-06. [2025-10-02T18:43:35.908678] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-02T18:43:36.107770] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-02T18:43:36.273030] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-09. [2025-10-02T18:43:37.073039] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-02. [2025-10-02T18:43:37.873000] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-07. [2025-10-02T18:43:38.118867] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-02T18:43:38.329191] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-02T18:43:38.546624] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-02T18:43:38.673049] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-10. [2025-10-02T18:43:39.473018] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-03. [2025-10-02T18:43:40.189347] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-02T18:43:40.191730] [INFO ] [REMOTE ] ENB: Full fetch complete (77488 records). [2025-10-02T18:43:40.191890] [DEBUG] [VALIDATOR ] ENB: Validating primary data. [2025-10-02T18:43:40.278162] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-08. [2025-10-02T18:43:40.643824] [DEBUG] [VALIDATOR ] ENB: All expected trading days are present. [2025-10-02T18:43:40.644003] [DEBUG] [VALIDATOR ] ENB: Primary data validation passed. [2025-10-02T18:43:40.648900] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-02T18:43:40.648755] [INFO ] [MAIN ] ENB: Fetched primary data is valid. [2025-10-02T18:43:40.650738] [DEBUG] [LOCAL ] ENB: Saving primary data. [2025-10-02T18:43:40.652192] [DEBUG] [LOCAL ] ENB: Trimmed 77488 records to 53900 (keeping 200 days of data) [2025-10-02T18:43:41.005559] [DEBUG] [LOCAL ] ENB: Primary data saved (53900 records). [2025-10-02T18:43:41.005751] [INFO ] [MAIN ] ENB: Full history saved. [2025-10-02T18:43:41.005844] [INFO ] [MAIN ] Update Progress: 739/2370 symbols completed. ENB took 48.2s. Estimated remaining: 3h 48m 42s. Rate: 7.1 symbols/min [2025-10-02T18:43:41.078144] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-10. [2025-10-02T18:43:41.208007] [INFO ] [MAIN ] ENR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:43:41.238379] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-02T18:43:41.286930] [DEBUG] [LOCAL ] ENR: Loaded 42858 existing records from primary storage. [2025-10-02T18:43:41.287271] [INFO ] [MAIN ] ENR: Loaded 42858 existing records. [2025-10-02T18:43:41.543825] [WARN ] [MAIN ] ENR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:43:41.544084] [INFO ] [MAIN ] ENR: Wiping existing primary data before full refresh. [2025-10-02T18:43:41.544138] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-10-02T18:43:41.545972] [DEBUG] [LOCAL ] ENR: Deleted primary data file. [2025-10-02T18:43:41.546037] [INFO ] [MAIN ] ENR: Starting full primary refresh. [2025-10-02T18:43:41.877067] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-04. [2025-10-02T18:43:41.967745] [INFO ] [REMOTE ] ENR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:43:42.196155] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-02T18:43:42.197809] [INFO ] [REMOTE ] ENIC: Full fetch complete (51447 records). [2025-10-02T18:43:42.197929] [DEBUG] [VALIDATOR ] ENIC: Validating primary data. [2025-10-02T18:43:42.605980] [DEBUG] [VALIDATOR ] ENIC: All expected trading days are present. [2025-10-02T18:43:42.606101] [DEBUG] [VALIDATOR ] ENIC: Primary data validation passed. [2025-10-02T18:43:42.606886] [INFO ] [MAIN ] ENIC: Fetched primary data is valid. [2025-10-02T18:43:42.606964] [DEBUG] [LOCAL ] ENIC: Saving primary data. [2025-10-02T18:43:42.608487] [DEBUG] [LOCAL ] ENIC: Trimmed 51447 records to 36637 (keeping 200 days of data) [2025-10-02T18:43:42.676327] [INFO ] [REMOTE ] ENR: Fetching primary data for 2024-12. [2025-10-02T18:43:42.835555] [DEBUG] [LOCAL ] ENIC: Primary data saved (36637 records). [2025-10-02T18:43:42.835756] [INFO ] [MAIN ] ENIC: Full history saved. [2025-10-02T18:43:42.835845] [INFO ] [MAIN ] Update Progress: 740/2370 symbols completed. ENIC took 39.5s. Estimated remaining: 3h 48m 19s. Rate: 7.1 symbols/min [2025-10-02T18:43:43.023086] [INFO ] [MAIN ] ENS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:43:43.023285] [DEBUG] [LOCAL ] ENS: No existing data file found in primary storage. [2025-10-02T18:43:43.023325] [WARN ] [MAIN ] ENS: No existing data found, performing full refresh instead. [2025-10-02T18:43:43.023445] [INFO ] [MAIN ] ENS: Wiping existing primary data before full refresh. [2025-10-02T18:43:43.023489] [INFO ] [LOCAL ] ENS: Starting deletion of primary data. [2025-10-02T18:43:43.023534] [DEBUG] [LOCAL ] ENS: No primary data file found to delete. [2025-10-02T18:43:43.023569] [INFO ] [MAIN ] ENS: Starting full primary refresh. [2025-10-02T18:43:43.443945] [INFO ] [REMOTE ] ENS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:43:43.471765] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-02T18:43:43.481304] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-09. [2025-10-02T18:43:43.868255] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-02T18:43:44.103989] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-02T18:43:44.273007] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-05. [2025-10-02T18:43:45.073043] [INFO ] [REMOTE ] ENS: Fetching primary data for 2024-12. [2025-10-02T18:43:45.872974] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-01. [2025-10-02T18:43:45.914737] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-02T18:43:46.374072] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-02T18:43:46.673007] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-10. [2025-10-02T18:43:47.149258] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-02T18:43:47.171505] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-02T18:43:47.172224] [INFO ] [REMOTE ] ENO: Full fetch complete (3113 records). [2025-10-02T18:43:47.172295] [DEBUG] [VALIDATOR ] ENO: Validating primary data. [2025-10-02T18:43:47.478244] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-02. [2025-10-02T18:43:47.576996] [DEBUG] [VALIDATOR ] ENO: All expected trading days are present. [2025-10-02T18:43:47.577099] [DEBUG] [VALIDATOR ] ENO: Primary data validation passed. [2025-10-02T18:43:47.577251] [INFO ] [MAIN ] ENO: Fetched primary data is valid. [2025-10-02T18:43:47.577312] [DEBUG] [LOCAL ] ENO: Saving primary data. [2025-10-02T18:43:47.577840] [DEBUG] [LOCAL ] ENO: Trimmed 3113 records to 1926 (keeping 200 days of data) [2025-10-02T18:43:47.599158] [DEBUG] [LOCAL ] ENO: Primary data saved (1926 records). [2025-10-02T18:43:47.599308] [INFO ] [MAIN ] ENO: Full history saved. [2025-10-02T18:43:47.599406] [INFO ] [MAIN ] Update Progress: 741/2370 symbols completed. ENO took 26.7s. Estimated remaining: 3h 48m 2s. Rate: 7.1 symbols/min [2025-10-02T18:43:47.813366] [INFO ] [MAIN ] ENVA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:43:47.844896] [DEBUG] [LOCAL ] ENVA: Loaded 25283 existing records from primary storage. [2025-10-02T18:43:47.845160] [INFO ] [MAIN ] ENVA: Loaded 25283 existing records. [2025-10-02T18:43:48.031881] [WARN ] [MAIN ] ENVA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:43:48.032092] [INFO ] [MAIN ] ENVA: Wiping existing primary data before full refresh. [2025-10-02T18:43:48.032154] [INFO ] [LOCAL ] ENVA: Starting deletion of primary data. [2025-10-02T18:43:48.033063] [DEBUG] [LOCAL ] ENVA: Deleted primary data file. [2025-10-02T18:43:48.033126] [INFO ] [MAIN ] ENVA: Starting full primary refresh. [2025-10-02T18:43:48.284438] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-01. [2025-10-02T18:43:48.460491] [INFO ] [REMOTE ] ENVA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:43:48.906024] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-02T18:43:49.073003] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-03. [2025-10-02T18:43:49.613523] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-02T18:43:49.873026] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-06. [2025-10-02T18:43:50.240135] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-02T18:43:50.672995] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-02. [2025-10-02T18:43:51.426222] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-02T18:43:51.473018] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-07. [2025-10-02T18:43:52.080461] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-02T18:43:52.273019] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-03. [2025-10-02T18:43:53.072978] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-04. [2025-10-02T18:43:53.149508] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-02T18:43:53.307028] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-02T18:43:53.873010] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-04. [2025-10-02T18:43:54.673000] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-08. [2025-10-02T18:43:54.746620] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-02T18:43:55.301928] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-02T18:43:55.473007] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-05. [2025-10-02T18:43:56.273003] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-05. [2025-10-02T18:43:56.363855] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-02T18:43:57.072974] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-09. [2025-10-02T18:43:57.111429] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-02T18:43:57.420677] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-02T18:43:57.873001] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2024-12. [2025-10-02T18:43:58.619014] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-02T18:43:58.673011] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-10. [2025-10-02T18:43:59.040112] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-02T18:43:59.473010] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-06. [2025-10-02T18:43:59.773307] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-02T18:43:59.775905] [INFO ] [REMOTE ] ENOV: Full fetch complete (63222 records). [2025-10-02T18:43:59.776037] [DEBUG] [VALIDATOR ] ENOV: Validating primary data. [2025-10-02T18:44:00.201011] [DEBUG] [VALIDATOR ] ENOV: All expected trading days are present. [2025-10-02T18:44:00.201093] [DEBUG] [VALIDATOR ] ENOV: Primary data validation passed. [2025-10-02T18:44:00.201961] [INFO ] [MAIN ] ENOV: Fetched primary data is valid. [2025-10-02T18:44:00.202025] [DEBUG] [LOCAL ] ENOV: Saving primary data. [2025-10-02T18:44:00.203350] [DEBUG] [LOCAL ] ENOV: Trimmed 63222 records to 45207 (keeping 200 days of data) [2025-10-02T18:44:00.290956] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-06. [2025-10-02T18:44:00.487728] [DEBUG] [LOCAL ] ENOV: Primary data saved (45207 records). [2025-10-02T18:44:00.487863] [INFO ] [MAIN ] ENOV: Full history saved. [2025-10-02T18:44:00.488413] [INFO ] [MAIN ] Update Progress: 742/2370 symbols completed. ENOV took 33.7s. Estimated remaining: 3h 48m 4s. Rate: 7.1 symbols/min [2025-10-02T18:44:00.669736] [INFO ] [MAIN ] EOD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:44:00.685941] [DEBUG] [LOCAL ] EOD: Loaded 14412 existing records from primary storage. [2025-10-02T18:44:00.686192] [INFO ] [MAIN ] EOD: Loaded 14412 existing records. [2025-10-02T18:44:00.876314] [WARN ] [MAIN ] EOD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:44:00.876523] [INFO ] [MAIN ] EOD: Wiping existing primary data before full refresh. [2025-10-02T18:44:00.876573] [INFO ] [LOCAL ] EOD: Starting deletion of primary data. [2025-10-02T18:44:00.877415] [DEBUG] [LOCAL ] EOD: Deleted primary data file. [2025-10-02T18:44:00.877482] [INFO ] [MAIN ] EOD: Starting full primary refresh. [2025-10-02T18:44:01.078397] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-01. [2025-10-02T18:44:01.278457] [INFO ] [REMOTE ] EOD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:44:01.312859] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-02T18:44:01.838389] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-02T18:44:01.872987] [INFO ] [REMOTE ] EOD: Fetching primary data for 2024-12. [2025-10-02T18:44:02.265342] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-02T18:44:02.571569] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-02T18:44:02.672994] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-07. [2025-10-02T18:44:03.473037] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-07. [2025-10-02T18:44:04.122017] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-02T18:44:04.272999] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-08. [2025-10-02T18:44:04.743541] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-02T18:44:05.073013] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-08. [2025-10-02T18:44:05.692168] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-02T18:44:05.873035] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-01. [2025-10-02T18:44:06.045600] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-02T18:44:06.673056] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-02. [2025-10-02T18:44:06.783237] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-02T18:44:07.473002] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-02. [2025-10-02T18:44:08.037931] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-02T18:44:08.068506] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-02T18:44:08.273013] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-09. [2025-10-02T18:44:09.073049] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-03. [2025-10-02T18:44:09.635602] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-02T18:44:09.700146] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-02T18:44:09.873003] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-09. [2025-10-02T18:44:10.673012] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-03. [2025-10-02T18:44:11.215156] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-02T18:44:11.473037] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-04. [2025-10-02T18:44:11.933939] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-02T18:44:12.273022] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-10. [2025-10-02T18:44:12.295252] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-02T18:44:13.072996] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-04. [2025-10-02T18:44:13.237018] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-02T18:44:13.238480] [INFO ] [REMOTE ] ENS: Full fetch complete (42016 records). [2025-10-02T18:44:13.238582] [DEBUG] [VALIDATOR ] ENS: Validating primary data. [2025-10-02T18:44:13.239185] [FATAL] [VALIDATOR ] ENS: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:44:13.239280] [FATAL] [MAIN ] ENS: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:44:13.239362] [WARN ] [MAIN ] ENS: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:44:13.239440] [INFO ] [LOCAL ] ENS: Starting deletion of primary data. [2025-10-02T18:44:13.239552] [DEBUG] [LOCAL ] ENS: No primary data file found to delete. [2025-10-02T18:44:13.239597] [INFO ] [LOCAL ] ENS: Starting deletion of derivative data. [2025-10-02T18:44:13.239669] [DEBUG] [LOCAL ] ENS: No derivative data file found to delete. [2025-10-02T18:44:13.239752] [INFO ] [MAIN ] Update Progress: 743/2370 symbols completed. ENS took 30.4s. Estimated remaining: 3h 48m 5s. Rate: 7.1 symbols/min [2025-10-02T18:44:13.451435] [INFO ] [MAIN ] EOG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:44:13.514300] [DEBUG] [LOCAL ] EOG: Loaded 53344 existing records from primary storage. [2025-10-02T18:44:13.514841] [INFO ] [MAIN ] EOG: Loaded 53344 existing records. [2025-10-02T18:44:13.717118] [WARN ] [MAIN ] EOG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:44:13.717369] [INFO ] [MAIN ] EOG: Wiping existing primary data before full refresh. [2025-10-02T18:44:13.717420] [INFO ] [LOCAL ] EOG: Starting deletion of primary data. [2025-10-02T18:44:13.719994] [DEBUG] [LOCAL ] EOG: Deleted primary data file. [2025-10-02T18:44:13.720078] [INFO ] [MAIN ] EOG: Starting full primary refresh. [2025-10-02T18:44:13.880053] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-10. [2025-10-02T18:44:14.130888] [INFO ] [REMOTE ] EOG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:44:14.369917] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-02T18:44:14.673003] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-05. [2025-10-02T18:44:15.472948] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-05. [2025-10-02T18:44:15.480392] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-02T18:44:15.483122] [INFO ] [REMOTE ] ENR: Full fetch complete (58677 records). [2025-10-02T18:44:15.483310] [DEBUG] [VALIDATOR ] ENR: Validating primary data. [2025-10-02T18:44:16.069563] [DEBUG] [VALIDATOR ] ENR: All expected trading days are present. [2025-10-02T18:44:16.069763] [DEBUG] [VALIDATOR ] ENR: Primary data validation passed. [2025-10-02T18:44:16.070840] [INFO ] [MAIN ] ENR: Fetched primary data is valid. [2025-10-02T18:44:16.070985] [DEBUG] [LOCAL ] ENR: Saving primary data. [2025-10-02T18:44:16.098447] [DEBUG] [LOCAL ] ENR: Trimmed 58677 records to 43162 (keeping 200 days of data) [2025-10-02T18:44:16.101922] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-02T18:44:16.279717] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-06. [2025-10-02T18:44:16.443361] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-02T18:44:16.509292] [DEBUG] [LOCAL ] ENR: Primary data saved (43162 records). [2025-10-02T18:44:16.509490] [INFO ] [MAIN ] ENR: Full history saved. [2025-10-02T18:44:16.509619] [INFO ] [MAIN ] Update Progress: 744/2370 symbols completed. ENR took 35.5s. Estimated remaining: 3h 47m 45s. Rate: 7.1 symbols/min [2025-10-02T18:44:16.716620] [INFO ] [MAIN ] EOI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:44:16.730739] [DEBUG] [LOCAL ] EOI: Loaded 10683 existing records from primary storage. [2025-10-02T18:44:16.731018] [INFO ] [MAIN ] EOI: Loaded 10683 existing records. [2025-10-02T18:44:16.932028] [WARN ] [MAIN ] EOI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:44:16.932231] [INFO ] [MAIN ] EOI: Wiping existing primary data before full refresh. [2025-10-02T18:44:16.932281] [INFO ] [LOCAL ] EOI: Starting deletion of primary data. [2025-10-02T18:44:16.932858] [DEBUG] [LOCAL ] EOI: Deleted primary data file. [2025-10-02T18:44:16.932919] [INFO ] [MAIN ] EOI: Starting full primary refresh. [2025-10-02T18:44:17.089019] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-06. [2025-10-02T18:44:17.334429] [INFO ] [REMOTE ] EOI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:44:17.351114] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-02T18:44:17.873011] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-07. [2025-10-02T18:44:18.062083] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-02T18:44:18.673356] [INFO ] [REMOTE ] EOG: Fetching primary data for 2024-12. [2025-10-02T18:44:19.143969] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-02T18:44:19.472983] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-07. [2025-10-02T18:44:20.233706] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-02T18:44:20.273003] [INFO ] [REMOTE ] EOI: Fetching primary data for 2024-12. [2025-10-02T18:44:20.542469] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-02T18:44:21.073038] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-01. [2025-10-02T18:44:21.241846] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-02T18:44:21.873019] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-08. [2025-10-02T18:44:22.672972] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-08. [2025-10-02T18:44:22.927860] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-02T18:44:22.955485] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-02T18:44:23.473012] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-09. [2025-10-02T18:44:23.593858] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-02T18:44:24.273018] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-09. [2025-10-02T18:44:24.618334] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-02T18:44:24.863196] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-02T18:44:25.073014] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-10. [2025-10-02T18:44:25.712825] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-02T18:44:25.713998] [INFO ] [REMOTE ] EOD: Full fetch complete (20232 records). [2025-10-02T18:44:25.714077] [DEBUG] [VALIDATOR ] EOD: Validating primary data. [2025-10-02T18:44:25.714518] [FATAL] [VALIDATOR ] EOD: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:44:25.714714] [FATAL] [MAIN ] EOD: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:44:25.714793] [WARN ] [MAIN ] EOD: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:44:25.714881] [INFO ] [LOCAL ] EOD: Starting deletion of primary data. [2025-10-02T18:44:25.714971] [DEBUG] [LOCAL ] EOD: No primary data file found to delete. [2025-10-02T18:44:25.715011] [INFO ] [LOCAL ] EOD: Starting deletion of derivative data. [2025-10-02T18:44:25.715391] [DEBUG] [LOCAL ] EOD: Deleted derivative data file. [2025-10-02T18:44:25.715482] [INFO ] [MAIN ] Update Progress: 745/2370 symbols completed. EOD took 25.2s. Estimated remaining: 3h 47m 39s. Rate: 7.1 symbols/min [2025-10-02T18:44:25.878130] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-02. [2025-10-02T18:44:25.913392] [INFO ] [MAIN ] EOS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:44:25.930282] [DEBUG] [LOCAL ] EOS: Loaded 15225 existing records from primary storage. [2025-10-02T18:44:25.930542] [INFO ] [MAIN ] EOS: Loaded 15225 existing records. [2025-10-02T18:44:26.135404] [WARN ] [MAIN ] EOS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:44:26.135625] [INFO ] [MAIN ] EOS: Wiping existing primary data before full refresh. [2025-10-02T18:44:26.135709] [INFO ] [LOCAL ] EOS: Starting deletion of primary data. [2025-10-02T18:44:26.136519] [DEBUG] [LOCAL ] EOS: Deleted primary data file. [2025-10-02T18:44:26.136610] [INFO ] [MAIN ] EOS: Starting full primary refresh. [2025-10-02T18:44:26.535051] [INFO ] [REMOTE ] EOS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:44:26.673053] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-10. [2025-10-02T18:44:27.273631] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-02T18:44:27.473034] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-01. [2025-10-02T18:44:27.690761] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-02T18:44:27.692259] [INFO ] [REMOTE ] ENVA: Full fetch complete (36785 records). [2025-10-02T18:44:27.692343] [DEBUG] [VALIDATOR ] ENVA: Validating primary data. [2025-10-02T18:44:28.114322] [DEBUG] [VALIDATOR ] ENVA: All expected trading days are present. [2025-10-02T18:44:28.114417] [DEBUG] [VALIDATOR ] ENVA: Primary data validation passed. [2025-10-02T18:44:28.115086] [INFO ] [MAIN ] ENVA: Fetched primary data is valid. [2025-10-02T18:44:28.115153] [DEBUG] [LOCAL ] ENVA: Saving primary data. [2025-10-02T18:44:28.116193] [DEBUG] [LOCAL ] ENVA: Trimmed 36785 records to 25450 (keeping 200 days of data) [2025-10-02T18:44:28.276166] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-03. [2025-10-02T18:44:28.276797] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-02T18:44:28.303831] [DEBUG] [LOCAL ] ENVA: Primary data saved (25450 records). [2025-10-02T18:44:28.303995] [INFO ] [MAIN ] ENVA: Full history saved. [2025-10-02T18:44:28.304103] [INFO ] [MAIN ] Update Progress: 746/2370 symbols completed. ENVA took 40.7s. Estimated remaining: 3h 47m 17s. Rate: 7.1 symbols/min [2025-10-02T18:44:28.490228] [INFO ] [MAIN ] EOT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:44:28.499340] [DEBUG] [LOCAL ] EOT: Loaded 6873 existing records from primary storage. [2025-10-02T18:44:28.499572] [INFO ] [MAIN ] EOT: Loaded 6873 existing records. [2025-10-02T18:44:28.695314] [WARN ] [MAIN ] EOT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:44:28.695568] [INFO ] [MAIN ] EOT: Wiping existing primary data before full refresh. [2025-10-02T18:44:28.695619] [INFO ] [LOCAL ] EOT: Starting deletion of primary data. [2025-10-02T18:44:28.696278] [DEBUG] [LOCAL ] EOT: Deleted primary data file. [2025-10-02T18:44:28.696345] [INFO ] [MAIN ] EOT: Starting full primary refresh. [2025-10-02T18:44:29.078224] [INFO ] [REMOTE ] EOS: Fetching primary data for 2024-12. [2025-10-02T18:44:29.110975] [INFO ] [REMOTE ] EOT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:44:29.813902] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-02T18:44:29.873008] [INFO ] [REMOTE ] EOT: Fetching primary data for 2024-12. [2025-10-02T18:44:30.229330] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-02T18:44:30.673012] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-04. [2025-10-02T18:44:30.775249] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-02T18:44:31.473004] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-01. [2025-10-02T18:44:32.235224] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-02T18:44:32.272991] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-02. [2025-10-02T18:44:32.672536] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-02T18:44:33.040460] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-02T18:44:33.073054] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-01. [2025-10-02T18:44:33.869103] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-02T18:44:33.873725] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-02. [2025-10-02T18:44:34.673011] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-02. [2025-10-02T18:44:34.802346] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-02T18:44:35.473042] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-03. [2025-10-02T18:44:35.497056] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-02T18:44:36.273006] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-03. [2025-10-02T18:44:36.641628] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-02T18:44:37.013692] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-02T18:44:37.073021] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-04. [2025-10-02T18:44:37.872995] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-03. [2025-10-02T18:44:38.213411] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-02T18:44:38.672983] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-05. [2025-10-02T18:44:38.742089] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-02T18:44:39.473012] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-04. [2025-10-02T18:44:39.621959] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-02T18:44:40.160755] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-02T18:44:40.273008] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-06. [2025-10-02T18:44:41.073052] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-04. [2025-10-02T18:44:41.274784] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-02T18:44:41.873036] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-05. [2025-10-02T18:44:42.673015] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-05. [2025-10-02T18:44:42.689351] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-02T18:44:43.473012] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-05. [2025-10-02T18:44:43.535461] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-02T18:44:43.890303] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-02T18:44:44.087999] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-02T18:44:44.272993] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-06. [2025-10-02T18:44:44.937989] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-02T18:44:45.073005] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-07. [2025-10-02T18:44:45.616665] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-02T18:44:45.872998] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-06. [2025-10-02T18:44:46.613362] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-02T18:44:46.673005] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-07. [2025-10-02T18:44:47.445959] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-02T18:44:47.472967] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-06. [2025-10-02T18:44:48.273037] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-08. [2025-10-02T18:44:48.996853] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-02T18:44:49.041916] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-02T18:44:49.072975] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-09. [2025-10-02T18:44:49.870420] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-02T18:44:49.872942] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-10. [2025-10-02T18:44:50.458071] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-02T18:44:50.458961] [INFO ] [REMOTE ] EOT: Full fetch complete (10768 records). [2025-10-02T18:44:50.459034] [DEBUG] [VALIDATOR ] EOT: Validating primary data. [2025-10-02T18:44:50.678192] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-07. [2025-10-02T18:44:50.872021] [DEBUG] [VALIDATOR ] EOT: All expected trading days are present. [2025-10-02T18:44:50.872120] [DEBUG] [VALIDATOR ] EOT: Primary data validation passed. [2025-10-02T18:44:50.872555] [INFO ] [MAIN ] EOT: Fetched primary data is valid. [2025-10-02T18:44:50.872635] [DEBUG] [LOCAL ] EOT: Saving primary data. [2025-10-02T18:44:50.873420] [DEBUG] [LOCAL ] EOT: Trimmed 10768 records to 6929 (keeping 200 days of data) [2025-10-02T18:44:50.925430] [DEBUG] [LOCAL ] EOT: Primary data saved (6929 records). [2025-10-02T18:44:50.925575] [INFO ] [MAIN ] EOT: Full history saved. [2025-10-02T18:44:50.925683] [INFO ] [MAIN ] Update Progress: 747/2370 symbols completed. EOT took 22.6s. Estimated remaining: 3h 47m 40s. Rate: 7.1 symbols/min [2025-10-02T18:44:51.130242] [INFO ] [MAIN ] EPAC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:44:51.158743] [DEBUG] [LOCAL ] EPAC: Loaded 26946 existing records from primary storage. [2025-10-02T18:44:51.159063] [INFO ] [MAIN ] EPAC: Loaded 26946 existing records. [2025-10-02T18:44:51.361662] [WARN ] [MAIN ] EPAC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:44:51.361898] [INFO ] [MAIN ] EPAC: Wiping existing primary data before full refresh. [2025-10-02T18:44:51.361948] [INFO ] [LOCAL ] EPAC: Starting deletion of primary data. [2025-10-02T18:44:51.362947] [DEBUG] [LOCAL ] EPAC: Deleted primary data file. [2025-10-02T18:44:51.363011] [INFO ] [MAIN ] EPAC: Starting full primary refresh. [2025-10-02T18:44:51.474891] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-07. [2025-10-02T18:44:51.750355] [INFO ] [REMOTE ] EPAC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:44:52.119547] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-02T18:44:52.272997] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2024-12. [2025-10-02T18:44:53.072992] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-08. [2025-10-02T18:44:53.453318] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-02T18:44:53.652878] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-02T18:44:53.872975] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-08. [2025-10-02T18:44:53.903873] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-02T18:44:54.673007] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-01. [2025-10-02T18:44:54.759542] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-02T18:44:55.473015] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-09. [2025-10-02T18:44:55.708171] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-02T18:44:56.273005] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-02. [2025-10-02T18:44:56.362900] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-02T18:44:57.072986] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-10. [2025-10-02T18:44:57.428535] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-02T18:44:57.873040] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-08. [2025-10-02T18:44:57.944477] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-02T18:44:57.945703] [INFO ] [REMOTE ] EOI: Full fetch complete (16216 records). [2025-10-02T18:44:57.945786] [DEBUG] [VALIDATOR ] EOI: Validating primary data. [2025-10-02T18:44:58.344897] [DEBUG] [VALIDATOR ] EOI: All expected trading days are present. [2025-10-02T18:44:58.344981] [DEBUG] [VALIDATOR ] EOI: Primary data validation passed. [2025-10-02T18:44:58.345448] [INFO ] [MAIN ] EOI: Fetched primary data is valid. [2025-10-02T18:44:58.345508] [DEBUG] [LOCAL ] EOI: Saving primary data. [2025-10-02T18:44:58.346571] [DEBUG] [LOCAL ] EOI: Trimmed 16216 records to 10789 (keeping 200 days of data) [2025-10-02T18:44:58.422030] [DEBUG] [LOCAL ] EOI: Primary data saved (10789 records). [2025-10-02T18:44:58.422179] [INFO ] [MAIN ] EOI: Full history saved. [2025-10-02T18:44:58.422264] [INFO ] [MAIN ] Update Progress: 748/2370 symbols completed. EOI took 41.9s. Estimated remaining: 3h 47m 30s. Rate: 7.1 symbols/min [2025-10-02T18:44:58.648409] [INFO ] [MAIN ] EPAM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:44:58.673004] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-09. [2025-10-02T18:44:58.693292] [DEBUG] [LOCAL ] EPAM: Loaded 39752 existing records from primary storage. [2025-10-02T18:44:58.693809] [INFO ] [MAIN ] EPAM: Loaded 39752 existing records. [2025-10-02T18:44:58.909275] [WARN ] [MAIN ] EPAM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:44:58.909512] [INFO ] [MAIN ] EPAM: Wiping existing primary data before full refresh. [2025-10-02T18:44:58.909562] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-10-02T18:44:58.910727] [DEBUG] [LOCAL ] EPAM: Deleted primary data file. [2025-10-02T18:44:58.910790] [INFO ] [MAIN ] EPAM: Starting full primary refresh. [2025-10-02T18:44:59.321429] [INFO ] [REMOTE ] EPAM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:44:59.473005] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-03. [2025-10-02T18:44:59.652446] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-02T18:44:59.777824] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-02T18:45:00.273069] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-10. [2025-10-02T18:45:00.852281] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-02T18:45:01.013445] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-02T18:45:01.014498] [INFO ] [REMOTE ] EOS: Full fetch complete (23193 records). [2025-10-02T18:45:01.014576] [DEBUG] [VALIDATOR ] EOS: Validating primary data. [2025-10-02T18:45:01.015106] [FATAL] [VALIDATOR ] EOS: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:45:01.015194] [FATAL] [MAIN ] EOS: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:45:01.015239] [WARN ] [MAIN ] EOS: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:45:01.015321] [INFO ] [LOCAL ] EOS: Starting deletion of primary data. [2025-10-02T18:45:01.015387] [DEBUG] [LOCAL ] EOS: No primary data file found to delete. [2025-10-02T18:45:01.015422] [INFO ] [LOCAL ] EOS: Starting deletion of derivative data. [2025-10-02T18:45:01.015962] [DEBUG] [LOCAL ] EOS: Deleted derivative data file. [2025-10-02T18:45:01.016064] [INFO ] [MAIN ] Update Progress: 749/2370 symbols completed. EOS took 35.3s. Estimated remaining: 3h 47m 9s. Rate: 7.1 symbols/min [2025-10-02T18:45:01.081455] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2024-12. [2025-10-02T18:45:01.231688] [INFO ] [MAIN ] EPC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:45:01.277691] [DEBUG] [LOCAL ] EPC: Loaded 39811 existing records from primary storage. [2025-10-02T18:45:01.278004] [INFO ] [MAIN ] EPC: Loaded 39811 existing records. [2025-10-02T18:45:01.551621] [WARN ] [MAIN ] EPC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:45:01.551967] [INFO ] [MAIN ] EPC: Wiping existing primary data before full refresh. [2025-10-02T18:45:01.552090] [INFO ] [LOCAL ] EPC: Starting deletion of primary data. [2025-10-02T18:45:01.553692] [DEBUG] [LOCAL ] EPC: Deleted primary data file. [2025-10-02T18:45:01.553768] [INFO ] [MAIN ] EPC: Starting full primary refresh. [2025-10-02T18:45:01.882630] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-04. [2025-10-02T18:45:02.045770] [INFO ] [REMOTE ] EPC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:45:02.673002] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-09. [2025-10-02T18:45:02.911394] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-02T18:45:02.942789] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-02T18:45:03.473043] [INFO ] [REMOTE ] EPC: Fetching primary data for 2024-12. [2025-10-02T18:45:04.272983] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-01. [2025-10-02T18:45:04.611041] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-02T18:45:05.072975] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-10. [2025-10-02T18:45:05.216560] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-02T18:45:05.726324] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-02T18:45:05.873007] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-05. [2025-10-02T18:45:06.672861] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-02T18:45:06.672925] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-01. [2025-10-02T18:45:06.677176] [INFO ] [REMOTE ] EOG: Full fetch complete (77276 records). [2025-10-02T18:45:06.677356] [DEBUG] [VALIDATOR ] EOG: Validating primary data. [2025-10-02T18:45:07.153219] [DEBUG] [VALIDATOR ] EOG: All expected trading days are present. [2025-10-02T18:45:07.153334] [DEBUG] [VALIDATOR ] EOG: Primary data validation passed. [2025-10-02T18:45:07.154354] [INFO ] [MAIN ] EOG: Fetched primary data is valid. [2025-10-02T18:45:07.154425] [DEBUG] [LOCAL ] EOG: Saving primary data. [2025-10-02T18:45:07.156286] [DEBUG] [LOCAL ] EOG: Trimmed 77276 records to 53734 (keeping 200 days of data) [2025-10-02T18:45:07.408130] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-02T18:45:07.493539] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-02. [2025-10-02T18:45:07.558182] [DEBUG] [LOCAL ] EOG: Primary data saved (53734 records). [2025-10-02T18:45:07.558382] [INFO ] [MAIN ] EOG: Full history saved. [2025-10-02T18:45:07.558522] [INFO ] [MAIN ] Update Progress: 750/2370 symbols completed. EOG took 54.3s. Estimated remaining: 3h 46m 56s. Rate: 7.1 symbols/min [2025-10-02T18:45:07.785060] [INFO ] [MAIN ] EPD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:45:07.866786] [DEBUG] [LOCAL ] EPD: Loaded 53610 existing records from primary storage. [2025-10-02T18:45:07.867324] [INFO ] [MAIN ] EPD: Loaded 53610 existing records. [2025-10-02T18:45:08.208965] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-02T18:45:08.206411] [WARN ] [MAIN ] EPD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:45:08.217673] [INFO ] [MAIN ] EPD: Wiping existing primary data before full refresh. [2025-10-02T18:45:08.218680] [INFO ] [LOCAL ] EPD: Starting deletion of primary data. [2025-10-02T18:45:08.220758] [DEBUG] [LOCAL ] EPD: Deleted primary data file. [2025-10-02T18:45:08.220834] [INFO ] [MAIN ] EPD: Starting full primary refresh. [2025-10-02T18:45:08.278193] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-06. [2025-10-02T18:45:08.825507] [INFO ] [REMOTE ] EPD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:45:08.847636] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-02T18:45:09.073000] [INFO ] [REMOTE ] EPD: Fetching primary data for 2024-12. [2025-10-02T18:45:09.580748] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-02T18:45:09.873036] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-02. [2025-10-02T18:45:10.673005] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-03. [2025-10-02T18:45:11.212966] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-10-02T18:45:11.477438] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-01. [2025-10-02T18:45:11.480283] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-02T18:45:11.969711] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-02T18:45:12.273022] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-03. [2025-10-02T18:45:13.072971] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-04. [2025-10-02T18:45:13.418685] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-02T18:45:13.774885] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-02T18:45:13.872978] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-04. [2025-10-02T18:45:14.429671] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-02T18:45:14.673082] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-02. [2025-10-02T18:45:15.472991] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-07. [2025-10-02T18:45:15.568177] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-02T18:45:16.273020] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-05. [2025-10-02T18:45:16.553380] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-02T18:45:16.781959] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-02T18:45:17.073045] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-03. [2025-10-02T18:45:17.527144] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-02T18:45:17.873027] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-05. [2025-10-02T18:45:18.676084] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-08. [2025-10-02T18:45:18.682460] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-02T18:45:19.473000] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-04. [2025-10-02T18:45:19.696565] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-02T18:45:19.738004] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-02T18:45:20.272998] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-09. [2025-10-02T18:45:21.073041] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-06. [2025-10-02T18:45:21.609250] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-02T18:45:21.873042] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-06. [2025-10-02T18:45:21.916243] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-10-02T18:45:22.595783] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-02T18:45:22.673010] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-05. [2025-10-02T18:45:23.378787] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-02T18:45:23.473054] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-07. [2025-10-02T18:45:24.265507] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-02T18:45:24.276763] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-10. [2025-10-02T18:45:24.981608] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-02T18:45:25.073017] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-07. [2025-10-02T18:45:25.229568] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-02T18:45:25.231176] [INFO ] [REMOTE ] EPAC: Full fetch complete (39102 records). [2025-10-02T18:45:25.231254] [DEBUG] [VALIDATOR ] EPAC: Validating primary data. [2025-10-02T18:45:25.637292] [DEBUG] [VALIDATOR ] EPAC: All expected trading days are present. [2025-10-02T18:45:25.637376] [DEBUG] [VALIDATOR ] EPAC: Primary data validation passed. [2025-10-02T18:45:25.637989] [INFO ] [MAIN ] EPAC: Fetched primary data is valid. [2025-10-02T18:45:25.638083] [DEBUG] [LOCAL ] EPAC: Saving primary data. [2025-10-02T18:45:25.639114] [DEBUG] [LOCAL ] EPAC: Trimmed 39102 records to 27163 (keeping 200 days of data) [2025-10-02T18:45:25.803789] [DEBUG] [LOCAL ] EPAC: Primary data saved (27163 records). [2025-10-02T18:45:25.803931] [INFO ] [MAIN ] EPAC: Full history saved. [2025-10-02T18:45:25.804019] [INFO ] [MAIN ] Update Progress: 751/2370 symbols completed. EPAC took 34.9s. Estimated remaining: 3h 47m 9s. Rate: 7.1 symbols/min [2025-10-02T18:45:25.878186] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-06. [2025-10-02T18:45:26.000831] [INFO ] [MAIN ] EPR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:45:26.050136] [DEBUG] [LOCAL ] EPR: Loaded 43923 existing records from primary storage. [2025-10-02T18:45:26.050465] [INFO ] [MAIN ] EPR: Loaded 43923 existing records. [2025-10-02T18:45:26.261298] [WARN ] [MAIN ] EPR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:45:26.261547] [INFO ] [MAIN ] EPR: Wiping existing primary data before full refresh. [2025-10-02T18:45:26.261621] [INFO ] [LOCAL ] EPR: Starting deletion of primary data. [2025-10-02T18:45:26.263102] [DEBUG] [LOCAL ] EPR: Deleted primary data file. [2025-10-02T18:45:26.263204] [INFO ] [MAIN ] EPR: Starting full primary refresh. [2025-10-02T18:45:26.692314] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-08. [2025-10-02T18:45:26.696272] [INFO ] [REMOTE ] EPR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:45:26.751107] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-02T18:45:27.473038] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-08. [2025-10-02T18:45:27.761468] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-02T18:45:28.278140] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-07. [2025-10-02T18:45:28.295504] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-02T18:45:28.867172] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-02T18:45:29.073026] [INFO ] [REMOTE ] EPR: Fetching primary data for 2024-12. [2025-10-02T18:45:29.872983] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-09. [2025-10-02T18:45:30.212193] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-02T18:45:30.683706] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-09. [2025-10-02T18:45:30.692989] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-02T18:45:31.473034] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-08. [2025-10-02T18:45:31.528836] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-02T18:45:31.884743] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-02T18:45:32.273017] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-10. [2025-10-02T18:45:33.073036] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-10. [2025-10-02T18:45:33.422773] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-02T18:45:33.424279] [INFO ] [REMOTE ] EPC: Full fetch complete (56645 records). [2025-10-02T18:45:33.424407] [DEBUG] [VALIDATOR ] EPC: Validating primary data. [2025-10-02T18:45:33.425259] [FATAL] [VALIDATOR ] EPC: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:45:33.425355] [FATAL] [MAIN ] EPC: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:45:33.425401] [WARN ] [MAIN ] EPC: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:45:33.425444] [INFO ] [LOCAL ] EPC: Starting deletion of primary data. [2025-10-02T18:45:33.425503] [DEBUG] [LOCAL ] EPC: No primary data file found to delete. [2025-10-02T18:45:33.425540] [INFO ] [LOCAL ] EPC: Starting deletion of derivative data. [2025-10-02T18:45:33.425999] [DEBUG] [LOCAL ] EPC: Deleted derivative data file. [2025-10-02T18:45:33.426418] [INFO ] [MAIN ] Update Progress: 752/2370 symbols completed. EPC took 32.4s. Estimated remaining: 3h 46m 59s. Rate: 7.1 symbols/min [2025-10-02T18:45:33.620099] [INFO ] [MAIN ] EPRT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:45:33.653853] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-02T18:45:33.709074] [DEBUG] [LOCAL ] EPRT: Loaded 48479 existing records from primary storage. [2025-10-02T18:45:33.709432] [INFO ] [MAIN ] EPRT: Loaded 48479 existing records. [2025-10-02T18:45:33.879204] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-09. [2025-10-02T18:45:33.915686] [WARN ] [MAIN ] EPRT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:45:33.915906] [INFO ] [MAIN ] EPRT: Wiping existing primary data before full refresh. [2025-10-02T18:45:33.915956] [INFO ] [LOCAL ] EPRT: Starting deletion of primary data. [2025-10-02T18:45:33.917379] [DEBUG] [LOCAL ] EPRT: Deleted primary data file. [2025-10-02T18:45:33.917449] [INFO ] [MAIN ] EPRT: Starting full primary refresh. [2025-10-02T18:45:34.329280] [INFO ] [REMOTE ] EPRT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:45:34.377364] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-02T18:45:34.379268] [INFO ] [REMOTE ] EPAM: Full fetch complete (56132 records). [2025-10-02T18:45:34.379391] [DEBUG] [VALIDATOR ] EPAM: Validating primary data. [2025-10-02T18:45:34.682633] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2024-12. [2025-10-02T18:45:34.829462] [DEBUG] [VALIDATOR ] EPAM: All expected trading days are present. [2025-10-02T18:45:34.829555] [DEBUG] [VALIDATOR ] EPAM: Primary data validation passed. [2025-10-02T18:45:34.830401] [INFO ] [MAIN ] EPAM: Fetched primary data is valid. [2025-10-02T18:45:34.830473] [DEBUG] [LOCAL ] EPAM: Saving primary data. [2025-10-02T18:45:34.831860] [DEBUG] [LOCAL ] EPAM: Trimmed 56132 records to 40032 (keeping 200 days of data) [2025-10-02T18:45:35.093172] [DEBUG] [LOCAL ] EPAM: Primary data saved (40032 records). [2025-10-02T18:45:35.093340] [INFO ] [MAIN ] EPAM: Full history saved. [2025-10-02T18:45:35.093467] [INFO ] [MAIN ] Update Progress: 753/2370 symbols completed. EPAM took 36.7s. Estimated remaining: 3h 46m 36s. Rate: 7.1 symbols/min [2025-10-02T18:45:35.274775] [INFO ] [MAIN ] EQBK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:45:35.274983] [DEBUG] [LOCAL ] EQBK: No existing data file found in primary storage. [2025-10-02T18:45:35.275025] [WARN ] [MAIN ] EQBK: No existing data found, performing full refresh instead. [2025-10-02T18:45:35.275169] [INFO ] [MAIN ] EQBK: Wiping existing primary data before full refresh. [2025-10-02T18:45:35.275262] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-10-02T18:45:35.275334] [DEBUG] [LOCAL ] EQBK: No primary data file found to delete. [2025-10-02T18:45:35.275383] [INFO ] [MAIN ] EQBK: Starting full primary refresh. [2025-10-02T18:45:35.481504] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-01. [2025-10-02T18:45:35.691186] [INFO ] [REMOTE ] EQBK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:45:35.725676] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-02T18:45:36.074184] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-02T18:45:36.272998] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2024-12. [2025-10-02T18:45:37.073095] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-01. [2025-10-02T18:45:37.073013] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-02T18:45:37.122617] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-02T18:45:37.873007] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-02. [2025-10-02T18:45:38.349510] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-02T18:45:38.673000] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-01. [2025-10-02T18:45:39.450698] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-02T18:45:39.467298] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-02T18:45:39.472952] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-02. [2025-10-02T18:45:40.041491] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-02T18:45:40.272997] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-02. [2025-10-02T18:45:41.072990] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-03. [2025-10-02T18:45:41.781236] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-02T18:45:41.873006] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-03. [2025-10-02T18:45:42.645580] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-02T18:45:42.672984] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-04. [2025-10-02T18:45:43.472981] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-03. [2025-10-02T18:45:43.591726] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-02T18:45:43.940830] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-02T18:45:44.218509] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-02T18:45:44.272979] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-05. [2025-10-02T18:45:45.072995] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-04. [2025-10-02T18:45:45.848625] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-02T18:45:45.873014] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-10. [2025-10-02T18:45:46.607607] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-02T18:45:46.672970] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-05. [2025-10-02T18:45:47.472973] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-06. [2025-10-02T18:45:47.549929] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-02T18:45:47.552789] [INFO ] [REMOTE ] EPD: Full fetch complete (77641 records). [2025-10-02T18:45:47.552968] [DEBUG] [VALIDATOR ] EPD: Validating primary data. [2025-10-02T18:45:48.035487] [DEBUG] [VALIDATOR ] EPD: All expected trading days are present. [2025-10-02T18:45:48.035578] [DEBUG] [VALIDATOR ] EPD: Primary data validation passed. [2025-10-02T18:45:48.036494] [INFO ] [MAIN ] EPD: Fetched primary data is valid. [2025-10-02T18:45:48.036617] [DEBUG] [LOCAL ] EPD: Saving primary data. [2025-10-02T18:45:48.038279] [DEBUG] [LOCAL ] EPD: Trimmed 77641 records to 53999 (keeping 200 days of data) [2025-10-02T18:45:48.273025] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-04. [2025-10-02T18:45:48.380290] [DEBUG] [LOCAL ] EPD: Primary data saved (53999 records). [2025-10-02T18:45:48.380537] [INFO ] [MAIN ] EPD: Full history saved. [2025-10-02T18:45:48.380682] [INFO ] [MAIN ] Update Progress: 754/2370 symbols completed. EPD took 40.8s. Estimated remaining: 3h 46m 38s. Rate: 7.1 symbols/min [2025-10-02T18:45:48.529068] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-02T18:45:48.616022] [INFO ] [MAIN ] EQH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:45:48.667884] [DEBUG] [LOCAL ] EQH: Loaded 52653 existing records from primary storage. [2025-10-02T18:45:48.668255] [INFO ] [MAIN ] EQH: Loaded 52653 existing records. [2025-10-02T18:45:48.867104] [WARN ] [MAIN ] EQH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:45:48.867337] [INFO ] [MAIN ] EQH: Wiping existing primary data before full refresh. [2025-10-02T18:45:48.867387] [INFO ] [LOCAL ] EQH: Starting deletion of primary data. [2025-10-02T18:45:48.868976] [DEBUG] [LOCAL ] EQH: Deleted primary data file. [2025-10-02T18:45:48.869040] [INFO ] [MAIN ] EQH: Starting full primary refresh. [2025-10-02T18:45:49.081034] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-06. [2025-10-02T18:45:49.276218] [INFO ] [REMOTE ] EQH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:45:49.287338] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-02T18:45:49.318558] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-02T18:45:49.872994] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-07. [2025-10-02T18:45:50.672956] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-05. [2025-10-02T18:45:50.871943] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-02T18:45:51.392289] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-02T18:45:51.453618] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-02T18:45:51.472960] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-08. [2025-10-02T18:45:52.272993] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-07. [2025-10-02T18:45:53.072982] [INFO ] [REMOTE ] EQH: Fetching primary data for 2024-12. [2025-10-02T18:45:53.248588] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-02T18:45:53.606122] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-02T18:45:53.872993] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-08. [2025-10-02T18:45:54.672993] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-06. [2025-10-02T18:45:54.808336] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-02T18:45:55.430309] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-02T18:45:55.464997] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-02T18:45:55.472976] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-07. [2025-10-02T18:45:56.273002] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-09. [2025-10-02T18:45:56.472792] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-02T18:45:57.073019] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-08. [2025-10-02T18:45:57.878176] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-09. [2025-10-02T18:45:57.902619] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-02T18:45:57.923080] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-02T18:45:58.673011] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-09. [2025-10-02T18:45:58.786408] [DEBUG] [REMOTE ] EQBK: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-10-02T18:45:58.786804] [WARN ] [REMOTE ] EQBK: No data returned for month 2025-09 [2025-10-02T18:45:58.786924] [FATAL] [REMOTE ] EQBK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T18:45:58.787008] [FATAL] [MAIN ] EQBK: Failed to fetch primary data. [2025-10-02T18:45:58.787070] [WARN ] [MAIN ] EQBK: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T18:45:58.787144] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-10-02T18:45:58.787211] [DEBUG] [LOCAL ] EQBK: No primary data file found to delete. [2025-10-02T18:45:58.787259] [INFO ] [LOCAL ] EQBK: Starting deletion of derivative data. [2025-10-02T18:45:58.787308] [DEBUG] [LOCAL ] EQBK: No derivative data file found to delete. [2025-10-02T18:45:58.787356] [INFO ] [MAIN ] Update Progress: 755/2370 symbols completed. EQBK took 23.7s. Estimated remaining: 3h 46m 34s. Rate: 7.1 symbols/min [2025-10-02T18:45:58.973176] [INFO ] [MAIN ] EQNR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:45:59.026878] [DEBUG] [LOCAL ] EQNR: Loaded 53033 existing records from primary storage. [2025-10-02T18:45:59.027223] [INFO ] [MAIN ] EQNR: Loaded 53033 existing records. [2025-10-02T18:45:59.215597] [WARN ] [MAIN ] EQNR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:45:59.215825] [INFO ] [MAIN ] EQNR: Wiping existing primary data before full refresh. [2025-10-02T18:45:59.215873] [INFO ] [LOCAL ] EQNR: Starting deletion of primary data. [2025-10-02T18:45:59.217404] [DEBUG] [LOCAL ] EQNR: Deleted primary data file. [2025-10-02T18:45:59.217468] [INFO ] [MAIN ] EQNR: Starting full primary refresh. [2025-10-02T18:45:59.473717] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-01. [2025-10-02T18:45:59.612576] [INFO ] [REMOTE ] EQNR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:45:59.726320] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-02T18:46:00.273004] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-10. [2025-10-02T18:46:01.073080] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-10. [2025-10-02T18:46:01.260065] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-02T18:46:01.399761] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-02T18:46:01.402473] [INFO ] [REMOTE ] EPR: Full fetch complete (62982 records). [2025-10-02T18:46:01.402787] [DEBUG] [VALIDATOR ] EPR: Validating primary data. [2025-10-02T18:46:01.879220] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-02. [2025-10-02T18:46:01.930121] [DEBUG] [VALIDATOR ] EPR: All expected trading days are present. [2025-10-02T18:46:01.930214] [DEBUG] [VALIDATOR ] EPR: Primary data validation passed. [2025-10-02T18:46:01.931130] [INFO ] [MAIN ] EPR: Fetched primary data is valid. [2025-10-02T18:46:01.931195] [DEBUG] [LOCAL ] EPR: Saving primary data. [2025-10-02T18:46:01.932626] [DEBUG] [LOCAL ] EPR: Trimmed 62982 records to 44243 (keeping 200 days of data) [2025-10-02T18:46:02.219246] [DEBUG] [LOCAL ] EPR: Primary data saved (44243 records). [2025-10-02T18:46:02.219388] [INFO ] [MAIN ] EPR: Full history saved. [2025-10-02T18:46:02.219507] [INFO ] [MAIN ] Update Progress: 756/2370 symbols completed. EPR took 36.4s. Estimated remaining: 3h 46m 15s. Rate: 7.1 symbols/min [2025-10-02T18:46:02.422393] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-02T18:46:02.429398] [INFO ] [MAIN ] EQR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:46:02.432720] [INFO ] [REMOTE ] EPRT: Full fetch complete (68785 records). [2025-10-02T18:46:02.433042] [DEBUG] [VALIDATOR ] EPRT: Validating primary data. [2025-10-02T18:46:02.709851] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2024-12. [2025-10-02T18:46:02.873746] [DEBUG] [LOCAL ] EQR: Loaded 51509 existing records from primary storage. [2025-10-02T18:46:02.874392] [INFO ] [MAIN ] EQR: Loaded 51509 existing records. [2025-10-02T18:46:03.092587] [DEBUG] [VALIDATOR ] EPRT: All expected trading days are present. [2025-10-02T18:46:03.103034] [DEBUG] [VALIDATOR ] EPRT: Primary data validation passed. [2025-10-02T18:46:03.114395] [INFO ] [MAIN ] EPRT: Fetched primary data is valid. [2025-10-02T18:46:03.129997] [DEBUG] [LOCAL ] EPRT: Saving primary data. [2025-10-02T18:46:03.174699] [WARN ] [MAIN ] EQR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:46:03.175297] [INFO ] [MAIN ] EQR: Wiping existing primary data before full refresh. [2025-10-02T18:46:03.175415] [INFO ] [LOCAL ] EQR: Starting deletion of primary data. [2025-10-02T18:46:03.175554] [DEBUG] [LOCAL ] EPRT: Trimmed 68785 records to 48821 (keeping 200 days of data) [2025-10-02T18:46:03.176847] [DEBUG] [LOCAL ] EQR: Deleted primary data file. [2025-10-02T18:46:03.176927] [INFO ] [MAIN ] EQR: Starting full primary refresh. [2025-10-02T18:46:03.815696] [INFO ] [REMOTE ] EQR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:46:03.816889] [INFO ] [REMOTE ] EQR: Fetching primary data for 2024-12. [2025-10-02T18:46:03.867108] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-02T18:46:03.952283] [DEBUG] [LOCAL ] EPRT: Primary data saved (48821 records). [2025-10-02T18:46:03.952436] [INFO ] [MAIN ] EPRT: Full history saved. [2025-10-02T18:46:03.952997] [INFO ] [MAIN ] Update Progress: 757/2370 symbols completed. EPRT took 30.5s. Estimated remaining: 3h 45m 52s. Rate: 7.1 symbols/min [2025-10-02T18:46:04.273013] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-03. [2025-10-02T18:46:04.655942] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-02T18:46:05.073016] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-01. [2025-10-02T18:46:05.183935] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-02T18:46:05.873007] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-01. [2025-10-02T18:46:06.003590] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-02T18:46:06.672972] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-04. [2025-10-02T18:46:07.001815] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-02T18:46:07.102736] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-02T18:46:07.472994] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-02. [2025-10-02T18:46:08.273030] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-02. [2025-10-02T18:46:08.551621] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-02T18:46:09.073013] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-05. [2025-10-02T18:46:09.119553] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-02T18:46:09.872970] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-03. [2025-10-02T18:46:09.961313] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-02T18:46:10.475902] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-02T18:46:10.673029] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-03. [2025-10-02T18:46:11.473056] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-06. [2025-10-02T18:46:11.721803] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-02T18:46:12.273000] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-04. [2025-10-02T18:46:12.344110] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-02T18:46:13.079152] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-04. [2025-10-02T18:46:13.099780] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-02T18:46:13.872989] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-07. [2025-10-02T18:46:14.065318] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-02T18:46:14.673075] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-05. [2025-10-02T18:46:15.049044] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-02T18:46:15.473023] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-05. [2025-10-02T18:46:15.671333] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-02T18:46:15.976688] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-02T18:46:16.273003] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-06. [2025-10-02T18:46:17.073043] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-08. [2025-10-02T18:46:17.450694] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-02T18:46:17.608364] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-02T18:46:17.873000] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-06. [2025-10-02T18:46:18.672986] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-07. [2025-10-02T18:46:18.765682] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-02T18:46:19.473000] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-09. [2025-10-02T18:46:19.607689] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-02T18:46:20.272995] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-07. [2025-10-02T18:46:20.489522] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-02T18:46:20.879773] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-02T18:46:21.073071] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-08. [2025-10-02T18:46:21.872975] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-10. [2025-10-02T18:46:22.050689] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-02T18:46:22.673028] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-08. [2025-10-02T18:46:22.831665] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-02T18:46:23.133764] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-02T18:46:23.136093] [INFO ] [REMOTE ] EQH: Full fetch complete (76370 records). [2025-10-02T18:46:23.136212] [DEBUG] [VALIDATOR ] EQH: Validating primary data. [2025-10-02T18:46:23.477740] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-09. [2025-10-02T18:46:23.599669] [DEBUG] [VALIDATOR ] EQH: All expected trading days are present. [2025-10-02T18:46:23.599786] [DEBUG] [VALIDATOR ] EQH: Primary data validation passed. [2025-10-02T18:46:23.601250] [INFO ] [MAIN ] EQH: Fetched primary data is valid. [2025-10-02T18:46:23.601332] [DEBUG] [LOCAL ] EQH: Saving primary data. [2025-10-02T18:46:23.603473] [DEBUG] [LOCAL ] EQH: Trimmed 76370 records to 53042 (keeping 200 days of data) [2025-10-02T18:46:23.954348] [DEBUG] [LOCAL ] EQH: Primary data saved (53042 records). [2025-10-02T18:46:23.954520] [INFO ] [MAIN ] EQH: Full history saved. [2025-10-02T18:46:23.954697] [INFO ] [MAIN ] Update Progress: 758/2370 symbols completed. EQH took 35.6s. Estimated remaining: 3h 46m 8s. Rate: 7.1 symbols/min [2025-10-02T18:46:24.661238] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-02T18:46:24.673102] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-09. [2025-10-02T18:46:25.109306] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-02T18:46:25.121434] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-10. [2025-10-02T18:46:26.377775] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-02T18:46:26.389891] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-10. [2025-10-02T18:46:26.484873] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-02T18:46:26.487085] [INFO ] [REMOTE ] EQR: Full fetch complete (73993 records). [2025-10-02T18:46:26.487193] [DEBUG] [VALIDATOR ] EQR: Validating primary data. [2025-10-02T18:46:26.914352] [DEBUG] [VALIDATOR ] EQR: All expected trading days are present. [2025-10-02T18:46:26.914440] [DEBUG] [VALIDATOR ] EQR: Primary data validation passed. [2025-10-02T18:46:26.915318] [INFO ] [MAIN ] EQR: Fetched primary data is valid. [2025-10-02T18:46:26.915390] [DEBUG] [LOCAL ] EQR: Saving primary data. [2025-10-02T18:46:26.916864] [DEBUG] [LOCAL ] EQR: Trimmed 73993 records to 51894 (keeping 200 days of data) [2025-10-02T18:46:27.254339] [DEBUG] [LOCAL ] EQR: Primary data saved (51894 records). [2025-10-02T18:46:27.254538] [INFO ] [MAIN ] EQR: Full history saved. [2025-10-02T18:46:27.254701] [INFO ] [MAIN ] Update Progress: 759/2370 symbols completed. EQR took 25.0s. Estimated remaining: 3h 45m 49s. Rate: 7.1 symbols/min [2025-10-02T18:46:27.815048] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-02T18:46:27.817760] [INFO ] [REMOTE ] EQNR: Full fetch complete (76811 records). [2025-10-02T18:46:27.817915] [DEBUG] [VALIDATOR ] EQNR: Validating primary data. [2025-10-02T18:46:28.248007] [DEBUG] [VALIDATOR ] EQNR: All expected trading days are present. [2025-10-02T18:46:28.248227] [DEBUG] [VALIDATOR ] EQNR: Primary data validation passed. [2025-10-02T18:46:28.249163] [INFO ] [MAIN ] EQNR: Fetched primary data is valid. [2025-10-02T18:46:28.249229] [DEBUG] [LOCAL ] EQNR: Saving primary data. [2025-10-02T18:46:28.250989] [DEBUG] [LOCAL ] EQNR: Trimmed 76811 records to 53416 (keeping 200 days of data) [2025-10-02T18:46:28.593582] [DEBUG] [LOCAL ] EQNR: Primary data saved (53416 records). [2025-10-02T18:46:28.593772] [INFO ] [MAIN ] EQNR: Full history saved. [2025-10-02T18:46:28.593904] [INFO ] [MAIN ] Update Progress: 760/2370 symbols completed. EQNR took 29.8s. Estimated remaining: 3h 45m 26s. Rate: 7.1 symbols/min [2025-10-02T18:46:29.226484] [INFO ] [MAIN ] EQS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:46:29.344710] [INFO ] [MAIN ] ERJ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:46:29.345612] [INFO ] [MAIN ] EQV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:46:29.345801] [DEBUG] [LOCAL ] EQS: No existing data file found in primary storage. [2025-10-02T18:46:29.355632] [WARN ] [MAIN ] EQS: No existing data found, performing full refresh instead. [2025-10-02T18:46:29.373636] [INFO ] [MAIN ] EQS: Wiping existing primary data before full refresh. [2025-10-02T18:46:29.373801] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-02T18:46:29.374033] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-02T18:46:29.374097] [INFO ] [MAIN ] EQS: Starting full primary refresh. [2025-10-02T18:46:29.383397] [INFO ] [MAIN ] EQT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:46:29.459927] [DEBUG] [LOCAL ] EQV: Loaded 2736 existing records from primary storage. [2025-10-02T18:46:29.482960] [INFO ] [MAIN ] EQV: Loaded 2736 existing records. [2025-10-02T18:46:29.839480] [DEBUG] [LOCAL ] ERJ: Loaded 50627 existing records from primary storage. [2025-10-02T18:46:29.939302] [WARN ] [MAIN ] EQV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:46:29.934958] [INFO ] [MAIN ] ERJ: Loaded 50627 existing records. [2025-10-02T18:46:29.990797] [INFO ] [MAIN ] EQV: Wiping existing primary data before full refresh. [2025-10-02T18:46:30.023917] [INFO ] [LOCAL ] EQV: Starting deletion of primary data. [2025-10-02T18:46:30.030103] [DEBUG] [LOCAL ] EQT: Loaded 53682 existing records from primary storage. [2025-10-02T18:46:30.081782] [DEBUG] [LOCAL ] EQV: Deleted primary data file. [2025-10-02T18:46:30.091257] [INFO ] [MAIN ] EQT: Loaded 53682 existing records. [2025-10-02T18:46:30.141360] [INFO ] [MAIN ] EQV: Starting full primary refresh. [2025-10-02T18:46:30.369532] [INFO ] [REMOTE ] EQS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:46:30.395610] [INFO ] [REMOTE ] EQS: Fetching primary data for 2024-12. [2025-10-02T18:46:30.574089] [WARN ] [MAIN ] ERJ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:46:30.606441] [INFO ] [MAIN ] ERJ: Wiping existing primary data before full refresh. [2025-10-02T18:46:30.642304] [INFO ] [LOCAL ] ERJ: Starting deletion of primary data. [2025-10-02T18:46:30.691811] [DEBUG] [LOCAL ] ERJ: Deleted primary data file. [2025-10-02T18:46:30.692064] [INFO ] [MAIN ] ERJ: Starting full primary refresh. [2025-10-02T18:46:30.691735] [WARN ] [MAIN ] EQT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:46:30.725104] [INFO ] [MAIN ] EQT: Wiping existing primary data before full refresh. [2025-10-02T18:46:30.800025] [INFO ] [LOCAL ] EQT: Starting deletion of primary data. [2025-10-02T18:46:30.891534] [DEBUG] [LOCAL ] EQT: Deleted primary data file. [2025-10-02T18:46:30.952591] [INFO ] [MAIN ] EQT: Starting full primary refresh. [2025-10-02T18:46:31.293022] [INFO ] [REMOTE ] EQV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:46:31.330011] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-02T18:46:31.309590] [INFO ] [REMOTE ] EQV: Fetching primary data for 2024-12. [2025-10-02T18:46:31.367848] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-01. [2025-10-02T18:46:31.722543] [INFO ] [REMOTE ] ERJ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:46:31.736828] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2024-12. [2025-10-02T18:46:31.828264] [INFO ] [REMOTE ] EQT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:46:31.828634] [INFO ] [REMOTE ] EQT: Fetching primary data for 2024-12. [2025-10-02T18:46:31.885328] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-02T18:46:31.886492] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-02. [2025-10-02T18:46:32.205835] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-02T18:46:32.207952] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-01. [2025-10-02T18:46:32.214967] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-02T18:46:32.273008] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-03. [2025-10-02T18:46:32.535738] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-03 (0.26 seconds). [2025-10-02T18:46:32.970261] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-02T18:46:33.072960] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-02. [2025-10-02T18:46:33.272691] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-02T18:46:33.502682] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-02T18:46:33.569994] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-02T18:46:33.872995] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-01. [2025-10-02T18:46:34.673026] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-01. [2025-10-02T18:46:35.472989] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-03. [2025-10-02T18:46:35.820947] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-02T18:46:35.845212] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-02T18:46:35.949171] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-02T18:46:36.273006] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-04. [2025-10-02T18:46:36.775798] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-02T18:46:37.073003] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-02. [2025-10-02T18:46:37.873025] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-02. [2025-10-02T18:46:38.672989] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-04. [2025-10-02T18:46:39.015611] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-02T18:46:39.098414] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-02T18:46:39.214961] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-02T18:46:39.473015] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-03. [2025-10-02T18:46:40.273001] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-05. [2025-10-02T18:46:40.621700] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-02T18:46:41.030140] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-02T18:46:41.073011] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-05. [2025-10-02T18:46:41.631516] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-02T18:46:41.873011] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-06. [2025-10-02T18:46:42.384219] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-02T18:46:42.673011] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-03. [2025-10-02T18:46:43.473009] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-07. [2025-10-02T18:46:43.911290] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-02T18:46:44.273012] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-08. [2025-10-02T18:46:44.644894] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-02T18:46:44.952398] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-02T18:46:45.073032] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-04. [2025-10-02T18:46:45.872996] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-06. [2025-10-02T18:46:46.443928] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-02T18:46:46.672998] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-07. [2025-10-02T18:46:47.079984] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-02T18:46:47.198662] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-02T18:46:47.472976] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-04. [2025-10-02T18:46:48.273013] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-09. [2025-10-02T18:46:48.934543] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-02T18:46:49.072993] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-10. [2025-10-02T18:46:49.292493] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-02T18:46:49.547499] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-02T18:46:49.548343] [INFO ] [REMOTE ] EQS: Full fetch complete (2531 records). [2025-10-02T18:46:49.548461] [DEBUG] [VALIDATOR ] EQS: Validating primary data. [2025-10-02T18:46:49.755486] [WARN ] [VALIDATOR ] EQS: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-10-02T18:46:49.755806] [FATAL] [MAIN ] EQS: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:46:49.755905] [WARN ] [MAIN ] EQS: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:46:49.756015] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-02T18:46:49.756100] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-02T18:46:49.756149] [INFO ] [LOCAL ] EQS: Starting deletion of derivative data. [2025-10-02T18:46:49.756231] [DEBUG] [LOCAL ] EQS: No derivative data file found to delete. [2025-10-02T18:46:49.756344] [INFO ] [MAIN ] Update Progress: 761/2370 symbols completed. EQS took 21.2s. Estimated remaining: 3h 45m 44s. Rate: 7.1 symbols/min [2025-10-02T18:46:49.878099] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-08. [2025-10-02T18:46:49.949053] [INFO ] [MAIN ] ERO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:46:50.004779] [DEBUG] [LOCAL ] ERO: Loaded 41247 existing records from primary storage. [2025-10-02T18:46:50.005098] [INFO ] [MAIN ] ERO: Loaded 41247 existing records. [2025-10-02T18:46:50.201994] [WARN ] [MAIN ] ERO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:46:50.202239] [INFO ] [MAIN ] ERO: Wiping existing primary data before full refresh. [2025-10-02T18:46:50.202289] [INFO ] [LOCAL ] ERO: Starting deletion of primary data. [2025-10-02T18:46:50.203305] [DEBUG] [LOCAL ] ERO: Deleted primary data file. [2025-10-02T18:46:50.203368] [INFO ] [MAIN ] ERO: Starting full primary refresh. [2025-10-02T18:46:50.527324] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-02T18:46:50.618117] [INFO ] [REMOTE ] ERO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:46:50.672994] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-09. [2025-10-02T18:46:50.995484] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-02T18:46:51.472989] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-05. [2025-10-02T18:46:52.273057] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-05. [2025-10-02T18:46:53.073075] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-10. [2025-10-02T18:46:53.443978] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-02T18:46:53.526970] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-02T18:46:53.527880] [INFO ] [REMOTE ] EQV: Full fetch complete (5783 records). [2025-10-02T18:46:53.527968] [DEBUG] [VALIDATOR ] EQV: Validating primary data. [2025-10-02T18:46:53.876799] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-06. [2025-10-02T18:46:54.107293] [DEBUG] [VALIDATOR ] EQV: All expected trading days are present. [2025-10-02T18:46:54.107550] [DEBUG] [VALIDATOR ] EQV: Primary data validation passed. [2025-10-02T18:46:54.107956] [INFO ] [MAIN ] EQV: Fetched primary data is valid. [2025-10-02T18:46:54.108200] [DEBUG] [LOCAL ] EQV: Saving primary data. [2025-10-02T18:46:54.109035] [DEBUG] [LOCAL ] EQV: Trimmed 5783 records to 2747 (keeping 200 days of data) [2025-10-02T18:46:54.174019] [DEBUG] [LOCAL ] EQV: Primary data saved (2747 records). [2025-10-02T18:46:54.173147] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-02T18:46:54.185370] [INFO ] [MAIN ] EQV: Full history saved. [2025-10-02T18:46:54.185774] [INFO ] [MAIN ] Update Progress: 762/2370 symbols completed. EQV took 25.6s. Estimated remaining: 3h 45m 27s. Rate: 7.1 symbols/min [2025-10-02T18:46:54.395776] [INFO ] [MAIN ] ES: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:46:54.465596] [DEBUG] [LOCAL ] ES: Loaded 52572 existing records from primary storage. [2025-10-02T18:46:54.465995] [INFO ] [MAIN ] ES: Loaded 52572 existing records. [2025-10-02T18:46:54.654740] [WARN ] [MAIN ] ES: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:46:54.654997] [INFO ] [MAIN ] ES: Wiping existing primary data before full refresh. [2025-10-02T18:46:54.655053] [INFO ] [LOCAL ] ES: Starting deletion of primary data. [2025-10-02T18:46:54.656637] [DEBUG] [LOCAL ] ES: Deleted primary data file. [2025-10-02T18:46:54.656739] [INFO ] [MAIN ] ES: Starting full primary refresh. [2025-10-02T18:46:54.679799] [INFO ] [REMOTE ] ERO: Fetching primary data for 2024-12. [2025-10-02T18:46:55.056745] [INFO ] [REMOTE ] ES: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:46:55.472986] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-06. [2025-10-02T18:46:55.909677] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-02T18:46:56.186605] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-02T18:46:56.273040] [INFO ] [REMOTE ] ES: Fetching primary data for 2024-12. [2025-10-02T18:46:56.825873] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-02T18:46:57.073058] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-01. [2025-10-02T18:46:57.872977] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-07. [2025-10-02T18:46:58.074129] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-02T18:46:58.538359] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-02T18:46:58.673018] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-07. [2025-10-02T18:46:59.472999] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-02. [2025-10-02T18:46:59.826603] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-02T18:47:00.272974] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-01. [2025-10-02T18:47:00.681465] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-02T18:47:00.900032] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-02T18:47:01.073044] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-08. [2025-10-02T18:47:01.873001] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-03. [2025-10-02T18:47:02.672994] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-08. [2025-10-02T18:47:02.764916] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-01 (2.49 seconds). [2025-10-02T18:47:02.981303] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-02T18:47:03.275038] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-02T18:47:03.473060] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-04. [2025-10-02T18:47:04.247072] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-02T18:47:04.272969] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-09. [2025-10-02T18:47:04.592409] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-02T18:47:05.073054] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-09. [2025-10-02T18:47:05.872978] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-02. [2025-10-02T18:47:06.012664] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-02T18:47:06.570781] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-02T18:47:06.673000] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-10. [2025-10-02T18:47:07.472968] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-05. [2025-10-02T18:47:08.017339] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-02T18:47:08.019721] [INFO ] [REMOTE ] ERJ: Full fetch complete (72387 records). [2025-10-02T18:47:08.019855] [DEBUG] [VALIDATOR ] ERJ: Validating primary data. [2025-10-02T18:47:08.277791] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-02 (2.40 seconds). [2025-10-02T18:47:08.276112] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-10. [2025-10-02T18:47:08.533996] [DEBUG] [VALIDATOR ] ERJ: All expected trading days are present. [2025-10-02T18:47:08.534175] [DEBUG] [VALIDATOR ] ERJ: Primary data validation passed. [2025-10-02T18:47:08.535464] [INFO ] [MAIN ] ERJ: Fetched primary data is valid. [2025-10-02T18:47:08.535554] [DEBUG] [LOCAL ] ERJ: Saving primary data. [2025-10-02T18:47:08.537690] [DEBUG] [LOCAL ] ERJ: Trimmed 72387 records to 51007 (keeping 200 days of data) [2025-10-02T18:47:08.864038] [DEBUG] [LOCAL ] ERJ: Primary data saved (51007 records). [2025-10-02T18:47:08.864330] [INFO ] [MAIN ] ERJ: Full history saved. [2025-10-02T18:47:08.864562] [INFO ] [MAIN ] Update Progress: 763/2370 symbols completed. ERJ took 40.2s. Estimated remaining: 3h 45m 32s. Rate: 7.1 symbols/min [2025-10-02T18:47:09.059114] [INFO ] [MAIN ] ESAB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:47:09.074252] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-03. [2025-10-02T18:47:09.089117] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-02T18:47:09.122389] [DEBUG] [LOCAL ] ESAB: Loaded 26110 existing records from primary storage. [2025-10-02T18:47:09.122707] [INFO ] [MAIN ] ESAB: Loaded 26110 existing records. [2025-10-02T18:47:09.318104] [WARN ] [MAIN ] ESAB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:47:09.318341] [INFO ] [MAIN ] ESAB: Wiping existing primary data before full refresh. [2025-10-02T18:47:09.318392] [INFO ] [LOCAL ] ESAB: Starting deletion of primary data. [2025-10-02T18:47:09.319228] [DEBUG] [LOCAL ] ESAB: Deleted primary data file. [2025-10-02T18:47:09.319289] [INFO ] [MAIN ] ESAB: Starting full primary refresh. [2025-10-02T18:47:09.706913] [INFO ] [REMOTE ] ESAB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:47:09.873010] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-06. [2025-10-02T18:47:10.022406] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-02T18:47:10.025516] [INFO ] [REMOTE ] EQT: Full fetch complete (77692 records). [2025-10-02T18:47:10.025728] [DEBUG] [VALIDATOR ] EQT: Validating primary data. [2025-10-02T18:47:10.470252] [DEBUG] [VALIDATOR ] EQT: All expected trading days are present. [2025-10-02T18:47:10.470442] [DEBUG] [VALIDATOR ] EQT: Primary data validation passed. [2025-10-02T18:47:10.471804] [INFO ] [MAIN ] EQT: Fetched primary data is valid. [2025-10-02T18:47:10.471899] [DEBUG] [LOCAL ] EQT: Saving primary data. [2025-10-02T18:47:10.474508] [DEBUG] [LOCAL ] EQT: Trimmed 77692 records to 54072 (keeping 200 days of data) [2025-10-02T18:47:10.668757] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-02T18:47:10.683809] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2024-12. [2025-10-02T18:47:10.923586] [DEBUG] [LOCAL ] EQT: Primary data saved (54072 records). [2025-10-02T18:47:10.923787] [INFO ] [MAIN ] EQT: Full history saved. [2025-10-02T18:47:10.923876] [INFO ] [MAIN ] Update Progress: 764/2370 symbols completed. EQT took 42.3s. Estimated remaining: 3h 45m 10s. Rate: 7.1 symbols/min [2025-10-02T18:47:11.112700] [INFO ] [MAIN ] ESE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:47:11.137815] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-02T18:47:11.161311] [DEBUG] [LOCAL ] ESE: Loaded 16706 existing records from primary storage. [2025-10-02T18:47:11.161582] [INFO ] [MAIN ] ESE: Loaded 16706 existing records. [2025-10-02T18:47:11.361277] [WARN ] [MAIN ] ESE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:47:11.361527] [INFO ] [MAIN ] ESE: Wiping existing primary data before full refresh. [2025-10-02T18:47:11.361586] [INFO ] [LOCAL ] ESE: Starting deletion of primary data. [2025-10-02T18:47:11.362255] [DEBUG] [LOCAL ] ESE: Deleted primary data file. [2025-10-02T18:47:11.362317] [INFO ] [MAIN ] ESE: Starting full primary refresh. [2025-10-02T18:47:11.480946] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-07. [2025-10-02T18:47:11.785372] [INFO ] [REMOTE ] ESE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:47:11.800542] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-02T18:47:12.272946] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-04. [2025-10-02T18:47:13.011612] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-02T18:47:13.073062] [INFO ] [REMOTE ] ESE: Fetching primary data for 2024-12. [2025-10-02T18:47:13.872996] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-08. [2025-10-02T18:47:13.896304] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-02T18:47:14.113831] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-02T18:47:14.673052] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-01. [2025-10-02T18:47:15.309072] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-02T18:47:15.473044] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-01. [2025-10-02T18:47:15.607766] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-02T18:47:16.272996] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-05. [2025-10-02T18:47:16.497251] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-02T18:47:17.073008] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-02. [2025-10-02T18:47:17.775238] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-02T18:47:17.873054] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-02. [2025-10-02T18:47:18.041227] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-02T18:47:18.673003] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-09. [2025-10-02T18:47:19.024881] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-02T18:47:19.472994] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-06. [2025-10-02T18:47:20.278560] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-03. [2025-10-02T18:47:20.297721] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-02T18:47:21.073019] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-10. [2025-10-02T18:47:21.183016] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-02T18:47:21.522269] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-02T18:47:21.873044] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-03. [2025-10-02T18:47:22.561310] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-02T18:47:22.563173] [INFO ] [REMOTE ] ERO: Full fetch complete (59573 records). [2025-10-02T18:47:22.563268] [DEBUG] [VALIDATOR ] ERO: Validating primary data. [2025-10-02T18:47:22.676674] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-04. [2025-10-02T18:47:23.010499] [DEBUG] [VALIDATOR ] ERO: All expected trading days are present. [2025-10-02T18:47:23.011836] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-02T18:47:23.011182] [DEBUG] [VALIDATOR ] ERO: Primary data validation passed. [2025-10-02T18:47:23.012829] [INFO ] [MAIN ] ERO: Fetched primary data is valid. [2025-10-02T18:47:23.017606] [DEBUG] [LOCAL ] ERO: Saving primary data. [2025-10-02T18:47:23.019000] [DEBUG] [LOCAL ] ERO: Trimmed 59573 records to 41598 (keeping 200 days of data) [2025-10-02T18:47:23.287669] [DEBUG] [LOCAL ] ERO: Primary data saved (41598 records). [2025-10-02T18:47:23.287848] [INFO ] [MAIN ] ERO: Full history saved. [2025-10-02T18:47:23.288683] [INFO ] [MAIN ] Update Progress: 765/2370 symbols completed. ERO took 33.5s. Estimated remaining: 3h 45m 10s. Rate: 7.1 symbols/min [2025-10-02T18:47:23.479579] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-07. [2025-10-02T18:47:23.484315] [INFO ] [MAIN ] ESI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:47:23.543819] [DEBUG] [LOCAL ] ESI: Loaded 50725 existing records from primary storage. [2025-10-02T18:47:23.544158] [INFO ] [MAIN ] ESI: Loaded 50725 existing records. [2025-10-02T18:47:23.750959] [WARN ] [MAIN ] ESI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:47:23.751252] [INFO ] [MAIN ] ESI: Wiping existing primary data before full refresh. [2025-10-02T18:47:23.751343] [INFO ] [LOCAL ] ESI: Starting deletion of primary data. [2025-10-02T18:47:23.770404] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-02T18:47:23.776128] [DEBUG] [LOCAL ] ESI: Deleted primary data file. [2025-10-02T18:47:23.776462] [INFO ] [MAIN ] ESI: Starting full primary refresh. [2025-10-02T18:47:24.168873] [INFO ] [REMOTE ] ESI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:47:24.273066] [INFO ] [REMOTE ] ESI: Fetching primary data for 2024-12. [2025-10-02T18:47:25.033921] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-02T18:47:25.072986] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-08. [2025-10-02T18:47:25.877612] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-05. [2025-10-02T18:47:25.889796] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-02T18:47:26.445877] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-02T18:47:26.672998] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-09. [2025-10-02T18:47:27.101188] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-02T18:47:27.473007] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-04. [2025-10-02T18:47:28.272984] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-06. [2025-10-02T18:47:28.436448] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-02T18:47:28.467146] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-02T18:47:29.072997] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-10. [2025-10-02T18:47:29.345332] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-02T18:47:29.873012] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-05. [2025-10-02T18:47:30.577811] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-02T18:47:30.582482] [INFO ] [REMOTE ] ES: Full fetch complete (76198 records). [2025-10-02T18:47:30.582711] [DEBUG] [VALIDATOR ] ES: Validating primary data. [2025-10-02T18:47:30.678204] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-01. [2025-10-02T18:47:31.054824] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-02T18:47:31.055108] [DEBUG] [VALIDATOR ] ES: All expected trading days are present. [2025-10-02T18:47:31.059298] [DEBUG] [VALIDATOR ] ES: Primary data validation passed. [2025-10-02T18:47:31.060465] [INFO ] [MAIN ] ES: Fetched primary data is valid. [2025-10-02T18:47:31.060555] [DEBUG] [LOCAL ] ES: Saving primary data. [2025-10-02T18:47:31.062127] [DEBUG] [LOCAL ] ES: Trimmed 76198 records to 52959 (keeping 200 days of data) [2025-10-02T18:47:31.415764] [DEBUG] [LOCAL ] ES: Primary data saved (52959 records). [2025-10-02T18:47:31.415908] [INFO ] [MAIN ] ES: Full history saved. [2025-10-02T18:47:31.415990] [INFO ] [MAIN ] Update Progress: 766/2370 symbols completed. ES took 37.2s. Estimated remaining: 3h 45m 1s. Rate: 7.1 symbols/min [2025-10-02T18:47:31.485437] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-06. [2025-10-02T18:47:31.609125] [INFO ] [MAIN ] ESNT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:47:31.646864] [DEBUG] [LOCAL ] ESNT: Loaded 38358 existing records from primary storage. [2025-10-02T18:47:31.647205] [INFO ] [MAIN ] ESNT: Loaded 38358 existing records. [2025-10-02T18:47:31.847563] [WARN ] [MAIN ] ESNT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:47:31.848129] [INFO ] [MAIN ] ESNT: Wiping existing primary data before full refresh. [2025-10-02T18:47:31.848188] [INFO ] [LOCAL ] ESNT: Starting deletion of primary data. [2025-10-02T18:47:31.849526] [DEBUG] [LOCAL ] ESNT: Deleted primary data file. [2025-10-02T18:47:31.849589] [INFO ] [MAIN ] ESNT: Starting full primary refresh. [2025-10-02T18:47:32.244293] [INFO ] [REMOTE ] ESNT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:47:32.276530] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2024-12. [2025-10-02T18:47:32.284450] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-02T18:47:32.617031] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-02T18:47:33.072994] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-02. [2025-10-02T18:47:33.440386] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-02T18:47:33.873050] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-07. [2025-10-02T18:47:34.620891] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-02T18:47:34.672989] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-07. [2025-10-02T18:47:34.769419] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-02T18:47:35.473045] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-03. [2025-10-02T18:47:35.652875] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-02T18:47:36.273015] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-01. [2025-10-02T18:47:37.072992] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-08. [2025-10-02T18:47:37.189935] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-02T18:47:37.625357] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-02T18:47:37.873008] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-02. [2025-10-02T18:47:38.445353] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-02T18:47:38.673013] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-08. [2025-10-02T18:47:39.340924] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-02T18:47:39.473014] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-09. [2025-10-02T18:47:39.736138] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-02T18:47:40.273048] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-04. [2025-10-02T18:47:40.511771] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-02T18:47:41.072995] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-10. [2025-10-02T18:47:41.664151] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-02T18:47:41.872994] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-09. [2025-10-02T18:47:42.148760] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-02T18:47:42.150582] [INFO ] [REMOTE ] ESAB: Full fetch complete (35792 records). [2025-10-02T18:47:42.150777] [DEBUG] [VALIDATOR ] ESAB: Validating primary data. [2025-10-02T18:47:42.562158] [DEBUG] [VALIDATOR ] ESAB: All expected trading days are present. [2025-10-02T18:47:42.562267] [DEBUG] [VALIDATOR ] ESAB: Primary data validation passed. [2025-10-02T18:47:42.562975] [INFO ] [MAIN ] ESAB: Fetched primary data is valid. [2025-10-02T18:47:42.563039] [DEBUG] [LOCAL ] ESAB: Saving primary data. [2025-10-02T18:47:42.563955] [DEBUG] [LOCAL ] ESAB: Trimmed 35792 records to 26272 (keeping 200 days of data) [2025-10-02T18:47:42.673246] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-05. [2025-10-02T18:47:42.735059] [DEBUG] [LOCAL ] ESAB: Primary data saved (26272 records). [2025-10-02T18:47:42.735324] [INFO ] [MAIN ] ESAB: Full history saved. [2025-10-02T18:47:42.735479] [INFO ] [MAIN ] Update Progress: 767/2370 symbols completed. ESAB took 33.9s. Estimated remaining: 3h 44m 59s. Rate: 7.1 symbols/min [2025-10-02T18:47:42.929203] [INFO ] [MAIN ] ESRT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:47:42.943882] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-02T18:47:42.990882] [DEBUG] [LOCAL ] ESRT: Loaded 46454 existing records from primary storage. [2025-10-02T18:47:42.991200] [INFO ] [MAIN ] ESRT: Loaded 46454 existing records. [2025-10-02T18:47:43.185920] [WARN ] [MAIN ] ESRT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:47:43.186191] [INFO ] [MAIN ] ESRT: Wiping existing primary data before full refresh. [2025-10-02T18:47:43.186243] [INFO ] [LOCAL ] ESRT: Starting deletion of primary data. [2025-10-02T18:47:43.187566] [DEBUG] [LOCAL ] ESRT: Deleted primary data file. [2025-10-02T18:47:43.187632] [INFO ] [MAIN ] ESRT: Starting full primary refresh. [2025-10-02T18:47:43.481386] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-03. [2025-10-02T18:47:43.581001] [INFO ] [REMOTE ] ESRT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:47:44.272995] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2024-12. [2025-10-02T18:47:44.354687] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-02T18:47:45.021168] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-02T18:47:45.072965] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-04. [2025-10-02T18:47:45.872994] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-06. [2025-10-02T18:47:46.054138] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-02T18:47:46.678844] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-10. [2025-10-02T18:47:46.692872] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-02T18:47:47.464975] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-02T18:47:47.475177] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-05. [2025-10-02T18:47:47.537204] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-02T18:47:47.538532] [INFO ] [REMOTE ] ESE: Full fetch complete (22397 records). [2025-10-02T18:47:47.538632] [DEBUG] [VALIDATOR ] ESE: Validating primary data. [2025-10-02T18:47:47.958066] [DEBUG] [VALIDATOR ] ESE: All expected trading days are present. [2025-10-02T18:47:47.958157] [DEBUG] [VALIDATOR ] ESE: Primary data validation passed. [2025-10-02T18:47:47.958709] [INFO ] [MAIN ] ESE: Fetched primary data is valid. [2025-10-02T18:47:47.958774] [DEBUG] [LOCAL ] ESE: Saving primary data. [2025-10-02T18:47:47.959448] [DEBUG] [LOCAL ] ESE: Trimmed 22397 records to 16803 (keeping 200 days of data) [2025-10-02T18:47:48.067711] [DEBUG] [LOCAL ] ESE: Primary data saved (16803 records). [2025-10-02T18:47:48.067859] [INFO ] [MAIN ] ESE: Full history saved. [2025-10-02T18:47:48.067948] [INFO ] [MAIN ] Update Progress: 768/2370 symbols completed. ESE took 37.1s. Estimated remaining: 3h 44m 44s. Rate: 7.1 symbols/min [2025-10-02T18:47:48.247447] [INFO ] [MAIN ] ESS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:47:48.278144] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-07. [2025-10-02T18:47:48.280684] [DEBUG] [LOCAL ] ESS: Loaded 29988 existing records from primary storage. [2025-10-02T18:47:48.280972] [INFO ] [MAIN ] ESS: Loaded 29988 existing records. [2025-10-02T18:47:48.482841] [WARN ] [MAIN ] ESS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:47:48.483055] [INFO ] [MAIN ] ESS: Wiping existing primary data before full refresh. [2025-10-02T18:47:48.483149] [INFO ] [LOCAL ] ESS: Starting deletion of primary data. [2025-10-02T18:47:48.484210] [DEBUG] [LOCAL ] ESS: Deleted primary data file. [2025-10-02T18:47:48.484274] [INFO ] [MAIN ] ESS: Starting full primary refresh. [2025-10-02T18:47:48.895846] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-02T18:47:48.902523] [INFO ] [REMOTE ] ESS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:47:49.073005] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-06. [2025-10-02T18:47:49.872991] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-01. [2025-10-02T18:47:50.077294] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-02T18:47:50.418312] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-02T18:47:50.673000] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-07. [2025-10-02T18:47:51.083124] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-02T18:47:51.472994] [INFO ] [REMOTE ] ESS: Fetching primary data for 2024-12. [2025-10-02T18:47:52.273861] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-02T18:47:52.273965] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-02. [2025-10-02T18:47:52.464125] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-02T18:47:53.073012] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-08. [2025-10-02T18:47:53.793810] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-02T18:47:53.873002] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-01. [2025-10-02T18:47:54.673006] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-03. [2025-10-02T18:47:54.767033] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-02T18:47:54.941703] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-02T18:47:55.473017] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-02. [2025-10-02T18:47:56.267419] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-02T18:47:56.276303] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-09. [2025-10-02T18:47:56.799156] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-02T18:47:57.073047] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-04. [2025-10-02T18:47:57.610860] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-02T18:47:57.873004] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-03. [2025-10-02T18:47:58.673020] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-10. [2025-10-02T18:47:58.752449] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-02T18:47:58.955623] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-02T18:47:59.473041] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-04. [2025-10-02T18:47:59.949602] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-02T18:47:59.951401] [INFO ] [REMOTE ] ESNT: Full fetch complete (57120 records). [2025-10-02T18:47:59.951554] [DEBUG] [VALIDATOR ] ESNT: Validating primary data. [2025-10-02T18:48:00.278122] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-08. [2025-10-02T18:48:00.386621] [DEBUG] [VALIDATOR ] ESNT: All expected trading days are present. [2025-10-02T18:48:00.386742] [DEBUG] [VALIDATOR ] ESNT: Primary data validation passed. [2025-10-02T18:48:00.387542] [INFO ] [MAIN ] ESNT: Fetched primary data is valid. [2025-10-02T18:48:00.387591] [DEBUG] [LOCAL ] ESNT: Saving primary data. [2025-10-02T18:48:00.388923] [DEBUG] [LOCAL ] ESNT: Trimmed 57120 records to 38632 (keeping 200 days of data) [2025-10-02T18:48:00.631384] [DEBUG] [LOCAL ] ESNT: Primary data saved (38632 records). [2025-10-02T18:48:00.631538] [INFO ] [MAIN ] ESNT: Full history saved. [2025-10-02T18:48:00.631626] [INFO ] [MAIN ] Update Progress: 769/2370 symbols completed. ESNT took 29.2s. Estimated remaining: 3h 44m 44s. Rate: 7.1 symbols/min [2025-10-02T18:48:00.818069] [INFO ] [MAIN ] ESTC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:48:00.865577] [DEBUG] [LOCAL ] ESTC: Loaded 49968 existing records from primary storage. [2025-10-02T18:48:00.865941] [INFO ] [MAIN ] ESTC: Loaded 49968 existing records. [2025-10-02T18:48:01.079628] [WARN ] [MAIN ] ESTC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:48:01.080318] [INFO ] [MAIN ] ESTC: Wiping existing primary data before full refresh. [2025-10-02T18:48:01.080005] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-05. [2025-10-02T18:48:01.080787] [INFO ] [LOCAL ] ESTC: Starting deletion of primary data. [2025-10-02T18:48:01.082259] [DEBUG] [LOCAL ] ESTC: Deleted primary data file. [2025-10-02T18:48:01.082383] [INFO ] [MAIN ] ESTC: Starting full primary refresh. [2025-10-02T18:48:01.406890] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-02T18:48:01.531463] [INFO ] [REMOTE ] ESTC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:48:01.872999] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-05. [2025-10-02T18:48:02.048239] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-02T18:48:02.669755] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-02T18:48:02.680922] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-09. [2025-10-02T18:48:03.171429] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-02T18:48:03.473069] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-06. [2025-10-02T18:48:04.254188] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-02T18:48:04.272974] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-10. [2025-10-02T18:48:04.658684] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-02T18:48:05.073028] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-06. [2025-10-02T18:48:05.668007] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-02T18:48:05.670091] [INFO ] [REMOTE ] ESI: Full fetch complete (72659 records). [2025-10-02T18:48:05.670220] [DEBUG] [VALIDATOR ] ESI: Validating primary data. [2025-10-02T18:48:05.876856] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2024-12. [2025-10-02T18:48:06.141320] [DEBUG] [VALIDATOR ] ESI: All expected trading days are present. [2025-10-02T18:48:06.141423] [DEBUG] [VALIDATOR ] ESI: Primary data validation passed. [2025-10-02T18:48:06.142406] [INFO ] [MAIN ] ESI: Fetched primary data is valid. [2025-10-02T18:48:06.142473] [DEBUG] [LOCAL ] ESI: Saving primary data. [2025-10-02T18:48:06.144138] [DEBUG] [LOCAL ] ESI: Trimmed 72659 records to 51102 (keeping 200 days of data) [2025-10-02T18:48:06.410034] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-02T18:48:06.520350] [DEBUG] [LOCAL ] ESI: Primary data saved (51102 records). [2025-10-02T18:48:06.520535] [INFO ] [MAIN ] ESI: Full history saved. [2025-10-02T18:48:06.521519] [INFO ] [MAIN ] Update Progress: 770/2370 symbols completed. ESI took 43.2s. Estimated remaining: 3h 44m 31s. Rate: 7.1 symbols/min [2025-10-02T18:48:06.685172] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-07. [2025-10-02T18:48:06.725541] [INFO ] [MAIN ] ET: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:48:06.783233] [DEBUG] [LOCAL ] ET: Loaded 53789 existing records from primary storage. [2025-10-02T18:48:06.783623] [INFO ] [MAIN ] ET: Loaded 53789 existing records. [2025-10-02T18:48:07.005480] [WARN ] [MAIN ] ET: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:48:07.005717] [INFO ] [MAIN ] ET: Wiping existing primary data before full refresh. [2025-10-02T18:48:07.005779] [INFO ] [LOCAL ] ET: Starting deletion of primary data. [2025-10-02T18:48:07.007257] [DEBUG] [LOCAL ] ET: Deleted primary data file. [2025-10-02T18:48:07.007325] [INFO ] [MAIN ] ET: Starting full primary refresh. [2025-10-02T18:48:07.479623] [INFO ] [REMOTE ] ET: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:48:07.475600] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-07. [2025-10-02T18:48:07.749401] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-02T18:48:08.273052] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-01. [2025-10-02T18:48:08.511287] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-02T18:48:08.863483] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-02T18:48:09.072976] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-08. [2025-10-02T18:48:09.635590] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-02T18:48:09.873001] [INFO ] [REMOTE ] ET: Fetching primary data for 2024-12. [2025-10-02T18:48:10.581551] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-02T18:48:10.673052] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-08. [2025-10-02T18:48:11.473046] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-09. [2025-10-02T18:48:12.211578] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-02T18:48:12.224047] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2024-12 (2.35 seconds). [2025-10-02T18:48:12.273001] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-01. [2025-10-02T18:48:13.073018] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-09. [2025-10-02T18:48:13.106449] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-02T18:48:13.872997] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-10. [2025-10-02T18:48:14.318794] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-02T18:48:14.476315] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-10-02T18:48:14.673008] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-10. [2025-10-02T18:48:14.946754] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-02T18:48:14.948878] [INFO ] [REMOTE ] ESRT: Full fetch complete (66558 records). [2025-10-02T18:48:14.948997] [DEBUG] [VALIDATOR ] ESRT: Validating primary data. [2025-10-02T18:48:15.370934] [DEBUG] [VALIDATOR ] ESRT: All expected trading days are present. [2025-10-02T18:48:15.371047] [DEBUG] [VALIDATOR ] ESRT: Primary data validation passed. [2025-10-02T18:48:15.371979] [INFO ] [MAIN ] ESRT: Fetched primary data is valid. [2025-10-02T18:48:15.372053] [DEBUG] [LOCAL ] ESRT: Saving primary data. [2025-10-02T18:48:15.373678] [DEBUG] [LOCAL ] ESRT: Trimmed 66558 records to 46767 (keeping 200 days of data) [2025-10-02T18:48:15.473685] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-02. [2025-10-02T18:48:15.660585] [DEBUG] [LOCAL ] ESRT: Primary data saved (46767 records). [2025-10-02T18:48:15.660776] [INFO ] [MAIN ] ESRT: Full history saved. [2025-10-02T18:48:15.660881] [INFO ] [MAIN ] Update Progress: 771/2370 symbols completed. ESRT took 32.9s. Estimated remaining: 3h 44m 24s. Rate: 7.1 symbols/min [2025-10-02T18:48:15.854936] [INFO ] [MAIN ] ETB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:48:15.859030] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-02T18:48:15.860922] [INFO ] [REMOTE ] ESS: Full fetch complete (43462 records). [2025-10-02T18:48:15.861012] [DEBUG] [VALIDATOR ] ESS: Validating primary data. [2025-10-02T18:48:15.994230] [DEBUG] [LOCAL ] ETB: Loaded 12077 existing records from primary storage. [2025-10-02T18:48:16.010806] [INFO ] [MAIN ] ETB: Loaded 12077 existing records. [2025-10-02T18:48:16.282415] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-02. [2025-10-02T18:48:16.472775] [WARN ] [MAIN ] ETB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:48:16.504170] [INFO ] [MAIN ] ETB: Wiping existing primary data before full refresh. [2025-10-02T18:48:16.511825] [INFO ] [LOCAL ] ETB: Starting deletion of primary data. [2025-10-02T18:48:16.538094] [DEBUG] [LOCAL ] ETB: Deleted primary data file. [2025-10-02T18:48:16.549834] [INFO ] [MAIN ] ETB: Starting full primary refresh. [2025-10-02T18:48:16.550017] [DEBUG] [VALIDATOR ] ESS: All expected trading days are present. [2025-10-02T18:48:16.550253] [DEBUG] [VALIDATOR ] ESS: Primary data validation passed. [2025-10-02T18:48:16.556294] [INFO ] [MAIN ] ESS: Fetched primary data is valid. [2025-10-02T18:48:16.561678] [DEBUG] [LOCAL ] ESS: Saving primary data. [2025-10-02T18:48:16.662186] [DEBUG] [LOCAL ] ESS: Trimmed 43462 records to 30187 (keeping 200 days of data) [2025-10-02T18:48:17.184329] [DEBUG] [LOCAL ] ESS: Primary data saved (30187 records). [2025-10-02T18:48:17.218547] [INFO ] [MAIN ] ESS: Full history saved. [2025-10-02T18:48:17.227500] [INFO ] [REMOTE ] ETB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:48:17.228342] [INFO ] [REMOTE ] ETB: Fetching primary data for 2024-12. [2025-10-02T18:48:17.228490] [INFO ] [MAIN ] Update Progress: 772/2370 symbols completed. ESS took 29.2s. Estimated remaining: 3h 44m 1s. Rate: 7.1 symbols/min [2025-10-02T18:48:17.451242] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-02T18:48:17.455409] [INFO ] [MAIN ] ETD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:48:17.494880] [DEBUG] [LOCAL ] ETD: Loaded 27426 existing records from primary storage. [2025-10-02T18:48:17.495220] [INFO ] [MAIN ] ETD: Loaded 27426 existing records. [2025-10-02T18:48:17.699382] [WARN ] [MAIN ] ETD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:48:17.699667] [INFO ] [MAIN ] ETD: Wiping existing primary data before full refresh. [2025-10-02T18:48:17.699735] [INFO ] [LOCAL ] ETD: Starting deletion of primary data. [2025-10-02T18:48:17.700556] [DEBUG] [LOCAL ] ETD: Deleted primary data file. [2025-10-02T18:48:17.700618] [INFO ] [MAIN ] ETD: Starting full primary refresh. [2025-10-02T18:48:17.883316] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-03. [2025-10-02T18:48:17.955575] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-02T18:48:18.147589] [INFO ] [REMOTE ] ETD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:48:18.179988] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-02T18:48:18.673030] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-01. [2025-10-02T18:48:19.183196] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-02T18:48:19.472969] [INFO ] [REMOTE ] ETD: Fetching primary data for 2024-12. [2025-10-02T18:48:19.570602] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-02T18:48:20.272981] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-02. [2025-10-02T18:48:20.590092] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-02T18:48:20.861836] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-02T18:48:21.073042] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-03. [2025-10-02T18:48:21.873023] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-03. [2025-10-02T18:48:22.636530] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-02T18:48:22.672996] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-04. [2025-10-02T18:48:22.971475] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-02T18:48:23.473011] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-04. [2025-10-02T18:48:23.627807] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-02T18:48:24.273002] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-01. [2025-10-02T18:48:25.072963] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-05. [2025-10-02T18:48:25.266326] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-02T18:48:25.424567] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-02T18:48:25.872986] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-05. [2025-10-02T18:48:25.922685] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-02T18:48:26.673053] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-04. [2025-10-02T18:48:27.472997] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-06. [2025-10-02T18:48:27.580418] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-02T18:48:28.272974] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-06. [2025-10-02T18:48:28.343824] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-02T18:48:29.073015] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-02. [2025-10-02T18:48:29.107191] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-10-02T18:48:29.852505] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-02T18:48:29.872976] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-07. [2025-10-02T18:48:30.331024] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-02T18:48:30.673024] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-05. [2025-10-02T18:48:31.473014] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-07. [2025-10-02T18:48:32.068276] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-02T18:48:32.247097] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-02T18:48:32.272970] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-08. [2025-10-02T18:48:32.935688] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-02T18:48:32.955346] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-02T18:48:33.072995] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-03. [2025-10-02T18:48:33.872995] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-06. [2025-10-02T18:48:34.177260] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-02T18:48:34.673023] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-04. [2025-10-02T18:48:35.472994] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-08. [2025-10-02T18:48:36.056306] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-10-02T18:48:36.087701] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-02T18:48:36.273007] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-05. [2025-10-02T18:48:36.989267] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-02T18:48:37.073004] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-09. [2025-10-02T18:48:37.751453] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-02T18:48:37.873057] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-06. [2025-10-02T18:48:38.673002] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-09. [2025-10-02T18:48:38.697071] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-02T18:48:38.805814] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-02T18:48:39.211361] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-02T18:48:39.473000] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-07. [2025-10-02T18:48:40.273007] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-07. [2025-10-02T18:48:41.072972] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-10. [2025-10-02T18:48:41.416495] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-02T18:48:41.813558] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-02T18:48:41.873006] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-08. [2025-10-02T18:48:42.454362] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-02T18:48:42.456325] [INFO ] [REMOTE ] ESTC: Full fetch complete (72034 records). [2025-10-02T18:48:42.456429] [DEBUG] [VALIDATOR ] ESTC: Validating primary data. [2025-10-02T18:48:42.674472] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-10. [2025-10-02T18:48:42.885333] [DEBUG] [VALIDATOR ] ESTC: All expected trading days are present. [2025-10-02T18:48:42.885425] [DEBUG] [VALIDATOR ] ESTC: Primary data validation passed. [2025-10-02T18:48:42.886295] [INFO ] [MAIN ] ESTC: Fetched primary data is valid. [2025-10-02T18:48:42.886359] [DEBUG] [LOCAL ] ESTC: Saving primary data. [2025-10-02T18:48:42.887826] [DEBUG] [LOCAL ] ESTC: Trimmed 72034 records to 50315 (keeping 200 days of data) [2025-10-02T18:48:43.184438] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-02T18:48:43.228440] [DEBUG] [LOCAL ] ESTC: Primary data saved (50315 records). [2025-10-02T18:48:43.228579] [INFO ] [MAIN ] ESTC: Full history saved. [2025-10-02T18:48:43.228695] [INFO ] [MAIN ] Update Progress: 773/2370 symbols completed. ESTC took 42.6s. Estimated remaining: 3h 44m 29s. Rate: 7.1 symbols/min [2025-10-02T18:48:43.415084] [INFO ] [MAIN ] ETG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:48:43.433320] [DEBUG] [LOCAL ] ETG: Loaded 16472 existing records from primary storage. [2025-10-02T18:48:43.433568] [INFO ] [MAIN ] ETG: Loaded 16472 existing records. [2025-10-02T18:48:43.481519] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-08. [2025-10-02T18:48:43.529042] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-02T18:48:43.555293] [INFO ] [REMOTE ] ETB: Full fetch complete (18156 records). [2025-10-02T18:48:43.571809] [DEBUG] [VALIDATOR ] ETB: Validating primary data. [2025-10-02T18:48:43.738385] [WARN ] [MAIN ] ETG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:48:43.764433] [INFO ] [MAIN ] ETG: Wiping existing primary data before full refresh. [2025-10-02T18:48:43.764566] [INFO ] [LOCAL ] ETG: Starting deletion of primary data. [2025-10-02T18:48:43.770629] [DEBUG] [LOCAL ] ETG: Deleted primary data file. [2025-10-02T18:48:43.775875] [INFO ] [MAIN ] ETG: Starting full primary refresh. [2025-10-02T18:48:44.299779] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-09. [2025-10-02T18:48:44.402491] [DEBUG] [VALIDATOR ] ETB: All expected trading days are present. [2025-10-02T18:48:44.407366] [DEBUG] [VALIDATOR ] ETB: Primary data validation passed. [2025-10-02T18:48:44.408220] [INFO ] [MAIN ] ETB: Fetched primary data is valid. [2025-10-02T18:48:44.419102] [DEBUG] [LOCAL ] ETB: Saving primary data. [2025-10-02T18:48:44.456812] [DEBUG] [LOCAL ] ETB: Trimmed 18156 records to 12219 (keeping 200 days of data) [2025-10-02T18:48:44.497638] [INFO ] [REMOTE ] ETG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:48:44.579320] [DEBUG] [LOCAL ] ETB: Primary data saved (12219 records). [2025-10-02T18:48:44.579469] [INFO ] [MAIN ] ETB: Full history saved. [2025-10-02T18:48:44.579554] [INFO ] [MAIN ] Update Progress: 774/2370 symbols completed. ETB took 28.9s. Estimated remaining: 3h 44m 6s. Rate: 7.1 symbols/min [2025-10-02T18:48:44.767721] [INFO ] [MAIN ] ETJ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:48:44.785681] [DEBUG] [LOCAL ] ETJ: Loaded 16671 existing records from primary storage. [2025-10-02T18:48:44.785972] [INFO ] [MAIN ] ETJ: Loaded 16671 existing records. [2025-10-02T18:48:44.991153] [WARN ] [MAIN ] ETJ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:48:44.991431] [INFO ] [MAIN ] ETJ: Wiping existing primary data before full refresh. [2025-10-02T18:48:44.991493] [INFO ] [LOCAL ] ETJ: Starting deletion of primary data. [2025-10-02T18:48:44.992046] [DEBUG] [LOCAL ] ETJ: Deleted primary data file. [2025-10-02T18:48:44.992109] [INFO ] [MAIN ] ETJ: Starting full primary refresh. [2025-10-02T18:48:45.082717] [INFO ] [REMOTE ] ETG: Fetching primary data for 2024-12. [2025-10-02T18:48:45.386418] [INFO ] [REMOTE ] ETJ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:48:45.791382] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-02T18:48:45.840685] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-02T18:48:45.863639] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-02T18:48:45.872962] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-09. [2025-10-02T18:48:46.672992] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-01. [2025-10-02T18:48:47.473018] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-10. [2025-10-02T18:48:48.018292] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-02T18:48:48.194025] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-10-02T18:48:48.273007] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-02. [2025-10-02T18:48:48.539377] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-02T18:48:48.540886] [INFO ] [REMOTE ] ETD: Full fetch complete (38493 records). [2025-10-02T18:48:48.541005] [DEBUG] [VALIDATOR ] ETD: Validating primary data. [2025-10-02T18:48:48.944698] [DEBUG] [VALIDATOR ] ETD: All expected trading days are present. [2025-10-02T18:48:48.944788] [DEBUG] [VALIDATOR ] ETD: Primary data validation passed. [2025-10-02T18:48:48.945611] [INFO ] [MAIN ] ETD: Fetched primary data is valid. [2025-10-02T18:48:48.946101] [DEBUG] [LOCAL ] ETD: Saving primary data. [2025-10-02T18:48:48.947135] [DEBUG] [LOCAL ] ETD: Trimmed 38493 records to 27624 (keeping 200 days of data) [2025-10-02T18:48:49.091801] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2024-12. [2025-10-02T18:48:49.121578] [DEBUG] [LOCAL ] ETD: Primary data saved (27624 records). [2025-10-02T18:48:49.121713] [INFO ] [MAIN ] ETD: Full history saved. [2025-10-02T18:48:49.121806] [INFO ] [MAIN ] Update Progress: 775/2370 symbols completed. ETD took 31.9s. Estimated remaining: 3h 43m 50s. Rate: 7.1 symbols/min [2025-10-02T18:48:49.308616] [INFO ] [MAIN ] ETN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:48:49.330317] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-02T18:48:49.374453] [DEBUG] [LOCAL ] ETN: Loaded 52758 existing records from primary storage. [2025-10-02T18:48:49.374843] [INFO ] [MAIN ] ETN: Loaded 52758 existing records. [2025-10-02T18:48:49.569227] [WARN ] [MAIN ] ETN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:48:49.569464] [INFO ] [MAIN ] ETN: Wiping existing primary data before full refresh. [2025-10-02T18:48:49.569518] [INFO ] [LOCAL ] ETN: Starting deletion of primary data. [2025-10-02T18:48:49.571010] [DEBUG] [LOCAL ] ETN: Deleted primary data file. [2025-10-02T18:48:49.571074] [INFO ] [MAIN ] ETN: Starting full primary refresh. [2025-10-02T18:48:49.875197] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-10. [2025-10-02T18:48:49.891236] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-02T18:48:49.997207] [INFO ] [REMOTE ] ETN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:48:50.673002] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-01. [2025-10-02T18:48:51.472994] [INFO ] [REMOTE ] ETN: Fetching primary data for 2024-12. [2025-10-02T18:48:51.675372] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-02T18:48:51.742103] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-02T18:48:51.744401] [INFO ] [REMOTE ] ET: Full fetch complete (77955 records). [2025-10-02T18:48:51.744561] [DEBUG] [VALIDATOR ] ET: Validating primary data. [2025-10-02T18:48:52.177906] [DEBUG] [VALIDATOR ] ET: All expected trading days are present. [2025-10-02T18:48:52.177999] [DEBUG] [VALIDATOR ] ET: Primary data validation passed. [2025-10-02T18:48:52.179008] [INFO ] [MAIN ] ET: Fetched primary data is valid. [2025-10-02T18:48:52.179125] [DEBUG] [LOCAL ] ET: Saving primary data. [2025-10-02T18:48:52.180691] [DEBUG] [LOCAL ] ET: Trimmed 77955 records to 54179 (keeping 200 days of data) [2025-10-02T18:48:52.279560] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-02. [2025-10-02T18:48:52.543735] [DEBUG] [LOCAL ] ET: Primary data saved (54179 records). [2025-10-02T18:48:52.543924] [INFO ] [MAIN ] ET: Full history saved. [2025-10-02T18:48:52.545069] [INFO ] [MAIN ] Update Progress: 776/2370 symbols completed. ET took 46.0s. Estimated remaining: 3h 43m 31s. Rate: 7.1 symbols/min [2025-10-02T18:48:52.735034] [INFO ] [MAIN ] ETO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:48:52.745193] [DEBUG] [LOCAL ] ETO: Loaded 6515 existing records from primary storage. [2025-10-02T18:48:52.745426] [INFO ] [MAIN ] ETO: Loaded 6515 existing records. [2025-10-02T18:48:52.946103] [WARN ] [MAIN ] ETO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:48:52.946724] [INFO ] [MAIN ] ETO: Wiping existing primary data before full refresh. [2025-10-02T18:48:52.946789] [INFO ] [LOCAL ] ETO: Starting deletion of primary data. [2025-10-02T18:48:52.947174] [DEBUG] [LOCAL ] ETO: Deleted primary data file. [2025-10-02T18:48:52.947235] [INFO ] [MAIN ] ETO: Starting full primary refresh. [2025-10-02T18:48:53.061811] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-02T18:48:53.085158] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-03. [2025-10-02T18:48:53.399354] [INFO ] [REMOTE ] ETO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:48:53.429849] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-02T18:48:53.873027] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-03. [2025-10-02T18:48:54.139109] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-02T18:48:54.672996] [INFO ] [REMOTE ] ETO: Fetching primary data for 2024-12. [2025-10-02T18:48:54.883164] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-02T18:48:55.319459] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-02T18:48:55.473065] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-01. [2025-10-02T18:48:56.273000] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-01. [2025-10-02T18:48:57.050184] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-02T18:48:57.072953] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-04. [2025-10-02T18:48:57.247996] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-02T18:48:57.873019] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-02. [2025-10-02T18:48:58.154912] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-02T18:48:58.673005] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-05. [2025-10-02T18:48:59.473031] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-02. [2025-10-02T18:48:59.667012] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-02T18:48:59.843358] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-02T18:48:59.899908] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-02T18:49:00.273035] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-06. [2025-10-02T18:49:00.445207] [DEBUG] [REMOTE ] ETG: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-10-02T18:49:00.445539] [WARN ] [REMOTE ] ETG: No data returned for month 2025-06 [2025-10-02T18:49:00.445633] [FATAL] [REMOTE ] ETG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T18:49:00.445809] [FATAL] [MAIN ] ETG: Failed to fetch primary data. [2025-10-02T18:49:00.445881] [WARN ] [MAIN ] ETG: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T18:49:00.445960] [INFO ] [LOCAL ] ETG: Starting deletion of primary data. [2025-10-02T18:49:00.446034] [DEBUG] [LOCAL ] ETG: No primary data file found to delete. [2025-10-02T18:49:00.446077] [INFO ] [LOCAL ] ETG: Starting deletion of derivative data. [2025-10-02T18:49:00.446419] [DEBUG] [LOCAL ] ETG: Deleted derivative data file. [2025-10-02T18:49:00.446518] [INFO ] [MAIN ] Update Progress: 777/2370 symbols completed. ETG took 17.2s. Estimated remaining: 3h 43m 21s. Rate: 7.1 symbols/min [2025-10-02T18:49:00.623276] [INFO ] [MAIN ] ETR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:49:00.674447] [DEBUG] [LOCAL ] ETR: Loaded 53225 existing records from primary storage. [2025-10-02T18:49:00.674854] [INFO ] [MAIN ] ETR: Loaded 53225 existing records. [2025-10-02T18:49:00.870548] [WARN ] [MAIN ] ETR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:49:00.870801] [INFO ] [MAIN ] ETR: Wiping existing primary data before full refresh. [2025-10-02T18:49:00.870871] [INFO ] [LOCAL ] ETR: Starting deletion of primary data. [2025-10-02T18:49:00.872661] [DEBUG] [LOCAL ] ETR: Deleted primary data file. [2025-10-02T18:49:00.872726] [INFO ] [MAIN ] ETR: Starting full primary refresh. [2025-10-02T18:49:01.078537] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-03. [2025-10-02T18:49:01.262725] [INFO ] [REMOTE ] ETR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:49:01.873054] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-04. [2025-10-02T18:49:02.673007] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-03. [2025-10-02T18:49:03.195154] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-02T18:49:03.242708] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-02T18:49:03.395728] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-02T18:49:03.473050] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-05. [2025-10-02T18:49:04.275139] [INFO ] [REMOTE ] ETR: Fetching primary data for 2024-12. [2025-10-02T18:49:04.279746] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-02T18:49:05.073062] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-04. [2025-10-02T18:49:05.761443] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-02T18:49:05.807681] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-02T18:49:05.873005] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-01. [2025-10-02T18:49:06.673018] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-04. [2025-10-02T18:49:07.473037] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-05. [2025-10-02T18:49:07.613056] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-02T18:49:07.961698] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-02T18:49:08.272985] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-02. [2025-10-02T18:49:08.317828] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-02T18:49:09.073034] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-05. [2025-10-02T18:49:09.873009] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-06. [2025-10-02T18:49:10.144153] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-02T18:49:10.673015] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-03. [2025-10-02T18:49:10.772703] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-02T18:49:11.089257] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-02T18:49:11.473005] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-07. [2025-10-02T18:49:12.273007] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-06. [2025-10-02T18:49:12.573130] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-02T18:49:12.987558] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-02T18:49:13.073019] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-06. [2025-10-02T18:49:13.648255] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-03 (2.98 seconds). [2025-10-02T18:49:13.873001] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-08. [2025-10-02T18:49:14.672960] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-04. [2025-10-02T18:49:14.893772] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-02T18:49:14.953104] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-02T18:49:15.473075] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-07. [2025-10-02T18:49:16.272973] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-07. [2025-10-02T18:49:16.339506] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-02T18:49:16.454209] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-02T18:49:17.073005] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-08. [2025-10-02T18:49:17.732997] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-02T18:49:17.872954] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-05. [2025-10-02T18:49:17.985273] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-02T18:49:18.673022] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-08. [2025-10-02T18:49:19.472983] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-09. [2025-10-02T18:49:19.631960] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-02T18:49:20.272969] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-06. [2025-10-02T18:49:20.307384] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-02T18:49:20.471767] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-02T18:49:21.073041] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-09. [2025-10-02T18:49:21.873012] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-10. [2025-10-02T18:49:21.966901] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-02T18:49:22.673053] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-07. [2025-10-02T18:49:22.718048] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-02T18:49:22.719532] [INFO ] [REMOTE ] ETJ: Full fetch complete (25566 records). [2025-10-02T18:49:22.719629] [DEBUG] [VALIDATOR ] ETJ: Validating primary data. [2025-10-02T18:49:23.221304] [DEBUG] [VALIDATOR ] ETJ: All expected trading days are present. [2025-10-02T18:49:23.221525] [DEBUG] [VALIDATOR ] ETJ: Primary data validation passed. [2025-10-02T18:49:23.222239] [INFO ] [MAIN ] ETJ: Fetched primary data is valid. [2025-10-02T18:49:23.222347] [DEBUG] [LOCAL ] ETJ: Saving primary data. [2025-10-02T18:49:23.223222] [DEBUG] [LOCAL ] ETJ: Trimmed 25566 records to 16912 (keeping 200 days of data) [2025-10-02T18:49:23.334478] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-02T18:49:23.372176] [DEBUG] [LOCAL ] ETJ: Primary data saved (16912 records). [2025-10-02T18:49:23.372754] [INFO ] [MAIN ] ETJ: Full history saved. [2025-10-02T18:49:23.372854] [INFO ] [MAIN ] Update Progress: 778/2370 symbols completed. ETJ took 38.8s. Estimated remaining: 3h 43m 43s. Rate: 7.1 symbols/min [2025-10-02T18:49:23.478469] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-09. [2025-10-02T18:49:23.571883] [INFO ] [MAIN ] ETV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:49:23.596849] [DEBUG] [LOCAL ] ETV: Loaded 21526 existing records from primary storage. [2025-10-02T18:49:23.597207] [INFO ] [MAIN ] ETV: Loaded 21526 existing records. [2025-10-02T18:49:23.810294] [WARN ] [MAIN ] ETV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:49:23.810849] [INFO ] [MAIN ] ETV: Wiping existing primary data before full refresh. [2025-10-02T18:49:23.810914] [INFO ] [LOCAL ] ETV: Starting deletion of primary data. [2025-10-02T18:49:23.811728] [DEBUG] [LOCAL ] ETV: Deleted primary data file. [2025-10-02T18:49:23.811792] [INFO ] [MAIN ] ETV: Starting full primary refresh. [2025-10-02T18:49:24.232454] [INFO ] [REMOTE ] ETV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:49:24.273013] [INFO ] [REMOTE ] ETV: Fetching primary data for 2024-12. [2025-10-02T18:49:24.434266] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-02T18:49:24.436696] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-02T18:49:25.072995] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-08. [2025-10-02T18:49:25.170492] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-02T18:49:25.872999] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-10. [2025-10-02T18:49:26.525120] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-02T18:49:26.673028] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-10. [2025-10-02T18:49:27.137231] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-02T18:49:27.138242] [INFO ] [REMOTE ] ETO: Full fetch complete (9413 records). [2025-10-02T18:49:27.138318] [DEBUG] [VALIDATOR ] ETO: Validating primary data. [2025-10-02T18:49:27.478157] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-01. [2025-10-02T18:49:27.544397] [DEBUG] [VALIDATOR ] ETO: All expected trading days are present. [2025-10-02T18:49:27.544594] [DEBUG] [VALIDATOR ] ETO: Primary data validation passed. [2025-10-02T18:49:27.544902] [INFO ] [MAIN ] ETO: Fetched primary data is valid. [2025-10-02T18:49:27.545022] [DEBUG] [LOCAL ] ETO: Saving primary data. [2025-10-02T18:49:27.545487] [DEBUG] [LOCAL ] ETO: Trimmed 9413 records to 6595 (keeping 200 days of data) [2025-10-02T18:49:27.595086] [DEBUG] [LOCAL ] ETO: Primary data saved (6595 records). [2025-10-02T18:49:27.600681] [INFO ] [MAIN ] ETO: Full history saved. [2025-10-02T18:49:27.601621] [INFO ] [MAIN ] Update Progress: 779/2370 symbols completed. ETO took 35.1s. Estimated remaining: 3h 43m 26s. Rate: 7.1 symbols/min [2025-10-02T18:49:27.601852] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-02T18:49:27.655152] [INFO ] [REMOTE ] ETN: Full fetch complete (76548 records). [2025-10-02T18:49:27.683290] [DEBUG] [VALIDATOR ] ETN: Validating primary data. [2025-10-02T18:49:27.943671] [INFO ] [MAIN ] ETW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:49:28.207865] [DEBUG] [LOCAL ] ETW: Loaded 25087 existing records from primary storage. [2025-10-02T18:49:28.232980] [INFO ] [MAIN ] ETW: Loaded 25087 existing records. [2025-10-02T18:49:28.278252] [DEBUG] [VALIDATOR ] ETN: All expected trading days are present. [2025-10-02T18:49:28.278133] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-09. [2025-10-02T18:49:28.293235] [DEBUG] [VALIDATOR ] ETN: Primary data validation passed. [2025-10-02T18:49:28.318364] [INFO ] [MAIN ] ETN: Fetched primary data is valid. [2025-10-02T18:49:28.354506] [DEBUG] [LOCAL ] ETN: Saving primary data. [2025-10-02T18:49:28.469222] [WARN ] [MAIN ] ETW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:49:28.469749] [DEBUG] [LOCAL ] ETN: Trimmed 76548 records to 53136 (keeping 200 days of data) [2025-10-02T18:49:28.470225] [INFO ] [MAIN ] ETW: Wiping existing primary data before full refresh. [2025-10-02T18:49:28.470908] [INFO ] [LOCAL ] ETW: Starting deletion of primary data. [2025-10-02T18:49:28.472341] [DEBUG] [LOCAL ] ETW: Deleted primary data file. [2025-10-02T18:49:28.472412] [INFO ] [MAIN ] ETW: Starting full primary refresh. [2025-10-02T18:49:28.885861] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-02T18:49:29.090335] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-02. [2025-10-02T18:49:29.226713] [INFO ] [REMOTE ] ETW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:49:29.317269] [DEBUG] [LOCAL ] ETN: Primary data saved (53136 records). [2025-10-02T18:49:29.317469] [INFO ] [MAIN ] ETN: Full history saved. [2025-10-02T18:49:29.317708] [INFO ] [MAIN ] Update Progress: 780/2370 symbols completed. ETN took 40.2s. Estimated remaining: 3h 43m 4s. Rate: 7.1 symbols/min [2025-10-02T18:49:29.506916] [INFO ] [MAIN ] ETX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:49:29.519708] [DEBUG] [LOCAL ] ETX: Loaded 5134 existing records from primary storage. [2025-10-02T18:49:29.519941] [INFO ] [MAIN ] ETX: Loaded 5134 existing records. [2025-10-02T18:49:29.721063] [WARN ] [MAIN ] ETX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:49:29.721301] [INFO ] [MAIN ] ETX: Wiping existing primary data before full refresh. [2025-10-02T18:49:29.721374] [INFO ] [LOCAL ] ETX: Starting deletion of primary data. [2025-10-02T18:49:29.721836] [DEBUG] [LOCAL ] ETX: Deleted primary data file. [2025-10-02T18:49:29.721927] [INFO ] [MAIN ] ETX: Starting full primary refresh. [2025-10-02T18:49:29.880589] [INFO ] [REMOTE ] ETW: Fetching primary data for 2024-12. [2025-10-02T18:49:30.143469] [INFO ] [REMOTE ] ETX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:49:30.181330] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-02T18:49:30.232505] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-02T18:49:30.673022] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-10. [2025-10-02T18:49:30.986882] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-02T18:49:31.473045] [INFO ] [REMOTE ] ETX: Fetching primary data for 2024-12. [2025-10-02T18:49:31.907087] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-02T18:49:31.912096] [INFO ] [REMOTE ] ETR: Full fetch complete (77094 records). [2025-10-02T18:49:31.912279] [DEBUG] [VALIDATOR ] ETR: Validating primary data. [2025-10-02T18:49:32.048260] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-02T18:49:32.278161] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-03. [2025-10-02T18:49:32.375964] [DEBUG] [VALIDATOR ] ETR: All expected trading days are present. [2025-10-02T18:49:32.376080] [DEBUG] [VALIDATOR ] ETR: Primary data validation passed. [2025-10-02T18:49:32.377584] [INFO ] [MAIN ] ETR: Fetched primary data is valid. [2025-10-02T18:49:32.377697] [DEBUG] [LOCAL ] ETR: Saving primary data. [2025-10-02T18:49:32.385014] [DEBUG] [LOCAL ] ETR: Trimmed 77094 records to 53613 (keeping 200 days of data) [2025-10-02T18:49:32.755153] [DEBUG] [LOCAL ] ETR: Primary data saved (53613 records). [2025-10-02T18:49:32.755293] [INFO ] [MAIN ] ETR: Full history saved. [2025-10-02T18:49:32.755399] [INFO ] [MAIN ] Update Progress: 781/2370 symbols completed. ETR took 32.3s. Estimated remaining: 3h 42m 45s. Rate: 7.1 symbols/min [2025-10-02T18:49:32.943928] [INFO ] [MAIN ] ETY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:49:32.969484] [DEBUG] [LOCAL ] ETY: Loaded 22753 existing records from primary storage. [2025-10-02T18:49:32.969779] [INFO ] [MAIN ] ETY: Loaded 22753 existing records. [2025-10-02T18:49:33.081619] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-01. [2025-10-02T18:49:33.170371] [WARN ] [MAIN ] ETY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:49:33.170707] [INFO ] [MAIN ] ETY: Wiping existing primary data before full refresh. [2025-10-02T18:49:33.170782] [INFO ] [LOCAL ] ETY: Starting deletion of primary data. [2025-10-02T18:49:33.173476] [DEBUG] [LOCAL ] ETY: Deleted primary data file. [2025-10-02T18:49:33.173542] [INFO ] [MAIN ] ETY: Starting full primary refresh. [2025-10-02T18:49:33.524837] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-02T18:49:33.606298] [INFO ] [REMOTE ] ETY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:49:33.608504] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-02T18:49:33.873017] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-04. [2025-10-02T18:49:34.672981] [INFO ] [REMOTE ] ETY: Fetching primary data for 2024-12. [2025-10-02T18:49:35.068807] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-02T18:49:35.458766] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-02T18:49:35.472945] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-01. [2025-10-02T18:49:36.272993] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-05. [2025-10-02T18:49:36.460714] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-02T18:49:37.025143] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-02T18:49:37.072974] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-02. [2025-10-02T18:49:37.872996] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-01. [2025-10-02T18:49:38.219488] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-02T18:49:38.673001] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-03. [2025-10-02T18:49:39.035449] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-02T18:49:39.472969] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-06. [2025-10-02T18:49:39.539426] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-02T18:49:40.272988] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-02. [2025-10-02T18:49:40.294097] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-02T18:49:40.885488] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-02T18:49:41.072998] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-03. [2025-10-02T18:49:41.476480] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-02T18:49:41.873017] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-07. [2025-10-02T18:49:42.672974] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-02. [2025-10-02T18:49:43.011746] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-02T18:49:43.429682] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-02T18:49:43.472992] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-03. [2025-10-02T18:49:44.272998] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-04. [2025-10-02T18:49:44.727448] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-02T18:49:44.897156] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-02T18:49:45.073040] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-08. [2025-10-02T18:49:45.872998] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-04. [2025-10-02T18:49:46.129679] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-02T18:49:46.673041] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-09. [2025-10-02T18:49:47.010926] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-02T18:49:47.473068] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-04. [2025-10-02T18:49:47.749938] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-02T18:49:48.273005] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-05. [2025-10-02T18:49:48.517690] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-02T18:49:48.802210] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-02T18:49:49.073028] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-05. [2025-10-02T18:49:49.873016] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-06. [2025-10-02T18:49:50.255993] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-02T18:49:50.590508] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-02T18:49:50.673011] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-10. [2025-10-02T18:49:51.473021] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-06. [2025-10-02T18:49:51.637222] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-02T18:49:51.639207] [INFO ] [REMOTE ] ETV: Full fetch complete (32066 records). [2025-10-02T18:49:51.639289] [DEBUG] [VALIDATOR ] ETV: Validating primary data. [2025-10-02T18:49:52.071339] [DEBUG] [VALIDATOR ] ETV: All expected trading days are present. [2025-10-02T18:49:52.071410] [DEBUG] [VALIDATOR ] ETV: Primary data validation passed. [2025-10-02T18:49:52.072084] [INFO ] [MAIN ] ETV: Fetched primary data is valid. [2025-10-02T18:49:52.072148] [DEBUG] [LOCAL ] ETV: Saving primary data. [2025-10-02T18:49:52.074362] [DEBUG] [LOCAL ] ETV: Trimmed 32066 records to 21812 (keeping 200 days of data) [2025-10-02T18:49:52.222387] [DEBUG] [LOCAL ] ETV: Primary data saved (21812 records). [2025-10-02T18:49:52.222515] [INFO ] [MAIN ] ETV: Full history saved. [2025-10-02T18:49:52.222624] [INFO ] [MAIN ] Update Progress: 782/2370 symbols completed. ETV took 28.8s. Estimated remaining: 3h 42m 59s. Rate: 7.1 symbols/min [2025-10-02T18:49:52.283261] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-07. [2025-10-02T18:49:52.416731] [INFO ] [MAIN ] EVC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:49:52.436383] [DEBUG] [LOCAL ] EVC: Loaded 18618 existing records from primary storage. [2025-10-02T18:49:52.436704] [INFO ] [MAIN ] EVC: Loaded 18618 existing records. [2025-10-02T18:49:52.659275] [WARN ] [MAIN ] EVC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:49:52.660701] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-02T18:49:52.660889] [INFO ] [MAIN ] EVC: Wiping existing primary data before full refresh. [2025-10-02T18:49:52.666121] [INFO ] [LOCAL ] EVC: Starting deletion of primary data. [2025-10-02T18:49:52.666885] [DEBUG] [LOCAL ] EVC: Deleted primary data file. [2025-10-02T18:49:52.666962] [INFO ] [MAIN ] EVC: Starting full primary refresh. [2025-10-02T18:49:53.007185] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-02T18:49:53.075764] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-05. [2025-10-02T18:49:53.100891] [INFO ] [REMOTE ] EVC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:49:53.872972] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-07. [2025-10-02T18:49:54.197445] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-02T18:49:54.673030] [INFO ] [REMOTE ] EVC: Fetching primary data for 2024-12. [2025-10-02T18:49:55.151194] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-02T18:49:55.473030] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-08. [2025-10-02T18:49:56.206192] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-02T18:49:56.273005] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-08. [2025-10-02T18:49:56.524269] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-02T18:49:56.748790] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-02T18:49:57.073001] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-09. [2025-10-02T18:49:57.873022] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-06. [2025-10-02T18:49:58.053518] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-02T18:49:58.609307] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-02T18:49:58.673002] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-07. [2025-10-02T18:49:59.472976] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-01. [2025-10-02T18:49:59.816728] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-02T18:50:00.273026] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-09. [2025-10-02T18:50:00.929369] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-02T18:50:01.072997] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-08. [2025-10-02T18:50:01.159035] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-02T18:50:01.873060] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-10. [2025-10-02T18:50:02.168905] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-02T18:50:02.673053] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-02. [2025-10-02T18:50:02.832446] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-02T18:50:02.835564] [INFO ] [REMOTE ] ETW: Full fetch complete (36491 records). [2025-10-02T18:50:02.835682] [DEBUG] [VALIDATOR ] ETW: Validating primary data. [2025-10-02T18:50:03.254864] [DEBUG] [VALIDATOR ] ETW: All expected trading days are present. [2025-10-02T18:50:03.254965] [DEBUG] [VALIDATOR ] ETW: Primary data validation passed. [2025-10-02T18:50:03.255668] [INFO ] [MAIN ] ETW: Fetched primary data is valid. [2025-10-02T18:50:03.255738] [DEBUG] [LOCAL ] ETW: Saving primary data. [2025-10-02T18:50:03.256816] [DEBUG] [LOCAL ] ETW: Trimmed 36491 records to 25372 (keeping 200 days of data) [2025-10-02T18:50:03.431238] [DEBUG] [LOCAL ] ETW: Primary data saved (25372 records). [2025-10-02T18:50:03.431382] [INFO ] [MAIN ] ETW: Full history saved. [2025-10-02T18:50:03.431470] [INFO ] [MAIN ] Update Progress: 783/2370 symbols completed. ETW took 35.8s. Estimated remaining: 3h 42m 56s. Rate: 7.1 symbols/min [2025-10-02T18:50:03.479488] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-10. [2025-10-02T18:50:03.660203] [INFO ] [MAIN ] EVEX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:50:03.661584] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-02T18:50:03.703951] [DEBUG] [LOCAL ] EVEX: Loaded 30504 existing records from primary storage. [2025-10-02T18:50:03.704259] [INFO ] [MAIN ] EVEX: Loaded 30504 existing records. [2025-10-02T18:50:03.907425] [WARN ] [MAIN ] EVEX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:50:03.907696] [INFO ] [MAIN ] EVEX: Wiping existing primary data before full refresh. [2025-10-02T18:50:03.907796] [INFO ] [LOCAL ] EVEX: Starting deletion of primary data. [2025-10-02T18:50:03.908756] [DEBUG] [LOCAL ] EVEX: Deleted primary data file. [2025-10-02T18:50:03.908816] [INFO ] [MAIN ] EVEX: Starting full primary refresh. [2025-10-02T18:50:04.270698] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-02T18:50:04.279451] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-03. [2025-10-02T18:50:04.283470] [INFO ] [REMOTE ] ETX: Full fetch complete (7086 records). [2025-10-02T18:50:04.302728] [DEBUG] [VALIDATOR ] ETX: Validating primary data. [2025-10-02T18:50:04.310715] [INFO ] [REMOTE ] EVEX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:50:04.726818] [DEBUG] [VALIDATOR ] ETX: All expected trading days are present. [2025-10-02T18:50:04.726898] [DEBUG] [VALIDATOR ] ETX: Primary data validation passed. [2025-10-02T18:50:04.727098] [INFO ] [MAIN ] ETX: Fetched primary data is valid. [2025-10-02T18:50:04.727139] [DEBUG] [LOCAL ] ETX: Saving primary data. [2025-10-02T18:50:04.727592] [DEBUG] [LOCAL ] ETX: Trimmed 7086 records to 5194 (keeping 200 days of data) [2025-10-02T18:50:04.761796] [DEBUG] [LOCAL ] ETX: Primary data saved (5194 records). [2025-10-02T18:50:04.761997] [INFO ] [MAIN ] ETX: Full history saved. [2025-10-02T18:50:04.762168] [INFO ] [MAIN ] Update Progress: 784/2370 symbols completed. ETX took 35.4s. Estimated remaining: 3h 42m 33s. Rate: 7.1 symbols/min [2025-10-02T18:50:04.953284] [INFO ] [MAIN ] EVF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:50:04.965086] [DEBUG] [LOCAL ] EVF: Loaded 9403 existing records from primary storage. [2025-10-02T18:50:04.965323] [INFO ] [MAIN ] EVF: Loaded 9403 existing records. [2025-10-02T18:50:05.073001] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2024-12. [2025-10-02T18:50:05.160701] [WARN ] [MAIN ] EVF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:50:05.160907] [INFO ] [MAIN ] EVF: Wiping existing primary data before full refresh. [2025-10-02T18:50:05.160956] [INFO ] [LOCAL ] EVF: Starting deletion of primary data. [2025-10-02T18:50:05.161426] [DEBUG] [LOCAL ] EVF: Deleted primary data file. [2025-10-02T18:50:05.161489] [INFO ] [MAIN ] EVF: Starting full primary refresh. [2025-10-02T18:50:05.561626] [INFO ] [REMOTE ] EVF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:50:05.656480] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-02T18:50:05.873058] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-09. [2025-10-02T18:50:06.505269] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-02T18:50:06.672973] [INFO ] [REMOTE ] EVF: Fetching primary data for 2024-12. [2025-10-02T18:50:06.986050] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-02T18:50:07.183847] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-02T18:50:07.473031] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-01. [2025-10-02T18:50:08.153500] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-02T18:50:08.273057] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-02. [2025-10-02T18:50:08.990571] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-02T18:50:09.072999] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-01. [2025-10-02T18:50:09.872982] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-03. [2025-10-02T18:50:10.211570] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-02T18:50:10.673058] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-10. [2025-10-02T18:50:10.796278] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-02T18:50:11.392407] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-02T18:50:11.394409] [INFO ] [REMOTE ] ETY: Full fetch complete (34294 records). [2025-10-02T18:50:11.394739] [DEBUG] [VALIDATOR ] ETY: Validating primary data. [2025-10-02T18:50:11.478170] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-04. [2025-10-02T18:50:11.813028] [DEBUG] [VALIDATOR ] ETY: All expected trading days are present. [2025-10-02T18:50:11.813112] [DEBUG] [VALIDATOR ] ETY: Primary data validation passed. [2025-10-02T18:50:11.813773] [INFO ] [MAIN ] ETY: Fetched primary data is valid. [2025-10-02T18:50:11.813843] [DEBUG] [LOCAL ] ETY: Saving primary data. [2025-10-02T18:50:11.814821] [DEBUG] [LOCAL ] ETY: Trimmed 34294 records to 23009 (keeping 200 days of data) [2025-10-02T18:50:11.964595] [DEBUG] [LOCAL ] ETY: Primary data saved (23009 records). [2025-10-02T18:50:11.964824] [INFO ] [MAIN ] ETY: Full history saved. [2025-10-02T18:50:11.964926] [INFO ] [MAIN ] Update Progress: 785/2370 symbols completed. ETY took 39.2s. Estimated remaining: 3h 42m 23s. Rate: 7.1 symbols/min [2025-10-02T18:50:12.151380] [INFO ] [MAIN ] EVG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:50:12.159837] [DEBUG] [LOCAL ] EVG: Loaded 5952 existing records from primary storage. [2025-10-02T18:50:12.160070] [INFO ] [MAIN ] EVG: Loaded 5952 existing records. [2025-10-02T18:50:12.275920] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-02. [2025-10-02T18:50:12.373723] [WARN ] [MAIN ] EVG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:50:12.373996] [INFO ] [MAIN ] EVG: Wiping existing primary data before full refresh. [2025-10-02T18:50:12.374068] [INFO ] [LOCAL ] EVG: Starting deletion of primary data. [2025-10-02T18:50:12.374430] [DEBUG] [LOCAL ] EVG: Deleted primary data file. [2025-10-02T18:50:12.374494] [INFO ] [MAIN ] EVG: Starting full primary refresh. [2025-10-02T18:50:12.798024] [INFO ] [REMOTE ] EVG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:50:12.960578] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-02T18:50:13.072984] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-05. [2025-10-02T18:50:13.392501] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-02T18:50:13.873007] [INFO ] [REMOTE ] EVG: Fetching primary data for 2024-12. [2025-10-02T18:50:14.048497] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-02T18:50:14.319356] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-02T18:50:14.673014] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-03. [2025-10-02T18:50:15.472976] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-04. [2025-10-02T18:50:15.567508] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-02T18:50:16.024827] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-02T18:50:16.273018] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-01. [2025-10-02T18:50:16.901981] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-02T18:50:17.073007] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-04. [2025-10-02T18:50:17.873017] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-02. [2025-10-02T18:50:18.031205] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-02T18:50:18.445120] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-02T18:50:18.673015] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-03. [2025-10-02T18:50:19.272697] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-02T18:50:19.472986] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-06. [2025-10-02T18:50:20.273053] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-04. [2025-10-02T18:50:20.657540] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-02T18:50:20.923935] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-02T18:50:21.073064] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-07. [2025-10-02T18:50:21.873003] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-05. [2025-10-02T18:50:21.895114] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-02T18:50:22.294438] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-02T18:50:22.673008] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-05. [2025-10-02T18:50:23.304451] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-02T18:50:23.473014] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-05. [2025-10-02T18:50:24.272974] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-06. [2025-10-02T18:50:24.364952] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-02T18:50:25.063536] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-02T18:50:25.072984] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-08. [2025-10-02T18:50:25.872969] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-06. [2025-10-02T18:50:26.029798] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-02T18:50:26.673013] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-07. [2025-10-02T18:50:27.151616] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-02T18:50:27.341372] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-02T18:50:27.472992] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-07. [2025-10-02T18:50:28.273056] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-08. [2025-10-02T18:50:28.912408] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-02T18:50:29.066725] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-02T18:50:29.072958] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-09. [2025-10-02T18:50:29.792379] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-02T18:50:29.872998] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-06. [2025-10-02T18:50:30.289287] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-02T18:50:30.673042] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-09. [2025-10-02T18:50:31.413908] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-02T18:50:31.473004] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-07. [2025-10-02T18:50:32.077719] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-02T18:50:32.273000] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-08. [2025-10-02T18:50:33.073018] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-10. [2025-10-02T18:50:33.687586] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-02T18:50:33.688560] [INFO ] [REMOTE ] EVF: Full fetch complete (12206 records). [2025-10-02T18:50:33.688635] [DEBUG] [VALIDATOR ] EVF: Validating primary data. [2025-10-02T18:50:33.885591] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-10. [2025-10-02T18:50:34.148465] [DEBUG] [VALIDATOR ] EVF: All expected trading days are present. [2025-10-02T18:50:34.162109] [DEBUG] [VALIDATOR ] EVF: Primary data validation passed. [2025-10-02T18:50:34.171474] [INFO ] [MAIN ] EVF: Fetched primary data is valid. [2025-10-02T18:50:34.171862] [DEBUG] [LOCAL ] EVF: Saving primary data. [2025-10-02T18:50:34.173608] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-02T18:50:34.182590] [DEBUG] [LOCAL ] EVF: Trimmed 12206 records to 9459 (keeping 200 days of data) [2025-10-02T18:50:34.241744] [DEBUG] [LOCAL ] EVF: Primary data saved (9459 records). [2025-10-02T18:50:34.241882] [INFO ] [MAIN ] EVF: Full history saved. [2025-10-02T18:50:34.241968] [INFO ] [MAIN ] Update Progress: 786/2370 symbols completed. EVF took 29.5s. Estimated remaining: 3h 42m 42s. Rate: 7.1 symbols/min [2025-10-02T18:50:34.437388] [INFO ] [MAIN ] EVH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:50:34.494465] [DEBUG] [LOCAL ] EVH: Loaded 49369 existing records from primary storage. [2025-10-02T18:50:34.494816] [INFO ] [MAIN ] EVH: Loaded 49369 existing records. [2025-10-02T18:50:34.686051] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-08. [2025-10-02T18:50:34.692268] [WARN ] [MAIN ] EVH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:50:34.693233] [INFO ] [MAIN ] EVH: Wiping existing primary data before full refresh. [2025-10-02T18:50:34.693283] [INFO ] [LOCAL ] EVH: Starting deletion of primary data. [2025-10-02T18:50:34.694535] [DEBUG] [LOCAL ] EVH: Deleted primary data file. [2025-10-02T18:50:34.694596] [INFO ] [MAIN ] EVH: Starting full primary refresh. [2025-10-02T18:50:34.784726] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-02T18:50:34.810764] [INFO ] [REMOTE ] EVC: Full fetch complete (30142 records). [2025-10-02T18:50:34.811110] [DEBUG] [VALIDATOR ] EVC: Validating primary data. [2025-10-02T18:50:35.377732] [INFO ] [REMOTE ] EVH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:50:35.481541] [INFO ] [REMOTE ] EVH: Fetching primary data for 2024-12. [2025-10-02T18:50:35.541120] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-02T18:50:35.541751] [DEBUG] [VALIDATOR ] EVC: All expected trading days are present. [2025-10-02T18:50:35.544572] [DEBUG] [VALIDATOR ] EVC: Primary data validation passed. [2025-10-02T18:50:35.545866] [INFO ] [MAIN ] EVC: Fetched primary data is valid. [2025-10-02T18:50:35.545938] [DEBUG] [LOCAL ] EVC: Saving primary data. [2025-10-02T18:50:35.547095] [DEBUG] [LOCAL ] EVC: Trimmed 30142 records to 18719 (keeping 200 days of data) [2025-10-02T18:50:35.659048] [DEBUG] [LOCAL ] EVC: Primary data saved (18719 records). [2025-10-02T18:50:35.659195] [INFO ] [MAIN ] EVC: Full history saved. [2025-10-02T18:50:35.659308] [INFO ] [MAIN ] Update Progress: 787/2370 symbols completed. EVC took 43.4s. Estimated remaining: 3h 42m 20s. Rate: 7.1 symbols/min [2025-10-02T18:50:35.848574] [INFO ] [MAIN ] EVN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:50:35.863512] [DEBUG] [LOCAL ] EVN: Loaded 11144 existing records from primary storage. [2025-10-02T18:50:35.863852] [INFO ] [MAIN ] EVN: Loaded 11144 existing records. [2025-10-02T18:50:36.094920] [WARN ] [MAIN ] EVN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:50:36.095128] [INFO ] [MAIN ] EVN: Wiping existing primary data before full refresh. [2025-10-02T18:50:36.095181] [INFO ] [LOCAL ] EVN: Starting deletion of primary data. [2025-10-02T18:50:36.095763] [DEBUG] [LOCAL ] EVN: Deleted primary data file. [2025-10-02T18:50:36.095826] [INFO ] [MAIN ] EVN: Starting full primary refresh. [2025-10-02T18:50:36.285023] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-09. [2025-10-02T18:50:36.505281] [INFO ] [REMOTE ] EVN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:50:36.978515] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-02T18:50:37.072981] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-10. [2025-10-02T18:50:37.252561] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-02T18:50:37.717854] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-02T18:50:37.718938] [INFO ] [REMOTE ] EVG: Full fetch complete (8244 records). [2025-10-02T18:50:37.719038] [DEBUG] [VALIDATOR ] EVG: Validating primary data. [2025-10-02T18:50:37.878130] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-09. [2025-10-02T18:50:38.131187] [DEBUG] [VALIDATOR ] EVG: All expected trading days are present. [2025-10-02T18:50:38.131325] [DEBUG] [VALIDATOR ] EVG: Primary data validation passed. [2025-10-02T18:50:38.131605] [INFO ] [MAIN ] EVG: Fetched primary data is valid. [2025-10-02T18:50:38.131694] [DEBUG] [LOCAL ] EVG: Saving primary data. [2025-10-02T18:50:38.132156] [DEBUG] [LOCAL ] EVG: Trimmed 8244 records to 5992 (keeping 200 days of data) [2025-10-02T18:50:38.170580] [DEBUG] [LOCAL ] EVG: Primary data saved (5992 records). [2025-10-02T18:50:38.170707] [INFO ] [MAIN ] EVG: Full history saved. [2025-10-02T18:50:38.170860] [INFO ] [MAIN ] Update Progress: 788/2370 symbols completed. EVG took 26.2s. Estimated remaining: 3h 41m 59s. Rate: 7.1 symbols/min [2025-10-02T18:50:38.350443] [INFO ] [MAIN ] EVR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:50:38.390241] [DEBUG] [LOCAL ] EVR: Loaded 34906 existing records from primary storage. [2025-10-02T18:50:38.390542] [INFO ] [MAIN ] EVR: Loaded 34906 existing records. [2025-10-02T18:50:38.599556] [WARN ] [MAIN ] EVR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:50:38.599861] [INFO ] [MAIN ] EVR: Wiping existing primary data before full refresh. [2025-10-02T18:50:38.599910] [INFO ] [LOCAL ] EVR: Starting deletion of primary data. [2025-10-02T18:50:38.601086] [DEBUG] [LOCAL ] EVR: Deleted primary data file. [2025-10-02T18:50:38.601150] [INFO ] [MAIN ] EVR: Starting full primary refresh. [2025-10-02T18:50:38.679219] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-01. [2025-10-02T18:50:38.994072] [INFO ] [REMOTE ] EVR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:50:39.472962] [INFO ] [REMOTE ] EVR: Fetching primary data for 2024-12. [2025-10-02T18:50:39.588639] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-02T18:50:40.273001] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-10. [2025-10-02T18:50:40.431869] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-02T18:50:40.507735] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-02T18:50:41.073017] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-02. [2025-10-02T18:50:41.734092] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-02T18:50:41.736269] [INFO ] [REMOTE ] EVEX: Full fetch complete (42189 records). [2025-10-02T18:50:41.736400] [DEBUG] [VALIDATOR ] EVEX: Validating primary data. [2025-10-02T18:50:41.878149] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-01. [2025-10-02T18:50:42.176634] [DEBUG] [VALIDATOR ] EVEX: All expected trading days are present. [2025-10-02T18:50:42.176827] [DEBUG] [VALIDATOR ] EVEX: Primary data validation passed. [2025-10-02T18:50:42.177686] [INFO ] [MAIN ] EVEX: Fetched primary data is valid. [2025-10-02T18:50:42.177766] [DEBUG] [LOCAL ] EVEX: Saving primary data. [2025-10-02T18:50:42.178990] [DEBUG] [LOCAL ] EVEX: Trimmed 42189 records to 30868 (keeping 200 days of data) [2025-10-02T18:50:42.387835] [DEBUG] [LOCAL ] EVEX: Primary data saved (30868 records). [2025-10-02T18:50:42.387983] [INFO ] [MAIN ] EVEX: Full history saved. [2025-10-02T18:50:42.389243] [INFO ] [MAIN ] Update Progress: 789/2370 symbols completed. EVEX took 39.0s. Estimated remaining: 3h 41m 42s. Rate: 7.1 symbols/min [2025-10-02T18:50:42.577685] [INFO ] [MAIN ] EVT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:50:42.597769] [DEBUG] [LOCAL ] EVT: Loaded 16951 existing records from primary storage. [2025-10-02T18:50:42.598029] [INFO ] [MAIN ] EVT: Loaded 16951 existing records. [2025-10-02T18:50:42.674098] [INFO ] [REMOTE ] EVN: Fetching primary data for 2024-12. [2025-10-02T18:50:42.821999] [WARN ] [MAIN ] EVT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:50:42.824053] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-02T18:50:42.833569] [INFO ] [MAIN ] EVT: Wiping existing primary data before full refresh. [2025-10-02T18:50:42.834015] [INFO ] [LOCAL ] EVT: Starting deletion of primary data. [2025-10-02T18:50:42.834784] [DEBUG] [LOCAL ] EVT: Deleted primary data file. [2025-10-02T18:50:42.834855] [INFO ] [MAIN ] EVT: Starting full primary refresh. [2025-10-02T18:50:43.232561] [INFO ] [REMOTE ] EVT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:50:43.429502] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-02T18:50:43.472959] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-02. [2025-10-02T18:50:43.652452] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-02T18:50:44.273004] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-03. [2025-10-02T18:50:44.762318] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-02T18:50:45.072995] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-03. [2025-10-02T18:50:45.872984] [INFO ] [REMOTE ] EVT: Fetching primary data for 2024-12. [2025-10-02T18:50:45.917563] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-02T18:50:46.672967] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-04. [2025-10-02T18:50:46.700041] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-02T18:50:46.956545] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-02T18:50:47.473014] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-01. [2025-10-02T18:50:48.147265] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-02T18:50:48.273023] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-02. [2025-10-02T18:50:48.403225] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-02T18:50:48.924617] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-02T18:50:49.073002] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-03. [2025-10-02T18:50:49.873006] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-01. [2025-10-02T18:50:49.905161] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-02T18:50:50.673009] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-05. [2025-10-02T18:50:50.841812] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-02T18:50:51.473009] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-02. [2025-10-02T18:50:52.244857] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-02T18:50:52.272953] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-03. [2025-10-02T18:50:52.331860] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-02T18:50:53.073020] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-04. [2025-10-02T18:50:53.269925] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-02T18:50:53.872975] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-06. [2025-10-02T18:50:53.955468] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-02T18:50:54.673006] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-04. [2025-10-02T18:50:55.472984] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-04. [2025-10-02T18:50:55.529552] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-02T18:50:56.272988] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-07. [2025-10-02T18:50:56.373550] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-02T18:50:56.519185] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-02T18:50:57.073009] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-05. [2025-10-02T18:50:57.821939] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-02T18:50:57.872972] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-08. [2025-10-02T18:50:58.497204] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-02T18:50:58.672997] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-05. [2025-10-02T18:50:59.472976] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-05. [2025-10-02T18:50:59.564130] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-02T18:50:59.729454] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-02T18:51:00.129692] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-02T18:51:00.273000] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-06. [2025-10-02T18:51:01.072975] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-09. [2025-10-02T18:51:01.077723] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-02T18:51:01.873047] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-06. [2025-10-02T18:51:02.530546] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-02T18:51:02.673020] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-06. [2025-10-02T18:51:02.814254] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-02T18:51:03.472975] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-10. [2025-10-02T18:51:03.700322] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-02T18:51:04.273043] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-07. [2025-10-02T18:51:04.968879] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-02T18:51:04.971679] [INFO ] [REMOTE ] EVH: Full fetch complete (71784 records). [2025-10-02T18:51:04.971832] [DEBUG] [VALIDATOR ] EVH: Validating primary data. [2025-10-02T18:51:05.078823] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-07. [2025-10-02T18:51:05.450830] [DEBUG] [VALIDATOR ] EVH: All expected trading days are present. [2025-10-02T18:51:05.451035] [DEBUG] [VALIDATOR ] EVH: Primary data validation passed. [2025-10-02T18:51:05.452166] [INFO ] [MAIN ] EVH: Fetched primary data is valid. [2025-10-02T18:51:05.462865] [DEBUG] [LOCAL ] EVH: Saving primary data. [2025-10-02T18:51:05.464303] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-02T18:51:05.470214] [DEBUG] [LOCAL ] EVH: Trimmed 71784 records to 49734 (keeping 200 days of data) [2025-10-02T18:51:05.771932] [DEBUG] [LOCAL ] EVH: Primary data saved (49734 records). [2025-10-02T18:51:05.772083] [INFO ] [MAIN ] EVH: Full history saved. [2025-10-02T18:51:05.772235] [INFO ] [MAIN ] Update Progress: 790/2370 symbols completed. EVH took 31.5s. Estimated remaining: 3h 42m 4s. Rate: 7.1 symbols/min [2025-10-02T18:51:05.878123] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-08. [2025-10-02T18:51:05.961000] [INFO ] [MAIN ] EVTC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:51:05.989632] [DEBUG] [LOCAL ] EVTC: Loaded 26228 existing records from primary storage. [2025-10-02T18:51:05.989937] [INFO ] [MAIN ] EVTC: Loaded 26228 existing records. [2025-10-02T18:51:06.193195] [WARN ] [MAIN ] EVTC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:51:06.193447] [INFO ] [MAIN ] EVTC: Wiping existing primary data before full refresh. [2025-10-02T18:51:06.193502] [INFO ] [LOCAL ] EVTC: Starting deletion of primary data. [2025-10-02T18:51:06.194579] [DEBUG] [LOCAL ] EVTC: Deleted primary data file. [2025-10-02T18:51:06.194675] [INFO ] [MAIN ] EVTC: Starting full primary refresh. [2025-10-02T18:51:06.597826] [INFO ] [REMOTE ] EVTC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:51:06.639776] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-02T18:51:06.659089] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-02T18:51:06.672950] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-09. [2025-10-02T18:51:07.472994] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2024-12. [2025-10-02T18:51:07.647381] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-02T18:51:08.273017] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-10. [2025-10-02T18:51:08.591617] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-02T18:51:08.847881] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-02T18:51:08.849394] [INFO ] [REMOTE ] EVT: Full fetch complete (25316 records). [2025-10-02T18:51:08.849495] [DEBUG] [VALIDATOR ] EVT: Validating primary data. [2025-10-02T18:51:09.078151] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-07. [2025-10-02T18:51:09.283946] [DEBUG] [VALIDATOR ] EVT: All expected trading days are present. [2025-10-02T18:51:09.284041] [DEBUG] [VALIDATOR ] EVT: Primary data validation passed. [2025-10-02T18:51:09.284619] [INFO ] [MAIN ] EVT: Fetched primary data is valid. [2025-10-02T18:51:09.284703] [DEBUG] [LOCAL ] EVT: Saving primary data. [2025-10-02T18:51:09.285525] [DEBUG] [LOCAL ] EVT: Trimmed 25316 records to 17068 (keeping 200 days of data) [2025-10-02T18:51:09.391700] [DEBUG] [LOCAL ] EVT: Primary data saved (17068 records). [2025-10-02T18:51:09.391885] [INFO ] [MAIN ] EVT: Full history saved. [2025-10-02T18:51:09.391993] [INFO ] [MAIN ] Update Progress: 791/2370 symbols completed. EVT took 27.0s. Estimated remaining: 3h 41m 46s. Rate: 7.1 symbols/min [2025-10-02T18:51:09.567679] [INFO ] [MAIN ] EVTL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:51:09.604849] [DEBUG] [LOCAL ] EVTL: Loaded 38254 existing records from primary storage. [2025-10-02T18:51:09.605141] [INFO ] [MAIN ] EVTL: Loaded 38254 existing records. [2025-10-02T18:51:09.808135] [WARN ] [MAIN ] EVTL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:51:09.808355] [INFO ] [MAIN ] EVTL: Wiping existing primary data before full refresh. [2025-10-02T18:51:09.808408] [INFO ] [LOCAL ] EVTL: Starting deletion of primary data. [2025-10-02T18:51:09.809984] [DEBUG] [LOCAL ] EVTL: Deleted primary data file. [2025-10-02T18:51:09.810060] [INFO ] [MAIN ] EVTL: Starting full primary refresh. [2025-10-02T18:51:09.880259] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-08. [2025-10-02T18:51:10.021246] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-02T18:51:10.221576] [INFO ] [REMOTE ] EVTL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:51:10.673029] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-01. [2025-10-02T18:51:11.232504] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-02T18:51:11.474136] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2024-12. [2025-10-02T18:51:11.478928] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-02T18:51:12.273049] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-08. [2025-10-02T18:51:12.591245] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-02T18:51:13.073024] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-09. [2025-10-02T18:51:13.189393] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-02T18:51:13.872984] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-02. [2025-10-02T18:51:14.074331] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-02T18:51:14.672998] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-01. [2025-10-02T18:51:15.031281] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-02T18:51:15.473028] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-09. [2025-10-02T18:51:15.883362] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-02T18:51:16.273007] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-02. [2025-10-02T18:51:16.372861] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-02T18:51:17.073014] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-10. [2025-10-02T18:51:17.753111] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-02T18:51:17.873005] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-10. [2025-10-02T18:51:18.274418] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-02T18:51:18.276025] [INFO ] [REMOTE ] EVR: Full fetch complete (50817 records). [2025-10-02T18:51:18.276155] [DEBUG] [VALIDATOR ] EVR: Validating primary data. [2025-10-02T18:51:18.474123] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-02T18:51:18.498736] [INFO ] [REMOTE ] EVN: Full fetch complete (17812 records). [2025-10-02T18:51:18.568509] [DEBUG] [VALIDATOR ] EVN: Validating primary data. [2025-10-02T18:51:18.677999] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-03. [2025-10-02T18:51:18.909088] [DEBUG] [VALIDATOR ] EVR: All expected trading days are present. [2025-10-02T18:51:18.920452] [DEBUG] [VALIDATOR ] EVR: Primary data validation passed. [2025-10-02T18:51:18.932503] [INFO ] [MAIN ] EVR: Fetched primary data is valid. [2025-10-02T18:51:18.960489] [DEBUG] [LOCAL ] EVR: Saving primary data. [2025-10-02T18:51:19.073923] [DEBUG] [LOCAL ] EVR: Trimmed 50817 records to 35117 (keeping 200 days of data) [2025-10-02T18:51:19.226797] [DEBUG] [VALIDATOR ] EVN: All expected trading days are present. [2025-10-02T18:51:19.227189] [DEBUG] [VALIDATOR ] EVN: Primary data validation passed. [2025-10-02T18:51:19.255574] [INFO ] [MAIN ] EVN: Fetched primary data is valid. [2025-10-02T18:51:19.255998] [DEBUG] [LOCAL ] EVN: Saving primary data. [2025-10-02T18:51:19.259458] [DEBUG] [LOCAL ] EVN: Trimmed 17812 records to 11253 (keeping 200 days of data) [2025-10-02T18:51:19.454238] [DEBUG] [LOCAL ] EVN: Primary data saved (11253 records). [2025-10-02T18:51:19.456797] [INFO ] [MAIN ] EVN: Full history saved. [2025-10-02T18:51:19.458253] [INFO ] [MAIN ] Update Progress: 792/2370 symbols completed. EVN took 43.8s. Estimated remaining: 3h 41m 41s. Rate: 7.1 symbols/min [2025-10-02T18:51:19.478088] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-03. [2025-10-02T18:51:19.558836] [DEBUG] [LOCAL ] EVR: Primary data saved (35117 records). [2025-10-02T18:51:19.579623] [INFO ] [MAIN ] EVR: Full history saved. [2025-10-02T18:51:19.582530] [INFO ] [MAIN ] Update Progress: 793/2370 symbols completed. EVR took 41.4s. Estimated remaining: 3h 41m 16s. Rate: 7.1 symbols/min [2025-10-02T18:51:19.733733] [INFO ] [MAIN ] EVTR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:51:19.855443] [INFO ] [MAIN ] EW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:51:19.873438] [DEBUG] [LOCAL ] EVTR: Loaded 23681 existing records from primary storage. [2025-10-02T18:51:19.873714] [INFO ] [MAIN ] EVTR: Loaded 23681 existing records. [2025-10-02T18:51:20.104074] [WARN ] [MAIN ] EVTR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:51:20.117488] [INFO ] [MAIN ] EVTR: Wiping existing primary data before full refresh. [2025-10-02T18:51:20.117336] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-02T18:51:20.117703] [INFO ] [LOCAL ] EVTR: Starting deletion of primary data. [2025-10-02T18:51:20.140946] [DEBUG] [LOCAL ] EVTR: Deleted primary data file. [2025-10-02T18:51:20.141082] [INFO ] [MAIN ] EVTR: Starting full primary refresh. [2025-10-02T18:51:20.147572] [DEBUG] [LOCAL ] EW: Loaded 53402 existing records from primary storage. [2025-10-02T18:51:20.204498] [INFO ] [MAIN ] EW: Loaded 53402 existing records. [2025-10-02T18:51:20.312677] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-04. [2025-10-02T18:51:20.631515] [WARN ] [MAIN ] EW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:51:20.657622] [INFO ] [MAIN ] EW: Wiping existing primary data before full refresh. [2025-10-02T18:51:20.663225] [INFO ] [LOCAL ] EW: Starting deletion of primary data. [2025-10-02T18:51:20.689163] [DEBUG] [LOCAL ] EW: Deleted primary data file. [2025-10-02T18:51:20.689528] [INFO ] [MAIN ] EW: Starting full primary refresh. [2025-10-02T18:51:20.870807] [INFO ] [REMOTE ] EVTR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:51:20.885528] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-02T18:51:21.078151] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-04. [2025-10-02T18:51:21.249794] [INFO ] [REMOTE ] EW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:51:21.363267] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-02T18:51:21.872975] [INFO ] [REMOTE ] EW: Fetching primary data for 2024-12. [2025-10-02T18:51:22.272950] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-02T18:51:22.673030] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-05. [2025-10-02T18:51:23.467230] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-02T18:51:23.477589] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-05. [2025-10-02T18:51:23.949202] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-02T18:51:24.262197] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-02T18:51:24.273004] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-01. [2025-10-02T18:51:25.073000] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2024-12. [2025-10-02T18:51:25.873812] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-06. [2025-10-02T18:51:25.877002] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-02T18:51:25.916616] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-02T18:51:26.673006] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-02. [2025-10-02T18:51:27.472977] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-01. [2025-10-02T18:51:27.536809] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-02T18:51:28.089822] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-02T18:51:28.120212] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-02T18:51:28.272999] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-02. [2025-10-02T18:51:29.072979] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-07. [2025-10-02T18:51:29.202521] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-02T18:51:29.873008] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-06. [2025-10-02T18:51:30.672999] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-03. [2025-10-02T18:51:30.969497] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-02T18:51:31.133346] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-02T18:51:31.374787] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-02T18:51:31.472981] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-07. [2025-10-02T18:51:32.272972] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-03. [2025-10-02T18:51:32.408294] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-02T18:51:33.073021] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-04. [2025-10-02T18:51:33.873013] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-08. [2025-10-02T18:51:34.085027] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-02T18:51:34.123550] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-02T18:51:34.673000] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-04. [2025-10-02T18:51:35.473000] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-05. [2025-10-02T18:51:35.663177] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-02T18:51:36.152812] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-02T18:51:36.273018] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-08. [2025-10-02T18:51:36.519140] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-02T18:51:37.072992] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-09. [2025-10-02T18:51:37.123192] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-02T18:51:37.873000] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-05. [2025-10-02T18:51:38.672982] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-09. [2025-10-02T18:51:38.857101] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-02T18:51:39.472963] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-10. [2025-10-02T18:51:39.652526] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-02T18:51:39.819242] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-02T18:51:40.272992] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-10. [2025-10-02T18:51:41.072997] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-06. [2025-10-02T18:51:41.094816] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-02T18:51:41.096785] [INFO ] [REMOTE ] EVTL: Full fetch complete (52188 records). [2025-10-02T18:51:41.096895] [DEBUG] [VALIDATOR ] EVTL: Validating primary data. [2025-10-02T18:51:41.398835] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-02T18:51:41.430041] [INFO ] [REMOTE ] EVTC: Full fetch complete (38002 records). [2025-10-02T18:51:41.435973] [DEBUG] [VALIDATOR ] EVTC: Validating primary data. [2025-10-02T18:51:41.677218] [DEBUG] [VALIDATOR ] EVTL: All expected trading days are present. [2025-10-02T18:51:41.682451] [DEBUG] [VALIDATOR ] EVTL: Primary data validation passed. [2025-10-02T18:51:41.683327] [INFO ] [MAIN ] EVTL: Fetched primary data is valid. [2025-10-02T18:51:41.704864] [DEBUG] [LOCAL ] EVTL: Saving primary data. [2025-10-02T18:51:41.741140] [DEBUG] [LOCAL ] EVTL: Trimmed 52188 records to 38644 (keeping 200 days of data) [2025-10-02T18:51:41.880147] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-06. [2025-10-02T18:51:42.063893] [DEBUG] [VALIDATOR ] EVTC: All expected trading days are present. [2025-10-02T18:51:42.064606] [DEBUG] [VALIDATOR ] EVTC: Primary data validation passed. [2025-10-02T18:51:42.066126] [INFO ] [MAIN ] EVTC: Fetched primary data is valid. [2025-10-02T18:51:42.066214] [DEBUG] [LOCAL ] EVTC: Saving primary data. [2025-10-02T18:51:42.071062] [DEBUG] [LOCAL ] EVTC: Trimmed 38002 records to 26492 (keeping 200 days of data) [2025-10-02T18:51:42.198780] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-02T18:51:42.361213] [DEBUG] [LOCAL ] EVTC: Primary data saved (26492 records). [2025-10-02T18:51:42.362207] [INFO ] [MAIN ] EVTC: Full history saved. [2025-10-02T18:51:42.363418] [INFO ] [MAIN ] Update Progress: 794/2370 symbols completed. EVTC took 36.6s. Estimated remaining: 3h 41m 36s. Rate: 7.1 symbols/min [2025-10-02T18:51:42.559179] [INFO ] [MAIN ] EXG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:51:42.570748] [DEBUG] [LOCAL ] EVTL: Primary data saved (38644 records). [2025-10-02T18:51:42.570889] [INFO ] [MAIN ] EVTL: Full history saved. [2025-10-02T18:51:42.571456] [INFO ] [MAIN ] Update Progress: 795/2370 symbols completed. EVTL took 33.2s. Estimated remaining: 3h 41m 11s. Rate: 7.1 symbols/min [2025-10-02T18:51:42.682439] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-07. [2025-10-02T18:51:42.766955] [DEBUG] [LOCAL ] EXG: Loaded 34113 existing records from primary storage. [2025-10-02T18:51:42.786985] [INFO ] [MAIN ] EXK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:51:42.787401] [INFO ] [MAIN ] EXG: Loaded 34113 existing records. [2025-10-02T18:51:43.006267] [WARN ] [MAIN ] EXG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:51:43.006532] [INFO ] [MAIN ] EXG: Wiping existing primary data before full refresh. [2025-10-02T18:51:43.006585] [INFO ] [LOCAL ] EXG: Starting deletion of primary data. [2025-10-02T18:51:43.007829] [DEBUG] [LOCAL ] EXG: Deleted primary data file. [2025-10-02T18:51:43.007897] [INFO ] [MAIN ] EXG: Starting full primary refresh. [2025-10-02T18:51:43.165856] [DEBUG] [LOCAL ] EXK: Loaded 53136 existing records from primary storage. [2025-10-02T18:51:43.200217] [INFO ] [MAIN ] EXK: Loaded 53136 existing records. [2025-10-02T18:51:43.644266] [INFO ] [REMOTE ] EXG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:51:43.645107] [INFO ] [REMOTE ] EXG: Fetching primary data for 2024-12. [2025-10-02T18:51:43.640183] [WARN ] [MAIN ] EXK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:51:43.645480] [INFO ] [MAIN ] EXK: Wiping existing primary data before full refresh. [2025-10-02T18:51:43.646497] [INFO ] [LOCAL ] EXK: Starting deletion of primary data. [2025-10-02T18:51:43.647992] [DEBUG] [LOCAL ] EXK: Deleted primary data file. [2025-10-02T18:51:43.648060] [INFO ] [MAIN ] EXK: Starting full primary refresh. [2025-10-02T18:51:44.091148] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-02T18:51:44.097021] [INFO ] [REMOTE ] EXK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:51:44.125350] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-10-02T18:51:44.272984] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-08. [2025-10-02T18:51:45.000991] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-02T18:51:45.073025] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-01. [2025-10-02T18:51:45.438742] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-02T18:51:45.873039] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-09. [2025-10-02T18:51:46.078206] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-02T18:51:46.673027] [INFO ] [REMOTE ] EXK: Fetching primary data for 2024-12. [2025-10-02T18:51:47.217407] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-02T18:51:47.473006] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-02. [2025-10-02T18:51:48.273110] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-07. [2025-10-02T18:51:48.444735] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-02T18:51:48.838290] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-02T18:51:49.073037] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-10. [2025-10-02T18:51:49.724420] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-02T18:51:49.873062] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-03. [2025-10-02T18:51:50.081283] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-02T18:51:50.083440] [INFO ] [REMOTE ] EVTR: Full fetch complete (32535 records). [2025-10-02T18:51:50.083594] [DEBUG] [VALIDATOR ] EVTR: Validating primary data. [2025-10-02T18:51:50.629401] [DEBUG] [VALIDATOR ] EVTR: All expected trading days are present. [2025-10-02T18:51:50.629511] [DEBUG] [VALIDATOR ] EVTR: Primary data validation passed. [2025-10-02T18:51:50.630397] [INFO ] [MAIN ] EVTR: Fetched primary data is valid. [2025-10-02T18:51:50.630468] [DEBUG] [LOCAL ] EVTR: Saving primary data. [2025-10-02T18:51:50.631600] [DEBUG] [LOCAL ] EVTR: Trimmed 32535 records to 23911 (keeping 200 days of data) [2025-10-02T18:51:50.691637] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-01. [2025-10-02T18:51:50.805289] [DEBUG] [LOCAL ] EVTR: Primary data saved (23911 records). [2025-10-02T18:51:50.805449] [INFO ] [MAIN ] EVTR: Full history saved. [2025-10-02T18:51:50.805612] [INFO ] [MAIN ] Update Progress: 796/2370 symbols completed. EVTR took 31.3s. Estimated remaining: 3h 41m 2s. Rate: 7.1 symbols/min [2025-10-02T18:51:51.017627] [INFO ] [MAIN ] EXP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:51:51.054500] [DEBUG] [LOCAL ] EXP: Loaded 29652 existing records from primary storage. [2025-10-02T18:51:51.054808] [INFO ] [MAIN ] EXP: Loaded 29652 existing records. [2025-10-02T18:51:51.259943] [WARN ] [MAIN ] EXP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:51:51.260227] [INFO ] [MAIN ] EXP: Wiping existing primary data before full refresh. [2025-10-02T18:51:51.260301] [INFO ] [LOCAL ] EXP: Starting deletion of primary data. [2025-10-02T18:51:51.271582] [DEBUG] [LOCAL ] EXP: Deleted primary data file. [2025-10-02T18:51:51.290761] [INFO ] [MAIN ] EXP: Starting full primary refresh. [2025-10-02T18:51:51.298153] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-02T18:51:51.499406] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-04. [2025-10-02T18:51:51.710983] [INFO ] [REMOTE ] EXP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:51:52.272967] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-08. [2025-10-02T18:51:52.478023] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-02T18:51:53.072972] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-02. [2025-10-02T18:51:53.138800] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-02T18:51:53.703274] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-02T18:51:53.873049] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-05. [2025-10-02T18:51:54.673033] [INFO ] [REMOTE ] EXP: Fetching primary data for 2024-12. [2025-10-02T18:51:54.717928] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-02T18:51:54.813834] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-02T18:51:55.473027] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-03. [2025-10-02T18:51:55.996301] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-02T18:51:56.273026] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-06. [2025-10-02T18:51:57.073042] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-09. [2025-10-02T18:51:57.453384] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-02T18:51:57.699216] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-02T18:51:57.873037] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-01. [2025-10-02T18:51:58.673010] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-07. [2025-10-02T18:51:59.023603] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-02T18:51:59.163797] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-02T18:51:59.473024] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-02. [2025-10-02T18:52:00.105511] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-02T18:52:00.273053] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-04. [2025-10-02T18:52:00.723449] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-02T18:52:01.073000] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-03. [2025-10-02T18:52:01.852809] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-02T18:52:01.872964] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-05. [2025-10-02T18:52:02.473588] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-02T18:52:02.673045] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-04. [2025-10-02T18:52:03.473060] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-10. [2025-10-02T18:52:03.695602] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-02T18:52:04.016001] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-02T18:52:04.273046] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-08. [2025-10-02T18:52:05.032507] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-02T18:52:05.034867] [INFO ] [REMOTE ] EW: Full fetch complete (77350 records). [2025-10-02T18:52:05.035003] [DEBUG] [VALIDATOR ] EW: Validating primary data. [2025-10-02T18:52:05.078197] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-05. [2025-10-02T18:52:05.515554] [DEBUG] [VALIDATOR ] EW: All expected trading days are present. [2025-10-02T18:52:05.516513] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-02T18:52:05.516773] [DEBUG] [VALIDATOR ] EW: Primary data validation passed. [2025-10-02T18:52:05.524847] [INFO ] [MAIN ] EW: Fetched primary data is valid. [2025-10-02T18:52:05.525420] [DEBUG] [LOCAL ] EW: Saving primary data. [2025-10-02T18:52:05.527352] [DEBUG] [LOCAL ] EW: Trimmed 77350 records to 53791 (keeping 200 days of data) [2025-10-02T18:52:05.870064] [DEBUG] [LOCAL ] EW: Primary data saved (53791 records). [2025-10-02T18:52:05.870241] [INFO ] [MAIN ] EW: Full history saved. [2025-10-02T18:52:05.870345] [INFO ] [MAIN ] Update Progress: 797/2370 symbols completed. EW took 46.3s. Estimated remaining: 3h 41m 7s. Rate: 7.1 symbols/min [2025-10-02T18:52:05.872971] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-09. [2025-10-02T18:52:06.223813] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-02T18:52:06.673014] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-06. [2025-10-02T18:52:07.134991] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-02T18:52:07.473041] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-10. [2025-10-02T18:52:08.063739] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-02T18:52:08.273009] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-06. [2025-10-02T18:52:08.578099] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-02T18:52:08.579684] [INFO ] [REMOTE ] EXG: Full fetch complete (49955 records). [2025-10-02T18:52:08.579771] [DEBUG] [VALIDATOR ] EXG: Validating primary data. [2025-10-02T18:52:09.007810] [DEBUG] [VALIDATOR ] EXG: All expected trading days are present. [2025-10-02T18:52:09.007902] [DEBUG] [VALIDATOR ] EXG: Primary data validation passed. [2025-10-02T18:52:09.008698] [INFO ] [MAIN ] EXG: Fetched primary data is valid. [2025-10-02T18:52:09.008765] [DEBUG] [LOCAL ] EXG: Saving primary data. [2025-10-02T18:52:09.009950] [DEBUG] [LOCAL ] EXG: Trimmed 49955 records to 34342 (keeping 200 days of data) [2025-10-02T18:52:09.096322] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-07. [2025-10-02T18:52:09.227174] [DEBUG] [LOCAL ] EXG: Primary data saved (34342 records). [2025-10-02T18:52:09.227331] [INFO ] [MAIN ] EXG: Full history saved. [2025-10-02T18:52:09.227441] [INFO ] [MAIN ] Update Progress: 798/2370 symbols completed. EXG took 26.9s. Estimated remaining: 3h 40m 49s. Rate: 7.1 symbols/min [2025-10-02T18:52:10.173780] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-02T18:52:10.185728] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-07. [2025-10-02T18:52:10.462807] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-02T18:52:10.673050] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-08. [2025-10-02T18:52:12.021788] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-02T18:52:12.030408] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-09. [2025-10-02T18:52:12.172673] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-02T18:52:12.273078] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-08. [2025-10-02T18:52:13.217932] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-02T18:52:13.227513] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-10. [2025-10-02T18:52:14.032875] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-02T18:52:14.045182] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-09. [2025-10-02T18:52:14.204738] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-02T18:52:14.206213] [INFO ] [REMOTE ] EXP: Full fetch complete (42884 records). [2025-10-02T18:52:14.206309] [DEBUG] [VALIDATOR ] EXP: Validating primary data. [2025-10-02T18:52:14.622749] [DEBUG] [VALIDATOR ] EXP: All expected trading days are present. [2025-10-02T18:52:14.622889] [DEBUG] [VALIDATOR ] EXP: Primary data validation passed. [2025-10-02T18:52:14.623602] [INFO ] [MAIN ] EXP: Fetched primary data is valid. [2025-10-02T18:52:14.623676] [DEBUG] [LOCAL ] EXP: Saving primary data. [2025-10-02T18:52:14.624886] [DEBUG] [LOCAL ] EXP: Trimmed 42884 records to 29797 (keeping 200 days of data) [2025-10-02T18:52:14.824435] [DEBUG] [LOCAL ] EXP: Primary data saved (29797 records). [2025-10-02T18:52:14.824577] [INFO ] [MAIN ] EXP: Full history saved. [2025-10-02T18:52:14.824679] [INFO ] [MAIN ] Update Progress: 799/2370 symbols completed. EXP took 24.0s. Estimated remaining: 3h 40m 35s. Rate: 7.1 symbols/min [2025-10-02T18:52:15.958815] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-02T18:52:15.975089] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-10. [2025-10-02T18:52:17.558765] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-02T18:52:17.560847] [INFO ] [REMOTE ] EXK: Full fetch complete (76542 records). [2025-10-02T18:52:17.560959] [DEBUG] [VALIDATOR ] EXK: Validating primary data. [2025-10-02T18:52:17.981558] [DEBUG] [VALIDATOR ] EXK: All expected trading days are present. [2025-10-02T18:52:17.981664] [DEBUG] [VALIDATOR ] EXK: Primary data validation passed. [2025-10-02T18:52:17.982557] [INFO ] [MAIN ] EXK: Fetched primary data is valid. [2025-10-02T18:52:17.982606] [DEBUG] [LOCAL ] EXK: Saving primary data. [2025-10-02T18:52:17.984075] [DEBUG] [LOCAL ] EXK: Trimmed 76542 records to 53526 (keeping 200 days of data) [2025-10-02T18:52:18.306137] [DEBUG] [LOCAL ] EXK: Primary data saved (53526 records). [2025-10-02T18:52:18.306333] [INFO ] [MAIN ] EXK: Full history saved. [2025-10-02T18:52:18.306555] [INFO ] [MAIN ] Update Progress: 800/2370 symbols completed. EXK took 35.7s. Estimated remaining: 3h 40m 16s. Rate: 7.1 symbols/min [2025-10-02T18:52:18.907209] [INFO ] [MAIN ] EXR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:52:19.050619] [INFO ] [MAIN ] F: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:52:19.056585] [INFO ] [MAIN ] EXPD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:52:19.094170] [INFO ] [MAIN ] FAF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:52:19.188853] [DEBUG] [LOCAL ] F: Loaded 53820 existing records from primary storage. [2025-10-02T18:52:19.216098] [DEBUG] [LOCAL ] EXR: Loaded 45268 existing records from primary storage. [2025-10-02T18:52:19.214760] [DEBUG] [LOCAL ] FAF: Loaded 41688 existing records from primary storage. [2025-10-02T18:52:19.214960] [INFO ] [MAIN ] F: Loaded 53820 existing records. [2025-10-02T18:52:19.216470] [INFO ] [MAIN ] EXR: Loaded 45268 existing records. [2025-10-02T18:52:19.217319] [INFO ] [MAIN ] FAF: Loaded 41688 existing records. [2025-10-02T18:52:19.370098] [DEBUG] [LOCAL ] EXPD: Loaded 47959 existing records from primary storage. [2025-10-02T18:52:19.444701] [INFO ] [MAIN ] EXPD: Loaded 47959 existing records. [2025-10-02T18:52:19.866001] [WARN ] [MAIN ] EXR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:52:19.974483] [WARN ] [MAIN ] F: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:52:19.982108] [INFO ] [MAIN ] EXR: Wiping existing primary data before full refresh. [2025-10-02T18:52:19.981740] [WARN ] [MAIN ] FAF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:52:19.992826] [INFO ] [LOCAL ] EXR: Starting deletion of primary data. [2025-10-02T18:52:19.992743] [INFO ] [MAIN ] FAF: Wiping existing primary data before full refresh. [2025-10-02T18:52:20.013832] [DEBUG] [LOCAL ] EXR: Deleted primary data file. [2025-10-02T18:52:20.013912] [INFO ] [LOCAL ] FAF: Starting deletion of primary data. [2025-10-02T18:52:20.013713] [INFO ] [MAIN ] F: Wiping existing primary data before full refresh. [2025-10-02T18:52:20.026536] [DEBUG] [LOCAL ] FAF: Deleted primary data file. [2025-10-02T18:52:20.031914] [INFO ] [MAIN ] FAF: Starting full primary refresh. [2025-10-02T18:52:20.032021] [INFO ] [LOCAL ] F: Starting deletion of primary data. [2025-10-02T18:52:20.026673] [INFO ] [MAIN ] EXR: Starting full primary refresh. [2025-10-02T18:52:20.051348] [DEBUG] [LOCAL ] F: Deleted primary data file. [2025-10-02T18:52:20.105795] [WARN ] [MAIN ] EXPD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:52:20.194709] [INFO ] [MAIN ] EXPD: Wiping existing primary data before full refresh. [2025-10-02T18:52:20.200886] [INFO ] [LOCAL ] EXPD: Starting deletion of primary data. [2025-10-02T18:52:20.153793] [INFO ] [MAIN ] F: Starting full primary refresh. [2025-10-02T18:52:20.331438] [DEBUG] [LOCAL ] EXPD: Deleted primary data file. [2025-10-02T18:52:20.367537] [INFO ] [MAIN ] EXPD: Starting full primary refresh. [2025-10-02T18:52:21.376145] [INFO ] [REMOTE ] EXR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:52:21.493885] [INFO ] [REMOTE ] EXR: Fetching primary data for 2024-12. [2025-10-02T18:52:21.554290] [INFO ] [REMOTE ] FAF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:52:21.607069] [INFO ] [REMOTE ] FAF: Fetching primary data for 2024-12. [2025-10-02T18:52:21.634664] [INFO ] [REMOTE ] F: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:52:21.668242] [INFO ] [REMOTE ] F: Fetching primary data for 2024-12. [2025-10-02T18:52:21.756926] [INFO ] [REMOTE ] EXPD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:52:21.757251] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2024-12. [2025-10-02T18:52:23.018937] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-02T18:52:23.026805] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-01. [2025-10-02T18:52:23.068298] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-02T18:52:23.078617] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-01. [2025-10-02T18:52:23.143551] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-02T18:52:23.153115] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-01. [2025-10-02T18:52:23.932303] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-02T18:52:23.939976] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-02. [2025-10-02T18:52:23.985695] [INFO ] [REMOTE ] F: Incremental fetch complete for 2024-12 (2.32 seconds). [2025-10-02T18:52:23.997459] [INFO ] [REMOTE ] F: Fetching primary data for 2025-01. [2025-10-02T18:52:24.609585] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-02T18:52:24.620136] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-02. [2025-10-02T18:52:24.804131] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-02T18:52:24.814945] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-02. [2025-10-02T18:52:24.906927] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-02T18:52:24.914289] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-03. [2025-10-02T18:52:25.909710] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-02T18:52:25.920098] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-03. [2025-10-02T18:52:26.295269] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-02T18:52:26.304548] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-03. [2025-10-02T18:52:26.379547] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-02T18:52:26.450028] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-01 (2.45 seconds). [2025-10-02T18:52:26.673017] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-04. [2025-10-02T18:52:27.386400] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-02T18:52:27.472990] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-04. [2025-10-02T18:52:27.955069] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-02T18:52:28.034379] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-02T18:52:28.273042] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-05. [2025-10-02T18:52:29.073028] [INFO ] [REMOTE ] F: Fetching primary data for 2025-02. [2025-10-02T18:52:29.175716] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-02T18:52:29.507911] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-02T18:52:29.872995] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-06. [2025-10-02T18:52:30.673006] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-04. [2025-10-02T18:52:31.351295] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-02T18:52:31.486228] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-05. [2025-10-02T18:52:31.494196] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-02 (2.42 seconds). [2025-10-02T18:52:32.272973] [INFO ] [REMOTE ] F: Fetching primary data for 2025-03. [2025-10-02T18:52:32.364199] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-02T18:52:33.072996] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-05. [2025-10-02T18:52:33.314829] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-02T18:52:33.873004] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-07. [2025-10-02T18:52:34.676082] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-06. [2025-10-02T18:52:34.681383] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-02T18:52:34.796753] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-03 (2.52 seconds). [2025-10-02T18:52:35.243973] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-02T18:52:35.473001] [INFO ] [REMOTE ] F: Fetching primary data for 2025-04. [2025-10-02T18:52:35.882268] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-02T18:52:36.273012] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-08. [2025-10-02T18:52:37.072992] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-07. [2025-10-02T18:52:37.635081] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-02T18:52:37.873003] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-06. [2025-10-02T18:52:37.984434] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-04 (2.51 seconds). [2025-10-02T18:52:38.673087] [INFO ] [REMOTE ] F: Fetching primary data for 2025-05. [2025-10-02T18:52:38.741504] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-02T18:52:39.423544] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-02T18:52:39.473001] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-07. [2025-10-02T18:52:40.273043] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-08. [2025-10-02T18:52:41.072975] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-09. [2025-10-02T18:52:41.155685] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-02T18:52:41.209104] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-05 (2.54 seconds). [2025-10-02T18:52:41.795336] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-02T18:52:41.873003] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-08. [2025-10-02T18:52:42.601838] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-02T18:52:42.673037] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-10. [2025-10-02T18:52:43.478134] [INFO ] [REMOTE ] F: Fetching primary data for 2025-06. [2025-10-02T18:52:43.496696] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-02T18:52:43.872273] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-02T18:52:43.873870] [INFO ] [REMOTE ] FAF: Full fetch complete (57628 records). [2025-10-02T18:52:43.873986] [DEBUG] [VALIDATOR ] FAF: Validating primary data. [2025-10-02T18:52:44.282300] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-09. [2025-10-02T18:52:44.305223] [DEBUG] [VALIDATOR ] FAF: All expected trading days are present. [2025-10-02T18:52:44.305292] [DEBUG] [VALIDATOR ] FAF: Primary data validation passed. [2025-10-02T18:52:44.306054] [INFO ] [MAIN ] FAF: Fetched primary data is valid. [2025-10-02T18:52:44.306237] [DEBUG] [LOCAL ] FAF: Saving primary data. [2025-10-02T18:52:44.307960] [DEBUG] [LOCAL ] FAF: Trimmed 57628 records to 41936 (keeping 200 days of data) [2025-10-02T18:52:44.579058] [DEBUG] [LOCAL ] FAF: Primary data saved (41936 records). [2025-10-02T18:52:44.579212] [INFO ] [MAIN ] FAF: Full history saved. [2025-10-02T18:52:44.580916] [INFO ] [MAIN ] Update Progress: 801/2370 symbols completed. FAF took 26.2s. Estimated remaining: 3h 40m 43s. Rate: 7.1 symbols/min [2025-10-02T18:52:44.822966] [INFO ] [MAIN ] FBIN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:52:44.878870] [DEBUG] [LOCAL ] FBIN: Loaded 50327 existing records from primary storage. [2025-10-02T18:52:44.879195] [INFO ] [MAIN ] FBIN: Loaded 50327 existing records. [2025-10-02T18:52:45.067746] [WARN ] [MAIN ] FBIN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:52:45.067974] [INFO ] [MAIN ] FBIN: Wiping existing primary data before full refresh. [2025-10-02T18:52:45.068024] [INFO ] [LOCAL ] FBIN: Starting deletion of primary data. [2025-10-02T18:52:45.070768] [DEBUG] [LOCAL ] FBIN: Deleted primary data file. [2025-10-02T18:52:45.070841] [INFO ] [MAIN ] FBIN: Starting full primary refresh. [2025-10-02T18:52:45.104836] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-09. [2025-10-02T18:52:45.463265] [INFO ] [REMOTE ] FBIN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:52:45.866265] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-06 (2.39 seconds). [2025-10-02T18:52:45.877429] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2024-12. [2025-10-02T18:52:45.930193] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-02T18:52:46.365911] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-02T18:52:46.673010] [INFO ] [REMOTE ] F: Fetching primary data for 2025-07. [2025-10-02T18:52:47.442337] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-02T18:52:47.472992] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-01. [2025-10-02T18:52:48.273040] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-10. [2025-10-02T18:52:49.031979] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-02T18:52:49.072999] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-02. [2025-10-02T18:52:49.138802] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-10-02T18:52:49.351560] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-02T18:52:49.354381] [INFO ] [REMOTE ] EXPD: Full fetch complete (69316 records). [2025-10-02T18:52:49.354608] [DEBUG] [VALIDATOR ] EXPD: Validating primary data. [2025-10-02T18:52:49.801873] [DEBUG] [VALIDATOR ] EXPD: All expected trading days are present. [2025-10-02T18:52:49.801966] [DEBUG] [VALIDATOR ] EXPD: Primary data validation passed. [2025-10-02T18:52:49.802947] [INFO ] [MAIN ] EXPD: Fetched primary data is valid. [2025-10-02T18:52:49.803017] [DEBUG] [LOCAL ] EXPD: Saving primary data. [2025-10-02T18:52:49.804478] [DEBUG] [LOCAL ] EXPD: Trimmed 69316 records to 48284 (keeping 200 days of data) [2025-10-02T18:52:49.877633] [INFO ] [REMOTE ] F: Fetching primary data for 2025-08. [2025-10-02T18:52:50.134917] [DEBUG] [LOCAL ] EXPD: Primary data saved (48284 records). [2025-10-02T18:52:50.135070] [INFO ] [MAIN ] EXPD: Full history saved. [2025-10-02T18:52:50.135157] [INFO ] [MAIN ] Update Progress: 802/2370 symbols completed. EXPD took 31.8s. Estimated remaining: 3h 40m 29s. Rate: 7.1 symbols/min [2025-10-02T18:52:50.336480] [INFO ] [MAIN ] FBK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:52:50.367200] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-02T18:52:50.401100] [DEBUG] [LOCAL ] FBK: Loaded 26076 existing records from primary storage. [2025-10-02T18:52:50.401544] [INFO ] [MAIN ] FBK: Loaded 26076 existing records. [2025-10-02T18:52:50.597672] [WARN ] [MAIN ] FBK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:52:50.597919] [INFO ] [MAIN ] FBK: Wiping existing primary data before full refresh. [2025-10-02T18:52:50.597980] [INFO ] [LOCAL ] FBK: Starting deletion of primary data. [2025-10-02T18:52:50.598965] [DEBUG] [LOCAL ] FBK: Deleted primary data file. [2025-10-02T18:52:50.599036] [INFO ] [MAIN ] FBK: Starting full primary refresh. [2025-10-02T18:52:50.678199] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-10. [2025-10-02T18:52:51.017541] [INFO ] [REMOTE ] FBK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:52:51.473067] [INFO ] [REMOTE ] FBK: Fetching primary data for 2024-12. [2025-10-02T18:52:52.034179] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-02T18:52:52.089871] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-02T18:52:52.092827] [INFO ] [REMOTE ] EXR: Full fetch complete (65898 records). [2025-10-02T18:52:52.092991] [DEBUG] [VALIDATOR ] EXR: Validating primary data. [2025-10-02T18:52:52.218586] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-02T18:52:52.280999] [INFO ] [REMOTE ] F: Fetching primary data for 2025-09. [2025-10-02T18:52:52.532142] [DEBUG] [VALIDATOR ] EXR: All expected trading days are present. [2025-10-02T18:52:52.532230] [DEBUG] [VALIDATOR ] EXR: Primary data validation passed. [2025-10-02T18:52:52.533048] [INFO ] [MAIN ] EXR: Fetched primary data is valid. [2025-10-02T18:52:52.533114] [DEBUG] [LOCAL ] EXR: Saving primary data. [2025-10-02T18:52:52.534525] [DEBUG] [LOCAL ] EXR: Trimmed 65898 records to 45592 (keeping 200 days of data) [2025-10-02T18:52:52.843500] [DEBUG] [LOCAL ] EXR: Primary data saved (45592 records). [2025-10-02T18:52:52.843636] [INFO ] [MAIN ] EXR: Full history saved. [2025-10-02T18:52:52.843761] [INFO ] [MAIN ] Update Progress: 803/2370 symbols completed. EXR took 34.5s. Estimated remaining: 3h 40m 9s. Rate: 7.1 symbols/min [2025-10-02T18:52:53.019205] [INFO ] [MAIN ] FBP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:52:53.069304] [DEBUG] [LOCAL ] FBP: Loaded 45961 existing records from primary storage. [2025-10-02T18:52:53.069610] [INFO ] [MAIN ] FBP: Loaded 45961 existing records. [2025-10-02T18:52:53.080933] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-01. [2025-10-02T18:52:53.265526] [WARN ] [MAIN ] FBP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:52:53.265793] [INFO ] [MAIN ] FBP: Wiping existing primary data before full refresh. [2025-10-02T18:52:53.265853] [INFO ] [LOCAL ] FBP: Starting deletion of primary data. [2025-10-02T18:52:53.267396] [DEBUG] [LOCAL ] FBP: Deleted primary data file. [2025-10-02T18:52:53.267464] [INFO ] [MAIN ] FBP: Starting full primary refresh. [2025-10-02T18:52:53.642532] [INFO ] [REMOTE ] FBP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:52:53.873001] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-03. [2025-10-02T18:52:54.212269] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-02T18:52:54.673034] [INFO ] [REMOTE ] FBP: Fetching primary data for 2024-12. [2025-10-02T18:52:54.803836] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-10-02T18:52:55.472977] [INFO ] [REMOTE ] F: Fetching primary data for 2025-10. [2025-10-02T18:52:55.603826] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-02T18:52:56.130503] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-02T18:52:56.273041] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-01. [2025-10-02T18:52:57.073047] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-02. [2025-10-02T18:52:57.782164] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-10 (2.31 seconds). [2025-10-02T18:52:57.799209] [INFO ] [REMOTE ] F: Full fetch complete (77999 records). [2025-10-02T18:52:57.817188] [DEBUG] [VALIDATOR ] F: Validating primary data. [2025-10-02T18:52:57.829115] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-02T18:52:57.830418] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-02T18:52:57.878105] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-03. [2025-10-02T18:52:58.269533] [DEBUG] [VALIDATOR ] F: All expected trading days are present. [2025-10-02T18:52:58.269620] [DEBUG] [VALIDATOR ] F: Primary data validation passed. [2025-10-02T18:52:58.270598] [INFO ] [MAIN ] F: Fetched primary data is valid. [2025-10-02T18:52:58.270688] [DEBUG] [LOCAL ] F: Saving primary data. [2025-10-02T18:52:58.272185] [DEBUG] [LOCAL ] F: Trimmed 77999 records to 54210 (keeping 200 days of data) [2025-10-02T18:52:58.629703] [DEBUG] [LOCAL ] F: Primary data saved (54210 records). [2025-10-02T18:52:58.629848] [INFO ] [MAIN ] F: Full history saved. [2025-10-02T18:52:58.629937] [INFO ] [MAIN ] Update Progress: 804/2370 symbols completed. F took 40.3s. Estimated remaining: 3h 39m 56s. Rate: 7.1 symbols/min [2025-10-02T18:52:58.678187] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-04. [2025-10-02T18:52:58.820424] [INFO ] [MAIN ] FBRT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:52:58.859681] [DEBUG] [LOCAL ] FBRT: Loaded 34730 existing records from primary storage. [2025-10-02T18:52:58.860039] [INFO ] [MAIN ] FBRT: Loaded 34730 existing records. [2025-10-02T18:52:59.002574] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-02T18:52:59.070361] [WARN ] [MAIN ] FBRT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:52:59.070563] [INFO ] [MAIN ] FBRT: Wiping existing primary data before full refresh. [2025-10-02T18:52:59.070633] [INFO ] [LOCAL ] FBRT: Starting deletion of primary data. [2025-10-02T18:52:59.072103] [DEBUG] [LOCAL ] FBRT: Deleted primary data file. [2025-10-02T18:52:59.072165] [INFO ] [MAIN ] FBRT: Starting full primary refresh. [2025-10-02T18:52:59.453327] [INFO ] [REMOTE ] FBRT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:52:59.472971] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-02. [2025-10-02T18:53:00.264864] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-02T18:53:00.276087] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2024-12. [2025-10-02T18:53:01.031877] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-02T18:53:01.072992] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-03. [2025-10-02T18:53:01.703213] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-02T18:53:01.873039] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-05. [2025-10-02T18:53:02.432461] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-02T18:53:02.673032] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-04. [2025-10-02T18:53:03.312097] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-02T18:53:03.473007] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-06. [2025-10-02T18:53:03.702529] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-02T18:53:04.273058] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-05. [2025-10-02T18:53:05.072980] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-04. [2025-10-02T18:53:05.190724] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-02T18:53:05.240462] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-02T18:53:05.872992] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-07. [2025-10-02T18:53:06.673006] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-06. [2025-10-02T18:53:06.958592] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-02T18:53:07.448137] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-02T18:53:07.472982] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-07. [2025-10-02T18:53:07.629106] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-02T18:53:08.273036] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-01. [2025-10-02T18:53:08.999585] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-02T18:53:09.073028] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-08. [2025-10-02T18:53:09.639111] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-02T18:53:09.873008] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-08. [2025-10-02T18:53:10.673025] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-05. [2025-10-02T18:53:10.788386] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-02T18:53:11.051292] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-02T18:53:11.472980] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-09. [2025-10-02T18:53:12.259400] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-02T18:53:12.272965] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-06. [2025-10-02T18:53:12.601039] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-02T18:53:13.072996] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-10. [2025-10-02T18:53:13.750982] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-02T18:53:13.872998] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-07. [2025-10-02T18:53:14.031582] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-02T18:53:14.033104] [INFO ] [REMOTE ] FBK: Full fetch complete (33663 records). [2025-10-02T18:53:14.033186] [DEBUG] [VALIDATOR ] FBK: Validating primary data. [2025-10-02T18:53:14.437028] [DEBUG] [VALIDATOR ] FBK: All expected trading days are present. [2025-10-02T18:53:14.437110] [DEBUG] [VALIDATOR ] FBK: Primary data validation passed. [2025-10-02T18:53:14.437748] [INFO ] [MAIN ] FBK: Fetched primary data is valid. [2025-10-02T18:53:14.437816] [DEBUG] [LOCAL ] FBK: Saving primary data. [2025-10-02T18:53:14.438881] [DEBUG] [LOCAL ] FBK: Trimmed 33663 records to 26281 (keeping 200 days of data) [2025-10-02T18:53:14.611476] [DEBUG] [LOCAL ] FBK: Primary data saved (26281 records). [2025-10-02T18:53:14.611625] [INFO ] [MAIN ] FBK: Full history saved. [2025-10-02T18:53:14.611760] [INFO ] [MAIN ] Update Progress: 805/2370 symbols completed. FBK took 24.5s. Estimated remaining: 3h 40m 2s. Rate: 7.1 symbols/min [2025-10-02T18:53:14.680259] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-09. [2025-10-02T18:53:14.801835] [INFO ] [MAIN ] FC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:53:14.819087] [DEBUG] [LOCAL ] FC: Loaded 15437 existing records from primary storage. [2025-10-02T18:53:14.819353] [INFO ] [MAIN ] FC: Loaded 15437 existing records. [2025-10-02T18:53:15.020142] [WARN ] [MAIN ] FC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:53:15.020403] [INFO ] [MAIN ] FC: Wiping existing primary data before full refresh. [2025-10-02T18:53:15.020459] [INFO ] [LOCAL ] FC: Starting deletion of primary data. [2025-10-02T18:53:15.021004] [DEBUG] [LOCAL ] FC: Deleted primary data file. [2025-10-02T18:53:15.021067] [INFO ] [MAIN ] FC: Starting full primary refresh. [2025-10-02T18:53:15.430903] [INFO ] [REMOTE ] FC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:53:15.472984] [INFO ] [REMOTE ] FC: Fetching primary data for 2024-12. [2025-10-02T18:53:15.569817] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-02T18:53:16.273037] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-08. [2025-10-02T18:53:16.316031] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-02T18:53:16.335556] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-02T18:53:17.073042] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-10. [2025-10-02T18:53:17.873026] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-02. [2025-10-02T18:53:17.908264] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-02T18:53:18.459239] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-02T18:53:18.461254] [INFO ] [REMOTE ] FBIN: Full fetch complete (72588 records). [2025-10-02T18:53:18.461361] [DEBUG] [VALIDATOR ] FBIN: Validating primary data. [2025-10-02T18:53:18.683009] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-09. [2025-10-02T18:53:18.889471] [DEBUG] [VALIDATOR ] FBIN: All expected trading days are present. [2025-10-02T18:53:18.889698] [DEBUG] [VALIDATOR ] FBIN: Primary data validation passed. [2025-10-02T18:53:18.890707] [INFO ] [MAIN ] FBIN: Fetched primary data is valid. [2025-10-02T18:53:18.890855] [DEBUG] [LOCAL ] FBIN: Saving primary data. [2025-10-02T18:53:18.909299] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-02T18:53:18.916291] [DEBUG] [LOCAL ] FBIN: Trimmed 72588 records to 50693 (keeping 200 days of data) [2025-10-02T18:53:19.268165] [DEBUG] [LOCAL ] FBIN: Primary data saved (50693 records). [2025-10-02T18:53:19.268316] [INFO ] [MAIN ] FBIN: Full history saved. [2025-10-02T18:53:19.269384] [INFO ] [MAIN ] Update Progress: 806/2370 symbols completed. FBIN took 34.7s. Estimated remaining: 3h 39m 46s. Rate: 7.1 symbols/min [2025-10-02T18:53:19.452258] [INFO ] [MAIN ] FCF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:53:19.478912] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-01. [2025-10-02T18:53:19.500134] [DEBUG] [LOCAL ] FCF: Loaded 39411 existing records from primary storage. [2025-10-02T18:53:19.500487] [INFO ] [MAIN ] FCF: Loaded 39411 existing records. [2025-10-02T18:53:19.696093] [WARN ] [MAIN ] FCF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:53:19.696305] [INFO ] [MAIN ] FCF: Wiping existing primary data before full refresh. [2025-10-02T18:53:19.696353] [INFO ] [LOCAL ] FCF: Starting deletion of primary data. [2025-10-02T18:53:19.698044] [DEBUG] [LOCAL ] FCF: Deleted primary data file. [2025-10-02T18:53:19.698127] [INFO ] [MAIN ] FCF: Starting full primary refresh. [2025-10-02T18:53:20.100580] [INFO ] [REMOTE ] FCF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:53:20.200373] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-02T18:53:20.273021] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-10. [2025-10-02T18:53:20.472958] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-02T18:53:21.073001] [INFO ] [REMOTE ] FCF: Fetching primary data for 2024-12. [2025-10-02T18:53:21.575310] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-02T18:53:21.577451] [INFO ] [REMOTE ] FBP: Full fetch complete (66364 records). [2025-10-02T18:53:21.577637] [DEBUG] [VALIDATOR ] FBP: Validating primary data. [2025-10-02T18:53:21.878206] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-03. [2025-10-02T18:53:22.022847] [DEBUG] [VALIDATOR ] FBP: All expected trading days are present. [2025-10-02T18:53:22.022929] [DEBUG] [VALIDATOR ] FBP: Primary data validation passed. [2025-10-02T18:53:22.023812] [INFO ] [MAIN ] FBP: Fetched primary data is valid. [2025-10-02T18:53:22.023880] [DEBUG] [LOCAL ] FBP: Saving primary data. [2025-10-02T18:53:22.025336] [DEBUG] [LOCAL ] FBP: Trimmed 66364 records to 46270 (keeping 200 days of data) [2025-10-02T18:53:22.321752] [DEBUG] [LOCAL ] FBP: Primary data saved (46270 records). [2025-10-02T18:53:22.322055] [INFO ] [MAIN ] FBP: Full history saved. [2025-10-02T18:53:22.322235] [INFO ] [MAIN ] Update Progress: 807/2370 symbols completed. FBP took 29.5s. Estimated remaining: 3h 39m 27s. Rate: 7.1 symbols/min [2025-10-02T18:53:22.533378] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-02T18:53:22.531465] [INFO ] [MAIN ] FCN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:53:22.571593] [DEBUG] [LOCAL ] FCN: Loaded 25935 existing records from primary storage. [2025-10-02T18:53:22.571929] [INFO ] [MAIN ] FCN: Loaded 25935 existing records. [2025-10-02T18:53:22.682037] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-01. [2025-10-02T18:53:22.771967] [WARN ] [MAIN ] FCN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:53:22.772242] [INFO ] [MAIN ] FCN: Wiping existing primary data before full refresh. [2025-10-02T18:53:22.772290] [INFO ] [LOCAL ] FCN: Starting deletion of primary data. [2025-10-02T18:53:22.773872] [DEBUG] [LOCAL ] FCN: Deleted primary data file. [2025-10-02T18:53:22.773935] [INFO ] [MAIN ] FCN: Starting full primary refresh. [2025-10-02T18:53:23.175584] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-02T18:53:23.179865] [INFO ] [REMOTE ] FCN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:53:23.472995] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-04. [2025-10-02T18:53:23.916837] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-02T18:53:24.273001] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-02. [2025-10-02T18:53:24.838474] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-02T18:53:25.073034] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-02. [2025-10-02T18:53:25.616952] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-02T18:53:25.872965] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-03. [2025-10-02T18:53:25.992685] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-02T18:53:26.673026] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-03. [2025-10-02T18:53:27.424781] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-02T18:53:27.473009] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-04. [2025-10-02T18:53:27.725599] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-02T18:53:28.273006] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-05. [2025-10-02T18:53:29.073043] [INFO ] [REMOTE ] FCN: Fetching primary data for 2024-12. [2025-10-02T18:53:29.155684] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-02T18:53:29.657141] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-02T18:53:29.804588] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-02T18:53:29.873000] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-06. [2025-10-02T18:53:30.673001] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-01. [2025-10-02T18:53:31.336509] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-02T18:53:31.472970] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-04. [2025-10-02T18:53:31.704299] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-02T18:53:32.273013] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-05. [2025-10-02T18:53:32.577401] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-02T18:53:33.072991] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-05. [2025-10-02T18:53:33.574161] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-02T18:53:33.846883] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-02T18:53:33.872980] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-06. [2025-10-02T18:53:34.459532] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-02T18:53:34.673015] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-02. [2025-10-02T18:53:35.473024] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-06. [2025-10-02T18:53:35.776597] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-02T18:53:36.273031] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-07. [2025-10-02T18:53:36.659789] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-02T18:53:37.073010] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-07. [2025-10-02T18:53:37.761762] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-02T18:53:37.873012] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-03. [2025-10-02T18:53:38.672993] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-08. [2025-10-02T18:53:38.780938] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-02T18:53:39.112414] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-02T18:53:39.473019] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-08. [2025-10-02T18:53:40.049996] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-02T18:53:40.273037] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-07. [2025-10-02T18:53:40.881787] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-02T18:53:41.073008] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-04. [2025-10-02T18:53:41.304253] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-02T18:53:41.873034] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-09. [2025-10-02T18:53:42.183838] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-02T18:53:42.673043] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-05. [2025-10-02T18:53:43.295236] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-02T18:53:43.473005] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-10. [2025-10-02T18:53:43.984462] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-02T18:53:44.273051] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-06. [2025-10-02T18:53:44.594262] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-02T18:53:44.596278] [INFO ] [REMOTE ] FCF: Full fetch complete (58039 records). [2025-10-02T18:53:44.596408] [DEBUG] [VALIDATOR ] FCF: Validating primary data. [2025-10-02T18:53:45.007248] [DEBUG] [VALIDATOR ] FCF: All expected trading days are present. [2025-10-02T18:53:45.007341] [DEBUG] [VALIDATOR ] FCF: Primary data validation passed. [2025-10-02T18:53:45.008162] [INFO ] [MAIN ] FCF: Fetched primary data is valid. [2025-10-02T18:53:45.008231] [DEBUG] [LOCAL ] FCF: Saving primary data. [2025-10-02T18:53:45.009495] [DEBUG] [LOCAL ] FCF: Trimmed 58039 records to 39650 (keeping 200 days of data) [2025-10-02T18:53:45.074964] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-09. [2025-10-02T18:53:45.257919] [DEBUG] [LOCAL ] FCF: Primary data saved (39650 records). [2025-10-02T18:53:45.261507] [INFO ] [MAIN ] FCF: Full history saved. [2025-10-02T18:53:45.262150] [INFO ] [MAIN ] Update Progress: 808/2370 symbols completed. FCF took 26.0s. Estimated remaining: 3h 39m 47s. Rate: 7.1 symbols/min [2025-10-02T18:53:45.447799] [INFO ] [MAIN ] FCPT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:53:45.486169] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-02T18:53:45.505423] [DEBUG] [LOCAL ] FCPT: Loaded 37301 existing records from primary storage. [2025-10-02T18:53:45.505791] [INFO ] [MAIN ] FCPT: Loaded 37301 existing records. [2025-10-02T18:53:45.698706] [WARN ] [MAIN ] FCPT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:53:45.698931] [INFO ] [MAIN ] FCPT: Wiping existing primary data before full refresh. [2025-10-02T18:53:45.698979] [INFO ] [LOCAL ] FCPT: Starting deletion of primary data. [2025-10-02T18:53:45.700572] [DEBUG] [LOCAL ] FCPT: Deleted primary data file. [2025-10-02T18:53:45.700634] [INFO ] [MAIN ] FCPT: Starting full primary refresh. [2025-10-02T18:53:45.887061] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-07. [2025-10-02T18:53:46.098662] [INFO ] [REMOTE ] FCPT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:53:46.399865] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-02T18:53:46.673011] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-08. [2025-10-02T18:53:47.265068] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-02T18:53:47.472972] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-10. [2025-10-02T18:53:47.632016] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-02T18:53:48.273034] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-09. [2025-10-02T18:53:48.640056] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-02T18:53:48.641765] [INFO ] [REMOTE ] FBRT: Full fetch complete (48950 records). [2025-10-02T18:53:48.641859] [DEBUG] [VALIDATOR ] FBRT: Validating primary data. [2025-10-02T18:53:49.073998] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-08. [2025-10-02T18:53:49.074509] [DEBUG] [VALIDATOR ] FBRT: All expected trading days are present. [2025-10-02T18:53:49.074750] [DEBUG] [VALIDATOR ] FBRT: Primary data validation passed. [2025-10-02T18:53:49.076565] [INFO ] [MAIN ] FBRT: Fetched primary data is valid. [2025-10-02T18:53:49.076666] [DEBUG] [LOCAL ] FBRT: Saving primary data. [2025-10-02T18:53:49.077938] [DEBUG] [LOCAL ] FBRT: Trimmed 48950 records to 34942 (keeping 200 days of data) [2025-10-02T18:53:49.208948] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-02T18:53:49.326639] [DEBUG] [LOCAL ] FBRT: Primary data saved (34942 records). [2025-10-02T18:53:49.326823] [INFO ] [MAIN ] FBRT: Full history saved. [2025-10-02T18:53:49.326911] [INFO ] [MAIN ] Update Progress: 809/2370 symbols completed. FBRT took 50.7s. Estimated remaining: 3h 39m 30s. Rate: 7.1 symbols/min [2025-10-02T18:53:49.515027] [INFO ] [MAIN ] FCRX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:53:49.515223] [DEBUG] [LOCAL ] FCRX: No existing data file found in primary storage. [2025-10-02T18:53:49.515267] [WARN ] [MAIN ] FCRX: No existing data found, performing full refresh instead. [2025-10-02T18:53:49.515380] [INFO ] [MAIN ] FCRX: Wiping existing primary data before full refresh. [2025-10-02T18:53:49.515423] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-02T18:53:49.515480] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-02T18:53:49.515560] [INFO ] [MAIN ] FCRX: Starting full primary refresh. [2025-10-02T18:53:49.879060] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-10. [2025-10-02T18:53:49.925961] [INFO ] [REMOTE ] FCRX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:53:49.942599] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-02T18:53:50.673060] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2024-12. [2025-10-02T18:53:50.704123] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-02T18:53:50.705300] [INFO ] [REMOTE ] FC: Full fetch complete (21810 records). [2025-10-02T18:53:50.705375] [DEBUG] [VALIDATOR ] FC: Validating primary data. [2025-10-02T18:53:50.989819] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2024-12 (0.32 seconds). [2025-10-02T18:53:51.119359] [DEBUG] [VALIDATOR ] FC: All expected trading days are present. [2025-10-02T18:53:51.119439] [DEBUG] [VALIDATOR ] FC: Primary data validation passed. [2025-10-02T18:53:51.119963] [INFO ] [MAIN ] FC: Fetched primary data is valid. [2025-10-02T18:53:51.120030] [DEBUG] [LOCAL ] FC: Saving primary data. [2025-10-02T18:53:51.120861] [DEBUG] [LOCAL ] FC: Trimmed 21810 records to 15565 (keeping 200 days of data) [2025-10-02T18:53:51.214857] [DEBUG] [LOCAL ] FC: Primary data saved (15565 records). [2025-10-02T18:53:51.214997] [INFO ] [MAIN ] FC: Full history saved. [2025-10-02T18:53:51.215083] [INFO ] [MAIN ] Update Progress: 810/2370 symbols completed. FC took 36.6s. Estimated remaining: 3h 39m 9s. Rate: 7.1 symbols/min [2025-10-02T18:53:51.396800] [INFO ] [MAIN ] FCT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:53:51.413174] [DEBUG] [LOCAL ] FCT: Loaded 14609 existing records from primary storage. [2025-10-02T18:53:51.413418] [INFO ] [MAIN ] FCT: Loaded 14609 existing records. [2025-10-02T18:53:51.478783] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2024-12. [2025-10-02T18:53:51.603786] [WARN ] [MAIN ] FCT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:53:51.603991] [INFO ] [MAIN ] FCT: Wiping existing primary data before full refresh. [2025-10-02T18:53:51.604041] [INFO ] [LOCAL ] FCT: Starting deletion of primary data. [2025-10-02T18:53:51.604984] [DEBUG] [LOCAL ] FCT: Deleted primary data file. [2025-10-02T18:53:51.605047] [INFO ] [MAIN ] FCT: Starting full primary refresh. [2025-10-02T18:53:51.978119] [INFO ] [REMOTE ] FCT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:53:52.273042] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-09. [2025-10-02T18:53:52.920046] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-02T18:53:53.073024] [INFO ] [REMOTE ] FCT: Fetching primary data for 2024-12. [2025-10-02T18:53:53.251349] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-02T18:53:53.872984] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-01. [2025-10-02T18:53:54.034412] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-02T18:53:54.292373] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-02T18:53:54.673043] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-02. [2025-10-02T18:53:55.112621] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-02T18:53:55.473001] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-03. [2025-10-02T18:53:55.820264] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-02T18:53:56.273007] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-04. [2025-10-02T18:53:56.752098] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-02T18:53:57.072996] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-10. [2025-10-02T18:53:57.873031] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-05. [2025-10-02T18:53:57.969720] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-02T18:53:57.971020] [INFO ] [REMOTE ] FCN: Full fetch complete (35653 records). [2025-10-02T18:53:57.971104] [DEBUG] [VALIDATOR ] FCN: Validating primary data. [2025-10-02T18:53:58.252781] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-02T18:53:58.379471] [DEBUG] [VALIDATOR ] FCN: All expected trading days are present. [2025-10-02T18:53:58.379562] [DEBUG] [VALIDATOR ] FCN: Primary data validation passed. [2025-10-02T18:53:58.380206] [INFO ] [MAIN ] FCN: Fetched primary data is valid. [2025-10-02T18:53:58.380274] [DEBUG] [LOCAL ] FCN: Saving primary data. [2025-10-02T18:53:58.381290] [DEBUG] [LOCAL ] FCN: Trimmed 35653 records to 26094 (keeping 200 days of data) [2025-10-02T18:53:58.543728] [DEBUG] [LOCAL ] FCN: Primary data saved (26094 records). [2025-10-02T18:53:58.543862] [INFO ] [MAIN ] FCN: Full history saved. [2025-10-02T18:53:58.543947] [INFO ] [MAIN ] Update Progress: 811/2370 symbols completed. FCN took 36.2s. Estimated remaining: 3h 38m 59s. Rate: 7.1 symbols/min [2025-10-02T18:53:58.678176] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-06. [2025-10-02T18:53:58.725980] [INFO ] [MAIN ] FCX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:53:58.779209] [DEBUG] [LOCAL ] FCX: Loaded 53700 existing records from primary storage. [2025-10-02T18:53:58.779554] [INFO ] [MAIN ] FCX: Loaded 53700 existing records. [2025-10-02T18:53:58.978808] [WARN ] [MAIN ] FCX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:53:58.979070] [INFO ] [MAIN ] FCX: Wiping existing primary data before full refresh. [2025-10-02T18:53:58.979129] [INFO ] [LOCAL ] FCX: Starting deletion of primary data. [2025-10-02T18:53:58.981080] [DEBUG] [LOCAL ] FCX: Deleted primary data file. [2025-10-02T18:53:58.981144] [INFO ] [MAIN ] FCX: Starting full primary refresh. [2025-10-02T18:53:59.187302] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-02T18:53:59.376762] [INFO ] [REMOTE ] FCX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:53:59.473019] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-01. [2025-10-02T18:54:00.273036] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-01. [2025-10-02T18:54:01.023392] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-02T18:54:01.073035] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-07. [2025-10-02T18:54:01.348143] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-02T18:54:01.434283] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-02T18:54:01.873025] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-02. [2025-10-02T18:54:02.673025] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-08. [2025-10-02T18:54:03.020872] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-02T18:54:03.268038] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-02T18:54:03.473047] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-02. [2025-10-02T18:54:04.273040] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-09. [2025-10-02T18:54:04.293695] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-02T18:54:04.703023] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-02T18:54:05.072990] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-10. [2025-10-02T18:54:05.420221] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-02T18:54:05.420956] [INFO ] [REMOTE ] FCRX: Full fetch complete (1687 records). [2025-10-02T18:54:05.421029] [DEBUG] [VALIDATOR ] FCRX: Validating primary data. [2025-10-02T18:54:05.626706] [WARN ] [VALIDATOR ] FCRX: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-10-02T18:54:05.626986] [FATAL] [MAIN ] FCRX: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:54:05.627061] [WARN ] [MAIN ] FCRX: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:54:05.627142] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-02T18:54:05.627218] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-02T18:54:05.627260] [INFO ] [LOCAL ] FCRX: Starting deletion of derivative data. [2025-10-02T18:54:05.627303] [DEBUG] [LOCAL ] FCRX: No derivative data file found to delete. [2025-10-02T18:54:05.627375] [INFO ] [MAIN ] Update Progress: 812/2370 symbols completed. FCRX took 16.3s. Estimated remaining: 3h 38m 48s. Rate: 7.1 symbols/min [2025-10-02T18:54:05.808578] [INFO ] [MAIN ] FDP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:54:05.847242] [DEBUG] [LOCAL ] FDP: Loaded 30111 existing records from primary storage. [2025-10-02T18:54:05.847617] [INFO ] [MAIN ] FDP: Loaded 30111 existing records. [2025-10-02T18:54:05.878235] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-03. [2025-10-02T18:54:06.035707] [WARN ] [MAIN ] FDP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:54:06.036005] [INFO ] [MAIN ] FDP: Wiping existing primary data before full refresh. [2025-10-02T18:54:06.036135] [INFO ] [LOCAL ] FDP: Starting deletion of primary data. [2025-10-02T18:54:06.037485] [DEBUG] [LOCAL ] FDP: Deleted primary data file. [2025-10-02T18:54:06.037550] [INFO ] [MAIN ] FDP: Starting full primary refresh. [2025-10-02T18:54:06.397427] [INFO ] [REMOTE ] FDP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:54:06.673061] [INFO ] [REMOTE ] FCX: Fetching primary data for 2024-12. [2025-10-02T18:54:07.056337] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-02T18:54:07.473070] [INFO ] [REMOTE ] FDP: Fetching primary data for 2024-12. [2025-10-02T18:54:08.273001] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-03. [2025-10-02T18:54:08.759196] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-02T18:54:08.761187] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-02T18:54:09.073028] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-01. [2025-10-02T18:54:09.841963] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-02T18:54:09.872982] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-01. [2025-10-02T18:54:09.911691] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-02T18:54:10.673004] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-04. [2025-10-02T18:54:11.473047] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-04. [2025-10-02T18:54:11.671348] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-02T18:54:11.851895] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-02T18:54:12.272979] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-02. [2025-10-02T18:54:12.766746] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-02T18:54:13.073033] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-05. [2025-10-02T18:54:13.873029] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-05. [2025-10-02T18:54:14.272909] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-02T18:54:14.646520] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-02T18:54:14.672997] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-06. [2025-10-02T18:54:14.691325] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-02T18:54:15.473030] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-06. [2025-10-02T18:54:16.140615] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-02T18:54:16.165031] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-02T18:54:16.273044] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-03. [2025-10-02T18:54:17.073013] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-07. [2025-10-02T18:54:17.873026] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-02. [2025-10-02T18:54:18.032940] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-02T18:54:18.234416] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-02T18:54:18.673024] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-08. [2025-10-02T18:54:19.199865] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-02T18:54:19.216326] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-02T18:54:19.473000] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-09. [2025-10-02T18:54:20.273009] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-07. [2025-10-02T18:54:20.451009] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-02T18:54:21.073008] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-04. [2025-10-02T18:54:21.651623] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-02T18:54:21.872996] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-10. [2025-10-02T18:54:22.672992] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-03. [2025-10-02T18:54:22.820236] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-02T18:54:22.821474] [INFO ] [REMOTE ] FCT: Full fetch complete (21142 records). [2025-10-02T18:54:22.821593] [DEBUG] [VALIDATOR ] FCT: Validating primary data. [2025-10-02T18:54:23.265297] [DEBUG] [VALIDATOR ] FCT: All expected trading days are present. [2025-10-02T18:54:23.265024] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-02T18:54:23.265517] [DEBUG] [VALIDATOR ] FCT: Primary data validation passed. [2025-10-02T18:54:23.281588] [INFO ] [MAIN ] FCT: Fetched primary data is valid. [2025-10-02T18:54:23.281843] [DEBUG] [LOCAL ] FCT: Saving primary data. [2025-10-02T18:54:23.283319] [DEBUG] [LOCAL ] FCT: Trimmed 21142 records to 14789 (keeping 200 days of data) [2025-10-02T18:54:23.376855] [DEBUG] [LOCAL ] FCT: Primary data saved (14789 records). [2025-10-02T18:54:23.377002] [INFO ] [MAIN ] FCT: Full history saved. [2025-10-02T18:54:23.377083] [INFO ] [MAIN ] Update Progress: 813/2370 symbols completed. FCT took 32.2s. Estimated remaining: 3h 38m 57s. Rate: 7.1 symbols/min [2025-10-02T18:54:23.479007] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-05. [2025-10-02T18:54:23.557265] [INFO ] [MAIN ] FDS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:54:23.585622] [DEBUG] [LOCAL ] FDS: Loaded 26623 existing records from primary storage. [2025-10-02T18:54:23.585949] [INFO ] [MAIN ] FDS: Loaded 26623 existing records. [2025-10-02T18:54:23.785987] [WARN ] [MAIN ] FDS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:54:23.786248] [INFO ] [MAIN ] FDS: Wiping existing primary data before full refresh. [2025-10-02T18:54:23.786297] [INFO ] [LOCAL ] FDS: Starting deletion of primary data. [2025-10-02T18:54:23.787373] [DEBUG] [LOCAL ] FDS: Deleted primary data file. [2025-10-02T18:54:23.787434] [INFO ] [MAIN ] FDS: Starting full primary refresh. [2025-10-02T18:54:24.208000] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-02T18:54:24.212582] [INFO ] [REMOTE ] FDS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:54:24.273012] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-04. [2025-10-02T18:54:25.072977] [INFO ] [REMOTE ] FDS: Fetching primary data for 2024-12. [2025-10-02T18:54:25.566238] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-02T18:54:25.637323] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-02T18:54:25.873001] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-06. [2025-10-02T18:54:26.306040] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-02T18:54:26.672999] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-01. [2025-10-02T18:54:27.473030] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-05. [2025-10-02T18:54:27.880441] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-02T18:54:27.881906] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-02T18:54:28.272999] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-07. [2025-10-02T18:54:28.420470] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-02T18:54:29.072991] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-06. [2025-10-02T18:54:29.872995] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-08. [2025-10-02T18:54:30.223034] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-02T18:54:30.678105] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-07. [2025-10-02T18:54:30.695417] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-10-02T18:54:31.121531] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-02T18:54:31.472965] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-09. [2025-10-02T18:54:31.961800] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-02T18:54:32.273034] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-08. [2025-10-02T18:54:32.619631] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-02T18:54:33.073014] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-08. [2025-10-02T18:54:33.606202] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-02T18:54:33.873004] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-02. [2025-10-02T18:54:34.672993] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-10. [2025-10-02T18:54:34.726455] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-02T18:54:35.106855] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-02T18:54:35.473061] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-03. [2025-10-02T18:54:35.877074] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-02T18:54:35.878983] [INFO ] [REMOTE ] FCPT: Full fetch complete (53794 records). [2025-10-02T18:54:35.879119] [DEBUG] [VALIDATOR ] FCPT: Validating primary data. [2025-10-02T18:54:36.281477] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-09. [2025-10-02T18:54:36.315010] [DEBUG] [VALIDATOR ] FCPT: All expected trading days are present. [2025-10-02T18:54:36.315160] [DEBUG] [VALIDATOR ] FCPT: Primary data validation passed. [2025-10-02T18:54:36.316020] [INFO ] [MAIN ] FCPT: Fetched primary data is valid. [2025-10-02T18:54:36.316089] [DEBUG] [LOCAL ] FCPT: Saving primary data. [2025-10-02T18:54:36.317484] [DEBUG] [LOCAL ] FCPT: Trimmed 53794 records to 37618 (keeping 200 days of data) [2025-10-02T18:54:36.571718] [DEBUG] [LOCAL ] FCPT: Primary data saved (37618 records). [2025-10-02T18:54:36.571907] [INFO ] [MAIN ] FCPT: Full history saved. [2025-10-02T18:54:36.572868] [INFO ] [MAIN ] Update Progress: 814/2370 symbols completed. FCPT took 51.3s. Estimated remaining: 3h 38m 58s. Rate: 7.1 symbols/min [2025-10-02T18:54:36.787198] [INFO ] [MAIN ] FDX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:54:36.806412] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-02T18:54:36.866876] [DEBUG] [LOCAL ] FDX: Loaded 51582 existing records from primary storage. [2025-10-02T18:54:36.867288] [INFO ] [MAIN ] FDX: Loaded 51582 existing records. [2025-10-02T18:54:37.058133] [WARN ] [MAIN ] FDX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:54:37.058358] [INFO ] [MAIN ] FDX: Wiping existing primary data before full refresh. [2025-10-02T18:54:37.058412] [INFO ] [LOCAL ] FDX: Starting deletion of primary data. [2025-10-02T18:54:37.060590] [DEBUG] [LOCAL ] FDX: Deleted primary data file. [2025-10-02T18:54:37.060681] [INFO ] [MAIN ] FDX: Starting full primary refresh. [2025-10-02T18:54:37.082271] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-04. [2025-10-02T18:54:37.454825] [INFO ] [REMOTE ] FDX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:54:37.748987] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-02T18:54:37.873004] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-09. [2025-10-02T18:54:38.370355] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-02T18:54:38.673010] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-10. [2025-10-02T18:54:39.472968] [INFO ] [REMOTE ] FDX: Fetching primary data for 2024-12. [2025-10-02T18:54:39.738694] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-02T18:54:39.742512] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-02T18:54:39.746867] [INFO ] [REMOTE ] FDP: Full fetch complete (42871 records). [2025-10-02T18:54:39.754137] [DEBUG] [VALIDATOR ] FDP: Validating primary data. [2025-10-02T18:54:40.157178] [DEBUG] [VALIDATOR ] FDP: All expected trading days are present. [2025-10-02T18:54:40.157281] [DEBUG] [VALIDATOR ] FDP: Primary data validation passed. [2025-10-02T18:54:40.157997] [INFO ] [MAIN ] FDP: Fetched primary data is valid. [2025-10-02T18:54:40.158063] [DEBUG] [LOCAL ] FDP: Saving primary data. [2025-10-02T18:54:40.159200] [DEBUG] [LOCAL ] FDP: Trimmed 42871 records to 30317 (keeping 200 days of data) [2025-10-02T18:54:40.274713] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-10. [2025-10-02T18:54:40.354310] [DEBUG] [LOCAL ] FDP: Primary data saved (30317 records). [2025-10-02T18:54:40.354461] [INFO ] [MAIN ] FDP: Full history saved. [2025-10-02T18:54:40.354547] [INFO ] [MAIN ] Update Progress: 815/2370 symbols completed. FDP took 34.7s. Estimated remaining: 3h 38m 40s. Rate: 7.1 symbols/min [2025-10-02T18:54:40.544530] [INFO ] [MAIN ] FE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:54:40.601178] [DEBUG] [LOCAL ] FE: Loaded 53430 existing records from primary storage. [2025-10-02T18:54:40.601542] [INFO ] [MAIN ] FE: Loaded 53430 existing records. [2025-10-02T18:54:40.799080] [WARN ] [MAIN ] FE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:54:40.799337] [INFO ] [MAIN ] FE: Wiping existing primary data before full refresh. [2025-10-02T18:54:40.799401] [INFO ] [LOCAL ] FE: Starting deletion of primary data. [2025-10-02T18:54:40.801143] [DEBUG] [LOCAL ] FE: Deleted primary data file. [2025-10-02T18:54:40.801209] [INFO ] [MAIN ] FE: Starting full primary refresh. [2025-10-02T18:54:41.080169] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-05. [2025-10-02T18:54:41.215773] [INFO ] [REMOTE ] FE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:54:41.278776] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-02T18:54:41.872971] [INFO ] [REMOTE ] FE: Fetching primary data for 2024-12. [2025-10-02T18:54:41.979624] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-02T18:54:41.981847] [INFO ] [REMOTE ] FCX: Full fetch complete (77740 records). [2025-10-02T18:54:41.981983] [DEBUG] [VALIDATOR ] FCX: Validating primary data. [2025-10-02T18:54:42.295831] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-02T18:54:42.436969] [DEBUG] [VALIDATOR ] FCX: All expected trading days are present. [2025-10-02T18:54:42.437060] [DEBUG] [VALIDATOR ] FCX: Primary data validation passed. [2025-10-02T18:54:42.438215] [INFO ] [MAIN ] FCX: Fetched primary data is valid. [2025-10-02T18:54:42.438284] [DEBUG] [LOCAL ] FCX: Saving primary data. [2025-10-02T18:54:42.439872] [DEBUG] [LOCAL ] FCX: Trimmed 77740 records to 54090 (keeping 200 days of data) [2025-10-02T18:54:42.673213] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-01. [2025-10-02T18:54:42.788956] [DEBUG] [LOCAL ] FCX: Primary data saved (54090 records). [2025-10-02T18:54:42.789099] [INFO ] [MAIN ] FCX: Full history saved. [2025-10-02T18:54:42.789247] [INFO ] [MAIN ] Update Progress: 816/2370 symbols completed. FCX took 44.2s. Estimated remaining: 3h 38m 20s. Rate: 7.1 symbols/min [2025-10-02T18:54:42.975257] [INFO ] [MAIN ] FENG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:54:42.975447] [DEBUG] [LOCAL ] FENG: No existing data file found in primary storage. [2025-10-02T18:54:42.975489] [WARN ] [MAIN ] FENG: No existing data found, performing full refresh instead. [2025-10-02T18:54:42.975606] [INFO ] [MAIN ] FENG: Wiping existing primary data before full refresh. [2025-10-02T18:54:42.975675] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-02T18:54:42.975742] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-02T18:54:42.975778] [INFO ] [MAIN ] FENG: Starting full primary refresh. [2025-10-02T18:54:43.388398] [INFO ] [REMOTE ] FENG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:54:43.424385] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-02T18:54:43.473060] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-01. [2025-10-02T18:54:44.026687] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-02T18:54:44.273053] [INFO ] [REMOTE ] FENG: Fetching primary data for 2024-12. [2025-10-02T18:54:44.647967] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-10-02T18:54:44.873387] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-02T18:54:45.072993] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-02. [2025-10-02T18:54:45.873003] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-02. [2025-10-02T18:54:46.661952] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-02T18:54:46.672945] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-03. [2025-10-02T18:54:47.472982] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-06. [2025-10-02T18:54:47.594316] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-02T18:54:48.254388] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-02T18:54:48.272960] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-03. [2025-10-02T18:54:48.351422] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-02T18:54:49.073002] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-04. [2025-10-02T18:54:49.873027] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-01. [2025-10-02T18:54:50.045026] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-02T18:54:50.299598] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-02T18:54:50.672970] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-07. [2025-10-02T18:54:50.920207] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-02T18:54:51.473015] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-04. [2025-10-02T18:54:51.810426] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-02T18:54:52.273018] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-08. [2025-10-02T18:54:53.072967] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-02. [2025-10-02T18:54:53.388183] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-02T18:54:53.500101] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-02T18:54:53.527960] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-02T18:54:53.873011] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-05. [2025-10-02T18:54:54.672997] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-03. [2025-10-02T18:54:54.967351] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-10-02T18:54:55.472975] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-04. [2025-10-02T18:54:55.798176] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-02T18:54:55.961866] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-02T18:54:56.273000] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-05. [2025-10-02T18:54:56.692057] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-02T18:54:57.073030] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-09. [2025-10-02T18:54:57.872994] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-05. [2025-10-02T18:54:58.672975] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-06. [2025-10-02T18:54:58.700666] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-02T18:54:58.947566] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-10-02T18:54:59.211460] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-02T18:54:59.473003] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-07. [2025-10-02T18:54:59.819255] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-02T18:55:00.273019] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-08. [2025-10-02T18:55:00.642804] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-02T18:55:01.072982] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-06. [2025-10-02T18:55:01.873061] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-06. [2025-10-02T18:55:02.673020] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-10. [2025-10-02T18:55:02.901905] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-02T18:55:03.472979] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-07. [2025-10-02T18:55:03.737971] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-02T18:55:03.840424] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-02T18:55:03.842024] [INFO ] [REMOTE ] FDS: Full fetch complete (37687 records). [2025-10-02T18:55:03.842120] [DEBUG] [VALIDATOR ] FDS: Validating primary data. [2025-10-02T18:55:04.255678] [DEBUG] [VALIDATOR ] FDS: All expected trading days are present. [2025-10-02T18:55:04.255789] [DEBUG] [VALIDATOR ] FDS: Primary data validation passed. [2025-10-02T18:55:04.256478] [INFO ] [MAIN ] FDS: Fetched primary data is valid. [2025-10-02T18:55:04.256542] [DEBUG] [LOCAL ] FDS: Saving primary data. [2025-10-02T18:55:04.257712] [DEBUG] [LOCAL ] FDS: Trimmed 37687 records to 26895 (keeping 200 days of data) [2025-10-02T18:55:04.318191] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-07. [2025-10-02T18:55:04.439879] [DEBUG] [LOCAL ] FDS: Primary data saved (26895 records). [2025-10-02T18:55:04.440025] [INFO ] [MAIN ] FDS: Full history saved. [2025-10-02T18:55:04.440112] [INFO ] [MAIN ] Update Progress: 817/2370 symbols completed. FDS took 41.1s. Estimated remaining: 3h 38m 37s. Rate: 7.1 symbols/min [2025-10-02T18:55:04.634373] [INFO ] [MAIN ] FERG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:55:04.688275] [DEBUG] [LOCAL ] FERG: Loaded 48853 existing records from primary storage. [2025-10-02T18:55:04.688699] [INFO ] [MAIN ] FERG: Loaded 48853 existing records. [2025-10-02T18:55:04.894258] [WARN ] [MAIN ] FERG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:55:04.894547] [INFO ] [MAIN ] FERG: Wiping existing primary data before full refresh. [2025-10-02T18:55:04.894599] [INFO ] [LOCAL ] FERG: Starting deletion of primary data. [2025-10-02T18:55:04.896480] [DEBUG] [LOCAL ] FERG: Deleted primary data file. [2025-10-02T18:55:04.896542] [INFO ] [MAIN ] FERG: Starting full primary refresh. [2025-10-02T18:55:05.086942] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-09. [2025-10-02T18:55:05.345454] [INFO ] [REMOTE ] FERG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:55:05.385984] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-02T18:55:05.479729] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-02T18:55:05.873015] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-10. [2025-10-02T18:55:06.356451] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-02T18:55:06.368824] [INFO ] [REMOTE ] FENG: Full fetch complete (2261 records). [2025-10-02T18:55:06.387841] [DEBUG] [VALIDATOR ] FENG: Validating primary data. [2025-10-02T18:55:06.404034] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-02T18:55:06.631411] [WARN ] [VALIDATOR ] FENG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-02T18:55:06.631559] [FATAL] [MAIN ] FENG: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:55:06.631663] [WARN ] [MAIN ] FENG: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:55:06.631758] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-02T18:55:06.631833] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-02T18:55:06.631892] [INFO ] [LOCAL ] FENG: Starting deletion of derivative data. [2025-10-02T18:55:06.631938] [DEBUG] [LOCAL ] FENG: No derivative data file found to delete. [2025-10-02T18:55:06.632002] [INFO ] [MAIN ] Update Progress: 818/2370 symbols completed. FENG took 23.8s. Estimated remaining: 3h 38m 17s. Rate: 7.1 symbols/min [2025-10-02T18:55:06.678135] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-08. [2025-10-02T18:55:06.831524] [INFO ] [MAIN ] FET: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:55:06.847628] [DEBUG] [LOCAL ] FET: Loaded 12872 existing records from primary storage. [2025-10-02T18:55:06.847905] [INFO ] [MAIN ] FET: Loaded 12872 existing records. [2025-10-02T18:55:07.056240] [WARN ] [MAIN ] FET: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:55:07.056486] [INFO ] [MAIN ] FET: Wiping existing primary data before full refresh. [2025-10-02T18:55:07.056544] [INFO ] [LOCAL ] FET: Starting deletion of primary data. [2025-10-02T18:55:07.057239] [DEBUG] [LOCAL ] FET: Deleted primary data file. [2025-10-02T18:55:07.057306] [INFO ] [MAIN ] FET: Starting full primary refresh. [2025-10-02T18:55:07.475026] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-08. [2025-10-02T18:55:07.474839] [INFO ] [REMOTE ] FET: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:55:08.272997] [INFO ] [REMOTE ] FET: Fetching primary data for 2024-12. [2025-10-02T18:55:08.549793] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-02T18:55:09.072994] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-09. [2025-10-02T18:55:09.144822] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-02T18:55:09.427913] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-02T18:55:09.873056] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-09. [2025-10-02T18:55:10.672974] [INFO ] [REMOTE ] FERG: Fetching primary data for 2024-12. [2025-10-02T18:55:10.837839] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-02T18:55:11.472978] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-01. [2025-10-02T18:55:11.927614] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-02T18:55:12.039365] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-02T18:55:12.281414] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-02. [2025-10-02T18:55:12.309751] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-02T18:55:13.072997] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-10. [2025-10-02T18:55:13.186235] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-02T18:55:13.873004] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-01. [2025-10-02T18:55:14.673027] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-10. [2025-10-02T18:55:14.803210] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-02T18:55:14.805342] [INFO ] [REMOTE ] FDX: Full fetch complete (74454 records). [2025-10-02T18:55:14.805452] [DEBUG] [VALIDATOR ] FDX: Validating primary data. [2025-10-02T18:55:15.271630] [DEBUG] [VALIDATOR ] FDX: All expected trading days are present. [2025-10-02T18:55:15.271781] [DEBUG] [VALIDATOR ] FDX: Primary data validation passed. [2025-10-02T18:55:15.272730] [INFO ] [MAIN ] FDX: Fetched primary data is valid. [2025-10-02T18:55:15.272908] [DEBUG] [LOCAL ] FDX: Saving primary data. [2025-10-02T18:55:15.274499] [DEBUG] [LOCAL ] FDX: Trimmed 74454 records to 51922 (keeping 200 days of data) [2025-10-02T18:55:15.476531] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-03. [2025-10-02T18:55:15.656979] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-02T18:55:15.682773] [DEBUG] [LOCAL ] FDX: Primary data saved (51922 records). [2025-10-02T18:55:15.682932] [INFO ] [MAIN ] FDX: Full history saved. [2025-10-02T18:55:15.686260] [INFO ] [MAIN ] Update Progress: 819/2370 symbols completed. FDX took 39.1s. Estimated remaining: 3h 38m 10s. Rate: 7.1 symbols/min [2025-10-02T18:55:15.890278] [INFO ] [MAIN ] FF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:55:15.918036] [DEBUG] [LOCAL ] FF: Loaded 24977 existing records from primary storage. [2025-10-02T18:55:15.918363] [INFO ] [MAIN ] FF: Loaded 24977 existing records. [2025-10-02T18:55:16.050079] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-02T18:55:16.078929] [INFO ] [REMOTE ] FE: Full fetch complete (77261 records). [2025-10-02T18:55:16.106935] [DEBUG] [VALIDATOR ] FE: Validating primary data. [2025-10-02T18:55:16.140803] [WARN ] [MAIN ] FF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:55:16.141115] [INFO ] [MAIN ] FF: Wiping existing primary data before full refresh. [2025-10-02T18:55:16.141241] [INFO ] [LOCAL ] FF: Starting deletion of primary data. [2025-10-02T18:55:16.176130] [DEBUG] [LOCAL ] FF: Deleted primary data file. [2025-10-02T18:55:16.212226] [INFO ] [MAIN ] FF: Starting full primary refresh. [2025-10-02T18:55:16.274086] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-02. [2025-10-02T18:55:16.634800] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-02T18:55:17.044469] [DEBUG] [VALIDATOR ] FE: All expected trading days are present. [2025-10-02T18:55:17.045200] [DEBUG] [VALIDATOR ] FE: Primary data validation passed. [2025-10-02T18:55:17.046963] [INFO ] [MAIN ] FE: Fetched primary data is valid. [2025-10-02T18:55:17.047668] [DEBUG] [LOCAL ] FE: Saving primary data. [2025-10-02T18:55:17.073697] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-04. [2025-10-02T18:55:17.073517] [INFO ] [REMOTE ] FF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:55:17.076382] [DEBUG] [LOCAL ] FE: Trimmed 77261 records to 53818 (keeping 200 days of data) [2025-10-02T18:55:17.417392] [DEBUG] [LOCAL ] FE: Primary data saved (53818 records). [2025-10-02T18:55:17.417546] [INFO ] [MAIN ] FE: Full history saved. [2025-10-02T18:55:17.417629] [INFO ] [MAIN ] Update Progress: 820/2370 symbols completed. FE took 37.1s. Estimated remaining: 3h 37m 48s. Rate: 7.1 symbols/min [2025-10-02T18:55:17.602762] [INFO ] [MAIN ] FFA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:55:17.610451] [DEBUG] [LOCAL ] FFA: Loaded 5856 existing records from primary storage. [2025-10-02T18:55:17.610698] [INFO ] [MAIN ] FFA: Loaded 5856 existing records. [2025-10-02T18:55:17.811511] [WARN ] [MAIN ] FFA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:55:17.811971] [INFO ] [MAIN ] FFA: Wiping existing primary data before full refresh. [2025-10-02T18:55:17.812141] [INFO ] [LOCAL ] FFA: Starting deletion of primary data. [2025-10-02T18:55:17.812776] [DEBUG] [LOCAL ] FFA: Deleted primary data file. [2025-10-02T18:55:17.812884] [INFO ] [MAIN ] FFA: Starting full primary refresh. [2025-10-02T18:55:17.881492] [INFO ] [REMOTE ] FF: Fetching primary data for 2024-12. [2025-10-02T18:55:18.040079] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-02T18:55:18.117100] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-02T18:55:18.265829] [INFO ] [REMOTE ] FFA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:55:18.672991] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-03. [2025-10-02T18:55:19.149898] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-02T18:55:19.473007] [INFO ] [REMOTE ] FFA: Fetching primary data for 2024-12. [2025-10-02T18:55:20.032010] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-02T18:55:20.272971] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-01. [2025-10-02T18:55:20.466260] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-02T18:55:21.072982] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-04. [2025-10-02T18:55:21.458366] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-02T18:55:21.872998] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-01. [2025-10-02T18:55:22.611708] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-02T18:55:22.673015] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-02. [2025-10-02T18:55:22.858826] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-02T18:55:23.401445] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-02T18:55:23.473010] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-05. [2025-10-02T18:55:24.273031] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-05. [2025-10-02T18:55:24.782230] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-02T18:55:25.072991] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-02. [2025-10-02T18:55:25.295296] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-02T18:55:25.672138] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-02T18:55:25.873017] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-06. [2025-10-02T18:55:26.673022] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-03. [2025-10-02T18:55:26.718472] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-02T18:55:27.128550] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-02T18:55:27.472997] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-07. [2025-10-02T18:55:28.272984] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-06. [2025-10-02T18:55:28.387262] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-02T18:55:29.072977] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-03. [2025-10-02T18:55:29.872985] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-08. [2025-10-02T18:55:30.075014] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-02T18:55:30.196875] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-02T18:55:30.457561] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-02T18:55:30.673022] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-04. [2025-10-02T18:55:31.472992] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-07. [2025-10-02T18:55:32.039415] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-02T18:55:32.273053] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-04. [2025-10-02T18:55:33.055846] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-02T18:55:33.072952] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-05. [2025-10-02T18:55:33.259748] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-02T18:55:33.435122] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-02T18:55:33.873035] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-06. [2025-10-02T18:55:34.466525] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-02T18:55:34.673015] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-07. [2025-10-02T18:55:35.419977] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-02T18:55:35.473077] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-05. [2025-10-02T18:55:36.272975] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-09. [2025-10-02T18:55:36.599395] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-02T18:55:37.072992] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-06. [2025-10-02T18:55:37.256992] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-02T18:55:37.873040] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-08. [2025-10-02T18:55:37.996998] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-02T18:55:38.673012] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-07. [2025-10-02T18:55:39.069205] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-02T18:55:39.472998] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-09. [2025-10-02T18:55:39.799776] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-02T18:55:40.273000] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-08. [2025-10-02T18:55:40.839318] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-02T18:55:41.072971] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-10. [2025-10-02T18:55:41.273171] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-02T18:55:41.842584] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-02T18:55:41.843774] [INFO ] [REMOTE ] FET: Full fetch complete (18353 records). [2025-10-02T18:55:41.843896] [DEBUG] [VALIDATOR ] FET: Validating primary data. [2025-10-02T18:55:41.878202] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-08. [2025-10-02T18:55:42.276526] [DEBUG] [VALIDATOR ] FET: All expected trading days are present. [2025-10-02T18:55:42.276637] [DEBUG] [VALIDATOR ] FET: Primary data validation passed. [2025-10-02T18:55:42.277205] [INFO ] [MAIN ] FET: Fetched primary data is valid. [2025-10-02T18:55:42.277300] [DEBUG] [LOCAL ] FET: Saving primary data. [2025-10-02T18:55:42.278181] [DEBUG] [LOCAL ] FET: Trimmed 18353 records to 12979 (keeping 200 days of data) [2025-10-02T18:55:42.362867] [DEBUG] [LOCAL ] FET: Primary data saved (12979 records). [2025-10-02T18:55:42.363003] [INFO ] [MAIN ] FET: Full history saved. [2025-10-02T18:55:42.363145] [INFO ] [MAIN ] Update Progress: 821/2370 symbols completed. FET took 35.7s. Estimated remaining: 3h 38m 11s. Rate: 7.1 symbols/min [2025-10-02T18:55:42.545881] [INFO ] [MAIN ] FFC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:55:42.567858] [DEBUG] [LOCAL ] FFC: Loaded 16765 existing records from primary storage. [2025-10-02T18:55:42.568176] [INFO ] [MAIN ] FFC: Loaded 16765 existing records. [2025-10-02T18:55:42.678227] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-10. [2025-10-02T18:55:42.783620] [WARN ] [MAIN ] FFC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:55:42.783866] [INFO ] [MAIN ] FFC: Wiping existing primary data before full refresh. [2025-10-02T18:55:42.783923] [INFO ] [LOCAL ] FFC: Starting deletion of primary data. [2025-10-02T18:55:42.784545] [DEBUG] [LOCAL ] FFC: Deleted primary data file. [2025-10-02T18:55:42.784625] [INFO ] [MAIN ] FFC: Starting full primary refresh. [2025-10-02T18:55:43.050830] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-02T18:55:43.207737] [INFO ] [REMOTE ] FFC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:55:43.473023] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-09. [2025-10-02T18:55:44.271331] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-02T18:55:44.273260] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-09. [2025-10-02T18:55:44.275269] [INFO ] [REMOTE ] FERG: Full fetch complete (70948 records). [2025-10-02T18:55:44.275390] [DEBUG] [VALIDATOR ] FERG: Validating primary data. [2025-10-02T18:55:44.545718] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-02T18:55:44.760616] [DEBUG] [VALIDATOR ] FERG: All expected trading days are present. [2025-10-02T18:55:44.760743] [DEBUG] [VALIDATOR ] FERG: Primary data validation passed. [2025-10-02T18:55:44.761716] [INFO ] [MAIN ] FERG: Fetched primary data is valid. [2025-10-02T18:55:44.761788] [DEBUG] [LOCAL ] FERG: Saving primary data. [2025-10-02T18:55:44.763366] [DEBUG] [LOCAL ] FERG: Trimmed 70948 records to 49230 (keeping 200 days of data) [2025-10-02T18:55:45.030024] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-02T18:55:45.093990] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-10. [2025-10-02T18:55:45.133197] [DEBUG] [LOCAL ] FERG: Primary data saved (49230 records). [2025-10-02T18:55:45.133377] [INFO ] [MAIN ] FERG: Full history saved. [2025-10-02T18:55:45.133504] [INFO ] [MAIN ] Update Progress: 822/2370 symbols completed. FERG took 40.7s. Estimated remaining: 3h 37m 52s. Rate: 7.1 symbols/min [2025-10-02T18:55:45.330540] [INFO ] [MAIN ] FFWM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:55:45.368620] [DEBUG] [LOCAL ] FFWM: Loaded 35720 existing records from primary storage. [2025-10-02T18:55:45.368984] [INFO ] [MAIN ] FFWM: Loaded 35720 existing records. [2025-10-02T18:55:45.587410] [WARN ] [MAIN ] FFWM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:55:45.587638] [INFO ] [MAIN ] FFWM: Wiping existing primary data before full refresh. [2025-10-02T18:55:45.587723] [INFO ] [LOCAL ] FFWM: Starting deletion of primary data. [2025-10-02T18:55:45.588745] [DEBUG] [LOCAL ] FFWM: Deleted primary data file. [2025-10-02T18:55:45.588809] [INFO ] [MAIN ] FFWM: Starting full primary refresh. [2025-10-02T18:55:45.878339] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-10. [2025-10-02T18:55:45.904945] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-02T18:55:45.932918] [INFO ] [REMOTE ] FF: Full fetch complete (36734 records). [2025-10-02T18:55:45.933526] [DEBUG] [VALIDATOR ] FF: Validating primary data. [2025-10-02T18:55:46.134143] [INFO ] [REMOTE ] FFWM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:55:46.428272] [DEBUG] [VALIDATOR ] FF: All expected trading days are present. [2025-10-02T18:55:46.428364] [DEBUG] [VALIDATOR ] FF: Primary data validation passed. [2025-10-02T18:55:46.428970] [INFO ] [MAIN ] FF: Fetched primary data is valid. [2025-10-02T18:55:46.429034] [DEBUG] [LOCAL ] FF: Saving primary data. [2025-10-02T18:55:46.430110] [DEBUG] [LOCAL ] FF: Trimmed 36734 records to 25097 (keeping 200 days of data) [2025-10-02T18:55:46.504800] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-02T18:55:46.538925] [INFO ] [REMOTE ] FFA: Full fetch complete (8518 records). [2025-10-02T18:55:46.544991] [DEBUG] [VALIDATOR ] FFA: Validating primary data. [2025-10-02T18:55:46.675919] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2024-12. [2025-10-02T18:55:46.947845] [DEBUG] [LOCAL ] FF: Primary data saved (25097 records). [2025-10-02T18:55:46.950922] [INFO ] [MAIN ] FF: Full history saved. [2025-10-02T18:55:46.951093] [INFO ] [MAIN ] Update Progress: 823/2370 symbols completed. FF took 31.3s. Estimated remaining: 3h 37m 31s. Rate: 7.1 symbols/min [2025-10-02T18:55:47.237916] [DEBUG] [VALIDATOR ] FFA: All expected trading days are present. [2025-10-02T18:55:47.254503] [DEBUG] [VALIDATOR ] FFA: Primary data validation passed. [2025-10-02T18:55:47.273307] [INFO ] [MAIN ] FFA: Fetched primary data is valid. [2025-10-02T18:55:47.279321] [DEBUG] [LOCAL ] FFA: Saving primary data. [2025-10-02T18:55:47.279083] [INFO ] [MAIN ] FG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:55:47.280383] [DEBUG] [LOCAL ] FFA: Trimmed 8518 records to 5933 (keeping 200 days of data) [2025-10-02T18:55:47.339066] [DEBUG] [LOCAL ] FG: Loaded 22819 existing records from primary storage. [2025-10-02T18:55:47.339171] [DEBUG] [LOCAL ] FFA: Primary data saved (5933 records). [2025-10-02T18:55:47.339413] [INFO ] [MAIN ] FFA: Full history saved. [2025-10-02T18:55:47.339695] [INFO ] [MAIN ] FG: Loaded 22819 existing records. [2025-10-02T18:55:47.339871] [INFO ] [MAIN ] Update Progress: 824/2370 symbols completed. FFA took 29.9s. Estimated remaining: 3h 37m 8s. Rate: 7.1 symbols/min [2025-10-02T18:55:47.482390] [INFO ] [REMOTE ] FFC: Fetching primary data for 2024-12. [2025-10-02T18:55:47.809879] [INFO ] [MAIN ] FGN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:55:47.831272] [WARN ] [MAIN ] FG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:55:47.831772] [INFO ] [MAIN ] FG: Wiping existing primary data before full refresh. [2025-10-02T18:55:47.831864] [INFO ] [LOCAL ] FG: Starting deletion of primary data. [2025-10-02T18:55:47.832899] [DEBUG] [LOCAL ] FG: Deleted primary data file. [2025-10-02T18:55:47.833057] [INFO ] [MAIN ] FG: Starting full primary refresh. [2025-10-02T18:55:47.929945] [DEBUG] [LOCAL ] FGN: Loaded 3895 existing records from primary storage. [2025-10-02T18:55:47.952268] [INFO ] [MAIN ] FGN: Loaded 3895 existing records. [2025-10-02T18:55:48.393148] [WARN ] [MAIN ] FGN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:55:48.426431] [INFO ] [MAIN ] FGN: Wiping existing primary data before full refresh. [2025-10-02T18:55:48.449446] [INFO ] [LOCAL ] FGN: Starting deletion of primary data. [2025-10-02T18:55:48.483089] [DEBUG] [LOCAL ] FGN: Deleted primary data file. [2025-10-02T18:55:48.484478] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-02T18:55:48.527175] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-01. [2025-10-02T18:55:48.526578] [INFO ] [REMOTE ] FG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:55:48.512282] [INFO ] [MAIN ] FGN: Starting full primary refresh. [2025-10-02T18:55:48.791168] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-02T18:55:48.955577] [INFO ] [REMOTE ] FGN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:55:49.072984] [INFO ] [REMOTE ] FGN: Fetching primary data for 2024-12. [2025-10-02T18:55:49.403972] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-10-02T18:55:49.873069] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-01. [2025-10-02T18:55:49.928400] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-02T18:55:50.372181] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-02T18:55:50.673028] [INFO ] [REMOTE ] FG: Fetching primary data for 2024-12. [2025-10-02T18:55:51.405924] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-02T18:55:51.473004] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-02. [2025-10-02T18:55:52.273005] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-01. [2025-10-02T18:55:52.875031] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-02T18:55:53.072983] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-03. [2025-10-02T18:55:53.616023] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-02T18:55:53.873052] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-02. [2025-10-02T18:55:54.493275] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-02T18:55:54.642931] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-02T18:55:54.673041] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-02. [2025-10-02T18:55:55.044425] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-02T18:55:55.473007] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-03. [2025-10-02T18:55:56.273013] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-04. [2025-10-02T18:55:56.465109] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-02T18:55:57.073006] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-01. [2025-10-02T18:55:57.861980] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-02T18:55:57.872946] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-05. [2025-10-02T18:55:58.009370] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-02T18:55:58.673044] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-03. [2025-10-02T18:55:59.273172] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-02T18:55:59.351426] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-02T18:55:59.472991] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-04. [2025-10-02T18:56:00.273056] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-06. [2025-10-02T18:56:00.594015] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-02T18:56:01.072993] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-02. [2025-10-02T18:56:01.612177] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-02T18:56:01.873010] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-05. [2025-10-02T18:56:01.970113] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-02T18:56:02.623087] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-02T18:56:02.672996] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-06. [2025-10-02T18:56:03.473009] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-03. [2025-10-02T18:56:03.515694] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-02T18:56:04.272970] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-07. [2025-10-02T18:56:04.674457] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-02T18:56:05.072996] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-07. [2025-10-02T18:56:05.258638] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-02T18:56:05.873020] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-04. [2025-10-02T18:56:06.240801] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-02T18:56:06.595241] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-02T18:56:06.673005] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-08. [2025-10-02T18:56:07.473035] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-05. [2025-10-02T18:56:08.035407] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-02T18:56:08.105362] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-02T18:56:08.273047] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-08. [2025-10-02T18:56:09.072977] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-09. [2025-10-02T18:56:09.393612] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-02T18:56:09.873042] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-06. [2025-10-02T18:56:10.072609] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-02T18:56:10.493544] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-02T18:56:10.673021] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-07. [2025-10-02T18:56:10.991551] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-02T18:56:11.473033] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-09. [2025-10-02T18:56:12.273059] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-04. [2025-10-02T18:56:12.730214] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-02T18:56:13.072989] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-08. [2025-10-02T18:56:13.471267] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-02T18:56:13.698256] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-02T18:56:13.872996] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-10. [2025-10-02T18:56:14.673006] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-05. [2025-10-02T18:56:15.002394] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-02T18:56:15.004161] [INFO ] [REMOTE ] FFWM: Full fetch complete (51755 records). [2025-10-02T18:56:15.004289] [DEBUG] [VALIDATOR ] FFWM: Validating primary data. [2025-10-02T18:56:15.435943] [DEBUG] [VALIDATOR ] FFWM: All expected trading days are present. [2025-10-02T18:56:15.436266] [DEBUG] [VALIDATOR ] FFWM: Primary data validation passed. [2025-10-02T18:56:15.437100] [INFO ] [MAIN ] FFWM: Fetched primary data is valid. [2025-10-02T18:56:15.437168] [DEBUG] [LOCAL ] FFWM: Saving primary data. [2025-10-02T18:56:15.438511] [DEBUG] [LOCAL ] FFWM: Trimmed 51755 records to 36004 (keeping 200 days of data) [2025-10-02T18:56:15.486091] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-10. [2025-10-02T18:56:15.652920] [DEBUG] [LOCAL ] FFWM: Primary data saved (36004 records). [2025-10-02T18:56:15.653112] [INFO ] [MAIN ] FFWM: Full history saved. [2025-10-02T18:56:15.653229] [INFO ] [MAIN ] Update Progress: 825/2370 symbols completed. FFWM took 30.5s. Estimated remaining: 3h 37m 36s. Rate: 7.1 symbols/min [2025-10-02T18:56:15.841380] [INFO ] [MAIN ] FGSN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:56:15.841689] [DEBUG] [LOCAL ] FGSN: No existing data file found in primary storage. [2025-10-02T18:56:15.841759] [WARN ] [MAIN ] FGSN: No existing data found, performing full refresh instead. [2025-10-02T18:56:15.841989] [INFO ] [MAIN ] FGSN: Wiping existing primary data before full refresh. [2025-10-02T18:56:15.842099] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-02T18:56:15.842220] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-02T18:56:15.842263] [INFO ] [MAIN ] FGSN: Starting full primary refresh. [2025-10-02T18:56:16.174847] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-02T18:56:16.274873] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-09. [2025-10-02T18:56:16.275017] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-02T18:56:16.279915] [INFO ] [REMOTE ] FGSN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:56:16.282425] [INFO ] [REMOTE ] FFC: Full fetch complete (24737 records). [2025-10-02T18:56:16.282733] [DEBUG] [VALIDATOR ] FFC: Validating primary data. [2025-10-02T18:56:16.642717] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-02T18:56:16.732849] [DEBUG] [VALIDATOR ] FFC: All expected trading days are present. [2025-10-02T18:56:16.732955] [DEBUG] [VALIDATOR ] FFC: Primary data validation passed. [2025-10-02T18:56:16.733514] [INFO ] [MAIN ] FFC: Fetched primary data is valid. [2025-10-02T18:56:16.733562] [DEBUG] [LOCAL ] FFC: Saving primary data. [2025-10-02T18:56:16.734398] [DEBUG] [LOCAL ] FFC: Trimmed 24737 records to 16849 (keeping 200 days of data) [2025-10-02T18:56:16.856400] [DEBUG] [LOCAL ] FFC: Primary data saved (16849 records). [2025-10-02T18:56:16.856550] [INFO ] [MAIN ] FFC: Full history saved. [2025-10-02T18:56:16.856638] [INFO ] [MAIN ] Update Progress: 826/2370 symbols completed. FFC took 34.5s. Estimated remaining: 3h 37m 14s. Rate: 7.1 symbols/min [2025-10-02T18:56:17.055455] [INFO ] [MAIN ] FHI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:56:17.073071] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-10. [2025-10-02T18:56:17.105195] [DEBUG] [LOCAL ] FHI: Loaded 40247 existing records from primary storage. [2025-10-02T18:56:17.105519] [INFO ] [MAIN ] FHI: Loaded 40247 existing records. [2025-10-02T18:56:17.303923] [WARN ] [MAIN ] FHI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:56:17.304140] [INFO ] [MAIN ] FHI: Wiping existing primary data before full refresh. [2025-10-02T18:56:17.304218] [INFO ] [LOCAL ] FHI: Starting deletion of primary data. [2025-10-02T18:56:17.305709] [DEBUG] [LOCAL ] FHI: Deleted primary data file. [2025-10-02T18:56:17.305772] [INFO ] [MAIN ] FHI: Starting full primary refresh. [2025-10-02T18:56:17.639198] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-02T18:56:17.656345] [INFO ] [REMOTE ] FGN: Full fetch complete (5783 records). [2025-10-02T18:56:17.666771] [DEBUG] [VALIDATOR ] FGN: Validating primary data. [2025-10-02T18:56:17.818681] [INFO ] [REMOTE ] FHI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:56:17.878120] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2024-12. [2025-10-02T18:56:18.136299] [DEBUG] [VALIDATOR ] FGN: All expected trading days are present. [2025-10-02T18:56:18.136457] [DEBUG] [VALIDATOR ] FGN: Primary data validation passed. [2025-10-02T18:56:18.136673] [INFO ] [MAIN ] FGN: Fetched primary data is valid. [2025-10-02T18:56:18.136741] [DEBUG] [LOCAL ] FGN: Saving primary data. [2025-10-02T18:56:18.137233] [DEBUG] [LOCAL ] FGN: Trimmed 5783 records to 3909 (keeping 200 days of data) [2025-10-02T18:56:18.152872] [DEBUG] [REMOTE ] FGSN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T18:56:18.161495] [WARN ] [REMOTE ] FGSN: No data returned for month 2024-12 [2025-10-02T18:56:18.168760] [DEBUG] [LOCAL ] FGN: Primary data saved (3909 records). [2025-10-02T18:56:18.169025] [INFO ] [MAIN ] FGN: Full history saved. [2025-10-02T18:56:18.168931] [FATAL] [REMOTE ] FGSN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T18:56:18.169248] [INFO ] [MAIN ] Update Progress: 827/2370 symbols completed. FGN took 30.8s. Estimated remaining: 3h 36m 53s. Rate: 7.1 symbols/min [2025-10-02T18:56:18.174780] [FATAL] [MAIN ] FGSN: Failed to fetch primary data. [2025-10-02T18:56:18.238025] [WARN ] [MAIN ] FGSN: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T18:56:18.250307] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-02T18:56:18.278828] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-02T18:56:18.279034] [INFO ] [LOCAL ] FGSN: Starting deletion of derivative data. [2025-10-02T18:56:18.279409] [DEBUG] [LOCAL ] FGSN: No derivative data file found to delete. [2025-10-02T18:56:18.285026] [INFO ] [MAIN ] Update Progress: 828/2370 symbols completed. FGSN took 2.6s. Estimated remaining: 3h 36m 29s. Rate: 7.1 symbols/min [2025-10-02T18:56:18.487424] [INFO ] [MAIN ] FHN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:56:18.579682] [INFO ] [MAIN ] FI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:56:18.642162] [DEBUG] [LOCAL ] FHN: Loaded 53365 existing records from primary storage. [2025-10-02T18:56:18.642502] [INFO ] [MAIN ] FHN: Loaded 53365 existing records. [2025-10-02T18:56:18.677462] [INFO ] [REMOTE ] FHI: Fetching primary data for 2024-12. [2025-10-02T18:56:18.882141] [WARN ] [MAIN ] FHN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:56:18.882431] [INFO ] [MAIN ] FHN: Wiping existing primary data before full refresh. [2025-10-02T18:56:18.882485] [INFO ] [LOCAL ] FHN: Starting deletion of primary data. [2025-10-02T18:56:18.885353] [DEBUG] [LOCAL ] FHN: Deleted primary data file. [2025-10-02T18:56:18.885436] [INFO ] [MAIN ] FHN: Starting full primary refresh. [2025-10-02T18:56:18.885271] [DEBUG] [LOCAL ] FI: Loaded 53499 existing records from primary storage. [2025-10-02T18:56:18.954914] [INFO ] [MAIN ] FI: Loaded 53499 existing records. [2025-10-02T18:56:19.403956] [WARN ] [MAIN ] FI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:56:19.434764] [INFO ] [MAIN ] FI: Wiping existing primary data before full refresh. [2025-10-02T18:56:19.450463] [INFO ] [LOCAL ] FI: Starting deletion of primary data. [2025-10-02T18:56:19.473419] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-06. [2025-10-02T18:56:19.508330] [DEBUG] [LOCAL ] FI: Deleted primary data file. [2025-10-02T18:56:19.514596] [INFO ] [REMOTE ] FHN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:56:19.514680] [INFO ] [MAIN ] FI: Starting full primary refresh. [2025-10-02T18:56:19.918235] [INFO ] [REMOTE ] FI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:56:20.203399] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-02T18:56:20.272998] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-01. [2025-10-02T18:56:20.644550] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-02T18:56:21.072994] [INFO ] [REMOTE ] FHN: Fetching primary data for 2024-12. [2025-10-02T18:56:21.847767] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-02T18:56:21.872996] [INFO ] [REMOTE ] FI: Fetching primary data for 2024-12. [2025-10-02T18:56:22.672987] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-07. [2025-10-02T18:56:22.810013] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-02T18:56:23.472987] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-02. [2025-10-02T18:56:23.675003] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-02T18:56:23.759532] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-02T18:56:24.272998] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-01. [2025-10-02T18:56:24.591739] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-02T18:56:25.072994] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-03. [2025-10-02T18:56:25.872985] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-08. [2025-10-02T18:56:26.025048] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-02T18:56:26.658830] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-02T18:56:26.672953] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-04. [2025-10-02T18:56:26.799036] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-02T18:56:27.473001] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-02. [2025-10-02T18:56:28.112213] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-02T18:56:28.273041] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-09. [2025-10-02T18:56:29.072982] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-05. [2025-10-02T18:56:29.214629] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-02T18:56:29.296598] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-02T18:56:29.873069] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-01. [2025-10-02T18:56:30.440692] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-02T18:56:30.673099] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-10. [2025-10-02T18:56:31.472986] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-06. [2025-10-02T18:56:31.543191] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-02T18:56:31.544417] [INFO ] [REMOTE ] FG: Full fetch complete (27709 records). [2025-10-02T18:56:31.544497] [DEBUG] [VALIDATOR ] FG: Validating primary data. [2025-10-02T18:56:31.924190] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-02T18:56:32.018807] [DEBUG] [VALIDATOR ] FG: All expected trading days are present. [2025-10-02T18:56:32.018891] [DEBUG] [VALIDATOR ] FG: Primary data validation passed. [2025-10-02T18:56:32.019469] [INFO ] [MAIN ] FG: Fetched primary data is valid. [2025-10-02T18:56:32.019510] [DEBUG] [LOCAL ] FG: Saving primary data. [2025-10-02T18:56:32.020279] [DEBUG] [LOCAL ] FG: Trimmed 27709 records to 22965 (keeping 200 days of data) [2025-10-02T18:56:32.167754] [DEBUG] [LOCAL ] FG: Primary data saved (22965 records). [2025-10-02T18:56:32.167893] [INFO ] [MAIN ] FG: Full history saved. [2025-10-02T18:56:32.167977] [INFO ] [MAIN ] Update Progress: 829/2370 symbols completed. FG took 45.2s. Estimated remaining: 3h 36m 30s. Rate: 7.1 symbols/min [2025-10-02T18:56:32.276594] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-02. [2025-10-02T18:56:32.357395] [INFO ] [MAIN ] FICO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:56:32.378671] [DEBUG] [LOCAL ] FICO: Loaded 20486 existing records from primary storage. [2025-10-02T18:56:32.378952] [INFO ] [MAIN ] FICO: Loaded 20486 existing records. [2025-10-02T18:56:32.578396] [WARN ] [MAIN ] FICO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:56:32.578636] [INFO ] [MAIN ] FICO: Wiping existing primary data before full refresh. [2025-10-02T18:56:32.578724] [INFO ] [LOCAL ] FICO: Starting deletion of primary data. [2025-10-02T18:56:32.579499] [DEBUG] [LOCAL ] FICO: Deleted primary data file. [2025-10-02T18:56:32.579560] [INFO ] [MAIN ] FICO: Starting full primary refresh. [2025-10-02T18:56:32.995522] [INFO ] [REMOTE ] FICO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:56:33.073046] [INFO ] [REMOTE ] FICO: Fetching primary data for 2024-12. [2025-10-02T18:56:33.113130] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-02T18:56:33.872991] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-07. [2025-10-02T18:56:33.956282] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-02T18:56:34.043463] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-02T18:56:34.673019] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-03. [2025-10-02T18:56:35.280186] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-02T18:56:35.473026] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-01. [2025-10-02T18:56:36.273011] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-03. [2025-10-02T18:56:36.470333] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-02T18:56:36.563174] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-02T18:56:37.073030] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-02. [2025-10-02T18:56:37.872984] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-08. [2025-10-02T18:56:37.951564] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-02T18:56:37.979858] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-02T18:56:38.673045] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-04. [2025-10-02T18:56:39.098664] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-02T18:56:39.473000] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-03. [2025-10-02T18:56:40.242272] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-02T18:56:40.272969] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-04. [2025-10-02T18:56:40.500762] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-02T18:56:41.073018] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-09. [2025-10-02T18:56:41.365923] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-02T18:56:41.872992] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-05. [2025-10-02T18:56:42.428462] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-02T18:56:42.673009] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-10. [2025-10-02T18:56:42.801499] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-02T18:56:43.473012] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-05. [2025-10-02T18:56:44.068227] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-02T18:56:44.070097] [INFO ] [REMOTE ] FHI: Full fetch complete (57756 records). [2025-10-02T18:56:44.070297] [DEBUG] [VALIDATOR ] FHI: Validating primary data. [2025-10-02T18:56:44.278593] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-06. [2025-10-02T18:56:44.507622] [DEBUG] [VALIDATOR ] FHI: All expected trading days are present. [2025-10-02T18:56:44.507762] [DEBUG] [VALIDATOR ] FHI: Primary data validation passed. [2025-10-02T18:56:44.508712] [INFO ] [MAIN ] FHI: Fetched primary data is valid. [2025-10-02T18:56:44.508782] [DEBUG] [LOCAL ] FHI: Saving primary data. [2025-10-02T18:56:44.510220] [DEBUG] [LOCAL ] FHI: Trimmed 57756 records to 40514 (keeping 200 days of data) [2025-10-02T18:56:44.774424] [DEBUG] [LOCAL ] FHI: Primary data saved (40514 records). [2025-10-02T18:56:44.774556] [INFO ] [MAIN ] FHI: Full history saved. [2025-10-02T18:56:44.774672] [INFO ] [MAIN ] Update Progress: 830/2370 symbols completed. FHI took 27.9s. Estimated remaining: 3h 36m 30s. Rate: 7.1 symbols/min [2025-10-02T18:56:44.968451] [INFO ] [MAIN ] FIG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:56:44.968940] [DEBUG] [LOCAL ] FIG: No existing data file found in primary storage. [2025-10-02T18:56:44.969182] [WARN ] [MAIN ] FIG: No existing data found, performing full refresh instead. [2025-10-02T18:56:44.969391] [INFO ] [MAIN ] FIG: Wiping existing primary data before full refresh. [2025-10-02T18:56:44.969506] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-02T18:56:44.969624] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-02T18:56:44.969783] [INFO ] [MAIN ] FIG: Starting full primary refresh. [2025-10-02T18:56:45.073831] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-04. [2025-10-02T18:56:45.347260] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-02T18:56:45.449637] [INFO ] [REMOTE ] FIG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:56:45.468459] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-02T18:56:45.873018] [INFO ] [REMOTE ] FIG: Fetching primary data for 2024-12. [2025-10-02T18:56:46.200260] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-10-02T18:56:46.673006] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-07. [2025-10-02T18:56:47.024290] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-02T18:56:47.473053] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-05. [2025-10-02T18:56:48.016190] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-02T18:56:48.273034] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-06. [2025-10-02T18:56:49.072985] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-08. [2025-10-02T18:56:49.460811] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-02T18:56:49.872966] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-06. [2025-10-02T18:56:49.983901] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-02T18:56:50.215998] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-02T18:56:50.673041] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-07. [2025-10-02T18:56:51.481350] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-09. [2025-10-02T18:56:51.500169] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-02T18:56:52.272999] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-07. [2025-10-02T18:56:52.432967] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-02T18:56:52.561288] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-02T18:56:53.073043] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-01. [2025-10-02T18:56:53.305968] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-01 (0.23 seconds). [2025-10-02T18:56:53.873008] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-02. [2025-10-02T18:56:54.168719] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-02T18:56:54.184112] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-02T18:56:54.672995] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-03. [2025-10-02T18:56:54.910192] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-10-02T18:56:55.473060] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-04. [2025-10-02T18:56:55.710137] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-04 (0.24 seconds). [2025-10-02T18:56:56.273010] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-05. [2025-10-02T18:56:56.570001] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-02T18:56:57.073029] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-10. [2025-10-02T18:56:57.873011] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-08. [2025-10-02T18:56:58.444107] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-02T18:56:58.445803] [INFO ] [REMOTE ] FICO: Full fetch complete (28702 records). [2025-10-02T18:56:58.445895] [DEBUG] [VALIDATOR ] FICO: Validating primary data. [2025-10-02T18:56:58.680949] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-08. [2025-10-02T18:56:58.862735] [DEBUG] [VALIDATOR ] FICO: All expected trading days are present. [2025-10-02T18:56:58.862826] [DEBUG] [VALIDATOR ] FICO: Primary data validation passed. [2025-10-02T18:56:58.863447] [INFO ] [MAIN ] FICO: Fetched primary data is valid. [2025-10-02T18:56:58.863521] [DEBUG] [LOCAL ] FICO: Saving primary data. [2025-10-02T18:56:58.864298] [DEBUG] [LOCAL ] FICO: Trimmed 28702 records to 20838 (keeping 200 days of data) [2025-10-02T18:56:59.002247] [DEBUG] [LOCAL ] FICO: Primary data saved (20838 records). [2025-10-02T18:56:59.002377] [INFO ] [MAIN ] FICO: Full history saved. [2025-10-02T18:56:59.002460] [INFO ] [MAIN ] Update Progress: 831/2370 symbols completed. FICO took 26.8s. Estimated remaining: 3h 36m 32s. Rate: 7.1 symbols/min [2025-10-02T18:56:59.178744] [INFO ] [MAIN ] FIGS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:56:59.229400] [DEBUG] [LOCAL ] FIGS: Loaded 48826 existing records from primary storage. [2025-10-02T18:56:59.229742] [INFO ] [MAIN ] FIGS: Loaded 48826 existing records. [2025-10-02T18:56:59.445844] [WARN ] [MAIN ] FIGS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:56:59.446046] [INFO ] [MAIN ] FIGS: Wiping existing primary data before full refresh. [2025-10-02T18:56:59.446093] [INFO ] [LOCAL ] FIGS: Starting deletion of primary data. [2025-10-02T18:56:59.447997] [DEBUG] [LOCAL ] FIGS: Deleted primary data file. [2025-10-02T18:56:59.448058] [INFO ] [MAIN ] FIGS: Starting full primary refresh. [2025-10-02T18:56:59.486957] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-06. [2025-10-02T18:56:59.758873] [DEBUG] [REMOTE ] FIG: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T18:56:59.763928] [WARN ] [REMOTE ] FIG: No data returned for month 2025-06 [2025-10-02T18:56:59.790532] [FATAL] [REMOTE ] FIG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T18:56:59.813744] [FATAL] [MAIN ] FIG: Failed to fetch primary data. [2025-10-02T18:56:59.845980] [WARN ] [MAIN ] FIG: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T18:56:59.846116] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-02T18:56:59.853359] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-02T18:56:59.853505] [INFO ] [LOCAL ] FIG: Starting deletion of derivative data. [2025-10-02T18:56:59.853154] [INFO ] [REMOTE ] FIGS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:56:59.854053] [DEBUG] [LOCAL ] FIG: No derivative data file found to delete. [2025-10-02T18:56:59.854199] [INFO ] [MAIN ] Update Progress: 832/2370 symbols completed. FIG took 15.1s. Estimated remaining: 3h 36m 10s. Rate: 7.1 symbols/min [2025-10-02T18:57:00.077365] [INFO ] [MAIN ] FIHL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:57:00.080791] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-02T18:57:00.140984] [DEBUG] [LOCAL ] FIHL: Loaded 39863 existing records from primary storage. [2025-10-02T18:57:00.141307] [INFO ] [MAIN ] FIHL: Loaded 39863 existing records. [2025-10-02T18:57:00.278194] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-09. [2025-10-02T18:57:00.342001] [WARN ] [MAIN ] FIHL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:57:00.342386] [INFO ] [MAIN ] FIHL: Wiping existing primary data before full refresh. [2025-10-02T18:57:00.342458] [INFO ] [LOCAL ] FIHL: Starting deletion of primary data. [2025-10-02T18:57:00.346026] [DEBUG] [LOCAL ] FIHL: Deleted primary data file. [2025-10-02T18:57:00.346093] [INFO ] [MAIN ] FIHL: Starting full primary refresh. [2025-10-02T18:57:00.681871] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-02T18:57:00.809164] [INFO ] [REMOTE ] FIHL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:57:01.073023] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2024-12. [2025-10-02T18:57:01.873045] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2024-12. [2025-10-02T18:57:02.265774] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-02T18:57:02.672974] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-10. [2025-10-02T18:57:03.097280] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-02T18:57:03.136307] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-02T18:57:03.473005] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-09. [2025-10-02T18:57:04.272967] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-01. [2025-10-02T18:57:04.495693] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-02T18:57:04.497922] [INFO ] [REMOTE ] FI: Full fetch complete (77175 records). [2025-10-02T18:57:04.498050] [DEBUG] [VALIDATOR ] FI: Validating primary data. [2025-10-02T18:57:04.950759] [DEBUG] [VALIDATOR ] FI: All expected trading days are present. [2025-10-02T18:57:04.950953] [DEBUG] [VALIDATOR ] FI: Primary data validation passed. [2025-10-02T18:57:04.951982] [INFO ] [MAIN ] FI: Fetched primary data is valid. [2025-10-02T18:57:04.952068] [DEBUG] [LOCAL ] FI: Saving primary data. [2025-10-02T18:57:04.953927] [DEBUG] [LOCAL ] FI: Trimmed 77175 records to 53888 (keeping 200 days of data) [2025-10-02T18:57:05.078154] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-02T18:57:05.073726] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-01. [2025-10-02T18:57:05.339820] [DEBUG] [LOCAL ] FI: Primary data saved (53888 records). [2025-10-02T18:57:05.339967] [INFO ] [MAIN ] FI: Full history saved. [2025-10-02T18:57:05.341217] [INFO ] [MAIN ] Update Progress: 833/2370 symbols completed. FI took 47.0s. Estimated remaining: 3h 35m 56s. Rate: 7.1 symbols/min [2025-10-02T18:57:05.532572] [INFO ] [MAIN ] FINS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:57:05.544592] [DEBUG] [LOCAL ] FINS: Loaded 8293 existing records from primary storage. [2025-10-02T18:57:05.544880] [INFO ] [MAIN ] FINS: Loaded 8293 existing records. [2025-10-02T18:57:05.754321] [WARN ] [MAIN ] FINS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:57:05.754618] [INFO ] [MAIN ] FINS: Wiping existing primary data before full refresh. [2025-10-02T18:57:05.754725] [INFO ] [LOCAL ] FINS: Starting deletion of primary data. [2025-10-02T18:57:05.755262] [DEBUG] [LOCAL ] FINS: Deleted primary data file. [2025-10-02T18:57:05.755324] [INFO ] [MAIN ] FINS: Starting full primary refresh. [2025-10-02T18:57:05.875242] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-10. [2025-10-02T18:57:06.152284] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-02T18:57:06.195387] [INFO ] [REMOTE ] FINS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:57:06.424597] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-02T18:57:06.673014] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-02. [2025-10-02T18:57:07.239764] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-02T18:57:07.241910] [INFO ] [REMOTE ] FHN: Full fetch complete (77281 records). [2025-10-02T18:57:07.242020] [DEBUG] [VALIDATOR ] FHN: Validating primary data. [2025-10-02T18:57:07.478230] [INFO ] [REMOTE ] FINS: Fetching primary data for 2024-12. [2025-10-02T18:57:07.689837] [DEBUG] [VALIDATOR ] FHN: All expected trading days are present. [2025-10-02T18:57:07.689943] [DEBUG] [VALIDATOR ] FHN: Primary data validation passed. [2025-10-02T18:57:07.691144] [INFO ] [MAIN ] FHN: Fetched primary data is valid. [2025-10-02T18:57:07.691214] [DEBUG] [LOCAL ] FHN: Saving primary data. [2025-10-02T18:57:07.693024] [DEBUG] [LOCAL ] FHN: Trimmed 77281 records to 53755 (keeping 200 days of data) [2025-10-02T18:57:08.057822] [DEBUG] [LOCAL ] FHN: Primary data saved (53755 records). [2025-10-02T18:57:08.057979] [INFO ] [MAIN ] FHN: Full history saved. [2025-10-02T18:57:08.058070] [INFO ] [MAIN ] Update Progress: 834/2370 symbols completed. FHN took 49.9s. Estimated remaining: 3h 35m 37s. Rate: 7.1 symbols/min [2025-10-02T18:57:08.248637] [INFO ] [MAIN ] FINV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:57:08.275725] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-02. [2025-10-02T18:57:08.277258] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-02T18:57:08.328681] [DEBUG] [LOCAL ] FINV: Loaded 45304 existing records from primary storage. [2025-10-02T18:57:08.329054] [INFO ] [MAIN ] FINV: Loaded 45304 existing records. [2025-10-02T18:57:08.511069] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-02T18:57:08.534276] [WARN ] [MAIN ] FINV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:57:08.538961] [INFO ] [MAIN ] FINV: Wiping existing primary data before full refresh. [2025-10-02T18:57:08.539025] [INFO ] [LOCAL ] FINV: Starting deletion of primary data. [2025-10-02T18:57:08.540637] [DEBUG] [LOCAL ] FINV: Deleted primary data file. [2025-10-02T18:57:08.540723] [INFO ] [MAIN ] FINV: Starting full primary refresh. [2025-10-02T18:57:08.998740] [INFO ] [REMOTE ] FINV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:57:09.073003] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-03. [2025-10-02T18:57:09.574250] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-02T18:57:09.872999] [INFO ] [REMOTE ] FINV: Fetching primary data for 2024-12. [2025-10-02T18:57:10.684802] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-03. [2025-10-02T18:57:10.688761] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-02T18:57:11.473001] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-04. [2025-10-02T18:57:11.724911] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-02T18:57:12.273069] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-01. [2025-10-02T18:57:13.060570] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-10-02T18:57:13.081925] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-04. [2025-10-02T18:57:13.105403] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-02T18:57:13.814707] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-02T18:57:13.873025] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-01. [2025-10-02T18:57:14.552932] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-02T18:57:14.585963] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-02T18:57:14.673019] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-05. [2025-10-02T18:57:15.473013] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-02. [2025-10-02T18:57:16.282639] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-05. [2025-10-02T18:57:16.288278] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-02T18:57:17.006331] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-02T18:57:17.073011] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-06. [2025-10-02T18:57:17.673483] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-02T18:57:17.873009] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-03. [2025-10-02T18:57:18.673006] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-06. [2025-10-02T18:57:18.774412] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-02T18:57:19.289458] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-02T18:57:19.472995] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-04. [2025-10-02T18:57:19.734184] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-02T18:57:20.273004] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-02. [2025-10-02T18:57:20.783226] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-02T18:57:20.924348] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-02T18:57:21.072999] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-05. [2025-10-02T18:57:21.872999] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-03. [2025-10-02T18:57:22.476283] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-02T18:57:22.673452] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-07. [2025-10-02T18:57:22.680509] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-02T18:57:23.473010] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-07. [2025-10-02T18:57:24.163779] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-02T18:57:24.272997] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-04. [2025-10-02T18:57:24.785751] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-02T18:57:25.073042] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-06. [2025-10-02T18:57:25.143912] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-02T18:57:25.872995] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-08. [2025-10-02T18:57:26.293448] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-02T18:57:26.672997] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-05. [2025-10-02T18:57:27.473043] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-07. [2025-10-02T18:57:27.640597] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-02T18:57:27.686582] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-02T18:57:28.273045] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-06. [2025-10-02T18:57:28.911778] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-02T18:57:29.079374] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-08. [2025-10-02T18:57:29.105166] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-02T18:57:29.873044] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-08. [2025-10-02T18:57:30.673054] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-09. [2025-10-02T18:57:30.903302] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-02T18:57:31.473005] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-09. [2025-10-02T18:57:31.528301] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-02T18:57:32.199893] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-02T18:57:32.273041] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-07. [2025-10-02T18:57:32.892188] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-02T18:57:32.921021] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-02T18:57:33.073020] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-08. [2025-10-02T18:57:33.666246] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-02T18:57:33.872993] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-09. [2025-10-02T18:57:34.500283] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-02T18:57:34.673078] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-10. [2025-10-02T18:57:35.473002] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-09. [2025-10-02T18:57:35.910959] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-02T18:57:35.913018] [INFO ] [REMOTE ] FIHL: Full fetch complete (55807 records). [2025-10-02T18:57:35.913120] [DEBUG] [VALIDATOR ] FIHL: Validating primary data. [2025-10-02T18:57:36.283929] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-10. [2025-10-02T18:57:36.341704] [DEBUG] [VALIDATOR ] FIHL: All expected trading days are present. [2025-10-02T18:57:36.341805] [DEBUG] [VALIDATOR ] FIHL: Primary data validation passed. [2025-10-02T18:57:36.342613] [INFO ] [MAIN ] FIHL: Fetched primary data is valid. [2025-10-02T18:57:36.342700] [DEBUG] [LOCAL ] FIHL: Saving primary data. [2025-10-02T18:57:36.343942] [DEBUG] [LOCAL ] FIHL: Trimmed 55807 records to 40141 (keeping 200 days of data) [2025-10-02T18:57:36.616993] [DEBUG] [LOCAL ] FIHL: Primary data saved (40141 records). [2025-10-02T18:57:36.617206] [INFO ] [MAIN ] FIHL: Full history saved. [2025-10-02T18:57:36.617321] [INFO ] [MAIN ] Update Progress: 835/2370 symbols completed. FIHL took 36.8s. Estimated remaining: 3h 36m 5s. Rate: 7.1 symbols/min [2025-10-02T18:57:36.806033] [INFO ] [MAIN ] FIS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:57:36.862243] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-02T18:57:36.864343] [DEBUG] [LOCAL ] FIS: Loaded 53361 existing records from primary storage. [2025-10-02T18:57:36.864609] [INFO ] [REMOTE ] FINS: Full fetch complete (12314 records). [2025-10-02T18:57:36.864829] [DEBUG] [VALIDATOR ] FINS: Validating primary data. [2025-10-02T18:57:36.865254] [INFO ] [MAIN ] FIS: Loaded 53361 existing records. [2025-10-02T18:57:37.078322] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-10. [2025-10-02T18:57:37.265419] [WARN ] [MAIN ] FIS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:57:37.313903] [INFO ] [MAIN ] FIS: Wiping existing primary data before full refresh. [2025-10-02T18:57:37.371639] [INFO ] [LOCAL ] FIS: Starting deletion of primary data. [2025-10-02T18:57:37.429967] [DEBUG] [LOCAL ] FIS: Deleted primary data file. [2025-10-02T18:57:37.445591] [INFO ] [MAIN ] FIS: Starting full primary refresh. [2025-10-02T18:57:37.594299] [DEBUG] [VALIDATOR ] FINS: All expected trading days are present. [2025-10-02T18:57:37.637520] [DEBUG] [VALIDATOR ] FINS: Primary data validation passed. [2025-10-02T18:57:37.638683] [INFO ] [MAIN ] FINS: Fetched primary data is valid. [2025-10-02T18:57:37.643956] [DEBUG] [LOCAL ] FINS: Saving primary data. [2025-10-02T18:57:37.661885] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-02T18:57:37.696528] [DEBUG] [LOCAL ] FINS: Trimmed 12314 records to 8316 (keeping 200 days of data) [2025-10-02T18:57:37.878207] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-10. [2025-10-02T18:57:38.009873] [DEBUG] [LOCAL ] FINS: Primary data saved (8316 records). [2025-10-02T18:57:38.029387] [INFO ] [MAIN ] FINS: Full history saved. [2025-10-02T18:57:38.044286] [INFO ] [MAIN ] Update Progress: 836/2370 symbols completed. FINS took 32.7s. Estimated remaining: 3h 35m 44s. Rate: 7.1 symbols/min [2025-10-02T18:57:38.044173] [INFO ] [REMOTE ] FIS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:57:38.242028] [INFO ] [MAIN ] FIX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:57:38.273400] [DEBUG] [LOCAL ] FIX: Loaded 29792 existing records from primary storage. [2025-10-02T18:57:38.273725] [INFO ] [MAIN ] FIX: Loaded 29792 existing records. [2025-10-02T18:57:38.475689] [WARN ] [MAIN ] FIX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:57:38.475917] [INFO ] [MAIN ] FIX: Wiping existing primary data before full refresh. [2025-10-02T18:57:38.475968] [INFO ] [LOCAL ] FIX: Starting deletion of primary data. [2025-10-02T18:57:38.479112] [DEBUG] [LOCAL ] FIX: Deleted primary data file. [2025-10-02T18:57:38.479221] [INFO ] [MAIN ] FIX: Starting full primary refresh. [2025-10-02T18:57:38.609269] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-02T18:57:38.640007] [INFO ] [REMOTE ] FIGS: Full fetch complete (71008 records). [2025-10-02T18:57:38.697608] [INFO ] [REMOTE ] FIS: Fetching primary data for 2024-12. [2025-10-02T18:57:38.698001] [DEBUG] [VALIDATOR ] FIGS: Validating primary data. [2025-10-02T18:57:39.193068] [INFO ] [REMOTE ] FIX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:57:39.287088] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-02T18:57:39.327379] [INFO ] [REMOTE ] FINV: Full fetch complete (63567 records). [2025-10-02T18:57:39.339569] [DEBUG] [VALIDATOR ] FINV: Validating primary data. [2025-10-02T18:57:39.378857] [DEBUG] [VALIDATOR ] FIGS: All expected trading days are present. [2025-10-02T18:57:39.378963] [DEBUG] [VALIDATOR ] FIGS: Primary data validation passed. [2025-10-02T18:57:39.379923] [INFO ] [MAIN ] FIGS: Fetched primary data is valid. [2025-10-02T18:57:39.380047] [DEBUG] [LOCAL ] FIGS: Saving primary data. [2025-10-02T18:57:39.482368] [INFO ] [REMOTE ] FIX: Fetching primary data for 2024-12. [2025-10-02T18:57:39.495332] [DEBUG] [LOCAL ] FIGS: Trimmed 71008 records to 49208 (keeping 200 days of data) [2025-10-02T18:57:39.910460] [DEBUG] [VALIDATOR ] FINV: All expected trading days are present. [2025-10-02T18:57:39.910924] [DEBUG] [VALIDATOR ] FINV: Primary data validation passed. [2025-10-02T18:57:39.912394] [INFO ] [MAIN ] FINV: Fetched primary data is valid. [2025-10-02T18:57:39.912845] [DEBUG] [LOCAL ] FINV: Saving primary data. [2025-10-02T18:57:39.918261] [DEBUG] [LOCAL ] FINV: Trimmed 63567 records to 45625 (keeping 200 days of data) [2025-10-02T18:57:40.344768] [DEBUG] [LOCAL ] FIGS: Primary data saved (49208 records). [2025-10-02T18:57:40.346429] [INFO ] [MAIN ] FIGS: Full history saved. [2025-10-02T18:57:40.348051] [INFO ] [MAIN ] Update Progress: 837/2370 symbols completed. FIGS took 41.3s. Estimated remaining: 3h 35m 24s. Rate: 7.1 symbols/min [2025-10-02T18:57:40.399303] [DEBUG] [LOCAL ] FINV: Primary data saved (45625 records). [2025-10-02T18:57:40.399519] [INFO ] [MAIN ] FINV: Full history saved. [2025-10-02T18:57:40.399691] [INFO ] [MAIN ] Update Progress: 838/2370 symbols completed. FINV took 32.3s. Estimated remaining: 3h 35m 1s. Rate: 7.1 symbols/min [2025-10-02T18:57:40.531837] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-02T18:57:40.543877] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-01. [2025-10-02T18:57:40.564226] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-02T18:57:41.073035] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-01. [2025-10-02T18:57:42.347877] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-02T18:57:42.360474] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-02. [2025-10-02T18:57:42.505078] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-02T18:57:42.673002] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-02. [2025-10-02T18:57:44.130569] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-02T18:57:44.141099] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-03. [2025-10-02T18:57:44.623586] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-02T18:57:44.632182] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-03. [2025-10-02T18:57:45.594514] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-02T18:57:45.607790] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-04. [2025-10-02T18:57:45.944862] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-02T18:57:45.954027] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-04. [2025-10-02T18:57:47.367020] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-02T18:57:47.378789] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-05. [2025-10-02T18:57:47.452239] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-02T18:57:47.472990] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-05. [2025-10-02T18:57:48.995605] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-02T18:57:49.002868] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-06. [2025-10-02T18:57:49.281345] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-02T18:57:49.292900] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-06. [2025-10-02T18:57:50.226091] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-02T18:57:50.233500] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-07. [2025-10-02T18:57:51.043884] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-02T18:57:51.055983] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-07. [2025-10-02T18:57:51.597723] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-02T18:57:51.605035] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-08. [2025-10-02T18:57:52.871086] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-02T18:57:52.878605] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-09. [2025-10-02T18:57:52.927786] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-02T18:57:53.073067] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-08. [2025-10-02T18:57:53.965137] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-02T18:57:53.972073] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-10. [2025-10-02T18:57:54.512585] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-02T18:57:54.673032] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-09. [2025-10-02T18:57:55.264089] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-02T18:57:55.265896] [INFO ] [REMOTE ] FIX: Full fetch complete (45479 records). [2025-10-02T18:57:55.266013] [DEBUG] [VALIDATOR ] FIX: Validating primary data. [2025-10-02T18:57:55.703876] [DEBUG] [VALIDATOR ] FIX: All expected trading days are present. [2025-10-02T18:57:55.703980] [DEBUG] [VALIDATOR ] FIX: Primary data validation passed. [2025-10-02T18:57:55.704709] [INFO ] [MAIN ] FIX: Fetched primary data is valid. [2025-10-02T18:57:55.704776] [DEBUG] [LOCAL ] FIX: Saving primary data. [2025-10-02T18:57:55.706382] [DEBUG] [LOCAL ] FIX: Trimmed 45479 records to 29974 (keeping 200 days of data) [2025-10-02T18:57:55.923884] [DEBUG] [LOCAL ] FIX: Primary data saved (29974 records). [2025-10-02T18:57:55.924027] [INFO ] [MAIN ] FIX: Full history saved. [2025-10-02T18:57:55.924113] [INFO ] [MAIN ] Update Progress: 839/2370 symbols completed. FIX took 17.9s. Estimated remaining: 3h 35m 5s. Rate: 7.1 symbols/min [2025-10-02T18:57:56.554609] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-02T18:57:56.566985] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-10. [2025-10-02T18:57:58.019172] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-02T18:57:58.024729] [INFO ] [REMOTE ] FIS: Full fetch complete (77180 records). [2025-10-02T18:57:58.024915] [DEBUG] [VALIDATOR ] FIS: Validating primary data. [2025-10-02T18:57:58.468792] [DEBUG] [VALIDATOR ] FIS: All expected trading days are present. [2025-10-02T18:57:58.468876] [DEBUG] [VALIDATOR ] FIS: Primary data validation passed. [2025-10-02T18:57:58.469794] [INFO ] [MAIN ] FIS: Fetched primary data is valid. [2025-10-02T18:57:58.469861] [DEBUG] [LOCAL ] FIS: Saving primary data. [2025-10-02T18:57:58.471627] [DEBUG] [LOCAL ] FIS: Trimmed 77180 records to 53751 (keeping 200 days of data) [2025-10-02T18:57:58.828973] [DEBUG] [LOCAL ] FIS: Primary data saved (53751 records). [2025-10-02T18:57:58.829140] [INFO ] [MAIN ] FIS: Full history saved. [2025-10-02T18:57:58.829292] [INFO ] [MAIN ] Update Progress: 840/2370 symbols completed. FIS took 22.2s. Estimated remaining: 3h 34m 47s. Rate: 7.1 symbols/min [2025-10-02T18:57:59.514966] [INFO ] [MAIN ] FLG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:57:59.550588] [INFO ] [MAIN ] FIXT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:57:59.611696] [INFO ] [MAIN ] FLC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:57:59.610398] [DEBUG] [LOCAL ] FIXT: No existing data file found in primary storage. [2025-10-02T18:57:59.612795] [WARN ] [MAIN ] FIXT: No existing data found, performing full refresh instead. [2025-10-02T18:57:59.639746] [INFO ] [MAIN ] FLNG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:57:59.640295] [INFO ] [MAIN ] FIXT: Wiping existing primary data before full refresh. [2025-10-02T18:57:59.640524] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-02T18:57:59.640996] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-02T18:57:59.641107] [INFO ] [MAIN ] FIXT: Starting full primary refresh. [2025-10-02T18:57:59.748861] [DEBUG] [LOCAL ] FLC: Loaded 5422 existing records from primary storage. [2025-10-02T18:57:59.779186] [INFO ] [MAIN ] FLC: Loaded 5422 existing records. [2025-10-02T18:58:00.067165] [DEBUG] [LOCAL ] FLNG: Loaded 33707 existing records from primary storage. [2025-10-02T18:58:00.094550] [DEBUG] [LOCAL ] FLG: Loaded 53320 existing records from primary storage. [2025-10-02T18:58:00.137852] [INFO ] [MAIN ] FLNG: Loaded 33707 existing records. [2025-10-02T18:58:00.137712] [INFO ] [MAIN ] FLG: Loaded 53320 existing records. [2025-10-02T18:58:00.553929] [WARN ] [MAIN ] FLC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:58:00.574334] [INFO ] [MAIN ] FLC: Wiping existing primary data before full refresh. [2025-10-02T18:58:00.550710] [INFO ] [REMOTE ] FIXT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:58:00.574851] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2024-12. [2025-10-02T18:58:00.575165] [INFO ] [LOCAL ] FLC: Starting deletion of primary data. [2025-10-02T18:58:00.643845] [DEBUG] [LOCAL ] FLC: Deleted primary data file. [2025-10-02T18:58:00.649630] [INFO ] [MAIN ] FLC: Starting full primary refresh. [2025-10-02T18:58:00.822055] [WARN ] [MAIN ] FLG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:58:00.874858] [INFO ] [MAIN ] FLG: Wiping existing primary data before full refresh. [2025-10-02T18:58:00.923184] [INFO ] [LOCAL ] FLG: Starting deletion of primary data. [2025-10-02T18:58:00.922938] [WARN ] [MAIN ] FLNG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:58:00.939229] [INFO ] [MAIN ] FLNG: Wiping existing primary data before full refresh. [2025-10-02T18:58:00.939323] [DEBUG] [LOCAL ] FLG: Deleted primary data file. [2025-10-02T18:58:00.965301] [INFO ] [MAIN ] FLG: Starting full primary refresh. [2025-10-02T18:58:00.944499] [INFO ] [LOCAL ] FLNG: Starting deletion of primary data. [2025-10-02T18:58:00.982029] [DEBUG] [LOCAL ] FLNG: Deleted primary data file. [2025-10-02T18:58:00.988638] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T18:58:00.988723] [INFO ] [MAIN ] FLNG: Starting full primary refresh. [2025-10-02T18:58:01.048162] [WARN ] [REMOTE ] FIXT: No data returned for month 2024-12 [2025-10-02T18:58:01.097840] [FATAL] [REMOTE ] FIXT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T18:58:01.133993] [FATAL] [MAIN ] FIXT: Failed to fetch primary data. [2025-10-02T18:58:01.218525] [WARN ] [MAIN ] FIXT: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T18:58:01.376786] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-02T18:58:01.428136] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-02T18:58:01.525697] [INFO ] [LOCAL ] FIXT: Starting deletion of derivative data. [2025-10-02T18:58:01.651302] [DEBUG] [LOCAL ] FIXT: No derivative data file found to delete. [2025-10-02T18:58:01.665638] [INFO ] [REMOTE ] FLC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:58:01.720906] [INFO ] [REMOTE ] FLC: Fetching primary data for 2024-12. [2025-10-02T18:58:01.726239] [INFO ] [MAIN ] Update Progress: 841/2370 symbols completed. FIXT took 2.9s. Estimated remaining: 3h 34m 28s. Rate: 7.1 symbols/min [2025-10-02T18:58:02.155059] [INFO ] [REMOTE ] FLNG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:58:02.227376] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2024-12. [2025-10-02T18:58:02.227039] [INFO ] [REMOTE ] FLG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:58:02.246584] [INFO ] [REMOTE ] FLG: Fetching primary data for 2024-12. [2025-10-02T18:58:02.246328] [INFO ] [MAIN ] FLO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:58:02.311888] [DEBUG] [LOCAL ] FLO: Loaded 51910 existing records from primary storage. [2025-10-02T18:58:02.312211] [INFO ] [MAIN ] FLO: Loaded 51910 existing records. [2025-10-02T18:58:02.503256] [WARN ] [MAIN ] FLO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:58:02.503580] [INFO ] [MAIN ] FLO: Wiping existing primary data before full refresh. [2025-10-02T18:58:02.503774] [INFO ] [LOCAL ] FLO: Starting deletion of primary data. [2025-10-02T18:58:02.508596] [DEBUG] [LOCAL ] FLO: Deleted primary data file. [2025-10-02T18:58:02.509203] [INFO ] [MAIN ] FLO: Starting full primary refresh. [2025-10-02T18:58:02.509403] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-02T18:58:02.545934] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-01. [2025-10-02T18:58:02.900448] [INFO ] [REMOTE ] FLO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:58:02.900781] [INFO ] [REMOTE ] FLO: Fetching primary data for 2024-12. [2025-10-02T18:58:03.066578] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-02T18:58:03.068470] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-02. [2025-10-02T18:58:03.381334] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-02T18:58:03.389458] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-01. [2025-10-02T18:58:03.668053] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-02T18:58:03.669713] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-03. [2025-10-02T18:58:04.068518] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-02T18:58:04.079718] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-01. [2025-10-02T18:58:04.152298] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-02T18:58:04.272991] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-04. [2025-10-02T18:58:04.351353] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-02T18:58:04.782159] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-02T18:58:04.996234] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-02T18:58:05.072991] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-01. [2025-10-02T18:58:05.873051] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-02. [2025-10-02T18:58:05.931999] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-02T18:58:06.505626] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-02T18:58:06.673074] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-02. [2025-10-02T18:58:07.307073] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-02T18:58:07.473009] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-05. [2025-10-02T18:58:08.102536] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-02T18:58:08.145523] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-02T18:58:08.273067] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-02. [2025-10-02T18:58:09.073051] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-06. [2025-10-02T18:58:09.703423] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-02T18:58:09.873039] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-03. [2025-10-02T18:58:09.911712] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-02T18:58:10.673044] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-03. [2025-10-02T18:58:11.364473] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-02T18:58:11.473004] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-04. [2025-10-02T18:58:12.273004] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-03. [2025-10-02T18:58:12.487181] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-02T18:58:12.779530] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-02T18:58:13.073021] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-07. [2025-10-02T18:58:13.762666] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-02T18:58:13.873003] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-08. [2025-10-02T18:58:14.036835] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-02T18:58:14.563347] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-02T18:58:14.673014] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-04. [2025-10-02T18:58:15.473036] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-05. [2025-10-02T18:58:16.273031] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-09. [2025-10-02T18:58:16.537665] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-02T18:58:16.774161] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-02T18:58:16.868199] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-02T18:58:17.072995] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-06. [2025-10-02T18:58:17.872999] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-05. [2025-10-02T18:58:18.400337] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-02T18:58:18.673006] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-10. [2025-10-02T18:58:19.135441] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-02T18:58:19.136283] [INFO ] [REMOTE ] FLC: Full fetch complete (7952 records). [2025-10-02T18:58:19.136377] [DEBUG] [VALIDATOR ] FLC: Validating primary data. [2025-10-02T18:58:19.483875] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-04. [2025-10-02T18:58:19.533103] [DEBUG] [VALIDATOR ] FLC: All expected trading days are present. [2025-10-02T18:58:19.533295] [DEBUG] [VALIDATOR ] FLC: Primary data validation passed. [2025-10-02T18:58:19.533528] [INFO ] [MAIN ] FLC: Fetched primary data is valid. [2025-10-02T18:58:19.533573] [DEBUG] [LOCAL ] FLC: Saving primary data. [2025-10-02T18:58:19.534072] [DEBUG] [LOCAL ] FLC: Trimmed 7952 records to 5441 (keeping 200 days of data) [2025-10-02T18:58:19.571864] [DEBUG] [LOCAL ] FLC: Primary data saved (5441 records). [2025-10-02T18:58:19.572010] [INFO ] [MAIN ] FLC: Full history saved. [2025-10-02T18:58:19.572131] [INFO ] [MAIN ] Update Progress: 842/2370 symbols completed. FLC took 20.7s. Estimated remaining: 3h 34m 37s. Rate: 7.1 symbols/min [2025-10-02T18:58:19.764532] [INFO ] [MAIN ] FLOC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:58:19.765046] [DEBUG] [LOCAL ] FLOC: No existing data file found in primary storage. [2025-10-02T18:58:19.765148] [WARN ] [MAIN ] FLOC: No existing data found, performing full refresh instead. [2025-10-02T18:58:19.765426] [INFO ] [MAIN ] FLOC: Wiping existing primary data before full refresh. [2025-10-02T18:58:19.765603] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-10-02T18:58:19.765775] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-10-02T18:58:19.765844] [INFO ] [MAIN ] FLOC: Starting full primary refresh. [2025-10-02T18:58:19.968473] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-02T18:58:20.216209] [INFO ] [REMOTE ] FLOC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:58:20.272984] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2024-12. [2025-10-02T18:58:20.457986] [DEBUG] [REMOTE ] FLOC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T18:58:20.458374] [WARN ] [REMOTE ] FLOC: No data returned for month 2024-12 [2025-10-02T18:58:20.458468] [FATAL] [REMOTE ] FLOC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T18:58:20.458549] [FATAL] [MAIN ] FLOC: Failed to fetch primary data. [2025-10-02T18:58:20.458616] [WARN ] [MAIN ] FLOC: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T18:58:20.458710] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-10-02T18:58:20.458775] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-10-02T18:58:20.458813] [INFO ] [LOCAL ] FLOC: Starting deletion of derivative data. [2025-10-02T18:58:20.458853] [DEBUG] [LOCAL ] FLOC: No derivative data file found to delete. [2025-10-02T18:58:20.458902] [INFO ] [MAIN ] Update Progress: 843/2370 symbols completed. FLOC took 0.9s. Estimated remaining: 3h 34m 15s. Rate: 7.1 symbols/min [2025-10-02T18:58:20.643287] [INFO ] [MAIN ] FLR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:58:20.703090] [DEBUG] [LOCAL ] FLR: Loaded 53125 existing records from primary storage. [2025-10-02T18:58:20.703472] [INFO ] [MAIN ] FLR: Loaded 53125 existing records. [2025-10-02T18:58:20.912319] [WARN ] [MAIN ] FLR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:58:20.912536] [INFO ] [MAIN ] FLR: Wiping existing primary data before full refresh. [2025-10-02T18:58:20.912587] [INFO ] [LOCAL ] FLR: Starting deletion of primary data. [2025-10-02T18:58:20.914782] [DEBUG] [LOCAL ] FLR: Deleted primary data file. [2025-10-02T18:58:20.914854] [INFO ] [MAIN ] FLR: Starting full primary refresh. [2025-10-02T18:58:21.080275] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-07. [2025-10-02T18:58:21.315931] [INFO ] [REMOTE ] FLR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:58:21.346521] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-02T18:58:21.873020] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-06. [2025-10-02T18:58:22.672984] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-05. [2025-10-02T18:58:22.675308] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-02T18:58:23.473020] [INFO ] [REMOTE ] FLR: Fetching primary data for 2024-12. [2025-10-02T18:58:23.646597] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-02T18:58:24.077751] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-02T18:58:24.273000] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-07. [2025-10-02T18:58:25.072999] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-08. [2025-10-02T18:58:25.212282] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-02T18:58:25.872967] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-01. [2025-10-02T18:58:26.189730] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-02T18:58:26.504877] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-02T18:58:26.673044] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-08. [2025-10-02T18:58:27.277146] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-02T18:58:27.473021] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-02. [2025-10-02T18:58:28.154382] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-02T18:58:28.272997] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-09. [2025-10-02T18:58:29.072971] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-06. [2025-10-02T18:58:29.108706] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-02T18:58:29.714808] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-02T18:58:29.872999] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-09. [2025-10-02T18:58:30.673042] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-10. [2025-10-02T18:58:30.848625] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-02T18:58:31.473029] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-03. [2025-10-02T18:58:31.530991] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-02T18:58:31.631168] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-02T18:58:31.632611] [INFO ] [REMOTE ] FLNG: Full fetch complete (50599 records). [2025-10-02T18:58:31.632758] [DEBUG] [VALIDATOR ] FLNG: Validating primary data. [2025-10-02T18:58:32.066338] [DEBUG] [VALIDATOR ] FLNG: All expected trading days are present. [2025-10-02T18:58:32.066424] [DEBUG] [VALIDATOR ] FLNG: Primary data validation passed. [2025-10-02T18:58:32.067217] [INFO ] [MAIN ] FLNG: Fetched primary data is valid. [2025-10-02T18:58:32.067283] [DEBUG] [LOCAL ] FLNG: Saving primary data. [2025-10-02T18:58:32.068548] [DEBUG] [LOCAL ] FLNG: Trimmed 50599 records to 33928 (keeping 200 days of data) [2025-10-02T18:58:32.286591] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-10. [2025-10-02T18:58:32.316956] [DEBUG] [LOCAL ] FLNG: Primary data saved (33928 records). [2025-10-02T18:58:32.317111] [INFO ] [MAIN ] FLNG: Full history saved. [2025-10-02T18:58:32.317216] [INFO ] [MAIN ] Update Progress: 844/2370 symbols completed. FLNG took 33.5s. Estimated remaining: 3h 34m 13s. Rate: 7.1 symbols/min [2025-10-02T18:58:32.518170] [INFO ] [MAIN ] FLS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:58:32.566257] [DEBUG] [LOCAL ] FLS: Loaded 50175 existing records from primary storage. [2025-10-02T18:58:32.566719] [INFO ] [MAIN ] FLS: Loaded 50175 existing records. [2025-10-02T18:58:32.779372] [WARN ] [MAIN ] FLS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:58:32.779615] [INFO ] [MAIN ] FLS: Wiping existing primary data before full refresh. [2025-10-02T18:58:32.779695] [INFO ] [LOCAL ] FLS: Starting deletion of primary data. [2025-10-02T18:58:32.782434] [DEBUG] [LOCAL ] FLS: Deleted primary data file. [2025-10-02T18:58:32.782503] [INFO ] [MAIN ] FLS: Starting full primary refresh. [2025-10-02T18:58:33.084781] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-07. [2025-10-02T18:58:33.219758] [INFO ] [REMOTE ] FLS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:58:33.254353] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-02T18:58:33.664932] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-02T18:58:33.667285] [INFO ] [REMOTE ] FLG: Full fetch complete (77307 records). [2025-10-02T18:58:33.667488] [DEBUG] [VALIDATOR ] FLG: Validating primary data. [2025-10-02T18:58:33.881583] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-04. [2025-10-02T18:58:34.101136] [DEBUG] [VALIDATOR ] FLG: All expected trading days are present. [2025-10-02T18:58:34.101223] [DEBUG] [VALIDATOR ] FLG: Primary data validation passed. [2025-10-02T18:58:34.102234] [INFO ] [MAIN ] FLG: Fetched primary data is valid. [2025-10-02T18:58:34.102305] [DEBUG] [LOCAL ] FLG: Saving primary data. [2025-10-02T18:58:34.103929] [DEBUG] [LOCAL ] FLG: Trimmed 77307 records to 53710 (keeping 200 days of data) [2025-10-02T18:58:34.468553] [DEBUG] [LOCAL ] FLG: Primary data saved (53710 records). [2025-10-02T18:58:34.468736] [INFO ] [MAIN ] FLG: Full history saved. [2025-10-02T18:58:34.468837] [INFO ] [MAIN ] Update Progress: 845/2370 symbols completed. FLG took 35.6s. Estimated remaining: 3h 33m 53s. Rate: 7.1 symbols/min [2025-10-02T18:58:34.666265] [INFO ] [MAIN ] FLUT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:58:34.672970] [INFO ] [REMOTE ] FLS: Fetching primary data for 2024-12. [2025-10-02T18:58:34.716891] [DEBUG] [LOCAL ] FLUT: Loaded 50788 existing records from primary storage. [2025-10-02T18:58:34.717415] [INFO ] [MAIN ] FLUT: Loaded 50788 existing records. [2025-10-02T18:58:34.926624] [WARN ] [MAIN ] FLUT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:58:34.926934] [INFO ] [MAIN ] FLUT: Wiping existing primary data before full refresh. [2025-10-02T18:58:34.927040] [INFO ] [LOCAL ] FLUT: Starting deletion of primary data. [2025-10-02T18:58:34.939779] [DEBUG] [LOCAL ] FLUT: Deleted primary data file. [2025-10-02T18:58:34.958830] [INFO ] [MAIN ] FLUT: Starting full primary refresh. [2025-10-02T18:58:35.036219] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-02T18:58:35.376619] [INFO ] [REMOTE ] FLUT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:58:35.473005] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-08. [2025-10-02T18:58:35.703025] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-02T18:58:35.920785] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-02T18:58:36.273005] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2024-12. [2025-10-02T18:58:37.072988] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-01. [2025-10-02T18:58:37.294811] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-02T18:58:37.872984] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-05. [2025-10-02T18:58:37.972274] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-02T18:58:38.228463] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-02T18:58:38.673021] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-09. [2025-10-02T18:58:39.355015] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-02T18:58:39.473024] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-02. [2025-10-02T18:58:40.272981] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-06. [2025-10-02T18:58:40.530209] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-02T18:58:40.830868] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-02T18:58:41.073000] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-10. [2025-10-02T18:58:41.873009] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-03. [2025-10-02T18:58:41.985797] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-02T18:58:42.585226] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-02T18:58:42.587419] [INFO ] [REMOTE ] FLO: Full fetch complete (75017 records). [2025-10-02T18:58:42.587547] [DEBUG] [VALIDATOR ] FLO: Validating primary data. [2025-10-02T18:58:42.678908] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-07. [2025-10-02T18:58:43.025171] [DEBUG] [VALIDATOR ] FLO: All expected trading days are present. [2025-10-02T18:58:43.025266] [DEBUG] [VALIDATOR ] FLO: Primary data validation passed. [2025-10-02T18:58:43.026214] [INFO ] [MAIN ] FLO: Fetched primary data is valid. [2025-10-02T18:58:43.026285] [DEBUG] [LOCAL ] FLO: Saving primary data. [2025-10-02T18:58:43.027860] [DEBUG] [LOCAL ] FLO: Trimmed 75017 records to 52293 (keeping 200 days of data) [2025-10-02T18:58:43.304252] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-02T18:58:43.416393] [DEBUG] [LOCAL ] FLO: Primary data saved (52293 records). [2025-10-02T18:58:43.416552] [INFO ] [MAIN ] FLO: Full history saved. [2025-10-02T18:58:43.416661] [INFO ] [MAIN ] Update Progress: 846/2370 symbols completed. FLO took 41.7s. Estimated remaining: 3h 33m 45s. Rate: 7.1 symbols/min [2025-10-02T18:58:43.482532] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-01. [2025-10-02T18:58:43.595785] [INFO ] [MAIN ] FLXR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:58:43.618051] [DEBUG] [LOCAL ] FLXR: Loaded 20437 existing records from primary storage. [2025-10-02T18:58:43.618361] [INFO ] [MAIN ] FLXR: Loaded 20437 existing records. [2025-10-02T18:58:43.807234] [WARN ] [MAIN ] FLXR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:58:43.807458] [INFO ] [MAIN ] FLXR: Wiping existing primary data before full refresh. [2025-10-02T18:58:43.807507] [INFO ] [LOCAL ] FLXR: Starting deletion of primary data. [2025-10-02T18:58:43.808219] [DEBUG] [LOCAL ] FLXR: Deleted primary data file. [2025-10-02T18:58:43.808279] [INFO ] [MAIN ] FLXR: Starting full primary refresh. [2025-10-02T18:58:44.184261] [INFO ] [REMOTE ] FLXR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:58:44.273020] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2024-12. [2025-10-02T18:58:44.747592] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-02T18:58:44.781783] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-02T18:58:45.072970] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-01. [2025-10-02T18:58:45.168345] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-02T18:58:45.872790] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-02T18:58:45.873067] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-04. [2025-10-02T18:58:46.672998] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-02. [2025-10-02T18:58:47.472993] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-02. [2025-10-02T18:58:47.517790] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-02T18:58:47.629307] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-02T18:58:48.273017] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-03. [2025-10-02T18:58:49.072985] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-08. [2025-10-02T18:58:49.153524] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-02T18:58:49.389618] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-02T18:58:49.873013] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-04. [2025-10-02T18:58:50.673006] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-05. [2025-10-02T18:58:50.990793] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-02T18:58:51.012141] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-02T18:58:51.473040] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-03. [2025-10-02T18:58:52.272962] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-05. [2025-10-02T18:58:52.307751] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-02T18:58:53.073049] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-06. [2025-10-02T18:58:53.272017] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-02T18:58:53.577992] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-02T18:58:53.872998] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-06. [2025-10-02T18:58:54.632722] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-02T18:58:54.672989] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-07. [2025-10-02T18:58:54.813030] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-02T18:58:55.473027] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-09. [2025-10-02T18:58:56.272994] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-04. [2025-10-02T18:58:56.449568] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-02T18:58:56.939338] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-02T18:58:57.073007] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-08. [2025-10-02T18:58:57.873002] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-10. [2025-10-02T18:58:58.214026] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-02T18:58:58.673012] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-05. [2025-10-02T18:58:58.799281] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-02T18:58:59.289908] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-02T18:58:59.292051] [INFO ] [REMOTE ] FLR: Full fetch complete (76449 records). [2025-10-02T18:58:59.292176] [DEBUG] [VALIDATOR ] FLR: Validating primary data. [2025-10-02T18:58:59.474760] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-09. [2025-10-02T18:58:59.702970] [DEBUG] [VALIDATOR ] FLR: All expected trading days are present. [2025-10-02T18:58:59.703062] [DEBUG] [VALIDATOR ] FLR: Primary data validation passed. [2025-10-02T18:58:59.704045] [INFO ] [MAIN ] FLR: Fetched primary data is valid. [2025-10-02T18:58:59.704115] [DEBUG] [LOCAL ] FLR: Saving primary data. [2025-10-02T18:58:59.705613] [DEBUG] [LOCAL ] FLR: Trimmed 76449 records to 53509 (keeping 200 days of data) [2025-10-02T18:59:00.042211] [DEBUG] [LOCAL ] FLR: Primary data saved (53509 records). [2025-10-02T18:59:00.042379] [INFO ] [MAIN ] FLR: Full history saved. [2025-10-02T18:59:00.042483] [INFO ] [MAIN ] Update Progress: 847/2370 symbols completed. FLR took 39.6s. Estimated remaining: 3h 33m 52s. Rate: 7.1 symbols/min [2025-10-02T18:59:00.232167] [INFO ] [MAIN ] FMC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:59:00.282511] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-07. [2025-10-02T18:59:00.286070] [DEBUG] [LOCAL ] FMC: Loaded 51782 existing records from primary storage. [2025-10-02T18:59:00.286521] [INFO ] [MAIN ] FMC: Loaded 51782 existing records. [2025-10-02T18:59:00.491675] [WARN ] [MAIN ] FMC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:59:00.521540] [INFO ] [MAIN ] FMC: Wiping existing primary data before full refresh. [2025-10-02T18:59:00.521691] [INFO ] [LOCAL ] FMC: Starting deletion of primary data. [2025-10-02T18:59:00.524893] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-02T18:59:00.524982] [DEBUG] [LOCAL ] FMC: Deleted primary data file. [2025-10-02T18:59:00.540383] [INFO ] [MAIN ] FMC: Starting full primary refresh. [2025-10-02T18:59:00.967844] [INFO ] [REMOTE ] FMC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:59:01.072979] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-06. [2025-10-02T18:59:01.376304] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-02T18:59:01.420358] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-02T18:59:01.872997] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-08. [2025-10-02T18:59:02.672988] [INFO ] [REMOTE ] FMC: Fetching primary data for 2024-12. [2025-10-02T18:59:02.835793] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-02T18:59:02.882343] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-02T18:59:03.473001] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-07. [2025-10-02T18:59:04.273008] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-10. [2025-10-02T18:59:04.371741] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-02T18:59:04.947487] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-02T18:59:05.073010] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-08. [2025-10-02T18:59:05.780042] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-02T18:59:05.782161] [INFO ] [REMOTE ] FLS: Full fetch complete (71629 records). [2025-10-02T18:59:05.782284] [DEBUG] [VALIDATOR ] FLS: Validating primary data. [2025-10-02T18:59:05.880821] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-01. [2025-10-02T18:59:06.219580] [DEBUG] [VALIDATOR ] FLS: All expected trading days are present. [2025-10-02T18:59:06.219709] [DEBUG] [VALIDATOR ] FLS: Primary data validation passed. [2025-10-02T18:59:06.220637] [INFO ] [MAIN ] FLS: Fetched primary data is valid. [2025-10-02T18:59:06.220732] [DEBUG] [LOCAL ] FLS: Saving primary data. [2025-10-02T18:59:06.222348] [DEBUG] [LOCAL ] FLS: Trimmed 71629 records to 50554 (keeping 200 days of data) [2025-10-02T18:59:06.548826] [DEBUG] [LOCAL ] FLS: Primary data saved (50554 records). [2025-10-02T18:59:06.548970] [INFO ] [MAIN ] FLS: Full history saved. [2025-10-02T18:59:06.549060] [INFO ] [MAIN ] Update Progress: 848/2370 symbols completed. FLS took 34.2s. Estimated remaining: 3h 33m 40s. Rate: 7.1 symbols/min [2025-10-02T18:59:06.674890] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-09. [2025-10-02T18:59:06.741705] [INFO ] [MAIN ] FMN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:59:06.749978] [DEBUG] [LOCAL ] FMN: Loaded 5591 existing records from primary storage. [2025-10-02T18:59:06.750546] [INFO ] [MAIN ] FMN: Loaded 5591 existing records. [2025-10-02T18:59:06.945110] [WARN ] [MAIN ] FMN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:59:06.945458] [INFO ] [MAIN ] FMN: Wiping existing primary data before full refresh. [2025-10-02T18:59:06.945604] [INFO ] [LOCAL ] FMN: Starting deletion of primary data. [2025-10-02T18:59:06.946061] [DEBUG] [LOCAL ] FMN: Deleted primary data file. [2025-10-02T18:59:06.946128] [INFO ] [MAIN ] FMN: Starting full primary refresh. [2025-10-02T18:59:07.077067] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-02T18:59:07.418611] [INFO ] [REMOTE ] FMN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:59:07.473019] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-09. [2025-10-02T18:59:07.554325] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-02T18:59:07.595001] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-02T18:59:08.273011] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-02. [2025-10-02T18:59:09.072978] [INFO ] [REMOTE ] FMN: Fetching primary data for 2024-12. [2025-10-02T18:59:09.249070] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-02T18:59:09.765694] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-02T18:59:09.872969] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-01. [2025-10-02T18:59:10.016325] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-02T18:59:10.673585] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-02T18:59:10.673176] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-03. [2025-10-02T18:59:11.473011] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-10. [2025-10-02T18:59:12.272979] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-02. [2025-10-02T18:59:12.452819] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-02T18:59:12.454886] [INFO ] [REMOTE ] FLXR: Full fetch complete (25692 records). [2025-10-02T18:59:12.455454] [DEBUG] [VALIDATOR ] FLXR: Validating primary data. [2025-10-02T18:59:12.457689] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-02T18:59:12.822479] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-02T18:59:12.898265] [DEBUG] [VALIDATOR ] FLXR: All expected trading days are present. [2025-10-02T18:59:12.898357] [DEBUG] [VALIDATOR ] FLXR: Primary data validation passed. [2025-10-02T18:59:12.898969] [INFO ] [MAIN ] FLXR: Fetched primary data is valid. [2025-10-02T18:59:12.899033] [DEBUG] [LOCAL ] FLXR: Saving primary data. [2025-10-02T18:59:12.899769] [DEBUG] [LOCAL ] FLXR: Trimmed 25692 records to 20621 (keeping 200 days of data) [2025-10-02T18:59:13.033473] [DEBUG] [LOCAL ] FLXR: Primary data saved (20621 records). [2025-10-02T18:59:13.033606] [INFO ] [MAIN ] FLXR: Full history saved. [2025-10-02T18:59:13.033712] [INFO ] [MAIN ] Update Progress: 849/2370 symbols completed. FLXR took 29.6s. Estimated remaining: 3h 33m 28s. Rate: 7.1 symbols/min [2025-10-02T18:59:13.078163] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-03. [2025-10-02T18:59:13.215739] [INFO ] [MAIN ] FMS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:59:13.246504] [DEBUG] [LOCAL ] FMS: Loaded 30083 existing records from primary storage. [2025-10-02T18:59:13.246830] [INFO ] [MAIN ] FMS: Loaded 30083 existing records. [2025-10-02T18:59:13.433564] [WARN ] [MAIN ] FMS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:59:13.433810] [INFO ] [MAIN ] FMS: Wiping existing primary data before full refresh. [2025-10-02T18:59:13.433860] [INFO ] [LOCAL ] FMS: Starting deletion of primary data. [2025-10-02T18:59:13.435319] [DEBUG] [LOCAL ] FMS: Deleted primary data file. [2025-10-02T18:59:13.435380] [INFO ] [MAIN ] FMS: Starting full primary refresh. [2025-10-02T18:59:13.860569] [INFO ] [REMOTE ] FMS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:59:13.869631] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-02T18:59:13.872950] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-04. [2025-10-02T18:59:14.584469] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-02T18:59:14.672995] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-05. [2025-10-02T18:59:15.250083] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-02T18:59:15.473037] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-06. [2025-10-02T18:59:16.127316] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-02T18:59:16.273001] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-10. [2025-10-02T18:59:17.072993] [INFO ] [REMOTE ] FMS: Fetching primary data for 2024-12. [2025-10-02T18:59:17.873009] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-07. [2025-10-02T18:59:17.976472] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-02T18:59:17.978705] [INFO ] [REMOTE ] FLUT: Full fetch complete (72895 records). [2025-10-02T18:59:17.978903] [DEBUG] [VALIDATOR ] FLUT: Validating primary data. [2025-10-02T18:59:18.450691] [DEBUG] [VALIDATOR ] FLUT: All expected trading days are present. [2025-10-02T18:59:18.451428] [DEBUG] [VALIDATOR ] FLUT: Primary data validation passed. [2025-10-02T18:59:18.452028] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-02T18:59:18.453055] [INFO ] [MAIN ] FLUT: Fetched primary data is valid. [2025-10-02T18:59:18.455090] [DEBUG] [LOCAL ] FLUT: Saving primary data. [2025-10-02T18:59:18.460680] [DEBUG] [LOCAL ] FLUT: Trimmed 72895 records to 51173 (keeping 200 days of data) [2025-10-02T18:59:18.555846] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-02T18:59:18.683159] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-08. [2025-10-02T18:59:18.796168] [DEBUG] [LOCAL ] FLUT: Primary data saved (51173 records). [2025-10-02T18:59:18.796381] [INFO ] [MAIN ] FLUT: Full history saved. [2025-10-02T18:59:18.796497] [INFO ] [MAIN ] Update Progress: 850/2370 symbols completed. FLUT took 44.3s. Estimated remaining: 3h 33m 15s. Rate: 7.1 symbols/min [2025-10-02T18:59:18.985569] [INFO ] [MAIN ] FMX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:59:19.026359] [DEBUG] [LOCAL ] FMX: Loaded 40731 existing records from primary storage. [2025-10-02T18:59:19.026693] [INFO ] [MAIN ] FMX: Loaded 40731 existing records. [2025-10-02T18:59:19.141696] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-02T18:59:19.226866] [WARN ] [MAIN ] FMX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:59:19.227144] [INFO ] [MAIN ] FMX: Wiping existing primary data before full refresh. [2025-10-02T18:59:19.227204] [INFO ] [LOCAL ] FMX: Starting deletion of primary data. [2025-10-02T18:59:19.228712] [DEBUG] [LOCAL ] FMX: Deleted primary data file. [2025-10-02T18:59:19.228778] [INFO ] [MAIN ] FMX: Starting full primary refresh. [2025-10-02T18:59:19.478259] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-01. [2025-10-02T18:59:19.614162] [INFO ] [REMOTE ] FMX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:59:20.273003] [INFO ] [REMOTE ] FMX: Fetching primary data for 2024-12. [2025-10-02T18:59:20.680128] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-02T18:59:21.073045] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-04. [2025-10-02T18:59:21.702832] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-02T18:59:21.873001] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-09. [2025-10-02T18:59:22.495539] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-02T18:59:22.673031] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-01. [2025-10-02T18:59:22.839148] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-02T18:59:23.473043] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-02. [2025-10-02T18:59:24.071242] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-02T18:59:24.273050] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-05. [2025-10-02T18:59:24.588951] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-02T18:59:25.073019] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-10. [2025-10-02T18:59:25.589866] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-02T18:59:25.590724] [INFO ] [REMOTE ] FMN: Full fetch complete (9952 records). [2025-10-02T18:59:25.590797] [DEBUG] [VALIDATOR ] FMN: Validating primary data. [2025-10-02T18:59:25.875768] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-03. [2025-10-02T18:59:26.022726] [DEBUG] [VALIDATOR ] FMN: All expected trading days are present. [2025-10-02T18:59:26.022940] [DEBUG] [VALIDATOR ] FMN: Primary data validation passed. [2025-10-02T18:59:26.023363] [INFO ] [MAIN ] FMN: Fetched primary data is valid. [2025-10-02T18:59:26.023446] [DEBUG] [LOCAL ] FMN: Saving primary data. [2025-10-02T18:59:26.024260] [DEBUG] [LOCAL ] FMN: Trimmed 9952 records to 5624 (keeping 200 days of data) [2025-10-02T18:59:26.085877] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-02T18:59:26.103789] [DEBUG] [LOCAL ] FMN: Primary data saved (5624 records). [2025-10-02T18:59:26.103935] [INFO ] [MAIN ] FMN: Full history saved. [2025-10-02T18:59:26.104021] [INFO ] [MAIN ] Update Progress: 851/2370 symbols completed. FMN took 19.6s. Estimated remaining: 3h 33m 4s. Rate: 7.1 symbols/min [2025-10-02T18:59:26.288085] [INFO ] [MAIN ] FMY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:59:26.291295] [DEBUG] [LOCAL ] FMY: Loaded 1397 existing records from primary storage. [2025-10-02T18:59:26.291443] [INFO ] [MAIN ] FMY: Loaded 1397 existing records. [2025-10-02T18:59:26.476906] [WARN ] [MAIN ] FMY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:59:26.477135] [INFO ] [MAIN ] FMY: Wiping existing primary data before full refresh. [2025-10-02T18:59:26.477185] [INFO ] [LOCAL ] FMY: Starting deletion of primary data. [2025-10-02T18:59:26.477439] [DEBUG] [LOCAL ] FMY: Deleted primary data file. [2025-10-02T18:59:26.477501] [INFO ] [MAIN ] FMY: Starting full primary refresh. [2025-10-02T18:59:26.683612] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-02. [2025-10-02T18:59:26.884103] [INFO ] [REMOTE ] FMY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:59:27.251073] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-02T18:59:27.473005] [INFO ] [REMOTE ] FMY: Fetching primary data for 2024-12. [2025-10-02T18:59:27.835008] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-10-02T18:59:27.899825] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-02T18:59:28.272997] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-03. [2025-10-02T18:59:29.073044] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-01. [2025-10-02T18:59:29.447684] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-02T18:59:29.845959] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-02T18:59:29.872964] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-04. [2025-10-02T18:59:30.673000] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-04. [2025-10-02T18:59:31.127589] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-02T18:59:31.473041] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-02. [2025-10-02T18:59:31.883773] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-02T18:59:32.064170] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-02T18:59:32.273043] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-03. [2025-10-02T18:59:32.643302] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-02T18:59:33.073033] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-04. [2025-10-02T18:59:33.550477] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-02T18:59:33.873023] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-05. [2025-10-02T18:59:34.164296] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-02T18:59:34.673047] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-05. [2025-10-02T18:59:35.472971] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-06. [2025-10-02T18:59:35.802280] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-02T18:59:35.924595] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-02T18:59:36.273052] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-06. [2025-10-02T18:59:37.073047] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-07. [2025-10-02T18:59:37.345521] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-10-02T18:59:37.873007] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-05. [2025-10-02T18:59:37.943385] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-02T18:59:38.673014] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-06. [2025-10-02T18:59:39.440068] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-02T18:59:39.472962] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-08. [2025-10-02T18:59:39.501500] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-02T18:59:39.924877] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-02T18:59:40.273013] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-09. [2025-10-02T18:59:40.571362] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-02T18:59:41.073000] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-06. [2025-10-02T18:59:41.872972] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-10. [2025-10-02T18:59:42.267280] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-02T18:59:42.267975] [INFO ] [REMOTE ] FMY: Full fetch complete (1972 records). [2025-10-02T18:59:42.268182] [DEBUG] [VALIDATOR ] FMY: Validating primary data. [2025-10-02T18:59:42.622486] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-02T18:59:42.680434] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-07. [2025-10-02T18:59:42.704504] [DEBUG] [VALIDATOR ] FMY: All expected trading days are present. [2025-10-02T18:59:42.704587] [DEBUG] [VALIDATOR ] FMY: Primary data validation passed. [2025-10-02T18:59:42.704730] [INFO ] [MAIN ] FMY: Fetched primary data is valid. [2025-10-02T18:59:42.704790] [DEBUG] [LOCAL ] FMY: Saving primary data. [2025-10-02T18:59:42.705185] [DEBUG] [LOCAL ] FMY: Trimmed 1972 records to 1399 (keeping 200 days of data) [2025-10-02T18:59:42.715095] [DEBUG] [LOCAL ] FMY: Primary data saved (1399 records). [2025-10-02T18:59:42.715166] [INFO ] [MAIN ] FMY: Full history saved. [2025-10-02T18:59:42.715246] [INFO ] [MAIN ] Update Progress: 852/2370 symbols completed. FMY took 16.6s. Estimated remaining: 3h 33m 11s. Rate: 7.1 symbols/min [2025-10-02T18:59:42.894194] [INFO ] [MAIN ] FN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:59:42.934349] [DEBUG] [LOCAL ] FN: Loaded 38577 existing records from primary storage. [2025-10-02T18:59:42.934729] [INFO ] [MAIN ] FN: Loaded 38577 existing records. [2025-10-02T18:59:43.129301] [WARN ] [MAIN ] FN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:59:43.129520] [INFO ] [MAIN ] FN: Wiping existing primary data before full refresh. [2025-10-02T18:59:43.129570] [INFO ] [LOCAL ] FN: Starting deletion of primary data. [2025-10-02T18:59:43.131315] [DEBUG] [LOCAL ] FN: Deleted primary data file. [2025-10-02T18:59:43.131378] [INFO ] [MAIN ] FN: Starting full primary refresh. [2025-10-02T18:59:43.479524] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-07. [2025-10-02T18:59:43.525069] [INFO ] [REMOTE ] FN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:59:43.933769] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-02T18:59:44.273034] [INFO ] [REMOTE ] FN: Fetching primary data for 2024-12. [2025-10-02T18:59:44.948283] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-02T18:59:45.073044] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-07. [2025-10-02T18:59:45.590129] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-02T18:59:45.873014] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-01. [2025-10-02T18:59:46.673031] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-08. [2025-10-02T18:59:46.932897] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-02T18:59:47.320225] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-02T18:59:47.473073] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-08. [2025-10-02T18:59:47.771789] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-02T18:59:48.273041] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-02. [2025-10-02T18:59:49.072966] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-08. [2025-10-02T18:59:49.229406] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-02T18:59:49.497988] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-02T18:59:49.873019] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-03. [2025-10-02T18:59:50.574336] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-02T18:59:50.673011] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-09. [2025-10-02T18:59:51.125638] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-02T18:59:51.473033] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-09. [2025-10-02T18:59:52.236127] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-02T18:59:52.272981] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-10. [2025-10-02T18:59:52.858743] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-02T18:59:53.073008] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-09. [2025-10-02T18:59:53.625983] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-02T18:59:53.628377] [INFO ] [REMOTE ] FMC: Full fetch complete (75111 records). [2025-10-02T18:59:53.628514] [DEBUG] [VALIDATOR ] FMC: Validating primary data. [2025-10-02T18:59:53.880577] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-10. [2025-10-02T18:59:54.069257] [DEBUG] [VALIDATOR ] FMC: All expected trading days are present. [2025-10-02T18:59:54.069379] [DEBUG] [VALIDATOR ] FMC: Primary data validation passed. [2025-10-02T18:59:54.070486] [INFO ] [MAIN ] FMC: Fetched primary data is valid. [2025-10-02T18:59:54.070580] [DEBUG] [LOCAL ] FMC: Saving primary data. [2025-10-02T18:59:54.072323] [DEBUG] [LOCAL ] FMC: Trimmed 75111 records to 52171 (keeping 200 days of data) [2025-10-02T18:59:54.357147] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-02T18:59:54.465856] [DEBUG] [LOCAL ] FMC: Primary data saved (52171 records). [2025-10-02T18:59:54.466023] [INFO ] [MAIN ] FMC: Full history saved. [2025-10-02T18:59:54.466111] [INFO ] [MAIN ] Update Progress: 853/2370 symbols completed. FMC took 54.4s. Estimated remaining: 3h 33m 8s. Rate: 7.1 symbols/min [2025-10-02T18:59:54.651117] [INFO ] [MAIN ] FNB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:59:54.682370] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-04. [2025-10-02T18:59:54.708796] [DEBUG] [LOCAL ] FNB: Loaded 52458 existing records from primary storage. [2025-10-02T18:59:54.709188] [INFO ] [MAIN ] FNB: Loaded 52458 existing records. [2025-10-02T18:59:54.909840] [WARN ] [MAIN ] FNB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:59:54.910069] [INFO ] [MAIN ] FNB: Wiping existing primary data before full refresh. [2025-10-02T18:59:54.910123] [INFO ] [LOCAL ] FNB: Starting deletion of primary data. [2025-10-02T18:59:54.913336] [DEBUG] [LOCAL ] FNB: Deleted primary data file. [2025-10-02T18:59:54.913428] [INFO ] [MAIN ] FNB: Starting full primary refresh. [2025-10-02T18:59:55.272172] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-02T18:59:55.304890] [INFO ] [REMOTE ] FMX: Full fetch complete (57910 records). [2025-10-02T18:59:55.309665] [INFO ] [REMOTE ] FNB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:59:55.310000] [DEBUG] [VALIDATOR ] FMX: Validating primary data. [2025-10-02T18:59:55.482442] [INFO ] [REMOTE ] FNB: Fetching primary data for 2024-12. [2025-10-02T18:59:55.745107] [DEBUG] [VALIDATOR ] FMX: All expected trading days are present. [2025-10-02T18:59:55.745199] [DEBUG] [VALIDATOR ] FMX: Primary data validation passed. [2025-10-02T18:59:55.745965] [INFO ] [MAIN ] FMX: Fetched primary data is valid. [2025-10-02T18:59:55.746033] [DEBUG] [LOCAL ] FMX: Saving primary data. [2025-10-02T18:59:55.747472] [DEBUG] [LOCAL ] FMX: Trimmed 57910 records to 40981 (keeping 200 days of data) [2025-10-02T18:59:56.004829] [DEBUG] [LOCAL ] FMX: Primary data saved (40981 records). [2025-10-02T18:59:56.004963] [INFO ] [MAIN ] FMX: Full history saved. [2025-10-02T18:59:56.005047] [INFO ] [MAIN ] Update Progress: 854/2370 symbols completed. FMX took 37.2s. Estimated remaining: 3h 32m 47s. Rate: 7.1 symbols/min [2025-10-02T18:59:56.199031] [INFO ] [MAIN ] FND: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:59:56.251688] [DEBUG] [LOCAL ] FND: Loaded 52101 existing records from primary storage. [2025-10-02T18:59:56.252039] [INFO ] [MAIN ] FND: Loaded 52101 existing records. [2025-10-02T18:59:56.278253] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-10. [2025-10-02T18:59:56.487413] [WARN ] [MAIN ] FND: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:59:56.490283] [INFO ] [MAIN ] FND: Wiping existing primary data before full refresh. [2025-10-02T18:59:56.490402] [INFO ] [LOCAL ] FND: Starting deletion of primary data. [2025-10-02T18:59:56.490156] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-02T18:59:56.499411] [DEBUG] [LOCAL ] FND: Deleted primary data file. [2025-10-02T18:59:56.499712] [INFO ] [MAIN ] FND: Starting full primary refresh. [2025-10-02T18:59:56.897966] [INFO ] [REMOTE ] FND: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:59:56.935248] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-02T18:59:57.072988] [INFO ] [REMOTE ] FND: Fetching primary data for 2024-12. [2025-10-02T18:59:57.237346] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-02T18:59:57.238879] [INFO ] [REMOTE ] FMS: Full fetch complete (42389 records). [2025-10-02T18:59:57.238981] [DEBUG] [VALIDATOR ] FMS: Validating primary data. [2025-10-02T18:59:57.699475] [DEBUG] [VALIDATOR ] FMS: All expected trading days are present. [2025-10-02T18:59:57.699572] [DEBUG] [VALIDATOR ] FMS: Primary data validation passed. [2025-10-02T18:59:57.700221] [INFO ] [MAIN ] FMS: Fetched primary data is valid. [2025-10-02T18:59:57.700289] [DEBUG] [LOCAL ] FMS: Saving primary data. [2025-10-02T18:59:57.701549] [DEBUG] [LOCAL ] FMS: Trimmed 42389 records to 30247 (keeping 200 days of data) [2025-10-02T18:59:57.880106] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-01. [2025-10-02T18:59:57.904761] [DEBUG] [LOCAL ] FMS: Primary data saved (30247 records). [2025-10-02T18:59:57.904919] [INFO ] [MAIN ] FMS: Full history saved. [2025-10-02T18:59:57.906691] [INFO ] [MAIN ] Update Progress: 855/2370 symbols completed. FMS took 44.9s. Estimated remaining: 3h 32m 27s. Rate: 7.1 symbols/min [2025-10-02T18:59:58.123775] [INFO ] [MAIN ] FNF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:59:58.123962] [DEBUG] [LOCAL ] FNF: No existing data file found in primary storage. [2025-10-02T18:59:58.124002] [WARN ] [MAIN ] FNF: No existing data found, performing full refresh instead. [2025-10-02T18:59:58.124115] [INFO ] [MAIN ] FNF: Wiping existing primary data before full refresh. [2025-10-02T18:59:58.124157] [INFO ] [LOCAL ] FNF: Starting deletion of primary data. [2025-10-02T18:59:58.124199] [DEBUG] [LOCAL ] FNF: No primary data file found to delete. [2025-10-02T18:59:58.124232] [INFO ] [MAIN ] FNF: Starting full primary refresh. [2025-10-02T18:59:58.591487] [INFO ] [REMOTE ] FNF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:59:58.623761] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-02T18:59:58.672971] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-01. [2025-10-02T18:59:59.117838] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-02T18:59:59.473007] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-05. [2025-10-02T19:00:00.188911] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-02T19:00:00.273043] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-02. [2025-10-02T19:00:01.034320] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-02T19:00:01.072999] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-02. [2025-10-02T19:00:01.873029] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-06. [2025-10-02T19:00:02.036899] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-02T19:00:02.586663] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-02T19:00:02.673005] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-03. [2025-10-02T19:00:03.476083] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-03. [2025-10-02T19:00:03.482799] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-02T19:00:04.228764] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-02T19:00:04.272981] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-07. [2025-10-02T19:00:05.072997] [INFO ] [REMOTE ] FNF: Fetching primary data for 2024-12. [2025-10-02T19:00:05.252085] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-02T19:00:05.382085] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-02T19:00:05.873021] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-08. [2025-10-02T19:00:06.612207] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-02T19:00:06.673041] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-01. [2025-10-02T19:00:07.472978] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-04. [2025-10-02T19:00:07.591681] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-02T19:00:08.014120] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-02T19:00:08.273003] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-02. [2025-10-02T19:00:09.072989] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-04. [2025-10-02T19:00:09.270157] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-02T19:00:09.844439] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-02T19:00:09.872999] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-05. [2025-10-02T19:00:10.673030] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-09. [2025-10-02T19:00:10.793853] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-02T19:00:11.473012] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-05. [2025-10-02T19:00:11.698087] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-02T19:00:12.131386] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-02T19:00:12.272991] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-10. [2025-10-02T19:00:13.073056] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-06. [2025-10-02T19:00:13.184732] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-02T19:00:13.407219] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-02T19:00:13.413402] [INFO ] [REMOTE ] FN: Full fetch complete (56304 records). [2025-10-02T19:00:13.413569] [DEBUG] [VALIDATOR ] FN: Validating primary data. [2025-10-02T19:00:13.851488] [DEBUG] [VALIDATOR ] FN: All expected trading days are present. [2025-10-02T19:00:13.851576] [DEBUG] [VALIDATOR ] FN: Primary data validation passed. [2025-10-02T19:00:13.852402] [INFO ] [MAIN ] FN: Fetched primary data is valid. [2025-10-02T19:00:13.852503] [DEBUG] [LOCAL ] FN: Saving primary data. [2025-10-02T19:00:13.854607] [DEBUG] [LOCAL ] FN: Trimmed 56304 records to 38785 (keeping 200 days of data) [2025-10-02T19:00:13.911377] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-06. [2025-10-02T19:00:14.100343] [DEBUG] [LOCAL ] FN: Primary data saved (38785 records). [2025-10-02T19:00:14.100532] [INFO ] [MAIN ] FN: Full history saved. [2025-10-02T19:00:14.100737] [INFO ] [MAIN ] Update Progress: 856/2370 symbols completed. FN took 31.4s. Estimated remaining: 3h 32m 33s. Rate: 7.1 symbols/min [2025-10-02T19:00:14.290302] [INFO ] [MAIN ] FNV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:00:14.345843] [DEBUG] [LOCAL ] FNV: Loaded 46148 existing records from primary storage. [2025-10-02T19:00:14.346231] [INFO ] [MAIN ] FNV: Loaded 46148 existing records. [2025-10-02T19:00:14.555740] [WARN ] [MAIN ] FNV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:00:14.556346] [INFO ] [MAIN ] FNV: Wiping existing primary data before full refresh. [2025-10-02T19:00:14.556492] [INFO ] [LOCAL ] FNV: Starting deletion of primary data. [2025-10-02T19:00:14.558756] [DEBUG] [LOCAL ] FNV: Deleted primary data file. [2025-10-02T19:00:14.558844] [INFO ] [MAIN ] FNV: Starting full primary refresh. [2025-10-02T19:00:14.677794] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-03. [2025-10-02T19:00:14.729425] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-02T19:00:15.009698] [INFO ] [REMOTE ] FNV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:00:15.472995] [INFO ] [REMOTE ] FNV: Fetching primary data for 2024-12. [2025-10-02T19:00:16.172622] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-10-02T19:00:16.273066] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-07. [2025-10-02T19:00:16.681396] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-02T19:00:17.078326] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-04. [2025-10-02T19:00:17.103038] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-02T19:00:17.872989] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-07. [2025-10-02T19:00:18.130892] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-02T19:00:18.673020] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-08. [2025-10-02T19:00:18.819529] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-02T19:00:19.473019] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-01. [2025-10-02T19:00:19.539180] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-02T19:00:20.100044] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-02T19:00:20.273015] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-05. [2025-10-02T19:00:20.785508] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-02T19:00:21.073035] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-08. [2025-10-02T19:00:21.873008] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-09. [2025-10-02T19:00:22.117033] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-02T19:00:22.673000] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-02. [2025-10-02T19:00:22.791538] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-02T19:00:23.473010] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-06. [2025-10-02T19:00:23.736863] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-02T19:00:24.188004] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-02T19:00:24.273012] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-10. [2025-10-02T19:00:24.835533] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-02T19:00:25.073012] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-07. [2025-10-02T19:00:25.698776] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-02T19:00:25.700905] [INFO ] [REMOTE ] FNB: Full fetch complete (75842 records). [2025-10-02T19:00:25.701022] [DEBUG] [VALIDATOR ] FNB: Validating primary data. [2025-10-02T19:00:25.882247] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-03. [2025-10-02T19:00:26.151822] [DEBUG] [VALIDATOR ] FNB: All expected trading days are present. [2025-10-02T19:00:26.151911] [DEBUG] [VALIDATOR ] FNB: Primary data validation passed. [2025-10-02T19:00:26.153072] [INFO ] [MAIN ] FNB: Fetched primary data is valid. [2025-10-02T19:00:26.153143] [DEBUG] [LOCAL ] FNB: Saving primary data. [2025-10-02T19:00:26.154735] [DEBUG] [LOCAL ] FNB: Trimmed 75842 records to 52848 (keeping 200 days of data) [2025-10-02T19:00:26.511075] [DEBUG] [LOCAL ] FNB: Primary data saved (52848 records). [2025-10-02T19:00:26.511224] [INFO ] [MAIN ] FNB: Full history saved. [2025-10-02T19:00:26.511318] [INFO ] [MAIN ] Update Progress: 857/2370 symbols completed. FNB took 32.0s. Estimated remaining: 3h 32m 31s. Rate: 7.1 symbols/min [2025-10-02T19:00:26.681537] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-09. [2025-10-02T19:00:26.719725] [INFO ] [MAIN ] FOA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:00:26.736096] [DEBUG] [LOCAL ] FOA: Loaded 13079 existing records from primary storage. [2025-10-02T19:00:26.736576] [INFO ] [MAIN ] FOA: Loaded 13079 existing records. [2025-10-02T19:00:26.939033] [WARN ] [MAIN ] FOA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:00:26.939615] [INFO ] [MAIN ] FOA: Wiping existing primary data before full refresh. [2025-10-02T19:00:26.939731] [INFO ] [LOCAL ] FOA: Starting deletion of primary data. [2025-10-02T19:00:26.951296] [DEBUG] [LOCAL ] FOA: Deleted primary data file. [2025-10-02T19:00:26.956527] [INFO ] [MAIN ] FOA: Starting full primary refresh. [2025-10-02T19:00:27.044059] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-02T19:00:27.381537] [INFO ] [REMOTE ] FOA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:00:27.473022] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-08. [2025-10-02T19:00:27.704018] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-02T19:00:28.273045] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-04. [2025-10-02T19:00:28.558094] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-02T19:00:28.819347] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-02T19:00:29.073041] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-10. [2025-10-02T19:00:29.873000] [INFO ] [REMOTE ] FOA: Fetching primary data for 2024-12. [2025-10-02T19:00:30.285817] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-02T19:00:30.673006] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-09. [2025-10-02T19:00:30.894796] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-02T19:00:30.897906] [INFO ] [REMOTE ] FND: Full fetch complete (74630 records). [2025-10-02T19:00:30.898054] [DEBUG] [VALIDATOR ] FND: Validating primary data. [2025-10-02T19:00:31.134330] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-02T19:00:31.382746] [DEBUG] [VALIDATOR ] FND: All expected trading days are present. [2025-10-02T19:00:31.382866] [DEBUG] [VALIDATOR ] FND: Primary data validation passed. [2025-10-02T19:00:31.383806] [INFO ] [MAIN ] FND: Fetched primary data is valid. [2025-10-02T19:00:31.383872] [DEBUG] [LOCAL ] FND: Saving primary data. [2025-10-02T19:00:31.386076] [DEBUG] [LOCAL ] FND: Trimmed 74630 records to 52478 (keeping 200 days of data) [2025-10-02T19:00:31.492588] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-05. [2025-10-02T19:00:31.742890] [DEBUG] [LOCAL ] FND: Primary data saved (52478 records). [2025-10-02T19:00:31.743062] [INFO ] [MAIN ] FND: Full history saved. [2025-10-02T19:00:31.743192] [INFO ] [MAIN ] Update Progress: 858/2370 symbols completed. FND took 35.7s. Estimated remaining: 3h 32m 17s. Rate: 7.1 symbols/min [2025-10-02T19:00:31.967993] [INFO ] [MAIN ] FOF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:00:31.981293] [DEBUG] [LOCAL ] FOF: Loaded 8431 existing records from primary storage. [2025-10-02T19:00:31.981574] [INFO ] [MAIN ] FOF: Loaded 8431 existing records. [2025-10-02T19:00:32.216232] [WARN ] [MAIN ] FOF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:00:32.216692] [INFO ] [MAIN ] FOF: Wiping existing primary data before full refresh. [2025-10-02T19:00:32.216801] [INFO ] [LOCAL ] FOF: Starting deletion of primary data. [2025-10-02T19:00:32.217155] [DEBUG] [LOCAL ] FOF: Deleted primary data file. [2025-10-02T19:00:32.217221] [INFO ] [MAIN ] FOF: Starting full primary refresh. [2025-10-02T19:00:32.277354] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-01. [2025-10-02T19:00:32.643320] [INFO ] [REMOTE ] FOF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:00:32.685844] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-02T19:00:33.072965] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-10. [2025-10-02T19:00:33.261694] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-02T19:00:33.313859] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-02T19:00:33.872999] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-06. [2025-10-02T19:00:34.484491] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-02T19:00:34.486439] [INFO ] [REMOTE ] FNF: Full fetch complete (69599 records). [2025-10-02T19:00:34.486579] [DEBUG] [VALIDATOR ] FNF: Validating primary data. [2025-10-02T19:00:34.679794] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-02. [2025-10-02T19:00:34.936632] [DEBUG] [VALIDATOR ] FNF: All expected trading days are present. [2025-10-02T19:00:34.936831] [DEBUG] [VALIDATOR ] FNF: Primary data validation passed. [2025-10-02T19:00:34.937707] [INFO ] [MAIN ] FNF: Fetched primary data is valid. [2025-10-02T19:00:34.937772] [DEBUG] [LOCAL ] FNF: Saving primary data. [2025-10-02T19:00:34.939212] [DEBUG] [LOCAL ] FNF: Trimmed 69599 records to 49364 (keeping 200 days of data) [2025-10-02T19:00:35.265317] [DEBUG] [LOCAL ] FNF: Primary data saved (49364 records). [2025-10-02T19:00:35.265452] [INFO ] [MAIN ] FNF: Full history saved. [2025-10-02T19:00:35.265536] [INFO ] [MAIN ] Update Progress: 859/2370 symbols completed. FNF took 37.4s. Estimated remaining: 3h 32m 0s. Rate: 7.1 symbols/min [2025-10-02T19:00:35.439288] [INFO ] [MAIN ] FOR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:00:35.459795] [DEBUG] [LOCAL ] FOR: Loaded 19842 existing records from primary storage. [2025-10-02T19:00:35.460703] [INFO ] [MAIN ] FOR: Loaded 19842 existing records. [2025-10-02T19:00:35.482156] [INFO ] [REMOTE ] FOF: Fetching primary data for 2024-12. [2025-10-02T19:00:35.656064] [WARN ] [MAIN ] FOR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:00:35.656418] [INFO ] [MAIN ] FOR: Wiping existing primary data before full refresh. [2025-10-02T19:00:35.656541] [INFO ] [LOCAL ] FOR: Starting deletion of primary data. [2025-10-02T19:00:35.657461] [DEBUG] [LOCAL ] FOR: Deleted primary data file. [2025-10-02T19:00:35.657582] [INFO ] [MAIN ] FOR: Starting full primary refresh. [2025-10-02T19:00:35.809576] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-02T19:00:36.032239] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-02T19:00:36.111159] [INFO ] [REMOTE ] FOR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:00:36.273050] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-03. [2025-10-02T19:00:36.304539] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-02T19:00:37.072994] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-07. [2025-10-02T19:00:37.349342] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-02T19:00:37.873016] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-01. [2025-10-02T19:00:38.672990] [INFO ] [REMOTE ] FOR: Fetching primary data for 2024-12. [2025-10-02T19:00:38.905795] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-02T19:00:39.123326] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-02T19:00:39.472976] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-08. [2025-10-02T19:00:39.572081] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-02T19:00:40.273060] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-02. [2025-10-02T19:00:40.771533] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-02T19:00:41.012472] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-02T19:00:41.072996] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-03. [2025-10-02T19:00:41.859182] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-02T19:00:41.872974] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-04. [2025-10-02T19:00:42.487877] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-02T19:00:42.673025] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-05. [2025-10-02T19:00:43.408070] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-02T19:00:43.473001] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-06. [2025-10-02T19:00:43.971177] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-02T19:00:44.273040] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-07. [2025-10-02T19:00:45.009034] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-02T19:00:45.073042] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-08. [2025-10-02T19:00:45.596406] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-02T19:00:45.873004] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-09. [2025-10-02T19:00:46.673000] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-04. [2025-10-02T19:00:46.765331] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-02T19:00:47.473057] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-01. [2025-10-02T19:00:47.580296] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-02T19:00:48.273019] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-10. [2025-10-02T19:00:48.551068] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-02T19:00:48.934482] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-02T19:00:48.935861] [INFO ] [REMOTE ] FOF: Full fetch complete (11868 records). [2025-10-02T19:00:48.935966] [DEBUG] [VALIDATOR ] FOF: Validating primary data. [2025-10-02T19:00:49.078149] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-05. [2025-10-02T19:00:49.377255] [DEBUG] [VALIDATOR ] FOF: All expected trading days are present. [2025-10-02T19:00:49.377344] [DEBUG] [VALIDATOR ] FOF: Primary data validation passed. [2025-10-02T19:00:49.377665] [INFO ] [MAIN ] FOF: Fetched primary data is valid. [2025-10-02T19:00:49.377730] [DEBUG] [LOCAL ] FOF: Saving primary data. [2025-10-02T19:00:49.378239] [DEBUG] [LOCAL ] FOF: Trimmed 11868 records to 8487 (keeping 200 days of data) [2025-10-02T19:00:49.433293] [DEBUG] [LOCAL ] FOF: Primary data saved (8487 records). [2025-10-02T19:00:49.433441] [INFO ] [MAIN ] FOF: Full history saved. [2025-10-02T19:00:49.433539] [INFO ] [MAIN ] Update Progress: 860/2370 symbols completed. FOF took 17.7s. Estimated remaining: 3h 32m 2s. Rate: 7.1 symbols/min [2025-10-02T19:00:49.629917] [INFO ] [MAIN ] FOUR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:00:49.677320] [DEBUG] [LOCAL ] FOUR: Loaded 49533 existing records from primary storage. [2025-10-02T19:00:49.677627] [INFO ] [MAIN ] FOUR: Loaded 49533 existing records. [2025-10-02T19:00:49.863429] [WARN ] [MAIN ] FOUR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:00:49.863789] [INFO ] [MAIN ] FOUR: Wiping existing primary data before full refresh. [2025-10-02T19:00:49.863893] [INFO ] [LOCAL ] FOUR: Starting deletion of primary data. [2025-10-02T19:00:49.865608] [DEBUG] [LOCAL ] FOUR: Deleted primary data file. [2025-10-02T19:00:49.865695] [INFO ] [MAIN ] FOUR: Starting full primary refresh. [2025-10-02T19:00:49.878704] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-09. [2025-10-02T19:00:50.016055] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-02T19:00:50.322404] [INFO ] [REMOTE ] FOUR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:00:50.672995] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-02. [2025-10-02T19:00:51.472980] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-06. [2025-10-02T19:00:51.735866] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-02T19:00:51.768464] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-02T19:00:51.888207] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-02T19:00:52.273014] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-03. [2025-10-02T19:00:53.007261] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-02T19:00:53.073027] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2024-12. [2025-10-02T19:00:53.872994] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-07. [2025-10-02T19:00:54.667585] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-02T19:00:54.678472] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-04. [2025-10-02T19:00:54.753843] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-02T19:00:55.472974] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-08. [2025-10-02T19:00:55.706486] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-02T19:00:56.195165] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-02T19:00:56.273001] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-10. [2025-10-02T19:00:57.073003] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-09. [2025-10-02T19:00:57.611818] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-02T19:00:57.614700] [INFO ] [REMOTE ] FNV: Full fetch complete (66333 records). [2025-10-02T19:00:57.614908] [DEBUG] [VALIDATOR ] FNV: Validating primary data. [2025-10-02T19:00:57.874065] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-05. [2025-10-02T19:00:57.968185] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-02T19:00:58.112188] [DEBUG] [VALIDATOR ] FNV: All expected trading days are present. [2025-10-02T19:00:58.112275] [DEBUG] [VALIDATOR ] FNV: Primary data validation passed. [2025-10-02T19:00:58.113119] [INFO ] [MAIN ] FNV: Fetched primary data is valid. [2025-10-02T19:00:58.113185] [DEBUG] [LOCAL ] FNV: Saving primary data. [2025-10-02T19:00:58.115460] [DEBUG] [LOCAL ] FNV: Trimmed 66333 records to 46489 (keeping 200 days of data) [2025-10-02T19:00:58.445792] [DEBUG] [LOCAL ] FNV: Primary data saved (46489 records). [2025-10-02T19:00:58.445939] [INFO ] [MAIN ] FNV: Full history saved. [2025-10-02T19:00:58.446031] [INFO ] [MAIN ] Update Progress: 861/2370 symbols completed. FNV took 44.3s. Estimated remaining: 3h 31m 55s. Rate: 7.1 symbols/min [2025-10-02T19:00:58.678170] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-10. [2025-10-02T19:00:58.680899] [INFO ] [MAIN ] FPF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:00:58.702762] [DEBUG] [LOCAL ] FPF: Loaded 18186 existing records from primary storage. [2025-10-02T19:00:58.703071] [INFO ] [MAIN ] FPF: Loaded 18186 existing records. [2025-10-02T19:00:58.901394] [WARN ] [MAIN ] FPF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:00:58.901595] [INFO ] [MAIN ] FPF: Wiping existing primary data before full refresh. [2025-10-02T19:00:58.901667] [INFO ] [LOCAL ] FPF: Starting deletion of primary data. [2025-10-02T19:00:58.902361] [DEBUG] [LOCAL ] FPF: Deleted primary data file. [2025-10-02T19:00:58.902426] [INFO ] [MAIN ] FPF: Starting full primary refresh. [2025-10-02T19:00:59.097307] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-02T19:00:59.319880] [INFO ] [REMOTE ] FPF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:00:59.324182] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-02T19:00:59.325322] [INFO ] [REMOTE ] FOA: Full fetch complete (22384 records). [2025-10-02T19:00:59.325444] [DEBUG] [VALIDATOR ] FOA: Validating primary data. [2025-10-02T19:00:59.489519] [INFO ] [REMOTE ] FPF: Fetching primary data for 2024-12. [2025-10-02T19:00:59.754896] [DEBUG] [VALIDATOR ] FOA: All expected trading days are present. [2025-10-02T19:00:59.754984] [DEBUG] [VALIDATOR ] FOA: Primary data validation passed. [2025-10-02T19:00:59.755515] [INFO ] [MAIN ] FOA: Fetched primary data is valid. [2025-10-02T19:00:59.755559] [DEBUG] [LOCAL ] FOA: Saving primary data. [2025-10-02T19:00:59.756377] [DEBUG] [LOCAL ] FOA: Trimmed 22384 records to 13189 (keeping 200 days of data) [2025-10-02T19:00:59.841533] [DEBUG] [LOCAL ] FOA: Primary data saved (13189 records). [2025-10-02T19:00:59.841717] [INFO ] [MAIN ] FOA: Full history saved. [2025-10-02T19:00:59.841818] [INFO ] [MAIN ] Update Progress: 862/2370 symbols completed. FOA took 33.3s. Estimated remaining: 3h 31m 34s. Rate: 7.1 symbols/min [2025-10-02T19:01:00.029055] [INFO ] [MAIN ] FPH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:01:00.048185] [DEBUG] [LOCAL ] FPH: Loaded 19419 existing records from primary storage. [2025-10-02T19:01:00.048438] [INFO ] [MAIN ] FPH: Loaded 19419 existing records. [2025-10-02T19:01:00.234091] [WARN ] [MAIN ] FPH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:01:00.234330] [INFO ] [MAIN ] FPH: Wiping existing primary data before full refresh. [2025-10-02T19:01:00.234382] [INFO ] [LOCAL ] FPH: Starting deletion of primary data. [2025-10-02T19:01:00.235013] [DEBUG] [LOCAL ] FPH: Deleted primary data file. [2025-10-02T19:01:00.235077] [INFO ] [MAIN ] FPH: Starting full primary refresh. [2025-10-02T19:01:00.280959] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-06. [2025-10-02T19:01:00.639591] [INFO ] [REMOTE ] FPH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:01:00.853943] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-02T19:01:01.072984] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-01. [2025-10-02T19:01:01.412376] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-02T19:01:01.872995] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-07. [2025-10-02T19:01:02.115699] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-02T19:01:02.672976] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-02. [2025-10-02T19:01:02.748522] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-02T19:01:03.473033] [INFO ] [REMOTE ] FPH: Fetching primary data for 2024-12. [2025-10-02T19:01:03.635453] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-02T19:01:04.272979] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-01. [2025-10-02T19:01:04.602277] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-02T19:01:05.072996] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-01. [2025-10-02T19:01:05.872994] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-03. [2025-10-02T19:01:05.999676] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-02T19:01:06.069801] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-02T19:01:06.673000] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-08. [2025-10-02T19:01:06.866492] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-02T19:01:07.464193] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-02T19:01:07.472968] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-09. [2025-10-02T19:01:08.272989] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-02. [2025-10-02T19:01:08.467553] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-02T19:01:09.073047] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-10. [2025-10-02T19:01:09.683465] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-02T19:01:09.685879] [INFO ] [REMOTE ] FOR: Full fetch complete (29899 records). [2025-10-02T19:01:09.686046] [DEBUG] [VALIDATOR ] FOR: Validating primary data. [2025-10-02T19:01:09.877263] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-04. [2025-10-02T19:01:10.216197] [DEBUG] [VALIDATOR ] FOR: All expected trading days are present. [2025-10-02T19:01:10.216325] [DEBUG] [VALIDATOR ] FOR: Primary data validation passed. [2025-10-02T19:01:10.217021] [INFO ] [MAIN ] FOR: Fetched primary data is valid. [2025-10-02T19:01:10.217176] [DEBUG] [LOCAL ] FOR: Saving primary data. [2025-10-02T19:01:10.218454] [DEBUG] [LOCAL ] FOR: Trimmed 29899 records to 19927 (keeping 200 days of data) [2025-10-02T19:01:10.357817] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-02T19:01:10.398782] [DEBUG] [LOCAL ] FOR: Primary data saved (19927 records). [2025-10-02T19:01:10.398929] [INFO ] [MAIN ] FOR: Full history saved. [2025-10-02T19:01:10.399033] [INFO ] [MAIN ] Update Progress: 863/2370 symbols completed. FOR took 35.1s. Estimated remaining: 3h 31m 29s. Rate: 7.1 symbols/min [2025-10-02T19:01:10.587986] [INFO ] [MAIN ] FPI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:01:10.620365] [DEBUG] [LOCAL ] FPI: Loaded 31045 existing records from primary storage. [2025-10-02T19:01:10.620682] [INFO ] [MAIN ] FPI: Loaded 31045 existing records. [2025-10-02T19:01:10.678540] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-02. [2025-10-02T19:01:10.817561] [WARN ] [MAIN ] FPI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:01:10.817858] [INFO ] [MAIN ] FPI: Wiping existing primary data before full refresh. [2025-10-02T19:01:10.817979] [INFO ] [LOCAL ] FPI: Starting deletion of primary data. [2025-10-02T19:01:10.819209] [DEBUG] [LOCAL ] FPI: Deleted primary data file. [2025-10-02T19:01:10.819274] [INFO ] [MAIN ] FPI: Starting full primary refresh. [2025-10-02T19:01:11.177521] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-02T19:01:11.226146] [INFO ] [REMOTE ] FPI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:01:11.472994] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-05. [2025-10-02T19:01:12.002534] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-02T19:01:12.272993] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-03. [2025-10-02T19:01:12.523806] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-02T19:01:13.073059] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-06. [2025-10-02T19:01:13.255910] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-02T19:01:13.873013] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-04. [2025-10-02T19:01:14.672994] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-03. [2025-10-02T19:01:14.961104] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-02T19:01:15.017453] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-02T19:01:15.473001] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-05. [2025-10-02T19:01:16.272985] [INFO ] [REMOTE ] FPI: Fetching primary data for 2024-12. [2025-10-02T19:01:16.406496] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-02T19:01:16.500140] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-02T19:01:17.073044] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-06. [2025-10-02T19:01:17.826959] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-02T19:01:17.872994] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-01. [2025-10-02T19:01:18.103611] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-02T19:01:18.673011] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-07. [2025-10-02T19:01:19.000253] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-02T19:01:19.473077] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-04. [2025-10-02T19:01:19.631537] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-02T19:01:20.273045] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-08. [2025-10-02T19:01:21.072976] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-02. [2025-10-02T19:01:21.277079] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-02T19:01:21.483243] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-02T19:01:21.873034] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-09. [2025-10-02T19:01:22.106773] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-02T19:01:22.673008] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-05. [2025-10-02T19:01:23.015483] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-02T19:01:23.473044] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-07. [2025-10-02T19:01:24.272989] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-03. [2025-10-02T19:01:24.335981] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-02T19:01:24.454766] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-02T19:01:25.073012] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-08. [2025-10-02T19:01:25.212098] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-02T19:01:25.782737] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-02T19:01:25.873035] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-09. [2025-10-02T19:01:26.673040] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-10. [2025-10-02T19:01:26.901565] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-02T19:01:27.366907] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-02T19:01:27.368225] [INFO ] [REMOTE ] FPH: Full fetch complete (31376 records). [2025-10-02T19:01:27.368335] [DEBUG] [VALIDATOR ] FPH: Validating primary data. [2025-10-02T19:01:27.478339] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-06. [2025-10-02T19:01:27.803481] [DEBUG] [VALIDATOR ] FPH: All expected trading days are present. [2025-10-02T19:01:27.803573] [DEBUG] [VALIDATOR ] FPH: Primary data validation passed. [2025-10-02T19:01:27.804193] [INFO ] [MAIN ] FPH: Fetched primary data is valid. [2025-10-02T19:01:27.804264] [DEBUG] [LOCAL ] FPH: Saving primary data. [2025-10-02T19:01:27.805154] [DEBUG] [LOCAL ] FPH: Trimmed 31376 records to 19546 (keeping 200 days of data) [2025-10-02T19:01:27.930988] [DEBUG] [LOCAL ] FPH: Primary data saved (19546 records). [2025-10-02T19:01:27.931145] [INFO ] [MAIN ] FPH: Full history saved. [2025-10-02T19:01:27.931248] [INFO ] [MAIN ] Update Progress: 864/2370 symbols completed. FPH took 28.1s. Estimated remaining: 3h 31m 37s. Rate: 7.1 symbols/min [2025-10-02T19:01:28.138735] [INFO ] [MAIN ] FR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:01:28.184631] [DEBUG] [LOCAL ] FR: Loaded 46429 existing records from primary storage. [2025-10-02T19:01:28.185029] [INFO ] [MAIN ] FR: Loaded 46429 existing records. [2025-10-02T19:01:28.278220] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-04. [2025-10-02T19:01:28.392421] [WARN ] [MAIN ] FR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:01:28.392710] [INFO ] [MAIN ] FR: Wiping existing primary data before full refresh. [2025-10-02T19:01:28.392798] [INFO ] [LOCAL ] FR: Starting deletion of primary data. [2025-10-02T19:01:28.394142] [DEBUG] [LOCAL ] FR: Deleted primary data file. [2025-10-02T19:01:28.394206] [INFO ] [MAIN ] FR: Starting full primary refresh. [2025-10-02T19:01:28.817727] [INFO ] [REMOTE ] FR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:01:29.073019] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-10. [2025-10-02T19:01:29.229658] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-02T19:01:29.286260] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-02T19:01:29.841487] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-02T19:01:29.842879] [INFO ] [REMOTE ] FPF: Full fetch complete (26634 records). [2025-10-02T19:01:29.842978] [DEBUG] [VALIDATOR ] FPF: Validating primary data. [2025-10-02T19:01:29.879141] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-07. [2025-10-02T19:01:30.277857] [DEBUG] [VALIDATOR ] FPF: All expected trading days are present. [2025-10-02T19:01:30.277960] [DEBUG] [VALIDATOR ] FPF: Primary data validation passed. [2025-10-02T19:01:30.278677] [INFO ] [MAIN ] FPF: Fetched primary data is valid. [2025-10-02T19:01:30.278748] [DEBUG] [LOCAL ] FPF: Saving primary data. [2025-10-02T19:01:30.279570] [DEBUG] [LOCAL ] FPF: Trimmed 26634 records to 18405 (keeping 200 days of data) [2025-10-02T19:01:30.400980] [DEBUG] [LOCAL ] FPF: Primary data saved (18405 records). [2025-10-02T19:01:30.401144] [INFO ] [MAIN ] FPF: Full history saved. [2025-10-02T19:01:30.401238] [INFO ] [MAIN ] Update Progress: 865/2370 symbols completed. FPF took 32.0s. Estimated remaining: 3h 31m 18s. Rate: 7.1 symbols/min [2025-10-02T19:01:30.593391] [INFO ] [MAIN ] FRA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:01:30.609665] [DEBUG] [LOCAL ] FRA: Loaded 14571 existing records from primary storage. [2025-10-02T19:01:30.609926] [INFO ] [MAIN ] FRA: Loaded 14571 existing records. [2025-10-02T19:01:30.678202] [INFO ] [REMOTE ] FR: Fetching primary data for 2024-12. [2025-10-02T19:01:30.804786] [WARN ] [MAIN ] FRA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:01:30.805023] [INFO ] [MAIN ] FRA: Wiping existing primary data before full refresh. [2025-10-02T19:01:30.805113] [INFO ] [LOCAL ] FRA: Starting deletion of primary data. [2025-10-02T19:01:30.805727] [DEBUG] [LOCAL ] FRA: Deleted primary data file. [2025-10-02T19:01:30.805794] [INFO ] [MAIN ] FRA: Starting full primary refresh. [2025-10-02T19:01:31.198305] [INFO ] [REMOTE ] FRA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:01:31.473046] [INFO ] [REMOTE ] FRA: Fetching primary data for 2024-12. [2025-10-02T19:01:31.716636] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-02T19:01:32.273030] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-08. [2025-10-02T19:01:32.405464] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-02T19:01:32.470810] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-02T19:01:33.072998] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-01. [2025-10-02T19:01:33.873053] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-01. [2025-10-02T19:01:34.233313] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-02T19:01:34.678084] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-02. [2025-10-02T19:01:34.698870] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-10-02T19:01:35.366610] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-02T19:01:35.473028] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-09. [2025-10-02T19:01:36.248818] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-02T19:01:36.272962] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-03. [2025-10-02T19:01:37.072998] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-05. [2025-10-02T19:01:37.362073] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-02T19:01:37.762470] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-02T19:01:37.873055] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-10. [2025-10-02T19:01:38.394299] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-02T19:01:38.673024] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-06. [2025-10-02T19:01:39.473051] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-04. [2025-10-02T19:01:39.705251] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-02T19:01:39.708088] [INFO ] [REMOTE ] FOUR: Full fetch complete (72017 records). [2025-10-02T19:01:39.708265] [DEBUG] [VALIDATOR ] FOUR: Validating primary data. [2025-10-02T19:01:40.129250] [DEBUG] [VALIDATOR ] FOUR: All expected trading days are present. [2025-10-02T19:01:40.129356] [DEBUG] [VALIDATOR ] FOUR: Primary data validation passed. [2025-10-02T19:01:40.130311] [INFO ] [MAIN ] FOUR: Fetched primary data is valid. [2025-10-02T19:01:40.130381] [DEBUG] [LOCAL ] FOUR: Saving primary data. [2025-10-02T19:01:40.131966] [DEBUG] [LOCAL ] FOUR: Trimmed 72017 records to 49921 (keeping 200 days of data) [2025-10-02T19:01:40.305976] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-02. [2025-10-02T19:01:40.441232] [DEBUG] [LOCAL ] FOUR: Primary data saved (49921 records). [2025-10-02T19:01:40.441389] [INFO ] [MAIN ] FOUR: Full history saved. [2025-10-02T19:01:40.441479] [INFO ] [MAIN ] Update Progress: 866/2370 symbols completed. FOUR took 51.0s. Estimated remaining: 3h 31m 12s. Rate: 7.1 symbols/min [2025-10-02T19:01:40.627144] [INFO ] [MAIN ] FRGE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:01:40.646401] [DEBUG] [LOCAL ] FRGE: Loaded 17691 existing records from primary storage. [2025-10-02T19:01:40.646702] [INFO ] [MAIN ] FRGE: Loaded 17691 existing records. [2025-10-02T19:01:40.847742] [WARN ] [MAIN ] FRGE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:01:40.848164] [INFO ] [MAIN ] FRGE: Wiping existing primary data before full refresh. [2025-10-02T19:01:40.848240] [INFO ] [LOCAL ] FRGE: Starting deletion of primary data. [2025-10-02T19:01:40.855198] [DEBUG] [LOCAL ] FRGE: Deleted primary data file. [2025-10-02T19:01:40.855297] [INFO ] [MAIN ] FRGE: Starting full primary refresh. [2025-10-02T19:01:40.934686] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-10-02T19:01:41.089115] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-07. [2025-10-02T19:01:41.277426] [INFO ] [REMOTE ] FRGE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:01:41.299987] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-02T19:01:41.767461] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-02T19:01:41.873043] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-05. [2025-10-02T19:01:42.572502] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-02T19:01:42.673021] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-08. [2025-10-02T19:01:43.472999] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-03. [2025-10-02T19:01:44.208328] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-10-02T19:01:44.272972] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-06. [2025-10-02T19:01:44.513023] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-02T19:01:44.536099] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-02T19:01:45.073002] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-09. [2025-10-02T19:01:45.801631] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-02T19:01:45.872978] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-07. [2025-10-02T19:01:46.402270] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-02T19:01:46.672996] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-10. [2025-10-02T19:01:47.473058] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-04. [2025-10-02T19:01:47.580286] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-02T19:01:47.776206] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-02T19:01:47.777769] [INFO ] [REMOTE ] FPI: Full fetch complete (44364 records). [2025-10-02T19:01:47.777882] [DEBUG] [VALIDATOR ] FPI: Validating primary data. [2025-10-02T19:01:48.188929] [DEBUG] [VALIDATOR ] FPI: All expected trading days are present. [2025-10-02T19:01:48.189028] [DEBUG] [VALIDATOR ] FPI: Primary data validation passed. [2025-10-02T19:01:48.189807] [INFO ] [MAIN ] FPI: Fetched primary data is valid. [2025-10-02T19:01:48.189881] [DEBUG] [LOCAL ] FPI: Saving primary data. [2025-10-02T19:01:48.191130] [DEBUG] [LOCAL ] FPI: Trimmed 44364 records to 31264 (keeping 200 days of data) [2025-10-02T19:01:48.282611] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2024-12. [2025-10-02T19:01:48.392286] [DEBUG] [LOCAL ] FPI: Primary data saved (31264 records). [2025-10-02T19:01:48.392439] [INFO ] [MAIN ] FPI: Full history saved. [2025-10-02T19:01:48.393282] [INFO ] [MAIN ] Update Progress: 867/2370 symbols completed. FPI took 38.0s. Estimated remaining: 3h 31m 3s. Rate: 7.1 symbols/min [2025-10-02T19:01:48.596834] [INFO ] [MAIN ] FRO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:01:48.605298] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-02T19:01:48.665597] [DEBUG] [LOCAL ] FRO: Loaded 51761 existing records from primary storage. [2025-10-02T19:01:48.665980] [INFO ] [MAIN ] FRO: Loaded 51761 existing records. [2025-10-02T19:01:48.857794] [WARN ] [MAIN ] FRO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:01:48.858019] [INFO ] [MAIN ] FRO: Wiping existing primary data before full refresh. [2025-10-02T19:01:48.858070] [INFO ] [LOCAL ] FRO: Starting deletion of primary data. [2025-10-02T19:01:48.859696] [DEBUG] [LOCAL ] FRO: Deleted primary data file. [2025-10-02T19:01:48.859760] [INFO ] [MAIN ] FRO: Starting full primary refresh. [2025-10-02T19:01:49.078182] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-08. [2025-10-02T19:01:49.273776] [INFO ] [REMOTE ] FRO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:01:49.406679] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-02T19:01:49.873008] [INFO ] [REMOTE ] FRO: Fetching primary data for 2024-12. [2025-10-02T19:01:50.667538] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-02T19:01:50.676128] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-05. [2025-10-02T19:01:51.473037] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-09. [2025-10-02T19:01:51.496816] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-02T19:01:51.748262] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-02T19:01:52.273062] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-01. [2025-10-02T19:01:52.990943] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-02T19:01:53.073000] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-10. [2025-10-02T19:01:53.872999] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-06. [2025-10-02T19:01:54.197343] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-02T19:01:54.380296] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-02T19:01:54.382384] [INFO ] [REMOTE ] FR: Full fetch complete (66737 records). [2025-10-02T19:01:54.382498] [DEBUG] [VALIDATOR ] FR: Validating primary data. [2025-10-02T19:01:54.678185] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-01. [2025-10-02T19:01:54.856530] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-02T19:01:54.877267] [DEBUG] [VALIDATOR ] FR: All expected trading days are present. [2025-10-02T19:01:54.877971] [DEBUG] [VALIDATOR ] FR: Primary data validation passed. [2025-10-02T19:01:54.878997] [INFO ] [MAIN ] FR: Fetched primary data is valid. [2025-10-02T19:01:54.879079] [DEBUG] [LOCAL ] FR: Saving primary data. [2025-10-02T19:01:54.881179] [DEBUG] [LOCAL ] FR: Trimmed 66737 records to 46743 (keeping 200 days of data) [2025-10-02T19:01:55.179492] [DEBUG] [LOCAL ] FR: Primary data saved (46743 records). [2025-10-02T19:01:55.179635] [INFO ] [MAIN ] FR: Full history saved. [2025-10-02T19:01:55.179779] [INFO ] [MAIN ] Update Progress: 868/2370 symbols completed. FR took 27.2s. Estimated remaining: 3h 30m 52s. Rate: 7.1 symbols/min [2025-10-02T19:01:55.371005] [INFO ] [MAIN ] FRT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:01:55.415396] [DEBUG] [LOCAL ] FRT: Loaded 41996 existing records from primary storage. [2025-10-02T19:01:55.415772] [INFO ] [MAIN ] FRT: Loaded 41996 existing records. [2025-10-02T19:01:55.480705] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-07. [2025-10-02T19:01:55.635741] [WARN ] [MAIN ] FRT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:01:55.635959] [INFO ] [MAIN ] FRT: Wiping existing primary data before full refresh. [2025-10-02T19:01:55.636010] [INFO ] [LOCAL ] FRT: Starting deletion of primary data. [2025-10-02T19:01:55.637542] [DEBUG] [LOCAL ] FRT: Deleted primary data file. [2025-10-02T19:01:55.637616] [INFO ] [MAIN ] FRT: Starting full primary refresh. [2025-10-02T19:01:56.038807] [INFO ] [REMOTE ] FRT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:01:56.061629] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-02T19:01:56.273013] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-02. [2025-10-02T19:01:56.511025] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-02T19:01:57.073059] [INFO ] [REMOTE ] FRT: Fetching primary data for 2024-12. [2025-10-02T19:01:57.873037] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-08. [2025-10-02T19:01:58.165868] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-02T19:01:58.568355] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-02T19:01:58.673027] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-03. [2025-10-02T19:01:58.696149] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-02T19:01:59.472997] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-09. [2025-10-02T19:02:00.272979] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-01. [2025-10-02T19:02:00.304806] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-02T19:02:00.682020] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-02T19:02:01.073026] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-04. [2025-10-02T19:02:01.825183] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-02T19:02:01.873126] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-02. [2025-10-02T19:02:02.673082] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-02. [2025-10-02T19:02:03.077519] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-02T19:02:03.179517] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-02T19:02:03.472997] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-03. [2025-10-02T19:02:04.138681] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-02T19:02:04.272999] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-10. [2025-10-02T19:02:04.583889] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-02T19:02:05.039916] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-02T19:02:05.040945] [INFO ] [REMOTE ] FRA: Full fetch complete (24043 records). [2025-10-02T19:02:05.041021] [DEBUG] [VALIDATOR ] FRA: Validating primary data. [2025-10-02T19:02:05.078241] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-03. [2025-10-02T19:02:05.447584] [DEBUG] [VALIDATOR ] FRA: All expected trading days are present. [2025-10-02T19:02:05.447699] [DEBUG] [VALIDATOR ] FRA: Primary data validation passed. [2025-10-02T19:02:05.448301] [INFO ] [MAIN ] FRA: Fetched primary data is valid. [2025-10-02T19:02:05.448367] [DEBUG] [LOCAL ] FRA: Saving primary data. [2025-10-02T19:02:05.449255] [DEBUG] [LOCAL ] FRA: Trimmed 24043 records to 14628 (keeping 200 days of data) [2025-10-02T19:02:05.558681] [DEBUG] [LOCAL ] FRA: Primary data saved (14628 records). [2025-10-02T19:02:05.559001] [INFO ] [MAIN ] FRA: Full history saved. [2025-10-02T19:02:05.559362] [INFO ] [MAIN ] Update Progress: 869/2370 symbols completed. FRA took 35.2s. Estimated remaining: 3h 30m 47s. Rate: 7.1 symbols/min [2025-10-02T19:02:05.759389] [INFO ] [MAIN ] FSCO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:02:05.809126] [DEBUG] [LOCAL ] FSCO: Loaded 37554 existing records from primary storage. [2025-10-02T19:02:05.809461] [INFO ] [MAIN ] FSCO: Loaded 37554 existing records. [2025-10-02T19:02:05.878365] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-05. [2025-10-02T19:02:06.029624] [WARN ] [MAIN ] FSCO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:02:06.029866] [INFO ] [MAIN ] FSCO: Wiping existing primary data before full refresh. [2025-10-02T19:02:06.029916] [INFO ] [LOCAL ] FSCO: Starting deletion of primary data. [2025-10-02T19:02:06.031007] [DEBUG] [LOCAL ] FSCO: Deleted primary data file. [2025-10-02T19:02:06.031095] [INFO ] [MAIN ] FSCO: Starting full primary refresh. [2025-10-02T19:02:06.431739] [INFO ] [REMOTE ] FSCO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:02:06.672968] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-04. [2025-10-02T19:02:06.715443] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-02T19:02:07.473008] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-04. [2025-10-02T19:02:07.847330] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-02T19:02:07.897509] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-02T19:02:08.273200] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-06. [2025-10-02T19:02:08.884787] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-02T19:02:09.073007] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-05. [2025-10-02T19:02:09.872988] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-05. [2025-10-02T19:02:10.257089] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-02T19:02:10.585527] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-02T19:02:10.673001] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2024-12. [2025-10-02T19:02:10.706311] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-02T19:02:11.473062] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-07. [2025-10-02T19:02:11.745420] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-02T19:02:12.273046] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-06. [2025-10-02T19:02:13.073003] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-01. [2025-10-02T19:02:13.263320] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-02T19:02:13.451584] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-02T19:02:13.873003] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-08. [2025-10-02T19:02:14.565280] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-02T19:02:14.673019] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-07. [2025-10-02T19:02:15.473005] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-02. [2025-10-02T19:02:15.799002] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-02T19:02:15.827991] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-02T19:02:16.272971] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-08. [2025-10-02T19:02:16.747182] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-02T19:02:17.073006] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-09. [2025-10-02T19:02:17.356256] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-02T19:02:17.873036] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-09. [2025-10-02T19:02:18.557293] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-02T19:02:18.672989] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-10. [2025-10-02T19:02:18.685323] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-02T19:02:19.473011] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-06. [2025-10-02T19:02:20.240685] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-02T19:02:20.242737] [INFO ] [REMOTE ] FRO: Full fetch complete (75244 records). [2025-10-02T19:02:20.242867] [DEBUG] [VALIDATOR ] FRO: Validating primary data. [2025-10-02T19:02:20.279714] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-10. [2025-10-02T19:02:20.711201] [DEBUG] [VALIDATOR ] FRO: All expected trading days are present. [2025-10-02T19:02:20.711382] [DEBUG] [VALIDATOR ] FRO: Primary data validation passed. [2025-10-02T19:02:20.712325] [INFO ] [MAIN ] FRO: Fetched primary data is valid. [2025-10-02T19:02:20.712401] [DEBUG] [LOCAL ] FRO: Saving primary data. [2025-10-02T19:02:20.718878] [DEBUG] [LOCAL ] FRO: Trimmed 75244 records to 52117 (keeping 200 days of data) [2025-10-02T19:02:20.986370] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-02T19:02:21.084113] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-07. [2025-10-02T19:02:21.111741] [DEBUG] [LOCAL ] FRO: Primary data saved (52117 records). [2025-10-02T19:02:21.111899] [INFO ] [MAIN ] FRO: Full history saved. [2025-10-02T19:02:21.113947] [INFO ] [MAIN ] Update Progress: 870/2370 symbols completed. FRO took 32.7s. Estimated remaining: 3h 30m 51s. Rate: 7.1 symbols/min [2025-10-02T19:02:21.221013] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-02T19:02:21.242392] [INFO ] [REMOTE ] FRGE: Full fetch complete (32481 records). [2025-10-02T19:02:21.263579] [DEBUG] [VALIDATOR ] FRGE: Validating primary data. [2025-10-02T19:02:21.432216] [INFO ] [MAIN ] FSK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:02:21.803245] [DEBUG] [LOCAL ] FSK: Loaded 49410 existing records from primary storage. [2025-10-02T19:02:21.803587] [DEBUG] [VALIDATOR ] FRGE: All expected trading days are present. [2025-10-02T19:02:21.803788] [INFO ] [MAIN ] FSK: Loaded 49410 existing records. [2025-10-02T19:02:21.803898] [DEBUG] [VALIDATOR ] FRGE: Primary data validation passed. [2025-10-02T19:02:21.804575] [INFO ] [MAIN ] FRGE: Fetched primary data is valid. [2025-10-02T19:02:21.804719] [DEBUG] [LOCAL ] FRGE: Saving primary data. [2025-10-02T19:02:21.875832] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-03. [2025-10-02T19:02:21.913683] [DEBUG] [LOCAL ] FRGE: Trimmed 32481 records to 17758 (keeping 200 days of data) [2025-10-02T19:02:22.087786] [WARN ] [MAIN ] FSK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:02:22.107099] [INFO ] [MAIN ] FSK: Wiping existing primary data before full refresh. [2025-10-02T19:02:22.112782] [INFO ] [LOCAL ] FSK: Starting deletion of primary data. [2025-10-02T19:02:22.119493] [DEBUG] [LOCAL ] FRGE: Primary data saved (17758 records). [2025-10-02T19:02:22.119672] [INFO ] [MAIN ] FRGE: Full history saved. [2025-10-02T19:02:22.119811] [INFO ] [MAIN ] Update Progress: 871/2370 symbols completed. FRGE took 41.7s. Estimated remaining: 3h 30m 29s. Rate: 7.1 symbols/min [2025-10-02T19:02:22.125222] [DEBUG] [LOCAL ] FSK: Deleted primary data file. [2025-10-02T19:02:22.159660] [INFO ] [MAIN ] FSK: Starting full primary refresh. [2025-10-02T19:02:22.461755] [INFO ] [MAIN ] FSLY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:02:22.769443] [INFO ] [REMOTE ] FSK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:02:22.769998] [INFO ] [REMOTE ] FSK: Fetching primary data for 2024-12. [2025-10-02T19:02:22.805632] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-02T19:02:22.832195] [DEBUG] [LOCAL ] FSLY: Loaded 51231 existing records from primary storage. [2025-10-02T19:02:22.833153] [INFO ] [MAIN ] FSLY: Loaded 51231 existing records. [2025-10-02T19:02:23.043748] [WARN ] [MAIN ] FSLY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:02:23.043987] [INFO ] [MAIN ] FSLY: Wiping existing primary data before full refresh. [2025-10-02T19:02:23.044039] [INFO ] [LOCAL ] FSLY: Starting deletion of primary data. [2025-10-02T19:02:23.046014] [DEBUG] [LOCAL ] FSLY: Deleted primary data file. [2025-10-02T19:02:23.046159] [INFO ] [MAIN ] FSLY: Starting full primary refresh. [2025-10-02T19:02:23.456735] [INFO ] [REMOTE ] FSLY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:02:23.476579] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2024-12. [2025-10-02T19:02:23.482386] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-02T19:02:24.272981] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-08. [2025-10-02T19:02:24.457724] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-02T19:02:24.805262] [DEBUG] [REMOTE ] FRT: Error fetching primary data for 2025-08: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')) [2025-10-02T19:02:24.805422] [WARN ] [REMOTE ] FRT: No data returned for month 2025-08 [2025-10-02T19:02:24.805499] [FATAL] [REMOTE ] FRT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T19:02:24.805574] [FATAL] [MAIN ] FRT: Failed to fetch primary data. [2025-10-02T19:02:24.805667] [WARN ] [MAIN ] FRT: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T19:02:24.805745] [INFO ] [LOCAL ] FRT: Starting deletion of primary data. [2025-10-02T19:02:24.805816] [DEBUG] [LOCAL ] FRT: No primary data file found to delete. [2025-10-02T19:02:24.805864] [INFO ] [LOCAL ] FRT: Starting deletion of derivative data. [2025-10-02T19:02:24.806259] [DEBUG] [LOCAL ] FRT: Deleted derivative data file. [2025-10-02T19:02:24.806337] [INFO ] [MAIN ] Update Progress: 872/2370 symbols completed. FRT took 29.6s. Estimated remaining: 3h 30m 11s. Rate: 7.1 symbols/min [2025-10-02T19:02:25.011041] [INFO ] [MAIN ] FSM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:02:25.069849] [DEBUG] [LOCAL ] FSM: Loaded 53292 existing records from primary storage. [2025-10-02T19:02:25.070240] [INFO ] [MAIN ] FSM: Loaded 53292 existing records. [2025-10-02T19:02:25.082620] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-04. [2025-10-02T19:02:25.303724] [WARN ] [MAIN ] FSM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:02:25.304059] [INFO ] [MAIN ] FSM: Wiping existing primary data before full refresh. [2025-10-02T19:02:25.304193] [INFO ] [LOCAL ] FSM: Starting deletion of primary data. [2025-10-02T19:02:25.305915] [DEBUG] [LOCAL ] FSM: Deleted primary data file. [2025-10-02T19:02:25.305994] [INFO ] [MAIN ] FSM: Starting full primary refresh. [2025-10-02T19:02:25.455377] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-02T19:02:25.763757] [INFO ] [REMOTE ] FSM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:02:25.873014] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-01. [2025-10-02T19:02:26.310329] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-02T19:02:26.673067] [INFO ] [REMOTE ] FSM: Fetching primary data for 2024-12. [2025-10-02T19:02:27.473004] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-05. [2025-10-02T19:02:27.581232] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-02T19:02:28.276018] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-02. [2025-10-02T19:02:28.282623] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-02T19:02:28.842285] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-02T19:02:29.072997] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-01. [2025-10-02T19:02:29.396813] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-02T19:02:29.873028] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-06. [2025-10-02T19:02:30.672968] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-01. [2025-10-02T19:02:30.713114] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-02T19:02:30.850590] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-02T19:02:31.473033] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-02. [2025-10-02T19:02:32.272978] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-03. [2025-10-02T19:02:32.424012] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-02T19:02:33.072990] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-02. [2025-10-02T19:02:33.142414] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-02T19:02:33.565585] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-02T19:02:33.873035] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-03. [2025-10-02T19:02:34.502921] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-02T19:02:34.673027] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-03. [2025-10-02T19:02:35.472991] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-07. [2025-10-02T19:02:35.691338] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-02T19:02:36.272976] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-04. [2025-10-02T19:02:36.394397] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-02T19:02:36.921117] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-02T19:02:37.073017] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-04. [2025-10-02T19:02:37.873007] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-08. [2025-10-02T19:02:37.932028] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-02T19:02:38.672996] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-05. [2025-10-02T19:02:38.801398] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-02T19:02:39.411837] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-02T19:02:39.473017] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-09. [2025-10-02T19:02:40.180035] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-02T19:02:40.273028] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-05. [2025-10-02T19:02:40.972816] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-02T19:02:41.073039] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-04. [2025-10-02T19:02:41.729946] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-02T19:02:41.873032] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-10. [2025-10-02T19:02:42.492186] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-02T19:02:42.673033] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-06. [2025-10-02T19:02:43.249269] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-02T19:02:43.251393] [INFO ] [REMOTE ] FSCO: Full fetch complete (54403 records). [2025-10-02T19:02:43.251499] [DEBUG] [VALIDATOR ] FSCO: Validating primary data. [2025-10-02T19:02:43.476942] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-05. [2025-10-02T19:02:43.725721] [DEBUG] [VALIDATOR ] FSCO: All expected trading days are present. [2025-10-02T19:02:43.725821] [DEBUG] [VALIDATOR ] FSCO: Primary data validation passed. [2025-10-02T19:02:43.726679] [INFO ] [MAIN ] FSCO: Fetched primary data is valid. [2025-10-02T19:02:43.726758] [DEBUG] [LOCAL ] FSCO: Saving primary data. [2025-10-02T19:02:43.728020] [DEBUG] [LOCAL ] FSCO: Trimmed 54403 records to 37913 (keeping 200 days of data) [2025-10-02T19:02:43.981214] [DEBUG] [LOCAL ] FSCO: Primary data saved (37913 records). [2025-10-02T19:02:43.981363] [INFO ] [MAIN ] FSCO: Full history saved. [2025-10-02T19:02:43.981488] [INFO ] [MAIN ] Update Progress: 873/2370 symbols completed. FSCO took 38.4s. Estimated remaining: 3h 30m 21s. Rate: 7.1 symbols/min [2025-10-02T19:02:44.184510] [INFO ] [MAIN ] FSS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:02:44.222264] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-02T19:02:44.272345] [DEBUG] [LOCAL ] FSS: Loaded 34065 existing records from primary storage. [2025-10-02T19:02:44.272681] [INFO ] [MAIN ] FSS: Loaded 34065 existing records. [2025-10-02T19:02:44.278208] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-07. [2025-10-02T19:02:44.478316] [WARN ] [MAIN ] FSS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:02:44.478578] [INFO ] [MAIN ] FSS: Wiping existing primary data before full refresh. [2025-10-02T19:02:44.478628] [INFO ] [LOCAL ] FSS: Starting deletion of primary data. [2025-10-02T19:02:44.481021] [DEBUG] [LOCAL ] FSS: Deleted primary data file. [2025-10-02T19:02:44.481087] [INFO ] [MAIN ] FSS: Starting full primary refresh. [2025-10-02T19:02:44.905696] [INFO ] [REMOTE ] FSS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:02:45.073115] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-06. [2025-10-02T19:02:45.389463] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-02T19:02:45.873015] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-06. [2025-10-02T19:02:46.114935] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-02T19:02:46.470551] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-02T19:02:46.673066] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-07. [2025-10-02T19:02:47.179194] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-02T19:02:47.473021] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-07. [2025-10-02T19:02:48.273022] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-08. [2025-10-02T19:02:48.547760] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-02T19:02:48.799341] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-02T19:02:49.073050] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-08. [2025-10-02T19:02:49.872970] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-08. [2025-10-02T19:02:50.094782] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-02T19:02:50.673047] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-09. [2025-10-02T19:02:50.917195] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-02T19:02:51.473002] [INFO ] [REMOTE ] FSS: Fetching primary data for 2024-12. [2025-10-02T19:02:51.636477] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-02T19:02:52.272996] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-09. [2025-10-02T19:02:52.391566] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-02T19:02:52.423996] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-02T19:02:53.073034] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-01. [2025-10-02T19:02:53.872998] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-10. [2025-10-02T19:02:54.036624] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-02T19:02:54.291300] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-02T19:02:54.673048] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-10. [2025-10-02T19:02:55.447942] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-02T19:02:55.450507] [INFO ] [REMOTE ] FSM: Full fetch complete (76769 records). [2025-10-02T19:02:55.450710] [DEBUG] [VALIDATOR ] FSM: Validating primary data. [2025-10-02T19:02:55.478181] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-02. [2025-10-02T19:02:55.906405] [DEBUG] [VALIDATOR ] FSM: All expected trading days are present. [2025-10-02T19:02:55.906527] [DEBUG] [VALIDATOR ] FSM: Primary data validation passed. [2025-10-02T19:02:55.908713] [INFO ] [MAIN ] FSM: Fetched primary data is valid. [2025-10-02T19:02:55.908803] [DEBUG] [LOCAL ] FSM: Saving primary data. [2025-10-02T19:02:55.910525] [DEBUG] [LOCAL ] FSM: Trimmed 76769 records to 53680 (keeping 200 days of data) [2025-10-02T19:02:56.027533] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-02T19:02:56.032859] [INFO ] [REMOTE ] FSK: Full fetch complete (71538 records). [2025-10-02T19:02:56.035136] [DEBUG] [VALIDATOR ] FSK: Validating primary data. [2025-10-02T19:02:56.308525] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-09. [2025-10-02T19:02:56.706673] [DEBUG] [VALIDATOR ] FSK: All expected trading days are present. [2025-10-02T19:02:56.717535] [DEBUG] [VALIDATOR ] FSK: Primary data validation passed. [2025-10-02T19:02:56.721800] [INFO ] [MAIN ] FSK: Fetched primary data is valid. [2025-10-02T19:02:56.721977] [DEBUG] [LOCAL ] FSK: Saving primary data. [2025-10-02T19:02:56.740954] [DEBUG] [LOCAL ] FSM: Primary data saved (53680 records). [2025-10-02T19:02:56.741373] [INFO ] [MAIN ] FSM: Full history saved. [2025-10-02T19:02:56.741810] [INFO ] [MAIN ] Update Progress: 874/2370 symbols completed. FSM took 31.9s. Estimated remaining: 3h 30m 20s. Rate: 7.1 symbols/min [2025-10-02T19:02:56.747596] [DEBUG] [LOCAL ] FSK: Trimmed 71538 records to 49800 (keeping 200 days of data) [2025-10-02T19:02:56.991159] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-02T19:02:57.082870] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-03. [2025-10-02T19:02:57.088366] [INFO ] [MAIN ] FT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:02:57.109987] [DEBUG] [LOCAL ] FT: Loaded 6535 existing records from primary storage. [2025-10-02T19:02:57.112219] [INFO ] [MAIN ] FT: Loaded 6535 existing records. [2025-10-02T19:02:57.357109] [WARN ] [MAIN ] FT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:02:57.363524] [INFO ] [MAIN ] FT: Wiping existing primary data before full refresh. [2025-10-02T19:02:57.372993] [INFO ] [LOCAL ] FT: Starting deletion of primary data. [2025-10-02T19:02:57.373527] [DEBUG] [LOCAL ] FT: Deleted primary data file. [2025-10-02T19:02:57.373598] [INFO ] [MAIN ] FT: Starting full primary refresh. [2025-10-02T19:02:57.975521] [INFO ] [REMOTE ] FT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:02:57.977296] [INFO ] [REMOTE ] FT: Fetching primary data for 2024-12. [2025-10-02T19:02:58.078829] [DEBUG] [LOCAL ] FSK: Primary data saved (49800 records). [2025-10-02T19:02:58.078996] [INFO ] [MAIN ] FSK: Full history saved. [2025-10-02T19:02:58.079816] [INFO ] [MAIN ] Update Progress: 875/2370 symbols completed. FSK took 37.0s. Estimated remaining: 3h 29m 59s. Rate: 7.1 symbols/min [2025-10-02T19:02:58.285904] [INFO ] [MAIN ] FTHY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:02:58.325877] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-02T19:02:58.344812] [DEBUG] [LOCAL ] FTHY: Loaded 11958 existing records from primary storage. [2025-10-02T19:02:58.345264] [INFO ] [MAIN ] FTHY: Loaded 11958 existing records. [2025-10-02T19:02:58.517151] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-02T19:02:58.509995] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-02T19:02:58.613059] [WARN ] [MAIN ] FTHY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:02:58.613579] [INFO ] [MAIN ] FTHY: Wiping existing primary data before full refresh. [2025-10-02T19:02:58.613629] [INFO ] [LOCAL ] FTHY: Starting deletion of primary data. [2025-10-02T19:02:58.614595] [DEBUG] [LOCAL ] FTHY: Deleted primary data file. [2025-10-02T19:02:58.614698] [INFO ] [MAIN ] FTHY: Starting full primary refresh. [2025-10-02T19:02:58.682104] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-01. [2025-10-02T19:02:59.020268] [INFO ] [REMOTE ] FTHY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:02:59.189861] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-02T19:02:59.473015] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-04. [2025-10-02T19:03:00.273007] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-10. [2025-10-02T19:03:01.073038] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-02. [2025-10-02T19:03:01.752697] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-02T19:03:01.783772] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-02T19:03:01.873024] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2024-12. [2025-10-02T19:03:02.165905] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-02T19:03:02.168851] [INFO ] [REMOTE ] FSLY: Full fetch complete (74894 records). [2025-10-02T19:03:02.168982] [DEBUG] [VALIDATOR ] FSLY: Validating primary data. [2025-10-02T19:03:02.609131] [DEBUG] [VALIDATOR ] FSLY: All expected trading days are present. [2025-10-02T19:03:02.609251] [DEBUG] [VALIDATOR ] FSLY: Primary data validation passed. [2025-10-02T19:03:02.610170] [INFO ] [MAIN ] FSLY: Fetched primary data is valid. [2025-10-02T19:03:02.610237] [DEBUG] [LOCAL ] FSLY: Saving primary data. [2025-10-02T19:03:02.611992] [DEBUG] [LOCAL ] FSLY: Trimmed 74894 records to 51615 (keeping 200 days of data) [2025-10-02T19:03:02.674983] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-03. [2025-10-02T19:03:02.836008] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-02T19:03:02.952558] [DEBUG] [LOCAL ] FSLY: Primary data saved (51615 records). [2025-10-02T19:03:02.952731] [INFO ] [MAIN ] FSLY: Full history saved. [2025-10-02T19:03:02.952825] [INFO ] [MAIN ] Update Progress: 876/2370 symbols completed. FSLY took 40.8s. Estimated remaining: 3h 29m 45s. Rate: 7.1 symbols/min [2025-10-02T19:03:03.149807] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-02T19:03:03.154353] [INFO ] [MAIN ] FTI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:03:03.213732] [DEBUG] [LOCAL ] FTI: Loaded 53299 existing records from primary storage. [2025-10-02T19:03:03.214119] [INFO ] [MAIN ] FTI: Loaded 53299 existing records. [2025-10-02T19:03:03.413005] [WARN ] [MAIN ] FTI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:03:03.413295] [INFO ] [MAIN ] FTI: Wiping existing primary data before full refresh. [2025-10-02T19:03:03.413353] [INFO ] [LOCAL ] FTI: Starting deletion of primary data. [2025-10-02T19:03:03.415207] [DEBUG] [LOCAL ] FTI: Deleted primary data file. [2025-10-02T19:03:03.415270] [INFO ] [MAIN ] FTI: Starting full primary refresh. [2025-10-02T19:03:03.478492] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-01. [2025-10-02T19:03:03.805904] [INFO ] [REMOTE ] FTI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:03:04.272996] [INFO ] [REMOTE ] FTI: Fetching primary data for 2024-12. [2025-10-02T19:03:04.393402] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-02T19:03:05.073006] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-04. [2025-10-02T19:03:05.781842] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-02T19:03:05.872991] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-05. [2025-10-02T19:03:06.022807] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-02T19:03:06.661055] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-02T19:03:06.672955] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-06. [2025-10-02T19:03:07.232057] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-02T19:03:07.473044] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-07. [2025-10-02T19:03:08.085835] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-02T19:03:08.273041] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-05. [2025-10-02T19:03:09.073030] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-08. [2025-10-02T19:03:09.325620] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-02T19:03:09.801536] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-02T19:03:09.872992] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-02. [2025-10-02T19:03:10.598237] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-02T19:03:10.673043] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-01. [2025-10-02T19:03:11.473087] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-06. [2025-10-02T19:03:12.273062] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-09. [2025-10-02T19:03:12.371187] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-02T19:03:12.840556] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-02T19:03:13.022452] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-02T19:03:13.073020] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-10. [2025-10-02T19:03:13.690231] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-02T19:03:13.691262] [INFO ] [REMOTE ] FT: Full fetch complete (9155 records). [2025-10-02T19:03:13.691352] [DEBUG] [VALIDATOR ] FT: Validating primary data. [2025-10-02T19:03:13.886399] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-02. [2025-10-02T19:03:14.104873] [DEBUG] [VALIDATOR ] FT: All expected trading days are present. [2025-10-02T19:03:14.104962] [DEBUG] [VALIDATOR ] FT: Primary data validation passed. [2025-10-02T19:03:14.105207] [INFO ] [MAIN ] FT: Fetched primary data is valid. [2025-10-02T19:03:14.105249] [DEBUG] [LOCAL ] FT: Saving primary data. [2025-10-02T19:03:14.105731] [DEBUG] [LOCAL ] FT: Trimmed 9155 records to 6571 (keeping 200 days of data) [2025-10-02T19:03:14.152233] [DEBUG] [LOCAL ] FT: Primary data saved (6571 records). [2025-10-02T19:03:14.152373] [INFO ] [MAIN ] FT: Full history saved. [2025-10-02T19:03:14.152494] [INFO ] [MAIN ] Update Progress: 877/2370 symbols completed. FT took 17.4s. Estimated remaining: 3h 29m 41s. Rate: 7.1 symbols/min [2025-10-02T19:03:14.673058] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-07. [2025-10-02T19:03:15.473267] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-03. [2025-10-02T19:03:15.596519] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-02T19:03:15.881095] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-02T19:03:15.907403] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-02T19:03:16.273027] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-04. [2025-10-02T19:03:17.073005] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-08. [2025-10-02T19:03:17.244436] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-02T19:03:17.873001] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-03. [2025-10-02T19:03:18.171321] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-02T19:03:18.673043] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-05. [2025-10-02T19:03:19.287547] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-02T19:03:19.449930] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-02T19:03:19.473007] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-09. [2025-10-02T19:03:20.273071] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-04. [2025-10-02T19:03:20.805913] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-02T19:03:21.073144] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-10. [2025-10-02T19:03:21.873098] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-06. [2025-10-02T19:03:21.982999] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-02T19:03:21.985441] [INFO ] [REMOTE ] FSS: Full fetch complete (48386 records). [2025-10-02T19:03:21.985630] [DEBUG] [VALIDATOR ] FSS: Validating primary data. [2025-10-02T19:03:22.428159] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-02T19:03:22.486775] [DEBUG] [VALIDATOR ] FSS: All expected trading days are present. [2025-10-02T19:03:22.487625] [DEBUG] [VALIDATOR ] FSS: Primary data validation passed. [2025-10-02T19:03:22.488897] [INFO ] [MAIN ] FSS: Fetched primary data is valid. [2025-10-02T19:03:22.488971] [DEBUG] [LOCAL ] FSS: Saving primary data. [2025-10-02T19:03:22.490619] [DEBUG] [LOCAL ] FSS: Trimmed 48386 records to 34339 (keeping 200 days of data) [2025-10-02T19:03:22.678418] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-05. [2025-10-02T19:03:22.714469] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-02T19:03:22.749087] [DEBUG] [LOCAL ] FSS: Primary data saved (34339 records). [2025-10-02T19:03:22.749315] [INFO ] [MAIN ] FSS: Full history saved. [2025-10-02T19:03:22.749429] [INFO ] [MAIN ] Update Progress: 878/2370 symbols completed. FSS took 38.8s. Estimated remaining: 3h 29m 33s. Rate: 7.1 symbols/min [2025-10-02T19:03:23.473022] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-07. [2025-10-02T19:03:24.263144] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-02T19:03:24.272961] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-08. [2025-10-02T19:03:24.368580] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-02T19:03:24.748794] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-02T19:03:25.073064] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-09. [2025-10-02T19:03:25.873124] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-06. [2025-10-02T19:03:25.908581] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-02T19:03:26.673113] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-10. [2025-10-02T19:03:27.507515] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-02T19:03:27.509028] [INFO ] [REMOTE ] FTHY: Full fetch complete (17575 records). [2025-10-02T19:03:27.509145] [DEBUG] [VALIDATOR ] FTHY: Validating primary data. [2025-10-02T19:03:27.887916] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-02T19:03:28.027330] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-07. [2025-10-02T19:03:28.028928] [DEBUG] [VALIDATOR ] FTHY: All expected trading days are present. [2025-10-02T19:03:28.029044] [DEBUG] [VALIDATOR ] FTHY: Primary data validation passed. [2025-10-02T19:03:28.029703] [INFO ] [MAIN ] FTHY: Fetched primary data is valid. [2025-10-02T19:03:28.029777] [DEBUG] [LOCAL ] FTHY: Saving primary data. [2025-10-02T19:03:28.030808] [DEBUG] [LOCAL ] FTHY: Trimmed 17575 records to 12100 (keeping 200 days of data) [2025-10-02T19:03:28.115178] [DEBUG] [LOCAL ] FTHY: Primary data saved (12100 records). [2025-10-02T19:03:28.115335] [INFO ] [MAIN ] FTHY: Full history saved. [2025-10-02T19:03:28.115425] [INFO ] [MAIN ] Update Progress: 879/2370 symbols completed. FTHY took 30.0s. Estimated remaining: 3h 29m 20s. Rate: 7.1 symbols/min [2025-10-02T19:03:29.814271] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-02T19:03:29.827215] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-08. [2025-10-02T19:03:31.213501] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-02T19:03:31.225413] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-09. [2025-10-02T19:03:32.694841] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-02T19:03:32.706969] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-10. [2025-10-02T19:03:34.156534] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-02T19:03:34.159245] [INFO ] [REMOTE ] FTI: Full fetch complete (77132 records). [2025-10-02T19:03:34.159416] [DEBUG] [VALIDATOR ] FTI: Validating primary data. [2025-10-02T19:03:34.628282] [DEBUG] [VALIDATOR ] FTI: All expected trading days are present. [2025-10-02T19:03:34.628388] [DEBUG] [VALIDATOR ] FTI: Primary data validation passed. [2025-10-02T19:03:34.629496] [INFO ] [MAIN ] FTI: Fetched primary data is valid. [2025-10-02T19:03:34.629574] [DEBUG] [LOCAL ] FTI: Saving primary data. [2025-10-02T19:03:34.631539] [DEBUG] [LOCAL ] FTI: Trimmed 77132 records to 53689 (keeping 200 days of data) [2025-10-02T19:03:34.992359] [DEBUG] [LOCAL ] FTI: Primary data saved (53689 records). [2025-10-02T19:03:34.992500] [INFO ] [MAIN ] FTI: Full history saved. [2025-10-02T19:03:34.992584] [INFO ] [MAIN ] Update Progress: 880/2370 symbols completed. FTI took 32.0s. Estimated remaining: 3h 29m 8s. Rate: 7.1 symbols/min [2025-10-02T19:03:35.654604] [INFO ] [MAIN ] FTV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:03:35.767817] [INFO ] [MAIN ] FTK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:03:35.801499] [INFO ] [MAIN ] FTS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:03:35.829522] [INFO ] [MAIN ] FTWO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:03:35.835806] [DEBUG] [LOCAL ] FTWO: Loaded 1816 existing records from primary storage. [2025-10-02T19:03:35.836140] [INFO ] [MAIN ] FTWO: Loaded 1816 existing records. [2025-10-02T19:03:36.099316] [WARN ] [MAIN ] FTWO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:03:36.100424] [DEBUG] [LOCAL ] FTK: Loaded 32200 existing records from primary storage. [2025-10-02T19:03:36.112517] [INFO ] [MAIN ] FTWO: Wiping existing primary data before full refresh. [2025-10-02T19:03:36.114138] [INFO ] [MAIN ] FTK: Loaded 32200 existing records. [2025-10-02T19:03:36.119796] [INFO ] [LOCAL ] FTWO: Starting deletion of primary data. [2025-10-02T19:03:36.153433] [DEBUG] [LOCAL ] FTS: Loaded 42138 existing records from primary storage. [2025-10-02T19:03:36.191755] [INFO ] [MAIN ] FTS: Loaded 42138 existing records. [2025-10-02T19:03:36.208310] [DEBUG] [LOCAL ] FTWO: Deleted primary data file. [2025-10-02T19:03:36.230389] [INFO ] [MAIN ] FTWO: Starting full primary refresh. [2025-10-02T19:03:36.219547] [DEBUG] [LOCAL ] FTV: Loaded 52928 existing records from primary storage. [2025-10-02T19:03:36.329361] [INFO ] [MAIN ] FTV: Loaded 52928 existing records. [2025-10-02T19:03:36.758753] [WARN ] [MAIN ] FTK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:03:36.792129] [INFO ] [MAIN ] FTK: Wiping existing primary data before full refresh. [2025-10-02T19:03:36.881510] [INFO ] [LOCAL ] FTK: Starting deletion of primary data. [2025-10-02T19:03:36.966504] [WARN ] [MAIN ] FTS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:03:37.026336] [DEBUG] [LOCAL ] FTK: Deleted primary data file. [2025-10-02T19:03:37.047593] [INFO ] [MAIN ] FTS: Wiping existing primary data before full refresh. [2025-10-02T19:03:37.030584] [WARN ] [MAIN ] FTV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:03:37.052944] [INFO ] [LOCAL ] FTS: Starting deletion of primary data. [2025-10-02T19:03:37.042244] [INFO ] [MAIN ] FTK: Starting full primary refresh. [2025-10-02T19:03:37.070479] [DEBUG] [LOCAL ] FTS: Deleted primary data file. [2025-10-02T19:03:37.102928] [INFO ] [MAIN ] FTS: Starting full primary refresh. [2025-10-02T19:03:37.117998] [INFO ] [MAIN ] FTV: Wiping existing primary data before full refresh. [2025-10-02T19:03:37.173702] [INFO ] [LOCAL ] FTV: Starting deletion of primary data. [2025-10-02T19:03:37.284731] [DEBUG] [LOCAL ] FTV: Deleted primary data file. [2025-10-02T19:03:37.349628] [INFO ] [MAIN ] FTV: Starting full primary refresh. [2025-10-02T19:03:37.595146] [INFO ] [REMOTE ] FTWO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:03:37.718605] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2024-12. [2025-10-02T19:03:38.551404] [INFO ] [REMOTE ] FTS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:03:38.583205] [INFO ] [REMOTE ] FTS: Fetching primary data for 2024-12. [2025-10-02T19:03:38.577527] [INFO ] [REMOTE ] FTV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:03:38.582775] [INFO ] [REMOTE ] FTK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:03:38.588057] [INFO ] [REMOTE ] FTV: Fetching primary data for 2024-12. [2025-10-02T19:03:38.587604] [INFO ] [REMOTE ] FTK: Fetching primary data for 2024-12. [2025-10-02T19:03:38.592022] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-02T19:03:38.594393] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-01. [2025-10-02T19:03:38.971638] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-02T19:03:38.973404] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-02. [2025-10-02T19:03:39.600452] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-02T19:03:39.601930] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-03. [2025-10-02T19:03:39.965067] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-02T19:03:39.970676] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-01. [2025-10-02T19:03:40.075266] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-02T19:03:40.076587] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-04. [2025-10-02T19:03:40.151914] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-02T19:03:40.163248] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-01. [2025-10-02T19:03:40.370053] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-02T19:03:40.380327] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-01. [2025-10-02T19:03:40.384724] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-10-02T19:03:40.386027] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-05. [2025-10-02T19:03:40.657791] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-10-02T19:03:40.659427] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-06. [2025-10-02T19:03:41.103836] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-02T19:03:41.110872] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-02. [2025-10-02T19:03:41.187418] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-02T19:03:41.599345] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-02T19:03:41.841603] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-02T19:03:41.872962] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-02. [2025-10-02T19:03:41.975575] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-02T19:03:42.672993] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-03. [2025-10-02T19:03:43.243055] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-02T19:03:43.472997] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-03. [2025-10-02T19:03:43.925053] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-02T19:03:44.273004] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-04. [2025-10-02T19:03:44.893587] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-02T19:03:45.073008] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-07. [2025-10-02T19:03:45.421442] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-02T19:03:45.508451] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-02T19:03:45.873031] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-02. [2025-10-02T19:03:46.673030] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-04. [2025-10-02T19:03:47.305419] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-02T19:03:47.473004] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-05. [2025-10-02T19:03:48.272974] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-08. [2025-10-02T19:03:48.498964] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-02T19:03:48.798048] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-02T19:03:49.007837] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-02T19:03:49.073016] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-03. [2025-10-02T19:03:49.872997] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-06. [2025-10-02T19:03:50.531711] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-02T19:03:50.672995] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-05. [2025-10-02T19:03:51.356825] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-02T19:03:51.473054] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-07. [2025-10-02T19:03:52.273021] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-04. [2025-10-02T19:03:52.476004] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-02T19:03:52.906690] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-02T19:03:53.073002] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-06. [2025-10-02T19:03:53.537964] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-02T19:03:53.873004] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-09. [2025-10-02T19:03:54.180343] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-02T19:03:54.429811] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-02T19:03:54.673005] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-05. [2025-10-02T19:03:55.473005] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-10. [2025-10-02T19:03:55.864892] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-02T19:03:55.865602] [INFO ] [REMOTE ] FTWO: Full fetch complete (3344 records). [2025-10-02T19:03:55.865702] [DEBUG] [VALIDATOR ] FTWO: Validating primary data. [2025-10-02T19:03:56.280233] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-08. [2025-10-02T19:03:56.289016] [DEBUG] [VALIDATOR ] FTWO: All expected trading days are present. [2025-10-02T19:03:56.289099] [DEBUG] [VALIDATOR ] FTWO: Primary data validation passed. [2025-10-02T19:03:56.289353] [INFO ] [MAIN ] FTWO: Fetched primary data is valid. [2025-10-02T19:03:56.289430] [DEBUG] [LOCAL ] FTWO: Saving primary data. [2025-10-02T19:03:56.290108] [DEBUG] [LOCAL ] FTWO: Trimmed 3344 records to 1836 (keeping 200 days of data) [2025-10-02T19:03:56.317254] [DEBUG] [LOCAL ] FTWO: Primary data saved (1836 records). [2025-10-02T19:03:56.328631] [INFO ] [MAIN ] FTWO: Full history saved. [2025-10-02T19:03:56.328983] [INFO ] [MAIN ] Update Progress: 881/2370 symbols completed. FTWO took 21.3s. Estimated remaining: 3h 29m 22s. Rate: 7.1 symbols/min [2025-10-02T19:03:56.335986] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-02T19:03:56.544917] [INFO ] [MAIN ] FUBO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:03:56.600098] [DEBUG] [LOCAL ] FUBO: Loaded 53697 existing records from primary storage. [2025-10-02T19:03:56.600485] [INFO ] [MAIN ] FUBO: Loaded 53697 existing records. [2025-10-02T19:03:56.803290] [WARN ] [MAIN ] FUBO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:03:56.803532] [INFO ] [MAIN ] FUBO: Wiping existing primary data before full refresh. [2025-10-02T19:03:56.803583] [INFO ] [LOCAL ] FUBO: Starting deletion of primary data. [2025-10-02T19:03:56.805267] [DEBUG] [LOCAL ] FUBO: Deleted primary data file. [2025-10-02T19:03:56.805335] [INFO ] [MAIN ] FUBO: Starting full primary refresh. [2025-10-02T19:03:57.080359] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-07. [2025-10-02T19:03:57.224224] [INFO ] [REMOTE ] FUBO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:03:57.466599] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-02T19:03:57.872999] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2024-12. [2025-10-02T19:03:58.672990] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-09. [2025-10-02T19:03:59.035084] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-02T19:03:59.472971] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-06. [2025-10-02T19:03:59.628257] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-02T19:04:00.003939] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-02T19:04:00.272995] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-01. [2025-10-02T19:04:01.073023] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-08. [2025-10-02T19:04:01.769952] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-10-02T19:04:01.873013] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-07. [2025-10-02T19:04:02.673001] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-10. [2025-10-02T19:04:03.287684] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-01 (3.01 seconds). [2025-10-02T19:04:03.473026] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-02. [2025-10-02T19:04:03.692384] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-08 (2.62 seconds). [2025-10-02T19:04:03.908396] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-02T19:04:03.910871] [INFO ] [REMOTE ] FTK: Full fetch complete (43105 records). [2025-10-02T19:04:03.911013] [DEBUG] [VALIDATOR ] FTK: Validating primary data. [2025-10-02T19:04:04.278009] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-09. [2025-10-02T19:04:04.287347] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-10-02T19:04:04.547195] [DEBUG] [VALIDATOR ] FTK: All expected trading days are present. [2025-10-02T19:04:04.547318] [DEBUG] [VALIDATOR ] FTK: Primary data validation passed. [2025-10-02T19:04:04.548593] [INFO ] [MAIN ] FTK: Fetched primary data is valid. [2025-10-02T19:04:04.548779] [DEBUG] [LOCAL ] FTK: Saving primary data. [2025-10-02T19:04:04.550560] [DEBUG] [LOCAL ] FTK: Trimmed 43105 records to 32441 (keeping 200 days of data) [2025-10-02T19:04:04.820515] [DEBUG] [LOCAL ] FTK: Primary data saved (32441 records). [2025-10-02T19:04:04.820799] [INFO ] [MAIN ] FTK: Full history saved. [2025-10-02T19:04:04.820920] [INFO ] [MAIN ] Update Progress: 882/2370 symbols completed. FTK took 29.8s. Estimated remaining: 3h 29m 14s. Rate: 7.1 symbols/min [2025-10-02T19:04:05.057353] [INFO ] [MAIN ] FUL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:04:05.078950] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-08. [2025-10-02T19:04:05.095927] [DEBUG] [LOCAL ] FUL: Loaded 32983 existing records from primary storage. [2025-10-02T19:04:05.096298] [INFO ] [MAIN ] FUL: Loaded 32983 existing records. [2025-10-02T19:04:05.311208] [WARN ] [MAIN ] FUL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:04:05.311505] [INFO ] [MAIN ] FUL: Wiping existing primary data before full refresh. [2025-10-02T19:04:05.311558] [INFO ] [LOCAL ] FUL: Starting deletion of primary data. [2025-10-02T19:04:05.313065] [DEBUG] [LOCAL ] FUL: Deleted primary data file. [2025-10-02T19:04:05.313129] [INFO ] [MAIN ] FUL: Starting full primary refresh. [2025-10-02T19:04:05.712548] [INFO ] [REMOTE ] FUL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:04:05.745894] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-10-02T19:04:05.873032] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-03. [2025-10-02T19:04:06.086116] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-02T19:04:06.628938] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-02T19:04:06.673041] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-09. [2025-10-02T19:04:07.473008] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-10. [2025-10-02T19:04:07.888954] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-02T19:04:07.958928] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-02T19:04:08.273035] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-10. [2025-10-02T19:04:08.945399] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-02T19:04:08.947734] [INFO ] [REMOTE ] FTV: Full fetch complete (76321 records). [2025-10-02T19:04:08.947856] [DEBUG] [VALIDATOR ] FTV: Validating primary data. [2025-10-02T19:04:09.078172] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-04. [2025-10-02T19:04:09.384772] [DEBUG] [VALIDATOR ] FTV: All expected trading days are present. [2025-10-02T19:04:09.389268] [DEBUG] [VALIDATOR ] FTV: Primary data validation passed. [2025-10-02T19:04:09.390981] [INFO ] [MAIN ] FTV: Fetched primary data is valid. [2025-10-02T19:04:09.391270] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-02T19:04:09.392903] [DEBUG] [LOCAL ] FTV: Saving primary data. [2025-10-02T19:04:09.394063] [INFO ] [REMOTE ] FTS: Full fetch complete (60194 records). [2025-10-02T19:04:09.394491] [DEBUG] [VALIDATOR ] FTS: Validating primary data. [2025-10-02T19:04:09.431416] [DEBUG] [LOCAL ] FTV: Trimmed 76321 records to 53318 (keeping 200 days of data) [2025-10-02T19:04:09.882526] [INFO ] [REMOTE ] FUL: Fetching primary data for 2024-12. [2025-10-02T19:04:09.947798] [DEBUG] [VALIDATOR ] FTS: All expected trading days are present. [2025-10-02T19:04:09.949004] [DEBUG] [VALIDATOR ] FTS: Primary data validation passed. [2025-10-02T19:04:09.950446] [INFO ] [MAIN ] FTS: Fetched primary data is valid. [2025-10-02T19:04:09.950573] [DEBUG] [LOCAL ] FTS: Saving primary data. [2025-10-02T19:04:09.957630] [DEBUG] [LOCAL ] FTS: Trimmed 60194 records to 42461 (keeping 200 days of data) [2025-10-02T19:04:10.461912] [DEBUG] [LOCAL ] FTS: Primary data saved (42461 records). [2025-10-02T19:04:10.462945] [INFO ] [MAIN ] FTS: Full history saved. [2025-10-02T19:04:10.463734] [INFO ] [MAIN ] Update Progress: 883/2370 symbols completed. FTS took 35.5s. Estimated remaining: 3h 29m 0s. Rate: 7.1 symbols/min [2025-10-02T19:04:10.539766] [DEBUG] [LOCAL ] FTV: Primary data saved (53318 records). [2025-10-02T19:04:10.551038] [INFO ] [MAIN ] FTV: Full history saved. [2025-10-02T19:04:10.574925] [INFO ] [MAIN ] Update Progress: 884/2370 symbols completed. FTV took 35.6s. Estimated remaining: 3h 28m 38s. Rate: 7.1 symbols/min [2025-10-02T19:04:10.778951] [INFO ] [MAIN ] FUN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:04:10.860634] [INFO ] [MAIN ] FVR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:04:10.887067] [DEBUG] [LOCAL ] FVR: Loaded 21768 existing records from primary storage. [2025-10-02T19:04:10.900472] [INFO ] [MAIN ] FVR: Loaded 21768 existing records. [2025-10-02T19:04:11.062378] [DEBUG] [LOCAL ] FUN: Loaded 51609 existing records from primary storage. [2025-10-02T19:04:11.108019] [INFO ] [MAIN ] FUN: Loaded 51609 existing records. [2025-10-02T19:04:11.141349] [WARN ] [MAIN ] FVR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:04:11.153917] [INFO ] [MAIN ] FVR: Wiping existing primary data before full refresh. [2025-10-02T19:04:11.231168] [INFO ] [LOCAL ] FVR: Starting deletion of primary data. [2025-10-02T19:04:11.232332] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-02T19:04:11.306178] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-01. [2025-10-02T19:04:11.312812] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-02T19:04:11.306254] [DEBUG] [LOCAL ] FVR: Deleted primary data file. [2025-10-02T19:04:11.337277] [INFO ] [MAIN ] FVR: Starting full primary refresh. [2025-10-02T19:04:11.476015] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-05. [2025-10-02T19:04:11.475487] [WARN ] [MAIN ] FUN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:04:11.509842] [INFO ] [MAIN ] FUN: Wiping existing primary data before full refresh. [2025-10-02T19:04:11.521731] [INFO ] [LOCAL ] FUN: Starting deletion of primary data. [2025-10-02T19:04:11.549731] [DEBUG] [LOCAL ] FUN: Deleted primary data file. [2025-10-02T19:04:11.570638] [INFO ] [MAIN ] FUN: Starting full primary refresh. [2025-10-02T19:04:12.089430] [INFO ] [REMOTE ] FVR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:04:12.278057] [INFO ] [REMOTE ] FVR: Fetching primary data for 2024-12. [2025-10-02T19:04:12.282153] [INFO ] [REMOTE ] FUN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:04:12.823370] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-02T19:04:13.073013] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-02. [2025-10-02T19:04:13.402583] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-02T19:04:13.439371] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-02T19:04:13.873052] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-01. [2025-10-02T19:04:14.505666] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-02T19:04:14.670925] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-02T19:04:14.674840] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-03. [2025-10-02T19:04:15.473057] [INFO ] [REMOTE ] FUN: Fetching primary data for 2024-12. [2025-10-02T19:04:16.243396] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-02T19:04:16.273012] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-02. [2025-10-02T19:04:17.073000] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-04. [2025-10-02T19:04:17.140900] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-02T19:04:17.231586] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-02T19:04:17.873016] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-03. [2025-10-02T19:04:18.619501] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-02T19:04:18.673074] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-05. [2025-10-02T19:04:18.944476] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-02T19:04:19.473008] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-01. [2025-10-02T19:04:19.922762] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-02T19:04:20.273009] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-06. [2025-10-02T19:04:20.923679] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-02T19:04:21.073052] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-02. [2025-10-02T19:04:21.575903] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-02T19:04:21.873004] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-04. [2025-10-02T19:04:22.190573] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-02T19:04:22.672976] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-03. [2025-10-02T19:04:22.883205] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-02T19:04:23.473049] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-06. [2025-10-02T19:04:24.232863] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-02T19:04:24.272963] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-04. [2025-10-02T19:04:25.072984] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-05. [2025-10-02T19:04:25.573489] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-02T19:04:25.662362] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-02T19:04:25.873046] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-07. [2025-10-02T19:04:26.247828] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-02T19:04:26.673022] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-05. [2025-10-02T19:04:27.122435] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-02T19:04:27.473043] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-07. [2025-10-02T19:04:28.273036] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-08. [2025-10-02T19:04:28.445565] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-02T19:04:29.073033] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-06. [2025-10-02T19:04:29.594996] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-02T19:04:29.730829] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-02T19:04:29.873014] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-09. [2025-10-02T19:04:30.678344] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-06. [2025-10-02T19:04:30.697232] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-02T19:04:30.838931] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-02T19:04:31.472997] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-07. [2025-10-02T19:04:31.769288] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-02T19:04:32.273023] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-07. [2025-10-02T19:04:33.072971] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-10. [2025-10-02T19:04:33.289587] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-02T19:04:33.340436] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-02T19:04:33.873006] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-08. [2025-10-02T19:04:34.249365] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-02T19:04:34.251245] [INFO ] [REMOTE ] FUL: Full fetch complete (47596 records). [2025-10-02T19:04:34.251406] [DEBUG] [VALIDATOR ] FUL: Validating primary data. [2025-10-02T19:04:34.675062] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-08. [2025-10-02T19:04:34.691895] [DEBUG] [VALIDATOR ] FUL: All expected trading days are present. [2025-10-02T19:04:34.692855] [DEBUG] [VALIDATOR ] FUL: Primary data validation passed. [2025-10-02T19:04:34.693678] [INFO ] [MAIN ] FUL: Fetched primary data is valid. [2025-10-02T19:04:34.693745] [DEBUG] [LOCAL ] FUL: Saving primary data. [2025-10-02T19:04:34.695042] [DEBUG] [LOCAL ] FUL: Trimmed 47596 records to 33213 (keeping 200 days of data) [2025-10-02T19:04:34.913812] [DEBUG] [LOCAL ] FUL: Primary data saved (33213 records). [2025-10-02T19:04:34.914028] [INFO ] [MAIN ] FUL: Full history saved. [2025-10-02T19:04:34.914143] [INFO ] [MAIN ] Update Progress: 885/2370 symbols completed. FUL took 30.1s. Estimated remaining: 3h 28m 56s. Rate: 7.1 symbols/min [2025-10-02T19:04:35.103396] [INFO ] [MAIN ] FVRR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:04:35.145243] [DEBUG] [LOCAL ] FVRR: Loaded 40034 existing records from primary storage. [2025-10-02T19:04:35.145552] [INFO ] [MAIN ] FVRR: Loaded 40034 existing records. [2025-10-02T19:04:35.340385] [WARN ] [MAIN ] FVRR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:04:35.340695] [INFO ] [MAIN ] FVRR: Wiping existing primary data before full refresh. [2025-10-02T19:04:35.340758] [INFO ] [LOCAL ] FVRR: Starting deletion of primary data. [2025-10-02T19:04:35.343796] [DEBUG] [LOCAL ] FVRR: Deleted primary data file. [2025-10-02T19:04:35.343862] [INFO ] [MAIN ] FVRR: Starting full primary refresh. [2025-10-02T19:04:35.478149] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-08. [2025-10-02T19:04:35.754275] [INFO ] [REMOTE ] FVRR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:04:35.788179] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-02T19:04:36.274400] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-09. [2025-10-02T19:04:36.279444] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-02T19:04:36.597055] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-02T19:04:37.073011] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-09. [2025-10-02T19:04:37.872978] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-09. [2025-10-02T19:04:38.076006] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-02T19:04:38.672984] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2024-12. [2025-10-02T19:04:38.898941] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-02T19:04:38.992961] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-02T19:04:39.473042] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-10. [2025-10-02T19:04:40.224352] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-02T19:04:40.272997] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-01. [2025-10-02T19:04:41.001179] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-02T19:04:41.003603] [INFO ] [REMOTE ] FUN: Full fetch complete (72878 records). [2025-10-02T19:04:41.003820] [DEBUG] [VALIDATOR ] FUN: Validating primary data. [2025-10-02T19:04:41.078177] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-10. [2025-10-02T19:04:41.436835] [DEBUG] [VALIDATOR ] FUN: All expected trading days are present. [2025-10-02T19:04:41.437067] [DEBUG] [VALIDATOR ] FUN: Primary data validation passed. [2025-10-02T19:04:41.438013] [INFO ] [MAIN ] FUN: Fetched primary data is valid. [2025-10-02T19:04:41.438084] [DEBUG] [LOCAL ] FUN: Saving primary data. [2025-10-02T19:04:41.439787] [DEBUG] [LOCAL ] FUN: Trimmed 72878 records to 51989 (keeping 200 days of data) [2025-10-02T19:04:41.782278] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-02T19:04:41.803450] [DEBUG] [LOCAL ] FUN: Primary data saved (51989 records). [2025-10-02T19:04:41.803610] [INFO ] [MAIN ] FUN: Full history saved. [2025-10-02T19:04:41.803730] [INFO ] [MAIN ] Update Progress: 886/2370 symbols completed. FUN took 31.3s. Estimated remaining: 3h 28m 45s. Rate: 7.1 symbols/min [2025-10-02T19:04:41.876455] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-10. [2025-10-02T19:04:41.958418] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-02T19:04:41.994348] [INFO ] [REMOTE ] FVR: Full fetch complete (30312 records). [2025-10-02T19:04:42.018540] [INFO ] [MAIN ] FXED: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:04:42.018779] [DEBUG] [VALIDATOR ] FVR: Validating primary data. [2025-10-02T19:04:42.114218] [DEBUG] [LOCAL ] FXED: Loaded 1241 existing records from primary storage. [2025-10-02T19:04:42.133686] [INFO ] [MAIN ] FXED: Loaded 1241 existing records. [2025-10-02T19:04:42.529765] [WARN ] [MAIN ] FXED: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:04:42.547335] [INFO ] [MAIN ] FXED: Wiping existing primary data before full refresh. [2025-10-02T19:04:42.568302] [INFO ] [LOCAL ] FXED: Starting deletion of primary data. [2025-10-02T19:04:42.577197] [DEBUG] [LOCAL ] FXED: Deleted primary data file. [2025-10-02T19:04:42.587541] [INFO ] [MAIN ] FXED: Starting full primary refresh. [2025-10-02T19:04:42.690856] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-02. [2025-10-02T19:04:42.732468] [DEBUG] [VALIDATOR ] FVR: All expected trading days are present. [2025-10-02T19:04:42.758423] [DEBUG] [VALIDATOR ] FVR: Primary data validation passed. [2025-10-02T19:04:42.778621] [INFO ] [MAIN ] FVR: Fetched primary data is valid. [2025-10-02T19:04:42.778833] [DEBUG] [LOCAL ] FVR: Saving primary data. [2025-10-02T19:04:42.829004] [DEBUG] [LOCAL ] FVR: Trimmed 30312 records to 21880 (keeping 200 days of data) [2025-10-02T19:04:43.173121] [INFO ] [REMOTE ] FXED: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:04:43.218929] [DEBUG] [LOCAL ] FVR: Primary data saved (21880 records). [2025-10-02T19:04:43.219068] [INFO ] [MAIN ] FVR: Full history saved. [2025-10-02T19:04:43.219187] [INFO ] [MAIN ] Update Progress: 887/2370 symbols completed. FVR took 32.6s. Estimated remaining: 3h 28m 25s. Rate: 7.1 symbols/min [2025-10-02T19:04:43.411188] [INFO ] [MAIN ] G: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:04:43.466775] [DEBUG] [LOCAL ] G: Loaded 49838 existing records from primary storage. [2025-10-02T19:04:43.467130] [INFO ] [MAIN ] G: Loaded 49838 existing records. [2025-10-02T19:04:43.502615] [INFO ] [REMOTE ] FXED: Fetching primary data for 2024-12. [2025-10-02T19:04:43.662195] [WARN ] [MAIN ] G: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:04:43.662417] [INFO ] [MAIN ] G: Wiping existing primary data before full refresh. [2025-10-02T19:04:43.662467] [INFO ] [LOCAL ] G: Starting deletion of primary data. [2025-10-02T19:04:43.665066] [DEBUG] [LOCAL ] G: Deleted primary data file. [2025-10-02T19:04:43.665130] [INFO ] [MAIN ] G: Starting full primary refresh. [2025-10-02T19:04:43.972618] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-02T19:04:43.995304] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-02T19:04:44.046174] [INFO ] [REMOTE ] FUBO: Full fetch complete (77767 records). [2025-10-02T19:04:44.069749] [DEBUG] [VALIDATOR ] FUBO: Validating primary data. [2025-10-02T19:04:44.069579] [INFO ] [REMOTE ] G: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:04:44.276041] [INFO ] [REMOTE ] G: Fetching primary data for 2024-12. [2025-10-02T19:04:44.545469] [DEBUG] [VALIDATOR ] FUBO: All expected trading days are present. [2025-10-02T19:04:44.549246] [DEBUG] [VALIDATOR ] FUBO: Primary data validation passed. [2025-10-02T19:04:44.550708] [INFO ] [MAIN ] FUBO: Fetched primary data is valid. [2025-10-02T19:04:44.552800] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-02T19:04:44.553023] [DEBUG] [LOCAL ] FUBO: Saving primary data. [2025-10-02T19:04:44.568408] [DEBUG] [LOCAL ] FUBO: Trimmed 77767 records to 54087 (keeping 200 days of data) [2025-10-02T19:04:44.919666] [DEBUG] [LOCAL ] FUBO: Primary data saved (54087 records). [2025-10-02T19:04:44.919828] [INFO ] [MAIN ] FUBO: Full history saved. [2025-10-02T19:04:44.919913] [INFO ] [MAIN ] Update Progress: 888/2370 symbols completed. FUBO took 48.6s. Estimated remaining: 3h 28m 5s. Rate: 7.1 symbols/min [2025-10-02T19:04:45.080231] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-03. [2025-10-02T19:04:45.116186] [INFO ] [MAIN ] GAB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:04:45.146847] [DEBUG] [LOCAL ] GAB: Loaded 27976 existing records from primary storage. [2025-10-02T19:04:45.147114] [INFO ] [MAIN ] GAB: Loaded 27976 existing records. [2025-10-02T19:04:45.342738] [WARN ] [MAIN ] GAB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:04:45.342944] [INFO ] [MAIN ] GAB: Wiping existing primary data before full refresh. [2025-10-02T19:04:45.342994] [INFO ] [LOCAL ] GAB: Starting deletion of primary data. [2025-10-02T19:04:45.345111] [DEBUG] [LOCAL ] GAB: Deleted primary data file. [2025-10-02T19:04:45.345175] [INFO ] [MAIN ] GAB: Starting full primary refresh. [2025-10-02T19:04:45.751102] [INFO ] [REMOTE ] GAB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:04:45.873003] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-01. [2025-10-02T19:04:45.935357] [INFO ] [REMOTE ] G: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-02T19:04:46.524224] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-02T19:04:46.561962] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-02T19:04:46.673005] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-02. [2025-10-02T19:04:47.002841] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-02T19:04:47.473033] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-04. [2025-10-02T19:04:48.273003] [INFO ] [REMOTE ] GAB: Fetching primary data for 2024-12. [2025-10-02T19:04:48.932911] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-02T19:04:49.073010] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-05. [2025-10-02T19:04:49.487104] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-02T19:04:49.873003] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-01. [2025-10-02T19:04:50.568227] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-02T19:04:50.672976] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-06. [2025-10-02T19:04:50.984515] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-02T19:04:51.473007] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-02. [2025-10-02T19:04:52.082862] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-02T19:04:52.273003] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-07. [2025-10-02T19:04:52.418748] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-02T19:04:53.073016] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-03. [2025-10-02T19:04:53.431372] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-02T19:04:53.545504] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-02T19:04:53.873003] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-04. [2025-10-02T19:04:54.319269] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-02T19:04:54.672995] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-03. [2025-10-02T19:04:55.472997] [INFO ] [REMOTE ] G: Fetching primary data for 2025-01. [2025-10-02T19:04:56.015937] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-02T19:04:56.273006] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-05. [2025-10-02T19:04:56.629590] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-02T19:04:57.078320] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-06. [2025-10-02T19:04:57.094165] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-02T19:04:57.372863] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-10-02T19:04:57.873001] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-08. [2025-10-02T19:04:58.673027] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-07. [2025-10-02T19:04:58.958722] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-10-02T19:04:59.451028] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-02T19:04:59.472972] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-09. [2025-10-02T19:05:00.273030] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-08. [2025-10-02T19:05:01.073014] [INFO ] [REMOTE ] G: Fetching primary data for 2025-02. [2025-10-02T19:05:01.386930] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-02T19:05:01.438880] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-02T19:05:01.873018] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-04. [2025-10-02T19:05:02.519449] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-02T19:05:02.672984] [INFO ] [REMOTE ] G: Fetching primary data for 2025-03. [2025-10-02T19:05:02.998261] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-02T19:05:03.473001] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-09. [2025-10-02T19:05:03.915813] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-02T19:05:04.272981] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-05. [2025-10-02T19:05:04.655574] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-02T19:05:05.072967] [INFO ] [REMOTE ] G: Fetching primary data for 2025-04. [2025-10-02T19:05:05.480988] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-02T19:05:05.873030] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-06. [2025-10-02T19:05:06.672988] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-10. [2025-10-02T19:05:06.768449] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-02T19:05:07.081944] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-02T19:05:07.082608] [INFO ] [REMOTE ] FXED: Full fetch complete (1803 records). [2025-10-02T19:05:07.082707] [DEBUG] [VALIDATOR ] FXED: Validating primary data. [2025-10-02T19:05:07.391819] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-02T19:05:07.480716] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-10. [2025-10-02T19:05:07.515777] [DEBUG] [VALIDATOR ] FXED: All expected trading days are present. [2025-10-02T19:05:07.515863] [DEBUG] [VALIDATOR ] FXED: Primary data validation passed. [2025-10-02T19:05:07.515977] [INFO ] [MAIN ] FXED: Fetched primary data is valid. [2025-10-02T19:05:07.516053] [DEBUG] [LOCAL ] FXED: Saving primary data. [2025-10-02T19:05:07.516410] [DEBUG] [LOCAL ] FXED: Trimmed 1803 records to 1253 (keeping 200 days of data) [2025-10-02T19:05:07.526766] [DEBUG] [LOCAL ] FXED: Primary data saved (1253 records). [2025-10-02T19:05:07.526846] [INFO ] [MAIN ] FXED: Full history saved. [2025-10-02T19:05:07.526950] [INFO ] [MAIN ] Update Progress: 889/2370 symbols completed. FXED took 25.7s. Estimated remaining: 3h 28m 21s. Rate: 7.1 symbols/min [2025-10-02T19:05:07.711215] [INFO ] [MAIN ] GAM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:05:07.723704] [DEBUG] [LOCAL ] GAM: Loaded 4061 existing records from primary storage. [2025-10-02T19:05:07.723930] [INFO ] [MAIN ] GAM: Loaded 4061 existing records. [2025-10-02T19:05:07.925222] [WARN ] [MAIN ] GAM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:05:07.925532] [INFO ] [MAIN ] GAM: Wiping existing primary data before full refresh. [2025-10-02T19:05:07.925606] [INFO ] [LOCAL ] GAM: Starting deletion of primary data. [2025-10-02T19:05:07.926033] [DEBUG] [LOCAL ] GAM: Deleted primary data file. [2025-10-02T19:05:07.926109] [INFO ] [MAIN ] GAM: Starting full primary refresh. [2025-10-02T19:05:08.278183] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-07. [2025-10-02T19:05:08.338135] [INFO ] [REMOTE ] GAM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:05:08.834079] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-02T19:05:08.835887] [INFO ] [REMOTE ] FVRR: Full fetch complete (59003 records). [2025-10-02T19:05:08.835980] [DEBUG] [VALIDATOR ] FVRR: Validating primary data. [2025-10-02T19:05:09.077121] [INFO ] [REMOTE ] G: Fetching primary data for 2025-05. [2025-10-02T19:05:09.260880] [DEBUG] [VALIDATOR ] FVRR: All expected trading days are present. [2025-10-02T19:05:09.261023] [DEBUG] [VALIDATOR ] FVRR: Primary data validation passed. [2025-10-02T19:05:09.261854] [INFO ] [MAIN ] FVRR: Fetched primary data is valid. [2025-10-02T19:05:09.262062] [DEBUG] [LOCAL ] FVRR: Saving primary data. [2025-10-02T19:05:09.280957] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-02T19:05:09.280122] [DEBUG] [LOCAL ] FVRR: Trimmed 59003 records to 40323 (keeping 200 days of data) [2025-10-02T19:05:09.543278] [DEBUG] [LOCAL ] FVRR: Primary data saved (40323 records). [2025-10-02T19:05:09.543451] [INFO ] [MAIN ] FVRR: Full history saved. [2025-10-02T19:05:09.543602] [INFO ] [MAIN ] Update Progress: 890/2370 symbols completed. FVRR took 34.6s. Estimated remaining: 3h 28m 1s. Rate: 7.1 symbols/min [2025-10-02T19:05:09.726098] [INFO ] [MAIN ] GAP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:05:09.783062] [DEBUG] [LOCAL ] GAP: Loaded 53655 existing records from primary storage. [2025-10-02T19:05:09.783404] [INFO ] [MAIN ] GAP: Loaded 53655 existing records. [2025-10-02T19:05:09.880378] [INFO ] [REMOTE ] GAM: Fetching primary data for 2024-12. [2025-10-02T19:05:09.980229] [WARN ] [MAIN ] GAP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:05:09.980467] [INFO ] [MAIN ] GAP: Wiping existing primary data before full refresh. [2025-10-02T19:05:09.980539] [INFO ] [LOCAL ] GAP: Starting deletion of primary data. [2025-10-02T19:05:09.983165] [DEBUG] [LOCAL ] GAP: Deleted primary data file. [2025-10-02T19:05:09.983229] [INFO ] [MAIN ] GAP: Starting full primary refresh. [2025-10-02T19:05:10.380244] [INFO ] [REMOTE ] GAP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:05:10.512023] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-02T19:05:10.673022] [INFO ] [REMOTE ] G: Fetching primary data for 2025-06. [2025-10-02T19:05:10.680933] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-02T19:05:11.473006] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-01. [2025-10-02T19:05:12.063605] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-02T19:05:12.273006] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-08. [2025-10-02T19:05:12.340566] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-02T19:05:13.073019] [INFO ] [REMOTE ] GAP: Fetching primary data for 2024-12. [2025-10-02T19:05:13.187602] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-02T19:05:13.872995] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-02. [2025-10-02T19:05:14.624519] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-02T19:05:14.643199] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-02T19:05:14.672969] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-01. [2025-10-02T19:05:15.473051] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-09. [2025-10-02T19:05:16.272997] [INFO ] [REMOTE ] G: Fetching primary data for 2025-07. [2025-10-02T19:05:16.548718] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-02T19:05:16.743807] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-02T19:05:17.073031] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-02. [2025-10-02T19:05:17.872987] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-03. [2025-10-02T19:05:17.981094] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-02T19:05:18.512290] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-02T19:05:18.628416] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-02T19:05:18.672992] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-10. [2025-10-02T19:05:19.473024] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-03. [2025-10-02T19:05:19.506748] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-02T19:05:19.508257] [INFO ] [REMOTE ] GAB: Full fetch complete (39597 records). [2025-10-02T19:05:19.508383] [DEBUG] [VALIDATOR ] GAB: Validating primary data. [2025-10-02T19:05:19.938628] [DEBUG] [VALIDATOR ] GAB: All expected trading days are present. [2025-10-02T19:05:19.938793] [DEBUG] [VALIDATOR ] GAB: Primary data validation passed. [2025-10-02T19:05:19.939480] [INFO ] [MAIN ] GAB: Fetched primary data is valid. [2025-10-02T19:05:19.939526] [DEBUG] [LOCAL ] GAB: Saving primary data. [2025-10-02T19:05:19.940600] [DEBUG] [LOCAL ] GAB: Trimmed 39597 records to 28112 (keeping 200 days of data) [2025-10-02T19:05:20.120703] [DEBUG] [LOCAL ] GAB: Primary data saved (28112 records). [2025-10-02T19:05:20.120842] [INFO ] [MAIN ] GAB: Full history saved. [2025-10-02T19:05:20.120939] [INFO ] [MAIN ] Update Progress: 891/2370 symbols completed. GAB took 35.2s. Estimated remaining: 3h 27m 57s. Rate: 7.1 symbols/min [2025-10-02T19:05:20.278205] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-04. [2025-10-02T19:05:20.312361] [INFO ] [MAIN ] GATX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:05:20.333757] [DEBUG] [LOCAL ] GATX: Loaded 18174 existing records from primary storage. [2025-10-02T19:05:20.334030] [INFO ] [MAIN ] GATX: Loaded 18174 existing records. [2025-10-02T19:05:20.533485] [WARN ] [MAIN ] GATX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:05:20.533823] [INFO ] [MAIN ] GATX: Wiping existing primary data before full refresh. [2025-10-02T19:05:20.533886] [INFO ] [LOCAL ] GATX: Starting deletion of primary data. [2025-10-02T19:05:20.535085] [DEBUG] [LOCAL ] GATX: Deleted primary data file. [2025-10-02T19:05:20.535160] [INFO ] [MAIN ] GATX: Starting full primary refresh. [2025-10-02T19:05:20.937928] [INFO ] [REMOTE ] GATX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:05:20.976960] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-02T19:05:20.994246] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-02T19:05:21.073023] [INFO ] [REMOTE ] G: Fetching primary data for 2025-08. [2025-10-02T19:05:21.872984] [INFO ] [REMOTE ] GATX: Fetching primary data for 2024-12. [2025-10-02T19:05:22.672993] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-04. [2025-10-02T19:05:22.794569] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-02T19:05:22.927917] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-02T19:05:23.473081] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-05. [2025-10-02T19:05:24.047548] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-02T19:05:24.273000] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-06. [2025-10-02T19:05:24.576771] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-02T19:05:24.663479] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-02T19:05:25.073000] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-05. [2025-10-02T19:05:25.873010] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-01. [2025-10-02T19:05:26.672984] [INFO ] [REMOTE ] G: Fetching primary data for 2025-09. [2025-10-02T19:05:26.915024] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-02T19:05:27.089472] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-02T19:05:27.473049] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-07. [2025-10-02T19:05:27.966274] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-02T19:05:28.266359] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-02T19:05:28.277029] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-06. [2025-10-02T19:05:29.073029] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-08. [2025-10-02T19:05:29.731628] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-02T19:05:29.872972] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-09. [2025-10-02T19:05:30.073379] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-02T19:05:30.417357] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-02T19:05:30.673041] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-07. [2025-10-02T19:05:31.473006] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-10. [2025-10-02T19:05:31.871596] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-02T19:05:31.872362] [INFO ] [REMOTE ] GAM: Full fetch complete (6726 records). [2025-10-02T19:05:31.872447] [DEBUG] [VALIDATOR ] GAM: Validating primary data. [2025-10-02T19:05:32.247533] [DEBUG] [VALIDATOR ] GAM: All expected trading days are present. [2025-10-02T19:05:32.247610] [DEBUG] [VALIDATOR ] GAM: Primary data validation passed. [2025-10-02T19:05:32.247820] [INFO ] [MAIN ] GAM: Fetched primary data is valid. [2025-10-02T19:05:32.247880] [DEBUG] [LOCAL ] GAM: Saving primary data. [2025-10-02T19:05:32.248321] [DEBUG] [LOCAL ] GAM: Trimmed 6726 records to 4081 (keeping 200 days of data) [2025-10-02T19:05:32.273069] [INFO ] [REMOTE ] G: Fetching primary data for 2025-10. [2025-10-02T19:05:32.274377] [DEBUG] [LOCAL ] GAM: Primary data saved (4081 records). [2025-10-02T19:05:32.274466] [INFO ] [MAIN ] GAM: Full history saved. [2025-10-02T19:05:32.275354] [INFO ] [MAIN ] Update Progress: 892/2370 symbols completed. GAM took 24.7s. Estimated remaining: 3h 27m 54s. Rate: 7.1 symbols/min [2025-10-02T19:05:32.454380] [INFO ] [MAIN ] GBAB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:05:32.473966] [DEBUG] [LOCAL ] GBAB: Loaded 13085 existing records from primary storage. [2025-10-02T19:05:32.474254] [INFO ] [MAIN ] GBAB: Loaded 13085 existing records. [2025-10-02T19:05:32.669982] [WARN ] [MAIN ] GBAB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:05:32.670297] [INFO ] [MAIN ] GBAB: Wiping existing primary data before full refresh. [2025-10-02T19:05:32.670359] [INFO ] [LOCAL ] GBAB: Starting deletion of primary data. [2025-10-02T19:05:32.671011] [DEBUG] [LOCAL ] GBAB: Deleted primary data file. [2025-10-02T19:05:32.671090] [INFO ] [MAIN ] GBAB: Starting full primary refresh. [2025-10-02T19:05:32.924796] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-02T19:05:33.074131] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-08. [2025-10-02T19:05:33.156620] [INFO ] [REMOTE ] GBAB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:05:33.713638] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-02T19:05:33.715794] [INFO ] [REMOTE ] G: Full fetch complete (71634 records). [2025-10-02T19:05:33.715965] [DEBUG] [VALIDATOR ] G: Validating primary data. [2025-10-02T19:05:33.878152] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-02. [2025-10-02T19:05:34.164904] [DEBUG] [VALIDATOR ] G: All expected trading days are present. [2025-10-02T19:05:34.165012] [DEBUG] [VALIDATOR ] G: Primary data validation passed. [2025-10-02T19:05:34.166015] [INFO ] [MAIN ] G: Fetched primary data is valid. [2025-10-02T19:05:34.166105] [DEBUG] [LOCAL ] G: Saving primary data. [2025-10-02T19:05:34.167695] [DEBUG] [LOCAL ] G: Trimmed 71634 records to 50210 (keeping 200 days of data) [2025-10-02T19:05:34.500065] [DEBUG] [LOCAL ] G: Primary data saved (50210 records). [2025-10-02T19:05:34.500223] [INFO ] [MAIN ] G: Full history saved. [2025-10-02T19:05:34.501314] [INFO ] [MAIN ] Update Progress: 893/2370 symbols completed. G took 51.3s. Estimated remaining: 3h 27m 36s. Rate: 7.1 symbols/min [2025-10-02T19:05:34.675536] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2024-12. [2025-10-02T19:05:34.698398] [INFO ] [MAIN ] GBCI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:05:34.714289] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-02T19:05:34.768317] [DEBUG] [LOCAL ] GBCI: Loaded 40011 existing records from primary storage. [2025-10-02T19:05:34.770186] [INFO ] [MAIN ] GBCI: Loaded 40011 existing records. [2025-10-02T19:05:34.989259] [WARN ] [MAIN ] GBCI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:05:34.989552] [INFO ] [MAIN ] GBCI: Wiping existing primary data before full refresh. [2025-10-02T19:05:34.989719] [INFO ] [LOCAL ] GBCI: Starting deletion of primary data. [2025-10-02T19:05:35.001581] [DEBUG] [LOCAL ] GBCI: Deleted primary data file. [2025-10-02T19:05:35.021928] [INFO ] [MAIN ] GBCI: Starting full primary refresh. [2025-10-02T19:05:35.029770] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-02T19:05:35.437949] [INFO ] [REMOTE ] GBCI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:05:35.472971] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2024-12. [2025-10-02T19:05:35.489354] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-02T19:05:36.273013] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-01. [2025-10-02T19:05:36.893838] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-02T19:05:37.073009] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-09. [2025-10-02T19:05:37.178928] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-02T19:05:37.873003] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-02. [2025-10-02T19:05:38.600128] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-02T19:05:38.673016] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-03. [2025-10-02T19:05:38.999600] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-02T19:05:39.235188] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-02T19:05:39.473008] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-01. [2025-10-02T19:05:40.273004] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-03. [2025-10-02T19:05:40.876931] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-02T19:05:41.073109] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-10. [2025-10-02T19:05:41.073435] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-02T19:05:41.872984] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-04. [2025-10-02T19:05:42.435995] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-02T19:05:42.438169] [INFO ] [REMOTE ] GAP: Full fetch complete (77635 records). [2025-10-02T19:05:42.438283] [DEBUG] [VALIDATOR ] GAP: Validating primary data. [2025-10-02T19:05:42.678166] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-02. [2025-10-02T19:05:42.823219] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-02T19:05:42.876110] [DEBUG] [VALIDATOR ] GAP: All expected trading days are present. [2025-10-02T19:05:42.876197] [DEBUG] [VALIDATOR ] GAP: Primary data validation passed. [2025-10-02T19:05:42.877258] [INFO ] [MAIN ] GAP: Fetched primary data is valid. [2025-10-02T19:05:42.877332] [DEBUG] [LOCAL ] GAP: Saving primary data. [2025-10-02T19:05:42.878968] [DEBUG] [LOCAL ] GAP: Trimmed 77635 records to 54045 (keeping 200 days of data) [2025-10-02T19:05:43.230295] [DEBUG] [LOCAL ] GAP: Primary data saved (54045 records). [2025-10-02T19:05:43.230443] [INFO ] [MAIN ] GAP: Full history saved. [2025-10-02T19:05:43.230544] [INFO ] [MAIN ] Update Progress: 894/2370 symbols completed. GAP took 33.7s. Estimated remaining: 3h 27m 28s. Rate: 7.1 symbols/min [2025-10-02T19:05:43.411555] [INFO ] [MAIN ] GBLI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:05:43.411745] [DEBUG] [LOCAL ] GBLI: No existing data file found in primary storage. [2025-10-02T19:05:43.411793] [WARN ] [MAIN ] GBLI: No existing data found, performing full refresh instead. [2025-10-02T19:05:43.411903] [INFO ] [MAIN ] GBLI: Wiping existing primary data before full refresh. [2025-10-02T19:05:43.411944] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-02T19:05:43.411986] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-02T19:05:43.412018] [INFO ] [MAIN ] GBLI: Starting full primary refresh. [2025-10-02T19:05:43.479712] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-05. [2025-10-02T19:05:43.795301] [INFO ] [REMOTE ] GBLI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:05:44.066526] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-02T19:05:44.273038] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2024-12. [2025-10-02T19:05:44.297034] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-02T19:05:44.575570] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2024-12 (0.30 seconds). [2025-10-02T19:05:45.073000] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-03. [2025-10-02T19:05:45.873001] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-01. [2025-10-02T19:05:46.219498] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-02T19:05:46.327447] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-02T19:05:46.673006] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-04. [2025-10-02T19:05:47.473009] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-02. [2025-10-02T19:05:47.763930] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-02T19:05:47.977541] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-02T19:05:48.273004] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-06. [2025-10-02T19:05:49.073003] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-03. [2025-10-02T19:05:49.307972] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-02T19:05:49.421243] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-02T19:05:49.873002] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-04. [2025-10-02T19:05:50.672996] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-05. [2025-10-02T19:05:51.405818] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-02T19:05:51.472960] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-05. [2025-10-02T19:05:51.663315] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-02T19:05:52.273043] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-06. [2025-10-02T19:05:52.635876] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-02T19:05:53.073017] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-04. [2025-10-02T19:05:53.357686] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-02T19:05:53.497941] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-02T19:05:53.872999] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-07. [2025-10-02T19:05:54.673015] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-07. [2025-10-02T19:05:54.792605] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-02T19:05:55.472996] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-08. [2025-10-02T19:05:55.615394] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-02T19:05:56.249572] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-02T19:05:56.272982] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-09. [2025-10-02T19:05:57.056225] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-02T19:05:57.073037] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-06. [2025-10-02T19:05:57.873022] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-10. [2025-10-02T19:05:58.439792] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-02T19:05:58.480103] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-02T19:05:58.481188] [INFO ] [REMOTE ] GBAB: Full fetch complete (19692 records). [2025-10-02T19:05:58.481287] [DEBUG] [VALIDATOR ] GBAB: Validating primary data. [2025-10-02T19:05:58.694455] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-08. [2025-10-02T19:05:58.942013] [DEBUG] [VALIDATOR ] GBAB: All expected trading days are present. [2025-10-02T19:05:58.942116] [DEBUG] [VALIDATOR ] GBAB: Primary data validation passed. [2025-10-02T19:05:58.942674] [INFO ] [MAIN ] GBAB: Fetched primary data is valid. [2025-10-02T19:05:58.942747] [DEBUG] [LOCAL ] GBAB: Saving primary data. [2025-10-02T19:05:58.943539] [DEBUG] [LOCAL ] GBAB: Trimmed 19692 records to 13143 (keeping 200 days of data) [2025-10-02T19:05:59.028916] [DEBUG] [LOCAL ] GBAB: Primary data saved (13143 records). [2025-10-02T19:05:59.029064] [INFO ] [MAIN ] GBAB: Full history saved. [2025-10-02T19:05:59.029147] [INFO ] [MAIN ] Update Progress: 895/2370 symbols completed. GBAB took 26.8s. Estimated remaining: 3h 27m 31s. Rate: 7.1 symbols/min [2025-10-02T19:05:59.208159] [INFO ] [MAIN ] GBTG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:05:59.254207] [DEBUG] [LOCAL ] GBTG: Loaded 40046 existing records from primary storage. [2025-10-02T19:05:59.254536] [INFO ] [MAIN ] GBTG: Loaded 40046 existing records. [2025-10-02T19:05:59.460559] [WARN ] [MAIN ] GBTG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:05:59.460945] [INFO ] [MAIN ] GBTG: Wiping existing primary data before full refresh. [2025-10-02T19:05:59.461030] [INFO ] [LOCAL ] GBTG: Starting deletion of primary data. [2025-10-02T19:05:59.462186] [DEBUG] [LOCAL ] GBTG: Deleted primary data file. [2025-10-02T19:05:59.462249] [INFO ] [MAIN ] GBTG: Starting full primary refresh. [2025-10-02T19:05:59.478111] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-05. [2025-10-02T19:05:59.815727] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-02T19:05:59.927774] [INFO ] [REMOTE ] GBTG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:05:59.930577] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-02T19:06:00.273008] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-06. [2025-10-02T19:06:00.915918] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-02T19:06:01.072979] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-07. [2025-10-02T19:06:01.872994] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2024-12. [2025-10-02T19:06:02.652257] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-02T19:06:02.672977] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-08. [2025-10-02T19:06:03.320633] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-02T19:06:03.472998] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-07. [2025-10-02T19:06:03.728531] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-10-02T19:06:04.101582] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-02T19:06:04.273033] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-08. [2025-10-02T19:06:04.716068] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-02T19:06:05.073013] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-01. [2025-10-02T19:06:05.873012] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-09. [2025-10-02T19:06:06.415385] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-02T19:06:06.673059] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-09. [2025-10-02T19:06:07.009559] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-02T19:06:07.352881] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-02T19:06:07.473022] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-10. [2025-10-02T19:06:08.031782] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-02T19:06:08.032474] [INFO ] [REMOTE ] GBLI: Full fetch complete (1318 records). [2025-10-02T19:06:08.032547] [DEBUG] [VALIDATOR ] GBLI: Validating primary data. [2025-10-02T19:06:08.220341] [WARN ] [VALIDATOR ] GBLI: Validation failed - insufficient historical data. Have 172 unique days, need 200 days [2025-10-02T19:06:08.220537] [FATAL] [MAIN ] GBLI: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:06:08.220658] [WARN ] [MAIN ] GBLI: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:06:08.220740] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-02T19:06:08.220814] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-02T19:06:08.220858] [INFO ] [LOCAL ] GBLI: Starting deletion of derivative data. [2025-10-02T19:06:08.220903] [DEBUG] [LOCAL ] GBLI: No derivative data file found to delete. [2025-10-02T19:06:08.220963] [INFO ] [MAIN ] Update Progress: 896/2370 symbols completed. GBLI took 25.0s. Estimated remaining: 3h 27m 24s. Rate: 7.1 symbols/min [2025-10-02T19:06:08.278173] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-10. [2025-10-02T19:06:08.406584] [INFO ] [MAIN ] GBX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:06:08.441489] [DEBUG] [LOCAL ] GBX: Loaded 29152 existing records from primary storage. [2025-10-02T19:06:08.441902] [INFO ] [MAIN ] GBX: Loaded 29152 existing records. [2025-10-02T19:06:08.636991] [WARN ] [MAIN ] GBX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:06:08.637208] [INFO ] [MAIN ] GBX: Wiping existing primary data before full refresh. [2025-10-02T19:06:08.637314] [INFO ] [LOCAL ] GBX: Starting deletion of primary data. [2025-10-02T19:06:08.638231] [DEBUG] [LOCAL ] GBX: Deleted primary data file. [2025-10-02T19:06:08.638294] [INFO ] [MAIN ] GBX: Starting full primary refresh. [2025-10-02T19:06:09.036974] [INFO ] [REMOTE ] GBX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:06:09.072985] [INFO ] [REMOTE ] GBX: Fetching primary data for 2024-12. [2025-10-02T19:06:09.552430] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-02T19:06:09.554307] [INFO ] [REMOTE ] GBCI: Full fetch complete (58300 records). [2025-10-02T19:06:09.554402] [DEBUG] [VALIDATOR ] GBCI: Validating primary data. [2025-10-02T19:06:09.878094] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-02. [2025-10-02T19:06:09.968588] [DEBUG] [VALIDATOR ] GBCI: All expected trading days are present. [2025-10-02T19:06:09.968708] [DEBUG] [VALIDATOR ] GBCI: Primary data validation passed. [2025-10-02T19:06:09.969468] [INFO ] [MAIN ] GBCI: Fetched primary data is valid. [2025-10-02T19:06:09.969513] [DEBUG] [LOCAL ] GBCI: Saving primary data. [2025-10-02T19:06:09.970810] [DEBUG] [LOCAL ] GBCI: Trimmed 58300 records to 40436 (keeping 200 days of data) [2025-10-02T19:06:10.227506] [DEBUG] [LOCAL ] GBCI: Primary data saved (40436 records). [2025-10-02T19:06:10.227664] [INFO ] [MAIN ] GBCI: Full history saved. [2025-10-02T19:06:10.228543] [INFO ] [MAIN ] Update Progress: 897/2370 symbols completed. GBCI took 35.7s. Estimated remaining: 3h 27m 5s. Rate: 7.1 symbols/min [2025-10-02T19:06:10.436156] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-02T19:06:10.446835] [INFO ] [MAIN ] GCI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:06:10.489615] [DEBUG] [LOCAL ] GCI: Loaded 44121 existing records from primary storage. [2025-10-02T19:06:10.489962] [INFO ] [MAIN ] GCI: Loaded 44121 existing records. [2025-10-02T19:06:10.683853] [WARN ] [MAIN ] GCI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:06:10.678418] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-09. [2025-10-02T19:06:10.684870] [INFO ] [MAIN ] GCI: Wiping existing primary data before full refresh. [2025-10-02T19:06:10.684939] [INFO ] [LOCAL ] GCI: Starting deletion of primary data. [2025-10-02T19:06:10.686275] [DEBUG] [LOCAL ] GCI: Deleted primary data file. [2025-10-02T19:06:10.686344] [INFO ] [MAIN ] GCI: Starting full primary refresh. [2025-10-02T19:06:11.085428] [INFO ] [REMOTE ] GCI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:06:11.224682] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-02T19:06:11.473018] [INFO ] [REMOTE ] GCI: Fetching primary data for 2024-12. [2025-10-02T19:06:11.801004] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-02T19:06:12.273055] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-03. [2025-10-02T19:06:12.854894] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-02T19:06:13.073044] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-10. [2025-10-02T19:06:13.806897] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-02T19:06:13.873017] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-01. [2025-10-02T19:06:13.928935] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-02T19:06:13.930151] [INFO ] [REMOTE ] GATX: Full fetch complete (25195 records). [2025-10-02T19:06:13.930237] [DEBUG] [VALIDATOR ] GATX: Validating primary data. [2025-10-02T19:06:14.338985] [DEBUG] [VALIDATOR ] GATX: All expected trading days are present. [2025-10-02T19:06:14.339123] [DEBUG] [VALIDATOR ] GATX: Primary data validation passed. [2025-10-02T19:06:14.339747] [INFO ] [MAIN ] GATX: Fetched primary data is valid. [2025-10-02T19:06:14.339839] [DEBUG] [LOCAL ] GATX: Saving primary data. [2025-10-02T19:06:14.340705] [DEBUG] [LOCAL ] GATX: Trimmed 25195 records to 18259 (keeping 200 days of data) [2025-10-02T19:06:14.463161] [DEBUG] [LOCAL ] GATX: Primary data saved (18259 records). [2025-10-02T19:06:14.463314] [INFO ] [MAIN ] GATX: Full history saved. [2025-10-02T19:06:14.463432] [INFO ] [MAIN ] Update Progress: 898/2370 symbols completed. GATX took 54.3s. Estimated remaining: 3h 26m 50s. Rate: 7.1 symbols/min [2025-10-02T19:06:14.657970] [INFO ] [MAIN ] GCO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:06:14.673091] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-04. [2025-10-02T19:06:14.683887] [DEBUG] [LOCAL ] GCO: Loaded 24664 existing records from primary storage. [2025-10-02T19:06:14.684339] [INFO ] [MAIN ] GCO: Loaded 24664 existing records. [2025-10-02T19:06:14.885117] [WARN ] [MAIN ] GCO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:06:14.885465] [INFO ] [MAIN ] GCO: Wiping existing primary data before full refresh. [2025-10-02T19:06:14.885579] [INFO ] [LOCAL ] GCO: Starting deletion of primary data. [2025-10-02T19:06:14.886480] [DEBUG] [LOCAL ] GCO: Deleted primary data file. [2025-10-02T19:06:14.886559] [INFO ] [MAIN ] GCO: Starting full primary refresh. [2025-10-02T19:06:15.286957] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-02T19:06:15.328631] [INFO ] [REMOTE ] GCO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:06:15.473013] [INFO ] [REMOTE ] GCO: Fetching primary data for 2024-12. [2025-10-02T19:06:16.101736] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-02T19:06:16.272984] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-01. [2025-10-02T19:06:16.513722] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-02T19:06:17.073010] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-02. [2025-10-02T19:06:17.740395] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-02T19:06:17.872972] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-01. [2025-10-02T19:06:18.170239] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-02T19:06:18.673003] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-03. [2025-10-02T19:06:18.940517] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-02T19:06:19.473046] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-02. [2025-10-02T19:06:20.022797] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-02T19:06:20.273034] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-05. [2025-10-02T19:06:20.765473] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-02T19:06:21.073014] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-02. [2025-10-02T19:06:21.676814] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-02T19:06:21.872985] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-04. [2025-10-02T19:06:22.144518] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-02T19:06:22.673060] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-06. [2025-10-02T19:06:23.105033] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-02T19:06:23.473020] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-03. [2025-10-02T19:06:23.985797] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-02T19:06:24.273010] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-07. [2025-10-02T19:06:24.954800] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-02T19:06:25.073041] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-05. [2025-10-02T19:06:25.799426] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-02T19:06:25.872989] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-03. [2025-10-02T19:06:26.194755] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-02T19:06:26.673010] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-06. [2025-10-02T19:06:27.294716] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-02T19:06:27.357515] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-02T19:06:27.473017] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-08. [2025-10-02T19:06:28.273028] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-04. [2025-10-02T19:06:28.811092] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-02T19:06:29.073008] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-09. [2025-10-02T19:06:29.381401] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-02T19:06:29.872997] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-05. [2025-10-02T19:06:30.423622] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-02T19:06:30.673045] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-10. [2025-10-02T19:06:31.422964] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-02T19:06:31.473008] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-04. [2025-10-02T19:06:31.906925] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-02T19:06:31.908818] [INFO ] [REMOTE ] GBTG: Full fetch complete (56602 records). [2025-10-02T19:06:31.908966] [DEBUG] [VALIDATOR ] GBTG: Validating primary data. [2025-10-02T19:06:32.278164] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-07. [2025-10-02T19:06:32.338911] [DEBUG] [VALIDATOR ] GBTG: All expected trading days are present. [2025-10-02T19:06:32.339018] [DEBUG] [VALIDATOR ] GBTG: Primary data validation passed. [2025-10-02T19:06:32.339943] [INFO ] [MAIN ] GBTG: Fetched primary data is valid. [2025-10-02T19:06:32.340012] [DEBUG] [LOCAL ] GBTG: Saving primary data. [2025-10-02T19:06:32.341503] [DEBUG] [LOCAL ] GBTG: Trimmed 56602 records to 40317 (keeping 200 days of data) [2025-10-02T19:06:32.591363] [DEBUG] [LOCAL ] GBTG: Primary data saved (40317 records). [2025-10-02T19:06:32.591501] [INFO ] [MAIN ] GBTG: Full history saved. [2025-10-02T19:06:32.591588] [INFO ] [MAIN ] Update Progress: 899/2370 symbols completed. GBTG took 33.6s. Estimated remaining: 3h 26m 57s. Rate: 7.1 symbols/min [2025-10-02T19:06:32.825626] [INFO ] [MAIN ] GCTS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:06:32.847700] [DEBUG] [LOCAL ] GCTS: Loaded 19957 existing records from primary storage. [2025-10-02T19:06:32.848048] [INFO ] [MAIN ] GCTS: Loaded 19957 existing records. [2025-10-02T19:06:33.078324] [WARN ] [MAIN ] GCTS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:06:33.078442] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-06. [2025-10-02T19:06:33.080853] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-02T19:06:33.081366] [INFO ] [MAIN ] GCTS: Wiping existing primary data before full refresh. [2025-10-02T19:06:33.089473] [INFO ] [LOCAL ] GCTS: Starting deletion of primary data. [2025-10-02T19:06:33.090283] [DEBUG] [LOCAL ] GCTS: Deleted primary data file. [2025-10-02T19:06:33.090495] [INFO ] [MAIN ] GCTS: Starting full primary refresh. [2025-10-02T19:06:33.517048] [INFO ] [REMOTE ] GCTS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:06:33.666397] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-02T19:06:33.873032] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2024-12. [2025-10-02T19:06:34.682331] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-08. [2025-10-02T19:06:34.700496] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-02T19:06:34.987669] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-02T19:06:35.419177] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-02T19:06:35.472972] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-01. [2025-10-02T19:06:36.225607] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-02T19:06:36.273035] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-05. [2025-10-02T19:06:37.072984] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-09. [2025-10-02T19:06:37.431790] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-02T19:06:37.872971] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-06. [2025-10-02T19:06:38.136587] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-02T19:06:38.673023] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-07. [2025-10-02T19:06:38.889928] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-02T19:06:39.472997] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-10. [2025-10-02T19:06:40.255811] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-02T19:06:40.272967] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-08. [2025-10-02T19:06:40.414166] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-02T19:06:40.415968] [INFO ] [REMOTE ] GBX: Full fetch complete (42845 records). [2025-10-02T19:06:40.416090] [DEBUG] [VALIDATOR ] GBX: Validating primary data. [2025-10-02T19:06:40.852780] [DEBUG] [VALIDATOR ] GBX: All expected trading days are present. [2025-10-02T19:06:40.852891] [DEBUG] [VALIDATOR ] GBX: Primary data validation passed. [2025-10-02T19:06:40.853787] [INFO ] [MAIN ] GBX: Fetched primary data is valid. [2025-10-02T19:06:40.853853] [DEBUG] [LOCAL ] GBX: Saving primary data. [2025-10-02T19:06:40.855134] [DEBUG] [LOCAL ] GBX: Trimmed 42845 records to 29327 (keeping 200 days of data) [2025-10-02T19:06:41.041913] [DEBUG] [LOCAL ] GBX: Primary data saved (29327 records). [2025-10-02T19:06:41.042069] [INFO ] [MAIN ] GBX: Full history saved. [2025-10-02T19:06:41.042157] [INFO ] [MAIN ] Update Progress: 900/2370 symbols completed. GBX took 32.8s. Estimated remaining: 3h 26m 49s. Rate: 7.1 symbols/min [2025-10-02T19:06:41.078231] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-02. [2025-10-02T19:06:41.240505] [INFO ] [MAIN ] GCV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:06:41.250010] [DEBUG] [LOCAL ] GCV: Loaded 7370 existing records from primary storage. [2025-10-02T19:06:41.250239] [INFO ] [MAIN ] GCV: Loaded 7370 existing records. [2025-10-02T19:06:41.447732] [WARN ] [MAIN ] GCV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:06:41.448108] [INFO ] [MAIN ] GCV: Wiping existing primary data before full refresh. [2025-10-02T19:06:41.448198] [INFO ] [LOCAL ] GCV: Starting deletion of primary data. [2025-10-02T19:06:41.448616] [DEBUG] [LOCAL ] GCV: Deleted primary data file. [2025-10-02T19:06:41.448714] [INFO ] [MAIN ] GCV: Starting full primary refresh. [2025-10-02T19:06:41.861933] [INFO ] [REMOTE ] GCV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:06:41.878088] [INFO ] [REMOTE ] GCV: Fetching primary data for 2024-12. [2025-10-02T19:06:41.891165] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-02T19:06:42.092800] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-02T19:06:42.560859] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-02T19:06:42.673026] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-01. [2025-10-02T19:06:43.168304] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-02T19:06:43.473001] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-02. [2025-10-02T19:06:44.150278] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-02T19:06:44.273016] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-07. [2025-10-02T19:06:45.072994] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-03. [2025-10-02T19:06:45.395100] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-02T19:06:45.873003] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-09. [2025-10-02T19:06:46.047004] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-02T19:06:46.672994] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-08. [2025-10-02T19:06:47.010990] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-02T19:06:47.472996] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-04. [2025-10-02T19:06:47.849683] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-02T19:06:48.273030] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-09. [2025-10-02T19:06:48.492930] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-02T19:06:49.073016] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-05. [2025-10-02T19:06:49.107353] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-02T19:06:49.817020] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-02T19:06:49.872998] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-03. [2025-10-02T19:06:50.466830] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-02T19:06:50.672995] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-06. [2025-10-02T19:06:51.472995] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-04. [2025-10-02T19:06:52.044272] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-02T19:06:52.272975] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-07. [2025-10-02T19:06:52.310402] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-02T19:06:53.073015] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-05. [2025-10-02T19:06:53.345732] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-02T19:06:53.752259] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-02T19:06:53.872996] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-08. [2025-10-02T19:06:54.672969] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-10. [2025-10-02T19:06:54.846848] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-02T19:06:55.473003] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-09. [2025-10-02T19:06:55.582094] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-02T19:06:55.583340] [INFO ] [REMOTE ] GCO: Full fetch complete (35434 records). [2025-10-02T19:06:55.583418] [DEBUG] [VALIDATOR ] GCO: Validating primary data. [2025-10-02T19:06:55.973893] [DEBUG] [VALIDATOR ] GCO: All expected trading days are present. [2025-10-02T19:06:55.974040] [DEBUG] [VALIDATOR ] GCO: Primary data validation passed. [2025-10-02T19:06:55.974718] [INFO ] [MAIN ] GCO: Fetched primary data is valid. [2025-10-02T19:06:55.974783] [DEBUG] [LOCAL ] GCO: Saving primary data. [2025-10-02T19:06:55.975636] [DEBUG] [LOCAL ] GCO: Trimmed 35434 records to 24786 (keeping 200 days of data) [2025-10-02T19:06:56.119317] [DEBUG] [LOCAL ] GCO: Primary data saved (24786 records). [2025-10-02T19:06:56.119453] [INFO ] [MAIN ] GCO: Full history saved. [2025-10-02T19:06:56.119582] [INFO ] [MAIN ] Update Progress: 901/2370 symbols completed. GCO took 41.7s. Estimated remaining: 3h 26m 51s. Rate: 7.1 symbols/min [2025-10-02T19:06:56.280111] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-10. [2025-10-02T19:06:56.307004] [INFO ] [MAIN ] GD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:06:56.356757] [DEBUG] [LOCAL ] GD: Loaded 47149 existing records from primary storage. [2025-10-02T19:06:56.357111] [INFO ] [MAIN ] GD: Loaded 47149 existing records. [2025-10-02T19:06:56.549232] [WARN ] [MAIN ] GD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:06:56.549617] [INFO ] [MAIN ] GD: Wiping existing primary data before full refresh. [2025-10-02T19:06:56.549762] [INFO ] [LOCAL ] GD: Starting deletion of primary data. [2025-10-02T19:06:56.551273] [DEBUG] [LOCAL ] GD: Deleted primary data file. [2025-10-02T19:06:56.551338] [INFO ] [MAIN ] GD: Starting full primary refresh. [2025-10-02T19:06:56.678773] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-02T19:06:56.960115] [INFO ] [REMOTE ] GD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:06:57.073034] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-06. [2025-10-02T19:06:57.603114] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-02T19:06:57.605268] [INFO ] [REMOTE ] GCI: Full fetch complete (63186 records). [2025-10-02T19:06:57.605367] [DEBUG] [VALIDATOR ] GCI: Validating primary data. [2025-10-02T19:06:57.725422] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-02T19:06:57.878185] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-10. [2025-10-02T19:06:58.060255] [DEBUG] [VALIDATOR ] GCI: All expected trading days are present. [2025-10-02T19:06:58.060351] [DEBUG] [VALIDATOR ] GCI: Primary data validation passed. [2025-10-02T19:06:58.061183] [INFO ] [MAIN ] GCI: Fetched primary data is valid. [2025-10-02T19:06:58.061249] [DEBUG] [LOCAL ] GCI: Saving primary data. [2025-10-02T19:06:58.062715] [DEBUG] [LOCAL ] GCI: Trimmed 63186 records to 44426 (keeping 200 days of data) [2025-10-02T19:06:58.316479] [DEBUG] [LOCAL ] GCI: Primary data saved (44426 records). [2025-10-02T19:06:58.316611] [INFO ] [MAIN ] GCI: Full history saved. [2025-10-02T19:06:58.317253] [INFO ] [MAIN ] Update Progress: 902/2370 symbols completed. GCI took 48.1s. Estimated remaining: 3h 26m 33s. Rate: 7.1 symbols/min [2025-10-02T19:06:58.517509] [INFO ] [MAIN ] GDDY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:06:58.572851] [DEBUG] [LOCAL ] GDDY: Loaded 49682 existing records from primary storage. [2025-10-02T19:06:58.573203] [INFO ] [MAIN ] GDDY: Loaded 49682 existing records. [2025-10-02T19:06:58.678348] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-07. [2025-10-02T19:06:58.771928] [WARN ] [MAIN ] GDDY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:06:58.772159] [INFO ] [MAIN ] GDDY: Wiping existing primary data before full refresh. [2025-10-02T19:06:58.772219] [INFO ] [LOCAL ] GDDY: Starting deletion of primary data. [2025-10-02T19:06:58.773810] [DEBUG] [LOCAL ] GDDY: Deleted primary data file. [2025-10-02T19:06:58.773873] [INFO ] [MAIN ] GDDY: Starting full primary refresh. [2025-10-02T19:06:58.885752] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-02T19:06:58.901169] [INFO ] [REMOTE ] GCTS: Full fetch complete (26906 records). [2025-10-02T19:06:58.911595] [DEBUG] [VALIDATOR ] GCTS: Validating primary data. [2025-10-02T19:06:59.402978] [INFO ] [REMOTE ] GDDY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:06:59.478090] [INFO ] [REMOTE ] GD: Fetching primary data for 2024-12. [2025-10-02T19:06:59.501900] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-02T19:06:59.597989] [DEBUG] [VALIDATOR ] GCTS: All expected trading days are present. [2025-10-02T19:06:59.598090] [DEBUG] [VALIDATOR ] GCTS: Primary data validation passed. [2025-10-02T19:06:59.598711] [INFO ] [MAIN ] GCTS: Fetched primary data is valid. [2025-10-02T19:06:59.598777] [DEBUG] [LOCAL ] GCTS: Saving primary data. [2025-10-02T19:06:59.599527] [DEBUG] [LOCAL ] GCTS: Trimmed 26906 records to 20086 (keeping 200 days of data) [2025-10-02T19:06:59.716224] [DEBUG] [LOCAL ] GCTS: Primary data saved (20086 records). [2025-10-02T19:06:59.716350] [INFO ] [MAIN ] GCTS: Full history saved. [2025-10-02T19:06:59.716445] [INFO ] [MAIN ] Update Progress: 903/2370 symbols completed. GCTS took 27.1s. Estimated remaining: 3h 26m 13s. Rate: 7.1 symbols/min [2025-10-02T19:06:59.908322] [INFO ] [MAIN ] GDIV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:06:59.914549] [DEBUG] [LOCAL ] GDIV: Loaded 3623 existing records from primary storage. [2025-10-02T19:06:59.914768] [INFO ] [MAIN ] GDIV: Loaded 3623 existing records. [2025-10-02T19:07:00.113963] [WARN ] [MAIN ] GDIV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:07:00.114167] [INFO ] [MAIN ] GDIV: Wiping existing primary data before full refresh. [2025-10-02T19:07:00.114217] [INFO ] [LOCAL ] GDIV: Starting deletion of primary data. [2025-10-02T19:07:00.114606] [DEBUG] [LOCAL ] GDIV: Deleted primary data file. [2025-10-02T19:07:00.114698] [INFO ] [MAIN ] GDIV: Starting full primary refresh. [2025-10-02T19:07:00.278090] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-08. [2025-10-02T19:07:00.516414] [INFO ] [REMOTE ] GDIV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:07:01.073024] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2024-12. [2025-10-02T19:07:01.574072] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-02T19:07:01.854530] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2024-12 (2.38 seconds). [2025-10-02T19:07:01.874817] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-01. [2025-10-02T19:07:01.875172] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-02T19:07:02.673038] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2024-12. [2025-10-02T19:07:03.472979] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-09. [2025-10-02T19:07:03.650091] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-02T19:07:04.219393] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-02T19:07:04.273059] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-01. [2025-10-02T19:07:04.396965] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-02T19:07:04.831803] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-02T19:07:05.073013] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-02. [2025-10-02T19:07:05.594474] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-02T19:07:05.873004] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-02. [2025-10-02T19:07:06.673072] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-10. [2025-10-02T19:07:07.332220] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-02T19:07:07.333226] [INFO ] [REMOTE ] GCV: Full fetch complete (9418 records). [2025-10-02T19:07:07.333302] [DEBUG] [VALIDATOR ] GCV: Validating primary data. [2025-10-02T19:07:07.478110] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-03. [2025-10-02T19:07:07.735455] [DEBUG] [VALIDATOR ] GCV: All expected trading days are present. [2025-10-02T19:07:07.735564] [DEBUG] [VALIDATOR ] GCV: Primary data validation passed. [2025-10-02T19:07:07.735904] [INFO ] [MAIN ] GCV: Fetched primary data is valid. [2025-10-02T19:07:07.736050] [DEBUG] [LOCAL ] GCV: Saving primary data. [2025-10-02T19:07:07.736840] [DEBUG] [LOCAL ] GCV: Trimmed 9418 records to 7454 (keeping 200 days of data) [2025-10-02T19:07:07.801391] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-02T19:07:07.825393] [DEBUG] [LOCAL ] GCV: Primary data saved (7454 records). [2025-10-02T19:07:07.825534] [INFO ] [MAIN ] GCV: Full history saved. [2025-10-02T19:07:07.825622] [INFO ] [MAIN ] Update Progress: 904/2370 symbols completed. GCV took 26.8s. Estimated remaining: 3h 26m 4s. Rate: 7.1 symbols/min [2025-10-02T19:07:08.020454] [INFO ] [MAIN ] GDL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:07:08.029196] [DEBUG] [LOCAL ] GDL: Loaded 2566 existing records from primary storage. [2025-10-02T19:07:08.029486] [INFO ] [MAIN ] GDL: Loaded 2566 existing records. [2025-10-02T19:07:08.229451] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-02T19:07:08.233511] [WARN ] [MAIN ] GDL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:07:08.235142] [INFO ] [MAIN ] GDL: Wiping existing primary data before full refresh. [2025-10-02T19:07:08.235717] [INFO ] [LOCAL ] GDL: Starting deletion of primary data. [2025-10-02T19:07:08.236090] [DEBUG] [LOCAL ] GDL: Deleted primary data file. [2025-10-02T19:07:08.236167] [INFO ] [MAIN ] GDL: Starting full primary refresh. [2025-10-02T19:07:08.278143] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-01. [2025-10-02T19:07:08.625088] [INFO ] [REMOTE ] GDL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:07:09.073086] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-03. [2025-10-02T19:07:09.873029] [INFO ] [REMOTE ] GDL: Fetching primary data for 2024-12. [2025-10-02T19:07:09.980025] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-02T19:07:10.205897] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-10-02T19:07:10.672974] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-02. [2025-10-02T19:07:10.939302] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-02T19:07:11.473027] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-04. [2025-10-02T19:07:12.125143] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-02T19:07:12.272980] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-01. [2025-10-02T19:07:12.371750] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-02T19:07:12.741245] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-02T19:07:13.073014] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-03. [2025-10-02T19:07:13.873031] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-02. [2025-10-02T19:07:14.251200] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-02T19:07:14.642062] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-02T19:07:14.672961] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-04. [2025-10-02T19:07:15.472999] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-05. [2025-10-02T19:07:16.272967] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-04. [2025-10-02T19:07:16.330177] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-02T19:07:16.621129] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-02T19:07:17.073007] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-06. [2025-10-02T19:07:17.657537] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-02T19:07:17.872979] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-07. [2025-10-02T19:07:17.943893] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-02T19:07:18.487818] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-02T19:07:18.673029] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-08. [2025-10-02T19:07:19.133580] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-02T19:07:19.473058] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-05. [2025-10-02T19:07:20.273026] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-05. [2025-10-02T19:07:21.072982] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-09. [2025-10-02T19:07:21.237444] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-02T19:07:21.606385] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-02T19:07:21.872974] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-10. [2025-10-02T19:07:21.980300] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-02T19:07:22.512183] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-02T19:07:22.513400] [INFO ] [REMOTE ] GDIV: Full fetch complete (5462 records). [2025-10-02T19:07:22.513519] [DEBUG] [VALIDATOR ] GDIV: Validating primary data. [2025-10-02T19:07:22.680224] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-06. [2025-10-02T19:07:22.902427] [DEBUG] [VALIDATOR ] GDIV: All expected trading days are present. [2025-10-02T19:07:22.902568] [DEBUG] [VALIDATOR ] GDIV: Primary data validation passed. [2025-10-02T19:07:22.902775] [INFO ] [MAIN ] GDIV: Fetched primary data is valid. [2025-10-02T19:07:22.902855] [DEBUG] [LOCAL ] GDIV: Saving primary data. [2025-10-02T19:07:22.903357] [DEBUG] [LOCAL ] GDIV: Trimmed 5462 records to 3648 (keeping 200 days of data) [2025-10-02T19:07:22.932545] [DEBUG] [LOCAL ] GDIV: Primary data saved (3648 records). [2025-10-02T19:07:22.932680] [INFO ] [MAIN ] GDIV: Full history saved. [2025-10-02T19:07:22.932808] [INFO ] [MAIN ] Update Progress: 905/2370 symbols completed. GDIV took 23.2s. Estimated remaining: 3h 26m 6s. Rate: 7.1 symbols/min [2025-10-02T19:07:23.113912] [INFO ] [MAIN ] GDO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:07:23.127893] [DEBUG] [LOCAL ] GDO: Loaded 5984 existing records from primary storage. [2025-10-02T19:07:23.128155] [INFO ] [MAIN ] GDO: Loaded 5984 existing records. [2025-10-02T19:07:23.326374] [WARN ] [MAIN ] GDO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:07:23.326612] [INFO ] [MAIN ] GDO: Wiping existing primary data before full refresh. [2025-10-02T19:07:23.326707] [INFO ] [LOCAL ] GDO: Starting deletion of primary data. [2025-10-02T19:07:23.327209] [DEBUG] [LOCAL ] GDO: Deleted primary data file. [2025-10-02T19:07:23.327283] [INFO ] [MAIN ] GDO: Starting full primary refresh. [2025-10-02T19:07:23.488257] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-03. [2025-10-02T19:07:23.740347] [INFO ] [REMOTE ] GDO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:07:24.004772] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-02T19:07:24.272999] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-04. [2025-10-02T19:07:24.405749] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-02T19:07:24.610502] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-02T19:07:25.073010] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-07. [2025-10-02T19:07:25.872993] [INFO ] [REMOTE ] GDO: Fetching primary data for 2024-12. [2025-10-02T19:07:26.678041] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-06. [2025-10-02T19:07:26.681633] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-02T19:07:26.887526] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-02T19:07:27.473007] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-01. [2025-10-02T19:07:28.144395] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-02T19:07:28.180974] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-02T19:07:28.273022] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-08. [2025-10-02T19:07:29.073007] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-07. [2025-10-02T19:07:29.873044] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-05. [2025-10-02T19:07:30.098721] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-02T19:07:30.303159] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-02T19:07:30.672969] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-09. [2025-10-02T19:07:30.992427] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-02T19:07:31.473034] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-02. [2025-10-02T19:07:32.125452] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-02T19:07:32.129597] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-02T19:07:32.273020] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-10. [2025-10-02T19:07:33.072996] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-06. [2025-10-02T19:07:33.550925] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-02T19:07:33.837393] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-02T19:07:33.839554] [INFO ] [REMOTE ] GDDY: Full fetch complete (71470 records). [2025-10-02T19:07:33.839685] [DEBUG] [VALIDATOR ] GDDY: Validating primary data. [2025-10-02T19:07:33.878265] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-07. [2025-10-02T19:07:34.272362] [DEBUG] [VALIDATOR ] GDDY: All expected trading days are present. [2025-10-02T19:07:34.272488] [DEBUG] [VALIDATOR ] GDDY: Primary data validation passed. [2025-10-02T19:07:34.273784] [INFO ] [MAIN ] GDDY: Fetched primary data is valid. [2025-10-02T19:07:34.273860] [DEBUG] [LOCAL ] GDDY: Saving primary data. [2025-10-02T19:07:34.275411] [DEBUG] [LOCAL ] GDDY: Trimmed 71470 records to 50069 (keeping 200 days of data) [2025-10-02T19:07:34.406829] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-02T19:07:34.611437] [DEBUG] [LOCAL ] GDDY: Primary data saved (50069 records). [2025-10-02T19:07:34.611585] [INFO ] [MAIN ] GDDY: Full history saved. [2025-10-02T19:07:34.612750] [INFO ] [MAIN ] Update Progress: 906/2370 symbols completed. GDDY took 36.3s. Estimated remaining: 3h 26m 3s. Rate: 7.1 symbols/min [2025-10-02T19:07:34.680001] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-08. [2025-10-02T19:07:34.802418] [INFO ] [MAIN ] GDOT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:07:34.843790] [DEBUG] [LOCAL ] GDOT: Loaded 38324 existing records from primary storage. [2025-10-02T19:07:34.844099] [INFO ] [MAIN ] GDOT: Loaded 38324 existing records. [2025-10-02T19:07:35.048413] [WARN ] [MAIN ] GDOT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:07:35.048665] [INFO ] [MAIN ] GDOT: Wiping existing primary data before full refresh. [2025-10-02T19:07:35.048730] [INFO ] [LOCAL ] GDOT: Starting deletion of primary data. [2025-10-02T19:07:35.049991] [DEBUG] [LOCAL ] GDOT: Deleted primary data file. [2025-10-02T19:07:35.050052] [INFO ] [MAIN ] GDOT: Starting full primary refresh. [2025-10-02T19:07:35.232313] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-02T19:07:35.456480] [INFO ] [REMOTE ] GDOT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:07:35.472989] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2024-12. [2025-10-02T19:07:36.272980] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-09. [2025-10-02T19:07:36.403325] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-02T19:07:36.818380] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-02T19:07:37.072999] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-01. [2025-10-02T19:07:37.873004] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-10. [2025-10-02T19:07:38.292943] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-02T19:07:38.293876] [INFO ] [REMOTE ] GDL: Full fetch complete (3651 records). [2025-10-02T19:07:38.293960] [DEBUG] [VALIDATOR ] GDL: Validating primary data. [2025-10-02T19:07:38.610121] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-02T19:07:38.678108] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-03. [2025-10-02T19:07:38.742613] [DEBUG] [VALIDATOR ] GDL: All expected trading days are present. [2025-10-02T19:07:38.742737] [DEBUG] [VALIDATOR ] GDL: Primary data validation passed. [2025-10-02T19:07:38.742883] [INFO ] [MAIN ] GDL: Fetched primary data is valid. [2025-10-02T19:07:38.742944] [DEBUG] [LOCAL ] GDL: Saving primary data. [2025-10-02T19:07:38.743332] [DEBUG] [LOCAL ] GDL: Trimmed 3651 records to 2576 (keeping 200 days of data) [2025-10-02T19:07:38.761977] [DEBUG] [LOCAL ] GDL: Primary data saved (2576 records). [2025-10-02T19:07:38.762097] [INFO ] [MAIN ] GDL: Full history saved. [2025-10-02T19:07:38.762216] [INFO ] [MAIN ] Update Progress: 907/2370 symbols completed. GDL took 30.9s. Estimated remaining: 3h 25m 48s. Rate: 7.1 symbols/min [2025-10-02T19:07:38.996835] [INFO ] [MAIN ] GDV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:07:39.019680] [DEBUG] [LOCAL ] GDV: Loaded 19475 existing records from primary storage. [2025-10-02T19:07:39.019934] [INFO ] [MAIN ] GDV: Loaded 19475 existing records. [2025-10-02T19:07:39.223179] [WARN ] [MAIN ] GDV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:07:39.223580] [INFO ] [MAIN ] GDV: Wiping existing primary data before full refresh. [2025-10-02T19:07:39.223662] [INFO ] [LOCAL ] GDV: Starting deletion of primary data. [2025-10-02T19:07:39.224552] [DEBUG] [LOCAL ] GDV: Deleted primary data file. [2025-10-02T19:07:39.224616] [INFO ] [MAIN ] GDV: Starting full primary refresh. [2025-10-02T19:07:39.482426] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-02. [2025-10-02T19:07:39.530286] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-02T19:07:39.628088] [INFO ] [REMOTE ] GDV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:07:40.273000] [INFO ] [REMOTE ] GDV: Fetching primary data for 2024-12. [2025-10-02T19:07:40.759301] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-02T19:07:41.072989] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-04. [2025-10-02T19:07:41.147346] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-02T19:07:41.739878] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-02T19:07:41.873002] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-08. [2025-10-02T19:07:42.673023] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-01. [2025-10-02T19:07:43.443579] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-02T19:07:43.472972] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-09. [2025-10-02T19:07:43.498036] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-02T19:07:44.273017] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-05. [2025-10-02T19:07:44.858532] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-02T19:07:44.890293] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-02T19:07:45.072998] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-03. [2025-10-02T19:07:45.873006] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-02. [2025-10-02T19:07:46.586452] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-02T19:07:46.672964] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-04. [2025-10-02T19:07:46.690448] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-02T19:07:47.472989] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-10. [2025-10-02T19:07:47.801083] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-02T19:07:48.273004] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-05. [2025-10-02T19:07:48.898572] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-02T19:07:48.901340] [INFO ] [REMOTE ] GD: Full fetch complete (70296 records). [2025-10-02T19:07:48.901470] [DEBUG] [VALIDATOR ] GD: Validating primary data. [2025-10-02T19:07:49.081436] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-03. [2025-10-02T19:07:49.366472] [DEBUG] [VALIDATOR ] GD: All expected trading days are present. [2025-10-02T19:07:49.366605] [DEBUG] [VALIDATOR ] GD: Primary data validation passed. [2025-10-02T19:07:49.367693] [INFO ] [MAIN ] GD: Fetched primary data is valid. [2025-10-02T19:07:49.367773] [DEBUG] [LOCAL ] GD: Saving primary data. [2025-10-02T19:07:49.369338] [DEBUG] [LOCAL ] GD: Trimmed 70296 records to 47468 (keeping 200 days of data) [2025-10-02T19:07:49.717921] [DEBUG] [LOCAL ] GD: Primary data saved (47468 records). [2025-10-02T19:07:49.718255] [INFO ] [MAIN ] GD: Full history saved. [2025-10-02T19:07:49.718361] [INFO ] [MAIN ] Update Progress: 908/2370 symbols completed. GD took 53.6s. Estimated remaining: 3h 25m 43s. Rate: 7.1 symbols/min [2025-10-02T19:07:49.874802] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-06. [2025-10-02T19:07:49.878086] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-02T19:07:49.960282] [INFO ] [MAIN ] GE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:07:50.024074] [DEBUG] [LOCAL ] GE: Loaded 53714 existing records from primary storage. [2025-10-02T19:07:50.024457] [INFO ] [MAIN ] GE: Loaded 53714 existing records. [2025-10-02T19:07:50.223491] [WARN ] [MAIN ] GE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:07:50.223827] [INFO ] [MAIN ] GE: Wiping existing primary data before full refresh. [2025-10-02T19:07:50.223964] [INFO ] [LOCAL ] GE: Starting deletion of primary data. [2025-10-02T19:07:50.226147] [DEBUG] [LOCAL ] GE: Deleted primary data file. [2025-10-02T19:07:50.226215] [INFO ] [MAIN ] GE: Starting full primary refresh. [2025-10-02T19:07:50.387869] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-02T19:07:50.592615] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-02T19:07:50.678234] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-06. [2025-10-02T19:07:50.685418] [INFO ] [REMOTE ] GE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:07:51.473000] [INFO ] [REMOTE ] GE: Fetching primary data for 2024-12. [2025-10-02T19:07:51.751479] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-02T19:07:52.272990] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-07. [2025-10-02T19:07:52.821668] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-02T19:07:53.072973] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-07. [2025-10-02T19:07:53.175005] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-02T19:07:53.873055] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-04. [2025-10-02T19:07:54.524211] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-02T19:07:54.673072] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-01. [2025-10-02T19:07:55.060838] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-02T19:07:55.473037] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-08. [2025-10-02T19:07:56.201729] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-02T19:07:56.273017] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-09. [2025-10-02T19:07:56.723040] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-02T19:07:56.906999] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-02T19:07:57.073051] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-05. [2025-10-02T19:07:57.873069] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-10. [2025-10-02T19:07:58.181726] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-02T19:07:58.409114] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-02T19:07:58.409987] [INFO ] [REMOTE ] GDO: Full fetch complete (9190 records). [2025-10-02T19:07:58.410065] [DEBUG] [VALIDATOR ] GDO: Validating primary data. [2025-10-02T19:07:58.678102] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-02. [2025-10-02T19:07:58.807489] [DEBUG] [VALIDATOR ] GDO: All expected trading days are present. [2025-10-02T19:07:58.807572] [DEBUG] [VALIDATOR ] GDO: Primary data validation passed. [2025-10-02T19:07:58.807852] [INFO ] [MAIN ] GDO: Fetched primary data is valid. [2025-10-02T19:07:58.807919] [DEBUG] [LOCAL ] GDO: Saving primary data. [2025-10-02T19:07:58.808545] [DEBUG] [LOCAL ] GDO: Trimmed 9190 records to 6027 (keeping 200 days of data) [2025-10-02T19:07:58.848381] [DEBUG] [LOCAL ] GDO: Primary data saved (6027 records). [2025-10-02T19:07:58.848516] [INFO ] [MAIN ] GDO: Full history saved. [2025-10-02T19:07:58.848605] [INFO ] [MAIN ] Update Progress: 909/2370 symbols completed. GDO took 35.9s. Estimated remaining: 3h 25m 36s. Rate: 7.1 symbols/min [2025-10-02T19:07:59.035279] [INFO ] [MAIN ] GEF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:07:59.058049] [DEBUG] [LOCAL ] GEF: Loaded 20682 existing records from primary storage. [2025-10-02T19:07:59.058333] [INFO ] [MAIN ] GEF: Loaded 20682 existing records. [2025-10-02T19:07:59.255065] [WARN ] [MAIN ] GEF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:07:59.255285] [INFO ] [MAIN ] GEF: Wiping existing primary data before full refresh. [2025-10-02T19:07:59.255335] [INFO ] [LOCAL ] GEF: Starting deletion of primary data. [2025-10-02T19:07:59.256083] [DEBUG] [LOCAL ] GEF: Deleted primary data file. [2025-10-02T19:07:59.256145] [INFO ] [MAIN ] GEF: Starting full primary refresh. [2025-10-02T19:07:59.478095] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-06. [2025-10-02T19:07:59.638193] [INFO ] [REMOTE ] GEF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:08:00.272996] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-08. [2025-10-02T19:08:00.538518] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-02T19:08:00.793380] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-02T19:08:01.073039] [INFO ] [REMOTE ] GEF: Fetching primary data for 2024-12. [2025-10-02T19:08:01.610563] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-02T19:08:01.873045] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-09. [2025-10-02T19:08:01.912489] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-02T19:08:02.673009] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-07. [2025-10-02T19:08:03.148110] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-02T19:08:03.472982] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-01. [2025-10-02T19:08:03.750937] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-02T19:08:04.273065] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-10. [2025-10-02T19:08:04.629520] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-02T19:08:05.073001] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-02. [2025-10-02T19:08:05.491268] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-02T19:08:05.493476] [INFO ] [REMOTE ] GDOT: Full fetch complete (53132 records). [2025-10-02T19:08:05.493594] [DEBUG] [VALIDATOR ] GDOT: Validating primary data. [2025-10-02T19:08:05.877522] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-08. [2025-10-02T19:08:05.940942] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-02T19:08:05.939981] [DEBUG] [VALIDATOR ] GDOT: All expected trading days are present. [2025-10-02T19:08:05.944782] [DEBUG] [VALIDATOR ] GDOT: Primary data validation passed. [2025-10-02T19:08:05.945986] [INFO ] [MAIN ] GDOT: Fetched primary data is valid. [2025-10-02T19:08:05.946074] [DEBUG] [LOCAL ] GDOT: Saving primary data. [2025-10-02T19:08:05.947307] [DEBUG] [LOCAL ] GDOT: Trimmed 53132 records to 38623 (keeping 200 days of data) [2025-10-02T19:08:06.183262] [DEBUG] [LOCAL ] GDOT: Primary data saved (38623 records). [2025-10-02T19:08:06.183410] [INFO ] [MAIN ] GDOT: Full history saved. [2025-10-02T19:08:06.184629] [INFO ] [MAIN ] Update Progress: 910/2370 symbols completed. GDOT took 31.6s. Estimated remaining: 3h 25m 26s. Rate: 7.1 symbols/min [2025-10-02T19:08:06.369261] [INFO ] [MAIN ] GEL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:08:06.409108] [DEBUG] [LOCAL ] GEL: Loaded 33118 existing records from primary storage. [2025-10-02T19:08:06.409410] [INFO ] [MAIN ] GEL: Loaded 33118 existing records. [2025-10-02T19:08:06.600027] [WARN ] [MAIN ] GEL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:08:06.600243] [INFO ] [MAIN ] GEL: Wiping existing primary data before full refresh. [2025-10-02T19:08:06.600359] [INFO ] [LOCAL ] GEL: Starting deletion of primary data. [2025-10-02T19:08:06.601282] [DEBUG] [LOCAL ] GEL: Deleted primary data file. [2025-10-02T19:08:06.601344] [INFO ] [MAIN ] GEL: Starting full primary refresh. [2025-10-02T19:08:06.682025] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-03. [2025-10-02T19:08:07.011424] [INFO ] [REMOTE ] GEL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:08:07.026013] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-02T19:08:07.472991] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-03. [2025-10-02T19:08:07.835924] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-02T19:08:08.272992] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-09. [2025-10-02T19:08:09.072984] [INFO ] [REMOTE ] GEL: Fetching primary data for 2024-12. [2025-10-02T19:08:09.191440] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-02T19:08:09.380799] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-02T19:08:09.855486] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-02T19:08:09.872974] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-01. [2025-10-02T19:08:10.673001] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-04. [2025-10-02T19:08:11.224111] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-02T19:08:11.473007] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-04. [2025-10-02T19:08:12.273024] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-02. [2025-10-02T19:08:12.529096] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-02T19:08:12.952740] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-02T19:08:13.073005] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-05. [2025-10-02T19:08:13.645966] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-02T19:08:13.848899] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-02T19:08:13.872975] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-10. [2025-10-02T19:08:14.501876] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-02T19:08:14.504911] [INFO ] [REMOTE ] GDV: Full fetch complete (28524 records). [2025-10-02T19:08:14.505002] [DEBUG] [VALIDATOR ] GDV: Validating primary data. [2025-10-02T19:08:14.680610] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-06. [2025-10-02T19:08:14.928161] [DEBUG] [VALIDATOR ] GDV: All expected trading days are present. [2025-10-02T19:08:14.928267] [DEBUG] [VALIDATOR ] GDV: Primary data validation passed. [2025-10-02T19:08:14.928874] [INFO ] [MAIN ] GDV: Fetched primary data is valid. [2025-10-02T19:08:14.928964] [DEBUG] [LOCAL ] GDV: Saving primary data. [2025-10-02T19:08:14.930587] [DEBUG] [LOCAL ] GDV: Trimmed 28524 records to 19585 (keeping 200 days of data) [2025-10-02T19:08:15.070632] [DEBUG] [LOCAL ] GDV: Primary data saved (19585 records). [2025-10-02T19:08:15.070818] [INFO ] [MAIN ] GDV: Full history saved. [2025-10-02T19:08:15.070905] [INFO ] [MAIN ] Update Progress: 911/2370 symbols completed. GDV took 36.3s. Estimated remaining: 3h 25m 18s. Rate: 7.1 symbols/min [2025-10-02T19:08:15.261102] [INFO ] [MAIN ] GENI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:08:15.323095] [DEBUG] [LOCAL ] GENI: Loaded 52930 existing records from primary storage. [2025-10-02T19:08:15.323452] [INFO ] [MAIN ] GENI: Loaded 52930 existing records. [2025-10-02T19:08:15.478087] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-03. [2025-10-02T19:08:15.523488] [WARN ] [MAIN ] GENI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:08:15.523838] [INFO ] [MAIN ] GENI: Wiping existing primary data before full refresh. [2025-10-02T19:08:15.523902] [INFO ] [LOCAL ] GENI: Starting deletion of primary data. [2025-10-02T19:08:15.525101] [DEBUG] [LOCAL ] GENI: Deleted primary data file. [2025-10-02T19:08:15.525163] [INFO ] [MAIN ] GENI: Starting full primary refresh. [2025-10-02T19:08:15.923956] [INFO ] [REMOTE ] GENI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:08:15.948757] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-02T19:08:16.273037] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-07. [2025-10-02T19:08:16.985873] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-02T19:08:17.072980] [INFO ] [REMOTE ] GENI: Fetching primary data for 2024-12. [2025-10-02T19:08:17.309562] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-02T19:08:17.873008] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-04. [2025-10-02T19:08:18.516784] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-02T19:08:18.672990] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-01. [2025-10-02T19:08:19.164196] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-02T19:08:19.473040] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-05. [2025-10-02T19:08:20.274598] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-05. [2025-10-02T19:08:20.280399] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-02T19:08:20.817520] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-02T19:08:21.073025] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-08. [2025-10-02T19:08:21.873044] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-06. [2025-10-02T19:08:22.131376] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-02T19:08:22.276038] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-02T19:08:22.673032] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-06. [2025-10-02T19:08:23.278463] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-02T19:08:23.473017] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-07. [2025-10-02T19:08:24.273072] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-09. [2025-10-02T19:08:24.735912] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-02T19:08:24.788591] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-02T19:08:25.010810] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-02T19:08:25.072998] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-10. [2025-10-02T19:08:25.873019] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-07. [2025-10-02T19:08:26.092765] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-02T19:08:26.094204] [INFO ] [REMOTE ] GEF: Full fetch complete (29530 records). [2025-10-02T19:08:26.094281] [DEBUG] [VALIDATOR ] GEF: Validating primary data. [2025-10-02T19:08:26.501296] [DEBUG] [VALIDATOR ] GEF: All expected trading days are present. [2025-10-02T19:08:26.501399] [DEBUG] [VALIDATOR ] GEF: Primary data validation passed. [2025-10-02T19:08:26.502043] [INFO ] [MAIN ] GEF: Fetched primary data is valid. [2025-10-02T19:08:26.502107] [DEBUG] [LOCAL ] GEF: Saving primary data. [2025-10-02T19:08:26.503011] [DEBUG] [LOCAL ] GEF: Trimmed 29530 records to 20830 (keeping 200 days of data) [2025-10-02T19:08:26.651118] [DEBUG] [LOCAL ] GEF: Primary data saved (20830 records). [2025-10-02T19:08:26.651283] [INFO ] [MAIN ] GEF: Full history saved. [2025-10-02T19:08:26.651386] [INFO ] [MAIN ] Update Progress: 912/2370 symbols completed. GEF took 27.8s. Estimated remaining: 3h 25m 14s. Rate: 7.1 symbols/min [2025-10-02T19:08:26.678248] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-08. [2025-10-02T19:08:26.848810] [INFO ] [MAIN ] GEO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:08:26.905501] [DEBUG] [LOCAL ] GEO: Loaded 51950 existing records from primary storage. [2025-10-02T19:08:26.905881] [INFO ] [MAIN ] GEO: Loaded 51950 existing records. [2025-10-02T19:08:27.116265] [WARN ] [MAIN ] GEO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:08:27.116509] [INFO ] [MAIN ] GEO: Wiping existing primary data before full refresh. [2025-10-02T19:08:27.116561] [INFO ] [LOCAL ] GEO: Starting deletion of primary data. [2025-10-02T19:08:27.117938] [DEBUG] [LOCAL ] GEO: Deleted primary data file. [2025-10-02T19:08:27.118002] [INFO ] [MAIN ] GEO: Starting full primary refresh. [2025-10-02T19:08:27.477806] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-02. [2025-10-02T19:08:27.500622] [INFO ] [REMOTE ] GEO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:08:27.864182] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-02T19:08:28.179514] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-02T19:08:28.273036] [INFO ] [REMOTE ] GEO: Fetching primary data for 2024-12. [2025-10-02T19:08:29.070353] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-02T19:08:29.079383] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-09. [2025-10-02T19:08:29.872977] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-03. [2025-10-02T19:08:30.070049] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-02T19:08:30.181820] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-02T19:08:30.673016] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-10. [2025-10-02T19:08:31.404459] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-02T19:08:31.472978] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-08. [2025-10-02T19:08:31.537500] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-02T19:08:31.539344] [INFO ] [REMOTE ] GEL: Full fetch complete (48534 records). [2025-10-02T19:08:31.539475] [DEBUG] [VALIDATOR ] GEL: Validating primary data. [2025-10-02T19:08:31.961493] [DEBUG] [VALIDATOR ] GEL: All expected trading days are present. [2025-10-02T19:08:31.961579] [DEBUG] [VALIDATOR ] GEL: Primary data validation passed. [2025-10-02T19:08:31.962306] [INFO ] [MAIN ] GEL: Fetched primary data is valid. [2025-10-02T19:08:31.962374] [DEBUG] [LOCAL ] GEL: Saving primary data. [2025-10-02T19:08:31.963476] [DEBUG] [LOCAL ] GEL: Trimmed 48534 records to 33312 (keeping 200 days of data) [2025-10-02T19:08:32.174478] [DEBUG] [LOCAL ] GEL: Primary data saved (33312 records). [2025-10-02T19:08:32.174622] [INFO ] [MAIN ] GEL: Full history saved. [2025-10-02T19:08:32.176409] [INFO ] [MAIN ] Update Progress: 913/2370 symbols completed. GEL took 26.0s. Estimated remaining: 3h 25m 1s. Rate: 7.1 symbols/min [2025-10-02T19:08:32.279605] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-04. [2025-10-02T19:08:32.370756] [INFO ] [MAIN ] GES: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:08:32.414194] [DEBUG] [LOCAL ] GES: Loaded 39414 existing records from primary storage. [2025-10-02T19:08:32.414595] [INFO ] [MAIN ] GES: Loaded 39414 existing records. [2025-10-02T19:08:32.623859] [WARN ] [MAIN ] GES: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:08:32.624260] [INFO ] [MAIN ] GES: Wiping existing primary data before full refresh. [2025-10-02T19:08:32.624319] [INFO ] [LOCAL ] GES: Starting deletion of primary data. [2025-10-02T19:08:32.625578] [DEBUG] [LOCAL ] GES: Deleted primary data file. [2025-10-02T19:08:32.625690] [INFO ] [MAIN ] GES: Starting full primary refresh. [2025-10-02T19:08:33.021390] [INFO ] [REMOTE ] GES: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:08:33.073024] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-01. [2025-10-02T19:08:33.602524] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-02T19:08:33.649571] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-02T19:08:33.873005] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-09. [2025-10-02T19:08:34.673003] [INFO ] [REMOTE ] GES: Fetching primary data for 2024-12. [2025-10-02T19:08:35.050886] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-02T19:08:35.473030] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-05. [2025-10-02T19:08:35.920413] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-02T19:08:36.272986] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-02. [2025-10-02T19:08:36.347322] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-02T19:08:36.949497] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-02T19:08:37.072993] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-10. [2025-10-02T19:08:37.872993] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-01. [2025-10-02T19:08:37.998805] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-02T19:08:38.673015] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-06. [2025-10-02T19:08:38.957857] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-02T19:08:38.960373] [INFO ] [REMOTE ] GE: Full fetch complete (77779 records). [2025-10-02T19:08:38.960566] [DEBUG] [VALIDATOR ] GE: Validating primary data. [2025-10-02T19:08:39.397863] [DEBUG] [VALIDATOR ] GE: All expected trading days are present. [2025-10-02T19:08:39.397963] [DEBUG] [VALIDATOR ] GE: Primary data validation passed. [2025-10-02T19:08:39.399019] [INFO ] [MAIN ] GE: Fetched primary data is valid. [2025-10-02T19:08:39.399101] [DEBUG] [LOCAL ] GE: Saving primary data. [2025-10-02T19:08:39.400705] [DEBUG] [LOCAL ] GE: Trimmed 77779 records to 54103 (keeping 200 days of data) [2025-10-02T19:08:39.474869] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-03. [2025-10-02T19:08:39.545028] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-02T19:08:39.813422] [DEBUG] [LOCAL ] GE: Primary data saved (54103 records). [2025-10-02T19:08:39.813572] [INFO ] [MAIN ] GE: Full history saved. [2025-10-02T19:08:39.813680] [INFO ] [MAIN ] Update Progress: 914/2370 symbols completed. GE took 50.1s. Estimated remaining: 3h 24m 52s. Rate: 7.1 symbols/min [2025-10-02T19:08:40.017346] [INFO ] [MAIN ] GETY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:08:40.054186] [DEBUG] [LOCAL ] GETY: Loaded 35605 existing records from primary storage. [2025-10-02T19:08:40.054530] [INFO ] [MAIN ] GETY: Loaded 35605 existing records. [2025-10-02T19:08:40.280173] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-02. [2025-10-02T19:08:40.288031] [WARN ] [MAIN ] GETY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:08:40.289397] [INFO ] [MAIN ] GETY: Wiping existing primary data before full refresh. [2025-10-02T19:08:40.289513] [INFO ] [LOCAL ] GETY: Starting deletion of primary data. [2025-10-02T19:08:40.292343] [DEBUG] [LOCAL ] GETY: Deleted primary data file. [2025-10-02T19:08:40.292272] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-02T19:08:40.292590] [INFO ] [MAIN ] GETY: Starting full primary refresh. [2025-10-02T19:08:40.736920] [INFO ] [REMOTE ] GETY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:08:41.073039] [INFO ] [REMOTE ] GETY: Fetching primary data for 2024-12. [2025-10-02T19:08:41.357095] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-02T19:08:41.873026] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-04. [2025-10-02T19:08:41.915762] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-02T19:08:42.455503] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-02T19:08:42.673015] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-03. [2025-10-02T19:08:43.472988] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-07. [2025-10-02T19:08:43.672665] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-02T19:08:44.230525] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-02T19:08:44.273014] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-04. [2025-10-02T19:08:45.025028] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-02T19:08:45.072975] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-08. [2025-10-02T19:08:45.873002] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-05. [2025-10-02T19:08:46.119935] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-02T19:08:46.673031] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-01. [2025-10-02T19:08:46.786993] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-02T19:08:47.472970] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-09. [2025-10-02T19:08:47.701151] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-02T19:08:48.132294] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-02T19:08:48.272987] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-02. [2025-10-02T19:08:48.994440] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-02T19:08:49.073020] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-10. [2025-10-02T19:08:49.641355] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-02T19:08:49.872993] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-06. [2025-10-02T19:08:50.526478] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-02T19:08:50.529179] [INFO ] [REMOTE ] GENI: Full fetch complete (75489 records). [2025-10-02T19:08:50.529360] [DEBUG] [VALIDATOR ] GENI: Validating primary data. [2025-10-02T19:08:50.684867] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-05. [2025-10-02T19:08:50.961027] [DEBUG] [VALIDATOR ] GENI: All expected trading days are present. [2025-10-02T19:08:50.961137] [DEBUG] [VALIDATOR ] GENI: Primary data validation passed. [2025-10-02T19:08:50.962154] [INFO ] [MAIN ] GENI: Fetched primary data is valid. [2025-10-02T19:08:50.962222] [DEBUG] [LOCAL ] GENI: Saving primary data. [2025-10-02T19:08:50.963894] [DEBUG] [LOCAL ] GENI: Trimmed 75489 records to 53320 (keeping 200 days of data) [2025-10-02T19:08:51.298244] [DEBUG] [LOCAL ] GENI: Primary data saved (53320 records). [2025-10-02T19:08:51.298508] [INFO ] [MAIN ] GENI: Full history saved. [2025-10-02T19:08:51.298607] [INFO ] [MAIN ] Update Progress: 915/2370 symbols completed. GENI took 36.2s. Estimated remaining: 3h 24m 48s. Rate: 7.1 symbols/min [2025-10-02T19:08:51.479799] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-03. [2025-10-02T19:08:51.503263] [INFO ] [MAIN ] GEV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:08:51.540492] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-02T19:08:51.601475] [DEBUG] [LOCAL ] GEV: Loaded 53053 existing records from primary storage. [2025-10-02T19:08:51.601877] [INFO ] [MAIN ] GEV: Loaded 53053 existing records. [2025-10-02T19:08:51.799925] [WARN ] [MAIN ] GEV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:08:51.800211] [INFO ] [MAIN ] GEV: Wiping existing primary data before full refresh. [2025-10-02T19:08:51.800305] [INFO ] [LOCAL ] GEV: Starting deletion of primary data. [2025-10-02T19:08:51.802260] [DEBUG] [LOCAL ] GEV: Deleted primary data file. [2025-10-02T19:08:51.802325] [INFO ] [MAIN ] GEV: Starting full primary refresh. [2025-10-02T19:08:52.217088] [INFO ] [REMOTE ] GEV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:08:52.243924] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-02T19:08:52.272969] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-06. [2025-10-02T19:08:53.073005] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-07. [2025-10-02T19:08:53.126534] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-02T19:08:53.660996] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-02T19:08:53.873005] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-04. [2025-10-02T19:08:54.673004] [INFO ] [REMOTE ] GEV: Fetching primary data for 2024-12. [2025-10-02T19:08:54.981458] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-02T19:08:55.019147] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-02T19:08:55.473055] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-07. [2025-10-02T19:08:56.272993] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-08. [2025-10-02T19:08:56.564275] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-02T19:08:57.037393] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-02T19:08:57.072975] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-01. [2025-10-02T19:08:57.698601] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-02T19:08:57.873015] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-05. [2025-10-02T19:08:58.673074] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-08. [2025-10-02T19:08:59.259942] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-02T19:08:59.386376] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-10-02T19:08:59.473011] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-02. [2025-10-02T19:09:00.211817] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-02T19:09:00.272982] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-09. [2025-10-02T19:09:01.073039] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-09. [2025-10-02T19:09:01.859680] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-02 (2.39 seconds). [2025-10-02T19:09:01.872958] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-03. [2025-10-02T19:09:01.916147] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-02T19:09:02.673567] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-10. [2025-10-02T19:09:02.677537] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-02T19:09:03.472994] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-10. [2025-10-02T19:09:03.926828] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-02T19:09:03.928677] [INFO ] [REMOTE ] GES: Full fetch complete (59446 records). [2025-10-02T19:09:03.928787] [DEBUG] [VALIDATOR ] GES: Validating primary data. [2025-10-02T19:09:04.276126] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-06. [2025-10-02T19:09:04.415771] [DEBUG] [VALIDATOR ] GES: All expected trading days are present. [2025-10-02T19:09:04.415895] [DEBUG] [VALIDATOR ] GES: Primary data validation passed. [2025-10-02T19:09:04.416905] [INFO ] [MAIN ] GES: Fetched primary data is valid. [2025-10-02T19:09:04.416990] [DEBUG] [LOCAL ] GES: Saving primary data. [2025-10-02T19:09:04.451217] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-03 (2.58 seconds). [2025-10-02T19:09:04.449769] [DEBUG] [LOCAL ] GES: Trimmed 59446 records to 39655 (keeping 200 days of data) [2025-10-02T19:09:04.720952] [DEBUG] [LOCAL ] GES: Primary data saved (39655 records). [2025-10-02T19:09:04.721102] [INFO ] [MAIN ] GES: Full history saved. [2025-10-02T19:09:04.724728] [INFO ] [MAIN ] Update Progress: 916/2370 symbols completed. GES took 32.5s. Estimated remaining: 3h 24m 47s. Rate: 7.1 symbols/min [2025-10-02T19:09:04.936241] [INFO ] [MAIN ] GF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:09:04.943066] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-02T19:09:04.946982] [INFO ] [REMOTE ] GEO: Full fetch complete (75476 records). [2025-10-02T19:09:04.947245] [DEBUG] [VALIDATOR ] GEO: Validating primary data. [2025-10-02T19:09:04.950465] [DEBUG] [LOCAL ] GF: Loaded 2967 existing records from primary storage. [2025-10-02T19:09:04.956153] [INFO ] [MAIN ] GF: Loaded 2967 existing records. [2025-10-02T19:09:05.073353] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-04. [2025-10-02T19:09:05.447416] [WARN ] [MAIN ] GF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:09:05.481594] [INFO ] [MAIN ] GF: Wiping existing primary data before full refresh. [2025-10-02T19:09:05.485872] [INFO ] [LOCAL ] GF: Starting deletion of primary data. [2025-10-02T19:09:05.486215] [DEBUG] [LOCAL ] GF: Deleted primary data file. [2025-10-02T19:09:05.491717] [INFO ] [MAIN ] GF: Starting full primary refresh. [2025-10-02T19:09:05.712482] [DEBUG] [VALIDATOR ] GEO: All expected trading days are present. [2025-10-02T19:09:05.723463] [DEBUG] [VALIDATOR ] GEO: Primary data validation passed. [2025-10-02T19:09:05.729575] [INFO ] [MAIN ] GEO: Fetched primary data is valid. [2025-10-02T19:09:05.793911] [DEBUG] [LOCAL ] GEO: Saving primary data. [2025-10-02T19:09:05.913790] [DEBUG] [LOCAL ] GEO: Trimmed 75476 records to 52324 (keeping 200 days of data) [2025-10-02T19:09:06.059630] [INFO ] [REMOTE ] GF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:09:06.106075] [INFO ] [REMOTE ] GF: Fetching primary data for 2024-12. [2025-10-02T19:09:06.111115] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-02T19:09:06.353132] [DEBUG] [LOCAL ] GEO: Primary data saved (52324 records). [2025-10-02T19:09:06.353277] [INFO ] [MAIN ] GEO: Full history saved. [2025-10-02T19:09:06.353373] [INFO ] [MAIN ] Update Progress: 917/2370 symbols completed. GEO took 39.7s. Estimated remaining: 3h 24m 28s. Rate: 7.1 symbols/min [2025-10-02T19:09:06.673055] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-07. [2025-10-02T19:09:06.763096] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-02T19:09:07.117447] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-02T19:09:07.473011] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-01. [2025-10-02T19:09:07.763841] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-02T19:09:08.093071] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-02T19:09:08.273050] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-02. [2025-10-02T19:09:08.967738] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-02T19:09:09.073012] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-05. [2025-10-02T19:09:09.873028] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-03. [2025-10-02T19:09:10.529767] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-02T19:09:10.673010] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-08. [2025-10-02T19:09:11.482725] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-04. [2025-10-02T19:09:11.517104] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-10-02T19:09:12.051874] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-02T19:09:12.094511] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-02T19:09:12.273023] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-09. [2025-10-02T19:09:13.072944] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-05. [2025-10-02T19:09:13.744063] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-02T19:09:13.748518] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-02T19:09:13.872998] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-06. [2025-10-02T19:09:14.457534] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-02T19:09:14.673040] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-07. [2025-10-02T19:09:15.130685] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-02T19:09:15.473008] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-08. [2025-10-02T19:09:15.944837] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-02T19:09:16.273044] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-09. [2025-10-02T19:09:16.754158] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-02T19:09:17.073029] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-06. [2025-10-02T19:09:17.873014] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-10. [2025-10-02T19:09:18.236982] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-02T19:09:18.237723] [INFO ] [REMOTE ] GF: Full fetch complete (5175 records). [2025-10-02T19:09:18.237828] [DEBUG] [VALIDATOR ] GF: Validating primary data. [2025-10-02T19:09:18.649371] [DEBUG] [VALIDATOR ] GF: All expected trading days are present. [2025-10-02T19:09:18.649448] [DEBUG] [VALIDATOR ] GF: Primary data validation passed. [2025-10-02T19:09:18.649586] [INFO ] [MAIN ] GF: Fetched primary data is valid. [2025-10-02T19:09:18.649633] [DEBUG] [LOCAL ] GF: Saving primary data. [2025-10-02T19:09:18.650033] [DEBUG] [LOCAL ] GF: Trimmed 5175 records to 2981 (keeping 200 days of data) [2025-10-02T19:09:18.670225] [DEBUG] [LOCAL ] GF: Primary data saved (2981 records). [2025-10-02T19:09:18.670312] [INFO ] [MAIN ] GF: Full history saved. [2025-10-02T19:09:18.670387] [INFO ] [MAIN ] Update Progress: 918/2370 symbols completed. GF took 13.9s. Estimated remaining: 3h 24m 26s. Rate: 7.1 symbols/min [2025-10-02T19:09:18.673009] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-10. [2025-10-02T19:09:19.294030] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-10-02T19:09:19.473064] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-07. [2025-10-02T19:09:19.803206] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-02T19:09:19.804912] [INFO ] [REMOTE ] GETY: Full fetch complete (55448 records). [2025-10-02T19:09:19.804998] [DEBUG] [VALIDATOR ] GETY: Validating primary data. [2025-10-02T19:09:20.227265] [DEBUG] [VALIDATOR ] GETY: All expected trading days are present. [2025-10-02T19:09:20.227354] [DEBUG] [VALIDATOR ] GETY: Primary data validation passed. [2025-10-02T19:09:20.228395] [INFO ] [MAIN ] GETY: Fetched primary data is valid. [2025-10-02T19:09:20.228534] [DEBUG] [LOCAL ] GETY: Saving primary data. [2025-10-02T19:09:20.229864] [DEBUG] [LOCAL ] GETY: Trimmed 55448 records to 35780 (keeping 200 days of data) [2025-10-02T19:09:20.456290] [DEBUG] [LOCAL ] GETY: Primary data saved (35780 records). [2025-10-02T19:09:20.456444] [INFO ] [MAIN ] GETY: Full history saved. [2025-10-02T19:09:20.456565] [INFO ] [MAIN ] Update Progress: 919/2370 symbols completed. GETY took 40.6s. Estimated remaining: 3h 24m 7s. Rate: 7.1 symbols/min [2025-10-02T19:09:22.001374] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-10-02T19:09:22.014336] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-08. [2025-10-02T19:09:24.498814] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-08 (2.48 seconds). [2025-10-02T19:09:24.510361] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-09. [2025-10-02T19:09:27.028897] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-10-02T19:09:27.041011] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-10. [2025-10-02T19:09:29.192878] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-02T19:09:29.195256] [INFO ] [REMOTE ] GEV: Full fetch complete (76903 records). [2025-10-02T19:09:29.195411] [DEBUG] [VALIDATOR ] GEV: Validating primary data. [2025-10-02T19:09:29.636614] [DEBUG] [VALIDATOR ] GEV: All expected trading days are present. [2025-10-02T19:09:29.636790] [DEBUG] [VALIDATOR ] GEV: Primary data validation passed. [2025-10-02T19:09:29.637875] [INFO ] [MAIN ] GEV: Fetched primary data is valid. [2025-10-02T19:09:29.637990] [DEBUG] [LOCAL ] GEV: Saving primary data. [2025-10-02T19:09:29.640271] [DEBUG] [LOCAL ] GEV: Trimmed 76903 records to 53424 (keeping 200 days of data) [2025-10-02T19:09:29.998540] [DEBUG] [LOCAL ] GEV: Primary data saved (53424 records). [2025-10-02T19:09:29.998728] [INFO ] [MAIN ] GEV: Full history saved. [2025-10-02T19:09:29.998928] [INFO ] [MAIN ] Update Progress: 920/2370 symbols completed. GEV took 38.7s. Estimated remaining: 3h 24m 0s. Rate: 7.1 symbols/min [2025-10-02T19:09:30.652633] [INFO ] [MAIN ] GFI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:09:30.703437] [INFO ] [MAIN ] GFR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:09:30.780440] [INFO ] [MAIN ] GFF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:09:30.800005] [INFO ] [MAIN ] GFL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:09:30.809086] [DEBUG] [LOCAL ] GFR: Loaded 8335 existing records from primary storage. [2025-10-02T19:09:30.810097] [INFO ] [MAIN ] GFR: Loaded 8335 existing records. [2025-10-02T19:09:31.024700] [WARN ] [MAIN ] GFR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:09:31.039161] [INFO ] [MAIN ] GFR: Wiping existing primary data before full refresh. [2025-10-02T19:09:31.050893] [INFO ] [LOCAL ] GFR: Starting deletion of primary data. [2025-10-02T19:09:31.052533] [DEBUG] [LOCAL ] GFF: Loaded 30368 existing records from primary storage. [2025-10-02T19:09:31.052834] [DEBUG] [LOCAL ] GFR: Deleted primary data file. [2025-10-02T19:09:31.053178] [INFO ] [MAIN ] GFR: Starting full primary refresh. [2025-10-02T19:09:31.053106] [INFO ] [MAIN ] GFF: Loaded 30368 existing records. [2025-10-02T19:09:31.263698] [DEBUG] [LOCAL ] GFI: Loaded 53104 existing records from primary storage. [2025-10-02T19:09:31.305789] [DEBUG] [LOCAL ] GFL: Loaded 47938 existing records from primary storage. [2025-10-02T19:09:31.312140] [INFO ] [MAIN ] GFI: Loaded 53104 existing records. [2025-10-02T19:09:31.354871] [INFO ] [MAIN ] GFL: Loaded 47938 existing records. [2025-10-02T19:09:31.625589] [WARN ] [MAIN ] GFF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:09:31.718016] [INFO ] [MAIN ] GFF: Wiping existing primary data before full refresh. [2025-10-02T19:09:31.794963] [INFO ] [LOCAL ] GFF: Starting deletion of primary data. [2025-10-02T19:09:31.876041] [DEBUG] [LOCAL ] GFF: Deleted primary data file. [2025-10-02T19:09:31.901962] [INFO ] [MAIN ] GFF: Starting full primary refresh. [2025-10-02T19:09:32.029072] [WARN ] [MAIN ] GFI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:09:32.129226] [WARN ] [MAIN ] GFL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:09:32.139327] [INFO ] [MAIN ] GFI: Wiping existing primary data before full refresh. [2025-10-02T19:09:32.149912] [INFO ] [LOCAL ] GFI: Starting deletion of primary data. [2025-10-02T19:09:32.165913] [INFO ] [MAIN ] GFL: Wiping existing primary data before full refresh. [2025-10-02T19:09:32.181420] [DEBUG] [LOCAL ] GFI: Deleted primary data file. [2025-10-02T19:09:32.206234] [INFO ] [LOCAL ] GFL: Starting deletion of primary data. [2025-10-02T19:09:32.248236] [DEBUG] [LOCAL ] GFL: Deleted primary data file. [2025-10-02T19:09:32.263113] [INFO ] [MAIN ] GFI: Starting full primary refresh. [2025-10-02T19:09:32.269573] [INFO ] [REMOTE ] GFR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:09:32.263227] [INFO ] [MAIN ] GFL: Starting full primary refresh. [2025-10-02T19:09:32.275498] [INFO ] [REMOTE ] GFR: Fetching primary data for 2024-12. [2025-10-02T19:09:33.237912] [INFO ] [REMOTE ] GFF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:09:33.264383] [INFO ] [REMOTE ] GFF: Fetching primary data for 2024-12. [2025-10-02T19:09:33.444762] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-02T19:09:33.436393] [INFO ] [REMOTE ] GFI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:09:33.479091] [INFO ] [REMOTE ] GFL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:09:33.484081] [INFO ] [REMOTE ] GFL: Fetching primary data for 2024-12. [2025-10-02T19:09:33.483799] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-01. [2025-10-02T19:09:33.480096] [INFO ] [REMOTE ] GFI: Fetching primary data for 2024-12. [2025-10-02T19:09:34.217858] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-02T19:09:34.220946] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-02. [2025-10-02T19:09:34.634948] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-02T19:09:34.641955] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-01. [2025-10-02T19:09:34.709994] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-02T19:09:34.712423] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-03. [2025-10-02T19:09:35.026392] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-02T19:09:35.035705] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-01. [2025-10-02T19:09:35.314415] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-02T19:09:35.324873] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-01. [2025-10-02T19:09:35.472044] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-02T19:09:35.477323] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-04. [2025-10-02T19:09:35.714699] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-02T19:09:35.721141] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-02. [2025-10-02T19:09:36.128956] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-02T19:09:36.132860] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-05. [2025-10-02T19:09:36.574882] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-02T19:09:36.585224] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-02. [2025-10-02T19:09:36.829403] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-02T19:09:36.833607] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-06. [2025-10-02T19:09:36.949074] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-02T19:09:36.961180] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-02. [2025-10-02T19:09:37.198887] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-02T19:09:37.209846] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-03. [2025-10-02T19:09:37.547187] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-02T19:09:37.549496] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-07. [2025-10-02T19:09:38.055870] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-02T19:09:38.058860] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-08. [2025-10-02T19:09:38.088034] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-02T19:09:38.098676] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-03. [2025-10-02T19:09:38.519384] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-02T19:09:38.610288] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-02T19:09:38.673002] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-09. [2025-10-02T19:09:38.758962] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-02T19:09:39.203851] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-02T19:09:39.351317] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-02T19:09:39.473053] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-10. [2025-10-02T19:09:39.939749] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-02T19:09:39.941047] [INFO ] [REMOTE ] GFR: Full fetch complete (12471 records). [2025-10-02T19:09:39.941150] [DEBUG] [VALIDATOR ] GFR: Validating primary data. [2025-10-02T19:09:40.280167] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-04. [2025-10-02T19:09:40.484683] [DEBUG] [VALIDATOR ] GFR: All expected trading days are present. [2025-10-02T19:09:40.484802] [DEBUG] [VALIDATOR ] GFR: Primary data validation passed. [2025-10-02T19:09:40.485276] [INFO ] [MAIN ] GFR: Fetched primary data is valid. [2025-10-02T19:09:40.485352] [DEBUG] [LOCAL ] GFR: Saving primary data. [2025-10-02T19:09:40.486093] [DEBUG] [LOCAL ] GFR: Trimmed 12471 records to 8355 (keeping 200 days of data) [2025-10-02T19:09:40.544040] [DEBUG] [LOCAL ] GFR: Primary data saved (8355 records). [2025-10-02T19:09:40.544238] [INFO ] [MAIN ] GFR: Full history saved. [2025-10-02T19:09:40.544379] [INFO ] [MAIN ] Update Progress: 921/2370 symbols completed. GFR took 10.5s. Estimated remaining: 3h 23m 55s. Rate: 7.1 symbols/min [2025-10-02T19:09:40.760284] [INFO ] [MAIN ] GGB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:09:40.821166] [DEBUG] [LOCAL ] GGB: Loaded 51093 existing records from primary storage. [2025-10-02T19:09:40.821496] [INFO ] [MAIN ] GGB: Loaded 51093 existing records. [2025-10-02T19:09:41.018576] [WARN ] [MAIN ] GGB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:09:41.018847] [INFO ] [MAIN ] GGB: Wiping existing primary data before full refresh. [2025-10-02T19:09:41.018923] [INFO ] [LOCAL ] GGB: Starting deletion of primary data. [2025-10-02T19:09:41.020966] [DEBUG] [LOCAL ] GGB: Deleted primary data file. [2025-10-02T19:09:41.021045] [INFO ] [MAIN ] GGB: Starting full primary refresh. [2025-10-02T19:09:41.078116] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-04. [2025-10-02T19:09:41.430282] [INFO ] [REMOTE ] GGB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:09:41.873012] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-03. [2025-10-02T19:09:42.068316] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-02T19:09:42.672970] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-05. [2025-10-02T19:09:42.857076] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-02T19:09:43.473001] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-05. [2025-10-02T19:09:43.934200] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-02T19:09:44.272965] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-04. [2025-10-02T19:09:44.339372] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-02T19:09:44.381449] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-02T19:09:45.072998] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-06. [2025-10-02T19:09:45.873018] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-06. [2025-10-02T19:09:46.343806] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-02T19:09:46.672968] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-07. [2025-10-02T19:09:46.753228] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-10-02T19:09:47.356570] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-02T19:09:47.473040] [INFO ] [REMOTE ] GGB: Fetching primary data for 2024-12. [2025-10-02T19:09:47.874280] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-02T19:09:48.273046] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-05. [2025-10-02T19:09:48.903610] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-02T19:09:49.073025] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-07. [2025-10-02T19:09:49.872995] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-08. [2025-10-02T19:09:50.385437] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-02T19:09:50.672995] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-06. [2025-10-02T19:09:50.749394] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-02T19:09:50.894917] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-02T19:09:51.473043] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-08. [2025-10-02T19:09:52.246803] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-02T19:09:52.273013] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-01. [2025-10-02T19:09:52.853805] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-02T19:09:53.073050] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-09. [2025-10-02T19:09:53.873013] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-07. [2025-10-02T19:09:53.929396] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-02T19:09:54.599439] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-02T19:09:54.672971] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-02. [2025-10-02T19:09:55.473005] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-09. [2025-10-02T19:09:55.829573] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-02T19:09:56.270676] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-02T19:09:56.279942] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-08. [2025-10-02T19:09:56.650519] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-02T19:09:57.073013] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-10. [2025-10-02T19:09:57.872988] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-10. [2025-10-02T19:09:58.017477] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-02T19:09:58.461423] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-02T19:09:58.464048] [INFO ] [REMOTE ] GFL: Full fetch complete (69137 records). [2025-10-02T19:09:58.464157] [DEBUG] [VALIDATOR ] GFL: Validating primary data. [2025-10-02T19:09:58.679055] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-09. [2025-10-02T19:09:58.802477] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-02T19:09:58.824825] [INFO ] [REMOTE ] GFF: Full fetch complete (44161 records). [2025-10-02T19:09:58.844509] [DEBUG] [VALIDATOR ] GFF: Validating primary data. [2025-10-02T19:09:58.986874] [DEBUG] [VALIDATOR ] GFL: All expected trading days are present. [2025-10-02T19:09:59.012301] [DEBUG] [VALIDATOR ] GFL: Primary data validation passed. [2025-10-02T19:09:59.016164] [INFO ] [MAIN ] GFL: Fetched primary data is valid. [2025-10-02T19:09:59.016296] [DEBUG] [LOCAL ] GFL: Saving primary data. [2025-10-02T19:09:59.082495] [DEBUG] [LOCAL ] GFL: Trimmed 69137 records to 48290 (keeping 200 days of data) [2025-10-02T19:09:59.461023] [DEBUG] [VALIDATOR ] GFF: All expected trading days are present. [2025-10-02T19:09:59.461916] [DEBUG] [VALIDATOR ] GFF: Primary data validation passed. [2025-10-02T19:09:59.464105] [INFO ] [MAIN ] GFF: Fetched primary data is valid. [2025-10-02T19:09:59.464496] [DEBUG] [LOCAL ] GFF: Saving primary data. [2025-10-02T19:09:59.470235] [DEBUG] [LOCAL ] GFF: Trimmed 44161 records to 30582 (keeping 200 days of data) [2025-10-02T19:09:59.521827] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-03. [2025-10-02T19:09:59.771241] [DEBUG] [LOCAL ] GFF: Primary data saved (30582 records). [2025-10-02T19:09:59.772000] [INFO ] [MAIN ] GFF: Full history saved. [2025-10-02T19:09:59.772377] [INFO ] [MAIN ] Update Progress: 922/2370 symbols completed. GFF took 29.8s. Estimated remaining: 3h 24m 4s. Rate: 7.1 symbols/min [2025-10-02T19:09:59.993851] [INFO ] [MAIN ] GGG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:10:00.082854] [DEBUG] [LOCAL ] GGG: Loaded 40968 existing records from primary storage. [2025-10-02T19:10:00.084598] [INFO ] [MAIN ] GGG: Loaded 40968 existing records. [2025-10-02T19:10:00.200134] [DEBUG] [LOCAL ] GFL: Primary data saved (48290 records). [2025-10-02T19:10:00.200347] [INFO ] [MAIN ] GFL: Full history saved. [2025-10-02T19:10:00.200845] [INFO ] [MAIN ] Update Progress: 923/2370 symbols completed. GFL took 30.2s. Estimated remaining: 3h 23m 43s. Rate: 7.1 symbols/min [2025-10-02T19:10:00.413531] [WARN ] [MAIN ] GGG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:10:00.448710] [INFO ] [MAIN ] GGG: Wiping existing primary data before full refresh. [2025-10-02T19:10:00.463975] [INFO ] [LOCAL ] GGG: Starting deletion of primary data. [2025-10-02T19:10:00.484973] [INFO ] [MAIN ] GGT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:10:00.487825] [DEBUG] [LOCAL ] GGG: Deleted primary data file. [2025-10-02T19:10:00.487974] [INFO ] [MAIN ] GGG: Starting full primary refresh. [2025-10-02T19:10:00.615967] [DEBUG] [LOCAL ] GGT: Loaded 14063 existing records from primary storage. [2025-10-02T19:10:00.642324] [INFO ] [MAIN ] GGT: Loaded 14063 existing records. [2025-10-02T19:10:01.106441] [WARN ] [MAIN ] GGT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:10:01.123968] [INFO ] [MAIN ] GGT: Wiping existing primary data before full refresh. [2025-10-02T19:10:01.201916] [INFO ] [REMOTE ] GGG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:10:01.202556] [INFO ] [REMOTE ] GGG: Fetching primary data for 2024-12. [2025-10-02T19:10:01.194517] [INFO ] [LOCAL ] GGT: Starting deletion of primary data. [2025-10-02T19:10:01.204896] [DEBUG] [LOCAL ] GGT: Deleted primary data file. [2025-10-02T19:10:01.205118] [INFO ] [MAIN ] GGT: Starting full primary refresh. [2025-10-02T19:10:01.519983] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-09 (2.84 seconds). [2025-10-02T19:10:01.609150] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-10. [2025-10-02T19:10:01.774692] [INFO ] [REMOTE ] GGT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:10:01.805455] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-02T19:10:01.872990] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-04. [2025-10-02T19:10:02.541501] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-02T19:10:02.673063] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-01. [2025-10-02T19:10:03.473027] [INFO ] [REMOTE ] GGT: Fetching primary data for 2024-12. [2025-10-02T19:10:03.678083] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-02T19:10:03.680307] [INFO ] [REMOTE ] GFI: Full fetch complete (76406 records). [2025-10-02T19:10:03.680414] [DEBUG] [VALIDATOR ] GFI: Validating primary data. [2025-10-02T19:10:04.033163] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-02T19:10:04.205389] [DEBUG] [VALIDATOR ] GFI: All expected trading days are present. [2025-10-02T19:10:04.205756] [DEBUG] [VALIDATOR ] GFI: Primary data validation passed. [2025-10-02T19:10:04.206855] [INFO ] [MAIN ] GFI: Fetched primary data is valid. [2025-10-02T19:10:04.206987] [DEBUG] [LOCAL ] GFI: Saving primary data. [2025-10-02T19:10:04.230861] [DEBUG] [LOCAL ] GFI: Trimmed 76406 records to 53491 (keeping 200 days of data) [2025-10-02T19:10:04.233109] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-02T19:10:04.296368] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-05. [2025-10-02T19:10:04.449829] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-02T19:10:04.614092] [DEBUG] [LOCAL ] GFI: Primary data saved (53491 records). [2025-10-02T19:10:04.614264] [INFO ] [MAIN ] GFI: Full history saved. [2025-10-02T19:10:04.615296] [INFO ] [MAIN ] Update Progress: 924/2370 symbols completed. GFI took 34.6s. Estimated remaining: 3h 23m 28s. Rate: 7.1 symbols/min [2025-10-02T19:10:04.810516] [INFO ] [MAIN ] GGZ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:10:04.815537] [DEBUG] [LOCAL ] GGZ: Loaded 2416 existing records from primary storage. [2025-10-02T19:10:04.815768] [INFO ] [MAIN ] GGZ: Loaded 2416 existing records. [2025-10-02T19:10:05.016344] [WARN ] [MAIN ] GGZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:10:05.016721] [INFO ] [MAIN ] GGZ: Wiping existing primary data before full refresh. [2025-10-02T19:10:05.016795] [INFO ] [LOCAL ] GGZ: Starting deletion of primary data. [2025-10-02T19:10:05.017129] [DEBUG] [LOCAL ] GGZ: Deleted primary data file. [2025-10-02T19:10:05.017217] [INFO ] [MAIN ] GGZ: Starting full primary refresh. [2025-10-02T19:10:05.080476] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-01. [2025-10-02T19:10:05.407810] [INFO ] [REMOTE ] GGZ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:10:05.872988] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2024-12. [2025-10-02T19:10:06.039403] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-02T19:10:06.097728] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-02T19:10:06.472467] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-02T19:10:06.673005] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-02. [2025-10-02T19:10:07.419521] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-02T19:10:07.473048] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-03. [2025-10-02T19:10:08.272988] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-02. [2025-10-02T19:10:08.344790] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-02T19:10:09.073040] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-06. [2025-10-02T19:10:09.706258] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-02T19:10:09.873022] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-03. [2025-10-02T19:10:10.673030] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-01. [2025-10-02T19:10:10.825743] [DEBUG] [REMOTE ] GGZ: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-02T19:10:10.826076] [WARN ] [REMOTE ] GGZ: No data returned for month 2025-01 [2025-10-02T19:10:10.826174] [FATAL] [REMOTE ] GGZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T19:10:10.826265] [FATAL] [MAIN ] GGZ: Failed to fetch primary data. [2025-10-02T19:10:10.826341] [WARN ] [MAIN ] GGZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T19:10:10.826447] [INFO ] [LOCAL ] GGZ: Starting deletion of primary data. [2025-10-02T19:10:10.826512] [DEBUG] [LOCAL ] GGZ: No primary data file found to delete. [2025-10-02T19:10:10.826551] [INFO ] [LOCAL ] GGZ: Starting deletion of derivative data. [2025-10-02T19:10:10.827076] [DEBUG] [LOCAL ] GGZ: Deleted derivative data file. [2025-10-02T19:10:10.827168] [INFO ] [MAIN ] Update Progress: 925/2370 symbols completed. GGZ took 6.2s. Estimated remaining: 3h 23m 16s. Rate: 7.1 symbols/min [2025-10-02T19:10:11.046347] [INFO ] [MAIN ] GHC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:10:11.049346] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-02T19:10:11.064194] [DEBUG] [LOCAL ] GHC: Loaded 2669 existing records from primary storage. [2025-10-02T19:10:11.064933] [INFO ] [MAIN ] GHC: Loaded 2669 existing records. [2025-10-02T19:10:11.267181] [WARN ] [MAIN ] GHC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:10:11.267512] [INFO ] [MAIN ] GHC: Wiping existing primary data before full refresh. [2025-10-02T19:10:11.267676] [INFO ] [LOCAL ] GHC: Starting deletion of primary data. [2025-10-02T19:10:11.268104] [DEBUG] [LOCAL ] GHC: Deleted primary data file. [2025-10-02T19:10:11.268211] [INFO ] [MAIN ] GHC: Starting full primary refresh. [2025-10-02T19:10:11.478730] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-07. [2025-10-02T19:10:11.688181] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-02T19:10:11.720878] [INFO ] [REMOTE ] GHC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:10:12.273000] [INFO ] [REMOTE ] GHC: Fetching primary data for 2024-12. [2025-10-02T19:10:12.700573] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-02T19:10:13.079995] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-04. [2025-10-02T19:10:13.103477] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-02T19:10:13.872998] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-01. [2025-10-02T19:10:13.917507] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-02T19:10:14.443393] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-02T19:10:14.673030] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-05. [2025-10-02T19:10:15.473008] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-02. [2025-10-02T19:10:15.831037] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-02T19:10:15.869537] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-02T19:10:16.273028] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-06. [2025-10-02T19:10:16.940143] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-02T19:10:17.072992] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-07. [2025-10-02T19:10:17.873004] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-04. [2025-10-02T19:10:18.009898] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-02T19:10:18.673000] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-08. [2025-10-02T19:10:19.472971] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-08. [2025-10-02T19:10:19.655694] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-02T19:10:20.059488] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-02T19:10:20.272991] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-09. [2025-10-02T19:10:20.409537] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-02T19:10:20.802771] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-02T19:10:21.073044] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-10. [2025-10-02T19:10:21.866491] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-02T19:10:21.867604] [INFO ] [REMOTE ] GGT: Full fetch complete (18793 records). [2025-10-02T19:10:21.867725] [DEBUG] [VALIDATOR ] GGT: Validating primary data. [2025-10-02T19:10:21.879611] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-05. [2025-10-02T19:10:22.277926] [DEBUG] [VALIDATOR ] GGT: All expected trading days are present. [2025-10-02T19:10:22.278050] [DEBUG] [VALIDATOR ] GGT: Primary data validation passed. [2025-10-02T19:10:22.278530] [INFO ] [MAIN ] GGT: Fetched primary data is valid. [2025-10-02T19:10:22.278595] [DEBUG] [LOCAL ] GGT: Saving primary data. [2025-10-02T19:10:22.279205] [DEBUG] [LOCAL ] GGT: Trimmed 18793 records to 14175 (keeping 200 days of data) [2025-10-02T19:10:22.368244] [DEBUG] [LOCAL ] GGT: Primary data saved (14175 records). [2025-10-02T19:10:22.368384] [INFO ] [MAIN ] GGT: Full history saved. [2025-10-02T19:10:22.368505] [INFO ] [MAIN ] Update Progress: 926/2370 symbols completed. GGT took 22.2s. Estimated remaining: 3h 23m 12s. Rate: 7.1 symbols/min [2025-10-02T19:10:22.559396] [INFO ] [MAIN ] GHG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:10:22.566124] [DEBUG] [LOCAL ] GHG: Loaded 3185 existing records from primary storage. [2025-10-02T19:10:22.566363] [INFO ] [MAIN ] GHG: Loaded 3185 existing records. [2025-10-02T19:10:22.674900] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-09. [2025-10-02T19:10:22.759829] [WARN ] [MAIN ] GHG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:10:22.760070] [INFO ] [MAIN ] GHG: Wiping existing primary data before full refresh. [2025-10-02T19:10:22.760124] [INFO ] [LOCAL ] GHG: Starting deletion of primary data. [2025-10-02T19:10:22.760698] [DEBUG] [LOCAL ] GHG: Deleted primary data file. [2025-10-02T19:10:22.760774] [INFO ] [MAIN ] GHG: Starting full primary refresh. [2025-10-02T19:10:23.160588] [INFO ] [REMOTE ] GHG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:10:23.193071] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-02T19:10:23.473021] [INFO ] [REMOTE ] GHG: Fetching primary data for 2024-12. [2025-10-02T19:10:24.272996] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-06. [2025-10-02T19:10:24.345411] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-02T19:10:24.460970] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-02T19:10:25.073019] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-03. [2025-10-02T19:10:25.398574] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-02T19:10:25.568282] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-02T19:10:25.872997] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-01. [2025-10-02T19:10:26.300165] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-02T19:10:26.673035] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-04. [2025-10-02T19:10:27.197142] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-02T19:10:27.472995] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-05. [2025-10-02T19:10:28.021408] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-02T19:10:28.273009] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-02. [2025-10-02T19:10:28.615192] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-02T19:10:29.073003] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-03. [2025-10-02T19:10:29.803196] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-02T19:10:29.873048] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-10. [2025-10-02T19:10:30.672986] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-04. [2025-10-02T19:10:31.013795] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-02T19:10:31.392752] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-02T19:10:31.395001] [INFO ] [REMOTE ] GGB: Full fetch complete (74071 records). [2025-10-02T19:10:31.395137] [DEBUG] [VALIDATOR ] GGB: Validating primary data. [2025-10-02T19:10:31.478106] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-06. [2025-10-02T19:10:31.868907] [DEBUG] [VALIDATOR ] GGB: All expected trading days are present. [2025-10-02T19:10:31.869058] [DEBUG] [VALIDATOR ] GGB: Primary data validation passed. [2025-10-02T19:10:31.870040] [INFO ] [MAIN ] GGB: Fetched primary data is valid. [2025-10-02T19:10:31.870156] [DEBUG] [LOCAL ] GGB: Saving primary data. [2025-10-02T19:10:31.871704] [DEBUG] [LOCAL ] GGB: Trimmed 74071 records to 51478 (keeping 200 days of data) [2025-10-02T19:10:32.004962] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-02T19:10:32.192552] [DEBUG] [LOCAL ] GGB: Primary data saved (51478 records). [2025-10-02T19:10:32.192735] [INFO ] [MAIN ] GGB: Full history saved. [2025-10-02T19:10:32.192839] [INFO ] [MAIN ] Update Progress: 927/2370 symbols completed. GGB took 51.6s. Estimated remaining: 3h 23m 6s. Rate: 7.1 symbols/min [2025-10-02T19:10:32.278163] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-05. [2025-10-02T19:10:32.381081] [INFO ] [MAIN ] GHI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:10:32.390400] [DEBUG] [LOCAL ] GHI: Loaded 7020 existing records from primary storage. [2025-10-02T19:10:32.390635] [INFO ] [MAIN ] GHI: Loaded 7020 existing records. [2025-10-02T19:10:32.594347] [WARN ] [MAIN ] GHI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:10:32.594575] [INFO ] [MAIN ] GHI: Wiping existing primary data before full refresh. [2025-10-02T19:10:32.594661] [INFO ] [LOCAL ] GHI: Starting deletion of primary data. [2025-10-02T19:10:32.595472] [DEBUG] [LOCAL ] GHI: Deleted primary data file. [2025-10-02T19:10:32.595533] [INFO ] [MAIN ] GHI: Starting full primary refresh. [2025-10-02T19:10:32.875258] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-02T19:10:32.985183] [INFO ] [REMOTE ] GHI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:10:33.073002] [INFO ] [REMOTE ] GHI: Fetching primary data for 2024-12. [2025-10-02T19:10:33.873022] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-07. [2025-10-02T19:10:34.098743] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-02T19:10:34.239764] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-02T19:10:34.673001] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-07. [2025-10-02T19:10:35.472998] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-08. [2025-10-02T19:10:35.987536] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-02T19:10:36.182574] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-02T19:10:36.272976] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-08. [2025-10-02T19:10:37.073009] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-06. [2025-10-02T19:10:37.520389] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-02T19:10:37.776087] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-02T19:10:37.873005] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-07. [2025-10-02T19:10:38.672993] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-01. [2025-10-02T19:10:39.472998] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-09. [2025-10-02T19:10:39.505367] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-02T19:10:39.993366] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-02T19:10:40.191847] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-02T19:10:40.272992] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-08. [2025-10-02T19:10:40.828925] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-02T19:10:41.072997] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-09. [2025-10-02T19:10:41.872994] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-02. [2025-10-02T19:10:42.415399] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-02T19:10:42.672983] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-03. [2025-10-02T19:10:42.733584] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-02T19:10:43.472998] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-10. [2025-10-02T19:10:44.273042] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-09. [2025-10-02T19:10:44.560485] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-02T19:10:44.562850] [INFO ] [REMOTE ] GGG: Full fetch complete (59333 records). [2025-10-02T19:10:44.563014] [DEBUG] [VALIDATOR ] GGG: Validating primary data. [2025-10-02T19:10:44.904350] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-02T19:10:45.009065] [DEBUG] [VALIDATOR ] GGG: All expected trading days are present. [2025-10-02T19:10:45.009155] [DEBUG] [VALIDATOR ] GGG: Primary data validation passed. [2025-10-02T19:10:45.010051] [INFO ] [MAIN ] GGG: Fetched primary data is valid. [2025-10-02T19:10:45.010116] [DEBUG] [LOCAL ] GGG: Saving primary data. [2025-10-02T19:10:45.011400] [DEBUG] [LOCAL ] GGG: Trimmed 59333 records to 41247 (keeping 200 days of data) [2025-10-02T19:10:45.081361] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-10. [2025-10-02T19:10:45.287184] [DEBUG] [LOCAL ] GGG: Primary data saved (41247 records). [2025-10-02T19:10:45.287977] [INFO ] [MAIN ] GGG: Full history saved. [2025-10-02T19:10:45.288284] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-03 (2.62 seconds). [2025-10-02T19:10:45.288535] [INFO ] [MAIN ] Update Progress: 928/2370 symbols completed. GGG took 45.5s. Estimated remaining: 3h 23m 5s. Rate: 7.1 symbols/min [2025-10-02T19:10:45.497231] [INFO ] [MAIN ] GHLD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:10:45.504300] [DEBUG] [LOCAL ] GHLD: Loaded 4179 existing records from primary storage. [2025-10-02T19:10:45.504515] [INFO ] [MAIN ] GHLD: Loaded 4179 existing records. [2025-10-02T19:10:45.599832] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-02T19:10:45.617263] [INFO ] [REMOTE ] GHC: Full fetch complete (3322 records). [2025-10-02T19:10:45.617397] [DEBUG] [VALIDATOR ] GHC: Validating primary data. [2025-10-02T19:10:45.831058] [WARN ] [MAIN ] GHLD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:10:45.864419] [INFO ] [MAIN ] GHLD: Wiping existing primary data before full refresh. [2025-10-02T19:10:45.874762] [INFO ] [LOCAL ] GHLD: Starting deletion of primary data. [2025-10-02T19:10:45.874613] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-10. [2025-10-02T19:10:45.882913] [DEBUG] [LOCAL ] GHLD: Deleted primary data file. [2025-10-02T19:10:45.900182] [INFO ] [MAIN ] GHLD: Starting full primary refresh. [2025-10-02T19:10:46.342480] [DEBUG] [VALIDATOR ] GHC: All expected trading days are present. [2025-10-02T19:10:46.382107] [DEBUG] [VALIDATOR ] GHC: Primary data validation passed. [2025-10-02T19:10:46.388364] [INFO ] [MAIN ] GHC: Fetched primary data is valid. [2025-10-02T19:10:46.393580] [DEBUG] [LOCAL ] GHC: Saving primary data. [2025-10-02T19:10:46.414408] [DEBUG] [LOCAL ] GHC: Trimmed 3322 records to 2690 (keeping 200 days of data) [2025-10-02T19:10:46.482494] [DEBUG] [LOCAL ] GHC: Primary data saved (2690 records). [2025-10-02T19:10:46.537578] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-02T19:10:46.541233] [INFO ] [REMOTE ] GHLD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:10:46.542315] [INFO ] [REMOTE ] GHG: Full fetch complete (4030 records). [2025-10-02T19:10:46.542433] [DEBUG] [VALIDATOR ] GHG: Validating primary data. [2025-10-02T19:10:46.529823] [INFO ] [MAIN ] GHC: Full history saved. [2025-10-02T19:10:46.542578] [INFO ] [MAIN ] Update Progress: 929/2370 symbols completed. GHC took 35.7s. Estimated remaining: 3h 22m 45s. Rate: 7.1 symbols/min [2025-10-02T19:10:46.677591] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2024-12. [2025-10-02T19:10:46.975474] [INFO ] [MAIN ] GHM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:10:47.115300] [DEBUG] [LOCAL ] GHM: Loaded 14066 existing records from primary storage. [2025-10-02T19:10:47.140896] [INFO ] [MAIN ] GHM: Loaded 14066 existing records. [2025-10-02T19:10:47.141033] [DEBUG] [VALIDATOR ] GHG: All expected trading days are present. [2025-10-02T19:10:47.163223] [DEBUG] [VALIDATOR ] GHG: Primary data validation passed. [2025-10-02T19:10:47.180239] [INFO ] [MAIN ] GHG: Fetched primary data is valid. [2025-10-02T19:10:47.192903] [DEBUG] [LOCAL ] GHG: Saving primary data. [2025-10-02T19:10:47.228401] [DEBUG] [LOCAL ] GHG: Trimmed 4030 records to 3197 (keeping 200 days of data) [2025-10-02T19:10:47.249155] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-02T19:10:47.375239] [WARN ] [MAIN ] GHM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:10:47.376485] [DEBUG] [LOCAL ] GHG: Primary data saved (3197 records). [2025-10-02T19:10:47.376693] [INFO ] [MAIN ] GHM: Wiping existing primary data before full refresh. [2025-10-02T19:10:47.376774] [INFO ] [LOCAL ] GHM: Starting deletion of primary data. [2025-10-02T19:10:47.376888] [INFO ] [MAIN ] GHG: Full history saved. [2025-10-02T19:10:47.376985] [INFO ] [MAIN ] Update Progress: 930/2370 symbols completed. GHG took 25.0s. Estimated remaining: 3h 22m 25s. Rate: 7.1 symbols/min [2025-10-02T19:10:47.410278] [DEBUG] [LOCAL ] GHM: Deleted primary data file. [2025-10-02T19:10:47.436218] [INFO ] [MAIN ] GHM: Starting full primary refresh. [2025-10-02T19:10:47.509586] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-01. [2025-10-02T19:10:47.681135] [INFO ] [MAIN ] GHY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:10:47.902598] [DEBUG] [LOCAL ] GHY: Loaded 20837 existing records from primary storage. [2025-10-02T19:10:47.918680] [INFO ] [MAIN ] GHY: Loaded 20837 existing records. [2025-10-02T19:10:48.063520] [INFO ] [REMOTE ] GHM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:10:48.105833] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-02T19:10:48.191818] [WARN ] [MAIN ] GHY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:10:48.192045] [INFO ] [MAIN ] GHY: Wiping existing primary data before full refresh. [2025-10-02T19:10:48.192095] [INFO ] [LOCAL ] GHY: Starting deletion of primary data. [2025-10-02T19:10:48.192878] [DEBUG] [LOCAL ] GHY: Deleted primary data file. [2025-10-02T19:10:48.192942] [INFO ] [MAIN ] GHY: Starting full primary refresh. [2025-10-02T19:10:48.278187] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-04. [2025-10-02T19:10:48.583858] [INFO ] [REMOTE ] GHY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:10:49.073082] [INFO ] [REMOTE ] GHM: Fetching primary data for 2024-12. [2025-10-02T19:10:49.089450] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-02T19:10:49.873037] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-02. [2025-10-02T19:10:49.976047] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-02T19:10:50.268708] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-02T19:10:50.673014] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-01. [2025-10-02T19:10:51.472984] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-05. [2025-10-02T19:10:51.534496] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-02T19:10:52.094838] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-02T19:10:52.273009] [INFO ] [REMOTE ] GHY: Fetching primary data for 2024-12. [2025-10-02T19:10:53.072999] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-06. [2025-10-02T19:10:53.329463] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-02T19:10:53.560133] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-02T19:10:53.873010] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-02. [2025-10-02T19:10:54.672987] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-07. [2025-10-02T19:10:55.029467] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-02T19:10:55.184893] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-02T19:10:55.473049] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-01. [2025-10-02T19:10:56.273068] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-08. [2025-10-02T19:10:56.447432] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-02T19:10:57.072998] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-03. [2025-10-02T19:10:57.083232] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-02T19:10:57.571059] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-02T19:10:57.873040] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-02. [2025-10-02T19:10:58.673044] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-04. [2025-10-02T19:10:58.847395] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-02T19:10:59.136094] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-02T19:10:59.473025] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-03. [2025-10-02T19:11:00.272974] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-05. [2025-10-02T19:11:00.643989] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-02T19:11:00.783483] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-02T19:11:01.073018] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-09. [2025-10-02T19:11:01.591116] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-02T19:11:01.873042] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-06. [2025-10-02T19:11:02.483862] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-02T19:11:02.673025] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-10. [2025-10-02T19:11:03.297742] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-02T19:11:03.298786] [INFO ] [REMOTE ] GHI: Full fetch complete (11661 records). [2025-10-02T19:11:03.298860] [DEBUG] [VALIDATOR ] GHI: Validating primary data. [2025-10-02T19:11:03.481117] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-04. [2025-10-02T19:11:03.686860] [DEBUG] [VALIDATOR ] GHI: All expected trading days are present. [2025-10-02T19:11:03.686946] [DEBUG] [VALIDATOR ] GHI: Primary data validation passed. [2025-10-02T19:11:03.687223] [INFO ] [MAIN ] GHI: Fetched primary data is valid. [2025-10-02T19:11:03.687263] [DEBUG] [LOCAL ] GHI: Saving primary data. [2025-10-02T19:11:03.687823] [DEBUG] [LOCAL ] GHI: Trimmed 11661 records to 7089 (keeping 200 days of data) [2025-10-02T19:11:03.739665] [DEBUG] [LOCAL ] GHI: Primary data saved (7089 records). [2025-10-02T19:11:03.739832] [INFO ] [MAIN ] GHI: Full history saved. [2025-10-02T19:11:03.739930] [INFO ] [MAIN ] Update Progress: 931/2370 symbols completed. GHI took 31.5s. Estimated remaining: 3h 22m 29s. Rate: 7.1 symbols/min [2025-10-02T19:11:03.924305] [INFO ] [MAIN ] GIB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:11:03.959343] [DEBUG] [LOCAL ] GIB: Loaded 32101 existing records from primary storage. [2025-10-02T19:11:03.959615] [INFO ] [MAIN ] GIB: Loaded 32101 existing records. [2025-10-02T19:11:04.155848] [WARN ] [MAIN ] GIB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:11:04.156060] [INFO ] [MAIN ] GIB: Wiping existing primary data before full refresh. [2025-10-02T19:11:04.156114] [INFO ] [LOCAL ] GIB: Starting deletion of primary data. [2025-10-02T19:11:04.157332] [DEBUG] [LOCAL ] GIB: Deleted primary data file. [2025-10-02T19:11:04.157398] [INFO ] [MAIN ] GIB: Starting full primary refresh. [2025-10-02T19:11:04.278087] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-03. [2025-10-02T19:11:04.567196] [INFO ] [REMOTE ] GIB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:11:04.774360] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-02T19:11:05.073017] [INFO ] [REMOTE ] GIB: Fetching primary data for 2024-12. [2025-10-02T19:11:05.369155] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-02T19:11:05.873012] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-04. [2025-10-02T19:11:06.153345] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-02T19:11:06.672981] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-07. [2025-10-02T19:11:06.728770] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-02T19:11:07.301554] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-02T19:11:07.473024] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-08. [2025-10-02T19:11:08.167385] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-02T19:11:08.273032] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-05. [2025-10-02T19:11:09.073037] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-05. [2025-10-02T19:11:09.363332] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-02T19:11:09.582911] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-02T19:11:09.873015] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-06. [2025-10-02T19:11:10.672975] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-09. [2025-10-02T19:11:10.879362] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-02T19:11:11.259247] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-02T19:11:11.473034] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-06. [2025-10-02T19:11:12.272970] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-07. [2025-10-02T19:11:12.486811] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-02T19:11:13.073012] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-01. [2025-10-02T19:11:13.234302] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-02T19:11:13.873009] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-10. [2025-10-02T19:11:14.310479] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-02T19:11:14.373463] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-02T19:11:14.374327] [INFO ] [REMOTE ] GHLD: Full fetch complete (4790 records). [2025-10-02T19:11:14.374405] [DEBUG] [VALIDATOR ] GHLD: Validating primary data. [2025-10-02T19:11:14.678149] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-08. [2025-10-02T19:11:14.779351] [DEBUG] [VALIDATOR ] GHLD: All expected trading days are present. [2025-10-02T19:11:14.779432] [DEBUG] [VALIDATOR ] GHLD: Primary data validation passed. [2025-10-02T19:11:14.779576] [INFO ] [MAIN ] GHLD: Fetched primary data is valid. [2025-10-02T19:11:14.779616] [DEBUG] [LOCAL ] GHLD: Saving primary data. [2025-10-02T19:11:14.780053] [DEBUG] [LOCAL ] GHLD: Trimmed 4790 records to 4203 (keeping 200 days of data) [2025-10-02T19:11:14.805039] [DEBUG] [LOCAL ] GHLD: Primary data saved (4203 records). [2025-10-02T19:11:14.805149] [INFO ] [MAIN ] GHLD: Full history saved. [2025-10-02T19:11:14.805231] [INFO ] [MAIN ] Update Progress: 932/2370 symbols completed. GHLD took 29.5s. Estimated remaining: 3h 22m 24s. Rate: 7.1 symbols/min [2025-10-02T19:11:14.981671] [INFO ] [MAIN ] GIC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:11:14.996552] [DEBUG] [LOCAL ] GIC: Loaded 13517 existing records from primary storage. [2025-10-02T19:11:14.996812] [INFO ] [MAIN ] GIC: Loaded 13517 existing records. [2025-10-02T19:11:15.185993] [WARN ] [MAIN ] GIC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:11:15.186236] [INFO ] [MAIN ] GIC: Wiping existing primary data before full refresh. [2025-10-02T19:11:15.186297] [INFO ] [LOCAL ] GIC: Starting deletion of primary data. [2025-10-02T19:11:15.186821] [DEBUG] [LOCAL ] GIC: Deleted primary data file. [2025-10-02T19:11:15.186882] [INFO ] [MAIN ] GIC: Starting full primary refresh. [2025-10-02T19:11:15.478172] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-07. [2025-10-02T19:11:15.626784] [INFO ] [REMOTE ] GIC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:11:15.730740] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-02T19:11:16.273016] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-09. [2025-10-02T19:11:16.641071] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-02T19:11:17.071984] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-02T19:11:17.073840] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-08. [2025-10-02T19:11:17.872997] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-10. [2025-10-02T19:11:17.924815] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-02T19:11:18.672975] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-09. [2025-10-02T19:11:18.728395] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-02T19:11:18.729816] [INFO ] [REMOTE ] GHM: Full fetch complete (21788 records). [2025-10-02T19:11:18.729893] [DEBUG] [VALIDATOR ] GHM: Validating primary data. [2025-10-02T19:11:19.122870] [DEBUG] [VALIDATOR ] GHM: All expected trading days are present. [2025-10-02T19:11:19.122951] [DEBUG] [VALIDATOR ] GHM: Primary data validation passed. [2025-10-02T19:11:19.123443] [INFO ] [MAIN ] GHM: Fetched primary data is valid. [2025-10-02T19:11:19.123493] [DEBUG] [LOCAL ] GHM: Saving primary data. [2025-10-02T19:11:19.124174] [DEBUG] [LOCAL ] GHM: Trimmed 21788 records to 14163 (keeping 200 days of data) [2025-10-02T19:11:19.216206] [DEBUG] [LOCAL ] GHM: Primary data saved (14163 records). [2025-10-02T19:11:19.216363] [INFO ] [MAIN ] GHM: Full history saved. [2025-10-02T19:11:19.216470] [INFO ] [MAIN ] Update Progress: 933/2370 symbols completed. GHM took 32.6s. Estimated remaining: 3h 22m 10s. Rate: 7.1 symbols/min [2025-10-02T19:11:19.405068] [INFO ] [MAIN ] GIL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:11:19.417730] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-02T19:11:19.467457] [DEBUG] [LOCAL ] GIL: Loaded 43388 existing records from primary storage. [2025-10-02T19:11:19.467825] [INFO ] [MAIN ] GIL: Loaded 43388 existing records. [2025-10-02T19:11:19.479599] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-02. [2025-10-02T19:11:19.663605] [WARN ] [MAIN ] GIL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:11:19.663930] [INFO ] [MAIN ] GIL: Wiping existing primary data before full refresh. [2025-10-02T19:11:19.664047] [INFO ] [LOCAL ] GIL: Starting deletion of primary data. [2025-10-02T19:11:19.665556] [DEBUG] [LOCAL ] GIL: Deleted primary data file. [2025-10-02T19:11:19.665620] [INFO ] [MAIN ] GIL: Starting full primary refresh. [2025-10-02T19:11:20.050849] [INFO ] [REMOTE ] GIL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:11:20.272992] [INFO ] [REMOTE ] GIC: Fetching primary data for 2024-12. [2025-10-02T19:11:20.866719] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-02T19:11:21.073073] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-03. [2025-10-02T19:11:21.321442] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-02T19:11:21.873037] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-10. [2025-10-02T19:11:22.558942] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-02T19:11:22.662994] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-02T19:11:22.664320] [INFO ] [REMOTE ] GHY: Full fetch complete (32266 records). [2025-10-02T19:11:22.664397] [DEBUG] [VALIDATOR ] GHY: Validating primary data. [2025-10-02T19:11:22.678150] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-01. [2025-10-02T19:11:23.117602] [DEBUG] [VALIDATOR ] GHY: All expected trading days are present. [2025-10-02T19:11:23.117714] [DEBUG] [VALIDATOR ] GHY: Primary data validation passed. [2025-10-02T19:11:23.118354] [INFO ] [MAIN ] GHY: Fetched primary data is valid. [2025-10-02T19:11:23.118416] [DEBUG] [LOCAL ] GHY: Saving primary data. [2025-10-02T19:11:23.119240] [DEBUG] [LOCAL ] GHY: Trimmed 32266 records to 20989 (keeping 200 days of data) [2025-10-02T19:11:23.250430] [DEBUG] [LOCAL ] GHY: Primary data saved (20989 records). [2025-10-02T19:11:23.250557] [INFO ] [MAIN ] GHY: Full history saved. [2025-10-02T19:11:23.250638] [INFO ] [MAIN ] Update Progress: 934/2370 symbols completed. GHY took 35.9s. Estimated remaining: 3h 21m 54s. Rate: 7.1 symbols/min [2025-10-02T19:11:23.444230] [INFO ] [MAIN ] GIS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:11:23.476818] [INFO ] [REMOTE ] GIL: Fetching primary data for 2024-12. [2025-10-02T19:11:23.503134] [DEBUG] [LOCAL ] GIS: Loaded 53672 existing records from primary storage. [2025-10-02T19:11:23.503499] [INFO ] [MAIN ] GIS: Loaded 53672 existing records. [2025-10-02T19:11:23.706187] [WARN ] [MAIN ] GIS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:11:23.706492] [INFO ] [MAIN ] GIS: Wiping existing primary data before full refresh. [2025-10-02T19:11:23.706568] [INFO ] [LOCAL ] GIS: Starting deletion of primary data. [2025-10-02T19:11:23.708442] [DEBUG] [LOCAL ] GIS: Deleted primary data file. [2025-10-02T19:11:23.708539] [INFO ] [MAIN ] GIS: Starting full primary refresh. [2025-10-02T19:11:23.819065] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-02T19:11:24.137706] [INFO ] [REMOTE ] GIS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:11:24.273043] [INFO ] [REMOTE ] GIS: Fetching primary data for 2024-12. [2025-10-02T19:11:24.889052] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-02T19:11:25.073028] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-02. [2025-10-02T19:11:25.872981] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-04. [2025-10-02T19:11:25.964602] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-02T19:11:26.231241] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-02T19:11:26.673049] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-03. [2025-10-02T19:11:27.328005] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-02T19:11:27.473016] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-01. [2025-10-02T19:11:27.597469] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-02T19:11:28.272989] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-05. [2025-10-02T19:11:29.073010] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-01. [2025-10-02T19:11:29.660859] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-02T19:11:29.699471] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-02T19:11:29.873019] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-04. [2025-10-02T19:11:30.610073] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-02T19:11:30.673025] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-06. [2025-10-02T19:11:30.891058] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-02T19:11:31.472996] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-02. [2025-10-02T19:11:32.023598] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-02T19:11:32.273002] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-02. [2025-10-02T19:11:32.887500] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-02T19:11:33.072995] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-03. [2025-10-02T19:11:33.872983] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-05. [2025-10-02T19:11:34.022940] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-02T19:11:34.672971] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-03. [2025-10-02T19:11:34.711762] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-02T19:11:34.730841] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-02T19:11:35.473014] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-04. [2025-10-02T19:11:36.272988] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-07. [2025-10-02T19:11:36.470132] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-02T19:11:37.073010] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-04. [2025-10-02T19:11:37.167971] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-02T19:11:37.546403] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-02T19:11:37.872999] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-06. [2025-10-02T19:11:38.654082] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-02T19:11:38.672958] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-07. [2025-10-02T19:11:39.137968] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-02T19:11:39.320290] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-02T19:11:39.472996] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-05. [2025-10-02T19:11:40.272991] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-08. [2025-10-02T19:11:41.073016] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-05. [2025-10-02T19:11:41.452388] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-02T19:11:41.770426] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-02T19:11:41.873001] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-09. [2025-10-02T19:11:42.456159] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-02T19:11:42.673029] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-06. [2025-10-02T19:11:43.297235] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-02T19:11:43.473042] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-06. [2025-10-02T19:11:44.273034] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-10. [2025-10-02T19:11:44.565284] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-02T19:11:45.010455] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-02T19:11:45.073013] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-07. [2025-10-02T19:11:45.458628] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-02T19:11:45.460224] [INFO ] [REMOTE ] GIB: Full fetch complete (45769 records). [2025-10-02T19:11:45.460313] [DEBUG] [VALIDATOR ] GIB: Validating primary data. [2025-10-02T19:11:45.879022] [DEBUG] [VALIDATOR ] GIB: All expected trading days are present. [2025-10-02T19:11:45.878228] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-07. [2025-10-02T19:11:45.879135] [DEBUG] [VALIDATOR ] GIB: Primary data validation passed. [2025-10-02T19:11:45.880811] [INFO ] [MAIN ] GIB: Fetched primary data is valid. [2025-10-02T19:11:45.880884] [DEBUG] [LOCAL ] GIB: Saving primary data. [2025-10-02T19:11:45.882139] [DEBUG] [LOCAL ] GIB: Trimmed 45769 records to 32317 (keeping 200 days of data) [2025-10-02T19:11:46.091590] [DEBUG] [LOCAL ] GIB: Primary data saved (32317 records). [2025-10-02T19:11:46.091771] [INFO ] [MAIN ] GIB: Full history saved. [2025-10-02T19:11:46.091872] [INFO ] [MAIN ] Update Progress: 935/2370 symbols completed. GIB took 42.4s. Estimated remaining: 3h 22m 8s. Rate: 7.1 symbols/min [2025-10-02T19:11:46.275345] [INFO ] [MAIN ] GKOS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:11:46.315880] [DEBUG] [LOCAL ] GKOS: Loaded 42661 existing records from primary storage. [2025-10-02T19:11:46.316191] [INFO ] [MAIN ] GKOS: Loaded 42661 existing records. [2025-10-02T19:11:46.507195] [WARN ] [MAIN ] GKOS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:11:46.507447] [INFO ] [MAIN ] GKOS: Wiping existing primary data before full refresh. [2025-10-02T19:11:46.507507] [INFO ] [LOCAL ] GKOS: Starting deletion of primary data. [2025-10-02T19:11:46.511909] [DEBUG] [LOCAL ] GKOS: Deleted primary data file. [2025-10-02T19:11:46.512028] [INFO ] [MAIN ] GKOS: Starting full primary refresh. [2025-10-02T19:11:46.682973] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-08. [2025-10-02T19:11:46.957967] [INFO ] [REMOTE ] GKOS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:11:47.234548] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-02T19:11:47.472975] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2024-12. [2025-10-02T19:11:47.573680] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-02T19:11:47.816629] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-02T19:11:48.272988] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-08. [2025-10-02T19:11:48.610747] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-02T19:11:49.072995] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-09. [2025-10-02T19:11:49.825685] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-02T19:11:49.865004] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-02T19:11:49.872961] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-10. [2025-10-02T19:11:50.512155] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-02T19:11:50.513127] [INFO ] [REMOTE ] GIC: Full fetch complete (20185 records). [2025-10-02T19:11:50.513299] [DEBUG] [VALIDATOR ] GIC: Validating primary data. [2025-10-02T19:11:50.678158] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-09. [2025-10-02T19:11:50.925997] [DEBUG] [VALIDATOR ] GIC: All expected trading days are present. [2025-10-02T19:11:50.926087] [DEBUG] [VALIDATOR ] GIC: Primary data validation passed. [2025-10-02T19:11:50.926552] [INFO ] [MAIN ] GIC: Fetched primary data is valid. [2025-10-02T19:11:50.926597] [DEBUG] [LOCAL ] GIC: Saving primary data. [2025-10-02T19:11:50.927219] [DEBUG] [LOCAL ] GIC: Trimmed 20185 records to 13577 (keeping 200 days of data) [2025-10-02T19:11:51.012488] [DEBUG] [LOCAL ] GIC: Primary data saved (13577 records). [2025-10-02T19:11:51.012631] [INFO ] [MAIN ] GIC: Full history saved. [2025-10-02T19:11:51.012769] [INFO ] [MAIN ] Update Progress: 936/2370 symbols completed. GIC took 36.2s. Estimated remaining: 3h 21m 54s. Rate: 7.1 symbols/min [2025-10-02T19:11:51.197552] [INFO ] [MAIN ] GL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:11:51.239335] [DEBUG] [LOCAL ] GL: Loaded 37783 existing records from primary storage. [2025-10-02T19:11:51.239701] [INFO ] [MAIN ] GL: Loaded 37783 existing records. [2025-10-02T19:11:51.430977] [WARN ] [MAIN ] GL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:11:51.431189] [INFO ] [MAIN ] GL: Wiping existing primary data before full refresh. [2025-10-02T19:11:51.431239] [INFO ] [LOCAL ] GL: Starting deletion of primary data. [2025-10-02T19:11:51.432188] [DEBUG] [LOCAL ] GL: Deleted primary data file. [2025-10-02T19:11:51.432251] [INFO ] [MAIN ] GL: Starting full primary refresh. [2025-10-02T19:11:51.478084] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-01. [2025-10-02T19:11:51.837979] [INFO ] [REMOTE ] GL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:11:52.278194] [INFO ] [REMOTE ] GL: Fetching primary data for 2024-12. [2025-10-02T19:11:52.291059] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-02T19:11:52.921475] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-02T19:11:53.073070] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-02. [2025-10-02T19:11:53.705109] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-02T19:11:53.873002] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-10. [2025-10-02T19:11:54.576833] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-02T19:11:54.673044] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-08. [2025-10-02T19:11:55.295816] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-02T19:11:55.298089] [INFO ] [REMOTE ] GIL: Full fetch complete (61480 records). [2025-10-02T19:11:55.298324] [DEBUG] [VALIDATOR ] GIL: Validating primary data. [2025-10-02T19:11:55.475006] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-01. [2025-10-02T19:11:55.747365] [DEBUG] [VALIDATOR ] GIL: All expected trading days are present. [2025-10-02T19:11:55.747462] [DEBUG] [VALIDATOR ] GIL: Primary data validation passed. [2025-10-02T19:11:55.748352] [INFO ] [MAIN ] GIL: Fetched primary data is valid. [2025-10-02T19:11:55.748426] [DEBUG] [LOCAL ] GIL: Saving primary data. [2025-10-02T19:11:55.749789] [DEBUG] [LOCAL ] GIL: Trimmed 61480 records to 43689 (keeping 200 days of data) [2025-10-02T19:11:56.031896] [DEBUG] [LOCAL ] GIL: Primary data saved (43689 records). [2025-10-02T19:11:56.032050] [INFO ] [MAIN ] GIL: Full history saved. [2025-10-02T19:11:56.032705] [INFO ] [MAIN ] Update Progress: 937/2370 symbols completed. GIL took 36.8s. Estimated remaining: 3h 21m 41s. Rate: 7.1 symbols/min [2025-10-02T19:11:56.273966] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-03. [2025-10-02T19:11:56.275881] [INFO ] [MAIN ] GLOB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:11:56.330225] [DEBUG] [LOCAL ] GLOB: Loaded 47585 existing records from primary storage. [2025-10-02T19:11:56.330583] [INFO ] [MAIN ] GLOB: Loaded 47585 existing records. [2025-10-02T19:11:56.587157] [WARN ] [MAIN ] GLOB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:11:56.587589] [INFO ] [MAIN ] GLOB: Wiping existing primary data before full refresh. [2025-10-02T19:11:56.587791] [INFO ] [LOCAL ] GLOB: Starting deletion of primary data. [2025-10-02T19:11:56.589516] [DEBUG] [LOCAL ] GLOB: Deleted primary data file. [2025-10-02T19:11:56.589594] [INFO ] [MAIN ] GLOB: Starting full primary refresh. [2025-10-02T19:11:56.955807] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-10-02T19:11:57.079729] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-09. [2025-10-02T19:11:57.086521] [INFO ] [REMOTE ] GLOB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:11:57.165267] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-02T19:11:57.870139] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-02T19:11:57.879007] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2024-12. [2025-10-02T19:11:58.672998] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-04. [2025-10-02T19:11:58.844024] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-02T19:11:59.302298] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-02T19:11:59.472991] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-01. [2025-10-02T19:12:00.272980] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-10. [2025-10-02T19:12:00.381485] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-02T19:12:01.073023] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-05. [2025-10-02T19:12:01.304303] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-02T19:12:01.873027] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-02. [2025-10-02T19:12:02.187942] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-02T19:12:02.190581] [INFO ] [REMOTE ] GIS: Full fetch complete (77653 records). [2025-10-02T19:12:02.190766] [DEBUG] [VALIDATOR ] GIS: Validating primary data. [2025-10-02T19:12:02.646977] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-02T19:12:02.685502] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-02. [2025-10-02T19:12:02.720871] [DEBUG] [VALIDATOR ] GIS: All expected trading days are present. [2025-10-02T19:12:02.720997] [DEBUG] [VALIDATOR ] GIS: Primary data validation passed. [2025-10-02T19:12:02.722660] [INFO ] [MAIN ] GIS: Fetched primary data is valid. [2025-10-02T19:12:02.722805] [DEBUG] [LOCAL ] GIS: Saving primary data. [2025-10-02T19:12:02.724764] [DEBUG] [LOCAL ] GIS: Trimmed 77653 records to 54062 (keeping 200 days of data) [2025-10-02T19:12:03.078686] [DEBUG] [LOCAL ] GIS: Primary data saved (54062 records). [2025-10-02T19:12:03.078834] [INFO ] [MAIN ] GIS: Full history saved. [2025-10-02T19:12:03.078963] [INFO ] [MAIN ] Update Progress: 938/2370 symbols completed. GIS took 39.8s. Estimated remaining: 3h 21m 30s. Rate: 7.1 symbols/min [2025-10-02T19:12:03.279275] [INFO ] [MAIN ] GLP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:12:03.290522] [DEBUG] [LOCAL ] GLP: Loaded 9351 existing records from primary storage. [2025-10-02T19:12:03.290763] [INFO ] [MAIN ] GLP: Loaded 9351 existing records. [2025-10-02T19:12:03.484306] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-06. [2025-10-02T19:12:03.512315] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-02T19:12:03.510728] [WARN ] [MAIN ] GLP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:12:03.521908] [INFO ] [MAIN ] GLP: Wiping existing primary data before full refresh. [2025-10-02T19:12:03.522350] [INFO ] [LOCAL ] GLP: Starting deletion of primary data. [2025-10-02T19:12:03.522869] [DEBUG] [LOCAL ] GLP: Deleted primary data file. [2025-10-02T19:12:03.523324] [INFO ] [MAIN ] GLP: Starting full primary refresh. [2025-10-02T19:12:03.925131] [INFO ] [REMOTE ] GLP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:12:03.951252] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-02T19:12:04.273011] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-03. [2025-10-02T19:12:05.021860] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-02T19:12:05.072990] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-07. [2025-10-02T19:12:05.873011] [INFO ] [REMOTE ] GLP: Fetching primary data for 2024-12. [2025-10-02T19:12:05.910310] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-02T19:12:06.672978] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-04. [2025-10-02T19:12:06.724820] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-02T19:12:06.824436] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-02T19:12:07.472999] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-01. [2025-10-02T19:12:08.281835] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-03. [2025-10-02T19:12:08.305256] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-02T19:12:08.323783] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-02T19:12:09.072986] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-02. [2025-10-02T19:12:09.859755] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-02T19:12:09.872970] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-04. [2025-10-02T19:12:09.895877] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-02T19:12:10.673056] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-03. [2025-10-02T19:12:11.220391] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-02T19:12:11.459087] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-02T19:12:11.472983] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-05. [2025-10-02T19:12:12.273050] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-04. [2025-10-02T19:12:12.381353] [DEBUG] [REMOTE ] GLP: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-10-02T19:12:12.381704] [WARN ] [REMOTE ] GLP: No data returned for month 2025-04 [2025-10-02T19:12:12.381807] [FATAL] [REMOTE ] GLP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T19:12:12.381902] [FATAL] [MAIN ] GLP: Failed to fetch primary data. [2025-10-02T19:12:12.381975] [WARN ] [MAIN ] GLP: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T19:12:12.382069] [INFO ] [LOCAL ] GLP: Starting deletion of primary data. [2025-10-02T19:12:12.382147] [DEBUG] [LOCAL ] GLP: No primary data file found to delete. [2025-10-02T19:12:12.382186] [INFO ] [LOCAL ] GLP: Starting deletion of derivative data. [2025-10-02T19:12:12.382636] [DEBUG] [LOCAL ] GLP: Deleted derivative data file. [2025-10-02T19:12:12.382758] [INFO ] [MAIN ] Update Progress: 939/2370 symbols completed. GLP took 9.3s. Estimated remaining: 3h 21m 23s. Rate: 7.1 symbols/min [2025-10-02T19:12:12.556472] [INFO ] [MAIN ] GLW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:12:12.617307] [DEBUG] [LOCAL ] GLW: Loaded 53636 existing records from primary storage. [2025-10-02T19:12:12.617894] [INFO ] [MAIN ] GLW: Loaded 53636 existing records. [2025-10-02T19:12:12.834572] [WARN ] [MAIN ] GLW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:12:12.834856] [INFO ] [MAIN ] GLW: Wiping existing primary data before full refresh. [2025-10-02T19:12:12.834916] [INFO ] [LOCAL ] GLW: Starting deletion of primary data. [2025-10-02T19:12:12.836599] [DEBUG] [LOCAL ] GLW: Deleted primary data file. [2025-10-02T19:12:12.836691] [INFO ] [MAIN ] GLW: Starting full primary refresh. [2025-10-02T19:12:13.078105] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-08. [2025-10-02T19:12:13.214237] [INFO ] [REMOTE ] GLW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:12:13.249688] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-02T19:12:13.873057] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-05. [2025-10-02T19:12:14.669496] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-02T19:12:14.678037] [INFO ] [REMOTE ] GLW: Fetching primary data for 2024-12. [2025-10-02T19:12:15.473381] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-09. [2025-10-02T19:12:15.473287] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-02T19:12:16.272997] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-06. [2025-10-02T19:12:16.647002] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-02T19:12:17.038064] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-02T19:12:17.072968] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-10. [2025-10-02T19:12:17.787673] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-02T19:12:17.873029] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-01. [2025-10-02T19:12:18.606336] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-02T19:12:18.608705] [INFO ] [REMOTE ] GKOS: Full fetch complete (60032 records). [2025-10-02T19:12:18.608864] [DEBUG] [VALIDATOR ] GKOS: Validating primary data. [2025-10-02T19:12:18.678160] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-07. [2025-10-02T19:12:19.040566] [DEBUG] [VALIDATOR ] GKOS: All expected trading days are present. [2025-10-02T19:12:19.040724] [DEBUG] [VALIDATOR ] GKOS: Primary data validation passed. [2025-10-02T19:12:19.041900] [INFO ] [MAIN ] GKOS: Fetched primary data is valid. [2025-10-02T19:12:19.041977] [DEBUG] [LOCAL ] GKOS: Saving primary data. [2025-10-02T19:12:19.043993] [DEBUG] [LOCAL ] GKOS: Trimmed 60032 records to 42984 (keeping 200 days of data) [2025-10-02T19:12:19.317367] [DEBUG] [LOCAL ] GKOS: Primary data saved (42984 records). [2025-10-02T19:12:19.317555] [INFO ] [MAIN ] GKOS: Full history saved. [2025-10-02T19:12:19.317695] [INFO ] [MAIN ] Update Progress: 940/2370 symbols completed. GKOS took 33.2s. Estimated remaining: 3h 21m 12s. Rate: 7.1 symbols/min [2025-10-02T19:12:19.475108] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-06. [2025-10-02T19:12:19.497296] [INFO ] [MAIN ] GM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:12:19.545077] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-02T19:12:19.608482] [DEBUG] [LOCAL ] GM: Loaded 53728 existing records from primary storage. [2025-10-02T19:12:19.609017] [INFO ] [MAIN ] GM: Loaded 53728 existing records. [2025-10-02T19:12:19.789960] [WARN ] [MAIN ] GM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:12:19.790283] [INFO ] [MAIN ] GM: Wiping existing primary data before full refresh. [2025-10-02T19:12:19.790339] [INFO ] [LOCAL ] GM: Starting deletion of primary data. [2025-10-02T19:12:19.792311] [DEBUG] [LOCAL ] GM: Deleted primary data file. [2025-10-02T19:12:19.792378] [INFO ] [MAIN ] GM: Starting full primary refresh. [2025-10-02T19:12:20.174615] [INFO ] [REMOTE ] GM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:12:20.273009] [INFO ] [REMOTE ] GM: Fetching primary data for 2024-12. [2025-10-02T19:12:20.332436] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-02T19:12:21.072979] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-08. [2025-10-02T19:12:21.185464] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-02T19:12:21.873087] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-07. [2025-10-02T19:12:22.517606] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-02T19:12:22.565453] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-10-02T19:12:22.673012] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-09. [2025-10-02T19:12:23.478241] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-02. [2025-10-02T19:12:23.505260] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-02T19:12:24.007326] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-02T19:12:24.273026] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-01. [2025-10-02T19:12:25.073056] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-10. [2025-10-02T19:12:25.306927] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-02T19:12:25.872982] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-03. [2025-10-02T19:12:25.982525] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-02T19:12:26.299577] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-02T19:12:26.301826] [INFO ] [REMOTE ] GL: Full fetch complete (55420 records). [2025-10-02T19:12:26.302001] [DEBUG] [VALIDATOR ] GL: Validating primary data. [2025-10-02T19:12:26.675979] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-02. [2025-10-02T19:12:26.736583] [DEBUG] [VALIDATOR ] GL: All expected trading days are present. [2025-10-02T19:12:26.736812] [DEBUG] [VALIDATOR ] GL: Primary data validation passed. [2025-10-02T19:12:26.738897] [INFO ] [MAIN ] GL: Fetched primary data is valid. [2025-10-02T19:12:26.739020] [DEBUG] [LOCAL ] GL: Saving primary data. [2025-10-02T19:12:26.741393] [DEBUG] [LOCAL ] GL: Trimmed 55420 records to 38054 (keeping 200 days of data) [2025-10-02T19:12:27.030491] [DEBUG] [LOCAL ] GL: Primary data saved (38054 records). [2025-10-02T19:12:27.030761] [INFO ] [MAIN ] GL: Full history saved. [2025-10-02T19:12:27.030925] [INFO ] [MAIN ] Update Progress: 941/2370 symbols completed. GL took 36.0s. Estimated remaining: 3h 21m 3s. Rate: 7.1 symbols/min [2025-10-02T19:12:27.215634] [INFO ] [MAIN ] GME: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:12:27.273268] [DEBUG] [LOCAL ] GME: Loaded 53762 existing records from primary storage. [2025-10-02T19:12:27.273770] [INFO ] [MAIN ] GME: Loaded 53762 existing records. [2025-10-02T19:12:27.460689] [WARN ] [MAIN ] GME: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:12:27.461121] [INFO ] [MAIN ] GME: Wiping existing primary data before full refresh. [2025-10-02T19:12:27.461186] [INFO ] [LOCAL ] GME: Starting deletion of primary data. [2025-10-02T19:12:27.463397] [DEBUG] [LOCAL ] GME: Deleted primary data file. [2025-10-02T19:12:27.463460] [INFO ] [MAIN ] GME: Starting full primary refresh. [2025-10-02T19:12:27.495336] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-08. [2025-10-02T19:12:27.844302] [INFO ] [REMOTE ] GME: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:12:27.890570] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-02T19:12:28.273011] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-04. [2025-10-02T19:12:28.737916] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-02T19:12:29.072989] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-03. [2025-10-02T19:12:29.279561] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-02T19:12:29.872993] [INFO ] [REMOTE ] GME: Fetching primary data for 2024-12. [2025-10-02T19:12:29.917631] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-02T19:12:30.672994] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-05. [2025-10-02T19:12:31.241259] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-02T19:12:31.473047] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-09. [2025-10-02T19:12:32.272995] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-04. [2025-10-02T19:12:32.350494] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-02T19:12:32.500855] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2024-12 (2.63 seconds). [2025-10-02T19:12:33.072995] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-06. [2025-10-02T19:12:33.259749] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-02T19:12:33.873132] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-01. [2025-10-02T19:12:34.483753] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-02T19:12:34.673009] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-05. [2025-10-02T19:12:34.877751] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-02T19:12:35.473005] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-07. [2025-10-02T19:12:36.272974] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-10. [2025-10-02T19:12:36.407116] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-01 (2.53 seconds). [2025-10-02T19:12:36.536532] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-02T19:12:37.072999] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-02. [2025-10-02T19:12:37.448616] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-02T19:12:37.565668] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-02T19:12:37.567965] [INFO ] [REMOTE ] GLOB: Full fetch complete (64177 records). [2025-10-02T19:12:37.568115] [DEBUG] [VALIDATOR ] GLOB: Validating primary data. [2025-10-02T19:12:37.878245] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-08. [2025-10-02T19:12:38.002091] [DEBUG] [VALIDATOR ] GLOB: All expected trading days are present. [2025-10-02T19:12:38.002187] [DEBUG] [VALIDATOR ] GLOB: Primary data validation passed. [2025-10-02T19:12:38.003045] [INFO ] [MAIN ] GLOB: Fetched primary data is valid. [2025-10-02T19:12:38.003122] [DEBUG] [LOCAL ] GLOB: Saving primary data. [2025-10-02T19:12:38.004548] [DEBUG] [LOCAL ] GLOB: Trimmed 64177 records to 47963 (keeping 200 days of data) [2025-10-02T19:12:38.308459] [DEBUG] [LOCAL ] GLOB: Primary data saved (47963 records). [2025-10-02T19:12:38.308725] [INFO ] [MAIN ] GLOB: Full history saved. [2025-10-02T19:12:38.309950] [INFO ] [MAIN ] Update Progress: 942/2370 symbols completed. GLOB took 42.3s. Estimated remaining: 3h 20m 58s. Rate: 7.1 symbols/min [2025-10-02T19:12:38.505563] [INFO ] [MAIN ] GMED: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:12:38.568701] [DEBUG] [LOCAL ] GMED: Loaded 48332 existing records from primary storage. [2025-10-02T19:12:38.569108] [INFO ] [MAIN ] GMED: Loaded 48332 existing records. [2025-10-02T19:12:38.678234] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-06. [2025-10-02T19:12:38.799160] [WARN ] [MAIN ] GMED: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:12:38.799369] [INFO ] [MAIN ] GMED: Wiping existing primary data before full refresh. [2025-10-02T19:12:38.799418] [INFO ] [LOCAL ] GMED: Starting deletion of primary data. [2025-10-02T19:12:38.801049] [DEBUG] [LOCAL ] GMED: Deleted primary data file. [2025-10-02T19:12:38.801123] [INFO ] [MAIN ] GMED: Starting full primary refresh. [2025-10-02T19:12:39.189169] [INFO ] [REMOTE ] GMED: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:12:39.227242] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-10-02T19:12:39.472983] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-03. [2025-10-02T19:12:39.611147] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-02T19:12:40.272991] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-09. [2025-10-02T19:12:40.448000] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-02T19:12:41.072998] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-07. [2025-10-02T19:12:41.873023] [INFO ] [REMOTE ] GMED: Fetching primary data for 2024-12. [2025-10-02T19:12:42.023613] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-03 (2.55 seconds). [2025-10-02T19:12:42.092756] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-02T19:12:42.673050] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-10. [2025-10-02T19:12:43.277295] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-02T19:12:43.436580] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-02T19:12:43.472955] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-01. [2025-10-02T19:12:44.272983] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-04. [2025-10-02T19:12:44.525773] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-02T19:12:44.529054] [INFO ] [REMOTE ] GLW: Full fetch complete (77618 records). [2025-10-02T19:12:44.529217] [DEBUG] [VALIDATOR ] GLW: Validating primary data. [2025-10-02T19:12:44.990884] [DEBUG] [VALIDATOR ] GLW: All expected trading days are present. [2025-10-02T19:12:44.991004] [DEBUG] [VALIDATOR ] GLW: Primary data validation passed. [2025-10-02T19:12:44.992210] [INFO ] [MAIN ] GLW: Fetched primary data is valid. [2025-10-02T19:12:44.992310] [DEBUG] [LOCAL ] GLW: Saving primary data. [2025-10-02T19:12:44.994772] [DEBUG] [LOCAL ] GLW: Trimmed 77618 records to 54026 (keeping 200 days of data) [2025-10-02T19:12:45.092893] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-08. [2025-10-02T19:12:45.129614] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-02T19:12:45.408258] [DEBUG] [LOCAL ] GLW: Primary data saved (54026 records). [2025-10-02T19:12:45.408504] [INFO ] [MAIN ] GLW: Full history saved. [2025-10-02T19:12:45.408669] [INFO ] [MAIN ] Update Progress: 943/2370 symbols completed. GLW took 33.0s. Estimated remaining: 3h 20m 48s. Rate: 7.1 symbols/min [2025-10-02T19:12:45.603980] [INFO ] [MAIN ] GMRE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:12:45.644316] [DEBUG] [LOCAL ] GMRE: Loaded 37396 existing records from primary storage. [2025-10-02T19:12:45.644712] [INFO ] [MAIN ] GMRE: Loaded 37396 existing records. [2025-10-02T19:12:45.852113] [WARN ] [MAIN ] GMRE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:12:45.852356] [INFO ] [MAIN ] GMRE: Wiping existing primary data before full refresh. [2025-10-02T19:12:45.852417] [INFO ] [LOCAL ] GMRE: Starting deletion of primary data. [2025-10-02T19:12:45.853971] [DEBUG] [LOCAL ] GMRE: Deleted primary data file. [2025-10-02T19:12:45.854037] [INFO ] [MAIN ] GMRE: Starting full primary refresh. [2025-10-02T19:12:45.888711] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-02. [2025-10-02T19:12:46.272332] [INFO ] [REMOTE ] GMRE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:12:46.673043] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2024-12. [2025-10-02T19:12:46.826408] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-04 (2.55 seconds). [2025-10-02T19:12:47.106833] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-02T19:12:47.473001] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-09. [2025-10-02T19:12:47.620687] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-02T19:12:47.779122] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-02T19:12:48.272996] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-01. [2025-10-02T19:12:49.072988] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-05. [2025-10-02T19:12:49.516543] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-02T19:12:49.721523] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-02T19:12:49.873047] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-03. [2025-10-02T19:12:50.673031] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-02. [2025-10-02T19:12:51.472967] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-10. [2025-10-02T19:12:51.581389] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-10-02T19:12:51.646454] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-02T19:12:51.983758] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-02T19:12:52.273051] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-03. [2025-10-02T19:12:53.072979] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-06. [2025-10-02T19:12:53.236974] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-02T19:12:53.239174] [INFO ] [REMOTE ] GM: Full fetch complete (77821 records). [2025-10-02T19:12:53.239293] [DEBUG] [VALIDATOR ] GM: Validating primary data. [2025-10-02T19:12:53.737165] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-02T19:12:53.741876] [DEBUG] [VALIDATOR ] GM: All expected trading days are present. [2025-10-02T19:12:53.749962] [DEBUG] [VALIDATOR ] GM: Primary data validation passed. [2025-10-02T19:12:53.751421] [INFO ] [MAIN ] GM: Fetched primary data is valid. [2025-10-02T19:12:53.751505] [DEBUG] [LOCAL ] GM: Saving primary data. [2025-10-02T19:12:53.753112] [DEBUG] [LOCAL ] GM: Trimmed 77821 records to 54118 (keeping 200 days of data) [2025-10-02T19:12:53.873119] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-04. [2025-10-02T19:12:54.142631] [DEBUG] [LOCAL ] GM: Primary data saved (54118 records). [2025-10-02T19:12:54.142804] [INFO ] [MAIN ] GM: Full history saved. [2025-10-02T19:12:54.142928] [INFO ] [MAIN ] Update Progress: 944/2370 symbols completed. GM took 34.8s. Estimated remaining: 3h 20m 40s. Rate: 7.1 symbols/min [2025-10-02T19:12:54.333430] [INFO ] [MAIN ] GNE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:12:54.353683] [DEBUG] [LOCAL ] GNE: Loaded 17835 existing records from primary storage. [2025-10-02T19:12:54.353999] [INFO ] [MAIN ] GNE: Loaded 17835 existing records. [2025-10-02T19:12:54.551133] [WARN ] [MAIN ] GNE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:12:54.551382] [INFO ] [MAIN ] GNE: Wiping existing primary data before full refresh. [2025-10-02T19:12:54.551429] [INFO ] [LOCAL ] GNE: Starting deletion of primary data. [2025-10-02T19:12:54.552238] [DEBUG] [LOCAL ] GNE: Deleted primary data file. [2025-10-02T19:12:54.552336] [INFO ] [MAIN ] GNE: Starting full primary refresh. [2025-10-02T19:12:54.678106] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-04. [2025-10-02T19:12:54.953894] [INFO ] [REMOTE ] GNE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:12:55.298463] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-10-02T19:12:55.472992] [INFO ] [REMOTE ] GNE: Fetching primary data for 2024-12. [2025-10-02T19:12:55.620160] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-02T19:12:55.936873] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-02T19:12:56.272989] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-05. [2025-10-02T19:12:56.343490] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-02T19:12:57.073017] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-01. [2025-10-02T19:12:57.516388] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-02T19:12:57.847320] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-02T19:12:57.872959] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-07. [2025-10-02T19:12:58.673007] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-02. [2025-10-02T19:12:59.464249] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-02T19:12:59.472955] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-03. [2025-10-02T19:13:00.273002] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-02T19:13:00.273079] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-05. [2025-10-02T19:13:00.559950] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-07 (2.69 seconds). [2025-10-02T19:13:01.073021] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-08. [2025-10-02T19:13:01.882166] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-04. [2025-10-02T19:13:01.908159] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-02T19:13:02.673000] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-06. [2025-10-02T19:13:02.738725] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-02T19:13:03.472988] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-05. [2025-10-02T19:13:03.572941] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-08 (2.50 seconds). [2025-10-02T19:13:03.795213] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-02T19:13:04.054135] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-02T19:13:04.273021] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-09. [2025-10-02T19:13:05.073048] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-06. [2025-10-02T19:13:05.873048] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-06. [2025-10-02T19:13:06.628930] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-02T19:13:06.672976] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-07. [2025-10-02T19:13:06.765397] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-09 (2.49 seconds). [2025-10-02T19:13:07.158731] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-02T19:13:07.473047] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-07. [2025-10-02T19:13:08.185369] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-02T19:13:08.273045] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-07. [2025-10-02T19:13:08.531270] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-02T19:13:09.073023] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-08. [2025-10-02T19:13:09.873059] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-10. [2025-10-02T19:13:10.028756] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-02T19:13:10.055041] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-02T19:13:10.672995] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-09. [2025-10-02T19:13:11.443968] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-02T19:13:11.472964] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-08. [2025-10-02T19:13:11.926721] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-02T19:13:11.929926] [INFO ] [REMOTE ] GME: Full fetch complete (77920 records). [2025-10-02T19:13:11.930061] [DEBUG] [VALIDATOR ] GME: Validating primary data. [2025-10-02T19:13:12.278118] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-08. [2025-10-02T19:13:12.364870] [DEBUG] [VALIDATOR ] GME: All expected trading days are present. [2025-10-02T19:13:12.364957] [DEBUG] [VALIDATOR ] GME: Primary data validation passed. [2025-10-02T19:13:12.366058] [INFO ] [MAIN ] GME: Fetched primary data is valid. [2025-10-02T19:13:12.366183] [DEBUG] [LOCAL ] GME: Saving primary data. [2025-10-02T19:13:12.367857] [DEBUG] [LOCAL ] GME: Trimmed 77920 records to 54152 (keeping 200 days of data) [2025-10-02T19:13:12.645627] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-02T19:13:12.779768] [DEBUG] [LOCAL ] GME: Primary data saved (54152 records). [2025-10-02T19:13:12.779906] [INFO ] [MAIN ] GME: Full history saved. [2025-10-02T19:13:12.780046] [INFO ] [MAIN ] Update Progress: 945/2370 symbols completed. GME took 45.7s. Estimated remaining: 3h 20m 47s. Rate: 7.1 symbols/min [2025-10-02T19:13:12.971136] [INFO ] [MAIN ] GNK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:13:13.014042] [DEBUG] [LOCAL ] GNK: Loaded 40264 existing records from primary storage. [2025-10-02T19:13:13.014430] [INFO ] [MAIN ] GNK: Loaded 40264 existing records. [2025-10-02T19:13:13.079273] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-09. [2025-10-02T19:13:13.202913] [WARN ] [MAIN ] GNK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:13:13.203188] [INFO ] [MAIN ] GNK: Wiping existing primary data before full refresh. [2025-10-02T19:13:13.203238] [INFO ] [LOCAL ] GNK: Starting deletion of primary data. [2025-10-02T19:13:13.204459] [DEBUG] [LOCAL ] GNK: Deleted primary data file. [2025-10-02T19:13:13.204522] [INFO ] [MAIN ] GNK: Starting full primary refresh. [2025-10-02T19:13:13.600455] [INFO ] [REMOTE ] GNK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:13:13.629262] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-02T19:13:13.872997] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-09. [2025-10-02T19:13:14.459040] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-02T19:13:14.673006] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-10. [2025-10-02T19:13:15.132890] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-02T19:13:15.473020] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-10. [2025-10-02T19:13:15.497046] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-02T19:13:15.500026] [INFO ] [REMOTE ] GNE: Full fetch complete (22478 records). [2025-10-02T19:13:15.500205] [DEBUG] [VALIDATOR ] GNE: Validating primary data. [2025-10-02T19:13:15.963245] [DEBUG] [VALIDATOR ] GNE: All expected trading days are present. [2025-10-02T19:13:15.963326] [DEBUG] [VALIDATOR ] GNE: Primary data validation passed. [2025-10-02T19:13:15.963860] [INFO ] [MAIN ] GNE: Fetched primary data is valid. [2025-10-02T19:13:15.963924] [DEBUG] [LOCAL ] GNE: Saving primary data. [2025-10-02T19:13:15.964586] [DEBUG] [LOCAL ] GNE: Trimmed 22478 records to 17926 (keeping 200 days of data) [2025-10-02T19:13:16.077240] [DEBUG] [LOCAL ] GNE: Primary data saved (17926 records). [2025-10-02T19:13:16.077381] [INFO ] [MAIN ] GNE: Full history saved. [2025-10-02T19:13:16.077464] [INFO ] [MAIN ] Update Progress: 946/2370 symbols completed. GNE took 21.9s. Estimated remaining: 3h 20m 31s. Rate: 7.1 symbols/min [2025-10-02T19:13:16.265413] [INFO ] [MAIN ] GNL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:13:16.273030] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-10. [2025-10-02T19:13:16.315801] [DEBUG] [LOCAL ] GNL: Loaded 46827 existing records from primary storage. [2025-10-02T19:13:16.316133] [INFO ] [MAIN ] GNL: Loaded 46827 existing records. [2025-10-02T19:13:16.506245] [WARN ] [MAIN ] GNL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:13:16.506466] [INFO ] [MAIN ] GNL: Wiping existing primary data before full refresh. [2025-10-02T19:13:16.506515] [INFO ] [LOCAL ] GNL: Starting deletion of primary data. [2025-10-02T19:13:16.508089] [DEBUG] [LOCAL ] GNL: Deleted primary data file. [2025-10-02T19:13:16.508171] [INFO ] [MAIN ] GNL: Starting full primary refresh. [2025-10-02T19:13:16.934853] [INFO ] [REMOTE ] GNL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:13:17.049090] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-02T19:13:17.053222] [INFO ] [REMOTE ] GMED: Full fetch complete (69679 records). [2025-10-02T19:13:17.053379] [DEBUG] [VALIDATOR ] GMED: Validating primary data. [2025-10-02T19:13:17.080762] [INFO ] [REMOTE ] GNL: Fetching primary data for 2024-12. [2025-10-02T19:13:17.508538] [DEBUG] [VALIDATOR ] GMED: All expected trading days are present. [2025-10-02T19:13:17.508634] [DEBUG] [VALIDATOR ] GMED: Primary data validation passed. [2025-10-02T19:13:17.509616] [INFO ] [MAIN ] GMED: Fetched primary data is valid. [2025-10-02T19:13:17.509711] [DEBUG] [LOCAL ] GMED: Saving primary data. [2025-10-02T19:13:17.511128] [DEBUG] [LOCAL ] GMED: Trimmed 69679 records to 48729 (keeping 200 days of data) [2025-10-02T19:13:17.731152] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-02T19:13:17.734560] [INFO ] [REMOTE ] GMRE: Full fetch complete (53331 records). [2025-10-02T19:13:17.735958] [DEBUG] [VALIDATOR ] GMRE: Validating primary data. [2025-10-02T19:13:17.874042] [INFO ] [REMOTE ] GNK: Fetching primary data for 2024-12. [2025-10-02T19:13:18.201320] [DEBUG] [VALIDATOR ] GMRE: All expected trading days are present. [2025-10-02T19:13:18.201443] [DEBUG] [VALIDATOR ] GMRE: Primary data validation passed. [2025-10-02T19:13:18.202334] [INFO ] [MAIN ] GMRE: Fetched primary data is valid. [2025-10-02T19:13:18.202425] [DEBUG] [LOCAL ] GMRE: Saving primary data. [2025-10-02T19:13:18.256138] [DEBUG] [LOCAL ] GMED: Primary data saved (48729 records). [2025-10-02T19:13:18.256541] [INFO ] [MAIN ] GMED: Full history saved. [2025-10-02T19:13:18.258769] [DEBUG] [LOCAL ] GMRE: Trimmed 53331 records to 37572 (keeping 200 days of data) [2025-10-02T19:13:18.258616] [INFO ] [MAIN ] Update Progress: 947/2370 symbols completed. GMED took 39.9s. Estimated remaining: 3h 20m 13s. Rate: 7.1 symbols/min [2025-10-02T19:13:18.544962] [INFO ] [MAIN ] GNRC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:13:18.612408] [DEBUG] [LOCAL ] GNRC: Loaded 45108 existing records from primary storage. [2025-10-02T19:13:18.612808] [INFO ] [MAIN ] GNRC: Loaded 45108 existing records. [2025-10-02T19:13:18.908946] [WARN ] [MAIN ] GNRC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:13:18.915097] [INFO ] [MAIN ] GNRC: Wiping existing primary data before full refresh. [2025-10-02T19:13:18.915266] [INFO ] [LOCAL ] GNRC: Starting deletion of primary data. [2025-10-02T19:13:18.917746] [DEBUG] [LOCAL ] GNRC: Deleted primary data file. [2025-10-02T19:13:18.918937] [INFO ] [MAIN ] GNRC: Starting full primary refresh. [2025-10-02T19:13:19.098795] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-02T19:13:19.166882] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-01. [2025-10-02T19:13:19.271992] [DEBUG] [LOCAL ] GMRE: Primary data saved (37572 records). [2025-10-02T19:13:19.298112] [INFO ] [MAIN ] GMRE: Full history saved. [2025-10-02T19:13:19.298381] [INFO ] [MAIN ] Update Progress: 948/2370 symbols completed. GMRE took 33.9s. Estimated remaining: 3h 19m 53s. Rate: 7.1 symbols/min [2025-10-02T19:13:19.506385] [INFO ] [REMOTE ] GNRC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:13:19.498920] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-02T19:13:19.514906] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2024-12. [2025-10-02T19:13:19.610495] [INFO ] [MAIN ] GNT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:13:19.621294] [DEBUG] [LOCAL ] GNT: Loaded 8141 existing records from primary storage. [2025-10-02T19:13:19.621619] [INFO ] [MAIN ] GNT: Loaded 8141 existing records. [2025-10-02T19:13:19.818777] [WARN ] [MAIN ] GNT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:13:19.819002] [INFO ] [MAIN ] GNT: Wiping existing primary data before full refresh. [2025-10-02T19:13:19.819050] [INFO ] [LOCAL ] GNT: Starting deletion of primary data. [2025-10-02T19:13:19.819452] [DEBUG] [LOCAL ] GNT: Deleted primary data file. [2025-10-02T19:13:19.819523] [INFO ] [MAIN ] GNT: Starting full primary refresh. [2025-10-02T19:13:20.203119] [INFO ] [REMOTE ] GNT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:13:20.272991] [INFO ] [REMOTE ] GNT: Fetching primary data for 2024-12. [2025-10-02T19:13:20.764042] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-02T19:13:20.865006] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-02T19:13:20.941943] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-02T19:13:21.072990] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-01. [2025-10-02T19:13:21.657804] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-02T19:13:21.872992] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-01. [2025-10-02T19:13:22.673010] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-01. [2025-10-02T19:13:23.098827] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-02T19:13:23.472996] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-02. [2025-10-02T19:13:24.191336] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-02T19:13:24.272999] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-02. [2025-10-02T19:13:24.779238] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-02T19:13:25.073002] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-02. [2025-10-02T19:13:25.576192] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-02T19:13:25.873057] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-02. [2025-10-02T19:13:26.355488] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-02T19:13:26.619634] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-02T19:13:26.673057] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-03. [2025-10-02T19:13:27.473018] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-03. [2025-10-02T19:13:28.069440] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-02T19:13:28.273022] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-03. [2025-10-02T19:13:29.024670] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-02T19:13:29.073015] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-04. [2025-10-02T19:13:29.873006] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-04. [2025-10-02T19:13:29.942569] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-02T19:13:30.621118] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-02T19:13:30.672980] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-03. [2025-10-02T19:13:31.259058] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-02T19:13:31.439538] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-02T19:13:31.472969] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-04. [2025-10-02T19:13:32.273008] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-05. [2025-10-02T19:13:33.074818] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-04. [2025-10-02T19:13:33.077733] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-02T19:13:33.456391] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-02T19:13:33.828072] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-02T19:13:33.872994] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-06. [2025-10-02T19:13:34.672998] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-05. [2025-10-02T19:13:35.279384] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-02T19:13:35.435928] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-02T19:13:35.472984] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-06. [2025-10-02T19:13:36.273038] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-05. [2025-10-02T19:13:36.290415] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-02T19:13:37.073039] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-07. [2025-10-02T19:13:37.628930] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-02T19:13:37.884675] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-05. [2025-10-02T19:13:37.891771] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-02T19:13:38.673018] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-07. [2025-10-02T19:13:39.473010] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-06. [2025-10-02T19:13:39.522318] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-02T19:13:40.256392] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-02T19:13:40.272954] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-08. [2025-10-02T19:13:41.016696] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-02T19:13:41.073006] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-06. [2025-10-02T19:13:41.801196] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-02T19:13:41.873030] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-08. [2025-10-02T19:13:42.214674] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-02T19:13:42.574719] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-02T19:13:42.673021] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-07. [2025-10-02T19:13:43.473003] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-09. [2025-10-02T19:13:44.129012] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-02T19:13:44.273039] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-09. [2025-10-02T19:13:44.896499] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-02T19:13:44.943047] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-02T19:13:45.073009] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-08. [2025-10-02T19:13:45.873032] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-07. [2025-10-02T19:13:46.306325] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-02T19:13:46.673000] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-09. [2025-10-02T19:13:47.208829] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-02T19:13:47.472996] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-10. [2025-10-02T19:13:48.111016] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-02T19:13:48.112003] [INFO ] [REMOTE ] GNT: Full fetch complete (10840 records). [2025-10-02T19:13:48.112081] [DEBUG] [VALIDATOR ] GNT: Validating primary data. [2025-10-02T19:13:48.280142] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-08. [2025-10-02T19:13:48.491677] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-02T19:13:48.574051] [DEBUG] [VALIDATOR ] GNT: All expected trading days are present. [2025-10-02T19:13:48.574136] [DEBUG] [VALIDATOR ] GNT: Primary data validation passed. [2025-10-02T19:13:48.574409] [INFO ] [MAIN ] GNT: Fetched primary data is valid. [2025-10-02T19:13:48.574451] [DEBUG] [LOCAL ] GNT: Saving primary data. [2025-10-02T19:13:48.574979] [DEBUG] [LOCAL ] GNT: Trimmed 10840 records to 8217 (keeping 200 days of data) [2025-10-02T19:13:48.624347] [DEBUG] [LOCAL ] GNT: Primary data saved (8217 records). [2025-10-02T19:13:48.624478] [INFO ] [MAIN ] GNT: Full history saved. [2025-10-02T19:13:48.624556] [INFO ] [MAIN ] Update Progress: 949/2370 symbols completed. GNT took 29.3s. Estimated remaining: 3h 20m 16s. Rate: 7.1 symbols/min [2025-10-02T19:13:48.825674] [INFO ] [MAIN ] GNW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:13:48.877591] [DEBUG] [LOCAL ] GNW: Loaded 51326 existing records from primary storage. [2025-10-02T19:13:48.877988] [INFO ] [MAIN ] GNW: Loaded 51326 existing records. [2025-10-02T19:13:49.070912] [WARN ] [MAIN ] GNW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:13:49.071150] [INFO ] [MAIN ] GNW: Wiping existing primary data before full refresh. [2025-10-02T19:13:49.071202] [INFO ] [LOCAL ] GNW: Starting deletion of primary data. [2025-10-02T19:13:49.072453] [DEBUG] [LOCAL ] GNW: Deleted primary data file. [2025-10-02T19:13:49.072518] [INFO ] [MAIN ] GNW: Starting full primary refresh. [2025-10-02T19:13:49.083878] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-10. [2025-10-02T19:13:49.486390] [INFO ] [REMOTE ] GNW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:13:49.873005] [INFO ] [REMOTE ] GNW: Fetching primary data for 2024-12. [2025-10-02T19:13:49.951439] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-02T19:13:50.394291] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-02T19:13:50.396360] [INFO ] [REMOTE ] GNL: Full fetch complete (68266 records). [2025-10-02T19:13:50.396487] [DEBUG] [VALIDATOR ] GNL: Validating primary data. [2025-10-02T19:13:50.679455] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-10. [2025-10-02T19:13:50.811817] [DEBUG] [VALIDATOR ] GNL: All expected trading days are present. [2025-10-02T19:13:50.811914] [DEBUG] [VALIDATOR ] GNL: Primary data validation passed. [2025-10-02T19:13:50.812897] [INFO ] [MAIN ] GNL: Fetched primary data is valid. [2025-10-02T19:13:50.812972] [DEBUG] [LOCAL ] GNL: Saving primary data. [2025-10-02T19:13:50.814444] [DEBUG] [LOCAL ] GNL: Trimmed 68266 records to 47148 (keeping 200 days of data) [2025-10-02T19:13:51.093694] [DEBUG] [LOCAL ] GNL: Primary data saved (47148 records). [2025-10-02T19:13:51.093840] [INFO ] [MAIN ] GNL: Full history saved. [2025-10-02T19:13:51.093927] [INFO ] [MAIN ] Update Progress: 950/2370 symbols completed. GNL took 35.0s. Estimated remaining: 3h 19m 59s. Rate: 7.1 symbols/min [2025-10-02T19:13:51.280887] [INFO ] [MAIN ] GOF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:13:51.312137] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-02T19:13:51.362778] [DEBUG] [LOCAL ] GOF: Loaded 42589 existing records from primary storage. [2025-10-02T19:13:51.363095] [INFO ] [MAIN ] GOF: Loaded 42589 existing records. [2025-10-02T19:13:51.475050] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-09. [2025-10-02T19:13:51.559922] [WARN ] [MAIN ] GOF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:13:51.560190] [INFO ] [MAIN ] GOF: Wiping existing primary data before full refresh. [2025-10-02T19:13:51.560248] [INFO ] [LOCAL ] GOF: Starting deletion of primary data. [2025-10-02T19:13:51.561673] [DEBUG] [LOCAL ] GOF: Deleted primary data file. [2025-10-02T19:13:51.561738] [INFO ] [MAIN ] GOF: Starting full primary refresh. [2025-10-02T19:13:51.945270] [INFO ] [REMOTE ] GOF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:13:52.039063] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-02T19:13:52.041093] [INFO ] [REMOTE ] GNK: Full fetch complete (57175 records). [2025-10-02T19:13:52.041209] [DEBUG] [VALIDATOR ] GNK: Validating primary data. [2025-10-02T19:13:52.285339] [INFO ] [REMOTE ] GOF: Fetching primary data for 2024-12. [2025-10-02T19:13:52.463207] [DEBUG] [VALIDATOR ] GNK: All expected trading days are present. [2025-10-02T19:13:52.463293] [DEBUG] [VALIDATOR ] GNK: Primary data validation passed. [2025-10-02T19:13:52.464079] [INFO ] [MAIN ] GNK: Fetched primary data is valid. [2025-10-02T19:13:52.464143] [DEBUG] [LOCAL ] GNK: Saving primary data. [2025-10-02T19:13:52.465364] [DEBUG] [LOCAL ] GNK: Trimmed 57175 records to 40592 (keeping 200 days of data) [2025-10-02T19:13:52.725955] [DEBUG] [LOCAL ] GNK: Primary data saved (40592 records). [2025-10-02T19:13:52.726086] [INFO ] [MAIN ] GNK: Full history saved. [2025-10-02T19:13:52.726174] [INFO ] [MAIN ] Update Progress: 951/2370 symbols completed. GNK took 39.9s. Estimated remaining: 3h 19m 40s. Rate: 7.1 symbols/min [2025-10-02T19:13:52.902099] [INFO ] [MAIN ] GOLF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:13:52.934433] [DEBUG] [LOCAL ] GOLF: Loaded 31207 existing records from primary storage. [2025-10-02T19:13:52.934839] [INFO ] [MAIN ] GOLF: Loaded 31207 existing records. [2025-10-02T19:13:53.079944] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-01. [2025-10-02T19:13:53.123404] [WARN ] [MAIN ] GOLF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:13:53.123800] [INFO ] [MAIN ] GOLF: Wiping existing primary data before full refresh. [2025-10-02T19:13:53.123890] [INFO ] [LOCAL ] GOLF: Starting deletion of primary data. [2025-10-02T19:13:53.124934] [DEBUG] [LOCAL ] GOLF: Deleted primary data file. [2025-10-02T19:13:53.124998] [INFO ] [MAIN ] GOLF: Starting full primary refresh. [2025-10-02T19:13:53.421171] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-02T19:13:53.556027] [INFO ] [REMOTE ] GOLF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:13:53.624092] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-02T19:13:53.872992] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-01. [2025-10-02T19:13:54.568486] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-02T19:13:54.673042] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2024-12. [2025-10-02T19:13:55.472995] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-02. [2025-10-02T19:13:55.564910] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-02T19:13:55.789376] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-02T19:13:56.273014] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-02. [2025-10-02T19:13:56.848319] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-02T19:13:57.073047] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-03. [2025-10-02T19:13:57.878053] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-01. [2025-10-02T19:13:57.898629] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-02T19:13:58.672990] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-10. [2025-10-02T19:13:58.814807] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-02T19:13:59.006412] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-02T19:13:59.473046] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-04. [2025-10-02T19:14:00.105431] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-02T19:14:00.107460] [INFO ] [REMOTE ] GNRC: Full fetch complete (65302 records). [2025-10-02T19:14:00.107581] [DEBUG] [VALIDATOR ] GNRC: Validating primary data. [2025-10-02T19:14:00.278162] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-02. [2025-10-02T19:14:00.549206] [DEBUG] [VALIDATOR ] GNRC: All expected trading days are present. [2025-10-02T19:14:00.549325] [DEBUG] [VALIDATOR ] GNRC: Primary data validation passed. [2025-10-02T19:14:00.550278] [INFO ] [MAIN ] GNRC: Fetched primary data is valid. [2025-10-02T19:14:00.550347] [DEBUG] [LOCAL ] GNRC: Saving primary data. [2025-10-02T19:14:00.551791] [DEBUG] [LOCAL ] GNRC: Trimmed 65302 records to 45434 (keeping 200 days of data) [2025-10-02T19:14:00.849829] [DEBUG] [LOCAL ] GNRC: Primary data saved (45434 records). [2025-10-02T19:14:00.849965] [INFO ] [MAIN ] GNRC: Full history saved. [2025-10-02T19:14:00.853208] [INFO ] [MAIN ] Update Progress: 952/2370 symbols completed. GNRC took 42.6s. Estimated remaining: 3h 19m 31s. Rate: 7.1 symbols/min [2025-10-02T19:14:01.049121] [INFO ] [MAIN ] GOOS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:14:01.076986] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-03. [2025-10-02T19:14:01.098535] [DEBUG] [LOCAL ] GOOS: Loaded 45028 existing records from primary storage. [2025-10-02T19:14:01.099008] [INFO ] [MAIN ] GOOS: Loaded 45028 existing records. [2025-10-02T19:14:01.298971] [WARN ] [MAIN ] GOOS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:14:01.299222] [INFO ] [MAIN ] GOOS: Wiping existing primary data before full refresh. [2025-10-02T19:14:01.299272] [INFO ] [LOCAL ] GOOS: Starting deletion of primary data. [2025-10-02T19:14:01.300771] [DEBUG] [LOCAL ] GOOS: Deleted primary data file. [2025-10-02T19:14:01.300833] [INFO ] [MAIN ] GOOS: Starting full primary refresh. [2025-10-02T19:14:01.707696] [INFO ] [REMOTE ] GOOS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:14:01.743451] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-02T19:14:01.873003] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2024-12. [2025-10-02T19:14:01.949923] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-02T19:14:02.672985] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-03. [2025-10-02T19:14:02.769462] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-02T19:14:03.473065] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-04. [2025-10-02T19:14:03.541539] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-02T19:14:03.771224] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-02T19:14:04.273018] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-04. [2025-10-02T19:14:04.789077] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-02T19:14:05.073010] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-01. [2025-10-02T19:14:05.734430] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-02T19:14:05.873024] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-05. [2025-10-02T19:14:06.297550] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-02T19:14:06.673041] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-05. [2025-10-02T19:14:07.292199] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-02T19:14:07.473059] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-06. [2025-10-02T19:14:08.068557] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-02T19:14:08.273048] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-05. [2025-10-02T19:14:08.849792] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-02T19:14:09.073027] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-07. [2025-10-02T19:14:09.873060] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-02. [2025-10-02T19:14:10.038185] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-02T19:14:10.296088] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-02T19:14:10.673050] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-06. [2025-10-02T19:14:11.398058] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-02T19:14:11.473007] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-03. [2025-10-02T19:14:11.911983] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-02T19:14:12.273009] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-07. [2025-10-02T19:14:13.038554] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-02T19:14:13.072994] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-04. [2025-10-02T19:14:13.566253] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-02T19:14:13.873007] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-08. [2025-10-02T19:14:14.673009] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-06. [2025-10-02T19:14:14.840911] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-02T19:14:15.231520] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-02T19:14:15.473022] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-08. [2025-10-02T19:14:16.050639] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-02T19:14:16.273008] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-09. [2025-10-02T19:14:16.881084] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-02T19:14:17.072986] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-07. [2025-10-02T19:14:17.390141] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-02T19:14:17.873015] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-09. [2025-10-02T19:14:18.447028] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-02T19:14:18.673014] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-10. [2025-10-02T19:14:19.472971] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-08. [2025-10-02T19:14:19.522551] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-02T19:14:19.524082] [INFO ] [REMOTE ] GOLF: Full fetch complete (45107 records). [2025-10-02T19:14:19.524176] [DEBUG] [VALIDATOR ] GOLF: Validating primary data. [2025-10-02T19:14:19.728604] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-02T19:14:19.982457] [DEBUG] [VALIDATOR ] GOLF: All expected trading days are present. [2025-10-02T19:14:19.982545] [DEBUG] [VALIDATOR ] GOLF: Primary data validation passed. [2025-10-02T19:14:19.983319] [INFO ] [MAIN ] GOLF: Fetched primary data is valid. [2025-10-02T19:14:19.983387] [DEBUG] [LOCAL ] GOLF: Saving primary data. [2025-10-02T19:14:19.984495] [DEBUG] [LOCAL ] GOLF: Trimmed 45107 records to 31420 (keeping 200 days of data) [2025-10-02T19:14:20.183360] [DEBUG] [LOCAL ] GOLF: Primary data saved (31420 records). [2025-10-02T19:14:20.183504] [INFO ] [MAIN ] GOLF: Full history saved. [2025-10-02T19:14:20.183590] [INFO ] [MAIN ] Update Progress: 953/2370 symbols completed. GOLF took 27.5s. Estimated remaining: 3h 19m 39s. Rate: 7.1 symbols/min [2025-10-02T19:14:20.279743] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-10. [2025-10-02T19:14:20.376348] [INFO ] [MAIN ] GOTU: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:14:20.421119] [DEBUG] [LOCAL ] GOTU: Loaded 38435 existing records from primary storage. [2025-10-02T19:14:20.421618] [INFO ] [MAIN ] GOTU: Loaded 38435 existing records. [2025-10-02T19:14:20.619485] [WARN ] [MAIN ] GOTU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:14:20.619755] [INFO ] [MAIN ] GOTU: Wiping existing primary data before full refresh. [2025-10-02T19:14:20.619842] [INFO ] [LOCAL ] GOTU: Starting deletion of primary data. [2025-10-02T19:14:20.621116] [DEBUG] [LOCAL ] GOTU: Deleted primary data file. [2025-10-02T19:14:20.621182] [INFO ] [MAIN ] GOTU: Starting full primary refresh. [2025-10-02T19:14:21.011404] [INFO ] [REMOTE ] GOTU: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:14:21.073026] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2024-12. [2025-10-02T19:14:21.241360] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-02T19:14:21.709333] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-02T19:14:21.711251] [INFO ] [REMOTE ] GOF: Full fetch complete (62118 records). [2025-10-02T19:14:21.711419] [DEBUG] [VALIDATOR ] GOF: Validating primary data. [2025-10-02T19:14:21.878244] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-09. [2025-10-02T19:14:22.167087] [DEBUG] [VALIDATOR ] GOF: All expected trading days are present. [2025-10-02T19:14:22.167219] [DEBUG] [VALIDATOR ] GOF: Primary data validation passed. [2025-10-02T19:14:22.168168] [INFO ] [MAIN ] GOF: Fetched primary data is valid. [2025-10-02T19:14:22.168235] [DEBUG] [LOCAL ] GOF: Saving primary data. [2025-10-02T19:14:22.169784] [DEBUG] [LOCAL ] GOF: Trimmed 62118 records to 42879 (keeping 200 days of data) [2025-10-02T19:14:22.468326] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-02T19:14:22.488151] [DEBUG] [LOCAL ] GOF: Primary data saved (42879 records). [2025-10-02T19:14:22.488270] [INFO ] [MAIN ] GOF: Full history saved. [2025-10-02T19:14:22.488384] [INFO ] [MAIN ] Update Progress: 954/2370 symbols completed. GOF took 31.4s. Estimated remaining: 3h 19m 21s. Rate: 7.1 symbols/min [2025-10-02T19:14:22.677820] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-01. [2025-10-02T19:14:22.679585] [INFO ] [MAIN ] GPC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:14:22.734208] [DEBUG] [LOCAL ] GPC: Loaded 46349 existing records from primary storage. [2025-10-02T19:14:22.734563] [INFO ] [MAIN ] GPC: Loaded 46349 existing records. [2025-10-02T19:14:22.925557] [WARN ] [MAIN ] GPC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:14:22.925868] [INFO ] [MAIN ] GPC: Wiping existing primary data before full refresh. [2025-10-02T19:14:22.925919] [INFO ] [LOCAL ] GPC: Starting deletion of primary data. [2025-10-02T19:14:22.928207] [DEBUG] [LOCAL ] GPC: Deleted primary data file. [2025-10-02T19:14:22.928270] [INFO ] [MAIN ] GPC: Starting full primary refresh. [2025-10-02T19:14:23.343755] [INFO ] [REMOTE ] GPC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:14:23.472997] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-05. [2025-10-02T19:14:23.725900] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-02T19:14:24.272999] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-10. [2025-10-02T19:14:24.339248] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-02T19:14:25.072995] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-02. [2025-10-02T19:14:25.159379] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-02T19:14:25.832066] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-02T19:14:25.834377] [INFO ] [REMOTE ] GNW: Full fetch complete (73558 records). [2025-10-02T19:14:25.834511] [DEBUG] [VALIDATOR ] GNW: Validating primary data. [2025-10-02T19:14:25.878105] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-06. [2025-10-02T19:14:26.298358] [DEBUG] [VALIDATOR ] GNW: All expected trading days are present. [2025-10-02T19:14:26.298584] [DEBUG] [VALIDATOR ] GNW: Primary data validation passed. [2025-10-02T19:14:26.299726] [INFO ] [MAIN ] GNW: Fetched primary data is valid. [2025-10-02T19:14:26.299920] [DEBUG] [LOCAL ] GNW: Saving primary data. [2025-10-02T19:14:26.301454] [DEBUG] [LOCAL ] GNW: Trimmed 73558 records to 51722 (keeping 200 days of data) [2025-10-02T19:14:26.646680] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-02T19:14:26.663548] [DEBUG] [LOCAL ] GNW: Primary data saved (51722 records). [2025-10-02T19:14:26.663780] [INFO ] [MAIN ] GNW: Full history saved. [2025-10-02T19:14:26.663906] [INFO ] [MAIN ] Update Progress: 955/2370 symbols completed. GNW took 38.0s. Estimated remaining: 3h 19m 7s. Rate: 7.1 symbols/min [2025-10-02T19:14:26.678103] [INFO ] [REMOTE ] GPC: Fetching primary data for 2024-12. [2025-10-02T19:14:26.855450] [INFO ] [MAIN ] GPI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:14:26.873521] [DEBUG] [LOCAL ] GPI: Loaded 14648 existing records from primary storage. [2025-10-02T19:14:26.873800] [INFO ] [MAIN ] GPI: Loaded 14648 existing records. [2025-10-02T19:14:27.086719] [WARN ] [MAIN ] GPI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:14:27.086924] [INFO ] [MAIN ] GPI: Wiping existing primary data before full refresh. [2025-10-02T19:14:27.086976] [INFO ] [LOCAL ] GPI: Starting deletion of primary data. [2025-10-02T19:14:27.087832] [DEBUG] [LOCAL ] GPI: Deleted primary data file. [2025-10-02T19:14:27.087895] [INFO ] [MAIN ] GPI: Starting full primary refresh. [2025-10-02T19:14:27.496360] [INFO ] [REMOTE ] GPI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:14:27.473406] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-03. [2025-10-02T19:14:27.524630] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-02T19:14:28.273019] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-07. [2025-10-02T19:14:28.626714] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-02T19:14:28.893487] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-02T19:14:29.072995] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-04. [2025-10-02T19:14:29.740068] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-02T19:14:29.872983] [INFO ] [REMOTE ] GPI: Fetching primary data for 2024-12. [2025-10-02T19:14:30.669861] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-02T19:14:30.672901] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-01. [2025-10-02T19:14:30.699153] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-02T19:14:31.472983] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-05. [2025-10-02T19:14:31.679524] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-02T19:14:32.273014] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-02. [2025-10-02T19:14:32.843045] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-02T19:14:33.072992] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-08. [2025-10-02T19:14:33.166254] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-02T19:14:33.873003] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-01. [2025-10-02T19:14:34.672976] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-03. [2025-10-02T19:14:34.737359] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-02T19:14:35.172885] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-02T19:14:35.473000] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-09. [2025-10-02T19:14:35.800764] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-02T19:14:36.273049] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-04. [2025-10-02T19:14:36.784953] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-02T19:14:37.073102] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-10. [2025-10-02T19:14:37.351772] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-02T19:14:37.873040] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-02. [2025-10-02T19:14:38.292785] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-02T19:14:38.294783] [INFO ] [REMOTE ] GOOS: Full fetch complete (65541 records). [2025-10-02T19:14:38.294921] [DEBUG] [VALIDATOR ] GOOS: Validating primary data. [2025-10-02T19:14:38.674428] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-06. [2025-10-02T19:14:38.722522] [DEBUG] [VALIDATOR ] GOOS: All expected trading days are present. [2025-10-02T19:14:38.722612] [DEBUG] [VALIDATOR ] GOOS: Primary data validation passed. [2025-10-02T19:14:38.723618] [INFO ] [MAIN ] GOOS: Fetched primary data is valid. [2025-10-02T19:14:38.723800] [DEBUG] [LOCAL ] GOOS: Saving primary data. [2025-10-02T19:14:38.725338] [DEBUG] [LOCAL ] GOOS: Trimmed 65541 records to 45342 (keeping 200 days of data) [2025-10-02T19:14:39.006877] [DEBUG] [LOCAL ] GOOS: Primary data saved (45342 records). [2025-10-02T19:14:39.007009] [INFO ] [MAIN ] GOOS: Full history saved. [2025-10-02T19:14:39.008104] [INFO ] [MAIN ] Update Progress: 956/2370 symbols completed. GOOS took 38.2s. Estimated remaining: 3h 19m 4s. Rate: 7.1 symbols/min [2025-10-02T19:14:39.191977] [INFO ] [MAIN ] GPJA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:14:39.202710] [DEBUG] [LOCAL ] GPJA: Loaded 4229 existing records from primary storage. [2025-10-02T19:14:39.202942] [INFO ] [MAIN ] GPJA: Loaded 4229 existing records. [2025-10-02T19:14:39.398945] [WARN ] [MAIN ] GPJA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:14:39.399239] [INFO ] [MAIN ] GPJA: Wiping existing primary data before full refresh. [2025-10-02T19:14:39.399340] [INFO ] [LOCAL ] GPJA: Starting deletion of primary data. [2025-10-02T19:14:39.399839] [DEBUG] [LOCAL ] GPJA: Deleted primary data file. [2025-10-02T19:14:39.399901] [INFO ] [MAIN ] GPJA: Starting full primary refresh. [2025-10-02T19:14:39.481324] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-05. [2025-10-02T19:14:39.835164] [INFO ] [REMOTE ] GPJA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:14:39.847276] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-02T19:14:40.090051] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-02T19:14:40.108153] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-02T19:14:40.273011] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-06. [2025-10-02T19:14:41.072984] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-07. [2025-10-02T19:14:41.220549] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-02T19:14:41.873009] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-03. [2025-10-02T19:14:42.200476] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-02T19:14:42.673029] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-07. [2025-10-02T19:14:43.440022] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-02T19:14:43.472983] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-08. [2025-10-02T19:14:43.758523] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-02T19:14:44.273026] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-08. [2025-10-02T19:14:44.901018] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-02T19:14:44.918843] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-02T19:14:45.073011] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-09. [2025-10-02T19:14:45.873003] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-04. [2025-10-02T19:14:46.073286] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-02T19:14:46.673004] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2024-12. [2025-10-02T19:14:47.228809] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-02T19:14:47.473016] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-09. [2025-10-02T19:14:47.674428] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-02T19:14:48.273025] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-01. [2025-10-02T19:14:48.452462] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-02T19:14:49.077505] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-10. [2025-10-02T19:14:49.081393] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-02T19:14:49.873023] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-05. [2025-10-02T19:14:50.149297] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-02T19:14:50.150871] [INFO ] [REMOTE ] GOTU: Full fetch complete (59141 records). [2025-10-02T19:14:50.151049] [DEBUG] [VALIDATOR ] GOTU: Validating primary data. [2025-10-02T19:14:50.597561] [DEBUG] [VALIDATOR ] GOTU: All expected trading days are present. [2025-10-02T19:14:50.597719] [DEBUG] [VALIDATOR ] GOTU: Primary data validation passed. [2025-10-02T19:14:50.598670] [INFO ] [MAIN ] GOTU: Fetched primary data is valid. [2025-10-02T19:14:50.598782] [DEBUG] [LOCAL ] GOTU: Saving primary data. [2025-10-02T19:14:50.600344] [DEBUG] [LOCAL ] GOTU: Trimmed 59141 records to 38626 (keeping 200 days of data) [2025-10-02T19:14:50.689717] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-10. [2025-10-02T19:14:50.834556] [DEBUG] [LOCAL ] GOTU: Primary data saved (38626 records). [2025-10-02T19:14:50.834747] [INFO ] [MAIN ] GOTU: Full history saved. [2025-10-02T19:14:50.834896] [INFO ] [MAIN ] Update Progress: 957/2370 symbols completed. GOTU took 30.7s. Estimated remaining: 3h 19m 0s. Rate: 7.1 symbols/min [2025-10-02T19:14:51.460105] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-02T19:14:51.461395] [INFO ] [REMOTE ] GPI: Full fetch complete (21138 records). [2025-10-02T19:14:51.461511] [DEBUG] [VALIDATOR ] GPI: Validating primary data. [2025-10-02T19:14:51.497472] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-02. [2025-10-02T19:14:51.873383] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-02T19:14:51.910370] [DEBUG] [VALIDATOR ] GPI: All expected trading days are present. [2025-10-02T19:14:51.910552] [DEBUG] [VALIDATOR ] GPI: Primary data validation passed. [2025-10-02T19:14:51.911030] [INFO ] [MAIN ] GPI: Fetched primary data is valid. [2025-10-02T19:14:51.911112] [DEBUG] [LOCAL ] GPI: Saving primary data. [2025-10-02T19:14:51.912025] [DEBUG] [LOCAL ] GPI: Trimmed 21138 records to 14747 (keeping 200 days of data) [2025-10-02T19:14:52.013742] [DEBUG] [LOCAL ] GPI: Primary data saved (14747 records). [2025-10-02T19:14:52.013885] [INFO ] [MAIN ] GPI: Full history saved. [2025-10-02T19:14:52.013969] [INFO ] [MAIN ] Update Progress: 958/2370 symbols completed. GPI took 25.3s. Estimated remaining: 3h 18m 41s. Rate: 7.1 symbols/min [2025-10-02T19:14:52.156725] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-02T19:14:52.272994] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-06. [2025-10-02T19:14:53.073005] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-03. [2025-10-02T19:14:53.804789] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-02T19:14:53.840422] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-02T19:14:53.872991] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-04. [2025-10-02T19:14:54.430144] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-02T19:14:54.673019] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-07. [2025-10-02T19:14:55.472976] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-05. [2025-10-02T19:14:55.926577] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-02T19:14:56.272975] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-06. [2025-10-02T19:14:56.318508] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-02T19:14:56.858413] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-02T19:14:57.073054] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-08. [2025-10-02T19:14:57.873021] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-07. [2025-10-02T19:14:58.384768] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-02T19:14:58.672994] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-08. [2025-10-02T19:14:58.763909] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-02T19:14:59.261476] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-02T19:14:59.473015] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-09. [2025-10-02T19:15:00.273060] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-09. [2025-10-02T19:15:01.175354] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-02T19:15:01.177332] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-10. [2025-10-02T19:15:01.664031] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-02T19:15:01.873026] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-10. [2025-10-02T19:15:02.524466] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-02T19:15:02.525316] [INFO ] [REMOTE ] GPJA: Full fetch complete (7350 records). [2025-10-02T19:15:02.525423] [DEBUG] [VALIDATOR ] GPJA: Validating primary data. [2025-10-02T19:15:02.948073] [DEBUG] [VALIDATOR ] GPJA: All expected trading days are present. [2025-10-02T19:15:02.948199] [DEBUG] [VALIDATOR ] GPJA: Primary data validation passed. [2025-10-02T19:15:02.948440] [INFO ] [MAIN ] GPJA: Fetched primary data is valid. [2025-10-02T19:15:02.948511] [DEBUG] [LOCAL ] GPJA: Saving primary data. [2025-10-02T19:15:02.949067] [DEBUG] [LOCAL ] GPJA: Trimmed 7350 records to 4260 (keeping 200 days of data) [2025-10-02T19:15:02.978329] [DEBUG] [LOCAL ] GPJA: Primary data saved (4260 records). [2025-10-02T19:15:02.978476] [INFO ] [MAIN ] GPJA: Full history saved. [2025-10-02T19:15:02.978562] [INFO ] [MAIN ] Update Progress: 959/2370 symbols completed. GPJA took 24.0s. Estimated remaining: 3h 18m 36s. Rate: 7.1 symbols/min [2025-10-02T19:15:03.327272] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-02T19:15:03.329244] [INFO ] [REMOTE ] GPC: Full fetch complete (68945 records). [2025-10-02T19:15:03.329373] [DEBUG] [VALIDATOR ] GPC: Validating primary data. [2025-10-02T19:15:03.769830] [DEBUG] [VALIDATOR ] GPC: All expected trading days are present. [2025-10-02T19:15:03.769918] [DEBUG] [VALIDATOR ] GPC: Primary data validation passed. [2025-10-02T19:15:03.770876] [INFO ] [MAIN ] GPC: Fetched primary data is valid. [2025-10-02T19:15:03.770941] [DEBUG] [LOCAL ] GPC: Saving primary data. [2025-10-02T19:15:03.772395] [DEBUG] [LOCAL ] GPC: Trimmed 68945 records to 46702 (keeping 200 days of data) [2025-10-02T19:15:04.088889] [DEBUG] [LOCAL ] GPC: Primary data saved (46702 records). [2025-10-02T19:15:04.089041] [INFO ] [MAIN ] GPC: Full history saved. [2025-10-02T19:15:04.089194] [INFO ] [MAIN ] Update Progress: 960/2370 symbols completed. GPC took 41.6s. Estimated remaining: 3h 18m 17s. Rate: 7.1 symbols/min [2025-10-02T19:15:04.787594] [INFO ] [MAIN ] GPOR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:15:04.745536] [INFO ] [MAIN ] GPN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:15:04.898723] [INFO ] [MAIN ] GPK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:15:04.903029] [INFO ] [MAIN ] GPMT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:15:04.939547] [DEBUG] [LOCAL ] GPOR: Loaded 23138 existing records from primary storage. [2025-10-02T19:15:04.939976] [INFO ] [MAIN ] GPOR: Loaded 23138 existing records. [2025-10-02T19:15:05.008856] [DEBUG] [LOCAL ] GPMT: Loaded 26086 existing records from primary storage. [2025-10-02T19:15:05.037400] [INFO ] [MAIN ] GPMT: Loaded 26086 existing records. [2025-10-02T19:15:05.364529] [DEBUG] [LOCAL ] GPK: Loaded 52660 existing records from primary storage. [2025-10-02T19:15:05.356584] [DEBUG] [LOCAL ] GPN: Loaded 52049 existing records from primary storage. [2025-10-02T19:15:05.364927] [INFO ] [MAIN ] GPK: Loaded 52660 existing records. [2025-10-02T19:15:05.364431] [WARN ] [MAIN ] GPOR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:15:05.370389] [INFO ] [MAIN ] GPN: Loaded 52049 existing records. [2025-10-02T19:15:05.387331] [INFO ] [MAIN ] GPOR: Wiping existing primary data before full refresh. [2025-10-02T19:15:05.420633] [INFO ] [LOCAL ] GPOR: Starting deletion of primary data. [2025-10-02T19:15:05.567308] [WARN ] [MAIN ] GPMT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:15:05.622292] [INFO ] [MAIN ] GPMT: Wiping existing primary data before full refresh. [2025-10-02T19:15:05.637922] [DEBUG] [LOCAL ] GPOR: Deleted primary data file. [2025-10-02T19:15:05.678275] [INFO ] [MAIN ] GPOR: Starting full primary refresh. [2025-10-02T19:15:05.677930] [INFO ] [LOCAL ] GPMT: Starting deletion of primary data. [2025-10-02T19:15:05.698357] [DEBUG] [LOCAL ] GPMT: Deleted primary data file. [2025-10-02T19:15:05.729910] [INFO ] [MAIN ] GPMT: Starting full primary refresh. [2025-10-02T19:15:05.984992] [WARN ] [MAIN ] GPK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:15:06.056469] [INFO ] [MAIN ] GPK: Wiping existing primary data before full refresh. [2025-10-02T19:15:06.049537] [WARN ] [MAIN ] GPN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:15:06.056796] [INFO ] [LOCAL ] GPK: Starting deletion of primary data. [2025-10-02T19:15:06.071548] [INFO ] [MAIN ] GPN: Wiping existing primary data before full refresh. [2025-10-02T19:15:06.108104] [INFO ] [LOCAL ] GPN: Starting deletion of primary data. [2025-10-02T19:15:06.152186] [DEBUG] [LOCAL ] GPK: Deleted primary data file. [2025-10-02T19:15:06.163195] [INFO ] [MAIN ] GPK: Starting full primary refresh. [2025-10-02T19:15:06.178264] [DEBUG] [LOCAL ] GPN: Deleted primary data file. [2025-10-02T19:15:06.234048] [INFO ] [MAIN ] GPN: Starting full primary refresh. [2025-10-02T19:15:07.177713] [INFO ] [REMOTE ] GPOR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:15:07.234291] [INFO ] [REMOTE ] GPMT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:15:07.244853] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2024-12. [2025-10-02T19:15:07.294740] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2024-12. [2025-10-02T19:15:07.478351] [INFO ] [REMOTE ] GPK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:15:07.489284] [INFO ] [REMOTE ] GPK: Fetching primary data for 2024-12. [2025-10-02T19:15:07.567800] [INFO ] [REMOTE ] GPN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:15:07.568300] [INFO ] [REMOTE ] GPN: Fetching primary data for 2024-12. [2025-10-02T19:15:08.691220] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-02T19:15:08.709765] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-01. [2025-10-02T19:15:08.711671] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-02T19:15:08.719914] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-01. [2025-10-02T19:15:09.163896] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-02T19:15:09.174614] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-01. [2025-10-02T19:15:09.453513] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-02T19:15:09.464723] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-01. [2025-10-02T19:15:09.712073] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-02T19:15:09.721794] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-02. [2025-10-02T19:15:09.783970] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-02T19:15:09.873046] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-02. [2025-10-02T19:15:10.529216] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-02T19:15:10.644772] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-02T19:15:10.672959] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-03. [2025-10-02T19:15:10.736831] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-02T19:15:10.810309] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-02T19:15:11.472970] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-03. [2025-10-02T19:15:11.510525] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-02T19:15:12.273029] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-02. [2025-10-02T19:15:12.619691] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-02T19:15:13.073048] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-02. [2025-10-02T19:15:13.641858] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-02T19:15:13.872997] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-04. [2025-10-02T19:15:14.422080] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-02T19:15:14.673015] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-03. [2025-10-02T19:15:15.243490] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-02T19:15:15.472998] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-04. [2025-10-02T19:15:16.273023] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-03. [2025-10-02T19:15:16.491220] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-02T19:15:16.636170] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-02T19:15:17.073018] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-05. [2025-10-02T19:15:17.873009] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-04. [2025-10-02T19:15:18.047391] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-02T19:15:18.160072] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-02T19:15:18.673021] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-06. [2025-10-02T19:15:19.396260] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-02T19:15:19.472990] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-07. [2025-10-02T19:15:19.643594] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-02T19:15:20.273003] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-04. [2025-10-02T19:15:20.729020] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-02T19:15:21.073057] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-05. [2025-10-02T19:15:21.873010] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-05. [2025-10-02T19:15:21.996016] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-02T19:15:22.672971] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-05. [2025-10-02T19:15:22.867250] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-02T19:15:23.226176] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-02T19:15:23.472995] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-06. [2025-10-02T19:15:24.273035] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-08. [2025-10-02T19:15:24.756945] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-02T19:15:25.073017] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-06. [2025-10-02T19:15:25.702544] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-02T19:15:25.875152] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-06. [2025-10-02T19:15:25.879488] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-06 (2.41 seconds). [2025-10-02T19:15:26.678524] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-07. [2025-10-02T19:15:26.694471] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-02T19:15:27.472968] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-09. [2025-10-02T19:15:27.549290] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-02T19:15:28.166927] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-02T19:15:28.272997] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-07. [2025-10-02T19:15:28.558438] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-02T19:15:29.073019] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-07. [2025-10-02T19:15:29.873033] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-10. [2025-10-02T19:15:30.028992] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-02T19:15:30.063867] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-02T19:15:30.673001] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-08. [2025-10-02T19:15:30.756104] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-02T19:15:30.757458] [INFO ] [REMOTE ] GPOR: Full fetch complete (34976 records). [2025-10-02T19:15:30.757598] [DEBUG] [VALIDATOR ] GPOR: Validating primary data. [2025-10-02T19:15:31.174823] [DEBUG] [VALIDATOR ] GPOR: All expected trading days are present. [2025-10-02T19:15:31.174904] [DEBUG] [VALIDATOR ] GPOR: Primary data validation passed. [2025-10-02T19:15:31.175565] [INFO ] [MAIN ] GPOR: Fetched primary data is valid. [2025-10-02T19:15:31.175608] [DEBUG] [LOCAL ] GPOR: Saving primary data. [2025-10-02T19:15:31.176443] [DEBUG] [LOCAL ] GPOR: Trimmed 34976 records to 23347 (keeping 200 days of data) [2025-10-02T19:15:31.328388] [DEBUG] [LOCAL ] GPOR: Primary data saved (23347 records). [2025-10-02T19:15:31.328550] [INFO ] [MAIN ] GPOR: Full history saved. [2025-10-02T19:15:31.328754] [INFO ] [MAIN ] Update Progress: 961/2370 symbols completed. GPOR took 27.2s. Estimated remaining: 3h 18m 36s. Rate: 7.1 symbols/min [2025-10-02T19:15:31.478099] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-08. [2025-10-02T19:15:31.536163] [INFO ] [MAIN ] GPRK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:15:31.575257] [DEBUG] [LOCAL ] GPRK: Loaded 39366 existing records from primary storage. [2025-10-02T19:15:31.575551] [INFO ] [MAIN ] GPRK: Loaded 39366 existing records. [2025-10-02T19:15:31.784337] [WARN ] [MAIN ] GPRK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:15:31.784706] [INFO ] [MAIN ] GPRK: Wiping existing primary data before full refresh. [2025-10-02T19:15:31.784842] [INFO ] [LOCAL ] GPRK: Starting deletion of primary data. [2025-10-02T19:15:31.796827] [DEBUG] [LOCAL ] GPRK: Deleted primary data file. [2025-10-02T19:15:31.797560] [INFO ] [MAIN ] GPRK: Starting full primary refresh. [2025-10-02T19:15:31.798346] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-02T19:15:32.206348] [INFO ] [REMOTE ] GPRK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:15:32.272999] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-09. [2025-10-02T19:15:33.072973] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-08. [2025-10-02T19:15:33.197089] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-02T19:15:33.219927] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-02T19:15:33.873031] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-09. [2025-10-02T19:15:34.509662] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-02T19:15:34.673013] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-10. [2025-10-02T19:15:35.440572] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-02T19:15:35.441823] [INFO ] [REMOTE ] GPMT: Full fetch complete (37335 records). [2025-10-02T19:15:35.441912] [DEBUG] [VALIDATOR ] GPMT: Validating primary data. [2025-10-02T19:15:35.473691] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2024-12. [2025-10-02T19:15:35.922731] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-02T19:15:35.949850] [DEBUG] [VALIDATOR ] GPMT: All expected trading days are present. [2025-10-02T19:15:35.950151] [DEBUG] [VALIDATOR ] GPMT: Primary data validation passed. [2025-10-02T19:15:35.951258] [INFO ] [MAIN ] GPMT: Fetched primary data is valid. [2025-10-02T19:15:35.951344] [DEBUG] [LOCAL ] GPMT: Saving primary data. [2025-10-02T19:15:35.953040] [DEBUG] [LOCAL ] GPMT: Trimmed 37335 records to 26208 (keeping 200 days of data) [2025-10-02T19:15:36.120639] [DEBUG] [LOCAL ] GPMT: Primary data saved (26208 records). [2025-10-02T19:15:36.120808] [INFO ] [MAIN ] GPMT: Full history saved. [2025-10-02T19:15:36.120891] [INFO ] [MAIN ] Update Progress: 962/2370 symbols completed. GPMT took 32.0s. Estimated remaining: 3h 18m 23s. Rate: 7.1 symbols/min [2025-10-02T19:15:36.282020] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-10. [2025-10-02T19:15:36.322448] [INFO ] [MAIN ] GRBK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:15:36.351420] [DEBUG] [LOCAL ] GRBK: Loaded 26888 existing records from primary storage. [2025-10-02T19:15:36.351737] [INFO ] [MAIN ] GRBK: Loaded 26888 existing records. [2025-10-02T19:15:36.561105] [WARN ] [MAIN ] GRBK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:15:36.561405] [INFO ] [MAIN ] GRBK: Wiping existing primary data before full refresh. [2025-10-02T19:15:36.561471] [INFO ] [LOCAL ] GRBK: Starting deletion of primary data. [2025-10-02T19:15:36.562230] [DEBUG] [LOCAL ] GRBK: Deleted primary data file. [2025-10-02T19:15:36.562293] [INFO ] [MAIN ] GRBK: Starting full primary refresh. [2025-10-02T19:15:36.979547] [INFO ] [REMOTE ] GRBK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:15:37.082092] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-09. [2025-10-02T19:15:37.087358] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-02T19:15:37.637399] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-02T19:15:37.639489] [INFO ] [REMOTE ] GPK: Full fetch complete (75559 records). [2025-10-02T19:15:37.639601] [DEBUG] [VALIDATOR ] GPK: Validating primary data. [2025-10-02T19:15:37.878189] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-01. [2025-10-02T19:15:38.082460] [DEBUG] [VALIDATOR ] GPK: All expected trading days are present. [2025-10-02T19:15:38.082550] [DEBUG] [VALIDATOR ] GPK: Primary data validation passed. [2025-10-02T19:15:38.083561] [INFO ] [MAIN ] GPK: Fetched primary data is valid. [2025-10-02T19:15:38.083630] [DEBUG] [LOCAL ] GPK: Saving primary data. [2025-10-02T19:15:38.085194] [DEBUG] [LOCAL ] GPK: Trimmed 75559 records to 53044 (keeping 200 days of data) [2025-10-02T19:15:38.423894] [DEBUG] [LOCAL ] GPK: Primary data saved (53044 records). [2025-10-02T19:15:38.424101] [INFO ] [MAIN ] GPK: Full history saved. [2025-10-02T19:15:38.424259] [INFO ] [MAIN ] Update Progress: 963/2370 symbols completed. GPK took 34.3s. Estimated remaining: 3h 18m 5s. Rate: 7.1 symbols/min [2025-10-02T19:15:38.621520] [INFO ] [MAIN ] GRC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:15:38.637873] [DEBUG] [LOCAL ] GRC: Loaded 8958 existing records from primary storage. [2025-10-02T19:15:38.638286] [INFO ] [MAIN ] GRC: Loaded 8958 existing records. [2025-10-02T19:15:38.680634] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2024-12. [2025-10-02T19:15:38.878840] [WARN ] [MAIN ] GRC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:15:38.879131] [INFO ] [MAIN ] GRC: Wiping existing primary data before full refresh. [2025-10-02T19:15:38.879186] [INFO ] [LOCAL ] GRC: Starting deletion of primary data. [2025-10-02T19:15:38.879556] [DEBUG] [LOCAL ] GRC: Deleted primary data file. [2025-10-02T19:15:38.879619] [INFO ] [MAIN ] GRC: Starting full primary refresh. [2025-10-02T19:15:39.291823] [INFO ] [REMOTE ] GRC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:15:39.332857] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-02T19:15:39.475192] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-10. [2025-10-02T19:15:39.485361] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-02T19:15:40.042734] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-02T19:15:40.273000] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-02. [2025-10-02T19:15:41.073019] [INFO ] [REMOTE ] GRC: Fetching primary data for 2024-12. [2025-10-02T19:15:41.117862] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-02T19:15:41.120035] [INFO ] [REMOTE ] GPN: Full fetch complete (74888 records). [2025-10-02T19:15:41.120186] [DEBUG] [VALIDATOR ] GPN: Validating primary data. [2025-10-02T19:15:41.547943] [DEBUG] [VALIDATOR ] GPN: All expected trading days are present. [2025-10-02T19:15:41.548043] [DEBUG] [VALIDATOR ] GPN: Primary data validation passed. [2025-10-02T19:15:41.549082] [INFO ] [MAIN ] GPN: Fetched primary data is valid. [2025-10-02T19:15:41.549153] [DEBUG] [LOCAL ] GPN: Saving primary data. [2025-10-02T19:15:41.550747] [DEBUG] [LOCAL ] GPN: Trimmed 74888 records to 52423 (keeping 200 days of data) [2025-10-02T19:15:41.878310] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-01. [2025-10-02T19:15:41.890392] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-02T19:15:41.929110] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-02T19:15:41.951676] [DEBUG] [LOCAL ] GPN: Primary data saved (52423 records). [2025-10-02T19:15:41.952543] [INFO ] [MAIN ] GPN: Full history saved. [2025-10-02T19:15:41.952742] [INFO ] [MAIN ] Update Progress: 964/2370 symbols completed. GPN took 37.8s. Estimated remaining: 3h 17m 50s. Rate: 7.1 symbols/min [2025-10-02T19:15:42.150227] [INFO ] [MAIN ] GRDN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:15:42.172060] [DEBUG] [LOCAL ] GRDN: Loaded 20512 existing records from primary storage. [2025-10-02T19:15:42.172327] [INFO ] [MAIN ] GRDN: Loaded 20512 existing records. [2025-10-02T19:15:42.370874] [WARN ] [MAIN ] GRDN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:15:42.371083] [INFO ] [MAIN ] GRDN: Wiping existing primary data before full refresh. [2025-10-02T19:15:42.371133] [INFO ] [LOCAL ] GRDN: Starting deletion of primary data. [2025-10-02T19:15:42.371810] [DEBUG] [LOCAL ] GRDN: Deleted primary data file. [2025-10-02T19:15:42.371873] [INFO ] [MAIN ] GRDN: Starting full primary refresh. [2025-10-02T19:15:42.675535] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-03. [2025-10-02T19:15:42.761145] [INFO ] [REMOTE ] GRDN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:15:43.153497] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-02T19:15:43.473049] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-02. [2025-10-02T19:15:44.246263] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-02T19:15:44.272971] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-04. [2025-10-02T19:15:44.445738] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-02T19:15:45.073005] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-03. [2025-10-02T19:15:45.812977] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-02T19:15:45.873020] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-05. [2025-10-02T19:15:45.971409] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-02T19:15:46.673018] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2024-12. [2025-10-02T19:15:47.473023] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-01. [2025-10-02T19:15:47.517000] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-02T19:15:47.931917] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-02T19:15:48.105382] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-02T19:15:48.272999] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-02. [2025-10-02T19:15:48.864245] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-02T19:15:49.073049] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-04. [2025-10-02T19:15:49.873013] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-01. [2025-10-02T19:15:50.441559] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-02T19:15:50.672996] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-05. [2025-10-02T19:15:50.689558] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-02T19:15:51.473035] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-06. [2025-10-02T19:15:51.887376] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-02T19:15:52.273008] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-02. [2025-10-02T19:15:52.658978] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-02T19:15:53.035102] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-02T19:15:53.072979] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-06. [2025-10-02T19:15:53.873029] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-03. [2025-10-02T19:15:54.244569] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-02T19:15:54.672983] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-07. [2025-10-02T19:15:54.955809] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-02T19:15:55.473019] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-07. [2025-10-02T19:15:55.869576] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-02T19:15:56.273002] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-03. [2025-10-02T19:15:56.692237] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-02T19:15:57.073012] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-08. [2025-10-02T19:15:57.128915] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-02T19:15:57.873028] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-04. [2025-10-02T19:15:58.313399] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-02T19:15:58.547349] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-02T19:15:58.673005] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-04. [2025-10-02T19:15:59.473019] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-09. [2025-10-02T19:15:59.485543] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-02T19:16:00.273006] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-08. [2025-10-02T19:16:01.072998] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-05. [2025-10-02T19:16:01.436685] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-02T19:16:01.864870] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-02T19:16:01.873020] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-09. [2025-10-02T19:16:02.625834] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-02T19:16:02.673021] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-10. [2025-10-02T19:16:03.119486] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-02T19:16:03.472996] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-10. [2025-10-02T19:16:04.059012] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-02T19:16:04.061228] [INFO ] [REMOTE ] GPRK: Full fetch complete (57451 records). [2025-10-02T19:16:04.061361] [DEBUG] [VALIDATOR ] GPRK: Validating primary data. [2025-10-02T19:16:04.283345] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-05. [2025-10-02T19:16:04.495325] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-02T19:16:04.513010] [DEBUG] [VALIDATOR ] GPRK: All expected trading days are present. [2025-10-02T19:16:04.513296] [DEBUG] [VALIDATOR ] GPRK: Primary data validation passed. [2025-10-02T19:16:04.513204] [INFO ] [REMOTE ] GRBK: Full fetch complete (40558 records). [2025-10-02T19:16:04.514306] [INFO ] [MAIN ] GPRK: Fetched primary data is valid. [2025-10-02T19:16:04.514393] [DEBUG] [LOCAL ] GPRK: Saving primary data. [2025-10-02T19:16:04.514637] [DEBUG] [VALIDATOR ] GRBK: Validating primary data. [2025-10-02T19:16:04.570107] [DEBUG] [LOCAL ] GPRK: Trimmed 57451 records to 39690 (keeping 200 days of data) [2025-10-02T19:16:05.081812] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-06. [2025-10-02T19:16:05.196967] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-02T19:16:05.201494] [DEBUG] [VALIDATOR ] GRBK: All expected trading days are present. [2025-10-02T19:16:05.202190] [DEBUG] [VALIDATOR ] GRBK: Primary data validation passed. [2025-10-02T19:16:05.204891] [INFO ] [MAIN ] GRBK: Fetched primary data is valid. [2025-10-02T19:16:05.205253] [DEBUG] [LOCAL ] GRBK: Saving primary data. [2025-10-02T19:16:05.213344] [DEBUG] [LOCAL ] GRBK: Trimmed 40558 records to 27074 (keeping 200 days of data) [2025-10-02T19:16:05.327027] [DEBUG] [LOCAL ] GPRK: Primary data saved (39690 records). [2025-10-02T19:16:05.336429] [INFO ] [MAIN ] GPRK: Full history saved. [2025-10-02T19:16:05.338726] [INFO ] [MAIN ] Update Progress: 965/2370 symbols completed. GPRK took 34.0s. Estimated remaining: 3h 18m 3s. Rate: 7.1 symbols/min [2025-10-02T19:16:05.577965] [DEBUG] [LOCAL ] GRBK: Primary data saved (27074 records). [2025-10-02T19:16:05.595102] [INFO ] [MAIN ] GRBK: Full history saved. [2025-10-02T19:16:05.599517] [INFO ] [MAIN ] Update Progress: 966/2370 symbols completed. GRBK took 29.5s. Estimated remaining: 3h 17m 42s. Rate: 7.1 symbols/min [2025-10-02T19:16:05.599340] [INFO ] [MAIN ] GRMN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:16:05.787941] [INFO ] [MAIN ] GRND: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:16:05.819615] [DEBUG] [LOCAL ] GRMN: Loaded 41016 existing records from primary storage. [2025-10-02T19:16:05.819994] [INFO ] [MAIN ] GRMN: Loaded 41016 existing records. [2025-10-02T19:16:05.877834] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-06. [2025-10-02T19:16:06.056844] [WARN ] [MAIN ] GRMN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:16:06.073671] [INFO ] [MAIN ] GRMN: Wiping existing primary data before full refresh. [2025-10-02T19:16:06.073774] [INFO ] [LOCAL ] GRMN: Starting deletion of primary data. [2025-10-02T19:16:06.075116] [DEBUG] [LOCAL ] GRND: Loaded 49918 existing records from primary storage. [2025-10-02T19:16:06.075380] [DEBUG] [LOCAL ] GRMN: Deleted primary data file. [2025-10-02T19:16:06.075460] [INFO ] [MAIN ] GRMN: Starting full primary refresh. [2025-10-02T19:16:06.080844] [INFO ] [MAIN ] GRND: Loaded 49918 existing records. [2025-10-02T19:16:06.330014] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-02T19:16:06.607821] [WARN ] [MAIN ] GRND: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:16:06.618582] [INFO ] [MAIN ] GRND: Wiping existing primary data before full refresh. [2025-10-02T19:16:06.632379] [INFO ] [LOCAL ] GRND: Starting deletion of primary data. [2025-10-02T19:16:06.647851] [DEBUG] [LOCAL ] GRND: Deleted primary data file. [2025-10-02T19:16:06.681360] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-07. [2025-10-02T19:16:06.681493] [INFO ] [MAIN ] GRND: Starting full primary refresh. [2025-10-02T19:16:06.726542] [INFO ] [REMOTE ] GRMN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:16:06.774744] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-02T19:16:07.147601] [INFO ] [REMOTE ] GRND: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:16:07.472999] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2024-12. [2025-10-02T19:16:07.747985] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-02T19:16:08.273003] [INFO ] [REMOTE ] GRND: Fetching primary data for 2024-12. [2025-10-02T19:16:09.040152] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-02T19:16:09.073011] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-01. [2025-10-02T19:16:09.753926] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-02T19:16:09.873044] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-08. [2025-10-02T19:16:10.668486] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-02T19:16:10.673174] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-01. [2025-10-02T19:16:10.803376] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-02T19:16:11.473013] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-07. [2025-10-02T19:16:12.001827] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-02T19:16:12.150280] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-02T19:16:12.273027] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-09. [2025-10-02T19:16:13.073052] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-08. [2025-10-02T19:16:13.271463] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-02T19:16:13.748901] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-02T19:16:13.873017] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-10. [2025-10-02T19:16:14.673044] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-02. [2025-10-02T19:16:14.969904] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-02T19:16:14.972190] [INFO ] [REMOTE ] GRDN: Full fetch complete (26329 records). [2025-10-02T19:16:14.972280] [DEBUG] [VALIDATOR ] GRDN: Validating primary data. [2025-10-02T19:16:15.376303] [DEBUG] [VALIDATOR ] GRDN: All expected trading days are present. [2025-10-02T19:16:15.376402] [DEBUG] [VALIDATOR ] GRDN: Primary data validation passed. [2025-10-02T19:16:15.377113] [INFO ] [MAIN ] GRDN: Fetched primary data is valid. [2025-10-02T19:16:15.377218] [DEBUG] [LOCAL ] GRDN: Saving primary data. [2025-10-02T19:16:15.378317] [DEBUG] [LOCAL ] GRDN: Trimmed 26329 records to 20716 (keeping 200 days of data) [2025-10-02T19:16:15.482685] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-02. [2025-10-02T19:16:15.526070] [DEBUG] [LOCAL ] GRDN: Primary data saved (20716 records). [2025-10-02T19:16:15.526210] [INFO ] [MAIN ] GRDN: Full history saved. [2025-10-02T19:16:15.526294] [INFO ] [MAIN ] Update Progress: 967/2370 symbols completed. GRDN took 33.6s. Estimated remaining: 3h 17m 36s. Rate: 7.1 symbols/min [2025-10-02T19:16:15.712842] [INFO ] [MAIN ] GRNT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:16:15.748112] [DEBUG] [LOCAL ] GRNT: Loaded 33794 existing records from primary storage. [2025-10-02T19:16:15.748425] [INFO ] [MAIN ] GRNT: Loaded 33794 existing records. [2025-10-02T19:16:15.950435] [WARN ] [MAIN ] GRNT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:16:15.950663] [INFO ] [MAIN ] GRNT: Wiping existing primary data before full refresh. [2025-10-02T19:16:15.950729] [INFO ] [LOCAL ] GRNT: Starting deletion of primary data. [2025-10-02T19:16:15.951685] [DEBUG] [LOCAL ] GRNT: Deleted primary data file. [2025-10-02T19:16:15.951747] [INFO ] [MAIN ] GRNT: Starting full primary refresh. [2025-10-02T19:16:16.275613] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-09. [2025-10-02T19:16:16.353246] [INFO ] [REMOTE ] GRNT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:16:16.383895] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-02T19:16:16.741075] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-02T19:16:17.072995] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2024-12. [2025-10-02T19:16:17.170759] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-02T19:16:17.873017] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-03. [2025-10-02T19:16:18.375527] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-02T19:16:18.673036] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-10. [2025-10-02T19:16:19.467260] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-02T19:16:19.468568] [INFO ] [REMOTE ] GRC: Full fetch complete (13142 records). [2025-10-02T19:16:19.468719] [DEBUG] [VALIDATOR ] GRC: Validating primary data. [2025-10-02T19:16:19.481058] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-03. [2025-10-02T19:16:19.627488] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-02T19:16:19.919348] [DEBUG] [VALIDATOR ] GRC: All expected trading days are present. [2025-10-02T19:16:19.919436] [DEBUG] [VALIDATOR ] GRC: Primary data validation passed. [2025-10-02T19:16:19.919887] [INFO ] [MAIN ] GRC: Fetched primary data is valid. [2025-10-02T19:16:19.919958] [DEBUG] [LOCAL ] GRC: Saving primary data. [2025-10-02T19:16:19.920557] [DEBUG] [LOCAL ] GRC: Trimmed 13142 records to 9062 (keeping 200 days of data) [2025-10-02T19:16:19.978915] [DEBUG] [LOCAL ] GRC: Primary data saved (9062 records). [2025-10-02T19:16:19.979061] [INFO ] [MAIN ] GRC: Full history saved. [2025-10-02T19:16:19.979150] [INFO ] [MAIN ] Update Progress: 968/2370 symbols completed. GRC took 41.6s. Estimated remaining: 3h 17m 22s. Rate: 7.1 symbols/min [2025-10-02T19:16:20.170035] [INFO ] [MAIN ] GROV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:16:20.181093] [DEBUG] [LOCAL ] GROV: Loaded 8902 existing records from primary storage. [2025-10-02T19:16:20.181425] [INFO ] [MAIN ] GROV: Loaded 8902 existing records. [2025-10-02T19:16:20.278880] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-04. [2025-10-02T19:16:20.379000] [WARN ] [MAIN ] GROV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:16:20.379220] [INFO ] [MAIN ] GROV: Wiping existing primary data before full refresh. [2025-10-02T19:16:20.379269] [INFO ] [LOCAL ] GROV: Starting deletion of primary data. [2025-10-02T19:16:20.379620] [DEBUG] [LOCAL ] GROV: Deleted primary data file. [2025-10-02T19:16:20.379718] [INFO ] [MAIN ] GROV: Starting full primary refresh. [2025-10-02T19:16:20.781827] [INFO ] [REMOTE ] GROV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:16:21.072990] [INFO ] [REMOTE ] GROV: Fetching primary data for 2024-12. [2025-10-02T19:16:21.341236] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-02T19:16:21.873031] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-04. [2025-10-02T19:16:21.920486] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-02T19:16:22.183784] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-02T19:16:22.673032] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-05. [2025-10-02T19:16:23.473012] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-01. [2025-10-02T19:16:23.597554] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-02T19:16:23.815559] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-02T19:16:24.154215] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-02T19:16:24.272986] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-05. [2025-10-02T19:16:25.073019] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-02. [2025-10-02T19:16:25.794439] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-02T19:16:25.827490] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-02T19:16:25.873023] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-06. [2025-10-02T19:16:26.672995] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-01. [2025-10-02T19:16:27.351255] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-02T19:16:27.472993] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-03. [2025-10-02T19:16:28.050058] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-02T19:16:28.217757] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-02T19:16:28.272996] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-04. [2025-10-02T19:16:28.757814] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-02T19:16:29.073007] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-07. [2025-10-02T19:16:29.873001] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-06. [2025-10-02T19:16:30.672973] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-02. [2025-10-02T19:16:30.703864] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-02T19:16:31.472975] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-08. [2025-10-02T19:16:31.533075] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-02T19:16:31.809475] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-02T19:16:32.273000] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-03. [2025-10-02T19:16:33.050847] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-02T19:16:33.072972] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-07. [2025-10-02T19:16:33.315537] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-02T19:16:33.873023] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-05. [2025-10-02T19:16:34.626159] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-02T19:16:34.672985] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-06. [2025-10-02T19:16:34.784900] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-02T19:16:35.472988] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-04. [2025-10-02T19:16:35.485860] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-02T19:16:36.273009] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-09. [2025-10-02T19:16:36.893630] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-02T19:16:37.073004] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-05. [2025-10-02T19:16:37.872996] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-08. [2025-10-02T19:16:37.937668] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-02T19:16:38.583992] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-02T19:16:38.673014] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-06. [2025-10-02T19:16:39.363395] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-02T19:16:39.473047] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-09. [2025-10-02T19:16:40.035849] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-02T19:16:40.272997] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-07. [2025-10-02T19:16:41.067770] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-02T19:16:41.078060] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-07. [2025-10-02T19:16:41.378310] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-02T19:16:41.873045] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-10. [2025-10-02T19:16:42.409323] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-02T19:16:42.673021] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-08. [2025-10-02T19:16:43.173131] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-02T19:16:43.282864] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-02T19:16:43.284875] [INFO ] [REMOTE ] GRND: Full fetch complete (70921 records). [2025-10-02T19:16:43.284978] [DEBUG] [VALIDATOR ] GRND: Validating primary data. [2025-10-02T19:16:43.478529] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-09. [2025-10-02T19:16:43.726421] [DEBUG] [VALIDATOR ] GRND: All expected trading days are present. [2025-10-02T19:16:43.726515] [DEBUG] [VALIDATOR ] GRND: Primary data validation passed. [2025-10-02T19:16:43.727597] [INFO ] [MAIN ] GRND: Fetched primary data is valid. [2025-10-02T19:16:43.727691] [DEBUG] [LOCAL ] GRND: Saving primary data. [2025-10-02T19:16:43.729341] [DEBUG] [LOCAL ] GRND: Trimmed 70921 records to 50304 (keeping 200 days of data) [2025-10-02T19:16:44.045334] [DEBUG] [LOCAL ] GRND: Primary data saved (50304 records). [2025-10-02T19:16:44.045484] [INFO ] [MAIN ] GRND: Full history saved. [2025-10-02T19:16:44.045574] [INFO ] [MAIN ] Update Progress: 969/2370 symbols completed. GRND took 38.4s. Estimated remaining: 3h 17m 36s. Rate: 7.1 symbols/min [2025-10-02T19:16:44.240097] [INFO ] [MAIN ] GRX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:16:44.246873] [DEBUG] [LOCAL ] GRX: Loaded 4663 existing records from primary storage. [2025-10-02T19:16:44.247089] [INFO ] [MAIN ] GRX: Loaded 4663 existing records. [2025-10-02T19:16:44.282971] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-08. [2025-10-02T19:16:44.399615] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-02T19:16:44.478428] [WARN ] [MAIN ] GRX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:16:44.478704] [INFO ] [MAIN ] GRX: Wiping existing primary data before full refresh. [2025-10-02T19:16:44.478771] [INFO ] [LOCAL ] GRX: Starting deletion of primary data. [2025-10-02T19:16:44.479083] [DEBUG] [LOCAL ] GRX: Deleted primary data file. [2025-10-02T19:16:44.479181] [INFO ] [MAIN ] GRX: Starting full primary refresh. [2025-10-02T19:16:44.871864] [INFO ] [REMOTE ] GRX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:16:45.072999] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-10. [2025-10-02T19:16:45.675399] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-02T19:16:45.873005] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-10. [2025-10-02T19:16:46.311586] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-02T19:16:46.313454] [INFO ] [REMOTE ] GRMN: Full fetch complete (59953 records). [2025-10-02T19:16:46.313591] [DEBUG] [VALIDATOR ] GRMN: Validating primary data. [2025-10-02T19:16:46.512101] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-02T19:16:46.540622] [INFO ] [REMOTE ] GROV: Full fetch complete (14355 records). [2025-10-02T19:16:46.589621] [DEBUG] [VALIDATOR ] GROV: Validating primary data. [2025-10-02T19:16:46.695984] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-09. [2025-10-02T19:16:46.945292] [DEBUG] [VALIDATOR ] GRMN: All expected trading days are present. [2025-10-02T19:16:46.960100] [DEBUG] [VALIDATOR ] GRMN: Primary data validation passed. [2025-10-02T19:16:47.011075] [INFO ] [MAIN ] GRMN: Fetched primary data is valid. [2025-10-02T19:16:47.041495] [DEBUG] [LOCAL ] GRMN: Saving primary data. [2025-10-02T19:16:47.104742] [DEBUG] [LOCAL ] GRMN: Trimmed 59953 records to 41310 (keeping 200 days of data) [2025-10-02T19:16:47.232409] [DEBUG] [VALIDATOR ] GROV: All expected trading days are present. [2025-10-02T19:16:47.232924] [DEBUG] [VALIDATOR ] GROV: Primary data validation passed. [2025-10-02T19:16:47.233145] [INFO ] [MAIN ] GROV: Fetched primary data is valid. [2025-10-02T19:16:47.267972] [DEBUG] [LOCAL ] GROV: Saving primary data. [2025-10-02T19:16:47.270852] [DEBUG] [LOCAL ] GROV: Trimmed 14355 records to 8931 (keeping 200 days of data) [2025-10-02T19:16:47.350367] [DEBUG] [LOCAL ] GROV: Primary data saved (8931 records). [2025-10-02T19:16:47.351616] [INFO ] [MAIN ] GROV: Full history saved. [2025-10-02T19:16:47.352084] [INFO ] [MAIN ] Update Progress: 970/2370 symbols completed. GROV took 27.4s. Estimated remaining: 3h 17m 20s. Rate: 7.1 symbols/min [2025-10-02T19:16:47.479700] [INFO ] [REMOTE ] GRX: Fetching primary data for 2024-12. [2025-10-02T19:16:47.689820] [INFO ] [MAIN ] GS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:16:47.760308] [DEBUG] [LOCAL ] GS: Loaded 51875 existing records from primary storage. [2025-10-02T19:16:47.761500] [INFO ] [MAIN ] GS: Loaded 51875 existing records. [2025-10-02T19:16:47.950038] [DEBUG] [LOCAL ] GRMN: Primary data saved (41310 records). [2025-10-02T19:16:47.984946] [INFO ] [MAIN ] GRMN: Full history saved. [2025-10-02T19:16:47.984523] [WARN ] [MAIN ] GS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:16:47.985151] [INFO ] [MAIN ] Update Progress: 971/2370 symbols completed. GRMN took 42.6s. Estimated remaining: 3h 17m 0s. Rate: 7.1 symbols/min [2025-10-02T19:16:47.985311] [INFO ] [MAIN ] GS: Wiping existing primary data before full refresh. [2025-10-02T19:16:47.985436] [INFO ] [LOCAL ] GS: Starting deletion of primary data. [2025-10-02T19:16:48.047578] [DEBUG] [LOCAL ] GS: Deleted primary data file. [2025-10-02T19:16:48.076932] [INFO ] [MAIN ] GS: Starting full primary refresh. [2025-10-02T19:16:48.299399] [INFO ] [MAIN ] GSBD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:16:48.306830] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-02T19:16:48.315241] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-01. [2025-10-02T19:16:48.360767] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-02T19:16:48.669833] [INFO ] [REMOTE ] GS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:16:48.671353] [DEBUG] [LOCAL ] GSBD: Loaded 39140 existing records from primary storage. [2025-10-02T19:16:48.672171] [INFO ] [MAIN ] GSBD: Loaded 39140 existing records. [2025-10-02T19:16:48.861063] [WARN ] [MAIN ] GSBD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:16:48.861341] [INFO ] [MAIN ] GSBD: Wiping existing primary data before full refresh. [2025-10-02T19:16:48.861397] [INFO ] [LOCAL ] GSBD: Starting deletion of primary data. [2025-10-02T19:16:48.862618] [DEBUG] [LOCAL ] GSBD: Deleted primary data file. [2025-10-02T19:16:48.862718] [INFO ] [MAIN ] GSBD: Starting full primary refresh. [2025-10-02T19:16:48.991898] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-02T19:16:49.078269] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-10. [2025-10-02T19:16:49.276027] [INFO ] [REMOTE ] GSBD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:16:49.873007] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-02. [2025-10-02T19:16:50.323782] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-02T19:16:50.325528] [INFO ] [REMOTE ] GRNT: Full fetch complete (48496 records). [2025-10-02T19:16:50.325627] [DEBUG] [VALIDATOR ] GRNT: Validating primary data. [2025-10-02T19:16:50.449193] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-02T19:16:50.678101] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-03. [2025-10-02T19:16:50.770440] [DEBUG] [VALIDATOR ] GRNT: All expected trading days are present. [2025-10-02T19:16:50.770536] [DEBUG] [VALIDATOR ] GRNT: Primary data validation passed. [2025-10-02T19:16:50.771488] [INFO ] [MAIN ] GRNT: Fetched primary data is valid. [2025-10-02T19:16:50.771559] [DEBUG] [LOCAL ] GRNT: Saving primary data. [2025-10-02T19:16:50.772856] [DEBUG] [LOCAL ] GRNT: Trimmed 48496 records to 34012 (keeping 200 days of data) [2025-10-02T19:16:50.990243] [DEBUG] [LOCAL ] GRNT: Primary data saved (34012 records). [2025-10-02T19:16:50.990400] [INFO ] [MAIN ] GRNT: Full history saved. [2025-10-02T19:16:50.992353] [INFO ] [MAIN ] Update Progress: 972/2370 symbols completed. GRNT took 35.5s. Estimated remaining: 3h 16m 44s. Rate: 7.1 symbols/min [2025-10-02T19:16:51.183128] [INFO ] [MAIN ] GSK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:16:51.239491] [DEBUG] [LOCAL ] GSK: Loaded 53493 existing records from primary storage. [2025-10-02T19:16:51.239920] [INFO ] [MAIN ] GSK: Loaded 53493 existing records. [2025-10-02T19:16:51.362154] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-02T19:16:51.450538] [WARN ] [MAIN ] GSK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:16:51.450822] [INFO ] [MAIN ] GSK: Wiping existing primary data before full refresh. [2025-10-02T19:16:51.450874] [INFO ] [LOCAL ] GSK: Starting deletion of primary data. [2025-10-02T19:16:51.452457] [DEBUG] [LOCAL ] GSK: Deleted primary data file. [2025-10-02T19:16:51.452522] [INFO ] [MAIN ] GSK: Starting full primary refresh. [2025-10-02T19:16:51.483317] [INFO ] [REMOTE ] GS: Fetching primary data for 2024-12. [2025-10-02T19:16:51.882288] [INFO ] [REMOTE ] GSK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:16:52.272997] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-04. [2025-10-02T19:16:52.871170] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-02T19:16:53.073039] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-05. [2025-10-02T19:16:53.549374] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-02T19:16:53.713858] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-02T19:16:53.873001] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-01. [2025-10-02T19:16:54.673013] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2024-12. [2025-10-02T19:16:55.473003] [INFO ] [REMOTE ] GSK: Fetching primary data for 2024-12. [2025-10-02T19:16:56.151832] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-10-02T19:16:56.272996] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-02. [2025-10-02T19:16:56.340361] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-02T19:16:56.951241] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-02T19:16:57.073015] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-01. [2025-10-02T19:16:57.872985] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-06. [2025-10-02T19:16:58.190708] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-02T19:16:58.255378] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-02T19:16:58.673027] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-01. [2025-10-02T19:16:58.970633] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-02T19:16:59.473046] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-07. [2025-10-02T19:16:59.860060] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-02T19:16:59.902332] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-02T19:17:00.273056] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-08. [2025-10-02T19:17:01.073003] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-02. [2025-10-02T19:17:01.190505] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-02T19:17:01.873064] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-02. [2025-10-02T19:17:02.639817] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-02T19:17:02.672990] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-03. [2025-10-02T19:17:03.472998] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-09. [2025-10-02T19:17:03.648723] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-02T19:17:04.225197] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-02T19:17:04.256748] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-02T19:17:04.272946] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-04. [2025-10-02T19:17:05.073016] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-03. [2025-10-02T19:17:05.872965] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-03. [2025-10-02T19:17:05.975913] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-02T19:17:06.673015] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-05. [2025-10-02T19:17:07.395725] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-10-02T19:17:07.472994] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-10. [2025-10-02T19:17:07.834090] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-02T19:17:08.177698] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-02T19:17:08.176703] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-02T19:17:08.187054] [INFO ] [REMOTE ] GRX: Full fetch complete (6659 records). [2025-10-02T19:17:08.187552] [DEBUG] [VALIDATOR ] GRX: Validating primary data. [2025-10-02T19:17:08.278134] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-04. [2025-10-02T19:17:08.573212] [DEBUG] [VALIDATOR ] GRX: All expected trading days are present. [2025-10-02T19:17:08.573293] [DEBUG] [VALIDATOR ] GRX: Primary data validation passed. [2025-10-02T19:17:08.573489] [INFO ] [MAIN ] GRX: Fetched primary data is valid. [2025-10-02T19:17:08.573532] [DEBUG] [LOCAL ] GRX: Saving primary data. [2025-10-02T19:17:08.573972] [DEBUG] [LOCAL ] GRX: Trimmed 6659 records to 4740 (keeping 200 days of data) [2025-10-02T19:17:08.602125] [DEBUG] [LOCAL ] GRX: Primary data saved (4740 records). [2025-10-02T19:17:08.602214] [INFO ] [MAIN ] GRX: Full history saved. [2025-10-02T19:17:08.602290] [INFO ] [MAIN ] Update Progress: 973/2370 symbols completed. GRX took 24.6s. Estimated remaining: 3h 16m 49s. Rate: 7.1 symbols/min [2025-10-02T19:17:08.780216] [INFO ] [MAIN ] GSL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:17:08.815248] [DEBUG] [LOCAL ] GSL: Loaded 33326 existing records from primary storage. [2025-10-02T19:17:08.815539] [INFO ] [MAIN ] GSL: Loaded 33326 existing records. [2025-10-02T19:17:09.012017] [WARN ] [MAIN ] GSL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:17:09.012224] [INFO ] [MAIN ] GSL: Wiping existing primary data before full refresh. [2025-10-02T19:17:09.012272] [INFO ] [LOCAL ] GSL: Starting deletion of primary data. [2025-10-02T19:17:09.013440] [DEBUG] [LOCAL ] GSL: Deleted primary data file. [2025-10-02T19:17:09.013510] [INFO ] [MAIN ] GSL: Starting full primary refresh. [2025-10-02T19:17:09.078105] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-04. [2025-10-02T19:17:09.430892] [INFO ] [REMOTE ] GSL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:17:09.873053] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-06. [2025-10-02T19:17:10.032481] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-02T19:17:10.673006] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-05. [2025-10-02T19:17:11.337316] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-02T19:17:11.442882] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-02T19:17:11.472999] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-07. [2025-10-02T19:17:12.273004] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-05. [2025-10-02T19:17:12.391628] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-02T19:17:13.073015] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-06. [2025-10-02T19:17:13.262294] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-02T19:17:13.873046] [INFO ] [REMOTE ] GSL: Fetching primary data for 2024-12. [2025-10-02T19:17:14.404521] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-02T19:17:14.673121] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-06. [2025-10-02T19:17:14.909686] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-02T19:17:15.256529] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-02T19:17:15.473033] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-01. [2025-10-02T19:17:16.272971] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-08. [2025-10-02T19:17:16.768856] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-02T19:17:16.831426] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-02T19:17:17.073007] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-07. [2025-10-02T19:17:17.757540] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-02T19:17:17.873000] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-09. [2025-10-02T19:17:18.673024] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-07. [2025-10-02T19:17:19.265922] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-02T19:17:19.377506] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-02T19:17:19.472999] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-10. [2025-10-02T19:17:20.273010] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-08. [2025-10-02T19:17:20.719493] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-02T19:17:20.914055] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-02T19:17:20.916034] [INFO ] [REMOTE ] GSBD: Full fetch complete (58474 records). [2025-10-02T19:17:20.916163] [DEBUG] [VALIDATOR ] GSBD: Validating primary data. [2025-10-02T19:17:21.078253] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-08. [2025-10-02T19:17:21.371471] [DEBUG] [VALIDATOR ] GSBD: All expected trading days are present. [2025-10-02T19:17:21.371562] [DEBUG] [VALIDATOR ] GSBD: Primary data validation passed. [2025-10-02T19:17:21.372516] [INFO ] [MAIN ] GSBD: Fetched primary data is valid. [2025-10-02T19:17:21.372587] [DEBUG] [LOCAL ] GSBD: Saving primary data. [2025-10-02T19:17:21.373984] [DEBUG] [LOCAL ] GSBD: Trimmed 58474 records to 39460 (keeping 200 days of data) [2025-10-02T19:17:21.632627] [DEBUG] [LOCAL ] GSBD: Primary data saved (39460 records). [2025-10-02T19:17:21.632883] [INFO ] [MAIN ] GSBD: Full history saved. [2025-10-02T19:17:21.633015] [INFO ] [MAIN ] Update Progress: 974/2370 symbols completed. GSBD took 33.6s. Estimated remaining: 3h 16m 47s. Rate: 7.1 symbols/min [2025-10-02T19:17:21.820932] [INFO ] [MAIN ] GTES: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:17:21.872976] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-02. [2025-10-02T19:17:21.904583] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-02T19:17:21.916406] [DEBUG] [LOCAL ] GTES: Loaded 50520 existing records from primary storage. [2025-10-02T19:17:21.918029] [INFO ] [MAIN ] GTES: Loaded 50520 existing records. [2025-10-02T19:17:22.121714] [WARN ] [MAIN ] GTES: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:17:22.121923] [INFO ] [MAIN ] GTES: Wiping existing primary data before full refresh. [2025-10-02T19:17:22.121972] [INFO ] [LOCAL ] GTES: Starting deletion of primary data. [2025-10-02T19:17:22.123417] [DEBUG] [LOCAL ] GTES: Deleted primary data file. [2025-10-02T19:17:22.123480] [INFO ] [MAIN ] GTES: Starting full primary refresh. [2025-10-02T19:17:22.547308] [INFO ] [REMOTE ] GTES: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:17:22.672970] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-09. [2025-10-02T19:17:22.946484] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-02T19:17:23.022595] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-02T19:17:23.473007] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-03. [2025-10-02T19:17:24.272992] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-09. [2025-10-02T19:17:24.427857] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-02T19:17:24.986178] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-02T19:17:25.072991] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-10. [2025-10-02T19:17:25.872990] [INFO ] [REMOTE ] GTES: Fetching primary data for 2024-12. [2025-10-02T19:17:26.182495] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-02T19:17:26.672997] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-04. [2025-10-02T19:17:26.805322] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-02T19:17:26.807323] [INFO ] [REMOTE ] GS: Full fetch complete (75689 records). [2025-10-02T19:17:26.807433] [DEBUG] [VALIDATOR ] GS: Validating primary data. [2025-10-02T19:17:27.248007] [DEBUG] [VALIDATOR ] GS: All expected trading days are present. [2025-10-02T19:17:27.248358] [DEBUG] [VALIDATOR ] GS: Primary data validation passed. [2025-10-02T19:17:27.249991] [INFO ] [MAIN ] GS: Fetched primary data is valid. [2025-10-02T19:17:27.250105] [DEBUG] [LOCAL ] GS: Saving primary data. [2025-10-02T19:17:27.251849] [DEBUG] [LOCAL ] GS: Trimmed 75689 records to 52244 (keeping 200 days of data) [2025-10-02T19:17:27.486344] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-10. [2025-10-02T19:17:27.531816] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-02T19:17:27.653452] [DEBUG] [LOCAL ] GS: Primary data saved (52244 records). [2025-10-02T19:17:27.653619] [INFO ] [MAIN ] GS: Full history saved. [2025-10-02T19:17:27.653763] [INFO ] [MAIN ] Update Progress: 975/2370 symbols completed. GS took 40.3s. Estimated remaining: 3h 16m 35s. Rate: 7.1 symbols/min [2025-10-02T19:17:27.860151] [INFO ] [MAIN ] GTLS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:17:27.906613] [DEBUG] [LOCAL ] GTLS: Loaded 42788 existing records from primary storage. [2025-10-02T19:17:27.906992] [INFO ] [MAIN ] GTLS: Loaded 42788 existing records. [2025-10-02T19:17:28.124544] [WARN ] [MAIN ] GTLS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:17:28.125022] [INFO ] [MAIN ] GTLS: Wiping existing primary data before full refresh. [2025-10-02T19:17:28.125097] [INFO ] [LOCAL ] GTLS: Starting deletion of primary data. [2025-10-02T19:17:28.133594] [DEBUG] [LOCAL ] GTLS: Deleted primary data file. [2025-10-02T19:17:28.147541] [INFO ] [MAIN ] GTLS: Starting full primary refresh. [2025-10-02T19:17:28.155005] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-02T19:17:28.278968] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-01. [2025-10-02T19:17:28.579103] [INFO ] [REMOTE ] GTLS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:17:29.072992] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-05. [2025-10-02T19:17:29.166438] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-02T19:17:29.168736] [INFO ] [REMOTE ] GSK: Full fetch complete (77471 records). [2025-10-02T19:17:29.168921] [DEBUG] [VALIDATOR ] GSK: Validating primary data. [2025-10-02T19:17:29.637029] [DEBUG] [VALIDATOR ] GSK: All expected trading days are present. [2025-10-02T19:17:29.637263] [DEBUG] [VALIDATOR ] GSK: Primary data validation passed. [2025-10-02T19:17:29.638587] [INFO ] [MAIN ] GSK: Fetched primary data is valid. [2025-10-02T19:17:29.638757] [DEBUG] [LOCAL ] GSK: Saving primary data. [2025-10-02T19:17:29.640507] [DEBUG] [LOCAL ] GSK: Trimmed 77471 records to 53882 (keeping 200 days of data) [2025-10-02T19:17:29.880898] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2024-12. [2025-10-02T19:17:30.037288] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-02T19:17:30.054514] [DEBUG] [LOCAL ] GSK: Primary data saved (53882 records). [2025-10-02T19:17:30.055257] [INFO ] [MAIN ] GSK: Full history saved. [2025-10-02T19:17:30.057818] [INFO ] [MAIN ] Update Progress: 976/2370 symbols completed. GSK took 39.1s. Estimated remaining: 3h 16m 18s. Rate: 7.1 symbols/min [2025-10-02T19:17:30.263232] [INFO ] [MAIN ] GTN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:17:30.308592] [DEBUG] [LOCAL ] GTN: Loaded 45476 existing records from primary storage. [2025-10-02T19:17:30.308919] [INFO ] [MAIN ] GTN: Loaded 45476 existing records. [2025-10-02T19:17:30.516460] [WARN ] [MAIN ] GTN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:17:30.516740] [INFO ] [MAIN ] GTN: Wiping existing primary data before full refresh. [2025-10-02T19:17:30.516809] [INFO ] [LOCAL ] GTN: Starting deletion of primary data. [2025-10-02T19:17:30.528344] [DEBUG] [LOCAL ] GTN: Deleted primary data file. [2025-10-02T19:17:30.546427] [INFO ] [MAIN ] GTN: Starting full primary refresh. [2025-10-02T19:17:30.622078] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-02T19:17:30.674434] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-02. [2025-10-02T19:17:30.979907] [INFO ] [REMOTE ] GTN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:17:31.441413] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-02T19:17:31.472959] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-01. [2025-10-02T19:17:32.279820] [INFO ] [REMOTE ] GTN: Fetching primary data for 2024-12. [2025-10-02T19:17:32.306811] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-02T19:17:33.029067] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-02T19:17:33.072980] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-02. [2025-10-02T19:17:33.724945] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-02T19:17:33.873008] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-03. [2025-10-02T19:17:34.496969] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-02T19:17:34.673037] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-06. [2025-10-02T19:17:35.472967] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-01. [2025-10-02T19:17:35.567316] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-02T19:17:35.996676] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-02T19:17:36.273011] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-07. [2025-10-02T19:17:37.041498] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-02T19:17:37.072969] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-02. [2025-10-02T19:17:37.705690] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-02T19:17:37.873044] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-08. [2025-10-02T19:17:38.619015] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-02T19:17:38.672998] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-04. [2025-10-02T19:17:38.778337] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-02T19:17:39.473006] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-09. [2025-10-02T19:17:40.051146] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-02T19:17:40.272999] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-05. [2025-10-02T19:17:40.557234] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-02T19:17:41.073008] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-10. [2025-10-02T19:17:41.873008] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-03. [2025-10-02T19:17:41.915325] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-02T19:17:41.917141] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-02T19:17:41.930176] [INFO ] [REMOTE ] GSL: Full fetch complete (47911 records). [2025-10-02T19:17:41.930550] [DEBUG] [VALIDATOR ] GSL: Validating primary data. [2025-10-02T19:17:42.363548] [DEBUG] [VALIDATOR ] GSL: All expected trading days are present. [2025-10-02T19:17:42.363632] [DEBUG] [VALIDATOR ] GSL: Primary data validation passed. [2025-10-02T19:17:42.364420] [INFO ] [MAIN ] GSL: Fetched primary data is valid. [2025-10-02T19:17:42.364474] [DEBUG] [LOCAL ] GSL: Saving primary data. [2025-10-02T19:17:42.365598] [DEBUG] [LOCAL ] GSL: Trimmed 47911 records to 33513 (keeping 200 days of data) [2025-10-02T19:17:42.585362] [DEBUG] [LOCAL ] GSL: Primary data saved (33513 records). [2025-10-02T19:17:42.585534] [INFO ] [MAIN ] GSL: Full history saved. [2025-10-02T19:17:42.585627] [INFO ] [MAIN ] Update Progress: 977/2370 symbols completed. GSL took 34.0s. Estimated remaining: 3h 16m 15s. Rate: 7.1 symbols/min [2025-10-02T19:17:42.678216] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-03. [2025-10-02T19:17:42.776800] [INFO ] [MAIN ] GTY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:17:42.818983] [DEBUG] [LOCAL ] GTY: Loaded 30286 existing records from primary storage. [2025-10-02T19:17:42.819331] [INFO ] [MAIN ] GTY: Loaded 30286 existing records. [2025-10-02T19:17:43.021460] [WARN ] [MAIN ] GTY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:17:43.022044] [INFO ] [MAIN ] GTY: Wiping existing primary data before full refresh. [2025-10-02T19:17:43.022197] [INFO ] [LOCAL ] GTY: Starting deletion of primary data. [2025-10-02T19:17:43.023252] [DEBUG] [LOCAL ] GTY: Deleted primary data file. [2025-10-02T19:17:43.023332] [INFO ] [MAIN ] GTY: Starting full primary refresh. [2025-10-02T19:17:43.414816] [INFO ] [REMOTE ] GTY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:17:43.444266] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-02T19:17:43.472989] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-04. [2025-10-02T19:17:44.273010] [INFO ] [REMOTE ] GTY: Fetching primary data for 2024-12. [2025-10-02T19:17:44.495896] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-02T19:17:44.764955] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-02T19:17:45.073013] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-06. [2025-10-02T19:17:45.382032] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-02T19:17:45.873060] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-04. [2025-10-02T19:17:46.673009] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-01. [2025-10-02T19:17:46.770117] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-02T19:17:47.472989] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-05. [2025-10-02T19:17:47.533756] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-02T19:17:47.612259] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-02T19:17:48.273044] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-05. [2025-10-02T19:17:48.779188] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-02T19:17:49.073022] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-07. [2025-10-02T19:17:49.873009] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-02. [2025-10-02T19:17:49.921924] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-02T19:17:50.672977] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-06. [2025-10-02T19:17:50.729116] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-02T19:17:50.794947] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-02T19:17:51.473070] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-03. [2025-10-02T19:17:52.219846] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-02T19:17:52.272978] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-07. [2025-10-02T19:17:52.897052] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-02T19:17:53.073001] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-08. [2025-10-02T19:17:53.872981] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-06. [2025-10-02T19:17:53.940896] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-02T19:17:54.404168] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-02T19:17:54.673005] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-09. [2025-10-02T19:17:55.451426] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-02T19:17:55.472967] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-07. [2025-10-02T19:17:56.272992] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-04. [2025-10-02T19:17:56.374535] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-02T19:17:56.972970] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-02T19:17:57.073029] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-08. [2025-10-02T19:17:57.743223] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-02T19:17:57.873017] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-10. [2025-10-02T19:17:58.672976] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-08. [2025-10-02T19:17:58.728028] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-02T19:17:59.322898] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-02T19:17:59.324873] [INFO ] [REMOTE ] GTES: Full fetch complete (73892 records). [2025-10-02T19:17:59.325011] [DEBUG] [VALIDATOR ] GTES: Validating primary data. [2025-10-02T19:17:59.483180] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-09. [2025-10-02T19:17:59.774588] [DEBUG] [VALIDATOR ] GTES: All expected trading days are present. [2025-10-02T19:17:59.774715] [DEBUG] [VALIDATOR ] GTES: Primary data validation passed. [2025-10-02T19:17:59.775725] [INFO ] [MAIN ] GTES: Fetched primary data is valid. [2025-10-02T19:17:59.775796] [DEBUG] [LOCAL ] GTES: Saving primary data. [2025-10-02T19:17:59.777467] [DEBUG] [LOCAL ] GTES: Trimmed 73892 records to 50882 (keeping 200 days of data) [2025-10-02T19:18:00.106469] [DEBUG] [LOCAL ] GTES: Primary data saved (50882 records). [2025-10-02T19:18:00.106622] [INFO ] [MAIN ] GTES: Full history saved. [2025-10-02T19:18:00.106780] [INFO ] [MAIN ] Update Progress: 978/2370 symbols completed. GTES took 38.5s. Estimated remaining: 3h 16m 20s. Rate: 7.1 symbols/min [2025-10-02T19:18:00.275755] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-05. [2025-10-02T19:18:00.313433] [INFO ] [MAIN ] GUG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:18:00.313803] [DEBUG] [LOCAL ] GUG: No existing data file found in primary storage. [2025-10-02T19:18:00.313919] [WARN ] [MAIN ] GUG: No existing data found, performing full refresh instead. [2025-10-02T19:18:00.314172] [INFO ] [MAIN ] GUG: Wiping existing primary data before full refresh. [2025-10-02T19:18:00.314235] [INFO ] [LOCAL ] GUG: Starting deletion of primary data. [2025-10-02T19:18:00.314304] [DEBUG] [LOCAL ] GUG: No primary data file found to delete. [2025-10-02T19:18:00.314340] [INFO ] [MAIN ] GUG: Starting full primary refresh. [2025-10-02T19:18:00.519169] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-02T19:18:00.767522] [INFO ] [REMOTE ] GUG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:18:01.072995] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-09. [2025-10-02T19:18:01.388764] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-02T19:18:01.872976] [INFO ] [REMOTE ] GUG: Fetching primary data for 2024-12. [2025-10-02T19:18:01.950014] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-02T19:18:02.274377] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-02T19:18:02.433477] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-02T19:18:02.673018] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-01. [2025-10-02T19:18:03.472992] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-06. [2025-10-02T19:18:03.734064] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-02T19:18:04.273046] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-10. [2025-10-02T19:18:04.636264] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-02T19:18:05.073016] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-10. [2025-10-02T19:18:05.644682] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-02T19:18:05.646561] [INFO ] [REMOTE ] GTN: Full fetch complete (66415 records). [2025-10-02T19:18:05.646709] [DEBUG] [VALIDATOR ] GTN: Validating primary data. [2025-10-02T19:18:05.878145] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-07. [2025-10-02T19:18:06.095048] [DEBUG] [VALIDATOR ] GTN: All expected trading days are present. [2025-10-02T19:18:06.095141] [DEBUG] [VALIDATOR ] GTN: Primary data validation passed. [2025-10-02T19:18:06.096185] [INFO ] [MAIN ] GTN: Fetched primary data is valid. [2025-10-02T19:18:06.096254] [DEBUG] [LOCAL ] GTN: Saving primary data. [2025-10-02T19:18:06.097699] [DEBUG] [LOCAL ] GTN: Trimmed 66415 records to 45825 (keeping 200 days of data) [2025-10-02T19:18:06.386810] [DEBUG] [LOCAL ] GTN: Primary data saved (45825 records). [2025-10-02T19:18:06.386992] [INFO ] [MAIN ] GTN: Full history saved. [2025-10-02T19:18:06.387632] [INFO ] [MAIN ] Update Progress: 979/2370 symbols completed. GTN took 36.3s. Estimated remaining: 3h 16m 8s. Rate: 7.1 symbols/min [2025-10-02T19:18:06.575217] [INFO ] [MAIN ] GUT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:18:06.594784] [DEBUG] [LOCAL ] GUT: Loaded 15316 existing records from primary storage. [2025-10-02T19:18:06.595041] [INFO ] [MAIN ] GUT: Loaded 15316 existing records. [2025-10-02T19:18:06.678064] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-02. [2025-10-02T19:18:06.798735] [WARN ] [MAIN ] GUT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:18:06.798967] [INFO ] [MAIN ] GUT: Wiping existing primary data before full refresh. [2025-10-02T19:18:06.799026] [INFO ] [LOCAL ] GUT: Starting deletion of primary data. [2025-10-02T19:18:06.799631] [DEBUG] [LOCAL ] GUT: Deleted primary data file. [2025-10-02T19:18:06.799724] [INFO ] [MAIN ] GUT: Starting full primary refresh. [2025-10-02T19:18:07.190359] [INFO ] [REMOTE ] GUT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:18:07.296494] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-02T19:18:07.473003] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-08. [2025-10-02T19:18:07.571351] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-02T19:18:08.273007] [INFO ] [REMOTE ] GUT: Fetching primary data for 2024-12. [2025-10-02T19:18:08.858512] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-02T19:18:09.072966] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-09. [2025-10-02T19:18:09.217741] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-10 (4.14 seconds). [2025-10-02T19:18:09.219261] [INFO ] [REMOTE ] GTLS: Full fetch complete (61089 records). [2025-10-02T19:18:09.219356] [DEBUG] [VALIDATOR ] GTLS: Validating primary data. [2025-10-02T19:18:09.220105] [FATAL] [VALIDATOR ] GTLS: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:18:09.220199] [FATAL] [MAIN ] GTLS: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:18:09.220244] [WARN ] [MAIN ] GTLS: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:18:09.220311] [INFO ] [LOCAL ] GTLS: Starting deletion of primary data. [2025-10-02T19:18:09.220394] [DEBUG] [LOCAL ] GTLS: No primary data file found to delete. [2025-10-02T19:18:09.220451] [INFO ] [LOCAL ] GTLS: Starting deletion of derivative data. [2025-10-02T19:18:09.220888] [DEBUG] [LOCAL ] GTLS: Deleted derivative data file. [2025-10-02T19:18:09.220987] [INFO ] [MAIN ] Update Progress: 980/2370 symbols completed. GTLS took 41.6s. Estimated remaining: 3h 15m 52s. Rate: 7.1 symbols/min [2025-10-02T19:18:09.422281] [INFO ] [MAIN ] GVA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:18:09.423520] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-02T19:18:09.470998] [DEBUG] [LOCAL ] GVA: Loaded 33140 existing records from primary storage. [2025-10-02T19:18:09.471282] [INFO ] [MAIN ] GVA: Loaded 33140 existing records. [2025-10-02T19:18:09.660138] [WARN ] [MAIN ] GVA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:18:09.660391] [INFO ] [MAIN ] GVA: Wiping existing primary data before full refresh. [2025-10-02T19:18:09.660447] [INFO ] [LOCAL ] GVA: Starting deletion of primary data. [2025-10-02T19:18:09.661511] [DEBUG] [LOCAL ] GVA: Deleted primary data file. [2025-10-02T19:18:09.661583] [INFO ] [MAIN ] GVA: Starting full primary refresh. [2025-10-02T19:18:09.878217] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-01. [2025-10-02T19:18:10.063385] [INFO ] [REMOTE ] GVA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:18:10.388277] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-02T19:18:10.587463] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-02T19:18:10.673034] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-02. [2025-10-02T19:18:11.472999] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-03. [2025-10-02T19:18:11.495878] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-02T19:18:12.237826] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-02T19:18:12.272991] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-03. [2025-10-02T19:18:13.073031] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-04. [2025-10-02T19:18:13.188310] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-02T19:18:13.872966] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-04. [2025-10-02T19:18:13.957101] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-02T19:18:14.588605] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-02T19:18:14.673020] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-05. [2025-10-02T19:18:15.468299] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-02T19:18:15.472946] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-06. [2025-10-02T19:18:16.272988] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-05. [2025-10-02T19:18:16.353821] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-02T19:18:17.073035] [INFO ] [REMOTE ] GVA: Fetching primary data for 2024-12. [2025-10-02T19:18:17.167537] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-02T19:18:17.872968] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-10. [2025-10-02T19:18:18.199785] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-02T19:18:18.673024] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-06. [2025-10-02T19:18:18.948386] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-02T19:18:18.950216] [INFO ] [REMOTE ] GTY: Full fetch complete (43506 records). [2025-10-02T19:18:18.950317] [DEBUG] [VALIDATOR ] GTY: Validating primary data. [2025-10-02T19:18:19.367573] [DEBUG] [VALIDATOR ] GTY: All expected trading days are present. [2025-10-02T19:18:19.367686] [DEBUG] [VALIDATOR ] GTY: Primary data validation passed. [2025-10-02T19:18:19.368424] [INFO ] [MAIN ] GTY: Fetched primary data is valid. [2025-10-02T19:18:19.368490] [DEBUG] [LOCAL ] GTY: Saving primary data. [2025-10-02T19:18:19.369763] [DEBUG] [LOCAL ] GTY: Trimmed 43506 records to 30501 (keeping 200 days of data) [2025-10-02T19:18:19.480702] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-07. [2025-10-02T19:18:19.578965] [DEBUG] [LOCAL ] GTY: Primary data saved (30501 records). [2025-10-02T19:18:19.579118] [INFO ] [MAIN ] GTY: Full history saved. [2025-10-02T19:18:19.579236] [INFO ] [MAIN ] Update Progress: 981/2370 symbols completed. GTY took 37.0s. Estimated remaining: 3h 15m 46s. Rate: 7.1 symbols/min [2025-10-02T19:18:19.731143] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-02T19:18:19.789079] [INFO ] [MAIN ] GWH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:18:19.808442] [DEBUG] [LOCAL ] GWH: Loaded 16083 existing records from primary storage. [2025-10-02T19:18:19.808828] [INFO ] [MAIN ] GWH: Loaded 16083 existing records. [2025-10-02T19:18:19.998845] [WARN ] [MAIN ] GWH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:18:19.999097] [INFO ] [MAIN ] GWH: Wiping existing primary data before full refresh. [2025-10-02T19:18:19.999145] [INFO ] [LOCAL ] GWH: Starting deletion of primary data. [2025-10-02T19:18:19.999857] [DEBUG] [LOCAL ] GWH: Deleted primary data file. [2025-10-02T19:18:19.999918] [INFO ] [MAIN ] GWH: Starting full primary refresh. [2025-10-02T19:18:20.277323] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-07. [2025-10-02T19:18:20.406785] [INFO ] [REMOTE ] GWH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:18:20.418028] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-02T19:18:21.073034] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-01. [2025-10-02T19:18:21.287134] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-02T19:18:21.872995] [INFO ] [REMOTE ] GWH: Fetching primary data for 2024-12. [2025-10-02T19:18:22.034179] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-02T19:18:22.504312] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-02T19:18:22.672990] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-08. [2025-10-02T19:18:23.284242] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-02T19:18:23.473049] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-02. [2025-10-02T19:18:24.273004] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-08. [2025-10-02T19:18:24.758503] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-02T19:18:24.977130] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-02T19:18:25.072993] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-03. [2025-10-02T19:18:25.872992] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-09. [2025-10-02T19:18:26.672983] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-01. [2025-10-02T19:18:26.708756] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-02T19:18:26.855790] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-02T19:18:27.457015] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-02T19:18:27.472977] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-02. [2025-10-02T19:18:28.273018] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-10. [2025-10-02T19:18:28.287027] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-02T19:18:28.966173] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-02T19:18:28.967217] [INFO ] [REMOTE ] GUG: Full fetch complete (19848 records). [2025-10-02T19:18:28.967301] [DEBUG] [VALIDATOR ] GUG: Validating primary data. [2025-10-02T19:18:29.078074] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-03. [2025-10-02T19:18:29.376168] [DEBUG] [VALIDATOR ] GUG: All expected trading days are present. [2025-10-02T19:18:29.376284] [DEBUG] [VALIDATOR ] GUG: Primary data validation passed. [2025-10-02T19:18:29.376802] [INFO ] [MAIN ] GUG: Fetched primary data is valid. [2025-10-02T19:18:29.376869] [DEBUG] [LOCAL ] GUG: Saving primary data. [2025-10-02T19:18:29.377437] [DEBUG] [LOCAL ] GUG: Trimmed 19848 records to 12171 (keeping 200 days of data) [2025-10-02T19:18:29.455105] [DEBUG] [LOCAL ] GUG: Primary data saved (12171 records). [2025-10-02T19:18:29.455249] [INFO ] [MAIN ] GUG: Full history saved. [2025-10-02T19:18:29.455340] [INFO ] [MAIN ] Update Progress: 982/2370 symbols completed. GUG took 29.3s. Estimated remaining: 3h 15m 40s. Rate: 7.1 symbols/min [2025-10-02T19:18:29.639274] [INFO ] [MAIN ] GWRE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:18:29.639446] [DEBUG] [LOCAL ] GWRE: No existing data file found in primary storage. [2025-10-02T19:18:29.639487] [WARN ] [MAIN ] GWRE: No existing data found, performing full refresh instead. [2025-10-02T19:18:29.639603] [INFO ] [MAIN ] GWRE: Wiping existing primary data before full refresh. [2025-10-02T19:18:29.639669] [INFO ] [LOCAL ] GWRE: Starting deletion of primary data. [2025-10-02T19:18:29.639738] [DEBUG] [LOCAL ] GWRE: No primary data file found to delete. [2025-10-02T19:18:29.639775] [INFO ] [MAIN ] GWRE: Starting full primary refresh. [2025-10-02T19:18:29.879564] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-04. [2025-10-02T19:18:29.909966] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-02T19:18:30.059204] [INFO ] [REMOTE ] GWRE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:18:30.673050] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-09. [2025-10-02T19:18:31.463125] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-02T19:18:31.472947] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-05. [2025-10-02T19:18:31.517092] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-02T19:18:32.273004] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-10. [2025-10-02T19:18:32.837661] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-02T19:18:32.838826] [INFO ] [REMOTE ] GUT: Full fetch complete (22725 records). [2025-10-02T19:18:32.838925] [DEBUG] [VALIDATOR ] GUT: Validating primary data. [2025-10-02T19:18:33.057702] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-02T19:18:33.081916] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2024-12. [2025-10-02T19:18:33.347943] [DEBUG] [VALIDATOR ] GUT: All expected trading days are present. [2025-10-02T19:18:33.348078] [DEBUG] [VALIDATOR ] GUT: Primary data validation passed. [2025-10-02T19:18:33.348611] [INFO ] [MAIN ] GUT: Fetched primary data is valid. [2025-10-02T19:18:33.348699] [DEBUG] [LOCAL ] GUT: Saving primary data. [2025-10-02T19:18:33.349515] [DEBUG] [LOCAL ] GUT: Trimmed 22725 records to 15401 (keeping 200 days of data) [2025-10-02T19:18:33.441937] [DEBUG] [LOCAL ] GUT: Primary data saved (15401 records). [2025-10-02T19:18:33.442086] [INFO ] [MAIN ] GUT: Full history saved. [2025-10-02T19:18:33.442169] [INFO ] [MAIN ] Update Progress: 983/2370 symbols completed. GUT took 27.1s. Estimated remaining: 3h 15m 25s. Rate: 7.1 symbols/min [2025-10-02T19:18:33.629754] [INFO ] [MAIN ] GWW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:18:33.651350] [DEBUG] [LOCAL ] GWW: Loaded 19477 existing records from primary storage. [2025-10-02T19:18:33.651624] [INFO ] [MAIN ] GWW: Loaded 19477 existing records. [2025-10-02T19:18:33.845096] [WARN ] [MAIN ] GWW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:18:33.845315] [INFO ] [MAIN ] GWW: Wiping existing primary data before full refresh. [2025-10-02T19:18:33.845371] [INFO ] [LOCAL ] GWW: Starting deletion of primary data. [2025-10-02T19:18:33.846352] [DEBUG] [LOCAL ] GWW: Deleted primary data file. [2025-10-02T19:18:33.846417] [INFO ] [MAIN ] GWW: Starting full primary refresh. [2025-10-02T19:18:33.881169] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-06. [2025-10-02T19:18:34.234758] [INFO ] [REMOTE ] GWW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:18:34.506618] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-02T19:18:34.673011] [INFO ] [REMOTE ] GWW: Fetching primary data for 2024-12. [2025-10-02T19:18:35.328504] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-02T19:18:35.472987] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-07. [2025-10-02T19:18:35.703252] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-02T19:18:36.273048] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-01. [2025-10-02T19:18:36.520606] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-02T19:18:37.072975] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-04. [2025-10-02T19:18:37.442453] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-02T19:18:37.840928] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-02T19:18:37.872999] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-05. [2025-10-02T19:18:38.673035] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-08. [2025-10-02T19:18:39.002757] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-02T19:18:39.473019] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-01. [2025-10-02T19:18:40.083256] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-02T19:18:40.273065] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-06. [2025-10-02T19:18:40.870693] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-02T19:18:41.073009] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-02. [2025-10-02T19:18:41.381291] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-02T19:18:41.873043] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-07. [2025-10-02T19:18:42.660494] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-02T19:18:42.672952] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-03. [2025-10-02T19:18:43.323720] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-02T19:18:43.473036] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-08. [2025-10-02T19:18:44.272973] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-02. [2025-10-02T19:18:44.480566] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-02T19:18:44.530180] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-02T19:18:45.072977] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-04. [2025-10-02T19:18:45.256207] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-02T19:18:45.873044] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-09. [2025-10-02T19:18:46.677041] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-09. [2025-10-02T19:18:46.683249] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-02T19:18:47.107724] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-02T19:18:47.376140] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-02T19:18:47.473011] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-05. [2025-10-02T19:18:48.273045] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-10. [2025-10-02T19:18:48.972495] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-02T19:18:49.072978] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-03. [2025-10-02T19:18:49.134782] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-02T19:18:49.135930] [INFO ] [REMOTE ] GWH: Full fetch complete (21261 records). [2025-10-02T19:18:49.136006] [DEBUG] [VALIDATOR ] GWH: Validating primary data. [2025-10-02T19:18:49.533393] [DEBUG] [VALIDATOR ] GWH: All expected trading days are present. [2025-10-02T19:18:49.533471] [DEBUG] [VALIDATOR ] GWH: Primary data validation passed. [2025-10-02T19:18:49.534027] [INFO ] [MAIN ] GWH: Fetched primary data is valid. [2025-10-02T19:18:49.534091] [DEBUG] [LOCAL ] GWH: Saving primary data. [2025-10-02T19:18:49.534723] [DEBUG] [LOCAL ] GWH: Trimmed 21261 records to 16198 (keeping 200 days of data) [2025-10-02T19:18:49.627768] [DEBUG] [LOCAL ] GWH: Primary data saved (16198 records). [2025-10-02T19:18:49.627911] [INFO ] [MAIN ] GWH: Full history saved. [2025-10-02T19:18:49.628013] [INFO ] [MAIN ] Update Progress: 984/2370 symbols completed. GWH took 30.0s. Estimated remaining: 3h 15m 27s. Rate: 7.1 symbols/min [2025-10-02T19:18:49.816584] [INFO ] [MAIN ] GXO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:18:49.816830] [DEBUG] [LOCAL ] GXO: No existing data file found in primary storage. [2025-10-02T19:18:49.816882] [WARN ] [MAIN ] GXO: No existing data found, performing full refresh instead. [2025-10-02T19:18:49.817023] [INFO ] [MAIN ] GXO: Wiping existing primary data before full refresh. [2025-10-02T19:18:49.817097] [INFO ] [LOCAL ] GXO: Starting deletion of primary data. [2025-10-02T19:18:49.817166] [DEBUG] [LOCAL ] GXO: No primary data file found to delete. [2025-10-02T19:18:49.817213] [INFO ] [MAIN ] GXO: Starting full primary refresh. [2025-10-02T19:18:49.877762] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-10. [2025-10-02T19:18:50.249933] [INFO ] [REMOTE ] GXO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:18:50.264908] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-02T19:18:50.673040] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-06. [2025-10-02T19:18:50.943356] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-02T19:18:50.945107] [INFO ] [REMOTE ] GVA: Full fetch complete (48584 records). [2025-10-02T19:18:50.945248] [DEBUG] [VALIDATOR ] GVA: Validating primary data. [2025-10-02T19:18:51.362218] [DEBUG] [VALIDATOR ] GVA: All expected trading days are present. [2025-10-02T19:18:51.362300] [DEBUG] [VALIDATOR ] GVA: Primary data validation passed. [2025-10-02T19:18:51.363155] [INFO ] [MAIN ] GVA: Fetched primary data is valid. [2025-10-02T19:18:51.363222] [DEBUG] [LOCAL ] GVA: Saving primary data. [2025-10-02T19:18:51.364277] [DEBUG] [LOCAL ] GVA: Trimmed 48584 records to 33350 (keeping 200 days of data) [2025-10-02T19:18:51.475066] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-04. [2025-10-02T19:18:51.590079] [DEBUG] [LOCAL ] GVA: Primary data saved (33350 records). [2025-10-02T19:18:51.590214] [INFO ] [MAIN ] GVA: Full history saved. [2025-10-02T19:18:51.590302] [INFO ] [MAIN ] Update Progress: 985/2370 symbols completed. GVA took 42.4s. Estimated remaining: 3h 15m 10s. Rate: 7.1 symbols/min [2025-10-02T19:18:51.773020] [INFO ] [MAIN ] GYLD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:18:51.773195] [DEBUG] [LOCAL ] GYLD: No existing data file found in primary storage. [2025-10-02T19:18:51.773234] [WARN ] [MAIN ] GYLD: No existing data found, performing full refresh instead. [2025-10-02T19:18:51.773353] [INFO ] [MAIN ] GYLD: Wiping existing primary data before full refresh. [2025-10-02T19:18:51.773396] [INFO ] [LOCAL ] GYLD: Starting deletion of primary data. [2025-10-02T19:18:51.773438] [DEBUG] [LOCAL ] GYLD: No primary data file found to delete. [2025-10-02T19:18:51.773473] [INFO ] [MAIN ] GYLD: Starting full primary refresh. [2025-10-02T19:18:52.194710] [INFO ] [REMOTE ] GYLD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:18:52.228327] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-02T19:18:52.272973] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-07. [2025-10-02T19:18:52.711619] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-02T19:18:53.073025] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2024-12. [2025-10-02T19:18:53.593131] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-02T19:18:53.612011] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-02T19:18:53.873035] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-08. [2025-10-02T19:18:54.673047] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-05. [2025-10-02T19:18:55.160556] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-02T19:18:55.336597] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-02T19:18:55.473005] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-01. [2025-10-02T19:18:55.811778] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-02T19:18:56.273004] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-09. [2025-10-02T19:18:57.073027] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-06. [2025-10-02T19:18:57.767794] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-02T19:18:57.872980] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-10. [2025-10-02T19:18:58.064813] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-02T19:18:58.673025] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-07. [2025-10-02T19:18:59.473027] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-02. [2025-10-02T19:18:59.768387] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-02T19:18:59.821602] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-02T19:19:00.273048] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-03. [2025-10-02T19:19:00.770807] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-02T19:19:00.984282] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-10 (3.11 seconds). [2025-10-02T19:19:00.985736] [INFO ] [REMOTE ] GWRE: Full fetch complete (60782 records). [2025-10-02T19:19:00.985837] [DEBUG] [VALIDATOR ] GWRE: Validating primary data. [2025-10-02T19:19:00.986435] [FATAL] [VALIDATOR ] GWRE: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:19:00.986524] [FATAL] [MAIN ] GWRE: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:19:00.986569] [WARN ] [MAIN ] GWRE: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:19:00.986636] [INFO ] [LOCAL ] GWRE: Starting deletion of primary data. [2025-10-02T19:19:00.986741] [DEBUG] [LOCAL ] GWRE: No primary data file found to delete. [2025-10-02T19:19:00.986782] [INFO ] [LOCAL ] GWRE: Starting deletion of derivative data. [2025-10-02T19:19:00.986824] [DEBUG] [LOCAL ] GWRE: No derivative data file found to delete. [2025-10-02T19:19:00.986881] [INFO ] [MAIN ] Update Progress: 986/2370 symbols completed. GWRE took 31.5s. Estimated remaining: 3h 15m 2s. Rate: 7.1 symbols/min [2025-10-02T19:19:01.078211] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-08. [2025-10-02T19:19:01.211037] [INFO ] [MAIN ] H: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:19:01.211238] [DEBUG] [LOCAL ] H: No existing data file found in primary storage. [2025-10-02T19:19:01.211279] [WARN ] [MAIN ] H: No existing data found, performing full refresh instead. [2025-10-02T19:19:01.211425] [INFO ] [MAIN ] H: Wiping existing primary data before full refresh. [2025-10-02T19:19:01.211469] [INFO ] [LOCAL ] H: Starting deletion of primary data. [2025-10-02T19:19:01.211512] [DEBUG] [LOCAL ] H: No primary data file found to delete. [2025-10-02T19:19:01.211546] [INFO ] [MAIN ] H: Starting full primary refresh. [2025-10-02T19:19:01.608901] [INFO ] [REMOTE ] H: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:19:01.873048] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-04. [2025-10-02T19:19:02.318761] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-02T19:19:02.327432] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-02T19:19:02.672990] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-05. [2025-10-02T19:19:03.027408] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-02T19:19:03.473008] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-06. [2025-10-02T19:19:03.924071] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-02T19:19:04.273055] [INFO ] [REMOTE ] H: Fetching primary data for 2024-12. [2025-10-02T19:19:05.073015] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-09. [2025-10-02T19:19:05.461503] [INFO ] [REMOTE ] H: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-02T19:19:05.872972] [INFO ] [REMOTE ] GXO: Fetching primary data for 2024-12. [2025-10-02T19:19:06.177914] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-02T19:19:06.673036] [INFO ] [REMOTE ] H: Fetching primary data for 2025-01. [2025-10-02T19:19:07.473045] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-07. [2025-10-02T19:19:07.518917] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-02T19:19:07.947245] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-02T19:19:08.113636] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-02T19:19:08.273014] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-08. [2025-10-02T19:19:08.635840] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-02T19:19:09.073023] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-10. [2025-10-02T19:19:09.873024] [INFO ] [REMOTE ] H: Fetching primary data for 2025-02. [2025-10-02T19:19:10.673001] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-01. [2025-10-02T19:19:11.420457] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-02T19:19:11.473062] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-09. [2025-10-02T19:19:11.772527] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-10 (2.70 seconds). [2025-10-02T19:19:11.773743] [INFO ] [REMOTE ] GWW: Full fetch complete (29153 records). [2025-10-02T19:19:11.773836] [DEBUG] [VALIDATOR ] GWW: Validating primary data. [2025-10-02T19:19:11.774418] [FATAL] [VALIDATOR ] GWW: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:19:11.774509] [FATAL] [MAIN ] GWW: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:19:11.774589] [WARN ] [MAIN ] GWW: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:19:11.774668] [INFO ] [LOCAL ] GWW: Starting deletion of primary data. [2025-10-02T19:19:11.774769] [DEBUG] [LOCAL ] GWW: No primary data file found to delete. [2025-10-02T19:19:11.774828] [INFO ] [LOCAL ] GWW: Starting deletion of derivative data. [2025-10-02T19:19:11.775419] [DEBUG] [LOCAL ] GWW: Deleted derivative data file. [2025-10-02T19:19:11.775518] [INFO ] [MAIN ] Update Progress: 987/2370 symbols completed. GWW took 38.3s. Estimated remaining: 3h 14m 57s. Rate: 7.1 symbols/min [2025-10-02T19:19:11.972043] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-02T19:19:11.976678] [INFO ] [MAIN ] HAE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:19:11.978596] [DEBUG] [LOCAL ] HAE: No existing data file found in primary storage. [2025-10-02T19:19:11.978767] [WARN ] [MAIN ] HAE: No existing data found, performing full refresh instead. [2025-10-02T19:19:11.979004] [INFO ] [MAIN ] HAE: Wiping existing primary data before full refresh. [2025-10-02T19:19:11.979132] [INFO ] [LOCAL ] HAE: Starting deletion of primary data. [2025-10-02T19:19:11.979212] [DEBUG] [LOCAL ] HAE: No primary data file found to delete. [2025-10-02T19:19:11.979365] [INFO ] [MAIN ] HAE: Starting full primary refresh. [2025-10-02T19:19:12.191375] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-02T19:19:12.278080] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-10. [2025-10-02T19:19:12.440789] [INFO ] [REMOTE ] HAE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:19:13.073061] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-02. [2025-10-02T19:19:13.873033] [INFO ] [REMOTE ] H: Fetching primary data for 2025-03. [2025-10-02T19:19:14.673018] [INFO ] [REMOTE ] HAE: Fetching primary data for 2024-12. [2025-10-02T19:19:14.747322] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-02T19:19:15.174698] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-02T19:19:15.472999] [INFO ] [REMOTE ] H: Fetching primary data for 2025-04. [2025-10-02T19:19:15.707465] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-10 (3.43 seconds). [2025-10-02T19:19:15.708401] [INFO ] [REMOTE ] GYLD: Full fetch complete (2068 records). [2025-10-02T19:19:15.708474] [DEBUG] [VALIDATOR ] GYLD: Validating primary data. [2025-10-02T19:19:15.708921] [FATAL] [VALIDATOR ] GYLD: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:19:15.709010] [FATAL] [MAIN ] GYLD: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:19:15.709053] [WARN ] [MAIN ] GYLD: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:19:15.709121] [INFO ] [LOCAL ] GYLD: Starting deletion of primary data. [2025-10-02T19:19:15.709193] [DEBUG] [LOCAL ] GYLD: No primary data file found to delete. [2025-10-02T19:19:15.709231] [INFO ] [LOCAL ] GYLD: Starting deletion of derivative data. [2025-10-02T19:19:15.709270] [DEBUG] [LOCAL ] GYLD: No derivative data file found to delete. [2025-10-02T19:19:15.709329] [INFO ] [MAIN ] Update Progress: 988/2370 symbols completed. GYLD took 24.1s. Estimated remaining: 3h 14m 43s. Rate: 7.1 symbols/min [2025-10-02T19:19:15.880720] [INFO ] [MAIN ] HAFN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:19:15.881194] [DEBUG] [LOCAL ] HAFN: No existing data file found in primary storage. [2025-10-02T19:19:15.881327] [WARN ] [MAIN ] HAFN: No existing data found, performing full refresh instead. [2025-10-02T19:19:15.881468] [INFO ] [MAIN ] HAFN: Wiping existing primary data before full refresh. [2025-10-02T19:19:15.881512] [INFO ] [LOCAL ] HAFN: Starting deletion of primary data. [2025-10-02T19:19:15.881556] [DEBUG] [LOCAL ] HAFN: No primary data file found to delete. [2025-10-02T19:19:15.881590] [INFO ] [MAIN ] HAFN: Starting full primary refresh. [2025-10-02T19:19:16.260667] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-02T19:19:16.286940] [INFO ] [REMOTE ] HAFN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:19:16.279841] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-03. [2025-10-02T19:19:17.042951] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-02T19:19:17.073071] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-01. [2025-10-02T19:19:17.873029] [INFO ] [REMOTE ] H: Fetching primary data for 2025-05. [2025-10-02T19:19:17.976279] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-02T19:19:18.481825] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-02T19:19:18.673016] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-02. [2025-10-02T19:19:19.351075] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-02T19:19:19.473053] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2024-12. [2025-10-02T19:19:19.854523] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-02T19:19:20.273072] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-04. [2025-10-02T19:19:21.073006] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-03. [2025-10-02T19:19:21.300264] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-02T19:19:21.873033] [INFO ] [REMOTE ] H: Fetching primary data for 2025-06. [2025-10-02T19:19:21.972503] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-02T19:19:22.637167] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-02T19:19:22.672950] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-04. [2025-10-02T19:19:23.473084] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-05. [2025-10-02T19:19:23.769530] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-02T19:19:24.128729] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-02T19:19:24.273008] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-01. [2025-10-02T19:19:24.974940] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-02T19:19:25.073039] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-06. [2025-10-02T19:19:25.873014] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-05. [2025-10-02T19:19:26.503587] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-02T19:19:26.673217] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-02T19:19:26.673300] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-02. [2025-10-02T19:19:26.907677] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-02T19:19:27.473009] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-06. [2025-10-02T19:19:28.273064] [INFO ] [REMOTE ] H: Fetching primary data for 2025-07. [2025-10-02T19:19:28.394254] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-02T19:19:28.856501] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-02T19:19:29.073050] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-07. [2025-10-02T19:19:29.609804] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-02T19:19:29.873029] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-03. [2025-10-02T19:19:30.678182] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-07. [2025-10-02T19:19:30.693130] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-02T19:19:31.276272] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-02T19:19:31.473017] [INFO ] [REMOTE ] H: Fetching primary data for 2025-08. [2025-10-02T19:19:32.131921] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-02T19:19:32.273024] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-04. [2025-10-02T19:19:32.800452] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-02T19:19:33.073037] [INFO ] [REMOTE ] H: Fetching primary data for 2025-09. [2025-10-02T19:19:33.651930] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-02T19:19:33.872994] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-08. [2025-10-02T19:19:34.283257] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-02T19:19:34.673020] [INFO ] [REMOTE ] H: Fetching primary data for 2025-10. [2025-10-02T19:19:35.084557] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-02T19:19:35.473032] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-08. [2025-10-02T19:19:36.273003] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-05. [2025-10-02T19:19:36.648452] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-02T19:19:37.072999] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-09. [2025-10-02T19:19:37.648964] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-02T19:19:37.809902] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-10 (3.14 seconds). [2025-10-02T19:19:37.812058] [INFO ] [REMOTE ] H: Full fetch complete (61869 records). [2025-10-02T19:19:37.812209] [DEBUG] [VALIDATOR ] H: Validating primary data. [2025-10-02T19:19:37.813220] [FATAL] [VALIDATOR ] H: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:19:37.813343] [FATAL] [MAIN ] H: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:19:37.813400] [WARN ] [MAIN ] H: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:19:37.813483] [INFO ] [LOCAL ] H: Starting deletion of primary data. [2025-10-02T19:19:37.813623] [DEBUG] [LOCAL ] H: No primary data file found to delete. [2025-10-02T19:19:37.813728] [INFO ] [LOCAL ] H: Starting deletion of derivative data. [2025-10-02T19:19:37.813805] [DEBUG] [LOCAL ] H: No derivative data file found to delete. [2025-10-02T19:19:37.813899] [INFO ] [MAIN ] Update Progress: 989/2370 symbols completed. H took 36.8s. Estimated remaining: 3h 14m 53s. Rate: 7.1 symbols/min [2025-10-02T19:19:37.878173] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-09. [2025-10-02T19:19:38.027446] [INFO ] [MAIN ] HAL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:19:38.027664] [DEBUG] [LOCAL ] HAL: No existing data file found in primary storage. [2025-10-02T19:19:38.027724] [WARN ] [MAIN ] HAL: No existing data found, performing full refresh instead. [2025-10-02T19:19:38.027839] [INFO ] [MAIN ] HAL: Wiping existing primary data before full refresh. [2025-10-02T19:19:38.027883] [INFO ] [LOCAL ] HAL: Starting deletion of primary data. [2025-10-02T19:19:38.027925] [DEBUG] [LOCAL ] HAL: No primary data file found to delete. [2025-10-02T19:19:38.027969] [INFO ] [MAIN ] HAL: Starting full primary refresh. [2025-10-02T19:19:38.429438] [INFO ] [REMOTE ] HAL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:19:38.460743] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-02T19:19:38.673037] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-10. [2025-10-02T19:19:39.123108] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-02T19:19:39.472985] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-10. [2025-10-02T19:19:40.273047] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-06. [2025-10-02T19:19:41.073050] [INFO ] [REMOTE ] HAL: Fetching primary data for 2024-12. [2025-10-02T19:19:41.452744] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-02T19:19:41.838868] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-10 (3.17 seconds). [2025-10-02T19:19:41.840267] [INFO ] [REMOTE ] HAE: Full fetch complete (57935 records). [2025-10-02T19:19:41.840381] [DEBUG] [VALIDATOR ] HAE: Validating primary data. [2025-10-02T19:19:41.841246] [FATAL] [VALIDATOR ] HAE: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:19:41.841337] [FATAL] [MAIN ] HAE: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:19:41.841409] [WARN ] [MAIN ] HAE: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:19:41.841485] [INFO ] [LOCAL ] HAE: Starting deletion of primary data. [2025-10-02T19:19:41.841560] [DEBUG] [LOCAL ] HAE: No primary data file found to delete. [2025-10-02T19:19:41.841607] [INFO ] [LOCAL ] HAE: Starting deletion of derivative data. [2025-10-02T19:19:41.841697] [DEBUG] [LOCAL ] HAE: No derivative data file found to delete. [2025-10-02T19:19:41.841793] [INFO ] [MAIN ] Update Progress: 990/2370 symbols completed. HAE took 30.1s. Estimated remaining: 3h 14m 38s. Rate: 7.1 symbols/min [2025-10-02T19:19:41.878069] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-07. [2025-10-02T19:19:42.033829] [INFO ] [MAIN ] HASI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:19:42.033991] [DEBUG] [LOCAL ] HASI: No existing data file found in primary storage. [2025-10-02T19:19:42.034031] [WARN ] [MAIN ] HASI: No existing data found, performing full refresh instead. [2025-10-02T19:19:42.034144] [INFO ] [MAIN ] HASI: Wiping existing primary data before full refresh. [2025-10-02T19:19:42.034188] [INFO ] [LOCAL ] HASI: Starting deletion of primary data. [2025-10-02T19:19:42.034231] [DEBUG] [LOCAL ] HASI: No primary data file found to delete. [2025-10-02T19:19:42.034265] [INFO ] [MAIN ] HASI: Starting full primary refresh. [2025-10-02T19:19:42.420111] [INFO ] [REMOTE ] HASI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:19:42.571432] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-10 (3.10 seconds). [2025-10-02T19:19:42.574957] [INFO ] [REMOTE ] GXO: Full fetch complete (69638 records). [2025-10-02T19:19:42.575073] [DEBUG] [VALIDATOR ] GXO: Validating primary data. [2025-10-02T19:19:42.575895] [FATAL] [VALIDATOR ] GXO: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:19:42.575983] [FATAL] [MAIN ] GXO: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:19:42.576031] [WARN ] [MAIN ] GXO: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:19:42.576122] [INFO ] [LOCAL ] GXO: Starting deletion of primary data. [2025-10-02T19:19:42.576186] [DEBUG] [LOCAL ] GXO: No primary data file found to delete. [2025-10-02T19:19:42.576223] [INFO ] [LOCAL ] GXO: Starting deletion of derivative data. [2025-10-02T19:19:42.576263] [DEBUG] [LOCAL ] GXO: No derivative data file found to delete. [2025-10-02T19:19:42.576320] [INFO ] [MAIN ] Update Progress: 991/2370 symbols completed. GXO took 52.9s. Estimated remaining: 3h 14m 19s. Rate: 7.1 symbols/min [2025-10-02T19:19:42.679789] [INFO ] [REMOTE ] HASI: Fetching primary data for 2024-12. [2025-10-02T19:19:42.762798] [INFO ] [MAIN ] HAYW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:19:42.763020] [DEBUG] [LOCAL ] HAYW: No existing data file found in primary storage. [2025-10-02T19:19:42.763066] [WARN ] [MAIN ] HAYW: No existing data found, performing full refresh instead. [2025-10-02T19:19:42.763174] [INFO ] [MAIN ] HAYW: Wiping existing primary data before full refresh. [2025-10-02T19:19:42.763216] [INFO ] [LOCAL ] HAYW: Starting deletion of primary data. [2025-10-02T19:19:42.763257] [DEBUG] [LOCAL ] HAYW: No primary data file found to delete. [2025-10-02T19:19:42.763308] [INFO ] [MAIN ] HAYW: Starting full primary refresh. [2025-10-02T19:19:43.159812] [INFO ] [REMOTE ] HAYW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:19:43.196511] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-02T19:19:43.451942] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-02T19:19:43.473010] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2024-12. [2025-10-02T19:19:44.272990] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-01. [2025-10-02T19:19:44.452400] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-02T19:19:44.822955] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-02T19:19:45.072999] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-01. [2025-10-02T19:19:45.872982] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-08. [2025-10-02T19:19:46.255352] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-02T19:19:46.328893] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-02T19:19:46.673006] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-02. [2025-10-02T19:19:47.457188] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-02T19:19:47.472954] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-09. [2025-10-02T19:19:48.272987] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-01. [2025-10-02T19:19:48.350496] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-02T19:19:49.069475] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-02T19:19:49.077921] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-02. [2025-10-02T19:19:49.873007] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-10. [2025-10-02T19:19:50.146983] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-02T19:19:50.672996] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-02. [2025-10-02T19:19:50.786010] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-02T19:19:51.473033] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-03. [2025-10-02T19:19:52.157848] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-02T19:19:52.272999] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-03. [2025-10-02T19:19:53.032628] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-10 (3.16 seconds). [2025-10-02T19:19:53.034285] [INFO ] [REMOTE ] HAFN: Full fetch complete (65183 records). [2025-10-02T19:19:53.034383] [DEBUG] [VALIDATOR ] HAFN: Validating primary data. [2025-10-02T19:19:53.035361] [FATAL] [VALIDATOR ] HAFN: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:19:53.035459] [FATAL] [MAIN ] HAFN: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:19:53.035503] [WARN ] [MAIN ] HAFN: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:19:53.035567] [INFO ] [LOCAL ] HAFN: Starting deletion of primary data. [2025-10-02T19:19:53.035739] [DEBUG] [LOCAL ] HAFN: No primary data file found to delete. [2025-10-02T19:19:53.035784] [INFO ] [LOCAL ] HAFN: Starting deletion of derivative data. [2025-10-02T19:19:53.035827] [DEBUG] [LOCAL ] HAFN: No derivative data file found to delete. [2025-10-02T19:19:53.035886] [INFO ] [MAIN ] Update Progress: 992/2370 symbols completed. HAFN took 37.3s. Estimated remaining: 3h 14m 14s. Rate: 7.1 symbols/min [2025-10-02T19:19:53.082084] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-03. [2025-10-02T19:19:53.230590] [INFO ] [MAIN ] HBB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:19:53.231016] [DEBUG] [LOCAL ] HBB: No existing data file found in primary storage. [2025-10-02T19:19:53.231076] [WARN ] [MAIN ] HBB: No existing data found, performing full refresh instead. [2025-10-02T19:19:53.231243] [INFO ] [MAIN ] HBB: Wiping existing primary data before full refresh. [2025-10-02T19:19:53.231284] [INFO ] [LOCAL ] HBB: Starting deletion of primary data. [2025-10-02T19:19:53.231325] [DEBUG] [LOCAL ] HBB: No primary data file found to delete. [2025-10-02T19:19:53.231357] [INFO ] [MAIN ] HBB: Starting full primary refresh. [2025-10-02T19:19:53.679066] [INFO ] [REMOTE ] HBB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:19:53.682010] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-02T19:19:53.872968] [INFO ] [REMOTE ] HBB: Fetching primary data for 2024-12. [2025-10-02T19:19:53.913496] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-02T19:19:54.672979] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-04. [2025-10-02T19:19:54.861574] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-02T19:19:54.879364] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-02T19:19:55.473015] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-01. [2025-10-02T19:19:56.146373] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-02T19:19:56.278262] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-04. [2025-10-02T19:19:56.292459] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-02T19:19:57.073052] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-05. [2025-10-02T19:19:57.873010] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-02. [2025-10-02T19:19:58.333128] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-02T19:19:58.494998] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-02T19:19:58.672989] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-04. [2025-10-02T19:19:58.850045] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-02T19:19:59.473030] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-06. [2025-10-02T19:20:00.273004] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-03. [2025-10-02T19:20:00.310578] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-02T19:20:00.935062] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-02T19:20:01.048126] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-02T19:20:01.073021] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-05. [2025-10-02T19:20:01.872999] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-04. [2025-10-02T19:20:02.673047] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-05. [2025-10-02T19:20:03.473232] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-07. [2025-10-02T19:20:03.611461] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-05 (2.54 seconds). [2025-10-02T19:20:03.701748] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-02T19:20:04.273042] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-06. [2025-10-02T19:20:05.073048] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-05. [2025-10-02T19:20:06.005839] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-02T19:20:06.008399] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-06. [2025-10-02T19:20:06.212374] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-07 (2.74 seconds). [2025-10-02T19:20:06.552213] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-05 (3.88 seconds). [2025-10-02T19:20:06.672987] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-06. [2025-10-02T19:20:06.739241] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-06 (2.47 seconds). [2025-10-02T19:20:06.878036] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-02T19:20:07.473012] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-07. [2025-10-02T19:20:08.273009] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-07. [2025-10-02T19:20:08.398533] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-02T19:20:08.909058] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-02T19:20:09.073067] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-08. [2025-10-02T19:20:09.484433] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-02T19:20:09.598622] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-02T19:20:09.873048] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-07. [2025-10-02T19:20:10.673016] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-08. [2025-10-02T19:20:11.472998] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-09. [2025-10-02T19:20:11.792892] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-02T19:20:12.030446] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-02T19:20:12.272997] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-08. [2025-10-02T19:20:12.778751] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-02T19:20:13.073019] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-09. [2025-10-02T19:20:13.568387] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-02T19:20:13.872994] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-08. [2025-10-02T19:20:14.671162] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-02T19:20:14.682466] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-10. [2025-10-02T19:20:15.473007] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-09. [2025-10-02T19:20:15.904295] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-02T19:20:16.272996] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-09. [2025-10-02T19:20:17.072971] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-10. [2025-10-02T19:20:17.171212] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-02T19:20:17.789011] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-10 (3.11 seconds). [2025-10-02T19:20:17.789792] [INFO ] [REMOTE ] HBB: Full fetch complete (9524 records). [2025-10-02T19:20:17.789883] [DEBUG] [VALIDATOR ] HBB: Validating primary data. [2025-10-02T19:20:17.790335] [FATAL] [VALIDATOR ] HBB: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:20:17.790426] [FATAL] [MAIN ] HBB: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:20:17.790472] [WARN ] [MAIN ] HBB: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:20:17.790515] [INFO ] [LOCAL ] HBB: Starting deletion of primary data. [2025-10-02T19:20:17.790579] [DEBUG] [LOCAL ] HBB: No primary data file found to delete. [2025-10-02T19:20:17.790638] [INFO ] [LOCAL ] HBB: Starting deletion of derivative data. [2025-10-02T19:20:17.790738] [DEBUG] [LOCAL ] HBB: No derivative data file found to delete. [2025-10-02T19:20:17.790799] [INFO ] [MAIN ] Update Progress: 993/2370 symbols completed. HBB took 24.8s. Estimated remaining: 3h 14m 28s. Rate: 7.1 symbols/min [2025-10-02T19:20:17.873637] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-10. [2025-10-02T19:20:17.984738] [INFO ] [MAIN ] HBI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:20:17.984935] [DEBUG] [LOCAL ] HBI: No existing data file found in primary storage. [2025-10-02T19:20:17.985072] [WARN ] [MAIN ] HBI: No existing data found, performing full refresh instead. [2025-10-02T19:20:17.985277] [INFO ] [MAIN ] HBI: Wiping existing primary data before full refresh. [2025-10-02T19:20:17.985351] [INFO ] [LOCAL ] HBI: Starting deletion of primary data. [2025-10-02T19:20:17.985434] [DEBUG] [LOCAL ] HBI: No primary data file found to delete. [2025-10-02T19:20:17.985481] [INFO ] [MAIN ] HBI: Starting full primary refresh. [2025-10-02T19:20:18.216249] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-02T19:20:18.436127] [INFO ] [REMOTE ] HBI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:20:18.672989] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-10. [2025-10-02T19:20:19.473045] [INFO ] [REMOTE ] HBI: Fetching primary data for 2024-12. [2025-10-02T19:20:21.084087] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-10 (3.21 seconds). [2025-10-02T19:20:21.085881] [INFO ] [REMOTE ] HASI: Full fetch complete (67766 records). [2025-10-02T19:20:21.085992] [DEBUG] [VALIDATOR ] HASI: Validating primary data. [2025-10-02T19:20:21.086826] [FATAL] [VALIDATOR ] HASI: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:20:21.086931] [FATAL] [MAIN ] HASI: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:20:21.086978] [WARN ] [MAIN ] HASI: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:20:21.087049] [INFO ] [LOCAL ] HASI: Starting deletion of primary data. [2025-10-02T19:20:21.087114] [DEBUG] [LOCAL ] HASI: No primary data file found to delete. [2025-10-02T19:20:21.087150] [INFO ] [LOCAL ] HASI: Starting deletion of derivative data. [2025-10-02T19:20:21.087189] [DEBUG] [LOCAL ] HASI: No derivative data file found to delete. [2025-10-02T19:20:21.087247] [INFO ] [MAIN ] Update Progress: 994/2370 symbols completed. HASI took 39.2s. Estimated remaining: 3h 14m 12s. Rate: 7.1 symbols/min [2025-10-02T19:20:21.307350] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-02T19:20:21.311629] [INFO ] [MAIN ] HBM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:20:21.322721] [DEBUG] [LOCAL ] HBM: No existing data file found in primary storage. [2025-10-02T19:20:21.323025] [WARN ] [MAIN ] HBM: No existing data found, performing full refresh instead. [2025-10-02T19:20:21.323728] [INFO ] [MAIN ] HBM: Wiping existing primary data before full refresh. [2025-10-02T19:20:21.323581] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-01. [2025-10-02T19:20:21.324619] [INFO ] [LOCAL ] HBM: Starting deletion of primary data. [2025-10-02T19:20:21.324714] [DEBUG] [LOCAL ] HBM: No primary data file found to delete. [2025-10-02T19:20:21.324759] [INFO ] [MAIN ] HBM: Starting full primary refresh. [2025-10-02T19:20:21.512103] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-10 (4.44 seconds). [2025-10-02T19:20:21.570017] [INFO ] [REMOTE ] HAYW: Full fetch complete (70520 records). [2025-10-02T19:20:21.570214] [DEBUG] [VALIDATOR ] HAYW: Validating primary data. [2025-10-02T19:20:21.613137] [FATAL] [VALIDATOR ] HAYW: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:20:21.651053] [FATAL] [MAIN ] HAYW: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:20:21.655520] [WARN ] [MAIN ] HAYW: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:20:21.656032] [INFO ] [LOCAL ] HAYW: Starting deletion of primary data. [2025-10-02T19:20:21.666745] [DEBUG] [LOCAL ] HAYW: No primary data file found to delete. [2025-10-02T19:20:21.687453] [INFO ] [LOCAL ] HAYW: Starting deletion of derivative data. [2025-10-02T19:20:21.706486] [DEBUG] [LOCAL ] HAYW: No derivative data file found to delete. [2025-10-02T19:20:21.723564] [INFO ] [MAIN ] Update Progress: 995/2370 symbols completed. HAYW took 39.1s. Estimated remaining: 3h 13m 53s. Rate: 7.1 symbols/min [2025-10-02T19:20:21.781753] [INFO ] [REMOTE ] HBM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:20:21.809300] [INFO ] [REMOTE ] HBM: Fetching primary data for 2024-12. [2025-10-02T19:20:21.934355] [INFO ] [MAIN ] HCA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:20:21.934528] [DEBUG] [LOCAL ] HCA: No existing data file found in primary storage. [2025-10-02T19:20:21.934567] [WARN ] [MAIN ] HCA: No existing data found, performing full refresh instead. [2025-10-02T19:20:21.934737] [INFO ] [MAIN ] HCA: Wiping existing primary data before full refresh. [2025-10-02T19:20:21.934789] [INFO ] [LOCAL ] HCA: Starting deletion of primary data. [2025-10-02T19:20:21.934833] [DEBUG] [LOCAL ] HCA: No primary data file found to delete. [2025-10-02T19:20:21.934868] [INFO ] [MAIN ] HCA: Starting full primary refresh. [2025-10-02T19:20:22.027190] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-10 (3.35 seconds). [2025-10-02T19:20:22.059495] [INFO ] [REMOTE ] HAL: Full fetch complete (77376 records). [2025-10-02T19:20:22.080259] [DEBUG] [VALIDATOR ] HAL: Validating primary data. [2025-10-02T19:20:22.112918] [FATAL] [VALIDATOR ] HAL: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:20:22.146268] [FATAL] [MAIN ] HAL: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:20:22.213444] [WARN ] [MAIN ] HAL: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:20:22.239786] [INFO ] [LOCAL ] HAL: Starting deletion of primary data. [2025-10-02T19:20:22.257785] [DEBUG] [LOCAL ] HAL: No primary data file found to delete. [2025-10-02T19:20:22.274101] [INFO ] [LOCAL ] HAL: Starting deletion of derivative data. [2025-10-02T19:20:22.321590] [DEBUG] [LOCAL ] HAL: No derivative data file found to delete. [2025-10-02T19:20:22.344822] [INFO ] [MAIN ] Update Progress: 996/2370 symbols completed. HAL took 44.5s. Estimated remaining: 3h 13m 34s. Rate: 7.1 symbols/min [2025-10-02T19:20:22.344614] [INFO ] [REMOTE ] HCA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:20:22.345261] [INFO ] [REMOTE ] HCA: Fetching primary data for 2024-12. [2025-10-02T19:20:22.556161] [INFO ] [MAIN ] HCC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:20:22.556342] [DEBUG] [LOCAL ] HCC: No existing data file found in primary storage. [2025-10-02T19:20:22.556385] [WARN ] [MAIN ] HCC: No existing data found, performing full refresh instead. [2025-10-02T19:20:22.556528] [INFO ] [MAIN ] HCC: Wiping existing primary data before full refresh. [2025-10-02T19:20:22.556598] [INFO ] [LOCAL ] HCC: Starting deletion of primary data. [2025-10-02T19:20:22.556686] [DEBUG] [LOCAL ] HCC: No primary data file found to delete. [2025-10-02T19:20:22.556752] [INFO ] [MAIN ] HCC: Starting full primary refresh. [2025-10-02T19:20:22.941525] [INFO ] [REMOTE ] HCC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:20:22.942446] [INFO ] [REMOTE ] HCC: Fetching primary data for 2024-12. [2025-10-02T19:20:23.065376] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-02T19:20:23.439231] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-02T19:20:23.472956] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-01. [2025-10-02T19:20:23.793077] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-02T19:20:24.025282] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-02T19:20:24.273032] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-01. [2025-10-02T19:20:25.072978] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-02. [2025-10-02T19:20:25.164998] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-02T19:20:25.798582] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-02T19:20:25.873006] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-02. [2025-10-02T19:20:26.355042] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-02T19:20:26.673043] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-02. [2025-10-02T19:20:27.472978] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-01. [2025-10-02T19:20:27.683141] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-02T19:20:28.273009] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-03. [2025-10-02T19:20:28.323258] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-02T19:20:29.068879] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-02T19:20:29.076971] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-03. [2025-10-02T19:20:29.872990] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-02. [2025-10-02T19:20:30.191392] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-02T19:20:30.485996] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-02T19:20:30.673018] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-04. [2025-10-02T19:20:31.301049] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-02T19:20:31.473006] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-03. [2025-10-02T19:20:32.273049] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-03. [2025-10-02T19:20:32.794833] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-02T19:20:33.073025] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-04. [2025-10-02T19:20:33.794041] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-04 (3.12 seconds). [2025-10-02T19:20:33.873000] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-04. [2025-10-02T19:20:34.380463] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-02T19:20:34.673002] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-05. [2025-10-02T19:20:34.966572] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-02T19:20:35.472981] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-05. [2025-10-02T19:20:35.648600] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-02T19:20:36.081496] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-02T19:20:36.272991] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-06. [2025-10-02T19:20:36.819722] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-02T19:20:37.073047] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-05. [2025-10-02T19:20:37.563683] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-02T19:20:37.873008] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-06. [2025-10-02T19:20:38.672994] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-07. [2025-10-02T19:20:38.769799] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-02T19:20:39.473005] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-06. [2025-10-02T19:20:39.523489] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-02T19:20:40.272974] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-04. [2025-10-02T19:20:40.407345] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-02T19:20:40.842193] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-02T19:20:41.073043] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-07. [2025-10-02T19:20:41.619356] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-02T19:20:41.873002] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-05. [2025-10-02T19:20:42.405391] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-02T19:20:42.672994] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-08. [2025-10-02T19:20:43.472990] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-08. [2025-10-02T19:20:43.576357] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-02T19:20:44.121575] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-02T19:20:44.273001] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-06. [2025-10-02T19:20:44.768803] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-02T19:20:45.073003] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-09. [2025-10-02T19:20:45.679064] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-02T19:20:45.873011] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-09. [2025-10-02T19:20:46.606031] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-02T19:20:46.673008] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-07. [2025-10-02T19:20:47.472990] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-07. [2025-10-02T19:20:47.516842] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-02T19:20:48.034628] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-02T19:20:48.273029] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-10. [2025-10-02T19:20:48.996409] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-02T19:20:49.073049] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-08. [2025-10-02T19:20:49.872979] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-08. [2025-10-02T19:20:50.673032] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-10. [2025-10-02T19:20:50.848159] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-02T19:20:51.285281] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-10 (3.01 seconds). [2025-10-02T19:20:51.287008] [INFO ] [REMOTE ] HCC: Full fetch complete (64221 records). [2025-10-02T19:20:51.287127] [DEBUG] [VALIDATOR ] HCC: Validating primary data. [2025-10-02T19:20:51.288044] [FATAL] [VALIDATOR ] HCC: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:20:51.288185] [FATAL] [MAIN ] HCC: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:20:51.288242] [WARN ] [MAIN ] HCC: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:20:51.288436] [INFO ] [LOCAL ] HCC: Starting deletion of primary data. [2025-10-02T19:20:51.288524] [DEBUG] [LOCAL ] HCC: No primary data file found to delete. [2025-10-02T19:20:51.288582] [INFO ] [LOCAL ] HCC: Starting deletion of derivative data. [2025-10-02T19:20:51.288663] [DEBUG] [LOCAL ] HCC: No derivative data file found to delete. [2025-10-02T19:20:51.288751] [INFO ] [MAIN ] Update Progress: 997/2370 symbols completed. HCC took 28.9s. Estimated remaining: 3h 13m 53s. Rate: 7.1 symbols/min [2025-10-02T19:20:51.473042] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-09. [2025-10-02T19:20:51.689684] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-02T19:20:52.273089] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-09. [2025-10-02T19:20:53.334513] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-02T19:20:53.346923] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-10. [2025-10-02T19:20:53.642587] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-02T19:20:53.873056] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-10. [2025-10-02T19:20:53.942915] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-10 (3.27 seconds). [2025-10-02T19:20:53.944761] [INFO ] [REMOTE ] HCA: Full fetch complete (68591 records). [2025-10-02T19:20:53.944932] [DEBUG] [VALIDATOR ] HCA: Validating primary data. [2025-10-02T19:20:53.946373] [FATAL] [VALIDATOR ] HCA: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:20:53.946534] [FATAL] [MAIN ] HCA: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:20:53.946623] [WARN ] [MAIN ] HCA: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:20:53.946748] [INFO ] [LOCAL ] HCA: Starting deletion of primary data. [2025-10-02T19:20:53.946827] [DEBUG] [LOCAL ] HCA: No primary data file found to delete. [2025-10-02T19:20:53.946867] [INFO ] [LOCAL ] HCA: Starting deletion of derivative data. [2025-10-02T19:20:53.946962] [DEBUG] [LOCAL ] HCA: No derivative data file found to delete. [2025-10-02T19:20:53.947076] [INFO ] [MAIN ] Update Progress: 998/2370 symbols completed. HCA took 32.2s. Estimated remaining: 3h 13m 37s. Rate: 7.1 symbols/min [2025-10-02T19:20:56.660263] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-10 (3.31 seconds). [2025-10-02T19:20:56.661828] [INFO ] [REMOTE ] HBM: Full fetch complete (75848 records). [2025-10-02T19:20:56.661928] [DEBUG] [VALIDATOR ] HBM: Validating primary data. [2025-10-02T19:20:56.662734] [FATAL] [VALIDATOR ] HBM: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:20:56.662826] [FATAL] [MAIN ] HBM: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:20:56.662871] [WARN ] [MAIN ] HBM: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:20:56.662941] [INFO ] [LOCAL ] HBM: Starting deletion of primary data. [2025-10-02T19:20:56.663036] [DEBUG] [LOCAL ] HBM: No primary data file found to delete. [2025-10-02T19:20:56.663093] [INFO ] [LOCAL ] HBM: Starting deletion of derivative data. [2025-10-02T19:20:56.663138] [DEBUG] [LOCAL ] HBM: No derivative data file found to delete. [2025-10-02T19:20:56.663196] [INFO ] [MAIN ] Update Progress: 999/2370 symbols completed. HBM took 35.6s. Estimated remaining: 3h 13m 20s. Rate: 7.1 symbols/min [2025-10-02T19:20:57.062012] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-10 (3.19 seconds). [2025-10-02T19:20:57.063873] [INFO ] [REMOTE ] HBI: Full fetch complete (76506 records). [2025-10-02T19:20:57.064052] [DEBUG] [VALIDATOR ] HBI: Validating primary data. [2025-10-02T19:20:57.065011] [FATAL] [VALIDATOR ] HBI: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:20:57.065115] [FATAL] [MAIN ] HBI: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:20:57.065160] [WARN ] [MAIN ] HBI: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:20:57.065200] [INFO ] [LOCAL ] HBI: Starting deletion of primary data. [2025-10-02T19:20:57.065257] [DEBUG] [LOCAL ] HBI: No primary data file found to delete. [2025-10-02T19:20:57.065352] [INFO ] [LOCAL ] HBI: Starting deletion of derivative data. [2025-10-02T19:20:57.065417] [DEBUG] [LOCAL ] HBI: No derivative data file found to delete. [2025-10-02T19:20:57.065480] [INFO ] [MAIN ] Update Progress: 1000/2370 symbols completed. HBI took 39.3s. Estimated remaining: 3h 13m 1s. Rate: 7.1 symbols/min [2025-10-02T19:20:57.837762] [INFO ] [MAIN ] HDB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:20:57.906777] [INFO ] [MAIN ] HD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:20:57.891628] [DEBUG] [LOCAL ] HDB: No existing data file found in primary storage. [2025-10-02T19:20:57.914053] [INFO ] [MAIN ] HCI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:20:57.963198] [DEBUG] [LOCAL ] HCI: No existing data file found in primary storage. [2025-10-02T19:20:57.968474] [INFO ] [MAIN ] HCXY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:20:57.968788] [WARN ] [MAIN ] HDB: No existing data found, performing full refresh instead. [2025-10-02T19:20:57.969248] [DEBUG] [LOCAL ] HCXY: No existing data file found in primary storage. [2025-10-02T19:20:57.969618] [INFO ] [MAIN ] HDB: Wiping existing primary data before full refresh. [2025-10-02T19:20:57.968984] [DEBUG] [LOCAL ] HD: No existing data file found in primary storage. [2025-10-02T19:20:57.970156] [WARN ] [MAIN ] HCXY: No existing data found, performing full refresh instead. [2025-10-02T19:20:57.969887] [INFO ] [LOCAL ] HDB: Starting deletion of primary data. [2025-10-02T19:20:57.969530] [WARN ] [MAIN ] HCI: No existing data found, performing full refresh instead. [2025-10-02T19:20:57.970568] [DEBUG] [LOCAL ] HDB: No primary data file found to delete. [2025-10-02T19:20:57.970699] [INFO ] [MAIN ] HCXY: Wiping existing primary data before full refresh. [2025-10-02T19:20:57.970882] [INFO ] [MAIN ] HDB: Starting full primary refresh. [2025-10-02T19:20:57.970060] [WARN ] [MAIN ] HD: No existing data found, performing full refresh instead. [2025-10-02T19:20:57.983866] [INFO ] [MAIN ] HD: Wiping existing primary data before full refresh. [2025-10-02T19:20:57.989295] [INFO ] [LOCAL ] HD: Starting deletion of primary data. [2025-10-02T19:20:57.989115] [INFO ] [MAIN ] HCI: Wiping existing primary data before full refresh. [2025-10-02T19:20:57.995371] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-02T19:20:58.006558] [DEBUG] [LOCAL ] HD: No primary data file found to delete. [2025-10-02T19:20:58.012034] [INFO ] [LOCAL ] HCI: Starting deletion of primary data. [2025-10-02T19:20:58.012261] [INFO ] [MAIN ] HD: Starting full primary refresh. [2025-10-02T19:20:58.022811] [DEBUG] [LOCAL ] HCI: No primary data file found to delete. [2025-10-02T19:20:58.023316] [INFO ] [MAIN ] HCI: Starting full primary refresh. [2025-10-02T19:20:58.023041] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-02T19:20:58.093057] [INFO ] [MAIN ] HCXY: Starting full primary refresh. [2025-10-02T19:20:59.527528] [INFO ] [REMOTE ] HDB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:20:59.613275] [INFO ] [REMOTE ] HCXY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:20:59.603456] [INFO ] [REMOTE ] HDB: Fetching primary data for 2024-12. [2025-10-02T19:20:59.629032] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2024-12. [2025-10-02T19:20:59.643939] [INFO ] [REMOTE ] HCI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:20:59.640102] [INFO ] [REMOTE ] HD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:20:59.644427] [INFO ] [REMOTE ] HCI: Fetching primary data for 2024-12. [2025-10-02T19:20:59.645183] [INFO ] [REMOTE ] HD: Fetching primary data for 2024-12. [2025-10-02T19:21:00.073802] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-02T19:21:00.075061] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-01. [2025-10-02T19:21:00.391886] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-02T19:21:00.392811] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-02. [2025-10-02T19:21:00.730279] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-02T19:21:00.733820] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-01. [2025-10-02T19:21:01.506264] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-02T19:21:01.519564] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-01. [2025-10-02T19:21:01.882048] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-10-02T19:21:01.896065] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-01. [2025-10-02T19:21:04.832460] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-02 (4.44 seconds). [2025-10-02T19:21:04.833685] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-03. [2025-10-02T19:21:05.140673] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-02T19:21:05.141585] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-04. [2025-10-02T19:21:05.335863] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-01 (4.60 seconds). [2025-10-02T19:21:05.339932] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-02. [2025-10-02T19:21:05.378166] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-04 (0.24 seconds). [2025-10-02T19:21:05.379087] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-05. [2025-10-02T19:21:05.628768] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-10-02T19:21:05.629704] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-06. [2025-10-02T19:21:05.672291] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-01 (3.78 seconds). [2025-10-02T19:21:05.873029] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-02. [2025-10-02T19:21:05.949730] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-02T19:21:06.129323] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-02T19:21:06.672992] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-07. [2025-10-02T19:21:06.837187] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-01 (5.32 seconds). [2025-10-02T19:21:07.472988] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-03. [2025-10-02T19:21:07.779869] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-02T19:21:08.164247] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-02T19:21:08.273016] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-08. [2025-10-02T19:21:08.509053] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-08 (0.24 seconds). [2025-10-02T19:21:09.073025] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-09. [2025-10-02T19:21:09.353280] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-10-02T19:21:09.581906] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-02T19:21:09.873002] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-02. [2025-10-02T19:21:10.672990] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-03. [2025-10-02T19:21:11.472999] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-10. [2025-10-02T19:21:12.057111] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-10-02T19:21:12.273175] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-04. [2025-10-02T19:21:12.965677] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-02T19:21:13.073027] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-05. [2025-10-02T19:21:13.873036] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-03. [2025-10-02T19:21:13.923621] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-10 (2.45 seconds). [2025-10-02T19:21:13.924344] [INFO ] [REMOTE ] HCXY: Full fetch complete (569 records). [2025-10-02T19:21:13.924418] [DEBUG] [VALIDATOR ] HCXY: Validating primary data. [2025-10-02T19:21:13.924912] [FATAL] [VALIDATOR ] HCXY: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:21:13.925003] [FATAL] [MAIN ] HCXY: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:21:13.925048] [WARN ] [MAIN ] HCXY: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:21:13.925121] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-02T19:21:13.925198] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-02T19:21:13.925254] [INFO ] [LOCAL ] HCXY: Starting deletion of derivative data. [2025-10-02T19:21:13.925298] [DEBUG] [LOCAL ] HCXY: No derivative data file found to delete. [2025-10-02T19:21:13.925367] [INFO ] [MAIN ] Update Progress: 1001/2370 symbols completed. HCXY took 16.8s. Estimated remaining: 3h 13m 4s. Rate: 7.1 symbols/min [2025-10-02T19:21:14.136890] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-02T19:21:14.138563] [INFO ] [MAIN ] HE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:21:14.141868] [DEBUG] [LOCAL ] HE: No existing data file found in primary storage. [2025-10-02T19:21:14.142180] [WARN ] [MAIN ] HE: No existing data found, performing full refresh instead. [2025-10-02T19:21:14.142298] [INFO ] [MAIN ] HE: Wiping existing primary data before full refresh. [2025-10-02T19:21:14.142342] [INFO ] [LOCAL ] HE: Starting deletion of primary data. [2025-10-02T19:21:14.142386] [DEBUG] [LOCAL ] HE: No primary data file found to delete. [2025-10-02T19:21:14.142420] [INFO ] [MAIN ] HE: Starting full primary refresh. [2025-10-02T19:21:14.565694] [INFO ] [REMOTE ] HE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:21:14.599438] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-03 (3.93 seconds). [2025-10-02T19:21:14.673002] [INFO ] [REMOTE ] HE: Fetching primary data for 2024-12. [2025-10-02T19:21:15.408871] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-02T19:21:15.472998] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-04. [2025-10-02T19:21:16.272974] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-04. [2025-10-02T19:21:16.473789] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-02T19:21:17.072997] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-06. [2025-10-02T19:21:17.253434] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-02T19:21:17.872982] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-01. [2025-10-02T19:21:18.027353] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-02T19:21:18.414902] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-02T19:21:18.673009] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-05. [2025-10-02T19:21:19.282409] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-02T19:21:19.473044] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-05. [2025-10-02T19:21:20.272971] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-02. [2025-10-02T19:21:20.473598] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-02T19:21:20.926323] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-02T19:21:21.072954] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-06. [2025-10-02T19:21:21.873026] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-07. [2025-10-02T19:21:22.123159] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-02T19:21:22.673024] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-03. [2025-10-02T19:21:22.765287] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-02T19:21:22.875873] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-02T19:21:23.473009] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-07. [2025-10-02T19:21:24.273040] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-06. [2025-10-02T19:21:24.409757] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-02T19:21:25.072954] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-04. [2025-10-02T19:21:25.569431] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-02T19:21:25.873014] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-08. [2025-10-02T19:21:26.450692] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-10-02T19:21:26.673086] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-07. [2025-10-02T19:21:26.832888] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-02T19:21:27.327957] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-02T19:21:27.473016] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-09. [2025-10-02T19:21:28.273028] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-05. [2025-10-02T19:21:28.853322] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-02T19:21:28.924093] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-02T19:21:29.073053] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-08. [2025-10-02T19:21:29.873023] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-08. [2025-10-02T19:21:30.614698] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-10-02T19:21:30.673059] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-06. [2025-10-02T19:21:30.846344] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-02T19:21:31.474223] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-10. [2025-10-02T19:21:31.474093] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-10-02T19:21:32.086611] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-02T19:21:32.273029] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-09. [2025-10-02T19:21:33.073011] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-09. [2025-10-02T19:21:33.873017] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-07. [2025-10-02T19:21:34.231744] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-02T19:21:34.673021] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-10. [2025-10-02T19:21:34.678203] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-10 (3.20 seconds). [2025-10-02T19:21:34.679973] [INFO ] [REMOTE ] HDB: Full fetch complete (74924 records). [2025-10-02T19:21:34.680161] [DEBUG] [VALIDATOR ] HDB: Validating primary data. [2025-10-02T19:21:34.681245] [FATAL] [VALIDATOR ] HDB: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:21:34.681350] [FATAL] [MAIN ] HDB: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:21:34.681406] [WARN ] [MAIN ] HDB: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:21:34.681519] [INFO ] [LOCAL ] HDB: Starting deletion of primary data. [2025-10-02T19:21:34.681810] [DEBUG] [LOCAL ] HDB: No primary data file found to delete. [2025-10-02T19:21:34.681914] [INFO ] [LOCAL ] HDB: Starting deletion of derivative data. [2025-10-02T19:21:34.681990] [DEBUG] [LOCAL ] HDB: No derivative data file found to delete. [2025-10-02T19:21:34.682129] [INFO ] [MAIN ] Update Progress: 1002/2370 symbols completed. HDB took 37.6s. Estimated remaining: 3h 13m 12s. Rate: 7.1 symbols/min [2025-10-02T19:21:34.880856] [INFO ] [MAIN ] HEI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:21:34.881231] [DEBUG] [LOCAL ] HEI: No existing data file found in primary storage. [2025-10-02T19:21:34.881383] [WARN ] [MAIN ] HEI: No existing data found, performing full refresh instead. [2025-10-02T19:21:34.881617] [INFO ] [MAIN ] HEI: Wiping existing primary data before full refresh. [2025-10-02T19:21:34.881707] [INFO ] [LOCAL ] HEI: Starting deletion of primary data. [2025-10-02T19:21:34.881765] [DEBUG] [LOCAL ] HEI: No primary data file found to delete. [2025-10-02T19:21:34.881802] [INFO ] [MAIN ] HEI: Starting full primary refresh. [2025-10-02T19:21:35.327302] [INFO ] [REMOTE ] HEI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:21:35.331559] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-02T19:21:35.423767] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-02T19:21:35.472966] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-08. [2025-10-02T19:21:36.273072] [INFO ] [REMOTE ] HEI: Fetching primary data for 2024-12. [2025-10-02T19:21:37.073028] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-10. [2025-10-02T19:21:37.226737] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-02T19:21:37.287552] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-10 (2.61 seconds). [2025-10-02T19:21:37.288744] [INFO ] [REMOTE ] HCI: Full fetch complete (19351 records). [2025-10-02T19:21:37.288887] [DEBUG] [VALIDATOR ] HCI: Validating primary data. [2025-10-02T19:21:37.289331] [FATAL] [VALIDATOR ] HCI: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:21:37.289453] [FATAL] [MAIN ] HCI: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:21:37.289498] [WARN ] [MAIN ] HCI: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:21:37.289570] [INFO ] [LOCAL ] HCI: Starting deletion of primary data. [2025-10-02T19:21:37.289720] [DEBUG] [LOCAL ] HCI: No primary data file found to delete. [2025-10-02T19:21:37.289779] [INFO ] [LOCAL ] HCI: Starting deletion of derivative data. [2025-10-02T19:21:37.289880] [DEBUG] [LOCAL ] HCI: No derivative data file found to delete. [2025-10-02T19:21:37.289947] [INFO ] [MAIN ] Update Progress: 1003/2370 symbols completed. HCI took 40.2s. Estimated remaining: 3h 12m 56s. Rate: 7.1 symbols/min [2025-10-02T19:21:37.493725] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-02T19:21:37.512438] [INFO ] [MAIN ] HEQ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:21:37.520105] [DEBUG] [LOCAL ] HEQ: No existing data file found in primary storage. [2025-10-02T19:21:37.520159] [WARN ] [MAIN ] HEQ: No existing data found, performing full refresh instead. [2025-10-02T19:21:37.520300] [INFO ] [MAIN ] HEQ: Wiping existing primary data before full refresh. [2025-10-02T19:21:37.520360] [INFO ] [LOCAL ] HEQ: Starting deletion of primary data. [2025-10-02T19:21:37.520415] [DEBUG] [LOCAL ] HEQ: No primary data file found to delete. [2025-10-02T19:21:37.520476] [INFO ] [MAIN ] HEQ: Starting full primary refresh. [2025-10-02T19:21:37.877797] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-01. [2025-10-02T19:21:37.910119] [INFO ] [REMOTE ] HEQ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:21:38.673015] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-09. [2025-10-02T19:21:39.074804] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-02T19:21:39.473043] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2024-12. [2025-10-02T19:21:40.124771] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-02T19:21:40.127422] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-02T19:21:40.273008] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-01. [2025-10-02T19:21:40.669803] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-10 (3.60 seconds). [2025-10-02T19:21:40.671438] [INFO ] [REMOTE ] HD: Full fetch complete (77054 records). [2025-10-02T19:21:40.671547] [DEBUG] [VALIDATOR ] HD: Validating primary data. [2025-10-02T19:21:40.672290] [FATAL] [VALIDATOR ] HD: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:21:40.672382] [FATAL] [MAIN ] HD: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:21:40.672487] [WARN ] [MAIN ] HD: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:21:40.672564] [INFO ] [LOCAL ] HD: Starting deletion of primary data. [2025-10-02T19:21:40.672703] [DEBUG] [LOCAL ] HD: No primary data file found to delete. [2025-10-02T19:21:40.672761] [INFO ] [LOCAL ] HD: Starting deletion of derivative data. [2025-10-02T19:21:40.672808] [DEBUG] [LOCAL ] HD: No derivative data file found to delete. [2025-10-02T19:21:40.672871] [INFO ] [MAIN ] Update Progress: 1004/2370 symbols completed. HD took 43.6s. Estimated remaining: 3h 12m 40s. Rate: 7.1 symbols/min [2025-10-02T19:21:40.789612] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-02T19:21:40.874714] [INFO ] [MAIN ] HESM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:21:40.874929] [DEBUG] [LOCAL ] HESM: No existing data file found in primary storage. [2025-10-02T19:21:40.874985] [WARN ] [MAIN ] HESM: No existing data found, performing full refresh instead. [2025-10-02T19:21:40.875098] [INFO ] [MAIN ] HESM: Wiping existing primary data before full refresh. [2025-10-02T19:21:40.875151] [INFO ] [LOCAL ] HESM: Starting deletion of primary data. [2025-10-02T19:21:40.875220] [DEBUG] [LOCAL ] HESM: No primary data file found to delete. [2025-10-02T19:21:40.875256] [INFO ] [MAIN ] HESM: Starting full primary refresh. [2025-10-02T19:21:41.078622] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-10. [2025-10-02T19:21:41.274506] [INFO ] [REMOTE ] HESM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:21:41.872981] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-02. [2025-10-02T19:21:42.673013] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-02. [2025-10-02T19:21:43.228429] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-02T19:21:43.267620] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-02T19:21:43.472991] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-03. [2025-10-02T19:21:44.056580] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-02T19:21:44.273064] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-03. [2025-10-02T19:21:44.466118] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-10 (3.39 seconds). [2025-10-02T19:21:44.471168] [INFO ] [REMOTE ] HE: Full fetch complete (72020 records). [2025-10-02T19:21:44.471317] [DEBUG] [VALIDATOR ] HE: Validating primary data. [2025-10-02T19:21:44.476353] [FATAL] [VALIDATOR ] HE: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:21:44.476496] [FATAL] [MAIN ] HE: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:21:44.476542] [WARN ] [MAIN ] HE: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:21:44.476588] [INFO ] [LOCAL ] HE: Starting deletion of primary data. [2025-10-02T19:21:44.476682] [DEBUG] [LOCAL ] HE: No primary data file found to delete. [2025-10-02T19:21:44.476742] [INFO ] [LOCAL ] HE: Starting deletion of derivative data. [2025-10-02T19:21:44.476789] [DEBUG] [LOCAL ] HE: No derivative data file found to delete. [2025-10-02T19:21:44.476870] [INFO ] [MAIN ] Update Progress: 1005/2370 symbols completed. HE took 30.6s. Estimated remaining: 3h 12m 26s. Rate: 7.1 symbols/min [2025-10-02T19:21:44.694488] [INFO ] [MAIN ] HF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:21:44.694931] [DEBUG] [LOCAL ] HF: No existing data file found in primary storage. [2025-10-02T19:21:44.694988] [WARN ] [MAIN ] HF: No existing data found, performing full refresh instead. [2025-10-02T19:21:44.695110] [INFO ] [MAIN ] HF: Wiping existing primary data before full refresh. [2025-10-02T19:21:44.695153] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-02T19:21:44.695196] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-02T19:21:44.695229] [INFO ] [MAIN ] HF: Starting full primary refresh. [2025-10-02T19:21:45.078189] [INFO ] [REMOTE ] HESM: Fetching primary data for 2024-12. [2025-10-02T19:21:45.128937] [INFO ] [REMOTE ] HF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:21:45.880272] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-04. [2025-10-02T19:21:45.906401] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-02T19:21:46.630390] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-02T19:21:46.673012] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-04. [2025-10-02T19:21:47.114130] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-02T19:21:47.473030] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-05. [2025-10-02T19:21:48.200084] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-02T19:21:48.254049] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-02T19:21:48.272995] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-06. [2025-10-02T19:21:48.834027] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-02T19:21:49.073005] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-01. [2025-10-02T19:21:49.873017] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-05. [2025-10-02T19:21:50.656404] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-02T19:21:50.672943] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-02. [2025-10-02T19:21:51.369786] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-02T19:21:51.473036] [INFO ] [REMOTE ] HF: Fetching primary data for 2024-12. [2025-10-02T19:21:51.805390] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-10-02T19:21:52.251240] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-02T19:21:52.272895] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-03. [2025-10-02T19:21:53.073001] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-01. [2025-10-02T19:21:53.404094] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-02T19:21:53.873002] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-07. [2025-10-02T19:21:53.940076] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-02T19:21:54.604299] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-02T19:21:54.673000] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-08. [2025-10-02T19:21:55.260816] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-02T19:21:55.473041] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-02. [2025-10-02T19:21:55.816675] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-02T19:21:56.273019] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-03. [2025-10-02T19:21:56.461214] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-03 (0.19 seconds). [2025-10-02T19:21:57.073027] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-06. [2025-10-02T19:21:57.873013] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-04. [2025-10-02T19:21:58.656289] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-02T19:21:58.672974] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-07. [2025-10-02T19:21:59.476223] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-04. [2025-10-02T19:21:59.481138] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-02T19:21:59.713052] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-04 (0.24 seconds). [2025-10-02T19:21:59.944153] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-02T19:22:00.273014] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-09. [2025-10-02T19:22:01.073015] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-05. [2025-10-02T19:22:01.584365] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-02T19:22:01.873015] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-08. [2025-10-02T19:22:02.614927] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-02T19:22:02.673016] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-10. [2025-10-02T19:22:03.237967] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-02T19:22:03.473020] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-06. [2025-10-02T19:22:04.273013] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-09. [2025-10-02T19:22:04.779910] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-02T19:22:05.072970] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-07. [2025-10-02T19:22:05.160921] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-10 (2.49 seconds). [2025-10-02T19:22:05.161804] [INFO ] [REMOTE ] HEQ: Full fetch complete (9222 records). [2025-10-02T19:22:05.161881] [DEBUG] [VALIDATOR ] HEQ: Validating primary data. [2025-10-02T19:22:05.162495] [FATAL] [VALIDATOR ] HEQ: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:22:05.162587] [FATAL] [MAIN ] HEQ: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:22:05.162638] [WARN ] [MAIN ] HEQ: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:22:05.162747] [INFO ] [LOCAL ] HEQ: Starting deletion of primary data. [2025-10-02T19:22:05.162997] [DEBUG] [LOCAL ] HEQ: No primary data file found to delete. [2025-10-02T19:22:05.163058] [INFO ] [LOCAL ] HEQ: Starting deletion of derivative data. [2025-10-02T19:22:05.163111] [DEBUG] [LOCAL ] HEQ: No derivative data file found to delete. [2025-10-02T19:22:05.163201] [INFO ] [MAIN ] Update Progress: 1006/2370 symbols completed. HEQ took 27.9s. Estimated remaining: 3h 12m 34s. Rate: 7.1 symbols/min [2025-10-02T19:22:05.361402] [INFO ] [MAIN ] HFND: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:22:05.361720] [DEBUG] [LOCAL ] HFND: No existing data file found in primary storage. [2025-10-02T19:22:05.361781] [WARN ] [MAIN ] HFND: No existing data found, performing full refresh instead. [2025-10-02T19:22:05.361932] [INFO ] [MAIN ] HFND: Wiping existing primary data before full refresh. [2025-10-02T19:22:05.361990] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-02T19:22:05.362066] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-02T19:22:05.362119] [INFO ] [MAIN ] HFND: Starting full primary refresh. [2025-10-02T19:22:05.736190] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-02T19:22:05.815085] [INFO ] [REMOTE ] HFND: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:22:05.873018] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-10. [2025-10-02T19:22:06.672983] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-05. [2025-10-02T19:22:06.852770] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-02T19:22:06.931512] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-10-02T19:22:07.473003] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-08. [2025-10-02T19:22:08.273010] [INFO ] [REMOTE ] HFND: Fetching primary data for 2024-12. [2025-10-02T19:22:08.657909] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-10 (2.78 seconds). [2025-10-02T19:22:08.659255] [INFO ] [REMOTE ] HEI: Full fetch complete (48563 records). [2025-10-02T19:22:08.659376] [DEBUG] [VALIDATOR ] HEI: Validating primary data. [2025-10-02T19:22:08.660059] [FATAL] [VALIDATOR ] HEI: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:22:08.660145] [FATAL] [MAIN ] HEI: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:22:08.660211] [WARN ] [MAIN ] HEI: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:22:08.660286] [INFO ] [LOCAL ] HEI: Starting deletion of primary data. [2025-10-02T19:22:08.660351] [DEBUG] [LOCAL ] HEI: No primary data file found to delete. [2025-10-02T19:22:08.660388] [INFO ] [LOCAL ] HEI: Starting deletion of derivative data. [2025-10-02T19:22:08.660430] [DEBUG] [LOCAL ] HEI: No derivative data file found to delete. [2025-10-02T19:22:08.660502] [INFO ] [MAIN ] Update Progress: 1007/2370 symbols completed. HEI took 34.0s. Estimated remaining: 3h 12m 19s. Rate: 7.1 symbols/min [2025-10-02T19:22:08.752570] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-02T19:22:08.865008] [INFO ] [MAIN ] HFRO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:22:08.865197] [DEBUG] [LOCAL ] HFRO: No existing data file found in primary storage. [2025-10-02T19:22:08.865244] [WARN ] [MAIN ] HFRO: No existing data found, performing full refresh instead. [2025-10-02T19:22:08.865364] [INFO ] [MAIN ] HFRO: Wiping existing primary data before full refresh. [2025-10-02T19:22:08.865406] [INFO ] [LOCAL ] HFRO: Starting deletion of primary data. [2025-10-02T19:22:08.865448] [DEBUG] [LOCAL ] HFRO: No primary data file found to delete. [2025-10-02T19:22:08.865482] [INFO ] [MAIN ] HFRO: Starting full primary refresh. [2025-10-02T19:22:09.074142] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-06. [2025-10-02T19:22:09.299622] [INFO ] [REMOTE ] HFRO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:22:09.331392] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-02T19:22:09.364278] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-10-02T19:22:09.873041] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-07. [2025-10-02T19:22:10.131885] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-10-02T19:22:10.673004] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-09. [2025-10-02T19:22:11.473001] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2024-12. [2025-10-02T19:22:12.272995] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-01. [2025-10-02T19:22:12.366672] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-02T19:22:12.757753] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-02T19:22:12.836379] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-02T19:22:13.072994] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-08. [2025-10-02T19:22:13.298607] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-08 (0.23 seconds). [2025-10-02T19:22:13.873003] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-09. [2025-10-02T19:22:14.151238] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-10-02T19:22:14.673012] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-10. [2025-10-02T19:22:15.473023] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-02. [2025-10-02T19:22:15.948026] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-02T19:22:16.273012] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-03. [2025-10-02T19:22:16.730706] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-02T19:22:16.937302] [DEBUG] [REMOTE ] HF: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T19:22:16.937624] [WARN ] [REMOTE ] HF: No data returned for month 2025-10 [2025-10-02T19:22:16.937744] [FATAL] [REMOTE ] HF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T19:22:16.937822] [FATAL] [MAIN ] HF: Failed to fetch primary data. [2025-10-02T19:22:16.937891] [WARN ] [MAIN ] HF: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T19:22:16.937966] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-02T19:22:16.938046] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-02T19:22:16.938105] [INFO ] [LOCAL ] HF: Starting deletion of derivative data. [2025-10-02T19:22:16.938196] [DEBUG] [LOCAL ] HF: No derivative data file found to delete. [2025-10-02T19:22:16.938268] [INFO ] [MAIN ] Update Progress: 1008/2370 symbols completed. HF took 32.5s. Estimated remaining: 3h 12m 10s. Rate: 7.1 symbols/min [2025-10-02T19:22:17.078109] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-04. [2025-10-02T19:22:17.139003] [INFO ] [MAIN ] HGER: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:22:17.139235] [DEBUG] [LOCAL ] HGER: No existing data file found in primary storage. [2025-10-02T19:22:17.139282] [WARN ] [MAIN ] HGER: No existing data found, performing full refresh instead. [2025-10-02T19:22:17.139411] [INFO ] [MAIN ] HGER: Wiping existing primary data before full refresh. [2025-10-02T19:22:17.139462] [INFO ] [LOCAL ] HGER: Starting deletion of primary data. [2025-10-02T19:22:17.139508] [DEBUG] [LOCAL ] HGER: No primary data file found to delete. [2025-10-02T19:22:17.139546] [INFO ] [MAIN ] HGER: Starting full primary refresh. [2025-10-02T19:22:17.549609] [INFO ] [REMOTE ] HGER: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:22:17.553271] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-02T19:22:17.872997] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-10. [2025-10-02T19:22:18.673026] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-01. [2025-10-02T19:22:19.473015] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-05. [2025-10-02T19:22:19.818270] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-02T19:22:19.868464] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-02T19:22:20.273024] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-06. [2025-10-02T19:22:20.596581] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-02T19:22:20.992689] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-10 (3.12 seconds). [2025-10-02T19:22:20.997046] [INFO ] [REMOTE ] HESM: Full fetch complete (68911 records). [2025-10-02T19:22:20.997167] [DEBUG] [VALIDATOR ] HESM: Validating primary data. [2025-10-02T19:22:20.998052] [FATAL] [VALIDATOR ] HESM: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:22:20.998207] [FATAL] [MAIN ] HESM: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:22:20.998310] [WARN ] [MAIN ] HESM: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:22:20.998387] [INFO ] [LOCAL ] HESM: Starting deletion of primary data. [2025-10-02T19:22:20.998454] [DEBUG] [LOCAL ] HESM: No primary data file found to delete. [2025-10-02T19:22:20.998490] [INFO ] [LOCAL ] HESM: Starting deletion of derivative data. [2025-10-02T19:22:20.998531] [DEBUG] [LOCAL ] HESM: No derivative data file found to delete. [2025-10-02T19:22:20.998590] [INFO ] [MAIN ] Update Progress: 1009/2370 symbols completed. HESM took 40.3s. Estimated remaining: 3h 11m 55s. Rate: 7.1 symbols/min [2025-10-02T19:22:21.078228] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-07. [2025-10-02T19:22:21.206243] [INFO ] [MAIN ] HGLB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:22:21.206479] [DEBUG] [LOCAL ] HGLB: No existing data file found in primary storage. [2025-10-02T19:22:21.206541] [WARN ] [MAIN ] HGLB: No existing data found, performing full refresh instead. [2025-10-02T19:22:21.206682] [INFO ] [MAIN ] HGLB: Wiping existing primary data before full refresh. [2025-10-02T19:22:21.206739] [INFO ] [LOCAL ] HGLB: Starting deletion of primary data. [2025-10-02T19:22:21.206787] [DEBUG] [LOCAL ] HGLB: No primary data file found to delete. [2025-10-02T19:22:21.206822] [INFO ] [MAIN ] HGLB: Starting full primary refresh. [2025-10-02T19:22:21.568493] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-02T19:22:21.603267] [INFO ] [REMOTE ] HGLB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:22:21.873000] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-02. [2025-10-02T19:22:22.672976] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2024-12. [2025-10-02T19:22:22.905084] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-02T19:22:23.472988] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-03. [2025-10-02T19:22:23.515873] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-02T19:22:24.237522] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-02T19:22:24.272995] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-01. [2025-10-02T19:22:25.041104] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-02T19:22:25.072975] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-04. [2025-10-02T19:22:25.873015] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-08. [2025-10-02T19:22:25.924763] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-02T19:22:26.300556] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-02T19:22:26.673074] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-02. [2025-10-02T19:22:27.473001] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-09. [2025-10-02T19:22:27.512909] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-02T19:22:27.950727] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-02T19:22:28.273014] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-03. [2025-10-02T19:22:29.073034] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-05. [2025-10-02T19:22:29.086526] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-02T19:22:29.870156] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-02T19:22:29.873928] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-10. [2025-10-02T19:22:30.673010] [INFO ] [REMOTE ] HGER: Fetching primary data for 2024-12. [2025-10-02T19:22:31.226133] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-02T19:22:31.473027] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-01. [2025-10-02T19:22:32.162077] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-02T19:22:32.161356] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-10 (2.29 seconds). [2025-10-02T19:22:32.163055] [INFO ] [REMOTE ] HFND: Full fetch complete (1777 records). [2025-10-02T19:22:32.165026] [DEBUG] [VALIDATOR ] HFND: Validating primary data. [2025-10-02T19:22:32.166371] [FATAL] [VALIDATOR ] HFND: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:22:32.166461] [FATAL] [MAIN ] HFND: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:22:32.166539] [WARN ] [MAIN ] HFND: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:22:32.166616] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-02T19:22:32.166748] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-02T19:22:32.166835] [INFO ] [LOCAL ] HFND: Starting deletion of derivative data. [2025-10-02T19:22:32.166890] [DEBUG] [LOCAL ] HFND: No derivative data file found to delete. [2025-10-02T19:22:32.166947] [INFO ] [MAIN ] Update Progress: 1010/2370 symbols completed. HFND took 27.0s. Estimated remaining: 3h 11m 51s. Rate: 7.1 symbols/min [2025-10-02T19:22:32.278131] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-02. [2025-10-02T19:22:32.421874] [INFO ] [MAIN ] HGTY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:22:32.422053] [DEBUG] [LOCAL ] HGTY: No existing data file found in primary storage. [2025-10-02T19:22:32.422092] [WARN ] [MAIN ] HGTY: No existing data found, performing full refresh instead. [2025-10-02T19:22:32.422208] [INFO ] [MAIN ] HGTY: Wiping existing primary data before full refresh. [2025-10-02T19:22:32.422252] [INFO ] [LOCAL ] HGTY: Starting deletion of primary data. [2025-10-02T19:22:32.422297] [DEBUG] [LOCAL ] HGTY: No primary data file found to delete. [2025-10-02T19:22:32.422332] [INFO ] [MAIN ] HGTY: Starting full primary refresh. [2025-10-02T19:22:32.823896] [INFO ] [REMOTE ] HGTY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:22:32.862614] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-02T19:22:33.073026] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2024-12. [2025-10-02T19:22:33.528348] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-02T19:22:33.873005] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-03. [2025-10-02T19:22:34.580470] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-02T19:22:34.673046] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-06. [2025-10-02T19:22:35.472989] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-04. [2025-10-02T19:22:35.684469] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-02T19:22:36.272972] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-07. [2025-10-02T19:22:36.319316] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-02T19:22:37.062674] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-02T19:22:37.072952] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-08. [2025-10-02T19:22:37.873005] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-01. [2025-10-02T19:22:38.149920] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-02T19:22:38.561355] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-02T19:22:38.673052] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-04. [2025-10-02T19:22:39.473006] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-05. [2025-10-02T19:22:39.515072] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-02T19:22:40.183149] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-02T19:22:40.273001] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-06. [2025-10-02T19:22:40.766117] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-02T19:22:41.073196] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-05. [2025-10-02T19:22:41.834846] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-02T19:22:41.872975] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-06. [2025-10-02T19:22:42.470177] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-02T19:22:42.673031] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-02. [2025-10-02T19:22:43.436018] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-02T19:22:43.473024] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-07. [2025-10-02T19:22:44.273214] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-09. [2025-10-02T19:22:44.284918] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-02T19:22:45.072986] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-03. [2025-10-02T19:22:45.308054] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-02T19:22:45.841534] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-02T19:22:45.873044] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-08. [2025-10-02T19:22:46.601798] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-02T19:22:46.672992] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-10. [2025-10-02T19:22:47.473010] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-07. [2025-10-02T19:22:48.164423] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-02T19:22:48.273021] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-08. [2025-10-02T19:22:49.073069] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-09. [2025-10-02T19:22:49.167822] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-02T19:22:49.331479] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-10 (2.66 seconds). [2025-10-02T19:22:49.332530] [INFO ] [REMOTE ] HFRO: Full fetch complete (28882 records). [2025-10-02T19:22:49.332611] [DEBUG] [VALIDATOR ] HFRO: Validating primary data. [2025-10-02T19:22:49.333196] [FATAL] [VALIDATOR ] HFRO: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:22:49.333296] [FATAL] [MAIN ] HFRO: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:22:49.333373] [WARN ] [MAIN ] HFRO: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:22:49.333507] [INFO ] [LOCAL ] HFRO: Starting deletion of primary data. [2025-10-02T19:22:49.333611] [DEBUG] [LOCAL ] HFRO: No primary data file found to delete. [2025-10-02T19:22:49.333700] [INFO ] [LOCAL ] HFRO: Starting deletion of derivative data. [2025-10-02T19:22:49.333761] [DEBUG] [LOCAL ] HFRO: No derivative data file found to delete. [2025-10-02T19:22:49.333820] [INFO ] [MAIN ] Update Progress: 1011/2370 symbols completed. HFRO took 40.7s. Estimated remaining: 3h 11m 54s. Rate: 7.1 symbols/min [2025-10-02T19:22:49.520613] [INFO ] [MAIN ] HGV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:22:49.520863] [DEBUG] [LOCAL ] HGV: No existing data file found in primary storage. [2025-10-02T19:22:49.520920] [WARN ] [MAIN ] HGV: No existing data found, performing full refresh instead. [2025-10-02T19:22:49.521086] [INFO ] [MAIN ] HGV: Wiping existing primary data before full refresh. [2025-10-02T19:22:49.521160] [INFO ] [LOCAL ] HGV: Starting deletion of primary data. [2025-10-02T19:22:49.521223] [DEBUG] [LOCAL ] HGV: No primary data file found to delete. [2025-10-02T19:22:49.521258] [INFO ] [MAIN ] HGV: Starting full primary refresh. [2025-10-02T19:22:49.890689] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-04. [2025-10-02T19:22:49.942570] [INFO ] [REMOTE ] HGV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:22:49.951312] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-02T19:22:50.673038] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-10. [2025-10-02T19:22:50.751302] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-02T19:22:51.473000] [INFO ] [REMOTE ] HGV: Fetching primary data for 2024-12. [2025-10-02T19:22:52.273033] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-09. [2025-10-02T19:22:53.073003] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-05. [2025-10-02T19:23:05.927888] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-05 (12.85 seconds). [2025-10-02T19:23:05.932754] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-06. [2025-10-02T19:23:06.595028] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-09 (14.32 seconds). [2025-10-02T19:23:06.601394] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-10. [2025-10-02T19:23:08.099708] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2024-12 (16.63 seconds). [2025-10-02T19:23:08.108450] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-01. [2025-10-02T19:23:08.656075] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-10 (17.98 seconds). [2025-10-02T19:23:08.656919] [INFO ] [REMOTE ] HGLB: Full fetch complete (14514 records). [2025-10-02T19:23:08.656996] [DEBUG] [VALIDATOR ] HGLB: Validating primary data. [2025-10-02T19:23:08.657403] [FATAL] [VALIDATOR ] HGLB: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:23:08.657490] [FATAL] [MAIN ] HGLB: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:23:08.657537] [WARN ] [MAIN ] HGLB: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:23:08.657606] [INFO ] [LOCAL ] HGLB: Starting deletion of primary data. [2025-10-02T19:23:08.657705] [DEBUG] [LOCAL ] HGLB: No primary data file found to delete. [2025-10-02T19:23:08.657796] [INFO ] [LOCAL ] HGLB: Starting deletion of derivative data. [2025-10-02T19:23:08.657860] [DEBUG] [LOCAL ] HGLB: No derivative data file found to delete. [2025-10-02T19:23:08.657919] [INFO ] [MAIN ] Update Progress: 1012/2370 symbols completed. HGLB took 47.7s. Estimated remaining: 3h 11m 60s. Rate: 7.1 symbols/min [2025-10-02T19:23:08.853917] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-06 (2.92 seconds). [2025-10-02T19:23:08.857489] [INFO ] [MAIN ] HHH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:23:08.860528] [DEBUG] [LOCAL ] HHH: No existing data file found in primary storage. [2025-10-02T19:23:08.860907] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-07. [2025-10-02T19:23:08.860969] [WARN ] [MAIN ] HHH: No existing data found, performing full refresh instead. [2025-10-02T19:23:08.861960] [INFO ] [MAIN ] HHH: Wiping existing primary data before full refresh. [2025-10-02T19:23:08.862011] [INFO ] [LOCAL ] HHH: Starting deletion of primary data. [2025-10-02T19:23:08.862057] [DEBUG] [LOCAL ] HHH: No primary data file found to delete. [2025-10-02T19:23:08.862092] [INFO ] [MAIN ] HHH: Starting full primary refresh. [2025-10-02T19:23:09.255214] [INFO ] [REMOTE ] HHH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:23:09.255562] [INFO ] [REMOTE ] HHH: Fetching primary data for 2024-12. [2025-10-02T19:23:09.506301] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-02T19:23:09.509554] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-08. [2025-10-02T19:23:09.900208] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-02T19:23:09.909827] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-02. [2025-10-02T19:23:10.554692] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-02T19:23:10.559626] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-09. [2025-10-02T19:23:10.704583] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-02T19:23:10.704763] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-10 (4.10 seconds). [2025-10-02T19:23:10.712134] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-01. [2025-10-02T19:23:10.711428] [INFO ] [REMOTE ] HGER: Full fetch complete (16772 records). [2025-10-02T19:23:10.712334] [DEBUG] [VALIDATOR ] HGER: Validating primary data. [2025-10-02T19:23:10.713902] [FATAL] [VALIDATOR ] HGER: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:23:10.714008] [FATAL] [MAIN ] HGER: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:23:10.714213] [WARN ] [MAIN ] HGER: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:23:10.714309] [INFO ] [LOCAL ] HGER: Starting deletion of primary data. [2025-10-02T19:23:10.714393] [DEBUG] [LOCAL ] HGER: No primary data file found to delete. [2025-10-02T19:23:10.714440] [INFO ] [LOCAL ] HGER: Starting deletion of derivative data. [2025-10-02T19:23:10.714484] [DEBUG] [LOCAL ] HGER: No derivative data file found to delete. [2025-10-02T19:23:10.714545] [INFO ] [MAIN ] Update Progress: 1013/2370 symbols completed. HGER took 53.8s. Estimated remaining: 3h 11m 43s. Rate: 7.1 symbols/min [2025-10-02T19:23:10.911960] [INFO ] [MAIN ] HI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:23:10.912127] [DEBUG] [LOCAL ] HI: No existing data file found in primary storage. [2025-10-02T19:23:10.912168] [WARN ] [MAIN ] HI: No existing data found, performing full refresh instead. [2025-10-02T19:23:10.912317] [INFO ] [MAIN ] HI: Wiping existing primary data before full refresh. [2025-10-02T19:23:10.912387] [INFO ] [LOCAL ] HI: Starting deletion of primary data. [2025-10-02T19:23:10.912440] [DEBUG] [LOCAL ] HI: No primary data file found to delete. [2025-10-02T19:23:10.912478] [INFO ] [MAIN ] HI: Starting full primary refresh. [2025-10-02T19:23:11.327326] [INFO ] [REMOTE ] HI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:23:11.327864] [INFO ] [REMOTE ] HI: Fetching primary data for 2024-12. [2025-10-02T19:23:11.342530] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-02T19:23:11.348425] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-10. [2025-10-02T19:23:11.423204] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-02T19:23:11.432148] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-03. [2025-10-02T19:23:12.228296] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-02T19:23:12.234795] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-02. [2025-10-02T19:23:12.709893] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-02T19:23:12.718136] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-01. [2025-10-02T19:23:13.236769] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-02T19:23:13.258253] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-04. [2025-10-02T19:23:13.270942] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-02T19:23:13.278412] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-03. [2025-10-02T19:23:13.894119] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-02T19:23:13.901424] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-02. [2025-10-02T19:23:13.990859] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-10 (2.64 seconds). [2025-10-02T19:23:13.991769] [INFO ] [REMOTE ] HGTY: Full fetch complete (17158 records). [2025-10-02T19:23:13.991843] [DEBUG] [VALIDATOR ] HGTY: Validating primary data. [2025-10-02T19:23:13.992304] [FATAL] [VALIDATOR ] HGTY: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:23:13.992400] [FATAL] [MAIN ] HGTY: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:23:13.992470] [WARN ] [MAIN ] HGTY: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:23:13.992578] [INFO ] [LOCAL ] HGTY: Starting deletion of primary data. [2025-10-02T19:23:13.992673] [DEBUG] [LOCAL ] HGTY: No primary data file found to delete. [2025-10-02T19:23:13.992733] [INFO ] [LOCAL ] HGTY: Starting deletion of derivative data. [2025-10-02T19:23:13.992792] [DEBUG] [LOCAL ] HGTY: No derivative data file found to delete. [2025-10-02T19:23:13.992868] [INFO ] [MAIN ] Update Progress: 1014/2370 symbols completed. HGTY took 41.8s. Estimated remaining: 3h 11m 27s. Rate: 7.1 symbols/min [2025-10-02T19:23:14.182263] [INFO ] [MAIN ] HIG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:23:14.182471] [DEBUG] [LOCAL ] HIG: No existing data file found in primary storage. [2025-10-02T19:23:14.182521] [WARN ] [MAIN ] HIG: No existing data found, performing full refresh instead. [2025-10-02T19:23:14.182633] [INFO ] [MAIN ] HIG: Wiping existing primary data before full refresh. [2025-10-02T19:23:14.182761] [INFO ] [LOCAL ] HIG: Starting deletion of primary data. [2025-10-02T19:23:14.182814] [DEBUG] [LOCAL ] HIG: No primary data file found to delete. [2025-10-02T19:23:14.182849] [INFO ] [MAIN ] HIG: Starting full primary refresh. [2025-10-02T19:23:14.609510] [INFO ] [REMOTE ] HIG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:23:14.610034] [INFO ] [REMOTE ] HIG: Fetching primary data for 2024-12. [2025-10-02T19:23:14.631094] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-02T19:23:14.638534] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-04. [2025-10-02T19:23:14.674933] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-02T19:23:14.686786] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-05. [2025-10-02T19:23:15.305713] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-02T19:23:15.313847] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-03. [2025-10-02T19:23:15.657126] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-02T19:23:15.663828] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-05. [2025-10-02T19:23:16.162528] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-02T19:23:16.173922] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-06. [2025-10-02T19:23:16.460486] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-02T19:23:16.471355] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-01. [2025-10-02T19:23:16.557113] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-02T19:23:16.564607] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-04. [2025-10-02T19:23:16.890270] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-02T19:23:16.903119] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-06. [2025-10-02T19:23:17.706606] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-02T19:23:17.718191] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-07. [2025-10-02T19:23:18.100565] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-02T19:23:18.109398] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-07. [2025-10-02T19:23:18.137136] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-02T19:23:18.146562] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-05. [2025-10-02T19:23:18.218721] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-02T19:23:18.229063] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-02. [2025-10-02T19:23:19.423175] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-02T19:23:19.441911] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-08. [2025-10-02T19:23:19.554539] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-02T19:23:19.563571] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-06. [2025-10-02T19:23:19.612612] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-02T19:23:19.622484] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-08. [2025-10-02T19:23:19.807080] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-02T19:23:20.273035] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-03. [2025-10-02T19:23:20.556417] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-02T19:23:20.643489] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-02T19:23:21.032922] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-02T19:23:21.073044] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-09. [2025-10-02T19:23:21.873019] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-09. [2025-10-02T19:23:22.007697] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-02T19:23:22.119743] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-02T19:23:22.673042] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-10. [2025-10-02T19:23:22.983683] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-02T19:23:23.473039] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-04. [2025-10-02T19:23:24.273051] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-10. [2025-10-02T19:23:25.072990] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-07. [2025-10-02T19:23:25.328538] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-02T19:23:25.704400] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-10 (3.03 seconds). [2025-10-02T19:23:25.705782] [INFO ] [REMOTE ] HHH: Full fetch complete (45405 records). [2025-10-02T19:23:25.705873] [DEBUG] [VALIDATOR ] HHH: Validating primary data. [2025-10-02T19:23:25.706482] [FATAL] [VALIDATOR ] HHH: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:23:25.706569] [FATAL] [MAIN ] HHH: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:23:25.706626] [WARN ] [MAIN ] HHH: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:23:25.706838] [INFO ] [LOCAL ] HHH: Starting deletion of primary data. [2025-10-02T19:23:25.706921] [DEBUG] [LOCAL ] HHH: No primary data file found to delete. [2025-10-02T19:23:25.706960] [INFO ] [LOCAL ] HHH: Starting deletion of derivative data. [2025-10-02T19:23:25.707001] [DEBUG] [LOCAL ] HHH: No derivative data file found to delete. [2025-10-02T19:23:25.707061] [INFO ] [MAIN ] Update Progress: 1015/2370 symbols completed. HHH took 17.0s. Estimated remaining: 3h 11m 23s. Rate: 7.1 symbols/min [2025-10-02T19:23:25.881837] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-05. [2025-10-02T19:23:25.913706] [INFO ] [MAIN ] HII: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:23:25.913994] [DEBUG] [LOCAL ] HII: No existing data file found in primary storage. [2025-10-02T19:23:25.914069] [WARN ] [MAIN ] HII: No existing data found, performing full refresh instead. [2025-10-02T19:23:25.914228] [INFO ] [MAIN ] HII: Wiping existing primary data before full refresh. [2025-10-02T19:23:25.914306] [INFO ] [LOCAL ] HII: Starting deletion of primary data. [2025-10-02T19:23:25.914399] [DEBUG] [LOCAL ] HII: No primary data file found to delete. [2025-10-02T19:23:25.914470] [INFO ] [MAIN ] HII: Starting full primary refresh. [2025-10-02T19:23:26.344743] [INFO ] [REMOTE ] HII: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:23:26.370398] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-02T19:23:26.673023] [INFO ] [REMOTE ] HII: Fetching primary data for 2024-12. [2025-10-02T19:23:27.326273] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-10 (3.05 seconds). [2025-10-02T19:23:27.327940] [INFO ] [REMOTE ] HGV: Full fetch complete (65632 records). [2025-10-02T19:23:27.328062] [DEBUG] [VALIDATOR ] HGV: Validating primary data. [2025-10-02T19:23:27.329318] [FATAL] [VALIDATOR ] HGV: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:23:27.329408] [FATAL] [MAIN ] HGV: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:23:27.329453] [WARN ] [MAIN ] HGV: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:23:27.329524] [INFO ] [LOCAL ] HGV: Starting deletion of primary data. [2025-10-02T19:23:27.329594] [DEBUG] [LOCAL ] HGV: No primary data file found to delete. [2025-10-02T19:23:27.329632] [INFO ] [LOCAL ] HGV: Starting deletion of derivative data. [2025-10-02T19:23:27.329725] [DEBUG] [LOCAL ] HGV: No derivative data file found to delete. [2025-10-02T19:23:27.329846] [INFO ] [MAIN ] Update Progress: 1016/2370 symbols completed. HGV took 38.0s. Estimated remaining: 3h 11m 6s. Rate: 7.1 symbols/min [2025-10-02T19:23:27.477817] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-08. [2025-10-02T19:23:27.536746] [INFO ] [MAIN ] HIMS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:23:27.537184] [DEBUG] [LOCAL ] HIMS: No existing data file found in primary storage. [2025-10-02T19:23:27.537451] [WARN ] [MAIN ] HIMS: No existing data found, performing full refresh instead. [2025-10-02T19:23:27.537818] [INFO ] [MAIN ] HIMS: Wiping existing primary data before full refresh. [2025-10-02T19:23:27.537974] [INFO ] [LOCAL ] HIMS: Starting deletion of primary data. [2025-10-02T19:23:27.538091] [DEBUG] [LOCAL ] HIMS: No primary data file found to delete. [2025-10-02T19:23:27.538227] [INFO ] [MAIN ] HIMS: Starting full primary refresh. [2025-10-02T19:23:28.010895] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-02T19:23:28.137473] [INFO ] [REMOTE ] HIMS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:23:28.189909] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-02T19:23:28.273008] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-01. [2025-10-02T19:23:28.705391] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-02T19:23:29.073000] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2024-12. [2025-10-02T19:23:29.723235] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-02T19:23:29.873005] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-06. [2025-10-02T19:23:30.673015] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-09. [2025-10-02T19:23:31.184993] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-02T19:23:31.473055] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-02. [2025-10-02T19:23:31.547801] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2024-12 (2.47 seconds). [2025-10-02T19:23:31.768601] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-02T19:23:32.273051] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-01. [2025-10-02T19:23:33.073224] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-10. [2025-10-02T19:23:33.100748] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-02T19:23:33.873003] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-03. [2025-10-02T19:23:34.596770] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-10-02T19:23:34.673049] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-02. [2025-10-02T19:23:35.472992] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-07. [2025-10-02T19:23:35.554230] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-02T19:23:36.272994] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-04. [2025-10-02T19:23:36.521387] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-10 (3.45 seconds). [2025-10-02T19:23:36.522703] [INFO ] [REMOTE ] HI: Full fetch complete (49754 records). [2025-10-02T19:23:36.522785] [DEBUG] [VALIDATOR ] HI: Validating primary data. [2025-10-02T19:23:36.523358] [FATAL] [VALIDATOR ] HI: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:23:36.523442] [FATAL] [MAIN ] HI: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:23:36.523486] [WARN ] [MAIN ] HI: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:23:36.523553] [INFO ] [LOCAL ] HI: Starting deletion of primary data. [2025-10-02T19:23:36.523615] [DEBUG] [LOCAL ] HI: No primary data file found to delete. [2025-10-02T19:23:36.523680] [INFO ] [LOCAL ] HI: Starting deletion of derivative data. [2025-10-02T19:23:36.523743] [DEBUG] [LOCAL ] HI: No derivative data file found to delete. [2025-10-02T19:23:36.523814] [INFO ] [MAIN ] Update Progress: 1017/2370 symbols completed. HI took 25.8s. Estimated remaining: 3h 10m 58s. Rate: 7.1 symbols/min [2025-10-02T19:23:36.708567] [INFO ] [MAIN ] HIO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:23:36.708760] [DEBUG] [LOCAL ] HIO: No existing data file found in primary storage. [2025-10-02T19:23:36.708866] [WARN ] [MAIN ] HIO: No existing data found, performing full refresh instead. [2025-10-02T19:23:36.708987] [INFO ] [MAIN ] HIO: Wiping existing primary data before full refresh. [2025-10-02T19:23:36.709030] [INFO ] [LOCAL ] HIO: Starting deletion of primary data. [2025-10-02T19:23:36.709073] [DEBUG] [LOCAL ] HIO: No primary data file found to delete. [2025-10-02T19:23:36.709106] [INFO ] [MAIN ] HIO: Starting full primary refresh. [2025-10-02T19:23:37.109446] [INFO ] [REMOTE ] HIO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:23:37.110186] [INFO ] [REMOTE ] HIO: Fetching primary data for 2024-12. [2025-10-02T19:23:37.319463] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-02T19:23:37.363717] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-02 (2.69 seconds). [2025-10-02T19:23:37.856093] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-02T19:23:37.880993] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-03. [2025-10-02T19:23:37.886854] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-02T19:23:38.673009] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-01. [2025-10-02T19:23:39.473017] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-08. [2025-10-02T19:23:39.867777] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-02T19:23:40.272975] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-02. [2025-10-02T19:23:40.616405] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-03 (2.74 seconds). [2025-10-02T19:23:40.759105] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-02T19:23:41.073019] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-09. [2025-10-02T19:23:41.450280] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-02T19:23:41.873047] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-04. [2025-10-02T19:23:42.672981] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-05. [2025-10-02T19:23:42.789976] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-02T19:23:43.473054] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-03. [2025-10-02T19:23:44.231623] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-02T19:23:44.273067] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-10. [2025-10-02T19:23:44.477551] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-04 (2.60 seconds). [2025-10-02T19:23:44.510618] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-02T19:23:45.073005] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-05. [2025-10-02T19:23:45.873038] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-04. [2025-10-02T19:23:46.673074] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-06. [2025-10-02T19:23:47.093390] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-02T19:23:47.473013] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-05. [2025-10-02T19:23:47.585225] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-10 (3.31 seconds). [2025-10-02T19:23:47.587116] [INFO ] [REMOTE ] HIG: Full fetch complete (72859 records). [2025-10-02T19:23:47.587271] [DEBUG] [VALIDATOR ] HIG: Validating primary data. [2025-10-02T19:23:47.588081] [FATAL] [VALIDATOR ] HIG: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:23:47.588230] [FATAL] [MAIN ] HIG: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:23:47.588305] [WARN ] [MAIN ] HIG: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:23:47.588381] [INFO ] [LOCAL ] HIG: Starting deletion of primary data. [2025-10-02T19:23:47.588489] [DEBUG] [LOCAL ] HIG: No primary data file found to delete. [2025-10-02T19:23:47.588544] [INFO ] [LOCAL ] HIG: Starting deletion of derivative data. [2025-10-02T19:23:47.588590] [DEBUG] [LOCAL ] HIG: No derivative data file found to delete. [2025-10-02T19:23:47.588683] [INFO ] [MAIN ] Update Progress: 1018/2370 symbols completed. HIG took 33.6s. Estimated remaining: 3h 10m 53s. Rate: 7.1 symbols/min [2025-10-02T19:23:47.797923] [INFO ] [MAIN ] HIPO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:23:47.798524] [DEBUG] [LOCAL ] HIPO: No existing data file found in primary storage. [2025-10-02T19:23:47.798608] [WARN ] [MAIN ] HIPO: No existing data found, performing full refresh instead. [2025-10-02T19:23:47.799258] [INFO ] [MAIN ] HIPO: Wiping existing primary data before full refresh. [2025-10-02T19:23:47.799515] [INFO ] [LOCAL ] HIPO: Starting deletion of primary data. [2025-10-02T19:23:47.824303] [DEBUG] [LOCAL ] HIPO: No primary data file found to delete. [2025-10-02T19:23:47.854017] [INFO ] [MAIN ] HIPO: Starting full primary refresh. [2025-10-02T19:23:47.856456] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-02T19:23:47.863850] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-05 (2.79 seconds). [2025-10-02T19:23:48.276101] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-07. [2025-10-02T19:23:48.276010] [INFO ] [REMOTE ] HIPO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:23:48.550984] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-02T19:23:49.073015] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-06. [2025-10-02T19:23:49.698855] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-02T19:23:49.798945] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-02T19:23:49.873043] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-06. [2025-10-02T19:23:50.673012] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-07. [2025-10-02T19:23:51.473006] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2024-12. [2025-10-02T19:23:51.715434] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-02T19:23:52.272991] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-08. [2025-10-02T19:23:52.510105] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-02T19:23:52.571785] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-06 (2.70 seconds). [2025-10-02T19:23:53.072967] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-07. [2025-10-02T19:23:53.388853] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-02T19:23:53.873004] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-08. [2025-10-02T19:23:54.673008] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-09. [2025-10-02T19:23:55.277255] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-02T19:23:55.473066] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-01. [2025-10-02T19:23:55.860706] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-07 (2.79 seconds). [2025-10-02T19:23:55.910967] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-02T19:23:56.273059] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-10. [2025-10-02T19:23:56.461180] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-02T19:23:57.073003] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-09. [2025-10-02T19:23:57.873055] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-08. [2025-10-02T19:23:58.161455] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-02T19:23:58.673010] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-10. [2025-10-02T19:23:59.142047] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-10 (2.87 seconds). [2025-10-02T19:23:59.143386] [INFO ] [REMOTE ] HIO: Full fetch complete (37119 records). [2025-10-02T19:23:59.143474] [DEBUG] [VALIDATOR ] HIO: Validating primary data. [2025-10-02T19:23:59.144043] [FATAL] [VALIDATOR ] HIO: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:23:59.144127] [FATAL] [MAIN ] HIO: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:23:59.144171] [WARN ] [MAIN ] HIO: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:23:59.144212] [INFO ] [LOCAL ] HIO: Starting deletion of primary data. [2025-10-02T19:23:59.144267] [DEBUG] [LOCAL ] HIO: No primary data file found to delete. [2025-10-02T19:23:59.144304] [INFO ] [LOCAL ] HIO: Starting deletion of derivative data. [2025-10-02T19:23:59.144344] [DEBUG] [LOCAL ] HIO: No derivative data file found to delete. [2025-10-02T19:23:59.144397] [INFO ] [MAIN ] Update Progress: 1019/2370 symbols completed. HIO took 22.6s. Estimated remaining: 3h 10m 49s. Rate: 7.1 symbols/min [2025-10-02T19:23:59.328726] [INFO ] [MAIN ] HIW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:23:59.328908] [DEBUG] [LOCAL ] HIW: No existing data file found in primary storage. [2025-10-02T19:23:59.328947] [WARN ] [MAIN ] HIW: No existing data found, performing full refresh instead. [2025-10-02T19:23:59.329068] [INFO ] [MAIN ] HIW: Wiping existing primary data before full refresh. [2025-10-02T19:23:59.329111] [INFO ] [LOCAL ] HIW: Starting deletion of primary data. [2025-10-02T19:23:59.329202] [DEBUG] [LOCAL ] HIW: No primary data file found to delete. [2025-10-02T19:23:59.329289] [INFO ] [MAIN ] HIW: Starting full primary refresh. [2025-10-02T19:23:59.478174] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-02. [2025-10-02T19:23:59.749310] [INFO ] [REMOTE ] HIW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:24:00.118222] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-02T19:24:00.272983] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-09. [2025-10-02T19:24:00.633714] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-02T19:24:01.073000] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-03. [2025-10-02T19:24:01.741102] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-10 (3.07 seconds). [2025-10-02T19:24:01.743032] [INFO ] [REMOTE ] HII: Full fetch complete (52789 records). [2025-10-02T19:24:01.743191] [DEBUG] [VALIDATOR ] HII: Validating primary data. [2025-10-02T19:24:01.744352] [FATAL] [VALIDATOR ] HII: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:24:01.744460] [FATAL] [MAIN ] HII: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:24:01.744545] [WARN ] [MAIN ] HII: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:24:01.744630] [INFO ] [LOCAL ] HII: Starting deletion of primary data. [2025-10-02T19:24:01.744808] [DEBUG] [LOCAL ] HII: No primary data file found to delete. [2025-10-02T19:24:01.744868] [INFO ] [LOCAL ] HII: Starting deletion of derivative data. [2025-10-02T19:24:01.744930] [DEBUG] [LOCAL ] HII: No derivative data file found to delete. [2025-10-02T19:24:01.745013] [INFO ] [MAIN ] Update Progress: 1020/2370 symbols completed. HII took 36.0s. Estimated remaining: 3h 10m 33s. Rate: 7.1 symbols/min [2025-10-02T19:24:01.878411] [INFO ] [REMOTE ] HIW: Fetching primary data for 2024-12. [2025-10-02T19:24:01.958853] [INFO ] [MAIN ] HIX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:24:01.959257] [DEBUG] [LOCAL ] HIX: No existing data file found in primary storage. [2025-10-02T19:24:01.959338] [WARN ] [MAIN ] HIX: No existing data found, performing full refresh instead. [2025-10-02T19:24:01.959533] [INFO ] [MAIN ] HIX: Wiping existing primary data before full refresh. [2025-10-02T19:24:01.959609] [INFO ] [LOCAL ] HIX: Starting deletion of primary data. [2025-10-02T19:24:01.959729] [DEBUG] [LOCAL ] HIX: No primary data file found to delete. [2025-10-02T19:24:01.959773] [INFO ] [MAIN ] HIX: Starting full primary refresh. [2025-10-02T19:24:02.373019] [INFO ] [REMOTE ] HIX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:24:02.384409] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-02T19:24:02.672983] [INFO ] [REMOTE ] HIX: Fetching primary data for 2024-12. [2025-10-02T19:24:03.029008] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-09 (2.76 seconds). [2025-10-02T19:24:03.372764] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-02T19:24:03.472975] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-01. [2025-10-02T19:24:03.843721] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-02T19:24:04.272989] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-10. [2025-10-02T19:24:05.019186] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-02T19:24:05.072976] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-04. [2025-10-02T19:24:05.873009] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-02. [2025-10-02T19:24:05.956963] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-02T19:24:06.673016] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-01. [2025-10-02T19:24:07.466952] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-02T19:24:07.476101] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-05. [2025-10-02T19:24:07.525516] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-02T19:24:08.272982] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-02. [2025-10-02T19:24:08.308712] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-02T19:24:08.515319] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-10 (4.24 seconds). [2025-10-02T19:24:08.517019] [INFO ] [REMOTE ] HIMS: Full fetch complete (77545 records). [2025-10-02T19:24:08.517136] [DEBUG] [VALIDATOR ] HIMS: Validating primary data. [2025-10-02T19:24:08.518017] [FATAL] [VALIDATOR ] HIMS: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:24:08.518117] [FATAL] [MAIN ] HIMS: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:24:08.518207] [WARN ] [MAIN ] HIMS: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:24:08.518283] [INFO ] [LOCAL ] HIMS: Starting deletion of primary data. [2025-10-02T19:24:08.518350] [DEBUG] [LOCAL ] HIMS: No primary data file found to delete. [2025-10-02T19:24:08.518388] [INFO ] [LOCAL ] HIMS: Starting deletion of derivative data. [2025-10-02T19:24:08.518429] [DEBUG] [LOCAL ] HIMS: No derivative data file found to delete. [2025-10-02T19:24:08.518488] [INFO ] [MAIN ] Update Progress: 1021/2370 symbols completed. HIMS took 41.2s. Estimated remaining: 3h 10m 22s. Rate: 7.1 symbols/min [2025-10-02T19:24:08.718592] [INFO ] [MAIN ] HKD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:24:08.718778] [DEBUG] [LOCAL ] HKD: No existing data file found in primary storage. [2025-10-02T19:24:08.718824] [WARN ] [MAIN ] HKD: No existing data found, performing full refresh instead. [2025-10-02T19:24:08.718984] [INFO ] [MAIN ] HKD: Wiping existing primary data before full refresh. [2025-10-02T19:24:08.719033] [INFO ] [LOCAL ] HKD: Starting deletion of primary data. [2025-10-02T19:24:08.719076] [DEBUG] [LOCAL ] HKD: No primary data file found to delete. [2025-10-02T19:24:08.719107] [INFO ] [MAIN ] HKD: Starting full primary refresh. [2025-10-02T19:24:09.078125] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-06. [2025-10-02T19:24:09.142583] [INFO ] [REMOTE ] HKD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:24:09.333944] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-02T19:24:09.873006] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-03. [2025-10-02T19:24:10.371614] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-02T19:24:10.672976] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-03. [2025-10-02T19:24:10.917796] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-02T19:24:11.473013] [INFO ] [REMOTE ] HKD: Fetching primary data for 2024-12. [2025-10-02T19:24:12.273009] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-04. [2025-10-02T19:24:12.352893] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-02T19:24:12.773873] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-02T19:24:13.072998] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-07. [2025-10-02T19:24:13.417146] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-02T19:24:13.873005] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-04. [2025-10-02T19:24:14.092149] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-02T19:24:14.673034] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-01. [2025-10-02T19:24:15.285484] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-02T19:24:15.472973] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-08. [2025-10-02T19:24:15.789003] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-02T19:24:16.272973] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-02. [2025-10-02T19:24:16.298792] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-02T19:24:17.073018] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-05. [2025-10-02T19:24:17.436751] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-02T19:24:17.872992] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-09. [2025-10-02T19:24:18.477683] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-02T19:24:18.673048] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-03. [2025-10-02T19:24:18.961320] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-02T19:24:19.473010] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-06. [2025-10-02T19:24:19.727458] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-02T19:24:20.273031] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-04. [2025-10-02T19:24:21.011990] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-02T19:24:21.072985] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-07. [2025-10-02T19:24:21.332220] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-02T19:24:21.873008] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-05. [2025-10-02T19:24:22.632027] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-02T19:24:22.672989] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-08. [2025-10-02T19:24:22.816573] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-02T19:24:23.473027] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-06. [2025-10-02T19:24:24.280901] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-05. [2025-10-02T19:24:24.286876] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-02T19:24:24.584234] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-02T19:24:25.073014] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-10. [2025-10-02T19:24:25.390015] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-02T19:24:25.873009] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-06. [2025-10-02T19:24:26.678680] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-09. [2025-10-02T19:24:26.683158] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-02T19:24:27.473030] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-07. [2025-10-02T19:24:27.733320] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-10 (2.66 seconds). [2025-10-02T19:24:27.734318] [INFO ] [REMOTE ] HIPO: Full fetch complete (31457 records). [2025-10-02T19:24:27.734397] [DEBUG] [VALIDATOR ] HIPO: Validating primary data. [2025-10-02T19:24:27.735015] [FATAL] [VALIDATOR ] HIPO: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:24:27.735104] [FATAL] [MAIN ] HIPO: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:24:27.735149] [WARN ] [MAIN ] HIPO: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:24:27.735221] [INFO ] [LOCAL ] HIPO: Starting deletion of primary data. [2025-10-02T19:24:27.735301] [DEBUG] [LOCAL ] HIPO: No primary data file found to delete. [2025-10-02T19:24:27.735359] [INFO ] [LOCAL ] HIPO: Starting deletion of derivative data. [2025-10-02T19:24:27.735422] [DEBUG] [LOCAL ] HIPO: No derivative data file found to delete. [2025-10-02T19:24:27.735499] [INFO ] [MAIN ] Update Progress: 1022/2370 symbols completed. HIPO took 40.1s. Estimated remaining: 3h 10m 28s. Rate: 7.1 symbols/min [2025-10-02T19:24:27.921251] [INFO ] [MAIN ] HL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:24:27.921430] [DEBUG] [LOCAL ] HL: No existing data file found in primary storage. [2025-10-02T19:24:27.921486] [WARN ] [MAIN ] HL: No existing data found, performing full refresh instead. [2025-10-02T19:24:27.921604] [INFO ] [MAIN ] HL: Wiping existing primary data before full refresh. [2025-10-02T19:24:27.921676] [INFO ] [LOCAL ] HL: Starting deletion of primary data. [2025-10-02T19:24:27.921774] [DEBUG] [LOCAL ] HL: No primary data file found to delete. [2025-10-02T19:24:27.921829] [INFO ] [MAIN ] HL: Starting full primary refresh. [2025-10-02T19:24:28.273867] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-07. [2025-10-02T19:24:28.339606] [INFO ] [REMOTE ] HL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:24:28.385941] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-02T19:24:28.397348] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-02T19:24:29.073019] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-10. [2025-10-02T19:24:29.561879] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-02T19:24:29.873029] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-08. [2025-10-02T19:24:30.673009] [INFO ] [REMOTE ] HL: Fetching primary data for 2024-12. [2025-10-02T19:24:31.027759] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-02T19:24:31.473055] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-08. [2025-10-02T19:24:32.193820] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-10 (3.12 seconds). [2025-10-02T19:24:32.195544] [INFO ] [REMOTE ] HIW: Full fetch complete (64425 records). [2025-10-02T19:24:32.195715] [DEBUG] [VALIDATOR ] HIW: Validating primary data. [2025-10-02T19:24:32.196502] [FATAL] [VALIDATOR ] HIW: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:24:32.196596] [FATAL] [MAIN ] HIW: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:24:32.196667] [WARN ] [MAIN ] HIW: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:24:32.196734] [INFO ] [LOCAL ] HIW: Starting deletion of primary data. [2025-10-02T19:24:32.196826] [DEBUG] [LOCAL ] HIW: No primary data file found to delete. [2025-10-02T19:24:32.196889] [INFO ] [LOCAL ] HIW: Starting deletion of derivative data. [2025-10-02T19:24:32.196980] [DEBUG] [LOCAL ] HIW: No derivative data file found to delete. [2025-10-02T19:24:32.197059] [INFO ] [MAIN ] Update Progress: 1023/2370 symbols completed. HIW took 33.1s. Estimated remaining: 3h 10m 14s. Rate: 7.1 symbols/min [2025-10-02T19:24:32.275803] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-09. [2025-10-02T19:24:32.378588] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-02T19:24:32.454743] [INFO ] [MAIN ] HLF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:24:32.432684] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-02T19:24:32.455721] [DEBUG] [LOCAL ] HLF: No existing data file found in primary storage. [2025-10-02T19:24:32.455875] [WARN ] [MAIN ] HLF: No existing data found, performing full refresh instead. [2025-10-02T19:24:32.456032] [INFO ] [MAIN ] HLF: Wiping existing primary data before full refresh. [2025-10-02T19:24:32.459406] [INFO ] [LOCAL ] HLF: Starting deletion of primary data. [2025-10-02T19:24:32.459996] [DEBUG] [LOCAL ] HLF: No primary data file found to delete. [2025-10-02T19:24:32.460053] [INFO ] [MAIN ] HLF: Starting full primary refresh. [2025-10-02T19:24:32.854262] [INFO ] [REMOTE ] HLF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:24:33.078514] [INFO ] [REMOTE ] HLF: Fetching primary data for 2024-12. [2025-10-02T19:24:33.086216] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-02T19:24:33.873000] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-01. [2025-10-02T19:24:34.482027] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-02T19:24:34.673033] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-09. [2025-10-02T19:24:35.473049] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-01. [2025-10-02T19:24:35.805554] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-02T19:24:35.951000] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-02T19:24:36.273038] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-02. [2025-10-02T19:24:36.996084] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-02T19:24:37.073049] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-10. [2025-10-02T19:24:37.813683] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-02T19:24:37.873005] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-02. [2025-10-02T19:24:38.673004] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-03. [2025-10-02T19:24:39.474701] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-10. [2025-10-02T19:24:39.484167] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-02T19:24:39.991058] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-10 (2.92 seconds). [2025-10-02T19:24:39.992091] [INFO ] [REMOTE ] HKD: Full fetch complete (28325 records). [2025-10-02T19:24:39.992166] [DEBUG] [VALIDATOR ] HKD: Validating primary data. [2025-10-02T19:24:39.992637] [FATAL] [VALIDATOR ] HKD: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:24:39.992760] [FATAL] [MAIN ] HKD: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:24:39.992806] [WARN ] [MAIN ] HKD: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:24:39.992847] [INFO ] [LOCAL ] HKD: Starting deletion of primary data. [2025-10-02T19:24:39.992918] [DEBUG] [LOCAL ] HKD: No primary data file found to delete. [2025-10-02T19:24:39.992976] [INFO ] [LOCAL ] HKD: Starting deletion of derivative data. [2025-10-02T19:24:39.993023] [DEBUG] [LOCAL ] HKD: No derivative data file found to delete. [2025-10-02T19:24:39.993090] [INFO ] [MAIN ] Update Progress: 1024/2370 symbols completed. HKD took 31.5s. Estimated remaining: 3h 10m 4s. Rate: 7.1 symbols/min [2025-10-02T19:24:40.181350] [INFO ] [MAIN ] HLI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:24:40.181615] [DEBUG] [LOCAL ] HLI: No existing data file found in primary storage. [2025-10-02T19:24:40.181690] [WARN ] [MAIN ] HLI: No existing data found, performing full refresh instead. [2025-10-02T19:24:40.181782] [INFO ] [MAIN ] HLI: Wiping existing primary data before full refresh. [2025-10-02T19:24:40.181822] [INFO ] [LOCAL ] HLI: Starting deletion of primary data. [2025-10-02T19:24:40.181865] [DEBUG] [LOCAL ] HLI: No primary data file found to delete. [2025-10-02T19:24:40.181901] [INFO ] [MAIN ] HLI: Starting full primary refresh. [2025-10-02T19:24:40.276303] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-03. [2025-10-02T19:24:40.575302] [INFO ] [REMOTE ] HLI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:24:40.656552] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-02T19:24:41.073023] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-04. [2025-10-02T19:24:41.848666] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-02T19:24:41.872959] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-04. [2025-10-02T19:24:42.417048] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-10 (2.94 seconds). [2025-10-02T19:24:42.418368] [INFO ] [REMOTE ] HIX: Full fetch complete (30623 records). [2025-10-02T19:24:42.418456] [DEBUG] [VALIDATOR ] HIX: Validating primary data. [2025-10-02T19:24:42.419014] [FATAL] [VALIDATOR ] HIX: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:24:42.419102] [FATAL] [MAIN ] HIX: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:24:42.419148] [WARN ] [MAIN ] HIX: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:24:42.419190] [INFO ] [LOCAL ] HIX: Starting deletion of primary data. [2025-10-02T19:24:42.419249] [DEBUG] [LOCAL ] HIX: No primary data file found to delete. [2025-10-02T19:24:42.419287] [INFO ] [LOCAL ] HIX: Starting deletion of derivative data. [2025-10-02T19:24:42.419329] [DEBUG] [LOCAL ] HIX: No derivative data file found to delete. [2025-10-02T19:24:42.419384] [INFO ] [MAIN ] Update Progress: 1025/2370 symbols completed. HIX took 40.7s. Estimated remaining: 3h 9m 48s. Rate: 7.1 symbols/min [2025-10-02T19:24:42.630000] [INFO ] [MAIN ] HLIO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:24:42.630174] [DEBUG] [LOCAL ] HLIO: No existing data file found in primary storage. [2025-10-02T19:24:42.630212] [WARN ] [MAIN ] HLIO: No existing data found, performing full refresh instead. [2025-10-02T19:24:42.630370] [INFO ] [MAIN ] HLIO: Wiping existing primary data before full refresh. [2025-10-02T19:24:42.630428] [INFO ] [LOCAL ] HLIO: Starting deletion of primary data. [2025-10-02T19:24:42.630481] [DEBUG] [LOCAL ] HLIO: No primary data file found to delete. [2025-10-02T19:24:42.630523] [INFO ] [MAIN ] HLIO: Starting full primary refresh. [2025-10-02T19:24:42.675501] [INFO ] [REMOTE ] HLI: Fetching primary data for 2024-12. [2025-10-02T19:24:43.027956] [INFO ] [REMOTE ] HLIO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:24:43.189491] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-02T19:24:43.303588] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-02T19:24:43.473021] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2024-12. [2025-10-02T19:24:44.115755] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-02T19:24:44.278001] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-01. [2025-10-02T19:24:44.283621] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-02T19:24:45.073002] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-05. [2025-10-02T19:24:45.730505] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-02T19:24:45.873006] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-01. [2025-10-02T19:24:46.680043] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-05. [2025-10-02T19:24:46.701026] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-02T19:24:46.878502] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-02T19:24:47.473043] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-02. [2025-10-02T19:24:48.273037] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-02. [2025-10-02T19:24:48.563461] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-02T19:24:48.637558] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-02T19:24:49.073029] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-06. [2025-10-02T19:24:49.502342] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-02T19:24:49.873019] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-03. [2025-10-02T19:24:50.660533] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-02T19:24:50.672960] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-06. [2025-10-02T19:24:51.023413] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-02T19:24:51.473039] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-03. [2025-10-02T19:24:52.273022] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-07. [2025-10-02T19:24:52.455012] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-02T19:24:52.506448] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-02T19:24:53.073021] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-07. [2025-10-02T19:24:53.565938] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-02T19:24:53.873007] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-04. [2025-10-02T19:24:54.672966] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-04. [2025-10-02T19:24:55.119325] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-02T19:24:55.253116] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-02T19:24:55.473003] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-05. [2025-10-02T19:24:55.765485] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-02T19:24:56.273000] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-08. [2025-10-02T19:24:56.827514] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-02T19:24:57.073001] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-06. [2025-10-02T19:24:57.871417] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-02T19:24:57.881206] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-05. [2025-10-02T19:24:58.506242] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-02T19:24:58.673011] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-07. [2025-10-02T19:24:59.308405] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-02T19:24:59.473017] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-08. [2025-10-02T19:24:59.985507] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-02T19:25:00.272989] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-09. [2025-10-02T19:25:01.073005] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-08. [2025-10-02T19:25:01.875884] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-06. [2025-10-02T19:25:01.884153] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-10-02T19:25:02.069735] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-02T19:25:02.673015] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-10. [2025-10-02T19:25:03.106787] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-02T19:25:03.473006] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-09. [2025-10-02T19:25:03.578470] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-02T19:25:04.272995] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-09. [2025-10-02T19:25:04.558715] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-02T19:25:05.073036] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-07. [2025-10-02T19:25:05.873026] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-10. [2025-10-02T19:25:05.968666] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-10 (3.30 seconds). [2025-10-02T19:25:05.973321] [INFO ] [REMOTE ] HLF: Full fetch complete (70862 records). [2025-10-02T19:25:05.973536] [DEBUG] [VALIDATOR ] HLF: Validating primary data. [2025-10-02T19:25:05.978930] [FATAL] [VALIDATOR ] HLF: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:25:05.979158] [FATAL] [MAIN ] HLF: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:25:05.979262] [WARN ] [MAIN ] HLF: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:25:05.979422] [INFO ] [LOCAL ] HLF: Starting deletion of primary data. [2025-10-02T19:25:05.979546] [DEBUG] [LOCAL ] HLF: No primary data file found to delete. [2025-10-02T19:25:05.979664] [INFO ] [LOCAL ] HLF: Starting deletion of derivative data. [2025-10-02T19:25:05.979739] [DEBUG] [LOCAL ] HLF: No derivative data file found to delete. [2025-10-02T19:25:05.979846] [INFO ] [MAIN ] Update Progress: 1026/2370 symbols completed. HLF took 33.8s. Estimated remaining: 3h 9m 59s. Rate: 7.1 symbols/min [2025-10-02T19:25:06.193271] [INFO ] [MAIN ] HLLY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:25:06.193577] [DEBUG] [LOCAL ] HLLY: No existing data file found in primary storage. [2025-10-02T19:25:06.193723] [WARN ] [MAIN ] HLLY: No existing data found, performing full refresh instead. [2025-10-02T19:25:06.193969] [INFO ] [MAIN ] HLLY: Wiping existing primary data before full refresh. [2025-10-02T19:25:06.194042] [INFO ] [LOCAL ] HLLY: Starting deletion of primary data. [2025-10-02T19:25:06.194132] [DEBUG] [LOCAL ] HLLY: No primary data file found to delete. [2025-10-02T19:25:06.194220] [INFO ] [MAIN ] HLLY: Starting full primary refresh. [2025-10-02T19:25:06.614369] [INFO ] [REMOTE ] HLLY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:25:06.667865] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-02T19:25:06.670178] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-10-02T19:25:06.677462] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2024-12. [2025-10-02T19:25:07.473048] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-08. [2025-10-02T19:25:07.926793] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-02T19:25:08.273047] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-01. [2025-10-02T19:25:08.728450] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-10 (2.86 seconds). [2025-10-02T19:25:08.730599] [INFO ] [REMOTE ] HLIO: Full fetch complete (36082 records). [2025-10-02T19:25:08.730857] [DEBUG] [VALIDATOR ] HLIO: Validating primary data. [2025-10-02T19:25:08.755048] [FATAL] [VALIDATOR ] HLIO: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:25:08.758483] [FATAL] [MAIN ] HLIO: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:25:08.760309] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-02T19:25:08.759013] [WARN ] [MAIN ] HLIO: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:25:08.769526] [INFO ] [LOCAL ] HLIO: Starting deletion of primary data. [2025-10-02T19:25:08.769959] [DEBUG] [LOCAL ] HLIO: No primary data file found to delete. [2025-10-02T19:25:08.770009] [INFO ] [LOCAL ] HLIO: Starting deletion of derivative data. [2025-10-02T19:25:08.770072] [DEBUG] [LOCAL ] HLIO: No derivative data file found to delete. [2025-10-02T19:25:08.770169] [INFO ] [MAIN ] Update Progress: 1027/2370 symbols completed. HLIO took 26.4s. Estimated remaining: 3h 9m 43s. Rate: 7.1 symbols/min [2025-10-02T19:25:08.964422] [INFO ] [MAIN ] HLN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:25:08.964668] [DEBUG] [LOCAL ] HLN: No existing data file found in primary storage. [2025-10-02T19:25:08.964727] [WARN ] [MAIN ] HLN: No existing data found, performing full refresh instead. [2025-10-02T19:25:08.964846] [INFO ] [MAIN ] HLN: Wiping existing primary data before full refresh. [2025-10-02T19:25:08.964913] [INFO ] [LOCAL ] HLN: Starting deletion of primary data. [2025-10-02T19:25:08.964988] [DEBUG] [LOCAL ] HLN: No primary data file found to delete. [2025-10-02T19:25:08.965047] [INFO ] [MAIN ] HLN: Starting full primary refresh. [2025-10-02T19:25:09.082521] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-10. [2025-10-02T19:25:09.388631] [INFO ] [REMOTE ] HLN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:25:09.443450] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-02T19:25:09.872968] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-02. [2025-10-02T19:25:10.673008] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-09. [2025-10-02T19:25:10.729622] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-02T19:25:11.473064] [INFO ] [REMOTE ] HLN: Fetching primary data for 2024-12. [2025-10-02T19:25:12.002127] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-02T19:25:12.272999] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-10. [2025-10-02T19:25:12.848050] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-10 (3.77 seconds). [2025-10-02T19:25:12.849958] [INFO ] [REMOTE ] HL: Full fetch complete (77267 records). [2025-10-02T19:25:12.850155] [DEBUG] [VALIDATOR ] HL: Validating primary data. [2025-10-02T19:25:12.851267] [FATAL] [VALIDATOR ] HL: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:25:12.851371] [FATAL] [MAIN ] HL: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:25:12.851417] [WARN ] [MAIN ] HL: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:25:12.851461] [INFO ] [LOCAL ] HL: Starting deletion of primary data. [2025-10-02T19:25:12.851544] [DEBUG] [LOCAL ] HL: No primary data file found to delete. [2025-10-02T19:25:12.851600] [INFO ] [LOCAL ] HL: Starting deletion of derivative data. [2025-10-02T19:25:12.851675] [DEBUG] [LOCAL ] HL: No derivative data file found to delete. [2025-10-02T19:25:12.851756] [INFO ] [MAIN ] Update Progress: 1028/2370 symbols completed. HL took 45.1s. Estimated remaining: 3h 9m 29s. Rate: 7.1 symbols/min [2025-10-02T19:25:13.051367] [INFO ] [MAIN ] HLT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:25:13.051562] [DEBUG] [LOCAL ] HLT: No existing data file found in primary storage. [2025-10-02T19:25:13.051627] [WARN ] [MAIN ] HLT: No existing data found, performing full refresh instead. [2025-10-02T19:25:13.051795] [INFO ] [MAIN ] HLT: Wiping existing primary data before full refresh. [2025-10-02T19:25:13.051857] [INFO ] [LOCAL ] HLT: Starting deletion of primary data. [2025-10-02T19:25:13.051923] [DEBUG] [LOCAL ] HLT: No primary data file found to delete. [2025-10-02T19:25:13.052007] [INFO ] [MAIN ] HLT: Starting full primary refresh. [2025-10-02T19:25:13.079693] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-03. [2025-10-02T19:25:13.458237] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-02T19:25:13.536544] [INFO ] [REMOTE ] HLT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:25:13.873033] [INFO ] [REMOTE ] HLT: Fetching primary data for 2024-12. [2025-10-02T19:25:14.509055] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-02T19:25:14.673056] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-04. [2025-10-02T19:25:15.365589] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-10 (3.09 seconds). [2025-10-02T19:25:15.368207] [INFO ] [REMOTE ] HLI: Full fetch complete (45164 records). [2025-10-02T19:25:15.368327] [DEBUG] [VALIDATOR ] HLI: Validating primary data. [2025-10-02T19:25:15.369190] [FATAL] [VALIDATOR ] HLI: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:25:15.369281] [FATAL] [MAIN ] HLI: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:25:15.369353] [WARN ] [MAIN ] HLI: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:25:15.369441] [INFO ] [LOCAL ] HLI: Starting deletion of primary data. [2025-10-02T19:25:15.369560] [DEBUG] [LOCAL ] HLI: No primary data file found to delete. [2025-10-02T19:25:15.369639] [INFO ] [LOCAL ] HLI: Starting deletion of derivative data. [2025-10-02T19:25:15.369738] [DEBUG] [LOCAL ] HLI: No derivative data file found to delete. [2025-10-02T19:25:15.369806] [INFO ] [MAIN ] Update Progress: 1029/2370 symbols completed. HLI took 35.4s. Estimated remaining: 3h 9m 13s. Rate: 7.1 symbols/min [2025-10-02T19:25:15.475555] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-01. [2025-10-02T19:25:15.570616] [INFO ] [MAIN ] HLX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:25:15.571083] [DEBUG] [LOCAL ] HLX: No existing data file found in primary storage. [2025-10-02T19:25:15.571259] [WARN ] [MAIN ] HLX: No existing data found, performing full refresh instead. [2025-10-02T19:25:15.571596] [INFO ] [MAIN ] HLX: Wiping existing primary data before full refresh. [2025-10-02T19:25:15.571699] [INFO ] [LOCAL ] HLX: Starting deletion of primary data. [2025-10-02T19:25:15.571869] [DEBUG] [LOCAL ] HLX: No primary data file found to delete. [2025-10-02T19:25:15.571927] [INFO ] [MAIN ] HLX: Starting full primary refresh. [2025-10-02T19:25:15.993738] [INFO ] [REMOTE ] HLX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:25:16.023397] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-02T19:25:16.121256] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-02T19:25:16.273000] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-05. [2025-10-02T19:25:17.072981] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-01. [2025-10-02T19:25:17.278455] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-02T19:25:17.574615] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-02T19:25:17.872995] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-06. [2025-10-02T19:25:18.672984] [INFO ] [REMOTE ] HLX: Fetching primary data for 2024-12. [2025-10-02T19:25:18.819983] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-02T19:25:19.059593] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-02T19:25:19.472998] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-07. [2025-10-02T19:25:20.019334] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-02T19:25:20.272994] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-01. [2025-10-02T19:25:20.534161] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-02T19:25:21.073009] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-08. [2025-10-02T19:25:21.872287] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-02T19:25:21.875910] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-02. [2025-10-02T19:25:22.202912] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-02T19:25:22.673018] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-02. [2025-10-02T19:25:23.481767] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-02. [2025-10-02T19:25:23.484910] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-02T19:25:24.272985] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-03. [2025-10-02T19:25:24.392686] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-02T19:25:24.982276] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-02T19:25:25.073025] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-03. [2025-10-02T19:25:25.872968] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-03. [2025-10-02T19:25:26.071630] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-02T19:25:26.673017] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-04. [2025-10-02T19:25:26.880897] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-02T19:25:27.472966] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-04. [2025-10-02T19:25:27.512185] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-02T19:25:28.275827] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-09. [2025-10-02T19:25:28.282569] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-02T19:25:29.073016] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-05. [2025-10-02T19:25:29.310723] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-02T19:25:29.407359] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-02T19:25:29.873082] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-04. [2025-10-02T19:25:30.663111] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-02T19:25:30.674639] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-05. [2025-10-02T19:25:31.473029] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-10. [2025-10-02T19:25:31.516057] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-02T19:25:32.273005] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-05. [2025-10-02T19:25:32.477518] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-02T19:25:33.073025] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-06. [2025-10-02T19:25:33.933875] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-06. [2025-10-02T19:25:33.956225] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-02T19:25:34.381677] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-10 (2.91 seconds). [2025-10-02T19:25:34.383334] [INFO ] [REMOTE ] HLLY: Full fetch complete (45982 records). [2025-10-02T19:25:34.383443] [DEBUG] [VALIDATOR ] HLLY: Validating primary data. [2025-10-02T19:25:34.384162] [FATAL] [VALIDATOR ] HLLY: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:25:34.384253] [FATAL] [MAIN ] HLLY: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:25:34.384302] [WARN ] [MAIN ] HLLY: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:25:34.384373] [INFO ] [LOCAL ] HLLY: Starting deletion of primary data. [2025-10-02T19:25:34.384447] [DEBUG] [LOCAL ] HLLY: No primary data file found to delete. [2025-10-02T19:25:34.384484] [INFO ] [LOCAL ] HLLY: Starting deletion of derivative data. [2025-10-02T19:25:34.384738] [DEBUG] [LOCAL ] HLLY: No derivative data file found to delete. [2025-10-02T19:25:34.384854] [INFO ] [MAIN ] Update Progress: 1030/2370 symbols completed. HLLY took 28.4s. Estimated remaining: 3h 9m 18s. Rate: 7.1 symbols/min [2025-10-02T19:25:34.582092] [INFO ] [MAIN ] HMC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:25:34.582356] [DEBUG] [LOCAL ] HMC: No existing data file found in primary storage. [2025-10-02T19:25:34.582457] [WARN ] [MAIN ] HMC: No existing data found, performing full refresh instead. [2025-10-02T19:25:34.582723] [INFO ] [MAIN ] HMC: Wiping existing primary data before full refresh. [2025-10-02T19:25:34.582906] [INFO ] [LOCAL ] HMC: Starting deletion of primary data. [2025-10-02T19:25:34.583022] [DEBUG] [LOCAL ] HMC: No primary data file found to delete. [2025-10-02T19:25:34.583197] [INFO ] [MAIN ] HMC: Starting full primary refresh. [2025-10-02T19:25:34.680912] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-06. [2025-10-02T19:25:34.976131] [INFO ] [REMOTE ] HMC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:25:35.004235] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-02T19:25:35.472985] [INFO ] [REMOTE ] HMC: Fetching primary data for 2024-12. [2025-10-02T19:25:35.645810] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-02T19:25:36.279271] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-07. [2025-10-02T19:25:36.298596] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-02T19:25:37.072997] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-07. [2025-10-02T19:25:37.518058] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-02T19:25:37.873407] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-01. [2025-10-02T19:25:37.880447] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-02T19:25:38.673041] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-07. [2025-10-02T19:25:38.813515] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-02T19:25:39.473002] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-08. [2025-10-02T19:25:39.706033] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-02T19:25:40.244754] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-02T19:25:40.272963] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-08. [2025-10-02T19:25:40.860731] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-02T19:25:41.072999] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-09. [2025-10-02T19:25:41.872975] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-02. [2025-10-02T19:25:41.919141] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-02T19:25:42.326415] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-02T19:25:42.673012] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-08. [2025-10-02T19:25:43.473002] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-10. [2025-10-02T19:25:43.616459] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-02T19:25:44.272971] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-03. [2025-10-02T19:25:44.548252] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-02T19:25:45.073014] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-09. [2025-10-02T19:25:45.706135] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-02T19:25:45.872999] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-04. [2025-10-02T19:25:46.599161] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-10 (3.13 seconds). [2025-10-02T19:25:46.600828] [INFO ] [REMOTE ] HLX: Full fetch complete (68917 records). [2025-10-02T19:25:46.600961] [DEBUG] [VALIDATOR ] HLX: Validating primary data. [2025-10-02T19:25:46.602264] [FATAL] [VALIDATOR ] HLX: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:25:46.602395] [FATAL] [MAIN ] HLX: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:25:46.602441] [WARN ] [MAIN ] HLX: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:25:46.602495] [INFO ] [LOCAL ] HLX: Starting deletion of primary data. [2025-10-02T19:25:46.602580] [DEBUG] [LOCAL ] HLX: No primary data file found to delete. [2025-10-02T19:25:46.602625] [INFO ] [LOCAL ] HLX: Starting deletion of derivative data. [2025-10-02T19:25:46.602725] [DEBUG] [LOCAL ] HLX: No derivative data file found to delete. [2025-10-02T19:25:46.602812] [INFO ] [MAIN ] Update Progress: 1031/2370 symbols completed. HLX took 31.2s. Estimated remaining: 3h 9m 15s. Rate: 7.1 symbols/min [2025-10-02T19:25:46.678822] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-09. [2025-10-02T19:25:46.803991] [INFO ] [MAIN ] HMN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:25:46.804223] [DEBUG] [LOCAL ] HMN: No existing data file found in primary storage. [2025-10-02T19:25:46.804362] [WARN ] [MAIN ] HMN: No existing data found, performing full refresh instead. [2025-10-02T19:25:46.804533] [INFO ] [MAIN ] HMN: Wiping existing primary data before full refresh. [2025-10-02T19:25:46.804675] [INFO ] [LOCAL ] HMN: Starting deletion of primary data. [2025-10-02T19:25:46.804788] [DEBUG] [LOCAL ] HMN: No primary data file found to delete. [2025-10-02T19:25:46.804858] [INFO ] [MAIN ] HMN: Starting full primary refresh. [2025-10-02T19:25:47.149466] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-02T19:25:47.274038] [INFO ] [REMOTE ] HMN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:25:47.473066] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-10. [2025-10-02T19:25:47.601124] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-02T19:25:48.272986] [INFO ] [REMOTE ] HMN: Fetching primary data for 2024-12. [2025-10-02T19:25:48.364286] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-02T19:25:49.072985] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-10. [2025-10-02T19:25:49.129164] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-02T19:25:49.873000] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-05. [2025-10-02T19:25:50.673048] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-01. [2025-10-02T19:25:50.743308] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-10 (3.27 seconds). [2025-10-02T19:25:50.744890] [INFO ] [REMOTE ] HLN: Full fetch complete (76390 records). [2025-10-02T19:25:50.745019] [DEBUG] [VALIDATOR ] HLN: Validating primary data. [2025-10-02T19:25:50.746033] [FATAL] [VALIDATOR ] HLN: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:25:50.746152] [FATAL] [MAIN ] HLN: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:25:50.746230] [WARN ] [MAIN ] HLN: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:25:50.746292] [INFO ] [LOCAL ] HLN: Starting deletion of primary data. [2025-10-02T19:25:50.746362] [DEBUG] [LOCAL ] HLN: No primary data file found to delete. [2025-10-02T19:25:50.746405] [INFO ] [LOCAL ] HLN: Starting deletion of derivative data. [2025-10-02T19:25:50.746452] [DEBUG] [LOCAL ] HLN: No derivative data file found to delete. [2025-10-02T19:25:50.746514] [INFO ] [MAIN ] Update Progress: 1032/2370 symbols completed. HLN took 42.0s. Estimated remaining: 3h 9m 0s. Rate: 7.1 symbols/min [2025-10-02T19:25:50.929961] [INFO ] [MAIN ] HMY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:25:50.930154] [DEBUG] [LOCAL ] HMY: No existing data file found in primary storage. [2025-10-02T19:25:50.930210] [WARN ] [MAIN ] HMY: No existing data found, performing full refresh instead. [2025-10-02T19:25:50.930330] [INFO ] [MAIN ] HMY: Wiping existing primary data before full refresh. [2025-10-02T19:25:50.930373] [INFO ] [LOCAL ] HMY: Starting deletion of primary data. [2025-10-02T19:25:50.930414] [DEBUG] [LOCAL ] HMY: No primary data file found to delete. [2025-10-02T19:25:50.930447] [INFO ] [MAIN ] HMY: Starting full primary refresh. [2025-10-02T19:25:51.336344] [INFO ] [REMOTE ] HMY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:25:51.484761] [INFO ] [REMOTE ] HMY: Fetching primary data for 2024-12. [2025-10-02T19:25:51.503236] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-02T19:25:51.640368] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-02T19:25:52.199067] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-10 (3.13 seconds). [2025-10-02T19:25:52.200763] [INFO ] [REMOTE ] HLT: Full fetch complete (73057 records). [2025-10-02T19:25:52.200911] [DEBUG] [VALIDATOR ] HLT: Validating primary data. [2025-10-02T19:25:52.201814] [FATAL] [VALIDATOR ] HLT: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:25:52.201904] [FATAL] [MAIN ] HLT: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:25:52.201951] [WARN ] [MAIN ] HLT: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:25:52.202067] [INFO ] [LOCAL ] HLT: Starting deletion of primary data. [2025-10-02T19:25:52.202149] [DEBUG] [LOCAL ] HLT: No primary data file found to delete. [2025-10-02T19:25:52.202187] [INFO ] [LOCAL ] HLT: Starting deletion of derivative data. [2025-10-02T19:25:52.202228] [DEBUG] [LOCAL ] HLT: No derivative data file found to delete. [2025-10-02T19:25:52.202287] [INFO ] [MAIN ] Update Progress: 1033/2370 symbols completed. HLT took 39.4s. Estimated remaining: 3h 8m 43s. Rate: 7.1 symbols/min [2025-10-02T19:25:52.278205] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-06. [2025-10-02T19:25:52.397056] [INFO ] [MAIN ] HNGE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:25:52.397231] [DEBUG] [LOCAL ] HNGE: No existing data file found in primary storage. [2025-10-02T19:25:52.397281] [WARN ] [MAIN ] HNGE: No existing data found, performing full refresh instead. [2025-10-02T19:25:52.397428] [INFO ] [MAIN ] HNGE: Wiping existing primary data before full refresh. [2025-10-02T19:25:52.397477] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-02T19:25:52.397534] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-02T19:25:52.397574] [INFO ] [MAIN ] HNGE: Starting full primary refresh. [2025-10-02T19:25:52.808709] [INFO ] [REMOTE ] HNGE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:25:53.073035] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2024-12. [2025-10-02T19:25:53.210563] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-02T19:25:53.261335] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T19:25:53.261630] [WARN ] [REMOTE ] HNGE: No data returned for month 2024-12 [2025-10-02T19:25:53.261740] [FATAL] [REMOTE ] HNGE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T19:25:53.261794] [FATAL] [MAIN ] HNGE: Failed to fetch primary data. [2025-10-02T19:25:53.261835] [WARN ] [MAIN ] HNGE: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T19:25:53.261875] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-02T19:25:53.261931] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-02T19:25:53.261966] [INFO ] [LOCAL ] HNGE: Starting deletion of derivative data. [2025-10-02T19:25:53.262016] [DEBUG] [LOCAL ] HNGE: No derivative data file found to delete. [2025-10-02T19:25:53.262064] [INFO ] [MAIN ] Update Progress: 1034/2370 symbols completed. HNGE took 1.1s. Estimated remaining: 3h 8m 25s. Rate: 7.1 symbols/min [2025-10-02T19:25:53.448284] [INFO ] [MAIN ] HNI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:25:53.448461] [DEBUG] [LOCAL ] HNI: No existing data file found in primary storage. [2025-10-02T19:25:53.448501] [WARN ] [MAIN ] HNI: No existing data found, performing full refresh instead. [2025-10-02T19:25:53.448615] [INFO ] [MAIN ] HNI: Wiping existing primary data before full refresh. [2025-10-02T19:25:53.448691] [INFO ] [LOCAL ] HNI: Starting deletion of primary data. [2025-10-02T19:25:53.448753] [DEBUG] [LOCAL ] HNI: No primary data file found to delete. [2025-10-02T19:25:53.448787] [INFO ] [MAIN ] HNI: Starting full primary refresh. [2025-10-02T19:25:53.878603] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-02. [2025-10-02T19:25:53.885803] [INFO ] [REMOTE ] HNI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:25:53.990415] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-02T19:25:54.672972] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-07. [2025-10-02T19:25:54.973408] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-02T19:25:55.473010] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-03. [2025-10-02T19:25:56.272979] [INFO ] [REMOTE ] HNI: Fetching primary data for 2024-12. [2025-10-02T19:25:56.507244] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-02T19:25:56.532422] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-02T19:25:57.073018] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-04. [2025-10-02T19:25:57.604101] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-02T19:25:57.873179] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-08. [2025-10-02T19:25:58.200815] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-02T19:25:58.673019] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-01. [2025-10-02T19:25:59.472977] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-05. [2025-10-02T19:25:59.566440] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-02T19:25:59.827903] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-02T19:26:00.272993] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-09. [2025-10-02T19:26:00.993205] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-02T19:26:01.073018] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-02. [2025-10-02T19:26:01.808137] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-02T19:26:01.872989] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-06. [2025-10-02T19:26:02.099985] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-02T19:26:02.672278] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-02T19:26:02.677365] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-01. [2025-10-02T19:26:03.473039] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-07. [2025-10-02T19:26:04.273004] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-03. [2025-10-02T19:26:04.573114] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-02T19:26:04.675551] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-02T19:26:05.072997] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-08. [2025-10-02T19:26:05.629507] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-02T19:26:05.875279] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-10. [2025-10-02T19:26:05.882750] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-02T19:26:06.672995] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-04. [2025-10-02T19:26:07.472982] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-09. [2025-10-02T19:26:07.543253] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-02T19:26:08.272970] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-05. [2025-10-02T19:26:08.586639] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-02T19:26:09.073013] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-02. [2025-10-02T19:26:09.104954] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-10 (3.23 seconds). [2025-10-02T19:26:09.106488] [INFO ] [REMOTE ] HMC: Full fetch complete (69074 records). [2025-10-02T19:26:09.106630] [DEBUG] [VALIDATOR ] HMC: Validating primary data. [2025-10-02T19:26:09.107589] [FATAL] [VALIDATOR ] HMC: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:26:09.107836] [FATAL] [MAIN ] HMC: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:26:09.107925] [WARN ] [MAIN ] HMC: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:26:09.108003] [INFO ] [LOCAL ] HMC: Starting deletion of primary data. [2025-10-02T19:26:09.108104] [DEBUG] [LOCAL ] HMC: No primary data file found to delete. [2025-10-02T19:26:09.108188] [INFO ] [LOCAL ] HMC: Starting deletion of derivative data. [2025-10-02T19:26:09.108264] [DEBUG] [LOCAL ] HMC: No derivative data file found to delete. [2025-10-02T19:26:09.108330] [INFO ] [MAIN ] Update Progress: 1035/2370 symbols completed. HMC took 34.7s. Estimated remaining: 3h 8m 26s. Rate: 7.1 symbols/min [2025-10-02T19:26:09.306434] [INFO ] [MAIN ] HOG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:26:09.306635] [DEBUG] [LOCAL ] HOG: No existing data file found in primary storage. [2025-10-02T19:26:09.306773] [WARN ] [MAIN ] HOG: No existing data found, performing full refresh instead. [2025-10-02T19:26:09.306901] [INFO ] [MAIN ] HOG: Wiping existing primary data before full refresh. [2025-10-02T19:26:09.306944] [INFO ] [LOCAL ] HOG: Starting deletion of primary data. [2025-10-02T19:26:09.306987] [DEBUG] [LOCAL ] HOG: No primary data file found to delete. [2025-10-02T19:26:09.307058] [INFO ] [MAIN ] HOG: Starting full primary refresh. [2025-10-02T19:26:09.527862] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-02T19:26:09.726017] [INFO ] [REMOTE ] HOG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:26:09.873072] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-10. [2025-10-02T19:26:10.672975] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-06. [2025-10-02T19:26:10.869077] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-02T19:26:11.473065] [INFO ] [REMOTE ] HOG: Fetching primary data for 2024-12. [2025-10-02T19:26:12.110275] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-02T19:26:12.272995] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-07. [2025-10-02T19:26:12.472743] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-10 (2.60 seconds). [2025-10-02T19:26:12.473773] [INFO ] [REMOTE ] HMN: Full fetch complete (31459 records). [2025-10-02T19:26:12.473849] [DEBUG] [VALIDATOR ] HMN: Validating primary data. [2025-10-02T19:26:12.474413] [FATAL] [VALIDATOR ] HMN: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:26:12.474500] [FATAL] [MAIN ] HMN: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:26:12.474549] [WARN ] [MAIN ] HMN: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:26:12.474629] [INFO ] [LOCAL ] HMN: Starting deletion of primary data. [2025-10-02T19:26:12.474757] [DEBUG] [LOCAL ] HMN: No primary data file found to delete. [2025-10-02T19:26:12.474806] [INFO ] [LOCAL ] HMN: Starting deletion of derivative data. [2025-10-02T19:26:12.474854] [DEBUG] [LOCAL ] HMN: No derivative data file found to delete. [2025-10-02T19:26:12.474913] [INFO ] [MAIN ] Update Progress: 1036/2370 symbols completed. HMN took 25.9s. Estimated remaining: 3h 8m 11s. Rate: 7.1 symbols/min [2025-10-02T19:26:12.669289] [INFO ] [MAIN ] HOMB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:26:12.669490] [DEBUG] [LOCAL ] HOMB: No existing data file found in primary storage. [2025-10-02T19:26:12.669532] [WARN ] [MAIN ] HOMB: No existing data found, performing full refresh instead. [2025-10-02T19:26:12.669671] [INFO ] [MAIN ] HOMB: Wiping existing primary data before full refresh. [2025-10-02T19:26:12.669731] [INFO ] [LOCAL ] HOMB: Starting deletion of primary data. [2025-10-02T19:26:12.669781] [DEBUG] [LOCAL ] HOMB: No primary data file found to delete. [2025-10-02T19:26:12.669868] [INFO ] [MAIN ] HOMB: Starting full primary refresh. [2025-10-02T19:26:13.083681] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-03. [2025-10-02T19:26:13.090542] [INFO ] [REMOTE ] HOMB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:26:13.125156] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-02T19:26:13.398760] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-02T19:26:13.873004] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-08. [2025-10-02T19:26:14.673006] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-01. [2025-10-02T19:26:15.185336] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-02T19:26:15.395614] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-02T19:26:15.473045] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-09. [2025-10-02T19:26:16.094587] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-02T19:26:16.273034] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-04. [2025-10-02T19:26:16.922537] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-02T19:26:17.073010] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2024-12. [2025-10-02T19:26:17.873046] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-02. [2025-10-02T19:26:18.568018] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-02T19:26:18.586853] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-02T19:26:18.673000] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-01. [2025-10-02T19:26:19.472988] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-05. [2025-10-02T19:26:19.635707] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-02T19:26:20.228973] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-02T19:26:20.272966] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-02. [2025-10-02T19:26:21.072984] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-03. [2025-10-02T19:26:21.417616] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-02T19:26:21.591375] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-02T19:26:21.873019] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-03. [2025-10-02T19:26:22.480499] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-02T19:26:22.672994] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-04. [2025-10-02T19:26:23.181393] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-02T19:26:23.473046] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-10. [2025-10-02T19:26:24.272991] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-06. [2025-10-02T19:26:24.492870] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-02T19:26:25.073002] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-05. [2025-10-02T19:26:25.873064] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-04. [2025-10-02T19:26:26.283293] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-02T19:26:26.421187] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-10 (2.95 seconds). [2025-10-02T19:26:26.423622] [INFO ] [REMOTE ] HNI: Full fetch complete (41637 records). [2025-10-02T19:26:26.423967] [DEBUG] [VALIDATOR ] HNI: Validating primary data. [2025-10-02T19:26:26.425121] [FATAL] [VALIDATOR ] HNI: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:26:26.425254] [FATAL] [MAIN ] HNI: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:26:26.425353] [WARN ] [MAIN ] HNI: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:26:26.425434] [INFO ] [LOCAL ] HNI: Starting deletion of primary data. [2025-10-02T19:26:26.425503] [DEBUG] [LOCAL ] HNI: No primary data file found to delete. [2025-10-02T19:26:26.425540] [INFO ] [LOCAL ] HNI: Starting deletion of derivative data. [2025-10-02T19:26:26.425695] [DEBUG] [LOCAL ] HNI: No derivative data file found to delete. [2025-10-02T19:26:26.425789] [INFO ] [MAIN ] Update Progress: 1037/2370 symbols completed. HNI took 33.2s. Estimated remaining: 3h 8m 10s. Rate: 7.1 symbols/min [2025-10-02T19:26:26.673040] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-07. [2025-10-02T19:26:26.927910] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-02T19:26:27.200516] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-02T19:26:27.473018] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-06. [2025-10-02T19:26:28.273049] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-05. [2025-10-02T19:26:28.400320] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-02T19:26:28.615139] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-02T19:26:29.073038] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-08. [2025-10-02T19:26:29.677478] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-02T19:26:29.873030] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-07. [2025-10-02T19:26:30.673009] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-06. [2025-10-02T19:26:30.869222] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-02T19:26:31.473115] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-09. [2025-10-02T19:26:31.624995] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-02T19:26:31.901155] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-02T19:26:32.273013] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-07. [2025-10-02T19:26:33.073034] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-08. [2025-10-02T19:26:33.662019] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-02T19:26:33.872987] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-10. [2025-10-02T19:26:33.953213] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-02T19:26:34.673000] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-08. [2025-10-02T19:26:34.926688] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-02T19:26:35.473000] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-09. [2025-10-02T19:26:36.290289] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-02T19:26:36.299714] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-09. [2025-10-02T19:26:37.106194] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-02T19:26:37.117327] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-10. [2025-10-02T19:26:37.416136] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-10 (3.54 seconds). [2025-10-02T19:26:37.417639] [INFO ] [REMOTE ] HMY: Full fetch complete (76341 records). [2025-10-02T19:26:37.417767] [DEBUG] [VALIDATOR ] HMY: Validating primary data. [2025-10-02T19:26:37.418582] [FATAL] [VALIDATOR ] HMY: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:26:37.418695] [FATAL] [MAIN ] HMY: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:26:37.418746] [WARN ] [MAIN ] HMY: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:26:37.418854] [INFO ] [LOCAL ] HMY: Starting deletion of primary data. [2025-10-02T19:26:37.418934] [DEBUG] [LOCAL ] HMY: No primary data file found to delete. [2025-10-02T19:26:37.418971] [INFO ] [LOCAL ] HMY: Starting deletion of derivative data. [2025-10-02T19:26:37.419016] [DEBUG] [LOCAL ] HMY: No derivative data file found to delete. [2025-10-02T19:26:37.419077] [INFO ] [MAIN ] Update Progress: 1038/2370 symbols completed. HMY took 46.7s. Estimated remaining: 3h 8m 4s. Rate: 7.1 symbols/min [2025-10-02T19:26:37.487349] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-02T19:26:37.873002] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-10. [2025-10-02T19:26:40.325106] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-10 (3.21 seconds). [2025-10-02T19:26:40.327177] [INFO ] [REMOTE ] HOG: Full fetch complete (73808 records). [2025-10-02T19:26:40.327314] [DEBUG] [VALIDATOR ] HOG: Validating primary data. [2025-10-02T19:26:40.328524] [FATAL] [VALIDATOR ] HOG: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:26:40.328619] [FATAL] [MAIN ] HOG: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:26:40.328702] [WARN ] [MAIN ] HOG: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:26:40.328755] [INFO ] [LOCAL ] HOG: Starting deletion of primary data. [2025-10-02T19:26:40.328815] [DEBUG] [LOCAL ] HOG: No primary data file found to delete. [2025-10-02T19:26:40.328852] [INFO ] [LOCAL ] HOG: Starting deletion of derivative data. [2025-10-02T19:26:40.328895] [DEBUG] [LOCAL ] HOG: No derivative data file found to delete. [2025-10-02T19:26:40.328956] [INFO ] [MAIN ] Update Progress: 1039/2370 symbols completed. HOG took 31.2s. Estimated remaining: 3h 7m 49s. Rate: 7.1 symbols/min [2025-10-02T19:26:41.015278] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-10 (3.14 seconds). [2025-10-02T19:26:41.016800] [INFO ] [REMOTE ] HOMB: Full fetch complete (63614 records). [2025-10-02T19:26:41.016905] [DEBUG] [VALIDATOR ] HOMB: Validating primary data. [2025-10-02T19:26:41.017639] [FATAL] [VALIDATOR ] HOMB: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:26:41.017760] [FATAL] [MAIN ] HOMB: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:26:41.017807] [WARN ] [MAIN ] HOMB: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:26:41.017889] [INFO ] [LOCAL ] HOMB: Starting deletion of primary data. [2025-10-02T19:26:41.017956] [DEBUG] [LOCAL ] HOMB: No primary data file found to delete. [2025-10-02T19:26:41.017994] [INFO ] [LOCAL ] HOMB: Starting deletion of derivative data. [2025-10-02T19:26:41.018037] [DEBUG] [LOCAL ] HOMB: No derivative data file found to delete. [2025-10-02T19:26:41.018222] [INFO ] [MAIN ] Update Progress: 1040/2370 symbols completed. HOMB took 28.5s. Estimated remaining: 3h 7m 30s. Rate: 7.1 symbols/min [2025-10-02T19:26:41.632732] [INFO ] [MAIN ] HPE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:26:41.692699] [DEBUG] [LOCAL ] HPE: No existing data file found in primary storage. [2025-10-02T19:26:41.717566] [WARN ] [MAIN ] HPE: No existing data found, performing full refresh instead. [2025-10-02T19:26:41.811732] [INFO ] [MAIN ] HPE: Wiping existing primary data before full refresh. [2025-10-02T19:26:41.811418] [INFO ] [MAIN ] HP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:26:41.812847] [INFO ] [MAIN ] HOV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:26:41.818288] [INFO ] [LOCAL ] HPE: Starting deletion of primary data. [2025-10-02T19:26:41.818387] [DEBUG] [LOCAL ] HOV: No existing data file found in primary storage. [2025-10-02T19:26:41.813017] [DEBUG] [LOCAL ] HP: No existing data file found in primary storage. [2025-10-02T19:26:41.854374] [DEBUG] [LOCAL ] HPE: No primary data file found to delete. [2025-10-02T19:26:41.854215] [WARN ] [MAIN ] HOV: No existing data found, performing full refresh instead. [2025-10-02T19:26:41.856964] [WARN ] [MAIN ] HP: No existing data found, performing full refresh instead. [2025-10-02T19:26:41.858524] [INFO ] [MAIN ] HOUS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:26:41.858918] [INFO ] [MAIN ] HOV: Wiping existing primary data before full refresh. [2025-10-02T19:26:41.857230] [INFO ] [MAIN ] HPE: Starting full primary refresh. [2025-10-02T19:26:41.864344] [INFO ] [LOCAL ] HOV: Starting deletion of primary data. [2025-10-02T19:26:41.864585] [INFO ] [MAIN ] HP: Wiping existing primary data before full refresh. [2025-10-02T19:26:41.876688] [DEBUG] [LOCAL ] HOUS: No existing data file found in primary storage. [2025-10-02T19:26:41.888581] [INFO ] [LOCAL ] HP: Starting deletion of primary data. [2025-10-02T19:26:41.876822] [DEBUG] [LOCAL ] HOV: No primary data file found to delete. [2025-10-02T19:26:41.894143] [INFO ] [MAIN ] HOV: Starting full primary refresh. [2025-10-02T19:26:41.894324] [DEBUG] [LOCAL ] HP: No primary data file found to delete. [2025-10-02T19:26:41.894267] [WARN ] [MAIN ] HOUS: No existing data found, performing full refresh instead. [2025-10-02T19:26:41.939581] [INFO ] [MAIN ] HP: Starting full primary refresh. [2025-10-02T19:26:42.004343] [INFO ] [MAIN ] HOUS: Wiping existing primary data before full refresh. [2025-10-02T19:26:42.089229] [INFO ] [LOCAL ] HOUS: Starting deletion of primary data. [2025-10-02T19:26:42.171545] [DEBUG] [LOCAL ] HOUS: No primary data file found to delete. [2025-10-02T19:26:42.213273] [INFO ] [MAIN ] HOUS: Starting full primary refresh. [2025-10-02T19:26:43.223886] [INFO ] [REMOTE ] HOV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:26:43.251937] [INFO ] [REMOTE ] HOV: Fetching primary data for 2024-12. [2025-10-02T19:26:43.277374] [INFO ] [REMOTE ] HPE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:26:43.303067] [INFO ] [REMOTE ] HPE: Fetching primary data for 2024-12. [2025-10-02T19:26:43.480553] [INFO ] [REMOTE ] HP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:26:43.491223] [INFO ] [REMOTE ] HP: Fetching primary data for 2024-12. [2025-10-02T19:26:43.555285] [INFO ] [REMOTE ] HOUS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:26:43.555621] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2024-12. [2025-10-02T19:26:44.389598] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-02T19:26:44.393203] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-01. [2025-10-02T19:26:45.000867] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-02T19:26:45.010089] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-01. [2025-10-02T19:26:45.195255] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-02T19:26:45.209372] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-01. [2025-10-02T19:26:45.236844] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-02T19:26:45.240102] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-02. [2025-10-02T19:26:45.501554] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-10-02T19:26:45.512721] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-01. [2025-10-02T19:26:46.093892] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-02T19:26:46.110769] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-02T19:26:46.111733] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-02. [2025-10-02T19:26:46.672996] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-03. [2025-10-02T19:26:46.934332] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-02T19:26:47.441285] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-02T19:26:47.472985] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-02. [2025-10-02T19:26:47.627848] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-02T19:26:47.645047] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-02T19:26:48.272999] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-04. [2025-10-02T19:26:49.072983] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-02. [2025-10-02T19:26:49.122049] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-02T19:26:49.192866] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-02T19:26:49.873095] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-05. [2025-10-02T19:26:50.662045] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-02T19:26:50.672950] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-03. [2025-10-02T19:26:50.804541] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-02T19:26:51.472995] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-06. [2025-10-02T19:26:52.272996] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-03. [2025-10-02T19:26:52.428870] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-02T19:26:52.472288] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-02T19:26:53.072979] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-07. [2025-10-02T19:26:53.873000] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-04. [2025-10-02T19:26:54.150852] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-02T19:26:54.366992] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-02T19:26:54.672999] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-04. [2025-10-02T19:26:55.472988] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-03. [2025-10-02T19:26:55.534933] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-02T19:26:56.272964] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-05. [2025-10-02T19:26:56.824429] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-02T19:26:56.975996] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-02T19:26:57.073033] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-04. [2025-10-02T19:26:57.701029] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-02T19:26:57.873018] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-05. [2025-10-02T19:26:58.672974] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-06. [2025-10-02T19:26:58.713105] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-02T19:26:59.473043] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-08. [2025-10-02T19:26:59.851734] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-02T19:27:00.060041] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-02T19:27:00.273009] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-05. [2025-10-02T19:27:00.423500] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-02T19:27:01.073024] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-09. [2025-10-02T19:27:01.764251] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-02T19:27:01.816857] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-02T19:27:01.873036] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-10. [2025-10-02T19:27:02.673000] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-07. [2025-10-02T19:27:03.473012] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-06. [2025-10-02T19:27:04.272976] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-06. [2025-10-02T19:27:04.489507] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-02T19:27:04.602612] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-10 (2.73 seconds). [2025-10-02T19:27:04.603538] [INFO ] [REMOTE ] HOV: Full fetch complete (19194 records). [2025-10-02T19:27:04.603680] [DEBUG] [VALIDATOR ] HOV: Validating primary data. [2025-10-02T19:27:04.604204] [FATAL] [VALIDATOR ] HOV: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:27:04.604284] [FATAL] [MAIN ] HOV: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:27:04.604351] [WARN ] [MAIN ] HOV: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:27:04.604427] [INFO ] [LOCAL ] HOV: Starting deletion of primary data. [2025-10-02T19:27:04.604493] [DEBUG] [LOCAL ] HOV: No primary data file found to delete. [2025-10-02T19:27:04.604529] [INFO ] [LOCAL ] HOV: Starting deletion of derivative data. [2025-10-02T19:27:04.604569] [DEBUG] [LOCAL ] HOV: No derivative data file found to delete. [2025-10-02T19:27:04.604624] [INFO ] [MAIN ] Update Progress: 1041/2370 symbols completed. HOV took 23.6s. Estimated remaining: 3h 7m 41s. Rate: 7.1 symbols/min [2025-10-02T19:27:04.793563] [INFO ] [MAIN ] HPF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:27:04.793817] [DEBUG] [LOCAL ] HPF: No existing data file found in primary storage. [2025-10-02T19:27:04.793874] [WARN ] [MAIN ] HPF: No existing data found, performing full refresh instead. [2025-10-02T19:27:04.793987] [INFO ] [MAIN ] HPF: Wiping existing primary data before full refresh. [2025-10-02T19:27:04.794030] [INFO ] [LOCAL ] HPF: Starting deletion of primary data. [2025-10-02T19:27:04.794073] [DEBUG] [LOCAL ] HPF: No primary data file found to delete. [2025-10-02T19:27:04.794113] [INFO ] [MAIN ] HPF: Starting full primary refresh. [2025-10-02T19:27:05.076092] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-08. [2025-10-02T19:27:05.194123] [INFO ] [REMOTE ] HPF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:27:05.414007] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-02T19:27:05.773986] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-02T19:27:05.873019] [INFO ] [REMOTE ] HPF: Fetching primary data for 2024-12. [2025-10-02T19:27:06.582282] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-02T19:27:06.641357] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-02T19:27:06.672984] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-01. [2025-10-02T19:27:07.274565] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-02T19:27:07.473005] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-02. [2025-10-02T19:27:08.133582] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-02T19:27:08.273045] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-07. [2025-10-02T19:27:09.073004] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-09. [2025-10-02T19:27:09.872998] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-03. [2025-10-02T19:27:09.920864] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-02T19:27:10.522521] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-02T19:27:10.672984] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-04. [2025-10-02T19:27:10.722259] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-02T19:27:11.364310] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-02T19:27:11.472985] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-07. [2025-10-02T19:27:12.273042] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-05. [2025-10-02T19:27:12.967635] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-02T19:27:13.004206] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-02T19:27:13.073017] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-08. [2025-10-02T19:27:13.872997] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-08. [2025-10-02T19:27:14.672995] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-06. [2025-10-02T19:27:15.214207] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-02T19:27:15.279851] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-02T19:27:15.477787] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-10. [2025-10-02T19:27:15.483933] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-02T19:27:16.273039] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-09. [2025-10-02T19:27:16.769766] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-02T19:27:16.771337] [INFO ] [REMOTE ] HP: Full fetch complete (73624 records). [2025-10-02T19:27:16.771453] [DEBUG] [VALIDATOR ] HP: Validating primary data. [2025-10-02T19:27:16.772431] [FATAL] [VALIDATOR ] HP: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:27:16.772544] [FATAL] [MAIN ] HP: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:27:16.772756] [WARN ] [MAIN ] HP: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:27:16.772833] [INFO ] [LOCAL ] HP: Starting deletion of primary data. [2025-10-02T19:27:16.772901] [DEBUG] [LOCAL ] HP: No primary data file found to delete. [2025-10-02T19:27:16.772939] [INFO ] [LOCAL ] HP: Starting deletion of derivative data. [2025-10-02T19:27:16.772998] [DEBUG] [LOCAL ] HP: No derivative data file found to delete. [2025-10-02T19:27:16.773082] [INFO ] [MAIN ] Update Progress: 1042/2370 symbols completed. HP took 35.8s. Estimated remaining: 3h 7m 37s. Rate: 7.1 symbols/min [2025-10-02T19:27:16.954742] [INFO ] [MAIN ] HPI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:27:16.954911] [DEBUG] [LOCAL ] HPI: No existing data file found in primary storage. [2025-10-02T19:27:16.954950] [WARN ] [MAIN ] HPI: No existing data found, performing full refresh instead. [2025-10-02T19:27:16.955066] [INFO ] [MAIN ] HPI: Wiping existing primary data before full refresh. [2025-10-02T19:27:16.955112] [INFO ] [LOCAL ] HPI: Starting deletion of primary data. [2025-10-02T19:27:16.955155] [DEBUG] [LOCAL ] HPI: No primary data file found to delete. [2025-10-02T19:27:16.955189] [INFO ] [MAIN ] HPI: Starting full primary refresh. [2025-10-02T19:27:17.078154] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-09. [2025-10-02T19:27:17.356596] [INFO ] [REMOTE ] HPI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:27:17.873040] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-07. [2025-10-02T19:27:17.949285] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-02T19:27:18.632247] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-02T19:27:18.673013] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-08. [2025-10-02T19:27:18.906967] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-02T19:27:19.387371] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-02T19:27:19.472990] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-10. [2025-10-02T19:27:20.273010] [INFO ] [REMOTE ] HPI: Fetching primary data for 2024-12. [2025-10-02T19:27:21.072490] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-02T19:27:21.074895] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-10. [2025-10-02T19:27:21.873047] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-09. [2025-10-02T19:27:22.260568] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-02T19:27:22.262839] [INFO ] [REMOTE ] HOUS: Full fetch complete (63152 records). [2025-10-02T19:27:22.262942] [DEBUG] [VALIDATOR ] HOUS: Validating primary data. [2025-10-02T19:27:22.263771] [FATAL] [VALIDATOR ] HOUS: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:27:22.263878] [FATAL] [MAIN ] HOUS: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:27:22.263932] [WARN ] [MAIN ] HOUS: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:27:22.264014] [INFO ] [LOCAL ] HOUS: Starting deletion of primary data. [2025-10-02T19:27:22.264096] [DEBUG] [LOCAL ] HOUS: No primary data file found to delete. [2025-10-02T19:27:22.264191] [INFO ] [LOCAL ] HOUS: Starting deletion of derivative data. [2025-10-02T19:27:22.264257] [DEBUG] [LOCAL ] HOUS: No derivative data file found to delete. [2025-10-02T19:27:22.264339] [INFO ] [MAIN ] Update Progress: 1043/2370 symbols completed. HOUS took 41.2s. Estimated remaining: 3h 7m 25s. Rate: 7.1 symbols/min [2025-10-02T19:27:22.470816] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-02T19:27:22.472927] [INFO ] [MAIN ] HPP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:27:22.475948] [DEBUG] [LOCAL ] HPP: No existing data file found in primary storage. [2025-10-02T19:27:22.476018] [WARN ] [MAIN ] HPP: No existing data found, performing full refresh instead. [2025-10-02T19:27:22.476143] [INFO ] [MAIN ] HPP: Wiping existing primary data before full refresh. [2025-10-02T19:27:22.476188] [INFO ] [LOCAL ] HPP: Starting deletion of primary data. [2025-10-02T19:27:22.476233] [DEBUG] [LOCAL ] HPP: No primary data file found to delete. [2025-10-02T19:27:22.476268] [INFO ] [MAIN ] HPP: Starting full primary refresh. [2025-10-02T19:27:22.680967] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-01. [2025-10-02T19:27:22.881975] [INFO ] [REMOTE ] HPP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:27:23.091548] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-10 (3.62 seconds). [2025-10-02T19:27:23.093130] [INFO ] [REMOTE ] HPE: Full fetch complete (77342 records). [2025-10-02T19:27:23.093227] [DEBUG] [VALIDATOR ] HPE: Validating primary data. [2025-10-02T19:27:23.094313] [FATAL] [VALIDATOR ] HPE: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:27:23.094415] [FATAL] [MAIN ] HPE: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:27:23.094469] [WARN ] [MAIN ] HPE: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:27:23.094540] [INFO ] [LOCAL ] HPE: Starting deletion of primary data. [2025-10-02T19:27:23.094687] [DEBUG] [LOCAL ] HPE: No primary data file found to delete. [2025-10-02T19:27:23.094776] [INFO ] [LOCAL ] HPE: Starting deletion of derivative data. [2025-10-02T19:27:23.094833] [DEBUG] [LOCAL ] HPE: No derivative data file found to delete. [2025-10-02T19:27:23.094901] [INFO ] [MAIN ] Update Progress: 1044/2370 symbols completed. HPE took 42.1s. Estimated remaining: 3h 7m 7s. Rate: 7.1 symbols/min [2025-10-02T19:27:23.288844] [INFO ] [MAIN ] HPQ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:27:23.289128] [DEBUG] [LOCAL ] HPQ: No existing data file found in primary storage. [2025-10-02T19:27:23.289180] [WARN ] [MAIN ] HPQ: No existing data found, performing full refresh instead. [2025-10-02T19:27:23.289299] [INFO ] [MAIN ] HPQ: Wiping existing primary data before full refresh. [2025-10-02T19:27:23.289341] [INFO ] [LOCAL ] HPQ: Starting deletion of primary data. [2025-10-02T19:27:23.289384] [DEBUG] [LOCAL ] HPQ: No primary data file found to delete. [2025-10-02T19:27:23.289418] [INFO ] [MAIN ] HPQ: Starting full primary refresh. [2025-10-02T19:27:23.474959] [INFO ] [REMOTE ] HPP: Fetching primary data for 2024-12. [2025-10-02T19:27:23.605744] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-02T19:27:23.747294] [INFO ] [REMOTE ] HPQ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:27:24.273017] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-02. [2025-10-02T19:27:24.871929] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-02T19:27:25.072993] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-10. [2025-10-02T19:27:25.232051] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-02T19:27:25.508979] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-02T19:27:25.509925] [INFO ] [REMOTE ] HPF: Full fetch complete (10762 records). [2025-10-02T19:27:25.510061] [DEBUG] [VALIDATOR ] HPF: Validating primary data. [2025-10-02T19:27:25.510599] [FATAL] [VALIDATOR ] HPF: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:27:25.510725] [FATAL] [MAIN ] HPF: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:27:25.510792] [WARN ] [MAIN ] HPF: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:27:25.510879] [INFO ] [LOCAL ] HPF: Starting deletion of primary data. [2025-10-02T19:27:25.510958] [DEBUG] [LOCAL ] HPF: No primary data file found to delete. [2025-10-02T19:27:25.511031] [INFO ] [LOCAL ] HPF: Starting deletion of derivative data. [2025-10-02T19:27:25.511114] [DEBUG] [LOCAL ] HPF: No derivative data file found to delete. [2025-10-02T19:27:25.511188] [INFO ] [MAIN ] Update Progress: 1045/2370 symbols completed. HPF took 20.9s. Estimated remaining: 3h 6m 51s. Rate: 7.1 symbols/min [2025-10-02T19:27:25.706540] [INFO ] [MAIN ] HPS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:27:25.706771] [DEBUG] [LOCAL ] HPS: No existing data file found in primary storage. [2025-10-02T19:27:25.706829] [WARN ] [MAIN ] HPS: No existing data found, performing full refresh instead. [2025-10-02T19:27:25.706948] [INFO ] [MAIN ] HPS: Wiping existing primary data before full refresh. [2025-10-02T19:27:25.706991] [INFO ] [LOCAL ] HPS: Starting deletion of primary data. [2025-10-02T19:27:25.707034] [DEBUG] [LOCAL ] HPS: No primary data file found to delete. [2025-10-02T19:27:25.707070] [INFO ] [MAIN ] HPS: Starting full primary refresh. [2025-10-02T19:27:25.882676] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-03. [2025-10-02T19:27:26.089166] [INFO ] [REMOTE ] HPS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:27:26.672991] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2024-12. [2025-10-02T19:27:26.704557] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-02T19:27:27.472987] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-04. [2025-10-02T19:27:28.264598] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-02T19:27:28.272946] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-05. [2025-10-02T19:27:28.568022] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-02T19:27:28.989389] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-02T19:27:29.073005] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-06. [2025-10-02T19:27:29.875219] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-02T19:27:29.873490] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-01. [2025-10-02T19:27:30.673022] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-07. [2025-10-02T19:27:31.438826] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-02T19:27:31.470473] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-02T19:27:31.480722] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-08. [2025-10-02T19:27:32.274121] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-02. [2025-10-02T19:27:32.277285] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-02T19:27:33.073221] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-09. [2025-10-02T19:27:33.754473] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-02T19:27:33.873013] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-01. [2025-10-02T19:27:34.043028] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-02T19:27:34.673023] [INFO ] [REMOTE ] HPS: Fetching primary data for 2024-12. [2025-10-02T19:27:35.376757] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-02T19:27:35.473009] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-02. [2025-10-02T19:27:35.559864] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-02T19:27:36.273010] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-10. [2025-10-02T19:27:36.921290] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-02T19:27:36.922178] [INFO ] [REMOTE ] HPI: Full fetch complete (13756 records). [2025-10-02T19:27:36.922251] [DEBUG] [VALIDATOR ] HPI: Validating primary data. [2025-10-02T19:27:36.922761] [FATAL] [VALIDATOR ] HPI: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:27:36.922849] [FATAL] [MAIN ] HPI: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:27:36.922893] [WARN ] [MAIN ] HPI: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:27:36.922935] [INFO ] [LOCAL ] HPI: Starting deletion of primary data. [2025-10-02T19:27:36.923006] [DEBUG] [LOCAL ] HPI: No primary data file found to delete. [2025-10-02T19:27:36.923060] [INFO ] [LOCAL ] HPI: Starting deletion of derivative data. [2025-10-02T19:27:36.923104] [DEBUG] [LOCAL ] HPI: No derivative data file found to delete. [2025-10-02T19:27:36.923159] [INFO ] [MAIN ] Update Progress: 1046/2370 symbols completed. HPI took 20.1s. Estimated remaining: 3h 6m 46s. Rate: 7.1 symbols/min [2025-10-02T19:27:37.084251] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-01. [2025-10-02T19:27:37.123342] [INFO ] [MAIN ] HQH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:27:37.123820] [DEBUG] [LOCAL ] HQH: No existing data file found in primary storage. [2025-10-02T19:27:37.123927] [WARN ] [MAIN ] HQH: No existing data found, performing full refresh instead. [2025-10-02T19:27:37.124115] [INFO ] [MAIN ] HQH: Wiping existing primary data before full refresh. [2025-10-02T19:27:37.124257] [INFO ] [LOCAL ] HQH: Starting deletion of primary data. [2025-10-02T19:27:37.124459] [DEBUG] [LOCAL ] HQH: No primary data file found to delete. [2025-10-02T19:27:37.124523] [INFO ] [MAIN ] HQH: Starting full primary refresh. [2025-10-02T19:27:37.478714] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-02T19:27:37.563139] [INFO ] [REMOTE ] HQH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:27:37.873005] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-03. [2025-10-02T19:27:37.884044] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-02T19:27:38.673033] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-03. [2025-10-02T19:27:39.473000] [INFO ] [REMOTE ] HQH: Fetching primary data for 2024-12. [2025-10-02T19:27:39.908234] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-02T19:27:40.273052] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-02. [2025-10-02T19:27:40.360953] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-02T19:27:40.447345] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-02T19:27:41.055717] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-02T19:27:41.073000] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-01. [2025-10-02T19:27:41.873032] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-03. [2025-10-02T19:27:42.266000] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-02T19:27:42.427169] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-02T19:27:42.673055] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-04. [2025-10-02T19:27:43.417439] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-02T19:27:43.473006] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-05. [2025-10-02T19:27:44.271699] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-02T19:27:44.273966] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-04. [2025-10-02T19:27:45.073014] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-04. [2025-10-02T19:27:45.872974] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-02. [2025-10-02T19:27:45.970590] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-02T19:27:46.673016] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-06. [2025-10-02T19:27:46.747799] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-02T19:27:46.949676] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-02T19:27:47.473014] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-03. [2025-10-02T19:27:47.492466] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-02T19:27:48.272986] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-07. [2025-10-02T19:27:48.543252] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-02T19:27:49.073027] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-04. [2025-10-02T19:27:49.257542] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-02T19:27:49.872989] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-08. [2025-10-02T19:27:50.214537] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-02T19:27:50.646178] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-02T19:27:50.672998] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-05. [2025-10-02T19:27:51.480325] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-05. [2025-10-02T19:27:51.486429] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-02T19:27:52.272968] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-09. [2025-10-02T19:27:53.071097] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-02T19:27:53.073556] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-06. [2025-10-02T19:27:53.323214] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-02T19:27:53.872994] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-06. [2025-10-02T19:27:54.018599] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-02T19:27:54.673030] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-07. [2025-10-02T19:27:55.472981] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-10. [2025-10-02T19:27:55.662527] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-02T19:27:55.997511] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-02T19:27:55.998600] [INFO ] [REMOTE ] HPS: Full fetch complete (15218 records). [2025-10-02T19:27:56.022839] [DEBUG] [VALIDATOR ] HPS: Validating primary data. [2025-10-02T19:27:56.025172] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-02T19:27:56.025986] [FATAL] [VALIDATOR ] HPS: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:27:56.033414] [FATAL] [MAIN ] HPS: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:27:56.033708] [WARN ] [MAIN ] HPS: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:27:56.033816] [INFO ] [LOCAL ] HPS: Starting deletion of primary data. [2025-10-02T19:27:56.034323] [DEBUG] [LOCAL ] HPS: No primary data file found to delete. [2025-10-02T19:27:56.034396] [INFO ] [LOCAL ] HPS: Starting deletion of derivative data. [2025-10-02T19:27:56.034472] [DEBUG] [LOCAL ] HPS: No derivative data file found to delete. [2025-10-02T19:27:56.034609] [INFO ] [MAIN ] Update Progress: 1047/2370 symbols completed. HPS took 30.5s. Estimated remaining: 3h 6m 51s. Rate: 7.1 symbols/min [2025-10-02T19:27:56.228757] [INFO ] [MAIN ] HQL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:27:56.228962] [DEBUG] [LOCAL ] HQL: No existing data file found in primary storage. [2025-10-02T19:27:56.229006] [WARN ] [MAIN ] HQL: No existing data found, performing full refresh instead. [2025-10-02T19:27:56.229120] [INFO ] [MAIN ] HQL: Wiping existing primary data before full refresh. [2025-10-02T19:27:56.229175] [INFO ] [LOCAL ] HQL: Starting deletion of primary data. [2025-10-02T19:27:56.229218] [DEBUG] [LOCAL ] HQL: No primary data file found to delete. [2025-10-02T19:27:56.229251] [INFO ] [MAIN ] HQL: Starting full primary refresh. [2025-10-02T19:27:56.278217] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-07. [2025-10-02T19:27:56.622527] [INFO ] [REMOTE ] HQL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:27:57.073019] [INFO ] [REMOTE ] HQL: Fetching primary data for 2024-12. [2025-10-02T19:27:57.873008] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-08. [2025-10-02T19:27:57.888559] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-02T19:27:58.461362] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-02T19:27:58.672998] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-08. [2025-10-02T19:27:59.087460] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-02T19:27:59.472999] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-05. [2025-10-02T19:28:00.273045] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-09. [2025-10-02T19:28:00.567136] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-02T19:28:01.076317] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-01. [2025-10-02T19:28:01.082224] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-02T19:28:01.502196] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-02T19:28:01.737116] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-02T19:28:01.873009] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-10. [2025-10-02T19:28:02.673019] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-02. [2025-10-02T19:28:02.748626] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-02T19:28:02.749865] [INFO ] [REMOTE ] HQH: Full fetch complete (37297 records). [2025-10-02T19:28:02.749945] [DEBUG] [VALIDATOR ] HQH: Validating primary data. [2025-10-02T19:28:02.750431] [FATAL] [VALIDATOR ] HQH: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:28:02.750517] [FATAL] [MAIN ] HQH: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:28:02.750562] [WARN ] [MAIN ] HQH: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:28:02.750601] [INFO ] [LOCAL ] HQH: Starting deletion of primary data. [2025-10-02T19:28:02.750690] [DEBUG] [LOCAL ] HQH: No primary data file found to delete. [2025-10-02T19:28:02.750747] [INFO ] [LOCAL ] HQH: Starting deletion of derivative data. [2025-10-02T19:28:02.750792] [DEBUG] [LOCAL ] HQH: No derivative data file found to delete. [2025-10-02T19:28:02.751000] [INFO ] [MAIN ] Update Progress: 1048/2370 symbols completed. HQH took 25.8s. Estimated remaining: 3h 6m 40s. Rate: 7.1 symbols/min [2025-10-02T19:28:02.929616] [INFO ] [MAIN ] HR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:28:02.929817] [DEBUG] [LOCAL ] HR: No existing data file found in primary storage. [2025-10-02T19:28:02.929873] [WARN ] [MAIN ] HR: No existing data found, performing full refresh instead. [2025-10-02T19:28:02.929987] [INFO ] [MAIN ] HR: Wiping existing primary data before full refresh. [2025-10-02T19:28:02.930029] [INFO ] [LOCAL ] HR: Starting deletion of primary data. [2025-10-02T19:28:02.930081] [DEBUG] [LOCAL ] HR: No primary data file found to delete. [2025-10-02T19:28:02.930124] [INFO ] [MAIN ] HR: Starting full primary refresh. [2025-10-02T19:28:03.309979] [INFO ] [REMOTE ] HR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:28:03.473019] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-09. [2025-10-02T19:28:03.784759] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-02T19:28:04.273072] [INFO ] [REMOTE ] HR: Fetching primary data for 2024-12. [2025-10-02T19:28:05.072985] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-06. [2025-10-02T19:28:05.218597] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-02T19:28:05.724914] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-02T19:28:05.873039] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-01. [2025-10-02T19:28:06.421124] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-02T19:28:06.673001] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-07. [2025-10-02T19:28:07.307147] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-02T19:28:07.473047] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-10. [2025-10-02T19:28:08.273013] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-03. [2025-10-02T19:28:08.485745] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-02T19:28:09.073015] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-02. [2025-10-02T19:28:09.264488] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-02T19:28:09.873015] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-04. [2025-10-02T19:28:10.673026] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-08. [2025-10-02T19:28:10.757493] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-02T19:28:10.829989] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-02T19:28:10.981259] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-10 (3.51 seconds). [2025-10-02T19:28:10.982978] [INFO ] [REMOTE ] HPQ: Full fetch complete (77279 records). [2025-10-02T19:28:10.983117] [DEBUG] [VALIDATOR ] HPQ: Validating primary data. [2025-10-02T19:28:10.984103] [FATAL] [VALIDATOR ] HPQ: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:28:10.984226] [FATAL] [MAIN ] HPQ: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:28:10.984272] [WARN ] [MAIN ] HPQ: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:28:10.984340] [INFO ] [LOCAL ] HPQ: Starting deletion of primary data. [2025-10-02T19:28:10.984414] [DEBUG] [LOCAL ] HPQ: No primary data file found to delete. [2025-10-02T19:28:10.984453] [INFO ] [LOCAL ] HPQ: Starting deletion of derivative data. [2025-10-02T19:28:10.984494] [DEBUG] [LOCAL ] HPQ: No derivative data file found to delete. [2025-10-02T19:28:10.984554] [INFO ] [MAIN ] Update Progress: 1049/2370 symbols completed. HPQ took 47.9s. Estimated remaining: 3h 6m 32s. Rate: 7.1 symbols/min [2025-10-02T19:28:11.172033] [INFO ] [MAIN ] HRB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:28:11.172217] [DEBUG] [LOCAL ] HRB: No existing data file found in primary storage. [2025-10-02T19:28:11.172257] [WARN ] [MAIN ] HRB: No existing data found, performing full refresh instead. [2025-10-02T19:28:11.172382] [INFO ] [MAIN ] HRB: Wiping existing primary data before full refresh. [2025-10-02T19:28:11.172424] [INFO ] [LOCAL ] HRB: Starting deletion of primary data. [2025-10-02T19:28:11.172465] [DEBUG] [LOCAL ] HRB: No primary data file found to delete. [2025-10-02T19:28:11.172499] [INFO ] [MAIN ] HRB: Starting full primary refresh. [2025-10-02T19:28:11.478093] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-05. [2025-10-02T19:28:11.568776] [INFO ] [REMOTE ] HRB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:28:12.273041] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-03. [2025-10-02T19:28:12.344127] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-02T19:28:12.479032] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-02T19:28:13.073016] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-06. [2025-10-02T19:28:13.872960] [INFO ] [REMOTE ] HRB: Fetching primary data for 2024-12. [2025-10-02T19:28:13.964612] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-02T19:28:14.004578] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-02T19:28:14.673108] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-09. [2025-10-02T19:28:15.472962] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-04. [2025-10-02T19:28:15.577696] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-02T19:28:16.273031] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-07. [2025-10-02T19:28:16.411969] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-02T19:28:16.888308] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-02T19:28:16.990847] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-02T19:28:17.072969] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-08. [2025-10-02T19:28:17.872980] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-01. [2025-10-02T19:28:18.094681] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-02T19:28:18.673038] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-05. [2025-10-02T19:28:19.338694] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-02T19:28:19.473010] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-09. [2025-10-02T19:28:20.272996] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-02. [2025-10-02T19:28:20.357817] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-02T19:28:20.487375] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-02T19:28:21.073018] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-10. [2025-10-02T19:28:21.873094] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-06. [2025-10-02T19:28:21.930123] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-02T19:28:22.673062] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-03. [2025-10-02T19:28:23.473049] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-10. [2025-10-02T19:28:23.610894] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-02T19:28:23.825892] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-10 (2.75 seconds). [2025-10-02T19:28:23.827171] [INFO ] [REMOTE ] HQL: Full fetch complete (24671 records). [2025-10-02T19:28:23.827289] [DEBUG] [VALIDATOR ] HQL: Validating primary data. [2025-10-02T19:28:23.828106] [FATAL] [VALIDATOR ] HQL: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:28:23.828236] [FATAL] [MAIN ] HQL: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:28:23.828294] [WARN ] [MAIN ] HQL: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:28:23.828379] [INFO ] [LOCAL ] HQL: Starting deletion of primary data. [2025-10-02T19:28:23.828476] [DEBUG] [LOCAL ] HQL: No primary data file found to delete. [2025-10-02T19:28:23.828557] [INFO ] [LOCAL ] HQL: Starting deletion of derivative data. [2025-10-02T19:28:23.828629] [DEBUG] [LOCAL ] HQL: No derivative data file found to delete. [2025-10-02T19:28:23.828769] [INFO ] [MAIN ] Update Progress: 1050/2370 symbols completed. HQL took 27.8s. Estimated remaining: 3h 6m 29s. Rate: 7.1 symbols/min [2025-10-02T19:28:24.028319] [INFO ] [MAIN ] HRI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:28:24.028510] [DEBUG] [LOCAL ] HRI: No existing data file found in primary storage. [2025-10-02T19:28:24.028565] [WARN ] [MAIN ] HRI: No existing data found, performing full refresh instead. [2025-10-02T19:28:24.028707] [INFO ] [MAIN ] HRI: Wiping existing primary data before full refresh. [2025-10-02T19:28:24.028760] [INFO ] [LOCAL ] HRI: Starting deletion of primary data. [2025-10-02T19:28:24.028804] [DEBUG] [LOCAL ] HRI: No primary data file found to delete. [2025-10-02T19:28:24.028841] [INFO ] [MAIN ] HRI: Starting full primary refresh. [2025-10-02T19:28:24.275589] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-07. [2025-10-02T19:28:24.463958] [INFO ] [REMOTE ] HRI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:28:24.497491] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-02T19:28:24.666902] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-02T19:28:24.668809] [INFO ] [REMOTE ] HPP: Full fetch complete (73003 records). [2025-10-02T19:28:24.668924] [DEBUG] [VALIDATOR ] HPP: Validating primary data. [2025-10-02T19:28:24.669949] [FATAL] [VALIDATOR ] HPP: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:28:24.670048] [FATAL] [MAIN ] HPP: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:28:24.670093] [WARN ] [MAIN ] HPP: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:28:24.670135] [INFO ] [LOCAL ] HPP: Starting deletion of primary data. [2025-10-02T19:28:24.670194] [DEBUG] [LOCAL ] HPP: No primary data file found to delete. [2025-10-02T19:28:24.670230] [INFO ] [LOCAL ] HPP: Starting deletion of derivative data. [2025-10-02T19:28:24.670313] [DEBUG] [LOCAL ] HPP: No derivative data file found to delete. [2025-10-02T19:28:24.670417] [INFO ] [MAIN ] Update Progress: 1051/2370 symbols completed. HPP took 1m 2s. Estimated remaining: 3h 6m 11s. Rate: 7.1 symbols/min [2025-10-02T19:28:24.874838] [INFO ] [MAIN ] HRL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:28:24.875028] [DEBUG] [LOCAL ] HRL: No existing data file found in primary storage. [2025-10-02T19:28:24.875066] [WARN ] [MAIN ] HRL: No existing data found, performing full refresh instead. [2025-10-02T19:28:24.875182] [INFO ] [MAIN ] HRL: Wiping existing primary data before full refresh. [2025-10-02T19:28:24.875223] [INFO ] [LOCAL ] HRL: Starting deletion of primary data. [2025-10-02T19:28:24.875267] [DEBUG] [LOCAL ] HRL: No primary data file found to delete. [2025-10-02T19:28:24.875299] [INFO ] [MAIN ] HRL: Starting full primary refresh. [2025-10-02T19:28:25.078157] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-04. [2025-10-02T19:28:25.269734] [INFO ] [REMOTE ] HRL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:28:25.701705] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-02T19:28:25.872984] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-08. [2025-10-02T19:28:26.673055] [INFO ] [REMOTE ] HRL: Fetching primary data for 2024-12. [2025-10-02T19:28:26.965245] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-02T19:28:27.424141] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-02T19:28:27.472986] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-09. [2025-10-02T19:28:28.244605] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-02T19:28:28.273024] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-01. [2025-10-02T19:28:28.904994] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-02T19:28:29.073010] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-10. [2025-10-02T19:28:29.873070] [INFO ] [REMOTE ] HRI: Fetching primary data for 2024-12. [2025-10-02T19:28:29.936722] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-02T19:28:30.469856] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-02T19:28:30.475274] [INFO ] [REMOTE ] HR: Full fetch complete (74459 records). [2025-10-02T19:28:30.475397] [DEBUG] [VALIDATOR ] HR: Validating primary data. [2025-10-02T19:28:30.480846] [FATAL] [VALIDATOR ] HR: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:28:30.481001] [FATAL] [MAIN ] HR: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:28:30.481048] [WARN ] [MAIN ] HR: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:28:30.481134] [INFO ] [LOCAL ] HR: Starting deletion of primary data. [2025-10-02T19:28:30.481241] [DEBUG] [LOCAL ] HR: No primary data file found to delete. [2025-10-02T19:28:30.481330] [INFO ] [LOCAL ] HR: Starting deletion of derivative data. [2025-10-02T19:28:30.481384] [DEBUG] [LOCAL ] HR: No derivative data file found to delete. [2025-10-02T19:28:30.481454] [INFO ] [MAIN ] Update Progress: 1052/2370 symbols completed. HR took 27.7s. Estimated remaining: 3h 5m 59s. Rate: 7.1 symbols/min [2025-10-02T19:28:30.665733] [INFO ] [MAIN ] HRTG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:28:30.665911] [DEBUG] [LOCAL ] HRTG: No existing data file found in primary storage. [2025-10-02T19:28:30.665968] [WARN ] [MAIN ] HRTG: No existing data found, performing full refresh instead. [2025-10-02T19:28:30.666084] [INFO ] [MAIN ] HRTG: Wiping existing primary data before full refresh. [2025-10-02T19:28:30.666129] [INFO ] [LOCAL ] HRTG: Starting deletion of primary data. [2025-10-02T19:28:30.666173] [DEBUG] [LOCAL ] HRTG: No primary data file found to delete. [2025-10-02T19:28:30.666220] [INFO ] [MAIN ] HRTG: Starting full primary refresh. [2025-10-02T19:28:30.678158] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-02. [2025-10-02T19:28:31.051827] [INFO ] [REMOTE ] HRTG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:28:31.068506] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-02T19:28:31.473002] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-01. [2025-10-02T19:28:32.273039] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-05. [2025-10-02T19:28:32.493609] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-02T19:28:32.728112] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-02T19:28:33.073005] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-02. [2025-10-02T19:28:33.769767] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-02T19:28:33.873001] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-06. [2025-10-02T19:28:34.479629] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-02T19:28:34.673066] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-03. [2025-10-02T19:28:35.482991] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-03. [2025-10-02T19:28:35.510103] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-02T19:28:36.130141] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-02T19:28:36.273048] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-04. [2025-10-02T19:28:37.074711] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-02T19:28:37.073026] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-07. [2025-10-02T19:28:37.461766] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-02T19:28:37.872993] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-05. [2025-10-02T19:28:38.303132] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-02T19:28:38.672994] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-08. [2025-10-02T19:28:39.227953] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-02T19:28:39.472994] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2024-12. [2025-10-02T19:28:40.272981] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-04. [2025-10-02T19:28:40.365343] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-02T19:28:40.544885] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-02T19:28:41.073013] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-06. [2025-10-02T19:28:41.872997] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-01. [2025-10-02T19:28:42.093044] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-02T19:28:42.409629] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-02T19:28:42.672992] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-05. [2025-10-02T19:28:42.978420] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-02T19:28:43.472985] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-02. [2025-10-02T19:28:44.200083] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-02T19:28:44.247046] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-02T19:28:44.273004] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-07. [2025-10-02T19:28:45.073000] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-06. [2025-10-02T19:28:45.680452] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-02T19:28:45.872999] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-09. [2025-10-02T19:28:46.487089] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-02T19:28:46.672996] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-03. [2025-10-02T19:28:47.478101] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-07. [2025-10-02T19:28:47.495268] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-02T19:28:47.826134] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-02T19:28:48.272986] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-04. [2025-10-02T19:28:49.072970] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-10. [2025-10-02T19:28:49.316495] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-02T19:28:49.652955] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-02T19:28:49.873041] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-05. [2025-10-02T19:28:50.673016] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-08. [2025-10-02T19:28:51.081978] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-02T19:28:51.473009] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-06. [2025-10-02T19:28:52.002278] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-02T19:28:52.093774] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-10 (3.02 seconds). [2025-10-02T19:28:52.095308] [INFO ] [REMOTE ] HRB: Full fetch complete (69466 records). [2025-10-02T19:28:52.095413] [DEBUG] [VALIDATOR ] HRB: Validating primary data. [2025-10-02T19:28:52.096488] [FATAL] [VALIDATOR ] HRB: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:28:52.096584] [FATAL] [MAIN ] HRB: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:28:52.096631] [WARN ] [MAIN ] HRB: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:28:52.096739] [INFO ] [LOCAL ] HRB: Starting deletion of primary data. [2025-10-02T19:28:52.096823] [DEBUG] [LOCAL ] HRB: No primary data file found to delete. [2025-10-02T19:28:52.096863] [INFO ] [LOCAL ] HRB: Starting deletion of derivative data. [2025-10-02T19:28:52.096907] [DEBUG] [LOCAL ] HRB: No derivative data file found to delete. [2025-10-02T19:28:52.097037] [INFO ] [MAIN ] Update Progress: 1053/2370 symbols completed. HRB took 41.1s. Estimated remaining: 3h 6m 7s. Rate: 7.1 symbols/min [2025-10-02T19:28:52.278374] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-08. [2025-10-02T19:28:52.281257] [INFO ] [MAIN ] HSBC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:28:52.282145] [DEBUG] [LOCAL ] HSBC: No existing data file found in primary storage. [2025-10-02T19:28:52.282229] [WARN ] [MAIN ] HSBC: No existing data found, performing full refresh instead. [2025-10-02T19:28:52.282316] [INFO ] [MAIN ] HSBC: Wiping existing primary data before full refresh. [2025-10-02T19:28:52.282355] [INFO ] [LOCAL ] HSBC: Starting deletion of primary data. [2025-10-02T19:28:52.282400] [DEBUG] [LOCAL ] HSBC: No primary data file found to delete. [2025-10-02T19:28:52.282496] [INFO ] [MAIN ] HSBC: Starting full primary refresh. [2025-10-02T19:28:52.680938] [INFO ] [REMOTE ] HSBC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:28:52.702301] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-02T19:28:53.072984] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-07. [2025-10-02T19:28:53.830338] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-02T19:28:53.872965] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-09. [2025-10-02T19:28:54.438989] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-02T19:28:54.673044] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-09. [2025-10-02T19:28:55.479609] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-08. [2025-10-02T19:28:55.486513] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-02T19:28:56.054073] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-02T19:28:56.273046] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-10. [2025-10-02T19:28:56.832052] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-02T19:28:57.073008] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2024-12. [2025-10-02T19:28:57.684470] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-02T19:28:57.686192] [INFO ] [REMOTE ] HRL: Full fetch complete (76294 records). [2025-10-02T19:28:57.686330] [DEBUG] [VALIDATOR ] HRL: Validating primary data. [2025-10-02T19:28:57.687377] [FATAL] [VALIDATOR ] HRL: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:28:57.687474] [FATAL] [MAIN ] HRL: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:28:57.687539] [WARN ] [MAIN ] HRL: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:28:57.687615] [INFO ] [LOCAL ] HRL: Starting deletion of primary data. [2025-10-02T19:28:57.687715] [DEBUG] [LOCAL ] HRL: No primary data file found to delete. [2025-10-02T19:28:57.687764] [INFO ] [LOCAL ] HRL: Starting deletion of derivative data. [2025-10-02T19:28:57.687808] [DEBUG] [LOCAL ] HRL: No derivative data file found to delete. [2025-10-02T19:28:57.687881] [INFO ] [MAIN ] Update Progress: 1054/2370 symbols completed. HRL took 33.0s. Estimated remaining: 3h 5m 55s. Rate: 7.1 symbols/min [2025-10-02T19:28:57.885678] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-10. [2025-10-02T19:28:57.889619] [INFO ] [MAIN ] HSHP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:28:57.890601] [DEBUG] [LOCAL ] HSHP: No existing data file found in primary storage. [2025-10-02T19:28:57.890702] [WARN ] [MAIN ] HSHP: No existing data found, performing full refresh instead. [2025-10-02T19:28:57.890876] [INFO ] [MAIN ] HSHP: Wiping existing primary data before full refresh. [2025-10-02T19:28:57.890921] [INFO ] [LOCAL ] HSHP: Starting deletion of primary data. [2025-10-02T19:28:57.890965] [DEBUG] [LOCAL ] HSHP: No primary data file found to delete. [2025-10-02T19:28:57.890999] [INFO ] [MAIN ] HSHP: Starting full primary refresh. [2025-10-02T19:28:58.275526] [INFO ] [REMOTE ] HSHP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:28:58.673016] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2024-12. [2025-10-02T19:28:58.731546] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-02T19:28:59.472998] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-01. [2025-10-02T19:28:59.729268] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-02T19:29:00.273050] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-01. [2025-10-02T19:29:00.851837] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-10 (2.97 seconds). [2025-10-02T19:29:00.853141] [INFO ] [REMOTE ] HRI: Full fetch complete (46046 records). [2025-10-02T19:29:00.853225] [DEBUG] [VALIDATOR ] HRI: Validating primary data. [2025-10-02T19:29:00.853937] [FATAL] [VALIDATOR ] HRI: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:29:00.854026] [FATAL] [MAIN ] HRI: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:29:00.854092] [WARN ] [MAIN ] HRI: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:29:00.854185] [INFO ] [LOCAL ] HRI: Starting deletion of primary data. [2025-10-02T19:29:00.854263] [DEBUG] [LOCAL ] HRI: No primary data file found to delete. [2025-10-02T19:29:00.854303] [INFO ] [LOCAL ] HRI: Starting deletion of derivative data. [2025-10-02T19:29:00.854346] [DEBUG] [LOCAL ] HRI: No derivative data file found to delete. [2025-10-02T19:29:00.854405] [INFO ] [MAIN ] Update Progress: 1055/2370 symbols completed. HRI took 37.0s. Estimated remaining: 3h 5m 40s. Rate: 7.1 symbols/min [2025-10-02T19:29:01.059068] [INFO ] [MAIN ] HSY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:29:01.059728] [DEBUG] [LOCAL ] HSY: No existing data file found in primary storage. [2025-10-02T19:29:01.059794] [WARN ] [MAIN ] HSY: No existing data found, performing full refresh instead. [2025-10-02T19:29:01.059916] [INFO ] [MAIN ] HSY: Wiping existing primary data before full refresh. [2025-10-02T19:29:01.059970] [INFO ] [LOCAL ] HSY: Starting deletion of primary data. [2025-10-02T19:29:01.060028] [DEBUG] [LOCAL ] HSY: No primary data file found to delete. [2025-10-02T19:29:01.060088] [INFO ] [MAIN ] HSY: Starting full primary refresh. [2025-10-02T19:29:01.093576] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-09. [2025-10-02T19:29:01.282168] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-02T19:29:01.521907] [INFO ] [REMOTE ] HSY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:29:01.553235] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-02T19:29:01.873020] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-02. [2025-10-02T19:29:02.519822] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-02T19:29:02.673048] [INFO ] [REMOTE ] HSY: Fetching primary data for 2024-12. [2025-10-02T19:29:03.473037] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-02. [2025-10-02T19:29:03.725768] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-02T19:29:04.081125] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-02T19:29:04.272981] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-03. [2025-10-02T19:29:04.473798] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-02T19:29:05.072982] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-01. [2025-10-02T19:29:05.377977] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-02T19:29:05.873013] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-03. [2025-10-02T19:29:06.672973] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-10. [2025-10-02T19:29:06.711382] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-02T19:29:07.473034] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-04. [2025-10-02T19:29:07.653879] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-02T19:29:07.655631] [INFO ] [REMOTE ] HRTG: Full fetch complete (42773 records). [2025-10-02T19:29:07.655748] [DEBUG] [VALIDATOR ] HRTG: Validating primary data. [2025-10-02T19:29:07.656322] [FATAL] [VALIDATOR ] HRTG: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:29:07.656420] [FATAL] [MAIN ] HRTG: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:29:07.656464] [WARN ] [MAIN ] HRTG: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:29:07.656504] [INFO ] [LOCAL ] HRTG: Starting deletion of primary data. [2025-10-02T19:29:07.656602] [DEBUG] [LOCAL ] HRTG: No primary data file found to delete. [2025-10-02T19:29:07.656701] [INFO ] [LOCAL ] HRTG: Starting deletion of derivative data. [2025-10-02T19:29:07.656933] [DEBUG] [LOCAL ] HRTG: No derivative data file found to delete. [2025-10-02T19:29:07.657110] [INFO ] [MAIN ] Update Progress: 1056/2370 symbols completed. HRTG took 37.2s. Estimated remaining: 3h 5m 29s. Rate: 7.1 symbols/min [2025-10-02T19:29:07.847168] [INFO ] [MAIN ] HTB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:29:07.847466] [DEBUG] [LOCAL ] HTB: No existing data file found in primary storage. [2025-10-02T19:29:07.847538] [WARN ] [MAIN ] HTB: No existing data found, performing full refresh instead. [2025-10-02T19:29:07.847804] [INFO ] [MAIN ] HTB: Wiping existing primary data before full refresh. [2025-10-02T19:29:07.847866] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-02T19:29:07.847928] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-02T19:29:07.848074] [INFO ] [MAIN ] HTB: Starting full primary refresh. [2025-10-02T19:29:08.091192] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-02T19:29:08.280387] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-04. [2025-10-02T19:29:08.326718] [INFO ] [REMOTE ] HTB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:29:08.499068] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-02T19:29:09.073006] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-05. [2025-10-02T19:29:09.718703] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-02T19:29:09.873054] [INFO ] [REMOTE ] HTB: Fetching primary data for 2024-12. [2025-10-02T19:29:10.073478] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T19:29:10.074704] [WARN ] [REMOTE ] HTB: No data returned for month 2024-12 [2025-10-02T19:29:10.074826] [FATAL] [REMOTE ] HTB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T19:29:10.074875] [FATAL] [MAIN ] HTB: Failed to fetch primary data. [2025-10-02T19:29:10.074910] [WARN ] [MAIN ] HTB: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T19:29:10.074949] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-02T19:29:10.075021] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-02T19:29:10.075103] [INFO ] [LOCAL ] HTB: Starting deletion of derivative data. [2025-10-02T19:29:10.075209] [DEBUG] [LOCAL ] HTB: No derivative data file found to delete. [2025-10-02T19:29:10.075491] [INFO ] [MAIN ] Update Progress: 1057/2370 symbols completed. HTB took 2.4s. Estimated remaining: 3h 5m 13s. Rate: 7.1 symbols/min [2025-10-02T19:29:10.266199] [INFO ] [MAIN ] HTD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:29:10.266447] [DEBUG] [LOCAL ] HTD: No existing data file found in primary storage. [2025-10-02T19:29:10.266505] [WARN ] [MAIN ] HTD: No existing data found, performing full refresh instead. [2025-10-02T19:29:10.266665] [INFO ] [MAIN ] HTD: Wiping existing primary data before full refresh. [2025-10-02T19:29:10.266740] [INFO ] [LOCAL ] HTD: Starting deletion of primary data. [2025-10-02T19:29:10.266806] [DEBUG] [LOCAL ] HTD: No primary data file found to delete. [2025-10-02T19:29:10.266843] [INFO ] [MAIN ] HTD: Starting full primary refresh. [2025-10-02T19:29:10.654930] [INFO ] [REMOTE ] HTD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:29:10.681832] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-06. [2025-10-02T19:29:10.687839] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-10-02T19:29:11.472972] [INFO ] [REMOTE ] HTD: Fetching primary data for 2024-12. [2025-10-02T19:29:11.690911] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-02T19:29:12.273001] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-05. [2025-10-02T19:29:12.361614] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-02T19:29:13.073011] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-07. [2025-10-02T19:29:13.872979] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-01. [2025-10-02T19:29:14.198443] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-02T19:29:14.199145] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-02T19:29:14.673052] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-08. [2025-10-02T19:29:14.761774] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-02T19:29:15.472994] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-06. [2025-10-02T19:29:15.500519] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-02T19:29:16.273043] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-02. [2025-10-02T19:29:16.871881] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-02T19:29:17.072994] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-03. [2025-10-02T19:29:17.381303] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-02T19:29:17.873049] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-09. [2025-10-02T19:29:18.003428] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-02T19:29:18.638020] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-02T19:29:18.673009] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-04. [2025-10-02T19:29:19.473011] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-02. [2025-10-02T19:29:19.576397] [DEBUG] [REMOTE ] HSY: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-10-02T19:29:19.576763] [WARN ] [REMOTE ] HSY: No data returned for month 2025-02 [2025-10-02T19:29:19.576876] [FATAL] [REMOTE ] HSY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T19:29:19.576965] [FATAL] [MAIN ] HSY: Failed to fetch primary data. [2025-10-02T19:29:19.577028] [WARN ] [MAIN ] HSY: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T19:29:19.577103] [INFO ] [LOCAL ] HSY: Starting deletion of primary data. [2025-10-02T19:29:19.577167] [DEBUG] [LOCAL ] HSY: No primary data file found to delete. [2025-10-02T19:29:19.577205] [INFO ] [LOCAL ] HSY: Starting deletion of derivative data. [2025-10-02T19:29:19.577302] [DEBUG] [LOCAL ] HSY: No derivative data file found to delete. [2025-10-02T19:29:19.577369] [INFO ] [MAIN ] Update Progress: 1058/2370 symbols completed. HSY took 18.7s. Estimated remaining: 3h 5m 6s. Rate: 7.1 symbols/min [2025-10-02T19:29:19.839318] [INFO ] [MAIN ] HTFC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:29:19.835609] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-02T19:29:19.843046] [DEBUG] [LOCAL ] HTFC: No existing data file found in primary storage. [2025-10-02T19:29:19.843148] [WARN ] [MAIN ] HTFC: No existing data found, performing full refresh instead. [2025-10-02T19:29:19.843764] [INFO ] [MAIN ] HTFC: Wiping existing primary data before full refresh. [2025-10-02T19:29:19.843855] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-02T19:29:19.843909] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-02T19:29:19.843944] [INFO ] [MAIN ] HTFC: Starting full primary refresh. [2025-10-02T19:29:20.242539] [INFO ] [REMOTE ] HTFC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:29:20.272996] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-05. [2025-10-02T19:29:21.009544] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-02T19:29:21.072979] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-10. [2025-10-02T19:29:21.873845] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-02T19:29:21.873599] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-06. [2025-10-02T19:29:21.876094] [INFO ] [REMOTE ] HSHP: Full fetch complete (23269 records). [2025-10-02T19:29:21.876203] [DEBUG] [VALIDATOR ] HSHP: Validating primary data. [2025-10-02T19:29:21.876930] [FATAL] [VALIDATOR ] HSHP: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:29:21.877039] [FATAL] [MAIN ] HSHP: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:29:21.877127] [WARN ] [MAIN ] HSHP: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:29:21.877225] [INFO ] [LOCAL ] HSHP: Starting deletion of primary data. [2025-10-02T19:29:21.877455] [DEBUG] [LOCAL ] HSHP: No primary data file found to delete. [2025-10-02T19:29:21.877583] [INFO ] [LOCAL ] HSHP: Starting deletion of derivative data. [2025-10-02T19:29:21.877696] [DEBUG] [LOCAL ] HSHP: No derivative data file found to delete. [2025-10-02T19:29:21.877804] [INFO ] [MAIN ] Update Progress: 1059/2370 symbols completed. HSHP took 24.2s. Estimated remaining: 3h 4m 50s. Rate: 7.1 symbols/min [2025-10-02T19:29:22.061117] [INFO ] [MAIN ] HTGC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:29:22.061279] [DEBUG] [LOCAL ] HTGC: No existing data file found in primary storage. [2025-10-02T19:29:22.061319] [WARN ] [MAIN ] HTGC: No existing data found, performing full refresh instead. [2025-10-02T19:29:22.061434] [INFO ] [MAIN ] HTGC: Wiping existing primary data before full refresh. [2025-10-02T19:29:22.061476] [INFO ] [LOCAL ] HTGC: Starting deletion of primary data. [2025-10-02T19:29:22.061518] [DEBUG] [LOCAL ] HTGC: No primary data file found to delete. [2025-10-02T19:29:22.061551] [INFO ] [MAIN ] HTGC: Starting full primary refresh. [2025-10-02T19:29:22.448811] [INFO ] [REMOTE ] HTGC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:29:22.457365] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-02T19:29:22.673020] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2024-12. [2025-10-02T19:29:22.991966] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2024-12 (0.32 seconds). [2025-10-02T19:29:23.472990] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-07. [2025-10-02T19:29:24.273018] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2024-12. [2025-10-02T19:29:25.072979] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-01. [2025-10-02T19:29:25.407513] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-02T19:29:25.449674] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-02T19:29:25.843915] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-02T19:29:25.872970] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-01. [2025-10-02T19:29:26.673024] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-08. [2025-10-02T19:29:27.472974] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-02. [2025-10-02T19:29:27.514351] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-02T19:29:27.832553] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-02T19:29:28.159416] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-02T19:29:28.273009] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-09. [2025-10-02T19:29:29.073034] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-02. [2025-10-02T19:29:29.872981] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-07. [2025-10-02T19:29:30.134938] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-02T19:29:30.612448] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-02T19:29:30.645486] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-02T19:29:30.672962] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-03. [2025-10-02T19:29:31.473000] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-10. [2025-10-02T19:29:32.272986] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-08. [2025-10-02T19:29:32.510621] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-02T19:29:32.755327] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-02T19:29:32.757137] [INFO ] [REMOTE ] HSBC: Full fetch complete (73368 records). [2025-10-02T19:29:32.757263] [DEBUG] [VALIDATOR ] HSBC: Validating primary data. [2025-10-02T19:29:32.758480] [FATAL] [VALIDATOR ] HSBC: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:29:32.758691] [FATAL] [MAIN ] HSBC: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:29:32.758776] [WARN ] [MAIN ] HSBC: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:29:32.758873] [INFO ] [LOCAL ] HSBC: Starting deletion of primary data. [2025-10-02T19:29:32.758972] [DEBUG] [LOCAL ] HSBC: No primary data file found to delete. [2025-10-02T19:29:32.759020] [INFO ] [LOCAL ] HSBC: Starting deletion of derivative data. [2025-10-02T19:29:32.759065] [DEBUG] [LOCAL ] HSBC: No derivative data file found to delete. [2025-10-02T19:29:32.759185] [INFO ] [MAIN ] Update Progress: 1060/2370 symbols completed. HSBC took 40.7s. Estimated remaining: 3h 4m 44s. Rate: 7.1 symbols/min [2025-10-02T19:29:32.962965] [INFO ] [MAIN ] HTH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:29:32.963127] [DEBUG] [LOCAL ] HTH: No existing data file found in primary storage. [2025-10-02T19:29:32.963165] [WARN ] [MAIN ] HTH: No existing data found, performing full refresh instead. [2025-10-02T19:29:32.963275] [INFO ] [MAIN ] HTH: Wiping existing primary data before full refresh. [2025-10-02T19:29:32.963317] [INFO ] [LOCAL ] HTH: Starting deletion of primary data. [2025-10-02T19:29:32.963358] [DEBUG] [LOCAL ] HTH: No primary data file found to delete. [2025-10-02T19:29:32.963412] [INFO ] [MAIN ] HTH: Starting full primary refresh. [2025-10-02T19:29:33.075523] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-03. [2025-10-02T19:29:33.249492] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-02T19:29:33.380189] [INFO ] [REMOTE ] HTH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:29:33.442260] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-02T19:29:33.873006] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-09. [2025-10-02T19:29:34.673008] [INFO ] [REMOTE ] HTH: Fetching primary data for 2024-12. [2025-10-02T19:29:34.799063] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-02T19:29:35.473009] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-10. [2025-10-02T19:29:35.825564] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-02T19:29:36.160096] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-02T19:29:36.161213] [INFO ] [REMOTE ] HTD: Full fetch complete (18970 records). [2025-10-02T19:29:36.161289] [DEBUG] [VALIDATOR ] HTD: Validating primary data. [2025-10-02T19:29:36.161809] [FATAL] [VALIDATOR ] HTD: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:29:36.161920] [FATAL] [MAIN ] HTD: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:29:36.162001] [WARN ] [MAIN ] HTD: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:29:36.162104] [INFO ] [LOCAL ] HTD: Starting deletion of primary data. [2025-10-02T19:29:36.162183] [DEBUG] [LOCAL ] HTD: No primary data file found to delete. [2025-10-02T19:29:36.162244] [INFO ] [LOCAL ] HTD: Starting deletion of derivative data. [2025-10-02T19:29:36.162305] [DEBUG] [LOCAL ] HTD: No derivative data file found to delete. [2025-10-02T19:29:36.162365] [INFO ] [MAIN ] Update Progress: 1061/2370 symbols completed. HTD took 26.1s. Estimated remaining: 3h 4m 30s. Rate: 7.1 symbols/min [2025-10-02T19:29:36.278271] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-04. [2025-10-02T19:29:36.368283] [INFO ] [MAIN ] HUBB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:29:36.368502] [DEBUG] [LOCAL ] HUBB: No existing data file found in primary storage. [2025-10-02T19:29:36.368559] [WARN ] [MAIN ] HUBB: No existing data found, performing full refresh instead. [2025-10-02T19:29:36.368637] [INFO ] [MAIN ] HUBB: Wiping existing primary data before full refresh. [2025-10-02T19:29:36.368717] [INFO ] [LOCAL ] HUBB: Starting deletion of primary data. [2025-10-02T19:29:36.368769] [DEBUG] [LOCAL ] HUBB: No primary data file found to delete. [2025-10-02T19:29:36.368806] [INFO ] [MAIN ] HUBB: Starting full primary refresh. [2025-10-02T19:29:36.766878] [INFO ] [REMOTE ] HUBB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:29:37.072998] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-01. [2025-10-02T19:29:37.873027] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-04. [2025-10-02T19:29:37.921079] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-02T19:29:38.136164] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-02T19:29:38.281518] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-02T19:29:38.673028] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-05. [2025-10-02T19:29:38.895967] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-05 (0.22 seconds). [2025-10-02T19:29:39.472992] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-06. [2025-10-02T19:29:39.709394] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-10-02T19:29:40.272995] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-07. [2025-10-02T19:29:40.502203] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-10-02T19:29:41.073003] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2024-12. [2025-10-02T19:29:41.872988] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-05. [2025-10-02T19:29:42.385847] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-02T19:29:42.673006] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-01. [2025-10-02T19:29:43.472991] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-02. [2025-10-02T19:29:43.574153] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-02T19:29:44.284923] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-08. [2025-10-02T19:29:44.311841] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-02T19:29:44.518499] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-08 (0.23 seconds). [2025-10-02T19:29:44.593273] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-02T19:29:45.072997] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-09. [2025-10-02T19:29:45.306452] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-09 (0.23 seconds). [2025-10-02T19:29:45.872993] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-10. [2025-10-02T19:29:46.672999] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-06. [2025-10-02T19:29:47.472977] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-03. [2025-10-02T19:29:48.108754] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-10 (2.24 seconds). [2025-10-02T19:29:48.109407] [INFO ] [REMOTE ] HTFC: Full fetch complete (833 records). [2025-10-02T19:29:48.109477] [DEBUG] [VALIDATOR ] HTFC: Validating primary data. [2025-10-02T19:29:48.109871] [FATAL] [VALIDATOR ] HTFC: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:29:48.109960] [FATAL] [MAIN ] HTFC: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:29:48.110004] [WARN ] [MAIN ] HTFC: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:29:48.110076] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-02T19:29:48.110138] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-02T19:29:48.110174] [INFO ] [LOCAL ] HTFC: Starting deletion of derivative data. [2025-10-02T19:29:48.110241] [DEBUG] [LOCAL ] HTFC: No derivative data file found to delete. [2025-10-02T19:29:48.110332] [INFO ] [MAIN ] Update Progress: 1062/2370 symbols completed. HTFC took 28.5s. Estimated remaining: 3h 4m 25s. Rate: 7.1 symbols/min [2025-10-02T19:29:48.277774] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-02. [2025-10-02T19:29:48.306596] [INFO ] [MAIN ] HUBS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:29:48.307728] [DEBUG] [LOCAL ] HUBS: No existing data file found in primary storage. [2025-10-02T19:29:48.307872] [WARN ] [MAIN ] HUBS: No existing data found, performing full refresh instead. [2025-10-02T19:29:48.307998] [INFO ] [MAIN ] HUBS: Wiping existing primary data before full refresh. [2025-10-02T19:29:48.308063] [INFO ] [LOCAL ] HUBS: Starting deletion of primary data. [2025-10-02T19:29:48.308110] [DEBUG] [LOCAL ] HUBS: No primary data file found to delete. [2025-10-02T19:29:48.308377] [INFO ] [MAIN ] HUBS: Starting full primary refresh. [2025-10-02T19:29:48.457970] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-02T19:29:48.767292] [INFO ] [REMOTE ] HUBS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:29:48.787370] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-02T19:29:49.073053] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2024-12. [2025-10-02T19:29:49.873053] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-04. [2025-10-02T19:29:50.464597] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-02T19:29:50.563200] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-10-02T19:29:50.672987] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-03. [2025-10-02T19:29:51.276753] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-02T19:29:51.473001] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-07. [2025-10-02T19:29:52.273031] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-05. [2025-10-02T19:29:52.331628] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-02T19:29:52.843701] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-02T19:29:53.073000] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-01. [2025-10-02T19:29:53.740820] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-02T19:29:53.873020] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-06. [2025-10-02T19:29:54.210375] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-02T19:29:54.673029] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-08. [2025-10-02T19:29:55.169908] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-02T19:29:55.473043] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-02. [2025-10-02T19:29:56.272987] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-07. [2025-10-02T19:29:56.431062] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-02T19:29:56.932946] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-02T19:29:57.073023] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-03. [2025-10-02T19:29:57.609165] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-02T19:29:57.872996] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-09. [2025-10-02T19:29:58.255013] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-02T19:29:58.673016] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-08. [2025-10-02T19:29:59.478007] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-04. [2025-10-02T19:29:59.483458] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-02T19:30:00.270595] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-02T19:30:00.279802] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-10. [2025-10-02T19:30:00.817198] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-02T19:30:01.072991] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-09. [2025-10-02T19:30:01.470950] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-02T19:30:01.473111] [INFO ] [REMOTE ] HTGC: Full fetch complete (67885 records). [2025-10-02T19:30:01.473436] [DEBUG] [VALIDATOR ] HTGC: Validating primary data. [2025-10-02T19:30:01.474242] [FATAL] [VALIDATOR ] HTGC: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:30:01.474343] [FATAL] [MAIN ] HTGC: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:30:01.474392] [WARN ] [MAIN ] HTGC: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:30:01.474437] [INFO ] [LOCAL ] HTGC: Starting deletion of primary data. [2025-10-02T19:30:01.474541] [DEBUG] [LOCAL ] HTGC: No primary data file found to delete. [2025-10-02T19:30:01.474595] [INFO ] [LOCAL ] HTGC: Starting deletion of derivative data. [2025-10-02T19:30:01.474671] [DEBUG] [LOCAL ] HTGC: No derivative data file found to delete. [2025-10-02T19:30:01.474771] [INFO ] [MAIN ] Update Progress: 1063/2370 symbols completed. HTGC took 39.6s. Estimated remaining: 3h 4m 23s. Rate: 7.1 symbols/min [2025-10-02T19:30:01.681509] [INFO ] [MAIN ] HUM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:30:01.681701] [DEBUG] [LOCAL ] HUM: No existing data file found in primary storage. [2025-10-02T19:30:01.681755] [WARN ] [MAIN ] HUM: No existing data found, performing full refresh instead. [2025-10-02T19:30:01.681871] [INFO ] [MAIN ] HUM: Wiping existing primary data before full refresh. [2025-10-02T19:30:01.681916] [INFO ] [LOCAL ] HUM: Starting deletion of primary data. [2025-10-02T19:30:01.681960] [DEBUG] [LOCAL ] HUM: No primary data file found to delete. [2025-10-02T19:30:01.681996] [INFO ] [MAIN ] HUM: Starting full primary refresh. [2025-10-02T19:30:01.878118] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-04. [2025-10-02T19:30:02.184452] [INFO ] [REMOTE ] HUM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:30:02.218787] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-02T19:30:02.673060] [INFO ] [REMOTE ] HUM: Fetching primary data for 2024-12. [2025-10-02T19:30:03.473031] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-05. [2025-10-02T19:30:03.620758] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-02T19:30:04.272980] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-10. [2025-10-02T19:30:04.646156] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-02T19:30:05.038510] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-02T19:30:05.072988] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-01. [2025-10-02T19:30:05.873004] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-05. [2025-10-02T19:30:06.673020] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-06. [2025-10-02T19:30:06.844221] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-02T19:30:07.211380] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-10 (2.94 seconds). [2025-10-02T19:30:07.212698] [INFO ] [REMOTE ] HTH: Full fetch complete (46521 records). [2025-10-02T19:30:07.212798] [DEBUG] [VALIDATOR ] HTH: Validating primary data. [2025-10-02T19:30:07.213453] [FATAL] [VALIDATOR ] HTH: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:30:07.213543] [FATAL] [MAIN ] HTH: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:30:07.213588] [WARN ] [MAIN ] HTH: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:30:07.213630] [INFO ] [LOCAL ] HTH: Starting deletion of primary data. [2025-10-02T19:30:07.213782] [DEBUG] [LOCAL ] HTH: No primary data file found to delete. [2025-10-02T19:30:07.213835] [INFO ] [LOCAL ] HTH: Starting deletion of derivative data. [2025-10-02T19:30:07.213881] [DEBUG] [LOCAL ] HTH: No derivative data file found to delete. [2025-10-02T19:30:07.213969] [INFO ] [MAIN ] Update Progress: 1064/2370 symbols completed. HTH took 34.5s. Estimated remaining: 3h 4m 11s. Rate: 7.1 symbols/min [2025-10-02T19:30:07.420957] [INFO ] [MAIN ] HUN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:30:07.421185] [DEBUG] [LOCAL ] HUN: No existing data file found in primary storage. [2025-10-02T19:30:07.421250] [WARN ] [MAIN ] HUN: No existing data found, performing full refresh instead. [2025-10-02T19:30:07.421494] [INFO ] [MAIN ] HUN: Wiping existing primary data before full refresh. [2025-10-02T19:30:07.421569] [INFO ] [LOCAL ] HUN: Starting deletion of primary data. [2025-10-02T19:30:07.421713] [DEBUG] [LOCAL ] HUN: No primary data file found to delete. [2025-10-02T19:30:07.421788] [INFO ] [MAIN ] HUN: Starting full primary refresh. [2025-10-02T19:30:07.483097] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-02. [2025-10-02T19:30:07.700584] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-02T19:30:07.903555] [INFO ] [REMOTE ] HUN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:30:07.927121] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-02T19:30:08.273007] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-06. [2025-10-02T19:30:08.975841] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-02T19:30:09.073053] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-07. [2025-10-02T19:30:09.712194] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-02T19:30:09.873019] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-03. [2025-10-02T19:30:10.649808] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-02T19:30:10.672955] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-08. [2025-10-02T19:30:11.472956] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-07. [2025-10-02T19:30:11.611407] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-02T19:30:12.099679] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-02T19:30:12.273043] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-09. [2025-10-02T19:30:13.053174] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-02T19:30:13.073002] [INFO ] [REMOTE ] HUN: Fetching primary data for 2024-12. [2025-10-02T19:30:13.792207] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-02T19:30:13.873011] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-08. [2025-10-02T19:30:14.450915] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-02T19:30:14.673041] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-04. [2025-10-02T19:30:15.473065] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-10. [2025-10-02T19:30:15.516834] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-02T19:30:16.273018] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-01. [2025-10-02T19:30:16.568225] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-02T19:30:16.589137] [INFO ] [REMOTE ] HUBB: Full fetch complete (53451 records). [2025-10-02T19:30:16.608121] [DEBUG] [VALIDATOR ] HUBB: Validating primary data. [2025-10-02T19:30:16.609934] [FATAL] [VALIDATOR ] HUBB: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:30:16.613721] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-02T19:30:16.617936] [FATAL] [MAIN ] HUBB: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:30:16.625074] [WARN ] [MAIN ] HUBB: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:30:16.625359] [INFO ] [LOCAL ] HUBB: Starting deletion of primary data. [2025-10-02T19:30:16.625446] [DEBUG] [LOCAL ] HUBB: No primary data file found to delete. [2025-10-02T19:30:16.625488] [INFO ] [LOCAL ] HUBB: Starting deletion of derivative data. [2025-10-02T19:30:16.626134] [DEBUG] [LOCAL ] HUBB: No derivative data file found to delete. [2025-10-02T19:30:16.626432] [INFO ] [MAIN ] Update Progress: 1065/2370 symbols completed. HUBB took 40.5s. Estimated remaining: 3h 4m 4s. Rate: 7.1 symbols/min [2025-10-02T19:30:16.843499] [INFO ] [MAIN ] HUYA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:30:16.843742] [DEBUG] [LOCAL ] HUYA: No existing data file found in primary storage. [2025-10-02T19:30:16.843798] [WARN ] [MAIN ] HUYA: No existing data found, performing full refresh instead. [2025-10-02T19:30:16.843952] [INFO ] [MAIN ] HUYA: Wiping existing primary data before full refresh. [2025-10-02T19:30:16.844027] [INFO ] [LOCAL ] HUYA: Starting deletion of primary data. [2025-10-02T19:30:16.844089] [DEBUG] [LOCAL ] HUYA: No primary data file found to delete. [2025-10-02T19:30:16.844125] [INFO ] [MAIN ] HUYA: Starting full primary refresh. [2025-10-02T19:30:17.078318] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-09. [2025-10-02T19:30:17.247276] [INFO ] [REMOTE ] HUYA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:30:17.873025] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-05. [2025-10-02T19:30:17.973045] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-02T19:30:18.394131] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-02T19:30:18.673036] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2024-12. [2025-10-02T19:30:19.473064] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-10. [2025-10-02T19:30:19.779178] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-02T19:30:20.212875] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-02T19:30:20.273010] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-01. [2025-10-02T19:30:21.073053] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-06. [2025-10-02T19:30:21.764508] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-02T19:30:21.873072] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-02. [2025-10-02T19:30:22.444134] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-02T19:30:22.673031] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-07. [2025-10-02T19:30:22.690153] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-10 (3.22 seconds). [2025-10-02T19:30:22.692319] [INFO ] [REMOTE ] HUBS: Full fetch complete (55284 records). [2025-10-02T19:30:22.692478] [DEBUG] [VALIDATOR ] HUBS: Validating primary data. [2025-10-02T19:30:22.693448] [FATAL] [VALIDATOR ] HUBS: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:30:22.693558] [FATAL] [MAIN ] HUBS: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:30:22.693631] [WARN ] [MAIN ] HUBS: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:30:22.693755] [INFO ] [LOCAL ] HUBS: Starting deletion of primary data. [2025-10-02T19:30:22.693842] [DEBUG] [LOCAL ] HUBS: No primary data file found to delete. [2025-10-02T19:30:22.693883] [INFO ] [LOCAL ] HUBS: Starting deletion of derivative data. [2025-10-02T19:30:22.693926] [DEBUG] [LOCAL ] HUBS: No derivative data file found to delete. [2025-10-02T19:30:22.693999] [INFO ] [MAIN ] Update Progress: 1066/2370 symbols completed. HUBS took 34.6s. Estimated remaining: 3h 3m 52s. Rate: 7.1 symbols/min [2025-10-02T19:30:22.878535] [INFO ] [MAIN ] HVT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:30:22.878856] [DEBUG] [LOCAL ] HVT: No existing data file found in primary storage. [2025-10-02T19:30:22.878904] [WARN ] [MAIN ] HVT: No existing data found, performing full refresh instead. [2025-10-02T19:30:22.879044] [INFO ] [MAIN ] HVT: Wiping existing primary data before full refresh. [2025-10-02T19:30:22.879122] [INFO ] [LOCAL ] HVT: Starting deletion of primary data. [2025-10-02T19:30:22.879167] [DEBUG] [LOCAL ] HVT: No primary data file found to delete. [2025-10-02T19:30:22.879202] [INFO ] [MAIN ] HVT: Starting full primary refresh. [2025-10-02T19:30:23.297895] [INFO ] [REMOTE ] HVT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:30:23.473078] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-02. [2025-10-02T19:30:23.564760] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-02T19:30:24.273017] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-03. [2025-10-02T19:30:24.680503] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-02T19:30:24.898791] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-02T19:30:25.073008] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-03. [2025-10-02T19:30:25.873067] [INFO ] [REMOTE ] HVT: Fetching primary data for 2024-12. [2025-10-02T19:30:26.091978] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-02T19:30:26.673123] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-08. [2025-10-02T19:30:26.818238] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-02T19:30:26.878925] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-02T19:30:27.473040] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-04. [2025-10-02T19:30:28.191095] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-02T19:30:28.273051] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-04. [2025-10-02T19:30:28.613824] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-02T19:30:29.073010] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-01. [2025-10-02T19:30:29.726035] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-02T19:30:29.872989] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-09. [2025-10-02T19:30:30.100587] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-02T19:30:30.673053] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-05. [2025-10-02T19:30:31.472957] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-05. [2025-10-02T19:30:31.671434] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-02T19:30:32.273020] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-10. [2025-10-02T19:30:32.409392] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-02T19:30:32.948996] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-02T19:30:33.073008] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-06. [2025-10-02T19:30:33.609806] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-02T19:30:33.611381] [INFO ] [REMOTE ] HUM: Full fetch complete (70613 records). [2025-10-02T19:30:33.611484] [DEBUG] [VALIDATOR ] HUM: Validating primary data. [2025-10-02T19:30:33.612591] [FATAL] [VALIDATOR ] HUM: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:30:33.612834] [FATAL] [MAIN ] HUM: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:30:33.612905] [WARN ] [MAIN ] HUM: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:30:33.612981] [INFO ] [LOCAL ] HUM: Starting deletion of primary data. [2025-10-02T19:30:33.613049] [DEBUG] [LOCAL ] HUM: No primary data file found to delete. [2025-10-02T19:30:33.613129] [INFO ] [LOCAL ] HUM: Starting deletion of derivative data. [2025-10-02T19:30:33.613183] [DEBUG] [LOCAL ] HUM: No derivative data file found to delete. [2025-10-02T19:30:33.613291] [INFO ] [MAIN ] Update Progress: 1067/2370 symbols completed. HUM took 32.1s. Estimated remaining: 3h 3m 47s. Rate: 7.1 symbols/min [2025-10-02T19:30:33.805312] [INFO ] [MAIN ] HWM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:30:33.805523] [DEBUG] [LOCAL ] HWM: No existing data file found in primary storage. [2025-10-02T19:30:33.805579] [WARN ] [MAIN ] HWM: No existing data found, performing full refresh instead. [2025-10-02T19:30:33.805728] [INFO ] [MAIN ] HWM: Wiping existing primary data before full refresh. [2025-10-02T19:30:33.805778] [INFO ] [LOCAL ] HWM: Starting deletion of primary data. [2025-10-02T19:30:33.805821] [DEBUG] [LOCAL ] HWM: No primary data file found to delete. [2025-10-02T19:30:33.805855] [INFO ] [MAIN ] HWM: Starting full primary refresh. [2025-10-02T19:30:33.878350] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-02. [2025-10-02T19:30:34.233620] [INFO ] [REMOTE ] HWM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:30:34.653825] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-02T19:30:34.672975] [INFO ] [REMOTE ] HWM: Fetching primary data for 2024-12. [2025-10-02T19:30:34.689036] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-02T19:30:35.473008] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-07. [2025-10-02T19:30:36.273040] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-06. [2025-10-02T19:30:36.679917] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-02T19:30:37.073049] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-01. [2025-10-02T19:30:37.211083] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-02T19:30:37.572252] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-02T19:30:37.873011] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-03. [2025-10-02T19:30:38.673017] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-08. [2025-10-02T19:30:38.693825] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-02T19:30:39.036950] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-02T19:30:39.473000] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-02. [2025-10-02T19:30:40.182821] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-02T19:30:40.272974] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-07. [2025-10-02T19:30:41.072998] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-04. [2025-10-02T19:30:41.303858] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-02T19:30:41.783860] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-02T19:30:41.872965] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-08. [2025-10-02T19:30:42.187959] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-02T19:30:42.672996] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-03. [2025-10-02T19:30:43.472998] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-09. [2025-10-02T19:30:43.679023] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-02T19:30:44.272961] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-09. [2025-10-02T19:30:44.486025] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-02T19:30:45.080976] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-05. [2025-10-02T19:30:45.088840] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-02T19:30:45.698015] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-02T19:30:45.795759] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-02T19:30:45.873008] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-06. [2025-10-02T19:30:46.673003] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-10. [2025-10-02T19:30:46.774173] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-02T19:30:47.473040] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-04. [2025-10-02T19:30:47.804155] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-02T19:30:47.805668] [INFO ] [REMOTE ] HUYA: Full fetch complete (63286 records). [2025-10-02T19:30:47.805782] [DEBUG] [VALIDATOR ] HUYA: Validating primary data. [2025-10-02T19:30:47.806533] [FATAL] [VALIDATOR ] HUYA: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:30:47.806633] [FATAL] [MAIN ] HUYA: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:30:47.806720] [WARN ] [MAIN ] HUYA: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:30:47.806768] [INFO ] [LOCAL ] HUYA: Starting deletion of primary data. [2025-10-02T19:30:47.806826] [DEBUG] [LOCAL ] HUYA: No primary data file found to delete. [2025-10-02T19:30:47.806862] [INFO ] [LOCAL ] HUYA: Starting deletion of derivative data. [2025-10-02T19:30:47.806902] [DEBUG] [LOCAL ] HUYA: No derivative data file found to delete. [2025-10-02T19:30:47.807025] [INFO ] [MAIN ] Update Progress: 1068/2370 symbols completed. HUYA took 31.2s. Estimated remaining: 3h 3m 46s. Rate: 7.1 symbols/min [2025-10-02T19:30:47.989663] [INFO ] [MAIN ] HXL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:30:47.989879] [DEBUG] [LOCAL ] HXL: No existing data file found in primary storage. [2025-10-02T19:30:47.989935] [WARN ] [MAIN ] HXL: No existing data found, performing full refresh instead. [2025-10-02T19:30:47.990052] [INFO ] [MAIN ] HXL: Wiping existing primary data before full refresh. [2025-10-02T19:30:47.990095] [INFO ] [LOCAL ] HXL: Starting deletion of primary data. [2025-10-02T19:30:47.990138] [DEBUG] [LOCAL ] HXL: No primary data file found to delete. [2025-10-02T19:30:47.990171] [INFO ] [MAIN ] HXL: Starting full primary refresh. [2025-10-02T19:30:48.278145] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-10. [2025-10-02T19:30:48.373354] [INFO ] [REMOTE ] HXL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:30:49.073011] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-07. [2025-10-02T19:30:49.117562] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-02T19:30:49.641319] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-02T19:30:49.642980] [INFO ] [REMOTE ] HUN: Full fetch complete (76304 records). [2025-10-02T19:30:49.643095] [DEBUG] [VALIDATOR ] HUN: Validating primary data. [2025-10-02T19:30:49.643958] [FATAL] [VALIDATOR ] HUN: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:30:49.644049] [FATAL] [MAIN ] HUN: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:30:49.644095] [WARN ] [MAIN ] HUN: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:30:49.644138] [INFO ] [LOCAL ] HUN: Starting deletion of primary data. [2025-10-02T19:30:49.644233] [DEBUG] [LOCAL ] HUN: No primary data file found to delete. [2025-10-02T19:30:49.644290] [INFO ] [LOCAL ] HUN: Starting deletion of derivative data. [2025-10-02T19:30:49.644350] [DEBUG] [LOCAL ] HUN: No derivative data file found to delete. [2025-10-02T19:30:49.644432] [INFO ] [MAIN ] Update Progress: 1069/2370 symbols completed. HUN took 42.4s. Estimated remaining: 3h 3m 29s. Rate: 7.1 symbols/min [2025-10-02T19:30:49.845720] [INFO ] [MAIN ] HY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:30:49.846025] [DEBUG] [LOCAL ] HY: No existing data file found in primary storage. [2025-10-02T19:30:49.846117] [WARN ] [MAIN ] HY: No existing data found, performing full refresh instead. [2025-10-02T19:30:49.846207] [INFO ] [MAIN ] HY: Wiping existing primary data before full refresh. [2025-10-02T19:30:49.846247] [INFO ] [LOCAL ] HY: Starting deletion of primary data. [2025-10-02T19:30:49.846292] [DEBUG] [LOCAL ] HY: No primary data file found to delete. [2025-10-02T19:30:49.846327] [INFO ] [MAIN ] HY: Starting full primary refresh. [2025-10-02T19:30:49.880727] [INFO ] [REMOTE ] HXL: Fetching primary data for 2024-12. [2025-10-02T19:30:50.176914] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-02T19:30:50.270446] [INFO ] [REMOTE ] HY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:30:50.673050] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-08. [2025-10-02T19:30:51.338854] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-02T19:30:51.467870] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-02T19:30:51.476210] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-05. [2025-10-02T19:30:52.273012] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-09. [2025-10-02T19:30:53.073009] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-01. [2025-10-02T19:30:53.157093] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-02T19:30:53.179098] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-02T19:30:53.873007] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-10. [2025-10-02T19:30:54.475825] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-02T19:30:54.476837] [INFO ] [REMOTE ] HVT: Full fetch complete (23337 records). [2025-10-02T19:30:54.476913] [DEBUG] [VALIDATOR ] HVT: Validating primary data. [2025-10-02T19:30:54.477542] [FATAL] [VALIDATOR ] HVT: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:30:54.477699] [FATAL] [MAIN ] HVT: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:30:54.477772] [WARN ] [MAIN ] HVT: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:30:54.477861] [INFO ] [LOCAL ] HVT: Starting deletion of primary data. [2025-10-02T19:30:54.477958] [DEBUG] [LOCAL ] HVT: No primary data file found to delete. [2025-10-02T19:30:54.478026] [INFO ] [LOCAL ] HVT: Starting deletion of derivative data. [2025-10-02T19:30:54.478118] [DEBUG] [LOCAL ] HVT: No derivative data file found to delete. [2025-10-02T19:30:54.478259] [INFO ] [MAIN ] Update Progress: 1070/2370 symbols completed. HVT took 31.8s. Estimated remaining: 3h 3m 16s. Rate: 7.1 symbols/min [2025-10-02T19:30:54.669262] [INFO ] [MAIN ] HYAC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:30:54.669480] [DEBUG] [LOCAL ] HYAC: No existing data file found in primary storage. [2025-10-02T19:30:54.669556] [WARN ] [MAIN ] HYAC: No existing data found, performing full refresh instead. [2025-10-02T19:30:54.669755] [INFO ] [MAIN ] HYAC: Wiping existing primary data before full refresh. [2025-10-02T19:30:54.669898] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-02T19:30:54.670056] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-02T19:30:54.670115] [INFO ] [MAIN ] HYAC: Starting full primary refresh. [2025-10-02T19:30:54.675401] [INFO ] [REMOTE ] HY: Fetching primary data for 2024-12. [2025-10-02T19:30:55.014216] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-02T19:30:55.111434] [INFO ] [REMOTE ] HYAC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:30:55.472993] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-06. [2025-10-02T19:30:55.523141] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-02T19:30:56.273050] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-01. [2025-10-02T19:30:57.043621] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-02T19:30:57.072253] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-02T19:30:57.074856] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-07. [2025-10-02T19:30:57.873005] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-02. [2025-10-02T19:30:58.657884] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-02T19:30:58.672979] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-03. [2025-10-02T19:30:59.097773] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-02T19:30:59.473036] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-08. [2025-10-02T19:30:59.551298] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-02T19:31:00.273004] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2024-12. [2025-10-02T19:31:00.566191] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2024-12 (0.29 seconds). [2025-10-02T19:31:01.072973] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-04. [2025-10-02T19:31:01.414271] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-02T19:31:01.749018] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-02T19:31:01.873025] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-09. [2025-10-02T19:31:02.673040] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-02. [2025-10-02T19:31:03.473011] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-05. [2025-10-02T19:31:03.950569] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-02T19:31:04.203232] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-02T19:31:04.229926] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-02T19:31:04.272994] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-03. [2025-10-02T19:31:05.073035] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-10. [2025-10-02T19:31:05.872993] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-01. [2025-10-02T19:31:06.008234] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-02T19:31:06.132671] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-01 (0.26 seconds). [2025-10-02T19:31:06.463750] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-02T19:31:06.465470] [INFO ] [REMOTE ] HWM: Full fetch complete (76237 records). [2025-10-02T19:31:06.465628] [DEBUG] [VALIDATOR ] HWM: Validating primary data. [2025-10-02T19:31:06.466717] [FATAL] [VALIDATOR ] HWM: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:31:06.466841] [FATAL] [MAIN ] HWM: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:31:06.466900] [WARN ] [MAIN ] HWM: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:31:06.466946] [INFO ] [LOCAL ] HWM: Starting deletion of primary data. [2025-10-02T19:31:06.467019] [DEBUG] [LOCAL ] HWM: No primary data file found to delete. [2025-10-02T19:31:06.467079] [INFO ] [LOCAL ] HWM: Starting deletion of derivative data. [2025-10-02T19:31:06.467125] [DEBUG] [LOCAL ] HWM: No derivative data file found to delete. [2025-10-02T19:31:06.467247] [INFO ] [MAIN ] Update Progress: 1071/2370 symbols completed. HWM took 32.9s. Estimated remaining: 3h 3m 12s. Rate: 7.1 symbols/min [2025-10-02T19:31:06.663981] [INFO ] [MAIN ] HYBX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:31:06.664148] [DEBUG] [LOCAL ] HYBX: No existing data file found in primary storage. [2025-10-02T19:31:06.664189] [WARN ] [MAIN ] HYBX: No existing data found, performing full refresh instead. [2025-10-02T19:31:06.664316] [INFO ] [MAIN ] HYBX: Wiping existing primary data before full refresh. [2025-10-02T19:31:06.664359] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-02T19:31:06.664407] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-02T19:31:06.664483] [INFO ] [MAIN ] HYBX: Starting full primary refresh. [2025-10-02T19:31:06.678093] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-06. [2025-10-02T19:31:07.069804] [INFO ] [REMOTE ] HYBX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:31:07.472977] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2024-12. [2025-10-02T19:31:07.503397] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-02T19:31:07.821633] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-10-02T19:31:08.272995] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-07. [2025-10-02T19:31:09.046852] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-02T19:31:09.072976] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-08. [2025-10-02T19:31:09.873000] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-04. [2025-10-02T19:31:09.903422] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-02T19:31:10.673016] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-01. [2025-10-02T19:31:10.993996] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-02T19:31:11.259747] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-02T19:31:11.473038] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-02. [2025-10-02T19:31:11.707718] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-02 (0.23 seconds). [2025-10-02T19:31:12.273046] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-09. [2025-10-02T19:31:13.073006] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-05. [2025-10-02T19:31:13.124872] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-02T19:31:13.873014] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-03. [2025-10-02T19:31:14.117149] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-10-02T19:31:14.672992] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-04. [2025-10-02T19:31:14.793420] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-02T19:31:15.012552] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-02T19:31:15.473057] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-06. [2025-10-02T19:31:16.273012] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-02. [2025-10-02T19:31:16.588858] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-02T19:31:17.029863] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-02T19:31:17.073009] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-10. [2025-10-02T19:31:17.569371] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-02T19:31:17.570392] [INFO ] [REMOTE ] HY: Full fetch complete (15085 records). [2025-10-02T19:31:17.570469] [DEBUG] [VALIDATOR ] HY: Validating primary data. [2025-10-02T19:31:17.570969] [FATAL] [VALIDATOR ] HY: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:31:17.571104] [FATAL] [MAIN ] HY: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:31:17.571182] [WARN ] [MAIN ] HY: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:31:17.571257] [INFO ] [LOCAL ] HY: Starting deletion of primary data. [2025-10-02T19:31:17.571320] [DEBUG] [LOCAL ] HY: No primary data file found to delete. [2025-10-02T19:31:17.571356] [INFO ] [LOCAL ] HY: Starting deletion of derivative data. [2025-10-02T19:31:17.571396] [DEBUG] [LOCAL ] HY: No derivative data file found to delete. [2025-10-02T19:31:17.571451] [INFO ] [MAIN ] Update Progress: 1072/2370 symbols completed. HY took 27.9s. Estimated remaining: 3h 3m 7s. Rate: 7.1 symbols/min [2025-10-02T19:31:17.762459] [INFO ] [MAIN ] HYI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:31:17.762699] [DEBUG] [LOCAL ] HYI: No existing data file found in primary storage. [2025-10-02T19:31:17.762772] [WARN ] [MAIN ] HYI: No existing data found, performing full refresh instead. [2025-10-02T19:31:17.762895] [INFO ] [MAIN ] HYI: Wiping existing primary data before full refresh. [2025-10-02T19:31:17.762937] [INFO ] [LOCAL ] HYI: Starting deletion of primary data. [2025-10-02T19:31:17.762979] [DEBUG] [LOCAL ] HYI: No primary data file found to delete. [2025-10-02T19:31:17.763012] [INFO ] [MAIN ] HYI: Starting full primary refresh. [2025-10-02T19:31:17.878124] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-05. [2025-10-02T19:31:18.172275] [INFO ] [REMOTE ] HYI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:31:18.258574] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-02T19:31:18.673018] [INFO ] [REMOTE ] HYI: Fetching primary data for 2024-12. [2025-10-02T19:31:19.473024] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-06. [2025-10-02T19:31:19.583210] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-02T19:31:19.788164] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-02T19:31:20.273025] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-03. [2025-10-02T19:31:20.487295] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-03 (0.21 seconds). [2025-10-02T19:31:21.073045] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-07. [2025-10-02T19:31:21.873001] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-04. [2025-10-02T19:31:22.194769] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-02T19:31:22.672979] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-05. [2025-10-02T19:31:22.840073] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-02T19:31:23.002032] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-02T19:31:23.472999] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-08. [2025-10-02T19:31:24.273009] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-01. [2025-10-02T19:31:24.988058] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-02T19:31:25.006313] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-02T19:31:25.073016] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-09. [2025-10-02T19:31:25.873023] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-07. [2025-10-02T19:31:26.211146] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-02T19:31:26.385791] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-02T19:31:26.673012] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-02. [2025-10-02T19:31:27.431000] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-02T19:31:27.473032] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-03. [2025-10-02T19:31:28.215478] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-02T19:31:28.273056] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-04. [2025-10-02T19:31:29.067716] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-02T19:31:29.072958] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-05. [2025-10-02T19:31:29.856951] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-02T19:31:29.872954] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-08. [2025-10-02T19:31:30.184397] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-02T19:31:30.673018] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-10. [2025-10-02T19:31:31.473027] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-06. [2025-10-02T19:31:31.745954] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-02T19:31:31.748432] [INFO ] [REMOTE ] HXL: Full fetch complete (65911 records). [2025-10-02T19:31:31.748585] [DEBUG] [VALIDATOR ] HXL: Validating primary data. [2025-10-02T19:31:31.749501] [FATAL] [VALIDATOR ] HXL: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:31:31.749621] [FATAL] [MAIN ] HXL: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:31:31.749730] [WARN ] [MAIN ] HXL: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:31:31.749862] [INFO ] [LOCAL ] HXL: Starting deletion of primary data. [2025-10-02T19:31:31.749967] [DEBUG] [LOCAL ] HXL: No primary data file found to delete. [2025-10-02T19:31:31.750038] [INFO ] [LOCAL ] HXL: Starting deletion of derivative data. [2025-10-02T19:31:31.750111] [DEBUG] [LOCAL ] HXL: No derivative data file found to delete. [2025-10-02T19:31:31.750210] [INFO ] [MAIN ] Update Progress: 1073/2370 symbols completed. HXL took 43.9s. Estimated remaining: 3h 3m 5s. Rate: 7.1 symbols/min [2025-10-02T19:31:31.940308] [INFO ] [MAIN ] HYT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:31:31.941344] [DEBUG] [LOCAL ] HYT: No existing data file found in primary storage. [2025-10-02T19:31:31.941416] [WARN ] [MAIN ] HYT: No existing data found, performing full refresh instead. [2025-10-02T19:31:31.941630] [INFO ] [MAIN ] HYT: Wiping existing primary data before full refresh. [2025-10-02T19:31:31.941719] [INFO ] [LOCAL ] HYT: Starting deletion of primary data. [2025-10-02T19:31:31.941777] [DEBUG] [LOCAL ] HYT: No primary data file found to delete. [2025-10-02T19:31:31.941824] [INFO ] [MAIN ] HYT: Starting full primary refresh. [2025-10-02T19:31:32.044759] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-02T19:31:32.278079] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-07. [2025-10-02T19:31:32.343980] [INFO ] [REMOTE ] HYT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:31:32.906902] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-02T19:31:33.072998] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-06. [2025-10-02T19:31:33.309591] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-10-02T19:31:33.873006] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-07. [2025-10-02T19:31:34.306950] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-02T19:31:34.673000] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-09. [2025-10-02T19:31:34.921272] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-09 (0.25 seconds). [2025-10-02T19:31:35.473009] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-10. [2025-10-02T19:31:35.734202] [DEBUG] [REMOTE ] HYBX: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T19:31:35.734667] [WARN ] [REMOTE ] HYBX: No data returned for month 2025-10 [2025-10-02T19:31:35.734782] [FATAL] [REMOTE ] HYBX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T19:31:35.734910] [FATAL] [MAIN ] HYBX: Failed to fetch primary data. [2025-10-02T19:31:35.734990] [WARN ] [MAIN ] HYBX: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T19:31:35.735077] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-02T19:31:35.735204] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-02T19:31:35.735275] [INFO ] [LOCAL ] HYBX: Starting deletion of derivative data. [2025-10-02T19:31:35.735336] [DEBUG] [LOCAL ] HYBX: No derivative data file found to delete. [2025-10-02T19:31:35.735420] [INFO ] [MAIN ] Update Progress: 1074/2370 symbols completed. HYBX took 29.3s. Estimated remaining: 3h 2m 51s. Rate: 7.1 symbols/min [2025-10-02T19:31:35.958354] [INFO ] [MAIN ] HYTR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:31:35.958553] [DEBUG] [LOCAL ] HYTR: No existing data file found in primary storage. [2025-10-02T19:31:35.958610] [WARN ] [MAIN ] HYTR: No existing data found, performing full refresh instead. [2025-10-02T19:31:35.958770] [INFO ] [MAIN ] HYTR: Wiping existing primary data before full refresh. [2025-10-02T19:31:35.958826] [INFO ] [LOCAL ] HYTR: Starting deletion of primary data. [2025-10-02T19:31:35.958906] [DEBUG] [LOCAL ] HYTR: No primary data file found to delete. [2025-10-02T19:31:35.958954] [INFO ] [MAIN ] HYTR: Starting full primary refresh. [2025-10-02T19:31:36.278136] [INFO ] [REMOTE ] HYT: Fetching primary data for 2024-12. [2025-10-02T19:31:36.353622] [INFO ] [REMOTE ] HYTR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:31:37.073017] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-08. [2025-10-02T19:31:37.266732] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-08 (0.19 seconds). [2025-10-02T19:31:37.545751] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-02T19:31:37.872994] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-01. [2025-10-02T19:31:38.673004] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-08. [2025-10-02T19:31:39.228223] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-02T19:31:39.472584] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-02T19:31:39.475571] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-02. [2025-10-02T19:31:40.272967] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-09. [2025-10-02T19:31:40.739201] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-02T19:31:40.752337] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-02T19:31:41.073079] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-09. [2025-10-02T19:31:41.872975] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2024-12. [2025-10-02T19:31:41.949572] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-02T19:31:42.319002] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-02T19:31:42.673003] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-03. [2025-10-02T19:31:43.473053] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-10. [2025-10-02T19:31:44.059626] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-02T19:31:44.060721] [INFO ] [REMOTE ] HYI: Full fetch complete (13450 records). [2025-10-02T19:31:44.060815] [DEBUG] [VALIDATOR ] HYI: Validating primary data. [2025-10-02T19:31:44.061280] [FATAL] [VALIDATOR ] HYI: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:31:44.061363] [FATAL] [MAIN ] HYI: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:31:44.061406] [WARN ] [MAIN ] HYI: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:31:44.061447] [INFO ] [LOCAL ] HYI: Starting deletion of primary data. [2025-10-02T19:31:44.061503] [DEBUG] [LOCAL ] HYI: No primary data file found to delete. [2025-10-02T19:31:44.061538] [INFO ] [LOCAL ] HYI: Starting deletion of derivative data. [2025-10-02T19:31:44.061578] [DEBUG] [LOCAL ] HYI: No derivative data file found to delete. [2025-10-02T19:31:44.061674] [INFO ] [MAIN ] Update Progress: 1075/2370 symbols completed. HYI took 26.5s. Estimated remaining: 3h 2m 43s. Rate: 7.1 symbols/min [2025-10-02T19:31:44.221854] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-02T19:31:44.275152] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-01. [2025-10-02T19:31:44.293944] [INFO ] [MAIN ] HZO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:31:44.295253] [DEBUG] [LOCAL ] HZO: No existing data file found in primary storage. [2025-10-02T19:31:44.295340] [WARN ] [MAIN ] HZO: No existing data found, performing full refresh instead. [2025-10-02T19:31:44.295457] [INFO ] [MAIN ] HZO: Wiping existing primary data before full refresh. [2025-10-02T19:31:44.295527] [INFO ] [LOCAL ] HZO: Starting deletion of primary data. [2025-10-02T19:31:44.295587] [DEBUG] [LOCAL ] HZO: No primary data file found to delete. [2025-10-02T19:31:44.295622] [INFO ] [MAIN ] HZO: Starting full primary refresh. [2025-10-02T19:31:44.670153] [INFO ] [REMOTE ] HZO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:31:44.912288] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-02T19:31:45.072977] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-02. [2025-10-02T19:31:45.617544] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-02T19:31:45.873028] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-10. [2025-10-02T19:31:46.167304] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-10-02T19:31:46.168219] [INFO ] [REMOTE ] HYAC: Full fetch complete (855 records). [2025-10-02T19:31:46.168296] [DEBUG] [VALIDATOR ] HYAC: Validating primary data. [2025-10-02T19:31:46.168743] [FATAL] [VALIDATOR ] HYAC: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:31:46.168827] [FATAL] [MAIN ] HYAC: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:31:46.168898] [WARN ] [MAIN ] HYAC: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:31:46.168973] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-02T19:31:46.169036] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-02T19:31:46.169071] [INFO ] [LOCAL ] HYAC: Starting deletion of derivative data. [2025-10-02T19:31:46.169110] [DEBUG] [LOCAL ] HYAC: No derivative data file found to delete. [2025-10-02T19:31:46.169185] [INFO ] [MAIN ] Update Progress: 1076/2370 symbols completed. HYAC took 51.7s. Estimated remaining: 3h 2m 27s. Rate: 7.1 symbols/min [2025-10-02T19:31:46.357388] [INFO ] [MAIN ] IAE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:31:46.357581] [DEBUG] [LOCAL ] IAE: No existing data file found in primary storage. [2025-10-02T19:31:46.357700] [WARN ] [MAIN ] IAE: No existing data found, performing full refresh instead. [2025-10-02T19:31:46.357838] [INFO ] [MAIN ] IAE: Wiping existing primary data before full refresh. [2025-10-02T19:31:46.357885] [INFO ] [LOCAL ] IAE: Starting deletion of primary data. [2025-10-02T19:31:46.357930] [DEBUG] [LOCAL ] IAE: No primary data file found to delete. [2025-10-02T19:31:46.357964] [INFO ] [MAIN ] IAE: Starting full primary refresh. [2025-10-02T19:31:46.678119] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-04. [2025-10-02T19:31:46.747005] [INFO ] [REMOTE ] IAE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:31:47.472999] [INFO ] [REMOTE ] HZO: Fetching primary data for 2024-12. [2025-10-02T19:31:48.220171] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-02T19:31:48.272990] [INFO ] [REMOTE ] IAE: Fetching primary data for 2024-12. [2025-10-02T19:31:48.568576] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-02T19:31:48.888419] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-02T19:31:49.073040] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-05. [2025-10-02T19:31:49.873016] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-01. [2025-10-02T19:31:50.398478] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-02T19:31:50.673003] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-06. [2025-10-02T19:31:50.957859] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-02T19:31:51.473036] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-02. [2025-10-02T19:31:52.128976] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-02T19:31:52.272981] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-07. [2025-10-02T19:31:52.613438] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-02T19:31:53.073050] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-03. [2025-10-02T19:31:53.407518] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-02T19:31:53.873015] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-08. [2025-10-02T19:31:54.453427] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-02T19:31:54.673025] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-03. [2025-10-02T19:31:54.935290] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-02T19:31:55.296242] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-02T19:31:55.472988] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-04. [2025-10-02T19:31:56.044443] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-02T19:31:56.273051] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-04. [2025-10-02T19:31:57.072980] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-05. [2025-10-02T19:31:57.630169] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-02T19:31:57.770907] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-02T19:31:57.872976] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-05. [2025-10-02T19:31:58.673040] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-01. [2025-10-02T19:31:59.010894] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-02T19:31:59.320508] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-02T19:31:59.473064] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-06. [2025-10-02T19:31:59.823938] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-02T19:32:00.273005] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-07. [2025-10-02T19:32:00.851346] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-02T19:32:01.073030] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-02. [2025-10-02T19:32:01.430708] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-02T19:32:01.873028] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-09. [2025-10-02T19:32:02.673017] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-03. [2025-10-02T19:32:03.279692] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-02T19:32:03.343413] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-02T19:32:03.472995] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-08. [2025-10-02T19:32:03.935323] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-02T19:32:04.273066] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-04. [2025-10-02T19:32:04.878899] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-02T19:32:05.073015] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-09. [2025-10-02T19:32:05.637579] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-02T19:32:05.872991] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-05. [2025-10-02T19:32:06.503703] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-02T19:32:06.673010] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-06. [2025-10-02T19:32:07.170123] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-02T19:32:07.472994] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-06. [2025-10-02T19:32:08.273010] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-10. [2025-10-02T19:32:08.628123] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-02T19:32:08.628923] [INFO ] [REMOTE ] HYTR: Full fetch complete (4508 records). [2025-10-02T19:32:08.629010] [DEBUG] [VALIDATOR ] HYTR: Validating primary data. [2025-10-02T19:32:08.629781] [FATAL] [VALIDATOR ] HYTR: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:32:08.629871] [FATAL] [MAIN ] HYTR: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:32:08.629917] [WARN ] [MAIN ] HYTR: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:32:08.629993] [INFO ] [LOCAL ] HYTR: Starting deletion of primary data. [2025-10-02T19:32:08.630075] [DEBUG] [LOCAL ] HYTR: No primary data file found to delete. [2025-10-02T19:32:08.630113] [INFO ] [LOCAL ] HYTR: Starting deletion of derivative data. [2025-10-02T19:32:08.630154] [DEBUG] [LOCAL ] HYTR: No derivative data file found to delete. [2025-10-02T19:32:08.630218] [INFO ] [MAIN ] Update Progress: 1077/2370 symbols completed. HYTR took 32.9s. Estimated remaining: 3h 2m 35s. Rate: 7.1 symbols/min [2025-10-02T19:32:08.761916] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-02T19:32:09.073011] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-10. [2025-10-02T19:32:09.872993] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-07. [2025-10-02T19:32:10.584876] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-02T19:32:10.673002] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-08. [2025-10-02T19:32:11.323461] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-02T19:32:11.473004] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-09. [2025-10-02T19:32:11.993969] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-02T19:32:12.124714] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-10 (3.05 seconds). [2025-10-02T19:32:12.126787] [INFO ] [REMOTE ] HYT: Full fetch complete (47304 records). [2025-10-02T19:32:12.126913] [DEBUG] [VALIDATOR ] HYT: Validating primary data. [2025-10-02T19:32:12.127623] [FATAL] [VALIDATOR ] HYT: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:32:12.127774] [FATAL] [MAIN ] HYT: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:32:12.127869] [WARN ] [MAIN ] HYT: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:32:12.127949] [INFO ] [LOCAL ] HYT: Starting deletion of primary data. [2025-10-02T19:32:12.128028] [DEBUG] [LOCAL ] HYT: No primary data file found to delete. [2025-10-02T19:32:12.128071] [INFO ] [LOCAL ] HYT: Starting deletion of derivative data. [2025-10-02T19:32:12.128122] [DEBUG] [LOCAL ] HYT: No derivative data file found to delete. [2025-10-02T19:32:12.128243] [INFO ] [MAIN ] Update Progress: 1078/2370 symbols completed. HYT took 40.4s. Estimated remaining: 3h 2m 20s. Rate: 7.1 symbols/min [2025-10-02T19:32:12.273018] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-10. [2025-10-02T19:32:12.747818] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-02T19:32:12.749136] [INFO ] [REMOTE ] IAE: Full fetch complete (8625 records). [2025-10-02T19:32:12.749209] [DEBUG] [VALIDATOR ] IAE: Validating primary data. [2025-10-02T19:32:12.749585] [FATAL] [VALIDATOR ] IAE: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:32:12.749704] [FATAL] [MAIN ] IAE: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:32:12.749755] [WARN ] [MAIN ] IAE: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:32:12.749847] [INFO ] [LOCAL ] IAE: Starting deletion of primary data. [2025-10-02T19:32:12.749913] [DEBUG] [LOCAL ] IAE: No primary data file found to delete. [2025-10-02T19:32:12.749950] [INFO ] [LOCAL ] IAE: Starting deletion of derivative data. [2025-10-02T19:32:12.749990] [DEBUG] [LOCAL ] IAE: No derivative data file found to delete. [2025-10-02T19:32:12.750045] [INFO ] [MAIN ] Update Progress: 1079/2370 symbols completed. IAE took 26.6s. Estimated remaining: 3h 2m 3s. Rate: 7.1 symbols/min [2025-10-02T19:32:13.073062] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-07. [2025-10-02T19:32:14.480775] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-02T19:32:14.487936] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-08. [2025-10-02T19:32:15.752868] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-02T19:32:15.760257] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-09. [2025-10-02T19:32:17.009105] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-02T19:32:17.016489] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-10. [2025-10-02T19:32:17.982367] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-02T19:32:17.983950] [INFO ] [REMOTE ] HZO: Full fetch complete (40838 records). [2025-10-02T19:32:17.984092] [DEBUG] [VALIDATOR ] HZO: Validating primary data. [2025-10-02T19:32:17.984861] [FATAL] [VALIDATOR ] HZO: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:32:17.984969] [FATAL] [MAIN ] HZO: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:32:17.985022] [WARN ] [MAIN ] HZO: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:32:17.985071] [INFO ] [LOCAL ] HZO: Starting deletion of primary data. [2025-10-02T19:32:17.985136] [DEBUG] [LOCAL ] HZO: No primary data file found to delete. [2025-10-02T19:32:17.985179] [INFO ] [LOCAL ] HZO: Starting deletion of derivative data. [2025-10-02T19:32:17.985286] [DEBUG] [LOCAL ] HZO: No derivative data file found to delete. [2025-10-02T19:32:17.985407] [INFO ] [MAIN ] Update Progress: 1080/2370 symbols completed. HZO took 33.9s. Estimated remaining: 3h 1m 50s. Rate: 7.1 symbols/min [2025-10-02T19:32:18.626463] [INFO ] [MAIN ] IBN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:32:18.728086] [DEBUG] [LOCAL ] IBN: No existing data file found in primary storage. [2025-10-02T19:32:18.726417] [INFO ] [MAIN ] IAG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:32:18.728293] [WARN ] [MAIN ] IBN: No existing data found, performing full refresh instead. [2025-10-02T19:32:18.759874] [DEBUG] [LOCAL ] IAG: No existing data file found in primary storage. [2025-10-02T19:32:18.760090] [WARN ] [MAIN ] IAG: No existing data found, performing full refresh instead. [2025-10-02T19:32:18.782284] [INFO ] [MAIN ] IBN: Wiping existing primary data before full refresh. [2025-10-02T19:32:18.783522] [INFO ] [LOCAL ] IBN: Starting deletion of primary data. [2025-10-02T19:32:18.783288] [INFO ] [MAIN ] IBP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:32:18.779333] [INFO ] [MAIN ] IBM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:32:18.783344] [INFO ] [MAIN ] IAG: Wiping existing primary data before full refresh. [2025-10-02T19:32:18.783789] [DEBUG] [LOCAL ] IBN: No primary data file found to delete. [2025-10-02T19:32:18.784188] [INFO ] [LOCAL ] IAG: Starting deletion of primary data. [2025-10-02T19:32:18.784125] [DEBUG] [LOCAL ] IBP: No existing data file found in primary storage. [2025-10-02T19:32:18.784477] [WARN ] [MAIN ] IBP: No existing data found, performing full refresh instead. [2025-10-02T19:32:18.784252] [DEBUG] [LOCAL ] IBM: No existing data file found in primary storage. [2025-10-02T19:32:18.784806] [INFO ] [MAIN ] IBN: Starting full primary refresh. [2025-10-02T19:32:18.784866] [INFO ] [MAIN ] IBP: Wiping existing primary data before full refresh. [2025-10-02T19:32:18.785037] [DEBUG] [LOCAL ] IAG: No primary data file found to delete. [2025-10-02T19:32:18.784721] [WARN ] [MAIN ] IBM: No existing data found, performing full refresh instead. [2025-10-02T19:32:18.796964] [INFO ] [MAIN ] IAG: Starting full primary refresh. [2025-10-02T19:32:18.849470] [INFO ] [MAIN ] IBM: Wiping existing primary data before full refresh. [2025-10-02T19:32:18.807375] [INFO ] [LOCAL ] IBP: Starting deletion of primary data. [2025-10-02T19:32:18.865747] [INFO ] [LOCAL ] IBM: Starting deletion of primary data. [2025-10-02T19:32:18.914711] [DEBUG] [LOCAL ] IBM: No primary data file found to delete. [2025-10-02T19:32:18.998342] [DEBUG] [LOCAL ] IBP: No primary data file found to delete. [2025-10-02T19:32:19.002455] [INFO ] [MAIN ] IBM: Starting full primary refresh. [2025-10-02T19:32:19.014466] [INFO ] [MAIN ] IBP: Starting full primary refresh. [2025-10-02T19:32:20.163796] [INFO ] [REMOTE ] IAG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:32:20.075373] [INFO ] [REMOTE ] IBN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:32:20.191255] [INFO ] [REMOTE ] IBN: Fetching primary data for 2024-12. [2025-10-02T19:32:20.185865] [INFO ] [REMOTE ] IAG: Fetching primary data for 2024-12. [2025-10-02T19:32:20.441430] [INFO ] [REMOTE ] IBM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:32:20.456416] [INFO ] [REMOTE ] IBM: Fetching primary data for 2024-12. [2025-10-02T19:32:20.456001] [INFO ] [REMOTE ] IBP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:32:20.457977] [INFO ] [REMOTE ] IBP: Fetching primary data for 2024-12. [2025-10-02T19:32:21.853305] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-02T19:32:21.859633] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-01. [2025-10-02T19:32:22.029064] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-02T19:32:22.040493] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-01. [2025-10-02T19:32:22.116670] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-02T19:32:22.127922] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-01. [2025-10-02T19:32:22.655215] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-10-02T19:32:22.666698] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-01. [2025-10-02T19:32:22.768320] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-02T19:32:22.774720] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-02. [2025-10-02T19:32:23.388543] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-02T19:32:23.473004] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-02. [2025-10-02T19:32:23.873578] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-02T19:32:23.994306] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-02T19:32:24.273016] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-02. [2025-10-02T19:32:24.880037] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-10-02T19:32:25.049395] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-02T19:32:25.072954] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-03. [2025-10-02T19:32:25.621506] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-02T19:32:25.873019] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-03. [2025-10-02T19:32:26.672971] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-03. [2025-10-02T19:32:26.758872] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-02T19:32:27.344607] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-02T19:32:27.473009] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-04. [2025-10-02T19:32:28.134744] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-02T19:32:28.273052] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-04. [2025-10-02T19:32:28.867004] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-02T19:32:29.073010] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-04. [2025-10-02T19:32:29.873036] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-02. [2025-10-02T19:32:30.322636] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-02T19:32:30.526789] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-02T19:32:30.673006] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-05. [2025-10-02T19:32:31.473012] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-05. [2025-10-02T19:32:31.876135] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-02T19:32:32.273000] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-05. [2025-10-02T19:32:32.667596] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-02T19:32:33.018274] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-02T19:32:33.072997] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-06. [2025-10-02T19:32:33.532849] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-02T19:32:33.872993] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-06. [2025-10-02T19:32:34.672969] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-06. [2025-10-02T19:32:34.779806] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-02T19:32:35.224837] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-02T19:32:35.472995] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-03. [2025-10-02T19:32:36.011163] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-02T19:32:36.273024] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-07. [2025-10-02T19:32:37.072952] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-07. [2025-10-02T19:32:37.660836] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-02T19:32:37.717315] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-02T19:32:37.873000] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-04. [2025-10-02T19:32:38.672993] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-08. [2025-10-02T19:32:38.959197] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-02T19:32:39.473011] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-08. [2025-10-02T19:32:39.619700] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-02T19:32:40.183462] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-02T19:32:40.273028] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-09. [2025-10-02T19:32:40.855934] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-02T19:32:41.073057] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-05. [2025-10-02T19:32:41.159749] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-02T19:32:41.873055] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-10. [2025-10-02T19:32:42.672968] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-07. [2025-10-02T19:32:42.822920] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-02T19:32:42.824475] [INFO ] [REMOTE ] IBP: Full fetch complete (41164 records). [2025-10-02T19:32:42.824576] [DEBUG] [VALIDATOR ] IBP: Validating primary data. [2025-10-02T19:32:43.286341] [DEBUG] [VALIDATOR ] IBP: All expected trading days are present. [2025-10-02T19:32:43.286534] [DEBUG] [VALIDATOR ] IBP: Primary data validation passed. [2025-10-02T19:32:43.287421] [INFO ] [MAIN ] IBP: Fetched primary data is valid. [2025-10-02T19:32:43.287601] [DEBUG] [LOCAL ] IBP: Saving primary data. [2025-10-02T19:32:43.320159] [DEBUG] [LOCAL ] IBP: Trimmed 41164 records to 29050 (keeping 200 days of data) [2025-10-02T19:32:43.321799] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-10-02T19:32:43.473763] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-09. [2025-10-02T19:32:43.544272] [DEBUG] [LOCAL ] IBP: Primary data saved (29050 records). [2025-10-02T19:32:43.544413] [INFO ] [MAIN ] IBP: Full history saved. [2025-10-02T19:32:43.544489] [INFO ] [MAIN ] Update Progress: 1081/2370 symbols completed. IBP took 25.5s. Estimated remaining: 3h 2m 2s. Rate: 7.1 symbols/min [2025-10-02T19:32:43.738394] [INFO ] [MAIN ] IBTA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:32:43.783273] [DEBUG] [LOCAL ] IBTA: Loaded 37611 existing records from primary storage. [2025-10-02T19:32:43.783611] [INFO ] [MAIN ] IBTA: Loaded 37611 existing records. [2025-10-02T19:32:43.998875] [WARN ] [MAIN ] IBTA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:32:43.999110] [INFO ] [MAIN ] IBTA: Wiping existing primary data before full refresh. [2025-10-02T19:32:43.999172] [INFO ] [LOCAL ] IBTA: Starting deletion of primary data. [2025-10-02T19:32:44.001226] [DEBUG] [LOCAL ] IBTA: Deleted primary data file. [2025-10-02T19:32:44.001360] [INFO ] [MAIN ] IBTA: Starting full primary refresh. [2025-10-02T19:32:44.283236] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-06. [2025-10-02T19:32:44.435605] [INFO ] [REMOTE ] IBTA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:32:44.629854] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-02T19:32:45.074850] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-08. [2025-10-02T19:32:45.081162] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-02T19:32:45.873057] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-10. [2025-10-02T19:32:46.498983] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-02T19:32:46.594159] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-10-02T19:32:46.672987] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-07. [2025-10-02T19:32:47.472980] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-09. [2025-10-02T19:32:47.611929] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-02T19:32:47.614041] [INFO ] [REMOTE ] IAG: Full fetch complete (77253 records). [2025-10-02T19:32:47.614198] [DEBUG] [VALIDATOR ] IAG: Validating primary data. [2025-10-02T19:32:48.067828] [DEBUG] [VALIDATOR ] IAG: All expected trading days are present. [2025-10-02T19:32:48.067914] [DEBUG] [VALIDATOR ] IAG: Primary data validation passed. [2025-10-02T19:32:48.072175] [INFO ] [MAIN ] IAG: Fetched primary data is valid. [2025-10-02T19:32:48.072253] [DEBUG] [LOCAL ] IAG: Saving primary data. [2025-10-02T19:32:48.073897] [DEBUG] [LOCAL ] IAG: Trimmed 77253 records to 53844 (keeping 200 days of data) [2025-10-02T19:32:48.287575] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2024-12. [2025-10-02T19:32:48.410061] [DEBUG] [LOCAL ] IAG: Primary data saved (53844 records). [2025-10-02T19:32:48.410206] [INFO ] [MAIN ] IAG: Full history saved. [2025-10-02T19:32:48.410281] [INFO ] [MAIN ] Update Progress: 1082/2370 symbols completed. IAG took 30.4s. Estimated remaining: 3h 1m 49s. Rate: 7.1 symbols/min [2025-10-02T19:32:48.592266] [INFO ] [MAIN ] ICE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:32:48.652877] [DEBUG] [LOCAL ] ICE: Loaded 53003 existing records from primary storage. [2025-10-02T19:32:48.653218] [INFO ] [MAIN ] ICE: Loaded 53003 existing records. [2025-10-02T19:32:48.852966] [WARN ] [MAIN ] ICE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:32:48.853469] [INFO ] [MAIN ] ICE: Wiping existing primary data before full refresh. [2025-10-02T19:32:48.853868] [INFO ] [LOCAL ] ICE: Starting deletion of primary data. [2025-10-02T19:32:48.855825] [DEBUG] [LOCAL ] ICE: Deleted primary data file. [2025-10-02T19:32:48.855892] [INFO ] [MAIN ] ICE: Starting full primary refresh. [2025-10-02T19:32:49.273129] [INFO ] [REMOTE ] ICE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:32:49.273743] [INFO ] [REMOTE ] ICE: Fetching primary data for 2024-12. [2025-10-02T19:32:49.341438] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-02T19:32:49.371922] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-02T19:32:49.381801] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-07 (2.71 seconds). [2025-10-02T19:32:49.872992] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-01. [2025-10-02T19:32:50.673027] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-10. [2025-10-02T19:32:50.963795] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-02T19:32:51.048887] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-02T19:32:51.473074] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-02. [2025-10-02T19:32:52.221283] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-02T19:32:52.223498] [INFO ] [REMOTE ] IBN: Full fetch complete (76319 records). [2025-10-02T19:32:52.223628] [DEBUG] [VALIDATOR ] IBN: Validating primary data. [2025-10-02T19:32:52.273211] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-01. [2025-10-02T19:32:52.713175] [DEBUG] [VALIDATOR ] IBN: All expected trading days are present. [2025-10-02T19:32:52.714343] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-02T19:32:52.713736] [DEBUG] [VALIDATOR ] IBN: Primary data validation passed. [2025-10-02T19:32:52.720949] [INFO ] [MAIN ] IBN: Fetched primary data is valid. [2025-10-02T19:32:52.721563] [DEBUG] [LOCAL ] IBN: Saving primary data. [2025-10-02T19:32:52.723048] [DEBUG] [LOCAL ] IBN: Trimmed 76319 records to 53259 (keeping 200 days of data) [2025-10-02T19:32:53.082877] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-03. [2025-10-02T19:32:53.085221] [DEBUG] [LOCAL ] IBN: Primary data saved (53259 records). [2025-10-02T19:32:53.086539] [INFO ] [MAIN ] IBN: Full history saved. [2025-10-02T19:32:53.086679] [INFO ] [MAIN ] Update Progress: 1083/2370 symbols completed. IBN took 35.1s. Estimated remaining: 3h 1m 36s. Rate: 7.1 symbols/min [2025-10-02T19:32:53.296880] [INFO ] [MAIN ] ICL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:32:53.341189] [DEBUG] [LOCAL ] ICL: Loaded 38446 existing records from primary storage. [2025-10-02T19:32:53.341559] [INFO ] [MAIN ] ICL: Loaded 38446 existing records. [2025-10-02T19:32:53.586414] [WARN ] [MAIN ] ICL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:32:53.586637] [INFO ] [MAIN ] ICL: Wiping existing primary data before full refresh. [2025-10-02T19:32:53.586726] [INFO ] [LOCAL ] ICL: Starting deletion of primary data. [2025-10-02T19:32:53.587973] [DEBUG] [LOCAL ] ICL: Deleted primary data file. [2025-10-02T19:32:53.588035] [INFO ] [MAIN ] ICL: Starting full primary refresh. [2025-10-02T19:32:53.877240] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-08. [2025-10-02T19:32:54.047363] [INFO ] [REMOTE ] ICL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:32:54.094997] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-02T19:32:54.673011] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-02. [2025-10-02T19:32:54.708608] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-02T19:32:55.473067] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-04. [2025-10-02T19:32:56.167747] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-10-02T19:32:56.272977] [INFO ] [REMOTE ] ICL: Fetching primary data for 2024-12. [2025-10-02T19:32:56.312042] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-02T19:32:57.072998] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-03. [2025-10-02T19:32:57.114478] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-02T19:32:57.708722] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-02T19:32:57.872989] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-05. [2025-10-02T19:32:58.673066] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-01. [2025-10-02T19:32:59.069109] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-02T19:32:59.289004] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-02T19:32:59.473020] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-09. [2025-10-02T19:33:00.048331] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-02T19:33:00.273040] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-02. [2025-10-02T19:33:01.073017] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-06. [2025-10-02T19:33:01.767007] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-02T19:33:01.872970] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-03. [2025-10-02T19:33:01.894622] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-02T19:33:02.318562] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-09 (2.85 seconds). [2025-10-02T19:33:02.673000] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-10. [2025-10-02T19:33:03.020206] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-02T19:33:03.473038] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-04. [2025-10-02T19:33:04.273058] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-04. [2025-10-02T19:33:04.921271] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-02T19:33:04.923503] [INFO ] [REMOTE ] IBM: Full fetch complete (77620 records). [2025-10-02T19:33:04.923689] [DEBUG] [VALIDATOR ] IBM: Validating primary data. [2025-10-02T19:33:05.089788] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-07. [2025-10-02T19:33:05.373572] [DEBUG] [VALIDATOR ] IBM: All expected trading days are present. [2025-10-02T19:33:05.373790] [DEBUG] [VALIDATOR ] IBM: Primary data validation passed. [2025-10-02T19:33:05.375032] [INFO ] [MAIN ] IBM: Fetched primary data is valid. [2025-10-02T19:33:05.375209] [DEBUG] [LOCAL ] IBM: Saving primary data. [2025-10-02T19:33:05.376918] [DEBUG] [LOCAL ] IBM: Trimmed 77620 records to 54023 (keeping 200 days of data) [2025-10-02T19:33:05.507403] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-02T19:33:05.786539] [DEBUG] [LOCAL ] IBM: Primary data saved (54023 records). [2025-10-02T19:33:05.786719] [INFO ] [MAIN ] IBM: Full history saved. [2025-10-02T19:33:05.786810] [INFO ] [MAIN ] Update Progress: 1084/2370 symbols completed. IBM took 47.8s. Estimated remaining: 3h 1m 33s. Rate: 7.1 symbols/min [2025-10-02T19:33:05.876748] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-05. [2025-10-02T19:33:06.016238] [INFO ] [MAIN ] IDA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:33:06.019074] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-02T19:33:06.077606] [DEBUG] [LOCAL ] IDA: Loaded 32160 existing records from primary storage. [2025-10-02T19:33:06.078046] [INFO ] [MAIN ] IDA: Loaded 32160 existing records. [2025-10-02T19:33:06.306439] [WARN ] [MAIN ] IDA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:33:06.306850] [INFO ] [MAIN ] IDA: Wiping existing primary data before full refresh. [2025-10-02T19:33:06.306932] [INFO ] [LOCAL ] IDA: Starting deletion of primary data. [2025-10-02T19:33:06.308416] [DEBUG] [LOCAL ] IDA: Deleted primary data file. [2025-10-02T19:33:06.308480] [INFO ] [MAIN ] IDA: Starting full primary refresh. [2025-10-02T19:33:06.522218] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-02T19:33:06.689534] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-08. [2025-10-02T19:33:06.744758] [INFO ] [REMOTE ] IDA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:33:07.406067] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-02T19:33:07.472966] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-06. [2025-10-02T19:33:08.047912] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-02T19:33:08.272995] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-05. [2025-10-02T19:33:09.073049] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-09. [2025-10-02T19:33:09.198524] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-02T19:33:09.818929] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-02T19:33:09.873053] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-07. [2025-10-02T19:33:10.307943] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-02T19:33:10.673051] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-06. [2025-10-02T19:33:11.271732] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-02T19:33:11.473031] [INFO ] [REMOTE ] IDA: Fetching primary data for 2024-12. [2025-10-02T19:33:12.210121] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-02T19:33:12.272989] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-08. [2025-10-02T19:33:12.371209] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-02T19:33:13.073017] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-07. [2025-10-02T19:33:13.872998] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-10. [2025-10-02T19:33:14.107559] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-02T19:33:14.557023] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-02T19:33:14.673023] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-01. [2025-10-02T19:33:15.033839] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-02T19:33:15.035435] [INFO ] [REMOTE ] IBTA: Full fetch complete (50823 records). [2025-10-02T19:33:15.035560] [DEBUG] [VALIDATOR ] IBTA: Validating primary data. [2025-10-02T19:33:15.447076] [DEBUG] [VALIDATOR ] IBTA: All expected trading days are present. [2025-10-02T19:33:15.447171] [DEBUG] [VALIDATOR ] IBTA: Primary data validation passed. [2025-10-02T19:33:15.448018] [INFO ] [MAIN ] IBTA: Fetched primary data is valid. [2025-10-02T19:33:15.448094] [DEBUG] [LOCAL ] IBTA: Saving primary data. [2025-10-02T19:33:15.449404] [DEBUG] [LOCAL ] IBTA: Trimmed 50823 records to 37847 (keeping 200 days of data) [2025-10-02T19:33:15.499751] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-08. [2025-10-02T19:33:15.683620] [DEBUG] [LOCAL ] IBTA: Primary data saved (37847 records). [2025-10-02T19:33:15.683843] [INFO ] [MAIN ] IBTA: Full history saved. [2025-10-02T19:33:15.683956] [INFO ] [MAIN ] Update Progress: 1085/2370 symbols completed. IBTA took 32.1s. Estimated remaining: 3h 1m 26s. Rate: 7.1 symbols/min [2025-10-02T19:33:15.877796] [INFO ] [MAIN ] IDE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:33:15.888536] [DEBUG] [LOCAL ] IDE: Loaded 8754 existing records from primary storage. [2025-10-02T19:33:15.888821] [INFO ] [MAIN ] IDE: Loaded 8754 existing records. [2025-10-02T19:33:16.088846] [WARN ] [MAIN ] IDE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:33:16.089201] [INFO ] [MAIN ] IDE: Wiping existing primary data before full refresh. [2025-10-02T19:33:16.089363] [INFO ] [LOCAL ] IDE: Starting deletion of primary data. [2025-10-02T19:33:16.089887] [DEBUG] [LOCAL ] IDE: Deleted primary data file. [2025-10-02T19:33:16.089953] [INFO ] [MAIN ] IDE: Starting full primary refresh. [2025-10-02T19:33:16.224174] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-02T19:33:16.273169] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-09. [2025-10-02T19:33:16.512490] [INFO ] [REMOTE ] IDE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:33:17.028492] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-02T19:33:17.073000] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-02. [2025-10-02T19:33:17.873007] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-09. [2025-10-02T19:33:18.131301] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-02T19:33:18.175744] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-02T19:33:18.673004] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-10. [2025-10-02T19:33:19.365891] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-02T19:33:19.473028] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-10. [2025-10-02T19:33:20.273012] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-03. [2025-10-02T19:33:20.494495] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-02T19:33:20.498112] [INFO ] [REMOTE ] ICE: Full fetch complete (76757 records). [2025-10-02T19:33:20.498272] [DEBUG] [VALIDATOR ] ICE: Validating primary data. [2025-10-02T19:33:20.839540] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-02T19:33:20.862955] [INFO ] [REMOTE ] ICL: Full fetch complete (55927 records). [2025-10-02T19:33:20.891147] [DEBUG] [VALIDATOR ] ICL: Validating primary data. [2025-10-02T19:33:21.058473] [DEBUG] [VALIDATOR ] ICE: All expected trading days are present. [2025-10-02T19:33:21.074598] [DEBUG] [VALIDATOR ] ICE: Primary data validation passed. [2025-10-02T19:33:21.074499] [INFO ] [REMOTE ] IDE: Fetching primary data for 2024-12. [2025-10-02T19:33:21.080916] [INFO ] [MAIN ] ICE: Fetched primary data is valid. [2025-10-02T19:33:21.092481] [DEBUG] [LOCAL ] ICE: Saving primary data. [2025-10-02T19:33:21.252135] [DEBUG] [LOCAL ] ICE: Trimmed 76757 records to 53392 (keeping 200 days of data) [2025-10-02T19:33:21.532179] [DEBUG] [VALIDATOR ] ICL: All expected trading days are present. [2025-10-02T19:33:21.532299] [DEBUG] [VALIDATOR ] ICL: Primary data validation passed. [2025-10-02T19:33:21.533285] [INFO ] [MAIN ] ICL: Fetched primary data is valid. [2025-10-02T19:33:21.536960] [DEBUG] [LOCAL ] ICL: Saving primary data. [2025-10-02T19:33:21.551501] [DEBUG] [LOCAL ] ICL: Trimmed 55927 records to 38682 (keeping 200 days of data) [2025-10-02T19:33:21.774446] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-02T19:33:21.883090] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-04. [2025-10-02T19:33:21.954180] [DEBUG] [LOCAL ] ICL: Primary data saved (38682 records). [2025-10-02T19:33:21.954926] [INFO ] [MAIN ] ICL: Full history saved. [2025-10-02T19:33:21.963693] [INFO ] [MAIN ] Update Progress: 1086/2370 symbols completed. ICL took 28.9s. Estimated remaining: 3h 1m 15s. Rate: 7.1 symbols/min [2025-10-02T19:33:21.987093] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-02T19:33:22.186345] [INFO ] [MAIN ] IDT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:33:22.278863] [DEBUG] [LOCAL ] IDT: Loaded 17953 existing records from primary storage. [2025-10-02T19:33:22.280611] [INFO ] [MAIN ] IDT: Loaded 17953 existing records. [2025-10-02T19:33:22.478771] [WARN ] [MAIN ] IDT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:33:22.479751] [INFO ] [MAIN ] IDT: Wiping existing primary data before full refresh. [2025-10-02T19:33:22.479833] [INFO ] [LOCAL ] IDT: Starting deletion of primary data. [2025-10-02T19:33:22.481368] [DEBUG] [LOCAL ] IDT: Deleted primary data file. [2025-10-02T19:33:22.483347] [INFO ] [MAIN ] IDT: Starting full primary refresh. [2025-10-02T19:33:22.684399] [DEBUG] [LOCAL ] ICE: Primary data saved (53392 records). [2025-10-02T19:33:22.705344] [INFO ] [MAIN ] ICE: Full history saved. [2025-10-02T19:33:22.683746] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-01. [2025-10-02T19:33:22.731608] [INFO ] [MAIN ] Update Progress: 1087/2370 symbols completed. ICE took 34.3s. Estimated remaining: 3h 0m 58s. Rate: 7.1 symbols/min [2025-10-02T19:33:23.041051] [INFO ] [REMOTE ] IDT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:33:23.095089] [INFO ] [MAIN ] IEX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:33:23.136419] [DEBUG] [LOCAL ] IEX: Loaded 38359 existing records from primary storage. [2025-10-02T19:33:23.136800] [INFO ] [MAIN ] IEX: Loaded 38359 existing records. [2025-10-02T19:33:23.332695] [WARN ] [MAIN ] IEX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:33:23.333119] [INFO ] [MAIN ] IEX: Wiping existing primary data before full refresh. [2025-10-02T19:33:23.333201] [INFO ] [LOCAL ] IEX: Starting deletion of primary data. [2025-10-02T19:33:23.334814] [DEBUG] [LOCAL ] IEX: Deleted primary data file. [2025-10-02T19:33:23.334883] [INFO ] [MAIN ] IEX: Starting full primary refresh. [2025-10-02T19:33:23.476394] [INFO ] [REMOTE ] IDT: Fetching primary data for 2024-12. [2025-10-02T19:33:23.577903] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-02T19:33:23.531943] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-02T19:33:23.786112] [INFO ] [REMOTE ] IEX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:33:24.272973] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-05. [2025-10-02T19:33:24.546050] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-02T19:33:25.073013] [INFO ] [REMOTE ] IEX: Fetching primary data for 2024-12. [2025-10-02T19:33:25.768923] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-02T19:33:25.873018] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-06. [2025-10-02T19:33:26.472789] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-02T19:33:26.673008] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-01. [2025-10-02T19:33:26.825153] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-02T19:33:27.210192] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-02T19:33:27.472999] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-02. [2025-10-02T19:33:28.257306] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-02T19:33:28.272968] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-02. [2025-10-02T19:33:28.994339] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-02T19:33:29.073001] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-01. [2025-10-02T19:33:29.873005] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-03. [2025-10-02T19:33:30.471853] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-02T19:33:30.479151] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-02T19:33:30.673006] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-07. [2025-10-02T19:33:31.473020] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-03. [2025-10-02T19:33:32.273008] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-02. [2025-10-02T19:33:32.307794] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-02T19:33:32.532867] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-02T19:33:33.073039] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-08. [2025-10-02T19:33:33.768066] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-02T19:33:33.872976] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-04. [2025-10-02T19:33:33.914238] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-02T19:33:34.582244] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-02T19:33:34.673061] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-03. [2025-10-02T19:33:35.473057] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-04. [2025-10-02T19:33:36.235506] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-02T19:33:36.272979] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-04. [2025-10-02T19:33:36.588696] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-02T19:33:37.073005] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-05. [2025-10-02T19:33:37.822237] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-02T19:33:37.878092] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-06. [2025-10-02T19:33:37.892925] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-02T19:33:38.641828] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-02T19:33:38.672998] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-05. [2025-10-02T19:33:39.472949] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-05. [2025-10-02T19:33:39.916291] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-02T19:33:40.273005] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-06. [2025-10-02T19:33:40.490136] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-02T19:33:41.073017] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-06. [2025-10-02T19:33:41.765606] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-02T19:33:41.872981] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-07. [2025-10-02T19:33:42.097945] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-02T19:33:42.673003] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-07. [2025-10-02T19:33:42.684596] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-02T19:33:43.472995] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-08. [2025-10-02T19:33:43.755624] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-02T19:33:44.052687] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-02T19:33:44.273015] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-09. [2025-10-02T19:33:45.073032] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-09. [2025-10-02T19:33:45.813507] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-02T19:33:45.882585] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-10. [2025-10-02T19:33:45.885612] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-02T19:33:46.466320] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-02T19:33:46.467213] [INFO ] [REMOTE ] IDE: Full fetch complete (12578 records). [2025-10-02T19:33:46.467286] [DEBUG] [VALIDATOR ] IDE: Validating primary data. [2025-10-02T19:33:46.680735] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-10. [2025-10-02T19:33:46.866003] [DEBUG] [VALIDATOR ] IDE: All expected trading days are present. [2025-10-02T19:33:46.866111] [DEBUG] [VALIDATOR ] IDE: Primary data validation passed. [2025-10-02T19:33:46.866459] [INFO ] [MAIN ] IDE: Fetched primary data is valid. [2025-10-02T19:33:46.866503] [DEBUG] [LOCAL ] IDE: Saving primary data. [2025-10-02T19:33:46.867276] [DEBUG] [LOCAL ] IDE: Trimmed 12578 records to 8807 (keeping 200 days of data) [2025-10-02T19:33:46.926934] [DEBUG] [LOCAL ] IDE: Primary data saved (8807 records). [2025-10-02T19:33:46.927083] [INFO ] [MAIN ] IDE: Full history saved. [2025-10-02T19:33:46.927172] [INFO ] [MAIN ] Update Progress: 1088/2370 symbols completed. IDE took 31.2s. Estimated remaining: 3h 1m 8s. Rate: 7.1 symbols/min [2025-10-02T19:33:47.115269] [INFO ] [MAIN ] IFF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:33:47.174318] [DEBUG] [LOCAL ] IFF: Loaded 50984 existing records from primary storage. [2025-10-02T19:33:47.174744] [INFO ] [MAIN ] IFF: Loaded 50984 existing records. [2025-10-02T19:33:47.392674] [WARN ] [MAIN ] IFF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:33:47.393027] [INFO ] [MAIN ] IFF: Wiping existing primary data before full refresh. [2025-10-02T19:33:47.393160] [INFO ] [LOCAL ] IFF: Starting deletion of primary data. [2025-10-02T19:33:47.394877] [DEBUG] [LOCAL ] IFF: Deleted primary data file. [2025-10-02T19:33:47.395009] [INFO ] [MAIN ] IFF: Starting full primary refresh. [2025-10-02T19:33:47.478242] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-07. [2025-10-02T19:33:47.829895] [INFO ] [REMOTE ] IFF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:33:47.875444] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-02T19:33:47.878371] [INFO ] [REMOTE ] IDA: Full fetch complete (44817 records). [2025-10-02T19:33:47.878483] [DEBUG] [VALIDATOR ] IDA: Validating primary data. [2025-10-02T19:33:48.283849] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-08. [2025-10-02T19:33:48.287810] [DEBUG] [VALIDATOR ] IDA: All expected trading days are present. [2025-10-02T19:33:48.287927] [DEBUG] [VALIDATOR ] IDA: Primary data validation passed. [2025-10-02T19:33:48.288949] [INFO ] [MAIN ] IDA: Fetched primary data is valid. [2025-10-02T19:33:48.289152] [DEBUG] [LOCAL ] IDA: Saving primary data. [2025-10-02T19:33:48.291568] [DEBUG] [LOCAL ] IDA: Trimmed 44817 records to 32394 (keeping 200 days of data) [2025-10-02T19:33:48.517284] [DEBUG] [LOCAL ] IDA: Primary data saved (32394 records). [2025-10-02T19:33:48.517423] [INFO ] [MAIN ] IDA: Full history saved. [2025-10-02T19:33:48.517593] [INFO ] [MAIN ] Update Progress: 1089/2370 symbols completed. IDA took 42.7s. Estimated remaining: 3h 0m 51s. Rate: 7.1 symbols/min [2025-10-02T19:33:48.695114] [INFO ] [MAIN ] IFN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:33:48.715503] [DEBUG] [LOCAL ] IFN: Loaded 18268 existing records from primary storage. [2025-10-02T19:33:48.715770] [INFO ] [MAIN ] IFN: Loaded 18268 existing records. [2025-10-02T19:33:48.900484] [WARN ] [MAIN ] IFN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:33:48.900704] [INFO ] [MAIN ] IFN: Wiping existing primary data before full refresh. [2025-10-02T19:33:48.900764] [INFO ] [LOCAL ] IFN: Starting deletion of primary data. [2025-10-02T19:33:48.901538] [DEBUG] [LOCAL ] IFN: Deleted primary data file. [2025-10-02T19:33:48.901602] [INFO ] [MAIN ] IFN: Starting full primary refresh. [2025-10-02T19:33:49.083638] [INFO ] [REMOTE ] IFF: Fetching primary data for 2024-12. [2025-10-02T19:33:49.303056] [INFO ] [REMOTE ] IFN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:33:49.384334] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-02T19:33:49.596742] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-02T19:33:49.873005] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-09. [2025-10-02T19:33:50.673002] [INFO ] [REMOTE ] IFN: Fetching primary data for 2024-12. [2025-10-02T19:33:50.937408] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-02T19:33:51.072464] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-02T19:33:51.473053] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-10. [2025-10-02T19:33:52.015051] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-02T19:33:52.272997] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-01. [2025-10-02T19:33:52.444949] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-02T19:33:52.446372] [INFO ] [REMOTE ] IDT: Full fetch complete (23023 records). [2025-10-02T19:33:52.446450] [DEBUG] [VALIDATOR ] IDT: Validating primary data. [2025-10-02T19:33:52.860403] [DEBUG] [VALIDATOR ] IDT: All expected trading days are present. [2025-10-02T19:33:52.860492] [DEBUG] [VALIDATOR ] IDT: Primary data validation passed. [2025-10-02T19:33:52.861121] [INFO ] [MAIN ] IDT: Fetched primary data is valid. [2025-10-02T19:33:52.861190] [DEBUG] [LOCAL ] IDT: Saving primary data. [2025-10-02T19:33:52.862020] [DEBUG] [LOCAL ] IDT: Trimmed 23023 records to 18168 (keeping 200 days of data) [2025-10-02T19:33:52.981621] [DEBUG] [LOCAL ] IDT: Primary data saved (18168 records). [2025-10-02T19:33:52.981798] [INFO ] [MAIN ] IDT: Full history saved. [2025-10-02T19:33:52.981904] [INFO ] [MAIN ] Update Progress: 1090/2370 symbols completed. IDT took 31.0s. Estimated remaining: 3h 0m 38s. Rate: 7.1 symbols/min [2025-10-02T19:33:53.078144] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-08. [2025-10-02T19:33:53.176746] [INFO ] [MAIN ] IFS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:33:53.200997] [DEBUG] [LOCAL ] IFS: Loaded 23078 existing records from primary storage. [2025-10-02T19:33:53.201295] [INFO ] [MAIN ] IFS: Loaded 23078 existing records. [2025-10-02T19:33:53.395550] [WARN ] [MAIN ] IFS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:33:53.396028] [INFO ] [MAIN ] IFS: Wiping existing primary data before full refresh. [2025-10-02T19:33:53.396087] [INFO ] [LOCAL ] IFS: Starting deletion of primary data. [2025-10-02T19:33:53.397062] [DEBUG] [LOCAL ] IFS: Deleted primary data file. [2025-10-02T19:33:53.397128] [INFO ] [MAIN ] IFS: Starting full primary refresh. [2025-10-02T19:33:53.752938] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-02T19:33:53.822311] [INFO ] [REMOTE ] IFS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:33:53.873010] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-01. [2025-10-02T19:33:54.608250] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-02T19:33:54.672994] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-09. [2025-10-02T19:33:55.472976] [INFO ] [REMOTE ] IFS: Fetching primary data for 2024-12. [2025-10-02T19:33:55.568554] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-02T19:33:55.770835] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-02T19:33:56.272971] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-10. [2025-10-02T19:33:56.495444] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-02T19:33:57.072986] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-02. [2025-10-02T19:33:57.567555] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-02T19:33:57.569444] [INFO ] [REMOTE ] IEX: Full fetch complete (53557 records). [2025-10-02T19:33:57.569604] [DEBUG] [VALIDATOR ] IEX: Validating primary data. [2025-10-02T19:33:57.878226] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-02. [2025-10-02T19:33:57.991159] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-02T19:33:58.035737] [DEBUG] [VALIDATOR ] IEX: All expected trading days are present. [2025-10-02T19:33:58.035831] [DEBUG] [VALIDATOR ] IEX: Primary data validation passed. [2025-10-02T19:33:58.036603] [INFO ] [MAIN ] IEX: Fetched primary data is valid. [2025-10-02T19:33:58.036673] [DEBUG] [LOCAL ] IEX: Saving primary data. [2025-10-02T19:33:58.038303] [DEBUG] [LOCAL ] IEX: Trimmed 53557 records to 38652 (keeping 200 days of data) [2025-10-02T19:33:58.301828] [DEBUG] [LOCAL ] IEX: Primary data saved (38652 records). [2025-10-02T19:33:58.301977] [INFO ] [MAIN ] IEX: Full history saved. [2025-10-02T19:33:58.302079] [INFO ] [MAIN ] Update Progress: 1091/2370 symbols completed. IEX took 35.6s. Estimated remaining: 3h 0m 26s. Rate: 7.1 symbols/min [2025-10-02T19:33:58.488202] [INFO ] [MAIN ] IGA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:33:58.499879] [DEBUG] [LOCAL ] IGA: Loaded 9830 existing records from primary storage. [2025-10-02T19:33:58.500133] [INFO ] [MAIN ] IGA: Loaded 9830 existing records. [2025-10-02T19:33:58.673100] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-03. [2025-10-02T19:33:58.695428] [WARN ] [MAIN ] IGA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:33:58.696583] [INFO ] [MAIN ] IGA: Wiping existing primary data before full refresh. [2025-10-02T19:33:58.696676] [INFO ] [LOCAL ] IGA: Starting deletion of primary data. [2025-10-02T19:33:58.697324] [DEBUG] [LOCAL ] IGA: Deleted primary data file. [2025-10-02T19:33:58.697444] [INFO ] [MAIN ] IGA: Starting full primary refresh. [2025-10-02T19:33:59.148875] [INFO ] [REMOTE ] IGA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:33:59.252479] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-02T19:33:59.473019] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-01. [2025-10-02T19:33:59.734829] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-02T19:34:00.273009] [INFO ] [REMOTE ] IGA: Fetching primary data for 2024-12. [2025-10-02T19:34:00.446337] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-02T19:34:01.073074] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-04. [2025-10-02T19:34:01.274366] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-02T19:34:01.873028] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-03. [2025-10-02T19:34:02.179587] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-02T19:34:02.673030] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-05. [2025-10-02T19:34:03.472989] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-01. [2025-10-02T19:34:03.745269] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-02T19:34:03.769391] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-02T19:34:04.237884] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-02T19:34:04.273033] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-02. [2025-10-02T19:34:05.072988] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-06. [2025-10-02T19:34:05.368400] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-02T19:34:05.873016] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-03. [2025-10-02T19:34:06.023350] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-02T19:34:06.673027] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-02. [2025-10-02T19:34:06.976923] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-02T19:34:07.441596] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-02T19:34:07.472998] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-04. [2025-10-02T19:34:08.273008] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-03. [2025-10-02T19:34:09.009113] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-02T19:34:09.073050] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-07. [2025-10-02T19:34:09.296898] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-02T19:34:09.872997] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-04. [2025-10-02T19:34:10.282725] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-02T19:34:10.655072] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-02T19:34:10.672940] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-05. [2025-10-02T19:34:11.410404] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-02T19:34:11.473005] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-06. [2025-10-02T19:34:12.267203] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-02T19:34:12.272950] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-07. [2025-10-02T19:34:13.075989] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-05. [2025-10-02T19:34:13.078773] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-02T19:34:13.872986] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-08. [2025-10-02T19:34:14.683967] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-08. [2025-10-02T19:34:14.690218] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-02T19:34:14.709826] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-02T19:34:15.473040] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-04. [2025-10-02T19:34:16.036022] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-02T19:34:16.273005] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-09. [2025-10-02T19:34:16.306695] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-02T19:34:17.072997] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-05. [2025-10-02T19:34:17.218510] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-02T19:34:17.873036] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-06. [2025-10-02T19:34:18.210347] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-02T19:34:18.673022] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-06. [2025-10-02T19:34:19.130937] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-02T19:34:19.473029] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-07. [2025-10-02T19:34:19.765781] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-02T19:34:20.273034] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-07. [2025-10-02T19:34:21.072988] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-09. [2025-10-02T19:34:21.241979] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-02T19:34:21.376492] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-02T19:34:21.873028] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-08. [2025-10-02T19:34:22.673008] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-10. [2025-10-02T19:34:23.322157] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-02T19:34:23.323233] [INFO ] [REMOTE ] IGA: Full fetch complete (13746 records). [2025-10-02T19:34:23.323309] [DEBUG] [VALIDATOR ] IGA: Validating primary data. [2025-10-02T19:34:23.479179] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-08. [2025-10-02T19:34:23.736390] [DEBUG] [VALIDATOR ] IGA: All expected trading days are present. [2025-10-02T19:34:23.736473] [DEBUG] [VALIDATOR ] IGA: Primary data validation passed. [2025-10-02T19:34:23.736862] [INFO ] [MAIN ] IGA: Fetched primary data is valid. [2025-10-02T19:34:23.736929] [DEBUG] [LOCAL ] IGA: Saving primary data. [2025-10-02T19:34:23.737692] [DEBUG] [LOCAL ] IGA: Trimmed 13746 records to 9918 (keeping 200 days of data) [2025-10-02T19:34:23.805341] [DEBUG] [LOCAL ] IGA: Primary data saved (9918 records). [2025-10-02T19:34:23.805490] [INFO ] [MAIN ] IGA: Full history saved. [2025-10-02T19:34:23.805629] [INFO ] [MAIN ] Update Progress: 1092/2370 symbols completed. IGA took 25.5s. Estimated remaining: 3h 0m 37s. Rate: 7.1 symbols/min [2025-10-02T19:34:23.995739] [INFO ] [MAIN ] IGD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:34:24.015312] [DEBUG] [LOCAL ] IGD: Loaded 19065 existing records from primary storage. [2025-10-02T19:34:24.015595] [INFO ] [MAIN ] IGD: Loaded 19065 existing records. [2025-10-02T19:34:24.224045] [WARN ] [MAIN ] IGD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:34:24.224304] [INFO ] [MAIN ] IGD: Wiping existing primary data before full refresh. [2025-10-02T19:34:24.224362] [INFO ] [LOCAL ] IGD: Starting deletion of primary data. [2025-10-02T19:34:24.225746] [DEBUG] [LOCAL ] IGD: Deleted primary data file. [2025-10-02T19:34:24.225858] [INFO ] [MAIN ] IGD: Starting full primary refresh. [2025-10-02T19:34:24.726283] [INFO ] [REMOTE ] IGD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:34:24.726852] [INFO ] [REMOTE ] IGD: Fetching primary data for 2024-12. [2025-10-02T19:34:25.134777] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-02T19:34:25.151481] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-09. [2025-10-02T19:34:25.799386] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-09 (4.73 seconds). [2025-10-02T19:34:25.878308] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-10. [2025-10-02T19:34:25.879309] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-02T19:34:26.326247] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-08 (4.45 seconds). [2025-10-02T19:34:26.672994] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-01. [2025-10-02T19:34:26.728500] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-02T19:34:27.002260] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-02T19:34:27.003556] [INFO ] [REMOTE ] IFN: Full fetch complete (29071 records). [2025-10-02T19:34:27.003739] [DEBUG] [VALIDATOR ] IFN: Validating primary data. [2025-10-02T19:34:27.427334] [DEBUG] [VALIDATOR ] IFN: All expected trading days are present. [2025-10-02T19:34:27.427427] [DEBUG] [VALIDATOR ] IFN: Primary data validation passed. [2025-10-02T19:34:27.428354] [INFO ] [MAIN ] IFN: Fetched primary data is valid. [2025-10-02T19:34:27.428428] [DEBUG] [LOCAL ] IFN: Saving primary data. [2025-10-02T19:34:27.429576] [DEBUG] [LOCAL ] IFN: Trimmed 29071 records to 18372 (keeping 200 days of data) [2025-10-02T19:34:27.485797] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-09. [2025-10-02T19:34:27.560112] [DEBUG] [LOCAL ] IFN: Primary data saved (18372 records). [2025-10-02T19:34:27.560290] [INFO ] [MAIN ] IFN: Full history saved. [2025-10-02T19:34:27.560450] [INFO ] [MAIN ] Update Progress: 1093/2370 symbols completed. IFN took 39.0s. Estimated remaining: 3h 0m 23s. Rate: 7.1 symbols/min [2025-10-02T19:34:27.755174] [INFO ] [MAIN ] IGI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:34:27.775714] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-02T19:34:27.784821] [DEBUG] [LOCAL ] IGI: Loaded 3604 existing records from primary storage. [2025-10-02T19:34:27.785543] [INFO ] [MAIN ] IGI: Loaded 3604 existing records. [2025-10-02T19:34:27.983796] [WARN ] [MAIN ] IGI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:34:27.984002] [INFO ] [MAIN ] IGI: Wiping existing primary data before full refresh. [2025-10-02T19:34:27.984051] [INFO ] [LOCAL ] IGI: Starting deletion of primary data. [2025-10-02T19:34:27.984378] [DEBUG] [LOCAL ] IGI: Deleted primary data file. [2025-10-02T19:34:27.984446] [INFO ] [MAIN ] IGI: Starting full primary refresh. [2025-10-02T19:34:28.280452] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-10. [2025-10-02T19:34:28.407434] [INFO ] [REMOTE ] IGI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:34:28.622089] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-02T19:34:29.072992] [INFO ] [REMOTE ] IGI: Fetching primary data for 2024-12. [2025-10-02T19:34:29.647018] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-02T19:34:29.873036] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-10. [2025-10-02T19:34:30.136621] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-02T19:34:30.138870] [INFO ] [REMOTE ] IFF: Full fetch complete (73046 records). [2025-10-02T19:34:30.139030] [DEBUG] [VALIDATOR ] IFF: Validating primary data. [2025-10-02T19:34:30.568150] [DEBUG] [VALIDATOR ] IFF: All expected trading days are present. [2025-10-02T19:34:30.568312] [DEBUG] [VALIDATOR ] IFF: Primary data validation passed. [2025-10-02T19:34:30.569272] [INFO ] [MAIN ] IFF: Fetched primary data is valid. [2025-10-02T19:34:30.569337] [DEBUG] [LOCAL ] IFF: Saving primary data. [2025-10-02T19:34:30.570843] [DEBUG] [LOCAL ] IFF: Trimmed 73046 records to 51357 (keeping 200 days of data) [2025-10-02T19:34:30.676702] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-02. [2025-10-02T19:34:30.846604] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-02T19:34:30.849139] [INFO ] [REMOTE ] IFS: Full fetch complete (31658 records). [2025-10-02T19:34:30.850372] [DEBUG] [VALIDATOR ] IFS: Validating primary data. [2025-10-02T19:34:31.343712] [DEBUG] [VALIDATOR ] IFS: All expected trading days are present. [2025-10-02T19:34:31.344927] [DEBUG] [VALIDATOR ] IFS: Primary data validation passed. [2025-10-02T19:34:31.347750] [INFO ] [MAIN ] IFS: Fetched primary data is valid. [2025-10-02T19:34:31.348364] [DEBUG] [LOCAL ] IFS: Saving primary data. [2025-10-02T19:34:31.351881] [DEBUG] [LOCAL ] IFS: Trimmed 31658 records to 23264 (keeping 200 days of data) [2025-10-02T19:34:31.447210] [DEBUG] [LOCAL ] IFF: Primary data saved (51357 records). [2025-10-02T19:34:31.448070] [INFO ] [MAIN ] IFF: Full history saved. [2025-10-02T19:34:31.448525] [INFO ] [MAIN ] Update Progress: 1094/2370 symbols completed. IFF took 44.5s. Estimated remaining: 3h 0m 9s. Rate: 7.1 symbols/min [2025-10-02T19:34:31.484044] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-01. [2025-10-02T19:34:31.624045] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-02T19:34:31.700087] [INFO ] [MAIN ] IGR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:34:31.759813] [DEBUG] [LOCAL ] IGR: Loaded 30496 existing records from primary storage. [2025-10-02T19:34:31.761099] [INFO ] [MAIN ] IGR: Loaded 30496 existing records. [2025-10-02T19:34:31.899771] [DEBUG] [LOCAL ] IFS: Primary data saved (23264 records). [2025-10-02T19:34:31.910146] [INFO ] [MAIN ] IFS: Full history saved. [2025-10-02T19:34:31.926440] [INFO ] [MAIN ] Update Progress: 1095/2370 symbols completed. IFS took 38.9s. Estimated remaining: 2h 59m 52s. Rate: 7.1 symbols/min [2025-10-02T19:34:32.067858] [WARN ] [MAIN ] IGR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:34:32.087466] [INFO ] [MAIN ] IGR: Wiping existing primary data before full refresh. [2025-10-02T19:34:32.064437] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-02T19:34:32.087667] [INFO ] [LOCAL ] IGR: Starting deletion of primary data. [2025-10-02T19:34:32.095619] [DEBUG] [LOCAL ] IGR: Deleted primary data file. [2025-10-02T19:34:32.105944] [INFO ] [MAIN ] IGR: Starting full primary refresh. [2025-10-02T19:34:32.281987] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-02. [2025-10-02T19:34:32.276747] [INFO ] [MAIN ] IH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:34:32.366233] [DEBUG] [LOCAL ] IH: Loaded 3116 existing records from primary storage. [2025-10-02T19:34:32.383135] [INFO ] [MAIN ] IH: Loaded 3116 existing records. [2025-10-02T19:34:32.735752] [WARN ] [MAIN ] IH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:34:32.753251] [INFO ] [MAIN ] IH: Wiping existing primary data before full refresh. [2025-10-02T19:34:32.774282] [INFO ] [LOCAL ] IH: Starting deletion of primary data. [2025-10-02T19:34:32.802677] [INFO ] [REMOTE ] IGR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:34:32.795391] [DEBUG] [LOCAL ] IH: Deleted primary data file. [2025-10-02T19:34:32.803230] [INFO ] [MAIN ] IH: Starting full primary refresh. [2025-10-02T19:34:32.867003] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-02T19:34:33.078115] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-03. [2025-10-02T19:34:33.197763] [INFO ] [REMOTE ] IH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:34:33.724103] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-02T19:34:33.873001] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-04. [2025-10-02T19:34:34.330134] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-02T19:34:34.673031] [INFO ] [REMOTE ] IH: Fetching primary data for 2024-12. [2025-10-02T19:34:35.247158] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-02T19:34:35.473046] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-01. [2025-10-02T19:34:35.921487] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-02T19:34:36.273053] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-02. [2025-10-02T19:34:36.859226] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-02T19:34:37.073040] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-05. [2025-10-02T19:34:37.873023] [INFO ] [REMOTE ] IGR: Fetching primary data for 2024-12. [2025-10-02T19:34:38.673004] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-03. [2025-10-02T19:34:39.473046] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-03. [2025-10-02T19:34:39.507804] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-02T19:34:39.513894] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-02T19:34:40.272971] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-01. [2025-10-02T19:34:40.617195] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-02T19:34:41.073056] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-04. [2025-10-02T19:34:41.516020] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-02T19:34:41.717944] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-02T19:34:41.872986] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-02. [2025-10-02T19:34:42.673040] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-05. [2025-10-02T19:34:42.935483] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-10-02T19:34:43.120340] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-02T19:34:43.473014] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-03. [2025-10-02T19:34:44.058772] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-05 (6.99 seconds). [2025-10-02T19:34:44.273022] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-04. [2025-10-02T19:34:44.879243] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-02T19:34:45.073026] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-06. [2025-10-02T19:34:45.333864] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-02T19:34:45.529463] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-02T19:34:45.873045] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-04. [2025-10-02T19:34:46.673011] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-07. [2025-10-02T19:34:47.238253] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-02T19:34:47.251820] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-02T19:34:47.473039] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-08. [2025-10-02T19:34:48.049858] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-02T19:34:48.273032] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-05. [2025-10-02T19:34:49.072996] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-06. [2025-10-02T19:34:49.391304] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-02T19:34:49.804061] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-02T19:34:49.873012] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-06. [2025-10-02T19:34:50.673040] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-05. [2025-10-02T19:34:50.937176] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-02T19:34:51.473008] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-07. [2025-10-02T19:34:51.621039] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-02T19:34:51.837249] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-02T19:34:52.273013] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-09. [2025-10-02T19:34:52.738358] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-02T19:34:53.073030] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-06. [2025-10-02T19:34:53.872999] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-08. [2025-10-02T19:34:54.106254] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-02T19:34:54.486759] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-02T19:34:54.673005] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-10. [2025-10-02T19:34:55.101665] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-02T19:34:55.102428] [INFO ] [REMOTE ] IH: Full fetch complete (4974 records). [2025-10-02T19:34:55.102506] [DEBUG] [VALIDATOR ] IH: Validating primary data. [2025-10-02T19:34:55.478235] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-07. [2025-10-02T19:34:55.521203] [DEBUG] [VALIDATOR ] IH: All expected trading days are present. [2025-10-02T19:34:55.521319] [DEBUG] [VALIDATOR ] IH: Primary data validation passed. [2025-10-02T19:34:55.522531] [INFO ] [MAIN ] IH: Fetched primary data is valid. [2025-10-02T19:34:55.522601] [DEBUG] [LOCAL ] IH: Saving primary data. [2025-10-02T19:34:55.523032] [DEBUG] [LOCAL ] IH: Trimmed 4974 records to 3128 (keeping 200 days of data) [2025-10-02T19:34:55.543162] [DEBUG] [LOCAL ] IH: Primary data saved (3128 records). [2025-10-02T19:34:55.543253] [INFO ] [MAIN ] IH: Full history saved. [2025-10-02T19:34:55.543335] [INFO ] [MAIN ] Update Progress: 1096/2370 symbols completed. IH took 23.6s. Estimated remaining: 3h 0m 1s. Rate: 7.1 symbols/min [2025-10-02T19:34:55.742589] [INFO ] [MAIN ] IHD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:34:55.752322] [DEBUG] [LOCAL ] IHD: Loaded 6958 existing records from primary storage. [2025-10-02T19:34:55.752584] [INFO ] [MAIN ] IHD: Loaded 6958 existing records. [2025-10-02T19:34:55.942846] [WARN ] [MAIN ] IHD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:34:55.943168] [INFO ] [MAIN ] IHD: Wiping existing primary data before full refresh. [2025-10-02T19:34:55.943229] [INFO ] [LOCAL ] IHD: Starting deletion of primary data. [2025-10-02T19:34:55.943999] [DEBUG] [LOCAL ] IHD: Deleted primary data file. [2025-10-02T19:34:55.944068] [INFO ] [MAIN ] IHD: Starting full primary refresh. [2025-10-02T19:34:56.278213] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-07. [2025-10-02T19:34:56.338284] [INFO ] [REMOTE ] IHD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:34:56.809963] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-02T19:34:57.073002] [INFO ] [REMOTE ] IHD: Fetching primary data for 2024-12. [2025-10-02T19:34:57.472080] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-02T19:34:57.643711] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-02T19:34:57.873017] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-09. [2025-10-02T19:34:58.427989] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-02T19:34:58.673006] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-08. [2025-10-02T19:34:59.473029] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-01. [2025-10-02T19:34:59.744593] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-02T19:35:00.272992] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-10. [2025-10-02T19:35:00.389588] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-02T19:35:01.073057] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-08. [2025-10-02T19:35:01.197392] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-02T19:35:01.198563] [INFO ] [REMOTE ] IGI: Full fetch complete (5293 records). [2025-10-02T19:35:01.198740] [DEBUG] [VALIDATOR ] IGI: Validating primary data. [2025-10-02T19:35:01.629700] [DEBUG] [VALIDATOR ] IGI: All expected trading days are present. [2025-10-02T19:35:01.629835] [DEBUG] [VALIDATOR ] IGI: Primary data validation passed. [2025-10-02T19:35:01.630016] [INFO ] [MAIN ] IGI: Fetched primary data is valid. [2025-10-02T19:35:01.630060] [DEBUG] [LOCAL ] IGI: Saving primary data. [2025-10-02T19:35:01.630734] [DEBUG] [LOCAL ] IGI: Trimmed 5293 records to 3658 (keeping 200 days of data) [2025-10-02T19:35:01.655234] [DEBUG] [LOCAL ] IGI: Primary data saved (3658 records). [2025-10-02T19:35:01.655349] [INFO ] [MAIN ] IGI: Full history saved. [2025-10-02T19:35:01.655441] [INFO ] [MAIN ] Update Progress: 1097/2370 symbols completed. IGI took 34.1s. Estimated remaining: 2h 59m 50s. Rate: 7.1 symbols/min [2025-10-02T19:35:01.875536] [INFO ] [MAIN ] IHG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:35:01.875707] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-02. [2025-10-02T19:35:01.902220] [DEBUG] [LOCAL ] IHG: Loaded 24438 existing records from primary storage. [2025-10-02T19:35:01.902489] [INFO ] [MAIN ] IHG: Loaded 24438 existing records. [2025-10-02T19:35:02.114509] [WARN ] [MAIN ] IHG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:35:02.114743] [INFO ] [MAIN ] IHG: Wiping existing primary data before full refresh. [2025-10-02T19:35:02.114798] [INFO ] [LOCAL ] IHG: Starting deletion of primary data. [2025-10-02T19:35:02.116013] [DEBUG] [LOCAL ] IHG: Deleted primary data file. [2025-10-02T19:35:02.116076] [INFO ] [MAIN ] IHG: Starting full primary refresh. [2025-10-02T19:35:02.527531] [INFO ] [REMOTE ] IHG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:35:02.640982] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-02T19:35:02.648043] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-02T19:35:02.672988] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-03. [2025-10-02T19:35:03.429304] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-02T19:35:03.473014] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-09. [2025-10-02T19:35:04.273032] [INFO ] [REMOTE ] IHG: Fetching primary data for 2024-12. [2025-10-02T19:35:04.823036] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-02T19:35:05.072965] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-10. [2025-10-02T19:35:05.221928] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-02T19:35:05.873007] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-04. [2025-10-02T19:35:06.255267] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-02T19:35:06.256617] [INFO ] [REMOTE ] IGR: Full fetch complete (45700 records). [2025-10-02T19:35:06.256724] [DEBUG] [VALIDATOR ] IGR: Validating primary data. [2025-10-02T19:35:06.588425] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-02T19:35:06.673019] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-05. [2025-10-02T19:35:06.687741] [DEBUG] [VALIDATOR ] IGR: All expected trading days are present. [2025-10-02T19:35:06.687839] [DEBUG] [VALIDATOR ] IGR: Primary data validation passed. [2025-10-02T19:35:06.688723] [INFO ] [MAIN ] IGR: Fetched primary data is valid. [2025-10-02T19:35:06.688889] [DEBUG] [LOCAL ] IGR: Saving primary data. [2025-10-02T19:35:06.690091] [DEBUG] [LOCAL ] IGR: Trimmed 45700 records to 30686 (keeping 200 days of data) [2025-10-02T19:35:06.884027] [DEBUG] [LOCAL ] IGR: Primary data saved (30686 records). [2025-10-02T19:35:06.884180] [INFO ] [MAIN ] IGR: Full history saved. [2025-10-02T19:35:06.884270] [INFO ] [MAIN ] Update Progress: 1098/2370 symbols completed. IGR took 35.4s. Estimated remaining: 2h 59m 37s. Rate: 7.1 symbols/min [2025-10-02T19:35:07.073859] [INFO ] [MAIN ] IHS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:35:07.111847] [DEBUG] [LOCAL ] IHS: Loaded 39149 existing records from primary storage. [2025-10-02T19:35:07.112172] [INFO ] [MAIN ] IHS: Loaded 39149 existing records. [2025-10-02T19:35:07.316114] [WARN ] [MAIN ] IHS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:35:07.316470] [INFO ] [MAIN ] IHS: Wiping existing primary data before full refresh. [2025-10-02T19:35:07.316578] [INFO ] [LOCAL ] IHS: Starting deletion of primary data. [2025-10-02T19:35:07.317814] [DEBUG] [LOCAL ] IHS: Deleted primary data file. [2025-10-02T19:35:07.317909] [INFO ] [MAIN ] IHS: Starting full primary refresh. [2025-10-02T19:35:07.475086] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-01. [2025-10-02T19:35:07.643542] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-02T19:35:07.729847] [INFO ] [REMOTE ] IHS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:35:08.272998] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-09. [2025-10-02T19:35:08.627728] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-02T19:35:08.964222] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-02T19:35:09.073038] [INFO ] [REMOTE ] IHS: Fetching primary data for 2024-12. [2025-10-02T19:35:09.873004] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-06. [2025-10-02T19:35:10.595145] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-02T19:35:10.672982] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-07. [2025-10-02T19:35:10.711480] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-02T19:35:11.397750] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-02T19:35:11.473023] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-02. [2025-10-02T19:35:12.272992] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-08. [2025-10-02T19:35:12.676080] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-02T19:35:12.867634] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-02T19:35:13.073003] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-09. [2025-10-02T19:35:13.598604] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-02T19:35:13.872995] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-10. [2025-10-02T19:35:14.358617] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-02T19:35:14.359519] [INFO ] [REMOTE ] IHD: Full fetch complete (11759 records). [2025-10-02T19:35:14.359593] [DEBUG] [VALIDATOR ] IHD: Validating primary data. [2025-10-02T19:35:14.678465] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-10. [2025-10-02T19:35:14.774418] [DEBUG] [VALIDATOR ] IHD: All expected trading days are present. [2025-10-02T19:35:14.774498] [DEBUG] [VALIDATOR ] IHD: Primary data validation passed. [2025-10-02T19:35:14.774822] [INFO ] [MAIN ] IHD: Fetched primary data is valid. [2025-10-02T19:35:14.774885] [DEBUG] [LOCAL ] IHD: Saving primary data. [2025-10-02T19:35:14.775387] [DEBUG] [LOCAL ] IHD: Trimmed 11759 records to 6998 (keeping 200 days of data) [2025-10-02T19:35:14.821844] [DEBUG] [LOCAL ] IHD: Primary data saved (6998 records). [2025-10-02T19:35:14.822025] [INFO ] [MAIN ] IHD: Full history saved. [2025-10-02T19:35:14.822125] [INFO ] [MAIN ] Update Progress: 1099/2370 symbols completed. IHD took 19.3s. Estimated remaining: 2h 59m 28s. Rate: 7.1 symbols/min [2025-10-02T19:35:15.000318] [INFO ] [MAIN ] IIF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:35:15.007259] [DEBUG] [LOCAL ] IIF: Loaded 5723 existing records from primary storage. [2025-10-02T19:35:15.007450] [INFO ] [MAIN ] IIF: Loaded 5723 existing records. [2025-10-02T19:35:15.201518] [WARN ] [MAIN ] IIF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:35:15.201747] [INFO ] [MAIN ] IIF: Wiping existing primary data before full refresh. [2025-10-02T19:35:15.201802] [INFO ] [LOCAL ] IIF: Starting deletion of primary data. [2025-10-02T19:35:15.202114] [DEBUG] [LOCAL ] IIF: Deleted primary data file. [2025-10-02T19:35:15.202216] [INFO ] [MAIN ] IIF: Starting full primary refresh. [2025-10-02T19:35:15.478099] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-03. [2025-10-02T19:35:15.600365] [INFO ] [REMOTE ] IIF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:35:15.759222] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-02T19:35:15.760706] [INFO ] [REMOTE ] IGD: Full fetch complete (29782 records). [2025-10-02T19:35:15.760798] [DEBUG] [VALIDATOR ] IGD: Validating primary data. [2025-10-02T19:35:16.174508] [DEBUG] [VALIDATOR ] IGD: All expected trading days are present. [2025-10-02T19:35:16.174591] [DEBUG] [VALIDATOR ] IGD: Primary data validation passed. [2025-10-02T19:35:16.175248] [INFO ] [MAIN ] IGD: Fetched primary data is valid. [2025-10-02T19:35:16.175323] [DEBUG] [LOCAL ] IGD: Saving primary data. [2025-10-02T19:35:16.176169] [DEBUG] [LOCAL ] IGD: Trimmed 29782 records to 19256 (keeping 200 days of data) [2025-10-02T19:35:16.272971] [INFO ] [REMOTE ] IIF: Fetching primary data for 2024-12. [2025-10-02T19:35:16.295539] [DEBUG] [LOCAL ] IGD: Primary data saved (19256 records). [2025-10-02T19:35:16.295697] [INFO ] [MAIN ] IGD: Full history saved. [2025-10-02T19:35:16.295791] [INFO ] [MAIN ] Update Progress: 1100/2370 symbols completed. IGD took 52.5s. Estimated remaining: 2h 59m 12s. Rate: 7.1 symbols/min [2025-10-02T19:35:16.478923] [INFO ] [MAIN ] IIIN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:35:16.498533] [DEBUG] [LOCAL ] IIIN: Loaded 16358 existing records from primary storage. [2025-10-02T19:35:16.498825] [INFO ] [MAIN ] IIIN: Loaded 16358 existing records. [2025-10-02T19:35:16.743941] [WARN ] [MAIN ] IIIN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:35:16.744285] [INFO ] [MAIN ] IIIN: Wiping existing primary data before full refresh. [2025-10-02T19:35:16.744364] [INFO ] [LOCAL ] IIIN: Starting deletion of primary data. [2025-10-02T19:35:16.750891] [DEBUG] [LOCAL ] IIIN: Deleted primary data file. [2025-10-02T19:35:16.762875] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-02T19:35:16.761958] [INFO ] [MAIN ] IIIN: Starting full primary refresh. [2025-10-02T19:35:17.078407] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-01. [2025-10-02T19:35:17.219520] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-02T19:35:17.354302] [INFO ] [REMOTE ] IIIN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:35:17.873045] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-01. [2025-10-02T19:35:18.132956] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-02T19:35:18.655566] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-02T19:35:18.672973] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-02. [2025-10-02T19:35:19.473007] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-02. [2025-10-02T19:35:19.800002] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-02T19:35:20.034838] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-02T19:35:20.272997] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2024-12. [2025-10-02T19:35:21.073015] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-03. [2025-10-02T19:35:21.712853] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-02T19:35:21.872994] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-01. [2025-10-02T19:35:22.633126] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-02T19:35:22.672967] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-04. [2025-10-02T19:35:23.473015] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-03. [2025-10-02T19:35:24.039495] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-02T19:35:24.040351] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-02T19:35:24.273017] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-05. [2025-10-02T19:35:25.073021] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-04. [2025-10-02T19:35:25.557081] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-02T19:35:25.873030] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-06. [2025-10-02T19:35:26.273902] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-02T19:35:26.327822] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-01 (4.45 seconds). [2025-10-02T19:35:26.550948] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-02T19:35:26.673003] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-05. [2025-10-02T19:35:27.473012] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-02. [2025-10-02T19:35:28.185073] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-02T19:35:28.273002] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-07. [2025-10-02T19:35:28.371062] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-02T19:35:29.073054] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-03. [2025-10-02T19:35:29.605079] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-02T19:35:29.873015] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-08. [2025-10-02T19:35:29.893587] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-02T19:35:30.673002] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-06. [2025-10-02T19:35:30.967608] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-02T19:35:31.473052] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-04. [2025-10-02T19:35:32.103474] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-02T19:35:32.251339] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-02T19:35:32.272966] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-05. [2025-10-02T19:35:32.972662] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-02T19:35:33.073059] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-04. [2025-10-02T19:35:33.873002] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-09. [2025-10-02T19:35:34.162589] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-02T19:35:34.673055] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-07. [2025-10-02T19:35:35.030615] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-02T19:35:35.473044] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-10. [2025-10-02T19:35:35.783758] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-02T19:35:36.273002] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-06. [2025-10-02T19:35:36.511721] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-02T19:35:36.513107] [INFO ] [REMOTE ] IHG: Full fetch complete (33815 records). [2025-10-02T19:35:36.513194] [DEBUG] [VALIDATOR ] IHG: Validating primary data. [2025-10-02T19:35:36.912483] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-02T19:35:36.952226] [DEBUG] [VALIDATOR ] IHG: All expected trading days are present. [2025-10-02T19:35:36.952322] [DEBUG] [VALIDATOR ] IHG: Primary data validation passed. [2025-10-02T19:35:36.953158] [INFO ] [MAIN ] IHG: Fetched primary data is valid. [2025-10-02T19:35:36.953235] [DEBUG] [LOCAL ] IHG: Saving primary data. [2025-10-02T19:35:36.954333] [DEBUG] [LOCAL ] IHG: Trimmed 33815 records to 24606 (keeping 200 days of data) [2025-10-02T19:35:37.073055] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-07. [2025-10-02T19:35:37.126992] [DEBUG] [LOCAL ] IHG: Primary data saved (24606 records). [2025-10-02T19:35:37.127141] [INFO ] [MAIN ] IHG: Full history saved. [2025-10-02T19:35:37.127245] [INFO ] [MAIN ] Update Progress: 1101/2370 symbols completed. IHG took 35.5s. Estimated remaining: 2h 59m 17s. Rate: 7.1 symbols/min [2025-10-02T19:35:37.317030] [INFO ] [MAIN ] IIM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:35:37.334442] [DEBUG] [LOCAL ] IIM: Loaded 16041 existing records from primary storage. [2025-10-02T19:35:37.334718] [INFO ] [MAIN ] IIM: Loaded 16041 existing records. [2025-10-02T19:35:37.521112] [WARN ] [MAIN ] IIM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:35:37.521379] [INFO ] [MAIN ] IIM: Wiping existing primary data before full refresh. [2025-10-02T19:35:37.521435] [INFO ] [LOCAL ] IIM: Starting deletion of primary data. [2025-10-02T19:35:37.522194] [DEBUG] [LOCAL ] IIM: Deleted primary data file. [2025-10-02T19:35:37.522258] [INFO ] [MAIN ] IIM: Starting full primary refresh. [2025-10-02T19:35:37.815350] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-02T19:35:37.878114] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-05. [2025-10-02T19:35:37.959246] [INFO ] [REMOTE ] IIM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:35:38.672981] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-08. [2025-10-02T19:35:38.863571] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-02T19:35:39.473008] [INFO ] [REMOTE ] IIM: Fetching primary data for 2024-12. [2025-10-02T19:35:39.734195] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-02T19:35:40.273037] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-08. [2025-10-02T19:35:40.688291] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-02T19:35:40.884469] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-02T19:35:41.073072] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-06. [2025-10-02T19:35:41.873042] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-01. [2025-10-02T19:35:41.900710] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-02T19:35:42.673039] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-09. [2025-10-02T19:35:42.932530] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-02T19:35:43.237966] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-02T19:35:43.473045] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-02. [2025-10-02T19:35:44.273000] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-10. [2025-10-02T19:35:44.553929] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-02T19:35:44.697020] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-02T19:35:44.697824] [INFO ] [REMOTE ] IIF: Full fetch complete (9391 records). [2025-10-02T19:35:44.697934] [DEBUG] [VALIDATOR ] IIF: Validating primary data. [2025-10-02T19:35:45.079494] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-09. [2025-10-02T19:35:45.089420] [DEBUG] [VALIDATOR ] IIF: All expected trading days are present. [2025-10-02T19:35:45.089529] [DEBUG] [VALIDATOR ] IIF: Primary data validation passed. [2025-10-02T19:35:45.089828] [INFO ] [MAIN ] IIF: Fetched primary data is valid. [2025-10-02T19:35:45.089909] [DEBUG] [LOCAL ] IIF: Saving primary data. [2025-10-02T19:35:45.090448] [DEBUG] [LOCAL ] IIF: Trimmed 9391 records to 5734 (keeping 200 days of data) [2025-10-02T19:35:45.126348] [DEBUG] [LOCAL ] IIF: Primary data saved (5734 records). [2025-10-02T19:35:45.126483] [INFO ] [MAIN ] IIF: Full history saved. [2025-10-02T19:35:45.126570] [INFO ] [MAIN ] Update Progress: 1102/2370 symbols completed. IIF took 30.3s. Estimated remaining: 2h 59m 8s. Rate: 7.1 symbols/min [2025-10-02T19:35:45.312462] [INFO ] [MAIN ] IIPR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:35:45.350097] [DEBUG] [LOCAL ] IIPR: Loaded 29798 existing records from primary storage. [2025-10-02T19:35:45.350379] [INFO ] [MAIN ] IIPR: Loaded 29798 existing records. [2025-10-02T19:35:45.546042] [WARN ] [MAIN ] IIPR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:35:45.546327] [INFO ] [MAIN ] IIPR: Wiping existing primary data before full refresh. [2025-10-02T19:35:45.546406] [INFO ] [LOCAL ] IIPR: Starting deletion of primary data. [2025-10-02T19:35:45.547771] [DEBUG] [LOCAL ] IIPR: Deleted primary data file. [2025-10-02T19:35:45.547851] [INFO ] [MAIN ] IIPR: Starting full primary refresh. [2025-10-02T19:35:45.878117] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-07. [2025-10-02T19:35:45.951435] [INFO ] [REMOTE ] IIPR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:35:46.322403] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-02T19:35:46.672977] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-10. [2025-10-02T19:35:46.980260] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-02T19:35:47.473006] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-08. [2025-10-02T19:35:47.761218] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-02T19:35:47.762785] [INFO ] [REMOTE ] IHS: Full fetch complete (51732 records). [2025-10-02T19:35:47.762889] [DEBUG] [VALIDATOR ] IHS: Validating primary data. [2025-10-02T19:35:48.194494] [DEBUG] [VALIDATOR ] IHS: All expected trading days are present. [2025-10-02T19:35:48.194602] [DEBUG] [VALIDATOR ] IHS: Primary data validation passed. [2025-10-02T19:35:48.195445] [INFO ] [MAIN ] IHS: Fetched primary data is valid. [2025-10-02T19:35:48.195505] [DEBUG] [LOCAL ] IHS: Saving primary data. [2025-10-02T19:35:48.196695] [DEBUG] [LOCAL ] IHS: Trimmed 51732 records to 39304 (keeping 200 days of data) [2025-10-02T19:35:48.277062] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2024-12. [2025-10-02T19:35:48.401956] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-02T19:35:48.441624] [DEBUG] [LOCAL ] IHS: Primary data saved (39304 records). [2025-10-02T19:35:48.441827] [INFO ] [MAIN ] IHS: Full history saved. [2025-10-02T19:35:48.441923] [INFO ] [MAIN ] Update Progress: 1103/2370 symbols completed. IHS took 41.6s. Estimated remaining: 2h 58m 54s. Rate: 7.1 symbols/min [2025-10-02T19:35:48.625950] [INFO ] [MAIN ] IMAX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:35:48.666547] [DEBUG] [LOCAL ] IMAX: Loaded 42818 existing records from primary storage. [2025-10-02T19:35:48.666912] [INFO ] [MAIN ] IMAX: Loaded 42818 existing records. [2025-10-02T19:35:48.866420] [WARN ] [MAIN ] IMAX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:35:48.866732] [INFO ] [MAIN ] IMAX: Wiping existing primary data before full refresh. [2025-10-02T19:35:48.866799] [INFO ] [LOCAL ] IMAX: Starting deletion of primary data. [2025-10-02T19:35:48.868307] [DEBUG] [LOCAL ] IMAX: Deleted primary data file. [2025-10-02T19:35:48.868369] [INFO ] [MAIN ] IMAX: Starting full primary refresh. [2025-10-02T19:35:49.078236] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-09. [2025-10-02T19:35:49.262045] [INFO ] [REMOTE ] IMAX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:35:49.756756] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-02T19:35:49.873017] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-03. [2025-10-02T19:35:50.128557] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-02T19:35:50.672996] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-10. [2025-10-02T19:35:50.862811] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-02T19:35:51.293416] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-02T19:35:51.294497] [INFO ] [REMOTE ] IIIN: Full fetch complete (24907 records). [2025-10-02T19:35:51.294596] [DEBUG] [VALIDATOR ] IIIN: Validating primary data. [2025-10-02T19:35:51.477444] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2024-12. [2025-10-02T19:35:51.708756] [DEBUG] [VALIDATOR ] IIIN: All expected trading days are present. [2025-10-02T19:35:51.708834] [DEBUG] [VALIDATOR ] IIIN: Primary data validation passed. [2025-10-02T19:35:51.709334] [INFO ] [MAIN ] IIIN: Fetched primary data is valid. [2025-10-02T19:35:51.709374] [DEBUG] [LOCAL ] IIIN: Saving primary data. [2025-10-02T19:35:51.710112] [DEBUG] [LOCAL ] IIIN: Trimmed 24907 records to 16475 (keeping 200 days of data) [2025-10-02T19:35:51.814060] [DEBUG] [LOCAL ] IIIN: Primary data saved (16475 records). [2025-10-02T19:35:51.814201] [INFO ] [MAIN ] IIIN: Full history saved. [2025-10-02T19:35:51.814281] [INFO ] [MAIN ] Update Progress: 1104/2370 symbols completed. IIIN took 35.5s. Estimated remaining: 2h 58m 40s. Rate: 7.1 symbols/min [2025-10-02T19:35:51.995869] [INFO ] [MAIN ] INFA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:35:52.051404] [DEBUG] [LOCAL ] INFA: Loaded 49567 existing records from primary storage. [2025-10-02T19:35:52.051774] [INFO ] [MAIN ] INFA: Loaded 49567 existing records. [2025-10-02T19:35:52.243392] [WARN ] [MAIN ] INFA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:35:52.243620] [INFO ] [MAIN ] INFA: Wiping existing primary data before full refresh. [2025-10-02T19:35:52.243705] [INFO ] [LOCAL ] INFA: Starting deletion of primary data. [2025-10-02T19:35:52.246033] [DEBUG] [LOCAL ] INFA: Deleted primary data file. [2025-10-02T19:35:52.246100] [INFO ] [MAIN ] INFA: Starting full primary refresh. [2025-10-02T19:35:52.272994] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-01. [2025-10-02T19:35:52.651909] [INFO ] [REMOTE ] INFA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:35:52.932134] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-02T19:35:53.072994] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-01. [2025-10-02T19:35:53.768562] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-02T19:35:53.873009] [INFO ] [REMOTE ] INFA: Fetching primary data for 2024-12. [2025-10-02T19:35:54.510062] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-02T19:35:54.673001] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-04. [2025-10-02T19:35:55.473022] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-02. [2025-10-02T19:35:55.537222] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-02T19:35:55.635477] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-02T19:35:56.273036] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-01. [2025-10-02T19:35:56.907670] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-02T19:35:57.073030] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-02. [2025-10-02T19:35:57.872970] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-03. [2025-10-02T19:35:58.025347] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-02T19:35:58.328883] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-02T19:35:58.672994] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-03. [2025-10-02T19:35:59.347820] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-02T19:35:59.472988] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-04. [2025-10-02T19:36:00.272978] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-05. [2025-10-02T19:36:00.446846] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-02T19:36:00.913350] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-02T19:36:01.072982] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-05. [2025-10-02T19:36:01.201798] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-02T19:36:01.873038] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-06. [2025-10-02T19:36:02.537339] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-02T19:36:02.566539] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-02T19:36:02.673038] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-06. [2025-10-02T19:36:03.473049] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-07. [2025-10-02T19:36:04.247792] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-02T19:36:04.272982] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-07. [2025-10-02T19:36:04.464997] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-02T19:36:05.073004] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-08. [2025-10-02T19:36:05.873035] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-02. [2025-10-02T19:36:05.933798] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-02T19:36:06.083377] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-02T19:36:06.673019] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-09. [2025-10-02T19:36:07.473028] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-04. [2025-10-02T19:36:07.674239] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-02T19:36:07.764311] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-02T19:36:08.273010] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-10. [2025-10-02T19:36:08.742757] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-02T19:36:09.072976] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-03. [2025-10-02T19:36:09.077959] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-02T19:36:09.079337] [INFO ] [REMOTE ] IIM: Full fetch complete (25563 records). [2025-10-02T19:36:09.079427] [DEBUG] [VALIDATOR ] IIM: Validating primary data. [2025-10-02T19:36:09.584791] [DEBUG] [VALIDATOR ] IIM: All expected trading days are present. [2025-10-02T19:36:09.584930] [DEBUG] [VALIDATOR ] IIM: Primary data validation passed. [2025-10-02T19:36:09.586156] [INFO ] [MAIN ] IIM: Fetched primary data is valid. [2025-10-02T19:36:09.586251] [DEBUG] [LOCAL ] IIM: Saving primary data. [2025-10-02T19:36:09.587461] [DEBUG] [LOCAL ] IIM: Trimmed 25563 records to 16251 (keeping 200 days of data) [2025-10-02T19:36:09.769743] [DEBUG] [LOCAL ] IIM: Primary data saved (16251 records). [2025-10-02T19:36:09.769949] [INFO ] [MAIN ] IIM: Full history saved. [2025-10-02T19:36:09.770087] [INFO ] [MAIN ] Update Progress: 1105/2370 symbols completed. IIM took 32.6s. Estimated remaining: 2h 58m 42s. Rate: 7.1 symbols/min [2025-10-02T19:36:09.878337] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-05. [2025-10-02T19:36:10.039488] [INFO ] [MAIN ] INFY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:36:10.107959] [DEBUG] [LOCAL ] INFY: Loaded 53598 existing records from primary storage. [2025-10-02T19:36:10.108539] [INFO ] [MAIN ] INFY: Loaded 53598 existing records. [2025-10-02T19:36:10.350825] [WARN ] [MAIN ] INFY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:36:10.351086] [INFO ] [MAIN ] INFY: Wiping existing primary data before full refresh. [2025-10-02T19:36:10.351170] [INFO ] [LOCAL ] INFY: Starting deletion of primary data. [2025-10-02T19:36:10.354388] [DEBUG] [LOCAL ] INFY: Deleted primary data file. [2025-10-02T19:36:10.354460] [INFO ] [MAIN ] INFY: Starting full primary refresh. [2025-10-02T19:36:10.673761] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-08. [2025-10-02T19:36:10.769823] [INFO ] [REMOTE ] INFY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:36:10.806348] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-02T19:36:11.162049] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-02T19:36:11.473001] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-06. [2025-10-02T19:36:12.278137] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-04. [2025-10-02T19:36:12.301628] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-02T19:36:12.638094] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-02T19:36:13.073006] [INFO ] [REMOTE ] INFY: Fetching primary data for 2024-12. [2025-10-02T19:36:13.873002] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-09. [2025-10-02T19:36:14.093035] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-02T19:36:14.672969] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-05. [2025-10-02T19:36:14.818007] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-02T19:36:15.192745] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-02T19:36:15.472994] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-01. [2025-10-02T19:36:16.269041] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-02T19:36:16.285092] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-10. [2025-10-02T19:36:17.072995] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-06. [2025-10-02T19:36:17.300482] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-02T19:36:17.702840] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-02T19:36:17.705575] [INFO ] [REMOTE ] IMAX: Full fetch complete (59878 records). [2025-10-02T19:36:17.705739] [DEBUG] [VALIDATOR ] IMAX: Validating primary data. [2025-10-02T19:36:17.878076] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-02. [2025-10-02T19:36:18.138486] [DEBUG] [VALIDATOR ] IMAX: All expected trading days are present. [2025-10-02T19:36:18.138566] [DEBUG] [VALIDATOR ] IMAX: Primary data validation passed. [2025-10-02T19:36:18.139365] [INFO ] [MAIN ] IMAX: Fetched primary data is valid. [2025-10-02T19:36:18.139453] [DEBUG] [LOCAL ] IMAX: Saving primary data. [2025-10-02T19:36:18.140953] [DEBUG] [LOCAL ] IMAX: Trimmed 59878 records to 43087 (keeping 200 days of data) [2025-10-02T19:36:18.409582] [DEBUG] [LOCAL ] IMAX: Primary data saved (43087 records). [2025-10-02T19:36:18.409740] [INFO ] [MAIN ] IMAX: Full history saved. [2025-10-02T19:36:18.409985] [INFO ] [MAIN ] Update Progress: 1106/2370 symbols completed. IMAX took 30.0s. Estimated remaining: 2h 58m 34s. Rate: 7.1 symbols/min [2025-10-02T19:36:18.594381] [INFO ] [MAIN ] ING: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:36:18.626262] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-02T19:36:18.680451] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-07. [2025-10-02T19:36:18.683839] [DEBUG] [LOCAL ] ING: Loaded 50724 existing records from primary storage. [2025-10-02T19:36:18.684220] [INFO ] [MAIN ] ING: Loaded 50724 existing records. [2025-10-02T19:36:18.887008] [WARN ] [MAIN ] ING: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:36:18.887232] [INFO ] [MAIN ] ING: Wiping existing primary data before full refresh. [2025-10-02T19:36:18.887284] [INFO ] [LOCAL ] ING: Starting deletion of primary data. [2025-10-02T19:36:18.889706] [DEBUG] [LOCAL ] ING: Deleted primary data file. [2025-10-02T19:36:18.889791] [INFO ] [MAIN ] ING: Starting full primary refresh. [2025-10-02T19:36:19.290005] [INFO ] [REMOTE ] ING: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:36:19.473017] [INFO ] [REMOTE ] ING: Fetching primary data for 2024-12. [2025-10-02T19:36:19.756226] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-02T19:36:20.066237] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-02T19:36:20.273001] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-08. [2025-10-02T19:36:20.863234] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-02T19:36:21.073017] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-01. [2025-10-02T19:36:21.571382] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-02T19:36:21.872999] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-07. [2025-10-02T19:36:22.673023] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-03. [2025-10-02T19:36:23.014691] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-02T19:36:23.473045] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-02. [2025-10-02T19:36:23.533673] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-02T19:36:24.182569] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-02T19:36:24.273039] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-04. [2025-10-02T19:36:25.073000] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-08. [2025-10-02T19:36:25.132281] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-02T19:36:25.872964] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-03. [2025-10-02T19:36:26.066407] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-02T19:36:26.649601] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-02T19:36:26.672958] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-09. [2025-10-02T19:36:27.431715] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-02T19:36:27.472985] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-04. [2025-10-02T19:36:28.232407] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-02T19:36:28.273019] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-09. [2025-10-02T19:36:29.078145] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-10. [2025-10-02T19:36:29.101103] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-02T19:36:29.154279] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-02T19:36:29.873046] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-05. [2025-10-02T19:36:30.673012] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-10. [2025-10-02T19:36:31.087269] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-02T19:36:31.089444] [INFO ] [REMOTE ] INFA: Full fetch complete (71374 records). [2025-10-02T19:36:31.089586] [DEBUG] [VALIDATOR ] INFA: Validating primary data. [2025-10-02T19:36:31.536271] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-05. [2025-10-02T19:36:31.624513] [DEBUG] [VALIDATOR ] INFA: All expected trading days are present. [2025-10-02T19:36:31.627427] [DEBUG] [VALIDATOR ] INFA: Primary data validation passed. [2025-10-02T19:36:31.628894] [INFO ] [MAIN ] INFA: Fetched primary data is valid. [2025-10-02T19:36:31.629017] [DEBUG] [LOCAL ] INFA: Saving primary data. [2025-10-02T19:36:31.627302] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-02T19:36:31.642579] [DEBUG] [LOCAL ] INFA: Trimmed 71374 records to 49887 (keeping 200 days of data) [2025-10-02T19:36:31.957172] [DEBUG] [LOCAL ] INFA: Primary data saved (49887 records). [2025-10-02T19:36:31.957323] [INFO ] [MAIN ] INFA: Full history saved. [2025-10-02T19:36:31.957445] [INFO ] [MAIN ] Update Progress: 1107/2370 symbols completed. INFA took 40.1s. Estimated remaining: 2h 58m 31s. Rate: 7.1 symbols/min [2025-10-02T19:36:32.132742] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-02T19:36:32.160260] [INFO ] [MAIN ] INGM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:36:32.161042] [INFO ] [REMOTE ] IIPR: Full fetch complete (44734 records). [2025-10-02T19:36:32.161226] [DEBUG] [VALIDATOR ] IIPR: Validating primary data. [2025-10-02T19:36:32.278110] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-06. [2025-10-02T19:36:32.410866] [DEBUG] [LOCAL ] INGM: Loaded 28652 existing records from primary storage. [2025-10-02T19:36:32.478385] [INFO ] [MAIN ] INGM: Loaded 28652 existing records. [2025-10-02T19:36:32.822696] [WARN ] [MAIN ] INGM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:36:32.837949] [INFO ] [MAIN ] INGM: Wiping existing primary data before full refresh. [2025-10-02T19:36:32.838056] [INFO ] [LOCAL ] INGM: Starting deletion of primary data. [2025-10-02T19:36:32.838345] [DEBUG] [VALIDATOR ] IIPR: All expected trading days are present. [2025-10-02T19:36:32.838407] [DEBUG] [VALIDATOR ] IIPR: Primary data validation passed. [2025-10-02T19:36:32.839187] [INFO ] [MAIN ] IIPR: Fetched primary data is valid. [2025-10-02T19:36:32.839232] [DEBUG] [LOCAL ] INGM: Deleted primary data file. [2025-10-02T19:36:32.839378] [INFO ] [MAIN ] INGM: Starting full primary refresh. [2025-10-02T19:36:32.844595] [DEBUG] [LOCAL ] IIPR: Saving primary data. [2025-10-02T19:36:32.956625] [DEBUG] [LOCAL ] IIPR: Trimmed 44734 records to 30075 (keeping 200 days of data) [2025-10-02T19:36:33.355020] [INFO ] [REMOTE ] INGM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:36:33.355969] [INFO ] [REMOTE ] INGM: Fetching primary data for 2024-12. [2025-10-02T19:36:33.473787] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-02T19:36:33.503055] [DEBUG] [LOCAL ] IIPR: Primary data saved (30075 records). [2025-10-02T19:36:33.503216] [INFO ] [MAIN ] IIPR: Full history saved. [2025-10-02T19:36:33.504634] [INFO ] [MAIN ] Update Progress: 1108/2370 symbols completed. IIPR took 48.4s. Estimated remaining: 2h 58m 15s. Rate: 7.1 symbols/min [2025-10-02T19:36:33.693548] [INFO ] [MAIN ] INGR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:36:33.736050] [DEBUG] [LOCAL ] INGR: Loaded 33339 existing records from primary storage. [2025-10-02T19:36:33.736353] [INFO ] [MAIN ] INGR: Loaded 33339 existing records. [2025-10-02T19:36:33.893358] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-06. [2025-10-02T19:36:33.956753] [WARN ] [MAIN ] INGR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:36:33.969674] [INFO ] [MAIN ] INGR: Wiping existing primary data before full refresh. [2025-10-02T19:36:33.969972] [INFO ] [LOCAL ] INGR: Starting deletion of primary data. [2025-10-02T19:36:33.971593] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-02T19:36:33.971746] [DEBUG] [LOCAL ] INGR: Deleted primary data file. [2025-10-02T19:36:33.982539] [INFO ] [MAIN ] INGR: Starting full primary refresh. [2025-10-02T19:36:34.394061] [INFO ] [REMOTE ] INGR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:36:34.673051] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-07. [2025-10-02T19:36:34.856728] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-02T19:36:35.433016] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-02T19:36:35.473058] [INFO ] [REMOTE ] INGR: Fetching primary data for 2024-12. [2025-10-02T19:36:36.273031] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-07. [2025-10-02T19:36:36.406122] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-02T19:36:36.788879] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-02T19:36:37.073035] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-08. [2025-10-02T19:36:37.873013] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-01. [2025-10-02T19:36:38.111102] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-02T19:36:38.672995] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-08. [2025-10-02T19:36:38.742877] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-02T19:36:39.294340] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-02T19:36:39.473037] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-01. [2025-10-02T19:36:40.252499] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-02T19:36:40.273000] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-09. [2025-10-02T19:36:40.405851] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-02T19:36:41.073038] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-02. [2025-10-02T19:36:41.715886] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-02T19:36:41.873018] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-10. [2025-10-02T19:36:42.558784] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-02T19:36:42.673024] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-09. [2025-10-02T19:36:43.087543] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-02T19:36:43.089909] [INFO ] [REMOTE ] ING: Full fetch complete (73620 records). [2025-10-02T19:36:43.090057] [DEBUG] [VALIDATOR ] ING: Validating primary data. [2025-10-02T19:36:43.478203] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-03. [2025-10-02T19:36:43.532923] [DEBUG] [VALIDATOR ] ING: All expected trading days are present. [2025-10-02T19:36:43.533042] [DEBUG] [VALIDATOR ] ING: Primary data validation passed. [2025-10-02T19:36:43.534068] [INFO ] [MAIN ] ING: Fetched primary data is valid. [2025-10-02T19:36:43.534188] [DEBUG] [LOCAL ] ING: Saving primary data. [2025-10-02T19:36:43.536369] [DEBUG] [LOCAL ] ING: Trimmed 73620 records to 51091 (keeping 200 days of data) [2025-10-02T19:36:43.874138] [DEBUG] [LOCAL ] ING: Primary data saved (51091 records). [2025-10-02T19:36:43.874294] [INFO ] [MAIN ] ING: Full history saved. [2025-10-02T19:36:43.874382] [INFO ] [MAIN ] Update Progress: 1109/2370 symbols completed. ING took 25.5s. Estimated remaining: 2h 58m 8s. Rate: 7.1 symbols/min [2025-10-02T19:36:44.055182] [INFO ] [MAIN ] INN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:36:44.093210] [DEBUG] [LOCAL ] INN: Loaded 41756 existing records from primary storage. [2025-10-02T19:36:44.093548] [INFO ] [MAIN ] INN: Loaded 41756 existing records. [2025-10-02T19:36:44.279585] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-02. [2025-10-02T19:36:44.286294] [WARN ] [MAIN ] INN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:36:44.287481] [INFO ] [MAIN ] INN: Wiping existing primary data before full refresh. [2025-10-02T19:36:44.287537] [INFO ] [LOCAL ] INN: Starting deletion of primary data. [2025-10-02T19:36:44.288872] [DEBUG] [LOCAL ] INN: Deleted primary data file. [2025-10-02T19:36:44.288939] [INFO ] [MAIN ] INN: Starting full primary refresh. [2025-10-02T19:36:44.697750] [INFO ] [REMOTE ] INN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:36:44.736838] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-02T19:36:45.079565] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-10. [2025-10-02T19:36:45.082556] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-02T19:36:45.510026] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-02T19:36:45.873028] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-04. [2025-10-02T19:36:46.522876] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-02T19:36:46.525485] [INFO ] [REMOTE ] INFY: Full fetch complete (77542 records). [2025-10-02T19:36:46.525605] [DEBUG] [VALIDATOR ] INFY: Validating primary data. [2025-10-02T19:36:46.684298] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-03. [2025-10-02T19:36:46.981692] [DEBUG] [VALIDATOR ] INFY: All expected trading days are present. [2025-10-02T19:36:46.981866] [DEBUG] [VALIDATOR ] INFY: Primary data validation passed. [2025-10-02T19:36:46.983206] [INFO ] [MAIN ] INFY: Fetched primary data is valid. [2025-10-02T19:36:46.983273] [DEBUG] [LOCAL ] INFY: Saving primary data. [2025-10-02T19:36:46.986915] [DEBUG] [LOCAL ] INFY: Trimmed 77542 records to 53985 (keeping 200 days of data) [2025-10-02T19:36:47.251816] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-02T19:36:47.380384] [DEBUG] [LOCAL ] INFY: Primary data saved (53985 records). [2025-10-02T19:36:47.380572] [INFO ] [MAIN ] INFY: Full history saved. [2025-10-02T19:36:47.380716] [INFO ] [MAIN ] Update Progress: 1110/2370 symbols completed. INFY took 37.6s. Estimated remaining: 2h 57m 54s. Rate: 7.1 symbols/min [2025-10-02T19:36:47.478087] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-05. [2025-10-02T19:36:47.576437] [INFO ] [MAIN ] INR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:36:47.576600] [DEBUG] [LOCAL ] INR: No existing data file found in primary storage. [2025-10-02T19:36:47.576638] [WARN ] [MAIN ] INR: No existing data found, performing full refresh instead. [2025-10-02T19:36:47.576776] [INFO ] [MAIN ] INR: Wiping existing primary data before full refresh. [2025-10-02T19:36:47.576818] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-02T19:36:47.576881] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-02T19:36:47.576915] [INFO ] [MAIN ] INR: Starting full primary refresh. [2025-10-02T19:36:47.977446] [INFO ] [REMOTE ] INR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:36:48.167318] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-02T19:36:48.273050] [INFO ] [REMOTE ] INR: Fetching primary data for 2024-12. [2025-10-02T19:36:48.831953] [DEBUG] [REMOTE ] INR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T19:36:48.832396] [WARN ] [REMOTE ] INR: No data returned for month 2024-12 [2025-10-02T19:36:48.832515] [FATAL] [REMOTE ] INR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T19:36:48.832580] [FATAL] [MAIN ] INR: Failed to fetch primary data. [2025-10-02T19:36:48.832685] [WARN ] [MAIN ] INR: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T19:36:48.832773] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-02T19:36:48.832869] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-02T19:36:48.832937] [INFO ] [LOCAL ] INR: Starting deletion of derivative data. [2025-10-02T19:36:48.832997] [DEBUG] [LOCAL ] INR: No derivative data file found to delete. [2025-10-02T19:36:48.833074] [INFO ] [MAIN ] Update Progress: 1111/2370 symbols completed. INR took 1.5s. Estimated remaining: 2h 57m 38s. Rate: 7.1 symbols/min [2025-10-02T19:36:49.051179] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-02T19:36:49.071323] [INFO ] [MAIN ] INSP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:36:49.078411] [INFO ] [REMOTE ] INN: Fetching primary data for 2024-12. [2025-10-02T19:36:49.121181] [DEBUG] [LOCAL ] INSP: Loaded 37162 existing records from primary storage. [2025-10-02T19:36:49.121526] [INFO ] [MAIN ] INSP: Loaded 37162 existing records. [2025-10-02T19:36:49.318540] [WARN ] [MAIN ] INSP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:36:49.318813] [INFO ] [MAIN ] INSP: Wiping existing primary data before full refresh. [2025-10-02T19:36:49.318865] [INFO ] [LOCAL ] INSP: Starting deletion of primary data. [2025-10-02T19:36:49.319944] [DEBUG] [LOCAL ] INSP: Deleted primary data file. [2025-10-02T19:36:49.320007] [INFO ] [MAIN ] INSP: Starting full primary refresh. [2025-10-02T19:36:49.736104] [INFO ] [REMOTE ] INSP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:36:49.873020] [INFO ] [REMOTE ] INSP: Fetching primary data for 2024-12. [2025-10-02T19:36:50.563520] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-02T19:36:50.673006] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-06. [2025-10-02T19:36:51.257350] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-02T19:36:51.473037] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-04. [2025-10-02T19:36:51.907353] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-02T19:36:52.273022] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-01. [2025-10-02T19:36:52.923141] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-02T19:36:53.073003] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-05. [2025-10-02T19:36:53.761776] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-02T19:36:53.872980] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-02. [2025-10-02T19:36:54.438477] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-02T19:36:54.673013] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-07. [2025-10-02T19:36:55.409169] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-02T19:36:55.473047] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-06. [2025-10-02T19:36:55.692262] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-02T19:36:56.273005] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-08. [2025-10-02T19:36:56.730631] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-02T19:36:57.073190] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-01. [2025-10-02T19:36:57.652359] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-02T19:36:57.873030] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-07. [2025-10-02T19:36:58.425853] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-02T19:36:58.672998] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-02. [2025-10-02T19:36:59.114719] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-02T19:36:59.473037] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-03. [2025-10-02T19:36:59.707735] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-02T19:37:00.273017] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-09. [2025-10-02T19:37:00.873319] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-02T19:37:01.073055] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-04. [2025-10-02T19:37:01.507138] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-02T19:37:01.873014] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-03. [2025-10-02T19:37:02.411230] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-02T19:37:02.673000] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-05. [2025-10-02T19:37:03.351170] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-02T19:37:03.473062] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-08. [2025-10-02T19:37:04.079820] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-02T19:37:04.273008] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-06. [2025-10-02T19:37:04.578221] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-02T19:37:05.072997] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-09. [2025-10-02T19:37:05.667543] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-02T19:37:05.872979] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-04. [2025-10-02T19:37:06.170200] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-02T19:37:06.673009] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-07. [2025-10-02T19:37:07.466532] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-02T19:37:07.476389] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-10. [2025-10-02T19:37:08.202961] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-02T19:37:08.273048] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-10. [2025-10-02T19:37:08.494542] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-02T19:37:08.496254] [INFO ] [REMOTE ] INGM: Full fetch complete (42480 records). [2025-10-02T19:37:08.496421] [DEBUG] [VALIDATOR ] INGM: Validating primary data. [2025-10-02T19:37:08.956242] [DEBUG] [VALIDATOR ] INGM: All expected trading days are present. [2025-10-02T19:37:08.956339] [DEBUG] [VALIDATOR ] INGM: Primary data validation passed. [2025-10-02T19:37:08.957163] [INFO ] [MAIN ] INGM: Fetched primary data is valid. [2025-10-02T19:37:08.957299] [DEBUG] [LOCAL ] INGM: Saving primary data. [2025-10-02T19:37:08.958566] [DEBUG] [LOCAL ] INGM: Trimmed 42480 records to 28854 (keeping 200 days of data) [2025-10-02T19:37:09.074053] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-08. [2025-10-02T19:37:09.162057] [DEBUG] [LOCAL ] INGM: Primary data saved (28854 records). [2025-10-02T19:37:09.162219] [INFO ] [MAIN ] INGM: Full history saved. [2025-10-02T19:37:09.162337] [INFO ] [MAIN ] Update Progress: 1112/2370 symbols completed. INGM took 37.2s. Estimated remaining: 2h 57m 43s. Rate: 7.1 symbols/min [2025-10-02T19:37:09.357041] [INFO ] [MAIN ] INSW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:37:09.401804] [DEBUG] [LOCAL ] INSW: Loaded 39994 existing records from primary storage. [2025-10-02T19:37:09.402125] [INFO ] [MAIN ] INSW: Loaded 39994 existing records. [2025-10-02T19:37:09.519749] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-02T19:37:09.543701] [INFO ] [REMOTE ] INGR: Full fetch complete (50228 records). [2025-10-02T19:37:09.574141] [DEBUG] [VALIDATOR ] INGR: Validating primary data. [2025-10-02T19:37:09.648536] [WARN ] [MAIN ] INSW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:37:09.686797] [INFO ] [MAIN ] INSW: Wiping existing primary data before full refresh. [2025-10-02T19:37:09.700921] [INFO ] [LOCAL ] INSW: Starting deletion of primary data. [2025-10-02T19:37:09.733964] [DEBUG] [LOCAL ] INSW: Deleted primary data file. [2025-10-02T19:37:09.734076] [INFO ] [MAIN ] INSW: Starting full primary refresh. [2025-10-02T19:37:09.885032] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-05. [2025-10-02T19:37:10.378824] [DEBUG] [VALIDATOR ] INGR: All expected trading days are present. [2025-10-02T19:37:10.405623] [DEBUG] [VALIDATOR ] INGR: Primary data validation passed. [2025-10-02T19:37:10.461310] [INFO ] [REMOTE ] INSW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:37:10.462230] [INFO ] [MAIN ] INGR: Fetched primary data is valid. [2025-10-02T19:37:10.463008] [DEBUG] [LOCAL ] INGR: Saving primary data. [2025-10-02T19:37:10.464166] [DEBUG] [LOCAL ] INGR: Trimmed 50228 records to 33646 (keeping 200 days of data) [2025-10-02T19:37:10.673273] [INFO ] [REMOTE ] INSW: Fetching primary data for 2024-12. [2025-10-02T19:37:10.695211] [DEBUG] [LOCAL ] INGR: Primary data saved (33646 records). [2025-10-02T19:37:10.695345] [INFO ] [MAIN ] INGR: Full history saved. [2025-10-02T19:37:10.696207] [INFO ] [MAIN ] Update Progress: 1113/2370 symbols completed. INGR took 37.2s. Estimated remaining: 2h 57m 27s. Rate: 7.1 symbols/min [2025-10-02T19:37:10.878416] [INFO ] [MAIN ] INVH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:37:10.908010] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-02T19:37:10.965482] [DEBUG] [LOCAL ] INVH: Loaded 53133 existing records from primary storage. [2025-10-02T19:37:10.965847] [INFO ] [MAIN ] INVH: Loaded 53133 existing records. [2025-10-02T19:37:11.156714] [WARN ] [MAIN ] INVH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:37:11.156940] [INFO ] [MAIN ] INVH: Wiping existing primary data before full refresh. [2025-10-02T19:37:11.156989] [INFO ] [LOCAL ] INVH: Starting deletion of primary data. [2025-10-02T19:37:11.158730] [DEBUG] [LOCAL ] INVH: Deleted primary data file. [2025-10-02T19:37:11.158792] [INFO ] [MAIN ] INVH: Starting full primary refresh. [2025-10-02T19:37:11.495693] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-09. [2025-10-02T19:37:11.540964] [INFO ] [REMOTE ] INVH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:37:11.582243] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-02T19:37:12.273019] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-06. [2025-10-02T19:37:12.409831] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-02T19:37:12.755053] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-02T19:37:13.073005] [INFO ] [REMOTE ] INVH: Fetching primary data for 2024-12. [2025-10-02T19:37:13.385165] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-02T19:37:13.872998] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-10. [2025-10-02T19:37:14.672959] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-07. [2025-10-02T19:37:14.709930] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-02T19:37:15.371238] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-02T19:37:15.373335] [INFO ] [REMOTE ] INSP: Full fetch complete (53094 records). [2025-10-02T19:37:15.373472] [DEBUG] [VALIDATOR ] INSP: Validating primary data. [2025-10-02T19:37:15.478113] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-01. [2025-10-02T19:37:15.878512] [DEBUG] [VALIDATOR ] INSP: All expected trading days are present. [2025-10-02T19:37:15.878848] [DEBUG] [VALIDATOR ] INSP: Primary data validation passed. [2025-10-02T19:37:15.879750] [INFO ] [MAIN ] INSP: Fetched primary data is valid. [2025-10-02T19:37:15.879863] [DEBUG] [LOCAL ] INSP: Saving primary data. [2025-10-02T19:37:15.881577] [DEBUG] [LOCAL ] INSP: Trimmed 53094 records to 37471 (keeping 200 days of data) [2025-10-02T19:37:16.006186] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-02T19:37:16.170751] [DEBUG] [LOCAL ] INSP: Primary data saved (37471 records). [2025-10-02T19:37:16.170904] [INFO ] [MAIN ] INSP: Full history saved. [2025-10-02T19:37:16.170988] [INFO ] [MAIN ] Update Progress: 1114/2370 symbols completed. INSP took 27.3s. Estimated remaining: 2h 57m 15s. Rate: 7.1 symbols/min [2025-10-02T19:37:16.280353] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-08. [2025-10-02T19:37:16.362825] [INFO ] [MAIN ] INVX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:37:16.393909] [DEBUG] [LOCAL ] INVX: Loaded 29044 existing records from primary storage. [2025-10-02T19:37:16.394273] [INFO ] [MAIN ] INVX: Loaded 29044 existing records. [2025-10-02T19:37:16.597674] [WARN ] [MAIN ] INVX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:37:16.597940] [INFO ] [MAIN ] INVX: Wiping existing primary data before full refresh. [2025-10-02T19:37:16.598008] [INFO ] [LOCAL ] INVX: Starting deletion of primary data. [2025-10-02T19:37:16.599178] [DEBUG] [LOCAL ] INVX: Deleted primary data file. [2025-10-02T19:37:16.599241] [INFO ] [MAIN ] INVX: Starting full primary refresh. [2025-10-02T19:37:17.001880] [INFO ] [REMOTE ] INVX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:37:17.037373] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-02T19:37:17.073009] [INFO ] [REMOTE ] INVX: Fetching primary data for 2024-12. [2025-10-02T19:37:17.492137] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-02T19:37:17.873003] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-01. [2025-10-02T19:37:18.537875] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-02T19:37:18.673039] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-02. [2025-10-02T19:37:19.472999] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-01. [2025-10-02T19:37:19.549198] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-02T19:37:20.184197] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-02T19:37:20.272988] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-02. [2025-10-02T19:37:20.381768] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-02T19:37:21.073060] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-09. [2025-10-02T19:37:21.873025] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-03. [2025-10-02T19:37:21.927993] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-02T19:37:22.576232] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-02T19:37:22.673025] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-10. [2025-10-02T19:37:23.473038] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-03. [2025-10-02T19:37:23.693739] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-02T19:37:23.905704] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-02T19:37:23.907569] [INFO ] [REMOTE ] INN: Full fetch complete (57783 records). [2025-10-02T19:37:23.907704] [DEBUG] [VALIDATOR ] INN: Validating primary data. [2025-10-02T19:37:24.278158] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-04. [2025-10-02T19:37:24.327287] [DEBUG] [VALIDATOR ] INN: All expected trading days are present. [2025-10-02T19:37:24.327388] [DEBUG] [VALIDATOR ] INN: Primary data validation passed. [2025-10-02T19:37:24.328264] [INFO ] [MAIN ] INN: Fetched primary data is valid. [2025-10-02T19:37:24.328340] [DEBUG] [LOCAL ] INN: Saving primary data. [2025-10-02T19:37:24.329727] [DEBUG] [LOCAL ] INN: Trimmed 57783 records to 41983 (keeping 200 days of data) [2025-10-02T19:37:24.593475] [DEBUG] [LOCAL ] INN: Primary data saved (41983 records). [2025-10-02T19:37:24.593610] [INFO ] [MAIN ] INN: Full history saved. [2025-10-02T19:37:24.593721] [INFO ] [MAIN ] Update Progress: 1115/2370 symbols completed. INN took 40.7s. Estimated remaining: 2h 57m 6s. Rate: 7.1 symbols/min [2025-10-02T19:37:24.785755] [INFO ] [MAIN ] IONQ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:37:24.842477] [DEBUG] [LOCAL ] IONQ: Loaded 53788 existing records from primary storage. [2025-10-02T19:37:24.842847] [INFO ] [MAIN ] IONQ: Loaded 53788 existing records. [2025-10-02T19:37:25.037400] [WARN ] [MAIN ] IONQ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:37:25.037710] [INFO ] [MAIN ] IONQ: Wiping existing primary data before full refresh. [2025-10-02T19:37:25.037787] [INFO ] [LOCAL ] IONQ: Starting deletion of primary data. [2025-10-02T19:37:25.047453] [DEBUG] [LOCAL ] IONQ: Deleted primary data file. [2025-10-02T19:37:25.063248] [INFO ] [MAIN ] IONQ: Starting full primary refresh. [2025-10-02T19:37:25.078202] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-02. [2025-10-02T19:37:25.106790] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-02T19:37:25.460551] [INFO ] [REMOTE ] IONQ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:37:25.859913] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-02T19:37:25.872944] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-05. [2025-10-02T19:37:25.902364] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-02T19:37:26.673046] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-03. [2025-10-02T19:37:27.473003] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-04. [2025-10-02T19:37:27.752266] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-02T19:37:27.826558] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-02T19:37:28.273004] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-04. [2025-10-02T19:37:29.083432] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-06. [2025-10-02T19:37:29.089188] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-02T19:37:29.682030] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-02T19:37:29.873034] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2024-12. [2025-10-02T19:37:30.422385] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-02T19:37:30.673058] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-05. [2025-10-02T19:37:31.473035] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-05. [2025-10-02T19:37:31.954900] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-02T19:37:32.272981] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-07. [2025-10-02T19:37:32.607801] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2024-12 (2.73 seconds). [2025-10-02T19:37:32.663301] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-02T19:37:33.072984] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-06. [2025-10-02T19:37:33.882826] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-06. [2025-10-02T19:37:33.907331] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-02T19:37:34.543666] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-02T19:37:34.673041] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-07. [2025-10-02T19:37:35.256762] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-02T19:37:35.473007] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-07. [2025-10-02T19:37:36.053578] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-02T19:37:36.273021] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-08. [2025-10-02T19:37:36.832081] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-02T19:37:37.073038] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-01. [2025-10-02T19:37:37.873046] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-08. [2025-10-02T19:37:37.970213] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-02T19:37:38.672985] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-08. [2025-10-02T19:37:38.811871] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-02T19:37:39.473002] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-09. [2025-10-02T19:37:39.697478] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-01 (2.62 seconds). [2025-10-02T19:37:40.042909] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-02T19:37:40.273014] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-02. [2025-10-02T19:37:41.073015] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-09. [2025-10-02T19:37:41.439705] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-02T19:37:41.872984] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-10. [2025-10-02T19:37:42.258164] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-02T19:37:42.314138] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-02T19:37:42.673041] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-10. [2025-10-02T19:37:43.186335] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-02T19:37:43.188528] [INFO ] [REMOTE ] INVH: Full fetch complete (76725 records). [2025-10-02T19:37:43.188731] [DEBUG] [VALIDATOR ] INVH: Validating primary data. [2025-10-02T19:37:43.479754] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-09. [2025-10-02T19:37:43.628382] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-02T19:37:43.671671] [DEBUG] [VALIDATOR ] INVH: All expected trading days are present. [2025-10-02T19:37:43.671987] [DEBUG] [VALIDATOR ] INVH: Primary data validation passed. [2025-10-02T19:37:43.673112] [INFO ] [MAIN ] INVH: Fetched primary data is valid. [2025-10-02T19:37:43.673203] [DEBUG] [LOCAL ] INVH: Saving primary data. [2025-10-02T19:37:43.671892] [INFO ] [REMOTE ] INVX: Full fetch complete (44095 records). [2025-10-02T19:37:43.673584] [DEBUG] [VALIDATOR ] INVX: Validating primary data. [2025-10-02T19:37:43.780921] [DEBUG] [LOCAL ] INVH: Trimmed 76725 records to 53521 (keeping 200 days of data) [2025-10-02T19:37:44.208041] [DEBUG] [VALIDATOR ] INVX: All expected trading days are present. [2025-10-02T19:37:44.209019] [DEBUG] [VALIDATOR ] INVX: Primary data validation passed. [2025-10-02T19:37:44.210169] [INFO ] [MAIN ] INVX: Fetched primary data is valid. [2025-10-02T19:37:44.210532] [DEBUG] [LOCAL ] INVX: Saving primary data. [2025-10-02T19:37:44.218048] [DEBUG] [LOCAL ] INVX: Trimmed 44095 records to 29238 (keeping 200 days of data) [2025-10-02T19:37:44.281543] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-03. [2025-10-02T19:37:44.607829] [DEBUG] [LOCAL ] INVX: Primary data saved (29238 records). [2025-10-02T19:37:44.608282] [INFO ] [MAIN ] INVX: Full history saved. [2025-10-02T19:37:44.621352] [INFO ] [MAIN ] Update Progress: 1116/2370 symbols completed. INVX took 28.5s. Estimated remaining: 2h 57m 11s. Rate: 7.1 symbols/min [2025-10-02T19:37:44.630384] [DEBUG] [LOCAL ] INVH: Primary data saved (53521 records). [2025-10-02T19:37:44.635947] [INFO ] [MAIN ] INVH: Full history saved. [2025-10-02T19:37:44.643926] [INFO ] [MAIN ] Update Progress: 1117/2370 symbols completed. INVH took 33.9s. Estimated remaining: 2h 56m 53s. Rate: 7.1 symbols/min [2025-10-02T19:37:44.834144] [INFO ] [MAIN ] IOT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:37:44.887618] [DEBUG] [LOCAL ] IOT: Loaded 53471 existing records from primary storage. [2025-10-02T19:37:44.887994] [INFO ] [MAIN ] IOT: Loaded 53471 existing records. [2025-10-02T19:37:45.100091] [WARN ] [MAIN ] IOT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:37:45.121746] [INFO ] [MAIN ] IOT: Wiping existing primary data before full refresh. [2025-10-02T19:37:45.121884] [INFO ] [LOCAL ] IOT: Starting deletion of primary data. [2025-10-02T19:37:45.123563] [DEBUG] [LOCAL ] IOT: Deleted primary data file. [2025-10-02T19:37:45.123495] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-02T19:37:45.123733] [INFO ] [MAIN ] IOT: Starting full primary refresh. [2025-10-02T19:37:45.217907] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-10. [2025-10-02T19:37:45.518313] [INFO ] [REMOTE ] IOT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:37:45.873038] [INFO ] [REMOTE ] IOT: Fetching primary data for 2024-12. [2025-10-02T19:37:46.532273] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-02T19:37:46.534049] [INFO ] [REMOTE ] INSW: Full fetch complete (60500 records). [2025-10-02T19:37:46.534213] [DEBUG] [VALIDATOR ] INSW: Validating primary data. [2025-10-02T19:37:46.965492] [DEBUG] [VALIDATOR ] INSW: All expected trading days are present. [2025-10-02T19:37:46.965595] [DEBUG] [VALIDATOR ] INSW: Primary data validation passed. [2025-10-02T19:37:46.966627] [INFO ] [MAIN ] INSW: Fetched primary data is valid. [2025-10-02T19:37:46.966769] [DEBUG] [LOCAL ] INSW: Saving primary data. [2025-10-02T19:37:46.968407] [DEBUG] [LOCAL ] INSW: Trimmed 60500 records to 40240 (keeping 200 days of data) [2025-10-02T19:37:47.098563] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-03 (2.82 seconds). [2025-10-02T19:37:47.114704] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-04. [2025-10-02T19:37:47.273001] [DEBUG] [LOCAL ] INSW: Primary data saved (40240 records). [2025-10-02T19:37:47.273140] [INFO ] [MAIN ] INSW: Full history saved. [2025-10-02T19:37:47.273225] [INFO ] [MAIN ] Update Progress: 1118/2370 symbols completed. INSW took 38.1s. Estimated remaining: 2h 56m 38s. Rate: 7.1 symbols/min [2025-10-02T19:37:47.529740] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-02T19:37:47.542621] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-01. [2025-10-02T19:37:49.281973] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-02T19:37:49.293305] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-02. [2025-10-02T19:37:49.933423] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-04 (2.82 seconds). [2025-10-02T19:37:49.945782] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-05. [2025-10-02T19:37:51.117688] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-02T19:37:51.128301] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-03. [2025-10-02T19:37:52.371796] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-10-02T19:37:52.383893] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-06. [2025-10-02T19:37:53.031163] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-02T19:37:53.042921] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-04. [2025-10-02T19:37:54.613219] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-10-02T19:37:54.624928] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-07. [2025-10-02T19:37:54.702638] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-02T19:37:54.714441] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-05. [2025-10-02T19:37:56.062914] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-02T19:37:56.074834] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-06. [2025-10-02T19:37:57.596474] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-07 (2.97 seconds). [2025-10-02T19:37:57.615881] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-08. [2025-10-02T19:37:57.660423] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-02T19:37:57.672602] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-07. [2025-10-02T19:37:59.704438] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-02T19:37:59.717050] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-08. [2025-10-02T19:37:59.957453] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-10-02T19:37:59.970556] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-09. [2025-10-02T19:38:01.650075] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-02T19:38:01.662171] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-09. [2025-10-02T19:38:02.766964] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-09 (2.80 seconds). [2025-10-02T19:38:02.778873] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-10. [2025-10-02T19:38:03.301018] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-02T19:38:03.312867] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-10. [2025-10-02T19:38:04.608613] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-02T19:38:04.610884] [INFO ] [REMOTE ] IOT: Full fetch complete (77383 records). [2025-10-02T19:38:04.611094] [DEBUG] [VALIDATOR ] IOT: Validating primary data. [2025-10-02T19:38:05.042069] [DEBUG] [VALIDATOR ] IOT: All expected trading days are present. [2025-10-02T19:38:05.042196] [DEBUG] [VALIDATOR ] IOT: Primary data validation passed. [2025-10-02T19:38:05.043274] [INFO ] [MAIN ] IOT: Fetched primary data is valid. [2025-10-02T19:38:05.043344] [DEBUG] [LOCAL ] IOT: Saving primary data. [2025-10-02T19:38:05.045053] [DEBUG] [LOCAL ] IOT: Trimmed 77383 records to 53861 (keeping 200 days of data) [2025-10-02T19:38:05.370886] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-10 (2.59 seconds). [2025-10-02T19:38:05.375026] [INFO ] [REMOTE ] IONQ: Full fetch complete (77968 records). [2025-10-02T19:38:05.375817] [DEBUG] [VALIDATOR ] IONQ: Validating primary data. [2025-10-02T19:38:05.824475] [DEBUG] [VALIDATOR ] IONQ: All expected trading days are present. [2025-10-02T19:38:05.825123] [DEBUG] [VALIDATOR ] IONQ: Primary data validation passed. [2025-10-02T19:38:05.826503] [INFO ] [MAIN ] IONQ: Fetched primary data is valid. [2025-10-02T19:38:05.826911] [DEBUG] [LOCAL ] IONQ: Saving primary data. [2025-10-02T19:38:05.831837] [DEBUG] [LOCAL ] IOT: Primary data saved (53861 records). [2025-10-02T19:38:05.832127] [INFO ] [MAIN ] IOT: Full history saved. [2025-10-02T19:38:05.832283] [INFO ] [MAIN ] Update Progress: 1119/2370 symbols completed. IOT took 21.2s. Estimated remaining: 2h 56m 41s. Rate: 7.1 symbols/min [2025-10-02T19:38:05.833182] [DEBUG] [LOCAL ] IONQ: Trimmed 77968 records to 54178 (keeping 200 days of data) [2025-10-02T19:38:06.180475] [DEBUG] [LOCAL ] IONQ: Primary data saved (54178 records). [2025-10-02T19:38:06.180659] [INFO ] [MAIN ] IONQ: Full history saved. [2025-10-02T19:38:06.180768] [INFO ] [MAIN ] Update Progress: 1120/2370 symbols completed. IONQ took 41.6s. Estimated remaining: 2h 56m 23s. Rate: 7.1 symbols/min [2025-10-02T19:38:06.768531] [INFO ] [MAIN ] IPG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:38:06.887867] [INFO ] [MAIN ] IPI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:38:06.917561] [INFO ] [MAIN ] IP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:38:07.003682] [INFO ] [MAIN ] IQI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:38:07.025131] [DEBUG] [LOCAL ] IPI: Loaded 21433 existing records from primary storage. [2025-10-02T19:38:07.029906] [INFO ] [MAIN ] IPI: Loaded 21433 existing records. [2025-10-02T19:38:07.155233] [DEBUG] [LOCAL ] IQI: Loaded 18090 existing records from primary storage. [2025-10-02T19:38:07.166064] [INFO ] [MAIN ] IQI: Loaded 18090 existing records. [2025-10-02T19:38:07.262677] [DEBUG] [LOCAL ] IP: Loaded 53313 existing records from primary storage. [2025-10-02T19:38:07.307795] [DEBUG] [LOCAL ] IPG: Loaded 53330 existing records from primary storage. [2025-10-02T19:38:07.377076] [INFO ] [MAIN ] IP: Loaded 53313 existing records. [2025-10-02T19:38:07.392190] [INFO ] [MAIN ] IPG: Loaded 53330 existing records. [2025-10-02T19:38:07.423341] [WARN ] [MAIN ] IPI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:38:07.497709] [INFO ] [MAIN ] IPI: Wiping existing primary data before full refresh. [2025-10-02T19:38:07.550766] [INFO ] [LOCAL ] IPI: Starting deletion of primary data. [2025-10-02T19:38:07.621065] [DEBUG] [LOCAL ] IPI: Deleted primary data file. [2025-10-02T19:38:07.711531] [INFO ] [MAIN ] IPI: Starting full primary refresh. [2025-10-02T19:38:07.792543] [WARN ] [MAIN ] IQI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:38:07.792852] [INFO ] [MAIN ] IQI: Wiping existing primary data before full refresh. [2025-10-02T19:38:07.803760] [INFO ] [LOCAL ] IQI: Starting deletion of primary data. [2025-10-02T19:38:07.871765] [DEBUG] [LOCAL ] IQI: Deleted primary data file. [2025-10-02T19:38:08.003519] [WARN ] [MAIN ] IP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:38:08.008980] [INFO ] [MAIN ] IQI: Starting full primary refresh. [2025-10-02T19:38:08.017924] [INFO ] [MAIN ] IP: Wiping existing primary data before full refresh. [2025-10-02T19:38:08.017821] [WARN ] [MAIN ] IPG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:38:08.087316] [INFO ] [MAIN ] IPG: Wiping existing primary data before full refresh. [2025-10-02T19:38:08.040569] [INFO ] [LOCAL ] IP: Starting deletion of primary data. [2025-10-02T19:38:08.108042] [INFO ] [LOCAL ] IPG: Starting deletion of primary data. [2025-10-02T19:38:08.125224] [DEBUG] [LOCAL ] IP: Deleted primary data file. [2025-10-02T19:38:08.140417] [INFO ] [MAIN ] IP: Starting full primary refresh. [2025-10-02T19:38:08.153736] [DEBUG] [LOCAL ] IPG: Deleted primary data file. [2025-10-02T19:38:08.175746] [INFO ] [MAIN ] IPG: Starting full primary refresh. [2025-10-02T19:38:09.431723] [INFO ] [REMOTE ] IPI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:38:09.435779] [INFO ] [REMOTE ] IQI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:38:09.458341] [INFO ] [REMOTE ] IPI: Fetching primary data for 2024-12. [2025-10-02T19:38:09.458084] [INFO ] [REMOTE ] IQI: Fetching primary data for 2024-12. [2025-10-02T19:38:09.588455] [INFO ] [REMOTE ] IP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:38:09.622039] [INFO ] [REMOTE ] IP: Fetching primary data for 2024-12. [2025-10-02T19:38:09.628481] [INFO ] [REMOTE ] IPG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:38:09.628917] [INFO ] [REMOTE ] IPG: Fetching primary data for 2024-12. [2025-10-02T19:38:10.638889] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-02T19:38:10.643523] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-01. [2025-10-02T19:38:10.725062] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-02T19:38:10.730846] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-01. [2025-10-02T19:38:11.364744] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-02T19:38:11.399875] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-01. [2025-10-02T19:38:11.399049] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-02T19:38:11.412201] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-02. [2025-10-02T19:38:11.492598] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-02T19:38:11.508414] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-02T19:38:11.516112] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-02. [2025-10-02T19:38:11.509460] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-01. [2025-10-02T19:38:12.215520] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-02T19:38:12.220538] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-03. [2025-10-02T19:38:12.512812] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-02T19:38:12.518467] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-03. [2025-10-02T19:38:13.067262] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-02T19:38:13.079102] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-02. [2025-10-02T19:38:13.358037] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-02T19:38:13.381163] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-04. [2025-10-02T19:38:13.398073] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-02T19:38:13.410198] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-02. [2025-10-02T19:38:13.575919] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-02T19:38:13.580379] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-04. [2025-10-02T19:38:14.278374] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-02T19:38:14.284380] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-05. [2025-10-02T19:38:14.335141] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-02T19:38:14.340607] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-05. [2025-10-02T19:38:14.496106] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-02T19:38:14.672997] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-03. [2025-10-02T19:38:15.109533] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-02T19:38:15.155833] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-02T19:38:15.201231] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-02T19:38:15.472997] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-06. [2025-10-02T19:38:16.174788] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-02T19:38:16.223400] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-02T19:38:16.273011] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-07. [2025-10-02T19:38:17.018774] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-02T19:38:17.073003] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-04. [2025-10-02T19:38:17.873010] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-03. [2025-10-02T19:38:18.672983] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-08. [2025-10-02T19:38:18.971263] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-02T19:38:19.473025] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-05. [2025-10-02T19:38:19.476254] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-02T19:38:19.653520] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-02T19:38:20.272998] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-09. [2025-10-02T19:38:21.072981] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-04. [2025-10-02T19:38:21.185682] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-02T19:38:21.262539] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-02T19:38:21.873043] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-06. [2025-10-02T19:38:22.673003] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-06. [2025-10-02T19:38:22.818668] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-02T19:38:23.007068] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-02T19:38:23.473057] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-10. [2025-10-02T19:38:24.123092] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-02T19:38:24.124368] [INFO ] [REMOTE ] IQI: Full fetch complete (27034 records). [2025-10-02T19:38:24.124455] [DEBUG] [VALIDATOR ] IQI: Validating primary data. [2025-10-02T19:38:24.273539] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-05. [2025-10-02T19:38:24.562044] [DEBUG] [VALIDATOR ] IQI: All expected trading days are present. [2025-10-02T19:38:24.562173] [DEBUG] [VALIDATOR ] IQI: Primary data validation passed. [2025-10-02T19:38:24.562825] [INFO ] [MAIN ] IQI: Fetched primary data is valid. [2025-10-02T19:38:24.562989] [DEBUG] [LOCAL ] IQI: Saving primary data. [2025-10-02T19:38:24.564305] [DEBUG] [LOCAL ] IQI: Trimmed 27034 records to 18227 (keeping 200 days of data) [2025-10-02T19:38:24.679465] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-02T19:38:24.725455] [DEBUG] [LOCAL ] IQI: Primary data saved (18227 records). [2025-10-02T19:38:24.725585] [INFO ] [MAIN ] IQI: Full history saved. [2025-10-02T19:38:24.725730] [INFO ] [MAIN ] Update Progress: 1121/2370 symbols completed. IQI took 18.5s. Estimated remaining: 2h 56m 26s. Rate: 7.1 symbols/min [2025-10-02T19:38:24.920772] [INFO ] [MAIN ] IQV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:38:24.975414] [DEBUG] [LOCAL ] IQV: Loaded 50102 existing records from primary storage. [2025-10-02T19:38:24.975783] [INFO ] [MAIN ] IQV: Loaded 50102 existing records. [2025-10-02T19:38:25.078900] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-07. [2025-10-02T19:38:25.176196] [WARN ] [MAIN ] IQV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:38:25.176432] [INFO ] [MAIN ] IQV: Wiping existing primary data before full refresh. [2025-10-02T19:38:25.176550] [INFO ] [LOCAL ] IQV: Starting deletion of primary data. [2025-10-02T19:38:25.177876] [DEBUG] [LOCAL ] IQV: Deleted primary data file. [2025-10-02T19:38:25.177939] [INFO ] [MAIN ] IQV: Starting full primary refresh. [2025-10-02T19:38:25.605631] [INFO ] [REMOTE ] IQV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:38:25.873029] [INFO ] [REMOTE ] IQV: Fetching primary data for 2024-12. [2025-10-02T19:38:26.241039] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-02T19:38:26.672997] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-07. [2025-10-02T19:38:26.986208] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-02T19:38:27.340952] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-02T19:38:27.473005] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-06. [2025-10-02T19:38:27.721405] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-02T19:38:28.273057] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-08. [2025-10-02T19:38:29.073013] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-08. [2025-10-02T19:38:29.148544] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-02T19:38:29.370985] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-02T19:38:29.873073] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-01. [2025-10-02T19:38:30.673011] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-09. [2025-10-02T19:38:30.842594] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-02T19:38:31.388606] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-02T19:38:31.456126] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-02T19:38:31.473009] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-10. [2025-10-02T19:38:32.272994] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-09. [2025-10-02T19:38:32.349567] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-02T19:38:32.350894] [INFO ] [REMOTE ] IPI: Full fetch complete (29307 records). [2025-10-02T19:38:32.350969] [DEBUG] [VALIDATOR ] IPI: Validating primary data. [2025-10-02T19:38:32.749238] [DEBUG] [VALIDATOR ] IPI: All expected trading days are present. [2025-10-02T19:38:32.749342] [DEBUG] [VALIDATOR ] IPI: Primary data validation passed. [2025-10-02T19:38:32.749953] [INFO ] [MAIN ] IPI: Fetched primary data is valid. [2025-10-02T19:38:32.750017] [DEBUG] [LOCAL ] IPI: Saving primary data. [2025-10-02T19:38:32.750810] [DEBUG] [LOCAL ] IPI: Trimmed 29307 records to 21605 (keeping 200 days of data) [2025-10-02T19:38:32.880242] [DEBUG] [LOCAL ] IPI: Primary data saved (21605 records). [2025-10-02T19:38:32.880366] [INFO ] [MAIN ] IPI: Full history saved. [2025-10-02T19:38:32.880446] [INFO ] [MAIN ] Update Progress: 1122/2370 symbols completed. IPI took 26.7s. Estimated remaining: 2h 56m 17s. Rate: 7.1 symbols/min [2025-10-02T19:38:33.070602] [INFO ] [MAIN ] IR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:38:33.073072] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-07. [2025-10-02T19:38:33.126098] [DEBUG] [LOCAL ] IR: Loaded 52690 existing records from primary storage. [2025-10-02T19:38:33.126458] [INFO ] [MAIN ] IR: Loaded 52690 existing records. [2025-10-02T19:38:33.320535] [WARN ] [MAIN ] IR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:38:33.320793] [INFO ] [MAIN ] IR: Wiping existing primary data before full refresh. [2025-10-02T19:38:33.320846] [INFO ] [LOCAL ] IR: Starting deletion of primary data. [2025-10-02T19:38:33.322222] [DEBUG] [LOCAL ] IR: Deleted primary data file. [2025-10-02T19:38:33.322287] [INFO ] [MAIN ] IR: Starting full primary refresh. [2025-10-02T19:38:33.738103] [INFO ] [REMOTE ] IR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:38:33.873038] [INFO ] [REMOTE ] IR: Fetching primary data for 2024-12. [2025-10-02T19:38:34.082268] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-02T19:38:34.672980] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-10. [2025-10-02T19:38:34.912210] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-02T19:38:35.405187] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-02T19:38:35.473037] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-08. [2025-10-02T19:38:36.123092] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-02T19:38:36.125377] [INFO ] [REMOTE ] IPG: Full fetch complete (77253 records). [2025-10-02T19:38:36.125523] [DEBUG] [VALIDATOR ] IPG: Validating primary data. [2025-10-02T19:38:36.278100] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-01. [2025-10-02T19:38:36.620743] [DEBUG] [VALIDATOR ] IPG: All expected trading days are present. [2025-10-02T19:38:36.620842] [DEBUG] [VALIDATOR ] IPG: Primary data validation passed. [2025-10-02T19:38:36.621846] [INFO ] [MAIN ] IPG: Fetched primary data is valid. [2025-10-02T19:38:36.621917] [DEBUG] [LOCAL ] IPG: Saving primary data. [2025-10-02T19:38:36.623980] [DEBUG] [LOCAL ] IPG: Trimmed 77253 records to 53719 (keeping 200 days of data) [2025-10-02T19:38:36.973420] [DEBUG] [LOCAL ] IPG: Primary data saved (53719 records). [2025-10-02T19:38:36.973715] [INFO ] [MAIN ] IPG: Full history saved. [2025-10-02T19:38:36.973823] [INFO ] [MAIN ] Update Progress: 1123/2370 symbols completed. IPG took 30.8s. Estimated remaining: 2h 56m 4s. Rate: 7.1 symbols/min [2025-10-02T19:38:37.075499] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-02. [2025-10-02T19:38:37.136353] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-02T19:38:37.225250] [INFO ] [MAIN ] IRM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:38:37.274980] [DEBUG] [LOCAL ] IRM: Loaded 49302 existing records from primary storage. [2025-10-02T19:38:37.275369] [INFO ] [MAIN ] IRM: Loaded 49302 existing records. [2025-10-02T19:38:37.478625] [WARN ] [MAIN ] IRM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:38:37.478906] [INFO ] [MAIN ] IRM: Wiping existing primary data before full refresh. [2025-10-02T19:38:37.478961] [INFO ] [LOCAL ] IRM: Starting deletion of primary data. [2025-10-02T19:38:37.480240] [DEBUG] [LOCAL ] IRM: Deleted primary data file. [2025-10-02T19:38:37.480300] [INFO ] [MAIN ] IRM: Starting full primary refresh. [2025-10-02T19:38:37.878603] [INFO ] [REMOTE ] IRM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:38:37.874319] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-09. [2025-10-02T19:38:38.090813] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-02T19:38:38.359618] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-02T19:38:38.673055] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-02. [2025-10-02T19:38:39.438762] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-02T19:38:39.472969] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-10. [2025-10-02T19:38:40.273023] [INFO ] [REMOTE ] IRM: Fetching primary data for 2024-12. [2025-10-02T19:38:40.399732] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-02T19:38:40.960806] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-02T19:38:40.962977] [INFO ] [REMOTE ] IP: Full fetch complete (77100 records). [2025-10-02T19:38:40.963089] [DEBUG] [VALIDATOR ] IP: Validating primary data. [2025-10-02T19:38:41.074418] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-03. [2025-10-02T19:38:41.381975] [DEBUG] [VALIDATOR ] IP: All expected trading days are present. [2025-10-02T19:38:41.382094] [DEBUG] [VALIDATOR ] IP: Primary data validation passed. [2025-10-02T19:38:41.383101] [INFO ] [MAIN ] IP: Fetched primary data is valid. [2025-10-02T19:38:41.383169] [DEBUG] [LOCAL ] IP: Saving primary data. [2025-10-02T19:38:41.384800] [DEBUG] [LOCAL ] IP: Trimmed 77100 records to 53702 (keeping 200 days of data) [2025-10-02T19:38:41.779168] [DEBUG] [LOCAL ] IP: Primary data saved (53702 records). [2025-10-02T19:38:41.779344] [INFO ] [MAIN ] IP: Full history saved. [2025-10-02T19:38:41.780544] [INFO ] [MAIN ] Update Progress: 1124/2370 symbols completed. IP took 35.6s. Estimated remaining: 2h 55m 51s. Rate: 7.1 symbols/min [2025-10-02T19:38:41.876594] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-03. [2025-10-02T19:38:41.981999] [INFO ] [MAIN ] IRS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:38:42.016723] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-02T19:38:42.045017] [DEBUG] [LOCAL ] IRS: Loaded 21936 existing records from primary storage. [2025-10-02T19:38:42.045293] [INFO ] [MAIN ] IRS: Loaded 21936 existing records. [2025-10-02T19:38:42.258897] [WARN ] [MAIN ] IRS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:38:42.259212] [INFO ] [MAIN ] IRS: Wiping existing primary data before full refresh. [2025-10-02T19:38:42.259269] [INFO ] [LOCAL ] IRS: Starting deletion of primary data. [2025-10-02T19:38:42.260048] [DEBUG] [LOCAL ] IRS: Deleted primary data file. [2025-10-02T19:38:42.260112] [INFO ] [MAIN ] IRS: Starting full primary refresh. [2025-10-02T19:38:42.675098] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-01. [2025-10-02T19:38:42.674870] [INFO ] [REMOTE ] IRS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:38:42.903985] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-02T19:38:43.472970] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-04. [2025-10-02T19:38:43.659039] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-02T19:38:44.127436] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-02T19:38:44.273021] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-04. [2025-10-02T19:38:45.072969] [INFO ] [REMOTE ] IRS: Fetching primary data for 2024-12. [2025-10-02T19:38:45.263245] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-02T19:38:45.872997] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-02. [2025-10-02T19:38:45.972092] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-02T19:38:46.394327] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-02T19:38:46.673019] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-01. [2025-10-02T19:38:47.312165] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-02T19:38:47.473027] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-05. [2025-10-02T19:38:47.968401] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-02T19:38:48.273008] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-02. [2025-10-02T19:38:49.072980] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-03. [2025-10-02T19:38:49.315091] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-02T19:38:49.360778] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-02T19:38:49.873043] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-06. [2025-10-02T19:38:50.672987] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-05. [2025-10-02T19:38:50.907009] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-02T19:38:51.472978] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-03. [2025-10-02T19:38:51.585974] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-02T19:38:52.185610] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-02T19:38:52.273023] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-04. [2025-10-02T19:38:52.437148] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-02T19:38:53.073011] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-06. [2025-10-02T19:38:53.873062] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-04. [2025-10-02T19:38:53.929695] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-02T19:38:54.322861] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-02T19:38:54.672974] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-07. [2025-10-02T19:38:54.927924] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-02T19:38:55.473014] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-07. [2025-10-02T19:38:56.084990] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-02T19:38:56.273002] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-05. [2025-10-02T19:38:57.073038] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-08. [2025-10-02T19:38:57.306077] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-02T19:38:57.873125] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-08. [2025-10-02T19:38:57.976400] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-02T19:38:58.672991] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-05. [2025-10-02T19:38:58.784490] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-02T19:38:59.443570] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-02T19:38:59.472984] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-06. [2025-10-02T19:38:59.510825] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-02T19:39:00.273010] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-09. [2025-10-02T19:39:00.639195] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-02T19:39:01.073004] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-09. [2025-10-02T19:39:01.655170] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-02T19:39:01.873000] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-06. [2025-10-02T19:39:02.673015] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-10. [2025-10-02T19:39:02.815102] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-02T19:39:03.473072] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-07. [2025-10-02T19:39:03.587099] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-02T19:39:03.899917] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-02T19:39:03.902444] [INFO ] [REMOTE ] IQV: Full fetch complete (72192 records). [2025-10-02T19:39:03.902710] [DEBUG] [VALIDATOR ] IQV: Validating primary data. [2025-10-02T19:39:04.278139] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-10. [2025-10-02T19:39:04.384112] [DEBUG] [VALIDATOR ] IQV: All expected trading days are present. [2025-10-02T19:39:04.384231] [DEBUG] [VALIDATOR ] IQV: Primary data validation passed. [2025-10-02T19:39:04.385277] [INFO ] [MAIN ] IQV: Fetched primary data is valid. [2025-10-02T19:39:04.385448] [DEBUG] [LOCAL ] IQV: Saving primary data. [2025-10-02T19:39:04.387682] [DEBUG] [LOCAL ] IQV: Trimmed 72192 records to 50465 (keeping 200 days of data) [2025-10-02T19:39:04.608625] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-02T19:39:04.742930] [DEBUG] [LOCAL ] IQV: Primary data saved (50465 records). [2025-10-02T19:39:04.743086] [INFO ] [MAIN ] IQV: Full history saved. [2025-10-02T19:39:04.743227] [INFO ] [MAIN ] Update Progress: 1125/2370 symbols completed. IQV took 40.0s. Estimated remaining: 2h 55m 59s. Rate: 7.1 symbols/min [2025-10-02T19:39:04.922387] [INFO ] [MAIN ] IRT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:39:04.976964] [DEBUG] [LOCAL ] IRT: Loaded 50401 existing records from primary storage. [2025-10-02T19:39:04.977334] [INFO ] [MAIN ] IRT: Loaded 50401 existing records. [2025-10-02T19:39:05.078261] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-08. [2025-10-02T19:39:05.174833] [WARN ] [MAIN ] IRT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:39:05.175049] [INFO ] [MAIN ] IRT: Wiping existing primary data before full refresh. [2025-10-02T19:39:05.175100] [INFO ] [LOCAL ] IRT: Starting deletion of primary data. [2025-10-02T19:39:05.176575] [DEBUG] [LOCAL ] IRT: Deleted primary data file. [2025-10-02T19:39:05.176668] [INFO ] [MAIN ] IRT: Starting full primary refresh. [2025-10-02T19:39:05.567245] [INFO ] [REMOTE ] IRT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:39:05.826853] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-02T19:39:05.829848] [INFO ] [REMOTE ] IR: Full fetch complete (76181 records). [2025-10-02T19:39:05.829977] [DEBUG] [VALIDATOR ] IR: Validating primary data. [2025-10-02T19:39:05.878161] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-07. [2025-10-02T19:39:06.294362] [DEBUG] [VALIDATOR ] IR: All expected trading days are present. [2025-10-02T19:39:06.295148] [DEBUG] [VALIDATOR ] IR: Primary data validation passed. [2025-10-02T19:39:06.294954] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-02T19:39:06.296331] [INFO ] [MAIN ] IR: Fetched primary data is valid. [2025-10-02T19:39:06.301703] [DEBUG] [LOCAL ] IR: Saving primary data. [2025-10-02T19:39:06.309198] [DEBUG] [LOCAL ] IR: Trimmed 76181 records to 53077 (keeping 200 days of data) [2025-10-02T19:39:06.663154] [DEBUG] [LOCAL ] IR: Primary data saved (53077 records). [2025-10-02T19:39:06.663299] [INFO ] [MAIN ] IR: Full history saved. [2025-10-02T19:39:06.663422] [INFO ] [MAIN ] Update Progress: 1126/2370 symbols completed. IR took 33.8s. Estimated remaining: 2h 55m 43s. Rate: 7.1 symbols/min [2025-10-02T19:39:06.678158] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-09. [2025-10-02T19:39:06.861226] [INFO ] [MAIN ] ISD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:39:06.879840] [DEBUG] [LOCAL ] ISD: Loaded 15574 existing records from primary storage. [2025-10-02T19:39:06.880205] [INFO ] [MAIN ] ISD: Loaded 15574 existing records. [2025-10-02T19:39:07.075607] [WARN ] [MAIN ] ISD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:39:07.075849] [INFO ] [MAIN ] ISD: Wiping existing primary data before full refresh. [2025-10-02T19:39:07.075910] [INFO ] [LOCAL ] ISD: Starting deletion of primary data. [2025-10-02T19:39:07.076567] [DEBUG] [LOCAL ] ISD: Deleted primary data file. [2025-10-02T19:39:07.076629] [INFO ] [MAIN ] ISD: Starting full primary refresh. [2025-10-02T19:39:07.472545] [INFO ] [REMOTE ] ISD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:39:07.473064] [INFO ] [REMOTE ] ISD: Fetching primary data for 2024-12. [2025-10-02T19:39:07.550233] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-02T19:39:08.071097] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-02T19:39:08.272998] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-10. [2025-10-02T19:39:08.585184] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-02T19:39:09.073003] [INFO ] [REMOTE ] IRT: Fetching primary data for 2024-12. [2025-10-02T19:39:09.480798] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-02T19:39:09.483023] [INFO ] [REMOTE ] IRS: Full fetch complete (32271 records). [2025-10-02T19:39:09.483172] [DEBUG] [VALIDATOR ] IRS: Validating primary data. [2025-10-02T19:39:09.881459] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-01. [2025-10-02T19:39:09.927254] [DEBUG] [VALIDATOR ] IRS: All expected trading days are present. [2025-10-02T19:39:09.927337] [DEBUG] [VALIDATOR ] IRS: Primary data validation passed. [2025-10-02T19:39:09.928066] [INFO ] [MAIN ] IRS: Fetched primary data is valid. [2025-10-02T19:39:09.928133] [DEBUG] [LOCAL ] IRS: Saving primary data. [2025-10-02T19:39:09.929036] [DEBUG] [LOCAL ] IRS: Trimmed 32271 records to 22194 (keeping 200 days of data) [2025-10-02T19:39:10.070174] [DEBUG] [LOCAL ] IRS: Primary data saved (22194 records). [2025-10-02T19:39:10.070309] [INFO ] [MAIN ] IRS: Full history saved. [2025-10-02T19:39:10.070395] [INFO ] [MAIN ] Update Progress: 1127/2370 symbols completed. IRS took 28.3s. Estimated remaining: 2h 55m 29s. Rate: 7.1 symbols/min [2025-10-02T19:39:10.255218] [INFO ] [MAIN ] IT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:39:10.306629] [DEBUG] [LOCAL ] IT: Loaded 42034 existing records from primary storage. [2025-10-02T19:39:10.307169] [INFO ] [MAIN ] IT: Loaded 42034 existing records. [2025-10-02T19:39:10.541203] [WARN ] [MAIN ] IT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:39:10.541464] [INFO ] [MAIN ] IT: Wiping existing primary data before full refresh. [2025-10-02T19:39:10.541558] [INFO ] [LOCAL ] IT: Starting deletion of primary data. [2025-10-02T19:39:10.542724] [DEBUG] [LOCAL ] IT: Deleted primary data file. [2025-10-02T19:39:10.542801] [INFO ] [MAIN ] IT: Starting full primary refresh. [2025-10-02T19:39:10.676336] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-08. [2025-10-02T19:39:10.941576] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-02T19:39:10.992560] [INFO ] [REMOTE ] IT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:39:11.009597] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-02T19:39:11.473001] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-01. [2025-10-02T19:39:12.273012] [INFO ] [REMOTE ] IT: Fetching primary data for 2024-12. [2025-10-02T19:39:12.503982] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-02T19:39:13.012630] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-02T19:39:13.072996] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-02. [2025-10-02T19:39:13.679135] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-02T19:39:13.872992] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-01. [2025-10-02T19:39:14.574320] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-02T19:39:14.673004] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-03. [2025-10-02T19:39:15.303921] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-02T19:39:15.473004] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-02. [2025-10-02T19:39:16.209361] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-02T19:39:16.273026] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-04. [2025-10-02T19:39:16.789298] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-02T19:39:17.073024] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-02. [2025-10-02T19:39:17.872990] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-09. [2025-10-02T19:39:17.983338] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-02T19:39:18.023529] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-02T19:39:18.673060] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-03. [2025-10-02T19:39:19.473052] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-05. [2025-10-02T19:39:19.654393] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-02T19:39:19.671548] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-02T19:39:20.273041] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-03. [2025-10-02T19:39:21.027839] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-02T19:39:21.072973] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-10. [2025-10-02T19:39:21.872968] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-06. [2025-10-02T19:39:21.904517] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-02T19:39:22.543667] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-02T19:39:22.545746] [INFO ] [REMOTE ] IRM: Full fetch complete (72245 records). [2025-10-02T19:39:22.545864] [DEBUG] [VALIDATOR ] IRM: Validating primary data. [2025-10-02T19:39:22.678087] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-04. [2025-10-02T19:39:22.958028] [DEBUG] [VALIDATOR ] IRM: All expected trading days are present. [2025-10-02T19:39:22.958121] [DEBUG] [VALIDATOR ] IRM: Primary data validation passed. [2025-10-02T19:39:22.959164] [INFO ] [MAIN ] IRM: Fetched primary data is valid. [2025-10-02T19:39:22.959233] [DEBUG] [LOCAL ] IRM: Saving primary data. [2025-10-02T19:39:22.960855] [DEBUG] [LOCAL ] IRM: Trimmed 72245 records to 49653 (keeping 200 days of data) [2025-10-02T19:39:23.285688] [DEBUG] [LOCAL ] IRM: Primary data saved (49653 records). [2025-10-02T19:39:23.285861] [INFO ] [MAIN ] IRM: Full history saved. [2025-10-02T19:39:23.285971] [INFO ] [MAIN ] Update Progress: 1128/2370 symbols completed. IRM took 46.3s. Estimated remaining: 2h 55m 26s. Rate: 7.1 symbols/min [2025-10-02T19:39:23.479393] [INFO ] [MAIN ] ITGR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:39:23.479496] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-04. [2025-10-02T19:39:23.512700] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-02T19:39:23.553761] [DEBUG] [LOCAL ] ITGR: Loaded 31386 existing records from primary storage. [2025-10-02T19:39:23.554095] [INFO ] [MAIN ] ITGR: Loaded 31386 existing records. [2025-10-02T19:39:23.751550] [WARN ] [MAIN ] ITGR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:39:23.751790] [INFO ] [MAIN ] ITGR: Wiping existing primary data before full refresh. [2025-10-02T19:39:23.751843] [INFO ] [LOCAL ] ITGR: Starting deletion of primary data. [2025-10-02T19:39:23.752742] [DEBUG] [LOCAL ] ITGR: Deleted primary data file. [2025-10-02T19:39:23.752804] [INFO ] [MAIN ] ITGR: Starting full primary refresh. [2025-10-02T19:39:24.157858] [INFO ] [REMOTE ] ITGR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:39:24.273008] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-07. [2025-10-02T19:39:24.302039] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-02T19:39:25.073020] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-05. [2025-10-02T19:39:25.218578] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-02T19:39:25.664186] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-02T19:39:25.873040] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-06. [2025-10-02T19:39:26.177147] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-02T19:39:26.452518] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-02T19:39:26.673037] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-08. [2025-10-02T19:39:27.473014] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-07. [2025-10-02T19:39:28.231266] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-02T19:39:28.272971] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2024-12. [2025-10-02T19:39:28.317944] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-02T19:39:29.073009] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-05. [2025-10-02T19:39:29.560085] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-02T19:39:29.873019] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-09. [2025-10-02T19:39:30.175482] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-02T19:39:30.673076] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-08. [2025-10-02T19:39:31.474582] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-01. [2025-10-02T19:39:31.478211] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-02T19:39:31.506023] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-02T19:39:32.273013] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-10. [2025-10-02T19:39:32.548824] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-02T19:39:33.072934] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-02. [2025-10-02T19:39:33.606374] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-02T19:39:33.608461] [INFO ] [REMOTE ] IRT: Full fetch complete (72616 records). [2025-10-02T19:39:33.608586] [DEBUG] [VALIDATOR ] IRT: Validating primary data. [2025-10-02T19:39:33.882567] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-06. [2025-10-02T19:39:34.054247] [DEBUG] [VALIDATOR ] IRT: All expected trading days are present. [2025-10-02T19:39:34.054404] [DEBUG] [VALIDATOR ] IRT: Primary data validation passed. [2025-10-02T19:39:34.055516] [INFO ] [MAIN ] IRT: Fetched primary data is valid. [2025-10-02T19:39:34.055621] [DEBUG] [LOCAL ] IRT: Saving primary data. [2025-10-02T19:39:34.057283] [DEBUG] [LOCAL ] IRT: Trimmed 72616 records to 50773 (keeping 200 days of data) [2025-10-02T19:39:34.278101] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-02T19:39:34.421789] [DEBUG] [LOCAL ] IRT: Primary data saved (50773 records). [2025-10-02T19:39:34.421982] [INFO ] [MAIN ] IRT: Full history saved. [2025-10-02T19:39:34.422078] [INFO ] [MAIN ] Update Progress: 1129/2370 symbols completed. IRT took 29.7s. Estimated remaining: 2h 55m 20s. Rate: 7.1 symbols/min [2025-10-02T19:39:34.606794] [INFO ] [MAIN ] ITT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:39:34.644625] [DEBUG] [LOCAL ] ITT: Loaded 32783 existing records from primary storage. [2025-10-02T19:39:34.645019] [INFO ] [MAIN ] ITT: Loaded 32783 existing records. [2025-10-02T19:39:34.678129] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-03. [2025-10-02T19:39:34.846922] [WARN ] [MAIN ] ITT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:39:34.847201] [INFO ] [MAIN ] ITT: Wiping existing primary data before full refresh. [2025-10-02T19:39:34.847265] [INFO ] [LOCAL ] ITT: Starting deletion of primary data. [2025-10-02T19:39:34.848579] [DEBUG] [LOCAL ] ITT: Deleted primary data file. [2025-10-02T19:39:34.848675] [INFO ] [MAIN ] ITT: Starting full primary refresh. [2025-10-02T19:39:35.272249] [INFO ] [REMOTE ] ITT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:39:35.296806] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-02T19:39:35.473038] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-09. [2025-10-02T19:39:36.223824] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-02T19:39:36.272987] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-04. [2025-10-02T19:39:36.336455] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-02T19:39:37.073058] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-10. [2025-10-02T19:39:37.592628] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-02T19:39:37.744771] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-02T19:39:37.746080] [INFO ] [REMOTE ] ISD: Full fetch complete (24019 records). [2025-10-02T19:39:37.746165] [DEBUG] [VALIDATOR ] ISD: Validating primary data. [2025-10-02T19:39:37.878204] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-07. [2025-10-02T19:39:38.154492] [DEBUG] [VALIDATOR ] ISD: All expected trading days are present. [2025-10-02T19:39:38.154576] [DEBUG] [VALIDATOR ] ISD: Primary data validation passed. [2025-10-02T19:39:38.155206] [INFO ] [MAIN ] ISD: Fetched primary data is valid. [2025-10-02T19:39:38.155272] [DEBUG] [LOCAL ] ISD: Saving primary data. [2025-10-02T19:39:38.156211] [DEBUG] [LOCAL ] ISD: Trimmed 24019 records to 15710 (keeping 200 days of data) [2025-10-02T19:39:38.254630] [DEBUG] [LOCAL ] ISD: Primary data saved (15710 records). [2025-10-02T19:39:38.254813] [INFO ] [MAIN ] ISD: Full history saved. [2025-10-02T19:39:38.254941] [INFO ] [MAIN ] Update Progress: 1130/2370 symbols completed. ISD took 31.6s. Estimated remaining: 2h 55m 6s. Rate: 7.1 symbols/min [2025-10-02T19:39:38.433385] [INFO ] [MAIN ] ITUB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:39:38.487375] [DEBUG] [LOCAL ] ITUB: Loaded 53325 existing records from primary storage. [2025-10-02T19:39:38.487758] [INFO ] [MAIN ] ITUB: Loaded 53325 existing records. [2025-10-02T19:39:38.683254] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-05. [2025-10-02T19:39:38.690818] [WARN ] [MAIN ] ITUB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:39:38.692102] [INFO ] [MAIN ] ITUB: Wiping existing primary data before full refresh. [2025-10-02T19:39:38.692181] [INFO ] [LOCAL ] ITUB: Starting deletion of primary data. [2025-10-02T19:39:38.694226] [DEBUG] [LOCAL ] ITUB: Deleted primary data file. [2025-10-02T19:39:38.694289] [INFO ] [MAIN ] ITUB: Starting full primary refresh. [2025-10-02T19:39:39.099488] [INFO ] [REMOTE ] ITUB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:39:39.472975] [INFO ] [REMOTE ] ITT: Fetching primary data for 2024-12. [2025-10-02T19:39:39.513875] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-02T19:39:40.136728] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-02T19:39:40.273016] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-08. [2025-10-02T19:39:40.800174] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-02T19:39:41.073040] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-06. [2025-10-02T19:39:41.759603] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-02T19:39:41.873003] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-01. [2025-10-02T19:39:42.312583] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-02T19:39:42.673057] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-07. [2025-10-02T19:39:43.223454] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-02T19:39:43.472978] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-09. [2025-10-02T19:39:43.762509] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-02T19:39:44.273022] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-02. [2025-10-02T19:39:44.727009] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-02T19:39:45.073000] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-10. [2025-10-02T19:39:45.687002] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-02T19:39:45.873030] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-03. [2025-10-02T19:39:46.332848] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-02T19:39:46.334716] [INFO ] [REMOTE ] IT: Full fetch complete (56194 records). [2025-10-02T19:39:46.334863] [DEBUG] [VALIDATOR ] IT: Validating primary data. [2025-10-02T19:39:46.678202] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2024-12. [2025-10-02T19:39:46.762376] [DEBUG] [VALIDATOR ] IT: All expected trading days are present. [2025-10-02T19:39:46.762475] [DEBUG] [VALIDATOR ] IT: Primary data validation passed. [2025-10-02T19:39:46.763364] [INFO ] [MAIN ] IT: Fetched primary data is valid. [2025-10-02T19:39:46.763428] [DEBUG] [LOCAL ] IT: Saving primary data. [2025-10-02T19:39:46.764819] [DEBUG] [LOCAL ] IT: Trimmed 56194 records to 42328 (keeping 200 days of data) [2025-10-02T19:39:47.043106] [DEBUG] [LOCAL ] IT: Primary data saved (42328 records). [2025-10-02T19:39:47.043279] [INFO ] [MAIN ] IT: Full history saved. [2025-10-02T19:39:47.044233] [INFO ] [MAIN ] Update Progress: 1131/2370 symbols completed. IT took 37.0s. Estimated remaining: 2h 54m 58s. Rate: 7.1 symbols/min [2025-10-02T19:39:47.246884] [INFO ] [MAIN ] ITW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:39:47.307923] [DEBUG] [LOCAL ] ITW: Loaded 45819 existing records from primary storage. [2025-10-02T19:39:47.308305] [INFO ] [MAIN ] ITW: Loaded 45819 existing records. [2025-10-02T19:39:47.455742] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-02T19:39:47.478996] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-08. [2025-10-02T19:39:47.544767] [WARN ] [MAIN ] ITW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:39:47.545328] [INFO ] [MAIN ] ITW: Wiping existing primary data before full refresh. [2025-10-02T19:39:47.545428] [INFO ] [LOCAL ] ITW: Starting deletion of primary data. [2025-10-02T19:39:47.547264] [DEBUG] [LOCAL ] ITW: Deleted primary data file. [2025-10-02T19:39:47.547333] [INFO ] [MAIN ] ITW: Starting full primary refresh. [2025-10-02T19:39:47.972449] [INFO ] [REMOTE ] ITW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:39:48.200635] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-02T19:39:48.272966] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-04. [2025-10-02T19:39:48.661201] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-02T19:39:49.073010] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-09. [2025-10-02T19:39:49.714744] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-02T19:39:49.873017] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-05. [2025-10-02T19:39:50.431891] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-02T19:39:50.673012] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-10. [2025-10-02T19:39:51.364117] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-02T19:39:51.473060] [INFO ] [REMOTE ] ITW: Fetching primary data for 2024-12. [2025-10-02T19:39:51.698337] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-02T19:39:51.701947] [INFO ] [REMOTE ] ITGR: Full fetch complete (41788 records). [2025-10-02T19:39:51.702051] [DEBUG] [VALIDATOR ] ITGR: Validating primary data. [2025-10-02T19:39:52.179322] [DEBUG] [VALIDATOR ] ITGR: All expected trading days are present. [2025-10-02T19:39:52.179437] [DEBUG] [VALIDATOR ] ITGR: Primary data validation passed. [2025-10-02T19:39:52.180870] [INFO ] [MAIN ] ITGR: Fetched primary data is valid. [2025-10-02T19:39:52.180941] [DEBUG] [LOCAL ] ITGR: Saving primary data. [2025-10-02T19:39:52.182388] [DEBUG] [LOCAL ] ITGR: Trimmed 41788 records to 31551 (keeping 200 days of data) [2025-10-02T19:39:52.273342] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-01. [2025-10-02T19:39:52.401815] [DEBUG] [LOCAL ] ITGR: Primary data saved (31551 records). [2025-10-02T19:39:52.402041] [INFO ] [MAIN ] ITGR: Full history saved. [2025-10-02T19:39:52.402184] [INFO ] [MAIN ] Update Progress: 1132/2370 symbols completed. ITGR took 29.1s. Estimated remaining: 2h 54m 46s. Rate: 7.1 symbols/min [2025-10-02T19:39:52.573316] [INFO ] [MAIN ] IVR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:39:52.627188] [DEBUG] [LOCAL ] IVR: Loaded 47888 existing records from primary storage. [2025-10-02T19:39:52.627677] [INFO ] [MAIN ] IVR: Loaded 47888 existing records. [2025-10-02T19:39:52.820882] [WARN ] [MAIN ] IVR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:39:52.821406] [INFO ] [MAIN ] IVR: Wiping existing primary data before full refresh. [2025-10-02T19:39:52.821470] [INFO ] [LOCAL ] IVR: Starting deletion of primary data. [2025-10-02T19:39:52.825490] [DEBUG] [LOCAL ] IVR: Deleted primary data file. [2025-10-02T19:39:52.825557] [INFO ] [MAIN ] IVR: Starting full primary refresh. [2025-10-02T19:39:53.081737] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-06. [2025-10-02T19:39:53.233453] [INFO ] [REMOTE ] IVR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:39:53.245492] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-02T19:39:53.873044] [INFO ] [REMOTE ] IVR: Fetching primary data for 2024-12. [2025-10-02T19:39:54.071296] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-02T19:39:54.413523] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-02T19:39:54.673023] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-01. [2025-10-02T19:39:55.345691] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-02T19:39:55.473080] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-01. [2025-10-02T19:39:56.163824] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-02T19:39:56.273009] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-02. [2025-10-02T19:39:57.073008] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-02. [2025-10-02T19:39:57.122997] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-02T19:39:57.883709] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-07. [2025-10-02T19:39:57.890003] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-02T19:39:58.555453] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-02T19:39:58.672999] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-02. [2025-10-02T19:39:59.269137] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-02T19:39:59.473076] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-03. [2025-10-02T19:40:00.257585] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-02T19:40:00.272963] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-03. [2025-10-02T19:40:01.073018] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-08. [2025-10-02T19:40:01.705967] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-02T19:40:01.872999] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-04. [2025-10-02T19:40:02.394059] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-02T19:40:02.509355] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-10-02T19:40:02.673029] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-09. [2025-10-02T19:40:03.473003] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-04. [2025-10-02T19:40:03.750474] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-02T19:40:04.034198] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-02T19:40:04.273020] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-03. [2025-10-02T19:40:05.073029] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-10. [2025-10-02T19:40:05.291914] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-02T19:40:05.873045] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-05. [2025-10-02T19:40:05.903432] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-02T19:40:05.905017] [INFO ] [REMOTE ] ITT: Full fetch complete (47024 records). [2025-10-02T19:40:05.905143] [DEBUG] [VALIDATOR ] ITT: Validating primary data. [2025-10-02T19:40:06.362502] [DEBUG] [VALIDATOR ] ITT: All expected trading days are present. [2025-10-02T19:40:06.362860] [DEBUG] [VALIDATOR ] ITT: Primary data validation passed. [2025-10-02T19:40:06.364313] [INFO ] [MAIN ] ITT: Fetched primary data is valid. [2025-10-02T19:40:06.365592] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-02T19:40:06.376149] [DEBUG] [LOCAL ] ITT: Saving primary data. [2025-10-02T19:40:06.377839] [DEBUG] [LOCAL ] ITT: Trimmed 47024 records to 32995 (keeping 200 days of data) [2025-10-02T19:40:06.612511] [DEBUG] [LOCAL ] ITT: Primary data saved (32995 records). [2025-10-02T19:40:06.612680] [INFO ] [MAIN ] ITT: Full history saved. [2025-10-02T19:40:06.612784] [INFO ] [MAIN ] Update Progress: 1133/2370 symbols completed. ITT took 32.2s. Estimated remaining: 2h 54m 44s. Rate: 7.1 symbols/min [2025-10-02T19:40:06.684147] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-04. [2025-10-02T19:40:06.806214] [INFO ] [MAIN ] IVT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:40:06.839384] [DEBUG] [LOCAL ] IVT: Loaded 30693 existing records from primary storage. [2025-10-02T19:40:06.839688] [INFO ] [MAIN ] IVT: Loaded 30693 existing records. [2025-10-02T19:40:07.028108] [WARN ] [MAIN ] IVT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:40:07.028375] [INFO ] [MAIN ] IVT: Wiping existing primary data before full refresh. [2025-10-02T19:40:07.028426] [INFO ] [LOCAL ] IVT: Starting deletion of primary data. [2025-10-02T19:40:07.029734] [DEBUG] [LOCAL ] IVT: Deleted primary data file. [2025-10-02T19:40:07.029824] [INFO ] [MAIN ] IVT: Starting full primary refresh. [2025-10-02T19:40:07.468850] [INFO ] [REMOTE ] IVT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:40:07.472979] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-05. [2025-10-02T19:40:07.552288] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-02T19:40:08.273034] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-06. [2025-10-02T19:40:08.647570] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-02T19:40:08.996562] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-02T19:40:09.073000] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-05. [2025-10-02T19:40:09.873012] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-06. [2025-10-02T19:40:10.282252] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-02T19:40:10.673009] [INFO ] [REMOTE ] IVT: Fetching primary data for 2024-12. [2025-10-02T19:40:10.758820] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-02T19:40:11.473065] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-06. [2025-10-02T19:40:11.688951] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-02T19:40:12.030989] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-02T19:40:12.272990] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-01. [2025-10-02T19:40:12.655904] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-02T19:40:13.072996] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-07. [2025-10-02T19:40:13.560195] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-02T19:40:13.873001] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-07. [2025-10-02T19:40:14.672994] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-07. [2025-10-02T19:40:14.920106] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-02T19:40:15.473061] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-08. [2025-10-02T19:40:15.570350] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-02T19:40:16.273045] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-08. [2025-10-02T19:40:16.505887] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-02T19:40:17.013210] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-02T19:40:17.073006] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-09. [2025-10-02T19:40:17.873012] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-02. [2025-10-02T19:40:18.235466] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-02T19:40:18.673684] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-02T19:40:18.673778] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-09. [2025-10-02T19:40:19.132263] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-02T19:40:19.473025] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-08. [2025-10-02T19:40:20.273027] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-03. [2025-10-02T19:40:20.511372] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-02T19:40:21.073030] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-10. [2025-10-02T19:40:21.162402] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-02T19:40:21.521982] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-02T19:40:21.873007] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-09. [2025-10-02T19:40:22.589218] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-02T19:40:22.591435] [INFO ] [REMOTE ] ITUB: Full fetch complete (77169 records). [2025-10-02T19:40:22.591677] [DEBUG] [VALIDATOR ] ITUB: Validating primary data. [2025-10-02T19:40:22.678199] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-04. [2025-10-02T19:40:23.038612] [DEBUG] [VALIDATOR ] ITUB: All expected trading days are present. [2025-10-02T19:40:23.038729] [DEBUG] [VALIDATOR ] ITUB: Primary data validation passed. [2025-10-02T19:40:23.039823] [INFO ] [MAIN ] ITUB: Fetched primary data is valid. [2025-10-02T19:40:23.039889] [DEBUG] [LOCAL ] ITUB: Saving primary data. [2025-10-02T19:40:23.041389] [DEBUG] [LOCAL ] ITUB: Trimmed 77169 records to 53711 (keeping 200 days of data) [2025-10-02T19:40:23.377991] [DEBUG] [LOCAL ] ITUB: Primary data saved (53711 records). [2025-10-02T19:40:23.378167] [INFO ] [MAIN ] ITUB: Full history saved. [2025-10-02T19:40:23.378295] [INFO ] [MAIN ] Update Progress: 1134/2370 symbols completed. ITUB took 45.1s. Estimated remaining: 2h 54m 45s. Rate: 7.1 symbols/min [2025-10-02T19:40:23.477276] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-10. [2025-10-02T19:40:23.579369] [INFO ] [MAIN ] IVZ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:40:23.637993] [DEBUG] [LOCAL ] IVZ: Loaded 53128 existing records from primary storage. [2025-10-02T19:40:23.638382] [INFO ] [MAIN ] IVZ: Loaded 53128 existing records. [2025-10-02T19:40:23.881595] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-02T19:40:23.879665] [WARN ] [MAIN ] IVZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:40:23.892499] [INFO ] [MAIN ] IVZ: Wiping existing primary data before full refresh. [2025-10-02T19:40:23.892596] [INFO ] [LOCAL ] IVZ: Starting deletion of primary data. [2025-10-02T19:40:23.894991] [DEBUG] [LOCAL ] IVZ: Deleted primary data file. [2025-10-02T19:40:23.895062] [INFO ] [MAIN ] IVZ: Starting full primary refresh. [2025-10-02T19:40:24.310743] [INFO ] [REMOTE ] IVZ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:40:24.304405] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-10. [2025-10-02T19:40:24.333190] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-02T19:40:24.645863] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-02T19:40:24.647743] [INFO ] [REMOTE ] ITW: Full fetch complete (66374 records). [2025-10-02T19:40:24.647846] [DEBUG] [VALIDATOR ] ITW: Validating primary data. [2025-10-02T19:40:25.061913] [DEBUG] [VALIDATOR ] ITW: All expected trading days are present. [2025-10-02T19:40:25.062004] [DEBUG] [VALIDATOR ] ITW: Primary data validation passed. [2025-10-02T19:40:25.062966] [INFO ] [MAIN ] ITW: Fetched primary data is valid. [2025-10-02T19:40:25.063050] [DEBUG] [LOCAL ] ITW: Saving primary data. [2025-10-02T19:40:25.064520] [DEBUG] [LOCAL ] ITW: Trimmed 66374 records to 46101 (keeping 200 days of data) [2025-10-02T19:40:25.126094] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2024-12. [2025-10-02T19:40:25.390273] [DEBUG] [LOCAL ] ITW: Primary data saved (46101 records). [2025-10-02T19:40:25.390411] [INFO ] [MAIN ] ITW: Full history saved. [2025-10-02T19:40:25.391818] [INFO ] [MAIN ] Update Progress: 1135/2370 symbols completed. ITW took 38.3s. Estimated remaining: 2h 54m 29s. Rate: 7.1 symbols/min [2025-10-02T19:40:25.576241] [INFO ] [MAIN ] IX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:40:25.603746] [DEBUG] [LOCAL ] IX: Loaded 22501 existing records from primary storage. [2025-10-02T19:40:25.604008] [INFO ] [MAIN ] IX: Loaded 22501 existing records. [2025-10-02T19:40:25.816461] [WARN ] [MAIN ] IX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:40:25.816724] [INFO ] [MAIN ] IX: Wiping existing primary data before full refresh. [2025-10-02T19:40:25.816825] [INFO ] [LOCAL ] IX: Starting deletion of primary data. [2025-10-02T19:40:25.817633] [DEBUG] [LOCAL ] IX: Deleted primary data file. [2025-10-02T19:40:25.817732] [INFO ] [MAIN ] IX: Starting full primary refresh. [2025-10-02T19:40:25.878145] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-05. [2025-10-02T19:40:25.931690] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-02T19:40:25.950037] [INFO ] [REMOTE ] IVR: Full fetch complete (69181 records). [2025-10-02T19:40:25.965761] [DEBUG] [VALIDATOR ] IVR: Validating primary data. [2025-10-02T19:40:26.500855] [INFO ] [REMOTE ] IX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:40:26.677475] [INFO ] [REMOTE ] IX: Fetching primary data for 2024-12. [2025-10-02T19:40:26.681454] [DEBUG] [VALIDATOR ] IVR: All expected trading days are present. [2025-10-02T19:40:26.682519] [DEBUG] [VALIDATOR ] IVR: Primary data validation passed. [2025-10-02T19:40:26.683572] [INFO ] [MAIN ] IVR: Fetched primary data is valid. [2025-10-02T19:40:26.683853] [DEBUG] [LOCAL ] IVR: Saving primary data. [2025-10-02T19:40:26.686220] [DEBUG] [LOCAL ] IVR: Trimmed 69181 records to 48258 (keeping 200 days of data) [2025-10-02T19:40:26.812175] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-02T19:40:27.025210] [DEBUG] [LOCAL ] IVR: Primary data saved (48258 records). [2025-10-02T19:40:27.025515] [INFO ] [MAIN ] IVR: Full history saved. [2025-10-02T19:40:27.025722] [INFO ] [MAIN ] Update Progress: 1136/2370 symbols completed. IVR took 34.6s. Estimated remaining: 2h 54m 13s. Rate: 7.1 symbols/min [2025-10-02T19:40:27.233194] [INFO ] [MAIN ] J: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:40:27.278971] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-02T19:40:27.299284] [DEBUG] [LOCAL ] J: Loaded 40138 existing records from primary storage. [2025-10-02T19:40:27.299610] [INFO ] [MAIN ] J: Loaded 40138 existing records. [2025-10-02T19:40:27.494044] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-06. [2025-10-02T19:40:27.500533] [WARN ] [MAIN ] J: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:40:27.501947] [INFO ] [MAIN ] J: Wiping existing primary data before full refresh. [2025-10-02T19:40:27.502018] [INFO ] [LOCAL ] J: Starting deletion of primary data. [2025-10-02T19:40:27.504211] [DEBUG] [LOCAL ] J: Deleted primary data file. [2025-10-02T19:40:27.504438] [INFO ] [MAIN ] J: Starting full primary refresh. [2025-10-02T19:40:27.850060] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-02T19:40:27.920959] [INFO ] [REMOTE ] J: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:40:28.273045] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-01. [2025-10-02T19:40:28.763905] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-02T19:40:29.073047] [INFO ] [REMOTE ] J: Fetching primary data for 2024-12. [2025-10-02T19:40:29.873025] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-01. [2025-10-02T19:40:29.971924] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-02T19:40:30.240459] [INFO ] [REMOTE ] J: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-02T19:40:30.301293] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-02T19:40:30.673006] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-07. [2025-10-02T19:40:31.473007] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-02. [2025-10-02T19:40:32.193365] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-02T19:40:32.273049] [INFO ] [REMOTE ] J: Fetching primary data for 2025-01. [2025-10-02T19:40:33.073003] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-02. [2025-10-02T19:40:33.229005] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-02T19:40:33.790770] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-02T19:40:33.843540] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-02T19:40:33.872966] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-03. [2025-10-02T19:40:34.673051] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-08. [2025-10-02T19:40:34.744209] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-02T19:40:35.472969] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-03. [2025-10-02T19:40:35.761621] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-02T19:40:36.273031] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-09. [2025-10-02T19:40:37.072995] [INFO ] [REMOTE ] J: Fetching primary data for 2025-02. [2025-10-02T19:40:37.308365] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-02T19:40:37.342037] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-02T19:40:37.873035] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-04. [2025-10-02T19:40:38.591370] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-02T19:40:38.673075] [INFO ] [REMOTE ] J: Fetching primary data for 2025-03. [2025-10-02T19:40:38.877915] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-02T19:40:39.472997] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-04. [2025-10-02T19:40:40.273023] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-10. [2025-10-02T19:40:40.324003] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-02T19:40:41.072984] [INFO ] [REMOTE ] J: Fetching primary data for 2025-04. [2025-10-02T19:40:41.324693] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-02T19:40:41.358636] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-02T19:40:41.360723] [INFO ] [REMOTE ] IVT: Full fetch complete (45515 records). [2025-10-02T19:40:41.360852] [DEBUG] [VALIDATOR ] IVT: Validating primary data. [2025-10-02T19:40:41.786198] [DEBUG] [VALIDATOR ] IVT: All expected trading days are present. [2025-10-02T19:40:41.786286] [DEBUG] [VALIDATOR ] IVT: Primary data validation passed. [2025-10-02T19:40:41.787006] [INFO ] [MAIN ] IVT: Fetched primary data is valid. [2025-10-02T19:40:41.787071] [DEBUG] [LOCAL ] IVT: Saving primary data. [2025-10-02T19:40:41.788259] [DEBUG] [LOCAL ] IVT: Trimmed 45515 records to 30940 (keeping 200 days of data) [2025-10-02T19:40:41.877501] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-05. [2025-10-02T19:40:41.985300] [DEBUG] [LOCAL ] IVT: Primary data saved (30940 records). [2025-10-02T19:40:41.985447] [INFO ] [MAIN ] IVT: Full history saved. [2025-10-02T19:40:41.985529] [INFO ] [MAIN ] Update Progress: 1137/2370 symbols completed. IVT took 35.4s. Estimated remaining: 2h 54m 12s. Rate: 7.1 symbols/min [2025-10-02T19:40:42.171208] [INFO ] [MAIN ] JBGS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:40:42.215130] [DEBUG] [LOCAL ] JBGS: Loaded 42383 existing records from primary storage. [2025-10-02T19:40:42.215481] [INFO ] [MAIN ] JBGS: Loaded 42383 existing records. [2025-10-02T19:40:42.423867] [WARN ] [MAIN ] JBGS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:40:42.424165] [INFO ] [MAIN ] JBGS: Wiping existing primary data before full refresh. [2025-10-02T19:40:42.424215] [INFO ] [LOCAL ] JBGS: Starting deletion of primary data. [2025-10-02T19:40:42.427160] [DEBUG] [LOCAL ] JBGS: Deleted primary data file. [2025-10-02T19:40:42.427233] [INFO ] [MAIN ] JBGS: Starting full primary refresh. [2025-10-02T19:40:42.678139] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-05. [2025-10-02T19:40:42.880987] [INFO ] [REMOTE ] JBGS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:40:42.893363] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-02T19:40:43.472973] [INFO ] [REMOTE ] J: Fetching primary data for 2025-05. [2025-10-02T19:40:43.594765] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-02T19:40:43.724819] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-02T19:40:44.273026] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-06. [2025-10-02T19:40:44.841304] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-02T19:40:45.073040] [INFO ] [REMOTE ] J: Fetching primary data for 2025-06. [2025-10-02T19:40:45.321160] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-02T19:40:45.873028] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2024-12. [2025-10-02T19:40:46.468943] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-02T19:40:46.673065] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-06. [2025-10-02T19:40:46.994337] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-02T19:40:47.473036] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-07. [2025-10-02T19:40:48.060142] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-02T19:40:48.272997] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-07. [2025-10-02T19:40:48.406180] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-02T19:40:49.073044] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-01. [2025-10-02T19:40:49.872990] [INFO ] [REMOTE ] J: Fetching primary data for 2025-07. [2025-10-02T19:40:50.256762] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-02T19:40:50.383077] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-02T19:40:50.673007] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-08. [2025-10-02T19:40:51.021740] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-02T19:40:51.473026] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-02. [2025-10-02T19:40:52.272995] [INFO ] [REMOTE ] J: Fetching primary data for 2025-08. [2025-10-02T19:40:52.459556] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-02T19:40:52.866201] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-02T19:40:53.073009] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-03. [2025-10-02T19:40:53.766987] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-02T19:40:53.873000] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-08. [2025-10-02T19:40:54.435463] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-02T19:40:54.484112] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-02T19:40:54.673046] [INFO ] [REMOTE ] J: Fetching primary data for 2025-09. [2025-10-02T19:40:55.473014] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-04. [2025-10-02T19:40:56.198129] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-02T19:40:56.272986] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-09. [2025-10-02T19:40:56.652893] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-02T19:40:57.073016] [INFO ] [REMOTE ] J: Fetching primary data for 2025-10. [2025-10-02T19:40:57.873004] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-09. [2025-10-02T19:40:58.071358] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-02T19:40:58.107901] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-02T19:40:58.109823] [INFO ] [REMOTE ] J: Full fetch complete (59098 records). [2025-10-02T19:40:58.110066] [DEBUG] [VALIDATOR ] J: Validating primary data. [2025-10-02T19:40:58.519009] [DEBUG] [VALIDATOR ] J: All expected trading days are present. [2025-10-02T19:40:58.519100] [DEBUG] [VALIDATOR ] J: Primary data validation passed. [2025-10-02T19:40:58.520081] [INFO ] [MAIN ] J: Fetched primary data is valid. [2025-10-02T19:40:58.520147] [DEBUG] [LOCAL ] J: Saving primary data. [2025-10-02T19:40:58.521524] [DEBUG] [LOCAL ] J: Trimmed 59098 records to 40454 (keeping 200 days of data) [2025-10-02T19:40:58.709837] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-05. [2025-10-02T19:40:58.788606] [DEBUG] [LOCAL ] J: Primary data saved (40454 records). [2025-10-02T19:40:58.788770] [INFO ] [MAIN ] J: Full history saved. [2025-10-02T19:40:58.788859] [INFO ] [MAIN ] Update Progress: 1138/2370 symbols completed. J took 31.8s. Estimated remaining: 2h 54m 12s. Rate: 7.1 symbols/min [2025-10-02T19:40:58.987945] [INFO ] [MAIN ] JBI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:40:59.000763] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-02T19:40:59.046882] [DEBUG] [LOCAL ] JBI: Loaded 43502 existing records from primary storage. [2025-10-02T19:40:59.047196] [INFO ] [MAIN ] JBI: Loaded 43502 existing records. [2025-10-02T19:40:59.245149] [WARN ] [MAIN ] JBI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:40:59.245365] [INFO ] [MAIN ] JBI: Wiping existing primary data before full refresh. [2025-10-02T19:40:59.245460] [INFO ] [LOCAL ] JBI: Starting deletion of primary data. [2025-10-02T19:40:59.246403] [DEBUG] [LOCAL ] JBI: Deleted primary data file. [2025-10-02T19:40:59.246467] [INFO ] [MAIN ] JBI: Starting full primary refresh. [2025-10-02T19:40:59.478207] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-10. [2025-10-02T19:40:59.634532] [INFO ] [REMOTE ] JBI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:41:00.273042] [INFO ] [REMOTE ] JBI: Fetching primary data for 2024-12. [2025-10-02T19:41:00.323503] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-02T19:41:01.073045] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-06. [2025-10-02T19:41:01.283263] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-02T19:41:01.285842] [INFO ] [REMOTE ] IVZ: Full fetch complete (76783 records). [2025-10-02T19:41:01.286061] [DEBUG] [VALIDATOR ] IVZ: Validating primary data. [2025-10-02T19:41:01.742548] [DEBUG] [VALIDATOR ] IVZ: All expected trading days are present. [2025-10-02T19:41:01.742720] [DEBUG] [VALIDATOR ] IVZ: Primary data validation passed. [2025-10-02T19:41:01.744040] [INFO ] [MAIN ] IVZ: Fetched primary data is valid. [2025-10-02T19:41:01.744126] [DEBUG] [LOCAL ] IVZ: Saving primary data. [2025-10-02T19:41:01.746116] [DEBUG] [LOCAL ] IVZ: Trimmed 76783 records to 53517 (keeping 200 days of data) [2025-10-02T19:41:01.873807] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-10. [2025-10-02T19:41:02.048457] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-02T19:41:02.161535] [DEBUG] [LOCAL ] IVZ: Primary data saved (53517 records). [2025-10-02T19:41:02.161896] [INFO ] [MAIN ] IVZ: Full history saved. [2025-10-02T19:41:02.162097] [INFO ] [MAIN ] Update Progress: 1139/2370 symbols completed. IVZ took 38.8s. Estimated remaining: 2h 53m 58s. Rate: 7.1 symbols/min [2025-10-02T19:41:02.310897] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-02T19:41:02.402976] [INFO ] [MAIN ] JBL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:41:02.455867] [DEBUG] [LOCAL ] JBL: Loaded 48376 existing records from primary storage. [2025-10-02T19:41:02.456237] [INFO ] [MAIN ] JBL: Loaded 48376 existing records. [2025-10-02T19:41:02.658247] [WARN ] [MAIN ] JBL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:41:02.658463] [INFO ] [MAIN ] JBL: Wiping existing primary data before full refresh. [2025-10-02T19:41:02.658514] [INFO ] [LOCAL ] JBL: Starting deletion of primary data. [2025-10-02T19:41:02.659796] [DEBUG] [LOCAL ] JBL: Deleted primary data file. [2025-10-02T19:41:02.659859] [INFO ] [MAIN ] JBL: Starting full primary refresh. [2025-10-02T19:41:02.680919] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-07. [2025-10-02T19:41:02.787059] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-02T19:41:02.814786] [INFO ] [REMOTE ] IX: Full fetch complete (27293 records). [2025-10-02T19:41:02.833378] [DEBUG] [VALIDATOR ] IX: Validating primary data. [2025-10-02T19:41:03.271852] [INFO ] [REMOTE ] JBL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:41:03.477121] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-01. [2025-10-02T19:41:03.478517] [DEBUG] [VALIDATOR ] IX: All expected trading days are present. [2025-10-02T19:41:03.478624] [DEBUG] [VALIDATOR ] IX: Primary data validation passed. [2025-10-02T19:41:03.479269] [INFO ] [MAIN ] IX: Fetched primary data is valid. [2025-10-02T19:41:03.479336] [DEBUG] [LOCAL ] IX: Saving primary data. [2025-10-02T19:41:03.480392] [DEBUG] [LOCAL ] IX: Trimmed 27293 records to 22607 (keeping 200 days of data) [2025-10-02T19:41:03.621551] [DEBUG] [LOCAL ] IX: Primary data saved (22607 records). [2025-10-02T19:41:03.621711] [INFO ] [MAIN ] IX: Full history saved. [2025-10-02T19:41:03.621825] [INFO ] [MAIN ] Update Progress: 1140/2370 symbols completed. IX took 38.2s. Estimated remaining: 2h 53m 42s. Rate: 7.1 symbols/min [2025-10-02T19:41:03.836738] [INFO ] [MAIN ] JBND: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:41:03.867841] [DEBUG] [LOCAL ] JBND: Loaded 26039 existing records from primary storage. [2025-10-02T19:41:03.868143] [INFO ] [MAIN ] JBND: Loaded 26039 existing records. [2025-10-02T19:41:04.077732] [WARN ] [MAIN ] JBND: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:41:04.077991] [INFO ] [MAIN ] JBND: Wiping existing primary data before full refresh. [2025-10-02T19:41:04.078043] [INFO ] [LOCAL ] JBND: Starting deletion of primary data. [2025-10-02T19:41:04.078943] [DEBUG] [LOCAL ] JBND: Deleted primary data file. [2025-10-02T19:41:04.079012] [INFO ] [MAIN ] JBND: Starting full primary refresh. [2025-10-02T19:41:04.281264] [INFO ] [REMOTE ] JBL: Fetching primary data for 2024-12. [2025-10-02T19:41:04.536070] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-02T19:41:04.572687] [INFO ] [REMOTE ] JBND: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:41:04.737890] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-02T19:41:05.073071] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-08. [2025-10-02T19:41:05.853231] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-02T19:41:05.872990] [INFO ] [REMOTE ] JBND: Fetching primary data for 2024-12. [2025-10-02T19:41:06.520455] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-02T19:41:06.672963] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-01. [2025-10-02T19:41:06.886036] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-02T19:41:07.472995] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-09. [2025-10-02T19:41:08.273018] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-02. [2025-10-02T19:41:08.402525] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-02T19:41:08.737501] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-02T19:41:09.072994] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-02. [2025-10-02T19:41:09.872993] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-10. [2025-10-02T19:41:09.901705] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-02T19:41:10.673005] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-01. [2025-10-02T19:41:10.994573] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-02T19:41:10.998132] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-02T19:41:11.001815] [INFO ] [REMOTE ] JBGS: Full fetch complete (59305 records). [2025-10-02T19:41:11.008018] [DEBUG] [VALIDATOR ] JBGS: Validating primary data. [2025-10-02T19:41:11.420794] [DEBUG] [VALIDATOR ] JBGS: All expected trading days are present. [2025-10-02T19:41:11.420938] [DEBUG] [VALIDATOR ] JBGS: Primary data validation passed. [2025-10-02T19:41:11.421947] [INFO ] [MAIN ] JBGS: Fetched primary data is valid. [2025-10-02T19:41:11.422097] [DEBUG] [LOCAL ] JBGS: Saving primary data. [2025-10-02T19:41:11.433916] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-02T19:41:11.437953] [DEBUG] [LOCAL ] JBGS: Trimmed 59305 records to 42686 (keeping 200 days of data) [2025-10-02T19:41:11.493633] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-02. [2025-10-02T19:41:11.710135] [DEBUG] [LOCAL ] JBGS: Primary data saved (42686 records). [2025-10-02T19:41:11.710277] [INFO ] [MAIN ] JBGS: Full history saved. [2025-10-02T19:41:11.710365] [INFO ] [MAIN ] Update Progress: 1141/2370 symbols completed. JBGS took 29.7s. Estimated remaining: 2h 53m 34s. Rate: 7.1 symbols/min [2025-10-02T19:41:11.892384] [INFO ] [MAIN ] JBS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:41:11.892600] [DEBUG] [LOCAL ] JBS: No existing data file found in primary storage. [2025-10-02T19:41:11.892679] [WARN ] [MAIN ] JBS: No existing data found, performing full refresh instead. [2025-10-02T19:41:11.892800] [INFO ] [MAIN ] JBS: Wiping existing primary data before full refresh. [2025-10-02T19:41:11.892843] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-02T19:41:11.892885] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-02T19:41:11.892919] [INFO ] [MAIN ] JBS: Starting full primary refresh. [2025-10-02T19:41:12.284258] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-03. [2025-10-02T19:41:12.291000] [INFO ] [REMOTE ] JBS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:41:12.455913] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-02T19:41:13.073052] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-03. [2025-10-02T19:41:13.872984] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-03. [2025-10-02T19:41:14.073777] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-02T19:41:14.175927] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-02T19:41:14.672985] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-04. [2025-10-02T19:41:14.904515] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-02T19:41:15.473005] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-04. [2025-10-02T19:41:16.273061] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-04. [2025-10-02T19:41:16.346445] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-02T19:41:16.630402] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-02T19:41:17.072987] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-05. [2025-10-02T19:41:17.873012] [INFO ] [REMOTE ] JBS: Fetching primary data for 2024-12. [2025-10-02T19:41:18.065280] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-02T19:41:18.088729] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T19:41:18.089161] [WARN ] [REMOTE ] JBS: No data returned for month 2024-12 [2025-10-02T19:41:18.089257] [FATAL] [REMOTE ] JBS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T19:41:18.089305] [FATAL] [MAIN ] JBS: Failed to fetch primary data. [2025-10-02T19:41:18.089338] [WARN ] [MAIN ] JBS: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T19:41:18.089406] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-02T19:41:18.089522] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-02T19:41:18.089598] [INFO ] [LOCAL ] JBS: Starting deletion of derivative data. [2025-10-02T19:41:18.089798] [DEBUG] [LOCAL ] JBS: No derivative data file found to delete. [2025-10-02T19:41:18.089873] [INFO ] [MAIN ] Update Progress: 1142/2370 symbols completed. JBS took 6.4s. Estimated remaining: 2h 53m 23s. Rate: 7.1 symbols/min [2025-10-02T19:41:18.312157] [INFO ] [MAIN ] JBTM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:41:18.318585] [DEBUG] [LOCAL ] JBTM: No existing data file found in primary storage. [2025-10-02T19:41:18.318703] [WARN ] [MAIN ] JBTM: No existing data found, performing full refresh instead. [2025-10-02T19:41:18.320039] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-02T19:41:18.320286] [INFO ] [MAIN ] JBTM: Wiping existing primary data before full refresh. [2025-10-02T19:41:18.325845] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-10-02T19:41:18.326503] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-10-02T19:41:18.326966] [INFO ] [MAIN ] JBTM: Starting full primary refresh. [2025-10-02T19:41:18.679277] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-05. [2025-10-02T19:41:18.734074] [INFO ] [REMOTE ] JBTM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:41:19.473012] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-05. [2025-10-02T19:41:20.174517] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-02T19:41:20.273055] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2024-12. [2025-10-02T19:41:20.476102] [DEBUG] [REMOTE ] JBTM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T19:41:20.476440] [WARN ] [REMOTE ] JBTM: No data returned for month 2024-12 [2025-10-02T19:41:20.476533] [FATAL] [REMOTE ] JBTM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T19:41:20.476581] [FATAL] [MAIN ] JBTM: Failed to fetch primary data. [2025-10-02T19:41:20.476615] [WARN ] [MAIN ] JBTM: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T19:41:20.476688] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-10-02T19:41:20.476761] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-10-02T19:41:20.476797] [INFO ] [LOCAL ] JBTM: Starting deletion of derivative data. [2025-10-02T19:41:20.476864] [DEBUG] [LOCAL ] JBTM: No derivative data file found to delete. [2025-10-02T19:41:20.476933] [INFO ] [MAIN ] Update Progress: 1143/2370 symbols completed. JBTM took 2.4s. Estimated remaining: 2h 53m 8s. Rate: 7.1 symbols/min [2025-10-02T19:41:20.669126] [INFO ] [MAIN ] JCE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:41:20.679416] [DEBUG] [LOCAL ] JCE: Loaded 6781 existing records from primary storage. [2025-10-02T19:41:20.679691] [INFO ] [MAIN ] JCE: Loaded 6781 existing records. [2025-10-02T19:41:20.885273] [WARN ] [MAIN ] JCE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:41:20.885683] [INFO ] [MAIN ] JCE: Wiping existing primary data before full refresh. [2025-10-02T19:41:20.885802] [INFO ] [LOCAL ] JCE: Starting deletion of primary data. [2025-10-02T19:41:20.886237] [DEBUG] [LOCAL ] JCE: Deleted primary data file. [2025-10-02T19:41:20.886317] [INFO ] [MAIN ] JCE: Starting full primary refresh. [2025-10-02T19:41:21.076184] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-02T19:41:21.076275] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-06. [2025-10-02T19:41:21.328811] [INFO ] [REMOTE ] JCE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:41:21.872995] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-06. [2025-10-02T19:41:22.672993] [INFO ] [REMOTE ] JCE: Fetching primary data for 2024-12. [2025-10-02T19:41:23.084058] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-02T19:41:23.176087] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-02T19:41:23.440824] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-02T19:41:23.473052] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-07. [2025-10-02T19:41:24.273039] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-06. [2025-10-02T19:41:25.052872] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-02T19:41:25.072962] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-08. [2025-10-02T19:41:25.379030] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-02T19:41:25.873045] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-01. [2025-10-02T19:41:26.460706] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-02T19:41:26.571814] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-02T19:41:26.673010] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-07. [2025-10-02T19:41:27.472983] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-02. [2025-10-02T19:41:27.901928] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-02T19:41:27.927452] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-02T19:41:28.273019] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-07. [2025-10-02T19:41:29.073065] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-03. [2025-10-02T19:41:29.761886] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-02T19:41:29.839965] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-02T19:41:29.872991] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-08. [2025-10-02T19:41:30.673059] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-08. [2025-10-02T19:41:31.455524] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-02T19:41:31.472961] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-09. [2025-10-02T19:41:31.890918] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-02T19:41:32.272995] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-04. [2025-10-02T19:41:32.868072] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-02T19:41:32.968894] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-02T19:41:33.073039] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-09. [2025-10-02T19:41:33.873028] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-05. [2025-10-02T19:41:34.270370] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-02T19:41:34.428210] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-02T19:41:34.673021] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-09. [2025-10-02T19:41:35.473007] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-06. [2025-10-02T19:41:36.158589] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-02T19:41:36.273012] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-10. [2025-10-02T19:41:36.406471] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-02T19:41:37.073007] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-07. [2025-10-02T19:41:37.469868] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-02T19:41:37.471723] [INFO ] [REMOTE ] JBI: Full fetch complete (64419 records). [2025-10-02T19:41:37.471821] [DEBUG] [VALIDATOR ] JBI: Validating primary data. [2025-10-02T19:41:37.828089] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-02T19:41:37.887478] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-08. [2025-10-02T19:41:37.953014] [DEBUG] [VALIDATOR ] JBI: All expected trading days are present. [2025-10-02T19:41:37.953147] [DEBUG] [VALIDATOR ] JBI: Primary data validation passed. [2025-10-02T19:41:37.954194] [INFO ] [MAIN ] JBI: Fetched primary data is valid. [2025-10-02T19:41:37.954269] [DEBUG] [LOCAL ] JBI: Saving primary data. [2025-10-02T19:41:37.956014] [DEBUG] [LOCAL ] JBI: Trimmed 64419 records to 43831 (keeping 200 days of data) [2025-10-02T19:41:38.230510] [DEBUG] [LOCAL ] JBI: Primary data saved (43831 records). [2025-10-02T19:41:38.230688] [INFO ] [MAIN ] JBI: Full history saved. [2025-10-02T19:41:38.230801] [INFO ] [MAIN ] Update Progress: 1144/2370 symbols completed. JBI took 39.4s. Estimated remaining: 2h 53m 9s. Rate: 7.1 symbols/min [2025-10-02T19:41:38.431371] [INFO ] [MAIN ] JCI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:41:38.489906] [DEBUG] [LOCAL ] JCI: Loaded 53545 existing records from primary storage. [2025-10-02T19:41:38.490270] [INFO ] [MAIN ] JCI: Loaded 53545 existing records. [2025-10-02T19:41:38.605412] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-02T19:41:38.683070] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-10. [2025-10-02T19:41:38.689298] [WARN ] [MAIN ] JCI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:41:38.690601] [INFO ] [MAIN ] JCI: Wiping existing primary data before full refresh. [2025-10-02T19:41:38.690691] [INFO ] [LOCAL ] JCI: Starting deletion of primary data. [2025-10-02T19:41:38.692119] [DEBUG] [LOCAL ] JCI: Deleted primary data file. [2025-10-02T19:41:38.692187] [INFO ] [MAIN ] JCI: Starting full primary refresh. [2025-10-02T19:41:39.116534] [INFO ] [REMOTE ] JCI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:41:39.473003] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-09. [2025-10-02T19:41:40.272993] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-10. [2025-10-02T19:41:40.296853] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-02T19:41:40.298918] [INFO ] [REMOTE ] JBL: Full fetch complete (70384 records). [2025-10-02T19:41:40.299024] [DEBUG] [VALIDATOR ] JBL: Validating primary data. [2025-10-02T19:41:40.613020] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-02T19:41:40.746162] [DEBUG] [VALIDATOR ] JBL: All expected trading days are present. [2025-10-02T19:41:40.746261] [DEBUG] [VALIDATOR ] JBL: Primary data validation passed. [2025-10-02T19:41:40.747210] [INFO ] [MAIN ] JBL: Fetched primary data is valid. [2025-10-02T19:41:40.747277] [DEBUG] [LOCAL ] JBL: Saving primary data. [2025-10-02T19:41:40.748858] [DEBUG] [LOCAL ] JBL: Trimmed 70384 records to 48752 (keeping 200 days of data) [2025-10-02T19:41:41.068729] [DEBUG] [LOCAL ] JBL: Primary data saved (48752 records). [2025-10-02T19:41:41.068873] [INFO ] [MAIN ] JBL: Full history saved. [2025-10-02T19:41:41.068959] [INFO ] [MAIN ] Update Progress: 1145/2370 symbols completed. JBL took 38.9s. Estimated remaining: 2h 52m 55s. Rate: 7.1 symbols/min [2025-10-02T19:41:41.080499] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-10. [2025-10-02T19:41:41.261794] [INFO ] [MAIN ] JEF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:41:41.266366] [DEBUG] [LOCAL ] JEF: No existing data file found in primary storage. [2025-10-02T19:41:41.266574] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-02T19:41:41.266739] [WARN ] [MAIN ] JEF: No existing data found, performing full refresh instead. [2025-10-02T19:41:41.268619] [INFO ] [MAIN ] JEF: Wiping existing primary data before full refresh. [2025-10-02T19:41:41.268833] [INFO ] [LOCAL ] JEF: Starting deletion of primary data. [2025-10-02T19:41:41.268747] [INFO ] [REMOTE ] JBND: Full fetch complete (34301 records). [2025-10-02T19:41:41.268919] [DEBUG] [LOCAL ] JEF: No primary data file found to delete. [2025-10-02T19:41:41.269107] [DEBUG] [VALIDATOR ] JBND: Validating primary data. [2025-10-02T19:41:41.269183] [INFO ] [MAIN ] JEF: Starting full primary refresh. [2025-10-02T19:41:41.866368] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-02T19:41:41.883756] [INFO ] [REMOTE ] JCI: Fetching primary data for 2024-12. [2025-10-02T19:41:41.883931] [INFO ] [REMOTE ] JCE: Full fetch complete (9476 records). [2025-10-02T19:41:41.979687] [DEBUG] [VALIDATOR ] JCE: Validating primary data. [2025-10-02T19:41:42.040796] [INFO ] [REMOTE ] JEF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:41:42.245602] [DEBUG] [VALIDATOR ] JBND: All expected trading days are present. [2025-10-02T19:41:42.255994] [DEBUG] [VALIDATOR ] JBND: Primary data validation passed. [2025-10-02T19:41:42.262072] [INFO ] [MAIN ] JBND: Fetched primary data is valid. [2025-10-02T19:41:42.279513] [DEBUG] [LOCAL ] JBND: Saving primary data. [2025-10-02T19:41:42.331716] [DEBUG] [LOCAL ] JBND: Trimmed 34301 records to 26305 (keeping 200 days of data) [2025-10-02T19:41:42.642263] [DEBUG] [VALIDATOR ] JCE: All expected trading days are present. [2025-10-02T19:41:42.643413] [DEBUG] [VALIDATOR ] JCE: Primary data validation passed. [2025-10-02T19:41:42.644258] [INFO ] [MAIN ] JCE: Fetched primary data is valid. [2025-10-02T19:41:42.644990] [DEBUG] [LOCAL ] JCE: Saving primary data. [2025-10-02T19:41:42.648864] [DEBUG] [LOCAL ] JCE: Trimmed 9476 records to 6893 (keeping 200 days of data) [2025-10-02T19:41:42.674688] [INFO ] [REMOTE ] JEF: Fetching primary data for 2024-12. [2025-10-02T19:41:42.725893] [DEBUG] [LOCAL ] JCE: Primary data saved (6893 records). [2025-10-02T19:41:42.726739] [INFO ] [MAIN ] JCE: Full history saved. [2025-10-02T19:41:42.727874] [INFO ] [MAIN ] Update Progress: 1146/2370 symbols completed. JCE took 22.3s. Estimated remaining: 2h 52m 39s. Rate: 7.1 symbols/min [2025-10-02T19:41:42.943720] [INFO ] [MAIN ] JELD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:41:42.994898] [DEBUG] [LOCAL ] JBND: Primary data saved (26305 records). [2025-10-02T19:41:42.995104] [INFO ] [MAIN ] JBND: Full history saved. [2025-10-02T19:41:42.995308] [INFO ] [MAIN ] Update Progress: 1147/2370 symbols completed. JBND took 39.4s. Estimated remaining: 2h 52m 22s. Rate: 7.1 symbols/min [2025-10-02T19:41:43.164381] [DEBUG] [LOCAL ] JELD: Loaded 46073 existing records from primary storage. [2025-10-02T19:41:43.195627] [INFO ] [MAIN ] JELD: Loaded 46073 existing records. [2025-10-02T19:41:43.221474] [INFO ] [MAIN ] JEQ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:41:43.428734] [WARN ] [MAIN ] JELD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:41:43.429237] [DEBUG] [LOCAL ] JEQ: Loaded 8807 existing records from primary storage. [2025-10-02T19:41:43.429470] [INFO ] [MAIN ] JEQ: Loaded 8807 existing records. [2025-10-02T19:41:43.434881] [INFO ] [MAIN ] JELD: Wiping existing primary data before full refresh. [2025-10-02T19:41:43.451484] [INFO ] [LOCAL ] JELD: Starting deletion of primary data. [2025-10-02T19:41:43.517400] [DEBUG] [LOCAL ] JELD: Deleted primary data file. [2025-10-02T19:41:43.542422] [INFO ] [MAIN ] JELD: Starting full primary refresh. [2025-10-02T19:41:43.710176] [WARN ] [MAIN ] JEQ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:41:43.720822] [INFO ] [MAIN ] JEQ: Wiping existing primary data before full refresh. [2025-10-02T19:41:43.727668] [INFO ] [LOCAL ] JEQ: Starting deletion of primary data. [2025-10-02T19:41:43.741057] [DEBUG] [LOCAL ] JEQ: Deleted primary data file. [2025-10-02T19:41:43.752313] [INFO ] [MAIN ] JEQ: Starting full primary refresh. [2025-10-02T19:41:44.036170] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-02T19:41:44.108601] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-01. [2025-10-02T19:41:44.364082] [INFO ] [REMOTE ] JELD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:41:44.381026] [INFO ] [REMOTE ] JELD: Fetching primary data for 2024-12. [2025-10-02T19:41:44.544360] [INFO ] [REMOTE ] JEQ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:41:44.579348] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-02T19:41:45.073019] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-01. [2025-10-02T19:41:45.794234] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-02T19:41:45.872980] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2024-12. [2025-10-02T19:41:45.942400] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-02T19:41:46.321135] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-02T19:41:46.673060] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-01. [2025-10-02T19:41:46.809857] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-02T19:41:47.286404] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-02T19:41:47.473001] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-02. [2025-10-02T19:41:48.273046] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-02. [2025-10-02T19:41:49.072983] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-01. [2025-10-02T19:41:49.125627] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-02T19:41:49.872984] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-02. [2025-10-02T19:41:49.908599] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-02T19:41:50.483841] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-02T19:41:50.520625] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-02T19:41:50.673012] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-03. [2025-10-02T19:41:51.473020] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-03. [2025-10-02T19:41:52.273069] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-03. [2025-10-02T19:41:52.634396] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-02T19:41:53.073019] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-04. [2025-10-02T19:41:53.089573] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-02T19:41:53.304912] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-02T19:41:53.873015] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-04. [2025-10-02T19:41:54.592993] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-02T19:41:54.673033] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-02. [2025-10-02T19:41:54.692189] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-02T19:41:55.473019] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-05. [2025-10-02T19:41:56.134147] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-02T19:41:56.273008] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-05. [2025-10-02T19:41:57.040327] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-02T19:41:57.044336] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-02T19:41:57.073053] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-06. [2025-10-02T19:41:57.873055] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-06. [2025-10-02T19:41:58.573794] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-02T19:41:58.673000] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-07. [2025-10-02T19:41:58.823865] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-02T19:41:59.309138] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-02T19:41:59.473027] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-04. [2025-10-02T19:42:00.273023] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-08. [2025-10-02T19:42:01.073000] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-03. [2025-10-02T19:42:01.511931] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-02T19:42:01.772406] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-02T19:42:01.873003] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-09. [2025-10-02T19:42:02.404259] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-02T19:42:02.511076] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-02T19:42:02.673008] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-05. [2025-10-02T19:42:03.473009] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-10. [2025-10-02T19:42:03.965554] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-02T19:42:03.966568] [INFO ] [REMOTE ] JEQ: Full fetch complete (11824 records). [2025-10-02T19:42:03.966666] [DEBUG] [VALIDATOR ] JEQ: Validating primary data. [2025-10-02T19:42:04.278243] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-04. [2025-10-02T19:42:04.388750] [DEBUG] [VALIDATOR ] JEQ: All expected trading days are present. [2025-10-02T19:42:04.388933] [DEBUG] [VALIDATOR ] JEQ: Primary data validation passed. [2025-10-02T19:42:04.389314] [INFO ] [MAIN ] JEQ: Fetched primary data is valid. [2025-10-02T19:42:04.389435] [DEBUG] [LOCAL ] JEQ: Saving primary data. [2025-10-02T19:42:04.390351] [DEBUG] [LOCAL ] JEQ: Trimmed 11824 records to 8924 (keeping 200 days of data) [2025-10-02T19:42:04.468048] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-02T19:42:04.496135] [DEBUG] [LOCAL ] JEQ: Primary data saved (8924 records). [2025-10-02T19:42:04.496290] [INFO ] [MAIN ] JEQ: Full history saved. [2025-10-02T19:42:04.496397] [INFO ] [MAIN ] Update Progress: 1148/2370 symbols completed. JEQ took 21.5s. Estimated remaining: 2h 52m 27s. Rate: 7.1 symbols/min [2025-10-02T19:42:04.696507] [INFO ] [MAIN ] JFR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:42:04.733292] [DEBUG] [LOCAL ] JFR: Loaded 30718 existing records from primary storage. [2025-10-02T19:42:04.733590] [INFO ] [MAIN ] JFR: Loaded 30718 existing records. [2025-10-02T19:42:04.935408] [WARN ] [MAIN ] JFR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:42:04.935709] [INFO ] [MAIN ] JFR: Wiping existing primary data before full refresh. [2025-10-02T19:42:04.935779] [INFO ] [LOCAL ] JFR: Starting deletion of primary data. [2025-10-02T19:42:04.937774] [DEBUG] [LOCAL ] JFR: Deleted primary data file. [2025-10-02T19:42:04.937856] [INFO ] [MAIN ] JFR: Starting full primary refresh. [2025-10-02T19:42:05.078219] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-07. [2025-10-02T19:42:05.375842] [INFO ] [REMOTE ] JFR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:42:05.872971] [INFO ] [REMOTE ] JFR: Fetching primary data for 2024-12. [2025-10-02T19:42:06.209320] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-02T19:42:06.672977] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-06. [2025-10-02T19:42:06.997835] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-02T19:42:07.042438] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-02T19:42:07.472986] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-08. [2025-10-02T19:42:08.151477] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-02T19:42:08.273057] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-01. [2025-10-02T19:42:09.072992] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-05. [2025-10-02T19:42:09.466273] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-02T19:42:09.721963] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-02T19:42:09.873026] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-02. [2025-10-02T19:42:10.673027] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-09. [2025-10-02T19:42:10.831807] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-02T19:42:11.438518] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-02T19:42:11.472985] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-03. [2025-10-02T19:42:12.273042] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-06. [2025-10-02T19:42:12.527725] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-02T19:42:12.613057] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-02T19:42:13.073038] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-04. [2025-10-02T19:42:13.436167] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-02T19:42:13.873001] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-10. [2025-10-02T19:42:14.364539] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-02T19:42:14.673013] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-05. [2025-10-02T19:42:15.121871] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-02T19:42:15.125506] [INFO ] [REMOTE ] JCI: Full fetch complete (77414 records). [2025-10-02T19:42:15.125777] [DEBUG] [VALIDATOR ] JCI: Validating primary data. [2025-10-02T19:42:15.478146] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-07. [2025-10-02T19:42:15.589774] [DEBUG] [VALIDATOR ] JCI: All expected trading days are present. [2025-10-02T19:42:15.589993] [DEBUG] [VALIDATOR ] JCI: Primary data validation passed. [2025-10-02T19:42:15.591734] [INFO ] [MAIN ] JCI: Fetched primary data is valid. [2025-10-02T19:42:15.591860] [DEBUG] [LOCAL ] JCI: Saving primary data. [2025-10-02T19:42:15.594207] [DEBUG] [LOCAL ] JCI: Trimmed 77414 records to 53933 (keeping 200 days of data) [2025-10-02T19:42:15.896954] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-02T19:42:16.054936] [DEBUG] [LOCAL ] JCI: Primary data saved (53933 records). [2025-10-02T19:42:16.055087] [INFO ] [MAIN ] JCI: Full history saved. [2025-10-02T19:42:16.055259] [INFO ] [MAIN ] Update Progress: 1149/2370 symbols completed. JCI took 37.8s. Estimated remaining: 2h 52m 22s. Rate: 7.1 symbols/min [2025-10-02T19:42:16.243504] [INFO ] [MAIN ] JGH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:42:16.256733] [DEBUG] [LOCAL ] JGH: Loaded 11062 existing records from primary storage. [2025-10-02T19:42:16.256993] [INFO ] [MAIN ] JGH: Loaded 11062 existing records. [2025-10-02T19:42:16.280145] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-06. [2025-10-02T19:42:16.462180] [WARN ] [MAIN ] JGH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:42:16.462457] [INFO ] [MAIN ] JGH: Wiping existing primary data before full refresh. [2025-10-02T19:42:16.462520] [INFO ] [LOCAL ] JGH: Starting deletion of primary data. [2025-10-02T19:42:16.463098] [DEBUG] [LOCAL ] JGH: Deleted primary data file. [2025-10-02T19:42:16.463162] [INFO ] [MAIN ] JGH: Starting full primary refresh. [2025-10-02T19:42:16.913736] [INFO ] [REMOTE ] JGH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:42:17.078218] [INFO ] [REMOTE ] JGH: Fetching primary data for 2024-12. [2025-10-02T19:42:17.093252] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-02T19:42:17.502933] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-02T19:42:17.872986] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-07. [2025-10-02T19:42:17.941066] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-02T19:42:18.673024] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-08. [2025-10-02T19:42:18.988540] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-02T19:42:19.473009] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-07. [2025-10-02T19:42:19.994509] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-02T19:42:20.273044] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-08. [2025-10-02T19:42:21.073023] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-01. [2025-10-02T19:42:21.116747] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-02T19:42:21.169525] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-02T19:42:21.836597] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-02T19:42:21.872989] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-02. [2025-10-02T19:42:22.474191] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-02T19:42:22.673003] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-03. [2025-10-02T19:42:23.405330] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-02T19:42:23.472971] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-09. [2025-10-02T19:42:24.272995] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-08. [2025-10-02T19:42:24.715369] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-02T19:42:25.073041] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-04. [2025-10-02T19:42:25.702754] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-02T19:42:25.748097] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-02T19:42:25.873029] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-09. [2025-10-02T19:42:26.673000] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-05. [2025-10-02T19:42:27.220126] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-02T19:42:27.472995] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-10. [2025-10-02T19:42:27.499027] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-02T19:42:28.273046] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-10. [2025-10-02T19:42:28.582517] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-02T19:42:28.584106] [INFO ] [REMOTE ] JFR: Full fetch complete (48265 records). [2025-10-02T19:42:28.584193] [DEBUG] [VALIDATOR ] JFR: Validating primary data. [2025-10-02T19:42:29.026871] [DEBUG] [VALIDATOR ] JFR: All expected trading days are present. [2025-10-02T19:42:29.026993] [DEBUG] [VALIDATOR ] JFR: Primary data validation passed. [2025-10-02T19:42:29.028356] [INFO ] [MAIN ] JFR: Fetched primary data is valid. [2025-10-02T19:42:29.028468] [DEBUG] [LOCAL ] JFR: Saving primary data. [2025-10-02T19:42:29.029850] [DEBUG] [LOCAL ] JFR: Trimmed 48265 records to 30936 (keeping 200 days of data) [2025-10-02T19:42:29.097764] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-09. [2025-10-02T19:42:29.252127] [DEBUG] [LOCAL ] JFR: Primary data saved (30936 records). [2025-10-02T19:42:29.252290] [INFO ] [MAIN ] JFR: Full history saved. [2025-10-02T19:42:29.253395] [INFO ] [MAIN ] Update Progress: 1150/2370 symbols completed. JFR took 24.8s. Estimated remaining: 2h 52m 19s. Rate: 7.1 symbols/min [2025-10-02T19:42:29.445312] [INFO ] [MAIN ] JHG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:42:29.497788] [DEBUG] [LOCAL ] JHG: Loaded 47664 existing records from primary storage. [2025-10-02T19:42:29.498120] [INFO ] [MAIN ] JHG: Loaded 47664 existing records. [2025-10-02T19:42:29.616315] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-02T19:42:29.624304] [INFO ] [REMOTE ] JELD: Full fetch complete (64095 records). [2025-10-02T19:42:29.629546] [DEBUG] [VALIDATOR ] JELD: Validating primary data. [2025-10-02T19:42:29.814762] [WARN ] [MAIN ] JHG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:42:29.839701] [INFO ] [MAIN ] JHG: Wiping existing primary data before full refresh. [2025-10-02T19:42:29.839833] [INFO ] [LOCAL ] JHG: Starting deletion of primary data. [2025-10-02T19:42:29.862511] [DEBUG] [LOCAL ] JHG: Deleted primary data file. [2025-10-02T19:42:29.867960] [INFO ] [MAIN ] JHG: Starting full primary refresh. [2025-10-02T19:42:29.873170] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-06. [2025-10-02T19:42:30.482054] [DEBUG] [VALIDATOR ] JELD: All expected trading days are present. [2025-10-02T19:42:30.515221] [DEBUG] [VALIDATOR ] JELD: Primary data validation passed. [2025-10-02T19:42:30.538245] [INFO ] [MAIN ] JELD: Fetched primary data is valid. [2025-10-02T19:42:30.548717] [DEBUG] [LOCAL ] JELD: Saving primary data. [2025-10-02T19:42:30.617425] [INFO ] [REMOTE ] JHG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:42:30.618759] [DEBUG] [LOCAL ] JELD: Trimmed 64095 records to 46427 (keeping 200 days of data) [2025-10-02T19:42:30.687391] [INFO ] [REMOTE ] JHG: Fetching primary data for 2024-12. [2025-10-02T19:42:30.891493] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-02T19:42:30.893313] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-02T19:42:30.979740] [DEBUG] [LOCAL ] JELD: Primary data saved (46427 records). [2025-10-02T19:42:30.979884] [INFO ] [MAIN ] JELD: Full history saved. [2025-10-02T19:42:30.979984] [INFO ] [MAIN ] Update Progress: 1151/2370 symbols completed. JELD took 48.3s. Estimated remaining: 2h 52m 3s. Rate: 7.1 symbols/min [2025-10-02T19:42:31.162554] [INFO ] [MAIN ] JHI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:42:31.169289] [DEBUG] [LOCAL ] JHI: Loaded 3586 existing records from primary storage. [2025-10-02T19:42:31.169511] [INFO ] [MAIN ] JHI: Loaded 3586 existing records. [2025-10-02T19:42:31.365003] [WARN ] [MAIN ] JHI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:42:31.365234] [INFO ] [MAIN ] JHI: Wiping existing primary data before full refresh. [2025-10-02T19:42:31.365289] [INFO ] [LOCAL ] JHI: Starting deletion of primary data. [2025-10-02T19:42:31.365619] [DEBUG] [LOCAL ] JHI: Deleted primary data file. [2025-10-02T19:42:31.365719] [INFO ] [MAIN ] JHI: Starting full primary refresh. [2025-10-02T19:42:31.473791] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-07. [2025-10-02T19:42:31.763527] [INFO ] [REMOTE ] JHI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:42:31.989847] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-02T19:42:32.272999] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-10. [2025-10-02T19:42:32.387362] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-02T19:42:33.073003] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-08. [2025-10-02T19:42:33.687274] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-02T19:42:33.692502] [INFO ] [REMOTE ] JEF: Full fetch complete (72952 records). [2025-10-02T19:42:33.692676] [DEBUG] [VALIDATOR ] JEF: Validating primary data. [2025-10-02T19:42:33.878750] [INFO ] [REMOTE ] JHI: Fetching primary data for 2024-12. [2025-10-02T19:42:33.995223] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-02T19:42:34.153789] [DEBUG] [VALIDATOR ] JEF: All expected trading days are present. [2025-10-02T19:42:34.153886] [DEBUG] [VALIDATOR ] JEF: Primary data validation passed. [2025-10-02T19:42:34.154840] [INFO ] [MAIN ] JEF: Fetched primary data is valid. [2025-10-02T19:42:34.154908] [DEBUG] [LOCAL ] JEF: Saving primary data. [2025-10-02T19:42:34.156592] [DEBUG] [LOCAL ] JEF: Trimmed 72952 records to 50415 (keeping 200 days of data) [2025-10-02T19:42:34.409888] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-02T19:42:34.511758] [DEBUG] [LOCAL ] JEF: Primary data saved (50415 records). [2025-10-02T19:42:34.511901] [INFO ] [MAIN ] JEF: Full history saved. [2025-10-02T19:42:34.511978] [INFO ] [MAIN ] Update Progress: 1152/2370 symbols completed. JEF took 53.4s. Estimated remaining: 2h 51m 49s. Rate: 7.1 symbols/min [2025-10-02T19:42:34.675704] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-01. [2025-10-02T19:42:34.697792] [INFO ] [MAIN ] JHS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:42:34.704236] [DEBUG] [LOCAL ] JHS: Loaded 2826 existing records from primary storage. [2025-10-02T19:42:34.704411] [INFO ] [MAIN ] JHS: Loaded 2826 existing records. [2025-10-02T19:42:34.900130] [WARN ] [MAIN ] JHS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:42:34.900361] [INFO ] [MAIN ] JHS: Wiping existing primary data before full refresh. [2025-10-02T19:42:34.900411] [INFO ] [LOCAL ] JHS: Starting deletion of primary data. [2025-10-02T19:42:34.900755] [DEBUG] [LOCAL ] JHS: Deleted primary data file. [2025-10-02T19:42:34.901013] [INFO ] [MAIN ] JHS: Starting full primary refresh. [2025-10-02T19:42:35.293426] [INFO ] [REMOTE ] JHS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:42:35.473034] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-09. [2025-10-02T19:42:36.271078] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-02T19:42:36.274261] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-01. [2025-10-02T19:42:36.415458] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-02T19:42:36.823755] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-02T19:42:37.073038] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-02. [2025-10-02T19:42:37.873017] [INFO ] [REMOTE ] JHS: Fetching primary data for 2024-12. [2025-10-02T19:42:38.335341] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-02T19:42:38.592802] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-02T19:42:38.673043] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-01. [2025-10-02T19:42:39.236887] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-02T19:42:39.473005] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-10. [2025-10-02T19:42:40.269223] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-02T19:42:40.270208] [INFO ] [REMOTE ] JGH: Full fetch complete (15057 records). [2025-10-02T19:42:40.270280] [DEBUG] [VALIDATOR ] JGH: Validating primary data. [2025-10-02T19:42:40.282042] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-02. [2025-10-02T19:42:40.685210] [DEBUG] [VALIDATOR ] JGH: All expected trading days are present. [2025-10-02T19:42:40.685318] [DEBUG] [VALIDATOR ] JGH: Primary data validation passed. [2025-10-02T19:42:40.685917] [INFO ] [MAIN ] JGH: Fetched primary data is valid. [2025-10-02T19:42:40.685987] [DEBUG] [LOCAL ] JGH: Saving primary data. [2025-10-02T19:42:40.687125] [DEBUG] [LOCAL ] JGH: Trimmed 15057 records to 11163 (keeping 200 days of data) [2025-10-02T19:42:40.764679] [DEBUG] [LOCAL ] JGH: Primary data saved (11163 records). [2025-10-02T19:42:40.764881] [INFO ] [MAIN ] JGH: Full history saved. [2025-10-02T19:42:40.765005] [INFO ] [MAIN ] Update Progress: 1153/2370 symbols completed. JGH took 24.7s. Estimated remaining: 2h 51m 39s. Rate: 7.1 symbols/min [2025-10-02T19:42:40.900467] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-02T19:42:40.978001] [INFO ] [MAIN ] JHX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:42:41.030813] [DEBUG] [LOCAL ] JHX: Loaded 51882 existing records from primary storage. [2025-10-02T19:42:41.031157] [INFO ] [MAIN ] JHX: Loaded 51882 existing records. [2025-10-02T19:42:41.078218] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-02. [2025-10-02T19:42:41.230395] [WARN ] [MAIN ] JHX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:42:41.230637] [INFO ] [MAIN ] JHX: Wiping existing primary data before full refresh. [2025-10-02T19:42:41.230753] [INFO ] [LOCAL ] JHX: Starting deletion of primary data. [2025-10-02T19:42:41.232208] [DEBUG] [LOCAL ] JHX: Deleted primary data file. [2025-10-02T19:42:41.232285] [INFO ] [MAIN ] JHX: Starting full primary refresh. [2025-10-02T19:42:41.566635] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-02T19:42:41.632901] [INFO ] [REMOTE ] JHX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:42:41.873002] [INFO ] [REMOTE ] JHX: Fetching primary data for 2024-12. [2025-10-02T19:42:42.673038] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-03. [2025-10-02T19:42:42.792610] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-02T19:42:43.091672] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-02T19:42:43.472994] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-01. [2025-10-02T19:42:44.224815] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-02T19:42:44.273017] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-03. [2025-10-02T19:42:45.073027] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-03. [2025-10-02T19:42:45.594773] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-02T19:42:45.873001] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-04. [2025-10-02T19:42:45.959476] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-02T19:42:46.671376] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-02T19:42:46.673204] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-04. [2025-10-02T19:42:47.472997] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-04. [2025-10-02T19:42:47.945440] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-02T19:42:48.273003] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-05. [2025-10-02T19:42:48.441564] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-02T19:42:48.628346] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-02T19:42:49.073005] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-05. [2025-10-02T19:42:49.638903] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-02T19:42:49.873076] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-06. [2025-10-02T19:42:50.444117] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-02T19:42:50.672973] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-07. [2025-10-02T19:42:51.246011] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-02T19:42:51.473010] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-08. [2025-10-02T19:42:51.814697] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-02T19:42:52.273005] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-09. [2025-10-02T19:42:52.747561] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-02T19:42:53.073001] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-05. [2025-10-02T19:42:53.872993] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-02. [2025-10-02T19:42:54.672990] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-10. [2025-10-02T19:42:54.749938] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-02T19:42:54.778283] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-02T19:42:55.119336] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-02T19:42:55.120144] [INFO ] [REMOTE ] JHI: Full fetch complete (5273 records). [2025-10-02T19:42:55.120216] [DEBUG] [VALIDATOR ] JHI: Validating primary data. [2025-10-02T19:42:55.486715] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-06. [2025-10-02T19:42:55.542142] [DEBUG] [VALIDATOR ] JHI: All expected trading days are present. [2025-10-02T19:42:55.542260] [DEBUG] [VALIDATOR ] JHI: Primary data validation passed. [2025-10-02T19:42:55.542473] [INFO ] [MAIN ] JHI: Fetched primary data is valid. [2025-10-02T19:42:55.542553] [DEBUG] [LOCAL ] JHI: Saving primary data. [2025-10-02T19:42:55.543192] [DEBUG] [LOCAL ] JHI: Trimmed 5273 records to 3612 (keeping 200 days of data) [2025-10-02T19:42:55.578313] [DEBUG] [LOCAL ] JHI: Primary data saved (3612 records). [2025-10-02T19:42:55.578508] [INFO ] [MAIN ] JHI: Full history saved. [2025-10-02T19:42:55.578641] [INFO ] [MAIN ] Update Progress: 1154/2370 symbols completed. JHI took 24.6s. Estimated remaining: 2h 51m 37s. Rate: 7.1 symbols/min [2025-10-02T19:42:55.766087] [INFO ] [MAIN ] JILL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:42:55.784194] [DEBUG] [LOCAL ] JILL: Loaded 16664 existing records from primary storage. [2025-10-02T19:42:55.784529] [INFO ] [MAIN ] JILL: Loaded 16664 existing records. [2025-10-02T19:42:55.978785] [WARN ] [MAIN ] JILL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:42:55.979025] [INFO ] [MAIN ] JILL: Wiping existing primary data before full refresh. [2025-10-02T19:42:55.979074] [INFO ] [LOCAL ] JILL: Starting deletion of primary data. [2025-10-02T19:42:55.979735] [DEBUG] [LOCAL ] JILL: Deleted primary data file. [2025-10-02T19:42:55.979795] [INFO ] [MAIN ] JILL: Starting full primary refresh. [2025-10-02T19:42:56.273552] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-03. [2025-10-02T19:42:56.358839] [INFO ] [REMOTE ] JILL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:42:57.072994] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-06. [2025-10-02T19:42:57.110693] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-02T19:42:57.586284] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-02T19:42:57.640530] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-02T19:42:57.873020] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-04. [2025-10-02T19:42:58.673000] [INFO ] [REMOTE ] JILL: Fetching primary data for 2024-12. [2025-10-02T19:42:59.473042] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-07. [2025-10-02T19:42:59.632429] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-02T19:42:59.682964] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-02T19:43:00.273007] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-05. [2025-10-02T19:43:01.073017] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-07. [2025-10-02T19:43:01.611621] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-02T19:43:01.668976] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-02T19:43:01.873002] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-08. [2025-10-02T19:43:02.110490] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-02T19:43:02.672998] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-06. [2025-10-02T19:43:03.173091] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-02T19:43:03.472987] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-09. [2025-10-02T19:43:04.105142] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-02T19:43:04.273002] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-01. [2025-10-02T19:43:04.983729] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-02T19:43:05.072982] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-10. [2025-10-02T19:43:05.087176] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-02T19:43:05.873012] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-02. [2025-10-02T19:43:06.428809] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-02T19:43:06.431124] [INFO ] [REMOTE ] JHG: Full fetch complete (68275 records). [2025-10-02T19:43:06.431296] [DEBUG] [VALIDATOR ] JHG: Validating primary data. [2025-10-02T19:43:06.631038] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-02T19:43:06.678227] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-08. [2025-10-02T19:43:06.875313] [DEBUG] [VALIDATOR ] JHG: All expected trading days are present. [2025-10-02T19:43:06.875412] [DEBUG] [VALIDATOR ] JHG: Primary data validation passed. [2025-10-02T19:43:06.876429] [INFO ] [MAIN ] JHG: Fetched primary data is valid. [2025-10-02T19:43:06.876509] [DEBUG] [LOCAL ] JHG: Saving primary data. [2025-10-02T19:43:06.878040] [DEBUG] [LOCAL ] JHG: Trimmed 68275 records to 47986 (keeping 200 days of data) [2025-10-02T19:43:07.209296] [DEBUG] [LOCAL ] JHG: Primary data saved (47986 records). [2025-10-02T19:43:07.209464] [INFO ] [MAIN ] JHG: Full history saved. [2025-10-02T19:43:07.210378] [INFO ] [MAIN ] Update Progress: 1155/2370 symbols completed. JHG took 38.0s. Estimated remaining: 2h 51m 32s. Rate: 7.1 symbols/min [2025-10-02T19:43:07.323306] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-02T19:43:07.410398] [INFO ] [MAIN ] JKS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:43:07.453220] [DEBUG] [LOCAL ] JKS: Loaded 40094 existing records from primary storage. [2025-10-02T19:43:07.453559] [INFO ] [MAIN ] JKS: Loaded 40094 existing records. [2025-10-02T19:43:07.478237] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-09. [2025-10-02T19:43:07.654194] [WARN ] [MAIN ] JKS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:43:07.654448] [INFO ] [MAIN ] JKS: Wiping existing primary data before full refresh. [2025-10-02T19:43:07.654502] [INFO ] [LOCAL ] JKS: Starting deletion of primary data. [2025-10-02T19:43:07.655480] [DEBUG] [LOCAL ] JKS: Deleted primary data file. [2025-10-02T19:43:07.655545] [INFO ] [MAIN ] JKS: Starting full primary refresh. [2025-10-02T19:43:08.089909] [INFO ] [REMOTE ] JKS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:43:08.094801] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-02T19:43:08.273018] [INFO ] [REMOTE ] JKS: Fetching primary data for 2024-12. [2025-10-02T19:43:09.073004] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-10. [2025-10-02T19:43:09.588915] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-02T19:43:09.589632] [INFO ] [REMOTE ] JHS: Full fetch complete (4437 records). [2025-10-02T19:43:09.589732] [DEBUG] [VALIDATOR ] JHS: Validating primary data. [2025-10-02T19:43:09.873886] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-03. [2025-10-02T19:43:09.999188] [DEBUG] [VALIDATOR ] JHS: All expected trading days are present. [2025-10-02T19:43:09.999301] [DEBUG] [VALIDATOR ] JHS: Primary data validation passed. [2025-10-02T19:43:09.999488] [INFO ] [MAIN ] JHS: Fetched primary data is valid. [2025-10-02T19:43:09.999566] [DEBUG] [LOCAL ] JHS: Saving primary data. [2025-10-02T19:43:10.000335] [DEBUG] [LOCAL ] JHS: Trimmed 4437 records to 2834 (keeping 200 days of data) [2025-10-02T19:43:10.047364] [DEBUG] [LOCAL ] JHS: Primary data saved (2834 records). [2025-10-02T19:43:10.048108] [INFO ] [MAIN ] JHS: Full history saved. [2025-10-02T19:43:10.050014] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-02T19:43:10.050194] [INFO ] [MAIN ] Update Progress: 1156/2370 symbols completed. JHS took 35.5s. Estimated remaining: 2h 51m 17s. Rate: 7.1 symbols/min [2025-10-02T19:43:10.247987] [INFO ] [MAIN ] JLL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:43:10.280782] [DEBUG] [LOCAL ] JLL: Loaded 31546 existing records from primary storage. [2025-10-02T19:43:10.281081] [INFO ] [MAIN ] JLL: Loaded 31546 existing records. [2025-10-02T19:43:10.476249] [WARN ] [MAIN ] JLL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:43:10.476495] [INFO ] [MAIN ] JLL: Wiping existing primary data before full refresh. [2025-10-02T19:43:10.476549] [INFO ] [LOCAL ] JLL: Starting deletion of primary data. [2025-10-02T19:43:10.477309] [DEBUG] [LOCAL ] JLL: Deleted primary data file. [2025-10-02T19:43:10.477371] [INFO ] [MAIN ] JLL: Starting full primary refresh. [2025-10-02T19:43:10.681012] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-01. [2025-10-02T19:43:10.885720] [INFO ] [REMOTE ] JLL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:43:11.062947] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-02T19:43:11.473007] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-04. [2025-10-02T19:43:12.272983] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-07. [2025-10-02T19:43:12.392727] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-02T19:43:12.490834] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-02T19:43:13.073075] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-05. [2025-10-02T19:43:13.796379] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-02T19:43:13.872973] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-08. [2025-10-02T19:43:13.949923] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-02T19:43:14.673034] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-06. [2025-10-02T19:43:15.472976] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-02. [2025-10-02T19:43:15.500987] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-02T19:43:15.710094] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-02T19:43:16.273007] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-09. [2025-10-02T19:43:17.026048] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-02T19:43:17.073009] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-03. [2025-10-02T19:43:17.869495] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-02T19:43:17.885074] [INFO ] [REMOTE ] JLL: Fetching primary data for 2024-12. [2025-10-02T19:43:18.635900] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-02T19:43:18.672972] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-10. [2025-10-02T19:43:19.145271] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-02T19:43:19.473049] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-07. [2025-10-02T19:43:20.150004] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-02T19:43:20.155277] [INFO ] [REMOTE ] JHX: Full fetch complete (58833 records). [2025-10-02T19:43:20.155390] [DEBUG] [VALIDATOR ] JHX: Validating primary data. [2025-10-02T19:43:20.278133] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-01. [2025-10-02T19:43:20.464386] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-02T19:43:20.597862] [DEBUG] [VALIDATOR ] JHX: All expected trading days are present. [2025-10-02T19:43:20.597948] [DEBUG] [VALIDATOR ] JHX: Primary data validation passed. [2025-10-02T19:43:20.598960] [INFO ] [MAIN ] JHX: Fetched primary data is valid. [2025-10-02T19:43:20.599026] [DEBUG] [LOCAL ] JHX: Saving primary data. [2025-10-02T19:43:20.600573] [DEBUG] [LOCAL ] JHX: Trimmed 58833 records to 52271 (keeping 200 days of data) [2025-10-02T19:43:20.921246] [DEBUG] [LOCAL ] JHX: Primary data saved (52271 records). [2025-10-02T19:43:20.921388] [INFO ] [MAIN ] JHX: Full history saved. [2025-10-02T19:43:20.921468] [INFO ] [MAIN ] Update Progress: 1157/2370 symbols completed. JHX took 40.2s. Estimated remaining: 2h 51m 11s. Rate: 7.1 symbols/min [2025-10-02T19:43:21.073022] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-04. [2025-10-02T19:43:21.772463] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-02T19:43:21.872956] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-08. [2025-10-02T19:43:22.673044] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-02. [2025-10-02T19:43:22.876577] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-02T19:43:22.878951] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-02T19:43:23.473049] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-09. [2025-10-02T19:43:24.123138] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-02T19:43:24.174290] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-02T19:43:24.273002] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-10. [2025-10-02T19:43:25.048052] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-02T19:43:25.049300] [INFO ] [REMOTE ] JILL: Full fetch complete (22822 records). [2025-10-02T19:43:25.049398] [DEBUG] [VALIDATOR ] JILL: Validating primary data. [2025-10-02T19:43:25.082940] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-05. [2025-10-02T19:43:25.463866] [DEBUG] [VALIDATOR ] JILL: All expected trading days are present. [2025-10-02T19:43:25.463978] [DEBUG] [VALIDATOR ] JILL: Primary data validation passed. [2025-10-02T19:43:25.464525] [INFO ] [MAIN ] JILL: Fetched primary data is valid. [2025-10-02T19:43:25.464589] [DEBUG] [LOCAL ] JILL: Saving primary data. [2025-10-02T19:43:25.465330] [DEBUG] [LOCAL ] JILL: Trimmed 22822 records to 16768 (keeping 200 days of data) [2025-10-02T19:43:25.573447] [DEBUG] [LOCAL ] JILL: Primary data saved (16768 records). [2025-10-02T19:43:25.573593] [INFO ] [MAIN ] JILL: Full history saved. [2025-10-02T19:43:25.573706] [INFO ] [MAIN ] Update Progress: 1158/2370 symbols completed. JILL took 30.0s. Estimated remaining: 2h 50m 59s. Rate: 7.1 symbols/min [2025-10-02T19:43:25.873013] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-03. [2025-10-02T19:43:26.317511] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-02T19:43:26.673043] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-06. [2025-10-02T19:43:26.700758] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-02T19:43:27.473012] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-04. [2025-10-02T19:43:27.582432] [DEBUG] [REMOTE ] JLL: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-10-02T19:43:27.582905] [WARN ] [REMOTE ] JLL: No data returned for month 2025-04 [2025-10-02T19:43:27.583025] [FATAL] [REMOTE ] JLL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T19:43:27.583149] [FATAL] [MAIN ] JLL: Failed to fetch primary data. [2025-10-02T19:43:27.583239] [WARN ] [MAIN ] JLL: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T19:43:27.583331] [INFO ] [LOCAL ] JLL: Starting deletion of primary data. [2025-10-02T19:43:27.583431] [DEBUG] [LOCAL ] JLL: No primary data file found to delete. [2025-10-02T19:43:27.583508] [INFO ] [LOCAL ] JLL: Starting deletion of derivative data. [2025-10-02T19:43:27.584159] [DEBUG] [LOCAL ] JLL: Deleted derivative data file. [2025-10-02T19:43:27.584274] [INFO ] [MAIN ] Update Progress: 1159/2370 symbols completed. JLL took 17.5s. Estimated remaining: 2h 50m 44s. Rate: 7.1 symbols/min [2025-10-02T19:43:28.233063] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-02T19:43:28.272993] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-07. [2025-10-02T19:43:29.743204] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-02T19:43:29.752446] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-08. [2025-10-02T19:43:30.891017] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-02T19:43:30.899120] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-09. [2025-10-02T19:43:32.479447] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-02T19:43:32.488825] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-10. [2025-10-02T19:43:33.509301] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-02T19:43:33.511014] [INFO ] [REMOTE ] JKS: Full fetch complete (58946 records). [2025-10-02T19:43:33.511112] [DEBUG] [VALIDATOR ] JKS: Validating primary data. [2025-10-02T19:43:33.919388] [DEBUG] [VALIDATOR ] JKS: All expected trading days are present. [2025-10-02T19:43:33.919476] [DEBUG] [VALIDATOR ] JKS: Primary data validation passed. [2025-10-02T19:43:33.920387] [INFO ] [MAIN ] JKS: Fetched primary data is valid. [2025-10-02T19:43:33.920454] [DEBUG] [LOCAL ] JKS: Saving primary data. [2025-10-02T19:43:33.921762] [DEBUG] [LOCAL ] JKS: Trimmed 58946 records to 40360 (keeping 200 days of data) [2025-10-02T19:43:34.178930] [DEBUG] [LOCAL ] JKS: Primary data saved (40360 records). [2025-10-02T19:43:34.179059] [INFO ] [MAIN ] JKS: Full history saved. [2025-10-02T19:43:34.179566] [INFO ] [MAIN ] Update Progress: 1160/2370 symbols completed. JKS took 27.0s. Estimated remaining: 2h 50m 33s. Rate: 7.1 symbols/min [2025-10-02T19:43:34.733573] [INFO ] [MAIN ] JNJ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:43:34.925807] [INFO ] [MAIN ] JMM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:43:34.954338] [DEBUG] [LOCAL ] JMM: No existing data file found in primary storage. [2025-10-02T19:43:34.960248] [WARN ] [MAIN ] JMM: No existing data found, performing full refresh instead. [2025-10-02T19:43:34.951038] [INFO ] [MAIN ] JLS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:43:34.961561] [INFO ] [MAIN ] JMM: Wiping existing primary data before full refresh. [2025-10-02T19:43:34.985240] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-02T19:43:34.985468] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-02T19:43:34.985825] [INFO ] [MAIN ] JMM: Starting full primary refresh. [2025-10-02T19:43:34.992886] [INFO ] [MAIN ] JMIA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:43:35.055893] [DEBUG] [LOCAL ] JLS: Loaded 4138 existing records from primary storage. [2025-10-02T19:43:35.076491] [INFO ] [MAIN ] JLS: Loaded 4138 existing records. [2025-10-02T19:43:35.425474] [DEBUG] [LOCAL ] JNJ: Loaded 53753 existing records from primary storage. [2025-10-02T19:43:35.558053] [WARN ] [MAIN ] JLS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:43:35.563348] [INFO ] [MAIN ] JNJ: Loaded 53753 existing records. [2025-10-02T19:43:35.575510] [INFO ] [MAIN ] JLS: Wiping existing primary data before full refresh. [2025-10-02T19:43:35.587294] [INFO ] [LOCAL ] JLS: Starting deletion of primary data. [2025-10-02T19:43:35.640142] [DEBUG] [LOCAL ] JLS: Deleted primary data file. [2025-10-02T19:43:35.679508] [DEBUG] [LOCAL ] JMIA: Loaded 50668 existing records from primary storage. [2025-10-02T19:43:35.678672] [INFO ] [MAIN ] JLS: Starting full primary refresh. [2025-10-02T19:43:35.699694] [INFO ] [MAIN ] JMIA: Loaded 50668 existing records. [2025-10-02T19:43:35.875460] [INFO ] [REMOTE ] JMM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:43:35.938879] [INFO ] [REMOTE ] JMM: Fetching primary data for 2024-12. [2025-10-02T19:43:36.222360] [WARN ] [MAIN ] JNJ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:43:36.320204] [INFO ] [MAIN ] JNJ: Wiping existing primary data before full refresh. [2025-10-02T19:43:36.350891] [INFO ] [LOCAL ] JNJ: Starting deletion of primary data. [2025-10-02T19:43:36.401845] [WARN ] [MAIN ] JMIA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:43:36.421109] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-02T19:43:36.417898] [INFO ] [MAIN ] JMIA: Wiping existing primary data before full refresh. [2025-10-02T19:43:36.427537] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-01. [2025-10-02T19:43:36.427627] [INFO ] [LOCAL ] JMIA: Starting deletion of primary data. [2025-10-02T19:43:36.421000] [DEBUG] [LOCAL ] JNJ: Deleted primary data file. [2025-10-02T19:43:36.447983] [INFO ] [MAIN ] JNJ: Starting full primary refresh. [2025-10-02T19:43:36.476011] [DEBUG] [LOCAL ] JMIA: Deleted primary data file. [2025-10-02T19:43:36.539914] [INFO ] [MAIN ] JMIA: Starting full primary refresh. [2025-10-02T19:43:36.691276] [INFO ] [REMOTE ] JLS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:43:36.722581] [INFO ] [REMOTE ] JLS: Fetching primary data for 2024-12. [2025-10-02T19:43:36.902790] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-02T19:43:36.988393] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-02. [2025-10-02T19:43:37.323441] [INFO ] [REMOTE ] JNJ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:43:37.336636] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2024-12. [2025-10-02T19:43:37.383889] [INFO ] [REMOTE ] JMIA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:43:37.389468] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2024-12. [2025-10-02T19:43:37.389146] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-02T19:43:37.392210] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-01. [2025-10-02T19:43:37.593138] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-02T19:43:37.594296] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-03. [2025-10-02T19:43:37.808470] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-02T19:43:37.873050] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-02. [2025-10-02T19:43:37.922007] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-02T19:43:38.441055] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-02T19:43:38.673063] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-04. [2025-10-02T19:43:38.952723] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-02T19:43:39.095986] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-02T19:43:39.473044] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-01. [2025-10-02T19:43:39.687977] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2024-12 (2.35 seconds). [2025-10-02T19:43:40.273033] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-05. [2025-10-02T19:43:40.819510] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-02T19:43:41.073009] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-01. [2025-10-02T19:43:41.248044] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-02T19:43:41.873056] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-02. [2025-10-02T19:43:42.673007] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-03. [2025-10-02T19:43:43.262195] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-02T19:43:43.366391] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-10-02T19:43:43.473042] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-06. [2025-10-02T19:43:43.627673] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-02T19:43:43.977834] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-02T19:43:44.273001] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-02. [2025-10-02T19:43:45.073005] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-07. [2025-10-02T19:43:45.735993] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-02T19:43:45.873035] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-03. [2025-10-02T19:43:46.313562] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-02T19:43:46.673011] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-03. [2025-10-02T19:43:47.473005] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-04. [2025-10-02T19:43:47.673448] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-02T19:43:48.069446] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-02T19:43:48.273033] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-05. [2025-10-02T19:43:48.838893] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-02T19:43:48.862542] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-02T19:43:49.073001] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-06. [2025-10-02T19:43:49.423244] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-02T19:43:49.873044] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-04. [2025-10-02T19:43:50.673007] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-07. [2025-10-02T19:43:51.277850] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-02T19:43:51.473043] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-08. [2025-10-02T19:43:52.028838] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-02T19:43:52.215811] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-02T19:43:52.272989] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-08. [2025-10-02T19:43:52.721169] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-02T19:43:53.072995] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-05. [2025-10-02T19:43:53.873008] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-09. [2025-10-02T19:43:54.309968] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-02T19:43:54.673014] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-04. [2025-10-02T19:43:55.358662] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-10-02T19:43:55.472994] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-09. [2025-10-02T19:43:56.054380] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-02T19:43:56.273003] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-06. [2025-10-02T19:43:56.341421] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-02T19:43:57.073002] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-10. [2025-10-02T19:43:57.533054] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-02T19:43:57.534068] [INFO ] [REMOTE ] JMM: Full fetch complete (2316 records). [2025-10-02T19:43:57.534204] [DEBUG] [VALIDATOR ] JMM: Validating primary data. [2025-10-02T19:43:57.764017] [WARN ] [VALIDATOR ] JMM: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-10-02T19:43:57.764266] [FATAL] [MAIN ] JMM: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:43:57.764342] [WARN ] [MAIN ] JMM: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:43:57.764417] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-02T19:43:57.764519] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-02T19:43:57.764578] [INFO ] [LOCAL ] JMM: Starting deletion of derivative data. [2025-10-02T19:43:57.764625] [DEBUG] [LOCAL ] JMM: No derivative data file found to delete. [2025-10-02T19:43:57.764725] [INFO ] [MAIN ] Update Progress: 1161/2370 symbols completed. JMM took 23.6s. Estimated remaining: 2h 50m 41s. Rate: 7.1 symbols/min [2025-10-02T19:43:57.881289] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-05. [2025-10-02T19:43:57.967390] [INFO ] [MAIN ] JOBY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:43:58.026344] [DEBUG] [LOCAL ] JOBY: Loaded 53799 existing records from primary storage. [2025-10-02T19:43:58.026810] [INFO ] [MAIN ] JOBY: Loaded 53799 existing records. [2025-10-02T19:43:58.256403] [WARN ] [MAIN ] JOBY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:43:58.256740] [INFO ] [MAIN ] JOBY: Wiping existing primary data before full refresh. [2025-10-02T19:43:58.256895] [INFO ] [LOCAL ] JOBY: Starting deletion of primary data. [2025-10-02T19:43:58.268474] [DEBUG] [LOCAL ] JOBY: Deleted primary data file. [2025-10-02T19:43:58.287193] [INFO ] [MAIN ] JOBY: Starting full primary refresh. [2025-10-02T19:43:58.294694] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-02T19:43:58.678130] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-10. [2025-10-02T19:43:58.747172] [INFO ] [REMOTE ] JOBY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:43:59.217513] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-02T19:43:59.218335] [INFO ] [REMOTE ] JLS: Full fetch complete (5832 records). [2025-10-02T19:43:59.218409] [DEBUG] [VALIDATOR ] JLS: Validating primary data. [2025-10-02T19:43:59.476226] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2024-12. [2025-10-02T19:43:59.653920] [DEBUG] [VALIDATOR ] JLS: All expected trading days are present. [2025-10-02T19:43:59.654008] [DEBUG] [VALIDATOR ] JLS: Primary data validation passed. [2025-10-02T19:43:59.654195] [INFO ] [MAIN ] JLS: Fetched primary data is valid. [2025-10-02T19:43:59.654236] [DEBUG] [LOCAL ] JLS: Saving primary data. [2025-10-02T19:43:59.654628] [DEBUG] [LOCAL ] JLS: Trimmed 5832 records to 4162 (keeping 200 days of data) [2025-10-02T19:43:59.684796] [DEBUG] [LOCAL ] JLS: Primary data saved (4162 records). [2025-10-02T19:43:59.684936] [INFO ] [MAIN ] JLS: Full history saved. [2025-10-02T19:43:59.685021] [INFO ] [MAIN ] Update Progress: 1162/2370 symbols completed. JLS took 25.5s. Estimated remaining: 2h 50m 25s. Rate: 7.1 symbols/min [2025-10-02T19:43:59.910798] [INFO ] [MAIN ] JOE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:43:59.913465] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-02T19:43:59.950238] [DEBUG] [LOCAL ] JOE: Loaded 24154 existing records from primary storage. [2025-10-02T19:43:59.950562] [INFO ] [MAIN ] JOE: Loaded 24154 existing records. [2025-10-02T19:44:00.170453] [WARN ] [MAIN ] JOE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:44:00.170756] [INFO ] [MAIN ] JOE: Wiping existing primary data before full refresh. [2025-10-02T19:44:00.170819] [INFO ] [LOCAL ] JOE: Starting deletion of primary data. [2025-10-02T19:44:00.171880] [DEBUG] [LOCAL ] JOE: Deleted primary data file. [2025-10-02T19:44:00.171942] [INFO ] [MAIN ] JOE: Starting full primary refresh. [2025-10-02T19:44:00.281255] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-07. [2025-10-02T19:44:00.567963] [INFO ] [REMOTE ] JOE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:44:01.073030] [INFO ] [REMOTE ] JOE: Fetching primary data for 2024-12. [2025-10-02T19:44:01.873059] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-06. [2025-10-02T19:44:02.125422] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-02T19:44:02.283101] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2024-12 (2.81 seconds). [2025-10-02T19:44:02.673044] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-01. [2025-10-02T19:44:02.720498] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-02T19:44:03.324349] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-02T19:44:03.473018] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-01. [2025-10-02T19:44:04.273040] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-07. [2025-10-02T19:44:04.819911] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-02T19:44:05.073046] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-08. [2025-10-02T19:44:05.873011] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-02. [2025-10-02T19:44:06.191087] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-02T19:44:06.673026] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-08. [2025-10-02T19:44:06.979084] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-02T19:44:07.472993] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-09. [2025-10-02T19:44:08.427755] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-02 (2.55 seconds). [2025-10-02T19:44:08.440202] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-03. [2025-10-02T19:44:08.667810] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-02T19:44:09.073042] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-09. [2025-10-02T19:44:09.482146] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-01 (6.01 seconds). [2025-10-02T19:44:09.726611] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-02T19:44:09.872995] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-10. [2025-10-02T19:44:10.673035] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-02. [2025-10-02T19:44:10.910348] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-10-02T19:44:11.162446] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-02T19:44:11.473042] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-04. [2025-10-02T19:44:11.766958] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-02T19:44:11.827613] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-02T19:44:11.829828] [INFO ] [REMOTE ] JNJ: Full fetch complete (77855 records). [2025-10-02T19:44:11.830005] [DEBUG] [VALIDATOR ] JNJ: Validating primary data. [2025-10-02T19:44:12.279019] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-10. [2025-10-02T19:44:12.281088] [DEBUG] [VALIDATOR ] JNJ: All expected trading days are present. [2025-10-02T19:44:12.281214] [DEBUG] [VALIDATOR ] JNJ: Primary data validation passed. [2025-10-02T19:44:12.282577] [INFO ] [MAIN ] JNJ: Fetched primary data is valid. [2025-10-02T19:44:12.282841] [DEBUG] [LOCAL ] JNJ: Saving primary data. [2025-10-02T19:44:12.284962] [DEBUG] [LOCAL ] JNJ: Trimmed 77855 records to 54143 (keeping 200 days of data) [2025-10-02T19:44:12.667219] [DEBUG] [LOCAL ] JNJ: Primary data saved (54143 records). [2025-10-02T19:44:12.667375] [INFO ] [MAIN ] JNJ: Full history saved. [2025-10-02T19:44:12.668584] [INFO ] [MAIN ] Update Progress: 1163/2370 symbols completed. JNJ took 38.5s. Estimated remaining: 2h 50m 21s. Rate: 7.1 symbols/min [2025-10-02T19:44:12.856188] [INFO ] [MAIN ] JOF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:44:12.867626] [DEBUG] [LOCAL ] JOF: Loaded 7000 existing records from primary storage. [2025-10-02T19:44:12.867894] [INFO ] [MAIN ] JOF: Loaded 7000 existing records. [2025-10-02T19:44:13.067902] [WARN ] [MAIN ] JOF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:44:13.068201] [INFO ] [MAIN ] JOF: Wiping existing primary data before full refresh. [2025-10-02T19:44:13.068265] [INFO ] [LOCAL ] JOF: Starting deletion of primary data. [2025-10-02T19:44:13.068680] [DEBUG] [LOCAL ] JOF: Deleted primary data file. [2025-10-02T19:44:13.068744] [INFO ] [MAIN ] JOF: Starting full primary refresh. [2025-10-02T19:44:13.074712] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-03. [2025-10-02T19:44:13.486439] [INFO ] [REMOTE ] JOF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:44:13.873041] [INFO ] [REMOTE ] JOF: Fetching primary data for 2024-12. [2025-10-02T19:44:13.966313] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-10-02T19:44:14.063278] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-02T19:44:14.065383] [INFO ] [REMOTE ] JMIA: Full fetch complete (73265 records). [2025-10-02T19:44:14.065510] [DEBUG] [VALIDATOR ] JMIA: Validating primary data. [2025-10-02T19:44:14.481280] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-02T19:44:14.528618] [DEBUG] [VALIDATOR ] JMIA: All expected trading days are present. [2025-10-02T19:44:14.528797] [DEBUG] [VALIDATOR ] JMIA: Primary data validation passed. [2025-10-02T19:44:14.529943] [INFO ] [MAIN ] JMIA: Fetched primary data is valid. [2025-10-02T19:44:14.530162] [DEBUG] [LOCAL ] JMIA: Saving primary data. [2025-10-02T19:44:14.531979] [DEBUG] [LOCAL ] JMIA: Trimmed 73265 records to 51046 (keeping 200 days of data) [2025-10-02T19:44:14.626275] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-02T19:44:14.711688] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-01. [2025-10-02T19:44:14.859703] [DEBUG] [LOCAL ] JMIA: Primary data saved (51046 records). [2025-10-02T19:44:14.859859] [INFO ] [MAIN ] JMIA: Full history saved. [2025-10-02T19:44:14.859950] [INFO ] [MAIN ] Update Progress: 1164/2370 symbols completed. JMIA took 40.7s. Estimated remaining: 2h 50m 6s. Rate: 7.1 symbols/min [2025-10-02T19:44:15.056540] [INFO ] [MAIN ] JPC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:44:15.112242] [DEBUG] [LOCAL ] JPC: Loaded 37095 existing records from primary storage. [2025-10-02T19:44:15.113402] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-02T19:44:15.114912] [INFO ] [MAIN ] JPC: Loaded 37095 existing records. [2025-10-02T19:44:15.314039] [WARN ] [MAIN ] JPC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:44:15.314367] [INFO ] [MAIN ] JPC: Wiping existing primary data before full refresh. [2025-10-02T19:44:15.314447] [INFO ] [LOCAL ] JPC: Starting deletion of primary data. [2025-10-02T19:44:15.315379] [DEBUG] [LOCAL ] JPC: Deleted primary data file. [2025-10-02T19:44:15.315459] [INFO ] [MAIN ] JPC: Starting full primary refresh. [2025-10-02T19:44:15.478812] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-02. [2025-10-02T19:44:15.713396] [INFO ] [REMOTE ] JPC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:44:15.928742] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-02T19:44:16.273008] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-03. [2025-10-02T19:44:16.977519] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-02T19:44:17.073017] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-04. [2025-10-02T19:44:17.830387] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-02T19:44:17.872959] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-05. [2025-10-02T19:44:18.478795] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-02T19:44:18.672985] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-06. [2025-10-02T19:44:19.280855] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-02T19:44:19.473015] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-05. [2025-10-02T19:44:20.273050] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-07. [2025-10-02T19:44:20.802692] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-02T19:44:21.073045] [INFO ] [REMOTE ] JPC: Fetching primary data for 2024-12. [2025-10-02T19:44:21.856160] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-10-02T19:44:21.872950] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-06. [2025-10-02T19:44:22.607522] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-02T19:44:22.673001] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-04. [2025-10-02T19:44:23.473054] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-01. [2025-10-02T19:44:24.022124] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-02T19:44:24.149590] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-10-02T19:44:24.272956] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-08. [2025-10-02T19:44:24.748476] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-02T19:44:25.072603] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-02T19:44:25.074736] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-02. [2025-10-02T19:44:25.873033] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-09. [2025-10-02T19:44:26.380236] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-02T19:44:26.622175] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-02T19:44:26.673020] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-10. [2025-10-02T19:44:27.171822] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-02T19:44:27.172703] [INFO ] [REMOTE ] JOF: Full fetch complete (9476 records). [2025-10-02T19:44:27.172791] [DEBUG] [VALIDATOR ] JOF: Validating primary data. [2025-10-02T19:44:27.478194] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-05. [2025-10-02T19:44:27.587669] [DEBUG] [VALIDATOR ] JOF: All expected trading days are present. [2025-10-02T19:44:27.587788] [DEBUG] [VALIDATOR ] JOF: Primary data validation passed. [2025-10-02T19:44:27.588047] [INFO ] [MAIN ] JOF: Fetched primary data is valid. [2025-10-02T19:44:27.588100] [DEBUG] [LOCAL ] JOF: Saving primary data. [2025-10-02T19:44:27.588887] [DEBUG] [LOCAL ] JOF: Trimmed 9476 records to 7036 (keeping 200 days of data) [2025-10-02T19:44:27.640026] [DEBUG] [LOCAL ] JOF: Primary data saved (7036 records). [2025-10-02T19:44:27.640175] [INFO ] [MAIN ] JOF: Full history saved. [2025-10-02T19:44:27.640362] [INFO ] [MAIN ] Update Progress: 1165/2370 symbols completed. JOF took 15.0s. Estimated remaining: 2h 50m 2s. Rate: 7.1 symbols/min [2025-10-02T19:44:27.841561] [INFO ] [MAIN ] JPM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:44:27.917280] [DEBUG] [LOCAL ] JPM: Loaded 53794 existing records from primary storage. [2025-10-02T19:44:27.917712] [INFO ] [MAIN ] JPM: Loaded 53794 existing records. [2025-10-02T19:44:28.122678] [WARN ] [MAIN ] JPM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:44:28.122929] [INFO ] [MAIN ] JPM: Wiping existing primary data before full refresh. [2025-10-02T19:44:28.122991] [INFO ] [LOCAL ] JPM: Starting deletion of primary data. [2025-10-02T19:44:28.124342] [DEBUG] [LOCAL ] JPM: Deleted primary data file. [2025-10-02T19:44:28.124404] [INFO ] [MAIN ] JPM: Starting full primary refresh. [2025-10-02T19:44:28.285874] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-07. [2025-10-02T19:44:28.561933] [INFO ] [REMOTE ] JPM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:44:28.665627] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-02T19:44:29.073017] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-06. [2025-10-02T19:44:29.878267] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-03. [2025-10-02T19:44:29.889520] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-02T19:44:30.673027] [INFO ] [REMOTE ] JPM: Fetching primary data for 2024-12. [2025-10-02T19:44:30.820058] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-10-02T19:44:31.361920] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-02T19:44:31.473001] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-04. [2025-10-02T19:44:32.273050] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-08. [2025-10-02T19:44:32.556508] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-02T19:44:32.762488] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-02T19:44:33.072998] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-01. [2025-10-02T19:44:33.872993] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-07. [2025-10-02T19:44:34.673033] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-05. [2025-10-02T19:44:35.070202] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-08 (2.80 seconds). [2025-10-02T19:44:35.093877] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-02T19:44:35.217443] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-02T19:44:35.473042] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-08. [2025-10-02T19:44:36.062991] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-02T19:44:36.273043] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-06. [2025-10-02T19:44:36.514207] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-02T19:44:37.073000] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-09. [2025-10-02T19:44:37.465175] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-02T19:44:37.873004] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-07. [2025-10-02T19:44:38.170420] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-02T19:44:38.672993] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-02. [2025-10-02T19:44:39.089628] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-02T19:44:39.473043] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-09. [2025-10-02T19:44:40.273075] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-10. [2025-10-02T19:44:40.664838] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-02T19:44:40.989021] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-02T19:44:40.991047] [INFO ] [REMOTE ] JOE: Full fetch complete (36047 records). [2025-10-02T19:44:40.991354] [DEBUG] [VALIDATOR ] JOE: Validating primary data. [2025-10-02T19:44:41.078964] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-03. [2025-10-02T19:44:41.411678] [DEBUG] [VALIDATOR ] JOE: All expected trading days are present. [2025-10-02T19:44:41.411811] [DEBUG] [VALIDATOR ] JOE: Primary data validation passed. [2025-10-02T19:44:41.412514] [INFO ] [MAIN ] JOE: Fetched primary data is valid. [2025-10-02T19:44:41.412558] [DEBUG] [LOCAL ] JOE: Saving primary data. [2025-10-02T19:44:41.415082] [DEBUG] [LOCAL ] JOE: Trimmed 36047 records to 24297 (keeping 200 days of data) [2025-10-02T19:44:41.591597] [DEBUG] [LOCAL ] JOE: Primary data saved (24297 records). [2025-10-02T19:44:41.591799] [INFO ] [MAIN ] JOE: Full history saved. [2025-10-02T19:44:41.591918] [INFO ] [MAIN ] Update Progress: 1166/2370 symbols completed. JOE took 41.9s. Estimated remaining: 2h 49m 60s. Rate: 7.1 symbols/min [2025-10-02T19:44:41.788211] [INFO ] [MAIN ] JQC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:44:41.823784] [DEBUG] [LOCAL ] JQC: Loaded 34263 existing records from primary storage. [2025-10-02T19:44:41.824093] [INFO ] [MAIN ] JQC: Loaded 34263 existing records. [2025-10-02T19:44:41.875079] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-08. [2025-10-02T19:44:42.027391] [WARN ] [MAIN ] JQC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:44:42.027808] [INFO ] [MAIN ] JQC: Wiping existing primary data before full refresh. [2025-10-02T19:44:42.028061] [INFO ] [LOCAL ] JQC: Starting deletion of primary data. [2025-10-02T19:44:42.029131] [DEBUG] [LOCAL ] JQC: Deleted primary data file. [2025-10-02T19:44:42.029206] [INFO ] [MAIN ] JQC: Starting full primary refresh. [2025-10-02T19:44:42.456304] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-09 (2.98 seconds). [2025-10-02T19:44:42.474134] [INFO ] [REMOTE ] JQC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:44:42.672986] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-10. [2025-10-02T19:44:43.379575] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-02T19:44:43.473013] [INFO ] [REMOTE ] JQC: Fetching primary data for 2024-12. [2025-10-02T19:44:43.545394] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-10-02T19:44:44.272981] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-04. [2025-10-02T19:44:44.700386] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-02T19:44:44.974008] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-10 (2.30 seconds). [2025-10-02T19:44:44.978567] [INFO ] [REMOTE ] JOBY: Full fetch complete (77971 records). [2025-10-02T19:44:44.978769] [DEBUG] [VALIDATOR ] JOBY: Validating primary data. [2025-10-02T19:44:45.082721] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-01. [2025-10-02T19:44:45.425222] [DEBUG] [VALIDATOR ] JOBY: All expected trading days are present. [2025-10-02T19:44:45.425340] [DEBUG] [VALIDATOR ] JOBY: Primary data validation passed. [2025-10-02T19:44:45.426544] [INFO ] [MAIN ] JOBY: Fetched primary data is valid. [2025-10-02T19:44:45.426623] [DEBUG] [LOCAL ] JOBY: Saving primary data. [2025-10-02T19:44:45.430517] [DEBUG] [LOCAL ] JOBY: Trimmed 77971 records to 54189 (keeping 200 days of data) [2025-10-02T19:44:45.811949] [DEBUG] [LOCAL ] JOBY: Primary data saved (54189 records). [2025-10-02T19:44:45.812088] [INFO ] [MAIN ] JOBY: Full history saved. [2025-10-02T19:44:45.812207] [INFO ] [MAIN ] Update Progress: 1167/2370 symbols completed. JOBY took 48.0s. Estimated remaining: 2h 49m 47s. Rate: 7.1 symbols/min [2025-10-02T19:44:45.887081] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-09. [2025-10-02T19:44:46.009371] [INFO ] [MAIN ] JRI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:44:46.028336] [DEBUG] [LOCAL ] JRI: Loaded 14885 existing records from primary storage. [2025-10-02T19:44:46.028614] [INFO ] [MAIN ] JRI: Loaded 14885 existing records. [2025-10-02T19:44:46.228087] [WARN ] [MAIN ] JRI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:44:46.228314] [INFO ] [MAIN ] JRI: Wiping existing primary data before full refresh. [2025-10-02T19:44:46.228366] [INFO ] [LOCAL ] JRI: Starting deletion of primary data. [2025-10-02T19:44:46.228966] [DEBUG] [LOCAL ] JRI: Deleted primary data file. [2025-10-02T19:44:46.229037] [INFO ] [MAIN ] JRI: Starting full primary refresh. [2025-10-02T19:44:46.668518] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-02T19:44:46.666782] [INFO ] [REMOTE ] JRI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:44:46.677216] [INFO ] [REMOTE ] JRI: Fetching primary data for 2024-12. [2025-10-02T19:44:46.726628] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-10-02T19:44:47.407046] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-02T19:44:47.472986] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-05. [2025-10-02T19:44:47.680001] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-02T19:44:48.273049] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-02. [2025-10-02T19:44:49.073050] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-01. [2025-10-02T19:44:49.536410] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-02T19:44:49.872972] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-03. [2025-10-02T19:44:49.974625] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-10-02T19:44:50.115407] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-02T19:44:50.672998] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-10. [2025-10-02T19:44:51.094606] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-02T19:44:51.473054] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-06. [2025-10-02T19:44:51.949809] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-02T19:44:51.951821] [INFO ] [REMOTE ] JPC: Full fetch complete (55628 records). [2025-10-02T19:44:51.951999] [DEBUG] [VALIDATOR ] JPC: Validating primary data. [2025-10-02T19:44:52.278120] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-02. [2025-10-02T19:44:52.418359] [DEBUG] [VALIDATOR ] JPC: All expected trading days are present. [2025-10-02T19:44:52.418452] [DEBUG] [VALIDATOR ] JPC: Primary data validation passed. [2025-10-02T19:44:52.419361] [INFO ] [MAIN ] JPC: Fetched primary data is valid. [2025-10-02T19:44:52.419428] [DEBUG] [LOCAL ] JPC: Saving primary data. [2025-10-02T19:44:52.420757] [DEBUG] [LOCAL ] JPC: Trimmed 55628 records to 37383 (keeping 200 days of data) [2025-10-02T19:44:52.663490] [DEBUG] [LOCAL ] JPC: Primary data saved (37383 records). [2025-10-02T19:44:52.663661] [INFO ] [MAIN ] JPC: Full history saved. [2025-10-02T19:44:52.663806] [INFO ] [MAIN ] Update Progress: 1168/2370 symbols completed. JPC took 37.8s. Estimated remaining: 2h 49m 37s. Rate: 7.1 symbols/min [2025-10-02T19:44:52.846892] [INFO ] [MAIN ] JRS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:44:52.860317] [DEBUG] [LOCAL ] JRS: Loaded 11305 existing records from primary storage. [2025-10-02T19:44:52.860560] [INFO ] [MAIN ] JRS: Loaded 11305 existing records. [2025-10-02T19:44:53.054721] [WARN ] [MAIN ] JRS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:44:53.054968] [INFO ] [MAIN ] JRS: Wiping existing primary data before full refresh. [2025-10-02T19:44:53.055020] [INFO ] [LOCAL ] JRS: Starting deletion of primary data. [2025-10-02T19:44:53.055446] [DEBUG] [LOCAL ] JRS: Deleted primary data file. [2025-10-02T19:44:53.055510] [INFO ] [MAIN ] JRS: Starting full primary refresh. [2025-10-02T19:44:53.079379] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-04. [2025-10-02T19:44:53.379814] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-02T19:44:53.503703] [INFO ] [REMOTE ] JRS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:44:53.539283] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-02T19:44:53.872992] [INFO ] [REMOTE ] JRS: Fetching primary data for 2024-12. [2025-10-02T19:44:54.560900] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-02T19:44:54.577801] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-02T19:44:54.672983] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-07. [2025-10-02T19:44:55.472988] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-03. [2025-10-02T19:44:56.273003] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-01. [2025-10-02T19:44:56.488090] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-02T19:44:57.032854] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-02T19:44:57.073052] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-02. [2025-10-02T19:44:57.151995] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-10-02T19:44:57.872977] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-05. [2025-10-02T19:44:57.893940] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-02T19:44:58.673035] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-03. [2025-10-02T19:44:59.250720] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-02T19:44:59.472981] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-08. [2025-10-02T19:44:59.484195] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-02T19:45:00.273005] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-04. [2025-10-02T19:45:01.073051] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-04. [2025-10-02T19:45:01.301950] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-02T19:45:01.870182] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-10-02T19:45:01.881054] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-06. [2025-10-02T19:45:02.143102] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-02T19:45:02.673019] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-09. [2025-10-02T19:45:03.050708] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-02T19:45:03.473059] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-05. [2025-10-02T19:45:04.273005] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-05. [2025-10-02T19:45:04.474038] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-02T19:45:04.856151] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-02T19:45:05.002962] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-10-02T19:45:05.073046] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-10. [2025-10-02T19:45:05.873037] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-07. [2025-10-02T19:45:06.673000] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-06. [2025-10-02T19:45:07.158317] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-02T19:45:07.160472] [INFO ] [REMOTE ] JPM: Full fetch complete (77892 records). [2025-10-02T19:45:07.160779] [DEBUG] [VALIDATOR ] JPM: Validating primary data. [2025-10-02T19:45:07.475376] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-06. [2025-10-02T19:45:07.547532] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-02T19:45:07.681112] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-02T19:45:07.681437] [DEBUG] [VALIDATOR ] JPM: All expected trading days are present. [2025-10-02T19:45:07.686069] [DEBUG] [VALIDATOR ] JPM: Primary data validation passed. [2025-10-02T19:45:07.688427] [INFO ] [MAIN ] JPM: Fetched primary data is valid. [2025-10-02T19:45:07.688510] [DEBUG] [LOCAL ] JPM: Saving primary data. [2025-10-02T19:45:07.690041] [DEBUG] [LOCAL ] JPM: Trimmed 77892 records to 54184 (keeping 200 days of data) [2025-10-02T19:45:08.047024] [DEBUG] [LOCAL ] JPM: Primary data saved (54184 records). [2025-10-02T19:45:08.047175] [INFO ] [MAIN ] JPM: Full history saved. [2025-10-02T19:45:08.047262] [INFO ] [MAIN ] Update Progress: 1169/2370 symbols completed. JPM took 40.4s. Estimated remaining: 2h 49m 35s. Rate: 7.1 symbols/min [2025-10-02T19:45:08.239335] [INFO ] [MAIN ] JXN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:45:08.282129] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-07. [2025-10-02T19:45:08.285890] [DEBUG] [LOCAL ] JXN: Loaded 45580 existing records from primary storage. [2025-10-02T19:45:08.286325] [INFO ] [MAIN ] JXN: Loaded 45580 existing records. [2025-10-02T19:45:08.416678] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-02T19:45:08.501085] [WARN ] [MAIN ] JXN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:45:08.501324] [INFO ] [MAIN ] JXN: Wiping existing primary data before full refresh. [2025-10-02T19:45:08.501374] [INFO ] [LOCAL ] JXN: Starting deletion of primary data. [2025-10-02T19:45:08.502367] [DEBUG] [LOCAL ] JXN: Deleted primary data file. [2025-10-02T19:45:08.502429] [INFO ] [MAIN ] JXN: Starting full primary refresh. [2025-10-02T19:45:08.896205] [INFO ] [REMOTE ] JXN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:45:09.073015] [INFO ] [REMOTE ] JXN: Fetching primary data for 2024-12. [2025-10-02T19:45:09.403913] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-02T19:45:09.873004] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-08. [2025-10-02T19:45:10.526457] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-02T19:45:10.672986] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-01. [2025-10-02T19:45:11.251333] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-02T19:45:11.473068] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-08. [2025-10-02T19:45:12.264615] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-02T19:45:12.278694] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-07. [2025-10-02T19:45:12.301131] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-02T19:45:12.941836] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-02T19:45:13.073005] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-09. [2025-10-02T19:45:13.872983] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-02. [2025-10-02T19:45:14.092623] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-02T19:45:14.673003] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-09. [2025-10-02T19:45:15.045734] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-02T19:45:15.473023] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-10. [2025-10-02T19:45:16.178547] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-02T19:45:16.179976] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-02T19:45:16.188287] [INFO ] [REMOTE ] JRI: Full fetch complete (23264 records). [2025-10-02T19:45:16.189052] [DEBUG] [VALIDATOR ] JRI: Validating primary data. [2025-10-02T19:45:16.278161] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-10. [2025-10-02T19:45:16.595614] [DEBUG] [VALIDATOR ] JRI: All expected trading days are present. [2025-10-02T19:45:16.595729] [DEBUG] [VALIDATOR ] JRI: Primary data validation passed. [2025-10-02T19:45:16.596274] [INFO ] [MAIN ] JRI: Fetched primary data is valid. [2025-10-02T19:45:16.596361] [DEBUG] [LOCAL ] JRI: Saving primary data. [2025-10-02T19:45:16.597023] [DEBUG] [LOCAL ] JRI: Trimmed 23264 records to 14997 (keeping 200 days of data) [2025-10-02T19:45:16.691790] [DEBUG] [LOCAL ] JRI: Primary data saved (14997 records). [2025-10-02T19:45:16.691967] [INFO ] [MAIN ] JRI: Full history saved. [2025-10-02T19:45:16.692165] [INFO ] [MAIN ] Update Progress: 1170/2370 symbols completed. JRI took 30.9s. Estimated remaining: 2h 49m 27s. Rate: 7.1 symbols/min [2025-10-02T19:45:16.874568] [INFO ] [MAIN ] K: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:45:16.922286] [DEBUG] [LOCAL ] K: Loaded 49977 existing records from primary storage. [2025-10-02T19:45:16.922665] [INFO ] [MAIN ] K: Loaded 49977 existing records. [2025-10-02T19:45:17.078119] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-08. [2025-10-02T19:45:17.109302] [WARN ] [MAIN ] K: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:45:17.109687] [INFO ] [MAIN ] K: Wiping existing primary data before full refresh. [2025-10-02T19:45:17.109748] [INFO ] [LOCAL ] K: Starting deletion of primary data. [2025-10-02T19:45:17.110837] [DEBUG] [LOCAL ] K: Deleted primary data file. [2025-10-02T19:45:17.110897] [INFO ] [MAIN ] K: Starting full primary refresh. [2025-10-02T19:45:17.501427] [INFO ] [REMOTE ] K: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:45:17.514112] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-02T19:45:17.516065] [INFO ] [REMOTE ] JQC: Full fetch complete (49237 records). [2025-10-02T19:45:17.516161] [DEBUG] [VALIDATOR ] JQC: Validating primary data. [2025-10-02T19:45:17.734737] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-02T19:45:17.878123] [INFO ] [REMOTE ] K: Fetching primary data for 2024-12. [2025-10-02T19:45:17.954921] [DEBUG] [VALIDATOR ] JQC: All expected trading days are present. [2025-10-02T19:45:17.955020] [DEBUG] [VALIDATOR ] JQC: Primary data validation passed. [2025-10-02T19:45:17.956132] [INFO ] [MAIN ] JQC: Fetched primary data is valid. [2025-10-02T19:45:17.956227] [DEBUG] [LOCAL ] JQC: Saving primary data. [2025-10-02T19:45:17.957894] [DEBUG] [LOCAL ] JQC: Trimmed 49237 records to 34592 (keeping 200 days of data) [2025-10-02T19:45:18.190542] [DEBUG] [LOCAL ] JQC: Primary data saved (34592 records). [2025-10-02T19:45:18.190721] [INFO ] [MAIN ] JQC: Full history saved. [2025-10-02T19:45:18.190819] [INFO ] [MAIN ] Update Progress: 1171/2370 symbols completed. JQC took 36.6s. Estimated remaining: 2h 49m 11s. Rate: 7.1 symbols/min [2025-10-02T19:45:18.382252] [INFO ] [MAIN ] KAI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:45:18.399216] [DEBUG] [LOCAL ] KAI: Loaded 13309 existing records from primary storage. [2025-10-02T19:45:18.399489] [INFO ] [MAIN ] KAI: Loaded 13309 existing records. [2025-10-02T19:45:18.602798] [WARN ] [MAIN ] KAI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:45:18.603084] [INFO ] [MAIN ] KAI: Wiping existing primary data before full refresh. [2025-10-02T19:45:18.603151] [INFO ] [LOCAL ] KAI: Starting deletion of primary data. [2025-10-02T19:45:18.603733] [DEBUG] [LOCAL ] KAI: Deleted primary data file. [2025-10-02T19:45:18.603800] [INFO ] [MAIN ] KAI: Starting full primary refresh. [2025-10-02T19:45:18.678144] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-09. [2025-10-02T19:45:19.006359] [INFO ] [REMOTE ] KAI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:45:19.473041] [INFO ] [REMOTE ] KAI: Fetching primary data for 2024-12. [2025-10-02T19:45:19.635998] [INFO ] [REMOTE ] K: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-02T19:45:20.109457] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-02T19:45:20.273014] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-10. [2025-10-02T19:45:20.333591] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-02T19:45:20.861407] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-02T19:45:20.862483] [INFO ] [REMOTE ] JRS: Full fetch complete (16298 records). [2025-10-02T19:45:20.862556] [DEBUG] [VALIDATOR ] JRS: Validating primary data. [2025-10-02T19:45:21.078987] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-03. [2025-10-02T19:45:21.273688] [DEBUG] [VALIDATOR ] JRS: All expected trading days are present. [2025-10-02T19:45:21.273778] [DEBUG] [VALIDATOR ] JRS: Primary data validation passed. [2025-10-02T19:45:21.274205] [INFO ] [MAIN ] JRS: Fetched primary data is valid. [2025-10-02T19:45:21.274248] [DEBUG] [LOCAL ] JRS: Saving primary data. [2025-10-02T19:45:21.274895] [DEBUG] [LOCAL ] JRS: Trimmed 16298 records to 11452 (keeping 200 days of data) [2025-10-02T19:45:21.345419] [DEBUG] [LOCAL ] JRS: Primary data saved (11452 records). [2025-10-02T19:45:21.345556] [INFO ] [MAIN ] JRS: Full history saved. [2025-10-02T19:45:21.345639] [INFO ] [MAIN ] Update Progress: 1172/2370 symbols completed. JRS took 28.7s. Estimated remaining: 2h 48m 58s. Rate: 7.1 symbols/min [2025-10-02T19:45:21.558220] [INFO ] [MAIN ] KAR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:45:21.610264] [DEBUG] [LOCAL ] KAR: Loaded 39968 existing records from primary storage. [2025-10-02T19:45:21.610592] [INFO ] [MAIN ] KAR: Loaded 39968 existing records. [2025-10-02T19:45:21.812601] [WARN ] [MAIN ] KAR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:45:21.812888] [INFO ] [MAIN ] KAR: Wiping existing primary data before full refresh. [2025-10-02T19:45:21.812952] [INFO ] [LOCAL ] KAR: Starting deletion of primary data. [2025-10-02T19:45:21.813883] [DEBUG] [LOCAL ] KAR: Deleted primary data file. [2025-10-02T19:45:21.813949] [INFO ] [MAIN ] KAR: Starting full primary refresh. [2025-10-02T19:45:21.878108] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-01. [2025-10-02T19:45:22.213111] [INFO ] [REMOTE ] KAR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:45:22.502900] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-02T19:45:22.672972] [INFO ] [REMOTE ] K: Fetching primary data for 2025-01. [2025-10-02T19:45:22.740945] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-02T19:45:23.473027] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-04. [2025-10-02T19:45:24.019639] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-02T19:45:24.273003] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-02. [2025-10-02T19:45:24.832337] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-02T19:45:25.072999] [INFO ] [REMOTE ] K: Fetching primary data for 2025-02. [2025-10-02T19:45:25.249491] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-02T19:45:25.873053] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-03. [2025-10-02T19:45:26.652892] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-02T19:45:26.672954] [INFO ] [REMOTE ] K: Fetching primary data for 2025-03. [2025-10-02T19:45:26.712532] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-02T19:45:27.472982] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-04. [2025-10-02T19:45:28.027986] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-02T19:45:28.272973] [INFO ] [REMOTE ] K: Fetching primary data for 2025-04. [2025-10-02T19:45:28.577229] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-02T19:45:29.073011] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-05. [2025-10-02T19:45:29.863449] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-02T19:45:29.878587] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-06. [2025-10-02T19:45:29.899703] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-02T19:45:30.673014] [INFO ] [REMOTE ] K: Fetching primary data for 2025-05. [2025-10-02T19:45:30.888100] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-02T19:45:31.473087] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-07. [2025-10-02T19:45:32.191365] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-02T19:45:32.273003] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-05. [2025-10-02T19:45:32.470050] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-02T19:45:33.073006] [INFO ] [REMOTE ] K: Fetching primary data for 2025-06. [2025-10-02T19:45:33.878257] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-08. [2025-10-02T19:45:33.884212] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-02T19:45:34.496388] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-02T19:45:34.673004] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-09. [2025-10-02T19:45:34.735371] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-02T19:45:35.473011] [INFO ] [REMOTE ] K: Fetching primary data for 2025-07. [2025-10-02T19:45:35.513418] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-02T19:45:36.273000] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-10. [2025-10-02T19:45:36.957272] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-02T19:45:36.958415] [INFO ] [REMOTE ] KAI: Full fetch complete (18852 records). [2025-10-02T19:45:36.958501] [DEBUG] [VALIDATOR ] KAI: Validating primary data. [2025-10-02T19:45:37.075225] [INFO ] [REMOTE ] KAR: Fetching primary data for 2024-12. [2025-10-02T19:45:37.401764] [DEBUG] [VALIDATOR ] KAI: All expected trading days are present. [2025-10-02T19:45:37.401988] [DEBUG] [VALIDATOR ] KAI: Primary data validation passed. [2025-10-02T19:45:37.402615] [INFO ] [MAIN ] KAI: Fetched primary data is valid. [2025-10-02T19:45:37.421402] [DEBUG] [LOCAL ] KAI: Saving primary data. [2025-10-02T19:45:37.436966] [DEBUG] [LOCAL ] KAI: Trimmed 18852 records to 13381 (keeping 200 days of data) [2025-10-02T19:45:37.439308] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-02T19:45:37.547207] [DEBUG] [LOCAL ] KAI: Primary data saved (13381 records). [2025-10-02T19:45:37.547370] [INFO ] [MAIN ] KAI: Full history saved. [2025-10-02T19:45:37.547481] [INFO ] [MAIN ] Update Progress: 1173/2370 symbols completed. KAI took 19.4s. Estimated remaining: 2h 48m 57s. Rate: 7.1 symbols/min [2025-10-02T19:45:37.726624] [INFO ] [MAIN ] KB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:45:37.750402] [DEBUG] [LOCAL ] KB: Loaded 23969 existing records from primary storage. [2025-10-02T19:45:37.750682] [INFO ] [MAIN ] KB: Loaded 23969 existing records. [2025-10-02T19:45:37.878219] [INFO ] [REMOTE ] K: Fetching primary data for 2025-08. [2025-10-02T19:45:37.948333] [WARN ] [MAIN ] KB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:45:37.948539] [INFO ] [MAIN ] KB: Wiping existing primary data before full refresh. [2025-10-02T19:45:37.948633] [INFO ] [LOCAL ] KB: Starting deletion of primary data. [2025-10-02T19:45:37.949605] [DEBUG] [LOCAL ] KB: Deleted primary data file. [2025-10-02T19:45:37.949691] [INFO ] [MAIN ] KB: Starting full primary refresh. [2025-10-02T19:45:38.334968] [INFO ] [REMOTE ] KB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:45:38.582398] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-02T19:45:38.673058] [INFO ] [REMOTE ] KB: Fetching primary data for 2024-12. [2025-10-02T19:45:39.381617] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-02T19:45:39.473013] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-01. [2025-10-02T19:45:39.897747] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-02T19:45:40.273012] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-06. [2025-10-02T19:45:40.834097] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-02T19:45:41.073015] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-02. [2025-10-02T19:45:41.436832] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-02T19:45:41.872999] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-01. [2025-10-02T19:45:42.159150] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-02T19:45:42.672971] [INFO ] [REMOTE ] K: Fetching primary data for 2025-09. [2025-10-02T19:45:42.895956] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-02T19:45:43.473072] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-07. [2025-10-02T19:45:44.273078] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-02. [2025-10-02T19:45:44.439160] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-02T19:45:45.065317] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-02T19:45:45.072956] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-03. [2025-10-02T19:45:45.109695] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-02T19:45:45.873079] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-08. [2025-10-02T19:45:46.238745] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-02T19:45:46.672997] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-03. [2025-10-02T19:45:47.472965] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-04. [2025-10-02T19:45:47.518696] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-02T19:45:48.181198] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-02T19:45:48.272977] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-04. [2025-10-02T19:45:48.376335] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-02T19:45:49.072996] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-09. [2025-10-02T19:45:49.708354] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-02T19:45:49.872997] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-05. [2025-10-02T19:45:50.471915] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-02T19:45:50.673006] [INFO ] [REMOTE ] K: Fetching primary data for 2025-10. [2025-10-02T19:45:51.391364] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-02T19:45:51.472995] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-06. [2025-10-02T19:45:52.103023] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-02T19:45:52.105185] [INFO ] [REMOTE ] K: Full fetch complete (72096 records). [2025-10-02T19:45:52.105410] [DEBUG] [VALIDATOR ] K: Validating primary data. [2025-10-02T19:45:52.278106] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-05. [2025-10-02T19:45:52.560240] [DEBUG] [VALIDATOR ] K: All expected trading days are present. [2025-10-02T19:45:52.560387] [DEBUG] [VALIDATOR ] K: Primary data validation passed. [2025-10-02T19:45:52.561503] [INFO ] [MAIN ] K: Fetched primary data is valid. [2025-10-02T19:45:52.561576] [DEBUG] [LOCAL ] K: Saving primary data. [2025-10-02T19:45:52.563332] [DEBUG] [LOCAL ] K: Trimmed 72096 records to 50366 (keeping 200 days of data) [2025-10-02T19:45:52.907598] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-02T19:45:52.932354] [DEBUG] [LOCAL ] K: Primary data saved (50366 records). [2025-10-02T19:45:52.932530] [INFO ] [MAIN ] K: Full history saved. [2025-10-02T19:45:52.932673] [INFO ] [MAIN ] Update Progress: 1174/2370 symbols completed. K took 36.2s. Estimated remaining: 2h 48m 56s. Rate: 7.1 symbols/min [2025-10-02T19:45:53.078122] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-07. [2025-10-02T19:45:53.131839] [INFO ] [MAIN ] KBDC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:45:53.154830] [DEBUG] [LOCAL ] KBDC: Loaded 21161 existing records from primary storage. [2025-10-02T19:45:53.155100] [INFO ] [MAIN ] KBDC: Loaded 21161 existing records. [2025-10-02T19:45:53.351380] [WARN ] [MAIN ] KBDC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:45:53.351813] [INFO ] [MAIN ] KBDC: Wiping existing primary data before full refresh. [2025-10-02T19:45:53.351878] [INFO ] [LOCAL ] KBDC: Starting deletion of primary data. [2025-10-02T19:45:53.352483] [DEBUG] [LOCAL ] KBDC: Deleted primary data file. [2025-10-02T19:45:53.352545] [INFO ] [MAIN ] KBDC: Starting full primary refresh. [2025-10-02T19:45:53.678893] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-02T19:45:53.791120] [INFO ] [REMOTE ] KBDC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:45:53.873031] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-06. [2025-10-02T19:45:54.553585] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-02T19:45:54.672996] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-10. [2025-10-02T19:45:55.098860] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-02T19:45:55.473035] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2024-12. [2025-10-02T19:45:55.708969] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-02T19:45:55.710720] [INFO ] [REMOTE ] JXN: Full fetch complete (65216 records). [2025-10-02T19:45:55.710822] [DEBUG] [VALIDATOR ] JXN: Validating primary data. [2025-10-02T19:45:56.152043] [DEBUG] [VALIDATOR ] JXN: All expected trading days are present. [2025-10-02T19:45:56.152236] [DEBUG] [VALIDATOR ] JXN: Primary data validation passed. [2025-10-02T19:45:56.153314] [INFO ] [MAIN ] JXN: Fetched primary data is valid. [2025-10-02T19:45:56.153445] [DEBUG] [LOCAL ] JXN: Saving primary data. [2025-10-02T19:45:56.155559] [DEBUG] [LOCAL ] JXN: Trimmed 65216 records to 45845 (keeping 200 days of data) [2025-10-02T19:45:56.273215] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-08. [2025-10-02T19:45:56.398897] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-02T19:45:56.480116] [DEBUG] [LOCAL ] JXN: Primary data saved (45845 records). [2025-10-02T19:45:56.480274] [INFO ] [MAIN ] JXN: Full history saved. [2025-10-02T19:45:56.480365] [INFO ] [MAIN ] Update Progress: 1175/2370 symbols completed. JXN took 48.4s. Estimated remaining: 2h 48m 42s. Rate: 7.1 symbols/min [2025-10-02T19:45:56.686869] [INFO ] [MAIN ] KBH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:45:56.736756] [DEBUG] [LOCAL ] KBH: Loaded 48894 existing records from primary storage. [2025-10-02T19:45:56.737136] [INFO ] [MAIN ] KBH: Loaded 48894 existing records. [2025-10-02T19:45:56.930888] [WARN ] [MAIN ] KBH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:45:56.931165] [INFO ] [MAIN ] KBH: Wiping existing primary data before full refresh. [2025-10-02T19:45:56.931221] [INFO ] [LOCAL ] KBH: Starting deletion of primary data. [2025-10-02T19:45:56.932371] [DEBUG] [LOCAL ] KBH: Deleted primary data file. [2025-10-02T19:45:56.932436] [INFO ] [MAIN ] KBH: Starting full primary refresh. [2025-10-02T19:45:57.082126] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-01. [2025-10-02T19:45:57.324204] [INFO ] [REMOTE ] KBH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:45:57.881522] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-07. [2025-10-02T19:45:57.887027] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-02T19:45:58.248565] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-02T19:45:58.673000] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-09. [2025-10-02T19:45:59.131279] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-02T19:45:59.473025] [INFO ] [REMOTE ] KBH: Fetching primary data for 2024-12. [2025-10-02T19:46:00.184277] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-02T19:46:00.272995] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-02. [2025-10-02T19:46:00.934251] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-02T19:46:01.061097] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-02T19:46:01.072950] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-03. [2025-10-02T19:46:01.873016] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-08. [2025-10-02T19:46:02.245822] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-02T19:46:02.672985] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-10. [2025-10-02T19:46:02.844781] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-02T19:46:03.473046] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-04. [2025-10-02T19:46:03.784583] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-02T19:46:03.786436] [INFO ] [REMOTE ] KAR: Full fetch complete (56823 records). [2025-10-02T19:46:03.786565] [DEBUG] [VALIDATOR ] KAR: Validating primary data. [2025-10-02T19:46:04.203989] [DEBUG] [VALIDATOR ] KAR: All expected trading days are present. [2025-10-02T19:46:04.204074] [DEBUG] [VALIDATOR ] KAR: Primary data validation passed. [2025-10-02T19:46:04.204891] [INFO ] [MAIN ] KAR: Fetched primary data is valid. [2025-10-02T19:46:04.204956] [DEBUG] [LOCAL ] KAR: Saving primary data. [2025-10-02T19:46:04.206226] [DEBUG] [LOCAL ] KAR: Trimmed 56823 records to 40252 (keeping 200 days of data) [2025-10-02T19:46:04.290171] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-09. [2025-10-02T19:46:04.439181] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-02T19:46:04.475552] [DEBUG] [LOCAL ] KAR: Primary data saved (40252 records). [2025-10-02T19:46:04.475764] [INFO ] [MAIN ] KAR: Full history saved. [2025-10-02T19:46:04.475865] [INFO ] [MAIN ] Update Progress: 1176/2370 symbols completed. KAR took 43.1s. Estimated remaining: 2h 48m 33s. Rate: 7.1 symbols/min [2025-10-02T19:46:04.676634] [INFO ] [MAIN ] KBR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:46:04.726469] [DEBUG] [LOCAL ] KBR: Loaded 48025 existing records from primary storage. [2025-10-02T19:46:04.726941] [INFO ] [MAIN ] KBR: Loaded 48025 existing records. [2025-10-02T19:46:04.936312] [WARN ] [MAIN ] KBR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:46:04.936525] [INFO ] [MAIN ] KBR: Wiping existing primary data before full refresh. [2025-10-02T19:46:04.936577] [INFO ] [LOCAL ] KBR: Starting deletion of primary data. [2025-10-02T19:46:04.937710] [DEBUG] [LOCAL ] KBR: Deleted primary data file. [2025-10-02T19:46:04.937772] [INFO ] [MAIN ] KBR: Starting full primary refresh. [2025-10-02T19:46:05.086139] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-05. [2025-10-02T19:46:05.345617] [INFO ] [REMOTE ] KBR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:46:05.359989] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-02T19:46:05.873031] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-01. [2025-10-02T19:46:06.137558] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-02T19:46:06.672997] [INFO ] [REMOTE ] KBR: Fetching primary data for 2024-12. [2025-10-02T19:46:07.473005] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-06. [2025-10-02T19:46:07.507744] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-02T19:46:08.254232] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-02T19:46:08.272976] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-02. [2025-10-02T19:46:08.502080] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-02T19:46:09.073074] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-07. [2025-10-02T19:46:09.537028] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-02T19:46:09.872978] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-01. [2025-10-02T19:46:10.107950] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-02T19:46:10.672991] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-03. [2025-10-02T19:46:11.473027] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-08. [2025-10-02T19:46:11.742589] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-02T19:46:12.093554] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-02T19:46:12.119289] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-02T19:46:12.273038] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-10. [2025-10-02T19:46:13.074529] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-02T19:46:13.074400] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-02. [2025-10-02T19:46:13.077133] [INFO ] [REMOTE ] KB: Full fetch complete (34031 records). [2025-10-02T19:46:13.077230] [DEBUG] [VALIDATOR ] KB: Validating primary data. [2025-10-02T19:46:13.496676] [DEBUG] [VALIDATOR ] KB: All expected trading days are present. [2025-10-02T19:46:13.496776] [DEBUG] [VALIDATOR ] KB: Primary data validation passed. [2025-10-02T19:46:13.497489] [INFO ] [MAIN ] KB: Fetched primary data is valid. [2025-10-02T19:46:13.497534] [DEBUG] [LOCAL ] KB: Saving primary data. [2025-10-02T19:46:13.498605] [DEBUG] [LOCAL ] KB: Trimmed 34031 records to 24074 (keeping 200 days of data) [2025-10-02T19:46:13.655749] [DEBUG] [LOCAL ] KB: Primary data saved (24074 records). [2025-10-02T19:46:13.655887] [INFO ] [MAIN ] KB: Full history saved. [2025-10-02T19:46:13.655972] [INFO ] [MAIN ] Update Progress: 1177/2370 symbols completed. KB took 36.1s. Estimated remaining: 2h 48m 25s. Rate: 7.1 symbols/min [2025-10-02T19:46:13.872742] [INFO ] [MAIN ] KD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:46:13.873293] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-09. [2025-10-02T19:46:13.927837] [DEBUG] [LOCAL ] KD: Loaded 52309 existing records from primary storage. [2025-10-02T19:46:13.928230] [INFO ] [MAIN ] KD: Loaded 52309 existing records. [2025-10-02T19:46:14.131585] [WARN ] [MAIN ] KD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:46:14.131860] [INFO ] [MAIN ] KD: Wiping existing primary data before full refresh. [2025-10-02T19:46:14.131910] [INFO ] [LOCAL ] KD: Starting deletion of primary data. [2025-10-02T19:46:14.132978] [DEBUG] [LOCAL ] KD: Deleted primary data file. [2025-10-02T19:46:14.133041] [INFO ] [MAIN ] KD: Starting full primary refresh. [2025-10-02T19:46:14.523410] [INFO ] [REMOTE ] KD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:46:14.672979] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-04. [2025-10-02T19:46:14.757788] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-02T19:46:14.911431] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-02T19:46:15.473008] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-03. [2025-10-02T19:46:16.273009] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-10. [2025-10-02T19:46:16.503806] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-02T19:46:17.073070] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-05. [2025-10-02T19:46:17.242868] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-02T19:46:17.241419] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-02T19:46:17.254378] [INFO ] [REMOTE ] KBDC: Full fetch complete (28952 records). [2025-10-02T19:46:17.254877] [DEBUG] [VALIDATOR ] KBDC: Validating primary data. [2025-10-02T19:46:17.660268] [DEBUG] [VALIDATOR ] KBDC: All expected trading days are present. [2025-10-02T19:46:17.660356] [DEBUG] [VALIDATOR ] KBDC: Primary data validation passed. [2025-10-02T19:46:17.661026] [INFO ] [MAIN ] KBDC: Fetched primary data is valid. [2025-10-02T19:46:17.661092] [DEBUG] [LOCAL ] KBDC: Saving primary data. [2025-10-02T19:46:17.662067] [DEBUG] [LOCAL ] KBDC: Trimmed 28952 records to 21392 (keeping 200 days of data) [2025-10-02T19:46:17.797352] [DEBUG] [LOCAL ] KBDC: Primary data saved (21392 records). [2025-10-02T19:46:17.797484] [INFO ] [MAIN ] KBDC: Full history saved. [2025-10-02T19:46:17.797565] [INFO ] [MAIN ] Update Progress: 1178/2370 symbols completed. KBDC took 24.9s. Estimated remaining: 2h 48m 13s. Rate: 7.1 symbols/min [2025-10-02T19:46:17.880737] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-04. [2025-10-02T19:46:17.985266] [INFO ] [MAIN ] KEN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:46:17.992155] [DEBUG] [LOCAL ] KEN: Loaded 4732 existing records from primary storage. [2025-10-02T19:46:17.992356] [INFO ] [MAIN ] KEN: Loaded 4732 existing records. [2025-10-02T19:46:18.191793] [WARN ] [MAIN ] KEN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:46:18.192012] [INFO ] [MAIN ] KEN: Wiping existing primary data before full refresh. [2025-10-02T19:46:18.192084] [INFO ] [LOCAL ] KEN: Starting deletion of primary data. [2025-10-02T19:46:18.192347] [DEBUG] [LOCAL ] KEN: Deleted primary data file. [2025-10-02T19:46:18.192409] [INFO ] [MAIN ] KEN: Starting full primary refresh. [2025-10-02T19:46:18.655794] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-02T19:46:18.691240] [INFO ] [REMOTE ] KEN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:46:18.678583] [INFO ] [REMOTE ] KD: Fetching primary data for 2024-12. [2025-10-02T19:46:19.472985] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-06. [2025-10-02T19:46:19.522259] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-02T19:46:20.272983] [INFO ] [REMOTE ] KEN: Fetching primary data for 2024-12. [2025-10-02T19:46:20.309094] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-02T19:46:21.073000] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-01. [2025-10-02T19:46:21.091278] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-02T19:46:21.131417] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-02T19:46:21.873009] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-07. [2025-10-02T19:46:22.672998] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-05. [2025-10-02T19:46:22.900433] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-02T19:46:23.473024] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-01. [2025-10-02T19:46:23.525674] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-02T19:46:24.042812] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-02T19:46:24.122216] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-02T19:46:24.273029] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-02. [2025-10-02T19:46:25.073044] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-02. [2025-10-02T19:46:25.433801] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-02T19:46:25.739265] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-02T19:46:25.873034] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-08. [2025-10-02T19:46:26.673002] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-06. [2025-10-02T19:46:27.473044] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-03. [2025-10-02T19:46:27.623255] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-02T19:46:28.056425] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-02T19:46:28.089602] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-02T19:46:28.273023] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-07. [2025-10-02T19:46:29.073034] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-04. [2025-10-02T19:46:29.842961] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-02T19:46:29.873026] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-03. [2025-10-02T19:46:29.932830] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-02T19:46:30.673003] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-05. [2025-10-02T19:46:31.311124] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-02T19:46:31.472987] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-06. [2025-10-02T19:46:31.794323] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-02T19:46:32.172006] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-02T19:46:32.273000] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-09. [2025-10-02T19:46:33.073048] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-08. [2025-10-02T19:46:33.652264] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-02T19:46:33.873002] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-07. [2025-10-02T19:46:34.650588] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-02T19:46:34.678144] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-04. [2025-10-02T19:46:34.699277] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-02T19:46:35.473031] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-08. [2025-10-02T19:46:36.037584] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-02T19:46:36.273055] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-09. [2025-10-02T19:46:36.516898] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-02T19:46:36.629930] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-02T19:46:37.072999] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-05. [2025-10-02T19:46:37.873002] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-09. [2025-10-02T19:46:38.522040] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-02T19:46:38.673021] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-10. [2025-10-02T19:46:39.473037] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-06. [2025-10-02T19:46:39.560040] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-02T19:46:40.085333] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-02T19:46:40.087448] [INFO ] [REMOTE ] KBH: Full fetch complete (70724 records). [2025-10-02T19:46:40.087589] [DEBUG] [VALIDATOR ] KBH: Validating primary data. [2025-10-02T19:46:40.273340] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-10. [2025-10-02T19:46:40.544129] [DEBUG] [VALIDATOR ] KBH: All expected trading days are present. [2025-10-02T19:46:40.544364] [DEBUG] [VALIDATOR ] KBH: Primary data validation passed. [2025-10-02T19:46:40.545486] [INFO ] [MAIN ] KBH: Fetched primary data is valid. [2025-10-02T19:46:40.545621] [DEBUG] [LOCAL ] KBH: Saving primary data. [2025-10-02T19:46:40.547367] [DEBUG] [LOCAL ] KBH: Trimmed 70724 records to 49218 (keeping 200 days of data) [2025-10-02T19:46:40.868344] [DEBUG] [LOCAL ] KBH: Primary data saved (49218 records). [2025-10-02T19:46:40.868496] [INFO ] [MAIN ] KBH: Full history saved. [2025-10-02T19:46:40.870225] [INFO ] [MAIN ] Update Progress: 1179/2370 symbols completed. KBH took 44.4s. Estimated remaining: 2h 48m 19s. Rate: 7.1 symbols/min [2025-10-02T19:46:41.059036] [INFO ] [MAIN ] KEP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:46:41.074579] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-10. [2025-10-02T19:46:41.096553] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-02T19:46:41.134784] [DEBUG] [LOCAL ] KEP: Loaded 31109 existing records from primary storage. [2025-10-02T19:46:41.135088] [INFO ] [MAIN ] KEP: Loaded 31109 existing records. [2025-10-02T19:46:41.325117] [WARN ] [MAIN ] KEP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:46:41.325492] [INFO ] [MAIN ] KEP: Wiping existing primary data before full refresh. [2025-10-02T19:46:41.325611] [INFO ] [LOCAL ] KEP: Starting deletion of primary data. [2025-10-02T19:46:41.326610] [DEBUG] [LOCAL ] KEP: Deleted primary data file. [2025-10-02T19:46:41.326705] [INFO ] [MAIN ] KEP: Starting full primary refresh. [2025-10-02T19:46:41.590431] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-02T19:46:41.606295] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-02T19:46:41.617006] [INFO ] [REMOTE ] KEN: Full fetch complete (5943 records). [2025-10-02T19:46:41.637454] [DEBUG] [VALIDATOR ] KEN: Validating primary data. [2025-10-02T19:46:41.643256] [INFO ] [REMOTE ] KBR: Full fetch complete (69809 records). [2025-10-02T19:46:41.659256] [DEBUG] [VALIDATOR ] KBR: Validating primary data. [2025-10-02T19:46:41.820618] [INFO ] [REMOTE ] KEP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:46:41.882166] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-07. [2025-10-02T19:46:42.574732] [DEBUG] [VALIDATOR ] KEN: All expected trading days are present. [2025-10-02T19:46:42.578576] [DEBUG] [VALIDATOR ] KBR: All expected trading days are present. [2025-10-02T19:46:42.578444] [DEBUG] [VALIDATOR ] KEN: Primary data validation passed. [2025-10-02T19:46:42.578931] [INFO ] [MAIN ] KEN: Fetched primary data is valid. [2025-10-02T19:46:42.578984] [DEBUG] [VALIDATOR ] KBR: Primary data validation passed. [2025-10-02T19:46:42.579097] [DEBUG] [LOCAL ] KEN: Saving primary data. [2025-10-02T19:46:42.580106] [INFO ] [MAIN ] KBR: Fetched primary data is valid. [2025-10-02T19:46:42.580380] [DEBUG] [LOCAL ] KBR: Saving primary data. [2025-10-02T19:46:42.581182] [DEBUG] [LOCAL ] KEN: Trimmed 5943 records to 4749 (keeping 200 days of data) [2025-10-02T19:46:42.603225] [DEBUG] [LOCAL ] KBR: Trimmed 69809 records to 48339 (keeping 200 days of data) [2025-10-02T19:46:42.698729] [INFO ] [REMOTE ] KEP: Fetching primary data for 2024-12. [2025-10-02T19:46:42.710113] [DEBUG] [LOCAL ] KEN: Primary data saved (4749 records). [2025-10-02T19:46:42.714497] [INFO ] [MAIN ] KEN: Full history saved. [2025-10-02T19:46:42.715347] [INFO ] [MAIN ] Update Progress: 1180/2370 symbols completed. KEN took 24.9s. Estimated remaining: 2h 48m 4s. Rate: 7.1 symbols/min [2025-10-02T19:46:42.963953] [INFO ] [MAIN ] KEX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:46:43.115762] [DEBUG] [LOCAL ] KEX: Loaded 38135 existing records from primary storage. [2025-10-02T19:46:43.117381] [INFO ] [MAIN ] KEX: Loaded 38135 existing records. [2025-10-02T19:46:43.331314] [WARN ] [MAIN ] KEX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:46:43.334856] [INFO ] [MAIN ] KEX: Wiping existing primary data before full refresh. [2025-10-02T19:46:43.334981] [INFO ] [LOCAL ] KEX: Starting deletion of primary data. [2025-10-02T19:46:43.357203] [DEBUG] [LOCAL ] KEX: Deleted primary data file. [2025-10-02T19:46:43.372809] [INFO ] [MAIN ] KEX: Starting full primary refresh. [2025-10-02T19:46:43.687185] [DEBUG] [LOCAL ] KBR: Primary data saved (48339 records). [2025-10-02T19:46:43.708331] [INFO ] [MAIN ] KBR: Full history saved. [2025-10-02T19:46:43.712738] [INFO ] [MAIN ] Update Progress: 1181/2370 symbols completed. KBR took 39.2s. Estimated remaining: 2h 47m 48s. Rate: 7.1 symbols/min [2025-10-02T19:46:43.896305] [INFO ] [REMOTE ] KEX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:46:43.916894] [INFO ] [REMOTE ] KEX: Fetching primary data for 2024-12. [2025-10-02T19:46:44.040998] [INFO ] [MAIN ] KEY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:46:44.041583] [DEBUG] [LOCAL ] KEY: No existing data file found in primary storage. [2025-10-02T19:46:44.041764] [WARN ] [MAIN ] KEY: No existing data found, performing full refresh instead. [2025-10-02T19:46:44.042142] [INFO ] [MAIN ] KEY: Wiping existing primary data before full refresh. [2025-10-02T19:46:44.042555] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-02T19:46:44.042702] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-02T19:46:44.050326] [INFO ] [MAIN ] KEY: Starting full primary refresh. [2025-10-02T19:46:44.087274] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-02T19:46:44.281518] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-01. [2025-10-02T19:46:44.331481] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-10-02T19:46:44.547863] [INFO ] [REMOTE ] KEY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:46:45.073005] [INFO ] [REMOTE ] KEY: Fetching primary data for 2024-12. [2025-10-02T19:46:45.201048] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-02T19:46:45.264038] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-02T19:46:45.873008] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-01. [2025-10-02T19:46:46.672968] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-02. [2025-10-02T19:46:46.953082] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-02T19:46:47.402037] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-02T19:46:47.472996] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-08. [2025-10-02T19:46:47.771467] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-02T19:46:48.272994] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-03. [2025-10-02T19:46:49.047843] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-02T19:46:49.072958] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-04. [2025-10-02T19:46:49.133906] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-02T19:46:49.872996] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-01. [2025-10-02T19:46:50.321345] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-02T19:46:50.673026] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-09. [2025-10-02T19:46:51.447837] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-02T19:46:51.473015] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-02. [2025-10-02T19:46:52.272993] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-02. [2025-10-02T19:46:52.543183] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-02T19:46:52.972881] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-02T19:46:53.072980] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-05. [2025-10-02T19:46:53.872975] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-10. [2025-10-02T19:46:54.001051] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-02T19:46:54.357959] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-02T19:46:54.673017] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-03. [2025-10-02T19:46:55.167956] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-02T19:46:55.170832] [INFO ] [REMOTE ] KD: Full fetch complete (75650 records). [2025-10-02T19:46:55.171069] [DEBUG] [VALIDATOR ] KD: Validating primary data. [2025-10-02T19:46:55.481513] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-03. [2025-10-02T19:46:55.618296] [DEBUG] [VALIDATOR ] KD: All expected trading days are present. [2025-10-02T19:46:55.618388] [DEBUG] [VALIDATOR ] KD: Primary data validation passed. [2025-10-02T19:46:55.619465] [INFO ] [MAIN ] KD: Fetched primary data is valid. [2025-10-02T19:46:55.619574] [DEBUG] [LOCAL ] KD: Saving primary data. [2025-10-02T19:46:55.621202] [DEBUG] [LOCAL ] KD: Trimmed 75650 records to 52682 (keeping 200 days of data) [2025-10-02T19:46:55.956967] [DEBUG] [LOCAL ] KD: Primary data saved (52682 records). [2025-10-02T19:46:55.957119] [INFO ] [MAIN ] KD: Full history saved. [2025-10-02T19:46:55.957250] [INFO ] [MAIN ] Update Progress: 1182/2370 symbols completed. KD took 42.3s. Estimated remaining: 2h 47m 43s. Rate: 7.1 symbols/min [2025-10-02T19:46:56.143318] [INFO ] [MAIN ] KEYS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:46:56.189267] [DEBUG] [LOCAL ] KEYS: Loaded 43152 existing records from primary storage. [2025-10-02T19:46:56.189595] [INFO ] [MAIN ] KEYS: Loaded 43152 existing records. [2025-10-02T19:46:56.277309] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-06. [2025-10-02T19:46:56.410219] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-02T19:46:56.416024] [WARN ] [MAIN ] KEYS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:46:56.424513] [INFO ] [MAIN ] KEYS: Wiping existing primary data before full refresh. [2025-10-02T19:46:56.425079] [INFO ] [LOCAL ] KEYS: Starting deletion of primary data. [2025-10-02T19:46:56.426375] [DEBUG] [LOCAL ] KEYS: Deleted primary data file. [2025-10-02T19:46:56.426454] [INFO ] [MAIN ] KEYS: Starting full primary refresh. [2025-10-02T19:46:56.847397] [INFO ] [REMOTE ] KEYS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:46:57.073024] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-04. [2025-10-02T19:46:57.369409] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-02T19:46:57.501796] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-02T19:46:57.873033] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2024-12. [2025-10-02T19:46:58.610793] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-02T19:46:58.673026] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-05. [2025-10-02T19:46:59.472978] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-04. [2025-10-02T19:46:59.521795] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-02T19:47:00.180288] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-02T19:47:00.272946] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-06. [2025-10-02T19:47:01.073020] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-01. [2025-10-02T19:47:01.488206] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-02T19:47:01.526629] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-02T19:47:01.873062] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-07. [2025-10-02T19:47:02.672995] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-07. [2025-10-02T19:47:03.473052] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-05. [2025-10-02T19:47:04.134044] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-02T19:47:04.273031] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-08. [2025-10-02T19:47:05.258373] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-02T19:47:05.270764] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-06. [2025-10-02T19:47:05.313965] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-01 (4.24 seconds). [2025-10-02T19:47:05.873029] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-02. [2025-10-02T19:47:05.963005] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-02T19:47:06.604776] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-07 (4.73 seconds). [2025-10-02T19:47:06.673047] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-09. [2025-10-02T19:47:06.961333] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-02T19:47:07.073290] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-02T19:47:07.473019] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-08. [2025-10-02T19:47:08.051749] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-02T19:47:08.273069] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-03. [2025-10-02T19:47:08.959487] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-02T19:47:09.072999] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-09. [2025-10-02T19:47:09.872974] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-07. [2025-10-02T19:47:09.917691] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-02T19:47:10.073271] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-02T19:47:10.672995] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-04. [2025-10-02T19:47:11.473058] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-10. [2025-10-02T19:47:11.742220] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-02T19:47:12.273020] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-10. [2025-10-02T19:47:12.412111] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-02T19:47:12.545153] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-02T19:47:12.547687] [INFO ] [REMOTE ] KEP: Full fetch complete (41742 records). [2025-10-02T19:47:12.547776] [DEBUG] [VALIDATOR ] KEP: Validating primary data. [2025-10-02T19:47:12.966899] [DEBUG] [VALIDATOR ] KEP: All expected trading days are present. [2025-10-02T19:47:12.966983] [DEBUG] [VALIDATOR ] KEP: Primary data validation passed. [2025-10-02T19:47:12.967685] [INFO ] [MAIN ] KEP: Fetched primary data is valid. [2025-10-02T19:47:12.967748] [DEBUG] [LOCAL ] KEP: Saving primary data. [2025-10-02T19:47:12.968797] [DEBUG] [LOCAL ] KEP: Trimmed 41742 records to 31283 (keeping 200 days of data) [2025-10-02T19:47:13.073539] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-05. [2025-10-02T19:47:13.189593] [DEBUG] [LOCAL ] KEP: Primary data saved (31283 records). [2025-10-02T19:47:13.189792] [INFO ] [MAIN ] KEP: Full history saved. [2025-10-02T19:47:13.191936] [INFO ] [MAIN ] Update Progress: 1183/2370 symbols completed. KEP took 32.3s. Estimated remaining: 2h 47m 43s. Rate: 7.1 symbols/min [2025-10-02T19:47:13.391250] [INFO ] [MAIN ] KF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:47:13.397000] [DEBUG] [LOCAL ] KF: Loaded 2447 existing records from primary storage. [2025-10-02T19:47:13.397308] [INFO ] [MAIN ] KF: Loaded 2447 existing records. [2025-10-02T19:47:13.606909] [WARN ] [MAIN ] KF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:47:13.607161] [INFO ] [MAIN ] KF: Wiping existing primary data before full refresh. [2025-10-02T19:47:13.607252] [INFO ] [LOCAL ] KF: Starting deletion of primary data. [2025-10-02T19:47:13.607500] [DEBUG] [LOCAL ] KF: Deleted primary data file. [2025-10-02T19:47:13.607603] [INFO ] [MAIN ] KF: Starting full primary refresh. [2025-10-02T19:47:13.700042] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-02T19:47:13.731211] [INFO ] [REMOTE ] KEX: Full fetch complete (55839 records). [2025-10-02T19:47:13.746933] [DEBUG] [VALIDATOR ] KEX: Validating primary data. [2025-10-02T19:47:13.874533] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-08. [2025-10-02T19:47:14.246399] [INFO ] [REMOTE ] KF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:47:14.473377] [DEBUG] [VALIDATOR ] KEX: All expected trading days are present. [2025-10-02T19:47:14.473500] [DEBUG] [VALIDATOR ] KEX: Primary data validation passed. [2025-10-02T19:47:14.474465] [INFO ] [MAIN ] KEX: Fetched primary data is valid. [2025-10-02T19:47:14.474563] [DEBUG] [LOCAL ] KEX: Saving primary data. [2025-10-02T19:47:14.476505] [DEBUG] [LOCAL ] KEX: Trimmed 55839 records to 38410 (keeping 200 days of data) [2025-10-02T19:47:14.558984] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-02T19:47:14.689886] [INFO ] [REMOTE ] KF: Fetching primary data for 2024-12. [2025-10-02T19:47:14.757685] [DEBUG] [LOCAL ] KEX: Primary data saved (38410 records). [2025-10-02T19:47:14.757853] [INFO ] [MAIN ] KEX: Full history saved. [2025-10-02T19:47:14.757949] [INFO ] [MAIN ] Update Progress: 1184/2370 symbols completed. KEX took 32.0s. Estimated remaining: 2h 47m 28s. Rate: 7.1 symbols/min [2025-10-02T19:47:14.940370] [INFO ] [MAIN ] KFRC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:47:14.960889] [DEBUG] [LOCAL ] KFRC: Loaded 19595 existing records from primary storage. [2025-10-02T19:47:14.961192] [INFO ] [MAIN ] KFRC: Loaded 19595 existing records. [2025-10-02T19:47:15.155891] [WARN ] [MAIN ] KFRC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:47:15.160116] [INFO ] [MAIN ] KFRC: Wiping existing primary data before full refresh. [2025-10-02T19:47:15.160789] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-02T19:47:15.160616] [INFO ] [LOCAL ] KFRC: Starting deletion of primary data. [2025-10-02T19:47:15.163273] [DEBUG] [LOCAL ] KFRC: Deleted primary data file. [2025-10-02T19:47:15.163337] [INFO ] [MAIN ] KFRC: Starting full primary refresh. [2025-10-02T19:47:15.478165] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-06. [2025-10-02T19:47:15.555181] [INFO ] [REMOTE ] KFRC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:47:16.116977] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-10-02T19:47:16.273054] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2024-12. [2025-10-02T19:47:16.892046] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-02T19:47:17.073003] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-01. [2025-10-02T19:47:17.155369] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-02T19:47:17.389685] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-02T19:47:17.873033] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-01. [2025-10-02T19:47:18.673046] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-09. [2025-10-02T19:47:18.720359] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-02T19:47:19.473064] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-02. [2025-10-02T19:47:20.272988] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-07. [2025-10-02T19:47:20.382086] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-02T19:47:20.462770] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-02T19:47:21.073016] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-03. [2025-10-02T19:47:21.591051] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-02T19:47:21.872984] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-02. [2025-10-02T19:47:22.077777] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-02T19:47:22.291463] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-02T19:47:22.673011] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-08. [2025-10-02T19:47:23.473003] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-03. [2025-10-02T19:47:23.963893] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-02T19:47:24.018388] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-02T19:47:24.273014] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-10. [2025-10-02T19:47:25.073021] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-04. [2025-10-02T19:47:25.423944] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-02T19:47:25.594931] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-02T19:47:25.597424] [INFO ] [REMOTE ] KEY: Full fetch complete (77257 records). [2025-10-02T19:47:25.597837] [DEBUG] [VALIDATOR ] KEY: Validating primary data. [2025-10-02T19:47:25.818449] [WARN ] [VALIDATOR ] KEY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-02T19:47:25.819323] [FATAL] [MAIN ] KEY: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:47:25.819399] [WARN ] [MAIN ] KEY: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:47:25.819473] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-02T19:47:25.819544] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-02T19:47:25.819581] [INFO ] [LOCAL ] KEY: Starting deletion of derivative data. [2025-10-02T19:47:25.819637] [DEBUG] [LOCAL ] KEY: No derivative data file found to delete. [2025-10-02T19:47:25.819784] [INFO ] [MAIN ] Update Progress: 1185/2370 symbols completed. KEY took 42.1s. Estimated remaining: 2h 47m 22s. Rate: 7.1 symbols/min [2025-10-02T19:47:25.879693] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-05. [2025-10-02T19:47:26.036582] [INFO ] [MAIN ] KFS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:47:26.048084] [DEBUG] [LOCAL ] KFS: Loaded 8478 existing records from primary storage. [2025-10-02T19:47:26.048572] [INFO ] [MAIN ] KFS: Loaded 8478 existing records. [2025-10-02T19:47:26.238108] [WARN ] [MAIN ] KFS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:47:26.238380] [INFO ] [MAIN ] KFS: Wiping existing primary data before full refresh. [2025-10-02T19:47:26.238438] [INFO ] [LOCAL ] KFS: Starting deletion of primary data. [2025-10-02T19:47:26.238859] [DEBUG] [LOCAL ] KFS: Deleted primary data file. [2025-10-02T19:47:26.238920] [INFO ] [MAIN ] KFS: Starting full primary refresh. [2025-10-02T19:47:26.359456] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-02T19:47:26.632100] [INFO ] [REMOTE ] KFS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:47:26.673009] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-09. [2025-10-02T19:47:27.473010] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-06. [2025-10-02T19:47:28.186752] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-02T19:47:28.220852] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-02T19:47:28.273013] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-04. [2025-10-02T19:47:29.073072] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-10. [2025-10-02T19:47:29.376973] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-02T19:47:29.873048] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-05. [2025-10-02T19:47:30.128042] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-02T19:47:30.129986] [INFO ] [REMOTE ] KEYS: Full fetch complete (62841 records). [2025-10-02T19:47:30.130125] [DEBUG] [VALIDATOR ] KEYS: Validating primary data. [2025-10-02T19:47:30.558046] [DEBUG] [VALIDATOR ] KEYS: All expected trading days are present. [2025-10-02T19:47:30.558292] [DEBUG] [VALIDATOR ] KEYS: Primary data validation passed. [2025-10-02T19:47:30.559624] [INFO ] [MAIN ] KEYS: Fetched primary data is valid. [2025-10-02T19:47:30.559845] [DEBUG] [LOCAL ] KEYS: Saving primary data. [2025-10-02T19:47:30.561634] [DEBUG] [LOCAL ] KEYS: Trimmed 62841 records to 43450 (keeping 200 days of data) [2025-10-02T19:47:30.674711] [INFO ] [REMOTE ] KFS: Fetching primary data for 2024-12. [2025-10-02T19:47:30.681266] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-02T19:47:30.866678] [DEBUG] [LOCAL ] KEYS: Primary data saved (43450 records). [2025-10-02T19:47:30.866824] [INFO ] [MAIN ] KEYS: Full history saved. [2025-10-02T19:47:30.866932] [INFO ] [MAIN ] Update Progress: 1186/2370 symbols completed. KEYS took 34.9s. Estimated remaining: 2h 47m 10s. Rate: 7.1 symbols/min [2025-10-02T19:47:31.058803] [INFO ] [MAIN ] KFY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:47:31.089887] [DEBUG] [LOCAL ] KFY: Loaded 29999 existing records from primary storage. [2025-10-02T19:47:31.090200] [INFO ] [MAIN ] KFY: Loaded 29999 existing records. [2025-10-02T19:47:31.288612] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-02T19:47:31.292683] [WARN ] [MAIN ] KFY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:47:31.294915] [INFO ] [MAIN ] KFY: Wiping existing primary data before full refresh. [2025-10-02T19:47:31.294967] [INFO ] [LOCAL ] KFY: Starting deletion of primary data. [2025-10-02T19:47:31.295611] [DEBUG] [LOCAL ] KFY: Deleted primary data file. [2025-10-02T19:47:31.295701] [INFO ] [MAIN ] KFY: Starting full primary refresh. [2025-10-02T19:47:31.487610] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-07. [2025-10-02T19:47:31.710371] [INFO ] [REMOTE ] KFY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:47:32.059915] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-02T19:47:32.273032] [INFO ] [REMOTE ] KFY: Fetching primary data for 2024-12. [2025-10-02T19:47:33.073024] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-08. [2025-10-02T19:47:33.648438] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-02T19:47:33.670206] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-02T19:47:33.873005] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-06. [2025-10-02T19:47:34.671363] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-02T19:47:34.675377] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-09. [2025-10-02T19:47:35.138029] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-02T19:47:35.473101] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-01. [2025-10-02T19:47:36.077178] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-02T19:47:36.272998] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-01. [2025-10-02T19:47:37.072979] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-10. [2025-10-02T19:47:37.468339] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-02T19:47:37.469701] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-02T19:47:37.470576] [INFO ] [REMOTE ] KF: Full fetch complete (3564 records). [2025-10-02T19:47:37.476463] [DEBUG] [VALIDATOR ] KF: Validating primary data. [2025-10-02T19:47:37.879639] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-02. [2025-10-02T19:47:37.889117] [DEBUG] [VALIDATOR ] KF: All expected trading days are present. [2025-10-02T19:47:37.889202] [DEBUG] [VALIDATOR ] KF: Primary data validation passed. [2025-10-02T19:47:37.889395] [INFO ] [MAIN ] KF: Fetched primary data is valid. [2025-10-02T19:47:37.889477] [DEBUG] [LOCAL ] KF: Saving primary data. [2025-10-02T19:47:37.890004] [DEBUG] [LOCAL ] KF: Trimmed 3564 records to 2452 (keeping 200 days of data) [2025-10-02T19:47:37.908699] [DEBUG] [LOCAL ] KF: Primary data saved (2452 records). [2025-10-02T19:47:37.908804] [INFO ] [MAIN ] KF: Full history saved. [2025-10-02T19:47:37.909056] [INFO ] [MAIN ] Update Progress: 1187/2370 symbols completed. KF took 24.7s. Estimated remaining: 2h 47m 0s. Rate: 7.1 symbols/min [2025-10-02T19:47:38.093491] [INFO ] [MAIN ] KGC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:47:38.160370] [DEBUG] [LOCAL ] KGC: Loaded 53699 existing records from primary storage. [2025-10-02T19:47:38.160766] [INFO ] [MAIN ] KGC: Loaded 53699 existing records. [2025-10-02T19:47:38.356674] [WARN ] [MAIN ] KGC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:47:38.356906] [INFO ] [MAIN ] KGC: Wiping existing primary data before full refresh. [2025-10-02T19:47:38.356956] [INFO ] [LOCAL ] KGC: Starting deletion of primary data. [2025-10-02T19:47:38.358503] [DEBUG] [LOCAL ] KGC: Deleted primary data file. [2025-10-02T19:47:38.358580] [INFO ] [MAIN ] KGC: Starting full primary refresh. [2025-10-02T19:47:38.678154] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-07. [2025-10-02T19:47:38.758861] [INFO ] [REMOTE ] KGC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:47:39.010177] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-02T19:47:39.472979] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-03. [2025-10-02T19:47:39.766825] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-02T19:47:40.273007] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-08. [2025-10-02T19:47:40.633337] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-02T19:47:41.073001] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-04. [2025-10-02T19:47:41.450962] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-02T19:47:41.872999] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-09. [2025-10-02T19:47:42.513730] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-02T19:47:42.673018] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-02. [2025-10-02T19:47:43.026566] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-02T19:47:43.073804] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-02T19:47:43.473008] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-03. [2025-10-02T19:47:44.075175] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-02T19:47:44.273009] [INFO ] [REMOTE ] KGC: Fetching primary data for 2024-12. [2025-10-02T19:47:45.073010] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-04. [2025-10-02T19:47:45.873023] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-10. [2025-10-02T19:47:45.970172] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-02T19:47:46.176380] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-02T19:47:46.673018] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-05. [2025-10-02T19:47:46.788952] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-02T19:47:46.790178] [INFO ] [REMOTE ] KFRC: Full fetch complete (25704 records). [2025-10-02T19:47:46.790258] [DEBUG] [VALIDATOR ] KFRC: Validating primary data. [2025-10-02T19:47:47.208194] [DEBUG] [VALIDATOR ] KFRC: All expected trading days are present. [2025-10-02T19:47:47.208289] [DEBUG] [VALIDATOR ] KFRC: Primary data validation passed. [2025-10-02T19:47:47.208913] [INFO ] [MAIN ] KFRC: Fetched primary data is valid. [2025-10-02T19:47:47.208982] [DEBUG] [LOCAL ] KFRC: Saving primary data. [2025-10-02T19:47:47.209886] [DEBUG] [LOCAL ] KFRC: Trimmed 25704 records to 19732 (keeping 200 days of data) [2025-10-02T19:47:47.338478] [DEBUG] [LOCAL ] KFRC: Primary data saved (19732 records). [2025-10-02T19:47:47.338761] [INFO ] [MAIN ] KFRC: Full history saved. [2025-10-02T19:47:47.338902] [INFO ] [MAIN ] Update Progress: 1188/2370 symbols completed. KFRC took 32.6s. Estimated remaining: 2h 46m 53s. Rate: 7.1 symbols/min [2025-10-02T19:47:47.489564] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-05. [2025-10-02T19:47:47.525978] [INFO ] [MAIN ] KGS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:47:47.574085] [DEBUG] [LOCAL ] KGS: Loaded 45668 existing records from primary storage. [2025-10-02T19:47:47.574394] [INFO ] [MAIN ] KGS: Loaded 45668 existing records. [2025-10-02T19:47:47.767977] [WARN ] [MAIN ] KGS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:47:47.768492] [INFO ] [MAIN ] KGS: Wiping existing primary data before full refresh. [2025-10-02T19:47:47.768681] [INFO ] [LOCAL ] KGS: Starting deletion of primary data. [2025-10-02T19:47:47.770005] [DEBUG] [LOCAL ] KGS: Deleted primary data file. [2025-10-02T19:47:47.770070] [INFO ] [MAIN ] KGS: Starting full primary refresh. [2025-10-02T19:47:48.070793] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-02T19:47:48.194482] [INFO ] [REMOTE ] KGS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:47:48.272989] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-06. [2025-10-02T19:47:48.356629] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-02T19:47:49.073003] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-06. [2025-10-02T19:47:49.645893] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-02T19:47:49.856311] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-02T19:47:49.872961] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-07. [2025-10-02T19:47:50.621778] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-02T19:47:50.673011] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-08. [2025-10-02T19:47:51.405815] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-02T19:47:51.473060] [INFO ] [REMOTE ] KGS: Fetching primary data for 2024-12. [2025-10-02T19:47:52.272973] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-07. [2025-10-02T19:47:53.075740] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-01. [2025-10-02T19:47:53.092782] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-02T19:47:53.542318] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-02T19:47:53.872997] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-01. [2025-10-02T19:47:54.670138] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-02T19:47:54.680389] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-09. [2025-10-02T19:47:55.101417] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-02T19:47:55.473040] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-02. [2025-10-02T19:47:55.472833] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-02T19:47:56.273041] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-10. [2025-10-02T19:47:57.028202] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-02T19:47:57.029081] [INFO ] [REMOTE ] KFS: Full fetch complete (10584 records). [2025-10-02T19:47:57.029158] [DEBUG] [VALIDATOR ] KFS: Validating primary data. [2025-10-02T19:47:57.078469] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-02. [2025-10-02T19:47:57.444899] [DEBUG] [VALIDATOR ] KFS: All expected trading days are present. [2025-10-02T19:47:57.445049] [DEBUG] [VALIDATOR ] KFS: Primary data validation passed. [2025-10-02T19:47:57.445383] [INFO ] [MAIN ] KFS: Fetched primary data is valid. [2025-10-02T19:47:57.445480] [DEBUG] [LOCAL ] KFS: Saving primary data. [2025-10-02T19:47:57.446387] [DEBUG] [LOCAL ] KFS: Trimmed 10584 records to 8523 (keeping 200 days of data) [2025-10-02T19:47:57.511576] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-02T19:47:57.548775] [DEBUG] [LOCAL ] KFS: Primary data saved (8523 records). [2025-10-02T19:47:57.549357] [INFO ] [MAIN ] KFS: Full history saved. [2025-10-02T19:47:57.549482] [INFO ] [MAIN ] Update Progress: 1189/2370 symbols completed. KFS took 31.7s. Estimated remaining: 2h 46m 46s. Rate: 7.1 symbols/min [2025-10-02T19:47:57.731971] [INFO ] [MAIN ] KIM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:47:57.797200] [DEBUG] [LOCAL ] KIM: Loaded 53045 existing records from primary storage. [2025-10-02T19:47:57.797631] [INFO ] [MAIN ] KIM: Loaded 53045 existing records. [2025-10-02T19:47:57.880446] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-03. [2025-10-02T19:47:57.996033] [WARN ] [MAIN ] KIM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:47:57.996282] [INFO ] [MAIN ] KIM: Wiping existing primary data before full refresh. [2025-10-02T19:47:57.996340] [INFO ] [LOCAL ] KIM: Starting deletion of primary data. [2025-10-02T19:47:57.997816] [DEBUG] [LOCAL ] KIM: Deleted primary data file. [2025-10-02T19:47:57.997886] [INFO ] [MAIN ] KIM: Starting full primary refresh. [2025-10-02T19:47:58.385170] [INFO ] [REMOTE ] KIM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:47:58.647139] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-02T19:47:58.672968] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-03. [2025-10-02T19:47:59.472974] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-08. [2025-10-02T19:47:59.971268] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-02T19:48:00.003328] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-02T19:48:00.273011] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-04. [2025-10-02T19:48:00.639092] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-02T19:48:01.073084] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-04. [2025-10-02T19:48:01.873043] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-09. [2025-10-02T19:48:02.241540] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-02T19:48:02.673000] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-05. [2025-10-02T19:48:03.018506] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-02T19:48:03.473158] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-10. [2025-10-02T19:48:03.581449] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-04 (2.51 seconds). [2025-10-02T19:48:03.966048] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-02T19:48:04.273025] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-05. [2025-10-02T19:48:04.534116] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-02T19:48:04.535736] [INFO ] [REMOTE ] KFY: Full fetch complete (43491 records). [2025-10-02T19:48:04.535842] [DEBUG] [VALIDATOR ] KFY: Validating primary data. [2025-10-02T19:48:04.968684] [DEBUG] [VALIDATOR ] KFY: All expected trading days are present. [2025-10-02T19:48:04.968794] [DEBUG] [VALIDATOR ] KFY: Primary data validation passed. [2025-10-02T19:48:04.969519] [INFO ] [MAIN ] KFY: Fetched primary data is valid. [2025-10-02T19:48:04.969598] [DEBUG] [LOCAL ] KFY: Saving primary data. [2025-10-02T19:48:04.970795] [DEBUG] [LOCAL ] KFY: Trimmed 43491 records to 30268 (keeping 200 days of data) [2025-10-02T19:48:05.073299] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-06. [2025-10-02T19:48:05.178343] [DEBUG] [LOCAL ] KFY: Primary data saved (30268 records). [2025-10-02T19:48:05.178492] [INFO ] [MAIN ] KFY: Full history saved. [2025-10-02T19:48:05.178602] [INFO ] [MAIN ] Update Progress: 1190/2370 symbols completed. KFY took 34.3s. Estimated remaining: 2h 46m 37s. Rate: 7.1 symbols/min [2025-10-02T19:48:05.361978] [INFO ] [MAIN ] KIO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:48:05.384070] [DEBUG] [LOCAL ] KIO: Loaded 21220 existing records from primary storage. [2025-10-02T19:48:05.384343] [INFO ] [MAIN ] KIO: Loaded 21220 existing records. [2025-10-02T19:48:05.571925] [WARN ] [MAIN ] KIO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:48:05.572127] [INFO ] [MAIN ] KIO: Wiping existing primary data before full refresh. [2025-10-02T19:48:05.572176] [INFO ] [LOCAL ] KIO: Starting deletion of primary data. [2025-10-02T19:48:05.572864] [DEBUG] [LOCAL ] KIO: Deleted primary data file. [2025-10-02T19:48:05.572925] [INFO ] [MAIN ] KIO: Starting full primary refresh. [2025-10-02T19:48:05.878085] [INFO ] [REMOTE ] KIM: Fetching primary data for 2024-12. [2025-10-02T19:48:05.959409] [INFO ] [REMOTE ] KIO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:48:06.415075] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-02T19:48:06.555473] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-02T19:48:06.673000] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-07. [2025-10-02T19:48:07.473016] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-06. [2025-10-02T19:48:07.674200] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-02T19:48:08.278227] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-01. [2025-10-02T19:48:08.293249] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-02T19:48:09.073001] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-08. [2025-10-02T19:48:09.463569] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-02T19:48:09.872985] [INFO ] [REMOTE ] KIO: Fetching primary data for 2024-12. [2025-10-02T19:48:10.056374] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-02T19:48:10.580181] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-02T19:48:10.673067] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-01. [2025-10-02T19:48:10.725686] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-02T19:48:11.472976] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-02. [2025-10-02T19:48:11.848216] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-02T19:48:12.273017] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-09. [2025-10-02T19:48:13.072997] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-02. [2025-10-02T19:48:13.822181] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-10-02T19:48:13.874273] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-03. [2025-10-02T19:48:13.894830] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-02T19:48:14.111917] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-02T19:48:14.673052] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-10. [2025-10-02T19:48:15.472972] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-03. [2025-10-02T19:48:15.829509] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-02T19:48:15.895307] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-02T19:48:15.897416] [INFO ] [REMOTE ] KGS: Full fetch complete (66336 records). [2025-10-02T19:48:15.897591] [DEBUG] [VALIDATOR ] KGS: Validating primary data. [2025-10-02T19:48:16.279599] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-07. [2025-10-02T19:48:16.340209] [DEBUG] [VALIDATOR ] KGS: All expected trading days are present. [2025-10-02T19:48:16.340299] [DEBUG] [VALIDATOR ] KGS: Primary data validation passed. [2025-10-02T19:48:16.341286] [INFO ] [MAIN ] KGS: Fetched primary data is valid. [2025-10-02T19:48:16.341363] [DEBUG] [LOCAL ] KGS: Saving primary data. [2025-10-02T19:48:16.342947] [DEBUG] [LOCAL ] KGS: Trimmed 66336 records to 46001 (keeping 200 days of data) [2025-10-02T19:48:16.579624] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-02T19:48:16.656794] [DEBUG] [LOCAL ] KGS: Primary data saved (46001 records). [2025-10-02T19:48:16.656928] [INFO ] [MAIN ] KGS: Full history saved. [2025-10-02T19:48:16.657012] [INFO ] [MAIN ] Update Progress: 1191/2370 symbols completed. KGS took 29.3s. Estimated remaining: 2h 46m 31s. Rate: 7.1 symbols/min [2025-10-02T19:48:16.841743] [INFO ] [MAIN ] KKR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:48:16.899122] [DEBUG] [LOCAL ] KKR: Loaded 53500 existing records from primary storage. [2025-10-02T19:48:16.899457] [INFO ] [MAIN ] KKR: Loaded 53500 existing records. [2025-10-02T19:48:17.091267] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-04. [2025-10-02T19:48:17.097257] [WARN ] [MAIN ] KKR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:48:17.097472] [INFO ] [MAIN ] KKR: Wiping existing primary data before full refresh. [2025-10-02T19:48:17.097540] [INFO ] [LOCAL ] KKR: Starting deletion of primary data. [2025-10-02T19:48:17.099741] [DEBUG] [LOCAL ] KKR: Deleted primary data file. [2025-10-02T19:48:17.099844] [INFO ] [MAIN ] KKR: Starting full primary refresh. [2025-10-02T19:48:17.470319] [INFO ] [REMOTE ] KKR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:48:17.873004] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-04. [2025-10-02T19:48:18.192021] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-02T19:48:18.451130] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-02T19:48:18.673053] [INFO ] [REMOTE ] KKR: Fetching primary data for 2024-12. [2025-10-02T19:48:19.218802] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-02T19:48:19.473015] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-05. [2025-10-02T19:48:20.273043] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-08. [2025-10-02T19:48:20.597233] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-02T19:48:21.073036] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-01. [2025-10-02T19:48:21.292265] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-02T19:48:21.873028] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-05. [2025-10-02T19:48:22.270493] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-02T19:48:22.672987] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-06. [2025-10-02T19:48:22.860820] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-02T19:48:22.955828] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-02T19:48:23.472992] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-02. [2025-10-02T19:48:24.235221] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-02T19:48:24.273018] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-06. [2025-10-02T19:48:24.973388] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-02T19:48:25.073063] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-09. [2025-10-02T19:48:25.271509] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-02T19:48:25.873079] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-07. [2025-10-02T19:48:26.672961] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-07. [2025-10-02T19:48:27.010444] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-02T19:48:27.174570] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-02T19:48:27.473034] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-10. [2025-10-02T19:48:28.272999] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-03. [2025-10-02T19:48:28.439080] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-02T19:48:29.073052] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-08. [2025-10-02T19:48:29.453362] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-02T19:48:29.455764] [INFO ] [REMOTE ] KGC: Full fetch complete (77696 records). [2025-10-02T19:48:29.456104] [DEBUG] [VALIDATOR ] KGC: Validating primary data. [2025-10-02T19:48:29.876540] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-08. [2025-10-02T19:48:29.896716] [DEBUG] [VALIDATOR ] KGC: All expected trading days are present. [2025-10-02T19:48:29.897919] [DEBUG] [VALIDATOR ] KGC: Primary data validation passed. [2025-10-02T19:48:29.899072] [INFO ] [MAIN ] KGC: Fetched primary data is valid. [2025-10-02T19:48:29.899293] [DEBUG] [LOCAL ] KGC: Saving primary data. [2025-10-02T19:48:29.901245] [DEBUG] [LOCAL ] KGC: Trimmed 77696 records to 54089 (keeping 200 days of data) [2025-10-02T19:48:30.196210] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-02T19:48:30.300479] [DEBUG] [LOCAL ] KGC: Primary data saved (54089 records). [2025-10-02T19:48:30.300620] [INFO ] [MAIN ] KGC: Full history saved. [2025-10-02T19:48:30.301578] [INFO ] [MAIN ] Update Progress: 1192/2370 symbols completed. KGC took 52.4s. Estimated remaining: 2h 46m 28s. Rate: 7.1 symbols/min [2025-10-02T19:48:30.486710] [INFO ] [MAIN ] KKRS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:48:30.496458] [DEBUG] [LOCAL ] KKRS: Loaded 5710 existing records from primary storage. [2025-10-02T19:48:30.496731] [INFO ] [MAIN ] KKRS: Loaded 5710 existing records. [2025-10-02T19:48:30.672977] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-04. [2025-10-02T19:48:30.701503] [WARN ] [MAIN ] KKRS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:48:30.702698] [INFO ] [MAIN ] KKRS: Wiping existing primary data before full refresh. [2025-10-02T19:48:30.702832] [INFO ] [LOCAL ] KKRS: Starting deletion of primary data. [2025-10-02T19:48:30.703325] [DEBUG] [LOCAL ] KKRS: Deleted primary data file. [2025-10-02T19:48:30.703388] [INFO ] [MAIN ] KKRS: Starting full primary refresh. [2025-10-02T19:48:31.147478] [INFO ] [REMOTE ] KKRS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:48:31.151451] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-02T19:48:31.179622] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-02T19:48:31.473014] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-09. [2025-10-02T19:48:32.272972] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-09. [2025-10-02T19:48:32.527207] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-02T19:48:33.072979] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-05. [2025-10-02T19:48:33.182467] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-02T19:48:33.322472] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-02T19:48:33.872999] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-10. [2025-10-02T19:48:34.672998] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-10. [2025-10-02T19:48:35.127299] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-02T19:48:35.186563] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-02T19:48:35.190880] [INFO ] [REMOTE ] KIM: Full fetch complete (76828 records). [2025-10-02T19:48:35.191071] [DEBUG] [VALIDATOR ] KIM: Validating primary data. [2025-10-02T19:48:35.479413] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-06. [2025-10-02T19:48:35.535807] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-02T19:48:35.554110] [INFO ] [REMOTE ] KIO: Full fetch complete (31296 records). [2025-10-02T19:48:35.564627] [DEBUG] [VALIDATOR ] KIO: Validating primary data. [2025-10-02T19:48:35.742472] [DEBUG] [VALIDATOR ] KIM: All expected trading days are present. [2025-10-02T19:48:35.766170] [DEBUG] [VALIDATOR ] KIM: Primary data validation passed. [2025-10-02T19:48:35.770521] [INFO ] [MAIN ] KIM: Fetched primary data is valid. [2025-10-02T19:48:35.776435] [DEBUG] [LOCAL ] KIM: Saving primary data. [2025-10-02T19:48:35.836884] [DEBUG] [LOCAL ] KIM: Trimmed 76828 records to 53419 (keeping 200 days of data) [2025-10-02T19:48:36.278601] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2024-12. [2025-10-02T19:48:36.317227] [DEBUG] [VALIDATOR ] KIO: All expected trading days are present. [2025-10-02T19:48:36.317843] [DEBUG] [VALIDATOR ] KIO: Primary data validation passed. [2025-10-02T19:48:36.318720] [INFO ] [MAIN ] KIO: Fetched primary data is valid. [2025-10-02T19:48:36.318807] [DEBUG] [LOCAL ] KIO: Saving primary data. [2025-10-02T19:48:36.386377] [DEBUG] [LOCAL ] KIO: Trimmed 31296 records to 21442 (keeping 200 days of data) [2025-10-02T19:48:36.404296] [DEBUG] [LOCAL ] KIM: Primary data saved (53419 records). [2025-10-02T19:48:36.404846] [INFO ] [MAIN ] KIM: Full history saved. [2025-10-02T19:48:36.405226] [INFO ] [MAIN ] Update Progress: 1193/2370 symbols completed. KIM took 38.9s. Estimated remaining: 2h 46m 17s. Rate: 7.1 symbols/min [2025-10-02T19:48:36.735239] [INFO ] [MAIN ] KKRT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:48:36.742722] [DEBUG] [LOCAL ] KKRT: No existing data file found in primary storage. [2025-10-02T19:48:36.751473] [WARN ] [MAIN ] KKRT: No existing data found, performing full refresh instead. [2025-10-02T19:48:36.753143] [INFO ] [MAIN ] KKRT: Wiping existing primary data before full refresh. [2025-10-02T19:48:36.752971] [DEBUG] [LOCAL ] KIO: Primary data saved (21442 records). [2025-10-02T19:48:36.753396] [INFO ] [MAIN ] KIO: Full history saved. [2025-10-02T19:48:36.753309] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-02T19:48:36.753579] [INFO ] [MAIN ] Update Progress: 1194/2370 symbols completed. KIO took 31.6s. Estimated remaining: 2h 46m 0s. Rate: 7.1 symbols/min [2025-10-02T19:48:36.753714] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-02T19:48:36.771756] [INFO ] [MAIN ] KKRT: Starting full primary refresh. [2025-10-02T19:48:37.058842] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-02T19:48:37.086639] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-01. [2025-10-02T19:48:37.102280] [INFO ] [MAIN ] KLAR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:48:37.142231] [DEBUG] [LOCAL ] KLAR: No existing data file found in primary storage. [2025-10-02T19:48:37.155070] [WARN ] [MAIN ] KLAR: No existing data found, performing full refresh instead. [2025-10-02T19:48:37.231396] [INFO ] [MAIN ] KLAR: Wiping existing primary data before full refresh. [2025-10-02T19:48:37.249105] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-02T19:48:37.254511] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-02T19:48:37.259861] [INFO ] [MAIN ] KLAR: Starting full primary refresh. [2025-10-02T19:48:37.496682] [INFO ] [REMOTE ] KKRT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:48:37.776476] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-02T19:48:37.837886] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-10-02T19:48:37.882525] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-02. [2025-10-02T19:48:37.934553] [INFO ] [REMOTE ] KLAR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:48:38.600402] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-02T19:48:38.673014] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2024-12. [2025-10-02T19:48:38.874003] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T19:48:38.874428] [WARN ] [REMOTE ] KLAR: No data returned for month 2024-12 [2025-10-02T19:48:38.874544] [FATAL] [REMOTE ] KLAR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T19:48:38.874613] [FATAL] [MAIN ] KLAR: Failed to fetch primary data. [2025-10-02T19:48:38.874711] [WARN ] [MAIN ] KLAR: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T19:48:38.874801] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-02T19:48:38.874885] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-02T19:48:38.874933] [INFO ] [LOCAL ] KLAR: Starting deletion of derivative data. [2025-10-02T19:48:38.875015] [DEBUG] [LOCAL ] KLAR: No derivative data file found to delete. [2025-10-02T19:48:38.875106] [INFO ] [MAIN ] Update Progress: 1195/2370 symbols completed. KLAR took 2.1s. Estimated remaining: 2h 45m 46s. Rate: 7.1 symbols/min [2025-10-02T19:48:39.088833] [INFO ] [MAIN ] KLC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:48:39.125275] [DEBUG] [LOCAL ] KLC: Loaded 36723 existing records from primary storage. [2025-10-02T19:48:39.125616] [INFO ] [MAIN ] KLC: Loaded 36723 existing records. [2025-10-02T19:48:39.320067] [WARN ] [MAIN ] KLC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:48:39.320317] [INFO ] [MAIN ] KLC: Wiping existing primary data before full refresh. [2025-10-02T19:48:39.320368] [INFO ] [LOCAL ] KLC: Starting deletion of primary data. [2025-10-02T19:48:39.321161] [DEBUG] [LOCAL ] KLC: Deleted primary data file. [2025-10-02T19:48:39.321223] [INFO ] [MAIN ] KLC: Starting full primary refresh. [2025-10-02T19:48:39.478165] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2024-12. [2025-10-02T19:48:39.748042] [INFO ] [REMOTE ] KLC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:48:39.752152] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T19:48:39.752531] [WARN ] [REMOTE ] KKRT: No data returned for month 2024-12 [2025-10-02T19:48:39.752665] [FATAL] [REMOTE ] KKRT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T19:48:39.752740] [FATAL] [MAIN ] KKRT: Failed to fetch primary data. [2025-10-02T19:48:39.752851] [WARN ] [MAIN ] KKRT: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T19:48:39.752937] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-02T19:48:39.753004] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-02T19:48:39.753045] [INFO ] [LOCAL ] KKRT: Starting deletion of derivative data. [2025-10-02T19:48:39.753116] [DEBUG] [LOCAL ] KKRT: No derivative data file found to delete. [2025-10-02T19:48:39.753189] [INFO ] [MAIN ] Update Progress: 1196/2370 symbols completed. KKRT took 3.3s. Estimated remaining: 2h 45m 30s. Rate: 7.1 symbols/min [2025-10-02T19:48:39.937329] [INFO ] [MAIN ] KMI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:48:39.989871] [DEBUG] [LOCAL ] KMI: Loaded 53693 existing records from primary storage. [2025-10-02T19:48:39.990292] [INFO ] [MAIN ] KMI: Loaded 53693 existing records. [2025-10-02T19:48:40.184032] [WARN ] [MAIN ] KMI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:48:40.184238] [INFO ] [MAIN ] KMI: Wiping existing primary data before full refresh. [2025-10-02T19:48:40.184287] [INFO ] [LOCAL ] KMI: Starting deletion of primary data. [2025-10-02T19:48:40.185460] [DEBUG] [LOCAL ] KMI: Deleted primary data file. [2025-10-02T19:48:40.185525] [INFO ] [MAIN ] KMI: Starting full primary refresh. [2025-10-02T19:48:40.278092] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-03. [2025-10-02T19:48:40.568842] [INFO ] [REMOTE ] KMI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:48:40.712117] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-02T19:48:41.072998] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-04. [2025-10-02T19:48:41.844439] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-02T19:48:41.872974] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-05. [2025-10-02T19:48:42.529809] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-02T19:48:42.673022] [INFO ] [REMOTE ] KMI: Fetching primary data for 2024-12. [2025-10-02T19:48:43.473003] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-07. [2025-10-02T19:48:44.272965] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-06. [2025-10-02T19:48:44.785386] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-02T19:48:44.797946] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-02T19:48:45.073042] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-01. [2025-10-02T19:48:45.418232] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-02T19:48:45.873024] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-08. [2025-10-02T19:48:46.673023] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-07. [2025-10-02T19:48:47.172877] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-02T19:48:47.189710] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-02T19:48:47.473044] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-02. [2025-10-02T19:48:47.776732] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-02T19:48:48.273011] [INFO ] [REMOTE ] KLC: Fetching primary data for 2024-12. [2025-10-02T19:48:49.072997] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-08. [2025-10-02T19:48:49.570834] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-02T19:48:49.656014] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-02T19:48:49.872963] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-09. [2025-10-02T19:48:49.967628] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-02T19:48:50.433219] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-02T19:48:50.673019] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-09. [2025-10-02T19:48:51.473033] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-10. [2025-10-02T19:48:51.936543] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-02T19:48:51.937377] [INFO ] [REMOTE ] KKRS: Full fetch complete (7898 records). [2025-10-02T19:48:51.937480] [DEBUG] [VALIDATOR ] KKRS: Validating primary data. [2025-10-02T19:48:52.273726] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-03. [2025-10-02T19:48:52.332856] [DEBUG] [VALIDATOR ] KKRS: All expected trading days are present. [2025-10-02T19:48:52.333047] [DEBUG] [VALIDATOR ] KKRS: Primary data validation passed. [2025-10-02T19:48:52.333350] [INFO ] [MAIN ] KKRS: Fetched primary data is valid. [2025-10-02T19:48:52.333498] [DEBUG] [LOCAL ] KKRS: Saving primary data. [2025-10-02T19:48:52.334121] [DEBUG] [LOCAL ] KKRS: Trimmed 7898 records to 5729 (keeping 200 days of data) [2025-10-02T19:48:52.371982] [DEBUG] [LOCAL ] KKRS: Primary data saved (5729 records). [2025-10-02T19:48:52.372109] [INFO ] [MAIN ] KKRS: Full history saved. [2025-10-02T19:48:52.372195] [INFO ] [MAIN ] Update Progress: 1197/2370 symbols completed. KKRS took 22.1s. Estimated remaining: 2h 45m 25s. Rate: 7.1 symbols/min [2025-10-02T19:48:52.608978] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-02T19:48:53.073003] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-10. [2025-10-02T19:48:53.872986] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-01. [2025-10-02T19:48:54.340894] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-02T19:48:54.590706] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-02T19:48:54.593075] [INFO ] [REMOTE ] KKR: Full fetch complete (77445 records). [2025-10-02T19:48:54.593500] [DEBUG] [VALIDATOR ] KKR: Validating primary data. [2025-10-02T19:48:54.680949] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-04. [2025-10-02T19:48:55.026731] [DEBUG] [VALIDATOR ] KKR: All expected trading days are present. [2025-10-02T19:48:55.026895] [DEBUG] [VALIDATOR ] KKR: Primary data validation passed. [2025-10-02T19:48:55.028017] [INFO ] [MAIN ] KKR: Fetched primary data is valid. [2025-10-02T19:48:55.028142] [DEBUG] [LOCAL ] KKR: Saving primary data. [2025-10-02T19:48:55.029945] [DEBUG] [LOCAL ] KKR: Trimmed 77445 records to 53890 (keeping 200 days of data) [2025-10-02T19:48:55.162187] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-02T19:48:55.410004] [DEBUG] [LOCAL ] KKR: Primary data saved (53890 records). [2025-10-02T19:48:55.410149] [INFO ] [MAIN ] KKR: Full history saved. [2025-10-02T19:48:55.410232] [INFO ] [MAIN ] Update Progress: 1198/2370 symbols completed. KKR took 38.8s. Estimated remaining: 2h 45m 12s. Rate: 7.1 symbols/min [2025-10-02T19:48:55.472997] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-02. [2025-10-02T19:48:56.306914] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-02T19:48:56.312971] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-03. [2025-10-02T19:48:56.480797] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-02T19:48:57.073026] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-05. [2025-10-02T19:48:57.727617] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-02T19:48:57.873046] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-04. [2025-10-02T19:48:59.061309] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-02T19:48:59.073133] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-06. [2025-10-02T19:48:59.315366] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-02T19:48:59.473049] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-05. [2025-10-02T19:49:00.921340] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-02T19:49:00.930090] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-06. [2025-10-02T19:49:01.777882] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-06 (2.70 seconds). [2025-10-02T19:49:01.789746] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-07. [2025-10-02T19:49:02.050229] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-02T19:49:02.059250] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-07. [2025-10-02T19:49:03.399612] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-02T19:49:03.407692] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-08. [2025-10-02T19:49:03.621280] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-02T19:49:03.633496] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-08. [2025-10-02T19:49:04.855580] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-02T19:49:04.864802] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-09. [2025-10-02T19:49:05.501532] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-02T19:49:05.514930] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-09. [2025-10-02T19:49:06.329219] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-02T19:49:06.342610] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-10. [2025-10-02T19:49:07.481555] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-02T19:49:07.494126] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-10. [2025-10-02T19:49:07.687111] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-02T19:49:07.688951] [INFO ] [REMOTE ] KLC: Full fetch complete (50690 records). [2025-10-02T19:49:07.689100] [DEBUG] [VALIDATOR ] KLC: Validating primary data. [2025-10-02T19:49:08.105897] [DEBUG] [VALIDATOR ] KLC: All expected trading days are present. [2025-10-02T19:49:08.105985] [DEBUG] [VALIDATOR ] KLC: Primary data validation passed. [2025-10-02T19:49:08.106880] [INFO ] [MAIN ] KLC: Fetched primary data is valid. [2025-10-02T19:49:08.106950] [DEBUG] [LOCAL ] KLC: Saving primary data. [2025-10-02T19:49:08.108290] [DEBUG] [LOCAL ] KLC: Trimmed 50690 records to 36984 (keeping 200 days of data) [2025-10-02T19:49:08.328266] [DEBUG] [LOCAL ] KLC: Primary data saved (36984 records). [2025-10-02T19:49:08.328415] [INFO ] [MAIN ] KLC: Full history saved. [2025-10-02T19:49:08.328521] [INFO ] [MAIN ] Update Progress: 1199/2370 symbols completed. KLC took 29.5s. Estimated remaining: 2h 45m 8s. Rate: 7.1 symbols/min [2025-10-02T19:49:08.972725] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-02T19:49:08.974969] [INFO ] [REMOTE ] KMI: Full fetch complete (77764 records). [2025-10-02T19:49:08.975109] [DEBUG] [VALIDATOR ] KMI: Validating primary data. [2025-10-02T19:49:09.392130] [DEBUG] [VALIDATOR ] KMI: All expected trading days are present. [2025-10-02T19:49:09.392222] [DEBUG] [VALIDATOR ] KMI: Primary data validation passed. [2025-10-02T19:49:09.393465] [INFO ] [MAIN ] KMI: Fetched primary data is valid. [2025-10-02T19:49:09.393535] [DEBUG] [LOCAL ] KMI: Saving primary data. [2025-10-02T19:49:09.395186] [DEBUG] [LOCAL ] KMI: Trimmed 77764 records to 54083 (keeping 200 days of data) [2025-10-02T19:49:09.745217] [DEBUG] [LOCAL ] KMI: Primary data saved (54083 records). [2025-10-02T19:49:09.745371] [INFO ] [MAIN ] KMI: Full history saved. [2025-10-02T19:49:09.745459] [INFO ] [MAIN ] Update Progress: 1200/2370 symbols completed. KMI took 30.0s. Estimated remaining: 2h 44m 52s. Rate: 7.1 symbols/min [2025-10-02T19:49:10.315608] [INFO ] [MAIN ] KMX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:49:10.435183] [INFO ] [MAIN ] KMT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:49:10.512887] [INFO ] [MAIN ] KMPR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:49:10.536779] [INFO ] [MAIN ] KMPB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:49:10.545487] [DEBUG] [LOCAL ] KMPB: Loaded 3780 existing records from primary storage. [2025-10-02T19:49:10.546043] [INFO ] [MAIN ] KMPB: Loaded 3780 existing records. [2025-10-02T19:49:10.795027] [DEBUG] [LOCAL ] KMPR: Loaded 38886 existing records from primary storage. [2025-10-02T19:49:10.817432] [DEBUG] [LOCAL ] KMT: Loaded 42939 existing records from primary storage. [2025-10-02T19:49:10.817947] [INFO ] [MAIN ] KMPR: Loaded 38886 existing records. [2025-10-02T19:49:10.847121] [DEBUG] [LOCAL ] KMX: Loaded 53161 existing records from primary storage. [2025-10-02T19:49:10.846233] [INFO ] [MAIN ] KMT: Loaded 42939 existing records. [2025-10-02T19:49:10.845862] [WARN ] [MAIN ] KMPB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:49:10.857926] [INFO ] [MAIN ] KMPB: Wiping existing primary data before full refresh. [2025-10-02T19:49:10.858063] [INFO ] [LOCAL ] KMPB: Starting deletion of primary data. [2025-10-02T19:49:10.871912] [INFO ] [MAIN ] KMX: Loaded 53161 existing records. [2025-10-02T19:49:10.971168] [DEBUG] [LOCAL ] KMPB: Deleted primary data file. [2025-10-02T19:49:11.018525] [INFO ] [MAIN ] KMPB: Starting full primary refresh. [2025-10-02T19:49:11.530450] [WARN ] [MAIN ] KMX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:49:11.600737] [INFO ] [MAIN ] KMX: Wiping existing primary data before full refresh. [2025-10-02T19:49:11.600441] [WARN ] [MAIN ] KMT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:49:11.604840] [INFO ] [LOCAL ] KMX: Starting deletion of primary data. [2025-10-02T19:49:11.638066] [INFO ] [MAIN ] KMT: Wiping existing primary data before full refresh. [2025-10-02T19:49:11.655982] [WARN ] [MAIN ] KMPR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:49:11.661465] [INFO ] [MAIN ] KMPR: Wiping existing primary data before full refresh. [2025-10-02T19:49:11.661570] [INFO ] [LOCAL ] KMT: Starting deletion of primary data. [2025-10-02T19:49:11.686924] [INFO ] [LOCAL ] KMPR: Starting deletion of primary data. [2025-10-02T19:49:11.692279] [DEBUG] [LOCAL ] KMX: Deleted primary data file. [2025-10-02T19:49:11.723915] [INFO ] [MAIN ] KMX: Starting full primary refresh. [2025-10-02T19:49:11.723785] [DEBUG] [LOCAL ] KMT: Deleted primary data file. [2025-10-02T19:49:11.754811] [DEBUG] [LOCAL ] KMPR: Deleted primary data file. [2025-10-02T19:49:11.774573] [INFO ] [MAIN ] KMT: Starting full primary refresh. [2025-10-02T19:49:11.803417] [INFO ] [MAIN ] KMPR: Starting full primary refresh. [2025-10-02T19:49:12.332818] [INFO ] [REMOTE ] KMPB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:49:12.406211] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2024-12. [2025-10-02T19:49:13.146464] [INFO ] [REMOTE ] KMT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:49:13.149630] [INFO ] [REMOTE ] KMX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:49:13.183621] [INFO ] [REMOTE ] KMT: Fetching primary data for 2024-12. [2025-10-02T19:49:13.189841] [INFO ] [REMOTE ] KMPR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:49:13.191861] [INFO ] [REMOTE ] KMX: Fetching primary data for 2024-12. [2025-10-02T19:49:13.192367] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-02T19:49:13.192843] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2024-12. [2025-10-02T19:49:13.195517] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-01. [2025-10-02T19:49:13.628946] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-02T19:49:13.630258] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-02. [2025-10-02T19:49:14.139980] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-02T19:49:14.140785] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-02T19:49:14.142316] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-03. [2025-10-02T19:49:14.149589] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-01. [2025-10-02T19:49:14.523972] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-02T19:49:14.532798] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-01. [2025-10-02T19:49:14.604417] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-02T19:49:14.672995] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-01. [2025-10-02T19:49:14.709238] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-02T19:49:15.279107] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-02T19:49:15.473049] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-02. [2025-10-02T19:49:15.922608] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-02T19:49:16.278996] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-04. [2025-10-02T19:49:16.303091] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-02T19:49:16.720637] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-02T19:49:16.862140] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-02T19:49:17.073001] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-03. [2025-10-02T19:49:17.873014] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-05. [2025-10-02T19:49:18.322633] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-02T19:49:18.368818] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-02T19:49:18.673014] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-02. [2025-10-02T19:49:19.473012] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-04. [2025-10-02T19:49:20.262042] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-02T19:49:20.272948] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-03. [2025-10-02T19:49:20.677428] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-02T19:49:21.073066] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-02. [2025-10-02T19:49:21.873009] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-05. [2025-10-02T19:49:22.258948] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-02T19:49:22.334798] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-02T19:49:22.672958] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-04. [2025-10-02T19:49:23.145598] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-02T19:49:23.473017] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-06. [2025-10-02T19:49:24.273002] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-06. [2025-10-02T19:49:24.595588] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-02T19:49:24.806542] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-02T19:49:24.852784] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-02T19:49:25.073007] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-05. [2025-10-02T19:49:25.873001] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-07. [2025-10-02T19:49:26.672982] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-07. [2025-10-02T19:49:26.794222] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-02T19:49:27.058109] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-02T19:49:27.122896] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-02T19:49:27.473005] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-08. [2025-10-02T19:49:28.023495] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-02T19:49:28.273016] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-06. [2025-10-02T19:49:29.073013] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-03. [2025-10-02T19:49:29.696194] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-02T19:49:29.872998] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-08. [2025-10-02T19:49:30.628614] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-02T19:49:30.673066] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-09. [2025-10-02T19:49:31.210311] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-02T19:49:31.478317] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-04. [2025-10-02T19:49:31.497797] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-02T19:49:32.273012] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-07. [2025-10-02T19:49:33.072972] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-09. [2025-10-02T19:49:33.147618] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-02T19:49:33.873963] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-05. [2025-10-02T19:49:33.877120] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-02T19:49:34.425799] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-02T19:49:34.673005] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-10. [2025-10-02T19:49:35.027672] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-02T19:49:35.472995] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-08. [2025-10-02T19:49:35.905771] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-02T19:49:35.908083] [INFO ] [REMOTE ] KMPR: Full fetch complete (51562 records). [2025-10-02T19:49:35.908279] [DEBUG] [VALIDATOR ] KMPR: Validating primary data. [2025-10-02T19:49:36.288374] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-06. [2025-10-02T19:49:36.347121] [DEBUG] [VALIDATOR ] KMPR: All expected trading days are present. [2025-10-02T19:49:36.347235] [DEBUG] [VALIDATOR ] KMPR: Primary data validation passed. [2025-10-02T19:49:36.348210] [INFO ] [MAIN ] KMPR: Fetched primary data is valid. [2025-10-02T19:49:36.348280] [DEBUG] [LOCAL ] KMPR: Saving primary data. [2025-10-02T19:49:36.349731] [DEBUG] [LOCAL ] KMPR: Trimmed 51562 records to 39204 (keeping 200 days of data) [2025-10-02T19:49:36.604119] [DEBUG] [LOCAL ] KMPR: Primary data saved (39204 records). [2025-10-02T19:49:36.604274] [INFO ] [MAIN ] KMPR: Full history saved. [2025-10-02T19:49:36.604406] [INFO ] [MAIN ] Update Progress: 1201/2370 symbols completed. KMPR took 26.9s. Estimated remaining: 2h 45m 2s. Rate: 7.1 symbols/min [2025-10-02T19:49:36.785351] [INFO ] [MAIN ] KN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:49:36.826338] [DEBUG] [LOCAL ] KN: Loaded 38555 existing records from primary storage. [2025-10-02T19:49:36.826683] [INFO ] [MAIN ] KN: Loaded 38555 existing records. [2025-10-02T19:49:37.020869] [WARN ] [MAIN ] KN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:49:37.021155] [INFO ] [MAIN ] KN: Wiping existing primary data before full refresh. [2025-10-02T19:49:37.021208] [INFO ] [LOCAL ] KN: Starting deletion of primary data. [2025-10-02T19:49:37.022210] [DEBUG] [LOCAL ] KN: Deleted primary data file. [2025-10-02T19:49:37.022273] [INFO ] [MAIN ] KN: Starting full primary refresh. [2025-10-02T19:49:37.092564] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-10. [2025-10-02T19:49:37.426836] [INFO ] [REMOTE ] KN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:49:37.461234] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-02T19:49:37.500475] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-02T19:49:37.663409] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-02T19:49:37.664514] [INFO ] [REMOTE ] KMPB: Full fetch complete (5134 records). [2025-10-02T19:49:37.664615] [DEBUG] [VALIDATOR ] KMPB: Validating primary data. [2025-10-02T19:49:37.886314] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-09. [2025-10-02T19:49:38.091487] [DEBUG] [VALIDATOR ] KMPB: All expected trading days are present. [2025-10-02T19:49:38.091570] [DEBUG] [VALIDATOR ] KMPB: Primary data validation passed. [2025-10-02T19:49:38.091759] [INFO ] [MAIN ] KMPB: Fetched primary data is valid. [2025-10-02T19:49:38.091823] [DEBUG] [LOCAL ] KMPB: Saving primary data. [2025-10-02T19:49:38.092213] [DEBUG] [LOCAL ] KMPB: Trimmed 5134 records to 3795 (keeping 200 days of data) [2025-10-02T19:49:38.115748] [DEBUG] [LOCAL ] KMPB: Primary data saved (3795 records). [2025-10-02T19:49:38.115854] [INFO ] [MAIN ] KMPB: Full history saved. [2025-10-02T19:49:38.115932] [INFO ] [MAIN ] Update Progress: 1202/2370 symbols completed. KMPB took 28.4s. Estimated remaining: 2h 44m 47s. Rate: 7.1 symbols/min [2025-10-02T19:49:38.303478] [INFO ] [MAIN ] KNF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:49:38.341363] [DEBUG] [LOCAL ] KNF: Loaded 35852 existing records from primary storage. [2025-10-02T19:49:38.341679] [INFO ] [MAIN ] KNF: Loaded 35852 existing records. [2025-10-02T19:49:38.534992] [WARN ] [MAIN ] KNF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:49:38.535229] [INFO ] [MAIN ] KNF: Wiping existing primary data before full refresh. [2025-10-02T19:49:38.535279] [INFO ] [LOCAL ] KNF: Starting deletion of primary data. [2025-10-02T19:49:38.539130] [DEBUG] [LOCAL ] KNF: Deleted primary data file. [2025-10-02T19:49:38.539205] [INFO ] [MAIN ] KNF: Starting full primary refresh. [2025-10-02T19:49:38.678311] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-07. [2025-10-02T19:49:38.988981] [INFO ] [REMOTE ] KNF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:49:39.473063] [INFO ] [REMOTE ] KNF: Fetching primary data for 2024-12. [2025-10-02T19:49:39.997844] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-02T19:49:40.256972] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-02T19:49:40.272947] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-08. [2025-10-02T19:49:40.734011] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-02T19:49:41.073011] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-01. [2025-10-02T19:49:41.782538] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-02T19:49:41.873040] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-10. [2025-10-02T19:49:41.937236] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-02T19:49:42.673045] [INFO ] [REMOTE ] KN: Fetching primary data for 2024-12. [2025-10-02T19:49:43.435249] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-02T19:49:43.437473] [INFO ] [REMOTE ] KMX: Full fetch complete (76053 records). [2025-10-02T19:49:43.437632] [DEBUG] [VALIDATOR ] KMX: Validating primary data. [2025-10-02T19:49:43.478216] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-09. [2025-10-02T19:49:43.891782] [DEBUG] [VALIDATOR ] KMX: All expected trading days are present. [2025-10-02T19:49:43.891980] [DEBUG] [VALIDATOR ] KMX: Primary data validation passed. [2025-10-02T19:49:43.893200] [INFO ] [MAIN ] KMX: Fetched primary data is valid. [2025-10-02T19:49:43.893316] [DEBUG] [LOCAL ] KMX: Saving primary data. [2025-10-02T19:49:43.896384] [DEBUG] [LOCAL ] KMX: Trimmed 76053 records to 53551 (keeping 200 days of data) [2025-10-02T19:49:44.151679] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-02T19:49:44.264637] [DEBUG] [LOCAL ] KMX: Primary data saved (53551 records). [2025-10-02T19:49:44.264813] [INFO ] [MAIN ] KMX: Full history saved. [2025-10-02T19:49:44.264958] [INFO ] [MAIN ] Update Progress: 1203/2370 symbols completed. KMX took 34.5s. Estimated remaining: 2h 44m 36s. Rate: 7.1 symbols/min [2025-10-02T19:49:44.278082] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-02. [2025-10-02T19:49:44.446415] [INFO ] [MAIN ] KNOP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:49:44.460300] [DEBUG] [LOCAL ] KNOP: Loaded 10442 existing records from primary storage. [2025-10-02T19:49:44.460528] [INFO ] [MAIN ] KNOP: Loaded 10442 existing records. [2025-10-02T19:49:44.651127] [WARN ] [MAIN ] KNOP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:49:44.651439] [INFO ] [MAIN ] KNOP: Wiping existing primary data before full refresh. [2025-10-02T19:49:44.651559] [INFO ] [LOCAL ] KNOP: Starting deletion of primary data. [2025-10-02T19:49:44.652156] [DEBUG] [LOCAL ] KNOP: Deleted primary data file. [2025-10-02T19:49:44.652261] [INFO ] [MAIN ] KNOP: Starting full primary refresh. [2025-10-02T19:49:45.061244] [INFO ] [REMOTE ] KNOP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:49:45.063556] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-02T19:49:45.073013] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-01. [2025-10-02T19:49:45.341943] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-02T19:49:45.873032] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2024-12. [2025-10-02T19:49:46.477095] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-02T19:49:46.494582] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-02T19:49:46.673078] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-10. [2025-10-02T19:49:47.473034] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-01. [2025-10-02T19:49:47.749323] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-02T19:49:47.751029] [INFO ] [REMOTE ] KMT: Full fetch complete (62091 records). [2025-10-02T19:49:47.751327] [DEBUG] [VALIDATOR ] KMT: Validating primary data. [2025-10-02T19:49:48.188951] [DEBUG] [VALIDATOR ] KMT: All expected trading days are present. [2025-10-02T19:49:48.189143] [DEBUG] [VALIDATOR ] KMT: Primary data validation passed. [2025-10-02T19:49:48.190034] [INFO ] [MAIN ] KMT: Fetched primary data is valid. [2025-10-02T19:49:48.190098] [DEBUG] [LOCAL ] KMT: Saving primary data. [2025-10-02T19:49:48.191704] [DEBUG] [LOCAL ] KMT: Trimmed 62091 records to 43222 (keeping 200 days of data) [2025-10-02T19:49:48.297276] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-02. [2025-10-02T19:49:48.300716] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-02T19:49:48.488506] [DEBUG] [LOCAL ] KMT: Primary data saved (43222 records). [2025-10-02T19:49:48.488676] [INFO ] [MAIN ] KMT: Full history saved. [2025-10-02T19:49:48.488819] [INFO ] [MAIN ] Update Progress: 1204/2370 symbols completed. KMT took 38.7s. Estimated remaining: 2h 44m 23s. Rate: 7.1 symbols/min [2025-10-02T19:49:48.680044] [INFO ] [MAIN ] KNSL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:49:48.701777] [DEBUG] [LOCAL ] KNSL: Loaded 18181 existing records from primary storage. [2025-10-02T19:49:48.702092] [INFO ] [MAIN ] KNSL: Loaded 18181 existing records. [2025-10-02T19:49:48.902292] [WARN ] [MAIN ] KNSL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:49:48.902519] [INFO ] [MAIN ] KNSL: Wiping existing primary data before full refresh. [2025-10-02T19:49:48.902567] [INFO ] [LOCAL ] KNSL: Starting deletion of primary data. [2025-10-02T19:49:48.903192] [DEBUG] [LOCAL ] KNSL: Deleted primary data file. [2025-10-02T19:49:48.903253] [INFO ] [MAIN ] KNSL: Starting full primary refresh. [2025-10-02T19:49:49.073996] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-02. [2025-10-02T19:49:49.294771] [INFO ] [REMOTE ] KNSL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:49:49.802555] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-02T19:49:49.864477] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-02T19:49:49.872951] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-03. [2025-10-02T19:49:50.467748] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-02T19:49:50.673033] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-03. [2025-10-02T19:49:51.473035] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-03. [2025-10-02T19:49:51.716826] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-02T19:49:52.273023] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2024-12. [2025-10-02T19:49:52.890922] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-02T19:49:53.073019] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-04. [2025-10-02T19:49:53.372694] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-02T19:49:53.873000] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-04. [2025-10-02T19:49:54.517173] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-02T19:49:54.673043] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-05. [2025-10-02T19:49:55.116841] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-02T19:49:55.473046] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-04. [2025-10-02T19:49:55.633628] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-02T19:49:56.273006] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-05. [2025-10-02T19:49:56.378301] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-02T19:49:57.072965] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-01. [2025-10-02T19:49:57.744578] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-02T19:49:57.872984] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-06. [2025-10-02T19:49:57.891273] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-02T19:49:58.673011] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-05. [2025-10-02T19:49:59.272130] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-02T19:49:59.473021] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-06. [2025-10-02T19:49:59.483106] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-02T19:50:00.272983] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-06. [2025-10-02T19:50:00.953303] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-02T19:50:01.072978] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-07. [2025-10-02T19:50:01.224382] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-02T19:50:01.873046] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-07. [2025-10-02T19:50:02.494863] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-02T19:50:02.673026] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-02. [2025-10-02T19:50:02.828353] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-02T19:50:03.472987] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-08. [2025-10-02T19:50:03.807241] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-02T19:50:04.205379] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-02T19:50:04.273005] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-09. [2025-10-02T19:50:05.073004] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-07. [2025-10-02T19:50:05.179133] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-02T19:50:05.873058] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-08. [2025-10-02T19:50:06.401097] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-02T19:50:06.673002] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-08. [2025-10-02T19:50:06.936995] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-02T19:50:07.473013] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-09. [2025-10-02T19:50:08.119067] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-02T19:50:08.273010] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-10. [2025-10-02T19:50:08.633317] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-02T19:50:09.058229] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-02T19:50:09.059253] [INFO ] [REMOTE ] KNOP: Full fetch complete (14778 records). [2025-10-02T19:50:09.059335] [DEBUG] [VALIDATOR ] KNOP: Validating primary data. [2025-10-02T19:50:09.078134] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-10. [2025-10-02T19:50:09.472855] [DEBUG] [VALIDATOR ] KNOP: All expected trading days are present. [2025-10-02T19:50:09.472941] [DEBUG] [VALIDATOR ] KNOP: Primary data validation passed. [2025-10-02T19:50:09.473316] [INFO ] [MAIN ] KNOP: Fetched primary data is valid. [2025-10-02T19:50:09.473378] [DEBUG] [LOCAL ] KNOP: Saving primary data. [2025-10-02T19:50:09.473975] [DEBUG] [LOCAL ] KNOP: Trimmed 14778 records to 10514 (keeping 200 days of data) [2025-10-02T19:50:09.542249] [DEBUG] [LOCAL ] KNOP: Primary data saved (10514 records). [2025-10-02T19:50:09.542392] [INFO ] [MAIN ] KNOP: Full history saved. [2025-10-02T19:50:09.542498] [INFO ] [MAIN ] Update Progress: 1205/2370 symbols completed. KNOP took 25.3s. Estimated remaining: 2h 44m 27s. Rate: 7.1 symbols/min [2025-10-02T19:50:09.742208] [INFO ] [MAIN ] KNTK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:50:09.795221] [DEBUG] [LOCAL ] KNTK: Loaded 46161 existing records from primary storage. [2025-10-02T19:50:09.795678] [INFO ] [MAIN ] KNTK: Loaded 46161 existing records. [2025-10-02T19:50:09.879122] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-09. [2025-10-02T19:50:09.996220] [WARN ] [MAIN ] KNTK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:50:09.996483] [INFO ] [MAIN ] KNTK: Wiping existing primary data before full refresh. [2025-10-02T19:50:09.996541] [INFO ] [LOCAL ] KNTK: Starting deletion of primary data. [2025-10-02T19:50:09.998519] [DEBUG] [LOCAL ] KNTK: Deleted primary data file. [2025-10-02T19:50:09.998592] [INFO ] [MAIN ] KNTK: Starting full primary refresh. [2025-10-02T19:50:10.378985] [INFO ] [REMOTE ] KNTK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:50:10.394251] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-02T19:50:10.396573] [INFO ] [REMOTE ] KN: Full fetch complete (56533 records). [2025-10-02T19:50:10.396742] [DEBUG] [VALIDATOR ] KN: Validating primary data. [2025-10-02T19:50:10.678237] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-03. [2025-10-02T19:50:10.814337] [DEBUG] [VALIDATOR ] KN: All expected trading days are present. [2025-10-02T19:50:10.814425] [DEBUG] [VALIDATOR ] KN: Primary data validation passed. [2025-10-02T19:50:10.815374] [INFO ] [MAIN ] KN: Fetched primary data is valid. [2025-10-02T19:50:10.815456] [DEBUG] [LOCAL ] KN: Saving primary data. [2025-10-02T19:50:10.817061] [DEBUG] [LOCAL ] KN: Trimmed 56533 records to 38880 (keeping 200 days of data) [2025-10-02T19:50:11.066509] [DEBUG] [LOCAL ] KN: Primary data saved (38880 records). [2025-10-02T19:50:11.066681] [INFO ] [MAIN ] KN: Full history saved. [2025-10-02T19:50:11.066802] [INFO ] [MAIN ] Update Progress: 1206/2370 symbols completed. KN took 34.5s. Estimated remaining: 2h 44m 12s. Rate: 7.1 symbols/min [2025-10-02T19:50:11.270270] [INFO ] [MAIN ] KNX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:50:11.327419] [DEBUG] [LOCAL ] KNX: Loaded 52589 existing records from primary storage. [2025-10-02T19:50:11.327832] [INFO ] [MAIN ] KNX: Loaded 52589 existing records. [2025-10-02T19:50:11.480322] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2024-12. [2025-10-02T19:50:11.539214] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-02T19:50:11.563397] [WARN ] [MAIN ] KNX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:50:11.572776] [INFO ] [MAIN ] KNX: Wiping existing primary data before full refresh. [2025-10-02T19:50:11.573745] [INFO ] [LOCAL ] KNX: Starting deletion of primary data. [2025-10-02T19:50:11.580434] [DEBUG] [LOCAL ] KNX: Deleted primary data file. [2025-10-02T19:50:11.590100] [INFO ] [MAIN ] KNX: Starting full primary refresh. [2025-10-02T19:50:11.590779] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-02T19:50:11.998613] [INFO ] [REMOTE ] KNX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:50:12.273041] [INFO ] [REMOTE ] KNX: Fetching primary data for 2024-12. [2025-10-02T19:50:12.962342] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-02T19:50:13.073010] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-01. [2025-10-02T19:50:13.872972] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-10. [2025-10-02T19:50:13.917443] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-02T19:50:14.276293] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-02T19:50:14.673003] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-02. [2025-10-02T19:50:15.196101] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-02T19:50:15.198266] [INFO ] [REMOTE ] KNF: Full fetch complete (50857 records). [2025-10-02T19:50:15.198580] [DEBUG] [VALIDATOR ] KNF: Validating primary data. [2025-10-02T19:50:15.486628] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-01. [2025-10-02T19:50:15.635489] [DEBUG] [VALIDATOR ] KNF: All expected trading days are present. [2025-10-02T19:50:15.635581] [DEBUG] [VALIDATOR ] KNF: Primary data validation passed. [2025-10-02T19:50:15.636491] [INFO ] [MAIN ] KNF: Fetched primary data is valid. [2025-10-02T19:50:15.636559] [DEBUG] [LOCAL ] KNF: Saving primary data. [2025-10-02T19:50:15.637903] [DEBUG] [LOCAL ] KNF: Trimmed 50857 records to 36189 (keeping 200 days of data) [2025-10-02T19:50:15.877611] [DEBUG] [LOCAL ] KNF: Primary data saved (36189 records). [2025-10-02T19:50:15.877772] [INFO ] [MAIN ] KNF: Full history saved. [2025-10-02T19:50:15.878695] [INFO ] [MAIN ] Update Progress: 1207/2370 symbols completed. KNF took 37.8s. Estimated remaining: 2h 43m 60s. Rate: 7.1 symbols/min [2025-10-02T19:50:16.065115] [INFO ] [MAIN ] KO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:50:16.065342] [DEBUG] [LOCAL ] KO: No existing data file found in primary storage. [2025-10-02T19:50:16.065414] [WARN ] [MAIN ] KO: No existing data found, performing full refresh instead. [2025-10-02T19:50:16.065664] [INFO ] [MAIN ] KO: Wiping existing primary data before full refresh. [2025-10-02T19:50:16.065740] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-02T19:50:16.065884] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-02T19:50:16.065936] [INFO ] [MAIN ] KO: Starting full primary refresh. [2025-10-02T19:50:16.283997] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-04. [2025-10-02T19:50:16.490143] [INFO ] [REMOTE ] KO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:50:16.514751] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-02T19:50:17.072978] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-03. [2025-10-02T19:50:17.157328] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-02T19:50:17.182714] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-02T19:50:17.873003] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-05. [2025-10-02T19:50:18.640465] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-02T19:50:18.661841] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-02T19:50:18.672966] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-06. [2025-10-02T19:50:19.384155] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-02T19:50:19.473019] [INFO ] [REMOTE ] KO: Fetching primary data for 2024-12. [2025-10-02T19:50:20.273019] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-07. [2025-10-02T19:50:21.072994] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-02. [2025-10-02T19:50:21.373112] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-02T19:50:21.879244] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-08. [2025-10-02T19:50:21.883209] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2024-12 (2.41 seconds). [2025-10-02T19:50:22.602920] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-02T19:50:22.640480] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-02T19:50:22.673066] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-09. [2025-10-02T19:50:23.478405] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-01. [2025-10-02T19:50:23.496613] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-02T19:50:24.273013] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-04. [2025-10-02T19:50:25.073055] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-03. [2025-10-02T19:50:25.850422] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-02T19:50:25.872977] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-05. [2025-10-02T19:50:26.002046] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-01 (2.52 seconds). [2025-10-02T19:50:26.433715] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-02T19:50:26.672998] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-02. [2025-10-02T19:50:27.506386] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-10. [2025-10-02T19:50:27.529883] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-02T19:50:28.273010] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-06. [2025-10-02T19:50:28.366691] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-02T19:50:28.368414] [INFO ] [REMOTE ] KNSL: Full fetch complete (26695 records). [2025-10-02T19:50:28.368684] [DEBUG] [VALIDATOR ] KNSL: Validating primary data. [2025-10-02T19:50:28.814470] [DEBUG] [VALIDATOR ] KNSL: All expected trading days are present. [2025-10-02T19:50:28.814555] [DEBUG] [VALIDATOR ] KNSL: Primary data validation passed. [2025-10-02T19:50:28.815143] [INFO ] [MAIN ] KNSL: Fetched primary data is valid. [2025-10-02T19:50:28.815230] [DEBUG] [LOCAL ] KNSL: Saving primary data. [2025-10-02T19:50:28.816107] [DEBUG] [LOCAL ] KNSL: Trimmed 26695 records to 18336 (keeping 200 days of data) [2025-10-02T19:50:28.949337] [DEBUG] [LOCAL ] KNSL: Primary data saved (18336 records). [2025-10-02T19:50:28.949498] [INFO ] [MAIN ] KNSL: Full history saved. [2025-10-02T19:50:28.949588] [INFO ] [MAIN ] Update Progress: 1208/2370 symbols completed. KNSL took 40.5s. Estimated remaining: 2h 43m 56s. Rate: 7.1 symbols/min [2025-10-02T19:50:29.073516] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-04. [2025-10-02T19:50:29.144385] [INFO ] [MAIN ] KODK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:50:29.179822] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-02 (2.51 seconds). [2025-10-02T19:50:29.227061] [DEBUG] [LOCAL ] KODK: Loaded 43459 existing records from primary storage. [2025-10-02T19:50:29.227376] [INFO ] [MAIN ] KODK: Loaded 43459 existing records. [2025-10-02T19:50:29.424724] [WARN ] [MAIN ] KODK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:50:29.424939] [INFO ] [MAIN ] KODK: Wiping existing primary data before full refresh. [2025-10-02T19:50:29.424987] [INFO ] [LOCAL ] KODK: Starting deletion of primary data. [2025-10-02T19:50:29.426232] [DEBUG] [LOCAL ] KODK: Deleted primary data file. [2025-10-02T19:50:29.426294] [INFO ] [MAIN ] KODK: Starting full primary refresh. [2025-10-02T19:50:29.827322] [INFO ] [REMOTE ] KODK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:50:29.872969] [INFO ] [REMOTE ] KODK: Fetching primary data for 2024-12. [2025-10-02T19:50:29.969325] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-02T19:50:30.673034] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-07. [2025-10-02T19:50:30.806275] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-02T19:50:31.233329] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-02T19:50:31.472998] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-05. [2025-10-02T19:50:32.272971] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-01. [2025-10-02T19:50:32.333191] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-02T19:50:33.072971] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-03. [2025-10-02T19:50:33.133098] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-02T19:50:33.591977] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-02T19:50:33.872993] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-06. [2025-10-02T19:50:34.672991] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-02. [2025-10-02T19:50:35.472979] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-08. [2025-10-02T19:50:35.596818] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-02T19:50:35.749240] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-03 (2.68 seconds). [2025-10-02T19:50:35.803237] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-02T19:50:36.273072] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-07. [2025-10-02T19:50:37.053345] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-02T19:50:37.072981] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-09. [2025-10-02T19:50:37.730633] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-02T19:50:37.873012] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-04. [2025-10-02T19:50:38.319066] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-02T19:50:38.673012] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-08. [2025-10-02T19:50:39.473083] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-03. [2025-10-02T19:50:40.273049] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-10. [2025-10-02T19:50:40.452904] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-04 (2.58 seconds). [2025-10-02T19:50:40.515606] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-02T19:50:40.683673] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-02T19:50:41.073045] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-09. [2025-10-02T19:50:41.388980] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-02T19:50:41.391056] [INFO ] [REMOTE ] KNTK: Full fetch complete (64649 records). [2025-10-02T19:50:41.391204] [DEBUG] [VALIDATOR ] KNTK: Validating primary data. [2025-10-02T19:50:41.876098] [DEBUG] [VALIDATOR ] KNTK: All expected trading days are present. [2025-10-02T19:50:41.875824] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-04. [2025-10-02T19:50:41.876245] [DEBUG] [VALIDATOR ] KNTK: Primary data validation passed. [2025-10-02T19:50:41.879322] [INFO ] [MAIN ] KNTK: Fetched primary data is valid. [2025-10-02T19:50:41.879499] [DEBUG] [LOCAL ] KNTK: Saving primary data. [2025-10-02T19:50:41.881513] [DEBUG] [LOCAL ] KNTK: Trimmed 64649 records to 46533 (keeping 200 days of data) [2025-10-02T19:50:42.179347] [DEBUG] [LOCAL ] KNTK: Primary data saved (46533 records). [2025-10-02T19:50:42.179493] [INFO ] [MAIN ] KNTK: Full history saved. [2025-10-02T19:50:42.179706] [INFO ] [MAIN ] Update Progress: 1209/2370 symbols completed. KNTK took 32.6s. Estimated remaining: 2h 43m 52s. Rate: 7.1 symbols/min [2025-10-02T19:50:42.365426] [INFO ] [MAIN ] KOF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:50:42.393147] [DEBUG] [LOCAL ] KOF: Loaded 26133 existing records from primary storage. [2025-10-02T19:50:42.393417] [INFO ] [MAIN ] KOF: Loaded 26133 existing records. [2025-10-02T19:50:42.589793] [WARN ] [MAIN ] KOF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:50:42.590332] [INFO ] [MAIN ] KOF: Wiping existing primary data before full refresh. [2025-10-02T19:50:42.590389] [INFO ] [LOCAL ] KOF: Starting deletion of primary data. [2025-10-02T19:50:42.591264] [DEBUG] [LOCAL ] KOF: Deleted primary data file. [2025-10-02T19:50:42.591341] [INFO ] [MAIN ] KOF: Starting full primary refresh. [2025-10-02T19:50:42.678132] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-05. [2025-10-02T19:50:43.009783] [INFO ] [REMOTE ] KOF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:50:43.043228] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-02T19:50:43.472989] [INFO ] [REMOTE ] KOF: Fetching primary data for 2024-12. [2025-10-02T19:50:43.513173] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-02T19:50:44.273019] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-10. [2025-10-02T19:50:44.289687] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-02T19:50:45.078156] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-01. [2025-10-02T19:50:45.103147] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-10-02T19:50:45.406760] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-02T19:50:45.408956] [INFO ] [REMOTE ] KNX: Full fetch complete (75786 records). [2025-10-02T19:50:45.409217] [DEBUG] [VALIDATOR ] KNX: Validating primary data. [2025-10-02T19:50:45.875428] [DEBUG] [VALIDATOR ] KNX: All expected trading days are present. [2025-10-02T19:50:45.875157] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-05. [2025-10-02T19:50:45.876361] [DEBUG] [VALIDATOR ] KNX: Primary data validation passed. [2025-10-02T19:50:45.877447] [INFO ] [MAIN ] KNX: Fetched primary data is valid. [2025-10-02T19:50:45.877606] [DEBUG] [LOCAL ] KNX: Saving primary data. [2025-10-02T19:50:45.879345] [DEBUG] [LOCAL ] KNX: Trimmed 75786 records to 52978 (keeping 200 days of data) [2025-10-02T19:50:46.239116] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-02T19:50:46.266893] [DEBUG] [LOCAL ] KNX: Primary data saved (52978 records). [2025-10-02T19:50:46.267049] [INFO ] [MAIN ] KNX: Full history saved. [2025-10-02T19:50:46.267246] [INFO ] [MAIN ] Update Progress: 1210/2370 symbols completed. KNX took 35.2s. Estimated remaining: 2h 43m 39s. Rate: 7.1 symbols/min [2025-10-02T19:50:46.448354] [INFO ] [MAIN ] KOP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:50:46.467435] [DEBUG] [LOCAL ] KOP: Loaded 17610 existing records from primary storage. [2025-10-02T19:50:46.467725] [INFO ] [MAIN ] KOP: Loaded 17610 existing records. [2025-10-02T19:50:46.667385] [WARN ] [MAIN ] KOP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:50:46.667743] [INFO ] [MAIN ] KOP: Wiping existing primary data before full refresh. [2025-10-02T19:50:46.667806] [INFO ] [LOCAL ] KOP: Starting deletion of primary data. [2025-10-02T19:50:46.668520] [DEBUG] [LOCAL ] KOP: Deleted primary data file. [2025-10-02T19:50:46.668580] [INFO ] [MAIN ] KOP: Starting full primary refresh. [2025-10-02T19:50:46.679984] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-02. [2025-10-02T19:50:47.058336] [INFO ] [REMOTE ] KOP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:50:47.478124] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-06. [2025-10-02T19:50:47.500558] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-02T19:50:47.831771] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-02T19:50:48.272997] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-03. [2025-10-02T19:50:49.072983] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-06. [2025-10-02T19:50:49.340229] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-02T19:50:49.692778] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-10-02T19:50:49.873013] [INFO ] [REMOTE ] KOP: Fetching primary data for 2024-12. [2025-10-02T19:50:50.512563] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-02T19:50:50.673058] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-04. [2025-10-02T19:50:50.841014] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-02T19:50:51.473024] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-07. [2025-10-02T19:50:51.613309] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-02T19:50:52.273055] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-07. [2025-10-02T19:50:53.073009] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-05. [2025-10-02T19:50:53.873073] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-01. [2025-10-02T19:50:53.927634] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-02T19:50:54.124737] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-07 (2.65 seconds). [2025-10-02T19:50:54.332776] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-02T19:50:54.495055] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-02T19:50:54.673038] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-08. [2025-10-02T19:50:55.473048] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-08. [2025-10-02T19:50:56.273018] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-06. [2025-10-02T19:50:56.371553] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-02T19:50:57.073021] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-02. [2025-10-02T19:50:57.549635] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-02T19:50:57.666616] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-02T19:50:57.873028] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-07. [2025-10-02T19:50:58.028182] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-02T19:50:58.673009] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-03. [2025-10-02T19:50:59.142235] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-02T19:50:59.371041] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-02T19:50:59.473023] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-08. [2025-10-02T19:51:00.273027] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-09. [2025-10-02T19:51:00.577876] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-02T19:51:01.073016] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-09. [2025-10-02T19:51:01.873049] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-09. [2025-10-02T19:51:02.152598] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-02T19:51:02.672998] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-04. [2025-10-02T19:51:02.740488] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-02T19:51:03.473054] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-10. [2025-10-02T19:51:03.734696] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-02T19:51:04.273070] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-05. [2025-10-02T19:51:04.526181] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-02T19:51:04.528042] [INFO ] [REMOTE ] KOF: Full fetch complete (37312 records). [2025-10-02T19:51:04.528165] [DEBUG] [VALIDATOR ] KOF: Validating primary data. [2025-10-02T19:51:04.960120] [DEBUG] [VALIDATOR ] KOF: All expected trading days are present. [2025-10-02T19:51:04.960342] [DEBUG] [VALIDATOR ] KOF: Primary data validation passed. [2025-10-02T19:51:04.961248] [INFO ] [MAIN ] KOF: Fetched primary data is valid. [2025-10-02T19:51:04.961331] [DEBUG] [LOCAL ] KOF: Saving primary data. [2025-10-02T19:51:04.962747] [DEBUG] [LOCAL ] KOF: Trimmed 37312 records to 26353 (keeping 200 days of data) [2025-10-02T19:51:04.995051] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-09 (3.12 seconds). [2025-10-02T19:51:05.097271] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-10. [2025-10-02T19:51:05.176280] [DEBUG] [LOCAL ] KOF: Primary data saved (26353 records). [2025-10-02T19:51:05.176444] [INFO ] [MAIN ] KOF: Full history saved. [2025-10-02T19:51:05.176556] [INFO ] [MAIN ] Update Progress: 1211/2370 symbols completed. KOF took 23.0s. Estimated remaining: 2h 43m 41s. Rate: 7.1 symbols/min [2025-10-02T19:51:05.319704] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-02T19:51:05.384234] [INFO ] [MAIN ] KORE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:51:05.384401] [DEBUG] [LOCAL ] KORE: No existing data file found in primary storage. [2025-10-02T19:51:05.384440] [WARN ] [MAIN ] KORE: No existing data found, performing full refresh instead. [2025-10-02T19:51:05.384555] [INFO ] [MAIN ] KORE: Wiping existing primary data before full refresh. [2025-10-02T19:51:05.384596] [INFO ] [LOCAL ] KORE: Starting deletion of primary data. [2025-10-02T19:51:05.384711] [DEBUG] [LOCAL ] KORE: No primary data file found to delete. [2025-10-02T19:51:05.384755] [INFO ] [MAIN ] KORE: Starting full primary refresh. [2025-10-02T19:51:05.802024] [INFO ] [REMOTE ] KORE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:51:05.873026] [INFO ] [REMOTE ] KORE: Fetching primary data for 2024-12. [2025-10-02T19:51:06.351221] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-02T19:51:06.353910] [INFO ] [REMOTE ] KODK: Full fetch complete (63433 records). [2025-10-02T19:51:06.354047] [DEBUG] [VALIDATOR ] KODK: Validating primary data. [2025-10-02T19:51:06.681421] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-06. [2025-10-02T19:51:06.801362] [DEBUG] [VALIDATOR ] KODK: All expected trading days are present. [2025-10-02T19:51:06.801527] [DEBUG] [VALIDATOR ] KODK: Primary data validation passed. [2025-10-02T19:51:06.802682] [INFO ] [MAIN ] KODK: Fetched primary data is valid. [2025-10-02T19:51:06.802832] [DEBUG] [LOCAL ] KODK: Saving primary data. [2025-10-02T19:51:06.804987] [DEBUG] [LOCAL ] KODK: Trimmed 63433 records to 43779 (keeping 200 days of data) [2025-10-02T19:51:07.023710] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-02T19:51:07.090201] [DEBUG] [LOCAL ] KODK: Primary data saved (43779 records). [2025-10-02T19:51:07.090344] [INFO ] [MAIN ] KODK: Full history saved. [2025-10-02T19:51:07.090444] [INFO ] [MAIN ] Update Progress: 1212/2370 symbols completed. KODK took 38.1s. Estimated remaining: 2h 43m 26s. Rate: 7.1 symbols/min [2025-10-02T19:51:07.286110] [INFO ] [MAIN ] KOS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:51:07.352708] [DEBUG] [LOCAL ] KOS: Loaded 53059 existing records from primary storage. [2025-10-02T19:51:07.353176] [INFO ] [MAIN ] KOS: Loaded 53059 existing records. [2025-10-02T19:51:07.478110] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-10. [2025-10-02T19:51:07.555426] [WARN ] [MAIN ] KOS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:51:07.555954] [INFO ] [MAIN ] KOS: Wiping existing primary data before full refresh. [2025-10-02T19:51:07.556200] [INFO ] [LOCAL ] KOS: Starting deletion of primary data. [2025-10-02T19:51:07.558465] [DEBUG] [LOCAL ] KOS: Deleted primary data file. [2025-10-02T19:51:07.558545] [INFO ] [MAIN ] KOS: Starting full primary refresh. [2025-10-02T19:51:07.689673] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-02T19:51:07.985577] [INFO ] [REMOTE ] KOS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:51:08.273016] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-01. [2025-10-02T19:51:09.073005] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-07. [2025-10-02T19:51:09.096068] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-02T19:51:09.847119] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-10 (2.37 seconds). [2025-10-02T19:51:09.850414] [INFO ] [REMOTE ] KO: Full fetch complete (77214 records). [2025-10-02T19:51:09.850572] [DEBUG] [VALIDATOR ] KO: Validating primary data. [2025-10-02T19:51:09.884958] [INFO ] [REMOTE ] KOS: Fetching primary data for 2024-12. [2025-10-02T19:51:10.062423] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-02T19:51:10.081242] [WARN ] [VALIDATOR ] KO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-02T19:51:10.088364] [FATAL] [MAIN ] KO: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:51:10.088534] [WARN ] [MAIN ] KO: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:51:10.088633] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-02T19:51:10.088782] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-02T19:51:10.088870] [INFO ] [LOCAL ] KO: Starting deletion of derivative data. [2025-10-02T19:51:10.088966] [DEBUG] [LOCAL ] KO: No derivative data file found to delete. [2025-10-02T19:51:10.089079] [INFO ] [MAIN ] Update Progress: 1213/2370 symbols completed. KO took 54.2s. Estimated remaining: 2h 43m 12s. Rate: 7.1 symbols/min [2025-10-02T19:51:10.283200] [INFO ] [MAIN ] KR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:51:10.345027] [DEBUG] [LOCAL ] KR: Loaded 53681 existing records from primary storage. [2025-10-02T19:51:10.345438] [INFO ] [MAIN ] KR: Loaded 53681 existing records. [2025-10-02T19:51:10.547245] [WARN ] [MAIN ] KR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:51:10.547528] [INFO ] [MAIN ] KR: Wiping existing primary data before full refresh. [2025-10-02T19:51:10.547589] [INFO ] [LOCAL ] KR: Starting deletion of primary data. [2025-10-02T19:51:10.549999] [DEBUG] [LOCAL ] KR: Deleted primary data file. [2025-10-02T19:51:10.550094] [INFO ] [MAIN ] KR: Starting full primary refresh. [2025-10-02T19:51:10.678119] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-08. [2025-10-02T19:51:10.975195] [INFO ] [REMOTE ] KR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:51:11.349206] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-02T19:51:11.472977] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-02. [2025-10-02T19:51:11.784460] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-02T19:51:11.838738] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-02T19:51:12.273046] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-09. [2025-10-02T19:51:13.073037] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-01. [2025-10-02T19:51:13.355416] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-02T19:51:13.873002] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-10. [2025-10-02T19:51:14.621568] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-02T19:51:14.623287] [INFO ] [REMOTE ] KOP: Full fetch complete (25484 records). [2025-10-02T19:51:14.623392] [DEBUG] [VALIDATOR ] KOP: Validating primary data. [2025-10-02T19:51:14.697990] [INFO ] [REMOTE ] KR: Fetching primary data for 2024-12. [2025-10-02T19:51:14.830070] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-02T19:51:15.082182] [DEBUG] [VALIDATOR ] KOP: All expected trading days are present. [2025-10-02T19:51:15.082272] [DEBUG] [VALIDATOR ] KOP: Primary data validation passed. [2025-10-02T19:51:15.083039] [INFO ] [MAIN ] KOP: Fetched primary data is valid. [2025-10-02T19:51:15.083164] [DEBUG] [LOCAL ] KOP: Saving primary data. [2025-10-02T19:51:15.084125] [DEBUG] [LOCAL ] KOP: Trimmed 25484 records to 17741 (keeping 200 days of data) [2025-10-02T19:51:15.204158] [DEBUG] [LOCAL ] KOP: Primary data saved (17741 records). [2025-10-02T19:51:15.204315] [INFO ] [MAIN ] KOP: Full history saved. [2025-10-02T19:51:15.204404] [INFO ] [MAIN ] Update Progress: 1214/2370 symbols completed. KOP took 28.9s. Estimated remaining: 2h 43m 1s. Rate: 7.1 symbols/min [2025-10-02T19:51:15.480959] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-03. [2025-10-02T19:51:15.486860] [INFO ] [MAIN ] KRC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:51:15.557960] [DEBUG] [LOCAL ] KRC: Loaded 48262 existing records from primary storage. [2025-10-02T19:51:15.558459] [INFO ] [MAIN ] KRC: Loaded 48262 existing records. [2025-10-02T19:51:15.821961] [WARN ] [MAIN ] KRC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:51:15.822222] [INFO ] [MAIN ] KRC: Wiping existing primary data before full refresh. [2025-10-02T19:51:15.822279] [INFO ] [LOCAL ] KRC: Starting deletion of primary data. [2025-10-02T19:51:15.824124] [DEBUG] [LOCAL ] KRC: Deleted primary data file. [2025-10-02T19:51:15.824194] [INFO ] [MAIN ] KRC: Starting full primary refresh. [2025-10-02T19:51:15.961192] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-02T19:51:16.275956] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-04. [2025-10-02T19:51:16.325580] [INFO ] [REMOTE ] KRC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:51:16.627610] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-02T19:51:16.788885] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-02T19:51:17.073014] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-01. [2025-10-02T19:51:17.873017] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-02. [2025-10-02T19:51:18.520633] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-02T19:51:18.673020] [INFO ] [REMOTE ] KRC: Fetching primary data for 2024-12. [2025-10-02T19:51:19.473039] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-02. [2025-10-02T19:51:19.519010] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-02T19:51:19.834394] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-02T19:51:20.272993] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-03. [2025-10-02T19:51:21.073027] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-01. [2025-10-02T19:51:21.279223] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-02T19:51:21.873033] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-03. [2025-10-02T19:51:22.085108] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-02T19:51:22.623464] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-02T19:51:22.673025] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-04. [2025-10-02T19:51:23.473021] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-02. [2025-10-02T19:51:23.868039] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-02T19:51:24.273002] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-04. [2025-10-02T19:51:24.590228] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-02T19:51:25.075860] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-05. [2025-10-02T19:51:25.081373] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-02T19:51:25.873011] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-05. [2025-10-02T19:51:26.203105] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-02T19:51:26.367412] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-02T19:51:26.511810] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-02T19:51:26.673015] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-03. [2025-10-02T19:51:27.472999] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-06. [2025-10-02T19:51:27.922718] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-02T19:51:28.273011] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-07. [2025-10-02T19:51:28.422052] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-02T19:51:28.756953] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-02T19:51:29.073003] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-05. [2025-10-02T19:51:29.873005] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-04. [2025-10-02T19:51:30.672988] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-08. [2025-10-02T19:51:31.060333] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-02T19:51:31.172114] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-02T19:51:31.179767] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-02T19:51:31.472995] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-09. [2025-10-02T19:51:31.924284] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-02T19:51:32.273011] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-06. [2025-10-02T19:51:33.073032] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-10. [2025-10-02T19:51:33.465572] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-02T19:51:33.466348] [INFO ] [REMOTE ] KORE: Full fetch complete (5936 records). [2025-10-02T19:51:33.466422] [DEBUG] [VALIDATOR ] KORE: Validating primary data. [2025-10-02T19:51:33.871519] [DEBUG] [VALIDATOR ] KORE: All expected trading days are present. [2025-10-02T19:51:33.871734] [DEBUG] [VALIDATOR ] KORE: Primary data validation passed. [2025-10-02T19:51:33.872111] [INFO ] [MAIN ] KORE: Fetched primary data is valid. [2025-10-02T19:51:33.872232] [DEBUG] [LOCAL ] KORE: Saving primary data. [2025-10-02T19:51:33.872978] [DEBUG] [LOCAL ] KORE: Trimmed 5936 records to 2034 (keeping 200 days of data) [2025-10-02T19:51:33.873058] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-05. [2025-10-02T19:51:33.887070] [DEBUG] [LOCAL ] KORE: Primary data saved (2034 records). [2025-10-02T19:51:33.887264] [INFO ] [MAIN ] KORE: Full history saved. [2025-10-02T19:51:33.887361] [INFO ] [MAIN ] Update Progress: 1215/2370 symbols completed. KORE took 28.7s. Estimated remaining: 2h 43m 2s. Rate: 7.1 symbols/min [2025-10-02T19:51:34.116598] [INFO ] [MAIN ] KREF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:51:34.120232] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-02T19:51:34.167278] [DEBUG] [LOCAL ] KREF: Loaded 37580 existing records from primary storage. [2025-10-02T19:51:34.167585] [INFO ] [MAIN ] KREF: Loaded 37580 existing records. [2025-10-02T19:51:34.359671] [WARN ] [MAIN ] KREF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:51:34.359907] [INFO ] [MAIN ] KREF: Wiping existing primary data before full refresh. [2025-10-02T19:51:34.359965] [INFO ] [LOCAL ] KREF: Starting deletion of primary data. [2025-10-02T19:51:34.361388] [DEBUG] [LOCAL ] KREF: Deleted primary data file. [2025-10-02T19:51:34.361452] [INFO ] [MAIN ] KREF: Starting full primary refresh. [2025-10-02T19:51:34.678171] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-07. [2025-10-02T19:51:34.785607] [INFO ] [REMOTE ] KREF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:51:35.473057] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-06. [2025-10-02T19:51:35.594840] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-02T19:51:36.272962] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-06. [2025-10-02T19:51:36.644718] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-02T19:51:37.072981] [INFO ] [REMOTE ] KREF: Fetching primary data for 2024-12. [2025-10-02T19:51:37.256302] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-02T19:51:37.623278] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-02T19:51:37.873005] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-07. [2025-10-02T19:51:38.417229] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-02T19:51:38.673060] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-07. [2025-10-02T19:51:39.460176] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-02T19:51:39.473081] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-08. [2025-10-02T19:51:39.918912] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-02T19:51:40.273010] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-08. [2025-10-02T19:51:41.072995] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-08. [2025-10-02T19:51:41.341965] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-02T19:51:41.713875] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-02T19:51:41.873016] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-09. [2025-10-02T19:51:42.672984] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-09. [2025-10-02T19:51:42.764587] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-02T19:51:43.473019] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-09. [2025-10-02T19:51:43.919946] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-02T19:51:44.001070] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-02T19:51:44.273000] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-10. [2025-10-02T19:51:44.677101] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-02T19:51:45.073018] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-10. [2025-10-02T19:51:45.873004] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-10. [2025-10-02T19:51:46.012615] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-02T19:51:46.014801] [INFO ] [REMOTE ] KR: Full fetch complete (77678 records). [2025-10-02T19:51:46.014977] [DEBUG] [VALIDATOR ] KR: Validating primary data. [2025-10-02T19:51:46.440257] [DEBUG] [VALIDATOR ] KR: All expected trading days are present. [2025-10-02T19:51:46.440347] [DEBUG] [VALIDATOR ] KR: Primary data validation passed. [2025-10-02T19:51:46.441609] [INFO ] [MAIN ] KR: Fetched primary data is valid. [2025-10-02T19:51:46.441707] [DEBUG] [LOCAL ] KR: Saving primary data. [2025-10-02T19:51:46.443556] [DEBUG] [LOCAL ] KR: Trimmed 77678 records to 54071 (keeping 200 days of data) [2025-10-02T19:51:46.682486] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-01. [2025-10-02T19:51:46.684039] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-02T19:51:46.689027] [INFO ] [REMOTE ] KOS: Full fetch complete (76886 records). [2025-10-02T19:51:46.690180] [DEBUG] [VALIDATOR ] KOS: Validating primary data. [2025-10-02T19:51:47.145375] [DEBUG] [VALIDATOR ] KOS: All expected trading days are present. [2025-10-02T19:51:47.145732] [DEBUG] [VALIDATOR ] KOS: Primary data validation passed. [2025-10-02T19:51:47.147486] [INFO ] [MAIN ] KOS: Fetched primary data is valid. [2025-10-02T19:51:47.147919] [DEBUG] [LOCAL ] KOS: Saving primary data. [2025-10-02T19:51:47.151591] [DEBUG] [LOCAL ] KOS: Trimmed 76886 records to 53441 (keeping 200 days of data) [2025-10-02T19:51:47.256453] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-02T19:51:47.260358] [INFO ] [REMOTE ] KRC: Full fetch complete (69858 records). [2025-10-02T19:51:47.260771] [DEBUG] [VALIDATOR ] KRC: Validating primary data. [2025-10-02T19:51:47.950005] [DEBUG] [VALIDATOR ] KRC: All expected trading days are present. [2025-10-02T19:51:47.950446] [DEBUG] [VALIDATOR ] KRC: Primary data validation passed. [2025-10-02T19:51:47.952704] [INFO ] [MAIN ] KRC: Fetched primary data is valid. [2025-10-02T19:51:47.954615] [DEBUG] [LOCAL ] KRC: Saving primary data. [2025-10-02T19:51:47.983026] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-02T19:51:47.994061] [DEBUG] [LOCAL ] KRC: Trimmed 69858 records to 48621 (keeping 200 days of data) [2025-10-02T19:51:47.994410] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-02. [2025-10-02T19:51:48.110241] [DEBUG] [LOCAL ] KR: Primary data saved (54071 records). [2025-10-02T19:51:48.111871] [INFO ] [MAIN ] KR: Full history saved. [2025-10-02T19:51:48.113580] [INFO ] [MAIN ] Update Progress: 1216/2370 symbols completed. KR took 38.0s. Estimated remaining: 2h 42m 59s. Rate: 7.1 symbols/min [2025-10-02T19:51:48.339722] [INFO ] [MAIN ] KRG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:51:48.539100] [DEBUG] [LOCAL ] KOS: Primary data saved (53441 records). [2025-10-02T19:51:48.549903] [INFO ] [MAIN ] KOS: Full history saved. [2025-10-02T19:51:48.552506] [INFO ] [MAIN ] Update Progress: 1217/2370 symbols completed. KOS took 41.5s. Estimated remaining: 2h 42m 43s. Rate: 7.1 symbols/min [2025-10-02T19:51:48.685620] [DEBUG] [LOCAL ] KRG: Loaded 49159 existing records from primary storage. [2025-10-02T19:51:48.714880] [INFO ] [MAIN ] KRG: Loaded 49159 existing records. [2025-10-02T19:51:48.779143] [INFO ] [MAIN ] KRMN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:51:48.843537] [DEBUG] [LOCAL ] KRMN: No existing data file found in primary storage. [2025-10-02T19:51:48.855736] [WARN ] [MAIN ] KRMN: No existing data found, performing full refresh instead. [2025-10-02T19:51:48.874098] [INFO ] [MAIN ] KRMN: Wiping existing primary data before full refresh. [2025-10-02T19:51:48.945666] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-02T19:51:48.979612] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-02T19:51:49.001794] [INFO ] [MAIN ] KRMN: Starting full primary refresh. [2025-10-02T19:51:49.073383] [WARN ] [MAIN ] KRG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:51:49.103583] [INFO ] [MAIN ] KRG: Wiping existing primary data before full refresh. [2025-10-02T19:51:49.109705] [INFO ] [LOCAL ] KRG: Starting deletion of primary data. [2025-10-02T19:51:49.159704] [DEBUG] [LOCAL ] KRG: Deleted primary data file. [2025-10-02T19:51:49.173344] [DEBUG] [LOCAL ] KRC: Primary data saved (48621 records). [2025-10-02T19:51:49.173517] [INFO ] [MAIN ] KRC: Full history saved. [2025-10-02T19:51:49.173627] [INFO ] [MAIN ] KRG: Starting full primary refresh. [2025-10-02T19:51:49.184469] [INFO ] [MAIN ] Update Progress: 1218/2370 symbols completed. KRC took 34.0s. Estimated remaining: 2h 42m 27s. Rate: 7.1 symbols/min [2025-10-02T19:51:49.222198] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-02T19:51:49.386509] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-03. [2025-10-02T19:51:49.880380] [INFO ] [MAIN ] KRO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:51:50.078611] [INFO ] [REMOTE ] KRMN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:51:50.100439] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2024-12. [2025-10-02T19:51:50.164385] [INFO ] [REMOTE ] KRG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:51:50.165079] [INFO ] [REMOTE ] KRG: Fetching primary data for 2024-12. [2025-10-02T19:51:50.185294] [DEBUG] [LOCAL ] KRO: Loaded 26074 existing records from primary storage. [2025-10-02T19:51:50.185555] [INFO ] [MAIN ] KRO: Loaded 26074 existing records. [2025-10-02T19:51:50.369466] [WARN ] [MAIN ] KRO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:51:50.369831] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T19:51:50.370292] [INFO ] [MAIN ] KRO: Wiping existing primary data before full refresh. [2025-10-02T19:51:50.370624] [INFO ] [LOCAL ] KRO: Starting deletion of primary data. [2025-10-02T19:51:50.370739] [WARN ] [REMOTE ] KRMN: No data returned for month 2024-12 [2025-10-02T19:51:50.371003] [FATAL] [REMOTE ] KRMN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T19:51:50.371091] [FATAL] [MAIN ] KRMN: Failed to fetch primary data. [2025-10-02T19:51:50.371159] [WARN ] [MAIN ] KRMN: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T19:51:50.371231] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-02T19:51:50.371304] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-02T19:51:50.371348] [INFO ] [LOCAL ] KRMN: Starting deletion of derivative data. [2025-10-02T19:51:50.371391] [DEBUG] [LOCAL ] KRMN: No derivative data file found to delete. [2025-10-02T19:51:50.371450] [INFO ] [MAIN ] Update Progress: 1219/2370 symbols completed. KRMN took 1.8s. Estimated remaining: 2h 42m 12s. Rate: 7.1 symbols/min [2025-10-02T19:51:50.376762] [DEBUG] [LOCAL ] KRO: Deleted primary data file. [2025-10-02T19:51:50.411705] [INFO ] [MAIN ] KRO: Starting full primary refresh. [2025-10-02T19:51:50.734444] [INFO ] [MAIN ] KRP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:51:51.039442] [INFO ] [REMOTE ] KRO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:51:51.040425] [DEBUG] [LOCAL ] KRP: Loaded 37049 existing records from primary storage. [2025-10-02T19:51:51.040979] [INFO ] [REMOTE ] KRO: Fetching primary data for 2024-12. [2025-10-02T19:51:51.041467] [INFO ] [MAIN ] KRP: Loaded 37049 existing records. [2025-10-02T19:51:51.202073] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-02T19:51:51.290151] [WARN ] [MAIN ] KRP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:51:51.290404] [INFO ] [MAIN ] KRP: Wiping existing primary data before full refresh. [2025-10-02T19:51:51.290483] [INFO ] [LOCAL ] KRP: Starting deletion of primary data. [2025-10-02T19:51:51.291861] [DEBUG] [LOCAL ] KRP: Deleted primary data file. [2025-10-02T19:51:51.291941] [INFO ] [MAIN ] KRP: Starting full primary refresh. [2025-10-02T19:51:51.473920] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-04. [2025-10-02T19:51:51.696381] [INFO ] [REMOTE ] KRP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:51:51.771409] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-02T19:51:52.201165] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-02T19:51:52.273029] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-01. [2025-10-02T19:51:52.797994] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-02T19:51:53.073037] [INFO ] [REMOTE ] KRP: Fetching primary data for 2024-12. [2025-10-02T19:51:53.826204] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-02T19:51:53.873010] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-01. [2025-10-02T19:51:54.456618] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-02T19:51:54.673056] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-02. [2025-10-02T19:51:54.853428] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-02T19:51:55.473011] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-05. [2025-10-02T19:51:56.145511] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-02T19:51:56.272994] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-03. [2025-10-02T19:51:57.005595] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-02T19:51:57.072996] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-06. [2025-10-02T19:51:57.590498] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-02T19:51:57.873004] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-01. [2025-10-02T19:51:58.354044] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-02T19:51:58.673016] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-04. [2025-10-02T19:51:59.297490] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-02T19:51:59.473025] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-02. [2025-10-02T19:52:00.278098] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-02. [2025-10-02T19:52:00.300117] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-02T19:52:00.964508] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-02T19:52:01.073038] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-05. [2025-10-02T19:52:01.175681] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-02T19:52:01.872995] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-07. [2025-10-02T19:52:02.447788] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-02T19:52:02.673053] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-06. [2025-10-02T19:52:03.339222] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-02T19:52:03.473032] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-03. [2025-10-02T19:52:03.872439] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-02T19:52:04.273009] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-03. [2025-10-02T19:52:04.571396] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-02T19:52:05.073046] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-08. [2025-10-02T19:52:05.766188] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-02T19:52:05.873060] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-04. [2025-10-02T19:52:06.450018] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-02T19:52:06.673029] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-07. [2025-10-02T19:52:07.365604] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-02T19:52:07.472994] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-09. [2025-10-02T19:52:08.272994] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-04. [2025-10-02T19:52:08.431240] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-02T19:52:08.814916] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-02T19:52:09.073012] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-10. [2025-10-02T19:52:09.132930] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-02T19:52:09.873008] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-08. [2025-10-02T19:52:10.366702] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-02T19:52:10.372176] [INFO ] [REMOTE ] KREF: Full fetch complete (52603 records). [2025-10-02T19:52:10.372315] [DEBUG] [VALIDATOR ] KREF: Validating primary data. [2025-10-02T19:52:10.678242] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-05. [2025-10-02T19:52:10.825572] [DEBUG] [VALIDATOR ] KREF: All expected trading days are present. [2025-10-02T19:52:10.825717] [DEBUG] [VALIDATOR ] KREF: Primary data validation passed. [2025-10-02T19:52:10.826803] [INFO ] [MAIN ] KREF: Fetched primary data is valid. [2025-10-02T19:52:10.826885] [DEBUG] [LOCAL ] KREF: Saving primary data. [2025-10-02T19:52:10.828239] [DEBUG] [LOCAL ] KREF: Trimmed 52603 records to 37907 (keeping 200 days of data) [2025-10-02T19:52:11.067795] [DEBUG] [LOCAL ] KREF: Primary data saved (37907 records). [2025-10-02T19:52:11.067955] [INFO ] [MAIN ] KREF: Full history saved. [2025-10-02T19:52:11.068047] [INFO ] [MAIN ] Update Progress: 1220/2370 symbols completed. KREF took 37.2s. Estimated remaining: 2h 42m 15s. Rate: 7.1 symbols/min [2025-10-02T19:52:11.266494] [INFO ] [MAIN ] KSS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:52:11.322463] [DEBUG] [LOCAL ] KSS: Loaded 53603 existing records from primary storage. [2025-10-02T19:52:11.322843] [INFO ] [MAIN ] KSS: Loaded 53603 existing records. [2025-10-02T19:52:11.479975] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-05. [2025-10-02T19:52:11.528599] [WARN ] [MAIN ] KSS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:52:11.529410] [INFO ] [MAIN ] KSS: Wiping existing primary data before full refresh. [2025-10-02T19:52:11.529700] [INFO ] [LOCAL ] KSS: Starting deletion of primary data. [2025-10-02T19:52:11.540354] [DEBUG] [LOCAL ] KSS: Deleted primary data file. [2025-10-02T19:52:11.545789] [INFO ] [MAIN ] KSS: Starting full primary refresh. [2025-10-02T19:52:11.599958] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-02T19:52:11.973105] [INFO ] [REMOTE ] KSS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:52:11.998433] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-02T19:52:12.273005] [INFO ] [REMOTE ] KSS: Fetching primary data for 2024-12. [2025-10-02T19:52:12.681198] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-02T19:52:13.073005] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-09. [2025-10-02T19:52:13.873014] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-06. [2025-10-02T19:52:14.301909] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-02T19:52:14.673003] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-01. [2025-10-02T19:52:14.778175] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-02T19:52:14.878079] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-02T19:52:15.473007] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-06. [2025-10-02T19:52:16.273017] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-10. [2025-10-02T19:52:16.619870] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-02T19:52:16.677325] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-02T19:52:17.073008] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-02. [2025-10-02T19:52:17.567224] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-02T19:52:17.569347] [INFO ] [REMOTE ] KRG: Full fetch complete (71121 records). [2025-10-02T19:52:17.569579] [DEBUG] [VALIDATOR ] KRG: Validating primary data. [2025-10-02T19:52:17.880322] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-07. [2025-10-02T19:52:18.025663] [DEBUG] [VALIDATOR ] KRG: All expected trading days are present. [2025-10-02T19:52:18.025838] [DEBUG] [VALIDATOR ] KRG: Primary data validation passed. [2025-10-02T19:52:18.026830] [INFO ] [MAIN ] KRG: Fetched primary data is valid. [2025-10-02T19:52:18.026900] [DEBUG] [LOCAL ] KRG: Saving primary data. [2025-10-02T19:52:18.028795] [DEBUG] [LOCAL ] KRG: Trimmed 71121 records to 49512 (keeping 200 days of data) [2025-10-02T19:52:18.350097] [DEBUG] [LOCAL ] KRG: Primary data saved (49512 records). [2025-10-02T19:52:18.350329] [INFO ] [MAIN ] KRG: Full history saved. [2025-10-02T19:52:18.352023] [INFO ] [MAIN ] Update Progress: 1221/2370 symbols completed. KRG took 30.2s. Estimated remaining: 2h 42m 5s. Rate: 7.1 symbols/min [2025-10-02T19:52:18.545232] [INFO ] [MAIN ] KT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:52:18.594357] [DEBUG] [LOCAL ] KT: Loaded 45686 existing records from primary storage. [2025-10-02T19:52:18.594707] [INFO ] [MAIN ] KT: Loaded 45686 existing records. [2025-10-02T19:52:18.678060] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-07. [2025-10-02T19:52:18.794233] [WARN ] [MAIN ] KT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:52:18.794545] [INFO ] [MAIN ] KT: Wiping existing primary data before full refresh. [2025-10-02T19:52:18.794629] [INFO ] [LOCAL ] KT: Starting deletion of primary data. [2025-10-02T19:52:18.798890] [DEBUG] [LOCAL ] KT: Deleted primary data file. [2025-10-02T19:52:18.798957] [INFO ] [MAIN ] KT: Starting full primary refresh. [2025-10-02T19:52:19.186554] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-02T19:52:19.238482] [INFO ] [REMOTE ] KT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:52:19.346711] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-02T19:52:19.472993] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-08. [2025-10-02T19:52:19.615729] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-02T19:52:20.272995] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-08. [2025-10-02T19:52:20.961300] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-02T19:52:21.073013] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-09. [2025-10-02T19:52:21.705198] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-02T19:52:21.872998] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-03. [2025-10-02T19:52:22.433027] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-02T19:52:22.672999] [INFO ] [REMOTE ] KT: Fetching primary data for 2024-12. [2025-10-02T19:52:23.473013] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-10. [2025-10-02T19:52:23.876447] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-02T19:52:24.181243] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-02T19:52:24.262614] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-02T19:52:24.264213] [INFO ] [REMOTE ] KRP: Full fetch complete (54946 records). [2025-10-02T19:52:24.264317] [DEBUG] [VALIDATOR ] KRP: Validating primary data. [2025-10-02T19:52:24.278183] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-01. [2025-10-02T19:52:24.682940] [DEBUG] [VALIDATOR ] KRP: All expected trading days are present. [2025-10-02T19:52:24.683039] [DEBUG] [VALIDATOR ] KRP: Primary data validation passed. [2025-10-02T19:52:24.683968] [INFO ] [MAIN ] KRP: Fetched primary data is valid. [2025-10-02T19:52:24.684040] [DEBUG] [LOCAL ] KRP: Saving primary data. [2025-10-02T19:52:24.685371] [DEBUG] [LOCAL ] KRP: Trimmed 54946 records to 37273 (keeping 200 days of data) [2025-10-02T19:52:24.921575] [DEBUG] [LOCAL ] KRP: Primary data saved (37273 records). [2025-10-02T19:52:24.921763] [INFO ] [MAIN ] KRP: Full history saved. [2025-10-02T19:52:24.921892] [INFO ] [MAIN ] Update Progress: 1222/2370 symbols completed. KRP took 34.6s. Estimated remaining: 2h 41m 55s. Rate: 7.1 symbols/min [2025-10-02T19:52:25.079189] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-04. [2025-10-02T19:52:25.108351] [INFO ] [MAIN ] KTB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:52:25.149951] [DEBUG] [LOCAL ] KTB: Loaded 41046 existing records from primary storage. [2025-10-02T19:52:25.150290] [INFO ] [MAIN ] KTB: Loaded 41046 existing records. [2025-10-02T19:52:25.340767] [WARN ] [MAIN ] KTB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:52:25.341034] [INFO ] [MAIN ] KTB: Wiping existing primary data before full refresh. [2025-10-02T19:52:25.341094] [INFO ] [LOCAL ] KTB: Starting deletion of primary data. [2025-10-02T19:52:25.342283] [DEBUG] [LOCAL ] KTB: Deleted primary data file. [2025-10-02T19:52:25.342348] [INFO ] [MAIN ] KTB: Starting full primary refresh. [2025-10-02T19:52:25.746152] [INFO ] [REMOTE ] KTB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:52:25.775248] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-02T19:52:25.872994] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-02. [2025-10-02T19:52:26.673024] [INFO ] [REMOTE ] KTB: Fetching primary data for 2024-12. [2025-10-02T19:52:26.827733] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-02T19:52:27.129787] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-02T19:52:27.473064] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-09. [2025-10-02T19:52:27.627526] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-02T19:52:28.272992] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-03. [2025-10-02T19:52:28.650123] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-02T19:52:29.073058] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-05. [2025-10-02T19:52:29.838275] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-02T19:52:29.873009] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-04. [2025-10-02T19:52:30.672978] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-01. [2025-10-02T19:52:31.004133] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-02T19:52:31.472975] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-06. [2025-10-02T19:52:31.600221] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-02T19:52:31.638030] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-02T19:52:32.273012] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-02. [2025-10-02T19:52:33.078179] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-10. [2025-10-02T19:52:33.099105] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-02T19:52:33.609337] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-02T19:52:33.873016] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-07. [2025-10-02T19:52:33.954677] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-02T19:52:33.957394] [INFO ] [REMOTE ] KRO: Full fetch complete (34963 records). [2025-10-02T19:52:33.957531] [DEBUG] [VALIDATOR ] KRO: Validating primary data. [2025-10-02T19:52:34.373211] [DEBUG] [VALIDATOR ] KRO: All expected trading days are present. [2025-10-02T19:52:34.373291] [DEBUG] [VALIDATOR ] KRO: Primary data validation passed. [2025-10-02T19:52:34.374073] [INFO ] [MAIN ] KRO: Fetched primary data is valid. [2025-10-02T19:52:34.374167] [DEBUG] [LOCAL ] KRO: Saving primary data. [2025-10-02T19:52:34.375412] [DEBUG] [LOCAL ] KRO: Trimmed 34963 records to 26251 (keeping 200 days of data) [2025-10-02T19:52:34.556768] [DEBUG] [LOCAL ] KRO: Primary data saved (26251 records). [2025-10-02T19:52:34.556995] [INFO ] [MAIN ] KRO: Full history saved. [2025-10-02T19:52:34.557153] [INFO ] [MAIN ] Update Progress: 1223/2370 symbols completed. KRO took 45.3s. Estimated remaining: 2h 41m 48s. Rate: 7.1 symbols/min [2025-10-02T19:52:34.678115] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-03. [2025-10-02T19:52:34.744398] [INFO ] [MAIN ] KTF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:52:34.760570] [DEBUG] [LOCAL ] KTF: Loaded 12567 existing records from primary storage. [2025-10-02T19:52:34.760884] [INFO ] [MAIN ] KTF: Loaded 12567 existing records. [2025-10-02T19:52:34.950799] [WARN ] [MAIN ] KTF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:52:34.951016] [INFO ] [MAIN ] KTF: Wiping existing primary data before full refresh. [2025-10-02T19:52:34.951076] [INFO ] [LOCAL ] KTF: Starting deletion of primary data. [2025-10-02T19:52:34.951992] [DEBUG] [LOCAL ] KTF: Deleted primary data file. [2025-10-02T19:52:34.952064] [INFO ] [MAIN ] KTF: Starting full primary refresh. [2025-10-02T19:52:35.371722] [INFO ] [REMOTE ] KTF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:52:35.473030] [INFO ] [REMOTE ] KTF: Fetching primary data for 2024-12. [2025-10-02T19:52:36.171504] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-02T19:52:36.219487] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-02T19:52:36.273016] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-08. [2025-10-02T19:52:36.447922] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-02T19:52:37.073019] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-01. [2025-10-02T19:52:37.823062] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-02T19:52:37.872999] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-04. [2025-10-02T19:52:38.331788] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-02T19:52:38.673024] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-09. [2025-10-02T19:52:39.438182] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-02T19:52:39.472959] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-05. [2025-10-02T19:52:40.272995] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-02. [2025-10-02T19:52:40.599104] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-02T19:52:41.000885] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-02T19:52:41.054992] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-02T19:52:41.072968] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-03. [2025-10-02T19:52:41.873027] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-06. [2025-10-02T19:52:42.018184] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-02T19:52:42.673032] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-04. [2025-10-02T19:52:43.118523] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-02T19:52:43.473023] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-10. [2025-10-02T19:52:43.578811] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-02T19:52:44.273039] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-05. [2025-10-02T19:52:45.011303] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-02T19:52:45.073064] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-06. [2025-10-02T19:52:45.270175] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-02T19:52:45.272378] [INFO ] [REMOTE ] KSS: Full fetch complete (77634 records). [2025-10-02T19:52:45.272517] [DEBUG] [VALIDATOR ] KSS: Validating primary data. [2025-10-02T19:52:45.704999] [DEBUG] [VALIDATOR ] KSS: All expected trading days are present. [2025-10-02T19:52:45.705098] [DEBUG] [VALIDATOR ] KSS: Primary data validation passed. [2025-10-02T19:52:45.706508] [INFO ] [MAIN ] KSS: Fetched primary data is valid. [2025-10-02T19:52:45.706590] [DEBUG] [LOCAL ] KSS: Saving primary data. [2025-10-02T19:52:45.708747] [DEBUG] [LOCAL ] KSS: Trimmed 77634 records to 53992 (keeping 200 days of data) [2025-10-02T19:52:45.900804] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-05. [2025-10-02T19:52:45.973587] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-02T19:52:46.076804] [DEBUG] [LOCAL ] KSS: Primary data saved (53992 records). [2025-10-02T19:52:46.076949] [INFO ] [MAIN ] KSS: Full history saved. [2025-10-02T19:52:46.077084] [INFO ] [MAIN ] Update Progress: 1224/2370 symbols completed. KSS took 35.0s. Estimated remaining: 2h 41m 42s. Rate: 7.1 symbols/min [2025-10-02T19:52:46.261860] [INFO ] [MAIN ] KUKE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:52:46.262050] [DEBUG] [LOCAL ] KUKE: No existing data file found in primary storage. [2025-10-02T19:52:46.262089] [WARN ] [MAIN ] KUKE: No existing data found, performing full refresh instead. [2025-10-02T19:52:46.262204] [INFO ] [MAIN ] KUKE: Wiping existing primary data before full refresh. [2025-10-02T19:52:46.262248] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-10-02T19:52:46.262291] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-10-02T19:52:46.262339] [INFO ] [MAIN ] KUKE: Starting full primary refresh. [2025-10-02T19:52:46.642621] [INFO ] [REMOTE ] KUKE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:52:46.673006] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2024-12. [2025-10-02T19:52:47.021353] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-10-02T19:52:47.399033] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-02T19:52:47.473018] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-06. [2025-10-02T19:52:48.272994] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-01. [2025-10-02T19:52:48.914430] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-02T19:52:49.073019] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-07. [2025-10-02T19:52:49.179074] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-02T19:52:49.873001] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-07. [2025-10-02T19:52:50.549321] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-02T19:52:50.673014] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-08. [2025-10-02T19:52:51.311379] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-02T19:52:51.473050] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-07. [2025-10-02T19:52:52.215850] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-02T19:52:52.272979] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-08. [2025-10-02T19:52:52.352483] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-02T19:52:53.073011] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-02. [2025-10-02T19:52:53.533492] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-02T19:52:53.715762] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-02T19:52:53.872992] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-08. [2025-10-02T19:52:54.667011] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-02T19:52:54.672953] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-09. [2025-10-02T19:52:55.338621] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-02T19:52:55.473012] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-03. [2025-10-02T19:52:56.273013] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-09. [2025-10-02T19:52:56.318829] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-02T19:52:57.073053] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-09. [2025-10-02T19:52:57.873033] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-04. [2025-10-02T19:52:58.046579] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-02T19:52:58.353362] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-02T19:52:58.459275] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-02T19:52:58.672989] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-10. [2025-10-02T19:52:59.473054] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-10. [2025-10-02T19:52:59.979497] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-02T19:52:59.981496] [INFO ] [REMOTE ] KT: Full fetch complete (66696 records). [2025-10-02T19:52:59.981618] [DEBUG] [VALIDATOR ] KT: Validating primary data. [2025-10-02T19:53:00.269904] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-02T19:53:00.281334] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-10. [2025-10-02T19:53:00.299882] [INFO ] [REMOTE ] KTF: Full fetch complete (17825 records). [2025-10-02T19:53:00.312907] [DEBUG] [VALIDATOR ] KTF: Validating primary data. [2025-10-02T19:53:00.590296] [DEBUG] [VALIDATOR ] KT: All expected trading days are present. [2025-10-02T19:53:00.617139] [DEBUG] [VALIDATOR ] KT: Primary data validation passed. [2025-10-02T19:53:00.644407] [INFO ] [MAIN ] KT: Fetched primary data is valid. [2025-10-02T19:53:00.655258] [DEBUG] [LOCAL ] KT: Saving primary data. [2025-10-02T19:53:00.781483] [DEBUG] [LOCAL ] KT: Trimmed 66696 records to 46056 (keeping 200 days of data) [2025-10-02T19:53:00.930493] [DEBUG] [VALIDATOR ] KTF: All expected trading days are present. [2025-10-02T19:53:00.930932] [DEBUG] [VALIDATOR ] KTF: Primary data validation passed. [2025-10-02T19:53:00.931358] [INFO ] [MAIN ] KTF: Fetched primary data is valid. [2025-10-02T19:53:00.931441] [DEBUG] [LOCAL ] KTF: Saving primary data. [2025-10-02T19:53:00.960811] [DEBUG] [LOCAL ] KTF: Trimmed 17825 records to 12632 (keeping 200 days of data) [2025-10-02T19:53:01.069563] [DEBUG] [LOCAL ] KTF: Primary data saved (12632 records). [2025-10-02T19:53:01.070249] [INFO ] [MAIN ] KTF: Full history saved. [2025-10-02T19:53:01.070716] [INFO ] [MAIN ] Update Progress: 1225/2370 symbols completed. KTF took 26.5s. Estimated remaining: 2h 41m 40s. Rate: 7.1 symbols/min [2025-10-02T19:53:01.076919] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-05. [2025-10-02T19:53:01.364477] [INFO ] [MAIN ] KVUE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:53:01.457339] [DEBUG] [LOCAL ] KT: Primary data saved (46056 records). [2025-10-02T19:53:01.458374] [INFO ] [MAIN ] KT: Full history saved. [2025-10-02T19:53:01.461342] [INFO ] [MAIN ] Update Progress: 1226/2370 symbols completed. KT took 43.1s. Estimated remaining: 2h 41m 24s. Rate: 7.1 symbols/min [2025-10-02T19:53:01.570245] [DEBUG] [LOCAL ] KVUE: Loaded 53667 existing records from primary storage. [2025-10-02T19:53:01.595782] [INFO ] [MAIN ] KVUE: Loaded 53667 existing records. [2025-10-02T19:53:01.672532] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-02T19:53:01.792280] [INFO ] [MAIN ] KVYO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:53:01.851732] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-02T19:53:01.876031] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-06. [2025-10-02T19:53:01.894875] [INFO ] [REMOTE ] KTB: Full fetch complete (57901 records). [2025-10-02T19:53:01.902234] [DEBUG] [VALIDATOR ] KTB: Validating primary data. [2025-10-02T19:53:01.951423] [WARN ] [MAIN ] KVUE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:53:01.984949] [INFO ] [MAIN ] KVUE: Wiping existing primary data before full refresh. [2025-10-02T19:53:02.010568] [INFO ] [LOCAL ] KVUE: Starting deletion of primary data. [2025-10-02T19:53:02.072550] [DEBUG] [LOCAL ] KVUE: Deleted primary data file. [2025-10-02T19:53:02.077522] [INFO ] [MAIN ] KVUE: Starting full primary refresh. [2025-10-02T19:53:02.205679] [DEBUG] [LOCAL ] KVYO: Loaded 50071 existing records from primary storage. [2025-10-02T19:53:02.258956] [INFO ] [MAIN ] KVYO: Loaded 50071 existing records. [2025-10-02T19:53:02.519500] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-02T19:53:02.689949] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-07. [2025-10-02T19:53:02.816459] [WARN ] [MAIN ] KVYO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:53:02.858943] [INFO ] [MAIN ] KVYO: Wiping existing primary data before full refresh. [2025-10-02T19:53:02.874444] [INFO ] [LOCAL ] KVYO: Starting deletion of primary data. [2025-10-02T19:53:02.961690] [DEBUG] [LOCAL ] KVYO: Deleted primary data file. [2025-10-02T19:53:02.990867] [INFO ] [MAIN ] KVYO: Starting full primary refresh. [2025-10-02T19:53:03.043821] [DEBUG] [VALIDATOR ] KTB: All expected trading days are present. [2025-10-02T19:53:03.077880] [DEBUG] [VALIDATOR ] KTB: Primary data validation passed. [2025-10-02T19:53:03.110147] [INFO ] [REMOTE ] KVUE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:53:03.144924] [INFO ] [MAIN ] KTB: Fetched primary data is valid. [2025-10-02T19:53:03.151616] [DEBUG] [LOCAL ] KTB: Saving primary data. [2025-10-02T19:53:03.208218] [DEBUG] [LOCAL ] KTB: Trimmed 57901 records to 41321 (keeping 200 days of data) [2025-10-02T19:53:03.445949] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-02T19:53:03.476065] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-08. [2025-10-02T19:53:03.586114] [INFO ] [REMOTE ] KVYO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:53:03.760552] [DEBUG] [LOCAL ] KTB: Primary data saved (41321 records). [2025-10-02T19:53:03.760720] [INFO ] [MAIN ] KTB: Full history saved. [2025-10-02T19:53:03.760895] [INFO ] [MAIN ] Update Progress: 1227/2370 symbols completed. KTB took 38.8s. Estimated remaining: 2h 41m 9s. Rate: 7.1 symbols/min [2025-10-02T19:53:03.945273] [INFO ] [MAIN ] KW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:53:03.950367] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-02T19:53:03.992327] [DEBUG] [LOCAL ] KW: Loaded 40529 existing records from primary storage. [2025-10-02T19:53:03.992637] [INFO ] [MAIN ] KW: Loaded 40529 existing records. [2025-10-02T19:53:04.178735] [WARN ] [MAIN ] KW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:53:04.179329] [INFO ] [MAIN ] KW: Wiping existing primary data before full refresh. [2025-10-02T19:53:04.179386] [INFO ] [LOCAL ] KW: Starting deletion of primary data. [2025-10-02T19:53:04.180625] [DEBUG] [LOCAL ] KW: Deleted primary data file. [2025-10-02T19:53:04.180750] [INFO ] [MAIN ] KW: Starting full primary refresh. [2025-10-02T19:53:04.278380] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2024-12. [2025-10-02T19:53:04.570166] [INFO ] [REMOTE ] KW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:53:05.073010] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2024-12. [2025-10-02T19:53:05.872986] [INFO ] [REMOTE ] KW: Fetching primary data for 2024-12. [2025-10-02T19:53:06.008843] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-02T19:53:06.657850] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-02T19:53:06.672946] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-01. [2025-10-02T19:53:07.121569] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-02T19:53:07.473054] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-01. [2025-10-02T19:53:08.273040] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-01. [2025-10-02T19:53:08.495788] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-02T19:53:08.915715] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-02T19:53:09.073017] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-09. [2025-10-02T19:53:09.533933] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-02T19:53:09.872998] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-02. [2025-10-02T19:53:09.916920] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-02T19:53:10.673049] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-02. [2025-10-02T19:53:11.397156] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-02T19:53:11.473008] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-10. [2025-10-02T19:53:12.044528] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-02T19:53:12.272996] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-03. [2025-10-02T19:53:12.314215] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-02T19:53:12.315237] [INFO ] [REMOTE ] KUKE: Full fetch complete (8508 records). [2025-10-02T19:53:12.315341] [DEBUG] [VALIDATOR ] KUKE: Validating primary data. [2025-10-02T19:53:12.511198] [WARN ] [VALIDATOR ] KUKE: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-02T19:53:12.511437] [FATAL] [MAIN ] KUKE: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:53:12.511507] [WARN ] [MAIN ] KUKE: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:53:12.511580] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-10-02T19:53:12.511665] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-10-02T19:53:12.511723] [INFO ] [LOCAL ] KUKE: Starting deletion of derivative data. [2025-10-02T19:53:12.511785] [DEBUG] [LOCAL ] KUKE: No derivative data file found to delete. [2025-10-02T19:53:12.511866] [INFO ] [MAIN ] Update Progress: 1228/2370 symbols completed. KUKE took 26.4s. Estimated remaining: 2h 41m 1s. Rate: 7.1 symbols/min [2025-10-02T19:53:12.703397] [INFO ] [MAIN ] KWR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:53:12.723246] [DEBUG] [LOCAL ] KWR: Loaded 16535 existing records from primary storage. [2025-10-02T19:53:12.723585] [INFO ] [MAIN ] KWR: Loaded 16535 existing records. [2025-10-02T19:53:12.930192] [WARN ] [MAIN ] KWR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:53:12.930482] [INFO ] [MAIN ] KWR: Wiping existing primary data before full refresh. [2025-10-02T19:53:12.930556] [INFO ] [LOCAL ] KWR: Starting deletion of primary data. [2025-10-02T19:53:12.931360] [DEBUG] [LOCAL ] KWR: Deleted primary data file. [2025-10-02T19:53:12.931424] [INFO ] [MAIN ] KWR: Starting full primary refresh. [2025-10-02T19:53:13.078214] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-03. [2025-10-02T19:53:13.351613] [INFO ] [REMOTE ] KWR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:53:13.872984] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-02. [2025-10-02T19:53:14.063089] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-02T19:53:14.566330] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-02T19:53:14.673049] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-04. [2025-10-02T19:53:15.429697] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-02T19:53:15.472969] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-03. [2025-10-02T19:53:16.191102] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-02T19:53:16.273005] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-05. [2025-10-02T19:53:17.072999] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-04. [2025-10-02T19:53:17.127530] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-02T19:53:17.634884] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-02T19:53:17.873009] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-04. [2025-10-02T19:53:18.515249] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-02T19:53:18.673015] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-06. [2025-10-02T19:53:19.402079] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-02T19:53:19.473066] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-05. [2025-10-02T19:53:20.181774] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-02T19:53:20.273027] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-05. [2025-10-02T19:53:21.072999] [INFO ] [REMOTE ] KWR: Fetching primary data for 2024-12. [2025-10-02T19:53:21.331841] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-02T19:53:21.694511] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-02T19:53:21.873002] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-06. [2025-10-02T19:53:22.219536] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-02T19:53:22.673003] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-07. [2025-10-02T19:53:23.478028] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-01. [2025-10-02T19:53:23.483233] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-02T19:53:24.124853] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-02T19:53:24.272996] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-08. [2025-10-02T19:53:24.563765] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-02T19:53:25.072992] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-02. [2025-10-02T19:53:25.584976] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-02T19:53:25.697357] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-02T19:53:25.872972] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-03. [2025-10-02T19:53:26.673002] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-06. [2025-10-02T19:53:26.936141] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-02T19:53:27.473042] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-09. [2025-10-02T19:53:28.272997] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-07. [2025-10-02T19:53:28.476377] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-02T19:53:28.893946] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-02T19:53:29.073005] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-07. [2025-10-02T19:53:29.679463] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-02T19:53:29.873036] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-10. [2025-10-02T19:53:30.577362] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-02T19:53:30.673062] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-04. [2025-10-02T19:53:30.918850] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-02T19:53:30.921142] [INFO ] [REMOTE ] KW: Full fetch complete (57126 records). [2025-10-02T19:53:30.921241] [DEBUG] [VALIDATOR ] KW: Validating primary data. [2025-10-02T19:53:31.327151] [DEBUG] [VALIDATOR ] KW: All expected trading days are present. [2025-10-02T19:53:31.327254] [DEBUG] [VALIDATOR ] KW: Primary data validation passed. [2025-10-02T19:53:31.328210] [INFO ] [MAIN ] KW: Fetched primary data is valid. [2025-10-02T19:53:31.328283] [DEBUG] [LOCAL ] KW: Saving primary data. [2025-10-02T19:53:31.329623] [DEBUG] [LOCAL ] KW: Trimmed 57126 records to 40831 (keeping 200 days of data) [2025-10-02T19:53:31.506814] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-08. [2025-10-02T19:53:31.586751] [DEBUG] [LOCAL ] KW: Primary data saved (40831 records). [2025-10-02T19:53:31.586967] [INFO ] [MAIN ] KW: Full history saved. [2025-10-02T19:53:31.587083] [INFO ] [MAIN ] Update Progress: 1229/2370 symbols completed. KW took 27.8s. Estimated remaining: 2h 41m 3s. Rate: 7.1 symbols/min [2025-10-02T19:53:31.772857] [INFO ] [MAIN ] KYN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:53:31.786601] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-02T19:53:31.821472] [DEBUG] [LOCAL ] KYN: Loaded 30010 existing records from primary storage. [2025-10-02T19:53:31.821767] [INFO ] [MAIN ] KYN: Loaded 30010 existing records. [2025-10-02T19:53:32.013696] [WARN ] [MAIN ] KYN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:53:32.013951] [INFO ] [MAIN ] KYN: Wiping existing primary data before full refresh. [2025-10-02T19:53:32.014000] [INFO ] [LOCAL ] KYN: Starting deletion of primary data. [2025-10-02T19:53:32.014797] [DEBUG] [LOCAL ] KYN: Deleted primary data file. [2025-10-02T19:53:32.014856] [INFO ] [MAIN ] KYN: Starting full primary refresh. [2025-10-02T19:53:32.278127] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-05. [2025-10-02T19:53:32.389285] [INFO ] [REMOTE ] KYN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:53:33.073050] [INFO ] [REMOTE ] KYN: Fetching primary data for 2024-12. [2025-10-02T19:53:33.121065] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-02T19:53:33.261323] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-02T19:53:33.873004] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-06. [2025-10-02T19:53:34.440297] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-02T19:53:34.672991] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-09. [2025-10-02T19:53:34.803270] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-02T19:53:35.473025] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-01. [2025-10-02T19:53:36.273054] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-08. [2025-10-02T19:53:36.759223] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-02T19:53:36.813228] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-02T19:53:37.073004] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-02. [2025-10-02T19:53:37.835279] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-02T19:53:37.872965] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-09. [2025-10-02T19:53:38.239737] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-02T19:53:38.673005] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-10. [2025-10-02T19:53:39.473010] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-07. [2025-10-02T19:53:39.617287] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-02T19:53:40.118817] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-02T19:53:40.272999] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-10. [2025-10-02T19:53:40.379638] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-02T19:53:40.381829] [INFO ] [REMOTE ] KVUE: Full fetch complete (77673 records). [2025-10-02T19:53:40.381933] [DEBUG] [VALIDATOR ] KVUE: Validating primary data. [2025-10-02T19:53:40.845846] [DEBUG] [VALIDATOR ] KVUE: All expected trading days are present. [2025-10-02T19:53:40.845932] [DEBUG] [VALIDATOR ] KVUE: Primary data validation passed. [2025-10-02T19:53:40.847014] [INFO ] [MAIN ] KVUE: Fetched primary data is valid. [2025-10-02T19:53:40.847101] [DEBUG] [LOCAL ] KVUE: Saving primary data. [2025-10-02T19:53:40.849226] [DEBUG] [LOCAL ] KVUE: Trimmed 77673 records to 54057 (keeping 200 days of data) [2025-10-02T19:53:41.075300] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-08. [2025-10-02T19:53:41.201290] [DEBUG] [LOCAL ] KVUE: Primary data saved (54057 records). [2025-10-02T19:53:41.201478] [INFO ] [MAIN ] KVUE: Full history saved. [2025-10-02T19:53:41.201579] [INFO ] [MAIN ] Update Progress: 1230/2370 symbols completed. KVUE took 40.1s. Estimated remaining: 2h 40m 55s. Rate: 7.1 symbols/min [2025-10-02T19:53:41.387099] [INFO ] [MAIN ] L: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:53:41.426820] [DEBUG] [LOCAL ] L: Loaded 40991 existing records from primary storage. [2025-10-02T19:53:41.427137] [INFO ] [MAIN ] L: Loaded 40991 existing records. [2025-10-02T19:53:41.640589] [WARN ] [MAIN ] L: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:53:41.640944] [INFO ] [MAIN ] L: Wiping existing primary data before full refresh. [2025-10-02T19:53:41.641011] [INFO ] [LOCAL ] L: Starting deletion of primary data. [2025-10-02T19:53:41.642155] [DEBUG] [LOCAL ] L: Deleted primary data file. [2025-10-02T19:53:41.642220] [INFO ] [MAIN ] L: Starting full primary refresh. [2025-10-02T19:53:41.752698] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-02T19:53:41.791190] [INFO ] [REMOTE ] KVYO: Full fetch complete (71669 records). [2025-10-02T19:53:41.796633] [DEBUG] [VALIDATOR ] KVYO: Validating primary data. [2025-10-02T19:53:41.874736] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-03. [2025-10-02T19:53:42.096352] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-02T19:53:42.411878] [INFO ] [REMOTE ] L: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:53:42.540122] [DEBUG] [VALIDATOR ] KVYO: All expected trading days are present. [2025-10-02T19:53:42.540211] [DEBUG] [VALIDATOR ] KVYO: Primary data validation passed. [2025-10-02T19:53:42.541207] [INFO ] [MAIN ] KVYO: Fetched primary data is valid. [2025-10-02T19:53:42.541276] [DEBUG] [LOCAL ] KVYO: Saving primary data. [2025-10-02T19:53:42.542922] [DEBUG] [LOCAL ] KVYO: Trimmed 71669 records to 50458 (keeping 200 days of data) [2025-10-02T19:53:42.673007] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-09. [2025-10-02T19:53:42.864887] [DEBUG] [LOCAL ] KVYO: Primary data saved (50458 records). [2025-10-02T19:53:42.865036] [INFO ] [MAIN ] KVYO: Full history saved. [2025-10-02T19:53:42.865135] [INFO ] [MAIN ] Update Progress: 1231/2370 symbols completed. KVYO took 41.4s. Estimated remaining: 2h 40m 40s. Rate: 7.1 symbols/min [2025-10-02T19:53:43.056348] [INFO ] [MAIN ] LAC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:53:43.110565] [DEBUG] [LOCAL ] LAC: Loaded 52362 existing records from primary storage. [2025-10-02T19:53:43.110933] [INFO ] [MAIN ] LAC: Loaded 52362 existing records. [2025-10-02T19:53:43.312589] [WARN ] [MAIN ] LAC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:53:43.327561] [INFO ] [MAIN ] LAC: Wiping existing primary data before full refresh. [2025-10-02T19:53:43.327683] [INFO ] [LOCAL ] LAC: Starting deletion of primary data. [2025-10-02T19:53:43.335735] [DEBUG] [LOCAL ] LAC: Deleted primary data file. [2025-10-02T19:53:43.338797] [INFO ] [MAIN ] LAC: Starting full primary refresh. [2025-10-02T19:53:43.413188] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-02T19:53:43.478109] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-04. [2025-10-02T19:53:43.674353] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-02T19:53:43.758266] [INFO ] [REMOTE ] LAC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:53:44.273030] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-10. [2025-10-02T19:53:44.854281] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-02T19:53:44.855313] [INFO ] [REMOTE ] KWR: Full fetch complete (23974 records). [2025-10-02T19:53:44.855386] [DEBUG] [VALIDATOR ] KWR: Validating primary data. [2025-10-02T19:53:45.034142] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-02T19:53:45.077507] [INFO ] [REMOTE ] L: Fetching primary data for 2024-12. [2025-10-02T19:53:45.288180] [DEBUG] [VALIDATOR ] KWR: All expected trading days are present. [2025-10-02T19:53:45.288295] [DEBUG] [VALIDATOR ] KWR: Primary data validation passed. [2025-10-02T19:53:45.288818] [INFO ] [MAIN ] KWR: Fetched primary data is valid. [2025-10-02T19:53:45.288881] [DEBUG] [LOCAL ] KWR: Saving primary data. [2025-10-02T19:53:45.289835] [DEBUG] [LOCAL ] KWR: Trimmed 23974 records to 16654 (keeping 200 days of data) [2025-10-02T19:53:45.397633] [DEBUG] [LOCAL ] KWR: Primary data saved (16654 records). [2025-10-02T19:53:45.397831] [INFO ] [MAIN ] KWR: Full history saved. [2025-10-02T19:53:45.397920] [INFO ] [MAIN ] Update Progress: 1232/2370 symbols completed. KWR took 32.9s. Estimated remaining: 2h 40m 26s. Rate: 7.1 symbols/min [2025-10-02T19:53:45.575168] [INFO ] [MAIN ] LAD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:53:45.598842] [DEBUG] [LOCAL ] LAD: Loaded 23471 existing records from primary storage. [2025-10-02T19:53:45.599122] [INFO ] [MAIN ] LAD: Loaded 23471 existing records. [2025-10-02T19:53:45.784288] [WARN ] [MAIN ] LAD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:53:45.784512] [INFO ] [MAIN ] LAD: Wiping existing primary data before full refresh. [2025-10-02T19:53:45.784560] [INFO ] [LOCAL ] LAD: Starting deletion of primary data. [2025-10-02T19:53:45.785274] [DEBUG] [LOCAL ] LAD: Deleted primary data file. [2025-10-02T19:53:45.785335] [INFO ] [MAIN ] LAD: Starting full primary refresh. [2025-10-02T19:53:45.878156] [INFO ] [REMOTE ] LAC: Fetching primary data for 2024-12. [2025-10-02T19:53:46.169158] [INFO ] [REMOTE ] LAD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:53:46.608986] [INFO ] [REMOTE ] L: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-02T19:53:46.673000] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-05. [2025-10-02T19:53:47.473089] [INFO ] [REMOTE ] LAD: Fetching primary data for 2024-12. [2025-10-02T19:53:47.519154] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-02T19:53:47.917555] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-02T19:53:48.272991] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-06. [2025-10-02T19:53:48.646010] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-02T19:53:49.073020] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-01. [2025-10-02T19:53:49.103316] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-02T19:53:49.872975] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-07. [2025-10-02T19:53:50.285820] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-02T19:53:50.673009] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-02. [2025-10-02T19:53:51.179465] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-02T19:53:51.473035] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-01. [2025-10-02T19:53:51.770333] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-02T19:53:52.273003] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-08. [2025-10-02T19:53:53.072971] [INFO ] [REMOTE ] L: Fetching primary data for 2025-01. [2025-10-02T19:53:53.456104] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-02T19:53:53.529759] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-02T19:53:53.873044] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-09. [2025-10-02T19:53:54.213475] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-02T19:53:54.672980] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-03. [2025-10-02T19:53:54.844489] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-02T19:53:55.473013] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-02. [2025-10-02T19:53:55.965018] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-02T19:53:56.272995] [INFO ] [REMOTE ] L: Fetching primary data for 2025-02. [2025-10-02T19:53:56.873599] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-02T19:53:57.073000] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-03. [2025-10-02T19:53:57.603488] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-02T19:53:57.873021] [INFO ] [REMOTE ] L: Fetching primary data for 2025-03. [2025-10-02T19:53:58.673019] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-04. [2025-10-02T19:53:59.301079] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-02T19:53:59.370731] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-02T19:53:59.470300] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-02T19:53:59.477062] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-04. [2025-10-02T19:54:00.273027] [INFO ] [REMOTE ] L: Fetching primary data for 2025-04. [2025-10-02T19:54:01.073021] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-10. [2025-10-02T19:54:01.366971] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-02T19:54:01.873012] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-05. [2025-10-02T19:54:02.057234] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-02T19:54:02.059022] [INFO ] [REMOTE ] KYN: Full fetch complete (44571 records). [2025-10-02T19:54:02.059194] [DEBUG] [VALIDATOR ] KYN: Validating primary data. [2025-10-02T19:54:02.489870] [DEBUG] [VALIDATOR ] KYN: All expected trading days are present. [2025-10-02T19:54:02.489958] [DEBUG] [VALIDATOR ] KYN: Primary data validation passed. [2025-10-02T19:54:02.490704] [INFO ] [MAIN ] KYN: Fetched primary data is valid. [2025-10-02T19:54:02.490771] [DEBUG] [LOCAL ] KYN: Saving primary data. [2025-10-02T19:54:02.491969] [DEBUG] [LOCAL ] KYN: Trimmed 44571 records to 30181 (keeping 200 days of data) [2025-10-02T19:54:02.673170] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-05. [2025-10-02T19:54:02.691996] [DEBUG] [LOCAL ] KYN: Primary data saved (30181 records). [2025-10-02T19:54:02.692150] [INFO ] [MAIN ] KYN: Full history saved. [2025-10-02T19:54:02.692252] [INFO ] [MAIN ] Update Progress: 1233/2370 symbols completed. KYN took 31.1s. Estimated remaining: 2h 40m 26s. Rate: 7.1 symbols/min [2025-10-02T19:54:02.876876] [INFO ] [MAIN ] LADR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:54:02.916719] [DEBUG] [LOCAL ] LADR: Loaded 38885 existing records from primary storage. [2025-10-02T19:54:02.917076] [INFO ] [MAIN ] LADR: Loaded 38885 existing records. [2025-10-02T19:54:03.107737] [WARN ] [MAIN ] LADR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:54:03.107951] [INFO ] [MAIN ] LADR: Wiping existing primary data before full refresh. [2025-10-02T19:54:03.108002] [INFO ] [LOCAL ] LADR: Starting deletion of primary data. [2025-10-02T19:54:03.108971] [DEBUG] [LOCAL ] LADR: Deleted primary data file. [2025-10-02T19:54:03.109067] [INFO ] [MAIN ] LADR: Starting full primary refresh. [2025-10-02T19:54:03.499215] [INFO ] [REMOTE ] LADR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:54:03.499925] [INFO ] [REMOTE ] LADR: Fetching primary data for 2024-12. [2025-10-02T19:54:03.670076] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-02T19:54:03.801873] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-02T19:54:04.273037] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-06. [2025-10-02T19:54:04.922189] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-02T19:54:05.073000] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-06. [2025-10-02T19:54:05.376574] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-02T19:54:05.498769] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-04 (5.23 seconds). [2025-10-02T19:54:05.873048] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-07. [2025-10-02T19:54:06.384883] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-02T19:54:06.673020] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-07. [2025-10-02T19:54:07.058150] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-02T19:54:07.473054] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-01. [2025-10-02T19:54:08.272973] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-08. [2025-10-02T19:54:08.700518] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-02T19:54:08.733471] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-02T19:54:09.072978] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-02. [2025-10-02T19:54:09.364286] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-02T19:54:09.873006] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-08. [2025-10-02T19:54:10.221937] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-02T19:54:10.673013] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-09. [2025-10-02T19:54:11.473002] [INFO ] [REMOTE ] L: Fetching primary data for 2025-05. [2025-10-02T19:54:11.741337] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-02T19:54:12.273012] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-10. [2025-10-02T19:54:12.336104] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-10-02T19:54:12.986793] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-02T19:54:13.073002] [INFO ] [REMOTE ] L: Fetching primary data for 2025-06. [2025-10-02T19:54:13.134930] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-02T19:54:13.136351] [INFO ] [REMOTE ] LAD: Full fetch complete (35439 records). [2025-10-02T19:54:13.136429] [DEBUG] [VALIDATOR ] LAD: Validating primary data. [2025-10-02T19:54:13.549408] [DEBUG] [VALIDATOR ] LAD: All expected trading days are present. [2025-10-02T19:54:13.549497] [DEBUG] [VALIDATOR ] LAD: Primary data validation passed. [2025-10-02T19:54:13.550236] [INFO ] [MAIN ] LAD: Fetched primary data is valid. [2025-10-02T19:54:13.550300] [DEBUG] [LOCAL ] LAD: Saving primary data. [2025-10-02T19:54:13.551286] [DEBUG] [LOCAL ] LAD: Trimmed 35439 records to 23644 (keeping 200 days of data) [2025-10-02T19:54:13.704320] [DEBUG] [LOCAL ] LAD: Primary data saved (23644 records). [2025-10-02T19:54:13.704461] [INFO ] [MAIN ] LAD: Full history saved. [2025-10-02T19:54:13.704549] [INFO ] [MAIN ] Update Progress: 1234/2370 symbols completed. LAD took 28.3s. Estimated remaining: 2h 40m 20s. Rate: 7.1 symbols/min [2025-10-02T19:54:13.888942] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-03. [2025-10-02T19:54:13.893700] [INFO ] [MAIN ] LANV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:54:13.899683] [DEBUG] [LOCAL ] LANV: Loaded 2826 existing records from primary storage. [2025-10-02T19:54:13.900082] [INFO ] [MAIN ] LANV: Loaded 2826 existing records. [2025-10-02T19:54:14.114610] [WARN ] [MAIN ] LANV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:54:14.114874] [INFO ] [MAIN ] LANV: Wiping existing primary data before full refresh. [2025-10-02T19:54:14.114923] [INFO ] [LOCAL ] LANV: Starting deletion of primary data. [2025-10-02T19:54:14.115217] [DEBUG] [LOCAL ] LANV: Deleted primary data file. [2025-10-02T19:54:14.115277] [INFO ] [MAIN ] LANV: Starting full primary refresh. [2025-10-02T19:54:14.517991] [INFO ] [REMOTE ] LANV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:54:14.615553] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-02T19:54:14.673026] [INFO ] [REMOTE ] LANV: Fetching primary data for 2024-12. [2025-10-02T19:54:15.279992] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-02T19:54:15.280237] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-02T19:54:15.473006] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-04. [2025-10-02T19:54:16.273010] [INFO ] [REMOTE ] L: Fetching primary data for 2025-07. [2025-10-02T19:54:17.065423] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-02T19:54:17.075087] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-01. [2025-10-02T19:54:17.437735] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-02T19:54:17.741068] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-02T19:54:17.873007] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-02. [2025-10-02T19:54:18.330205] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-02T19:54:18.673013] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-03. [2025-10-02T19:54:19.118710] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-02T19:54:19.473005] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-04. [2025-10-02T19:54:19.946056] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-02T19:54:20.273008] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-05. [2025-10-02T19:54:20.684141] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-02T19:54:21.073001] [INFO ] [REMOTE ] L: Fetching primary data for 2025-08. [2025-10-02T19:54:21.872993] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-05. [2025-10-02T19:54:22.650539] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-02T19:54:22.672959] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-09. [2025-10-02T19:54:23.207589] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-02T19:54:23.473000] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-06. [2025-10-02T19:54:23.778863] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-02T19:54:24.273013] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-07. [2025-10-02T19:54:24.736906] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-02T19:54:24.911262] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-02T19:54:25.073042] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-10. [2025-10-02T19:54:25.873006] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-08. [2025-10-02T19:54:26.428011] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-02T19:54:26.673016] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-09. [2025-10-02T19:54:27.018939] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-02T19:54:27.021457] [INFO ] [REMOTE ] LAC: Full fetch complete (75986 records). [2025-10-02T19:54:27.021591] [DEBUG] [VALIDATOR ] LAC: Validating primary data. [2025-10-02T19:54:27.457382] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-02T19:54:27.461347] [DEBUG] [VALIDATOR ] LAC: All expected trading days are present. [2025-10-02T19:54:27.461426] [DEBUG] [VALIDATOR ] LAC: Primary data validation passed. [2025-10-02T19:54:27.464912] [INFO ] [MAIN ] LAC: Fetched primary data is valid. [2025-10-02T19:54:27.465000] [DEBUG] [LOCAL ] LAC: Saving primary data. [2025-10-02T19:54:27.466449] [DEBUG] [LOCAL ] LAC: Trimmed 75986 records to 52752 (keeping 200 days of data) [2025-10-02T19:54:27.472988] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-10. [2025-10-02T19:54:27.796416] [DEBUG] [LOCAL ] LAC: Primary data saved (52752 records). [2025-10-02T19:54:27.796572] [INFO ] [MAIN ] LAC: Full history saved. [2025-10-02T19:54:27.796680] [INFO ] [MAIN ] Update Progress: 1235/2370 symbols completed. LAC took 44.9s. Estimated remaining: 2h 40m 17s. Rate: 7.1 symbols/min [2025-10-02T19:54:27.985368] [INFO ] [MAIN ] LAR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:54:27.988008] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-02T19:54:27.988260] [DEBUG] [LOCAL ] LAR: No existing data file found in primary storage. [2025-10-02T19:54:27.988382] [WARN ] [MAIN ] LAR: No existing data found, performing full refresh instead. [2025-10-02T19:54:27.989294] [INFO ] [REMOTE ] LANV: Full fetch complete (4452 records). [2025-10-02T19:54:27.989473] [INFO ] [MAIN ] LAR: Wiping existing primary data before full refresh. [2025-10-02T19:54:27.989601] [DEBUG] [VALIDATOR ] LANV: Validating primary data. [2025-10-02T19:54:27.989712] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-02T19:54:28.059149] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-02T19:54:28.071347] [INFO ] [MAIN ] LAR: Starting full primary refresh. [2025-10-02T19:54:28.273851] [INFO ] [REMOTE ] L: Fetching primary data for 2025-09. [2025-10-02T19:54:28.829631] [DEBUG] [VALIDATOR ] LANV: All expected trading days are present. [2025-10-02T19:54:28.837533] [DEBUG] [VALIDATOR ] LANV: Primary data validation passed. [2025-10-02T19:54:28.841290] [INFO ] [MAIN ] LANV: Fetched primary data is valid. [2025-10-02T19:54:28.841760] [DEBUG] [LOCAL ] LANV: Saving primary data. [2025-10-02T19:54:28.858094] [DEBUG] [LOCAL ] LANV: Trimmed 4452 records to 2845 (keeping 200 days of data) [2025-10-02T19:54:28.865840] [INFO ] [REMOTE ] LAR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:54:28.883597] [DEBUG] [LOCAL ] LANV: Primary data saved (2845 records). [2025-10-02T19:54:28.883769] [INFO ] [MAIN ] LANV: Full history saved. [2025-10-02T19:54:28.883868] [INFO ] [MAIN ] Update Progress: 1236/2370 symbols completed. LANV took 15.2s. Estimated remaining: 2h 40m 1s. Rate: 7.1 symbols/min [2025-10-02T19:54:29.073144] [INFO ] [MAIN ] LAW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:54:29.073257] [INFO ] [REMOTE ] LAR: Fetching primary data for 2024-12. [2025-10-02T19:54:29.089281] [DEBUG] [LOCAL ] LAW: Loaded 14021 existing records from primary storage. [2025-10-02T19:54:29.089519] [INFO ] [MAIN ] LAW: Loaded 14021 existing records. [2025-10-02T19:54:29.285405] [DEBUG] [REMOTE ] LAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T19:54:29.285222] [WARN ] [MAIN ] LAW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:54:29.285889] [INFO ] [MAIN ] LAW: Wiping existing primary data before full refresh. [2025-10-02T19:54:29.286015] [WARN ] [REMOTE ] LAR: No data returned for month 2024-12 [2025-10-02T19:54:29.286230] [INFO ] [LOCAL ] LAW: Starting deletion of primary data. [2025-10-02T19:54:29.286141] [FATAL] [REMOTE ] LAR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T19:54:29.286430] [FATAL] [MAIN ] LAR: Failed to fetch primary data. [2025-10-02T19:54:29.286505] [WARN ] [MAIN ] LAR: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T19:54:29.286560] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-02T19:54:29.286623] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-02T19:54:29.286701] [INFO ] [LOCAL ] LAR: Starting deletion of derivative data. [2025-10-02T19:54:29.286818] [DEBUG] [LOCAL ] LAW: Deleted primary data file. [2025-10-02T19:54:29.286777] [DEBUG] [LOCAL ] LAR: No derivative data file found to delete. [2025-10-02T19:54:29.287017] [INFO ] [MAIN ] Update Progress: 1237/2370 symbols completed. LAR took 1.5s. Estimated remaining: 2h 39m 46s. Rate: 7.1 symbols/min [2025-10-02T19:54:29.287105] [INFO ] [MAIN ] LAW: Starting full primary refresh. [2025-10-02T19:54:29.693426] [INFO ] [REMOTE ] LAW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:54:29.872990] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-06. [2025-10-02T19:54:29.934850] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-02T19:54:30.673027] [INFO ] [REMOTE ] LAW: Fetching primary data for 2024-12. [2025-10-02T19:54:31.250071] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-02T19:54:31.473060] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-07. [2025-10-02T19:54:31.593232] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-02T19:54:32.273028] [INFO ] [REMOTE ] L: Fetching primary data for 2025-10. [2025-10-02T19:54:32.978771] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-02T19:54:33.073056] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-08. [2025-10-02T19:54:33.456899] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-02T19:54:33.458915] [INFO ] [REMOTE ] L: Full fetch complete (59496 records). [2025-10-02T19:54:33.459016] [DEBUG] [VALIDATOR ] L: Validating primary data. [2025-10-02T19:54:33.878172] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-01. [2025-10-02T19:54:33.879018] [DEBUG] [VALIDATOR ] L: All expected trading days are present. [2025-10-02T19:54:33.880024] [DEBUG] [VALIDATOR ] L: Primary data validation passed. [2025-10-02T19:54:33.881085] [INFO ] [MAIN ] L: Fetched primary data is valid. [2025-10-02T19:54:33.881295] [DEBUG] [LOCAL ] L: Saving primary data. [2025-10-02T19:54:33.882931] [DEBUG] [LOCAL ] L: Trimmed 59496 records to 41305 (keeping 200 days of data) [2025-10-02T19:54:34.159711] [DEBUG] [LOCAL ] L: Primary data saved (41305 records). [2025-10-02T19:54:34.159840] [INFO ] [MAIN ] L: Full history saved. [2025-10-02T19:54:34.159922] [INFO ] [MAIN ] Update Progress: 1238/2370 symbols completed. L took 53.0s. Estimated remaining: 2h 39m 34s. Rate: 7.1 symbols/min [2025-10-02T19:54:34.226686] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-02T19:54:34.445406] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-02T19:54:34.673026] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-02. [2025-10-02T19:54:35.473034] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-09. [2025-10-02T19:54:35.663886] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-02T19:54:36.273044] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-03. [2025-10-02T19:54:36.896566] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-02T19:54:36.948230] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-02T19:54:37.073001] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-04. [2025-10-02T19:54:37.873009] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-10. [2025-10-02T19:54:37.922671] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-02T19:54:38.673021] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-05. [2025-10-02T19:54:39.145971] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-02T19:54:39.148276] [INFO ] [REMOTE ] LADR: Full fetch complete (55479 records). [2025-10-02T19:54:39.148465] [DEBUG] [VALIDATOR ] LADR: Validating primary data. [2025-10-02T19:54:39.572361] [DEBUG] [VALIDATOR ] LADR: All expected trading days are present. [2025-10-02T19:54:39.581863] [DEBUG] [VALIDATOR ] LADR: Primary data validation passed. [2025-10-02T19:54:39.583344] [INFO ] [MAIN ] LADR: Fetched primary data is valid. [2025-10-02T19:54:39.583840] [DEBUG] [LOCAL ] LADR: Saving primary data. [2025-10-02T19:54:39.583757] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-02T19:54:39.588826] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-06. [2025-10-02T19:54:39.590371] [DEBUG] [LOCAL ] LADR: Trimmed 55479 records to 39182 (keeping 200 days of data) [2025-10-02T19:54:39.839014] [DEBUG] [LOCAL ] LADR: Primary data saved (39182 records). [2025-10-02T19:54:39.839161] [INFO ] [MAIN ] LADR: Full history saved. [2025-10-02T19:54:39.839244] [INFO ] [MAIN ] Update Progress: 1239/2370 symbols completed. LADR took 37.1s. Estimated remaining: 2h 39m 23s. Rate: 7.1 symbols/min [2025-10-02T19:54:40.740083] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-02T19:54:40.744198] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-07. [2025-10-02T19:54:41.711437] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-02T19:54:41.715487] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-08. [2025-10-02T19:54:42.641393] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-02T19:54:42.647679] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-09. [2025-10-02T19:54:43.607504] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-02T19:54:43.612045] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-10. [2025-10-02T19:54:44.271379] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-02T19:54:44.272557] [INFO ] [REMOTE ] LAW: Full fetch complete (20562 records). [2025-10-02T19:54:44.272679] [DEBUG] [VALIDATOR ] LAW: Validating primary data. [2025-10-02T19:54:44.697177] [DEBUG] [VALIDATOR ] LAW: All expected trading days are present. [2025-10-02T19:54:44.697259] [DEBUG] [VALIDATOR ] LAW: Primary data validation passed. [2025-10-02T19:54:44.697758] [INFO ] [MAIN ] LAW: Fetched primary data is valid. [2025-10-02T19:54:44.697822] [DEBUG] [LOCAL ] LAW: Saving primary data. [2025-10-02T19:54:44.698467] [DEBUG] [LOCAL ] LAW: Trimmed 20562 records to 14185 (keeping 200 days of data) [2025-10-02T19:54:44.783589] [DEBUG] [LOCAL ] LAW: Primary data saved (14185 records). [2025-10-02T19:54:44.783757] [INFO ] [MAIN ] LAW: Full history saved. [2025-10-02T19:54:44.783849] [INFO ] [MAIN ] Update Progress: 1240/2370 symbols completed. LAW took 15.9s. Estimated remaining: 2h 39m 11s. Rate: 7.1 symbols/min [2025-10-02T19:54:45.542756] [INFO ] [MAIN ] LBRT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:54:45.561298] [INFO ] [MAIN ] LB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:54:45.481703] [INFO ] [MAIN ] LC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:54:45.590407] [INFO ] [MAIN ] LAZ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:54:45.644102] [DEBUG] [LOCAL ] LB: Loaded 37751 existing records from primary storage. [2025-10-02T19:54:45.644632] [INFO ] [MAIN ] LB: Loaded 37751 existing records. [2025-10-02T19:54:45.817264] [DEBUG] [LOCAL ] LC: Loaded 47835 existing records from primary storage. [2025-10-02T19:54:45.831068] [INFO ] [MAIN ] LC: Loaded 47835 existing records. [2025-10-02T19:54:45.833584] [DEBUG] [LOCAL ] LAZ: Loaded 44922 existing records from primary storage. [2025-10-02T19:54:45.832529] [DEBUG] [LOCAL ] LBRT: Loaded 52912 existing records from primary storage. [2025-10-02T19:54:45.844492] [INFO ] [MAIN ] LBRT: Loaded 52912 existing records. [2025-10-02T19:54:45.871379] [INFO ] [MAIN ] LAZ: Loaded 44922 existing records. [2025-10-02T19:54:46.151595] [WARN ] [MAIN ] LB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:54:46.245992] [INFO ] [MAIN ] LB: Wiping existing primary data before full refresh. [2025-10-02T19:54:46.334803] [INFO ] [LOCAL ] LB: Starting deletion of primary data. [2025-10-02T19:54:46.408851] [DEBUG] [LOCAL ] LB: Deleted primary data file. [2025-10-02T19:54:46.445979] [WARN ] [MAIN ] LBRT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:54:46.465814] [INFO ] [MAIN ] LBRT: Wiping existing primary data before full refresh. [2025-10-02T19:54:46.465734] [INFO ] [MAIN ] LB: Starting full primary refresh. [2025-10-02T19:54:46.466316] [INFO ] [LOCAL ] LBRT: Starting deletion of primary data. [2025-10-02T19:54:46.488349] [WARN ] [MAIN ] LC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:54:46.537145] [INFO ] [MAIN ] LC: Wiping existing primary data before full refresh. [2025-10-02T19:54:46.536958] [DEBUG] [LOCAL ] LBRT: Deleted primary data file. [2025-10-02T19:54:46.569025] [INFO ] [MAIN ] LBRT: Starting full primary refresh. [2025-10-02T19:54:46.542434] [INFO ] [LOCAL ] LC: Starting deletion of primary data. [2025-10-02T19:54:46.617510] [DEBUG] [LOCAL ] LC: Deleted primary data file. [2025-10-02T19:54:46.657190] [INFO ] [MAIN ] LC: Starting full primary refresh. [2025-10-02T19:54:46.747217] [WARN ] [MAIN ] LAZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:54:46.820519] [INFO ] [MAIN ] LAZ: Wiping existing primary data before full refresh. [2025-10-02T19:54:46.913356] [INFO ] [LOCAL ] LAZ: Starting deletion of primary data. [2025-10-02T19:54:46.982023] [DEBUG] [LOCAL ] LAZ: Deleted primary data file. [2025-10-02T19:54:47.067861] [INFO ] [MAIN ] LAZ: Starting full primary refresh. [2025-10-02T19:54:47.879911] [INFO ] [REMOTE ] LB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:54:47.917706] [INFO ] [REMOTE ] LB: Fetching primary data for 2024-12. [2025-10-02T19:54:48.045835] [INFO ] [REMOTE ] LBRT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:54:48.054067] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2024-12. [2025-10-02T19:54:48.103627] [INFO ] [REMOTE ] LC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:54:48.158794] [INFO ] [REMOTE ] LC: Fetching primary data for 2024-12. [2025-10-02T19:54:48.269232] [INFO ] [REMOTE ] LAZ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:54:48.269532] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2024-12. [2025-10-02T19:54:49.519622] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-02T19:54:49.529011] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-01. [2025-10-02T19:54:49.594897] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-02T19:54:49.604680] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-01. [2025-10-02T19:54:49.843631] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-02T19:54:49.854392] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-01. [2025-10-02T19:54:49.899530] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-02T19:54:49.909770] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-01. [2025-10-02T19:54:51.158383] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-02T19:54:51.167925] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-02. [2025-10-02T19:54:51.215957] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-02T19:54:51.226364] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-02. [2025-10-02T19:54:51.261154] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-02T19:54:51.393209] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-02T19:54:51.472984] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-02. [2025-10-02T19:54:52.273003] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-02. [2025-10-02T19:54:52.349513] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-02T19:54:52.660861] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-02T19:54:53.072995] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-03. [2025-10-02T19:54:53.134159] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-02T19:54:53.872986] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-03. [2025-10-02T19:54:54.153203] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-02T19:54:54.329624] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-02T19:54:54.673051] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-03. [2025-10-02T19:54:55.479893] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-04. [2025-10-02T19:54:55.486312] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-02T19:54:56.070353] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-02T19:54:56.273038] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-04. [2025-10-02T19:54:57.072988] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-04. [2025-10-02T19:54:57.264089] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-02T19:54:57.459980] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-02T19:54:57.873052] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-05. [2025-10-02T19:54:58.673002] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-03. [2025-10-02T19:54:58.975886] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-02T19:54:59.153065] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-02T19:54:59.473004] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-05. [2025-10-02T19:55:00.272986] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-06. [2025-10-02T19:55:00.375806] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-02T19:55:01.073076] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-04. [2025-10-02T19:55:01.403441] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-02T19:55:01.873018] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-05. [2025-10-02T19:55:01.910810] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-02T19:55:02.673016] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-07. [2025-10-02T19:55:02.886751] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-02T19:55:03.473004] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-06. [2025-10-02T19:55:03.517986] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-02T19:55:04.273088] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-06. [2025-10-02T19:55:04.418060] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-02T19:55:05.000221] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-02T19:55:05.073038] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-07. [2025-10-02T19:55:05.731635] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-02T19:55:05.873019] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-07. [2025-10-02T19:55:06.673020] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-05. [2025-10-02T19:55:07.031633] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-02T19:55:07.485618] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-08. [2025-10-02T19:55:07.515401] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-02T19:55:07.943326] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-02T19:55:08.272992] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-08. [2025-10-02T19:55:09.073002] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-06. [2025-10-02T19:55:09.405349] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-02T19:55:09.440285] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-02T19:55:09.873010] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-09. [2025-10-02T19:55:10.672986] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-09. [2025-10-02T19:55:10.708070] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-02T19:55:11.472980] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-07. [2025-10-02T19:55:11.716116] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-02T19:55:11.756295] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-02T19:55:12.273043] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-08. [2025-10-02T19:55:12.997083] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-02T19:55:13.073002] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-08. [2025-10-02T19:55:13.738545] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-02T19:55:13.872997] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-09. [2025-10-02T19:55:14.672999] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-10. [2025-10-02T19:55:14.754993] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-02T19:55:15.473131] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-02T19:55:15.473244] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-09. [2025-10-02T19:55:15.937546] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-02T19:55:15.939743] [INFO ] [REMOTE ] LBRT: Full fetch complete (76539 records). [2025-10-02T19:55:15.939856] [DEBUG] [VALIDATOR ] LBRT: Validating primary data. [2025-10-02T19:55:16.278088] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-10. [2025-10-02T19:55:16.403320] [DEBUG] [VALIDATOR ] LBRT: All expected trading days are present. [2025-10-02T19:55:16.403422] [DEBUG] [VALIDATOR ] LBRT: Primary data validation passed. [2025-10-02T19:55:16.404497] [INFO ] [MAIN ] LBRT: Fetched primary data is valid. [2025-10-02T19:55:16.404569] [DEBUG] [LOCAL ] LBRT: Saving primary data. [2025-10-02T19:55:16.406246] [DEBUG] [LOCAL ] LBRT: Trimmed 76539 records to 53299 (keeping 200 days of data) [2025-10-02T19:55:16.777325] [DEBUG] [LOCAL ] LBRT: Primary data saved (53299 records). [2025-10-02T19:55:16.777528] [INFO ] [MAIN ] LBRT: Full history saved. [2025-10-02T19:55:16.777868] [INFO ] [MAIN ] Update Progress: 1241/2370 symbols completed. LBRT took 32.0s. Estimated remaining: 2h 39m 24s. Rate: 7.1 symbols/min [2025-10-02T19:55:16.978797] [INFO ] [MAIN ] LCII: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:55:17.015493] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-02T19:55:17.052535] [DEBUG] [LOCAL ] LCII: Loaded 28050 existing records from primary storage. [2025-10-02T19:55:17.053039] [INFO ] [MAIN ] LCII: Loaded 28050 existing records. [2025-10-02T19:55:17.078128] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-10. [2025-10-02T19:55:17.251679] [WARN ] [MAIN ] LCII: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:55:17.251911] [INFO ] [MAIN ] LCII: Wiping existing primary data before full refresh. [2025-10-02T19:55:17.251959] [INFO ] [LOCAL ] LCII: Starting deletion of primary data. [2025-10-02T19:55:17.252742] [DEBUG] [LOCAL ] LCII: Deleted primary data file. [2025-10-02T19:55:17.252845] [INFO ] [MAIN ] LCII: Starting full primary refresh. [2025-10-02T19:55:17.540926] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-02T19:55:17.587812] [INFO ] [REMOTE ] LB: Full fetch complete (55881 records). [2025-10-02T19:55:17.598526] [DEBUG] [VALIDATOR ] LB: Validating primary data. [2025-10-02T19:55:17.710333] [INFO ] [REMOTE ] LCII: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:55:17.874561] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-10. [2025-10-02T19:55:18.106157] [DEBUG] [VALIDATOR ] LB: All expected trading days are present. [2025-10-02T19:55:18.106283] [DEBUG] [VALIDATOR ] LB: Primary data validation passed. [2025-10-02T19:55:18.107191] [INFO ] [MAIN ] LB: Fetched primary data is valid. [2025-10-02T19:55:18.107260] [DEBUG] [LOCAL ] LB: Saving primary data. [2025-10-02T19:55:18.109108] [DEBUG] [LOCAL ] LB: Trimmed 55881 records to 37995 (keeping 200 days of data) [2025-10-02T19:55:18.352885] [DEBUG] [LOCAL ] LB: Primary data saved (37995 records). [2025-10-02T19:55:18.353059] [INFO ] [MAIN ] LB: Full history saved. [2025-10-02T19:55:18.353156] [INFO ] [MAIN ] Update Progress: 1242/2370 symbols completed. LB took 33.6s. Estimated remaining: 2h 39m 9s. Rate: 7.1 symbols/min [2025-10-02T19:55:18.487737] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-02T19:55:18.536277] [INFO ] [REMOTE ] LC: Full fetch complete (70565 records). [2025-10-02T19:55:18.539289] [DEBUG] [VALIDATOR ] LC: Validating primary data. [2025-10-02T19:55:18.561872] [INFO ] [MAIN ] LDI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:55:18.682334] [INFO ] [REMOTE ] LCII: Fetching primary data for 2024-12. [2025-10-02T19:55:18.942895] [DEBUG] [LOCAL ] LDI: Loaded 44137 existing records from primary storage. [2025-10-02T19:55:18.943270] [INFO ] [MAIN ] LDI: Loaded 44137 existing records. [2025-10-02T19:55:19.182128] [DEBUG] [VALIDATOR ] LC: All expected trading days are present. [2025-10-02T19:55:19.182745] [DEBUG] [VALIDATOR ] LC: Primary data validation passed. [2025-10-02T19:55:19.203059] [INFO ] [MAIN ] LC: Fetched primary data is valid. [2025-10-02T19:55:19.233355] [DEBUG] [LOCAL ] LC: Saving primary data. [2025-10-02T19:55:19.233275] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-02T19:55:19.286248] [DEBUG] [LOCAL ] LC: Trimmed 70565 records to 48187 (keeping 200 days of data) [2025-10-02T19:55:19.263927] [INFO ] [REMOTE ] LAZ: Full fetch complete (65835 records). [2025-10-02T19:55:19.290898] [WARN ] [MAIN ] LDI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:55:19.291817] [DEBUG] [VALIDATOR ] LAZ: Validating primary data. [2025-10-02T19:55:19.292531] [INFO ] [MAIN ] LDI: Wiping existing primary data before full refresh. [2025-10-02T19:55:19.292633] [INFO ] [LOCAL ] LDI: Starting deletion of primary data. [2025-10-02T19:55:19.294096] [DEBUG] [LOCAL ] LDI: Deleted primary data file. [2025-10-02T19:55:19.294198] [INFO ] [MAIN ] LDI: Starting full primary refresh. [2025-10-02T19:55:20.083473] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-02T19:55:20.140170] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-01. [2025-10-02T19:55:20.188912] [INFO ] [REMOTE ] LDI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:55:20.288024] [INFO ] [REMOTE ] LDI: Fetching primary data for 2024-12. [2025-10-02T19:55:20.431231] [DEBUG] [VALIDATOR ] LAZ: All expected trading days are present. [2025-10-02T19:55:20.436492] [DEBUG] [VALIDATOR ] LAZ: Primary data validation passed. [2025-10-02T19:55:20.446108] [INFO ] [MAIN ] LAZ: Fetched primary data is valid. [2025-10-02T19:55:20.449101] [DEBUG] [LOCAL ] LAZ: Saving primary data. [2025-10-02T19:55:20.485285] [DEBUG] [LOCAL ] LAZ: Trimmed 65835 records to 45182 (keeping 200 days of data) [2025-10-02T19:55:20.501686] [DEBUG] [LOCAL ] LC: Primary data saved (48187 records). [2025-10-02T19:55:20.501828] [INFO ] [MAIN ] LC: Full history saved. [2025-10-02T19:55:20.501940] [INFO ] [MAIN ] Update Progress: 1243/2370 symbols completed. LC took 35.7s. Estimated remaining: 2h 38m 55s. Rate: 7.1 symbols/min [2025-10-02T19:55:20.797086] [INFO ] [MAIN ] LDOS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:55:21.024335] [DEBUG] [LOCAL ] LDOS: Loaded 45597 existing records from primary storage. [2025-10-02T19:55:21.026962] [DEBUG] [LOCAL ] LAZ: Primary data saved (45182 records). [2025-10-02T19:55:21.027584] [INFO ] [MAIN ] LDOS: Loaded 45597 existing records. [2025-10-02T19:55:21.027418] [INFO ] [MAIN ] LAZ: Full history saved. [2025-10-02T19:55:21.044673] [INFO ] [MAIN ] Update Progress: 1244/2370 symbols completed. LAZ took 36.2s. Estimated remaining: 2h 38m 40s. Rate: 7.1 symbols/min [2025-10-02T19:55:21.380607] [INFO ] [MAIN ] LDP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:55:21.447451] [WARN ] [MAIN ] LDOS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:55:21.447979] [INFO ] [MAIN ] LDOS: Wiping existing primary data before full refresh. [2025-10-02T19:55:21.448324] [INFO ] [LOCAL ] LDOS: Starting deletion of primary data. [2025-10-02T19:55:21.454668] [DEBUG] [LOCAL ] LDOS: Deleted primary data file. [2025-10-02T19:55:21.462564] [INFO ] [MAIN ] LDOS: Starting full primary refresh. [2025-10-02T19:55:21.469012] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-02T19:55:21.534760] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-02. [2025-10-02T19:55:21.579289] [DEBUG] [LOCAL ] LDP: Loaded 12928 existing records from primary storage. [2025-10-02T19:55:21.596552] [INFO ] [MAIN ] LDP: Loaded 12928 existing records. [2025-10-02T19:55:22.012268] [WARN ] [MAIN ] LDP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:55:22.019922] [INFO ] [MAIN ] LDP: Wiping existing primary data before full refresh. [2025-10-02T19:55:22.020125] [INFO ] [LOCAL ] LDP: Starting deletion of primary data. [2025-10-02T19:55:22.031122] [DEBUG] [LOCAL ] LDP: Deleted primary data file. [2025-10-02T19:55:22.074135] [INFO ] [MAIN ] LDP: Starting full primary refresh. [2025-10-02T19:55:22.121049] [INFO ] [REMOTE ] LDOS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:55:22.160448] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2024-12. [2025-10-02T19:55:22.233636] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-02T19:55:22.554139] [INFO ] [REMOTE ] LDP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:55:22.672978] [INFO ] [REMOTE ] LDP: Fetching primary data for 2024-12. [2025-10-02T19:55:22.753809] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-02T19:55:23.472984] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-03. [2025-10-02T19:55:23.581203] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-02T19:55:23.683565] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-02T19:55:24.273023] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-01. [2025-10-02T19:55:24.806879] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-02T19:55:25.073013] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-01. [2025-10-02T19:55:25.173972] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-02T19:55:25.873024] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-04. [2025-10-02T19:55:26.374776] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-02T19:55:26.673009] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-01. [2025-10-02T19:55:27.296167] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-02T19:55:27.473051] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-02. [2025-10-02T19:55:28.108713] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-02T19:55:28.273041] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-02. [2025-10-02T19:55:29.072540] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-02T19:55:29.079416] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-02. [2025-10-02T19:55:29.610629] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-02T19:55:29.872978] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-03. [2025-10-02T19:55:29.947221] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-02T19:55:30.673024] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-03. [2025-10-02T19:55:30.811940] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-02T19:55:31.473063] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-03. [2025-10-02T19:55:32.273035] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-05. [2025-10-02T19:55:32.328850] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-02T19:55:32.478373] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-02T19:55:33.073008] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-04. [2025-10-02T19:55:33.439481] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-02T19:55:33.873016] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-04. [2025-10-02T19:55:34.626402] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-02T19:55:34.673050] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-04. [2025-10-02T19:55:35.474001] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-05. [2025-10-02T19:55:35.476891] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-02T19:55:35.568075] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-02T19:55:36.273042] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-05. [2025-10-02T19:55:37.073009] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-05. [2025-10-02T19:55:37.089244] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-02T19:55:37.219692] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-02T19:55:37.873058] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-06. [2025-10-02T19:55:38.203201] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-02T19:55:38.615427] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-02T19:55:38.673047] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-06. [2025-10-02T19:55:39.473004] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-06. [2025-10-02T19:55:40.152131] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-02T19:55:40.272984] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-07. [2025-10-02T19:55:40.655426] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-02T19:55:40.846905] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-02T19:55:41.073022] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-08. [2025-10-02T19:55:41.767019] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-02T19:55:41.873036] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-07. [2025-10-02T19:55:42.673046] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-06. [2025-10-02T19:55:42.823929] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-02T19:55:43.473087] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-08. [2025-10-02T19:55:44.273039] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-09. [2025-10-02T19:55:44.408374] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-02T19:55:44.677799] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-02T19:55:45.073036] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-07. [2025-10-02T19:55:45.093559] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-02T19:55:45.873002] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-10. [2025-10-02T19:55:46.270692] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-02T19:55:46.572110] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-02T19:55:46.573169] [INFO ] [REMOTE ] LDP: Full fetch complete (19413 records). [2025-10-02T19:55:46.573244] [DEBUG] [VALIDATOR ] LDP: Validating primary data. [2025-10-02T19:55:46.678120] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-09. [2025-10-02T19:55:46.992347] [DEBUG] [VALIDATOR ] LDP: All expected trading days are present. [2025-10-02T19:55:46.992437] [DEBUG] [VALIDATOR ] LDP: Primary data validation passed. [2025-10-02T19:55:46.992970] [INFO ] [MAIN ] LDP: Fetched primary data is valid. [2025-10-02T19:55:46.993073] [DEBUG] [LOCAL ] LDP: Saving primary data. [2025-10-02T19:55:46.993865] [DEBUG] [LOCAL ] LDP: Trimmed 19413 records to 13028 (keeping 200 days of data) [2025-10-02T19:55:47.078513] [DEBUG] [LOCAL ] LDP: Primary data saved (13028 records). [2025-10-02T19:55:47.078684] [INFO ] [MAIN ] LDP: Full history saved. [2025-10-02T19:55:47.078815] [INFO ] [MAIN ] Update Progress: 1245/2370 symbols completed. LDP took 26.0s. Estimated remaining: 2h 38m 47s. Rate: 7.1 symbols/min [2025-10-02T19:55:47.266583] [INFO ] [MAIN ] LEA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:55:47.315364] [DEBUG] [LOCAL ] LEA: Loaded 41746 existing records from primary storage. [2025-10-02T19:55:47.315747] [INFO ] [MAIN ] LEA: Loaded 41746 existing records. [2025-10-02T19:55:47.479020] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-08. [2025-10-02T19:55:47.517796] [WARN ] [MAIN ] LEA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:55:47.518127] [INFO ] [MAIN ] LEA: Wiping existing primary data before full refresh. [2025-10-02T19:55:47.518243] [INFO ] [LOCAL ] LEA: Starting deletion of primary data. [2025-10-02T19:55:47.519275] [DEBUG] [LOCAL ] LEA: Deleted primary data file. [2025-10-02T19:55:47.519352] [INFO ] [MAIN ] LEA: Starting full primary refresh. [2025-10-02T19:55:47.928950] [INFO ] [REMOTE ] LEA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:55:47.939513] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-02T19:55:48.273011] [INFO ] [REMOTE ] LEA: Fetching primary data for 2024-12. [2025-10-02T19:55:49.073039] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-10. [2025-10-02T19:55:49.222330] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-02T19:55:49.888369] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-09. [2025-10-02T19:55:49.892156] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-02T19:55:49.945366] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-02T19:55:49.947803] [INFO ] [REMOTE ] LCII: Full fetch complete (39223 records). [2025-10-02T19:55:49.947925] [DEBUG] [VALIDATOR ] LCII: Validating primary data. [2025-10-02T19:55:50.480617] [DEBUG] [VALIDATOR ] LCII: All expected trading days are present. [2025-10-02T19:55:50.480734] [DEBUG] [VALIDATOR ] LCII: Primary data validation passed. [2025-10-02T19:55:50.481501] [INFO ] [MAIN ] LCII: Fetched primary data is valid. [2025-10-02T19:55:50.481552] [DEBUG] [LOCAL ] LCII: Saving primary data. [2025-10-02T19:55:50.482603] [DEBUG] [LOCAL ] LCII: Trimmed 39223 records to 28181 (keeping 200 days of data) [2025-10-02T19:55:50.676425] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-07. [2025-10-02T19:55:50.680384] [DEBUG] [LOCAL ] LCII: Primary data saved (28181 records). [2025-10-02T19:55:50.680552] [INFO ] [MAIN ] LCII: Full history saved. [2025-10-02T19:55:50.680770] [INFO ] [MAIN ] Update Progress: 1246/2370 symbols completed. LCII took 33.9s. Estimated remaining: 2h 38m 34s. Rate: 7.1 symbols/min [2025-10-02T19:55:50.891013] [INFO ] [MAIN ] LEG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:55:50.939633] [DEBUG] [LOCAL ] LEG: Loaded 50265 existing records from primary storage. [2025-10-02T19:55:50.940031] [INFO ] [MAIN ] LEG: Loaded 50265 existing records. [2025-10-02T19:55:51.145462] [WARN ] [MAIN ] LEG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:55:51.145706] [INFO ] [MAIN ] LEG: Wiping existing primary data before full refresh. [2025-10-02T19:55:51.145766] [INFO ] [LOCAL ] LEG: Starting deletion of primary data. [2025-10-02T19:55:51.146813] [DEBUG] [LOCAL ] LEG: Deleted primary data file. [2025-10-02T19:55:51.146874] [INFO ] [MAIN ] LEG: Starting full primary refresh. [2025-10-02T19:55:51.473056] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-01. [2025-10-02T19:55:51.565948] [INFO ] [REMOTE ] LEG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:55:51.609967] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-02T19:55:52.273043] [INFO ] [REMOTE ] LEG: Fetching primary data for 2024-12. [2025-10-02T19:55:52.390227] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-02T19:55:53.014956] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-02T19:55:53.073054] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-08. [2025-10-02T19:55:53.582806] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-02T19:55:53.873053] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-10. [2025-10-02T19:55:54.388599] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-02T19:55:54.673026] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-02. [2025-10-02T19:55:55.148083] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-02T19:55:55.150027] [INFO ] [REMOTE ] LDOS: Full fetch complete (67596 records). [2025-10-02T19:55:55.150136] [DEBUG] [VALIDATOR ] LDOS: Validating primary data. [2025-10-02T19:55:55.481941] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-01. [2025-10-02T19:55:55.605478] [DEBUG] [VALIDATOR ] LDOS: All expected trading days are present. [2025-10-02T19:55:55.605575] [DEBUG] [VALIDATOR ] LDOS: Primary data validation passed. [2025-10-02T19:55:55.607230] [INFO ] [MAIN ] LDOS: Fetched primary data is valid. [2025-10-02T19:55:55.607304] [DEBUG] [LOCAL ] LDOS: Saving primary data. [2025-10-02T19:55:55.608924] [DEBUG] [LOCAL ] LDOS: Trimmed 67596 records to 45923 (keeping 200 days of data) [2025-10-02T19:55:55.915074] [DEBUG] [LOCAL ] LDOS: Primary data saved (45923 records). [2025-10-02T19:55:55.915387] [INFO ] [MAIN ] LDOS: Full history saved. [2025-10-02T19:55:55.915615] [INFO ] [MAIN ] Update Progress: 1247/2370 symbols completed. LDOS took 35.4s. Estimated remaining: 2h 38m 23s. Rate: 7.1 symbols/min [2025-10-02T19:55:56.110207] [INFO ] [MAIN ] LEN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:55:56.135701] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-02T19:55:56.196363] [DEBUG] [LOCAL ] LEN: Loaded 53177 existing records from primary storage. [2025-10-02T19:55:56.196797] [INFO ] [MAIN ] LEN: Loaded 53177 existing records. [2025-10-02T19:55:56.281901] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-03. [2025-10-02T19:55:56.398747] [WARN ] [MAIN ] LEN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:55:56.398959] [INFO ] [MAIN ] LEN: Wiping existing primary data before full refresh. [2025-10-02T19:55:56.399009] [INFO ] [LOCAL ] LEN: Starting deletion of primary data. [2025-10-02T19:55:56.400273] [DEBUG] [LOCAL ] LEN: Deleted primary data file. [2025-10-02T19:55:56.400339] [INFO ] [MAIN ] LEN: Starting full primary refresh. [2025-10-02T19:55:56.794083] [INFO ] [REMOTE ] LEN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:55:57.073000] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-09. [2025-10-02T19:55:57.121475] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-02T19:55:57.579509] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-02T19:55:57.873017] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-02. [2025-10-02T19:55:58.673043] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-04. [2025-10-02T19:55:59.198675] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-02T19:55:59.283443] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-02T19:55:59.473039] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-03. [2025-10-02T19:56:00.229503] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-02T19:56:00.273006] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-05. [2025-10-02T19:56:01.073008] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-10. [2025-10-02T19:56:01.348353] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-02T19:56:01.873062] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-04. [2025-10-02T19:56:02.673030] [INFO ] [REMOTE ] LEN: Fetching primary data for 2024-12. [2025-10-02T19:56:03.071051] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-02T19:56:03.073201] [INFO ] [REMOTE ] LDI: Full fetch complete (60648 records). [2025-10-02T19:56:03.073509] [DEBUG] [VALIDATOR ] LDI: Validating primary data. [2025-10-02T19:56:03.516758] [DEBUG] [VALIDATOR ] LDI: All expected trading days are present. [2025-10-02T19:56:03.522193] [DEBUG] [VALIDATOR ] LDI: Primary data validation passed. [2025-10-02T19:56:03.536170] [INFO ] [MAIN ] LDI: Fetched primary data is valid. [2025-10-02T19:56:03.536364] [DEBUG] [LOCAL ] LDI: Saving primary data. [2025-10-02T19:56:03.539399] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-05 (3.27 seconds). [2025-10-02T19:56:03.550275] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-06. [2025-10-02T19:56:03.549796] [DEBUG] [LOCAL ] LDI: Trimmed 60648 records to 44523 (keeping 200 days of data) [2025-10-02T19:56:03.697783] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-02T19:56:03.865822] [DEBUG] [LOCAL ] LDI: Primary data saved (44523 records). [2025-10-02T19:56:03.865959] [INFO ] [MAIN ] LDI: Full history saved. [2025-10-02T19:56:03.866072] [INFO ] [MAIN ] Update Progress: 1248/2370 symbols completed. LDI took 45.5s. Estimated remaining: 2h 38m 14s. Rate: 7.1 symbols/min [2025-10-02T19:56:04.072738] [INFO ] [MAIN ] LEO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:56:04.092131] [DEBUG] [LOCAL ] LEO: Loaded 17282 existing records from primary storage. [2025-10-02T19:56:04.092531] [INFO ] [MAIN ] LEO: Loaded 17282 existing records. [2025-10-02T19:56:04.273773] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-05. [2025-10-02T19:56:04.300448] [WARN ] [MAIN ] LEO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:56:04.302257] [INFO ] [MAIN ] LEO: Wiping existing primary data before full refresh. [2025-10-02T19:56:04.302448] [INFO ] [LOCAL ] LEO: Starting deletion of primary data. [2025-10-02T19:56:04.315678] [DEBUG] [LOCAL ] LEO: Deleted primary data file. [2025-10-02T19:56:04.325683] [INFO ] [MAIN ] LEO: Starting full primary refresh. [2025-10-02T19:56:04.432501] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-02T19:56:04.770614] [INFO ] [REMOTE ] LEO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:56:05.058733] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-02T19:56:05.072962] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-07. [2025-10-02T19:56:05.567752] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-02T19:56:05.872999] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-01. [2025-10-02T19:56:06.568976] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-02T19:56:06.673010] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-06. [2025-10-02T19:56:07.473052] [INFO ] [REMOTE ] LEO: Fetching primary data for 2024-12. [2025-10-02T19:56:07.807909] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-02T19:56:07.905546] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-02T19:56:08.070585] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-02T19:56:08.273006] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-01. [2025-10-02T19:56:09.073013] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-07. [2025-10-02T19:56:09.389712] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-02T19:56:09.873030] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-02. [2025-10-02T19:56:10.672980] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-08. [2025-10-02T19:56:10.787390] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-02T19:56:10.802975] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-02T19:56:11.473006] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-03. [2025-10-02T19:56:12.222485] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-02T19:56:12.272979] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-02. [2025-10-02T19:56:12.303936] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-02T19:56:13.073067] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-04. [2025-10-02T19:56:13.873017] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-08. [2025-10-02T19:56:14.061851] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-02T19:56:14.183498] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-02T19:56:14.673022] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-03. [2025-10-02T19:56:15.473011] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-09. [2025-10-02T19:56:15.569372] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-02T19:56:16.272971] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-05. [2025-10-02T19:56:16.630038] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-02T19:56:16.667903] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-02T19:56:16.827697] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-02T19:56:17.073009] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-06. [2025-10-02T19:56:17.872986] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-04. [2025-10-02T19:56:17.918002] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-02T19:56:18.672997] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-10. [2025-10-02T19:56:19.473044] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-09. [2025-10-02T19:56:19.809698] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-02T19:56:19.884973] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-02T19:56:19.887155] [INFO ] [REMOTE ] LEA: Full fetch complete (60923 records). [2025-10-02T19:56:19.887361] [DEBUG] [VALIDATOR ] LEA: Validating primary data. [2025-10-02T19:56:20.278315] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-07. [2025-10-02T19:56:20.348067] [DEBUG] [VALIDATOR ] LEA: All expected trading days are present. [2025-10-02T19:56:20.348174] [DEBUG] [VALIDATOR ] LEA: Primary data validation passed. [2025-10-02T19:56:20.349333] [INFO ] [MAIN ] LEA: Fetched primary data is valid. [2025-10-02T19:56:20.349405] [DEBUG] [LOCAL ] LEA: Saving primary data. [2025-10-02T19:56:20.350867] [DEBUG] [LOCAL ] LEA: Trimmed 60923 records to 42058 (keeping 200 days of data) [2025-10-02T19:56:20.637503] [DEBUG] [LOCAL ] LEA: Primary data saved (42058 records). [2025-10-02T19:56:20.637667] [INFO ] [MAIN ] LEA: Full history saved. [2025-10-02T19:56:20.637793] [INFO ] [MAIN ] Update Progress: 1249/2370 symbols completed. LEA took 33.6s. Estimated remaining: 2h 38m 13s. Rate: 7.1 symbols/min [2025-10-02T19:56:20.839023] [INFO ] [MAIN ] LEVI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:56:20.871314] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-02T19:56:20.932348] [DEBUG] [LOCAL ] LEVI: Loaded 51565 existing records from primary storage. [2025-10-02T19:56:20.932774] [INFO ] [MAIN ] LEVI: Loaded 51565 existing records. [2025-10-02T19:56:21.087918] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-05. [2025-10-02T19:56:21.141138] [WARN ] [MAIN ] LEVI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:56:21.141500] [INFO ] [MAIN ] LEVI: Wiping existing primary data before full refresh. [2025-10-02T19:56:21.141552] [INFO ] [LOCAL ] LEVI: Starting deletion of primary data. [2025-10-02T19:56:21.143060] [DEBUG] [LOCAL ] LEVI: Deleted primary data file. [2025-10-02T19:56:21.143124] [INFO ] [MAIN ] LEVI: Starting full primary refresh. [2025-10-02T19:56:21.410958] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-02T19:56:21.594922] [INFO ] [REMOTE ] LEVI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:56:21.872953] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-10. [2025-10-02T19:56:22.673005] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-08. [2025-10-02T19:56:23.134440] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-02T19:56:23.287848] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-02T19:56:23.289981] [INFO ] [REMOTE ] LEG: Full fetch complete (73074 records). [2025-10-02T19:56:23.290144] [DEBUG] [VALIDATOR ] LEG: Validating primary data. [2025-10-02T19:56:23.477458] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2024-12. [2025-10-02T19:56:23.477380] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-02T19:56:23.757202] [DEBUG] [VALIDATOR ] LEG: All expected trading days are present. [2025-10-02T19:56:23.757288] [DEBUG] [VALIDATOR ] LEG: Primary data validation passed. [2025-10-02T19:56:23.758446] [INFO ] [MAIN ] LEG: Fetched primary data is valid. [2025-10-02T19:56:23.758517] [DEBUG] [LOCAL ] LEG: Saving primary data. [2025-10-02T19:56:23.760390] [DEBUG] [LOCAL ] LEG: Trimmed 73074 records to 50600 (keeping 200 days of data) [2025-10-02T19:56:24.084111] [DEBUG] [LOCAL ] LEG: Primary data saved (50600 records). [2025-10-02T19:56:24.084265] [INFO ] [MAIN ] LEG: Full history saved. [2025-10-02T19:56:24.084354] [INFO ] [MAIN ] Update Progress: 1250/2370 symbols completed. LEG took 33.4s. Estimated remaining: 2h 37m 60s. Rate: 7.1 symbols/min [2025-10-02T19:56:24.278509] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-06. [2025-10-02T19:56:24.280941] [INFO ] [MAIN ] LFT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:56:24.303787] [DEBUG] [LOCAL ] LFT: Loaded 18303 existing records from primary storage. [2025-10-02T19:56:24.304076] [INFO ] [MAIN ] LFT: Loaded 18303 existing records. [2025-10-02T19:56:24.515413] [WARN ] [MAIN ] LFT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:56:24.515669] [INFO ] [MAIN ] LFT: Wiping existing primary data before full refresh. [2025-10-02T19:56:24.515734] [INFO ] [LOCAL ] LFT: Starting deletion of primary data. [2025-10-02T19:56:24.516322] [DEBUG] [LOCAL ] LFT: Deleted primary data file. [2025-10-02T19:56:24.516383] [INFO ] [MAIN ] LFT: Starting full primary refresh. [2025-10-02T19:56:24.918517] [INFO ] [REMOTE ] LFT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:56:25.073050] [INFO ] [REMOTE ] LFT: Fetching primary data for 2024-12. [2025-10-02T19:56:25.282586] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-02T19:56:25.873045] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-09. [2025-10-02T19:56:26.138535] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-02T19:56:26.237790] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-02T19:56:26.672989] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-01. [2025-10-02T19:56:26.848622] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-02T19:56:27.475297] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-10. [2025-10-02T19:56:27.477166] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-02T19:56:28.078107] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-02T19:56:28.079249] [INFO ] [REMOTE ] LEO: Full fetch complete (26943 records). [2025-10-02T19:56:28.079321] [DEBUG] [VALIDATOR ] LEO: Validating primary data. [2025-10-02T19:56:28.284951] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-02. [2025-10-02T19:56:28.512685] [DEBUG] [VALIDATOR ] LEO: All expected trading days are present. [2025-10-02T19:56:28.512789] [DEBUG] [VALIDATOR ] LEO: Primary data validation passed. [2025-10-02T19:56:28.513455] [INFO ] [MAIN ] LEO: Fetched primary data is valid. [2025-10-02T19:56:28.513521] [DEBUG] [LOCAL ] LEO: Saving primary data. [2025-10-02T19:56:28.514306] [DEBUG] [LOCAL ] LEO: Trimmed 26943 records to 17395 (keeping 200 days of data) [2025-10-02T19:56:28.621511] [DEBUG] [LOCAL ] LEO: Primary data saved (17395 records). [2025-10-02T19:56:28.621763] [INFO ] [MAIN ] LEO: Full history saved. [2025-10-02T19:56:28.621890] [INFO ] [MAIN ] Update Progress: 1251/2370 symbols completed. LEO took 24.8s. Estimated remaining: 2h 37m 48s. Rate: 7.1 symbols/min [2025-10-02T19:56:28.824084] [INFO ] [MAIN ] LGI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:56:28.835891] [DEBUG] [LOCAL ] LGI: Loaded 9839 existing records from primary storage. [2025-10-02T19:56:28.836128] [INFO ] [MAIN ] LGI: Loaded 9839 existing records. [2025-10-02T19:56:29.037734] [WARN ] [MAIN ] LGI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:56:29.037994] [INFO ] [MAIN ] LGI: Wiping existing primary data before full refresh. [2025-10-02T19:56:29.038051] [INFO ] [LOCAL ] LGI: Starting deletion of primary data. [2025-10-02T19:56:29.038611] [DEBUG] [LOCAL ] LGI: Deleted primary data file. [2025-10-02T19:56:29.038708] [INFO ] [MAIN ] LGI: Starting full primary refresh. [2025-10-02T19:56:29.078114] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-07. [2025-10-02T19:56:29.380433] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-02T19:56:29.472216] [INFO ] [REMOTE ] LGI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:56:29.873057] [INFO ] [REMOTE ] LGI: Fetching primary data for 2024-12. [2025-10-02T19:56:30.386154] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-02T19:56:30.672982] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-01. [2025-10-02T19:56:31.108021] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-02T19:56:31.473005] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-08. [2025-10-02T19:56:32.273000] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-03. [2025-10-02T19:56:32.353139] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-02T19:56:32.915035] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-02T19:56:33.073002] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-01. [2025-10-02T19:56:33.234424] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-02T19:56:33.833926] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-02T19:56:33.872993] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-02. [2025-10-02T19:56:34.447841] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-02T19:56:34.673039] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-09. [2025-10-02T19:56:35.473013] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-04. [2025-10-02T19:56:36.273030] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-03. [2025-10-02T19:56:36.477041] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-02T19:56:36.931017] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-02T19:56:37.051869] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-02T19:56:37.073020] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-05. [2025-10-02T19:56:37.808379] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-02T19:56:37.873018] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-04. [2025-10-02T19:56:38.673059] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-10. [2025-10-02T19:56:38.733502] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-02T19:56:39.473001] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-05. [2025-10-02T19:56:40.249022] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-02T19:56:40.272999] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-06. [2025-10-02T19:56:40.553204] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-02T19:56:40.555981] [INFO ] [REMOTE ] LEN: Full fetch complete (77032 records). [2025-10-02T19:56:40.556158] [DEBUG] [VALIDATOR ] LEN: Validating primary data. [2025-10-02T19:56:41.022668] [DEBUG] [VALIDATOR ] LEN: All expected trading days are present. [2025-10-02T19:56:41.022764] [DEBUG] [VALIDATOR ] LEN: Primary data validation passed. [2025-10-02T19:56:41.023755] [INFO ] [MAIN ] LEN: Fetched primary data is valid. [2025-10-02T19:56:41.023820] [DEBUG] [LOCAL ] LEN: Saving primary data. [2025-10-02T19:56:41.025309] [DEBUG] [LOCAL ] LEN: Trimmed 77032 records to 53562 (keeping 200 days of data) [2025-10-02T19:56:41.083389] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-02. [2025-10-02T19:56:41.139280] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-02T19:56:41.389583] [DEBUG] [LOCAL ] LEN: Primary data saved (53562 records). [2025-10-02T19:56:41.389760] [INFO ] [MAIN ] LEN: Full history saved. [2025-10-02T19:56:41.389855] [INFO ] [MAIN ] Update Progress: 1252/2370 symbols completed. LEN took 45.5s. Estimated remaining: 2h 37m 43s. Rate: 7.1 symbols/min [2025-10-02T19:56:41.574562] [INFO ] [MAIN ] LH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:56:41.612541] [DEBUG] [LOCAL ] LH: Loaded 37827 existing records from primary storage. [2025-10-02T19:56:41.612908] [INFO ] [MAIN ] LH: Loaded 37827 existing records. [2025-10-02T19:56:41.812026] [WARN ] [MAIN ] LH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:56:41.813492] [INFO ] [MAIN ] LH: Wiping existing primary data before full refresh. [2025-10-02T19:56:41.813553] [INFO ] [LOCAL ] LH: Starting deletion of primary data. [2025-10-02T19:56:41.815117] [DEBUG] [LOCAL ] LH: Deleted primary data file. [2025-10-02T19:56:41.815188] [INFO ] [MAIN ] LH: Starting full primary refresh. [2025-10-02T19:56:41.885424] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-06. [2025-10-02T19:56:42.222963] [INFO ] [REMOTE ] LH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:56:42.673003] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-07. [2025-10-02T19:56:43.148888] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-02T19:56:43.236630] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-10-02T19:56:43.247620] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-02T19:56:43.473049] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-07. [2025-10-02T19:56:44.273021] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-08. [2025-10-02T19:56:44.564224] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-02T19:56:45.073040] [INFO ] [REMOTE ] LH: Fetching primary data for 2024-12. [2025-10-02T19:56:45.252451] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-02T19:56:45.873009] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-08. [2025-10-02T19:56:46.310606] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-02T19:56:46.673001] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-03. [2025-10-02T19:56:46.956087] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-02T19:56:47.473041] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-09. [2025-10-02T19:56:48.210941] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-02T19:56:48.272982] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-01. [2025-10-02T19:56:48.607720] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-02T19:56:49.073011] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-10. [2025-10-02T19:56:49.508767] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-02T19:56:49.624823] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-02T19:56:49.625773] [INFO ] [REMOTE ] LGI: Full fetch complete (14277 records). [2025-10-02T19:56:49.625851] [DEBUG] [VALIDATOR ] LGI: Validating primary data. [2025-10-02T19:56:49.878229] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-09. [2025-10-02T19:56:50.020245] [DEBUG] [VALIDATOR ] LGI: All expected trading days are present. [2025-10-02T19:56:50.020331] [DEBUG] [VALIDATOR ] LGI: Primary data validation passed. [2025-10-02T19:56:50.020670] [INFO ] [MAIN ] LGI: Fetched primary data is valid. [2025-10-02T19:56:50.020733] [DEBUG] [LOCAL ] LGI: Saving primary data. [2025-10-02T19:56:50.021264] [DEBUG] [LOCAL ] LGI: Trimmed 14277 records to 9893 (keeping 200 days of data) [2025-10-02T19:56:50.084660] [DEBUG] [LOCAL ] LGI: Primary data saved (9893 records). [2025-10-02T19:56:50.084808] [INFO ] [MAIN ] LGI: Full history saved. [2025-10-02T19:56:50.084889] [INFO ] [MAIN ] Update Progress: 1253/2370 symbols completed. LGI took 21.5s. Estimated remaining: 2h 37m 35s. Rate: 7.1 symbols/min [2025-10-02T19:56:50.294186] [INFO ] [MAIN ] LHX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:56:50.350391] [DEBUG] [LOCAL ] LHX: Loaded 48686 existing records from primary storage. [2025-10-02T19:56:50.350765] [INFO ] [MAIN ] LHX: Loaded 48686 existing records. [2025-10-02T19:56:50.544006] [WARN ] [MAIN ] LHX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:56:50.544843] [INFO ] [MAIN ] LHX: Wiping existing primary data before full refresh. [2025-10-02T19:56:50.544922] [INFO ] [LOCAL ] LHX: Starting deletion of primary data. [2025-10-02T19:56:50.546023] [DEBUG] [LOCAL ] LHX: Deleted primary data file. [2025-10-02T19:56:50.546117] [INFO ] [MAIN ] LHX: Starting full primary refresh. [2025-10-02T19:56:50.678104] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-02. [2025-10-02T19:56:50.944767] [INFO ] [REMOTE ] LHX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:56:50.955072] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-02T19:56:51.473009] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-04. [2025-10-02T19:56:52.196198] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-02T19:56:52.273013] [INFO ] [REMOTE ] LHX: Fetching primary data for 2024-12. [2025-10-02T19:56:53.073003] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-03. [2025-10-02T19:56:53.332061] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-02T19:56:53.872988] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-10. [2025-10-02T19:56:53.917766] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-02T19:56:54.221003] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-02T19:56:54.539848] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-02T19:56:54.540875] [INFO ] [REMOTE ] LFT: Full fetch complete (24157 records). [2025-10-02T19:56:54.540954] [DEBUG] [VALIDATOR ] LFT: Validating primary data. [2025-10-02T19:56:54.678138] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-04. [2025-10-02T19:56:54.947472] [DEBUG] [VALIDATOR ] LFT: All expected trading days are present. [2025-10-02T19:56:54.947557] [DEBUG] [VALIDATOR ] LFT: Primary data validation passed. [2025-10-02T19:56:54.948129] [INFO ] [MAIN ] LFT: Fetched primary data is valid. [2025-10-02T19:56:54.948214] [DEBUG] [LOCAL ] LFT: Saving primary data. [2025-10-02T19:56:54.948949] [DEBUG] [LOCAL ] LFT: Trimmed 24157 records to 18394 (keeping 200 days of data) [2025-10-02T19:56:55.061124] [DEBUG] [LOCAL ] LFT: Primary data saved (18394 records). [2025-10-02T19:56:55.061276] [INFO ] [MAIN ] LFT: Full history saved. [2025-10-02T19:56:55.061366] [INFO ] [MAIN ] Update Progress: 1254/2370 symbols completed. LFT took 31.0s. Estimated remaining: 2h 37m 24s. Rate: 7.1 symbols/min [2025-10-02T19:56:55.248550] [INFO ] [MAIN ] LII: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:56:55.278957] [DEBUG] [LOCAL ] LII: Loaded 27988 existing records from primary storage. [2025-10-02T19:56:55.279232] [INFO ] [MAIN ] LII: Loaded 27988 existing records. [2025-10-02T19:56:55.469318] [WARN ] [MAIN ] LII: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:56:55.469538] [INFO ] [MAIN ] LII: Wiping existing primary data before full refresh. [2025-10-02T19:56:55.469589] [INFO ] [LOCAL ] LII: Starting deletion of primary data. [2025-10-02T19:56:55.470586] [DEBUG] [LOCAL ] LII: Deleted primary data file. [2025-10-02T19:56:55.470685] [INFO ] [MAIN ] LII: Starting full primary refresh. [2025-10-02T19:56:55.483300] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-05. [2025-10-02T19:56:55.859113] [INFO ] [REMOTE ] LII: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:56:56.273171] [INFO ] [REMOTE ] LII: Fetching primary data for 2024-12. [2025-10-02T19:56:56.467526] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-02T19:56:56.961079] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-02T19:56:57.073054] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-01. [2025-10-02T19:56:57.517385] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-02T19:56:57.872965] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-01. [2025-10-02T19:56:58.672989] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-05. [2025-10-02T19:56:58.859117] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-02T19:56:59.210213] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-02T19:56:59.473019] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-02. [2025-10-02T19:57:00.272978] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-02. [2025-10-02T19:57:00.303210] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-02T19:57:01.001728] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-02T19:57:01.073021] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-03. [2025-10-02T19:57:01.781570] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-02T19:57:01.873014] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-06. [2025-10-02T19:57:02.020793] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-02T19:57:02.672999] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-03. [2025-10-02T19:57:03.313386] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-02T19:57:03.473016] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-06. [2025-10-02T19:57:04.116490] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-02T19:57:04.273017] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-07. [2025-10-02T19:57:04.824862] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-02T19:57:05.073039] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-04. [2025-10-02T19:57:05.882728] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-07. [2025-10-02T19:57:05.913141] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-02T19:57:06.673054] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-08. [2025-10-02T19:57:06.923089] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-02T19:57:07.472983] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-05. [2025-10-02T19:57:07.800723] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-02T19:57:08.150400] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-02T19:57:08.273010] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-08. [2025-10-02T19:57:09.072985] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-04. [2025-10-02T19:57:09.284048] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-02T19:57:09.873633] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-09. [2025-10-02T19:57:09.876696] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-02T19:57:10.587810] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-02T19:57:10.672992] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-06. [2025-10-02T19:57:10.830765] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-02T19:57:11.472999] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-09. [2025-10-02T19:57:12.273000] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-10. [2025-10-02T19:57:12.556465] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-02T19:57:13.072996] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-07. [2025-10-02T19:57:13.240906] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-02T19:57:13.448036] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-02T19:57:13.449851] [INFO ] [REMOTE ] LH: Full fetch complete (54952 records). [2025-10-02T19:57:13.449947] [DEBUG] [VALIDATOR ] LH: Validating primary data. [2025-10-02T19:57:13.863638] [DEBUG] [VALIDATOR ] LH: All expected trading days are present. [2025-10-02T19:57:13.863756] [DEBUG] [VALIDATOR ] LH: Primary data validation passed. [2025-10-02T19:57:13.864582] [INFO ] [MAIN ] LH: Fetched primary data is valid. [2025-10-02T19:57:13.864670] [DEBUG] [LOCAL ] LH: Saving primary data. [2025-10-02T19:57:13.866007] [DEBUG] [LOCAL ] LH: Trimmed 54952 records to 38094 (keeping 200 days of data) [2025-10-02T19:57:13.924546] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-10. [2025-10-02T19:57:14.126064] [DEBUG] [LOCAL ] LH: Primary data saved (38094 records). [2025-10-02T19:57:14.126240] [INFO ] [MAIN ] LH: Full history saved. [2025-10-02T19:57:14.126345] [INFO ] [MAIN ] Update Progress: 1255/2370 symbols completed. LH took 32.7s. Estimated remaining: 2h 37m 24s. Rate: 7.1 symbols/min [2025-10-02T19:57:14.321994] [INFO ] [MAIN ] LION: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:57:14.368475] [DEBUG] [LOCAL ] LION: Loaded 44271 existing records from primary storage. [2025-10-02T19:57:14.368844] [INFO ] [MAIN ] LION: Loaded 44271 existing records. [2025-10-02T19:57:14.585898] [WARN ] [MAIN ] LION: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:57:14.586284] [INFO ] [MAIN ] LION: Wiping existing primary data before full refresh. [2025-10-02T19:57:14.586504] [INFO ] [LOCAL ] LION: Starting deletion of primary data. [2025-10-02T19:57:14.587480] [DEBUG] [LOCAL ] LION: Deleted primary data file. [2025-10-02T19:57:14.587544] [INFO ] [MAIN ] LION: Starting full primary refresh. [2025-10-02T19:57:14.673123] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-05. [2025-10-02T19:57:15.001625] [INFO ] [REMOTE ] LION: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:57:15.039415] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-02T19:57:15.472993] [INFO ] [REMOTE ] LION: Fetching primary data for 2024-12. [2025-10-02T19:57:15.514306] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-02T19:57:15.517239] [INFO ] [REMOTE ] LEVI: Full fetch complete (74450 records). [2025-10-02T19:57:15.517426] [DEBUG] [VALIDATOR ] LEVI: Validating primary data. [2025-10-02T19:57:15.969908] [DEBUG] [VALIDATOR ] LEVI: All expected trading days are present. [2025-10-02T19:57:15.970231] [DEBUG] [VALIDATOR ] LEVI: Primary data validation passed. [2025-10-02T19:57:15.971369] [INFO ] [MAIN ] LEVI: Fetched primary data is valid. [2025-10-02T19:57:15.971612] [DEBUG] [LOCAL ] LEVI: Saving primary data. [2025-10-02T19:57:15.973399] [DEBUG] [LOCAL ] LEVI: Trimmed 74450 records to 51949 (keeping 200 days of data) [2025-10-02T19:57:16.104083] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-02T19:57:16.299889] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-06. [2025-10-02T19:57:16.352089] [DEBUG] [LOCAL ] LEVI: Primary data saved (51949 records). [2025-10-02T19:57:16.352343] [INFO ] [MAIN ] LEVI: Full history saved. [2025-10-02T19:57:16.352451] [INFO ] [MAIN ] Update Progress: 1256/2370 symbols completed. LEVI took 55.7s. Estimated remaining: 2h 37m 10s. Rate: 7.1 symbols/min [2025-10-02T19:57:16.545755] [INFO ] [MAIN ] LITB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:57:16.552448] [DEBUG] [LOCAL ] LITB: Loaded 4340 existing records from primary storage. [2025-10-02T19:57:16.552679] [INFO ] [MAIN ] LITB: Loaded 4340 existing records. [2025-10-02T19:57:16.696463] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-02T19:57:16.810838] [WARN ] [MAIN ] LITB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:57:16.811127] [INFO ] [MAIN ] LITB: Wiping existing primary data before full refresh. [2025-10-02T19:57:16.811178] [INFO ] [LOCAL ] LITB: Starting deletion of primary data. [2025-10-02T19:57:16.811470] [DEBUG] [LOCAL ] LITB: Deleted primary data file. [2025-10-02T19:57:16.811530] [INFO ] [MAIN ] LITB: Starting full primary refresh. [2025-10-02T19:57:17.076967] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-08. [2025-10-02T19:57:17.202661] [INFO ] [REMOTE ] LITB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:57:17.485090] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-02T19:57:17.873045] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-01. [2025-10-02T19:57:18.672989] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-07. [2025-10-02T19:57:18.815522] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-02T19:57:18.893299] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-02T19:57:19.473063] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-09. [2025-10-02T19:57:19.620029] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-02T19:57:20.273028] [INFO ] [REMOTE ] LITB: Fetching primary data for 2024-12. [2025-10-02T19:57:20.743984] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-02T19:57:20.903485] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-02T19:57:21.072999] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-02. [2025-10-02T19:57:21.873027] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-10. [2025-10-02T19:57:22.215364] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-02T19:57:22.673022] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-03. [2025-10-02T19:57:23.296883] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-02T19:57:23.299003] [INFO ] [REMOTE ] LHX: Full fetch complete (70815 records). [2025-10-02T19:57:23.299123] [DEBUG] [VALIDATOR ] LHX: Validating primary data. [2025-10-02T19:57:23.473686] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-01. [2025-10-02T19:57:23.657600] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-02T19:57:23.765825] [DEBUG] [VALIDATOR ] LHX: All expected trading days are present. [2025-10-02T19:57:23.765908] [DEBUG] [VALIDATOR ] LHX: Primary data validation passed. [2025-10-02T19:57:23.767009] [INFO ] [MAIN ] LHX: Fetched primary data is valid. [2025-10-02T19:57:23.767088] [DEBUG] [LOCAL ] LHX: Saving primary data. [2025-10-02T19:57:23.768905] [DEBUG] [LOCAL ] LHX: Trimmed 70815 records to 49032 (keeping 200 days of data) [2025-10-02T19:57:24.081183] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-02T19:57:24.101568] [DEBUG] [LOCAL ] LHX: Primary data saved (49032 records). [2025-10-02T19:57:24.101766] [INFO ] [MAIN ] LHX: Full history saved. [2025-10-02T19:57:24.101859] [INFO ] [MAIN ] Update Progress: 1257/2370 symbols completed. LHX took 34.0s. Estimated remaining: 2h 37m 1s. Rate: 7.1 symbols/min [2025-10-02T19:57:24.278101] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-02. [2025-10-02T19:57:24.310220] [INFO ] [MAIN ] LLY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:57:24.365937] [DEBUG] [LOCAL ] LLY: Loaded 53285 existing records from primary storage. [2025-10-02T19:57:24.366261] [INFO ] [MAIN ] LLY: Loaded 53285 existing records. [2025-10-02T19:57:24.572496] [WARN ] [MAIN ] LLY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:57:24.572697] [INFO ] [MAIN ] LLY: Wiping existing primary data before full refresh. [2025-10-02T19:57:24.572794] [INFO ] [LOCAL ] LLY: Starting deletion of primary data. [2025-10-02T19:57:24.574386] [DEBUG] [LOCAL ] LLY: Deleted primary data file. [2025-10-02T19:57:24.574452] [INFO ] [MAIN ] LLY: Starting full primary refresh. [2025-10-02T19:57:24.880844] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-02T19:57:24.994257] [INFO ] [REMOTE ] LLY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:57:25.072972] [INFO ] [REMOTE ] LLY: Fetching primary data for 2024-12. [2025-10-02T19:57:25.873038] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-04. [2025-10-02T19:57:26.673031] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-03. [2025-10-02T19:57:27.284273] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-02T19:57:27.322275] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-02T19:57:27.473018] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-04. [2025-10-02T19:57:27.633297] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2024-12 (2.56 seconds). [2025-10-02T19:57:28.262048] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-02T19:57:28.272996] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-05. [2025-10-02T19:57:28.761618] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-02T19:57:29.073002] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-01. [2025-10-02T19:57:29.873006] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-08. [2025-10-02T19:57:30.673007] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-06. [2025-10-02T19:57:31.045015] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-02T19:57:31.112854] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-02T19:57:31.475957] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-07. [2025-10-02T19:57:31.479028] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-01 (2.41 seconds). [2025-10-02T19:57:31.782242] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-02T19:57:32.273022] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-09. [2025-10-02T19:57:33.073008] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-08. [2025-10-02T19:57:33.501415] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-02T19:57:33.595590] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-02T19:57:33.872999] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-05. [2025-10-02T19:57:33.975144] [DEBUG] [REMOTE ] LION: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-02T19:57:33.975485] [WARN ] [REMOTE ] LION: No data returned for month 2025-05 [2025-10-02T19:57:33.975579] [FATAL] [REMOTE ] LION: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T19:57:33.975700] [FATAL] [MAIN ] LION: Failed to fetch primary data. [2025-10-02T19:57:33.975784] [WARN ] [MAIN ] LION: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T19:57:33.975887] [INFO ] [LOCAL ] LION: Starting deletion of primary data. [2025-10-02T19:57:33.975979] [DEBUG] [LOCAL ] LION: No primary data file found to delete. [2025-10-02T19:57:33.976097] [INFO ] [LOCAL ] LION: Starting deletion of derivative data. [2025-10-02T19:57:33.976570] [DEBUG] [LOCAL ] LION: Deleted derivative data file. [2025-10-02T19:57:33.976686] [INFO ] [MAIN ] Update Progress: 1258/2370 symbols completed. LION took 19.9s. Estimated remaining: 2h 36m 54s. Rate: 7.1 symbols/min [2025-10-02T19:57:34.176295] [INFO ] [MAIN ] LMND: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:57:34.230526] [DEBUG] [LOCAL ] LMND: Loaded 51874 existing records from primary storage. [2025-10-02T19:57:34.230992] [INFO ] [MAIN ] LMND: Loaded 51874 existing records. [2025-10-02T19:57:34.437086] [WARN ] [MAIN ] LMND: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:57:34.437370] [INFO ] [MAIN ] LMND: Wiping existing primary data before full refresh. [2025-10-02T19:57:34.437434] [INFO ] [LOCAL ] LMND: Starting deletion of primary data. [2025-10-02T19:57:34.438410] [DEBUG] [LOCAL ] LMND: Deleted primary data file. [2025-10-02T19:57:34.438476] [INFO ] [MAIN ] LMND: Starting full primary refresh. [2025-10-02T19:57:34.678257] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-09. [2025-10-02T19:57:34.830917] [INFO ] [REMOTE ] LMND: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:57:35.344077] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-02T19:57:35.473066] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-10. [2025-10-02T19:57:36.273044] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-10. [2025-10-02T19:57:36.487329] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-02T19:57:36.489039] [INFO ] [REMOTE ] LII: Full fetch complete (41422 records). [2025-10-02T19:57:36.489173] [DEBUG] [VALIDATOR ] LII: Validating primary data. [2025-10-02T19:57:36.802485] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-02T19:57:36.841205] [INFO ] [REMOTE ] LITB: Full fetch complete (5639 records). [2025-10-02T19:57:36.841368] [DEBUG] [VALIDATOR ] LITB: Validating primary data. [2025-10-02T19:57:37.076760] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-02. [2025-10-02T19:57:37.109446] [DEBUG] [VALIDATOR ] LII: All expected trading days are present. [2025-10-02T19:57:37.115683] [DEBUG] [VALIDATOR ] LII: Primary data validation passed. [2025-10-02T19:57:37.197135] [INFO ] [MAIN ] LII: Fetched primary data is valid. [2025-10-02T19:57:37.224500] [DEBUG] [LOCAL ] LII: Saving primary data. [2025-10-02T19:57:37.279772] [DEBUG] [LOCAL ] LII: Trimmed 41422 records to 28170 (keeping 200 days of data) [2025-10-02T19:57:37.429695] [DEBUG] [VALIDATOR ] LITB: All expected trading days are present. [2025-10-02T19:57:37.454670] [DEBUG] [VALIDATOR ] LITB: Primary data validation passed. [2025-10-02T19:57:37.455139] [INFO ] [MAIN ] LITB: Fetched primary data is valid. [2025-10-02T19:57:37.455443] [DEBUG] [LOCAL ] LITB: Saving primary data. [2025-10-02T19:57:37.456894] [DEBUG] [LOCAL ] LITB: Trimmed 5639 records to 4368 (keeping 200 days of data) [2025-10-02T19:57:37.489172] [DEBUG] [LOCAL ] LITB: Primary data saved (4368 records). [2025-10-02T19:57:37.489796] [INFO ] [MAIN ] LITB: Full history saved. [2025-10-02T19:57:37.490217] [INFO ] [MAIN ] Update Progress: 1259/2370 symbols completed. LITB took 21.1s. Estimated remaining: 2h 36m 41s. Rate: 7.1 symbols/min [2025-10-02T19:57:37.679234] [INFO ] [MAIN ] LMT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:57:37.779931] [DEBUG] [LOCAL ] LMT: Loaded 49847 existing records from primary storage. [2025-10-02T19:57:37.781372] [INFO ] [MAIN ] LMT: Loaded 49847 existing records. [2025-10-02T19:57:37.873756] [INFO ] [REMOTE ] LMND: Fetching primary data for 2024-12. [2025-10-02T19:57:37.991932] [WARN ] [MAIN ] LMT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:57:37.992969] [INFO ] [MAIN ] LMT: Wiping existing primary data before full refresh. [2025-10-02T19:57:37.993304] [INFO ] [LOCAL ] LMT: Starting deletion of primary data. [2025-10-02T19:57:37.996141] [DEBUG] [LOCAL ] LMT: Deleted primary data file. [2025-10-02T19:57:37.996837] [INFO ] [MAIN ] LMT: Starting full primary refresh. [2025-10-02T19:57:38.089158] [DEBUG] [LOCAL ] LII: Primary data saved (28170 records). [2025-10-02T19:57:38.112553] [INFO ] [MAIN ] LII: Full history saved. [2025-10-02T19:57:38.123541] [INFO ] [MAIN ] Update Progress: 1260/2370 symbols completed. LII took 43.1s. Estimated remaining: 2h 36m 26s. Rate: 7.1 symbols/min [2025-10-02T19:57:38.506290] [INFO ] [MAIN ] LNC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:57:38.612106] [INFO ] [REMOTE ] LMT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:57:38.657030] [DEBUG] [LOCAL ] LNC: Loaded 51610 existing records from primary storage. [2025-10-02T19:57:38.657417] [INFO ] [MAIN ] LNC: Loaded 51610 existing records. [2025-10-02T19:57:38.692915] [INFO ] [REMOTE ] LMT: Fetching primary data for 2024-12. [2025-10-02T19:57:38.862241] [WARN ] [MAIN ] LNC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:57:38.862474] [INFO ] [MAIN ] LNC: Wiping existing primary data before full refresh. [2025-10-02T19:57:38.862525] [INFO ] [LOCAL ] LNC: Starting deletion of primary data. [2025-10-02T19:57:38.863562] [DEBUG] [LOCAL ] LNC: Deleted primary data file. [2025-10-02T19:57:38.863624] [INFO ] [MAIN ] LNC: Starting full primary refresh. [2025-10-02T19:57:39.261150] [INFO ] [REMOTE ] LNC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:57:39.390330] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-10-02T19:57:39.473021] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-03. [2025-10-02T19:57:39.914492] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-02T19:57:40.273040] [INFO ] [REMOTE ] LNC: Fetching primary data for 2024-12. [2025-10-02T19:57:40.881264] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-10-02T19:57:41.073026] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-01. [2025-10-02T19:57:41.432481] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-02T19:57:41.679827] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-02T19:57:41.873010] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-04. [2025-10-02T19:57:42.673001] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-01. [2025-10-02T19:57:42.922511] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-02T19:57:43.472975] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-02. [2025-10-02T19:57:44.052375] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-02T19:57:44.273014] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-05. [2025-10-02T19:57:44.851798] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-02T19:57:45.073031] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-02. [2025-10-02T19:57:45.366499] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-02T19:57:45.873060] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-01. [2025-10-02T19:57:46.672999] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-03. [2025-10-02T19:57:46.932029] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-02T19:57:47.078836] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-05 (2.81 seconds). [2025-10-02T19:57:47.480716] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-06. [2025-10-02T19:57:47.486862] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-02T19:57:48.272979] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-02. [2025-10-02T19:57:48.561334] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-02T19:57:49.073033] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-03. [2025-10-02T19:57:49.872955] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-04. [2025-10-02T19:57:49.910838] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-02T19:57:50.018983] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-06 (2.54 seconds). [2025-10-02T19:57:50.672986] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-07. [2025-10-02T19:57:50.865530] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-02T19:57:51.472979] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-04. [2025-10-02T19:57:51.664100] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-02T19:57:52.273002] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-03. [2025-10-02T19:57:52.980911] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-02T19:57:53.072988] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-08. [2025-10-02T19:57:53.500626] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-02T19:57:53.872969] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-05. [2025-10-02T19:57:53.987883] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-02T19:57:54.673000] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-04. [2025-10-02T19:57:55.473008] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-05. [2025-10-02T19:57:55.669479] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-02T19:57:55.764982] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-08 (2.69 seconds). [2025-10-02T19:57:56.042751] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-02T19:57:56.272996] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-05. [2025-10-02T19:57:57.072988] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-06. [2025-10-02T19:57:57.331826] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-02T19:57:57.872969] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-09. [2025-10-02T19:57:57.933138] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-02T19:57:58.673070] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-06. [2025-10-02T19:57:59.044138] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-02T19:57:59.473081] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-06. [2025-10-02T19:58:00.124337] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-02T19:58:00.249358] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-02T19:58:00.272961] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-07. [2025-10-02T19:58:01.073060] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-07. [2025-10-02T19:58:01.564717] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-02T19:58:01.764937] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-02T19:58:01.873031] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-08. [2025-10-02T19:58:02.673006] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-07. [2025-10-02T19:58:03.473304] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-10-02T19:58:03.473382] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-10. [2025-10-02T19:58:03.522912] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-02T19:58:04.272992] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-08. [2025-10-02T19:58:04.743119] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-02T19:58:05.073009] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-09. [2025-10-02T19:58:05.754213] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-10 (2.28 seconds). [2025-10-02T19:58:05.756330] [INFO ] [REMOTE ] LLY: Full fetch complete (77276 records). [2025-10-02T19:58:05.756441] [DEBUG] [VALIDATOR ] LLY: Validating primary data. [2025-10-02T19:58:05.878135] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-08. [2025-10-02T19:58:06.200816] [DEBUG] [VALIDATOR ] LLY: All expected trading days are present. [2025-10-02T19:58:06.201028] [DEBUG] [VALIDATOR ] LLY: Primary data validation passed. [2025-10-02T19:58:06.202070] [INFO ] [MAIN ] LLY: Fetched primary data is valid. [2025-10-02T19:58:06.202231] [DEBUG] [LOCAL ] LLY: Saving primary data. [2025-10-02T19:58:06.204113] [DEBUG] [LOCAL ] LLY: Trimmed 77276 records to 53674 (keeping 200 days of data) [2025-10-02T19:58:06.333956] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-02T19:58:06.606268] [DEBUG] [LOCAL ] LLY: Primary data saved (53674 records). [2025-10-02T19:58:06.606412] [INFO ] [MAIN ] LLY: Full history saved. [2025-10-02T19:58:06.606498] [INFO ] [MAIN ] Update Progress: 1261/2370 symbols completed. LLY took 42.5s. Estimated remaining: 2h 36m 35s. Rate: 7.1 symbols/min [2025-10-02T19:58:06.676598] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-09. [2025-10-02T19:58:06.797866] [INFO ] [MAIN ] LND: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:58:06.830689] [DEBUG] [LOCAL ] LND: Loaded 4914 existing records from primary storage. [2025-10-02T19:58:06.833814] [INFO ] [MAIN ] LND: Loaded 4914 existing records. [2025-10-02T19:58:06.895549] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-02T19:58:07.042928] [WARN ] [MAIN ] LND: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:58:07.043174] [INFO ] [MAIN ] LND: Wiping existing primary data before full refresh. [2025-10-02T19:58:07.043226] [INFO ] [LOCAL ] LND: Starting deletion of primary data. [2025-10-02T19:58:07.043553] [DEBUG] [LOCAL ] LND: Deleted primary data file. [2025-10-02T19:58:07.043614] [INFO ] [MAIN ] LND: Starting full primary refresh. [2025-10-02T19:58:07.431129] [INFO ] [REMOTE ] LND: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:58:07.473025] [INFO ] [REMOTE ] LND: Fetching primary data for 2024-12. [2025-10-02T19:58:07.879670] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-02T19:58:08.273018] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-10. [2025-10-02T19:58:08.299834] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-02T19:58:08.878305] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-02T19:58:09.073049] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-10. [2025-10-02T19:58:09.568746] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-02T19:58:09.570881] [INFO ] [REMOTE ] LNC: Full fetch complete (74209 records). [2025-10-02T19:58:09.570993] [DEBUG] [VALIDATOR ] LNC: Validating primary data. [2025-10-02T19:58:09.881760] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-01. [2025-10-02T19:58:10.001574] [DEBUG] [VALIDATOR ] LNC: All expected trading days are present. [2025-10-02T19:58:10.001703] [DEBUG] [VALIDATOR ] LNC: Primary data validation passed. [2025-10-02T19:58:10.002815] [INFO ] [MAIN ] LNC: Fetched primary data is valid. [2025-10-02T19:58:10.002889] [DEBUG] [LOCAL ] LNC: Saving primary data. [2025-10-02T19:58:10.004489] [DEBUG] [LOCAL ] LNC: Trimmed 74209 records to 51991 (keeping 200 days of data) [2025-10-02T19:58:10.343092] [DEBUG] [LOCAL ] LNC: Primary data saved (51991 records). [2025-10-02T19:58:10.343290] [INFO ] [MAIN ] LNC: Full history saved. [2025-10-02T19:58:10.343398] [INFO ] [MAIN ] Update Progress: 1262/2370 symbols completed. LNC took 32.2s. Estimated remaining: 2h 36m 22s. Rate: 7.1 symbols/min [2025-10-02T19:58:10.476551] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-02T19:58:10.538824] [INFO ] [MAIN ] LNG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:58:10.592367] [DEBUG] [LOCAL ] LNG: Loaded 51384 existing records from primary storage. [2025-10-02T19:58:10.592753] [INFO ] [MAIN ] LNG: Loaded 51384 existing records. [2025-10-02T19:58:10.678289] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-02. [2025-10-02T19:58:10.827903] [WARN ] [MAIN ] LNG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:58:10.828144] [INFO ] [MAIN ] LNG: Wiping existing primary data before full refresh. [2025-10-02T19:58:10.828193] [INFO ] [LOCAL ] LNG: Starting deletion of primary data. [2025-10-02T19:58:10.829155] [DEBUG] [LOCAL ] LNG: Deleted primary data file. [2025-10-02T19:58:10.829215] [INFO ] [MAIN ] LNG: Starting full primary refresh. [2025-10-02T19:58:10.993965] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-02T19:58:11.018150] [INFO ] [REMOTE ] LMT: Full fetch complete (72445 records). [2025-10-02T19:58:11.019430] [DEBUG] [VALIDATOR ] LMT: Validating primary data. [2025-10-02T19:58:11.498167] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-09. [2025-10-02T19:58:11.566046] [INFO ] [REMOTE ] LNG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:58:11.595697] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-02T19:58:11.773100] [DEBUG] [VALIDATOR ] LMT: All expected trading days are present. [2025-10-02T19:58:11.773227] [DEBUG] [VALIDATOR ] LMT: Primary data validation passed. [2025-10-02T19:58:11.774380] [INFO ] [MAIN ] LMT: Fetched primary data is valid. [2025-10-02T19:58:11.774457] [DEBUG] [LOCAL ] LMT: Saving primary data. [2025-10-02T19:58:11.776140] [DEBUG] [LOCAL ] LMT: Trimmed 72445 records to 50172 (keeping 200 days of data) [2025-10-02T19:58:12.117692] [DEBUG] [LOCAL ] LMT: Primary data saved (50172 records). [2025-10-02T19:58:12.117830] [INFO ] [MAIN ] LMT: Full history saved. [2025-10-02T19:58:12.118983] [INFO ] [MAIN ] Update Progress: 1263/2370 symbols completed. LMT took 34.6s. Estimated remaining: 2h 36m 8s. Rate: 7.1 symbols/min [2025-10-02T19:58:12.277517] [INFO ] [REMOTE ] LNG: Fetching primary data for 2024-12. [2025-10-02T19:58:12.305572] [INFO ] [MAIN ] LNN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:58:12.321395] [DEBUG] [LOCAL ] LNN: Loaded 11157 existing records from primary storage. [2025-10-02T19:58:12.321844] [INFO ] [MAIN ] LNN: Loaded 11157 existing records. [2025-10-02T19:58:12.534138] [WARN ] [MAIN ] LNN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:58:12.534365] [INFO ] [MAIN ] LNN: Wiping existing primary data before full refresh. [2025-10-02T19:58:12.534417] [INFO ] [LOCAL ] LNN: Starting deletion of primary data. [2025-10-02T19:58:12.534960] [DEBUG] [LOCAL ] LNN: Deleted primary data file. [2025-10-02T19:58:12.535023] [INFO ] [MAIN ] LNN: Starting full primary refresh. [2025-10-02T19:58:12.938909] [INFO ] [REMOTE ] LNN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:58:13.072999] [INFO ] [REMOTE ] LNN: Fetching primary data for 2024-12. [2025-10-02T19:58:13.838275] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-10-02T19:58:13.858292] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-02T19:58:13.878134] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-03. [2025-10-02T19:58:13.896941] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-02T19:58:14.521219] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-02T19:58:14.672985] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-04. [2025-10-02T19:58:15.179171] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-02T19:58:15.472998] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-05. [2025-10-02T19:58:16.047770] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-02T19:58:16.272982] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-01. [2025-10-02T19:58:16.854931] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-02T19:58:17.073045] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-06. [2025-10-02T19:58:17.539631] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-02T19:58:17.873028] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-07. [2025-10-02T19:58:18.311703] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-02T19:58:18.673061] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-01. [2025-10-02T19:58:19.473051] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-08. [2025-10-02T19:58:20.075098] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-02T19:58:20.273011] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-09. [2025-10-02T19:58:20.368818] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-02T19:58:20.836085] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-02T19:58:21.073009] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-02. [2025-10-02T19:58:21.873039] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-10. [2025-10-02T19:58:22.672998] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-10. [2025-10-02T19:58:23.000359] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-02T19:58:23.211247] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-02T19:58:23.212133] [INFO ] [REMOTE ] LND: Full fetch complete (8333 records). [2025-10-02T19:58:23.212213] [DEBUG] [VALIDATOR ] LND: Validating primary data. [2025-10-02T19:58:23.478099] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-03. [2025-10-02T19:58:23.613665] [DEBUG] [VALIDATOR ] LND: All expected trading days are present. [2025-10-02T19:58:23.613755] [DEBUG] [VALIDATOR ] LND: Primary data validation passed. [2025-10-02T19:58:23.614040] [INFO ] [MAIN ] LND: Fetched primary data is valid. [2025-10-02T19:58:23.614088] [DEBUG] [LOCAL ] LND: Saving primary data. [2025-10-02T19:58:23.614514] [DEBUG] [LOCAL ] LND: Trimmed 8333 records to 4941 (keeping 200 days of data) [2025-10-02T19:58:23.644594] [DEBUG] [LOCAL ] LND: Primary data saved (4941 records). [2025-10-02T19:58:23.644746] [INFO ] [MAIN ] LND: Full history saved. [2025-10-02T19:58:23.644835] [INFO ] [MAIN ] Update Progress: 1264/2370 symbols completed. LND took 17.0s. Estimated remaining: 2h 36m 2s. Rate: 7.1 symbols/min [2025-10-02T19:58:23.759244] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-02T19:58:23.771629] [INFO ] [REMOTE ] LMND: Full fetch complete (75309 records). [2025-10-02T19:58:23.782064] [DEBUG] [VALIDATOR ] LMND: Validating primary data. [2025-10-02T19:58:23.959826] [INFO ] [MAIN ] LOAR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:58:24.291560] [DEBUG] [LOCAL ] LOAR: Loaded 41649 existing records from primary storage. [2025-10-02T19:58:24.291761] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-02. [2025-10-02T19:58:24.332892] [INFO ] [MAIN ] LOAR: Loaded 41649 existing records. [2025-10-02T19:58:24.382594] [DEBUG] [VALIDATOR ] LMND: All expected trading days are present. [2025-10-02T19:58:24.418399] [DEBUG] [VALIDATOR ] LMND: Primary data validation passed. [2025-10-02T19:58:24.436717] [INFO ] [MAIN ] LMND: Fetched primary data is valid. [2025-10-02T19:58:24.477157] [DEBUG] [LOCAL ] LMND: Saving primary data. [2025-10-02T19:58:24.554115] [DEBUG] [LOCAL ] LMND: Trimmed 75309 records to 52254 (keeping 200 days of data) [2025-10-02T19:58:24.620793] [WARN ] [MAIN ] LOAR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:58:24.678033] [INFO ] [MAIN ] LOAR: Wiping existing primary data before full refresh. [2025-10-02T19:58:24.678579] [INFO ] [LOCAL ] LOAR: Starting deletion of primary data. [2025-10-02T19:58:24.707578] [DEBUG] [LOCAL ] LOAR: Deleted primary data file. [2025-10-02T19:58:24.708765] [INFO ] [MAIN ] LOAR: Starting full primary refresh. [2025-10-02T19:58:25.156636] [INFO ] [REMOTE ] LOAR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:58:25.161994] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2024-12. [2025-10-02T19:58:25.211920] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-02T19:58:25.321398] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-02T19:58:25.444101] [DEBUG] [LOCAL ] LMND: Primary data saved (52254 records). [2025-10-02T19:58:25.444267] [INFO ] [MAIN ] LMND: Full history saved. [2025-10-02T19:58:25.444366] [INFO ] [MAIN ] Update Progress: 1265/2370 symbols completed. LMND took 51.5s. Estimated remaining: 2h 35m 48s. Rate: 7.1 symbols/min [2025-10-02T19:58:25.638553] [INFO ] [MAIN ] LOB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:58:25.667087] [DEBUG] [LOCAL ] LOB: Loaded 27380 existing records from primary storage. [2025-10-02T19:58:25.667395] [INFO ] [MAIN ] LOB: Loaded 27380 existing records. [2025-10-02T19:58:25.862962] [WARN ] [MAIN ] LOB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:58:25.863218] [INFO ] [MAIN ] LOB: Wiping existing primary data before full refresh. [2025-10-02T19:58:25.863277] [INFO ] [LOCAL ] LOB: Starting deletion of primary data. [2025-10-02T19:58:25.864075] [DEBUG] [LOCAL ] LOB: Deleted primary data file. [2025-10-02T19:58:25.864140] [INFO ] [MAIN ] LOB: Starting full primary refresh. [2025-10-02T19:58:25.878140] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-03. [2025-10-02T19:58:26.251033] [INFO ] [REMOTE ] LOB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:58:26.608032] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-02T19:58:26.673045] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-04. [2025-10-02T19:58:26.719543] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-02T19:58:27.473003] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-04. [2025-10-02T19:58:28.262524] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-02T19:58:28.274178] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-01. [2025-10-02T19:58:28.441234] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-02T19:58:29.073010] [INFO ] [REMOTE ] LOB: Fetching primary data for 2024-12. [2025-10-02T19:58:29.479006] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-02T19:58:29.873045] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-05. [2025-10-02T19:58:29.987709] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-02T19:58:30.673056] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-05. [2025-10-02T19:58:31.433170] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-02T19:58:31.473067] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-06. [2025-10-02T19:58:31.959192] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-02T19:58:32.273013] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-01. [2025-10-02T19:58:32.386153] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-02T19:58:33.072974] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-02. [2025-10-02T19:58:33.466038] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-02T19:58:33.872995] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-02. [2025-10-02T19:58:34.312859] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-02T19:58:34.673054] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-03. [2025-10-02T19:58:34.965817] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-02T19:58:35.473033] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-03. [2025-10-02T19:58:36.065460] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-02T19:58:36.273017] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-04. [2025-10-02T19:58:36.798838] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-02T19:58:37.072956] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-06. [2025-10-02T19:58:37.836134] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-02T19:58:37.873104] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-07. [2025-10-02T19:58:38.611554] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-02T19:58:38.673010] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-04. [2025-10-02T19:58:38.870169] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-02T19:58:39.473057] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-08. [2025-10-02T19:58:39.817419] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-02T19:58:40.220573] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-02T19:58:40.273043] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-05. [2025-10-02T19:58:41.072965] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-09. [2025-10-02T19:58:41.379433] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-02T19:58:41.872981] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-06. [2025-10-02T19:58:41.939819] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-02T19:58:42.673001] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-10. [2025-10-02T19:58:42.900369] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-02T19:58:43.432185] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-02T19:58:43.434439] [INFO ] [REMOTE ] LNN: Full fetch complete (15705 records). [2025-10-02T19:58:43.434523] [DEBUG] [VALIDATOR ] LNN: Validating primary data. [2025-10-02T19:58:43.478111] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-05. [2025-10-02T19:58:43.854623] [DEBUG] [VALIDATOR ] LNN: All expected trading days are present. [2025-10-02T19:58:43.854738] [DEBUG] [VALIDATOR ] LNN: Primary data validation passed. [2025-10-02T19:58:43.855130] [INFO ] [MAIN ] LNN: Fetched primary data is valid. [2025-10-02T19:58:43.855179] [DEBUG] [LOCAL ] LNN: Saving primary data. [2025-10-02T19:58:43.855794] [DEBUG] [LOCAL ] LNN: Trimmed 15705 records to 11250 (keeping 200 days of data) [2025-10-02T19:58:43.937501] [DEBUG] [LOCAL ] LNN: Primary data saved (11250 records). [2025-10-02T19:58:43.937677] [INFO ] [MAIN ] LNN: Full history saved. [2025-10-02T19:58:43.937785] [INFO ] [MAIN ] Update Progress: 1266/2370 symbols completed. LNN took 31.8s. Estimated remaining: 2h 35m 48s. Rate: 7.1 symbols/min [2025-10-02T19:58:44.122993] [INFO ] [MAIN ] LOCL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:58:44.128988] [DEBUG] [LOCAL ] LOCL: Loaded 3632 existing records from primary storage. [2025-10-02T19:58:44.129181] [INFO ] [MAIN ] LOCL: Loaded 3632 existing records. [2025-10-02T19:58:44.288122] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-07. [2025-10-02T19:58:44.347305] [WARN ] [MAIN ] LOCL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:58:44.347589] [INFO ] [MAIN ] LOCL: Wiping existing primary data before full refresh. [2025-10-02T19:58:44.347681] [INFO ] [LOCAL ] LOCL: Starting deletion of primary data. [2025-10-02T19:58:44.348865] [DEBUG] [LOCAL ] LOCL: Deleted primary data file. [2025-10-02T19:58:44.348928] [INFO ] [MAIN ] LOCL: Starting full primary refresh. [2025-10-02T19:58:44.751019] [INFO ] [REMOTE ] LOCL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:58:45.073055] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-07. [2025-10-02T19:58:45.220792] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-02T19:58:45.873030] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2024-12. [2025-10-02T19:58:46.347050] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-02T19:58:46.378028] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-02T19:58:46.559765] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-02T19:58:46.673013] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-08. [2025-10-02T19:58:47.472963] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-06. [2025-10-02T19:58:47.645336] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-02T19:58:48.273067] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-01. [2025-10-02T19:58:48.715350] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-02T19:58:48.983326] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-02T19:58:49.073017] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-08. [2025-10-02T19:58:49.872999] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-07. [2025-10-02T19:58:50.673055] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-02. [2025-10-02T19:58:50.718233] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-02T19:58:51.326150] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-02T19:58:51.374137] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-02T19:58:51.473064] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-08. [2025-10-02T19:58:52.273078] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-09. [2025-10-02T19:58:52.644579] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-02T19:58:53.073024] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-09. [2025-10-02T19:58:53.873001] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-09. [2025-10-02T19:58:54.052517] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-02T19:58:54.213350] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-02T19:58:54.672982] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-10. [2025-10-02T19:58:55.075619] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-02T19:58:55.473016] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-10. [2025-10-02T19:58:56.272999] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-03. [2025-10-02T19:58:56.336383] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-02T19:58:56.339117] [INFO ] [REMOTE ] LNG: Full fetch complete (74685 records). [2025-10-02T19:58:56.339275] [DEBUG] [VALIDATOR ] LNG: Validating primary data. [2025-10-02T19:58:56.482896] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-02T19:58:56.505474] [INFO ] [REMOTE ] LOB: Full fetch complete (37935 records). [2025-10-02T19:58:56.524462] [DEBUG] [VALIDATOR ] LOB: Validating primary data. [2025-10-02T19:58:56.685096] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-02T19:58:57.078157] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-10. [2025-10-02T19:58:57.166150] [DEBUG] [VALIDATOR ] LNG: All expected trading days are present. [2025-10-02T19:58:57.171399] [DEBUG] [VALIDATOR ] LNG: Primary data validation passed. [2025-10-02T19:58:57.173429] [INFO ] [MAIN ] LNG: Fetched primary data is valid. [2025-10-02T19:58:57.193159] [DEBUG] [LOCAL ] LNG: Saving primary data. [2025-10-02T19:58:57.277161] [DEBUG] [LOCAL ] LNG: Trimmed 74685 records to 51737 (keeping 200 days of data) [2025-10-02T19:58:57.292133] [DEBUG] [VALIDATOR ] LOB: All expected trading days are present. [2025-10-02T19:58:57.292242] [DEBUG] [VALIDATOR ] LOB: Primary data validation passed. [2025-10-02T19:58:57.292679] [INFO ] [MAIN ] LOB: Fetched primary data is valid. [2025-10-02T19:58:57.292766] [DEBUG] [LOCAL ] LOB: Saving primary data. [2025-10-02T19:58:57.294223] [DEBUG] [LOCAL ] LOB: Trimmed 37935 records to 27571 (keeping 200 days of data) [2025-10-02T19:58:57.803481] [DEBUG] [LOCAL ] LOB: Primary data saved (27571 records). [2025-10-02T19:58:57.819186] [INFO ] [MAIN ] LOB: Full history saved. [2025-10-02T19:58:57.819565] [INFO ] [MAIN ] Update Progress: 1267/2370 symbols completed. LOB took 32.4s. Estimated remaining: 2h 35m 45s. Rate: 7.1 symbols/min [2025-10-02T19:58:57.873111] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-04. [2025-10-02T19:58:58.053278] [INFO ] [MAIN ] LOMA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:58:58.083901] [DEBUG] [LOCAL ] LNG: Primary data saved (51737 records). [2025-10-02T19:58:58.084057] [INFO ] [MAIN ] LNG: Full history saved. [2025-10-02T19:58:58.084148] [INFO ] [MAIN ] Update Progress: 1268/2370 symbols completed. LNG took 47.7s. Estimated remaining: 2h 35m 29s. Rate: 7.1 symbols/min [2025-10-02T19:58:58.215540] [DEBUG] [LOCAL ] LOMA: Loaded 32067 existing records from primary storage. [2025-10-02T19:58:58.221612] [INFO ] [MAIN ] LOMA: Loaded 32067 existing records. [2025-10-02T19:58:58.349259] [INFO ] [MAIN ] LOW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:58:58.365757] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-02T19:58:58.392622] [INFO ] [REMOTE ] LOAR: Full fetch complete (56177 records). [2025-10-02T19:58:58.405679] [DEBUG] [VALIDATOR ] LOAR: Validating primary data. [2025-10-02T19:58:58.651529] [WARN ] [MAIN ] LOMA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:58:58.657235] [INFO ] [MAIN ] LOMA: Wiping existing primary data before full refresh. [2025-10-02T19:58:58.657383] [INFO ] [LOCAL ] LOMA: Starting deletion of primary data. [2025-10-02T19:58:58.668557] [DEBUG] [LOCAL ] LOMA: Deleted primary data file. [2025-10-02T19:58:58.673940] [INFO ] [MAIN ] LOMA: Starting full primary refresh. [2025-10-02T19:58:58.855195] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-02T19:58:58.907992] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-05. [2025-10-02T19:58:59.025639] [DEBUG] [LOCAL ] LOW: Loaded 52943 existing records from primary storage. [2025-10-02T19:58:59.038378] [INFO ] [MAIN ] LOW: Loaded 52943 existing records. [2025-10-02T19:58:59.342257] [DEBUG] [VALIDATOR ] LOAR: All expected trading days are present. [2025-10-02T19:58:59.358877] [DEBUG] [VALIDATOR ] LOAR: Primary data validation passed. [2025-10-02T19:58:59.426776] [INFO ] [MAIN ] LOAR: Fetched primary data is valid. [2025-10-02T19:58:59.483633] [DEBUG] [LOCAL ] LOAR: Saving primary data. [2025-10-02T19:58:59.497469] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-02T19:58:59.499947] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-06. [2025-10-02T19:58:59.581578] [DEBUG] [LOCAL ] LOAR: Trimmed 56177 records to 41885 (keeping 200 days of data) [2025-10-02T19:58:59.710353] [WARN ] [MAIN ] LOW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:58:59.715207] [INFO ] [REMOTE ] LOMA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:58:59.715907] [INFO ] [MAIN ] LOW: Wiping existing primary data before full refresh. [2025-10-02T19:58:59.715993] [INFO ] [LOCAL ] LOW: Starting deletion of primary data. [2025-10-02T19:58:59.768783] [DEBUG] [LOCAL ] LOW: Deleted primary data file. [2025-10-02T19:58:59.777784] [INFO ] [MAIN ] LOW: Starting full primary refresh. [2025-10-02T19:59:00.083378] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-02T19:59:00.250513] [INFO ] [REMOTE ] LOW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:59:00.273421] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2024-12. [2025-10-02T19:59:00.420171] [DEBUG] [LOCAL ] LOAR: Primary data saved (41885 records). [2025-10-02T19:59:00.420312] [INFO ] [MAIN ] LOAR: Full history saved. [2025-10-02T19:59:00.420400] [INFO ] [MAIN ] Update Progress: 1269/2370 symbols completed. LOAR took 36.8s. Estimated remaining: 2h 35m 15s. Rate: 7.1 symbols/min [2025-10-02T19:59:00.612496] [INFO ] [MAIN ] LPG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:59:00.655699] [DEBUG] [LOCAL ] LPG: Loaded 39882 existing records from primary storage. [2025-10-02T19:59:00.656031] [INFO ] [MAIN ] LPG: Loaded 39882 existing records. [2025-10-02T19:59:00.857179] [WARN ] [MAIN ] LPG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:59:00.857417] [INFO ] [MAIN ] LPG: Wiping existing primary data before full refresh. [2025-10-02T19:59:00.857468] [INFO ] [LOCAL ] LPG: Starting deletion of primary data. [2025-10-02T19:59:00.858080] [DEBUG] [LOCAL ] LPG: Deleted primary data file. [2025-10-02T19:59:00.858143] [INFO ] [MAIN ] LPG: Starting full primary refresh. [2025-10-02T19:59:01.079588] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-07. [2025-10-02T19:59:01.269341] [INFO ] [REMOTE ] LPG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:59:01.762722] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-02T19:59:01.873303] [INFO ] [REMOTE ] LOW: Fetching primary data for 2024-12. [2025-10-02T19:59:01.878368] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-02T19:59:02.672993] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-01. [2025-10-02T19:59:03.472984] [INFO ] [REMOTE ] LPG: Fetching primary data for 2024-12. [2025-10-02T19:59:03.855060] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-02T19:59:03.922594] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-02T19:59:04.273010] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-01. [2025-10-02T19:59:04.911402] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-02T19:59:05.072972] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-02. [2025-10-02T19:59:05.841845] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-02T19:59:05.873002] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-02. [2025-10-02T19:59:06.494469] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-02T19:59:06.673012] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-08. [2025-10-02T19:59:07.127879] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-02T19:59:07.332573] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-02T19:59:07.473010] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-03. [2025-10-02T19:59:08.272992] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-03. [2025-10-02T19:59:09.055970] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-02T19:59:09.072955] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-04. [2025-10-02T19:59:09.583003] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-02T19:59:09.872983] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-01. [2025-10-02T19:59:10.673035] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-04. [2025-10-02T19:59:11.061918] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-02T19:59:11.472972] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-05. [2025-10-02T19:59:11.505113] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-02T19:59:12.088608] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-02T19:59:12.273029] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-05. [2025-10-02T19:59:13.072995] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-09. [2025-10-02T19:59:13.457052] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-02T19:59:13.487947] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-02T19:59:13.730934] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-02T19:59:13.873010] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-06. [2025-10-02T19:59:14.673010] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-02. [2025-10-02T19:59:15.472984] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-10. [2025-10-02T19:59:15.667019] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-02T19:59:16.274343] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-02T19:59:16.274147] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-06. [2025-10-02T19:59:16.275280] [INFO ] [REMOTE ] LOCL: Full fetch complete (4725 records). [2025-10-02T19:59:16.276082] [DEBUG] [VALIDATOR ] LOCL: Validating primary data. [2025-10-02T19:59:16.457075] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-02T19:59:16.727179] [DEBUG] [VALIDATOR ] LOCL: All expected trading days are present. [2025-10-02T19:59:16.727256] [DEBUG] [VALIDATOR ] LOCL: Primary data validation passed. [2025-10-02T19:59:16.727409] [INFO ] [MAIN ] LOCL: Fetched primary data is valid. [2025-10-02T19:59:16.727450] [DEBUG] [LOCAL ] LOCL: Saving primary data. [2025-10-02T19:59:16.727848] [DEBUG] [LOCAL ] LOCL: Trimmed 4725 records to 3642 (keeping 200 days of data) [2025-10-02T19:59:16.748509] [DEBUG] [LOCAL ] LOCL: Primary data saved (3642 records). [2025-10-02T19:59:16.748613] [INFO ] [MAIN ] LOCL: Full history saved. [2025-10-02T19:59:16.748722] [INFO ] [MAIN ] Update Progress: 1270/2370 symbols completed. LOCL took 32.8s. Estimated remaining: 2h 35m 14s. Rate: 7.1 symbols/min [2025-10-02T19:59:16.930528] [INFO ] [MAIN ] LPL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:59:16.958251] [DEBUG] [LOCAL ] LPL: Loaded 26529 existing records from primary storage. [2025-10-02T19:59:16.958555] [INFO ] [MAIN ] LPL: Loaded 26529 existing records. [2025-10-02T19:59:17.074881] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-07. [2025-10-02T19:59:17.179167] [WARN ] [MAIN ] LPL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:59:17.179595] [INFO ] [MAIN ] LPL: Wiping existing primary data before full refresh. [2025-10-02T19:59:17.179703] [INFO ] [LOCAL ] LPL: Starting deletion of primary data. [2025-10-02T19:59:17.180462] [DEBUG] [LOCAL ] LPL: Deleted primary data file. [2025-10-02T19:59:17.180526] [INFO ] [MAIN ] LPL: Starting full primary refresh. [2025-10-02T19:59:17.288171] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-02T19:59:17.597081] [INFO ] [REMOTE ] LPL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:59:17.872998] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-07. [2025-10-02T19:59:18.664151] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-02T19:59:18.672942] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-08. [2025-10-02T19:59:19.079828] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-02T19:59:19.473000] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-08. [2025-10-02T19:59:19.654205] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-02T19:59:20.273017] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-09. [2025-10-02T19:59:21.073039] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-03. [2025-10-02T19:59:21.498428] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-02T19:59:21.872997] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-09. [2025-10-02T19:59:22.026405] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-02T19:59:22.364028] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-02T19:59:22.673012] [INFO ] [REMOTE ] LPL: Fetching primary data for 2024-12. [2025-10-02T19:59:23.388188] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-02T19:59:23.473046] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-10. [2025-10-02T19:59:23.651245] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-02T19:59:24.273029] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-01. [2025-10-02T19:59:24.599881] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-02T19:59:24.602884] [INFO ] [REMOTE ] LOMA: Full fetch complete (47882 records). [2025-10-02T19:59:24.603065] [DEBUG] [VALIDATOR ] LOMA: Validating primary data. [2025-10-02T19:59:25.016883] [DEBUG] [VALIDATOR ] LOMA: All expected trading days are present. [2025-10-02T19:59:25.016977] [DEBUG] [VALIDATOR ] LOMA: Primary data validation passed. [2025-10-02T19:59:25.017851] [INFO ] [MAIN ] LOMA: Fetched primary data is valid. [2025-10-02T19:59:25.017951] [DEBUG] [LOCAL ] LOMA: Saving primary data. [2025-10-02T19:59:25.019229] [DEBUG] [LOCAL ] LOMA: Trimmed 47882 records to 32305 (keeping 200 days of data) [2025-10-02T19:59:25.081835] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-04. [2025-10-02T19:59:25.224888] [DEBUG] [LOCAL ] LOMA: Primary data saved (32305 records). [2025-10-02T19:59:25.225075] [INFO ] [MAIN ] LOMA: Full history saved. [2025-10-02T19:59:25.225245] [INFO ] [MAIN ] Update Progress: 1271/2370 symbols completed. LOMA took 27.4s. Estimated remaining: 2h 35m 5s. Rate: 7.1 symbols/min [2025-10-02T19:59:25.430669] [INFO ] [MAIN ] LPX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:59:25.433340] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-02T19:59:25.477816] [DEBUG] [LOCAL ] LPX: Loaded 39688 existing records from primary storage. [2025-10-02T19:59:25.478156] [INFO ] [MAIN ] LPX: Loaded 39688 existing records. [2025-10-02T19:59:25.672159] [WARN ] [MAIN ] LPX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:59:25.672372] [INFO ] [MAIN ] LPX: Wiping existing primary data before full refresh. [2025-10-02T19:59:25.672422] [INFO ] [LOCAL ] LPX: Starting deletion of primary data. [2025-10-02T19:59:25.672857] [DEBUG] [LOCAL ] LPX: Deleted primary data file. [2025-10-02T19:59:25.672931] [INFO ] [MAIN ] LPX: Starting full primary refresh. [2025-10-02T19:59:25.873092] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-10. [2025-10-02T19:59:26.064010] [INFO ] [REMOTE ] LPX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:59:26.634084] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-02T19:59:26.673036] [INFO ] [REMOTE ] LPX: Fetching primary data for 2024-12. [2025-10-02T19:59:27.472986] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-02. [2025-10-02T19:59:27.508079] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-02T19:59:27.512126] [INFO ] [REMOTE ] LOW: Full fetch complete (76498 records). [2025-10-02T19:59:27.512284] [DEBUG] [VALIDATOR ] LOW: Validating primary data. [2025-10-02T19:59:27.998397] [DEBUG] [VALIDATOR ] LOW: All expected trading days are present. [2025-10-02T19:59:27.998493] [DEBUG] [VALIDATOR ] LOW: Primary data validation passed. [2025-10-02T19:59:27.999527] [INFO ] [MAIN ] LOW: Fetched primary data is valid. [2025-10-02T19:59:27.999592] [DEBUG] [LOCAL ] LOW: Saving primary data. [2025-10-02T19:59:28.001200] [DEBUG] [LOCAL ] LOW: Trimmed 76498 records to 53319 (keeping 200 days of data) [2025-10-02T19:59:28.158094] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-02T19:59:28.289541] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-05. [2025-10-02T19:59:28.431412] [DEBUG] [LOCAL ] LOW: Primary data saved (53319 records). [2025-10-02T19:59:28.431662] [INFO ] [MAIN ] LOW: Full history saved. [2025-10-02T19:59:28.431813] [INFO ] [MAIN ] Update Progress: 1272/2370 symbols completed. LOW took 30.3s. Estimated remaining: 2h 34m 52s. Rate: 7.1 symbols/min [2025-10-02T19:59:28.629492] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-02T19:59:28.659573] [INFO ] [MAIN ] LRN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:59:28.705952] [DEBUG] [LOCAL ] LRN: Loaded 39775 existing records from primary storage. [2025-10-02T19:59:28.706379] [INFO ] [MAIN ] LRN: Loaded 39775 existing records. [2025-10-02T19:59:28.910626] [WARN ] [MAIN ] LRN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:59:28.910893] [INFO ] [MAIN ] LRN: Wiping existing primary data before full refresh. [2025-10-02T19:59:28.910952] [INFO ] [LOCAL ] LRN: Starting deletion of primary data. [2025-10-02T19:59:28.911572] [DEBUG] [LOCAL ] LRN: Deleted primary data file. [2025-10-02T19:59:28.911703] [INFO ] [MAIN ] LRN: Starting full primary refresh. [2025-10-02T19:59:29.078160] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-03. [2025-10-02T19:59:29.296913] [INFO ] [REMOTE ] LRN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:59:29.868738] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-02T19:59:29.878027] [INFO ] [REMOTE ] LRN: Fetching primary data for 2024-12. [2025-10-02T19:59:29.920128] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-02T19:59:30.673000] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-06. [2025-10-02T19:59:31.376737] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-02T19:59:31.473043] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-04. [2025-10-02T19:59:31.747073] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-02T19:59:32.272969] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-01. [2025-10-02T19:59:32.533741] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-02T19:59:33.072998] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-07. [2025-10-02T19:59:33.717455] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-02T19:59:33.873002] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-05. [2025-10-02T19:59:34.621684] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-02T19:59:34.672994] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-08. [2025-10-02T19:59:34.895374] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-02T19:59:35.473041] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-01. [2025-10-02T19:59:36.160098] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-02T19:59:36.273057] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-02. [2025-10-02T19:59:37.072996] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-09. [2025-10-02T19:59:37.122371] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-02T19:59:37.729847] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-02T19:59:37.872994] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-02. [2025-10-02T19:59:38.670034] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-02T19:59:38.678098] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-06. [2025-10-02T19:59:39.333157] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-02T19:59:39.416690] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-02T19:59:39.472950] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-10. [2025-10-02T19:59:40.273000] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-03. [2025-10-02T19:59:40.681350] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-02T19:59:40.683134] [INFO ] [REMOTE ] LPG: Full fetch complete (59603 records). [2025-10-02T19:59:40.683243] [DEBUG] [VALIDATOR ] LPG: Validating primary data. [2025-10-02T19:59:41.074082] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-03. [2025-10-02T19:59:41.095351] [DEBUG] [VALIDATOR ] LPG: All expected trading days are present. [2025-10-02T19:59:41.095480] [DEBUG] [VALIDATOR ] LPG: Primary data validation passed. [2025-10-02T19:59:41.096622] [INFO ] [MAIN ] LPG: Fetched primary data is valid. [2025-10-02T19:59:41.096836] [DEBUG] [LOCAL ] LPG: Saving primary data. [2025-10-02T19:59:41.098418] [DEBUG] [LOCAL ] LPG: Trimmed 59603 records to 40198 (keeping 200 days of data) [2025-10-02T19:59:41.375409] [DEBUG] [LOCAL ] LPG: Primary data saved (40198 records). [2025-10-02T19:59:41.375583] [INFO ] [MAIN ] LPG: Full history saved. [2025-10-02T19:59:41.375748] [INFO ] [MAIN ] Update Progress: 1273/2370 symbols completed. LPG took 41.0s. Estimated remaining: 2h 34m 47s. Rate: 7.1 symbols/min [2025-10-02T19:59:41.564371] [INFO ] [MAIN ] LSPD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:59:41.614676] [DEBUG] [LOCAL ] LSPD: Loaded 42896 existing records from primary storage. [2025-10-02T19:59:41.614987] [INFO ] [MAIN ] LSPD: Loaded 42896 existing records. [2025-10-02T19:59:41.822330] [WARN ] [MAIN ] LSPD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:59:41.822706] [INFO ] [MAIN ] LSPD: Wiping existing primary data before full refresh. [2025-10-02T19:59:41.822869] [INFO ] [LOCAL ] LSPD: Starting deletion of primary data. [2025-10-02T19:59:41.823685] [DEBUG] [LOCAL ] LSPD: Deleted primary data file. [2025-10-02T19:59:41.823749] [INFO ] [MAIN ] LSPD: Starting full primary refresh. [2025-10-02T19:59:41.885100] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-07. [2025-10-02T19:59:42.206907] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-02T19:59:42.289835] [INFO ] [REMOTE ] LSPD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:59:42.588000] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-02T19:59:42.673022] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-04. [2025-10-02T19:59:43.164263] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-02T19:59:43.473035] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2024-12. [2025-10-02T19:59:43.996309] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-02T19:59:44.273061] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-08. [2025-10-02T19:59:44.949362] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-02T19:59:45.073001] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-04. [2025-10-02T19:59:45.493531] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-02T19:59:45.873050] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-01. [2025-10-02T19:59:46.595021] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-02T19:59:46.673014] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-09. [2025-10-02T19:59:47.198191] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-02T19:59:47.473016] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-02. [2025-10-02T19:59:47.820969] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-02T19:59:48.273041] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-05. [2025-10-02T19:59:49.003782] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-02T19:59:49.073003] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-05. [2025-10-02T19:59:49.466204] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-02T19:59:49.872991] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-10. [2025-10-02T19:59:50.305462] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-02T19:59:50.673001] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-06. [2025-10-02T19:59:51.239859] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-02T19:59:51.241466] [INFO ] [REMOTE ] LPL: Full fetch complete (35528 records). [2025-10-02T19:59:51.241552] [DEBUG] [VALIDATOR ] LPL: Validating primary data. [2025-10-02T19:59:51.479681] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-06. [2025-10-02T19:59:51.655263] [DEBUG] [VALIDATOR ] LPL: All expected trading days are present. [2025-10-02T19:59:51.655353] [DEBUG] [VALIDATOR ] LPL: Primary data validation passed. [2025-10-02T19:59:51.656162] [INFO ] [MAIN ] LPL: Fetched primary data is valid. [2025-10-02T19:59:51.656249] [DEBUG] [LOCAL ] LPL: Saving primary data. [2025-10-02T19:59:51.657466] [DEBUG] [LOCAL ] LPL: Trimmed 35528 records to 26772 (keeping 200 days of data) [2025-10-02T19:59:51.814372] [DEBUG] [LOCAL ] LPL: Primary data saved (26772 records). [2025-10-02T19:59:51.814515] [INFO ] [MAIN ] LPL: Full history saved. [2025-10-02T19:59:51.814631] [INFO ] [MAIN ] Update Progress: 1274/2370 symbols completed. LPL took 35.1s. Estimated remaining: 2h 34m 41s. Rate: 7.1 symbols/min [2025-10-02T19:59:52.002012] [INFO ] [MAIN ] LTC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:59:52.049154] [DEBUG] [LOCAL ] LTC: Loaded 30230 existing records from primary storage. [2025-10-02T19:59:52.049730] [INFO ] [MAIN ] LTC: Loaded 30230 existing records. [2025-10-02T19:59:52.241714] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-02T19:59:52.284986] [WARN ] [MAIN ] LTC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:59:52.285893] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-03. [2025-10-02T19:59:52.286514] [INFO ] [MAIN ] LTC: Wiping existing primary data before full refresh. [2025-10-02T19:59:52.287817] [INFO ] [LOCAL ] LTC: Starting deletion of primary data. [2025-10-02T19:59:52.288503] [DEBUG] [LOCAL ] LTC: Deleted primary data file. [2025-10-02T19:59:52.288569] [INFO ] [MAIN ] LTC: Starting full primary refresh. [2025-10-02T19:59:52.677867] [INFO ] [REMOTE ] LTC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:59:53.073033] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-07. [2025-10-02T19:59:53.125285] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-02T19:59:53.872996] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-07. [2025-10-02T19:59:54.064426] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-02T19:59:54.573270] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-02T19:59:54.673011] [INFO ] [REMOTE ] LTC: Fetching primary data for 2024-12. [2025-10-02T19:59:55.399378] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-02T19:59:55.473007] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-08. [2025-10-02T19:59:55.896616] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-02T19:59:56.273006] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-08. [2025-10-02T19:59:57.027939] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-02T19:59:57.073049] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-04. [2025-10-02T19:59:57.863021] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-02T19:59:57.872974] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-09. [2025-10-02T19:59:58.672976] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-09. [2025-10-02T19:59:58.831891] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-02T19:59:59.202000] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-02T19:59:59.473006] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-05. [2025-10-02T20:00:00.039929] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-02T20:00:00.273000] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-10. [2025-10-02T20:00:00.996896] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-02T20:00:01.073079] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-01. [2025-10-02T20:00:01.729843] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-02T20:00:01.732593] [INFO ] [REMOTE ] LPX: Full fetch complete (58832 records). [2025-10-02T20:00:01.732836] [DEBUG] [VALIDATOR ] LPX: Validating primary data. [2025-10-02T20:00:01.880553] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-10. [2025-10-02T20:00:02.428995] [DEBUG] [VALIDATOR ] LPX: All expected trading days are present. [2025-10-02T20:00:02.429267] [DEBUG] [VALIDATOR ] LPX: Primary data validation passed. [2025-10-02T20:00:02.430328] [INFO ] [MAIN ] LPX: Fetched primary data is valid. [2025-10-02T20:00:02.430444] [DEBUG] [LOCAL ] LPX: Saving primary data. [2025-10-02T20:00:02.431909] [DEBUG] [LOCAL ] LPX: Trimmed 58832 records to 39976 (keeping 200 days of data) [2025-10-02T20:00:02.684409] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-06. [2025-10-02T20:00:02.730817] [DEBUG] [LOCAL ] LPX: Primary data saved (39976 records). [2025-10-02T20:00:02.731004] [INFO ] [MAIN ] LPX: Full history saved. [2025-10-02T20:00:02.748582] [INFO ] [MAIN ] Update Progress: 1275/2370 symbols completed. LPX took 37.5s. Estimated remaining: 2h 34m 34s. Rate: 7.1 symbols/min [2025-10-02T20:00:02.750567] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-02T20:00:02.972005] [INFO ] [MAIN ] LTH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:00:03.044395] [DEBUG] [LOCAL ] LTH: Loaded 51747 existing records from primary storage. [2025-10-02T20:00:03.044839] [INFO ] [MAIN ] LTH: Loaded 51747 existing records. [2025-10-02T20:00:03.243898] [WARN ] [MAIN ] LTH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:00:03.244195] [INFO ] [MAIN ] LTH: Wiping existing primary data before full refresh. [2025-10-02T20:00:03.244301] [INFO ] [LOCAL ] LTH: Starting deletion of primary data. [2025-10-02T20:00:03.245082] [DEBUG] [LOCAL ] LTH: Deleted primary data file. [2025-10-02T20:00:03.245159] [INFO ] [MAIN ] LTH: Starting full primary refresh. [2025-10-02T20:00:03.399995] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-02T20:00:03.434036] [INFO ] [REMOTE ] LRN: Full fetch complete (58498 records). [2025-10-02T20:00:03.462896] [DEBUG] [VALIDATOR ] LRN: Validating primary data. [2025-10-02T20:00:03.480015] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-02. [2025-10-02T20:00:03.859001] [INFO ] [REMOTE ] LTH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:00:04.136413] [DEBUG] [VALIDATOR ] LRN: All expected trading days are present. [2025-10-02T20:00:04.136538] [DEBUG] [VALIDATOR ] LRN: Primary data validation passed. [2025-10-02T20:00:04.137624] [INFO ] [MAIN ] LRN: Fetched primary data is valid. [2025-10-02T20:00:04.137814] [DEBUG] [LOCAL ] LRN: Saving primary data. [2025-10-02T20:00:04.139609] [DEBUG] [LOCAL ] LRN: Trimmed 58498 records to 40020 (keeping 200 days of data) [2025-10-02T20:00:04.269693] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-02T20:00:04.280557] [INFO ] [REMOTE ] LTH: Fetching primary data for 2024-12. [2025-10-02T20:00:04.455432] [DEBUG] [LOCAL ] LRN: Primary data saved (40020 records). [2025-10-02T20:00:04.455562] [INFO ] [MAIN ] LRN: Full history saved. [2025-10-02T20:00:04.455668] [INFO ] [MAIN ] Update Progress: 1276/2370 symbols completed. LRN took 36.0s. Estimated remaining: 2h 34m 20s. Rate: 7.1 symbols/min [2025-10-02T20:00:04.656688] [INFO ] [MAIN ] LTM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:00:04.698498] [DEBUG] [LOCAL ] LTM: Loaded 36988 existing records from primary storage. [2025-10-02T20:00:04.698847] [INFO ] [MAIN ] LTM: Loaded 36988 existing records. [2025-10-02T20:00:04.892713] [WARN ] [MAIN ] LTM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:00:04.892975] [INFO ] [MAIN ] LTM: Wiping existing primary data before full refresh. [2025-10-02T20:00:04.893043] [INFO ] [LOCAL ] LTM: Starting deletion of primary data. [2025-10-02T20:00:04.909296] [DEBUG] [LOCAL ] LTM: Deleted primary data file. [2025-10-02T20:00:04.909665] [INFO ] [MAIN ] LTM: Starting full primary refresh. [2025-10-02T20:00:04.916059] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-02T20:00:05.078125] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-07. [2025-10-02T20:00:05.314306] [INFO ] [REMOTE ] LTM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:00:05.568330] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-02T20:00:05.872994] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-01. [2025-10-02T20:00:06.593766] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-02T20:00:06.672995] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-08. [2025-10-02T20:00:07.317015] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-02T20:00:07.473016] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-03. [2025-10-02T20:00:08.200397] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-02T20:00:08.273035] [INFO ] [REMOTE ] LTM: Fetching primary data for 2024-12. [2025-10-02T20:00:09.073005] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-02. [2025-10-02T20:00:09.162896] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-02T20:00:09.176683] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-02T20:00:09.873011] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-04. [2025-10-02T20:00:10.643692] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-02T20:00:10.672980] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-03. [2025-10-02T20:00:11.473045] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-09. [2025-10-02T20:00:11.859330] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-02T20:00:12.272984] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-01. [2025-10-02T20:00:12.386707] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-02T20:00:12.883168] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-02T20:00:13.073042] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-10. [2025-10-02T20:00:13.400799] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-02T20:00:13.872998] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-02. [2025-10-02T20:00:14.373352] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-02T20:00:14.375237] [INFO ] [REMOTE ] LSPD: Full fetch complete (61691 records). [2025-10-02T20:00:14.375350] [DEBUG] [VALIDATOR ] LSPD: Validating primary data. [2025-10-02T20:00:14.681169] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-04. [2025-10-02T20:00:14.819495] [DEBUG] [VALIDATOR ] LSPD: All expected trading days are present. [2025-10-02T20:00:14.819619] [DEBUG] [VALIDATOR ] LSPD: Primary data validation passed. [2025-10-02T20:00:14.820572] [INFO ] [MAIN ] LSPD: Fetched primary data is valid. [2025-10-02T20:00:14.820677] [DEBUG] [LOCAL ] LSPD: Saving primary data. [2025-10-02T20:00:14.822192] [DEBUG] [LOCAL ] LSPD: Trimmed 61691 records to 43183 (keeping 200 days of data) [2025-10-02T20:00:14.951346] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-02T20:00:15.162689] [DEBUG] [LOCAL ] LSPD: Primary data saved (43183 records). [2025-10-02T20:00:15.162843] [INFO ] [MAIN ] LSPD: Full history saved. [2025-10-02T20:00:15.162974] [INFO ] [MAIN ] Update Progress: 1277/2370 symbols completed. LSPD took 33.8s. Estimated remaining: 2h 34m 14s. Rate: 7.1 symbols/min [2025-10-02T20:00:15.473017] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-03. [2025-10-02T20:00:16.273092] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-05. [2025-10-02T20:00:16.668578] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-02T20:00:16.763120] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-02T20:00:17.073016] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-05. [2025-10-02T20:00:17.483108] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-02T20:00:17.873009] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-04. [2025-10-02T20:00:18.516479] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-02T20:00:18.673049] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-06. [2025-10-02T20:00:19.137315] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-02T20:00:19.473035] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-05. [2025-10-02T20:00:20.185567] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-02T20:00:20.273055] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-07. [2025-10-02T20:00:20.443142] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-02T20:00:21.073009] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-06. [2025-10-02T20:00:21.873067] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-06. [2025-10-02T20:00:21.934099] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-02T20:00:22.353050] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-02T20:00:22.673044] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-07. [2025-10-02T20:00:23.078247] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-02T20:00:23.472987] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-07. [2025-10-02T20:00:23.799344] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-02T20:00:24.272998] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-08. [2025-10-02T20:00:24.916516] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-02T20:00:25.072996] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-08. [2025-10-02T20:00:25.484909] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-02T20:00:25.873038] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-09. [2025-10-02T20:00:26.506174] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-02T20:00:26.673023] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-08. [2025-10-02T20:00:27.472998] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-09. [2025-10-02T20:00:27.601406] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-02T20:00:28.118903] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-02T20:00:28.273058] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-09. [2025-10-02T20:00:28.900946] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-02T20:00:29.073025] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-10. [2025-10-02T20:00:29.617205] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-02T20:00:29.873044] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-10. [2025-10-02T20:00:30.273698] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-02T20:00:30.275558] [INFO ] [REMOTE ] LTM: Full fetch complete (48079 records). [2025-10-02T20:00:30.275665] [DEBUG] [VALIDATOR ] LTM: Validating primary data. [2025-10-02T20:00:30.682226] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-10. [2025-10-02T20:00:30.786198] [DEBUG] [VALIDATOR ] LTM: All expected trading days are present. [2025-10-02T20:00:30.786319] [DEBUG] [VALIDATOR ] LTM: Primary data validation passed. [2025-10-02T20:00:30.787251] [INFO ] [MAIN ] LTM: Fetched primary data is valid. [2025-10-02T20:00:30.787321] [DEBUG] [LOCAL ] LTM: Saving primary data. [2025-10-02T20:00:30.788818] [DEBUG] [LOCAL ] LTM: Trimmed 48079 records to 37342 (keeping 200 days of data) [2025-10-02T20:00:31.026925] [DEBUG] [LOCAL ] LTM: Primary data saved (37342 records). [2025-10-02T20:00:31.027122] [INFO ] [MAIN ] LTM: Full history saved. [2025-10-02T20:00:31.027225] [INFO ] [MAIN ] Update Progress: 1278/2370 symbols completed. LTM took 26.6s. Estimated remaining: 2h 34m 11s. Rate: 7.1 symbols/min [2025-10-02T20:00:31.319698] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-02T20:00:31.321824] [INFO ] [REMOTE ] LTH: Full fetch complete (74205 records). [2025-10-02T20:00:31.321951] [DEBUG] [VALIDATOR ] LTH: Validating primary data. [2025-10-02T20:00:31.764480] [DEBUG] [VALIDATOR ] LTH: All expected trading days are present. [2025-10-02T20:00:31.764576] [DEBUG] [VALIDATOR ] LTH: Primary data validation passed. [2025-10-02T20:00:31.765759] [INFO ] [MAIN ] LTH: Fetched primary data is valid. [2025-10-02T20:00:31.765832] [DEBUG] [LOCAL ] LTH: Saving primary data. [2025-10-02T20:00:31.767384] [DEBUG] [LOCAL ] LTH: Trimmed 74205 records to 52100 (keeping 200 days of data) [2025-10-02T20:00:32.001786] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-02T20:00:32.006241] [INFO ] [REMOTE ] LTC: Full fetch complete (43500 records). [2025-10-02T20:00:32.007287] [DEBUG] [VALIDATOR ] LTC: Validating primary data. [2025-10-02T20:00:32.465611] [DEBUG] [VALIDATOR ] LTC: All expected trading days are present. [2025-10-02T20:00:32.466304] [DEBUG] [VALIDATOR ] LTC: Primary data validation passed. [2025-10-02T20:00:32.467939] [INFO ] [MAIN ] LTC: Fetched primary data is valid. [2025-10-02T20:00:32.468038] [DEBUG] [LOCAL ] LTC: Saving primary data. [2025-10-02T20:00:32.474711] [DEBUG] [LOCAL ] LTC: Trimmed 43500 records to 30459 (keeping 200 days of data) [2025-10-02T20:00:32.666921] [DEBUG] [LOCAL ] LTH: Primary data saved (52100 records). [2025-10-02T20:00:32.667595] [INFO ] [MAIN ] LTH: Full history saved. [2025-10-02T20:00:32.668290] [INFO ] [MAIN ] Update Progress: 1279/2370 symbols completed. LTH took 29.9s. Estimated remaining: 2h 33m 57s. Rate: 7.1 symbols/min [2025-10-02T20:00:32.757517] [DEBUG] [LOCAL ] LTC: Primary data saved (30459 records). [2025-10-02T20:00:32.757708] [INFO ] [MAIN ] LTC: Full history saved. [2025-10-02T20:00:32.757814] [INFO ] [MAIN ] Update Progress: 1280/2370 symbols completed. LTC took 40.9s. Estimated remaining: 2h 33m 42s. Rate: 7.1 symbols/min [2025-10-02T20:00:33.421735] [INFO ] [MAIN ] LUMN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:00:33.505494] [INFO ] [MAIN ] LUCK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:00:33.499427] [INFO ] [MAIN ] LUV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:00:33.533806] [INFO ] [MAIN ] LU: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:00:33.561731] [DEBUG] [LOCAL ] LUCK: Loaded 24646 existing records from primary storage. [2025-10-02T20:00:33.562147] [INFO ] [MAIN ] LUCK: Loaded 24646 existing records. [2025-10-02T20:00:33.783840] [DEBUG] [LOCAL ] LUMN: Loaded 53634 existing records from primary storage. [2025-10-02T20:00:33.876925] [WARN ] [MAIN ] LUCK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:00:33.857937] [DEBUG] [LOCAL ] LUV: Loaded 53689 existing records from primary storage. [2025-10-02T20:00:33.878770] [INFO ] [MAIN ] LUV: Loaded 53689 existing records. [2025-10-02T20:00:33.879522] [DEBUG] [LOCAL ] LU: Loaded 48987 existing records from primary storage. [2025-10-02T20:00:33.878586] [INFO ] [MAIN ] LUCK: Wiping existing primary data before full refresh. [2025-10-02T20:00:33.828772] [INFO ] [MAIN ] LUMN: Loaded 53634 existing records. [2025-10-02T20:00:33.891858] [INFO ] [MAIN ] LU: Loaded 48987 existing records. [2025-10-02T20:00:33.884849] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-10-02T20:00:34.012814] [DEBUG] [LOCAL ] LUCK: Deleted primary data file. [2025-10-02T20:00:34.113480] [INFO ] [MAIN ] LUCK: Starting full primary refresh. [2025-10-02T20:00:34.674520] [WARN ] [MAIN ] LUMN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:00:34.761819] [WARN ] [MAIN ] LUV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:00:34.780232] [WARN ] [MAIN ] LU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:00:34.792148] [INFO ] [MAIN ] LUMN: Wiping existing primary data before full refresh. [2025-10-02T20:00:34.792064] [INFO ] [MAIN ] LUV: Wiping existing primary data before full refresh. [2025-10-02T20:00:34.823616] [INFO ] [LOCAL ] LUMN: Starting deletion of primary data. [2025-10-02T20:00:34.823514] [INFO ] [LOCAL ] LUV: Starting deletion of primary data. [2025-10-02T20:00:34.840455] [DEBUG] [LOCAL ] LUMN: Deleted primary data file. [2025-10-02T20:00:34.832719] [INFO ] [MAIN ] LU: Wiping existing primary data before full refresh. [2025-10-02T20:00:34.861275] [DEBUG] [LOCAL ] LUV: Deleted primary data file. [2025-10-02T20:00:34.871798] [INFO ] [LOCAL ] LU: Starting deletion of primary data. [2025-10-02T20:00:34.882313] [INFO ] [MAIN ] LUMN: Starting full primary refresh. [2025-10-02T20:00:34.889165] [INFO ] [MAIN ] LUV: Starting full primary refresh. [2025-10-02T20:00:34.909571] [DEBUG] [LOCAL ] LU: Deleted primary data file. [2025-10-02T20:00:34.968948] [INFO ] [MAIN ] LU: Starting full primary refresh. [2025-10-02T20:00:35.415534] [INFO ] [REMOTE ] LUCK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:00:35.488943] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2024-12. [2025-10-02T20:00:36.184797] [INFO ] [REMOTE ] LUV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:00:36.269393] [INFO ] [REMOTE ] LUMN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:00:36.280911] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2024-12. [2025-10-02T20:00:36.284985] [INFO ] [REMOTE ] LU: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:00:36.280427] [INFO ] [REMOTE ] LUV: Fetching primary data for 2024-12. [2025-10-02T20:00:36.287373] [INFO ] [REMOTE ] LU: Fetching primary data for 2024-12. [2025-10-02T20:00:36.725298] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-02T20:00:36.733393] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-01. [2025-10-02T20:00:38.038268] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-02T20:00:38.049598] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-01. [2025-10-02T20:00:38.159443] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-02T20:00:38.167926] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-02. [2025-10-02T20:00:38.201471] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-02T20:00:38.213966] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-01. [2025-10-02T20:00:38.438035] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-02T20:00:38.449791] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-01. [2025-10-02T20:00:39.173169] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-02T20:00:39.180870] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-03. [2025-10-02T20:00:39.760941] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-02T20:00:39.772233] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-02. [2025-10-02T20:00:40.029218] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-02T20:00:40.118058] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-02T20:00:40.150575] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-02T20:00:40.273027] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-02. [2025-10-02T20:00:41.073004] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-04. [2025-10-02T20:00:41.406509] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-02T20:00:41.872970] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-03. [2025-10-02T20:00:42.091424] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-02T20:00:42.325857] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-02T20:00:42.673009] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-03. [2025-10-02T20:00:43.473026] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-05. [2025-10-02T20:00:43.623440] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-02T20:00:44.273012] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-04. [2025-10-02T20:00:44.564145] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-02T20:00:44.620238] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-02T20:00:45.073059] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-06. [2025-10-02T20:00:45.732564] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-02T20:00:45.872985] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-02. [2025-10-02T20:00:46.192072] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-02T20:00:46.673007] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-05. [2025-10-02T20:00:47.473006] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-07. [2025-10-02T20:00:47.941153] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-02T20:00:48.273001] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-03. [2025-10-02T20:00:48.340574] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-02T20:00:48.379939] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-02T20:00:49.072999] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-06. [2025-10-02T20:00:49.872983] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-04. [2025-10-02T20:00:50.227125] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-02T20:00:50.321584] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-02T20:00:50.673002] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-07. [2025-10-02T20:00:51.473021] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-08. [2025-10-02T20:00:51.807086] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-02T20:00:52.107389] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-02T20:00:52.177432] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-02T20:00:52.273009] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-05. [2025-10-02T20:00:53.073008] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-09. [2025-10-02T20:00:53.872975] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-08. [2025-10-02T20:00:53.963299] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-02T20:00:54.164307] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-02T20:00:54.673080] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-10. [2025-10-02T20:00:55.470676] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-02T20:00:55.471994] [INFO ] [REMOTE ] LUCK: Full fetch complete (41210 records). [2025-10-02T20:00:55.472097] [DEBUG] [VALIDATOR ] LUCK: Validating primary data. [2025-10-02T20:00:55.478263] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-04. [2025-10-02T20:00:55.678731] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-02T20:00:55.979986] [DEBUG] [VALIDATOR ] LUCK: All expected trading days are present. [2025-10-02T20:00:55.980106] [DEBUG] [VALIDATOR ] LUCK: Primary data validation passed. [2025-10-02T20:00:55.980925] [INFO ] [MAIN ] LUCK: Fetched primary data is valid. [2025-10-02T20:00:55.980992] [DEBUG] [LOCAL ] LUCK: Saving primary data. [2025-10-02T20:00:55.981994] [DEBUG] [LOCAL ] LUCK: Trimmed 41210 records to 24825 (keeping 200 days of data) [2025-10-02T20:00:56.151739] [DEBUG] [LOCAL ] LUCK: Primary data saved (24825 records). [2025-10-02T20:00:56.151892] [INFO ] [MAIN ] LUCK: Full history saved. [2025-10-02T20:00:56.151982] [INFO ] [MAIN ] Update Progress: 1281/2370 symbols completed. LUCK took 23.4s. Estimated remaining: 2h 33m 46s. Rate: 7.1 symbols/min [2025-10-02T20:00:56.278269] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-09. [2025-10-02T20:00:56.357261] [INFO ] [MAIN ] LUXE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:00:56.357464] [DEBUG] [LOCAL ] LUXE: No existing data file found in primary storage. [2025-10-02T20:00:56.357523] [WARN ] [MAIN ] LUXE: No existing data found, performing full refresh instead. [2025-10-02T20:00:56.357663] [INFO ] [MAIN ] LUXE: Wiping existing primary data before full refresh. [2025-10-02T20:00:56.357727] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-10-02T20:00:56.357788] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-10-02T20:00:56.357833] [INFO ] [MAIN ] LUXE: Starting full primary refresh. [2025-10-02T20:00:56.757398] [INFO ] [REMOTE ] LUXE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:00:57.073011] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2024-12. [2025-10-02T20:00:57.274951] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T20:00:57.275281] [WARN ] [REMOTE ] LUXE: No data returned for month 2024-12 [2025-10-02T20:00:57.275389] [FATAL] [REMOTE ] LUXE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T20:00:57.275443] [FATAL] [MAIN ] LUXE: Failed to fetch primary data. [2025-10-02T20:00:57.275524] [WARN ] [MAIN ] LUXE: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T20:00:57.275600] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-10-02T20:00:57.275695] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-10-02T20:00:57.275751] [INFO ] [LOCAL ] LUXE: Starting deletion of derivative data. [2025-10-02T20:00:57.275814] [DEBUG] [LOCAL ] LUXE: No derivative data file found to delete. [2025-10-02T20:00:57.275887] [INFO ] [MAIN ] Update Progress: 1282/2370 symbols completed. LUXE took 1.1s. Estimated remaining: 2h 33m 31s. Rate: 7.1 symbols/min [2025-10-02T20:00:57.476938] [INFO ] [MAIN ] LVS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:00:57.533557] [DEBUG] [LOCAL ] LVS: Loaded 53563 existing records from primary storage. [2025-10-02T20:00:57.533948] [INFO ] [MAIN ] LVS: Loaded 53563 existing records. [2025-10-02T20:00:57.736212] [WARN ] [MAIN ] LVS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:00:57.736546] [INFO ] [MAIN ] LVS: Wiping existing primary data before full refresh. [2025-10-02T20:00:57.736765] [INFO ] [LOCAL ] LVS: Starting deletion of primary data. [2025-10-02T20:00:57.737873] [DEBUG] [LOCAL ] LVS: Deleted primary data file. [2025-10-02T20:00:57.737938] [INFO ] [MAIN ] LVS: Starting full primary refresh. [2025-10-02T20:00:57.880353] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-06. [2025-10-02T20:00:58.006465] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-04 (2.53 seconds). [2025-10-02T20:00:58.206786] [INFO ] [REMOTE ] LVS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:00:58.241722] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-02T20:00:58.673015] [INFO ] [REMOTE ] LVS: Fetching primary data for 2024-12. [2025-10-02T20:00:59.473009] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-05. [2025-10-02T20:00:59.931051] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-02T20:01:00.278818] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-10. [2025-10-02T20:01:00.293798] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-02T20:01:01.073003] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-01. [2025-10-02T20:01:01.254794] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-02T20:01:01.750931] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-02T20:01:01.753022] [INFO ] [REMOTE ] LU: Full fetch complete (70392 records). [2025-10-02T20:01:01.753188] [DEBUG] [VALIDATOR ] LU: Validating primary data. [2025-10-02T20:01:01.878093] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-06. [2025-10-02T20:01:02.198075] [DEBUG] [VALIDATOR ] LU: All expected trading days are present. [2025-10-02T20:01:02.198163] [DEBUG] [VALIDATOR ] LU: Primary data validation passed. [2025-10-02T20:01:02.199260] [INFO ] [MAIN ] LU: Fetched primary data is valid. [2025-10-02T20:01:02.199329] [DEBUG] [LOCAL ] LU: Saving primary data. [2025-10-02T20:01:02.200884] [DEBUG] [LOCAL ] LU: Trimmed 70392 records to 49348 (keeping 200 days of data) [2025-10-02T20:01:02.499367] [DEBUG] [LOCAL ] LU: Primary data saved (49348 records). [2025-10-02T20:01:02.499510] [INFO ] [MAIN ] LU: Full history saved. [2025-10-02T20:01:02.499597] [INFO ] [MAIN ] Update Progress: 1283/2370 symbols completed. LU took 29.7s. Estimated remaining: 2h 33m 20s. Rate: 7.1 symbols/min [2025-10-02T20:01:02.673975] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-07. [2025-10-02T20:01:02.696678] [INFO ] [MAIN ] LVWR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:01:02.716888] [DEBUG] [LOCAL ] LVWR: Loaded 17692 existing records from primary storage. [2025-10-02T20:01:02.717150] [INFO ] [MAIN ] LVWR: Loaded 17692 existing records. [2025-10-02T20:01:02.913800] [WARN ] [MAIN ] LVWR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:01:02.914191] [INFO ] [MAIN ] LVWR: Wiping existing primary data before full refresh. [2025-10-02T20:01:02.914339] [INFO ] [LOCAL ] LVWR: Starting deletion of primary data. [2025-10-02T20:01:02.914822] [DEBUG] [LOCAL ] LVWR: Deleted primary data file. [2025-10-02T20:01:02.914884] [INFO ] [MAIN ] LVWR: Starting full primary refresh. [2025-10-02T20:01:03.351704] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-10-02T20:01:03.355954] [INFO ] [REMOTE ] LVWR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:01:03.473036] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2024-12. [2025-10-02T20:01:03.907220] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-02T20:01:04.093458] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-02T20:01:04.219694] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-02T20:01:04.273046] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-02. [2025-10-02T20:01:05.073052] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-01. [2025-10-02T20:01:05.742514] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-02T20:01:05.872996] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-07. [2025-10-02T20:01:06.006562] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-02T20:01:06.673000] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-03. [2025-10-02T20:01:07.473006] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-08. [2025-10-02T20:01:08.036830] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-02T20:01:08.273008] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-08. [2025-10-02T20:01:08.580875] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-02T20:01:09.072990] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-02. [2025-10-02T20:01:09.483529] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-02T20:01:09.873031] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-09. [2025-10-02T20:01:10.309897] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-02T20:01:10.673002] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-04. [2025-10-02T20:01:11.108154] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-02T20:01:11.473046] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-03. [2025-10-02T20:01:12.038179] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-02T20:01:12.115541] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-02T20:01:12.272983] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-04. [2025-10-02T20:01:12.319774] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-02T20:01:12.691145] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-02T20:01:13.072984] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-05. [2025-10-02T20:01:13.872993] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-09. [2025-10-02T20:01:14.218842] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-02T20:01:14.673040] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-05. [2025-10-02T20:01:15.472994] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-06. [2025-10-02T20:01:15.847673] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-02T20:01:16.272970] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-10. [2025-10-02T20:01:16.601257] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-02T20:01:17.073034] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-10. [2025-10-02T20:01:17.324400] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-02T20:01:17.873010] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-07. [2025-10-02T20:01:17.886862] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-02T20:01:17.889486] [INFO ] [REMOTE ] LUV: Full fetch complete (77729 records). [2025-10-02T20:01:17.889714] [DEBUG] [VALIDATOR ] LUV: Validating primary data. [2025-10-02T20:01:18.346408] [DEBUG] [VALIDATOR ] LUV: All expected trading days are present. [2025-10-02T20:01:18.346512] [DEBUG] [VALIDATOR ] LUV: Primary data validation passed. [2025-10-02T20:01:18.347721] [INFO ] [MAIN ] LUV: Fetched primary data is valid. [2025-10-02T20:01:18.347793] [DEBUG] [LOCAL ] LUV: Saving primary data. [2025-10-02T20:01:18.349670] [DEBUG] [LOCAL ] LUV: Trimmed 77729 records to 54079 (keeping 200 days of data) [2025-10-02T20:01:18.676598] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-06. [2025-10-02T20:01:18.727907] [DEBUG] [LOCAL ] LUV: Primary data saved (54079 records). [2025-10-02T20:01:18.728069] [INFO ] [MAIN ] LUV: Full history saved. [2025-10-02T20:01:18.729563] [INFO ] [MAIN ] Update Progress: 1284/2370 symbols completed. LUV took 46.0s. Estimated remaining: 2h 33m 18s. Rate: 7.1 symbols/min [2025-10-02T20:01:18.928897] [INFO ] [MAIN ] LW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:01:18.968398] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-02T20:01:18.983582] [INFO ] [REMOTE ] LUMN: Full fetch complete (77635 records). [2025-10-02T20:01:18.998429] [DEBUG] [VALIDATOR ] LUMN: Validating primary data. [2025-10-02T20:01:19.000879] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-02T20:01:19.024182] [DEBUG] [LOCAL ] LW: Loaded 51158 existing records from primary storage. [2025-10-02T20:01:19.051804] [INFO ] [MAIN ] LW: Loaded 51158 existing records. [2025-10-02T20:01:19.450842] [WARN ] [MAIN ] LW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:01:19.475996] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-08. [2025-10-02T20:01:19.481585] [INFO ] [MAIN ] LW: Wiping existing primary data before full refresh. [2025-10-02T20:01:19.512001] [INFO ] [LOCAL ] LW: Starting deletion of primary data. [2025-10-02T20:01:19.566398] [DEBUG] [LOCAL ] LW: Deleted primary data file. [2025-10-02T20:01:19.578697] [INFO ] [MAIN ] LW: Starting full primary refresh. [2025-10-02T20:01:19.864909] [DEBUG] [VALIDATOR ] LUMN: All expected trading days are present. [2025-10-02T20:01:19.870226] [DEBUG] [VALIDATOR ] LUMN: Primary data validation passed. [2025-10-02T20:01:19.895863] [INFO ] [MAIN ] LUMN: Fetched primary data is valid. [2025-10-02T20:01:19.955784] [DEBUG] [LOCAL ] LUMN: Saving primary data. [2025-10-02T20:01:20.070099] [DEBUG] [LOCAL ] LUMN: Trimmed 77635 records to 54024 (keeping 200 days of data) [2025-10-02T20:01:20.248738] [INFO ] [REMOTE ] LW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:01:20.274586] [INFO ] [REMOTE ] LW: Fetching primary data for 2024-12. [2025-10-02T20:01:20.429016] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-02T20:01:20.459176] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-02T20:01:20.587123] [DEBUG] [LOCAL ] LUMN: Primary data saved (54024 records). [2025-10-02T20:01:20.587275] [INFO ] [MAIN ] LUMN: Full history saved. [2025-10-02T20:01:20.587368] [INFO ] [MAIN ] Update Progress: 1285/2370 symbols completed. LUMN took 47.8s. Estimated remaining: 2h 33m 4s. Rate: 7.1 symbols/min [2025-10-02T20:01:20.767709] [INFO ] [MAIN ] LXFR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:01:20.787214] [DEBUG] [LOCAL ] LXFR: Loaded 16834 existing records from primary storage. [2025-10-02T20:01:20.787538] [INFO ] [MAIN ] LXFR: Loaded 16834 existing records. [2025-10-02T20:01:20.974760] [WARN ] [MAIN ] LXFR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:01:20.974960] [INFO ] [MAIN ] LXFR: Wiping existing primary data before full refresh. [2025-10-02T20:01:20.975030] [INFO ] [LOCAL ] LXFR: Starting deletion of primary data. [2025-10-02T20:01:20.975308] [DEBUG] [LOCAL ] LXFR: Deleted primary data file. [2025-10-02T20:01:20.975403] [INFO ] [MAIN ] LXFR: Starting full primary refresh. [2025-10-02T20:01:21.078854] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-09. [2025-10-02T20:01:21.359011] [INFO ] [REMOTE ] LXFR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:01:21.872999] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2024-12. [2025-10-02T20:01:22.200362] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-02T20:01:22.200980] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-02T20:01:22.672977] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-07. [2025-10-02T20:01:22.886292] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-02T20:01:23.472977] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-01. [2025-10-02T20:01:24.205496] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-02T20:01:24.273048] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-02. [2025-10-02T20:01:24.623253] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-02T20:01:25.072982] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-08. [2025-10-02T20:01:25.230393] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-02T20:01:25.873010] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-10. [2025-10-02T20:01:26.670305] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-02T20:01:26.671681] [INFO ] [REMOTE ] LVWR: Full fetch complete (20077 records). [2025-10-02T20:01:26.671776] [DEBUG] [VALIDATOR ] LVWR: Validating primary data. [2025-10-02T20:01:26.678086] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-03. [2025-10-02T20:01:27.123533] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-02T20:01:27.147266] [DEBUG] [VALIDATOR ] LVWR: All expected trading days are present. [2025-10-02T20:01:27.147594] [DEBUG] [VALIDATOR ] LVWR: Primary data validation passed. [2025-10-02T20:01:27.148395] [INFO ] [MAIN ] LVWR: Fetched primary data is valid. [2025-10-02T20:01:27.148851] [DEBUG] [LOCAL ] LVWR: Saving primary data. [2025-10-02T20:01:27.149534] [DEBUG] [LOCAL ] LVWR: Trimmed 20077 records to 17935 (keeping 200 days of data) [2025-10-02T20:01:27.261936] [DEBUG] [LOCAL ] LVWR: Primary data saved (17935 records). [2025-10-02T20:01:27.262088] [INFO ] [MAIN ] LVWR: Full history saved. [2025-10-02T20:01:27.262184] [INFO ] [MAIN ] Update Progress: 1286/2370 symbols completed. LVWR took 24.8s. Estimated remaining: 2h 32m 54s. Rate: 7.1 symbols/min [2025-10-02T20:01:27.459809] [INFO ] [MAIN ] LXP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:01:27.472977] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-01. [2025-10-02T20:01:27.518736] [DEBUG] [LOCAL ] LXP: Loaded 50700 existing records from primary storage. [2025-10-02T20:01:27.519126] [INFO ] [MAIN ] LXP: Loaded 50700 existing records. [2025-10-02T20:01:27.743832] [WARN ] [MAIN ] LXP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:01:27.744134] [INFO ] [MAIN ] LXP: Wiping existing primary data before full refresh. [2025-10-02T20:01:27.744205] [INFO ] [LOCAL ] LXP: Starting deletion of primary data. [2025-10-02T20:01:27.745028] [DEBUG] [LOCAL ] LXP: Deleted primary data file. [2025-10-02T20:01:27.745116] [INFO ] [MAIN ] LXP: Starting full primary refresh. [2025-10-02T20:01:27.969761] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-02T20:01:28.178528] [INFO ] [REMOTE ] LXP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:01:28.273029] [INFO ] [REMOTE ] LXP: Fetching primary data for 2024-12. [2025-10-02T20:01:29.073031] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-04. [2025-10-02T20:01:29.358942] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-02T20:01:29.875896] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-02. [2025-10-02T20:01:29.882377] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-02T20:01:30.140478] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-02T20:01:30.673025] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-09. [2025-10-02T20:01:31.473092] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-05. [2025-10-02T20:01:31.546464] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-02T20:01:32.272977] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-01. [2025-10-02T20:01:32.433881] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-02T20:01:32.715207] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-02T20:01:33.073013] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-10. [2025-10-02T20:01:33.873006] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-03. [2025-10-02T20:01:34.032884] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-02T20:01:34.372916] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-02T20:01:34.375372] [INFO ] [REMOTE ] LVS: Full fetch complete (77515 records). [2025-10-02T20:01:34.375494] [DEBUG] [VALIDATOR ] LVS: Validating primary data. [2025-10-02T20:01:34.679489] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-06. [2025-10-02T20:01:34.820056] [DEBUG] [VALIDATOR ] LVS: All expected trading days are present. [2025-10-02T20:01:34.820167] [DEBUG] [VALIDATOR ] LVS: Primary data validation passed. [2025-10-02T20:01:34.821518] [INFO ] [MAIN ] LVS: Fetched primary data is valid. [2025-10-02T20:01:34.821624] [DEBUG] [LOCAL ] LVS: Saving primary data. [2025-10-02T20:01:34.823440] [DEBUG] [LOCAL ] LVS: Trimmed 77515 records to 53953 (keeping 200 days of data) [2025-10-02T20:01:35.185407] [DEBUG] [LOCAL ] LVS: Primary data saved (53953 records). [2025-10-02T20:01:35.185571] [INFO ] [MAIN ] LVS: Full history saved. [2025-10-02T20:01:35.185701] [INFO ] [MAIN ] Update Progress: 1287/2370 symbols completed. LVS took 37.9s. Estimated remaining: 2h 32m 45s. Rate: 7.1 symbols/min [2025-10-02T20:01:35.393119] [INFO ] [MAIN ] LXU: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:01:35.428437] [DEBUG] [LOCAL ] LXU: Loaded 31708 existing records from primary storage. [2025-10-02T20:01:35.428783] [INFO ] [MAIN ] LXU: Loaded 31708 existing records. [2025-10-02T20:01:35.487924] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-02. [2025-10-02T20:01:35.678478] [WARN ] [MAIN ] LXU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:01:35.695487] [INFO ] [MAIN ] LXU: Wiping existing primary data before full refresh. [2025-10-02T20:01:35.699334] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-02T20:01:35.702513] [INFO ] [LOCAL ] LXU: Starting deletion of primary data. [2025-10-02T20:01:35.716217] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-02T20:01:35.722809] [DEBUG] [LOCAL ] LXU: Deleted primary data file. [2025-10-02T20:01:35.723805] [INFO ] [MAIN ] LXU: Starting full primary refresh. [2025-10-02T20:01:36.124480] [INFO ] [REMOTE ] LXU: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:01:36.273038] [INFO ] [REMOTE ] LXU: Fetching primary data for 2024-12. [2025-10-02T20:01:37.072979] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-07. [2025-10-02T20:01:37.196035] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-02T20:01:37.413082] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-02T20:01:37.799967] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-02T20:01:37.872991] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-01. [2025-10-02T20:01:38.673041] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-08. [2025-10-02T20:01:39.203929] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-02T20:01:39.473006] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-04. [2025-10-02T20:01:39.643829] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-02T20:01:40.273045] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-03. [2025-10-02T20:01:41.072986] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-02. [2025-10-02T20:01:41.265872] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-02T20:01:41.872983] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-09. [2025-10-02T20:01:41.973740] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-02T20:01:42.176752] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-02T20:01:42.673008] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-05. [2025-10-02T20:01:42.806713] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-02T20:01:43.473046] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-03. [2025-10-02T20:01:44.128111] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-02T20:01:44.273015] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-06. [2025-10-02T20:01:44.848591] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-02T20:01:45.073037] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-04. [2025-10-02T20:01:45.615945] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-02T20:01:45.872999] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-07. [2025-10-02T20:01:46.602010] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-02T20:01:46.673012] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-04. [2025-10-02T20:01:47.473042] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-05. [2025-10-02T20:01:47.773070] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-02T20:01:48.273041] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-10. [2025-10-02T20:01:48.553869] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-02T20:01:48.572568] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-02T20:01:48.922165] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-02T20:01:48.925426] [INFO ] [REMOTE ] LXFR: Full fetch complete (25046 records). [2025-10-02T20:01:48.925530] [DEBUG] [VALIDATOR ] LXFR: Validating primary data. [2025-10-02T20:01:49.087693] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-06. [2025-10-02T20:01:49.361923] [DEBUG] [VALIDATOR ] LXFR: All expected trading days are present. [2025-10-02T20:01:49.362056] [DEBUG] [VALIDATOR ] LXFR: Primary data validation passed. [2025-10-02T20:01:49.362927] [INFO ] [MAIN ] LXFR: Fetched primary data is valid. [2025-10-02T20:01:49.363035] [DEBUG] [LOCAL ] LXFR: Saving primary data. [2025-10-02T20:01:49.365388] [DEBUG] [LOCAL ] LXFR: Trimmed 25046 records to 16949 (keeping 200 days of data) [2025-10-02T20:01:49.481995] [DEBUG] [LOCAL ] LXFR: Primary data saved (16949 records). [2025-10-02T20:01:49.482133] [INFO ] [MAIN ] LXFR: Full history saved. [2025-10-02T20:01:49.482269] [INFO ] [MAIN ] Update Progress: 1288/2370 symbols completed. LXFR took 28.9s. Estimated remaining: 2h 32m 41s. Rate: 7.1 symbols/min [2025-10-02T20:01:49.671428] [INFO ] [MAIN ] LYB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:01:49.737040] [DEBUG] [LOCAL ] LYB: Loaded 53602 existing records from primary storage. [2025-10-02T20:01:49.737492] [INFO ] [MAIN ] LYB: Loaded 53602 existing records. [2025-10-02T20:01:49.878194] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-08. [2025-10-02T20:01:49.938676] [WARN ] [MAIN ] LYB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:01:49.938915] [INFO ] [MAIN ] LYB: Wiping existing primary data before full refresh. [2025-10-02T20:01:49.938964] [INFO ] [LOCAL ] LYB: Starting deletion of primary data. [2025-10-02T20:01:49.940080] [DEBUG] [LOCAL ] LYB: Deleted primary data file. [2025-10-02T20:01:49.940152] [INFO ] [MAIN ] LYB: Starting full primary refresh. [2025-10-02T20:01:50.359102] [INFO ] [REMOTE ] LYB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:01:50.381632] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-02T20:01:50.672986] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-07. [2025-10-02T20:01:51.472976] [INFO ] [REMOTE ] LYB: Fetching primary data for 2024-12. [2025-10-02T20:01:51.649428] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-02T20:01:51.687367] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-02T20:01:52.272999] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-08. [2025-10-02T20:01:53.072995] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-09. [2025-10-02T20:01:53.470782] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-02T20:01:53.515404] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-02T20:01:53.873021] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-05. [2025-10-02T20:01:54.672987] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-09. [2025-10-02T20:01:54.948018] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-02T20:01:55.317337] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-02T20:01:55.473005] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-06. [2025-10-02T20:01:55.516079] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-02T20:01:56.273012] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-10. [2025-10-02T20:01:57.072968] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-01. [2025-10-02T20:01:57.119256] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-02T20:01:57.220819] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-02T20:01:57.222320] [INFO ] [REMOTE ] LXU: Full fetch complete (44971 records). [2025-10-02T20:01:57.222521] [DEBUG] [VALIDATOR ] LXU: Validating primary data. [2025-10-02T20:01:57.662196] [DEBUG] [VALIDATOR ] LXU: All expected trading days are present. [2025-10-02T20:01:57.662291] [DEBUG] [VALIDATOR ] LXU: Primary data validation passed. [2025-10-02T20:01:57.663293] [INFO ] [MAIN ] LXU: Fetched primary data is valid. [2025-10-02T20:01:57.663417] [DEBUG] [LOCAL ] LXU: Saving primary data. [2025-10-02T20:01:57.664591] [DEBUG] [LOCAL ] LXU: Trimmed 44971 records to 31890 (keeping 200 days of data) [2025-10-02T20:01:57.859534] [DEBUG] [LOCAL ] LXU: Primary data saved (31890 records). [2025-10-02T20:01:57.859722] [INFO ] [MAIN ] LXU: Full history saved. [2025-10-02T20:01:57.859823] [INFO ] [MAIN ] Update Progress: 1289/2370 symbols completed. LXU took 22.7s. Estimated remaining: 2h 32m 33s. Rate: 7.1 symbols/min [2025-10-02T20:01:57.878158] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-07. [2025-10-02T20:01:58.058790] [INFO ] [MAIN ] LYG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:01:58.116502] [DEBUG] [LOCAL ] LYG: Loaded 52795 existing records from primary storage. [2025-10-02T20:01:58.116931] [INFO ] [MAIN ] LYG: Loaded 52795 existing records. [2025-10-02T20:01:58.341607] [WARN ] [MAIN ] LYG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:01:58.341878] [INFO ] [MAIN ] LYG: Wiping existing primary data before full refresh. [2025-10-02T20:01:58.341948] [INFO ] [LOCAL ] LYG: Starting deletion of primary data. [2025-10-02T20:01:58.342844] [DEBUG] [LOCAL ] LYG: Deleted primary data file. [2025-10-02T20:01:58.342925] [INFO ] [MAIN ] LYG: Starting full primary refresh. [2025-10-02T20:01:58.677766] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-10. [2025-10-02T20:01:58.765876] [INFO ] [REMOTE ] LYG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:01:59.053812] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-02T20:01:59.473022] [INFO ] [REMOTE ] LYG: Fetching primary data for 2024-12. [2025-10-02T20:01:59.754492] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-02T20:02:00.238743] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-02T20:02:00.240900] [INFO ] [REMOTE ] LW: Full fetch complete (74700 records). [2025-10-02T20:02:00.241000] [DEBUG] [VALIDATOR ] LW: Validating primary data. [2025-10-02T20:02:00.278122] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-08. [2025-10-02T20:02:00.676388] [DEBUG] [VALIDATOR ] LW: All expected trading days are present. [2025-10-02T20:02:00.676480] [DEBUG] [VALIDATOR ] LW: Primary data validation passed. [2025-10-02T20:02:00.677599] [INFO ] [MAIN ] LW: Fetched primary data is valid. [2025-10-02T20:02:00.677698] [DEBUG] [LOCAL ] LW: Saving primary data. [2025-10-02T20:02:00.679364] [DEBUG] [LOCAL ] LW: Trimmed 74700 records to 51548 (keeping 200 days of data) [2025-10-02T20:02:01.041182] [DEBUG] [LOCAL ] LW: Primary data saved (51548 records). [2025-10-02T20:02:01.041340] [INFO ] [MAIN ] LW: Full history saved. [2025-10-02T20:02:01.041458] [INFO ] [MAIN ] Update Progress: 1290/2370 symbols completed. LW took 42.3s. Estimated remaining: 2h 32m 20s. Rate: 7.1 symbols/min [2025-10-02T20:02:01.077064] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-02. [2025-10-02T20:02:01.262384] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-02T20:02:01.285454] [INFO ] [MAIN ] LYV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:02:01.354940] [DEBUG] [LOCAL ] LYV: Loaded 51121 existing records from primary storage. [2025-10-02T20:02:01.355373] [INFO ] [MAIN ] LYV: Loaded 51121 existing records. [2025-10-02T20:02:01.585294] [WARN ] [MAIN ] LYV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:02:01.585588] [INFO ] [MAIN ] LYV: Wiping existing primary data before full refresh. [2025-10-02T20:02:01.585679] [INFO ] [LOCAL ] LYV: Starting deletion of primary data. [2025-10-02T20:02:01.586666] [DEBUG] [LOCAL ] LYV: Deleted primary data file. [2025-10-02T20:02:01.586730] [INFO ] [MAIN ] LYV: Starting full primary refresh. [2025-10-02T20:02:01.875029] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-01. [2025-10-02T20:02:02.009050] [INFO ] [REMOTE ] LYV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:02:02.103768] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-02T20:02:02.673036] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-09. [2025-10-02T20:02:02.925587] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-02T20:02:03.304353] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-02T20:02:03.473005] [INFO ] [REMOTE ] LYV: Fetching primary data for 2024-12. [2025-10-02T20:02:04.273046] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-03. [2025-10-02T20:02:04.373624] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-02T20:02:05.072996] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-10. [2025-10-02T20:02:05.146200] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-02T20:02:05.872969] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-01. [2025-10-02T20:02:05.907334] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-02T20:02:06.673050] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-04. [2025-10-02T20:02:06.700672] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-02T20:02:06.703099] [INFO ] [REMOTE ] LXP: Full fetch complete (72626 records). [2025-10-02T20:02:06.703256] [DEBUG] [VALIDATOR ] LXP: Validating primary data. [2025-10-02T20:02:07.140249] [DEBUG] [VALIDATOR ] LXP: All expected trading days are present. [2025-10-02T20:02:07.140388] [DEBUG] [VALIDATOR ] LXP: Primary data validation passed. [2025-10-02T20:02:07.141531] [INFO ] [MAIN ] LXP: Fetched primary data is valid. [2025-10-02T20:02:07.141600] [DEBUG] [LOCAL ] LXP: Saving primary data. [2025-10-02T20:02:07.143890] [DEBUG] [LOCAL ] LXP: Trimmed 72626 records to 51071 (keeping 200 days of data) [2025-10-02T20:02:07.481752] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-02. [2025-10-02T20:02:07.500978] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-02T20:02:07.534406] [DEBUG] [LOCAL ] LXP: Primary data saved (51071 records). [2025-10-02T20:02:07.534566] [INFO ] [MAIN ] LXP: Full history saved. [2025-10-02T20:02:07.534695] [INFO ] [MAIN ] Update Progress: 1291/2370 symbols completed. LXP took 40.3s. Estimated remaining: 2h 32m 10s. Rate: 7.1 symbols/min [2025-10-02T20:02:07.730081] [INFO ] [MAIN ] LZB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:02:07.772551] [DEBUG] [LOCAL ] LZB: Loaded 35517 existing records from primary storage. [2025-10-02T20:02:07.772924] [INFO ] [MAIN ] LZB: Loaded 35517 existing records. [2025-10-02T20:02:07.973392] [WARN ] [MAIN ] LZB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:02:07.973669] [INFO ] [MAIN ] LZB: Wiping existing primary data before full refresh. [2025-10-02T20:02:07.973775] [INFO ] [LOCAL ] LZB: Starting deletion of primary data. [2025-10-02T20:02:07.974480] [DEBUG] [LOCAL ] LZB: Deleted primary data file. [2025-10-02T20:02:07.974545] [INFO ] [MAIN ] LZB: Starting full primary refresh. [2025-10-02T20:02:08.278264] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-02. [2025-10-02T20:02:08.391036] [INFO ] [REMOTE ] LZB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:02:08.709167] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-02T20:02:09.072983] [INFO ] [REMOTE ] LZB: Fetching primary data for 2024-12. [2025-10-02T20:02:09.447675] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-02T20:02:09.872976] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-03. [2025-10-02T20:02:09.984810] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-02T20:02:10.328699] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-02T20:02:10.672996] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-01. [2025-10-02T20:02:11.472975] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-03. [2025-10-02T20:02:11.583761] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-02T20:02:12.054071] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-02T20:02:12.273025] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-04. [2025-10-02T20:02:13.072993] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-05. [2025-10-02T20:02:13.457752] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-02T20:02:13.759217] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-02T20:02:13.873015] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-05. [2025-10-02T20:02:14.647161] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-02T20:02:14.673009] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-06. [2025-10-02T20:02:15.473030] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-04. [2025-10-02T20:02:15.663468] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-02T20:02:16.273050] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-06. [2025-10-02T20:02:16.540972] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-02T20:02:16.990463] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-02T20:02:17.073002] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-05. [2025-10-02T20:02:17.872997] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-07. [2025-10-02T20:02:17.995064] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-02T20:02:18.665144] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-02T20:02:18.675740] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-07. [2025-10-02T20:02:19.473014] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-02. [2025-10-02T20:02:19.855134] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-02T20:02:20.273042] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-06. [2025-10-02T20:02:20.554275] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-02T20:02:20.691707] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-02T20:02:21.073017] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-08. [2025-10-02T20:02:21.873000] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-08. [2025-10-02T20:02:21.996135] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-02T20:02:22.673002] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-07. [2025-10-02T20:02:22.926387] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-02T20:02:23.473065] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-09. [2025-10-02T20:02:23.817449] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-02T20:02:24.273050] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-03. [2025-10-02T20:02:24.538862] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-02T20:02:24.978494] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-02T20:02:25.073067] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-08. [2025-10-02T20:02:25.676303] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-02T20:02:25.872986] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-10. [2025-10-02T20:02:26.673054] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-09. [2025-10-02T20:02:26.895625] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-02T20:02:27.336056] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-02T20:02:27.338692] [INFO ] [REMOTE ] LYG: Full fetch complete (76046 records). [2025-10-02T20:02:27.339050] [DEBUG] [VALIDATOR ] LYG: Validating primary data. [2025-10-02T20:02:27.481164] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-04. [2025-10-02T20:02:27.882509] [DEBUG] [VALIDATOR ] LYG: All expected trading days are present. [2025-10-02T20:02:27.882600] [DEBUG] [VALIDATOR ] LYG: Primary data validation passed. [2025-10-02T20:02:27.883726] [INFO ] [MAIN ] LYG: Fetched primary data is valid. [2025-10-02T20:02:27.883793] [DEBUG] [LOCAL ] LYG: Saving primary data. [2025-10-02T20:02:27.888461] [DEBUG] [LOCAL ] LYG: Trimmed 76046 records to 53179 (keeping 200 days of data) [2025-10-02T20:02:28.228443] [DEBUG] [LOCAL ] LYG: Primary data saved (53179 records). [2025-10-02T20:02:28.228605] [INFO ] [MAIN ] LYG: Full history saved. [2025-10-02T20:02:28.228774] [INFO ] [MAIN ] Update Progress: 1292/2370 symbols completed. LYG took 30.4s. Estimated remaining: 2h 32m 12s. Rate: 7.1 symbols/min [2025-10-02T20:02:28.282420] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-09. [2025-10-02T20:02:28.448635] [INFO ] [MAIN ] LZM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:02:28.474546] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-02T20:02:28.500822] [DEBUG] [LOCAL ] LZM: Loaded 13976 existing records from primary storage. [2025-10-02T20:02:28.501080] [INFO ] [MAIN ] LZM: Loaded 13976 existing records. [2025-10-02T20:02:28.702711] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-02T20:02:28.766755] [WARN ] [MAIN ] LZM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:02:28.767715] [INFO ] [MAIN ] LZM: Wiping existing primary data before full refresh. [2025-10-02T20:02:28.767802] [INFO ] [LOCAL ] LZM: Starting deletion of primary data. [2025-10-02T20:02:28.768615] [DEBUG] [LOCAL ] LZM: Deleted primary data file. [2025-10-02T20:02:28.768719] [INFO ] [MAIN ] LZM: Starting full primary refresh. [2025-10-02T20:02:29.078306] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-10. [2025-10-02T20:02:29.249120] [INFO ] [REMOTE ] LZM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:02:29.873002] [INFO ] [REMOTE ] LZM: Fetching primary data for 2024-12. [2025-10-02T20:02:30.139298] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-02T20:02:30.622159] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-02T20:02:30.673002] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-10. [2025-10-02T20:02:30.875179] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-02T20:02:30.878104] [INFO ] [REMOTE ] LYB: Full fetch complete (77459 records). [2025-10-02T20:02:30.878255] [DEBUG] [VALIDATOR ] LYB: Validating primary data. [2025-10-02T20:02:31.299635] [DEBUG] [VALIDATOR ] LYB: All expected trading days are present. [2025-10-02T20:02:31.299759] [DEBUG] [VALIDATOR ] LYB: Primary data validation passed. [2025-10-02T20:02:31.300935] [INFO ] [MAIN ] LYB: Fetched primary data is valid. [2025-10-02T20:02:31.301046] [DEBUG] [LOCAL ] LYB: Saving primary data. [2025-10-02T20:02:31.302797] [DEBUG] [LOCAL ] LYB: Trimmed 77459 records to 53992 (keeping 200 days of data) [2025-10-02T20:02:31.500863] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-05. [2025-10-02T20:02:31.667878] [DEBUG] [LOCAL ] LYB: Primary data saved (53992 records). [2025-10-02T20:02:31.668029] [INFO ] [MAIN ] LYB: Full history saved. [2025-10-02T20:02:31.668114] [INFO ] [MAIN ] Update Progress: 1293/2370 symbols completed. LYB took 42.2s. Estimated remaining: 2h 31m 59s. Rate: 7.1 symbols/min [2025-10-02T20:02:31.864112] [INFO ] [MAIN ] M: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:02:31.925693] [DEBUG] [LOCAL ] M: Loaded 53535 existing records from primary storage. [2025-10-02T20:02:31.926091] [INFO ] [MAIN ] M: Loaded 53535 existing records. [2025-10-02T20:02:32.140803] [WARN ] [MAIN ] M: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:02:32.141017] [INFO ] [MAIN ] M: Wiping existing primary data before full refresh. [2025-10-02T20:02:32.141085] [INFO ] [LOCAL ] M: Starting deletion of primary data. [2025-10-02T20:02:32.142270] [DEBUG] [LOCAL ] M: Deleted primary data file. [2025-10-02T20:02:32.142336] [INFO ] [MAIN ] M: Starting full primary refresh. [2025-10-02T20:02:32.278370] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-01. [2025-10-02T20:02:32.353841] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-02T20:02:32.399121] [INFO ] [REMOTE ] LYV: Full fetch complete (73734 records). [2025-10-02T20:02:32.405134] [DEBUG] [VALIDATOR ] LYV: Validating primary data. [2025-10-02T20:02:32.692209] [INFO ] [REMOTE ] M: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:02:32.968074] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-02T20:02:33.079252] [INFO ] [REMOTE ] M: Fetching primary data for 2024-12. [2025-10-02T20:02:33.083636] [DEBUG] [VALIDATOR ] LYV: All expected trading days are present. [2025-10-02T20:02:33.091772] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-02T20:02:33.091962] [DEBUG] [VALIDATOR ] LYV: Primary data validation passed. [2025-10-02T20:02:33.095557] [INFO ] [MAIN ] LYV: Fetched primary data is valid. [2025-10-02T20:02:33.096718] [DEBUG] [LOCAL ] LYV: Saving primary data. [2025-10-02T20:02:33.098243] [DEBUG] [LOCAL ] LYV: Trimmed 73734 records to 51500 (keeping 200 days of data) [2025-10-02T20:02:33.446775] [DEBUG] [LOCAL ] LYV: Primary data saved (51500 records). [2025-10-02T20:02:33.446969] [INFO ] [MAIN ] LYV: Full history saved. [2025-10-02T20:02:33.447091] [INFO ] [MAIN ] Update Progress: 1294/2370 symbols completed. LYV took 32.4s. Estimated remaining: 2h 31m 45s. Rate: 7.1 symbols/min [2025-10-02T20:02:33.650120] [INFO ] [MAIN ] MA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:02:33.712369] [DEBUG] [LOCAL ] MA: Loaded 52525 existing records from primary storage. [2025-10-02T20:02:33.712729] [INFO ] [MAIN ] MA: Loaded 52525 existing records. [2025-10-02T20:02:33.878077] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-02. [2025-10-02T20:02:33.918409] [WARN ] [MAIN ] MA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:02:33.918834] [INFO ] [MAIN ] MA: Wiping existing primary data before full refresh. [2025-10-02T20:02:33.918929] [INFO ] [LOCAL ] MA: Starting deletion of primary data. [2025-10-02T20:02:33.919790] [DEBUG] [LOCAL ] MA: Deleted primary data file. [2025-10-02T20:02:33.919884] [INFO ] [MAIN ] MA: Starting full primary refresh. [2025-10-02T20:02:34.326860] [INFO ] [REMOTE ] MA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:02:34.576719] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-02T20:02:34.672999] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-03. [2025-10-02T20:02:35.078872] [INFO ] [REMOTE ] M: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-02T20:02:35.297352] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-02T20:02:35.473039] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-06. [2025-10-02T20:02:36.273012] [INFO ] [REMOTE ] MA: Fetching primary data for 2024-12. [2025-10-02T20:02:36.851155] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-02T20:02:37.073016] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-04. [2025-10-02T20:02:37.873009] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-07. [2025-10-02T20:02:38.106267] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-02T20:02:38.142291] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-02T20:02:38.673013] [INFO ] [REMOTE ] M: Fetching primary data for 2025-01. [2025-10-02T20:02:39.179814] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-02T20:02:39.473055] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-08. [2025-10-02T20:02:40.273057] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-01. [2025-10-02T20:02:40.568863] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-02T20:02:40.939995] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-02T20:02:41.073024] [INFO ] [REMOTE ] M: Fetching primary data for 2025-02. [2025-10-02T20:02:41.873016] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-09. [2025-10-02T20:02:42.463519] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-02T20:02:42.673006] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-05. [2025-10-02T20:02:42.918942] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-02T20:02:43.417798] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-02T20:02:43.461333] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-02T20:02:43.472950] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-06. [2025-10-02T20:02:44.200443] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-02T20:02:44.273022] [INFO ] [REMOTE ] M: Fetching primary data for 2025-03. [2025-10-02T20:02:45.073027] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-02. [2025-10-02T20:02:45.873015] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-07. [2025-10-02T20:02:46.036493] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-02T20:02:46.672970] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-10. [2025-10-02T20:02:46.682405] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-02T20:02:46.870029] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-02T20:02:47.473033] [INFO ] [REMOTE ] M: Fetching primary data for 2025-04. [2025-10-02T20:02:47.785823] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-02T20:02:47.787545] [INFO ] [REMOTE ] LZB: Full fetch complete (50564 records). [2025-10-02T20:02:47.787710] [DEBUG] [VALIDATOR ] LZB: Validating primary data. [2025-10-02T20:02:48.234531] [DEBUG] [VALIDATOR ] LZB: All expected trading days are present. [2025-10-02T20:02:48.234627] [DEBUG] [VALIDATOR ] LZB: Primary data validation passed. [2025-10-02T20:02:48.235561] [INFO ] [MAIN ] LZB: Fetched primary data is valid. [2025-10-02T20:02:48.235621] [DEBUG] [LOCAL ] LZB: Saving primary data. [2025-10-02T20:02:48.236972] [DEBUG] [LOCAL ] LZB: Trimmed 50564 records to 35687 (keeping 200 days of data) [2025-10-02T20:02:48.293038] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-03. [2025-10-02T20:02:48.473468] [DEBUG] [LOCAL ] LZB: Primary data saved (35687 records). [2025-10-02T20:02:48.473664] [INFO ] [MAIN ] LZB: Full history saved. [2025-10-02T20:02:48.473782] [INFO ] [MAIN ] Update Progress: 1295/2370 symbols completed. LZB took 40.9s. Estimated remaining: 2h 31m 42s. Rate: 7.1 symbols/min [2025-10-02T20:02:48.669094] [INFO ] [MAIN ] MAA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:02:48.720722] [DEBUG] [LOCAL ] MAA: Loaded 42625 existing records from primary storage. [2025-10-02T20:02:48.721076] [INFO ] [MAIN ] MAA: Loaded 42625 existing records. [2025-10-02T20:02:48.924633] [WARN ] [MAIN ] MAA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:02:48.924892] [INFO ] [MAIN ] MAA: Wiping existing primary data before full refresh. [2025-10-02T20:02:48.924946] [INFO ] [LOCAL ] MAA: Starting deletion of primary data. [2025-10-02T20:02:48.925945] [DEBUG] [LOCAL ] MAA: Deleted primary data file. [2025-10-02T20:02:48.926021] [INFO ] [MAIN ] MAA: Starting full primary refresh. [2025-10-02T20:02:49.078145] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-08. [2025-10-02T20:02:49.379187] [INFO ] [REMOTE ] MAA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:02:49.458033] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-02T20:02:49.872973] [INFO ] [REMOTE ] MAA: Fetching primary data for 2024-12. [2025-10-02T20:02:49.959286] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-02T20:02:50.037069] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-02T20:02:50.672992] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-04. [2025-10-02T20:02:51.044701] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-02T20:02:51.472991] [INFO ] [REMOTE ] M: Fetching primary data for 2025-05. [2025-10-02T20:02:52.272973] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-09. [2025-10-02T20:02:52.362352] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-02T20:02:53.073008] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-05. [2025-10-02T20:02:53.268348] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-02T20:02:53.521351] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-02T20:02:53.872980] [INFO ] [REMOTE ] M: Fetching primary data for 2025-06. [2025-10-02T20:02:54.673009] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-10. [2025-10-02T20:02:54.923512] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-02T20:02:55.472986] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-06. [2025-10-02T20:02:55.516675] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-02T20:02:55.518533] [INFO ] [REMOTE ] LZM: Full fetch complete (18421 records). [2025-10-02T20:02:55.518860] [DEBUG] [VALIDATOR ] LZM: Validating primary data. [2025-10-02T20:02:55.928697] [DEBUG] [VALIDATOR ] LZM: All expected trading days are present. [2025-10-02T20:02:55.928895] [DEBUG] [VALIDATOR ] LZM: Primary data validation passed. [2025-10-02T20:02:55.929474] [INFO ] [MAIN ] LZM: Fetched primary data is valid. [2025-10-02T20:02:55.929662] [DEBUG] [LOCAL ] LZM: Saving primary data. [2025-10-02T20:02:55.930592] [DEBUG] [LOCAL ] LZM: Trimmed 18421 records to 14138 (keeping 200 days of data) [2025-10-02T20:02:56.021146] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-02T20:02:56.055683] [DEBUG] [LOCAL ] LZM: Primary data saved (14138 records). [2025-10-02T20:02:56.055837] [INFO ] [MAIN ] LZM: Full history saved. [2025-10-02T20:02:56.055927] [INFO ] [MAIN ] Update Progress: 1296/2370 symbols completed. LZM took 27.8s. Estimated remaining: 2h 31m 33s. Rate: 7.1 symbols/min [2025-10-02T20:02:56.234002] [INFO ] [MAIN ] MAC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:02:56.280457] [INFO ] [REMOTE ] M: Fetching primary data for 2025-07. [2025-10-02T20:02:56.283716] [DEBUG] [LOCAL ] MAC: Loaded 49670 existing records from primary storage. [2025-10-02T20:02:56.284148] [INFO ] [MAIN ] MAC: Loaded 49670 existing records. [2025-10-02T20:02:56.474110] [WARN ] [MAIN ] MAC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:02:56.474332] [INFO ] [MAIN ] MAC: Wiping existing primary data before full refresh. [2025-10-02T20:02:56.474383] [INFO ] [LOCAL ] MAC: Starting deletion of primary data. [2025-10-02T20:02:56.475267] [DEBUG] [LOCAL ] MAC: Deleted primary data file. [2025-10-02T20:02:56.475331] [INFO ] [MAIN ] MAC: Starting full primary refresh. [2025-10-02T20:02:56.861927] [INFO ] [REMOTE ] MAC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:02:57.073017] [INFO ] [REMOTE ] MAC: Fetching primary data for 2024-12. [2025-10-02T20:02:57.188277] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-02T20:02:57.873006] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-07. [2025-10-02T20:02:58.329500] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-02T20:02:58.622570] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-02T20:02:58.673024] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-01. [2025-10-02T20:02:59.472973] [INFO ] [REMOTE ] M: Fetching primary data for 2025-08. [2025-10-02T20:02:59.914680] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-02T20:02:59.994055] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-02T20:03:00.273066] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-01. [2025-10-02T20:03:01.073003] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-08. [2025-10-02T20:03:01.411915] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-02T20:03:01.453484] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-02T20:03:01.872985] [INFO ] [REMOTE ] M: Fetching primary data for 2025-09. [2025-10-02T20:03:02.673005] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-02. [2025-10-02T20:03:02.929891] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-02T20:03:03.472987] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-09. [2025-10-02T20:03:03.784832] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-02T20:03:04.193476] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-02T20:03:04.273019] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-03. [2025-10-02T20:03:05.078141] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-02. [2025-10-02T20:03:05.101457] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-02T20:03:05.872988] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-10. [2025-10-02T20:03:06.156526] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-02T20:03:06.651784] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-02T20:03:06.673013] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-03. [2025-10-02T20:03:07.364382] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-02T20:03:07.367417] [INFO ] [REMOTE ] MA: Full fetch complete (76247 records). [2025-10-02T20:03:07.367595] [DEBUG] [VALIDATOR ] MA: Validating primary data. [2025-10-02T20:03:07.480489] [INFO ] [REMOTE ] M: Fetching primary data for 2025-10. [2025-10-02T20:03:07.828419] [DEBUG] [VALIDATOR ] MA: All expected trading days are present. [2025-10-02T20:03:07.828513] [DEBUG] [VALIDATOR ] MA: Primary data validation passed. [2025-10-02T20:03:07.829697] [INFO ] [MAIN ] MA: Fetched primary data is valid. [2025-10-02T20:03:07.829780] [DEBUG] [LOCAL ] MA: Saving primary data. [2025-10-02T20:03:07.831503] [DEBUG] [LOCAL ] MA: Trimmed 76247 records to 52903 (keeping 200 days of data) [2025-10-02T20:03:08.195835] [DEBUG] [LOCAL ] MA: Primary data saved (52903 records). [2025-10-02T20:03:08.195987] [INFO ] [MAIN ] MA: Full history saved. [2025-10-02T20:03:08.197294] [INFO ] [MAIN ] Update Progress: 1297/2370 symbols completed. MA took 34.8s. Estimated remaining: 2h 31m 27s. Rate: 7.1 symbols/min [2025-10-02T20:03:08.278952] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-04. [2025-10-02T20:03:08.407555] [INFO ] [MAIN ] MAGN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:03:08.435086] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-02T20:03:08.480241] [DEBUG] [LOCAL ] MAGN: Loaded 34828 existing records from primary storage. [2025-10-02T20:03:08.480560] [INFO ] [MAIN ] MAGN: Loaded 34828 existing records. [2025-10-02T20:03:08.685739] [WARN ] [MAIN ] MAGN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:03:08.685982] [INFO ] [MAIN ] MAGN: Wiping existing primary data before full refresh. [2025-10-02T20:03:08.686033] [INFO ] [LOCAL ] MAGN: Starting deletion of primary data. [2025-10-02T20:03:08.686802] [DEBUG] [LOCAL ] MAGN: Deleted primary data file. [2025-10-02T20:03:08.686864] [INFO ] [MAIN ] MAGN: Starting full primary refresh. [2025-10-02T20:03:09.073937] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-04. [2025-10-02T20:03:09.114617] [INFO ] [REMOTE ] MAGN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:03:09.116090] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-02T20:03:09.120107] [INFO ] [REMOTE ] M: Full fetch complete (77519 records). [2025-10-02T20:03:09.120296] [DEBUG] [VALIDATOR ] M: Validating primary data. [2025-10-02T20:03:09.624974] [DEBUG] [VALIDATOR ] M: All expected trading days are present. [2025-10-02T20:03:09.625176] [DEBUG] [VALIDATOR ] M: Primary data validation passed. [2025-10-02T20:03:09.626385] [INFO ] [MAIN ] M: Fetched primary data is valid. [2025-10-02T20:03:09.626523] [DEBUG] [LOCAL ] M: Saving primary data. [2025-10-02T20:03:09.628777] [DEBUG] [LOCAL ] M: Trimmed 77519 records to 53924 (keeping 200 days of data) [2025-10-02T20:03:09.876790] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2024-12. [2025-10-02T20:03:09.910812] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-02T20:03:10.052346] [DEBUG] [LOCAL ] M: Primary data saved (53924 records). [2025-10-02T20:03:10.052495] [INFO ] [MAIN ] M: Full history saved. [2025-10-02T20:03:10.052579] [INFO ] [MAIN ] Update Progress: 1298/2370 symbols completed. M took 38.4s. Estimated remaining: 2h 31m 13s. Rate: 7.1 symbols/min [2025-10-02T20:03:10.253372] [INFO ] [MAIN ] MAIN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:03:10.511592] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-02T20:03:10.672994] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-05. [2025-10-02T20:03:10.878976] [DEBUG] [LOCAL ] MAIN: Loaded 41168 existing records from primary storage. [2025-10-02T20:03:10.879455] [INFO ] [MAIN ] MAIN: Loaded 41168 existing records. [2025-10-02T20:03:11.094566] [WARN ] [MAIN ] MAIN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:03:11.094948] [INFO ] [MAIN ] MAIN: Wiping existing primary data before full refresh. [2025-10-02T20:03:11.095144] [INFO ] [LOCAL ] MAIN: Starting deletion of primary data. [2025-10-02T20:03:11.096165] [DEBUG] [LOCAL ] MAIN: Deleted primary data file. [2025-10-02T20:03:11.096234] [INFO ] [MAIN ] MAIN: Starting full primary refresh. [2025-10-02T20:03:11.189876] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-02T20:03:11.478183] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-05. [2025-10-02T20:03:11.547249] [INFO ] [REMOTE ] MAIN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:03:11.957120] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-02T20:03:12.273006] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-01. [2025-10-02T20:03:13.015849] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-02T20:03:13.073045] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2024-12. [2025-10-02T20:03:13.569118] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-02T20:03:13.873061] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-06. [2025-10-02T20:03:14.673109] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-06. [2025-10-02T20:03:14.800985] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-02T20:03:15.384232] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-02T20:03:15.473041] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-02. [2025-10-02T20:03:15.957705] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-02T20:03:16.273088] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-07. [2025-10-02T20:03:16.835113] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-02T20:03:17.073051] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-03. [2025-10-02T20:03:17.679246] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-02T20:03:17.873013] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-08. [2025-10-02T20:03:18.489851] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-02T20:03:18.673232] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-07. [2025-10-02T20:03:19.473049] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-04. [2025-10-02T20:03:19.650254] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-02T20:03:20.305698] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-09. [2025-10-02T20:03:20.329396] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-02T20:03:20.696512] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-02T20:03:21.073063] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-05. [2025-10-02T20:03:21.872972] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-08. [2025-10-02T20:03:22.273990] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-02T20:03:22.309884] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-02T20:03:22.673002] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-06. [2025-10-02T20:03:23.472343] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-02T20:03:23.476383] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-10. [2025-10-02T20:03:24.072148] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-02T20:03:24.273017] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-01. [2025-10-02T20:03:24.964878] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-02T20:03:24.966867] [INFO ] [REMOTE ] MAC: Full fetch complete (71441 records). [2025-10-02T20:03:24.966977] [DEBUG] [VALIDATOR ] MAC: Validating primary data. [2025-10-02T20:03:25.078127] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-07. [2025-10-02T20:03:25.476542] [DEBUG] [VALIDATOR ] MAC: All expected trading days are present. [2025-10-02T20:03:25.476819] [DEBUG] [VALIDATOR ] MAC: Primary data validation passed. [2025-10-02T20:03:25.477929] [INFO ] [MAIN ] MAC: Fetched primary data is valid. [2025-10-02T20:03:25.478018] [DEBUG] [LOCAL ] MAC: Saving primary data. [2025-10-02T20:03:25.479760] [DEBUG] [LOCAL ] MAC: Trimmed 71441 records to 50021 (keeping 200 days of data) [2025-10-02T20:03:25.817099] [DEBUG] [LOCAL ] MAC: Primary data saved (50021 records). [2025-10-02T20:03:25.817249] [INFO ] [MAIN ] MAC: Full history saved. [2025-10-02T20:03:25.817379] [INFO ] [MAIN ] Update Progress: 1299/2370 symbols completed. MAC took 29.8s. Estimated remaining: 2h 31m 11s. Rate: 7.1 symbols/min [2025-10-02T20:03:25.880587] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-09. [2025-10-02T20:03:26.024431] [INFO ] [MAIN ] MAN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:03:26.053668] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-02T20:03:26.101726] [DEBUG] [LOCAL ] MAN: Loaded 43461 existing records from primary storage. [2025-10-02T20:03:26.102172] [INFO ] [MAIN ] MAN: Loaded 43461 existing records. [2025-10-02T20:03:26.318078] [WARN ] [MAIN ] MAN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:03:26.318714] [INFO ] [MAIN ] MAN: Wiping existing primary data before full refresh. [2025-10-02T20:03:26.318879] [INFO ] [LOCAL ] MAN: Starting deletion of primary data. [2025-10-02T20:03:26.328411] [DEBUG] [LOCAL ] MAN: Deleted primary data file. [2025-10-02T20:03:26.344602] [INFO ] [MAIN ] MAN: Starting full primary refresh. [2025-10-02T20:03:26.411633] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-02T20:03:26.677218] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-02. [2025-10-02T20:03:26.768842] [INFO ] [REMOTE ] MAN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:03:27.454375] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-02T20:03:27.472969] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-10. [2025-10-02T20:03:28.046300] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-02T20:03:28.273052] [INFO ] [REMOTE ] MAN: Fetching primary data for 2024-12. [2025-10-02T20:03:28.751093] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-02T20:03:28.753093] [INFO ] [REMOTE ] MAA: Full fetch complete (61087 records). [2025-10-02T20:03:28.753378] [DEBUG] [VALIDATOR ] MAA: Validating primary data. [2025-10-02T20:03:29.079387] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-03. [2025-10-02T20:03:29.182116] [DEBUG] [VALIDATOR ] MAA: All expected trading days are present. [2025-10-02T20:03:29.182209] [DEBUG] [VALIDATOR ] MAA: Primary data validation passed. [2025-10-02T20:03:29.183367] [INFO ] [MAIN ] MAA: Fetched primary data is valid. [2025-10-02T20:03:29.183435] [DEBUG] [LOCAL ] MAA: Saving primary data. [2025-10-02T20:03:29.185007] [DEBUG] [LOCAL ] MAA: Trimmed 61087 records to 42948 (keeping 200 days of data) [2025-10-02T20:03:29.496175] [DEBUG] [LOCAL ] MAA: Primary data saved (42948 records). [2025-10-02T20:03:29.496335] [INFO ] [MAIN ] MAA: Full history saved. [2025-10-02T20:03:29.496424] [INFO ] [MAIN ] Update Progress: 1300/2370 symbols completed. MAA took 41.0s. Estimated remaining: 2h 30m 59s. Rate: 7.1 symbols/min [2025-10-02T20:03:29.737285] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-02T20:03:29.785721] [INFO ] [MAIN ] MANU: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:03:29.830171] [DEBUG] [LOCAL ] MANU: Loaded 26805 existing records from primary storage. [2025-10-02T20:03:29.830502] [INFO ] [MAIN ] MANU: Loaded 26805 existing records. [2025-10-02T20:03:29.878165] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-08. [2025-10-02T20:03:30.051382] [WARN ] [MAIN ] MANU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:03:30.051713] [INFO ] [MAIN ] MANU: Wiping existing primary data before full refresh. [2025-10-02T20:03:30.051773] [INFO ] [LOCAL ] MANU: Starting deletion of primary data. [2025-10-02T20:03:30.052264] [DEBUG] [LOCAL ] MANU: Deleted primary data file. [2025-10-02T20:03:30.052327] [INFO ] [MAIN ] MANU: Starting full primary refresh. [2025-10-02T20:03:30.468317] [INFO ] [REMOTE ] MANU: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:03:30.672982] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-01. [2025-10-02T20:03:30.879261] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-02T20:03:31.269589] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-02T20:03:31.473036] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-09. [2025-10-02T20:03:32.273038] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-04. [2025-10-02T20:03:32.572785] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-02T20:03:32.845927] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-02T20:03:33.073003] [INFO ] [REMOTE ] MANU: Fetching primary data for 2024-12. [2025-10-02T20:03:33.826081] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-02T20:03:33.872967] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-05. [2025-10-02T20:03:34.236275] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-02T20:03:34.673012] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-02. [2025-10-02T20:03:35.473052] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-01. [2025-10-02T20:03:35.514987] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-02T20:03:35.674459] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-02T20:03:36.273040] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-03. [2025-10-02T20:03:36.634175] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-02T20:03:37.073018] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-02. [2025-10-02T20:03:37.843512] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-02T20:03:37.872963] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-04. [2025-10-02T20:03:38.190290] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-02T20:03:38.673020] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-10. [2025-10-02T20:03:39.358821] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-02T20:03:39.473004] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-05. [2025-10-02T20:03:39.939957] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-02T20:03:39.942603] [INFO ] [REMOTE ] MAGN: Full fetch complete (51051 records). [2025-10-02T20:03:39.942827] [DEBUG] [VALIDATOR ] MAGN: Validating primary data. [2025-10-02T20:03:40.279290] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-03. [2025-10-02T20:03:40.431810] [DEBUG] [VALIDATOR ] MAGN: All expected trading days are present. [2025-10-02T20:03:40.431896] [DEBUG] [VALIDATOR ] MAGN: Primary data validation passed. [2025-10-02T20:03:40.433015] [INFO ] [MAIN ] MAGN: Fetched primary data is valid. [2025-10-02T20:03:40.433114] [DEBUG] [LOCAL ] MAGN: Saving primary data. [2025-10-02T20:03:40.434394] [DEBUG] [LOCAL ] MAGN: Trimmed 51051 records to 35225 (keeping 200 days of data) [2025-10-02T20:03:40.666952] [DEBUG] [LOCAL ] MAGN: Primary data saved (35225 records). [2025-10-02T20:03:40.667106] [INFO ] [MAIN ] MAGN: Full history saved. [2025-10-02T20:03:40.667316] [INFO ] [MAIN ] Update Progress: 1301/2370 symbols completed. MAGN took 32.5s. Estimated remaining: 2h 30m 52s. Rate: 7.1 symbols/min [2025-10-02T20:03:40.866955] [INFO ] [MAIN ] MAS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:03:40.923818] [DEBUG] [LOCAL ] MAS: Loaded 52326 existing records from primary storage. [2025-10-02T20:03:40.924189] [INFO ] [MAIN ] MAS: Loaded 52326 existing records. [2025-10-02T20:03:41.076787] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-06. [2025-10-02T20:03:41.175152] [WARN ] [MAIN ] MAS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:03:41.170286] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-02T20:03:41.188407] [INFO ] [MAIN ] MAS: Wiping existing primary data before full refresh. [2025-10-02T20:03:41.189048] [INFO ] [LOCAL ] MAS: Starting deletion of primary data. [2025-10-02T20:03:41.190511] [DEBUG] [LOCAL ] MAS: Deleted primary data file. [2025-10-02T20:03:41.190624] [INFO ] [MAIN ] MAS: Starting full primary refresh. [2025-10-02T20:03:41.607389] [INFO ] [REMOTE ] MAS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:03:41.717071] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-02T20:03:41.872995] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-06. [2025-10-02T20:03:42.673006] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-04. [2025-10-02T20:03:42.922521] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-02T20:03:43.050922] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-02T20:03:43.473010] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-07. [2025-10-02T20:03:43.801230] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-02T20:03:44.273004] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-07. [2025-10-02T20:03:45.073002] [INFO ] [REMOTE ] MAS: Fetching primary data for 2024-12. [2025-10-02T20:03:45.185858] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-02T20:03:45.872997] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-05. [2025-10-02T20:03:46.074749] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-02T20:03:46.682027] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-08. [2025-10-02T20:03:46.685252] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-02T20:03:46.738941] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-02T20:03:47.473003] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-08. [2025-10-02T20:03:48.257972] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-02T20:03:48.272986] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-09. [2025-10-02T20:03:49.073002] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-01. [2025-10-02T20:03:49.275337] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-02T20:03:49.870277] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-02T20:03:49.879321] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-06. [2025-10-02T20:03:50.413065] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-02T20:03:50.673035] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-10. [2025-10-02T20:03:51.012340] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-02T20:03:51.473060] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-07. [2025-10-02T20:03:51.912957] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-02T20:03:51.914843] [INFO ] [REMOTE ] MAN: Full fetch complete (62140 records). [2025-10-02T20:03:51.914975] [DEBUG] [VALIDATOR ] MAN: Validating primary data. [2025-10-02T20:03:52.282289] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-02. [2025-10-02T20:03:52.345289] [DEBUG] [VALIDATOR ] MAN: All expected trading days are present. [2025-10-02T20:03:52.345380] [DEBUG] [VALIDATOR ] MAN: Primary data validation passed. [2025-10-02T20:03:52.346689] [INFO ] [MAIN ] MAN: Fetched primary data is valid. [2025-10-02T20:03:52.346790] [DEBUG] [LOCAL ] MAN: Saving primary data. [2025-10-02T20:03:52.348537] [DEBUG] [LOCAL ] MAN: Trimmed 62140 records to 43848 (keeping 200 days of data) [2025-10-02T20:03:52.643297] [DEBUG] [LOCAL ] MAN: Primary data saved (43848 records). [2025-10-02T20:03:52.643462] [INFO ] [MAIN ] MAN: Full history saved. [2025-10-02T20:03:52.643689] [INFO ] [MAIN ] Update Progress: 1302/2370 symbols completed. MAN took 26.8s. Estimated remaining: 2h 30m 47s. Rate: 7.1 symbols/min [2025-10-02T20:03:52.835431] [INFO ] [MAIN ] MATV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:03:52.855240] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-02T20:03:52.897368] [DEBUG] [LOCAL ] MATV: Loaded 36693 existing records from primary storage. [2025-10-02T20:03:52.897717] [INFO ] [MAIN ] MATV: Loaded 36693 existing records. [2025-10-02T20:03:53.087204] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-09. [2025-10-02T20:03:53.111400] [WARN ] [MAIN ] MATV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:03:53.112716] [INFO ] [MAIN ] MATV: Wiping existing primary data before full refresh. [2025-10-02T20:03:53.112782] [INFO ] [LOCAL ] MATV: Starting deletion of primary data. [2025-10-02T20:03:53.113757] [DEBUG] [LOCAL ] MATV: Deleted primary data file. [2025-10-02T20:03:53.113820] [INFO ] [MAIN ] MATV: Starting full primary refresh. [2025-10-02T20:03:53.543613] [INFO ] [REMOTE ] MATV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:03:53.872987] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-08. [2025-10-02T20:03:53.979565] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-02T20:03:54.672983] [INFO ] [REMOTE ] MATV: Fetching primary data for 2024-12. [2025-10-02T20:03:54.890524] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-02T20:03:54.922362] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-02T20:03:55.473023] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-09. [2025-10-02T20:03:55.661943] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-02T20:03:56.273013] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-10. [2025-10-02T20:03:56.906204] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-02T20:03:57.073019] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-10. [2025-10-02T20:03:57.694495] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-02T20:03:57.696596] [INFO ] [REMOTE ] MAIN: Full fetch complete (59802 records). [2025-10-02T20:03:57.696778] [DEBUG] [VALIDATOR ] MAIN: Validating primary data. [2025-10-02T20:03:57.898316] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-03. [2025-10-02T20:03:58.149358] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-02T20:03:58.192370] [INFO ] [REMOTE ] MANU: Full fetch complete (38223 records). [2025-10-02T20:03:58.192672] [DEBUG] [VALIDATOR ] MAIN: All expected trading days are present. [2025-10-02T20:03:58.192781] [DEBUG] [VALIDATOR ] MANU: Validating primary data. [2025-10-02T20:03:58.193064] [DEBUG] [VALIDATOR ] MAIN: Primary data validation passed. [2025-10-02T20:03:58.194318] [INFO ] [MAIN ] MAIN: Fetched primary data is valid. [2025-10-02T20:03:58.194481] [DEBUG] [LOCAL ] MAIN: Saving primary data. [2025-10-02T20:03:58.322727] [DEBUG] [LOCAL ] MAIN: Trimmed 59802 records to 41439 (keeping 200 days of data) [2025-10-02T20:03:58.675264] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-01. [2025-10-02T20:03:58.824201] [DEBUG] [VALIDATOR ] MANU: All expected trading days are present. [2025-10-02T20:03:58.834912] [DEBUG] [VALIDATOR ] MANU: Primary data validation passed. [2025-10-02T20:03:58.835991] [INFO ] [MAIN ] MANU: Fetched primary data is valid. [2025-10-02T20:03:58.836077] [DEBUG] [LOCAL ] MANU: Saving primary data. [2025-10-02T20:03:58.933145] [DEBUG] [LOCAL ] MANU: Trimmed 38223 records to 26976 (keeping 200 days of data) [2025-10-02T20:03:59.071089] [DEBUG] [LOCAL ] MAIN: Primary data saved (41439 records). [2025-10-02T20:03:59.071782] [INFO ] [MAIN ] MAIN: Full history saved. [2025-10-02T20:03:59.072237] [INFO ] [MAIN ] Update Progress: 1303/2370 symbols completed. MAIN took 49.0s. Estimated remaining: 2h 30m 37s. Rate: 7.1 symbols/min [2025-10-02T20:03:59.276763] [INFO ] [MAIN ] MATX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:03:59.363006] [DEBUG] [LOCAL ] MATX: Loaded 31529 existing records from primary storage. [2025-10-02T20:03:59.363569] [INFO ] [MAIN ] MATX: Loaded 31529 existing records. [2025-10-02T20:03:59.586798] [WARN ] [MAIN ] MATX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:03:59.589400] [INFO ] [MAIN ] MATX: Wiping existing primary data before full refresh. [2025-10-02T20:03:59.589919] [INFO ] [LOCAL ] MATX: Starting deletion of primary data. [2025-10-02T20:03:59.592848] [DEBUG] [LOCAL ] MATX: Deleted primary data file. [2025-10-02T20:03:59.594635] [DEBUG] [LOCAL ] MANU: Primary data saved (26976 records). [2025-10-02T20:03:59.593390] [INFO ] [MAIN ] MATX: Starting full primary refresh. [2025-10-02T20:03:59.600087] [INFO ] [MAIN ] MANU: Full history saved. [2025-10-02T20:03:59.606841] [INFO ] [MAIN ] Update Progress: 1304/2370 symbols completed. MANU took 30.1s. Estimated remaining: 2h 30m 22s. Rate: 7.1 symbols/min [2025-10-02T20:03:59.899374] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-02T20:03:59.977025] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-04. [2025-10-02T20:04:00.127360] [INFO ] [MAIN ] MAX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:04:00.322464] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-02T20:04:00.381616] [INFO ] [REMOTE ] MATX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:04:00.383334] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-02. [2025-10-02T20:04:00.404872] [DEBUG] [LOCAL ] MAX: Loaded 30716 existing records from primary storage. [2025-10-02T20:04:00.405309] [INFO ] [MAIN ] MAX: Loaded 30716 existing records. [2025-10-02T20:04:00.626323] [WARN ] [MAIN ] MAX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:04:00.626676] [INFO ] [MAIN ] MAX: Wiping existing primary data before full refresh. [2025-10-02T20:04:00.626741] [INFO ] [LOCAL ] MAX: Starting deletion of primary data. [2025-10-02T20:04:00.627705] [DEBUG] [LOCAL ] MAX: Deleted primary data file. [2025-10-02T20:04:00.627770] [INFO ] [MAIN ] MAX: Starting full primary refresh. [2025-10-02T20:04:01.041421] [INFO ] [REMOTE ] MAX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:04:01.073035] [INFO ] [REMOTE ] MAX: Fetching primary data for 2024-12. [2025-10-02T20:04:01.849955] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-02T20:04:01.878290] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-03. [2025-10-02T20:04:01.901423] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-02T20:04:02.126832] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-02T20:04:02.672999] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-05. [2025-10-02T20:04:03.389838] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-02T20:04:03.473066] [INFO ] [REMOTE ] MATX: Fetching primary data for 2024-12. [2025-10-02T20:04:04.273021] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-01. [2025-10-02T20:04:04.516075] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-02T20:04:04.734144] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-02T20:04:05.073030] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-04. [2025-10-02T20:04:05.246957] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-02T20:04:05.873001] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-06. [2025-10-02T20:04:06.621967] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-02T20:04:06.673018] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-01. [2025-10-02T20:04:07.478118] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-05. [2025-10-02T20:04:07.506694] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-02T20:04:07.823600] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-02T20:04:08.273026] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-02. [2025-10-02T20:04:08.958315] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-02T20:04:09.072982] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-06. [2025-10-02T20:04:09.116612] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-02T20:04:09.872968] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-03. [2025-10-02T20:04:10.490063] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-02T20:04:10.673040] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-02. [2025-10-02T20:04:10.891880] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-02T20:04:11.473029] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-07. [2025-10-02T20:04:11.687050] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-02T20:04:12.273052] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-03. [2025-10-02T20:04:12.924484] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-02T20:04:13.073021] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-07. [2025-10-02T20:04:13.438823] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-02T20:04:13.873031] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-08. [2025-10-02T20:04:14.561676] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-02T20:04:14.672991] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-04. [2025-10-02T20:04:15.472975] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-08. [2025-10-02T20:04:15.504963] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-02T20:04:16.030028] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-02T20:04:16.273004] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-05. [2025-10-02T20:04:17.073041] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-09. [2025-10-02T20:04:17.259135] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-02T20:04:17.574597] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-02T20:04:17.873047] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-06. [2025-10-02T20:04:18.369163] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-02T20:04:18.672996] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-04. [2025-10-02T20:04:18.931465] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-02T20:04:19.473017] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-07. [2025-10-02T20:04:19.881841] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-02T20:04:20.273000] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-05. [2025-10-02T20:04:20.475046] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-02T20:04:21.073028] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-08. [2025-10-02T20:04:21.687661] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-02T20:04:21.873042] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-09. [2025-10-02T20:04:22.491493] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-02T20:04:22.672999] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-10. [2025-10-02T20:04:23.472967] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-09. [2025-10-02T20:04:23.627411] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-02T20:04:23.631314] [INFO ] [REMOTE ] MATV: Full fetch complete (52402 records). [2025-10-02T20:04:23.631526] [DEBUG] [VALIDATOR ] MATV: Validating primary data. [2025-10-02T20:04:24.153782] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-02T20:04:24.186443] [DEBUG] [VALIDATOR ] MATV: All expected trading days are present. [2025-10-02T20:04:24.186855] [DEBUG] [VALIDATOR ] MATV: Primary data validation passed. [2025-10-02T20:04:24.187764] [INFO ] [MAIN ] MATV: Fetched primary data is valid. [2025-10-02T20:04:24.187849] [DEBUG] [LOCAL ] MATV: Saving primary data. [2025-10-02T20:04:24.189957] [DEBUG] [LOCAL ] MATV: Trimmed 52402 records to 36941 (keeping 200 days of data) [2025-10-02T20:04:24.278924] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-10. [2025-10-02T20:04:24.430038] [DEBUG] [LOCAL ] MATV: Primary data saved (36941 records). [2025-10-02T20:04:24.430207] [INFO ] [MAIN ] MATV: Full history saved. [2025-10-02T20:04:24.430306] [INFO ] [MAIN ] Update Progress: 1305/2370 symbols completed. MATV took 31.8s. Estimated remaining: 2h 30m 26s. Rate: 7.1 symbols/min [2025-10-02T20:04:24.630203] [INFO ] [MAIN ] MBC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:04:24.654587] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-02T20:04:24.714089] [DEBUG] [LOCAL ] MBC: Loaded 43173 existing records from primary storage. [2025-10-02T20:04:24.714572] [INFO ] [MAIN ] MBC: Loaded 43173 existing records. [2025-10-02T20:04:24.932100] [WARN ] [MAIN ] MBC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:04:24.932382] [INFO ] [MAIN ] MBC: Wiping existing primary data before full refresh. [2025-10-02T20:04:24.932453] [INFO ] [LOCAL ] MBC: Starting deletion of primary data. [2025-10-02T20:04:24.934016] [DEBUG] [LOCAL ] MBC: Deleted primary data file. [2025-10-02T20:04:24.934097] [INFO ] [MAIN ] MBC: Starting full primary refresh. [2025-10-02T20:04:25.078158] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-10. [2025-10-02T20:04:25.356007] [INFO ] [REMOTE ] MBC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:04:25.707289] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-02T20:04:25.710731] [INFO ] [REMOTE ] MAS: Full fetch complete (74843 records). [2025-10-02T20:04:25.710887] [DEBUG] [VALIDATOR ] MAS: Validating primary data. [2025-10-02T20:04:25.881479] [INFO ] [REMOTE ] MBC: Fetching primary data for 2024-12. [2025-10-02T20:04:26.156611] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-02T20:04:26.156761] [DEBUG] [VALIDATOR ] MAS: All expected trading days are present. [2025-10-02T20:04:26.158235] [DEBUG] [VALIDATOR ] MAS: Primary data validation passed. [2025-10-02T20:04:26.159680] [INFO ] [REMOTE ] MAX: Full fetch complete (45219 records). [2025-10-02T20:04:26.159804] [DEBUG] [VALIDATOR ] MAX: Validating primary data. [2025-10-02T20:04:26.159551] [INFO ] [MAIN ] MAS: Fetched primary data is valid. [2025-10-02T20:04:26.160036] [DEBUG] [LOCAL ] MAS: Saving primary data. [2025-10-02T20:04:26.280483] [DEBUG] [LOCAL ] MAS: Trimmed 74843 records to 52702 (keeping 200 days of data) [2025-10-02T20:04:26.680586] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-06. [2025-10-02T20:04:26.705418] [DEBUG] [VALIDATOR ] MAX: All expected trading days are present. [2025-10-02T20:04:26.706107] [DEBUG] [VALIDATOR ] MAX: Primary data validation passed. [2025-10-02T20:04:26.707280] [INFO ] [MAIN ] MAX: Fetched primary data is valid. [2025-10-02T20:04:26.708475] [DEBUG] [LOCAL ] MAX: Saving primary data. [2025-10-02T20:04:26.713709] [DEBUG] [LOCAL ] MAX: Trimmed 45219 records to 30922 (keeping 200 days of data) [2025-10-02T20:04:27.085693] [DEBUG] [LOCAL ] MAX: Primary data saved (30922 records). [2025-10-02T20:04:27.085848] [INFO ] [MAIN ] MAX: Full history saved. [2025-10-02T20:04:27.085943] [INFO ] [MAIN ] Update Progress: 1306/2370 symbols completed. MAX took 27.5s. Estimated remaining: 2h 30m 13s. Rate: 7.1 symbols/min [2025-10-02T20:04:27.357952] [INFO ] [MAIN ] MBI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:04:27.393355] [DEBUG] [LOCAL ] MAS: Primary data saved (52702 records). [2025-10-02T20:04:27.403144] [INFO ] [MAIN ] MAS: Full history saved. [2025-10-02T20:04:27.403375] [INFO ] [MAIN ] Update Progress: 1307/2370 symbols completed. MAS took 46.7s. Estimated remaining: 2h 29m 58s. Rate: 7.1 symbols/min [2025-10-02T20:04:27.403906] [DEBUG] [LOCAL ] MBI: Loaded 24272 existing records from primary storage. [2025-10-02T20:04:27.409761] [INFO ] [MAIN ] MBI: Loaded 24272 existing records. [2025-10-02T20:04:27.840858] [INFO ] [MAIN ] MC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:04:27.875165] [WARN ] [MAIN ] MBI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:04:27.876056] [INFO ] [MAIN ] MBI: Wiping existing primary data before full refresh. [2025-10-02T20:04:27.876127] [INFO ] [LOCAL ] MBI: Starting deletion of primary data. [2025-10-02T20:04:27.902341] [DEBUG] [LOCAL ] MBI: Deleted primary data file. [2025-10-02T20:04:27.902768] [INFO ] [MAIN ] MBI: Starting full primary refresh. [2025-10-02T20:04:27.904609] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-02T20:04:27.945154] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-01. [2025-10-02T20:04:28.264307] [DEBUG] [LOCAL ] MC: Loaded 44087 existing records from primary storage. [2025-10-02T20:04:28.283804] [INFO ] [MAIN ] MC: Loaded 44087 existing records. [2025-10-02T20:04:28.296293] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-02T20:04:28.387783] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-07. [2025-10-02T20:04:28.481465] [INFO ] [REMOTE ] MBI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:04:28.579947] [WARN ] [MAIN ] MC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:04:28.580204] [INFO ] [MAIN ] MC: Wiping existing primary data before full refresh. [2025-10-02T20:04:28.580284] [INFO ] [LOCAL ] MC: Starting deletion of primary data. [2025-10-02T20:04:28.581417] [DEBUG] [LOCAL ] MC: Deleted primary data file. [2025-10-02T20:04:28.581494] [INFO ] [MAIN ] MC: Starting full primary refresh. [2025-10-02T20:04:28.992258] [INFO ] [REMOTE ] MC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:04:29.072966] [INFO ] [REMOTE ] MC: Fetching primary data for 2024-12. [2025-10-02T20:04:29.252477] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-02T20:04:29.875362] [INFO ] [REMOTE ] MBI: Fetching primary data for 2024-12. [2025-10-02T20:04:29.881596] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-02T20:04:30.534450] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-02T20:04:30.673023] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-08. [2025-10-02T20:04:31.119259] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-02T20:04:31.473044] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-01. [2025-10-02T20:04:32.038952] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-02T20:04:32.273008] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-02. [2025-10-02T20:04:32.898330] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-02T20:04:33.073008] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-01. [2025-10-02T20:04:33.381342] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-02T20:04:33.866376] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-02T20:04:33.872991] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-03. [2025-10-02T20:04:34.673010] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-02. [2025-10-02T20:04:35.472985] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-02. [2025-10-02T20:04:35.631500] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-02T20:04:36.093194] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-02T20:04:36.185866] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-02T20:04:36.273012] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-03. [2025-10-02T20:04:37.072978] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-03. [2025-10-02T20:04:37.222033] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-02T20:04:37.872999] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-09. [2025-10-02T20:04:38.679537] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-04. [2025-10-02T20:04:38.702827] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-02T20:04:39.071433] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-02T20:04:39.472995] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-10. [2025-10-02T20:04:39.608510] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-02T20:04:40.272965] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-04. [2025-10-02T20:04:40.433534] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-02T20:04:40.434957] [INFO ] [REMOTE ] MATX: Full fetch complete (42627 records). [2025-10-02T20:04:40.435057] [DEBUG] [VALIDATOR ] MATX: Validating primary data. [2025-10-02T20:04:40.866366] [DEBUG] [VALIDATOR ] MATX: All expected trading days are present. [2025-10-02T20:04:40.866462] [DEBUG] [VALIDATOR ] MATX: Primary data validation passed. [2025-10-02T20:04:40.867505] [INFO ] [MAIN ] MATX: Fetched primary data is valid. [2025-10-02T20:04:40.867577] [DEBUG] [LOCAL ] MATX: Saving primary data. [2025-10-02T20:04:40.868958] [DEBUG] [LOCAL ] MATX: Trimmed 42627 records to 31728 (keeping 200 days of data) [2025-10-02T20:04:41.073106] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-04. [2025-10-02T20:04:41.111700] [DEBUG] [LOCAL ] MATX: Primary data saved (31728 records). [2025-10-02T20:04:41.111956] [INFO ] [MAIN ] MATX: Full history saved. [2025-10-02T20:04:41.112102] [INFO ] [MAIN ] Update Progress: 1308/2370 symbols completed. MATX took 42.0s. Estimated remaining: 2h 29m 54s. Rate: 7.1 symbols/min [2025-10-02T20:04:41.372933] [INFO ] [MAIN ] MCB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:04:41.387797] [DEBUG] [LOCAL ] MCB: Loaded 11400 existing records from primary storage. [2025-10-02T20:04:41.388098] [INFO ] [MAIN ] MCB: Loaded 11400 existing records. [2025-10-02T20:04:41.683370] [WARN ] [MAIN ] MCB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:04:41.683834] [INFO ] [MAIN ] MCB: Wiping existing primary data before full refresh. [2025-10-02T20:04:41.683928] [INFO ] [LOCAL ] MCB: Starting deletion of primary data. [2025-10-02T20:04:41.684565] [DEBUG] [LOCAL ] MCB: Deleted primary data file. [2025-10-02T20:04:41.684686] [INFO ] [MAIN ] MCB: Starting full primary refresh. [2025-10-02T20:04:41.873934] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-05. [2025-10-02T20:04:42.167994] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-02T20:04:42.247863] [INFO ] [REMOTE ] MCB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:04:42.466974] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-02T20:04:42.672963] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-05. [2025-10-02T20:04:42.766895] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-02T20:04:43.473009] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-05. [2025-10-02T20:04:44.268781] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-02T20:04:44.278241] [INFO ] [REMOTE ] MCB: Fetching primary data for 2024-12. [2025-10-02T20:04:45.061890] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-02T20:04:45.080148] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-01. [2025-10-02T20:04:45.098755] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-02T20:04:45.873040] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-06. [2025-10-02T20:04:45.974205] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-02T20:04:46.680175] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-06. [2025-10-02T20:04:46.683369] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-02T20:04:47.473049] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-07. [2025-10-02T20:04:47.897096] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-02T20:04:48.272973] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-02. [2025-10-02T20:04:48.530568] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-02T20:04:49.025692] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-02T20:04:49.073037] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-08. [2025-10-02T20:04:49.872995] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-07. [2025-10-02T20:04:50.356883] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-02T20:04:50.673040] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-09. [2025-10-02T20:04:51.473005] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-06. [2025-10-02T20:04:51.626579] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-02T20:04:51.775623] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-02T20:04:52.273034] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-10. [2025-10-02T20:04:52.977897] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-02T20:04:53.072987] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-07. [2025-10-02T20:04:53.213097] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-02T20:04:53.214411] [INFO ] [REMOTE ] MBI: Full fetch complete (36506 records). [2025-10-02T20:04:53.214491] [DEBUG] [VALIDATOR ] MBI: Validating primary data. [2025-10-02T20:04:53.653967] [DEBUG] [VALIDATOR ] MBI: All expected trading days are present. [2025-10-02T20:04:53.654071] [DEBUG] [VALIDATOR ] MBI: Primary data validation passed. [2025-10-02T20:04:53.654896] [INFO ] [MAIN ] MBI: Fetched primary data is valid. [2025-10-02T20:04:53.654984] [DEBUG] [LOCAL ] MBI: Saving primary data. [2025-10-02T20:04:53.656045] [DEBUG] [LOCAL ] MBI: Trimmed 36506 records to 24438 (keeping 200 days of data) [2025-10-02T20:04:53.803129] [DEBUG] [LOCAL ] MBI: Primary data saved (24438 records). [2025-10-02T20:04:53.803283] [INFO ] [MAIN ] MBI: Full history saved. [2025-10-02T20:04:53.803372] [INFO ] [MAIN ] Update Progress: 1309/2370 symbols completed. MBI took 26.7s. Estimated remaining: 2h 29m 49s. Rate: 7.1 symbols/min [2025-10-02T20:04:53.878185] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-08. [2025-10-02T20:04:53.995625] [INFO ] [MAIN ] MCD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:04:53.995826] [DEBUG] [LOCAL ] MCD: No existing data file found in primary storage. [2025-10-02T20:04:53.995874] [WARN ] [MAIN ] MCD: No existing data found, performing full refresh instead. [2025-10-02T20:04:53.995990] [INFO ] [MAIN ] MCD: Wiping existing primary data before full refresh. [2025-10-02T20:04:53.996033] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-10-02T20:04:53.996076] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-10-02T20:04:53.996110] [INFO ] [MAIN ] MCD: Starting full primary refresh. [2025-10-02T20:04:54.424831] [INFO ] [REMOTE ] MCD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:04:54.578258] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-02T20:04:54.673039] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-08. [2025-10-02T20:04:55.413426] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-02T20:04:55.473057] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-09. [2025-10-02T20:04:55.810502] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-02T20:04:56.273026] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-03. [2025-10-02T20:04:56.611820] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-02T20:04:57.073028] [INFO ] [REMOTE ] MCD: Fetching primary data for 2024-12. [2025-10-02T20:04:57.132668] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-02T20:04:57.873010] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-10. [2025-10-02T20:04:58.673004] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-04. [2025-10-02T20:04:59.169194] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-02T20:04:59.171535] [INFO ] [REMOTE ] MC: Full fetch complete (62565 records). [2025-10-02T20:04:59.171636] [DEBUG] [VALIDATOR ] MC: Validating primary data. [2025-10-02T20:04:59.473962] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-09. [2025-10-02T20:04:59.556470] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2024-12 (2.48 seconds). [2025-10-02T20:04:59.671864] [DEBUG] [VALIDATOR ] MC: All expected trading days are present. [2025-10-02T20:04:59.672103] [DEBUG] [VALIDATOR ] MC: Primary data validation passed. [2025-10-02T20:04:59.673247] [INFO ] [MAIN ] MC: Fetched primary data is valid. [2025-10-02T20:04:59.673378] [DEBUG] [LOCAL ] MC: Saving primary data. [2025-10-02T20:04:59.684977] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-02T20:04:59.690431] [DEBUG] [LOCAL ] MC: Trimmed 62565 records to 44384 (keeping 200 days of data) [2025-10-02T20:04:59.985583] [DEBUG] [LOCAL ] MC: Primary data saved (44384 records). [2025-10-02T20:04:59.985741] [INFO ] [MAIN ] MC: Full history saved. [2025-10-02T20:04:59.985844] [INFO ] [MAIN ] Update Progress: 1310/2370 symbols completed. MC took 32.6s. Estimated remaining: 2h 29m 39s. Rate: 7.1 symbols/min [2025-10-02T20:05:00.172955] [INFO ] [MAIN ] MCI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:05:00.182077] [DEBUG] [LOCAL ] MCI: Loaded 6368 existing records from primary storage. [2025-10-02T20:05:00.182336] [INFO ] [MAIN ] MCI: Loaded 6368 existing records. [2025-10-02T20:05:00.278119] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-01. [2025-10-02T20:05:00.388718] [WARN ] [MAIN ] MCI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:05:00.388965] [INFO ] [MAIN ] MCI: Wiping existing primary data before full refresh. [2025-10-02T20:05:00.389012] [INFO ] [LOCAL ] MCI: Starting deletion of primary data. [2025-10-02T20:05:00.389410] [DEBUG] [LOCAL ] MCI: Deleted primary data file. [2025-10-02T20:05:00.389471] [INFO ] [MAIN ] MCI: Starting full primary refresh. [2025-10-02T20:05:00.767982] [INFO ] [REMOTE ] MCI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:05:01.073012] [INFO ] [REMOTE ] MCI: Fetching primary data for 2024-12. [2025-10-02T20:05:01.323882] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-02T20:05:01.476908] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-10-02T20:05:01.872974] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-10. [2025-10-02T20:05:02.453477] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-02T20:05:02.672992] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-05. [2025-10-02T20:05:03.386135] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-02T20:05:03.388957] [INFO ] [REMOTE ] MBC: Full fetch complete (63049 records). [2025-10-02T20:05:03.389174] [DEBUG] [VALIDATOR ] MBC: Validating primary data. [2025-10-02T20:05:03.478437] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-01. [2025-10-02T20:05:03.668065] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-02T20:05:03.858931] [DEBUG] [VALIDATOR ] MBC: All expected trading days are present. [2025-10-02T20:05:03.859039] [DEBUG] [VALIDATOR ] MBC: Primary data validation passed. [2025-10-02T20:05:03.860071] [INFO ] [MAIN ] MBC: Fetched primary data is valid. [2025-10-02T20:05:03.860194] [DEBUG] [LOCAL ] MBC: Saving primary data. [2025-10-02T20:05:03.861752] [DEBUG] [LOCAL ] MBC: Trimmed 63049 records to 43591 (keeping 200 days of data) [2025-10-02T20:05:04.138554] [DEBUG] [LOCAL ] MBC: Primary data saved (43591 records). [2025-10-02T20:05:04.138736] [INFO ] [MAIN ] MBC: Full history saved. [2025-10-02T20:05:04.138836] [INFO ] [MAIN ] Update Progress: 1311/2370 symbols completed. MBC took 39.7s. Estimated remaining: 2h 29m 27s. Rate: 7.1 symbols/min [2025-10-02T20:05:04.273573] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-02. [2025-10-02T20:05:04.328528] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-02T20:05:04.356754] [INFO ] [MAIN ] MCK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:05:04.400267] [DEBUG] [LOCAL ] MCK: Loaded 39151 existing records from primary storage. [2025-10-02T20:05:04.400598] [INFO ] [MAIN ] MCK: Loaded 39151 existing records. [2025-10-02T20:05:04.600677] [WARN ] [MAIN ] MCK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:05:04.601038] [INFO ] [MAIN ] MCK: Wiping existing primary data before full refresh. [2025-10-02T20:05:04.601115] [INFO ] [LOCAL ] MCK: Starting deletion of primary data. [2025-10-02T20:05:04.602342] [DEBUG] [LOCAL ] MCK: Deleted primary data file. [2025-10-02T20:05:04.602425] [INFO ] [MAIN ] MCK: Starting full primary refresh. [2025-10-02T20:05:05.012727] [INFO ] [REMOTE ] MCK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:05:05.073030] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-06. [2025-10-02T20:05:05.873046] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-02. [2025-10-02T20:05:05.904225] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-02T20:05:06.328249] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-02T20:05:06.660601] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-02T20:05:06.672975] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-03. [2025-10-02T20:05:07.110408] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-02T20:05:07.473005] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-07. [2025-10-02T20:05:08.273046] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-03. [2025-10-02T20:05:08.405575] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-02T20:05:09.073042] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-04. [2025-10-02T20:05:09.769865] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-02T20:05:09.873043] [INFO ] [REMOTE ] MCK: Fetching primary data for 2024-12. [2025-10-02T20:05:10.182261] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-02T20:05:10.673015] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-05. [2025-10-02T20:05:11.474985] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-02T20:05:11.475059] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-04. [2025-10-02T20:05:11.485545] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-02T20:05:12.273068] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-06. [2025-10-02T20:05:13.072967] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-08. [2025-10-02T20:05:13.098542] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-02T20:05:13.639325] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-02T20:05:13.849323] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-02T20:05:13.872978] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-09. [2025-10-02T20:05:14.673050] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-07. [2025-10-02T20:05:14.698958] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-02T20:05:15.285741] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-02T20:05:15.473050] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-08. [2025-10-02T20:05:16.085929] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-02T20:05:16.273041] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-09. [2025-10-02T20:05:16.925362] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-02T20:05:17.073015] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-05. [2025-10-02T20:05:17.873046] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-10. [2025-10-02T20:05:18.477632] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-02T20:05:18.478555] [INFO ] [REMOTE ] MCI: Full fetch complete (10001 records). [2025-10-02T20:05:18.478629] [DEBUG] [VALIDATOR ] MCI: Validating primary data. [2025-10-02T20:05:18.678802] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-10. [2025-10-02T20:05:18.908576] [DEBUG] [VALIDATOR ] MCI: All expected trading days are present. [2025-10-02T20:05:18.908884] [DEBUG] [VALIDATOR ] MCI: Primary data validation passed. [2025-10-02T20:05:18.909186] [INFO ] [MAIN ] MCI: Fetched primary data is valid. [2025-10-02T20:05:18.909397] [DEBUG] [LOCAL ] MCI: Saving primary data. [2025-10-02T20:05:18.910217] [DEBUG] [LOCAL ] MCI: Trimmed 10001 records to 6458 (keeping 200 days of data) [2025-10-02T20:05:18.953347] [DEBUG] [LOCAL ] MCI: Primary data saved (6458 records). [2025-10-02T20:05:18.953503] [INFO ] [MAIN ] MCI: Full history saved. [2025-10-02T20:05:18.953689] [INFO ] [MAIN ] Update Progress: 1312/2370 symbols completed. MCI took 19.0s. Estimated remaining: 2h 29m 23s. Rate: 7.1 symbols/min [2025-10-02T20:05:19.145687] [INFO ] [MAIN ] MCN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:05:19.193181] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-02T20:05:19.212662] [DEBUG] [LOCAL ] MCN: Loaded 8211 existing records from primary storage. [2025-10-02T20:05:19.212930] [INFO ] [MAIN ] MCN: Loaded 8211 existing records. [2025-10-02T20:05:19.353712] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-02T20:05:19.375573] [INFO ] [REMOTE ] MCB: Full fetch complete (16339 records). [2025-10-02T20:05:19.398707] [DEBUG] [VALIDATOR ] MCB: Validating primary data. [2025-10-02T20:05:19.478618] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-06. [2025-10-02T20:05:19.502828] [WARN ] [MAIN ] MCN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:05:19.550766] [INFO ] [MAIN ] MCN: Wiping existing primary data before full refresh. [2025-10-02T20:05:19.557128] [INFO ] [LOCAL ] MCN: Starting deletion of primary data. [2025-10-02T20:05:19.562992] [DEBUG] [LOCAL ] MCN: Deleted primary data file. [2025-10-02T20:05:19.573376] [INFO ] [MAIN ] MCN: Starting full primary refresh. [2025-10-02T20:05:20.206070] [DEBUG] [VALIDATOR ] MCB: All expected trading days are present. [2025-10-02T20:05:20.206520] [DEBUG] [VALIDATOR ] MCB: Primary data validation passed. [2025-10-02T20:05:20.212495] [INFO ] [MAIN ] MCB: Fetched primary data is valid. [2025-10-02T20:05:20.217719] [DEBUG] [LOCAL ] MCB: Saving primary data. [2025-10-02T20:05:20.264603] [DEBUG] [LOCAL ] MCB: Trimmed 16339 records to 11457 (keeping 200 days of data) [2025-10-02T20:05:20.292320] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-01. [2025-10-02T20:05:20.296517] [INFO ] [REMOTE ] MCN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:05:20.376029] [DEBUG] [LOCAL ] MCB: Primary data saved (11457 records). [2025-10-02T20:05:20.376164] [INFO ] [MAIN ] MCB: Full history saved. [2025-10-02T20:05:20.376253] [INFO ] [MAIN ] Update Progress: 1313/2370 symbols completed. MCB took 39.3s. Estimated remaining: 2h 29m 9s. Rate: 7.1 symbols/min [2025-10-02T20:05:20.565220] [INFO ] [MAIN ] MCO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:05:20.605395] [DEBUG] [LOCAL ] MCO: Loaded 39277 existing records from primary storage. [2025-10-02T20:05:20.605742] [INFO ] [MAIN ] MCO: Loaded 39277 existing records. [2025-10-02T20:05:20.807280] [WARN ] [MAIN ] MCO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:05:20.807490] [INFO ] [MAIN ] MCO: Wiping existing primary data before full refresh. [2025-10-02T20:05:20.807539] [INFO ] [LOCAL ] MCO: Starting deletion of primary data. [2025-10-02T20:05:20.808564] [DEBUG] [LOCAL ] MCO: Deleted primary data file. [2025-10-02T20:05:20.808634] [INFO ] [MAIN ] MCO: Starting full primary refresh. [2025-10-02T20:05:21.082018] [INFO ] [REMOTE ] MCN: Fetching primary data for 2024-12. [2025-10-02T20:05:21.201292] [INFO ] [REMOTE ] MCO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:05:21.872965] [INFO ] [REMOTE ] MCO: Fetching primary data for 2024-12. [2025-10-02T20:05:21.921778] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-06 (2.44 seconds). [2025-10-02T20:05:22.015118] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-02T20:05:22.029267] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-02T20:05:22.673019] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-07. [2025-10-02T20:05:22.983990] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-02T20:05:23.473043] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-02. [2025-10-02T20:05:24.273015] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-01. [2025-10-02T20:05:24.974711] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-02T20:05:24.993725] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-02T20:05:25.072974] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-02. [2025-10-02T20:05:25.117482] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-02T20:05:25.750842] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-02T20:05:25.872988] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-03. [2025-10-02T20:05:26.456418] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-02T20:05:26.673066] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-01. [2025-10-02T20:05:27.473005] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-03. [2025-10-02T20:05:28.096577] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-02T20:05:28.273055] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-08. [2025-10-02T20:05:28.963761] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-02T20:05:29.072994] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-02. [2025-10-02T20:05:29.872982] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-04. [2025-10-02T20:05:30.285926] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-02T20:05:30.673020] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-09. [2025-10-02T20:05:30.749708] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-02T20:05:31.473004] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-04. [2025-10-02T20:05:31.670902] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-02T20:05:32.082904] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-02T20:05:32.273006] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-05. [2025-10-02T20:05:32.719626] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-02T20:05:33.073066] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-10. [2025-10-02T20:05:33.873057] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-03. [2025-10-02T20:05:34.014683] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-02T20:05:34.673003] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-06. [2025-10-02T20:05:34.690868] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-02T20:05:34.693230] [INFO ] [REMOTE ] MCD: Full fetch complete (77031 records). [2025-10-02T20:05:34.693358] [DEBUG] [VALIDATOR ] MCD: Validating primary data. [2025-10-02T20:05:34.907474] [WARN ] [VALIDATOR ] MCD: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-02T20:05:34.908371] [FATAL] [MAIN ] MCD: Fetched primary data is invalid. Refusing to save it. [2025-10-02T20:05:34.908447] [WARN ] [MAIN ] MCD: Deleting existing primary and derivative data due to validation failure. [2025-10-02T20:05:34.908523] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-10-02T20:05:34.908692] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-10-02T20:05:34.908753] [INFO ] [LOCAL ] MCD: Starting deletion of derivative data. [2025-10-02T20:05:34.908815] [DEBUG] [LOCAL ] MCD: No derivative data file found to delete. [2025-10-02T20:05:34.908908] [INFO ] [MAIN ] Update Progress: 1314/2370 symbols completed. MCD took 41.1s. Estimated remaining: 2h 29m 6s. Rate: 7.1 symbols/min [2025-10-02T20:05:35.115081] [INFO ] [MAIN ] MCR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:05:35.127380] [DEBUG] [LOCAL ] MCR: Loaded 8766 existing records from primary storage. [2025-10-02T20:05:35.127700] [INFO ] [MAIN ] MCR: Loaded 8766 existing records. [2025-10-02T20:05:35.331223] [WARN ] [MAIN ] MCR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:05:35.331624] [INFO ] [MAIN ] MCR: Wiping existing primary data before full refresh. [2025-10-02T20:05:35.331843] [INFO ] [LOCAL ] MCR: Starting deletion of primary data. [2025-10-02T20:05:35.333366] [DEBUG] [LOCAL ] MCR: Deleted primary data file. [2025-10-02T20:05:35.333443] [INFO ] [MAIN ] MCR: Starting full primary refresh. [2025-10-02T20:05:35.475192] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-05. [2025-10-02T20:05:35.499436] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-02T20:05:35.781292] [INFO ] [REMOTE ] MCR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:05:36.205849] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-02T20:05:36.234216] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-02T20:05:36.272989] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-06. [2025-10-02T20:05:37.009894] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-02T20:05:37.073000] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-07. [2025-10-02T20:05:37.873002] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-04. [2025-10-02T20:05:38.546577] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-02T20:05:38.673012] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-07. [2025-10-02T20:05:39.476162] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-08. [2025-10-02T20:05:39.478299] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-02T20:05:39.616220] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-02T20:05:40.272967] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-08. [2025-10-02T20:05:40.854940] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-02T20:05:40.883007] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-02T20:05:41.073010] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-09. [2025-10-02T20:05:41.863922] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-02T20:05:41.872948] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-10. [2025-10-02T20:05:42.345754] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-02T20:05:42.346585] [INFO ] [REMOTE ] MCN: Full fetch complete (11678 records). [2025-10-02T20:05:42.346699] [DEBUG] [VALIDATOR ] MCN: Validating primary data. [2025-10-02T20:05:42.678078] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-05. [2025-10-02T20:05:42.756075] [DEBUG] [VALIDATOR ] MCN: All expected trading days are present. [2025-10-02T20:05:42.756167] [DEBUG] [VALIDATOR ] MCN: Primary data validation passed. [2025-10-02T20:05:42.756464] [INFO ] [MAIN ] MCN: Fetched primary data is valid. [2025-10-02T20:05:42.756509] [DEBUG] [LOCAL ] MCN: Saving primary data. [2025-10-02T20:05:42.757051] [DEBUG] [LOCAL ] MCN: Trimmed 11678 records to 8254 (keeping 200 days of data) [2025-10-02T20:05:42.807333] [DEBUG] [LOCAL ] MCN: Primary data saved (8254 records). [2025-10-02T20:05:42.807470] [INFO ] [MAIN ] MCN: Full history saved. [2025-10-02T20:05:42.807567] [INFO ] [MAIN ] Update Progress: 1315/2370 symbols completed. MCN took 23.9s. Estimated remaining: 2h 28m 57s. Rate: 7.1 symbols/min [2025-10-02T20:05:42.988984] [INFO ] [MAIN ] MCS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:05:43.011352] [DEBUG] [LOCAL ] MCS: Loaded 20933 existing records from primary storage. [2025-10-02T20:05:43.011668] [INFO ] [MAIN ] MCS: Loaded 20933 existing records. [2025-10-02T20:05:43.211114] [WARN ] [MAIN ] MCS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:05:43.211430] [INFO ] [MAIN ] MCS: Wiping existing primary data before full refresh. [2025-10-02T20:05:43.211515] [INFO ] [LOCAL ] MCS: Starting deletion of primary data. [2025-10-02T20:05:43.212389] [DEBUG] [LOCAL ] MCS: Deleted primary data file. [2025-10-02T20:05:43.212468] [INFO ] [MAIN ] MCS: Starting full primary refresh. [2025-10-02T20:05:43.478173] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-09. [2025-10-02T20:05:43.607515] [INFO ] [REMOTE ] MCS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:05:43.916598] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-02T20:05:44.273013] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-06. [2025-10-02T20:05:45.078097] [INFO ] [REMOTE ] MCR: Fetching primary data for 2024-12. [2025-10-02T20:05:45.098672] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-02T20:05:45.671467] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-02T20:05:45.689492] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-02T20:05:45.873045] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-07. [2025-10-02T20:05:46.673010] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-01. [2025-10-02T20:05:47.332633] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-02T20:05:47.374849] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-02T20:05:47.472997] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-10. [2025-10-02T20:05:48.273000] [INFO ] [REMOTE ] MCS: Fetching primary data for 2024-12. [2025-10-02T20:05:48.622517] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-02T20:05:48.624416] [INFO ] [REMOTE ] MCK: Full fetch complete (57226 records). [2025-10-02T20:05:48.624519] [DEBUG] [VALIDATOR ] MCK: Validating primary data. [2025-10-02T20:05:49.044745] [DEBUG] [VALIDATOR ] MCK: All expected trading days are present. [2025-10-02T20:05:49.044845] [DEBUG] [VALIDATOR ] MCK: Primary data validation passed. [2025-10-02T20:05:49.045809] [INFO ] [MAIN ] MCK: Fetched primary data is valid. [2025-10-02T20:05:49.045877] [DEBUG] [LOCAL ] MCK: Saving primary data. [2025-10-02T20:05:49.047231] [DEBUG] [LOCAL ] MCK: Trimmed 57226 records to 39384 (keeping 200 days of data) [2025-10-02T20:05:49.107730] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-08. [2025-10-02T20:05:49.297985] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-02T20:05:49.331818] [DEBUG] [LOCAL ] MCK: Primary data saved (39384 records). [2025-10-02T20:05:49.331957] [INFO ] [MAIN ] MCK: Full history saved. [2025-10-02T20:05:49.332049] [INFO ] [MAIN ] Update Progress: 1316/2370 symbols completed. MCK took 45.2s. Estimated remaining: 2h 28m 47s. Rate: 7.1 symbols/min [2025-10-02T20:05:49.515479] [INFO ] [MAIN ] MCY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:05:49.539747] [DEBUG] [LOCAL ] MCY: Loaded 24385 existing records from primary storage. [2025-10-02T20:05:49.540025] [INFO ] [MAIN ] MCY: Loaded 24385 existing records. [2025-10-02T20:05:49.730704] [WARN ] [MAIN ] MCY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:05:49.730921] [INFO ] [MAIN ] MCY: Wiping existing primary data before full refresh. [2025-10-02T20:05:49.731021] [INFO ] [LOCAL ] MCY: Starting deletion of primary data. [2025-10-02T20:05:49.731891] [DEBUG] [LOCAL ] MCY: Deleted primary data file. [2025-10-02T20:05:49.731954] [INFO ] [MAIN ] MCY: Starting full primary refresh. [2025-10-02T20:05:49.882563] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-02. [2025-10-02T20:05:50.126689] [INFO ] [REMOTE ] MCY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:05:50.563473] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-02T20:05:50.598440] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-02T20:05:50.673013] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-03. [2025-10-02T20:05:51.186357] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-02T20:05:51.473048] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-01. [2025-10-02T20:05:52.272995] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-09. [2025-10-02T20:05:52.467143] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-02T20:05:53.073078] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-04. [2025-10-02T20:05:53.852136] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-02T20:05:53.872967] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-10. [2025-10-02T20:05:53.946393] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-02T20:05:54.673031] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-05. [2025-10-02T20:05:55.115260] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-02T20:05:55.117083] [INFO ] [REMOTE ] MCO: Full fetch complete (57039 records). [2025-10-02T20:05:55.117221] [DEBUG] [VALIDATOR ] MCO: Validating primary data. [2025-10-02T20:05:55.462580] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-02T20:05:55.478128] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-02. [2025-10-02T20:05:55.576235] [DEBUG] [VALIDATOR ] MCO: All expected trading days are present. [2025-10-02T20:05:55.576329] [DEBUG] [VALIDATOR ] MCO: Primary data validation passed. [2025-10-02T20:05:55.577303] [INFO ] [MAIN ] MCO: Fetched primary data is valid. [2025-10-02T20:05:55.577372] [DEBUG] [LOCAL ] MCO: Saving primary data. [2025-10-02T20:05:55.578876] [DEBUG] [LOCAL ] MCO: Trimmed 57039 records to 39604 (keeping 200 days of data) [2025-10-02T20:05:55.852099] [DEBUG] [LOCAL ] MCO: Primary data saved (39604 records). [2025-10-02T20:05:55.852247] [INFO ] [MAIN ] MCO: Full history saved. [2025-10-02T20:05:55.852330] [INFO ] [MAIN ] Update Progress: 1317/2370 symbols completed. MCO took 35.5s. Estimated remaining: 2h 28m 37s. Rate: 7.1 symbols/min [2025-10-02T20:05:56.273029] [INFO ] [REMOTE ] MCY: Fetching primary data for 2024-12. [2025-10-02T20:05:56.543153] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-02T20:05:57.073049] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-06. [2025-10-02T20:05:57.350725] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-02T20:05:57.780058] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-02T20:05:57.873058] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-03. [2025-10-02T20:05:58.672988] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-01. [2025-10-02T20:05:58.977697] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-02T20:05:59.473057] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-04. [2025-10-02T20:06:00.233633] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-02T20:06:00.273002] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-05. [2025-10-02T20:06:00.305099] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-02T20:06:01.072999] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-07. [2025-10-02T20:06:01.330771] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-02T20:06:01.792428] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-02T20:06:01.873032] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-06. [2025-10-02T20:06:02.643068] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-02T20:06:02.672981] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-07. [2025-10-02T20:06:03.473022] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-02. [2025-10-02T20:06:03.786952] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-02T20:06:04.272982] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-08. [2025-10-02T20:06:04.926788] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-02T20:06:05.073012] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-03. [2025-10-02T20:06:05.364921] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-02T20:06:05.873010] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-09. [2025-10-02T20:06:06.440343] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-02T20:06:06.523130] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-02T20:06:06.672990] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-10. [2025-10-02T20:06:07.376982] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-02T20:06:07.378413] [INFO ] [REMOTE ] MCS: Full fetch complete (30455 records). [2025-10-02T20:06:07.378545] [DEBUG] [VALIDATOR ] MCS: Validating primary data. [2025-10-02T20:06:07.479415] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-08. [2025-10-02T20:06:07.787908] [DEBUG] [VALIDATOR ] MCS: All expected trading days are present. [2025-10-02T20:06:07.787999] [DEBUG] [VALIDATOR ] MCS: Primary data validation passed. [2025-10-02T20:06:07.788931] [INFO ] [MAIN ] MCS: Fetched primary data is valid. [2025-10-02T20:06:07.789000] [DEBUG] [LOCAL ] MCS: Saving primary data. [2025-10-02T20:06:07.790042] [DEBUG] [LOCAL ] MCS: Trimmed 30455 records to 21177 (keeping 200 days of data) [2025-10-02T20:06:07.923226] [DEBUG] [LOCAL ] MCS: Primary data saved (21177 records). [2025-10-02T20:06:07.923353] [INFO ] [MAIN ] MCS: Full history saved. [2025-10-02T20:06:07.923438] [INFO ] [MAIN ] Update Progress: 1318/2370 symbols completed. MCS took 25.1s. Estimated remaining: 2h 28m 31s. Rate: 7.1 symbols/min [2025-10-02T20:06:08.273005] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-04. [2025-10-02T20:06:08.349144] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-02T20:06:09.073021] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-09. [2025-10-02T20:06:09.617928] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-02T20:06:09.695363] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-02T20:06:09.873011] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-05. [2025-10-02T20:06:10.673011] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-10. [2025-10-02T20:06:11.293599] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-02T20:06:11.303376] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-02T20:06:11.304845] [INFO ] [REMOTE ] MCR: Full fetch complete (14086 records). [2025-10-02T20:06:11.304951] [DEBUG] [VALIDATOR ] MCR: Validating primary data. [2025-10-02T20:06:11.478256] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-06. [2025-10-02T20:06:11.745148] [DEBUG] [VALIDATOR ] MCR: All expected trading days are present. [2025-10-02T20:06:11.745232] [DEBUG] [VALIDATOR ] MCR: Primary data validation passed. [2025-10-02T20:06:11.745589] [INFO ] [MAIN ] MCR: Fetched primary data is valid. [2025-10-02T20:06:11.745632] [DEBUG] [LOCAL ] MCR: Saving primary data. [2025-10-02T20:06:11.746210] [DEBUG] [LOCAL ] MCR: Trimmed 14086 records to 8814 (keeping 200 days of data) [2025-10-02T20:06:11.801532] [DEBUG] [LOCAL ] MCR: Primary data saved (8814 records). [2025-10-02T20:06:11.801710] [INFO ] [MAIN ] MCR: Full history saved. [2025-10-02T20:06:11.801810] [INFO ] [MAIN ] Update Progress: 1319/2370 symbols completed. MCR took 36.9s. Estimated remaining: 2h 28m 19s. Rate: 7.1 symbols/min [2025-10-02T20:06:12.598053] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-02T20:06:12.603796] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-07. [2025-10-02T20:06:13.758282] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-02T20:06:13.764533] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-08. [2025-10-02T20:06:14.929274] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-02T20:06:14.934904] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-09. [2025-10-02T20:06:16.005202] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-02T20:06:16.011257] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-10. [2025-10-02T20:06:17.142708] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-02T20:06:17.144007] [INFO ] [REMOTE ] MCY: Full fetch complete (41484 records). [2025-10-02T20:06:17.144117] [DEBUG] [VALIDATOR ] MCY: Validating primary data. [2025-10-02T20:06:17.569415] [DEBUG] [VALIDATOR ] MCY: All expected trading days are present. [2025-10-02T20:06:17.569551] [DEBUG] [VALIDATOR ] MCY: Primary data validation passed. [2025-10-02T20:06:17.570389] [INFO ] [MAIN ] MCY: Fetched primary data is valid. [2025-10-02T20:06:17.570453] [DEBUG] [LOCAL ] MCY: Saving primary data. [2025-10-02T20:06:17.571528] [DEBUG] [LOCAL ] MCY: Trimmed 41484 records to 24525 (keeping 200 days of data) [2025-10-02T20:06:17.731395] [DEBUG] [LOCAL ] MCY: Primary data saved (24525 records). [2025-10-02T20:06:17.731542] [INFO ] [MAIN ] MCY: Full history saved. [2025-10-02T20:06:17.731632] [INFO ] [MAIN ] Update Progress: 1320/2370 symbols completed. MCY took 28.4s. Estimated remaining: 2h 28m 8s. Rate: 7.1 symbols/min [2025-10-02T20:06:18.397067] [INFO ] [MAIN ] MD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:06:18.425687] [INFO ] [MAIN ] MDT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:06:18.464100] [INFO ] [MAIN ] MDU: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:06:18.541768] [INFO ] [MAIN ] MDST: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:06:18.556701] [DEBUG] [LOCAL ] MDST: Loaded 5682 existing records from primary storage. [2025-10-02T20:06:18.557392] [INFO ] [MAIN ] MDST: Loaded 5682 existing records. [2025-10-02T20:06:18.781344] [DEBUG] [LOCAL ] MDU: Loaded 47936 existing records from primary storage. [2025-10-02T20:06:18.799045] [DEBUG] [LOCAL ] MD: Loaded 38329 existing records from primary storage. [2025-10-02T20:06:18.812426] [INFO ] [MAIN ] MDU: Loaded 47936 existing records. [2025-10-02T20:06:18.873903] [WARN ] [MAIN ] MDST: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:06:18.856568] [INFO ] [MAIN ] MD: Loaded 38329 existing records. [2025-10-02T20:06:18.905353] [INFO ] [MAIN ] MDST: Wiping existing primary data before full refresh. [2025-10-02T20:06:18.927731] [INFO ] [LOCAL ] MDST: Starting deletion of primary data. [2025-10-02T20:06:18.985919] [DEBUG] [LOCAL ] MDST: Deleted primary data file. [2025-10-02T20:06:18.986101] [INFO ] [MAIN ] MDST: Starting full primary refresh. [2025-10-02T20:06:19.004700] [DEBUG] [LOCAL ] MDT: Loaded 53678 existing records from primary storage. [2025-10-02T20:06:19.132065] [INFO ] [MAIN ] MDT: Loaded 53678 existing records. [2025-10-02T20:06:19.459484] [WARN ] [MAIN ] MDU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:06:19.545604] [WARN ] [MAIN ] MD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:06:19.602900] [INFO ] [MAIN ] MDU: Wiping existing primary data before full refresh. [2025-10-02T20:06:19.614407] [INFO ] [MAIN ] MD: Wiping existing primary data before full refresh. [2025-10-02T20:06:19.639895] [INFO ] [LOCAL ] MDU: Starting deletion of primary data. [2025-10-02T20:06:19.652859] [DEBUG] [LOCAL ] MDU: Deleted primary data file. [2025-10-02T20:06:19.658144] [INFO ] [MAIN ] MDU: Starting full primary refresh. [2025-10-02T20:06:19.747755] [INFO ] [LOCAL ] MD: Starting deletion of primary data. [2025-10-02T20:06:19.886798] [WARN ] [MAIN ] MDT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:06:19.883221] [DEBUG] [LOCAL ] MD: Deleted primary data file. [2025-10-02T20:06:19.933528] [INFO ] [MAIN ] MDT: Wiping existing primary data before full refresh. [2025-10-02T20:06:19.923166] [INFO ] [MAIN ] MD: Starting full primary refresh. [2025-10-02T20:06:19.965613] [INFO ] [LOCAL ] MDT: Starting deletion of primary data. [2025-10-02T20:06:20.014784] [DEBUG] [LOCAL ] MDT: Deleted primary data file. [2025-10-02T20:06:20.116192] [INFO ] [MAIN ] MDT: Starting full primary refresh. [2025-10-02T20:06:20.197454] [INFO ] [REMOTE ] MDST: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:06:20.341257] [INFO ] [REMOTE ] MDST: Fetching primary data for 2024-12. [2025-10-02T20:06:20.905034] [INFO ] [REMOTE ] MDU: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:06:20.946222] [INFO ] [REMOTE ] MDU: Fetching primary data for 2024-12. [2025-10-02T20:06:21.033892] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-02T20:06:21.128049] [INFO ] [REMOTE ] MD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:06:21.123635] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-01. [2025-10-02T20:06:21.129437] [INFO ] [REMOTE ] MD: Fetching primary data for 2024-12. [2025-10-02T20:06:21.221360] [INFO ] [REMOTE ] MDT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:06:21.221732] [INFO ] [REMOTE ] MDT: Fetching primary data for 2024-12. [2025-10-02T20:06:21.764392] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-02T20:06:21.766840] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-02. [2025-10-02T20:06:22.259752] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-02T20:06:22.262468] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-03. [2025-10-02T20:06:22.603025] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-02T20:06:22.611405] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-01. [2025-10-02T20:06:22.642572] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-02T20:06:22.644618] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-04. [2025-10-02T20:06:22.789511] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-02T20:06:22.800904] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-01. [2025-10-02T20:06:23.000281] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-02T20:06:23.305235] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-02T20:06:23.472990] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-05. [2025-10-02T20:06:23.888893] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-02T20:06:23.954850] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-02T20:06:24.273046] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-02. [2025-10-02T20:06:24.429887] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-02T20:06:25.073024] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-02. [2025-10-02T20:06:25.734112] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-02T20:06:25.873033] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-03. [2025-10-02T20:06:26.673065] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-06. [2025-10-02T20:06:26.850827] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-02T20:06:27.359823] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-02T20:06:27.384897] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-02T20:06:27.473013] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-07. [2025-10-02T20:06:28.169580] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-02T20:06:28.273009] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-04. [2025-10-02T20:06:29.073005] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-03. [2025-10-02T20:06:29.730524] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-02T20:06:29.872999] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-01. [2025-10-02T20:06:30.336948] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-02T20:06:30.673013] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-05. [2025-10-02T20:06:31.472964] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-08. [2025-10-02T20:06:31.782992] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-02T20:06:32.190784] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-02T20:06:32.220720] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-02T20:06:32.273003] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-04. [2025-10-02T20:06:33.073005] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-09. [2025-10-02T20:06:33.878096] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-06. [2025-10-02T20:06:33.896316] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-02T20:06:33.913397] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-02T20:06:34.672999] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-05. [2025-10-02T20:06:35.373447] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-02T20:06:35.472995] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-02. [2025-10-02T20:06:36.262822] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-02T20:06:36.272963] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-07. [2025-10-02T20:06:36.945666] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-02T20:06:37.073008] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-06. [2025-10-02T20:06:37.664549] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-02T20:06:37.873003] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-03. [2025-10-02T20:06:38.642868] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-02T20:06:38.672974] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-07. [2025-10-02T20:06:39.472997] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-08. [2025-10-02T20:06:39.754940] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-02T20:06:40.090264] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-02T20:06:40.273068] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-04. [2025-10-02T20:06:40.970160] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-02T20:06:41.073002] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-09. [2025-10-02T20:06:41.872998] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-08. [2025-10-02T20:06:42.376863] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-02T20:06:42.417291] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-02T20:06:42.673051] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-10. [2025-10-02T20:06:43.148177] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-02T20:06:43.473019] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-10. [2025-10-02T20:06:43.789155] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-02T20:06:43.790859] [INFO ] [REMOTE ] MD: Full fetch complete (55162 records). [2025-10-02T20:06:43.791003] [DEBUG] [VALIDATOR ] MD: Validating primary data. [2025-10-02T20:06:44.149382] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-02T20:06:44.190779] [INFO ] [REMOTE ] MDST: Full fetch complete (8569 records). [2025-10-02T20:06:44.195223] [DEBUG] [VALIDATOR ] MDST: Validating primary data. [2025-10-02T20:06:44.282905] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-09. [2025-10-02T20:06:44.418540] [DEBUG] [VALIDATOR ] MD: All expected trading days are present. [2025-10-02T20:06:44.418736] [DEBUG] [VALIDATOR ] MD: Primary data validation passed. [2025-10-02T20:06:44.425566] [INFO ] [MAIN ] MD: Fetched primary data is valid. [2025-10-02T20:06:44.441178] [DEBUG] [LOCAL ] MD: Saving primary data. [2025-10-02T20:06:44.578758] [DEBUG] [LOCAL ] MD: Trimmed 55162 records to 38594 (keeping 200 days of data) [2025-10-02T20:06:44.836426] [DEBUG] [VALIDATOR ] MDST: All expected trading days are present. [2025-10-02T20:06:44.844363] [DEBUG] [VALIDATOR ] MDST: Primary data validation passed. [2025-10-02T20:06:44.849857] [INFO ] [MAIN ] MDST: Fetched primary data is valid. [2025-10-02T20:06:44.850581] [DEBUG] [LOCAL ] MDST: Saving primary data. [2025-10-02T20:06:44.853794] [DEBUG] [LOCAL ] MDST: Trimmed 8569 records to 5730 (keeping 200 days of data) [2025-10-02T20:06:44.900627] [DEBUG] [LOCAL ] MDST: Primary data saved (5730 records). [2025-10-02T20:06:44.900843] [INFO ] [MAIN ] MDST: Full history saved. [2025-10-02T20:06:44.900963] [INFO ] [MAIN ] Update Progress: 1321/2370 symbols completed. MDST took 27.2s. Estimated remaining: 2h 28m 15s. Rate: 7.1 symbols/min [2025-10-02T20:06:45.076895] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-05. [2025-10-02T20:06:45.210853] [INFO ] [MAIN ] MDV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:06:45.221881] [DEBUG] [LOCAL ] MD: Primary data saved (38594 records). [2025-10-02T20:06:45.222030] [INFO ] [MAIN ] MD: Full history saved. [2025-10-02T20:06:45.222168] [INFO ] [MAIN ] Update Progress: 1322/2370 symbols completed. MD took 27.5s. Estimated remaining: 2h 27m 60s. Rate: 7.1 symbols/min [2025-10-02T20:06:45.289612] [DEBUG] [LOCAL ] MDV: Loaded 8486 existing records from primary storage. [2025-10-02T20:06:45.299510] [INFO ] [MAIN ] MDV: Loaded 8486 existing records. [2025-10-02T20:06:45.544326] [INFO ] [MAIN ] MEC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:06:45.617334] [WARN ] [MAIN ] MDV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:06:45.621952] [INFO ] [MAIN ] MDV: Wiping existing primary data before full refresh. [2025-10-02T20:06:45.622010] [INFO ] [LOCAL ] MDV: Starting deletion of primary data. [2025-10-02T20:06:45.622367] [DEBUG] [LOCAL ] MDV: Deleted primary data file. [2025-10-02T20:06:45.622429] [INFO ] [MAIN ] MDV: Starting full primary refresh. [2025-10-02T20:06:45.715055] [DEBUG] [LOCAL ] MEC: Loaded 16283 existing records from primary storage. [2025-10-02T20:06:45.739858] [INFO ] [MAIN ] MEC: Loaded 16283 existing records. [2025-10-02T20:06:46.180110] [WARN ] [MAIN ] MEC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:06:46.243665] [INFO ] [MAIN ] MEC: Wiping existing primary data before full refresh. [2025-10-02T20:06:46.252358] [INFO ] [LOCAL ] MEC: Starting deletion of primary data. [2025-10-02T20:06:46.252077] [INFO ] [REMOTE ] MDV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:06:46.252882] [INFO ] [REMOTE ] MDV: Fetching primary data for 2024-12. [2025-10-02T20:06:46.254249] [DEBUG] [LOCAL ] MEC: Deleted primary data file. [2025-10-02T20:06:46.254365] [INFO ] [MAIN ] MEC: Starting full primary refresh. [2025-10-02T20:06:46.490984] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-02T20:06:46.678116] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-10. [2025-10-02T20:06:46.721728] [INFO ] [REMOTE ] MEC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:06:46.966556] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-02T20:06:47.070272] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-02T20:06:47.473045] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-01. [2025-10-02T20:06:47.916181] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-02T20:06:47.918301] [INFO ] [REMOTE ] MDU: Full fetch complete (70417 records). [2025-10-02T20:06:47.918400] [DEBUG] [VALIDATOR ] MDU: Validating primary data. [2025-10-02T20:06:48.151423] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-02T20:06:48.278105] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-06. [2025-10-02T20:06:48.365450] [DEBUG] [VALIDATOR ] MDU: All expected trading days are present. [2025-10-02T20:06:48.365709] [DEBUG] [VALIDATOR ] MDU: Primary data validation passed. [2025-10-02T20:06:48.366832] [INFO ] [MAIN ] MDU: Fetched primary data is valid. [2025-10-02T20:06:48.366899] [DEBUG] [LOCAL ] MDU: Saving primary data. [2025-10-02T20:06:48.368480] [DEBUG] [LOCAL ] MDU: Trimmed 70417 records to 48324 (keeping 200 days of data) [2025-10-02T20:06:48.682440] [DEBUG] [LOCAL ] MDU: Primary data saved (48324 records). [2025-10-02T20:06:48.682594] [INFO ] [MAIN ] MDU: Full history saved. [2025-10-02T20:06:48.682727] [INFO ] [MAIN ] Update Progress: 1323/2370 symbols completed. MDU took 31.0s. Estimated remaining: 2h 27m 47s. Rate: 7.1 symbols/min [2025-10-02T20:06:48.890547] [INFO ] [MAIN ] MED: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:06:48.915409] [DEBUG] [LOCAL ] MED: Loaded 21517 existing records from primary storage. [2025-10-02T20:06:48.915740] [INFO ] [MAIN ] MED: Loaded 21517 existing records. [2025-10-02T20:06:49.078113] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-02. [2025-10-02T20:06:49.144683] [WARN ] [MAIN ] MED: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:06:49.144976] [INFO ] [MAIN ] MED: Wiping existing primary data before full refresh. [2025-10-02T20:06:49.145032] [INFO ] [LOCAL ] MED: Starting deletion of primary data. [2025-10-02T20:06:49.145556] [DEBUG] [LOCAL ] MED: Deleted primary data file. [2025-10-02T20:06:49.145618] [INFO ] [MAIN ] MED: Starting full primary refresh. [2025-10-02T20:06:49.544123] [INFO ] [REMOTE ] MED: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:06:49.862733] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-02T20:06:49.873422] [INFO ] [REMOTE ] MEC: Fetching primary data for 2024-12. [2025-10-02T20:06:49.881976] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-02T20:06:50.672981] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-07. [2025-10-02T20:06:50.807479] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-02T20:06:51.473010] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-01. [2025-10-02T20:06:52.164948] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-02T20:06:52.273043] [INFO ] [REMOTE ] MED: Fetching primary data for 2024-12. [2025-10-02T20:06:52.656425] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-02T20:06:53.073062] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-02. [2025-10-02T20:06:53.512989] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-02T20:06:53.738402] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-02T20:06:53.873040] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-08. [2025-10-02T20:06:54.673009] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-03. [2025-10-02T20:06:55.345704] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-02T20:06:55.472999] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-01. [2025-10-02T20:06:55.860260] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-02T20:06:56.272982] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-09. [2025-10-02T20:06:56.675097] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-02T20:06:57.073100] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-04. [2025-10-02T20:06:57.807900] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-02T20:06:57.873027] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-10. [2025-10-02T20:06:57.941035] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-02T20:06:58.673085] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-02. [2025-10-02T20:06:59.473077] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-05. [2025-10-02T20:06:59.501073] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-02T20:06:59.503521] [INFO ] [REMOTE ] MDT: Full fetch complete (77699 records). [2025-10-02T20:06:59.503774] [DEBUG] [VALIDATOR ] MDT: Validating primary data. [2025-10-02T20:06:59.985315] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-02T20:06:59.985604] [DEBUG] [VALIDATOR ] MDT: All expected trading days are present. [2025-10-02T20:06:59.985787] [DEBUG] [VALIDATOR ] MDT: Primary data validation passed. [2025-10-02T20:06:59.987385] [INFO ] [MAIN ] MDT: Fetched primary data is valid. [2025-10-02T20:06:59.987498] [DEBUG] [LOCAL ] MDT: Saving primary data. [2025-10-02T20:06:59.996852] [DEBUG] [LOCAL ] MDT: Trimmed 77699 records to 54068 (keeping 200 days of data) [2025-10-02T20:07:00.305868] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-03. [2025-10-02T20:07:00.354095] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-02T20:07:00.377363] [DEBUG] [LOCAL ] MDT: Primary data saved (54068 records). [2025-10-02T20:07:00.377551] [INFO ] [MAIN ] MDT: Full history saved. [2025-10-02T20:07:00.377713] [INFO ] [MAIN ] Update Progress: 1324/2370 symbols completed. MDT took 42.6s. Estimated remaining: 2h 27m 41s. Rate: 7.1 symbols/min [2025-10-02T20:07:00.571559] [INFO ] [MAIN ] MEG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:07:00.605619] [DEBUG] [LOCAL ] MEG: Loaded 31808 existing records from primary storage. [2025-10-02T20:07:00.605949] [INFO ] [MAIN ] MEG: Loaded 31808 existing records. [2025-10-02T20:07:00.800408] [WARN ] [MAIN ] MEG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:07:00.800801] [INFO ] [MAIN ] MEG: Wiping existing primary data before full refresh. [2025-10-02T20:07:00.800857] [INFO ] [LOCAL ] MEG: Starting deletion of primary data. [2025-10-02T20:07:00.802616] [DEBUG] [LOCAL ] MEG: Deleted primary data file. [2025-10-02T20:07:00.802721] [INFO ] [MAIN ] MEG: Starting full primary refresh. [2025-10-02T20:07:01.078096] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-03. [2025-10-02T20:07:01.209746] [INFO ] [REMOTE ] MEG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:07:01.483589] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-02T20:07:01.873030] [INFO ] [REMOTE ] MEG: Fetching primary data for 2024-12. [2025-10-02T20:07:02.200383] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-02T20:07:02.673030] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-04. [2025-10-02T20:07:03.412003] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-02T20:07:03.472977] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-01. [2025-10-02T20:07:03.569749] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-02T20:07:04.273192] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-04. [2025-10-02T20:07:04.912159] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-02T20:07:05.073039] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-05. [2025-10-02T20:07:05.324920] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-02T20:07:05.853105] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-02T20:07:05.872982] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-06. [2025-10-02T20:07:06.673043] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-06. [2025-10-02T20:07:07.027922] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-02T20:07:07.472983] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-07. [2025-10-02T20:07:07.512933] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-02T20:07:08.273046] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-07. [2025-10-02T20:07:08.619477] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-02T20:07:09.044680] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-02T20:07:09.073028] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-08. [2025-10-02T20:07:09.873040] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-08. [2025-10-02T20:07:10.123746] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-02T20:07:10.673041] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-09. [2025-10-02T20:07:10.787895] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-02T20:07:11.472989] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-09. [2025-10-02T20:07:11.735253] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-02T20:07:12.195208] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-02T20:07:12.273072] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-02. [2025-10-02T20:07:13.073047] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-05. [2025-10-02T20:07:13.583833] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-02T20:07:13.873062] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-03. [2025-10-02T20:07:14.069568] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-02T20:07:14.673032] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-06. [2025-10-02T20:07:15.257087] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-02T20:07:15.473031] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-04. [2025-10-02T20:07:15.813017] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-02T20:07:16.273050] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-10. [2025-10-02T20:07:16.749941] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-02T20:07:16.751046] [INFO ] [REMOTE ] MDV: Full fetch complete (11683 records). [2025-10-02T20:07:16.751127] [DEBUG] [VALIDATOR ] MDV: Validating primary data. [2025-10-02T20:07:17.082380] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-10. [2025-10-02T20:07:17.209993] [DEBUG] [VALIDATOR ] MDV: All expected trading days are present. [2025-10-02T20:07:17.211549] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-02T20:07:17.211846] [DEBUG] [VALIDATOR ] MDV: Primary data validation passed. [2025-10-02T20:07:17.220787] [INFO ] [MAIN ] MDV: Fetched primary data is valid. [2025-10-02T20:07:17.221355] [DEBUG] [LOCAL ] MDV: Saving primary data. [2025-10-02T20:07:17.222357] [DEBUG] [LOCAL ] MDV: Trimmed 11683 records to 8576 (keeping 200 days of data) [2025-10-02T20:07:17.282187] [DEBUG] [LOCAL ] MDV: Primary data saved (8576 records). [2025-10-02T20:07:17.282340] [INFO ] [MAIN ] MDV: Full history saved. [2025-10-02T20:07:17.282487] [INFO ] [MAIN ] Update Progress: 1325/2370 symbols completed. MDV took 32.4s. Estimated remaining: 2h 27m 40s. Rate: 7.1 symbols/min [2025-10-02T20:07:17.472500] [INFO ] [MAIN ] MEGI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:07:17.496722] [DEBUG] [LOCAL ] MEGI: Loaded 20116 existing records from primary storage. [2025-10-02T20:07:17.496995] [INFO ] [MAIN ] MEGI: Loaded 20116 existing records. [2025-10-02T20:07:17.700109] [WARN ] [MAIN ] MEGI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:07:17.700312] [INFO ] [MAIN ] MEGI: Wiping existing primary data before full refresh. [2025-10-02T20:07:17.700361] [INFO ] [LOCAL ] MEGI: Starting deletion of primary data. [2025-10-02T20:07:17.701318] [DEBUG] [LOCAL ] MEGI: Deleted primary data file. [2025-10-02T20:07:17.701380] [INFO ] [MAIN ] MEGI: Starting full primary refresh. [2025-10-02T20:07:17.876763] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-07. [2025-10-02T20:07:18.008013] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-02T20:07:18.021804] [INFO ] [REMOTE ] MED: Full fetch complete (32623 records). [2025-10-02T20:07:18.032488] [DEBUG] [VALIDATOR ] MED: Validating primary data. [2025-10-02T20:07:18.142271] [INFO ] [REMOTE ] MEGI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:07:18.498520] [DEBUG] [VALIDATOR ] MED: All expected trading days are present. [2025-10-02T20:07:18.498626] [DEBUG] [VALIDATOR ] MED: Primary data validation passed. [2025-10-02T20:07:18.500010] [INFO ] [MAIN ] MED: Fetched primary data is valid. [2025-10-02T20:07:18.500075] [DEBUG] [LOCAL ] MED: Saving primary data. [2025-10-02T20:07:18.501009] [DEBUG] [LOCAL ] MED: Trimmed 32623 records to 21638 (keeping 200 days of data) [2025-10-02T20:07:18.643010] [DEBUG] [LOCAL ] MED: Primary data saved (21638 records). [2025-10-02T20:07:18.643214] [INFO ] [MAIN ] MED: Full history saved. [2025-10-02T20:07:18.643344] [INFO ] [MAIN ] Update Progress: 1326/2370 symbols completed. MED took 30.0s. Estimated remaining: 2h 27m 26s. Rate: 7.1 symbols/min [2025-10-02T20:07:18.678301] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2024-12. [2025-10-02T20:07:18.821131] [INFO ] [MAIN ] MEI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:07:18.855197] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-02T20:07:18.870271] [DEBUG] [LOCAL ] MEI: Loaded 32017 existing records from primary storage. [2025-10-02T20:07:18.870659] [INFO ] [MAIN ] MEI: Loaded 32017 existing records. [2025-10-02T20:07:19.049836] [WARN ] [MAIN ] MEI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:07:19.050214] [INFO ] [MAIN ] MEI: Wiping existing primary data before full refresh. [2025-10-02T20:07:19.050322] [INFO ] [LOCAL ] MEI: Starting deletion of primary data. [2025-10-02T20:07:19.052109] [DEBUG] [LOCAL ] MEI: Deleted primary data file. [2025-10-02T20:07:19.052175] [INFO ] [MAIN ] MEI: Starting full primary refresh. [2025-10-02T20:07:19.421697] [INFO ] [REMOTE ] MEI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:07:19.473007] [INFO ] [REMOTE ] MEI: Fetching primary data for 2024-12. [2025-10-02T20:07:19.742783] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-02T20:07:20.273014] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-01. [2025-10-02T20:07:20.481716] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-02T20:07:21.072993] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-05. [2025-10-02T20:07:21.171491] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-02T20:07:21.873035] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-08. [2025-10-02T20:07:22.076217] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-02T20:07:22.673068] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-01. [2025-10-02T20:07:22.924898] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-02T20:07:23.473092] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-09. [2025-10-02T20:07:23.788341] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-02T20:07:24.272998] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-02. [2025-10-02T20:07:24.435866] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-02T20:07:25.025074] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-02T20:07:25.073070] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-02. [2025-10-02T20:07:25.873052] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-10. [2025-10-02T20:07:26.225424] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-02T20:07:26.673053] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-03. [2025-10-02T20:07:26.724421] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-02T20:07:26.725687] [INFO ] [REMOTE ] MEC: Full fetch complete (22849 records). [2025-10-02T20:07:26.725792] [DEBUG] [VALIDATOR ] MEC: Validating primary data. [2025-10-02T20:07:27.133921] [DEBUG] [VALIDATOR ] MEC: All expected trading days are present. [2025-10-02T20:07:27.134025] [DEBUG] [VALIDATOR ] MEC: Primary data validation passed. [2025-10-02T20:07:27.134632] [INFO ] [MAIN ] MEC: Fetched primary data is valid. [2025-10-02T20:07:27.134717] [DEBUG] [LOCAL ] MEC: Saving primary data. [2025-10-02T20:07:27.135417] [DEBUG] [LOCAL ] MEC: Trimmed 22849 records to 16383 (keeping 200 days of data) [2025-10-02T20:07:27.236729] [DEBUG] [LOCAL ] MEC: Primary data saved (16383 records). [2025-10-02T20:07:27.236889] [INFO ] [MAIN ] MEC: Full history saved. [2025-10-02T20:07:27.236987] [INFO ] [MAIN ] Update Progress: 1327/2370 symbols completed. MEC took 42.0s. Estimated remaining: 2h 27m 17s. Rate: 7.1 symbols/min [2025-10-02T20:07:27.421307] [INFO ] [MAIN ] MET: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:07:27.475140] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-03. [2025-10-02T20:07:27.477619] [DEBUG] [LOCAL ] MET: Loaded 53311 existing records from primary storage. [2025-10-02T20:07:27.478179] [INFO ] [MAIN ] MET: Loaded 53311 existing records. [2025-10-02T20:07:27.675021] [WARN ] [MAIN ] MET: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:07:27.675314] [INFO ] [MAIN ] MET: Wiping existing primary data before full refresh. [2025-10-02T20:07:27.675372] [INFO ] [LOCAL ] MET: Starting deletion of primary data. [2025-10-02T20:07:27.676791] [DEBUG] [LOCAL ] MET: Deleted primary data file. [2025-10-02T20:07:27.676856] [INFO ] [MAIN ] MET: Starting full primary refresh. [2025-10-02T20:07:28.092127] [INFO ] [REMOTE ] MET: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:07:28.208601] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-02T20:07:28.272964] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-04. [2025-10-02T20:07:28.659375] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-02T20:07:29.073034] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-04. [2025-10-02T20:07:29.363711] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-02T20:07:29.873016] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-06. [2025-10-02T20:07:30.136080] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-02T20:07:30.673026] [INFO ] [REMOTE ] MET: Fetching primary data for 2024-12. [2025-10-02T20:07:31.103772] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-02T20:07:31.473189] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-05. [2025-10-02T20:07:32.272999] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-05. [2025-10-02T20:07:32.341977] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-02T20:07:32.469984] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-02T20:07:33.073060] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-06. [2025-10-02T20:07:33.405085] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-02T20:07:33.723105] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-02T20:07:33.873024] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-07. [2025-10-02T20:07:34.672987] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-06. [2025-10-02T20:07:34.985593] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-02T20:07:35.473071] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-08. [2025-10-02T20:07:35.836851] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-02T20:07:36.273030] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-07. [2025-10-02T20:07:36.627883] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-02T20:07:37.073041] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-01. [2025-10-02T20:07:37.754624] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-02T20:07:37.873018] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-09. [2025-10-02T20:07:38.490468] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-02T20:07:38.672987] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-08. [2025-10-02T20:07:38.913367] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-02T20:07:39.472994] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-10. [2025-10-02T20:07:40.028421] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-02T20:07:40.272998] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-02. [2025-10-02T20:07:40.357936] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-02T20:07:40.359144] [INFO ] [REMOTE ] MEGI: Full fetch complete (30366 records). [2025-10-02T20:07:40.359220] [DEBUG] [VALIDATOR ] MEGI: Validating primary data. [2025-10-02T20:07:40.845393] [DEBUG] [VALIDATOR ] MEGI: All expected trading days are present. [2025-10-02T20:07:40.845505] [DEBUG] [VALIDATOR ] MEGI: Primary data validation passed. [2025-10-02T20:07:40.846235] [INFO ] [MAIN ] MEGI: Fetched primary data is valid. [2025-10-02T20:07:40.846304] [DEBUG] [LOCAL ] MEGI: Saving primary data. [2025-10-02T20:07:40.847347] [DEBUG] [LOCAL ] MEGI: Trimmed 30366 records to 20228 (keeping 200 days of data) [2025-10-02T20:07:40.987362] [DEBUG] [LOCAL ] MEGI: Primary data saved (20228 records). [2025-10-02T20:07:40.987531] [INFO ] [MAIN ] MEGI: Full history saved. [2025-10-02T20:07:40.987627] [INFO ] [MAIN ] Update Progress: 1328/2370 symbols completed. MEGI took 23.7s. Estimated remaining: 2h 27m 13s. Rate: 7.1 symbols/min [2025-10-02T20:07:41.078140] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-09. [2025-10-02T20:07:41.181271] [INFO ] [MAIN ] MFA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:07:41.228425] [DEBUG] [LOCAL ] MFA: Loaded 45479 existing records from primary storage. [2025-10-02T20:07:41.228771] [INFO ] [MAIN ] MFA: Loaded 45479 existing records. [2025-10-02T20:07:41.435160] [WARN ] [MAIN ] MFA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:07:41.435442] [INFO ] [MAIN ] MFA: Wiping existing primary data before full refresh. [2025-10-02T20:07:41.435501] [INFO ] [LOCAL ] MFA: Starting deletion of primary data. [2025-10-02T20:07:41.437018] [DEBUG] [LOCAL ] MFA: Deleted primary data file. [2025-10-02T20:07:41.437112] [INFO ] [MAIN ] MFA: Starting full primary refresh. [2025-10-02T20:07:41.851515] [INFO ] [REMOTE ] MFA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:07:41.873032] [INFO ] [REMOTE ] MFA: Fetching primary data for 2024-12. [2025-10-02T20:07:41.949794] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-02T20:07:42.489074] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-02T20:07:42.673018] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-10. [2025-10-02T20:07:43.429369] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-02T20:07:43.472990] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-01. [2025-10-02T20:07:43.657391] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-02T20:07:43.659069] [INFO ] [REMOTE ] MEI: Full fetch complete (45521 records). [2025-10-02T20:07:43.659155] [DEBUG] [VALIDATOR ] MEI: Validating primary data. [2025-10-02T20:07:44.115734] [DEBUG] [VALIDATOR ] MEI: All expected trading days are present. [2025-10-02T20:07:44.115828] [DEBUG] [VALIDATOR ] MEI: Primary data validation passed. [2025-10-02T20:07:44.116696] [INFO ] [MAIN ] MEI: Fetched primary data is valid. [2025-10-02T20:07:44.116763] [DEBUG] [LOCAL ] MEI: Saving primary data. [2025-10-02T20:07:44.117935] [DEBUG] [LOCAL ] MEI: Trimmed 45521 records to 32265 (keeping 200 days of data) [2025-10-02T20:07:44.284090] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-03. [2025-10-02T20:07:44.342006] [DEBUG] [LOCAL ] MEI: Primary data saved (32265 records). [2025-10-02T20:07:44.342148] [INFO ] [MAIN ] MEI: Full history saved. [2025-10-02T20:07:44.342280] [INFO ] [MAIN ] Update Progress: 1329/2370 symbols completed. MEI took 25.7s. Estimated remaining: 2h 27m 0s. Rate: 7.1 symbols/min [2025-10-02T20:07:44.539677] [INFO ] [MAIN ] MFAN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:07:44.545680] [DEBUG] [LOCAL ] MFAN: Loaded 4236 existing records from primary storage. [2025-10-02T20:07:44.545866] [INFO ] [MAIN ] MFAN: Loaded 4236 existing records. [2025-10-02T20:07:44.749372] [WARN ] [MAIN ] MFAN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:07:44.749784] [INFO ] [MAIN ] MFAN: Wiping existing primary data before full refresh. [2025-10-02T20:07:44.749960] [INFO ] [LOCAL ] MFAN: Starting deletion of primary data. [2025-10-02T20:07:44.750387] [DEBUG] [LOCAL ] MFAN: Deleted primary data file. [2025-10-02T20:07:44.750456] [INFO ] [MAIN ] MFAN: Starting full primary refresh. [2025-10-02T20:07:45.075967] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-07. [2025-10-02T20:07:45.186298] [INFO ] [REMOTE ] MFAN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:07:45.189136] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-02T20:07:45.873013] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-02. [2025-10-02T20:07:46.215760] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-02T20:07:46.244398] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-02T20:07:46.673039] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-04. [2025-10-02T20:07:47.472976] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-08. [2025-10-02T20:07:47.561881] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-02T20:07:48.272993] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2024-12. [2025-10-02T20:07:48.436811] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-02T20:07:48.565230] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2024-12 (0.29 seconds). [2025-10-02T20:07:48.728252] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-02T20:07:49.073009] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-01. [2025-10-02T20:07:49.419172] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-02T20:07:49.873015] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-02. [2025-10-02T20:07:50.337634] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-02T20:07:50.673044] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-05. [2025-10-02T20:07:51.473007] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-09. [2025-10-02T20:07:52.273025] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-03. [2025-10-02T20:07:52.500208] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-02T20:07:52.838109] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-02T20:07:53.072997] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-10. [2025-10-02T20:07:53.879165] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-06. [2025-10-02T20:07:53.884967] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-02T20:07:54.238878] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-02T20:07:54.240520] [INFO ] [REMOTE ] MEG: Full fetch complete (47910 records). [2025-10-02T20:07:54.240609] [DEBUG] [VALIDATOR ] MEG: Validating primary data. [2025-10-02T20:07:54.671143] [DEBUG] [VALIDATOR ] MEG: All expected trading days are present. [2025-10-02T20:07:54.671232] [DEBUG] [VALIDATOR ] MEG: Primary data validation passed. [2025-10-02T20:07:54.672106] [INFO ] [MAIN ] MEG: Fetched primary data is valid. [2025-10-02T20:07:54.672179] [DEBUG] [LOCAL ] MEG: Saving primary data. [2025-10-02T20:07:54.673081] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-04. [2025-10-02T20:07:54.674588] [DEBUG] [LOCAL ] MEG: Trimmed 47910 records to 32074 (keeping 200 days of data) [2025-10-02T20:07:54.874321] [DEBUG] [LOCAL ] MEG: Primary data saved (32074 records). [2025-10-02T20:07:54.874475] [INFO ] [MAIN ] MEG: Full history saved. [2025-10-02T20:07:54.874566] [INFO ] [MAIN ] Update Progress: 1330/2370 symbols completed. MEG took 54.5s. Estimated remaining: 2h 26m 53s. Rate: 7.1 symbols/min [2025-10-02T20:07:55.057789] [INFO ] [MAIN ] MFAO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:07:55.064719] [DEBUG] [LOCAL ] MFAO: Loaded 3828 existing records from primary storage. [2025-10-02T20:07:55.064977] [INFO ] [MAIN ] MFAO: Loaded 3828 existing records. [2025-10-02T20:07:55.256746] [WARN ] [MAIN ] MFAO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:07:55.256995] [INFO ] [MAIN ] MFAO: Wiping existing primary data before full refresh. [2025-10-02T20:07:55.257045] [INFO ] [LOCAL ] MFAO: Starting deletion of primary data. [2025-10-02T20:07:55.257355] [DEBUG] [LOCAL ] MFAO: Deleted primary data file. [2025-10-02T20:07:55.257465] [INFO ] [MAIN ] MFAO: Starting full primary refresh. [2025-10-02T20:07:55.500986] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-03. [2025-10-02T20:07:55.669659] [INFO ] [REMOTE ] MFAO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:07:55.743997] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-02T20:07:56.093281] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-02T20:07:56.135756] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-02T20:07:56.272994] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2024-12. [2025-10-02T20:07:56.707941] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-02T20:07:57.073035] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-05. [2025-10-02T20:07:57.873000] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-04. [2025-10-02T20:07:58.452571] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-02T20:07:58.666541] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-02T20:07:58.672955] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-05. [2025-10-02T20:07:59.262496] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-02T20:07:59.473013] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-06. [2025-10-02T20:08:00.273037] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-01. [2025-10-02T20:08:00.850526] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-02T20:08:01.078071] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-02. [2025-10-02T20:08:01.084023] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-02T20:08:01.638593] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-02T20:08:01.873001] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-07. [2025-10-02T20:08:02.673059] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-07. [2025-10-02T20:08:03.473060] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-06. [2025-10-02T20:08:03.620696] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-02T20:08:03.819379] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-02T20:08:04.285430] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-08. [2025-10-02T20:08:04.293515] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-02T20:08:05.073003] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-03. [2025-10-02T20:08:05.520939] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-02T20:08:05.872967] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-07. [2025-10-02T20:08:05.978355] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-02T20:08:06.220015] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-02T20:08:06.673031] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-04. [2025-10-02T20:08:07.290435] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-02T20:08:07.473021] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-05. [2025-10-02T20:08:08.056897] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-02T20:08:08.273036] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-08. [2025-10-02T20:08:08.895201] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-02T20:08:09.073018] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-09. [2025-10-02T20:08:09.622313] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-02T20:08:09.872993] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-08. [2025-10-02T20:08:10.673011] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-06. [2025-10-02T20:08:10.986567] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-02T20:08:11.472991] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-07. [2025-10-02T20:08:11.813933] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-02T20:08:12.019360] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-02T20:08:12.273023] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-09. [2025-10-02T20:08:13.073029] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-10. [2025-10-02T20:08:13.609257] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-02T20:08:13.610181] [INFO ] [REMOTE ] MFAN: Full fetch complete (5733 records). [2025-10-02T20:08:13.610258] [DEBUG] [VALIDATOR ] MFAN: Validating primary data. [2025-10-02T20:08:13.878167] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-09. [2025-10-02T20:08:14.039121] [DEBUG] [VALIDATOR ] MFAN: All expected trading days are present. [2025-10-02T20:08:14.039229] [DEBUG] [VALIDATOR ] MFAN: Primary data validation passed. [2025-10-02T20:08:14.039433] [INFO ] [MAIN ] MFAN: Fetched primary data is valid. [2025-10-02T20:08:14.039545] [DEBUG] [LOCAL ] MFAN: Saving primary data. [2025-10-02T20:08:14.040257] [DEBUG] [LOCAL ] MFAN: Trimmed 5733 records to 4277 (keeping 200 days of data) [2025-10-02T20:08:14.100865] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-02T20:08:14.114489] [DEBUG] [LOCAL ] MFAN: Primary data saved (4277 records). [2025-10-02T20:08:14.114866] [INFO ] [MAIN ] MFAN: Full history saved. [2025-10-02T20:08:14.115268] [INFO ] [MAIN ] Update Progress: 1331/2370 symbols completed. MFAN took 29.8s. Estimated remaining: 2h 26m 53s. Rate: 7.1 symbols/min [2025-10-02T20:08:14.303925] [INFO ] [MAIN ] MFC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:08:14.359533] [DEBUG] [LOCAL ] MFC: Loaded 51162 existing records from primary storage. [2025-10-02T20:08:14.359895] [INFO ] [MAIN ] MFC: Loaded 51162 existing records. [2025-10-02T20:08:14.557877] [WARN ] [MAIN ] MFC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:08:14.558147] [INFO ] [MAIN ] MFC: Wiping existing primary data before full refresh. [2025-10-02T20:08:14.558256] [INFO ] [LOCAL ] MFC: Starting deletion of primary data. [2025-10-02T20:08:14.559774] [DEBUG] [LOCAL ] MFC: Deleted primary data file. [2025-10-02T20:08:14.559838] [INFO ] [MAIN ] MFC: Starting full primary refresh. [2025-10-02T20:08:14.678141] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-08. [2025-10-02T20:08:14.941128] [INFO ] [REMOTE ] MFC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:08:15.298503] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-02T20:08:15.473000] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-09. [2025-10-02T20:08:15.577085] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-02T20:08:15.959673] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-02T20:08:16.273025] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-10. [2025-10-02T20:08:16.755517] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-02T20:08:16.756364] [INFO ] [REMOTE ] MFAO: Full fetch complete (5323 records). [2025-10-02T20:08:16.756444] [DEBUG] [VALIDATOR ] MFAO: Validating primary data. [2025-10-02T20:08:17.079080] [INFO ] [REMOTE ] MFC: Fetching primary data for 2024-12. [2025-10-02T20:08:17.169915] [DEBUG] [VALIDATOR ] MFAO: All expected trading days are present. [2025-10-02T20:08:17.170025] [DEBUG] [VALIDATOR ] MFAO: Primary data validation passed. [2025-10-02T20:08:17.170277] [INFO ] [MAIN ] MFAO: Fetched primary data is valid. [2025-10-02T20:08:17.170341] [DEBUG] [LOCAL ] MFAO: Saving primary data. [2025-10-02T20:08:17.170916] [DEBUG] [LOCAL ] MFAO: Trimmed 5323 records to 3857 (keeping 200 days of data) [2025-10-02T20:08:17.196575] [DEBUG] [LOCAL ] MFAO: Primary data saved (3857 records). [2025-10-02T20:08:17.196747] [INFO ] [MAIN ] MFAO: Full history saved. [2025-10-02T20:08:17.196886] [INFO ] [MAIN ] Update Progress: 1332/2370 symbols completed. MFAO took 22.3s. Estimated remaining: 2h 26m 41s. Rate: 7.1 symbols/min [2025-10-02T20:08:17.379988] [INFO ] [MAIN ] MFG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:08:17.430790] [DEBUG] [LOCAL ] MFG: Loaded 49225 existing records from primary storage. [2025-10-02T20:08:17.431181] [INFO ] [MAIN ] MFG: Loaded 49225 existing records. [2025-10-02T20:08:17.624231] [WARN ] [MAIN ] MFG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:08:17.624453] [INFO ] [MAIN ] MFG: Wiping existing primary data before full refresh. [2025-10-02T20:08:17.624510] [INFO ] [LOCAL ] MFG: Starting deletion of primary data. [2025-10-02T20:08:17.625710] [DEBUG] [LOCAL ] MFG: Deleted primary data file. [2025-10-02T20:08:17.625774] [INFO ] [MAIN ] MFG: Starting full primary refresh. [2025-10-02T20:08:17.885238] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-10. [2025-10-02T20:08:18.013440] [INFO ] [REMOTE ] MFG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:08:18.672992] [INFO ] [REMOTE ] MFG: Fetching primary data for 2024-12. [2025-10-02T20:08:18.824240] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-02T20:08:19.436897] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-02T20:08:19.438918] [INFO ] [REMOTE ] MFA: Full fetch complete (65155 records). [2025-10-02T20:08:19.439025] [DEBUG] [VALIDATOR ] MFA: Validating primary data. [2025-10-02T20:08:19.478122] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-01. [2025-10-02T20:08:19.905462] [DEBUG] [VALIDATOR ] MFA: All expected trading days are present. [2025-10-02T20:08:19.905560] [DEBUG] [VALIDATOR ] MFA: Primary data validation passed. [2025-10-02T20:08:19.906561] [INFO ] [MAIN ] MFA: Fetched primary data is valid. [2025-10-02T20:08:19.906631] [DEBUG] [LOCAL ] MFA: Saving primary data. [2025-10-02T20:08:19.908179] [DEBUG] [LOCAL ] MFA: Trimmed 65155 records to 45805 (keeping 200 days of data) [2025-10-02T20:08:20.209190] [DEBUG] [LOCAL ] MFA: Primary data saved (45805 records). [2025-10-02T20:08:20.209320] [INFO ] [MAIN ] MFA: Full history saved. [2025-10-02T20:08:20.209401] [INFO ] [MAIN ] Update Progress: 1333/2370 symbols completed. MFA took 39.2s. Estimated remaining: 2h 26m 28s. Rate: 7.1 symbols/min [2025-10-02T20:08:20.277973] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-10. [2025-10-02T20:08:20.427040] [INFO ] [MAIN ] MFM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:08:20.423410] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-02T20:08:20.451313] [DEBUG] [LOCAL ] MFM: Loaded 14610 existing records from primary storage. [2025-10-02T20:08:20.451552] [INFO ] [MAIN ] MFM: Loaded 14610 existing records. [2025-10-02T20:08:20.644179] [WARN ] [MAIN ] MFM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:08:20.644375] [INFO ] [MAIN ] MFM: Wiping existing primary data before full refresh. [2025-10-02T20:08:20.644425] [INFO ] [LOCAL ] MFM: Starting deletion of primary data. [2025-10-02T20:08:20.644991] [DEBUG] [LOCAL ] MFM: Deleted primary data file. [2025-10-02T20:08:20.645052] [INFO ] [MAIN ] MFM: Starting full primary refresh. [2025-10-02T20:08:21.031616] [INFO ] [REMOTE ] MFM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:08:21.070313] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-02T20:08:21.080169] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-01. [2025-10-02T20:08:21.872984] [INFO ] [REMOTE ] MFM: Fetching primary data for 2024-12. [2025-10-02T20:08:22.065092] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-02T20:08:22.068069] [INFO ] [REMOTE ] MET: Full fetch complete (77117 records). [2025-10-02T20:08:22.068198] [DEBUG] [VALIDATOR ] MET: Validating primary data. [2025-10-02T20:08:22.512711] [DEBUG] [VALIDATOR ] MET: All expected trading days are present. [2025-10-02T20:08:22.512884] [DEBUG] [VALIDATOR ] MET: Primary data validation passed. [2025-10-02T20:08:22.513994] [INFO ] [MAIN ] MET: Fetched primary data is valid. [2025-10-02T20:08:22.514075] [DEBUG] [LOCAL ] MET: Saving primary data. [2025-10-02T20:08:22.515721] [DEBUG] [LOCAL ] MET: Trimmed 77117 records to 53701 (keeping 200 days of data) [2025-10-02T20:08:22.720023] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-02. [2025-10-02T20:08:22.791316] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-02T20:08:22.922956] [DEBUG] [LOCAL ] MET: Primary data saved (53701 records). [2025-10-02T20:08:22.923103] [INFO ] [MAIN ] MET: Full history saved. [2025-10-02T20:08:22.923192] [INFO ] [MAIN ] Update Progress: 1334/2370 symbols completed. MET took 55.7s. Estimated remaining: 2h 26m 15s. Rate: 7.1 symbols/min [2025-10-02T20:08:23.122021] [INFO ] [MAIN ] MFSB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:08:23.122277] [DEBUG] [LOCAL ] MFSB: No existing data file found in primary storage. [2025-10-02T20:08:23.122343] [WARN ] [MAIN ] MFSB: No existing data found, performing full refresh instead. [2025-10-02T20:08:23.122497] [INFO ] [MAIN ] MFSB: Wiping existing primary data before full refresh. [2025-10-02T20:08:23.122554] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-10-02T20:08:23.122602] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-10-02T20:08:23.122686] [INFO ] [MAIN ] MFSB: Starting full primary refresh. [2025-10-02T20:08:23.480805] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-02. [2025-10-02T20:08:23.507080] [INFO ] [REMOTE ] MFSB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:08:24.272995] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2024-12. [2025-10-02T20:08:24.441492] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-02T20:08:24.562321] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2024-12 (0.29 seconds). [2025-10-02T20:08:24.752448] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-02T20:08:25.072995] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-01. [2025-10-02T20:08:25.396501] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-02T20:08:25.872965] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-03. [2025-10-02T20:08:25.957712] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2024-12 (4.08 seconds). [2025-10-02T20:08:26.672997] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-03. [2025-10-02T20:08:27.473013] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-02. [2025-10-02T20:08:27.641633] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-02T20:08:27.732993] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-10-02T20:08:28.251785] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-02T20:08:28.273043] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-04. [2025-10-02T20:08:29.073020] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-03. [2025-10-02T20:08:29.400591] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-02T20:08:29.872983] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-04. [2025-10-02T20:08:29.970752] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-02T20:08:30.673025] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-01. [2025-10-02T20:08:31.407499] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-02T20:08:31.473016] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-05. [2025-10-02T20:08:31.559079] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-02T20:08:32.273049] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-05. [2025-10-02T20:08:33.001300] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-02T20:08:33.073001] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-04. [2025-10-02T20:08:33.391802] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-02T20:08:33.873005] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-06. [2025-10-02T20:08:34.007479] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-02T20:08:34.673028] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-02. [2025-10-02T20:08:35.238632] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-02T20:08:35.394896] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-02T20:08:35.473001] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-05. [2025-10-02T20:08:35.710026] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-05 (0.24 seconds). [2025-10-02T20:08:36.273034] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-06. [2025-10-02T20:08:36.545769] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-10-02T20:08:37.073046] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-03. [2025-10-02T20:08:37.668753] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-02T20:08:37.873007] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-07. [2025-10-02T20:08:38.673052] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-04. [2025-10-02T20:08:38.776268] [DEBUG] [REMOTE ] MFM: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-10-02T20:08:38.776614] [WARN ] [REMOTE ] MFM: No data returned for month 2025-04 [2025-10-02T20:08:38.776742] [FATAL] [REMOTE ] MFM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T20:08:38.776858] [FATAL] [MAIN ] MFM: Failed to fetch primary data. [2025-10-02T20:08:38.776928] [WARN ] [MAIN ] MFM: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T20:08:38.777001] [INFO ] [LOCAL ] MFM: Starting deletion of primary data. [2025-10-02T20:08:38.777068] [DEBUG] [LOCAL ] MFM: No primary data file found to delete. [2025-10-02T20:08:38.777107] [INFO ] [LOCAL ] MFM: Starting deletion of derivative data. [2025-10-02T20:08:38.777628] [DEBUG] [LOCAL ] MFM: Deleted derivative data file. [2025-10-02T20:08:38.777772] [INFO ] [MAIN ] Update Progress: 1335/2370 symbols completed. MFM took 18.6s. Estimated remaining: 2h 26m 12s. Rate: 7.1 symbols/min [2025-10-02T20:08:38.968468] [INFO ] [MAIN ] MFSG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:08:38.977098] [DEBUG] [LOCAL ] MFSG: Loaded 5380 existing records from primary storage. [2025-10-02T20:08:38.977324] [INFO ] [MAIN ] MFSG: Loaded 5380 existing records. [2025-10-02T20:08:39.178421] [WARN ] [MAIN ] MFSG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:08:39.178662] [INFO ] [MAIN ] MFSG: Wiping existing primary data before full refresh. [2025-10-02T20:08:39.178727] [INFO ] [LOCAL ] MFSG: Starting deletion of primary data. [2025-10-02T20:08:39.179024] [DEBUG] [LOCAL ] MFSG: Deleted primary data file. [2025-10-02T20:08:39.179085] [INFO ] [MAIN ] MFSG: Starting full primary refresh. [2025-10-02T20:08:39.476004] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-06. [2025-10-02T20:08:39.618486] [INFO ] [REMOTE ] MFSG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:08:39.701362] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-02T20:08:40.273029] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-08. [2025-10-02T20:08:40.979231] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-02T20:08:41.072998] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-07. [2025-10-02T20:08:41.486631] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-02T20:08:41.541724] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-02T20:08:41.873012] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-08. [2025-10-02T20:08:42.341863] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-02T20:08:42.673004] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-07. [2025-10-02T20:08:43.473037] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-09. [2025-10-02T20:08:44.084309] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-02T20:08:44.163229] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-02T20:08:44.273046] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-08. [2025-10-02T20:08:45.073040] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-09. [2025-10-02T20:08:45.872976] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-10. [2025-10-02T20:08:45.912324] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-02T20:08:46.374713] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-02T20:08:46.375828] [INFO ] [REMOTE ] MFSB: Full fetch complete (1701 records). [2025-10-02T20:08:46.375968] [DEBUG] [VALIDATOR ] MFSB: Validating primary data. [2025-10-02T20:08:46.580889] [WARN ] [VALIDATOR ] MFSB: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-02T20:08:46.581207] [FATAL] [MAIN ] MFSB: Fetched primary data is invalid. Refusing to save it. [2025-10-02T20:08:46.581282] [WARN ] [MAIN ] MFSB: Deleting existing primary and derivative data due to validation failure. [2025-10-02T20:08:46.581369] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-10-02T20:08:46.581465] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-10-02T20:08:46.581523] [INFO ] [LOCAL ] MFSB: Starting deletion of derivative data. [2025-10-02T20:08:46.581584] [DEBUG] [LOCAL ] MFSB: No derivative data file found to delete. [2025-10-02T20:08:46.581716] [INFO ] [MAIN ] Update Progress: 1336/2370 symbols completed. MFSB took 23.7s. Estimated remaining: 2h 26m 3s. Rate: 7.1 symbols/min [2025-10-02T20:08:46.678233] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-09. [2025-10-02T20:08:46.798660] [INFO ] [MAIN ] MFSI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:08:46.801852] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-02T20:08:46.825838] [DEBUG] [LOCAL ] MFSI: Loaded 11442 existing records from primary storage. [2025-10-02T20:08:46.826119] [INFO ] [MAIN ] MFSI: Loaded 11442 existing records. [2025-10-02T20:08:47.021374] [WARN ] [MAIN ] MFSI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:08:47.021671] [INFO ] [MAIN ] MFSI: Wiping existing primary data before full refresh. [2025-10-02T20:08:47.021735] [INFO ] [LOCAL ] MFSI: Starting deletion of primary data. [2025-10-02T20:08:47.022276] [DEBUG] [LOCAL ] MFSI: Deleted primary data file. [2025-10-02T20:08:47.022352] [INFO ] [MAIN ] MFSI: Starting full primary refresh. [2025-10-02T20:08:47.445192] [INFO ] [REMOTE ] MFSI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:08:47.473005] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-10. [2025-10-02T20:08:48.273024] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2024-12. [2025-10-02T20:08:48.334903] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-02T20:08:48.780933] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-02T20:08:48.787020] [INFO ] [REMOTE ] MFG: Full fetch complete (68878 records). [2025-10-02T20:08:48.787183] [DEBUG] [VALIDATOR ] MFG: Validating primary data. [2025-10-02T20:08:48.855338] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-02T20:08:49.078239] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-01. [2025-10-02T20:08:49.244247] [DEBUG] [VALIDATOR ] MFG: All expected trading days are present. [2025-10-02T20:08:49.244356] [DEBUG] [VALIDATOR ] MFG: Primary data validation passed. [2025-10-02T20:08:49.245437] [INFO ] [MAIN ] MFG: Fetched primary data is valid. [2025-10-02T20:08:49.245508] [DEBUG] [LOCAL ] MFG: Saving primary data. [2025-10-02T20:08:49.247358] [DEBUG] [LOCAL ] MFG: Trimmed 68878 records to 49581 (keeping 200 days of data) [2025-10-02T20:08:49.575361] [DEBUG] [LOCAL ] MFG: Primary data saved (49581 records). [2025-10-02T20:08:49.575514] [INFO ] [MAIN ] MFG: Full history saved. [2025-10-02T20:08:49.575632] [INFO ] [MAIN ] Update Progress: 1337/2370 symbols completed. MFG took 32.4s. Estimated remaining: 2h 25m 51s. Rate: 7.1 symbols/min [2025-10-02T20:08:49.763269] [INFO ] [MAIN ] MFSV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:08:49.768349] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-02T20:08:49.776047] [DEBUG] [LOCAL ] MFSV: Loaded 2553 existing records from primary storage. [2025-10-02T20:08:49.776244] [INFO ] [MAIN ] MFSV: Loaded 2553 existing records. [2025-10-02T20:08:49.880630] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-02. [2025-10-02T20:08:49.965602] [WARN ] [MAIN ] MFSV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:08:49.965830] [INFO ] [MAIN ] MFSV: Wiping existing primary data before full refresh. [2025-10-02T20:08:49.965879] [INFO ] [LOCAL ] MFSV: Starting deletion of primary data. [2025-10-02T20:08:49.966162] [DEBUG] [LOCAL ] MFSV: Deleted primary data file. [2025-10-02T20:08:49.966225] [INFO ] [MAIN ] MFSV: Starting full primary refresh. [2025-10-02T20:08:50.373088] [INFO ] [REMOTE ] MFSV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:08:50.466929] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-02T20:08:50.673013] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2024-12. [2025-10-02T20:08:51.038265] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-10-02T20:08:51.473018] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-03. [2025-10-02T20:08:52.126719] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-02T20:08:52.273043] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2024-12. [2025-10-02T20:08:52.601452] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-10-02T20:08:53.073010] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-01. [2025-10-02T20:08:53.424947] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-02T20:08:53.873007] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-02. [2025-10-02T20:08:54.313495] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-02T20:08:54.673016] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-10. [2025-10-02T20:08:55.473044] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-03. [2025-10-02T20:08:55.930504] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-02T20:08:55.983676] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-02T20:08:55.985902] [INFO ] [REMOTE ] MFC: Full fetch complete (74160 records). [2025-10-02T20:08:55.986018] [DEBUG] [VALIDATOR ] MFC: Validating primary data. [2025-10-02T20:08:56.278253] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-04. [2025-10-02T20:08:56.440079] [DEBUG] [VALIDATOR ] MFC: All expected trading days are present. [2025-10-02T20:08:56.440171] [DEBUG] [VALIDATOR ] MFC: Primary data validation passed. [2025-10-02T20:08:56.441253] [INFO ] [MAIN ] MFC: Fetched primary data is valid. [2025-10-02T20:08:56.441334] [DEBUG] [LOCAL ] MFC: Saving primary data. [2025-10-02T20:08:56.443050] [DEBUG] [LOCAL ] MFC: Trimmed 74160 records to 51524 (keeping 200 days of data) [2025-10-02T20:08:56.779162] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-02T20:08:56.802352] [DEBUG] [LOCAL ] MFC: Primary data saved (51524 records). [2025-10-02T20:08:56.802569] [INFO ] [MAIN ] MFC: Full history saved. [2025-10-02T20:08:56.802721] [INFO ] [MAIN ] Update Progress: 1338/2370 symbols completed. MFC took 42.7s. Estimated remaining: 2h 25m 41s. Rate: 7.1 symbols/min [2025-10-02T20:08:56.998753] [INFO ] [MAIN ] MG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:08:57.017352] [DEBUG] [LOCAL ] MG: Loaded 16389 existing records from primary storage. [2025-10-02T20:08:57.017665] [INFO ] [MAIN ] MG: Loaded 16389 existing records. [2025-10-02T20:08:57.078292] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-01. [2025-10-02T20:08:57.219696] [WARN ] [MAIN ] MG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:08:57.219931] [INFO ] [MAIN ] MG: Wiping existing primary data before full refresh. [2025-10-02T20:08:57.219982] [INFO ] [LOCAL ] MG: Starting deletion of primary data. [2025-10-02T20:08:57.220565] [DEBUG] [LOCAL ] MG: Deleted primary data file. [2025-10-02T20:08:57.220628] [INFO ] [MAIN ] MG: Starting full primary refresh. [2025-10-02T20:08:57.614692] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-02T20:08:57.641075] [INFO ] [REMOTE ] MG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:08:57.873040] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-02. [2025-10-02T20:08:58.293562] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-02T20:08:58.673000] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-03. [2025-10-02T20:08:59.189195] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-02T20:08:59.473033] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-04. [2025-10-02T20:09:00.169184] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-02T20:09:00.273052] [INFO ] [REMOTE ] MG: Fetching primary data for 2024-12. [2025-10-02T20:09:01.073009] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-04. [2025-10-02T20:09:01.516716] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-02T20:09:01.681178] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-02T20:09:01.873011] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-05. [2025-10-02T20:09:02.608706] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-02T20:09:02.672998] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-05. [2025-10-02T20:09:03.224270] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-02T20:09:03.473041] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-05. [2025-10-02T20:09:03.757915] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-10-02T20:09:04.273035] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-06. [2025-10-02T20:09:04.874094] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-02T20:09:05.073011] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-07. [2025-10-02T20:09:05.489488] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-02T20:09:05.873018] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-06. [2025-10-02T20:09:06.289331] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-02T20:09:06.673006] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-08. [2025-10-02T20:09:07.200550] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-02T20:09:07.473059] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-09. [2025-10-02T20:09:08.222095] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-02T20:09:08.273021] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-01. [2025-10-02T20:09:09.072990] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-07. [2025-10-02T20:09:09.244726] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-02T20:09:09.533768] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-02T20:09:09.873015] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-06. [2025-10-02T20:09:10.672978] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-02. [2025-10-02T20:09:10.690139] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-02T20:09:11.475405] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-10. [2025-10-02T20:09:11.478704] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-02T20:09:12.029716] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-02T20:09:12.030533] [INFO ] [REMOTE ] MFSG: Full fetch complete (6125 records). [2025-10-02T20:09:12.030634] [DEBUG] [VALIDATOR ] MFSG: Validating primary data. [2025-10-02T20:09:12.282565] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-03. [2025-10-02T20:09:12.413744] [DEBUG] [VALIDATOR ] MFSG: All expected trading days are present. [2025-10-02T20:09:12.413827] [DEBUG] [VALIDATOR ] MFSG: Primary data validation passed. [2025-10-02T20:09:12.414012] [INFO ] [MAIN ] MFSG: Fetched primary data is valid. [2025-10-02T20:09:12.414078] [DEBUG] [LOCAL ] MFSG: Saving primary data. [2025-10-02T20:09:12.414494] [DEBUG] [LOCAL ] MFSG: Trimmed 6125 records to 5433 (keeping 200 days of data) [2025-10-02T20:09:12.447552] [DEBUG] [LOCAL ] MFSG: Primary data saved (5433 records). [2025-10-02T20:09:12.447741] [INFO ] [MAIN ] MFSG: Full history saved. [2025-10-02T20:09:12.447896] [INFO ] [MAIN ] Update Progress: 1339/2370 symbols completed. MFSG took 33.7s. Estimated remaining: 2h 25m 38s. Rate: 7.1 symbols/min [2025-10-02T20:09:12.621545] [INFO ] [MAIN ] MGA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:09:12.679111] [DEBUG] [LOCAL ] MGA: Loaded 50657 existing records from primary storage. [2025-10-02T20:09:12.679497] [INFO ] [MAIN ] MGA: Loaded 50657 existing records. [2025-10-02T20:09:12.879739] [WARN ] [MAIN ] MGA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:09:12.880078] [INFO ] [MAIN ] MGA: Wiping existing primary data before full refresh. [2025-10-02T20:09:12.880127] [INFO ] [LOCAL ] MGA: Starting deletion of primary data. [2025-10-02T20:09:12.881783] [DEBUG] [LOCAL ] MGA: Deleted primary data file. [2025-10-02T20:09:12.881850] [INFO ] [MAIN ] MGA: Starting full primary refresh. [2025-10-02T20:09:13.080014] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-08. [2025-10-02T20:09:13.217729] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-02T20:09:13.307622] [INFO ] [REMOTE ] MGA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:09:13.782382] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-02T20:09:13.873046] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-09. [2025-10-02T20:09:14.519071] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-02T20:09:14.673004] [INFO ] [REMOTE ] MGA: Fetching primary data for 2024-12. [2025-10-02T20:09:15.473041] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-04. [2025-10-02T20:09:16.225315] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-02T20:09:16.272965] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-07. [2025-10-02T20:09:16.484462] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-02T20:09:17.073015] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-10. [2025-10-02T20:09:17.202720] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-02T20:09:17.608378] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-02T20:09:17.609263] [INFO ] [REMOTE ] MFSV: Full fetch complete (3219 records). [2025-10-02T20:09:17.609338] [DEBUG] [VALIDATOR ] MFSV: Validating primary data. [2025-10-02T20:09:17.878156] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-01. [2025-10-02T20:09:18.001175] [DEBUG] [VALIDATOR ] MFSV: All expected trading days are present. [2025-10-02T20:09:18.001257] [DEBUG] [VALIDATOR ] MFSV: Primary data validation passed. [2025-10-02T20:09:18.001382] [INFO ] [MAIN ] MFSV: Fetched primary data is valid. [2025-10-02T20:09:18.001422] [DEBUG] [LOCAL ] MFSV: Saving primary data. [2025-10-02T20:09:18.001824] [DEBUG] [LOCAL ] MFSV: Trimmed 3219 records to 2596 (keeping 200 days of data) [2025-10-02T20:09:18.018756] [DEBUG] [LOCAL ] MFSV: Primary data saved (2596 records). [2025-10-02T20:09:18.018865] [INFO ] [MAIN ] MFSV: Full history saved. [2025-10-02T20:09:18.018982] [INFO ] [MAIN ] Update Progress: 1340/2370 symbols completed. MFSV took 28.4s. Estimated remaining: 2h 25m 27s. Rate: 7.1 symbols/min [2025-10-02T20:09:18.207780] [INFO ] [MAIN ] MGF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:09:18.215481] [DEBUG] [LOCAL ] MGF: Loaded 4260 existing records from primary storage. [2025-10-02T20:09:18.215738] [INFO ] [MAIN ] MGF: Loaded 4260 existing records. [2025-10-02T20:09:18.401503] [WARN ] [MAIN ] MGF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:09:18.401804] [INFO ] [MAIN ] MGF: Wiping existing primary data before full refresh. [2025-10-02T20:09:18.401864] [INFO ] [LOCAL ] MGF: Starting deletion of primary data. [2025-10-02T20:09:18.402142] [DEBUG] [LOCAL ] MGF: Deleted primary data file. [2025-10-02T20:09:18.402204] [INFO ] [MAIN ] MGF: Starting full primary refresh. [2025-10-02T20:09:18.679401] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-08. [2025-10-02T20:09:18.775499] [INFO ] [REMOTE ] MGF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:09:19.472974] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-05. [2025-10-02T20:09:19.558350] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-02T20:09:19.674029] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-02T20:09:20.165056] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-02T20:09:20.273048] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-02. [2025-10-02T20:09:21.073027] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-09. [2025-10-02T20:09:21.872998] [INFO ] [REMOTE ] MGF: Fetching primary data for 2024-12. [2025-10-02T20:09:22.027813] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-02T20:09:22.672990] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-03. [2025-10-02T20:09:23.473011] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-06. [2025-10-02T20:09:24.189200] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-02T20:09:24.275835] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-07. [2025-10-02T20:09:24.279927] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-02T20:09:25.073020] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-04. [2025-10-02T20:09:25.291041] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-02T20:09:25.773417] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2024-12 (3.90 seconds). [2025-10-02T20:09:25.873120] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-08. [2025-10-02T20:09:26.438608] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-09 (5.37 seconds). [2025-10-02T20:09:26.629057] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-02T20:09:26.672971] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-05. [2025-10-02T20:09:26.771911] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-02T20:09:27.473041] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-10. [2025-10-02T20:09:28.272976] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-01. [2025-10-02T20:09:28.366086] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-02T20:09:28.367420] [INFO ] [REMOTE ] MFSI: Full fetch complete (13788 records). [2025-10-02T20:09:28.367545] [DEBUG] [VALIDATOR ] MFSI: Validating primary data. [2025-10-02T20:09:28.646792] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-02T20:09:28.741441] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-02T20:09:28.851358] [DEBUG] [VALIDATOR ] MFSI: All expected trading days are present. [2025-10-02T20:09:28.851453] [DEBUG] [VALIDATOR ] MFSI: Primary data validation passed. [2025-10-02T20:09:28.851842] [INFO ] [MAIN ] MFSI: Fetched primary data is valid. [2025-10-02T20:09:28.851909] [DEBUG] [LOCAL ] MFSI: Saving primary data. [2025-10-02T20:09:28.852547] [DEBUG] [LOCAL ] MFSI: Trimmed 13788 records to 11578 (keeping 200 days of data) [2025-10-02T20:09:28.933722] [DEBUG] [LOCAL ] MFSI: Primary data saved (11578 records). [2025-10-02T20:09:28.933879] [INFO ] [MAIN ] MFSI: Full history saved. [2025-10-02T20:09:28.934016] [INFO ] [MAIN ] Update Progress: 1341/2370 symbols completed. MFSI took 42.4s. Estimated remaining: 2h 25m 21s. Rate: 7.1 symbols/min [2025-10-02T20:09:29.082546] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-09. [2025-10-02T20:09:29.119125] [INFO ] [MAIN ] MGM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:09:29.184841] [DEBUG] [LOCAL ] MGM: Loaded 53608 existing records from primary storage. [2025-10-02T20:09:29.185266] [INFO ] [MAIN ] MGM: Loaded 53608 existing records. [2025-10-02T20:09:29.399853] [WARN ] [MAIN ] MGM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:09:29.400072] [INFO ] [MAIN ] MGM: Wiping existing primary data before full refresh. [2025-10-02T20:09:29.400129] [INFO ] [LOCAL ] MGM: Starting deletion of primary data. [2025-10-02T20:09:29.401711] [DEBUG] [LOCAL ] MGM: Deleted primary data file. [2025-10-02T20:09:29.401803] [INFO ] [MAIN ] MGM: Starting full primary refresh. [2025-10-02T20:09:29.826637] [INFO ] [REMOTE ] MGM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:09:29.837150] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-02T20:09:29.873014] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-02. [2025-10-02T20:09:30.430305] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-02T20:09:30.673059] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-03. [2025-10-02T20:09:31.323875] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-02T20:09:31.473006] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-10. [2025-10-02T20:09:32.205089] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-02T20:09:32.206265] [INFO ] [REMOTE ] MG: Full fetch complete (24027 records). [2025-10-02T20:09:32.206342] [DEBUG] [VALIDATOR ] MG: Validating primary data. [2025-10-02T20:09:32.278089] [INFO ] [REMOTE ] MGM: Fetching primary data for 2024-12. [2025-10-02T20:09:32.622243] [DEBUG] [VALIDATOR ] MG: All expected trading days are present. [2025-10-02T20:09:32.622327] [DEBUG] [VALIDATOR ] MG: Primary data validation passed. [2025-10-02T20:09:32.622924] [INFO ] [MAIN ] MG: Fetched primary data is valid. [2025-10-02T20:09:32.622992] [DEBUG] [LOCAL ] MG: Saving primary data. [2025-10-02T20:09:32.623730] [DEBUG] [LOCAL ] MG: Trimmed 24027 records to 16524 (keeping 200 days of data) [2025-10-02T20:09:32.720426] [DEBUG] [LOCAL ] MG: Primary data saved (16524 records). [2025-10-02T20:09:32.720576] [INFO ] [MAIN ] MG: Full history saved. [2025-10-02T20:09:32.720682] [INFO ] [MAIN ] Update Progress: 1342/2370 symbols completed. MG took 35.9s. Estimated remaining: 2h 25m 9s. Rate: 7.1 symbols/min [2025-10-02T20:09:32.900780] [INFO ] [MAIN ] MGR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:09:32.911408] [DEBUG] [LOCAL ] MGR: Loaded 5614 existing records from primary storage. [2025-10-02T20:09:32.911632] [INFO ] [MAIN ] MGR: Loaded 5614 existing records. [2025-10-02T20:09:33.078337] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-04. [2025-10-02T20:09:33.101229] [WARN ] [MAIN ] MGR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:09:33.102459] [INFO ] [MAIN ] MGR: Wiping existing primary data before full refresh. [2025-10-02T20:09:33.102532] [INFO ] [LOCAL ] MGR: Starting deletion of primary data. [2025-10-02T20:09:33.102865] [DEBUG] [LOCAL ] MGR: Deleted primary data file. [2025-10-02T20:09:33.102926] [INFO ] [MAIN ] MGR: Starting full primary refresh. [2025-10-02T20:09:33.501772] [INFO ] [REMOTE ] MGR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:09:33.875822] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-02T20:09:33.874985] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-06. [2025-10-02T20:09:34.143296] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-02T20:09:34.673047] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-01. [2025-10-02T20:09:35.473038] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-05. [2025-10-02T20:09:35.570707] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-02T20:09:36.046949] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-02T20:09:36.261799] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-02T20:09:36.272955] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-02. [2025-10-02T20:09:37.072995] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-06. [2025-10-02T20:09:37.661123] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-02T20:09:37.873009] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-07. [2025-10-02T20:09:38.007337] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-02T20:09:38.673062] [INFO ] [REMOTE ] MGR: Fetching primary data for 2024-12. [2025-10-02T20:09:39.188763] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-10-02T20:09:39.473042] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-07. [2025-10-02T20:09:39.643367] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-02T20:09:40.035934] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-02T20:09:40.273033] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-03. [2025-10-02T20:09:41.073016] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-08. [2025-10-02T20:09:41.573071] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-02T20:09:41.872974] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-09. [2025-10-02T20:09:42.113394] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-02T20:09:42.443610] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-02T20:09:42.672947] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-10. [2025-10-02T20:09:43.246150] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-02T20:09:43.247026] [INFO ] [REMOTE ] MGF: Full fetch complete (5920 records). [2025-10-02T20:09:43.247097] [DEBUG] [VALIDATOR ] MGF: Validating primary data. [2025-10-02T20:09:43.478238] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-01. [2025-10-02T20:09:43.635520] [DEBUG] [VALIDATOR ] MGF: All expected trading days are present. [2025-10-02T20:09:43.635597] [DEBUG] [VALIDATOR ] MGF: Primary data validation passed. [2025-10-02T20:09:43.635797] [INFO ] [MAIN ] MGF: Fetched primary data is valid. [2025-10-02T20:09:43.635860] [DEBUG] [LOCAL ] MGF: Saving primary data. [2025-10-02T20:09:43.636247] [DEBUG] [LOCAL ] MGF: Trimmed 5920 records to 4296 (keeping 200 days of data) [2025-10-02T20:09:43.662670] [DEBUG] [LOCAL ] MGF: Primary data saved (4296 records). [2025-10-02T20:09:43.662807] [INFO ] [MAIN ] MGF: Full history saved. [2025-10-02T20:09:43.662904] [INFO ] [MAIN ] Update Progress: 1343/2370 symbols completed. MGF took 25.6s. Estimated remaining: 2h 25m 2s. Rate: 7.1 symbols/min [2025-10-02T20:09:43.864204] [INFO ] [MAIN ] MGRB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:09:43.864368] [DEBUG] [LOCAL ] MGRB: No existing data file found in primary storage. [2025-10-02T20:09:43.864405] [WARN ] [MAIN ] MGRB: No existing data found, performing full refresh instead. [2025-10-02T20:09:43.864554] [INFO ] [MAIN ] MGRB: Wiping existing primary data before full refresh. [2025-10-02T20:09:43.864611] [INFO ] [LOCAL ] MGRB: Starting deletion of primary data. [2025-10-02T20:09:43.864688] [DEBUG] [LOCAL ] MGRB: No primary data file found to delete. [2025-10-02T20:09:43.864739] [INFO ] [MAIN ] MGRB: Starting full primary refresh. [2025-10-02T20:09:44.173889] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-02T20:09:44.255564] [INFO ] [REMOTE ] MGRB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:09:44.272960] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2024-12. [2025-10-02T20:09:44.848970] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-02T20:09:45.073007] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-02. [2025-10-02T20:09:45.699923] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-02T20:09:45.873027] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-04. [2025-10-02T20:09:46.673031] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-03. [2025-10-02T20:09:47.358409] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-02T20:09:47.473041] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-01. [2025-10-02T20:09:47.748276] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-02T20:09:48.042609] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-02T20:09:48.273022] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-08. [2025-10-02T20:09:49.073035] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-04. [2025-10-02T20:09:49.688480] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-02T20:09:49.873023] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-02. [2025-10-02T20:09:50.097900] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-02T20:09:50.443335] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-02T20:09:50.673026] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-03. [2025-10-02T20:09:51.227851] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-02T20:09:51.473021] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-04. [2025-10-02T20:09:51.855124] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-02T20:09:52.273040] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-05. [2025-10-02T20:09:52.886077] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-02T20:09:53.073000] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-06. [2025-10-02T20:09:53.650043] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-02T20:09:53.873000] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-05. [2025-10-02T20:09:54.282955] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-02T20:09:54.673032] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-09. [2025-10-02T20:09:55.472967] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-07. [2025-10-02T20:09:56.041884] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-02T20:09:56.273049] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-05. [2025-10-02T20:09:56.356887] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-02T20:09:57.073021] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-08. [2025-10-02T20:09:57.687586] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-02T20:09:57.873007] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-10. [2025-10-02T20:09:58.104710] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-02T20:09:58.673012] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-09. [2025-10-02T20:09:59.126811] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-02T20:09:59.235246] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-02T20:09:59.241525] [INFO ] [REMOTE ] MGA: Full fetch complete (73710 records). [2025-10-02T20:09:59.241735] [DEBUG] [VALIDATOR ] MGA: Validating primary data. [2025-10-02T20:09:59.484042] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-06. [2025-10-02T20:09:59.717374] [DEBUG] [VALIDATOR ] MGA: All expected trading days are present. [2025-10-02T20:09:59.717473] [DEBUG] [VALIDATOR ] MGA: Primary data validation passed. [2025-10-02T20:09:59.718666] [INFO ] [MAIN ] MGA: Fetched primary data is valid. [2025-10-02T20:09:59.718743] [DEBUG] [LOCAL ] MGA: Saving primary data. [2025-10-02T20:09:59.720403] [DEBUG] [LOCAL ] MGA: Trimmed 73710 records to 51045 (keeping 200 days of data) [2025-10-02T20:10:00.058128] [DEBUG] [LOCAL ] MGA: Primary data saved (51045 records). [2025-10-02T20:10:00.058301] [INFO ] [MAIN ] MGA: Full history saved. [2025-10-02T20:10:00.058399] [INFO ] [MAIN ] Update Progress: 1344/2370 symbols completed. MGA took 47.6s. Estimated remaining: 2h 24m 60s. Rate: 7.1 symbols/min [2025-10-02T20:10:00.251274] [INFO ] [MAIN ] MGRD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:10:00.256878] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-02T20:10:00.263246] [DEBUG] [LOCAL ] MGRD: Loaded 2238 existing records from primary storage. [2025-10-02T20:10:00.263445] [INFO ] [MAIN ] MGRD: Loaded 2238 existing records. [2025-10-02T20:10:00.278124] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-06. [2025-10-02T20:10:00.459704] [WARN ] [MAIN ] MGRD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:10:00.459942] [INFO ] [MAIN ] MGRD: Wiping existing primary data before full refresh. [2025-10-02T20:10:00.459991] [INFO ] [LOCAL ] MGRD: Starting deletion of primary data. [2025-10-02T20:10:00.460226] [DEBUG] [LOCAL ] MGRD: Deleted primary data file. [2025-10-02T20:10:00.460286] [INFO ] [MAIN ] MGRD: Starting full primary refresh. [2025-10-02T20:10:00.838535] [INFO ] [REMOTE ] MGRD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:10:01.073004] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-10. [2025-10-02T20:10:01.499438] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-02T20:10:01.500552] [INFO ] [REMOTE ] MGRB: Full fetch complete (6090 records). [2025-10-02T20:10:01.500898] [DEBUG] [VALIDATOR ] MGRB: Validating primary data. [2025-10-02T20:10:01.874911] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2024-12. [2025-10-02T20:10:01.927786] [DEBUG] [VALIDATOR ] MGRB: All expected trading days are present. [2025-10-02T20:10:01.927902] [DEBUG] [VALIDATOR ] MGRB: Primary data validation passed. [2025-10-02T20:10:01.928115] [INFO ] [MAIN ] MGRB: Fetched primary data is valid. [2025-10-02T20:10:01.928305] [DEBUG] [LOCAL ] MGRB: Saving primary data. [2025-10-02T20:10:01.929380] [DEBUG] [LOCAL ] MGRB: Trimmed 6090 records to 4079 (keeping 200 days of data) [2025-10-02T20:10:01.959060] [DEBUG] [LOCAL ] MGRB: Primary data saved (4079 records). [2025-10-02T20:10:01.959285] [INFO ] [MAIN ] MGRB: Full history saved. [2025-10-02T20:10:01.959382] [INFO ] [MAIN ] Update Progress: 1345/2370 symbols completed. MGRB took 18.3s. Estimated remaining: 2h 24m 46s. Rate: 7.1 symbols/min [2025-10-02T20:10:02.194020] [INFO ] [MAIN ] MGRE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:10:02.236112] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-02T20:10:02.251583] [DEBUG] [LOCAL ] MGRE: Loaded 6698 existing records from primary storage. [2025-10-02T20:10:02.251915] [INFO ] [MAIN ] MGRE: Loaded 6698 existing records. [2025-10-02T20:10:02.454742] [WARN ] [MAIN ] MGRE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:10:02.455058] [INFO ] [MAIN ] MGRE: Wiping existing primary data before full refresh. [2025-10-02T20:10:02.455119] [INFO ] [LOCAL ] MGRE: Starting deletion of primary data. [2025-10-02T20:10:02.455538] [DEBUG] [LOCAL ] MGRE: Deleted primary data file. [2025-10-02T20:10:02.455601] [INFO ] [MAIN ] MGRE: Starting full primary refresh. [2025-10-02T20:10:02.529855] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-02T20:10:02.678154] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-07. [2025-10-02T20:10:02.869760] [INFO ] [REMOTE ] MGRE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:10:03.418376] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-02T20:10:03.473000] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-01. [2025-10-02T20:10:04.037867] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-02T20:10:04.272999] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-07. [2025-10-02T20:10:05.073030] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-02. [2025-10-02T20:10:05.543303] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-02T20:10:05.872968] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2024-12. [2025-10-02T20:10:05.917757] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-02T20:10:06.497128] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-02T20:10:06.673004] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-08. [2025-10-02T20:10:07.473027] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-01. [2025-10-02T20:10:08.121365] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-02T20:10:08.273021] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-08. [2025-10-02T20:10:08.628593] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-02T20:10:08.786572] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-02T20:10:09.073001] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-02. [2025-10-02T20:10:09.518718] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-02T20:10:09.873044] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-03. [2025-10-02T20:10:10.527840] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-02T20:10:10.673009] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-04. [2025-10-02T20:10:11.398810] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-02T20:10:11.473022] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-05. [2025-10-02T20:10:12.170356] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-02T20:10:12.273054] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-09. [2025-10-02T20:10:12.864481] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-02T20:10:13.073095] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-10. [2025-10-02T20:10:13.873016] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-06. [2025-10-02T20:10:14.280842] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-02T20:10:14.281667] [INFO ] [REMOTE ] MGR: Full fetch complete (8216 records). [2025-10-02T20:10:14.281805] [DEBUG] [VALIDATOR ] MGR: Validating primary data. [2025-10-02T20:10:14.636537] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-02T20:10:14.682439] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-09. [2025-10-02T20:10:14.730240] [DEBUG] [VALIDATOR ] MGR: All expected trading days are present. [2025-10-02T20:10:14.730331] [DEBUG] [VALIDATOR ] MGR: Primary data validation passed. [2025-10-02T20:10:14.730545] [INFO ] [MAIN ] MGR: Fetched primary data is valid. [2025-10-02T20:10:14.730588] [DEBUG] [LOCAL ] MGR: Saving primary data. [2025-10-02T20:10:14.731145] [DEBUG] [LOCAL ] MGR: Trimmed 8216 records to 5639 (keeping 200 days of data) [2025-10-02T20:10:14.770556] [DEBUG] [LOCAL ] MGR: Primary data saved (5639 records). [2025-10-02T20:10:14.770785] [INFO ] [MAIN ] MGR: Full history saved. [2025-10-02T20:10:14.770890] [INFO ] [MAIN ] Update Progress: 1346/2370 symbols completed. MGR took 42.1s. Estimated remaining: 2h 24m 41s. Rate: 7.1 symbols/min [2025-10-02T20:10:14.956701] [INFO ] [MAIN ] MGY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:10:15.014362] [DEBUG] [LOCAL ] MGY: Loaded 52421 existing records from primary storage. [2025-10-02T20:10:15.014745] [INFO ] [MAIN ] MGY: Loaded 52421 existing records. [2025-10-02T20:10:15.208738] [WARN ] [MAIN ] MGY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:10:15.208943] [INFO ] [MAIN ] MGY: Wiping existing primary data before full refresh. [2025-10-02T20:10:15.208992] [INFO ] [LOCAL ] MGY: Starting deletion of primary data. [2025-10-02T20:10:15.210679] [DEBUG] [LOCAL ] MGY: Deleted primary data file. [2025-10-02T20:10:15.210747] [INFO ] [MAIN ] MGY: Starting full primary refresh. [2025-10-02T20:10:15.478152] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-03. [2025-10-02T20:10:15.604161] [INFO ] [REMOTE ] MGY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:10:15.979285] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-02T20:10:16.272971] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-04. [2025-10-02T20:10:16.472350] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-02T20:10:16.750820] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-02T20:10:17.073000] [INFO ] [REMOTE ] MGY: Fetching primary data for 2024-12. [2025-10-02T20:10:17.872999] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-10. [2025-10-02T20:10:18.673014] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-07. [2025-10-02T20:10:18.788589] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-02T20:10:19.465618] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-02T20:10:19.472949] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-08. [2025-10-02T20:10:19.619854] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-02T20:10:19.624376] [INFO ] [REMOTE ] MGM: Full fetch complete (77602 records). [2025-10-02T20:10:19.624581] [DEBUG] [VALIDATOR ] MGM: Validating primary data. [2025-10-02T20:10:20.124512] [DEBUG] [VALIDATOR ] MGM: All expected trading days are present. [2025-10-02T20:10:20.124604] [DEBUG] [VALIDATOR ] MGM: Primary data validation passed. [2025-10-02T20:10:20.125856] [INFO ] [MAIN ] MGM: Fetched primary data is valid. [2025-10-02T20:10:20.125928] [DEBUG] [LOCAL ] MGM: Saving primary data. [2025-10-02T20:10:20.127718] [DEBUG] [LOCAL ] MGM: Trimmed 77602 records to 53997 (keeping 200 days of data) [2025-10-02T20:10:20.230478] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-02T20:10:20.273084] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-09. [2025-10-02T20:10:20.495163] [DEBUG] [LOCAL ] MGM: Primary data saved (53997 records). [2025-10-02T20:10:20.495319] [INFO ] [MAIN ] MGM: Full history saved. [2025-10-02T20:10:20.495408] [INFO ] [MAIN ] Update Progress: 1347/2370 symbols completed. MGM took 51.6s. Estimated remaining: 2h 24m 31s. Rate: 7.1 symbols/min [2025-10-02T20:10:20.699934] [INFO ] [MAIN ] MH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:10:20.700189] [DEBUG] [LOCAL ] MH: No existing data file found in primary storage. [2025-10-02T20:10:20.700247] [WARN ] [MAIN ] MH: No existing data found, performing full refresh instead. [2025-10-02T20:10:20.700367] [INFO ] [MAIN ] MH: Wiping existing primary data before full refresh. [2025-10-02T20:10:20.700410] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-10-02T20:10:20.700456] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-10-02T20:10:20.700491] [INFO ] [MAIN ] MH: Starting full primary refresh. [2025-10-02T20:10:21.082288] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-05. [2025-10-02T20:10:21.131364] [INFO ] [REMOTE ] MH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:10:21.138466] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-02T20:10:21.611796] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-02T20:10:21.873016] [INFO ] [REMOTE ] MH: Fetching primary data for 2024-12. [2025-10-02T20:10:22.065127] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T20:10:22.065468] [WARN ] [REMOTE ] MH: No data returned for month 2024-12 [2025-10-02T20:10:22.065595] [FATAL] [REMOTE ] MH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T20:10:22.065711] [FATAL] [MAIN ] MH: Failed to fetch primary data. [2025-10-02T20:10:22.065796] [WARN ] [MAIN ] MH: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T20:10:22.065886] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-10-02T20:10:22.065962] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-10-02T20:10:22.066001] [INFO ] [LOCAL ] MH: Starting deletion of derivative data. [2025-10-02T20:10:22.066043] [DEBUG] [LOCAL ] MH: No derivative data file found to delete. [2025-10-02T20:10:22.066091] [INFO ] [MAIN ] Update Progress: 1348/2370 symbols completed. MH took 1.6s. Estimated remaining: 2h 24m 17s. Rate: 7.1 symbols/min [2025-10-02T20:10:22.270507] [INFO ] [MAIN ] MHD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:10:22.285237] [DEBUG] [LOCAL ] MHD: Loaded 12377 existing records from primary storage. [2025-10-02T20:10:22.285503] [INFO ] [MAIN ] MHD: Loaded 12377 existing records. [2025-10-02T20:10:22.479762] [WARN ] [MAIN ] MHD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:10:22.479987] [INFO ] [MAIN ] MHD: Wiping existing primary data before full refresh. [2025-10-02T20:10:22.480043] [INFO ] [LOCAL ] MHD: Starting deletion of primary data. [2025-10-02T20:10:22.480575] [DEBUG] [LOCAL ] MHD: Deleted primary data file. [2025-10-02T20:10:22.480637] [INFO ] [MAIN ] MHD: Starting full primary refresh. [2025-10-02T20:10:22.683398] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-06. [2025-10-02T20:10:22.887051] [INFO ] [REMOTE ] MHD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:10:23.223280] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-02T20:10:23.473043] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-07. [2025-10-02T20:10:23.913146] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-02T20:10:24.272974] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-08. [2025-10-02T20:10:24.715724] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-02T20:10:25.073024] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-10. [2025-10-02T20:10:25.772113] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-02T20:10:25.772944] [INFO ] [REMOTE ] MGRE: Full fetch complete (9472 records). [2025-10-02T20:10:25.773016] [DEBUG] [VALIDATOR ] MGRE: Validating primary data. [2025-10-02T20:10:25.878252] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-01. [2025-10-02T20:10:26.177796] [DEBUG] [VALIDATOR ] MGRE: All expected trading days are present. [2025-10-02T20:10:26.177880] [DEBUG] [VALIDATOR ] MGRE: Primary data validation passed. [2025-10-02T20:10:26.178149] [INFO ] [MAIN ] MGRE: Fetched primary data is valid. [2025-10-02T20:10:26.178281] [DEBUG] [LOCAL ] MGRE: Saving primary data. [2025-10-02T20:10:26.178776] [DEBUG] [LOCAL ] MGRE: Trimmed 9472 records to 6725 (keeping 200 days of data) [2025-10-02T20:10:26.223716] [DEBUG] [LOCAL ] MGRE: Primary data saved (6725 records). [2025-10-02T20:10:26.223838] [INFO ] [MAIN ] MGRE: Full history saved. [2025-10-02T20:10:26.223959] [INFO ] [MAIN ] Update Progress: 1349/2370 symbols completed. MGRE took 24.3s. Estimated remaining: 2h 24m 5s. Rate: 7.1 symbols/min [2025-10-02T20:10:26.408360] [INFO ] [MAIN ] MHF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:10:26.418805] [DEBUG] [LOCAL ] MHF: Loaded 8704 existing records from primary storage. [2025-10-02T20:10:26.419029] [INFO ] [MAIN ] MHF: Loaded 8704 existing records. [2025-10-02T20:10:26.619159] [WARN ] [MAIN ] MHF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:10:26.619400] [INFO ] [MAIN ] MHF: Wiping existing primary data before full refresh. [2025-10-02T20:10:26.619493] [INFO ] [LOCAL ] MHF: Starting deletion of primary data. [2025-10-02T20:10:26.619880] [DEBUG] [LOCAL ] MHF: Deleted primary data file. [2025-10-02T20:10:26.619941] [INFO ] [MAIN ] MHF: Starting full primary refresh. [2025-10-02T20:10:26.678099] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-09. [2025-10-02T20:10:27.014056] [INFO ] [REMOTE ] MHF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:10:27.173772] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-02T20:10:27.473019] [INFO ] [REMOTE ] MHD: Fetching primary data for 2024-12. [2025-10-02T20:10:27.580046] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-02T20:10:28.273047] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-10. [2025-10-02T20:10:28.489749] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-02T20:10:28.652733] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-02T20:10:28.653589] [INFO ] [REMOTE ] MGRD: Full fetch complete (3510 records). [2025-10-02T20:10:28.653701] [DEBUG] [VALIDATOR ] MGRD: Validating primary data. [2025-10-02T20:10:29.061775] [DEBUG] [VALIDATOR ] MGRD: All expected trading days are present. [2025-10-02T20:10:29.061858] [DEBUG] [VALIDATOR ] MGRD: Primary data validation passed. [2025-10-02T20:10:29.061994] [INFO ] [MAIN ] MGRD: Fetched primary data is valid. [2025-10-02T20:10:29.062039] [DEBUG] [LOCAL ] MGRD: Saving primary data. [2025-10-02T20:10:29.062452] [DEBUG] [LOCAL ] MGRD: Trimmed 3510 records to 2248 (keeping 200 days of data) [2025-10-02T20:10:29.073722] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-01. [2025-10-02T20:10:29.086434] [DEBUG] [LOCAL ] MGRD: Primary data saved (2248 records). [2025-10-02T20:10:29.087021] [INFO ] [MAIN ] MGRD: Full history saved. [2025-10-02T20:10:29.087267] [INFO ] [MAIN ] Update Progress: 1350/2370 symbols completed. MGRD took 29.0s. Estimated remaining: 2h 23m 52s. Rate: 7.1 symbols/min [2025-10-02T20:10:29.280122] [INFO ] [MAIN ] MHK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:10:29.326382] [DEBUG] [LOCAL ] MHK: Loaded 42192 existing records from primary storage. [2025-10-02T20:10:29.326767] [INFO ] [MAIN ] MHK: Loaded 42192 existing records. [2025-10-02T20:10:29.521937] [WARN ] [MAIN ] MHK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:10:29.522167] [INFO ] [MAIN ] MHK: Wiping existing primary data before full refresh. [2025-10-02T20:10:29.522219] [INFO ] [LOCAL ] MHK: Starting deletion of primary data. [2025-10-02T20:10:29.523442] [DEBUG] [LOCAL ] MHK: Deleted primary data file. [2025-10-02T20:10:29.523510] [INFO ] [MAIN ] MHK: Starting full primary refresh. [2025-10-02T20:10:29.875992] [INFO ] [REMOTE ] MHF: Fetching primary data for 2024-12. [2025-10-02T20:10:29.963344] [INFO ] [REMOTE ] MHK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:10:30.037680] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-02T20:10:30.672976] [INFO ] [REMOTE ] MHK: Fetching primary data for 2024-12. [2025-10-02T20:10:30.720852] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-02T20:10:31.473004] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-01. [2025-10-02T20:10:32.192152] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-02T20:10:32.239379] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-02T20:10:32.272967] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-02. [2025-10-02T20:10:32.820785] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-02T20:10:33.073058] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-02. [2025-10-02T20:10:33.873008] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-01. [2025-10-02T20:10:34.676336] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-03. [2025-10-02T20:10:34.681986] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-02T20:10:35.080586] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-02T20:10:35.295067] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-02T20:10:35.473017] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-03. [2025-10-02T20:10:36.272991] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-02. [2025-10-02T20:10:37.083445] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-04. [2025-10-02T20:10:37.089335] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-02T20:10:37.137236] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-02T20:10:37.867367] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-02T20:10:37.872949] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-04. [2025-10-02T20:10:38.673076] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-02. [2025-10-02T20:10:39.473024] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-05. [2025-10-02T20:10:39.671136] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-02T20:10:40.082858] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-02T20:10:40.171630] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-02T20:10:40.273000] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-05. [2025-10-02T20:10:41.073038] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-06. [2025-10-02T20:10:41.872985] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-03. [2025-10-02T20:10:41.967929] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-02T20:10:41.984800] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-02T20:10:42.673008] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-06. [2025-10-02T20:10:43.413111] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-02T20:10:43.473059] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-04. [2025-10-02T20:10:44.272981] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-07. [2025-10-02T20:10:44.396297] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-02T20:10:44.803082] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-02T20:10:44.854620] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-02T20:10:45.072948] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-08. [2025-10-02T20:10:45.873051] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-05. [2025-10-02T20:10:46.053958] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-02T20:10:46.673055] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-09. [2025-10-02T20:10:47.441201] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-02T20:10:47.449280] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-02T20:10:47.472966] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-10. [2025-10-02T20:10:48.050724] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-02T20:10:48.052308] [INFO ] [REMOTE ] MHF: Full fetch complete (12594 records). [2025-10-02T20:10:48.052405] [DEBUG] [VALIDATOR ] MHF: Validating primary data. [2025-10-02T20:10:48.280377] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-07. [2025-10-02T20:10:48.464695] [DEBUG] [VALIDATOR ] MHF: All expected trading days are present. [2025-10-02T20:10:48.464812] [DEBUG] [VALIDATOR ] MHF: Primary data validation passed. [2025-10-02T20:10:48.465152] [INFO ] [MAIN ] MHF: Fetched primary data is valid. [2025-10-02T20:10:48.465221] [DEBUG] [LOCAL ] MHF: Saving primary data. [2025-10-02T20:10:48.465828] [DEBUG] [LOCAL ] MHF: Trimmed 12594 records to 8733 (keeping 200 days of data) [2025-10-02T20:10:48.522992] [DEBUG] [LOCAL ] MHF: Primary data saved (8733 records). [2025-10-02T20:10:48.523125] [INFO ] [MAIN ] MHF: Full history saved. [2025-10-02T20:10:48.523264] [INFO ] [MAIN ] Update Progress: 1351/2370 symbols completed. MHF took 22.3s. Estimated remaining: 2h 23m 52s. Rate: 7.1 symbols/min [2025-10-02T20:10:48.712243] [INFO ] [MAIN ] MHLA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:10:48.712492] [DEBUG] [LOCAL ] MHLA: No existing data file found in primary storage. [2025-10-02T20:10:48.712561] [WARN ] [MAIN ] MHLA: No existing data found, performing full refresh instead. [2025-10-02T20:10:48.712738] [INFO ] [MAIN ] MHLA: Wiping existing primary data before full refresh. [2025-10-02T20:10:48.712839] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-10-02T20:10:48.712909] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-10-02T20:10:48.712958] [INFO ] [MAIN ] MHLA: Starting full primary refresh. [2025-10-02T20:10:49.086845] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-03. [2025-10-02T20:10:49.094119] [INFO ] [REMOTE ] MHLA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:10:49.873058] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-06. [2025-10-02T20:10:49.931814] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-02T20:10:50.061442] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-02T20:10:50.673011] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-04. [2025-10-02T20:10:51.472334] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-02T20:10:51.480777] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2024-12. [2025-10-02T20:10:51.591167] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-02T20:10:51.856246] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-10-02T20:10:52.273050] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-08. [2025-10-02T20:10:53.073006] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-07. [2025-10-02T20:10:53.872974] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-01. [2025-10-02T20:10:53.950349] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-02T20:10:54.212744] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-02T20:10:54.631739] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-02T20:10:54.672969] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-08. [2025-10-02T20:10:55.472995] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-05. [2025-10-02T20:10:55.887265] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-02T20:10:56.273012] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-09. [2025-10-02T20:10:56.297100] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-02T20:10:57.073048] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-06. [2025-10-02T20:10:57.676951] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-02T20:10:57.873005] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-10. [2025-10-02T20:10:57.904326] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-02T20:10:58.673043] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-07. [2025-10-02T20:10:59.180349] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-02T20:10:59.182420] [INFO ] [REMOTE ] MHK: Full fetch complete (60797 records). [2025-10-02T20:10:59.182547] [DEBUG] [VALIDATOR ] MHK: Validating primary data. [2025-10-02T20:10:59.400156] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-02T20:10:59.480495] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-08. [2025-10-02T20:10:59.637429] [DEBUG] [VALIDATOR ] MHK: All expected trading days are present. [2025-10-02T20:10:59.637522] [DEBUG] [VALIDATOR ] MHK: Primary data validation passed. [2025-10-02T20:10:59.638504] [INFO ] [MAIN ] MHK: Fetched primary data is valid. [2025-10-02T20:10:59.638582] [DEBUG] [LOCAL ] MHK: Saving primary data. [2025-10-02T20:10:59.640178] [DEBUG] [LOCAL ] MHK: Trimmed 60797 records to 42458 (keeping 200 days of data) [2025-10-02T20:10:59.929845] [DEBUG] [LOCAL ] MHK: Primary data saved (42458 records). [2025-10-02T20:10:59.930016] [INFO ] [MAIN ] MHK: Full history saved. [2025-10-02T20:10:59.930138] [INFO ] [MAIN ] Update Progress: 1352/2370 symbols completed. MHK took 30.8s. Estimated remaining: 2h 23m 46s. Rate: 7.1 symbols/min [2025-10-02T20:11:00.124101] [INFO ] [MAIN ] MHN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:11:00.134123] [DEBUG] [LOCAL ] MHN: Loaded 7578 existing records from primary storage. [2025-10-02T20:11:00.134351] [INFO ] [MAIN ] MHN: Loaded 7578 existing records. [2025-10-02T20:11:00.278136] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-02. [2025-10-02T20:11:00.373548] [WARN ] [MAIN ] MHN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:11:00.384317] [INFO ] [MAIN ] MHN: Wiping existing primary data before full refresh. [2025-10-02T20:11:00.385099] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-02T20:11:00.385193] [INFO ] [LOCAL ] MHN: Starting deletion of primary data. [2025-10-02T20:11:00.389092] [DEBUG] [LOCAL ] MHN: Deleted primary data file. [2025-10-02T20:11:00.389184] [INFO ] [MAIN ] MHN: Starting full primary refresh. [2025-10-02T20:11:00.764861] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-02T20:11:00.804180] [INFO ] [REMOTE ] MHN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:11:01.072993] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-03. [2025-10-02T20:11:01.431082] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-02T20:11:01.873009] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-09. [2025-10-02T20:11:02.673009] [INFO ] [REMOTE ] MHN: Fetching primary data for 2024-12. [2025-10-02T20:11:02.805588] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-02T20:11:03.473005] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-09. [2025-10-02T20:11:03.535337] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-02T20:11:04.273044] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-10. [2025-10-02T20:11:05.072973] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-04. [2025-10-02T20:11:05.226431] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-02T20:11:05.252891] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-02T20:11:05.254162] [INFO ] [REMOTE ] MHD: Full fetch complete (18939 records). [2025-10-02T20:11:05.254244] [DEBUG] [VALIDATOR ] MHD: Validating primary data. [2025-10-02T20:11:05.549136] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-02T20:11:05.669689] [DEBUG] [VALIDATOR ] MHD: All expected trading days are present. [2025-10-02T20:11:05.669779] [DEBUG] [VALIDATOR ] MHD: Primary data validation passed. [2025-10-02T20:11:05.670251] [INFO ] [MAIN ] MHD: Fetched primary data is valid. [2025-10-02T20:11:05.670327] [DEBUG] [LOCAL ] MHD: Saving primary data. [2025-10-02T20:11:05.671000] [DEBUG] [LOCAL ] MHD: Trimmed 18939 records to 12563 (keeping 200 days of data) [2025-10-02T20:11:05.758089] [DEBUG] [LOCAL ] MHD: Primary data saved (12563 records). [2025-10-02T20:11:05.758268] [INFO ] [MAIN ] MHD: Full history saved. [2025-10-02T20:11:05.758426] [INFO ] [MAIN ] Update Progress: 1353/2370 symbols completed. MHD took 43.7s. Estimated remaining: 2h 23m 36s. Rate: 7.1 symbols/min [2025-10-02T20:11:05.878118] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-10. [2025-10-02T20:11:05.944099] [INFO ] [MAIN ] MHO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:11:05.973505] [DEBUG] [LOCAL ] MHO: Loaded 23962 existing records from primary storage. [2025-10-02T20:11:05.973838] [INFO ] [MAIN ] MHO: Loaded 23962 existing records. [2025-10-02T20:11:06.170950] [WARN ] [MAIN ] MHO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:11:06.171196] [INFO ] [MAIN ] MHO: Wiping existing primary data before full refresh. [2025-10-02T20:11:06.171247] [INFO ] [LOCAL ] MHO: Starting deletion of primary data. [2025-10-02T20:11:06.172064] [DEBUG] [LOCAL ] MHO: Deleted primary data file. [2025-10-02T20:11:06.172127] [INFO ] [MAIN ] MHO: Starting full primary refresh. [2025-10-02T20:11:06.579760] [INFO ] [REMOTE ] MHO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:11:06.673020] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-05. [2025-10-02T20:11:07.165332] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-02T20:11:07.370836] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-02T20:11:07.373942] [INFO ] [REMOTE ] MGY: Full fetch complete (75695 records). [2025-10-02T20:11:07.374133] [DEBUG] [VALIDATOR ] MGY: Validating primary data. [2025-10-02T20:11:07.478117] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-06. [2025-10-02T20:11:07.835249] [DEBUG] [VALIDATOR ] MGY: All expected trading days are present. [2025-10-02T20:11:07.835364] [DEBUG] [VALIDATOR ] MGY: Primary data validation passed. [2025-10-02T20:11:07.836880] [INFO ] [MAIN ] MGY: Fetched primary data is valid. [2025-10-02T20:11:07.836948] [DEBUG] [LOCAL ] MGY: Saving primary data. [2025-10-02T20:11:07.838606] [DEBUG] [LOCAL ] MGY: Trimmed 75695 records to 52801 (keeping 200 days of data) [2025-10-02T20:11:07.947804] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-02T20:11:08.199417] [DEBUG] [LOCAL ] MGY: Primary data saved (52801 records). [2025-10-02T20:11:08.199571] [INFO ] [MAIN ] MGY: Full history saved. [2025-10-02T20:11:08.199740] [INFO ] [MAIN ] Update Progress: 1354/2370 symbols completed. MGY took 53.4s. Estimated remaining: 2h 23m 23s. Rate: 7.1 symbols/min [2025-10-02T20:11:08.278150] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-07. [2025-10-02T20:11:08.392619] [INFO ] [MAIN ] MIAX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:11:08.392856] [DEBUG] [LOCAL ] MIAX: No existing data file found in primary storage. [2025-10-02T20:11:08.392915] [WARN ] [MAIN ] MIAX: No existing data found, performing full refresh instead. [2025-10-02T20:11:08.393030] [INFO ] [MAIN ] MIAX: Wiping existing primary data before full refresh. [2025-10-02T20:11:08.393073] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-10-02T20:11:08.393116] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-10-02T20:11:08.393152] [INFO ] [MAIN ] MIAX: Starting full primary refresh. [2025-10-02T20:11:08.565605] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-10-02T20:11:08.798851] [INFO ] [REMOTE ] MIAX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:11:09.072998] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-01. [2025-10-02T20:11:09.873012] [INFO ] [REMOTE ] MHO: Fetching primary data for 2024-12. [2025-10-02T20:11:09.884610] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-02T20:11:10.673015] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2024-12. [2025-10-02T20:11:10.870710] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T20:11:10.871052] [WARN ] [REMOTE ] MIAX: No data returned for month 2024-12 [2025-10-02T20:11:10.871195] [FATAL] [REMOTE ] MIAX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T20:11:10.871247] [FATAL] [MAIN ] MIAX: Failed to fetch primary data. [2025-10-02T20:11:10.871288] [WARN ] [MAIN ] MIAX: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T20:11:10.871327] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-10-02T20:11:10.871383] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-10-02T20:11:10.871425] [INFO ] [LOCAL ] MIAX: Starting deletion of derivative data. [2025-10-02T20:11:10.871489] [DEBUG] [LOCAL ] MIAX: No derivative data file found to delete. [2025-10-02T20:11:10.871568] [INFO ] [MAIN ] Update Progress: 1355/2370 symbols completed. MIAX took 2.7s. Estimated remaining: 2h 23m 10s. Rate: 7.1 symbols/min [2025-10-02T20:11:11.062567] [INFO ] [MAIN ] MIN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:11:11.080093] [DEBUG] [LOCAL ] MIN: Loaded 13146 existing records from primary storage. [2025-10-02T20:11:11.080324] [INFO ] [MAIN ] MIN: Loaded 13146 existing records. [2025-10-02T20:11:11.279675] [WARN ] [MAIN ] MIN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:11:11.280034] [INFO ] [MAIN ] MIN: Wiping existing primary data before full refresh. [2025-10-02T20:11:11.280085] [INFO ] [LOCAL ] MIN: Starting deletion of primary data. [2025-10-02T20:11:11.280947] [DEBUG] [LOCAL ] MIN: Deleted primary data file. [2025-10-02T20:11:11.281083] [INFO ] [MAIN ] MIN: Starting full primary refresh. [2025-10-02T20:11:11.478160] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-02. [2025-10-02T20:11:11.627993] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-02T20:11:11.717383] [INFO ] [REMOTE ] MIN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:11:12.272975] [INFO ] [REMOTE ] MIN: Fetching primary data for 2024-12. [2025-10-02T20:11:12.347440] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-02T20:11:13.072990] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-03. [2025-10-02T20:11:13.206438] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-02T20:11:13.728705] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-02T20:11:13.873000] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-01. [2025-10-02T20:11:14.483865] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-02T20:11:14.673080] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-04. [2025-10-02T20:11:15.473629] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-01. [2025-10-02T20:11:15.477475] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-02T20:11:16.273029] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-05. [2025-10-02T20:11:16.857219] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-02T20:11:17.073019] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-02. [2025-10-02T20:11:17.102728] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-02T20:11:17.624588] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-02T20:11:17.873058] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-03. [2025-10-02T20:11:18.617446] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-02T20:11:18.673031] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-08. [2025-10-02T20:11:19.004904] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-02T20:11:19.473035] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-06. [2025-10-02T20:11:19.891181] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-02T20:11:20.273003] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-07. [2025-10-02T20:11:20.870919] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-02T20:11:21.073016] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-09. [2025-10-02T20:11:21.527916] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-02T20:11:21.873000] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-10. [2025-10-02T20:11:22.325326] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-02T20:11:22.326034] [INFO ] [REMOTE ] MHLA: Full fetch complete (1531 records). [2025-10-02T20:11:22.326108] [DEBUG] [VALIDATOR ] MHLA: Validating primary data. [2025-10-02T20:11:22.518558] [WARN ] [VALIDATOR ] MHLA: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-10-02T20:11:22.518776] [FATAL] [MAIN ] MHLA: Fetched primary data is invalid. Refusing to save it. [2025-10-02T20:11:22.518825] [WARN ] [MAIN ] MHLA: Deleting existing primary and derivative data due to validation failure. [2025-10-02T20:11:22.518897] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-10-02T20:11:22.518963] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-10-02T20:11:22.519001] [INFO ] [LOCAL ] MHLA: Starting deletion of derivative data. [2025-10-02T20:11:22.519043] [DEBUG] [LOCAL ] MHLA: No derivative data file found to delete. [2025-10-02T20:11:22.519101] [INFO ] [MAIN ] Update Progress: 1356/2370 symbols completed. MHLA took 34.0s. Estimated remaining: 2h 23m 4s. Rate: 7.1 symbols/min [2025-10-02T20:11:22.681682] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-02. [2025-10-02T20:11:22.703153] [INFO ] [MAIN ] MIR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:11:22.769701] [DEBUG] [LOCAL ] MIR: Loaded 51020 existing records from primary storage. [2025-10-02T20:11:22.770031] [INFO ] [MAIN ] MIR: Loaded 51020 existing records. [2025-10-02T20:11:22.962303] [WARN ] [MAIN ] MIR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:11:22.962507] [INFO ] [MAIN ] MIR: Wiping existing primary data before full refresh. [2025-10-02T20:11:22.962556] [INFO ] [LOCAL ] MIR: Starting deletion of primary data. [2025-10-02T20:11:22.963725] [DEBUG] [LOCAL ] MIR: Deleted primary data file. [2025-10-02T20:11:22.963789] [INFO ] [MAIN ] MIR: Starting full primary refresh. [2025-10-02T20:11:23.354764] [INFO ] [REMOTE ] MIR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:11:23.473240] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-04. [2025-10-02T20:11:24.050346] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-02T20:11:24.150800] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-02T20:11:24.273051] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-03. [2025-10-02T20:11:25.073043] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-05. [2025-10-02T20:11:25.309388] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-02T20:11:25.754637] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-02T20:11:25.873014] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-08. [2025-10-02T20:11:26.663453] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-02T20:11:26.672973] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-09. [2025-10-02T20:11:27.462686] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-02T20:11:27.472952] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-10. [2025-10-02T20:11:28.055278] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-02T20:11:28.056286] [INFO ] [REMOTE ] MHN: Full fetch complete (11792 records). [2025-10-02T20:11:28.056377] [DEBUG] [VALIDATOR ] MHN: Validating primary data. [2025-10-02T20:11:28.278153] [INFO ] [REMOTE ] MIR: Fetching primary data for 2024-12. [2025-10-02T20:11:28.497395] [DEBUG] [VALIDATOR ] MHN: All expected trading days are present. [2025-10-02T20:11:28.497495] [DEBUG] [VALIDATOR ] MHN: Primary data validation passed. [2025-10-02T20:11:28.497860] [INFO ] [MAIN ] MHN: Fetched primary data is valid. [2025-10-02T20:11:28.497927] [DEBUG] [LOCAL ] MHN: Saving primary data. [2025-10-02T20:11:28.498609] [DEBUG] [LOCAL ] MHN: Trimmed 11792 records to 7634 (keeping 200 days of data) [2025-10-02T20:11:28.549291] [DEBUG] [LOCAL ] MHN: Primary data saved (7634 records). [2025-10-02T20:11:28.549442] [INFO ] [MAIN ] MHN: Full history saved. [2025-10-02T20:11:28.549559] [INFO ] [MAIN ] Update Progress: 1357/2370 symbols completed. MHN took 28.6s. Estimated remaining: 2h 22m 53s. Rate: 7.1 symbols/min [2025-10-02T20:11:29.073040] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-04. [2025-10-02T20:11:29.873052] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-06. [2025-10-02T20:11:30.014180] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-02T20:11:30.310016] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-02T20:11:30.673009] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-01. [2025-10-02T20:11:30.720241] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-02T20:11:31.473048] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-05. [2025-10-02T20:11:32.250360] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-02T20:11:32.273004] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-07. [2025-10-02T20:11:32.692049] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-02T20:11:33.036544] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-02T20:11:33.073028] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-08. [2025-10-02T20:11:33.781555] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-02T20:11:33.872997] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-02. [2025-10-02T20:11:34.673038] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-06. [2025-10-02T20:11:35.475970] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-09. [2025-10-02T20:11:35.481140] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-02T20:11:35.733282] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-02T20:11:35.967520] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-02T20:11:36.273045] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-07. [2025-10-02T20:11:37.073017] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-03. [2025-10-02T20:11:37.662294] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-02T20:11:37.873029] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-08. [2025-10-02T20:11:38.336206] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-02T20:11:38.673032] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-04. [2025-10-02T20:11:39.201882] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-02T20:11:39.473012] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-09. [2025-10-02T20:11:40.221109] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-02T20:11:40.272977] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-05. [2025-10-02T20:11:40.730968] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-02T20:11:41.073037] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-10. [2025-10-02T20:11:41.847532] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-02T20:11:41.848929] [INFO ] [REMOTE ] MIN: Full fetch complete (17825 records). [2025-10-02T20:11:41.849020] [DEBUG] [VALIDATOR ] MIN: Validating primary data. [2025-10-02T20:11:41.884960] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-10. [2025-10-02T20:11:42.171315] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-02T20:11:42.341626] [DEBUG] [VALIDATOR ] MIN: All expected trading days are present. [2025-10-02T20:11:42.341740] [DEBUG] [VALIDATOR ] MIN: Primary data validation passed. [2025-10-02T20:11:42.342172] [INFO ] [MAIN ] MIN: Fetched primary data is valid. [2025-10-02T20:11:42.342214] [DEBUG] [LOCAL ] MIN: Saving primary data. [2025-10-02T20:11:42.342822] [DEBUG] [LOCAL ] MIN: Trimmed 17825 records to 13399 (keeping 200 days of data) [2025-10-02T20:11:42.430701] [DEBUG] [LOCAL ] MIN: Primary data saved (13399 records). [2025-10-02T20:11:42.430858] [INFO ] [MAIN ] MIN: Full history saved. [2025-10-02T20:11:42.430964] [INFO ] [MAIN ] Update Progress: 1358/2370 symbols completed. MIN took 31.6s. Estimated remaining: 2h 22m 49s. Rate: 7.1 symbols/min [2025-10-02T20:11:42.673054] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-06. [2025-10-02T20:11:42.958375] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-02T20:11:42.959535] [INFO ] [REMOTE ] MHO: Full fetch complete (37151 records). [2025-10-02T20:11:42.959613] [DEBUG] [VALIDATOR ] MHO: Validating primary data. [2025-10-02T20:11:43.363552] [DEBUG] [VALIDATOR ] MHO: All expected trading days are present. [2025-10-02T20:11:43.363633] [DEBUG] [VALIDATOR ] MHO: Primary data validation passed. [2025-10-02T20:11:43.364465] [INFO ] [MAIN ] MHO: Fetched primary data is valid. [2025-10-02T20:11:43.364519] [DEBUG] [LOCAL ] MHO: Saving primary data. [2025-10-02T20:11:43.365442] [DEBUG] [LOCAL ] MHO: Trimmed 37151 records to 24076 (keeping 200 days of data) [2025-10-02T20:11:43.521980] [DEBUG] [LOCAL ] MHO: Primary data saved (24076 records). [2025-10-02T20:11:43.522112] [INFO ] [MAIN ] MHO: Full history saved. [2025-10-02T20:11:43.522197] [INFO ] [MAIN ] Update Progress: 1359/2370 symbols completed. MHO took 37.8s. Estimated remaining: 2h 22m 35s. Rate: 7.1 symbols/min [2025-10-02T20:11:44.442326] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-02T20:11:44.453364] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-07. [2025-10-02T20:11:46.227347] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-02T20:11:46.239852] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-08. [2025-10-02T20:11:47.991109] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-02T20:11:48.003102] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-09. [2025-10-02T20:11:49.763753] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-02T20:11:49.776609] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-10. [2025-10-02T20:11:51.115766] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-02T20:11:51.117880] [INFO ] [REMOTE ] MIR: Full fetch complete (73494 records). [2025-10-02T20:11:51.117994] [DEBUG] [VALIDATOR ] MIR: Validating primary data. [2025-10-02T20:11:51.540683] [DEBUG] [VALIDATOR ] MIR: All expected trading days are present. [2025-10-02T20:11:51.540871] [DEBUG] [VALIDATOR ] MIR: Primary data validation passed. [2025-10-02T20:11:51.542235] [INFO ] [MAIN ] MIR: Fetched primary data is valid. [2025-10-02T20:11:51.542310] [DEBUG] [LOCAL ] MIR: Saving primary data. [2025-10-02T20:11:51.543966] [DEBUG] [LOCAL ] MIR: Trimmed 73494 records to 51410 (keeping 200 days of data) [2025-10-02T20:11:51.889909] [DEBUG] [LOCAL ] MIR: Primary data saved (51410 records). [2025-10-02T20:11:51.890056] [INFO ] [MAIN ] MIR: Full history saved. [2025-10-02T20:11:51.890164] [INFO ] [MAIN ] Update Progress: 1360/2370 symbols completed. MIR took 29.4s. Estimated remaining: 2h 22m 26s. Rate: 7.1 symbols/min [2025-10-02T20:11:52.585319] [INFO ] [MAIN ] MITT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:11:52.763561] [INFO ] [MAIN ] MITN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:11:52.820595] [DEBUG] [LOCAL ] MITN: No existing data file found in primary storage. [2025-10-02T20:11:52.822537] [INFO ] [MAIN ] MITP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:11:52.855927] [INFO ] [MAIN ] MIY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:11:52.856038] [WARN ] [MAIN ] MITN: No existing data found, performing full refresh instead. [2025-10-02T20:11:52.858166] [INFO ] [MAIN ] MITN: Wiping existing primary data before full refresh. [2025-10-02T20:11:52.858538] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-10-02T20:11:52.862963] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-10-02T20:11:52.865531] [DEBUG] [LOCAL ] MITP: Loaded 2402 existing records from primary storage. [2025-10-02T20:11:52.875702] [INFO ] [MAIN ] MITN: Starting full primary refresh. [2025-10-02T20:11:52.875578] [INFO ] [MAIN ] MITP: Loaded 2402 existing records. [2025-10-02T20:11:52.881355] [DEBUG] [LOCAL ] MIY: Loaded 5968 existing records from primary storage. [2025-10-02T20:11:52.959543] [INFO ] [MAIN ] MIY: Loaded 5968 existing records. [2025-10-02T20:11:53.081886] [DEBUG] [LOCAL ] MITT: Loaded 22930 existing records from primary storage. [2025-10-02T20:11:53.182615] [INFO ] [MAIN ] MITT: Loaded 22930 existing records. [2025-10-02T20:11:53.346639] [WARN ] [MAIN ] MITP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:11:53.368093] [INFO ] [MAIN ] MITP: Wiping existing primary data before full refresh. [2025-10-02T20:11:53.450292] [INFO ] [LOCAL ] MITP: Starting deletion of primary data. [2025-10-02T20:11:53.491563] [DEBUG] [LOCAL ] MITP: Deleted primary data file. [2025-10-02T20:11:53.540817] [INFO ] [MAIN ] MITP: Starting full primary refresh. [2025-10-02T20:11:54.119660] [WARN ] [MAIN ] MITT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:11:54.124230] [WARN ] [MAIN ] MIY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:11:54.130312] [INFO ] [MAIN ] MIY: Wiping existing primary data before full refresh. [2025-10-02T20:11:54.140868] [INFO ] [MAIN ] MITT: Wiping existing primary data before full refresh. [2025-10-02T20:11:54.168850] [INFO ] [LOCAL ] MITT: Starting deletion of primary data. [2025-10-02T20:11:54.168952] [INFO ] [LOCAL ] MIY: Starting deletion of primary data. [2025-10-02T20:11:54.267501] [DEBUG] [LOCAL ] MITT: Deleted primary data file. [2025-10-02T20:11:54.260757] [DEBUG] [LOCAL ] MIY: Deleted primary data file. [2025-10-02T20:11:54.310743] [INFO ] [MAIN ] MIY: Starting full primary refresh. [2025-10-02T20:11:54.272147] [INFO ] [MAIN ] MITT: Starting full primary refresh. [2025-10-02T20:11:54.361856] [INFO ] [REMOTE ] MITN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:11:54.428058] [INFO ] [REMOTE ] MITN: Fetching primary data for 2024-12. [2025-10-02T20:11:54.800318] [INFO ] [REMOTE ] MITP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:11:54.885762] [INFO ] [REMOTE ] MITP: Fetching primary data for 2024-12. [2025-10-02T20:11:54.975823] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-02T20:11:54.994256] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-01. [2025-10-02T20:11:55.338174] [INFO ] [REMOTE ] MIY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:11:55.359584] [INFO ] [REMOTE ] MIY: Fetching primary data for 2024-12. [2025-10-02T20:11:55.365819] [INFO ] [REMOTE ] MITT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:11:55.366918] [INFO ] [REMOTE ] MITT: Fetching primary data for 2024-12. [2025-10-02T20:11:55.526111] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-02T20:11:55.527381] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-01. [2025-10-02T20:11:55.567588] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-02T20:11:55.568864] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-02. [2025-10-02T20:11:55.901769] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-02T20:11:55.902967] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-03. [2025-10-02T20:11:56.018819] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-02T20:11:56.021548] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-01. [2025-10-02T20:11:56.038827] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-02T20:11:56.040414] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-02. [2025-10-02T20:11:56.322584] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-10-02T20:11:56.323809] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-03. [2025-10-02T20:11:56.376615] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-02T20:11:56.378192] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-04. [2025-10-02T20:11:56.607812] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-02T20:11:56.615590] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-01. [2025-10-02T20:11:56.626432] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-02T20:11:56.626151] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-10-02T20:11:56.851249] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-02T20:11:57.072998] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-04. [2025-10-02T20:11:57.406542] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-02T20:11:57.757612] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-02T20:11:57.873002] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-02. [2025-10-02T20:11:58.673003] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-05. [2025-10-02T20:11:58.937381] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-02T20:11:59.013533] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-02T20:11:59.472989] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-02. [2025-10-02T20:12:00.143391] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-02T20:12:00.273061] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-05. [2025-10-02T20:12:00.763981] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-02T20:12:01.073002] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-03. [2025-10-02T20:12:01.756089] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-02T20:12:01.873018] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-06. [2025-10-02T20:12:02.301497] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-02T20:12:02.673005] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-07. [2025-10-02T20:12:03.101093] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-02T20:12:03.473002] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-08. [2025-10-02T20:12:03.901225] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-02T20:12:04.273013] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-04. [2025-10-02T20:12:04.903006] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-02T20:12:05.073007] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-09. [2025-10-02T20:12:05.539907] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-02T20:12:05.872996] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-03. [2025-10-02T20:12:06.672997] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-05. [2025-10-02T20:12:07.087313] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-02T20:12:07.149936] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-02T20:12:07.472994] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-06. [2025-10-02T20:12:08.181615] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-02T20:12:08.272999] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-07. [2025-10-02T20:12:09.062915] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-02T20:12:09.072965] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-04. [2025-10-02T20:12:09.873002] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-08. [2025-10-02T20:12:10.308745] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-02T20:12:10.615438] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-02T20:12:10.673006] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-09. [2025-10-02T20:12:11.320203] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-02T20:12:11.473003] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-05. [2025-10-02T20:12:12.273009] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-10. [2025-10-02T20:12:12.496207] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-02T20:12:12.898706] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-02T20:12:12.899513] [INFO ] [REMOTE ] MIY: Full fetch complete (8979 records). [2025-10-02T20:12:12.899583] [DEBUG] [VALIDATOR ] MIY: Validating primary data. [2025-10-02T20:12:13.078842] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-06. [2025-10-02T20:12:13.314605] [DEBUG] [VALIDATOR ] MIY: All expected trading days are present. [2025-10-02T20:12:13.314729] [DEBUG] [VALIDATOR ] MIY: Primary data validation passed. [2025-10-02T20:12:13.314992] [INFO ] [MAIN ] MIY: Fetched primary data is valid. [2025-10-02T20:12:13.315039] [DEBUG] [LOCAL ] MIY: Saving primary data. [2025-10-02T20:12:13.315504] [DEBUG] [LOCAL ] MIY: Trimmed 8979 records to 6023 (keeping 200 days of data) [2025-10-02T20:12:13.357951] [DEBUG] [LOCAL ] MIY: Primary data saved (6023 records). [2025-10-02T20:12:13.358134] [INFO ] [MAIN ] MIY: Full history saved. [2025-10-02T20:12:13.358260] [INFO ] [MAIN ] Update Progress: 1361/2370 symbols completed. MIY took 21.5s. Estimated remaining: 2h 22m 28s. Rate: 7.1 symbols/min [2025-10-02T20:12:13.562785] [INFO ] [MAIN ] MKC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:12:13.616120] [DEBUG] [LOCAL ] MKC: Loaded 52440 existing records from primary storage. [2025-10-02T20:12:13.616521] [INFO ] [MAIN ] MKC: Loaded 52440 existing records. [2025-10-02T20:12:13.819059] [WARN ] [MAIN ] MKC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:12:13.819301] [INFO ] [MAIN ] MKC: Wiping existing primary data before full refresh. [2025-10-02T20:12:13.819352] [INFO ] [LOCAL ] MKC: Starting deletion of primary data. [2025-10-02T20:12:13.820633] [DEBUG] [LOCAL ] MKC: Deleted primary data file. [2025-10-02T20:12:13.820725] [INFO ] [MAIN ] MKC: Starting full primary refresh. [2025-10-02T20:12:13.878888] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-06. [2025-10-02T20:12:14.227747] [INFO ] [REMOTE ] MKC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:12:14.244878] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-02T20:12:14.269904] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-02T20:12:14.673058] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-10. [2025-10-02T20:12:15.060596] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-02T20:12:15.061327] [INFO ] [REMOTE ] MITP: Full fetch complete (3353 records). [2025-10-02T20:12:15.061397] [DEBUG] [VALIDATOR ] MITP: Validating primary data. [2025-10-02T20:12:15.457593] [DEBUG] [VALIDATOR ] MITP: All expected trading days are present. [2025-10-02T20:12:15.457701] [DEBUG] [VALIDATOR ] MITP: Primary data validation passed. [2025-10-02T20:12:15.457839] [INFO ] [MAIN ] MITP: Fetched primary data is valid. [2025-10-02T20:12:15.457881] [DEBUG] [LOCAL ] MITP: Saving primary data. [2025-10-02T20:12:15.458249] [DEBUG] [LOCAL ] MITP: Trimmed 3353 records to 2411 (keeping 200 days of data) [2025-10-02T20:12:15.472827] [DEBUG] [LOCAL ] MITP: Primary data saved (2411 records). [2025-10-02T20:12:15.472908] [INFO ] [MAIN ] MITP: Full history saved. [2025-10-02T20:12:15.473006] [INFO ] [MAIN ] Update Progress: 1362/2370 symbols completed. MITP took 23.6s. Estimated remaining: 2h 22m 14s. Rate: 7.1 symbols/min [2025-10-02T20:12:15.473183] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-07. [2025-10-02T20:12:15.660193] [INFO ] [MAIN ] MKL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:12:15.698354] [DEBUG] [LOCAL ] MKL: Loaded 34014 existing records from primary storage. [2025-10-02T20:12:15.698676] [INFO ] [MAIN ] MKL: Loaded 34014 existing records. [2025-10-02T20:12:15.882411] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-02T20:12:15.896153] [WARN ] [MAIN ] MKL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:12:15.898137] [INFO ] [MAIN ] MKL: Wiping existing primary data before full refresh. [2025-10-02T20:12:15.898262] [INFO ] [LOCAL ] MKL: Starting deletion of primary data. [2025-10-02T20:12:15.899257] [DEBUG] [LOCAL ] MKL: Deleted primary data file. [2025-10-02T20:12:15.899352] [INFO ] [MAIN ] MKL: Starting full primary refresh. [2025-10-02T20:12:16.278328] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-07. [2025-10-02T20:12:16.329441] [INFO ] [REMOTE ] MKL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:12:17.073081] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-08. [2025-10-02T20:12:17.492561] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-02T20:12:17.684613] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-02T20:12:17.873009] [INFO ] [REMOTE ] MKC: Fetching primary data for 2024-12. [2025-10-02T20:12:18.673008] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-09. [2025-10-02T20:12:19.005989] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-02T20:12:19.295387] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-02T20:12:19.473035] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-08. [2025-10-02T20:12:20.273026] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-01. [2025-10-02T20:12:20.633226] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-02T20:12:21.073011] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-09. [2025-10-02T20:12:21.873053] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-10. [2025-10-02T20:12:22.121853] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-02T20:12:22.219759] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-02T20:12:22.230565] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-02T20:12:22.231243] [INFO ] [REMOTE ] MITN: Full fetch complete (2324 records). [2025-10-02T20:12:22.231328] [DEBUG] [VALIDATOR ] MITN: Validating primary data. [2025-10-02T20:12:22.418531] [WARN ] [VALIDATOR ] MITN: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-02T20:12:22.418740] [FATAL] [MAIN ] MITN: Fetched primary data is invalid. Refusing to save it. [2025-10-02T20:12:22.418810] [WARN ] [MAIN ] MITN: Deleting existing primary and derivative data due to validation failure. [2025-10-02T20:12:22.418886] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-10-02T20:12:22.418949] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-10-02T20:12:22.418985] [INFO ] [LOCAL ] MITN: Starting deletion of derivative data. [2025-10-02T20:12:22.419024] [DEBUG] [LOCAL ] MITN: No derivative data file found to delete. [2025-10-02T20:12:22.419079] [INFO ] [MAIN ] Update Progress: 1363/2370 symbols completed. MITN took 30.5s. Estimated remaining: 2h 22m 5s. Rate: 7.1 symbols/min [2025-10-02T20:12:22.606794] [INFO ] [MAIN ] MLI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:12:22.654622] [DEBUG] [LOCAL ] MLI: Loaded 43527 existing records from primary storage. [2025-10-02T20:12:22.654980] [INFO ] [MAIN ] MLI: Loaded 43527 existing records. [2025-10-02T20:12:22.678094] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-02. [2025-10-02T20:12:22.852958] [WARN ] [MAIN ] MLI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:12:22.853206] [INFO ] [MAIN ] MLI: Wiping existing primary data before full refresh. [2025-10-02T20:12:22.853262] [INFO ] [LOCAL ] MLI: Starting deletion of primary data. [2025-10-02T20:12:22.854380] [DEBUG] [LOCAL ] MLI: Deleted primary data file. [2025-10-02T20:12:22.854442] [INFO ] [MAIN ] MLI: Starting full primary refresh. [2025-10-02T20:12:23.240211] [INFO ] [REMOTE ] MLI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:12:23.473050] [INFO ] [REMOTE ] MKL: Fetching primary data for 2024-12. [2025-10-02T20:12:24.272982] [INFO ] [REMOTE ] MLI: Fetching primary data for 2024-12. [2025-10-02T20:12:24.375298] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-02T20:12:24.881215] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-02T20:12:25.073041] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-01. [2025-10-02T20:12:25.675850] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-02T20:12:25.873045] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-01. [2025-10-02T20:12:26.119046] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-02T20:12:26.673015] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-02. [2025-10-02T20:12:27.175248] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-02T20:12:27.473007] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-03. [2025-10-02T20:12:28.066563] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-02T20:12:28.273057] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-03. [2025-10-02T20:12:28.989550] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-02T20:12:29.073021] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-10. [2025-10-02T20:12:29.755439] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-02T20:12:29.873052] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-04. [2025-10-02T20:12:29.960280] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-02T20:12:29.961518] [INFO ] [REMOTE ] MITT: Full fetch complete (34797 records). [2025-10-02T20:12:29.961597] [DEBUG] [VALIDATOR ] MITT: Validating primary data. [2025-10-02T20:12:30.366060] [DEBUG] [VALIDATOR ] MITT: All expected trading days are present. [2025-10-02T20:12:30.366156] [DEBUG] [VALIDATOR ] MITT: Primary data validation passed. [2025-10-02T20:12:30.367013] [INFO ] [MAIN ] MITT: Fetched primary data is valid. [2025-10-02T20:12:30.367094] [DEBUG] [LOCAL ] MITT: Saving primary data. [2025-10-02T20:12:30.368203] [DEBUG] [LOCAL ] MITT: Trimmed 34797 records to 23090 (keeping 200 days of data) [2025-10-02T20:12:30.513760] [DEBUG] [LOCAL ] MITT: Primary data saved (23090 records). [2025-10-02T20:12:30.513891] [INFO ] [MAIN ] MITT: Full history saved. [2025-10-02T20:12:30.513975] [INFO ] [MAIN ] Update Progress: 1364/2370 symbols completed. MITT took 38.6s. Estimated remaining: 2h 21m 56s. Rate: 7.1 symbols/min [2025-10-02T20:12:30.678095] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-04. [2025-10-02T20:12:30.704164] [INFO ] [MAIN ] MLM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:12:30.737266] [DEBUG] [LOCAL ] MLM: Loaded 29977 existing records from primary storage. [2025-10-02T20:12:30.737561] [INFO ] [MAIN ] MLM: Loaded 29977 existing records. [2025-10-02T20:12:30.938921] [WARN ] [MAIN ] MLM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:12:30.939166] [INFO ] [MAIN ] MLM: Wiping existing primary data before full refresh. [2025-10-02T20:12:30.939219] [INFO ] [LOCAL ] MLM: Starting deletion of primary data. [2025-10-02T20:12:30.940399] [DEBUG] [LOCAL ] MLM: Deleted primary data file. [2025-10-02T20:12:30.940464] [INFO ] [MAIN ] MLM: Starting full primary refresh. [2025-10-02T20:12:31.339822] [INFO ] [REMOTE ] MLM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:12:31.448566] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-02T20:12:31.472949] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-05. [2025-10-02T20:12:32.273007] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-02. [2025-10-02T20:12:32.439022] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-02T20:12:32.961797] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-02T20:12:33.073053] [INFO ] [REMOTE ] MLM: Fetching primary data for 2024-12. [2025-10-02T20:12:33.833484] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-02T20:12:33.872968] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-03. [2025-10-02T20:12:34.484150] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-02T20:12:34.673049] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-06. [2025-10-02T20:12:35.192133] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-02T20:12:35.473039] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-01. [2025-10-02T20:12:36.052554] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-02T20:12:36.272984] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-07. [2025-10-02T20:12:36.669971] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-02T20:12:37.073010] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-02. [2025-10-02T20:12:37.670258] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-02T20:12:37.873040] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-04. [2025-10-02T20:12:38.609169] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-02T20:12:38.673044] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-03. [2025-10-02T20:12:39.285918] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-02T20:12:39.472998] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-08. [2025-10-02T20:12:40.270093] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-02T20:12:40.280998] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-05. [2025-10-02T20:12:40.935780] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-02T20:12:41.073004] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-05. [2025-10-02T20:12:41.759490] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-02T20:12:41.873006] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-09. [2025-10-02T20:12:42.554769] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-02T20:12:42.673026] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-06. [2025-10-02T20:12:43.292487] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-02T20:12:43.473049] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-06. [2025-10-02T20:12:44.269396] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-02T20:12:44.278317] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-10. [2025-10-02T20:12:45.072982] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-04. [2025-10-02T20:12:45.203127] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-02T20:12:45.411963] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-02T20:12:45.413596] [INFO ] [REMOTE ] MKL: Full fetch complete (49611 records). [2025-10-02T20:12:45.413736] [DEBUG] [VALIDATOR ] MKL: Validating primary data. [2025-10-02T20:12:45.839906] [DEBUG] [VALIDATOR ] MKL: All expected trading days are present. [2025-10-02T20:12:45.839991] [DEBUG] [VALIDATOR ] MKL: Primary data validation passed. [2025-10-02T20:12:45.840836] [INFO ] [MAIN ] MKL: Fetched primary data is valid. [2025-10-02T20:12:45.840902] [DEBUG] [LOCAL ] MKL: Saving primary data. [2025-10-02T20:12:45.842064] [DEBUG] [LOCAL ] MKL: Trimmed 49611 records to 34273 (keeping 200 days of data) [2025-10-02T20:12:45.898436] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-07. [2025-10-02T20:12:46.072994] [DEBUG] [LOCAL ] MKL: Primary data saved (34273 records). [2025-10-02T20:12:46.073145] [INFO ] [MAIN ] MKL: Full history saved. [2025-10-02T20:12:46.073232] [INFO ] [MAIN ] Update Progress: 1365/2370 symbols completed. MKL took 30.6s. Estimated remaining: 2h 21m 53s. Rate: 7.1 symbols/min [2025-10-02T20:12:46.256778] [INFO ] [MAIN ] MLNK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:12:46.284471] [DEBUG] [LOCAL ] MLNK: Loaded 25390 existing records from primary storage. [2025-10-02T20:12:46.284764] [INFO ] [MAIN ] MLNK: Loaded 25390 existing records. [2025-10-02T20:12:46.489824] [WARN ] [MAIN ] MLNK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:12:46.490212] [INFO ] [MAIN ] MLNK: Wiping existing primary data before full refresh. [2025-10-02T20:12:46.490365] [INFO ] [LOCAL ] MLNK: Starting deletion of primary data. [2025-10-02T20:12:46.491223] [DEBUG] [LOCAL ] MLNK: Deleted primary data file. [2025-10-02T20:12:46.491290] [INFO ] [MAIN ] MLNK: Starting full primary refresh. [2025-10-02T20:12:46.676891] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-07. [2025-10-02T20:12:46.689586] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-02T20:12:46.913991] [INFO ] [REMOTE ] MLNK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:12:47.478091] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2024-12. [2025-10-02T20:12:47.498109] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-02T20:12:48.272973] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-05. [2025-10-02T20:12:48.447714] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-02T20:12:48.512393] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-02T20:12:49.073028] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-01. [2025-10-02T20:12:49.646038] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-02T20:12:49.872969] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-06. [2025-10-02T20:12:50.349763] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-02T20:12:50.673041] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-08. [2025-10-02T20:12:51.187735] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-02T20:12:51.473018] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-08. [2025-10-02T20:12:52.273009] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-07. [2025-10-02T20:12:52.437173] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-02T20:12:53.073028] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-09. [2025-10-02T20:12:53.337583] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-02T20:12:53.707528] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-02T20:12:53.873002] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-08. [2025-10-02T20:12:54.672989] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-09. [2025-10-02T20:12:54.831210] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-02T20:12:54.986569] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-02T20:12:55.473028] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-10. [2025-10-02T20:12:55.903259] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-02T20:12:56.273026] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-09. [2025-10-02T20:12:56.856022] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-02T20:12:56.859146] [INFO ] [REMOTE ] MKC: Full fetch complete (75580 records). [2025-10-02T20:12:56.859281] [DEBUG] [VALIDATOR ] MKC: Validating primary data. [2025-10-02T20:12:57.081824] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-02. [2025-10-02T20:12:57.310613] [DEBUG] [VALIDATOR ] MKC: All expected trading days are present. [2025-10-02T20:12:57.310767] [DEBUG] [VALIDATOR ] MKC: Primary data validation passed. [2025-10-02T20:12:57.311809] [INFO ] [MAIN ] MKC: Fetched primary data is valid. [2025-10-02T20:12:57.311877] [DEBUG] [LOCAL ] MKC: Saving primary data. [2025-10-02T20:12:57.313497] [DEBUG] [LOCAL ] MKC: Trimmed 75580 records to 52828 (keeping 200 days of data) [2025-10-02T20:12:57.651960] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-02T20:12:57.687830] [DEBUG] [LOCAL ] MKC: Primary data saved (52828 records). [2025-10-02T20:12:57.687974] [INFO ] [MAIN ] MKC: Full history saved. [2025-10-02T20:12:57.688093] [INFO ] [MAIN ] Update Progress: 1366/2370 symbols completed. MKC took 44.3s. Estimated remaining: 2h 21m 47s. Rate: 7.1 symbols/min [2025-10-02T20:12:57.873765] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-10. [2025-10-02T20:12:57.875490] [INFO ] [MAIN ] MLP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:12:57.882677] [DEBUG] [LOCAL ] MLP: Loaded 2986 existing records from primary storage. [2025-10-02T20:12:57.882929] [INFO ] [MAIN ] MLP: Loaded 2986 existing records. [2025-10-02T20:12:58.082046] [WARN ] [MAIN ] MLP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:12:58.082310] [INFO ] [MAIN ] MLP: Wiping existing primary data before full refresh. [2025-10-02T20:12:58.082365] [INFO ] [LOCAL ] MLP: Starting deletion of primary data. [2025-10-02T20:12:58.082695] [DEBUG] [LOCAL ] MLP: Deleted primary data file. [2025-10-02T20:12:58.082757] [INFO ] [MAIN ] MLP: Starting full primary refresh. [2025-10-02T20:12:58.221109] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-02T20:12:58.488968] [INFO ] [REMOTE ] MLP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:12:58.672999] [INFO ] [REMOTE ] MLP: Fetching primary data for 2024-12. [2025-10-02T20:12:59.065713] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-02T20:12:59.068150] [INFO ] [REMOTE ] MLI: Full fetch complete (63326 records). [2025-10-02T20:12:59.068396] [DEBUG] [VALIDATOR ] MLI: Validating primary data. [2025-10-02T20:12:59.421473] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-02T20:12:59.473064] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-01. [2025-10-02T20:12:59.529328] [DEBUG] [VALIDATOR ] MLI: All expected trading days are present. [2025-10-02T20:12:59.529422] [DEBUG] [VALIDATOR ] MLI: Primary data validation passed. [2025-10-02T20:12:59.530468] [INFO ] [MAIN ] MLI: Fetched primary data is valid. [2025-10-02T20:12:59.530546] [DEBUG] [LOCAL ] MLI: Saving primary data. [2025-10-02T20:12:59.532104] [DEBUG] [LOCAL ] MLI: Trimmed 63326 records to 43830 (keeping 200 days of data) [2025-10-02T20:12:59.842367] [DEBUG] [LOCAL ] MLI: Primary data saved (43830 records). [2025-10-02T20:12:59.842576] [INFO ] [MAIN ] MLI: Full history saved. [2025-10-02T20:12:59.842850] [INFO ] [MAIN ] Update Progress: 1367/2370 symbols completed. MLI took 37.4s. Estimated remaining: 2h 21m 34s. Rate: 7.1 symbols/min [2025-10-02T20:13:00.032831] [INFO ] [MAIN ] MLR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:13:00.050146] [DEBUG] [LOCAL ] MLR: Loaded 12504 existing records from primary storage. [2025-10-02T20:13:00.050431] [INFO ] [MAIN ] MLR: Loaded 12504 existing records. [2025-10-02T20:13:00.171499] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-02T20:13:00.260290] [WARN ] [MAIN ] MLR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:13:00.260508] [INFO ] [MAIN ] MLR: Wiping existing primary data before full refresh. [2025-10-02T20:13:00.260563] [INFO ] [LOCAL ] MLR: Starting deletion of primary data. [2025-10-02T20:13:00.261103] [DEBUG] [LOCAL ] MLR: Deleted primary data file. [2025-10-02T20:13:00.261185] [INFO ] [MAIN ] MLR: Starting full primary refresh. [2025-10-02T20:13:00.282574] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-03. [2025-10-02T20:13:00.650968] [INFO ] [REMOTE ] MLR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:13:01.072962] [INFO ] [REMOTE ] MLR: Fetching primary data for 2024-12. [2025-10-02T20:13:01.242066] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-02T20:13:01.873012] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-10. [2025-10-02T20:13:02.192002] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-02T20:13:02.672994] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-04. [2025-10-02T20:13:02.770220] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-02T20:13:02.775088] [INFO ] [REMOTE ] MLM: Full fetch complete (45574 records). [2025-10-02T20:13:02.775227] [DEBUG] [VALIDATOR ] MLM: Validating primary data. [2025-10-02T20:13:03.206945] [DEBUG] [VALIDATOR ] MLM: All expected trading days are present. [2025-10-02T20:13:03.207041] [DEBUG] [VALIDATOR ] MLM: Primary data validation passed. [2025-10-02T20:13:03.208013] [INFO ] [MAIN ] MLM: Fetched primary data is valid. [2025-10-02T20:13:03.208083] [DEBUG] [LOCAL ] MLM: Saving primary data. [2025-10-02T20:13:03.210250] [DEBUG] [LOCAL ] MLM: Trimmed 45574 records to 30160 (keeping 200 days of data) [2025-10-02T20:13:03.438496] [DEBUG] [LOCAL ] MLM: Primary data saved (30160 records). [2025-10-02T20:13:03.438677] [INFO ] [MAIN ] MLM: Full history saved. [2025-10-02T20:13:03.438870] [INFO ] [MAIN ] Update Progress: 1368/2370 symbols completed. MLM took 32.9s. Estimated remaining: 2h 21m 22s. Rate: 7.1 symbols/min [2025-10-02T20:13:03.478071] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-02. [2025-10-02T20:13:03.634781] [INFO ] [MAIN ] MMC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:13:03.694260] [DEBUG] [LOCAL ] MMC: Loaded 51794 existing records from primary storage. [2025-10-02T20:13:03.694638] [INFO ] [MAIN ] MMC: Loaded 51794 existing records. [2025-10-02T20:13:03.907374] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-02T20:13:03.913953] [WARN ] [MAIN ] MMC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:13:03.922527] [INFO ] [MAIN ] MMC: Wiping existing primary data before full refresh. [2025-10-02T20:13:03.923068] [INFO ] [LOCAL ] MMC: Starting deletion of primary data. [2025-10-02T20:13:03.924345] [DEBUG] [LOCAL ] MMC: Deleted primary data file. [2025-10-02T20:13:03.924408] [INFO ] [MAIN ] MMC: Starting full primary refresh. [2025-10-02T20:13:04.159147] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-02T20:13:04.278105] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-01. [2025-10-02T20:13:04.354969] [INFO ] [REMOTE ] MMC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:13:05.073000] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-03. [2025-10-02T20:13:05.191723] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-02T20:13:05.564539] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-02T20:13:05.872992] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-02. [2025-10-02T20:13:06.673003] [INFO ] [REMOTE ] MMC: Fetching primary data for 2024-12. [2025-10-02T20:13:06.700248] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-02T20:13:07.473006] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-03. [2025-10-02T20:13:08.273005] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-04. [2025-10-02T20:13:08.354103] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-02T20:13:08.587248] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-02T20:13:08.885734] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-02T20:13:09.073076] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-05. [2025-10-02T20:13:09.731446] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-02T20:13:09.873038] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-01. [2025-10-02T20:13:10.673022] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-05. [2025-10-02T20:13:11.473057] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-04. [2025-10-02T20:13:11.654213] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-02T20:13:11.678970] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-02T20:13:12.232485] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-02T20:13:12.273012] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-02. [2025-10-02T20:13:13.072999] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-06. [2025-10-02T20:13:13.401028] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-02T20:13:13.665028] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-02T20:13:13.873008] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-03. [2025-10-02T20:13:14.673055] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-05. [2025-10-02T20:13:15.473013] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-07. [2025-10-02T20:13:15.487599] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-02T20:13:15.656228] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-02T20:13:16.160799] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-02T20:13:16.273040] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-06. [2025-10-02T20:13:16.867835] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-02T20:13:17.073042] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-06. [2025-10-02T20:13:17.873035] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-04. [2025-10-02T20:13:18.443002] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-02T20:13:18.673017] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-07. [2025-10-02T20:13:19.473088] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-07. [2025-10-02T20:13:19.505075] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-02T20:13:19.775891] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-02T20:13:20.273052] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-08. [2025-10-02T20:13:20.530506] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-02T20:13:21.073003] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-08. [2025-10-02T20:13:21.146531] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-02T20:13:21.599199] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-02T20:13:21.873019] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-05. [2025-10-02T20:13:22.673043] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-08. [2025-10-02T20:13:23.473012] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-09. [2025-10-02T20:13:24.005940] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-02T20:13:24.046867] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-02T20:13:24.200142] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-02T20:13:24.273033] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-09. [2025-10-02T20:13:25.073042] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-06. [2025-10-02T20:13:25.432334] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-02T20:13:25.873031] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-09. [2025-10-02T20:13:26.179632] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-02T20:13:26.622902] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-02T20:13:26.673036] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-10. [2025-10-02T20:13:27.473049] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-10. [2025-10-02T20:13:27.603460] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-02T20:13:27.607256] [INFO ] [REMOTE ] MLNK: Full fetch complete (36099 records). [2025-10-02T20:13:27.607438] [DEBUG] [VALIDATOR ] MLNK: Validating primary data. [2025-10-02T20:13:27.944109] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-02T20:13:27.955355] [INFO ] [REMOTE ] MLP: Full fetch complete (4576 records). [2025-10-02T20:13:27.965723] [DEBUG] [VALIDATOR ] MLP: Validating primary data. [2025-10-02T20:13:28.163824] [DEBUG] [VALIDATOR ] MLNK: All expected trading days are present. [2025-10-02T20:13:28.179417] [DEBUG] [VALIDATOR ] MLNK: Primary data validation passed. [2025-10-02T20:13:28.207638] [INFO ] [MAIN ] MLNK: Fetched primary data is valid. [2025-10-02T20:13:28.213316] [DEBUG] [LOCAL ] MLNK: Saving primary data. [2025-10-02T20:13:28.226791] [DEBUG] [LOCAL ] MLNK: Trimmed 36099 records to 25666 (keeping 200 days of data) [2025-10-02T20:13:28.278104] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-10. [2025-10-02T20:13:28.589265] [DEBUG] [LOCAL ] MLNK: Primary data saved (25666 records). [2025-10-02T20:13:28.619868] [INFO ] [MAIN ] MLNK: Full history saved. [2025-10-02T20:13:28.625877] [DEBUG] [VALIDATOR ] MLP: All expected trading days are present. [2025-10-02T20:13:28.626080] [INFO ] [MAIN ] Update Progress: 1369/2370 symbols completed. MLNK took 42.6s. Estimated remaining: 2h 21m 25s. Rate: 7.1 symbols/min [2025-10-02T20:13:28.626383] [DEBUG] [VALIDATOR ] MLP: Primary data validation passed. [2025-10-02T20:13:28.631852] [INFO ] [MAIN ] MLP: Fetched primary data is valid. [2025-10-02T20:13:28.639400] [DEBUG] [LOCAL ] MLP: Saving primary data. [2025-10-02T20:13:28.677037] [DEBUG] [LOCAL ] MLP: Trimmed 4576 records to 3007 (keeping 200 days of data) [2025-10-02T20:13:28.779912] [DEBUG] [LOCAL ] MLP: Primary data saved (3007 records). [2025-10-02T20:13:28.790350] [INFO ] [MAIN ] MLP: Full history saved. [2025-10-02T20:13:28.806056] [INFO ] [MAIN ] Update Progress: 1370/2370 symbols completed. MLP took 31.1s. Estimated remaining: 2h 21m 11s. Rate: 7.1 symbols/min [2025-10-02T20:13:28.875489] [INFO ] [MAIN ] MMD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:13:29.046818] [DEBUG] [LOCAL ] MMD: Loaded 11388 existing records from primary storage. [2025-10-02T20:13:29.046054] [INFO ] [MAIN ] MMI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:13:29.047319] [INFO ] [MAIN ] MMD: Loaded 11388 existing records. [2025-10-02T20:13:29.082368] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-07. [2025-10-02T20:13:29.127261] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-02T20:13:29.164442] [INFO ] [REMOTE ] MLR: Full fetch complete (18689 records). [2025-10-02T20:13:29.176481] [DEBUG] [VALIDATOR ] MLR: Validating primary data. [2025-10-02T20:13:29.266883] [DEBUG] [LOCAL ] MMI: Loaded 15098 existing records from primary storage. [2025-10-02T20:13:29.301030] [INFO ] [MAIN ] MMI: Loaded 15098 existing records. [2025-10-02T20:13:29.354673] [WARN ] [MAIN ] MMD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:13:29.383386] [INFO ] [MAIN ] MMD: Wiping existing primary data before full refresh. [2025-10-02T20:13:29.395016] [INFO ] [LOCAL ] MMD: Starting deletion of primary data. [2025-10-02T20:13:29.445271] [DEBUG] [LOCAL ] MMD: Deleted primary data file. [2025-10-02T20:13:29.505912] [INFO ] [MAIN ] MMD: Starting full primary refresh. [2025-10-02T20:13:29.817700] [WARN ] [MAIN ] MMI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:13:29.919524] [INFO ] [MAIN ] MMI: Wiping existing primary data before full refresh. [2025-10-02T20:13:29.944779] [INFO ] [LOCAL ] MMI: Starting deletion of primary data. [2025-10-02T20:13:29.987114] [DEBUG] [LOCAL ] MMI: Deleted primary data file. [2025-10-02T20:13:30.020501] [INFO ] [MAIN ] MMI: Starting full primary refresh. [2025-10-02T20:13:30.242988] [DEBUG] [VALIDATOR ] MLR: All expected trading days are present. [2025-10-02T20:13:30.261060] [DEBUG] [VALIDATOR ] MLR: Primary data validation passed. [2025-10-02T20:13:30.318248] [INFO ] [MAIN ] MLR: Fetched primary data is valid. [2025-10-02T20:13:30.353599] [DEBUG] [LOCAL ] MLR: Saving primary data. [2025-10-02T20:13:30.429587] [DEBUG] [LOCAL ] MLR: Trimmed 18689 records to 12560 (keeping 200 days of data) [2025-10-02T20:13:30.658710] [INFO ] [REMOTE ] MMD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:13:30.664886] [INFO ] [REMOTE ] MMD: Fetching primary data for 2024-12. [2025-10-02T20:13:30.812258] [INFO ] [REMOTE ] MMI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:13:30.818109] [DEBUG] [LOCAL ] MLR: Primary data saved (12560 records). [2025-10-02T20:13:30.818864] [INFO ] [REMOTE ] MMI: Fetching primary data for 2024-12. [2025-10-02T20:13:30.818976] [INFO ] [MAIN ] MLR: Full history saved. [2025-10-02T20:13:30.819989] [INFO ] [MAIN ] Update Progress: 1371/2370 symbols completed. MLR took 31.0s. Estimated remaining: 2h 20m 58s. Rate: 7.1 symbols/min [2025-10-02T20:13:31.018505] [INFO ] [MAIN ] MMID: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:13:31.018858] [DEBUG] [LOCAL ] MMID: No existing data file found in primary storage. [2025-10-02T20:13:31.019075] [WARN ] [MAIN ] MMID: No existing data found, performing full refresh instead. [2025-10-02T20:13:31.019328] [INFO ] [MAIN ] MMID: Wiping existing primary data before full refresh. [2025-10-02T20:13:31.019405] [INFO ] [LOCAL ] MMID: Starting deletion of primary data. [2025-10-02T20:13:31.019534] [DEBUG] [LOCAL ] MMID: No primary data file found to delete. [2025-10-02T20:13:31.019586] [INFO ] [MAIN ] MMID: Starting full primary refresh. [2025-10-02T20:13:31.351459] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-02T20:13:31.476034] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-08. [2025-10-02T20:13:31.482958] [INFO ] [REMOTE ] MMID: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:13:31.593367] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-02T20:13:31.666773] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-02T20:13:32.273001] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-01. [2025-10-02T20:13:33.001884] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-02T20:13:33.073050] [INFO ] [REMOTE ] MMID: Fetching primary data for 2024-12. [2025-10-02T20:13:33.228709] [DEBUG] [REMOTE ] MMID: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T20:13:33.229096] [WARN ] [REMOTE ] MMID: No data returned for month 2024-12 [2025-10-02T20:13:33.229186] [FATAL] [REMOTE ] MMID: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T20:13:33.229234] [FATAL] [MAIN ] MMID: Failed to fetch primary data. [2025-10-02T20:13:33.229296] [WARN ] [MAIN ] MMID: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T20:13:33.229370] [INFO ] [LOCAL ] MMID: Starting deletion of primary data. [2025-10-02T20:13:33.229434] [DEBUG] [LOCAL ] MMID: No primary data file found to delete. [2025-10-02T20:13:33.229470] [INFO ] [LOCAL ] MMID: Starting deletion of derivative data. [2025-10-02T20:13:33.229510] [DEBUG] [LOCAL ] MMID: No derivative data file found to delete. [2025-10-02T20:13:33.229556] [INFO ] [MAIN ] Update Progress: 1372/2370 symbols completed. MMID took 2.4s. Estimated remaining: 2h 20m 45s. Rate: 7.1 symbols/min [2025-10-02T20:13:33.376607] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-02T20:13:33.486579] [INFO ] [MAIN ] MMKT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:13:33.486840] [DEBUG] [LOCAL ] MMKT: No existing data file found in primary storage. [2025-10-02T20:13:33.486898] [WARN ] [MAIN ] MMKT: No existing data found, performing full refresh instead. [2025-10-02T20:13:33.487048] [INFO ] [MAIN ] MMKT: Wiping existing primary data before full refresh. [2025-10-02T20:13:33.487097] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-10-02T20:13:33.487148] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-10-02T20:13:33.487189] [INFO ] [MAIN ] MMKT: Starting full primary refresh. [2025-10-02T20:13:33.877831] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-09. [2025-10-02T20:13:33.877726] [INFO ] [REMOTE ] MMKT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:13:34.673006] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2024-12. [2025-10-02T20:13:35.181210] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-02T20:13:35.472969] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-01. [2025-10-02T20:13:35.585488] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-02T20:13:35.947862] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-02T20:13:36.272993] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-10. [2025-10-02T20:13:37.073010] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-02. [2025-10-02T20:13:37.496347] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-02T20:13:37.708670] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-02T20:13:37.711611] [INFO ] [REMOTE ] MMC: Full fetch complete (74736 records). [2025-10-02T20:13:37.711844] [DEBUG] [VALIDATOR ] MMC: Validating primary data. [2025-10-02T20:13:37.878150] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-01. [2025-10-02T20:13:38.150473] [DEBUG] [VALIDATOR ] MMC: All expected trading days are present. [2025-10-02T20:13:38.150618] [DEBUG] [VALIDATOR ] MMC: Primary data validation passed. [2025-10-02T20:13:38.151992] [INFO ] [MAIN ] MMC: Fetched primary data is valid. [2025-10-02T20:13:38.152073] [DEBUG] [LOCAL ] MMC: Saving primary data. [2025-10-02T20:13:38.153733] [DEBUG] [LOCAL ] MMC: Trimmed 74736 records to 52173 (keeping 200 days of data) [2025-10-02T20:13:38.505963] [DEBUG] [LOCAL ] MMC: Primary data saved (52173 records). [2025-10-02T20:13:38.506136] [INFO ] [MAIN ] MMC: Full history saved. [2025-10-02T20:13:38.506255] [INFO ] [MAIN ] Update Progress: 1373/2370 symbols completed. MMC took 35.1s. Estimated remaining: 2h 20m 34s. Rate: 7.1 symbols/min [2025-10-02T20:13:38.678257] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-03. [2025-10-02T20:13:38.751889] [INFO ] [MAIN ] MMM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:13:38.807269] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-02T20:13:38.828974] [DEBUG] [LOCAL ] MMM: Loaded 53167 existing records from primary storage. [2025-10-02T20:13:38.829326] [INFO ] [MAIN ] MMM: Loaded 53167 existing records. [2025-10-02T20:13:39.059292] [WARN ] [MAIN ] MMM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:13:39.059527] [INFO ] [MAIN ] MMM: Wiping existing primary data before full refresh. [2025-10-02T20:13:39.059576] [INFO ] [LOCAL ] MMM: Starting deletion of primary data. [2025-10-02T20:13:39.061114] [DEBUG] [LOCAL ] MMM: Deleted primary data file. [2025-10-02T20:13:39.061192] [INFO ] [MAIN ] MMM: Starting full primary refresh. [2025-10-02T20:13:39.230261] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-02T20:13:39.450497] [INFO ] [REMOTE ] MMM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:13:39.472968] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-02. [2025-10-02T20:13:40.245224] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-02T20:13:40.272955] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-03. [2025-10-02T20:13:41.073015] [INFO ] [REMOTE ] MMM: Fetching primary data for 2024-12. [2025-10-02T20:13:41.254522] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-02T20:13:41.872998] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-02. [2025-10-02T20:13:42.678302] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-04. [2025-10-02T20:13:42.680616] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-02T20:13:42.859264] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-02T20:13:42.973018] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-10-02T20:13:43.473043] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-03. [2025-10-02T20:13:44.273015] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-05. [2025-10-02T20:13:44.288462] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-02T20:13:44.701429] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-02T20:13:45.073021] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-04. [2025-10-02T20:13:45.830012] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-02T20:13:45.872985] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-05. [2025-10-02T20:13:46.673005] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-06. [2025-10-02T20:13:46.821306] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-02T20:13:46.937403] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-10-02T20:13:47.472998] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-07. [2025-10-02T20:13:47.818002] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-02T20:13:48.272999] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-08. [2025-10-02T20:13:48.858166] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-02T20:13:49.073027] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-06. [2025-10-02T20:13:49.872979] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-09. [2025-10-02T20:13:50.104569] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-02T20:13:50.276862] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-02T20:13:50.673015] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-10. [2025-10-02T20:13:51.093051] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-02T20:13:51.093967] [INFO ] [REMOTE ] MMKT: Full fetch complete (2085 records). [2025-10-02T20:13:51.094095] [DEBUG] [VALIDATOR ] MMKT: Validating primary data. [2025-10-02T20:13:51.314554] [WARN ] [VALIDATOR ] MMKT: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-02T20:13:51.314763] [FATAL] [MAIN ] MMKT: Fetched primary data is invalid. Refusing to save it. [2025-10-02T20:13:51.314833] [WARN ] [MAIN ] MMKT: Deleting existing primary and derivative data due to validation failure. [2025-10-02T20:13:51.314908] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-10-02T20:13:51.314973] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-10-02T20:13:51.315029] [INFO ] [LOCAL ] MMKT: Starting deletion of derivative data. [2025-10-02T20:13:51.315073] [DEBUG] [LOCAL ] MMKT: No derivative data file found to delete. [2025-10-02T20:13:51.315160] [INFO ] [MAIN ] Update Progress: 1374/2370 symbols completed. MMKT took 18.1s. Estimated remaining: 2h 20m 29s. Rate: 7.1 symbols/min [2025-10-02T20:13:51.504993] [INFO ] [MAIN ] MMS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:13:51.478081] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-01. [2025-10-02T20:13:51.541244] [DEBUG] [LOCAL ] MMS: Loaded 33864 existing records from primary storage. [2025-10-02T20:13:51.541520] [INFO ] [MAIN ] MMS: Loaded 33864 existing records. [2025-10-02T20:13:51.731981] [WARN ] [MAIN ] MMS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:13:51.732192] [INFO ] [MAIN ] MMS: Wiping existing primary data before full refresh. [2025-10-02T20:13:51.732242] [INFO ] [LOCAL ] MMS: Starting deletion of primary data. [2025-10-02T20:13:51.733067] [DEBUG] [LOCAL ] MMS: Deleted primary data file. [2025-10-02T20:13:51.733128] [INFO ] [MAIN ] MMS: Starting full primary refresh. [2025-10-02T20:13:52.131880] [INFO ] [REMOTE ] MMS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:13:52.273002] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-07. [2025-10-02T20:13:53.072977] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-04. [2025-10-02T20:13:53.230169] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-02T20:13:53.646627] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-10-02T20:13:53.872972] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-08. [2025-10-02T20:13:54.032226] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-02T20:13:54.506053] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-02T20:13:54.673167] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-05. [2025-10-02T20:13:55.442188] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-02T20:13:55.472973] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-06. [2025-10-02T20:13:56.145988] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-02T20:13:56.272999] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-02. [2025-10-02T20:13:57.073178] [INFO ] [REMOTE ] MMS: Fetching primary data for 2024-12. [2025-10-02T20:13:57.872993] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-09. [2025-10-02T20:13:58.092870] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-02T20:13:58.483357] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-02T20:13:58.636120] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-02T20:13:58.673025] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-01. [2025-10-02T20:13:59.472999] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-07. [2025-10-02T20:14:00.007479] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-02T20:14:00.262817] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-02T20:14:00.273817] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-03. [2025-10-02T20:14:01.073011] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-02. [2025-10-02T20:14:01.873009] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-08. [2025-10-02T20:14:02.436962] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-02T20:14:02.583179] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-02T20:14:02.673014] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-04. [2025-10-02T20:14:02.701691] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-02T20:14:03.473039] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-10. [2025-10-02T20:14:04.221535] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-02T20:14:04.222691] [INFO ] [REMOTE ] MMI: Full fetch complete (21152 records). [2025-10-02T20:14:04.222808] [DEBUG] [VALIDATOR ] MMI: Validating primary data. [2025-10-02T20:14:04.282676] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-09. [2025-10-02T20:14:04.666072] [DEBUG] [VALIDATOR ] MMI: All expected trading days are present. [2025-10-02T20:14:04.666168] [DEBUG] [VALIDATOR ] MMI: Primary data validation passed. [2025-10-02T20:14:04.666719] [INFO ] [MAIN ] MMI: Fetched primary data is valid. [2025-10-02T20:14:04.666783] [DEBUG] [LOCAL ] MMI: Saving primary data. [2025-10-02T20:14:04.667678] [DEBUG] [LOCAL ] MMI: Trimmed 21152 records to 15236 (keeping 200 days of data) [2025-10-02T20:14:04.776343] [DEBUG] [LOCAL ] MMI: Primary data saved (15236 records). [2025-10-02T20:14:04.776490] [INFO ] [MAIN ] MMI: Full history saved. [2025-10-02T20:14:04.776607] [INFO ] [MAIN ] Update Progress: 1375/2370 symbols completed. MMI took 36.0s. Estimated remaining: 2h 20m 24s. Rate: 7.1 symbols/min [2025-10-02T20:14:04.973189] [INFO ] [MAIN ] MMT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:14:04.982568] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-02T20:14:05.025969] [DEBUG] [LOCAL ] MMT: Loaded 10794 existing records from primary storage. [2025-10-02T20:14:05.027992] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-10-02T20:14:05.028129] [INFO ] [MAIN ] MMT: Loaded 10794 existing records. [2025-10-02T20:14:05.078247] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-03. [2025-10-02T20:14:05.235336] [WARN ] [MAIN ] MMT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:14:05.235567] [INFO ] [MAIN ] MMT: Wiping existing primary data before full refresh. [2025-10-02T20:14:05.235637] [INFO ] [LOCAL ] MMT: Starting deletion of primary data. [2025-10-02T20:14:05.236168] [DEBUG] [LOCAL ] MMT: Deleted primary data file. [2025-10-02T20:14:05.236233] [INFO ] [MAIN ] MMT: Starting full primary refresh. [2025-10-02T20:14:05.625095] [INFO ] [REMOTE ] MMT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:14:05.873040] [INFO ] [REMOTE ] MMT: Fetching primary data for 2024-12. [2025-10-02T20:14:06.674850] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-10. [2025-10-02T20:14:06.699528] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-02T20:14:06.700713] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-02T20:14:07.277344] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-02T20:14:07.279456] [INFO ] [REMOTE ] MMD: Full fetch complete (17859 records). [2025-10-02T20:14:07.279544] [DEBUG] [VALIDATOR ] MMD: Validating primary data. [2025-10-02T20:14:07.476901] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-04. [2025-10-02T20:14:07.701090] [DEBUG] [VALIDATOR ] MMD: All expected trading days are present. [2025-10-02T20:14:07.701183] [DEBUG] [VALIDATOR ] MMD: Primary data validation passed. [2025-10-02T20:14:07.701632] [INFO ] [MAIN ] MMD: Fetched primary data is valid. [2025-10-02T20:14:07.701728] [DEBUG] [LOCAL ] MMD: Saving primary data. [2025-10-02T20:14:07.702895] [DEBUG] [LOCAL ] MMD: Trimmed 17859 records to 11435 (keeping 200 days of data) [2025-10-02T20:14:07.777031] [DEBUG] [LOCAL ] MMD: Primary data saved (11435 records). [2025-10-02T20:14:07.777219] [INFO ] [MAIN ] MMD: Full history saved. [2025-10-02T20:14:07.777340] [INFO ] [MAIN ] Update Progress: 1376/2370 symbols completed. MMD took 39.2s. Estimated remaining: 2h 20m 11s. Rate: 7.1 symbols/min [2025-10-02T20:14:07.960278] [INFO ] [MAIN ] MMU: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:14:07.978837] [DEBUG] [LOCAL ] MMU: Loaded 16842 existing records from primary storage. [2025-10-02T20:14:07.979111] [INFO ] [MAIN ] MMU: Loaded 16842 existing records. [2025-10-02T20:14:08.173009] [WARN ] [MAIN ] MMU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:14:08.173295] [INFO ] [MAIN ] MMU: Wiping existing primary data before full refresh. [2025-10-02T20:14:08.173369] [INFO ] [LOCAL ] MMU: Starting deletion of primary data. [2025-10-02T20:14:08.174002] [DEBUG] [LOCAL ] MMU: Deleted primary data file. [2025-10-02T20:14:08.174078] [INFO ] [MAIN ] MMU: Starting full primary refresh. [2025-10-02T20:14:08.282452] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-01. [2025-10-02T20:14:08.586285] [INFO ] [REMOTE ] MMU: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:14:08.972632] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-02T20:14:09.072973] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-05. [2025-10-02T20:14:09.179571] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-02T20:14:09.873035] [INFO ] [REMOTE ] MMU: Fetching primary data for 2024-12. [2025-10-02T20:14:10.195569] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-02T20:14:10.673010] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-02. [2025-10-02T20:14:10.910812] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-02T20:14:11.466240] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-02T20:14:11.472947] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-03. [2025-10-02T20:14:12.143934] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-02T20:14:12.273010] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-04. [2025-10-02T20:14:12.902696] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-02T20:14:13.072992] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-06. [2025-10-02T20:14:13.873003] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-01. [2025-10-02T20:14:14.320536] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-02T20:14:14.672999] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-05. [2025-10-02T20:14:14.943620] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-02T20:14:15.472996] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-05. [2025-10-02T20:14:16.272986] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-02. [2025-10-02T20:14:16.329279] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-02T20:14:16.570972] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-02T20:14:17.073050] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-06. [2025-10-02T20:14:17.275689] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-02T20:14:17.873005] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-03. [2025-10-02T20:14:18.673009] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-06. [2025-10-02T20:14:18.835064] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-02T20:14:18.946544] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-02T20:14:19.437596] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-02T20:14:19.472977] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-07. [2025-10-02T20:14:20.273016] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-04. [2025-10-02T20:14:20.498631] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-02T20:14:21.009415] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-02T20:14:21.072993] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-07. [2025-10-02T20:14:21.872985] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-05. [2025-10-02T20:14:22.672998] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-08. [2025-10-02T20:14:22.771460] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-02T20:14:23.292060] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-02T20:14:23.476981] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-06. [2025-10-02T20:14:23.479109] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-02T20:14:24.205145] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-02T20:14:24.273042] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-08. [2025-10-02T20:14:25.073016] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-07. [2025-10-02T20:14:25.873025] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-07. [2025-10-02T20:14:26.025174] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-02T20:14:26.255381] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-02T20:14:26.673053] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-09. [2025-10-02T20:14:27.332451] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-02T20:14:27.473031] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-09. [2025-10-02T20:14:28.192358] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-02T20:14:28.275896] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-08. [2025-10-02T20:14:28.281889] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-02T20:14:29.061087] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-02T20:14:29.072947] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-09. [2025-10-02T20:14:29.873033] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-10. [2025-10-02T20:14:29.989182] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-02T20:14:30.673034] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-10. [2025-10-02T20:14:31.435430] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-02T20:14:31.435620] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-02T20:14:31.439124] [INFO ] [REMOTE ] MMT: Full fetch complete (16096 records). [2025-10-02T20:14:31.439205] [DEBUG] [VALIDATOR ] MMT: Validating primary data. [2025-10-02T20:14:31.439301] [INFO ] [REMOTE ] MMM: Full fetch complete (77086 records). [2025-10-02T20:14:31.474152] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-08. [2025-10-02T20:14:31.474068] [DEBUG] [VALIDATOR ] MMM: Validating primary data. [2025-10-02T20:14:32.279711] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-10. [2025-10-02T20:14:32.285024] [DEBUG] [VALIDATOR ] MMT: All expected trading days are present. [2025-10-02T20:14:32.286036] [DEBUG] [VALIDATOR ] MMT: Primary data validation passed. [2025-10-02T20:14:32.315349] [INFO ] [MAIN ] MMT: Fetched primary data is valid. [2025-10-02T20:14:32.347313] [DEBUG] [VALIDATOR ] MMM: All expected trading days are present. [2025-10-02T20:14:32.347152] [DEBUG] [LOCAL ] MMT: Saving primary data. [2025-10-02T20:14:32.347441] [DEBUG] [VALIDATOR ] MMM: Primary data validation passed. [2025-10-02T20:14:32.348696] [INFO ] [MAIN ] MMM: Fetched primary data is valid. [2025-10-02T20:14:32.348778] [DEBUG] [LOCAL ] MMM: Saving primary data. [2025-10-02T20:14:32.350059] [DEBUG] [LOCAL ] MMT: Trimmed 16096 records to 10865 (keeping 200 days of data) [2025-10-02T20:14:32.350977] [DEBUG] [LOCAL ] MMM: Trimmed 77086 records to 53550 (keeping 200 days of data) [2025-10-02T20:14:32.543002] [DEBUG] [LOCAL ] MMT: Primary data saved (10865 records). [2025-10-02T20:14:32.543771] [INFO ] [MAIN ] MMT: Full history saved. [2025-10-02T20:14:32.544155] [INFO ] [MAIN ] Update Progress: 1377/2370 symbols completed. MMT took 27.8s. Estimated remaining: 2h 20m 15s. Rate: 7.1 symbols/min [2025-10-02T20:14:32.885567] [INFO ] [MAIN ] MNR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:14:33.031239] [DEBUG] [LOCAL ] MMM: Primary data saved (53550 records). [2025-10-02T20:14:33.032350] [INFO ] [MAIN ] MMM: Full history saved. [2025-10-02T20:14:33.033479] [INFO ] [MAIN ] Update Progress: 1378/2370 symbols completed. MMM took 54.5s. Estimated remaining: 2h 20m 0s. Rate: 7.1 symbols/min [2025-10-02T20:14:33.033298] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-02T20:14:33.078094] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-09. [2025-10-02T20:14:33.118791] [DEBUG] [LOCAL ] MNR: Loaded 24370 existing records from primary storage. [2025-10-02T20:14:33.150689] [INFO ] [MAIN ] MNR: Loaded 24370 existing records. [2025-10-02T20:14:33.275284] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-02T20:14:33.320673] [INFO ] [REMOTE ] MMU: Full fetch complete (25591 records). [2025-10-02T20:14:33.344726] [DEBUG] [VALIDATOR ] MMU: Validating primary data. [2025-10-02T20:14:33.397591] [INFO ] [MAIN ] MNSO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:14:33.521294] [WARN ] [MAIN ] MNR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:14:33.562045] [INFO ] [MAIN ] MNR: Wiping existing primary data before full refresh. [2025-10-02T20:14:33.562138] [INFO ] [LOCAL ] MNR: Starting deletion of primary data. [2025-10-02T20:14:33.597499] [DEBUG] [LOCAL ] MNR: Deleted primary data file. [2025-10-02T20:14:33.602847] [INFO ] [MAIN ] MNR: Starting full primary refresh. [2025-10-02T20:14:33.941171] [DEBUG] [LOCAL ] MNSO: Loaded 44366 existing records from primary storage. [2025-10-02T20:14:33.985966] [INFO ] [MAIN ] MNSO: Loaded 44366 existing records. [2025-10-02T20:14:34.324999] [DEBUG] [VALIDATOR ] MMU: All expected trading days are present. [2025-10-02T20:14:34.349200] [DEBUG] [VALIDATOR ] MMU: Primary data validation passed. [2025-10-02T20:14:34.351383] [INFO ] [MAIN ] MMU: Fetched primary data is valid. [2025-10-02T20:14:34.356853] [DEBUG] [LOCAL ] MMU: Saving primary data. [2025-10-02T20:14:34.450605] [DEBUG] [LOCAL ] MMU: Trimmed 25591 records to 16945 (keeping 200 days of data) [2025-10-02T20:14:34.534439] [WARN ] [MAIN ] MNSO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:14:34.538872] [INFO ] [REMOTE ] MNR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:14:34.540019] [INFO ] [MAIN ] MNSO: Wiping existing primary data before full refresh. [2025-10-02T20:14:34.539816] [INFO ] [REMOTE ] MNR: Fetching primary data for 2024-12. [2025-10-02T20:14:34.583770] [INFO ] [LOCAL ] MNSO: Starting deletion of primary data. [2025-10-02T20:14:34.593043] [DEBUG] [LOCAL ] MNSO: Deleted primary data file. [2025-10-02T20:14:34.593929] [INFO ] [MAIN ] MNSO: Starting full primary refresh. [2025-10-02T20:14:34.753277] [DEBUG] [LOCAL ] MMU: Primary data saved (16945 records). [2025-10-02T20:14:34.791463] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-02T20:14:34.789810] [INFO ] [MAIN ] MMU: Full history saved. [2025-10-02T20:14:34.803800] [INFO ] [MAIN ] Update Progress: 1379/2370 symbols completed. MMU took 27.0s. Estimated remaining: 2h 19m 47s. Rate: 7.1 symbols/min [2025-10-02T20:14:34.838141] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-10. [2025-10-02T20:14:35.259411] [INFO ] [MAIN ] MNTN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:14:35.285903] [DEBUG] [LOCAL ] MNTN: No existing data file found in primary storage. [2025-10-02T20:14:35.291994] [WARN ] [MAIN ] MNTN: No existing data found, performing full refresh instead. [2025-10-02T20:14:35.319277] [INFO ] [MAIN ] MNTN: Wiping existing primary data before full refresh. [2025-10-02T20:14:35.325874] [INFO ] [REMOTE ] MNSO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:14:35.325969] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-10-02T20:14:35.326111] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-10-02T20:14:35.326411] [INFO ] [MAIN ] MNTN: Starting full primary refresh. [2025-10-02T20:14:35.488845] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2024-12. [2025-10-02T20:14:35.744497] [INFO ] [REMOTE ] MNTN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:14:35.783694] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-02T20:14:36.091146] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-02T20:14:36.092998] [INFO ] [REMOTE ] MMS: Full fetch complete (52058 records). [2025-10-02T20:14:36.093119] [DEBUG] [VALIDATOR ] MMS: Validating primary data. [2025-10-02T20:14:36.273695] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-01. [2025-10-02T20:14:36.514602] [DEBUG] [VALIDATOR ] MMS: All expected trading days are present. [2025-10-02T20:14:36.514737] [DEBUG] [VALIDATOR ] MMS: Primary data validation passed. [2025-10-02T20:14:36.515802] [INFO ] [MAIN ] MMS: Fetched primary data is valid. [2025-10-02T20:14:36.515880] [DEBUG] [LOCAL ] MMS: Saving primary data. [2025-10-02T20:14:36.517190] [DEBUG] [LOCAL ] MMS: Trimmed 52058 records to 34135 (keeping 200 days of data) [2025-10-02T20:14:36.745569] [DEBUG] [LOCAL ] MMS: Primary data saved (34135 records). [2025-10-02T20:14:36.745753] [INFO ] [MAIN ] MMS: Full history saved. [2025-10-02T20:14:36.745857] [INFO ] [MAIN ] Update Progress: 1380/2370 symbols completed. MMS took 45.4s. Estimated remaining: 2h 19m 34s. Rate: 7.1 symbols/min [2025-10-02T20:14:36.940876] [INFO ] [MAIN ] MO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:14:36.941071] [DEBUG] [LOCAL ] MO: No existing data file found in primary storage. [2025-10-02T20:14:36.941120] [WARN ] [MAIN ] MO: No existing data found, performing full refresh instead. [2025-10-02T20:14:36.941234] [INFO ] [MAIN ] MO: Wiping existing primary data before full refresh. [2025-10-02T20:14:36.941277] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-10-02T20:14:36.941321] [DEBUG] [LOCAL ] MO: No primary data file found to delete. [2025-10-02T20:14:36.941354] [INFO ] [MAIN ] MO: Starting full primary refresh. [2025-10-02T20:14:37.078285] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2024-12. [2025-10-02T20:14:37.343732] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T20:14:37.352578] [WARN ] [REMOTE ] MNTN: No data returned for month 2024-12 [2025-10-02T20:14:37.357075] [INFO ] [REMOTE ] MO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:14:37.357401] [FATAL] [REMOTE ] MNTN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T20:14:37.357804] [FATAL] [MAIN ] MNTN: Failed to fetch primary data. [2025-10-02T20:14:37.357949] [WARN ] [MAIN ] MNTN: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T20:14:37.358031] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-10-02T20:14:37.358282] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-10-02T20:14:37.358373] [INFO ] [LOCAL ] MNTN: Starting deletion of derivative data. [2025-10-02T20:14:37.358576] [DEBUG] [LOCAL ] MNTN: No derivative data file found to delete. [2025-10-02T20:14:37.358673] [INFO ] [MAIN ] Update Progress: 1381/2370 symbols completed. MNTN took 2.5s. Estimated remaining: 2h 19m 20s. Rate: 7.1 symbols/min [2025-10-02T20:14:37.501467] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-02T20:14:37.604781] [INFO ] [MAIN ] MOD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:14:37.621388] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-02T20:14:37.669051] [DEBUG] [LOCAL ] MOD: Loaded 45228 existing records from primary storage. [2025-10-02T20:14:37.669361] [INFO ] [MAIN ] MOD: Loaded 45228 existing records. [2025-10-02T20:14:37.867008] [WARN ] [MAIN ] MOD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:14:37.867211] [INFO ] [MAIN ] MOD: Wiping existing primary data before full refresh. [2025-10-02T20:14:37.867261] [INFO ] [LOCAL ] MOD: Starting deletion of primary data. [2025-10-02T20:14:37.868300] [DEBUG] [LOCAL ] MOD: Deleted primary data file. [2025-10-02T20:14:37.868362] [INFO ] [MAIN ] MOD: Starting full primary refresh. [2025-10-02T20:14:37.880026] [INFO ] [REMOTE ] MO: Fetching primary data for 2024-12. [2025-10-02T20:14:38.266675] [INFO ] [REMOTE ] MOD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:14:38.673001] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-01. [2025-10-02T20:14:39.473031] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-02. [2025-10-02T20:14:40.273029] [INFO ] [REMOTE ] MOD: Fetching primary data for 2024-12. [2025-10-02T20:14:40.310172] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-02T20:14:40.759639] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2024-12 (2.88 seconds). [2025-10-02T20:14:40.790795] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-02T20:14:41.072999] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-02. [2025-10-02T20:14:41.877324] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-01. [2025-10-02T20:14:41.883307] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-02T20:14:42.673045] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-01. [2025-10-02T20:14:42.720216] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-02T20:14:43.473041] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-03. [2025-10-02T20:14:44.008751] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-02T20:14:44.054199] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-02T20:14:44.273002] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-02. [2025-10-02T20:14:44.322788] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-02T20:14:45.073039] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-04. [2025-10-02T20:14:45.873060] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-02. [2025-10-02T20:14:45.932243] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-02T20:14:45.985331] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-02T20:14:46.673021] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-05. [2025-10-02T20:14:47.472988] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-03. [2025-10-02T20:14:47.644776] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-02T20:14:47.782372] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-02T20:14:48.273049] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-06. [2025-10-02T20:14:49.072981] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-03. [2025-10-02T20:14:49.587944] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-02T20:14:49.802484] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-10-02T20:14:49.873019] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-04. [2025-10-02T20:14:50.672984] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-03. [2025-10-02T20:14:50.877750] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-02T20:14:51.473012] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-04. [2025-10-02T20:14:51.711343] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-02T20:14:52.273004] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-07. [2025-10-02T20:14:52.786932] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-02T20:14:53.073002] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-04. [2025-10-02T20:14:53.298595] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-02T20:14:53.351239] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-02T20:14:53.873018] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-05. [2025-10-02T20:14:54.673025] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-08. [2025-10-02T20:14:55.296410] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-02T20:14:55.362074] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-02T20:14:55.473004] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-06. [2025-10-02T20:14:55.504133] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-02T20:14:56.273004] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-09. [2025-10-02T20:14:57.072995] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-05. [2025-10-02T20:14:57.372241] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-02T20:14:57.485261] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-02T20:14:57.873004] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-07. [2025-10-02T20:14:58.652105] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-02T20:14:58.672970] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-06. [2025-10-02T20:14:59.472987] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-05. [2025-10-02T20:14:59.512902] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-02T20:15:00.237902] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-02T20:15:00.273010] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-07. [2025-10-02T20:15:01.073031] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-10. [2025-10-02T20:15:01.571970] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-02T20:15:01.872984] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-06. [2025-10-02T20:15:02.046163] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-02T20:15:02.047608] [INFO ] [REMOTE ] MNR: Full fetch complete (36757 records). [2025-10-02T20:15:02.047728] [DEBUG] [VALIDATOR ] MNR: Validating primary data. [2025-10-02T20:15:02.482180] [DEBUG] [VALIDATOR ] MNR: All expected trading days are present. [2025-10-02T20:15:02.482331] [DEBUG] [VALIDATOR ] MNR: Primary data validation passed. [2025-10-02T20:15:02.483325] [INFO ] [MAIN ] MNR: Fetched primary data is valid. [2025-10-02T20:15:02.483429] [DEBUG] [LOCAL ] MNR: Saving primary data. [2025-10-02T20:15:02.512204] [DEBUG] [LOCAL ] MNR: Trimmed 36757 records to 24586 (keeping 200 days of data) [2025-10-02T20:15:02.516268] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-02T20:15:02.676921] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-08. [2025-10-02T20:15:02.687087] [DEBUG] [LOCAL ] MNR: Primary data saved (24586 records). [2025-10-02T20:15:02.687191] [INFO ] [MAIN ] MNR: Full history saved. [2025-10-02T20:15:02.687272] [INFO ] [MAIN ] Update Progress: 1382/2370 symbols completed. MNR took 30.1s. Estimated remaining: 2h 19m 24s. Rate: 7.1 symbols/min [2025-10-02T20:15:02.901632] [INFO ] [MAIN ] MODG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:15:02.956243] [DEBUG] [LOCAL ] MODG: Loaded 51528 existing records from primary storage. [2025-10-02T20:15:02.956600] [INFO ] [MAIN ] MODG: Loaded 51528 existing records. [2025-10-02T20:15:03.160237] [WARN ] [MAIN ] MODG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T20:15:03.160476] [INFO ] [MAIN ] MODG: Wiping existing primary data before full refresh. [2025-10-02T20:15:03.160529] [INFO ] [LOCAL ] MODG: Starting deletion of primary data. [2025-10-02T20:15:03.161734] [DEBUG] [LOCAL ] MODG: Deleted primary data file. [2025-10-02T20:15:03.161798] [INFO ] [MAIN ] MODG: Starting full primary refresh. [2025-10-02T20:15:03.478241] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-08. [2025-10-02T20:15:03.596216] [INFO ] [REMOTE ] MODG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:15:04.212922] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-10-02T20:15:04.285156] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-07. [2025-10-02T20:15:04.303725] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-02T20:15:05.072997] [INFO ] [REMOTE ] MODG: Fetching primary data for 2024-12. [2025-10-02T20:15:05.126196] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-02T20:15:05.873069] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-09. [2025-10-02T20:15:06.672974] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-09. [2025-10-02T20:15:06.741288] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-10-02T20:15:06.798972] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-02T20:15:07.472970] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-01. [2025-10-02T20:15:08.020147] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-02T20:15:08.272972] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-10. [2025-10-02T20:15:08.451492] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-02T20:15:09.073024] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-10. [2025-10-02T20:15:09.305351] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-02T20:15:09.366620] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-02T20:15:09.368471] [INFO ] [REMOTE ] MOD: Full fetch complete (66306 records). [2025-10-02T20:15:09.368599] [DEBUG] [VALIDATOR ] MOD: Validating primary data. [2025-10-02T20:15:09.783921] [DEBUG] [VALIDATOR ] MOD: All expected trading days are present. [2025-10-02T20:15:09.784043] [DEBUG] [VALIDATOR ] MOD: Primary data validation passed. [2025-10-02T20:15:09.785127] [INFO ] [MAIN ] MOD: Fetched primary data is valid. [2025-10-02T20:15:09.785195] [DEBUG] [LOCAL ] MOD: Saving primary data. [2025-10-02T20:15:09.786504] [DEBUG] [LOCAL ] MOD: Trimmed 66306 records to 45531 (keeping 200 days of data) [2025-10-02T20:15:09.874910] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-08. [2025-10-02T20:15:10.071704] [DEBUG] [LOCAL ] MOD: Primary data saved (45531 records). [2025-10-02T20:15:10.071837] [INFO ] [MAIN ] MOD: Full history saved. [2025-10-02T20:15:10.071916] [INFO ] [MAIN ] Update Progress: 1383/2370 symbols completed. MOD took 32.7s. Estimated remaining: 2h 19m 14s. Rate: 7.1 symbols/min [2025-10-02T20:15:10.257807] [INFO ] [MAIN ] MOH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:15:10.257970] [DEBUG] [LOCAL ] MOH: No existing data file found in primary storage. [2025-10-02T20:15:10.258009] [WARN ] [MAIN ] MOH: No existing data found, performing full refresh instead. [2025-10-02T20:15:10.258125] [INFO ] [MAIN ] MOH: Wiping existing primary data before full refresh. [2025-10-02T20:15:10.258170] [INFO ] [LOCAL ] MOH: Starting deletion of primary data. [2025-10-02T20:15:10.258251] [DEBUG] [LOCAL ] MOH: No primary data file found to delete. [2025-10-02T20:15:10.258308] [INFO ] [MAIN ] MOH: Starting full primary refresh. [2025-10-02T20:15:10.454411] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-02T20:15:10.545325] [INFO ] [REMOTE ] MNSO: Full fetch complete (64229 records). [2025-10-02T20:15:10.565092] [DEBUG] [VALIDATOR ] MNSO: Validating primary data. [2025-10-02T20:15:10.680562] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-02. [2025-10-02T20:15:10.802724] [INFO ] [REMOTE ] MOH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:15:11.337697] [DEBUG] [VALIDATOR ] MNSO: All expected trading days are present. [2025-10-02T20:15:11.337833] [DEBUG] [VALIDATOR ] MNSO: Primary data validation passed. [2025-10-02T20:15:11.339930] [INFO ] [MAIN ] MNSO: Fetched primary data is valid. [2025-10-02T20:15:11.340047] [DEBUG] [LOCAL ] MNSO: Saving primary data. [2025-10-02T20:15:11.342092] [DEBUG] [LOCAL ] MNSO: Trimmed 64229 records to 44754 (keeping 200 days of data) [2025-10-02T20:15:11.473180] [INFO ] [REMOTE ] MOH: Fetching primary data for 2024-12. [2025-10-02T20:15:11.719218] [DEBUG] [LOCAL ] MNSO: Primary data saved (44754 records). [2025-10-02T20:15:11.719399] [INFO ] [MAIN ] MNSO: Full history saved. [2025-10-02T20:15:11.719512] [INFO ] [MAIN ] Update Progress: 1384/2370 symbols completed. MNSO took 38.7s. Estimated remaining: 2h 19m 1s. Rate: 7.1 symbols/min [2025-10-02T20:15:11.924917] [INFO ] [MAIN ] MOS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:15:11.925222] [DEBUG] [LOCAL ] MOS: No existing data file found in primary storage. [2025-10-02T20:15:11.925328] [WARN ] [MAIN ] MOS: No existing data found, performing full refresh instead. [2025-10-02T20:15:11.925542] [INFO ] [MAIN ] MOS: Wiping existing primary data before full refresh. [2025-10-02T20:15:11.925597] [INFO ] [LOCAL ] MOS: Starting deletion of primary data. [2025-10-02T20:15:11.925727] [DEBUG] [LOCAL ] MOS: No primary data file found to delete. [2025-10-02T20:15:11.925966] [INFO ] [MAIN ] MOS: Starting full primary refresh. [2025-10-02T20:15:12.294774] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-10-02T20:15:12.352068] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-09. [2025-10-02T20:15:12.412281] [INFO ] [REMOTE ] MOS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:15:12.443559] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-02T20:15:12.986929] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-02T20:15:13.072996] [INFO ] [REMOTE ] MOS: Fetching primary data for 2024-12. [2025-10-02T20:15:13.873024] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-03. [2025-10-02T20:15:14.649474] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-10-02T20:15:14.672995] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-01. [2025-10-02T20:15:15.124522] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-02T20:15:15.253516] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-02T20:15:15.473002] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-01. [2025-10-02T20:15:16.273017] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-10. [2025-10-02T20:15:16.347729] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-02T20:15:17.072976] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-02. [2025-10-02T20:15:17.356811] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-02T20:15:17.873001] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-02. [2025-10-02T20:15:17.970824] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-02T20:15:17.973243] [INFO ] [REMOTE ] MO: Full fetch complete (77495 records). [2025-10-02T20:15:17.973407] [DEBUG] [VALIDATOR ] MO: Validating primary data. [2025-10-02T20:15:18.199580] [WARN ] [VALIDATOR ] MO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-02T20:15:18.200628] [FATAL] [MAIN ] MO: Fetched primary data is invalid. Refusing to save it. [2025-10-02T20:15:18.200749] [WARN ] [MAIN ] MO: Deleting existing primary and derivative data due to validation failure. [2025-10-02T20:15:18.200833] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-10-02T20:15:18.200915] [DEBUG] [LOCAL ] MO: No primary data file found to delete. [2025-10-02T20:15:18.200960] [INFO ] [LOCAL ] MO: Starting deletion of derivative data. [2025-10-02T20:15:18.201005] [DEBUG] [LOCAL ] MO: No derivative data file found to delete. [2025-10-02T20:15:18.201082] [INFO ] [MAIN ] Update Progress: 1385/2370 symbols completed. MO took 41.5s. Estimated remaining: 2h 18m 51s. Rate: 7.1 symbols/min [2025-10-02T20:15:18.386549] [INFO ] [MAIN ] MOV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:15:18.387064] [DEBUG] [LOCAL ] MOV: No existing data file found in primary storage. [2025-10-02T20:15:18.387122] [WARN ] [MAIN ] MOV: No existing data found, performing full refresh instead. [2025-10-02T20:15:18.387239] [INFO ] [MAIN ] MOV: Wiping existing primary data before full refresh. [2025-10-02T20:15:18.387287] [INFO ] [LOCAL ] MOV: Starting deletion of primary data. [2025-10-02T20:15:18.387380] [DEBUG] [LOCAL ] MOV: No primary data file found to delete. [2025-10-02T20:15:18.387423] [INFO ] [MAIN ] MOV: Starting full primary refresh. [2025-10-02T20:15:18.673631] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-04. [2025-10-02T20:15:18.790440] [INFO ] [REMOTE ] MOV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:15:18.816334] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-02T20:15:19.473061] [INFO ] [REMOTE ] MOV: Fetching primary data for 2024-12. [2025-10-02T20:15:19.622816] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-02T20:15:20.273046] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-03. [2025-10-02T20:15:20.588926] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-02T20:15:20.622927] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-02T20:15:21.073048] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-05. [2025-10-02T20:15:21.872992] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-01. [2025-10-02T20:15:22.047586] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-02T20:15:22.672992] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-04. [2025-10-02T20:15:22.858083] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-02T20:15:22.898379] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-02T20:15:23.472993] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-03. [2025-10-02T20:15:24.272970] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-02. [2025-10-02T20:15:24.568392] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-02T20:15:25.019175] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-02T20:15:25.072979] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-06. [2025-10-02T20:15:25.370553] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-02T20:15:25.873002] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-04. [2025-10-02T20:15:26.672978] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-03. [2025-10-02T20:15:26.794637] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-02T20:15:27.473019] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-07. [2025-10-02T20:15:27.550436] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-02T20:15:27.605130] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-02T20:15:28.273029] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-04. [2025-10-02T20:15:29.072999] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-05. [2025-10-02T20:15:29.295039] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-02T20:15:29.358998] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-02T20:15:29.873026] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-05. [2025-10-02T20:15:30.165579] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-02T20:15:30.673018] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-06. [2025-10-02T20:15:31.473044] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-08. [2025-10-02T20:15:32.060237] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-02T20:15:32.122056] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-10-02T20:15:32.273004] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-05. [2025-10-02T20:15:33.072995] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-06. [2025-10-02T20:15:33.187518] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-02T20:15:33.478021] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-02T20:15:33.873013] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-07. [2025-10-02T20:15:34.600474] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-02T20:15:34.673028] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-07. [2025-10-02T20:15:35.472995] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-06. [2025-10-02T20:15:35.882758] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-02T20:15:36.273024] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-08. [2025-10-02T20:15:36.570594] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-02T20:15:36.642196] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-02T20:15:37.073022] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-07. [2025-10-02T20:15:37.796534] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-02T20:15:37.872984] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-09. [2025-10-02T20:15:38.090979] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-02T20:15:38.673013] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-08. [2025-10-02T20:15:39.316854] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-02T20:15:39.473018] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-10. [2025-10-02T20:15:40.272982] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-09. [2025-10-02T20:15:40.632258] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-02T20:15:41.016972] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-02T20:15:41.019072] [INFO ] [REMOTE ] MOH: Full fetch complete (58458 records). [2025-10-02T20:15:41.019202] [DEBUG] [VALIDATOR ] MOH: Validating primary data. [2025-10-02T20:15:41.082991] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-09. [2025-10-02T20:15:41.456569] [DEBUG] [VALIDATOR ] MOH: All expected trading days are present. [2025-10-02T20:15:41.456792] [DEBUG] [VALIDATOR ] MOH: Primary data validation passed. [2025-10-02T20:15:41.457837] [INFO ] [MAIN ] MOH: Fetched primary data is valid. [2025-10-02T20:15:41.457902] [DEBUG] [LOCAL ] MOH: Saving primary data. [2025-10-02T20:15:41.459359] [DEBUG] [LOCAL ] MOH: Trimmed 58458 records to 42055 (keeping 200 days of data) [2025-10-02T20:15:41.611949] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-02T20:15:41.794559] [DEBUG] [LOCAL ] MOH: Primary data saved (42055 records). [2025-10-02T20:15:41.794784] [INFO ] [MAIN ] MOH: Full history saved. [2025-10-02T20:15:41.794874] [INFO ] [MAIN ] Update Progress: 1386/2370 symbols completed. MOH took 31.7s. Estimated remaining: 2h 18m 53s. Rate: 7.1 symbols/min [2025-10-02T20:15:41.881678] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-10. [2025-10-02T20:15:41.986626] [INFO ] [MAIN ] MP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:15:41.986867] [DEBUG] [LOCAL ] MP: No existing data file found in primary storage. [2025-10-02T20:15:41.986984] [WARN ] [MAIN ] MP: No existing data found, performing full refresh instead. [2025-10-02T20:15:41.987076] [INFO ] [MAIN ] MP: Wiping existing primary data before full refresh. [2025-10-02T20:15:41.987119] [INFO ] [LOCAL ] MP: Starting deletion of primary data. [2025-10-02T20:15:41.987171] [DEBUG] [LOCAL ] MP: No primary data file found to delete. [2025-10-02T20:15:41.987207] [INFO ] [MAIN ] MP: Starting full primary refresh. [2025-10-02T20:15:42.373912] [INFO ] [REMOTE ] MP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:15:42.673016] [INFO ] [REMOTE ] MP: Fetching primary data for 2024-12. [2025-10-02T20:15:42.942335] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-02T20:15:43.286237] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-02T20:15:43.288457] [INFO ] [REMOTE ] MODG: Full fetch complete (74798 records). [2025-10-02T20:15:43.288593] [DEBUG] [VALIDATOR ] MODG: Validating primary data. [2025-10-02T20:15:43.476859] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-08. [2025-10-02T20:15:43.733018] [DEBUG] [VALIDATOR ] MODG: All expected trading days are present. [2025-10-02T20:15:43.733108] [DEBUG] [VALIDATOR ] MODG: Primary data validation passed. [2025-10-02T20:15:43.734160] [INFO ] [MAIN ] MODG: Fetched primary data is valid. [2025-10-02T20:15:43.734229] [DEBUG] [LOCAL ] MODG: Saving primary data. [2025-10-02T20:15:43.735925] [DEBUG] [LOCAL ] MODG: Trimmed 74798 records to 51905 (keeping 200 days of data) [2025-10-02T20:15:44.062379] [DEBUG] [LOCAL ] MODG: Primary data saved (51905 records). [2025-10-02T20:15:44.062519] [INFO ] [MAIN ] MODG: Full history saved. [2025-10-02T20:15:44.062607] [INFO ] [MAIN ] Update Progress: 1387/2370 symbols completed. MODG took 41.4s. Estimated remaining: 2h 18m 41s. Rate: 7.1 symbols/min [2025-10-02T20:15:44.251212] [INFO ] [MAIN ] MPA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:15:44.251440] [DEBUG] [LOCAL ] MPA: No existing data file found in primary storage. [2025-10-02T20:15:44.251497] [WARN ] [MAIN ] MPA: No existing data found, performing full refresh instead. [2025-10-02T20:15:44.251630] [INFO ] [MAIN ] MPA: Wiping existing primary data before full refresh. [2025-10-02T20:15:44.251715] [INFO ] [LOCAL ] MPA: Starting deletion of primary data. [2025-10-02T20:15:44.251769] [DEBUG] [LOCAL ] MPA: No primary data file found to delete. [2025-10-02T20:15:44.251804] [INFO ] [MAIN ] MPA: Starting full primary refresh. [2025-10-02T20:15:44.278792] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-10. [2025-10-02T20:15:44.681628] [INFO ] [REMOTE ] MPA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:15:44.706744] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-02T20:15:44.746781] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-02T20:15:45.072993] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-01. [2025-10-02T20:15:45.846912] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-02T20:15:45.849108] [INFO ] [REMOTE ] MOS: Full fetch complete (77451 records). [2025-10-02T20:15:45.849217] [DEBUG] [VALIDATOR ] MOS: Validating primary data. [2025-10-02T20:15:45.883851] [INFO ] [REMOTE ] MPA: Fetching primary data for 2024-12. [2025-10-02T20:15:46.285490] [DEBUG] [VALIDATOR ] MOS: All expected trading days are present. [2025-10-02T20:15:46.285582] [DEBUG] [VALIDATOR ] MOS: Primary data validation passed. [2025-10-02T20:15:46.286664] [INFO ] [MAIN ] MOS: Fetched primary data is valid. [2025-10-02T20:15:46.287479] [DEBUG] [LOCAL ] MOS: Saving primary data. [2025-10-02T20:15:46.289188] [DEBUG] [LOCAL ] MOS: Trimmed 77451 records to 53889 (keeping 200 days of data) [2025-10-02T20:15:46.396600] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-02T20:15:46.665745] [DEBUG] [LOCAL ] MOS: Primary data saved (53889 records). [2025-10-02T20:15:46.665988] [INFO ] [MAIN ] MOS: Full history saved. [2025-10-02T20:15:46.666140] [INFO ] [MAIN ] Update Progress: 1388/2370 symbols completed. MOS took 34.9s. Estimated remaining: 2h 18m 28s. Rate: 7.1 symbols/min [2025-10-02T20:15:46.681256] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-09. [2025-10-02T20:15:46.881697] [INFO ] [MAIN ] MPC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:15:46.882064] [DEBUG] [LOCAL ] MPC: No existing data file found in primary storage. [2025-10-02T20:15:46.882222] [WARN ] [MAIN ] MPC: No existing data found, performing full refresh instead. [2025-10-02T20:15:46.882765] [INFO ] [MAIN ] MPC: Wiping existing primary data before full refresh. [2025-10-02T20:15:46.882960] [INFO ] [LOCAL ] MPC: Starting deletion of primary data. [2025-10-02T20:15:46.883139] [DEBUG] [LOCAL ] MPC: No primary data file found to delete. [2025-10-02T20:15:46.883192] [INFO ] [MAIN ] MPC: Starting full primary refresh. [2025-10-02T20:15:47.270557] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-10-02T20:15:47.364357] [INFO ] [REMOTE ] MPC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:15:47.473010] [INFO ] [REMOTE ] MPC: Fetching primary data for 2024-12. [2025-10-02T20:15:47.956353] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-02T20:15:48.273022] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-02. [2025-10-02T20:15:49.073003] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-01. [2025-10-02T20:15:49.303232] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-02T20:15:49.543718] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-02T20:15:49.872982] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-01. [2025-10-02T20:15:50.181152] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-02T20:15:50.673032] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-03. [2025-10-02T20:15:51.333577] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-02T20:15:51.473030] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-02. [2025-10-02T20:15:52.236730] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-02T20:15:52.272996] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-03. [2025-10-02T20:15:52.379908] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-02T20:15:52.868261] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-02T20:15:53.073015] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-04. [2025-10-02T20:15:53.784898] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-02T20:15:53.873001] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-05. [2025-10-02T20:15:54.563471] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-02T20:15:54.673008] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-06. [2025-10-02T20:15:55.438554] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-02T20:15:55.472993] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-07. [2025-10-02T20:15:56.119334] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-02T20:15:56.273045] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-04. [2025-10-02T20:15:57.072928] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-10. [2025-10-02T20:15:57.873046] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-02. [2025-10-02T20:15:57.901736] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-02T20:15:57.902994] [INFO ] [REMOTE ] MOV: Full fetch complete (30642 records). [2025-10-02T20:15:57.903086] [DEBUG] [VALIDATOR ] MOV: Validating primary data. [2025-10-02T20:15:58.326540] [DEBUG] [VALIDATOR ] MOV: All expected trading days are present. [2025-10-02T20:15:58.326688] [DEBUG] [VALIDATOR ] MOV: Primary data validation passed. [2025-10-02T20:15:58.327529] [INFO ] [MAIN ] MOV: Fetched primary data is valid. [2025-10-02T20:15:58.327585] [DEBUG] [LOCAL ] MOV: Saving primary data. [2025-10-02T20:15:58.328515] [DEBUG] [LOCAL ] MOV: Trimmed 30642 records to 22121 (keeping 200 days of data) [2025-10-02T20:15:58.471380] [DEBUG] [LOCAL ] MOV: Primary data saved (22121 records). [2025-10-02T20:15:58.471696] [INFO ] [MAIN ] MOV: Full history saved. [2025-10-02T20:15:58.471886] [INFO ] [MAIN ] Update Progress: 1389/2370 symbols completed. MOV took 40.3s. Estimated remaining: 2h 18m 22s. Rate: 7.1 symbols/min [2025-10-02T20:15:58.626499] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-10-02T20:15:58.682684] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-08. [2025-10-02T20:15:58.721688] [INFO ] [MAIN ] MPLX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:15:58.722168] [DEBUG] [LOCAL ] MPLX: No existing data file found in primary storage. [2025-10-02T20:15:58.722223] [WARN ] [MAIN ] MPLX: No existing data found, performing full refresh instead. [2025-10-02T20:15:58.722395] [INFO ] [MAIN ] MPLX: Wiping existing primary data before full refresh. [2025-10-02T20:15:58.722453] [INFO ] [LOCAL ] MPLX: Starting deletion of primary data. [2025-10-02T20:15:58.722502] [DEBUG] [LOCAL ] MPLX: No primary data file found to delete. [2025-10-02T20:15:58.722538] [INFO ] [MAIN ] MPLX: Starting full primary refresh. [2025-10-02T20:15:59.128457] [INFO ] [REMOTE ] MPLX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:15:59.315490] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-02T20:15:59.472971] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-09. [2025-10-02T20:15:59.599703] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-02T20:16:00.083084] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-02T20:16:00.273027] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2024-12. [2025-10-02T20:16:01.073047] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-05. [2025-10-02T20:16:01.873017] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-10. [2025-10-02T20:16:02.096379] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-02T20:16:02.436931] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-02T20:16:02.438827] [INFO ] [REMOTE ] MPA: Full fetch complete (7187 records). [2025-10-02T20:16:02.438931] [DEBUG] [VALIDATOR ] MPA: Validating primary data. [2025-10-02T20:16:02.678323] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-01. [2025-10-02T20:16:02.833377] [DEBUG] [VALIDATOR ] MPA: All expected trading days are present. [2025-10-02T20:16:02.833458] [DEBUG] [VALIDATOR ] MPA: Primary data validation passed. [2025-10-02T20:16:02.833696] [INFO ] [MAIN ] MPA: Fetched primary data is valid. [2025-10-02T20:16:02.833784] [DEBUG] [LOCAL ] MPA: Saving primary data. [2025-10-02T20:16:02.834535] [DEBUG] [LOCAL ] MPA: Trimmed 7187 records to 5304 (keeping 200 days of data) [2025-10-02T20:16:02.868361] [DEBUG] [LOCAL ] MPA: Primary data saved (5304 records). [2025-10-02T20:16:02.868491] [INFO ] [MAIN ] MPA: Full history saved. [2025-10-02T20:16:02.868586] [INFO ] [MAIN ] Update Progress: 1390/2370 symbols completed. MPA took 18.8s. Estimated remaining: 2h 18m 11s. Rate: 7.1 symbols/min [2025-10-02T20:16:03.054939] [INFO ] [MAIN ] MPV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:16:03.055241] [DEBUG] [LOCAL ] MPV: No existing data file found in primary storage. [2025-10-02T20:16:03.055302] [WARN ] [MAIN ] MPV: No existing data found, performing full refresh instead. [2025-10-02T20:16:03.055416] [INFO ] [MAIN ] MPV: Wiping existing primary data before full refresh. [2025-10-02T20:16:03.055462] [INFO ] [LOCAL ] MPV: Starting deletion of primary data. [2025-10-02T20:16:03.055595] [DEBUG] [LOCAL ] MPV: No primary data file found to delete. [2025-10-02T20:16:03.055689] [INFO ] [MAIN ] MPV: Starting full primary refresh. [2025-10-02T20:16:03.451400] [INFO ] [REMOTE ] MPV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:16:03.481711] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-03. [2025-10-02T20:16:03.489947] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-05 (2.42 seconds). [2025-10-02T20:16:04.273087] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-06. [2025-10-02T20:16:04.572922] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-02T20:16:05.072998] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-02. [2025-10-02T20:16:05.159779] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-02T20:16:05.873014] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-04. [2025-10-02T20:16:06.673020] [INFO ] [REMOTE ] MPV: Fetching primary data for 2024-12. [2025-10-02T20:16:06.837340] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-06 (2.56 seconds). [2025-10-02T20:16:06.966750] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-02T20:16:07.136788] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-02T20:16:07.473036] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-01. [2025-10-02T20:16:07.596775] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-02T20:16:08.273033] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-03. [2025-10-02T20:16:08.296462] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-02T20:16:09.073049] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-07. [2025-10-02T20:16:09.873096] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-02. [2025-10-02T20:16:10.218078] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-02T20:16:10.637945] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-02T20:16:10.672979] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-03. [2025-10-02T20:16:11.473026] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-05. [2025-10-02T20:16:11.555800] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-02T20:16:11.996841] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-07 (2.92 seconds). [2025-10-02T20:16:12.273036] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-08. [2025-10-02T20:16:13.073005] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-04. [2025-10-02T20:16:13.400449] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-02T20:16:13.873008] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-06. [2025-10-02T20:16:14.672993] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-04. [2025-10-02T20:16:14.755857] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-02T20:16:15.136391] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-08 (2.86 seconds). [2025-10-02T20:16:15.378980] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-02T20:16:15.443309] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-02T20:16:15.472964] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-07. [2025-10-02T20:16:16.273049] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-05. [2025-10-02T20:16:17.017360] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-02T20:16:17.073020] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-06. [2025-10-02T20:16:17.306635] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-02T20:16:17.711888] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-02T20:16:17.872976] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-08. [2025-10-02T20:16:18.673099] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-09. [2025-10-02T20:16:19.473023] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-07. [2025-10-02T20:16:19.823393] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-02T20:16:20.206075] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-02T20:16:20.272967] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-08. [2025-10-02T20:16:20.829045] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-02T20:16:21.072999] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-05. [2025-10-02T20:16:21.132956] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-10-02T20:16:21.873075] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-09. [2025-10-02T20:16:22.565950] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-02T20:16:22.623525] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-02T20:16:22.673029] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-10. [2025-10-02T20:16:23.084135] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-02T20:16:23.084899] [INFO ] [REMOTE ] MPV: Full fetch complete (8017 records). [2025-10-02T20:16:23.084973] [DEBUG] [VALIDATOR ] MPV: Validating primary data. [2025-10-02T20:16:23.485283] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-09. [2025-10-02T20:16:23.494828] [DEBUG] [VALIDATOR ] MPV: All expected trading days are present. [2025-10-02T20:16:23.494891] [DEBUG] [VALIDATOR ] MPV: Primary data validation passed. [2025-10-02T20:16:23.495121] [INFO ] [MAIN ] MPV: Fetched primary data is valid. [2025-10-02T20:16:23.495165] [DEBUG] [LOCAL ] MPV: Saving primary data. [2025-10-02T20:16:23.495618] [DEBUG] [LOCAL ] MPV: Trimmed 8017 records to 4975 (keeping 200 days of data) [2025-10-02T20:16:23.531182] [DEBUG] [LOCAL ] MPV: Primary data saved (4975 records). [2025-10-02T20:16:23.531314] [INFO ] [MAIN ] MPV: Full history saved. [2025-10-02T20:16:23.531391] [INFO ] [MAIN ] Update Progress: 1391/2370 symbols completed. MPV took 20.7s. Estimated remaining: 2h 18m 11s. Rate: 7.1 symbols/min [2025-10-02T20:16:23.716603] [INFO ] [MAIN ] MPW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:16:23.716849] [DEBUG] [LOCAL ] MPW: No existing data file found in primary storage. [2025-10-02T20:16:23.716907] [WARN ] [MAIN ] MPW: No existing data found, performing full refresh instead. [2025-10-02T20:16:23.717032] [INFO ] [MAIN ] MPW: Wiping existing primary data before full refresh. [2025-10-02T20:16:23.717085] [INFO ] [LOCAL ] MPW: Starting deletion of primary data. [2025-10-02T20:16:23.717155] [DEBUG] [LOCAL ] MPW: No primary data file found to delete. [2025-10-02T20:16:23.717204] [INFO ] [MAIN ] MPW: Starting full primary refresh. [2025-10-02T20:16:24.122951] [INFO ] [REMOTE ] MPW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:16:24.273031] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-10. [2025-10-02T20:16:24.548897] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-10 (0.28 seconds). [2025-10-02T20:16:24.550605] [INFO ] [REMOTE ] MP: Full fetch complete (76945 records). [2025-10-02T20:16:24.550775] [DEBUG] [VALIDATOR ] MP: Validating primary data. [2025-10-02T20:16:24.551763] [FATAL] [VALIDATOR ] MP: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T20:16:24.551857] [FATAL] [MAIN ] MP: Fetched primary data is invalid. Refusing to save it. [2025-10-02T20:16:24.551951] [WARN ] [MAIN ] MP: Deleting existing primary and derivative data due to validation failure. [2025-10-02T20:16:24.552031] [INFO ] [LOCAL ] MP: Starting deletion of primary data. [2025-10-02T20:16:24.552110] [DEBUG] [LOCAL ] MP: No primary data file found to delete. [2025-10-02T20:16:24.552170] [INFO ] [LOCAL ] MP: Starting deletion of derivative data. [2025-10-02T20:16:24.552233] [DEBUG] [LOCAL ] MP: No derivative data file found to delete. [2025-10-02T20:16:24.552338] [INFO ] [MAIN ] Update Progress: 1392/2370 symbols completed. MP took 42.8s. Estimated remaining: 2h 17m 57s. Rate: 7.1 symbols/min [2025-10-02T20:16:24.832274] [INFO ] [MAIN ] MPX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:16:24.832469] [DEBUG] [LOCAL ] MPX: No existing data file found in primary storage. [2025-10-02T20:16:24.832526] [WARN ] [MAIN ] MPX: No existing data found, performing full refresh instead. [2025-10-02T20:16:24.832667] [INFO ] [MAIN ] MPX: Wiping existing primary data before full refresh. [2025-10-02T20:16:24.832760] [INFO ] [LOCAL ] MPX: Starting deletion of primary data. [2025-10-02T20:16:24.832826] [DEBUG] [LOCAL ] MPX: No primary data file found to delete. [2025-10-02T20:16:24.832862] [INFO ] [MAIN ] MPX: Starting full primary refresh. [2025-10-02T20:16:25.078175] [INFO ] [REMOTE ] MPW: Fetching primary data for 2024-12. [2025-10-02T20:16:25.262992] [INFO ] [REMOTE ] MPX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:16:25.873110] [INFO ] [REMOTE ] MPX: Fetching primary data for 2024-12. [2025-10-02T20:16:26.672986] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-06. [2025-10-02T20:16:26.755025] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-02T20:16:26.760359] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-09 (3.28 seconds). [2025-10-02T20:16:27.482812] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-10. [2025-10-02T20:16:27.489835] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2024-12 (2.41 seconds). [2025-10-02T20:16:28.272968] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-01. [2025-10-02T20:16:28.472617] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-02T20:16:28.811279] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-02T20:16:28.884242] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-02T20:16:28.886345] [INFO ] [REMOTE ] MPC: Full fetch complete (75843 records). [2025-10-02T20:16:28.886484] [DEBUG] [VALIDATOR ] MPC: Validating primary data. [2025-10-02T20:16:29.081789] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-07. [2025-10-02T20:16:29.337692] [DEBUG] [VALIDATOR ] MPC: All expected trading days are present. [2025-10-02T20:16:29.337787] [DEBUG] [VALIDATOR ] MPC: Primary data validation passed. [2025-10-02T20:16:29.339402] [INFO ] [MAIN ] MPC: Fetched primary data is valid. [2025-10-02T20:16:29.339476] [DEBUG] [LOCAL ] MPC: Saving primary data. [2025-10-02T20:16:29.341338] [DEBUG] [LOCAL ] MPC: Trimmed 75843 records to 52458 (keeping 200 days of data) [2025-10-02T20:16:29.705196] [DEBUG] [LOCAL ] MPC: Primary data saved (52458 records). [2025-10-02T20:16:29.705346] [INFO ] [MAIN ] MPC: Full history saved. [2025-10-02T20:16:29.705435] [INFO ] [MAIN ] Update Progress: 1393/2370 symbols completed. MPC took 43.0s. Estimated remaining: 2h 17m 46s. Rate: 7.1 symbols/min [2025-10-02T20:16:29.881311] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-02. [2025-10-02T20:16:29.901434] [INFO ] [MAIN ] MQT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:16:29.902586] [DEBUG] [LOCAL ] MQT: No existing data file found in primary storage. [2025-10-02T20:16:29.902633] [WARN ] [MAIN ] MQT: No existing data found, performing full refresh instead. [2025-10-02T20:16:29.902765] [INFO ] [MAIN ] MQT: Wiping existing primary data before full refresh. [2025-10-02T20:16:29.902809] [INFO ] [LOCAL ] MQT: Starting deletion of primary data. [2025-10-02T20:16:29.902854] [DEBUG] [LOCAL ] MQT: No primary data file found to delete. [2025-10-02T20:16:29.902890] [INFO ] [MAIN ] MQT: Starting full primary refresh. [2025-10-02T20:16:30.320194] [INFO ] [REMOTE ] MQT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:16:30.673011] [INFO ] [REMOTE ] MQT: Fetching primary data for 2024-12. [2025-10-02T20:16:30.698316] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-02T20:16:31.126449] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-02T20:16:31.472974] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-08. [2025-10-02T20:16:31.559094] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-02T20:16:32.273022] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-01. [2025-10-02T20:16:33.073004] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-03. [2025-10-02T20:16:33.472887] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-02T20:16:33.872971] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-09. [2025-10-02T20:16:34.041051] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-02T20:16:34.077609] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-02T20:16:34.673055] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-02. [2025-10-02T20:16:35.382217] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-02T20:16:35.473016] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-10. [2025-10-02T20:16:36.273012] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-04. [2025-10-02T20:16:36.677547] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-02T20:16:36.917309] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-02T20:16:36.919733] [INFO ] [REMOTE ] MPLX: Full fetch complete (74052 records). [2025-10-02T20:16:36.919852] [DEBUG] [VALIDATOR ] MPLX: Validating primary data. [2025-10-02T20:16:37.050259] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-02T20:16:37.078122] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-03. [2025-10-02T20:16:37.398000] [DEBUG] [VALIDATOR ] MPLX: All expected trading days are present. [2025-10-02T20:16:37.398096] [DEBUG] [VALIDATOR ] MPLX: Primary data validation passed. [2025-10-02T20:16:37.399350] [INFO ] [MAIN ] MPLX: Fetched primary data is valid. [2025-10-02T20:16:37.399428] [DEBUG] [LOCAL ] MPLX: Saving primary data. [2025-10-02T20:16:37.401149] [DEBUG] [LOCAL ] MPLX: Trimmed 74052 records to 51112 (keeping 200 days of data) [2025-10-02T20:16:37.736941] [DEBUG] [LOCAL ] MPLX: Primary data saved (51112 records). [2025-10-02T20:16:37.737082] [INFO ] [MAIN ] MPLX: Full history saved. [2025-10-02T20:16:37.737177] [INFO ] [MAIN ] Update Progress: 1394/2370 symbols completed. MPLX took 39.3s. Estimated remaining: 2h 17m 37s. Rate: 7.1 symbols/min [2025-10-02T20:16:37.878142] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-05. [2025-10-02T20:16:37.929132] [INFO ] [MAIN ] MQY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:16:37.929351] [DEBUG] [LOCAL ] MQY: No existing data file found in primary storage. [2025-10-02T20:16:37.929423] [WARN ] [MAIN ] MQY: No existing data found, performing full refresh instead. [2025-10-02T20:16:37.929587] [INFO ] [MAIN ] MQY: Wiping existing primary data before full refresh. [2025-10-02T20:16:37.929630] [INFO ] [LOCAL ] MQY: Starting deletion of primary data. [2025-10-02T20:16:37.929747] [DEBUG] [LOCAL ] MQY: No primary data file found to delete. [2025-10-02T20:16:37.929801] [INFO ] [MAIN ] MQY: Starting full primary refresh. [2025-10-02T20:16:38.329584] [INFO ] [REMOTE ] MQY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:16:38.628264] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-02T20:16:38.672986] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-06. [2025-10-02T20:16:39.196817] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-02T20:16:39.305536] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-02T20:16:39.473009] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-04. [2025-10-02T20:16:40.273022] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-07. [2025-10-02T20:16:41.024306] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-02T20:16:41.073023] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-01. [2025-10-02T20:16:41.704140] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-02T20:16:41.872998] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-05. [2025-10-02T20:16:41.974149] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-02T20:16:42.673000] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-02. [2025-10-02T20:16:43.472987] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-08. [2025-10-02T20:16:43.523597] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-02T20:16:43.907015] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-02T20:16:44.203276] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-02T20:16:44.273089] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-09. [2025-10-02T20:16:44.769693] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-02T20:16:45.073014] [INFO ] [REMOTE ] MQY: Fetching primary data for 2024-12. [2025-10-02T20:16:45.872998] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-10. [2025-10-02T20:16:46.357531] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-02T20:16:46.358496] [INFO ] [REMOTE ] MPX: Full fetch complete (6690 records). [2025-10-02T20:16:46.358627] [DEBUG] [VALIDATOR ] MPX: Validating primary data. [2025-10-02T20:16:46.536869] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-02T20:16:46.678118] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-03. [2025-10-02T20:16:46.788026] [DEBUG] [VALIDATOR ] MPX: All expected trading days are present. [2025-10-02T20:16:46.788112] [DEBUG] [VALIDATOR ] MPX: Primary data validation passed. [2025-10-02T20:16:46.788381] [INFO ] [MAIN ] MPX: Fetched primary data is valid. [2025-10-02T20:16:46.788444] [DEBUG] [LOCAL ] MPX: Saving primary data. [2025-10-02T20:16:46.788924] [DEBUG] [LOCAL ] MPX: Trimmed 6690 records to 4077 (keeping 200 days of data) [2025-10-02T20:16:46.817268] [DEBUG] [LOCAL ] MPX: Primary data saved (4077 records). [2025-10-02T20:16:46.817367] [INFO ] [MAIN ] MPX: Full history saved. [2025-10-02T20:16:46.817442] [INFO ] [MAIN ] Update Progress: 1395/2370 symbols completed. MPX took 22.3s. Estimated remaining: 2h 17m 29s. Rate: 7.1 symbols/min [2025-10-02T20:16:46.997300] [INFO ] [MAIN ] MRC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:16:46.997465] [DEBUG] [LOCAL ] MRC: No existing data file found in primary storage. [2025-10-02T20:16:46.997504] [WARN ] [MAIN ] MRC: No existing data found, performing full refresh instead. [2025-10-02T20:16:46.997615] [INFO ] [MAIN ] MRC: Wiping existing primary data before full refresh. [2025-10-02T20:16:46.997688] [INFO ] [LOCAL ] MRC: Starting deletion of primary data. [2025-10-02T20:16:46.997748] [DEBUG] [LOCAL ] MRC: No primary data file found to delete. [2025-10-02T20:16:46.997784] [INFO ] [MAIN ] MRC: Starting full primary refresh. [2025-10-02T20:16:47.399019] [INFO ] [REMOTE ] MRC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:16:47.472982] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-01. [2025-10-02T20:16:47.588125] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-02T20:16:48.273022] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-04. [2025-10-02T20:16:48.876807] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-02T20:16:49.072985] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-02. [2025-10-02T20:16:49.352136] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-02T20:16:49.873000] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-06. [2025-10-02T20:16:50.159710] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-02T20:16:50.672991] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-05. [2025-10-02T20:16:51.463622] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-02T20:16:51.472952] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-06. [2025-10-02T20:16:51.765474] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-02T20:16:52.273027] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-07. [2025-10-02T20:16:52.370258] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-02T20:16:53.072999] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-07. [2025-10-02T20:16:53.872972] [INFO ] [REMOTE ] MRC: Fetching primary data for 2024-12. [2025-10-02T20:16:54.018555] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-02T20:16:54.396132] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-02T20:16:54.673006] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-03. [2025-10-02T20:16:54.948073] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-02T20:16:55.473047] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-08. [2025-10-02T20:16:55.826167] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-02T20:16:56.273071] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-04. [2025-10-02T20:16:57.073012] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-01. [2025-10-02T20:16:57.444005] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-02T20:16:57.507747] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-02T20:16:57.873011] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-05. [2025-10-02T20:16:58.195559] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-02T20:16:58.673008] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-02. [2025-10-02T20:16:58.865147] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-02T20:16:59.473011] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-08. [2025-10-02T20:16:59.921078] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-02T20:17:00.274232] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-06. [2025-10-02T20:17:00.275249] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-02T20:17:01.072984] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-09. [2025-10-02T20:17:01.394176] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-02T20:17:01.872999] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-07. [2025-10-02T20:17:02.646152] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-02T20:17:02.673006] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-09. [2025-10-02T20:17:03.178568] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-02T20:17:03.473000] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-03. [2025-10-02T20:17:03.622064] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-02T20:17:04.273081] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-10. [2025-10-02T20:17:04.910989] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-02T20:17:04.912290] [INFO ] [REMOTE ] MQT: Full fetch complete (13378 records). [2025-10-02T20:17:04.912394] [DEBUG] [VALIDATOR ] MQT: Validating primary data. [2025-10-02T20:17:05.075589] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-10. [2025-10-02T20:17:05.415806] [DEBUG] [VALIDATOR ] MQT: All expected trading days are present. [2025-10-02T20:17:05.416129] [DEBUG] [VALIDATOR ] MQT: Primary data validation passed. [2025-10-02T20:17:05.417377] [INFO ] [MAIN ] MQT: Fetched primary data is valid. [2025-10-02T20:17:05.418691] [DEBUG] [LOCAL ] MQT: Saving primary data. [2025-10-02T20:17:05.418583] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-02T20:17:05.429028] [DEBUG] [LOCAL ] MQT: Trimmed 13378 records to 8739 (keeping 200 days of data) [2025-10-02T20:17:05.486904] [DEBUG] [LOCAL ] MQT: Primary data saved (8739 records). [2025-10-02T20:17:05.487087] [INFO ] [MAIN ] MQT: Full history saved. [2025-10-02T20:17:05.487184] [INFO ] [MAIN ] Update Progress: 1396/2370 symbols completed. MQT took 35.8s. Estimated remaining: 2h 17m 28s. Rate: 7.1 symbols/min [2025-10-02T20:17:05.676240] [INFO ] [MAIN ] MRK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:17:05.676408] [DEBUG] [LOCAL ] MRK: No existing data file found in primary storage. [2025-10-02T20:17:05.676495] [WARN ] [MAIN ] MRK: No existing data found, performing full refresh instead. [2025-10-02T20:17:05.676581] [INFO ] [MAIN ] MRK: Wiping existing primary data before full refresh. [2025-10-02T20:17:05.676621] [INFO ] [LOCAL ] MRK: Starting deletion of primary data. [2025-10-02T20:17:05.676703] [DEBUG] [LOCAL ] MRK: No primary data file found to delete. [2025-10-02T20:17:05.676751] [INFO ] [MAIN ] MRK: Starting full primary refresh. [2025-10-02T20:17:05.878124] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-08. [2025-10-02T20:17:06.066258] [INFO ] [REMOTE ] MRK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:17:06.673075] [INFO ] [REMOTE ] MRK: Fetching primary data for 2024-12. [2025-10-02T20:17:06.702391] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-02T20:17:06.704750] [INFO ] [REMOTE ] MPW: Full fetch complete (77517 records). [2025-10-02T20:17:06.704876] [DEBUG] [VALIDATOR ] MPW: Validating primary data. [2025-10-02T20:17:07.101059] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-02T20:17:07.171096] [DEBUG] [VALIDATOR ] MPW: All expected trading days are present. [2025-10-02T20:17:07.171184] [DEBUG] [VALIDATOR ] MPW: Primary data validation passed. [2025-10-02T20:17:07.172416] [INFO ] [MAIN ] MPW: Fetched primary data is valid. [2025-10-02T20:17:07.172487] [DEBUG] [LOCAL ] MPW: Saving primary data. [2025-10-02T20:17:07.174196] [DEBUG] [LOCAL ] MPW: Trimmed 77517 records to 53885 (keeping 200 days of data) [2025-10-02T20:17:07.473477] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-09. [2025-10-02T20:17:07.521386] [DEBUG] [LOCAL ] MPW: Primary data saved (53885 records). [2025-10-02T20:17:07.521517] [INFO ] [MAIN ] MPW: Full history saved. [2025-10-02T20:17:07.521594] [INFO ] [MAIN ] Update Progress: 1397/2370 symbols completed. MPW took 44.0s. Estimated remaining: 2h 17m 15s. Rate: 7.1 symbols/min [2025-10-02T20:17:08.273067] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-04. [2025-10-02T20:17:08.857533] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-02T20:17:09.073034] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-10. [2025-10-02T20:17:09.652145] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-02T20:17:09.873003] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-05. [2025-10-02T20:17:09.909751] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-02T20:17:09.910957] [INFO ] [REMOTE ] MQY: Full fetch complete (27076 records). [2025-10-02T20:17:09.911034] [DEBUG] [VALIDATOR ] MQY: Validating primary data. [2025-10-02T20:17:10.338940] [DEBUG] [VALIDATOR ] MQY: All expected trading days are present. [2025-10-02T20:17:10.339028] [DEBUG] [VALIDATOR ] MQY: Primary data validation passed. [2025-10-02T20:17:10.339740] [INFO ] [MAIN ] MQY: Fetched primary data is valid. [2025-10-02T20:17:10.339807] [DEBUG] [LOCAL ] MQY: Saving primary data. [2025-10-02T20:17:10.340596] [DEBUG] [LOCAL ] MQY: Trimmed 27076 records to 17140 (keeping 200 days of data) [2025-10-02T20:17:10.456112] [DEBUG] [LOCAL ] MQY: Primary data saved (17140 records). [2025-10-02T20:17:10.456262] [INFO ] [MAIN ] MQY: Full history saved. [2025-10-02T20:17:10.456341] [INFO ] [MAIN ] Update Progress: 1398/2370 symbols completed. MQY took 32.7s. Estimated remaining: 2h 17m 3s. Rate: 7.1 symbols/min [2025-10-02T20:17:11.303470] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-02T20:17:11.311845] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-06. [2025-10-02T20:17:11.976263] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2024-12 (5.30 seconds). [2025-10-02T20:17:11.988039] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-01. [2025-10-02T20:17:12.765713] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-02T20:17:12.774062] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-07. [2025-10-02T20:17:14.006012] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-02T20:17:14.018005] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-02. [2025-10-02T20:17:14.541527] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-02T20:17:14.552834] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-08. [2025-10-02T20:17:15.771194] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-02T20:17:15.780441] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-09. [2025-10-02T20:17:16.344907] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-10-02T20:17:16.356095] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-03. [2025-10-02T20:17:17.175811] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-02T20:17:17.183983] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-10. [2025-10-02T20:17:18.180681] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-02T20:17:18.182873] [INFO ] [REMOTE ] MRC: Full fetch complete (54798 records). [2025-10-02T20:17:18.182977] [DEBUG] [VALIDATOR ] MRC: Validating primary data. [2025-10-02T20:17:18.611004] [DEBUG] [VALIDATOR ] MRC: All expected trading days are present. [2025-10-02T20:17:18.611158] [DEBUG] [VALIDATOR ] MRC: Primary data validation passed. [2025-10-02T20:17:18.612184] [INFO ] [MAIN ] MRC: Fetched primary data is valid. [2025-10-02T20:17:18.612371] [DEBUG] [LOCAL ] MRC: Saving primary data. [2025-10-02T20:17:18.613796] [DEBUG] [LOCAL ] MRC: Trimmed 54798 records to 37651 (keeping 200 days of data) [2025-10-02T20:17:18.861275] [DEBUG] [LOCAL ] MRC: Primary data saved (37651 records). [2025-10-02T20:17:18.861520] [INFO ] [MAIN ] MRC: Full history saved. [2025-10-02T20:17:18.861627] [INFO ] [MAIN ] Update Progress: 1399/2370 symbols completed. MRC took 32.0s. Estimated remaining: 2h 16m 54s. Rate: 7.1 symbols/min [2025-10-02T20:17:18.895548] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-03 (2.54 seconds). [2025-10-02T20:17:18.908132] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-04. [2025-10-02T20:17:21.403596] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-10-02T20:17:21.415846] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-05. [2025-10-02T20:17:23.603784] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-02T20:17:23.616515] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-06. [2025-10-02T20:17:25.983988] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-10-02T20:17:25.995491] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-07. [2025-10-02T20:17:28.593427] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-10-02T20:17:28.606839] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-08. [2025-10-02T20:17:31.081956] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-08 (2.48 seconds). [2025-10-02T20:17:31.094302] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-09. [2025-10-02T20:17:33.686575] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-09 (2.59 seconds). [2025-10-02T20:17:33.699171] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-10. [2025-10-02T20:17:34.115636] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-02T20:17:34.117383] [INFO ] [REMOTE ] MRK: Full fetch complete (77467 records). [2025-10-02T20:17:34.117509] [DEBUG] [VALIDATOR ] MRK: Validating primary data. [2025-10-02T20:17:34.118696] [FATAL] [VALIDATOR ] MRK: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T20:17:34.118830] [FATAL] [MAIN ] MRK: Fetched primary data is invalid. Refusing to save it. [2025-10-02T20:17:34.118910] [WARN ] [MAIN ] MRK: Deleting existing primary and derivative data due to validation failure. [2025-10-02T20:17:34.119019] [INFO ] [LOCAL ] MRK: Starting deletion of primary data. [2025-10-02T20:17:34.119121] [DEBUG] [LOCAL ] MRK: No primary data file found to delete. [2025-10-02T20:17:34.119184] [INFO ] [LOCAL ] MRK: Starting deletion of derivative data. [2025-10-02T20:17:34.119276] [DEBUG] [LOCAL ] MRK: No derivative data file found to delete. [2025-10-02T20:17:34.119393] [INFO ] [MAIN ] Update Progress: 1400/2370 symbols completed. MRK took 28.6s. Estimated remaining: 2h 16m 51s. Rate: 7.1 symbols/min [2025-10-02T20:17:34.882125] [INFO ] [MAIN ] MRP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:17:34.925791] [DEBUG] [LOCAL ] MRP: No existing data file found in primary storage. [2025-10-02T20:17:34.955732] [INFO ] [MAIN ] MS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:17:34.957014] [WARN ] [MAIN ] MRP: No existing data found, performing full refresh instead. [2025-10-02T20:17:34.956846] [INFO ] [MAIN ] MSB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:17:34.948963] [INFO ] [MAIN ] MSA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:17:34.957459] [DEBUG] [LOCAL ] MS: No existing data file found in primary storage. [2025-10-02T20:17:34.957674] [DEBUG] [LOCAL ] MSA: No existing data file found in primary storage. [2025-10-02T20:17:34.957964] [WARN ] [MAIN ] MS: No existing data found, performing full refresh instead. [2025-10-02T20:17:34.957889] [INFO ] [MAIN ] MRP: Wiping existing primary data before full refresh. [2025-10-02T20:17:34.958163] [WARN ] [MAIN ] MSA: No existing data found, performing full refresh instead. [2025-10-02T20:17:34.958511] [INFO ] [MAIN ] MSA: Wiping existing primary data before full refresh. [2025-10-02T20:17:34.958386] [INFO ] [MAIN ] MS: Wiping existing primary data before full refresh. [2025-10-02T20:17:34.958875] [INFO ] [LOCAL ] MSA: Starting deletion of primary data. [2025-10-02T20:17:34.958828] [INFO ] [LOCAL ] MS: Starting deletion of primary data. [2025-10-02T20:17:34.958726] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-10-02T20:17:34.959073] [DEBUG] [LOCAL ] MS: No primary data file found to delete. [2025-10-02T20:17:34.959406] [DEBUG] [LOCAL ] MRP: No primary data file found to delete. [2025-10-02T20:17:34.959636] [INFO ] [MAIN ] MS: Starting full primary refresh. [2025-10-02T20:17:34.957827] [DEBUG] [LOCAL ] MSB: No existing data file found in primary storage. [2025-10-02T20:17:34.959266] [DEBUG] [LOCAL ] MSA: No primary data file found to delete. [2025-10-02T20:17:34.965188] [WARN ] [MAIN ] MSB: No existing data found, performing full refresh instead. [2025-10-02T20:17:34.959574] [INFO ] [MAIN ] MRP: Starting full primary refresh. [2025-10-02T20:17:34.979880] [INFO ] [MAIN ] MSB: Wiping existing primary data before full refresh. [2025-10-02T20:17:34.974358] [INFO ] [MAIN ] MSA: Starting full primary refresh. [2025-10-02T20:17:35.109120] [INFO ] [LOCAL ] MSB: Starting deletion of primary data. [2025-10-02T20:17:35.167221] [DEBUG] [LOCAL ] MSB: No primary data file found to delete. [2025-10-02T20:17:35.198316] [INFO ] [MAIN ] MSB: Starting full primary refresh. [2025-10-02T20:17:36.443502] [INFO ] [REMOTE ] MSA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:17:36.485571] [INFO ] [REMOTE ] MSA: Fetching primary data for 2024-12. [2025-10-02T20:17:36.620544] [INFO ] [REMOTE ] MS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:17:36.599677] [INFO ] [REMOTE ] MRP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:17:36.621924] [INFO ] [REMOTE ] MS: Fetching primary data for 2024-12. [2025-10-02T20:17:36.623072] [INFO ] [REMOTE ] MRP: Fetching primary data for 2024-12. [2025-10-02T20:17:36.630131] [INFO ] [REMOTE ] MSB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:17:36.630862] [INFO ] [REMOTE ] MSB: Fetching primary data for 2024-12. [2025-10-02T20:17:36.934526] [DEBUG] [REMOTE ] MRP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T20:17:36.934880] [WARN ] [REMOTE ] MRP: No data returned for month 2024-12 [2025-10-02T20:17:36.934970] [FATAL] [REMOTE ] MRP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T20:17:36.935021] [FATAL] [MAIN ] MRP: Failed to fetch primary data. [2025-10-02T20:17:36.935057] [WARN ] [MAIN ] MRP: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T20:17:36.935121] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-10-02T20:17:36.935182] [DEBUG] [LOCAL ] MRP: No primary data file found to delete. [2025-10-02T20:17:36.935218] [INFO ] [LOCAL ] MRP: Starting deletion of derivative data. [2025-10-02T20:17:36.935280] [DEBUG] [LOCAL ] MRP: No derivative data file found to delete. [2025-10-02T20:17:36.935351] [INFO ] [MAIN ] Update Progress: 1401/2370 symbols completed. MRP took 2.8s. Estimated remaining: 2h 16m 38s. Rate: 7.1 symbols/min [2025-10-02T20:17:37.126380] [INFO ] [MAIN ] MSC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:17:37.126560] [DEBUG] [LOCAL ] MSC: No existing data file found in primary storage. [2025-10-02T20:17:37.126597] [WARN ] [MAIN ] MSC: No existing data found, performing full refresh instead. [2025-10-02T20:17:37.126744] [INFO ] [MAIN ] MSC: Wiping existing primary data before full refresh. [2025-10-02T20:17:37.126788] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-10-02T20:17:37.126831] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-10-02T20:17:37.126867] [INFO ] [MAIN ] MSC: Starting full primary refresh. [2025-10-02T20:17:37.491049] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-02T20:17:37.535619] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-01. [2025-10-02T20:17:37.583246] [INFO ] [REMOTE ] MSC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:17:37.583750] [INFO ] [REMOTE ] MSC: Fetching primary data for 2024-12. [2025-10-02T20:17:37.596519] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-02T20:17:37.600534] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-01. [2025-10-02T20:17:38.051803] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-02T20:17:38.052971] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-01. [2025-10-02T20:17:38.327180] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-02T20:17:38.338349] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-01. [2025-10-02T20:17:38.656132] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-02T20:17:38.659636] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-02. [2025-10-02T20:17:38.693872] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-02T20:17:38.695949] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-02. [2025-10-02T20:17:38.711327] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-02T20:17:38.715278] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-02. [2025-10-02T20:17:39.447088] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-02T20:17:39.448756] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-03. [2025-10-02T20:17:39.611431] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-02T20:17:39.615492] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-03. [2025-10-02T20:17:39.818072] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-02T20:17:39.821351] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-03. [2025-10-02T20:17:39.850949] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-02T20:17:39.852070] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-04. [2025-10-02T20:17:40.205815] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-02T20:17:40.216872] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-02. [2025-10-02T20:17:40.313116] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-02T20:17:40.314158] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-05. [2025-10-02T20:17:40.431525] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-02T20:17:40.436197] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-04. [2025-10-02T20:17:40.557530] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-02T20:17:40.564062] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-04. [2025-10-02T20:17:40.761334] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-02T20:17:40.762561] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-06. [2025-10-02T20:17:41.163940] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-02T20:17:41.165038] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-07. [2025-10-02T20:17:41.275286] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-02T20:17:41.277817] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-05. [2025-10-02T20:17:41.675498] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-02T20:17:41.676760] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-08. [2025-10-02T20:17:41.736584] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-02T20:17:41.872972] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-05. [2025-10-02T20:17:41.905164] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-02T20:17:42.079739] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-02T20:17:42.169170] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-02T20:17:42.672999] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-03. [2025-10-02T20:17:42.782858] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-02T20:17:43.473008] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-06. [2025-10-02T20:17:44.273025] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-06. [2025-10-02T20:17:44.609414] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-02T20:17:44.909138] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-10-02T20:17:44.927317] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-02T20:17:45.073003] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-04. [2025-10-02T20:17:45.873003] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-07. [2025-10-02T20:17:46.673001] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-07. [2025-10-02T20:17:47.046836] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-02T20:17:47.448037] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-10-02T20:17:47.472989] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-05. [2025-10-02T20:17:47.540475] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-02T20:17:48.273068] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-08. [2025-10-02T20:17:49.073025] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-09. [2025-10-02T20:17:49.277058] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-02T20:17:49.704674] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-02T20:17:49.706961] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-02T20:17:49.873103] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-10. [2025-10-02T20:17:50.273318] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-02T20:17:50.274130] [INFO ] [REMOTE ] MSC: Full fetch complete (2531 records). [2025-10-02T20:17:50.274202] [DEBUG] [VALIDATOR ] MSC: Validating primary data. [2025-10-02T20:17:50.477727] [WARN ] [VALIDATOR ] MSC: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-10-02T20:17:50.477915] [FATAL] [MAIN ] MSC: Fetched primary data is invalid. Refusing to save it. [2025-10-02T20:17:50.477985] [WARN ] [MAIN ] MSC: Deleting existing primary and derivative data due to validation failure. [2025-10-02T20:17:50.478072] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-10-02T20:17:50.478174] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-10-02T20:17:50.478258] [INFO ] [LOCAL ] MSC: Starting deletion of derivative data. [2025-10-02T20:17:50.478321] [DEBUG] [LOCAL ] MSC: No derivative data file found to delete. [2025-10-02T20:17:50.478384] [INFO ] [MAIN ] Update Progress: 1402/2370 symbols completed. MSC took 13.5s. Estimated remaining: 2h 16m 33s. Rate: 7.1 symbols/min [2025-10-02T20:17:50.664849] [INFO ] [MAIN ] MSCI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:17:50.665017] [DEBUG] [LOCAL ] MSCI: No existing data file found in primary storage. [2025-10-02T20:17:50.665069] [WARN ] [MAIN ] MSCI: No existing data found, performing full refresh instead. [2025-10-02T20:17:50.665182] [INFO ] [MAIN ] MSCI: Wiping existing primary data before full refresh. [2025-10-02T20:17:50.665226] [INFO ] [LOCAL ] MSCI: Starting deletion of primary data. [2025-10-02T20:17:50.665291] [DEBUG] [LOCAL ] MSCI: No primary data file found to delete. [2025-10-02T20:17:50.665343] [INFO ] [MAIN ] MSCI: Starting full primary refresh. [2025-10-02T20:17:50.678078] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-06. [2025-10-02T20:17:51.058086] [INFO ] [REMOTE ] MSCI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:17:51.472994] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-08. [2025-10-02T20:17:52.273049] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2024-12. [2025-10-02T20:17:52.623514] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-02T20:17:52.829911] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-02T20:17:53.072995] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-07. [2025-10-02T20:17:53.731160] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-02T20:17:53.873001] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-09. [2025-10-02T20:17:54.630761] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-02T20:17:54.673032] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-10. [2025-10-02T20:17:55.144125] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-02T20:17:55.261841] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-02T20:17:55.262727] [INFO ] [REMOTE ] MSB: Full fetch complete (13025 records). [2025-10-02T20:17:55.262809] [DEBUG] [VALIDATOR ] MSB: Validating primary data. [2025-10-02T20:17:55.478184] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-08. [2025-10-02T20:17:55.664903] [DEBUG] [VALIDATOR ] MSB: All expected trading days are present. [2025-10-02T20:17:55.664990] [DEBUG] [VALIDATOR ] MSB: Primary data validation passed. [2025-10-02T20:17:55.665323] [INFO ] [MAIN ] MSB: Fetched primary data is valid. [2025-10-02T20:17:55.665366] [DEBUG] [LOCAL ] MSB: Saving primary data. [2025-10-02T20:17:55.665973] [DEBUG] [LOCAL ] MSB: Trimmed 13025 records to 7883 (keeping 200 days of data) [2025-10-02T20:17:55.717268] [DEBUG] [LOCAL ] MSB: Primary data saved (7883 records). [2025-10-02T20:17:55.717420] [INFO ] [MAIN ] MSB: Full history saved. [2025-10-02T20:17:55.717500] [INFO ] [MAIN ] Update Progress: 1403/2370 symbols completed. MSB took 21.6s. Estimated remaining: 2h 16m 23s. Rate: 7.1 symbols/min [2025-10-02T20:17:55.918756] [INFO ] [MAIN ] MSD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:17:55.919056] [DEBUG] [LOCAL ] MSD: No existing data file found in primary storage. [2025-10-02T20:17:55.919114] [WARN ] [MAIN ] MSD: No existing data found, performing full refresh instead. [2025-10-02T20:17:55.919231] [INFO ] [MAIN ] MSD: Wiping existing primary data before full refresh. [2025-10-02T20:17:55.919275] [INFO ] [LOCAL ] MSD: Starting deletion of primary data. [2025-10-02T20:17:55.919320] [DEBUG] [LOCAL ] MSD: No primary data file found to delete. [2025-10-02T20:17:55.919355] [INFO ] [MAIN ] MSD: Starting full primary refresh. [2025-10-02T20:17:56.278112] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-01. [2025-10-02T20:17:56.316944] [INFO ] [REMOTE ] MSD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:17:57.073062] [INFO ] [REMOTE ] MSD: Fetching primary data for 2024-12. [2025-10-02T20:17:57.605058] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-02T20:17:57.694386] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-02T20:17:57.873021] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-09. [2025-10-02T20:17:57.998432] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-02T20:17:58.673003] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-02. [2025-10-02T20:17:58.888233] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-02T20:17:59.472990] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-01. [2025-10-02T20:18:00.272982] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-09. [2025-10-02T20:18:00.356317] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-02T20:18:00.486038] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-02T20:18:01.073014] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-03. [2025-10-02T20:18:01.873054] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-10. [2025-10-02T20:18:02.430199] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-02T20:18:02.477678] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-02T20:18:02.673057] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-10. [2025-10-02T20:18:03.055832] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-02T20:18:03.057133] [INFO ] [REMOTE ] MSA: Full fetch complete (25885 records). [2025-10-02T20:18:03.057235] [DEBUG] [VALIDATOR ] MSA: Validating primary data. [2025-10-02T20:18:03.452927] [DEBUG] [VALIDATOR ] MSA: All expected trading days are present. [2025-10-02T20:18:03.453018] [DEBUG] [VALIDATOR ] MSA: Primary data validation passed. [2025-10-02T20:18:03.453629] [INFO ] [MAIN ] MSA: Fetched primary data is valid. [2025-10-02T20:18:03.453714] [DEBUG] [LOCAL ] MSA: Saving primary data. [2025-10-02T20:18:03.454600] [DEBUG] [LOCAL ] MSA: Trimmed 25885 records to 19007 (keeping 200 days of data) [2025-10-02T20:18:03.510202] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-04. [2025-10-02T20:18:03.588412] [DEBUG] [LOCAL ] MSA: Primary data saved (19007 records). [2025-10-02T20:18:03.588577] [INFO ] [MAIN ] MSA: Full history saved. [2025-10-02T20:18:03.588686] [INFO ] [MAIN ] Update Progress: 1404/2370 symbols completed. MSA took 29.5s. Estimated remaining: 2h 16m 14s. Rate: 7.1 symbols/min [2025-10-02T20:18:03.787734] [INFO ] [MAIN ] MSDL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:18:03.787907] [DEBUG] [LOCAL ] MSDL: No existing data file found in primary storage. [2025-10-02T20:18:03.787947] [WARN ] [MAIN ] MSDL: No existing data found, performing full refresh instead. [2025-10-02T20:18:03.788064] [INFO ] [MAIN ] MSDL: Wiping existing primary data before full refresh. [2025-10-02T20:18:03.788107] [INFO ] [LOCAL ] MSDL: Starting deletion of primary data. [2025-10-02T20:18:03.788149] [DEBUG] [LOCAL ] MSDL: No primary data file found to delete. [2025-10-02T20:18:03.788183] [INFO ] [MAIN ] MSDL: Starting full primary refresh. [2025-10-02T20:18:04.175130] [INFO ] [REMOTE ] MSDL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:18:04.181238] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-02T20:18:04.183734] [INFO ] [REMOTE ] MS: Full fetch complete (77719 records). [2025-10-02T20:18:04.183873] [DEBUG] [VALIDATOR ] MS: Validating primary data. [2025-10-02T20:18:04.278202] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2024-12. [2025-10-02T20:18:04.640385] [DEBUG] [VALIDATOR ] MS: All expected trading days are present. [2025-10-02T20:18:04.640534] [DEBUG] [VALIDATOR ] MS: Primary data validation passed. [2025-10-02T20:18:04.641964] [INFO ] [MAIN ] MS: Fetched primary data is valid. [2025-10-02T20:18:04.642037] [DEBUG] [LOCAL ] MS: Saving primary data. [2025-10-02T20:18:04.643765] [DEBUG] [LOCAL ] MS: Trimmed 77719 records to 54081 (keeping 200 days of data) [2025-10-02T20:18:05.023472] [DEBUG] [LOCAL ] MS: Primary data saved (54081 records). [2025-10-02T20:18:05.023636] [INFO ] [MAIN ] MS: Full history saved. [2025-10-02T20:18:05.023761] [INFO ] [MAIN ] Update Progress: 1405/2370 symbols completed. MS took 30.9s. Estimated remaining: 2h 16m 0s. Rate: 7.1 symbols/min [2025-10-02T20:18:05.074635] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-02. [2025-10-02T20:18:05.228637] [INFO ] [MAIN ] MSGE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:18:05.229114] [DEBUG] [LOCAL ] MSGE: No existing data file found in primary storage. [2025-10-02T20:18:05.229238] [WARN ] [MAIN ] MSGE: No existing data found, performing full refresh instead. [2025-10-02T20:18:05.229444] [INFO ] [MAIN ] MSGE: Wiping existing primary data before full refresh. [2025-10-02T20:18:05.229516] [INFO ] [LOCAL ] MSGE: Starting deletion of primary data. [2025-10-02T20:18:05.229632] [DEBUG] [LOCAL ] MSGE: No primary data file found to delete. [2025-10-02T20:18:05.229733] [INFO ] [MAIN ] MSGE: Starting full primary refresh. [2025-10-02T20:18:05.587847] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-02T20:18:05.690027] [INFO ] [REMOTE ] MSGE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:18:05.759065] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-02T20:18:05.872982] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-05. [2025-10-02T20:18:06.172589] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-02T20:18:06.673037] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2024-12. [2025-10-02T20:18:07.070298] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-02T20:18:07.473070] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-06. [2025-10-02T20:18:08.204762] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-02T20:18:08.273061] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-01. [2025-10-02T20:18:08.693202] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-02T20:18:09.073023] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-07. [2025-10-02T20:18:09.570021] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-02T20:18:09.872995] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-01. [2025-10-02T20:18:10.672987] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-03. [2025-10-02T20:18:10.874322] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-02T20:18:10.967910] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-02T20:18:11.412247] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-02T20:18:11.473046] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-02. [2025-10-02T20:18:12.272993] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-02. [2025-10-02T20:18:12.987314] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-02T20:18:13.072997] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-03. [2025-10-02T20:18:13.374873] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-02T20:18:13.873001] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-03. [2025-10-02T20:18:14.672993] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-08. [2025-10-02T20:18:14.809371] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-02T20:18:15.320394] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-02T20:18:15.473018] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-04. [2025-10-02T20:18:16.011129] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-02T20:18:16.272979] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-04. [2025-10-02T20:18:16.426797] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-02T20:18:17.073040] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-04. [2025-10-02T20:18:17.741156] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-02T20:18:17.873014] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-05. [2025-10-02T20:18:18.673035] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-05. [2025-10-02T20:18:18.804949] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-02T20:18:19.126165] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-02T20:18:19.473007] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-06. [2025-10-02T20:18:19.939051] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-02T20:18:20.272997] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-06. [2025-10-02T20:18:20.415672] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-02T20:18:21.073011] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-05. [2025-10-02T20:18:21.696098] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-02T20:18:21.873016] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-07. [2025-10-02T20:18:22.610008] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-02T20:18:22.672997] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-09. [2025-10-02T20:18:22.747849] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-02T20:18:23.473006] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-06. [2025-10-02T20:18:24.119186] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-02T20:18:24.273000] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-10. [2025-10-02T20:18:25.040130] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-02T20:18:25.072963] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-07. [2025-10-02T20:18:25.518668] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-02T20:18:25.520296] [INFO ] [REMOTE ] MSCI: Full fetch complete (50506 records). [2025-10-02T20:18:25.520386] [DEBUG] [VALIDATOR ] MSCI: Validating primary data. [2025-10-02T20:18:25.878176] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-08. [2025-10-02T20:18:25.949105] [DEBUG] [VALIDATOR ] MSCI: All expected trading days are present. [2025-10-02T20:18:25.949208] [DEBUG] [VALIDATOR ] MSCI: Primary data validation passed. [2025-10-02T20:18:25.950084] [INFO ] [MAIN ] MSCI: Fetched primary data is valid. [2025-10-02T20:18:25.950150] [DEBUG] [LOCAL ] MSCI: Saving primary data. [2025-10-02T20:18:25.951762] [DEBUG] [LOCAL ] MSCI: Trimmed 50506 records to 34810 (keeping 200 days of data) [2025-10-02T20:18:26.191451] [DEBUG] [LOCAL ] MSCI: Primary data saved (34810 records). [2025-10-02T20:18:26.191608] [INFO ] [MAIN ] MSCI: Full history saved. [2025-10-02T20:18:26.191723] [INFO ] [MAIN ] Update Progress: 1406/2370 symbols completed. MSCI took 35.7s. Estimated remaining: 2h 16m 1s. Rate: 7.1 symbols/min [2025-10-02T20:18:26.380048] [INFO ] [MAIN ] MSGS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:18:26.380217] [DEBUG] [LOCAL ] MSGS: No existing data file found in primary storage. [2025-10-02T20:18:26.380255] [WARN ] [MAIN ] MSGS: No existing data found, performing full refresh instead. [2025-10-02T20:18:26.380374] [INFO ] [MAIN ] MSGS: Wiping existing primary data before full refresh. [2025-10-02T20:18:26.380423] [INFO ] [LOCAL ] MSGS: Starting deletion of primary data. [2025-10-02T20:18:26.380468] [DEBUG] [LOCAL ] MSGS: No primary data file found to delete. [2025-10-02T20:18:26.380501] [INFO ] [MAIN ] MSGS: Starting full primary refresh. [2025-10-02T20:18:26.684117] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-07. [2025-10-02T20:18:26.836003] [INFO ] [REMOTE ] MSGS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:18:26.867604] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-02T20:18:27.172428] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-02T20:18:27.472975] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-09. [2025-10-02T20:18:27.833338] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-02T20:18:28.273069] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-08. [2025-10-02T20:18:28.838089] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-02T20:18:29.073040] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2024-12. [2025-10-02T20:18:29.422195] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-02T20:18:29.746980] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-02T20:18:29.873008] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-08. [2025-10-02T20:18:30.672999] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-01. [2025-10-02T20:18:31.473004] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-10. [2025-10-02T20:18:31.609785] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-02T20:18:31.628233] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-02T20:18:32.273025] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-09. [2025-10-02T20:18:32.405983] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-02T20:18:32.407758] [INFO ] [REMOTE ] MSGE: Full fetch complete (40204 records). [2025-10-02T20:18:32.407865] [DEBUG] [VALIDATOR ] MSGE: Validating primary data. [2025-10-02T20:18:32.852985] [DEBUG] [VALIDATOR ] MSGE: All expected trading days are present. [2025-10-02T20:18:32.853083] [DEBUG] [VALIDATOR ] MSGE: Primary data validation passed. [2025-10-02T20:18:32.854018] [INFO ] [MAIN ] MSGE: Fetched primary data is valid. [2025-10-02T20:18:32.854121] [DEBUG] [LOCAL ] MSGE: Saving primary data. [2025-10-02T20:18:32.855310] [DEBUG] [LOCAL ] MSGE: Trimmed 40204 records to 27150 (keeping 200 days of data) [2025-10-02T20:18:33.054908] [DEBUG] [LOCAL ] MSGE: Primary data saved (27150 records). [2025-10-02T20:18:33.055146] [INFO ] [MAIN ] MSGE: Full history saved. [2025-10-02T20:18:33.055260] [INFO ] [MAIN ] Update Progress: 1407/2370 symbols completed. MSGE took 28.0s. Estimated remaining: 2h 15m 51s. Rate: 7.1 symbols/min [2025-10-02T20:18:33.082853] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-02. [2025-10-02T20:18:33.274062] [INFO ] [MAIN ] MSI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:18:33.274283] [DEBUG] [LOCAL ] MSI: No existing data file found in primary storage. [2025-10-02T20:18:33.274339] [WARN ] [MAIN ] MSI: No existing data found, performing full refresh instead. [2025-10-02T20:18:33.274467] [INFO ] [MAIN ] MSI: Wiping existing primary data before full refresh. [2025-10-02T20:18:33.274519] [INFO ] [LOCAL ] MSI: Starting deletion of primary data. [2025-10-02T20:18:33.274589] [DEBUG] [LOCAL ] MSI: No primary data file found to delete. [2025-10-02T20:18:33.274639] [INFO ] [MAIN ] MSI: Starting full primary refresh. [2025-10-02T20:18:33.686785] [INFO ] [REMOTE ] MSI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:18:33.872997] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-09. [2025-10-02T20:18:33.966347] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-02T20:18:34.260372] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-02T20:18:34.673041] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-10. [2025-10-02T20:18:34.726613] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-02T20:18:35.473024] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-10. [2025-10-02T20:18:35.902031] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-02T20:18:35.904006] [INFO ] [REMOTE ] MSDL: Full fetch complete (54983 records). [2025-10-02T20:18:35.904168] [DEBUG] [VALIDATOR ] MSDL: Validating primary data. [2025-10-02T20:18:36.227463] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-02T20:18:36.242675] [INFO ] [REMOTE ] MSD: Full fetch complete (22477 records). [2025-10-02T20:18:36.253399] [DEBUG] [VALIDATOR ] MSD: Validating primary data. [2025-10-02T20:18:36.274486] [INFO ] [REMOTE ] MSI: Fetching primary data for 2024-12. [2025-10-02T20:18:36.474092] [DEBUG] [VALIDATOR ] MSDL: All expected trading days are present. [2025-10-02T20:18:36.477940] [DEBUG] [VALIDATOR ] MSDL: Primary data validation passed. [2025-10-02T20:18:36.484957] [INFO ] [MAIN ] MSDL: Fetched primary data is valid. [2025-10-02T20:18:36.505714] [DEBUG] [LOCAL ] MSDL: Saving primary data. [2025-10-02T20:18:36.664615] [DEBUG] [LOCAL ] MSDL: Trimmed 54983 records to 38548 (keeping 200 days of data) [2025-10-02T20:18:36.896940] [DEBUG] [VALIDATOR ] MSD: All expected trading days are present. [2025-10-02T20:18:36.897495] [DEBUG] [VALIDATOR ] MSD: Primary data validation passed. [2025-10-02T20:18:36.898393] [INFO ] [MAIN ] MSD: Fetched primary data is valid. [2025-10-02T20:18:36.898475] [DEBUG] [LOCAL ] MSD: Saving primary data. [2025-10-02T20:18:36.901781] [DEBUG] [LOCAL ] MSD: Trimmed 22477 records to 15944 (keeping 200 days of data) [2025-10-02T20:18:37.076930] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-03. [2025-10-02T20:18:37.128084] [DEBUG] [LOCAL ] MSD: Primary data saved (15944 records). [2025-10-02T20:18:37.129312] [INFO ] [MAIN ] MSD: Full history saved. [2025-10-02T20:18:37.130109] [INFO ] [MAIN ] Update Progress: 1408/2370 symbols completed. MSD took 41.4s. Estimated remaining: 2h 15m 40s. Rate: 7.1 symbols/min [2025-10-02T20:18:37.332128] [INFO ] [MAIN ] MSIF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:18:37.333173] [DEBUG] [LOCAL ] MSIF: No existing data file found in primary storage. [2025-10-02T20:18:37.333269] [WARN ] [MAIN ] MSIF: No existing data found, performing full refresh instead. [2025-10-02T20:18:37.334486] [INFO ] [MAIN ] MSIF: Wiping existing primary data before full refresh. [2025-10-02T20:18:37.335272] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-10-02T20:18:37.335989] [DEBUG] [LOCAL ] MSIF: No primary data file found to delete. [2025-10-02T20:18:37.336952] [INFO ] [MAIN ] MSIF: Starting full primary refresh. [2025-10-02T20:18:37.806239] [DEBUG] [LOCAL ] MSDL: Primary data saved (38548 records). [2025-10-02T20:18:37.806987] [INFO ] [MAIN ] MSDL: Full history saved. [2025-10-02T20:18:37.807116] [INFO ] [MAIN ] Update Progress: 1409/2370 symbols completed. MSDL took 34.2s. Estimated remaining: 2h 15m 26s. Rate: 7.1 symbols/min [2025-10-02T20:18:37.811057] [INFO ] [REMOTE ] MSIF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:18:37.886884] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2024-12. [2025-10-02T20:18:38.053885] [INFO ] [MAIN ] MSM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:18:38.054579] [DEBUG] [LOCAL ] MSM: No existing data file found in primary storage. [2025-10-02T20:18:38.060451] [WARN ] [MAIN ] MSM: No existing data found, performing full refresh instead. [2025-10-02T20:18:38.068616] [INFO ] [MAIN ] MSM: Wiping existing primary data before full refresh. [2025-10-02T20:18:38.068792] [INFO ] [LOCAL ] MSM: Starting deletion of primary data. [2025-10-02T20:18:38.069976] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-02T20:18:38.070163] [DEBUG] [LOCAL ] MSM: No primary data file found to delete. [2025-10-02T20:18:38.074949] [INFO ] [MAIN ] MSM: Starting full primary refresh. [2025-10-02T20:18:38.242317] [DEBUG] [REMOTE ] MSIF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T20:18:38.236307] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-02T20:18:38.266929] [WARN ] [REMOTE ] MSIF: No data returned for month 2024-12 [2025-10-02T20:18:38.283877] [FATAL] [REMOTE ] MSIF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T20:18:38.305574] [FATAL] [MAIN ] MSIF: Failed to fetch primary data. [2025-10-02T20:18:38.307368] [WARN ] [MAIN ] MSIF: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T20:18:38.340409] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-10-02T20:18:38.413019] [DEBUG] [LOCAL ] MSIF: No primary data file found to delete. [2025-10-02T20:18:38.447613] [INFO ] [LOCAL ] MSIF: Starting deletion of derivative data. [2025-10-02T20:18:38.451412] [DEBUG] [LOCAL ] MSIF: No derivative data file found to delete. [2025-10-02T20:18:38.456990] [INFO ] [MAIN ] Update Progress: 1410/2370 symbols completed. MSIF took 1.3s. Estimated remaining: 2h 15m 12s. Rate: 7.1 symbols/min [2025-10-02T20:18:38.660467] [INFO ] [REMOTE ] MSM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:18:38.678080] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-04. [2025-10-02T20:18:38.739280] [INFO ] [MAIN ] MT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:18:38.739493] [DEBUG] [LOCAL ] MT: No existing data file found in primary storage. [2025-10-02T20:18:38.739539] [WARN ] [MAIN ] MT: No existing data found, performing full refresh instead. [2025-10-02T20:18:38.739714] [INFO ] [MAIN ] MT: Wiping existing primary data before full refresh. [2025-10-02T20:18:38.739769] [INFO ] [LOCAL ] MT: Starting deletion of primary data. [2025-10-02T20:18:38.739814] [DEBUG] [LOCAL ] MT: No primary data file found to delete. [2025-10-02T20:18:38.739877] [INFO ] [MAIN ] MT: Starting full primary refresh. [2025-10-02T20:18:39.131271] [INFO ] [REMOTE ] MT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:18:39.473006] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-01. [2025-10-02T20:18:39.579235] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-02T20:18:40.273150] [INFO ] [REMOTE ] MT: Fetching primary data for 2024-12. [2025-10-02T20:18:41.073006] [INFO ] [REMOTE ] MSM: Fetching primary data for 2024-12. [2025-10-02T20:18:41.270198] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-02T20:18:41.873015] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-02. [2025-10-02T20:18:42.017357] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-02T20:18:42.663990] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-02T20:18:42.672956] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-01. [2025-10-02T20:18:43.473009] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-05. [2025-10-02T20:18:43.599926] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-02T20:18:44.015988] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-02T20:18:44.273225] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-01. [2025-10-02T20:18:44.276800] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-02T20:18:45.073005] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-02. [2025-10-02T20:18:45.846254] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-02T20:18:45.873005] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-02. [2025-10-02T20:18:46.492093] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-02T20:18:46.673054] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-03. [2025-10-02T20:18:47.473042] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-03. [2025-10-02T20:18:47.952093] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-02T20:18:48.272971] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-03. [2025-10-02T20:18:48.444761] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-02T20:18:48.863106] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-02T20:18:49.072995] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-04. [2025-10-02T20:18:49.873036] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-04. [2025-10-02T20:18:50.326177] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-02T20:18:50.673018] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-06. [2025-10-02T20:18:50.717393] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-02T20:18:51.479885] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-04. [2025-10-02T20:18:51.500011] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-02T20:18:51.524218] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-02T20:18:52.273045] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-05. [2025-10-02T20:18:53.072992] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-05. [2025-10-02T20:18:53.430974] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-02T20:18:53.703771] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-02T20:18:53.872979] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-06. [2025-10-02T20:18:54.603248] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-02T20:18:54.672991] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-06. [2025-10-02T20:18:55.022728] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-02T20:18:55.473037] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-05. [2025-10-02T20:18:55.985771] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-02T20:18:56.273025] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-07. [2025-10-02T20:18:57.079197] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-07. [2025-10-02T20:18:57.085181] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-02T20:18:57.873056] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-06. [2025-10-02T20:18:57.968483] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-02T20:18:58.015726] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-02T20:18:58.673106] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-08. [2025-10-02T20:18:59.473025] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-07. [2025-10-02T20:18:59.579747] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-02T20:18:59.653758] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-02T20:19:00.273043] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-09. [2025-10-02T20:19:01.073021] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-08. [2025-10-02T20:19:01.322152] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-02T20:19:01.379400] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-02T20:19:01.873007] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-08. [2025-10-02T20:19:02.418825] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-02T20:19:02.672998] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-09. [2025-10-02T20:19:02.944234] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-02T20:19:03.473013] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-07. [2025-10-02T20:19:04.273010] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-09. [2025-10-02T20:19:04.334634] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-02T20:19:05.072977] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-10. [2025-10-02T20:19:05.133567] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-02T20:19:05.860512] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-02T20:19:05.872955] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-10. [2025-10-02T20:19:05.913095] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-02T20:19:05.914357] [INFO ] [REMOTE ] MSGS: Full fetch complete (23086 records). [2025-10-02T20:19:05.914452] [DEBUG] [VALIDATOR ] MSGS: Validating primary data. [2025-10-02T20:19:06.331169] [DEBUG] [VALIDATOR ] MSGS: All expected trading days are present. [2025-10-02T20:19:06.331254] [DEBUG] [VALIDATOR ] MSGS: Primary data validation passed. [2025-10-02T20:19:06.331801] [INFO ] [MAIN ] MSGS: Fetched primary data is valid. [2025-10-02T20:19:06.331866] [DEBUG] [LOCAL ] MSGS: Saving primary data. [2025-10-02T20:19:06.332568] [DEBUG] [LOCAL ] MSGS: Trimmed 23086 records to 17372 (keeping 200 days of data) [2025-10-02T20:19:06.453479] [DEBUG] [LOCAL ] MSGS: Primary data saved (17372 records). [2025-10-02T20:19:06.453637] [INFO ] [MAIN ] MSGS: Full history saved. [2025-10-02T20:19:06.453756] [INFO ] [MAIN ] Update Progress: 1411/2370 symbols completed. MSGS took 40.3s. Estimated remaining: 2h 15m 17s. Rate: 7.1 symbols/min [2025-10-02T20:19:06.640126] [INFO ] [MAIN ] MTAL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:19:06.640334] [DEBUG] [LOCAL ] MTAL: No existing data file found in primary storage. [2025-10-02T20:19:06.640393] [WARN ] [MAIN ] MTAL: No existing data found, performing full refresh instead. [2025-10-02T20:19:06.640531] [INFO ] [MAIN ] MTAL: Wiping existing primary data before full refresh. [2025-10-02T20:19:06.640591] [INFO ] [LOCAL ] MTAL: Starting deletion of primary data. [2025-10-02T20:19:06.640682] [DEBUG] [LOCAL ] MTAL: No primary data file found to delete. [2025-10-02T20:19:06.640743] [INFO ] [MAIN ] MTAL: Starting full primary refresh. [2025-10-02T20:19:06.678170] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-10. [2025-10-02T20:19:07.052062] [INFO ] [REMOTE ] MTAL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:19:07.134213] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-02T20:19:07.136095] [INFO ] [REMOTE ] MSM: Full fetch complete (52068 records). [2025-10-02T20:19:07.136247] [DEBUG] [VALIDATOR ] MSM: Validating primary data. [2025-10-02T20:19:07.478123] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2024-12. [2025-10-02T20:19:07.575918] [DEBUG] [VALIDATOR ] MSM: All expected trading days are present. [2025-10-02T20:19:07.576021] [DEBUG] [VALIDATOR ] MSM: Primary data validation passed. [2025-10-02T20:19:07.576998] [INFO ] [MAIN ] MSM: Fetched primary data is valid. [2025-10-02T20:19:07.577067] [DEBUG] [LOCAL ] MSM: Saving primary data. [2025-10-02T20:19:07.578449] [DEBUG] [LOCAL ] MSM: Trimmed 52068 records to 35699 (keeping 200 days of data) [2025-10-02T20:19:07.818690] [DEBUG] [LOCAL ] MSM: Primary data saved (35699 records). [2025-10-02T20:19:07.818894] [INFO ] [MAIN ] MSM: Full history saved. [2025-10-02T20:19:07.819015] [INFO ] [MAIN ] Update Progress: 1412/2370 symbols completed. MSM took 30.0s. Estimated remaining: 2h 15m 4s. Rate: 7.1 symbols/min [2025-10-02T20:19:08.015956] [INFO ] [MAIN ] MTB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:19:08.016689] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-02T20:19:08.018252] [DEBUG] [LOCAL ] MTB: No existing data file found in primary storage. [2025-10-02T20:19:08.018330] [WARN ] [MAIN ] MTB: No existing data found, performing full refresh instead. [2025-10-02T20:19:08.018474] [INFO ] [MAIN ] MTB: Wiping existing primary data before full refresh. [2025-10-02T20:19:08.018597] [INFO ] [REMOTE ] MSI: Full fetch complete (58301 records). [2025-10-02T20:19:08.018670] [INFO ] [LOCAL ] MTB: Starting deletion of primary data. [2025-10-02T20:19:08.018798] [DEBUG] [VALIDATOR ] MSI: Validating primary data. [2025-10-02T20:19:08.019151] [DEBUG] [LOCAL ] MTB: No primary data file found to delete. [2025-10-02T20:19:08.019280] [INFO ] [MAIN ] MTB: Starting full primary refresh. [2025-10-02T20:19:08.287161] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-08. [2025-10-02T20:19:08.830782] [INFO ] [REMOTE ] MTB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:19:08.884479] [DEBUG] [VALIDATOR ] MSI: All expected trading days are present. [2025-10-02T20:19:08.884723] [DEBUG] [VALIDATOR ] MSI: Primary data validation passed. [2025-10-02T20:19:08.885869] [INFO ] [MAIN ] MSI: Fetched primary data is valid. [2025-10-02T20:19:08.886022] [DEBUG] [LOCAL ] MSI: Saving primary data. [2025-10-02T20:19:08.899784] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-02T20:19:08.904359] [DEBUG] [LOCAL ] MSI: Trimmed 58301 records to 40527 (keeping 200 days of data) [2025-10-02T20:19:09.102407] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-01. [2025-10-02T20:19:09.187726] [DEBUG] [LOCAL ] MSI: Primary data saved (40527 records). [2025-10-02T20:19:09.187860] [INFO ] [MAIN ] MSI: Full history saved. [2025-10-02T20:19:09.187943] [INFO ] [MAIN ] Update Progress: 1413/2370 symbols completed. MSI took 36.1s. Estimated remaining: 2h 14m 50s. Rate: 7.1 symbols/min [2025-10-02T20:19:09.378031] [INFO ] [MAIN ] MTD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:19:09.378246] [DEBUG] [LOCAL ] MTD: No existing data file found in primary storage. [2025-10-02T20:19:09.378304] [WARN ] [MAIN ] MTD: No existing data found, performing full refresh instead. [2025-10-02T20:19:09.378422] [INFO ] [MAIN ] MTD: Wiping existing primary data before full refresh. [2025-10-02T20:19:09.378466] [INFO ] [LOCAL ] MTD: Starting deletion of primary data. [2025-10-02T20:19:09.378510] [DEBUG] [LOCAL ] MTD: No primary data file found to delete. [2025-10-02T20:19:09.378547] [INFO ] [MAIN ] MTD: Starting full primary refresh. [2025-10-02T20:19:09.791998] [INFO ] [REMOTE ] MTD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:19:09.873026] [INFO ] [REMOTE ] MTD: Fetching primary data for 2024-12. [2025-10-02T20:19:10.235224] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-02T20:19:10.367295] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-02T20:19:10.673060] [INFO ] [REMOTE ] MTB: Fetching primary data for 2024-12. [2025-10-02T20:19:10.862905] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-02T20:19:11.473032] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-09. [2025-10-02T20:19:12.272975] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-01. [2025-10-02T20:19:12.570819] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-02T20:19:12.920606] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-02T20:19:13.072997] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-02. [2025-10-02T20:19:13.873015] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-10. [2025-10-02T20:19:14.125274] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-02T20:19:14.517941] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-02T20:19:14.673032] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-02. [2025-10-02T20:19:15.232497] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-02T20:19:15.236171] [INFO ] [REMOTE ] MT: Full fetch complete (73513 records). [2025-10-02T20:19:15.236394] [DEBUG] [VALIDATOR ] MT: Validating primary data. [2025-10-02T20:19:15.479351] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-03. [2025-10-02T20:19:15.705237] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-02T20:19:15.705610] [DEBUG] [VALIDATOR ] MT: All expected trading days are present. [2025-10-02T20:19:15.709688] [DEBUG] [VALIDATOR ] MT: Primary data validation passed. [2025-10-02T20:19:15.711301] [INFO ] [MAIN ] MT: Fetched primary data is valid. [2025-10-02T20:19:15.711397] [DEBUG] [LOCAL ] MT: Saving primary data. [2025-10-02T20:19:15.713370] [DEBUG] [LOCAL ] MT: Trimmed 73513 records to 50965 (keeping 200 days of data) [2025-10-02T20:19:16.046432] [DEBUG] [LOCAL ] MT: Primary data saved (50965 records). [2025-10-02T20:19:16.046577] [INFO ] [MAIN ] MT: Full history saved. [2025-10-02T20:19:16.046684] [INFO ] [MAIN ] Update Progress: 1414/2370 symbols completed. MT took 37.6s. Estimated remaining: 2h 14m 41s. Rate: 7.1 symbols/min [2025-10-02T20:19:16.235810] [INFO ] [MAIN ] MTDR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:19:16.236040] [DEBUG] [LOCAL ] MTDR: No existing data file found in primary storage. [2025-10-02T20:19:16.236097] [WARN ] [MAIN ] MTDR: No existing data found, performing full refresh instead. [2025-10-02T20:19:16.236209] [INFO ] [MAIN ] MTDR: Wiping existing primary data before full refresh. [2025-10-02T20:19:16.236256] [INFO ] [LOCAL ] MTDR: Starting deletion of primary data. [2025-10-02T20:19:16.236302] [DEBUG] [LOCAL ] MTDR: No primary data file found to delete. [2025-10-02T20:19:16.236334] [INFO ] [MAIN ] MTDR: Starting full primary refresh. [2025-10-02T20:19:16.280161] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-01. [2025-10-02T20:19:16.680276] [INFO ] [REMOTE ] MTDR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:19:16.905830] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-02T20:19:17.073009] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2024-12. [2025-10-02T20:19:17.872963] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-04. [2025-10-02T20:19:17.977820] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-02T20:19:18.673013] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-02. [2025-10-02T20:19:18.992774] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-02T20:19:19.092756] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-02T20:19:19.473037] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-01. [2025-10-02T20:19:20.272980] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-05. [2025-10-02T20:19:20.455118] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-02T20:19:21.073003] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-03. [2025-10-02T20:19:21.174116] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-02T20:19:21.873021] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-03. [2025-10-02T20:19:21.921319] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-02T20:19:21.942879] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-02T20:19:22.673000] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-04. [2025-10-02T20:19:23.473030] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-02. [2025-10-02T20:19:24.101893] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-02T20:19:24.143575] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-02T20:19:24.273007] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-05. [2025-10-02T20:19:25.072984] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-04. [2025-10-02T20:19:25.137869] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-02T20:19:25.308745] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-02T20:19:25.873043] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-06. [2025-10-02T20:19:26.672995] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-03. [2025-10-02T20:19:27.071424] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-02T20:19:27.274431] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-02T20:19:27.473009] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-05. [2025-10-02T20:19:28.277588] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-07. [2025-10-02T20:19:28.285183] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-02T20:19:29.072986] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-04. [2025-10-02T20:19:29.214385] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-02T20:19:29.872987] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-06. [2025-10-02T20:19:29.971900] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-02T20:19:30.648518] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-02T20:19:30.672963] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-05. [2025-10-02T20:19:31.473043] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-08. [2025-10-02T20:19:31.781617] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-02T20:19:32.272978] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-07. [2025-10-02T20:19:32.435202] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-02T20:19:32.718927] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-02T20:19:33.073002] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-09. [2025-10-02T20:19:33.873001] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-06. [2025-10-02T20:19:34.192454] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-02T20:19:34.266870] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-02T20:19:34.668407] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-02T20:19:34.672946] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-07. [2025-10-02T20:19:35.438433] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-02T20:19:35.473019] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-06. [2025-10-02T20:19:36.272997] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-08. [2025-10-02T20:19:37.073007] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-08. [2025-10-02T20:19:37.347373] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-02T20:19:37.663711] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-02T20:19:37.872977] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-10. [2025-10-02T20:19:38.247620] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-02T20:19:38.673004] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-09. [2025-10-02T20:19:38.802685] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-02T20:19:38.804515] [INFO ] [REMOTE ] MTAL: Full fetch complete (47676 records). [2025-10-02T20:19:38.804613] [DEBUG] [VALIDATOR ] MTAL: Validating primary data. [2025-10-02T20:19:39.245894] [DEBUG] [VALIDATOR ] MTAL: All expected trading days are present. [2025-10-02T20:19:39.246002] [DEBUG] [VALIDATOR ] MTAL: Primary data validation passed. [2025-10-02T20:19:39.246968] [INFO ] [MAIN ] MTAL: Fetched primary data is valid. [2025-10-02T20:19:39.247039] [DEBUG] [LOCAL ] MTAL: Saving primary data. [2025-10-02T20:19:39.248305] [DEBUG] [LOCAL ] MTAL: Trimmed 47676 records to 36775 (keeping 200 days of data) [2025-10-02T20:19:39.473187] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-07. [2025-10-02T20:19:39.486502] [DEBUG] [LOCAL ] MTAL: Primary data saved (36775 records). [2025-10-02T20:19:39.486709] [INFO ] [MAIN ] MTAL: Full history saved. [2025-10-02T20:19:39.486810] [INFO ] [MAIN ] Update Progress: 1415/2370 symbols completed. MTAL took 33.0s. Estimated remaining: 2h 14m 43s. Rate: 7.1 symbols/min [2025-10-02T20:19:39.681554] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-02T20:19:39.685348] [INFO ] [MAIN ] MTG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:19:39.688706] [DEBUG] [LOCAL ] MTG: No existing data file found in primary storage. [2025-10-02T20:19:39.689115] [WARN ] [MAIN ] MTG: No existing data found, performing full refresh instead. [2025-10-02T20:19:39.689242] [INFO ] [MAIN ] MTG: Wiping existing primary data before full refresh. [2025-10-02T20:19:39.689289] [INFO ] [LOCAL ] MTG: Starting deletion of primary data. [2025-10-02T20:19:39.689334] [DEBUG] [LOCAL ] MTG: No primary data file found to delete. [2025-10-02T20:19:39.689370] [INFO ] [MAIN ] MTG: Starting full primary refresh. [2025-10-02T20:19:40.086492] [INFO ] [REMOTE ] MTG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:19:40.272996] [INFO ] [REMOTE ] MTG: Fetching primary data for 2024-12. [2025-10-02T20:19:41.072973] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-10. [2025-10-02T20:19:41.557183] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-02T20:19:41.630037] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-02T20:19:41.728691] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-02T20:19:41.729994] [INFO ] [REMOTE ] MTD: Full fetch complete (21050 records). [2025-10-02T20:19:41.730085] [DEBUG] [VALIDATOR ] MTD: Validating primary data. [2025-10-02T20:19:41.879756] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-08. [2025-10-02T20:19:42.146367] [DEBUG] [VALIDATOR ] MTD: All expected trading days are present. [2025-10-02T20:19:42.146777] [DEBUG] [VALIDATOR ] MTD: Primary data validation passed. [2025-10-02T20:19:42.147301] [INFO ] [MAIN ] MTD: Fetched primary data is valid. [2025-10-02T20:19:42.147348] [DEBUG] [LOCAL ] MTD: Saving primary data. [2025-10-02T20:19:42.148027] [DEBUG] [LOCAL ] MTD: Trimmed 21050 records to 15267 (keeping 200 days of data) [2025-10-02T20:19:42.257678] [DEBUG] [LOCAL ] MTD: Primary data saved (15267 records). [2025-10-02T20:19:42.257866] [INFO ] [MAIN ] MTD: Full history saved. [2025-10-02T20:19:42.257971] [INFO ] [MAIN ] Update Progress: 1416/2370 symbols completed. MTD took 33.1s. Estimated remaining: 2h 14m 30s. Rate: 7.1 symbols/min [2025-10-02T20:19:42.447485] [INFO ] [MAIN ] MTH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:19:42.447725] [DEBUG] [LOCAL ] MTH: No existing data file found in primary storage. [2025-10-02T20:19:42.447777] [WARN ] [MAIN ] MTH: No existing data found, performing full refresh instead. [2025-10-02T20:19:42.447914] [INFO ] [MAIN ] MTH: Wiping existing primary data before full refresh. [2025-10-02T20:19:42.447960] [INFO ] [LOCAL ] MTH: Starting deletion of primary data. [2025-10-02T20:19:42.448008] [DEBUG] [LOCAL ] MTH: No primary data file found to delete. [2025-10-02T20:19:42.448046] [INFO ] [MAIN ] MTH: Starting full primary refresh. [2025-10-02T20:19:42.683218] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-01. [2025-10-02T20:19:42.831198] [INFO ] [REMOTE ] MTH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:19:43.478266] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-09. [2025-10-02T20:19:43.495163] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-02T20:19:44.273027] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-09. [2025-10-02T20:19:44.430390] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-02T20:19:45.072993] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-02. [2025-10-02T20:19:45.367517] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-02T20:19:45.872983] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-10. [2025-10-02T20:19:46.463772] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-02T20:19:46.569576] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-10-02T20:19:46.673043] [INFO ] [REMOTE ] MTH: Fetching primary data for 2024-12. [2025-10-02T20:19:47.008248] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-02T20:19:47.010213] [INFO ] [REMOTE ] MTB: Full fetch complete (68108 records). [2025-10-02T20:19:47.010378] [DEBUG] [VALIDATOR ] MTB: Validating primary data. [2025-10-02T20:19:47.453724] [DEBUG] [VALIDATOR ] MTB: All expected trading days are present. [2025-10-02T20:19:47.453822] [DEBUG] [VALIDATOR ] MTB: Primary data validation passed. [2025-10-02T20:19:47.454819] [INFO ] [MAIN ] MTB: Fetched primary data is valid. [2025-10-02T20:19:47.454887] [DEBUG] [LOCAL ] MTB: Saving primary data. [2025-10-02T20:19:47.456708] [DEBUG] [LOCAL ] MTB: Trimmed 68108 records to 47003 (keeping 200 days of data) [2025-10-02T20:19:47.516579] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-03. [2025-10-02T20:19:47.792459] [DEBUG] [LOCAL ] MTB: Primary data saved (47003 records). [2025-10-02T20:19:47.792613] [INFO ] [MAIN ] MTB: Full history saved. [2025-10-02T20:19:47.792725] [INFO ] [MAIN ] Update Progress: 1417/2370 symbols completed. MTB took 40.0s. Estimated remaining: 2h 14m 20s. Rate: 7.1 symbols/min [2025-10-02T20:19:47.980055] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-02T20:19:48.014737] [INFO ] [MAIN ] MTN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:19:48.014946] [DEBUG] [LOCAL ] MTN: No existing data file found in primary storage. [2025-10-02T20:19:48.014989] [WARN ] [MAIN ] MTN: No existing data found, performing full refresh instead. [2025-10-02T20:19:48.015066] [INFO ] [MAIN ] MTN: Wiping existing primary data before full refresh. [2025-10-02T20:19:48.015104] [INFO ] [LOCAL ] MTN: Starting deletion of primary data. [2025-10-02T20:19:48.015145] [DEBUG] [LOCAL ] MTN: No primary data file found to delete. [2025-10-02T20:19:48.015179] [INFO ] [MAIN ] MTN: Starting full primary refresh. [2025-10-02T20:19:48.284828] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-01. [2025-10-02T20:19:48.423008] [INFO ] [REMOTE ] MTN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:19:49.072995] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-10. [2025-10-02T20:19:49.589697] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-02T20:19:49.873039] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-04. [2025-10-02T20:19:50.015622] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-02T20:19:50.651505] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-02T20:19:50.653756] [INFO ] [REMOTE ] MTDR: Full fetch complete (73554 records). [2025-10-02T20:19:50.653880] [DEBUG] [VALIDATOR ] MTDR: Validating primary data. [2025-10-02T20:19:50.682340] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-02. [2025-10-02T20:19:51.227040] [DEBUG] [VALIDATOR ] MTDR: All expected trading days are present. [2025-10-02T20:19:51.227152] [DEBUG] [VALIDATOR ] MTDR: Primary data validation passed. [2025-10-02T20:19:51.228872] [INFO ] [MAIN ] MTDR: Fetched primary data is valid. [2025-10-02T20:19:51.228979] [DEBUG] [LOCAL ] MTDR: Saving primary data. [2025-10-02T20:19:51.231204] [DEBUG] [LOCAL ] MTDR: Trimmed 73554 records to 51967 (keeping 200 days of data) [2025-10-02T20:19:51.475551] [INFO ] [REMOTE ] MTN: Fetching primary data for 2024-12. [2025-10-02T20:19:51.562744] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-02T20:19:51.689336] [DEBUG] [LOCAL ] MTDR: Primary data saved (51967 records). [2025-10-02T20:19:51.689502] [INFO ] [MAIN ] MTDR: Full history saved. [2025-10-02T20:19:51.689584] [INFO ] [MAIN ] Update Progress: 1418/2370 symbols completed. MTDR took 35.6s. Estimated remaining: 2h 14m 8s. Rate: 7.1 symbols/min [2025-10-02T20:19:51.895175] [INFO ] [MAIN ] MTR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:19:51.895345] [DEBUG] [LOCAL ] MTR: No existing data file found in primary storage. [2025-10-02T20:19:51.895421] [WARN ] [MAIN ] MTR: No existing data found, performing full refresh instead. [2025-10-02T20:19:51.895545] [INFO ] [MAIN ] MTR: Wiping existing primary data before full refresh. [2025-10-02T20:19:51.895588] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-10-02T20:19:51.895630] [DEBUG] [LOCAL ] MTR: No primary data file found to delete. [2025-10-02T20:19:51.895712] [INFO ] [MAIN ] MTR: Starting full primary refresh. [2025-10-02T20:19:52.287779] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-05. [2025-10-02T20:19:52.303361] [INFO ] [REMOTE ] MTR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:19:52.333549] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-02T20:19:52.870876] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-02T20:19:53.073006] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-01. [2025-10-02T20:19:53.872996] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-03. [2025-10-02T20:19:54.174145] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-02T20:19:54.672960] [INFO ] [REMOTE ] MTR: Fetching primary data for 2024-12. [2025-10-02T20:19:54.782402] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-02T20:19:55.207239] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-02T20:19:55.257162] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-02T20:19:55.473031] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-01. [2025-10-02T20:19:55.858860] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-02T20:19:56.273001] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-02. [2025-10-02T20:19:56.815886] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-02T20:19:57.072997] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-02. [2025-10-02T20:19:57.873040] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-03. [2025-10-02T20:19:58.309495] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-02T20:19:58.584121] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-02T20:19:58.673042] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-06. [2025-10-02T20:19:59.473055] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-03. [2025-10-02T20:20:00.273022] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-04. [2025-10-02T20:20:00.458893] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-02T20:20:01.067426] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-02T20:20:01.076985] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-04. [2025-10-02T20:20:01.873059] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-04. [2025-10-02T20:20:02.223716] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-02T20:20:02.673074] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-07. [2025-10-02T20:20:03.356857] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-04 (3.08 seconds). [2025-10-02T20:20:03.473044] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-05. [2025-10-02T20:20:04.197967] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-10-02T20:20:04.273002] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-05. [2025-10-02T20:20:04.564973] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-02T20:20:04.816523] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-02T20:20:05.072985] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-08. [2025-10-02T20:20:05.337664] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-02T20:20:05.873045] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-05. [2025-10-02T20:20:06.673012] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-06. [2025-10-02T20:20:07.022450] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-02T20:20:07.479125] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-06. [2025-10-02T20:20:07.495954] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-02T20:20:07.527268] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-02T20:20:08.273019] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-06. [2025-10-02T20:20:09.072981] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-07. [2025-10-02T20:20:09.287368] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-02T20:20:09.795504] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-02T20:20:09.873029] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-07. [2025-10-02T20:20:10.076057] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-02T20:20:10.673038] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-09. [2025-10-02T20:20:11.473019] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-07. [2025-10-02T20:20:11.642550] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-02T20:20:12.273044] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-08. [2025-10-02T20:20:12.478898] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-02T20:20:13.072974] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-10. [2025-10-02T20:20:13.251476] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-02T20:20:13.872979] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-08. [2025-10-02T20:20:13.947752] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-02T20:20:14.270032] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-02T20:20:14.275058] [INFO ] [REMOTE ] MTG: Full fetch complete (74026 records). [2025-10-02T20:20:14.275266] [DEBUG] [VALIDATOR ] MTG: Validating primary data. [2025-10-02T20:20:14.394639] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-02T20:20:14.674140] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-09. [2025-10-02T20:20:14.718407] [DEBUG] [VALIDATOR ] MTG: All expected trading days are present. [2025-10-02T20:20:14.718502] [DEBUG] [VALIDATOR ] MTG: Primary data validation passed. [2025-10-02T20:20:14.719707] [INFO ] [MAIN ] MTG: Fetched primary data is valid. [2025-10-02T20:20:14.719783] [DEBUG] [LOCAL ] MTG: Saving primary data. [2025-10-02T20:20:14.721333] [DEBUG] [LOCAL ] MTG: Trimmed 74026 records to 51648 (keeping 200 days of data) [2025-10-02T20:20:15.083528] [DEBUG] [LOCAL ] MTG: Primary data saved (51648 records). [2025-10-02T20:20:15.083726] [INFO ] [MAIN ] MTG: Full history saved. [2025-10-02T20:20:15.083860] [INFO ] [MAIN ] Update Progress: 1419/2370 symbols completed. MTG took 35.6s. Estimated remaining: 2h 14m 10s. Rate: 7.1 symbols/min [2025-10-02T20:20:15.294232] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-02T20:20:15.296106] [INFO ] [MAIN ] MTRN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:20:15.297841] [DEBUG] [LOCAL ] MTRN: No existing data file found in primary storage. [2025-10-02T20:20:15.298087] [WARN ] [MAIN ] MTRN: No existing data found, performing full refresh instead. [2025-10-02T20:20:15.298255] [INFO ] [MAIN ] MTRN: Wiping existing primary data before full refresh. [2025-10-02T20:20:15.298311] [INFO ] [LOCAL ] MTRN: Starting deletion of primary data. [2025-10-02T20:20:15.298356] [DEBUG] [LOCAL ] MTRN: No primary data file found to delete. [2025-10-02T20:20:15.298391] [INFO ] [MAIN ] MTRN: Starting full primary refresh. [2025-10-02T20:20:15.478066] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-09. [2025-10-02T20:20:15.714410] [INFO ] [REMOTE ] MTRN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:20:16.273051] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2024-12. [2025-10-02T20:20:17.032354] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-02T20:20:17.072947] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-01. [2025-10-02T20:20:17.330256] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-02T20:20:17.873002] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-10. [2025-10-02T20:20:17.943785] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-02T20:20:18.283502] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-02T20:20:18.284204] [INFO ] [REMOTE ] MTR: Full fetch complete (2540 records). [2025-10-02T20:20:18.284276] [DEBUG] [VALIDATOR ] MTR: Validating primary data. [2025-10-02T20:20:18.526003] [WARN ] [VALIDATOR ] MTR: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-02T20:20:18.526267] [FATAL] [MAIN ] MTR: Fetched primary data is invalid. Refusing to save it. [2025-10-02T20:20:18.526343] [WARN ] [MAIN ] MTR: Deleting existing primary and derivative data due to validation failure. [2025-10-02T20:20:18.526418] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-10-02T20:20:18.526485] [DEBUG] [LOCAL ] MTR: No primary data file found to delete. [2025-10-02T20:20:18.526527] [INFO ] [LOCAL ] MTR: Starting deletion of derivative data. [2025-10-02T20:20:18.526567] [DEBUG] [LOCAL ] MTR: No derivative data file found to delete. [2025-10-02T20:20:18.526662] [INFO ] [MAIN ] Update Progress: 1420/2370 symbols completed. MTR took 26.8s. Estimated remaining: 2h 13m 58s. Rate: 7.1 symbols/min [2025-10-02T20:20:18.678621] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-10. [2025-10-02T20:20:18.715187] [INFO ] [MAIN ] MTUS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:20:18.715337] [DEBUG] [LOCAL ] MTUS: No existing data file found in primary storage. [2025-10-02T20:20:18.715377] [WARN ] [MAIN ] MTUS: No existing data found, performing full refresh instead. [2025-10-02T20:20:18.715488] [INFO ] [MAIN ] MTUS: Wiping existing primary data before full refresh. [2025-10-02T20:20:18.715531] [INFO ] [LOCAL ] MTUS: Starting deletion of primary data. [2025-10-02T20:20:18.715823] [DEBUG] [LOCAL ] MTUS: No primary data file found to delete. [2025-10-02T20:20:18.715875] [INFO ] [MAIN ] MTUS: Starting full primary refresh. [2025-10-02T20:20:19.099799] [INFO ] [REMOTE ] MTUS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:20:19.473038] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-02. [2025-10-02T20:20:20.103632] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-02T20:20:20.105598] [INFO ] [REMOTE ] MTH: Full fetch complete (63296 records). [2025-10-02T20:20:20.105800] [DEBUG] [VALIDATOR ] MTH: Validating primary data. [2025-10-02T20:20:20.282904] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2024-12. [2025-10-02T20:20:20.570551] [DEBUG] [VALIDATOR ] MTH: All expected trading days are present. [2025-10-02T20:20:20.570776] [DEBUG] [VALIDATOR ] MTH: Primary data validation passed. [2025-10-02T20:20:20.571838] [INFO ] [MAIN ] MTH: Fetched primary data is valid. [2025-10-02T20:20:20.571925] [DEBUG] [LOCAL ] MTH: Saving primary data. [2025-10-02T20:20:20.573361] [DEBUG] [LOCAL ] MTH: Trimmed 63296 records to 43930 (keeping 200 days of data) [2025-10-02T20:20:20.679154] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-02T20:20:20.900804] [DEBUG] [LOCAL ] MTH: Primary data saved (43930 records). [2025-10-02T20:20:20.900948] [INFO ] [MAIN ] MTH: Full history saved. [2025-10-02T20:20:20.901028] [INFO ] [MAIN ] Update Progress: 1421/2370 symbols completed. MTH took 38.6s. Estimated remaining: 2h 13m 45s. Rate: 7.1 symbols/min [2025-10-02T20:20:21.078696] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-03. [2025-10-02T20:20:21.083113] [INFO ] [MAIN ] MTW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:20:21.083407] [DEBUG] [LOCAL ] MTW: No existing data file found in primary storage. [2025-10-02T20:20:21.083471] [WARN ] [MAIN ] MTW: No existing data found, performing full refresh instead. [2025-10-02T20:20:21.083591] [INFO ] [MAIN ] MTW: Wiping existing primary data before full refresh. [2025-10-02T20:20:21.083716] [INFO ] [LOCAL ] MTW: Starting deletion of primary data. [2025-10-02T20:20:21.083777] [DEBUG] [LOCAL ] MTW: No primary data file found to delete. [2025-10-02T20:20:21.083813] [INFO ] [MAIN ] MTW: Starting full primary refresh. [2025-10-02T20:20:21.497329] [INFO ] [REMOTE ] MTW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:20:21.692842] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-02T20:20:21.873008] [INFO ] [REMOTE ] MTW: Fetching primary data for 2024-12. [2025-10-02T20:20:22.307363] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-02T20:20:22.673005] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-01. [2025-10-02T20:20:22.920833] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-02T20:20:23.473044] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-08. [2025-10-02T20:20:23.897466] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-02T20:20:24.273034] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-01. [2025-10-02T20:20:24.608574] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-02T20:20:25.072990] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-04. [2025-10-02T20:20:25.387676] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-02T20:20:25.872993] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-02. [2025-10-02T20:20:26.043075] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-02T20:20:26.673009] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-09. [2025-10-02T20:20:26.935367] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-02T20:20:27.473002] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-03. [2025-10-02T20:20:28.216316] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-02T20:20:28.272966] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-10. [2025-10-02T20:20:28.637151] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-02T20:20:29.073001] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-04. [2025-10-02T20:20:29.572150] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-02T20:20:29.574025] [INFO ] [REMOTE ] MTN: Full fetch complete (56220 records). [2025-10-02T20:20:29.574124] [DEBUG] [VALIDATOR ] MTN: Validating primary data. [2025-10-02T20:20:29.878135] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-05. [2025-10-02T20:20:29.998808] [DEBUG] [VALIDATOR ] MTN: All expected trading days are present. [2025-10-02T20:20:29.998898] [DEBUG] [VALIDATOR ] MTN: Primary data validation passed. [2025-10-02T20:20:30.000026] [INFO ] [MAIN ] MTN: Fetched primary data is valid. [2025-10-02T20:20:30.000094] [DEBUG] [LOCAL ] MTN: Saving primary data. [2025-10-02T20:20:30.001346] [DEBUG] [LOCAL ] MTN: Trimmed 56220 records to 39368 (keeping 200 days of data) [2025-10-02T20:20:30.267234] [DEBUG] [LOCAL ] MTN: Primary data saved (39368 records). [2025-10-02T20:20:30.267415] [INFO ] [MAIN ] MTN: Full history saved. [2025-10-02T20:20:30.267503] [INFO ] [MAIN ] Update Progress: 1422/2370 symbols completed. MTN took 42.5s. Estimated remaining: 2h 13m 38s. Rate: 7.1 symbols/min [2025-10-02T20:20:30.488181] [INFO ] [MAIN ] MTX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:20:30.489934] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-02T20:20:30.496670] [DEBUG] [LOCAL ] MTX: No existing data file found in primary storage. [2025-10-02T20:20:30.496906] [WARN ] [MAIN ] MTX: No existing data found, performing full refresh instead. [2025-10-02T20:20:30.497517] [INFO ] [MAIN ] MTX: Wiping existing primary data before full refresh. [2025-10-02T20:20:30.497636] [INFO ] [LOCAL ] MTX: Starting deletion of primary data. [2025-10-02T20:20:30.497814] [DEBUG] [LOCAL ] MTX: No primary data file found to delete. [2025-10-02T20:20:30.497856] [INFO ] [MAIN ] MTX: Starting full primary refresh. [2025-10-02T20:20:30.678188] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-02. [2025-10-02T20:20:30.940143] [INFO ] [REMOTE ] MTX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:20:31.327965] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-02T20:20:31.472991] [INFO ] [REMOTE ] MTX: Fetching primary data for 2024-12. [2025-10-02T20:20:31.881589] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-02T20:20:32.272987] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-05. [2025-10-02T20:20:32.584143] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-02T20:20:33.073003] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-06. [2025-10-02T20:20:33.873082] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-03. [2025-10-02T20:20:33.872958] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-02T20:20:34.210958] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-02T20:20:34.673006] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-06. [2025-10-02T20:20:34.932712] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-02T20:20:35.473004] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-07. [2025-10-02T20:20:36.011715] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-02T20:20:36.272995] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-01. [2025-10-02T20:20:36.669878] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-02T20:20:37.073050] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-07. [2025-10-02T20:20:37.442322] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-02T20:20:37.873008] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-02. [2025-10-02T20:20:38.315400] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-02T20:20:38.673041] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-04. [2025-10-02T20:20:39.106451] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-02T20:20:39.473054] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-03. [2025-10-02T20:20:40.095099] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-02T20:20:40.273001] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-05. [2025-10-02T20:20:40.707426] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-02T20:20:41.073020] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-04. [2025-10-02T20:20:41.638195] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-02T20:20:41.873000] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-08. [2025-10-02T20:20:42.611903] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-02T20:20:42.673001] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-05. [2025-10-02T20:20:42.976392] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-02T20:20:43.473021] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-08. [2025-10-02T20:20:43.780598] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-02T20:20:44.273083] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-06. [2025-10-02T20:20:44.704906] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-02T20:20:45.073019] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-09. [2025-10-02T20:20:45.166049] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-02T20:20:45.872988] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-07. [2025-10-02T20:20:46.124567] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-02T20:20:46.673007] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-06. [2025-10-02T20:20:47.206214] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-02T20:20:47.473073] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-09. [2025-10-02T20:20:47.914703] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-02T20:20:48.273000] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-07. [2025-10-02T20:20:48.577781] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-02T20:20:49.073049] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-08. [2025-10-02T20:20:49.607922] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-02T20:20:49.873003] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-08. [2025-10-02T20:20:50.153699] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-02T20:20:50.673003] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-09. [2025-10-02T20:20:50.958961] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-02T20:20:51.473009] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-10. [2025-10-02T20:20:51.754578] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-02T20:20:52.227828] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-02T20:20:52.229628] [INFO ] [REMOTE ] MTUS: Full fetch complete (42303 records). [2025-10-02T20:20:52.229746] [DEBUG] [VALIDATOR ] MTUS: Validating primary data. [2025-10-02T20:20:52.278158] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-09. [2025-10-02T20:20:52.668940] [DEBUG] [VALIDATOR ] MTUS: All expected trading days are present. [2025-10-02T20:20:52.669038] [DEBUG] [VALIDATOR ] MTUS: Primary data validation passed. [2025-10-02T20:20:52.669920] [INFO ] [MAIN ] MTUS: Fetched primary data is valid. [2025-10-02T20:20:52.669985] [DEBUG] [LOCAL ] MTUS: Saving primary data. [2025-10-02T20:20:52.671265] [DEBUG] [LOCAL ] MTUS: Trimmed 42303 records to 28407 (keeping 200 days of data) [2025-10-02T20:20:52.864062] [DEBUG] [LOCAL ] MTUS: Primary data saved (28407 records). [2025-10-02T20:20:52.864205] [INFO ] [MAIN ] MTUS: Full history saved. [2025-10-02T20:20:52.864286] [INFO ] [MAIN ] Update Progress: 1423/2370 symbols completed. MTUS took 34.3s. Estimated remaining: 2h 13m 39s. Rate: 7.1 symbols/min [2025-10-02T20:20:53.064435] [INFO ] [MAIN ] MTZ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:20:53.064699] [DEBUG] [LOCAL ] MTZ: No existing data file found in primary storage. [2025-10-02T20:20:53.064752] [WARN ] [MAIN ] MTZ: No existing data found, performing full refresh instead. [2025-10-02T20:20:53.064895] [INFO ] [MAIN ] MTZ: Wiping existing primary data before full refresh. [2025-10-02T20:20:53.064975] [INFO ] [LOCAL ] MTZ: Starting deletion of primary data. [2025-10-02T20:20:53.065039] [DEBUG] [LOCAL ] MTZ: No primary data file found to delete. [2025-10-02T20:20:53.065077] [INFO ] [MAIN ] MTZ: Starting full primary refresh. [2025-10-02T20:20:53.078707] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-10. [2025-10-02T20:20:53.513025] [INFO ] [REMOTE ] MTZ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:20:53.714432] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-02T20:20:53.872987] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-10. [2025-10-02T20:20:54.026317] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-02T20:20:54.027525] [INFO ] [REMOTE ] MTX: Full fetch complete (31272 records). [2025-10-02T20:20:54.027616] [DEBUG] [VALIDATOR ] MTX: Validating primary data. [2025-10-02T20:20:54.449624] [DEBUG] [VALIDATOR ] MTX: All expected trading days are present. [2025-10-02T20:20:54.449993] [DEBUG] [VALIDATOR ] MTX: Primary data validation passed. [2025-10-02T20:20:54.450703] [INFO ] [MAIN ] MTX: Fetched primary data is valid. [2025-10-02T20:20:54.450767] [DEBUG] [LOCAL ] MTX: Saving primary data. [2025-10-02T20:20:54.451634] [DEBUG] [LOCAL ] MTX: Trimmed 31272 records to 22888 (keeping 200 days of data) [2025-10-02T20:20:54.613378] [DEBUG] [LOCAL ] MTX: Primary data saved (22888 records). [2025-10-02T20:20:54.613523] [INFO ] [MAIN ] MTX: Full history saved. [2025-10-02T20:20:54.613608] [INFO ] [MAIN ] Update Progress: 1424/2370 symbols completed. MTX took 24.3s. Estimated remaining: 2h 13m 26s. Rate: 7.1 symbols/min [2025-10-02T20:20:54.684352] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-10. [2025-10-02T20:20:54.785331] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-02T20:20:54.812448] [INFO ] [REMOTE ] MTW: Full fetch complete (38382 records). [2025-10-02T20:20:54.816900] [DEBUG] [VALIDATOR ] MTW: Validating primary data. [2025-10-02T20:20:54.816707] [INFO ] [MAIN ] MUA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:20:54.817328] [DEBUG] [LOCAL ] MUA: No existing data file found in primary storage. [2025-10-02T20:20:54.854020] [WARN ] [MAIN ] MUA: No existing data found, performing full refresh instead. [2025-10-02T20:20:54.900846] [INFO ] [MAIN ] MUA: Wiping existing primary data before full refresh. [2025-10-02T20:20:54.913428] [INFO ] [LOCAL ] MUA: Starting deletion of primary data. [2025-10-02T20:20:54.927857] [DEBUG] [LOCAL ] MUA: No primary data file found to delete. [2025-10-02T20:20:54.939901] [INFO ] [MAIN ] MUA: Starting full primary refresh. [2025-10-02T20:20:55.479743] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2024-12. [2025-10-02T20:20:55.636899] [DEBUG] [VALIDATOR ] MTW: All expected trading days are present. [2025-10-02T20:20:55.647564] [DEBUG] [VALIDATOR ] MTW: Primary data validation passed. [2025-10-02T20:20:55.647438] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-02T20:20:55.661784] [INFO ] [MAIN ] MTW: Fetched primary data is valid. [2025-10-02T20:20:55.686295] [DEBUG] [LOCAL ] MTW: Saving primary data. [2025-10-02T20:20:55.690161] [INFO ] [REMOTE ] MUA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:20:55.686122] [INFO ] [REMOTE ] MTRN: Full fetch complete (23729 records). [2025-10-02T20:20:55.690713] [DEBUG] [VALIDATOR ] MTRN: Validating primary data. [2025-10-02T20:20:55.800155] [DEBUG] [LOCAL ] MTW: Trimmed 38382 records to 26640 (keeping 200 days of data) [2025-10-02T20:20:56.229866] [DEBUG] [VALIDATOR ] MTRN: All expected trading days are present. [2025-10-02T20:20:56.230305] [DEBUG] [VALIDATOR ] MTRN: Primary data validation passed. [2025-10-02T20:20:56.231198] [INFO ] [MAIN ] MTRN: Fetched primary data is valid. [2025-10-02T20:20:56.231989] [DEBUG] [LOCAL ] MTRN: Saving primary data. [2025-10-02T20:20:56.237205] [DEBUG] [LOCAL ] MTRN: Trimmed 23729 records to 18219 (keeping 200 days of data) [2025-10-02T20:20:56.294211] [INFO ] [REMOTE ] MUA: Fetching primary data for 2024-12. [2025-10-02T20:20:56.415948] [DEBUG] [LOCAL ] MTW: Primary data saved (26640 records). [2025-10-02T20:20:56.416577] [INFO ] [MAIN ] MTW: Full history saved. [2025-10-02T20:20:56.416970] [INFO ] [MAIN ] Update Progress: 1425/2370 symbols completed. MTW took 35.5s. Estimated remaining: 2h 13m 13s. Rate: 7.1 symbols/min [2025-10-02T20:20:56.618960] [INFO ] [MAIN ] MUC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:20:56.619989] [DEBUG] [LOCAL ] MUC: No existing data file found in primary storage. [2025-10-02T20:20:56.620291] [WARN ] [MAIN ] MUC: No existing data found, performing full refresh instead. [2025-10-02T20:20:56.620775] [INFO ] [MAIN ] MUC: Wiping existing primary data before full refresh. [2025-10-02T20:20:56.621635] [INFO ] [LOCAL ] MUC: Starting deletion of primary data. [2025-10-02T20:20:56.622566] [DEBUG] [LOCAL ] MUC: No primary data file found to delete. [2025-10-02T20:20:56.622882] [INFO ] [MAIN ] MUC: Starting full primary refresh. [2025-10-02T20:20:56.624424] [DEBUG] [LOCAL ] MTRN: Primary data saved (18219 records). [2025-10-02T20:20:56.624585] [INFO ] [MAIN ] MTRN: Full history saved. [2025-10-02T20:20:56.660794] [INFO ] [MAIN ] Update Progress: 1426/2370 symbols completed. MTRN took 41.6s. Estimated remaining: 2h 12m 59s. Rate: 7.1 symbols/min [2025-10-02T20:20:57.198629] [INFO ] [MAIN ] MUE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:20:57.207126] [DEBUG] [LOCAL ] MUE: No existing data file found in primary storage. [2025-10-02T20:20:57.208062] [WARN ] [MAIN ] MUE: No existing data found, performing full refresh instead. [2025-10-02T20:20:57.213992] [INFO ] [MAIN ] MUE: Wiping existing primary data before full refresh. [2025-10-02T20:20:57.229576] [INFO ] [LOCAL ] MUE: Starting deletion of primary data. [2025-10-02T20:20:57.245237] [DEBUG] [LOCAL ] MUE: No primary data file found to delete. [2025-10-02T20:20:57.250563] [INFO ] [MAIN ] MUE: Starting full primary refresh. [2025-10-02T20:20:57.379101] [INFO ] [REMOTE ] MUC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:20:57.385862] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-02T20:20:57.405625] [INFO ] [REMOTE ] MUC: Fetching primary data for 2024-12. [2025-10-02T20:20:57.574100] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-02T20:20:57.797264] [INFO ] [REMOTE ] MUE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:20:57.873009] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-01. [2025-10-02T20:20:58.672985] [INFO ] [REMOTE ] MUE: Fetching primary data for 2024-12. [2025-10-02T20:20:59.396943] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-02T20:20:59.478622] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-01. [2025-10-02T20:20:59.491746] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-02T20:20:59.491122] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-02T20:21:00.272986] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-01. [2025-10-02T20:21:00.571995] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-02T20:21:01.073000] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-02. [2025-10-02T20:21:01.109274] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-02T20:21:01.873005] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-02. [2025-10-02T20:21:02.159338] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-02T20:21:02.673000] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-03. [2025-10-02T20:21:02.751018] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-02T20:21:03.473235] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-02. [2025-10-02T20:21:03.961533] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-02T20:21:04.273026] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-01. [2025-10-02T20:21:05.072972] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-03. [2025-10-02T20:21:05.251071] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-02T20:21:05.515476] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-02T20:21:05.873046] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-03. [2025-10-02T20:21:05.955894] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-02T20:21:06.673199] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-04. [2025-10-02T20:21:07.473029] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-04. [2025-10-02T20:21:07.653633] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-02T20:21:07.726663] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-02T20:21:08.273022] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-04. [2025-10-02T20:21:08.479460] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-02T20:21:09.073003] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-05. [2025-10-02T20:21:09.639122] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-02T20:21:09.872986] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-05. [2025-10-02T20:21:10.007948] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-02T20:21:10.673028] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-05. [2025-10-02T20:21:11.473063] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-06. [2025-10-02T20:21:11.528841] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-02T20:21:11.612528] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-02T20:21:12.273035] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-02. [2025-10-02T20:21:12.315284] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-02T20:21:13.073005] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-06. [2025-10-02T20:21:13.340870] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-02T20:21:13.872995] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-03. [2025-10-02T20:21:14.127545] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-02T20:21:14.673045] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-07. [2025-10-02T20:21:15.473038] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-07. [2025-10-02T20:21:15.820214] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-02T20:21:16.273026] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-06. [2025-10-02T20:21:16.359092] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-02T20:21:16.513888] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-02T20:21:17.073008] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-08. [2025-10-02T20:21:17.873020] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-08. [2025-10-02T20:21:17.917861] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-02T20:21:18.313631] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-02T20:21:18.664141] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-02T20:21:18.672946] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-09. [2025-10-02T20:21:19.473075] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-09. [2025-10-02T20:21:19.552287] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-02T20:21:20.273000] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-07. [2025-10-02T20:21:20.426706] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-02T20:21:21.073049] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-10. [2025-10-02T20:21:21.795212] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-02T20:21:21.796105] [INFO ] [REMOTE ] MUE: Full fetch complete (16104 records). [2025-10-02T20:21:21.796179] [DEBUG] [VALIDATOR ] MUE: Validating primary data. [2025-10-02T20:21:21.878080] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-10. [2025-10-02T20:21:22.207015] [DEBUG] [VALIDATOR ] MUE: All expected trading days are present. [2025-10-02T20:21:22.207193] [DEBUG] [VALIDATOR ] MUE: Primary data validation passed. [2025-10-02T20:21:22.207771] [INFO ] [MAIN ] MUE: Fetched primary data is valid. [2025-10-02T20:21:22.207866] [DEBUG] [LOCAL ] MUE: Saving primary data. [2025-10-02T20:21:22.208877] [DEBUG] [LOCAL ] MUE: Trimmed 16104 records to 11972 (keeping 200 days of data) [2025-10-02T20:21:22.289796] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-02T20:21:22.323248] [DEBUG] [LOCAL ] MUE: Primary data saved (11972 records). [2025-10-02T20:21:22.323390] [INFO ] [MAIN ] MUE: Full history saved. [2025-10-02T20:21:22.323467] [INFO ] [MAIN ] Update Progress: 1427/2370 symbols completed. MUE took 25.6s. Estimated remaining: 2h 13m 2s. Rate: 7.1 symbols/min [2025-10-02T20:21:22.450095] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-02T20:21:22.467703] [INFO ] [REMOTE ] MUA: Full fetch complete (18825 records). [2025-10-02T20:21:22.473037] [DEBUG] [VALIDATOR ] MUA: Validating primary data. [2025-10-02T20:21:22.645007] [INFO ] [MAIN ] MUFG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:21:22.654148] [DEBUG] [LOCAL ] MUFG: No existing data file found in primary storage. [2025-10-02T20:21:22.664596] [WARN ] [MAIN ] MUFG: No existing data found, performing full refresh instead. [2025-10-02T20:21:22.675010] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-08. [2025-10-02T20:21:22.675339] [INFO ] [MAIN ] MUFG: Wiping existing primary data before full refresh. [2025-10-02T20:21:22.714859] [INFO ] [LOCAL ] MUFG: Starting deletion of primary data. [2025-10-02T20:21:22.716718] [DEBUG] [LOCAL ] MUFG: No primary data file found to delete. [2025-10-02T20:21:22.716824] [INFO ] [MAIN ] MUFG: Starting full primary refresh. [2025-10-02T20:21:23.209011] [DEBUG] [VALIDATOR ] MUA: All expected trading days are present. [2025-10-02T20:21:23.242895] [DEBUG] [VALIDATOR ] MUA: Primary data validation passed. [2025-10-02T20:21:23.281494] [INFO ] [MAIN ] MUA: Fetched primary data is valid. [2025-10-02T20:21:23.307968] [DEBUG] [LOCAL ] MUA: Saving primary data. [2025-10-02T20:21:23.312491] [DEBUG] [LOCAL ] MUA: Trimmed 18825 records to 12395 (keeping 200 days of data) [2025-10-02T20:21:23.463237] [INFO ] [REMOTE ] MUFG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:21:23.473083] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2024-12. [2025-10-02T20:21:23.498341] [DEBUG] [LOCAL ] MUA: Primary data saved (12395 records). [2025-10-02T20:21:23.498502] [INFO ] [MAIN ] MUA: Full history saved. [2025-10-02T20:21:23.498584] [INFO ] [MAIN ] Update Progress: 1428/2370 symbols completed. MUA took 28.9s. Estimated remaining: 2h 12m 49s. Rate: 7.1 symbols/min [2025-10-02T20:21:23.778981] [INFO ] [MAIN ] MUJ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:21:23.779184] [DEBUG] [LOCAL ] MUJ: No existing data file found in primary storage. [2025-10-02T20:21:23.779226] [WARN ] [MAIN ] MUJ: No existing data found, performing full refresh instead. [2025-10-02T20:21:23.779346] [INFO ] [MAIN ] MUJ: Wiping existing primary data before full refresh. [2025-10-02T20:21:23.779390] [INFO ] [LOCAL ] MUJ: Starting deletion of primary data. [2025-10-02T20:21:23.779435] [DEBUG] [LOCAL ] MUJ: No primary data file found to delete. [2025-10-02T20:21:23.779469] [INFO ] [MAIN ] MUJ: Starting full primary refresh. [2025-10-02T20:21:24.275759] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-04. [2025-10-02T20:21:24.334906] [INFO ] [REMOTE ] MUJ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:21:24.370254] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-02T20:21:25.073023] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2024-12. [2025-10-02T20:21:25.573087] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-02T20:21:25.663361] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-10-02T20:21:25.873013] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-01. [2025-10-02T20:21:25.990241] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-02T20:21:26.673003] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-05. [2025-10-02T20:21:27.473012] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-09. [2025-10-02T20:21:27.520707] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-02T20:21:27.795615] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-02T20:21:28.273035] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-06. [2025-10-02T20:21:29.072996] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-02. [2025-10-02T20:21:29.164487] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-02T20:21:29.435102] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-02T20:21:29.873018] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-07. [2025-10-02T20:21:30.672978] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-10. [2025-10-02T20:21:30.929163] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-02T20:21:31.112133] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-02T20:21:31.472996] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-01. [2025-10-02T20:21:32.006897] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-02T20:21:32.009143] [INFO ] [REMOTE ] MTZ: Full fetch complete (63356 records). [2025-10-02T20:21:32.009251] [DEBUG] [VALIDATOR ] MTZ: Validating primary data. [2025-10-02T20:21:32.286053] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-08. [2025-10-02T20:21:32.459258] [DEBUG] [VALIDATOR ] MTZ: All expected trading days are present. [2025-10-02T20:21:32.459356] [DEBUG] [VALIDATOR ] MTZ: Primary data validation passed. [2025-10-02T20:21:32.460387] [INFO ] [MAIN ] MTZ: Fetched primary data is valid. [2025-10-02T20:21:32.460455] [DEBUG] [LOCAL ] MTZ: Saving primary data. [2025-10-02T20:21:32.461892] [DEBUG] [LOCAL ] MTZ: Trimmed 63356 records to 43383 (keeping 200 days of data) [2025-10-02T20:21:32.755681] [DEBUG] [LOCAL ] MTZ: Primary data saved (43383 records). [2025-10-02T20:21:32.755831] [INFO ] [MAIN ] MTZ: Full history saved. [2025-10-02T20:21:32.755977] [INFO ] [MAIN ] Update Progress: 1429/2370 symbols completed. MTZ took 39.9s. Estimated remaining: 2h 12m 41s. Rate: 7.1 symbols/min [2025-10-02T20:21:32.911723] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-02T20:21:32.964361] [INFO ] [MAIN ] MUR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:21:32.964568] [DEBUG] [LOCAL ] MUR: No existing data file found in primary storage. [2025-10-02T20:21:32.964627] [WARN ] [MAIN ] MUR: No existing data found, performing full refresh instead. [2025-10-02T20:21:32.964766] [INFO ] [MAIN ] MUR: Wiping existing primary data before full refresh. [2025-10-02T20:21:32.964810] [INFO ] [LOCAL ] MUR: Starting deletion of primary data. [2025-10-02T20:21:32.964854] [DEBUG] [LOCAL ] MUR: No primary data file found to delete. [2025-10-02T20:21:32.964889] [INFO ] [MAIN ] MUR: Starting full primary refresh. [2025-10-02T20:21:33.074476] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-02. [2025-10-02T20:21:33.362927] [INFO ] [REMOTE ] MUR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:21:33.578140] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-02T20:21:33.759456] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-02T20:21:33.873042] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-09. [2025-10-02T20:21:34.673006] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-03. [2025-10-02T20:21:35.100687] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-02T20:21:35.473066] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-03. [2025-10-02T20:21:36.273056] [INFO ] [REMOTE ] MUR: Fetching primary data for 2024-12. [2025-10-02T20:21:36.397994] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-02T20:21:36.735288] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-02T20:21:37.073059] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-04. [2025-10-02T20:21:37.873004] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-10. [2025-10-02T20:21:38.141960] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-02T20:21:38.673025] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-01. [2025-10-02T20:21:38.775824] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-02T20:21:38.777134] [INFO ] [REMOTE ] MUC: Full fetch complete (30346 records). [2025-10-02T20:21:38.777227] [DEBUG] [VALIDATOR ] MUC: Validating primary data. [2025-10-02T20:21:39.203136] [DEBUG] [VALIDATOR ] MUC: All expected trading days are present. [2025-10-02T20:21:39.203351] [DEBUG] [VALIDATOR ] MUC: Primary data validation passed. [2025-10-02T20:21:39.204180] [INFO ] [MAIN ] MUC: Fetched primary data is valid. [2025-10-02T20:21:39.204268] [DEBUG] [LOCAL ] MUC: Saving primary data. [2025-10-02T20:21:39.239044] [DEBUG] [LOCAL ] MUC: Trimmed 30346 records to 20780 (keeping 200 days of data) [2025-10-02T20:21:39.241067] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-02T20:21:39.387433] [DEBUG] [LOCAL ] MUC: Primary data saved (20780 records). [2025-10-02T20:21:39.387574] [INFO ] [MAIN ] MUC: Full history saved. [2025-10-02T20:21:39.387683] [INFO ] [MAIN ] Update Progress: 1430/2370 symbols completed. MUC took 43.0s. Estimated remaining: 2h 12m 31s. Rate: 7.1 symbols/min [2025-10-02T20:21:39.478149] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-05. [2025-10-02T20:21:39.581864] [INFO ] [MAIN ] MUSA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:21:39.582102] [DEBUG] [LOCAL ] MUSA: No existing data file found in primary storage. [2025-10-02T20:21:39.582159] [WARN ] [MAIN ] MUSA: No existing data found, performing full refresh instead. [2025-10-02T20:21:39.582283] [INFO ] [MAIN ] MUSA: Wiping existing primary data before full refresh. [2025-10-02T20:21:39.582327] [INFO ] [LOCAL ] MUSA: Starting deletion of primary data. [2025-10-02T20:21:39.582371] [DEBUG] [LOCAL ] MUSA: No primary data file found to delete. [2025-10-02T20:21:39.582406] [INFO ] [MAIN ] MUSA: Starting full primary refresh. [2025-10-02T20:21:39.997810] [INFO ] [REMOTE ] MUSA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:21:40.273023] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-04. [2025-10-02T20:21:40.927037] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-02T20:21:41.073022] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2024-12. [2025-10-02T20:21:41.229772] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-02T20:21:41.642913] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-02T20:21:41.873062] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-06. [2025-10-02T20:21:42.219936] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-02T20:21:42.673027] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-01. [2025-10-02T20:21:43.473005] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-02. [2025-10-02T20:21:43.742510] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-02T20:21:43.879080] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-02T20:21:44.273048] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-05. [2025-10-02T20:21:45.001297] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-02T20:21:45.073037] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-03. [2025-10-02T20:21:45.244577] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-02T20:21:45.873048] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-06. [2025-10-02T20:21:46.673169] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-02. [2025-10-02T20:21:46.784305] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-02T20:21:46.884348] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-02T20:21:47.473050] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-04. [2025-10-02T20:21:48.035028] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-02T20:21:48.273194] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-07. [2025-10-02T20:21:49.073063] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-07. [2025-10-02T20:21:49.366781] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-02T20:21:49.872995] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-05. [2025-10-02T20:21:50.672981] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-03. [2025-10-02T20:21:50.888544] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-07 (2.62 seconds). [2025-10-02T20:21:51.208146] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-02T20:21:51.275314] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-02T20:21:51.472998] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-06. [2025-10-02T20:21:51.675439] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-02T20:21:52.273034] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-04. [2025-10-02T20:21:53.073006] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-08. [2025-10-02T20:21:53.338958] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-02T20:21:53.648610] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-02T20:21:53.872997] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-07. [2025-10-02T20:21:54.620543] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-02T20:21:54.673054] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-09. [2025-10-02T20:21:55.473020] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-05. [2025-10-02T20:21:55.847867] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-02T20:21:56.272963] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-08. [2025-10-02T20:21:56.731598] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-02T20:21:56.949313] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-02T20:21:57.073049] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-10. [2025-10-02T20:21:57.873028] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-08. [2025-10-02T20:21:57.951451] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-02T20:21:58.487304] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-02T20:21:58.492384] [INFO ] [REMOTE ] MUFG: Full fetch complete (75524 records). [2025-10-02T20:21:58.492576] [DEBUG] [VALIDATOR ] MUFG: Validating primary data. [2025-10-02T20:21:58.680333] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-09. [2025-10-02T20:21:58.951621] [DEBUG] [VALIDATOR ] MUFG: All expected trading days are present. [2025-10-02T20:21:58.951857] [DEBUG] [VALIDATOR ] MUFG: Primary data validation passed. [2025-10-02T20:21:58.953131] [INFO ] [MAIN ] MUFG: Fetched primary data is valid. [2025-10-02T20:21:58.953275] [DEBUG] [LOCAL ] MUFG: Saving primary data. [2025-10-02T20:21:58.955595] [DEBUG] [LOCAL ] MUFG: Trimmed 75524 records to 52941 (keeping 200 days of data) [2025-10-02T20:21:59.068286] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-02T20:21:59.360762] [DEBUG] [LOCAL ] MUFG: Primary data saved (52941 records). [2025-10-02T20:21:59.361002] [INFO ] [MAIN ] MUFG: Full history saved. [2025-10-02T20:21:59.361144] [INFO ] [MAIN ] Update Progress: 1431/2370 symbols completed. MUFG took 37.0s. Estimated remaining: 2h 12m 30s. Rate: 7.1 symbols/min [2025-10-02T20:21:59.476940] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-06. [2025-10-02T20:21:59.551589] [INFO ] [MAIN ] MUSE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:21:59.551829] [DEBUG] [LOCAL ] MUSE: No existing data file found in primary storage. [2025-10-02T20:21:59.551887] [WARN ] [MAIN ] MUSE: No existing data found, performing full refresh instead. [2025-10-02T20:21:59.552015] [INFO ] [MAIN ] MUSE: Wiping existing primary data before full refresh. [2025-10-02T20:21:59.552096] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-10-02T20:21:59.552179] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-10-02T20:21:59.552251] [INFO ] [MAIN ] MUSE: Starting full primary refresh. [2025-10-02T20:21:59.934393] [INFO ] [REMOTE ] MUSE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:22:00.273017] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2024-12. [2025-10-02T20:22:00.455639] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-02T20:22:00.973502] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-02T20:22:00.986543] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-02T20:22:01.073056] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-07. [2025-10-02T20:22:01.873002] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-01. [2025-10-02T20:22:02.195845] [DEBUG] [REMOTE ] MUSE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T20:22:02.196210] [WARN ] [REMOTE ] MUSE: No data returned for month 2025-01 [2025-10-02T20:22:02.196304] [FATAL] [REMOTE ] MUSE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T20:22:02.196380] [FATAL] [MAIN ] MUSE: Failed to fetch primary data. [2025-10-02T20:22:02.196417] [WARN ] [MAIN ] MUSE: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T20:22:02.196454] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-10-02T20:22:02.196509] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-10-02T20:22:02.196544] [INFO ] [LOCAL ] MUSE: Starting deletion of derivative data. [2025-10-02T20:22:02.196617] [DEBUG] [LOCAL ] MUSE: No derivative data file found to delete. [2025-10-02T20:22:02.196716] [INFO ] [MAIN ] Update Progress: 1432/2370 symbols completed. MUSE took 2.8s. Estimated remaining: 2h 12m 18s. Rate: 7.1 symbols/min [2025-10-02T20:22:02.426717] [INFO ] [MAIN ] MUX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:22:02.427022] [DEBUG] [LOCAL ] MUX: No existing data file found in primary storage. [2025-10-02T20:22:02.427130] [WARN ] [MAIN ] MUX: No existing data found, performing full refresh instead. [2025-10-02T20:22:02.427337] [INFO ] [MAIN ] MUX: Wiping existing primary data before full refresh. [2025-10-02T20:22:02.427417] [INFO ] [LOCAL ] MUX: Starting deletion of primary data. [2025-10-02T20:22:02.427520] [DEBUG] [LOCAL ] MUX: No primary data file found to delete. [2025-10-02T20:22:02.427585] [INFO ] [MAIN ] MUX: Starting full primary refresh. [2025-10-02T20:22:02.575031] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-02T20:22:02.677055] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-10. [2025-10-02T20:22:02.897635] [INFO ] [REMOTE ] MUX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:22:03.473014] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-08. [2025-10-02T20:22:04.221232] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-02T20:22:04.223372] [INFO ] [REMOTE ] MUR: Full fetch complete (76476 records). [2025-10-02T20:22:04.223496] [DEBUG] [VALIDATOR ] MUR: Validating primary data. [2025-10-02T20:22:04.278166] [INFO ] [REMOTE ] MUX: Fetching primary data for 2024-12. [2025-10-02T20:22:04.688770] [DEBUG] [VALIDATOR ] MUR: All expected trading days are present. [2025-10-02T20:22:04.688907] [DEBUG] [VALIDATOR ] MUR: Primary data validation passed. [2025-10-02T20:22:04.690093] [INFO ] [MAIN ] MUR: Fetched primary data is valid. [2025-10-02T20:22:04.690159] [DEBUG] [LOCAL ] MUR: Saving primary data. [2025-10-02T20:22:04.692093] [DEBUG] [LOCAL ] MUR: Trimmed 76476 records to 53312 (keeping 200 days of data) [2025-10-02T20:22:04.777606] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-02T20:22:05.073024] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-09. [2025-10-02T20:22:05.089821] [DEBUG] [LOCAL ] MUR: Primary data saved (53312 records). [2025-10-02T20:22:05.089991] [INFO ] [MAIN ] MUR: Full history saved. [2025-10-02T20:22:05.090077] [INFO ] [MAIN ] Update Progress: 1433/2370 symbols completed. MUR took 32.3s. Estimated remaining: 2h 12m 6s. Rate: 7.1 symbols/min [2025-10-02T20:22:05.299497] [INFO ] [MAIN ] MVF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:22:05.299721] [DEBUG] [LOCAL ] MVF: No existing data file found in primary storage. [2025-10-02T20:22:05.299772] [WARN ] [MAIN ] MVF: No existing data found, performing full refresh instead. [2025-10-02T20:22:05.299883] [INFO ] [MAIN ] MVF: Wiping existing primary data before full refresh. [2025-10-02T20:22:05.299925] [INFO ] [LOCAL ] MVF: Starting deletion of primary data. [2025-10-02T20:22:05.299968] [DEBUG] [LOCAL ] MVF: No primary data file found to delete. [2025-10-02T20:22:05.300002] [INFO ] [MAIN ] MVF: Starting full primary refresh. [2025-10-02T20:22:05.713319] [INFO ] [REMOTE ] MVF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:22:05.858351] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-02T20:22:05.872982] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-01. [2025-10-02T20:22:06.413231] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-02T20:22:06.673002] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-09. [2025-10-02T20:22:07.473049] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-10. [2025-10-02T20:22:07.594012] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-02T20:22:07.693721] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-02T20:22:08.275060] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-02T20:22:08.274811] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-02. [2025-10-02T20:22:08.277419] [INFO ] [REMOTE ] MUSA: Full fetch complete (35202 records). [2025-10-02T20:22:08.277521] [DEBUG] [VALIDATOR ] MUSA: Validating primary data. [2025-10-02T20:22:08.692160] [DEBUG] [VALIDATOR ] MUSA: All expected trading days are present. [2025-10-02T20:22:08.692286] [DEBUG] [VALIDATOR ] MUSA: Primary data validation passed. [2025-10-02T20:22:08.693145] [INFO ] [MAIN ] MUSA: Fetched primary data is valid. [2025-10-02T20:22:08.693213] [DEBUG] [LOCAL ] MUSA: Saving primary data. [2025-10-02T20:22:08.694261] [DEBUG] [LOCAL ] MUSA: Trimmed 35202 records to 24863 (keeping 200 days of data) [2025-10-02T20:22:08.868283] [DEBUG] [LOCAL ] MUSA: Primary data saved (24863 records). [2025-10-02T20:22:08.868425] [INFO ] [MAIN ] MUSA: Full history saved. [2025-10-02T20:22:08.868564] [INFO ] [MAIN ] Update Progress: 1434/2370 symbols completed. MUSA took 29.5s. Estimated remaining: 2h 11m 54s. Rate: 7.1 symbols/min [2025-10-02T20:22:09.057498] [INFO ] [MAIN ] MVO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:22:09.057695] [DEBUG] [LOCAL ] MVO: No existing data file found in primary storage. [2025-10-02T20:22:09.057750] [WARN ] [MAIN ] MVO: No existing data found, performing full refresh instead. [2025-10-02T20:22:09.057870] [INFO ] [MAIN ] MVO: Wiping existing primary data before full refresh. [2025-10-02T20:22:09.057913] [INFO ] [LOCAL ] MVO: Starting deletion of primary data. [2025-10-02T20:22:09.057958] [DEBUG] [LOCAL ] MVO: No primary data file found to delete. [2025-10-02T20:22:09.057992] [INFO ] [MAIN ] MVO: Starting full primary refresh. [2025-10-02T20:22:09.080894] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-10. [2025-10-02T20:22:09.498324] [INFO ] [REMOTE ] MVO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:22:09.873020] [INFO ] [REMOTE ] MVO: Fetching primary data for 2024-12. [2025-10-02T20:22:09.956874] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-02T20:22:10.019490] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-02T20:22:10.022438] [INFO ] [REMOTE ] MUJ: Full fetch complete (20514 records). [2025-10-02T20:22:10.022577] [DEBUG] [VALIDATOR ] MUJ: Validating primary data. [2025-10-02T20:22:10.451074] [DEBUG] [VALIDATOR ] MUJ: All expected trading days are present. [2025-10-02T20:22:10.451201] [DEBUG] [VALIDATOR ] MUJ: Primary data validation passed. [2025-10-02T20:22:10.451777] [INFO ] [MAIN ] MUJ: Fetched primary data is valid. [2025-10-02T20:22:10.451843] [DEBUG] [LOCAL ] MUJ: Saving primary data. [2025-10-02T20:22:10.452769] [DEBUG] [LOCAL ] MUJ: Trimmed 20514 records to 13577 (keeping 200 days of data) [2025-10-02T20:22:10.552958] [DEBUG] [LOCAL ] MUJ: Primary data saved (13577 records). [2025-10-02T20:22:10.553101] [INFO ] [MAIN ] MUJ: Full history saved. [2025-10-02T20:22:10.553207] [INFO ] [MAIN ] Update Progress: 1435/2370 symbols completed. MUJ took 47.1s. Estimated remaining: 2h 11m 41s. Rate: 7.1 symbols/min [2025-10-02T20:22:10.679135] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-03. [2025-10-02T20:22:10.722260] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-02T20:22:10.766874] [INFO ] [MAIN ] MVT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:22:10.767144] [DEBUG] [LOCAL ] MVT: No existing data file found in primary storage. [2025-10-02T20:22:10.767205] [WARN ] [MAIN ] MVT: No existing data found, performing full refresh instead. [2025-10-02T20:22:10.767318] [INFO ] [MAIN ] MVT: Wiping existing primary data before full refresh. [2025-10-02T20:22:10.767362] [INFO ] [LOCAL ] MVT: Starting deletion of primary data. [2025-10-02T20:22:10.767406] [DEBUG] [LOCAL ] MVT: No primary data file found to delete. [2025-10-02T20:22:10.767440] [INFO ] [MAIN ] MVT: Starting full primary refresh. [2025-10-02T20:22:11.180764] [INFO ] [REMOTE ] MVT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:22:11.473005] [INFO ] [REMOTE ] MVF: Fetching primary data for 2024-12. [2025-10-02T20:22:12.273042] [INFO ] [REMOTE ] MVT: Fetching primary data for 2024-12. [2025-10-02T20:22:12.530590] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-02T20:22:12.676063] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-02T20:22:13.073011] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-01. [2025-10-02T20:22:13.327471] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-02T20:22:13.872997] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-04. [2025-10-02T20:22:13.927543] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-02T20:22:14.673052] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-02. [2025-10-02T20:22:15.473069] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-01. [2025-10-02T20:22:15.648313] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-02T20:22:15.725068] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-02T20:22:16.273311] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-03. [2025-10-02T20:22:16.351518] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-02T20:22:17.073017] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-05. [2025-10-02T20:22:17.346758] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-02T20:22:17.873028] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-02. [2025-10-02T20:22:18.550527] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-02T20:22:18.673047] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-03. [2025-10-02T20:22:18.827870] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-02T20:22:19.208990] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-02T20:22:19.472999] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-04. [2025-10-02T20:22:20.184922] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-02T20:22:20.272996] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-05. [2025-10-02T20:22:21.074634] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-04. [2025-10-02T20:22:21.077413] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-02T20:22:21.873007] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-01. [2025-10-02T20:22:22.317722] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-02T20:22:22.672985] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-05. [2025-10-02T20:22:23.012041] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-02T20:22:23.473035] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-06. [2025-10-02T20:22:23.563749] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-02T20:22:24.273000] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-02. [2025-10-02T20:22:25.058148] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-02T20:22:25.072955] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-07. [2025-10-02T20:22:25.177314] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-02T20:22:25.873000] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-06. [2025-10-02T20:22:26.672998] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-03. [2025-10-02T20:22:26.852066] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-02T20:22:26.895132] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-02T20:22:27.432731] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-02T20:22:27.473027] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-04. [2025-10-02T20:22:28.273003] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-07. [2025-10-02T20:22:28.436943] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-02T20:22:29.073042] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-08. [2025-10-02T20:22:29.088062] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-02T20:22:29.872997] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-08. [2025-10-02T20:22:30.678332] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-05. [2025-10-02T20:22:30.693728] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-02T20:22:30.779900] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-02T20:22:31.194507] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-02T20:22:31.473034] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-09. [2025-10-02T20:22:32.273011] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-06. [2025-10-02T20:22:33.072971] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-09. [2025-10-02T20:22:33.237321] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-02T20:22:33.666289] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-02T20:22:33.872960] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-07. [2025-10-02T20:22:34.032617] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-02T20:22:34.673024] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-10. [2025-10-02T20:22:34.814868] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-02T20:22:35.473066] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-06. [2025-10-02T20:22:36.068680] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-02T20:22:36.071565] [INFO ] [REMOTE ] MUX: Full fetch complete (59423 records). [2025-10-02T20:22:36.071786] [DEBUG] [VALIDATOR ] MUX: Validating primary data. [2025-10-02T20:22:36.249839] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-02T20:22:36.282873] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-10. [2025-10-02T20:22:36.581989] [DEBUG] [VALIDATOR ] MUX: All expected trading days are present. [2025-10-02T20:22:36.582078] [DEBUG] [VALIDATOR ] MUX: Primary data validation passed. [2025-10-02T20:22:36.583272] [INFO ] [MAIN ] MUX: Fetched primary data is valid. [2025-10-02T20:22:36.583339] [DEBUG] [LOCAL ] MUX: Saving primary data. [2025-10-02T20:22:36.584861] [DEBUG] [LOCAL ] MUX: Trimmed 59423 records to 43201 (keeping 200 days of data) [2025-10-02T20:22:36.860956] [DEBUG] [LOCAL ] MUX: Primary data saved (43201 records). [2025-10-02T20:22:36.861100] [INFO ] [MAIN ] MUX: Full history saved. [2025-10-02T20:22:36.861207] [INFO ] [MAIN ] Update Progress: 1436/2370 symbols completed. MUX took 34.7s. Estimated remaining: 2h 11m 45s. Rate: 7.1 symbols/min [2025-10-02T20:22:37.021840] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-02T20:22:37.063427] [INFO ] [MAIN ] MWA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:22:37.063812] [DEBUG] [LOCAL ] MWA: No existing data file found in primary storage. [2025-10-02T20:22:37.063561] [INFO ] [REMOTE ] MVT: Full fetch complete (14564 records). [2025-10-02T20:22:37.063888] [WARN ] [MAIN ] MWA: No existing data found, performing full refresh instead. [2025-10-02T20:22:37.064072] [DEBUG] [VALIDATOR ] MVT: Validating primary data. [2025-10-02T20:22:37.064435] [INFO ] [MAIN ] MWA: Wiping existing primary data before full refresh. [2025-10-02T20:22:37.064509] [INFO ] [LOCAL ] MWA: Starting deletion of primary data. [2025-10-02T20:22:37.064589] [DEBUG] [LOCAL ] MWA: No primary data file found to delete. [2025-10-02T20:22:37.070312] [INFO ] [MAIN ] MWA: Starting full primary refresh. [2025-10-02T20:22:37.083438] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-07. [2025-10-02T20:22:37.894272] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-08. [2025-10-02T20:22:37.994326] [INFO ] [REMOTE ] MWA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:22:37.983258] [DEBUG] [VALIDATOR ] MVT: All expected trading days are present. [2025-10-02T20:22:38.003789] [DEBUG] [VALIDATOR ] MVT: Primary data validation passed. [2025-10-02T20:22:38.005883] [INFO ] [MAIN ] MVT: Fetched primary data is valid. [2025-10-02T20:22:38.006573] [DEBUG] [LOCAL ] MVT: Saving primary data. [2025-10-02T20:22:38.006480] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-02T20:22:38.013944] [DEBUG] [LOCAL ] MVT: Trimmed 14564 records to 10328 (keeping 200 days of data) [2025-10-02T20:22:38.092573] [DEBUG] [LOCAL ] MVT: Primary data saved (10328 records). [2025-10-02T20:22:38.092761] [INFO ] [MAIN ] MVT: Full history saved. [2025-10-02T20:22:38.092877] [INFO ] [MAIN ] Update Progress: 1437/2370 symbols completed. MVT took 27.5s. Estimated remaining: 2h 11m 31s. Rate: 7.1 symbols/min [2025-10-02T20:22:38.673053] [INFO ] [REMOTE ] MWA: Fetching primary data for 2024-12. [2025-10-02T20:22:38.930141] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-02T20:22:39.473064] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-09. [2025-10-02T20:22:40.273007] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-08. [2025-10-02T20:22:40.311978] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-02T20:22:40.537123] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-02T20:22:41.040636] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-02T20:22:41.073028] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-09. [2025-10-02T20:22:41.873004] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-10. [2025-10-02T20:22:41.950779] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-02T20:22:42.494031] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-02T20:22:42.495237] [INFO ] [REMOTE ] MVF: Full fetch complete (19116 records). [2025-10-02T20:22:42.495329] [DEBUG] [VALIDATOR ] MVF: Validating primary data. [2025-10-02T20:22:42.676965] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-10. [2025-10-02T20:22:42.918419] [DEBUG] [VALIDATOR ] MVF: All expected trading days are present. [2025-10-02T20:22:42.918507] [DEBUG] [VALIDATOR ] MVF: Primary data validation passed. [2025-10-02T20:22:42.918931] [INFO ] [MAIN ] MVF: Fetched primary data is valid. [2025-10-02T20:22:42.918994] [DEBUG] [LOCAL ] MVF: Saving primary data. [2025-10-02T20:22:42.919616] [DEBUG] [LOCAL ] MVF: Trimmed 19116 records to 13165 (keeping 200 days of data) [2025-10-02T20:22:43.002592] [DEBUG] [LOCAL ] MVF: Primary data saved (13165 records). [2025-10-02T20:22:43.002787] [INFO ] [MAIN ] MVF: Full history saved. [2025-10-02T20:22:43.002874] [INFO ] [MAIN ] Update Progress: 1438/2370 symbols completed. MVF took 37.9s. Estimated remaining: 2h 11m 21s. Rate: 7.1 symbols/min [2025-10-02T20:22:43.331015] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-02T20:22:43.332145] [INFO ] [REMOTE ] MVO: Full fetch complete (14387 records). [2025-10-02T20:22:43.332222] [DEBUG] [VALIDATOR ] MVO: Validating primary data. [2025-10-02T20:22:43.478086] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-01. [2025-10-02T20:22:43.756790] [DEBUG] [VALIDATOR ] MVO: All expected trading days are present. [2025-10-02T20:22:43.756890] [DEBUG] [VALIDATOR ] MVO: Primary data validation passed. [2025-10-02T20:22:43.757255] [INFO ] [MAIN ] MVO: Fetched primary data is valid. [2025-10-02T20:22:43.757299] [DEBUG] [LOCAL ] MVO: Saving primary data. [2025-10-02T20:22:43.757969] [DEBUG] [LOCAL ] MVO: Trimmed 14387 records to 8973 (keeping 200 days of data) [2025-10-02T20:22:43.820355] [DEBUG] [LOCAL ] MVO: Primary data saved (8973 records). [2025-10-02T20:22:43.820491] [INFO ] [MAIN ] MVO: Full history saved. [2025-10-02T20:22:43.820575] [INFO ] [MAIN ] Update Progress: 1439/2370 symbols completed. MVO took 35.0s. Estimated remaining: 2h 11m 7s. Rate: 7.1 symbols/min [2025-10-02T20:22:45.300964] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-02T20:22:45.312310] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-02. [2025-10-02T20:22:46.854473] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-02T20:22:46.866748] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-03. [2025-10-02T20:22:48.786139] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-02T20:22:48.798051] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-04. [2025-10-02T20:22:50.562074] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-02T20:22:50.575315] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-05. [2025-10-02T20:23:06.903091] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-05 (16.33 seconds). [2025-10-02T20:23:06.913766] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-06. [2025-10-02T20:23:08.768235] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-02T20:23:08.781878] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-07. [2025-10-02T20:23:10.621198] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-02T20:23:10.632629] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-08. [2025-10-02T20:23:12.050108] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-02T20:23:12.060349] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-09. [2025-10-02T20:23:13.271844] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-02T20:23:13.282472] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-10. [2025-10-02T20:23:14.629302] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-02T20:23:14.631434] [INFO ] [REMOTE ] MWA: Full fetch complete (67714 records). [2025-10-02T20:23:14.631564] [DEBUG] [VALIDATOR ] MWA: Validating primary data. [2025-10-02T20:23:15.075405] [DEBUG] [VALIDATOR ] MWA: All expected trading days are present. [2025-10-02T20:23:15.075537] [DEBUG] [VALIDATOR ] MWA: Primary data validation passed. [2025-10-02T20:23:15.076534] [INFO ] [MAIN ] MWA: Fetched primary data is valid. [2025-10-02T20:23:15.076600] [DEBUG] [LOCAL ] MWA: Saving primary data. [2025-10-02T20:23:15.078042] [DEBUG] [LOCAL ] MWA: Trimmed 67714 records to 46871 (keeping 200 days of data) [2025-10-02T20:23:15.399937] [DEBUG] [LOCAL ] MWA: Primary data saved (46871 records). [2025-10-02T20:23:15.400083] [INFO ] [MAIN ] MWA: Full history saved. [2025-10-02T20:23:15.400193] [INFO ] [MAIN ] Update Progress: 1440/2370 symbols completed. MWA took 38.5s. Estimated remaining: 2h 11m 14s. Rate: 7.1 symbols/min [2025-10-02T20:23:16.154717] [INFO ] [MAIN ] MXE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:23:16.201724] [DEBUG] [LOCAL ] MXE: No existing data file found in primary storage. [2025-10-02T20:23:16.201601] [INFO ] [MAIN ] MX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:23:16.203676] [WARN ] [MAIN ] MXE: No existing data found, performing full refresh instead. [2025-10-02T20:23:16.255872] [DEBUG] [LOCAL ] MX: No existing data file found in primary storage. [2025-10-02T20:23:16.279499] [WARN ] [MAIN ] MX: No existing data found, performing full refresh instead. [2025-10-02T20:23:16.255785] [INFO ] [MAIN ] MXE: Wiping existing primary data before full refresh. [2025-10-02T20:23:16.283369] [INFO ] [MAIN ] MXF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:23:16.252454] [INFO ] [MAIN ] MYD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:23:16.283879] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-10-02T20:23:16.284073] [DEBUG] [LOCAL ] MXF: No existing data file found in primary storage. [2025-10-02T20:23:16.284203] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-10-02T20:23:16.283785] [INFO ] [MAIN ] MX: Wiping existing primary data before full refresh. [2025-10-02T20:23:16.284303] [WARN ] [MAIN ] MXF: No existing data found, performing full refresh instead. [2025-10-02T20:23:16.284490] [INFO ] [MAIN ] MXE: Starting full primary refresh. [2025-10-02T20:23:16.289746] [INFO ] [LOCAL ] MX: Starting deletion of primary data. [2025-10-02T20:23:16.284381] [DEBUG] [LOCAL ] MYD: No existing data file found in primary storage. [2025-10-02T20:23:16.316713] [DEBUG] [LOCAL ] MX: No primary data file found to delete. [2025-10-02T20:23:16.327748] [INFO ] [MAIN ] MXF: Wiping existing primary data before full refresh. [2025-10-02T20:23:16.338255] [INFO ] [LOCAL ] MXF: Starting deletion of primary data. [2025-10-02T20:23:16.338341] [WARN ] [MAIN ] MYD: No existing data found, performing full refresh instead. [2025-10-02T20:23:16.354377] [INFO ] [MAIN ] MYD: Wiping existing primary data before full refresh. [2025-10-02T20:23:16.338712] [DEBUG] [LOCAL ] MXF: No primary data file found to delete. [2025-10-02T20:23:16.327856] [INFO ] [MAIN ] MX: Starting full primary refresh. [2025-10-02T20:23:16.364925] [INFO ] [LOCAL ] MYD: Starting deletion of primary data. [2025-10-02T20:23:16.385725] [INFO ] [MAIN ] MXF: Starting full primary refresh. [2025-10-02T20:23:16.436030] [DEBUG] [LOCAL ] MYD: No primary data file found to delete. [2025-10-02T20:23:16.524393] [INFO ] [MAIN ] MYD: Starting full primary refresh. [2025-10-02T20:23:17.558367] [INFO ] [REMOTE ] MXE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:23:17.658515] [INFO ] [REMOTE ] MXE: Fetching primary data for 2024-12. [2025-10-02T20:23:17.747118] [INFO ] [REMOTE ] MX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:23:17.772862] [INFO ] [REMOTE ] MX: Fetching primary data for 2024-12. [2025-10-02T20:23:17.848044] [INFO ] [REMOTE ] MXF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:23:17.860720] [INFO ] [REMOTE ] MXF: Fetching primary data for 2024-12. [2025-10-02T20:23:17.954750] [INFO ] [REMOTE ] MYD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:23:17.955118] [INFO ] [REMOTE ] MYD: Fetching primary data for 2024-12. [2025-10-02T20:23:18.433771] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-02T20:23:18.435112] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-01. [2025-10-02T20:23:18.877240] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-02T20:23:18.880390] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-01. [2025-10-02T20:23:19.046171] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-02T20:23:19.047685] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-02. [2025-10-02T20:23:19.270365] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-02T20:23:19.276228] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-01. [2025-10-02T20:23:19.312603] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-02T20:23:19.317545] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-01. [2025-10-02T20:23:19.454418] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-02T20:23:19.458002] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-02. [2025-10-02T20:23:19.694737] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-02T20:23:19.696001] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-03. [2025-10-02T20:23:20.121738] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-02T20:23:20.124447] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-03. [2025-10-02T20:23:20.141465] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-02T20:23:20.142775] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-04. [2025-10-02T20:23:20.305189] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-02T20:23:20.309564] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-02. [2025-10-02T20:23:20.333813] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-02T20:23:20.337856] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-02. [2025-10-02T20:23:20.710813] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-02T20:23:20.712020] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-05. [2025-10-02T20:23:20.814169] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-02T20:23:20.817866] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-04. [2025-10-02T20:23:21.270402] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-02T20:23:21.271485] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-06. [2025-10-02T20:23:21.372438] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-02T20:23:21.377826] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-03. [2025-10-02T20:23:21.414230] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-02T20:23:21.419068] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-03. [2025-10-02T20:23:21.502264] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-02T20:23:21.505299] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-05. [2025-10-02T20:23:21.875797] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-02T20:23:21.876923] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-07. [2025-10-02T20:23:22.410400] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-02T20:23:22.413091] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-06. [2025-10-02T20:23:22.471151] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-02T20:23:22.472587] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-08. [2025-10-02T20:23:22.605410] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-02T20:23:22.610119] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-04. [2025-10-02T20:23:22.803814] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-02T20:23:22.810215] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-04. [2025-10-02T20:23:22.853706] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-02T20:23:22.854907] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-09. [2025-10-02T20:23:22.895803] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-02T20:23:22.897828] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-07. [2025-10-02T20:23:23.377765] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-02T20:23:23.379436] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-10. [2025-10-02T20:23:23.630605] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-02T20:23:23.632583] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-08. [2025-10-02T20:23:23.747413] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-02T20:23:23.748264] [INFO ] [REMOTE ] MXE: Full fetch complete (2659 records). [2025-10-02T20:23:23.748340] [DEBUG] [VALIDATOR ] MXE: Validating primary data. [2025-10-02T20:23:23.922077] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-02T20:23:23.974562] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-05. [2025-10-02T20:23:23.974155] [WARN ] [VALIDATOR ] MXE: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-02T20:23:23.974941] [FATAL] [MAIN ] MXE: Fetched primary data is invalid. Refusing to save it. [2025-10-02T20:23:23.976047] [WARN ] [MAIN ] MXE: Deleting existing primary and derivative data due to validation failure. [2025-10-02T20:23:23.990252] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-10-02T20:23:23.991761] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-02T20:23:23.991905] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-10-02T20:23:23.997394] [INFO ] [LOCAL ] MXE: Starting deletion of derivative data. [2025-10-02T20:23:23.998202] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-05. [2025-10-02T20:23:23.998304] [DEBUG] [LOCAL ] MXE: No derivative data file found to delete. [2025-10-02T20:23:23.998446] [INFO ] [MAIN ] Update Progress: 1441/2370 symbols completed. MXE took 8.6s. Estimated remaining: 2h 11m 5s. Rate: 7.1 symbols/min [2025-10-02T20:23:24.126823] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-02T20:23:24.139491] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-09. [2025-10-02T20:23:24.214902] [INFO ] [MAIN ] MYE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:23:24.215097] [DEBUG] [LOCAL ] MYE: No existing data file found in primary storage. [2025-10-02T20:23:24.215159] [WARN ] [MAIN ] MYE: No existing data found, performing full refresh instead. [2025-10-02T20:23:24.215305] [INFO ] [MAIN ] MYE: Wiping existing primary data before full refresh. [2025-10-02T20:23:24.215371] [INFO ] [LOCAL ] MYE: Starting deletion of primary data. [2025-10-02T20:23:24.215443] [DEBUG] [LOCAL ] MYE: No primary data file found to delete. [2025-10-02T20:23:24.215515] [INFO ] [MAIN ] MYE: Starting full primary refresh. [2025-10-02T20:23:24.625146] [INFO ] [REMOTE ] MYE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:23:24.625475] [INFO ] [REMOTE ] MYE: Fetching primary data for 2024-12. [2025-10-02T20:23:24.737915] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-02T20:23:24.742175] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-06. [2025-10-02T20:23:24.802751] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-02T20:23:24.804128] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-10. [2025-10-02T20:23:25.173352] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-02T20:23:25.181080] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-06. [2025-10-02T20:23:25.256313] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-02T20:23:25.257167] [INFO ] [REMOTE ] MXF: Full fetch complete (10245 records). [2025-10-02T20:23:25.257264] [DEBUG] [VALIDATOR ] MXF: Validating primary data. [2025-10-02T20:23:25.547452] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-02T20:23:25.594675] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-07. [2025-10-02T20:23:25.695279] [DEBUG] [VALIDATOR ] MXF: All expected trading days are present. [2025-10-02T20:23:25.695425] [DEBUG] [VALIDATOR ] MXF: Primary data validation passed. [2025-10-02T20:23:25.695766] [INFO ] [MAIN ] MXF: Fetched primary data is valid. [2025-10-02T20:23:25.695852] [DEBUG] [LOCAL ] MXF: Saving primary data. [2025-10-02T20:23:25.697001] [DEBUG] [LOCAL ] MXF: Trimmed 10245 records to 5795 (keeping 200 days of data) [2025-10-02T20:23:25.736358] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-02T20:23:25.751564] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-01. [2025-10-02T20:23:25.764416] [DEBUG] [LOCAL ] MXF: Primary data saved (5795 records). [2025-10-02T20:23:25.764558] [INFO ] [MAIN ] MXF: Full history saved. [2025-10-02T20:23:25.764639] [INFO ] [MAIN ] Update Progress: 1442/2370 symbols completed. MXF took 10.3s. Estimated remaining: 2h 10m 53s. Rate: 7.1 symbols/min [2025-10-02T20:23:25.965406] [INFO ] [MAIN ] MYI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:23:25.965675] [DEBUG] [LOCAL ] MYI: No existing data file found in primary storage. [2025-10-02T20:23:25.965738] [WARN ] [MAIN ] MYI: No existing data found, performing full refresh instead. [2025-10-02T20:23:25.965895] [INFO ] [MAIN ] MYI: Wiping existing primary data before full refresh. [2025-10-02T20:23:25.965947] [INFO ] [LOCAL ] MYI: Starting deletion of primary data. [2025-10-02T20:23:25.965992] [DEBUG] [LOCAL ] MYI: No primary data file found to delete. [2025-10-02T20:23:25.966028] [INFO ] [MAIN ] MYI: Starting full primary refresh. [2025-10-02T20:23:26.342716] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-02T20:23:26.407985] [INFO ] [REMOTE ] MYI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:23:26.409002] [INFO ] [REMOTE ] MYI: Fetching primary data for 2024-12. [2025-10-02T20:23:26.408565] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-07. [2025-10-02T20:23:26.545636] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-02T20:23:26.549288] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-08. [2025-10-02T20:23:26.707464] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-02T20:23:26.714177] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-02. [2025-10-02T20:23:27.230412] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-02T20:23:27.233401] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-09. [2025-10-02T20:23:27.370627] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-02T20:23:27.376585] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-01. [2025-10-02T20:23:27.460788] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-02T20:23:27.472959] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-08. [2025-10-02T20:23:27.620790] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-02T20:23:27.827993] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-02T20:23:28.273054] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-03. [2025-10-02T20:23:28.469367] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-02T20:23:29.037844] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-02T20:23:29.073027] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-09. [2025-10-02T20:23:29.457616] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-02T20:23:29.873019] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-04. [2025-10-02T20:23:30.377158] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-02T20:23:30.673048] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-10. [2025-10-02T20:23:31.013408] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-02T20:23:31.331672] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-02T20:23:31.332767] [INFO ] [REMOTE ] MYD: Full fetch complete (20761 records). [2025-10-02T20:23:31.332848] [DEBUG] [VALIDATOR ] MYD: Validating primary data. [2025-10-02T20:23:31.478129] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-10. [2025-10-02T20:23:31.786040] [DEBUG] [VALIDATOR ] MYD: All expected trading days are present. [2025-10-02T20:23:31.786154] [DEBUG] [VALIDATOR ] MYD: Primary data validation passed. [2025-10-02T20:23:31.786712] [INFO ] [MAIN ] MYD: Fetched primary data is valid. [2025-10-02T20:23:31.786780] [DEBUG] [LOCAL ] MYD: Saving primary data. [2025-10-02T20:23:31.787697] [DEBUG] [LOCAL ] MYD: Trimmed 20761 records to 13825 (keeping 200 days of data) [2025-10-02T20:23:31.877424] [DEBUG] [LOCAL ] MYD: Primary data saved (13825 records). [2025-10-02T20:23:31.877575] [INFO ] [MAIN ] MYD: Full history saved. [2025-10-02T20:23:31.877677] [INFO ] [MAIN ] Update Progress: 1443/2370 symbols completed. MYD took 16.5s. Estimated remaining: 2h 10m 43s. Rate: 7.1 symbols/min [2025-10-02T20:23:32.075369] [INFO ] [MAIN ] MYN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:23:32.075558] [DEBUG] [LOCAL ] MYN: No existing data file found in primary storage. [2025-10-02T20:23:32.075598] [WARN ] [MAIN ] MYN: No existing data found, performing full refresh instead. [2025-10-02T20:23:32.075736] [INFO ] [MAIN ] MYN: Wiping existing primary data before full refresh. [2025-10-02T20:23:32.075783] [INFO ] [LOCAL ] MYN: Starting deletion of primary data. [2025-10-02T20:23:32.075826] [DEBUG] [LOCAL ] MYN: No primary data file found to delete. [2025-10-02T20:23:32.075861] [INFO ] [MAIN ] MYN: Starting full primary refresh. [2025-10-02T20:23:32.280408] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-05. [2025-10-02T20:23:32.420987] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-02T20:23:32.450360] [INFO ] [REMOTE ] MX: Full fetch complete (31820 records). [2025-10-02T20:23:32.456341] [DEBUG] [VALIDATOR ] MX: Validating primary data. [2025-10-02T20:23:32.571452] [INFO ] [REMOTE ] MYN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:23:32.923669] [DEBUG] [VALIDATOR ] MX: All expected trading days are present. [2025-10-02T20:23:32.923767] [DEBUG] [VALIDATOR ] MX: Primary data validation passed. [2025-10-02T20:23:32.924501] [INFO ] [MAIN ] MX: Fetched primary data is valid. [2025-10-02T20:23:32.924566] [DEBUG] [LOCAL ] MX: Saving primary data. [2025-10-02T20:23:32.925903] [DEBUG] [LOCAL ] MX: Trimmed 31820 records to 22864 (keeping 200 days of data) [2025-10-02T20:23:33.073684] [INFO ] [REMOTE ] MYN: Fetching primary data for 2024-12. [2025-10-02T20:23:33.085528] [DEBUG] [LOCAL ] MX: Primary data saved (22864 records). [2025-10-02T20:23:33.085636] [INFO ] [MAIN ] MX: Full history saved. [2025-10-02T20:23:33.085759] [INFO ] [MAIN ] Update Progress: 1444/2370 symbols completed. MX took 17.7s. Estimated remaining: 2h 10m 29s. Rate: 7.1 symbols/min [2025-10-02T20:23:33.302621] [INFO ] [MAIN ] NABL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:23:33.302823] [DEBUG] [LOCAL ] NABL: No existing data file found in primary storage. [2025-10-02T20:23:33.302875] [WARN ] [MAIN ] NABL: No existing data found, performing full refresh instead. [2025-10-02T20:23:33.302996] [INFO ] [MAIN ] NABL: Wiping existing primary data before full refresh. [2025-10-02T20:23:33.303040] [INFO ] [LOCAL ] NABL: Starting deletion of primary data. [2025-10-02T20:23:33.303087] [DEBUG] [LOCAL ] NABL: No primary data file found to delete. [2025-10-02T20:23:33.303121] [INFO ] [MAIN ] NABL: Starting full primary refresh. [2025-10-02T20:23:33.714827] [INFO ] [REMOTE ] NABL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:23:33.743757] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-02T20:23:33.873007] [INFO ] [REMOTE ] NABL: Fetching primary data for 2024-12. [2025-10-02T20:23:34.046474] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-02T20:23:34.673006] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-06. [2025-10-02T20:23:35.336671] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-02T20:23:35.473060] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-02. [2025-10-02T20:23:36.004299] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-02T20:23:36.273040] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-01. [2025-10-02T20:23:36.676631] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-02T20:23:37.073215] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-07. [2025-10-02T20:23:37.435307] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-02T20:23:37.873052] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-02. [2025-10-02T20:23:37.959636] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-02T20:23:38.673057] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-08. [2025-10-02T20:23:39.473060] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-01. [2025-10-02T20:23:39.534553] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-02T20:23:39.891339] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-02T20:23:40.273067] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-03. [2025-10-02T20:23:40.458069] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-02T20:23:41.073058] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-03. [2025-10-02T20:23:41.873046] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-02. [2025-10-02T20:23:42.041769] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-02T20:23:42.290836] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-02T20:23:42.672981] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-04. [2025-10-02T20:23:42.722511] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-02T20:23:43.473046] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-04. [2025-10-02T20:23:44.077788] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-02T20:23:44.273040] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-09. [2025-10-02T20:23:44.888635] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-02T20:23:45.073018] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-03. [2025-10-02T20:23:45.664315] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-02T20:23:45.873056] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-10. [2025-10-02T20:23:45.977755] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-02T20:23:46.673069] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-05. [2025-10-02T20:23:46.786586] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-02T20:23:46.788185] [INFO ] [REMOTE ] MYE: Full fetch complete (36490 records). [2025-10-02T20:23:46.788324] [DEBUG] [VALIDATOR ] MYE: Validating primary data. [2025-10-02T20:23:47.228426] [DEBUG] [VALIDATOR ] MYE: All expected trading days are present. [2025-10-02T20:23:47.228520] [DEBUG] [VALIDATOR ] MYE: Primary data validation passed. [2025-10-02T20:23:47.229276] [INFO ] [MAIN ] MYE: Fetched primary data is valid. [2025-10-02T20:23:47.229345] [DEBUG] [LOCAL ] MYE: Saving primary data. [2025-10-02T20:23:47.230390] [DEBUG] [LOCAL ] MYE: Trimmed 36490 records to 24709 (keeping 200 days of data) [2025-10-02T20:23:47.397991] [DEBUG] [LOCAL ] MYE: Primary data saved (24709 records). [2025-10-02T20:23:47.398157] [INFO ] [MAIN ] MYE: Full history saved. [2025-10-02T20:23:47.398266] [INFO ] [MAIN ] Update Progress: 1445/2370 symbols completed. MYE took 23.4s. Estimated remaining: 2h 10m 25s. Rate: 7.1 symbols/min [2025-10-02T20:23:47.473581] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-04. [2025-10-02T20:23:47.611165] [INFO ] [MAIN ] NAC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:23:47.611521] [DEBUG] [LOCAL ] NAC: No existing data file found in primary storage. [2025-10-02T20:23:47.611582] [WARN ] [MAIN ] NAC: No existing data found, performing full refresh instead. [2025-10-02T20:23:47.611727] [INFO ] [MAIN ] NAC: Wiping existing primary data before full refresh. [2025-10-02T20:23:47.611777] [INFO ] [LOCAL ] NAC: Starting deletion of primary data. [2025-10-02T20:23:47.611823] [DEBUG] [LOCAL ] NAC: No primary data file found to delete. [2025-10-02T20:23:47.611859] [INFO ] [MAIN ] NAC: Starting full primary refresh. [2025-10-02T20:23:47.803179] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-02T20:23:48.050179] [INFO ] [REMOTE ] NAC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:23:48.273041] [INFO ] [REMOTE ] NAC: Fetching primary data for 2024-12. [2025-10-02T20:23:48.360338] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-02T20:23:49.073008] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-06. [2025-10-02T20:23:49.713057] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-02T20:23:49.873044] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-01. [2025-10-02T20:23:50.257076] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-02T20:23:50.673044] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-05. [2025-10-02T20:23:51.081433] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-02T20:23:51.473059] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-07. [2025-10-02T20:23:52.273040] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-02. [2025-10-02T20:23:52.328610] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-02T20:23:52.524267] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-02T20:23:53.073007] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-05. [2025-10-02T20:23:53.364123] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-02T20:23:53.792349] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-02T20:23:53.872992] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-06. [2025-10-02T20:23:54.673062] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-08. [2025-10-02T20:23:54.766694] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-02T20:23:55.473010] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-03. [2025-10-02T20:23:55.877307] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-02T20:23:56.273061] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-09. [2025-10-02T20:23:56.711948] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-02T20:23:57.072985] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-04. [2025-10-02T20:23:57.466613] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-02T20:23:57.873069] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-10. [2025-10-02T20:23:58.502027] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-02T20:23:58.673015] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-06. [2025-10-02T20:23:58.688187] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-02T20:23:58.689529] [INFO ] [REMOTE ] MYI: Full fetch complete (29404 records). [2025-10-02T20:23:58.689680] [DEBUG] [VALIDATOR ] MYI: Validating primary data. [2025-10-02T20:23:59.132346] [DEBUG] [VALIDATOR ] MYI: All expected trading days are present. [2025-10-02T20:23:59.132475] [DEBUG] [VALIDATOR ] MYI: Primary data validation passed. [2025-10-02T20:23:59.133237] [INFO ] [MAIN ] MYI: Fetched primary data is valid. [2025-10-02T20:23:59.133305] [DEBUG] [LOCAL ] MYI: Saving primary data. [2025-10-02T20:23:59.134274] [DEBUG] [LOCAL ] MYI: Trimmed 29404 records to 19536 (keeping 200 days of data) [2025-10-02T20:23:59.269053] [DEBUG] [LOCAL ] MYI: Primary data saved (19536 records). [2025-10-02T20:23:59.269210] [INFO ] [MAIN ] MYI: Full history saved. [2025-10-02T20:23:59.269291] [INFO ] [MAIN ] Update Progress: 1446/2370 symbols completed. MYI took 33.5s. Estimated remaining: 2h 10m 19s. Rate: 7.1 symbols/min [2025-10-02T20:23:59.456362] [INFO ] [MAIN ] NAD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:23:59.456536] [DEBUG] [LOCAL ] NAD: No existing data file found in primary storage. [2025-10-02T20:23:59.456575] [WARN ] [MAIN ] NAD: No existing data found, performing full refresh instead. [2025-10-02T20:23:59.456721] [INFO ] [MAIN ] NAD: Wiping existing primary data before full refresh. [2025-10-02T20:23:59.456782] [INFO ] [LOCAL ] NAD: Starting deletion of primary data. [2025-10-02T20:23:59.456835] [DEBUG] [LOCAL ] NAD: No primary data file found to delete. [2025-10-02T20:23:59.456872] [INFO ] [MAIN ] NAD: Starting full primary refresh. [2025-10-02T20:23:59.479470] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-05. [2025-10-02T20:23:59.873340] [INFO ] [REMOTE ] NAD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:24:00.185452] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-02T20:24:00.273031] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-07. [2025-10-02T20:24:01.073044] [INFO ] [REMOTE ] NAD: Fetching primary data for 2024-12. [2025-10-02T20:24:01.102264] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-02T20:24:01.873019] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-06. [2025-10-02T20:24:01.912805] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-02T20:24:02.445764] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-02T20:24:02.673051] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-07. [2025-10-02T20:24:03.193530] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-02T20:24:03.473028] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-07. [2025-10-02T20:24:03.589897] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-02T20:24:04.273019] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-08. [2025-10-02T20:24:04.492561] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-02T20:24:05.073005] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-08. [2025-10-02T20:24:05.705599] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-02T20:24:05.777530] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-02T20:24:05.873011] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-01. [2025-10-02T20:24:06.673006] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-09. [2025-10-02T20:24:07.435718] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-02T20:24:07.473028] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-09. [2025-10-02T20:24:07.541066] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-02T20:24:08.272999] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-08. [2025-10-02T20:24:08.996929] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-02T20:24:09.073030] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-02. [2025-10-02T20:24:09.466438] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-02T20:24:09.873037] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-09. [2025-10-02T20:24:10.089763] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-02T20:24:10.673006] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-10. [2025-10-02T20:24:10.925718] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-02T20:24:11.472986] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-10. [2025-10-02T20:24:11.913155] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-02T20:24:11.915087] [INFO ] [REMOTE ] NABL: Full fetch complete (56777 records). [2025-10-02T20:24:11.915202] [DEBUG] [VALIDATOR ] NABL: Validating primary data. [2025-10-02T20:24:12.285064] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-03. [2025-10-02T20:24:12.362905] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-02T20:24:12.363349] [DEBUG] [VALIDATOR ] NABL: All expected trading days are present. [2025-10-02T20:24:12.364546] [INFO ] [REMOTE ] MYN: Full fetch complete (15448 records). [2025-10-02T20:24:12.364664] [DEBUG] [VALIDATOR ] MYN: Validating primary data. [2025-10-02T20:24:12.364469] [DEBUG] [VALIDATOR ] NABL: Primary data validation passed. [2025-10-02T20:24:12.366138] [INFO ] [MAIN ] NABL: Fetched primary data is valid. [2025-10-02T20:24:12.395290] [DEBUG] [LOCAL ] NABL: Saving primary data. [2025-10-02T20:24:12.504060] [DEBUG] [LOCAL ] NABL: Trimmed 56777 records to 39614 (keeping 200 days of data) [2025-10-02T20:24:12.941047] [DEBUG] [VALIDATOR ] MYN: All expected trading days are present. [2025-10-02T20:24:12.941408] [DEBUG] [VALIDATOR ] MYN: Primary data validation passed. [2025-10-02T20:24:12.941852] [INFO ] [MAIN ] MYN: Fetched primary data is valid. [2025-10-02T20:24:12.941930] [DEBUG] [LOCAL ] MYN: Saving primary data. [2025-10-02T20:24:12.944950] [DEBUG] [LOCAL ] MYN: Trimmed 15448 records to 10046 (keeping 200 days of data) [2025-10-02T20:24:13.083372] [DEBUG] [LOCAL ] MYN: Primary data saved (10046 records). [2025-10-02T20:24:13.083204] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-10. [2025-10-02T20:24:13.093604] [INFO ] [MAIN ] MYN: Full history saved. [2025-10-02T20:24:13.094115] [INFO ] [MAIN ] Update Progress: 1447/2370 symbols completed. MYN took 41.2s. Estimated remaining: 2h 10m 13s. Rate: 7.1 symbols/min [2025-10-02T20:24:13.338476] [INFO ] [MAIN ] NAN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:24:13.340561] [DEBUG] [LOCAL ] NAN: No existing data file found in primary storage. [2025-10-02T20:24:13.340622] [WARN ] [MAIN ] NAN: No existing data found, performing full refresh instead. [2025-10-02T20:24:13.342280] [INFO ] [MAIN ] NAN: Wiping existing primary data before full refresh. [2025-10-02T20:24:13.342369] [INFO ] [LOCAL ] NAN: Starting deletion of primary data. [2025-10-02T20:24:13.342435] [DEBUG] [LOCAL ] NAN: No primary data file found to delete. [2025-10-02T20:24:13.342477] [INFO ] [MAIN ] NAN: Starting full primary refresh. [2025-10-02T20:24:13.799008] [INFO ] [REMOTE ] NAN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:24:13.824940] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-02T20:24:13.825051] [DEBUG] [LOCAL ] NABL: Primary data saved (39614 records). [2025-10-02T20:24:13.832226] [INFO ] [MAIN ] NABL: Full history saved. [2025-10-02T20:24:13.832493] [INFO ] [MAIN ] Update Progress: 1448/2370 symbols completed. NABL took 40.7s. Estimated remaining: 2h 10m 0s. Rate: 7.1 symbols/min [2025-10-02T20:24:13.878538] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-04. [2025-10-02T20:24:14.020695] [INFO ] [MAIN ] NAT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:24:14.020907] [DEBUG] [LOCAL ] NAT: No existing data file found in primary storage. [2025-10-02T20:24:14.020963] [WARN ] [MAIN ] NAT: No existing data found, performing full refresh instead. [2025-10-02T20:24:14.021081] [INFO ] [MAIN ] NAT: Wiping existing primary data before full refresh. [2025-10-02T20:24:14.021123] [INFO ] [LOCAL ] NAT: Starting deletion of primary data. [2025-10-02T20:24:14.021166] [DEBUG] [LOCAL ] NAT: No primary data file found to delete. [2025-10-02T20:24:14.021198] [INFO ] [MAIN ] NAT: Starting full primary refresh. [2025-10-02T20:24:14.204080] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-02T20:24:14.282250] [INFO ] [REMOTE ] NAC: Full fetch complete (36282 records). [2025-10-02T20:24:14.319253] [DEBUG] [VALIDATOR ] NAC: Validating primary data. [2025-10-02T20:24:14.573461] [INFO ] [REMOTE ] NAT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:24:14.683415] [INFO ] [REMOTE ] NAT: Fetching primary data for 2024-12. [2025-10-02T20:24:14.879217] [DEBUG] [VALIDATOR ] NAC: All expected trading days are present. [2025-10-02T20:24:14.879305] [DEBUG] [VALIDATOR ] NAC: Primary data validation passed. [2025-10-02T20:24:14.880106] [INFO ] [MAIN ] NAC: Fetched primary data is valid. [2025-10-02T20:24:14.880171] [DEBUG] [LOCAL ] NAC: Saving primary data. [2025-10-02T20:24:14.881242] [DEBUG] [LOCAL ] NAC: Trimmed 36282 records to 25056 (keeping 200 days of data) [2025-10-02T20:24:15.049156] [DEBUG] [LOCAL ] NAC: Primary data saved (25056 records). [2025-10-02T20:24:15.049321] [INFO ] [MAIN ] NAC: Full history saved. [2025-10-02T20:24:15.049435] [INFO ] [MAIN ] Update Progress: 1449/2370 symbols completed. NAC took 27.7s. Estimated remaining: 2h 9m 47s. Rate: 7.1 symbols/min [2025-10-02T20:24:15.239607] [INFO ] [MAIN ] NATL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:24:15.239806] [DEBUG] [LOCAL ] NATL: No existing data file found in primary storage. [2025-10-02T20:24:15.239852] [WARN ] [MAIN ] NATL: No existing data found, performing full refresh instead. [2025-10-02T20:24:15.239968] [INFO ] [MAIN ] NATL: Wiping existing primary data before full refresh. [2025-10-02T20:24:15.240035] [INFO ] [LOCAL ] NATL: Starting deletion of primary data. [2025-10-02T20:24:15.240121] [DEBUG] [LOCAL ] NATL: No primary data file found to delete. [2025-10-02T20:24:15.240185] [INFO ] [MAIN ] NATL: Starting full primary refresh. [2025-10-02T20:24:15.475934] [INFO ] [REMOTE ] NAN: Fetching primary data for 2024-12. [2025-10-02T20:24:15.630173] [INFO ] [REMOTE ] NATL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:24:15.654484] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-02T20:24:16.272955] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-05. [2025-10-02T20:24:16.450067] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-02T20:24:16.469166] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-02T20:24:17.073048] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-01. [2025-10-02T20:24:17.666366] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-02T20:24:17.873033] [INFO ] [REMOTE ] NATL: Fetching primary data for 2024-12. [2025-10-02T20:24:18.673007] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-01. [2025-10-02T20:24:18.791610] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-02T20:24:19.473026] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-02. [2025-10-02T20:24:19.488005] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-02T20:24:19.510717] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-02T20:24:20.273053] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-02. [2025-10-02T20:24:21.073024] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-06. [2025-10-02T20:24:21.207929] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-02T20:24:21.321423] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-02T20:24:21.873013] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-01. [2025-10-02T20:24:22.106629] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-02T20:24:22.673035] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-07. [2025-10-02T20:24:23.227368] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-02T20:24:23.473049] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-03. [2025-10-02T20:24:24.274962] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-03. [2025-10-02T20:24:24.280086] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-02T20:24:25.019335] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-02T20:24:25.073026] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-04. [2025-10-02T20:24:25.282763] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-02T20:24:25.718433] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-02T20:24:25.873004] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-02. [2025-10-02T20:24:26.673137] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-08. [2025-10-02T20:24:27.100932] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-02T20:24:27.473026] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-04. [2025-10-02T20:24:28.088503] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-02T20:24:28.273040] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-09. [2025-10-02T20:24:29.072990] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-05. [2025-10-02T20:24:29.309778] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-02T20:24:29.699558] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-02T20:24:29.714950] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-02T20:24:29.873011] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-05. [2025-10-02T20:24:30.673012] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-03. [2025-10-02T20:24:31.380481] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-02T20:24:31.473010] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-06. [2025-10-02T20:24:32.098565] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-02T20:24:32.101415] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-02T20:24:32.273059] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-06. [2025-10-02T20:24:33.073062] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-07. [2025-10-02T20:24:33.740605] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-02T20:24:33.873019] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-10. [2025-10-02T20:24:33.956631] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-02T20:24:34.673006] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-08. [2025-10-02T20:24:34.743367] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-02T20:24:34.745088] [INFO ] [REMOTE ] NAD: Full fetch complete (49857 records). [2025-10-02T20:24:34.745207] [DEBUG] [VALIDATOR ] NAD: Validating primary data. [2025-10-02T20:24:35.160630] [DEBUG] [VALIDATOR ] NAD: All expected trading days are present. [2025-10-02T20:24:35.160741] [DEBUG] [VALIDATOR ] NAD: Primary data validation passed. [2025-10-02T20:24:35.161586] [INFO ] [MAIN ] NAD: Fetched primary data is valid. [2025-10-02T20:24:35.161671] [DEBUG] [LOCAL ] NAD: Saving primary data. [2025-10-02T20:24:35.162725] [DEBUG] [LOCAL ] NAD: Trimmed 49857 records to 34199 (keeping 200 days of data) [2025-10-02T20:24:35.404435] [DEBUG] [LOCAL ] NAD: Primary data saved (34199 records). [2025-10-02T20:24:35.404614] [INFO ] [MAIN ] NAD: Full history saved. [2025-10-02T20:24:35.404739] [INFO ] [MAIN ] Update Progress: 1450/2370 symbols completed. NAD took 36.1s. Estimated remaining: 2h 9m 46s. Rate: 7.1 symbols/min [2025-10-02T20:24:35.478366] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-07. [2025-10-02T20:24:35.603909] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-02T20:24:35.607345] [INFO ] [MAIN ] NAZ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:24:35.610521] [DEBUG] [LOCAL ] NAZ: No existing data file found in primary storage. [2025-10-02T20:24:35.610619] [WARN ] [MAIN ] NAZ: No existing data found, performing full refresh instead. [2025-10-02T20:24:35.610770] [INFO ] [MAIN ] NAZ: Wiping existing primary data before full refresh. [2025-10-02T20:24:35.610814] [INFO ] [LOCAL ] NAZ: Starting deletion of primary data. [2025-10-02T20:24:35.610857] [DEBUG] [LOCAL ] NAZ: No primary data file found to delete. [2025-10-02T20:24:35.610946] [INFO ] [MAIN ] NAZ: Starting full primary refresh. [2025-10-02T20:24:36.001182] [INFO ] [REMOTE ] NAZ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:24:36.273039] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-09. [2025-10-02T20:24:37.073001] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-04. [2025-10-02T20:24:37.108708] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-02T20:24:37.531041] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-02T20:24:37.873092] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-10. [2025-10-02T20:24:38.385199] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-02T20:24:38.386980] [INFO ] [REMOTE ] NAN: Full fetch complete (13845 records). [2025-10-02T20:24:38.387058] [DEBUG] [VALIDATOR ] NAN: Validating primary data. [2025-10-02T20:24:38.678087] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2024-12. [2025-10-02T20:24:38.777905] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-02T20:24:38.831267] [DEBUG] [VALIDATOR ] NAN: All expected trading days are present. [2025-10-02T20:24:38.831712] [DEBUG] [VALIDATOR ] NAN: Primary data validation passed. [2025-10-02T20:24:38.832147] [INFO ] [MAIN ] NAN: Fetched primary data is valid. [2025-10-02T20:24:38.832230] [DEBUG] [LOCAL ] NAN: Saving primary data. [2025-10-02T20:24:38.832994] [DEBUG] [LOCAL ] NAN: Trimmed 13845 records to 8900 (keeping 200 days of data) [2025-10-02T20:24:38.910403] [DEBUG] [LOCAL ] NAN: Primary data saved (8900 records). [2025-10-02T20:24:38.910556] [INFO ] [MAIN ] NAN: Full history saved. [2025-10-02T20:24:38.910676] [INFO ] [MAIN ] Update Progress: 1451/2370 symbols completed. NAN took 25.8s. Estimated remaining: 2h 9m 35s. Rate: 7.1 symbols/min [2025-10-02T20:24:39.139822] [INFO ] [MAIN ] NBB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:24:39.139989] [DEBUG] [LOCAL ] NBB: No existing data file found in primary storage. [2025-10-02T20:24:39.140026] [WARN ] [MAIN ] NBB: No existing data found, performing full refresh instead. [2025-10-02T20:24:39.140137] [INFO ] [MAIN ] NBB: Wiping existing primary data before full refresh. [2025-10-02T20:24:39.140253] [INFO ] [LOCAL ] NBB: Starting deletion of primary data. [2025-10-02T20:24:39.140318] [DEBUG] [LOCAL ] NBB: No primary data file found to delete. [2025-10-02T20:24:39.140353] [INFO ] [MAIN ] NBB: Starting full primary refresh. [2025-10-02T20:24:39.480756] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-08. [2025-10-02T20:24:39.526991] [INFO ] [REMOTE ] NBB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:24:39.533519] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-02T20:24:40.273156] [INFO ] [REMOTE ] NBB: Fetching primary data for 2024-12. [2025-10-02T20:24:41.073069] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-05. [2025-10-02T20:24:41.386477] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-02T20:24:41.388740] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-02T20:24:41.873019] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-09. [2025-10-02T20:24:42.145985] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-02T20:24:42.673019] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-06. [2025-10-02T20:24:43.399733] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-02T20:24:43.473010] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-01. [2025-10-02T20:24:43.974016] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-02T20:24:44.273025] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-07. [2025-10-02T20:24:44.369579] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-02T20:24:45.073006] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-10. [2025-10-02T20:24:45.741497] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-02T20:24:45.873005] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-08. [2025-10-02T20:24:45.980733] [DEBUG] [REMOTE ] NATL: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-10-02T20:24:45.981122] [WARN ] [REMOTE ] NATL: No data returned for month 2025-08 [2025-10-02T20:24:45.981220] [FATAL] [REMOTE ] NATL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T20:24:45.981328] [FATAL] [MAIN ] NATL: Failed to fetch primary data. [2025-10-02T20:24:45.981399] [WARN ] [MAIN ] NATL: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T20:24:45.981481] [INFO ] [LOCAL ] NATL: Starting deletion of primary data. [2025-10-02T20:24:45.981566] [DEBUG] [LOCAL ] NATL: No primary data file found to delete. [2025-10-02T20:24:45.981626] [INFO ] [LOCAL ] NATL: Starting deletion of derivative data. [2025-10-02T20:24:45.981732] [DEBUG] [LOCAL ] NATL: No derivative data file found to delete. [2025-10-02T20:24:45.981827] [INFO ] [MAIN ] Update Progress: 1452/2370 symbols completed. NATL took 30.9s. Estimated remaining: 2h 9m 25s. Rate: 7.1 symbols/min [2025-10-02T20:24:46.167969] [INFO ] [MAIN ] NBHC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:24:46.168180] [DEBUG] [LOCAL ] NBHC: No existing data file found in primary storage. [2025-10-02T20:24:46.168264] [WARN ] [MAIN ] NBHC: No existing data found, performing full refresh instead. [2025-10-02T20:24:46.168411] [INFO ] [MAIN ] NBHC: Wiping existing primary data before full refresh. [2025-10-02T20:24:46.168471] [INFO ] [LOCAL ] NBHC: Starting deletion of primary data. [2025-10-02T20:24:46.168523] [DEBUG] [LOCAL ] NBHC: No primary data file found to delete. [2025-10-02T20:24:46.168559] [INFO ] [MAIN ] NBHC: Starting full primary refresh. [2025-10-02T20:24:46.281432] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-02T20:24:46.324161] [INFO ] [REMOTE ] NAT: Full fetch complete (72128 records). [2025-10-02T20:24:46.335694] [DEBUG] [VALIDATOR ] NAT: Validating primary data. [2025-10-02T20:24:46.675219] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-02. [2025-10-02T20:24:46.758118] [INFO ] [REMOTE ] NBHC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:24:47.017279] [DEBUG] [VALIDATOR ] NAT: All expected trading days are present. [2025-10-02T20:24:47.017398] [DEBUG] [VALIDATOR ] NAT: Primary data validation passed. [2025-10-02T20:24:47.018459] [INFO ] [MAIN ] NAT: Fetched primary data is valid. [2025-10-02T20:24:47.018541] [DEBUG] [LOCAL ] NAT: Saving primary data. [2025-10-02T20:24:47.020189] [DEBUG] [LOCAL ] NAT: Trimmed 72128 records to 49548 (keeping 200 days of data) [2025-10-02T20:24:47.353436] [DEBUG] [LOCAL ] NAT: Primary data saved (49548 records). [2025-10-02T20:24:47.353587] [INFO ] [MAIN ] NAT: Full history saved. [2025-10-02T20:24:47.353697] [INFO ] [MAIN ] Update Progress: 1453/2370 symbols completed. NAT took 33.5s. Estimated remaining: 2h 9m 12s. Rate: 7.1 symbols/min [2025-10-02T20:24:47.478136] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2024-12. [2025-10-02T20:24:47.548465] [INFO ] [MAIN ] NBR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:24:47.548970] [DEBUG] [LOCAL ] NBR: No existing data file found in primary storage. [2025-10-02T20:24:47.549026] [WARN ] [MAIN ] NBR: No existing data found, performing full refresh instead. [2025-10-02T20:24:47.549136] [INFO ] [MAIN ] NBR: Wiping existing primary data before full refresh. [2025-10-02T20:24:47.549179] [INFO ] [LOCAL ] NBR: Starting deletion of primary data. [2025-10-02T20:24:47.549267] [DEBUG] [LOCAL ] NBR: No primary data file found to delete. [2025-10-02T20:24:47.549308] [INFO ] [MAIN ] NBR: Starting full primary refresh. [2025-10-02T20:24:47.900394] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-02T20:24:47.986567] [INFO ] [REMOTE ] NBR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:24:48.273036] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-03. [2025-10-02T20:24:48.691493] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-02T20:24:49.072996] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-01. [2025-10-02T20:24:49.099268] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-02T20:24:49.729580] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-02T20:24:49.873012] [INFO ] [REMOTE ] NBR: Fetching primary data for 2024-12. [2025-10-02T20:24:50.672998] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-01. [2025-10-02T20:24:51.284187] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-02T20:24:51.472978] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-04. [2025-10-02T20:24:51.653953] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-02T20:24:52.272981] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-02. [2025-10-02T20:24:52.420855] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-02T20:24:52.748954] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-02T20:24:53.073004] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-05. [2025-10-02T20:24:53.873008] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-01. [2025-10-02T20:24:53.963933] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-02T20:24:54.673027] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-03. [2025-10-02T20:24:55.116625] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-02T20:24:55.358404] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-02T20:24:55.473005] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-02. [2025-10-02T20:24:56.273023] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-02. [2025-10-02T20:24:56.609887] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-02T20:24:57.073004] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-06. [2025-10-02T20:24:57.171675] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-02T20:24:57.872999] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-03. [2025-10-02T20:24:57.983901] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-02T20:24:58.672994] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-07. [2025-10-02T20:24:59.365460] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-02T20:24:59.447567] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-02T20:24:59.473021] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-08. [2025-10-02T20:25:00.273019] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-03. [2025-10-02T20:25:00.336136] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-02T20:25:01.073038] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-04. [2025-10-02T20:25:01.573316] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-02T20:25:01.628869] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-02T20:25:01.873042] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-09. [2025-10-02T20:25:02.673087] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-04. [2025-10-02T20:25:02.788022] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-02T20:25:03.473056] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-10. [2025-10-02T20:25:04.123454] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-02T20:25:04.124898] [INFO ] [REMOTE ] NBB: Full fetch complete (13884 records). [2025-10-02T20:25:04.124978] [DEBUG] [VALIDATOR ] NBB: Validating primary data. [2025-10-02T20:25:04.274948] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-02T20:25:04.273132] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-05. [2025-10-02T20:25:04.605418] [DEBUG] [VALIDATOR ] NBB: All expected trading days are present. [2025-10-02T20:25:04.605510] [DEBUG] [VALIDATOR ] NBB: Primary data validation passed. [2025-10-02T20:25:04.605965] [INFO ] [MAIN ] NBB: Fetched primary data is valid. [2025-10-02T20:25:04.606032] [DEBUG] [LOCAL ] NBB: Saving primary data. [2025-10-02T20:25:04.606794] [DEBUG] [LOCAL ] NBB: Trimmed 13884 records to 9149 (keeping 200 days of data) [2025-10-02T20:25:04.671632] [DEBUG] [LOCAL ] NBB: Primary data saved (9149 records). [2025-10-02T20:25:04.671811] [INFO ] [MAIN ] NBB: Full history saved. [2025-10-02T20:25:04.671916] [INFO ] [MAIN ] Update Progress: 1454/2370 symbols completed. NBB took 25.8s. Estimated remaining: 2h 9m 9s. Rate: 7.1 symbols/min [2025-10-02T20:25:04.870445] [INFO ] [MAIN ] NBXG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:25:04.866212] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-02T20:25:04.870788] [DEBUG] [LOCAL ] NBXG: No existing data file found in primary storage. [2025-10-02T20:25:04.872263] [WARN ] [MAIN ] NBXG: No existing data found, performing full refresh instead. [2025-10-02T20:25:04.872784] [INFO ] [MAIN ] NBXG: Wiping existing primary data before full refresh. [2025-10-02T20:25:04.872832] [INFO ] [LOCAL ] NBXG: Starting deletion of primary data. [2025-10-02T20:25:04.872876] [DEBUG] [LOCAL ] NBXG: No primary data file found to delete. [2025-10-02T20:25:04.872959] [INFO ] [MAIN ] NBXG: Starting full primary refresh. [2025-10-02T20:25:05.078964] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-05. [2025-10-02T20:25:05.271723] [INFO ] [REMOTE ] NBXG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:25:05.872975] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2024-12. [2025-10-02T20:25:06.672980] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-04. [2025-10-02T20:25:06.824013] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-02T20:25:07.129732] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-02T20:25:07.472995] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-01. [2025-10-02T20:25:07.972984] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-02T20:25:08.273022] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-05. [2025-10-02T20:25:08.594029] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-02T20:25:09.072966] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-02. [2025-10-02T20:25:09.480778] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-02T20:25:09.872983] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-06. [2025-10-02T20:25:10.327816] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-02T20:25:10.436771] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-02T20:25:10.672984] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-07. [2025-10-02T20:25:11.123239] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-02T20:25:11.473048] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-08. [2025-10-02T20:25:12.165811] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-02T20:25:12.273067] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-03. [2025-10-02T20:25:13.072998] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-06. [2025-10-02T20:25:13.148371] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-02T20:25:13.873031] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-09. [2025-10-02T20:25:14.301069] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-02T20:25:14.658586] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-02T20:25:14.672995] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-10. [2025-10-02T20:25:15.164078] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-02T20:25:15.164919] [INFO ] [REMOTE ] NAZ: Full fetch complete (4367 records). [2025-10-02T20:25:15.165003] [DEBUG] [VALIDATOR ] NAZ: Validating primary data. [2025-10-02T20:25:15.479011] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-04. [2025-10-02T20:25:15.566599] [DEBUG] [VALIDATOR ] NAZ: All expected trading days are present. [2025-10-02T20:25:15.566704] [DEBUG] [VALIDATOR ] NAZ: Primary data validation passed. [2025-10-02T20:25:15.566862] [INFO ] [MAIN ] NAZ: Fetched primary data is valid. [2025-10-02T20:25:15.566905] [DEBUG] [LOCAL ] NAZ: Saving primary data. [2025-10-02T20:25:15.567268] [DEBUG] [LOCAL ] NAZ: Trimmed 4367 records to 2658 (keeping 200 days of data) [2025-10-02T20:25:15.585597] [DEBUG] [LOCAL ] NAZ: Primary data saved (2658 records). [2025-10-02T20:25:15.585710] [INFO ] [MAIN ] NAZ: Full history saved. [2025-10-02T20:25:15.585804] [INFO ] [MAIN ] Update Progress: 1455/2370 symbols completed. NAZ took 40.2s. Estimated remaining: 2h 9m 2s. Rate: 7.1 symbols/min [2025-10-02T20:25:15.782834] [INFO ] [MAIN ] NC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:25:15.783278] [DEBUG] [LOCAL ] NC: No existing data file found in primary storage. [2025-10-02T20:25:15.783395] [WARN ] [MAIN ] NC: No existing data found, performing full refresh instead. [2025-10-02T20:25:15.783593] [INFO ] [MAIN ] NC: Wiping existing primary data before full refresh. [2025-10-02T20:25:15.783637] [INFO ] [LOCAL ] NC: Starting deletion of primary data. [2025-10-02T20:25:15.783765] [DEBUG] [LOCAL ] NC: No primary data file found to delete. [2025-10-02T20:25:15.783814] [INFO ] [MAIN ] NC: Starting full primary refresh. [2025-10-02T20:25:16.190188] [INFO ] [REMOTE ] NC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:25:16.273028] [INFO ] [REMOTE ] NC: Fetching primary data for 2024-12. [2025-10-02T20:25:16.852580] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-02T20:25:16.997432] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-02T20:25:17.073141] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-01. [2025-10-02T20:25:17.675814] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-02T20:25:17.873038] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-02. [2025-10-02T20:25:18.501634] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-02T20:25:18.673022] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-05. [2025-10-02T20:25:19.473042] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-07. [2025-10-02T20:25:19.916148] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-02T20:25:20.272993] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-06. [2025-10-02T20:25:20.704278] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-02T20:25:21.072997] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-08. [2025-10-02T20:25:21.747292] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-02T20:25:21.873036] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-06. [2025-10-02T20:25:22.296894] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-02T20:25:22.672966] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-09. [2025-10-02T20:25:23.072347] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-02T20:25:23.472967] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-07. [2025-10-02T20:25:23.868037] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-02T20:25:24.273011] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-07. [2025-10-02T20:25:25.063009] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-02T20:25:25.075724] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-10. [2025-10-02T20:25:25.454611] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-02T20:25:25.873024] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-08. [2025-10-02T20:25:25.905380] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-02T20:25:25.906850] [INFO ] [REMOTE ] NBHC: Full fetch complete (32284 records). [2025-10-02T20:25:25.906931] [DEBUG] [VALIDATOR ] NBHC: Validating primary data. [2025-10-02T20:25:26.350112] [DEBUG] [VALIDATOR ] NBHC: All expected trading days are present. [2025-10-02T20:25:26.350223] [DEBUG] [VALIDATOR ] NBHC: Primary data validation passed. [2025-10-02T20:25:26.351182] [INFO ] [MAIN ] NBHC: Fetched primary data is valid. [2025-10-02T20:25:26.351260] [DEBUG] [LOCAL ] NBHC: Saving primary data. [2025-10-02T20:25:26.352334] [DEBUG] [LOCAL ] NBHC: Trimmed 32284 records to 23469 (keeping 200 days of data) [2025-10-02T20:25:26.540835] [DEBUG] [LOCAL ] NBHC: Primary data saved (23469 records). [2025-10-02T20:25:26.540997] [INFO ] [MAIN ] NBHC: Full history saved. [2025-10-02T20:25:26.541113] [INFO ] [MAIN ] Update Progress: 1456/2370 symbols completed. NBHC took 40.6s. Estimated remaining: 2h 8m 56s. Rate: 7.1 symbols/min [2025-10-02T20:25:26.678493] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-08. [2025-10-02T20:25:26.809906] [INFO ] [MAIN ] NCA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:25:26.810088] [DEBUG] [LOCAL ] NCA: No existing data file found in primary storage. [2025-10-02T20:25:26.810127] [WARN ] [MAIN ] NCA: No existing data found, performing full refresh instead. [2025-10-02T20:25:26.810251] [INFO ] [MAIN ] NCA: Wiping existing primary data before full refresh. [2025-10-02T20:25:26.810294] [INFO ] [LOCAL ] NCA: Starting deletion of primary data. [2025-10-02T20:25:26.810339] [DEBUG] [LOCAL ] NCA: No primary data file found to delete. [2025-10-02T20:25:26.810398] [INFO ] [MAIN ] NCA: Starting full primary refresh. [2025-10-02T20:25:27.283555] [INFO ] [REMOTE ] NCA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:25:27.415841] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-02T20:25:27.472976] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-09. [2025-10-02T20:25:27.495360] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-02T20:25:28.273012] [INFO ] [REMOTE ] NCA: Fetching primary data for 2024-12. [2025-10-02T20:25:28.749131] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-02T20:25:29.072994] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-09. [2025-10-02T20:25:29.139426] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-02T20:25:29.835623] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-02T20:25:29.873051] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-03. [2025-10-02T20:25:30.426339] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-02T20:25:30.673042] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-04. [2025-10-02T20:25:31.463903] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-02T20:25:31.473000] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-10. [2025-10-02T20:25:32.273006] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-10. [2025-10-02T20:25:32.298804] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-02T20:25:32.300749] [INFO ] [REMOTE ] NBXG: Full fetch complete (33012 records). [2025-10-02T20:25:32.300842] [DEBUG] [VALIDATOR ] NBXG: Validating primary data. [2025-10-02T20:25:32.707353] [DEBUG] [VALIDATOR ] NBXG: All expected trading days are present. [2025-10-02T20:25:32.707506] [DEBUG] [VALIDATOR ] NBXG: Primary data validation passed. [2025-10-02T20:25:32.708841] [INFO ] [MAIN ] NBXG: Fetched primary data is valid. [2025-10-02T20:25:32.708929] [DEBUG] [LOCAL ] NBXG: Saving primary data. [2025-10-02T20:25:32.710188] [DEBUG] [LOCAL ] NBXG: Trimmed 33012 records to 22472 (keeping 200 days of data) [2025-10-02T20:25:32.886061] [DEBUG] [LOCAL ] NBXG: Primary data saved (22472 records). [2025-10-02T20:25:32.886190] [INFO ] [MAIN ] NBXG: Full history saved. [2025-10-02T20:25:32.886264] [INFO ] [MAIN ] Update Progress: 1457/2370 symbols completed. NBXG took 28.2s. Estimated remaining: 2h 8m 46s. Rate: 7.1 symbols/min [2025-10-02T20:25:33.073035] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-05. [2025-10-02T20:25:33.074135] [INFO ] [MAIN ] NCDL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:25:33.074402] [DEBUG] [LOCAL ] NCDL: No existing data file found in primary storage. [2025-10-02T20:25:33.075235] [WARN ] [MAIN ] NCDL: No existing data found, performing full refresh instead. [2025-10-02T20:25:33.075357] [INFO ] [MAIN ] NCDL: Wiping existing primary data before full refresh. [2025-10-02T20:25:33.075434] [INFO ] [LOCAL ] NCDL: Starting deletion of primary data. [2025-10-02T20:25:33.075499] [DEBUG] [LOCAL ] NCDL: No primary data file found to delete. [2025-10-02T20:25:33.075534] [INFO ] [MAIN ] NCDL: Starting full primary refresh. [2025-10-02T20:25:33.382740] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-02T20:25:33.384439] [INFO ] [REMOTE ] NBR: Full fetch complete (49568 records). [2025-10-02T20:25:33.400185] [DEBUG] [VALIDATOR ] NBR: Validating primary data. [2025-10-02T20:25:33.549231] [INFO ] [REMOTE ] NCDL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:25:33.730548] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-02T20:25:33.880037] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-06. [2025-10-02T20:25:33.899195] [DEBUG] [VALIDATOR ] NBR: All expected trading days are present. [2025-10-02T20:25:33.900117] [DEBUG] [VALIDATOR ] NBR: Primary data validation passed. [2025-10-02T20:25:33.901049] [INFO ] [MAIN ] NBR: Fetched primary data is valid. [2025-10-02T20:25:33.901216] [DEBUG] [LOCAL ] NBR: Saving primary data. [2025-10-02T20:25:33.902407] [DEBUG] [LOCAL ] NBR: Trimmed 49568 records to 34765 (keeping 200 days of data) [2025-10-02T20:25:34.118133] [DEBUG] [LOCAL ] NBR: Primary data saved (34765 records). [2025-10-02T20:25:34.118303] [INFO ] [MAIN ] NBR: Full history saved. [2025-10-02T20:25:34.118388] [INFO ] [MAIN ] Update Progress: 1458/2370 symbols completed. NBR took 46.8s. Estimated remaining: 2h 8m 33s. Rate: 7.1 symbols/min [2025-10-02T20:25:34.301638] [INFO ] [MAIN ] NCLH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:25:34.301859] [DEBUG] [LOCAL ] NCLH: No existing data file found in primary storage. [2025-10-02T20:25:34.301916] [WARN ] [MAIN ] NCLH: No existing data found, performing full refresh instead. [2025-10-02T20:25:34.302036] [INFO ] [MAIN ] NCLH: Wiping existing primary data before full refresh. [2025-10-02T20:25:34.302079] [INFO ] [LOCAL ] NCLH: Starting deletion of primary data. [2025-10-02T20:25:34.302122] [DEBUG] [LOCAL ] NCLH: No primary data file found to delete. [2025-10-02T20:25:34.302156] [INFO ] [MAIN ] NCLH: Starting full primary refresh. [2025-10-02T20:25:34.673967] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-01. [2025-10-02T20:25:34.705053] [INFO ] [REMOTE ] NCLH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:25:34.848699] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-02T20:25:35.473017] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-07. [2025-10-02T20:25:35.625638] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-02T20:25:35.849218] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-02T20:25:36.273019] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-08. [2025-10-02T20:25:36.717277] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-02T20:25:37.073010] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-02. [2025-10-02T20:25:37.873019] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2024-12. [2025-10-02T20:25:37.930348] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-02T20:25:38.672996] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-09. [2025-10-02T20:25:39.095432] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-02T20:25:39.237357] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-02T20:25:39.473007] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-01. [2025-10-02T20:25:40.273021] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-03. [2025-10-02T20:25:40.782957] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-02T20:25:41.073055] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2024-12. [2025-10-02T20:25:41.179336] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-02T20:25:41.873067] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-10. [2025-10-02T20:25:42.297517] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-02T20:25:42.298781] [INFO ] [REMOTE ] NC: Full fetch complete (2717 records). [2025-10-02T20:25:42.298885] [DEBUG] [VALIDATOR ] NC: Validating primary data. [2025-10-02T20:25:42.686078] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-04. [2025-10-02T20:25:42.733471] [DEBUG] [VALIDATOR ] NC: All expected trading days are present. [2025-10-02T20:25:42.733555] [DEBUG] [VALIDATOR ] NC: Primary data validation passed. [2025-10-02T20:25:42.733700] [INFO ] [MAIN ] NC: Fetched primary data is valid. [2025-10-02T20:25:42.733765] [DEBUG] [LOCAL ] NC: Saving primary data. [2025-10-02T20:25:42.734231] [DEBUG] [LOCAL ] NC: Trimmed 2717 records to 1944 (keeping 200 days of data) [2025-10-02T20:25:42.748747] [DEBUG] [LOCAL ] NC: Primary data saved (1944 records). [2025-10-02T20:25:42.748900] [INFO ] [MAIN ] NC: Full history saved. [2025-10-02T20:25:42.748982] [INFO ] [MAIN ] Update Progress: 1459/2370 symbols completed. NC took 27.2s. Estimated remaining: 2h 8m 24s. Rate: 7.1 symbols/min [2025-10-02T20:25:42.964794] [INFO ] [MAIN ] NCV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:25:42.965135] [DEBUG] [LOCAL ] NCV: No existing data file found in primary storage. [2025-10-02T20:25:42.965288] [WARN ] [MAIN ] NCV: No existing data found, performing full refresh instead. [2025-10-02T20:25:42.965481] [INFO ] [MAIN ] NCV: Wiping existing primary data before full refresh. [2025-10-02T20:25:42.965528] [INFO ] [LOCAL ] NCV: Starting deletion of primary data. [2025-10-02T20:25:42.965571] [DEBUG] [LOCAL ] NCV: No primary data file found to delete. [2025-10-02T20:25:42.965605] [INFO ] [MAIN ] NCV: Starting full primary refresh. [2025-10-02T20:25:43.376965] [INFO ] [REMOTE ] NCV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:25:43.412079] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-10-02T20:25:43.473029] [INFO ] [REMOTE ] NCV: Fetching primary data for 2024-12. [2025-10-02T20:25:43.653734] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-02T20:25:44.273001] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-05. [2025-10-02T20:25:44.799883] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-02T20:25:45.073043] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-02. [2025-10-02T20:25:45.123899] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-02T20:25:45.872974] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-06. [2025-10-02T20:25:45.931578] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-02T20:25:46.672992] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-01. [2025-10-02T20:25:46.813039] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-02T20:25:47.472979] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-03. [2025-10-02T20:25:47.848009] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-02T20:25:48.272984] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-01. [2025-10-02T20:25:48.660235] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-02T20:25:49.073055] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-07. [2025-10-02T20:25:49.873009] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-04. [2025-10-02T20:25:50.036567] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-02T20:25:50.133961] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-02T20:25:50.673044] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-02. [2025-10-02T20:25:50.798314] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-02T20:25:51.473054] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-02. [2025-10-02T20:25:52.272993] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-08. [2025-10-02T20:25:52.334673] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-02T20:25:52.474218] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-02T20:25:53.072994] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-03. [2025-10-02T20:25:53.129489] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-02T20:25:53.873049] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-03. [2025-10-02T20:25:54.673022] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-05. [2025-10-02T20:25:54.897922] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-02T20:25:55.420287] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-10-02T20:25:55.472964] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-04. [2025-10-02T20:25:55.523750] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-02T20:25:56.272994] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-09. [2025-10-02T20:25:56.800976] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-02T20:25:57.073008] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-10. [2025-10-02T20:25:57.651927] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-02T20:25:57.652853] [INFO ] [REMOTE ] NCA: Full fetch complete (15554 records). [2025-10-02T20:25:57.652925] [DEBUG] [VALIDATOR ] NCA: Validating primary data. [2025-10-02T20:25:57.878153] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-04. [2025-10-02T20:25:58.009983] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-04 (2.54 seconds). [2025-10-02T20:25:58.126591] [DEBUG] [VALIDATOR ] NCA: All expected trading days are present. [2025-10-02T20:25:58.126724] [DEBUG] [VALIDATOR ] NCA: Primary data validation passed. [2025-10-02T20:25:58.127232] [INFO ] [MAIN ] NCA: Fetched primary data is valid. [2025-10-02T20:25:58.127297] [DEBUG] [LOCAL ] NCA: Saving primary data. [2025-10-02T20:25:58.127975] [DEBUG] [LOCAL ] NCA: Trimmed 15554 records to 10308 (keeping 200 days of data) [2025-10-02T20:25:58.194090] [DEBUG] [LOCAL ] NCA: Primary data saved (10308 records). [2025-10-02T20:25:58.194234] [INFO ] [MAIN ] NCA: Full history saved. [2025-10-02T20:25:58.194309] [INFO ] [MAIN ] Update Progress: 1460/2370 symbols completed. NCA took 31.7s. Estimated remaining: 2h 8m 20s. Rate: 7.1 symbols/min [2025-10-02T20:25:58.386699] [INFO ] [MAIN ] NCZ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:25:58.386897] [DEBUG] [LOCAL ] NCZ: No existing data file found in primary storage. [2025-10-02T20:25:58.386937] [WARN ] [MAIN ] NCZ: No existing data found, performing full refresh instead. [2025-10-02T20:25:58.387055] [INFO ] [MAIN ] NCZ: Wiping existing primary data before full refresh. [2025-10-02T20:25:58.387097] [INFO ] [LOCAL ] NCZ: Starting deletion of primary data. [2025-10-02T20:25:58.387140] [DEBUG] [LOCAL ] NCZ: No primary data file found to delete. [2025-10-02T20:25:58.387174] [INFO ] [MAIN ] NCZ: Starting full primary refresh. [2025-10-02T20:25:58.678160] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-05. [2025-10-02T20:25:58.820017] [INFO ] [REMOTE ] NCZ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:25:59.017454] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-02T20:25:59.473019] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2024-12. [2025-10-02T20:26:00.272966] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-05. [2025-10-02T20:26:00.647628] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-02T20:26:01.072983] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-06. [2025-10-02T20:26:01.290967] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-02T20:26:01.376984] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-05 (2.70 seconds). [2025-10-02T20:26:01.873015] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-06. [2025-10-02T20:26:02.297976] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-02T20:26:02.672997] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-07. [2025-10-02T20:26:03.473001] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-01. [2025-10-02T20:26:03.839847] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-02T20:26:04.021323] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-02T20:26:04.272996] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-07. [2025-10-02T20:26:04.704585] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-02T20:26:05.072995] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-02. [2025-10-02T20:26:05.872996] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-08. [2025-10-02T20:26:06.168134] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-02T20:26:06.652956] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-10-02T20:26:06.672953] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-08. [2025-10-02T20:26:06.739564] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-02T20:26:07.473051] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-03. [2025-10-02T20:26:08.272974] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-06. [2025-10-02T20:26:08.444009] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-02T20:26:08.727948] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-02T20:26:09.073000] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-09. [2025-10-02T20:26:09.193097] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-02T20:26:09.873005] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-09. [2025-10-02T20:26:10.672997] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-04. [2025-10-02T20:26:11.076751] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-02T20:26:11.246380] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-02T20:26:11.325003] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-02T20:26:11.473047] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-05. [2025-10-02T20:26:12.273008] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-10. [2025-10-02T20:26:12.405578] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-02T20:26:12.699897] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-02T20:26:12.701463] [INFO ] [REMOTE ] NCLH: Full fetch complete (77419 records). [2025-10-02T20:26:12.701584] [DEBUG] [VALIDATOR ] NCLH: Validating primary data. [2025-10-02T20:26:12.702624] [FATAL] [VALIDATOR ] NCLH: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T20:26:12.702814] [FATAL] [MAIN ] NCLH: Fetched primary data is invalid. Refusing to save it. [2025-10-02T20:26:12.702903] [WARN ] [MAIN ] NCLH: Deleting existing primary and derivative data due to validation failure. [2025-10-02T20:26:12.703000] [INFO ] [LOCAL ] NCLH: Starting deletion of primary data. [2025-10-02T20:26:12.703082] [DEBUG] [LOCAL ] NCLH: No primary data file found to delete. [2025-10-02T20:26:12.703120] [INFO ] [LOCAL ] NCLH: Starting deletion of derivative data. [2025-10-02T20:26:12.703160] [DEBUG] [LOCAL ] NCLH: No derivative data file found to delete. [2025-10-02T20:26:12.703218] [INFO ] [MAIN ] Update Progress: 1461/2370 symbols completed. NCLH took 38.6s. Estimated remaining: 2h 8m 16s. Rate: 7.1 symbols/min [2025-10-02T20:26:12.888883] [INFO ] [MAIN ] NDMO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:26:12.889068] [DEBUG] [LOCAL ] NDMO: No existing data file found in primary storage. [2025-10-02T20:26:12.889117] [WARN ] [MAIN ] NDMO: No existing data found, performing full refresh instead. [2025-10-02T20:26:12.889228] [INFO ] [MAIN ] NDMO: Wiping existing primary data before full refresh. [2025-10-02T20:26:12.889270] [INFO ] [LOCAL ] NDMO: Starting deletion of primary data. [2025-10-02T20:26:12.889311] [DEBUG] [LOCAL ] NDMO: No primary data file found to delete. [2025-10-02T20:26:12.889343] [INFO ] [MAIN ] NDMO: Starting full primary refresh. [2025-10-02T20:26:13.073015] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-07. [2025-10-02T20:26:13.271851] [INFO ] [REMOTE ] NDMO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:26:13.872980] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-06. [2025-10-02T20:26:13.928825] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-02T20:26:14.672979] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-08. [2025-10-02T20:26:14.783584] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-02T20:26:15.472983] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-07. [2025-10-02T20:26:15.742000] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-02T20:26:16.273001] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-10. [2025-10-02T20:26:16.402660] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-02T20:26:17.072994] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-08. [2025-10-02T20:26:17.114133] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-02T20:26:17.115541] [INFO ] [REMOTE ] NCDL: Full fetch complete (32954 records). [2025-10-02T20:26:17.115637] [DEBUG] [VALIDATOR ] NCDL: Validating primary data. [2025-10-02T20:26:17.526602] [DEBUG] [VALIDATOR ] NCDL: All expected trading days are present. [2025-10-02T20:26:17.526725] [DEBUG] [VALIDATOR ] NCDL: Primary data validation passed. [2025-10-02T20:26:17.527513] [INFO ] [MAIN ] NCDL: Fetched primary data is valid. [2025-10-02T20:26:17.527565] [DEBUG] [LOCAL ] NCDL: Saving primary data. [2025-10-02T20:26:17.528541] [DEBUG] [LOCAL ] NCDL: Trimmed 32954 records to 21767 (keeping 200 days of data) [2025-10-02T20:26:17.672337] [DEBUG] [LOCAL ] NCDL: Primary data saved (21767 records). [2025-10-02T20:26:17.672478] [INFO ] [MAIN ] NCDL: Full history saved. [2025-10-02T20:26:17.672555] [INFO ] [MAIN ] Update Progress: 1462/2370 symbols completed. NCDL took 44.8s. Estimated remaining: 2h 8m 5s. Rate: 7.1 symbols/min [2025-10-02T20:26:17.880215] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-09. [2025-10-02T20:26:17.887268] [INFO ] [MAIN ] NE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:26:17.888467] [DEBUG] [LOCAL ] NE: No existing data file found in primary storage. [2025-10-02T20:26:17.888626] [WARN ] [MAIN ] NE: No existing data found, performing full refresh instead. [2025-10-02T20:26:17.888774] [INFO ] [MAIN ] NE: Wiping existing primary data before full refresh. [2025-10-02T20:26:17.888868] [INFO ] [LOCAL ] NE: Starting deletion of primary data. [2025-10-02T20:26:17.888957] [DEBUG] [LOCAL ] NE: No primary data file found to delete. [2025-10-02T20:26:17.889004] [INFO ] [MAIN ] NE: Starting full primary refresh. [2025-10-02T20:26:18.047861] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-02T20:26:18.344854] [INFO ] [REMOTE ] NE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:26:18.673026] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2024-12. [2025-10-02T20:26:18.755059] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-02T20:26:19.473043] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-10. [2025-10-02T20:26:19.961815] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-02T20:26:20.086835] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-02T20:26:20.088237] [INFO ] [REMOTE ] NCV: Full fetch complete (22857 records). [2025-10-02T20:26:20.088332] [DEBUG] [VALIDATOR ] NCV: Validating primary data. [2025-10-02T20:26:20.278387] [INFO ] [REMOTE ] NE: Fetching primary data for 2024-12. [2025-10-02T20:26:20.525349] [DEBUG] [VALIDATOR ] NCV: All expected trading days are present. [2025-10-02T20:26:20.525454] [DEBUG] [VALIDATOR ] NCV: Primary data validation passed. [2025-10-02T20:26:20.526097] [INFO ] [MAIN ] NCV: Fetched primary data is valid. [2025-10-02T20:26:20.526189] [DEBUG] [LOCAL ] NCV: Saving primary data. [2025-10-02T20:26:20.527190] [DEBUG] [LOCAL ] NCV: Trimmed 22857 records to 13797 (keeping 200 days of data) [2025-10-02T20:26:20.626083] [DEBUG] [LOCAL ] NCV: Primary data saved (13797 records). [2025-10-02T20:26:20.626231] [INFO ] [MAIN ] NCV: Full history saved. [2025-10-02T20:26:20.626323] [INFO ] [MAIN ] Update Progress: 1463/2370 symbols completed. NCV took 37.9s. Estimated remaining: 2h 7m 53s. Rate: 7.1 symbols/min [2025-10-02T20:26:20.823154] [INFO ] [MAIN ] NEA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:26:20.823348] [DEBUG] [LOCAL ] NEA: No existing data file found in primary storage. [2025-10-02T20:26:20.823415] [WARN ] [MAIN ] NEA: No existing data found, performing full refresh instead. [2025-10-02T20:26:20.823545] [INFO ] [MAIN ] NEA: Wiping existing primary data before full refresh. [2025-10-02T20:26:20.823589] [INFO ] [LOCAL ] NEA: Starting deletion of primary data. [2025-10-02T20:26:20.823634] [DEBUG] [LOCAL ] NEA: No primary data file found to delete. [2025-10-02T20:26:20.823710] [INFO ] [MAIN ] NEA: Starting full primary refresh. [2025-10-02T20:26:21.078081] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-01. [2025-10-02T20:26:21.237312] [INFO ] [REMOTE ] NEA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:26:21.872976] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-09. [2025-10-02T20:26:22.220881] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-02T20:26:22.300378] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-02T20:26:22.671843] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-02T20:26:22.674832] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-01. [2025-10-02T20:26:23.473019] [INFO ] [REMOTE ] NEA: Fetching primary data for 2024-12. [2025-10-02T20:26:24.167626] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-02T20:26:24.272992] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-02. [2025-10-02T20:26:25.072999] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-10. [2025-10-02T20:26:25.137277] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-02T20:26:25.792023] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-02T20:26:25.793364] [INFO ] [REMOTE ] NCZ: Full fetch complete (21437 records). [2025-10-02T20:26:25.793453] [DEBUG] [VALIDATOR ] NCZ: Validating primary data. [2025-10-02T20:26:25.881229] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-02. [2025-10-02T20:26:26.215978] [DEBUG] [VALIDATOR ] NCZ: All expected trading days are present. [2025-10-02T20:26:26.216170] [DEBUG] [VALIDATOR ] NCZ: Primary data validation passed. [2025-10-02T20:26:26.216687] [INFO ] [MAIN ] NCZ: Fetched primary data is valid. [2025-10-02T20:26:26.216807] [DEBUG] [LOCAL ] NCZ: Saving primary data. [2025-10-02T20:26:26.245306] [DEBUG] [LOCAL ] NCZ: Trimmed 21437 records to 12088 (keeping 200 days of data) [2025-10-02T20:26:26.248138] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-02T20:26:26.340614] [DEBUG] [LOCAL ] NCZ: Primary data saved (12088 records). [2025-10-02T20:26:26.340848] [INFO ] [MAIN ] NCZ: Full history saved. [2025-10-02T20:26:26.340973] [INFO ] [MAIN ] Update Progress: 1464/2370 symbols completed. NCZ took 28.1s. Estimated remaining: 2h 7m 43s. Rate: 7.1 symbols/min [2025-10-02T20:26:26.531070] [INFO ] [MAIN ] NEE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:26:26.531266] [DEBUG] [LOCAL ] NEE: No existing data file found in primary storage. [2025-10-02T20:26:26.531322] [WARN ] [MAIN ] NEE: No existing data found, performing full refresh instead. [2025-10-02T20:26:26.531442] [INFO ] [MAIN ] NEE: Wiping existing primary data before full refresh. [2025-10-02T20:26:26.531485] [INFO ] [LOCAL ] NEE: Starting deletion of primary data. [2025-10-02T20:26:26.531528] [DEBUG] [LOCAL ] NEE: No primary data file found to delete. [2025-10-02T20:26:26.531561] [INFO ] [MAIN ] NEE: Starting full primary refresh. [2025-10-02T20:26:26.685146] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-01. [2025-10-02T20:26:26.941329] [INFO ] [REMOTE ] NEE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:26:26.954217] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-02T20:26:27.473040] [INFO ] [REMOTE ] NEE: Fetching primary data for 2024-12. [2025-10-02T20:26:28.283116] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-03. [2025-10-02T20:26:28.289857] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-02T20:26:29.072996] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-03. [2025-10-02T20:26:29.626190] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-02T20:26:29.852003] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-02T20:26:29.872978] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-02. [2025-10-02T20:26:30.299839] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-02T20:26:30.673045] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-01. [2025-10-02T20:26:30.883210] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-02T20:26:31.472947] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-03. [2025-10-02T20:26:32.273030] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-04. [2025-10-02T20:26:32.774920] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-02T20:26:32.949719] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-10-02T20:26:33.073034] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-02. [2025-10-02T20:26:33.873052] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-04. [2025-10-02T20:26:34.177880] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-02T20:26:34.672972] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-05. [2025-10-02T20:26:34.706293] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-02T20:26:35.018196] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-02T20:26:35.473076] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-03. [2025-10-02T20:26:36.273018] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-05. [2025-10-02T20:26:36.566896] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-02T20:26:36.917226] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-02T20:26:37.073009] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-04. [2025-10-02T20:26:37.752150] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-02T20:26:37.873050] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-04. [2025-10-02T20:26:38.630561] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-02T20:26:38.673031] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-06. [2025-10-02T20:26:39.473006] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-05. [2025-10-02T20:26:39.922259] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-02T20:26:40.273013] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-05. [2025-10-02T20:26:40.523905] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-02T20:26:40.622038] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-02T20:26:41.072997] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-07. [2025-10-02T20:26:41.872996] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-06. [2025-10-02T20:26:42.554473] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-10-02T20:26:42.648515] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-02T20:26:42.672972] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-06. [2025-10-02T20:26:42.938442] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-02T20:26:43.473034] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-06. [2025-10-02T20:26:44.120080] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-02T20:26:44.273012] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-07. [2025-10-02T20:26:45.057899] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-02T20:26:45.072957] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-08. [2025-10-02T20:26:45.631870] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-10-02T20:26:45.873006] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-07. [2025-10-02T20:26:46.219550] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-02T20:26:46.673042] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-07. [2025-10-02T20:26:47.471411] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-02T20:26:47.479212] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-08. [2025-10-02T20:26:48.272996] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-08. [2025-10-02T20:26:48.976265] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-02T20:26:49.078119] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-09. [2025-10-02T20:26:49.093448] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-02T20:26:49.563428] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-02T20:26:49.872998] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-09. [2025-10-02T20:26:50.241710] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-02T20:26:50.673041] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-08. [2025-10-02T20:26:51.145635] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-02T20:26:51.473064] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-10. [2025-10-02T20:26:52.273000] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-10. [2025-10-02T20:26:52.718848] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-02T20:26:52.720428] [INFO ] [REMOTE ] NEA: Full fetch complete (52079 records). [2025-10-02T20:26:52.720530] [DEBUG] [VALIDATOR ] NEA: Validating primary data. [2025-10-02T20:26:53.063731] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-02T20:26:53.075462] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-09. [2025-10-02T20:26:53.081118] [INFO ] [REMOTE ] NDMO: Full fetch complete (24741 records). [2025-10-02T20:26:53.098006] [DEBUG] [VALIDATOR ] NDMO: Validating primary data. [2025-10-02T20:26:53.225279] [DEBUG] [VALIDATOR ] NEA: All expected trading days are present. [2025-10-02T20:26:53.246953] [DEBUG] [VALIDATOR ] NEA: Primary data validation passed. [2025-10-02T20:26:53.261872] [INFO ] [MAIN ] NEA: Fetched primary data is valid. [2025-10-02T20:26:53.262667] [DEBUG] [LOCAL ] NEA: Saving primary data. [2025-10-02T20:26:53.269934] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-08 (2.60 seconds). [2025-10-02T20:26:53.363288] [DEBUG] [LOCAL ] NEA: Trimmed 52079 records to 35701 (keeping 200 days of data) [2025-10-02T20:26:53.791854] [DEBUG] [VALIDATOR ] NDMO: All expected trading days are present. [2025-10-02T20:26:53.792854] [DEBUG] [VALIDATOR ] NDMO: Primary data validation passed. [2025-10-02T20:26:53.793473] [INFO ] [MAIN ] NDMO: Fetched primary data is valid. [2025-10-02T20:26:53.793594] [DEBUG] [LOCAL ] NDMO: Saving primary data. [2025-10-02T20:26:53.796565] [DEBUG] [LOCAL ] NDMO: Trimmed 24741 records to 17082 (keeping 200 days of data) [2025-10-02T20:26:53.881805] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-09. [2025-10-02T20:26:54.018873] [DEBUG] [LOCAL ] NDMO: Primary data saved (17082 records). [2025-10-02T20:26:54.019601] [INFO ] [MAIN ] NDMO: Full history saved. [2025-10-02T20:26:54.020058] [INFO ] [MAIN ] Update Progress: 1465/2370 symbols completed. NDMO took 41.3s. Estimated remaining: 2h 7m 46s. Rate: 7.1 symbols/min [2025-10-02T20:26:54.245531] [INFO ] [MAIN ] NEM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:26:54.246599] [DEBUG] [LOCAL ] NEM: No existing data file found in primary storage. [2025-10-02T20:26:54.246973] [WARN ] [MAIN ] NEM: No existing data found, performing full refresh instead. [2025-10-02T20:26:54.247795] [INFO ] [MAIN ] NEM: Wiping existing primary data before full refresh. [2025-10-02T20:26:54.248192] [INFO ] [LOCAL ] NEM: Starting deletion of primary data. [2025-10-02T20:26:54.248956] [DEBUG] [LOCAL ] NEM: No primary data file found to delete. [2025-10-02T20:26:54.249324] [INFO ] [MAIN ] NEM: Starting full primary refresh. [2025-10-02T20:26:54.371701] [DEBUG] [LOCAL ] NEA: Primary data saved (35701 records). [2025-10-02T20:26:54.375441] [INFO ] [MAIN ] NEA: Full history saved. [2025-10-02T20:26:54.375709] [INFO ] [MAIN ] Update Progress: 1466/2370 symbols completed. NEA took 33.7s. Estimated remaining: 2h 7m 33s. Rate: 7.1 symbols/min [2025-10-02T20:26:54.724946] [INFO ] [MAIN ] NET: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:26:54.759360] [DEBUG] [LOCAL ] NET: No existing data file found in primary storage. [2025-10-02T20:26:54.797075] [WARN ] [MAIN ] NET: No existing data found, performing full refresh instead. [2025-10-02T20:26:54.833517] [INFO ] [MAIN ] NET: Wiping existing primary data before full refresh. [2025-10-02T20:26:54.874840] [INFO ] [REMOTE ] NEM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:26:54.875212] [INFO ] [LOCAL ] NET: Starting deletion of primary data. [2025-10-02T20:26:54.875460] [INFO ] [REMOTE ] NEM: Fetching primary data for 2024-12. [2025-10-02T20:26:54.875689] [DEBUG] [LOCAL ] NET: No primary data file found to delete. [2025-10-02T20:26:54.875786] [INFO ] [MAIN ] NET: Starting full primary refresh. [2025-10-02T20:26:55.331932] [INFO ] [REMOTE ] NET: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:26:55.335211] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-02T20:26:55.473034] [INFO ] [REMOTE ] NET: Fetching primary data for 2024-12. [2025-10-02T20:26:55.878343] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-02T20:26:56.273081] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-10. [2025-10-02T20:26:56.697029] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-02T20:26:56.699590] [INFO ] [REMOTE ] NEE: Full fetch complete (77369 records). [2025-10-02T20:26:56.699776] [DEBUG] [VALIDATOR ] NEE: Validating primary data. [2025-10-02T20:26:56.701055] [FATAL] [VALIDATOR ] NEE: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T20:26:56.701148] [FATAL] [MAIN ] NEE: Fetched primary data is invalid. Refusing to save it. [2025-10-02T20:26:56.701192] [WARN ] [MAIN ] NEE: Deleting existing primary and derivative data due to validation failure. [2025-10-02T20:26:56.701234] [INFO ] [LOCAL ] NEE: Starting deletion of primary data. [2025-10-02T20:26:56.701324] [DEBUG] [LOCAL ] NEE: No primary data file found to delete. [2025-10-02T20:26:56.701382] [INFO ] [LOCAL ] NEE: Starting deletion of derivative data. [2025-10-02T20:26:56.701442] [DEBUG] [LOCAL ] NEE: No derivative data file found to delete. [2025-10-02T20:26:56.701533] [INFO ] [MAIN ] Update Progress: 1467/2370 symbols completed. NEE took 30.4s. Estimated remaining: 2h 7m 21s. Rate: 7.1 symbols/min [2025-10-02T20:26:56.897264] [INFO ] [MAIN ] NEU: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:26:56.897611] [DEBUG] [LOCAL ] NEU: No existing data file found in primary storage. [2025-10-02T20:26:56.897732] [WARN ] [MAIN ] NEU: No existing data found, performing full refresh instead. [2025-10-02T20:26:56.898114] [INFO ] [MAIN ] NEU: Wiping existing primary data before full refresh. [2025-10-02T20:26:56.898171] [INFO ] [LOCAL ] NEU: Starting deletion of primary data. [2025-10-02T20:26:56.898252] [DEBUG] [LOCAL ] NEU: No primary data file found to delete. [2025-10-02T20:26:56.898311] [INFO ] [MAIN ] NEU: Starting full primary refresh. [2025-10-02T20:26:57.089721] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-10. [2025-10-02T20:26:57.322253] [INFO ] [REMOTE ] NEU: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:26:57.361907] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2024-12 (2.49 seconds). [2025-10-02T20:26:57.623992] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-02T20:26:57.873080] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-01. [2025-10-02T20:26:58.394568] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-02T20:26:58.397388] [INFO ] [REMOTE ] NE: Full fetch complete (75535 records). [2025-10-02T20:26:58.397559] [DEBUG] [VALIDATOR ] NE: Validating primary data. [2025-10-02T20:26:58.678821] [INFO ] [REMOTE ] NEU: Fetching primary data for 2024-12. [2025-10-02T20:26:58.809976] [DEBUG] [VALIDATOR ] NE: All expected trading days are present. [2025-10-02T20:26:58.810173] [DEBUG] [VALIDATOR ] NE: Primary data validation passed. [2025-10-02T20:26:58.811824] [INFO ] [MAIN ] NE: Fetched primary data is valid. [2025-10-02T20:26:58.811898] [DEBUG] [LOCAL ] NE: Saving primary data. [2025-10-02T20:26:58.814101] [DEBUG] [LOCAL ] NE: Trimmed 75535 records to 52725 (keeping 200 days of data) [2025-10-02T20:26:59.173625] [DEBUG] [LOCAL ] NE: Primary data saved (52725 records). [2025-10-02T20:26:59.173835] [INFO ] [MAIN ] NE: Full history saved. [2025-10-02T20:26:59.173951] [INFO ] [MAIN ] Update Progress: 1468/2370 symbols completed. NE took 41.5s. Estimated remaining: 2h 7m 9s. Rate: 7.1 symbols/min [2025-10-02T20:26:59.394993] [INFO ] [MAIN ] NEXA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:26:59.395224] [DEBUG] [LOCAL ] NEXA: No existing data file found in primary storage. [2025-10-02T20:26:59.395287] [WARN ] [MAIN ] NEXA: No existing data found, performing full refresh instead. [2025-10-02T20:26:59.395436] [INFO ] [MAIN ] NEXA: Wiping existing primary data before full refresh. [2025-10-02T20:26:59.395494] [INFO ] [LOCAL ] NEXA: Starting deletion of primary data. [2025-10-02T20:26:59.395540] [DEBUG] [LOCAL ] NEXA: No primary data file found to delete. [2025-10-02T20:26:59.395579] [INFO ] [MAIN ] NEXA: Starting full primary refresh. [2025-10-02T20:26:59.481424] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-01. [2025-10-02T20:26:59.545502] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-02T20:26:59.806396] [INFO ] [REMOTE ] NEXA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:27:00.132164] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-10-02T20:27:00.273004] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-01. [2025-10-02T20:27:00.891215] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-02T20:27:01.072997] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2024-12. [2025-10-02T20:27:01.566035] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-02T20:27:01.872993] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-02. [2025-10-02T20:27:02.070551] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-02T20:27:02.673007] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-02. [2025-10-02T20:27:03.473004] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-01. [2025-10-02T20:27:03.835135] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-02T20:27:04.273053] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-03. [2025-10-02T20:27:04.360426] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-02T20:27:04.965864] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-10-02T20:27:05.073035] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-03. [2025-10-02T20:27:05.873046] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-02. [2025-10-02T20:27:06.526071] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-02T20:27:06.673044] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-02. [2025-10-02T20:27:06.689731] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-02T20:27:07.201146] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-02T20:27:07.205108] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-02T20:27:07.473019] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-03. [2025-10-02T20:27:08.201552] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-02T20:27:08.273031] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-04. [2025-10-02T20:27:09.073075] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-04. [2025-10-02T20:27:09.704262] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-02T20:27:09.872991] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-03. [2025-10-02T20:27:10.473008] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-02T20:27:10.672980] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-04. [2025-10-02T20:27:10.739411] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-10-02T20:27:11.473046] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-05. [2025-10-02T20:27:11.512686] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-02T20:27:12.273006] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-04. [2025-10-02T20:27:13.072939] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-05. [2025-10-02T20:27:13.840925] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-10-02T20:27:13.873008] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-06. [2025-10-02T20:27:14.360970] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-02T20:27:14.673048] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-06. [2025-10-02T20:27:14.718857] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-10-02T20:27:15.389091] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-02T20:27:15.473003] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-07. [2025-10-02T20:27:16.270256] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-02T20:27:16.272868] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-08. [2025-10-02T20:27:16.394994] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-06 (2.52 seconds). [2025-10-02T20:27:16.893133] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-02T20:27:17.073042] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-09. [2025-10-02T20:27:17.872995] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-07. [2025-10-02T20:27:17.880621] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-02T20:27:18.673016] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-05. [2025-10-02T20:27:19.473027] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-10. [2025-10-02T20:27:20.027844] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-02T20:27:20.055558] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-02T20:27:20.056475] [INFO ] [REMOTE ] NEXA: Full fetch complete (7593 records). [2025-10-02T20:27:20.056603] [DEBUG] [VALIDATOR ] NEXA: Validating primary data. [2025-10-02T20:27:20.278281] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-05. [2025-10-02T20:27:20.486314] [DEBUG] [VALIDATOR ] NEXA: All expected trading days are present. [2025-10-02T20:27:20.486420] [DEBUG] [VALIDATOR ] NEXA: Primary data validation passed. [2025-10-02T20:27:20.486675] [INFO ] [MAIN ] NEXA: Fetched primary data is valid. [2025-10-02T20:27:20.486778] [DEBUG] [LOCAL ] NEXA: Saving primary data. [2025-10-02T20:27:20.487354] [DEBUG] [LOCAL ] NEXA: Trimmed 7593 records to 4393 (keeping 200 days of data) [2025-10-02T20:27:20.517582] [DEBUG] [LOCAL ] NEXA: Primary data saved (4393 records). [2025-10-02T20:27:20.517767] [INFO ] [MAIN ] NEXA: Full history saved. [2025-10-02T20:27:20.517876] [INFO ] [MAIN ] Update Progress: 1469/2370 symbols completed. NEXA took 21.3s. Estimated remaining: 2h 7m 8s. Rate: 7.1 symbols/min [2025-10-02T20:27:20.723226] [INFO ] [MAIN ] NFG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:27:20.723443] [DEBUG] [LOCAL ] NFG: No existing data file found in primary storage. [2025-10-02T20:27:20.723576] [WARN ] [MAIN ] NFG: No existing data found, performing full refresh instead. [2025-10-02T20:27:20.723735] [INFO ] [MAIN ] NFG: Wiping existing primary data before full refresh. [2025-10-02T20:27:20.723795] [INFO ] [LOCAL ] NFG: Starting deletion of primary data. [2025-10-02T20:27:20.723867] [DEBUG] [LOCAL ] NFG: No primary data file found to delete. [2025-10-02T20:27:20.723917] [INFO ] [MAIN ] NFG: Starting full primary refresh. [2025-10-02T20:27:21.026104] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-02T20:27:21.073027] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-06. [2025-10-02T20:27:21.156253] [INFO ] [REMOTE ] NFG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:27:21.206172] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-10-02T20:27:21.873029] [INFO ] [REMOTE ] NFG: Fetching primary data for 2024-12. [2025-10-02T20:27:22.584842] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-02T20:27:22.673046] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-07. [2025-10-02T20:27:23.472993] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-08. [2025-10-02T20:27:23.544269] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-02T20:27:23.804270] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-02T20:27:24.273059] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-01. [2025-10-02T20:27:25.073084] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-08. [2025-10-02T20:27:25.379356] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-02T20:27:25.859862] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-02T20:27:25.874834] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-06. [2025-10-02T20:27:25.879277] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-02T20:27:26.673026] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-02. [2025-10-02T20:27:27.473063] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-09. [2025-10-02T20:27:27.874922] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-02T20:27:28.244071] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-02T20:27:28.273059] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-03. [2025-10-02T20:27:29.073034] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-07. [2025-10-02T20:27:29.868732] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-10-02T20:27:29.880170] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-09. [2025-10-02T20:27:30.160889] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-02T20:27:30.541159] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-02T20:27:30.673048] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-04. [2025-10-02T20:27:31.474176] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-10-02T20:27:31.473051] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-10. [2025-10-02T20:27:31.957258] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-02T20:27:31.958942] [INFO ] [REMOTE ] NEM: Full fetch complete (77359 records). [2025-10-02T20:27:31.959075] [DEBUG] [VALIDATOR ] NEM: Validating primary data. [2025-10-02T20:27:31.960325] [FATAL] [VALIDATOR ] NEM: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T20:27:31.960456] [FATAL] [MAIN ] NEM: Fetched primary data is invalid. Refusing to save it. [2025-10-02T20:27:31.960531] [WARN ] [MAIN ] NEM: Deleting existing primary and derivative data due to validation failure. [2025-10-02T20:27:31.960707] [INFO ] [LOCAL ] NEM: Starting deletion of primary data. [2025-10-02T20:27:31.960824] [DEBUG] [LOCAL ] NEM: No primary data file found to delete. [2025-10-02T20:27:31.960888] [INFO ] [LOCAL ] NEM: Starting deletion of derivative data. [2025-10-02T20:27:31.960939] [DEBUG] [LOCAL ] NEM: No derivative data file found to delete. [2025-10-02T20:27:31.961003] [INFO ] [MAIN ] Update Progress: 1470/2370 symbols completed. NEM took 37.9s. Estimated remaining: 2h 7m 1s. Rate: 7.1 symbols/min [2025-10-02T20:27:32.157695] [INFO ] [MAIN ] NFJ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:27:32.158000] [DEBUG] [LOCAL ] NFJ: No existing data file found in primary storage. [2025-10-02T20:27:32.158251] [WARN ] [MAIN ] NFJ: No existing data found, performing full refresh instead. [2025-10-02T20:27:32.158416] [INFO ] [MAIN ] NFJ: Wiping existing primary data before full refresh. [2025-10-02T20:27:32.158594] [INFO ] [LOCAL ] NFJ: Starting deletion of primary data. [2025-10-02T20:27:32.158833] [DEBUG] [LOCAL ] NFJ: No primary data file found to delete. [2025-10-02T20:27:32.158935] [INFO ] [MAIN ] NFJ: Starting full primary refresh. [2025-10-02T20:27:32.274470] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-10. [2025-10-02T20:27:32.363386] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-02T20:27:32.617745] [INFO ] [REMOTE ] NFJ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:27:32.915738] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-02T20:27:32.917300] [INFO ] [REMOTE ] NEU: Full fetch complete (10525 records). [2025-10-02T20:27:32.917381] [DEBUG] [VALIDATOR ] NEU: Validating primary data. [2025-10-02T20:27:33.080073] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-05. [2025-10-02T20:27:33.342219] [DEBUG] [VALIDATOR ] NEU: All expected trading days are present. [2025-10-02T20:27:33.342312] [DEBUG] [VALIDATOR ] NEU: Primary data validation passed. [2025-10-02T20:27:33.342601] [INFO ] [MAIN ] NEU: Fetched primary data is valid. [2025-10-02T20:27:33.342675] [DEBUG] [LOCAL ] NEU: Saving primary data. [2025-10-02T20:27:33.343181] [DEBUG] [LOCAL ] NEU: Trimmed 10525 records to 8349 (keeping 200 days of data) [2025-10-02T20:27:33.404118] [DEBUG] [LOCAL ] NEU: Primary data saved (8349 records). [2025-10-02T20:27:33.404268] [INFO ] [MAIN ] NEU: Full history saved. [2025-10-02T20:27:33.404370] [INFO ] [MAIN ] Update Progress: 1471/2370 symbols completed. NEU took 36.7s. Estimated remaining: 2h 6m 49s. Rate: 7.1 symbols/min [2025-10-02T20:27:33.592739] [INFO ] [MAIN ] NGG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:27:33.592942] [DEBUG] [LOCAL ] NGG: No existing data file found in primary storage. [2025-10-02T20:27:33.592995] [WARN ] [MAIN ] NGG: No existing data found, performing full refresh instead. [2025-10-02T20:27:33.593116] [INFO ] [MAIN ] NGG: Wiping existing primary data before full refresh. [2025-10-02T20:27:33.593158] [INFO ] [LOCAL ] NGG: Starting deletion of primary data. [2025-10-02T20:27:33.593202] [DEBUG] [LOCAL ] NGG: No primary data file found to delete. [2025-10-02T20:27:33.593238] [INFO ] [MAIN ] NGG: Starting full primary refresh. [2025-10-02T20:27:33.881793] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2024-12. [2025-10-02T20:27:33.990041] [INFO ] [REMOTE ] NGG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:27:34.673038] [INFO ] [REMOTE ] NGG: Fetching primary data for 2024-12. [2025-10-02T20:27:35.111135] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-02T20:27:35.120936] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-02T20:27:35.473055] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-01. [2025-10-02T20:27:36.273029] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-08. [2025-10-02T20:27:36.397748] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-02T20:27:36.674340] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-02T20:27:37.072996] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-02. [2025-10-02T20:27:37.881367] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-01. [2025-10-02T20:27:37.883565] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-02T20:27:38.006681] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-02T20:27:38.673019] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-09. [2025-10-02T20:27:39.473047] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-03. [2025-10-02T20:27:39.792536] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-02T20:27:40.272994] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-02. [2025-10-02T20:27:40.401883] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-02T20:27:40.824405] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-02T20:27:41.073043] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-10. [2025-10-02T20:27:41.873017] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-06. [2025-10-02T20:27:42.022257] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-02T20:27:42.672972] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-04. [2025-10-02T20:27:42.730672] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-02T20:27:42.732900] [INFO ] [REMOTE ] NET: Full fetch complete (76801 records). [2025-10-02T20:27:42.733017] [DEBUG] [VALIDATOR ] NET: Validating primary data. [2025-10-02T20:27:43.175287] [DEBUG] [VALIDATOR ] NET: All expected trading days are present. [2025-10-02T20:27:43.175434] [DEBUG] [VALIDATOR ] NET: Primary data validation passed. [2025-10-02T20:27:43.176837] [INFO ] [MAIN ] NET: Fetched primary data is valid. [2025-10-02T20:27:43.177075] [DEBUG] [LOCAL ] NET: Saving primary data. [2025-10-02T20:27:43.178895] [DEBUG] [LOCAL ] NET: Trimmed 76801 records to 53363 (keeping 200 days of data) [2025-10-02T20:27:43.337049] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-02T20:27:43.473176] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-03. [2025-10-02T20:27:43.568031] [DEBUG] [LOCAL ] NET: Primary data saved (53363 records). [2025-10-02T20:27:43.568190] [INFO ] [MAIN ] NET: Full history saved. [2025-10-02T20:27:43.568494] [INFO ] [MAIN ] Update Progress: 1472/2370 symbols completed. NET took 49.2s. Estimated remaining: 2h 6m 41s. Rate: 7.1 symbols/min [2025-10-02T20:27:43.762045] [INFO ] [MAIN ] NGL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:27:43.762284] [DEBUG] [LOCAL ] NGL: No existing data file found in primary storage. [2025-10-02T20:27:43.762412] [WARN ] [MAIN ] NGL: No existing data found, performing full refresh instead. [2025-10-02T20:27:43.762669] [INFO ] [MAIN ] NGL: Wiping existing primary data before full refresh. [2025-10-02T20:27:43.762744] [INFO ] [LOCAL ] NGL: Starting deletion of primary data. [2025-10-02T20:27:43.762963] [DEBUG] [LOCAL ] NGL: No primary data file found to delete. [2025-10-02T20:27:43.763035] [INFO ] [MAIN ] NGL: Starting full primary refresh. [2025-10-02T20:27:43.869564] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-02T20:27:44.166613] [INFO ] [REMOTE ] NGL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:27:44.273000] [INFO ] [REMOTE ] NGL: Fetching primary data for 2024-12. [2025-10-02T20:27:45.073054] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-07. [2025-10-02T20:27:45.228408] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-02T20:27:45.485013] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-02T20:27:45.873031] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-01. [2025-10-02T20:27:46.455238] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-02T20:27:46.673019] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-08. [2025-10-02T20:27:47.051741] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-02T20:27:47.473044] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-04. [2025-10-02T20:27:48.273046] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-05. [2025-10-02T20:27:48.512066] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-02T20:27:49.078107] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-02. [2025-10-02T20:27:49.080144] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-02T20:27:49.387009] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-02T20:27:49.873021] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-06. [2025-10-02T20:27:50.302732] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-02T20:27:50.672987] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-03. [2025-10-02T20:27:51.008964] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-02T20:27:51.472990] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-07. [2025-10-02T20:27:51.975259] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-02T20:27:52.273000] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-05. [2025-10-02T20:27:52.730131] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-02T20:27:53.073003] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-08. [2025-10-02T20:27:53.872976] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-04. [2025-10-02T20:27:54.040467] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-02T20:27:54.249552] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-02T20:27:54.672996] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-09. [2025-10-02T20:27:55.297730] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-02T20:27:55.473008] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-09. [2025-10-02T20:27:56.268474] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-02T20:27:56.276378] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-06. [2025-10-02T20:27:56.542011] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-02T20:27:57.072992] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-10. [2025-10-02T20:27:57.695978] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-02T20:27:57.872997] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-07. [2025-10-02T20:27:58.223514] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-02T20:27:58.225510] [INFO ] [REMOTE ] NFG: Full fetch complete (56855 records). [2025-10-02T20:27:58.225625] [DEBUG] [VALIDATOR ] NFG: Validating primary data. [2025-10-02T20:27:58.686764] [DEBUG] [VALIDATOR ] NFG: All expected trading days are present. [2025-10-02T20:27:58.683593] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-05. [2025-10-02T20:27:58.686885] [DEBUG] [VALIDATOR ] NFG: Primary data validation passed. [2025-10-02T20:27:58.687886] [INFO ] [MAIN ] NFG: Fetched primary data is valid. [2025-10-02T20:27:58.688968] [DEBUG] [LOCAL ] NFG: Saving primary data. [2025-10-02T20:27:58.690497] [DEBUG] [LOCAL ] NFG: Trimmed 56855 records to 38850 (keeping 200 days of data) [2025-10-02T20:27:58.963088] [DEBUG] [LOCAL ] NFG: Primary data saved (38850 records). [2025-10-02T20:27:58.963239] [INFO ] [MAIN ] NFG: Full history saved. [2025-10-02T20:27:58.963331] [INFO ] [MAIN ] Update Progress: 1473/2370 symbols completed. NFG took 38.4s. Estimated remaining: 2h 6m 37s. Rate: 7.1 symbols/min [2025-10-02T20:27:59.174061] [INFO ] [MAIN ] NGS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:27:59.175370] [DEBUG] [LOCAL ] NGS: No existing data file found in primary storage. [2025-10-02T20:27:59.175432] [WARN ] [MAIN ] NGS: No existing data found, performing full refresh instead. [2025-10-02T20:27:59.175685] [INFO ] [MAIN ] NGS: Wiping existing primary data before full refresh. [2025-10-02T20:27:59.175743] [INFO ] [LOCAL ] NGS: Starting deletion of primary data. [2025-10-02T20:27:59.175791] [DEBUG] [LOCAL ] NGS: No primary data file found to delete. [2025-10-02T20:27:59.175827] [INFO ] [MAIN ] NGS: Starting full primary refresh. [2025-10-02T20:27:59.485424] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-10. [2025-10-02T20:27:59.577054] [INFO ] [REMOTE ] NGS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:27:59.731342] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-02T20:27:59.922049] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-02T20:28:00.273020] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-08. [2025-10-02T20:28:00.505089] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-02T20:28:00.506450] [INFO ] [REMOTE ] NFJ: Full fetch complete (30592 records). [2025-10-02T20:28:00.506530] [DEBUG] [VALIDATOR ] NFJ: Validating primary data. [2025-10-02T20:28:00.925688] [DEBUG] [VALIDATOR ] NFJ: All expected trading days are present. [2025-10-02T20:28:00.925779] [DEBUG] [VALIDATOR ] NFJ: Primary data validation passed. [2025-10-02T20:28:00.926481] [INFO ] [MAIN ] NFJ: Fetched primary data is valid. [2025-10-02T20:28:00.926544] [DEBUG] [LOCAL ] NFJ: Saving primary data. [2025-10-02T20:28:00.927376] [DEBUG] [LOCAL ] NFJ: Trimmed 30592 records to 20601 (keeping 200 days of data) [2025-10-02T20:28:01.073508] [INFO ] [REMOTE ] NGS: Fetching primary data for 2024-12. [2025-10-02T20:28:01.074827] [DEBUG] [LOCAL ] NFJ: Primary data saved (20601 records). [2025-10-02T20:28:01.076266] [INFO ] [MAIN ] NFJ: Full history saved. [2025-10-02T20:28:01.076363] [INFO ] [MAIN ] Update Progress: 1474/2370 symbols completed. NFJ took 29.1s. Estimated remaining: 2h 6m 25s. Rate: 7.1 symbols/min [2025-10-02T20:28:01.271534] [INFO ] [MAIN ] NGVC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:28:01.271778] [DEBUG] [LOCAL ] NGVC: No existing data file found in primary storage. [2025-10-02T20:28:01.271833] [WARN ] [MAIN ] NGVC: No existing data found, performing full refresh instead. [2025-10-02T20:28:01.271947] [INFO ] [MAIN ] NGVC: Wiping existing primary data before full refresh. [2025-10-02T20:28:01.271989] [INFO ] [LOCAL ] NGVC: Starting deletion of primary data. [2025-10-02T20:28:01.272031] [DEBUG] [LOCAL ] NGVC: No primary data file found to delete. [2025-10-02T20:28:01.272064] [INFO ] [MAIN ] NGVC: Starting full primary refresh. [2025-10-02T20:28:01.672287] [INFO ] [REMOTE ] NGVC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:28:01.873060] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-06. [2025-10-02T20:28:02.019348] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-02T20:28:02.064130] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-02T20:28:02.672990] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-01. [2025-10-02T20:28:02.984236] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-02T20:28:03.473032] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-07. [2025-10-02T20:28:03.740772] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-02T20:28:04.273043] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-02. [2025-10-02T20:28:04.982549] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-02T20:28:05.073007] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2024-12. [2025-10-02T20:28:05.097139] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-02T20:28:05.872994] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-08. [2025-10-02T20:28:06.232755] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-02T20:28:06.673021] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-01. [2025-10-02T20:28:07.317104] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-02T20:28:07.473036] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-03. [2025-10-02T20:28:07.822439] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-02T20:28:08.272998] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-09. [2025-10-02T20:28:08.493876] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-02T20:28:09.073052] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-02. [2025-10-02T20:28:09.624586] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-02T20:28:09.873012] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-09. [2025-10-02T20:28:09.890418] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-02T20:28:10.673036] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-10. [2025-10-02T20:28:11.473053] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-03. [2025-10-02T20:28:11.554744] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-02T20:28:11.757949] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-02T20:28:11.759425] [INFO ] [REMOTE ] NGL: Full fetch complete (41289 records). [2025-10-02T20:28:11.759526] [DEBUG] [VALIDATOR ] NGL: Validating primary data. [2025-10-02T20:28:12.183980] [DEBUG] [VALIDATOR ] NGL: All expected trading days are present. [2025-10-02T20:28:12.184070] [DEBUG] [VALIDATOR ] NGL: Primary data validation passed. [2025-10-02T20:28:12.184891] [INFO ] [MAIN ] NGL: Fetched primary data is valid. [2025-10-02T20:28:12.184998] [DEBUG] [LOCAL ] NGL: Saving primary data. [2025-10-02T20:28:12.186163] [DEBUG] [LOCAL ] NGL: Trimmed 41289 records to 30447 (keeping 200 days of data) [2025-10-02T20:28:12.275001] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-10. [2025-10-02T20:28:12.376265] [DEBUG] [LOCAL ] NGL: Primary data saved (30447 records). [2025-10-02T20:28:12.376414] [INFO ] [MAIN ] NGL: Full history saved. [2025-10-02T20:28:12.376506] [INFO ] [MAIN ] Update Progress: 1475/2370 symbols completed. NGL took 28.8s. Estimated remaining: 2h 6m 18s. Rate: 7.1 symbols/min [2025-10-02T20:28:12.569800] [INFO ] [MAIN ] NGVT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:28:12.569967] [DEBUG] [LOCAL ] NGVT: No existing data file found in primary storage. [2025-10-02T20:28:12.570006] [WARN ] [MAIN ] NGVT: No existing data found, performing full refresh instead. [2025-10-02T20:28:12.570118] [INFO ] [MAIN ] NGVT: Wiping existing primary data before full refresh. [2025-10-02T20:28:12.570189] [INFO ] [LOCAL ] NGVT: Starting deletion of primary data. [2025-10-02T20:28:12.570249] [DEBUG] [LOCAL ] NGVT: No primary data file found to delete. [2025-10-02T20:28:12.570323] [INFO ] [MAIN ] NGVT: Starting full primary refresh. [2025-10-02T20:28:12.917924] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-02T20:28:13.050529] [INFO ] [REMOTE ] NGVT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:28:13.072974] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2024-12. [2025-10-02T20:28:13.533146] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-02T20:28:13.535016] [INFO ] [REMOTE ] NGG: Full fetch complete (66385 records). [2025-10-02T20:28:13.535124] [DEBUG] [VALIDATOR ] NGG: Validating primary data. [2025-10-02T20:28:13.878097] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-04. [2025-10-02T20:28:13.967683] [DEBUG] [VALIDATOR ] NGG: All expected trading days are present. [2025-10-02T20:28:13.967828] [DEBUG] [VALIDATOR ] NGG: Primary data validation passed. [2025-10-02T20:28:13.969049] [INFO ] [MAIN ] NGG: Fetched primary data is valid. [2025-10-02T20:28:13.969129] [DEBUG] [LOCAL ] NGG: Saving primary data. [2025-10-02T20:28:13.971534] [DEBUG] [LOCAL ] NGG: Trimmed 66385 records to 46520 (keeping 200 days of data) [2025-10-02T20:28:14.221567] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-02T20:28:14.304739] [DEBUG] [LOCAL ] NGG: Primary data saved (46520 records). [2025-10-02T20:28:14.304882] [INFO ] [MAIN ] NGG: Full history saved. [2025-10-02T20:28:14.304962] [INFO ] [MAIN ] Update Progress: 1476/2370 symbols completed. NGG took 40.9s. Estimated remaining: 2h 6m 5s. Rate: 7.1 symbols/min [2025-10-02T20:28:14.490773] [INFO ] [MAIN ] NHI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:28:14.490989] [DEBUG] [LOCAL ] NHI: No existing data file found in primary storage. [2025-10-02T20:28:14.491043] [WARN ] [MAIN ] NHI: No existing data found, performing full refresh instead. [2025-10-02T20:28:14.491161] [INFO ] [MAIN ] NHI: Wiping existing primary data before full refresh. [2025-10-02T20:28:14.491205] [INFO ] [LOCAL ] NHI: Starting deletion of primary data. [2025-10-02T20:28:14.491267] [DEBUG] [LOCAL ] NHI: No primary data file found to delete. [2025-10-02T20:28:14.491303] [INFO ] [MAIN ] NHI: Starting full primary refresh. [2025-10-02T20:28:14.687821] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-01. [2025-10-02T20:28:14.898321] [INFO ] [REMOTE ] NHI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:28:15.172072] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-02T20:28:15.473006] [INFO ] [REMOTE ] NHI: Fetching primary data for 2024-12. [2025-10-02T20:28:15.959356] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-02T20:28:16.273019] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-05. [2025-10-02T20:28:16.525119] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-02T20:28:17.073046] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-02. [2025-10-02T20:28:17.631393] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-02T20:28:17.873020] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-04. [2025-10-02T20:28:18.289341] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-02T20:28:18.673052] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-01. [2025-10-02T20:28:19.473015] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-03. [2025-10-02T20:28:20.002913] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-02T20:28:20.043742] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-02T20:28:20.273089] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-02. [2025-10-02T20:28:20.722881] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-02T20:28:21.073308] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-06. [2025-10-02T20:28:21.430779] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-02T20:28:21.873022] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-04. [2025-10-02T20:28:22.293137] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-02T20:28:22.673012] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-05. [2025-10-02T20:28:23.224329] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-02T20:28:23.473004] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-03. [2025-10-02T20:28:23.594420] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-02T20:28:24.272987] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-06. [2025-10-02T20:28:24.873489] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-02T20:28:25.072973] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-04. [2025-10-02T20:28:25.147884] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-02T20:28:25.872996] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-07. [2025-10-02T20:28:26.362628] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-02T20:28:26.673035] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-05. [2025-10-02T20:28:26.690030] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-02T20:28:27.473050] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-05. [2025-10-02T20:28:27.924559] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-02T20:28:28.273014] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-07. [2025-10-02T20:28:28.782568] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-02T20:28:29.073030] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-08. [2025-10-02T20:28:29.598698] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-02T20:28:29.664032] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-02T20:28:29.873044] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-06. [2025-10-02T20:28:30.673013] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-09. [2025-10-02T20:28:30.739922] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-02T20:28:31.473044] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-07. [2025-10-02T20:28:31.587789] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-02T20:28:32.273005] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-10. [2025-10-02T20:28:32.686437] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-02T20:28:32.865308] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-02T20:28:32.866293] [INFO ] [REMOTE ] NGS: Full fetch complete (17216 records). [2025-10-02T20:28:32.866368] [DEBUG] [VALIDATOR ] NGS: Validating primary data. [2025-10-02T20:28:33.088092] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-08. [2025-10-02T20:28:33.288438] [DEBUG] [VALIDATOR ] NGS: All expected trading days are present. [2025-10-02T20:28:33.288525] [DEBUG] [VALIDATOR ] NGS: Primary data validation passed. [2025-10-02T20:28:33.288919] [INFO ] [MAIN ] NGS: Fetched primary data is valid. [2025-10-02T20:28:33.288984] [DEBUG] [LOCAL ] NGS: Saving primary data. [2025-10-02T20:28:33.289571] [DEBUG] [LOCAL ] NGS: Trimmed 17216 records to 11618 (keeping 200 days of data) [2025-10-02T20:28:33.365038] [DEBUG] [LOCAL ] NGS: Primary data saved (11618 records). [2025-10-02T20:28:33.365207] [INFO ] [MAIN ] NGS: Full history saved. [2025-10-02T20:28:33.365301] [INFO ] [MAIN ] Update Progress: 1477/2370 symbols completed. NGS took 34.4s. Estimated remaining: 2h 6m 3s. Rate: 7.1 symbols/min [2025-10-02T20:28:33.872994] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-08. [2025-10-02T20:28:34.192360] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-02T20:28:34.673024] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-06. [2025-10-02T20:28:35.101857] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-02T20:28:35.473026] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-09. [2025-10-02T20:28:35.863597] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-02T20:28:36.273002] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-09. [2025-10-02T20:28:36.490583] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-02T20:28:37.073083] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-07. [2025-10-02T20:28:37.252418] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-02T20:28:37.873010] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-10. [2025-10-02T20:28:38.306844] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-02T20:28:38.672973] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-08. [2025-10-02T20:28:38.748977] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-02T20:28:38.750293] [INFO ] [REMOTE ] NGVC: Full fetch complete (30475 records). [2025-10-02T20:28:38.750372] [DEBUG] [VALIDATOR ] NGVC: Validating primary data. [2025-10-02T20:28:39.173281] [DEBUG] [VALIDATOR ] NGVC: All expected trading days are present. [2025-10-02T20:28:39.173379] [DEBUG] [VALIDATOR ] NGVC: Primary data validation passed. [2025-10-02T20:28:39.174111] [INFO ] [MAIN ] NGVC: Fetched primary data is valid. [2025-10-02T20:28:39.174174] [DEBUG] [LOCAL ] NGVC: Saving primary data. [2025-10-02T20:28:39.174990] [DEBUG] [LOCAL ] NGVC: Trimmed 30475 records to 22532 (keeping 200 days of data) [2025-10-02T20:28:39.321626] [DEBUG] [LOCAL ] NGVC: Primary data saved (22532 records). [2025-10-02T20:28:39.321784] [INFO ] [MAIN ] NGVC: Full history saved. [2025-10-02T20:28:39.321859] [INFO ] [MAIN ] Update Progress: 1478/2370 symbols completed. NGVC took 38.2s. Estimated remaining: 2h 5m 53s. Rate: 7.1 symbols/min [2025-10-02T20:28:39.472984] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-10. [2025-10-02T20:28:39.617825] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-02T20:28:40.188080] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-02T20:28:40.189985] [INFO ] [REMOTE ] NGVT: Full fetch complete (34541 records). [2025-10-02T20:28:40.190082] [DEBUG] [VALIDATOR ] NGVT: Validating primary data. [2025-10-02T20:28:40.280759] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-09. [2025-10-02T20:28:40.614876] [DEBUG] [VALIDATOR ] NGVT: All expected trading days are present. [2025-10-02T20:28:40.614965] [DEBUG] [VALIDATOR ] NGVT: Primary data validation passed. [2025-10-02T20:28:40.615775] [INFO ] [MAIN ] NGVT: Fetched primary data is valid. [2025-10-02T20:28:40.615844] [DEBUG] [LOCAL ] NGVT: Saving primary data. [2025-10-02T20:28:40.616861] [DEBUG] [LOCAL ] NGVT: Trimmed 34541 records to 24311 (keeping 200 days of data) [2025-10-02T20:28:40.766310] [DEBUG] [LOCAL ] NGVT: Primary data saved (24311 records). [2025-10-02T20:28:40.766469] [INFO ] [MAIN ] NGVT: Full history saved. [2025-10-02T20:28:40.766552] [INFO ] [MAIN ] Update Progress: 1479/2370 symbols completed. NGVT took 28.4s. Estimated remaining: 2h 5m 41s. Rate: 7.1 symbols/min [2025-10-02T20:28:41.495161] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-02T20:28:41.500352] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-10. [2025-10-02T20:28:42.604902] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-02T20:28:42.606339] [INFO ] [REMOTE ] NHI: Full fetch complete (31571 records). [2025-10-02T20:28:42.606438] [DEBUG] [VALIDATOR ] NHI: Validating primary data. [2025-10-02T20:28:43.010622] [DEBUG] [VALIDATOR ] NHI: All expected trading days are present. [2025-10-02T20:28:43.010745] [DEBUG] [VALIDATOR ] NHI: Primary data validation passed. [2025-10-02T20:28:43.011509] [INFO ] [MAIN ] NHI: Fetched primary data is valid. [2025-10-02T20:28:43.011567] [DEBUG] [LOCAL ] NHI: Saving primary data. [2025-10-02T20:28:43.012613] [DEBUG] [LOCAL ] NHI: Trimmed 31571 records to 22052 (keeping 200 days of data) [2025-10-02T20:28:43.169250] [DEBUG] [LOCAL ] NHI: Primary data saved (22052 records). [2025-10-02T20:28:43.169476] [INFO ] [MAIN ] NHI: Full history saved. [2025-10-02T20:28:43.169602] [INFO ] [MAIN ] Update Progress: 1480/2370 symbols completed. NHI took 28.9s. Estimated remaining: 2h 5m 29s. Rate: 7.1 symbols/min [2025-10-02T20:28:43.976915] [INFO ] [MAIN ] NIE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:28:44.066112] [INFO ] [MAIN ] NIM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:28:44.062490] [INFO ] [MAIN ] NIC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:28:44.064410] [DEBUG] [LOCAL ] NIE: No existing data file found in primary storage. [2025-10-02T20:28:44.089905] [INFO ] [MAIN ] NI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:28:44.090525] [DEBUG] [LOCAL ] NIC: No existing data file found in primary storage. [2025-10-02T20:28:44.090772] [DEBUG] [LOCAL ] NI: No existing data file found in primary storage. [2025-10-02T20:28:44.090635] [DEBUG] [LOCAL ] NIM: No existing data file found in primary storage. [2025-10-02T20:28:44.090982] [WARN ] [MAIN ] NI: No existing data found, performing full refresh instead. [2025-10-02T20:28:44.090191] [WARN ] [MAIN ] NIE: No existing data found, performing full refresh instead. [2025-10-02T20:28:44.091342] [WARN ] [MAIN ] NIC: No existing data found, performing full refresh instead. [2025-10-02T20:28:44.091259] [INFO ] [MAIN ] NI: Wiping existing primary data before full refresh. [2025-10-02T20:28:44.091829] [INFO ] [MAIN ] NIC: Wiping existing primary data before full refresh. [2025-10-02T20:28:44.091583] [WARN ] [MAIN ] NIM: No existing data found, performing full refresh instead. [2025-10-02T20:28:44.092236] [INFO ] [LOCAL ] NI: Starting deletion of primary data. [2025-10-02T20:28:44.092156] [INFO ] [LOCAL ] NIC: Starting deletion of primary data. [2025-10-02T20:28:44.092506] [DEBUG] [LOCAL ] NI: No primary data file found to delete. [2025-10-02T20:28:44.092081] [INFO ] [MAIN ] NIE: Wiping existing primary data before full refresh. [2025-10-02T20:28:44.092912] [INFO ] [MAIN ] NIM: Wiping existing primary data before full refresh. [2025-10-02T20:28:44.093015] [INFO ] [MAIN ] NI: Starting full primary refresh. [2025-10-02T20:28:44.093258] [DEBUG] [LOCAL ] NIC: No primary data file found to delete. [2025-10-02T20:28:44.098487] [INFO ] [LOCAL ] NIM: Starting deletion of primary data. [2025-10-02T20:28:44.125992] [DEBUG] [LOCAL ] NIM: No primary data file found to delete. [2025-10-02T20:28:44.125795] [INFO ] [LOCAL ] NIE: Starting deletion of primary data. [2025-10-02T20:28:44.142437] [INFO ] [MAIN ] NIM: Starting full primary refresh. [2025-10-02T20:28:44.177422] [DEBUG] [LOCAL ] NIE: No primary data file found to delete. [2025-10-02T20:28:44.172007] [INFO ] [MAIN ] NIC: Starting full primary refresh. [2025-10-02T20:28:44.216871] [INFO ] [MAIN ] NIE: Starting full primary refresh. [2025-10-02T20:28:45.552739] [INFO ] [REMOTE ] NI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:28:45.688866] [INFO ] [REMOTE ] NI: Fetching primary data for 2024-12. [2025-10-02T20:28:45.770197] [INFO ] [REMOTE ] NIC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:28:45.804491] [INFO ] [REMOTE ] NIC: Fetching primary data for 2024-12. [2025-10-02T20:28:45.782376] [INFO ] [REMOTE ] NIM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:28:45.808524] [INFO ] [REMOTE ] NIE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:28:45.808964] [INFO ] [REMOTE ] NIE: Fetching primary data for 2024-12. [2025-10-02T20:28:45.809239] [INFO ] [REMOTE ] NIM: Fetching primary data for 2024-12. [2025-10-02T20:28:46.433919] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-02T20:28:46.436043] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-01. [2025-10-02T20:28:46.490405] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-02T20:28:46.493500] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-01. [2025-10-02T20:28:46.648903] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-02T20:28:46.673041] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-01. [2025-10-02T20:28:47.327186] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-02T20:28:47.345449] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-02T20:28:47.472999] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-02. [2025-10-02T20:28:48.273011] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-02. [2025-10-02T20:28:48.348431] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-02T20:28:48.425701] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2024-12 (2.74 seconds). [2025-10-02T20:28:48.473366] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-02T20:28:49.072999] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-03. [2025-10-02T20:28:49.188841] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-02T20:28:49.873028] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-02. [2025-10-02T20:28:49.977003] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-02T20:28:50.646609] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-02T20:28:50.672963] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-03. [2025-10-02T20:28:51.472979] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-03. [2025-10-02T20:28:51.615789] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-02T20:28:52.170309] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-02T20:28:52.272995] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-04. [2025-10-02T20:28:52.923423] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-02T20:28:53.073007] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-04. [2025-10-02T20:28:53.872995] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-01. [2025-10-02T20:28:54.225160] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-02T20:28:54.673194] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-05. [2025-10-02T20:28:55.472991] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-05. [2025-10-02T20:28:55.664255] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-02T20:28:55.808095] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-02T20:28:55.901751] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-02T20:28:56.273016] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-06. [2025-10-02T20:28:56.859817] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-02T20:28:57.072996] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-06. [2025-10-02T20:28:57.873002] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-02. [2025-10-02T20:28:57.967865] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-02T20:28:58.673013] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-07. [2025-10-02T20:28:59.361027] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-02T20:28:59.473035] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-08. [2025-10-02T20:28:59.686032] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-02T20:29:00.076609] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-02T20:29:00.273036] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-09. [2025-10-02T20:29:00.944180] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-02T20:29:01.072987] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-04. [2025-10-02T20:29:01.873004] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-10. [2025-10-02T20:29:02.059768] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-02T20:29:02.314635] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-02T20:29:02.315471] [INFO ] [REMOTE ] NIM: Full fetch complete (6757 records). [2025-10-02T20:29:02.315569] [DEBUG] [VALIDATOR ] NIM: Validating primary data. [2025-10-02T20:29:02.678936] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-07. [2025-10-02T20:29:02.728238] [DEBUG] [VALIDATOR ] NIM: All expected trading days are present. [2025-10-02T20:29:02.728334] [DEBUG] [VALIDATOR ] NIM: Primary data validation passed. [2025-10-02T20:29:02.728525] [INFO ] [MAIN ] NIM: Fetched primary data is valid. [2025-10-02T20:29:02.728565] [DEBUG] [LOCAL ] NIM: Saving primary data. [2025-10-02T20:29:02.729136] [DEBUG] [LOCAL ] NIM: Trimmed 6757 records to 4079 (keeping 200 days of data) [2025-10-02T20:29:02.757725] [DEBUG] [LOCAL ] NIM: Primary data saved (4079 records). [2025-10-02T20:29:02.757879] [INFO ] [MAIN ] NIM: Full history saved. [2025-10-02T20:29:02.757959] [INFO ] [MAIN ] Update Progress: 1481/2370 symbols completed. NIM took 19.6s. Estimated remaining: 2h 5m 27s. Rate: 7.1 symbols/min [2025-10-02T20:29:02.940346] [INFO ] [MAIN ] NINE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:29:02.940511] [DEBUG] [LOCAL ] NINE: No existing data file found in primary storage. [2025-10-02T20:29:02.940552] [WARN ] [MAIN ] NINE: No existing data found, performing full refresh instead. [2025-10-02T20:29:02.940699] [INFO ] [MAIN ] NINE: Wiping existing primary data before full refresh. [2025-10-02T20:29:02.940754] [INFO ] [LOCAL ] NINE: Starting deletion of primary data. [2025-10-02T20:29:02.940798] [DEBUG] [LOCAL ] NINE: No primary data file found to delete. [2025-10-02T20:29:02.940831] [INFO ] [MAIN ] NINE: Starting full primary refresh. [2025-10-02T20:29:03.314868] [INFO ] [REMOTE ] NINE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:29:03.472967] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-03. [2025-10-02T20:29:03.776811] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-02T20:29:04.273017] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-05. [2025-10-02T20:29:05.073018] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-08. [2025-10-02T20:29:05.256817] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-02T20:29:05.303194] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-02T20:29:05.873039] [INFO ] [REMOTE ] NINE: Fetching primary data for 2024-12. [2025-10-02T20:29:05.965693] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-02T20:29:06.673035] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-06. [2025-10-02T20:29:07.472977] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-04. [2025-10-02T20:29:07.521718] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-02T20:29:07.612941] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-02T20:29:08.273038] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-09. [2025-10-02T20:29:08.860585] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-02T20:29:09.073015] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-01. [2025-10-02T20:29:09.701574] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-02T20:29:09.873012] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-10. [2025-10-02T20:29:10.644764] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-02T20:29:10.646041] [INFO ] [REMOTE ] NIE: Full fetch complete (16677 records). [2025-10-02T20:29:10.646126] [DEBUG] [VALIDATOR ] NIE: Validating primary data. [2025-10-02T20:29:10.681288] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-05. [2025-10-02T20:29:11.069548] [DEBUG] [VALIDATOR ] NIE: All expected trading days are present. [2025-10-02T20:29:11.069689] [DEBUG] [VALIDATOR ] NIE: Primary data validation passed. [2025-10-02T20:29:11.070063] [INFO ] [MAIN ] NIE: Fetched primary data is valid. [2025-10-02T20:29:11.070107] [DEBUG] [LOCAL ] NIE: Saving primary data. [2025-10-02T20:29:11.070767] [DEBUG] [LOCAL ] NIE: Trimmed 16677 records to 11993 (keeping 200 days of data) [2025-10-02T20:29:11.151224] [DEBUG] [LOCAL ] NIE: Primary data saved (11993 records). [2025-10-02T20:29:11.151380] [INFO ] [MAIN ] NIE: Full history saved. [2025-10-02T20:29:11.151462] [INFO ] [MAIN ] Update Progress: 1482/2370 symbols completed. NIE took 28.0s. Estimated remaining: 2h 5m 18s. Rate: 7.1 symbols/min [2025-10-02T20:29:11.351380] [INFO ] [MAIN ] NIO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:29:11.351564] [DEBUG] [LOCAL ] NIO: No existing data file found in primary storage. [2025-10-02T20:29:11.351605] [WARN ] [MAIN ] NIO: No existing data found, performing full refresh instead. [2025-10-02T20:29:11.351746] [INFO ] [MAIN ] NIO: Wiping existing primary data before full refresh. [2025-10-02T20:29:11.351792] [INFO ] [LOCAL ] NIO: Starting deletion of primary data. [2025-10-02T20:29:11.351836] [DEBUG] [LOCAL ] NIO: No primary data file found to delete. [2025-10-02T20:29:11.351872] [INFO ] [MAIN ] NIO: Starting full primary refresh. [2025-10-02T20:29:11.483993] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-07. [2025-10-02T20:29:11.489996] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-10-02T20:29:11.775603] [INFO ] [REMOTE ] NIO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:29:12.273046] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-02. [2025-10-02T20:29:12.547625] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-02T20:29:12.660963] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-02T20:29:13.073073] [INFO ] [REMOTE ] NIO: Fetching primary data for 2024-12. [2025-10-02T20:29:13.319524] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-02T20:29:13.873034] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-06. [2025-10-02T20:29:14.673052] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-08. [2025-10-02T20:29:15.459181] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-02T20:29:15.472950] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-09. [2025-10-02T20:29:15.764510] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-02T20:29:15.819213] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2024-12 (2.75 seconds). [2025-10-02T20:29:15.964636] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-02T20:29:16.273043] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-01. [2025-10-02T20:29:17.073003] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-10. [2025-10-02T20:29:17.721511] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-02T20:29:17.722353] [INFO ] [REMOTE ] NIC: Full fetch complete (12213 records). [2025-10-02T20:29:17.722424] [DEBUG] [VALIDATOR ] NIC: Validating primary data. [2025-10-02T20:29:17.878073] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-03. [2025-10-02T20:29:18.104780] [DEBUG] [VALIDATOR ] NIC: All expected trading days are present. [2025-10-02T20:29:18.104863] [DEBUG] [VALIDATOR ] NIC: Primary data validation passed. [2025-10-02T20:29:18.105185] [INFO ] [MAIN ] NIC: Fetched primary data is valid. [2025-10-02T20:29:18.105239] [DEBUG] [LOCAL ] NIC: Saving primary data. [2025-10-02T20:29:18.105806] [DEBUG] [LOCAL ] NIC: Trimmed 12213 records to 9018 (keeping 200 days of data) [2025-10-02T20:29:18.168470] [DEBUG] [LOCAL ] NIC: Primary data saved (9018 records). [2025-10-02T20:29:18.168610] [INFO ] [MAIN ] NIC: Full history saved. [2025-10-02T20:29:18.168710] [INFO ] [MAIN ] Update Progress: 1483/2370 symbols completed. NIC took 35.0s. Estimated remaining: 2h 5m 9s. Rate: 7.1 symbols/min [2025-10-02T20:29:18.351229] [INFO ] [MAIN ] NIQ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:29:18.351436] [DEBUG] [LOCAL ] NIQ: No existing data file found in primary storage. [2025-10-02T20:29:18.351493] [WARN ] [MAIN ] NIQ: No existing data found, performing full refresh instead. [2025-10-02T20:29:18.351610] [INFO ] [MAIN ] NIQ: Wiping existing primary data before full refresh. [2025-10-02T20:29:18.351680] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-10-02T20:29:18.351746] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-10-02T20:29:18.351781] [INFO ] [MAIN ] NIQ: Starting full primary refresh. [2025-10-02T20:29:18.678082] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-07. [2025-10-02T20:29:18.737694] [INFO ] [REMOTE ] NIQ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:29:18.869893] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-01 (2.60 seconds). [2025-10-02T20:29:19.448283] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-02T20:29:19.472980] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2024-12. [2025-10-02T20:29:19.763913] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T20:29:19.764242] [WARN ] [REMOTE ] NIQ: No data returned for month 2024-12 [2025-10-02T20:29:19.764327] [FATAL] [REMOTE ] NIQ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T20:29:19.764380] [FATAL] [MAIN ] NIQ: Failed to fetch primary data. [2025-10-02T20:29:19.764414] [WARN ] [MAIN ] NIQ: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T20:29:19.764462] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-10-02T20:29:19.764515] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-10-02T20:29:19.764553] [INFO ] [LOCAL ] NIQ: Starting deletion of derivative data. [2025-10-02T20:29:19.764670] [DEBUG] [LOCAL ] NIQ: No derivative data file found to delete. [2025-10-02T20:29:19.764741] [INFO ] [MAIN ] Update Progress: 1484/2370 symbols completed. NIQ took 1.6s. Estimated remaining: 2h 4m 56s. Rate: 7.1 symbols/min [2025-10-02T20:29:19.954684] [INFO ] [MAIN ] NJR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:29:19.954883] [DEBUG] [LOCAL ] NJR: No existing data file found in primary storage. [2025-10-02T20:29:19.954929] [WARN ] [MAIN ] NJR: No existing data found, performing full refresh instead. [2025-10-02T20:29:19.955045] [INFO ] [MAIN ] NJR: Wiping existing primary data before full refresh. [2025-10-02T20:29:19.955089] [INFO ] [LOCAL ] NJR: Starting deletion of primary data. [2025-10-02T20:29:19.955134] [DEBUG] [LOCAL ] NJR: No primary data file found to delete. [2025-10-02T20:29:19.955169] [INFO ] [MAIN ] NJR: Starting full primary refresh. [2025-10-02T20:29:20.278188] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-04. [2025-10-02T20:29:20.352105] [INFO ] [REMOTE ] NJR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:29:21.073052] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-02. [2025-10-02T20:29:21.645776] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-07 (2.97 seconds). [2025-10-02T20:29:21.721347] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-02T20:29:21.873005] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-05. [2025-10-02T20:29:22.673006] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-08. [2025-10-02T20:29:23.207054] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-02T20:29:23.472977] [INFO ] [REMOTE ] NJR: Fetching primary data for 2024-12. [2025-10-02T20:29:24.182121] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-02 (3.11 seconds). [2025-10-02T20:29:24.273015] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-03. [2025-10-02T20:29:24.645528] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-02T20:29:24.932430] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-02T20:29:25.073014] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-09. [2025-10-02T20:29:25.873021] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-06. [2025-10-02T20:29:26.672981] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-01. [2025-10-02T20:29:26.955131] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-03 (2.68 seconds). [2025-10-02T20:29:27.472985] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-04. [2025-10-02T20:29:27.576600] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-02T20:29:27.713731] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-09 (2.64 seconds). [2025-10-02T20:29:28.197805] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-02T20:29:28.273001] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-10. [2025-10-02T20:29:28.751706] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-02T20:29:28.753456] [INFO ] [REMOTE ] NI: Full fetch complete (76877 records). [2025-10-02T20:29:28.753567] [DEBUG] [VALIDATOR ] NI: Validating primary data. [2025-10-02T20:29:28.754567] [FATAL] [VALIDATOR ] NI: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T20:29:28.754700] [FATAL] [MAIN ] NI: Fetched primary data is invalid. Refusing to save it. [2025-10-02T20:29:28.754757] [WARN ] [MAIN ] NI: Deleting existing primary and derivative data due to validation failure. [2025-10-02T20:29:28.754826] [INFO ] [LOCAL ] NI: Starting deletion of primary data. [2025-10-02T20:29:28.754892] [DEBUG] [LOCAL ] NI: No primary data file found to delete. [2025-10-02T20:29:28.754984] [INFO ] [LOCAL ] NI: Starting deletion of derivative data. [2025-10-02T20:29:28.755063] [DEBUG] [LOCAL ] NI: No derivative data file found to delete. [2025-10-02T20:29:28.755203] [INFO ] [MAIN ] Update Progress: 1485/2370 symbols completed. NI took 45.6s. Estimated remaining: 2h 4m 48s. Rate: 7.1 symbols/min [2025-10-02T20:29:28.962269] [INFO ] [MAIN ] NKE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:29:28.962474] [DEBUG] [LOCAL ] NKE: No existing data file found in primary storage. [2025-10-02T20:29:28.962531] [WARN ] [MAIN ] NKE: No existing data found, performing full refresh instead. [2025-10-02T20:29:28.962684] [INFO ] [MAIN ] NKE: Wiping existing primary data before full refresh. [2025-10-02T20:29:28.962743] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-10-02T20:29:28.962790] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-10-02T20:29:28.962826] [INFO ] [MAIN ] NKE: Starting full primary refresh. [2025-10-02T20:29:29.074281] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-02. [2025-10-02T20:29:29.374083] [INFO ] [REMOTE ] NKE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:29:29.878335] [INFO ] [REMOTE ] NKE: Fetching primary data for 2024-12. [2025-10-02T20:29:29.886180] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-10-02T20:29:30.667685] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-02T20:29:30.674472] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-07. [2025-10-02T20:29:31.473005] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-05. [2025-10-02T20:29:32.241497] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-02T20:29:32.272993] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-08. [2025-10-02T20:29:32.670950] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2024-12 (2.79 seconds). [2025-10-02T20:29:33.073015] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-03. [2025-10-02T20:29:33.575698] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-02T20:29:33.872997] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-09. [2025-10-02T20:29:34.042525] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-05 (2.57 seconds). [2025-10-02T20:29:34.337493] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-02T20:29:34.673036] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-06. [2025-10-02T20:29:34.753193] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-02T20:29:35.473011] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-10. [2025-10-02T20:29:36.273005] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-04. [2025-10-02T20:29:36.371806] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-02T20:29:36.374023] [INFO ] [REMOTE ] NINE: Full fetch complete (43895 records). [2025-10-02T20:29:36.374143] [DEBUG] [VALIDATOR ] NINE: Validating primary data. [2025-10-02T20:29:36.799754] [DEBUG] [VALIDATOR ] NINE: All expected trading days are present. [2025-10-02T20:29:36.799869] [DEBUG] [VALIDATOR ] NINE: Primary data validation passed. [2025-10-02T20:29:36.800925] [INFO ] [MAIN ] NINE: Fetched primary data is valid. [2025-10-02T20:29:36.801020] [DEBUG] [LOCAL ] NINE: Saving primary data. [2025-10-02T20:29:36.802312] [DEBUG] [LOCAL ] NINE: Trimmed 43895 records to 28398 (keeping 200 days of data) [2025-10-02T20:29:36.985154] [DEBUG] [LOCAL ] NINE: Primary data saved (28398 records). [2025-10-02T20:29:36.985320] [INFO ] [MAIN ] NINE: Full history saved. [2025-10-02T20:29:36.985430] [INFO ] [MAIN ] Update Progress: 1486/2370 symbols completed. NINE took 34.2s. Estimated remaining: 2h 4m 40s. Rate: 7.1 symbols/min [2025-10-02T20:29:37.080931] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-01. [2025-10-02T20:29:37.186034] [INFO ] [MAIN ] NKX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:29:37.186333] [DEBUG] [LOCAL ] NKX: No existing data file found in primary storage. [2025-10-02T20:29:37.186478] [WARN ] [MAIN ] NKX: No existing data found, performing full refresh instead. [2025-10-02T20:29:37.186968] [INFO ] [MAIN ] NKX: Wiping existing primary data before full refresh. [2025-10-02T20:29:37.187192] [INFO ] [LOCAL ] NKX: Starting deletion of primary data. [2025-10-02T20:29:37.187375] [DEBUG] [LOCAL ] NKX: No primary data file found to delete. [2025-10-02T20:29:37.187550] [INFO ] [MAIN ] NKX: Starting full primary refresh. [2025-10-02T20:29:37.408687] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-06 (2.74 seconds). [2025-10-02T20:29:37.652984] [INFO ] [REMOTE ] NKX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:29:37.677773] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-02T20:29:37.873022] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-07. [2025-10-02T20:29:38.672999] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-05. [2025-10-02T20:29:39.473011] [INFO ] [REMOTE ] NKX: Fetching primary data for 2024-12. [2025-10-02T20:29:39.675615] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-01 (2.59 seconds). [2025-10-02T20:29:40.038899] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-02T20:29:40.272969] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-02. [2025-10-02T20:29:40.400370] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-10-02T20:29:40.570516] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-02T20:29:41.072994] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-01. [2025-10-02T20:29:41.872976] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-08. [2025-10-02T20:29:41.944307] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-02T20:29:42.672983] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-02. [2025-10-02T20:29:42.849275] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-02 (2.58 seconds). [2025-10-02T20:29:43.472990] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-03. [2025-10-02T20:29:43.568698] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-02T20:29:44.273027] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-03. [2025-10-02T20:29:44.584042] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-08 (2.71 seconds). [2025-10-02T20:29:45.073020] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-06. [2025-10-02T20:29:45.275793] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-02T20:29:45.872995] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-04. [2025-10-02T20:29:46.019768] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-03 (2.55 seconds). [2025-10-02T20:29:46.579816] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-02T20:29:46.672998] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-04. [2025-10-02T20:29:46.940780] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-02T20:29:47.472996] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-05. [2025-10-02T20:29:48.272999] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-09. [2025-10-02T20:29:48.730464] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-02T20:29:49.073009] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-06. [2025-10-02T20:29:49.600536] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-04 (2.93 seconds). [2025-10-02T20:29:49.873021] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-07. [2025-10-02T20:29:50.242507] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-02T20:29:50.463080] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-02T20:29:50.672996] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-05. [2025-10-02T20:29:51.208604] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-02T20:29:51.473016] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-10. [2025-10-02T20:29:52.074911] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-02T20:29:52.077034] [INFO ] [REMOTE ] NIO: Full fetch complete (77974 records). [2025-10-02T20:29:52.077144] [DEBUG] [VALIDATOR ] NIO: Validating primary data. [2025-10-02T20:29:52.284458] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-07. [2025-10-02T20:29:52.502324] [DEBUG] [VALIDATOR ] NIO: All expected trading days are present. [2025-10-02T20:29:52.502412] [DEBUG] [VALIDATOR ] NIO: Primary data validation passed. [2025-10-02T20:29:52.503567] [INFO ] [MAIN ] NIO: Fetched primary data is valid. [2025-10-02T20:29:52.503637] [DEBUG] [LOCAL ] NIO: Saving primary data. [2025-10-02T20:29:52.505226] [DEBUG] [LOCAL ] NIO: Trimmed 77974 records to 54192 (keeping 200 days of data) [2025-10-02T20:29:52.849185] [DEBUG] [LOCAL ] NIO: Primary data saved (54192 records). [2025-10-02T20:29:52.849332] [INFO ] [MAIN ] NIO: Full history saved. [2025-10-02T20:29:52.849415] [INFO ] [MAIN ] Update Progress: 1487/2370 symbols completed. NIO took 41.7s. Estimated remaining: 2h 4m 36s. Rate: 7.1 symbols/min [2025-10-02T20:29:53.051185] [INFO ] [MAIN ] NL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:29:53.051477] [DEBUG] [LOCAL ] NL: No existing data file found in primary storage. [2025-10-02T20:29:53.051593] [WARN ] [MAIN ] NL: No existing data found, performing full refresh instead. [2025-10-02T20:29:53.051783] [INFO ] [MAIN ] NL: Wiping existing primary data before full refresh. [2025-10-02T20:29:53.051850] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-10-02T20:29:53.052344] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-10-02T20:29:53.052426] [INFO ] [MAIN ] NL: Starting full primary refresh. [2025-10-02T20:29:53.077438] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-08. [2025-10-02T20:29:53.419112] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-02T20:29:53.545311] [INFO ] [REMOTE ] NL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:29:53.550131] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-05 (2.88 seconds). [2025-10-02T20:29:53.872940] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-06. [2025-10-02T20:29:54.673000] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-08. [2025-10-02T20:29:54.737590] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-02T20:29:55.473043] [INFO ] [REMOTE ] NL: Fetching primary data for 2024-12. [2025-10-02T20:29:55.544093] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-02T20:29:56.102462] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-10-02T20:29:56.214247] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-02T20:29:56.272973] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-01. [2025-10-02T20:29:57.050914] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-02T20:29:57.072985] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-02. [2025-10-02T20:29:57.782739] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-02T20:29:57.872998] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-09. [2025-10-02T20:29:58.673014] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-07. [2025-10-02T20:29:59.327468] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-02T20:29:59.472995] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-03. [2025-10-02T20:29:59.996191] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-02T20:30:00.273006] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-04. [2025-10-02T20:30:01.072999] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-09. [2025-10-02T20:30:01.092502] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-02T20:30:01.738269] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-07 (3.07 seconds). [2025-10-02T20:30:01.873021] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-08. [2025-10-02T20:30:02.183604] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-02T20:30:02.673014] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-10. [2025-10-02T20:30:03.473063] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-05. [2025-10-02T20:30:03.557541] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-02T20:30:03.559172] [INFO ] [REMOTE ] NKX: Full fetch complete (19444 records). [2025-10-02T20:30:03.559284] [DEBUG] [VALIDATOR ] NKX: Validating primary data. [2025-10-02T20:30:03.990087] [DEBUG] [VALIDATOR ] NKX: All expected trading days are present. [2025-10-02T20:30:03.990169] [DEBUG] [VALIDATOR ] NKX: Primary data validation passed. [2025-10-02T20:30:03.990606] [INFO ] [MAIN ] NKX: Fetched primary data is valid. [2025-10-02T20:30:03.990677] [DEBUG] [LOCAL ] NKX: Saving primary data. [2025-10-02T20:30:03.991337] [DEBUG] [LOCAL ] NKX: Trimmed 19444 records to 13792 (keeping 200 days of data) [2025-10-02T20:30:04.087962] [DEBUG] [LOCAL ] NKX: Primary data saved (13792 records). [2025-10-02T20:30:04.088124] [INFO ] [MAIN ] NKX: Full history saved. [2025-10-02T20:30:04.088263] [INFO ] [MAIN ] Update Progress: 1488/2370 symbols completed. NKX took 27.1s. Estimated remaining: 2h 4m 29s. Rate: 7.1 symbols/min [2025-10-02T20:30:04.276367] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-10. [2025-10-02T20:30:04.299885] [INFO ] [MAIN ] NLOP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:30:04.301524] [DEBUG] [LOCAL ] NLOP: No existing data file found in primary storage. [2025-10-02T20:30:04.301584] [WARN ] [MAIN ] NLOP: No existing data found, performing full refresh instead. [2025-10-02T20:30:04.301750] [INFO ] [MAIN ] NLOP: Wiping existing primary data before full refresh. [2025-10-02T20:30:04.301836] [INFO ] [LOCAL ] NLOP: Starting deletion of primary data. [2025-10-02T20:30:04.301890] [DEBUG] [LOCAL ] NLOP: No primary data file found to delete. [2025-10-02T20:30:04.301938] [INFO ] [MAIN ] NLOP: Starting full primary refresh. [2025-10-02T20:30:04.395219] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-02T20:30:04.759479] [INFO ] [REMOTE ] NLOP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:30:05.073010] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-06. [2025-10-02T20:30:05.109544] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-08 (3.24 seconds). [2025-10-02T20:30:05.799400] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-02T20:30:05.801515] [INFO ] [REMOTE ] NJR: Full fetch complete (54693 records). [2025-10-02T20:30:05.801706] [DEBUG] [VALIDATOR ] NJR: Validating primary data. [2025-10-02T20:30:05.878901] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2024-12. [2025-10-02T20:30:05.952900] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-02T20:30:06.267264] [DEBUG] [VALIDATOR ] NJR: All expected trading days are present. [2025-10-02T20:30:06.267406] [DEBUG] [VALIDATOR ] NJR: Primary data validation passed. [2025-10-02T20:30:06.268426] [INFO ] [MAIN ] NJR: Fetched primary data is valid. [2025-10-02T20:30:06.268502] [DEBUG] [LOCAL ] NJR: Saving primary data. [2025-10-02T20:30:06.269922] [DEBUG] [LOCAL ] NJR: Trimmed 54693 records to 38448 (keeping 200 days of data) [2025-10-02T20:30:06.546243] [DEBUG] [LOCAL ] NJR: Primary data saved (38448 records). [2025-10-02T20:30:06.546420] [INFO ] [MAIN ] NJR: Full history saved. [2025-10-02T20:30:06.546536] [INFO ] [MAIN ] Update Progress: 1489/2370 symbols completed. NJR took 46.8s. Estimated remaining: 2h 4m 17s. Rate: 7.1 symbols/min [2025-10-02T20:30:06.678181] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-07. [2025-10-02T20:30:06.744924] [INFO ] [MAIN ] NLY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:30:06.745404] [DEBUG] [LOCAL ] NLY: No existing data file found in primary storage. [2025-10-02T20:30:06.745525] [WARN ] [MAIN ] NLY: No existing data found, performing full refresh instead. [2025-10-02T20:30:06.745781] [INFO ] [MAIN ] NLY: Wiping existing primary data before full refresh. [2025-10-02T20:30:06.745828] [INFO ] [LOCAL ] NLY: Starting deletion of primary data. [2025-10-02T20:30:06.745873] [DEBUG] [LOCAL ] NLY: No primary data file found to delete. [2025-10-02T20:30:06.745906] [INFO ] [MAIN ] NLY: Starting full primary refresh. [2025-10-02T20:30:06.888356] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-02T20:30:07.156987] [INFO ] [REMOTE ] NLY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:30:07.472987] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-09. [2025-10-02T20:30:07.531422] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-02T20:30:08.273130] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-01. [2025-10-02T20:30:09.073033] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-08. [2025-10-02T20:30:09.474230] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-02T20:30:09.805253] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-02T20:30:09.872995] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-09. [2025-10-02T20:30:10.121825] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-09 (2.65 seconds). [2025-10-02T20:30:10.511238] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-02T20:30:10.673044] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-10. [2025-10-02T20:30:11.473038] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-02. [2025-10-02T20:30:12.273008] [INFO ] [REMOTE ] NLY: Fetching primary data for 2024-12. [2025-10-02T20:30:12.363470] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-02T20:30:12.926719] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-02T20:30:12.929685] [INFO ] [REMOTE ] NKE: Full fetch complete (77197 records). [2025-10-02T20:30:12.929904] [DEBUG] [VALIDATOR ] NKE: Validating primary data. [2025-10-02T20:30:13.078169] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-03. [2025-10-02T20:30:13.176436] [WARN ] [VALIDATOR ] NKE: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-02T20:30:13.177821] [FATAL] [MAIN ] NKE: Fetched primary data is invalid. Refusing to save it. [2025-10-02T20:30:13.177910] [WARN ] [MAIN ] NKE: Deleting existing primary and derivative data due to validation failure. [2025-10-02T20:30:13.177988] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-10-02T20:30:13.178063] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-10-02T20:30:13.178102] [INFO ] [LOCAL ] NKE: Starting deletion of derivative data. [2025-10-02T20:30:13.178276] [DEBUG] [LOCAL ] NKE: No derivative data file found to delete. [2025-10-02T20:30:13.178401] [INFO ] [MAIN ] Update Progress: 1490/2370 symbols completed. NKE took 44.4s. Estimated remaining: 2h 4m 7s. Rate: 7.1 symbols/min [2025-10-02T20:30:13.373072] [INFO ] [MAIN ] NMAI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:30:13.373329] [DEBUG] [LOCAL ] NMAI: No existing data file found in primary storage. [2025-10-02T20:30:13.373387] [WARN ] [MAIN ] NMAI: No existing data found, performing full refresh instead. [2025-10-02T20:30:13.373509] [INFO ] [MAIN ] NMAI: Wiping existing primary data before full refresh. [2025-10-02T20:30:13.373568] [INFO ] [LOCAL ] NMAI: Starting deletion of primary data. [2025-10-02T20:30:13.373724] [DEBUG] [LOCAL ] NMAI: No primary data file found to delete. [2025-10-02T20:30:13.373784] [INFO ] [MAIN ] NMAI: Starting full primary refresh. [2025-10-02T20:30:13.792426] [INFO ] [REMOTE ] NMAI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:30:13.873008] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2024-12. [2025-10-02T20:30:14.022931] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-02T20:30:14.324596] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-02T20:30:14.673016] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-01. [2025-10-02T20:30:15.065006] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-02T20:30:15.473044] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-01. [2025-10-02T20:30:16.273006] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-10. [2025-10-02T20:30:16.493760] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-02T20:30:16.536318] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-02T20:30:16.745560] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-02T20:30:16.746429] [INFO ] [REMOTE ] NL: Full fetch complete (6857 records). [2025-10-02T20:30:16.746511] [DEBUG] [VALIDATOR ] NL: Validating primary data. [2025-10-02T20:30:16.962675] [WARN ] [VALIDATOR ] NL: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-02T20:30:16.963935] [FATAL] [MAIN ] NL: Fetched primary data is invalid. Refusing to save it. [2025-10-02T20:30:16.964039] [WARN ] [MAIN ] NL: Deleting existing primary and derivative data due to validation failure. [2025-10-02T20:30:16.964153] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-10-02T20:30:16.964317] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-10-02T20:30:16.964414] [INFO ] [LOCAL ] NL: Starting deletion of derivative data. [2025-10-02T20:30:16.964518] [DEBUG] [LOCAL ] NL: No derivative data file found to delete. [2025-10-02T20:30:16.964636] [INFO ] [MAIN ] Update Progress: 1491/2370 symbols completed. NL took 24.1s. Estimated remaining: 2h 3m 56s. Rate: 7.1 symbols/min [2025-10-02T20:30:17.078167] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-02. [2025-10-02T20:30:17.166171] [INFO ] [MAIN ] NMAX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:30:17.166341] [DEBUG] [LOCAL ] NMAX: No existing data file found in primary storage. [2025-10-02T20:30:17.166415] [WARN ] [MAIN ] NMAX: No existing data found, performing full refresh instead. [2025-10-02T20:30:17.166548] [INFO ] [MAIN ] NMAX: Wiping existing primary data before full refresh. [2025-10-02T20:30:17.166609] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-10-02T20:30:17.166721] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-10-02T20:30:17.166776] [INFO ] [MAIN ] NMAX: Starting full primary refresh. [2025-10-02T20:30:17.578393] [INFO ] [REMOTE ] NMAX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:30:17.798439] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-02T20:30:17.873008] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-04. [2025-10-02T20:30:18.673053] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2024-12. [2025-10-02T20:30:18.896772] [DEBUG] [REMOTE ] NMAX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T20:30:18.897190] [WARN ] [REMOTE ] NMAX: No data returned for month 2024-12 [2025-10-02T20:30:18.897303] [FATAL] [REMOTE ] NMAX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T20:30:18.897397] [FATAL] [MAIN ] NMAX: Failed to fetch primary data. [2025-10-02T20:30:18.897480] [WARN ] [MAIN ] NMAX: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T20:30:18.897570] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-10-02T20:30:18.897678] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-10-02T20:30:18.897746] [INFO ] [LOCAL ] NMAX: Starting deletion of derivative data. [2025-10-02T20:30:18.897795] [DEBUG] [LOCAL ] NMAX: No derivative data file found to delete. [2025-10-02T20:30:18.897858] [INFO ] [MAIN ] Update Progress: 1492/2370 symbols completed. NMAX took 1.9s. Estimated remaining: 2h 3m 44s. Rate: 7.1 symbols/min [2025-10-02T20:30:19.100912] [INFO ] [MAIN ] NMCO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:30:19.101229] [DEBUG] [LOCAL ] NMCO: No existing data file found in primary storage. [2025-10-02T20:30:19.101303] [WARN ] [MAIN ] NMCO: No existing data found, performing full refresh instead. [2025-10-02T20:30:19.101450] [INFO ] [MAIN ] NMCO: Wiping existing primary data before full refresh. [2025-10-02T20:30:19.101600] [INFO ] [LOCAL ] NMCO: Starting deletion of primary data. [2025-10-02T20:30:19.114769] [DEBUG] [LOCAL ] NMCO: No primary data file found to delete. [2025-10-02T20:30:19.114887] [INFO ] [MAIN ] NMCO: Starting full primary refresh. [2025-10-02T20:30:19.116072] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-02T20:30:19.481180] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-05. [2025-10-02T20:30:19.529444] [INFO ] [REMOTE ] NMCO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:30:20.272991] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2024-12. [2025-10-02T20:30:20.434879] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-02T20:30:21.072992] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-03. [2025-10-02T20:30:21.162487] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-02T20:30:21.873035] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-06. [2025-10-02T20:30:22.174423] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-02T20:30:22.491513] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-02T20:30:22.673012] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-07. [2025-10-02T20:30:23.473067] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-04. [2025-10-02T20:30:23.610249] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-02T20:30:24.273074] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-02. [2025-10-02T20:30:24.381829] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-02T20:30:25.073045] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-05. [2025-10-02T20:30:25.872994] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-01. [2025-10-02T20:30:25.953411] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-02T20:30:25.989174] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-02T20:30:26.673027] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-06. [2025-10-02T20:30:26.936973] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-02T20:30:27.473056] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-03. [2025-10-02T20:30:27.625756] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-02T20:30:28.273035] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-02. [2025-10-02T20:30:29.040235] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-02T20:30:29.072963] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-07. [2025-10-02T20:30:29.600499] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-02T20:30:29.873027] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-08. [2025-10-02T20:30:30.159714] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-02T20:30:30.673012] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-04. [2025-10-02T20:30:31.076934] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-02T20:30:31.472999] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-08. [2025-10-02T20:30:32.273060] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-09. [2025-10-02T20:30:32.444360] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-02T20:30:32.949526] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-02T20:30:33.072999] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-09. [2025-10-02T20:30:33.298275] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-02T20:30:33.873036] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-03. [2025-10-02T20:30:34.114370] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-02T20:30:34.672982] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-10. [2025-10-02T20:30:34.768824] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-02T20:30:35.442707] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-02T20:30:35.444111] [INFO ] [REMOTE ] NMAI: Full fetch complete (19971 records). [2025-10-02T20:30:35.444204] [DEBUG] [VALIDATOR ] NMAI: Validating primary data. [2025-10-02T20:30:35.478149] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-10. [2025-10-02T20:30:35.893093] [DEBUG] [VALIDATOR ] NMAI: All expected trading days are present. [2025-10-02T20:30:35.893188] [DEBUG] [VALIDATOR ] NMAI: Primary data validation passed. [2025-10-02T20:30:35.893684] [INFO ] [MAIN ] NMAI: Fetched primary data is valid. [2025-10-02T20:30:35.893758] [DEBUG] [LOCAL ] NMAI: Saving primary data. [2025-10-02T20:30:35.894762] [DEBUG] [LOCAL ] NMAI: Trimmed 19971 records to 12985 (keeping 200 days of data) [2025-10-02T20:30:35.986743] [DEBUG] [LOCAL ] NMAI: Primary data saved (12985 records). [2025-10-02T20:30:35.986887] [INFO ] [MAIN ] NMAI: Full history saved. [2025-10-02T20:30:35.986965] [INFO ] [MAIN ] Update Progress: 1493/2370 symbols completed. NMAI took 22.8s. Estimated remaining: 2h 3m 40s. Rate: 7.1 symbols/min [2025-10-02T20:30:36.101931] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-02T20:30:36.103348] [INFO ] [REMOTE ] NLOP: Full fetch complete (17712 records). [2025-10-02T20:30:36.108905] [DEBUG] [VALIDATOR ] NLOP: Validating primary data. [2025-10-02T20:30:36.286813] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-05. [2025-10-02T20:30:36.291813] [INFO ] [MAIN ] NMG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:30:36.297438] [DEBUG] [LOCAL ] NMG: No existing data file found in primary storage. [2025-10-02T20:30:36.297522] [WARN ] [MAIN ] NMG: No existing data found, performing full refresh instead. [2025-10-02T20:30:36.324922] [INFO ] [MAIN ] NMG: Wiping existing primary data before full refresh. [2025-10-02T20:30:36.361017] [INFO ] [LOCAL ] NMG: Starting deletion of primary data. [2025-10-02T20:30:36.363732] [DEBUG] [LOCAL ] NMG: No primary data file found to delete. [2025-10-02T20:30:36.380607] [INFO ] [MAIN ] NMG: Starting full primary refresh. [2025-10-02T20:30:36.787470] [DEBUG] [VALIDATOR ] NLOP: All expected trading days are present. [2025-10-02T20:30:36.804223] [DEBUG] [VALIDATOR ] NLOP: Primary data validation passed. [2025-10-02T20:30:36.864196] [INFO ] [MAIN ] NLOP: Fetched primary data is valid. [2025-10-02T20:30:36.892267] [DEBUG] [LOCAL ] NLOP: Saving primary data. [2025-10-02T20:30:36.928786] [DEBUG] [LOCAL ] NLOP: Trimmed 17712 records to 11794 (keeping 200 days of data) [2025-10-02T20:30:37.060744] [INFO ] [REMOTE ] NMG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:30:37.088729] [INFO ] [REMOTE ] NMG: Fetching primary data for 2024-12. [2025-10-02T20:30:37.121816] [DEBUG] [LOCAL ] NLOP: Primary data saved (11794 records). [2025-10-02T20:30:37.122016] [INFO ] [MAIN ] NLOP: Full history saved. [2025-10-02T20:30:37.122135] [INFO ] [MAIN ] Update Progress: 1494/2370 symbols completed. NLOP took 33.0s. Estimated remaining: 2h 3m 27s. Rate: 7.1 symbols/min [2025-10-02T20:30:37.345482] [INFO ] [MAIN ] NMI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:30:37.345680] [DEBUG] [LOCAL ] NMI: No existing data file found in primary storage. [2025-10-02T20:30:37.345776] [WARN ] [MAIN ] NMI: No existing data found, performing full refresh instead. [2025-10-02T20:30:37.345896] [INFO ] [MAIN ] NMI: Wiping existing primary data before full refresh. [2025-10-02T20:30:37.345939] [INFO ] [LOCAL ] NMI: Starting deletion of primary data. [2025-10-02T20:30:37.346018] [DEBUG] [LOCAL ] NMI: No primary data file found to delete. [2025-10-02T20:30:37.346073] [INFO ] [MAIN ] NMI: Starting full primary refresh. [2025-10-02T20:30:37.755710] [INFO ] [REMOTE ] NMI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:30:37.873011] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-04. [2025-10-02T20:30:37.901598] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-02T20:30:38.672969] [INFO ] [REMOTE ] NMI: Fetching primary data for 2024-12. [2025-10-02T20:30:38.997960] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-05 (2.71 seconds). [2025-10-02T20:30:39.143252] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-02T20:30:39.158980] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-10-02T20:30:39.473013] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-01. [2025-10-02T20:30:40.239763] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-02T20:30:40.272979] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-02. [2025-10-02T20:30:41.072984] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-06. [2025-10-02T20:30:41.166336] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-02T20:30:41.873011] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-01. [2025-10-02T20:30:42.553936] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-02T20:30:42.673011] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-03. [2025-10-02T20:30:43.240269] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-02T20:30:43.358302] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-02T20:30:43.472997] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-04. [2025-10-02T20:30:44.257263] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-02T20:30:44.272985] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-02. [2025-10-02T20:30:44.795254] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-02T20:30:45.072999] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-03. [2025-10-02T20:30:45.519829] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-02T20:30:45.872999] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-05. [2025-10-02T20:30:46.618313] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-02T20:30:46.673031] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-05. [2025-10-02T20:30:47.456774] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-02T20:30:47.473006] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-07. [2025-10-02T20:30:48.273017] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-04. [2025-10-02T20:30:48.949942] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-02T20:30:49.073002] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-06. [2025-10-02T20:30:49.467400] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-02T20:30:49.824526] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-02T20:30:49.872947] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-06. [2025-10-02T20:30:50.672982] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-05. [2025-10-02T20:30:50.967122] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-02T20:30:51.207453] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-02T20:30:51.472975] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-06. [2025-10-02T20:30:52.092473] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-02T20:30:52.273038] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-08. [2025-10-02T20:30:53.073006] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-07. [2025-10-02T20:30:53.872991] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-07. [2025-10-02T20:30:54.224444] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-02T20:30:54.298009] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-02T20:30:54.579730] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-02T20:30:54.673053] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-08. [2025-10-02T20:30:55.473040] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-08. [2025-10-02T20:30:55.607631] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-02T20:30:56.250555] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-02T20:30:56.272987] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-09. [2025-10-02T20:30:56.997667] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-02T20:30:57.073023] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-09. [2025-10-02T20:30:57.873039] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-10. [2025-10-02T20:30:58.121557] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-02T20:30:58.330012] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-02T20:30:58.330789] [INFO ] [REMOTE ] NMI: Full fetch complete (6071 records). [2025-10-02T20:30:58.330864] [DEBUG] [VALIDATOR ] NMI: Validating primary data. [2025-10-02T20:30:58.682721] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-07. [2025-10-02T20:30:58.727413] [DEBUG] [VALIDATOR ] NMI: All expected trading days are present. [2025-10-02T20:30:58.727544] [DEBUG] [VALIDATOR ] NMI: Primary data validation passed. [2025-10-02T20:30:58.727793] [INFO ] [MAIN ] NMI: Fetched primary data is valid. [2025-10-02T20:30:58.727858] [DEBUG] [LOCAL ] NMI: Saving primary data. [2025-10-02T20:30:58.728322] [DEBUG] [LOCAL ] NMI: Trimmed 6071 records to 4082 (keeping 200 days of data) [2025-10-02T20:30:58.755244] [DEBUG] [LOCAL ] NMI: Primary data saved (4082 records). [2025-10-02T20:30:58.755343] [INFO ] [MAIN ] NMI: Full history saved. [2025-10-02T20:30:58.755417] [INFO ] [MAIN ] Update Progress: 1495/2370 symbols completed. NMI took 21.6s. Estimated remaining: 2h 3m 27s. Rate: 7.1 symbols/min [2025-10-02T20:30:58.945928] [INFO ] [MAIN ] NMM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:30:58.946127] [DEBUG] [LOCAL ] NMM: No existing data file found in primary storage. [2025-10-02T20:30:58.946166] [WARN ] [MAIN ] NMM: No existing data found, performing full refresh instead. [2025-10-02T20:30:58.946284] [INFO ] [MAIN ] NMM: Wiping existing primary data before full refresh. [2025-10-02T20:30:58.946328] [INFO ] [LOCAL ] NMM: Starting deletion of primary data. [2025-10-02T20:30:58.946373] [DEBUG] [LOCAL ] NMM: No primary data file found to delete. [2025-10-02T20:30:58.946408] [INFO ] [MAIN ] NMM: Starting full primary refresh. [2025-10-02T20:30:59.332071] [INFO ] [REMOTE ] NMM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:30:59.472993] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-09. [2025-10-02T20:30:59.687720] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-02T20:31:00.273027] [INFO ] [REMOTE ] NMM: Fetching primary data for 2024-12. [2025-10-02T20:31:01.072993] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-10. [2025-10-02T20:31:01.575531] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-02T20:31:01.642829] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-02T20:31:01.683152] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-02T20:31:01.684561] [INFO ] [REMOTE ] NMCO: Full fetch complete (24206 records). [2025-10-02T20:31:01.684701] [DEBUG] [VALIDATOR ] NMCO: Validating primary data. [2025-10-02T20:31:01.878114] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-01. [2025-10-02T20:31:02.146399] [DEBUG] [VALIDATOR ] NMCO: All expected trading days are present. [2025-10-02T20:31:02.146523] [DEBUG] [VALIDATOR ] NMCO: Primary data validation passed. [2025-10-02T20:31:02.147172] [INFO ] [MAIN ] NMCO: Fetched primary data is valid. [2025-10-02T20:31:02.147246] [DEBUG] [LOCAL ] NMCO: Saving primary data. [2025-10-02T20:31:02.148246] [DEBUG] [LOCAL ] NMCO: Trimmed 24206 records to 16840 (keeping 200 days of data) [2025-10-02T20:31:02.262454] [DEBUG] [LOCAL ] NMCO: Primary data saved (16840 records). [2025-10-02T20:31:02.262605] [INFO ] [MAIN ] NMCO: Full history saved. [2025-10-02T20:31:02.262737] [INFO ] [MAIN ] Update Progress: 1496/2370 symbols completed. NMCO took 43.4s. Estimated remaining: 2h 3m 15s. Rate: 7.1 symbols/min [2025-10-02T20:31:02.450913] [INFO ] [MAIN ] NMR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:31:02.451134] [DEBUG] [LOCAL ] NMR: No existing data file found in primary storage. [2025-10-02T20:31:02.451190] [WARN ] [MAIN ] NMR: No existing data found, performing full refresh instead. [2025-10-02T20:31:02.451316] [INFO ] [MAIN ] NMR: Wiping existing primary data before full refresh. [2025-10-02T20:31:02.451377] [INFO ] [LOCAL ] NMR: Starting deletion of primary data. [2025-10-02T20:31:02.451457] [DEBUG] [LOCAL ] NMR: No primary data file found to delete. [2025-10-02T20:31:02.451559] [INFO ] [MAIN ] NMR: Starting full primary refresh. [2025-10-02T20:31:02.679172] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-08. [2025-10-02T20:31:02.847295] [INFO ] [REMOTE ] NMR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:31:03.170928] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-02T20:31:03.340589] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-02T20:31:03.473012] [INFO ] [REMOTE ] NMR: Fetching primary data for 2024-12. [2025-10-02T20:31:04.272997] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-09. [2025-10-02T20:31:04.950400] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-02T20:31:05.073056] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-10. [2025-10-02T20:31:05.360409] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-02T20:31:05.873086] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-02. [2025-10-02T20:31:06.647035] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-02T20:31:06.649253] [INFO ] [REMOTE ] NLY: Full fetch complete (77567 records). [2025-10-02T20:31:06.649378] [DEBUG] [VALIDATOR ] NLY: Validating primary data. [2025-10-02T20:31:06.682192] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-01. [2025-10-02T20:31:07.005554] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-02T20:31:07.111708] [DEBUG] [VALIDATOR ] NLY: All expected trading days are present. [2025-10-02T20:31:07.111803] [DEBUG] [VALIDATOR ] NLY: Primary data validation passed. [2025-10-02T20:31:07.112876] [INFO ] [MAIN ] NLY: Fetched primary data is valid. [2025-10-02T20:31:07.112941] [DEBUG] [LOCAL ] NLY: Saving primary data. [2025-10-02T20:31:07.114488] [DEBUG] [LOCAL ] NLY: Trimmed 77567 records to 53969 (keeping 200 days of data) [2025-10-02T20:31:07.472841] [DEBUG] [LOCAL ] NLY: Primary data saved (53969 records). [2025-10-02T20:31:07.473003] [INFO ] [MAIN ] NLY: Full history saved. [2025-10-02T20:31:07.473255] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-03. [2025-10-02T20:31:07.473420] [INFO ] [MAIN ] Update Progress: 1497/2370 symbols completed. NLY took 1m 1s. Estimated remaining: 2h 3m 5s. Rate: 7.1 symbols/min [2025-10-02T20:31:07.664236] [INFO ] [MAIN ] NMS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:31:07.664545] [DEBUG] [LOCAL ] NMS: No existing data file found in primary storage. [2025-10-02T20:31:07.664602] [WARN ] [MAIN ] NMS: No existing data found, performing full refresh instead. [2025-10-02T20:31:07.664762] [INFO ] [MAIN ] NMS: Wiping existing primary data before full refresh. [2025-10-02T20:31:07.664832] [INFO ] [LOCAL ] NMS: Starting deletion of primary data. [2025-10-02T20:31:07.664905] [DEBUG] [LOCAL ] NMS: No primary data file found to delete. [2025-10-02T20:31:07.664963] [INFO ] [MAIN ] NMS: Starting full primary refresh. [2025-10-02T20:31:08.068996] [INFO ] [REMOTE ] NMS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:31:08.089071] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-02T20:31:08.272969] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-10. [2025-10-02T20:31:08.564398] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-02T20:31:09.048424] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-02T20:31:09.049550] [INFO ] [REMOTE ] NMG: Full fetch complete (13383 records). [2025-10-02T20:31:09.049683] [DEBUG] [VALIDATOR ] NMG: Validating primary data. [2025-10-02T20:31:09.078172] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-04. [2025-10-02T20:31:09.487022] [DEBUG] [VALIDATOR ] NMG: All expected trading days are present. [2025-10-02T20:31:09.487107] [DEBUG] [VALIDATOR ] NMG: Primary data validation passed. [2025-10-02T20:31:09.487456] [INFO ] [MAIN ] NMG: Fetched primary data is valid. [2025-10-02T20:31:09.487496] [DEBUG] [LOCAL ] NMG: Saving primary data. [2025-10-02T20:31:09.488035] [DEBUG] [LOCAL ] NMG: Trimmed 13383 records to 8349 (keeping 200 days of data) [2025-10-02T20:31:09.536298] [DEBUG] [LOCAL ] NMG: Primary data saved (8349 records). [2025-10-02T20:31:09.536426] [INFO ] [MAIN ] NMG: Full history saved. [2025-10-02T20:31:09.536499] [INFO ] [MAIN ] Update Progress: 1498/2370 symbols completed. NMG took 33.5s. Estimated remaining: 2h 2m 53s. Rate: 7.1 symbols/min [2025-10-02T20:31:09.724490] [INFO ] [MAIN ] NMT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:31:09.724709] [DEBUG] [LOCAL ] NMT: No existing data file found in primary storage. [2025-10-02T20:31:09.724763] [WARN ] [MAIN ] NMT: No existing data found, performing full refresh instead. [2025-10-02T20:31:09.724879] [INFO ] [MAIN ] NMT: Wiping existing primary data before full refresh. [2025-10-02T20:31:09.724922] [INFO ] [LOCAL ] NMT: Starting deletion of primary data. [2025-10-02T20:31:09.724965] [DEBUG] [LOCAL ] NMT: No primary data file found to delete. [2025-10-02T20:31:09.724999] [INFO ] [MAIN ] NMT: Starting full primary refresh. [2025-10-02T20:31:09.878181] [INFO ] [REMOTE ] NMS: Fetching primary data for 2024-12. [2025-10-02T20:31:10.156794] [INFO ] [REMOTE ] NMT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:31:10.171361] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-02T20:31:10.544560] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-02T20:31:10.673045] [INFO ] [REMOTE ] NMT: Fetching primary data for 2024-12. [2025-10-02T20:31:11.357598] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-02T20:31:11.473019] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-01. [2025-10-02T20:31:12.063900] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-02T20:31:12.273037] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-02. [2025-10-02T20:31:12.907996] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-02T20:31:13.073013] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-01. [2025-10-02T20:31:13.596374] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-02T20:31:13.873010] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-05. [2025-10-02T20:31:14.672977] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-02. [2025-10-02T20:31:14.898495] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-02T20:31:15.473054] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-06. [2025-10-02T20:31:16.273029] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-02. [2025-10-02T20:31:16.336315] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-02T20:31:16.497493] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-02T20:31:16.940868] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-02T20:31:17.073038] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-03. [2025-10-02T20:31:17.873013] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-03. [2025-10-02T20:31:18.320267] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-02T20:31:18.672993] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-03. [2025-10-02T20:31:18.762881] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-02T20:31:19.208822] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-02T20:31:19.473059] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-07. [2025-10-02T20:31:20.273048] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-04. [2025-10-02T20:31:20.379900] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-02T20:31:20.813105] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-02T20:31:21.073064] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-05. [2025-10-02T20:31:21.705911] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-02T20:31:21.873040] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-06. [2025-10-02T20:31:22.285829] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-02T20:31:22.672995] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-07. [2025-10-02T20:31:23.332416] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-02T20:31:23.473057] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-08. [2025-10-02T20:31:24.273045] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-04. [2025-10-02T20:31:24.543268] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-02T20:31:24.917167] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-02T20:31:25.073005] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-09. [2025-10-02T20:31:25.873021] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-08. [2025-10-02T20:31:26.088612] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-02T20:31:26.570793] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-02T20:31:26.673023] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-04. [2025-10-02T20:31:27.473058] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-05. [2025-10-02T20:31:28.181569] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-02T20:31:28.272975] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-09. [2025-10-02T20:31:28.783795] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-02T20:31:28.831405] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-02T20:31:29.073011] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-10. [2025-10-02T20:31:29.744710] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-02T20:31:29.745777] [INFO ] [REMOTE ] NMM: Full fetch complete (21904 records). [2025-10-02T20:31:29.745854] [DEBUG] [VALIDATOR ] NMM: Validating primary data. [2025-10-02T20:31:29.872999] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-06. [2025-10-02T20:31:30.168350] [DEBUG] [VALIDATOR ] NMM: All expected trading days are present. [2025-10-02T20:31:30.168440] [DEBUG] [VALIDATOR ] NMM: Primary data validation passed. [2025-10-02T20:31:30.169135] [INFO ] [MAIN ] NMM: Fetched primary data is valid. [2025-10-02T20:31:30.169209] [DEBUG] [LOCAL ] NMM: Saving primary data. [2025-10-02T20:31:30.170019] [DEBUG] [LOCAL ] NMM: Trimmed 21904 records to 14430 (keeping 200 days of data) [2025-10-02T20:31:30.267320] [DEBUG] [LOCAL ] NMM: Primary data saved (14430 records). [2025-10-02T20:31:30.267478] [INFO ] [MAIN ] NMM: Full history saved. [2025-10-02T20:31:30.267560] [INFO ] [MAIN ] Update Progress: 1499/2370 symbols completed. NMM took 31.5s. Estimated remaining: 2h 2m 52s. Rate: 7.1 symbols/min [2025-10-02T20:31:30.469822] [INFO ] [MAIN ] NMZ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:31:30.470061] [DEBUG] [LOCAL ] NMZ: No existing data file found in primary storage. [2025-10-02T20:31:30.470120] [WARN ] [MAIN ] NMZ: No existing data found, performing full refresh instead. [2025-10-02T20:31:30.470310] [INFO ] [MAIN ] NMZ: Wiping existing primary data before full refresh. [2025-10-02T20:31:30.470378] [INFO ] [LOCAL ] NMZ: Starting deletion of primary data. [2025-10-02T20:31:30.470442] [DEBUG] [LOCAL ] NMZ: No primary data file found to delete. [2025-10-02T20:31:30.470498] [INFO ] [MAIN ] NMZ: Starting full primary refresh. [2025-10-02T20:31:30.563939] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-02T20:31:30.681776] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-10. [2025-10-02T20:31:30.925916] [INFO ] [REMOTE ] NMZ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:31:31.265504] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-02T20:31:31.266328] [INFO ] [REMOTE ] NMT: Full fetch complete (4085 records). [2025-10-02T20:31:31.266408] [DEBUG] [VALIDATOR ] NMT: Validating primary data. [2025-10-02T20:31:31.477083] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-05. [2025-10-02T20:31:31.705224] [DEBUG] [VALIDATOR ] NMT: All expected trading days are present. [2025-10-02T20:31:31.705307] [DEBUG] [VALIDATOR ] NMT: Primary data validation passed. [2025-10-02T20:31:31.705446] [INFO ] [MAIN ] NMT: Fetched primary data is valid. [2025-10-02T20:31:31.705488] [DEBUG] [LOCAL ] NMT: Saving primary data. [2025-10-02T20:31:31.705979] [DEBUG] [LOCAL ] NMT: Trimmed 4085 records to 2883 (keeping 200 days of data) [2025-10-02T20:31:31.725465] [DEBUG] [LOCAL ] NMT: Primary data saved (2883 records). [2025-10-02T20:31:31.725601] [INFO ] [MAIN ] NMT: Full history saved. [2025-10-02T20:31:31.725701] [INFO ] [MAIN ] Update Progress: 1500/2370 symbols completed. NMT took 22.2s. Estimated remaining: 2h 2m 39s. Rate: 7.1 symbols/min [2025-10-02T20:31:31.912216] [INFO ] [MAIN ] NNI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:31:31.912485] [DEBUG] [LOCAL ] NNI: No existing data file found in primary storage. [2025-10-02T20:31:31.912543] [WARN ] [MAIN ] NNI: No existing data found, performing full refresh instead. [2025-10-02T20:31:31.912687] [INFO ] [MAIN ] NNI: Wiping existing primary data before full refresh. [2025-10-02T20:31:31.912749] [INFO ] [LOCAL ] NNI: Starting deletion of primary data. [2025-10-02T20:31:31.912835] [DEBUG] [LOCAL ] NNI: No primary data file found to delete. [2025-10-02T20:31:31.912911] [INFO ] [MAIN ] NNI: Starting full primary refresh. [2025-10-02T20:31:32.286046] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-07. [2025-10-02T20:31:32.293069] [INFO ] [REMOTE ] NNI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:31:32.670614] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-02T20:31:32.907316] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-02T20:31:33.072992] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2024-12. [2025-10-02T20:31:33.873036] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-08. [2025-10-02T20:31:34.131431] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-02T20:31:34.484430] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-02T20:31:34.672998] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-09. [2025-10-02T20:31:35.268794] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-02T20:31:35.472987] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-06. [2025-10-02T20:31:36.273000] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-10. [2025-10-02T20:31:36.709463] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-02T20:31:36.710259] [INFO ] [REMOTE ] NMS: Full fetch complete (4036 records). [2025-10-02T20:31:36.710337] [DEBUG] [VALIDATOR ] NMS: Validating primary data. [2025-10-02T20:31:37.047592] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-02T20:31:37.086085] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-01. [2025-10-02T20:31:37.145479] [DEBUG] [VALIDATOR ] NMS: All expected trading days are present. [2025-10-02T20:31:37.145559] [DEBUG] [VALIDATOR ] NMS: Primary data validation passed. [2025-10-02T20:31:37.145721] [INFO ] [MAIN ] NMS: Fetched primary data is valid. [2025-10-02T20:31:37.145783] [DEBUG] [LOCAL ] NMS: Saving primary data. [2025-10-02T20:31:37.146216] [DEBUG] [LOCAL ] NMS: Trimmed 4036 records to 2875 (keeping 200 days of data) [2025-10-02T20:31:37.165003] [DEBUG] [LOCAL ] NMS: Primary data saved (2875 records). [2025-10-02T20:31:37.165092] [INFO ] [MAIN ] NMS: Full history saved. [2025-10-02T20:31:37.165158] [INFO ] [MAIN ] Update Progress: 1501/2370 symbols completed. NMS took 29.7s. Estimated remaining: 2h 2m 29s. Rate: 7.1 symbols/min [2025-10-02T20:31:37.352827] [INFO ] [MAIN ] NNN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:31:37.353052] [DEBUG] [LOCAL ] NNN: No existing data file found in primary storage. [2025-10-02T20:31:37.353138] [WARN ] [MAIN ] NNN: No existing data found, performing full refresh instead. [2025-10-02T20:31:37.353282] [INFO ] [MAIN ] NNN: Wiping existing primary data before full refresh. [2025-10-02T20:31:37.353365] [INFO ] [LOCAL ] NNN: Starting deletion of primary data. [2025-10-02T20:31:37.353458] [DEBUG] [LOCAL ] NNN: No primary data file found to delete. [2025-10-02T20:31:37.353538] [INFO ] [MAIN ] NNN: Starting full primary refresh. [2025-10-02T20:31:37.753675] [INFO ] [REMOTE ] NNN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:31:37.873029] [INFO ] [REMOTE ] NNN: Fetching primary data for 2024-12. [2025-10-02T20:31:38.134967] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-02T20:31:38.672997] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-02. [2025-10-02T20:31:39.472998] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-07. [2025-10-02T20:31:39.770140] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-02T20:31:40.048334] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-10-02T20:31:40.273004] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-03. [2025-10-02T20:31:41.072972] [INFO ] [REMOTE ] NNI: Fetching primary data for 2024-12. [2025-10-02T20:31:41.097003] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-02T20:31:41.182580] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-02T20:31:41.873006] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-01. [2025-10-02T20:31:41.989199] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-02T20:31:42.673000] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-08. [2025-10-02T20:31:43.276681] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-02T20:31:43.473006] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-02. [2025-10-02T20:31:44.104024] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-02T20:31:44.273005] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-04. [2025-10-02T20:31:45.072984] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-09. [2025-10-02T20:31:45.270587] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-02T20:31:45.333624] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-02T20:31:45.873003] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-03. [2025-10-02T20:31:46.529555] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-02T20:31:46.673040] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-05. [2025-10-02T20:31:47.472979] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-01. [2025-10-02T20:31:47.591745] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-02T20:31:47.818178] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-02T20:31:48.273040] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-10. [2025-10-02T20:31:48.286210] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-02T20:31:49.073038] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-02. [2025-10-02T20:31:49.426895] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-02T20:31:49.428546] [INFO ] [REMOTE ] NMR: Full fetch complete (50586 records). [2025-10-02T20:31:49.428635] [DEBUG] [VALIDATOR ] NMR: Validating primary data. [2025-10-02T20:31:49.750749] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-02T20:31:49.846935] [DEBUG] [VALIDATOR ] NMR: All expected trading days are present. [2025-10-02T20:31:49.847033] [DEBUG] [VALIDATOR ] NMR: Primary data validation passed. [2025-10-02T20:31:49.847872] [INFO ] [MAIN ] NMR: Fetched primary data is valid. [2025-10-02T20:31:49.847936] [DEBUG] [LOCAL ] NMR: Saving primary data. [2025-10-02T20:31:49.849225] [DEBUG] [LOCAL ] NMR: Trimmed 50586 records to 35236 (keeping 200 days of data) [2025-10-02T20:31:49.898089] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-04. [2025-10-02T20:31:50.062367] [DEBUG] [LOCAL ] NMR: Primary data saved (35236 records). [2025-10-02T20:31:50.062514] [INFO ] [MAIN ] NMR: Full history saved. [2025-10-02T20:31:50.062600] [INFO ] [MAIN ] Update Progress: 1502/2370 symbols completed. NMR took 47.8s. Estimated remaining: 2h 2m 23s. Rate: 7.1 symbols/min [2025-10-02T20:31:50.249170] [INFO ] [MAIN ] NNY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:31:50.249531] [DEBUG] [LOCAL ] NNY: No existing data file found in primary storage. [2025-10-02T20:31:50.249586] [WARN ] [MAIN ] NNY: No existing data found, performing full refresh instead. [2025-10-02T20:31:50.249724] [INFO ] [MAIN ] NNY: Wiping existing primary data before full refresh. [2025-10-02T20:31:50.249772] [INFO ] [LOCAL ] NNY: Starting deletion of primary data. [2025-10-02T20:31:50.249815] [DEBUG] [LOCAL ] NNY: No primary data file found to delete. [2025-10-02T20:31:50.249847] [INFO ] [MAIN ] NNY: Starting full primary refresh. [2025-10-02T20:31:50.649149] [INFO ] [REMOTE ] NNY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:31:50.672976] [INFO ] [REMOTE ] NNY: Fetching primary data for 2024-12. [2025-10-02T20:31:51.472988] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-03. [2025-10-02T20:31:51.566452] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-02T20:31:51.884602] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-02T20:31:52.273041] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-01. [2025-10-02T20:31:52.284011] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-02T20:31:52.953802] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-02T20:31:53.073038] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-04. [2025-10-02T20:31:53.873047] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-05. [2025-10-02T20:31:53.944043] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-02T20:31:54.673043] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-05. [2025-10-02T20:31:55.405762] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-02T20:31:55.472971] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-06. [2025-10-02T20:31:55.577266] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-02T20:31:56.272972] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-06. [2025-10-02T20:31:56.601379] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-02T20:31:57.072988] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-06. [2025-10-02T20:31:57.875634] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-07. [2025-10-02T20:31:57.878667] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-02T20:31:58.032475] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-02T20:31:58.672998] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-07. [2025-10-02T20:31:59.112144] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-02T20:31:59.473060] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-02. [2025-10-02T20:32:00.161051] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-02T20:32:00.255521] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-02T20:32:00.272987] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-08. [2025-10-02T20:32:01.073002] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-03. [2025-10-02T20:32:01.868869] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-02T20:32:01.871868] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-02T20:32:01.873441] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-08. [2025-10-02T20:32:02.673006] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-09. [2025-10-02T20:32:03.038191] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-02T20:32:03.473005] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-07. [2025-10-02T20:32:04.272996] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-04. [2025-10-02T20:32:04.495436] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-02T20:32:04.539312] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-02T20:32:04.831506] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-02T20:32:05.073026] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-05. [2025-10-02T20:32:05.815279] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-02T20:32:05.873048] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-08. [2025-10-02T20:32:06.672993] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-06. [2025-10-02T20:32:06.786442] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-02T20:32:07.345716] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-02T20:32:07.473072] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-09. [2025-10-02T20:32:08.273051] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-10. [2025-10-02T20:32:08.477779] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-02T20:32:09.073050] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-10. [2025-10-02T20:32:09.500848] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-02T20:32:09.503492] [INFO ] [REMOTE ] NNN: Full fetch complete (70283 records). [2025-10-02T20:32:09.503639] [DEBUG] [VALIDATOR ] NNN: Validating primary data. [2025-10-02T20:32:09.879521] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-09. [2025-10-02T20:32:09.947279] [DEBUG] [VALIDATOR ] NNN: All expected trading days are present. [2025-10-02T20:32:09.947367] [DEBUG] [VALIDATOR ] NNN: Primary data validation passed. [2025-10-02T20:32:09.948392] [INFO ] [MAIN ] NNN: Fetched primary data is valid. [2025-10-02T20:32:09.948501] [DEBUG] [LOCAL ] NNN: Saving primary data. [2025-10-02T20:32:09.950202] [DEBUG] [LOCAL ] NNN: Trimmed 70283 records to 48691 (keeping 200 days of data) [2025-10-02T20:32:10.026446] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-02T20:32:10.057340] [INFO ] [REMOTE ] NMZ: Full fetch complete (31899 records). [2025-10-02T20:32:10.058069] [DEBUG] [VALIDATOR ] NMZ: Validating primary data. [2025-10-02T20:32:10.510340] [DEBUG] [VALIDATOR ] NMZ: All expected trading days are present. [2025-10-02T20:32:10.511025] [DEBUG] [VALIDATOR ] NMZ: Primary data validation passed. [2025-10-02T20:32:10.511831] [INFO ] [MAIN ] NMZ: Fetched primary data is valid. [2025-10-02T20:32:10.511936] [DEBUG] [LOCAL ] NMZ: Saving primary data. [2025-10-02T20:32:10.515453] [DEBUG] [LOCAL ] NMZ: Trimmed 31899 records to 21855 (keeping 200 days of data) [2025-10-02T20:32:10.681447] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-07. [2025-10-02T20:32:10.795003] [DEBUG] [LOCAL ] NMZ: Primary data saved (21855 records). [2025-10-02T20:32:10.795840] [INFO ] [MAIN ] NMZ: Full history saved. [2025-10-02T20:32:10.797272] [INFO ] [MAIN ] Update Progress: 1503/2370 symbols completed. NMZ took 40.5s. Estimated remaining: 2h 2m 22s. Rate: 7.1 symbols/min [2025-10-02T20:32:11.022025] [INFO ] [MAIN ] NOA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:32:11.024141] [DEBUG] [LOCAL ] NOA: No existing data file found in primary storage. [2025-10-02T20:32:11.068361] [WARN ] [MAIN ] NOA: No existing data found, performing full refresh instead. [2025-10-02T20:32:11.080768] [INFO ] [MAIN ] NOA: Wiping existing primary data before full refresh. [2025-10-02T20:32:11.082119] [INFO ] [LOCAL ] NOA: Starting deletion of primary data. [2025-10-02T20:32:11.082896] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-02T20:32:11.087716] [DEBUG] [LOCAL ] NOA: No primary data file found to delete. [2025-10-02T20:32:11.090254] [INFO ] [MAIN ] NOA: Starting full primary refresh. [2025-10-02T20:32:11.472278] [DEBUG] [LOCAL ] NNN: Primary data saved (48691 records). [2025-10-02T20:32:11.477197] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-10. [2025-10-02T20:32:11.500385] [INFO ] [MAIN ] NNN: Full history saved. [2025-10-02T20:32:11.520042] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-02T20:32:11.551035] [INFO ] [REMOTE ] NOA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:32:11.520229] [INFO ] [MAIN ] Update Progress: 1504/2370 symbols completed. NNN took 34.4s. Estimated remaining: 2h 2m 9s. Rate: 7.1 symbols/min [2025-10-02T20:32:11.749702] [INFO ] [MAIN ] NOAH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:32:11.749919] [DEBUG] [LOCAL ] NOAH: No existing data file found in primary storage. [2025-10-02T20:32:11.749967] [WARN ] [MAIN ] NOAH: No existing data found, performing full refresh instead. [2025-10-02T20:32:11.750106] [INFO ] [MAIN ] NOAH: Wiping existing primary data before full refresh. [2025-10-02T20:32:11.750174] [INFO ] [LOCAL ] NOAH: Starting deletion of primary data. [2025-10-02T20:32:11.750226] [DEBUG] [LOCAL ] NOAH: No primary data file found to delete. [2025-10-02T20:32:11.750261] [INFO ] [MAIN ] NOAH: Starting full primary refresh. [2025-10-02T20:32:12.184511] [INFO ] [REMOTE ] NOAH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:32:12.223479] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-02T20:32:12.225336] [INFO ] [REMOTE ] NNI: Full fetch complete (12919 records). [2025-10-02T20:32:12.225425] [DEBUG] [VALIDATOR ] NNI: Validating primary data. [2025-10-02T20:32:12.278243] [INFO ] [REMOTE ] NOA: Fetching primary data for 2024-12. [2025-10-02T20:32:12.635231] [DEBUG] [VALIDATOR ] NNI: All expected trading days are present. [2025-10-02T20:32:12.635312] [DEBUG] [VALIDATOR ] NNI: Primary data validation passed. [2025-10-02T20:32:12.635635] [INFO ] [MAIN ] NNI: Fetched primary data is valid. [2025-10-02T20:32:12.635716] [DEBUG] [LOCAL ] NNI: Saving primary data. [2025-10-02T20:32:12.636275] [DEBUG] [LOCAL ] NNI: Trimmed 12919 records to 10284 (keeping 200 days of data) [2025-10-02T20:32:12.704565] [DEBUG] [LOCAL ] NNI: Primary data saved (10284 records). [2025-10-02T20:32:12.704732] [INFO ] [MAIN ] NNI: Full history saved. [2025-10-02T20:32:12.704818] [INFO ] [MAIN ] Update Progress: 1505/2370 symbols completed. NNI took 41.0s. Estimated remaining: 2h 1m 56s. Rate: 7.1 symbols/min [2025-10-02T20:32:12.897714] [INFO ] [MAIN ] NOC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:32:12.897891] [DEBUG] [LOCAL ] NOC: No existing data file found in primary storage. [2025-10-02T20:32:12.897940] [WARN ] [MAIN ] NOC: No existing data found, performing full refresh instead. [2025-10-02T20:32:12.898059] [INFO ] [MAIN ] NOC: Wiping existing primary data before full refresh. [2025-10-02T20:32:12.898106] [INFO ] [LOCAL ] NOC: Starting deletion of primary data. [2025-10-02T20:32:12.898171] [DEBUG] [LOCAL ] NOC: No primary data file found to delete. [2025-10-02T20:32:12.898254] [INFO ] [MAIN ] NOC: Starting full primary refresh. [2025-10-02T20:32:13.074731] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2024-12. [2025-10-02T20:32:13.265878] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-02T20:32:13.333344] [INFO ] [REMOTE ] NOC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:32:13.873045] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-01. [2025-10-02T20:32:14.466612] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-02T20:32:14.672919] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-08. [2025-10-02T20:32:14.893767] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-02T20:32:15.417486] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-02T20:32:15.473052] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-09. [2025-10-02T20:32:16.273034] [INFO ] [REMOTE ] NOC: Fetching primary data for 2024-12. [2025-10-02T20:32:16.395123] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-02T20:32:17.073010] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-01. [2025-10-02T20:32:17.873008] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-02. [2025-10-02T20:32:18.014898] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-02T20:32:18.206332] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-02T20:32:18.673003] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-01. [2025-10-02T20:32:18.850002] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-02T20:32:19.473009] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-03. [2025-10-02T20:32:20.095347] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-02T20:32:20.273008] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-02. [2025-10-02T20:32:20.669979] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-02T20:32:21.015871] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-02T20:32:21.073014] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-03. [2025-10-02T20:32:21.872979] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-10. [2025-10-02T20:32:22.023588] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-02T20:32:22.584019] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-02T20:32:22.584949] [INFO ] [REMOTE ] NNY: Full fetch complete (8820 records). [2025-10-02T20:32:22.585033] [DEBUG] [VALIDATOR ] NNY: Validating primary data. [2025-10-02T20:32:22.678192] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-04. [2025-10-02T20:32:22.978137] [DEBUG] [VALIDATOR ] NNY: All expected trading days are present. [2025-10-02T20:32:22.978241] [DEBUG] [VALIDATOR ] NNY: Primary data validation passed. [2025-10-02T20:32:22.978473] [INFO ] [MAIN ] NNY: Fetched primary data is valid. [2025-10-02T20:32:22.978520] [DEBUG] [LOCAL ] NNY: Saving primary data. [2025-10-02T20:32:22.979011] [DEBUG] [LOCAL ] NNY: Trimmed 8820 records to 5763 (keeping 200 days of data) [2025-10-02T20:32:23.015782] [DEBUG] [LOCAL ] NNY: Primary data saved (5763 records). [2025-10-02T20:32:23.015926] [INFO ] [MAIN ] NNY: Full history saved. [2025-10-02T20:32:23.016004] [INFO ] [MAIN ] Update Progress: 1506/2370 symbols completed. NNY took 33.0s. Estimated remaining: 2h 1m 49s. Rate: 7.1 symbols/min [2025-10-02T20:32:23.200029] [INFO ] [MAIN ] NOG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:32:23.200261] [DEBUG] [LOCAL ] NOG: No existing data file found in primary storage. [2025-10-02T20:32:23.200316] [WARN ] [MAIN ] NOG: No existing data found, performing full refresh instead. [2025-10-02T20:32:23.200447] [INFO ] [MAIN ] NOG: Wiping existing primary data before full refresh. [2025-10-02T20:32:23.200503] [INFO ] [LOCAL ] NOG: Starting deletion of primary data. [2025-10-02T20:32:23.200611] [DEBUG] [LOCAL ] NOG: No primary data file found to delete. [2025-10-02T20:32:23.200851] [INFO ] [MAIN ] NOG: Starting full primary refresh. [2025-10-02T20:32:23.478242] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-02. [2025-10-02T20:32:23.605184] [INFO ] [REMOTE ] NOG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:32:23.942640] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-02T20:32:24.273030] [INFO ] [REMOTE ] NOG: Fetching primary data for 2024-12. [2025-10-02T20:32:25.072965] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-05. [2025-10-02T20:32:25.395660] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-02T20:32:25.873002] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-03. [2025-10-02T20:32:25.904568] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-02T20:32:25.928485] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-02T20:32:26.673130] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-01. [2025-10-02T20:32:27.473033] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-06. [2025-10-02T20:32:27.662610] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-02T20:32:28.241850] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-02T20:32:28.263251] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-02T20:32:28.272999] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-04. [2025-10-02T20:32:29.073056] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-02. [2025-10-02T20:32:29.873030] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-04. [2025-10-02T20:32:30.374665] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-02T20:32:30.673032] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-05. [2025-10-02T20:32:30.826750] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-02T20:32:30.884367] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-02T20:32:31.473059] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-05. [2025-10-02T20:32:32.272983] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-03. [2025-10-02T20:32:32.317133] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-02T20:32:32.472895] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-02T20:32:33.073035] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-06. [2025-10-02T20:32:33.873010] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-07. [2025-10-02T20:32:34.272143] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-02T20:32:34.672975] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-04. [2025-10-02T20:32:34.965660] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-02T20:32:35.010960] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-02T20:32:35.472999] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-08. [2025-10-02T20:32:36.273025] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-07. [2025-10-02T20:32:36.769943] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-02T20:32:36.805984] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-02T20:32:37.073031] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-09. [2025-10-02T20:32:37.756177] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-02T20:32:37.872972] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-08. [2025-10-02T20:32:38.163966] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-02T20:32:38.673006] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-05. [2025-10-02T20:32:39.472983] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-10. [2025-10-02T20:32:39.554703] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-02T20:32:40.167838] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-02T20:32:40.170437] [INFO ] [REMOTE ] NOA: Full fetch complete (21984 records). [2025-10-02T20:32:40.170516] [DEBUG] [VALIDATOR ] NOA: Validating primary data. [2025-10-02T20:32:40.279610] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-09. [2025-10-02T20:32:40.598406] [DEBUG] [VALIDATOR ] NOA: All expected trading days are present. [2025-10-02T20:32:40.598660] [DEBUG] [VALIDATOR ] NOA: Primary data validation passed. [2025-10-02T20:32:40.599361] [INFO ] [MAIN ] NOA: Fetched primary data is valid. [2025-10-02T20:32:40.599496] [DEBUG] [LOCAL ] NOA: Saving primary data. [2025-10-02T20:32:40.601243] [DEBUG] [LOCAL ] NOA: Trimmed 21984 records to 16282 (keeping 200 days of data) [2025-10-02T20:32:40.717959] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-02T20:32:40.758759] [DEBUG] [LOCAL ] NOA: Primary data saved (16282 records). [2025-10-02T20:32:40.758903] [INFO ] [MAIN ] NOA: Full history saved. [2025-10-02T20:32:40.758977] [INFO ] [MAIN ] Update Progress: 1507/2370 symbols completed. NOA took 30.0s. Estimated remaining: 2h 1m 45s. Rate: 7.1 symbols/min [2025-10-02T20:32:40.937769] [INFO ] [MAIN ] NOK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:32:40.937939] [DEBUG] [LOCAL ] NOK: No existing data file found in primary storage. [2025-10-02T20:32:40.937976] [WARN ] [MAIN ] NOK: No existing data found, performing full refresh instead. [2025-10-02T20:32:40.938090] [INFO ] [MAIN ] NOK: Wiping existing primary data before full refresh. [2025-10-02T20:32:40.938132] [INFO ] [LOCAL ] NOK: Starting deletion of primary data. [2025-10-02T20:32:40.938178] [DEBUG] [LOCAL ] NOK: No primary data file found to delete. [2025-10-02T20:32:40.938291] [INFO ] [MAIN ] NOK: Starting full primary refresh. [2025-10-02T20:32:41.078140] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-06. [2025-10-02T20:32:41.335806] [INFO ] [REMOTE ] NOK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:32:41.872961] [INFO ] [REMOTE ] NOK: Fetching primary data for 2024-12. [2025-10-02T20:32:42.053176] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-02T20:32:42.672960] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-10. [2025-10-02T20:32:42.778667] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-02T20:32:43.473044] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-07. [2025-10-02T20:32:43.774852] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-02T20:32:43.776551] [INFO ] [REMOTE ] NOC: Full fetch complete (61795 records). [2025-10-02T20:32:43.776717] [DEBUG] [VALIDATOR ] NOC: Validating primary data. [2025-10-02T20:32:44.203670] [DEBUG] [VALIDATOR ] NOC: All expected trading days are present. [2025-10-02T20:32:44.203831] [DEBUG] [VALIDATOR ] NOC: Primary data validation passed. [2025-10-02T20:32:44.204991] [INFO ] [MAIN ] NOC: Fetched primary data is valid. [2025-10-02T20:32:44.205078] [DEBUG] [LOCAL ] NOC: Saving primary data. [2025-10-02T20:32:44.206542] [DEBUG] [LOCAL ] NOC: Trimmed 61795 records to 42344 (keeping 200 days of data) [2025-10-02T20:32:44.277524] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-06. [2025-10-02T20:32:44.494602] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2024-12 (2.62 seconds). [2025-10-02T20:32:44.564060] [DEBUG] [LOCAL ] NOC: Primary data saved (42344 records). [2025-10-02T20:32:44.564206] [INFO ] [MAIN ] NOC: Full history saved. [2025-10-02T20:32:44.564318] [INFO ] [MAIN ] Update Progress: 1508/2370 symbols completed. NOC took 31.9s. Estimated remaining: 2h 1m 34s. Rate: 7.1 symbols/min [2025-10-02T20:32:44.785774] [INFO ] [MAIN ] NOM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:32:44.786025] [DEBUG] [LOCAL ] NOM: No existing data file found in primary storage. [2025-10-02T20:32:44.786102] [WARN ] [MAIN ] NOM: No existing data found, performing full refresh instead. [2025-10-02T20:32:44.786262] [INFO ] [MAIN ] NOM: Wiping existing primary data before full refresh. [2025-10-02T20:32:44.786334] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-10-02T20:32:44.786422] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-10-02T20:32:44.786487] [INFO ] [MAIN ] NOM: Starting full primary refresh. [2025-10-02T20:32:45.077746] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-01. [2025-10-02T20:32:45.241800] [INFO ] [REMOTE ] NOM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:32:45.275882] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-02T20:32:45.302869] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-02T20:32:45.872980] [INFO ] [REMOTE ] NOM: Fetching primary data for 2024-12. [2025-10-02T20:32:46.423869] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-02T20:32:46.673018] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-07. [2025-10-02T20:32:47.120173] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-02T20:32:47.473005] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-02. [2025-10-02T20:32:47.817987] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-02T20:32:48.273025] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-08. [2025-10-02T20:32:49.073053] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-01. [2025-10-02T20:32:49.561056] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-02T20:32:49.652122] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-10-02T20:32:49.748580] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-02T20:32:49.873038] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-09. [2025-10-02T20:32:50.673010] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-02. [2025-10-02T20:32:51.143874] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-02T20:32:51.469054] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-02T20:32:51.473096] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-03. [2025-10-02T20:32:51.955190] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-02T20:32:52.273005] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-03. [2025-10-02T20:32:53.073020] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-08. [2025-10-02T20:32:53.873023] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-10. [2025-10-02T20:32:54.147489] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-02T20:32:54.414112] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-02T20:32:54.673068] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-04. [2025-10-02T20:32:55.364236] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-02T20:32:55.366460] [INFO ] [REMOTE ] NOG: Full fetch complete (73907 records). [2025-10-02T20:32:55.366595] [DEBUG] [VALIDATOR ] NOG: Validating primary data. [2025-10-02T20:32:55.478886] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-04. [2025-10-02T20:32:55.844603] [DEBUG] [VALIDATOR ] NOG: All expected trading days are present. [2025-10-02T20:32:55.844746] [DEBUG] [VALIDATOR ] NOG: Primary data validation passed. [2025-10-02T20:32:55.845884] [INFO ] [MAIN ] NOG: Fetched primary data is valid. [2025-10-02T20:32:55.845977] [DEBUG] [LOCAL ] NOG: Saving primary data. [2025-10-02T20:32:55.847675] [DEBUG] [LOCAL ] NOG: Trimmed 73907 records to 51580 (keeping 200 days of data) [2025-10-02T20:32:56.050094] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-02T20:32:56.195884] [DEBUG] [LOCAL ] NOG: Primary data saved (51580 records). [2025-10-02T20:32:56.196074] [INFO ] [MAIN ] NOG: Full history saved. [2025-10-02T20:32:56.196177] [INFO ] [MAIN ] Update Progress: 1509/2370 symbols completed. NOG took 33.2s. Estimated remaining: 2h 1m 28s. Rate: 7.1 symbols/min [2025-10-02T20:32:56.279997] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-09. [2025-10-02T20:32:56.390540] [INFO ] [MAIN ] NOMD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:32:56.391040] [DEBUG] [LOCAL ] NOMD: No existing data file found in primary storage. [2025-10-02T20:32:56.391100] [WARN ] [MAIN ] NOMD: No existing data found, performing full refresh instead. [2025-10-02T20:32:56.391297] [INFO ] [MAIN ] NOMD: Wiping existing primary data before full refresh. [2025-10-02T20:32:56.391345] [INFO ] [LOCAL ] NOMD: Starting deletion of primary data. [2025-10-02T20:32:56.391388] [DEBUG] [LOCAL ] NOMD: No primary data file found to delete. [2025-10-02T20:32:56.391422] [INFO ] [MAIN ] NOMD: Starting full primary refresh. [2025-10-02T20:32:56.841695] [INFO ] [REMOTE ] NOMD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:32:57.005859] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-02T20:32:57.072982] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-05. [2025-10-02T20:32:57.510508] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-02T20:32:57.873004] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-10. [2025-10-02T20:32:58.673025] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-05. [2025-10-02T20:32:58.735597] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-02T20:32:58.738454] [INFO ] [REMOTE ] NOAH: Full fetch complete (28557 records). [2025-10-02T20:32:58.738608] [DEBUG] [VALIDATOR ] NOAH: Validating primary data. [2025-10-02T20:32:59.150216] [DEBUG] [VALIDATOR ] NOAH: All expected trading days are present. [2025-10-02T20:32:59.150361] [DEBUG] [VALIDATOR ] NOAH: Primary data validation passed. [2025-10-02T20:32:59.151115] [INFO ] [MAIN ] NOAH: Fetched primary data is valid. [2025-10-02T20:32:59.151202] [DEBUG] [LOCAL ] NOAH: Saving primary data. [2025-10-02T20:32:59.152221] [DEBUG] [LOCAL ] NOAH: Trimmed 28557 records to 20504 (keeping 200 days of data) [2025-10-02T20:32:59.255171] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-02T20:32:59.294878] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-10-02T20:32:59.339530] [DEBUG] [LOCAL ] NOAH: Primary data saved (20504 records). [2025-10-02T20:32:59.339694] [INFO ] [MAIN ] NOAH: Full history saved. [2025-10-02T20:32:59.339786] [INFO ] [MAIN ] Update Progress: 1510/2370 symbols completed. NOAH took 47.8s. Estimated remaining: 2h 1m 16s. Rate: 7.1 symbols/min [2025-10-02T20:32:59.478145] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2024-12. [2025-10-02T20:32:59.533431] [INFO ] [MAIN ] NOTE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:32:59.533724] [DEBUG] [LOCAL ] NOTE: No existing data file found in primary storage. [2025-10-02T20:32:59.533827] [WARN ] [MAIN ] NOTE: No existing data found, performing full refresh instead. [2025-10-02T20:32:59.533917] [INFO ] [MAIN ] NOTE: Wiping existing primary data before full refresh. [2025-10-02T20:32:59.533958] [INFO ] [LOCAL ] NOTE: Starting deletion of primary data. [2025-10-02T20:32:59.534005] [DEBUG] [LOCAL ] NOTE: No primary data file found to delete. [2025-10-02T20:32:59.534042] [INFO ] [MAIN ] NOTE: Starting full primary refresh. [2025-10-02T20:32:59.924269] [INFO ] [REMOTE ] NOTE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:33:00.273059] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-06. [2025-10-02T20:33:00.984346] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-02T20:33:01.073058] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-01. [2025-10-02T20:33:01.873028] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2024-12. [2025-10-02T20:33:02.513800] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-10-02T20:33:02.672976] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-07. [2025-10-02T20:33:02.773623] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-02T20:33:03.473072] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-06. [2025-10-02T20:33:03.889008] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-02T20:33:03.976115] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-02T20:33:04.273033] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-02. [2025-10-02T20:33:05.062839] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-02T20:33:05.074166] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-01. [2025-10-02T20:33:05.404400] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-02T20:33:05.873040] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-07. [2025-10-02T20:33:06.395747] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-02T20:33:06.672975] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-08. [2025-10-02T20:33:07.184178] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-02T20:33:07.225857] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-02T20:33:07.473045] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-03. [2025-10-02T20:33:08.273029] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-09. [2025-10-02T20:33:08.841035] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-02T20:33:09.073005] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-02. [2025-10-02T20:33:09.146063] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-02T20:33:09.873041] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-08. [2025-10-02T20:33:10.673078] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-10. [2025-10-02T20:33:11.201459] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-02T20:33:11.203061] [INFO ] [REMOTE ] NOM: Full fetch complete (1616 records). [2025-10-02T20:33:11.204448] [DEBUG] [VALIDATOR ] NOM: Validating primary data. [2025-10-02T20:33:11.204294] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-10-02T20:33:11.427539] [WARN ] [VALIDATOR ] NOM: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-10-02T20:33:11.427781] [FATAL] [MAIN ] NOM: Fetched primary data is invalid. Refusing to save it. [2025-10-02T20:33:11.427855] [WARN ] [MAIN ] NOM: Deleting existing primary and derivative data due to validation failure. [2025-10-02T20:33:11.427931] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-10-02T20:33:11.428000] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-10-02T20:33:11.428037] [INFO ] [LOCAL ] NOM: Starting deletion of derivative data. [2025-10-02T20:33:11.428109] [DEBUG] [LOCAL ] NOM: No derivative data file found to delete. [2025-10-02T20:33:11.428191] [INFO ] [MAIN ] Update Progress: 1511/2370 symbols completed. NOM took 26.9s. Estimated remaining: 2h 1m 10s. Rate: 7.1 symbols/min [2025-10-02T20:33:11.478162] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-03. [2025-10-02T20:33:11.627349] [INFO ] [MAIN ] NOV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:33:11.627712] [DEBUG] [LOCAL ] NOV: No existing data file found in primary storage. [2025-10-02T20:33:11.627848] [WARN ] [MAIN ] NOV: No existing data found, performing full refresh instead. [2025-10-02T20:33:11.628177] [INFO ] [MAIN ] NOV: Wiping existing primary data before full refresh. [2025-10-02T20:33:11.631784] [INFO ] [LOCAL ] NOV: Starting deletion of primary data. [2025-10-02T20:33:11.631849] [DEBUG] [LOCAL ] NOV: No primary data file found to delete. [2025-10-02T20:33:11.631887] [INFO ] [MAIN ] NOV: Starting full primary refresh. [2025-10-02T20:33:12.043227] [INFO ] [REMOTE ] NOV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:33:12.065080] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-02T20:33:12.272997] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-09. [2025-10-02T20:33:13.072982] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-04. [2025-10-02T20:33:13.340575] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-02T20:33:13.873021] [INFO ] [REMOTE ] NOV: Fetching primary data for 2024-12. [2025-10-02T20:33:14.265285] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-02T20:33:14.673009] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-04. [2025-10-02T20:33:14.795687] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-02T20:33:15.350692] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-02T20:33:15.473029] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-01. [2025-10-02T20:33:16.169610] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-02T20:33:16.273018] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-10. [2025-10-02T20:33:17.072979] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-05. [2025-10-02T20:33:17.116147] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-02T20:33:17.873009] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-02. [2025-10-02T20:33:18.034896] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-02T20:33:18.037233] [INFO ] [REMOTE ] NOK: Full fetch complete (77637 records). [2025-10-02T20:33:18.037401] [DEBUG] [VALIDATOR ] NOK: Validating primary data. [2025-10-02T20:33:18.483268] [DEBUG] [VALIDATOR ] NOK: All expected trading days are present. [2025-10-02T20:33:18.483435] [DEBUG] [VALIDATOR ] NOK: Primary data validation passed. [2025-10-02T20:33:18.484550] [INFO ] [MAIN ] NOK: Fetched primary data is valid. [2025-10-02T20:33:18.484617] [DEBUG] [LOCAL ] NOK: Saving primary data. [2025-10-02T20:33:18.486434] [DEBUG] [LOCAL ] NOK: Trimmed 77637 records to 54011 (keeping 200 days of data) [2025-10-02T20:33:18.677508] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-05. [2025-10-02T20:33:18.844151] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-02T20:33:18.874599] [DEBUG] [LOCAL ] NOK: Primary data saved (54011 records). [2025-10-02T20:33:18.874788] [INFO ] [MAIN ] NOK: Full history saved. [2025-10-02T20:33:18.874915] [INFO ] [MAIN ] Update Progress: 1512/2370 symbols completed. NOK took 38.1s. Estimated remaining: 2h 1m 1s. Rate: 7.1 symbols/min [2025-10-02T20:33:19.069757] [INFO ] [MAIN ] NOW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:33:19.069950] [DEBUG] [LOCAL ] NOW: No existing data file found in primary storage. [2025-10-02T20:33:19.069988] [WARN ] [MAIN ] NOW: No existing data found, performing full refresh instead. [2025-10-02T20:33:19.070103] [INFO ] [MAIN ] NOW: Wiping existing primary data before full refresh. [2025-10-02T20:33:19.070145] [INFO ] [LOCAL ] NOW: Starting deletion of primary data. [2025-10-02T20:33:19.070188] [DEBUG] [LOCAL ] NOW: No primary data file found to delete. [2025-10-02T20:33:19.070221] [INFO ] [MAIN ] NOW: Starting full primary refresh. [2025-10-02T20:33:19.473601] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-06. [2025-10-02T20:33:19.473436] [INFO ] [REMOTE ] NOW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:33:19.534723] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-02T20:33:20.273017] [INFO ] [REMOTE ] NOW: Fetching primary data for 2024-12. [2025-10-02T20:33:20.594335] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-02T20:33:21.072996] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-06. [2025-10-02T20:33:21.232043] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-02T20:33:21.873030] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-03. [2025-10-02T20:33:22.649775] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2024-12 (2.38 seconds). [2025-10-02T20:33:22.673024] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-01. [2025-10-02T20:33:22.949620] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-02T20:33:23.428356] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-02T20:33:23.473038] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-04. [2025-10-02T20:33:24.273034] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-07. [2025-10-02T20:33:25.072993] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-07. [2025-10-02T20:33:25.127309] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-01 (2.45 seconds). [2025-10-02T20:33:25.525823] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-02T20:33:25.836325] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-02T20:33:25.873023] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-08. [2025-10-02T20:33:26.672993] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-05. [2025-10-02T20:33:27.219751] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-02T20:33:27.334380] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-02T20:33:27.472994] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-09. [2025-10-02T20:33:28.272984] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-02. [2025-10-02T20:33:28.512083] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-02T20:33:28.689687] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-02T20:33:29.073008] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-08. [2025-10-02T20:33:29.872996] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-06. [2025-10-02T20:33:30.634823] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-02 (2.36 seconds). [2025-10-02T20:33:30.672978] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-03. [2025-10-02T20:33:30.920082] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-02T20:33:31.472994] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-10. [2025-10-02T20:33:31.765487] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-02T20:33:32.273024] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-07. [2025-10-02T20:33:32.798687] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-02T20:33:32.800909] [INFO ] [REMOTE ] NOMD: Full fetch complete (59286 records). [2025-10-02T20:33:32.801137] [DEBUG] [VALIDATOR ] NOMD: Validating primary data. [2025-10-02T20:33:32.922104] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-02T20:33:33.078118] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-04. [2025-10-02T20:33:33.262635] [DEBUG] [VALIDATOR ] NOMD: All expected trading days are present. [2025-10-02T20:33:33.262754] [DEBUG] [VALIDATOR ] NOMD: Primary data validation passed. [2025-10-02T20:33:33.263664] [INFO ] [MAIN ] NOMD: Fetched primary data is valid. [2025-10-02T20:33:33.263728] [DEBUG] [LOCAL ] NOMD: Saving primary data. [2025-10-02T20:33:33.265017] [DEBUG] [LOCAL ] NOMD: Trimmed 59286 records to 41855 (keeping 200 days of data) [2025-10-02T20:33:33.538311] [DEBUG] [LOCAL ] NOMD: Primary data saved (41855 records). [2025-10-02T20:33:33.538459] [INFO ] [MAIN ] NOMD: Full history saved. [2025-10-02T20:33:33.538539] [INFO ] [MAIN ] Update Progress: 1513/2370 symbols completed. NOMD took 37.3s. Estimated remaining: 2h 0m 56s. Rate: 7.1 symbols/min [2025-10-02T20:33:33.736241] [INFO ] [MAIN ] NP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:33:33.736387] [DEBUG] [LOCAL ] NP: No existing data file found in primary storage. [2025-10-02T20:33:33.736444] [WARN ] [MAIN ] NP: No existing data found, performing full refresh instead. [2025-10-02T20:33:33.736557] [INFO ] [MAIN ] NP: Wiping existing primary data before full refresh. [2025-10-02T20:33:33.736601] [INFO ] [LOCAL ] NP: Starting deletion of primary data. [2025-10-02T20:33:33.736672] [DEBUG] [LOCAL ] NP: No primary data file found to delete. [2025-10-02T20:33:33.736736] [INFO ] [MAIN ] NP: Starting full primary refresh. [2025-10-02T20:33:33.874334] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-09. [2025-10-02T20:33:34.122600] [INFO ] [REMOTE ] NP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:33:34.423884] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-02T20:33:34.673003] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-08. [2025-10-02T20:33:35.127081] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-02T20:33:35.473004] [INFO ] [REMOTE ] NP: Fetching primary data for 2024-12. [2025-10-02T20:33:35.582930] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-10-02T20:33:35.776872] [DEBUG] [REMOTE ] NP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T20:33:35.777227] [WARN ] [REMOTE ] NP: No data returned for month 2024-12 [2025-10-02T20:33:35.777321] [FATAL] [REMOTE ] NP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T20:33:35.777390] [FATAL] [MAIN ] NP: Failed to fetch primary data. [2025-10-02T20:33:35.777458] [WARN ] [MAIN ] NP: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T20:33:35.777535] [INFO ] [LOCAL ] NP: Starting deletion of primary data. [2025-10-02T20:33:35.777602] [DEBUG] [LOCAL ] NP: No primary data file found to delete. [2025-10-02T20:33:35.777663] [INFO ] [LOCAL ] NP: Starting deletion of derivative data. [2025-10-02T20:33:35.777735] [DEBUG] [LOCAL ] NP: No derivative data file found to delete. [2025-10-02T20:33:35.777786] [INFO ] [MAIN ] Update Progress: 1514/2370 symbols completed. NP took 2.2s. Estimated remaining: 2h 0m 44s. Rate: 7.1 symbols/min [2025-10-02T20:33:35.962439] [INFO ] [MAIN ] NPB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:33:35.962625] [DEBUG] [LOCAL ] NPB: No existing data file found in primary storage. [2025-10-02T20:33:35.962698] [WARN ] [MAIN ] NPB: No existing data found, performing full refresh instead. [2025-10-02T20:33:35.962818] [INFO ] [MAIN ] NPB: Wiping existing primary data before full refresh. [2025-10-02T20:33:35.962862] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-10-02T20:33:35.962905] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-10-02T20:33:35.962939] [INFO ] [MAIN ] NPB: Starting full primary refresh. [2025-10-02T20:33:36.278079] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-10. [2025-10-02T20:33:36.352779] [INFO ] [REMOTE ] NPB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:33:36.622992] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-02T20:33:37.072999] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-09. [2025-10-02T20:33:37.367949] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-02T20:33:37.373401] [INFO ] [REMOTE ] NOTE: Full fetch complete (63604 records). [2025-10-02T20:33:37.373532] [DEBUG] [VALIDATOR ] NOTE: Validating primary data. [2025-10-02T20:33:37.780713] [DEBUG] [VALIDATOR ] NOTE: All expected trading days are present. [2025-10-02T20:33:37.780807] [DEBUG] [VALIDATOR ] NOTE: Primary data validation passed. [2025-10-02T20:33:37.781727] [INFO ] [MAIN ] NOTE: Fetched primary data is valid. [2025-10-02T20:33:37.781790] [DEBUG] [LOCAL ] NOTE: Saving primary data. [2025-10-02T20:33:37.783073] [DEBUG] [LOCAL ] NOTE: Trimmed 63604 records to 42000 (keeping 200 days of data) [2025-10-02T20:33:37.873166] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-05. [2025-10-02T20:33:38.041160] [DEBUG] [LOCAL ] NOTE: Primary data saved (42000 records). [2025-10-02T20:33:38.041289] [INFO ] [MAIN ] NOTE: Full history saved. [2025-10-02T20:33:38.041360] [INFO ] [MAIN ] Update Progress: 1515/2370 symbols completed. NOTE took 38.7s. Estimated remaining: 2h 0m 32s. Rate: 7.1 symbols/min [2025-10-02T20:33:38.218001] [INFO ] [MAIN ] NPCT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:33:38.218251] [DEBUG] [LOCAL ] NPCT: No existing data file found in primary storage. [2025-10-02T20:33:38.218354] [WARN ] [MAIN ] NPCT: No existing data found, performing full refresh instead. [2025-10-02T20:33:38.218473] [INFO ] [MAIN ] NPCT: Wiping existing primary data before full refresh. [2025-10-02T20:33:38.218515] [INFO ] [LOCAL ] NPCT: Starting deletion of primary data. [2025-10-02T20:33:38.218557] [DEBUG] [LOCAL ] NPCT: No primary data file found to delete. [2025-10-02T20:33:38.218589] [INFO ] [MAIN ] NPCT: Starting full primary refresh. [2025-10-02T20:33:38.601549] [INFO ] [REMOTE ] NPCT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:33:38.672976] [INFO ] [REMOTE ] NPB: Fetching primary data for 2024-12. [2025-10-02T20:33:38.966525] [DEBUG] [REMOTE ] NPB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T20:33:38.966935] [WARN ] [REMOTE ] NPB: No data returned for month 2024-12 [2025-10-02T20:33:38.967030] [FATAL] [REMOTE ] NPB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T20:33:38.967123] [FATAL] [MAIN ] NPB: Failed to fetch primary data. [2025-10-02T20:33:38.967205] [WARN ] [MAIN ] NPB: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T20:33:38.967282] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-10-02T20:33:38.967348] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-10-02T20:33:38.967388] [INFO ] [LOCAL ] NPB: Starting deletion of derivative data. [2025-10-02T20:33:38.967437] [DEBUG] [LOCAL ] NPB: No derivative data file found to delete. [2025-10-02T20:33:38.967527] [INFO ] [MAIN ] Update Progress: 1516/2370 symbols completed. NPB took 3.2s. Estimated remaining: 2h 0m 19s. Rate: 7.1 symbols/min [2025-10-02T20:33:39.156009] [INFO ] [MAIN ] NPFD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:33:39.156325] [DEBUG] [LOCAL ] NPFD: No existing data file found in primary storage. [2025-10-02T20:33:39.156420] [WARN ] [MAIN ] NPFD: No existing data found, performing full refresh instead. [2025-10-02T20:33:39.156678] [INFO ] [MAIN ] NPFD: Wiping existing primary data before full refresh. [2025-10-02T20:33:39.156873] [INFO ] [LOCAL ] NPFD: Starting deletion of primary data. [2025-10-02T20:33:39.156939] [DEBUG] [LOCAL ] NPFD: No primary data file found to delete. [2025-10-02T20:33:39.156977] [INFO ] [MAIN ] NPFD: Starting full primary refresh. [2025-10-02T20:33:39.299531] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-02T20:33:39.478083] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2024-12. [2025-10-02T20:33:39.587923] [INFO ] [REMOTE ] NPFD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:33:40.240424] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-10-02T20:33:40.272936] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-06. [2025-10-02T20:33:40.444973] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-02T20:33:41.073013] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-01. [2025-10-02T20:33:41.872959] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-10. [2025-10-02T20:33:42.288080] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-02T20:33:42.372969] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-02T20:33:42.672993] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-07. [2025-10-02T20:33:43.473037] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2024-12. [2025-10-02T20:33:43.657999] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-02T20:33:43.660247] [INFO ] [REMOTE ] NOV: Full fetch complete (76991 records). [2025-10-02T20:33:43.660359] [DEBUG] [VALIDATOR ] NOV: Validating primary data. [2025-10-02T20:33:44.103901] [DEBUG] [VALIDATOR ] NOV: All expected trading days are present. [2025-10-02T20:33:44.103997] [DEBUG] [VALIDATOR ] NOV: Primary data validation passed. [2025-10-02T20:33:44.105153] [INFO ] [MAIN ] NOV: Fetched primary data is valid. [2025-10-02T20:33:44.105223] [DEBUG] [LOCAL ] NOV: Saving primary data. [2025-10-02T20:33:44.106899] [DEBUG] [LOCAL ] NOV: Trimmed 76991 records to 53570 (keeping 200 days of data) [2025-10-02T20:33:44.295929] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-02. [2025-10-02T20:33:44.460703] [DEBUG] [LOCAL ] NOV: Primary data saved (53570 records). [2025-10-02T20:33:44.460968] [INFO ] [MAIN ] NOV: Full history saved. [2025-10-02T20:33:44.461167] [INFO ] [MAIN ] Update Progress: 1517/2370 symbols completed. NOV took 33.0s. Estimated remaining: 2h 0m 9s. Rate: 7.1 symbols/min [2025-10-02T20:33:44.540882] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-02T20:33:45.006568] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-10-02T20:33:45.073003] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-08. [2025-10-02T20:33:45.169006] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-02T20:33:45.873050] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-03. [2025-10-02T20:33:46.673163] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-01. [2025-10-02T20:33:46.967932] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-02T20:33:47.474543] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-04. [2025-10-02T20:33:47.478590] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-10-02T20:33:47.502187] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-02T20:33:48.272995] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-02. [2025-10-02T20:33:48.578908] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-02T20:33:49.073046] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-09. [2025-10-02T20:33:49.167986] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-02T20:33:49.873036] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-03. [2025-10-02T20:33:50.673020] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-05. [2025-10-02T20:33:50.808277] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-02T20:33:51.360233] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-10-02T20:33:51.473063] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-10. [2025-10-02T20:33:51.915677] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-02T20:33:51.948242] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-02T20:33:51.950148] [INFO ] [REMOTE ] NOW: Full fetch complete (70378 records). [2025-10-02T20:33:51.950293] [DEBUG] [VALIDATOR ] NOW: Validating primary data. [2025-10-02T20:33:51.951293] [FATAL] [VALIDATOR ] NOW: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T20:33:51.951434] [FATAL] [MAIN ] NOW: Fetched primary data is invalid. Refusing to save it. [2025-10-02T20:33:51.951506] [WARN ] [MAIN ] NOW: Deleting existing primary and derivative data due to validation failure. [2025-10-02T20:33:51.951587] [INFO ] [LOCAL ] NOW: Starting deletion of primary data. [2025-10-02T20:33:51.951704] [DEBUG] [LOCAL ] NOW: No primary data file found to delete. [2025-10-02T20:33:51.951786] [INFO ] [LOCAL ] NOW: Starting deletion of derivative data. [2025-10-02T20:33:51.951892] [DEBUG] [LOCAL ] NOW: No derivative data file found to delete. [2025-10-02T20:33:51.951976] [INFO ] [MAIN ] Update Progress: 1518/2370 symbols completed. NOW took 33.1s. Estimated remaining: 1h 59m 60s. Rate: 7.1 symbols/min [2025-10-02T20:33:52.273018] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-04. [2025-10-02T20:33:53.072969] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-06. [2025-10-02T20:33:53.228902] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-02T20:33:53.872982] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-05. [2025-10-02T20:33:53.975088] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-02T20:33:54.672993] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-07. [2025-10-02T20:33:54.714255] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-02T20:33:55.473034] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-06. [2025-10-02T20:33:55.967328] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-02T20:33:56.272987] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-08. [2025-10-02T20:33:56.374023] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-02T20:33:57.072962] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-07. [2025-10-02T20:33:57.271357] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-02T20:33:57.854418] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-02T20:33:57.872986] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-09. [2025-10-02T20:33:58.673012] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-08. [2025-10-02T20:33:58.977928] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-02T20:33:59.473013] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-10. [2025-10-02T20:33:59.527344] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-02T20:34:00.064376] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-02T20:34:00.065587] [INFO ] [REMOTE ] NPCT: Full fetch complete (25350 records). [2025-10-02T20:34:00.065712] [DEBUG] [VALIDATOR ] NPCT: Validating primary data. [2025-10-02T20:34:00.278132] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-09. [2025-10-02T20:34:00.483263] [DEBUG] [VALIDATOR ] NPCT: All expected trading days are present. [2025-10-02T20:34:00.483354] [DEBUG] [VALIDATOR ] NPCT: Primary data validation passed. [2025-10-02T20:34:00.484004] [INFO ] [MAIN ] NPCT: Fetched primary data is valid. [2025-10-02T20:34:00.484071] [DEBUG] [LOCAL ] NPCT: Saving primary data. [2025-10-02T20:34:00.484831] [DEBUG] [LOCAL ] NPCT: Trimmed 25350 records to 17141 (keeping 200 days of data) [2025-10-02T20:34:00.595082] [DEBUG] [LOCAL ] NPCT: Primary data saved (17141 records). [2025-10-02T20:34:00.595231] [INFO ] [MAIN ] NPCT: Full history saved. [2025-10-02T20:34:00.595308] [INFO ] [MAIN ] Update Progress: 1519/2370 symbols completed. NPCT took 22.6s. Estimated remaining: 1h 59m 52s. Rate: 7.1 symbols/min [2025-10-02T20:34:01.465481] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-02T20:34:01.468964] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-10. [2025-10-02T20:34:02.271610] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-02T20:34:02.272599] [INFO ] [REMOTE ] NPFD: Full fetch complete (14815 records). [2025-10-02T20:34:02.272706] [DEBUG] [VALIDATOR ] NPFD: Validating primary data. [2025-10-02T20:34:02.661926] [DEBUG] [VALIDATOR ] NPFD: All expected trading days are present. [2025-10-02T20:34:02.662007] [DEBUG] [VALIDATOR ] NPFD: Primary data validation passed. [2025-10-02T20:34:02.662334] [INFO ] [MAIN ] NPFD: Fetched primary data is valid. [2025-10-02T20:34:02.662417] [DEBUG] [LOCAL ] NPFD: Saving primary data. [2025-10-02T20:34:02.662984] [DEBUG] [LOCAL ] NPFD: Trimmed 14815 records to 9915 (keeping 200 days of data) [2025-10-02T20:34:02.726136] [DEBUG] [LOCAL ] NPFD: Primary data saved (9915 records). [2025-10-02T20:34:02.726273] [INFO ] [MAIN ] NPFD: Full history saved. [2025-10-02T20:34:02.726352] [INFO ] [MAIN ] Update Progress: 1520/2370 symbols completed. NPFD took 23.8s. Estimated remaining: 1h 59m 40s. Rate: 7.1 symbols/min [2025-10-02T20:34:03.345681] [INFO ] [MAIN ] NPO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:34:03.396931] [DEBUG] [LOCAL ] NPO: No existing data file found in primary storage. [2025-10-02T20:34:03.459115] [INFO ] [MAIN ] NPV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:34:03.455786] [INFO ] [MAIN ] NPKI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:34:03.480028] [DEBUG] [LOCAL ] NPKI: No existing data file found in primary storage. [2025-10-02T20:34:03.480167] [DEBUG] [LOCAL ] NPV: No existing data file found in primary storage. [2025-10-02T20:34:03.469526] [WARN ] [MAIN ] NPO: No existing data found, performing full refresh instead. [2025-10-02T20:34:03.509675] [WARN ] [MAIN ] NPV: No existing data found, performing full refresh instead. [2025-10-02T20:34:03.509772] [WARN ] [MAIN ] NPKI: No existing data found, performing full refresh instead. [2025-10-02T20:34:03.509595] [INFO ] [MAIN ] NPO: Wiping existing primary data before full refresh. [2025-10-02T20:34:03.530262] [INFO ] [MAIN ] NPKI: Wiping existing primary data before full refresh. [2025-10-02T20:34:03.532932] [INFO ] [LOCAL ] NPKI: Starting deletion of primary data. [2025-10-02T20:34:03.533363] [INFO ] [MAIN ] NPV: Wiping existing primary data before full refresh. [2025-10-02T20:34:03.533273] [INFO ] [LOCAL ] NPO: Starting deletion of primary data. [2025-10-02T20:34:03.533577] [DEBUG] [LOCAL ] NPKI: No primary data file found to delete. [2025-10-02T20:34:03.533826] [DEBUG] [LOCAL ] NPO: No primary data file found to delete. [2025-10-02T20:34:03.533746] [INFO ] [LOCAL ] NPV: Starting deletion of primary data. [2025-10-02T20:34:03.534091] [INFO ] [MAIN ] NPKI: Starting full primary refresh. [2025-10-02T20:34:03.532709] [INFO ] [MAIN ] NPK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:34:03.539437] [DEBUG] [LOCAL ] NPV: No primary data file found to delete. [2025-10-02T20:34:03.548783] [INFO ] [MAIN ] NPO: Starting full primary refresh. [2025-10-02T20:34:03.574112] [DEBUG] [LOCAL ] NPK: No existing data file found in primary storage. [2025-10-02T20:34:03.584850] [INFO ] [MAIN ] NPV: Starting full primary refresh. [2025-10-02T20:34:03.609161] [WARN ] [MAIN ] NPK: No existing data found, performing full refresh instead. [2025-10-02T20:34:03.799171] [INFO ] [MAIN ] NPK: Wiping existing primary data before full refresh. [2025-10-02T20:34:03.885120] [INFO ] [LOCAL ] NPK: Starting deletion of primary data. [2025-10-02T20:34:03.900841] [DEBUG] [LOCAL ] NPK: No primary data file found to delete. [2025-10-02T20:34:03.917329] [INFO ] [MAIN ] NPK: Starting full primary refresh. [2025-10-02T20:34:04.899562] [INFO ] [REMOTE ] NPKI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:34:04.956630] [INFO ] [REMOTE ] NPV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:34:04.981533] [INFO ] [REMOTE ] NPV: Fetching primary data for 2024-12. [2025-10-02T20:34:04.981839] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2024-12. [2025-10-02T20:34:05.154226] [INFO ] [REMOTE ] NPO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:34:05.178039] [INFO ] [REMOTE ] NPK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:34:05.179053] [INFO ] [REMOTE ] NPK: Fetching primary data for 2024-12. [2025-10-02T20:34:05.178723] [INFO ] [REMOTE ] NPO: Fetching primary data for 2024-12. [2025-10-02T20:34:06.103605] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-02T20:34:06.105255] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-01. [2025-10-02T20:34:06.344673] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-02T20:34:06.347817] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-01. [2025-10-02T20:34:06.440572] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-02T20:34:06.535265] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-02T20:34:06.673007] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-01. [2025-10-02T20:34:06.842962] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-02T20:34:07.378590] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-02T20:34:07.472987] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-02. [2025-10-02T20:34:07.637307] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-02T20:34:08.240964] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-02T20:34:08.272990] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-03. [2025-10-02T20:34:09.000208] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-02T20:34:09.073000] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-02. [2025-10-02T20:34:09.876335] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-04. [2025-10-02T20:34:09.883222] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-02T20:34:10.531065] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-02T20:34:10.673115] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-02. [2025-10-02T20:34:11.473014] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-01. [2025-10-02T20:34:11.815969] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-02T20:34:12.273014] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-03. [2025-10-02T20:34:12.320762] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-02T20:34:13.050564] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-02T20:34:13.073003] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-04. [2025-10-02T20:34:13.872968] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-02. [2025-10-02T20:34:14.260534] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-02T20:34:14.655140] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-02T20:34:14.673041] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-03. [2025-10-02T20:34:15.472988] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-05. [2025-10-02T20:34:15.524668] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-02T20:34:16.178064] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-02T20:34:16.273000] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-05. [2025-10-02T20:34:17.073047] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-04. [2025-10-02T20:34:17.452155] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-02T20:34:17.852918] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-02T20:34:17.873024] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-05. [2025-10-02T20:34:18.672987] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-03. [2025-10-02T20:34:18.823530] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-02T20:34:19.473018] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-06. [2025-10-02T20:34:20.118600] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-02T20:34:20.155829] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-02T20:34:20.273001] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-04. [2025-10-02T20:34:21.073045] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-07. [2025-10-02T20:34:21.873024] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-06. [2025-10-02T20:34:21.987996] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-02T20:34:22.089624] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-02T20:34:22.497719] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-02T20:34:22.673009] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-06. [2025-10-02T20:34:23.283384] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-02T20:34:23.473068] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-07. [2025-10-02T20:34:24.273049] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-08. [2025-10-02T20:34:24.311885] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-02T20:34:25.072973] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-05. [2025-10-02T20:34:25.260949] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-02T20:34:25.873012] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-08. [2025-10-02T20:34:26.631435] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-02T20:34:26.673009] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-09. [2025-10-02T20:34:26.717030] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-02T20:34:27.386082] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-02T20:34:27.473004] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-09. [2025-10-02T20:34:28.198573] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-02T20:34:28.272968] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-10. [2025-10-02T20:34:29.073041] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-07. [2025-10-02T20:34:29.086721] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-02T20:34:29.087789] [INFO ] [REMOTE ] NPO: Full fetch complete (18103 records). [2025-10-02T20:34:29.087865] [DEBUG] [VALIDATOR ] NPO: Validating primary data. [2025-10-02T20:34:29.488750] [DEBUG] [VALIDATOR ] NPO: All expected trading days are present. [2025-10-02T20:34:29.488868] [DEBUG] [VALIDATOR ] NPO: Primary data validation passed. [2025-10-02T20:34:29.489287] [INFO ] [MAIN ] NPO: Fetched primary data is valid. [2025-10-02T20:34:29.489335] [DEBUG] [LOCAL ] NPO: Saving primary data. [2025-10-02T20:34:29.490018] [DEBUG] [LOCAL ] NPO: Trimmed 18103 records to 13098 (keeping 200 days of data) [2025-10-02T20:34:29.579307] [DEBUG] [LOCAL ] NPO: Primary data saved (13098 records). [2025-10-02T20:34:29.579448] [INFO ] [MAIN ] NPO: Full history saved. [2025-10-02T20:34:29.579523] [INFO ] [MAIN ] Update Progress: 1521/2370 symbols completed. NPO took 26.9s. Estimated remaining: 1h 59m 41s. Rate: 7.1 symbols/min [2025-10-02T20:34:29.767816] [INFO ] [MAIN ] NPWR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:34:29.768301] [DEBUG] [LOCAL ] NPWR: No existing data file found in primary storage. [2025-10-02T20:34:29.768359] [WARN ] [MAIN ] NPWR: No existing data found, performing full refresh instead. [2025-10-02T20:34:29.768538] [INFO ] [MAIN ] NPWR: Wiping existing primary data before full refresh. [2025-10-02T20:34:29.768670] [INFO ] [LOCAL ] NPWR: Starting deletion of primary data. [2025-10-02T20:34:29.768782] [DEBUG] [LOCAL ] NPWR: No primary data file found to delete. [2025-10-02T20:34:29.768832] [INFO ] [MAIN ] NPWR: Starting full primary refresh. [2025-10-02T20:34:29.873793] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-06. [2025-10-02T20:34:30.176718] [INFO ] [REMOTE ] NPWR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:34:30.186477] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-02T20:34:30.673012] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2024-12. [2025-10-02T20:34:31.409571] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-02T20:34:31.473018] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-10. [2025-10-02T20:34:31.895272] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-02T20:34:31.896117] [INFO ] [REMOTE ] NPV: Full fetch complete (6906 records). [2025-10-02T20:34:31.896191] [DEBUG] [VALIDATOR ] NPV: Validating primary data. [2025-10-02T20:34:32.273328] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-07. [2025-10-02T20:34:32.325835] [DEBUG] [VALIDATOR ] NPV: All expected trading days are present. [2025-10-02T20:34:32.325981] [DEBUG] [VALIDATOR ] NPV: Primary data validation passed. [2025-10-02T20:34:32.326352] [INFO ] [MAIN ] NPV: Fetched primary data is valid. [2025-10-02T20:34:32.326436] [DEBUG] [LOCAL ] NPV: Saving primary data. [2025-10-02T20:34:32.327368] [DEBUG] [LOCAL ] NPV: Trimmed 6906 records to 5083 (keeping 200 days of data) [2025-10-02T20:34:32.381596] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-02T20:34:32.397057] [DEBUG] [LOCAL ] NPV: Primary data saved (5083 records). [2025-10-02T20:34:32.397215] [INFO ] [MAIN ] NPV: Full history saved. [2025-10-02T20:34:32.397308] [INFO ] [MAIN ] Update Progress: 1522/2370 symbols completed. NPV took 29.6s. Estimated remaining: 1h 59m 30s. Rate: 7.1 symbols/min [2025-10-02T20:34:32.619986] [INFO ] [MAIN ] NQP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:34:32.620186] [DEBUG] [LOCAL ] NQP: No existing data file found in primary storage. [2025-10-02T20:34:32.620238] [WARN ] [MAIN ] NQP: No existing data found, performing full refresh instead. [2025-10-02T20:34:32.620364] [INFO ] [MAIN ] NQP: Wiping existing primary data before full refresh. [2025-10-02T20:34:32.620421] [INFO ] [LOCAL ] NQP: Starting deletion of primary data. [2025-10-02T20:34:32.620504] [DEBUG] [LOCAL ] NQP: No primary data file found to delete. [2025-10-02T20:34:32.620550] [INFO ] [MAIN ] NQP: Starting full primary refresh. [2025-10-02T20:34:33.020372] [INFO ] [REMOTE ] NQP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:34:33.072979] [INFO ] [REMOTE ] NQP: Fetching primary data for 2024-12. [2025-10-02T20:34:33.873010] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-01. [2025-10-02T20:34:33.961383] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-02T20:34:34.376411] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-02T20:34:34.673002] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-08. [2025-10-02T20:34:35.372964] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-02T20:34:35.472999] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-08. [2025-10-02T20:34:36.172375] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-02T20:34:36.272992] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-02. [2025-10-02T20:34:36.284834] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-02T20:34:37.072980] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-09. [2025-10-02T20:34:37.714206] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-02T20:34:37.873009] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-01. [2025-10-02T20:34:38.607061] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-02T20:34:38.672987] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-09. [2025-10-02T20:34:38.747115] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-02T20:34:39.473011] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-03. [2025-10-02T20:34:39.536571] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-02T20:34:40.272998] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-02. [2025-10-02T20:34:41.073012] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-10. [2025-10-02T20:34:41.166462] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-02T20:34:41.204526] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-02T20:34:41.634714] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-02T20:34:41.635591] [INFO ] [REMOTE ] NPK: Full fetch complete (10883 records). [2025-10-02T20:34:41.635698] [DEBUG] [VALIDATOR ] NPK: Validating primary data. [2025-10-02T20:34:41.878220] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-04. [2025-10-02T20:34:42.048398] [DEBUG] [VALIDATOR ] NPK: All expected trading days are present. [2025-10-02T20:34:42.048478] [DEBUG] [VALIDATOR ] NPK: Primary data validation passed. [2025-10-02T20:34:42.048785] [INFO ] [MAIN ] NPK: Fetched primary data is valid. [2025-10-02T20:34:42.048848] [DEBUG] [LOCAL ] NPK: Saving primary data. [2025-10-02T20:34:42.049342] [DEBUG] [LOCAL ] NPK: Trimmed 10883 records to 8119 (keeping 200 days of data) [2025-10-02T20:34:42.100325] [DEBUG] [LOCAL ] NPK: Primary data saved (8119 records). [2025-10-02T20:34:42.100474] [INFO ] [MAIN ] NPK: Full history saved. [2025-10-02T20:34:42.100554] [INFO ] [MAIN ] Update Progress: 1523/2370 symbols completed. NPK took 39.4s. Estimated remaining: 1h 59m 22s. Rate: 7.1 symbols/min [2025-10-02T20:34:42.287967] [INFO ] [MAIN ] NRDY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:34:42.288152] [DEBUG] [LOCAL ] NRDY: No existing data file found in primary storage. [2025-10-02T20:34:42.288192] [WARN ] [MAIN ] NRDY: No existing data found, performing full refresh instead. [2025-10-02T20:34:42.288329] [INFO ] [MAIN ] NRDY: Wiping existing primary data before full refresh. [2025-10-02T20:34:42.288373] [INFO ] [LOCAL ] NRDY: Starting deletion of primary data. [2025-10-02T20:34:42.288417] [DEBUG] [LOCAL ] NRDY: No primary data file found to delete. [2025-10-02T20:34:42.288452] [INFO ] [MAIN ] NRDY: Starting full primary refresh. [2025-10-02T20:34:42.681733] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-10. [2025-10-02T20:34:42.708791] [INFO ] [REMOTE ] NRDY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:34:43.472990] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-03. [2025-10-02T20:34:43.706367] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-02T20:34:43.823135] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-02T20:34:43.824796] [INFO ] [REMOTE ] NPKI: Full fetch complete (54501 records). [2025-10-02T20:34:43.824902] [DEBUG] [VALIDATOR ] NPKI: Validating primary data. [2025-10-02T20:34:44.024827] [WARN ] [VALIDATOR ] NPKI: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-02T20:34:44.025463] [FATAL] [MAIN ] NPKI: Fetched primary data is invalid. Refusing to save it. [2025-10-02T20:34:44.025578] [WARN ] [MAIN ] NPKI: Deleting existing primary and derivative data due to validation failure. [2025-10-02T20:34:44.025677] [INFO ] [LOCAL ] NPKI: Starting deletion of primary data. [2025-10-02T20:34:44.025756] [DEBUG] [LOCAL ] NPKI: No primary data file found to delete. [2025-10-02T20:34:44.025795] [INFO ] [LOCAL ] NPKI: Starting deletion of derivative data. [2025-10-02T20:34:44.025850] [DEBUG] [LOCAL ] NPKI: No derivative data file found to delete. [2025-10-02T20:34:44.025936] [INFO ] [MAIN ] Update Progress: 1524/2370 symbols completed. NPKI took 41.3s. Estimated remaining: 1h 59m 10s. Rate: 7.1 symbols/min [2025-10-02T20:34:44.184582] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-02T20:34:44.222501] [INFO ] [MAIN ] NREF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:34:44.222703] [DEBUG] [LOCAL ] NREF: No existing data file found in primary storage. [2025-10-02T20:34:44.222756] [WARN ] [MAIN ] NREF: No existing data found, performing full refresh instead. [2025-10-02T20:34:44.222878] [INFO ] [MAIN ] NREF: Wiping existing primary data before full refresh. [2025-10-02T20:34:44.222921] [INFO ] [LOCAL ] NREF: Starting deletion of primary data. [2025-10-02T20:34:44.222964] [DEBUG] [LOCAL ] NREF: No primary data file found to delete. [2025-10-02T20:34:44.223000] [INFO ] [MAIN ] NREF: Starting full primary refresh. [2025-10-02T20:34:44.281127] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-04. [2025-10-02T20:34:44.633776] [INFO ] [REMOTE ] NREF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:34:45.073003] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2024-12. [2025-10-02T20:34:45.162545] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-02T20:34:45.873027] [INFO ] [REMOTE ] NREF: Fetching primary data for 2024-12. [2025-10-02T20:34:46.673088] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-05. [2025-10-02T20:34:46.819240] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-02T20:34:47.203229] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-02T20:34:47.472977] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-01. [2025-10-02T20:34:47.624830] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-02T20:34:48.228226] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-02T20:34:48.273008] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-01. [2025-10-02T20:34:49.073006] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-06. [2025-10-02T20:34:49.872978] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-02. [2025-10-02T20:34:49.979135] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-02T20:34:50.028730] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-02T20:34:50.656579] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-02T20:34:50.672952] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-03. [2025-10-02T20:34:51.472974] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-02. [2025-10-02T20:34:51.541114] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-02T20:34:52.273000] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-07. [2025-10-02T20:34:53.073023] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-04. [2025-10-02T20:34:53.186274] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-02T20:34:53.423980] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-02T20:34:53.873021] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-05. [2025-10-02T20:34:53.991423] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-02T20:34:54.673022] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-03. [2025-10-02T20:34:55.473011] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-08. [2025-10-02T20:34:55.631683] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-02T20:34:55.842046] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-02T20:34:56.272989] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-05. [2025-10-02T20:34:56.354703] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-02T20:34:57.017959] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-02T20:34:57.073055] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-09. [2025-10-02T20:34:57.873018] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-06. [2025-10-02T20:34:57.977480] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-02T20:34:58.673014] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-10. [2025-10-02T20:34:59.473049] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-06. [2025-10-02T20:34:59.525138] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-02T20:34:59.526266] [INFO ] [REMOTE ] NQP: Full fetch complete (13495 records). [2025-10-02T20:34:59.526374] [DEBUG] [VALIDATOR ] NQP: Validating primary data. [2025-10-02T20:34:59.782690] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-02T20:35:00.008488] [DEBUG] [VALIDATOR ] NQP: All expected trading days are present. [2025-10-02T20:35:00.008568] [DEBUG] [VALIDATOR ] NQP: Primary data validation passed. [2025-10-02T20:35:00.009017] [INFO ] [MAIN ] NQP: Fetched primary data is valid. [2025-10-02T20:35:00.009113] [DEBUG] [LOCAL ] NQP: Saving primary data. [2025-10-02T20:35:00.009624] [DEBUG] [LOCAL ] NQP: Trimmed 13495 records to 9362 (keeping 200 days of data) [2025-10-02T20:35:00.074623] [DEBUG] [LOCAL ] NQP: Primary data saved (9362 records). [2025-10-02T20:35:00.074799] [INFO ] [MAIN ] NQP: Full history saved. [2025-10-02T20:35:00.074899] [INFO ] [MAIN ] Update Progress: 1525/2370 symbols completed. NQP took 27.7s. Estimated remaining: 1h 59m 6s. Rate: 7.1 symbols/min [2025-10-02T20:35:00.257973] [INFO ] [MAIN ] NRG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:35:00.258162] [DEBUG] [LOCAL ] NRG: No existing data file found in primary storage. [2025-10-02T20:35:00.258247] [WARN ] [MAIN ] NRG: No existing data found, performing full refresh instead. [2025-10-02T20:35:00.258382] [INFO ] [MAIN ] NRG: Wiping existing primary data before full refresh. [2025-10-02T20:35:00.258437] [INFO ] [LOCAL ] NRG: Starting deletion of primary data. [2025-10-02T20:35:00.258508] [DEBUG] [LOCAL ] NRG: No primary data file found to delete. [2025-10-02T20:35:00.258567] [INFO ] [MAIN ] NRG: Starting full primary refresh. [2025-10-02T20:35:00.279413] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-07. [2025-10-02T20:35:00.466782] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-02T20:35:00.669514] [INFO ] [REMOTE ] NRG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:35:01.072996] [INFO ] [REMOTE ] NRG: Fetching primary data for 2024-12. [2025-10-02T20:35:01.873041] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-04. [2025-10-02T20:35:02.678281] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-07. [2025-10-02T20:35:02.704610] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-10-02T20:35:03.322263] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-02T20:35:03.474664] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-08. [2025-10-02T20:35:03.480757] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2024-12 (2.41 seconds). [2025-10-02T20:35:03.637241] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-02T20:35:04.272994] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-08. [2025-10-02T20:35:05.072986] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-01. [2025-10-02T20:35:05.131328] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-02T20:35:05.159349] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-02T20:35:05.872996] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-09. [2025-10-02T20:35:06.673018] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-09. [2025-10-02T20:35:06.849426] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-02T20:35:07.304330] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-02T20:35:07.473048] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-05. [2025-10-02T20:35:08.168001] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-02T20:35:08.273014] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-10. [2025-10-02T20:35:08.627522] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-02T20:35:09.073057] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-10. [2025-10-02T20:35:09.460488] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-02T20:35:09.462309] [INFO ] [REMOTE ] NPWR: Full fetch complete (59226 records). [2025-10-02T20:35:09.462423] [DEBUG] [VALIDATOR ] NPWR: Validating primary data. [2025-10-02T20:35:09.644556] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-02T20:35:09.680344] [INFO ] [REMOTE ] NREF: Full fetch complete (10866 records). [2025-10-02T20:35:09.686970] [DEBUG] [VALIDATOR ] NREF: Validating primary data. [2025-10-02T20:35:09.883190] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-02. [2025-10-02T20:35:10.193584] [DEBUG] [VALIDATOR ] NPWR: All expected trading days are present. [2025-10-02T20:35:10.209295] [DEBUG] [VALIDATOR ] NPWR: Primary data validation passed. [2025-10-02T20:35:10.217417] [INFO ] [MAIN ] NPWR: Fetched primary data is valid. [2025-10-02T20:35:10.246237] [DEBUG] [LOCAL ] NPWR: Saving primary data. [2025-10-02T20:35:10.311411] [DEBUG] [LOCAL ] NPWR: Trimmed 59226 records to 43122 (keeping 200 days of data) [2025-10-02T20:35:10.337943] [DEBUG] [VALIDATOR ] NREF: All expected trading days are present. [2025-10-02T20:35:10.338015] [DEBUG] [VALIDATOR ] NREF: Primary data validation passed. [2025-10-02T20:35:10.338163] [INFO ] [MAIN ] NREF: Fetched primary data is valid. [2025-10-02T20:35:10.338244] [DEBUG] [LOCAL ] NREF: Saving primary data. [2025-10-02T20:35:10.338818] [DEBUG] [LOCAL ] NREF: Trimmed 10866 records to 7915 (keeping 200 days of data) [2025-10-02T20:35:10.489578] [DEBUG] [LOCAL ] NREF: Primary data saved (7915 records). [2025-10-02T20:35:10.490533] [INFO ] [MAIN ] NREF: Full history saved. [2025-10-02T20:35:10.490678] [INFO ] [MAIN ] Update Progress: 1526/2370 symbols completed. NREF took 26.5s. Estimated remaining: 1h 58m 58s. Rate: 7.1 symbols/min [2025-10-02T20:35:10.693984] [INFO ] [MAIN ] NRGV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:35:10.694458] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-06. [2025-10-02T20:35:10.695255] [DEBUG] [LOCAL ] NRGV: No existing data file found in primary storage. [2025-10-02T20:35:10.695677] [WARN ] [MAIN ] NRGV: No existing data found, performing full refresh instead. [2025-10-02T20:35:10.697347] [INFO ] [MAIN ] NRGV: Wiping existing primary data before full refresh. [2025-10-02T20:35:10.697455] [INFO ] [LOCAL ] NRGV: Starting deletion of primary data. [2025-10-02T20:35:10.698287] [DEBUG] [LOCAL ] NRGV: No primary data file found to delete. [2025-10-02T20:35:10.698758] [INFO ] [MAIN ] NRGV: Starting full primary refresh. [2025-10-02T20:35:11.229837] [INFO ] [REMOTE ] NRGV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:35:11.293113] [DEBUG] [LOCAL ] NPWR: Primary data saved (43122 records). [2025-10-02T20:35:11.293253] [INFO ] [MAIN ] NPWR: Full history saved. [2025-10-02T20:35:11.293330] [INFO ] [MAIN ] Update Progress: 1527/2370 symbols completed. NPWR took 41.7s. Estimated remaining: 1h 58m 46s. Rate: 7.1 symbols/min [2025-10-02T20:35:11.476928] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2024-12. [2025-10-02T20:35:11.489604] [INFO ] [MAIN ] NRK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:35:11.490588] [DEBUG] [LOCAL ] NRK: No existing data file found in primary storage. [2025-10-02T20:35:11.490671] [WARN ] [MAIN ] NRK: No existing data found, performing full refresh instead. [2025-10-02T20:35:11.490790] [INFO ] [MAIN ] NRK: Wiping existing primary data before full refresh. [2025-10-02T20:35:11.490835] [INFO ] [LOCAL ] NRK: Starting deletion of primary data. [2025-10-02T20:35:11.490878] [DEBUG] [LOCAL ] NRK: No primary data file found to delete. [2025-10-02T20:35:11.490919] [INFO ] [MAIN ] NRK: Starting full primary refresh. [2025-10-02T20:35:11.923706] [INFO ] [REMOTE ] NRK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:35:11.968555] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-02T20:35:12.282235] [INFO ] [REMOTE ] NRK: Fetching primary data for 2024-12. [2025-10-02T20:35:12.287129] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-02T20:35:13.072997] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-03. [2025-10-02T20:35:13.236097] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-02T20:35:13.805516] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-02T20:35:13.873004] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-01. [2025-10-02T20:35:14.673012] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-01. [2025-10-02T20:35:15.233293] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-02T20:35:15.473040] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-07. [2025-10-02T20:35:15.517270] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-02T20:35:15.621751] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-02T20:35:16.272996] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-02. [2025-10-02T20:35:16.932300] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-02T20:35:17.073040] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-08. [2025-10-02T20:35:17.596367] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-02T20:35:17.873039] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-02. [2025-10-02T20:35:18.674692] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-04. [2025-10-02T20:35:18.680292] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-02T20:35:19.064967] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-02T20:35:19.473177] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-09. [2025-10-02T20:35:20.272988] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-03. [2025-10-02T20:35:20.778691] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-02T20:35:20.913095] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-02T20:35:21.073103] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-03. [2025-10-02T20:35:21.582893] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-02T20:35:21.873053] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-05. [2025-10-02T20:35:21.895841] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-02T20:35:22.673046] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-04. [2025-10-02T20:35:23.472997] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-10. [2025-10-02T20:35:23.761567] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-02T20:35:23.953064] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-02T20:35:24.273014] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-06. [2025-10-02T20:35:24.413430] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-02T20:35:24.415716] [INFO ] [REMOTE ] NRDY: Full fetch complete (51556 records). [2025-10-02T20:35:24.415826] [DEBUG] [VALIDATOR ] NRDY: Validating primary data. [2025-10-02T20:35:24.921937] [DEBUG] [VALIDATOR ] NRDY: All expected trading days are present. [2025-10-02T20:35:24.922028] [DEBUG] [VALIDATOR ] NRDY: Primary data validation passed. [2025-10-02T20:35:24.923272] [INFO ] [MAIN ] NRDY: Fetched primary data is valid. [2025-10-02T20:35:24.923348] [DEBUG] [LOCAL ] NRDY: Saving primary data. [2025-10-02T20:35:24.925133] [DEBUG] [LOCAL ] NRDY: Trimmed 51556 records to 32941 (keeping 200 days of data) [2025-10-02T20:35:25.090348] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-04. [2025-10-02T20:35:25.141633] [DEBUG] [LOCAL ] NRDY: Primary data saved (32941 records). [2025-10-02T20:35:25.141800] [INFO ] [MAIN ] NRDY: Full history saved. [2025-10-02T20:35:25.141879] [INFO ] [MAIN ] Update Progress: 1528/2370 symbols completed. NRDY took 43.0s. Estimated remaining: 1h 58m 40s. Rate: 7.1 symbols/min [2025-10-02T20:35:25.331700] [INFO ] [MAIN ] NRP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:35:25.331904] [DEBUG] [LOCAL ] NRP: No existing data file found in primary storage. [2025-10-02T20:35:25.331943] [WARN ] [MAIN ] NRP: No existing data found, performing full refresh instead. [2025-10-02T20:35:25.332063] [INFO ] [MAIN ] NRP: Wiping existing primary data before full refresh. [2025-10-02T20:35:25.332135] [INFO ] [LOCAL ] NRP: Starting deletion of primary data. [2025-10-02T20:35:25.332215] [DEBUG] [LOCAL ] NRP: No primary data file found to delete. [2025-10-02T20:35:25.332261] [INFO ] [MAIN ] NRP: Starting full primary refresh. [2025-10-02T20:35:25.716855] [INFO ] [REMOTE ] NRP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:35:25.872954] [INFO ] [REMOTE ] NRP: Fetching primary data for 2024-12. [2025-10-02T20:35:26.449023] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-10-02T20:35:26.673018] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-07. [2025-10-02T20:35:26.803686] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-02T20:35:26.841967] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-02T20:35:27.473007] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-01. [2025-10-02T20:35:28.188158] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-02T20:35:28.273009] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-02. [2025-10-02T20:35:28.800002] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-02T20:35:28.961960] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-02T20:35:29.073017] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-03. [2025-10-02T20:35:29.740298] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-02T20:35:29.873019] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-08. [2025-10-02T20:35:30.672994] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-04. [2025-10-02T20:35:31.404427] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-02T20:35:31.472997] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-05. [2025-10-02T20:35:31.816226] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-02T20:35:32.272988] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-05. [2025-10-02T20:35:32.792483] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-02T20:35:33.003579] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-02T20:35:33.073000] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-05. [2025-10-02T20:35:33.872984] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-06. [2025-10-02T20:35:34.246503] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-02T20:35:34.673004] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-06. [2025-10-02T20:35:35.473051] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-09. [2025-10-02T20:35:35.542868] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-02T20:35:35.746854] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-02T20:35:36.273002] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-07. [2025-10-02T20:35:37.073056] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-06. [2025-10-02T20:35:37.587875] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-02T20:35:37.624372] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-02T20:35:37.815617] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-02T20:35:37.872980] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-07. [2025-10-02T20:35:38.558132] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-02T20:35:38.673048] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-08. [2025-10-02T20:35:39.473005] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-08. [2025-10-02T20:35:40.080613] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-02T20:35:40.272995] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-09. [2025-10-02T20:35:40.421740] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-02T20:35:41.011147] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-02T20:35:41.073000] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-10. [2025-10-02T20:35:41.595745] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-02T20:35:41.596592] [INFO ] [REMOTE ] NRP: Full fetch complete (6481 records). [2025-10-02T20:35:41.596691] [DEBUG] [VALIDATOR ] NRP: Validating primary data. [2025-10-02T20:35:41.878211] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-07. [2025-10-02T20:35:42.000190] [DEBUG] [VALIDATOR ] NRP: All expected trading days are present. [2025-10-02T20:35:42.000277] [DEBUG] [VALIDATOR ] NRP: Primary data validation passed. [2025-10-02T20:35:42.000485] [INFO ] [MAIN ] NRP: Fetched primary data is valid. [2025-10-02T20:35:42.000552] [DEBUG] [LOCAL ] NRP: Saving primary data. [2025-10-02T20:35:42.001107] [DEBUG] [LOCAL ] NRP: Trimmed 6481 records to 4103 (keeping 200 days of data) [2025-10-02T20:35:42.036550] [DEBUG] [LOCAL ] NRP: Primary data saved (4103 records). [2025-10-02T20:35:42.037057] [INFO ] [MAIN ] NRP: Full history saved. [2025-10-02T20:35:42.037161] [INFO ] [MAIN ] Update Progress: 1529/2370 symbols completed. NRP took 16.9s. Estimated remaining: 1h 58m 36s. Rate: 7.1 symbols/min [2025-10-02T20:35:42.285588] [INFO ] [MAIN ] NRT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:35:42.285888] [DEBUG] [LOCAL ] NRT: No existing data file found in primary storage. [2025-10-02T20:35:42.285946] [WARN ] [MAIN ] NRT: No existing data found, performing full refresh instead. [2025-10-02T20:35:42.286106] [INFO ] [MAIN ] NRT: Wiping existing primary data before full refresh. [2025-10-02T20:35:42.286154] [INFO ] [LOCAL ] NRT: Starting deletion of primary data. [2025-10-02T20:35:42.286199] [DEBUG] [LOCAL ] NRT: No primary data file found to delete. [2025-10-02T20:35:42.286233] [INFO ] [MAIN ] NRT: Starting full primary refresh. [2025-10-02T20:35:42.683834] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-09. [2025-10-02T20:35:42.690204] [INFO ] [REMOTE ] NRT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:35:43.182750] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-02T20:35:43.473015] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-08. [2025-10-02T20:35:44.272980] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-10. [2025-10-02T20:35:44.522999] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-02T20:35:44.760861] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-02T20:35:44.772519] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-02T20:35:44.774423] [INFO ] [REMOTE ] NRG: Full fetch complete (76193 records). [2025-10-02T20:35:44.774570] [DEBUG] [VALIDATOR ] NRG: Validating primary data. [2025-10-02T20:35:44.775415] [FATAL] [VALIDATOR ] NRG: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T20:35:44.775511] [FATAL] [MAIN ] NRG: Fetched primary data is invalid. Refusing to save it. [2025-10-02T20:35:44.775556] [WARN ] [MAIN ] NRG: Deleting existing primary and derivative data due to validation failure. [2025-10-02T20:35:44.775673] [INFO ] [LOCAL ] NRG: Starting deletion of primary data. [2025-10-02T20:35:44.775759] [DEBUG] [LOCAL ] NRG: No primary data file found to delete. [2025-10-02T20:35:44.775799] [INFO ] [LOCAL ] NRG: Starting deletion of derivative data. [2025-10-02T20:35:44.775872] [DEBUG] [LOCAL ] NRG: No derivative data file found to delete. [2025-10-02T20:35:44.775983] [INFO ] [MAIN ] Update Progress: 1530/2370 symbols completed. NRG took 44.7s. Estimated remaining: 1h 58m 25s. Rate: 7.1 symbols/min [2025-10-02T20:35:44.972942] [INFO ] [MAIN ] NRUC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:35:44.973115] [DEBUG] [LOCAL ] NRUC: No existing data file found in primary storage. [2025-10-02T20:35:44.973152] [WARN ] [MAIN ] NRUC: No existing data found, performing full refresh instead. [2025-10-02T20:35:44.973266] [INFO ] [MAIN ] NRUC: Wiping existing primary data before full refresh. [2025-10-02T20:35:44.973308] [INFO ] [LOCAL ] NRUC: Starting deletion of primary data. [2025-10-02T20:35:44.973349] [DEBUG] [LOCAL ] NRUC: No primary data file found to delete. [2025-10-02T20:35:44.973384] [INFO ] [MAIN ] NRUC: Starting full primary refresh. [2025-10-02T20:35:45.082275] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-09. [2025-10-02T20:35:45.358024] [INFO ] [REMOTE ] NRUC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:35:45.873042] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-10. [2025-10-02T20:35:46.314862] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-02T20:35:46.672996] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-10. [2025-10-02T20:35:47.232567] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-02T20:35:47.234956] [INFO ] [REMOTE ] NRGV: Full fetch complete (62065 records). [2025-10-02T20:35:47.235074] [DEBUG] [VALIDATOR ] NRGV: Validating primary data. [2025-10-02T20:35:47.479588] [INFO ] [REMOTE ] NRT: Fetching primary data for 2024-12. [2025-10-02T20:35:47.581560] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-02T20:35:47.583541] [INFO ] [REMOTE ] NRK: Full fetch complete (27900 records). [2025-10-02T20:35:47.589190] [DEBUG] [VALIDATOR ] NRK: Validating primary data. [2025-10-02T20:35:47.818884] [DEBUG] [VALIDATOR ] NRGV: All expected trading days are present. [2025-10-02T20:35:47.819046] [DEBUG] [VALIDATOR ] NRGV: Primary data validation passed. [2025-10-02T20:35:47.820069] [INFO ] [MAIN ] NRGV: Fetched primary data is valid. [2025-10-02T20:35:47.820377] [DEBUG] [LOCAL ] NRGV: Saving primary data. [2025-10-02T20:35:47.901416] [DEBUG] [LOCAL ] NRGV: Trimmed 62065 records to 43740 (keeping 200 days of data) [2025-10-02T20:35:48.233806] [DEBUG] [VALIDATOR ] NRK: All expected trading days are present. [2025-10-02T20:35:48.234549] [DEBUG] [VALIDATOR ] NRK: Primary data validation passed. [2025-10-02T20:35:48.236249] [INFO ] [MAIN ] NRK: Fetched primary data is valid. [2025-10-02T20:35:48.236688] [DEBUG] [LOCAL ] NRK: Saving primary data. [2025-10-02T20:35:48.239165] [DEBUG] [LOCAL ] NRK: Trimmed 27900 records to 20132 (keeping 200 days of data) [2025-10-02T20:35:48.292080] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2024-12. [2025-10-02T20:35:48.466835] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-02T20:35:48.507496] [DEBUG] [LOCAL ] NRK: Primary data saved (20132 records). [2025-10-02T20:35:48.508625] [INFO ] [MAIN ] NRK: Full history saved. [2025-10-02T20:35:48.509024] [INFO ] [MAIN ] Update Progress: 1531/2370 symbols completed. NRK took 37.2s. Estimated remaining: 1h 58m 14s. Rate: 7.1 symbols/min [2025-10-02T20:35:48.706526] [INFO ] [MAIN ] NSA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:35:48.707557] [DEBUG] [LOCAL ] NSA: No existing data file found in primary storage. [2025-10-02T20:35:48.708478] [WARN ] [MAIN ] NSA: No existing data found, performing full refresh instead. [2025-10-02T20:35:48.709911] [INFO ] [MAIN ] NSA: Wiping existing primary data before full refresh. [2025-10-02T20:35:48.709986] [INFO ] [LOCAL ] NSA: Starting deletion of primary data. [2025-10-02T20:35:48.711416] [DEBUG] [LOCAL ] NSA: No primary data file found to delete. [2025-10-02T20:35:48.711966] [INFO ] [MAIN ] NSA: Starting full primary refresh. [2025-10-02T20:35:49.054264] [DEBUG] [LOCAL ] NRGV: Primary data saved (43740 records). [2025-10-02T20:35:49.054433] [INFO ] [MAIN ] NRGV: Full history saved. [2025-10-02T20:35:49.054891] [INFO ] [MAIN ] Update Progress: 1532/2370 symbols completed. NRGV took 38.6s. Estimated remaining: 1h 58m 1s. Rate: 7.1 symbols/min [2025-10-02T20:35:49.076156] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-01. [2025-10-02T20:35:49.171165] [INFO ] [REMOTE ] NSA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:35:49.320668] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-02T20:35:49.350633] [INFO ] [MAIN ] NSC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:35:49.350848] [DEBUG] [LOCAL ] NSC: No existing data file found in primary storage. [2025-10-02T20:35:49.350904] [WARN ] [MAIN ] NSC: No existing data found, performing full refresh instead. [2025-10-02T20:35:49.351021] [INFO ] [MAIN ] NSC: Wiping existing primary data before full refresh. [2025-10-02T20:35:49.351065] [INFO ] [LOCAL ] NSC: Starting deletion of primary data. [2025-10-02T20:35:49.351107] [DEBUG] [LOCAL ] NSC: No primary data file found to delete. [2025-10-02T20:35:49.351177] [INFO ] [MAIN ] NSC: Starting full primary refresh. [2025-10-02T20:35:49.747845] [INFO ] [REMOTE ] NSC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:35:49.873021] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-01. [2025-10-02T20:35:50.362798] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-02T20:35:50.656199] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-02T20:35:50.672947] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-02. [2025-10-02T20:35:51.403411] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-02T20:35:51.473038] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-03. [2025-10-02T20:35:52.185413] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-02T20:35:52.272987] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-04. [2025-10-02T20:35:52.921310] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-02T20:35:53.073001] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-05. [2025-10-02T20:35:53.802085] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-02T20:35:53.872968] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-06. [2025-10-02T20:35:54.456391] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-02T20:35:54.673004] [INFO ] [REMOTE ] NSC: Fetching primary data for 2024-12. [2025-10-02T20:35:55.473059] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-02. [2025-10-02T20:35:56.195354] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-02T20:35:56.273021] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-03. [2025-10-02T20:35:56.566270] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-02T20:35:56.994625] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-02T20:35:57.073011] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-04. [2025-10-02T20:35:57.662945] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-02T20:35:57.873019] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-07. [2025-10-02T20:35:58.395100] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-02T20:35:58.673046] [INFO ] [REMOTE ] NSA: Fetching primary data for 2024-12. [2025-10-02T20:35:59.473017] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-05. [2025-10-02T20:35:59.996083] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-02T20:36:00.273008] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-08. [2025-10-02T20:36:00.384182] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-02T20:36:00.914294] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-02T20:36:01.073073] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-06. [2025-10-02T20:36:01.626368] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-02T20:36:01.873021] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-07. [2025-10-02T20:36:02.607743] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-02T20:36:02.673034] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-09. [2025-10-02T20:36:03.178455] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-02T20:36:03.472997] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-08. [2025-10-02T20:36:04.272990] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-10. [2025-10-02T20:36:04.311118] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-02T20:36:05.009686] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-02T20:36:05.010513] [INFO ] [REMOTE ] NRUC: Full fetch complete (5506 records). [2025-10-02T20:36:05.010584] [DEBUG] [VALIDATOR ] NRUC: Validating primary data. [2025-10-02T20:36:05.078224] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-09. [2025-10-02T20:36:05.409680] [DEBUG] [VALIDATOR ] NRUC: All expected trading days are present. [2025-10-02T20:36:05.409799] [DEBUG] [VALIDATOR ] NRUC: Primary data validation passed. [2025-10-02T20:36:05.409984] [INFO ] [MAIN ] NRUC: Fetched primary data is valid. [2025-10-02T20:36:05.410029] [DEBUG] [LOCAL ] NRUC: Saving primary data. [2025-10-02T20:36:05.410560] [DEBUG] [LOCAL ] NRUC: Trimmed 5506 records to 3105 (keeping 200 days of data) [2025-10-02T20:36:05.431185] [DEBUG] [LOCAL ] NRUC: Primary data saved (3105 records). [2025-10-02T20:36:05.431327] [INFO ] [MAIN ] NRUC: Full history saved. [2025-10-02T20:36:05.431407] [INFO ] [MAIN ] Update Progress: 1533/2370 symbols completed. NRUC took 20.7s. Estimated remaining: 1h 57m 57s. Rate: 7.1 symbols/min [2025-10-02T20:36:05.617839] [INFO ] [MAIN ] NSP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:36:05.618002] [DEBUG] [LOCAL ] NSP: No existing data file found in primary storage. [2025-10-02T20:36:05.618041] [WARN ] [MAIN ] NSP: No existing data found, performing full refresh instead. [2025-10-02T20:36:05.618161] [INFO ] [MAIN ] NSP: Wiping existing primary data before full refresh. [2025-10-02T20:36:05.618234] [INFO ] [LOCAL ] NSP: Starting deletion of primary data. [2025-10-02T20:36:05.618300] [DEBUG] [LOCAL ] NSP: No primary data file found to delete. [2025-10-02T20:36:05.618337] [INFO ] [MAIN ] NSP: Starting full primary refresh. [2025-10-02T20:36:05.883456] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-01. [2025-10-02T20:36:05.932141] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-02T20:36:06.020360] [INFO ] [REMOTE ] NSP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:36:06.673053] [INFO ] [REMOTE ] NSP: Fetching primary data for 2024-12. [2025-10-02T20:36:07.473025] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-01. [2025-10-02T20:36:07.946362] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-02T20:36:08.272973] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-10. [2025-10-02T20:36:08.572993] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-02T20:36:08.710243] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-02T20:36:08.711135] [INFO ] [REMOTE ] NRT: Full fetch complete (8052 records). [2025-10-02T20:36:08.711211] [DEBUG] [VALIDATOR ] NRT: Validating primary data. [2025-10-02T20:36:09.078141] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-01. [2025-10-02T20:36:09.112359] [DEBUG] [VALIDATOR ] NRT: All expected trading days are present. [2025-10-02T20:36:09.112714] [DEBUG] [VALIDATOR ] NRT: Primary data validation passed. [2025-10-02T20:36:09.113189] [INFO ] [MAIN ] NRT: Fetched primary data is valid. [2025-10-02T20:36:09.113277] [DEBUG] [LOCAL ] NRT: Saving primary data. [2025-10-02T20:36:09.113932] [DEBUG] [LOCAL ] NRT: Trimmed 8052 records to 5012 (keeping 200 days of data) [2025-10-02T20:36:09.146323] [DEBUG] [LOCAL ] NRT: Primary data saved (5012 records). [2025-10-02T20:36:09.146459] [INFO ] [MAIN ] NRT: Full history saved. [2025-10-02T20:36:09.146537] [INFO ] [MAIN ] Update Progress: 1534/2370 symbols completed. NRT took 27.1s. Estimated remaining: 1h 57m 46s. Rate: 7.1 symbols/min [2025-10-02T20:36:09.334552] [INFO ] [MAIN ] NTB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:36:09.334886] [DEBUG] [LOCAL ] NTB: No existing data file found in primary storage. [2025-10-02T20:36:09.335060] [WARN ] [MAIN ] NTB: No existing data found, performing full refresh instead. [2025-10-02T20:36:09.335204] [INFO ] [MAIN ] NTB: Wiping existing primary data before full refresh. [2025-10-02T20:36:09.335335] [INFO ] [LOCAL ] NTB: Starting deletion of primary data. [2025-10-02T20:36:09.335559] [DEBUG] [LOCAL ] NTB: No primary data file found to delete. [2025-10-02T20:36:09.335613] [INFO ] [MAIN ] NTB: Starting full primary refresh. [2025-10-02T20:36:09.457796] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-02T20:36:09.757504] [INFO ] [REMOTE ] NTB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:36:09.873007] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-02. [2025-10-02T20:36:10.548950] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-02T20:36:10.673033] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-02. [2025-10-02T20:36:11.479157] [INFO ] [REMOTE ] NTB: Fetching primary data for 2024-12. [2025-10-02T20:36:11.484968] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-02T20:36:12.134946] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-02T20:36:12.273004] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-02. [2025-10-02T20:36:12.859873] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-02T20:36:13.073001] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-03. [2025-10-02T20:36:13.741083] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-02T20:36:13.873004] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-03. [2025-10-02T20:36:14.570182] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-02T20:36:14.673035] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-04. [2025-10-02T20:36:15.244204] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-02T20:36:15.472997] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-04. [2025-10-02T20:36:16.072196] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-02T20:36:16.272986] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-01. [2025-10-02T20:36:17.072976] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-05. [2025-10-02T20:36:17.175549] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-02T20:36:17.429921] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-02T20:36:17.873011] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-03. [2025-10-02T20:36:18.672995] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-05. [2025-10-02T20:36:18.721843] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-02T20:36:19.472989] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-06. [2025-10-02T20:36:19.970721] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-02T20:36:20.272991] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-04. [2025-10-02T20:36:20.474182] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-02T20:36:20.596766] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-02T20:36:21.073001] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-07. [2025-10-02T20:36:21.872978] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-06. [2025-10-02T20:36:21.945529] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-02T20:36:22.630263] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-02T20:36:22.672991] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-02. [2025-10-02T20:36:23.472960] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-08. [2025-10-02T20:36:23.578119] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-02T20:36:23.831828] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-02T20:36:24.272993] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-07. [2025-10-02T20:36:24.888280] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-02T20:36:25.072997] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-05. [2025-10-02T20:36:25.872984] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-09. [2025-10-02T20:36:26.244907] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-02T20:36:26.673004] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-08. [2025-10-02T20:36:27.473004] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-03. [2025-10-02T20:36:28.229152] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-10-02T20:36:28.272981] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-10. [2025-10-02T20:36:28.276470] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-05 (3.20 seconds). [2025-10-02T20:36:28.355307] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-02T20:36:28.404630] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-02T20:36:29.073004] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-06. [2025-10-02T20:36:29.515811] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-02T20:36:29.517474] [INFO ] [REMOTE ] NSP: Full fetch complete (49706 records). [2025-10-02T20:36:29.517577] [DEBUG] [VALIDATOR ] NSP: Validating primary data. [2025-10-02T20:36:29.878123] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-04. [2025-10-02T20:36:29.934285] [DEBUG] [VALIDATOR ] NSP: All expected trading days are present. [2025-10-02T20:36:29.934363] [DEBUG] [VALIDATOR ] NSP: Primary data validation passed. [2025-10-02T20:36:29.935267] [INFO ] [MAIN ] NSP: Fetched primary data is valid. [2025-10-02T20:36:29.935333] [DEBUG] [LOCAL ] NSP: Saving primary data. [2025-10-02T20:36:29.936427] [DEBUG] [LOCAL ] NSP: Trimmed 49706 records to 35259 (keeping 200 days of data) [2025-10-02T20:36:30.175809] [DEBUG] [LOCAL ] NSP: Primary data saved (35259 records). [2025-10-02T20:36:30.175965] [INFO ] [MAIN ] NSP: Full history saved. [2025-10-02T20:36:30.176040] [INFO ] [MAIN ] Update Progress: 1535/2370 symbols completed. NSP took 24.7s. Estimated remaining: 1h 57m 44s. Rate: 7.1 symbols/min [2025-10-02T20:36:30.370673] [INFO ] [MAIN ] NTEST: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:36:30.370893] [DEBUG] [LOCAL ] NTEST: No existing data file found in primary storage. [2025-10-02T20:36:30.370944] [WARN ] [MAIN ] NTEST: No existing data found, performing full refresh instead. [2025-10-02T20:36:30.371055] [INFO ] [MAIN ] NTEST: Wiping existing primary data before full refresh. [2025-10-02T20:36:30.371099] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-10-02T20:36:30.371145] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-10-02T20:36:30.371180] [INFO ] [MAIN ] NTEST: Starting full primary refresh. [2025-10-02T20:36:30.678268] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-09. [2025-10-02T20:36:30.756935] [INFO ] [REMOTE ] NTEST: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:36:30.790552] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-02T20:36:31.166272] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-02T20:36:31.473005] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2024-12. [2025-10-02T20:36:32.125613] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-02T20:36:32.272992] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-05. [2025-10-02T20:36:32.463507] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-02T20:36:33.072988] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-10. [2025-10-02T20:36:33.128494] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-02T20:36:33.873010] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-06. [2025-10-02T20:36:34.523352] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-02T20:36:34.526171] [INFO ] [REMOTE ] NSA: Full fetch complete (62012 records). [2025-10-02T20:36:34.526342] [DEBUG] [VALIDATOR ] NSA: Validating primary data. [2025-10-02T20:36:34.675733] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-01. [2025-10-02T20:36:34.985258] [DEBUG] [VALIDATOR ] NSA: All expected trading days are present. [2025-10-02T20:36:34.985380] [DEBUG] [VALIDATOR ] NSA: Primary data validation passed. [2025-10-02T20:36:34.986718] [INFO ] [MAIN ] NSA: Fetched primary data is valid. [2025-10-02T20:36:34.986896] [DEBUG] [LOCAL ] NSA: Saving primary data. [2025-10-02T20:36:34.989226] [DEBUG] [LOCAL ] NSA: Trimmed 62012 records to 45004 (keeping 200 days of data) [2025-10-02T20:36:35.099709] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-02T20:36:35.271938] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-02T20:36:35.319964] [DEBUG] [LOCAL ] NSA: Primary data saved (45004 records). [2025-10-02T20:36:35.320140] [INFO ] [MAIN ] NSA: Full history saved. [2025-10-02T20:36:35.320227] [INFO ] [MAIN ] Update Progress: 1536/2370 symbols completed. NSA took 46.8s. Estimated remaining: 1h 57m 34s. Rate: 7.1 symbols/min [2025-10-02T20:36:35.479526] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-07. [2025-10-02T20:36:35.513971] [INFO ] [MAIN ] NTR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:36:35.515211] [DEBUG] [LOCAL ] NTR: No existing data file found in primary storage. [2025-10-02T20:36:35.515262] [WARN ] [MAIN ] NTR: No existing data found, performing full refresh instead. [2025-10-02T20:36:35.515406] [INFO ] [MAIN ] NTR: Wiping existing primary data before full refresh. [2025-10-02T20:36:35.515491] [INFO ] [LOCAL ] NTR: Starting deletion of primary data. [2025-10-02T20:36:35.515591] [DEBUG] [LOCAL ] NTR: No primary data file found to delete. [2025-10-02T20:36:35.515690] [INFO ] [MAIN ] NTR: Starting full primary refresh. [2025-10-02T20:36:35.900435] [INFO ] [REMOTE ] NTR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:36:36.273068] [INFO ] [REMOTE ] NTR: Fetching primary data for 2024-12. [2025-10-02T20:36:36.784155] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-02T20:36:37.073016] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-08. [2025-10-02T20:36:37.872972] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-02. [2025-10-02T20:36:37.956821] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-02T20:36:38.288084] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-02T20:36:38.533629] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-02T20:36:38.673013] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-03. [2025-10-02T20:36:39.249270] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-02T20:36:39.472998] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-09. [2025-10-02T20:36:40.272975] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-04. [2025-10-02T20:36:40.567508] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-02T20:36:40.799285] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-02T20:36:41.073030] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-01. [2025-10-02T20:36:41.873047] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-10. [2025-10-02T20:36:42.589103] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-02T20:36:42.590334] [INFO ] [REMOTE ] NTB: Full fetch complete (30723 records). [2025-10-02T20:36:42.590417] [DEBUG] [VALIDATOR ] NTB: Validating primary data. [2025-10-02T20:36:42.674361] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-07. [2025-10-02T20:36:43.010954] [DEBUG] [VALIDATOR ] NTB: All expected trading days are present. [2025-10-02T20:36:43.011179] [DEBUG] [VALIDATOR ] NTB: Primary data validation passed. [2025-10-02T20:36:43.011926] [INFO ] [MAIN ] NTB: Fetched primary data is valid. [2025-10-02T20:36:43.012008] [DEBUG] [LOCAL ] NTB: Saving primary data. [2025-10-02T20:36:43.013325] [DEBUG] [LOCAL ] NTB: Trimmed 30723 records to 20329 (keeping 200 days of data) [2025-10-02T20:36:43.046157] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-02T20:36:43.196224] [DEBUG] [LOCAL ] NTB: Primary data saved (20329 records). [2025-10-02T20:36:43.196361] [INFO ] [MAIN ] NTB: Full history saved. [2025-10-02T20:36:43.196476] [INFO ] [MAIN ] Update Progress: 1537/2370 symbols completed. NTB took 34.0s. Estimated remaining: 1h 57m 25s. Rate: 7.1 symbols/min [2025-10-02T20:36:43.378891] [INFO ] [MAIN ] NTST: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:36:43.379109] [DEBUG] [LOCAL ] NTST: No existing data file found in primary storage. [2025-10-02T20:36:43.379166] [WARN ] [MAIN ] NTST: No existing data found, performing full refresh instead. [2025-10-02T20:36:43.379286] [INFO ] [MAIN ] NTST: Wiping existing primary data before full refresh. [2025-10-02T20:36:43.379332] [INFO ] [LOCAL ] NTST: Starting deletion of primary data. [2025-10-02T20:36:43.379377] [DEBUG] [LOCAL ] NTST: No primary data file found to delete. [2025-10-02T20:36:43.379413] [INFO ] [MAIN ] NTST: Starting full primary refresh. [2025-10-02T20:36:43.481288] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-05. [2025-10-02T20:36:43.791269] [INFO ] [REMOTE ] NTST: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:36:44.272993] [INFO ] [REMOTE ] NTST: Fetching primary data for 2024-12. [2025-10-02T20:36:44.404146] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-02T20:36:44.743707] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-02T20:36:45.072950] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-02. [2025-10-02T20:36:45.873031] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-08. [2025-10-02T20:36:46.033767] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-02T20:36:46.671298] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-02T20:36:46.680956] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-01. [2025-10-02T20:36:47.473072] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-03. [2025-10-02T20:36:47.723211] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-02T20:36:47.970765] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-02T20:36:48.273066] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-02. [2025-10-02T20:36:49.073031] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-09. [2025-10-02T20:36:49.349733] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-02T20:36:49.734024] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-02T20:36:49.873016] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-04. [2025-10-02T20:36:50.672985] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-06. [2025-10-02T20:36:50.995508] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-02T20:36:51.212507] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-02T20:36:51.302946] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-02T20:36:51.473033] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-03. [2025-10-02T20:36:52.272994] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-10. [2025-10-02T20:36:52.604158] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-02T20:36:52.605716] [INFO ] [REMOTE ] NSC: Full fetch complete (70601 records). [2025-10-02T20:36:52.605827] [DEBUG] [VALIDATOR ] NSC: Validating primary data. [2025-10-02T20:36:52.606721] [FATAL] [VALIDATOR ] NSC: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T20:36:52.606812] [FATAL] [MAIN ] NSC: Fetched primary data is invalid. Refusing to save it. [2025-10-02T20:36:52.606858] [WARN ] [MAIN ] NSC: Deleting existing primary and derivative data due to validation failure. [2025-10-02T20:36:52.606953] [INFO ] [LOCAL ] NSC: Starting deletion of primary data. [2025-10-02T20:36:52.607050] [DEBUG] [LOCAL ] NSC: No primary data file found to delete. [2025-10-02T20:36:52.607118] [INFO ] [LOCAL ] NSC: Starting deletion of derivative data. [2025-10-02T20:36:52.607184] [DEBUG] [LOCAL ] NSC: No derivative data file found to delete. [2025-10-02T20:36:52.607266] [INFO ] [MAIN ] Update Progress: 1538/2370 symbols completed. NSC took 1m 4s. Estimated remaining: 1h 57m 17s. Rate: 7.1 symbols/min [2025-10-02T20:36:52.794273] [INFO ] [MAIN ] NU: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:36:52.794434] [DEBUG] [LOCAL ] NU: No existing data file found in primary storage. [2025-10-02T20:36:52.794473] [WARN ] [MAIN ] NU: No existing data found, performing full refresh instead. [2025-10-02T20:36:52.794588] [INFO ] [MAIN ] NU: Wiping existing primary data before full refresh. [2025-10-02T20:36:52.794693] [INFO ] [LOCAL ] NU: Starting deletion of primary data. [2025-10-02T20:36:52.794782] [DEBUG] [LOCAL ] NU: No primary data file found to delete. [2025-10-02T20:36:52.794833] [INFO ] [MAIN ] NU: Starting full primary refresh. [2025-10-02T20:36:53.078087] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-05. [2025-10-02T20:36:53.180019] [INFO ] [REMOTE ] NU: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:36:53.482043] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-02T20:36:53.873015] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-07. [2025-10-02T20:36:54.533548] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-02T20:36:54.673070] [INFO ] [REMOTE ] NU: Fetching primary data for 2024-12. [2025-10-02T20:36:55.035416] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-02T20:36:55.473041] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-08. [2025-10-02T20:36:56.076399] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-02T20:36:56.273018] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-06. [2025-10-02T20:36:57.078103] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-09. [2025-10-02T20:36:57.099559] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2024-12 (2.43 seconds). [2025-10-02T20:36:57.674191] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-02T20:36:57.873020] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-10. [2025-10-02T20:36:58.090871] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-02T20:36:58.424466] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-02T20:36:58.425177] [INFO ] [REMOTE ] NTEST: Full fetch complete (1989 records). [2025-10-02T20:36:58.425249] [DEBUG] [VALIDATOR ] NTEST: Validating primary data. [2025-10-02T20:36:58.641210] [WARN ] [VALIDATOR ] NTEST: Validation failed - insufficient historical data. Have 171 unique days, need 200 days [2025-10-02T20:36:58.641437] [FATAL] [MAIN ] NTEST: Fetched primary data is invalid. Refusing to save it. [2025-10-02T20:36:58.641517] [WARN ] [MAIN ] NTEST: Deleting existing primary and derivative data due to validation failure. [2025-10-02T20:36:58.641606] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-10-02T20:36:58.641740] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-10-02T20:36:58.641800] [INFO ] [LOCAL ] NTEST: Starting deletion of derivative data. [2025-10-02T20:36:58.641847] [DEBUG] [LOCAL ] NTEST: No derivative data file found to delete. [2025-10-02T20:36:58.641913] [INFO ] [MAIN ] Update Progress: 1539/2370 symbols completed. NTEST took 28.5s. Estimated remaining: 1h 57m 7s. Rate: 7.1 symbols/min [2025-10-02T20:36:58.674965] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-01. [2025-10-02T20:36:58.845219] [INFO ] [MAIN ] NUE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:36:58.845450] [DEBUG] [LOCAL ] NUE: No existing data file found in primary storage. [2025-10-02T20:36:58.845508] [WARN ] [MAIN ] NUE: No existing data found, performing full refresh instead. [2025-10-02T20:36:58.845624] [INFO ] [MAIN ] NUE: Wiping existing primary data before full refresh. [2025-10-02T20:36:58.845700] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-10-02T20:36:58.845756] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-10-02T20:36:58.845792] [INFO ] [MAIN ] NUE: Starting full primary refresh. [2025-10-02T20:36:59.252253] [INFO ] [REMOTE ] NUE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:36:59.473012] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-04. [2025-10-02T20:37:00.273015] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-07. [2025-10-02T20:37:01.073013] [INFO ] [REMOTE ] NUE: Fetching primary data for 2024-12. [2025-10-02T20:37:01.576730] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-02T20:37:01.772302] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-01 (3.10 seconds). [2025-10-02T20:37:01.872975] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-02. [2025-10-02T20:37:01.948128] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-02T20:37:02.672991] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-08. [2025-10-02T20:37:03.325380] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-10-02T20:37:03.473039] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-05. [2025-10-02T20:37:04.208101] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-10-02T20:37:04.251481] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-02T20:37:04.272961] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-09. [2025-10-02T20:37:05.072974] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-03. [2025-10-02T20:37:05.171086] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-02T20:37:05.873013] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-06. [2025-10-02T20:37:06.379212] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-02T20:37:06.673061] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-10. [2025-10-02T20:37:07.411029] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-02T20:37:07.473348] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-10-02T20:37:07.473444] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-07. [2025-10-02T20:37:08.020063] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-02T20:37:08.022490] [INFO ] [REMOTE ] NTR: Full fetch complete (76297 records). [2025-10-02T20:37:08.022679] [DEBUG] [VALIDATOR ] NTR: Validating primary data. [2025-10-02T20:37:08.278127] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-04. [2025-10-02T20:37:08.474258] [DEBUG] [VALIDATOR ] NTR: All expected trading days are present. [2025-10-02T20:37:08.474345] [DEBUG] [VALIDATOR ] NTR: Primary data validation passed. [2025-10-02T20:37:08.475433] [INFO ] [MAIN ] NTR: Fetched primary data is valid. [2025-10-02T20:37:08.475502] [DEBUG] [LOCAL ] NTR: Saving primary data. [2025-10-02T20:37:08.477234] [DEBUG] [LOCAL ] NTR: Trimmed 76297 records to 52959 (keeping 200 days of data) [2025-10-02T20:37:08.847529] [DEBUG] [LOCAL ] NTR: Primary data saved (52959 records). [2025-10-02T20:37:08.847713] [INFO ] [MAIN ] NTR: Full history saved. [2025-10-02T20:37:08.847810] [INFO ] [MAIN ] Update Progress: 1540/2370 symbols completed. NTR took 33.5s. Estimated remaining: 1h 56m 60s. Rate: 7.1 symbols/min [2025-10-02T20:37:09.049830] [INFO ] [MAIN ] NUS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:37:09.050334] [DEBUG] [LOCAL ] NUS: No existing data file found in primary storage. [2025-10-02T20:37:09.050393] [WARN ] [MAIN ] NUS: No existing data found, performing full refresh instead. [2025-10-02T20:37:09.050576] [INFO ] [MAIN ] NUS: Wiping existing primary data before full refresh. [2025-10-02T20:37:09.050668] [INFO ] [LOCAL ] NUS: Starting deletion of primary data. [2025-10-02T20:37:09.050748] [DEBUG] [LOCAL ] NUS: No primary data file found to delete. [2025-10-02T20:37:09.050792] [INFO ] [MAIN ] NUS: Starting full primary refresh. [2025-10-02T20:37:09.085203] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-01. [2025-10-02T20:37:09.470764] [INFO ] [REMOTE ] NUS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:37:09.501968] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-02T20:37:09.873029] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-08. [2025-10-02T20:37:10.395357] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-02T20:37:10.672999] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-05. [2025-10-02T20:37:11.198532] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-02T20:37:11.473036] [INFO ] [REMOTE ] NUS: Fetching primary data for 2024-12. [2025-10-02T20:37:11.601972] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-02T20:37:12.272999] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-09. [2025-10-02T20:37:12.795589] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-02T20:37:13.072981] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-06. [2025-10-02T20:37:13.392359] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-02T20:37:13.724314] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-02T20:37:13.872993] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-10. [2025-10-02T20:37:14.673011] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-01. [2025-10-02T20:37:15.145156] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-02T20:37:15.147032] [INFO ] [REMOTE ] NTST: Full fetch complete (61140 records). [2025-10-02T20:37:15.147138] [DEBUG] [VALIDATOR ] NTST: Validating primary data. [2025-10-02T20:37:15.477572] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-02. [2025-10-02T20:37:15.557131] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-10-02T20:37:15.613839] [DEBUG] [VALIDATOR ] NTST: All expected trading days are present. [2025-10-02T20:37:15.614086] [DEBUG] [VALIDATOR ] NTST: Primary data validation passed. [2025-10-02T20:37:15.615225] [INFO ] [MAIN ] NTST: Fetched primary data is valid. [2025-10-02T20:37:15.615316] [DEBUG] [LOCAL ] NTST: Saving primary data. [2025-10-02T20:37:15.617067] [DEBUG] [LOCAL ] NTST: Trimmed 61140 records to 43828 (keeping 200 days of data) [2025-10-02T20:37:15.911505] [DEBUG] [LOCAL ] NTST: Primary data saved (43828 records). [2025-10-02T20:37:15.911682] [INFO ] [MAIN ] NTST: Full history saved. [2025-10-02T20:37:15.911783] [INFO ] [MAIN ] Update Progress: 1541/2370 symbols completed. NTST took 32.7s. Estimated remaining: 1h 56m 51s. Rate: 7.1 symbols/min [2025-10-02T20:37:16.093127] [INFO ] [MAIN ] NUV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:37:16.093417] [DEBUG] [LOCAL ] NUV: No existing data file found in primary storage. [2025-10-02T20:37:16.093523] [WARN ] [MAIN ] NUV: No existing data found, performing full refresh instead. [2025-10-02T20:37:16.093735] [INFO ] [MAIN ] NUV: Wiping existing primary data before full refresh. [2025-10-02T20:37:16.093900] [INFO ] [LOCAL ] NUV: Starting deletion of primary data. [2025-10-02T20:37:16.093973] [DEBUG] [LOCAL ] NUV: No primary data file found to delete. [2025-10-02T20:37:16.101938] [INFO ] [MAIN ] NUV: Starting full primary refresh. [2025-10-02T20:37:16.165325] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-02T20:37:16.283850] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-07. [2025-10-02T20:37:16.522457] [INFO ] [REMOTE ] NUV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:37:17.073014] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-02. [2025-10-02T20:37:17.873005] [INFO ] [REMOTE ] NUV: Fetching primary data for 2024-12. [2025-10-02T20:37:17.971952] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-02 (2.49 seconds). [2025-10-02T20:37:18.411100] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-02T20:37:18.672979] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-03. [2025-10-02T20:37:18.873053] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-07 (2.59 seconds). [2025-10-02T20:37:19.472995] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-08. [2025-10-02T20:37:19.579863] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-02T20:37:20.272993] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-03. [2025-10-02T20:37:20.367720] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-02T20:37:21.073010] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-04. [2025-10-02T20:37:21.614556] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-02T20:37:21.873014] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-01. [2025-10-02T20:37:22.672971] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-09. [2025-10-02T20:37:22.766931] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-03 (2.49 seconds). [2025-10-02T20:37:22.804362] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-02T20:37:23.152209] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-02T20:37:23.473008] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-04. [2025-10-02T20:37:24.273008] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-02. [2025-10-02T20:37:25.015682] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-10-02T20:37:25.072984] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-10. [2025-10-02T20:37:25.424872] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-02T20:37:25.606994] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-02T20:37:25.873008] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-03. [2025-10-02T20:37:26.673008] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-05. [2025-10-02T20:37:26.853978] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-02T20:37:26.866023] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-02T20:37:26.868722] [INFO ] [REMOTE ] NU: Full fetch complete (77880 records). [2025-10-02T20:37:26.868848] [DEBUG] [VALIDATOR ] NU: Validating primary data. [2025-10-02T20:37:27.294665] [DEBUG] [VALIDATOR ] NU: All expected trading days are present. [2025-10-02T20:37:27.294765] [DEBUG] [VALIDATOR ] NU: Primary data validation passed. [2025-10-02T20:37:27.295915] [INFO ] [MAIN ] NU: Fetched primary data is valid. [2025-10-02T20:37:27.295983] [DEBUG] [LOCAL ] NU: Saving primary data. [2025-10-02T20:37:27.297738] [DEBUG] [LOCAL ] NU: Trimmed 77880 records to 54136 (keeping 200 days of data) [2025-10-02T20:37:27.500578] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-05. [2025-10-02T20:37:27.676127] [DEBUG] [LOCAL ] NU: Primary data saved (54136 records). [2025-10-02T20:37:27.676352] [INFO ] [MAIN ] NU: Full history saved. [2025-10-02T20:37:27.676532] [INFO ] [MAIN ] Update Progress: 1542/2370 symbols completed. NU took 35.1s. Estimated remaining: 1h 56m 44s. Rate: 7.1 symbols/min [2025-10-02T20:37:27.868775] [INFO ] [MAIN ] NUVB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:37:27.869006] [DEBUG] [LOCAL ] NUVB: No existing data file found in primary storage. [2025-10-02T20:37:27.869057] [WARN ] [MAIN ] NUVB: No existing data found, performing full refresh instead. [2025-10-02T20:37:27.869174] [INFO ] [MAIN ] NUVB: Wiping existing primary data before full refresh. [2025-10-02T20:37:27.869218] [INFO ] [LOCAL ] NUVB: Starting deletion of primary data. [2025-10-02T20:37:27.869262] [DEBUG] [LOCAL ] NUVB: No primary data file found to delete. [2025-10-02T20:37:27.869310] [INFO ] [MAIN ] NUVB: Starting full primary refresh. [2025-10-02T20:37:28.261419] [INFO ] [REMOTE ] NUVB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:37:28.272957] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2024-12. [2025-10-02T20:37:28.519342] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-02T20:37:29.073000] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-06. [2025-10-02T20:37:29.220179] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-02T20:37:29.873011] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-06. [2025-10-02T20:37:30.109457] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-02T20:37:30.673056] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-01. [2025-10-02T20:37:30.927794] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-02T20:37:31.249554] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-10-02T20:37:31.473069] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-07. [2025-10-02T20:37:32.272987] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-07. [2025-10-02T20:37:32.420790] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-02T20:37:33.073020] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-04. [2025-10-02T20:37:33.485516] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-02T20:37:33.863344] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-02T20:37:33.872943] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-08. [2025-10-02T20:37:34.233939] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-02T20:37:34.673063] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-05. [2025-10-02T20:37:35.473033] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-08. [2025-10-02T20:37:35.542944] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-02T20:37:35.831756] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-02T20:37:36.272996] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-06. [2025-10-02T20:37:37.073003] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-09. [2025-10-02T20:37:37.431292] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-02T20:37:37.581687] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-02T20:37:37.873023] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-09. [2025-10-02T20:37:38.665165] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-02T20:37:38.672976] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-07. [2025-10-02T20:37:39.473008] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-10. [2025-10-02T20:37:39.889476] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-02T20:37:39.923493] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-02T20:37:40.273012] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-08. [2025-10-02T20:37:40.632029] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-02T20:37:40.633771] [INFO ] [REMOTE ] NUS: Full fetch complete (53908 records). [2025-10-02T20:37:40.633872] [DEBUG] [VALIDATOR ] NUS: Validating primary data. [2025-10-02T20:37:41.046555] [DEBUG] [VALIDATOR ] NUS: All expected trading days are present. [2025-10-02T20:37:41.046677] [DEBUG] [VALIDATOR ] NUS: Primary data validation passed. [2025-10-02T20:37:41.047589] [INFO ] [MAIN ] NUS: Fetched primary data is valid. [2025-10-02T20:37:41.047634] [DEBUG] [LOCAL ] NUS: Saving primary data. [2025-10-02T20:37:41.048993] [DEBUG] [LOCAL ] NUS: Trimmed 53908 records to 36660 (keeping 200 days of data) [2025-10-02T20:37:41.109794] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-02. [2025-10-02T20:37:41.295147] [DEBUG] [LOCAL ] NUS: Primary data saved (36660 records). [2025-10-02T20:37:41.295283] [INFO ] [MAIN ] NUS: Full history saved. [2025-10-02T20:37:41.295360] [INFO ] [MAIN ] Update Progress: 1543/2370 symbols completed. NUS took 32.4s. Estimated remaining: 1h 56m 38s. Rate: 7.1 symbols/min [2025-10-02T20:37:41.482074] [INFO ] [MAIN ] NUW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:37:41.482474] [DEBUG] [LOCAL ] NUW: No existing data file found in primary storage. [2025-10-02T20:37:41.482531] [WARN ] [MAIN ] NUW: No existing data found, performing full refresh instead. [2025-10-02T20:37:41.482686] [INFO ] [MAIN ] NUW: Wiping existing primary data before full refresh. [2025-10-02T20:37:41.482752] [INFO ] [LOCAL ] NUW: Starting deletion of primary data. [2025-10-02T20:37:41.482821] [DEBUG] [LOCAL ] NUW: No primary data file found to delete. [2025-10-02T20:37:41.482857] [INFO ] [MAIN ] NUW: Starting full primary refresh. [2025-10-02T20:37:41.674220] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-02T20:37:41.882072] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-10. [2025-10-02T20:37:41.925904] [INFO ] [REMOTE ] NUW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:37:42.615162] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-02T20:37:42.673040] [INFO ] [REMOTE ] NUW: Fetching primary data for 2024-12. [2025-10-02T20:37:43.443676] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-02T20:37:43.445753] [INFO ] [REMOTE ] NUE: Full fetch complete (74897 records). [2025-10-02T20:37:43.445875] [DEBUG] [VALIDATOR ] NUE: Validating primary data. [2025-10-02T20:37:43.478578] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-09. [2025-10-02T20:37:43.670607] [WARN ] [VALIDATOR ] NUE: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-02T20:37:43.671470] [FATAL] [MAIN ] NUE: Fetched primary data is invalid. Refusing to save it. [2025-10-02T20:37:43.671548] [WARN ] [MAIN ] NUE: Deleting existing primary and derivative data due to validation failure. [2025-10-02T20:37:43.671625] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-10-02T20:37:43.671739] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-10-02T20:37:43.671791] [INFO ] [LOCAL ] NUE: Starting deletion of derivative data. [2025-10-02T20:37:43.671863] [DEBUG] [LOCAL ] NUE: No derivative data file found to delete. [2025-10-02T20:37:43.671958] [INFO ] [MAIN ] Update Progress: 1544/2370 symbols completed. NUE took 45.0s. Estimated remaining: 1h 56m 27s. Rate: 7.1 symbols/min [2025-10-02T20:37:43.820520] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-02T20:37:43.892249] [INFO ] [MAIN ] NVG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:37:43.892453] [DEBUG] [LOCAL ] NVG: No existing data file found in primary storage. [2025-10-02T20:37:43.892511] [WARN ] [MAIN ] NVG: No existing data found, performing full refresh instead. [2025-10-02T20:37:43.892626] [INFO ] [MAIN ] NVG: Wiping existing primary data before full refresh. [2025-10-02T20:37:43.892709] [INFO ] [LOCAL ] NVG: Starting deletion of primary data. [2025-10-02T20:37:43.892764] [DEBUG] [LOCAL ] NVG: No primary data file found to delete. [2025-10-02T20:37:43.892833] [INFO ] [MAIN ] NVG: Starting full primary refresh. [2025-10-02T20:37:44.280161] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-03. [2025-10-02T20:37:44.285169] [INFO ] [REMOTE ] NVG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:37:44.388133] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-02T20:37:45.073033] [INFO ] [REMOTE ] NVG: Fetching primary data for 2024-12. [2025-10-02T20:37:45.872999] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-01. [2025-10-02T20:37:46.140066] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-02T20:37:46.587772] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-02T20:37:46.673041] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-04. [2025-10-02T20:37:46.804585] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-02T20:37:47.473003] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-10. [2025-10-02T20:37:48.273018] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-01. [2025-10-02T20:37:48.471619] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-02T20:37:48.577285] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-02T20:37:48.578835] [INFO ] [REMOTE ] NUV: Full fetch complete (34404 records). [2025-10-02T20:37:48.578914] [DEBUG] [VALIDATOR ] NUV: Validating primary data. [2025-10-02T20:37:48.983470] [DEBUG] [VALIDATOR ] NUV: All expected trading days are present. [2025-10-02T20:37:48.983612] [DEBUG] [VALIDATOR ] NUV: Primary data validation passed. [2025-10-02T20:37:48.984604] [INFO ] [MAIN ] NUV: Fetched primary data is valid. [2025-10-02T20:37:48.984695] [DEBUG] [LOCAL ] NUV: Saving primary data. [2025-10-02T20:37:48.985937] [DEBUG] [LOCAL ] NUV: Trimmed 34404 records to 23717 (keeping 200 days of data) [2025-10-02T20:37:49.083909] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-05. [2025-10-02T20:37:49.149629] [DEBUG] [LOCAL ] NUV: Primary data saved (23717 records). [2025-10-02T20:37:49.149807] [INFO ] [MAIN ] NUV: Full history saved. [2025-10-02T20:37:49.149886] [INFO ] [MAIN ] Update Progress: 1545/2370 symbols completed. NUV took 33.2s. Estimated remaining: 1h 56m 17s. Rate: 7.1 symbols/min [2025-10-02T20:37:49.361951] [INFO ] [MAIN ] NVGS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:37:49.362106] [DEBUG] [LOCAL ] NVGS: No existing data file found in primary storage. [2025-10-02T20:37:49.362145] [WARN ] [MAIN ] NVGS: No existing data found, performing full refresh instead. [2025-10-02T20:37:49.362257] [INFO ] [MAIN ] NVGS: Wiping existing primary data before full refresh. [2025-10-02T20:37:49.362300] [INFO ] [LOCAL ] NVGS: Starting deletion of primary data. [2025-10-02T20:37:49.362344] [DEBUG] [LOCAL ] NVGS: No primary data file found to delete. [2025-10-02T20:37:49.362377] [INFO ] [MAIN ] NVGS: Starting full primary refresh. [2025-10-02T20:37:49.726514] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-02T20:37:49.777158] [INFO ] [REMOTE ] NVGS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:37:49.873016] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-02. [2025-10-02T20:37:50.673022] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2024-12. [2025-10-02T20:37:50.974973] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-02T20:37:51.102198] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-02T20:37:51.473026] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-02. [2025-10-02T20:37:51.578977] [DEBUG] [REMOTE ] NUW: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-10-02T20:37:51.579305] [WARN ] [REMOTE ] NUW: No data returned for month 2025-02 [2025-10-02T20:37:51.579393] [FATAL] [REMOTE ] NUW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T20:37:51.579481] [FATAL] [MAIN ] NUW: Failed to fetch primary data. [2025-10-02T20:37:51.579544] [WARN ] [MAIN ] NUW: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T20:37:51.579618] [INFO ] [LOCAL ] NUW: Starting deletion of primary data. [2025-10-02T20:37:51.579716] [DEBUG] [LOCAL ] NUW: No primary data file found to delete. [2025-10-02T20:37:51.579763] [INFO ] [LOCAL ] NUW: Starting deletion of derivative data. [2025-10-02T20:37:51.579805] [DEBUG] [LOCAL ] NUW: No derivative data file found to delete. [2025-10-02T20:37:51.579852] [INFO ] [MAIN ] Update Progress: 1546/2370 symbols completed. NUW took 10.3s. Estimated remaining: 1h 56m 5s. Rate: 7.1 symbols/min [2025-10-02T20:37:51.770142] [INFO ] [MAIN ] NVO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:37:51.770362] [DEBUG] [LOCAL ] NVO: No existing data file found in primary storage. [2025-10-02T20:37:51.770410] [WARN ] [MAIN ] NVO: No existing data found, performing full refresh instead. [2025-10-02T20:37:51.770520] [INFO ] [MAIN ] NVO: Wiping existing primary data before full refresh. [2025-10-02T20:37:51.770564] [INFO ] [LOCAL ] NVO: Starting deletion of primary data. [2025-10-02T20:37:51.770607] [DEBUG] [LOCAL ] NVO: No primary data file found to delete. [2025-10-02T20:37:51.770668] [INFO ] [MAIN ] NVO: Starting full primary refresh. [2025-10-02T20:37:52.110843] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-02T20:37:52.184891] [INFO ] [REMOTE ] NVO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:37:52.273000] [INFO ] [REMOTE ] NVO: Fetching primary data for 2024-12. [2025-10-02T20:37:53.073008] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-01. [2025-10-02T20:37:53.873008] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-03. [2025-10-02T20:37:54.472172] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-02T20:37:54.672985] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-06. [2025-10-02T20:37:55.061196] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2024-12 (2.79 seconds). [2025-10-02T20:37:55.325607] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-02T20:37:55.473004] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-01. [2025-10-02T20:37:56.272986] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-04. [2025-10-02T20:37:56.454305] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-02T20:37:57.073036] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-07. [2025-10-02T20:37:57.713953] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-02T20:37:57.843760] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-01 (2.37 seconds). [2025-10-02T20:37:57.872959] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-02. [2025-10-02T20:37:58.673016] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-05. [2025-10-02T20:37:59.121060] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-02T20:37:59.473012] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-02. [2025-10-02T20:38:00.016743] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-02T20:38:00.272971] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-06. [2025-10-02T20:38:00.467182] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-02 (2.59 seconds). [2025-10-02T20:38:01.072989] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-08. [2025-10-02T20:38:01.162171] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-02T20:38:01.716638] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-02T20:38:01.873025] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-03. [2025-10-02T20:38:02.577849] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-02T20:38:02.672998] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-09. [2025-10-02T20:38:03.473043] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-03. [2025-10-02T20:38:04.273048] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-07. [2025-10-02T20:38:04.986292] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-03 (3.11 seconds). [2025-10-02T20:38:05.033146] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-10-02T20:38:05.069047] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-02T20:38:05.075975] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-10. [2025-10-02T20:38:05.605043] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-02T20:38:05.873011] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-04. [2025-10-02T20:38:06.673015] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-04. [2025-10-02T20:38:06.939244] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-02T20:38:06.941327] [INFO ] [REMOTE ] NUVB: Full fetch complete (72805 records). [2025-10-02T20:38:06.941433] [DEBUG] [VALIDATOR ] NUVB: Validating primary data. [2025-10-02T20:38:07.390270] [DEBUG] [VALIDATOR ] NUVB: All expected trading days are present. [2025-10-02T20:38:07.390402] [DEBUG] [VALIDATOR ] NUVB: Primary data validation passed. [2025-10-02T20:38:07.391617] [INFO ] [MAIN ] NUVB: Fetched primary data is valid. [2025-10-02T20:38:07.391718] [DEBUG] [LOCAL ] NUVB: Saving primary data. [2025-10-02T20:38:07.393747] [DEBUG] [LOCAL ] NUVB: Trimmed 72805 records to 51636 (keeping 200 days of data) [2025-10-02T20:38:07.477450] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-08. [2025-10-02T20:38:07.716127] [DEBUG] [LOCAL ] NUVB: Primary data saved (51636 records). [2025-10-02T20:38:07.716276] [INFO ] [MAIN ] NUVB: Full history saved. [2025-10-02T20:38:07.716391] [INFO ] [MAIN ] Update Progress: 1547/2370 symbols completed. NUVB took 40.0s. Estimated remaining: 1h 56m 1s. Rate: 7.1 symbols/min [2025-10-02T20:38:07.913356] [INFO ] [MAIN ] NVR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:38:07.913753] [DEBUG] [LOCAL ] NVR: No existing data file found in primary storage. [2025-10-02T20:38:07.913930] [WARN ] [MAIN ] NVR: No existing data found, performing full refresh instead. [2025-10-02T20:38:07.914133] [INFO ] [MAIN ] NVR: Wiping existing primary data before full refresh. [2025-10-02T20:38:07.914235] [INFO ] [LOCAL ] NVR: Starting deletion of primary data. [2025-10-02T20:38:07.914402] [DEBUG] [LOCAL ] NVR: No primary data file found to delete. [2025-10-02T20:38:07.914467] [INFO ] [MAIN ] NVR: Starting full primary refresh. [2025-10-02T20:38:08.209402] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-02T20:38:08.274540] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-05. [2025-10-02T20:38:08.365411] [INFO ] [REMOTE ] NVR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:38:08.639803] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-04 (2.77 seconds). [2025-10-02T20:38:08.887636] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-02T20:38:09.072990] [INFO ] [REMOTE ] NVR: Fetching primary data for 2024-12. [2025-10-02T20:38:09.729379] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-02T20:38:09.873012] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-05. [2025-10-02T20:38:10.311900] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-02T20:38:10.673009] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-01. [2025-10-02T20:38:11.472997] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-06. [2025-10-02T20:38:11.936897] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-02T20:38:12.272980] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-02. [2025-10-02T20:38:12.705001] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-05 (2.83 seconds). [2025-10-02T20:38:12.882011] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-02T20:38:13.072968] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-06. [2025-10-02T20:38:13.456069] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-02T20:38:13.872990] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-03. [2025-10-02T20:38:14.673001] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-09. [2025-10-02T20:38:15.230689] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-02T20:38:15.473010] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-07. [2025-10-02T20:38:15.645513] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-06 (2.57 seconds). [2025-10-02T20:38:16.124560] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-02T20:38:16.273021] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-04. [2025-10-02T20:38:17.073009] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-07. [2025-10-02T20:38:17.140397] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-02T20:38:17.205937] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-02T20:38:17.873029] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-05. [2025-10-02T20:38:18.673072] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-08. [2025-10-02T20:38:18.815168] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-02T20:38:19.472998] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-06. [2025-10-02T20:38:19.760322] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-07 (2.69 seconds). [2025-10-02T20:38:20.098156] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-02T20:38:20.273018] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-09. [2025-10-02T20:38:20.661021] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-02T20:38:21.072992] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-08. [2025-10-02T20:38:21.501769] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-02T20:38:21.872991] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-10. [2025-10-02T20:38:22.673037] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-07. [2025-10-02T20:38:22.721885] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-02T20:38:22.723310] [INFO ] [REMOTE ] NVGS: Full fetch complete (41485 records). [2025-10-02T20:38:22.723416] [DEBUG] [VALIDATOR ] NVGS: Validating primary data. [2025-10-02T20:38:23.139260] [DEBUG] [VALIDATOR ] NVGS: All expected trading days are present. [2025-10-02T20:38:23.139340] [DEBUG] [VALIDATOR ] NVGS: Primary data validation passed. [2025-10-02T20:38:23.140157] [INFO ] [MAIN ] NVGS: Fetched primary data is valid. [2025-10-02T20:38:23.140222] [DEBUG] [LOCAL ] NVGS: Saving primary data. [2025-10-02T20:38:23.141169] [DEBUG] [LOCAL ] NVGS: Trimmed 41485 records to 30804 (keeping 200 days of data) [2025-10-02T20:38:23.337391] [DEBUG] [LOCAL ] NVGS: Primary data saved (30804 records). [2025-10-02T20:38:23.337529] [INFO ] [MAIN ] NVGS: Full history saved. [2025-10-02T20:38:23.337628] [INFO ] [MAIN ] Update Progress: 1548/2370 symbols completed. NVGS took 34.2s. Estimated remaining: 1h 55m 56s. Rate: 7.1 symbols/min [2025-10-02T20:38:23.478140] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-10. [2025-10-02T20:38:23.529237] [INFO ] [MAIN ] NVRI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:38:23.529437] [DEBUG] [LOCAL ] NVRI: No existing data file found in primary storage. [2025-10-02T20:38:23.529585] [WARN ] [MAIN ] NVRI: No existing data found, performing full refresh instead. [2025-10-02T20:38:23.529695] [INFO ] [MAIN ] NVRI: Wiping existing primary data before full refresh. [2025-10-02T20:38:23.529749] [INFO ] [LOCAL ] NVRI: Starting deletion of primary data. [2025-10-02T20:38:23.529794] [DEBUG] [LOCAL ] NVRI: No primary data file found to delete. [2025-10-02T20:38:23.529828] [INFO ] [MAIN ] NVRI: Starting full primary refresh. [2025-10-02T20:38:23.983304] [INFO ] [REMOTE ] NVRI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:38:23.997373] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-02T20:38:24.051032] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-08 (2.98 seconds). [2025-10-02T20:38:24.273044] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-09. [2025-10-02T20:38:24.516326] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-02T20:38:24.517728] [INFO ] [REMOTE ] NVG: Full fetch complete (40701 records). [2025-10-02T20:38:24.517811] [DEBUG] [VALIDATOR ] NVG: Validating primary data. [2025-10-02T20:38:24.912934] [DEBUG] [VALIDATOR ] NVG: All expected trading days are present. [2025-10-02T20:38:24.913041] [DEBUG] [VALIDATOR ] NVG: Primary data validation passed. [2025-10-02T20:38:24.913761] [INFO ] [MAIN ] NVG: Fetched primary data is valid. [2025-10-02T20:38:24.913824] [DEBUG] [LOCAL ] NVG: Saving primary data. [2025-10-02T20:38:24.914847] [DEBUG] [LOCAL ] NVG: Trimmed 40701 records to 27690 (keeping 200 days of data) [2025-10-02T20:38:25.075810] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-08. [2025-10-02T20:38:25.092050] [DEBUG] [LOCAL ] NVG: Primary data saved (27690 records). [2025-10-02T20:38:25.092155] [INFO ] [MAIN ] NVG: Full history saved. [2025-10-02T20:38:25.092227] [INFO ] [MAIN ] Update Progress: 1549/2370 symbols completed. NVG took 41.4s. Estimated remaining: 1h 55m 44s. Rate: 7.1 symbols/min [2025-10-02T20:38:25.274437] [INFO ] [MAIN ] NVS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:38:25.274626] [DEBUG] [LOCAL ] NVS: No existing data file found in primary storage. [2025-10-02T20:38:25.274702] [WARN ] [MAIN ] NVS: No existing data found, performing full refresh instead. [2025-10-02T20:38:25.274830] [INFO ] [MAIN ] NVS: Wiping existing primary data before full refresh. [2025-10-02T20:38:25.274876] [INFO ] [LOCAL ] NVS: Starting deletion of primary data. [2025-10-02T20:38:25.274921] [DEBUG] [LOCAL ] NVS: No primary data file found to delete. [2025-10-02T20:38:25.274956] [INFO ] [MAIN ] NVS: Starting full primary refresh. [2025-10-02T20:38:25.644421] [INFO ] [REMOTE ] NVS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:38:25.873046] [INFO ] [REMOTE ] NVS: Fetching primary data for 2024-12. [2025-10-02T20:38:26.138276] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-02T20:38:26.673022] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2024-12. [2025-10-02T20:38:27.071286] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-09 (2.80 seconds). [2025-10-02T20:38:27.403217] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-02T20:38:27.473002] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-10. [2025-10-02T20:38:28.228514] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-02T20:38:28.272959] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-01. [2025-10-02T20:38:29.073010] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-09. [2025-10-02T20:38:29.704913] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-10 (2.23 seconds). [2025-10-02T20:38:29.707371] [INFO ] [REMOTE ] NVO: Full fetch complete (77955 records). [2025-10-02T20:38:29.707559] [DEBUG] [VALIDATOR ] NVO: Validating primary data. [2025-10-02T20:38:29.873680] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-01. [2025-10-02T20:38:30.096837] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-02T20:38:30.194099] [DEBUG] [VALIDATOR ] NVO: All expected trading days are present. [2025-10-02T20:38:30.194255] [DEBUG] [VALIDATOR ] NVO: Primary data validation passed. [2025-10-02T20:38:30.195627] [INFO ] [MAIN ] NVO: Fetched primary data is valid. [2025-10-02T20:38:30.195803] [DEBUG] [LOCAL ] NVO: Saving primary data. [2025-10-02T20:38:30.197507] [DEBUG] [LOCAL ] NVO: Trimmed 77955 records to 54174 (keeping 200 days of data) [2025-10-02T20:38:30.307691] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-02T20:38:30.572901] [DEBUG] [LOCAL ] NVO: Primary data saved (54174 records). [2025-10-02T20:38:30.573047] [INFO ] [MAIN ] NVO: Full history saved. [2025-10-02T20:38:30.573126] [INFO ] [MAIN ] Update Progress: 1550/2370 symbols completed. NVO took 39.0s. Estimated remaining: 1h 55m 34s. Rate: 7.1 symbols/min [2025-10-02T20:38:30.681370] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-10. [2025-10-02T20:38:30.763144] [INFO ] [MAIN ] NVST: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:38:30.763312] [DEBUG] [LOCAL ] NVST: No existing data file found in primary storage. [2025-10-02T20:38:30.763352] [WARN ] [MAIN ] NVST: No existing data found, performing full refresh instead. [2025-10-02T20:38:30.763512] [INFO ] [MAIN ] NVST: Wiping existing primary data before full refresh. [2025-10-02T20:38:30.763564] [INFO ] [LOCAL ] NVST: Starting deletion of primary data. [2025-10-02T20:38:30.763607] [DEBUG] [LOCAL ] NVST: No primary data file found to delete. [2025-10-02T20:38:30.763661] [INFO ] [MAIN ] NVST: Starting full primary refresh. [2025-10-02T20:38:31.143116] [INFO ] [REMOTE ] NVST: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:38:31.472980] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-02. [2025-10-02T20:38:31.548671] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-02T20:38:31.549893] [INFO ] [REMOTE ] NVR: Full fetch complete (29452 records). [2025-10-02T20:38:31.549973] [DEBUG] [VALIDATOR ] NVR: Validating primary data. [2025-10-02T20:38:31.989292] [DEBUG] [VALIDATOR ] NVR: All expected trading days are present. [2025-10-02T20:38:31.989577] [DEBUG] [VALIDATOR ] NVR: Primary data validation passed. [2025-10-02T20:38:31.990361] [INFO ] [MAIN ] NVR: Fetched primary data is valid. [2025-10-02T20:38:31.990443] [DEBUG] [LOCAL ] NVR: Saving primary data. [2025-10-02T20:38:32.021265] [DEBUG] [LOCAL ] NVR: Trimmed 29452 records to 18746 (keeping 200 days of data) [2025-10-02T20:38:32.024404] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-02T20:38:32.157083] [DEBUG] [LOCAL ] NVR: Primary data saved (18746 records). [2025-10-02T20:38:32.157237] [INFO ] [MAIN ] NVR: Full history saved. [2025-10-02T20:38:32.157317] [INFO ] [MAIN ] Update Progress: 1551/2370 symbols completed. NVR took 24.4s. Estimated remaining: 1h 55m 22s. Rate: 7.1 symbols/min [2025-10-02T20:38:32.278152] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-02. [2025-10-02T20:38:32.344019] [INFO ] [MAIN ] NVT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:38:32.344184] [DEBUG] [LOCAL ] NVT: No existing data file found in primary storage. [2025-10-02T20:38:32.344224] [WARN ] [MAIN ] NVT: No existing data found, performing full refresh instead. [2025-10-02T20:38:32.344334] [INFO ] [MAIN ] NVT: Wiping existing primary data before full refresh. [2025-10-02T20:38:32.344416] [INFO ] [LOCAL ] NVT: Starting deletion of primary data. [2025-10-02T20:38:32.344469] [DEBUG] [LOCAL ] NVT: No primary data file found to delete. [2025-10-02T20:38:32.344502] [INFO ] [MAIN ] NVT: Starting full primary refresh. [2025-10-02T20:38:32.735576] [INFO ] [REMOTE ] NVT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:38:32.881035] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-02T20:38:33.073017] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-03. [2025-10-02T20:38:33.873014] [INFO ] [REMOTE ] NVST: Fetching primary data for 2024-12. [2025-10-02T20:38:34.247902] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-02T20:38:34.673039] [INFO ] [REMOTE ] NVT: Fetching primary data for 2024-12. [2025-10-02T20:38:34.743805] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-02T20:38:35.473022] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-03. [2025-10-02T20:38:36.273088] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-04. [2025-10-02T20:38:36.418283] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2024-12 (2.55 seconds). [2025-10-02T20:38:36.739634] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-02T20:38:37.046278] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-02T20:38:37.073017] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-01. [2025-10-02T20:38:37.440320] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-02T20:38:37.873050] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-04. [2025-10-02T20:38:38.673026] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-05. [2025-10-02T20:38:38.747367] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-02T20:38:39.473019] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-01. [2025-10-02T20:38:39.924032] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-02T20:38:40.214635] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-02T20:38:40.272970] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-06. [2025-10-02T20:38:41.072987] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-02. [2025-10-02T20:38:41.303813] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-02T20:38:41.823925] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-02T20:38:41.873029] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-05. [2025-10-02T20:38:42.509113] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-02T20:38:42.673001] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-07. [2025-10-02T20:38:43.472976] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-02. [2025-10-02T20:38:43.716065] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-02T20:38:43.871117] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-02T20:38:44.273008] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-06. [2025-10-02T20:38:44.855166] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-02T20:38:45.073002] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-08. [2025-10-02T20:38:45.872981] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-03. [2025-10-02T20:38:46.206224] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-02T20:38:46.673001] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-03. [2025-10-02T20:38:46.752426] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-02T20:38:47.478136] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-07. [2025-10-02T20:38:47.494542] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-02T20:38:48.252345] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-02T20:38:48.273009] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-09. [2025-10-02T20:38:49.073051] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-04. [2025-10-02T20:38:49.227119] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-02T20:38:49.788900] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-02T20:38:49.872976] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-10. [2025-10-02T20:38:50.642796] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-02T20:38:50.672979] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-05. [2025-10-02T20:38:51.195863] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-02T20:38:51.197725] [INFO ] [REMOTE ] NVRI: Full fetch complete (55831 records). [2025-10-02T20:38:51.197825] [DEBUG] [VALIDATOR ] NVRI: Validating primary data. [2025-10-02T20:38:51.478944] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-08. [2025-10-02T20:38:51.621221] [DEBUG] [VALIDATOR ] NVRI: All expected trading days are present. [2025-10-02T20:38:51.621305] [DEBUG] [VALIDATOR ] NVRI: Primary data validation passed. [2025-10-02T20:38:51.622373] [INFO ] [MAIN ] NVRI: Fetched primary data is valid. [2025-10-02T20:38:51.622450] [DEBUG] [LOCAL ] NVRI: Saving primary data. [2025-10-02T20:38:51.624040] [DEBUG] [LOCAL ] NVRI: Trimmed 55831 records to 39035 (keeping 200 days of data) [2025-10-02T20:38:51.861543] [DEBUG] [LOCAL ] NVRI: Primary data saved (39035 records). [2025-10-02T20:38:51.861714] [INFO ] [MAIN ] NVRI: Full history saved. [2025-10-02T20:38:51.861805] [INFO ] [MAIN ] Update Progress: 1552/2370 symbols completed. NVRI took 28.5s. Estimated remaining: 1h 55m 19s. Rate: 7.1 symbols/min [2025-10-02T20:38:52.055749] [INFO ] [MAIN ] NWG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:38:52.055959] [DEBUG] [LOCAL ] NWG: No existing data file found in primary storage. [2025-10-02T20:38:52.056032] [WARN ] [MAIN ] NWG: No existing data found, performing full refresh instead. [2025-10-02T20:38:52.056211] [INFO ] [MAIN ] NWG: Wiping existing primary data before full refresh. [2025-10-02T20:38:52.056281] [INFO ] [LOCAL ] NWG: Starting deletion of primary data. [2025-10-02T20:38:52.056405] [DEBUG] [LOCAL ] NWG: No primary data file found to delete. [2025-10-02T20:38:52.056466] [INFO ] [MAIN ] NWG: Starting full primary refresh. [2025-10-02T20:38:52.282747] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-04. [2025-10-02T20:38:52.408605] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-02T20:38:52.483893] [INFO ] [REMOTE ] NWG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:38:53.072973] [INFO ] [REMOTE ] NWG: Fetching primary data for 2024-12. [2025-10-02T20:38:53.444130] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-02T20:38:53.873057] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-06. [2025-10-02T20:38:54.230570] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-02T20:38:54.673069] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-05. [2025-10-02T20:38:54.819373] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-02T20:38:55.473020] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-01. [2025-10-02T20:38:55.614230] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-02T20:38:56.272980] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-07. [2025-10-02T20:38:56.495979] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-02T20:38:57.073066] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-06. [2025-10-02T20:38:57.304433] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-02T20:38:57.873002] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-02. [2025-10-02T20:38:58.109738] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-02T20:38:58.672976] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-08. [2025-10-02T20:38:58.875481] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-02T20:38:59.309363] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-02T20:38:59.473053] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-03. [2025-10-02T20:39:00.272992] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-09. [2025-10-02T20:39:00.525882] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-02T20:39:01.072973] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-09. [2025-10-02T20:39:01.475496] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-02T20:39:01.873010] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-04. [2025-10-02T20:39:02.251374] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-02T20:39:02.624173] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-02T20:39:02.672995] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-10. [2025-10-02T20:39:03.473010] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-07. [2025-10-02T20:39:03.771301] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-02T20:39:04.059599] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-02T20:39:04.061815] [INFO ] [REMOTE ] NVS: Full fetch complete (74818 records). [2025-10-02T20:39:04.061959] [DEBUG] [VALIDATOR ] NVS: Validating primary data. [2025-10-02T20:39:04.278127] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-05. [2025-10-02T20:39:04.497357] [DEBUG] [VALIDATOR ] NVS: All expected trading days are present. [2025-10-02T20:39:04.497446] [DEBUG] [VALIDATOR ] NVS: Primary data validation passed. [2025-10-02T20:39:04.498573] [INFO ] [MAIN ] NVS: Fetched primary data is valid. [2025-10-02T20:39:04.498665] [DEBUG] [LOCAL ] NVS: Saving primary data. [2025-10-02T20:39:04.500324] [DEBUG] [LOCAL ] NVS: Trimmed 74818 records to 51944 (keeping 200 days of data) [2025-10-02T20:39:04.846508] [DEBUG] [LOCAL ] NVS: Primary data saved (51944 records). [2025-10-02T20:39:04.846682] [INFO ] [MAIN ] NVS: Full history saved. [2025-10-02T20:39:04.846782] [INFO ] [MAIN ] Update Progress: 1553/2370 symbols completed. NVS took 39.8s. Estimated remaining: 1h 55m 13s. Rate: 7.1 symbols/min [2025-10-02T20:39:05.036097] [INFO ] [MAIN ] NWN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:39:05.036262] [DEBUG] [LOCAL ] NWN: No existing data file found in primary storage. [2025-10-02T20:39:05.036302] [WARN ] [MAIN ] NWN: No existing data found, performing full refresh instead. [2025-10-02T20:39:05.036415] [INFO ] [MAIN ] NWN: Wiping existing primary data before full refresh. [2025-10-02T20:39:05.036468] [INFO ] [LOCAL ] NWN: Starting deletion of primary data. [2025-10-02T20:39:05.036543] [DEBUG] [LOCAL ] NWN: No primary data file found to delete. [2025-10-02T20:39:05.036582] [INFO ] [MAIN ] NWN: Starting full primary refresh. [2025-10-02T20:39:05.086742] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-10. [2025-10-02T20:39:05.496321] [INFO ] [REMOTE ] NWN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:39:05.498861] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-02T20:39:05.873009] [INFO ] [REMOTE ] NWN: Fetching primary data for 2024-12. [2025-10-02T20:39:06.344139] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-02T20:39:06.419127] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-02T20:39:06.421227] [INFO ] [REMOTE ] NVT: Full fetch complete (74553 records). [2025-10-02T20:39:06.421341] [DEBUG] [VALIDATOR ] NVT: Validating primary data. [2025-10-02T20:39:06.678587] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-06. [2025-10-02T20:39:06.870230] [DEBUG] [VALIDATOR ] NVT: All expected trading days are present. [2025-10-02T20:39:06.870324] [DEBUG] [VALIDATOR ] NVT: Primary data validation passed. [2025-10-02T20:39:06.871460] [INFO ] [MAIN ] NVT: Fetched primary data is valid. [2025-10-02T20:39:06.871544] [DEBUG] [LOCAL ] NVT: Saving primary data. [2025-10-02T20:39:06.873201] [DEBUG] [LOCAL ] NVT: Trimmed 74553 records to 51890 (keeping 200 days of data) [2025-10-02T20:39:07.220584] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-02T20:39:07.241225] [DEBUG] [LOCAL ] NVT: Primary data saved (51890 records). [2025-10-02T20:39:07.241348] [INFO ] [MAIN ] NVT: Full history saved. [2025-10-02T20:39:07.241421] [INFO ] [MAIN ] Update Progress: 1554/2370 symbols completed. NVT took 35.1s. Estimated remaining: 1h 55m 2s. Rate: 7.1 symbols/min [2025-10-02T20:39:07.419973] [INFO ] [MAIN ] NX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:39:07.420143] [DEBUG] [LOCAL ] NX: No existing data file found in primary storage. [2025-10-02T20:39:07.420204] [WARN ] [MAIN ] NX: No existing data found, performing full refresh instead. [2025-10-02T20:39:07.420323] [INFO ] [MAIN ] NX: Wiping existing primary data before full refresh. [2025-10-02T20:39:07.420367] [INFO ] [LOCAL ] NX: Starting deletion of primary data. [2025-10-02T20:39:07.420414] [DEBUG] [LOCAL ] NX: No primary data file found to delete. [2025-10-02T20:39:07.420449] [INFO ] [MAIN ] NX: Starting full primary refresh. [2025-10-02T20:39:07.479967] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-01. [2025-10-02T20:39:07.816558] [INFO ] [REMOTE ] NX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:39:08.273065] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-08. [2025-10-02T20:39:08.674169] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-02T20:39:08.824190] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-02T20:39:09.073017] [INFO ] [REMOTE ] NX: Fetching primary data for 2024-12. [2025-10-02T20:39:09.640875] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-02T20:39:09.873010] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-02. [2025-10-02T20:39:10.520145] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-02T20:39:10.672994] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-09. [2025-10-02T20:39:11.120117] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-02T20:39:11.473020] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-01. [2025-10-02T20:39:12.272961] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-03. [2025-10-02T20:39:12.488827] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-02T20:39:12.491307] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-02T20:39:13.072998] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-10. [2025-10-02T20:39:13.304937] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-02T20:39:13.872990] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-07. [2025-10-02T20:39:14.476610] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-02T20:39:14.478779] [INFO ] [REMOTE ] NVST: Full fetch complete (74084 records). [2025-10-02T20:39:14.478952] [DEBUG] [VALIDATOR ] NVST: Validating primary data. [2025-10-02T20:39:14.675786] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-04. [2025-10-02T20:39:14.900618] [DEBUG] [VALIDATOR ] NVST: All expected trading days are present. [2025-10-02T20:39:14.900751] [DEBUG] [VALIDATOR ] NVST: Primary data validation passed. [2025-10-02T20:39:14.901925] [INFO ] [MAIN ] NVST: Fetched primary data is valid. [2025-10-02T20:39:14.901998] [DEBUG] [LOCAL ] NVST: Saving primary data. [2025-10-02T20:39:14.903585] [DEBUG] [LOCAL ] NVST: Trimmed 74084 records to 51965 (keeping 200 days of data) [2025-10-02T20:39:15.223306] [DEBUG] [LOCAL ] NVST: Primary data saved (51965 records). [2025-10-02T20:39:15.223469] [INFO ] [MAIN ] NVST: Full history saved. [2025-10-02T20:39:15.223569] [INFO ] [MAIN ] Update Progress: 1555/2370 symbols completed. NVST took 44.7s. Estimated remaining: 1h 54m 53s. Rate: 7.1 symbols/min [2025-10-02T20:39:15.412733] [INFO ] [MAIN ] NXC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:39:15.412994] [DEBUG] [LOCAL ] NXC: No existing data file found in primary storage. [2025-10-02T20:39:15.413091] [WARN ] [MAIN ] NXC: No existing data found, performing full refresh instead. [2025-10-02T20:39:15.413272] [INFO ] [MAIN ] NXC: Wiping existing primary data before full refresh. [2025-10-02T20:39:15.413341] [INFO ] [LOCAL ] NXC: Starting deletion of primary data. [2025-10-02T20:39:15.413634] [DEBUG] [LOCAL ] NXC: No primary data file found to delete. [2025-10-02T20:39:15.413723] [INFO ] [MAIN ] NXC: Starting full primary refresh. [2025-10-02T20:39:15.480147] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-02. [2025-10-02T20:39:15.816158] [INFO ] [REMOTE ] NXC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:39:15.837854] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-02T20:39:16.169856] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-02T20:39:16.272996] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-08. [2025-10-02T20:39:16.952267] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-02T20:39:17.072993] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-05. [2025-10-02T20:39:17.872987] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-03. [2025-10-02T20:39:18.207672] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-02T20:39:18.518342] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-02T20:39:18.672993] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-09. [2025-10-02T20:39:19.376970] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-02T20:39:19.473001] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-06. [2025-10-02T20:39:20.129447] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-02T20:39:20.272999] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-10. [2025-10-02T20:39:20.818752] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-02T20:39:21.072953] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-04. [2025-10-02T20:39:21.787690] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-02T20:39:21.792293] [INFO ] [REMOTE ] NWG: Full fetch complete (73380 records). [2025-10-02T20:39:21.792418] [DEBUG] [VALIDATOR ] NWG: Validating primary data. [2025-10-02T20:39:21.878132] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-07. [2025-10-02T20:39:22.229186] [DEBUG] [VALIDATOR ] NWG: All expected trading days are present. [2025-10-02T20:39:22.229301] [DEBUG] [VALIDATOR ] NWG: Primary data validation passed. [2025-10-02T20:39:22.230470] [INFO ] [MAIN ] NWG: Fetched primary data is valid. [2025-10-02T20:39:22.230679] [DEBUG] [LOCAL ] NWG: Saving primary data. [2025-10-02T20:39:22.232332] [DEBUG] [LOCAL ] NWG: Trimmed 73380 records to 51874 (keeping 200 days of data) [2025-10-02T20:39:22.477900] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-02T20:39:22.596807] [DEBUG] [LOCAL ] NWG: Primary data saved (51874 records). [2025-10-02T20:39:22.596974] [INFO ] [MAIN ] NWG: Full history saved. [2025-10-02T20:39:22.597048] [INFO ] [MAIN ] Update Progress: 1556/2370 symbols completed. NWG took 30.7s. Estimated remaining: 1h 54m 44s. Rate: 7.1 symbols/min [2025-10-02T20:39:22.678096] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-05. [2025-10-02T20:39:22.778278] [INFO ] [MAIN ] NXDR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:39:22.778450] [DEBUG] [LOCAL ] NXDR: No existing data file found in primary storage. [2025-10-02T20:39:22.778490] [WARN ] [MAIN ] NXDR: No existing data found, performing full refresh instead. [2025-10-02T20:39:22.778600] [INFO ] [MAIN ] NXDR: Wiping existing primary data before full refresh. [2025-10-02T20:39:22.778665] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-10-02T20:39:22.778736] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-10-02T20:39:22.778774] [INFO ] [MAIN ] NXDR: Starting full primary refresh. [2025-10-02T20:39:23.193211] [INFO ] [REMOTE ] NXDR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:39:23.310896] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-02T20:39:23.473016] [INFO ] [REMOTE ] NXC: Fetching primary data for 2024-12. [2025-10-02T20:39:24.137033] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-02T20:39:24.273013] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-08. [2025-10-02T20:39:24.293051] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-02T20:39:25.072980] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2024-12. [2025-10-02T20:39:25.224519] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-02T20:39:25.373994] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T20:39:25.374319] [WARN ] [REMOTE ] NXDR: No data returned for month 2024-12 [2025-10-02T20:39:25.374414] [FATAL] [REMOTE ] NXDR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T20:39:25.374461] [FATAL] [MAIN ] NXDR: Failed to fetch primary data. [2025-10-02T20:39:25.374522] [WARN ] [MAIN ] NXDR: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T20:39:25.374596] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-10-02T20:39:25.374752] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-10-02T20:39:25.374796] [INFO ] [LOCAL ] NXDR: Starting deletion of derivative data. [2025-10-02T20:39:25.374854] [DEBUG] [LOCAL ] NXDR: No derivative data file found to delete. [2025-10-02T20:39:25.374924] [INFO ] [MAIN ] Update Progress: 1557/2370 symbols completed. NXDR took 2.8s. Estimated remaining: 1h 54m 32s. Rate: 7.1 symbols/min [2025-10-02T20:39:25.872994] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-09. [2025-10-02T20:39:26.673062] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-06. [2025-10-02T20:39:27.088048] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-02T20:39:27.473036] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-10. [2025-10-02T20:39:28.158035] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-02T20:39:28.228846] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-02T20:39:28.230123] [INFO ] [REMOTE ] NWN: Full fetch complete (37290 records). [2025-10-02T20:39:28.230201] [DEBUG] [VALIDATOR ] NWN: Validating primary data. [2025-10-02T20:39:28.278127] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-07. [2025-10-02T20:39:28.650228] [DEBUG] [VALIDATOR ] NWN: All expected trading days are present. [2025-10-02T20:39:28.650335] [DEBUG] [VALIDATOR ] NWN: Primary data validation passed. [2025-10-02T20:39:28.651166] [INFO ] [MAIN ] NWN: Fetched primary data is valid. [2025-10-02T20:39:28.651230] [DEBUG] [LOCAL ] NWN: Saving primary data. [2025-10-02T20:39:28.652380] [DEBUG] [LOCAL ] NWN: Trimmed 37290 records to 26885 (keeping 200 days of data) [2025-10-02T20:39:28.820395] [DEBUG] [LOCAL ] NWN: Primary data saved (26885 records). [2025-10-02T20:39:28.820532] [INFO ] [MAIN ] NWN: Full history saved. [2025-10-02T20:39:28.820609] [INFO ] [MAIN ] Update Progress: 1558/2370 symbols completed. NWN took 24.0s. Estimated remaining: 1h 54m 21s. Rate: 7.1 symbols/min [2025-10-02T20:39:29.073067] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-01. [2025-10-02T20:39:29.421903] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-02T20:39:29.652959] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-02T20:39:29.872999] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-02. [2025-10-02T20:39:30.540357] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-02T20:39:30.673014] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-08. [2025-10-02T20:39:31.473091] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-03. [2025-10-02T20:39:32.147631] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-02T20:39:32.148466] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-02T20:39:32.272993] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-04. [2025-10-02T20:39:33.027807] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-02T20:39:33.073000] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-09. [2025-10-02T20:39:33.873023] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-05. [2025-10-02T20:39:34.564499] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-02T20:39:34.672996] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-06. [2025-10-02T20:39:34.703476] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-02T20:39:35.128996] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-02T20:39:35.473050] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-07. [2025-10-02T20:39:36.125580] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-02T20:39:36.273014] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-10. [2025-10-02T20:39:37.073003] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-08. [2025-10-02T20:39:37.541688] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-02T20:39:37.543435] [INFO ] [REMOTE ] NX: Full fetch complete (48566 records). [2025-10-02T20:39:37.543548] [DEBUG] [VALIDATOR ] NX: Validating primary data. [2025-10-02T20:39:37.655080] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-02T20:39:37.878125] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-09. [2025-10-02T20:39:37.947132] [DEBUG] [VALIDATOR ] NX: All expected trading days are present. [2025-10-02T20:39:37.947220] [DEBUG] [VALIDATOR ] NX: Primary data validation passed. [2025-10-02T20:39:37.948115] [INFO ] [MAIN ] NX: Fetched primary data is valid. [2025-10-02T20:39:37.948212] [DEBUG] [LOCAL ] NX: Saving primary data. [2025-10-02T20:39:37.949458] [DEBUG] [LOCAL ] NX: Trimmed 48566 records to 33364 (keeping 200 days of data) [2025-10-02T20:39:38.170043] [DEBUG] [LOCAL ] NX: Primary data saved (33364 records). [2025-10-02T20:39:38.170220] [INFO ] [MAIN ] NX: Full history saved. [2025-10-02T20:39:38.170310] [INFO ] [MAIN ] Update Progress: 1559/2370 symbols completed. NX took 30.9s. Estimated remaining: 1h 54m 13s. Rate: 7.1 symbols/min [2025-10-02T20:39:38.586409] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-02T20:39:38.673000] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-10. [2025-10-02T20:39:39.105952] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-02T20:39:39.106867] [INFO ] [REMOTE ] NXC: Full fetch complete (5951 records). [2025-10-02T20:39:39.106980] [DEBUG] [VALIDATOR ] NXC: Validating primary data. [2025-10-02T20:39:39.534802] [DEBUG] [VALIDATOR ] NXC: All expected trading days are present. [2025-10-02T20:39:39.534898] [DEBUG] [VALIDATOR ] NXC: Primary data validation passed. [2025-10-02T20:39:39.535093] [INFO ] [MAIN ] NXC: Fetched primary data is valid. [2025-10-02T20:39:39.535140] [DEBUG] [LOCAL ] NXC: Saving primary data. [2025-10-02T20:39:39.535582] [DEBUG] [LOCAL ] NXC: Trimmed 5951 records to 4216 (keeping 200 days of data) [2025-10-02T20:39:39.564317] [DEBUG] [LOCAL ] NXC: Primary data saved (4216 records). [2025-10-02T20:39:39.564538] [INFO ] [MAIN ] NXC: Full history saved. [2025-10-02T20:39:39.564639] [INFO ] [MAIN ] Update Progress: 1560/2370 symbols completed. NXC took 24.3s. Estimated remaining: 1h 54m 1s. Rate: 7.1 symbols/min [2025-10-02T20:39:40.173846] [INFO ] [MAIN ] NXJ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:39:40.233478] [DEBUG] [LOCAL ] NXJ: No existing data file found in primary storage. [2025-10-02T20:39:40.249596] [WARN ] [MAIN ] NXJ: No existing data found, performing full refresh instead. [2025-10-02T20:39:40.325599] [INFO ] [MAIN ] NXDT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:39:40.341926] [INFO ] [MAIN ] NXJ: Wiping existing primary data before full refresh. [2025-10-02T20:39:40.373338] [DEBUG] [LOCAL ] NXDT: No existing data file found in primary storage. [2025-10-02T20:39:40.377620] [INFO ] [LOCAL ] NXJ: Starting deletion of primary data. [2025-10-02T20:39:40.377517] [INFO ] [MAIN ] NXE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:39:40.379620] [WARN ] [MAIN ] NXDT: No existing data found, performing full refresh instead. [2025-10-02T20:39:40.380133] [INFO ] [MAIN ] NXDT: Wiping existing primary data before full refresh. [2025-10-02T20:39:40.380210] [INFO ] [LOCAL ] NXDT: Starting deletion of primary data. [2025-10-02T20:39:40.380393] [DEBUG] [LOCAL ] NXE: No existing data file found in primary storage. [2025-10-02T20:39:40.380580] [WARN ] [MAIN ] NXE: No existing data found, performing full refresh instead. [2025-10-02T20:39:40.379993] [DEBUG] [LOCAL ] NXJ: No primary data file found to delete. [2025-10-02T20:39:40.380517] [DEBUG] [LOCAL ] NXDT: No primary data file found to delete. [2025-10-02T20:39:40.380772] [INFO ] [MAIN ] NXJ: Starting full primary refresh. [2025-10-02T20:39:40.400317] [INFO ] [MAIN ] NXE: Wiping existing primary data before full refresh. [2025-10-02T20:39:40.395065] [INFO ] [MAIN ] NXDT: Starting full primary refresh. [2025-10-02T20:39:40.379555] [INFO ] [MAIN ] NXG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:39:40.448551] [INFO ] [LOCAL ] NXE: Starting deletion of primary data. [2025-10-02T20:39:40.487364] [DEBUG] [LOCAL ] NXG: No existing data file found in primary storage. [2025-10-02T20:39:40.550371] [WARN ] [MAIN ] NXG: No existing data found, performing full refresh instead. [2025-10-02T20:39:40.550473] [DEBUG] [LOCAL ] NXE: No primary data file found to delete. [2025-10-02T20:39:40.576983] [INFO ] [MAIN ] NXG: Wiping existing primary data before full refresh. [2025-10-02T20:39:40.582366] [INFO ] [MAIN ] NXE: Starting full primary refresh. [2025-10-02T20:39:40.603514] [INFO ] [LOCAL ] NXG: Starting deletion of primary data. [2025-10-02T20:39:40.673257] [DEBUG] [LOCAL ] NXG: No primary data file found to delete. [2025-10-02T20:39:40.690447] [INFO ] [MAIN ] NXG: Starting full primary refresh. [2025-10-02T20:39:41.667693] [INFO ] [REMOTE ] NXJ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:39:41.736476] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2024-12. [2025-10-02T20:39:42.143863] [INFO ] [REMOTE ] NXDT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:39:42.156696] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2024-12. [2025-10-02T20:39:42.218090] [INFO ] [REMOTE ] NXE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:39:42.218634] [INFO ] [REMOTE ] NXE: Fetching primary data for 2024-12. [2025-10-02T20:39:42.335901] [INFO ] [REMOTE ] NXG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:39:42.336307] [INFO ] [REMOTE ] NXG: Fetching primary data for 2024-12. [2025-10-02T20:39:43.194102] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-02T20:39:43.198151] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-01. [2025-10-02T20:39:43.360294] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-02T20:39:43.473022] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-01. [2025-10-02T20:39:43.593272] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-02T20:39:44.154790] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-02T20:39:44.202438] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-02T20:39:44.224847] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-02T20:39:44.273008] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-02. [2025-10-02T20:39:45.072974] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-01. [2025-10-02T20:39:45.153866] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-02T20:39:45.873014] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-03. [2025-10-02T20:39:46.672992] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-01. [2025-10-02T20:39:46.707077] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-02T20:39:47.093170] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-02T20:39:47.473002] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-02. [2025-10-02T20:39:47.527103] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-02T20:39:48.273021] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-02. [2025-10-02T20:39:49.073005] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-02. [2025-10-02T20:39:49.389499] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-02T20:39:49.434171] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-02T20:39:49.873028] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-03. [2025-10-02T20:39:49.908407] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-02T20:39:50.673014] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-04. [2025-10-02T20:39:50.710222] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-02T20:39:51.472979] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-03. [2025-10-02T20:39:51.770021] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-02T20:39:52.272993] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-04. [2025-10-02T20:39:52.324806] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-02T20:39:53.073021] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-03. [2025-10-02T20:39:53.261463] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-02T20:39:53.873037] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-05. [2025-10-02T20:39:54.669632] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-02T20:39:54.673245] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-05. [2025-10-02T20:39:54.967553] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-02T20:39:55.473013] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-06. [2025-10-02T20:39:55.791909] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-02T20:39:56.273024] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-04. [2025-10-02T20:39:56.559727] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-02T20:39:56.857498] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-02T20:39:57.073006] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-05. [2025-10-02T20:39:57.865719] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-02T20:39:57.872950] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-06. [2025-10-02T20:39:58.670016] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-02T20:39:58.672952] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-07. [2025-10-02T20:39:59.473037] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-06. [2025-10-02T20:39:59.656261] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-02T20:40:00.273000] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-07. [2025-10-02T20:40:00.345610] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-02T20:40:01.072981] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-07. [2025-10-02T20:40:01.395366] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-02T20:40:01.873053] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-08. [2025-10-02T20:40:02.279284] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-02T20:40:02.672995] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-08. [2025-10-02T20:40:02.985912] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-02T20:40:03.443743] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-02T20:40:03.473046] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-08. [2025-10-02T20:40:04.273049] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-09. [2025-10-02T20:40:04.503098] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-02T20:40:05.072991] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-09. [2025-10-02T20:40:05.156852] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-02T20:40:05.873003] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-09. [2025-10-02T20:40:06.067742] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-02T20:40:06.672985] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-10. [2025-10-02T20:40:06.839980] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-02T20:40:07.382389] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-02T20:40:07.383526] [INFO ] [REMOTE ] NXDT: Full fetch complete (25507 records). [2025-10-02T20:40:07.383607] [DEBUG] [VALIDATOR ] NXDT: Validating primary data. [2025-10-02T20:40:07.478130] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-10. [2025-10-02T20:40:07.814173] [DEBUG] [VALIDATOR ] NXDT: All expected trading days are present. [2025-10-02T20:40:07.814281] [DEBUG] [VALIDATOR ] NXDT: Primary data validation passed. [2025-10-02T20:40:07.814862] [INFO ] [MAIN ] NXDT: Fetched primary data is valid. [2025-10-02T20:40:07.814926] [DEBUG] [LOCAL ] NXDT: Saving primary data. [2025-10-02T20:40:07.815549] [DEBUG] [LOCAL ] NXDT: Trimmed 25507 records to 16245 (keeping 200 days of data) [2025-10-02T20:40:07.914847] [DEBUG] [LOCAL ] NXDT: Primary data saved (16245 records). [2025-10-02T20:40:07.915105] [INFO ] [MAIN ] NXDT: Full history saved. [2025-10-02T20:40:07.915259] [INFO ] [MAIN ] Update Progress: 1561/2370 symbols completed. NXDT took 28.3s. Estimated remaining: 1h 54m 3s. Rate: 7.1 symbols/min [2025-10-02T20:40:08.119870] [INFO ] [MAIN ] NXN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:40:08.120056] [DEBUG] [LOCAL ] NXN: No existing data file found in primary storage. [2025-10-02T20:40:08.120127] [WARN ] [MAIN ] NXN: No existing data found, performing full refresh instead. [2025-10-02T20:40:08.120263] [INFO ] [MAIN ] NXN: Wiping existing primary data before full refresh. [2025-10-02T20:40:08.120308] [INFO ] [LOCAL ] NXN: Starting deletion of primary data. [2025-10-02T20:40:08.120358] [DEBUG] [LOCAL ] NXN: No primary data file found to delete. [2025-10-02T20:40:08.120436] [INFO ] [MAIN ] NXN: Starting full primary refresh. [2025-10-02T20:40:08.276733] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-04. [2025-10-02T20:40:08.286804] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-02T20:40:08.300382] [INFO ] [REMOTE ] NXJ: Full fetch complete (21035 records). [2025-10-02T20:40:08.318860] [DEBUG] [VALIDATOR ] NXJ: Validating primary data. [2025-10-02T20:40:08.738957] [INFO ] [REMOTE ] NXN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:40:08.950745] [DEBUG] [VALIDATOR ] NXJ: All expected trading days are present. [2025-10-02T20:40:08.950836] [DEBUG] [VALIDATOR ] NXJ: Primary data validation passed. [2025-10-02T20:40:08.951332] [INFO ] [MAIN ] NXJ: Fetched primary data is valid. [2025-10-02T20:40:08.951372] [DEBUG] [LOCAL ] NXJ: Saving primary data. [2025-10-02T20:40:08.952068] [DEBUG] [LOCAL ] NXJ: Trimmed 21035 records to 15045 (keeping 200 days of data) [2025-10-02T20:40:09.054281] [DEBUG] [LOCAL ] NXJ: Primary data saved (15045 records). [2025-10-02T20:40:09.054430] [INFO ] [MAIN ] NXJ: Full history saved. [2025-10-02T20:40:09.054509] [INFO ] [MAIN ] Update Progress: 1562/2370 symbols completed. NXJ took 29.5s. Estimated remaining: 1h 53m 51s. Rate: 7.1 symbols/min [2025-10-02T20:40:09.078132] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-10. [2025-10-02T20:40:09.240818] [INFO ] [MAIN ] NXP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:40:09.241044] [DEBUG] [LOCAL ] NXP: No existing data file found in primary storage. [2025-10-02T20:40:09.241102] [WARN ] [MAIN ] NXP: No existing data found, performing full refresh instead. [2025-10-02T20:40:09.241247] [INFO ] [MAIN ] NXP: Wiping existing primary data before full refresh. [2025-10-02T20:40:09.241320] [INFO ] [LOCAL ] NXP: Starting deletion of primary data. [2025-10-02T20:40:09.241377] [DEBUG] [LOCAL ] NXP: No primary data file found to delete. [2025-10-02T20:40:09.241414] [INFO ] [MAIN ] NXP: Starting full primary refresh. [2025-10-02T20:40:09.635935] [INFO ] [REMOTE ] NXP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:40:09.729346] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-02T20:40:09.730295] [INFO ] [REMOTE ] NXG: Full fetch complete (14440 records). [2025-10-02T20:40:09.730366] [DEBUG] [VALIDATOR ] NXG: Validating primary data. [2025-10-02T20:40:09.875035] [INFO ] [REMOTE ] NXN: Fetching primary data for 2024-12. [2025-10-02T20:40:10.123685] [DEBUG] [VALIDATOR ] NXG: All expected trading days are present. [2025-10-02T20:40:10.123830] [DEBUG] [VALIDATOR ] NXG: Primary data validation passed. [2025-10-02T20:40:10.124257] [INFO ] [MAIN ] NXG: Fetched primary data is valid. [2025-10-02T20:40:10.124322] [DEBUG] [LOCAL ] NXG: Saving primary data. [2025-10-02T20:40:10.124960] [DEBUG] [LOCAL ] NXG: Trimmed 14440 records to 10491 (keeping 200 days of data) [2025-10-02T20:40:10.197195] [DEBUG] [LOCAL ] NXG: Primary data saved (10491 records). [2025-10-02T20:40:10.197344] [INFO ] [MAIN ] NXG: Full history saved. [2025-10-02T20:40:10.197423] [INFO ] [MAIN ] Update Progress: 1563/2370 symbols completed. NXG took 30.6s. Estimated remaining: 1h 53m 39s. Rate: 7.1 symbols/min [2025-10-02T20:40:10.390097] [INFO ] [MAIN ] NXRT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:40:10.390486] [DEBUG] [LOCAL ] NXRT: No existing data file found in primary storage. [2025-10-02T20:40:10.390585] [WARN ] [MAIN ] NXRT: No existing data found, performing full refresh instead. [2025-10-02T20:40:10.390893] [INFO ] [MAIN ] NXRT: Wiping existing primary data before full refresh. [2025-10-02T20:40:10.390965] [INFO ] [LOCAL ] NXRT: Starting deletion of primary data. [2025-10-02T20:40:10.391141] [DEBUG] [LOCAL ] NXRT: No primary data file found to delete. [2025-10-02T20:40:10.391203] [INFO ] [MAIN ] NXRT: Starting full primary refresh. [2025-10-02T20:40:10.677989] [INFO ] [REMOTE ] NXP: Fetching primary data for 2024-12. [2025-10-02T20:40:10.704033] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-10-02T20:40:10.833581] [INFO ] [REMOTE ] NXRT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:40:10.904600] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-02T20:40:11.472998] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-01. [2025-10-02T20:40:11.913596] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-02T20:40:12.105460] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-02T20:40:12.273024] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-05. [2025-10-02T20:40:13.072998] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2024-12. [2025-10-02T20:40:13.872970] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-02. [2025-10-02T20:40:13.989934] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-02T20:40:14.279239] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-02T20:40:14.443098] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-02T20:40:14.672997] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-01. [2025-10-02T20:40:15.473013] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-01. [2025-10-02T20:40:15.707598] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-02T20:40:16.272990] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-02. [2025-10-02T20:40:16.292541] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-02T20:40:17.072981] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-03. [2025-10-02T20:40:17.455454] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-02T20:40:17.718149] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-02T20:40:17.873000] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-02. [2025-10-02T20:40:18.672980] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-06. [2025-10-02T20:40:18.827887] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-02T20:40:19.473040] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-03. [2025-10-02T20:40:20.172591] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-02T20:40:20.272967] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-03. [2025-10-02T20:40:20.629925] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-02T20:40:21.072967] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-04. [2025-10-02T20:40:21.386253] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-02T20:40:21.872989] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-04. [2025-10-02T20:40:21.904886] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-02T20:40:22.673011] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-05. [2025-10-02T20:40:23.009154] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-02T20:40:23.273659] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-02T20:40:23.472972] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-07. [2025-10-02T20:40:24.273014] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-06. [2025-10-02T20:40:25.073011] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-05. [2025-10-02T20:40:25.243328] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-02T20:40:25.616345] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-02T20:40:25.872973] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-07. [2025-10-02T20:40:26.167318] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-02T20:40:26.673029] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-04. [2025-10-02T20:40:26.936078] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-02T20:40:27.084689] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-02T20:40:27.472998] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-06. [2025-10-02T20:40:28.272974] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-08. [2025-10-02T20:40:28.624515] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-02T20:40:29.073042] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-07. [2025-10-02T20:40:29.185606] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-02T20:40:29.873068] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-08. [2025-10-02T20:40:30.213818] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-02T20:40:30.673003] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-08. [2025-10-02T20:40:31.472985] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-09. [2025-10-02T20:40:31.839751] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-02T20:40:31.907239] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-02T20:40:32.203714] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-02T20:40:32.273007] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-09. [2025-10-02T20:40:33.073025] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-09. [2025-10-02T20:40:33.872976] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-05. [2025-10-02T20:40:34.260117] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-02T20:40:34.457444] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-02T20:40:34.463480] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-02T20:40:34.673065] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-10. [2025-10-02T20:40:35.473022] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-10. [2025-10-02T20:40:35.569237] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-02T20:40:35.570360] [INFO ] [REMOTE ] NXRT: Full fetch complete (25476 records). [2025-10-02T20:40:35.570454] [DEBUG] [VALIDATOR ] NXRT: Validating primary data. [2025-10-02T20:40:35.969828] [DEBUG] [VALIDATOR ] NXRT: All expected trading days are present. [2025-10-02T20:40:35.969919] [DEBUG] [VALIDATOR ] NXRT: Primary data validation passed. [2025-10-02T20:40:35.970530] [INFO ] [MAIN ] NXRT: Fetched primary data is valid. [2025-10-02T20:40:35.970596] [DEBUG] [LOCAL ] NXRT: Saving primary data. [2025-10-02T20:40:35.971399] [DEBUG] [LOCAL ] NXRT: Trimmed 25476 records to 19068 (keeping 200 days of data) [2025-10-02T20:40:36.100686] [DEBUG] [LOCAL ] NXRT: Primary data saved (19068 records). [2025-10-02T20:40:36.100840] [INFO ] [MAIN ] NXRT: Full history saved. [2025-10-02T20:40:36.100918] [INFO ] [MAIN ] Update Progress: 1564/2370 symbols completed. NXRT took 25.9s. Estimated remaining: 1h 53m 39s. Rate: 7.1 symbols/min [2025-10-02T20:40:36.280022] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-06. [2025-10-02T20:40:36.285364] [INFO ] [MAIN ] NYC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:40:36.285552] [DEBUG] [LOCAL ] NYC: No existing data file found in primary storage. [2025-10-02T20:40:36.285678] [WARN ] [MAIN ] NYC: No existing data found, performing full refresh instead. [2025-10-02T20:40:36.285859] [INFO ] [MAIN ] NYC: Wiping existing primary data before full refresh. [2025-10-02T20:40:36.285961] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-10-02T20:40:36.286037] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-10-02T20:40:36.286093] [INFO ] [MAIN ] NYC: Starting full primary refresh. [2025-10-02T20:40:36.685203] [INFO ] [REMOTE ] NYC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:40:36.992616] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-02T20:40:37.073056] [INFO ] [REMOTE ] NYC: Fetching primary data for 2024-12. [2025-10-02T20:40:37.197391] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-02T20:40:37.199802] [INFO ] [REMOTE ] NXE: Full fetch complete (76690 records). [2025-10-02T20:40:37.199937] [DEBUG] [VALIDATOR ] NXE: Validating primary data. [2025-10-02T20:40:37.646636] [DEBUG] [VALIDATOR ] NXE: All expected trading days are present. [2025-10-02T20:40:37.646831] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-02T20:40:37.647050] [DEBUG] [VALIDATOR ] NXE: Primary data validation passed. [2025-10-02T20:40:37.649413] [INFO ] [MAIN ] NXE: Fetched primary data is valid. [2025-10-02T20:40:37.649483] [DEBUG] [LOCAL ] NXE: Saving primary data. [2025-10-02T20:40:37.651074] [DEBUG] [LOCAL ] NXE: Trimmed 76690 records to 53380 (keeping 200 days of data) [2025-10-02T20:40:37.873056] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-10. [2025-10-02T20:40:37.980246] [DEBUG] [LOCAL ] NXE: Primary data saved (53380 records). [2025-10-02T20:40:37.980409] [INFO ] [MAIN ] NXE: Full history saved. [2025-10-02T20:40:37.980518] [INFO ] [MAIN ] Update Progress: 1565/2370 symbols completed. NXE took 58.4s. Estimated remaining: 1h 53m 27s. Rate: 7.1 symbols/min [2025-10-02T20:40:38.167973] [INFO ] [MAIN ] NYT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:40:38.168212] [DEBUG] [LOCAL ] NYT: No existing data file found in primary storage. [2025-10-02T20:40:38.168275] [WARN ] [MAIN ] NYT: No existing data found, performing full refresh instead. [2025-10-02T20:40:38.168407] [INFO ] [MAIN ] NYT: Wiping existing primary data before full refresh. [2025-10-02T20:40:38.168455] [INFO ] [LOCAL ] NYT: Starting deletion of primary data. [2025-10-02T20:40:38.168504] [DEBUG] [LOCAL ] NYT: No primary data file found to delete. [2025-10-02T20:40:38.168550] [INFO ] [MAIN ] NYT: Starting full primary refresh. [2025-10-02T20:40:38.583239] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-02T20:40:38.608337] [INFO ] [REMOTE ] NYT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:40:38.608590] [INFO ] [REMOTE ] NXP: Full fetch complete (16891 records). [2025-10-02T20:40:38.608956] [DEBUG] [VALIDATOR ] NXP: Validating primary data. [2025-10-02T20:40:38.678277] [INFO ] [REMOTE ] NYT: Fetching primary data for 2024-12. [2025-10-02T20:40:39.162975] [DEBUG] [VALIDATOR ] NXP: All expected trading days are present. [2025-10-02T20:40:39.163066] [DEBUG] [VALIDATOR ] NXP: Primary data validation passed. [2025-10-02T20:40:39.163435] [INFO ] [MAIN ] NXP: Fetched primary data is valid. [2025-10-02T20:40:39.163476] [DEBUG] [LOCAL ] NXP: Saving primary data. [2025-10-02T20:40:39.164078] [DEBUG] [LOCAL ] NXP: Trimmed 16891 records to 12563 (keeping 200 days of data) [2025-10-02T20:40:39.246532] [DEBUG] [LOCAL ] NXP: Primary data saved (12563 records). [2025-10-02T20:40:39.246702] [INFO ] [MAIN ] NXP: Full history saved. [2025-10-02T20:40:39.246804] [INFO ] [MAIN ] Update Progress: 1566/2370 symbols completed. NXP took 30.2s. Estimated remaining: 1h 53m 15s. Rate: 7.1 symbols/min [2025-10-02T20:40:39.434703] [INFO ] [MAIN ] NZF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:40:39.434924] [DEBUG] [LOCAL ] NZF: No existing data file found in primary storage. [2025-10-02T20:40:39.434968] [WARN ] [MAIN ] NZF: No existing data found, performing full refresh instead. [2025-10-02T20:40:39.435086] [INFO ] [MAIN ] NZF: Wiping existing primary data before full refresh. [2025-10-02T20:40:39.435127] [INFO ] [LOCAL ] NZF: Starting deletion of primary data. [2025-10-02T20:40:39.435168] [DEBUG] [LOCAL ] NZF: No primary data file found to delete. [2025-10-02T20:40:39.435200] [INFO ] [MAIN ] NZF: Starting full primary refresh. [2025-10-02T20:40:39.479523] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-07. [2025-10-02T20:40:39.854720] [INFO ] [REMOTE ] NZF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:40:40.100507] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-02T20:40:40.273042] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-01. [2025-10-02T20:40:40.581182] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-02T20:40:40.792894] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-02T20:40:41.073038] [INFO ] [REMOTE ] NZF: Fetching primary data for 2024-12. [2025-10-02T20:40:41.873019] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-02. [2025-10-02T20:40:42.234043] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-02T20:40:42.673022] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-03. [2025-10-02T20:40:42.879819] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-02T20:40:43.240902] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-02T20:40:43.472996] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-04. [2025-10-02T20:40:44.030215] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-02T20:40:44.273011] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-08. [2025-10-02T20:40:44.698297] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-02T20:40:45.073021] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-05. [2025-10-02T20:40:45.526927] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-02T20:40:45.873030] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-06. [2025-10-02T20:40:46.398629] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-02T20:40:46.673045] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-01. [2025-10-02T20:40:47.473043] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-09. [2025-10-02T20:40:47.982224] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-02T20:40:48.273021] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-07. [2025-10-02T20:40:48.329394] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-02T20:40:48.611047] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-02T20:40:49.073056] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-08. [2025-10-02T20:40:49.528680] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-02T20:40:49.872996] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-09. [2025-10-02T20:40:50.431330] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-02T20:40:50.672995] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-10. [2025-10-02T20:40:51.057124] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-02T20:40:51.057858] [INFO ] [REMOTE ] NYC: Full fetch complete (1902 records). [2025-10-02T20:40:51.058021] [DEBUG] [VALIDATOR ] NYC: Validating primary data. [2025-10-02T20:40:51.250607] [WARN ] [VALIDATOR ] NYC: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-02T20:40:51.250846] [FATAL] [MAIN ] NYC: Fetched primary data is invalid. Refusing to save it. [2025-10-02T20:40:51.250919] [WARN ] [MAIN ] NYC: Deleting existing primary and derivative data due to validation failure. [2025-10-02T20:40:51.250995] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-10-02T20:40:51.251064] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-10-02T20:40:51.251101] [INFO ] [LOCAL ] NYC: Starting deletion of derivative data. [2025-10-02T20:40:51.251177] [DEBUG] [LOCAL ] NYC: No derivative data file found to delete. [2025-10-02T20:40:51.251258] [INFO ] [MAIN ] Update Progress: 1567/2370 symbols completed. NYC took 15.2s. Estimated remaining: 1h 53m 9s. Rate: 7.1 symbols/min [2025-10-02T20:40:51.433401] [INFO ] [MAIN ] O: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:40:51.433568] [DEBUG] [LOCAL ] O: No existing data file found in primary storage. [2025-10-02T20:40:51.433607] [WARN ] [MAIN ] O: No existing data found, performing full refresh instead. [2025-10-02T20:40:51.433744] [INFO ] [MAIN ] O: Wiping existing primary data before full refresh. [2025-10-02T20:40:51.433790] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-10-02T20:40:51.433836] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-10-02T20:40:51.433871] [INFO ] [MAIN ] O: Starting full primary refresh. [2025-10-02T20:40:51.478132] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-02. [2025-10-02T20:40:51.827424] [INFO ] [REMOTE ] O: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:40:52.273033] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-10. [2025-10-02T20:40:52.657383] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-02T20:40:52.658109] [INFO ] [REMOTE ] NXN: Full fetch complete (3647 records). [2025-10-02T20:40:52.658219] [DEBUG] [VALIDATOR ] NXN: Validating primary data. [2025-10-02T20:40:53.047580] [DEBUG] [VALIDATOR ] NXN: All expected trading days are present. [2025-10-02T20:40:53.047680] [DEBUG] [VALIDATOR ] NXN: Primary data validation passed. [2025-10-02T20:40:53.047832] [INFO ] [MAIN ] NXN: Fetched primary data is valid. [2025-10-02T20:40:53.047874] [DEBUG] [LOCAL ] NXN: Saving primary data. [2025-10-02T20:40:53.048276] [DEBUG] [LOCAL ] NXN: Trimmed 3647 records to 2335 (keeping 200 days of data) [2025-10-02T20:40:53.063526] [DEBUG] [LOCAL ] NXN: Primary data saved (2335 records). [2025-10-02T20:40:53.063623] [INFO ] [MAIN ] NXN: Full history saved. [2025-10-02T20:40:53.063731] [INFO ] [MAIN ] Update Progress: 1568/2370 symbols completed. NXN took 45.1s. Estimated remaining: 1h 52m 57s. Rate: 7.1 symbols/min [2025-10-02T20:40:53.094900] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-01. [2025-10-02T20:40:53.250632] [INFO ] [MAIN ] OBDC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:40:53.250920] [DEBUG] [LOCAL ] OBDC: No existing data file found in primary storage. [2025-10-02T20:40:53.250992] [WARN ] [MAIN ] OBDC: No existing data found, performing full refresh instead. [2025-10-02T20:40:53.251138] [INFO ] [MAIN ] OBDC: Wiping existing primary data before full refresh. [2025-10-02T20:40:53.251201] [INFO ] [LOCAL ] OBDC: Starting deletion of primary data. [2025-10-02T20:40:53.251252] [DEBUG] [LOCAL ] OBDC: No primary data file found to delete. [2025-10-02T20:40:53.251438] [INFO ] [MAIN ] OBDC: Starting full primary refresh. [2025-10-02T20:40:53.639515] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-10-02T20:40:53.688730] [INFO ] [REMOTE ] OBDC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:40:53.873038] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2024-12. [2025-10-02T20:40:54.590272] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-02T20:40:54.673014] [INFO ] [REMOTE ] O: Fetching primary data for 2024-12. [2025-10-02T20:40:55.473021] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-02. [2025-10-02T20:40:55.630174] [INFO ] [REMOTE ] O: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-02T20:40:55.790812] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-02T20:40:56.273038] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-03. [2025-10-02T20:40:56.811520] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-02T20:40:57.073027] [INFO ] [REMOTE ] O: Fetching primary data for 2025-01. [2025-10-02T20:40:57.872961] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-03. [2025-10-02T20:40:57.980273] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-02T20:40:58.182414] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-02T20:40:58.673025] [INFO ] [REMOTE ] O: Fetching primary data for 2025-02. [2025-10-02T20:40:59.302000] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-02T20:40:59.473020] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-04. [2025-10-02T20:40:59.537471] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-02T20:41:00.273058] [INFO ] [REMOTE ] O: Fetching primary data for 2025-03. [2025-10-02T20:41:01.073009] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-01. [2025-10-02T20:41:01.258855] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-02T20:41:01.415062] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-02T20:41:01.873020] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-05. [2025-10-02T20:41:02.673012] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-04. [2025-10-02T20:41:02.958599] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-02T20:41:03.473003] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-02. [2025-10-02T20:41:03.690021] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-02T20:41:04.187895] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-02T20:41:04.273004] [INFO ] [REMOTE ] O: Fetching primary data for 2025-04. [2025-10-02T20:41:05.073040] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-06. [2025-10-02T20:41:05.213705] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-02T20:41:05.260329] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-02T20:41:05.873021] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-05. [2025-10-02T20:41:06.672999] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-03. [2025-10-02T20:41:06.902757] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-02T20:41:07.041367] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-02T20:41:07.472999] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-07. [2025-10-02T20:41:08.272975] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-06. [2025-10-02T20:41:08.322767] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-02T20:41:09.073040] [INFO ] [REMOTE ] O: Fetching primary data for 2025-05. [2025-10-02T20:41:09.366350] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-02T20:41:09.720464] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-02T20:41:09.872992] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-08. [2025-10-02T20:41:10.006700] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-02T20:41:10.673007] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-04. [2025-10-02T20:41:11.472986] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-07. [2025-10-02T20:41:11.731903] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-02T20:41:12.272988] [INFO ] [REMOTE ] O: Fetching primary data for 2025-06. [2025-10-02T20:41:12.431059] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-02T20:41:12.473308] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-02T20:41:13.072998] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-05. [2025-10-02T20:41:13.872975] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-08. [2025-10-02T20:41:14.672983] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-09. [2025-10-02T20:41:14.996380] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-02T20:41:15.075556] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-06 (2.80 seconds). [2025-10-02T20:41:15.401230] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-02T20:41:15.473011] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-09. [2025-10-02T20:41:16.203262] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-02T20:41:16.273002] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-10. [2025-10-02T20:41:16.826441] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-02T20:41:17.073041] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-06. [2025-10-02T20:41:17.679983] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-02T20:41:17.681994] [INFO ] [REMOTE ] NYT: Full fetch complete (72086 records). [2025-10-02T20:41:17.682135] [DEBUG] [VALIDATOR ] NYT: Validating primary data. [2025-10-02T20:41:17.878367] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-10. [2025-10-02T20:41:18.119005] [DEBUG] [VALIDATOR ] NYT: All expected trading days are present. [2025-10-02T20:41:18.119134] [DEBUG] [VALIDATOR ] NYT: Primary data validation passed. [2025-10-02T20:41:18.120252] [INFO ] [MAIN ] NYT: Fetched primary data is valid. [2025-10-02T20:41:18.120353] [DEBUG] [LOCAL ] NYT: Saving primary data. [2025-10-02T20:41:18.122010] [DEBUG] [LOCAL ] NYT: Trimmed 72086 records to 50204 (keeping 200 days of data) [2025-10-02T20:41:18.447837] [DEBUG] [LOCAL ] NYT: Primary data saved (50204 records). [2025-10-02T20:41:18.448035] [INFO ] [MAIN ] NYT: Full history saved. [2025-10-02T20:41:18.448135] [INFO ] [MAIN ] Update Progress: 1569/2370 symbols completed. NYT took 40.5s. Estimated remaining: 1h 52m 57s. Rate: 7.1 symbols/min [2025-10-02T20:41:18.640324] [INFO ] [MAIN ] OBK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:41:18.640617] [DEBUG] [LOCAL ] OBK: No existing data file found in primary storage. [2025-10-02T20:41:18.640741] [WARN ] [MAIN ] OBK: No existing data found, performing full refresh instead. [2025-10-02T20:41:18.640962] [INFO ] [MAIN ] OBK: Wiping existing primary data before full refresh. [2025-10-02T20:41:18.641124] [INFO ] [LOCAL ] OBK: Starting deletion of primary data. [2025-10-02T20:41:18.641311] [DEBUG] [LOCAL ] OBK: No primary data file found to delete. [2025-10-02T20:41:18.641440] [INFO ] [MAIN ] OBK: Starting full primary refresh. [2025-10-02T20:41:18.676203] [INFO ] [REMOTE ] O: Fetching primary data for 2025-07. [2025-10-02T20:41:18.902277] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-02T20:41:19.113287] [INFO ] [REMOTE ] OBK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:41:19.328251] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-02T20:41:19.329868] [INFO ] [REMOTE ] NZF: Full fetch complete (43357 records). [2025-10-02T20:41:19.329995] [DEBUG] [VALIDATOR ] NZF: Validating primary data. [2025-10-02T20:41:19.481497] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-07. [2025-10-02T20:41:19.748769] [DEBUG] [VALIDATOR ] NZF: All expected trading days are present. [2025-10-02T20:41:19.748883] [DEBUG] [VALIDATOR ] NZF: Primary data validation passed. [2025-10-02T20:41:19.749861] [INFO ] [MAIN ] NZF: Fetched primary data is valid. [2025-10-02T20:41:19.750095] [DEBUG] [LOCAL ] NZF: Saving primary data. [2025-10-02T20:41:19.751777] [DEBUG] [LOCAL ] NZF: Trimmed 43357 records to 29328 (keeping 200 days of data) [2025-10-02T20:41:19.901272] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-02T20:41:20.024226] [DEBUG] [LOCAL ] NZF: Primary data saved (29328 records). [2025-10-02T20:41:20.024375] [INFO ] [MAIN ] NZF: Full history saved. [2025-10-02T20:41:20.024451] [INFO ] [MAIN ] Update Progress: 1570/2370 symbols completed. NZF took 40.8s. Estimated remaining: 1h 52m 45s. Rate: 7.1 symbols/min [2025-10-02T20:41:20.217953] [INFO ] [MAIN ] OC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:41:20.218203] [DEBUG] [LOCAL ] OC: No existing data file found in primary storage. [2025-10-02T20:41:20.218260] [WARN ] [MAIN ] OC: No existing data found, performing full refresh instead. [2025-10-02T20:41:20.218389] [INFO ] [MAIN ] OC: Wiping existing primary data before full refresh. [2025-10-02T20:41:20.218439] [INFO ] [LOCAL ] OC: Starting deletion of primary data. [2025-10-02T20:41:20.218481] [DEBUG] [LOCAL ] OC: No primary data file found to delete. [2025-10-02T20:41:20.218514] [INFO ] [MAIN ] OC: Starting full primary refresh. [2025-10-02T20:41:20.282593] [INFO ] [REMOTE ] OBK: Fetching primary data for 2024-12. [2025-10-02T20:41:20.632549] [INFO ] [REMOTE ] OC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:41:21.072985] [INFO ] [REMOTE ] OC: Fetching primary data for 2024-12. [2025-10-02T20:41:21.416554] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-02T20:41:21.614865] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-02T20:41:21.873045] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-08. [2025-10-02T20:41:22.562526] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-02T20:41:22.673041] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-01. [2025-10-02T20:41:23.427054] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-02T20:41:23.472987] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-09. [2025-10-02T20:41:23.579691] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-02T20:41:24.273023] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-02. [2025-10-02T20:41:25.073018] [INFO ] [REMOTE ] O: Fetching primary data for 2025-08. [2025-10-02T20:41:25.345587] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-02T20:41:25.442749] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-02T20:41:25.873005] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-10. [2025-10-02T20:41:25.964427] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-02T20:41:26.673028] [INFO ] [REMOTE ] O: Fetching primary data for 2025-09. [2025-10-02T20:41:27.354297] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-02T20:41:27.395287] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-02T20:41:27.400101] [INFO ] [REMOTE ] OBDC: Full fetch complete (75011 records). [2025-10-02T20:41:27.400262] [DEBUG] [VALIDATOR ] OBDC: Validating primary data. [2025-10-02T20:41:27.479109] [INFO ] [REMOTE ] O: Fetching primary data for 2025-10. [2025-10-02T20:41:27.878252] [DEBUG] [VALIDATOR ] OBDC: All expected trading days are present. [2025-10-02T20:41:27.878357] [DEBUG] [VALIDATOR ] OBDC: Primary data validation passed. [2025-10-02T20:41:27.879820] [INFO ] [MAIN ] OBDC: Fetched primary data is valid. [2025-10-02T20:41:27.879900] [DEBUG] [LOCAL ] OBDC: Saving primary data. [2025-10-02T20:41:27.881544] [DEBUG] [LOCAL ] OBDC: Trimmed 75011 records to 52051 (keeping 200 days of data) [2025-10-02T20:41:28.243735] [DEBUG] [LOCAL ] OBDC: Primary data saved (52051 records). [2025-10-02T20:41:28.243885] [INFO ] [MAIN ] OBDC: Full history saved. [2025-10-02T20:41:28.243963] [INFO ] [MAIN ] Update Progress: 1571/2370 symbols completed. OBDC took 35.2s. Estimated remaining: 1h 52m 36s. Rate: 7.1 symbols/min [2025-10-02T20:41:28.278890] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-03. [2025-10-02T20:41:28.449927] [INFO ] [MAIN ] OCFT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:41:28.450094] [DEBUG] [LOCAL ] OCFT: No existing data file found in primary storage. [2025-10-02T20:41:28.450133] [WARN ] [MAIN ] OCFT: No existing data found, performing full refresh instead. [2025-10-02T20:41:28.450251] [INFO ] [MAIN ] OCFT: Wiping existing primary data before full refresh. [2025-10-02T20:41:28.450294] [INFO ] [LOCAL ] OCFT: Starting deletion of primary data. [2025-10-02T20:41:28.450337] [DEBUG] [LOCAL ] OCFT: No primary data file found to delete. [2025-10-02T20:41:28.450390] [INFO ] [MAIN ] OCFT: Starting full primary refresh. [2025-10-02T20:41:28.849210] [INFO ] [REMOTE ] OCFT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:41:29.073041] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2024-12. [2025-10-02T20:41:29.420734] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-02T20:41:29.423060] [INFO ] [REMOTE ] O: Full fetch complete (77559 records). [2025-10-02T20:41:29.423218] [DEBUG] [VALIDATOR ] O: Validating primary data. [2025-10-02T20:41:29.648290] [WARN ] [VALIDATOR ] O: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-02T20:41:29.649067] [FATAL] [MAIN ] O: Fetched primary data is invalid. Refusing to save it. [2025-10-02T20:41:29.649142] [WARN ] [MAIN ] O: Deleting existing primary and derivative data due to validation failure. [2025-10-02T20:41:29.649216] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-10-02T20:41:29.649285] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-10-02T20:41:29.649326] [INFO ] [LOCAL ] O: Starting deletion of derivative data. [2025-10-02T20:41:29.649383] [DEBUG] [LOCAL ] O: No derivative data file found to delete. [2025-10-02T20:41:29.649471] [INFO ] [MAIN ] Update Progress: 1572/2370 symbols completed. O took 38.4s. Estimated remaining: 1h 52m 24s. Rate: 7.1 symbols/min [2025-10-02T20:41:29.834943] [INFO ] [MAIN ] ODC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:41:29.835152] [DEBUG] [LOCAL ] ODC: No existing data file found in primary storage. [2025-10-02T20:41:29.835213] [WARN ] [MAIN ] ODC: No existing data found, performing full refresh instead. [2025-10-02T20:41:29.835321] [INFO ] [MAIN ] ODC: Wiping existing primary data before full refresh. [2025-10-02T20:41:29.835364] [INFO ] [LOCAL ] ODC: Starting deletion of primary data. [2025-10-02T20:41:29.835406] [DEBUG] [LOCAL ] ODC: No primary data file found to delete. [2025-10-02T20:41:29.835438] [INFO ] [MAIN ] ODC: Starting full primary refresh. [2025-10-02T20:41:29.883631] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-01. [2025-10-02T20:41:29.960551] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-02T20:41:30.074276] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-02T20:41:30.265519] [INFO ] [REMOTE ] ODC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:41:30.673018] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-04. [2025-10-02T20:41:31.472979] [INFO ] [REMOTE ] ODC: Fetching primary data for 2024-12. [2025-10-02T20:41:31.709792] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-02T20:41:31.879269] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-02T20:41:32.074556] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-02T20:41:32.273049] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-01. [2025-10-02T20:41:32.922024] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-02T20:41:33.073009] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-02. [2025-10-02T20:41:33.687881] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-02T20:41:33.873002] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-05. [2025-10-02T20:41:34.673035] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-03. [2025-10-02T20:41:34.955517] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-02T20:41:35.472999] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-06. [2025-10-02T20:41:35.783877] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-02T20:41:36.267361] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-02T20:41:36.272945] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-07. [2025-10-02T20:41:37.073047] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-02. [2025-10-02T20:41:37.375050] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-02T20:41:37.873027] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-04. [2025-10-02T20:41:38.423635] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-02T20:41:38.673012] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-03. [2025-10-02T20:41:38.752309] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-02T20:41:39.473040] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-01. [2025-10-02T20:41:40.195099] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-02T20:41:40.272987] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-04. [2025-10-02T20:41:40.337783] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-02T20:41:41.073021] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-02. [2025-10-02T20:41:41.873023] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-08. [2025-10-02T20:41:41.893945] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-02T20:41:42.096772] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-02T20:41:42.604959] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-02T20:41:42.672994] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-05. [2025-10-02T20:41:43.473022] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-03. [2025-10-02T20:41:43.564279] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-02T20:41:44.272994] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-09. [2025-10-02T20:41:44.417850] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-02T20:41:45.072996] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-05. [2025-10-02T20:41:45.314023] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-02T20:41:45.873013] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-04. [2025-10-02T20:41:46.673010] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-10. [2025-10-02T20:41:46.789789] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-02T20:41:46.841312] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-02T20:41:47.473011] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-06. [2025-10-02T20:41:47.492184] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-02T20:41:47.493353] [INFO ] [REMOTE ] OBK: Full fetch complete (23838 records). [2025-10-02T20:41:47.493430] [DEBUG] [VALIDATOR ] OBK: Validating primary data. [2025-10-02T20:41:47.902099] [DEBUG] [VALIDATOR ] OBK: All expected trading days are present. [2025-10-02T20:41:47.902237] [DEBUG] [VALIDATOR ] OBK: Primary data validation passed. [2025-10-02T20:41:47.902882] [INFO ] [MAIN ] OBK: Fetched primary data is valid. [2025-10-02T20:41:47.902955] [DEBUG] [LOCAL ] OBK: Saving primary data. [2025-10-02T20:41:47.903810] [DEBUG] [LOCAL ] OBK: Trimmed 23838 records to 16248 (keeping 200 days of data) [2025-10-02T20:41:48.013081] [DEBUG] [LOCAL ] OBK: Primary data saved (16248 records). [2025-10-02T20:41:48.013229] [INFO ] [MAIN ] OBK: Full history saved. [2025-10-02T20:41:48.013333] [INFO ] [MAIN ] Update Progress: 1573/2370 symbols completed. OBK took 29.6s. Estimated remaining: 1h 52m 21s. Rate: 7.1 symbols/min [2025-10-02T20:41:48.196322] [INFO ] [MAIN ] ODV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:41:48.196513] [DEBUG] [LOCAL ] ODV: No existing data file found in primary storage. [2025-10-02T20:41:48.196557] [WARN ] [MAIN ] ODV: No existing data found, performing full refresh instead. [2025-10-02T20:41:48.196707] [INFO ] [MAIN ] ODV: Wiping existing primary data before full refresh. [2025-10-02T20:41:48.196761] [INFO ] [LOCAL ] ODV: Starting deletion of primary data. [2025-10-02T20:41:48.196806] [DEBUG] [LOCAL ] ODV: No primary data file found to delete. [2025-10-02T20:41:48.196840] [INFO ] [MAIN ] ODV: Starting full primary refresh. [2025-10-02T20:41:48.278122] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-05. [2025-10-02T20:41:48.584518] [INFO ] [REMOTE ] ODV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:41:49.072989] [INFO ] [REMOTE ] ODV: Fetching primary data for 2024-12. [2025-10-02T20:41:49.143179] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-02T20:41:49.158570] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-02T20:41:49.873051] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-07. [2025-10-02T20:41:50.137609] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-02T20:41:50.673026] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-06. [2025-10-02T20:41:51.473049] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-01. [2025-10-02T20:41:51.610303] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-02T20:41:51.645353] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-02T20:41:52.273008] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-07. [2025-10-02T20:41:52.363460] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-02T20:41:52.808843] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-02T20:41:53.073067] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-02. [2025-10-02T20:41:53.873032] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-08. [2025-10-02T20:41:53.973736] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-02T20:41:54.673016] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-06. [2025-10-02T20:41:55.322178] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-02T20:41:55.362086] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-02T20:41:55.473050] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-08. [2025-10-02T20:41:56.020150] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-02T20:41:56.273019] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-03. [2025-10-02T20:41:57.073007] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-09. [2025-10-02T20:41:57.238078] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-02T20:41:57.873037] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-07. [2025-10-02T20:41:58.604569] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-02T20:41:58.672987] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-10. [2025-10-02T20:41:58.753529] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-02T20:41:59.473035] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-09. [2025-10-02T20:41:59.733353] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-02T20:41:59.735253] [INFO ] [REMOTE ] OC: Full fetch complete (64148 records). [2025-10-02T20:41:59.735352] [DEBUG] [VALIDATOR ] OC: Validating primary data. [2025-10-02T20:42:00.189913] [DEBUG] [VALIDATOR ] OC: All expected trading days are present. [2025-10-02T20:42:00.193951] [DEBUG] [VALIDATOR ] OC: Primary data validation passed. [2025-10-02T20:42:00.195944] [INFO ] [MAIN ] OC: Fetched primary data is valid. [2025-10-02T20:42:00.196221] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-02T20:42:00.198143] [DEBUG] [LOCAL ] OC: Saving primary data. [2025-10-02T20:42:00.206085] [DEBUG] [LOCAL ] OC: Trimmed 64148 records to 44907 (keeping 200 days of data) [2025-10-02T20:42:00.274163] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-04. [2025-10-02T20:42:00.511596] [DEBUG] [LOCAL ] OC: Primary data saved (44907 records). [2025-10-02T20:42:00.511774] [INFO ] [MAIN ] OC: Full history saved. [2025-10-02T20:42:00.511882] [INFO ] [MAIN ] Update Progress: 1574/2370 symbols completed. OC took 40.5s. Estimated remaining: 1h 52m 14s. Rate: 7.1 symbols/min [2025-10-02T20:42:00.709684] [INFO ] [MAIN ] OEC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:42:00.709893] [DEBUG] [LOCAL ] OEC: No existing data file found in primary storage. [2025-10-02T20:42:00.709952] [WARN ] [MAIN ] OEC: No existing data found, performing full refresh instead. [2025-10-02T20:42:00.710071] [INFO ] [MAIN ] OEC: Wiping existing primary data before full refresh. [2025-10-02T20:42:00.710131] [INFO ] [LOCAL ] OEC: Starting deletion of primary data. [2025-10-02T20:42:00.710174] [DEBUG] [LOCAL ] OEC: No primary data file found to delete. [2025-10-02T20:42:00.710207] [INFO ] [MAIN ] OEC: Starting full primary refresh. [2025-10-02T20:42:01.078122] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-08. [2025-10-02T20:42:01.126676] [INFO ] [REMOTE ] OEC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:42:01.392337] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-02T20:42:01.873002] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-05. [2025-10-02T20:42:02.064911] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-02T20:42:02.672982] [INFO ] [REMOTE ] OEC: Fetching primary data for 2024-12. [2025-10-02T20:42:02.783751] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-02T20:42:03.473026] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-10. [2025-10-02T20:42:03.932715] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-02T20:42:03.933505] [INFO ] [REMOTE ] OCFT: Full fetch complete (11699 records). [2025-10-02T20:42:03.933597] [DEBUG] [VALIDATOR ] OCFT: Validating primary data. [2025-10-02T20:42:04.277096] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-09. [2025-10-02T20:42:04.314519] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-02T20:42:04.473942] [DEBUG] [VALIDATOR ] OCFT: All expected trading days are present. [2025-10-02T20:42:04.474036] [DEBUG] [VALIDATOR ] OCFT: Primary data validation passed. [2025-10-02T20:42:04.474313] [INFO ] [MAIN ] OCFT: Fetched primary data is valid. [2025-10-02T20:42:04.474365] [DEBUG] [LOCAL ] OCFT: Saving primary data. [2025-10-02T20:42:04.475125] [DEBUG] [LOCAL ] OCFT: Trimmed 11699 records to 8212 (keeping 200 days of data) [2025-10-02T20:42:04.526211] [DEBUG] [LOCAL ] OCFT: Primary data saved (8212 records). [2025-10-02T20:42:04.526361] [INFO ] [MAIN ] OCFT: Full history saved. [2025-10-02T20:42:04.526440] [INFO ] [MAIN ] Update Progress: 1575/2370 symbols completed. OCFT took 36.3s. Estimated remaining: 1h 52m 4s. Rate: 7.1 symbols/min [2025-10-02T20:42:04.719600] [INFO ] [MAIN ] OFG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:42:04.719808] [DEBUG] [LOCAL ] OFG: No existing data file found in primary storage. [2025-10-02T20:42:04.719865] [WARN ] [MAIN ] OFG: No existing data found, performing full refresh instead. [2025-10-02T20:42:04.719981] [INFO ] [MAIN ] OFG: Wiping existing primary data before full refresh. [2025-10-02T20:42:04.720025] [INFO ] [LOCAL ] OFG: Starting deletion of primary data. [2025-10-02T20:42:04.720069] [DEBUG] [LOCAL ] OFG: No primary data file found to delete. [2025-10-02T20:42:04.720102] [INFO ] [MAIN ] OFG: Starting full primary refresh. [2025-10-02T20:42:05.081301] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-06. [2025-10-02T20:42:05.128747] [INFO ] [REMOTE ] OFG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:42:05.224554] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-02T20:42:05.873001] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-10. [2025-10-02T20:42:06.268974] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-02T20:42:06.418533] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-02T20:42:06.419699] [INFO ] [REMOTE ] ODC: Full fetch complete (10895 records). [2025-10-02T20:42:06.419802] [DEBUG] [VALIDATOR ] ODC: Validating primary data. [2025-10-02T20:42:06.678207] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-01. [2025-10-02T20:42:06.841346] [DEBUG] [VALIDATOR ] ODC: All expected trading days are present. [2025-10-02T20:42:06.841424] [DEBUG] [VALIDATOR ] ODC: Primary data validation passed. [2025-10-02T20:42:06.841725] [INFO ] [MAIN ] ODC: Fetched primary data is valid. [2025-10-02T20:42:06.841787] [DEBUG] [LOCAL ] ODC: Saving primary data. [2025-10-02T20:42:06.842263] [DEBUG] [LOCAL ] ODC: Trimmed 10895 records to 8465 (keeping 200 days of data) [2025-10-02T20:42:06.897275] [DEBUG] [LOCAL ] ODC: Primary data saved (8465 records). [2025-10-02T20:42:06.897425] [INFO ] [MAIN ] ODC: Full history saved. [2025-10-02T20:42:06.897503] [INFO ] [MAIN ] Update Progress: 1576/2370 symbols completed. ODC took 37.2s. Estimated remaining: 1h 51m 52s. Rate: 7.1 symbols/min [2025-10-02T20:42:07.082835] [INFO ] [MAIN ] OGE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:42:07.083005] [DEBUG] [LOCAL ] OGE: No existing data file found in primary storage. [2025-10-02T20:42:07.083043] [WARN ] [MAIN ] OGE: No existing data found, performing full refresh instead. [2025-10-02T20:42:07.083205] [INFO ] [MAIN ] OGE: Wiping existing primary data before full refresh. [2025-10-02T20:42:07.083255] [INFO ] [LOCAL ] OGE: Starting deletion of primary data. [2025-10-02T20:42:07.083298] [DEBUG] [LOCAL ] OGE: No primary data file found to delete. [2025-10-02T20:42:07.083330] [INFO ] [MAIN ] OGE: Starting full primary refresh. [2025-10-02T20:42:07.480140] [INFO ] [REMOTE ] OGE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:42:07.475441] [INFO ] [REMOTE ] OFG: Fetching primary data for 2024-12. [2025-10-02T20:42:08.159712] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-02T20:42:08.272998] [INFO ] [REMOTE ] OGE: Fetching primary data for 2024-12. [2025-10-02T20:42:08.980306] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-02T20:42:09.072988] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-07. [2025-10-02T20:42:09.872976] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-01. [2025-10-02T20:42:10.023815] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-02T20:42:10.281608] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-02T20:42:10.672948] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-08. [2025-10-02T20:42:10.911619] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-02T20:42:11.472986] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-01. [2025-10-02T20:42:12.273053] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-02. [2025-10-02T20:42:12.297238] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-02T20:42:12.741409] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-02T20:42:13.073046] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-02. [2025-10-02T20:42:13.541877] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-02T20:42:13.873019] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-09. [2025-10-02T20:42:14.673008] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-03. [2025-10-02T20:42:14.706345] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-02T20:42:15.473074] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-03. [2025-10-02T20:42:15.520622] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-02T20:42:15.808237] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-02T20:42:16.273060] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-10. [2025-10-02T20:42:17.073043] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-02. [2025-10-02T20:42:17.279072] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-02T20:42:17.550636] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-02T20:42:17.552257] [INFO ] [REMOTE ] ODV: Full fetch complete (33054 records). [2025-10-02T20:42:17.552463] [DEBUG] [VALIDATOR ] ODV: Validating primary data. [2025-10-02T20:42:17.878168] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-04. [2025-10-02T20:42:17.966844] [DEBUG] [VALIDATOR ] ODV: All expected trading days are present. [2025-10-02T20:42:17.966935] [DEBUG] [VALIDATOR ] ODV: Primary data validation passed. [2025-10-02T20:42:17.967732] [INFO ] [MAIN ] ODV: Fetched primary data is valid. [2025-10-02T20:42:17.967798] [DEBUG] [LOCAL ] ODV: Saving primary data. [2025-10-02T20:42:17.968918] [DEBUG] [LOCAL ] ODV: Trimmed 33054 records to 27146 (keeping 200 days of data) [2025-10-02T20:42:18.133208] [DEBUG] [LOCAL ] ODV: Primary data saved (27146 records). [2025-10-02T20:42:18.133365] [INFO ] [MAIN ] ODV: Full history saved. [2025-10-02T20:42:18.133445] [INFO ] [MAIN ] Update Progress: 1577/2370 symbols completed. ODV took 30.1s. Estimated remaining: 1h 51m 45s. Rate: 7.1 symbols/min [2025-10-02T20:42:18.317015] [INFO ] [MAIN ] OGN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:42:18.317216] [DEBUG] [LOCAL ] OGN: No existing data file found in primary storage. [2025-10-02T20:42:18.317275] [WARN ] [MAIN ] OGN: No existing data found, performing full refresh instead. [2025-10-02T20:42:18.317387] [INFO ] [MAIN ] OGN: Wiping existing primary data before full refresh. [2025-10-02T20:42:18.317430] [INFO ] [LOCAL ] OGN: Starting deletion of primary data. [2025-10-02T20:42:18.317473] [DEBUG] [LOCAL ] OGN: No primary data file found to delete. [2025-10-02T20:42:18.317545] [INFO ] [MAIN ] OGN: Starting full primary refresh. [2025-10-02T20:42:18.678963] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-04. [2025-10-02T20:42:18.715613] [INFO ] [REMOTE ] OGN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:42:18.740772] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-02T20:42:19.297587] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-02T20:42:19.473021] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-05. [2025-10-02T20:42:20.272975] [INFO ] [REMOTE ] OGN: Fetching primary data for 2024-12. [2025-10-02T20:42:20.493348] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-02T20:42:20.591114] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-02T20:42:21.073048] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-06. [2025-10-02T20:42:21.873032] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-03. [2025-10-02T20:42:21.974998] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-02T20:42:22.673045] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-05. [2025-10-02T20:42:23.454586] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-02T20:42:23.472997] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-04. [2025-10-02T20:42:24.101184] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-02T20:42:24.273200] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-06. [2025-10-02T20:42:25.036473] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-02T20:42:25.073051] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-05. [2025-10-02T20:42:25.531381] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-02T20:42:25.601612] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-06 (4.53 seconds). [2025-10-02T20:42:25.873049] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-07. [2025-10-02T20:42:26.673048] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-07. [2025-10-02T20:42:26.726240] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-02T20:42:27.005389] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-02T20:42:27.473030] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-01. [2025-10-02T20:42:28.272965] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-06. [2025-10-02T20:42:28.473802] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-02T20:42:29.073024] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-08. [2025-10-02T20:42:29.303250] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-02T20:42:29.699371] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-02T20:42:29.873027] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-02. [2025-10-02T20:42:30.673039] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-07. [2025-10-02T20:42:30.882699] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-02T20:42:31.473015] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-09. [2025-10-02T20:42:31.622905] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-02T20:42:32.160154] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-02T20:42:32.273079] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-08. [2025-10-02T20:42:32.752628] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-02T20:42:33.073008] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-10. [2025-10-02T20:42:33.152565] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-02T20:42:33.872995] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-08. [2025-10-02T20:42:34.421028] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-02T20:42:34.422929] [INFO ] [REMOTE ] OGE: Full fetch complete (66748 records). [2025-10-02T20:42:34.423035] [DEBUG] [VALIDATOR ] OGE: Validating primary data. [2025-10-02T20:42:34.678133] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-03. [2025-10-02T20:42:34.863113] [DEBUG] [VALIDATOR ] OGE: All expected trading days are present. [2025-10-02T20:42:34.863209] [DEBUG] [VALIDATOR ] OGE: Primary data validation passed. [2025-10-02T20:42:34.864285] [INFO ] [MAIN ] OGE: Fetched primary data is valid. [2025-10-02T20:42:34.864365] [DEBUG] [LOCAL ] OGE: Saving primary data. [2025-10-02T20:42:34.866282] [DEBUG] [LOCAL ] OGE: Trimmed 66748 records to 46690 (keeping 200 days of data) [2025-10-02T20:42:35.131407] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-02T20:42:35.207499] [DEBUG] [LOCAL ] OGE: Primary data saved (46690 records). [2025-10-02T20:42:35.207667] [INFO ] [MAIN ] OGE: Full history saved. [2025-10-02T20:42:35.207765] [INFO ] [MAIN ] Update Progress: 1578/2370 symbols completed. OGE took 28.3s. Estimated remaining: 1h 51m 41s. Rate: 7.1 symbols/min [2025-10-02T20:42:35.399819] [INFO ] [MAIN ] OGS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:42:35.400077] [DEBUG] [LOCAL ] OGS: No existing data file found in primary storage. [2025-10-02T20:42:35.400127] [WARN ] [MAIN ] OGS: No existing data found, performing full refresh instead. [2025-10-02T20:42:35.400246] [INFO ] [MAIN ] OGS: Wiping existing primary data before full refresh. [2025-10-02T20:42:35.400313] [INFO ] [LOCAL ] OGS: Starting deletion of primary data. [2025-10-02T20:42:35.400447] [DEBUG] [LOCAL ] OGS: No primary data file found to delete. [2025-10-02T20:42:35.400521] [INFO ] [MAIN ] OGS: Starting full primary refresh. [2025-10-02T20:42:35.478102] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-09. [2025-10-02T20:42:35.811422] [INFO ] [REMOTE ] OGS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:42:36.273086] [INFO ] [REMOTE ] OGS: Fetching primary data for 2024-12. [2025-10-02T20:42:36.778414] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-02T20:42:37.027497] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-02T20:42:37.073059] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-09. [2025-10-02T20:42:37.665387] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-02T20:42:37.873023] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-10. [2025-10-02T20:42:38.220046] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-02T20:42:38.672974] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-04. [2025-10-02T20:42:38.847095] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-02T20:42:38.848763] [INFO ] [REMOTE ] OEC: Full fetch complete (52781 records). [2025-10-02T20:42:38.848868] [DEBUG] [VALIDATOR ] OEC: Validating primary data. [2025-10-02T20:42:39.274789] [DEBUG] [VALIDATOR ] OEC: All expected trading days are present. [2025-10-02T20:42:39.274871] [DEBUG] [VALIDATOR ] OEC: Primary data validation passed. [2025-10-02T20:42:39.275882] [INFO ] [MAIN ] OEC: Fetched primary data is valid. [2025-10-02T20:42:39.275949] [DEBUG] [LOCAL ] OEC: Saving primary data. [2025-10-02T20:42:39.277225] [DEBUG] [LOCAL ] OEC: Trimmed 52781 records to 37258 (keeping 200 days of data) [2025-10-02T20:42:39.481999] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-10. [2025-10-02T20:42:39.517048] [DEBUG] [LOCAL ] OEC: Primary data saved (37258 records). [2025-10-02T20:42:39.517197] [INFO ] [MAIN ] OEC: Full history saved. [2025-10-02T20:42:39.517275] [INFO ] [MAIN ] Update Progress: 1579/2370 symbols completed. OEC took 39.0s. Estimated remaining: 1h 51m 31s. Rate: 7.1 symbols/min [2025-10-02T20:42:39.708024] [INFO ] [MAIN ] OHI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:42:39.708244] [DEBUG] [LOCAL ] OHI: No existing data file found in primary storage. [2025-10-02T20:42:39.708301] [WARN ] [MAIN ] OHI: No existing data found, performing full refresh instead. [2025-10-02T20:42:39.708421] [INFO ] [MAIN ] OHI: Wiping existing primary data before full refresh. [2025-10-02T20:42:39.708463] [INFO ] [LOCAL ] OHI: Starting deletion of primary data. [2025-10-02T20:42:39.708505] [DEBUG] [LOCAL ] OHI: No primary data file found to delete. [2025-10-02T20:42:39.708538] [INFO ] [MAIN ] OHI: Starting full primary refresh. [2025-10-02T20:42:40.114693] [INFO ] [REMOTE ] OHI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:42:40.273008] [INFO ] [REMOTE ] OHI: Fetching primary data for 2024-12. [2025-10-02T20:42:40.280351] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-02T20:42:40.281759] [INFO ] [REMOTE ] OFG: Full fetch complete (34251 records). [2025-10-02T20:42:40.281841] [DEBUG] [VALIDATOR ] OFG: Validating primary data. [2025-10-02T20:42:40.732958] [DEBUG] [VALIDATOR ] OFG: All expected trading days are present. [2025-10-02T20:42:40.733084] [DEBUG] [VALIDATOR ] OFG: Primary data validation passed. [2025-10-02T20:42:40.734027] [INFO ] [MAIN ] OFG: Fetched primary data is valid. [2025-10-02T20:42:40.734117] [DEBUG] [LOCAL ] OFG: Saving primary data. [2025-10-02T20:42:40.735502] [DEBUG] [LOCAL ] OFG: Trimmed 34251 records to 21648 (keeping 200 days of data) [2025-10-02T20:42:40.880164] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-02T20:42:40.944362] [DEBUG] [LOCAL ] OFG: Primary data saved (21648 records). [2025-10-02T20:42:40.944537] [INFO ] [MAIN ] OFG: Full history saved. [2025-10-02T20:42:40.944632] [INFO ] [MAIN ] Update Progress: 1580/2370 symbols completed. OFG took 36.4s. Estimated remaining: 1h 51m 19s. Rate: 7.1 symbols/min [2025-10-02T20:42:41.078112] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-01. [2025-10-02T20:42:41.138209] [INFO ] [MAIN ] OI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:42:41.138482] [DEBUG] [LOCAL ] OI: No existing data file found in primary storage. [2025-10-02T20:42:41.138530] [WARN ] [MAIN ] OI: No existing data found, performing full refresh instead. [2025-10-02T20:42:41.138684] [INFO ] [MAIN ] OI: Wiping existing primary data before full refresh. [2025-10-02T20:42:41.138746] [INFO ] [LOCAL ] OI: Starting deletion of primary data. [2025-10-02T20:42:41.138798] [DEBUG] [LOCAL ] OI: No primary data file found to delete. [2025-10-02T20:42:41.138850] [INFO ] [MAIN ] OI: Starting full primary refresh. [2025-10-02T20:42:41.536137] [INFO ] [REMOTE ] OI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:42:41.873009] [INFO ] [REMOTE ] OI: Fetching primary data for 2024-12. [2025-10-02T20:42:42.156517] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-02T20:42:42.594273] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-02T20:42:42.673029] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-01. [2025-10-02T20:42:43.473052] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-05. [2025-10-02T20:42:43.625060] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-02T20:42:44.273056] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-01. [2025-10-02T20:42:44.572494] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-02T20:42:45.038088] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-02T20:42:45.073005] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-06. [2025-10-02T20:42:45.872982] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-02. [2025-10-02T20:42:45.914326] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-02T20:42:46.673024] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-02. [2025-10-02T20:42:46.808837] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-02T20:42:47.472979] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-02. [2025-10-02T20:42:47.661463] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-02T20:42:48.071897] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-02T20:42:48.273027] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-03. [2025-10-02T20:42:48.735562] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-02T20:42:49.073001] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-03. [2025-10-02T20:42:49.872993] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-07. [2025-10-02T20:42:50.210748] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-02T20:42:50.552063] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-02T20:42:50.673046] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-04. [2025-10-02T20:42:51.473025] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-04. [2025-10-02T20:42:51.617173] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-02T20:42:52.273009] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-08. [2025-10-02T20:42:52.598207] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-02T20:42:53.060177] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-02T20:42:53.072946] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-05. [2025-10-02T20:42:53.885349] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-03. [2025-10-02T20:42:53.892854] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-02T20:42:54.673000] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-09. [2025-10-02T20:42:54.794093] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-02T20:42:55.304507] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-02T20:42:55.473027] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-04. [2025-10-02T20:42:56.273048] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-05. [2025-10-02T20:42:56.696818] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-02T20:42:57.073010] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-10. [2025-10-02T20:42:57.873012] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-06. [2025-10-02T20:42:58.583020] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-02T20:42:58.585232] [INFO ] [REMOTE ] OGN: Full fetch complete (76803 records). [2025-10-02T20:42:58.585356] [DEBUG] [VALIDATOR ] OGN: Validating primary data. [2025-10-02T20:42:59.052225] [DEBUG] [VALIDATOR ] OGN: All expected trading days are present. [2025-10-02T20:42:59.052498] [DEBUG] [VALIDATOR ] OGN: Primary data validation passed. [2025-10-02T20:42:59.053822] [INFO ] [MAIN ] OGN: Fetched primary data is valid. [2025-10-02T20:42:59.070372] [DEBUG] [LOCAL ] OGN: Saving primary data. [2025-10-02T20:42:59.086494] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-04 (3.61 seconds). [2025-10-02T20:42:59.129510] [DEBUG] [LOCAL ] OGN: Trimmed 76803 records to 53480 (keeping 200 days of data) [2025-10-02T20:42:59.131427] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-05 (2.86 seconds). [2025-10-02T20:42:59.128777] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-05. [2025-10-02T20:42:59.277745] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-02T20:42:59.475498] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-06. [2025-10-02T20:42:59.522181] [DEBUG] [LOCAL ] OGN: Primary data saved (53480 records). [2025-10-02T20:42:59.522336] [INFO ] [MAIN ] OGN: Full history saved. [2025-10-02T20:42:59.522415] [INFO ] [MAIN ] Update Progress: 1581/2370 symbols completed. OGN took 41.4s. Estimated remaining: 1h 51m 15s. Rate: 7.1 symbols/min [2025-10-02T20:42:59.708201] [INFO ] [MAIN ] OIA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:42:59.708474] [DEBUG] [LOCAL ] OIA: No existing data file found in primary storage. [2025-10-02T20:42:59.708529] [WARN ] [MAIN ] OIA: No existing data found, performing full refresh instead. [2025-10-02T20:42:59.708925] [INFO ] [MAIN ] OIA: Wiping existing primary data before full refresh. [2025-10-02T20:42:59.709000] [INFO ] [LOCAL ] OIA: Starting deletion of primary data. [2025-10-02T20:42:59.709074] [DEBUG] [LOCAL ] OIA: No primary data file found to delete. [2025-10-02T20:42:59.709113] [INFO ] [MAIN ] OIA: Starting full primary refresh. [2025-10-02T20:43:00.145162] [INFO ] [REMOTE ] OIA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:43:00.273003] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-07. [2025-10-02T20:43:01.001588] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-02T20:43:01.072978] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-06. [2025-10-02T20:43:01.248221] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-02T20:43:01.583417] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-02T20:43:01.873035] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-08. [2025-10-02T20:43:02.673005] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-07. [2025-10-02T20:43:02.727079] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-02T20:43:03.420087] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-02T20:43:03.472995] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-09. [2025-10-02T20:43:04.273003] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-07. [2025-10-02T20:43:04.341522] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-02T20:43:04.969335] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-02T20:43:05.073002] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-10. [2025-10-02T20:43:05.839427] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-02T20:43:05.872984] [INFO ] [REMOTE ] OIA: Fetching primary data for 2024-12. [2025-10-02T20:43:06.076591] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-02T20:43:06.078831] [INFO ] [REMOTE ] OGS: Full fetch complete (48111 records). [2025-10-02T20:43:06.078981] [DEBUG] [VALIDATOR ] OGS: Validating primary data. [2025-10-02T20:43:06.522953] [DEBUG] [VALIDATOR ] OGS: All expected trading days are present. [2025-10-02T20:43:06.523045] [DEBUG] [VALIDATOR ] OGS: Primary data validation passed. [2025-10-02T20:43:06.523868] [INFO ] [MAIN ] OGS: Fetched primary data is valid. [2025-10-02T20:43:06.523934] [DEBUG] [LOCAL ] OGS: Saving primary data. [2025-10-02T20:43:06.525199] [DEBUG] [LOCAL ] OGS: Trimmed 48111 records to 34415 (keeping 200 days of data) [2025-10-02T20:43:06.709125] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-08. [2025-10-02T20:43:06.772469] [DEBUG] [LOCAL ] OGS: Primary data saved (34415 records). [2025-10-02T20:43:06.772659] [INFO ] [MAIN ] OGS: Full history saved. [2025-10-02T20:43:06.772761] [INFO ] [MAIN ] Update Progress: 1582/2370 symbols completed. OGS took 31.6s. Estimated remaining: 1h 51m 6s. Rate: 7.1 symbols/min [2025-10-02T20:43:06.964589] [INFO ] [MAIN ] OII: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:43:06.964814] [DEBUG] [LOCAL ] OII: No existing data file found in primary storage. [2025-10-02T20:43:06.964861] [WARN ] [MAIN ] OII: No existing data found, performing full refresh instead. [2025-10-02T20:43:06.964983] [INFO ] [MAIN ] OII: Wiping existing primary data before full refresh. [2025-10-02T20:43:06.965025] [INFO ] [LOCAL ] OII: Starting deletion of primary data. [2025-10-02T20:43:06.965111] [DEBUG] [LOCAL ] OII: No primary data file found to delete. [2025-10-02T20:43:06.965153] [INFO ] [MAIN ] OII: Starting full primary refresh. [2025-10-02T20:43:07.324451] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-02T20:43:07.395002] [INFO ] [REMOTE ] OII: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:43:07.473033] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-01. [2025-10-02T20:43:08.273003] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-08. [2025-10-02T20:43:09.073031] [INFO ] [REMOTE ] OII: Fetching primary data for 2024-12. [2025-10-02T20:43:09.314573] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-02T20:43:09.426069] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-08 (2.72 seconds). [2025-10-02T20:43:09.872944] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-09. [2025-10-02T20:43:10.673021] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-02. [2025-10-02T20:43:11.542794] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2024-12 (2.47 seconds). [2025-10-02T20:43:11.552920] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-01. [2025-10-02T20:43:11.722455] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-02T20:43:11.769519] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-08 (3.50 seconds). [2025-10-02T20:43:11.785177] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-02T20:43:12.273010] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-09. [2025-10-02T20:43:12.774426] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-02T20:43:13.073047] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-02. [2025-10-02T20:43:13.872975] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-03. [2025-10-02T20:43:14.070674] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-02T20:43:14.518131] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-02T20:43:14.673014] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-10. [2025-10-02T20:43:14.878436] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-02T20:43:15.473045] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-03. [2025-10-02T20:43:15.968300] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-02T20:43:15.970400] [INFO ] [REMOTE ] OI: Full fetch complete (68120 records). [2025-10-02T20:43:15.970537] [DEBUG] [VALIDATOR ] OI: Validating primary data. [2025-10-02T20:43:16.282367] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-10. [2025-10-02T20:43:16.386564] [DEBUG] [VALIDATOR ] OI: All expected trading days are present. [2025-10-02T20:43:16.386707] [DEBUG] [VALIDATOR ] OI: Primary data validation passed. [2025-10-02T20:43:16.388500] [INFO ] [MAIN ] OI: Fetched primary data is valid. [2025-10-02T20:43:16.388574] [DEBUG] [LOCAL ] OI: Saving primary data. [2025-10-02T20:43:16.390670] [DEBUG] [LOCAL ] OI: Trimmed 68120 records to 47454 (keeping 200 days of data) [2025-10-02T20:43:16.683328] [DEBUG] [LOCAL ] OI: Primary data saved (47454 records). [2025-10-02T20:43:16.683488] [INFO ] [MAIN ] OI: Full history saved. [2025-10-02T20:43:16.683574] [INFO ] [MAIN ] Update Progress: 1583/2370 symbols completed. OI took 35.7s. Estimated remaining: 1h 50m 58s. Rate: 7.1 symbols/min [2025-10-02T20:43:16.871501] [INFO ] [MAIN ] OIS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:43:16.871740] [DEBUG] [LOCAL ] OIS: No existing data file found in primary storage. [2025-10-02T20:43:16.871792] [WARN ] [MAIN ] OIS: No existing data found, performing full refresh instead. [2025-10-02T20:43:16.871911] [INFO ] [MAIN ] OIS: Wiping existing primary data before full refresh. [2025-10-02T20:43:16.871956] [INFO ] [LOCAL ] OIS: Starting deletion of primary data. [2025-10-02T20:43:16.872000] [DEBUG] [LOCAL ] OIS: No primary data file found to delete. [2025-10-02T20:43:16.872035] [INFO ] [MAIN ] OIS: Starting full primary refresh. [2025-10-02T20:43:17.074627] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-04. [2025-10-02T20:43:17.288934] [INFO ] [REMOTE ] OIS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:43:17.319851] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-02T20:43:17.737002] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-02T20:43:17.739204] [INFO ] [REMOTE ] OHI: Full fetch complete (75098 records). [2025-10-02T20:43:17.739348] [DEBUG] [VALIDATOR ] OHI: Validating primary data. [2025-10-02T20:43:17.875086] [INFO ] [REMOTE ] OIS: Fetching primary data for 2024-12. [2025-10-02T20:43:18.165956] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-02T20:43:18.229050] [DEBUG] [VALIDATOR ] OHI: All expected trading days are present. [2025-10-02T20:43:18.229135] [DEBUG] [VALIDATOR ] OHI: Primary data validation passed. [2025-10-02T20:43:18.230180] [INFO ] [MAIN ] OHI: Fetched primary data is valid. [2025-10-02T20:43:18.230250] [DEBUG] [LOCAL ] OHI: Saving primary data. [2025-10-02T20:43:18.231699] [DEBUG] [LOCAL ] OHI: Trimmed 75098 records to 52342 (keeping 200 days of data) [2025-10-02T20:43:18.567059] [DEBUG] [LOCAL ] OHI: Primary data saved (52342 records). [2025-10-02T20:43:18.567203] [INFO ] [MAIN ] OHI: Full history saved. [2025-10-02T20:43:18.567283] [INFO ] [MAIN ] Update Progress: 1584/2370 symbols completed. OHI took 39.0s. Estimated remaining: 1h 50m 47s. Rate: 7.1 symbols/min [2025-10-02T20:43:18.673105] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-04. [2025-10-02T20:43:18.748621] [INFO ] [MAIN ] OKE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:43:18.748815] [DEBUG] [LOCAL ] OKE: No existing data file found in primary storage. [2025-10-02T20:43:18.748858] [WARN ] [MAIN ] OKE: No existing data found, performing full refresh instead. [2025-10-02T20:43:18.748977] [INFO ] [MAIN ] OKE: Wiping existing primary data before full refresh. [2025-10-02T20:43:18.749021] [INFO ] [LOCAL ] OKE: Starting deletion of primary data. [2025-10-02T20:43:18.749317] [DEBUG] [LOCAL ] OKE: No primary data file found to delete. [2025-10-02T20:43:18.749368] [INFO ] [MAIN ] OKE: Starting full primary refresh. [2025-10-02T20:43:19.142373] [INFO ] [REMOTE ] OKE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:43:19.473011] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-05. [2025-10-02T20:43:19.860517] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-02T20:43:20.273083] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-01. [2025-10-02T20:43:20.392987] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-02T20:43:20.643198] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-02T20:43:21.073087] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-05. [2025-10-02T20:43:21.873016] [INFO ] [REMOTE ] OKE: Fetching primary data for 2024-12. [2025-10-02T20:43:21.909230] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-02T20:43:22.642563] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-02T20:43:22.672997] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-06. [2025-10-02T20:43:23.472988] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-02. [2025-10-02T20:43:23.755279] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-02T20:43:24.227586] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-02T20:43:24.272978] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-07. [2025-10-02T20:43:24.523919] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-02T20:43:25.073010] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-03. [2025-10-02T20:43:25.747712] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-02T20:43:25.873030] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-06. [2025-10-02T20:43:26.672975] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-01. [2025-10-02T20:43:26.715063] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-02T20:43:26.831425] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-02T20:43:27.473058] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-07. [2025-10-02T20:43:28.273077] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-08. [2025-10-02T20:43:28.551228] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-02T20:43:28.581004] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-02T20:43:29.073051] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-08. [2025-10-02T20:43:29.607703] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-02T20:43:29.872989] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-02. [2025-10-02T20:43:30.262626] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-02T20:43:30.673000] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-09. [2025-10-02T20:43:31.293534] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-02T20:43:31.472998] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-09. [2025-10-02T20:43:32.275065] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-04. [2025-10-02T20:43:32.278087] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-02T20:43:32.298059] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-02T20:43:33.073002] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-10. [2025-10-02T20:43:33.688256] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-02T20:43:33.873005] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-10. [2025-10-02T20:43:34.304305] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-02T20:43:34.306680] [INFO ] [REMOTE ] OII: Full fetch complete (61945 records). [2025-10-02T20:43:34.306832] [DEBUG] [VALIDATOR ] OII: Validating primary data. [2025-10-02T20:43:34.653159] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-02T20:43:34.681718] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-03. [2025-10-02T20:43:34.681960] [INFO ] [REMOTE ] OIA: Full fetch complete (21177 records). [2025-10-02T20:43:34.688268] [DEBUG] [VALIDATOR ] OIA: Validating primary data. [2025-10-02T20:43:34.922493] [DEBUG] [VALIDATOR ] OII: All expected trading days are present. [2025-10-02T20:43:34.938716] [DEBUG] [VALIDATOR ] OII: Primary data validation passed. [2025-10-02T20:43:34.972046] [INFO ] [MAIN ] OII: Fetched primary data is valid. [2025-10-02T20:43:34.981123] [DEBUG] [LOCAL ] OII: Saving primary data. [2025-10-02T20:43:35.122467] [DEBUG] [LOCAL ] OII: Trimmed 61945 records to 42794 (keeping 200 days of data) [2025-10-02T20:43:35.326732] [DEBUG] [VALIDATOR ] OIA: All expected trading days are present. [2025-10-02T20:43:35.327100] [DEBUG] [VALIDATOR ] OIA: Primary data validation passed. [2025-10-02T20:43:35.328018] [INFO ] [MAIN ] OIA: Fetched primary data is valid. [2025-10-02T20:43:35.328739] [DEBUG] [LOCAL ] OIA: Saving primary data. [2025-10-02T20:43:35.331178] [DEBUG] [LOCAL ] OIA: Trimmed 21177 records to 13841 (keeping 200 days of data) [2025-10-02T20:43:35.447456] [DEBUG] [LOCAL ] OIA: Primary data saved (13841 records). [2025-10-02T20:43:35.449174] [INFO ] [MAIN ] OIA: Full history saved. [2025-10-02T20:43:35.449899] [INFO ] [MAIN ] Update Progress: 1585/2370 symbols completed. OIA took 35.9s. Estimated remaining: 1h 50m 42s. Rate: 7.1 symbols/min [2025-10-02T20:43:35.485611] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-05. [2025-10-02T20:43:35.756992] [INFO ] [MAIN ] OKLO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:43:35.758935] [DEBUG] [LOCAL ] OKLO: No existing data file found in primary storage. [2025-10-02T20:43:35.759298] [WARN ] [MAIN ] OKLO: No existing data found, performing full refresh instead. [2025-10-02T20:43:35.760060] [INFO ] [MAIN ] OKLO: Wiping existing primary data before full refresh. [2025-10-02T20:43:35.760135] [INFO ] [LOCAL ] OKLO: Starting deletion of primary data. [2025-10-02T20:43:35.761103] [DEBUG] [LOCAL ] OKLO: No primary data file found to delete. [2025-10-02T20:43:35.761175] [INFO ] [MAIN ] OKLO: Starting full primary refresh. [2025-10-02T20:43:36.199396] [INFO ] [REMOTE ] OKLO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:43:36.230023] [DEBUG] [LOCAL ] OII: Primary data saved (42794 records). [2025-10-02T20:43:36.230210] [INFO ] [MAIN ] OII: Full history saved. [2025-10-02T20:43:36.230289] [INFO ] [MAIN ] Update Progress: 1586/2370 symbols completed. OII took 29.5s. Estimated remaining: 1h 50m 30s. Rate: 7.1 symbols/min [2025-10-02T20:43:36.279161] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2024-12. [2025-10-02T20:43:36.425033] [INFO ] [MAIN ] OLN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:43:36.425197] [DEBUG] [LOCAL ] OLN: No existing data file found in primary storage. [2025-10-02T20:43:36.425239] [WARN ] [MAIN ] OLN: No existing data found, performing full refresh instead. [2025-10-02T20:43:36.425351] [INFO ] [MAIN ] OLN: Wiping existing primary data before full refresh. [2025-10-02T20:43:36.425395] [INFO ] [LOCAL ] OLN: Starting deletion of primary data. [2025-10-02T20:43:36.425436] [DEBUG] [LOCAL ] OLN: No primary data file found to delete. [2025-10-02T20:43:36.425471] [INFO ] [MAIN ] OLN: Starting full primary refresh. [2025-10-02T20:43:36.822227] [INFO ] [REMOTE ] OLN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:43:36.859154] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-02T20:43:37.017855] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-02T20:43:37.072991] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-04. [2025-10-02T20:43:37.873024] [INFO ] [REMOTE ] OLN: Fetching primary data for 2024-12. [2025-10-02T20:43:38.672987] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-06. [2025-10-02T20:43:39.154878] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-02T20:43:39.171523] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2024-12 (2.89 seconds). [2025-10-02T20:43:39.473038] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-01. [2025-10-02T20:43:39.720044] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-02T20:43:39.796177] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-02T20:43:40.273058] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-01. [2025-10-02T20:43:41.072993] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-07. [2025-10-02T20:43:41.873045] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-05. [2025-10-02T20:43:42.110603] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-02T20:43:42.226152] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-01 (2.75 seconds). [2025-10-02T20:43:42.673003] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-02. [2025-10-02T20:43:42.723349] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-02T20:43:43.473003] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-02. [2025-10-02T20:43:43.592593] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-02T20:43:44.273000] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-08. [2025-10-02T20:43:45.072988] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-06. [2025-10-02T20:43:45.161471] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-02T20:43:45.345184] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-02 (2.67 seconds). [2025-10-02T20:43:45.378498] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-02T20:43:45.873017] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-03. [2025-10-02T20:43:46.673057] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-09. [2025-10-02T20:43:46.978926] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-02T20:43:47.473049] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-03. [2025-10-02T20:43:47.774342] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-02T20:43:48.273036] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-10. [2025-10-02T20:43:48.613637] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-03 (2.74 seconds). [2025-10-02T20:43:49.072978] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-04. [2025-10-02T20:43:49.369566] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-02T20:43:49.371268] [INFO ] [REMOTE ] OIS: Full fetch complete (57104 records). [2025-10-02T20:43:49.371355] [DEBUG] [VALIDATOR ] OIS: Validating primary data. [2025-10-02T20:43:49.722139] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-02T20:43:49.827715] [DEBUG] [VALIDATOR ] OIS: All expected trading days are present. [2025-10-02T20:43:49.827806] [DEBUG] [VALIDATOR ] OIS: Primary data validation passed. [2025-10-02T20:43:49.828867] [INFO ] [MAIN ] OIS: Fetched primary data is valid. [2025-10-02T20:43:49.828935] [DEBUG] [LOCAL ] OIS: Saving primary data. [2025-10-02T20:43:49.830182] [DEBUG] [LOCAL ] OIS: Trimmed 57104 records to 40676 (keeping 200 days of data) [2025-10-02T20:43:49.874854] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-07. [2025-10-02T20:43:50.069097] [DEBUG] [LOCAL ] OIS: Primary data saved (40676 records). [2025-10-02T20:43:50.069244] [INFO ] [MAIN ] OIS: Full history saved. [2025-10-02T20:43:50.069354] [INFO ] [MAIN ] Update Progress: 1587/2370 symbols completed. OIS took 33.4s. Estimated remaining: 1h 50m 24s. Rate: 7.1 symbols/min [2025-10-02T20:43:50.250626] [INFO ] [MAIN ] OLP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:43:50.250831] [DEBUG] [LOCAL ] OLP: No existing data file found in primary storage. [2025-10-02T20:43:50.250900] [WARN ] [MAIN ] OLP: No existing data found, performing full refresh instead. [2025-10-02T20:43:50.251027] [INFO ] [MAIN ] OLP: Wiping existing primary data before full refresh. [2025-10-02T20:43:50.251074] [INFO ] [LOCAL ] OLP: Starting deletion of primary data. [2025-10-02T20:43:50.251117] [DEBUG] [LOCAL ] OLP: No primary data file found to delete. [2025-10-02T20:43:50.251151] [INFO ] [MAIN ] OLP: Starting full primary refresh. [2025-10-02T20:43:50.678146] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-04. [2025-10-02T20:43:50.713192] [INFO ] [REMOTE ] OLP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:43:51.472994] [INFO ] [REMOTE ] OLP: Fetching primary data for 2024-12. [2025-10-02T20:43:51.597723] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-10-02T20:43:51.972556] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-02T20:43:52.273138] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-08. [2025-10-02T20:43:52.574401] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-02T20:43:52.658100] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-02T20:43:53.073020] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-05. [2025-10-02T20:43:53.873185] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-05. [2025-10-02T20:43:54.104928] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-02T20:43:54.672969] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-09. [2025-10-02T20:43:54.864452] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-02T20:43:55.472999] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-06. [2025-10-02T20:43:56.273032] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-01. [2025-10-02T20:43:56.749394] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-02T20:43:56.791841] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-05 (2.92 seconds). [2025-10-02T20:43:56.875421] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-02T20:43:57.072982] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-10. [2025-10-02T20:43:57.147568] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-02T20:43:57.873006] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-02. [2025-10-02T20:43:58.445768] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-02T20:43:58.672992] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-07. [2025-10-02T20:43:58.761527] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-02T20:43:58.764050] [INFO ] [REMOTE ] OKE: Full fetch complete (77492 records). [2025-10-02T20:43:58.764162] [DEBUG] [VALIDATOR ] OKE: Validating primary data. [2025-10-02T20:43:59.187518] [DEBUG] [VALIDATOR ] OKE: All expected trading days are present. [2025-10-02T20:43:59.187623] [DEBUG] [VALIDATOR ] OKE: Primary data validation passed. [2025-10-02T20:43:59.188826] [INFO ] [MAIN ] OKE: Fetched primary data is valid. [2025-10-02T20:43:59.188904] [DEBUG] [LOCAL ] OKE: Saving primary data. [2025-10-02T20:43:59.190628] [DEBUG] [LOCAL ] OKE: Trimmed 77492 records to 53927 (keeping 200 days of data) [2025-10-02T20:43:59.495720] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-03. [2025-10-02T20:43:59.552480] [DEBUG] [LOCAL ] OKE: Primary data saved (53927 records). [2025-10-02T20:43:59.552633] [INFO ] [MAIN ] OKE: Full history saved. [2025-10-02T20:43:59.552790] [INFO ] [MAIN ] Update Progress: 1588/2370 symbols completed. OKE took 41.0s. Estimated remaining: 1h 50m 16s. Rate: 7.1 symbols/min [2025-10-02T20:43:59.736956] [INFO ] [MAIN ] OMC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:43:59.737143] [DEBUG] [LOCAL ] OMC: No existing data file found in primary storage. [2025-10-02T20:43:59.737183] [WARN ] [MAIN ] OMC: No existing data found, performing full refresh instead. [2025-10-02T20:43:59.737298] [INFO ] [MAIN ] OMC: Wiping existing primary data before full refresh. [2025-10-02T20:43:59.737376] [INFO ] [LOCAL ] OMC: Starting deletion of primary data. [2025-10-02T20:43:59.737458] [DEBUG] [LOCAL ] OMC: No primary data file found to delete. [2025-10-02T20:43:59.737525] [INFO ] [MAIN ] OMC: Starting full primary refresh. [2025-10-02T20:44:00.126082] [INFO ] [REMOTE ] OMC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:44:00.261449] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-02T20:44:00.272958] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-06. [2025-10-02T20:44:00.680763] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-02T20:44:01.073006] [INFO ] [REMOTE ] OMC: Fetching primary data for 2024-12. [2025-10-02T20:44:01.873014] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-08. [2025-10-02T20:44:02.673000] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-04. [2025-10-02T20:44:03.091247] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-02T20:44:03.139351] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-06 (2.87 seconds). [2025-10-02T20:44:03.468073] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-02T20:44:03.478525] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-01. [2025-10-02T20:44:03.565686] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-02T20:44:04.273018] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-09. [2025-10-02T20:44:05.073055] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-05. [2025-10-02T20:44:05.385742] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-02T20:44:05.797472] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-02T20:44:05.872999] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-02. [2025-10-02T20:44:05.928129] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-02T20:44:06.673026] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-06. [2025-10-02T20:44:07.473015] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-10. [2025-10-02T20:44:07.600717] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-02T20:44:07.680996] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-02T20:44:08.273006] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-07. [2025-10-02T20:44:08.981720] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-02T20:44:08.984418] [INFO ] [REMOTE ] OLN: Full fetch complete (74654 records). [2025-10-02T20:44:08.984633] [DEBUG] [VALIDATOR ] OLN: Validating primary data. [2025-10-02T20:44:09.080461] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-07. [2025-10-02T20:44:09.224002] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-02T20:44:09.452837] [DEBUG] [VALIDATOR ] OLN: All expected trading days are present. [2025-10-02T20:44:09.452930] [DEBUG] [VALIDATOR ] OLN: Primary data validation passed. [2025-10-02T20:44:09.454106] [INFO ] [MAIN ] OLN: Fetched primary data is valid. [2025-10-02T20:44:09.454176] [DEBUG] [LOCAL ] OLN: Saving primary data. [2025-10-02T20:44:09.455893] [DEBUG] [LOCAL ] OLN: Trimmed 74654 records to 52160 (keeping 200 days of data) [2025-10-02T20:44:09.809851] [DEBUG] [LOCAL ] OLN: Primary data saved (52160 records). [2025-10-02T20:44:09.810040] [INFO ] [MAIN ] OLN: Full history saved. [2025-10-02T20:44:09.810130] [INFO ] [MAIN ] Update Progress: 1589/2370 symbols completed. OLN took 33.6s. Estimated remaining: 1h 50m 9s. Rate: 7.1 symbols/min [2025-10-02T20:44:09.882047] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-03. [2025-10-02T20:44:10.015546] [INFO ] [MAIN ] OMF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:44:10.015753] [DEBUG] [LOCAL ] OMF: No existing data file found in primary storage. [2025-10-02T20:44:10.015803] [WARN ] [MAIN ] OMF: No existing data found, performing full refresh instead. [2025-10-02T20:44:10.015965] [INFO ] [MAIN ] OMF: Wiping existing primary data before full refresh. [2025-10-02T20:44:10.016016] [INFO ] [LOCAL ] OMF: Starting deletion of primary data. [2025-10-02T20:44:10.016061] [DEBUG] [LOCAL ] OMF: No primary data file found to delete. [2025-10-02T20:44:10.016096] [INFO ] [MAIN ] OMF: Starting full primary refresh. [2025-10-02T20:44:10.407194] [INFO ] [REMOTE ] OMF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:44:10.673043] [INFO ] [REMOTE ] OMF: Fetching primary data for 2024-12. [2025-10-02T20:44:11.473052] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-08. [2025-10-02T20:44:11.830746] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-07 (2.75 seconds). [2025-10-02T20:44:11.996107] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-02T20:44:12.183140] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-02T20:44:12.273007] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-04. [2025-10-02T20:44:12.420323] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-02T20:44:13.073039] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-01. [2025-10-02T20:44:13.872989] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-08. [2025-10-02T20:44:14.258250] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-02T20:44:14.672975] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-05. [2025-10-02T20:44:14.828894] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-02T20:44:15.473040] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-02. [2025-10-02T20:44:16.273022] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-09. [2025-10-02T20:44:16.595460] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-02T20:44:16.642112] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-08 (2.77 seconds). [2025-10-02T20:44:16.721057] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-02T20:44:17.072995] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-03. [2025-10-02T20:44:17.144870] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-02T20:44:17.873051] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-06. [2025-10-02T20:44:18.673059] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-10. [2025-10-02T20:44:18.921663] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-02T20:44:19.246066] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-02T20:44:19.247099] [INFO ] [REMOTE ] OLP: Full fetch complete (14149 records). [2025-10-02T20:44:19.247178] [DEBUG] [VALIDATOR ] OLP: Validating primary data. [2025-10-02T20:44:19.478774] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-09. [2025-10-02T20:44:19.687374] [DEBUG] [VALIDATOR ] OLP: All expected trading days are present. [2025-10-02T20:44:19.687543] [DEBUG] [VALIDATOR ] OLP: Primary data validation passed. [2025-10-02T20:44:19.688106] [INFO ] [MAIN ] OLP: Fetched primary data is valid. [2025-10-02T20:44:19.688218] [DEBUG] [LOCAL ] OLP: Saving primary data. [2025-10-02T20:44:19.689011] [DEBUG] [LOCAL ] OLP: Trimmed 14149 records to 9962 (keeping 200 days of data) [2025-10-02T20:44:19.782130] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-02T20:44:19.800563] [DEBUG] [LOCAL ] OLP: Primary data saved (9962 records). [2025-10-02T20:44:19.800766] [INFO ] [MAIN ] OLP: Full history saved. [2025-10-02T20:44:19.800865] [INFO ] [MAIN ] Update Progress: 1590/2370 symbols completed. OLP took 29.7s. Estimated remaining: 1h 50m 1s. Rate: 7.1 symbols/min [2025-10-02T20:44:19.995622] [INFO ] [MAIN ] OMI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:44:19.995851] [DEBUG] [LOCAL ] OMI: No existing data file found in primary storage. [2025-10-02T20:44:19.995908] [WARN ] [MAIN ] OMI: No existing data found, performing full refresh instead. [2025-10-02T20:44:19.996022] [INFO ] [MAIN ] OMI: Wiping existing primary data before full refresh. [2025-10-02T20:44:19.996064] [INFO ] [LOCAL ] OMI: Starting deletion of primary data. [2025-10-02T20:44:19.996108] [DEBUG] [LOCAL ] OMI: No primary data file found to delete. [2025-10-02T20:44:19.996142] [INFO ] [MAIN ] OMI: Starting full primary refresh. [2025-10-02T20:44:20.278123] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-04. [2025-10-02T20:44:20.394771] [INFO ] [REMOTE ] OMI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:44:21.073084] [INFO ] [REMOTE ] OMI: Fetching primary data for 2024-12. [2025-10-02T20:44:21.873068] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-07. [2025-10-02T20:44:22.127262] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-09 (2.65 seconds). [2025-10-02T20:44:22.228143] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-02T20:44:22.484039] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-02T20:44:22.672995] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-01. [2025-10-02T20:44:23.473017] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-10. [2025-10-02T20:44:23.744745] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-10 (0.27 seconds). [2025-10-02T20:44:23.746605] [INFO ] [REMOTE ] OKLO: Full fetch complete (77603 records). [2025-10-02T20:44:23.746897] [DEBUG] [VALIDATOR ] OKLO: Validating primary data. [2025-10-02T20:44:23.748571] [FATAL] [VALIDATOR ] OKLO: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T20:44:23.749071] [FATAL] [MAIN ] OKLO: Fetched primary data is invalid. Refusing to save it. [2025-10-02T20:44:23.749168] [WARN ] [MAIN ] OKLO: Deleting existing primary and derivative data due to validation failure. [2025-10-02T20:44:23.749254] [INFO ] [LOCAL ] OKLO: Starting deletion of primary data. [2025-10-02T20:44:23.749353] [DEBUG] [LOCAL ] OKLO: No primary data file found to delete. [2025-10-02T20:44:23.749430] [INFO ] [LOCAL ] OKLO: Starting deletion of derivative data. [2025-10-02T20:44:23.749580] [DEBUG] [LOCAL ] OKLO: No derivative data file found to delete. [2025-10-02T20:44:23.749706] [INFO ] [MAIN ] Update Progress: 1591/2370 symbols completed. OKLO took 48.3s. Estimated remaining: 1h 49m 50s. Rate: 7.1 symbols/min [2025-10-02T20:44:23.942408] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-02T20:44:24.014137] [INFO ] [MAIN ] ONIT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:44:24.014366] [DEBUG] [LOCAL ] ONIT: No existing data file found in primary storage. [2025-10-02T20:44:24.014447] [WARN ] [MAIN ] ONIT: No existing data found, performing full refresh instead. [2025-10-02T20:44:24.014601] [INFO ] [MAIN ] ONIT: Wiping existing primary data before full refresh. [2025-10-02T20:44:24.015337] [INFO ] [LOCAL ] ONIT: Starting deletion of primary data. [2025-10-02T20:44:24.015441] [DEBUG] [LOCAL ] ONIT: No primary data file found to delete. [2025-10-02T20:44:24.015726] [INFO ] [MAIN ] ONIT: Starting full primary refresh. [2025-10-02T20:44:24.281776] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-08. [2025-10-02T20:44:24.343265] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-02T20:44:24.452815] [INFO ] [REMOTE ] ONIT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:44:25.072992] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-02. [2025-10-02T20:44:25.873038] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2024-12. [2025-10-02T20:44:26.277617] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-02T20:44:26.672978] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-09. [2025-10-02T20:44:26.772542] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-02T20:44:26.810690] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-02T20:44:27.473065] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-03. [2025-10-02T20:44:28.273004] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-05. [2025-10-02T20:44:28.622719] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-02T20:44:28.924564] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-02T20:44:29.073044] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-10. [2025-10-02T20:44:29.873007] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-01. [2025-10-02T20:44:30.295420] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-02T20:44:30.500153] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-02T20:44:30.502339] [INFO ] [REMOTE ] OMC: Full fetch complete (76984 records). [2025-10-02T20:44:30.502455] [DEBUG] [VALIDATOR ] OMC: Validating primary data. [2025-10-02T20:44:30.676976] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-04. [2025-10-02T20:44:30.763804] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-02T20:44:30.940583] [DEBUG] [VALIDATOR ] OMC: All expected trading days are present. [2025-10-02T20:44:30.940700] [DEBUG] [VALIDATOR ] OMC: Primary data validation passed. [2025-10-02T20:44:30.941771] [INFO ] [MAIN ] OMC: Fetched primary data is valid. [2025-10-02T20:44:30.941835] [DEBUG] [LOCAL ] OMC: Saving primary data. [2025-10-02T20:44:30.943313] [DEBUG] [LOCAL ] OMC: Trimmed 76984 records to 53679 (keeping 200 days of data) [2025-10-02T20:44:31.299539] [DEBUG] [LOCAL ] OMC: Primary data saved (53679 records). [2025-10-02T20:44:31.299718] [INFO ] [MAIN ] OMC: Full history saved. [2025-10-02T20:44:31.299827] [INFO ] [MAIN ] Update Progress: 1592/2370 symbols completed. OMC took 31.7s. Estimated remaining: 1h 49m 41s. Rate: 7.1 symbols/min [2025-10-02T20:44:31.480825] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-06. [2025-10-02T20:44:31.483582] [INFO ] [MAIN ] ONL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:44:31.484673] [DEBUG] [LOCAL ] ONL: No existing data file found in primary storage. [2025-10-02T20:44:31.484731] [WARN ] [MAIN ] ONL: No existing data found, performing full refresh instead. [2025-10-02T20:44:31.484837] [INFO ] [MAIN ] ONL: Wiping existing primary data before full refresh. [2025-10-02T20:44:31.484889] [INFO ] [LOCAL ] ONL: Starting deletion of primary data. [2025-10-02T20:44:31.484981] [DEBUG] [LOCAL ] ONL: No primary data file found to delete. [2025-10-02T20:44:31.485030] [INFO ] [MAIN ] ONL: Starting full primary refresh. [2025-10-02T20:44:31.891059] [INFO ] [REMOTE ] ONL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:44:32.272994] [INFO ] [REMOTE ] ONL: Fetching primary data for 2024-12. [2025-10-02T20:44:32.621423] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-02T20:44:33.072990] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-02. [2025-10-02T20:44:33.232862] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-02T20:44:33.300703] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-02T20:44:33.698275] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-02T20:44:33.873000] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-03. [2025-10-02T20:44:34.672974] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-01. [2025-10-02T20:44:34.868312] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-02T20:44:35.473006] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-04. [2025-10-02T20:44:36.024177] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-02T20:44:36.273021] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-07. [2025-10-02T20:44:36.304005] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-02T20:44:37.073040] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-05. [2025-10-02T20:44:37.873015] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-02. [2025-10-02T20:44:38.104238] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-02T20:44:38.672968] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-08. [2025-10-02T20:44:38.761321] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-02T20:44:39.010977] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-02T20:44:39.473009] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-03. [2025-10-02T20:44:40.272986] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-05. [2025-10-02T20:44:40.394524] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-02T20:44:41.066191] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-02T20:44:41.074505] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-09. [2025-10-02T20:44:41.133750] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-02T20:44:41.873024] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-06. [2025-10-02T20:44:42.672968] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-06. [2025-10-02T20:44:42.745823] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-02T20:44:43.429675] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-02T20:44:43.473023] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-10. [2025-10-02T20:44:43.490873] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-02T20:44:44.273023] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-07. [2025-10-02T20:44:44.585110] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-02T20:44:44.587248] [INFO ] [REMOTE ] OMF: Full fetch complete (66929 records). [2025-10-02T20:44:44.587432] [DEBUG] [VALIDATOR ] OMF: Validating primary data. [2025-10-02T20:44:45.012328] [DEBUG] [VALIDATOR ] OMF: All expected trading days are present. [2025-10-02T20:44:45.012424] [DEBUG] [VALIDATOR ] OMF: Primary data validation passed. [2025-10-02T20:44:45.013518] [INFO ] [MAIN ] OMF: Fetched primary data is valid. [2025-10-02T20:44:45.013633] [DEBUG] [LOCAL ] OMF: Saving primary data. [2025-10-02T20:44:45.016432] [DEBUG] [LOCAL ] OMF: Trimmed 66929 records to 46561 (keeping 200 days of data) [2025-10-02T20:44:45.079824] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-04. [2025-10-02T20:44:45.321505] [DEBUG] [LOCAL ] OMF: Primary data saved (46561 records). [2025-10-02T20:44:45.321667] [INFO ] [MAIN ] OMF: Full history saved. [2025-10-02T20:44:45.321787] [INFO ] [MAIN ] Update Progress: 1593/2370 symbols completed. OMF took 35.5s. Estimated remaining: 1h 49m 36s. Rate: 7.1 symbols/min [2025-10-02T20:44:45.542031] [INFO ] [MAIN ] ONON: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:44:45.542454] [DEBUG] [LOCAL ] ONON: No existing data file found in primary storage. [2025-10-02T20:44:45.542544] [WARN ] [MAIN ] ONON: No existing data found, performing full refresh instead. [2025-10-02T20:44:45.542685] [INFO ] [MAIN ] ONON: Wiping existing primary data before full refresh. [2025-10-02T20:44:45.542743] [INFO ] [LOCAL ] ONON: Starting deletion of primary data. [2025-10-02T20:44:45.542791] [DEBUG] [LOCAL ] ONON: No primary data file found to delete. [2025-10-02T20:44:45.542828] [INFO ] [MAIN ] ONON: Starting full primary refresh. [2025-10-02T20:44:45.876540] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-07. [2025-10-02T20:44:45.965708] [INFO ] [REMOTE ] ONON: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:44:45.991995] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-02T20:44:46.409412] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-02T20:44:46.672990] [INFO ] [REMOTE ] ONON: Fetching primary data for 2024-12. [2025-10-02T20:44:46.702831] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-02T20:44:47.473029] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-08. [2025-10-02T20:44:48.147924] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-02T20:44:48.272970] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-05. [2025-10-02T20:44:48.713216] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-02T20:44:49.073017] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-01. [2025-10-02T20:44:49.416274] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-02T20:44:49.872996] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-09. [2025-10-02T20:44:50.498095] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-02T20:44:50.673027] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-08. [2025-10-02T20:44:51.231578] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-02T20:44:51.472992] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-10. [2025-10-02T20:44:52.039109] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-02T20:44:52.039972] [INFO ] [REMOTE ] ONIT: Full fetch complete (11080 records). [2025-10-02T20:44:52.040079] [DEBUG] [VALIDATOR ] ONIT: Validating primary data. [2025-10-02T20:44:52.283054] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-02. [2025-10-02T20:44:52.456149] [DEBUG] [VALIDATOR ] ONIT: All expected trading days are present. [2025-10-02T20:44:52.456250] [DEBUG] [VALIDATOR ] ONIT: Primary data validation passed. [2025-10-02T20:44:52.456686] [INFO ] [MAIN ] ONIT: Fetched primary data is valid. [2025-10-02T20:44:52.456908] [DEBUG] [LOCAL ] ONIT: Saving primary data. [2025-10-02T20:44:52.457575] [DEBUG] [LOCAL ] ONIT: Trimmed 11080 records to 7761 (keeping 200 days of data) [2025-10-02T20:44:52.525225] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-02T20:44:52.550342] [DEBUG] [LOCAL ] ONIT: Primary data saved (7761 records). [2025-10-02T20:44:52.550487] [INFO ] [MAIN ] ONIT: Full history saved. [2025-10-02T20:44:52.550562] [INFO ] [MAIN ] Update Progress: 1594/2370 symbols completed. ONIT took 28.8s. Estimated remaining: 1h 49m 27s. Rate: 7.1 symbols/min [2025-10-02T20:44:52.729256] [INFO ] [MAIN ] ONTF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:44:52.729504] [DEBUG] [LOCAL ] ONTF: No existing data file found in primary storage. [2025-10-02T20:44:52.729564] [WARN ] [MAIN ] ONTF: No existing data found, performing full refresh instead. [2025-10-02T20:44:52.729718] [INFO ] [MAIN ] ONTF: Wiping existing primary data before full refresh. [2025-10-02T20:44:52.729781] [INFO ] [LOCAL ] ONTF: Starting deletion of primary data. [2025-10-02T20:44:52.729851] [DEBUG] [LOCAL ] ONTF: No primary data file found to delete. [2025-10-02T20:44:52.729890] [INFO ] [MAIN ] ONTF: Starting full primary refresh. [2025-10-02T20:44:53.078400] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-06. [2025-10-02T20:44:53.122588] [INFO ] [REMOTE ] ONTF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:44:53.872976] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2024-12. [2025-10-02T20:44:54.062744] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-02T20:44:54.645357] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-02T20:44:54.672971] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-07. [2025-10-02T20:44:55.207270] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-02T20:44:55.473003] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-03. [2025-10-02T20:44:56.136497] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-02T20:44:56.273002] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-09. [2025-10-02T20:44:57.072995] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-01. [2025-10-02T20:44:57.755266] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-02T20:44:57.798447] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-02T20:44:57.872976] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-04. [2025-10-02T20:44:58.195763] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-02T20:44:58.673039] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-02. [2025-10-02T20:44:59.473002] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-10. [2025-10-02T20:44:59.738018] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-02T20:44:59.960279] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-02T20:45:00.273039] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-05. [2025-10-02T20:45:00.849773] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-02T20:45:00.853018] [INFO ] [REMOTE ] OMI: Full fetch complete (64476 records). [2025-10-02T20:45:00.853140] [DEBUG] [VALIDATOR ] OMI: Validating primary data. [2025-10-02T20:45:01.078114] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-08. [2025-10-02T20:45:01.293563] [DEBUG] [VALIDATOR ] OMI: All expected trading days are present. [2025-10-02T20:45:01.293682] [DEBUG] [VALIDATOR ] OMI: Primary data validation passed. [2025-10-02T20:45:01.294631] [INFO ] [MAIN ] OMI: Fetched primary data is valid. [2025-10-02T20:45:01.294752] [DEBUG] [LOCAL ] OMI: Saving primary data. [2025-10-02T20:45:01.296603] [DEBUG] [LOCAL ] OMI: Trimmed 64476 records to 46195 (keeping 200 days of data) [2025-10-02T20:45:01.579441] [DEBUG] [LOCAL ] OMI: Primary data saved (46195 records). [2025-10-02T20:45:01.579583] [INFO ] [MAIN ] OMI: Full history saved. [2025-10-02T20:45:01.579680] [INFO ] [MAIN ] Update Progress: 1595/2370 symbols completed. OMI took 41.8s. Estimated remaining: 1h 49m 18s. Rate: 7.1 symbols/min [2025-10-02T20:45:01.767409] [INFO ] [MAIN ] ONTO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:45:01.767639] [DEBUG] [LOCAL ] ONTO: No existing data file found in primary storage. [2025-10-02T20:45:01.767718] [WARN ] [MAIN ] ONTO: No existing data found, performing full refresh instead. [2025-10-02T20:45:01.767840] [INFO ] [MAIN ] ONTO: Wiping existing primary data before full refresh. [2025-10-02T20:45:01.767894] [INFO ] [LOCAL ] ONTO: Starting deletion of primary data. [2025-10-02T20:45:01.767965] [DEBUG] [LOCAL ] ONTO: No primary data file found to delete. [2025-10-02T20:45:01.768016] [INFO ] [MAIN ] ONTO: Starting full primary refresh. [2025-10-02T20:45:01.884969] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-03. [2025-10-02T20:45:02.224222] [INFO ] [REMOTE ] ONTO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:45:02.559721] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-10-02T20:45:02.673010] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2024-12. [2025-10-02T20:45:02.745493] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-02T20:45:02.896617] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-02T20:45:03.473061] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-06. [2025-10-02T20:45:04.272983] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-04. [2025-10-02T20:45:04.488823] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-02T20:45:05.073043] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-09. [2025-10-02T20:45:05.242761] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-02T20:45:05.368822] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-02T20:45:05.873043] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-05. [2025-10-02T20:45:05.921480] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-02T20:45:06.672969] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-07. [2025-10-02T20:45:06.762407] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-02T20:45:07.473038] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-01. [2025-10-02T20:45:08.273050] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-06. [2025-10-02T20:45:08.957511] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-02T20:45:09.073009] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-08. [2025-10-02T20:45:09.221247] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-02T20:45:09.530665] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-02T20:45:09.873046] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-02. [2025-10-02T20:45:10.673053] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-10. [2025-10-02T20:45:11.410899] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-02T20:45:11.412782] [INFO ] [REMOTE ] ONL: Full fetch complete (43186 records). [2025-10-02T20:45:11.412900] [DEBUG] [VALIDATOR ] ONL: Validating primary data. [2025-10-02T20:45:11.476149] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-07. [2025-10-02T20:45:11.763311] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-02T20:45:11.944918] [DEBUG] [VALIDATOR ] ONL: All expected trading days are present. [2025-10-02T20:45:11.945059] [DEBUG] [VALIDATOR ] ONL: Primary data validation passed. [2025-10-02T20:45:11.946127] [INFO ] [MAIN ] ONL: Fetched primary data is valid. [2025-10-02T20:45:11.946212] [DEBUG] [LOCAL ] ONL: Saving primary data. [2025-10-02T20:45:11.948763] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-08 (2.88 seconds). [2025-10-02T20:45:11.961167] [DEBUG] [LOCAL ] ONL: Trimmed 43186 records to 30689 (keeping 200 days of data) [2025-10-02T20:45:12.164740] [DEBUG] [LOCAL ] ONL: Primary data saved (30689 records). [2025-10-02T20:45:12.164944] [INFO ] [MAIN ] ONL: Full history saved. [2025-10-02T20:45:12.165032] [INFO ] [MAIN ] Update Progress: 1596/2370 symbols completed. ONL took 40.9s. Estimated remaining: 1h 49m 11s. Rate: 7.1 symbols/min [2025-10-02T20:45:12.278099] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-03. [2025-10-02T20:45:12.351243] [INFO ] [MAIN ] OOMA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:45:12.351399] [DEBUG] [LOCAL ] OOMA: No existing data file found in primary storage. [2025-10-02T20:45:12.351485] [WARN ] [MAIN ] OOMA: No existing data found, performing full refresh instead. [2025-10-02T20:45:12.351759] [INFO ] [MAIN ] OOMA: Wiping existing primary data before full refresh. [2025-10-02T20:45:12.351820] [INFO ] [LOCAL ] OOMA: Starting deletion of primary data. [2025-10-02T20:45:12.351880] [DEBUG] [LOCAL ] OOMA: No primary data file found to delete. [2025-10-02T20:45:12.351928] [INFO ] [MAIN ] OOMA: Starting full primary refresh. [2025-10-02T20:45:12.773281] [INFO ] [REMOTE ] OOMA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:45:12.881181] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-02T20:45:13.073033] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2024-12. [2025-10-02T20:45:13.872980] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-09. [2025-10-02T20:45:14.108258] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-02T20:45:14.185153] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-02T20:45:14.672997] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-04. [2025-10-02T20:45:15.473042] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-08. [2025-10-02T20:45:15.744323] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-02T20:45:16.272999] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-10. [2025-10-02T20:45:16.483680] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-02T20:45:16.665094] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-02T20:45:17.073007] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-09. [2025-10-02T20:45:17.873001] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-01. [2025-10-02T20:45:17.922623] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-02T20:45:17.924917] [INFO ] [REMOTE ] ONON: Full fetch complete (77579 records). [2025-10-02T20:45:17.925074] [DEBUG] [VALIDATOR ] ONON: Validating primary data. [2025-10-02T20:45:18.391437] [DEBUG] [VALIDATOR ] ONON: All expected trading days are present. [2025-10-02T20:45:18.391711] [DEBUG] [VALIDATOR ] ONON: Primary data validation passed. [2025-10-02T20:45:18.392953] [INFO ] [MAIN ] ONON: Fetched primary data is valid. [2025-10-02T20:45:18.393047] [DEBUG] [LOCAL ] ONON: Saving primary data. [2025-10-02T20:45:18.410879] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-02T20:45:18.417428] [DEBUG] [LOCAL ] ONON: Trimmed 77579 records to 54003 (keeping 200 days of data) [2025-10-02T20:45:18.672983] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-10. [2025-10-02T20:45:18.768468] [DEBUG] [LOCAL ] ONON: Primary data saved (54003 records). [2025-10-02T20:45:18.768670] [INFO ] [MAIN ] ONON: Full history saved. [2025-10-02T20:45:18.768810] [INFO ] [MAIN ] Update Progress: 1597/2370 symbols completed. ONON took 33.4s. Estimated remaining: 1h 49m 2s. Rate: 7.1 symbols/min [2025-10-02T20:45:18.892271] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-02T20:45:19.441563] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-02T20:45:19.442914] [INFO ] [REMOTE ] ONTF: Full fetch complete (31606 records). [2025-10-02T20:45:19.442999] [DEBUG] [VALIDATOR ] ONTF: Validating primary data. [2025-10-02T20:45:19.479020] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-02. [2025-10-02T20:45:19.909603] [DEBUG] [VALIDATOR ] ONTF: All expected trading days are present. [2025-10-02T20:45:19.909732] [DEBUG] [VALIDATOR ] ONTF: Primary data validation passed. [2025-10-02T20:45:19.910513] [INFO ] [MAIN ] ONTF: Fetched primary data is valid. [2025-10-02T20:45:19.910569] [DEBUG] [LOCAL ] ONTF: Saving primary data. [2025-10-02T20:45:19.911693] [DEBUG] [LOCAL ] ONTF: Trimmed 31606 records to 22684 (keeping 200 days of data) [2025-10-02T20:45:20.044480] [DEBUG] [LOCAL ] ONTF: Primary data saved (22684 records). [2025-10-02T20:45:20.044661] [INFO ] [MAIN ] ONTF: Full history saved. [2025-10-02T20:45:20.044783] [INFO ] [MAIN ] Update Progress: 1598/2370 symbols completed. ONTF took 27.5s. Estimated remaining: 1h 48m 50s. Rate: 7.1 symbols/min [2025-10-02T20:45:20.273032] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-05. [2025-10-02T20:45:20.470294] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-02T20:45:21.073007] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-03. [2025-10-02T20:45:21.867621] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-02T20:45:21.879388] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-06. [2025-10-02T20:45:21.894366] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-02T20:45:22.673058] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-04. [2025-10-02T20:45:23.533270] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-02T20:45:23.538325] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-05. [2025-10-02T20:45:23.753160] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-02T20:45:24.273052] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-07. [2025-10-02T20:45:24.534535] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-02T20:45:25.073042] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-06. [2025-10-02T20:45:26.204790] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-02T20:45:26.225064] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-08. [2025-10-02T20:45:26.235463] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-02T20:45:26.673039] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-07. [2025-10-02T20:45:27.813121] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-02T20:45:27.818440] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-08. [2025-10-02T20:45:27.894441] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-02T20:45:28.273048] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-09. [2025-10-02T20:45:28.938759] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-02T20:45:29.073052] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-09. [2025-10-02T20:45:29.982272] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-02T20:45:29.987709] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-10. [2025-10-02T20:45:30.251920] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-02T20:45:30.673079] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-10. [2025-10-02T20:45:30.829974] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-02T20:45:30.831570] [INFO ] [REMOTE ] OOMA: Full fetch complete (25906 records). [2025-10-02T20:45:30.831773] [DEBUG] [VALIDATOR ] OOMA: Validating primary data. [2025-10-02T20:45:31.292039] [DEBUG] [VALIDATOR ] OOMA: All expected trading days are present. [2025-10-02T20:45:31.292130] [DEBUG] [VALIDATOR ] OOMA: Primary data validation passed. [2025-10-02T20:45:31.292784] [INFO ] [MAIN ] OOMA: Fetched primary data is valid. [2025-10-02T20:45:31.292854] [DEBUG] [LOCAL ] OOMA: Saving primary data. [2025-10-02T20:45:31.293776] [DEBUG] [LOCAL ] OOMA: Trimmed 25906 records to 18967 (keeping 200 days of data) [2025-10-02T20:45:31.422614] [DEBUG] [LOCAL ] OOMA: Primary data saved (18967 records). [2025-10-02T20:45:31.422790] [INFO ] [MAIN ] OOMA: Full history saved. [2025-10-02T20:45:31.422887] [INFO ] [MAIN ] Update Progress: 1599/2370 symbols completed. OOMA took 19.3s. Estimated remaining: 1h 48m 43s. Rate: 7.1 symbols/min [2025-10-02T20:45:32.167555] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-02T20:45:32.169549] [INFO ] [REMOTE ] ONTO: Full fetch complete (66082 records). [2025-10-02T20:45:32.169677] [DEBUG] [VALIDATOR ] ONTO: Validating primary data. [2025-10-02T20:45:32.616636] [DEBUG] [VALIDATOR ] ONTO: All expected trading days are present. [2025-10-02T20:45:32.616767] [DEBUG] [VALIDATOR ] ONTO: Primary data validation passed. [2025-10-02T20:45:32.617879] [INFO ] [MAIN ] ONTO: Fetched primary data is valid. [2025-10-02T20:45:32.617947] [DEBUG] [LOCAL ] ONTO: Saving primary data. [2025-10-02T20:45:32.619413] [DEBUG] [LOCAL ] ONTO: Trimmed 66082 records to 47013 (keeping 200 days of data) [2025-10-02T20:45:32.911091] [DEBUG] [LOCAL ] ONTO: Primary data saved (47013 records). [2025-10-02T20:45:32.911237] [INFO ] [MAIN ] ONTO: Full history saved. [2025-10-02T20:45:32.911313] [INFO ] [MAIN ] Update Progress: 1600/2370 symbols completed. ONTO took 31.3s. Estimated remaining: 1h 48m 31s. Rate: 7.1 symbols/min [2025-10-02T20:45:33.619710] [INFO ] [MAIN ] OPAD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:45:33.710022] [DEBUG] [LOCAL ] OPAD: No existing data file found in primary storage. [2025-10-02T20:45:33.696850] [INFO ] [MAIN ] OPFI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:45:33.776279] [INFO ] [MAIN ] OPY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:45:33.780674] [DEBUG] [LOCAL ] OPFI: No existing data file found in primary storage. [2025-10-02T20:45:33.780432] [INFO ] [MAIN ] OPP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:45:33.781173] [DEBUG] [LOCAL ] OPY: No existing data file found in primary storage. [2025-10-02T20:45:33.781510] [DEBUG] [LOCAL ] OPP: No existing data file found in primary storage. [2025-10-02T20:45:33.781275] [WARN ] [MAIN ] OPFI: No existing data found, performing full refresh instead. [2025-10-02T20:45:33.781774] [WARN ] [MAIN ] OPP: No existing data found, performing full refresh instead. [2025-10-02T20:45:33.781588] [WARN ] [MAIN ] OPY: No existing data found, performing full refresh instead. [2025-10-02T20:45:33.781962] [INFO ] [MAIN ] OPFI: Wiping existing primary data before full refresh. [2025-10-02T20:45:33.782273] [INFO ] [MAIN ] OPP: Wiping existing primary data before full refresh. [2025-10-02T20:45:33.782543] [INFO ] [LOCAL ] OPFI: Starting deletion of primary data. [2025-10-02T20:45:33.782465] [INFO ] [LOCAL ] OPP: Starting deletion of primary data. [2025-10-02T20:45:33.781427] [WARN ] [MAIN ] OPAD: No existing data found, performing full refresh instead. [2025-10-02T20:45:33.782927] [DEBUG] [LOCAL ] OPP: No primary data file found to delete. [2025-10-02T20:45:33.783183] [DEBUG] [LOCAL ] OPFI: No primary data file found to delete. [2025-10-02T20:45:33.783527] [INFO ] [MAIN ] OPAD: Wiping existing primary data before full refresh. [2025-10-02T20:45:33.782757] [INFO ] [MAIN ] OPY: Wiping existing primary data before full refresh. [2025-10-02T20:45:33.783284] [INFO ] [MAIN ] OPP: Starting full primary refresh. [2025-10-02T20:45:33.783764] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-10-02T20:45:33.783874] [INFO ] [MAIN ] OPFI: Starting full primary refresh. [2025-10-02T20:45:33.783948] [INFO ] [LOCAL ] OPAD: Starting deletion of primary data. [2025-10-02T20:45:33.789413] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-10-02T20:45:33.796176] [DEBUG] [LOCAL ] OPAD: No primary data file found to delete. [2025-10-02T20:45:33.840525] [INFO ] [MAIN ] OPY: Starting full primary refresh. [2025-10-02T20:45:33.840634] [INFO ] [MAIN ] OPAD: Starting full primary refresh. [2025-10-02T20:45:35.446635] [INFO ] [REMOTE ] OPP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:45:35.436728] [INFO ] [REMOTE ] OPY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:45:35.476233] [INFO ] [REMOTE ] OPP: Fetching primary data for 2024-12. [2025-10-02T20:45:35.518909] [INFO ] [REMOTE ] OPFI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:45:35.525838] [INFO ] [REMOTE ] OPAD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:45:35.515416] [INFO ] [REMOTE ] OPY: Fetching primary data for 2024-12. [2025-10-02T20:45:35.526146] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2024-12. [2025-10-02T20:45:35.526952] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2024-12. [2025-10-02T20:45:36.391075] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-02T20:45:36.399846] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-01. [2025-10-02T20:45:36.401461] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-02T20:45:36.404407] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-01. [2025-10-02T20:45:36.763874] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-02T20:45:36.772181] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-01. [2025-10-02T20:45:36.785148] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-02T20:45:36.916128] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-02T20:45:37.073017] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-01. [2025-10-02T20:45:37.333013] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-02T20:45:37.872983] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-02. [2025-10-02T20:45:37.963404] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-02T20:45:38.376701] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-02T20:45:38.672962] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-03. [2025-10-02T20:45:38.775825] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-02T20:45:39.435271] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-02T20:45:39.473018] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-02. [2025-10-02T20:45:40.176286] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-02T20:45:40.273033] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-04. [2025-10-02T20:45:41.073035] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-02. [2025-10-02T20:45:41.163765] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-02T20:45:41.873027] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-05. [2025-10-02T20:45:42.593358] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-02T20:45:42.672980] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-02. [2025-10-02T20:45:43.169701] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-02T20:45:43.288104] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-02T20:45:43.473041] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-03. [2025-10-02T20:45:44.273006] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-03. [2025-10-02T20:45:44.411912] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-02T20:45:45.073036] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-06. [2025-10-02T20:45:45.872975] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-03. [2025-10-02T20:45:45.931758] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-02T20:45:46.296993] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-02T20:45:46.651040] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-02T20:45:46.672977] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-04. [2025-10-02T20:45:47.472995] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-04. [2025-10-02T20:45:47.555494] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-02T20:45:48.272994] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-04. [2025-10-02T20:45:49.008920] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-02T20:45:49.042532] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-02T20:45:49.072977] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-05. [2025-10-02T20:45:49.872990] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-05. [2025-10-02T20:45:49.934162] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-02T20:45:50.672989] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-07. [2025-10-02T20:45:51.330109] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-02T20:45:51.473011] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-06. [2025-10-02T20:45:51.873761] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-02T20:45:52.273001] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-05. [2025-10-02T20:45:53.003864] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-02T20:45:53.072986] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-08. [2025-10-02T20:45:53.229627] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-02T20:45:53.873010] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-07. [2025-10-02T20:45:54.672963] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-06. [2025-10-02T20:45:55.192462] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-02T20:45:55.473017] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-09. [2025-10-02T20:45:55.563636] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-02T20:45:55.770710] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-02T20:45:56.272995] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-06. [2025-10-02T20:45:57.072975] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-07. [2025-10-02T20:45:57.156850] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-02T20:45:57.734837] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-02T20:45:57.846933] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-10-02T20:45:57.872972] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-08. [2025-10-02T20:45:58.673039] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-10. [2025-10-02T20:45:59.434220] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-02T20:45:59.473029] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-09. [2025-10-02T20:46:00.273008] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-07. [2025-10-02T20:46:00.687692] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-02T20:46:00.689773] [INFO ] [REMOTE ] OPAD: Full fetch complete (25073 records). [2025-10-02T20:46:00.689896] [DEBUG] [VALIDATOR ] OPAD: Validating primary data. [2025-10-02T20:46:01.043082] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-02T20:46:01.077179] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-08. [2025-10-02T20:46:01.134299] [DEBUG] [VALIDATOR ] OPAD: All expected trading days are present. [2025-10-02T20:46:01.134689] [DEBUG] [VALIDATOR ] OPAD: Primary data validation passed. [2025-10-02T20:46:01.135481] [INFO ] [MAIN ] OPAD: Fetched primary data is valid. [2025-10-02T20:46:01.135561] [DEBUG] [LOCAL ] OPAD: Saving primary data. [2025-10-02T20:46:01.136625] [DEBUG] [LOCAL ] OPAD: Trimmed 25073 records to 22121 (keeping 200 days of data) [2025-10-02T20:46:01.271787] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-02T20:46:01.310518] [DEBUG] [LOCAL ] OPAD: Primary data saved (22121 records). [2025-10-02T20:46:01.310724] [INFO ] [MAIN ] OPAD: Full history saved. [2025-10-02T20:46:01.310813] [INFO ] [MAIN ] Update Progress: 1601/2370 symbols completed. OPAD took 28.4s. Estimated remaining: 1h 48m 32s. Rate: 7.1 symbols/min [2025-10-02T20:46:01.495152] [INFO ] [MAIN ] OR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:46:01.495338] [DEBUG] [LOCAL ] OR: No existing data file found in primary storage. [2025-10-02T20:46:01.495376] [WARN ] [MAIN ] OR: No existing data found, performing full refresh instead. [2025-10-02T20:46:01.495488] [INFO ] [MAIN ] OR: Wiping existing primary data before full refresh. [2025-10-02T20:46:01.495530] [INFO ] [LOCAL ] OR: Starting deletion of primary data. [2025-10-02T20:46:01.495571] [DEBUG] [LOCAL ] OR: No primary data file found to delete. [2025-10-02T20:46:01.495605] [INFO ] [MAIN ] OR: Starting full primary refresh. [2025-10-02T20:46:01.874292] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-08. [2025-10-02T20:46:01.900029] [INFO ] [REMOTE ] OR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:46:02.149467] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-02T20:46:02.577181] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-02T20:46:02.672995] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-09. [2025-10-02T20:46:03.297871] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-02T20:46:03.473007] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-09. [2025-10-02T20:46:04.273046] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-10. [2025-10-02T20:46:04.688916] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-02T20:46:05.052735] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-02T20:46:05.053707] [INFO ] [REMOTE ] OPY: Full fetch complete (10048 records). [2025-10-02T20:46:05.053792] [DEBUG] [VALIDATOR ] OPY: Validating primary data. [2025-10-02T20:46:05.078193] [INFO ] [REMOTE ] OR: Fetching primary data for 2024-12. [2025-10-02T20:46:05.259809] [WARN ] [VALIDATOR ] OPY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-02T20:46:05.260155] [FATAL] [MAIN ] OPY: Fetched primary data is invalid. Refusing to save it. [2025-10-02T20:46:05.260287] [WARN ] [MAIN ] OPY: Deleting existing primary and derivative data due to validation failure. [2025-10-02T20:46:05.260383] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-10-02T20:46:05.260488] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-10-02T20:46:05.260548] [INFO ] [LOCAL ] OPY: Starting deletion of derivative data. [2025-10-02T20:46:05.260617] [DEBUG] [LOCAL ] OPY: No derivative data file found to delete. [2025-10-02T20:46:05.260743] [INFO ] [MAIN ] Update Progress: 1602/2370 symbols completed. OPY took 32.3s. Estimated remaining: 1h 48m 21s. Rate: 7.1 symbols/min [2025-10-02T20:46:05.457493] [INFO ] [MAIN ] ORA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:46:05.457686] [DEBUG] [LOCAL ] ORA: No existing data file found in primary storage. [2025-10-02T20:46:05.457771] [WARN ] [MAIN ] ORA: No existing data found, performing full refresh instead. [2025-10-02T20:46:05.457893] [INFO ] [MAIN ] ORA: Wiping existing primary data before full refresh. [2025-10-02T20:46:05.457934] [INFO ] [LOCAL ] ORA: Starting deletion of primary data. [2025-10-02T20:46:05.457977] [DEBUG] [LOCAL ] ORA: No primary data file found to delete. [2025-10-02T20:46:05.458009] [INFO ] [MAIN ] ORA: Starting full primary refresh. [2025-10-02T20:46:05.854301] [INFO ] [REMOTE ] ORA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:46:05.873007] [INFO ] [REMOTE ] ORA: Fetching primary data for 2024-12. [2025-10-02T20:46:06.385163] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-02T20:46:06.672996] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-01. [2025-10-02T20:46:07.473008] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-10. [2025-10-02T20:46:07.768984] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-02T20:46:08.266789] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-02T20:46:08.275079] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-10. [2025-10-02T20:46:08.745525] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-02T20:46:08.747449] [INFO ] [REMOTE ] OPFI: Full fetch complete (68073 records). [2025-10-02T20:46:08.747572] [DEBUG] [VALIDATOR ] OPFI: Validating primary data. [2025-10-02T20:46:08.913469] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-02T20:46:08.951226] [INFO ] [REMOTE ] OPP: Full fetch complete (17396 records). [2025-10-02T20:46:08.995166] [DEBUG] [VALIDATOR ] OPP: Validating primary data. [2025-10-02T20:46:09.074674] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-01. [2025-10-02T20:46:09.446347] [DEBUG] [VALIDATOR ] OPFI: All expected trading days are present. [2025-10-02T20:46:09.471970] [DEBUG] [VALIDATOR ] OPFI: Primary data validation passed. [2025-10-02T20:46:09.490971] [INFO ] [MAIN ] OPFI: Fetched primary data is valid. [2025-10-02T20:46:09.513475] [DEBUG] [LOCAL ] OPFI: Saving primary data. [2025-10-02T20:46:09.566344] [DEBUG] [LOCAL ] OPFI: Trimmed 68073 records to 46774 (keeping 200 days of data) [2025-10-02T20:46:09.670711] [DEBUG] [VALIDATOR ] OPP: All expected trading days are present. [2025-10-02T20:46:09.670880] [DEBUG] [VALIDATOR ] OPP: Primary data validation passed. [2025-10-02T20:46:09.671222] [INFO ] [MAIN ] OPP: Fetched primary data is valid. [2025-10-02T20:46:09.671364] [DEBUG] [LOCAL ] OPP: Saving primary data. [2025-10-02T20:46:09.708042] [DEBUG] [LOCAL ] OPP: Trimmed 17396 records to 11686 (keeping 200 days of data) [2025-10-02T20:46:09.813736] [DEBUG] [LOCAL ] OPP: Primary data saved (11686 records). [2025-10-02T20:46:09.814907] [INFO ] [MAIN ] OPP: Full history saved. [2025-10-02T20:46:09.815294] [INFO ] [MAIN ] Update Progress: 1603/2370 symbols completed. OPP took 36.9s. Estimated remaining: 1h 48m 11s. Rate: 7.1 symbols/min [2025-10-02T20:46:09.875968] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-02. [2025-10-02T20:46:10.121635] [INFO ] [MAIN ] ORC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:46:10.123089] [DEBUG] [LOCAL ] ORC: No existing data file found in primary storage. [2025-10-02T20:46:10.123486] [WARN ] [MAIN ] ORC: No existing data found, performing full refresh instead. [2025-10-02T20:46:10.124672] [INFO ] [MAIN ] ORC: Wiping existing primary data before full refresh. [2025-10-02T20:46:10.125073] [INFO ] [LOCAL ] ORC: Starting deletion of primary data. [2025-10-02T20:46:10.125481] [DEBUG] [LOCAL ] ORC: No primary data file found to delete. [2025-10-02T20:46:10.125567] [INFO ] [MAIN ] ORC: Starting full primary refresh. [2025-10-02T20:46:10.578130] [INFO ] [REMOTE ] ORC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:46:10.652410] [DEBUG] [LOCAL ] OPFI: Primary data saved (46774 records). [2025-10-02T20:46:10.652555] [INFO ] [MAIN ] OPFI: Full history saved. [2025-10-02T20:46:10.652631] [INFO ] [MAIN ] Update Progress: 1604/2370 symbols completed. OPFI took 37.7s. Estimated remaining: 1h 47m 59s. Rate: 7.1 symbols/min [2025-10-02T20:46:10.678110] [INFO ] [REMOTE ] ORC: Fetching primary data for 2024-12. [2025-10-02T20:46:10.849497] [INFO ] [MAIN ] ORCL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:46:10.849925] [DEBUG] [LOCAL ] ORCL: No existing data file found in primary storage. [2025-10-02T20:46:10.870972] [WARN ] [MAIN ] ORCL: No existing data found, performing full refresh instead. [2025-10-02T20:46:10.871195] [INFO ] [MAIN ] ORCL: Wiping existing primary data before full refresh. [2025-10-02T20:46:10.871495] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-10-02T20:46:10.872096] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-10-02T20:46:10.873067] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-02T20:46:10.873314] [INFO ] [MAIN ] ORCL: Starting full primary refresh. [2025-10-02T20:46:11.262798] [INFO ] [REMOTE ] ORCL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:46:11.472972] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2024-12. [2025-10-02T20:46:11.501041] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-02T20:46:12.272973] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-03. [2025-10-02T20:46:12.358270] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-02T20:46:13.073012] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-01. [2025-10-02T20:46:13.873053] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-02. [2025-10-02T20:46:14.083397] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-02T20:46:14.164123] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2024-12 (2.69 seconds). [2025-10-02T20:46:14.673041] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-04. [2025-10-02T20:46:15.228289] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-02T20:46:15.303238] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-02T20:46:15.473052] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-01. [2025-10-02T20:46:16.272977] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-03. [2025-10-02T20:46:16.534275] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-02T20:46:17.072965] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-02. [2025-10-02T20:46:17.419450] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-02T20:46:17.769924] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-10-02T20:46:17.873009] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-04. [2025-10-02T20:46:18.672992] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-02. [2025-10-02T20:46:19.069953] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-02T20:46:19.425036] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-02T20:46:19.472993] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-05. [2025-10-02T20:46:20.273028] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-03. [2025-10-02T20:46:21.072987] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-05. [2025-10-02T20:46:21.134454] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-02 (2.46 seconds). [2025-10-02T20:46:21.191713] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-02T20:46:21.873018] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-03. [2025-10-02T20:46:22.303682] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-02T20:46:22.350417] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-02T20:46:22.673157] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-04. [2025-10-02T20:46:23.473066] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-06. [2025-10-02T20:46:24.273082] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-06. [2025-10-02T20:46:24.624129] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-03 (2.75 seconds). [2025-10-02T20:46:25.019243] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-10-02T20:46:25.053627] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-02T20:46:25.073015] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-07. [2025-10-02T20:46:25.873030] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-05. [2025-10-02T20:46:25.947853] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-02T20:46:26.477260] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-02T20:46:26.673009] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-07. [2025-10-02T20:46:27.473021] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-04. [2025-10-02T20:46:28.010137] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-02T20:46:28.112609] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-02T20:46:28.273030] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-08. [2025-10-02T20:46:29.073004] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-08. [2025-10-02T20:46:29.757843] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-02T20:46:29.873020] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-06. [2025-10-02T20:46:29.957927] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-02T20:46:30.681636] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-09. [2025-10-02T20:46:30.686633] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-02T20:46:31.473011] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-09. [2025-10-02T20:46:31.536423] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-02T20:46:32.272986] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-07. [2025-10-02T20:46:32.584382] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-02T20:46:32.682239] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-02T20:46:33.073021] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-10. [2025-10-02T20:46:33.872997] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-05. [2025-10-02T20:46:34.242151] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-02T20:46:34.244903] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-02T20:46:34.260859] [INFO ] [REMOTE ] ORA: Full fetch complete (49260 records). [2025-10-02T20:46:34.261405] [DEBUG] [VALIDATOR ] ORA: Validating primary data. [2025-10-02T20:46:34.678129] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-10. [2025-10-02T20:46:34.732881] [DEBUG] [VALIDATOR ] ORA: All expected trading days are present. [2025-10-02T20:46:34.732973] [DEBUG] [VALIDATOR ] ORA: Primary data validation passed. [2025-10-02T20:46:34.733913] [INFO ] [MAIN ] ORA: Fetched primary data is valid. [2025-10-02T20:46:34.733982] [DEBUG] [LOCAL ] ORA: Saving primary data. [2025-10-02T20:46:34.735462] [DEBUG] [LOCAL ] ORA: Trimmed 49260 records to 32793 (keeping 200 days of data) [2025-10-02T20:46:34.951634] [DEBUG] [LOCAL ] ORA: Primary data saved (32793 records). [2025-10-02T20:46:34.951815] [INFO ] [MAIN ] ORA: Full history saved. [2025-10-02T20:46:34.951894] [INFO ] [MAIN ] Update Progress: 1605/2370 symbols completed. ORA took 29.7s. Estimated remaining: 1h 47m 58s. Rate: 7.1 symbols/min [2025-10-02T20:46:35.147002] [INFO ] [MAIN ] ORI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:46:35.147245] [DEBUG] [LOCAL ] ORI: No existing data file found in primary storage. [2025-10-02T20:46:35.147306] [WARN ] [MAIN ] ORI: No existing data found, performing full refresh instead. [2025-10-02T20:46:35.147427] [INFO ] [MAIN ] ORI: Wiping existing primary data before full refresh. [2025-10-02T20:46:35.147469] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-10-02T20:46:35.147515] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-10-02T20:46:35.147548] [INFO ] [MAIN ] ORI: Starting full primary refresh. [2025-10-02T20:46:35.482920] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-08. [2025-10-02T20:46:35.589705] [INFO ] [REMOTE ] ORI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:46:36.144002] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-02T20:46:36.146214] [INFO ] [REMOTE ] OR: Full fetch complete (65492 records). [2025-10-02T20:46:36.146337] [DEBUG] [VALIDATOR ] OR: Validating primary data. [2025-10-02T20:46:36.273081] [INFO ] [REMOTE ] ORI: Fetching primary data for 2024-12. [2025-10-02T20:46:36.577910] [DEBUG] [VALIDATOR ] OR: All expected trading days are present. [2025-10-02T20:46:36.578029] [DEBUG] [VALIDATOR ] OR: Primary data validation passed. [2025-10-02T20:46:36.579317] [INFO ] [MAIN ] OR: Fetched primary data is valid. [2025-10-02T20:46:36.579463] [DEBUG] [LOCAL ] OR: Saving primary data. [2025-10-02T20:46:36.581616] [DEBUG] [LOCAL ] OR: Trimmed 65492 records to 46493 (keeping 200 days of data) [2025-10-02T20:46:36.707869] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-05 (2.83 seconds). [2025-10-02T20:46:36.932761] [DEBUG] [LOCAL ] OR: Primary data saved (46493 records). [2025-10-02T20:46:36.932934] [INFO ] [MAIN ] OR: Full history saved. [2025-10-02T20:46:36.933032] [INFO ] [MAIN ] Update Progress: 1606/2370 symbols completed. OR took 35.6s. Estimated remaining: 1h 47m 46s. Rate: 7.1 symbols/min [2025-10-02T20:46:37.078108] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-06. [2025-10-02T20:46:37.132690] [INFO ] [MAIN ] ORN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:46:37.132984] [DEBUG] [LOCAL ] ORN: No existing data file found in primary storage. [2025-10-02T20:46:37.133048] [WARN ] [MAIN ] ORN: No existing data found, performing full refresh instead. [2025-10-02T20:46:37.133185] [INFO ] [MAIN ] ORN: Wiping existing primary data before full refresh. [2025-10-02T20:46:37.133236] [INFO ] [LOCAL ] ORN: Starting deletion of primary data. [2025-10-02T20:46:37.133292] [DEBUG] [LOCAL ] ORN: No primary data file found to delete. [2025-10-02T20:46:37.133337] [INFO ] [MAIN ] ORN: Starting full primary refresh. [2025-10-02T20:46:37.534798] [INFO ] [REMOTE ] ORN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:46:37.566717] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-02T20:46:37.872997] [INFO ] [REMOTE ] ORN: Fetching primary data for 2024-12. [2025-10-02T20:46:38.005184] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-02T20:46:38.673028] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-01. [2025-10-02T20:46:38.943864] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-02T20:46:39.472983] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-09. [2025-10-02T20:46:39.853294] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-06 (2.78 seconds). [2025-10-02T20:46:40.272972] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-07. [2025-10-02T20:46:40.458425] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-02T20:46:41.073017] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-02. [2025-10-02T20:46:41.184467] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-02T20:46:41.873001] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-10. [2025-10-02T20:46:42.673045] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-01. [2025-10-02T20:46:42.832805] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-02T20:46:43.268517] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-07 (3.00 seconds). [2025-10-02T20:46:43.472977] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-08. [2025-10-02T20:46:44.080735] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-02T20:46:44.272997] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-02. [2025-10-02T20:46:45.072976] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-03. [2025-10-02T20:46:45.222581] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-10 (3.35 seconds). [2025-10-02T20:46:45.225046] [INFO ] [REMOTE ] ORC: Full fetch complete (75352 records). [2025-10-02T20:46:45.225291] [DEBUG] [VALIDATOR ] ORC: Validating primary data. [2025-10-02T20:46:45.638307] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-02T20:46:45.711894] [DEBUG] [VALIDATOR ] ORC: All expected trading days are present. [2025-10-02T20:46:45.712003] [DEBUG] [VALIDATOR ] ORC: Primary data validation passed. [2025-10-02T20:46:45.713442] [INFO ] [MAIN ] ORC: Fetched primary data is valid. [2025-10-02T20:46:45.713528] [DEBUG] [LOCAL ] ORC: Saving primary data. [2025-10-02T20:46:45.715445] [DEBUG] [LOCAL ] ORC: Trimmed 75352 records to 52772 (keeping 200 days of data) [2025-10-02T20:46:45.890000] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-03. [2025-10-02T20:46:46.047118] [DEBUG] [LOCAL ] ORC: Primary data saved (52772 records). [2025-10-02T20:46:46.047306] [INFO ] [MAIN ] ORC: Full history saved. [2025-10-02T20:46:46.047396] [INFO ] [MAIN ] Update Progress: 1607/2370 symbols completed. ORC took 36.2s. Estimated remaining: 1h 47m 38s. Rate: 7.1 symbols/min [2025-10-02T20:46:46.232380] [INFO ] [MAIN ] OSCR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:46:46.232757] [DEBUG] [LOCAL ] OSCR: No existing data file found in primary storage. [2025-10-02T20:46:46.232836] [WARN ] [MAIN ] OSCR: No existing data found, performing full refresh instead. [2025-10-02T20:46:46.233090] [INFO ] [MAIN ] OSCR: Wiping existing primary data before full refresh. [2025-10-02T20:46:46.233171] [INFO ] [LOCAL ] OSCR: Starting deletion of primary data. [2025-10-02T20:46:46.233296] [DEBUG] [LOCAL ] OSCR: No primary data file found to delete. [2025-10-02T20:46:46.233364] [INFO ] [MAIN ] OSCR: Starting full primary refresh. [2025-10-02T20:46:46.645373] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-08 (3.17 seconds). [2025-10-02T20:46:46.711295] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-09. [2025-10-02T20:46:46.739062] [INFO ] [REMOTE ] OSCR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:46:46.913410] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-02T20:46:47.447324] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-02T20:46:47.472967] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-04. [2025-10-02T20:46:48.273017] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-04. [2025-10-02T20:46:48.925416] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-02T20:46:49.073011] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2024-12. [2025-10-02T20:46:49.615568] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-09 (2.90 seconds). [2025-10-02T20:46:49.873004] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-10. [2025-10-02T20:46:50.124236] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-02T20:46:50.390761] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-02T20:46:50.392317] [INFO ] [REMOTE ] ORCL: Full fetch complete (77142 records). [2025-10-02T20:46:50.392425] [DEBUG] [VALIDATOR ] ORCL: Validating primary data. [2025-10-02T20:46:50.393173] [FATAL] [VALIDATOR ] ORCL: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T20:46:50.393271] [FATAL] [MAIN ] ORCL: Fetched primary data is invalid. Refusing to save it. [2025-10-02T20:46:50.393349] [WARN ] [MAIN ] ORCL: Deleting existing primary and derivative data due to validation failure. [2025-10-02T20:46:50.393432] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-10-02T20:46:50.393501] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-10-02T20:46:50.393542] [INFO ] [LOCAL ] ORCL: Starting deletion of derivative data. [2025-10-02T20:46:50.393586] [DEBUG] [LOCAL ] ORCL: No derivative data file found to delete. [2025-10-02T20:46:50.393714] [INFO ] [MAIN ] Update Progress: 1608/2370 symbols completed. ORCL took 39.7s. Estimated remaining: 1h 47m 28s. Rate: 7.1 symbols/min [2025-10-02T20:46:50.579977] [INFO ] [MAIN ] OSK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:46:50.580145] [DEBUG] [LOCAL ] OSK: No existing data file found in primary storage. [2025-10-02T20:46:50.580184] [WARN ] [MAIN ] OSK: No existing data found, performing full refresh instead. [2025-10-02T20:46:50.580302] [INFO ] [MAIN ] OSK: Wiping existing primary data before full refresh. [2025-10-02T20:46:50.580346] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-10-02T20:46:50.580390] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-10-02T20:46:50.580426] [INFO ] [MAIN ] OSK: Starting full primary refresh. [2025-10-02T20:46:50.678150] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-05. [2025-10-02T20:46:50.995299] [INFO ] [REMOTE ] OSK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:46:51.052485] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-02T20:46:51.472991] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-01. [2025-10-02T20:46:52.273033] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-05. [2025-10-02T20:46:52.475748] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-02T20:46:53.073000] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-06. [2025-10-02T20:46:53.442187] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-02T20:46:53.873001] [INFO ] [REMOTE ] OSK: Fetching primary data for 2024-12. [2025-10-02T20:46:54.093483] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-02T20:46:54.121092] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-02T20:46:54.673050] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-02. [2025-10-02T20:46:55.473010] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-07. [2025-10-02T20:46:55.596162] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-02T20:46:56.273040] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-01. [2025-10-02T20:46:56.561156] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-02T20:46:56.628368] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-02T20:46:57.073010] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-03. [2025-10-02T20:46:57.872981] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-06. [2025-10-02T20:46:58.050369] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-02T20:46:58.673018] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-08. [2025-10-02T20:46:58.862156] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-02T20:46:59.473010] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-04. [2025-10-02T20:46:59.727084] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-02T20:47:00.048956] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-02T20:47:00.273018] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-07. [2025-10-02T20:47:01.073019] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-09. [2025-10-02T20:47:01.730323] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-02T20:47:01.873013] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-02. [2025-10-02T20:47:02.289853] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-02T20:47:02.556059] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-02T20:47:02.673001] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-05. [2025-10-02T20:47:03.472984] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-10. [2025-10-02T20:47:03.516586] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-02T20:47:04.273056] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-03. [2025-10-02T20:47:04.530234] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-02T20:47:04.531773] [INFO ] [REMOTE ] ORN: Full fetch complete (45470 records). [2025-10-02T20:47:04.531926] [DEBUG] [VALIDATOR ] ORN: Validating primary data. [2025-10-02T20:47:04.959617] [DEBUG] [VALIDATOR ] ORN: All expected trading days are present. [2025-10-02T20:47:04.959773] [DEBUG] [VALIDATOR ] ORN: Primary data validation passed. [2025-10-02T20:47:04.960697] [INFO ] [MAIN ] ORN: Fetched primary data is valid. [2025-10-02T20:47:04.960762] [DEBUG] [LOCAL ] ORN: Saving primary data. [2025-10-02T20:47:04.962121] [DEBUG] [LOCAL ] ORN: Trimmed 45470 records to 31198 (keeping 200 days of data) [2025-10-02T20:47:05.072981] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-08. [2025-10-02T20:47:05.157727] [DEBUG] [LOCAL ] ORN: Primary data saved (31198 records). [2025-10-02T20:47:05.157940] [INFO ] [MAIN ] ORN: Full history saved. [2025-10-02T20:47:05.158058] [INFO ] [MAIN ] Update Progress: 1609/2370 symbols completed. ORN took 28.2s. Estimated remaining: 1h 47m 22s. Rate: 7.1 symbols/min [2025-10-02T20:47:05.385877] [INFO ] [MAIN ] OTF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:47:05.386100] [DEBUG] [LOCAL ] OTF: No existing data file found in primary storage. [2025-10-02T20:47:05.386171] [WARN ] [MAIN ] OTF: No existing data found, performing full refresh instead. [2025-10-02T20:47:05.387179] [INFO ] [MAIN ] OTF: Wiping existing primary data before full refresh. [2025-10-02T20:47:05.389189] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-10-02T20:47:05.389070] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-05 (2.72 seconds). [2025-10-02T20:47:05.389371] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-10-02T20:47:05.401040] [INFO ] [MAIN ] OTF: Starting full primary refresh. [2025-10-02T20:47:05.811709] [INFO ] [REMOTE ] OTF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:47:05.872992] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-06. [2025-10-02T20:47:05.934523] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-02T20:47:06.503035] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-02T20:47:06.673001] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-04. [2025-10-02T20:47:07.473004] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-09. [2025-10-02T20:47:08.273004] [INFO ] [REMOTE ] OTF: Fetching primary data for 2024-12. [2025-10-02T20:47:08.505009] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T20:47:08.505344] [WARN ] [REMOTE ] OTF: No data returned for month 2024-12 [2025-10-02T20:47:08.505440] [FATAL] [REMOTE ] OTF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T20:47:08.505490] [FATAL] [MAIN ] OTF: Failed to fetch primary data. [2025-10-02T20:47:08.505554] [WARN ] [MAIN ] OTF: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T20:47:08.505628] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-10-02T20:47:08.505734] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-10-02T20:47:08.505781] [INFO ] [LOCAL ] OTF: Starting deletion of derivative data. [2025-10-02T20:47:08.505831] [DEBUG] [LOCAL ] OTF: No derivative data file found to delete. [2025-10-02T20:47:08.505880] [INFO ] [MAIN ] Update Progress: 1610/2370 symbols completed. OTF took 3.3s. Estimated remaining: 1h 47m 12s. Rate: 7.1 symbols/min [2025-10-02T20:47:08.745334] [INFO ] [MAIN ] OTIS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:47:08.747730] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-02T20:47:08.748304] [DEBUG] [LOCAL ] OTIS: No existing data file found in primary storage. [2025-10-02T20:47:08.790516] [WARN ] [MAIN ] OTIS: No existing data found, performing full refresh instead. [2025-10-02T20:47:08.794430] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-06 (2.92 seconds). [2025-10-02T20:47:08.792366] [INFO ] [MAIN ] OTIS: Wiping existing primary data before full refresh. [2025-10-02T20:47:08.805787] [INFO ] [LOCAL ] OTIS: Starting deletion of primary data. [2025-10-02T20:47:08.806958] [DEBUG] [LOCAL ] OTIS: No primary data file found to delete. [2025-10-02T20:47:08.807138] [INFO ] [MAIN ] OTIS: Starting full primary refresh. [2025-10-02T20:47:09.078174] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-07. [2025-10-02T20:47:09.185548] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-02T20:47:09.278007] [INFO ] [REMOTE ] OTIS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:47:09.873047] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2024-12. [2025-10-02T20:47:10.673010] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-05. [2025-10-02T20:47:11.472969] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-10. [2025-10-02T20:47:11.670244] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-02T20:47:11.782099] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-07 (2.70 seconds). [2025-10-02T20:47:12.272993] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-08. [2025-10-02T20:47:12.376781] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-02T20:47:12.654785] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-02T20:47:12.657480] [INFO ] [REMOTE ] ORI: Full fetch complete (70294 records). [2025-10-02T20:47:12.657713] [DEBUG] [VALIDATOR ] ORI: Validating primary data. [2025-10-02T20:47:12.903122] [WARN ] [VALIDATOR ] ORI: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-02T20:47:12.903984] [FATAL] [MAIN ] ORI: Fetched primary data is invalid. Refusing to save it. [2025-10-02T20:47:12.904109] [WARN ] [MAIN ] ORI: Deleting existing primary and derivative data due to validation failure. [2025-10-02T20:47:12.904204] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-10-02T20:47:12.904292] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-10-02T20:47:12.904339] [INFO ] [LOCAL ] ORI: Starting deletion of derivative data. [2025-10-02T20:47:12.904384] [DEBUG] [LOCAL ] ORI: No derivative data file found to delete. [2025-10-02T20:47:12.904449] [INFO ] [MAIN ] Update Progress: 1611/2370 symbols completed. ORI took 38.0s. Estimated remaining: 1h 47m 1s. Rate: 7.1 symbols/min [2025-10-02T20:47:13.087529] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-06. [2025-10-02T20:47:13.091473] [INFO ] [MAIN ] OUT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:47:13.091807] [DEBUG] [LOCAL ] OUT: No existing data file found in primary storage. [2025-10-02T20:47:13.092096] [WARN ] [MAIN ] OUT: No existing data found, performing full refresh instead. [2025-10-02T20:47:13.092939] [INFO ] [MAIN ] OUT: Wiping existing primary data before full refresh. [2025-10-02T20:47:13.092985] [INFO ] [LOCAL ] OUT: Starting deletion of primary data. [2025-10-02T20:47:13.093031] [DEBUG] [LOCAL ] OUT: No primary data file found to delete. [2025-10-02T20:47:13.093066] [INFO ] [MAIN ] OUT: Starting full primary refresh. [2025-10-02T20:47:13.488420] [INFO ] [REMOTE ] OUT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:47:13.873012] [INFO ] [REMOTE ] OUT: Fetching primary data for 2024-12. [2025-10-02T20:47:14.673101] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-01. [2025-10-02T20:47:14.780350] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-08 (2.51 seconds). [2025-10-02T20:47:14.904437] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-02T20:47:15.236070] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-02T20:47:15.473066] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-07. [2025-10-02T20:47:16.273035] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-01. [2025-10-02T20:47:16.500287] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-02T20:47:16.867263] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-02T20:47:17.073023] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-02. [2025-10-02T20:47:17.873051] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-09. [2025-10-02T20:47:18.427327] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-02T20:47:18.673018] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-02. [2025-10-02T20:47:19.473006] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-08. [2025-10-02T20:47:19.887499] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-02 (2.81 seconds). [2025-10-02T20:47:20.272979] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-03. [2025-10-02T20:47:20.475708] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-02T20:47:20.995004] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-09 (3.12 seconds). [2025-10-02T20:47:21.073050] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-03. [2025-10-02T20:47:21.342762] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-02T20:47:21.873014] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-09. [2025-10-02T20:47:21.968519] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-02T20:47:22.673018] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-10. [2025-10-02T20:47:22.768810] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-02T20:47:23.473037] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-04. [2025-10-02T20:47:23.540397] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-02T20:47:24.272995] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-10. [2025-10-02T20:47:24.943075] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-10-02T20:47:24.945187] [INFO ] [REMOTE ] OSCR: Full fetch complete (77497 records). [2025-10-02T20:47:24.945371] [DEBUG] [VALIDATOR ] OSCR: Validating primary data. [2025-10-02T20:47:25.078086] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-04. [2025-10-02T20:47:25.408010] [DEBUG] [VALIDATOR ] OSCR: All expected trading days are present. [2025-10-02T20:47:25.408129] [DEBUG] [VALIDATOR ] OSCR: Primary data validation passed. [2025-10-02T20:47:25.409287] [INFO ] [MAIN ] OSCR: Fetched primary data is valid. [2025-10-02T20:47:25.409488] [DEBUG] [LOCAL ] OSCR: Saving primary data. [2025-10-02T20:47:25.441204] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-02T20:47:25.439500] [DEBUG] [LOCAL ] OSCR: Trimmed 77497 records to 54112 (keeping 200 days of data) [2025-10-02T20:47:25.674458] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-02T20:47:25.678238] [INFO ] [REMOTE ] OSK: Full fetch complete (61286 records). [2025-10-02T20:47:25.679794] [DEBUG] [VALIDATOR ] OSK: Validating primary data. [2025-10-02T20:47:25.877337] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-05. [2025-10-02T20:47:25.928637] [WARN ] [VALIDATOR ] OSK: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-02T20:47:25.930489] [FATAL] [MAIN ] OSK: Fetched primary data is invalid. Refusing to save it. [2025-10-02T20:47:25.932261] [WARN ] [MAIN ] OSK: Deleting existing primary and derivative data due to validation failure. [2025-10-02T20:47:25.932701] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-10-02T20:47:25.933052] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-10-02T20:47:25.933787] [INFO ] [LOCAL ] OSK: Starting deletion of derivative data. [2025-10-02T20:47:25.934257] [DEBUG] [LOCAL ] OSK: No derivative data file found to delete. [2025-10-02T20:47:25.934686] [INFO ] [MAIN ] Update Progress: 1612/2370 symbols completed. OSK took 35.5s. Estimated remaining: 1h 46m 55s. Rate: 7.1 symbols/min [2025-10-02T20:47:26.140029] [INFO ] [MAIN ] OVV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:47:26.141086] [DEBUG] [LOCAL ] OVV: No existing data file found in primary storage. [2025-10-02T20:47:26.141405] [WARN ] [MAIN ] OVV: No existing data found, performing full refresh instead. [2025-10-02T20:47:26.142377] [INFO ] [MAIN ] OVV: Wiping existing primary data before full refresh. [2025-10-02T20:47:26.142726] [INFO ] [LOCAL ] OVV: Starting deletion of primary data. [2025-10-02T20:47:26.143106] [DEBUG] [LOCAL ] OVV: No primary data file found to delete. [2025-10-02T20:47:26.143164] [INFO ] [MAIN ] OVV: Starting full primary refresh. [2025-10-02T20:47:26.620582] [INFO ] [REMOTE ] OVV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:47:26.645101] [DEBUG] [LOCAL ] OSCR: Primary data saved (54112 records). [2025-10-02T20:47:26.645314] [INFO ] [MAIN ] OSCR: Full history saved. [2025-10-02T20:47:26.645464] [INFO ] [MAIN ] Update Progress: 1613/2370 symbols completed. OSCR took 40.6s. Estimated remaining: 1h 46m 43s. Rate: 7.1 symbols/min [2025-10-02T20:47:26.682249] [INFO ] [REMOTE ] OVV: Fetching primary data for 2024-12. [2025-10-02T20:47:26.837048] [INFO ] [MAIN ] OWL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:47:26.837202] [DEBUG] [LOCAL ] OWL: No existing data file found in primary storage. [2025-10-02T20:47:26.837241] [WARN ] [MAIN ] OWL: No existing data found, performing full refresh instead. [2025-10-02T20:47:26.837355] [INFO ] [MAIN ] OWL: Wiping existing primary data before full refresh. [2025-10-02T20:47:26.837397] [INFO ] [LOCAL ] OWL: Starting deletion of primary data. [2025-10-02T20:47:26.837440] [DEBUG] [LOCAL ] OWL: No primary data file found to delete. [2025-10-02T20:47:26.837473] [INFO ] [MAIN ] OWL: Starting full primary refresh. [2025-10-02T20:47:27.224381] [INFO ] [REMOTE ] OWL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:47:27.256301] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-02T20:47:27.472976] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-05. [2025-10-02T20:47:27.876581] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-02T20:47:28.273011] [INFO ] [REMOTE ] OWL: Fetching primary data for 2024-12. [2025-10-02T20:47:28.643163] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-02T20:47:29.073003] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-06. [2025-10-02T20:47:29.174558] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-02T20:47:29.872996] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-06. [2025-10-02T20:47:29.931806] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-02T20:47:30.547813] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-02T20:47:30.673002] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-07. [2025-10-02T20:47:31.472986] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-01. [2025-10-02T20:47:31.723905] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-02T20:47:32.272973] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-07. [2025-10-02T20:47:32.372881] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-02T20:47:33.073014] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-01. [2025-10-02T20:47:33.140944] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-02T20:47:33.872969] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-02. [2025-10-02T20:47:34.366154] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-02T20:47:34.672995] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-08. [2025-10-02T20:47:35.036567] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-02T20:47:35.473056] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-02. [2025-10-02T20:47:35.635315] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-02T20:47:36.082507] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-02T20:47:36.273003] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-09. [2025-10-02T20:47:37.072976] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-08. [2025-10-02T20:47:37.147168] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-02T20:47:37.872988] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-03. [2025-10-02T20:47:37.985023] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-02T20:47:38.673012] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-03. [2025-10-02T20:47:39.013827] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-02T20:47:39.472987] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-10. [2025-10-02T20:47:39.779839] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-02T20:47:40.272994] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-09. [2025-10-02T20:47:40.493163] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-02T20:47:40.777207] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-02T20:47:40.779303] [INFO ] [REMOTE ] OUT: Full fetch complete (68999 records). [2025-10-02T20:47:40.779436] [DEBUG] [VALIDATOR ] OUT: Validating primary data. [2025-10-02T20:47:41.080163] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-04. [2025-10-02T20:47:41.211454] [DEBUG] [VALIDATOR ] OUT: All expected trading days are present. [2025-10-02T20:47:41.211594] [DEBUG] [VALIDATOR ] OUT: Primary data validation passed. [2025-10-02T20:47:41.212582] [INFO ] [MAIN ] OUT: Fetched primary data is valid. [2025-10-02T20:47:41.212674] [DEBUG] [LOCAL ] OUT: Saving primary data. [2025-10-02T20:47:41.214120] [DEBUG] [LOCAL ] OUT: Trimmed 68999 records to 48152 (keeping 200 days of data) [2025-10-02T20:47:41.522553] [DEBUG] [LOCAL ] OUT: Primary data saved (48152 records). [2025-10-02T20:47:41.522725] [INFO ] [MAIN ] OUT: Full history saved. [2025-10-02T20:47:41.522826] [INFO ] [MAIN ] Update Progress: 1614/2370 symbols completed. OUT took 28.6s. Estimated remaining: 1h 46m 37s. Rate: 7.1 symbols/min [2025-10-02T20:47:41.714310] [INFO ] [MAIN ] OWLT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:47:41.714762] [DEBUG] [LOCAL ] OWLT: No existing data file found in primary storage. [2025-10-02T20:47:41.714814] [WARN ] [MAIN ] OWLT: No existing data found, performing full refresh instead. [2025-10-02T20:47:41.715001] [INFO ] [MAIN ] OWLT: Wiping existing primary data before full refresh. [2025-10-02T20:47:41.715046] [INFO ] [LOCAL ] OWLT: Starting deletion of primary data. [2025-10-02T20:47:41.715090] [DEBUG] [LOCAL ] OWLT: No primary data file found to delete. [2025-10-02T20:47:41.715124] [INFO ] [MAIN ] OWLT: Starting full primary refresh. [2025-10-02T20:47:41.884176] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-04. [2025-10-02T20:47:42.116026] [INFO ] [REMOTE ] OWLT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:47:42.150148] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-02T20:47:42.672978] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-10. [2025-10-02T20:47:43.144962] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-02T20:47:43.472995] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2024-12. [2025-10-02T20:47:43.701554] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-02T20:47:43.703673] [INFO ] [REMOTE ] OTIS: Full fetch complete (75933 records). [2025-10-02T20:47:43.703840] [DEBUG] [VALIDATOR ] OTIS: Validating primary data. [2025-10-02T20:47:44.132309] [DEBUG] [VALIDATOR ] OTIS: All expected trading days are present. [2025-10-02T20:47:44.132568] [DEBUG] [VALIDATOR ] OTIS: Primary data validation passed. [2025-10-02T20:47:44.133925] [INFO ] [MAIN ] OTIS: Fetched primary data is valid. [2025-10-02T20:47:44.134051] [DEBUG] [LOCAL ] OTIS: Saving primary data. [2025-10-02T20:47:44.165716] [DEBUG] [LOCAL ] OTIS: Trimmed 75933 records to 53094 (keeping 200 days of data) [2025-10-02T20:47:44.175339] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-02T20:47:44.176150] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-02T20:47:44.281987] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-05. [2025-10-02T20:47:44.534122] [DEBUG] [LOCAL ] OTIS: Primary data saved (53094 records). [2025-10-02T20:47:44.534268] [INFO ] [MAIN ] OTIS: Full history saved. [2025-10-02T20:47:44.534344] [INFO ] [MAIN ] Update Progress: 1615/2370 symbols completed. OTIS took 36.0s. Estimated remaining: 1h 46m 26s. Rate: 7.1 symbols/min [2025-10-02T20:47:44.717055] [INFO ] [MAIN ] OXM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:47:44.717273] [DEBUG] [LOCAL ] OXM: No existing data file found in primary storage. [2025-10-02T20:47:44.717336] [WARN ] [MAIN ] OXM: No existing data found, performing full refresh instead. [2025-10-02T20:47:44.717450] [INFO ] [MAIN ] OXM: Wiping existing primary data before full refresh. [2025-10-02T20:47:44.717491] [INFO ] [LOCAL ] OXM: Starting deletion of primary data. [2025-10-02T20:47:44.717533] [DEBUG] [LOCAL ] OXM: No primary data file found to delete. [2025-10-02T20:47:44.717567] [INFO ] [MAIN ] OXM: Starting full primary refresh. [2025-10-02T20:47:45.078265] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-05. [2025-10-02T20:47:45.119542] [INFO ] [REMOTE ] OXM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:47:45.872988] [INFO ] [REMOTE ] OXM: Fetching primary data for 2024-12. [2025-10-02T20:47:46.269363] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-02T20:47:46.672997] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-01. [2025-10-02T20:47:47.209304] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-02T20:47:47.254914] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-02T20:47:47.472945] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-02T20:47:47.473043] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-06. [2025-10-02T20:47:48.272994] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-02. [2025-10-02T20:47:48.997559] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-02T20:47:49.072996] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-03. [2025-10-02T20:47:49.558025] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-02T20:47:49.873056] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-01. [2025-10-02T20:47:49.996665] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-02T20:47:50.673024] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-07. [2025-10-02T20:47:51.146001] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-02T20:47:51.473091] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-04. [2025-10-02T20:47:52.214489] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-02T20:47:52.273025] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-02. [2025-10-02T20:47:52.546880] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-02T20:47:53.073051] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-08. [2025-10-02T20:47:53.257508] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-02T20:47:53.873038] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-06. [2025-10-02T20:47:54.673029] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-05. [2025-10-02T20:47:54.835810] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-02T20:47:55.427046] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-02T20:47:55.473014] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-06. [2025-10-02T20:47:55.762226] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-02T20:47:56.273125] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-03. [2025-10-02T20:47:57.072985] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-07. [2025-10-02T20:47:57.087621] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-02T20:47:57.873002] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-09. [2025-10-02T20:47:58.516765] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-10-02T20:47:58.673026] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-04. [2025-10-02T20:47:59.473079] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-07. [2025-10-02T20:48:00.210046] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-07 (3.14 seconds). [2025-10-02T20:48:00.272994] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-08. [2025-10-02T20:48:00.398075] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-10-02T20:48:00.468491] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-02T20:48:00.485808] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-02T20:48:01.072995] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-05. [2025-10-02T20:48:01.873043] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-10. [2025-10-02T20:48:02.352543] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-02T20:48:02.673018] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-09. [2025-10-02T20:48:03.264532] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-02T20:48:03.469169] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-02T20:48:03.471206] [INFO ] [REMOTE ] OVV: Full fetch complete (77316 records). [2025-10-02T20:48:03.471363] [DEBUG] [VALIDATOR ] OVV: Validating primary data. [2025-10-02T20:48:03.478062] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-08. [2025-10-02T20:48:03.912774] [DEBUG] [VALIDATOR ] OVV: All expected trading days are present. [2025-10-02T20:48:03.912898] [DEBUG] [VALIDATOR ] OVV: Primary data validation passed. [2025-10-02T20:48:03.914133] [INFO ] [MAIN ] OVV: Fetched primary data is valid. [2025-10-02T20:48:03.914231] [DEBUG] [LOCAL ] OVV: Saving primary data. [2025-10-02T20:48:03.915857] [DEBUG] [LOCAL ] OVV: Trimmed 77316 records to 53905 (keeping 200 days of data) [2025-10-02T20:48:04.268297] [DEBUG] [LOCAL ] OVV: Primary data saved (53905 records). [2025-10-02T20:48:04.268457] [INFO ] [MAIN ] OVV: Full history saved. [2025-10-02T20:48:04.268584] [INFO ] [MAIN ] Update Progress: 1616/2370 symbols completed. OVV took 38.3s. Estimated remaining: 1h 46m 23s. Rate: 7.1 symbols/min [2025-10-02T20:48:04.274055] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-06. [2025-10-02T20:48:04.469239] [INFO ] [MAIN ] OXY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:48:04.469465] [DEBUG] [LOCAL ] OXY: No existing data file found in primary storage. [2025-10-02T20:48:04.469568] [WARN ] [MAIN ] OXY: No existing data found, performing full refresh instead. [2025-10-02T20:48:04.469733] [INFO ] [MAIN ] OXY: Wiping existing primary data before full refresh. [2025-10-02T20:48:04.469798] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-10-02T20:48:04.469866] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-10-02T20:48:04.469925] [INFO ] [MAIN ] OXY: Starting full primary refresh. [2025-10-02T20:48:04.870777] [INFO ] [REMOTE ] OXY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:48:05.072999] [INFO ] [REMOTE ] OXY: Fetching primary data for 2024-12. [2025-10-02T20:48:05.131877] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-10-02T20:48:05.529232] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-02T20:48:05.873011] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-09. [2025-10-02T20:48:05.923441] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-02T20:48:06.522854] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-02T20:48:06.673042] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-07. [2025-10-02T20:48:07.473073] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-10. [2025-10-02T20:48:07.981332] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-02T20:48:08.079928] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2024-12 (3.01 seconds). [2025-10-02T20:48:08.273071] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-01. [2025-10-02T20:48:08.784219] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-02T20:48:08.786283] [INFO ] [REMOTE ] OWL: Full fetch complete (77529 records). [2025-10-02T20:48:08.786429] [DEBUG] [VALIDATOR ] OWL: Validating primary data. [2025-10-02T20:48:09.078144] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-10. [2025-10-02T20:48:09.207617] [DEBUG] [VALIDATOR ] OWL: All expected trading days are present. [2025-10-02T20:48:09.207763] [DEBUG] [VALIDATOR ] OWL: Primary data validation passed. [2025-10-02T20:48:09.209045] [INFO ] [MAIN ] OWL: Fetched primary data is valid. [2025-10-02T20:48:09.209118] [DEBUG] [LOCAL ] OWL: Saving primary data. [2025-10-02T20:48:09.210764] [DEBUG] [LOCAL ] OWL: Trimmed 77529 records to 53945 (keeping 200 days of data) [2025-10-02T20:48:09.581969] [DEBUG] [LOCAL ] OWL: Primary data saved (53945 records). [2025-10-02T20:48:09.582128] [INFO ] [MAIN ] OWL: Full history saved. [2025-10-02T20:48:09.582234] [INFO ] [MAIN ] Update Progress: 1617/2370 symbols completed. OWL took 42.9s. Estimated remaining: 1h 46m 13s. Rate: 7.1 symbols/min [2025-10-02T20:48:09.767179] [INFO ] [MAIN ] PAAS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:48:09.770314] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-02T20:48:09.770546] [DEBUG] [LOCAL ] PAAS: No existing data file found in primary storage. [2025-10-02T20:48:09.771667] [INFO ] [REMOTE ] OWLT: Full fetch complete (11590 records). [2025-10-02T20:48:09.771794] [WARN ] [MAIN ] PAAS: No existing data found, performing full refresh instead. [2025-10-02T20:48:09.771982] [DEBUG] [VALIDATOR ] OWLT: Validating primary data. [2025-10-02T20:48:09.772149] [INFO ] [MAIN ] PAAS: Wiping existing primary data before full refresh. [2025-10-02T20:48:09.788039] [INFO ] [LOCAL ] PAAS: Starting deletion of primary data. [2025-10-02T20:48:09.788188] [DEBUG] [LOCAL ] PAAS: No primary data file found to delete. [2025-10-02T20:48:09.810727] [INFO ] [MAIN ] PAAS: Starting full primary refresh. [2025-10-02T20:48:09.882291] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-08. [2025-10-02T20:48:10.628535] [DEBUG] [VALIDATOR ] OWLT: All expected trading days are present. [2025-10-02T20:48:10.632504] [DEBUG] [VALIDATOR ] OWLT: Primary data validation passed. [2025-10-02T20:48:10.659140] [INFO ] [REMOTE ] PAAS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:48:10.659793] [INFO ] [MAIN ] OWLT: Fetched primary data is valid. [2025-10-02T20:48:10.660221] [DEBUG] [LOCAL ] OWLT: Saving primary data. [2025-10-02T20:48:10.661042] [DEBUG] [LOCAL ] OWLT: Trimmed 11590 records to 8861 (keeping 200 days of data) [2025-10-02T20:48:10.684852] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2024-12. [2025-10-02T20:48:10.719681] [DEBUG] [LOCAL ] OWLT: Primary data saved (8861 records). [2025-10-02T20:48:10.719934] [INFO ] [MAIN ] OWLT: Full history saved. [2025-10-02T20:48:10.720054] [INFO ] [MAIN ] Update Progress: 1618/2370 symbols completed. OWLT took 29.2s. Estimated remaining: 1h 46m 1s. Rate: 7.1 symbols/min [2025-10-02T20:48:10.914185] [INFO ] [MAIN ] PAC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:48:10.914376] [DEBUG] [LOCAL ] PAC: No existing data file found in primary storage. [2025-10-02T20:48:10.914485] [WARN ] [MAIN ] PAC: No existing data found, performing full refresh instead. [2025-10-02T20:48:10.914711] [INFO ] [MAIN ] PAC: Wiping existing primary data before full refresh. [2025-10-02T20:48:10.914767] [INFO ] [LOCAL ] PAC: Starting deletion of primary data. [2025-10-02T20:48:10.914816] [DEBUG] [LOCAL ] PAC: No primary data file found to delete. [2025-10-02T20:48:10.914852] [INFO ] [MAIN ] PAC: Starting full primary refresh. [2025-10-02T20:48:11.299390] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-01 (3.03 seconds). [2025-10-02T20:48:11.301265] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-02T20:48:11.412200] [INFO ] [REMOTE ] PAC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:48:11.472934] [INFO ] [REMOTE ] PAC: Fetching primary data for 2024-12. [2025-10-02T20:48:12.228759] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-02T20:48:12.272986] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-01. [2025-10-02T20:48:12.402577] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-02T20:48:13.072994] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-02. [2025-10-02T20:48:13.182487] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-02T20:48:13.873007] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-02. [2025-10-02T20:48:14.623725] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-02T20:48:14.673038] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-01. [2025-10-02T20:48:15.473023] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-03. [2025-10-02T20:48:15.572794] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-02 (2.50 seconds). [2025-10-02T20:48:16.272996] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-03. [2025-10-02T20:48:16.464594] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-02T20:48:16.644377] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-02T20:48:17.073024] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-02. [2025-10-02T20:48:17.873042] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-04. [2025-10-02T20:48:18.673027] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-09. [2025-10-02T20:48:19.254430] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-03 (2.98 seconds). [2025-10-02T20:48:19.473076] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-04. [2025-10-02T20:48:19.747874] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-02T20:48:19.813781] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-02 (2.74 seconds). [2025-10-02T20:48:20.104520] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-02T20:48:20.273050] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-10. [2025-10-02T20:48:21.072988] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-05. [2025-10-02T20:48:21.301286] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-02T20:48:21.302869] [INFO ] [REMOTE ] OXM: Full fetch complete (46091 records). [2025-10-02T20:48:21.302979] [DEBUG] [VALIDATOR ] OXM: Validating primary data. [2025-10-02T20:48:21.707103] [DEBUG] [VALIDATOR ] OXM: All expected trading days are present. [2025-10-02T20:48:21.707186] [DEBUG] [VALIDATOR ] OXM: Primary data validation passed. [2025-10-02T20:48:21.708081] [INFO ] [MAIN ] OXM: Fetched primary data is valid. [2025-10-02T20:48:21.708146] [DEBUG] [LOCAL ] OXM: Saving primary data. [2025-10-02T20:48:21.709190] [DEBUG] [LOCAL ] OXM: Trimmed 46091 records to 33490 (keeping 200 days of data) [2025-10-02T20:48:21.883359] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-03. [2025-10-02T20:48:21.941382] [DEBUG] [LOCAL ] OXM: Primary data saved (33490 records). [2025-10-02T20:48:21.941681] [INFO ] [MAIN ] OXM: Full history saved. [2025-10-02T20:48:21.941806] [INFO ] [MAIN ] Update Progress: 1619/2370 symbols completed. OXM took 37.4s. Estimated remaining: 1h 45m 54s. Rate: 7.1 symbols/min [2025-10-02T20:48:22.144410] [INFO ] [MAIN ] PACK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:48:22.145114] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-02T20:48:22.155469] [DEBUG] [LOCAL ] PACK: No existing data file found in primary storage. [2025-10-02T20:48:22.155908] [WARN ] [MAIN ] PACK: No existing data found, performing full refresh instead. [2025-10-02T20:48:22.156151] [INFO ] [MAIN ] PACK: Wiping existing primary data before full refresh. [2025-10-02T20:48:22.156375] [INFO ] [LOCAL ] PACK: Starting deletion of primary data. [2025-10-02T20:48:22.156544] [DEBUG] [LOCAL ] PACK: No primary data file found to delete. [2025-10-02T20:48:22.156731] [INFO ] [MAIN ] PACK: Starting full primary refresh. [2025-10-02T20:48:22.583280] [INFO ] [REMOTE ] PACK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:48:22.585913] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-04 (3.11 seconds). [2025-10-02T20:48:22.673046] [INFO ] [REMOTE ] PACK: Fetching primary data for 2024-12. [2025-10-02T20:48:23.473054] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-05. [2025-10-02T20:48:23.883603] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-02T20:48:24.062942] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-02T20:48:24.273009] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-01. [2025-10-02T20:48:25.073049] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-06. [2025-10-02T20:48:25.538603] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-02T20:48:25.833018] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-10-02T20:48:25.873072] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-04. [2025-10-02T20:48:26.118024] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-02T20:48:26.673057] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-02. [2025-10-02T20:48:27.473057] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-06. [2025-10-02T20:48:28.017931] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-02T20:48:28.080306] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-02T20:48:28.273011] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-03. [2025-10-02T20:48:29.073040] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-07. [2025-10-02T20:48:29.693793] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-02T20:48:29.781910] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-02T20:48:29.872616] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-10-02T20:48:29.880127] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-05. [2025-10-02T20:48:30.673080] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-04. [2025-10-02T20:48:31.473057] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-08. [2025-10-02T20:48:31.753476] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-02T20:48:32.086981] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-02T20:48:32.272997] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-05. [2025-10-02T20:48:32.393717] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-02T20:48:33.073031] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-06. [2025-10-02T20:48:33.779259] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-02T20:48:33.873006] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-06. [2025-10-02T20:48:34.673006] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-09. [2025-10-02T20:48:34.970505] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-02T20:48:35.131188] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-02T20:48:35.465064] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-02T20:48:35.472953] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-10. [2025-10-02T20:48:35.962188] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-02T20:48:35.963204] [INFO ] [REMOTE ] PAC: Full fetch complete (16546 records). [2025-10-02T20:48:35.963275] [DEBUG] [VALIDATOR ] PAC: Validating primary data. [2025-10-02T20:48:36.278141] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-07. [2025-10-02T20:48:36.376839] [DEBUG] [VALIDATOR ] PAC: All expected trading days are present. [2025-10-02T20:48:36.376926] [DEBUG] [VALIDATOR ] PAC: Primary data validation passed. [2025-10-02T20:48:36.377359] [INFO ] [MAIN ] PAC: Fetched primary data is valid. [2025-10-02T20:48:36.377426] [DEBUG] [LOCAL ] PAC: Saving primary data. [2025-10-02T20:48:36.378047] [DEBUG] [LOCAL ] PAC: Trimmed 16546 records to 11658 (keeping 200 days of data) [2025-10-02T20:48:36.467170] [DEBUG] [LOCAL ] PAC: Primary data saved (11658 records). [2025-10-02T20:48:36.467325] [INFO ] [MAIN ] PAC: Full history saved. [2025-10-02T20:48:36.467403] [INFO ] [MAIN ] Update Progress: 1620/2370 symbols completed. PAC took 25.7s. Estimated remaining: 1h 45m 48s. Rate: 7.1 symbols/min [2025-10-02T20:48:36.652885] [INFO ] [MAIN ] PACS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:48:36.653081] [DEBUG] [LOCAL ] PACS: No existing data file found in primary storage. [2025-10-02T20:48:36.653126] [WARN ] [MAIN ] PACS: No existing data found, performing full refresh instead. [2025-10-02T20:48:36.653258] [INFO ] [MAIN ] PACS: Wiping existing primary data before full refresh. [2025-10-02T20:48:36.653308] [INFO ] [LOCAL ] PACS: Starting deletion of primary data. [2025-10-02T20:48:36.653357] [DEBUG] [LOCAL ] PACS: No primary data file found to delete. [2025-10-02T20:48:36.653392] [INFO ] [MAIN ] PACS: Starting full primary refresh. [2025-10-02T20:48:37.081298] [INFO ] [REMOTE ] PACS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:48:37.077429] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-07. [2025-10-02T20:48:37.873008] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-07. [2025-10-02T20:48:38.673002] [INFO ] [REMOTE ] PACS: Fetching primary data for 2024-12. [2025-10-02T20:48:39.002998] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-02T20:48:39.264679] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-07 (2.99 seconds). [2025-10-02T20:48:39.278203] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-02T20:48:39.472995] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-08. [2025-10-02T20:48:39.998334] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-02T20:48:40.272991] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-08. [2025-10-02T20:48:40.736017] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-02T20:48:41.073011] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-01. [2025-10-02T20:48:41.872995] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-09. [2025-10-02T20:48:42.327718] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-02T20:48:42.589113] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-10-02T20:48:42.672990] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-02. [2025-10-02T20:48:42.885251] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-02T20:48:43.472994] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-08. [2025-10-02T20:48:43.993898] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-02T20:48:44.272996] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-03. [2025-10-02T20:48:45.072978] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-09. [2025-10-02T20:48:45.451816] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-02T20:48:45.484275] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-02T20:48:45.873031] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-09. [2025-10-02T20:48:46.673037] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-04. [2025-10-02T20:48:47.472996] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-10. [2025-10-02T20:48:47.549266] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-10-02T20:48:47.902350] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-02T20:48:48.125427] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-02T20:48:48.272974] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-10. [2025-10-02T20:48:48.307205] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-02T20:48:48.309088] [INFO ] [REMOTE ] PACK: Full fetch complete (44091 records). [2025-10-02T20:48:48.309172] [DEBUG] [VALIDATOR ] PACK: Validating primary data. [2025-10-02T20:48:48.725432] [DEBUG] [VALIDATOR ] PACK: All expected trading days are present. [2025-10-02T20:48:48.725522] [DEBUG] [VALIDATOR ] PACK: Primary data validation passed. [2025-10-02T20:48:48.726416] [INFO ] [MAIN ] PACK: Fetched primary data is valid. [2025-10-02T20:48:48.726483] [DEBUG] [LOCAL ] PACK: Saving primary data. [2025-10-02T20:48:48.727549] [DEBUG] [LOCAL ] PACK: Trimmed 44091 records to 32109 (keeping 200 days of data) [2025-10-02T20:48:48.915621] [DEBUG] [LOCAL ] PACK: Primary data saved (32109 records). [2025-10-02T20:48:48.915791] [INFO ] [MAIN ] PACK: Full history saved. [2025-10-02T20:48:48.915870] [INFO ] [MAIN ] Update Progress: 1621/2370 symbols completed. PACK took 27.0s. Estimated remaining: 1h 45m 42s. Rate: 7.1 symbols/min [2025-10-02T20:48:49.096755] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-05. [2025-10-02T20:48:49.100554] [INFO ] [MAIN ] PAG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:48:49.102089] [DEBUG] [LOCAL ] PAG: No existing data file found in primary storage. [2025-10-02T20:48:49.102156] [WARN ] [MAIN ] PAG: No existing data found, performing full refresh instead. [2025-10-02T20:48:49.102271] [INFO ] [MAIN ] PAG: Wiping existing primary data before full refresh. [2025-10-02T20:48:49.102316] [INFO ] [LOCAL ] PAG: Starting deletion of primary data. [2025-10-02T20:48:49.102378] [DEBUG] [LOCAL ] PAG: No primary data file found to delete. [2025-10-02T20:48:49.102413] [INFO ] [MAIN ] PAG: Starting full primary refresh. [2025-10-02T20:48:49.519282] [INFO ] [REMOTE ] PAG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:48:49.684450] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-02T20:48:49.686572] [INFO ] [REMOTE ] PAAS: Full fetch complete (77394 records). [2025-10-02T20:48:49.686762] [DEBUG] [VALIDATOR ] PAAS: Validating primary data. [2025-10-02T20:48:49.878517] [INFO ] [REMOTE ] PAG: Fetching primary data for 2024-12. [2025-10-02T20:48:50.122301] [DEBUG] [VALIDATOR ] PAAS: All expected trading days are present. [2025-10-02T20:48:50.122462] [DEBUG] [VALIDATOR ] PAAS: Primary data validation passed. [2025-10-02T20:48:50.123789] [INFO ] [MAIN ] PAAS: Fetched primary data is valid. [2025-10-02T20:48:50.124047] [DEBUG] [LOCAL ] PAAS: Saving primary data. [2025-10-02T20:48:50.125861] [DEBUG] [LOCAL ] PAAS: Trimmed 77394 records to 53994 (keeping 200 days of data) [2025-10-02T20:48:50.481247] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-02T20:48:50.523990] [DEBUG] [LOCAL ] PAAS: Primary data saved (53994 records). [2025-10-02T20:48:50.524194] [INFO ] [MAIN ] PAAS: Full history saved. [2025-10-02T20:48:50.524399] [INFO ] [MAIN ] Update Progress: 1622/2370 symbols completed. PAAS took 40.9s. Estimated remaining: 1h 45m 30s. Rate: 7.1 symbols/min [2025-10-02T20:48:50.678195] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-06. [2025-10-02T20:48:50.730436] [INFO ] [MAIN ] PAGS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:48:50.730766] [DEBUG] [LOCAL ] PAGS: No existing data file found in primary storage. [2025-10-02T20:48:50.730829] [WARN ] [MAIN ] PAGS: No existing data found, performing full refresh instead. [2025-10-02T20:48:50.730951] [INFO ] [MAIN ] PAGS: Wiping existing primary data before full refresh. [2025-10-02T20:48:50.731000] [INFO ] [LOCAL ] PAGS: Starting deletion of primary data. [2025-10-02T20:48:50.731049] [DEBUG] [LOCAL ] PAGS: No primary data file found to delete. [2025-10-02T20:48:50.731087] [INFO ] [MAIN ] PAGS: Starting full primary refresh. [2025-10-02T20:48:51.148049] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-02T20:48:51.156416] [INFO ] [REMOTE ] PAGS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:48:51.473014] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-01. [2025-10-02T20:48:52.172942] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-02T20:48:52.272981] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-10. [2025-10-02T20:48:52.439033] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-02T20:48:53.072995] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2024-12. [2025-10-02T20:48:53.873003] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-07. [2025-10-02T20:48:54.072601] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-02T20:48:54.074804] [INFO ] [REMOTE ] OXY: Full fetch complete (77570 records). [2025-10-02T20:48:54.074915] [DEBUG] [VALIDATOR ] OXY: Validating primary data. [2025-10-02T20:48:54.286432] [WARN ] [VALIDATOR ] OXY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-02T20:48:54.287484] [FATAL] [MAIN ] OXY: Fetched primary data is invalid. Refusing to save it. [2025-10-02T20:48:54.287586] [WARN ] [MAIN ] OXY: Deleting existing primary and derivative data due to validation failure. [2025-10-02T20:48:54.287707] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-10-02T20:48:54.287818] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-10-02T20:48:54.287879] [INFO ] [LOCAL ] OXY: Starting deletion of derivative data. [2025-10-02T20:48:54.287926] [DEBUG] [LOCAL ] OXY: No derivative data file found to delete. [2025-10-02T20:48:54.287997] [INFO ] [MAIN ] Update Progress: 1623/2370 symbols completed. OXY took 50.0s. Estimated remaining: 1h 45m 20s. Rate: 7.1 symbols/min [2025-10-02T20:48:54.519624] [INFO ] [MAIN ] PAI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:48:54.519890] [DEBUG] [LOCAL ] PAI: No existing data file found in primary storage. [2025-10-02T20:48:54.519954] [WARN ] [MAIN ] PAI: No existing data found, performing full refresh instead. [2025-10-02T20:48:54.520094] [INFO ] [MAIN ] PAI: Wiping existing primary data before full refresh. [2025-10-02T20:48:54.520158] [INFO ] [LOCAL ] PAI: Starting deletion of primary data. [2025-10-02T20:48:54.520231] [DEBUG] [LOCAL ] PAI: No primary data file found to delete. [2025-10-02T20:48:54.520284] [INFO ] [MAIN ] PAI: Starting full primary refresh. [2025-10-02T20:48:54.679603] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-02. [2025-10-02T20:48:54.927616] [INFO ] [REMOTE ] PAI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:48:54.959303] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-02T20:48:55.283842] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-02T20:48:55.472993] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-01. [2025-10-02T20:48:55.974910] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-02T20:48:56.273045] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-03. [2025-10-02T20:48:57.073009] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-08. [2025-10-02T20:48:57.873012] [INFO ] [REMOTE ] PAI: Fetching primary data for 2024-12. [2025-10-02T20:48:58.011702] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-01 (2.54 seconds). [2025-10-02T20:48:58.546620] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-02T20:48:58.673030] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-02. [2025-10-02T20:48:58.812002] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-02T20:48:59.235215] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-02T20:48:59.473032] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-01. [2025-10-02T20:49:00.159678] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-02T20:49:00.272970] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-02. [2025-10-02T20:49:00.310797] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-02T20:49:00.803894] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-02T20:49:01.073029] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-03. [2025-10-02T20:49:01.873059] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-09. [2025-10-02T20:49:02.637611] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-02T20:49:02.672998] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-04. [2025-10-02T20:49:03.472995] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-03. [2025-10-02T20:49:04.273038] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-04. [2025-10-02T20:49:05.110419] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-02T20:49:05.111955] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-05. [2025-10-02T20:49:05.250518] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-09 (3.38 seconds). [2025-10-02T20:49:05.529774] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-04 (2.86 seconds). [2025-10-02T20:49:05.631482] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-02T20:49:05.872984] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-06. [2025-10-02T20:49:06.011952] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-03 (2.54 seconds). [2025-10-02T20:49:06.319694] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-02T20:49:06.673035] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-05. [2025-10-02T20:49:07.454800] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-02T20:49:07.472996] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-07. [2025-10-02T20:49:08.003675] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-02T20:49:08.273002] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-10. [2025-10-02T20:49:09.073020] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-08. [2025-10-02T20:49:09.614297] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-02T20:49:09.615937] [INFO ] [REMOTE ] PACS: Full fetch complete (50712 records). [2025-10-02T20:49:09.616027] [DEBUG] [VALIDATOR ] PACS: Validating primary data. [2025-10-02T20:49:09.878467] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-04. [2025-10-02T20:49:09.936738] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-02T20:49:10.030399] [DEBUG] [VALIDATOR ] PACS: All expected trading days are present. [2025-10-02T20:49:10.030480] [DEBUG] [VALIDATOR ] PACS: Primary data validation passed. [2025-10-02T20:49:10.031346] [INFO ] [MAIN ] PACS: Fetched primary data is valid. [2025-10-02T20:49:10.031411] [DEBUG] [LOCAL ] PACS: Saving primary data. [2025-10-02T20:49:10.032748] [DEBUG] [LOCAL ] PACS: Trimmed 50712 records to 34614 (keeping 200 days of data) [2025-10-02T20:49:10.245240] [DEBUG] [LOCAL ] PACS: Primary data saved (34614 records). [2025-10-02T20:49:10.245386] [INFO ] [MAIN ] PACS: Full history saved. [2025-10-02T20:49:10.245462] [INFO ] [MAIN ] Update Progress: 1624/2370 symbols completed. PACS took 33.8s. Estimated remaining: 1h 45m 15s. Rate: 7.1 symbols/min [2025-10-02T20:49:10.436414] [INFO ] [MAIN ] PAII: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:49:10.436767] [DEBUG] [LOCAL ] PAII: No existing data file found in primary storage. [2025-10-02T20:49:10.436824] [WARN ] [MAIN ] PAII: No existing data found, performing full refresh instead. [2025-10-02T20:49:10.437000] [INFO ] [MAIN ] PAII: Wiping existing primary data before full refresh. [2025-10-02T20:49:10.437063] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-10-02T20:49:10.437113] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-10-02T20:49:10.437148] [INFO ] [MAIN ] PAII: Starting full primary refresh. [2025-10-02T20:49:10.678107] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-06. [2025-10-02T20:49:10.827355] [INFO ] [REMOTE ] PAII: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:49:11.472981] [INFO ] [REMOTE ] PAII: Fetching primary data for 2024-12. [2025-10-02T20:49:11.788205] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-02T20:49:11.794080] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T20:49:11.795221] [WARN ] [REMOTE ] PAII: No data returned for month 2024-12 [2025-10-02T20:49:11.795315] [FATAL] [REMOTE ] PAII: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T20:49:11.795367] [FATAL] [MAIN ] PAII: Failed to fetch primary data. [2025-10-02T20:49:11.795429] [WARN ] [MAIN ] PAII: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T20:49:11.795505] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-10-02T20:49:11.795571] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-10-02T20:49:11.795609] [INFO ] [LOCAL ] PAII: Starting deletion of derivative data. [2025-10-02T20:49:11.795691] [DEBUG] [LOCAL ] PAII: No derivative data file found to delete. [2025-10-02T20:49:11.795768] [INFO ] [MAIN ] Update Progress: 1625/2370 symbols completed. PAII took 1.6s. Estimated remaining: 1h 45m 3s. Rate: 7.1 symbols/min [2025-10-02T20:49:11.997941] [INFO ] [MAIN ] PAM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:49:12.008501] [DEBUG] [LOCAL ] PAM: No existing data file found in primary storage. [2025-10-02T20:49:12.026506] [WARN ] [MAIN ] PAM: No existing data found, performing full refresh instead. [2025-10-02T20:49:12.028816] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-02T20:49:12.027589] [INFO ] [MAIN ] PAM: Wiping existing primary data before full refresh. [2025-10-02T20:49:12.039678] [INFO ] [LOCAL ] PAM: Starting deletion of primary data. [2025-10-02T20:49:12.040258] [DEBUG] [LOCAL ] PAM: No primary data file found to delete. [2025-10-02T20:49:12.040347] [INFO ] [MAIN ] PAM: Starting full primary refresh. [2025-10-02T20:49:12.278207] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-07. [2025-10-02T20:49:12.426940] [INFO ] [REMOTE ] PAM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:49:13.073003] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-05. [2025-10-02T20:49:13.592506] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-02T20:49:13.872998] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-09. [2025-10-02T20:49:14.673021] [INFO ] [REMOTE ] PAM: Fetching primary data for 2024-12. [2025-10-02T20:49:15.353194] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-02T20:49:15.473035] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-08. [2025-10-02T20:49:16.273001] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-10. [2025-10-02T20:49:16.376148] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-05 (3.30 seconds). [2025-10-02T20:49:17.005261] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-02T20:49:17.006002] [INFO ] [REMOTE ] PAI: Full fetch complete (4070 records). [2025-10-02T20:49:17.006076] [DEBUG] [VALIDATOR ] PAI: Validating primary data. [2025-10-02T20:49:17.075678] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-06. [2025-10-02T20:49:17.400438] [DEBUG] [VALIDATOR ] PAI: All expected trading days are present. [2025-10-02T20:49:17.400554] [DEBUG] [VALIDATOR ] PAI: Primary data validation passed. [2025-10-02T20:49:17.400796] [INFO ] [MAIN ] PAI: Fetched primary data is valid. [2025-10-02T20:49:17.400920] [DEBUG] [LOCAL ] PAI: Saving primary data. [2025-10-02T20:49:17.401581] [DEBUG] [LOCAL ] PAI: Trimmed 4070 records to 2695 (keeping 200 days of data) [2025-10-02T20:49:17.434576] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-02T20:49:17.435631] [DEBUG] [LOCAL ] PAI: Primary data saved (2695 records). [2025-10-02T20:49:17.441520] [INFO ] [MAIN ] PAI: Full history saved. [2025-10-02T20:49:17.441735] [INFO ] [MAIN ] Update Progress: 1626/2370 symbols completed. PAI took 23.2s. Estimated remaining: 1h 44m 53s. Rate: 7.1 symbols/min [2025-10-02T20:49:17.539844] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2024-12 (2.87 seconds). [2025-10-02T20:49:17.667980] [INFO ] [MAIN ] PAR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:49:17.668216] [DEBUG] [LOCAL ] PAR: No existing data file found in primary storage. [2025-10-02T20:49:17.668270] [WARN ] [MAIN ] PAR: No existing data found, performing full refresh instead. [2025-10-02T20:49:17.668391] [INFO ] [MAIN ] PAR: Wiping existing primary data before full refresh. [2025-10-02T20:49:17.668454] [INFO ] [LOCAL ] PAR: Starting deletion of primary data. [2025-10-02T20:49:17.668498] [DEBUG] [LOCAL ] PAR: No primary data file found to delete. [2025-10-02T20:49:17.668533] [INFO ] [MAIN ] PAR: Starting full primary refresh. [2025-10-02T20:49:17.885006] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-01. [2025-10-02T20:49:18.043018] [INFO ] [REMOTE ] PAR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:49:18.673029] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-09. [2025-10-02T20:49:18.991588] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-02T20:49:19.443035] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-02T20:49:19.473036] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-10. [2025-10-02T20:49:19.652886] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-02T20:49:20.273014] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-02. [2025-10-02T20:49:20.279593] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-02T20:49:20.281460] [INFO ] [REMOTE ] PAG: Full fetch complete (30299 records). [2025-10-02T20:49:20.281790] [DEBUG] [VALIDATOR ] PAG: Validating primary data. [2025-10-02T20:49:20.693855] [DEBUG] [VALIDATOR ] PAG: All expected trading days are present. [2025-10-02T20:49:20.693957] [DEBUG] [VALIDATOR ] PAG: Primary data validation passed. [2025-10-02T20:49:20.694689] [INFO ] [MAIN ] PAG: Fetched primary data is valid. [2025-10-02T20:49:20.694756] [DEBUG] [LOCAL ] PAG: Saving primary data. [2025-10-02T20:49:20.695525] [DEBUG] [LOCAL ] PAG: Trimmed 30299 records to 21862 (keeping 200 days of data) [2025-10-02T20:49:20.847336] [DEBUG] [LOCAL ] PAG: Primary data saved (21862 records). [2025-10-02T20:49:20.847470] [INFO ] [MAIN ] PAG: Full history saved. [2025-10-02T20:49:20.847547] [INFO ] [MAIN ] Update Progress: 1627/2370 symbols completed. PAG took 31.9s. Estimated remaining: 1h 44m 42s. Rate: 7.1 symbols/min [2025-10-02T20:49:21.031236] [INFO ] [MAIN ] PARR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:49:21.031457] [DEBUG] [LOCAL ] PARR: No existing data file found in primary storage. [2025-10-02T20:49:21.031518] [WARN ] [MAIN ] PARR: No existing data found, performing full refresh instead. [2025-10-02T20:49:21.031681] [INFO ] [MAIN ] PARR: Wiping existing primary data before full refresh. [2025-10-02T20:49:21.031744] [INFO ] [LOCAL ] PARR: Starting deletion of primary data. [2025-10-02T20:49:21.031794] [DEBUG] [LOCAL ] PARR: No primary data file found to delete. [2025-10-02T20:49:21.031833] [INFO ] [MAIN ] PARR: Starting full primary refresh. [2025-10-02T20:49:21.078636] [INFO ] [REMOTE ] PAR: Fetching primary data for 2024-12. [2025-10-02T20:49:21.434457] [INFO ] [REMOTE ] PARR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:49:21.452040] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-02T20:49:21.872999] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-03. [2025-10-02T20:49:22.512411] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-02T20:49:22.673029] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-01. [2025-10-02T20:49:22.939223] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-02T20:49:23.472994] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-04. [2025-10-02T20:49:24.278123] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-07. [2025-10-02T20:49:24.295400] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-02T20:49:24.892948] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-02T20:49:25.073007] [INFO ] [REMOTE ] PARR: Fetching primary data for 2024-12. [2025-10-02T20:49:25.878222] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-02. [2025-10-02T20:49:25.894301] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-02T20:49:26.645770] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-02T20:49:26.672964] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-01. [2025-10-02T20:49:26.887137] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-02T20:49:27.472987] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-05. [2025-10-02T20:49:28.272972] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-03. [2025-10-02T20:49:28.307400] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-02T20:49:28.732289] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-02T20:49:29.073001] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-08. [2025-10-02T20:49:29.459589] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-02T20:49:29.873002] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-04. [2025-10-02T20:49:30.673003] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-06. [2025-10-02T20:49:30.716233] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-02T20:49:31.382844] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-02T20:49:31.472964] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-09. [2025-10-02T20:49:31.841289] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-02T20:49:32.273026] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-07. [2025-10-02T20:49:33.072964] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-02. [2025-10-02T20:49:33.406337] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-02T20:49:33.599170] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-02T20:49:33.873014] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-10. [2025-10-02T20:49:34.393512] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-02T20:49:34.673010] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-03. [2025-10-02T20:49:34.913623] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-02T20:49:34.915822] [INFO ] [REMOTE ] PAGS: Full fetch complete (76337 records). [2025-10-02T20:49:34.915941] [DEBUG] [VALIDATOR ] PAGS: Validating primary data. [2025-10-02T20:49:35.333731] [DEBUG] [VALIDATOR ] PAGS: All expected trading days are present. [2025-10-02T20:49:35.333828] [DEBUG] [VALIDATOR ] PAGS: Primary data validation passed. [2025-10-02T20:49:35.334887] [INFO ] [MAIN ] PAGS: Fetched primary data is valid. [2025-10-02T20:49:35.334957] [DEBUG] [LOCAL ] PAGS: Saving primary data. [2025-10-02T20:49:35.336573] [DEBUG] [LOCAL ] PAGS: Trimmed 76337 records to 53105 (keeping 200 days of data) [2025-10-02T20:49:35.473288] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-05. [2025-10-02T20:49:35.690337] [DEBUG] [LOCAL ] PAGS: Primary data saved (53105 records). [2025-10-02T20:49:35.690598] [INFO ] [MAIN ] PAGS: Full history saved. [2025-10-02T20:49:35.690734] [INFO ] [MAIN ] Update Progress: 1628/2370 symbols completed. PAGS took 45.2s. Estimated remaining: 1h 44m 37s. Rate: 7.1 symbols/min [2025-10-02T20:49:35.900307] [INFO ] [MAIN ] PATH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:49:35.900555] [DEBUG] [LOCAL ] PATH: No existing data file found in primary storage. [2025-10-02T20:49:35.901072] [WARN ] [MAIN ] PATH: No existing data found, performing full refresh instead. [2025-10-02T20:49:35.901220] [INFO ] [MAIN ] PATH: Wiping existing primary data before full refresh. [2025-10-02T20:49:35.901266] [INFO ] [LOCAL ] PATH: Starting deletion of primary data. [2025-10-02T20:49:35.901311] [DEBUG] [LOCAL ] PATH: No primary data file found to delete. [2025-10-02T20:49:35.901346] [INFO ] [MAIN ] PATH: Starting full primary refresh. [2025-10-02T20:49:36.277548] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-08. [2025-10-02T20:49:36.294917] [INFO ] [REMOTE ] PATH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:49:36.326118] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-02T20:49:36.935760] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-02T20:49:37.073156] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-06. [2025-10-02T20:49:37.379899] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-02T20:49:37.873024] [INFO ] [REMOTE ] PATH: Fetching primary data for 2024-12. [2025-10-02T20:49:38.069935] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-02T20:49:38.673015] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-04. [2025-10-02T20:49:39.473027] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-09. [2025-10-02T20:49:39.784912] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-02T20:49:40.272993] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-07. [2025-10-02T20:49:40.456813] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-02T20:49:41.035854] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-02T20:49:41.073004] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-05. [2025-10-02T20:49:41.621982] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-02T20:49:41.872994] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-08. [2025-10-02T20:49:42.673006] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-01. [2025-10-02T20:49:42.833491] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-02T20:49:43.472995] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-10. [2025-10-02T20:49:43.607245] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-02T20:49:44.273010] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-06. [2025-10-02T20:49:44.370103] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-02T20:49:44.371775] [INFO ] [REMOTE ] PAM: Full fetch complete (42117 records). [2025-10-02T20:49:44.371859] [DEBUG] [VALIDATOR ] PAM: Validating primary data. [2025-10-02T20:49:44.794366] [DEBUG] [VALIDATOR ] PAM: All expected trading days are present. [2025-10-02T20:49:44.794587] [DEBUG] [VALIDATOR ] PAM: Primary data validation passed. [2025-10-02T20:49:44.795426] [INFO ] [MAIN ] PAM: Fetched primary data is valid. [2025-10-02T20:49:44.795508] [DEBUG] [LOCAL ] PAM: Saving primary data. [2025-10-02T20:49:44.796990] [DEBUG] [LOCAL ] PAM: Trimmed 42117 records to 28448 (keeping 200 days of data) [2025-10-02T20:49:44.923205] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-02T20:49:45.015442] [DEBUG] [LOCAL ] PAM: Primary data saved (28448 records). [2025-10-02T20:49:45.015620] [INFO ] [MAIN ] PAM: Full history saved. [2025-10-02T20:49:45.015741] [INFO ] [MAIN ] Update Progress: 1629/2370 symbols completed. PAM took 33.2s. Estimated remaining: 1h 44m 29s. Rate: 7.1 symbols/min [2025-10-02T20:49:45.083816] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-09. [2025-10-02T20:49:45.209150] [INFO ] [MAIN ] PAXS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:49:45.209377] [DEBUG] [LOCAL ] PAXS: No existing data file found in primary storage. [2025-10-02T20:49:45.209433] [WARN ] [MAIN ] PAXS: No existing data found, performing full refresh instead. [2025-10-02T20:49:45.209548] [INFO ] [MAIN ] PAXS: Wiping existing primary data before full refresh. [2025-10-02T20:49:45.209590] [INFO ] [LOCAL ] PAXS: Starting deletion of primary data. [2025-10-02T20:49:45.209632] [DEBUG] [LOCAL ] PAXS: No primary data file found to delete. [2025-10-02T20:49:45.209706] [INFO ] [MAIN ] PAXS: Starting full primary refresh. [2025-10-02T20:49:45.609852] [INFO ] [REMOTE ] PAXS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:49:45.805003] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-02T20:49:45.872989] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-07. [2025-10-02T20:49:46.673022] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2024-12. [2025-10-02T20:49:46.928976] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-02T20:49:47.472975] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-10. [2025-10-02T20:49:47.517267] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-02T20:49:48.050205] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-02T20:49:48.273044] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-01. [2025-10-02T20:49:48.674758] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-02T20:49:48.676562] [INFO ] [REMOTE ] PAR: Full fetch complete (47918 records). [2025-10-02T20:49:48.676670] [DEBUG] [VALIDATOR ] PAR: Validating primary data. [2025-10-02T20:49:49.075118] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-08. [2025-10-02T20:49:49.088266] [DEBUG] [VALIDATOR ] PAR: All expected trading days are present. [2025-10-02T20:49:49.088345] [DEBUG] [VALIDATOR ] PAR: Primary data validation passed. [2025-10-02T20:49:49.089206] [INFO ] [MAIN ] PAR: Fetched primary data is valid. [2025-10-02T20:49:49.089268] [DEBUG] [LOCAL ] PAR: Saving primary data. [2025-10-02T20:49:49.090402] [DEBUG] [LOCAL ] PAR: Trimmed 47918 records to 33104 (keeping 200 days of data) [2025-10-02T20:49:49.301530] [DEBUG] [LOCAL ] PAR: Primary data saved (33104 records). [2025-10-02T20:49:49.301719] [INFO ] [MAIN ] PAR: Full history saved. [2025-10-02T20:49:49.301856] [INFO ] [MAIN ] Update Progress: 1630/2370 symbols completed. PAR took 31.9s. Estimated remaining: 1h 44m 18s. Rate: 7.1 symbols/min [2025-10-02T20:49:49.502999] [INFO ] [MAIN ] PAY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:49:49.504480] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-02T20:49:49.504874] [DEBUG] [LOCAL ] PAY: No existing data file found in primary storage. [2025-10-02T20:49:49.510007] [WARN ] [MAIN ] PAY: No existing data found, performing full refresh instead. [2025-10-02T20:49:49.511120] [INFO ] [MAIN ] PAY: Wiping existing primary data before full refresh. [2025-10-02T20:49:49.511199] [INFO ] [LOCAL ] PAY: Starting deletion of primary data. [2025-10-02T20:49:49.511251] [DEBUG] [LOCAL ] PAY: No primary data file found to delete. [2025-10-02T20:49:49.511288] [INFO ] [MAIN ] PAY: Starting full primary refresh. [2025-10-02T20:49:49.887247] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-02. [2025-10-02T20:49:49.933250] [INFO ] [REMOTE ] PAY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:49:50.601775] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-02T20:49:50.673041] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-02. [2025-10-02T20:49:50.997216] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-02T20:49:51.472986] [INFO ] [REMOTE ] PAY: Fetching primary data for 2024-12. [2025-10-02T20:49:52.273013] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-03. [2025-10-02T20:49:52.873947] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-02T20:49:52.970257] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-02T20:49:52.979409] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-02T20:49:53.073024] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-09. [2025-10-02T20:49:53.873028] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-01. [2025-10-02T20:49:54.672983] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-03. [2025-10-02T20:49:54.710908] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-02T20:49:55.323215] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-02T20:49:55.472999] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-10. [2025-10-02T20:49:56.273046] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-04. [2025-10-02T20:49:57.072995] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-02. [2025-10-02T20:49:57.452252] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-03 (2.78 seconds). [2025-10-02T20:49:57.531525] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-02T20:49:57.533550] [INFO ] [REMOTE ] PARR: Full fetch complete (68951 records). [2025-10-02T20:49:57.533715] [DEBUG] [VALIDATOR ] PARR: Validating primary data. [2025-10-02T20:49:57.878129] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-04. [2025-10-02T20:49:57.956617] [DEBUG] [VALIDATOR ] PARR: All expected trading days are present. [2025-10-02T20:49:57.956752] [DEBUG] [VALIDATOR ] PARR: Primary data validation passed. [2025-10-02T20:49:57.957865] [INFO ] [MAIN ] PARR: Fetched primary data is valid. [2025-10-02T20:49:57.957935] [DEBUG] [LOCAL ] PARR: Saving primary data. [2025-10-02T20:49:57.959801] [DEBUG] [LOCAL ] PARR: Trimmed 68951 records to 48667 (keeping 200 days of data) [2025-10-02T20:49:58.259602] [DEBUG] [LOCAL ] PARR: Primary data saved (48667 records). [2025-10-02T20:49:58.259799] [INFO ] [MAIN ] PARR: Full history saved. [2025-10-02T20:49:58.259887] [INFO ] [MAIN ] Update Progress: 1631/2370 symbols completed. PARR took 37.4s. Estimated remaining: 1h 44m 10s. Rate: 7.1 symbols/min [2025-10-02T20:49:58.475160] [INFO ] [MAIN ] PAYC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:49:58.475335] [DEBUG] [LOCAL ] PAYC: No existing data file found in primary storage. [2025-10-02T20:49:58.475384] [WARN ] [MAIN ] PAYC: No existing data found, performing full refresh instead. [2025-10-02T20:49:58.475503] [INFO ] [MAIN ] PAYC: Wiping existing primary data before full refresh. [2025-10-02T20:49:58.475552] [INFO ] [LOCAL ] PAYC: Starting deletion of primary data. [2025-10-02T20:49:58.475663] [DEBUG] [LOCAL ] PAYC: No primary data file found to delete. [2025-10-02T20:49:58.475732] [INFO ] [MAIN ] PAYC: Starting full primary refresh. [2025-10-02T20:49:58.869776] [INFO ] [REMOTE ] PAYC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:49:58.870206] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2024-12. [2025-10-02T20:50:00.149194] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-04 (3.88 seconds). [2025-10-02T20:50:00.155210] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-05. [2025-10-02T20:50:00.216257] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-02 (3.14 seconds). [2025-10-02T20:50:00.272980] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-03. [2025-10-02T20:50:00.557317] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-02T20:50:00.828586] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-04 (2.95 seconds). [2025-10-02T20:50:01.064375] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-02T20:50:01.072944] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-06. [2025-10-02T20:50:01.873046] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-05. [2025-10-02T20:50:02.022876] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-02T20:50:02.334592] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-02T20:50:02.673032] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-01. [2025-10-02T20:50:03.473011] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-04. [2025-10-02T20:50:04.273036] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-07. [2025-10-02T20:50:04.961502] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-05 (3.09 seconds). [2025-10-02T20:50:05.032972] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-01 (2.36 seconds). [2025-10-02T20:50:05.073004] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-02. [2025-10-02T20:50:05.223417] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-02T20:50:05.665610] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-02T20:50:05.872962] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-05. [2025-10-02T20:50:06.123154] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-02T20:50:06.672984] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-08. [2025-10-02T20:50:07.478209] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-03. [2025-10-02T20:50:07.495765] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-02T20:50:07.777878] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-02T20:50:08.273024] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-06. [2025-10-02T20:50:09.072988] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-09. [2025-10-02T20:50:09.198130] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-02T20:50:09.872991] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-04. [2025-10-02T20:50:10.027445] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-02T20:50:10.509596] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-02T20:50:10.673017] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-06. [2025-10-02T20:50:11.473074] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-10. [2025-10-02T20:50:12.273086] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-07. [2025-10-02T20:50:13.758885] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-10 (2.29 seconds). [2025-10-02T20:50:13.760367] [INFO ] [REMOTE ] PAXS: Full fetch complete (30966 records). [2025-10-02T20:50:13.760508] [DEBUG] [VALIDATOR ] PAXS: Validating primary data. [2025-10-02T20:50:14.003917] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-04 (4.13 seconds). [2025-10-02T20:50:14.069981] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-05. [2025-10-02T20:50:14.236278] [DEBUG] [VALIDATOR ] PAXS: All expected trading days are present. [2025-10-02T20:50:14.236512] [DEBUG] [VALIDATOR ] PAXS: Primary data validation passed. [2025-10-02T20:50:14.237490] [INFO ] [MAIN ] PAXS: Fetched primary data is valid. [2025-10-02T20:50:14.237612] [DEBUG] [LOCAL ] PAXS: Saving primary data. [2025-10-02T20:50:14.255252] [DEBUG] [LOCAL ] PAXS: Trimmed 30966 records to 20955 (keeping 200 days of data) [2025-10-02T20:50:14.266988] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-02T20:50:14.276024] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-08. [2025-10-02T20:50:14.434126] [DEBUG] [LOCAL ] PAXS: Primary data saved (20955 records). [2025-10-02T20:50:14.434300] [INFO ] [MAIN ] PAXS: Full history saved. [2025-10-02T20:50:14.434421] [INFO ] [MAIN ] Update Progress: 1632/2370 symbols completed. PAXS took 29.4s. Estimated remaining: 1h 44m 5s. Rate: 7.1 symbols/min [2025-10-02T20:50:14.654963] [INFO ] [MAIN ] PB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:50:14.655277] [DEBUG] [LOCAL ] PB: No existing data file found in primary storage. [2025-10-02T20:50:14.655346] [WARN ] [MAIN ] PB: No existing data found, performing full refresh instead. [2025-10-02T20:50:14.655574] [INFO ] [MAIN ] PB: Wiping existing primary data before full refresh. [2025-10-02T20:50:14.655670] [INFO ] [LOCAL ] PB: Starting deletion of primary data. [2025-10-02T20:50:14.655949] [DEBUG] [LOCAL ] PB: No primary data file found to delete. [2025-10-02T20:50:14.656091] [INFO ] [MAIN ] PB: Starting full primary refresh. [2025-10-02T20:50:14.980821] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-06 (4.31 seconds). [2025-10-02T20:50:15.030074] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-07. [2025-10-02T20:50:15.111719] [INFO ] [REMOTE ] PB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:50:15.473044] [INFO ] [REMOTE ] PB: Fetching primary data for 2024-12. [2025-10-02T20:50:15.512329] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-02T20:50:16.025393] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-02T20:50:16.273008] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-06. [2025-10-02T20:50:17.073065] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-09. [2025-10-02T20:50:17.121296] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-02T20:50:17.246317] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-02T20:50:17.789002] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-02T20:50:17.873043] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-01. [2025-10-02T20:50:18.679915] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-08. [2025-10-02T20:50:18.705083] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-02T20:50:19.155830] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-02T20:50:19.473049] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-10. [2025-10-02T20:50:20.273035] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-07. [2025-10-02T20:50:20.742934] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-02T20:50:20.745613] [INFO ] [REMOTE ] PAY: Full fetch complete (53344 records). [2025-10-02T20:50:20.747374] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-02T20:50:20.747684] [DEBUG] [VALIDATOR ] PAY: Validating primary data. [2025-10-02T20:50:21.080031] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-09. [2025-10-02T20:50:21.187812] [DEBUG] [VALIDATOR ] PAY: All expected trading days are present. [2025-10-02T20:50:21.187897] [DEBUG] [VALIDATOR ] PAY: Primary data validation passed. [2025-10-02T20:50:21.189037] [INFO ] [MAIN ] PAY: Fetched primary data is valid. [2025-10-02T20:50:21.189105] [DEBUG] [LOCAL ] PAY: Saving primary data. [2025-10-02T20:50:21.190401] [DEBUG] [LOCAL ] PAY: Trimmed 53344 records to 38293 (keeping 200 days of data) [2025-10-02T20:50:21.420986] [DEBUG] [LOCAL ] PAY: Primary data saved (38293 records). [2025-10-02T20:50:21.421144] [INFO ] [MAIN ] PAY: Full history saved. [2025-10-02T20:50:21.421224] [INFO ] [MAIN ] Update Progress: 1633/2370 symbols completed. PAY took 32.1s. Estimated remaining: 1h 43m 56s. Rate: 7.1 symbols/min [2025-10-02T20:50:21.614833] [INFO ] [MAIN ] PBA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:50:21.615025] [DEBUG] [LOCAL ] PBA: No existing data file found in primary storage. [2025-10-02T20:50:21.615067] [WARN ] [MAIN ] PBA: No existing data found, performing full refresh instead. [2025-10-02T20:50:21.615182] [INFO ] [MAIN ] PBA: Wiping existing primary data before full refresh. [2025-10-02T20:50:21.615254] [INFO ] [LOCAL ] PBA: Starting deletion of primary data. [2025-10-02T20:50:21.615361] [DEBUG] [LOCAL ] PBA: No primary data file found to delete. [2025-10-02T20:50:21.615428] [INFO ] [MAIN ] PBA: Starting full primary refresh. [2025-10-02T20:50:21.882783] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-02. [2025-10-02T20:50:22.007745] [INFO ] [REMOTE ] PBA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:50:22.448303] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-02T20:50:22.673051] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-08. [2025-10-02T20:50:23.473032] [INFO ] [REMOTE ] PBA: Fetching primary data for 2024-12. [2025-10-02T20:50:23.505153] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-02T20:50:23.790319] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-09 (2.71 seconds). [2025-10-02T20:50:23.824378] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-02T20:50:24.272995] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-10. [2025-10-02T20:50:25.073016] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-03. [2025-10-02T20:50:25.147835] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-02T20:50:25.873015] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-01. [2025-10-02T20:50:26.321550] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-02T20:50:26.323630] [INFO ] [REMOTE ] PATH: Full fetch complete (77764 records). [2025-10-02T20:50:26.323796] [DEBUG] [VALIDATOR ] PATH: Validating primary data. [2025-10-02T20:50:26.678211] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-09. [2025-10-02T20:50:26.775548] [DEBUG] [VALIDATOR ] PATH: All expected trading days are present. [2025-10-02T20:50:26.775722] [DEBUG] [VALIDATOR ] PATH: Primary data validation passed. [2025-10-02T20:50:26.777068] [INFO ] [MAIN ] PATH: Fetched primary data is valid. [2025-10-02T20:50:26.777267] [DEBUG] [LOCAL ] PATH: Saving primary data. [2025-10-02T20:50:26.803614] [DEBUG] [LOCAL ] PATH: Trimmed 77764 records to 54067 (keeping 200 days of data) [2025-10-02T20:50:26.805558] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-02T20:50:27.168598] [DEBUG] [LOCAL ] PATH: Primary data saved (54067 records). [2025-10-02T20:50:27.168784] [INFO ] [MAIN ] PATH: Full history saved. [2025-10-02T20:50:27.168900] [INFO ] [MAIN ] Update Progress: 1634/2370 symbols completed. PATH took 51.5s. Estimated remaining: 1h 43m 46s. Rate: 7.1 symbols/min [2025-10-02T20:50:27.360464] [INFO ] [MAIN ] PBF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:50:27.360875] [DEBUG] [LOCAL ] PBF: No existing data file found in primary storage. [2025-10-02T20:50:27.361005] [WARN ] [MAIN ] PBF: No existing data found, performing full refresh instead. [2025-10-02T20:50:27.361251] [INFO ] [MAIN ] PBF: Wiping existing primary data before full refresh. [2025-10-02T20:50:27.361439] [INFO ] [LOCAL ] PBF: Starting deletion of primary data. [2025-10-02T20:50:27.361666] [DEBUG] [LOCAL ] PBF: No primary data file found to delete. [2025-10-02T20:50:27.361734] [INFO ] [MAIN ] PBF: Starting full primary refresh. [2025-10-02T20:50:27.478500] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-04. [2025-10-02T20:50:27.713047] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-02T20:50:27.811264] [INFO ] [REMOTE ] PBF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:50:28.125441] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-02T20:50:28.273004] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-10. [2025-10-02T20:50:29.028952] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-02T20:50:29.073014] [INFO ] [REMOTE ] PBF: Fetching primary data for 2024-12. [2025-10-02T20:50:29.419446] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-02T20:50:29.421900] [INFO ] [REMOTE ] PAYC: Full fetch complete (53115 records). [2025-10-02T20:50:29.422001] [DEBUG] [VALIDATOR ] PAYC: Validating primary data. [2025-10-02T20:50:29.884122] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-02. [2025-10-02T20:50:29.887522] [DEBUG] [VALIDATOR ] PAYC: All expected trading days are present. [2025-10-02T20:50:29.889123] [DEBUG] [VALIDATOR ] PAYC: Primary data validation passed. [2025-10-02T20:50:29.890514] [INFO ] [MAIN ] PAYC: Fetched primary data is valid. [2025-10-02T20:50:29.890606] [DEBUG] [LOCAL ] PAYC: Saving primary data. [2025-10-02T20:50:29.892152] [DEBUG] [LOCAL ] PAYC: Trimmed 53115 records to 36666 (keeping 200 days of data) [2025-10-02T20:50:30.145956] [DEBUG] [LOCAL ] PAYC: Primary data saved (36666 records). [2025-10-02T20:50:30.146106] [INFO ] [MAIN ] PAYC: Full history saved. [2025-10-02T20:50:30.146230] [INFO ] [MAIN ] Update Progress: 1635/2370 symbols completed. PAYC took 31.9s. Estimated remaining: 1h 43m 36s. Rate: 7.1 symbols/min [2025-10-02T20:50:30.347022] [INFO ] [MAIN ] PBH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:50:30.347282] [DEBUG] [LOCAL ] PBH: No existing data file found in primary storage. [2025-10-02T20:50:30.347349] [WARN ] [MAIN ] PBH: No existing data found, performing full refresh instead. [2025-10-02T20:50:30.347489] [INFO ] [MAIN ] PBH: Wiping existing primary data before full refresh. [2025-10-02T20:50:30.347542] [INFO ] [LOCAL ] PBH: Starting deletion of primary data. [2025-10-02T20:50:30.347596] [DEBUG] [LOCAL ] PBH: No primary data file found to delete. [2025-10-02T20:50:30.347638] [INFO ] [MAIN ] PBH: Starting full primary refresh. [2025-10-02T20:50:30.678065] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-05. [2025-10-02T20:50:30.766164] [INFO ] [REMOTE ] PBH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:50:30.999318] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-02T20:50:31.472972] [INFO ] [REMOTE ] PBH: Fetching primary data for 2024-12. [2025-10-02T20:50:31.635837] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-02T20:50:32.272982] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-03. [2025-10-02T20:50:32.320230] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-02T20:50:32.388228] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-02T20:50:33.072996] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-01. [2025-10-02T20:50:33.872988] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-06. [2025-10-02T20:50:34.201326] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-02T20:50:34.672977] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-04. [2025-10-02T20:50:34.783326] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-02T20:50:35.456166] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-02T20:50:35.472970] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-07. [2025-10-02T20:50:36.049369] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-02T20:50:36.272995] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-05. [2025-10-02T20:50:36.952066] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-02T20:50:37.072994] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-02. [2025-10-02T20:50:37.873047] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-01. [2025-10-02T20:50:38.112947] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-02T20:50:38.673000] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-06. [2025-10-02T20:50:38.870215] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-02T20:50:38.929963] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-02T20:50:39.473000] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-03. [2025-10-02T20:50:40.285122] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-08. [2025-10-02T20:50:40.290991] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-02T20:50:41.073011] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-07. [2025-10-02T20:50:41.199256] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-02T20:50:41.872997] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-04. [2025-10-02T20:50:42.094075] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-02T20:50:42.673065] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-09. [2025-10-02T20:50:42.873843] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-02T20:50:43.473054] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-02. [2025-10-02T20:50:43.866332] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-02T20:50:44.272981] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-08. [2025-10-02T20:50:44.446122] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-02T20:50:44.750513] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-02T20:50:45.073024] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-05. [2025-10-02T20:50:45.872989] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-10. [2025-10-02T20:50:46.118322] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-02T20:50:46.672972] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-09. [2025-10-02T20:50:46.992617] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-02T20:50:47.212547] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-02T20:50:47.214625] [INFO ] [REMOTE ] PB: Full fetch complete (58713 records). [2025-10-02T20:50:47.214803] [DEBUG] [VALIDATOR ] PB: Validating primary data. [2025-10-02T20:50:47.478187] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-06. [2025-10-02T20:50:47.669603] [DEBUG] [VALIDATOR ] PB: All expected trading days are present. [2025-10-02T20:50:47.669747] [DEBUG] [VALIDATOR ] PB: Primary data validation passed. [2025-10-02T20:50:47.670796] [INFO ] [MAIN ] PB: Fetched primary data is valid. [2025-10-02T20:50:47.670894] [DEBUG] [LOCAL ] PB: Saving primary data. [2025-10-02T20:50:47.672340] [DEBUG] [LOCAL ] PB: Trimmed 58713 records to 41835 (keeping 200 days of data) [2025-10-02T20:50:47.950830] [DEBUG] [LOCAL ] PB: Primary data saved (41835 records). [2025-10-02T20:50:47.950985] [INFO ] [MAIN ] PB: Full history saved. [2025-10-02T20:50:47.951086] [INFO ] [MAIN ] Update Progress: 1636/2370 symbols completed. PB took 33.5s. Estimated remaining: 1h 43m 31s. Rate: 7.1 symbols/min [2025-10-02T20:50:48.142112] [INFO ] [MAIN ] PBI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:50:48.142464] [DEBUG] [LOCAL ] PBI: No existing data file found in primary storage. [2025-10-02T20:50:48.142570] [WARN ] [MAIN ] PBI: No existing data found, performing full refresh instead. [2025-10-02T20:50:48.142765] [INFO ] [MAIN ] PBI: Wiping existing primary data before full refresh. [2025-10-02T20:50:48.142835] [INFO ] [LOCAL ] PBI: Starting deletion of primary data. [2025-10-02T20:50:48.143080] [DEBUG] [LOCAL ] PBI: No primary data file found to delete. [2025-10-02T20:50:48.143153] [INFO ] [MAIN ] PBI: Starting full primary refresh. [2025-10-02T20:50:48.276490] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-03. [2025-10-02T20:50:48.569271] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-02T20:50:48.612629] [INFO ] [REMOTE ] PBI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:50:49.073017] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-10. [2025-10-02T20:50:49.453860] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-02T20:50:49.736633] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-02T20:50:49.873003] [INFO ] [REMOTE ] PBI: Fetching primary data for 2024-12. [2025-10-02T20:50:50.428010] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-02T20:50:50.431011] [INFO ] [REMOTE ] PBA: Full fetch complete (71396 records). [2025-10-02T20:50:50.431146] [DEBUG] [VALIDATOR ] PBA: Validating primary data. [2025-10-02T20:50:50.678159] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-04. [2025-10-02T20:50:50.886884] [DEBUG] [VALIDATOR ] PBA: All expected trading days are present. [2025-10-02T20:50:50.887236] [DEBUG] [VALIDATOR ] PBA: Primary data validation passed. [2025-10-02T20:50:50.888293] [INFO ] [MAIN ] PBA: Fetched primary data is valid. [2025-10-02T20:50:50.888357] [DEBUG] [LOCAL ] PBA: Saving primary data. [2025-10-02T20:50:50.890008] [DEBUG] [LOCAL ] PBA: Trimmed 71396 records to 49243 (keeping 200 days of data) [2025-10-02T20:50:51.224755] [DEBUG] [LOCAL ] PBA: Primary data saved (49243 records). [2025-10-02T20:50:51.224938] [INFO ] [MAIN ] PBA: Full history saved. [2025-10-02T20:50:51.225025] [INFO ] [MAIN ] Update Progress: 1637/2370 symbols completed. PBA took 29.8s. Estimated remaining: 1h 43m 20s. Rate: 7.1 symbols/min [2025-10-02T20:50:51.473015] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-07. [2025-10-02T20:50:51.863531] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-02T20:50:52.273806] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-01. [2025-10-02T20:50:52.276264] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-02T20:50:53.073019] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-05. [2025-10-02T20:50:53.464695] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-02T20:50:53.873060] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-08. [2025-10-02T20:50:53.952603] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-02T20:50:54.491884] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-02T20:50:54.673043] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-06. [2025-10-02T20:50:55.473007] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-02. [2025-10-02T20:50:55.712427] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-02T20:50:55.853120] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-02T20:50:56.273032] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-09. [2025-10-02T20:50:57.073060] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-07. [2025-10-02T20:50:58.245862] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-02 (2.77 seconds). [2025-10-02T20:50:58.255667] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-03. [2025-10-02T20:50:58.775249] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-02T20:50:58.811897] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-08. [2025-10-02T20:50:58.814747] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-09 (2.54 seconds). [2025-10-02T20:50:59.473006] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-10. [2025-10-02T20:51:00.290028] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-02T20:51:00.301834] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-04. [2025-10-02T20:51:00.375022] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-02T20:51:00.910092] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-02T20:51:00.912312] [INFO ] [REMOTE ] PBF: Full fetch complete (76616 records). [2025-10-02T20:51:00.912467] [DEBUG] [VALIDATOR ] PBF: Validating primary data. [2025-10-02T20:51:01.078207] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-09. [2025-10-02T20:51:01.347178] [DEBUG] [VALIDATOR ] PBF: All expected trading days are present. [2025-10-02T20:51:01.347261] [DEBUG] [VALIDATOR ] PBF: Primary data validation passed. [2025-10-02T20:51:01.348409] [INFO ] [MAIN ] PBF: Fetched primary data is valid. [2025-10-02T20:51:01.348473] [DEBUG] [LOCAL ] PBF: Saving primary data. [2025-10-02T20:51:01.350015] [DEBUG] [LOCAL ] PBF: Trimmed 76616 records to 53502 (keeping 200 days of data) [2025-10-02T20:51:01.743723] [DEBUG] [LOCAL ] PBF: Primary data saved (53502 records). [2025-10-02T20:51:01.743881] [INFO ] [MAIN ] PBF: Full history saved. [2025-10-02T20:51:01.744022] [INFO ] [MAIN ] Update Progress: 1638/2370 symbols completed. PBF took 34.6s. Estimated remaining: 1h 43m 13s. Rate: 7.1 symbols/min [2025-10-02T20:51:01.915856] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-02T20:51:01.927736] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-05. [2025-10-02T20:51:03.021008] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-02T20:51:03.030048] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-10. [2025-10-02T20:51:04.553349] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-05 (2.63 seconds). [2025-10-02T20:51:04.569987] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-06. [2025-10-02T20:51:04.668449] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-02T20:51:04.670823] [INFO ] [REMOTE ] PBH: Full fetch complete (43495 records). [2025-10-02T20:51:04.670951] [DEBUG] [VALIDATOR ] PBH: Validating primary data. [2025-10-02T20:51:05.138119] [DEBUG] [VALIDATOR ] PBH: All expected trading days are present. [2025-10-02T20:51:05.138238] [DEBUG] [VALIDATOR ] PBH: Primary data validation passed. [2025-10-02T20:51:05.139136] [INFO ] [MAIN ] PBH: Fetched primary data is valid. [2025-10-02T20:51:05.139199] [DEBUG] [LOCAL ] PBH: Saving primary data. [2025-10-02T20:51:05.140300] [DEBUG] [LOCAL ] PBH: Trimmed 43495 records to 32101 (keeping 200 days of data) [2025-10-02T20:51:05.348034] [DEBUG] [LOCAL ] PBH: Primary data saved (32101 records). [2025-10-02T20:51:05.348202] [INFO ] [MAIN ] PBH: Full history saved. [2025-10-02T20:51:05.348290] [INFO ] [MAIN ] Update Progress: 1639/2370 symbols completed. PBH took 35.2s. Estimated remaining: 1h 43m 2s. Rate: 7.1 symbols/min [2025-10-02T20:51:06.356619] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-02T20:51:06.367306] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-07. [2025-10-02T20:51:08.403787] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-02T20:51:08.416310] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-08. [2025-10-02T20:51:10.206842] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-02T20:51:10.218121] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-09. [2025-10-02T20:51:12.120056] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-02T20:51:12.131756] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-10. [2025-10-02T20:51:13.486591] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-02T20:51:13.492390] [INFO ] [REMOTE ] PBI: Full fetch complete (72066 records). [2025-10-02T20:51:13.492605] [DEBUG] [VALIDATOR ] PBI: Validating primary data. [2025-10-02T20:51:13.943262] [DEBUG] [VALIDATOR ] PBI: All expected trading days are present. [2025-10-02T20:51:13.943382] [DEBUG] [VALIDATOR ] PBI: Primary data validation passed. [2025-10-02T20:51:13.944588] [INFO ] [MAIN ] PBI: Fetched primary data is valid. [2025-10-02T20:51:13.944684] [DEBUG] [LOCAL ] PBI: Saving primary data. [2025-10-02T20:51:13.946252] [DEBUG] [LOCAL ] PBI: Trimmed 72066 records to 50322 (keeping 200 days of data) [2025-10-02T20:51:14.274014] [DEBUG] [LOCAL ] PBI: Primary data saved (50322 records). [2025-10-02T20:51:14.274156] [INFO ] [MAIN ] PBI: Full history saved. [2025-10-02T20:51:14.274232] [INFO ] [MAIN ] Update Progress: 1640/2370 symbols completed. PBI took 26.3s. Estimated remaining: 1h 42m 54s. Rate: 7.1 symbols/min [2025-10-02T20:51:14.945160] [INFO ] [MAIN ] PCF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:51:14.999607] [INFO ] [MAIN ] PBR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:51:15.047908] [INFO ] [MAIN ] PBT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:51:15.057785] [DEBUG] [LOCAL ] PBT: No existing data file found in primary storage. [2025-10-02T20:51:15.054690] [DEBUG] [LOCAL ] PCF: No existing data file found in primary storage. [2025-10-02T20:51:15.057674] [DEBUG] [LOCAL ] PBR: No existing data file found in primary storage. [2025-10-02T20:51:15.058053] [WARN ] [MAIN ] PCF: No existing data found, performing full refresh instead. [2025-10-02T20:51:15.084421] [INFO ] [MAIN ] PCF: Wiping existing primary data before full refresh. [2025-10-02T20:51:15.062907] [WARN ] [MAIN ] PBT: No existing data found, performing full refresh instead. [2025-10-02T20:51:15.084332] [INFO ] [MAIN ] PCG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:51:15.083193] [WARN ] [MAIN ] PBR: No existing data found, performing full refresh instead. [2025-10-02T20:51:15.084978] [INFO ] [MAIN ] PBR: Wiping existing primary data before full refresh. [2025-10-02T20:51:15.084676] [INFO ] [LOCAL ] PCF: Starting deletion of primary data. [2025-10-02T20:51:15.085411] [DEBUG] [LOCAL ] PCF: No primary data file found to delete. [2025-10-02T20:51:15.085335] [INFO ] [LOCAL ] PBR: Starting deletion of primary data. [2025-10-02T20:51:15.085690] [INFO ] [MAIN ] PCF: Starting full primary refresh. [2025-10-02T20:51:15.085845] [DEBUG] [LOCAL ] PCG: No existing data file found in primary storage. [2025-10-02T20:51:15.085936] [DEBUG] [LOCAL ] PBR: No primary data file found to delete. [2025-10-02T20:51:15.085230] [INFO ] [MAIN ] PBT: Wiping existing primary data before full refresh. [2025-10-02T20:51:15.108682] [INFO ] [MAIN ] PBR: Starting full primary refresh. [2025-10-02T20:51:15.108560] [WARN ] [MAIN ] PCG: No existing data found, performing full refresh instead. [2025-10-02T20:51:15.108496] [INFO ] [LOCAL ] PBT: Starting deletion of primary data. [2025-10-02T20:51:15.141337] [INFO ] [MAIN ] PCG: Wiping existing primary data before full refresh. [2025-10-02T20:51:15.152177] [INFO ] [LOCAL ] PCG: Starting deletion of primary data. [2025-10-02T20:51:15.167537] [DEBUG] [LOCAL ] PBT: No primary data file found to delete. [2025-10-02T20:51:15.206555] [INFO ] [MAIN ] PBT: Starting full primary refresh. [2025-10-02T20:51:15.188458] [DEBUG] [LOCAL ] PCG: No primary data file found to delete. [2025-10-02T20:51:15.235319] [INFO ] [MAIN ] PCG: Starting full primary refresh. [2025-10-02T20:51:16.410736] [INFO ] [REMOTE ] PCF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:51:16.426850] [INFO ] [REMOTE ] PCF: Fetching primary data for 2024-12. [2025-10-02T20:51:16.706733] [INFO ] [REMOTE ] PCG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:51:16.778820] [INFO ] [REMOTE ] PBR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:51:16.804098] [INFO ] [REMOTE ] PCG: Fetching primary data for 2024-12. [2025-10-02T20:51:16.805898] [INFO ] [REMOTE ] PBR: Fetching primary data for 2024-12. [2025-10-02T20:51:16.831509] [INFO ] [REMOTE ] PBT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:51:16.833929] [INFO ] [REMOTE ] PBT: Fetching primary data for 2024-12. [2025-10-02T20:51:17.792018] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-02T20:51:17.796114] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-01. [2025-10-02T20:51:18.055686] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-02T20:51:18.060410] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-01. [2025-10-02T20:51:18.433486] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-02T20:51:18.437142] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-02. [2025-10-02T20:51:18.579970] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-02T20:51:18.591447] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-01. [2025-10-02T20:51:18.871819] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-02T20:51:18.876200] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-02. [2025-10-02T20:51:18.964168] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-02T20:51:18.975243] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-01. [2025-10-02T20:51:19.322003] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-02T20:51:19.325480] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-03. [2025-10-02T20:51:20.101778] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-02T20:51:20.105700] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-03. [2025-10-02T20:51:20.248082] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-02T20:51:20.250761] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-04. [2025-10-02T20:51:20.529795] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-02T20:51:20.541504] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-02. [2025-10-02T20:51:20.756790] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-02T20:51:20.761246] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-04. [2025-10-02T20:51:21.201228] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-02T20:51:21.212616] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-02. [2025-10-02T20:51:21.345639] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-02T20:51:21.349244] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-05. [2025-10-02T20:51:21.694367] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-02T20:51:21.700310] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-05. [2025-10-02T20:51:21.838077] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-02T20:51:21.873075] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-06. [2025-10-02T20:51:22.558913] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-02T20:51:22.672991] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-03. [2025-10-02T20:51:22.692598] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-02T20:51:22.717080] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-02T20:51:23.361917] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-10-02T20:51:23.472993] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-06. [2025-10-02T20:51:24.272977] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-03. [2025-10-02T20:51:24.364115] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-02T20:51:24.705602] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-02T20:51:25.073013] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-07. [2025-10-02T20:51:25.873004] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-07. [2025-10-02T20:51:25.908717] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-02T20:51:26.274845] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-02T20:51:26.644505] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-02T20:51:26.672975] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-08. [2025-10-02T20:51:27.472988] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-08. [2025-10-02T20:51:27.856893] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-02T20:51:28.273003] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-09. [2025-10-02T20:51:28.358269] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-02T20:51:29.072984] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-09. [2025-10-02T20:51:29.557422] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-02T20:51:29.729145] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-02T20:51:29.873023] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-04. [2025-10-02T20:51:30.673016] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-10. [2025-10-02T20:51:31.266867] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-02T20:51:31.267852] [INFO ] [REMOTE ] PCF: Full fetch complete (14205 records). [2025-10-02T20:51:31.267936] [DEBUG] [VALIDATOR ] PCF: Validating primary data. [2025-10-02T20:51:31.481068] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-10. [2025-10-02T20:51:31.686780] [DEBUG] [VALIDATOR ] PCF: All expected trading days are present. [2025-10-02T20:51:31.686886] [DEBUG] [VALIDATOR ] PCF: Primary data validation passed. [2025-10-02T20:51:31.687280] [INFO ] [MAIN ] PCF: Fetched primary data is valid. [2025-10-02T20:51:31.687404] [DEBUG] [LOCAL ] PCF: Saving primary data. [2025-10-02T20:51:31.688359] [DEBUG] [LOCAL ] PCF: Trimmed 14205 records to 8961 (keeping 200 days of data) [2025-10-02T20:51:31.743492] [DEBUG] [LOCAL ] PCF: Primary data saved (8961 records). [2025-10-02T20:51:31.743633] [INFO ] [MAIN ] PCF: Full history saved. [2025-10-02T20:51:31.743749] [INFO ] [MAIN ] Update Progress: 1641/2370 symbols completed. PCF took 17.5s. Estimated remaining: 1h 42m 50s. Rate: 7.1 symbols/min [2025-10-02T20:51:31.949962] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-02T20:51:31.989998] [INFO ] [MAIN ] PCM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:51:31.990756] [DEBUG] [LOCAL ] PCM: No existing data file found in primary storage. [2025-10-02T20:51:31.990849] [WARN ] [MAIN ] PCM: No existing data found, performing full refresh instead. [2025-10-02T20:51:31.991415] [INFO ] [MAIN ] PCM: Wiping existing primary data before full refresh. [2025-10-02T20:51:31.991492] [INFO ] [LOCAL ] PCM: Starting deletion of primary data. [2025-10-02T20:51:31.991569] [DEBUG] [LOCAL ] PCM: No primary data file found to delete. [2025-10-02T20:51:31.991679] [INFO ] [MAIN ] PCM: Starting full primary refresh. [2025-10-02T20:51:32.281556] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-04. [2025-10-02T20:51:32.322788] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-02T20:51:32.366135] [INFO ] [REMOTE ] PBT: Full fetch complete (25319 records). [2025-10-02T20:51:32.402991] [DEBUG] [VALIDATOR ] PBT: Validating primary data. [2025-10-02T20:51:32.414755] [INFO ] [REMOTE ] PCM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:51:32.822739] [DEBUG] [VALIDATOR ] PBT: All expected trading days are present. [2025-10-02T20:51:32.822896] [DEBUG] [VALIDATOR ] PBT: Primary data validation passed. [2025-10-02T20:51:32.823502] [INFO ] [MAIN ] PBT: Fetched primary data is valid. [2025-10-02T20:51:32.823550] [DEBUG] [LOCAL ] PBT: Saving primary data. [2025-10-02T20:51:32.824519] [DEBUG] [LOCAL ] PBT: Trimmed 25319 records to 17399 (keeping 200 days of data) [2025-10-02T20:51:32.946179] [DEBUG] [LOCAL ] PBT: Primary data saved (17399 records). [2025-10-02T20:51:32.946340] [INFO ] [MAIN ] PBT: Full history saved. [2025-10-02T20:51:32.946436] [INFO ] [MAIN ] Update Progress: 1642/2370 symbols completed. PBT took 18.7s. Estimated remaining: 1h 42m 38s. Rate: 7.1 symbols/min [2025-10-02T20:51:33.078173] [INFO ] [REMOTE ] PCM: Fetching primary data for 2024-12. [2025-10-02T20:51:33.133567] [INFO ] [MAIN ] PCN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:51:33.133837] [DEBUG] [LOCAL ] PCN: No existing data file found in primary storage. [2025-10-02T20:51:33.133888] [WARN ] [MAIN ] PCN: No existing data found, performing full refresh instead. [2025-10-02T20:51:33.134019] [INFO ] [MAIN ] PCN: Wiping existing primary data before full refresh. [2025-10-02T20:51:33.134063] [INFO ] [LOCAL ] PCN: Starting deletion of primary data. [2025-10-02T20:51:33.134107] [DEBUG] [LOCAL ] PCN: No primary data file found to delete. [2025-10-02T20:51:33.134143] [INFO ] [MAIN ] PCN: Starting full primary refresh. [2025-10-02T20:51:33.519999] [INFO ] [REMOTE ] PCN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:51:33.873010] [INFO ] [REMOTE ] PCN: Fetching primary data for 2024-12. [2025-10-02T20:51:34.300000] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-02T20:51:34.510088] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-02T20:51:34.673012] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-05. [2025-10-02T20:51:35.377028] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-02T20:51:35.472982] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-01. [2025-10-02T20:51:36.272972] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-05. [2025-10-02T20:51:36.570244] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-02T20:51:36.580015] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-02T20:51:37.073002] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-06. [2025-10-02T20:51:37.872983] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-01. [2025-10-02T20:51:38.381381] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-02T20:51:38.673008] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-02. [2025-10-02T20:51:38.740318] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-02T20:51:38.931249] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-02T20:51:39.472987] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-02. [2025-10-02T20:51:39.845989] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-02T20:51:40.221843] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-02T20:51:40.272993] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-03. [2025-10-02T20:51:41.033487] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-02T20:51:41.072990] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-06. [2025-10-02T20:51:41.872996] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-03. [2025-10-02T20:51:42.673005] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-04. [2025-10-02T20:51:43.051427] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-02T20:51:43.234181] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-02T20:51:43.244443] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-02T20:51:43.472992] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-07. [2025-10-02T20:51:44.273010] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-04. [2025-10-02T20:51:45.073054] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-05. [2025-10-02T20:51:45.429766] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-02T20:51:45.538358] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-02T20:51:45.565605] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-02T20:51:45.873003] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-06. [2025-10-02T20:51:46.673002] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-07. [2025-10-02T20:51:46.720586] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-02T20:51:47.473018] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-07. [2025-10-02T20:51:48.182155] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-02T20:51:48.273024] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-05. [2025-10-02T20:51:49.072971] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-08. [2025-10-02T20:51:49.181918] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-10-02T20:51:49.557244] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-02T20:51:49.872992] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-06. [2025-10-02T20:51:50.672966] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-08. [2025-10-02T20:51:50.983970] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-02T20:51:51.473003] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-08. [2025-10-02T20:51:51.508818] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-10-02T20:51:52.273248] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-09. [2025-10-02T20:51:52.276247] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-02T20:51:52.763973] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-02T20:51:53.072995] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-09. [2025-10-02T20:51:53.708882] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-02T20:51:53.873022] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-10. [2025-10-02T20:51:53.908791] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-02T20:51:54.648592] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-02T20:51:54.649549] [INFO ] [REMOTE ] PCM: Full fetch complete (10457 records). [2025-10-02T20:51:54.649630] [DEBUG] [VALIDATOR ] PCM: Validating primary data. [2025-10-02T20:51:54.681428] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-07. [2025-10-02T20:51:55.067167] [DEBUG] [VALIDATOR ] PCM: All expected trading days are present. [2025-10-02T20:51:55.067247] [DEBUG] [VALIDATOR ] PCM: Primary data validation passed. [2025-10-02T20:51:55.067517] [INFO ] [MAIN ] PCM: Fetched primary data is valid. [2025-10-02T20:51:55.067560] [DEBUG] [LOCAL ] PCM: Saving primary data. [2025-10-02T20:51:55.068121] [DEBUG] [LOCAL ] PCM: Trimmed 10457 records to 6752 (keeping 200 days of data) [2025-10-02T20:51:55.111057] [DEBUG] [LOCAL ] PCM: Primary data saved (6752 records). [2025-10-02T20:51:55.111232] [INFO ] [MAIN ] PCM: Full history saved. [2025-10-02T20:51:55.111324] [INFO ] [MAIN ] Update Progress: 1643/2370 symbols completed. PCM took 23.4s. Estimated remaining: 1h 42m 36s. Rate: 7.1 symbols/min [2025-10-02T20:51:55.301464] [INFO ] [MAIN ] PCOR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:51:55.301700] [DEBUG] [LOCAL ] PCOR: No existing data file found in primary storage. [2025-10-02T20:51:55.301759] [WARN ] [MAIN ] PCOR: No existing data found, performing full refresh instead. [2025-10-02T20:51:55.301876] [INFO ] [MAIN ] PCOR: Wiping existing primary data before full refresh. [2025-10-02T20:51:55.301920] [INFO ] [LOCAL ] PCOR: Starting deletion of primary data. [2025-10-02T20:51:55.301964] [DEBUG] [LOCAL ] PCOR: No primary data file found to delete. [2025-10-02T20:51:55.301996] [INFO ] [MAIN ] PCOR: Starting full primary refresh. [2025-10-02T20:51:55.481793] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-09. [2025-10-02T20:51:55.709843] [INFO ] [REMOTE ] PCOR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:51:55.916796] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-02T20:51:56.273044] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-08. [2025-10-02T20:51:57.073116] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-10. [2025-10-02T20:51:57.873053] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2024-12. [2025-10-02T20:51:58.257730] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-09 (2.78 seconds). [2025-10-02T20:51:58.392344] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-02T20:51:58.672998] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-10. [2025-10-02T20:51:59.472996] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-09. [2025-10-02T20:51:59.695220] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-02T20:51:59.696856] [INFO ] [REMOTE ] PCG: Full fetch complete (77345 records). [2025-10-02T20:51:59.696976] [DEBUG] [VALIDATOR ] PCG: Validating primary data. [2025-10-02T20:51:59.697825] [FATAL] [VALIDATOR ] PCG: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T20:51:59.697916] [FATAL] [MAIN ] PCG: Fetched primary data is invalid. Refusing to save it. [2025-10-02T20:51:59.697962] [WARN ] [MAIN ] PCG: Deleting existing primary and derivative data due to validation failure. [2025-10-02T20:51:59.698007] [INFO ] [LOCAL ] PCG: Starting deletion of primary data. [2025-10-02T20:51:59.698080] [DEBUG] [LOCAL ] PCG: No primary data file found to delete. [2025-10-02T20:51:59.698168] [INFO ] [LOCAL ] PCG: Starting deletion of derivative data. [2025-10-02T20:51:59.698299] [DEBUG] [LOCAL ] PCG: No derivative data file found to delete. [2025-10-02T20:51:59.698382] [INFO ] [MAIN ] Update Progress: 1644/2370 symbols completed. PCG took 45.4s. Estimated remaining: 1h 42m 25s. Rate: 7.1 symbols/min [2025-10-02T20:51:59.822861] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-10 (2.75 seconds). [2025-10-02T20:51:59.864058] [INFO ] [REMOTE ] PBR: Full fetch complete (77777 records). [2025-10-02T20:51:59.894109] [DEBUG] [VALIDATOR ] PBR: Validating primary data. [2025-10-02T20:51:59.893995] [INFO ] [MAIN ] PCQ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:51:59.894492] [DEBUG] [LOCAL ] PCQ: No existing data file found in primary storage. [2025-10-02T20:51:59.894563] [WARN ] [MAIN ] PCQ: No existing data found, performing full refresh instead. [2025-10-02T20:51:59.895087] [INFO ] [MAIN ] PCQ: Wiping existing primary data before full refresh. [2025-10-02T20:51:59.952090] [INFO ] [LOCAL ] PCQ: Starting deletion of primary data. [2025-10-02T20:51:59.997693] [DEBUG] [LOCAL ] PCQ: No primary data file found to delete. [2025-10-02T20:52:00.000540] [INFO ] [MAIN ] PCQ: Starting full primary refresh. [2025-10-02T20:52:00.689010] [DEBUG] [VALIDATOR ] PBR: All expected trading days are present. [2025-10-02T20:52:00.689363] [DEBUG] [VALIDATOR ] PBR: Primary data validation passed. [2025-10-02T20:52:00.702122] [INFO ] [MAIN ] PBR: Fetched primary data is valid. [2025-10-02T20:52:00.702424] [DEBUG] [LOCAL ] PBR: Saving primary data. [2025-10-02T20:52:00.755673] [DEBUG] [LOCAL ] PBR: Trimmed 77777 records to 54102 (keeping 200 days of data) [2025-10-02T20:52:00.803566] [INFO ] [REMOTE ] PCQ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:52:00.804245] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2024-12. [2025-10-02T20:52:00.880171] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-02T20:52:00.957135] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2024-12 (3.08 seconds). [2025-10-02T20:52:01.075866] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-10. [2025-10-02T20:52:01.236261] [DEBUG] [LOCAL ] PBR: Primary data saved (54102 records). [2025-10-02T20:52:01.236417] [INFO ] [MAIN ] PBR: Full history saved. [2025-10-02T20:52:01.236505] [INFO ] [MAIN ] Update Progress: 1645/2370 symbols completed. PBR took 47.0s. Estimated remaining: 1h 42m 14s. Rate: 7.1 symbols/min [2025-10-02T20:52:01.435835] [INFO ] [MAIN ] PD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:52:01.436049] [DEBUG] [LOCAL ] PD: No existing data file found in primary storage. [2025-10-02T20:52:01.436096] [WARN ] [MAIN ] PD: No existing data found, performing full refresh instead. [2025-10-02T20:52:01.436212] [INFO ] [MAIN ] PD: Wiping existing primary data before full refresh. [2025-10-02T20:52:01.436256] [INFO ] [LOCAL ] PD: Starting deletion of primary data. [2025-10-02T20:52:01.436303] [DEBUG] [LOCAL ] PD: No primary data file found to delete. [2025-10-02T20:52:01.436338] [INFO ] [MAIN ] PD: Starting full primary refresh. [2025-10-02T20:52:01.842194] [INFO ] [REMOTE ] PD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:52:01.872976] [INFO ] [REMOTE ] PD: Fetching primary data for 2024-12. [2025-10-02T20:52:02.171337] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-02T20:52:02.173305] [INFO ] [REMOTE ] PCN: Full fetch complete (34092 records). [2025-10-02T20:52:02.173394] [DEBUG] [VALIDATOR ] PCN: Validating primary data. [2025-10-02T20:52:02.475205] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-02T20:52:02.607109] [DEBUG] [VALIDATOR ] PCN: All expected trading days are present. [2025-10-02T20:52:02.607251] [DEBUG] [VALIDATOR ] PCN: Primary data validation passed. [2025-10-02T20:52:02.608004] [INFO ] [MAIN ] PCN: Fetched primary data is valid. [2025-10-02T20:52:02.608068] [DEBUG] [LOCAL ] PCN: Saving primary data. [2025-10-02T20:52:02.609120] [DEBUG] [LOCAL ] PCN: Trimmed 34092 records to 24652 (keeping 200 days of data) [2025-10-02T20:52:02.673274] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-01. [2025-10-02T20:52:02.771521] [DEBUG] [LOCAL ] PCN: Primary data saved (24652 records). [2025-10-02T20:52:02.771706] [INFO ] [MAIN ] PCN: Full history saved. [2025-10-02T20:52:02.771796] [INFO ] [MAIN ] Update Progress: 1646/2370 symbols completed. PCN took 29.8s. Estimated remaining: 1h 42m 2s. Rate: 7.1 symbols/min [2025-10-02T20:52:02.955712] [INFO ] [MAIN ] PDCC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:52:02.955921] [DEBUG] [LOCAL ] PDCC: No existing data file found in primary storage. [2025-10-02T20:52:02.955970] [WARN ] [MAIN ] PDCC: No existing data found, performing full refresh instead. [2025-10-02T20:52:02.956088] [INFO ] [MAIN ] PDCC: Wiping existing primary data before full refresh. [2025-10-02T20:52:02.956147] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-10-02T20:52:02.956191] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-10-02T20:52:02.956224] [INFO ] [MAIN ] PDCC: Starting full primary refresh. [2025-10-02T20:52:03.343335] [INFO ] [REMOTE ] PDCC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:52:03.473033] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-01. [2025-10-02T20:52:04.273050] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2024-12. [2025-10-02T20:52:04.882720] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2024-12 (3.01 seconds). [2025-10-02T20:52:05.073014] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-01. [2025-10-02T20:52:05.230702] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-02T20:52:05.433610] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-01 (2.76 seconds). [2025-10-02T20:52:05.446325] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-02T20:52:05.873056] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-01. [2025-10-02T20:52:06.224354] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-02T20:52:06.673014] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-02. [2025-10-02T20:52:06.798987] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-02T20:52:07.473015] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-02. [2025-10-02T20:52:07.972771] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-02T20:52:08.273040] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-03. [2025-10-02T20:52:08.509584] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-02T20:52:08.713535] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-02T20:52:09.073057] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-03. [2025-10-02T20:52:09.873020] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-02. [2025-10-02T20:52:10.672981] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-02. [2025-10-02T20:52:10.717921] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-02T20:52:10.902358] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-02T20:52:11.473001] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-03. [2025-10-02T20:52:12.112913] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-02T20:52:12.260457] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-02T20:52:12.272978] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-04. [2025-10-02T20:52:13.073000] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-04. [2025-10-02T20:52:13.288028] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-02T20:52:13.620379] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-02T20:52:13.873009] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-03. [2025-10-02T20:52:14.673034] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-05. [2025-10-02T20:52:15.148182] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-02T20:52:15.472990] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-06. [2025-10-02T20:52:15.565845] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-02T20:52:16.202404] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-02T20:52:16.273071] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-04. [2025-10-02T20:52:17.072995] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-07. [2025-10-02T20:52:17.707912] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-02T20:52:17.855603] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-02T20:52:17.872967] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-05. [2025-10-02T20:52:18.673039] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-05. [2025-10-02T20:52:19.193984] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-02T20:52:19.472998] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-06. [2025-10-02T20:52:19.542722] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-02T20:52:20.273031] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-06. [2025-10-02T20:52:21.073012] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-04. [2025-10-02T20:52:21.180951] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-02T20:52:21.280428] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-02T20:52:21.873067] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-07. [2025-10-02T20:52:22.673051] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-08. [2025-10-02T20:52:22.867521] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-02T20:52:23.108358] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-02T20:52:23.473045] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-05. [2025-10-02T20:52:23.628457] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-02T20:52:24.272999] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-08. [2025-10-02T20:52:25.078167] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-09. [2025-10-02T20:52:25.092904] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-02T20:52:25.508773] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-02T20:52:25.873017] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-06. [2025-10-02T20:52:26.062598] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-02T20:52:26.673007] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-07. [2025-10-02T20:52:27.294562] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-02T20:52:27.443078] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-02T20:52:27.473059] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-08. [2025-10-02T20:52:28.272991] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-09. [2025-10-02T20:52:28.625016] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-02T20:52:29.073008] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-10. [2025-10-02T20:52:29.393267] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-02T20:52:29.394091] [INFO ] [REMOTE ] PDCC: Full fetch complete (1335 records). [2025-10-02T20:52:29.394165] [DEBUG] [VALIDATOR ] PDCC: Validating primary data. [2025-10-02T20:52:29.608272] [WARN ] [VALIDATOR ] PDCC: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-10-02T20:52:29.608687] [FATAL] [MAIN ] PDCC: Fetched primary data is invalid. Refusing to save it. [2025-10-02T20:52:29.608827] [WARN ] [MAIN ] PDCC: Deleting existing primary and derivative data due to validation failure. [2025-10-02T20:52:29.609016] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-10-02T20:52:29.609189] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-10-02T20:52:29.609360] [INFO ] [LOCAL ] PDCC: Starting deletion of derivative data. [2025-10-02T20:52:29.609552] [DEBUG] [LOCAL ] PDCC: No derivative data file found to delete. [2025-10-02T20:52:29.609721] [INFO ] [MAIN ] Update Progress: 1647/2370 symbols completed. PDCC took 26.8s. Estimated remaining: 1h 42m 2s. Rate: 7.1 symbols/min [2025-10-02T20:52:29.833274] [INFO ] [MAIN ] PDI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:52:29.833715] [DEBUG] [LOCAL ] PDI: No existing data file found in primary storage. [2025-10-02T20:52:29.833839] [WARN ] [MAIN ] PDI: No existing data found, performing full refresh instead. [2025-10-02T20:52:29.834325] [INFO ] [MAIN ] PDI: Wiping existing primary data before full refresh. [2025-10-02T20:52:29.834729] [INFO ] [LOCAL ] PDI: Starting deletion of primary data. [2025-10-02T20:52:29.834799] [DEBUG] [LOCAL ] PDI: No primary data file found to delete. [2025-10-02T20:52:29.834860] [INFO ] [MAIN ] PDI: Starting full primary refresh. [2025-10-02T20:52:29.878961] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-09. [2025-10-02T20:52:30.002147] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-02T20:52:30.320782] [INFO ] [REMOTE ] PDI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:52:30.672999] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-07. [2025-10-02T20:52:31.080944] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-02T20:52:31.472999] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-10. [2025-10-02T20:52:32.197240] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-02T20:52:32.198527] [INFO ] [REMOTE ] PCQ: Full fetch complete (17288 records). [2025-10-02T20:52:32.198631] [DEBUG] [VALIDATOR ] PCQ: Validating primary data. [2025-10-02T20:52:32.279314] [INFO ] [REMOTE ] PDI: Fetching primary data for 2024-12. [2025-10-02T20:52:32.663287] [DEBUG] [VALIDATOR ] PCQ: All expected trading days are present. [2025-10-02T20:52:32.663635] [DEBUG] [VALIDATOR ] PCQ: Primary data validation passed. [2025-10-02T20:52:32.664210] [INFO ] [MAIN ] PCQ: Fetched primary data is valid. [2025-10-02T20:52:32.664293] [DEBUG] [LOCAL ] PCQ: Saving primary data. [2025-10-02T20:52:32.667575] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-02T20:52:32.668685] [DEBUG] [LOCAL ] PCQ: Trimmed 17288 records to 12305 (keeping 200 days of data) [2025-10-02T20:52:32.761977] [DEBUG] [LOCAL ] PCQ: Primary data saved (12305 records). [2025-10-02T20:52:32.762123] [INFO ] [MAIN ] PCQ: Full history saved. [2025-10-02T20:52:32.762214] [INFO ] [MAIN ] Update Progress: 1648/2370 symbols completed. PCQ took 33.1s. Estimated remaining: 1h 41m 51s. Rate: 7.1 symbols/min [2025-10-02T20:52:32.955799] [INFO ] [MAIN ] PDM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:52:32.956150] [DEBUG] [LOCAL ] PDM: No existing data file found in primary storage. [2025-10-02T20:52:32.956206] [WARN ] [MAIN ] PDM: No existing data found, performing full refresh instead. [2025-10-02T20:52:32.956348] [INFO ] [MAIN ] PDM: Wiping existing primary data before full refresh. [2025-10-02T20:52:32.956405] [INFO ] [LOCAL ] PDM: Starting deletion of primary data. [2025-10-02T20:52:32.956514] [DEBUG] [LOCAL ] PDM: No primary data file found to delete. [2025-10-02T20:52:32.956566] [INFO ] [MAIN ] PDM: Starting full primary refresh. [2025-10-02T20:52:33.078118] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-08. [2025-10-02T20:52:33.331114] [INFO ] [REMOTE ] PDM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:52:33.872994] [INFO ] [REMOTE ] PDM: Fetching primary data for 2024-12. [2025-10-02T20:52:34.542759] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-10-02T20:52:34.673036] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-01. [2025-10-02T20:52:35.030300] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-02T20:52:35.472997] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-09. [2025-10-02T20:52:35.533240] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-02T20:52:36.272990] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-10. [2025-10-02T20:52:36.314668] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-02T20:52:37.073013] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-01. [2025-10-02T20:52:37.352421] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-02T20:52:37.386991] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-02T20:52:37.389338] [INFO ] [REMOTE ] PCOR: Full fetch complete (69595 records). [2025-10-02T20:52:37.389497] [DEBUG] [VALIDATOR ] PCOR: Validating primary data. [2025-10-02T20:52:37.850261] [DEBUG] [VALIDATOR ] PCOR: All expected trading days are present. [2025-10-02T20:52:37.850353] [DEBUG] [VALIDATOR ] PCOR: Primary data validation passed. [2025-10-02T20:52:37.851435] [INFO ] [MAIN ] PCOR: Fetched primary data is valid. [2025-10-02T20:52:37.851505] [DEBUG] [LOCAL ] PCOR: Saving primary data. [2025-10-02T20:52:37.853732] [DEBUG] [LOCAL ] PCOR: Trimmed 69595 records to 48348 (keeping 200 days of data) [2025-10-02T20:52:37.920716] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-02. [2025-10-02T20:52:38.176992] [DEBUG] [LOCAL ] PCOR: Primary data saved (48348 records). [2025-10-02T20:52:38.177143] [INFO ] [MAIN ] PCOR: Full history saved. [2025-10-02T20:52:38.177223] [INFO ] [MAIN ] Update Progress: 1649/2370 symbols completed. PCOR took 43.1s. Estimated remaining: 1h 41m 41s. Rate: 7.1 symbols/min [2025-10-02T20:52:38.358760] [INFO ] [MAIN ] PDO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:52:38.358943] [DEBUG] [LOCAL ] PDO: No existing data file found in primary storage. [2025-10-02T20:52:38.358982] [WARN ] [MAIN ] PDO: No existing data found, performing full refresh instead. [2025-10-02T20:52:38.359094] [INFO ] [MAIN ] PDO: Wiping existing primary data before full refresh. [2025-10-02T20:52:38.359138] [INFO ] [LOCAL ] PDO: Starting deletion of primary data. [2025-10-02T20:52:38.359180] [DEBUG] [LOCAL ] PDO: No primary data file found to delete. [2025-10-02T20:52:38.359214] [INFO ] [MAIN ] PDO: Starting full primary refresh. [2025-10-02T20:52:38.680169] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-10. [2025-10-02T20:52:38.812767] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-02T20:52:38.885311] [INFO ] [REMOTE ] PDO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:52:39.473009] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-02. [2025-10-02T20:52:39.694301] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-02T20:52:40.098937] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-02T20:52:40.101239] [INFO ] [REMOTE ] PD: Full fetch complete (67748 records). [2025-10-02T20:52:40.101374] [DEBUG] [VALIDATOR ] PD: Validating primary data. [2025-10-02T20:52:40.278219] [INFO ] [REMOTE ] PDO: Fetching primary data for 2024-12. [2025-10-02T20:52:40.611773] [DEBUG] [VALIDATOR ] PD: All expected trading days are present. [2025-10-02T20:52:40.611929] [DEBUG] [VALIDATOR ] PD: Primary data validation passed. [2025-10-02T20:52:40.613318] [INFO ] [MAIN ] PD: Fetched primary data is valid. [2025-10-02T20:52:40.613389] [DEBUG] [LOCAL ] PD: Saving primary data. [2025-10-02T20:52:40.614951] [DEBUG] [LOCAL ] PD: Trimmed 67748 records to 48248 (keeping 200 days of data) [2025-10-02T20:52:40.916557] [DEBUG] [LOCAL ] PD: Primary data saved (48248 records). [2025-10-02T20:52:40.916725] [INFO ] [MAIN ] PD: Full history saved. [2025-10-02T20:52:40.916813] [INFO ] [MAIN ] Update Progress: 1650/2370 symbols completed. PD took 39.7s. Estimated remaining: 1h 41m 30s. Rate: 7.1 symbols/min [2025-10-02T20:52:41.073446] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-03. [2025-10-02T20:52:41.104973] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-02T20:52:41.146849] [INFO ] [MAIN ] PDS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:52:41.158081] [DEBUG] [LOCAL ] PDS: No existing data file found in primary storage. [2025-10-02T20:52:41.158936] [WARN ] [MAIN ] PDS: No existing data found, performing full refresh instead. [2025-10-02T20:52:41.159557] [INFO ] [MAIN ] PDS: Wiping existing primary data before full refresh. [2025-10-02T20:52:41.159623] [INFO ] [LOCAL ] PDS: Starting deletion of primary data. [2025-10-02T20:52:41.159769] [DEBUG] [LOCAL ] PDS: No primary data file found to delete. [2025-10-02T20:52:41.159830] [INFO ] [MAIN ] PDS: Starting full primary refresh. [2025-10-02T20:52:41.569287] [INFO ] [REMOTE ] PDS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:52:41.827673] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-02T20:52:41.873010] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-01. [2025-10-02T20:52:42.673033] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-03. [2025-10-02T20:52:43.151629] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-02T20:52:43.269610] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-02T20:52:43.472991] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-02. [2025-10-02T20:52:43.904483] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-02T20:52:44.273040] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-04. [2025-10-02T20:52:44.763314] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-02T20:52:45.073043] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-03. [2025-10-02T20:52:45.873007] [INFO ] [REMOTE ] PDS: Fetching primary data for 2024-12. [2025-10-02T20:52:45.904664] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-02T20:52:46.409043] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-02T20:52:46.616110] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-02T20:52:46.673020] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-05. [2025-10-02T20:52:47.473030] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-04. [2025-10-02T20:52:48.273046] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-04. [2025-10-02T20:52:48.414575] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-02T20:52:49.073023] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-06. [2025-10-02T20:52:49.371516] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-02T20:52:49.758350] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-02T20:52:49.872996] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-05. [2025-10-02T20:52:50.408364] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-02T20:52:50.672987] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-07. [2025-10-02T20:52:51.108673] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-02T20:52:51.472995] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-01. [2025-10-02T20:52:52.272943] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-06. [2025-10-02T20:52:52.400777] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-02T20:52:52.449378] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-02T20:52:53.073069] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-05. [2025-10-02T20:52:53.397009] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-02T20:52:53.873034] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-07. [2025-10-02T20:52:54.672985] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-02. [2025-10-02T20:52:54.940348] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-02T20:52:54.972623] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-02T20:52:55.418520] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-02T20:52:55.473010] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-08. [2025-10-02T20:52:56.273019] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-03. [2025-10-02T20:52:56.624150] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-02T20:52:57.073010] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-09. [2025-10-02T20:52:57.623330] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-02T20:52:57.873015] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-08. [2025-10-02T20:52:58.246154] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-02T20:52:58.673032] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-04. [2025-10-02T20:52:58.967075] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-02T20:52:59.472975] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-09. [2025-10-02T20:52:59.580291] [DEBUG] [REMOTE ] PDO: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-10-02T20:52:59.580596] [WARN ] [REMOTE ] PDO: No data returned for month 2025-09 [2025-10-02T20:52:59.580719] [FATAL] [REMOTE ] PDO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T20:52:59.580842] [FATAL] [MAIN ] PDO: Failed to fetch primary data. [2025-10-02T20:52:59.580913] [WARN ] [MAIN ] PDO: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T20:52:59.581000] [INFO ] [LOCAL ] PDO: Starting deletion of primary data. [2025-10-02T20:52:59.581086] [DEBUG] [LOCAL ] PDO: No primary data file found to delete. [2025-10-02T20:52:59.581143] [INFO ] [LOCAL ] PDO: Starting deletion of derivative data. [2025-10-02T20:52:59.581215] [DEBUG] [LOCAL ] PDO: No derivative data file found to delete. [2025-10-02T20:52:59.581326] [INFO ] [MAIN ] Update Progress: 1651/2370 symbols completed. PDO took 21.4s. Estimated remaining: 1h 41m 26s. Rate: 7.1 symbols/min [2025-10-02T20:52:59.772746] [INFO ] [MAIN ] PDT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:52:59.773148] [DEBUG] [LOCAL ] PDT: No existing data file found in primary storage. [2025-10-02T20:52:59.773208] [WARN ] [MAIN ] PDT: No existing data found, performing full refresh instead. [2025-10-02T20:52:59.773319] [INFO ] [MAIN ] PDT: Wiping existing primary data before full refresh. [2025-10-02T20:52:59.773361] [INFO ] [LOCAL ] PDT: Starting deletion of primary data. [2025-10-02T20:52:59.773402] [DEBUG] [LOCAL ] PDT: No primary data file found to delete. [2025-10-02T20:52:59.773435] [INFO ] [MAIN ] PDT: Starting full primary refresh. [2025-10-02T20:53:00.075835] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-02T20:53:00.189288] [INFO ] [REMOTE ] PDT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:53:00.273031] [INFO ] [REMOTE ] PDT: Fetching primary data for 2024-12. [2025-10-02T20:53:01.073080] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-05. [2025-10-02T20:53:01.459326] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-02T20:53:01.872955] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-01. [2025-10-02T20:53:02.361575] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-02T20:53:02.672997] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-06. [2025-10-02T20:53:02.875345] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-02T20:53:03.473002] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-02. [2025-10-02T20:53:04.273012] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-06. [2025-10-02T20:53:04.572011] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-02T20:53:04.684093] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-02T20:53:05.073032] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-03. [2025-10-02T20:53:05.429621] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-02T20:53:05.873097] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-07. [2025-10-02T20:53:06.236444] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-02T20:53:06.673028] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-07. [2025-10-02T20:53:07.472971] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-10. [2025-10-02T20:53:07.597056] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-02T20:53:08.069670] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-02T20:53:08.273090] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-08. [2025-10-02T20:53:08.601211] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-02T20:53:08.604132] [INFO ] [REMOTE ] PDM: Full fetch complete (57334 records). [2025-10-02T20:53:08.604272] [DEBUG] [VALIDATOR ] PDM: Validating primary data. [2025-10-02T20:53:09.030239] [DEBUG] [VALIDATOR ] PDM: All expected trading days are present. [2025-10-02T20:53:09.030326] [DEBUG] [VALIDATOR ] PDM: Primary data validation passed. [2025-10-02T20:53:09.031307] [INFO ] [MAIN ] PDM: Fetched primary data is valid. [2025-10-02T20:53:09.031375] [DEBUG] [LOCAL ] PDM: Saving primary data. [2025-10-02T20:53:09.032747] [DEBUG] [LOCAL ] PDM: Trimmed 57334 records to 39853 (keeping 200 days of data) [2025-10-02T20:53:09.090066] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-04. [2025-10-02T20:53:09.283246] [DEBUG] [LOCAL ] PDM: Primary data saved (39853 records). [2025-10-02T20:53:09.283399] [INFO ] [MAIN ] PDM: Full history saved. [2025-10-02T20:53:09.283488] [INFO ] [MAIN ] Update Progress: 1652/2370 symbols completed. PDM took 36.5s. Estimated remaining: 1h 41m 18s. Rate: 7.1 symbols/min [2025-10-02T20:53:09.474679] [INFO ] [MAIN ] PDX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:53:09.474932] [DEBUG] [LOCAL ] PDX: No existing data file found in primary storage. [2025-10-02T20:53:09.474989] [WARN ] [MAIN ] PDX: No existing data found, performing full refresh instead. [2025-10-02T20:53:09.475139] [INFO ] [MAIN ] PDX: Wiping existing primary data before full refresh. [2025-10-02T20:53:09.475183] [INFO ] [LOCAL ] PDX: Starting deletion of primary data. [2025-10-02T20:53:09.475227] [DEBUG] [LOCAL ] PDX: No primary data file found to delete. [2025-10-02T20:53:09.475260] [INFO ] [MAIN ] PDX: Starting full primary refresh. [2025-10-02T20:53:09.864767] [INFO ] [REMOTE ] PDX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:53:09.872951] [INFO ] [REMOTE ] PDX: Fetching primary data for 2024-12. [2025-10-02T20:53:10.174544] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-02T20:53:10.406695] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-02T20:53:10.673004] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-09. [2025-10-02T20:53:10.862965] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-02T20:53:11.472993] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-01. [2025-10-02T20:53:12.273009] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-05. [2025-10-02T20:53:12.591038] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-02T20:53:12.653599] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-02T20:53:13.072974] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-02. [2025-10-02T20:53:13.461680] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-02T20:53:13.873032] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-08. [2025-10-02T20:53:14.173118] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-02T20:53:14.673016] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-06. [2025-10-02T20:53:14.869940] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-02T20:53:15.472987] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-10. [2025-10-02T20:53:15.569274] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-02T20:53:16.273002] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-03. [2025-10-02T20:53:17.049353] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-02T20:53:17.051394] [INFO ] [REMOTE ] PDI: Full fetch complete (73015 records). [2025-10-02T20:53:17.051523] [DEBUG] [VALIDATOR ] PDI: Validating primary data. [2025-10-02T20:53:17.078188] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-07. [2025-10-02T20:53:17.392785] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-02T20:53:17.506231] [DEBUG] [VALIDATOR ] PDI: All expected trading days are present. [2025-10-02T20:53:17.506319] [DEBUG] [VALIDATOR ] PDI: Primary data validation passed. [2025-10-02T20:53:17.507419] [INFO ] [MAIN ] PDI: Fetched primary data is valid. [2025-10-02T20:53:17.507485] [DEBUG] [LOCAL ] PDI: Saving primary data. [2025-10-02T20:53:17.509017] [DEBUG] [LOCAL ] PDI: Trimmed 73015 records to 50434 (keeping 200 days of data) [2025-10-02T20:53:17.856326] [DEBUG] [LOCAL ] PDI: Primary data saved (50434 records). [2025-10-02T20:53:17.856551] [INFO ] [MAIN ] PDI: Full history saved. [2025-10-02T20:53:17.856857] [INFO ] [MAIN ] Update Progress: 1653/2370 symbols completed. PDI took 48.2s. Estimated remaining: 1h 41m 10s. Rate: 7.1 symbols/min [2025-10-02T20:53:17.879711] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-04. [2025-10-02T20:53:18.044140] [INFO ] [MAIN ] PEB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:53:18.044465] [DEBUG] [LOCAL ] PEB: No existing data file found in primary storage. [2025-10-02T20:53:18.044551] [WARN ] [MAIN ] PEB: No existing data found, performing full refresh instead. [2025-10-02T20:53:18.044666] [INFO ] [MAIN ] PEB: Wiping existing primary data before full refresh. [2025-10-02T20:53:18.044725] [INFO ] [LOCAL ] PEB: Starting deletion of primary data. [2025-10-02T20:53:18.044772] [DEBUG] [LOCAL ] PEB: No primary data file found to delete. [2025-10-02T20:53:18.044805] [INFO ] [MAIN ] PEB: Starting full primary refresh. [2025-10-02T20:53:18.219025] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-02T20:53:18.462690] [INFO ] [REMOTE ] PEB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:53:18.673043] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-08. [2025-10-02T20:53:19.278726] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-02T20:53:19.472991] [INFO ] [REMOTE ] PEB: Fetching primary data for 2024-12. [2025-10-02T20:53:19.795753] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-02T20:53:20.272993] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-05. [2025-10-02T20:53:20.812246] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-02T20:53:21.072986] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-09. [2025-10-02T20:53:21.346041] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-02T20:53:21.803492] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-02T20:53:21.873011] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-10. [2025-10-02T20:53:22.472039] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-02T20:53:22.473057] [INFO ] [REMOTE ] PDS: Full fetch complete (25550 records). [2025-10-02T20:53:22.473131] [DEBUG] [VALIDATOR ] PDS: Validating primary data. [2025-10-02T20:53:22.678213] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-06. [2025-10-02T20:53:22.882708] [DEBUG] [VALIDATOR ] PDS: All expected trading days are present. [2025-10-02T20:53:22.882802] [DEBUG] [VALIDATOR ] PDS: Primary data validation passed. [2025-10-02T20:53:22.883395] [INFO ] [MAIN ] PDS: Fetched primary data is valid. [2025-10-02T20:53:22.883460] [DEBUG] [LOCAL ] PDS: Saving primary data. [2025-10-02T20:53:22.884408] [DEBUG] [LOCAL ] PDS: Trimmed 25550 records to 17719 (keeping 200 days of data) [2025-10-02T20:53:22.993513] [DEBUG] [LOCAL ] PDS: Primary data saved (17719 records). [2025-10-02T20:53:22.993685] [INFO ] [MAIN ] PDS: Full history saved. [2025-10-02T20:53:22.993778] [INFO ] [MAIN ] Update Progress: 1654/2370 symbols completed. PDS took 42.1s. Estimated remaining: 1h 41m 0s. Rate: 7.1 symbols/min [2025-10-02T20:53:23.174625] [INFO ] [MAIN ] PEG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:53:23.174843] [DEBUG] [LOCAL ] PEG: No existing data file found in primary storage. [2025-10-02T20:53:23.174886] [WARN ] [MAIN ] PEG: No existing data found, performing full refresh instead. [2025-10-02T20:53:23.175007] [INFO ] [MAIN ] PEG: Wiping existing primary data before full refresh. [2025-10-02T20:53:23.175051] [INFO ] [LOCAL ] PEG: Starting deletion of primary data. [2025-10-02T20:53:23.175133] [DEBUG] [LOCAL ] PEG: No primary data file found to delete. [2025-10-02T20:53:23.175189] [INFO ] [MAIN ] PEG: Starting full primary refresh. [2025-10-02T20:53:23.478528] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-01. [2025-10-02T20:53:23.590442] [INFO ] [REMOTE ] PEG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:53:23.833118] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-02T20:53:24.272996] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-07. [2025-10-02T20:53:25.072962] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-09. [2025-10-02T20:53:25.170705] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-02T20:53:25.300811] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-02T20:53:25.872996] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-02. [2025-10-02T20:53:25.907771] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-02T20:53:26.673004] [INFO ] [REMOTE ] PEG: Fetching primary data for 2024-12. [2025-10-02T20:53:27.472997] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-08. [2025-10-02T20:53:27.518255] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-02T20:53:28.272986] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-03. [2025-10-02T20:53:28.621447] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-02T20:53:28.941334] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-02T20:53:29.072991] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-01. [2025-10-02T20:53:29.872973] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-10. [2025-10-02T20:53:30.355825] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-02T20:53:30.588005] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-02T20:53:30.618562] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-02T20:53:30.620160] [INFO ] [REMOTE ] PDT: Full fetch complete (25209 records). [2025-10-02T20:53:30.620255] [DEBUG] [VALIDATOR ] PDT: Validating primary data. [2025-10-02T20:53:30.678221] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-02. [2025-10-02T20:53:31.041227] [DEBUG] [VALIDATOR ] PDT: All expected trading days are present. [2025-10-02T20:53:31.041323] [DEBUG] [VALIDATOR ] PDT: Primary data validation passed. [2025-10-02T20:53:31.041876] [INFO ] [MAIN ] PDT: Fetched primary data is valid. [2025-10-02T20:53:31.041941] [DEBUG] [LOCAL ] PDT: Saving primary data. [2025-10-02T20:53:31.042782] [DEBUG] [LOCAL ] PDT: Trimmed 25209 records to 17545 (keeping 200 days of data) [2025-10-02T20:53:31.158230] [DEBUG] [LOCAL ] PDT: Primary data saved (17545 records). [2025-10-02T20:53:31.158390] [INFO ] [MAIN ] PDT: Full history saved. [2025-10-02T20:53:31.158475] [INFO ] [MAIN ] Update Progress: 1655/2370 symbols completed. PDT took 31.6s. Estimated remaining: 1h 40m 52s. Rate: 7.1 symbols/min [2025-10-02T20:53:31.348911] [INFO ] [MAIN ] PEN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:53:31.349111] [DEBUG] [LOCAL ] PEN: No existing data file found in primary storage. [2025-10-02T20:53:31.349152] [WARN ] [MAIN ] PEN: No existing data found, performing full refresh instead. [2025-10-02T20:53:31.349271] [INFO ] [MAIN ] PEN: Wiping existing primary data before full refresh. [2025-10-02T20:53:31.349315] [INFO ] [LOCAL ] PEN: Starting deletion of primary data. [2025-10-02T20:53:31.349360] [DEBUG] [LOCAL ] PEN: No primary data file found to delete. [2025-10-02T20:53:31.349395] [INFO ] [MAIN ] PEN: Starting full primary refresh. [2025-10-02T20:53:31.478119] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-04. [2025-10-02T20:53:31.746410] [INFO ] [REMOTE ] PEN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:53:32.273016] [INFO ] [REMOTE ] PEN: Fetching primary data for 2024-12. [2025-10-02T20:53:32.344270] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-02T20:53:33.073003] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-03. [2025-10-02T20:53:33.217452] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-02T20:53:33.375292] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-02T20:53:33.873005] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-05. [2025-10-02T20:53:34.682836] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-01. [2025-10-02T20:53:34.706457] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-02T20:53:35.472983] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-09. [2025-10-02T20:53:35.698916] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-02T20:53:35.773787] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-02T20:53:36.273012] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-02. [2025-10-02T20:53:36.539218] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-02T20:53:37.073064] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-04. [2025-10-02T20:53:37.830853] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-02T20:53:37.873004] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-06. [2025-10-02T20:53:38.673009] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-10. [2025-10-02T20:53:39.081143] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-02T20:53:39.348376] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-02T20:53:39.349407] [INFO ] [REMOTE ] PDX: Full fetch complete (24379 records). [2025-10-02T20:53:39.349482] [DEBUG] [VALIDATOR ] PDX: Validating primary data. [2025-10-02T20:53:39.480680] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-03. [2025-10-02T20:53:39.699804] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-02T20:53:39.801247] [DEBUG] [VALIDATOR ] PDX: All expected trading days are present. [2025-10-02T20:53:39.801329] [DEBUG] [VALIDATOR ] PDX: Primary data validation passed. [2025-10-02T20:53:39.801907] [INFO ] [MAIN ] PDX: Fetched primary data is valid. [2025-10-02T20:53:39.801971] [DEBUG] [LOCAL ] PDX: Saving primary data. [2025-10-02T20:53:39.802692] [DEBUG] [LOCAL ] PDX: Trimmed 24379 records to 14464 (keeping 200 days of data) [2025-10-02T20:53:39.909501] [DEBUG] [LOCAL ] PDX: Primary data saved (14464 records). [2025-10-02T20:53:39.909686] [INFO ] [MAIN ] PDX: Full history saved. [2025-10-02T20:53:39.909849] [INFO ] [MAIN ] Update Progress: 1656/2370 symbols completed. PDX took 30.6s. Estimated remaining: 1h 40m 43s. Rate: 7.1 symbols/min [2025-10-02T20:53:40.102813] [INFO ] [MAIN ] PEO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:53:40.103002] [DEBUG] [LOCAL ] PEO: No existing data file found in primary storage. [2025-10-02T20:53:40.103106] [WARN ] [MAIN ] PEO: No existing data found, performing full refresh instead. [2025-10-02T20:53:40.103228] [INFO ] [MAIN ] PEO: Wiping existing primary data before full refresh. [2025-10-02T20:53:40.103278] [INFO ] [LOCAL ] PEO: Starting deletion of primary data. [2025-10-02T20:53:40.103325] [DEBUG] [LOCAL ] PEO: No primary data file found to delete. [2025-10-02T20:53:40.103360] [INFO ] [MAIN ] PEO: Starting full primary refresh. [2025-10-02T20:53:40.275729] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-05. [2025-10-02T20:53:40.509565] [INFO ] [REMOTE ] PEO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:53:41.073017] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-07. [2025-10-02T20:53:41.311869] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-02T20:53:41.873012] [INFO ] [REMOTE ] PEO: Fetching primary data for 2024-12. [2025-10-02T20:53:42.190760] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-02T20:53:42.672982] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-04. [2025-10-02T20:53:42.815123] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-02T20:53:42.928559] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-02T20:53:43.472987] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-08. [2025-10-02T20:53:44.273042] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-06. [2025-10-02T20:53:44.324225] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-02T20:53:44.848111] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-02T20:53:45.073039] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-09. [2025-10-02T20:53:45.872980] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-05. [2025-10-02T20:53:45.937064] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-02T20:53:46.673013] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-01. [2025-10-02T20:53:46.920035] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-02T20:53:47.339133] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-02T20:53:47.472974] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-06. [2025-10-02T20:53:47.689679] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-02T20:53:48.273035] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-07. [2025-10-02T20:53:48.883496] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-02T20:53:49.073018] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-10. [2025-10-02T20:53:49.872997] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-07. [2025-10-02T20:53:50.203715] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-02T20:53:50.429282] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-02T20:53:50.432092] [INFO ] [REMOTE ] PEB: Full fetch complete (72861 records). [2025-10-02T20:53:50.432214] [DEBUG] [VALIDATOR ] PEB: Validating primary data. [2025-10-02T20:53:50.678592] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-02. [2025-10-02T20:53:50.878839] [DEBUG] [VALIDATOR ] PEB: All expected trading days are present. [2025-10-02T20:53:50.878924] [DEBUG] [VALIDATOR ] PEB: Primary data validation passed. [2025-10-02T20:53:50.879951] [INFO ] [MAIN ] PEB: Fetched primary data is valid. [2025-10-02T20:53:50.880015] [DEBUG] [LOCAL ] PEB: Saving primary data. [2025-10-02T20:53:50.881533] [DEBUG] [LOCAL ] PEB: Trimmed 72861 records to 51018 (keeping 200 days of data) [2025-10-02T20:53:51.219748] [DEBUG] [LOCAL ] PEB: Primary data saved (51018 records). [2025-10-02T20:53:51.219887] [INFO ] [MAIN ] PEB: Full history saved. [2025-10-02T20:53:51.219962] [INFO ] [MAIN ] Update Progress: 1657/2370 symbols completed. PEB took 33.4s. Estimated remaining: 1h 40m 36s. Rate: 7.1 symbols/min [2025-10-02T20:53:51.412714] [INFO ] [MAIN ] PERF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:53:51.413115] [DEBUG] [LOCAL ] PERF: No existing data file found in primary storage. [2025-10-02T20:53:51.413279] [WARN ] [MAIN ] PERF: No existing data found, performing full refresh instead. [2025-10-02T20:53:51.420288] [INFO ] [MAIN ] PERF: Wiping existing primary data before full refresh. [2025-10-02T20:53:51.432677] [INFO ] [LOCAL ] PERF: Starting deletion of primary data. [2025-10-02T20:53:51.434435] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-02T20:53:51.433380] [DEBUG] [LOCAL ] PERF: No primary data file found to delete. [2025-10-02T20:53:51.441756] [INFO ] [MAIN ] PERF: Starting full primary refresh. [2025-10-02T20:53:51.475712] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-08. [2025-10-02T20:53:51.748575] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-02T20:53:51.847949] [INFO ] [REMOTE ] PERF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:53:52.273036] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-08. [2025-10-02T20:53:53.073020] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-03. [2025-10-02T20:53:53.528248] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-02T20:53:53.638222] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-02T20:53:53.872991] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-09. [2025-10-02T20:53:53.926575] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-02T20:53:54.672996] [INFO ] [REMOTE ] PERF: Fetching primary data for 2024-12. [2025-10-02T20:53:55.472971] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-04. [2025-10-02T20:53:55.777893] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-02T20:53:55.895088] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-02T20:53:56.202154] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-02T20:53:56.273030] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-01. [2025-10-02T20:53:57.073029] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-05. [2025-10-02T20:53:57.330545] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-02T20:53:57.873032] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-09. [2025-10-02T20:53:58.007360] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-02T20:53:58.673047] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-06. [2025-10-02T20:53:59.317316] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-02T20:53:59.472987] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-10. [2025-10-02T20:53:59.516115] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-02T20:54:00.272964] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-07. [2025-10-02T20:54:00.489847] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-02T20:54:00.491328] [INFO ] [REMOTE ] PEN: Full fetch complete (44128 records). [2025-10-02T20:54:00.491411] [DEBUG] [VALIDATOR ] PEN: Validating primary data. [2025-10-02T20:54:00.576405] [DEBUG] [REMOTE ] PEO: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-02T20:54:00.607894] [WARN ] [REMOTE ] PEO: No data returned for month 2025-07 [2025-10-02T20:54:00.608497] [FATAL] [REMOTE ] PEO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T20:54:00.624182] [FATAL] [MAIN ] PEO: Failed to fetch primary data. [2025-10-02T20:54:00.634529] [WARN ] [MAIN ] PEO: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T20:54:00.648615] [INFO ] [LOCAL ] PEO: Starting deletion of primary data. [2025-10-02T20:54:00.653880] [DEBUG] [LOCAL ] PEO: No primary data file found to delete. [2025-10-02T20:54:00.660234] [INFO ] [LOCAL ] PEO: Starting deletion of derivative data. [2025-10-02T20:54:00.679752] [DEBUG] [LOCAL ] PEO: No derivative data file found to delete. [2025-10-02T20:54:00.693295] [INFO ] [MAIN ] Update Progress: 1658/2370 symbols completed. PEO took 20.8s. Estimated remaining: 1h 40m 28s. Rate: 7.1 symbols/min [2025-10-02T20:54:01.093334] [INFO ] [MAIN ] PEW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:54:01.092367] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-02. [2025-10-02T20:54:01.111667] [DEBUG] [VALIDATOR ] PEN: All expected trading days are present. [2025-10-02T20:54:01.111755] [DEBUG] [VALIDATOR ] PEN: Primary data validation passed. [2025-10-02T20:54:01.108354] [DEBUG] [LOCAL ] PEW: No existing data file found in primary storage. [2025-10-02T20:54:01.112722] [WARN ] [MAIN ] PEW: No existing data found, performing full refresh instead. [2025-10-02T20:54:01.112613] [INFO ] [MAIN ] PEN: Fetched primary data is valid. [2025-10-02T20:54:01.113013] [DEBUG] [LOCAL ] PEN: Saving primary data. [2025-10-02T20:54:01.113087] [INFO ] [MAIN ] PEW: Wiping existing primary data before full refresh. [2025-10-02T20:54:01.113302] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-10-02T20:54:01.113388] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-10-02T20:54:01.113432] [INFO ] [MAIN ] PEW: Starting full primary refresh. [2025-10-02T20:54:01.201126] [DEBUG] [LOCAL ] PEN: Trimmed 44128 records to 30405 (keeping 200 days of data) [2025-10-02T20:54:01.652542] [INFO ] [REMOTE ] PEW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:54:01.748047] [DEBUG] [LOCAL ] PEN: Primary data saved (30405 records). [2025-10-02T20:54:01.748235] [INFO ] [MAIN ] PEN: Full history saved. [2025-10-02T20:54:01.748326] [INFO ] [MAIN ] Update Progress: 1659/2370 symbols completed. PEN took 30.6s. Estimated remaining: 1h 40m 16s. Rate: 7.1 symbols/min [2025-10-02T20:54:01.878101] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-10. [2025-10-02T20:54:01.947540] [INFO ] [MAIN ] PFD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:54:01.948173] [DEBUG] [LOCAL ] PFD: No existing data file found in primary storage. [2025-10-02T20:54:01.948234] [WARN ] [MAIN ] PFD: No existing data found, performing full refresh instead. [2025-10-02T20:54:01.948374] [INFO ] [MAIN ] PFD: Wiping existing primary data before full refresh. [2025-10-02T20:54:01.948438] [INFO ] [LOCAL ] PFD: Starting deletion of primary data. [2025-10-02T20:54:01.948535] [DEBUG] [LOCAL ] PFD: No primary data file found to delete. [2025-10-02T20:54:01.948586] [INFO ] [MAIN ] PFD: Starting full primary refresh. [2025-10-02T20:54:02.366434] [INFO ] [REMOTE ] PFD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:54:02.406866] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-02T20:54:02.429282] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-02T20:54:02.431010] [INFO ] [REMOTE ] PEG: Full fetch complete (76302 records). [2025-10-02T20:54:02.431154] [DEBUG] [VALIDATOR ] PEG: Validating primary data. [2025-10-02T20:54:02.432096] [FATAL] [VALIDATOR ] PEG: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T20:54:02.432193] [FATAL] [MAIN ] PEG: Fetched primary data is invalid. Refusing to save it. [2025-10-02T20:54:02.432237] [WARN ] [MAIN ] PEG: Deleting existing primary and derivative data due to validation failure. [2025-10-02T20:54:02.432303] [INFO ] [LOCAL ] PEG: Starting deletion of primary data. [2025-10-02T20:54:02.432369] [DEBUG] [LOCAL ] PEG: No primary data file found to delete. [2025-10-02T20:54:02.432404] [INFO ] [LOCAL ] PEG: Starting deletion of derivative data. [2025-10-02T20:54:02.432445] [DEBUG] [LOCAL ] PEG: No derivative data file found to delete. [2025-10-02T20:54:02.432503] [INFO ] [MAIN ] Update Progress: 1660/2370 symbols completed. PEG took 39.4s. Estimated remaining: 1h 40m 4s. Rate: 7.1 symbols/min [2025-10-02T20:54:02.617779] [INFO ] [MAIN ] PFE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:54:02.617979] [DEBUG] [LOCAL ] PFE: No existing data file found in primary storage. [2025-10-02T20:54:02.618071] [WARN ] [MAIN ] PFE: No existing data found, performing full refresh instead. [2025-10-02T20:54:02.618196] [INFO ] [MAIN ] PFE: Wiping existing primary data before full refresh. [2025-10-02T20:54:02.618291] [INFO ] [LOCAL ] PFE: Starting deletion of primary data. [2025-10-02T20:54:02.618361] [DEBUG] [LOCAL ] PFE: No primary data file found to delete. [2025-10-02T20:54:02.618402] [INFO ] [MAIN ] PFE: Starting full primary refresh. [2025-10-02T20:54:02.682761] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-03. [2025-10-02T20:54:03.022264] [INFO ] [REMOTE ] PFE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:54:03.472989] [INFO ] [REMOTE ] PFD: Fetching primary data for 2024-12. [2025-10-02T20:54:03.847401] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-02T20:54:04.220963] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-02T20:54:04.273032] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-04. [2025-10-02T20:54:05.073015] [INFO ] [REMOTE ] PEW: Fetching primary data for 2024-12. [2025-10-02T20:54:05.237028] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-02T20:54:05.363136] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T20:54:05.363540] [WARN ] [REMOTE ] PEW: No data returned for month 2024-12 [2025-10-02T20:54:05.363683] [FATAL] [REMOTE ] PEW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T20:54:05.363741] [FATAL] [MAIN ] PEW: Failed to fetch primary data. [2025-10-02T20:54:05.363783] [WARN ] [MAIN ] PEW: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T20:54:05.363851] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-10-02T20:54:05.363917] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-10-02T20:54:05.363955] [INFO ] [LOCAL ] PEW: Starting deletion of derivative data. [2025-10-02T20:54:05.363998] [DEBUG] [LOCAL ] PEW: No derivative data file found to delete. [2025-10-02T20:54:05.364046] [INFO ] [MAIN ] Update Progress: 1661/2370 symbols completed. PEW took 4.7s. Estimated remaining: 1h 39m 54s. Rate: 7.1 symbols/min [2025-10-02T20:54:05.606509] [INFO ] [MAIN ] PFGC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:54:05.606720] [DEBUG] [LOCAL ] PFGC: No existing data file found in primary storage. [2025-10-02T20:54:05.606773] [WARN ] [MAIN ] PFGC: No existing data found, performing full refresh instead. [2025-10-02T20:54:05.606918] [INFO ] [MAIN ] PFGC: Wiping existing primary data before full refresh. [2025-10-02T20:54:05.606996] [INFO ] [LOCAL ] PFGC: Starting deletion of primary data. [2025-10-02T20:54:05.607076] [DEBUG] [LOCAL ] PFGC: No primary data file found to delete. [2025-10-02T20:54:05.607118] [INFO ] [MAIN ] PFGC: Starting full primary refresh. [2025-10-02T20:54:05.880737] [INFO ] [REMOTE ] PFE: Fetching primary data for 2024-12. [2025-10-02T20:54:06.029684] [INFO ] [REMOTE ] PFGC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:54:06.673029] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2024-12. [2025-10-02T20:54:07.472982] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-01. [2025-10-02T20:54:08.193833] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-02T20:54:08.272969] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-05. [2025-10-02T20:54:08.452620] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-02T20:54:08.614108] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2024-12 (2.73 seconds). [2025-10-02T20:54:09.073038] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-01. [2025-10-02T20:54:09.184631] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-02T20:54:09.873014] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-06. [2025-10-02T20:54:10.673045] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-02. [2025-10-02T20:54:11.099387] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-02T20:54:11.413781] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-02T20:54:11.473043] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-07. [2025-10-02T20:54:11.952304] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-01 (2.88 seconds). [2025-10-02T20:54:12.273030] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-02. [2025-10-02T20:54:12.775212] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-02T20:54:13.073032] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-01. [2025-10-02T20:54:13.872999] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-03. [2025-10-02T20:54:14.383732] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-02T20:54:14.583923] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-02T20:54:14.664984] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-02 (2.39 seconds). [2025-10-02T20:54:14.675232] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-08. [2025-10-02T20:54:15.420699] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-02T20:54:15.473013] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-09. [2025-10-02T20:54:16.272977] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-02. [2025-10-02T20:54:16.357687] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-02T20:54:17.073032] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-04. [2025-10-02T20:54:17.872971] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-10. [2025-10-02T20:54:17.905632] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-02T20:54:17.952847] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-02T20:54:18.574211] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-02T20:54:18.575384] [INFO ] [REMOTE ] PERF: Full fetch complete (21815 records). [2025-10-02T20:54:18.575464] [DEBUG] [VALIDATOR ] PERF: Validating primary data. [2025-10-02T20:54:18.678081] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-05. [2025-10-02T20:54:18.984048] [DEBUG] [VALIDATOR ] PERF: All expected trading days are present. [2025-10-02T20:54:18.984135] [DEBUG] [VALIDATOR ] PERF: Primary data validation passed. [2025-10-02T20:54:18.984689] [INFO ] [MAIN ] PERF: Fetched primary data is valid. [2025-10-02T20:54:18.984754] [DEBUG] [LOCAL ] PERF: Saving primary data. [2025-10-02T20:54:18.985534] [DEBUG] [LOCAL ] PERF: Trimmed 21815 records to 14100 (keeping 200 days of data) [2025-10-02T20:54:19.073367] [DEBUG] [LOCAL ] PERF: Primary data saved (14100 records). [2025-10-02T20:54:19.073573] [INFO ] [MAIN ] PERF: Full history saved. [2025-10-02T20:54:19.073694] [INFO ] [MAIN ] Update Progress: 1662/2370 symbols completed. PERF took 27.9s. Estimated remaining: 1h 39m 47s. Rate: 7.1 symbols/min [2025-10-02T20:54:19.283019] [INFO ] [MAIN ] PFH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:54:19.283216] [DEBUG] [LOCAL ] PFH: No existing data file found in primary storage. [2025-10-02T20:54:19.283260] [WARN ] [MAIN ] PFH: No existing data found, performing full refresh instead. [2025-10-02T20:54:19.283374] [INFO ] [MAIN ] PFH: Wiping existing primary data before full refresh. [2025-10-02T20:54:19.283416] [INFO ] [LOCAL ] PFH: Starting deletion of primary data. [2025-10-02T20:54:19.283457] [DEBUG] [LOCAL ] PFH: No primary data file found to delete. [2025-10-02T20:54:19.283591] [INFO ] [MAIN ] PFH: Starting full primary refresh. [2025-10-02T20:54:19.400897] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-02T20:54:19.487547] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-03. [2025-10-02T20:54:19.689768] [INFO ] [REMOTE ] PFH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:54:20.273002] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-03. [2025-10-02T20:54:21.073056] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-06. [2025-10-02T20:54:21.724687] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-02T20:54:21.878160] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-07. [2025-10-02T20:54:21.897046] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-02T20:54:22.047955] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-03 (2.56 seconds). [2025-10-02T20:54:22.673000] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-04. [2025-10-02T20:54:22.808693] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-02T20:54:23.473009] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-04. [2025-10-02T20:54:24.273029] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-08. [2025-10-02T20:54:24.572595] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-02T20:54:25.075583] [INFO ] [REMOTE ] PFH: Fetching primary data for 2024-12. [2025-10-02T20:54:25.077811] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-02T20:54:25.873006] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-09. [2025-10-02T20:54:26.133170] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-02T20:54:26.384618] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-04 (2.91 seconds). [2025-10-02T20:54:26.653779] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-02T20:54:26.672964] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-10. [2025-10-02T20:54:27.231758] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-02T20:54:27.232945] [INFO ] [REMOTE ] PFD: Full fetch complete (7455 records). [2025-10-02T20:54:27.233052] [DEBUG] [VALIDATOR ] PFD: Validating primary data. [2025-10-02T20:54:27.479572] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-05. [2025-10-02T20:54:27.624692] [DEBUG] [VALIDATOR ] PFD: All expected trading days are present. [2025-10-02T20:54:27.624789] [DEBUG] [VALIDATOR ] PFD: Primary data validation passed. [2025-10-02T20:54:27.625014] [INFO ] [MAIN ] PFD: Fetched primary data is valid. [2025-10-02T20:54:27.625081] [DEBUG] [LOCAL ] PFD: Saving primary data. [2025-10-02T20:54:27.625639] [DEBUG] [LOCAL ] PFD: Trimmed 7455 records to 5172 (keeping 200 days of data) [2025-10-02T20:54:27.661106] [DEBUG] [LOCAL ] PFD: Primary data saved (5172 records). [2025-10-02T20:54:27.661249] [INFO ] [MAIN ] PFD: Full history saved. [2025-10-02T20:54:27.661333] [INFO ] [MAIN ] Update Progress: 1663/2370 symbols completed. PFD took 25.9s. Estimated remaining: 1h 39m 39s. Rate: 7.1 symbols/min [2025-10-02T20:54:27.848552] [INFO ] [MAIN ] PFL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:54:27.848802] [DEBUG] [LOCAL ] PFL: No existing data file found in primary storage. [2025-10-02T20:54:27.848860] [WARN ] [MAIN ] PFL: No existing data found, performing full refresh instead. [2025-10-02T20:54:27.849005] [INFO ] [MAIN ] PFL: Wiping existing primary data before full refresh. [2025-10-02T20:54:27.849071] [INFO ] [LOCAL ] PFL: Starting deletion of primary data. [2025-10-02T20:54:27.849128] [DEBUG] [LOCAL ] PFL: No primary data file found to delete. [2025-10-02T20:54:27.849163] [INFO ] [MAIN ] PFL: Starting full primary refresh. [2025-10-02T20:54:28.234472] [INFO ] [REMOTE ] PFL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:54:28.272978] [INFO ] [REMOTE ] PFL: Fetching primary data for 2024-12. [2025-10-02T20:54:29.072973] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-05. [2025-10-02T20:54:29.214393] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-02T20:54:29.873024] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-01. [2025-10-02T20:54:30.224761] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-05 (2.75 seconds). [2025-10-02T20:54:30.568518] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-02T20:54:30.580615] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-02T20:54:30.673000] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-06. [2025-10-02T20:54:31.473034] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-06. [2025-10-02T20:54:32.261388] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-02T20:54:32.272958] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-07. [2025-10-02T20:54:33.073017] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-02. [2025-10-02T20:54:33.873068] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-01. [2025-10-02T20:54:34.038159] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-02T20:54:34.193215] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-02T20:54:34.192483] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-06 (2.72 seconds). [2025-10-02T20:54:34.446612] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-02T20:54:34.673047] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-07. [2025-10-02T20:54:35.473012] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-08. [2025-10-02T20:54:36.273048] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-02. [2025-10-02T20:54:36.944431] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-02T20:54:37.072993] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-03. [2025-10-02T20:54:37.278602] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-02T20:54:37.323812] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-07 (2.65 seconds). [2025-10-02T20:54:37.869620] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-02T20:54:37.872946] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-04. [2025-10-02T20:54:38.672993] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-08. [2025-10-02T20:54:38.693150] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-02T20:54:39.473022] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-03. [2025-10-02T20:54:40.272975] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-09. [2025-10-02T20:54:40.353263] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-02T20:54:41.072980] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-04. [2025-10-02T20:54:41.180946] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-08 (2.51 seconds). [2025-10-02T20:54:41.657379] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-02T20:54:41.873004] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-09. [2025-10-02T20:54:42.223338] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-02T20:54:42.673044] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-05. [2025-10-02T20:54:43.473005] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-10. [2025-10-02T20:54:43.553957] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-02T20:54:44.273023] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-05. [2025-10-02T20:54:44.493431] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-09 (2.62 seconds). [2025-10-02T20:54:44.575098] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-02T20:54:44.577090] [INFO ] [REMOTE ] PFGC: Full fetch complete (67284 records). [2025-10-02T20:54:44.577190] [DEBUG] [VALIDATOR ] PFGC: Validating primary data. [2025-10-02T20:54:44.999717] [DEBUG] [VALIDATOR ] PFGC: All expected trading days are present. [2025-10-02T20:54:44.999810] [DEBUG] [VALIDATOR ] PFGC: Primary data validation passed. [2025-10-02T20:54:45.000807] [INFO ] [MAIN ] PFGC: Fetched primary data is valid. [2025-10-02T20:54:45.000870] [DEBUG] [LOCAL ] PFGC: Saving primary data. [2025-10-02T20:54:45.003065] [DEBUG] [LOCAL ] PFGC: Trimmed 67284 records to 47161 (keeping 200 days of data) [2025-10-02T20:54:45.090579] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-10. [2025-10-02T20:54:45.124035] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-02T20:54:45.313760] [DEBUG] [LOCAL ] PFGC: Primary data saved (47161 records). [2025-10-02T20:54:45.313990] [INFO ] [MAIN ] PFGC: Full history saved. [2025-10-02T20:54:45.314083] [INFO ] [MAIN ] Update Progress: 1664/2370 symbols completed. PFGC took 39.9s. Estimated remaining: 1h 39m 34s. Rate: 7.1 symbols/min [2025-10-02T20:54:45.506884] [INFO ] [MAIN ] PFLT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:54:45.507083] [DEBUG] [LOCAL ] PFLT: No existing data file found in primary storage. [2025-10-02T20:54:45.507122] [WARN ] [MAIN ] PFLT: No existing data found, performing full refresh instead. [2025-10-02T20:54:45.507241] [INFO ] [MAIN ] PFLT: Wiping existing primary data before full refresh. [2025-10-02T20:54:45.507285] [INFO ] [LOCAL ] PFLT: Starting deletion of primary data. [2025-10-02T20:54:45.507327] [DEBUG] [LOCAL ] PFLT: No primary data file found to delete. [2025-10-02T20:54:45.507361] [INFO ] [MAIN ] PFLT: Starting full primary refresh. [2025-10-02T20:54:45.617154] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-02T20:54:45.637508] [INFO ] [REMOTE ] PFE: Full fetch complete (77589 records). [2025-10-02T20:54:45.647924] [DEBUG] [VALIDATOR ] PFE: Validating primary data. [2025-10-02T20:54:45.679516] [FATAL] [VALIDATOR ] PFE: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T20:54:45.694531] [FATAL] [MAIN ] PFE: Fetched primary data is invalid. Refusing to save it. [2025-10-02T20:54:45.721365] [WARN ] [MAIN ] PFE: Deleting existing primary and derivative data due to validation failure. [2025-10-02T20:54:45.787436] [INFO ] [LOCAL ] PFE: Starting deletion of primary data. [2025-10-02T20:54:45.800023] [DEBUG] [LOCAL ] PFE: No primary data file found to delete. [2025-10-02T20:54:45.829316] [INFO ] [LOCAL ] PFE: Starting deletion of derivative data. [2025-10-02T20:54:45.829466] [DEBUG] [LOCAL ] PFE: No derivative data file found to delete. [2025-10-02T20:54:45.829910] [INFO ] [MAIN ] Update Progress: 1665/2370 symbols completed. PFE took 43.4s. Estimated remaining: 1h 39m 23s. Rate: 7.1 symbols/min [2025-10-02T20:54:45.876982] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-06. [2025-10-02T20:54:46.023514] [INFO ] [REMOTE ] PFLT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:54:46.114611] [INFO ] [MAIN ] PFN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:54:46.114803] [DEBUG] [LOCAL ] PFN: No existing data file found in primary storage. [2025-10-02T20:54:46.114847] [WARN ] [MAIN ] PFN: No existing data found, performing full refresh instead. [2025-10-02T20:54:46.114959] [INFO ] [MAIN ] PFN: Wiping existing primary data before full refresh. [2025-10-02T20:54:46.115057] [INFO ] [LOCAL ] PFN: Starting deletion of primary data. [2025-10-02T20:54:46.115128] [DEBUG] [LOCAL ] PFN: No primary data file found to delete. [2025-10-02T20:54:46.115166] [INFO ] [MAIN ] PFN: Starting full primary refresh. [2025-10-02T20:54:46.493198] [INFO ] [REMOTE ] PFN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:54:46.673009] [INFO ] [REMOTE ] PFN: Fetching primary data for 2024-12. [2025-10-02T20:54:46.774611] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-02T20:54:47.473062] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2024-12. [2025-10-02T20:54:48.059093] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-02T20:54:48.273015] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-06. [2025-10-02T20:54:49.073022] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-07. [2025-10-02T20:54:49.130052] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-02T20:54:49.308857] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-02T20:54:49.873001] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-01. [2025-10-02T20:54:49.916470] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-02T20:54:50.673086] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-08. [2025-10-02T20:54:51.002239] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-02T20:54:51.473018] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-01. [2025-10-02T20:54:51.712087] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-02T20:54:52.273014] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-02. [2025-10-02T20:54:53.072969] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-07. [2025-10-02T20:54:53.248827] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-02T20:54:53.343051] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-02T20:54:53.873034] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-03. [2025-10-02T20:54:53.892342] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-02T20:54:54.673043] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-09. [2025-10-02T20:54:54.951771] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-02T20:54:55.472976] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-04. [2025-10-02T20:54:55.682045] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-02T20:54:56.273030] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-10. [2025-10-02T20:54:56.887116] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-02T20:54:57.015314] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-02T20:54:57.016527] [INFO ] [REMOTE ] PFL: Full fetch complete (20125 records). [2025-10-02T20:54:57.016608] [DEBUG] [VALIDATOR ] PFL: Validating primary data. [2025-10-02T20:54:57.080374] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-08. [2025-10-02T20:54:57.439726] [DEBUG] [VALIDATOR ] PFL: All expected trading days are present. [2025-10-02T20:54:57.439834] [DEBUG] [VALIDATOR ] PFL: Primary data validation passed. [2025-10-02T20:54:57.440414] [INFO ] [MAIN ] PFL: Fetched primary data is valid. [2025-10-02T20:54:57.440469] [DEBUG] [LOCAL ] PFL: Saving primary data. [2025-10-02T20:54:57.441309] [DEBUG] [LOCAL ] PFL: Trimmed 20125 records to 13775 (keeping 200 days of data) [2025-10-02T20:54:57.528398] [DEBUG] [LOCAL ] PFL: Primary data saved (13775 records). [2025-10-02T20:54:57.528536] [INFO ] [MAIN ] PFL: Full history saved. [2025-10-02T20:54:57.528609] [INFO ] [MAIN ] Update Progress: 1666/2370 symbols completed. PFL took 29.9s. Estimated remaining: 1h 39m 16s. Rate: 7.1 symbols/min [2025-10-02T20:54:57.709604] [INFO ] [MAIN ] PFO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:54:57.709755] [DEBUG] [LOCAL ] PFO: No existing data file found in primary storage. [2025-10-02T20:54:57.709800] [WARN ] [MAIN ] PFO: No existing data found, performing full refresh instead. [2025-10-02T20:54:57.709909] [INFO ] [MAIN ] PFO: Wiping existing primary data before full refresh. [2025-10-02T20:54:57.709952] [INFO ] [LOCAL ] PFO: Starting deletion of primary data. [2025-10-02T20:54:57.709994] [DEBUG] [LOCAL ] PFO: No primary data file found to delete. [2025-10-02T20:54:57.710067] [INFO ] [MAIN ] PFO: Starting full primary refresh. [2025-10-02T20:54:57.882393] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-02. [2025-10-02T20:54:57.981425] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-02T20:54:58.116709] [INFO ] [REMOTE ] PFO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:54:58.673030] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-05. [2025-10-02T20:54:59.305739] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-02T20:54:59.473012] [INFO ] [REMOTE ] PFO: Fetching primary data for 2024-12. [2025-10-02T20:55:00.082015] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-02T20:55:00.209342] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-02T20:55:00.273045] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-09. [2025-10-02T20:55:00.894127] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-02T20:55:01.073017] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-06. [2025-10-02T20:55:01.873002] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-10. [2025-10-02T20:55:01.988610] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-02T20:55:02.428662] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-02T20:55:02.429581] [INFO ] [REMOTE ] PFH: Full fetch complete (10544 records). [2025-10-02T20:55:02.429710] [DEBUG] [VALIDATOR ] PFH: Validating primary data. [2025-10-02T20:55:02.678102] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-07. [2025-10-02T20:55:02.832389] [DEBUG] [VALIDATOR ] PFH: All expected trading days are present. [2025-10-02T20:55:02.832481] [DEBUG] [VALIDATOR ] PFH: Primary data validation passed. [2025-10-02T20:55:02.832805] [INFO ] [MAIN ] PFH: Fetched primary data is valid. [2025-10-02T20:55:02.832870] [DEBUG] [LOCAL ] PFH: Saving primary data. [2025-10-02T20:55:02.833371] [DEBUG] [LOCAL ] PFH: Trimmed 10544 records to 6858 (keeping 200 days of data) [2025-10-02T20:55:02.879466] [DEBUG] [LOCAL ] PFH: Primary data saved (6858 records). [2025-10-02T20:55:02.879617] [INFO ] [MAIN ] PFH: Full history saved. [2025-10-02T20:55:02.879740] [INFO ] [MAIN ] Update Progress: 1667/2370 symbols completed. PFH took 43.8s. Estimated remaining: 1h 39m 6s. Rate: 7.1 symbols/min [2025-10-02T20:55:03.071190] [INFO ] [MAIN ] PFS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:55:03.071418] [DEBUG] [LOCAL ] PFS: No existing data file found in primary storage. [2025-10-02T20:55:03.071465] [WARN ] [MAIN ] PFS: No existing data found, performing full refresh instead. [2025-10-02T20:55:03.071588] [INFO ] [MAIN ] PFS: Wiping existing primary data before full refresh. [2025-10-02T20:55:03.071633] [INFO ] [LOCAL ] PFS: Starting deletion of primary data. [2025-10-02T20:55:03.071723] [DEBUG] [LOCAL ] PFS: No primary data file found to delete. [2025-10-02T20:55:03.071766] [INFO ] [MAIN ] PFS: Starting full primary refresh. [2025-10-02T20:55:03.468237] [INFO ] [REMOTE ] PFS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:55:03.472976] [INFO ] [REMOTE ] PFS: Fetching primary data for 2024-12. [2025-10-02T20:55:04.067721] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-02T20:55:04.273009] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-08. [2025-10-02T20:55:05.026923] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-02T20:55:05.072970] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-01. [2025-10-02T20:55:05.466105] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-02T20:55:05.736199] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-02T20:55:05.873045] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-02. [2025-10-02T20:55:06.484735] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-02T20:55:06.673039] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-09. [2025-10-02T20:55:07.472965] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-03. [2025-10-02T20:55:07.878355] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-02T20:55:07.978463] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-02T20:55:08.273000] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-04. [2025-10-02T20:55:08.815378] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-02T20:55:09.073001] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-03. [2025-10-02T20:55:09.873003] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-10. [2025-10-02T20:55:10.673078] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-05. [2025-10-02T20:55:10.787102] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-02T20:55:10.788988] [INFO ] [REMOTE ] PFN: Full fetch complete (30968 records). [2025-10-02T20:55:10.789242] [DEBUG] [VALIDATOR ] PFN: Validating primary data. [2025-10-02T20:55:11.040495] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-02T20:55:11.242821] [DEBUG] [VALIDATOR ] PFN: All expected trading days are present. [2025-10-02T20:55:11.243045] [DEBUG] [VALIDATOR ] PFN: Primary data validation passed. [2025-10-02T20:55:11.243839] [INFO ] [MAIN ] PFN: Fetched primary data is valid. [2025-10-02T20:55:11.244099] [DEBUG] [LOCAL ] PFN: Saving primary data. [2025-10-02T20:55:11.245330] [DEBUG] [LOCAL ] PFN: Trimmed 30968 records to 22007 (keeping 200 days of data) [2025-10-02T20:55:11.380699] [DEBUG] [LOCAL ] PFN: Primary data saved (22007 records). [2025-10-02T20:55:11.380831] [INFO ] [MAIN ] PFN: Full history saved. [2025-10-02T20:55:11.380930] [INFO ] [MAIN ] Update Progress: 1668/2370 symbols completed. PFN took 25.5s. Estimated remaining: 1h 38m 57s. Rate: 7.1 symbols/min [2025-10-02T20:55:11.475701] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-04. [2025-10-02T20:55:11.482102] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-02T20:55:11.582748] [INFO ] [MAIN ] PFSI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:55:11.582921] [DEBUG] [LOCAL ] PFSI: No existing data file found in primary storage. [2025-10-02T20:55:11.582961] [WARN ] [MAIN ] PFSI: No existing data found, performing full refresh instead. [2025-10-02T20:55:11.583106] [INFO ] [MAIN ] PFSI: Wiping existing primary data before full refresh. [2025-10-02T20:55:11.583162] [INFO ] [LOCAL ] PFSI: Starting deletion of primary data. [2025-10-02T20:55:11.583205] [DEBUG] [LOCAL ] PFSI: No primary data file found to delete. [2025-10-02T20:55:11.583253] [INFO ] [MAIN ] PFSI: Starting full primary refresh. [2025-10-02T20:55:11.970310] [INFO ] [REMOTE ] PFSI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:55:12.272990] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-01. [2025-10-02T20:55:13.052906] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-02T20:55:13.072973] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-05. [2025-10-02T20:55:13.850692] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-02T20:55:13.873014] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-06. [2025-10-02T20:55:14.353172] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-02T20:55:14.389247] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-02T20:55:14.673020] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2024-12. [2025-10-02T20:55:15.473002] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-07. [2025-10-02T20:55:15.615671] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-02T20:55:16.264781] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-02T20:55:16.273010] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-02. [2025-10-02T20:55:17.073014] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-06. [2025-10-02T20:55:17.395852] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-02T20:55:17.873008] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-08. [2025-10-02T20:55:18.497606] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-02T20:55:18.673004] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-01. [2025-10-02T20:55:18.703075] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-02T20:55:19.473041] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-03. [2025-10-02T20:55:20.060343] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-02T20:55:20.273008] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-09. [2025-10-02T20:55:20.745949] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-02T20:55:21.073004] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-04. [2025-10-02T20:55:21.170613] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-02T20:55:21.872984] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-10. [2025-10-02T20:55:22.331671] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-02T20:55:22.332561] [INFO ] [REMOTE ] PFO: Full fetch complete (7934 records). [2025-10-02T20:55:22.332696] [DEBUG] [VALIDATOR ] PFO: Validating primary data. [2025-10-02T20:55:22.675860] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-02. [2025-10-02T20:55:22.744342] [DEBUG] [VALIDATOR ] PFO: All expected trading days are present. [2025-10-02T20:55:22.744454] [DEBUG] [VALIDATOR ] PFO: Primary data validation passed. [2025-10-02T20:55:22.744802] [INFO ] [MAIN ] PFO: Fetched primary data is valid. [2025-10-02T20:55:22.744879] [DEBUG] [LOCAL ] PFO: Saving primary data. [2025-10-02T20:55:22.745770] [DEBUG] [LOCAL ] PFO: Trimmed 7934 records to 6008 (keeping 200 days of data) [2025-10-02T20:55:22.773392] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-02T20:55:22.822837] [DEBUG] [LOCAL ] PFO: Primary data saved (6008 records). [2025-10-02T20:55:22.822967] [INFO ] [MAIN ] PFO: Full history saved. [2025-10-02T20:55:22.823041] [INFO ] [MAIN ] Update Progress: 1669/2370 symbols completed. PFO took 25.3s. Estimated remaining: 1h 38m 50s. Rate: 7.1 symbols/min [2025-10-02T20:55:23.003159] [INFO ] [MAIN ] PG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:55:23.003385] [DEBUG] [LOCAL ] PG: No existing data file found in primary storage. [2025-10-02T20:55:23.003477] [WARN ] [MAIN ] PG: No existing data found, performing full refresh instead. [2025-10-02T20:55:23.003637] [INFO ] [MAIN ] PG: Wiping existing primary data before full refresh. [2025-10-02T20:55:23.003734] [INFO ] [LOCAL ] PG: Starting deletion of primary data. [2025-10-02T20:55:23.003806] [DEBUG] [LOCAL ] PG: No primary data file found to delete. [2025-10-02T20:55:23.003850] [INFO ] [MAIN ] PG: Starting full primary refresh. [2025-10-02T20:55:23.383916] [INFO ] [REMOTE ] PG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:55:23.472994] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-07. [2025-10-02T20:55:23.814089] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-02T20:55:24.272992] [INFO ] [REMOTE ] PG: Fetching primary data for 2024-12. [2025-10-02T20:55:25.072972] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-05. [2025-10-02T20:55:25.180485] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-02T20:55:25.872994] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-08. [2025-10-02T20:55:26.494581] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-10-02T20:55:26.536713] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-02T20:55:26.673042] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-01. [2025-10-02T20:55:27.123710] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-02T20:55:27.473022] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-03. [2025-10-02T20:55:28.273030] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-09. [2025-10-02T20:55:28.659618] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-02T20:55:28.842130] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-02T20:55:29.073014] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-04. [2025-10-02T20:55:29.873006] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-02. [2025-10-02T20:55:29.940809] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-02T20:55:30.672976] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-10. [2025-10-02T20:55:30.704179] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-02T20:55:31.473035] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-06. [2025-10-02T20:55:31.642505] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-02T20:55:32.046599] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-02T20:55:32.048858] [INFO ] [REMOTE ] PFLT: Full fetch complete (63884 records). [2025-10-02T20:55:32.048988] [DEBUG] [VALIDATOR ] PFLT: Validating primary data. [2025-10-02T20:55:32.278251] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-05. [2025-10-02T20:55:32.475484] [DEBUG] [VALIDATOR ] PFLT: All expected trading days are present. [2025-10-02T20:55:32.475631] [DEBUG] [VALIDATOR ] PFLT: Primary data validation passed. [2025-10-02T20:55:32.476863] [INFO ] [MAIN ] PFLT: Fetched primary data is valid. [2025-10-02T20:55:32.476931] [DEBUG] [LOCAL ] PFLT: Saving primary data. [2025-10-02T20:55:32.478782] [DEBUG] [LOCAL ] PFLT: Trimmed 63884 records to 44136 (keeping 200 days of data) [2025-10-02T20:55:32.770619] [DEBUG] [LOCAL ] PFLT: Primary data saved (44136 records). [2025-10-02T20:55:32.770780] [INFO ] [MAIN ] PFLT: Full history saved. [2025-10-02T20:55:32.770861] [INFO ] [MAIN ] Update Progress: 1670/2370 symbols completed. PFLT took 47.5s. Estimated remaining: 1h 38m 42s. Rate: 7.1 symbols/min [2025-10-02T20:55:32.914515] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-02T20:55:32.990494] [INFO ] [MAIN ] PGP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:55:32.991442] [DEBUG] [LOCAL ] PGP: No existing data file found in primary storage. [2025-10-02T20:55:32.991496] [WARN ] [MAIN ] PGP: No existing data found, performing full refresh instead. [2025-10-02T20:55:32.991633] [INFO ] [MAIN ] PGP: Wiping existing primary data before full refresh. [2025-10-02T20:55:32.991717] [INFO ] [LOCAL ] PGP: Starting deletion of primary data. [2025-10-02T20:55:32.991768] [DEBUG] [LOCAL ] PGP: No primary data file found to delete. [2025-10-02T20:55:32.991814] [INFO ] [MAIN ] PGP: Starting full primary refresh. [2025-10-02T20:55:33.078100] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-07. [2025-10-02T20:55:33.435458] [INFO ] [REMOTE ] PGP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:55:33.451829] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-02T20:55:33.873019] [INFO ] [REMOTE ] PGP: Fetching primary data for 2024-12. [2025-10-02T20:55:34.629090] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-02T20:55:34.672986] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-03. [2025-10-02T20:55:34.928832] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-02T20:55:35.473079] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-01. [2025-10-02T20:55:36.273052] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-06. [2025-10-02T20:55:36.311459] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-02T20:55:36.847144] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-02T20:55:37.073067] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-08. [2025-10-02T20:55:37.497303] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-02T20:55:37.873024] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-04. [2025-10-02T20:55:38.119126] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-02T20:55:38.673010] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-07. [2025-10-02T20:55:39.473036] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-09. [2025-10-02T20:55:40.028199] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-02T20:55:40.085883] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-02T20:55:40.273032] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-05. [2025-10-02T20:55:40.608332] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-02T20:55:41.073064] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-08. [2025-10-02T20:55:41.873054] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-02. [2025-10-02T20:55:42.355458] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-02T20:55:42.386004] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-02T20:55:42.624585] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-10-02T20:55:42.672964] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-09. [2025-10-02T20:55:43.473018] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-06. [2025-10-02T20:55:44.070535] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-02T20:55:44.273068] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-10. [2025-10-02T20:55:45.073047] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-10. [2025-10-02T20:55:45.415575] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-02T20:55:45.417285] [INFO ] [REMOTE ] PFSI: Full fetch complete (41022 records). [2025-10-02T20:55:45.417408] [DEBUG] [VALIDATOR ] PFSI: Validating primary data. [2025-10-02T20:55:45.850338] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-06 (2.38 seconds). [2025-10-02T20:55:45.885206] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-03. [2025-10-02T20:55:45.885432] [DEBUG] [VALIDATOR ] PFSI: All expected trading days are present. [2025-10-02T20:55:45.898100] [DEBUG] [VALIDATOR ] PFSI: Primary data validation passed. [2025-10-02T20:55:45.899435] [INFO ] [MAIN ] PFSI: Fetched primary data is valid. [2025-10-02T20:55:45.900068] [DEBUG] [LOCAL ] PFSI: Saving primary data. [2025-10-02T20:55:45.901358] [DEBUG] [LOCAL ] PFSI: Trimmed 41022 records to 28951 (keeping 200 days of data) [2025-10-02T20:55:46.085536] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-02T20:55:46.089776] [INFO ] [REMOTE ] PFS: Full fetch complete (51771 records). [2025-10-02T20:55:46.091049] [DEBUG] [VALIDATOR ] PFS: Validating primary data. [2025-10-02T20:55:46.455528] [DEBUG] [LOCAL ] PFSI: Primary data saved (28951 records). [2025-10-02T20:55:46.459145] [INFO ] [MAIN ] PFSI: Full history saved. [2025-10-02T20:55:46.459703] [INFO ] [MAIN ] Update Progress: 1671/2370 symbols completed. PFSI took 35.1s. Estimated remaining: 1h 38m 36s. Rate: 7.1 symbols/min [2025-10-02T20:55:46.575702] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-02T20:55:46.649264] [DEBUG] [VALIDATOR ] PFS: All expected trading days are present. [2025-10-02T20:55:46.683071] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-07. [2025-10-02T20:55:46.687288] [DEBUG] [VALIDATOR ] PFS: Primary data validation passed. [2025-10-02T20:55:46.690211] [INFO ] [MAIN ] PFS: Fetched primary data is valid. [2025-10-02T20:55:46.690332] [DEBUG] [LOCAL ] PFS: Saving primary data. [2025-10-02T20:55:46.749099] [DEBUG] [LOCAL ] PFS: Trimmed 51771 records to 35837 (keeping 200 days of data) [2025-10-02T20:55:46.769363] [INFO ] [MAIN ] PGR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:55:46.769936] [DEBUG] [LOCAL ] PGR: No existing data file found in primary storage. [2025-10-02T20:55:46.770236] [WARN ] [MAIN ] PGR: No existing data found, performing full refresh instead. [2025-10-02T20:55:46.770373] [INFO ] [MAIN ] PGR: Wiping existing primary data before full refresh. [2025-10-02T20:55:46.770490] [INFO ] [LOCAL ] PGR: Starting deletion of primary data. [2025-10-02T20:55:46.770591] [DEBUG] [LOCAL ] PGR: No primary data file found to delete. [2025-10-02T20:55:46.770634] [INFO ] [MAIN ] PGR: Starting full primary refresh. [2025-10-02T20:55:47.275192] [INFO ] [REMOTE ] PGR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:55:47.397853] [DEBUG] [LOCAL ] PFS: Primary data saved (35837 records). [2025-10-02T20:55:47.398001] [INFO ] [MAIN ] PFS: Full history saved. [2025-10-02T20:55:47.398081] [INFO ] [MAIN ] Update Progress: 1672/2370 symbols completed. PFS took 44.5s. Estimated remaining: 1h 38m 24s. Rate: 7.1 symbols/min [2025-10-02T20:55:47.478239] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-04. [2025-10-02T20:55:47.600415] [INFO ] [MAIN ] PGRE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:55:47.600695] [DEBUG] [LOCAL ] PGRE: No existing data file found in primary storage. [2025-10-02T20:55:47.600758] [WARN ] [MAIN ] PGRE: No existing data found, performing full refresh instead. [2025-10-02T20:55:47.600888] [INFO ] [MAIN ] PGRE: Wiping existing primary data before full refresh. [2025-10-02T20:55:47.600933] [INFO ] [LOCAL ] PGRE: Starting deletion of primary data. [2025-10-02T20:55:47.600975] [DEBUG] [LOCAL ] PGRE: No primary data file found to delete. [2025-10-02T20:55:47.601028] [INFO ] [MAIN ] PGRE: Starting full primary refresh. [2025-10-02T20:55:47.977236] [INFO ] [REMOTE ] PGRE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:55:48.273018] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2024-12. [2025-10-02T20:55:48.311498] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-02T20:55:49.073010] [INFO ] [REMOTE ] PGR: Fetching primary data for 2024-12. [2025-10-02T20:55:49.209543] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-10-02T20:55:49.403605] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-02T20:55:49.873013] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-08. [2025-10-02T20:55:50.673029] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-05. [2025-10-02T20:55:50.906288] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-02T20:55:51.379712] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-02T20:55:51.473048] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-01. [2025-10-02T20:55:51.884288] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-02T20:55:52.273015] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-01. [2025-10-02T20:55:52.832584] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-02T20:55:53.073042] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-06. [2025-10-02T20:55:53.596160] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-02T20:55:53.872998] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-07. [2025-10-02T20:55:54.325889] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-02T20:55:54.672981] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-02. [2025-10-02T20:55:54.746500] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-02T20:55:55.473006] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-09. [2025-10-02T20:55:56.053478] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-02T20:55:56.273013] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-08. [2025-10-02T20:55:57.014463] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-02T20:55:57.073005] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-09. [2025-10-02T20:55:57.654317] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-02T20:55:57.750532] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-02T20:55:57.873000] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-03. [2025-10-02T20:55:58.673043] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-02. [2025-10-02T20:55:59.472989] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-10. [2025-10-02T20:55:59.532461] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-02T20:55:59.892354] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-02T20:55:59.894018] [INFO ] [REMOTE ] PG: Full fetch complete (77395 records). [2025-10-02T20:55:59.894186] [DEBUG] [VALIDATOR ] PG: Validating primary data. [2025-10-02T20:55:59.895121] [FATAL] [VALIDATOR ] PG: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T20:55:59.895279] [FATAL] [MAIN ] PG: Fetched primary data is invalid. Refusing to save it. [2025-10-02T20:55:59.895468] [WARN ] [MAIN ] PG: Deleting existing primary and derivative data due to validation failure. [2025-10-02T20:55:59.895544] [INFO ] [LOCAL ] PG: Starting deletion of primary data. [2025-10-02T20:55:59.895612] [DEBUG] [LOCAL ] PG: No primary data file found to delete. [2025-10-02T20:55:59.895676] [INFO ] [LOCAL ] PG: Starting deletion of derivative data. [2025-10-02T20:55:59.895756] [DEBUG] [LOCAL ] PG: No derivative data file found to delete. [2025-10-02T20:55:59.895881] [INFO ] [MAIN ] Update Progress: 1673/2370 symbols completed. PG took 37.1s. Estimated remaining: 1h 38m 18s. Rate: 7.1 symbols/min [2025-10-02T20:56:00.087085] [INFO ] [MAIN ] PGZ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:56:00.087301] [DEBUG] [LOCAL ] PGZ: No existing data file found in primary storage. [2025-10-02T20:56:00.087364] [WARN ] [MAIN ] PGZ: No existing data found, performing full refresh instead. [2025-10-02T20:56:00.087476] [INFO ] [MAIN ] PGZ: Wiping existing primary data before full refresh. [2025-10-02T20:56:00.087520] [INFO ] [LOCAL ] PGZ: Starting deletion of primary data. [2025-10-02T20:56:00.087562] [DEBUG] [LOCAL ] PGZ: No primary data file found to delete. [2025-10-02T20:56:00.087597] [INFO ] [MAIN ] PGZ: Starting full primary refresh. [2025-10-02T20:56:00.279327] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-04. [2025-10-02T20:56:00.495298] [INFO ] [REMOTE ] PGZ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:56:00.526311] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-02T20:56:01.073009] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2024-12. [2025-10-02T20:56:01.872992] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-03. [2025-10-02T20:56:02.094123] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-02T20:56:02.133487] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-02T20:56:02.673029] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-05. [2025-10-02T20:56:03.473003] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-10. [2025-10-02T20:56:03.807319] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-02T20:56:03.924095] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-02T20:56:03.924996] [INFO ] [REMOTE ] PGP: Full fetch complete (7842 records). [2025-10-02T20:56:03.925089] [DEBUG] [VALIDATOR ] PGP: Validating primary data. [2025-10-02T20:56:04.277810] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-04. [2025-10-02T20:56:04.344507] [DEBUG] [VALIDATOR ] PGP: All expected trading days are present. [2025-10-02T20:56:04.344732] [DEBUG] [VALIDATOR ] PGP: Primary data validation passed. [2025-10-02T20:56:04.345285] [INFO ] [MAIN ] PGP: Fetched primary data is valid. [2025-10-02T20:56:04.345342] [DEBUG] [LOCAL ] PGP: Saving primary data. [2025-10-02T20:56:04.346195] [DEBUG] [LOCAL ] PGP: Trimmed 7842 records to 5544 (keeping 200 days of data) [2025-10-02T20:56:04.377245] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-02T20:56:04.423061] [DEBUG] [LOCAL ] PGP: Primary data saved (5544 records). [2025-10-02T20:56:04.423229] [INFO ] [MAIN ] PGP: Full history saved. [2025-10-02T20:56:04.423328] [INFO ] [MAIN ] Update Progress: 1674/2370 symbols completed. PGP took 31.7s. Estimated remaining: 1h 38m 8s. Rate: 7.1 symbols/min [2025-10-02T20:56:04.613627] [INFO ] [MAIN ] PH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:56:04.613808] [DEBUG] [LOCAL ] PH: No existing data file found in primary storage. [2025-10-02T20:56:04.613849] [WARN ] [MAIN ] PH: No existing data found, performing full refresh instead. [2025-10-02T20:56:04.613960] [INFO ] [MAIN ] PH: Wiping existing primary data before full refresh. [2025-10-02T20:56:04.614002] [INFO ] [LOCAL ] PH: Starting deletion of primary data. [2025-10-02T20:56:04.614044] [DEBUG] [LOCAL ] PH: No primary data file found to delete. [2025-10-02T20:56:04.614076] [INFO ] [MAIN ] PH: Starting full primary refresh. [2025-10-02T20:56:05.005993] [INFO ] [REMOTE ] PH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:56:05.073050] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-06. [2025-10-02T20:56:05.873053] [INFO ] [REMOTE ] PH: Fetching primary data for 2024-12. [2025-10-02T20:56:06.524703] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-02T20:56:06.591618] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-02T20:56:06.673008] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-05. [2025-10-02T20:56:07.007107] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-02T20:56:07.473002] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-07. [2025-10-02T20:56:08.272973] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-01. [2025-10-02T20:56:08.768718] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-02T20:56:09.072966] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-06. [2025-10-02T20:56:09.199624] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-02T20:56:09.204373] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-02T20:56:09.873010] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-02. [2025-10-02T20:56:10.642060] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-02T20:56:10.672969] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-03. [2025-10-02T20:56:11.094457] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-02T20:56:11.342004] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-02T20:56:11.472999] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-07. [2025-10-02T20:56:12.273017] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-04. [2025-10-02T20:56:12.819677] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-02T20:56:13.073030] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-01. [2025-10-02T20:56:13.805797] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-10-02T20:56:13.873012] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-05. [2025-10-02T20:56:14.608000] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-02T20:56:14.673014] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-06. [2025-10-02T20:56:14.795439] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-02T20:56:15.306178] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-02T20:56:15.473019] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-07. [2025-10-02T20:56:16.206478] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-02T20:56:16.273015] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-08. [2025-10-02T20:56:17.073044] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-08. [2025-10-02T20:56:17.095443] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-02T20:56:17.873007] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-09. [2025-10-02T20:56:18.673039] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-02. [2025-10-02T20:56:18.712707] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-02T20:56:18.945883] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-02T20:56:19.472994] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-10. [2025-10-02T20:56:20.023529] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-02T20:56:20.024362] [INFO ] [REMOTE ] PGZ: Full fetch complete (9015 records). [2025-10-02T20:56:20.024437] [DEBUG] [VALIDATOR ] PGZ: Validating primary data. [2025-10-02T20:56:20.278162] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-08. [2025-10-02T20:56:20.437824] [DEBUG] [VALIDATOR ] PGZ: All expected trading days are present. [2025-10-02T20:56:20.438100] [DEBUG] [VALIDATOR ] PGZ: Primary data validation passed. [2025-10-02T20:56:20.438412] [INFO ] [MAIN ] PGZ: Fetched primary data is valid. [2025-10-02T20:56:20.438631] [DEBUG] [LOCAL ] PGZ: Saving primary data. [2025-10-02T20:56:20.439427] [DEBUG] [LOCAL ] PGZ: Trimmed 9015 records to 5505 (keeping 200 days of data) [2025-10-02T20:56:20.487918] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-02T20:56:20.506606] [DEBUG] [LOCAL ] PGZ: Primary data saved (5505 records). [2025-10-02T20:56:20.506799] [INFO ] [MAIN ] PGZ: Full history saved. [2025-10-02T20:56:20.506887] [INFO ] [MAIN ] Update Progress: 1675/2370 symbols completed. PGZ took 20.6s. Estimated remaining: 1h 38m 2s. Rate: 7.1 symbols/min [2025-10-02T20:56:20.698061] [INFO ] [MAIN ] PHD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:56:20.698279] [DEBUG] [LOCAL ] PHD: No existing data file found in primary storage. [2025-10-02T20:56:20.698332] [WARN ] [MAIN ] PHD: No existing data found, performing full refresh instead. [2025-10-02T20:56:20.698444] [INFO ] [MAIN ] PHD: Wiping existing primary data before full refresh. [2025-10-02T20:56:20.698486] [INFO ] [LOCAL ] PHD: Starting deletion of primary data. [2025-10-02T20:56:20.698528] [DEBUG] [LOCAL ] PHD: No primary data file found to delete. [2025-10-02T20:56:20.698561] [INFO ] [MAIN ] PHD: Starting full primary refresh. [2025-10-02T20:56:21.075710] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-03. [2025-10-02T20:56:21.079906] [INFO ] [REMOTE ] PHD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:56:21.872996] [INFO ] [REMOTE ] PHD: Fetching primary data for 2024-12. [2025-10-02T20:56:22.106502] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-02T20:56:22.672984] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-09. [2025-10-02T20:56:22.864978] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-02T20:56:22.974219] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-02T20:56:23.473011] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-04. [2025-10-02T20:56:24.260091] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-02T20:56:24.272979] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-10. [2025-10-02T20:56:25.072980] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-09. [2025-10-02T20:56:25.374511] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-02T20:56:25.696180] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-02T20:56:25.698594] [INFO ] [REMOTE ] PGRE: Full fetch complete (63901 records). [2025-10-02T20:56:25.698779] [DEBUG] [VALIDATOR ] PGRE: Validating primary data. [2025-10-02T20:56:25.885401] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-01. [2025-10-02T20:56:26.123831] [DEBUG] [VALIDATOR ] PGRE: All expected trading days are present. [2025-10-02T20:56:26.123925] [DEBUG] [VALIDATOR ] PGRE: Primary data validation passed. [2025-10-02T20:56:26.125052] [INFO ] [MAIN ] PGRE: Fetched primary data is valid. [2025-10-02T20:56:26.125125] [DEBUG] [LOCAL ] PGRE: Saving primary data. [2025-10-02T20:56:26.127228] [DEBUG] [LOCAL ] PGRE: Trimmed 63901 records to 46986 (keeping 200 days of data) [2025-10-02T20:56:26.414117] [DEBUG] [LOCAL ] PGRE: Primary data saved (46986 records). [2025-10-02T20:56:26.414258] [INFO ] [MAIN ] PGRE: Full history saved. [2025-10-02T20:56:26.414333] [INFO ] [MAIN ] Update Progress: 1676/2370 symbols completed. PGRE took 39.0s. Estimated remaining: 1h 37m 53s. Rate: 7.1 symbols/min [2025-10-02T20:56:26.600480] [INFO ] [MAIN ] PHG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:56:26.600723] [DEBUG] [LOCAL ] PHG: No existing data file found in primary storage. [2025-10-02T20:56:26.600776] [WARN ] [MAIN ] PHG: No existing data found, performing full refresh instead. [2025-10-02T20:56:26.600902] [INFO ] [MAIN ] PHG: Wiping existing primary data before full refresh. [2025-10-02T20:56:26.600946] [INFO ] [LOCAL ] PHG: Starting deletion of primary data. [2025-10-02T20:56:26.600991] [DEBUG] [LOCAL ] PHG: No primary data file found to delete. [2025-10-02T20:56:26.601025] [INFO ] [MAIN ] PHG: Starting full primary refresh. [2025-10-02T20:56:26.673714] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-05. [2025-10-02T20:56:26.952519] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-02T20:56:27.027688] [INFO ] [REMOTE ] PHG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:56:27.241586] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-02T20:56:27.473013] [INFO ] [REMOTE ] PHG: Fetching primary data for 2024-12. [2025-10-02T20:56:28.272990] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-02. [2025-10-02T20:56:28.463915] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-02T20:56:28.781541] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-02T20:56:29.072968] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-01. [2025-10-02T20:56:29.229775] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-02T20:56:29.873001] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-06. [2025-10-02T20:56:30.672983] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-03. [2025-10-02T20:56:30.735373] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-02T20:56:31.167159] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-02T20:56:31.473053] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-07. [2025-10-02T20:56:31.694068] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-02T20:56:32.273013] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-04. [2025-10-02T20:56:32.753202] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-02T20:56:33.052617] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-02T20:56:33.073031] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-10. [2025-10-02T20:56:33.873014] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-02. [2025-10-02T20:56:34.673052] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-05. [2025-10-02T20:56:34.686407] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-02T20:56:34.689463] [INFO ] [REMOTE ] PGR: Full fetch complete (76559 records). [2025-10-02T20:56:34.689675] [DEBUG] [VALIDATOR ] PGR: Validating primary data. [2025-10-02T20:56:35.141815] [DEBUG] [VALIDATOR ] PGR: All expected trading days are present. [2025-10-02T20:56:35.141904] [DEBUG] [VALIDATOR ] PGR: Primary data validation passed. [2025-10-02T20:56:35.143088] [INFO ] [MAIN ] PGR: Fetched primary data is valid. [2025-10-02T20:56:35.143161] [DEBUG] [LOCAL ] PGR: Saving primary data. [2025-10-02T20:56:35.146058] [DEBUG] [LOCAL ] PGR: Trimmed 76559 records to 53322 (keeping 200 days of data) [2025-10-02T20:56:35.482075] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-08. [2025-10-02T20:56:35.491049] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-02T20:56:35.529980] [DEBUG] [LOCAL ] PGR: Primary data saved (53322 records). [2025-10-02T20:56:35.530190] [INFO ] [MAIN ] PGR: Full history saved. [2025-10-02T20:56:35.530314] [INFO ] [MAIN ] Update Progress: 1677/2370 symbols completed. PGR took 49.1s. Estimated remaining: 1h 37m 45s. Rate: 7.1 symbols/min [2025-10-02T20:56:35.696172] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-02T20:56:36.273039] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-06. [2025-10-02T20:56:37.070477] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-02T20:56:37.073111] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-07. [2025-10-02T20:56:37.140745] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-02T20:56:37.873006] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-09. [2025-10-02T20:56:38.237410] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-02T20:56:38.673061] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-03. [2025-10-02T20:56:39.353847] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-02T20:56:39.473063] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-10. [2025-10-02T20:56:40.034419] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-02T20:56:40.272976] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-04. [2025-10-02T20:56:40.413157] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-02T20:56:40.414709] [INFO ] [REMOTE ] PH: Full fetch complete (56277 records). [2025-10-02T20:56:40.414800] [DEBUG] [VALIDATOR ] PH: Validating primary data. [2025-10-02T20:56:40.830784] [DEBUG] [VALIDATOR ] PH: All expected trading days are present. [2025-10-02T20:56:40.830944] [DEBUG] [VALIDATOR ] PH: Primary data validation passed. [2025-10-02T20:56:40.831960] [INFO ] [MAIN ] PH: Fetched primary data is valid. [2025-10-02T20:56:40.832029] [DEBUG] [LOCAL ] PH: Saving primary data. [2025-10-02T20:56:40.833320] [DEBUG] [LOCAL ] PH: Trimmed 56277 records to 38286 (keeping 200 days of data) [2025-10-02T20:56:41.073015] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-08. [2025-10-02T20:56:41.092179] [DEBUG] [LOCAL ] PH: Primary data saved (38286 records). [2025-10-02T20:56:41.092327] [INFO ] [MAIN ] PH: Full history saved. [2025-10-02T20:56:41.092405] [INFO ] [MAIN ] Update Progress: 1678/2370 symbols completed. PH took 36.7s. Estimated remaining: 1h 37m 35s. Rate: 7.1 symbols/min [2025-10-02T20:56:41.970885] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-02T20:56:41.973469] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-09. [2025-10-02T20:56:42.101854] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-02T20:56:42.673017] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-05. [2025-10-02T20:56:43.008824] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-02T20:56:43.473034] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-10. [2025-10-02T20:56:44.292419] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-02T20:56:44.293697] [INFO ] [REMOTE ] PHD: Full fetch complete (14800 records). [2025-10-02T20:56:44.293807] [DEBUG] [VALIDATOR ] PHD: Validating primary data. [2025-10-02T20:56:44.654160] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-02T20:56:44.701724] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-06. [2025-10-02T20:56:44.772409] [DEBUG] [VALIDATOR ] PHD: All expected trading days are present. [2025-10-02T20:56:44.772511] [DEBUG] [VALIDATOR ] PHD: Primary data validation passed. [2025-10-02T20:56:44.772923] [INFO ] [MAIN ] PHD: Fetched primary data is valid. [2025-10-02T20:56:44.772989] [DEBUG] [LOCAL ] PHD: Saving primary data. [2025-10-02T20:56:44.773769] [DEBUG] [LOCAL ] PHD: Trimmed 14800 records to 10664 (keeping 200 days of data) [2025-10-02T20:56:44.848078] [DEBUG] [LOCAL ] PHD: Primary data saved (10664 records). [2025-10-02T20:56:44.848279] [INFO ] [MAIN ] PHD: Full history saved. [2025-10-02T20:56:44.848405] [INFO ] [MAIN ] Update Progress: 1679/2370 symbols completed. PHD took 24.3s. Estimated remaining: 1h 37m 24s. Rate: 7.1 symbols/min [2025-10-02T20:56:46.461455] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-02T20:56:46.472506] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-07. [2025-10-02T20:56:48.156558] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-02T20:56:48.167929] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-08. [2025-10-02T20:56:49.513696] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-02T20:56:49.523628] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-09. [2025-10-02T20:56:51.214989] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-02T20:56:51.225443] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-10. [2025-10-02T20:56:52.517485] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-02T20:56:52.519410] [INFO ] [REMOTE ] PHG: Full fetch complete (65703 records). [2025-10-02T20:56:52.519541] [DEBUG] [VALIDATOR ] PHG: Validating primary data. [2025-10-02T20:56:53.102077] [DEBUG] [VALIDATOR ] PHG: All expected trading days are present. [2025-10-02T20:56:53.102185] [DEBUG] [VALIDATOR ] PHG: Primary data validation passed. [2025-10-02T20:56:53.103337] [INFO ] [MAIN ] PHG: Fetched primary data is valid. [2025-10-02T20:56:53.103412] [DEBUG] [LOCAL ] PHG: Saving primary data. [2025-10-02T20:56:53.105144] [DEBUG] [LOCAL ] PHG: Trimmed 65703 records to 46334 (keeping 200 days of data) [2025-10-02T20:56:53.442709] [DEBUG] [LOCAL ] PHG: Primary data saved (46334 records). [2025-10-02T20:56:53.442888] [INFO ] [MAIN ] PHG: Full history saved. [2025-10-02T20:56:53.442973] [INFO ] [MAIN ] Update Progress: 1680/2370 symbols completed. PHG took 27.0s. Estimated remaining: 1h 37m 16s. Rate: 7.1 symbols/min [2025-10-02T20:56:54.193380] [INFO ] [MAIN ] PHK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:56:54.272252] [INFO ] [MAIN ] PHI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:56:54.286944] [DEBUG] [LOCAL ] PHI: No existing data file found in primary storage. [2025-10-02T20:56:54.276372] [INFO ] [MAIN ] PHM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:56:54.281727] [DEBUG] [LOCAL ] PHK: No existing data file found in primary storage. [2025-10-02T20:56:54.292322] [WARN ] [MAIN ] PHI: No existing data found, performing full refresh instead. [2025-10-02T20:56:54.325858] [DEBUG] [LOCAL ] PHM: No existing data file found in primary storage. [2025-10-02T20:56:54.345789] [INFO ] [MAIN ] PHIN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:56:54.317849] [WARN ] [MAIN ] PHK: No existing data found, performing full refresh instead. [2025-10-02T20:56:54.346150] [DEBUG] [LOCAL ] PHIN: No existing data file found in primary storage. [2025-10-02T20:56:54.346280] [INFO ] [MAIN ] PHI: Wiping existing primary data before full refresh. [2025-10-02T20:56:54.346236] [INFO ] [MAIN ] PHK: Wiping existing primary data before full refresh. [2025-10-02T20:56:54.346498] [INFO ] [LOCAL ] PHI: Starting deletion of primary data. [2025-10-02T20:56:54.346833] [INFO ] [LOCAL ] PHK: Starting deletion of primary data. [2025-10-02T20:56:54.344815] [WARN ] [MAIN ] PHM: No existing data found, performing full refresh instead. [2025-10-02T20:56:54.346568] [WARN ] [MAIN ] PHIN: No existing data found, performing full refresh instead. [2025-10-02T20:56:54.347134] [INFO ] [MAIN ] PHM: Wiping existing primary data before full refresh. [2025-10-02T20:56:54.347239] [DEBUG] [LOCAL ] PHI: No primary data file found to delete. [2025-10-02T20:56:54.347532] [INFO ] [LOCAL ] PHM: Starting deletion of primary data. [2025-10-02T20:56:54.347876] [DEBUG] [LOCAL ] PHM: No primary data file found to delete. [2025-10-02T20:56:54.347460] [INFO ] [MAIN ] PHIN: Wiping existing primary data before full refresh. [2025-10-02T20:56:54.348152] [INFO ] [LOCAL ] PHIN: Starting deletion of primary data. [2025-10-02T20:56:54.347741] [DEBUG] [LOCAL ] PHK: No primary data file found to delete. [2025-10-02T20:56:54.347688] [INFO ] [MAIN ] PHI: Starting full primary refresh. [2025-10-02T20:56:54.348290] [INFO ] [MAIN ] PHM: Starting full primary refresh. [2025-10-02T20:56:54.353738] [DEBUG] [LOCAL ] PHIN: No primary data file found to delete. [2025-10-02T20:56:54.353821] [INFO ] [MAIN ] PHK: Starting full primary refresh. [2025-10-02T20:56:54.386328] [INFO ] [MAIN ] PHIN: Starting full primary refresh. [2025-10-02T20:56:55.713457] [INFO ] [REMOTE ] PHM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:56:55.755616] [INFO ] [REMOTE ] PHM: Fetching primary data for 2024-12. [2025-10-02T20:56:55.977766] [INFO ] [REMOTE ] PHIN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:56:55.932702] [INFO ] [REMOTE ] PHK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:56:56.000231] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2024-12. [2025-10-02T20:56:55.999949] [INFO ] [REMOTE ] PHI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:56:56.001546] [INFO ] [REMOTE ] PHI: Fetching primary data for 2024-12. [2025-10-02T20:56:56.002471] [INFO ] [REMOTE ] PHK: Fetching primary data for 2024-12. [2025-10-02T20:56:57.011569] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-02T20:56:57.015053] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-01. [2025-10-02T20:56:57.326195] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-02T20:56:57.334149] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-01. [2025-10-02T20:56:57.425158] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-02T20:56:57.431861] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-01. [2025-10-02T20:56:57.660518] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-02T20:56:57.664406] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-02. [2025-10-02T20:56:57.859328] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-02T20:56:57.869884] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-01. [2025-10-02T20:56:58.318314] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-02T20:56:58.324758] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-02. [2025-10-02T20:56:58.589371] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-02T20:56:58.592838] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-03. [2025-10-02T20:56:58.635944] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-02T20:56:58.642778] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-02. [2025-10-02T20:56:59.721768] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-02T20:56:59.735797] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-02T20:56:59.747993] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-02. [2025-10-02T20:56:59.756382] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-03. [2025-10-02T20:56:59.768569] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-02T20:56:59.773125] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-04. [2025-10-02T20:56:59.934502] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-02T20:57:00.272994] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-03. [2025-10-02T20:57:00.586922] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-02T20:57:01.072972] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-05. [2025-10-02T20:57:01.269028] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-02T20:57:01.495191] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-02T20:57:01.554963] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-02T20:57:01.873000] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-03. [2025-10-02T20:57:02.078971] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-02T20:57:02.672992] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-04. [2025-10-02T20:57:03.021101] [DEBUG] [REMOTE ] PHK: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-10-02T20:57:03.021455] [WARN ] [REMOTE ] PHK: No data returned for month 2025-04 [2025-10-02T20:57:03.021562] [FATAL] [REMOTE ] PHK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T20:57:03.021710] [FATAL] [MAIN ] PHK: Failed to fetch primary data. [2025-10-02T20:57:03.021790] [WARN ] [MAIN ] PHK: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T20:57:03.021929] [INFO ] [LOCAL ] PHK: Starting deletion of primary data. [2025-10-02T20:57:03.021996] [DEBUG] [LOCAL ] PHK: No primary data file found to delete. [2025-10-02T20:57:03.022036] [INFO ] [LOCAL ] PHK: Starting deletion of derivative data. [2025-10-02T20:57:03.022111] [DEBUG] [LOCAL ] PHK: No derivative data file found to delete. [2025-10-02T20:57:03.022188] [INFO ] [MAIN ] Update Progress: 1681/2370 symbols completed. PHK took 9.6s. Estimated remaining: 1h 37m 8s. Rate: 7.1 symbols/min [2025-10-02T20:57:03.217463] [INFO ] [MAIN ] PHR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:57:03.217700] [DEBUG] [LOCAL ] PHR: No existing data file found in primary storage. [2025-10-02T20:57:03.217757] [WARN ] [MAIN ] PHR: No existing data found, performing full refresh instead. [2025-10-02T20:57:03.217875] [INFO ] [MAIN ] PHR: Wiping existing primary data before full refresh. [2025-10-02T20:57:03.217918] [INFO ] [LOCAL ] PHR: Starting deletion of primary data. [2025-10-02T20:57:03.217961] [DEBUG] [LOCAL ] PHR: No primary data file found to delete. [2025-10-02T20:57:03.217994] [INFO ] [MAIN ] PHR: Starting full primary refresh. [2025-10-02T20:57:03.477199] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-04. [2025-10-02T20:57:03.671948] [INFO ] [REMOTE ] PHR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:57:03.964572] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-02T20:57:04.273013] [INFO ] [REMOTE ] PHR: Fetching primary data for 2024-12. [2025-10-02T20:57:05.073010] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-04. [2025-10-02T20:57:05.121764] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-02T20:57:05.722044] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-02T20:57:05.873014] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-06. [2025-10-02T20:57:06.672982] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-01. [2025-10-02T20:57:06.904117] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-02T20:57:07.078017] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-02T20:57:07.473016] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-07. [2025-10-02T20:57:08.230958] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-02T20:57:08.278145] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-08. [2025-10-02T20:57:08.291889] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-02T20:57:09.073021] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-05. [2025-10-02T20:57:09.092078] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-02T20:57:09.873012] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-09. [2025-10-02T20:57:10.681378] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-02. [2025-10-02T20:57:10.688284] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-02T20:57:11.005475] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-02T20:57:11.473000] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-05. [2025-10-02T20:57:12.139636] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-02T20:57:12.272966] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-10. [2025-10-02T20:57:12.736887] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-02T20:57:13.073003] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-03. [2025-10-02T20:57:13.153679] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-02T20:57:13.154885] [INFO ] [REMOTE ] PHI: Full fetch complete (21029 records). [2025-10-02T20:57:13.154965] [DEBUG] [VALIDATOR ] PHI: Validating primary data. [2025-10-02T20:57:13.545734] [DEBUG] [VALIDATOR ] PHI: All expected trading days are present. [2025-10-02T20:57:13.545817] [DEBUG] [VALIDATOR ] PHI: Primary data validation passed. [2025-10-02T20:57:13.546306] [INFO ] [MAIN ] PHI: Fetched primary data is valid. [2025-10-02T20:57:13.546347] [DEBUG] [LOCAL ] PHI: Saving primary data. [2025-10-02T20:57:13.547015] [DEBUG] [LOCAL ] PHI: Trimmed 21029 records to 15208 (keeping 200 days of data) [2025-10-02T20:57:13.649331] [DEBUG] [LOCAL ] PHI: Primary data saved (15208 records). [2025-10-02T20:57:13.649503] [INFO ] [MAIN ] PHI: Full history saved. [2025-10-02T20:57:13.649584] [INFO ] [MAIN ] Update Progress: 1682/2370 symbols completed. PHI took 20.2s. Estimated remaining: 1h 37m 1s. Rate: 7.1 symbols/min [2025-10-02T20:57:13.839267] [INFO ] [MAIN ] PII: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:57:13.839465] [DEBUG] [LOCAL ] PII: No existing data file found in primary storage. [2025-10-02T20:57:13.839524] [WARN ] [MAIN ] PII: No existing data found, performing full refresh instead. [2025-10-02T20:57:13.839663] [INFO ] [MAIN ] PII: Wiping existing primary data before full refresh. [2025-10-02T20:57:13.839724] [INFO ] [LOCAL ] PII: Starting deletion of primary data. [2025-10-02T20:57:13.839773] [DEBUG] [LOCAL ] PII: No primary data file found to delete. [2025-10-02T20:57:13.839810] [INFO ] [MAIN ] PII: Starting full primary refresh. [2025-10-02T20:57:13.878172] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-06. [2025-10-02T20:57:14.240558] [INFO ] [REMOTE ] PII: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:57:14.606905] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-02T20:57:14.672999] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-06. [2025-10-02T20:57:14.858431] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-02T20:57:15.473006] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-07. [2025-10-02T20:57:16.272967] [INFO ] [REMOTE ] PII: Fetching primary data for 2024-12. [2025-10-02T20:57:16.466690] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-02T20:57:17.039553] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-02T20:57:17.072954] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-08. [2025-10-02T20:57:17.519886] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-02T20:57:17.873005] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-07. [2025-10-02T20:57:18.351881] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-02T20:57:18.672998] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-04. [2025-10-02T20:57:19.473010] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-09. [2025-10-02T20:57:19.901178] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-02T20:57:19.993974] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-02T20:57:20.272985] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-05. [2025-10-02T20:57:20.420381] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-02T20:57:21.072993] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-01. [2025-10-02T20:57:21.711365] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-02T20:57:21.872991] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-10. [2025-10-02T20:57:22.497111] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-02T20:57:22.672978] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-06. [2025-10-02T20:57:22.856922] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-02T20:57:22.858568] [INFO ] [REMOTE ] PHIN: Full fetch complete (48167 records). [2025-10-02T20:57:22.858710] [DEBUG] [VALIDATOR ] PHIN: Validating primary data. [2025-10-02T20:57:23.261966] [DEBUG] [VALIDATOR ] PHIN: All expected trading days are present. [2025-10-02T20:57:23.262103] [DEBUG] [VALIDATOR ] PHIN: Primary data validation passed. [2025-10-02T20:57:23.263469] [INFO ] [MAIN ] PHIN: Fetched primary data is valid. [2025-10-02T20:57:23.263544] [DEBUG] [LOCAL ] PHIN: Saving primary data. [2025-10-02T20:57:23.265345] [DEBUG] [LOCAL ] PHIN: Trimmed 48167 records to 32840 (keeping 200 days of data) [2025-10-02T20:57:23.473033] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-02. [2025-10-02T20:57:23.479751] [DEBUG] [LOCAL ] PHIN: Primary data saved (32840 records). [2025-10-02T20:57:23.479961] [INFO ] [MAIN ] PHIN: Full history saved. [2025-10-02T20:57:23.480058] [INFO ] [MAIN ] Update Progress: 1683/2370 symbols completed. PHIN took 30.0s. Estimated remaining: 1h 36m 53s. Rate: 7.1 symbols/min [2025-10-02T20:57:23.651059] [INFO ] [MAIN ] PIM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:57:23.651317] [DEBUG] [LOCAL ] PIM: No existing data file found in primary storage. [2025-10-02T20:57:23.651364] [WARN ] [MAIN ] PIM: No existing data found, performing full refresh instead. [2025-10-02T20:57:23.651487] [INFO ] [MAIN ] PIM: Wiping existing primary data before full refresh. [2025-10-02T20:57:23.651530] [INFO ] [LOCAL ] PIM: Starting deletion of primary data. [2025-10-02T20:57:23.651571] [DEBUG] [LOCAL ] PIM: No primary data file found to delete. [2025-10-02T20:57:23.651603] [INFO ] [MAIN ] PIM: Starting full primary refresh. [2025-10-02T20:57:24.021448] [INFO ] [REMOTE ] PIM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:57:24.073764] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-02T20:57:24.273019] [INFO ] [REMOTE ] PIM: Fetching primary data for 2024-12. [2025-10-02T20:57:24.780214] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-02T20:57:25.073090] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-08. [2025-10-02T20:57:25.279353] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-02T20:57:25.873047] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-07. [2025-10-02T20:57:26.672977] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-01. [2025-10-02T20:57:27.075873] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-02T20:57:27.392432] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-02T20:57:27.417624] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-02T20:57:27.472975] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-08. [2025-10-02T20:57:28.273043] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-09. [2025-10-02T20:57:28.906338] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-02T20:57:29.073045] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-09. [2025-10-02T20:57:29.873050] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-03. [2025-10-02T20:57:30.460572] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-02T20:57:30.660626] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-02T20:57:30.672964] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-10. [2025-10-02T20:57:31.473012] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-10. [2025-10-02T20:57:31.816347] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-02T20:57:31.956661] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-02T20:57:31.958530] [INFO ] [REMOTE ] PHR: Full fetch complete (52436 records). [2025-10-02T20:57:31.958623] [DEBUG] [VALIDATOR ] PHR: Validating primary data. [2025-10-02T20:57:32.164744] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-02T20:57:32.236113] [INFO ] [REMOTE ] PHM: Full fetch complete (74574 records). [2025-10-02T20:57:32.248535] [DEBUG] [VALIDATOR ] PHM: Validating primary data. [2025-10-02T20:57:32.274846] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-02. [2025-10-02T20:57:32.278459] [FATAL] [VALIDATOR ] PHM: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T20:57:32.279578] [FATAL] [MAIN ] PHM: Fetched primary data is invalid. Refusing to save it. [2025-10-02T20:57:32.279693] [WARN ] [MAIN ] PHM: Deleting existing primary and derivative data due to validation failure. [2025-10-02T20:57:32.285727] [INFO ] [LOCAL ] PHM: Starting deletion of primary data. [2025-10-02T20:57:32.291021] [DEBUG] [LOCAL ] PHM: No primary data file found to delete. [2025-10-02T20:57:32.301603] [INFO ] [LOCAL ] PHM: Starting deletion of derivative data. [2025-10-02T20:57:32.341195] [DEBUG] [LOCAL ] PHM: No derivative data file found to delete. [2025-10-02T20:57:32.350519] [INFO ] [MAIN ] Update Progress: 1684/2370 symbols completed. PHM took 38.9s. Estimated remaining: 1h 36m 44s. Rate: 7.1 symbols/min [2025-10-02T20:57:32.450665] [DEBUG] [VALIDATOR ] PHR: All expected trading days are present. [2025-10-02T20:57:32.467669] [DEBUG] [VALIDATOR ] PHR: Primary data validation passed. [2025-10-02T20:57:32.480746] [INFO ] [MAIN ] PHR: Fetched primary data is valid. [2025-10-02T20:57:32.493628] [DEBUG] [LOCAL ] PHR: Saving primary data. [2025-10-02T20:57:32.556276] [DEBUG] [LOCAL ] PHR: Trimmed 52436 records to 37647 (keeping 200 days of data) [2025-10-02T20:57:32.583716] [INFO ] [MAIN ] PINE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:57:32.584470] [DEBUG] [LOCAL ] PINE: No existing data file found in primary storage. [2025-10-02T20:57:32.584528] [WARN ] [MAIN ] PINE: No existing data found, performing full refresh instead. [2025-10-02T20:57:32.584704] [INFO ] [MAIN ] PINE: Wiping existing primary data before full refresh. [2025-10-02T20:57:32.585123] [INFO ] [LOCAL ] PINE: Starting deletion of primary data. [2025-10-02T20:57:32.585199] [DEBUG] [LOCAL ] PINE: No primary data file found to delete. [2025-10-02T20:57:32.585290] [INFO ] [MAIN ] PINE: Starting full primary refresh. [2025-10-02T20:57:32.921959] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-02T20:57:33.089705] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-04. [2025-10-02T20:57:33.098074] [INFO ] [REMOTE ] PINE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:57:33.236028] [DEBUG] [LOCAL ] PHR: Primary data saved (37647 records). [2025-10-02T20:57:33.236183] [INFO ] [MAIN ] PHR: Full history saved. [2025-10-02T20:57:33.236263] [INFO ] [MAIN ] Update Progress: 1685/2370 symbols completed. PHR took 30.2s. Estimated remaining: 1h 36m 33s. Rate: 7.1 symbols/min [2025-10-02T20:57:33.425827] [INFO ] [MAIN ] PINS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:57:33.426012] [DEBUG] [LOCAL ] PINS: No existing data file found in primary storage. [2025-10-02T20:57:33.426051] [WARN ] [MAIN ] PINS: No existing data found, performing full refresh instead. [2025-10-02T20:57:33.426165] [INFO ] [MAIN ] PINS: Wiping existing primary data before full refresh. [2025-10-02T20:57:33.426215] [INFO ] [LOCAL ] PINS: Starting deletion of primary data. [2025-10-02T20:57:33.426308] [DEBUG] [LOCAL ] PINS: No primary data file found to delete. [2025-10-02T20:57:33.426352] [INFO ] [MAIN ] PINS: Starting full primary refresh. [2025-10-02T20:57:33.820726] [INFO ] [REMOTE ] PINS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:57:33.872965] [INFO ] [REMOTE ] PINS: Fetching primary data for 2024-12. [2025-10-02T20:57:34.673000] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-03. [2025-10-02T20:57:35.001946] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-02T20:57:35.354457] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-02T20:57:35.473042] [INFO ] [REMOTE ] PINE: Fetching primary data for 2024-12. [2025-10-02T20:57:35.916465] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-02T20:57:36.273020] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-01. [2025-10-02T20:57:36.394164] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-02T20:57:37.073007] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-01. [2025-10-02T20:57:37.872980] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-05. [2025-10-02T20:57:38.095503] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-02T20:57:38.093963] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-02T20:57:38.673015] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-04. [2025-10-02T20:57:39.209528] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-02T20:57:39.473019] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-02. [2025-10-02T20:57:39.542878] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-02T20:57:40.272985] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-06. [2025-10-02T20:57:40.495899] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-02T20:57:41.073040] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-03. [2025-10-02T20:57:41.658304] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-02T20:57:41.873015] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-05. [2025-10-02T20:57:41.981790] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-02T20:57:42.621285] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-02T20:57:42.673011] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-06. [2025-10-02T20:57:43.329582] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-02T20:57:43.472969] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-07. [2025-10-02T20:57:44.273064] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-02. [2025-10-02T20:57:44.983694] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-02T20:57:45.073059] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-07. [2025-10-02T20:57:45.762207] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-02T20:57:45.873084] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-04. [2025-10-02T20:57:46.111759] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-02T20:57:46.672987] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-08. [2025-10-02T20:57:46.793024] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-02T20:57:47.473014] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-03. [2025-10-02T20:57:48.273128] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-05. [2025-10-02T20:57:48.350835] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-02T20:57:49.072991] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-08. [2025-10-02T20:57:49.173024] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-02T20:57:49.563459] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-02T20:57:49.568461] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-02T20:57:49.872981] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-04. [2025-10-02T20:57:50.673011] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-06. [2025-10-02T20:57:51.472992] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-09. [2025-10-02T20:57:51.596632] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-02T20:57:51.928557] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-02T20:57:52.063067] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-02T20:57:52.272994] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-10. [2025-10-02T20:57:52.752032] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-02T20:57:52.752989] [INFO ] [REMOTE ] PIM: Full fetch complete (6562 records). [2025-10-02T20:57:52.753114] [DEBUG] [VALIDATOR ] PIM: Validating primary data. [2025-10-02T20:57:53.078456] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-07. [2025-10-02T20:57:53.170850] [DEBUG] [VALIDATOR ] PIM: All expected trading days are present. [2025-10-02T20:57:53.170929] [DEBUG] [VALIDATOR ] PIM: Primary data validation passed. [2025-10-02T20:57:53.171135] [INFO ] [MAIN ] PIM: Fetched primary data is valid. [2025-10-02T20:57:53.171211] [DEBUG] [LOCAL ] PIM: Saving primary data. [2025-10-02T20:57:53.171721] [DEBUG] [LOCAL ] PIM: Trimmed 6562 records to 4816 (keeping 200 days of data) [2025-10-02T20:57:53.202203] [DEBUG] [LOCAL ] PIM: Primary data saved (4816 records). [2025-10-02T20:57:53.202344] [INFO ] [MAIN ] PIM: Full history saved. [2025-10-02T20:57:53.202443] [INFO ] [MAIN ] Update Progress: 1686/2370 symbols completed. PIM took 29.7s. Estimated remaining: 1h 36m 29s. Rate: 7.1 symbols/min [2025-10-02T20:57:53.410803] [INFO ] [MAIN ] PIPR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:57:53.411059] [DEBUG] [LOCAL ] PIPR: No existing data file found in primary storage. [2025-10-02T20:57:53.411120] [WARN ] [MAIN ] PIPR: No existing data found, performing full refresh instead. [2025-10-02T20:57:53.411246] [INFO ] [MAIN ] PIPR: Wiping existing primary data before full refresh. [2025-10-02T20:57:53.411328] [INFO ] [LOCAL ] PIPR: Starting deletion of primary data. [2025-10-02T20:57:53.411457] [DEBUG] [LOCAL ] PIPR: No primary data file found to delete. [2025-10-02T20:57:53.411520] [INFO ] [MAIN ] PIPR: Starting full primary refresh. [2025-10-02T20:57:53.852241] [INFO ] [REMOTE ] PIPR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:57:53.872998] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2024-12. [2025-10-02T20:57:54.240326] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-02T20:57:54.605629] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-02T20:57:54.673021] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-01. [2025-10-02T20:57:55.473014] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-09. [2025-10-02T20:57:55.572183] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-02T20:57:56.273041] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-05. [2025-10-02T20:57:57.073028] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-08. [2025-10-02T20:57:57.480817] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-02T20:57:57.872985] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-10. [2025-10-02T20:57:58.013133] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-02T20:57:58.204778] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-02T20:57:58.673003] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-06. [2025-10-02T20:57:59.219862] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-02T20:57:59.221876] [INFO ] [REMOTE ] PII: Full fetch complete (71202 records). [2025-10-02T20:57:59.221978] [DEBUG] [VALIDATOR ] PII: Validating primary data. [2025-10-02T20:57:59.478262] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-02. [2025-10-02T20:57:59.664303] [DEBUG] [VALIDATOR ] PII: All expected trading days are present. [2025-10-02T20:57:59.664398] [DEBUG] [VALIDATOR ] PII: Primary data validation passed. [2025-10-02T20:57:59.665565] [INFO ] [MAIN ] PII: Fetched primary data is valid. [2025-10-02T20:57:59.665666] [DEBUG] [LOCAL ] PII: Saving primary data. [2025-10-02T20:57:59.667334] [DEBUG] [LOCAL ] PII: Trimmed 71202 records to 49297 (keeping 200 days of data) [2025-10-02T20:57:59.987426] [DEBUG] [LOCAL ] PII: Primary data saved (49297 records). [2025-10-02T20:57:59.987574] [INFO ] [MAIN ] PII: Full history saved. [2025-10-02T20:57:59.987683] [INFO ] [MAIN ] Update Progress: 1687/2370 symbols completed. PII took 46.3s. Estimated remaining: 1h 36m 20s. Rate: 7.1 symbols/min [2025-10-02T20:58:00.167621] [INFO ] [MAIN ] PJT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:58:00.167883] [DEBUG] [LOCAL ] PJT: No existing data file found in primary storage. [2025-10-02T20:58:00.167952] [WARN ] [MAIN ] PJT: No existing data found, performing full refresh instead. [2025-10-02T20:58:00.168069] [INFO ] [MAIN ] PJT: Wiping existing primary data before full refresh. [2025-10-02T20:58:00.168146] [INFO ] [LOCAL ] PJT: Starting deletion of primary data. [2025-10-02T20:58:00.168216] [DEBUG] [LOCAL ] PJT: No primary data file found to delete. [2025-10-02T20:58:00.168262] [INFO ] [MAIN ] PJT: Starting full primary refresh. [2025-10-02T20:58:00.277206] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-09. [2025-10-02T20:58:00.567701] [INFO ] [REMOTE ] PJT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:58:00.568892] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-02T20:58:00.762275] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-02T20:58:01.072961] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-03. [2025-10-02T20:58:01.233455] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-02T20:58:01.872992] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-10. [2025-10-02T20:58:02.242117] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-02T20:58:02.594312] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-02T20:58:02.596744] [INFO ] [REMOTE ] PINE: Full fetch complete (21115 records). [2025-10-02T20:58:02.596823] [DEBUG] [VALIDATOR ] PINE: Validating primary data. [2025-10-02T20:58:02.678161] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-04. [2025-10-02T20:58:02.982016] [DEBUG] [VALIDATOR ] PINE: All expected trading days are present. [2025-10-02T20:58:02.982106] [DEBUG] [VALIDATOR ] PINE: Primary data validation passed. [2025-10-02T20:58:02.982572] [INFO ] [MAIN ] PINE: Fetched primary data is valid. [2025-10-02T20:58:02.982629] [DEBUG] [LOCAL ] PINE: Saving primary data. [2025-10-02T20:58:02.983283] [DEBUG] [LOCAL ] PINE: Trimmed 21115 records to 14200 (keeping 200 days of data) [2025-10-02T20:58:03.077716] [DEBUG] [LOCAL ] PINE: Primary data saved (14200 records). [2025-10-02T20:58:03.077876] [INFO ] [MAIN ] PINE: Full history saved. [2025-10-02T20:58:03.077981] [INFO ] [MAIN ] Update Progress: 1688/2370 symbols completed. PINE took 30.7s. Estimated remaining: 1h 36m 9s. Rate: 7.1 symbols/min [2025-10-02T20:58:03.267877] [INFO ] [MAIN ] PK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:58:03.268086] [DEBUG] [LOCAL ] PK: No existing data file found in primary storage. [2025-10-02T20:58:03.268171] [WARN ] [MAIN ] PK: No existing data found, performing full refresh instead. [2025-10-02T20:58:03.268314] [INFO ] [MAIN ] PK: Wiping existing primary data before full refresh. [2025-10-02T20:58:03.268374] [INFO ] [LOCAL ] PK: Starting deletion of primary data. [2025-10-02T20:58:03.268424] [DEBUG] [LOCAL ] PK: No primary data file found to delete. [2025-10-02T20:58:03.268479] [INFO ] [MAIN ] PK: Starting full primary refresh. [2025-10-02T20:58:03.486754] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-07. [2025-10-02T20:58:03.677780] [INFO ] [REMOTE ] PK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:58:03.852334] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-02T20:58:04.273028] [INFO ] [REMOTE ] PJT: Fetching primary data for 2024-12. [2025-10-02T20:58:05.073023] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-05. [2025-10-02T20:58:05.406994] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-02T20:58:05.777971] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-02T20:58:05.873003] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-01. [2025-10-02T20:58:06.198012] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-02T20:58:06.673010] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-06. [2025-10-02T20:58:06.941459] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-02T20:58:07.473039] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-08. [2025-10-02T20:58:07.722616] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-02T20:58:08.273036] [INFO ] [REMOTE ] PK: Fetching primary data for 2024-12. [2025-10-02T20:58:09.073006] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-07. [2025-10-02T20:58:09.803479] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-10-02T20:58:09.873419] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-09. [2025-10-02T20:58:09.883387] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-02T20:58:10.194894] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-02T20:58:10.673016] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-01. [2025-10-02T20:58:11.473018] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-02. [2025-10-02T20:58:12.028484] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-02T20:58:12.133353] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-02T20:58:12.272983] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-10. [2025-10-02T20:58:12.860463] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-02T20:58:13.073017] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-02. [2025-10-02T20:58:13.872978] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-03. [2025-10-02T20:58:14.048225] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-02T20:58:14.050630] [INFO ] [REMOTE ] PINS: Full fetch complete (77738 records). [2025-10-02T20:58:14.050848] [DEBUG] [VALIDATOR ] PINS: Validating primary data. [2025-10-02T20:58:14.507146] [DEBUG] [VALIDATOR ] PINS: All expected trading days are present. [2025-10-02T20:58:14.507243] [DEBUG] [VALIDATOR ] PINS: Primary data validation passed. [2025-10-02T20:58:14.508374] [INFO ] [MAIN ] PINS: Fetched primary data is valid. [2025-10-02T20:58:14.508453] [DEBUG] [LOCAL ] PINS: Saving primary data. [2025-10-02T20:58:14.510447] [DEBUG] [LOCAL ] PINS: Trimmed 77738 records to 54083 (keeping 200 days of data) [2025-10-02T20:58:14.703859] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-08. [2025-10-02T20:58:14.877500] [DEBUG] [LOCAL ] PINS: Primary data saved (54083 records). [2025-10-02T20:58:14.877736] [INFO ] [MAIN ] PINS: Full history saved. [2025-10-02T20:58:14.877890] [INFO ] [MAIN ] Update Progress: 1689/2370 symbols completed. PINS took 41.6s. Estimated remaining: 1h 36m 2s. Rate: 7.1 symbols/min [2025-10-02T20:58:15.099533] [INFO ] [MAIN ] PKE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:58:15.121140] [DEBUG] [LOCAL ] PKE: No existing data file found in primary storage. [2025-10-02T20:58:15.125075] [WARN ] [MAIN ] PKE: No existing data found, performing full refresh instead. [2025-10-02T20:58:15.125619] [INFO ] [MAIN ] PKE: Wiping existing primary data before full refresh. [2025-10-02T20:58:15.127550] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-02T20:58:15.126061] [INFO ] [LOCAL ] PKE: Starting deletion of primary data. [2025-10-02T20:58:15.127767] [DEBUG] [LOCAL ] PKE: No primary data file found to delete. [2025-10-02T20:58:15.137668] [INFO ] [MAIN ] PKE: Starting full primary refresh. [2025-10-02T20:58:15.461080] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-02T20:58:15.474448] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-03. [2025-10-02T20:58:15.574254] [INFO ] [REMOTE ] PKE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:58:15.781441] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-02T20:58:16.273002] [INFO ] [REMOTE ] PKE: Fetching primary data for 2024-12. [2025-10-02T20:58:16.919767] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-02T20:58:17.072990] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-01. [2025-10-02T20:58:17.311638] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-02T20:58:17.872993] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-04. [2025-10-02T20:58:18.120352] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-02T20:58:18.672999] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-04. [2025-10-02T20:58:19.473070] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-09. [2025-10-02T20:58:19.930192] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-02T20:58:20.138077] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-02T20:58:20.155355] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-02T20:58:20.273059] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-05. [2025-10-02T20:58:21.073003] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-05. [2025-10-02T20:58:21.250975] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-02T20:58:21.873015] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-10. [2025-10-02T20:58:22.550361] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-02T20:58:22.551625] [INFO ] [REMOTE ] PIPR: Full fetch complete (20450 records). [2025-10-02T20:58:22.551851] [DEBUG] [VALIDATOR ] PIPR: Validating primary data. [2025-10-02T20:58:22.674559] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-02. [2025-10-02T20:58:22.986322] [DEBUG] [VALIDATOR ] PIPR: All expected trading days are present. [2025-10-02T20:58:22.986428] [DEBUG] [VALIDATOR ] PIPR: Primary data validation passed. [2025-10-02T20:58:22.986979] [INFO ] [MAIN ] PIPR: Fetched primary data is valid. [2025-10-02T20:58:22.987229] [DEBUG] [LOCAL ] PIPR: Saving primary data. [2025-10-02T20:58:23.018083] [DEBUG] [LOCAL ] PIPR: Trimmed 20450 records to 14894 (keeping 200 days of data) [2025-10-02T20:58:23.020322] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-02T20:58:23.140122] [DEBUG] [LOCAL ] PIPR: Primary data saved (14894 records). [2025-10-02T20:58:23.140275] [INFO ] [MAIN ] PIPR: Full history saved. [2025-10-02T20:58:23.140353] [INFO ] [MAIN ] Update Progress: 1690/2370 symbols completed. PIPR took 29.9s. Estimated remaining: 1h 35m 54s. Rate: 7.1 symbols/min [2025-10-02T20:58:23.319177] [INFO ] [MAIN ] PKG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:58:23.319343] [DEBUG] [LOCAL ] PKG: No existing data file found in primary storage. [2025-10-02T20:58:23.319380] [WARN ] [MAIN ] PKG: No existing data found, performing full refresh instead. [2025-10-02T20:58:23.319490] [INFO ] [MAIN ] PKG: Wiping existing primary data before full refresh. [2025-10-02T20:58:23.319533] [INFO ] [LOCAL ] PKG: Starting deletion of primary data. [2025-10-02T20:58:23.319574] [DEBUG] [LOCAL ] PKG: No primary data file found to delete. [2025-10-02T20:58:23.319606] [INFO ] [MAIN ] PKG: Starting full primary refresh. [2025-10-02T20:58:23.478675] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-06. [2025-10-02T20:58:23.752026] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-02T20:58:23.756488] [INFO ] [REMOTE ] PKG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:58:24.273002] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-03. [2025-10-02T20:58:24.755199] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-02T20:58:24.972408] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-02T20:58:25.072938] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-06. [2025-10-02T20:58:25.873022] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-04. [2025-10-02T20:58:26.468979] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-02T20:58:26.529757] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-02T20:58:26.673019] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-07. [2025-10-02T20:58:27.473022] [INFO ] [REMOTE ] PKG: Fetching primary data for 2024-12. [2025-10-02T20:58:28.245261] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-02T20:58:28.273033] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-05. [2025-10-02T20:58:28.587751] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-02T20:58:29.073000] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-08. [2025-10-02T20:58:29.307373] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-02T20:58:29.873030] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-07. [2025-10-02T20:58:30.593681] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-02T20:58:30.673019] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-09. [2025-10-02T20:58:30.931966] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-02T20:58:31.473037] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-01. [2025-10-02T20:58:32.272976] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-08. [2025-10-02T20:58:32.575766] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-02T20:58:32.868445] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-02T20:58:33.073039] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-10. [2025-10-02T20:58:33.352126] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-02T20:58:33.873050] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-06. [2025-10-02T20:58:34.511327] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-02T20:58:34.513478] [INFO ] [REMOTE ] PK: Full fetch complete (76376 records). [2025-10-02T20:58:34.513613] [DEBUG] [VALIDATOR ] PK: Validating primary data. [2025-10-02T20:58:34.676561] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-02. [2025-10-02T20:58:34.858020] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-02T20:58:34.964016] [DEBUG] [VALIDATOR ] PK: All expected trading days are present. [2025-10-02T20:58:34.964115] [DEBUG] [VALIDATOR ] PK: Primary data validation passed. [2025-10-02T20:58:34.965172] [INFO ] [MAIN ] PK: Fetched primary data is valid. [2025-10-02T20:58:34.965240] [DEBUG] [LOCAL ] PK: Saving primary data. [2025-10-02T20:58:34.966850] [DEBUG] [LOCAL ] PK: Trimmed 76376 records to 53206 (keeping 200 days of data) [2025-10-02T20:58:35.345243] [DEBUG] [LOCAL ] PK: Primary data saved (53206 records). [2025-10-02T20:58:35.345405] [INFO ] [MAIN ] PK: Full history saved. [2025-10-02T20:58:35.345495] [INFO ] [MAIN ] Update Progress: 1691/2370 symbols completed. PK took 32.3s. Estimated remaining: 1h 35m 47s. Rate: 7.1 symbols/min [2025-10-02T20:58:35.478188] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-09. [2025-10-02T20:58:35.539923] [INFO ] [MAIN ] PKST: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:58:35.540674] [DEBUG] [LOCAL ] PKST: No existing data file found in primary storage. [2025-10-02T20:58:35.540737] [WARN ] [MAIN ] PKST: No existing data found, performing full refresh instead. [2025-10-02T20:58:35.540849] [INFO ] [MAIN ] PKST: Wiping existing primary data before full refresh. [2025-10-02T20:58:35.540894] [INFO ] [LOCAL ] PKST: Starting deletion of primary data. [2025-10-02T20:58:35.540940] [DEBUG] [LOCAL ] PKST: No primary data file found to delete. [2025-10-02T20:58:35.540974] [INFO ] [MAIN ] PKST: Starting full primary refresh. [2025-10-02T20:58:35.929794] [INFO ] [REMOTE ] PKST: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:58:36.272998] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-07. [2025-10-02T20:58:36.464508] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-02T20:58:36.602428] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-02T20:58:37.073062] [INFO ] [REMOTE ] PKST: Fetching primary data for 2024-12. [2025-10-02T20:58:37.541927] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-02T20:58:37.873051] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-03. [2025-10-02T20:58:38.218441] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-02T20:58:38.673082] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-08. [2025-10-02T20:58:39.083801] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-02T20:58:39.473006] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-10. [2025-10-02T20:58:39.762050] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-02T20:58:40.236470] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-02T20:58:40.237694] [INFO ] [REMOTE ] PJT: Full fetch complete (31894 records). [2025-10-02T20:58:40.237772] [DEBUG] [VALIDATOR ] PJT: Validating primary data. [2025-10-02T20:58:40.278137] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-01. [2025-10-02T20:58:40.670178] [DEBUG] [VALIDATOR ] PJT: All expected trading days are present. [2025-10-02T20:58:40.670317] [DEBUG] [VALIDATOR ] PJT: Primary data validation passed. [2025-10-02T20:58:40.671096] [INFO ] [MAIN ] PJT: Fetched primary data is valid. [2025-10-02T20:58:40.671161] [DEBUG] [LOCAL ] PJT: Saving primary data. [2025-10-02T20:58:40.672123] [DEBUG] [LOCAL ] PJT: Trimmed 31894 records to 21733 (keeping 200 days of data) [2025-10-02T20:58:40.818981] [DEBUG] [LOCAL ] PJT: Primary data saved (21733 records). [2025-10-02T20:58:40.819111] [INFO ] [MAIN ] PJT: Full history saved. [2025-10-02T20:58:40.819185] [INFO ] [MAIN ] Update Progress: 1692/2370 symbols completed. PJT took 40.8s. Estimated remaining: 1h 35m 37s. Rate: 7.1 symbols/min [2025-10-02T20:58:41.001232] [INFO ] [MAIN ] PKX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:58:41.001464] [DEBUG] [LOCAL ] PKX: No existing data file found in primary storage. [2025-10-02T20:58:41.001521] [WARN ] [MAIN ] PKX: No existing data found, performing full refresh instead. [2025-10-02T20:58:41.001697] [INFO ] [MAIN ] PKX: Wiping existing primary data before full refresh. [2025-10-02T20:58:41.001773] [INFO ] [LOCAL ] PKX: Starting deletion of primary data. [2025-10-02T20:58:41.001844] [DEBUG] [LOCAL ] PKX: No primary data file found to delete. [2025-10-02T20:58:41.001883] [INFO ] [MAIN ] PKX: Starting full primary refresh. [2025-10-02T20:58:41.076924] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-04. [2025-10-02T20:58:41.398148] [INFO ] [REMOTE ] PKX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:58:41.445275] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-02T20:58:41.873016] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-02. [2025-10-02T20:58:42.457575] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-02T20:58:42.673001] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-09. [2025-10-02T20:58:43.075739] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-02T20:58:43.472975] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-03. [2025-10-02T20:58:43.714787] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-02T20:58:44.273030] [INFO ] [REMOTE ] PKX: Fetching primary data for 2024-12. [2025-10-02T20:58:44.702255] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-02T20:58:45.073006] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-05. [2025-10-02T20:58:45.568555] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-02T20:58:45.872964] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-04. [2025-10-02T20:58:46.652582] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-02T20:58:46.672968] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-06. [2025-10-02T20:58:47.117429] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-02T20:58:47.473012] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-10. [2025-10-02T20:58:48.148339] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-02T20:58:48.215374] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-02T20:58:48.216462] [INFO ] [REMOTE ] PKE: Full fetch complete (17274 records). [2025-10-02T20:58:48.216544] [DEBUG] [VALIDATOR ] PKE: Validating primary data. [2025-10-02T20:58:48.278151] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-01. [2025-10-02T20:58:48.633240] [DEBUG] [VALIDATOR ] PKE: All expected trading days are present. [2025-10-02T20:58:48.633341] [DEBUG] [VALIDATOR ] PKE: Primary data validation passed. [2025-10-02T20:58:48.633836] [INFO ] [MAIN ] PKE: Fetched primary data is valid. [2025-10-02T20:58:48.633903] [DEBUG] [LOCAL ] PKE: Saving primary data. [2025-10-02T20:58:48.634533] [DEBUG] [LOCAL ] PKE: Trimmed 17274 records to 13081 (keeping 200 days of data) [2025-10-02T20:58:48.721770] [DEBUG] [LOCAL ] PKE: Primary data saved (13081 records). [2025-10-02T20:58:48.721935] [INFO ] [MAIN ] PKE: Full history saved. [2025-10-02T20:58:48.722024] [INFO ] [MAIN ] Update Progress: 1693/2370 symbols completed. PKE took 33.8s. Estimated remaining: 1h 35m 28s. Rate: 7.1 symbols/min [2025-10-02T20:58:48.918907] [INFO ] [MAIN ] PL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:58:48.919152] [DEBUG] [LOCAL ] PL: No existing data file found in primary storage. [2025-10-02T20:58:48.919205] [WARN ] [MAIN ] PL: No existing data found, performing full refresh instead. [2025-10-02T20:58:48.919323] [INFO ] [MAIN ] PL: Wiping existing primary data before full refresh. [2025-10-02T20:58:48.919367] [INFO ] [LOCAL ] PL: Starting deletion of primary data. [2025-10-02T20:58:48.919409] [DEBUG] [LOCAL ] PL: No primary data file found to delete. [2025-10-02T20:58:48.919442] [INFO ] [MAIN ] PL: Starting full primary refresh. [2025-10-02T20:58:49.080769] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-07. [2025-10-02T20:58:49.315392] [INFO ] [REMOTE ] PL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:58:49.592223] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-02T20:58:49.872998] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-05. [2025-10-02T20:58:50.506682] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-02T20:58:50.675751] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-02. [2025-10-02T20:58:50.679445] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-02T20:58:51.473041] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-08. [2025-10-02T20:58:52.125916] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-02T20:58:52.273024] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-03. [2025-10-02T20:58:52.765366] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-02T20:58:53.072991] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-06. [2025-10-02T20:58:53.865526] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-02T20:58:53.873506] [INFO ] [REMOTE ] PL: Fetching primary data for 2024-12. [2025-10-02T20:58:54.287329] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-02T20:58:54.673018] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-04. [2025-10-02T20:58:55.472979] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-07. [2025-10-02T20:58:55.965533] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-02T20:58:56.144882] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-02T20:58:56.272974] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-05. [2025-10-02T20:58:56.521621] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-02T20:58:57.073033] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-01. [2025-10-02T20:58:57.711090] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-02T20:58:57.873005] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-08. [2025-10-02T20:58:58.673012] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-06. [2025-10-02T20:58:58.979175] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-02T20:58:59.127790] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-02T20:58:59.472989] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-09. [2025-10-02T20:58:59.861537] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-02T20:59:00.273031] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-09. [2025-10-02T20:59:00.592129] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-02T20:59:01.073040] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-02. [2025-10-02T20:59:01.574854] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-02T20:59:01.873037] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-10. [2025-10-02T20:59:02.664341] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-02T20:59:02.665615] [INFO ] [REMOTE ] PKST: Full fetch complete (29613 records). [2025-10-02T20:59:02.665752] [DEBUG] [VALIDATOR ] PKST: Validating primary data. [2025-10-02T20:59:02.678288] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-10. [2025-10-02T20:59:03.074242] [DEBUG] [VALIDATOR ] PKST: All expected trading days are present. [2025-10-02T20:59:03.074326] [DEBUG] [VALIDATOR ] PKST: Primary data validation passed. [2025-10-02T20:59:03.074972] [INFO ] [MAIN ] PKST: Fetched primary data is valid. [2025-10-02T20:59:03.075036] [DEBUG] [LOCAL ] PKST: Saving primary data. [2025-10-02T20:59:03.075821] [DEBUG] [LOCAL ] PKST: Trimmed 29613 records to 18921 (keeping 200 days of data) [2025-10-02T20:59:03.198935] [DEBUG] [LOCAL ] PKST: Primary data saved (18921 records). [2025-10-02T20:59:03.199083] [INFO ] [MAIN ] PKST: Full history saved. [2025-10-02T20:59:03.199160] [INFO ] [MAIN ] Update Progress: 1694/2370 symbols completed. PKST took 27.9s. Estimated remaining: 1h 35m 22s. Rate: 7.1 symbols/min [2025-10-02T20:59:03.385752] [INFO ] [MAIN ] PLD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:59:03.386078] [DEBUG] [LOCAL ] PLD: No existing data file found in primary storage. [2025-10-02T20:59:03.386219] [WARN ] [MAIN ] PLD: No existing data found, performing full refresh instead. [2025-10-02T20:59:03.386381] [INFO ] [MAIN ] PLD: Wiping existing primary data before full refresh. [2025-10-02T20:59:03.386475] [INFO ] [LOCAL ] PLD: Starting deletion of primary data. [2025-10-02T20:59:03.386593] [DEBUG] [LOCAL ] PLD: No primary data file found to delete. [2025-10-02T20:59:03.386775] [INFO ] [MAIN ] PLD: Starting full primary refresh. [2025-10-02T20:59:03.478145] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-07. [2025-10-02T20:59:03.736901] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-02 (2.66 seconds). [2025-10-02T20:59:03.835474] [INFO ] [REMOTE ] PLD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:59:03.945703] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-02T20:59:03.947797] [INFO ] [REMOTE ] PKG: Full fetch complete (57776 records). [2025-10-02T20:59:03.948032] [DEBUG] [VALIDATOR ] PKG: Validating primary data. [2025-10-02T20:59:04.273787] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-03. [2025-10-02T20:59:04.374720] [DEBUG] [VALIDATOR ] PKG: All expected trading days are present. [2025-10-02T20:59:04.374825] [DEBUG] [VALIDATOR ] PKG: Primary data validation passed. [2025-10-02T20:59:04.375910] [INFO ] [MAIN ] PKG: Fetched primary data is valid. [2025-10-02T20:59:04.375985] [DEBUG] [LOCAL ] PKG: Saving primary data. [2025-10-02T20:59:04.377320] [DEBUG] [LOCAL ] PKG: Trimmed 57776 records to 39238 (keeping 200 days of data) [2025-10-02T20:59:04.643130] [DEBUG] [LOCAL ] PKG: Primary data saved (39238 records). [2025-10-02T20:59:04.643274] [INFO ] [MAIN ] PKG: Full history saved. [2025-10-02T20:59:04.643352] [INFO ] [MAIN ] Update Progress: 1695/2370 symbols completed. PKG took 41.5s. Estimated remaining: 1h 35m 11s. Rate: 7.1 symbols/min [2025-10-02T20:59:04.845856] [INFO ] [MAIN ] PLNT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:59:04.846170] [DEBUG] [LOCAL ] PLNT: No existing data file found in primary storage. [2025-10-02T20:59:04.846288] [WARN ] [MAIN ] PLNT: No existing data found, performing full refresh instead. [2025-10-02T20:59:04.846466] [INFO ] [MAIN ] PLNT: Wiping existing primary data before full refresh. [2025-10-02T20:59:04.846569] [INFO ] [LOCAL ] PLNT: Starting deletion of primary data. [2025-10-02T20:59:04.846753] [DEBUG] [LOCAL ] PLNT: No primary data file found to delete. [2025-10-02T20:59:04.846916] [INFO ] [MAIN ] PLNT: Starting full primary refresh. [2025-10-02T20:59:05.081514] [INFO ] [REMOTE ] PLD: Fetching primary data for 2024-12. [2025-10-02T20:59:05.131584] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-02T20:59:05.282418] [INFO ] [REMOTE ] PLNT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:59:05.872975] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-08. [2025-10-02T20:59:06.344019] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-02T20:59:06.672971] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2024-12. [2025-10-02T20:59:06.981882] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-02T20:59:07.190212] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-02T20:59:07.473028] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-04. [2025-10-02T20:59:08.273041] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-09. [2025-10-02T20:59:08.319504] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-02T20:59:09.072979] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-01. [2025-10-02T20:59:09.316727] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-02T20:59:09.463078] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-02T20:59:09.873014] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-05. [2025-10-02T20:59:10.672975] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-10. [2025-10-02T20:59:10.924461] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-02T20:59:11.473009] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-02. [2025-10-02T20:59:11.815315] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-02T20:59:11.812932] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-02T20:59:11.832917] [INFO ] [REMOTE ] PKX: Full fetch complete (36907 records). [2025-10-02T20:59:11.833062] [DEBUG] [VALIDATOR ] PKX: Validating primary data. [2025-10-02T20:59:12.249709] [DEBUG] [VALIDATOR ] PKX: All expected trading days are present. [2025-10-02T20:59:12.249858] [DEBUG] [VALIDATOR ] PKX: Primary data validation passed. [2025-10-02T20:59:12.250606] [INFO ] [MAIN ] PKX: Fetched primary data is valid. [2025-10-02T20:59:12.250673] [DEBUG] [LOCAL ] PKX: Saving primary data. [2025-10-02T20:59:12.251518] [DEBUG] [LOCAL ] PKX: Trimmed 36907 records to 24461 (keeping 200 days of data) [2025-10-02T20:59:12.304912] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-01. [2025-10-02T20:59:12.413152] [DEBUG] [LOCAL ] PKX: Primary data saved (24461 records). [2025-10-02T20:59:12.413339] [INFO ] [MAIN ] PKX: Full history saved. [2025-10-02T20:59:12.413426] [INFO ] [MAIN ] Update Progress: 1696/2370 symbols completed. PKX took 31.6s. Estimated remaining: 1h 35m 2s. Rate: 7.1 symbols/min [2025-10-02T20:59:12.589510] [INFO ] [MAIN ] PLOW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:59:12.589726] [DEBUG] [LOCAL ] PLOW: No existing data file found in primary storage. [2025-10-02T20:59:12.589776] [WARN ] [MAIN ] PLOW: No existing data found, performing full refresh instead. [2025-10-02T20:59:12.589892] [INFO ] [MAIN ] PLOW: Wiping existing primary data before full refresh. [2025-10-02T20:59:12.589934] [INFO ] [LOCAL ] PLOW: Starting deletion of primary data. [2025-10-02T20:59:12.589974] [DEBUG] [LOCAL ] PLOW: No primary data file found to delete. [2025-10-02T20:59:12.590019] [INFO ] [MAIN ] PLOW: Starting full primary refresh. [2025-10-02T20:59:12.970041] [INFO ] [REMOTE ] PLOW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:59:13.073026] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-06. [2025-10-02T20:59:13.245956] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-02T20:59:13.872993] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2024-12. [2025-10-02T20:59:14.247863] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-02T20:59:14.672992] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-02. [2025-10-02T20:59:14.889208] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-02T20:59:14.952700] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-02T20:59:15.472993] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-07. [2025-10-02T20:59:16.281545] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-01. [2025-10-02T20:59:16.287055] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-02T20:59:17.072997] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-03. [2025-10-02T20:59:17.277111] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-02T20:59:17.788700] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-02T20:59:17.872994] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-08. [2025-10-02T20:59:18.673041] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-02. [2025-10-02T20:59:18.934807] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-02T20:59:19.472985] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-04. [2025-10-02T20:59:19.841923] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-02T20:59:20.168738] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-10-02T20:59:20.273040] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-09. [2025-10-02T20:59:21.072961] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-03. [2025-10-02T20:59:21.194181] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-02T20:59:21.872969] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-05. [2025-10-02T20:59:22.182225] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-02T20:59:22.308576] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-02T20:59:22.673043] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-10. [2025-10-02T20:59:23.473007] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-04. [2025-10-02T20:59:23.609864] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-02T20:59:24.272987] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-03. [2025-10-02T20:59:24.593431] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-02T20:59:24.595677] [INFO ] [REMOTE ] PL: Full fetch complete (76961 records). [2025-10-02T20:59:24.595831] [DEBUG] [VALIDATOR ] PL: Validating primary data. [2025-10-02T20:59:25.004042] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-02T20:59:25.069294] [DEBUG] [VALIDATOR ] PL: All expected trading days are present. [2025-10-02T20:59:25.069389] [DEBUG] [VALIDATOR ] PL: Primary data validation passed. [2025-10-02T20:59:25.070552] [INFO ] [MAIN ] PL: Fetched primary data is valid. [2025-10-02T20:59:25.070621] [DEBUG] [LOCAL ] PL: Saving primary data. [2025-10-02T20:59:25.072303] [DEBUG] [LOCAL ] PL: Trimmed 76961 records to 53521 (keeping 200 days of data) [2025-10-02T20:59:25.073022] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-05. [2025-10-02T20:59:25.401856] [DEBUG] [LOCAL ] PL: Primary data saved (53521 records). [2025-10-02T20:59:25.402015] [INFO ] [MAIN ] PL: Full history saved. [2025-10-02T20:59:25.402094] [INFO ] [MAIN ] Update Progress: 1697/2370 symbols completed. PL took 36.7s. Estimated remaining: 1h 34m 56s. Rate: 7.1 symbols/min [2025-10-02T20:59:25.585618] [INFO ] [MAIN ] PLYM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:59:25.585818] [DEBUG] [LOCAL ] PLYM: No existing data file found in primary storage. [2025-10-02T20:59:25.585863] [WARN ] [MAIN ] PLYM: No existing data found, performing full refresh instead. [2025-10-02T20:59:25.585977] [INFO ] [MAIN ] PLYM: Wiping existing primary data before full refresh. [2025-10-02T20:59:25.586022] [INFO ] [LOCAL ] PLYM: Starting deletion of primary data. [2025-10-02T20:59:25.586066] [DEBUG] [LOCAL ] PLYM: No primary data file found to delete. [2025-10-02T20:59:25.586101] [INFO ] [MAIN ] PLYM: Starting full primary refresh. [2025-10-02T20:59:25.884727] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-06. [2025-10-02T20:59:25.987242] [INFO ] [REMOTE ] PLYM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:59:26.053708] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-02T20:59:26.333522] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-02T20:59:26.673012] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2024-12. [2025-10-02T20:59:27.472983] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-06. [2025-10-02T20:59:27.634904] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-02T20:59:28.090597] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-02T20:59:28.272982] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-04. [2025-10-02T20:59:28.396094] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-02T20:59:29.073050] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-07. [2025-10-02T20:59:29.873045] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-01. [2025-10-02T20:59:30.046442] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-02T20:59:30.211370] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-02T20:59:30.673058] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-05. [2025-10-02T20:59:31.280001] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-02T20:59:31.473020] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-02. [2025-10-02T20:59:32.272977] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-07. [2025-10-02T20:59:32.423970] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-02T20:59:32.460526] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-02T20:59:33.073008] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-03. [2025-10-02T20:59:33.534239] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-02T20:59:33.873000] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-06. [2025-10-02T20:59:34.255096] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-02T20:59:34.673003] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-08. [2025-10-02T20:59:35.472975] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-08. [2025-10-02T20:59:35.602540] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-02T20:59:35.913911] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-02T20:59:36.273008] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-09. [2025-10-02T20:59:36.682167] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-02T20:59:37.072971] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-07. [2025-10-02T20:59:37.303861] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-02T20:59:37.872999] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-10. [2025-10-02T20:59:38.556789] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-02T20:59:38.557948] [INFO ] [REMOTE ] PLOW: Full fetch complete (28702 records). [2025-10-02T20:59:38.558035] [DEBUG] [VALIDATOR ] PLOW: Validating primary data. [2025-10-02T20:59:38.673187] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-09. [2025-10-02T20:59:38.973931] [DEBUG] [VALIDATOR ] PLOW: All expected trading days are present. [2025-10-02T20:59:38.974114] [DEBUG] [VALIDATOR ] PLOW: Primary data validation passed. [2025-10-02T20:59:38.974877] [INFO ] [MAIN ] PLOW: Fetched primary data is valid. [2025-10-02T20:59:38.974981] [DEBUG] [LOCAL ] PLOW: Saving primary data. [2025-10-02T20:59:38.976271] [DEBUG] [LOCAL ] PLOW: Trimmed 28702 records to 20445 (keeping 200 days of data) [2025-10-02T20:59:39.108467] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-02T20:59:39.159059] [DEBUG] [LOCAL ] PLOW: Primary data saved (20445 records). [2025-10-02T20:59:39.159190] [INFO ] [MAIN ] PLOW: Full history saved. [2025-10-02T20:59:39.159260] [INFO ] [MAIN ] Update Progress: 1698/2370 symbols completed. PLOW took 26.7s. Estimated remaining: 1h 34m 49s. Rate: 7.1 symbols/min [2025-10-02T20:59:39.338677] [INFO ] [MAIN ] PM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:59:39.338849] [DEBUG] [LOCAL ] PM: No existing data file found in primary storage. [2025-10-02T20:59:39.338891] [WARN ] [MAIN ] PM: No existing data found, performing full refresh instead. [2025-10-02T20:59:39.339033] [INFO ] [MAIN ] PM: Wiping existing primary data before full refresh. [2025-10-02T20:59:39.339078] [INFO ] [LOCAL ] PM: Starting deletion of primary data. [2025-10-02T20:59:39.339123] [DEBUG] [LOCAL ] PM: No primary data file found to delete. [2025-10-02T20:59:39.339159] [INFO ] [MAIN ] PM: Starting full primary refresh. [2025-10-02T20:59:39.484726] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-04. [2025-10-02T20:59:39.720537] [INFO ] [REMOTE ] PM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:59:40.158486] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-02T20:59:40.272990] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-10. [2025-10-02T20:59:40.972089] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-02T20:59:41.028694] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-02T20:59:41.033602] [INFO ] [REMOTE ] PLNT: Full fetch complete (70321 records). [2025-10-02T20:59:41.033784] [DEBUG] [VALIDATOR ] PLNT: Validating primary data. [2025-10-02T20:59:41.078141] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-05. [2025-10-02T20:59:41.488275] [DEBUG] [VALIDATOR ] PLNT: All expected trading days are present. [2025-10-02T20:59:41.488383] [DEBUG] [VALIDATOR ] PLNT: Primary data validation passed. [2025-10-02T20:59:41.489460] [INFO ] [MAIN ] PLNT: Fetched primary data is valid. [2025-10-02T20:59:41.489526] [DEBUG] [LOCAL ] PLNT: Saving primary data. [2025-10-02T20:59:41.490989] [DEBUG] [LOCAL ] PLNT: Trimmed 70321 records to 48596 (keeping 200 days of data) [2025-10-02T20:59:41.804031] [DEBUG] [LOCAL ] PLNT: Primary data saved (48596 records). [2025-10-02T20:59:41.804200] [INFO ] [MAIN ] PLNT: Full history saved. [2025-10-02T20:59:41.804280] [INFO ] [MAIN ] Update Progress: 1699/2370 symbols completed. PLNT took 37.2s. Estimated remaining: 1h 34m 38s. Rate: 7.1 symbols/min [2025-10-02T20:59:41.878158] [INFO ] [REMOTE ] PM: Fetching primary data for 2024-12. [2025-10-02T20:59:42.001069] [INFO ] [MAIN ] PML: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:59:42.001268] [DEBUG] [LOCAL ] PML: No existing data file found in primary storage. [2025-10-02T20:59:42.001332] [WARN ] [MAIN ] PML: No existing data found, performing full refresh instead. [2025-10-02T20:59:42.001475] [INFO ] [MAIN ] PML: Wiping existing primary data before full refresh. [2025-10-02T20:59:42.001527] [INFO ] [LOCAL ] PML: Starting deletion of primary data. [2025-10-02T20:59:42.001575] [DEBUG] [LOCAL ] PML: No primary data file found to delete. [2025-10-02T20:59:42.001610] [INFO ] [MAIN ] PML: Starting full primary refresh. [2025-10-02T20:59:42.398451] [INFO ] [REMOTE ] PML: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:59:42.563183] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-02T20:59:42.673026] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-06. [2025-10-02T20:59:43.472969] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-08. [2025-10-02T20:59:44.064777] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-02T20:59:44.133285] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-10-02T20:59:44.272997] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-07. [2025-10-02T20:59:45.072972] [INFO ] [REMOTE ] PML: Fetching primary data for 2024-12. [2025-10-02T20:59:45.234688] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-02T20:59:45.872977] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-09. [2025-10-02T20:59:45.936638] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-02T20:59:46.198222] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-02T20:59:46.673049] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-01. [2025-10-02T20:59:47.473012] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-01. [2025-10-02T20:59:47.974867] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-02T20:59:48.273020] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-08. [2025-10-02T20:59:48.537593] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-02T20:59:48.707770] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-02T20:59:49.073031] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-02. [2025-10-02T20:59:49.558399] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-02T20:59:49.873031] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-02. [2025-10-02T20:59:50.156932] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-02T20:59:50.673051] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-09. [2025-10-02T20:59:51.473045] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-03. [2025-10-02T20:59:51.908225] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-02T20:59:52.137491] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-02T20:59:52.273004] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-10. [2025-10-02T20:59:52.409817] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-02T20:59:53.073051] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-03. [2025-10-02T20:59:53.844696] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-02T20:59:53.847051] [INFO ] [REMOTE ] PLD: Full fetch complete (77381 records). [2025-10-02T20:59:53.847374] [DEBUG] [VALIDATOR ] PLD: Validating primary data. [2025-10-02T20:59:53.884300] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-10. [2025-10-02T20:59:54.292547] [DEBUG] [VALIDATOR ] PLD: All expected trading days are present. [2025-10-02T20:59:54.292637] [DEBUG] [VALIDATOR ] PLD: Primary data validation passed. [2025-10-02T20:59:54.293908] [INFO ] [MAIN ] PLD: Fetched primary data is valid. [2025-10-02T20:59:54.293976] [DEBUG] [LOCAL ] PLD: Saving primary data. [2025-10-02T20:59:54.295674] [DEBUG] [LOCAL ] PLD: Trimmed 77381 records to 53823 (keeping 200 days of data) [2025-10-02T20:59:54.673033] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-04. [2025-10-02T20:59:54.680524] [DEBUG] [LOCAL ] PLD: Primary data saved (53823 records). [2025-10-02T20:59:54.680746] [INFO ] [MAIN ] PLD: Full history saved. [2025-10-02T20:59:54.680869] [INFO ] [MAIN ] Update Progress: 1700/2370 symbols completed. PLD took 51.5s. Estimated remaining: 1h 34m 32s. Rate: 7.1 symbols/min [2025-10-02T20:59:54.905551] [INFO ] [MAIN ] PMM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:59:54.905765] [DEBUG] [LOCAL ] PMM: No existing data file found in primary storage. [2025-10-02T20:59:54.905822] [WARN ] [MAIN ] PMM: No existing data found, performing full refresh instead. [2025-10-02T20:59:54.905937] [INFO ] [MAIN ] PMM: Wiping existing primary data before full refresh. [2025-10-02T20:59:54.905980] [INFO ] [LOCAL ] PMM: Starting deletion of primary data. [2025-10-02T20:59:54.906022] [DEBUG] [LOCAL ] PMM: No primary data file found to delete. [2025-10-02T20:59:54.906057] [INFO ] [MAIN ] PMM: Starting full primary refresh. [2025-10-02T20:59:55.151685] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-02T20:59:55.193716] [INFO ] [REMOTE ] PLYM: Full fetch complete (46986 records). [2025-10-02T20:59:55.222070] [DEBUG] [VALIDATOR ] PLYM: Validating primary data. [2025-10-02T20:59:55.408024] [INFO ] [REMOTE ] PMM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:59:55.477687] [INFO ] [REMOTE ] PMM: Fetching primary data for 2024-12. [2025-10-02T20:59:55.704514] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-02T20:59:55.719886] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-03 (2.65 seconds). [2025-10-02T20:59:55.847629] [DEBUG] [VALIDATOR ] PLYM: All expected trading days are present. [2025-10-02T20:59:55.847746] [DEBUG] [VALIDATOR ] PLYM: Primary data validation passed. [2025-10-02T20:59:55.848717] [INFO ] [MAIN ] PLYM: Fetched primary data is valid. [2025-10-02T20:59:55.848781] [DEBUG] [LOCAL ] PLYM: Saving primary data. [2025-10-02T20:59:55.849934] [DEBUG] [LOCAL ] PLYM: Trimmed 46986 records to 33746 (keeping 200 days of data) [2025-10-02T20:59:56.078227] [DEBUG] [LOCAL ] PLYM: Primary data saved (33746 records). [2025-10-02T20:59:56.078372] [INFO ] [MAIN ] PLYM: Full history saved. [2025-10-02T20:59:56.078462] [INFO ] [MAIN ] Update Progress: 1701/2370 symbols completed. PLYM took 30.7s. Estimated remaining: 1h 34m 20s. Rate: 7.1 symbols/min [2025-10-02T20:59:56.257759] [INFO ] [MAIN ] PMO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T20:59:56.257925] [DEBUG] [LOCAL ] PMO: No existing data file found in primary storage. [2025-10-02T20:59:56.257966] [WARN ] [MAIN ] PMO: No existing data found, performing full refresh instead. [2025-10-02T20:59:56.258079] [INFO ] [MAIN ] PMO: Wiping existing primary data before full refresh. [2025-10-02T20:59:56.258148] [INFO ] [LOCAL ] PMO: Starting deletion of primary data. [2025-10-02T20:59:56.258204] [DEBUG] [LOCAL ] PMO: No primary data file found to delete. [2025-10-02T20:59:56.258238] [INFO ] [MAIN ] PMO: Starting full primary refresh. [2025-10-02T20:59:56.279810] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-04. [2025-10-02T20:59:56.609932] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-02T20:59:56.670160] [INFO ] [REMOTE ] PMO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T20:59:57.073041] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-01. [2025-10-02T20:59:57.872980] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-05. [2025-10-02T20:59:58.256592] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-02T20:59:58.619597] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-02T20:59:58.645577] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-02T20:59:58.672968] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-05. [2025-10-02T20:59:59.473021] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-06. [2025-10-02T21:00:00.272973] [INFO ] [REMOTE ] PMO: Fetching primary data for 2024-12. [2025-10-02T21:00:00.319710] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-02T21:00:00.988405] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-10-02T21:00:01.073061] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-06. [2025-10-02T21:00:01.096952] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-02T21:00:01.873001] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-01. [2025-10-02T21:00:02.673062] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-07. [2025-10-02T21:00:02.819924] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-02T21:00:03.196612] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-02T21:00:03.473008] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-07. [2025-10-02T21:00:03.970618] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-02T21:00:04.273017] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-02. [2025-10-02T21:00:05.073041] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-08. [2025-10-02T21:00:05.376875] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-02T21:00:05.873002] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-03. [2025-10-02T21:00:05.923979] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-10-02T21:00:06.471593] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-02T21:00:06.672996] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-08. [2025-10-02T21:00:06.957270] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-02T21:00:07.473015] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-09. [2025-10-02T21:00:08.273010] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-04. [2025-10-02T21:00:08.561399] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-02T21:00:08.744272] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-02T21:00:09.072980] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-10. [2025-10-02T21:00:09.138630] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-02T21:00:09.872994] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-05. [2025-10-02T21:00:10.173557] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-02T21:00:10.175254] [INFO ] [REMOTE ] PML: Full fetch complete (29822 records). [2025-10-02T21:00:10.175457] [DEBUG] [VALIDATOR ] PML: Validating primary data. [2025-10-02T21:00:10.588727] [DEBUG] [VALIDATOR ] PML: All expected trading days are present. [2025-10-02T21:00:10.588816] [DEBUG] [VALIDATOR ] PML: Primary data validation passed. [2025-10-02T21:00:10.589867] [INFO ] [MAIN ] PML: Fetched primary data is valid. [2025-10-02T21:00:10.589976] [DEBUG] [LOCAL ] PML: Saving primary data. [2025-10-02T21:00:10.592866] [DEBUG] [LOCAL ] PML: Trimmed 29822 records to 21357 (keeping 200 days of data) [2025-10-02T21:00:10.679578] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-09. [2025-10-02T21:00:10.729693] [DEBUG] [LOCAL ] PML: Primary data saved (21357 records). [2025-10-02T21:00:10.729824] [INFO ] [MAIN ] PML: Full history saved. [2025-10-02T21:00:10.729925] [INFO ] [MAIN ] Update Progress: 1702/2370 symbols completed. PML took 28.9s. Estimated remaining: 1h 34m 14s. Rate: 7.1 symbols/min [2025-10-02T21:00:10.854916] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-02T21:00:10.934628] [INFO ] [MAIN ] PMT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:00:10.934815] [DEBUG] [LOCAL ] PMT: No existing data file found in primary storage. [2025-10-02T21:00:10.934856] [WARN ] [MAIN ] PMT: No existing data found, performing full refresh instead. [2025-10-02T21:00:10.934996] [INFO ] [MAIN ] PMT: Wiping existing primary data before full refresh. [2025-10-02T21:00:10.935067] [INFO ] [LOCAL ] PMT: Starting deletion of primary data. [2025-10-02T21:00:10.935124] [DEBUG] [LOCAL ] PMT: No primary data file found to delete. [2025-10-02T21:00:10.935172] [INFO ] [MAIN ] PMT: Starting full primary refresh. [2025-10-02T21:00:11.321188] [INFO ] [REMOTE ] PMT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:00:11.472999] [INFO ] [REMOTE ] PMT: Fetching primary data for 2024-12. [2025-10-02T21:00:12.273020] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-02. [2025-10-02T21:00:12.937029] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-02T21:00:12.983373] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-02T21:00:13.072995] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-01. [2025-10-02T21:00:13.204480] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-02T21:00:13.873006] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-10. [2025-10-02T21:00:14.376090] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-02T21:00:14.377786] [INFO ] [REMOTE ] PM: Full fetch complete (77314 records). [2025-10-02T21:00:14.377899] [DEBUG] [VALIDATOR ] PM: Validating primary data. [2025-10-02T21:00:14.378851] [FATAL] [VALIDATOR ] PM: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T21:00:14.378956] [FATAL] [MAIN ] PM: Fetched primary data is invalid. Refusing to save it. [2025-10-02T21:00:14.379053] [WARN ] [MAIN ] PM: Deleting existing primary and derivative data due to validation failure. [2025-10-02T21:00:14.379227] [INFO ] [LOCAL ] PM: Starting deletion of primary data. [2025-10-02T21:00:14.379317] [DEBUG] [LOCAL ] PM: No primary data file found to delete. [2025-10-02T21:00:14.379362] [INFO ] [LOCAL ] PM: Starting deletion of derivative data. [2025-10-02T21:00:14.379423] [DEBUG] [LOCAL ] PM: No derivative data file found to delete. [2025-10-02T21:00:14.379509] [INFO ] [MAIN ] Update Progress: 1703/2370 symbols completed. PM took 35.2s. Estimated remaining: 1h 34m 4s. Rate: 7.1 symbols/min [2025-10-02T21:00:14.572565] [INFO ] [MAIN ] PMTU: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:00:14.573051] [DEBUG] [LOCAL ] PMTU: No existing data file found in primary storage. [2025-10-02T21:00:14.573114] [WARN ] [MAIN ] PMTU: No existing data found, performing full refresh instead. [2025-10-02T21:00:14.573277] [INFO ] [MAIN ] PMTU: Wiping existing primary data before full refresh. [2025-10-02T21:00:14.573443] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-10-02T21:00:14.573526] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-10-02T21:00:14.573689] [INFO ] [MAIN ] PMTU: Starting full primary refresh. [2025-10-02T21:00:14.687010] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-06. [2025-10-02T21:00:14.726684] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-02T21:00:15.004037] [INFO ] [REMOTE ] PMTU: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:00:15.472978] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-03. [2025-10-02T21:00:15.687618] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-02T21:00:16.209408] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-02T21:00:16.272996] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2024-12. [2025-10-02T21:00:16.616629] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-10-02T21:00:17.073055] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-04. [2025-10-02T21:00:17.746795] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-02T21:00:17.873028] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-07. [2025-10-02T21:00:18.672986] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-02. [2025-10-02T21:00:18.751296] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-02T21:00:19.472997] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-05. [2025-10-02T21:00:20.086828] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-02T21:00:20.112362] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-02T21:00:20.273047] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-01. [2025-10-02T21:00:20.727265] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-02T21:00:21.073028] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-03. [2025-10-02T21:00:21.873004] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-02. [2025-10-02T21:00:22.640602] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-02T21:00:22.670623] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-02T21:00:22.679137] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-06. [2025-10-02T21:00:23.472980] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-03. [2025-10-02T21:00:23.508709] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-02T21:00:23.879205] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-02T21:00:24.273006] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-04. [2025-10-02T21:00:25.073034] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-07. [2025-10-02T21:00:25.873037] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-04. [2025-10-02T21:00:26.030470] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-02T21:00:26.134468] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-02T21:00:26.419537] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-02T21:00:26.672992] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-05. [2025-10-02T21:00:27.473022] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-08. [2025-10-02T21:00:27.912100] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-02T21:00:28.205989] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-02T21:00:28.273061] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-09. [2025-10-02T21:00:29.072991] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-06. [2025-10-02T21:00:29.112906] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-02T21:00:29.872941] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-10. [2025-10-02T21:00:30.263241] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-02T21:00:30.588597] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-02T21:00:30.589879] [INFO ] [REMOTE ] PMM: Full fetch complete (18290 records). [2025-10-02T21:00:30.590007] [DEBUG] [VALIDATOR ] PMM: Validating primary data. [2025-10-02T21:00:30.678164] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-07. [2025-10-02T21:00:31.018456] [DEBUG] [VALIDATOR ] PMM: All expected trading days are present. [2025-10-02T21:00:31.018542] [DEBUG] [VALIDATOR ] PMM: Primary data validation passed. [2025-10-02T21:00:31.019105] [INFO ] [MAIN ] PMM: Fetched primary data is valid. [2025-10-02T21:00:31.019171] [DEBUG] [LOCAL ] PMM: Saving primary data. [2025-10-02T21:00:31.019915] [DEBUG] [LOCAL ] PMM: Trimmed 18290 records to 10876 (keeping 200 days of data) [2025-10-02T21:00:31.089192] [DEBUG] [LOCAL ] PMM: Primary data saved (10876 records). [2025-10-02T21:00:31.089338] [INFO ] [MAIN ] PMM: Full history saved. [2025-10-02T21:00:31.089417] [INFO ] [MAIN ] Update Progress: 1704/2370 symbols completed. PMM took 36.4s. Estimated remaining: 1h 33m 59s. Rate: 7.1 symbols/min [2025-10-02T21:00:31.277873] [INFO ] [MAIN ] PMTV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:00:31.278069] [DEBUG] [LOCAL ] PMTV: No existing data file found in primary storage. [2025-10-02T21:00:31.278139] [WARN ] [MAIN ] PMTV: No existing data found, performing full refresh instead. [2025-10-02T21:00:31.278264] [INFO ] [MAIN ] PMTV: Wiping existing primary data before full refresh. [2025-10-02T21:00:31.278306] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-10-02T21:00:31.278347] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-10-02T21:00:31.278380] [INFO ] [MAIN ] PMTV: Starting full primary refresh. [2025-10-02T21:00:31.480296] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-05. [2025-10-02T21:00:31.681363] [INFO ] [REMOTE ] PMTV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:00:31.943621] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-02T21:00:32.272986] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2024-12. [2025-10-02T21:00:32.457621] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-02T21:00:32.588048] [DEBUG] [REMOTE ] PMTV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T21:00:32.588441] [WARN ] [REMOTE ] PMTV: No data returned for month 2024-12 [2025-10-02T21:00:32.588529] [FATAL] [REMOTE ] PMTV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T21:00:32.588602] [FATAL] [MAIN ] PMTV: Failed to fetch primary data. [2025-10-02T21:00:32.588692] [WARN ] [MAIN ] PMTV: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T21:00:32.588763] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-10-02T21:00:32.588827] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-10-02T21:00:32.588864] [INFO ] [LOCAL ] PMTV: Starting deletion of derivative data. [2025-10-02T21:00:32.588904] [DEBUG] [LOCAL ] PMTV: No derivative data file found to delete. [2025-10-02T21:00:32.588980] [INFO ] [MAIN ] Update Progress: 1705/2370 symbols completed. PMTV took 1.5s. Estimated remaining: 1h 33m 48s. Rate: 7.1 symbols/min [2025-10-02T21:00:32.771556] [INFO ] [MAIN ] PMTW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:00:32.771768] [DEBUG] [LOCAL ] PMTW: No existing data file found in primary storage. [2025-10-02T21:00:32.771813] [WARN ] [MAIN ] PMTW: No existing data found, performing full refresh instead. [2025-10-02T21:00:32.771927] [INFO ] [MAIN ] PMTW: Wiping existing primary data before full refresh. [2025-10-02T21:00:32.771969] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-10-02T21:00:32.772011] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-10-02T21:00:32.772044] [INFO ] [MAIN ] PMTW: Starting full primary refresh. [2025-10-02T21:00:33.078119] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-08. [2025-10-02T21:00:33.157725] [INFO ] [REMOTE ] PMTW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:00:33.873000] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2024-12. [2025-10-02T21:00:34.174271] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T21:00:34.174720] [WARN ] [REMOTE ] PMTW: No data returned for month 2024-12 [2025-10-02T21:00:34.174833] [FATAL] [REMOTE ] PMTW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T21:00:34.174900] [FATAL] [MAIN ] PMTW: Failed to fetch primary data. [2025-10-02T21:00:34.174949] [WARN ] [MAIN ] PMTW: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T21:00:34.175028] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-10-02T21:00:34.175150] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-10-02T21:00:34.175210] [INFO ] [LOCAL ] PMTW: Starting deletion of derivative data. [2025-10-02T21:00:34.175295] [DEBUG] [LOCAL ] PMTW: No derivative data file found to delete. [2025-10-02T21:00:34.175366] [INFO ] [MAIN ] Update Progress: 1706/2370 symbols completed. PMTW took 1.6s. Estimated remaining: 1h 33m 37s. Rate: 7.1 symbols/min [2025-10-02T21:00:34.390249] [INFO ] [MAIN ] PNC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:00:34.390727] [DEBUG] [LOCAL ] PNC: No existing data file found in primary storage. [2025-10-02T21:00:34.390819] [WARN ] [MAIN ] PNC: No existing data found, performing full refresh instead. [2025-10-02T21:00:34.391116] [INFO ] [MAIN ] PNC: Wiping existing primary data before full refresh. [2025-10-02T21:00:34.391379] [INFO ] [LOCAL ] PNC: Starting deletion of primary data. [2025-10-02T21:00:34.391505] [DEBUG] [LOCAL ] PNC: No primary data file found to delete. [2025-10-02T21:00:34.391797] [INFO ] [MAIN ] PNC: Starting full primary refresh. [2025-10-02T21:00:34.567021] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-02T21:00:34.680484] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-09. [2025-10-02T21:00:34.848799] [INFO ] [REMOTE ] PNC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:00:35.473026] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-06. [2025-10-02T21:00:35.930003] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-02T21:00:36.272969] [INFO ] [REMOTE ] PNC: Fetching primary data for 2024-12. [2025-10-02T21:00:36.389189] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-02T21:00:37.073040] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-07. [2025-10-02T21:00:37.524457] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-02T21:00:37.872983] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-10. [2025-10-02T21:00:38.054145] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-02T21:00:38.673077] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-01. [2025-10-02T21:00:38.969506] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-02T21:00:38.972083] [INFO ] [REMOTE ] PMT: Full fetch complete (58520 records). [2025-10-02T21:00:38.972212] [DEBUG] [VALIDATOR ] PMT: Validating primary data. [2025-10-02T21:00:39.456772] [DEBUG] [VALIDATOR ] PMT: All expected trading days are present. [2025-10-02T21:00:39.456901] [DEBUG] [VALIDATOR ] PMT: Primary data validation passed. [2025-10-02T21:00:39.459456] [INFO ] [MAIN ] PMT: Fetched primary data is valid. [2025-10-02T21:00:39.459575] [DEBUG] [LOCAL ] PMT: Saving primary data. [2025-10-02T21:00:39.462037] [DEBUG] [LOCAL ] PMT: Trimmed 58520 records to 40599 (keeping 200 days of data) [2025-10-02T21:00:39.473093] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-08. [2025-10-02T21:00:39.862085] [DEBUG] [LOCAL ] PMT: Primary data saved (40599 records). [2025-10-02T21:00:39.862255] [INFO ] [MAIN ] PMT: Full history saved. [2025-10-02T21:00:39.862367] [INFO ] [MAIN ] Update Progress: 1707/2370 symbols completed. PMT took 29.1s. Estimated remaining: 1h 33m 27s. Rate: 7.1 symbols/min [2025-10-02T21:00:40.139498] [INFO ] [MAIN ] PNI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:00:40.140030] [DEBUG] [LOCAL ] PNI: No existing data file found in primary storage. [2025-10-02T21:00:40.140090] [WARN ] [MAIN ] PNI: No existing data found, performing full refresh instead. [2025-10-02T21:00:40.140272] [INFO ] [MAIN ] PNI: Wiping existing primary data before full refresh. [2025-10-02T21:00:40.140317] [INFO ] [LOCAL ] PNI: Starting deletion of primary data. [2025-10-02T21:00:40.140423] [DEBUG] [LOCAL ] PNI: No primary data file found to delete. [2025-10-02T21:00:40.140529] [INFO ] [MAIN ] PNI: Starting full primary refresh. [2025-10-02T21:00:40.277411] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-08. [2025-10-02T21:00:40.536397] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-02T21:00:40.631876] [INFO ] [REMOTE ] PNI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:00:40.661718] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-02T21:00:40.787125] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-02T21:00:41.073058] [INFO ] [REMOTE ] PNI: Fetching primary data for 2024-12. [2025-10-02T21:00:41.873011] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-09. [2025-10-02T21:00:41.987735] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-02T21:00:42.479165] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-02T21:00:42.673009] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-01. [2025-10-02T21:00:43.225602] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-02T21:00:43.473023] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-02. [2025-10-02T21:00:44.273038] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-10. [2025-10-02T21:00:44.788015] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-02T21:00:44.789111] [INFO ] [REMOTE ] PMO: Full fetch complete (17110 records). [2025-10-02T21:00:44.789219] [DEBUG] [VALIDATOR ] PMO: Validating primary data. [2025-10-02T21:00:45.075388] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-09. [2025-10-02T21:00:45.224956] [DEBUG] [VALIDATOR ] PMO: All expected trading days are present. [2025-10-02T21:00:45.225095] [DEBUG] [VALIDATOR ] PMO: Primary data validation passed. [2025-10-02T21:00:45.225550] [INFO ] [MAIN ] PMO: Fetched primary data is valid. [2025-10-02T21:00:45.225724] [DEBUG] [LOCAL ] PMO: Saving primary data. [2025-10-02T21:00:45.236095] [DEBUG] [LOCAL ] PMO: Trimmed 17110 records to 10556 (keeping 200 days of data) [2025-10-02T21:00:45.254574] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-02T21:00:45.334801] [DEBUG] [LOCAL ] PMO: Primary data saved (10556 records). [2025-10-02T21:00:45.334947] [INFO ] [MAIN ] PMO: Full history saved. [2025-10-02T21:00:45.335039] [INFO ] [MAIN ] Update Progress: 1708/2370 symbols completed. PMO took 49.3s. Estimated remaining: 1h 33m 17s. Rate: 7.1 symbols/min [2025-10-02T21:00:45.536543] [INFO ] [MAIN ] PNNT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:00:45.536789] [DEBUG] [LOCAL ] PNNT: No existing data file found in primary storage. [2025-10-02T21:00:45.536900] [WARN ] [MAIN ] PNNT: No existing data found, performing full refresh instead. [2025-10-02T21:00:45.537023] [INFO ] [MAIN ] PNNT: Wiping existing primary data before full refresh. [2025-10-02T21:00:45.537067] [INFO ] [LOCAL ] PNNT: Starting deletion of primary data. [2025-10-02T21:00:45.537155] [DEBUG] [LOCAL ] PNNT: No primary data file found to delete. [2025-10-02T21:00:45.537196] [INFO ] [MAIN ] PNNT: Starting full primary refresh. [2025-10-02T21:00:45.609358] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-02T21:00:45.887839] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-03. [2025-10-02T21:00:45.934219] [INFO ] [REMOTE ] PNNT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:00:46.672993] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-10. [2025-10-02T21:00:47.011017] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-02T21:00:47.011755] [INFO ] [REMOTE ] PMTU: Full fetch complete (1229 records). [2025-10-02T21:00:47.011826] [DEBUG] [VALIDATOR ] PMTU: Validating primary data. [2025-10-02T21:00:47.218550] [WARN ] [VALIDATOR ] PMTU: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-10-02T21:00:47.218994] [FATAL] [MAIN ] PMTU: Fetched primary data is invalid. Refusing to save it. [2025-10-02T21:00:47.219063] [WARN ] [MAIN ] PMTU: Deleting existing primary and derivative data due to validation failure. [2025-10-02T21:00:47.219135] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-10-02T21:00:47.219243] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-10-02T21:00:47.219298] [INFO ] [LOCAL ] PMTU: Starting deletion of derivative data. [2025-10-02T21:00:47.219359] [DEBUG] [LOCAL ] PMTU: No derivative data file found to delete. [2025-10-02T21:00:47.219438] [INFO ] [MAIN ] Update Progress: 1709/2370 symbols completed. PMTU took 32.8s. Estimated remaining: 1h 33m 6s. Rate: 7.1 symbols/min [2025-10-02T21:00:47.407301] [INFO ] [MAIN ] PNR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:00:47.407726] [DEBUG] [LOCAL ] PNR: No existing data file found in primary storage. [2025-10-02T21:00:47.407897] [WARN ] [MAIN ] PNR: No existing data found, performing full refresh instead. [2025-10-02T21:00:47.408067] [INFO ] [MAIN ] PNR: Wiping existing primary data before full refresh. [2025-10-02T21:00:47.408154] [INFO ] [LOCAL ] PNR: Starting deletion of primary data. [2025-10-02T21:00:47.408237] [DEBUG] [LOCAL ] PNR: No primary data file found to delete. [2025-10-02T21:00:47.408383] [INFO ] [MAIN ] PNR: Starting full primary refresh. [2025-10-02T21:00:47.476565] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-02. [2025-10-02T21:00:47.826711] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-02T21:00:47.848162] [INFO ] [REMOTE ] PNR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:00:48.273047] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-04. [2025-10-02T21:00:48.436537] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-02T21:00:49.073049] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-03. [2025-10-02T21:00:49.790471] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-02T21:00:49.873023] [INFO ] [REMOTE ] PNR: Fetching primary data for 2024-12. [2025-10-02T21:00:50.114506] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-02T21:00:50.673002] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2024-12. [2025-10-02T21:00:51.270847] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-02T21:00:51.472982] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-01. [2025-10-02T21:00:51.816566] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-02T21:00:52.273045] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-01. [2025-10-02T21:00:52.790710] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-02T21:00:53.072999] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-02. [2025-10-02T21:00:53.660213] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-02T21:00:53.873023] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-05. [2025-10-02T21:00:54.673039] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-04. [2025-10-02T21:00:54.862961] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-02T21:00:55.312051] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-02T21:00:55.473010] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-02. [2025-10-02T21:00:55.539869] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-02T21:00:56.273008] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-03. [2025-10-02T21:00:56.871135] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-02T21:00:57.073002] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-05. [2025-10-02T21:00:57.797088] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-02T21:00:57.872975] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-06. [2025-10-02T21:00:58.151089] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-02T21:00:58.406209] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-02T21:00:58.673036] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-07. [2025-10-02T21:00:59.366339] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-02T21:00:59.473041] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-04. [2025-10-02T21:01:00.273000] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-08. [2025-10-02T21:01:01.073023] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-06. [2025-10-02T21:01:01.149510] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-02T21:01:01.249007] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-02T21:01:01.873057] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-05. [2025-10-02T21:01:02.673019] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-09. [2025-10-02T21:01:03.326891] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-02T21:01:03.328687] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-10-02T21:01:03.473017] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-10. [2025-10-02T21:01:03.741861] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-02T21:01:04.047496] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-02T21:01:04.048432] [INFO ] [REMOTE ] PNI: Full fetch complete (9917 records). [2025-10-02T21:01:04.048502] [DEBUG] [VALIDATOR ] PNI: Validating primary data. [2025-10-02T21:01:04.279080] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-03. [2025-10-02T21:01:04.443607] [DEBUG] [VALIDATOR ] PNI: All expected trading days are present. [2025-10-02T21:01:04.443717] [DEBUG] [VALIDATOR ] PNI: Primary data validation passed. [2025-10-02T21:01:04.443991] [INFO ] [MAIN ] PNI: Fetched primary data is valid. [2025-10-02T21:01:04.444033] [DEBUG] [LOCAL ] PNI: Saving primary data. [2025-10-02T21:01:04.444464] [DEBUG] [LOCAL ] PNI: Trimmed 9917 records to 6820 (keeping 200 days of data) [2025-10-02T21:01:04.485484] [DEBUG] [LOCAL ] PNI: Primary data saved (6820 records). [2025-10-02T21:01:04.485597] [INFO ] [MAIN ] PNI: Full history saved. [2025-10-02T21:01:04.485693] [INFO ] [MAIN ] Update Progress: 1710/2370 symbols completed. PNI took 24.6s. Estimated remaining: 1h 33m 1s. Rate: 7.1 symbols/min [2025-10-02T21:01:04.670466] [INFO ] [MAIN ] PNW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:01:04.670682] [DEBUG] [LOCAL ] PNW: No existing data file found in primary storage. [2025-10-02T21:01:04.670738] [WARN ] [MAIN ] PNW: No existing data found, performing full refresh instead. [2025-10-02T21:01:04.670847] [INFO ] [MAIN ] PNW: Wiping existing primary data before full refresh. [2025-10-02T21:01:04.670890] [INFO ] [LOCAL ] PNW: Starting deletion of primary data. [2025-10-02T21:01:04.670960] [DEBUG] [LOCAL ] PNW: No primary data file found to delete. [2025-10-02T21:01:04.671002] [INFO ] [MAIN ] PNW: Starting full primary refresh. [2025-10-02T21:01:05.078550] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-07. [2025-10-02T21:01:05.114752] [INFO ] [REMOTE ] PNW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:01:05.729116] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-02T21:01:05.872992] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-06. [2025-10-02T21:01:06.673020] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-04. [2025-10-02T21:01:07.073088] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-02T21:01:07.473017] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-08. [2025-10-02T21:01:07.532148] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-02T21:01:08.183357] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-02T21:01:08.272995] [INFO ] [REMOTE ] PNW: Fetching primary data for 2024-12. [2025-10-02T21:01:09.073000] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-07. [2025-10-02T21:01:09.473041] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-02T21:01:09.872999] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-09. [2025-10-02T21:01:09.996483] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-02T21:01:10.673002] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-01. [2025-10-02T21:01:10.917874] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-02T21:01:11.466296] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-02T21:01:11.476810] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-08. [2025-10-02T21:01:12.272964] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-05. [2025-10-02T21:01:12.376431] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-02T21:01:12.876684] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-02T21:01:13.073035] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-02. [2025-10-02T21:01:13.438457] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-02T21:01:13.873002] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-06. [2025-10-02T21:01:14.631808] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-02T21:01:14.672960] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-03. [2025-10-02T21:01:14.760174] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-02T21:01:15.473061] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-07. [2025-10-02T21:01:16.167785] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-02T21:01:16.273031] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-09. [2025-10-02T21:01:17.073095] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-04. [2025-10-02T21:01:17.109720] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-02T21:01:17.872958] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-08. [2025-10-02T21:01:17.993374] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-02T21:01:18.652083] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-02T21:01:18.672963] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-05. [2025-10-02T21:01:19.473017] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-10. [2025-10-02T21:01:19.591977] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-02T21:01:19.897839] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-02T21:01:19.900120] [INFO ] [REMOTE ] PNR: Full fetch complete (68823 records). [2025-10-02T21:01:19.900270] [DEBUG] [VALIDATOR ] PNR: Validating primary data. [2025-10-02T21:01:19.904613] [FATAL] [VALIDATOR ] PNR: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T21:01:19.904924] [FATAL] [MAIN ] PNR: Fetched primary data is invalid. Refusing to save it. [2025-10-02T21:01:19.904997] [WARN ] [MAIN ] PNR: Deleting existing primary and derivative data due to validation failure. [2025-10-02T21:01:19.905089] [INFO ] [LOCAL ] PNR: Starting deletion of primary data. [2025-10-02T21:01:19.905199] [DEBUG] [LOCAL ] PNR: No primary data file found to delete. [2025-10-02T21:01:19.905290] [INFO ] [LOCAL ] PNR: Starting deletion of derivative data. [2025-10-02T21:01:19.905564] [DEBUG] [LOCAL ] PNR: No derivative data file found to delete. [2025-10-02T21:01:19.905696] [INFO ] [MAIN ] Update Progress: 1711/2370 symbols completed. PNR took 32.7s. Estimated remaining: 1h 32m 56s. Rate: 7.1 symbols/min [2025-10-02T21:01:20.105145] [INFO ] [MAIN ] POR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:01:20.105419] [DEBUG] [LOCAL ] POR: No existing data file found in primary storage. [2025-10-02T21:01:20.105529] [WARN ] [MAIN ] POR: No existing data found, performing full refresh instead. [2025-10-02T21:01:20.105895] [INFO ] [MAIN ] POR: Wiping existing primary data before full refresh. [2025-10-02T21:01:20.105968] [INFO ] [LOCAL ] POR: Starting deletion of primary data. [2025-10-02T21:01:20.106178] [DEBUG] [LOCAL ] POR: No primary data file found to delete. [2025-10-02T21:01:20.106244] [INFO ] [MAIN ] POR: Starting full primary refresh. [2025-10-02T21:01:20.273078] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-10. [2025-10-02T21:01:20.467497] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-02T21:01:20.561631] [INFO ] [REMOTE ] POR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:01:20.797996] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-02T21:01:20.799947] [INFO ] [REMOTE ] PNC: Full fetch complete (75093 records). [2025-10-02T21:01:20.800086] [DEBUG] [VALIDATOR ] PNC: Validating primary data. [2025-10-02T21:01:20.801980] [FATAL] [VALIDATOR ] PNC: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T21:01:20.802229] [FATAL] [MAIN ] PNC: Fetched primary data is invalid. Refusing to save it. [2025-10-02T21:01:20.802313] [WARN ] [MAIN ] PNC: Deleting existing primary and derivative data due to validation failure. [2025-10-02T21:01:20.802396] [INFO ] [LOCAL ] PNC: Starting deletion of primary data. [2025-10-02T21:01:20.802471] [DEBUG] [LOCAL ] PNC: No primary data file found to delete. [2025-10-02T21:01:20.802512] [INFO ] [LOCAL ] PNC: Starting deletion of derivative data. [2025-10-02T21:01:20.802554] [DEBUG] [LOCAL ] PNC: No derivative data file found to delete. [2025-10-02T21:01:20.802630] [INFO ] [MAIN ] Update Progress: 1712/2370 symbols completed. PNC took 46.6s. Estimated remaining: 1h 32m 44s. Rate: 7.1 symbols/min [2025-10-02T21:01:20.993403] [INFO ] [MAIN ] POST: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:01:20.993580] [DEBUG] [LOCAL ] POST: No existing data file found in primary storage. [2025-10-02T21:01:20.993618] [WARN ] [MAIN ] POST: No existing data found, performing full refresh instead. [2025-10-02T21:01:20.993757] [INFO ] [MAIN ] POST: Wiping existing primary data before full refresh. [2025-10-02T21:01:20.993800] [INFO ] [LOCAL ] POST: Starting deletion of primary data. [2025-10-02T21:01:20.993884] [DEBUG] [LOCAL ] POST: No primary data file found to delete. [2025-10-02T21:01:20.993971] [INFO ] [MAIN ] POST: Starting full primary refresh. [2025-10-02T21:01:21.078177] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-06. [2025-10-02T21:01:21.387514] [INFO ] [REMOTE ] POST: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:01:21.872995] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-09. [2025-10-02T21:01:22.672997] [INFO ] [REMOTE ] POST: Fetching primary data for 2024-12. [2025-10-02T21:01:22.944273] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-02T21:01:23.372872] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-02T21:01:23.473042] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-10. [2025-10-02T21:01:23.955435] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-02T21:01:24.273015] [INFO ] [REMOTE ] POR: Fetching primary data for 2024-12. [2025-10-02T21:01:24.620166] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-02T21:01:24.622051] [INFO ] [REMOTE ] PNNT: Full fetch complete (47549 records). [2025-10-02T21:01:24.622176] [DEBUG] [VALIDATOR ] PNNT: Validating primary data. [2025-10-02T21:01:25.071561] [DEBUG] [VALIDATOR ] PNNT: All expected trading days are present. [2025-10-02T21:01:25.071688] [DEBUG] [VALIDATOR ] PNNT: Primary data validation passed. [2025-10-02T21:01:25.072699] [INFO ] [MAIN ] PNNT: Fetched primary data is valid. [2025-10-02T21:01:25.072773] [DEBUG] [LOCAL ] PNNT: Saving primary data. [2025-10-02T21:01:25.073094] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-07. [2025-10-02T21:01:25.075347] [DEBUG] [LOCAL ] PNNT: Trimmed 47549 records to 33121 (keeping 200 days of data) [2025-10-02T21:01:25.296679] [DEBUG] [LOCAL ] PNNT: Primary data saved (33121 records). [2025-10-02T21:01:25.296836] [INFO ] [MAIN ] PNNT: Full history saved. [2025-10-02T21:01:25.296916] [INFO ] [MAIN ] Update Progress: 1713/2370 symbols completed. PNNT took 40.0s. Estimated remaining: 1h 32m 34s. Rate: 7.1 symbols/min [2025-10-02T21:01:25.488401] [INFO ] [MAIN ] PPG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:01:25.488582] [DEBUG] [LOCAL ] PPG: No existing data file found in primary storage. [2025-10-02T21:01:25.488620] [WARN ] [MAIN ] PPG: No existing data found, performing full refresh instead. [2025-10-02T21:01:25.488790] [INFO ] [MAIN ] PPG: Wiping existing primary data before full refresh. [2025-10-02T21:01:25.488838] [INFO ] [LOCAL ] PPG: Starting deletion of primary data. [2025-10-02T21:01:25.488889] [DEBUG] [LOCAL ] PPG: No primary data file found to delete. [2025-10-02T21:01:25.488925] [INFO ] [MAIN ] PPG: Starting full primary refresh. [2025-10-02T21:01:25.873590] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-01. [2025-10-02T21:01:25.912916] [INFO ] [REMOTE ] PPG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:01:25.940403] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-02T21:01:26.673021] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-01. [2025-10-02T21:01:27.473060] [INFO ] [REMOTE ] PPG: Fetching primary data for 2024-12. [2025-10-02T21:01:27.745289] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-02T21:01:28.036761] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-07 (2.96 seconds). [2025-10-02T21:01:28.116729] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-02T21:01:28.273020] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-02. [2025-10-02T21:01:29.072992] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-08. [2025-10-02T21:01:29.347469] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-02T21:01:29.870294] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-02T21:01:29.880137] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-01. [2025-10-02T21:01:30.378758] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-02T21:01:30.673063] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-09. [2025-10-02T21:01:31.478194] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-02. [2025-10-02T21:01:31.500835] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-02T21:01:32.041162] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-02T21:01:32.273022] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-02. [2025-10-02T21:01:32.706666] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-02T21:01:33.073020] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-03. [2025-10-02T21:01:33.872974] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-10. [2025-10-02T21:01:34.070322] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-02T21:01:34.672982] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-03. [2025-10-02T21:01:34.768898] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-02T21:01:34.981962] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-02T21:01:34.984106] [INFO ] [REMOTE ] PNW: Full fetch complete (66070 records). [2025-10-02T21:01:34.984206] [DEBUG] [VALIDATOR ] PNW: Validating primary data. [2025-10-02T21:01:35.435219] [DEBUG] [VALIDATOR ] PNW: All expected trading days are present. [2025-10-02T21:01:35.435310] [DEBUG] [VALIDATOR ] PNW: Primary data validation passed. [2025-10-02T21:01:35.436515] [INFO ] [MAIN ] PNW: Fetched primary data is valid. [2025-10-02T21:01:35.436581] [DEBUG] [LOCAL ] PNW: Saving primary data. [2025-10-02T21:01:35.438366] [DEBUG] [LOCAL ] PNW: Trimmed 66070 records to 46137 (keeping 200 days of data) [2025-10-02T21:01:35.497882] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-04. [2025-10-02T21:01:35.748901] [DEBUG] [LOCAL ] PNW: Primary data saved (46137 records). [2025-10-02T21:01:35.749051] [INFO ] [MAIN ] PNW: Full history saved. [2025-10-02T21:01:35.749131] [INFO ] [MAIN ] Update Progress: 1714/2370 symbols completed. PNW took 31.3s. Estimated remaining: 1h 32m 27s. Rate: 7.1 symbols/min [2025-10-02T21:01:35.933954] [INFO ] [MAIN ] PPL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:01:35.934131] [DEBUG] [LOCAL ] PPL: No existing data file found in primary storage. [2025-10-02T21:01:35.934188] [WARN ] [MAIN ] PPL: No existing data found, performing full refresh instead. [2025-10-02T21:01:35.934343] [INFO ] [MAIN ] PPL: Wiping existing primary data before full refresh. [2025-10-02T21:01:35.934411] [INFO ] [LOCAL ] PPL: Starting deletion of primary data. [2025-10-02T21:01:35.934465] [DEBUG] [LOCAL ] PPL: No primary data file found to delete. [2025-10-02T21:01:35.934501] [INFO ] [MAIN ] PPL: Starting full primary refresh. [2025-10-02T21:01:36.281022] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-03. [2025-10-02T21:01:36.388986] [INFO ] [REMOTE ] PPL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:01:36.419393] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-02T21:01:37.073039] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-04. [2025-10-02T21:01:37.197751] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-02T21:01:37.872979] [INFO ] [REMOTE ] PPL: Fetching primary data for 2024-12. [2025-10-02T21:01:37.931666] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-02T21:01:38.673001] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-04. [2025-10-02T21:01:39.029265] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-02T21:01:39.389289] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-02T21:01:39.472992] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-05. [2025-10-02T21:01:40.273007] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-01. [2025-10-02T21:01:40.376236] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-02T21:01:41.073043] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-05. [2025-10-02T21:01:41.218518] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-02T21:01:41.872999] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-05. [2025-10-02T21:01:41.982974] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-02T21:01:42.654252] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-02T21:01:42.672959] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-06. [2025-10-02T21:01:43.472970] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-06. [2025-10-02T21:01:43.827599] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-02T21:01:44.279319] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-06. [2025-10-02T21:01:44.284199] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-02T21:01:45.073050] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-02. [2025-10-02T21:01:45.315588] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-02T21:01:45.872973] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-07. [2025-10-02T21:01:45.977697] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-02T21:01:46.672980] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-07. [2025-10-02T21:01:46.906810] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-02T21:01:47.473002] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-07. [2025-10-02T21:01:47.697458] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-02T21:01:47.989371] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-02T21:01:48.273054] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-08. [2025-10-02T21:01:49.073009] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-03. [2025-10-02T21:01:49.245139] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-02T21:01:49.771835] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-02T21:01:49.873009] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-08. [2025-10-02T21:01:50.672971] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-08. [2025-10-02T21:01:50.713703] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-02T21:01:51.480555] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-04. [2025-10-02T21:01:51.503566] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-02T21:01:52.273031] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-09. [2025-10-02T21:01:52.508570] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-02T21:01:53.073007] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-09. [2025-10-02T21:01:53.595222] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-02T21:01:53.873046] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-05. [2025-10-02T21:01:54.083683] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-02T21:01:54.672992] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-10. [2025-10-02T21:01:54.943501] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-02T21:01:55.473076] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-09. [2025-10-02T21:01:55.682582] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-02T21:01:55.730044] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-02T21:01:55.731634] [INFO ] [REMOTE ] POST: Full fetch complete (55863 records). [2025-10-02T21:01:55.731775] [DEBUG] [VALIDATOR ] POST: Validating primary data. [2025-10-02T21:01:56.153842] [DEBUG] [VALIDATOR ] POST: All expected trading days are present. [2025-10-02T21:01:56.153962] [DEBUG] [VALIDATOR ] POST: Primary data validation passed. [2025-10-02T21:01:56.155097] [INFO ] [MAIN ] POST: Fetched primary data is valid. [2025-10-02T21:01:56.155169] [DEBUG] [LOCAL ] POST: Saving primary data. [2025-10-02T21:01:56.156673] [DEBUG] [LOCAL ] POST: Trimmed 55863 records to 39020 (keeping 200 days of data) [2025-10-02T21:01:56.273014] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-06. [2025-10-02T21:01:56.419824] [DEBUG] [LOCAL ] POST: Primary data saved (39020 records). [2025-10-02T21:01:56.419971] [INFO ] [MAIN ] POST: Full history saved. [2025-10-02T21:01:56.420053] [INFO ] [MAIN ] Update Progress: 1715/2370 symbols completed. POST took 35.6s. Estimated remaining: 1h 32m 23s. Rate: 7.1 symbols/min [2025-10-02T21:01:56.604061] [INFO ] [MAIN ] PPT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:01:56.604254] [DEBUG] [LOCAL ] PPT: No existing data file found in primary storage. [2025-10-02T21:01:56.604293] [WARN ] [MAIN ] PPT: No existing data found, performing full refresh instead. [2025-10-02T21:01:56.604410] [INFO ] [MAIN ] PPT: Wiping existing primary data before full refresh. [2025-10-02T21:01:56.604453] [INFO ] [LOCAL ] PPT: Starting deletion of primary data. [2025-10-02T21:01:56.604496] [DEBUG] [LOCAL ] PPT: No primary data file found to delete. [2025-10-02T21:01:56.604531] [INFO ] [MAIN ] PPT: Starting full primary refresh. [2025-10-02T21:01:57.008935] [INFO ] [REMOTE ] PPT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:01:57.073032] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-10. [2025-10-02T21:01:57.320871] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-02T21:01:57.873032] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-10. [2025-10-02T21:01:58.255316] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-02T21:01:58.283555] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-02T21:01:58.287078] [INFO ] [REMOTE ] POR: Full fetch complete (68508 records). [2025-10-02T21:01:58.287288] [DEBUG] [VALIDATOR ] POR: Validating primary data. [2025-10-02T21:01:58.678134] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-07. [2025-10-02T21:01:58.766823] [DEBUG] [VALIDATOR ] POR: All expected trading days are present. [2025-10-02T21:01:58.766971] [DEBUG] [VALIDATOR ] POR: Primary data validation passed. [2025-10-02T21:01:58.768180] [INFO ] [MAIN ] POR: Fetched primary data is valid. [2025-10-02T21:01:58.768253] [DEBUG] [LOCAL ] POR: Saving primary data. [2025-10-02T21:01:58.769825] [DEBUG] [LOCAL ] POR: Trimmed 68508 records to 47361 (keeping 200 days of data) [2025-10-02T21:01:59.092992] [DEBUG] [LOCAL ] POR: Primary data saved (47361 records). [2025-10-02T21:01:59.093135] [INFO ] [MAIN ] POR: Full history saved. [2025-10-02T21:01:59.093215] [INFO ] [MAIN ] Update Progress: 1716/2370 symbols completed. POR took 39.2s. Estimated remaining: 1h 32m 12s. Rate: 7.1 symbols/min [2025-10-02T21:01:59.308443] [INFO ] [MAIN ] PR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:01:59.308668] [DEBUG] [LOCAL ] PR: No existing data file found in primary storage. [2025-10-02T21:01:59.308730] [WARN ] [MAIN ] PR: No existing data found, performing full refresh instead. [2025-10-02T21:01:59.308856] [INFO ] [MAIN ] PR: Wiping existing primary data before full refresh. [2025-10-02T21:01:59.308905] [INFO ] [LOCAL ] PR: Starting deletion of primary data. [2025-10-02T21:01:59.308949] [DEBUG] [LOCAL ] PR: No primary data file found to delete. [2025-10-02T21:01:59.308981] [INFO ] [MAIN ] PR: Starting full primary refresh. [2025-10-02T21:01:59.432312] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-02T21:01:59.445719] [INFO ] [REMOTE ] PPG: Full fetch complete (73777 records). [2025-10-02T21:01:59.461348] [DEBUG] [VALIDATOR ] PPG: Validating primary data. [2025-10-02T21:01:59.477132] [INFO ] [REMOTE ] PPT: Fetching primary data for 2024-12. [2025-10-02T21:02:00.032588] [INFO ] [REMOTE ] PR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:02:00.246941] [DEBUG] [VALIDATOR ] PPG: All expected trading days are present. [2025-10-02T21:02:00.247044] [DEBUG] [VALIDATOR ] PPG: Primary data validation passed. [2025-10-02T21:02:00.248279] [INFO ] [MAIN ] PPG: Fetched primary data is valid. [2025-10-02T21:02:00.248368] [DEBUG] [LOCAL ] PPG: Saving primary data. [2025-10-02T21:02:00.250259] [DEBUG] [LOCAL ] PPG: Trimmed 73777 records to 51055 (keeping 200 days of data) [2025-10-02T21:02:00.320275] [INFO ] [REMOTE ] PR: Fetching primary data for 2024-12. [2025-10-02T21:02:00.630499] [DEBUG] [LOCAL ] PPG: Primary data saved (51055 records). [2025-10-02T21:02:00.630706] [INFO ] [MAIN ] PPG: Full history saved. [2025-10-02T21:02:00.630808] [INFO ] [MAIN ] Update Progress: 1717/2370 symbols completed. PPG took 35.3s. Estimated remaining: 1h 32m 1s. Rate: 7.1 symbols/min [2025-10-02T21:02:00.873591] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-02T21:02:00.926295] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-02T21:02:01.073020] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-01. [2025-10-02T21:02:01.873010] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-08. [2025-10-02T21:02:02.401294] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-02T21:02:02.415342] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-02T21:02:02.673009] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-01. [2025-10-02T21:02:03.473015] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-02. [2025-10-02T21:02:03.970335] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-02T21:02:04.272968] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-09. [2025-10-02T21:02:04.796683] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-02T21:02:04.980096] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-10-02T21:02:05.072998] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-02. [2025-10-02T21:02:05.873051] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-03. [2025-10-02T21:02:06.489977] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-02T21:02:06.672964] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-10. [2025-10-02T21:02:07.005700] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-02T21:02:07.055698] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-02T21:02:07.098174] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-02T21:02:07.100522] [INFO ] [REMOTE ] PPL: Full fetch complete (77030 records). [2025-10-02T21:02:07.100680] [DEBUG] [VALIDATOR ] PPL: Validating primary data. [2025-10-02T21:02:07.101705] [FATAL] [VALIDATOR ] PPL: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T21:02:07.101804] [FATAL] [MAIN ] PPL: Fetched primary data is invalid. Refusing to save it. [2025-10-02T21:02:07.101851] [WARN ] [MAIN ] PPL: Deleting existing primary and derivative data due to validation failure. [2025-10-02T21:02:07.101897] [INFO ] [LOCAL ] PPL: Starting deletion of primary data. [2025-10-02T21:02:07.101986] [DEBUG] [LOCAL ] PPL: No primary data file found to delete. [2025-10-02T21:02:07.102052] [INFO ] [LOCAL ] PPL: Starting deletion of derivative data. [2025-10-02T21:02:07.102122] [DEBUG] [LOCAL ] PPL: No derivative data file found to delete. [2025-10-02T21:02:07.102233] [INFO ] [MAIN ] Update Progress: 1718/2370 symbols completed. PPL took 31.4s. Estimated remaining: 1h 31m 52s. Rate: 7.1 symbols/min [2025-10-02T21:02:07.473051] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-04. [2025-10-02T21:02:08.273083] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-03. [2025-10-02T21:02:08.711828] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-02T21:02:09.073057] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-05. [2025-10-02T21:02:10.291751] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-02T21:02:10.303772] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-04. [2025-10-02T21:02:10.383313] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-02T21:02:10.673016] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-06. [2025-10-02T21:02:11.725047] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-02T21:02:11.730921] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-07. [2025-10-02T21:02:12.646543] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-02T21:02:12.662936] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-05. [2025-10-02T21:02:13.076624] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-02T21:02:13.082639] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-08. [2025-10-02T21:02:14.388925] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-02T21:02:14.396112] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-09. [2025-10-02T21:02:14.572852] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-02T21:02:14.673047] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-06. [2025-10-02T21:02:15.336786] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-02T21:02:15.473015] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-10. [2025-10-02T21:02:16.265851] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-02T21:02:16.267298] [INFO ] [REMOTE ] PPT: Full fetch complete (29092 records). [2025-10-02T21:02:16.267406] [DEBUG] [VALIDATOR ] PPT: Validating primary data. [2025-10-02T21:02:16.706089] [DEBUG] [VALIDATOR ] PPT: All expected trading days are present. [2025-10-02T21:02:16.706237] [DEBUG] [VALIDATOR ] PPT: Primary data validation passed. [2025-10-02T21:02:16.707129] [INFO ] [MAIN ] PPT: Fetched primary data is valid. [2025-10-02T21:02:16.707319] [DEBUG] [LOCAL ] PPT: Saving primary data. [2025-10-02T21:02:16.708614] [DEBUG] [LOCAL ] PPT: Trimmed 29092 records to 20167 (keeping 200 days of data) [2025-10-02T21:02:16.861551] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-02T21:02:16.875419] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-07. [2025-10-02T21:02:16.915709] [DEBUG] [LOCAL ] PPT: Primary data saved (20167 records). [2025-10-02T21:02:16.915867] [INFO ] [MAIN ] PPT: Full history saved. [2025-10-02T21:02:16.915946] [INFO ] [MAIN ] Update Progress: 1719/2370 symbols completed. PPT took 20.5s. Estimated remaining: 1h 31m 44s. Rate: 7.1 symbols/min [2025-10-02T21:02:18.912394] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-02T21:02:18.924333] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-08. [2025-10-02T21:02:21.053416] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-02T21:02:21.065949] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-09. [2025-10-02T21:02:23.021709] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-02T21:02:23.035054] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-10. [2025-10-02T21:02:24.384860] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-02T21:02:24.387271] [INFO ] [REMOTE ] PR: Full fetch complete (77597 records). [2025-10-02T21:02:24.387439] [DEBUG] [VALIDATOR ] PR: Validating primary data. [2025-10-02T21:02:24.985364] [DEBUG] [VALIDATOR ] PR: All expected trading days are present. [2025-10-02T21:02:24.985483] [DEBUG] [VALIDATOR ] PR: Primary data validation passed. [2025-10-02T21:02:24.987528] [INFO ] [MAIN ] PR: Fetched primary data is valid. [2025-10-02T21:02:24.987620] [DEBUG] [LOCAL ] PR: Saving primary data. [2025-10-02T21:02:24.989709] [DEBUG] [LOCAL ] PR: Trimmed 77597 records to 54000 (keeping 200 days of data) [2025-10-02T21:02:25.449637] [DEBUG] [LOCAL ] PR: Primary data saved (54000 records). [2025-10-02T21:02:25.449834] [INFO ] [MAIN ] PR: Full history saved. [2025-10-02T21:02:25.449999] [INFO ] [MAIN ] Update Progress: 1720/2370 symbols completed. PR took 26.4s. Estimated remaining: 1h 31m 35s. Rate: 7.1 symbols/min [2025-10-02T21:02:26.128877] [INFO ] [MAIN ] PRA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:02:26.119818] [INFO ] [MAIN ] PRCS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:02:26.156927] [DEBUG] [LOCAL ] PRA: No existing data file found in primary storage. [2025-10-02T21:02:26.157080] [DEBUG] [LOCAL ] PRCS: No existing data file found in primary storage. [2025-10-02T21:02:26.163663] [WARN ] [MAIN ] PRA: No existing data found, performing full refresh instead. [2025-10-02T21:02:26.164115] [INFO ] [MAIN ] PRA: Wiping existing primary data before full refresh. [2025-10-02T21:02:26.163750] [WARN ] [MAIN ] PRCS: No existing data found, performing full refresh instead. [2025-10-02T21:02:26.172633] [INFO ] [MAIN ] PRCS: Wiping existing primary data before full refresh. [2025-10-02T21:02:26.184124] [INFO ] [LOCAL ] PRA: Starting deletion of primary data. [2025-10-02T21:02:26.218293] [DEBUG] [LOCAL ] PRA: No primary data file found to delete. [2025-10-02T21:02:26.216687] [INFO ] [MAIN ] PRGO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:02:26.224049] [INFO ] [MAIN ] PRA: Starting full primary refresh. [2025-10-02T21:02:26.223924] [DEBUG] [LOCAL ] PRGO: No existing data file found in primary storage. [2025-10-02T21:02:26.251093] [WARN ] [MAIN ] PRGO: No existing data found, performing full refresh instead. [2025-10-02T21:02:26.268143] [INFO ] [MAIN ] PRG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:02:26.268332] [DEBUG] [LOCAL ] PRG: No existing data file found in primary storage. [2025-10-02T21:02:26.251253] [INFO ] [LOCAL ] PRCS: Starting deletion of primary data. [2025-10-02T21:02:26.273529] [INFO ] [MAIN ] PRGO: Wiping existing primary data before full refresh. [2025-10-02T21:02:26.279539] [DEBUG] [LOCAL ] PRCS: No primary data file found to delete. [2025-10-02T21:02:26.289569] [INFO ] [MAIN ] PRCS: Starting full primary refresh. [2025-10-02T21:02:26.300143] [INFO ] [LOCAL ] PRGO: Starting deletion of primary data. [2025-10-02T21:02:26.294870] [WARN ] [MAIN ] PRG: No existing data found, performing full refresh instead. [2025-10-02T21:02:26.311851] [DEBUG] [LOCAL ] PRGO: No primary data file found to delete. [2025-10-02T21:02:26.326852] [INFO ] [MAIN ] PRGO: Starting full primary refresh. [2025-10-02T21:02:26.365930] [INFO ] [MAIN ] PRG: Wiping existing primary data before full refresh. [2025-10-02T21:02:26.446803] [INFO ] [LOCAL ] PRG: Starting deletion of primary data. [2025-10-02T21:02:26.539348] [DEBUG] [LOCAL ] PRG: No primary data file found to delete. [2025-10-02T21:02:26.572157] [INFO ] [MAIN ] PRG: Starting full primary refresh. [2025-10-02T21:02:27.319579] [INFO ] [REMOTE ] PRA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:02:27.425846] [INFO ] [REMOTE ] PRA: Fetching primary data for 2024-12. [2025-10-02T21:02:27.645614] [INFO ] [REMOTE ] PRCS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:02:27.702599] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2024-12. [2025-10-02T21:02:27.845318] [INFO ] [REMOTE ] PRGO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:02:27.861807] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2024-12. [2025-10-02T21:02:27.939315] [INFO ] [REMOTE ] PRG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:02:27.939677] [INFO ] [REMOTE ] PRG: Fetching primary data for 2024-12. [2025-10-02T21:02:28.330927] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-02T21:02:28.331901] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-01. [2025-10-02T21:02:28.351471] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-02T21:02:28.356361] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-01. [2025-10-02T21:02:28.900412] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-02T21:02:28.901672] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-02. [2025-10-02T21:02:29.082434] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-02T21:02:29.086936] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-02. [2025-10-02T21:02:29.332845] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-02T21:02:29.341535] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-01. [2025-10-02T21:02:29.439139] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-02T21:02:29.440573] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-03. [2025-10-02T21:02:29.527327] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-02T21:02:29.537807] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-01. [2025-10-02T21:02:29.831908] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-02T21:02:29.833325] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-04. [2025-10-02T21:02:29.877405] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-02T21:02:29.881736] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-03. [2025-10-02T21:02:30.161485] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-02T21:02:30.167613] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-02. [2025-10-02T21:02:30.458127] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-02T21:02:30.673018] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-05. [2025-10-02T21:02:30.968218] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-02T21:02:31.345081] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-02T21:02:31.349025] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-02T21:02:31.473129] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-04. [2025-10-02T21:02:31.738450] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-02T21:02:32.273074] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-02. [2025-10-02T21:02:32.989709] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-02T21:02:33.073037] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-03. [2025-10-02T21:02:33.872996] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-05. [2025-10-02T21:02:34.077946] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-02T21:02:34.672956] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-06. [2025-10-02T21:02:35.302809] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-02T21:02:35.472985] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-03. [2025-10-02T21:02:35.591982] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-02T21:02:36.273054] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-07. [2025-10-02T21:02:36.842335] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-02T21:02:37.073009] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-08. [2025-10-02T21:02:37.266635] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-02T21:02:37.637991] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-02T21:02:37.873009] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-09. [2025-10-02T21:02:38.223171] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-02T21:02:38.675411] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-10. [2025-10-02T21:02:38.679302] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-03 (5.61 seconds). [2025-10-02T21:02:39.098515] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-02T21:02:39.099519] [INFO ] [REMOTE ] PRCS: Full fetch complete (3831 records). [2025-10-02T21:02:39.099680] [DEBUG] [VALIDATOR ] PRCS: Validating primary data. [2025-10-02T21:02:39.478174] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-04. [2025-10-02T21:02:39.523560] [DEBUG] [VALIDATOR ] PRCS: All expected trading days are present. [2025-10-02T21:02:39.523753] [DEBUG] [VALIDATOR ] PRCS: Primary data validation passed. [2025-10-02T21:02:39.523951] [INFO ] [MAIN ] PRCS: Fetched primary data is valid. [2025-10-02T21:02:39.524139] [DEBUG] [LOCAL ] PRCS: Saving primary data. [2025-10-02T21:02:39.524917] [DEBUG] [LOCAL ] PRCS: Trimmed 3831 records to 2760 (keeping 200 days of data) [2025-10-02T21:02:39.546392] [DEBUG] [LOCAL ] PRCS: Primary data saved (2760 records). [2025-10-02T21:02:39.546571] [INFO ] [MAIN ] PRCS: Full history saved. [2025-10-02T21:02:39.546701] [INFO ] [MAIN ] Update Progress: 1721/2370 symbols completed. PRCS took 14.1s. Estimated remaining: 1h 31m 29s. Rate: 7.1 symbols/min [2025-10-02T21:02:39.739763] [INFO ] [MAIN ] PRH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:02:39.739997] [DEBUG] [LOCAL ] PRH: No existing data file found in primary storage. [2025-10-02T21:02:39.740055] [WARN ] [MAIN ] PRH: No existing data found, performing full refresh instead. [2025-10-02T21:02:39.740185] [INFO ] [MAIN ] PRH: Wiping existing primary data before full refresh. [2025-10-02T21:02:39.740239] [INFO ] [LOCAL ] PRH: Starting deletion of primary data. [2025-10-02T21:02:39.740312] [DEBUG] [LOCAL ] PRH: No primary data file found to delete. [2025-10-02T21:02:39.740363] [INFO ] [MAIN ] PRH: Starting full primary refresh. [2025-10-02T21:02:40.142915] [INFO ] [REMOTE ] PRH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:02:40.272982] [INFO ] [REMOTE ] PRH: Fetching primary data for 2024-12. [2025-10-02T21:02:40.806608] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-02T21:02:41.073034] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-06. [2025-10-02T21:02:41.131293] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-02T21:02:41.872995] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-05. [2025-10-02T21:02:42.109382] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-02T21:02:42.673017] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-07. [2025-10-02T21:02:43.423203] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-02T21:02:43.473056] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-01. [2025-10-02T21:02:44.214225] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-02T21:02:44.283016] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-02. [2025-10-02T21:02:44.288904] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-02T21:02:45.072990] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-04. [2025-10-02T21:02:45.144920] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-02T21:02:45.873014] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-06. [2025-10-02T21:02:46.502872] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-02T21:02:46.673001] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-05. [2025-10-02T21:02:47.217589] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-02T21:02:47.473053] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-03. [2025-10-02T21:02:48.190482] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-02T21:02:48.273111] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-07. [2025-10-02T21:02:48.444957] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-02T21:02:49.073020] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-04. [2025-10-02T21:02:49.326300] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-02T21:02:49.873051] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-08. [2025-10-02T21:02:49.895756] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-02T21:02:50.673042] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-06. [2025-10-02T21:02:50.955591] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-02T21:02:51.473025] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-05. [2025-10-02T21:02:52.038072] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-02T21:02:52.262594] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-02T21:02:52.272947] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-07. [2025-10-02T21:02:53.073024] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-06. [2025-10-02T21:02:53.777306] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-02T21:02:53.873006] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-07. [2025-10-02T21:02:53.919197] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-02T21:02:54.507824] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-02T21:02:54.672992] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-08. [2025-10-02T21:02:55.336428] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-02T21:02:55.472985] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-09. [2025-10-02T21:02:55.859831] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-02T21:02:56.273003] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-09. [2025-10-02T21:02:57.073002] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-08. [2025-10-02T21:02:57.627435] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-02T21:02:57.873000] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-10. [2025-10-02T21:02:58.366102] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-02T21:02:58.672988] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-09. [2025-10-02T21:02:58.945731] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-02T21:02:58.947462] [INFO ] [REMOTE ] PRA: Full fetch complete (43813 records). [2025-10-02T21:02:58.947566] [DEBUG] [VALIDATOR ] PRA: Validating primary data. [2025-10-02T21:02:59.367436] [DEBUG] [VALIDATOR ] PRA: All expected trading days are present. [2025-10-02T21:02:59.367556] [DEBUG] [VALIDATOR ] PRA: Primary data validation passed. [2025-10-02T21:02:59.368526] [INFO ] [MAIN ] PRA: Fetched primary data is valid. [2025-10-02T21:02:59.368595] [DEBUG] [LOCAL ] PRA: Saving primary data. [2025-10-02T21:02:59.369857] [DEBUG] [LOCAL ] PRA: Trimmed 43813 records to 35308 (keeping 200 days of data) [2025-10-02T21:02:59.473244] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-08. [2025-10-02T21:02:59.616677] [DEBUG] [LOCAL ] PRA: Primary data saved (35308 records). [2025-10-02T21:02:59.616831] [INFO ] [MAIN ] PRA: Full history saved. [2025-10-02T21:02:59.616960] [INFO ] [MAIN ] Update Progress: 1722/2370 symbols completed. PRA took 34.2s. Estimated remaining: 1h 31m 25s. Rate: 7.1 symbols/min [2025-10-02T21:02:59.815895] [INFO ] [MAIN ] PRI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:02:59.816107] [DEBUG] [LOCAL ] PRI: No existing data file found in primary storage. [2025-10-02T21:02:59.816146] [WARN ] [MAIN ] PRI: No existing data found, performing full refresh instead. [2025-10-02T21:02:59.816268] [INFO ] [MAIN ] PRI: Wiping existing primary data before full refresh. [2025-10-02T21:02:59.816326] [INFO ] [LOCAL ] PRI: Starting deletion of primary data. [2025-10-02T21:02:59.816411] [DEBUG] [LOCAL ] PRI: No primary data file found to delete. [2025-10-02T21:02:59.816555] [INFO ] [MAIN ] PRI: Starting full primary refresh. [2025-10-02T21:03:00.267924] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-02T21:03:00.275699] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-10. [2025-10-02T21:03:00.312522] [INFO ] [REMOTE ] PRI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:03:00.826254] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-02T21:03:00.828228] [INFO ] [REMOTE ] PRH: Full fetch complete (7591 records). [2025-10-02T21:03:00.828356] [DEBUG] [VALIDATOR ] PRH: Validating primary data. [2025-10-02T21:03:01.082002] [INFO ] [REMOTE ] PRI: Fetching primary data for 2024-12. [2025-10-02T21:03:01.262416] [DEBUG] [VALIDATOR ] PRH: All expected trading days are present. [2025-10-02T21:03:01.262680] [DEBUG] [VALIDATOR ] PRH: Primary data validation passed. [2025-10-02T21:03:01.262933] [INFO ] [MAIN ] PRH: Fetched primary data is valid. [2025-10-02T21:03:01.263055] [DEBUG] [LOCAL ] PRH: Saving primary data. [2025-10-02T21:03:01.263761] [DEBUG] [LOCAL ] PRH: Trimmed 7591 records to 4816 (keeping 200 days of data) [2025-10-02T21:03:01.322785] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-02T21:03:01.343568] [DEBUG] [LOCAL ] PRH: Primary data saved (4816 records). [2025-10-02T21:03:01.343720] [INFO ] [MAIN ] PRH: Full history saved. [2025-10-02T21:03:01.343827] [INFO ] [MAIN ] Update Progress: 1723/2370 symbols completed. PRH took 21.8s. Estimated remaining: 1h 31m 14s. Rate: 7.1 symbols/min [2025-10-02T21:03:01.566191] [INFO ] [MAIN ] PRIM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:03:01.566398] [DEBUG] [LOCAL ] PRIM: No existing data file found in primary storage. [2025-10-02T21:03:01.566456] [WARN ] [MAIN ] PRIM: No existing data found, performing full refresh instead. [2025-10-02T21:03:01.566579] [INFO ] [MAIN ] PRIM: Wiping existing primary data before full refresh. [2025-10-02T21:03:01.566673] [INFO ] [LOCAL ] PRIM: Starting deletion of primary data. [2025-10-02T21:03:01.566747] [DEBUG] [LOCAL ] PRIM: No primary data file found to delete. [2025-10-02T21:03:01.566784] [INFO ] [MAIN ] PRIM: Starting full primary refresh. [2025-10-02T21:03:01.878227] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-10. [2025-10-02T21:03:01.999472] [INFO ] [REMOTE ] PRIM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:03:02.233812] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-02T21:03:02.673008] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-01. [2025-10-02T21:03:03.080581] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-02T21:03:03.082305] [INFO ] [REMOTE ] PRG: Full fetch complete (44347 records). [2025-10-02T21:03:03.082411] [DEBUG] [VALIDATOR ] PRG: Validating primary data. [2025-10-02T21:03:03.478295] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2024-12. [2025-10-02T21:03:03.526259] [DEBUG] [VALIDATOR ] PRG: All expected trading days are present. [2025-10-02T21:03:03.526360] [DEBUG] [VALIDATOR ] PRG: Primary data validation passed. [2025-10-02T21:03:03.527204] [INFO ] [MAIN ] PRG: Fetched primary data is valid. [2025-10-02T21:03:03.527269] [DEBUG] [LOCAL ] PRG: Saving primary data. [2025-10-02T21:03:03.529850] [DEBUG] [LOCAL ] PRG: Trimmed 44347 records to 30059 (keeping 200 days of data) [2025-10-02T21:03:03.749133] [DEBUG] [LOCAL ] PRG: Primary data saved (30059 records). [2025-10-02T21:03:03.749280] [INFO ] [MAIN ] PRG: Full history saved. [2025-10-02T21:03:03.749478] [INFO ] [MAIN ] Update Progress: 1724/2370 symbols completed. PRG took 38.3s. Estimated remaining: 1h 31m 3s. Rate: 7.1 symbols/min [2025-10-02T21:03:03.875818] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-02T21:03:03.956301] [INFO ] [MAIN ] PRKS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:03:03.956488] [DEBUG] [LOCAL ] PRKS: No existing data file found in primary storage. [2025-10-02T21:03:03.956528] [WARN ] [MAIN ] PRKS: No existing data found, performing full refresh instead. [2025-10-02T21:03:03.956668] [INFO ] [MAIN ] PRKS: Wiping existing primary data before full refresh. [2025-10-02T21:03:03.956726] [INFO ] [LOCAL ] PRKS: Starting deletion of primary data. [2025-10-02T21:03:03.956773] [DEBUG] [LOCAL ] PRKS: No primary data file found to delete. [2025-10-02T21:03:03.956808] [INFO ] [MAIN ] PRKS: Starting full primary refresh. [2025-10-02T21:03:04.274147] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-02. [2025-10-02T21:03:04.367777] [INFO ] [REMOTE ] PRKS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:03:04.840345] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-02T21:03:05.072983] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-01. [2025-10-02T21:03:05.164476] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-02T21:03:05.872978] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-09. [2025-10-02T21:03:05.974013] [DEBUG] [REMOTE ] PRGO: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-10-02T21:03:05.974355] [WARN ] [REMOTE ] PRGO: No data returned for month 2025-09 [2025-10-02T21:03:05.974452] [FATAL] [REMOTE ] PRGO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T21:03:05.974537] [FATAL] [MAIN ] PRGO: Failed to fetch primary data. [2025-10-02T21:03:05.974602] [WARN ] [MAIN ] PRGO: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T21:03:05.974707] [INFO ] [LOCAL ] PRGO: Starting deletion of primary data. [2025-10-02T21:03:05.974808] [DEBUG] [LOCAL ] PRGO: No primary data file found to delete. [2025-10-02T21:03:05.974868] [INFO ] [LOCAL ] PRGO: Starting deletion of derivative data. [2025-10-02T21:03:05.974918] [DEBUG] [LOCAL ] PRGO: No derivative data file found to delete. [2025-10-02T21:03:05.974968] [INFO ] [MAIN ] Update Progress: 1725/2370 symbols completed. PRGO took 40.5s. Estimated remaining: 1h 30m 52s. Rate: 7.1 symbols/min [2025-10-02T21:03:06.179525] [INFO ] [MAIN ] PRLB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:03:06.179941] [DEBUG] [LOCAL ] PRLB: No existing data file found in primary storage. [2025-10-02T21:03:06.179989] [WARN ] [MAIN ] PRLB: No existing data found, performing full refresh instead. [2025-10-02T21:03:06.180189] [INFO ] [MAIN ] PRLB: Wiping existing primary data before full refresh. [2025-10-02T21:03:06.180249] [INFO ] [LOCAL ] PRLB: Starting deletion of primary data. [2025-10-02T21:03:06.180295] [DEBUG] [LOCAL ] PRLB: No primary data file found to delete. [2025-10-02T21:03:06.180329] [INFO ] [MAIN ] PRLB: Starting full primary refresh. [2025-10-02T21:03:06.605161] [INFO ] [REMOTE ] PRLB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:03:06.673018] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-03. [2025-10-02T21:03:06.724502] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-02T21:03:07.472995] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2024-12. [2025-10-02T21:03:07.793744] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-02T21:03:08.273135] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-02. [2025-10-02T21:03:08.779601] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-02T21:03:09.073056] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-04. [2025-10-02T21:03:09.872986] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2024-12. [2025-10-02T21:03:09.956230] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-02T21:03:09.988695] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-02T21:03:10.673091] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-03. [2025-10-02T21:03:10.841451] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-02T21:03:11.473025] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-05. [2025-10-02T21:03:12.276059] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-01. [2025-10-02T21:03:12.296254] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-02T21:03:12.343612] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-02T21:03:13.073011] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-06. [2025-10-02T21:03:13.868160] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-02T21:03:13.876242] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-04. [2025-10-02T21:03:13.924878] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-02T21:03:14.673030] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-02. [2025-10-02T21:03:15.473051] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-01. [2025-10-02T21:03:15.626254] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-02T21:03:16.233586] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-02T21:03:16.273001] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-05. [2025-10-02T21:03:16.474778] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-02T21:03:17.073058] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-07. [2025-10-02T21:03:17.873056] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-02. [2025-10-02T21:03:18.212761] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-02T21:03:18.259511] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-02T21:03:18.673053] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-08. [2025-10-02T21:03:19.265026] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-02T21:03:19.473047] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-03. [2025-10-02T21:03:19.776448] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-02T21:03:20.273052] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-06. [2025-10-02T21:03:21.073015] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-03. [2025-10-02T21:03:21.164292] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-02T21:03:21.873060] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-04. [2025-10-02T21:03:21.942859] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-02T21:03:22.107627] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-02T21:03:22.673032] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-04. [2025-10-02T21:03:23.200259] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-02T21:03:23.473057] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-07. [2025-10-02T21:03:23.960758] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-02T21:03:24.273009] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-09. [2025-10-02T21:03:25.073040] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-05. [2025-10-02T21:03:25.295553] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-02T21:03:25.382063] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-02T21:03:25.872999] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-05. [2025-10-02T21:03:26.673003] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-08. [2025-10-02T21:03:26.771131] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-02T21:03:27.037781] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-02T21:03:27.473056] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-06. [2025-10-02T21:03:28.273017] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-10. [2025-10-02T21:03:28.467364] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-02T21:03:28.698073] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-02T21:03:29.073023] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-09. [2025-10-02T21:03:29.873031] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-07. [2025-10-02T21:03:29.934964] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-02T21:03:29.936212] [INFO ] [REMOTE ] PRI: Full fetch complete (25741 records). [2025-10-02T21:03:29.936290] [DEBUG] [VALIDATOR ] PRI: Validating primary data. [2025-10-02T21:03:30.356631] [DEBUG] [VALIDATOR ] PRI: All expected trading days are present. [2025-10-02T21:03:30.357021] [DEBUG] [VALIDATOR ] PRI: Primary data validation passed. [2025-10-02T21:03:30.357673] [INFO ] [MAIN ] PRI: Fetched primary data is valid. [2025-10-02T21:03:30.357741] [DEBUG] [LOCAL ] PRI: Saving primary data. [2025-10-02T21:03:30.358526] [DEBUG] [LOCAL ] PRI: Trimmed 25741 records to 18394 (keeping 200 days of data) [2025-10-02T21:03:30.487878] [DEBUG] [LOCAL ] PRI: Primary data saved (18394 records). [2025-10-02T21:03:30.488033] [INFO ] [MAIN ] PRI: Full history saved. [2025-10-02T21:03:30.488149] [INFO ] [MAIN ] Update Progress: 1726/2370 symbols completed. PRI took 30.9s. Estimated remaining: 1h 30m 50s. Rate: 7.1 symbols/min [2025-10-02T21:03:30.673940] [INFO ] [MAIN ] PRM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:03:30.674356] [DEBUG] [LOCAL ] PRM: No existing data file found in primary storage. [2025-10-02T21:03:30.674045] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-06. [2025-10-02T21:03:30.675389] [WARN ] [MAIN ] PRM: No existing data found, performing full refresh instead. [2025-10-02T21:03:30.675570] [INFO ] [MAIN ] PRM: Wiping existing primary data before full refresh. [2025-10-02T21:03:30.675615] [INFO ] [LOCAL ] PRM: Starting deletion of primary data. [2025-10-02T21:03:30.675697] [DEBUG] [LOCAL ] PRM: No primary data file found to delete. [2025-10-02T21:03:30.675748] [INFO ] [MAIN ] PRM: Starting full primary refresh. [2025-10-02T21:03:31.076770] [INFO ] [REMOTE ] PRM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:03:31.163795] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-02T21:03:31.472974] [INFO ] [REMOTE ] PRM: Fetching primary data for 2024-12. [2025-10-02T21:03:31.752295] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-09 (2.68 seconds). [2025-10-02T21:03:32.272971] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-10. [2025-10-02T21:03:32.357856] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-02T21:03:33.081610] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-07. [2025-10-02T21:03:33.096163] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-02T21:03:33.475896] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-02T21:03:33.478339] [INFO ] [REMOTE ] PRIM: Full fetch complete (63483 records). [2025-10-02T21:03:33.478445] [DEBUG] [VALIDATOR ] PRIM: Validating primary data. [2025-10-02T21:03:33.880413] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-01. [2025-10-02T21:03:33.938033] [DEBUG] [VALIDATOR ] PRIM: All expected trading days are present. [2025-10-02T21:03:33.938158] [DEBUG] [VALIDATOR ] PRIM: Primary data validation passed. [2025-10-02T21:03:33.939302] [INFO ] [MAIN ] PRIM: Fetched primary data is valid. [2025-10-02T21:03:33.939372] [DEBUG] [LOCAL ] PRIM: Saving primary data. [2025-10-02T21:03:33.941347] [DEBUG] [LOCAL ] PRIM: Trimmed 63483 records to 44670 (keeping 200 days of data) [2025-10-02T21:03:34.266873] [DEBUG] [LOCAL ] PRIM: Primary data saved (44670 records). [2025-10-02T21:03:34.267016] [INFO ] [MAIN ] PRIM: Full history saved. [2025-10-02T21:03:34.267093] [INFO ] [MAIN ] Update Progress: 1727/2370 symbols completed. PRIM took 32.9s. Estimated remaining: 1h 30m 40s. Rate: 7.1 symbols/min [2025-10-02T21:03:34.470316] [INFO ] [MAIN ] PRMB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:03:34.470618] [DEBUG] [LOCAL ] PRMB: No existing data file found in primary storage. [2025-10-02T21:03:34.470888] [WARN ] [MAIN ] PRMB: No existing data found, performing full refresh instead. [2025-10-02T21:03:34.471066] [INFO ] [MAIN ] PRMB: Wiping existing primary data before full refresh. [2025-10-02T21:03:34.471114] [INFO ] [LOCAL ] PRMB: Starting deletion of primary data. [2025-10-02T21:03:34.471160] [DEBUG] [LOCAL ] PRMB: No primary data file found to delete. [2025-10-02T21:03:34.471195] [INFO ] [MAIN ] PRMB: Starting full primary refresh. [2025-10-02T21:03:34.768116] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-08. [2025-10-02T21:03:34.877589] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-02T21:03:35.030734] [INFO ] [REMOTE ] PRMB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:03:35.473032] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-08. [2025-10-02T21:03:35.543585] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-02T21:03:36.084880] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-02T21:03:36.273006] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-02. [2025-10-02T21:03:37.072992] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-09. [2025-10-02T21:03:37.109788] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-02T21:03:37.846834] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-02T21:03:37.872989] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-03. [2025-10-02T21:03:38.026040] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-02T21:03:38.673019] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-09. [2025-10-02T21:03:39.473067] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-10. [2025-10-02T21:03:39.608780] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-02T21:03:40.147147] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-02T21:03:40.148472] [INFO ] [REMOTE ] PRLB: Full fetch complete (30611 records). [2025-10-02T21:03:40.148555] [DEBUG] [VALIDATOR ] PRLB: Validating primary data. [2025-10-02T21:03:40.275375] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2024-12. [2025-10-02T21:03:40.602246] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-02T21:03:40.624583] [DEBUG] [VALIDATOR ] PRLB: All expected trading days are present. [2025-10-02T21:03:40.625145] [DEBUG] [VALIDATOR ] PRLB: Primary data validation passed. [2025-10-02T21:03:40.626111] [INFO ] [MAIN ] PRLB: Fetched primary data is valid. [2025-10-02T21:03:40.626228] [DEBUG] [LOCAL ] PRLB: Saving primary data. [2025-10-02T21:03:40.627465] [DEBUG] [LOCAL ] PRLB: Trimmed 30611 records to 20555 (keeping 200 days of data) [2025-10-02T21:03:40.766359] [DEBUG] [LOCAL ] PRLB: Primary data saved (20555 records). [2025-10-02T21:03:40.766489] [INFO ] [MAIN ] PRLB: Full history saved. [2025-10-02T21:03:40.766561] [INFO ] [MAIN ] Update Progress: 1728/2370 symbols completed. PRLB took 34.8s. Estimated remaining: 1h 30m 31s. Rate: 7.1 symbols/min [2025-10-02T21:03:40.956104] [INFO ] [MAIN ] PRO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:03:40.956316] [DEBUG] [LOCAL ] PRO: No existing data file found in primary storage. [2025-10-02T21:03:40.956374] [WARN ] [MAIN ] PRO: No existing data found, performing full refresh instead. [2025-10-02T21:03:40.956513] [INFO ] [MAIN ] PRO: Wiping existing primary data before full refresh. [2025-10-02T21:03:40.956577] [INFO ] [LOCAL ] PRO: Starting deletion of primary data. [2025-10-02T21:03:40.956627] [DEBUG] [LOCAL ] PRO: No primary data file found to delete. [2025-10-02T21:03:40.956706] [INFO ] [MAIN ] PRO: Starting full primary refresh. [2025-10-02T21:03:41.078146] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-04. [2025-10-02T21:03:41.380228] [INFO ] [REMOTE ] PRO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:03:41.820803] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-02T21:03:41.873021] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-10. [2025-10-02T21:03:42.673014] [INFO ] [REMOTE ] PRO: Fetching primary data for 2024-12. [2025-10-02T21:03:43.053681] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-02T21:03:43.179291] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-02T21:03:43.182873] [INFO ] [REMOTE ] PRKS: Full fetch complete (61398 records). [2025-10-02T21:03:43.183040] [DEBUG] [VALIDATOR ] PRKS: Validating primary data. [2025-10-02T21:03:43.484761] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-05. [2025-10-02T21:03:43.631470] [DEBUG] [VALIDATOR ] PRKS: All expected trading days are present. [2025-10-02T21:03:43.631584] [DEBUG] [VALIDATOR ] PRKS: Primary data validation passed. [2025-10-02T21:03:43.632550] [INFO ] [MAIN ] PRKS: Fetched primary data is valid. [2025-10-02T21:03:43.632615] [DEBUG] [LOCAL ] PRKS: Saving primary data. [2025-10-02T21:03:43.634778] [DEBUG] [LOCAL ] PRKS: Trimmed 61398 records to 42824 (keeping 200 days of data) [2025-10-02T21:03:43.907010] [DEBUG] [LOCAL ] PRKS: Primary data saved (42824 records). [2025-10-02T21:03:43.907148] [INFO ] [MAIN ] PRKS: Full history saved. [2025-10-02T21:03:43.907225] [INFO ] [MAIN ] Update Progress: 1729/2370 symbols completed. PRKS took 40.2s. Estimated remaining: 1h 30m 20s. Rate: 7.1 symbols/min [2025-10-02T21:03:44.109700] [INFO ] [MAIN ] PRSU: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:03:44.122676] [DEBUG] [LOCAL ] PRSU: No existing data file found in primary storage. [2025-10-02T21:03:44.123216] [WARN ] [MAIN ] PRSU: No existing data found, performing full refresh instead. [2025-10-02T21:03:44.124304] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-02T21:03:44.124466] [INFO ] [MAIN ] PRSU: Wiping existing primary data before full refresh. [2025-10-02T21:03:44.124697] [INFO ] [LOCAL ] PRSU: Starting deletion of primary data. [2025-10-02T21:03:44.131268] [DEBUG] [LOCAL ] PRSU: No primary data file found to delete. [2025-10-02T21:03:44.132130] [INFO ] [MAIN ] PRSU: Starting full primary refresh. [2025-10-02T21:03:44.278152] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-01. [2025-10-02T21:03:44.549418] [INFO ] [REMOTE ] PRSU: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:03:45.073010] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2024-12. [2025-10-02T21:03:45.152701] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-02T21:03:45.373440] [DEBUG] [REMOTE ] PRSU: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T21:03:45.374022] [WARN ] [REMOTE ] PRSU: No data returned for month 2024-12 [2025-10-02T21:03:45.374134] [FATAL] [REMOTE ] PRSU: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T21:03:45.374209] [FATAL] [MAIN ] PRSU: Failed to fetch primary data. [2025-10-02T21:03:45.374278] [WARN ] [MAIN ] PRSU: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T21:03:45.374350] [INFO ] [LOCAL ] PRSU: Starting deletion of primary data. [2025-10-02T21:03:45.374418] [DEBUG] [LOCAL ] PRSU: No primary data file found to delete. [2025-10-02T21:03:45.374457] [INFO ] [LOCAL ] PRSU: Starting deletion of derivative data. [2025-10-02T21:03:45.374499] [DEBUG] [LOCAL ] PRSU: No derivative data file found to delete. [2025-10-02T21:03:45.374547] [INFO ] [MAIN ] Update Progress: 1730/2370 symbols completed. PRSU took 1.5s. Estimated remaining: 1h 30m 9s. Rate: 7.1 symbols/min [2025-10-02T21:03:45.565067] [INFO ] [MAIN ] PRT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:03:45.565271] [DEBUG] [LOCAL ] PRT: No existing data file found in primary storage. [2025-10-02T21:03:45.565324] [WARN ] [MAIN ] PRT: No existing data found, performing full refresh instead. [2025-10-02T21:03:45.565437] [INFO ] [MAIN ] PRT: Wiping existing primary data before full refresh. [2025-10-02T21:03:45.565480] [INFO ] [LOCAL ] PRT: Starting deletion of primary data. [2025-10-02T21:03:45.565523] [DEBUG] [LOCAL ] PRT: No primary data file found to delete. [2025-10-02T21:03:45.565557] [INFO ] [MAIN ] PRT: Starting full primary refresh. [2025-10-02T21:03:45.878130] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-01. [2025-10-02T21:03:46.010180] [INFO ] [REMOTE ] PRT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:03:46.226115] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-02T21:03:46.673006] [INFO ] [REMOTE ] PRT: Fetching primary data for 2024-12. [2025-10-02T21:03:47.266275] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-02T21:03:47.473000] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-02. [2025-10-02T21:03:47.514197] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-02T21:03:48.273040] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-01. [2025-10-02T21:03:48.801822] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-02T21:03:49.073013] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-02. [2025-10-02T21:03:49.191305] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-02T21:03:49.873033] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-02. [2025-10-02T21:03:50.472617] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-02T21:03:50.673007] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-03. [2025-10-02T21:03:50.830434] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-02T21:03:51.473001] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-03. [2025-10-02T21:03:52.096202] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-02T21:03:52.273058] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-03. [2025-10-02T21:03:52.900690] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-02T21:03:53.073007] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-04. [2025-10-02T21:03:53.333062] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-02T21:03:53.873009] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-04. [2025-10-02T21:03:54.673011] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-06. [2025-10-02T21:03:54.736422] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-02T21:03:54.765325] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-02T21:03:55.473005] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-05. [2025-10-02T21:03:55.949570] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-02T21:03:56.273161] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-07. [2025-10-02T21:03:57.002936] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-02T21:03:57.073011] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-05. [2025-10-02T21:03:57.572083] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-02T21:03:57.830023] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-02T21:03:57.873007] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-06. [2025-10-02T21:03:58.546326] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-02T21:03:58.673064] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-08. [2025-10-02T21:03:59.473041] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-06. [2025-10-02T21:04:00.273041] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-04. [2025-10-02T21:04:00.355195] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-02T21:04:01.073021] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-09. [2025-10-02T21:04:01.159060] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-02T21:04:01.873015] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-07. [2025-10-02T21:04:02.139260] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-02T21:04:02.673069] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-05. [2025-10-02T21:04:02.840585] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-02T21:04:03.478111] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-10. [2025-10-02T21:04:03.500843] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-02T21:04:04.105148] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-02T21:04:04.273003] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-08. [2025-10-02T21:04:04.644254] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-02T21:04:04.647144] [INFO ] [REMOTE ] PRM: Full fetch complete (64478 records). [2025-10-02T21:04:04.647319] [DEBUG] [VALIDATOR ] PRM: Validating primary data. [2025-10-02T21:04:05.073334] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-06. [2025-10-02T21:04:05.178172] [DEBUG] [VALIDATOR ] PRM: All expected trading days are present. [2025-10-02T21:04:05.178311] [DEBUG] [VALIDATOR ] PRM: Primary data validation passed. [2025-10-02T21:04:05.179438] [INFO ] [MAIN ] PRM: Fetched primary data is valid. [2025-10-02T21:04:05.179504] [DEBUG] [LOCAL ] PRM: Saving primary data. [2025-10-02T21:04:05.181052] [DEBUG] [LOCAL ] PRM: Trimmed 64478 records to 45005 (keeping 200 days of data) [2025-10-02T21:04:05.475275] [DEBUG] [LOCAL ] PRM: Primary data saved (45005 records). [2025-10-02T21:04:05.475438] [INFO ] [MAIN ] PRM: Full history saved. [2025-10-02T21:04:05.475515] [INFO ] [MAIN ] Update Progress: 1731/2370 symbols completed. PRM took 35.0s. Estimated remaining: 1h 30m 5s. Rate: 7.1 symbols/min [2025-10-02T21:04:05.665029] [INFO ] [MAIN ] PRU: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:04:05.665198] [DEBUG] [LOCAL ] PRU: No existing data file found in primary storage. [2025-10-02T21:04:05.665238] [WARN ] [MAIN ] PRU: No existing data found, performing full refresh instead. [2025-10-02T21:04:05.665375] [INFO ] [MAIN ] PRU: Wiping existing primary data before full refresh. [2025-10-02T21:04:05.665416] [INFO ] [LOCAL ] PRU: Starting deletion of primary data. [2025-10-02T21:04:05.665465] [DEBUG] [LOCAL ] PRU: No primary data file found to delete. [2025-10-02T21:04:05.665502] [INFO ] [MAIN ] PRU: Starting full primary refresh. [2025-10-02T21:04:05.888005] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-07. [2025-10-02T21:04:06.129505] [INFO ] [REMOTE ] PRU: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:04:06.248124] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-02T21:04:06.642017] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-02T21:04:06.660006] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-02T21:04:06.672963] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-08. [2025-10-02T21:04:06.781596] [DEBUG] [REMOTE ] PRT: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-10-02T21:04:06.781960] [WARN ] [REMOTE ] PRT: No data returned for month 2025-08 [2025-10-02T21:04:06.782082] [FATAL] [REMOTE ] PRT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T21:04:06.782194] [FATAL] [MAIN ] PRT: Failed to fetch primary data. [2025-10-02T21:04:06.782264] [WARN ] [MAIN ] PRT: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T21:04:06.782345] [INFO ] [LOCAL ] PRT: Starting deletion of primary data. [2025-10-02T21:04:06.782413] [DEBUG] [LOCAL ] PRT: No primary data file found to delete. [2025-10-02T21:04:06.782452] [INFO ] [LOCAL ] PRT: Starting deletion of derivative data. [2025-10-02T21:04:06.782494] [DEBUG] [LOCAL ] PRT: No derivative data file found to delete. [2025-10-02T21:04:06.782543] [INFO ] [MAIN ] Update Progress: 1732/2370 symbols completed. PRT took 21.4s. Estimated remaining: 1h 29m 54s. Rate: 7.1 symbols/min [2025-10-02T21:04:06.967320] [INFO ] [MAIN ] PRVS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:04:06.967567] [DEBUG] [LOCAL ] PRVS: No existing data file found in primary storage. [2025-10-02T21:04:06.967629] [WARN ] [MAIN ] PRVS: No existing data found, performing full refresh instead. [2025-10-02T21:04:06.967766] [INFO ] [MAIN ] PRVS: Wiping existing primary data before full refresh. [2025-10-02T21:04:06.967812] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-10-02T21:04:06.967857] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-10-02T21:04:06.967892] [INFO ] [MAIN ] PRVS: Starting full primary refresh. [2025-10-02T21:04:07.365202] [INFO ] [REMOTE ] PRVS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:04:07.473019] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-09. [2025-10-02T21:04:08.272996] [INFO ] [REMOTE ] PRU: Fetching primary data for 2024-12. [2025-10-02T21:04:09.073042] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2024-12. [2025-10-02T21:04:09.112563] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-02T21:04:09.242217] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-02T21:04:09.434809] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-10-02T21:04:09.873005] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-01. [2025-10-02T21:04:10.391386] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-02T21:04:10.673020] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-02. [2025-10-02T21:04:11.149220] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-02T21:04:11.473048] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-01. [2025-10-02T21:04:12.272988] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-07. [2025-10-02T21:04:12.311305] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-02T21:04:13.073058] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-03. [2025-10-02T21:04:13.447907] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-02T21:04:13.873034] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-04. [2025-10-02T21:04:14.183489] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-02T21:04:14.235219] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-02T21:04:14.673037] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-08. [2025-10-02T21:04:15.473052] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-10. [2025-10-02T21:04:16.264042] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-02T21:04:16.276976] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-05. [2025-10-02T21:04:16.843225] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-02T21:04:16.845167] [INFO ] [REMOTE ] PRO: Full fetch complete (52186 records). [2025-10-02T21:04:16.845309] [DEBUG] [VALIDATOR ] PRO: Validating primary data. [2025-10-02T21:04:17.076919] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-02. [2025-10-02T21:04:17.108003] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-02T21:04:17.319285] [DEBUG] [VALIDATOR ] PRO: All expected trading days are present. [2025-10-02T21:04:17.319401] [DEBUG] [VALIDATOR ] PRO: Primary data validation passed. [2025-10-02T21:04:17.320477] [INFO ] [MAIN ] PRO: Fetched primary data is valid. [2025-10-02T21:04:17.320552] [DEBUG] [LOCAL ] PRO: Saving primary data. [2025-10-02T21:04:17.321878] [DEBUG] [LOCAL ] PRO: Trimmed 52186 records to 38650 (keeping 200 days of data) [2025-10-02T21:04:17.577581] [DEBUG] [LOCAL ] PRO: Primary data saved (38650 records). [2025-10-02T21:04:17.577771] [INFO ] [MAIN ] PRO: Full history saved. [2025-10-02T21:04:17.577897] [INFO ] [MAIN ] Update Progress: 1733/2370 symbols completed. PRO took 36.8s. Estimated remaining: 1h 29m 46s. Rate: 7.1 symbols/min [2025-10-02T21:04:17.784285] [INFO ] [MAIN ] PSA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:04:17.784863] [DEBUG] [LOCAL ] PSA: No existing data file found in primary storage. [2025-10-02T21:04:17.784921] [WARN ] [MAIN ] PSA: No existing data found, performing full refresh instead. [2025-10-02T21:04:17.785038] [INFO ] [MAIN ] PSA: Wiping existing primary data before full refresh. [2025-10-02T21:04:17.785084] [INFO ] [LOCAL ] PSA: Starting deletion of primary data. [2025-10-02T21:04:17.785128] [DEBUG] [LOCAL ] PSA: No primary data file found to delete. [2025-10-02T21:04:17.785173] [INFO ] [MAIN ] PSA: Starting full primary refresh. [2025-10-02T21:04:17.877967] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-09. [2025-10-02T21:04:18.204903] [INFO ] [REMOTE ] PSA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:04:18.234082] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-02T21:04:18.673013] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-03. [2025-10-02T21:04:19.389294] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-02T21:04:19.473003] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-06. [2025-10-02T21:04:19.905998] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-02T21:04:20.041273] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-02T21:04:20.273041] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-04. [2025-10-02T21:04:20.679218] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-02T21:04:21.073015] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-05. [2025-10-02T21:04:21.883559] [INFO ] [REMOTE ] PSA: Fetching primary data for 2024-12. [2025-10-02T21:04:21.890799] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-02T21:04:22.566417] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-02T21:04:22.673042] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-01. [2025-10-02T21:04:23.001257] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-02T21:04:23.473025] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-02. [2025-10-02T21:04:24.273040] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-10. [2025-10-02T21:04:24.392725] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-02T21:04:25.073053] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-07. [2025-10-02T21:04:25.494169] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-02T21:04:25.688561] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-02T21:04:25.692982] [INFO ] [REMOTE ] PRMB: Full fetch complete (76059 records). [2025-10-02T21:04:25.693130] [DEBUG] [VALIDATOR ] PRMB: Validating primary data. [2025-10-02T21:04:25.877635] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-03. [2025-10-02T21:04:26.239478] [DEBUG] [VALIDATOR ] PRMB: All expected trading days are present. [2025-10-02T21:04:26.239611] [DEBUG] [VALIDATOR ] PRMB: Primary data validation passed. [2025-10-02T21:04:26.241276] [INFO ] [MAIN ] PRMB: Fetched primary data is valid. [2025-10-02T21:04:26.241382] [DEBUG] [LOCAL ] PRMB: Saving primary data. [2025-10-02T21:04:26.243375] [DEBUG] [LOCAL ] PRMB: Trimmed 76059 records to 53528 (keeping 200 days of data) [2025-10-02T21:04:26.684349] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-06. [2025-10-02T21:04:26.765594] [DEBUG] [LOCAL ] PRMB: Primary data saved (53528 records). [2025-10-02T21:04:26.765970] [INFO ] [MAIN ] PRMB: Full history saved. [2025-10-02T21:04:26.766080] [INFO ] [MAIN ] Update Progress: 1734/2370 symbols completed. PRMB took 52.5s. Estimated remaining: 1h 29m 38s. Rate: 7.1 symbols/min [2025-10-02T21:04:27.016164] [INFO ] [MAIN ] PSBD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:04:27.016535] [DEBUG] [LOCAL ] PSBD: No existing data file found in primary storage. [2025-10-02T21:04:27.016606] [WARN ] [MAIN ] PSBD: No existing data found, performing full refresh instead. [2025-10-02T21:04:27.016795] [INFO ] [MAIN ] PSBD: Wiping existing primary data before full refresh. [2025-10-02T21:04:27.016861] [INFO ] [LOCAL ] PSBD: Starting deletion of primary data. [2025-10-02T21:04:27.017063] [DEBUG] [LOCAL ] PSBD: No primary data file found to delete. [2025-10-02T21:04:27.017262] [INFO ] [MAIN ] PSBD: Starting full primary refresh. [2025-10-02T21:04:27.184962] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-02T21:04:27.478190] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-04. [2025-10-02T21:04:27.545016] [INFO ] [REMOTE ] PSBD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:04:27.724926] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-02T21:04:28.272963] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2024-12. [2025-10-02T21:04:28.780732] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-02T21:04:28.926882] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-02T21:04:29.072978] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-05. [2025-10-02T21:04:29.873029] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-01. [2025-10-02T21:04:30.325189] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-02T21:04:30.673032] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-08. [2025-10-02T21:04:30.693458] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-02T21:04:31.133753] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-02T21:04:31.473024] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-06. [2025-10-02T21:04:31.905161] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-02T21:04:32.273010] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-09. [2025-10-02T21:04:32.705016] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-02T21:04:33.073018] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-07. [2025-10-02T21:04:33.600078] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-02T21:04:33.873032] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-10. [2025-10-02T21:04:34.236363] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-02T21:04:34.237423] [INFO ] [REMOTE ] PRVS: Full fetch complete (1277 records). [2025-10-02T21:04:34.237529] [DEBUG] [VALIDATOR ] PRVS: Validating primary data. [2025-10-02T21:04:34.483354] [WARN ] [VALIDATOR ] PRVS: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-10-02T21:04:34.483540] [FATAL] [MAIN ] PRVS: Fetched primary data is invalid. Refusing to save it. [2025-10-02T21:04:34.483587] [WARN ] [MAIN ] PRVS: Deleting existing primary and derivative data due to validation failure. [2025-10-02T21:04:34.483682] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-10-02T21:04:34.483781] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-10-02T21:04:34.483839] [INFO ] [LOCAL ] PRVS: Starting deletion of derivative data. [2025-10-02T21:04:34.483902] [DEBUG] [LOCAL ] PRVS: No derivative data file found to delete. [2025-10-02T21:04:34.483998] [INFO ] [MAIN ] Update Progress: 1735/2370 symbols completed. PRVS took 27.7s. Estimated remaining: 1h 29m 29s. Rate: 7.1 symbols/min [2025-10-02T21:04:34.669550] [INFO ] [MAIN ] PSF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:04:34.669811] [DEBUG] [LOCAL ] PSF: No existing data file found in primary storage. [2025-10-02T21:04:34.669857] [WARN ] [MAIN ] PSF: No existing data found, performing full refresh instead. [2025-10-02T21:04:34.669975] [INFO ] [MAIN ] PSF: Wiping existing primary data before full refresh. [2025-10-02T21:04:34.670018] [INFO ] [LOCAL ] PSF: Starting deletion of primary data. [2025-10-02T21:04:34.670062] [DEBUG] [LOCAL ] PSF: No primary data file found to delete. [2025-10-02T21:04:34.670095] [INFO ] [MAIN ] PSF: Starting full primary refresh. [2025-10-02T21:04:34.681982] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-07. [2025-10-02T21:04:35.061119] [INFO ] [REMOTE ] PSF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:04:35.473002] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-08. [2025-10-02T21:04:35.735602] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-02T21:04:36.273018] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-02. [2025-10-02T21:04:36.310738] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-02T21:04:36.933050] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-02T21:04:37.073046] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-03. [2025-10-02T21:04:37.739469] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-02T21:04:37.872995] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-09. [2025-10-02T21:04:38.673002] [INFO ] [REMOTE ] PSF: Fetching primary data for 2024-12. [2025-10-02T21:04:38.908962] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-02T21:04:39.183345] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-02T21:04:39.472996] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-01. [2025-10-02T21:04:40.233727] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-02T21:04:40.273002] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-04. [2025-10-02T21:04:41.072975] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-10. [2025-10-02T21:04:41.106146] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-02T21:04:41.873000] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-05. [2025-10-02T21:04:42.390753] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-02T21:04:42.392500] [INFO ] [REMOTE ] PSA: Full fetch complete (59301 records). [2025-10-02T21:04:42.392614] [DEBUG] [VALIDATOR ] PSA: Validating primary data. [2025-10-02T21:04:42.683361] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-02. [2025-10-02T21:04:42.734606] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-02T21:04:42.820394] [DEBUG] [VALIDATOR ] PSA: All expected trading days are present. [2025-10-02T21:04:42.820500] [DEBUG] [VALIDATOR ] PSA: Primary data validation passed. [2025-10-02T21:04:42.821548] [INFO ] [MAIN ] PSA: Fetched primary data is valid. [2025-10-02T21:04:42.821615] [DEBUG] [LOCAL ] PSA: Saving primary data. [2025-10-02T21:04:42.822943] [DEBUG] [LOCAL ] PSA: Trimmed 59301 records to 42042 (keeping 200 days of data) [2025-10-02T21:04:43.095170] [DEBUG] [LOCAL ] PSA: Primary data saved (42042 records). [2025-10-02T21:04:43.095302] [INFO ] [MAIN ] PSA: Full history saved. [2025-10-02T21:04:43.095377] [INFO ] [MAIN ] Update Progress: 1736/2370 symbols completed. PSA took 25.5s. Estimated remaining: 1h 29m 21s. Rate: 7.1 symbols/min [2025-10-02T21:04:43.280044] [INFO ] [MAIN ] PSFE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:04:43.280254] [DEBUG] [LOCAL ] PSFE: No existing data file found in primary storage. [2025-10-02T21:04:43.280299] [WARN ] [MAIN ] PSFE: No existing data found, performing full refresh instead. [2025-10-02T21:04:43.280420] [INFO ] [MAIN ] PSFE: Wiping existing primary data before full refresh. [2025-10-02T21:04:43.280465] [INFO ] [LOCAL ] PSFE: Starting deletion of primary data. [2025-10-02T21:04:43.280537] [DEBUG] [LOCAL ] PSFE: No primary data file found to delete. [2025-10-02T21:04:43.280608] [INFO ] [MAIN ] PSFE: Starting full primary refresh. [2025-10-02T21:04:43.458735] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-02T21:04:43.474673] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-08. [2025-10-02T21:04:43.677970] [INFO ] [REMOTE ] PSFE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:04:44.272974] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2024-12. [2025-10-02T21:04:44.616077] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-02T21:04:45.072998] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-06. [2025-10-02T21:04:45.713968] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-02T21:04:45.873010] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-03. [2025-10-02T21:04:45.936287] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-02T21:04:46.576324] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-02T21:04:46.673001] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-01. [2025-10-02T21:04:47.472964] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-09. [2025-10-02T21:04:47.569253] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-02T21:04:48.252520] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-02T21:04:48.272969] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-10. [2025-10-02T21:04:49.072992] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-04. [2025-10-02T21:04:49.748049] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-02T21:04:49.750425] [INFO ] [REMOTE ] PRU: Full fetch complete (74222 records). [2025-10-02T21:04:49.750532] [DEBUG] [VALIDATOR ] PRU: Validating primary data. [2025-10-02T21:04:49.872983] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-07. [2025-10-02T21:04:49.892688] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-02T21:04:50.218445] [DEBUG] [VALIDATOR ] PRU: All expected trading days are present. [2025-10-02T21:04:50.218550] [DEBUG] [VALIDATOR ] PRU: Primary data validation passed. [2025-10-02T21:04:50.219769] [INFO ] [MAIN ] PRU: Fetched primary data is valid. [2025-10-02T21:04:50.219843] [DEBUG] [LOCAL ] PRU: Saving primary data. [2025-10-02T21:04:50.221703] [DEBUG] [LOCAL ] PRU: Trimmed 74222 records to 51747 (keeping 200 days of data) [2025-10-02T21:04:50.472855] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-02T21:04:50.576632] [DEBUG] [LOCAL ] PRU: Primary data saved (51747 records). [2025-10-02T21:04:50.576810] [INFO ] [MAIN ] PRU: Full history saved. [2025-10-02T21:04:50.576892] [INFO ] [MAIN ] Update Progress: 1737/2370 symbols completed. PRU took 45.1s. Estimated remaining: 1h 29m 12s. Rate: 7.1 symbols/min [2025-10-02T21:04:50.679209] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-08. [2025-10-02T21:04:50.789796] [INFO ] [MAIN ] PSN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:04:50.789993] [DEBUG] [LOCAL ] PSN: No existing data file found in primary storage. [2025-10-02T21:04:50.790038] [WARN ] [MAIN ] PSN: No existing data found, performing full refresh instead. [2025-10-02T21:04:50.790160] [INFO ] [MAIN ] PSN: Wiping existing primary data before full refresh. [2025-10-02T21:04:50.790210] [INFO ] [LOCAL ] PSN: Starting deletion of primary data. [2025-10-02T21:04:50.790256] [DEBUG] [LOCAL ] PSN: No primary data file found to delete. [2025-10-02T21:04:50.790290] [INFO ] [MAIN ] PSN: Starting full primary refresh. [2025-10-02T21:04:51.172117] [INFO ] [REMOTE ] PSN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:04:51.472979] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-05. [2025-10-02T21:04:51.553503] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-02T21:04:52.098151] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-02T21:04:52.273052] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-02. [2025-10-02T21:04:53.073024] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-09. [2025-10-02T21:04:53.378963] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-02T21:04:53.873044] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-03. [2025-10-02T21:04:54.027478] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-02T21:04:54.673024] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-10. [2025-10-02T21:04:55.252630] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-02T21:04:55.253796] [INFO ] [REMOTE ] PSBD: Full fetch complete (9487 records). [2025-10-02T21:04:55.253903] [DEBUG] [VALIDATOR ] PSBD: Validating primary data. [2025-10-02T21:04:55.477060] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-06. [2025-10-02T21:04:55.621875] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-02T21:04:55.713690] [DEBUG] [VALIDATOR ] PSBD: All expected trading days are present. [2025-10-02T21:04:55.713774] [DEBUG] [VALIDATOR ] PSBD: Primary data validation passed. [2025-10-02T21:04:55.714004] [INFO ] [MAIN ] PSBD: Fetched primary data is valid. [2025-10-02T21:04:55.714045] [DEBUG] [LOCAL ] PSBD: Saving primary data. [2025-10-02T21:04:55.714463] [DEBUG] [LOCAL ] PSBD: Trimmed 9487 records to 7150 (keeping 200 days of data) [2025-10-02T21:04:55.759786] [DEBUG] [LOCAL ] PSBD: Primary data saved (7150 records). [2025-10-02T21:04:55.759937] [INFO ] [MAIN ] PSBD: Full history saved. [2025-10-02T21:04:55.760028] [INFO ] [MAIN ] Update Progress: 1738/2370 symbols completed. PSBD took 29.0s. Estimated remaining: 1h 29m 3s. Rate: 7.1 symbols/min [2025-10-02T21:04:55.948186] [INFO ] [MAIN ] PSO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:04:55.948358] [DEBUG] [LOCAL ] PSO: No existing data file found in primary storage. [2025-10-02T21:04:55.948395] [WARN ] [MAIN ] PSO: No existing data found, performing full refresh instead. [2025-10-02T21:04:55.948507] [INFO ] [MAIN ] PSO: Wiping existing primary data before full refresh. [2025-10-02T21:04:55.948549] [INFO ] [LOCAL ] PSO: Starting deletion of primary data. [2025-10-02T21:04:55.948591] [DEBUG] [LOCAL ] PSO: No primary data file found to delete. [2025-10-02T21:04:55.948627] [INFO ] [MAIN ] PSO: Starting full primary refresh. [2025-10-02T21:04:56.278139] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-04. [2025-10-02T21:04:56.362073] [INFO ] [REMOTE ] PSO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:04:56.364657] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-02T21:04:57.073021] [INFO ] [REMOTE ] PSO: Fetching primary data for 2024-12. [2025-10-02T21:04:57.789704] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-02T21:04:57.873053] [INFO ] [REMOTE ] PSN: Fetching primary data for 2024-12. [2025-10-02T21:04:58.416424] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-02T21:04:58.673024] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-05. [2025-10-02T21:04:59.291924] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-02T21:04:59.473001] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-01. [2025-10-02T21:05:00.170044] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-02T21:05:00.273003] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-07. [2025-10-02T21:05:01.034069] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-02T21:05:01.072964] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-06. [2025-10-02T21:05:01.271165] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-02T21:05:01.873042] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-02. [2025-10-02T21:05:02.598802] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-02T21:05:02.673018] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-01. [2025-10-02T21:05:03.473046] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-08. [2025-10-02T21:05:03.636551] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-02T21:05:04.200020] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-02T21:05:04.272975] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-07. [2025-10-02T21:05:04.344699] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-02T21:05:05.073030] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-02. [2025-10-02T21:05:05.601142] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-02T21:05:05.873077] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-08. [2025-10-02T21:05:06.514213] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-02T21:05:06.673054] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-03. [2025-10-02T21:05:07.338129] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-02T21:05:07.473004] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-03. [2025-10-02T21:05:07.577244] [DEBUG] [REMOTE ] PSO: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-10-02T21:05:07.577597] [WARN ] [REMOTE ] PSO: No data returned for month 2025-03 [2025-10-02T21:05:07.577753] [FATAL] [REMOTE ] PSO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T21:05:07.577930] [FATAL] [MAIN ] PSO: Failed to fetch primary data. [2025-10-02T21:05:07.578022] [WARN ] [MAIN ] PSO: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T21:05:07.578185] [INFO ] [LOCAL ] PSO: Starting deletion of primary data. [2025-10-02T21:05:07.578272] [DEBUG] [LOCAL ] PSO: No primary data file found to delete. [2025-10-02T21:05:07.578323] [INFO ] [LOCAL ] PSO: Starting deletion of derivative data. [2025-10-02T21:05:07.578406] [DEBUG] [LOCAL ] PSO: No derivative data file found to delete. [2025-10-02T21:05:07.578503] [INFO ] [MAIN ] Update Progress: 1739/2370 symbols completed. PSO took 11.8s. Estimated remaining: 1h 28m 55s. Rate: 7.1 symbols/min [2025-10-02T21:05:07.778409] [INFO ] [MAIN ] PSQH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:05:07.778574] [DEBUG] [LOCAL ] PSQH: No existing data file found in primary storage. [2025-10-02T21:05:07.778614] [WARN ] [MAIN ] PSQH: No existing data found, performing full refresh instead. [2025-10-02T21:05:07.778752] [INFO ] [MAIN ] PSQH: Wiping existing primary data before full refresh. [2025-10-02T21:05:07.778795] [INFO ] [LOCAL ] PSQH: Starting deletion of primary data. [2025-10-02T21:05:07.778856] [DEBUG] [LOCAL ] PSQH: No primary data file found to delete. [2025-10-02T21:05:07.778912] [INFO ] [MAIN ] PSQH: Starting full primary refresh. [2025-10-02T21:05:08.169036] [INFO ] [REMOTE ] PSQH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:05:08.222059] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-02T21:05:08.273013] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-09. [2025-10-02T21:05:09.073043] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2024-12. [2025-10-02T21:05:09.449556] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-02T21:05:09.873014] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-10. [2025-10-02T21:05:10.671821] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-02T21:05:10.673543] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-09. [2025-10-02T21:05:10.674911] [INFO ] [REMOTE ] PSFE: Full fetch complete (43094 records). [2025-10-02T21:05:10.675053] [DEBUG] [VALIDATOR ] PSFE: Validating primary data. [2025-10-02T21:05:11.123481] [DEBUG] [VALIDATOR ] PSFE: All expected trading days are present. [2025-10-02T21:05:11.132892] [DEBUG] [VALIDATOR ] PSFE: Primary data validation passed. [2025-10-02T21:05:11.139594] [INFO ] [MAIN ] PSFE: Fetched primary data is valid. [2025-10-02T21:05:11.147087] [DEBUG] [LOCAL ] PSFE: Saving primary data. [2025-10-02T21:05:11.152111] [DEBUG] [LOCAL ] PSFE: Trimmed 43094 records to 30221 (keeping 200 days of data) [2025-10-02T21:05:11.153238] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-02T21:05:11.353523] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-02T21:05:11.362581] [DEBUG] [LOCAL ] PSFE: Primary data saved (30221 records). [2025-10-02T21:05:11.362721] [INFO ] [MAIN ] PSFE: Full history saved. [2025-10-02T21:05:11.362809] [INFO ] [MAIN ] Update Progress: 1740/2370 symbols completed. PSFE took 28.3s. Estimated remaining: 1h 28m 45s. Rate: 7.1 symbols/min [2025-10-02T21:05:11.478177] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-04. [2025-10-02T21:05:11.563468] [INFO ] [MAIN ] PSTG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:05:11.563701] [DEBUG] [LOCAL ] PSTG: No existing data file found in primary storage. [2025-10-02T21:05:11.563756] [WARN ] [MAIN ] PSTG: No existing data found, performing full refresh instead. [2025-10-02T21:05:11.563879] [INFO ] [MAIN ] PSTG: Wiping existing primary data before full refresh. [2025-10-02T21:05:11.563931] [INFO ] [LOCAL ] PSTG: Starting deletion of primary data. [2025-10-02T21:05:11.563999] [DEBUG] [LOCAL ] PSTG: No primary data file found to delete. [2025-10-02T21:05:11.564035] [INFO ] [MAIN ] PSTG: Starting full primary refresh. [2025-10-02T21:05:11.947154] [INFO ] [REMOTE ] PSTG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:05:12.273015] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-01. [2025-10-02T21:05:13.072998] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-10. [2025-10-02T21:05:13.311669] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-02T21:05:13.686197] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-02T21:05:13.687218] [INFO ] [REMOTE ] PSF: Full fetch complete (9973 records). [2025-10-02T21:05:13.687301] [DEBUG] [VALIDATOR ] PSF: Validating primary data. [2025-10-02T21:05:13.875005] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-05. [2025-10-02T21:05:14.110182] [DEBUG] [VALIDATOR ] PSF: All expected trading days are present. [2025-10-02T21:05:14.110359] [DEBUG] [VALIDATOR ] PSF: Primary data validation passed. [2025-10-02T21:05:14.110834] [INFO ] [MAIN ] PSF: Fetched primary data is valid. [2025-10-02T21:05:14.110914] [DEBUG] [LOCAL ] PSF: Saving primary data. [2025-10-02T21:05:14.111622] [DEBUG] [LOCAL ] PSF: Trimmed 9973 records to 7014 (keeping 200 days of data) [2025-10-02T21:05:14.180005] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-02T21:05:14.203834] [DEBUG] [LOCAL ] PSF: Primary data saved (7014 records). [2025-10-02T21:05:14.204031] [INFO ] [MAIN ] PSF: Full history saved. [2025-10-02T21:05:14.204145] [INFO ] [MAIN ] Update Progress: 1741/2370 symbols completed. PSF took 39.7s. Estimated remaining: 1h 28m 35s. Rate: 7.1 symbols/min [2025-10-02T21:05:14.402447] [INFO ] [MAIN ] PSTL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:05:14.402694] [DEBUG] [LOCAL ] PSTL: No existing data file found in primary storage. [2025-10-02T21:05:14.402791] [WARN ] [MAIN ] PSTL: No existing data found, performing full refresh instead. [2025-10-02T21:05:14.402919] [INFO ] [MAIN ] PSTL: Wiping existing primary data before full refresh. [2025-10-02T21:05:14.402968] [INFO ] [LOCAL ] PSTL: Starting deletion of primary data. [2025-10-02T21:05:14.403018] [DEBUG] [LOCAL ] PSTL: No primary data file found to delete. [2025-10-02T21:05:14.403068] [INFO ] [MAIN ] PSTL: Starting full primary refresh. [2025-10-02T21:05:14.679184] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2024-12. [2025-10-02T21:05:14.815776] [INFO ] [REMOTE ] PSTL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:05:15.473030] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-02. [2025-10-02T21:05:15.771763] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-02T21:05:16.273048] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2024-12. [2025-10-02T21:05:16.812391] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-02T21:05:17.066816] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-02T21:05:17.077543] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-01. [2025-10-02T21:05:17.094445] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-02T21:05:17.873008] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-03. [2025-10-02T21:05:18.673068] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-06. [2025-10-02T21:05:19.080960] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-02T21:05:19.473166] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-01. [2025-10-02T21:05:19.608018] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-02T21:05:20.225905] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-02T21:05:20.273003] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-04. [2025-10-02T21:05:20.625329] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-02T21:05:21.073012] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-02. [2025-10-02T21:05:21.413161] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-02T21:05:21.873047] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-07. [2025-10-02T21:05:22.330050] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-02T21:05:22.673001] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-03. [2025-10-02T21:05:23.456352] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-02T21:05:23.472976] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-08. [2025-10-02T21:05:23.593410] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-02T21:05:24.273004] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-05. [2025-10-02T21:05:24.784584] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-02T21:05:25.073023] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-09. [2025-10-02T21:05:25.873002] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-04. [2025-10-02T21:05:26.076820] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-02T21:05:26.672983] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-02. [2025-10-02T21:05:26.827597] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-02T21:05:26.860267] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-02T21:05:27.473041] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-05. [2025-10-02T21:05:28.272987] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-06. [2025-10-02T21:05:28.348328] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-02T21:05:28.678388] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-02T21:05:29.073048] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-03. [2025-10-02T21:05:29.809292] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-02T21:05:29.873012] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-06. [2025-10-02T21:05:30.673004] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-07. [2025-10-02T21:05:30.939935] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-02T21:05:30.979384] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-02T21:05:31.473008] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-04. [2025-10-02T21:05:31.916355] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-02T21:05:32.273037] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-10. [2025-10-02T21:05:33.073003] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-07. [2025-10-02T21:05:33.221773] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-02T21:05:33.466436] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-02T21:05:33.472090] [INFO ] [REMOTE ] PSN: Full fetch complete (66965 records). [2025-10-02T21:05:33.472321] [DEBUG] [VALIDATOR ] PSN: Validating primary data. [2025-10-02T21:05:33.875127] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-08. [2025-10-02T21:05:33.897914] [DEBUG] [VALIDATOR ] PSN: All expected trading days are present. [2025-10-02T21:05:33.898025] [DEBUG] [VALIDATOR ] PSN: Primary data validation passed. [2025-10-02T21:05:33.899362] [INFO ] [MAIN ] PSN: Fetched primary data is valid. [2025-10-02T21:05:33.899435] [DEBUG] [LOCAL ] PSN: Saving primary data. [2025-10-02T21:05:33.901750] [DEBUG] [LOCAL ] PSN: Trimmed 66965 records to 46339 (keeping 200 days of data) [2025-10-02T21:05:34.203477] [DEBUG] [LOCAL ] PSN: Primary data saved (46339 records). [2025-10-02T21:05:34.203676] [INFO ] [MAIN ] PSN: Full history saved. [2025-10-02T21:05:34.203781] [INFO ] [MAIN ] Update Progress: 1742/2370 symbols completed. PSN took 43.6s. Estimated remaining: 1h 28m 30s. Rate: 7.1 symbols/min [2025-10-02T21:05:34.361176] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-02T21:05:34.418030] [INFO ] [MAIN ] PSX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:05:34.418330] [DEBUG] [LOCAL ] PSX: No existing data file found in primary storage. [2025-10-02T21:05:34.418763] [WARN ] [MAIN ] PSX: No existing data found, performing full refresh instead. [2025-10-02T21:05:34.418896] [INFO ] [MAIN ] PSX: Wiping existing primary data before full refresh. [2025-10-02T21:05:34.418940] [INFO ] [LOCAL ] PSX: Starting deletion of primary data. [2025-10-02T21:05:34.418984] [DEBUG] [LOCAL ] PSX: No primary data file found to delete. [2025-10-02T21:05:34.419063] [INFO ] [MAIN ] PSX: Starting full primary refresh. [2025-10-02T21:05:34.678252] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-05. [2025-10-02T21:05:34.820669] [INFO ] [REMOTE ] PSX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:05:35.472980] [INFO ] [REMOTE ] PSX: Fetching primary data for 2024-12. [2025-10-02T21:05:35.537920] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-02T21:05:36.273087] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-08. [2025-10-02T21:05:36.309954] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-02T21:05:36.674416] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-02T21:05:37.073035] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-01. [2025-10-02T21:05:37.416755] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-02T21:05:37.872161] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-02T21:05:37.882215] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-09. [2025-10-02T21:05:38.673015] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-06. [2025-10-02T21:05:38.986442] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-02T21:05:39.473003] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-10. [2025-10-02T21:05:40.151799] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-02T21:05:40.153143] [INFO ] [REMOTE ] PSTL: Full fetch complete (29732 records). [2025-10-02T21:05:40.153236] [DEBUG] [VALIDATOR ] PSTL: Validating primary data. [2025-10-02T21:05:40.275552] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-02. [2025-10-02T21:05:40.581603] [DEBUG] [VALIDATOR ] PSTL: All expected trading days are present. [2025-10-02T21:05:40.581736] [DEBUG] [VALIDATOR ] PSTL: Primary data validation passed. [2025-10-02T21:05:40.582537] [INFO ] [MAIN ] PSTL: Fetched primary data is valid. [2025-10-02T21:05:40.582622] [DEBUG] [LOCAL ] PSTL: Saving primary data. [2025-10-02T21:05:40.615434] [DEBUG] [LOCAL ] PSTL: Trimmed 29732 records to 20199 (keeping 200 days of data) [2025-10-02T21:05:40.618254] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-02T21:05:40.762062] [DEBUG] [LOCAL ] PSTL: Primary data saved (20199 records). [2025-10-02T21:05:40.762238] [INFO ] [MAIN ] PSTL: Full history saved. [2025-10-02T21:05:40.762374] [INFO ] [MAIN ] Update Progress: 1743/2370 symbols completed. PSTL took 26.6s. Estimated remaining: 1h 28m 21s. Rate: 7.1 symbols/min [2025-10-02T21:05:40.957790] [INFO ] [MAIN ] PTA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:05:40.957994] [DEBUG] [LOCAL ] PTA: No existing data file found in primary storage. [2025-10-02T21:05:40.958051] [WARN ] [MAIN ] PTA: No existing data found, performing full refresh instead. [2025-10-02T21:05:40.958185] [INFO ] [MAIN ] PTA: Wiping existing primary data before full refresh. [2025-10-02T21:05:40.958227] [INFO ] [LOCAL ] PTA: Starting deletion of primary data. [2025-10-02T21:05:40.958268] [DEBUG] [LOCAL ] PTA: No primary data file found to delete. [2025-10-02T21:05:40.958303] [INFO ] [MAIN ] PTA: Starting full primary refresh. [2025-10-02T21:05:41.080466] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-07. [2025-10-02T21:05:41.384460] [INFO ] [REMOTE ] PTA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:05:41.442786] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-02T21:05:41.872993] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-09. [2025-10-02T21:05:42.672971] [INFO ] [REMOTE ] PTA: Fetching primary data for 2024-12. [2025-10-02T21:05:42.717155] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-02T21:05:43.472975] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-08. [2025-10-02T21:05:43.727920] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-02T21:05:43.843230] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-02T21:05:44.272994] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-10. [2025-10-02T21:05:45.072993] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-03. [2025-10-02T21:05:45.501241] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-02T21:05:45.565313] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-02T21:05:45.749832] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-02T21:05:45.752142] [INFO ] [REMOTE ] PSQH: Full fetch complete (53461 records). [2025-10-02T21:05:45.752233] [DEBUG] [VALIDATOR ] PSQH: Validating primary data. [2025-10-02T21:05:45.878104] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-01. [2025-10-02T21:05:46.155510] [DEBUG] [VALIDATOR ] PSQH: All expected trading days are present. [2025-10-02T21:05:46.155598] [DEBUG] [VALIDATOR ] PSQH: Primary data validation passed. [2025-10-02T21:05:46.156510] [INFO ] [MAIN ] PSQH: Fetched primary data is valid. [2025-10-02T21:05:46.156575] [DEBUG] [LOCAL ] PSQH: Saving primary data. [2025-10-02T21:05:46.157831] [DEBUG] [LOCAL ] PSQH: Trimmed 53461 records to 35064 (keeping 200 days of data) [2025-10-02T21:05:46.382341] [DEBUG] [LOCAL ] PSQH: Primary data saved (35064 records). [2025-10-02T21:05:46.382506] [INFO ] [MAIN ] PSQH: Full history saved. [2025-10-02T21:05:46.382639] [INFO ] [MAIN ] Update Progress: 1744/2370 symbols completed. PSQH took 38.8s. Estimated remaining: 1h 28m 12s. Rate: 7.1 symbols/min [2025-10-02T21:05:46.573810] [INFO ] [MAIN ] PTY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:05:46.574013] [DEBUG] [LOCAL ] PTY: No existing data file found in primary storage. [2025-10-02T21:05:46.574076] [WARN ] [MAIN ] PTY: No existing data found, performing full refresh instead. [2025-10-02T21:05:46.574198] [INFO ] [MAIN ] PTY: Wiping existing primary data before full refresh. [2025-10-02T21:05:46.574250] [INFO ] [LOCAL ] PTY: Starting deletion of primary data. [2025-10-02T21:05:46.574297] [DEBUG] [LOCAL ] PTY: No primary data file found to delete. [2025-10-02T21:05:46.574334] [INFO ] [MAIN ] PTY: Starting full primary refresh. [2025-10-02T21:05:46.678131] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-09. [2025-10-02T21:05:46.970704] [INFO ] [REMOTE ] PTY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:05:47.017395] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-02T21:05:47.473007] [INFO ] [REMOTE ] PTY: Fetching primary data for 2024-12. [2025-10-02T21:05:48.273026] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-04. [2025-10-02T21:05:48.791766] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-02T21:05:49.072970] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-10. [2025-10-02T21:05:49.181350] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-02T21:05:49.286868] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-02T21:05:49.873059] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-05. [2025-10-02T21:05:50.646348] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-02T21:05:50.648415] [INFO ] [REMOTE ] PSTG: Full fetch complete (76543 records). [2025-10-02T21:05:50.648532] [DEBUG] [VALIDATOR ] PSTG: Validating primary data. [2025-10-02T21:05:50.684049] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-02. [2025-10-02T21:05:51.107971] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-02T21:05:51.208518] [DEBUG] [VALIDATOR ] PSTG: All expected trading days are present. [2025-10-02T21:05:51.208604] [DEBUG] [VALIDATOR ] PSTG: Primary data validation passed. [2025-10-02T21:05:51.209826] [INFO ] [MAIN ] PSTG: Fetched primary data is valid. [2025-10-02T21:05:51.209901] [DEBUG] [LOCAL ] PSTG: Saving primary data. [2025-10-02T21:05:51.211449] [DEBUG] [LOCAL ] PSTG: Trimmed 76543 records to 53227 (keeping 200 days of data) [2025-10-02T21:05:51.497254] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-01. [2025-10-02T21:05:51.552785] [DEBUG] [LOCAL ] PSTG: Primary data saved (53227 records). [2025-10-02T21:05:51.552936] [INFO ] [MAIN ] PSTG: Full history saved. [2025-10-02T21:05:51.553056] [INFO ] [MAIN ] Update Progress: 1745/2370 symbols completed. PSTG took 40.2s. Estimated remaining: 1h 28m 2s. Rate: 7.1 symbols/min [2025-10-02T21:05:51.733947] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-02T21:05:51.754034] [INFO ] [MAIN ] PUK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:05:51.757418] [DEBUG] [LOCAL ] PUK: No existing data file found in primary storage. [2025-10-02T21:05:51.757476] [WARN ] [MAIN ] PUK: No existing data found, performing full refresh instead. [2025-10-02T21:05:51.757590] [INFO ] [MAIN ] PUK: Wiping existing primary data before full refresh. [2025-10-02T21:05:51.757634] [INFO ] [LOCAL ] PUK: Starting deletion of primary data. [2025-10-02T21:05:51.757722] [DEBUG] [LOCAL ] PUK: No primary data file found to delete. [2025-10-02T21:05:51.757763] [INFO ] [MAIN ] PUK: Starting full primary refresh. [2025-10-02T21:05:52.150188] [INFO ] [REMOTE ] PUK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:05:52.272990] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-03. [2025-10-02T21:05:52.853588] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-02T21:05:53.074398] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-02. [2025-10-02T21:05:53.076286] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-02T21:05:53.873018] [INFO ] [REMOTE ] PUK: Fetching primary data for 2024-12. [2025-10-02T21:05:54.673718] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-04. [2025-10-02T21:05:54.674957] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-02T21:05:55.473046] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-06. [2025-10-02T21:05:55.524480] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-02T21:05:55.756595] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-02T21:05:56.242416] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-02T21:05:56.272990] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-07. [2025-10-02T21:05:57.073198] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-01. [2025-10-02T21:05:57.079960] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-02T21:05:57.873006] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-03. [2025-10-02T21:05:58.484016] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-02T21:05:58.672983] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-05. [2025-10-02T21:05:59.079470] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-02T21:05:59.473044] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-08. [2025-10-02T21:05:59.662841] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-02T21:06:00.272996] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-02. [2025-10-02T21:06:00.594516] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-02T21:06:01.073047] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-06. [2025-10-02T21:06:01.872975] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-04. [2025-10-02T21:06:02.104453] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-02T21:06:02.118582] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-02T21:06:02.673005] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-09. [2025-10-02T21:06:03.472983] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-03. [2025-10-02T21:06:03.639623] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-02T21:06:03.713831] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-02T21:06:04.273009] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-10. [2025-10-02T21:06:05.063013] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-02T21:06:05.074692] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-05. [2025-10-02T21:06:05.756268] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-02T21:06:05.758491] [INFO ] [REMOTE ] PSX: Full fetch complete (77046 records). [2025-10-02T21:06:05.758668] [DEBUG] [VALIDATOR ] PSX: Validating primary data. [2025-10-02T21:06:05.878203] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-07. [2025-10-02T21:06:06.190200] [DEBUG] [VALIDATOR ] PSX: All expected trading days are present. [2025-10-02T21:06:06.190320] [DEBUG] [VALIDATOR ] PSX: Primary data validation passed. [2025-10-02T21:06:06.191697] [INFO ] [MAIN ] PSX: Fetched primary data is valid. [2025-10-02T21:06:06.191795] [DEBUG] [LOCAL ] PSX: Saving primary data. [2025-10-02T21:06:06.193515] [DEBUG] [LOCAL ] PSX: Trimmed 77046 records to 53496 (keeping 200 days of data) [2025-10-02T21:06:06.562933] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-02T21:06:06.588475] [DEBUG] [LOCAL ] PSX: Primary data saved (53496 records). [2025-10-02T21:06:06.588637] [INFO ] [MAIN ] PSX: Full history saved. [2025-10-02T21:06:06.588763] [INFO ] [MAIN ] Update Progress: 1746/2370 symbols completed. PSX took 32.4s. Estimated remaining: 1h 27m 56s. Rate: 7.1 symbols/min [2025-10-02T21:06:06.682321] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-04. [2025-10-02T21:06:06.813968] [INFO ] [MAIN ] PUMP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:06:06.814138] [DEBUG] [LOCAL ] PUMP: No existing data file found in primary storage. [2025-10-02T21:06:06.814178] [WARN ] [MAIN ] PUMP: No existing data found, performing full refresh instead. [2025-10-02T21:06:06.814289] [INFO ] [MAIN ] PUMP: Wiping existing primary data before full refresh. [2025-10-02T21:06:06.814333] [INFO ] [LOCAL ] PUMP: Starting deletion of primary data. [2025-10-02T21:06:06.814378] [DEBUG] [LOCAL ] PUMP: No primary data file found to delete. [2025-10-02T21:06:06.814413] [INFO ] [MAIN ] PUMP: Starting full primary refresh. [2025-10-02T21:06:07.005217] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-02T21:06:07.230544] [INFO ] [REMOTE ] PUMP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:06:07.473005] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2024-12. [2025-10-02T21:06:08.273014] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-06. [2025-10-02T21:06:08.616166] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-02T21:06:08.987533] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-02T21:06:09.073056] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-01. [2025-10-02T21:06:09.865157] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-02T21:06:09.872975] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-05. [2025-10-02T21:06:10.673024] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-08. [2025-10-02T21:06:10.815028] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-02T21:06:11.473032] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-02. [2025-10-02T21:06:11.619498] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-02T21:06:11.716037] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-02T21:06:12.273022] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-06. [2025-10-02T21:06:13.073008] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-07. [2025-10-02T21:06:13.209191] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-02T21:06:13.721958] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-02T21:06:13.873047] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-07. [2025-10-02T21:06:14.391696] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-02T21:06:14.673015] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-03. [2025-10-02T21:06:15.473053] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-09. [2025-10-02T21:06:15.694282] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-02T21:06:16.025288] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-02T21:06:16.273010] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-04. [2025-10-02T21:06:16.562149] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-02T21:06:17.073028] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-08. [2025-10-02T21:06:17.872981] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-10. [2025-10-02T21:06:17.963317] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-02T21:06:18.673027] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-05. [2025-10-02T21:06:18.689952] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-02T21:06:18.691184] [INFO ] [REMOTE ] PTA: Full fetch complete (23330 records). [2025-10-02T21:06:18.691268] [DEBUG] [VALIDATOR ] PTA: Validating primary data. [2025-10-02T21:06:19.053194] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-02T21:06:19.140786] [DEBUG] [VALIDATOR ] PTA: All expected trading days are present. [2025-10-02T21:06:19.140869] [DEBUG] [VALIDATOR ] PTA: Primary data validation passed. [2025-10-02T21:06:19.141408] [INFO ] [MAIN ] PTA: Fetched primary data is valid. [2025-10-02T21:06:19.141455] [DEBUG] [LOCAL ] PTA: Saving primary data. [2025-10-02T21:06:19.142160] [DEBUG] [LOCAL ] PTA: Trimmed 23330 records to 15033 (keeping 200 days of data) [2025-10-02T21:06:19.250715] [DEBUG] [LOCAL ] PTA: Primary data saved (15033 records). [2025-10-02T21:06:19.250869] [INFO ] [MAIN ] PTA: Full history saved. [2025-10-02T21:06:19.250989] [INFO ] [MAIN ] Update Progress: 1747/2370 symbols completed. PTA took 38.5s. Estimated remaining: 1h 27m 49s. Rate: 7.1 symbols/min [2025-10-02T21:06:19.441306] [INFO ] [MAIN ] PVH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:06:19.441497] [DEBUG] [LOCAL ] PVH: No existing data file found in primary storage. [2025-10-02T21:06:19.441538] [WARN ] [MAIN ] PVH: No existing data found, performing full refresh instead. [2025-10-02T21:06:19.441682] [INFO ] [MAIN ] PVH: Wiping existing primary data before full refresh. [2025-10-02T21:06:19.441738] [INFO ] [LOCAL ] PVH: Starting deletion of primary data. [2025-10-02T21:06:19.441785] [DEBUG] [LOCAL ] PVH: No primary data file found to delete. [2025-10-02T21:06:19.441820] [INFO ] [MAIN ] PVH: Starting full primary refresh. [2025-10-02T21:06:19.478268] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-09. [2025-10-02T21:06:19.844325] [INFO ] [REMOTE ] PVH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:06:20.273036] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-08. [2025-10-02T21:06:20.515880] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-02T21:06:21.072988] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-06. [2025-10-02T21:06:21.395245] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-02T21:06:21.809999] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-02T21:06:21.873033] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-09. [2025-10-02T21:06:22.672963] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-10. [2025-10-02T21:06:22.783302] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-02T21:06:23.472981] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-07. [2025-10-02T21:06:23.530778] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-02T21:06:24.054614] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-02T21:06:24.056819] [INFO ] [REMOTE ] PUK: Full fetch complete (65207 records). [2025-10-02T21:06:24.056985] [DEBUG] [VALIDATOR ] PUK: Validating primary data. [2025-10-02T21:06:24.278179] [INFO ] [REMOTE ] PVH: Fetching primary data for 2024-12. [2025-10-02T21:06:24.474695] [DEBUG] [VALIDATOR ] PUK: All expected trading days are present. [2025-10-02T21:06:24.474799] [DEBUG] [VALIDATOR ] PUK: Primary data validation passed. [2025-10-02T21:06:24.475815] [INFO ] [MAIN ] PUK: Fetched primary data is valid. [2025-10-02T21:06:24.475882] [DEBUG] [LOCAL ] PUK: Saving primary data. [2025-10-02T21:06:24.477256] [DEBUG] [LOCAL ] PUK: Trimmed 65207 records to 45020 (keeping 200 days of data) [2025-10-02T21:06:24.774308] [DEBUG] [LOCAL ] PUK: Primary data saved (45020 records). [2025-10-02T21:06:24.774450] [INFO ] [MAIN ] PUK: Full history saved. [2025-10-02T21:06:24.774531] [INFO ] [MAIN ] Update Progress: 1748/2370 symbols completed. PUK took 33.2s. Estimated remaining: 1h 27m 40s. Rate: 7.1 symbols/min [2025-10-02T21:06:24.957819] [INFO ] [MAIN ] PVL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:06:24.958173] [DEBUG] [LOCAL ] PVL: No existing data file found in primary storage. [2025-10-02T21:06:24.958298] [WARN ] [MAIN ] PVL: No existing data found, performing full refresh instead. [2025-10-02T21:06:24.958485] [INFO ] [MAIN ] PVL: Wiping existing primary data before full refresh. [2025-10-02T21:06:24.958752] [INFO ] [LOCAL ] PVL: Starting deletion of primary data. [2025-10-02T21:06:24.958813] [DEBUG] [LOCAL ] PVL: No primary data file found to delete. [2025-10-02T21:06:24.958849] [INFO ] [MAIN ] PVL: Starting full primary refresh. [2025-10-02T21:06:25.077974] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-10. [2025-10-02T21:06:25.388517] [INFO ] [REMOTE ] PVL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:06:25.391185] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-02T21:06:25.872969] [INFO ] [REMOTE ] PVL: Fetching primary data for 2024-12. [2025-10-02T21:06:26.122006] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-02T21:06:26.424278] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-02T21:06:26.426215] [INFO ] [REMOTE ] PTY: Full fetch complete (53846 records). [2025-10-02T21:06:26.426314] [DEBUG] [VALIDATOR ] PTY: Validating primary data. [2025-10-02T21:06:26.678048] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-01. [2025-10-02T21:06:26.767632] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-02T21:06:26.857817] [DEBUG] [VALIDATOR ] PTY: All expected trading days are present. [2025-10-02T21:06:26.857898] [DEBUG] [VALIDATOR ] PTY: Primary data validation passed. [2025-10-02T21:06:26.858816] [INFO ] [MAIN ] PTY: Fetched primary data is valid. [2025-10-02T21:06:26.858880] [DEBUG] [LOCAL ] PTY: Saving primary data. [2025-10-02T21:06:26.860112] [DEBUG] [LOCAL ] PTY: Trimmed 53846 records to 37543 (keeping 200 days of data) [2025-10-02T21:06:27.104253] [DEBUG] [LOCAL ] PTY: Primary data saved (37543 records). [2025-10-02T21:06:27.104410] [INFO ] [MAIN ] PTY: Full history saved. [2025-10-02T21:06:27.104527] [INFO ] [MAIN ] Update Progress: 1749/2370 symbols completed. PTY took 40.7s. Estimated remaining: 1h 27m 29s. Rate: 7.1 symbols/min [2025-10-02T21:06:27.286969] [INFO ] [MAIN ] PWR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:06:27.287154] [DEBUG] [LOCAL ] PWR: No existing data file found in primary storage. [2025-10-02T21:06:27.287197] [WARN ] [MAIN ] PWR: No existing data found, performing full refresh instead. [2025-10-02T21:06:27.287311] [INFO ] [MAIN ] PWR: Wiping existing primary data before full refresh. [2025-10-02T21:06:27.287352] [INFO ] [LOCAL ] PWR: Starting deletion of primary data. [2025-10-02T21:06:27.287393] [DEBUG] [LOCAL ] PWR: No primary data file found to delete. [2025-10-02T21:06:27.287428] [INFO ] [MAIN ] PWR: Starting full primary refresh. [2025-10-02T21:06:27.479727] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-01. [2025-10-02T21:06:27.686518] [INFO ] [REMOTE ] PWR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:06:28.273005] [INFO ] [REMOTE ] PWR: Fetching primary data for 2024-12. [2025-10-02T21:06:28.303620] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-02T21:06:28.494235] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-02T21:06:28.847520] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-02T21:06:29.073010] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-02. [2025-10-02T21:06:29.814838] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-02T21:06:29.873035] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-02. [2025-10-02T21:06:30.672990] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-03. [2025-10-02T21:06:31.391304] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-02T21:06:31.472986] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-08. [2025-10-02T21:06:31.569373] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-02T21:06:32.273004] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-04. [2025-10-02T21:06:33.073010] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-03. [2025-10-02T21:06:33.174866] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-02T21:06:33.213098] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-02T21:06:33.872992] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-05. [2025-10-02T21:06:34.543119] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-02T21:06:34.672979] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-09. [2025-10-02T21:06:34.933147] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-02T21:06:35.473002] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-06. [2025-10-02T21:06:36.186685] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-02T21:06:36.214075] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-02T21:06:36.272999] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-07. [2025-10-02T21:06:36.925138] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-02T21:06:37.072995] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-08. [2025-10-02T21:06:37.773786] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-02T21:06:37.872997] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-01. [2025-10-02T21:06:38.672977] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-04. [2025-10-02T21:06:38.791452] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-02T21:06:39.473006] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-10. [2025-10-02T21:06:40.273002] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-02. [2025-10-02T21:06:40.532305] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-02T21:06:40.791456] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-02T21:06:40.793428] [INFO ] [REMOTE ] PUMP: Full fetch complete (71768 records). [2025-10-02T21:06:40.793530] [DEBUG] [VALIDATOR ] PUMP: Validating primary data. [2025-10-02T21:06:41.082734] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-05. [2025-10-02T21:06:41.232753] [DEBUG] [VALIDATOR ] PUMP: All expected trading days are present. [2025-10-02T21:06:41.232892] [DEBUG] [VALIDATOR ] PUMP: Primary data validation passed. [2025-10-02T21:06:41.234057] [INFO ] [MAIN ] PUMP: Fetched primary data is valid. [2025-10-02T21:06:41.234134] [DEBUG] [LOCAL ] PUMP: Saving primary data. [2025-10-02T21:06:41.235707] [DEBUG] [LOCAL ] PUMP: Trimmed 71768 records to 49753 (keeping 200 days of data) [2025-10-02T21:06:41.553602] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-02T21:06:41.588836] [DEBUG] [LOCAL ] PUMP: Primary data saved (49753 records). [2025-10-02T21:06:41.589018] [INFO ] [MAIN ] PUMP: Full history saved. [2025-10-02T21:06:41.589126] [INFO ] [MAIN ] Update Progress: 1750/2370 symbols completed. PUMP took 35.0s. Estimated remaining: 1h 27m 23s. Rate: 7.1 symbols/min [2025-10-02T21:06:41.788208] [INFO ] [MAIN ] PX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:06:41.788418] [DEBUG] [LOCAL ] PX: No existing data file found in primary storage. [2025-10-02T21:06:41.788461] [WARN ] [MAIN ] PX: No existing data found, performing full refresh instead. [2025-10-02T21:06:41.788535] [INFO ] [MAIN ] PX: Wiping existing primary data before full refresh. [2025-10-02T21:06:41.788572] [INFO ] [LOCAL ] PX: Starting deletion of primary data. [2025-10-02T21:06:41.788612] [DEBUG] [LOCAL ] PX: No primary data file found to delete. [2025-10-02T21:06:41.788666] [INFO ] [MAIN ] PX: Starting full primary refresh. [2025-10-02T21:06:41.878164] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-09. [2025-10-02T21:06:42.180027] [INFO ] [REMOTE ] PX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:06:42.601421] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-02T21:06:42.672993] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-10. [2025-10-02T21:06:43.015126] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-02T21:06:43.130156] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-02T21:06:43.130946] [INFO ] [REMOTE ] PVL: Full fetch complete (7491 records). [2025-10-02T21:06:43.131018] [DEBUG] [VALIDATOR ] PVL: Validating primary data. [2025-10-02T21:06:43.478154] [INFO ] [REMOTE ] PX: Fetching primary data for 2024-12. [2025-10-02T21:06:43.550206] [DEBUG] [VALIDATOR ] PVL: All expected trading days are present. [2025-10-02T21:06:43.550304] [DEBUG] [VALIDATOR ] PVL: Primary data validation passed. [2025-10-02T21:06:43.550518] [INFO ] [MAIN ] PVL: Fetched primary data is valid. [2025-10-02T21:06:43.550566] [DEBUG] [LOCAL ] PVL: Saving primary data. [2025-10-02T21:06:43.551042] [DEBUG] [LOCAL ] PVL: Trimmed 7491 records to 4773 (keeping 200 days of data) [2025-10-02T21:06:43.579364] [DEBUG] [LOCAL ] PVL: Primary data saved (4773 records). [2025-10-02T21:06:43.579473] [INFO ] [MAIN ] PVL: Full history saved. [2025-10-02T21:06:43.579544] [INFO ] [MAIN ] Update Progress: 1751/2370 symbols completed. PVL took 18.8s. Estimated remaining: 1h 27m 12s. Rate: 7.1 symbols/min [2025-10-02T21:06:43.757310] [INFO ] [MAIN ] QBTS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:06:43.757499] [DEBUG] [LOCAL ] QBTS: No existing data file found in primary storage. [2025-10-02T21:06:43.757613] [WARN ] [MAIN ] QBTS: No existing data found, performing full refresh instead. [2025-10-02T21:06:43.757756] [INFO ] [MAIN ] QBTS: Wiping existing primary data before full refresh. [2025-10-02T21:06:43.757799] [INFO ] [LOCAL ] QBTS: Starting deletion of primary data. [2025-10-02T21:06:43.757842] [DEBUG] [LOCAL ] QBTS: No primary data file found to delete. [2025-10-02T21:06:43.757875] [INFO ] [MAIN ] QBTS: Starting full primary refresh. [2025-10-02T21:06:44.141363] [INFO ] [REMOTE ] QBTS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:06:44.272996] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-03. [2025-10-02T21:06:45.047423] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-02T21:06:45.078116] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2024-12. [2025-10-02T21:06:45.097574] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-02T21:06:45.873020] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-01. [2025-10-02T21:06:46.672994] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-04. [2025-10-02T21:06:47.262059] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-02T21:06:47.384706] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-02T21:06:47.473025] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-06. [2025-10-02T21:06:47.929839] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2024-12 (2.85 seconds). [2025-10-02T21:06:48.273048] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-05. [2025-10-02T21:06:49.072988] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-01. [2025-10-02T21:06:49.274323] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-02T21:06:49.353154] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-02T21:06:49.873056] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-06. [2025-10-02T21:06:50.672979] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-02. [2025-10-02T21:06:50.956832] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-02T21:06:51.473023] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-07. [2025-10-02T21:06:51.816845] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-01 (2.74 seconds). [2025-10-02T21:06:51.897948] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-02T21:06:52.272972] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-07. [2025-10-02T21:06:52.500401] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-02T21:06:53.073024] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-03. [2025-10-02T21:06:53.872982] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-08. [2025-10-02T21:06:54.141508] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-02T21:06:54.486415] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-02T21:06:54.673001] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-02. [2025-10-02T21:06:54.726280] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-02T21:06:55.473049] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-08. [2025-10-02T21:06:56.273018] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-04. [2025-10-02T21:06:56.926424] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-10-02T21:06:57.073025] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-03. [2025-10-02T21:06:57.309783] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-02T21:06:57.536482] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-02T21:06:57.872998] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-05. [2025-10-02T21:06:58.673042] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-09. [2025-10-02T21:06:59.438148] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-02T21:06:59.473027] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-09. [2025-10-02T21:06:59.953191] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-03 (2.88 seconds). [2025-10-02T21:07:00.187875] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-02T21:07:00.272979] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-10. [2025-10-02T21:07:00.304253] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-02T21:07:01.073054] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-10. [2025-10-02T21:07:01.579955] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-02T21:07:01.581910] [INFO ] [REMOTE ] PVH: Full fetch complete (70778 records). [2025-10-02T21:07:01.582058] [DEBUG] [VALIDATOR ] PVH: Validating primary data. [2025-10-02T21:07:01.883801] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-06. [2025-10-02T21:07:02.035387] [DEBUG] [VALIDATOR ] PVH: All expected trading days are present. [2025-10-02T21:07:02.035481] [DEBUG] [VALIDATOR ] PVH: Primary data validation passed. [2025-10-02T21:07:02.036802] [INFO ] [MAIN ] PVH: Fetched primary data is valid. [2025-10-02T21:07:02.036878] [DEBUG] [LOCAL ] PVH: Saving primary data. [2025-10-02T21:07:02.038482] [DEBUG] [LOCAL ] PVH: Trimmed 70778 records to 50697 (keeping 200 days of data) [2025-10-02T21:07:02.362380] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-02T21:07:02.369075] [INFO ] [REMOTE ] PWR: Full fetch complete (68930 records). [2025-10-02T21:07:02.370176] [DEBUG] [VALIDATOR ] PWR: Validating primary data. [2025-10-02T21:07:02.529998] [DEBUG] [LOCAL ] PVH: Primary data saved (50697 records). [2025-10-02T21:07:02.540479] [INFO ] [MAIN ] PVH: Full history saved. [2025-10-02T21:07:02.560764] [INFO ] [MAIN ] Update Progress: 1752/2370 symbols completed. PVH took 43.3s. Estimated remaining: 1h 27m 7s. Rate: 7.1 symbols/min [2025-10-02T21:07:02.722066] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-04. [2025-10-02T21:07:03.016430] [INFO ] [MAIN ] QD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:07:03.022161] [DEBUG] [LOCAL ] QD: No existing data file found in primary storage. [2025-10-02T21:07:03.022253] [WARN ] [MAIN ] QD: No existing data found, performing full refresh instead. [2025-10-02T21:07:03.057563] [INFO ] [MAIN ] QD: Wiping existing primary data before full refresh. [2025-10-02T21:07:03.057678] [INFO ] [LOCAL ] QD: Starting deletion of primary data. [2025-10-02T21:07:03.057756] [DEBUG] [LOCAL ] QD: No primary data file found to delete. [2025-10-02T21:07:03.057795] [INFO ] [MAIN ] QD: Starting full primary refresh. [2025-10-02T21:07:03.119568] [DEBUG] [VALIDATOR ] PWR: All expected trading days are present. [2025-10-02T21:07:03.133488] [DEBUG] [VALIDATOR ] PWR: Primary data validation passed. [2025-10-02T21:07:03.134917] [INFO ] [MAIN ] PWR: Fetched primary data is valid. [2025-10-02T21:07:03.135021] [DEBUG] [LOCAL ] PWR: Saving primary data. [2025-10-02T21:07:03.179458] [DEBUG] [LOCAL ] PWR: Trimmed 68930 records to 47367 (keeping 200 days of data) [2025-10-02T21:07:03.670185] [INFO ] [REMOTE ] QD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:07:03.673218] [INFO ] [REMOTE ] QD: Fetching primary data for 2024-12. [2025-10-02T21:07:03.709988] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-02T21:07:03.950329] [DEBUG] [LOCAL ] PWR: Primary data saved (47367 records). [2025-10-02T21:07:03.950555] [INFO ] [MAIN ] PWR: Full history saved. [2025-10-02T21:07:03.950719] [INFO ] [MAIN ] Update Progress: 1753/2370 symbols completed. PWR took 36.8s. Estimated remaining: 1h 26m 56s. Rate: 7.1 symbols/min [2025-10-02T21:07:04.187534] [INFO ] [MAIN ] QGEN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:07:04.187820] [DEBUG] [LOCAL ] QGEN: No existing data file found in primary storage. [2025-10-02T21:07:04.187887] [WARN ] [MAIN ] QGEN: No existing data found, performing full refresh instead. [2025-10-02T21:07:04.188105] [INFO ] [MAIN ] QGEN: Wiping existing primary data before full refresh. [2025-10-02T21:07:04.188175] [INFO ] [LOCAL ] QGEN: Starting deletion of primary data. [2025-10-02T21:07:04.188248] [DEBUG] [LOCAL ] QGEN: No primary data file found to delete. [2025-10-02T21:07:04.188306] [INFO ] [MAIN ] QGEN: Starting full primary refresh. [2025-10-02T21:07:04.273812] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-07. [2025-10-02T21:07:04.784020] [INFO ] [REMOTE ] QGEN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:07:04.808833] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-02T21:07:05.073007] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-01. [2025-10-02T21:07:05.638762] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-04 (2.92 seconds). [2025-10-02T21:07:05.855501] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-02T21:07:05.872962] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-08. [2025-10-02T21:07:06.225246] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-02T21:07:06.673007] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-05. [2025-10-02T21:07:07.325029] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-02T21:07:07.473005] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-02. [2025-10-02T21:07:08.273009] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-09. [2025-10-02T21:07:08.381840] [DEBUG] [REMOTE ] PX: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-10-02T21:07:08.382175] [WARN ] [REMOTE ] PX: No data returned for month 2025-09 [2025-10-02T21:07:08.382273] [FATAL] [REMOTE ] PX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T21:07:08.382373] [FATAL] [MAIN ] PX: Failed to fetch primary data. [2025-10-02T21:07:08.382457] [WARN ] [MAIN ] PX: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T21:07:08.382545] [INFO ] [LOCAL ] PX: Starting deletion of primary data. [2025-10-02T21:07:08.382686] [DEBUG] [LOCAL ] PX: No primary data file found to delete. [2025-10-02T21:07:08.382757] [INFO ] [LOCAL ] PX: Starting deletion of derivative data. [2025-10-02T21:07:08.382855] [DEBUG] [LOCAL ] PX: No derivative data file found to delete. [2025-10-02T21:07:08.382952] [INFO ] [MAIN ] Update Progress: 1754/2370 symbols completed. PX took 26.8s. Estimated remaining: 1h 26m 46s. Rate: 7.1 symbols/min [2025-10-02T21:07:08.569353] [INFO ] [MAIN ] QS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:07:08.569881] [DEBUG] [LOCAL ] QS: No existing data file found in primary storage. [2025-10-02T21:07:08.569951] [WARN ] [MAIN ] QS: No existing data found, performing full refresh instead. [2025-10-02T21:07:08.570078] [INFO ] [MAIN ] QS: Wiping existing primary data before full refresh. [2025-10-02T21:07:08.570132] [INFO ] [LOCAL ] QS: Starting deletion of primary data. [2025-10-02T21:07:08.570187] [DEBUG] [LOCAL ] QS: No primary data file found to delete. [2025-10-02T21:07:08.570242] [INFO ] [MAIN ] QS: Starting full primary refresh. [2025-10-02T21:07:08.825823] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-02T21:07:09.023391] [INFO ] [REMOTE ] QS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:07:09.073015] [INFO ] [REMOTE ] QS: Fetching primary data for 2024-12. [2025-10-02T21:07:09.570571] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-05 (2.90 seconds). [2025-10-02T21:07:09.873003] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2024-12. [2025-10-02T21:07:10.673042] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-03. [2025-10-02T21:07:11.478998] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-06. [2025-10-02T21:07:11.494546] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-02T21:07:11.796377] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2024-12 (2.72 seconds). [2025-10-02T21:07:11.852423] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-02T21:07:12.273008] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-01. [2025-10-02T21:07:13.073048] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-01. [2025-10-02T21:07:13.848474] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-10-02T21:07:13.872971] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-07. [2025-10-02T21:07:14.673065] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-04. [2025-10-02T21:07:14.759716] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-01 (2.49 seconds). [2025-10-02T21:07:14.844790] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-02T21:07:15.472997] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-02. [2025-10-02T21:07:16.011253] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-02T21:07:16.273002] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-05. [2025-10-02T21:07:16.680175] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-07 (2.81 seconds). [2025-10-02T21:07:17.072981] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-02. [2025-10-02T21:07:17.241569] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-02T21:07:17.631101] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-02T21:07:17.873032] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-08. [2025-10-02T21:07:18.673020] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-03. [2025-10-02T21:07:19.315617] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-10-02T21:07:19.473051] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-03. [2025-10-02T21:07:20.272970] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-06. [2025-10-02T21:07:20.465151] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-02T21:07:20.811800] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-08 (2.94 seconds). [2025-10-02T21:07:21.073044] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-04. [2025-10-02T21:07:21.483127] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-02T21:07:21.677507] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-02T21:07:21.873003] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-04. [2025-10-02T21:07:22.672980] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-09. [2025-10-02T21:07:23.055538] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-02T21:07:23.473020] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-05. [2025-10-02T21:07:24.274543] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-07. [2025-10-02T21:07:24.278690] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-10-02T21:07:25.073008] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-05. [2025-10-02T21:07:25.113387] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-09 (2.44 seconds). [2025-10-02T21:07:25.206045] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-02T21:07:25.243386] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-02T21:07:25.873022] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-06. [2025-10-02T21:07:26.673007] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-10. [2025-10-02T21:07:27.147368] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-02T21:07:27.149060] [INFO ] [REMOTE ] QBTS: Full fetch complete (77533 records). [2025-10-02T21:07:27.149170] [DEBUG] [VALIDATOR ] QBTS: Validating primary data. [2025-10-02T21:07:27.150439] [FATAL] [VALIDATOR ] QBTS: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T21:07:27.150535] [FATAL] [MAIN ] QBTS: Fetched primary data is invalid. Refusing to save it. [2025-10-02T21:07:27.150581] [WARN ] [MAIN ] QBTS: Deleting existing primary and derivative data due to validation failure. [2025-10-02T21:07:27.150623] [INFO ] [LOCAL ] QBTS: Starting deletion of primary data. [2025-10-02T21:07:27.150750] [DEBUG] [LOCAL ] QBTS: No primary data file found to delete. [2025-10-02T21:07:27.150840] [INFO ] [LOCAL ] QBTS: Starting deletion of derivative data. [2025-10-02T21:07:27.150908] [DEBUG] [LOCAL ] QBTS: No derivative data file found to delete. [2025-10-02T21:07:27.151013] [INFO ] [MAIN ] Update Progress: 1755/2370 symbols completed. QBTS took 43.6s. Estimated remaining: 1h 26m 42s. Rate: 7.1 symbols/min [2025-10-02T21:07:27.346013] [INFO ] [MAIN ] QSR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:07:27.346423] [DEBUG] [LOCAL ] QSR: No existing data file found in primary storage. [2025-10-02T21:07:27.346522] [WARN ] [MAIN ] QSR: No existing data found, performing full refresh instead. [2025-10-02T21:07:27.346776] [INFO ] [MAIN ] QSR: Wiping existing primary data before full refresh. [2025-10-02T21:07:27.346916] [INFO ] [LOCAL ] QSR: Starting deletion of primary data. [2025-10-02T21:07:27.347100] [DEBUG] [LOCAL ] QSR: No primary data file found to delete. [2025-10-02T21:07:27.347169] [INFO ] [MAIN ] QSR: Starting full primary refresh. [2025-10-02T21:07:27.477565] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-08. [2025-10-02T21:07:27.569675] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-10-02T21:07:27.806268] [INFO ] [REMOTE ] QSR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:07:27.836423] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-02T21:07:28.273005] [INFO ] [REMOTE ] QSR: Fetching primary data for 2024-12. [2025-10-02T21:07:29.072984] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-06. [2025-10-02T21:07:29.241760] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-02T21:07:29.873057] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-07. [2025-10-02T21:07:30.224922] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-02T21:07:30.672996] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-01. [2025-10-02T21:07:31.347596] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-10-02T21:07:31.473019] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-09. [2025-10-02T21:07:31.769424] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-02T21:07:32.272978] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-07. [2025-10-02T21:07:32.553377] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-02T21:07:32.797285] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-02T21:07:33.073007] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-10. [2025-10-02T21:07:33.873007] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-08. [2025-10-02T21:07:33.877930] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-02T21:07:33.879963] [INFO ] [REMOTE ] QD: Full fetch complete (40274 records). [2025-10-02T21:07:33.880154] [DEBUG] [VALIDATOR ] QD: Validating primary data. [2025-10-02T21:07:34.295510] [DEBUG] [VALIDATOR ] QD: All expected trading days are present. [2025-10-02T21:07:34.295604] [DEBUG] [VALIDATOR ] QD: Primary data validation passed. [2025-10-02T21:07:34.296500] [INFO ] [MAIN ] QD: Fetched primary data is valid. [2025-10-02T21:07:34.296565] [DEBUG] [LOCAL ] QD: Saving primary data. [2025-10-02T21:07:34.297567] [DEBUG] [LOCAL ] QD: Trimmed 40274 records to 28148 (keeping 200 days of data) [2025-10-02T21:07:34.463007] [DEBUG] [LOCAL ] QD: Primary data saved (28148 records). [2025-10-02T21:07:34.463157] [INFO ] [MAIN ] QD: Full history saved. [2025-10-02T21:07:34.463238] [INFO ] [MAIN ] Update Progress: 1756/2370 symbols completed. QD took 31.9s. Estimated remaining: 1h 26m 33s. Rate: 7.1 symbols/min [2025-10-02T21:07:34.649807] [INFO ] [MAIN ] QTWO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:07:34.650019] [DEBUG] [LOCAL ] QTWO: No existing data file found in primary storage. [2025-10-02T21:07:34.650064] [WARN ] [MAIN ] QTWO: No existing data found, performing full refresh instead. [2025-10-02T21:07:34.650182] [INFO ] [MAIN ] QTWO: Wiping existing primary data before full refresh. [2025-10-02T21:07:34.650225] [INFO ] [LOCAL ] QTWO: Starting deletion of primary data. [2025-10-02T21:07:34.650267] [DEBUG] [LOCAL ] QTWO: No primary data file found to delete. [2025-10-02T21:07:34.650301] [INFO ] [MAIN ] QTWO: Starting full primary refresh. [2025-10-02T21:07:34.684737] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-02. [2025-10-02T21:07:35.047563] [INFO ] [REMOTE ] QTWO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:07:35.237543] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-07 (2.96 seconds). [2025-10-02T21:07:35.472992] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2024-12. [2025-10-02T21:07:35.709878] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-02T21:07:36.273006] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-08. [2025-10-02T21:07:36.693058] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-02T21:07:36.872853] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-02T21:07:37.073011] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-03. [2025-10-02T21:07:37.872994] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-01. [2025-10-02T21:07:38.657744] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-10-02T21:07:38.672958] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-09. [2025-10-02T21:07:38.872599] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-02T21:07:39.222602] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-02T21:07:39.472999] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-02. [2025-10-02T21:07:40.273000] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-09. [2025-10-02T21:07:41.027575] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-02T21:07:41.072968] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-03. [2025-10-02T21:07:41.482407] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-09 (2.81 seconds). [2025-10-02T21:07:41.872993] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-10. [2025-10-02T21:07:42.106148] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-02T21:07:42.325209] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-02T21:07:42.673002] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-04. [2025-10-02T21:07:43.473042] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-10. [2025-10-02T21:07:44.110206] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-10 (2.24 seconds). [2025-10-02T21:07:44.113143] [INFO ] [REMOTE ] QS: Full fetch complete (77886 records). [2025-10-02T21:07:44.113335] [DEBUG] [VALIDATOR ] QS: Validating primary data. [2025-10-02T21:07:44.290307] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-04. [2025-10-02T21:07:44.563967] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-02T21:07:44.598744] [DEBUG] [VALIDATOR ] QS: All expected trading days are present. [2025-10-02T21:07:44.598858] [DEBUG] [VALIDATOR ] QS: Primary data validation passed. [2025-10-02T21:07:44.600461] [INFO ] [MAIN ] QS: Fetched primary data is valid. [2025-10-02T21:07:44.600568] [DEBUG] [LOCAL ] QS: Saving primary data. [2025-10-02T21:07:44.603717] [DEBUG] [LOCAL ] QS: Trimmed 77886 records to 54133 (keeping 200 days of data) [2025-10-02T21:07:44.937796] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-02T21:07:44.946003] [INFO ] [REMOTE ] QGEN: Full fetch complete (70195 records). [2025-10-02T21:07:44.947320] [DEBUG] [VALIDATOR ] QGEN: Validating primary data. [2025-10-02T21:07:45.075066] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-05. [2025-10-02T21:07:45.135146] [DEBUG] [LOCAL ] QS: Primary data saved (54133 records). [2025-10-02T21:07:45.152993] [INFO ] [MAIN ] QS: Full history saved. [2025-10-02T21:07:45.176772] [INFO ] [MAIN ] Update Progress: 1757/2370 symbols completed. QS took 36.8s. Estimated remaining: 1h 26m 25s. Rate: 7.1 symbols/min [2025-10-02T21:07:45.412301] [DEBUG] [VALIDATOR ] QGEN: All expected trading days are present. [2025-10-02T21:07:45.412398] [DEBUG] [VALIDATOR ] QGEN: Primary data validation passed. [2025-10-02T21:07:45.413611] [INFO ] [MAIN ] QGEN: Fetched primary data is valid. [2025-10-02T21:07:45.413708] [DEBUG] [LOCAL ] QGEN: Saving primary data. [2025-10-02T21:07:45.415880] [DEBUG] [LOCAL ] QGEN: Trimmed 70195 records to 49452 (keeping 200 days of data) [2025-10-02T21:07:45.745416] [DEBUG] [LOCAL ] QGEN: Primary data saved (49452 records). [2025-10-02T21:07:45.745555] [INFO ] [MAIN ] QGEN: Full history saved. [2025-10-02T21:07:45.745637] [INFO ] [MAIN ] Update Progress: 1758/2370 symbols completed. QGEN took 41.8s. Estimated remaining: 1h 26m 14s. Rate: 7.1 symbols/min [2025-10-02T21:07:46.380790] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-02T21:07:46.392535] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-05. [2025-10-02T21:07:46.675552] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-02T21:07:46.684614] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-06. [2025-10-02T21:07:48.146879] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-02T21:07:48.154682] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-07. [2025-10-02T21:07:48.252612] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-02T21:07:48.272976] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-06. [2025-10-02T21:07:49.322830] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-02T21:07:49.330810] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-08. [2025-10-02T21:07:50.027285] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-02T21:07:50.038334] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-07. [2025-10-02T21:07:50.534587] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-02T21:07:50.673008] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-09. [2025-10-02T21:07:51.896209] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-02T21:07:51.908607] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-08. [2025-10-02T21:07:52.429994] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-02T21:07:52.440819] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-10. [2025-10-02T21:07:53.820405] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-02T21:07:53.832366] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-09. [2025-10-02T21:07:53.858305] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-02T21:07:53.860921] [INFO ] [REMOTE ] QTWO: Full fetch complete (57436 records). [2025-10-02T21:07:53.861083] [DEBUG] [VALIDATOR ] QTWO: Validating primary data. [2025-10-02T21:07:54.281239] [DEBUG] [VALIDATOR ] QTWO: All expected trading days are present. [2025-10-02T21:07:54.281342] [DEBUG] [VALIDATOR ] QTWO: Primary data validation passed. [2025-10-02T21:07:54.282681] [INFO ] [MAIN ] QTWO: Fetched primary data is valid. [2025-10-02T21:07:54.282754] [DEBUG] [LOCAL ] QTWO: Saving primary data. [2025-10-02T21:07:54.284083] [DEBUG] [LOCAL ] QTWO: Trimmed 57436 records to 39408 (keeping 200 days of data) [2025-10-02T21:07:54.544858] [DEBUG] [LOCAL ] QTWO: Primary data saved (39408 records). [2025-10-02T21:07:54.545017] [INFO ] [MAIN ] QTWO: Full history saved. [2025-10-02T21:07:54.545093] [INFO ] [MAIN ] Update Progress: 1759/2370 symbols completed. QTWO took 20.1s. Estimated remaining: 1h 26m 5s. Rate: 7.1 symbols/min [2025-10-02T21:07:55.752373] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-02T21:07:55.766784] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-10. [2025-10-02T21:07:57.272738] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-02T21:07:57.274943] [INFO ] [REMOTE ] QSR: Full fetch complete (75845 records). [2025-10-02T21:07:57.275176] [DEBUG] [VALIDATOR ] QSR: Validating primary data. [2025-10-02T21:07:57.722048] [DEBUG] [VALIDATOR ] QSR: All expected trading days are present. [2025-10-02T21:07:57.722135] [DEBUG] [VALIDATOR ] QSR: Primary data validation passed. [2025-10-02T21:07:57.723311] [INFO ] [MAIN ] QSR: Fetched primary data is valid. [2025-10-02T21:07:57.723379] [DEBUG] [LOCAL ] QSR: Saving primary data. [2025-10-02T21:07:57.725042] [DEBUG] [LOCAL ] QSR: Trimmed 75845 records to 52816 (keeping 200 days of data) [2025-10-02T21:07:58.075794] [DEBUG] [LOCAL ] QSR: Primary data saved (52816 records). [2025-10-02T21:07:58.075937] [INFO ] [MAIN ] QSR: Full history saved. [2025-10-02T21:07:58.076015] [INFO ] [MAIN ] Update Progress: 1760/2370 symbols completed. QSR took 30.9s. Estimated remaining: 1h 25m 55s. Rate: 7.1 symbols/min [2025-10-02T21:07:58.615253] [INFO ] [MAIN ] QXO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:07:58.713296] [DEBUG] [LOCAL ] QXO: No existing data file found in primary storage. [2025-10-02T21:07:58.719445] [INFO ] [MAIN ] QUAD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:07:58.776885] [WARN ] [MAIN ] QXO: No existing data found, performing full refresh instead. [2025-10-02T21:07:58.787195] [INFO ] [MAIN ] QXO: Wiping existing primary data before full refresh. [2025-10-02T21:07:58.787024] [DEBUG] [LOCAL ] QUAD: No existing data file found in primary storage. [2025-10-02T21:07:58.810775] [INFO ] [MAIN ] QVCC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:07:58.807123] [WARN ] [MAIN ] QUAD: No existing data found, performing full refresh instead. [2025-10-02T21:07:58.828191] [INFO ] [LOCAL ] QXO: Starting deletion of primary data. [2025-10-02T21:07:58.831379] [INFO ] [MAIN ] QUAD: Wiping existing primary data before full refresh. [2025-10-02T21:07:58.832746] [INFO ] [LOCAL ] QUAD: Starting deletion of primary data. [2025-10-02T21:07:58.831268] [DEBUG] [LOCAL ] QVCC: No existing data file found in primary storage. [2025-10-02T21:07:58.832937] [DEBUG] [LOCAL ] QXO: No primary data file found to delete. [2025-10-02T21:07:58.832617] [INFO ] [MAIN ] QVCD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:07:58.833371] [DEBUG] [LOCAL ] QVCD: No existing data file found in primary storage. [2025-10-02T21:07:58.833249] [WARN ] [MAIN ] QVCC: No existing data found, performing full refresh instead. [2025-10-02T21:07:58.833583] [DEBUG] [LOCAL ] QUAD: No primary data file found to delete. [2025-10-02T21:07:58.833457] [INFO ] [MAIN ] QXO: Starting full primary refresh. [2025-10-02T21:07:58.833899] [WARN ] [MAIN ] QVCD: No existing data found, performing full refresh instead. [2025-10-02T21:07:58.833826] [INFO ] [MAIN ] QUAD: Starting full primary refresh. [2025-10-02T21:07:58.834068] [INFO ] [MAIN ] QVCC: Wiping existing primary data before full refresh. [2025-10-02T21:07:58.860463] [INFO ] [MAIN ] QVCD: Wiping existing primary data before full refresh. [2025-10-02T21:07:58.875599] [INFO ] [LOCAL ] QVCC: Starting deletion of primary data. [2025-10-02T21:07:58.907957] [DEBUG] [LOCAL ] QVCC: No primary data file found to delete. [2025-10-02T21:07:58.908134] [INFO ] [LOCAL ] QVCD: Starting deletion of primary data. [2025-10-02T21:07:58.918726] [INFO ] [MAIN ] QVCC: Starting full primary refresh. [2025-10-02T21:07:59.047389] [DEBUG] [LOCAL ] QVCD: No primary data file found to delete. [2025-10-02T21:07:59.125071] [INFO ] [MAIN ] QVCD: Starting full primary refresh. [2025-10-02T21:08:00.261161] [INFO ] [REMOTE ] QUAD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:08:00.328253] [INFO ] [REMOTE ] QXO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:08:00.372302] [INFO ] [REMOTE ] QVCC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:08:00.377795] [INFO ] [REMOTE ] QXO: Fetching primary data for 2024-12. [2025-10-02T21:08:00.369109] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2024-12. [2025-10-02T21:08:00.394252] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2024-12. [2025-10-02T21:08:00.442050] [INFO ] [REMOTE ] QVCD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:08:00.443154] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2024-12. [2025-10-02T21:08:01.324945] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-02T21:08:01.326931] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-01. [2025-10-02T21:08:01.366609] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-02T21:08:01.369412] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-01. [2025-10-02T21:08:01.902514] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-02T21:08:01.908611] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-01. [2025-10-02T21:08:02.028437] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-02T21:08:02.030919] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-02. [2025-10-02T21:08:02.106521] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-02T21:08:02.107978] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-02. [2025-10-02T21:08:02.262701] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-02T21:08:02.274016] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-01. [2025-10-02T21:08:02.671317] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-02T21:08:02.672944] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-03. [2025-10-02T21:08:02.694051] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-02T21:08:03.126927] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-02T21:08:03.377492] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-02T21:08:03.473034] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-02. [2025-10-02T21:08:03.761371] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-02T21:08:04.272999] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-02. [2025-10-02T21:08:04.688565] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-02T21:08:05.073027] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-04. [2025-10-02T21:08:05.591405] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-02T21:08:05.873016] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-05. [2025-10-02T21:08:06.054803] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-02T21:08:06.672988] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-03. [2025-10-02T21:08:06.768268] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-02T21:08:07.473024] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-03. [2025-10-02T21:08:07.584725] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-02T21:08:08.273025] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-06. [2025-10-02T21:08:08.942512] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-02T21:08:09.073003] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-04. [2025-10-02T21:08:09.556079] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-02T21:08:09.675814] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-02T21:08:09.873020] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-03. [2025-10-02T21:08:10.673060] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-04. [2025-10-02T21:08:11.121205] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-02T21:08:11.473021] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-04. [2025-10-02T21:08:12.231867] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-02T21:08:12.272973] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-05. [2025-10-02T21:08:12.795282] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-02T21:08:13.073059] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-07. [2025-10-02T21:08:13.717317] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-02T21:08:13.873060] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-05. [2025-10-02T21:08:14.193188] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-02T21:08:14.673084] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-08. [2025-10-02T21:08:14.747113] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-02T21:08:15.412478] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-02T21:08:15.473061] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-09. [2025-10-02T21:08:16.044272] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-02T21:08:16.272999] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-06. [2025-10-02T21:08:17.073013] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-10. [2025-10-02T21:08:17.619746] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-02T21:08:17.620590] [INFO ] [REMOTE ] QVCD: Full fetch complete (6208 records). [2025-10-02T21:08:17.620735] [DEBUG] [VALIDATOR ] QVCD: Validating primary data. [2025-10-02T21:08:17.878160] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-06. [2025-10-02T21:08:18.045730] [DEBUG] [VALIDATOR ] QVCD: All expected trading days are present. [2025-10-02T21:08:18.045835] [DEBUG] [VALIDATOR ] QVCD: Primary data validation passed. [2025-10-02T21:08:18.046040] [INFO ] [MAIN ] QVCD: Fetched primary data is valid. [2025-10-02T21:08:18.046157] [DEBUG] [LOCAL ] QVCD: Saving primary data. [2025-10-02T21:08:18.047183] [DEBUG] [LOCAL ] QVCD: Trimmed 6208 records to 4541 (keeping 200 days of data) [2025-10-02T21:08:18.117716] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-02T21:08:18.133084] [DEBUG] [LOCAL ] QVCD: Primary data saved (4541 records). [2025-10-02T21:08:18.133619] [INFO ] [MAIN ] QVCD: Full history saved. [2025-10-02T21:08:18.133771] [INFO ] [MAIN ] Update Progress: 1761/2370 symbols completed. QVCD took 20.1s. Estimated remaining: 1h 25m 51s. Rate: 7.1 symbols/min [2025-10-02T21:08:18.346971] [INFO ] [MAIN ] R: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:08:18.347172] [DEBUG] [LOCAL ] R: No existing data file found in primary storage. [2025-10-02T21:08:18.347229] [WARN ] [MAIN ] R: No existing data found, performing full refresh instead. [2025-10-02T21:08:18.347344] [INFO ] [MAIN ] R: Wiping existing primary data before full refresh. [2025-10-02T21:08:18.347387] [INFO ] [LOCAL ] R: Starting deletion of primary data. [2025-10-02T21:08:18.347429] [DEBUG] [LOCAL ] R: No primary data file found to delete. [2025-10-02T21:08:18.347462] [INFO ] [MAIN ] R: Starting full primary refresh. [2025-10-02T21:08:18.681733] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-05. [2025-10-02T21:08:18.787590] [INFO ] [REMOTE ] R: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:08:18.891446] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-02T21:08:19.473020] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-07. [2025-10-02T21:08:20.144556] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-02T21:08:20.273032] [INFO ] [REMOTE ] R: Fetching primary data for 2024-12. [2025-10-02T21:08:21.073018] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-06. [2025-10-02T21:08:21.382173] [INFO ] [REMOTE ] R: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-02T21:08:21.733322] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-02T21:08:21.872998] [INFO ] [REMOTE ] R: Fetching primary data for 2025-01. [2025-10-02T21:08:22.363485] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-02T21:08:22.672985] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-07. [2025-10-02T21:08:23.268819] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-02T21:08:23.473051] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-07. [2025-10-02T21:08:23.851392] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-02T21:08:24.075402] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-02T21:08:24.273014] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-08. [2025-10-02T21:08:25.073007] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-08. [2025-10-02T21:08:25.143110] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-02T21:08:25.873009] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-08. [2025-10-02T21:08:26.673050] [INFO ] [REMOTE ] R: Fetching primary data for 2025-02. [2025-10-02T21:08:27.204422] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-02T21:08:27.233530] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-02T21:08:27.472997] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-09. [2025-10-02T21:08:27.752711] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-02T21:08:28.273003] [INFO ] [REMOTE ] R: Fetching primary data for 2025-03. [2025-10-02T21:08:29.072998] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-09. [2025-10-02T21:08:29.587508] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-02T21:08:29.872985] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-09. [2025-10-02T21:08:29.921205] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-10-02T21:08:30.181372] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-02T21:08:30.672976] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-10. [2025-10-02T21:08:30.709318] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-02T21:08:31.473800] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-10. [2025-10-02T21:08:31.474027] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-02T21:08:31.476540] [INFO ] [REMOTE ] QUAD: Full fetch complete (34463 records). [2025-10-02T21:08:31.476631] [DEBUG] [VALIDATOR ] QUAD: Validating primary data. [2025-10-02T21:08:31.886206] [DEBUG] [VALIDATOR ] QUAD: All expected trading days are present. [2025-10-02T21:08:31.886291] [DEBUG] [VALIDATOR ] QUAD: Primary data validation passed. [2025-10-02T21:08:31.887094] [INFO ] [MAIN ] QUAD: Fetched primary data is valid. [2025-10-02T21:08:31.887160] [DEBUG] [LOCAL ] QUAD: Saving primary data. [2025-10-02T21:08:31.888154] [DEBUG] [LOCAL ] QUAD: Trimmed 34463 records to 23572 (keeping 200 days of data) [2025-10-02T21:08:32.043187] [DEBUG] [LOCAL ] QUAD: Primary data saved (23572 records). [2025-10-02T21:08:32.043361] [INFO ] [MAIN ] QUAD: Full history saved. [2025-10-02T21:08:32.043485] [INFO ] [MAIN ] Update Progress: 1762/2370 symbols completed. QUAD took 34.0s. Estimated remaining: 1h 25m 44s. Rate: 7.1 symbols/min [2025-10-02T21:08:32.226135] [INFO ] [MAIN ] RA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:08:32.226330] [DEBUG] [LOCAL ] RA: No existing data file found in primary storage. [2025-10-02T21:08:32.226370] [WARN ] [MAIN ] RA: No existing data found, performing full refresh instead. [2025-10-02T21:08:32.226491] [INFO ] [MAIN ] RA: Wiping existing primary data before full refresh. [2025-10-02T21:08:32.226533] [INFO ] [LOCAL ] RA: Starting deletion of primary data. [2025-10-02T21:08:32.226577] [DEBUG] [LOCAL ] RA: No primary data file found to delete. [2025-10-02T21:08:32.226610] [INFO ] [MAIN ] RA: Starting full primary refresh. [2025-10-02T21:08:32.284514] [INFO ] [REMOTE ] R: Fetching primary data for 2025-04. [2025-10-02T21:08:32.631324] [INFO ] [REMOTE ] RA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:08:33.073028] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-10. [2025-10-02T21:08:33.105154] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-02T21:08:33.107381] [INFO ] [REMOTE ] QXO: Full fetch complete (75604 records). [2025-10-02T21:08:33.107519] [DEBUG] [VALIDATOR ] QXO: Validating primary data. [2025-10-02T21:08:33.565851] [DEBUG] [VALIDATOR ] QXO: All expected trading days are present. [2025-10-02T21:08:33.565944] [DEBUG] [VALIDATOR ] QXO: Primary data validation passed. [2025-10-02T21:08:33.567293] [INFO ] [MAIN ] QXO: Fetched primary data is valid. [2025-10-02T21:08:33.567366] [DEBUG] [LOCAL ] QXO: Saving primary data. [2025-10-02T21:08:33.568993] [DEBUG] [LOCAL ] QXO: Trimmed 75604 records to 53656 (keeping 200 days of data) [2025-10-02T21:08:33.751715] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-02T21:08:33.762507] [INFO ] [REMOTE ] QVCC: Full fetch complete (12028 records). [2025-10-02T21:08:33.790246] [DEBUG] [VALIDATOR ] QVCC: Validating primary data. [2025-10-02T21:08:33.875706] [INFO ] [REMOTE ] RA: Fetching primary data for 2024-12. [2025-10-02T21:08:34.273717] [DEBUG] [VALIDATOR ] QVCC: All expected trading days are present. [2025-10-02T21:08:34.275079] [DEBUG] [VALIDATOR ] QVCC: Primary data validation passed. [2025-10-02T21:08:34.276243] [INFO ] [MAIN ] QVCC: Fetched primary data is valid. [2025-10-02T21:08:34.276465] [DEBUG] [LOCAL ] QVCC: Saving primary data. [2025-10-02T21:08:34.301957] [DEBUG] [LOCAL ] QVCC: Trimmed 12028 records to 8967 (keeping 200 days of data) [2025-10-02T21:08:34.306016] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-02T21:08:34.452486] [DEBUG] [LOCAL ] QVCC: Primary data saved (8967 records). [2025-10-02T21:08:34.453897] [INFO ] [MAIN ] QVCC: Full history saved. [2025-10-02T21:08:34.454369] [INFO ] [MAIN ] Update Progress: 1763/2370 symbols completed. QVCC took 36.4s. Estimated remaining: 1h 25m 34s. Rate: 7.1 symbols/min [2025-10-02T21:08:34.654989] [INFO ] [MAIN ] RACE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:08:34.656888] [DEBUG] [LOCAL ] RACE: No existing data file found in primary storage. [2025-10-02T21:08:34.656972] [WARN ] [MAIN ] RACE: No existing data found, performing full refresh instead. [2025-10-02T21:08:34.658221] [INFO ] [MAIN ] RACE: Wiping existing primary data before full refresh. [2025-10-02T21:08:34.658302] [INFO ] [LOCAL ] RACE: Starting deletion of primary data. [2025-10-02T21:08:34.658380] [DEBUG] [LOCAL ] RACE: No primary data file found to delete. [2025-10-02T21:08:34.658881] [INFO ] [MAIN ] RACE: Starting full primary refresh. [2025-10-02T21:08:34.683324] [INFO ] [REMOTE ] R: Fetching primary data for 2025-05. [2025-10-02T21:08:34.789679] [DEBUG] [LOCAL ] QXO: Primary data saved (53656 records). [2025-10-02T21:08:34.795608] [INFO ] [MAIN ] QXO: Full history saved. [2025-10-02T21:08:34.806045] [INFO ] [MAIN ] Update Progress: 1764/2370 symbols completed. QXO took 36.7s. Estimated remaining: 1h 25m 22s. Rate: 7.1 symbols/min [2025-10-02T21:08:35.196149] [INFO ] [MAIN ] RAMP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:08:35.211758] [DEBUG] [LOCAL ] RAMP: No existing data file found in primary storage. [2025-10-02T21:08:35.217062] [WARN ] [MAIN ] RAMP: No existing data found, performing full refresh instead. [2025-10-02T21:08:35.217250] [INFO ] [MAIN ] RAMP: Wiping existing primary data before full refresh. [2025-10-02T21:08:35.217388] [INFO ] [LOCAL ] RAMP: Starting deletion of primary data. [2025-10-02T21:08:35.243556] [DEBUG] [LOCAL ] RAMP: No primary data file found to delete. [2025-10-02T21:08:35.279037] [INFO ] [REMOTE ] RACE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:08:35.275629] [INFO ] [MAIN ] RAMP: Starting full primary refresh. [2025-10-02T21:08:35.386123] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-02T21:08:35.474617] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-01. [2025-10-02T21:08:35.706992] [INFO ] [REMOTE ] RAMP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:08:36.132737] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-02T21:08:36.273005] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2024-12. [2025-10-02T21:08:36.819735] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-02T21:08:37.072999] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-02. [2025-10-02T21:08:37.421957] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-02T21:08:37.873002] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-01. [2025-10-02T21:08:38.203389] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-02T21:08:38.672980] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-03. [2025-10-02T21:08:39.353067] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-02T21:08:39.472994] [INFO ] [REMOTE ] R: Fetching primary data for 2025-06. [2025-10-02T21:08:39.928245] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-02T21:08:40.273014] [INFO ] [REMOTE ] RACE: Fetching primary data for 2024-12. [2025-10-02T21:08:40.558146] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-02T21:08:41.073044] [INFO ] [REMOTE ] R: Fetching primary data for 2025-07. [2025-10-02T21:08:41.786382] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-02T21:08:41.873008] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-04. [2025-10-02T21:08:42.247488] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-02T21:08:42.672993] [INFO ] [REMOTE ] R: Fetching primary data for 2025-08. [2025-10-02T21:08:43.191692] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-02T21:08:43.473045] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-05. [2025-10-02T21:08:43.936907] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-02T21:08:44.272974] [INFO ] [REMOTE ] R: Fetching primary data for 2025-09. [2025-10-02T21:08:44.650901] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-02T21:08:45.073003] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-06. [2025-10-02T21:08:45.602293] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-02T21:08:45.872974] [INFO ] [REMOTE ] R: Fetching primary data for 2025-10. [2025-10-02T21:08:45.976541] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-02T21:08:46.672988] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-01. [2025-10-02T21:08:46.864720] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-02T21:08:46.866146] [INFO ] [REMOTE ] R: Full fetch complete (42230 records). [2025-10-02T21:08:46.866254] [DEBUG] [VALIDATOR ] R: Validating primary data. [2025-10-02T21:08:47.308818] [DEBUG] [VALIDATOR ] R: All expected trading days are present. [2025-10-02T21:08:47.308935] [DEBUG] [VALIDATOR ] R: Primary data validation passed. [2025-10-02T21:08:47.309772] [INFO ] [MAIN ] R: Fetched primary data is valid. [2025-10-02T21:08:47.309839] [DEBUG] [LOCAL ] R: Saving primary data. [2025-10-02T21:08:47.311017] [DEBUG] [LOCAL ] R: Trimmed 42230 records to 29158 (keeping 200 days of data) [2025-10-02T21:08:47.476819] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-07. [2025-10-02T21:08:47.508901] [DEBUG] [LOCAL ] R: Primary data saved (29158 records). [2025-10-02T21:08:47.509010] [INFO ] [MAIN ] R: Full history saved. [2025-10-02T21:08:47.509082] [INFO ] [MAIN ] Update Progress: 1765/2370 symbols completed. R took 29.4s. Estimated remaining: 1h 25m 15s. Rate: 7.1 symbols/min [2025-10-02T21:08:47.695276] [INFO ] [MAIN ] RBA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:08:47.695443] [DEBUG] [LOCAL ] RBA: No existing data file found in primary storage. [2025-10-02T21:08:47.695482] [WARN ] [MAIN ] RBA: No existing data found, performing full refresh instead. [2025-10-02T21:08:47.695621] [INFO ] [MAIN ] RBA: Wiping existing primary data before full refresh. [2025-10-02T21:08:47.695708] [INFO ] [LOCAL ] RBA: Starting deletion of primary data. [2025-10-02T21:08:47.695783] [DEBUG] [LOCAL ] RBA: No primary data file found to delete. [2025-10-02T21:08:47.695894] [INFO ] [MAIN ] RBA: Starting full primary refresh. [2025-10-02T21:08:48.104667] [INFO ] [REMOTE ] RBA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:08:48.219335] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-02T21:08:48.273045] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-02. [2025-10-02T21:08:48.887283] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-02T21:08:49.072948] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-02. [2025-10-02T21:08:49.519817] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-02T21:08:49.873009] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-03. [2025-10-02T21:08:50.225205] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-02T21:08:50.673027] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-08. [2025-10-02T21:08:51.473048] [INFO ] [REMOTE ] RBA: Fetching primary data for 2024-12. [2025-10-02T21:08:51.667639] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-02T21:08:51.887049] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-02T21:08:52.273037] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-04. [2025-10-02T21:08:53.031864] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-02T21:08:53.072996] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-01. [2025-10-02T21:08:53.743315] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-02T21:08:53.872998] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-05. [2025-10-02T21:08:54.330546] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-02T21:08:54.673091] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-03. [2025-10-02T21:08:55.473012] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-09. [2025-10-02T21:08:55.638318] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-02T21:08:56.272974] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-06. [2025-10-02T21:08:56.373174] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-02T21:08:56.638607] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-02T21:08:57.073035] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-02. [2025-10-02T21:08:57.618984] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-02T21:08:57.873005] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-07. [2025-10-02T21:08:58.496804] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-02T21:08:58.672992] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-04. [2025-10-02T21:08:59.313604] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-02T21:08:59.472966] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-08. [2025-10-02T21:08:59.866267] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-02T21:09:00.273044] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-10. [2025-10-02T21:09:00.928185] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-02T21:09:01.073039] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-03. [2025-10-02T21:09:01.173441] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-02T21:09:01.175405] [INFO ] [REMOTE ] RA: Full fetch complete (32073 records). [2025-10-02T21:09:01.175552] [DEBUG] [VALIDATOR ] RA: Validating primary data. [2025-10-02T21:09:01.625052] [DEBUG] [VALIDATOR ] RA: All expected trading days are present. [2025-10-02T21:09:01.625367] [DEBUG] [VALIDATOR ] RA: Primary data validation passed. [2025-10-02T21:09:01.626266] [INFO ] [MAIN ] RA: Fetched primary data is valid. [2025-10-02T21:09:01.626334] [DEBUG] [LOCAL ] RA: Saving primary data. [2025-10-02T21:09:01.627382] [DEBUG] [LOCAL ] RA: Trimmed 32073 records to 21986 (keeping 200 days of data) [2025-10-02T21:09:01.788510] [DEBUG] [LOCAL ] RA: Primary data saved (21986 records). [2025-10-02T21:09:01.788712] [INFO ] [MAIN ] RA: Full history saved. [2025-10-02T21:09:01.788829] [INFO ] [MAIN ] Update Progress: 1766/2370 symbols completed. RA took 29.7s. Estimated remaining: 1h 25m 9s. Rate: 7.1 symbols/min [2025-10-02T21:09:01.881799] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-09. [2025-10-02T21:09:01.994097] [INFO ] [MAIN ] RBC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:09:01.994270] [DEBUG] [LOCAL ] RBC: No existing data file found in primary storage. [2025-10-02T21:09:01.994308] [WARN ] [MAIN ] RBC: No existing data found, performing full refresh instead. [2025-10-02T21:09:01.994467] [INFO ] [MAIN ] RBC: Wiping existing primary data before full refresh. [2025-10-02T21:09:01.994509] [INFO ] [LOCAL ] RBC: Starting deletion of primary data. [2025-10-02T21:09:01.994552] [DEBUG] [LOCAL ] RBC: No primary data file found to delete. [2025-10-02T21:09:01.994590] [INFO ] [MAIN ] RBC: Starting full primary refresh. [2025-10-02T21:09:02.404668] [INFO ] [REMOTE ] RBC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:09:02.672994] [INFO ] [REMOTE ] RBC: Fetching primary data for 2024-12. [2025-10-02T21:09:02.880298] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-02T21:09:03.472973] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-05. [2025-10-02T21:09:03.526717] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-02T21:09:03.650999] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-02T21:09:04.273022] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-01. [2025-10-02T21:09:04.827921] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-02T21:09:05.073044] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-06. [2025-10-02T21:09:05.244385] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-02T21:09:05.873007] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-10. [2025-10-02T21:09:06.283871] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-02T21:09:06.673060] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-04. [2025-10-02T21:09:07.181096] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-02T21:09:07.184850] [INFO ] [REMOTE ] RACE: Full fetch complete (47622 records). [2025-10-02T21:09:07.185054] [DEBUG] [VALIDATOR ] RACE: Validating primary data. [2025-10-02T21:09:07.476697] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-07. [2025-10-02T21:09:07.858999] [DEBUG] [VALIDATOR ] RACE: All expected trading days are present. [2025-10-02T21:09:07.859090] [DEBUG] [VALIDATOR ] RACE: Primary data validation passed. [2025-10-02T21:09:07.860055] [INFO ] [MAIN ] RACE: Fetched primary data is valid. [2025-10-02T21:09:07.860127] [DEBUG] [LOCAL ] RACE: Saving primary data. [2025-10-02T21:09:07.861635] [DEBUG] [LOCAL ] RACE: Trimmed 47622 records to 32781 (keeping 200 days of data) [2025-10-02T21:09:08.098102] [DEBUG] [LOCAL ] RACE: Primary data saved (32781 records). [2025-10-02T21:09:08.098254] [INFO ] [MAIN ] RACE: Full history saved. [2025-10-02T21:09:08.098334] [INFO ] [MAIN ] Update Progress: 1767/2370 symbols completed. RACE took 33.6s. Estimated remaining: 1h 24m 60s. Rate: 7.1 symbols/min [2025-10-02T21:09:08.273067] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-02. [2025-10-02T21:09:08.297786] [INFO ] [MAIN ] RBLX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:09:08.298109] [DEBUG] [LOCAL ] RBLX: No existing data file found in primary storage. [2025-10-02T21:09:08.298176] [WARN ] [MAIN ] RBLX: No existing data found, performing full refresh instead. [2025-10-02T21:09:08.298295] [INFO ] [MAIN ] RBLX: Wiping existing primary data before full refresh. [2025-10-02T21:09:08.298359] [INFO ] [LOCAL ] RBLX: Starting deletion of primary data. [2025-10-02T21:09:08.298431] [DEBUG] [LOCAL ] RBLX: No primary data file found to delete. [2025-10-02T21:09:08.298499] [INFO ] [MAIN ] RBLX: Starting full primary refresh. [2025-10-02T21:09:08.709830] [INFO ] [REMOTE ] RBLX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:09:08.751353] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-02T21:09:08.999201] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-02T21:09:09.073009] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-08. [2025-10-02T21:09:09.405409] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-02T21:09:09.873006] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-05. [2025-10-02T21:09:09.981012] [DEBUG] [REMOTE ] RBA: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-02T21:09:09.981334] [WARN ] [REMOTE ] RBA: No data returned for month 2025-05 [2025-10-02T21:09:09.981422] [FATAL] [REMOTE ] RBA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T21:09:09.981601] [FATAL] [MAIN ] RBA: Failed to fetch primary data. [2025-10-02T21:09:09.981701] [WARN ] [MAIN ] RBA: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T21:09:09.981788] [INFO ] [LOCAL ] RBA: Starting deletion of primary data. [2025-10-02T21:09:09.981854] [DEBUG] [LOCAL ] RBA: No primary data file found to delete. [2025-10-02T21:09:09.981897] [INFO ] [LOCAL ] RBA: Starting deletion of derivative data. [2025-10-02T21:09:09.981965] [DEBUG] [LOCAL ] RBA: No derivative data file found to delete. [2025-10-02T21:09:09.982035] [INFO ] [MAIN ] Update Progress: 1768/2370 symbols completed. RBA took 22.5s. Estimated remaining: 1h 24m 49s. Rate: 7.1 symbols/min [2025-10-02T21:09:10.168266] [INFO ] [MAIN ] RBOT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:09:10.168449] [DEBUG] [LOCAL ] RBOT: No existing data file found in primary storage. [2025-10-02T21:09:10.168488] [WARN ] [MAIN ] RBOT: No existing data found, performing full refresh instead. [2025-10-02T21:09:10.168602] [INFO ] [MAIN ] RBOT: Wiping existing primary data before full refresh. [2025-10-02T21:09:10.168666] [INFO ] [LOCAL ] RBOT: Starting deletion of primary data. [2025-10-02T21:09:10.168736] [DEBUG] [LOCAL ] RBOT: No primary data file found to delete. [2025-10-02T21:09:10.168772] [INFO ] [MAIN ] RBOT: Starting full primary refresh. [2025-10-02T21:09:10.565843] [INFO ] [REMOTE ] RBOT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:09:10.672987] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2024-12. [2025-10-02T21:09:10.809803] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-02T21:09:11.473015] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2024-12. [2025-10-02T21:09:11.576954] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-02T21:09:12.273014] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-01. [2025-10-02T21:09:13.072987] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-03. [2025-10-02T21:09:13.167743] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-02T21:09:13.832321] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2024-12 (2.36 seconds). [2025-10-02T21:09:13.873002] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-09. [2025-10-02T21:09:14.238250] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-02T21:09:14.672998] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-02. [2025-10-02T21:09:15.478930] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-04. [2025-10-02T21:09:15.483753] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-02T21:09:15.587745] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-02T21:09:16.273001] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-03. [2025-10-02T21:09:16.488896] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-02T21:09:17.011716] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-02T21:09:17.073000] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-10. [2025-10-02T21:09:17.872989] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-05. [2025-10-02T21:09:18.375952] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-02T21:09:18.377627] [INFO ] [REMOTE ] RAMP: Full fetch complete (53454 records). [2025-10-02T21:09:18.377740] [DEBUG] [VALIDATOR ] RAMP: Validating primary data. [2025-10-02T21:09:18.676728] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-01. [2025-10-02T21:09:18.832225] [DEBUG] [VALIDATOR ] RAMP: All expected trading days are present. [2025-10-02T21:09:18.833350] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-02T21:09:18.833457] [DEBUG] [VALIDATOR ] RAMP: Primary data validation passed. [2025-10-02T21:09:18.834667] [INFO ] [MAIN ] RAMP: Fetched primary data is valid. [2025-10-02T21:09:18.838595] [DEBUG] [LOCAL ] RAMP: Saving primary data. [2025-10-02T21:09:18.840318] [DEBUG] [LOCAL ] RAMP: Trimmed 53454 records to 37750 (keeping 200 days of data) [2025-10-02T21:09:19.076116] [DEBUG] [LOCAL ] RAMP: Primary data saved (37750 records). [2025-10-02T21:09:19.076267] [INFO ] [MAIN ] RAMP: Full history saved. [2025-10-02T21:09:19.076344] [INFO ] [MAIN ] Update Progress: 1769/2370 symbols completed. RAMP took 44.3s. Estimated remaining: 1h 24m 41s. Rate: 7.1 symbols/min [2025-10-02T21:09:19.261563] [INFO ] [MAIN ] RBRK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:09:19.261755] [DEBUG] [LOCAL ] RBRK: No existing data file found in primary storage. [2025-10-02T21:09:19.261803] [WARN ] [MAIN ] RBRK: No existing data found, performing full refresh instead. [2025-10-02T21:09:19.261925] [INFO ] [MAIN ] RBRK: Wiping existing primary data before full refresh. [2025-10-02T21:09:19.261967] [INFO ] [LOCAL ] RBRK: Starting deletion of primary data. [2025-10-02T21:09:19.262009] [DEBUG] [LOCAL ] RBRK: No primary data file found to delete. [2025-10-02T21:09:19.262043] [INFO ] [MAIN ] RBRK: Starting full primary refresh. [2025-10-02T21:09:19.478188] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-06. [2025-10-02T21:09:19.667164] [INFO ] [REMOTE ] RBRK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:09:20.272979] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-04. [2025-10-02T21:09:20.655970] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-02T21:09:20.885073] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-10-02T21:09:21.005233] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-02T21:09:21.073005] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-05. [2025-10-02T21:09:21.720167] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-02T21:09:21.873020] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-06. [2025-10-02T21:09:22.437138] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-02T21:09:22.673003] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-02. [2025-10-02T21:09:23.473036] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-07. [2025-10-02T21:09:24.272980] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2024-12. [2025-10-02T21:09:24.580211] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-02T21:09:24.978550] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-10-02T21:09:25.073002] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-03. [2025-10-02T21:09:25.872968] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-07. [2025-10-02T21:09:26.316608] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-02T21:09:26.673020] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-08. [2025-10-02T21:09:26.733058] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-02T21:09:27.345478] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-02T21:09:27.473042] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-01. [2025-10-02T21:09:27.790068] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-02T21:09:28.273041] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-08. [2025-10-02T21:09:29.072986] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-09. [2025-10-02T21:09:29.114686] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-02T21:09:29.447103] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-02T21:09:29.872984] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-02. [2025-10-02T21:09:30.113417] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-02T21:09:30.672988] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-10. [2025-10-02T21:09:31.374583] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-02T21:09:31.376170] [INFO ] [REMOTE ] RBC: Full fetch complete (21924 records). [2025-10-02T21:09:31.376245] [DEBUG] [VALIDATOR ] RBC: Validating primary data. [2025-10-02T21:09:31.478170] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-09. [2025-10-02T21:09:31.795503] [DEBUG] [VALIDATOR ] RBC: All expected trading days are present. [2025-10-02T21:09:31.795754] [DEBUG] [VALIDATOR ] RBC: Primary data validation passed. [2025-10-02T21:09:31.796422] [INFO ] [MAIN ] RBC: Fetched primary data is valid. [2025-10-02T21:09:31.796587] [DEBUG] [LOCAL ] RBC: Saving primary data. [2025-10-02T21:09:31.797995] [DEBUG] [LOCAL ] RBC: Trimmed 21924 records to 15344 (keeping 200 days of data) [2025-10-02T21:09:31.899392] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-02T21:09:31.938731] [DEBUG] [LOCAL ] RBC: Primary data saved (15344 records). [2025-10-02T21:09:31.938872] [INFO ] [MAIN ] RBC: Full history saved. [2025-10-02T21:09:31.938980] [INFO ] [MAIN ] Update Progress: 1770/2370 symbols completed. RBC took 30.1s. Estimated remaining: 1h 24m 34s. Rate: 7.1 symbols/min [2025-10-02T21:09:32.132603] [INFO ] [MAIN ] RC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:09:32.132838] [DEBUG] [LOCAL ] RC: No existing data file found in primary storage. [2025-10-02T21:09:32.132912] [WARN ] [MAIN ] RC: No existing data found, performing full refresh instead. [2025-10-02T21:09:32.133077] [INFO ] [MAIN ] RC: Wiping existing primary data before full refresh. [2025-10-02T21:09:32.133150] [INFO ] [LOCAL ] RC: Starting deletion of primary data. [2025-10-02T21:09:32.133242] [DEBUG] [LOCAL ] RC: No primary data file found to delete. [2025-10-02T21:09:32.133318] [INFO ] [MAIN ] RC: Starting full primary refresh. [2025-10-02T21:09:32.279372] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-04. [2025-10-02T21:09:32.477240] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-02T21:09:32.590428] [INFO ] [REMOTE ] RC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:09:33.073007] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-10. [2025-10-02T21:09:33.698737] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-02T21:09:33.700202] [INFO ] [REMOTE ] RBOT: Full fetch complete (8504 records). [2025-10-02T21:09:33.700306] [DEBUG] [VALIDATOR ] RBOT: Validating primary data. [2025-10-02T21:09:33.877158] [INFO ] [REMOTE ] RC: Fetching primary data for 2024-12. [2025-10-02T21:09:34.107828] [DEBUG] [VALIDATOR ] RBOT: All expected trading days are present. [2025-10-02T21:09:34.107913] [DEBUG] [VALIDATOR ] RBOT: Primary data validation passed. [2025-10-02T21:09:34.108195] [INFO ] [MAIN ] RBOT: Fetched primary data is valid. [2025-10-02T21:09:34.108259] [DEBUG] [LOCAL ] RBOT: Saving primary data. [2025-10-02T21:09:34.108728] [DEBUG] [LOCAL ] RBOT: Trimmed 8504 records to 5275 (keeping 200 days of data) [2025-10-02T21:09:34.141375] [DEBUG] [LOCAL ] RBOT: Primary data saved (5275 records). [2025-10-02T21:09:34.141522] [INFO ] [MAIN ] RBOT: Full history saved. [2025-10-02T21:09:34.141597] [INFO ] [MAIN ] Update Progress: 1771/2370 symbols completed. RBOT took 24.2s. Estimated remaining: 1h 24m 23s. Rate: 7.1 symbols/min [2025-10-02T21:09:34.324759] [INFO ] [MAIN ] RCB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:09:34.324939] [DEBUG] [LOCAL ] RCB: No existing data file found in primary storage. [2025-10-02T21:09:34.324983] [WARN ] [MAIN ] RCB: No existing data found, performing full refresh instead. [2025-10-02T21:09:34.325103] [INFO ] [MAIN ] RCB: Wiping existing primary data before full refresh. [2025-10-02T21:09:34.325146] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-10-02T21:09:34.325187] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-10-02T21:09:34.325219] [INFO ] [MAIN ] RCB: Starting full primary refresh. [2025-10-02T21:09:34.679318] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-03. [2025-10-02T21:09:34.728638] [INFO ] [REMOTE ] RCB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:09:34.762075] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-10-02T21:09:35.362802] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-02T21:09:35.472997] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-01. [2025-10-02T21:09:36.272983] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-05. [2025-10-02T21:09:36.446634] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-02T21:09:37.073028] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-04. [2025-10-02T21:09:37.285578] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-02T21:09:37.873024] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-02. [2025-10-02T21:09:38.630230] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-10-02T21:09:38.672959] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-06. [2025-10-02T21:09:39.293825] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-02T21:09:39.473003] [INFO ] [REMOTE ] RCB: Fetching primary data for 2024-12. [2025-10-02T21:09:39.540909] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-02T21:09:39.819983] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-10-02T21:09:40.272993] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-01. [2025-10-02T21:09:40.810540] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-02T21:09:41.072961] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-02. [2025-10-02T21:09:41.211805] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-06 (2.54 seconds). [2025-10-02T21:09:41.751040] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-02T21:09:41.873000] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-03. [2025-10-02T21:09:42.548760] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-02T21:09:42.672987] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-04. [2025-10-02T21:09:43.334770] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-02T21:09:43.472985] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-07. [2025-10-02T21:09:44.273059] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-03. [2025-10-02T21:09:45.073020] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-05. [2025-10-02T21:09:45.750803] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-02T21:09:45.873016] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-06. [2025-10-02T21:09:45.936937] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-02T21:09:46.040844] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-10-02T21:09:46.260256] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-02T21:09:46.672985] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-04. [2025-10-02T21:09:47.473051] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-07. [2025-10-02T21:09:47.833919] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-02T21:09:48.273042] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-08. [2025-10-02T21:09:48.574913] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-02T21:09:48.684065] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-02T21:09:49.073044] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-05. [2025-10-02T21:09:49.873008] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-08. [2025-10-02T21:09:50.672990] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-05. [2025-10-02T21:09:50.946017] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-02T21:09:51.473022] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-09. [2025-10-02T21:09:51.885492] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-02T21:09:52.215447] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-02T21:09:52.272999] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-10. [2025-10-02T21:09:52.487760] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-08 (2.61 seconds). [2025-10-02T21:09:52.622363] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-02T21:09:52.623129] [INFO ] [REMOTE ] RCB: Full fetch complete (3746 records). [2025-10-02T21:09:52.623202] [DEBUG] [VALIDATOR ] RCB: Validating primary data. [2025-10-02T21:09:52.845095] [WARN ] [VALIDATOR ] RCB: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-02T21:09:52.845310] [FATAL] [MAIN ] RCB: Fetched primary data is invalid. Refusing to save it. [2025-10-02T21:09:52.845383] [WARN ] [MAIN ] RCB: Deleting existing primary and derivative data due to validation failure. [2025-10-02T21:09:52.845491] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-10-02T21:09:52.845560] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-10-02T21:09:52.845600] [INFO ] [LOCAL ] RCB: Starting deletion of derivative data. [2025-10-02T21:09:52.845698] [DEBUG] [LOCAL ] RCB: No derivative data file found to delete. [2025-10-02T21:09:52.845775] [INFO ] [MAIN ] Update Progress: 1772/2370 symbols completed. RCB took 18.7s. Estimated remaining: 1h 24m 18s. Rate: 7.1 symbols/min [2025-10-02T21:09:53.059712] [INFO ] [MAIN ] RCD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:09:53.059892] [DEBUG] [LOCAL ] RCD: No existing data file found in primary storage. [2025-10-02T21:09:53.059932] [WARN ] [MAIN ] RCD: No existing data found, performing full refresh instead. [2025-10-02T21:09:53.060054] [INFO ] [MAIN ] RCD: Wiping existing primary data before full refresh. [2025-10-02T21:09:53.060098] [INFO ] [LOCAL ] RCD: Starting deletion of primary data. [2025-10-02T21:09:53.060142] [DEBUG] [LOCAL ] RCD: No primary data file found to delete. [2025-10-02T21:09:53.060177] [INFO ] [MAIN ] RCD: Starting full primary refresh. [2025-10-02T21:09:53.081755] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-06. [2025-10-02T21:09:53.445622] [INFO ] [REMOTE ] RCD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:09:53.873009] [INFO ] [REMOTE ] RCD: Fetching primary data for 2024-12. [2025-10-02T21:09:54.625197] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-02T21:09:54.672985] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-09. [2025-10-02T21:09:54.860519] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-02T21:09:55.472997] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-07. [2025-10-02T21:09:56.273040] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-06. [2025-10-02T21:09:57.027973] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-02T21:09:57.072983] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-08. [2025-10-02T21:09:57.439596] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-09 (2.77 seconds). [2025-10-02T21:09:57.873073] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-01. [2025-10-02T21:09:58.355182] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-02T21:09:58.658186] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-02T21:09:58.672970] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-07. [2025-10-02T21:09:58.957305] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-02T21:09:59.473068] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-02. [2025-10-02T21:09:59.999508] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-02T21:10:00.272973] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-03. [2025-10-02T21:10:00.548739] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-02T21:10:01.072979] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-10. [2025-10-02T21:10:01.134343] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-02T21:10:01.872960] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-09. [2025-10-02T21:10:02.673003] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-04. [2025-10-02T21:10:03.157425] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-02T21:10:03.160156] [INFO ] [REMOTE ] RBLX: Full fetch complete (77777 records). [2025-10-02T21:10:03.160329] [DEBUG] [VALIDATOR ] RBLX: Validating primary data. [2025-10-02T21:10:03.447043] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-02T21:10:03.475089] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-08. [2025-10-02T21:10:03.604836] [DEBUG] [VALIDATOR ] RBLX: All expected trading days are present. [2025-10-02T21:10:03.605006] [DEBUG] [VALIDATOR ] RBLX: Primary data validation passed. [2025-10-02T21:10:03.606171] [INFO ] [MAIN ] RBLX: Fetched primary data is valid. [2025-10-02T21:10:03.606282] [DEBUG] [LOCAL ] RBLX: Saving primary data. [2025-10-02T21:10:03.607983] [DEBUG] [LOCAL ] RBLX: Trimmed 77777 records to 54104 (keeping 200 days of data) [2025-10-02T21:10:03.883724] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-02T21:10:04.017989] [DEBUG] [LOCAL ] RBLX: Primary data saved (54104 records). [2025-10-02T21:10:04.018177] [INFO ] [MAIN ] RBLX: Full history saved. [2025-10-02T21:10:04.018261] [INFO ] [MAIN ] Update Progress: 1773/2370 symbols completed. RBLX took 55.9s. Estimated remaining: 1h 24m 11s. Rate: 7.1 symbols/min [2025-10-02T21:10:04.203926] [INFO ] [MAIN ] RCI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:10:04.204131] [DEBUG] [LOCAL ] RCI: No existing data file found in primary storage. [2025-10-02T21:10:04.204170] [WARN ] [MAIN ] RCI: No existing data found, performing full refresh instead. [2025-10-02T21:10:04.204333] [INFO ] [MAIN ] RCI: Wiping existing primary data before full refresh. [2025-10-02T21:10:04.204422] [INFO ] [LOCAL ] RCI: Starting deletion of primary data. [2025-10-02T21:10:04.204524] [DEBUG] [LOCAL ] RCI: No primary data file found to delete. [2025-10-02T21:10:04.204567] [INFO ] [MAIN ] RCI: Starting full primary refresh. [2025-10-02T21:10:04.282588] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-10. [2025-10-02T21:10:04.625850] [INFO ] [REMOTE ] RCI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:10:05.073011] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-05. [2025-10-02T21:10:05.414222] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-02T21:10:05.547447] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-02T21:10:05.827286] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-02T21:10:05.829347] [INFO ] [REMOTE ] RC: Full fetch complete (70862 records). [2025-10-02T21:10:05.829471] [DEBUG] [VALIDATOR ] RC: Validating primary data. [2025-10-02T21:10:05.878196] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-09. [2025-10-02T21:10:06.245298] [DEBUG] [VALIDATOR ] RC: All expected trading days are present. [2025-10-02T21:10:06.245425] [DEBUG] [VALIDATOR ] RC: Primary data validation passed. [2025-10-02T21:10:06.246757] [INFO ] [MAIN ] RC: Fetched primary data is valid. [2025-10-02T21:10:06.246835] [DEBUG] [LOCAL ] RC: Saving primary data. [2025-10-02T21:10:06.248516] [DEBUG] [LOCAL ] RC: Trimmed 70862 records to 49291 (keeping 200 days of data) [2025-10-02T21:10:06.555865] [DEBUG] [LOCAL ] RC: Primary data saved (49291 records). [2025-10-02T21:10:06.556013] [INFO ] [MAIN ] RC: Full history saved. [2025-10-02T21:10:06.556095] [INFO ] [MAIN ] Update Progress: 1774/2370 symbols completed. RC took 34.6s. Estimated remaining: 1h 24m 0s. Rate: 7.1 symbols/min [2025-10-02T21:10:06.672999] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-06. [2025-10-02T21:10:06.750872] [INFO ] [MAIN ] RCL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:10:06.751084] [DEBUG] [LOCAL ] RCL: No existing data file found in primary storage. [2025-10-02T21:10:06.751155] [WARN ] [MAIN ] RCL: No existing data found, performing full refresh instead. [2025-10-02T21:10:06.751278] [INFO ] [MAIN ] RCL: Wiping existing primary data before full refresh. [2025-10-02T21:10:06.751324] [INFO ] [LOCAL ] RCL: Starting deletion of primary data. [2025-10-02T21:10:06.751409] [DEBUG] [LOCAL ] RCL: No primary data file found to delete. [2025-10-02T21:10:06.751465] [INFO ] [MAIN ] RCL: Starting full primary refresh. [2025-10-02T21:10:07.139197] [INFO ] [REMOTE ] RCL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:10:07.460081] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-02T21:10:07.472957] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-07. [2025-10-02T21:10:08.109380] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-02T21:10:08.272981] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-08. [2025-10-02T21:10:08.314212] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-09 (2.44 seconds). [2025-10-02T21:10:09.050993] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-02T21:10:09.073001] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-10. [2025-10-02T21:10:09.873024] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-09. [2025-10-02T21:10:10.444785] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-02T21:10:10.672993] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-10. [2025-10-02T21:10:10.823344] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-02T21:10:10.825389] [INFO ] [REMOTE ] RBRK: Full fetch complete (76528 records). [2025-10-02T21:10:10.825496] [DEBUG] [VALIDATOR ] RBRK: Validating primary data. [2025-10-02T21:10:11.150793] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-02T21:10:11.162505] [INFO ] [REMOTE ] RCD: Full fetch complete (6934 records). [2025-10-02T21:10:11.178071] [DEBUG] [VALIDATOR ] RCD: Validating primary data. [2025-10-02T21:10:11.379157] [DEBUG] [VALIDATOR ] RBRK: All expected trading days are present. [2025-10-02T21:10:11.379542] [DEBUG] [VALIDATOR ] RBRK: Primary data validation passed. [2025-10-02T21:10:11.380755] [INFO ] [MAIN ] RBRK: Fetched primary data is valid. [2025-10-02T21:10:11.386258] [DEBUG] [LOCAL ] RBRK: Saving primary data. [2025-10-02T21:10:11.447036] [DEBUG] [LOCAL ] RBRK: Trimmed 76528 records to 53518 (keeping 200 days of data) [2025-10-02T21:10:11.471076] [WARN ] [VALIDATOR ] RCD: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-02T21:10:11.471698] [FATAL] [MAIN ] RCD: Fetched primary data is invalid. Refusing to save it. [2025-10-02T21:10:11.472078] [WARN ] [MAIN ] RCD: Deleting existing primary and derivative data due to validation failure. [2025-10-02T21:10:11.472216] [INFO ] [LOCAL ] RCD: Starting deletion of primary data. [2025-10-02T21:10:11.472326] [DEBUG] [LOCAL ] RCD: No primary data file found to delete. [2025-10-02T21:10:11.472385] [INFO ] [LOCAL ] RCD: Starting deletion of derivative data. [2025-10-02T21:10:11.472446] [DEBUG] [LOCAL ] RCD: No derivative data file found to delete. [2025-10-02T21:10:11.472545] [INFO ] [MAIN ] Update Progress: 1775/2370 symbols completed. RCD took 18.6s. Estimated remaining: 1h 23m 51s. Rate: 7.1 symbols/min [2025-10-02T21:10:11.478187] [INFO ] [REMOTE ] RCL: Fetching primary data for 2024-12. [2025-10-02T21:10:11.786711] [INFO ] [MAIN ] RCS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:10:11.792511] [DEBUG] [LOCAL ] RCS: No existing data file found in primary storage. [2025-10-02T21:10:11.792939] [WARN ] [MAIN ] RCS: No existing data found, performing full refresh instead. [2025-10-02T21:10:11.793445] [INFO ] [MAIN ] RCS: Wiping existing primary data before full refresh. [2025-10-02T21:10:11.794205] [INFO ] [LOCAL ] RCS: Starting deletion of primary data. [2025-10-02T21:10:11.797389] [DEBUG] [LOCAL ] RCS: No primary data file found to delete. [2025-10-02T21:10:11.797470] [INFO ] [MAIN ] RCS: Starting full primary refresh. [2025-10-02T21:10:12.284711] [INFO ] [REMOTE ] RCI: Fetching primary data for 2024-12. [2025-10-02T21:10:12.338461] [INFO ] [REMOTE ] RCS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:10:12.487913] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-02T21:10:12.518827] [DEBUG] [LOCAL ] RBRK: Primary data saved (53518 records). [2025-10-02T21:10:12.519384] [INFO ] [MAIN ] RBRK: Full history saved. [2025-10-02T21:10:12.519563] [INFO ] [MAIN ] Update Progress: 1776/2370 symbols completed. RBRK took 53.4s. Estimated remaining: 1h 23m 40s. Rate: 7.1 symbols/min [2025-10-02T21:10:12.717889] [INFO ] [MAIN ] RCUS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:10:12.718092] [DEBUG] [LOCAL ] RCUS: No existing data file found in primary storage. [2025-10-02T21:10:12.718187] [WARN ] [MAIN ] RCUS: No existing data found, performing full refresh instead. [2025-10-02T21:10:12.718312] [INFO ] [MAIN ] RCUS: Wiping existing primary data before full refresh. [2025-10-02T21:10:12.718383] [INFO ] [LOCAL ] RCUS: Starting deletion of primary data. [2025-10-02T21:10:12.718442] [DEBUG] [LOCAL ] RCUS: No primary data file found to delete. [2025-10-02T21:10:12.718476] [INFO ] [MAIN ] RCUS: Starting full primary refresh. [2025-10-02T21:10:13.085673] [INFO ] [REMOTE ] RCS: Fetching primary data for 2024-12. [2025-10-02T21:10:13.136196] [INFO ] [REMOTE ] RCUS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:10:13.873034] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-01. [2025-10-02T21:10:14.099235] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-02T21:10:14.112535] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-02T21:10:14.678198] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-01. [2025-10-02T21:10:14.694137] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-02T21:10:15.473048] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-02. [2025-10-02T21:10:16.273026] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2024-12. [2025-10-02T21:10:16.955411] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-10-02T21:10:17.073006] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-01. [2025-10-02T21:10:17.375714] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-02T21:10:17.580544] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-02T21:10:17.873042] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-01. [2025-10-02T21:10:18.672996] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-02. [2025-10-02T21:10:18.998134] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-02T21:10:19.425922] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-02T21:10:19.473000] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-02. [2025-10-02T21:10:19.726149] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-02T21:10:20.273039] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-03. [2025-10-02T21:10:21.072980] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-02. [2025-10-02T21:10:21.123399] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-02T21:10:21.438603] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-02T21:10:21.872996] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-03. [2025-10-02T21:10:22.261412] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-02T21:10:22.468842] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-02T21:10:22.672988] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-04. [2025-10-02T21:10:23.472996] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-04. [2025-10-02T21:10:23.591014] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-02T21:10:24.273000] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-03. [2025-10-02T21:10:24.390017] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-02T21:10:25.073016] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-05. [2025-10-02T21:10:25.873036] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-03. [2025-10-02T21:10:25.913504] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-02T21:10:26.078926] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-02T21:10:26.672992] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-04. [2025-10-02T21:10:27.472999] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-06. [2025-10-02T21:10:27.523105] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-02T21:10:27.976025] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-02T21:10:28.015677] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-02T21:10:28.273006] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-07. [2025-10-02T21:10:29.072983] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-04. [2025-10-02T21:10:29.241978] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-02T21:10:29.873028] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-05. [2025-10-02T21:10:30.672978] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-05. [2025-10-02T21:10:30.813470] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-02T21:10:31.473009] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-08. [2025-10-02T21:10:31.592715] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-02T21:10:31.609720] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-02T21:10:32.192251] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-02T21:10:32.272991] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-06. [2025-10-02T21:10:33.072981] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-05. [2025-10-02T21:10:33.317595] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-02T21:10:33.873001] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-07. [2025-10-02T21:10:34.674043] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-06. [2025-10-02T21:10:34.673964] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-02T21:10:34.901693] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-02T21:10:35.473048] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-06. [2025-10-02T21:10:36.273012] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-08. [2025-10-02T21:10:36.309572] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-02T21:10:37.073057] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-09. [2025-10-02T21:10:37.232714] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-02T21:10:37.273788] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-02T21:10:37.873009] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-07. [2025-10-02T21:10:38.194358] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-02T21:10:38.672980] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-10. [2025-10-02T21:10:39.242671] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-02T21:10:39.247496] [INFO ] [REMOTE ] RCL: Full fetch complete (75028 records). [2025-10-02T21:10:39.247739] [DEBUG] [VALIDATOR ] RCL: Validating primary data. [2025-10-02T21:10:39.248913] [FATAL] [VALIDATOR ] RCL: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T21:10:39.249087] [FATAL] [MAIN ] RCL: Fetched primary data is invalid. Refusing to save it. [2025-10-02T21:10:39.249161] [WARN ] [MAIN ] RCL: Deleting existing primary and derivative data due to validation failure. [2025-10-02T21:10:39.249269] [INFO ] [LOCAL ] RCL: Starting deletion of primary data. [2025-10-02T21:10:39.249355] [DEBUG] [LOCAL ] RCL: No primary data file found to delete. [2025-10-02T21:10:39.249416] [INFO ] [LOCAL ] RCL: Starting deletion of derivative data. [2025-10-02T21:10:39.249488] [DEBUG] [LOCAL ] RCL: No derivative data file found to delete. [2025-10-02T21:10:39.249571] [INFO ] [MAIN ] Update Progress: 1777/2370 symbols completed. RCL took 32.7s. Estimated remaining: 1h 23m 37s. Rate: 7.1 symbols/min [2025-10-02T21:10:39.462755] [INFO ] [MAIN ] RDDT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:10:39.463063] [DEBUG] [LOCAL ] RDDT: No existing data file found in primary storage. [2025-10-02T21:10:39.463142] [WARN ] [MAIN ] RDDT: No existing data found, performing full refresh instead. [2025-10-02T21:10:39.464132] [INFO ] [MAIN ] RDDT: Wiping existing primary data before full refresh. [2025-10-02T21:10:39.464276] [INFO ] [LOCAL ] RDDT: Starting deletion of primary data. [2025-10-02T21:10:39.464495] [DEBUG] [LOCAL ] RDDT: No primary data file found to delete. [2025-10-02T21:10:39.464677] [INFO ] [MAIN ] RDDT: Starting full primary refresh. [2025-10-02T21:10:39.478139] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-07. [2025-10-02T21:10:39.707274] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-02T21:10:39.927597] [INFO ] [REMOTE ] RDDT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:10:40.273043] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2024-12. [2025-10-02T21:10:41.073052] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-08. [2025-10-02T21:10:41.448559] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-02T21:10:41.873010] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-08. [2025-10-02T21:10:42.407226] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-02T21:10:42.547033] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-10-02T21:10:42.673063] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-01. [2025-10-02T21:10:43.473003] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-09. [2025-10-02T21:10:44.273021] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-09. [2025-10-02T21:10:45.129001] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-01 (2.46 seconds). [2025-10-02T21:10:45.141803] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-02. [2025-10-02T21:10:45.915081] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-02T21:10:45.924369] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-10. [2025-10-02T21:10:46.697014] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-08 (4.82 seconds). [2025-10-02T21:10:46.709422] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-09. [2025-10-02T21:10:47.199826] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-02T21:10:47.201580] [INFO ] [REMOTE ] RCUS: Full fetch complete (60174 records). [2025-10-02T21:10:47.201737] [DEBUG] [VALIDATOR ] RCUS: Validating primary data. [2025-10-02T21:10:47.666151] [DEBUG] [VALIDATOR ] RCUS: All expected trading days are present. [2025-10-02T21:10:47.666266] [DEBUG] [VALIDATOR ] RCUS: Primary data validation passed. [2025-10-02T21:10:47.667382] [INFO ] [MAIN ] RCUS: Fetched primary data is valid. [2025-10-02T21:10:47.667483] [DEBUG] [LOCAL ] RCUS: Saving primary data. [2025-10-02T21:10:47.669011] [DEBUG] [LOCAL ] RCUS: Trimmed 60174 records to 42717 (keeping 200 days of data) [2025-10-02T21:10:47.789970] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-02 (2.65 seconds). [2025-10-02T21:10:47.802584] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-03. [2025-10-02T21:10:47.994693] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-02T21:10:48.028862] [DEBUG] [LOCAL ] RCUS: Primary data saved (42717 records). [2025-10-02T21:10:48.029008] [INFO ] [MAIN ] RCUS: Full history saved. [2025-10-02T21:10:48.029095] [INFO ] [MAIN ] Update Progress: 1778/2370 symbols completed. RCUS took 35.5s. Estimated remaining: 1h 23m 29s. Rate: 7.1 symbols/min [2025-10-02T21:10:48.212025] [INFO ] [MAIN ] RDN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:10:48.212252] [DEBUG] [LOCAL ] RDN: No existing data file found in primary storage. [2025-10-02T21:10:48.212310] [WARN ] [MAIN ] RDN: No existing data found, performing full refresh instead. [2025-10-02T21:10:48.212436] [INFO ] [MAIN ] RDN: Wiping existing primary data before full refresh. [2025-10-02T21:10:48.212490] [INFO ] [LOCAL ] RDN: Starting deletion of primary data. [2025-10-02T21:10:48.212559] [DEBUG] [LOCAL ] RDN: No primary data file found to delete. [2025-10-02T21:10:48.212607] [INFO ] [MAIN ] RDN: Starting full primary refresh. [2025-10-02T21:10:48.279691] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-10. [2025-10-02T21:10:48.591058] [INFO ] [REMOTE ] RDN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:10:49.073047] [INFO ] [REMOTE ] RDN: Fetching primary data for 2024-12. [2025-10-02T21:10:49.225455] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-09 (5.75 seconds). [2025-10-02T21:10:49.441174] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-02T21:10:49.445262] [INFO ] [REMOTE ] RCI: Full fetch complete (70483 records). [2025-10-02T21:10:49.445377] [DEBUG] [VALIDATOR ] RCI: Validating primary data. [2025-10-02T21:10:49.866227] [DEBUG] [VALIDATOR ] RCI: All expected trading days are present. [2025-10-02T21:10:49.866318] [DEBUG] [VALIDATOR ] RCI: Primary data validation passed. [2025-10-02T21:10:49.867370] [INFO ] [MAIN ] RCI: Fetched primary data is valid. [2025-10-02T21:10:49.867440] [DEBUG] [LOCAL ] RCI: Saving primary data. [2025-10-02T21:10:49.869109] [DEBUG] [LOCAL ] RCI: Trimmed 70483 records to 48958 (keeping 200 days of data) [2025-10-02T21:10:49.873063] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-10. [2025-10-02T21:10:50.224793] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-10-02T21:10:50.252729] [DEBUG] [LOCAL ] RCI: Primary data saved (48958 records). [2025-10-02T21:10:50.252881] [INFO ] [MAIN ] RCI: Full history saved. [2025-10-02T21:10:50.253001] [INFO ] [MAIN ] Update Progress: 1779/2370 symbols completed. RCI took 46.2s. Estimated remaining: 1h 23m 19s. Rate: 7.1 symbols/min [2025-10-02T21:10:50.446363] [INFO ] [MAIN ] RDW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:10:50.446547] [DEBUG] [LOCAL ] RDW: No existing data file found in primary storage. [2025-10-02T21:10:50.446606] [WARN ] [MAIN ] RDW: No existing data found, performing full refresh instead. [2025-10-02T21:10:50.446755] [INFO ] [MAIN ] RDW: Wiping existing primary data before full refresh. [2025-10-02T21:10:50.446801] [INFO ] [LOCAL ] RDW: Starting deletion of primary data. [2025-10-02T21:10:50.446848] [DEBUG] [LOCAL ] RDW: No primary data file found to delete. [2025-10-02T21:10:50.446884] [INFO ] [MAIN ] RDW: Starting full primary refresh. [2025-10-02T21:10:50.550866] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-02T21:10:50.564773] [INFO ] [REMOTE ] RCS: Full fetch complete (19168 records). [2025-10-02T21:10:50.570637] [DEBUG] [VALIDATOR ] RCS: Validating primary data. [2025-10-02T21:10:50.713406] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-04. [2025-10-02T21:10:51.178309] [INFO ] [REMOTE ] RDW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:10:51.316719] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-10-02T21:10:51.317442] [DEBUG] [VALIDATOR ] RCS: All expected trading days are present. [2025-10-02T21:10:51.326053] [DEBUG] [VALIDATOR ] RCS: Primary data validation passed. [2025-10-02T21:10:51.327235] [INFO ] [MAIN ] RCS: Fetched primary data is valid. [2025-10-02T21:10:51.327320] [DEBUG] [LOCAL ] RCS: Saving primary data. [2025-10-02T21:10:51.327950] [DEBUG] [LOCAL ] RCS: Trimmed 19168 records to 11689 (keeping 200 days of data) [2025-10-02T21:10:51.406341] [DEBUG] [LOCAL ] RCS: Primary data saved (11689 records). [2025-10-02T21:10:51.406481] [INFO ] [MAIN ] RCS: Full history saved. [2025-10-02T21:10:51.406554] [INFO ] [MAIN ] Update Progress: 1780/2370 symbols completed. RCS took 39.9s. Estimated remaining: 1h 23m 8s. Rate: 7.1 symbols/min [2025-10-02T21:10:51.478153] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-01. [2025-10-02T21:10:51.587767] [INFO ] [MAIN ] RDY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:10:51.587932] [DEBUG] [LOCAL ] RDY: No existing data file found in primary storage. [2025-10-02T21:10:51.587971] [WARN ] [MAIN ] RDY: No existing data found, performing full refresh instead. [2025-10-02T21:10:51.588237] [INFO ] [MAIN ] RDY: Wiping existing primary data before full refresh. [2025-10-02T21:10:51.588305] [INFO ] [LOCAL ] RDY: Starting deletion of primary data. [2025-10-02T21:10:51.588365] [DEBUG] [LOCAL ] RDY: No primary data file found to delete. [2025-10-02T21:10:51.588399] [INFO ] [MAIN ] RDY: Starting full primary refresh. [2025-10-02T21:10:51.987960] [INFO ] [REMOTE ] RDY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:10:52.273056] [INFO ] [REMOTE ] RDY: Fetching primary data for 2024-12. [2025-10-02T21:10:53.073056] [INFO ] [REMOTE ] RDW: Fetching primary data for 2024-12. [2025-10-02T21:10:53.269795] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-02T21:10:53.343729] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-04 (2.63 seconds). [2025-10-02T21:10:53.873025] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-05. [2025-10-02T21:10:54.086183] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-02T21:10:54.673006] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-01. [2025-10-02T21:10:55.069196] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-02T21:10:55.473021] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-02. [2025-10-02T21:10:56.273073] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-01. [2025-10-02T21:10:56.594374] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-05 (2.72 seconds). [2025-10-02T21:10:56.666170] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-02T21:10:56.816730] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-02T21:10:57.073061] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-06. [2025-10-02T21:10:57.873011] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-02. [2025-10-02T21:10:58.413684] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-02T21:10:58.673031] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-02. [2025-10-02T21:10:59.472984] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-03. [2025-10-02T21:10:59.642930] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-02T21:10:59.686950] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-06 (2.61 seconds). [2025-10-02T21:11:00.273047] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-07. [2025-10-02T21:11:01.073032] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-03. [2025-10-02T21:11:01.115415] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-02T21:11:01.873057] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-04. [2025-10-02T21:11:02.909963] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-02T21:11:02.920682] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-04. [2025-10-02T21:11:02.997040] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-07 (2.72 seconds). [2025-10-02T21:11:03.210242] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-02T21:11:03.473028] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-08. [2025-10-02T21:11:04.273015] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-05. [2025-10-02T21:11:04.680725] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-02T21:11:05.072996] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-05. [2025-10-02T21:11:05.999374] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-02T21:11:06.009891] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-06. [2025-10-02T21:11:06.112714] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-08 (2.64 seconds). [2025-10-02T21:11:06.589777] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-02T21:11:06.673041] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-09. [2025-10-02T21:11:07.473066] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-06. [2025-10-02T21:11:07.675124] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-02T21:11:08.273026] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-07. [2025-10-02T21:11:09.092333] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-10-02T21:11:09.105757] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-10. [2025-10-02T21:11:09.147796] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-02T21:11:09.587048] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-02T21:11:09.873061] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-08. [2025-10-02T21:11:10.673023] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-07. [2025-10-02T21:11:11.327676] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-02T21:11:11.329834] [INFO ] [REMOTE ] RDDT: Full fetch complete (77887 records). [2025-10-02T21:11:11.329985] [DEBUG] [VALIDATOR ] RDDT: Validating primary data. [2025-10-02T21:11:11.750227] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-02 (13.08 seconds). [2025-10-02T21:11:11.867734] [DEBUG] [VALIDATOR ] RDDT: All expected trading days are present. [2025-10-02T21:11:11.867524] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-03. [2025-10-02T21:11:11.868723] [DEBUG] [VALIDATOR ] RDDT: Primary data validation passed. [2025-10-02T21:11:11.871985] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-02T21:11:11.870479] [INFO ] [MAIN ] RDDT: Fetched primary data is valid. [2025-10-02T21:11:11.881049] [DEBUG] [LOCAL ] RDDT: Saving primary data. [2025-10-02T21:11:11.883437] [DEBUG] [LOCAL ] RDDT: Trimmed 77887 records to 54170 (keeping 200 days of data) [2025-10-02T21:11:12.247427] [DEBUG] [LOCAL ] RDDT: Primary data saved (54170 records). [2025-10-02T21:11:12.247618] [INFO ] [MAIN ] RDDT: Full history saved. [2025-10-02T21:11:12.247741] [INFO ] [MAIN ] Update Progress: 1781/2370 symbols completed. RDDT took 33.0s. Estimated remaining: 1h 23m 3s. Rate: 7.1 symbols/min [2025-10-02T21:11:12.278210] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-09. [2025-10-02T21:11:12.479749] [INFO ] [MAIN ] RELX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:11:12.480037] [DEBUG] [LOCAL ] RELX: No existing data file found in primary storage. [2025-10-02T21:11:12.480115] [WARN ] [MAIN ] RELX: No existing data found, performing full refresh instead. [2025-10-02T21:11:12.480444] [INFO ] [MAIN ] RELX: Wiping existing primary data before full refresh. [2025-10-02T21:11:12.480506] [INFO ] [LOCAL ] RELX: Starting deletion of primary data. [2025-10-02T21:11:12.480555] [DEBUG] [LOCAL ] RELX: No primary data file found to delete. [2025-10-02T21:11:12.480590] [INFO ] [MAIN ] RELX: Starting full primary refresh. [2025-10-02T21:11:12.754945] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-02T21:11:12.910416] [INFO ] [REMOTE ] RELX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:11:13.073035] [INFO ] [REMOTE ] RELX: Fetching primary data for 2024-12. [2025-10-02T21:11:13.872991] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-08. [2025-10-02T21:11:14.046814] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-02T21:11:14.097928] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-02T21:11:14.672992] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-04. [2025-10-02T21:11:14.851777] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-02T21:11:15.146685] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-02T21:11:15.473007] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-09. [2025-10-02T21:11:16.272968] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-01. [2025-10-02T21:11:16.811205] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-02T21:11:17.073000] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-10. [2025-10-02T21:11:17.191680] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-02T21:11:17.752587] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-02T21:11:17.873021] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-10. [2025-10-02T21:11:18.496665] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-02T21:11:18.498613] [INFO ] [REMOTE ] RDN: Full fetch complete (66008 records). [2025-10-02T21:11:18.498761] [DEBUG] [VALIDATOR ] RDN: Validating primary data. [2025-10-02T21:11:18.677986] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-02. [2025-10-02T21:11:18.938226] [DEBUG] [VALIDATOR ] RDN: All expected trading days are present. [2025-10-02T21:11:18.938318] [DEBUG] [VALIDATOR ] RDN: Primary data validation passed. [2025-10-02T21:11:18.939454] [INFO ] [MAIN ] RDN: Fetched primary data is valid. [2025-10-02T21:11:18.939532] [DEBUG] [LOCAL ] RDN: Saving primary data. [2025-10-02T21:11:18.941018] [DEBUG] [LOCAL ] RDN: Trimmed 66008 records to 45366 (keeping 200 days of data) [2025-10-02T21:11:19.234153] [DEBUG] [LOCAL ] RDN: Primary data saved (45366 records). [2025-10-02T21:11:19.234307] [INFO ] [MAIN ] RDN: Full history saved. [2025-10-02T21:11:19.234399] [INFO ] [MAIN ] Update Progress: 1782/2370 symbols completed. RDN took 31.2s. Estimated remaining: 1h 22m 54s. Rate: 7.1 symbols/min [2025-10-02T21:11:19.354232] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-02T21:11:19.365364] [INFO ] [REMOTE ] RDY: Full fetch complete (68950 records). [2025-10-02T21:11:19.375783] [DEBUG] [VALIDATOR ] RDY: Validating primary data. [2025-10-02T21:11:19.443364] [INFO ] [MAIN ] RERE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:11:19.479578] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-05. [2025-10-02T21:11:19.486722] [DEBUG] [LOCAL ] RERE: No existing data file found in primary storage. [2025-10-02T21:11:19.493519] [WARN ] [MAIN ] RERE: No existing data found, performing full refresh instead. [2025-10-02T21:11:19.534259] [INFO ] [MAIN ] RERE: Wiping existing primary data before full refresh. [2025-10-02T21:11:19.552365] [INFO ] [LOCAL ] RERE: Starting deletion of primary data. [2025-10-02T21:11:19.552462] [DEBUG] [LOCAL ] RERE: No primary data file found to delete. [2025-10-02T21:11:19.552558] [INFO ] [MAIN ] RERE: Starting full primary refresh. [2025-10-02T21:11:20.195598] [DEBUG] [VALIDATOR ] RDY: All expected trading days are present. [2025-10-02T21:11:20.200126] [DEBUG] [VALIDATOR ] RDY: Primary data validation passed. [2025-10-02T21:11:20.201325] [INFO ] [MAIN ] RDY: Fetched primary data is valid. [2025-10-02T21:11:20.201532] [DEBUG] [LOCAL ] RDY: Saving primary data. [2025-10-02T21:11:20.214941] [DEBUG] [LOCAL ] RDY: Trimmed 68950 records to 47185 (keeping 200 days of data) [2025-10-02T21:11:20.397096] [INFO ] [REMOTE ] RERE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:11:20.398294] [INFO ] [REMOTE ] RERE: Fetching primary data for 2024-12. [2025-10-02T21:11:20.432318] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-02T21:11:20.666144] [DEBUG] [LOCAL ] RDY: Primary data saved (47185 records). [2025-10-02T21:11:20.666312] [INFO ] [MAIN ] RDY: Full history saved. [2025-10-02T21:11:20.666432] [INFO ] [MAIN ] Update Progress: 1783/2370 symbols completed. RDY took 29.3s. Estimated remaining: 1h 22m 44s. Rate: 7.1 symbols/min [2025-10-02T21:11:20.897081] [INFO ] [MAIN ] RES: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:11:20.897257] [DEBUG] [LOCAL ] RES: No existing data file found in primary storage. [2025-10-02T21:11:20.897298] [WARN ] [MAIN ] RES: No existing data found, performing full refresh instead. [2025-10-02T21:11:20.897452] [INFO ] [MAIN ] RES: Wiping existing primary data before full refresh. [2025-10-02T21:11:20.897496] [INFO ] [LOCAL ] RES: Starting deletion of primary data. [2025-10-02T21:11:20.897542] [DEBUG] [LOCAL ] RES: No primary data file found to delete. [2025-10-02T21:11:20.897577] [INFO ] [MAIN ] RES: Starting full primary refresh. [2025-10-02T21:11:21.075408] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-03. [2025-10-02T21:11:21.305975] [INFO ] [REMOTE ] RES: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:11:21.599990] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-02T21:11:21.873015] [INFO ] [REMOTE ] RES: Fetching primary data for 2024-12. [2025-10-02T21:11:22.155691] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-02T21:11:22.473772] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-02T21:11:22.673003] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-04. [2025-10-02T21:11:23.472995] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-06. [2025-10-02T21:11:23.577409] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-02T21:11:24.272985] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-01. [2025-10-02T21:11:24.478420] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-02T21:11:25.072997] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-01. [2025-10-02T21:11:25.526631] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-02T21:11:25.594089] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-02T21:11:25.873001] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-05. [2025-10-02T21:11:26.513207] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-02T21:11:26.673005] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-02. [2025-10-02T21:11:27.473002] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-07. [2025-10-02T21:11:27.703345] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-02T21:11:28.272990] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-06. [2025-10-02T21:11:28.375740] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-02T21:11:29.072994] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-03. [2025-10-02T21:11:29.872989] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-02. [2025-10-02T21:11:29.961548] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-10-02T21:11:30.035208] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-02T21:11:30.517429] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-02T21:11:30.672994] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-04. [2025-10-02T21:11:31.272188] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-02T21:11:31.473031] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-08. [2025-10-02T21:11:32.272975] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-03. [2025-10-02T21:11:32.470023] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-02T21:11:33.073079] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-07. [2025-10-02T21:11:33.875183] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-05. [2025-10-02T21:11:33.878982] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-02T21:11:34.118880] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-08 (2.65 seconds). [2025-10-02T21:11:34.672963] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-04. [2025-10-02T21:11:34.946580] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-02T21:11:35.472954] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-08. [2025-10-02T21:11:35.700446] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-02T21:11:35.780156] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-02T21:11:36.273007] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-09. [2025-10-02T21:11:37.073029] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-06. [2025-10-02T21:11:37.307359] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-02T21:11:37.873086] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-09. [2025-10-02T21:11:38.673051] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-05. [2025-10-02T21:11:38.803545] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-02T21:11:38.846978] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-09 (2.57 seconds). [2025-10-02T21:11:39.473012] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-07. [2025-10-02T21:11:39.758511] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-02T21:11:40.160348] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-02T21:11:40.273011] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-10. [2025-10-02T21:11:41.072970] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-10. [2025-10-02T21:11:41.269072] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-02T21:11:41.531770] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-02T21:11:41.533860] [INFO ] [REMOTE ] RELX: Full fetch complete (67402 records). [2025-10-02T21:11:41.534002] [DEBUG] [VALIDATOR ] RELX: Validating primary data. [2025-10-02T21:11:41.878103] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-06. [2025-10-02T21:11:41.954882] [DEBUG] [VALIDATOR ] RELX: All expected trading days are present. [2025-10-02T21:11:41.954959] [DEBUG] [VALIDATOR ] RELX: Primary data validation passed. [2025-10-02T21:11:41.956080] [INFO ] [MAIN ] RELX: Fetched primary data is valid. [2025-10-02T21:11:41.956144] [DEBUG] [LOCAL ] RELX: Saving primary data. [2025-10-02T21:11:41.957823] [DEBUG] [LOCAL ] RELX: Trimmed 67402 records to 48282 (keeping 200 days of data) [2025-10-02T21:11:42.266708] [DEBUG] [LOCAL ] RELX: Primary data saved (48282 records). [2025-10-02T21:11:42.266852] [INFO ] [MAIN ] RELX: Full history saved. [2025-10-02T21:11:42.266931] [INFO ] [MAIN ] Update Progress: 1784/2370 symbols completed. RELX took 30.0s. Estimated remaining: 1h 22m 39s. Rate: 7.1 symbols/min [2025-10-02T21:11:42.457703] [INFO ] [MAIN ] REVG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:11:42.457952] [DEBUG] [LOCAL ] REVG: No existing data file found in primary storage. [2025-10-02T21:11:42.458013] [WARN ] [MAIN ] REVG: No existing data found, performing full refresh instead. [2025-10-02T21:11:42.458172] [INFO ] [MAIN ] REVG: Wiping existing primary data before full refresh. [2025-10-02T21:11:42.458225] [INFO ] [LOCAL ] REVG: Starting deletion of primary data. [2025-10-02T21:11:42.458268] [DEBUG] [LOCAL ] REVG: No primary data file found to delete. [2025-10-02T21:11:42.458302] [INFO ] [MAIN ] REVG: Starting full primary refresh. [2025-10-02T21:11:42.687582] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-08. [2025-10-02T21:11:42.846271] [INFO ] [REMOTE ] REVG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:11:43.184221] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-02T21:11:43.187552] [INFO ] [REMOTE ] RDW: Full fetch complete (74868 records). [2025-10-02T21:11:43.187715] [DEBUG] [VALIDATOR ] RDW: Validating primary data. [2025-10-02T21:11:43.365917] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-02T21:11:43.485466] [INFO ] [REMOTE ] REVG: Fetching primary data for 2024-12. [2025-10-02T21:11:43.678227] [DEBUG] [VALIDATOR ] RDW: All expected trading days are present. [2025-10-02T21:11:43.678323] [DEBUG] [VALIDATOR ] RDW: Primary data validation passed. [2025-10-02T21:11:43.679375] [INFO ] [MAIN ] RDW: Fetched primary data is valid. [2025-10-02T21:11:43.679443] [DEBUG] [LOCAL ] RDW: Saving primary data. [2025-10-02T21:11:43.680881] [DEBUG] [LOCAL ] RDW: Trimmed 74868 records to 52434 (keeping 200 days of data) [2025-10-02T21:11:44.003078] [DEBUG] [LOCAL ] RDW: Primary data saved (52434 records). [2025-10-02T21:11:44.003217] [INFO ] [MAIN ] RDW: Full history saved. [2025-10-02T21:11:44.003290] [INFO ] [MAIN ] Update Progress: 1785/2370 symbols completed. RDW took 53.8s. Estimated remaining: 1h 22m 29s. Rate: 7.1 symbols/min [2025-10-02T21:11:44.213786] [INFO ] [MAIN ] REX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:11:44.214321] [DEBUG] [LOCAL ] REX: No existing data file found in primary storage. [2025-10-02T21:11:44.214388] [WARN ] [MAIN ] REX: No existing data found, performing full refresh instead. [2025-10-02T21:11:44.214569] [INFO ] [MAIN ] REX: Wiping existing primary data before full refresh. [2025-10-02T21:11:44.214626] [INFO ] [LOCAL ] REX: Starting deletion of primary data. [2025-10-02T21:11:44.214713] [DEBUG] [LOCAL ] REX: No primary data file found to delete. [2025-10-02T21:11:44.214952] [INFO ] [MAIN ] REX: Starting full primary refresh. [2025-10-02T21:11:44.274724] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-07. [2025-10-02T21:11:44.641375] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-02T21:11:44.722025] [INFO ] [REMOTE ] REX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:11:45.073002] [INFO ] [REMOTE ] REX: Fetching primary data for 2024-12. [2025-10-02T21:11:45.171607] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-02T21:11:45.874259] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-01. [2025-10-02T21:11:45.880384] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-02T21:11:46.230744] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-02T21:11:46.673016] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-08. [2025-10-02T21:11:47.444697] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-02T21:11:47.472978] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-02. [2025-10-02T21:11:48.278186] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-09. [2025-10-02T21:11:48.308394] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-02T21:11:48.603705] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-02T21:11:49.073006] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-03. [2025-10-02T21:11:49.738370] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-02T21:11:49.873013] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-09. [2025-10-02T21:11:50.673023] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-01. [2025-10-02T21:11:50.819399] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-02T21:11:51.473039] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-04. [2025-10-02T21:11:51.611042] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-02T21:11:51.838184] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-02T21:11:52.273061] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-10. [2025-10-02T21:11:53.072971] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-10. [2025-10-02T21:11:53.175350] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-02T21:11:53.604430] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-02T21:11:53.606310] [INFO ] [REMOTE ] RERE: Full fetch complete (57496 records). [2025-10-02T21:11:53.606436] [DEBUG] [VALIDATOR ] RERE: Validating primary data. [2025-10-02T21:11:53.878099] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-02. [2025-10-02T21:11:54.046028] [DEBUG] [VALIDATOR ] RERE: All expected trading days are present. [2025-10-02T21:11:54.046122] [DEBUG] [VALIDATOR ] RERE: Primary data validation passed. [2025-10-02T21:11:54.047163] [INFO ] [MAIN ] RERE: Fetched primary data is valid. [2025-10-02T21:11:54.047229] [DEBUG] [LOCAL ] RERE: Saving primary data. [2025-10-02T21:11:54.048555] [DEBUG] [LOCAL ] RERE: Trimmed 57496 records to 41454 (keeping 200 days of data) [2025-10-02T21:11:54.314935] [DEBUG] [LOCAL ] RERE: Primary data saved (41454 records). [2025-10-02T21:11:54.315311] [INFO ] [MAIN ] RERE: Full history saved. [2025-10-02T21:11:54.315408] [INFO ] [MAIN ] Update Progress: 1786/2370 symbols completed. RERE took 35.1s. Estimated remaining: 1h 22m 21s. Rate: 7.1 symbols/min [2025-10-02T21:11:54.388425] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-02T21:11:54.434893] [INFO ] [REMOTE ] RES: Full fetch complete (68911 records). [2025-10-02T21:11:54.449584] [DEBUG] [VALIDATOR ] RES: Validating primary data. [2025-10-02T21:11:54.678880] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-05. [2025-10-02T21:11:54.667989] [INFO ] [MAIN ] REXR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:11:54.695569] [DEBUG] [LOCAL ] REXR: No existing data file found in primary storage. [2025-10-02T21:11:54.716196] [WARN ] [MAIN ] REXR: No existing data found, performing full refresh instead. [2025-10-02T21:11:54.758589] [INFO ] [MAIN ] REXR: Wiping existing primary data before full refresh. [2025-10-02T21:11:54.776785] [INFO ] [LOCAL ] REXR: Starting deletion of primary data. [2025-10-02T21:11:54.820818] [DEBUG] [LOCAL ] REXR: No primary data file found to delete. [2025-10-02T21:11:54.854350] [INFO ] [MAIN ] REXR: Starting full primary refresh. [2025-10-02T21:11:55.148491] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-02T21:11:55.157135] [DEBUG] [VALIDATOR ] RES: All expected trading days are present. [2025-10-02T21:11:55.162454] [DEBUG] [VALIDATOR ] RES: Primary data validation passed. [2025-10-02T21:11:55.309753] [INFO ] [MAIN ] RES: Fetched primary data is valid. [2025-10-02T21:11:55.340620] [DEBUG] [LOCAL ] RES: Saving primary data. [2025-10-02T21:11:55.405153] [DEBUG] [LOCAL ] RES: Trimmed 68911 records to 47702 (keeping 200 days of data) [2025-10-02T21:11:55.471990] [INFO ] [REMOTE ] REXR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:11:55.472958] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-03. [2025-10-02T21:11:55.765008] [DEBUG] [LOCAL ] RES: Primary data saved (47702 records). [2025-10-02T21:11:55.765165] [INFO ] [MAIN ] RES: Full history saved. [2025-10-02T21:11:55.765243] [INFO ] [MAIN ] Update Progress: 1787/2370 symbols completed. RES took 35.1s. Estimated remaining: 1h 22m 10s. Rate: 7.1 symbols/min [2025-10-02T21:11:55.951363] [INFO ] [MAIN ] REZI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:11:55.951554] [DEBUG] [LOCAL ] REZI: No existing data file found in primary storage. [2025-10-02T21:11:55.951594] [WARN ] [MAIN ] REZI: No existing data found, performing full refresh instead. [2025-10-02T21:11:55.951759] [INFO ] [MAIN ] REZI: Wiping existing primary data before full refresh. [2025-10-02T21:11:55.951838] [INFO ] [LOCAL ] REZI: Starting deletion of primary data. [2025-10-02T21:11:55.951898] [DEBUG] [LOCAL ] REZI: No primary data file found to delete. [2025-10-02T21:11:55.951941] [INFO ] [MAIN ] REZI: Starting full primary refresh. [2025-10-02T21:11:56.276280] [INFO ] [REMOTE ] REXR: Fetching primary data for 2024-12. [2025-10-02T21:11:56.367366] [INFO ] [REMOTE ] REZI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:11:56.403461] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-02T21:11:56.456539] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-02T21:11:57.073042] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-06. [2025-10-02T21:11:57.872982] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-04. [2025-10-02T21:11:58.122881] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-02T21:11:58.673924] [INFO ] [REMOTE ] REZI: Fetching primary data for 2024-12. [2025-10-02T21:11:58.679299] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-02T21:11:58.832897] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-02T21:11:59.472971] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-01. [2025-10-02T21:12:00.272974] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-05. [2025-10-02T21:12:00.392599] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-02T21:12:01.073040] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-07. [2025-10-02T21:12:01.360852] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-02T21:12:01.400156] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-02T21:12:01.873059] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-06. [2025-10-02T21:12:02.488503] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-02T21:12:02.673017] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-08. [2025-10-02T21:12:02.846549] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-02T21:12:03.473021] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-07. [2025-10-02T21:12:04.273018] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-01. [2025-10-02T21:12:04.335297] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-02T21:12:04.466015] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-02T21:12:05.073016] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-08. [2025-10-02T21:12:05.629194] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-02T21:12:05.873073] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-02. [2025-10-02T21:12:06.070818] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-02T21:12:06.672989] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-09. [2025-10-02T21:12:07.362698] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-02T21:12:07.473022] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-03. [2025-10-02T21:12:07.847591] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-02T21:12:08.273012] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-10. [2025-10-02T21:12:09.073019] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-09. [2025-10-02T21:12:09.123213] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-02T21:12:09.124373] [INFO ] [REMOTE ] REX: Full fetch complete (21133 records). [2025-10-02T21:12:09.124454] [DEBUG] [VALIDATOR ] REX: Validating primary data. [2025-10-02T21:12:09.414876] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-02T21:12:09.605228] [DEBUG] [VALIDATOR ] REX: All expected trading days are present. [2025-10-02T21:12:09.605319] [DEBUG] [VALIDATOR ] REX: Primary data validation passed. [2025-10-02T21:12:09.605836] [INFO ] [MAIN ] REX: Fetched primary data is valid. [2025-10-02T21:12:09.605904] [DEBUG] [LOCAL ] REX: Saving primary data. [2025-10-02T21:12:09.606751] [DEBUG] [LOCAL ] REX: Trimmed 21133 records to 14244 (keeping 200 days of data) [2025-10-02T21:12:09.698201] [DEBUG] [LOCAL ] REX: Primary data saved (14244 records). [2025-10-02T21:12:09.698345] [INFO ] [MAIN ] REX: Full history saved. [2025-10-02T21:12:09.698422] [INFO ] [MAIN ] Update Progress: 1788/2370 symbols completed. REX took 25.7s. Estimated remaining: 1h 22m 4s. Rate: 7.1 symbols/min [2025-10-02T21:12:09.884301] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-04. [2025-10-02T21:12:09.888283] [INFO ] [MAIN ] RF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:12:09.889206] [DEBUG] [LOCAL ] RF: No existing data file found in primary storage. [2025-10-02T21:12:09.889251] [WARN ] [MAIN ] RF: No existing data found, performing full refresh instead. [2025-10-02T21:12:09.889381] [INFO ] [MAIN ] RF: Wiping existing primary data before full refresh. [2025-10-02T21:12:09.889457] [INFO ] [LOCAL ] RF: Starting deletion of primary data. [2025-10-02T21:12:09.889542] [DEBUG] [LOCAL ] RF: No primary data file found to delete. [2025-10-02T21:12:09.889596] [INFO ] [MAIN ] RF: Starting full primary refresh. [2025-10-02T21:12:10.289244] [INFO ] [REMOTE ] RF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:12:10.672972] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-02. [2025-10-02T21:12:10.858911] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-02T21:12:11.472974] [INFO ] [REMOTE ] RF: Fetching primary data for 2024-12. [2025-10-02T21:12:11.668951] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-02T21:12:12.082528] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-02T21:12:12.272978] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-03. [2025-10-02T21:12:12.430092] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-02T21:12:13.073047] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-10. [2025-10-02T21:12:13.873005] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-05. [2025-10-02T21:12:14.064467] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-02T21:12:14.083370] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-02T21:12:14.085412] [INFO ] [REMOTE ] REVG: Full fetch complete (58159 records). [2025-10-02T21:12:14.085570] [DEBUG] [VALIDATOR ] REVG: Validating primary data. [2025-10-02T21:12:14.532493] [DEBUG] [VALIDATOR ] REVG: All expected trading days are present. [2025-10-02T21:12:14.532609] [DEBUG] [VALIDATOR ] REVG: Primary data validation passed. [2025-10-02T21:12:14.533755] [INFO ] [MAIN ] REVG: Fetched primary data is valid. [2025-10-02T21:12:14.533829] [DEBUG] [LOCAL ] REVG: Saving primary data. [2025-10-02T21:12:14.535316] [DEBUG] [LOCAL ] REVG: Trimmed 58159 records to 41014 (keeping 200 days of data) [2025-10-02T21:12:14.673039] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-04. [2025-10-02T21:12:14.817901] [DEBUG] [LOCAL ] REVG: Primary data saved (41014 records). [2025-10-02T21:12:14.818059] [INFO ] [MAIN ] REVG: Full history saved. [2025-10-02T21:12:14.818178] [INFO ] [MAIN ] Update Progress: 1789/2370 symbols completed. REVG took 32.6s. Estimated remaining: 1h 21m 54s. Rate: 7.1 symbols/min [2025-10-02T21:12:15.014489] [INFO ] [MAIN ] RFI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:12:15.014695] [DEBUG] [LOCAL ] RFI: No existing data file found in primary storage. [2025-10-02T21:12:15.014753] [WARN ] [MAIN ] RFI: No existing data found, performing full refresh instead. [2025-10-02T21:12:15.014895] [INFO ] [MAIN ] RFI: Wiping existing primary data before full refresh. [2025-10-02T21:12:15.014951] [INFO ] [LOCAL ] RFI: Starting deletion of primary data. [2025-10-02T21:12:15.015000] [DEBUG] [LOCAL ] RFI: No primary data file found to delete. [2025-10-02T21:12:15.015035] [INFO ] [MAIN ] RFI: Starting full primary refresh. [2025-10-02T21:12:15.414459] [INFO ] [REMOTE ] RFI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:12:15.472997] [INFO ] [REMOTE ] RFI: Fetching primary data for 2024-12. [2025-10-02T21:12:15.579877] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-02T21:12:16.226145] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-02T21:12:16.228372] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-02T21:12:16.272985] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-01. [2025-10-02T21:12:17.073024] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-06. [2025-10-02T21:12:17.257504] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-02T21:12:17.873003] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-01. [2025-10-02T21:12:18.673003] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-05. [2025-10-02T21:12:18.800135] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-02T21:12:18.911084] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-02T21:12:19.473048] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-07. [2025-10-02T21:12:20.273028] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-02. [2025-10-02T21:12:20.517519] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-02T21:12:21.080908] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-06. [2025-10-02T21:12:21.103203] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-02T21:12:21.214216] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-02T21:12:21.873005] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-08. [2025-10-02T21:12:22.673008] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-03. [2025-10-02T21:12:22.768940] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-02T21:12:23.348457] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-02T21:12:23.472998] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-09. [2025-10-02T21:12:23.590708] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-02T21:12:24.273008] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-07. [2025-10-02T21:12:25.072981] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-04. [2025-10-02T21:12:25.201808] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-02T21:12:25.873001] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-10. [2025-10-02T21:12:25.932024] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-02T21:12:26.209751] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-02T21:12:26.672987] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-08. [2025-10-02T21:12:27.084579] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-02T21:12:27.086685] [INFO ] [REMOTE ] REZI: Full fetch complete (65961 records). [2025-10-02T21:12:27.086813] [DEBUG] [VALIDATOR ] REZI: Validating primary data. [2025-10-02T21:12:27.481421] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-02. [2025-10-02T21:12:27.523381] [DEBUG] [VALIDATOR ] REZI: All expected trading days are present. [2025-10-02T21:12:27.523472] [DEBUG] [VALIDATOR ] REZI: Primary data validation passed. [2025-10-02T21:12:27.524462] [INFO ] [MAIN ] REZI: Fetched primary data is valid. [2025-10-02T21:12:27.524526] [DEBUG] [LOCAL ] REZI: Saving primary data. [2025-10-02T21:12:27.525925] [DEBUG] [LOCAL ] REZI: Trimmed 65961 records to 47292 (keeping 200 days of data) [2025-10-02T21:12:27.826523] [DEBUG] [LOCAL ] REZI: Primary data saved (47292 records). [2025-10-02T21:12:27.826703] [INFO ] [MAIN ] REZI: Full history saved. [2025-10-02T21:12:27.826810] [INFO ] [MAIN ] Update Progress: 1790/2370 symbols completed. REZI took 32.1s. Estimated remaining: 1h 21m 47s. Rate: 7.1 symbols/min [2025-10-02T21:12:28.028137] [INFO ] [MAIN ] RFL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:12:28.028303] [DEBUG] [LOCAL ] RFL: No existing data file found in primary storage. [2025-10-02T21:12:28.028343] [WARN ] [MAIN ] RFL: No existing data found, performing full refresh instead. [2025-10-02T21:12:28.028461] [INFO ] [MAIN ] RFL: Wiping existing primary data before full refresh. [2025-10-02T21:12:28.028504] [INFO ] [LOCAL ] RFL: Starting deletion of primary data. [2025-10-02T21:12:28.028546] [DEBUG] [LOCAL ] RFL: No primary data file found to delete. [2025-10-02T21:12:28.028580] [INFO ] [MAIN ] RFL: Starting full primary refresh. [2025-10-02T21:12:28.280273] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-05. [2025-10-02T21:12:28.430314] [INFO ] [REMOTE ] RFL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:12:28.438424] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-02T21:12:28.527621] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-02T21:12:29.072987] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-03. [2025-10-02T21:12:29.511379] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-02T21:12:29.873072] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-06. [2025-10-02T21:12:30.046708] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-02T21:12:30.673053] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-09. [2025-10-02T21:12:30.998121] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-02T21:12:31.473027] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-07. [2025-10-02T21:12:32.273008] [INFO ] [REMOTE ] RFL: Fetching primary data for 2024-12. [2025-10-02T21:12:32.400893] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-02T21:12:32.732245] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-02T21:12:32.826416] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-02T21:12:33.073039] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-08. [2025-10-02T21:12:33.882053] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-10. [2025-10-02T21:12:33.906842] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-02T21:12:34.673044] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-04. [2025-10-02T21:12:35.361900] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-02T21:12:35.363941] [INFO ] [REMOTE ] REXR: Full fetch complete (75166 records). [2025-10-02T21:12:35.364089] [DEBUG] [VALIDATOR ] REXR: Validating primary data. [2025-10-02T21:12:35.476334] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-09. [2025-10-02T21:12:35.814555] [DEBUG] [VALIDATOR ] REXR: All expected trading days are present. [2025-10-02T21:12:35.815615] [DEBUG] [VALIDATOR ] REXR: Primary data validation passed. [2025-10-02T21:12:35.816225] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-02T21:12:35.817511] [INFO ] [MAIN ] REXR: Fetched primary data is valid. [2025-10-02T21:12:35.821414] [DEBUG] [LOCAL ] REXR: Saving primary data. [2025-10-02T21:12:35.822969] [DEBUG] [LOCAL ] REXR: Trimmed 75166 records to 52462 (keeping 200 days of data) [2025-10-02T21:12:36.164986] [DEBUG] [LOCAL ] REXR: Primary data saved (52462 records). [2025-10-02T21:12:36.165146] [INFO ] [MAIN ] REXR: Full history saved. [2025-10-02T21:12:36.165266] [INFO ] [MAIN ] Update Progress: 1791/2370 symbols completed. REXR took 41.8s. Estimated remaining: 1h 21m 38s. Rate: 7.1 symbols/min [2025-10-02T21:12:36.276697] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-01. [2025-10-02T21:12:36.354544] [INFO ] [MAIN ] RFM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:12:36.355583] [DEBUG] [LOCAL ] RFM: No existing data file found in primary storage. [2025-10-02T21:12:36.355674] [WARN ] [MAIN ] RFM: No existing data found, performing full refresh instead. [2025-10-02T21:12:36.355907] [INFO ] [MAIN ] RFM: Wiping existing primary data before full refresh. [2025-10-02T21:12:36.356045] [INFO ] [LOCAL ] RFM: Starting deletion of primary data. [2025-10-02T21:12:36.356235] [DEBUG] [LOCAL ] RFM: No primary data file found to delete. [2025-10-02T21:12:36.356326] [INFO ] [MAIN ] RFM: Starting full primary refresh. [2025-10-02T21:12:36.704214] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-02T21:12:36.822343] [INFO ] [REMOTE ] RFM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:12:37.040597] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-02T21:12:37.073047] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-02. [2025-10-02T21:12:37.728544] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-02T21:12:37.872974] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-03. [2025-10-02T21:12:38.513474] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-02T21:12:38.673045] [INFO ] [REMOTE ] RFM: Fetching primary data for 2024-12. [2025-10-02T21:12:39.357505] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-02T21:12:39.473001] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-01. [2025-10-02T21:12:40.162316] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-02T21:12:40.273068] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-04. [2025-10-02T21:12:41.073037] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-05. [2025-10-02T21:12:41.092881] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-02T21:12:41.872975] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-05. [2025-10-02T21:12:41.951458] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-02T21:12:42.639434] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-02T21:12:42.673013] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-06. [2025-10-02T21:12:43.473053] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-06. [2025-10-02T21:12:43.840083] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-02T21:12:44.273052] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-02. [2025-10-02T21:12:44.394420] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-02T21:12:44.829838] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-02T21:12:45.073032] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-07. [2025-10-02T21:12:45.871257] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-02T21:12:45.874104] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-07. [2025-10-02T21:12:46.673022] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-10. [2025-10-02T21:12:46.793630] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-02T21:12:47.472995] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-08. [2025-10-02T21:12:48.023947] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-02T21:12:48.026186] [INFO ] [REMOTE ] RF: Full fetch complete (77626 records). [2025-10-02T21:12:48.026300] [DEBUG] [VALIDATOR ] RF: Validating primary data. [2025-10-02T21:12:48.278122] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-03. [2025-10-02T21:12:48.470922] [DEBUG] [VALIDATOR ] RF: All expected trading days are present. [2025-10-02T21:12:48.471690] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-02T21:12:48.471933] [DEBUG] [VALIDATOR ] RF: Primary data validation passed. [2025-10-02T21:12:48.475874] [INFO ] [MAIN ] RF: Fetched primary data is valid. [2025-10-02T21:12:48.476547] [DEBUG] [LOCAL ] RF: Saving primary data. [2025-10-02T21:12:48.483913] [DEBUG] [LOCAL ] RF: Trimmed 77626 records to 54020 (keeping 200 days of data) [2025-10-02T21:12:48.840390] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-02T21:12:48.853241] [DEBUG] [LOCAL ] RF: Primary data saved (54020 records). [2025-10-02T21:12:48.853395] [INFO ] [MAIN ] RF: Full history saved. [2025-10-02T21:12:48.853492] [INFO ] [MAIN ] Update Progress: 1792/2370 symbols completed. RF took 39.2s. Estimated remaining: 1h 21m 31s. Rate: 7.1 symbols/min [2025-10-02T21:12:49.031325] [INFO ] [MAIN ] RFMZ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:12:49.031550] [DEBUG] [LOCAL ] RFMZ: No existing data file found in primary storage. [2025-10-02T21:12:49.031607] [WARN ] [MAIN ] RFMZ: No existing data found, performing full refresh instead. [2025-10-02T21:12:49.031793] [INFO ] [MAIN ] RFMZ: Wiping existing primary data before full refresh. [2025-10-02T21:12:49.031856] [INFO ] [LOCAL ] RFMZ: Starting deletion of primary data. [2025-10-02T21:12:49.031934] [DEBUG] [LOCAL ] RFMZ: No primary data file found to delete. [2025-10-02T21:12:49.031974] [INFO ] [MAIN ] RFMZ: Starting full primary refresh. [2025-10-02T21:12:49.078222] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-08. [2025-10-02T21:12:49.418841] [INFO ] [REMOTE ] RFMZ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:12:49.872973] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-09. [2025-10-02T21:12:50.045689] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-02T21:12:50.672962] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-09. [2025-10-02T21:12:51.473018] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2024-12. [2025-10-02T21:12:51.692454] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-02T21:12:52.113398] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-02T21:12:52.202772] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-02T21:12:52.273033] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-04. [2025-10-02T21:12:53.073003] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-10. [2025-10-02T21:12:53.117919] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-02T21:12:53.721247] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-02T21:12:53.722622] [INFO ] [REMOTE ] RFL: Full fetch complete (12975 records). [2025-10-02T21:12:53.722761] [DEBUG] [VALIDATOR ] RFL: Validating primary data. [2025-10-02T21:12:53.878752] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-01. [2025-10-02T21:12:54.164332] [DEBUG] [VALIDATOR ] RFL: All expected trading days are present. [2025-10-02T21:12:54.164417] [DEBUG] [VALIDATOR ] RFL: Primary data validation passed. [2025-10-02T21:12:54.164738] [INFO ] [MAIN ] RFL: Fetched primary data is valid. [2025-10-02T21:12:54.164801] [DEBUG] [LOCAL ] RFL: Saving primary data. [2025-10-02T21:12:54.165357] [DEBUG] [LOCAL ] RFL: Trimmed 12975 records to 11222 (keeping 200 days of data) [2025-10-02T21:12:54.234442] [DEBUG] [LOCAL ] RFL: Primary data saved (11222 records). [2025-10-02T21:12:54.234589] [INFO ] [MAIN ] RFL: Full history saved. [2025-10-02T21:12:54.234689] [INFO ] [MAIN ] Update Progress: 1793/2370 symbols completed. RFL took 26.4s. Estimated remaining: 1h 21m 22s. Rate: 7.1 symbols/min [2025-10-02T21:12:54.421209] [INFO ] [MAIN ] RGA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:12:54.421493] [DEBUG] [LOCAL ] RGA: No existing data file found in primary storage. [2025-10-02T21:12:54.421551] [WARN ] [MAIN ] RGA: No existing data found, performing full refresh instead. [2025-10-02T21:12:54.421694] [INFO ] [MAIN ] RGA: Wiping existing primary data before full refresh. [2025-10-02T21:12:54.421751] [INFO ] [LOCAL ] RGA: Starting deletion of primary data. [2025-10-02T21:12:54.421796] [DEBUG] [LOCAL ] RGA: No primary data file found to delete. [2025-10-02T21:12:54.421830] [INFO ] [MAIN ] RGA: Starting full primary refresh. [2025-10-02T21:12:54.682692] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-05. [2025-10-02T21:12:54.753361] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-02T21:12:54.844602] [INFO ] [REMOTE ] RGA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:12:55.369662] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-02T21:12:55.473028] [INFO ] [REMOTE ] RGA: Fetching primary data for 2024-12. [2025-10-02T21:12:56.273024] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-06. [2025-10-02T21:12:56.958547] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-02T21:12:57.062616] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-02T21:12:57.073007] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-07. [2025-10-02T21:12:57.826618] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-02T21:12:57.872984] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-01. [2025-10-02T21:12:58.673016] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-10. [2025-10-02T21:12:59.325513] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-02T21:12:59.327085] [INFO ] [REMOTE ] RFI: Full fetch complete (15776 records). [2025-10-02T21:12:59.327216] [DEBUG] [VALIDATOR ] RFI: Validating primary data. [2025-10-02T21:12:59.473616] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-08. [2025-10-02T21:12:59.576447] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-02T21:12:59.801534] [DEBUG] [VALIDATOR ] RFI: All expected trading days are present. [2025-10-02T21:12:59.801614] [DEBUG] [VALIDATOR ] RFI: Primary data validation passed. [2025-10-02T21:12:59.802024] [INFO ] [MAIN ] RFI: Fetched primary data is valid. [2025-10-02T21:12:59.802084] [DEBUG] [LOCAL ] RFI: Saving primary data. [2025-10-02T21:12:59.802714] [DEBUG] [LOCAL ] RFI: Trimmed 15776 records to 10556 (keeping 200 days of data) [2025-10-02T21:12:59.875167] [DEBUG] [LOCAL ] RFI: Primary data saved (10556 records). [2025-10-02T21:12:59.875306] [INFO ] [MAIN ] RFI: Full history saved. [2025-10-02T21:12:59.875381] [INFO ] [MAIN ] Update Progress: 1794/2370 symbols completed. RFI took 45.1s. Estimated remaining: 1h 21m 13s. Rate: 7.1 symbols/min [2025-10-02T21:13:00.065184] [INFO ] [MAIN ] RGR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:13:00.065418] [DEBUG] [LOCAL ] RGR: No existing data file found in primary storage. [2025-10-02T21:13:00.065474] [WARN ] [MAIN ] RGR: No existing data found, performing full refresh instead. [2025-10-02T21:13:00.065620] [INFO ] [MAIN ] RGR: Wiping existing primary data before full refresh. [2025-10-02T21:13:00.065725] [INFO ] [LOCAL ] RGR: Starting deletion of primary data. [2025-10-02T21:13:00.065791] [DEBUG] [LOCAL ] RGR: No primary data file found to delete. [2025-10-02T21:13:00.065847] [INFO ] [MAIN ] RGR: Starting full primary refresh. [2025-10-02T21:13:00.280203] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-02. [2025-10-02T21:13:00.346768] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-02T21:13:00.465532] [INFO ] [REMOTE ] RGR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:13:01.073036] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-09. [2025-10-02T21:13:01.108055] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-02T21:13:01.829983] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-02T21:13:01.873044] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-10. [2025-10-02T21:13:02.307930] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-02T21:13:02.308783] [INFO ] [REMOTE ] RFM: Full fetch complete (5896 records). [2025-10-02T21:13:02.308891] [DEBUG] [VALIDATOR ] RFM: Validating primary data. [2025-10-02T21:13:02.680828] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-02. [2025-10-02T21:13:02.727199] [DEBUG] [VALIDATOR ] RFM: All expected trading days are present. [2025-10-02T21:13:02.727362] [DEBUG] [VALIDATOR ] RFM: Primary data validation passed. [2025-10-02T21:13:02.727551] [INFO ] [MAIN ] RFM: Fetched primary data is valid. [2025-10-02T21:13:02.727661] [DEBUG] [LOCAL ] RFM: Saving primary data. [2025-10-02T21:13:02.728151] [DEBUG] [LOCAL ] RFM: Trimmed 5896 records to 4188 (keeping 200 days of data) [2025-10-02T21:13:02.755420] [DEBUG] [LOCAL ] RFM: Primary data saved (4188 records). [2025-10-02T21:13:02.755551] [INFO ] [MAIN ] RFM: Full history saved. [2025-10-02T21:13:02.755624] [INFO ] [MAIN ] Update Progress: 1795/2370 symbols completed. RFM took 26.6s. Estimated remaining: 1h 21m 2s. Rate: 7.1 symbols/min [2025-10-02T21:13:02.933982] [INFO ] [MAIN ] RGT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:13:02.934153] [DEBUG] [LOCAL ] RGT: No existing data file found in primary storage. [2025-10-02T21:13:02.934195] [WARN ] [MAIN ] RGT: No existing data found, performing full refresh instead. [2025-10-02T21:13:02.934309] [INFO ] [MAIN ] RGT: Wiping existing primary data before full refresh. [2025-10-02T21:13:02.934352] [INFO ] [LOCAL ] RGT: Starting deletion of primary data. [2025-10-02T21:13:02.934395] [DEBUG] [LOCAL ] RGT: No primary data file found to delete. [2025-10-02T21:13:02.934431] [INFO ] [MAIN ] RGT: Starting full primary refresh. [2025-10-02T21:13:03.363903] [INFO ] [REMOTE ] RGT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:13:03.473051] [INFO ] [REMOTE ] RGT: Fetching primary data for 2024-12. [2025-10-02T21:13:03.939061] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-02T21:13:04.272974] [INFO ] [REMOTE ] RGR: Fetching primary data for 2024-12. [2025-10-02T21:13:04.386485] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-02T21:13:05.073034] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-03. [2025-10-02T21:13:05.557348] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-02T21:13:05.873004] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-01. [2025-10-02T21:13:05.934223] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-02T21:13:06.672990] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-03. [2025-10-02T21:13:07.032787] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-02T21:13:07.473013] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-04. [2025-10-02T21:13:08.229185] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-02T21:13:08.272990] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-04. [2025-10-02T21:13:08.397856] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-02T21:13:09.072987] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-05. [2025-10-02T21:13:09.838077] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-02T21:13:09.873055] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-05. [2025-10-02T21:13:10.019629] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-02T21:13:10.673015] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-01. [2025-10-02T21:13:11.127139] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-02T21:13:11.457374] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-02T21:13:11.472960] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-06. [2025-10-02T21:13:12.273020] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-02. [2025-10-02T21:13:12.823167] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-02T21:13:13.073013] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-07. [2025-10-02T21:13:13.160048] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-02T21:13:13.873005] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-06. [2025-10-02T21:13:14.519213] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-02T21:13:14.657837] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-02T21:13:14.672973] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-08. [2025-10-02T21:13:15.473018] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-07. [2025-10-02T21:13:16.088201] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-02T21:13:16.273001] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-02. [2025-10-02T21:13:16.292604] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-02T21:13:16.669569] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-02T21:13:17.073071] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-03. [2025-10-02T21:13:17.872994] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-03. [2025-10-02T21:13:18.281902] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-02T21:13:18.584212] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-02T21:13:18.673003] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-04. [2025-10-02T21:13:19.472996] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-04. [2025-10-02T21:13:19.815056] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-02T21:13:20.173965] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-02T21:13:20.272999] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-08. [2025-10-02T21:13:21.067597] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-02T21:13:21.072943] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-09. [2025-10-02T21:13:21.872973] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-05. [2025-10-02T21:13:21.919686] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-02T21:13:22.672996] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-10. [2025-10-02T21:13:23.145462] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-02T21:13:23.306235] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-02T21:13:23.307251] [INFO ] [REMOTE ] RFMZ: Full fetch complete (12737 records). [2025-10-02T21:13:23.307394] [DEBUG] [VALIDATOR ] RFMZ: Validating primary data. [2025-10-02T21:13:23.478963] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-06. [2025-10-02T21:13:23.748127] [DEBUG] [VALIDATOR ] RFMZ: All expected trading days are present. [2025-10-02T21:13:23.748214] [DEBUG] [VALIDATOR ] RFMZ: Primary data validation passed. [2025-10-02T21:13:23.748591] [INFO ] [MAIN ] RFMZ: Fetched primary data is valid. [2025-10-02T21:13:23.748634] [DEBUG] [LOCAL ] RFMZ: Saving primary data. [2025-10-02T21:13:23.749166] [DEBUG] [LOCAL ] RFMZ: Trimmed 12737 records to 8813 (keeping 200 days of data) [2025-10-02T21:13:23.808291] [DEBUG] [LOCAL ] RFMZ: Primary data saved (8813 records). [2025-10-02T21:13:23.808435] [INFO ] [MAIN ] RFMZ: Full history saved. [2025-10-02T21:13:23.808612] [INFO ] [MAIN ] Update Progress: 1796/2370 symbols completed. RFMZ took 35.0s. Estimated remaining: 1h 20m 58s. Rate: 7.1 symbols/min [2025-10-02T21:13:23.990128] [INFO ] [MAIN ] RH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:13:23.990317] [DEBUG] [LOCAL ] RH: No existing data file found in primary storage. [2025-10-02T21:13:23.990373] [WARN ] [MAIN ] RH: No existing data found, performing full refresh instead. [2025-10-02T21:13:23.990487] [INFO ] [MAIN ] RH: Wiping existing primary data before full refresh. [2025-10-02T21:13:23.990529] [INFO ] [LOCAL ] RH: Starting deletion of primary data. [2025-10-02T21:13:23.990571] [DEBUG] [LOCAL ] RH: No primary data file found to delete. [2025-10-02T21:13:23.990687] [INFO ] [MAIN ] RH: Starting full primary refresh. [2025-10-02T21:13:24.281906] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-05. [2025-10-02T21:13:24.371788] [INFO ] [REMOTE ] RH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:13:24.763236] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-02T21:13:24.779113] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-02T21:13:25.072936] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-07. [2025-10-02T21:13:25.873005] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-06. [2025-10-02T21:13:26.305596] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-02T21:13:26.317550] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-02T21:13:26.673043] [INFO ] [REMOTE ] RH: Fetching primary data for 2024-12. [2025-10-02T21:13:27.473005] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-08. [2025-10-02T21:13:28.273018] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-09. [2025-10-02T21:13:28.517664] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-02T21:13:28.572932] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-02T21:13:29.073002] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-09. [2025-10-02T21:13:29.646318] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-02T21:13:29.873013] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-10. [2025-10-02T21:13:30.452765] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-02T21:13:30.673041] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-10. [2025-10-02T21:13:30.723232] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-02T21:13:30.724621] [INFO ] [REMOTE ] RGA: Full fetch complete (45464 records). [2025-10-02T21:13:30.724732] [DEBUG] [VALIDATOR ] RGA: Validating primary data. [2025-10-02T21:13:31.138665] [DEBUG] [VALIDATOR ] RGA: All expected trading days are present. [2025-10-02T21:13:31.138760] [DEBUG] [VALIDATOR ] RGA: Primary data validation passed. [2025-10-02T21:13:31.139719] [INFO ] [MAIN ] RGA: Fetched primary data is valid. [2025-10-02T21:13:31.139785] [DEBUG] [LOCAL ] RGA: Saving primary data. [2025-10-02T21:13:31.140871] [DEBUG] [LOCAL ] RGA: Trimmed 45464 records to 29832 (keeping 200 days of data) [2025-10-02T21:13:31.356582] [DEBUG] [LOCAL ] RGA: Primary data saved (29832 records). [2025-10-02T21:13:31.356759] [INFO ] [MAIN ] RGA: Full history saved. [2025-10-02T21:13:31.356890] [INFO ] [MAIN ] Update Progress: 1797/2370 symbols completed. RGA took 37.1s. Estimated remaining: 1h 20m 49s. Rate: 7.1 symbols/min [2025-10-02T21:13:31.432141] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-02T21:13:31.433575] [INFO ] [REMOTE ] RGR: Full fetch complete (28790 records). [2025-10-02T21:13:31.433674] [DEBUG] [VALIDATOR ] RGR: Validating primary data. [2025-10-02T21:13:31.479479] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-07. [2025-10-02T21:13:31.843927] [DEBUG] [VALIDATOR ] RGR: All expected trading days are present. [2025-10-02T21:13:31.844010] [DEBUG] [VALIDATOR ] RGR: Primary data validation passed. [2025-10-02T21:13:31.844748] [INFO ] [MAIN ] RGR: Fetched primary data is valid. [2025-10-02T21:13:31.844811] [DEBUG] [LOCAL ] RGR: Saving primary data. [2025-10-02T21:13:31.845632] [DEBUG] [LOCAL ] RGR: Trimmed 28790 records to 20763 (keeping 200 days of data) [2025-10-02T21:13:32.001882] [DEBUG] [LOCAL ] RGR: Primary data saved (20763 records). [2025-10-02T21:13:32.002018] [INFO ] [MAIN ] RGR: Full history saved. [2025-10-02T21:13:32.002096] [INFO ] [MAIN ] Update Progress: 1798/2370 symbols completed. RGR took 32.1s. Estimated remaining: 1h 20m 38s. Rate: 7.1 symbols/min [2025-10-02T21:13:32.266851] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-02T21:13:32.272947] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-08. [2025-10-02T21:13:32.813270] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-02T21:13:33.073015] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-01. [2025-10-02T21:13:33.873003] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-09. [2025-10-02T21:13:34.424294] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-02T21:13:34.678194] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-10. [2025-10-02T21:13:34.692415] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-02T21:13:35.072977] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-02T21:13:35.073820] [INFO ] [REMOTE ] RGT: Full fetch complete (4133 records). [2025-10-02T21:13:35.073894] [DEBUG] [VALIDATOR ] RGT: Validating primary data. [2025-10-02T21:13:35.475767] [DEBUG] [VALIDATOR ] RGT: All expected trading days are present. [2025-10-02T21:13:35.475473] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-02. [2025-10-02T21:13:35.475968] [DEBUG] [VALIDATOR ] RGT: Primary data validation passed. [2025-10-02T21:13:35.477690] [INFO ] [MAIN ] RGT: Fetched primary data is valid. [2025-10-02T21:13:35.477760] [DEBUG] [LOCAL ] RGT: Saving primary data. [2025-10-02T21:13:35.478271] [DEBUG] [LOCAL ] RGT: Trimmed 4133 records to 2781 (keeping 200 days of data) [2025-10-02T21:13:35.497541] [DEBUG] [LOCAL ] RGT: Primary data saved (2781 records). [2025-10-02T21:13:35.497711] [INFO ] [MAIN ] RGT: Full history saved. [2025-10-02T21:13:35.497809] [INFO ] [MAIN ] Update Progress: 1799/2370 symbols completed. RGT took 32.7s. Estimated remaining: 1h 20m 28s. Rate: 7.1 symbols/min [2025-10-02T21:13:37.075867] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-02T21:13:37.083596] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-03. [2025-10-02T21:13:38.967856] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-02T21:13:38.979702] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-04. [2025-10-02T21:13:40.754724] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-02T21:13:40.766369] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-05. [2025-10-02T21:13:42.839232] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-02T21:13:42.849781] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-06. [2025-10-02T21:13:44.881108] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-02T21:13:44.891985] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-07. [2025-10-02T21:13:46.778173] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-02T21:13:46.791790] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-08. [2025-10-02T21:13:48.672478] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-02T21:13:48.683183] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-09. [2025-10-02T21:13:50.673095] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-02T21:13:50.683791] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-10. [2025-10-02T21:13:52.162772] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-02T21:13:52.165146] [INFO ] [REMOTE ] RH: Full fetch complete (65721 records). [2025-10-02T21:13:52.165253] [DEBUG] [VALIDATOR ] RH: Validating primary data. [2025-10-02T21:13:52.593863] [DEBUG] [VALIDATOR ] RH: All expected trading days are present. [2025-10-02T21:13:52.593957] [DEBUG] [VALIDATOR ] RH: Primary data validation passed. [2025-10-02T21:13:52.594952] [INFO ] [MAIN ] RH: Fetched primary data is valid. [2025-10-02T21:13:52.595093] [DEBUG] [LOCAL ] RH: Saving primary data. [2025-10-02T21:13:52.596680] [DEBUG] [LOCAL ] RH: Trimmed 65721 records to 47866 (keeping 200 days of data) [2025-10-02T21:13:52.910695] [DEBUG] [LOCAL ] RH: Primary data saved (47866 records). [2025-10-02T21:13:52.910846] [INFO ] [MAIN ] RH: Full history saved. [2025-10-02T21:13:52.910930] [INFO ] [MAIN ] Update Progress: 1800/2370 symbols completed. RH took 29.1s. Estimated remaining: 1h 20m 23s. Rate: 7.1 symbols/min [2025-10-02T21:13:53.543705] [INFO ] [MAIN ] RHP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:13:53.570626] [DEBUG] [LOCAL ] RHP: No existing data file found in primary storage. [2025-10-02T21:13:53.608890] [WARN ] [MAIN ] RHP: No existing data found, performing full refresh instead. [2025-10-02T21:13:53.671985] [INFO ] [MAIN ] RIG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:13:53.715682] [INFO ] [MAIN ] RHI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:13:53.715902] [DEBUG] [LOCAL ] RIG: No existing data file found in primary storage. [2025-10-02T21:13:53.716012] [DEBUG] [LOCAL ] RHI: No existing data file found in primary storage. [2025-10-02T21:13:53.709031] [INFO ] [MAIN ] RHP: Wiping existing primary data before full refresh. [2025-10-02T21:13:53.716255] [WARN ] [MAIN ] RIG: No existing data found, performing full refresh instead. [2025-10-02T21:13:53.716101] [WARN ] [MAIN ] RHI: No existing data found, performing full refresh instead. [2025-10-02T21:13:53.716319] [INFO ] [LOCAL ] RHP: Starting deletion of primary data. [2025-10-02T21:13:53.716682] [INFO ] [MAIN ] RIG: Wiping existing primary data before full refresh. [2025-10-02T21:13:53.716856] [INFO ] [LOCAL ] RIG: Starting deletion of primary data. [2025-10-02T21:13:53.717017] [INFO ] [MAIN ] RHI: Wiping existing primary data before full refresh. [2025-10-02T21:13:53.717193] [INFO ] [LOCAL ] RHI: Starting deletion of primary data. [2025-10-02T21:13:53.710843] [INFO ] [MAIN ] RHLD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:13:53.717305] [DEBUG] [LOCAL ] RIG: No primary data file found to delete. [2025-10-02T21:13:53.717695] [DEBUG] [LOCAL ] RHP: No primary data file found to delete. [2025-10-02T21:13:53.717451] [DEBUG] [LOCAL ] RHI: No primary data file found to delete. [2025-10-02T21:13:53.717940] [INFO ] [MAIN ] RHI: Starting full primary refresh. [2025-10-02T21:13:53.717792] [DEBUG] [LOCAL ] RHLD: No existing data file found in primary storage. [2025-10-02T21:13:53.718009] [INFO ] [MAIN ] RHP: Starting full primary refresh. [2025-10-02T21:13:53.717587] [INFO ] [MAIN ] RIG: Starting full primary refresh. [2025-10-02T21:13:53.723455] [WARN ] [MAIN ] RHLD: No existing data found, performing full refresh instead. [2025-10-02T21:13:53.880252] [INFO ] [MAIN ] RHLD: Wiping existing primary data before full refresh. [2025-10-02T21:13:53.895841] [INFO ] [LOCAL ] RHLD: Starting deletion of primary data. [2025-10-02T21:13:53.911262] [DEBUG] [LOCAL ] RHLD: No primary data file found to delete. [2025-10-02T21:13:53.972614] [INFO ] [MAIN ] RHLD: Starting full primary refresh. [2025-10-02T21:13:55.112262] [INFO ] [REMOTE ] RHP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:13:55.172288] [INFO ] [REMOTE ] RHP: Fetching primary data for 2024-12. [2025-10-02T21:13:55.248276] [INFO ] [REMOTE ] RHI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:13:55.286168] [INFO ] [REMOTE ] RIG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:13:55.261499] [INFO ] [REMOTE ] RHI: Fetching primary data for 2024-12. [2025-10-02T21:13:55.296147] [INFO ] [REMOTE ] RIG: Fetching primary data for 2024-12. [2025-10-02T21:13:55.329913] [INFO ] [REMOTE ] RHLD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:13:55.330602] [INFO ] [REMOTE ] RHLD: Fetching primary data for 2024-12. [2025-10-02T21:13:55.675819] [DEBUG] [REMOTE ] RHLD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T21:13:55.676208] [WARN ] [REMOTE ] RHLD: No data returned for month 2024-12 [2025-10-02T21:13:55.676302] [FATAL] [REMOTE ] RHLD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T21:13:55.676372] [FATAL] [MAIN ] RHLD: Failed to fetch primary data. [2025-10-02T21:13:55.676440] [WARN ] [MAIN ] RHLD: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T21:13:55.676513] [INFO ] [LOCAL ] RHLD: Starting deletion of primary data. [2025-10-02T21:13:55.676579] [DEBUG] [LOCAL ] RHLD: No primary data file found to delete. [2025-10-02T21:13:55.676616] [INFO ] [LOCAL ] RHLD: Starting deletion of derivative data. [2025-10-02T21:13:55.676692] [DEBUG] [LOCAL ] RHLD: No derivative data file found to delete. [2025-10-02T21:13:55.676757] [INFO ] [MAIN ] Update Progress: 1801/2370 symbols completed. RHLD took 2.8s. Estimated remaining: 1h 20m 12s. Rate: 7.1 symbols/min [2025-10-02T21:13:55.864919] [INFO ] [MAIN ] RIO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:13:55.865087] [DEBUG] [LOCAL ] RIO: No existing data file found in primary storage. [2025-10-02T21:13:55.865125] [WARN ] [MAIN ] RIO: No existing data found, performing full refresh instead. [2025-10-02T21:13:55.865241] [INFO ] [MAIN ] RIO: Wiping existing primary data before full refresh. [2025-10-02T21:13:55.865283] [INFO ] [LOCAL ] RIO: Starting deletion of primary data. [2025-10-02T21:13:55.865323] [DEBUG] [LOCAL ] RIO: No primary data file found to delete. [2025-10-02T21:13:55.865356] [INFO ] [MAIN ] RIO: Starting full primary refresh. [2025-10-02T21:13:56.253075] [INFO ] [REMOTE ] RIO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:13:56.253435] [INFO ] [REMOTE ] RIO: Fetching primary data for 2024-12. [2025-10-02T21:13:56.283234] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-02T21:13:56.292510] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-01. [2025-10-02T21:13:56.829358] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-02T21:13:56.837939] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-01. [2025-10-02T21:13:57.150190] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-02T21:13:57.160759] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-02. [2025-10-02T21:13:57.478344] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-10-02T21:13:57.491544] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-01. [2025-10-02T21:13:58.137198] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-02T21:13:58.146956] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-03. [2025-10-02T21:13:58.185279] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-02T21:13:58.196680] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-01. [2025-10-02T21:13:58.301677] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-02T21:13:58.309011] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-02. [2025-10-02T21:13:58.615405] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-02T21:13:58.626130] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-04. [2025-10-02T21:13:59.255980] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-02T21:13:59.267320] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-02. [2025-10-02T21:13:59.438897] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-02T21:13:59.446860] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-03. [2025-10-02T21:13:59.479737] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-02T21:13:59.491954] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-05. [2025-10-02T21:13:59.989077] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-02T21:14:00.001159] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-02. [2025-10-02T21:14:00.349354] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-02T21:14:00.359303] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-06. [2025-10-02T21:14:01.067026] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-02T21:14:01.077528] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-03. [2025-10-02T21:14:01.337558] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-02T21:14:01.348173] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-07. [2025-10-02T21:14:01.450960] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-02T21:14:01.461471] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-04. [2025-10-02T21:14:01.627479] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-02T21:14:01.638301] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-03. [2025-10-02T21:14:01.789809] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-02T21:14:01.801812] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-08. [2025-10-02T21:14:02.481920] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-02T21:14:02.493555] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-09. [2025-10-02T21:14:02.754829] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-02T21:14:02.767227] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-04. [2025-10-02T21:14:02.853351] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-02T21:14:02.863455] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-05. [2025-10-02T21:14:03.172505] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-02T21:14:03.473007] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-10. [2025-10-02T21:14:03.897203] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-02T21:14:04.273013] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-04. [2025-10-02T21:14:04.583447] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-02T21:14:04.694909] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-02T21:14:04.918354] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-02T21:14:04.920681] [INFO ] [REMOTE ] RHI: Full fetch complete (70089 records). [2025-10-02T21:14:04.920859] [DEBUG] [VALIDATOR ] RHI: Validating primary data. [2025-10-02T21:14:05.078192] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-06. [2025-10-02T21:14:05.345748] [DEBUG] [VALIDATOR ] RHI: All expected trading days are present. [2025-10-02T21:14:05.345851] [DEBUG] [VALIDATOR ] RHI: Primary data validation passed. [2025-10-02T21:14:05.346905] [INFO ] [MAIN ] RHI: Fetched primary data is valid. [2025-10-02T21:14:05.346972] [DEBUG] [LOCAL ] RHI: Saving primary data. [2025-10-02T21:14:05.348582] [DEBUG] [LOCAL ] RHI: Trimmed 70089 records to 49625 (keeping 200 days of data) [2025-10-02T21:14:05.673266] [DEBUG] [LOCAL ] RHI: Primary data saved (49625 records). [2025-10-02T21:14:05.673421] [INFO ] [MAIN ] RHI: Full history saved. [2025-10-02T21:14:05.673502] [INFO ] [MAIN ] Update Progress: 1802/2370 symbols completed. RHI took 12.8s. Estimated remaining: 1h 20m 4s. Rate: 7.1 symbols/min [2025-10-02T21:14:05.870070] [INFO ] [MAIN ] RITM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:14:05.870296] [DEBUG] [LOCAL ] RITM: No existing data file found in primary storage. [2025-10-02T21:14:05.870350] [WARN ] [MAIN ] RITM: No existing data found, performing full refresh instead. [2025-10-02T21:14:05.870473] [INFO ] [MAIN ] RITM: Wiping existing primary data before full refresh. [2025-10-02T21:14:05.870517] [INFO ] [LOCAL ] RITM: Starting deletion of primary data. [2025-10-02T21:14:05.870561] [DEBUG] [LOCAL ] RITM: No primary data file found to delete. [2025-10-02T21:14:05.870594] [INFO ] [MAIN ] RITM: Starting full primary refresh. [2025-10-02T21:14:05.893486] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-05. [2025-10-02T21:14:06.288220] [INFO ] [REMOTE ] RITM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:14:06.328305] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-02T21:14:06.673015] [INFO ] [REMOTE ] RITM: Fetching primary data for 2024-12. [2025-10-02T21:14:06.822221] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-02T21:14:07.473025] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-07. [2025-10-02T21:14:07.964491] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-02T21:14:08.227286] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-02T21:14:08.272967] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-01. [2025-10-02T21:14:08.580185] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-02T21:14:09.073038] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-06. [2025-10-02T21:14:09.873030] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-08. [2025-10-02T21:14:10.059953] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-02T21:14:10.672996] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-02. [2025-10-02T21:14:11.082791] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-02T21:14:11.235055] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-10-02T21:14:11.473000] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-05. [2025-10-02T21:14:12.273032] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-09. [2025-10-02T21:14:12.403122] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-02T21:14:13.073003] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-03. [2025-10-02T21:14:13.529091] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-02T21:14:13.874396] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-06. [2025-10-02T21:14:13.876883] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-02T21:14:14.672995] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-07. [2025-10-02T21:14:14.881401] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-02T21:14:15.473030] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-04. [2025-10-02T21:14:16.018732] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-02T21:14:16.272969] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-07. [2025-10-02T21:14:16.501887] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-02T21:14:17.072979] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-08. [2025-10-02T21:14:17.547919] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-02T21:14:17.873002] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-05. [2025-10-02T21:14:18.361505] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-02T21:14:18.672992] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-10. [2025-10-02T21:14:18.742178] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-02T21:14:19.473001] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-08. [2025-10-02T21:14:19.823521] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-02T21:14:19.846359] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-02T21:14:19.848097] [INFO ] [REMOTE ] RHP: Full fetch complete (58063 records). [2025-10-02T21:14:19.848193] [DEBUG] [VALIDATOR ] RHP: Validating primary data. [2025-10-02T21:14:20.261457] [DEBUG] [VALIDATOR ] RHP: All expected trading days are present. [2025-10-02T21:14:20.261541] [DEBUG] [VALIDATOR ] RHP: Primary data validation passed. [2025-10-02T21:14:20.262523] [INFO ] [MAIN ] RHP: Fetched primary data is valid. [2025-10-02T21:14:20.262589] [DEBUG] [LOCAL ] RHP: Saving primary data. [2025-10-02T21:14:20.263888] [DEBUG] [LOCAL ] RHP: Trimmed 58063 records to 41502 (keeping 200 days of data) [2025-10-02T21:14:20.323091] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-06. [2025-10-02T21:14:20.545417] [DEBUG] [LOCAL ] RHP: Primary data saved (41502 records). [2025-10-02T21:14:20.545548] [INFO ] [MAIN ] RHP: Full history saved. [2025-10-02T21:14:20.545621] [INFO ] [MAIN ] Update Progress: 1803/2370 symbols completed. RHP took 27.6s. Estimated remaining: 1h 19m 58s. Rate: 7.1 symbols/min [2025-10-02T21:14:20.729133] [INFO ] [MAIN ] RIV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:14:20.729316] [DEBUG] [LOCAL ] RIV: No existing data file found in primary storage. [2025-10-02T21:14:20.729356] [WARN ] [MAIN ] RIV: No existing data found, performing full refresh instead. [2025-10-02T21:14:20.729472] [INFO ] [MAIN ] RIV: Wiping existing primary data before full refresh. [2025-10-02T21:14:20.729550] [INFO ] [LOCAL ] RIV: Starting deletion of primary data. [2025-10-02T21:14:20.729605] [DEBUG] [LOCAL ] RIV: No primary data file found to delete. [2025-10-02T21:14:20.729660] [INFO ] [MAIN ] RIV: Starting full primary refresh. [2025-10-02T21:14:21.084788] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-09. [2025-10-02T21:14:21.135675] [INFO ] [REMOTE ] RIV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:14:21.618744] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-02T21:14:21.872978] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-09. [2025-10-02T21:14:22.295327] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-02T21:14:22.672962] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-07. [2025-10-02T21:14:22.791678] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-02T21:14:23.473004] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-10. [2025-10-02T21:14:24.058610] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-02T21:14:24.273036] [INFO ] [REMOTE ] RIV: Fetching primary data for 2024-12. [2025-10-02T21:14:24.743545] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-02T21:14:25.072986] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-08. [2025-10-02T21:14:25.142969] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-02T21:14:25.145444] [INFO ] [REMOTE ] RIG: Full fetch complete (77706 records). [2025-10-02T21:14:25.145572] [DEBUG] [VALIDATOR ] RIG: Validating primary data. [2025-10-02T21:14:25.293079] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-02T21:14:25.604259] [DEBUG] [VALIDATOR ] RIG: All expected trading days are present. [2025-10-02T21:14:25.604350] [DEBUG] [VALIDATOR ] RIG: Primary data validation passed. [2025-10-02T21:14:25.605632] [INFO ] [MAIN ] RIG: Fetched primary data is valid. [2025-10-02T21:14:25.605725] [DEBUG] [LOCAL ] RIG: Saving primary data. [2025-10-02T21:14:25.607354] [DEBUG] [LOCAL ] RIG: Trimmed 77706 records to 54060 (keeping 200 days of data) [2025-10-02T21:14:25.885005] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-10. [2025-10-02T21:14:25.939014] [DEBUG] [LOCAL ] RIG: Primary data saved (54060 records). [2025-10-02T21:14:25.939156] [INFO ] [MAIN ] RIG: Full history saved. [2025-10-02T21:14:25.939236] [INFO ] [MAIN ] Update Progress: 1804/2370 symbols completed. RIG took 33.0s. Estimated remaining: 1h 19m 48s. Rate: 7.1 symbols/min [2025-10-02T21:14:26.120277] [INFO ] [MAIN ] RJF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:14:26.120482] [DEBUG] [LOCAL ] RJF: No existing data file found in primary storage. [2025-10-02T21:14:26.120546] [WARN ] [MAIN ] RJF: No existing data found, performing full refresh instead. [2025-10-02T21:14:26.120721] [INFO ] [MAIN ] RJF: Wiping existing primary data before full refresh. [2025-10-02T21:14:26.120801] [INFO ] [LOCAL ] RJF: Starting deletion of primary data. [2025-10-02T21:14:26.120881] [DEBUG] [LOCAL ] RJF: No primary data file found to delete. [2025-10-02T21:14:26.120925] [INFO ] [MAIN ] RJF: Starting full primary refresh. [2025-10-02T21:14:26.511795] [INFO ] [REMOTE ] RJF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:14:26.673040] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-01. [2025-10-02T21:14:27.216399] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-02T21:14:27.279762] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-02T21:14:27.473014] [INFO ] [REMOTE ] RJF: Fetching primary data for 2024-12. [2025-10-02T21:14:27.614712] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-02T21:14:27.616872] [INFO ] [REMOTE ] RIO: Full fetch complete (77359 records). [2025-10-02T21:14:27.616999] [DEBUG] [VALIDATOR ] RIO: Validating primary data. [2025-10-02T21:14:28.045380] [DEBUG] [VALIDATOR ] RIO: All expected trading days are present. [2025-10-02T21:14:28.045467] [DEBUG] [VALIDATOR ] RIO: Primary data validation passed. [2025-10-02T21:14:28.046732] [INFO ] [MAIN ] RIO: Fetched primary data is valid. [2025-10-02T21:14:28.046800] [DEBUG] [LOCAL ] RIO: Saving primary data. [2025-10-02T21:14:28.048590] [DEBUG] [LOCAL ] RIO: Trimmed 77359 records to 53783 (keeping 200 days of data) [2025-10-02T21:14:28.296941] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-09. [2025-10-02T21:14:28.437491] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-02T21:14:28.465598] [DEBUG] [LOCAL ] RIO: Primary data saved (53783 records). [2025-10-02T21:14:28.465810] [INFO ] [MAIN ] RIO: Full history saved. [2025-10-02T21:14:28.465909] [INFO ] [MAIN ] Update Progress: 1805/2370 symbols completed. RIO took 32.8s. Estimated remaining: 1h 19m 38s. Rate: 7.1 symbols/min [2025-10-02T21:14:28.648374] [INFO ] [MAIN ] RKT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:14:28.648575] [DEBUG] [LOCAL ] RKT: No existing data file found in primary storage. [2025-10-02T21:14:28.648620] [WARN ] [MAIN ] RKT: No existing data found, performing full refresh instead. [2025-10-02T21:14:28.648771] [INFO ] [MAIN ] RKT: Wiping existing primary data before full refresh. [2025-10-02T21:14:28.648816] [INFO ] [LOCAL ] RKT: Starting deletion of primary data. [2025-10-02T21:14:28.648909] [DEBUG] [LOCAL ] RKT: No primary data file found to delete. [2025-10-02T21:14:28.648960] [INFO ] [MAIN ] RKT: Starting full primary refresh. [2025-10-02T21:14:29.036545] [INFO ] [REMOTE ] RKT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:14:29.073032] [INFO ] [REMOTE ] RKT: Fetching primary data for 2024-12. [2025-10-02T21:14:29.872979] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-02. [2025-10-02T21:14:30.371238] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-02T21:14:30.622848] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-02T21:14:30.673062] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-01. [2025-10-02T21:14:30.727532] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-02T21:14:31.473000] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-03. [2025-10-02T21:14:32.193448] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-02T21:14:32.273002] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-01. [2025-10-02T21:14:32.337415] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-02T21:14:33.073016] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-10. [2025-10-02T21:14:33.872983] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-04. [2025-10-02T21:14:34.225230] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-02T21:14:34.591092] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-02T21:14:34.593423] [INFO ] [REMOTE ] RITM: Full fetch complete (76589 records). [2025-10-02T21:14:34.593607] [DEBUG] [VALIDATOR ] RITM: Validating primary data. [2025-10-02T21:14:34.672976] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-02. [2025-10-02T21:14:34.967933] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-02T21:14:35.058221] [DEBUG] [VALIDATOR ] RITM: All expected trading days are present. [2025-10-02T21:14:35.058404] [DEBUG] [VALIDATOR ] RITM: Primary data validation passed. [2025-10-02T21:14:35.059548] [INFO ] [MAIN ] RITM: Fetched primary data is valid. [2025-10-02T21:14:35.059685] [DEBUG] [LOCAL ] RITM: Saving primary data. [2025-10-02T21:14:35.061415] [DEBUG] [LOCAL ] RITM: Trimmed 76589 records to 53221 (keeping 200 days of data) [2025-10-02T21:14:35.317991] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-02T21:14:35.450862] [DEBUG] [LOCAL ] RITM: Primary data saved (53221 records). [2025-10-02T21:14:35.451018] [INFO ] [MAIN ] RITM: Full history saved. [2025-10-02T21:14:35.451097] [INFO ] [MAIN ] Update Progress: 1806/2370 symbols completed. RITM took 29.8s. Estimated remaining: 1h 19m 29s. Rate: 7.1 symbols/min [2025-10-02T21:14:35.478218] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-05. [2025-10-02T21:14:35.648353] [INFO ] [MAIN ] RL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:14:35.648603] [DEBUG] [LOCAL ] RL: No existing data file found in primary storage. [2025-10-02T21:14:35.648684] [WARN ] [MAIN ] RL: No existing data found, performing full refresh instead. [2025-10-02T21:14:35.648825] [INFO ] [MAIN ] RL: Wiping existing primary data before full refresh. [2025-10-02T21:14:35.648898] [INFO ] [LOCAL ] RL: Starting deletion of primary data. [2025-10-02T21:14:35.648955] [DEBUG] [LOCAL ] RL: No primary data file found to delete. [2025-10-02T21:14:35.648989] [INFO ] [MAIN ] RL: Starting full primary refresh. [2025-10-02T21:14:36.022281] [INFO ] [REMOTE ] RL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:14:36.273033] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-03. [2025-10-02T21:14:36.361242] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-02T21:14:37.072988] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-02. [2025-10-02T21:14:37.271135] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-02T21:14:37.873040] [INFO ] [REMOTE ] RL: Fetching primary data for 2024-12. [2025-10-02T21:14:38.673011] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-04. [2025-10-02T21:14:38.730426] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-02T21:14:38.947504] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-02T21:14:39.473051] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-01. [2025-10-02T21:14:39.793926] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-02T21:14:40.248810] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-02T21:14:40.272977] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-02. [2025-10-02T21:14:41.073005] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-05. [2025-10-02T21:14:41.125000] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-02T21:14:41.873001] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-06. [2025-10-02T21:14:41.965868] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-02T21:14:42.673010] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-06. [2025-10-02T21:14:42.738233] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-02T21:14:43.203991] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-02T21:14:43.473251] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-07. [2025-10-02T21:14:44.273070] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-07. [2025-10-02T21:14:44.421167] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-02T21:14:45.073011] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-03. [2025-10-02T21:14:45.377368] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-02T21:14:45.873033] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-03. [2025-10-02T21:14:45.927673] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-02T21:14:46.673026] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-08. [2025-10-02T21:14:47.473029] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-08. [2025-10-02T21:14:47.591673] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-02T21:14:48.037432] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-02T21:14:48.273037] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-04. [2025-10-02T21:14:48.525768] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-02T21:14:49.073018] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-09. [2025-10-02T21:14:49.880340] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-04. [2025-10-02T21:14:49.886923] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-02T21:14:50.242349] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-02T21:14:50.678154] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-05. [2025-10-02T21:14:50.692939] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-02T21:14:51.473048] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-05. [2025-10-02T21:14:52.272968] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-09. [2025-10-02T21:14:52.505183] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-02T21:14:52.846555] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-02T21:14:52.867683] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-02T21:14:53.073020] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-06. [2025-10-02T21:14:53.509991] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-02T21:14:53.873002] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-10. [2025-10-02T21:14:54.672971] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-06. [2025-10-02T21:14:54.752963] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-02T21:14:54.754106] [INFO ] [REMOTE ] RIV: Full fetch complete (17642 records). [2025-10-02T21:14:54.754230] [DEBUG] [VALIDATOR ] RIV: Validating primary data. [2025-10-02T21:14:55.200517] [DEBUG] [VALIDATOR ] RIV: All expected trading days are present. [2025-10-02T21:14:55.200604] [DEBUG] [VALIDATOR ] RIV: Primary data validation passed. [2025-10-02T21:14:55.201105] [INFO ] [MAIN ] RIV: Fetched primary data is valid. [2025-10-02T21:14:55.201171] [DEBUG] [LOCAL ] RIV: Saving primary data. [2025-10-02T21:14:55.201859] [DEBUG] [LOCAL ] RIV: Trimmed 17642 records to 12377 (keeping 200 days of data) [2025-10-02T21:14:55.284026] [DEBUG] [LOCAL ] RIV: Primary data saved (12377 records). [2025-10-02T21:14:55.284169] [INFO ] [MAIN ] RIV: Full history saved. [2025-10-02T21:14:55.284302] [INFO ] [MAIN ] Update Progress: 1807/2370 symbols completed. RIV took 34.7s. Estimated remaining: 1h 19m 24s. Rate: 7.1 symbols/min [2025-10-02T21:14:55.483399] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-07. [2025-10-02T21:14:55.487777] [INFO ] [MAIN ] RLI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:14:55.488437] [DEBUG] [LOCAL ] RLI: No existing data file found in primary storage. [2025-10-02T21:14:55.488524] [WARN ] [MAIN ] RLI: No existing data found, performing full refresh instead. [2025-10-02T21:14:55.489536] [INFO ] [MAIN ] RLI: Wiping existing primary data before full refresh. [2025-10-02T21:14:55.489585] [INFO ] [LOCAL ] RLI: Starting deletion of primary data. [2025-10-02T21:14:55.489629] [DEBUG] [LOCAL ] RLI: No primary data file found to delete. [2025-10-02T21:14:55.489752] [INFO ] [MAIN ] RLI: Starting full primary refresh. [2025-10-02T21:14:55.894899] [INFO ] [REMOTE ] RLI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:14:56.273039] [INFO ] [REMOTE ] RLI: Fetching primary data for 2024-12. [2025-10-02T21:14:56.464487] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-02T21:14:56.669466] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-02T21:14:57.073009] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-10. [2025-10-02T21:14:57.494722] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-02T21:14:57.873020] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-07. [2025-10-02T21:14:58.417930] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-02T21:14:58.420051] [INFO ] [REMOTE ] RJF: Full fetch complete (68413 records). [2025-10-02T21:14:58.420174] [DEBUG] [VALIDATOR ] RJF: Validating primary data. [2025-10-02T21:14:58.678140] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-08. [2025-10-02T21:14:58.863356] [DEBUG] [VALIDATOR ] RJF: All expected trading days are present. [2025-10-02T21:14:58.863476] [DEBUG] [VALIDATOR ] RJF: Primary data validation passed. [2025-10-02T21:14:58.864751] [INFO ] [MAIN ] RJF: Fetched primary data is valid. [2025-10-02T21:14:58.864830] [DEBUG] [LOCAL ] RJF: Saving primary data. [2025-10-02T21:14:58.866265] [DEBUG] [LOCAL ] RJF: Trimmed 68413 records to 47283 (keeping 200 days of data) [2025-10-02T21:14:59.194917] [DEBUG] [LOCAL ] RJF: Primary data saved (47283 records). [2025-10-02T21:14:59.195133] [INFO ] [MAIN ] RJF: Full history saved. [2025-10-02T21:14:59.195260] [INFO ] [MAIN ] Update Progress: 1808/2370 symbols completed. RJF took 33.3s. Estimated remaining: 1h 19m 14s. Rate: 7.1 symbols/min [2025-10-02T21:14:59.382024] [INFO ] [MAIN ] RLJ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:14:59.382193] [DEBUG] [LOCAL ] RLJ: No existing data file found in primary storage. [2025-10-02T21:14:59.382233] [WARN ] [MAIN ] RLJ: No existing data found, performing full refresh instead. [2025-10-02T21:14:59.382349] [INFO ] [MAIN ] RLJ: Wiping existing primary data before full refresh. [2025-10-02T21:14:59.382391] [INFO ] [LOCAL ] RLJ: Starting deletion of primary data. [2025-10-02T21:14:59.382434] [DEBUG] [LOCAL ] RLJ: No primary data file found to delete. [2025-10-02T21:14:59.382468] [INFO ] [MAIN ] RLJ: Starting full primary refresh. [2025-10-02T21:14:59.477566] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-01. [2025-10-02T21:14:59.790046] [INFO ] [REMOTE ] RLJ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:14:59.816533] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-02T21:14:59.930163] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-02T21:15:00.273044] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2024-12. [2025-10-02T21:15:01.078112] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-08. [2025-10-02T21:15:01.089426] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-02T21:15:01.767378] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-02T21:15:01.873044] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-01. [2025-10-02T21:15:02.673063] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-02. [2025-10-02T21:15:03.253864] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-02T21:15:03.473001] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-09. [2025-10-02T21:15:03.691469] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-02T21:15:04.138459] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-02T21:15:04.237147] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-02T21:15:04.273041] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-10. [2025-10-02T21:15:05.073029] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-03. [2025-10-02T21:15:05.438440] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-02T21:15:05.440225] [INFO ] [REMOTE ] RL: Full fetch complete (59919 records). [2025-10-02T21:15:05.440351] [DEBUG] [VALIDATOR ] RL: Validating primary data. [2025-10-02T21:15:05.869639] [DEBUG] [VALIDATOR ] RL: All expected trading days are present. [2025-10-02T21:15:05.869771] [DEBUG] [VALIDATOR ] RL: Primary data validation passed. [2025-10-02T21:15:05.870743] [INFO ] [MAIN ] RL: Fetched primary data is valid. [2025-10-02T21:15:05.870808] [DEBUG] [LOCAL ] RL: Saving primary data. [2025-10-02T21:15:05.872287] [DEBUG] [LOCAL ] RL: Trimmed 59919 records to 41302 (keeping 200 days of data) [2025-10-02T21:15:05.872992] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-09. [2025-10-02T21:15:06.161282] [DEBUG] [LOCAL ] RL: Primary data saved (41302 records). [2025-10-02T21:15:06.161415] [INFO ] [MAIN ] RL: Full history saved. [2025-10-02T21:15:06.161489] [INFO ] [MAIN ] Update Progress: 1809/2370 symbols completed. RL took 30.7s. Estimated remaining: 1h 19m 6s. Rate: 7.1 symbols/min [2025-10-02T21:15:06.345331] [INFO ] [MAIN ] RLTY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:15:06.345519] [DEBUG] [LOCAL ] RLTY: No existing data file found in primary storage. [2025-10-02T21:15:06.345561] [WARN ] [MAIN ] RLTY: No existing data found, performing full refresh instead. [2025-10-02T21:15:06.345746] [INFO ] [MAIN ] RLTY: Wiping existing primary data before full refresh. [2025-10-02T21:15:06.345797] [INFO ] [LOCAL ] RLTY: Starting deletion of primary data. [2025-10-02T21:15:06.345842] [DEBUG] [LOCAL ] RLTY: No primary data file found to delete. [2025-10-02T21:15:06.345875] [INFO ] [MAIN ] RLTY: Starting full primary refresh. [2025-10-02T21:15:06.683270] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-02. [2025-10-02T21:15:06.770557] [INFO ] [REMOTE ] RLTY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:15:06.786479] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-02T21:15:07.473007] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2024-12. [2025-10-02T21:15:08.272986] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-04. [2025-10-02T21:15:08.378159] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-02T21:15:08.447714] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-09 (2.57 seconds). [2025-10-02T21:15:08.650741] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-02T21:15:09.073011] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-03. [2025-10-02T21:15:09.470335] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-02T21:15:09.873005] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-01. [2025-10-02T21:15:10.673055] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-10. [2025-10-02T21:15:10.859785] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-02T21:15:10.903060] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-02T21:15:11.473027] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-04. [2025-10-02T21:15:12.273005] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-05. [2025-10-02T21:15:12.708900] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-02T21:15:12.711092] [INFO ] [REMOTE ] RKT: Full fetch complete (77395 records). [2025-10-02T21:15:12.711216] [DEBUG] [VALIDATOR ] RKT: Validating primary data. [2025-10-02T21:15:13.077128] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-02. [2025-10-02T21:15:13.166953] [DEBUG] [VALIDATOR ] RKT: All expected trading days are present. [2025-10-02T21:15:13.167181] [DEBUG] [VALIDATOR ] RKT: Primary data validation passed. [2025-10-02T21:15:13.168465] [INFO ] [MAIN ] RKT: Fetched primary data is valid. [2025-10-02T21:15:13.168567] [DEBUG] [LOCAL ] RKT: Saving primary data. [2025-10-02T21:15:13.170871] [DEBUG] [LOCAL ] RKT: Trimmed 77395 records to 54111 (keeping 200 days of data) [2025-10-02T21:15:13.306282] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-02T21:15:13.359318] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-02T21:15:13.588821] [DEBUG] [LOCAL ] RKT: Primary data saved (54111 records). [2025-10-02T21:15:13.588960] [INFO ] [MAIN ] RKT: Full history saved. [2025-10-02T21:15:13.589050] [INFO ] [MAIN ] Update Progress: 1810/2370 symbols completed. RKT took 45.1s. Estimated remaining: 1h 18m 57s. Rate: 7.1 symbols/min [2025-10-02T21:15:13.775152] [INFO ] [MAIN ] RLX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:15:13.775482] [DEBUG] [LOCAL ] RLX: No existing data file found in primary storage. [2025-10-02T21:15:13.775539] [WARN ] [MAIN ] RLX: No existing data found, performing full refresh instead. [2025-10-02T21:15:13.775712] [INFO ] [MAIN ] RLX: Wiping existing primary data before full refresh. [2025-10-02T21:15:13.775775] [INFO ] [LOCAL ] RLX: Starting deletion of primary data. [2025-10-02T21:15:13.775827] [DEBUG] [LOCAL ] RLX: No primary data file found to delete. [2025-10-02T21:15:13.775917] [INFO ] [MAIN ] RLX: Starting full primary refresh. [2025-10-02T21:15:13.881384] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-05. [2025-10-02T21:15:14.177789] [INFO ] [REMOTE ] RLX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:15:14.236667] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-02T21:15:14.672997] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-03. [2025-10-02T21:15:15.424706] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-02T21:15:15.473015] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-06. [2025-10-02T21:15:15.577910] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-02T21:15:16.273003] [INFO ] [REMOTE ] RLX: Fetching primary data for 2024-12. [2025-10-02T21:15:16.670487] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-02T21:15:17.073008] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-07. [2025-10-02T21:15:17.872991] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-06. [2025-10-02T21:15:18.200079] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-02T21:15:18.537411] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-02T21:15:18.672992] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-01. [2025-10-02T21:15:19.472994] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-08. [2025-10-02T21:15:19.615039] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-02T21:15:20.273084] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-07. [2025-10-02T21:15:20.663762] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-02T21:15:20.891701] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-02T21:15:21.073013] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-09. [2025-10-02T21:15:21.791713] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-02T21:15:21.873057] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-04. [2025-10-02T21:15:22.582881] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-02T21:15:22.673010] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-02. [2025-10-02T21:15:22.838887] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-02T21:15:23.473015] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-08. [2025-10-02T21:15:24.273015] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-10. [2025-10-02T21:15:24.408522] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-02T21:15:25.073012] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-03. [2025-10-02T21:15:25.161980] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-02T21:15:25.245503] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-02T21:15:25.247320] [INFO ] [REMOTE ] RLI: Full fetch complete (47097 records). [2025-10-02T21:15:25.247410] [DEBUG] [VALIDATOR ] RLI: Validating primary data. [2025-10-02T21:15:25.650095] [DEBUG] [VALIDATOR ] RLI: All expected trading days are present. [2025-10-02T21:15:25.650180] [DEBUG] [VALIDATOR ] RLI: Primary data validation passed. [2025-10-02T21:15:25.651042] [INFO ] [MAIN ] RLI: Fetched primary data is valid. [2025-10-02T21:15:25.651106] [DEBUG] [LOCAL ] RLI: Saving primary data. [2025-10-02T21:15:25.652143] [DEBUG] [LOCAL ] RLI: Trimmed 47097 records to 33827 (keeping 200 days of data) [2025-10-02T21:15:25.870070] [DEBUG] [LOCAL ] RLI: Primary data saved (33827 records). [2025-10-02T21:15:25.870217] [INFO ] [MAIN ] RLI: Full history saved. [2025-10-02T21:15:25.870294] [INFO ] [MAIN ] Update Progress: 1811/2370 symbols completed. RLI took 30.6s. Estimated remaining: 1h 18m 49s. Rate: 7.1 symbols/min [2025-10-02T21:15:25.882786] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-05. [2025-10-02T21:15:26.082548] [INFO ] [MAIN ] RM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:15:26.082849] [DEBUG] [LOCAL ] RM: No existing data file found in primary storage. [2025-10-02T21:15:26.082929] [WARN ] [MAIN ] RM: No existing data found, performing full refresh instead. [2025-10-02T21:15:26.083115] [INFO ] [MAIN ] RM: Wiping existing primary data before full refresh. [2025-10-02T21:15:26.083201] [INFO ] [LOCAL ] RM: Starting deletion of primary data. [2025-10-02T21:15:26.083256] [DEBUG] [LOCAL ] RM: No primary data file found to delete. [2025-10-02T21:15:26.083310] [INFO ] [MAIN ] RM: Starting full primary refresh. [2025-10-02T21:15:26.479690] [INFO ] [REMOTE ] RM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:15:26.673009] [INFO ] [REMOTE ] RM: Fetching primary data for 2024-12. [2025-10-02T21:15:26.758524] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-02T21:15:26.908507] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-02T21:15:27.330799] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-02T21:15:27.473049] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-01. [2025-10-02T21:15:28.272998] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-06. [2025-10-02T21:15:28.383132] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-02T21:15:29.072992] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-09. [2025-10-02T21:15:29.216793] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-02T21:15:29.873050] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-04. [2025-10-02T21:15:30.673007] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-07. [2025-10-02T21:15:30.740486] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-02T21:15:31.207897] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-02T21:15:31.473056] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-05. [2025-10-02T21:15:31.579012] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-02T21:15:32.273013] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-02. [2025-10-02T21:15:33.073024] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-08. [2025-10-02T21:15:33.216363] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-02T21:15:33.218669] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-02T21:15:33.872978] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-03. [2025-10-02T21:15:34.004298] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-02T21:15:34.575972] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-02T21:15:34.673022] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-04. [2025-10-02T21:15:35.473013] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-06. [2025-10-02T21:15:35.660280] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-02T21:15:36.273017] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-09. [2025-10-02T21:15:36.977047] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-02T21:15:37.072982] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-07. [2025-10-02T21:15:37.230449] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-02T21:15:37.873007] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-10. [2025-10-02T21:15:38.672995] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-05. [2025-10-02T21:15:38.937189] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-02T21:15:39.157893] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-02T21:15:39.160955] [INFO ] [REMOTE ] RLJ: Full fetch complete (69258 records). [2025-10-02T21:15:39.161101] [DEBUG] [VALIDATOR ] RLJ: Validating primary data. [2025-10-02T21:15:39.479786] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-08. [2025-10-02T21:15:39.602615] [DEBUG] [VALIDATOR ] RLJ: All expected trading days are present. [2025-10-02T21:15:39.602837] [DEBUG] [VALIDATOR ] RLJ: Primary data validation passed. [2025-10-02T21:15:39.604923] [INFO ] [MAIN ] RLJ: Fetched primary data is valid. [2025-10-02T21:15:39.605005] [DEBUG] [LOCAL ] RLJ: Saving primary data. [2025-10-02T21:15:39.611072] [DEBUG] [LOCAL ] RLJ: Trimmed 69258 records to 48448 (keeping 200 days of data) [2025-10-02T21:15:39.922111] [DEBUG] [LOCAL ] RLJ: Primary data saved (48448 records). [2025-10-02T21:15:39.922245] [INFO ] [MAIN ] RLJ: Full history saved. [2025-10-02T21:15:39.922333] [INFO ] [MAIN ] Update Progress: 1812/2370 symbols completed. RLJ took 40.7s. Estimated remaining: 1h 18m 43s. Rate: 7.1 symbols/min [2025-10-02T21:15:40.106965] [INFO ] [MAIN ] RMAX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:15:40.107207] [DEBUG] [LOCAL ] RMAX: No existing data file found in primary storage. [2025-10-02T21:15:40.107264] [WARN ] [MAIN ] RMAX: No existing data found, performing full refresh instead. [2025-10-02T21:15:40.107413] [INFO ] [MAIN ] RMAX: Wiping existing primary data before full refresh. [2025-10-02T21:15:40.107500] [INFO ] [LOCAL ] RMAX: Starting deletion of primary data. [2025-10-02T21:15:40.107573] [DEBUG] [LOCAL ] RMAX: No primary data file found to delete. [2025-10-02T21:15:40.107612] [INFO ] [MAIN ] RMAX: Starting full primary refresh. [2025-10-02T21:15:40.285979] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-10. [2025-10-02T21:15:40.492843] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-02T21:15:40.536930] [INFO ] [REMOTE ] RMAX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:15:41.050474] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-02T21:15:41.052047] [INFO ] [REMOTE ] RLTY: Full fetch complete (17948 records). [2025-10-02T21:15:41.052168] [DEBUG] [VALIDATOR ] RLTY: Validating primary data. [2025-10-02T21:15:41.078189] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2024-12. [2025-10-02T21:15:41.496020] [DEBUG] [VALIDATOR ] RLTY: All expected trading days are present. [2025-10-02T21:15:41.510971] [DEBUG] [VALIDATOR ] RLTY: Primary data validation passed. [2025-10-02T21:15:41.523737] [INFO ] [MAIN ] RLTY: Fetched primary data is valid. [2025-10-02T21:15:41.525712] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-02T21:15:41.524473] [DEBUG] [LOCAL ] RLTY: Saving primary data. [2025-10-02T21:15:41.537568] [DEBUG] [LOCAL ] RLTY: Trimmed 17948 records to 11252 (keeping 200 days of data) [2025-10-02T21:15:41.626308] [DEBUG] [LOCAL ] RLTY: Primary data saved (11252 records). [2025-10-02T21:15:41.626706] [INFO ] [MAIN ] RLTY: Full history saved. [2025-10-02T21:15:41.626816] [INFO ] [MAIN ] Update Progress: 1813/2370 symbols completed. RLTY took 35.5s. Estimated remaining: 1h 18m 32s. Rate: 7.1 symbols/min [2025-10-02T21:15:41.818221] [INFO ] [MAIN ] RMD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:15:41.818406] [DEBUG] [LOCAL ] RMD: No existing data file found in primary storage. [2025-10-02T21:15:41.818444] [WARN ] [MAIN ] RMD: No existing data found, performing full refresh instead. [2025-10-02T21:15:41.818555] [INFO ] [MAIN ] RMD: Wiping existing primary data before full refresh. [2025-10-02T21:15:41.818617] [INFO ] [LOCAL ] RMD: Starting deletion of primary data. [2025-10-02T21:15:41.818696] [DEBUG] [LOCAL ] RMD: No primary data file found to delete. [2025-10-02T21:15:41.818775] [INFO ] [MAIN ] RMD: Starting full primary refresh. [2025-10-02T21:15:41.878319] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-06. [2025-10-02T21:15:42.149556] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-02T21:15:42.238579] [INFO ] [REMOTE ] RMD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:15:42.446489] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-02T21:15:42.673034] [INFO ] [REMOTE ] RMD: Fetching primary data for 2024-12. [2025-10-02T21:15:43.472980] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-07. [2025-10-02T21:15:43.556694] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-02T21:15:44.273065] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-01. [2025-10-02T21:15:44.276527] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-02T21:15:45.072965] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-09. [2025-10-02T21:15:45.451300] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-02T21:15:45.873045] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-08. [2025-10-02T21:15:46.672970] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-02. [2025-10-02T21:15:46.750238] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-02T21:15:46.841351] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-02T21:15:47.473029] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-01. [2025-10-02T21:15:47.795619] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-02T21:15:48.273052] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-10. [2025-10-02T21:15:48.430500] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-02T21:15:49.073013] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-03. [2025-10-02T21:15:49.432884] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-02T21:15:49.434878] [INFO ] [REMOTE ] RLX: Full fetch complete (70266 records). [2025-10-02T21:15:49.435029] [DEBUG] [VALIDATOR ] RLX: Validating primary data. [2025-10-02T21:15:49.880340] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-09. [2025-10-02T21:15:49.881248] [DEBUG] [VALIDATOR ] RLX: All expected trading days are present. [2025-10-02T21:15:49.882358] [DEBUG] [VALIDATOR ] RLX: Primary data validation passed. [2025-10-02T21:15:49.883669] [INFO ] [MAIN ] RLX: Fetched primary data is valid. [2025-10-02T21:15:49.883836] [DEBUG] [LOCAL ] RLX: Saving primary data. [2025-10-02T21:15:49.885351] [DEBUG] [LOCAL ] RLX: Trimmed 70266 records to 48653 (keeping 200 days of data) [2025-10-02T21:15:50.198535] [DEBUG] [LOCAL ] RLX: Primary data saved (48653 records). [2025-10-02T21:15:50.198728] [INFO ] [MAIN ] RLX: Full history saved. [2025-10-02T21:15:50.198816] [INFO ] [MAIN ] Update Progress: 1814/2370 symbols completed. RLX took 36.6s. Estimated remaining: 1h 18m 24s. Rate: 7.1 symbols/min [2025-10-02T21:15:50.331081] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-02T21:15:50.409618] [INFO ] [MAIN ] RMI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:15:50.409833] [DEBUG] [LOCAL ] RMI: No existing data file found in primary storage. [2025-10-02T21:15:50.409877] [WARN ] [MAIN ] RMI: No existing data found, performing full refresh instead. [2025-10-02T21:15:50.409987] [INFO ] [MAIN ] RMI: Wiping existing primary data before full refresh. [2025-10-02T21:15:50.410106] [INFO ] [LOCAL ] RMI: Starting deletion of primary data. [2025-10-02T21:15:50.410172] [DEBUG] [LOCAL ] RMI: No primary data file found to delete. [2025-10-02T21:15:50.410221] [INFO ] [MAIN ] RMI: Starting full primary refresh. [2025-10-02T21:15:50.674836] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-02. [2025-10-02T21:15:50.825829] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-02T21:15:50.849501] [INFO ] [REMOTE ] RMI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:15:51.472978] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-10. [2025-10-02T21:15:51.536375] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-02T21:15:51.930556] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-02T21:15:51.931534] [INFO ] [REMOTE ] RM: Full fetch complete (11574 records). [2025-10-02T21:15:51.931610] [DEBUG] [VALIDATOR ] RM: Validating primary data. [2025-10-02T21:15:52.278123] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-04. [2025-10-02T21:15:52.360315] [DEBUG] [VALIDATOR ] RM: All expected trading days are present. [2025-10-02T21:15:52.360412] [DEBUG] [VALIDATOR ] RM: Primary data validation passed. [2025-10-02T21:15:52.360806] [INFO ] [MAIN ] RM: Fetched primary data is valid. [2025-10-02T21:15:52.360875] [DEBUG] [LOCAL ] RM: Saving primary data. [2025-10-02T21:15:52.361690] [DEBUG] [LOCAL ] RM: Trimmed 11574 records to 7680 (keeping 200 days of data) [2025-10-02T21:15:52.421162] [DEBUG] [LOCAL ] RM: Primary data saved (7680 records). [2025-10-02T21:15:52.421348] [INFO ] [MAIN ] RM: Full history saved. [2025-10-02T21:15:52.421462] [INFO ] [MAIN ] Update Progress: 1815/2370 symbols completed. RM took 26.6s. Estimated remaining: 1h 18m 13s. Rate: 7.1 symbols/min [2025-10-02T21:15:52.629038] [INFO ] [MAIN ] RMM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:15:52.629270] [DEBUG] [LOCAL ] RMM: No existing data file found in primary storage. [2025-10-02T21:15:52.629325] [WARN ] [MAIN ] RMM: No existing data found, performing full refresh instead. [2025-10-02T21:15:52.629454] [INFO ] [MAIN ] RMM: Wiping existing primary data before full refresh. [2025-10-02T21:15:52.629518] [INFO ] [LOCAL ] RMM: Starting deletion of primary data. [2025-10-02T21:15:52.629595] [DEBUG] [LOCAL ] RMM: No primary data file found to delete. [2025-10-02T21:15:52.629639] [INFO ] [MAIN ] RMM: Starting full primary refresh. [2025-10-02T21:15:53.078267] [INFO ] [REMOTE ] RMI: Fetching primary data for 2024-12. [2025-10-02T21:15:53.219754] [INFO ] [REMOTE ] RMM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:15:53.492578] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-02T21:15:53.817429] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-02T21:15:53.873001] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-01. [2025-10-02T21:15:54.460939] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-02T21:15:54.673013] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-05. [2025-10-02T21:15:55.472996] [INFO ] [REMOTE ] RMM: Fetching primary data for 2024-12. [2025-10-02T21:15:55.787094] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-02T21:15:56.273011] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-02. [2025-10-02T21:15:56.350712] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-02T21:15:56.997967] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-02T21:15:57.073001] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-03. [2025-10-02T21:15:57.787833] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-02T21:15:57.873004] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-03. [2025-10-02T21:15:58.537965] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-02T21:15:58.673007] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-06. [2025-10-02T21:15:59.473039] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-01. [2025-10-02T21:15:59.875553] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-02T21:16:00.273009] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-04. [2025-10-02T21:16:00.376910] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-02T21:16:00.929862] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-02T21:16:01.073052] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-05. [2025-10-02T21:16:01.873026] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-04. [2025-10-02T21:16:02.020569] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-02T21:16:02.445414] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-02T21:16:02.673018] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-07. [2025-10-02T21:16:03.473010] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-06. [2025-10-02T21:16:03.881638] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-02T21:16:04.273016] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-02. [2025-10-02T21:16:04.426779] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-02T21:16:05.072991] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-05. [2025-10-02T21:16:05.241833] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-02T21:16:05.728945] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-02T21:16:05.872991] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-03. [2025-10-02T21:16:06.673003] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-08. [2025-10-02T21:16:06.865089] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-02T21:16:07.473000] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-06. [2025-10-02T21:16:07.696471] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-02T21:16:08.130477] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-02T21:16:08.273000] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-07. [2025-10-02T21:16:08.965489] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-02T21:16:09.073020] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-07. [2025-10-02T21:16:09.877985] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-09. [2025-10-02T21:16:09.883277] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-02T21:16:10.672969] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-08. [2025-10-02T21:16:10.739708] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-02T21:16:11.473016] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-04. [2025-10-02T21:16:11.483471] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-02T21:16:12.273000] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-09. [2025-10-02T21:16:12.523176] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-02T21:16:12.981794] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-02T21:16:13.073004] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-10. [2025-10-02T21:16:13.524822] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-02T21:16:13.525714] [INFO ] [REMOTE ] RMI: Full fetch complete (6309 records). [2025-10-02T21:16:13.525790] [DEBUG] [VALIDATOR ] RMI: Validating primary data. [2025-10-02T21:16:13.885158] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-10. [2025-10-02T21:16:13.931939] [DEBUG] [VALIDATOR ] RMI: All expected trading days are present. [2025-10-02T21:16:13.932023] [DEBUG] [VALIDATOR ] RMI: Primary data validation passed. [2025-10-02T21:16:13.932219] [INFO ] [MAIN ] RMI: Fetched primary data is valid. [2025-10-02T21:16:13.932261] [DEBUG] [LOCAL ] RMI: Saving primary data. [2025-10-02T21:16:13.932765] [DEBUG] [LOCAL ] RMI: Trimmed 6309 records to 4733 (keeping 200 days of data) [2025-10-02T21:16:13.964383] [DEBUG] [LOCAL ] RMI: Primary data saved (4733 records). [2025-10-02T21:16:13.964528] [INFO ] [MAIN ] RMI: Full history saved. [2025-10-02T21:16:13.964669] [INFO ] [MAIN ] Update Progress: 1816/2370 symbols completed. RMI took 23.8s. Estimated remaining: 1h 18m 9s. Rate: 7.1 symbols/min [2025-10-02T21:16:14.148203] [INFO ] [MAIN ] RMMZ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:16:14.148417] [DEBUG] [LOCAL ] RMMZ: No existing data file found in primary storage. [2025-10-02T21:16:14.148476] [WARN ] [MAIN ] RMMZ: No existing data found, performing full refresh instead. [2025-10-02T21:16:14.148623] [INFO ] [MAIN ] RMMZ: Wiping existing primary data before full refresh. [2025-10-02T21:16:14.148720] [INFO ] [LOCAL ] RMMZ: Starting deletion of primary data. [2025-10-02T21:16:14.148785] [DEBUG] [LOCAL ] RMMZ: No primary data file found to delete. [2025-10-02T21:16:14.148825] [INFO ] [MAIN ] RMMZ: Starting full primary refresh. [2025-10-02T21:16:14.601688] [INFO ] [REMOTE ] RMMZ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:16:14.673013] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2024-12. [2025-10-02T21:16:14.786476] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-02T21:16:14.787874] [INFO ] [REMOTE ] RMAX: Full fetch complete (29822 records). [2025-10-02T21:16:14.787982] [DEBUG] [VALIDATOR ] RMAX: Validating primary data. [2025-10-02T21:16:15.196481] [DEBUG] [VALIDATOR ] RMAX: All expected trading days are present. [2025-10-02T21:16:15.196583] [DEBUG] [VALIDATOR ] RMAX: Primary data validation passed. [2025-10-02T21:16:15.197312] [INFO ] [MAIN ] RMAX: Fetched primary data is valid. [2025-10-02T21:16:15.197378] [DEBUG] [LOCAL ] RMAX: Saving primary data. [2025-10-02T21:16:15.198356] [DEBUG] [LOCAL ] RMAX: Trimmed 29822 records to 21594 (keeping 200 days of data) [2025-10-02T21:16:15.332149] [DEBUG] [LOCAL ] RMAX: Primary data saved (21594 records). [2025-10-02T21:16:15.332285] [INFO ] [MAIN ] RMAX: Full history saved. [2025-10-02T21:16:15.332371] [INFO ] [MAIN ] Update Progress: 1817/2370 symbols completed. RMAX took 35.4s. Estimated remaining: 1h 17m 58s. Rate: 7.1 symbols/min [2025-10-02T21:16:15.466352] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-02T21:16:15.476817] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-05. [2025-10-02T21:16:15.539147] [INFO ] [MAIN ] RMT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:16:15.539387] [DEBUG] [LOCAL ] RMT: No existing data file found in primary storage. [2025-10-02T21:16:15.539446] [WARN ] [MAIN ] RMT: No existing data found, performing full refresh instead. [2025-10-02T21:16:15.539562] [INFO ] [MAIN ] RMT: Wiping existing primary data before full refresh. [2025-10-02T21:16:15.539618] [INFO ] [LOCAL ] RMT: Starting deletion of primary data. [2025-10-02T21:16:15.539697] [DEBUG] [LOCAL ] RMT: No primary data file found to delete. [2025-10-02T21:16:15.539745] [INFO ] [MAIN ] RMT: Starting full primary refresh. [2025-10-02T21:16:15.927035] [INFO ] [REMOTE ] RMT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:16:16.272975] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-01. [2025-10-02T21:16:16.416216] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-02T21:16:16.948557] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-02T21:16:17.072990] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-06. [2025-10-02T21:16:17.709257] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-02T21:16:17.873024] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-07. [2025-10-02T21:16:18.627387] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-02T21:16:18.673001] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-08. [2025-10-02T21:16:19.479033] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-08. [2025-10-02T21:16:19.484093] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-02T21:16:20.273002] [INFO ] [REMOTE ] RMT: Fetching primary data for 2024-12. [2025-10-02T21:16:20.464393] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-02T21:16:21.073025] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-09. [2025-10-02T21:16:21.423180] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-02T21:16:21.866727] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-02T21:16:21.875261] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-09. [2025-10-02T21:16:22.642613] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-02T21:16:22.672957] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-10. [2025-10-02T21:16:23.473117] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-01. [2025-10-02T21:16:23.973716] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-02T21:16:23.976111] [INFO ] [REMOTE ] RMD: Full fetch complete (61220 records). [2025-10-02T21:16:23.976253] [DEBUG] [VALIDATOR ] RMD: Validating primary data. [2025-10-02T21:16:24.278333] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-10. [2025-10-02T21:16:24.476669] [DEBUG] [VALIDATOR ] RMD: All expected trading days are present. [2025-10-02T21:16:24.476853] [DEBUG] [VALIDATOR ] RMD: Primary data validation passed. [2025-10-02T21:16:24.478567] [INFO ] [MAIN ] RMD: Fetched primary data is valid. [2025-10-02T21:16:24.478633] [DEBUG] [LOCAL ] RMD: Saving primary data. [2025-10-02T21:16:24.480248] [DEBUG] [LOCAL ] RMD: Trimmed 61220 records to 42317 (keeping 200 days of data) [2025-10-02T21:16:24.628462] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-02T21:16:24.812904] [DEBUG] [LOCAL ] RMD: Primary data saved (42317 records). [2025-10-02T21:16:24.813100] [INFO ] [MAIN ] RMD: Full history saved. [2025-10-02T21:16:24.813208] [INFO ] [MAIN ] Update Progress: 1818/2370 symbols completed. RMD took 43.2s. Estimated remaining: 1h 17m 50s. Rate: 7.1 symbols/min [2025-10-02T21:16:24.982493] [INFO ] [MAIN ] RNG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:16:24.982783] [DEBUG] [LOCAL ] RNG: No existing data file found in primary storage. [2025-10-02T21:16:24.982833] [WARN ] [MAIN ] RNG: No existing data found, performing full refresh instead. [2025-10-02T21:16:24.983002] [INFO ] [MAIN ] RNG: Wiping existing primary data before full refresh. [2025-10-02T21:16:24.983045] [INFO ] [LOCAL ] RNG: Starting deletion of primary data. [2025-10-02T21:16:24.983088] [DEBUG] [LOCAL ] RNG: No primary data file found to delete. [2025-10-02T21:16:24.983121] [INFO ] [MAIN ] RNG: Starting full primary refresh. [2025-10-02T21:16:25.074448] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-02. [2025-10-02T21:16:25.090343] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-02T21:16:25.091981] [INFO ] [REMOTE ] RMM: Full fetch complete (15091 records). [2025-10-02T21:16:25.103000] [DEBUG] [VALIDATOR ] RMM: Validating primary data. [2025-10-02T21:16:25.678557] [INFO ] [REMOTE ] RNG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:16:25.774848] [DEBUG] [VALIDATOR ] RMM: All expected trading days are present. [2025-10-02T21:16:25.774940] [DEBUG] [VALIDATOR ] RMM: Primary data validation passed. [2025-10-02T21:16:25.775451] [INFO ] [MAIN ] RMM: Fetched primary data is valid. [2025-10-02T21:16:25.775493] [DEBUG] [LOCAL ] RMM: Saving primary data. [2025-10-02T21:16:25.776084] [DEBUG] [LOCAL ] RMM: Trimmed 15091 records to 10625 (keeping 200 days of data) [2025-10-02T21:16:25.846530] [DEBUG] [LOCAL ] RMM: Primary data saved (10625 records). [2025-10-02T21:16:25.846741] [INFO ] [MAIN ] RMM: Full history saved. [2025-10-02T21:16:25.846846] [INFO ] [MAIN ] Update Progress: 1819/2370 symbols completed. RMM took 33.4s. Estimated remaining: 1h 17m 39s. Rate: 7.1 symbols/min [2025-10-02T21:16:25.878186] [INFO ] [REMOTE ] RNG: Fetching primary data for 2024-12. [2025-10-02T21:16:26.036522] [INFO ] [MAIN ] RNGR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:16:26.036800] [DEBUG] [LOCAL ] RNGR: No existing data file found in primary storage. [2025-10-02T21:16:26.036861] [WARN ] [MAIN ] RNGR: No existing data found, performing full refresh instead. [2025-10-02T21:16:26.036993] [INFO ] [MAIN ] RNGR: Wiping existing primary data before full refresh. [2025-10-02T21:16:26.037040] [INFO ] [LOCAL ] RNGR: Starting deletion of primary data. [2025-10-02T21:16:26.037085] [DEBUG] [LOCAL ] RNGR: No primary data file found to delete. [2025-10-02T21:16:26.037122] [INFO ] [MAIN ] RNGR: Starting full primary refresh. [2025-10-02T21:16:26.233541] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-02T21:16:26.467298] [INFO ] [REMOTE ] RNGR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:16:26.673033] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2024-12. [2025-10-02T21:16:27.473080] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-03. [2025-10-02T21:16:27.519561] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-02T21:16:27.670932] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-02T21:16:28.273031] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-01. [2025-10-02T21:16:28.687381] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-02T21:16:29.073075] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-02. [2025-10-02T21:16:29.704377] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-02T21:16:29.876249] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-02T21:16:29.873252] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-03. [2025-10-02T21:16:30.564070] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-02T21:16:30.673005] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-02. [2025-10-02T21:16:31.473040] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-01. [2025-10-02T21:16:32.273018] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-04. [2025-10-02T21:16:32.413715] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-02T21:16:32.610021] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-02T21:16:32.810788] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-02T21:16:33.073028] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-02. [2025-10-02T21:16:33.873047] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-04. [2025-10-02T21:16:34.084052] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-02T21:16:34.672981] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-03. [2025-10-02T21:16:34.806729] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-02T21:16:35.473039] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-03. [2025-10-02T21:16:36.273016] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-05. [2025-10-02T21:16:36.502036] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-02T21:16:36.667330] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-02T21:16:37.072964] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-04. [2025-10-02T21:16:37.206366] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-02T21:16:37.872968] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-06. [2025-10-02T21:16:38.545985] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-02T21:16:38.673009] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-05. [2025-10-02T21:16:38.719183] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-02T21:16:39.472963] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-07. [2025-10-02T21:16:39.865728] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-02T21:16:40.272962] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-04. [2025-10-02T21:16:40.670892] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-02T21:16:41.073015] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-08. [2025-10-02T21:16:41.873001] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-05. [2025-10-02T21:16:41.897216] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-02T21:16:42.111097] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-02T21:16:42.598330] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-02T21:16:42.673017] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-06. [2025-10-02T21:16:43.473035] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-05. [2025-10-02T21:16:44.087064] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-02T21:16:44.273028] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-06. [2025-10-02T21:16:44.936185] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-02T21:16:45.073074] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-07. [2025-10-02T21:16:45.237829] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-02T21:16:45.873084] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-09. [2025-10-02T21:16:46.304317] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-02T21:16:46.673005] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-06. [2025-10-02T21:16:46.939075] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-02T21:16:47.473000] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-10. [2025-10-02T21:16:48.211100] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-02T21:16:48.212305] [INFO ] [REMOTE ] RMT: Full fetch complete (25397 records). [2025-10-02T21:16:48.212383] [DEBUG] [VALIDATOR ] RMT: Validating primary data. [2025-10-02T21:16:48.280419] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-08. [2025-10-02T21:16:48.662743] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-02T21:16:48.661214] [DEBUG] [VALIDATOR ] RMT: All expected trading days are present. [2025-10-02T21:16:48.662959] [DEBUG] [VALIDATOR ] RMT: Primary data validation passed. [2025-10-02T21:16:48.672857] [INFO ] [MAIN ] RMT: Fetched primary data is valid. [2025-10-02T21:16:48.673087] [DEBUG] [LOCAL ] RMT: Saving primary data. [2025-10-02T21:16:48.674151] [DEBUG] [LOCAL ] RMT: Trimmed 25397 records to 17436 (keeping 200 days of data) [2025-10-02T21:16:48.787973] [DEBUG] [LOCAL ] RMT: Primary data saved (17436 records). [2025-10-02T21:16:48.788170] [INFO ] [MAIN ] RMT: Full history saved. [2025-10-02T21:16:48.788257] [INFO ] [MAIN ] Update Progress: 1820/2370 symbols completed. RMT took 33.5s. Estimated remaining: 1h 17m 35s. Rate: 7.1 symbols/min [2025-10-02T21:16:48.982909] [INFO ] [MAIN ] RNP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:16:48.983098] [DEBUG] [LOCAL ] RNP: No existing data file found in primary storage. [2025-10-02T21:16:48.983136] [WARN ] [MAIN ] RNP: No existing data found, performing full refresh instead. [2025-10-02T21:16:48.983301] [INFO ] [MAIN ] RNP: Wiping existing primary data before full refresh. [2025-10-02T21:16:48.983354] [INFO ] [LOCAL ] RNP: Starting deletion of primary data. [2025-10-02T21:16:48.983397] [DEBUG] [LOCAL ] RNP: No primary data file found to delete. [2025-10-02T21:16:48.983430] [INFO ] [MAIN ] RNP: Starting full primary refresh. [2025-10-02T21:16:49.078138] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-07. [2025-10-02T21:16:49.404549] [INFO ] [REMOTE ] RNP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:16:49.873037] [INFO ] [REMOTE ] RNP: Fetching primary data for 2024-12. [2025-10-02T21:16:50.672990] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-07. [2025-10-02T21:16:50.901273] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-02T21:16:50.941072] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-02T21:16:51.419691] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-02T21:16:51.473039] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-01. [2025-10-02T21:16:52.273000] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-08. [2025-10-02T21:16:52.714266] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-02T21:16:53.073041] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-08. [2025-10-02T21:16:53.789537] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-02T21:16:53.798590] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-02T21:16:53.873002] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-09. [2025-10-02T21:16:54.533210] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-02T21:16:54.673046] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-02. [2025-10-02T21:16:55.473040] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-09. [2025-10-02T21:16:55.567584] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-02T21:16:56.273002] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-03. [2025-10-02T21:16:57.073067] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-10. [2025-10-02T21:16:57.142144] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-02T21:16:57.305023] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-02T21:16:57.662082] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-02T21:16:57.662928] [INFO ] [REMOTE ] RMMZ: Full fetch complete (7092 records). [2025-10-02T21:16:57.663003] [DEBUG] [VALIDATOR ] RMMZ: Validating primary data. [2025-10-02T21:16:57.878431] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-04. [2025-10-02T21:16:58.061850] [DEBUG] [VALIDATOR ] RMMZ: All expected trading days are present. [2025-10-02T21:16:58.061992] [DEBUG] [VALIDATOR ] RMMZ: Primary data validation passed. [2025-10-02T21:16:58.062296] [INFO ] [MAIN ] RMMZ: Fetched primary data is valid. [2025-10-02T21:16:58.062347] [DEBUG] [LOCAL ] RMMZ: Saving primary data. [2025-10-02T21:16:58.062820] [DEBUG] [LOCAL ] RMMZ: Trimmed 7092 records to 4867 (keeping 200 days of data) [2025-10-02T21:16:58.093625] [DEBUG] [LOCAL ] RMMZ: Primary data saved (4867 records). [2025-10-02T21:16:58.093787] [INFO ] [MAIN ] RMMZ: Full history saved. [2025-10-02T21:16:58.093865] [INFO ] [MAIN ] Update Progress: 1821/2370 symbols completed. RMMZ took 44.1s. Estimated remaining: 1h 17m 27s. Rate: 7.1 symbols/min [2025-10-02T21:16:58.280077] [INFO ] [MAIN ] RNR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:16:58.280271] [DEBUG] [LOCAL ] RNR: No existing data file found in primary storage. [2025-10-02T21:16:58.280332] [WARN ] [MAIN ] RNR: No existing data found, performing full refresh instead. [2025-10-02T21:16:58.280459] [INFO ] [MAIN ] RNR: Wiping existing primary data before full refresh. [2025-10-02T21:16:58.280502] [INFO ] [LOCAL ] RNR: Starting deletion of primary data. [2025-10-02T21:16:58.280544] [DEBUG] [LOCAL ] RNR: No primary data file found to delete. [2025-10-02T21:16:58.280576] [INFO ] [MAIN ] RNR: Starting full primary refresh. [2025-10-02T21:16:58.671385] [INFO ] [REMOTE ] RNR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:16:58.672964] [INFO ] [REMOTE ] RNR: Fetching primary data for 2024-12. [2025-10-02T21:16:59.004323] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-02T21:16:59.472997] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-05. [2025-10-02T21:17:00.029093] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-02T21:17:00.272991] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-01. [2025-10-02T21:17:00.557116] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-02T21:17:01.073013] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-10. [2025-10-02T21:17:01.872997] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-06. [2025-10-02T21:17:02.004926] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-02T21:17:02.236910] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-02T21:17:02.239195] [INFO ] [REMOTE ] RNG: Full fetch complete (69424 records). [2025-10-02T21:17:02.239530] [DEBUG] [VALIDATOR ] RNG: Validating primary data. [2025-10-02T21:17:02.670872] [DEBUG] [VALIDATOR ] RNG: All expected trading days are present. [2025-10-02T21:17:02.670998] [DEBUG] [VALIDATOR ] RNG: Primary data validation passed. [2025-10-02T21:17:02.672161] [INFO ] [MAIN ] RNG: Fetched primary data is valid. [2025-10-02T21:17:02.672228] [DEBUG] [LOCAL ] RNG: Saving primary data. [2025-10-02T21:17:02.673115] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-02. [2025-10-02T21:17:02.674981] [DEBUG] [LOCAL ] RNG: Trimmed 69424 records to 48381 (keeping 200 days of data) [2025-10-02T21:17:02.977545] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-02T21:17:02.995930] [DEBUG] [LOCAL ] RNG: Primary data saved (48381 records). [2025-10-02T21:17:02.996049] [INFO ] [MAIN ] RNG: Full history saved. [2025-10-02T21:17:02.996123] [INFO ] [MAIN ] Update Progress: 1822/2370 symbols completed. RNG took 38.2s. Estimated remaining: 1h 17m 18s. Rate: 7.1 symbols/min [2025-10-02T21:17:03.178109] [INFO ] [MAIN ] RNST: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:17:03.178301] [DEBUG] [LOCAL ] RNST: No existing data file found in primary storage. [2025-10-02T21:17:03.178344] [WARN ] [MAIN ] RNST: No existing data found, performing full refresh instead. [2025-10-02T21:17:03.178546] [INFO ] [MAIN ] RNST: Wiping existing primary data before full refresh. [2025-10-02T21:17:03.178604] [INFO ] [LOCAL ] RNST: Starting deletion of primary data. [2025-10-02T21:17:03.178680] [DEBUG] [LOCAL ] RNST: No primary data file found to delete. [2025-10-02T21:17:03.178736] [INFO ] [MAIN ] RNST: Starting full primary refresh. [2025-10-02T21:17:03.478067] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-07. [2025-10-02T21:17:03.575224] [INFO ] [REMOTE ] RNST: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:17:04.272992] [INFO ] [REMOTE ] RNST: Fetching primary data for 2024-12. [2025-10-02T21:17:04.497381] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-02T21:17:04.776171] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-02T21:17:05.072996] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-08. [2025-10-02T21:17:05.778599] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-02T21:17:05.873014] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-03. [2025-10-02T21:17:06.162564] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-02T21:17:06.673016] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-01. [2025-10-02T21:17:07.473018] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-09. [2025-10-02T21:17:07.557756] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-02T21:17:08.196327] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-02T21:17:08.273005] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-02. [2025-10-02T21:17:08.576226] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-02T21:17:09.073008] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-10. [2025-10-02T21:17:09.783382] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-02T21:17:09.784733] [INFO ] [REMOTE ] RNP: Full fetch complete (23572 records). [2025-10-02T21:17:09.784878] [DEBUG] [VALIDATOR ] RNP: Validating primary data. [2025-10-02T21:17:09.877176] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-04. [2025-10-02T21:17:09.947210] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-02T21:17:10.232059] [DEBUG] [VALIDATOR ] RNP: All expected trading days are present. [2025-10-02T21:17:10.232153] [DEBUG] [VALIDATOR ] RNP: Primary data validation passed. [2025-10-02T21:17:10.232683] [INFO ] [MAIN ] RNP: Fetched primary data is valid. [2025-10-02T21:17:10.232747] [DEBUG] [LOCAL ] RNP: Saving primary data. [2025-10-02T21:17:10.233700] [DEBUG] [LOCAL ] RNP: Trimmed 23572 records to 15980 (keeping 200 days of data) [2025-10-02T21:17:10.342040] [DEBUG] [LOCAL ] RNP: Primary data saved (15980 records). [2025-10-02T21:17:10.342186] [INFO ] [MAIN ] RNP: Full history saved. [2025-10-02T21:17:10.342265] [INFO ] [MAIN ] Update Progress: 1823/2370 symbols completed. RNP took 21.6s. Estimated remaining: 1h 17m 9s. Rate: 7.1 symbols/min [2025-10-02T21:17:10.549795] [INFO ] [MAIN ] ROG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:17:10.549993] [DEBUG] [LOCAL ] ROG: No existing data file found in primary storage. [2025-10-02T21:17:10.550033] [WARN ] [MAIN ] ROG: No existing data found, performing full refresh instead. [2025-10-02T21:17:10.550153] [INFO ] [MAIN ] ROG: Wiping existing primary data before full refresh. [2025-10-02T21:17:10.550197] [INFO ] [LOCAL ] ROG: Starting deletion of primary data. [2025-10-02T21:17:10.550241] [DEBUG] [LOCAL ] ROG: No primary data file found to delete. [2025-10-02T21:17:10.550277] [INFO ] [MAIN ] ROG: Starting full primary refresh. [2025-10-02T21:17:10.678185] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-03. [2025-10-02T21:17:10.986794] [INFO ] [REMOTE ] ROG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:17:11.472987] [INFO ] [REMOTE ] ROG: Fetching primary data for 2024-12. [2025-10-02T21:17:11.590486] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-02T21:17:12.273003] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-05. [2025-10-02T21:17:12.351873] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-02T21:17:12.407880] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-02T21:17:13.073028] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-01. [2025-10-02T21:17:13.804108] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-02T21:17:13.875263] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-04. [2025-10-02T21:17:13.877861] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-02T21:17:14.673036] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-02. [2025-10-02T21:17:15.448870] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-02T21:17:15.473026] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-06. [2025-10-02T21:17:15.839937] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-02T21:17:16.273004] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-03. [2025-10-02T21:17:16.777269] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-02T21:17:17.072977] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-07. [2025-10-02T21:17:17.533595] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-02T21:17:17.872998] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-04. [2025-10-02T21:17:18.673006] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-05. [2025-10-02T21:17:19.023005] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-02T21:17:19.387623] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-02T21:17:19.473006] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-05. [2025-10-02T21:17:20.172033] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-02T21:17:20.272999] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-06. [2025-10-02T21:17:20.770156] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-02T21:17:21.073019] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-06. [2025-10-02T21:17:21.765267] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-02T21:17:21.872997] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-07. [2025-10-02T21:17:22.163338] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-02T21:17:22.673028] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-07. [2025-10-02T21:17:23.133957] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-02T21:17:23.473028] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-08. [2025-10-02T21:17:23.692259] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-02T21:17:24.273052] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-08. [2025-10-02T21:17:24.509105] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-02T21:17:25.073038] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-08. [2025-10-02T21:17:25.481699] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-02T21:17:25.873029] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-09. [2025-10-02T21:17:26.228099] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-02T21:17:26.673028] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-09. [2025-10-02T21:17:27.308701] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-02T21:17:27.473036] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-10. [2025-10-02T21:17:27.749000] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-02T21:17:28.272999] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-10. [2025-10-02T21:17:28.306287] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-02T21:17:28.308101] [INFO ] [REMOTE ] RNR: Full fetch complete (51154 records). [2025-10-02T21:17:28.308208] [DEBUG] [VALIDATOR ] RNR: Validating primary data. [2025-10-02T21:17:28.728453] [DEBUG] [VALIDATOR ] RNR: All expected trading days are present. [2025-10-02T21:17:28.728543] [DEBUG] [VALIDATOR ] RNR: Primary data validation passed. [2025-10-02T21:17:28.729601] [INFO ] [MAIN ] RNR: Fetched primary data is valid. [2025-10-02T21:17:28.729693] [DEBUG] [LOCAL ] RNR: Saving primary data. [2025-10-02T21:17:28.730899] [DEBUG] [LOCAL ] RNR: Trimmed 51154 records to 34119 (keeping 200 days of data) [2025-10-02T21:17:28.963580] [DEBUG] [LOCAL ] RNR: Primary data saved (34119 records). [2025-10-02T21:17:28.963762] [INFO ] [MAIN ] RNR: Full history saved. [2025-10-02T21:17:28.963844] [INFO ] [MAIN ] Update Progress: 1824/2370 symbols completed. RNR took 30.9s. Estimated remaining: 1h 17m 3s. Rate: 7.1 symbols/min [2025-10-02T21:17:29.075140] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-09. [2025-10-02T21:17:29.161992] [INFO ] [MAIN ] ROK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:17:29.162209] [DEBUG] [LOCAL ] ROK: No existing data file found in primary storage. [2025-10-02T21:17:29.162253] [WARN ] [MAIN ] ROK: No existing data found, performing full refresh instead. [2025-10-02T21:17:29.166741] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-02T21:17:29.166899] [INFO ] [MAIN ] ROK: Wiping existing primary data before full refresh. [2025-10-02T21:17:29.168251] [INFO ] [LOCAL ] ROK: Starting deletion of primary data. [2025-10-02T21:17:29.168811] [DEBUG] [LOCAL ] ROK: No primary data file found to delete. [2025-10-02T21:17:29.169085] [INFO ] [MAIN ] ROK: Starting full primary refresh. [2025-10-02T21:17:29.202999] [INFO ] [REMOTE ] RNST: Full fetch complete (53218 records). [2025-10-02T21:17:29.237772] [DEBUG] [VALIDATOR ] RNST: Validating primary data. [2025-10-02T21:17:30.015829] [DEBUG] [VALIDATOR ] RNST: All expected trading days are present. [2025-10-02T21:17:30.021158] [DEBUG] [VALIDATOR ] RNST: Primary data validation passed. [2025-10-02T21:17:30.022309] [INFO ] [MAIN ] RNST: Fetched primary data is valid. [2025-10-02T21:17:30.035754] [DEBUG] [LOCAL ] RNST: Saving primary data. [2025-10-02T21:17:30.063090] [INFO ] [REMOTE ] ROK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:17:30.063989] [INFO ] [REMOTE ] ROK: Fetching primary data for 2024-12. [2025-10-02T21:17:30.065301] [DEBUG] [LOCAL ] RNST: Trimmed 53218 records to 37313 (keeping 200 days of data) [2025-10-02T21:17:30.172243] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-02T21:17:30.324521] [DEBUG] [LOCAL ] RNST: Primary data saved (37313 records). [2025-10-02T21:17:30.324699] [INFO ] [MAIN ] RNST: Full history saved. [2025-10-02T21:17:30.324788] [INFO ] [MAIN ] Update Progress: 1825/2370 symbols completed. RNST took 27.3s. Estimated remaining: 1h 16m 53s. Rate: 7.1 symbols/min [2025-10-02T21:17:30.509194] [INFO ] [MAIN ] ROL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:17:30.509427] [DEBUG] [LOCAL ] ROL: No existing data file found in primary storage. [2025-10-02T21:17:30.509530] [WARN ] [MAIN ] ROL: No existing data found, performing full refresh instead. [2025-10-02T21:17:30.509678] [INFO ] [MAIN ] ROL: Wiping existing primary data before full refresh. [2025-10-02T21:17:30.509735] [INFO ] [LOCAL ] ROL: Starting deletion of primary data. [2025-10-02T21:17:30.509782] [DEBUG] [LOCAL ] ROL: No primary data file found to delete. [2025-10-02T21:17:30.509816] [INFO ] [MAIN ] ROL: Starting full primary refresh. [2025-10-02T21:17:30.676868] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-10. [2025-10-02T21:17:30.900569] [INFO ] [REMOTE ] ROL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:17:30.955186] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-02T21:17:31.473014] [INFO ] [REMOTE ] ROL: Fetching primary data for 2024-12. [2025-10-02T21:17:31.614343] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-02T21:17:31.615588] [INFO ] [REMOTE ] ROG: Full fetch complete (30875 records). [2025-10-02T21:17:31.615750] [DEBUG] [VALIDATOR ] ROG: Validating primary data. [2025-10-02T21:17:32.024948] [DEBUG] [VALIDATOR ] ROG: All expected trading days are present. [2025-10-02T21:17:32.025064] [DEBUG] [VALIDATOR ] ROG: Primary data validation passed. [2025-10-02T21:17:32.025873] [INFO ] [MAIN ] ROG: Fetched primary data is valid. [2025-10-02T21:17:32.025956] [DEBUG] [LOCAL ] ROG: Saving primary data. [2025-10-02T21:17:32.027223] [DEBUG] [LOCAL ] ROG: Trimmed 30875 records to 22995 (keeping 200 days of data) [2025-10-02T21:17:32.146057] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-02T21:17:32.215147] [DEBUG] [LOCAL ] ROG: Primary data saved (22995 records). [2025-10-02T21:17:32.215309] [INFO ] [MAIN ] ROG: Full history saved. [2025-10-02T21:17:32.215415] [INFO ] [MAIN ] Update Progress: 1826/2370 symbols completed. ROG took 21.9s. Estimated remaining: 1h 16m 42s. Rate: 7.1 symbols/min [2025-10-02T21:17:32.283496] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-01. [2025-10-02T21:17:32.400431] [INFO ] [MAIN ] RPM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:17:32.400603] [DEBUG] [LOCAL ] RPM: No existing data file found in primary storage. [2025-10-02T21:17:32.400814] [WARN ] [MAIN ] RPM: No existing data found, performing full refresh instead. [2025-10-02T21:17:32.400938] [INFO ] [MAIN ] RPM: Wiping existing primary data before full refresh. [2025-10-02T21:17:32.400981] [INFO ] [LOCAL ] RPM: Starting deletion of primary data. [2025-10-02T21:17:32.401026] [DEBUG] [LOCAL ] RPM: No primary data file found to delete. [2025-10-02T21:17:32.401062] [INFO ] [MAIN ] RPM: Starting full primary refresh. [2025-10-02T21:17:32.780475] [INFO ] [REMOTE ] RPM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:17:33.072992] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-01. [2025-10-02T21:17:33.210172] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-02T21:17:33.882307] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-02. [2025-10-02T21:17:33.912444] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-02T21:17:34.673039] [INFO ] [REMOTE ] RPM: Fetching primary data for 2024-12. [2025-10-02T21:17:34.757883] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-02T21:17:35.473050] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-02. [2025-10-02T21:17:36.244941] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-02T21:17:36.272974] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-01. [2025-10-02T21:17:36.391404] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-02T21:17:37.073235] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-03. [2025-10-02T21:17:37.873000] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-03. [2025-10-02T21:17:37.927593] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-02T21:17:37.999198] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-02T21:17:38.672974] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-04. [2025-10-02T21:17:38.812662] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-02T21:17:39.082737] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-02T21:17:39.473014] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-04. [2025-10-02T21:17:40.117393] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-02T21:17:40.272995] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-05. [2025-10-02T21:17:40.741262] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-02T21:17:41.073009] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-02. [2025-10-02T21:17:41.873024] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-05. [2025-10-02T21:17:42.672993] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-06. [2025-10-02T21:17:42.741352] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-02T21:17:42.778584] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-02T21:17:43.472972] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-06. [2025-10-02T21:17:43.642457] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-02T21:17:44.031412] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-02T21:17:44.272981] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-07. [2025-10-02T21:17:45.072976] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-03. [2025-10-02T21:17:45.109179] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-02T21:17:45.873000] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-08. [2025-10-02T21:17:46.362312] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-02T21:17:46.498142] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-02T21:17:46.673046] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-09. [2025-10-02T21:17:47.473013] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-07. [2025-10-02T21:17:47.526334] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-02T21:17:48.273002] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-04. [2025-10-02T21:17:48.350312] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-02T21:17:49.073002] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-08. [2025-10-02T21:17:49.585426] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-02T21:17:49.812445] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-02T21:17:49.872997] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-09. [2025-10-02T21:17:50.673040] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-10. [2025-10-02T21:17:50.802685] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-02T21:17:51.473021] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-05. [2025-10-02T21:17:51.969915] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-02T21:17:51.971783] [INFO ] [REMOTE ] ROK: Full fetch complete (63124 records). [2025-10-02T21:17:51.971886] [DEBUG] [VALIDATOR ] ROK: Validating primary data. [2025-10-02T21:17:52.278698] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-10. [2025-10-02T21:17:52.402615] [DEBUG] [VALIDATOR ] ROK: All expected trading days are present. [2025-10-02T21:17:52.402840] [DEBUG] [VALIDATOR ] ROK: Primary data validation passed. [2025-10-02T21:17:52.403994] [INFO ] [MAIN ] ROK: Fetched primary data is valid. [2025-10-02T21:17:52.404083] [DEBUG] [LOCAL ] ROK: Saving primary data. [2025-10-02T21:17:52.405570] [DEBUG] [LOCAL ] ROK: Trimmed 63124 records to 44054 (keeping 200 days of data) [2025-10-02T21:17:52.694989] [DEBUG] [LOCAL ] ROK: Primary data saved (44054 records). [2025-10-02T21:17:52.695120] [INFO ] [MAIN ] ROK: Full history saved. [2025-10-02T21:17:52.695195] [INFO ] [MAIN ] Update Progress: 1827/2370 symbols completed. ROK took 23.7s. Estimated remaining: 1h 16m 37s. Rate: 7.1 symbols/min [2025-10-02T21:17:52.869531] [INFO ] [MAIN ] RPT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:17:52.869725] [DEBUG] [LOCAL ] RPT: No existing data file found in primary storage. [2025-10-02T21:17:52.869796] [WARN ] [MAIN ] RPT: No existing data found, performing full refresh instead. [2025-10-02T21:17:52.869951] [INFO ] [MAIN ] RPT: Wiping existing primary data before full refresh. [2025-10-02T21:17:52.870042] [INFO ] [LOCAL ] RPT: Starting deletion of primary data. [2025-10-02T21:17:52.870167] [DEBUG] [LOCAL ] RPT: No primary data file found to delete. [2025-10-02T21:17:52.870222] [INFO ] [MAIN ] RPT: Starting full primary refresh. [2025-10-02T21:17:53.267845] [INFO ] [REMOTE ] RPT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:17:53.268588] [INFO ] [REMOTE ] RPT: Fetching primary data for 2024-12. [2025-10-02T21:17:53.298298] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-02T21:17:53.503100] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-02T21:17:53.505505] [INFO ] [REMOTE ] ROL: Full fetch complete (72843 records). [2025-10-02T21:17:53.505699] [DEBUG] [VALIDATOR ] ROL: Validating primary data. [2025-10-02T21:17:53.888476] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-06. [2025-10-02T21:17:53.956756] [DEBUG] [VALIDATOR ] ROL: All expected trading days are present. [2025-10-02T21:17:53.956864] [DEBUG] [VALIDATOR ] ROL: Primary data validation passed. [2025-10-02T21:17:53.960709] [INFO ] [MAIN ] ROL: Fetched primary data is valid. [2025-10-02T21:17:53.960913] [DEBUG] [LOCAL ] ROL: Saving primary data. [2025-10-02T21:17:53.962496] [DEBUG] [LOCAL ] ROL: Trimmed 72843 records to 50678 (keeping 200 days of data) [2025-10-02T21:17:54.295596] [DEBUG] [LOCAL ] ROL: Primary data saved (50678 records). [2025-10-02T21:17:54.295762] [INFO ] [MAIN ] ROL: Full history saved. [2025-10-02T21:17:54.295858] [INFO ] [MAIN ] Update Progress: 1828/2370 symbols completed. ROL took 24.0s. Estimated remaining: 1h 16m 27s. Rate: 7.1 symbols/min [2025-10-02T21:17:54.457527] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-02T21:17:54.514957] [INFO ] [MAIN ] RQI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:17:54.515201] [DEBUG] [LOCAL ] RQI: No existing data file found in primary storage. [2025-10-02T21:17:54.515260] [WARN ] [MAIN ] RQI: No existing data found, performing full refresh instead. [2025-10-02T21:17:54.515390] [INFO ] [MAIN ] RQI: Wiping existing primary data before full refresh. [2025-10-02T21:17:54.515438] [INFO ] [LOCAL ] RQI: Starting deletion of primary data. [2025-10-02T21:17:54.515482] [DEBUG] [LOCAL ] RQI: No primary data file found to delete. [2025-10-02T21:17:54.515516] [INFO ] [MAIN ] RQI: Starting full primary refresh. [2025-10-02T21:17:54.679508] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-01. [2025-10-02T21:17:54.903583] [INFO ] [REMOTE ] RQI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:17:55.476020] [INFO ] [REMOTE ] RQI: Fetching primary data for 2024-12. [2025-10-02T21:17:55.502859] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-02T21:17:55.872508] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-02T21:17:56.272997] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-07. [2025-10-02T21:17:56.634149] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-02T21:17:57.073011] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-02. [2025-10-02T21:17:57.655678] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-02T21:17:57.873010] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-08. [2025-10-02T21:17:58.270020] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-02T21:17:58.673015] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-03. [2025-10-02T21:17:59.253487] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-02T21:17:59.472998] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-09. [2025-10-02T21:17:59.555608] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-02T21:18:00.273032] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-04. [2025-10-02T21:18:01.073023] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-01. [2025-10-02T21:18:01.219619] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-02T21:18:01.399172] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-02T21:18:01.872995] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-05. [2025-10-02T21:18:02.657862] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-02T21:18:02.672953] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-02. [2025-10-02T21:18:03.139506] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-02T21:18:03.473021] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-06. [2025-10-02T21:18:04.030430] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-02T21:18:04.273008] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-10. [2025-10-02T21:18:04.431129] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-02T21:18:05.073000] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-07. [2025-10-02T21:18:05.383210] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-02T21:18:05.385276] [INFO ] [REMOTE ] RPM: Full fetch complete (59358 records). [2025-10-02T21:18:05.385404] [DEBUG] [VALIDATOR ] RPM: Validating primary data. [2025-10-02T21:18:05.845599] [DEBUG] [VALIDATOR ] RPM: All expected trading days are present. [2025-10-02T21:18:05.845717] [DEBUG] [VALIDATOR ] RPM: Primary data validation passed. [2025-10-02T21:18:05.846786] [INFO ] [MAIN ] RPM: Fetched primary data is valid. [2025-10-02T21:18:05.846853] [DEBUG] [LOCAL ] RPM: Saving primary data. [2025-10-02T21:18:05.848284] [DEBUG] [LOCAL ] RPM: Trimmed 59358 records to 41852 (keeping 200 days of data) [2025-10-02T21:18:05.904534] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-03. [2025-10-02T21:18:06.154415] [DEBUG] [LOCAL ] RPM: Primary data saved (41852 records). [2025-10-02T21:18:06.154630] [INFO ] [MAIN ] RPM: Full history saved. [2025-10-02T21:18:06.154852] [INFO ] [MAIN ] Update Progress: 1829/2370 symbols completed. RPM took 33.9s. Estimated remaining: 1h 16m 20s. Rate: 7.1 symbols/min [2025-10-02T21:18:06.365314] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-02T21:18:06.399422] [INFO ] [MAIN ] RRC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:18:06.399842] [DEBUG] [LOCAL ] RRC: No existing data file found in primary storage. [2025-10-02T21:18:06.399902] [WARN ] [MAIN ] RRC: No existing data found, performing full refresh instead. [2025-10-02T21:18:06.400061] [INFO ] [MAIN ] RRC: Wiping existing primary data before full refresh. [2025-10-02T21:18:06.400113] [INFO ] [LOCAL ] RRC: Starting deletion of primary data. [2025-10-02T21:18:06.400159] [DEBUG] [LOCAL ] RRC: No primary data file found to delete. [2025-10-02T21:18:06.400206] [INFO ] [MAIN ] RRC: Starting full primary refresh. [2025-10-02T21:18:06.679285] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-08. [2025-10-02T21:18:06.792927] [INFO ] [REMOTE ] RRC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:18:07.428494] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-02T21:18:07.473003] [INFO ] [REMOTE ] RRC: Fetching primary data for 2024-12. [2025-10-02T21:18:07.880537] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-02T21:18:08.273017] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-04. [2025-10-02T21:18:09.069913] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-02T21:18:09.080022] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-09. [2025-10-02T21:18:09.870610] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-02T21:18:09.880999] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-01. [2025-10-02T21:18:09.898616] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-02T21:18:10.673017] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-05. [2025-10-02T21:18:11.348771] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-02T21:18:11.472974] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-02. [2025-10-02T21:18:12.092157] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-02T21:18:12.273012] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-06. [2025-10-02T21:18:13.072998] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-10. [2025-10-02T21:18:13.268072] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-02T21:18:13.597167] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-02T21:18:13.807812] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-02T21:18:13.808973] [INFO ] [REMOTE ] RPT: Full fetch complete (28464 records). [2025-10-02T21:18:13.809063] [DEBUG] [VALIDATOR ] RPT: Validating primary data. [2025-10-02T21:18:13.886378] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-07. [2025-10-02T21:18:14.220612] [DEBUG] [VALIDATOR ] RPT: All expected trading days are present. [2025-10-02T21:18:14.220723] [DEBUG] [VALIDATOR ] RPT: Primary data validation passed. [2025-10-02T21:18:14.221310] [INFO ] [MAIN ] RPT: Fetched primary data is valid. [2025-10-02T21:18:14.221354] [DEBUG] [LOCAL ] RPT: Saving primary data. [2025-10-02T21:18:14.222072] [DEBUG] [LOCAL ] RPT: Trimmed 28464 records to 19143 (keeping 200 days of data) [2025-10-02T21:18:14.347016] [DEBUG] [LOCAL ] RPT: Primary data saved (19143 records). [2025-10-02T21:18:14.347175] [INFO ] [MAIN ] RPT: Full history saved. [2025-10-02T21:18:14.347255] [INFO ] [MAIN ] Update Progress: 1830/2370 symbols completed. RPT took 21.7s. Estimated remaining: 1h 16m 11s. Rate: 7.1 symbols/min [2025-10-02T21:18:14.529211] [INFO ] [MAIN ] RRX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:18:14.529375] [DEBUG] [LOCAL ] RRX: No existing data file found in primary storage. [2025-10-02T21:18:14.529413] [WARN ] [MAIN ] RRX: No existing data found, performing full refresh instead. [2025-10-02T21:18:14.529527] [INFO ] [MAIN ] RRX: Wiping existing primary data before full refresh. [2025-10-02T21:18:14.529576] [INFO ] [LOCAL ] RRX: Starting deletion of primary data. [2025-10-02T21:18:14.529703] [DEBUG] [LOCAL ] RRX: No primary data file found to delete. [2025-10-02T21:18:14.529755] [INFO ] [MAIN ] RRX: Starting full primary refresh. [2025-10-02T21:18:14.680006] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-03. [2025-10-02T21:18:14.973284] [INFO ] [REMOTE ] RRX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:18:15.396709] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-02T21:18:15.472995] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-08. [2025-10-02T21:18:16.273048] [INFO ] [REMOTE ] RRX: Fetching primary data for 2024-12. [2025-10-02T21:18:16.920043] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-10-02T21:18:16.990212] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-02T21:18:17.073048] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-09. [2025-10-02T21:18:17.873019] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-04. [2025-10-02T21:18:17.945677] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-02T21:18:18.672975] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-01. [2025-10-02T21:18:18.763403] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-02T21:18:19.472977] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-10. [2025-10-02T21:18:19.800387] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-02T21:18:20.272960] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-05. [2025-10-02T21:18:20.302598] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-02T21:18:20.425100] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-02T21:18:20.426873] [INFO ] [REMOTE ] RQI: Full fetch complete (43361 records). [2025-10-02T21:18:20.427022] [DEBUG] [VALIDATOR ] RQI: Validating primary data. [2025-10-02T21:18:20.889445] [DEBUG] [VALIDATOR ] RQI: All expected trading days are present. [2025-10-02T21:18:20.889533] [DEBUG] [VALIDATOR ] RQI: Primary data validation passed. [2025-10-02T21:18:20.890416] [INFO ] [MAIN ] RQI: Fetched primary data is valid. [2025-10-02T21:18:20.890481] [DEBUG] [LOCAL ] RQI: Saving primary data. [2025-10-02T21:18:20.891552] [DEBUG] [LOCAL ] RQI: Trimmed 43361 records to 29347 (keeping 200 days of data) [2025-10-02T21:18:21.074886] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-02. [2025-10-02T21:18:21.095765] [DEBUG] [LOCAL ] RQI: Primary data saved (29347 records). [2025-10-02T21:18:21.095921] [INFO ] [MAIN ] RQI: Full history saved. [2025-10-02T21:18:21.096004] [INFO ] [MAIN ] Update Progress: 1831/2370 symbols completed. RQI took 26.8s. Estimated remaining: 1h 16m 2s. Rate: 7.1 symbols/min [2025-10-02T21:18:21.279796] [INFO ] [MAIN ] RS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:18:21.279963] [DEBUG] [LOCAL ] RS: No existing data file found in primary storage. [2025-10-02T21:18:21.280001] [WARN ] [MAIN ] RS: No existing data found, performing full refresh instead. [2025-10-02T21:18:21.280139] [INFO ] [MAIN ] RS: Wiping existing primary data before full refresh. [2025-10-02T21:18:21.280182] [INFO ] [LOCAL ] RS: Starting deletion of primary data. [2025-10-02T21:18:21.280224] [DEBUG] [LOCAL ] RS: No primary data file found to delete. [2025-10-02T21:18:21.280270] [INFO ] [MAIN ] RS: Starting full primary refresh. [2025-10-02T21:18:21.654377] [INFO ] [REMOTE ] RS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:18:21.873054] [INFO ] [REMOTE ] RS: Fetching primary data for 2024-12. [2025-10-02T21:18:22.252084] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-02T21:18:22.672976] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-06. [2025-10-02T21:18:22.871768] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-02T21:18:22.990281] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-02T21:18:23.473048] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-01. [2025-10-02T21:18:24.273015] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-03. [2025-10-02T21:18:24.559592] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-02T21:18:24.662173] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-02T21:18:25.073023] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-07. [2025-10-02T21:18:25.873042] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-02. [2025-10-02T21:18:26.029755] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-02T21:18:26.673054] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-04. [2025-10-02T21:18:27.087387] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-02T21:18:27.455815] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-02T21:18:27.472990] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-03. [2025-10-02T21:18:28.148944] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-02T21:18:28.273089] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-05. [2025-10-02T21:18:28.916182] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-02T21:18:28.938129] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-08 (100.66 seconds). [2025-10-02T21:18:29.073030] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-09. [2025-10-02T21:18:29.873063] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-08. [2025-10-02T21:18:29.965886] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-02T21:18:30.408396] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-02T21:18:30.673016] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-04. [2025-10-02T21:18:31.473035] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-06. [2025-10-02T21:18:31.796552] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-02T21:18:31.911553] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-02T21:18:32.273029] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-09. [2025-10-02T21:18:33.002631] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-02T21:18:33.073009] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-05. [2025-10-02T21:18:33.872991] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-10. [2025-10-02T21:18:34.135777] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-02T21:18:34.200448] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-02T21:18:34.673058] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-10. [2025-10-02T21:18:34.773775] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-02T21:18:34.775027] [INFO ] [REMOTE ] RNGR: Full fetch complete (28222 records). [2025-10-02T21:18:34.775107] [DEBUG] [VALIDATOR ] RNGR: Validating primary data. [2025-10-02T21:18:35.173807] [DEBUG] [VALIDATOR ] RNGR: All expected trading days are present. [2025-10-02T21:18:35.173889] [DEBUG] [VALIDATOR ] RNGR: Primary data validation passed. [2025-10-02T21:18:35.174595] [INFO ] [MAIN ] RNGR: Fetched primary data is valid. [2025-10-02T21:18:35.174684] [DEBUG] [LOCAL ] RNGR: Saving primary data. [2025-10-02T21:18:35.175390] [DEBUG] [LOCAL ] RNGR: Trimmed 28222 records to 20543 (keeping 200 days of data) [2025-10-02T21:18:35.305801] [DEBUG] [LOCAL ] RNGR: Primary data saved (20543 records). [2025-10-02T21:18:35.305954] [INFO ] [MAIN ] RNGR: Full history saved. [2025-10-02T21:18:35.306078] [INFO ] [MAIN ] Update Progress: 1832/2370 symbols completed. RNGR took 2m 9s. Estimated remaining: 1h 15m 55s. Rate: 7.1 symbols/min [2025-10-02T21:18:35.487325] [INFO ] [MAIN ] RSF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:18:35.483724] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-06. [2025-10-02T21:18:35.487515] [DEBUG] [LOCAL ] RSF: No existing data file found in primary storage. [2025-10-02T21:18:35.487587] [WARN ] [MAIN ] RSF: No existing data found, performing full refresh instead. [2025-10-02T21:18:35.488539] [INFO ] [MAIN ] RSF: Wiping existing primary data before full refresh. [2025-10-02T21:18:35.488603] [INFO ] [LOCAL ] RSF: Starting deletion of primary data. [2025-10-02T21:18:35.488718] [DEBUG] [LOCAL ] RSF: No primary data file found to delete. [2025-10-02T21:18:35.488787] [INFO ] [MAIN ] RSF: Starting full primary refresh. [2025-10-02T21:18:35.889821] [INFO ] [REMOTE ] RSF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:18:36.083753] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-02T21:18:36.088938] [INFO ] [REMOTE ] RRC: Full fetch complete (76355 records). [2025-10-02T21:18:36.089082] [DEBUG] [VALIDATOR ] RRC: Validating primary data. [2025-10-02T21:18:36.274680] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-07. [2025-10-02T21:18:36.506944] [DEBUG] [VALIDATOR ] RRC: All expected trading days are present. [2025-10-02T21:18:36.507030] [DEBUG] [VALIDATOR ] RRC: Primary data validation passed. [2025-10-02T21:18:36.508257] [INFO ] [MAIN ] RRC: Fetched primary data is valid. [2025-10-02T21:18:36.508323] [DEBUG] [LOCAL ] RRC: Saving primary data. [2025-10-02T21:18:36.510088] [DEBUG] [LOCAL ] RRC: Trimmed 76355 records to 53186 (keeping 200 days of data) [2025-10-02T21:18:36.758865] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-02T21:18:36.889063] [DEBUG] [LOCAL ] RRC: Primary data saved (53186 records). [2025-10-02T21:18:36.889212] [INFO ] [MAIN ] RRC: Full history saved. [2025-10-02T21:18:36.889322] [INFO ] [MAIN ] Update Progress: 1833/2370 symbols completed. RRC took 30.7s. Estimated remaining: 1h 15m 45s. Rate: 7.1 symbols/min [2025-10-02T21:18:37.076184] [INFO ] [REMOTE ] RSF: Fetching primary data for 2024-12. [2025-10-02T21:18:37.076112] [INFO ] [MAIN ] RSG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:18:37.077399] [DEBUG] [LOCAL ] RSG: No existing data file found in primary storage. [2025-10-02T21:18:37.077458] [WARN ] [MAIN ] RSG: No existing data found, performing full refresh instead. [2025-10-02T21:18:37.077585] [INFO ] [MAIN ] RSG: Wiping existing primary data before full refresh. [2025-10-02T21:18:37.077631] [INFO ] [LOCAL ] RSG: Starting deletion of primary data. [2025-10-02T21:18:37.077720] [DEBUG] [LOCAL ] RSG: No primary data file found to delete. [2025-10-02T21:18:37.077764] [INFO ] [MAIN ] RSG: Starting full primary refresh. [2025-10-02T21:18:37.456186] [INFO ] [REMOTE ] RSG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:18:37.675010] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-02T21:18:37.818909] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-02T21:18:37.873039] [INFO ] [REMOTE ] RSG: Fetching primary data for 2024-12. [2025-10-02T21:18:38.672974] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-01. [2025-10-02T21:18:38.946819] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-02T21:18:39.408735] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-02T21:18:39.473020] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-08. [2025-10-02T21:18:40.273027] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-02. [2025-10-02T21:18:40.704554] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-02T21:18:40.940913] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-02T21:18:41.072993] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-03. [2025-10-02T21:18:41.618557] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-02T21:18:41.873002] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-09. [2025-10-02T21:18:42.673052] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-04. [2025-10-02T21:18:43.248104] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-02T21:18:43.368501] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-02T21:18:43.473013] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-01. [2025-10-02T21:18:43.989897] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-02T21:18:44.273033] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-10. [2025-10-02T21:18:45.073034] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-07. [2025-10-02T21:18:45.339700] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-02T21:18:45.341406] [INFO ] [REMOTE ] RRX: Full fetch complete (58253 records). [2025-10-02T21:18:45.341492] [DEBUG] [VALIDATOR ] RRX: Validating primary data. [2025-10-02T21:18:45.746356] [DEBUG] [VALIDATOR ] RRX: All expected trading days are present. [2025-10-02T21:18:45.746443] [DEBUG] [VALIDATOR ] RRX: Primary data validation passed. [2025-10-02T21:18:45.747460] [INFO ] [MAIN ] RRX: Fetched primary data is valid. [2025-10-02T21:18:45.747527] [DEBUG] [LOCAL ] RRX: Saving primary data. [2025-10-02T21:18:45.748897] [DEBUG] [LOCAL ] RRX: Trimmed 58253 records to 41307 (keeping 200 days of data) [2025-10-02T21:18:45.873272] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-02. [2025-10-02T21:18:46.038380] [DEBUG] [LOCAL ] RRX: Primary data saved (41307 records). [2025-10-02T21:18:46.038544] [INFO ] [MAIN ] RRX: Full history saved. [2025-10-02T21:18:46.038694] [INFO ] [MAIN ] Update Progress: 1834/2370 symbols completed. RRX took 31.7s. Estimated remaining: 1h 15m 36s. Rate: 7.1 symbols/min [2025-10-02T21:18:46.228551] [INFO ] [MAIN ] RSI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:18:46.228762] [DEBUG] [LOCAL ] RSI: No existing data file found in primary storage. [2025-10-02T21:18:46.228818] [WARN ] [MAIN ] RSI: No existing data found, performing full refresh instead. [2025-10-02T21:18:46.228934] [INFO ] [MAIN ] RSI: Wiping existing primary data before full refresh. [2025-10-02T21:18:46.228979] [INFO ] [LOCAL ] RSI: Starting deletion of primary data. [2025-10-02T21:18:46.229021] [DEBUG] [LOCAL ] RSI: No primary data file found to delete. [2025-10-02T21:18:46.229054] [INFO ] [MAIN ] RSI: Starting full primary refresh. [2025-10-02T21:18:46.622295] [INFO ] [REMOTE ] RSI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:18:46.644449] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-02T21:18:46.673013] [INFO ] [REMOTE ] RSI: Fetching primary data for 2024-12. [2025-10-02T21:18:46.891779] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-02T21:18:47.473026] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-03. [2025-10-02T21:18:48.045009] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-02T21:18:48.273020] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-05. [2025-10-02T21:18:48.362082] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-02T21:18:48.916506] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-02T21:18:49.073007] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-04. [2025-10-02T21:18:49.872995] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-01. [2025-10-02T21:18:49.968238] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-02T21:18:50.673059] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-08. [2025-10-02T21:18:51.343092] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-02T21:18:51.473006] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-05. [2025-10-02T21:18:52.063679] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-02T21:18:52.272989] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-09. [2025-10-02T21:18:52.441532] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-02T21:18:53.073011] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-06. [2025-10-02T21:18:53.591091] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-02T21:18:53.873012] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-10. [2025-10-02T21:18:53.997375] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-02T21:18:54.630094] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-02T21:18:54.631461] [INFO ] [REMOTE ] RS: Full fetch complete (39426 records). [2025-10-02T21:18:54.631585] [DEBUG] [VALIDATOR ] RS: Validating primary data. [2025-10-02T21:18:54.678195] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-06. [2025-10-02T21:18:55.043979] [DEBUG] [VALIDATOR ] RS: All expected trading days are present. [2025-10-02T21:18:55.044069] [DEBUG] [VALIDATOR ] RS: Primary data validation passed. [2025-10-02T21:18:55.044974] [INFO ] [MAIN ] RS: Fetched primary data is valid. [2025-10-02T21:18:55.045041] [DEBUG] [LOCAL ] RS: Saving primary data. [2025-10-02T21:18:55.046191] [DEBUG] [LOCAL ] RS: Trimmed 39426 records to 25543 (keeping 200 days of data) [2025-10-02T21:18:55.223829] [DEBUG] [LOCAL ] RS: Primary data saved (25543 records). [2025-10-02T21:18:55.223976] [INFO ] [MAIN ] RS: Full history saved. [2025-10-02T21:18:55.224060] [INFO ] [MAIN ] Update Progress: 1835/2370 symbols completed. RS took 34.1s. Estimated remaining: 1h 15m 28s. Rate: 7.1 symbols/min [2025-10-02T21:18:55.407304] [INFO ] [MAIN ] RSKD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:18:55.407472] [DEBUG] [LOCAL ] RSKD: No existing data file found in primary storage. [2025-10-02T21:18:55.407513] [WARN ] [MAIN ] RSKD: No existing data found, performing full refresh instead. [2025-10-02T21:18:55.407631] [INFO ] [MAIN ] RSKD: Wiping existing primary data before full refresh. [2025-10-02T21:18:55.407712] [INFO ] [LOCAL ] RSKD: Starting deletion of primary data. [2025-10-02T21:18:55.407764] [DEBUG] [LOCAL ] RSKD: No primary data file found to delete. [2025-10-02T21:18:55.407799] [INFO ] [MAIN ] RSKD: Starting full primary refresh. [2025-10-02T21:18:55.482860] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-07. [2025-10-02T21:18:55.523233] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-02T21:18:55.797814] [INFO ] [REMOTE ] RSKD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:18:56.273016] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-07. [2025-10-02T21:18:56.418069] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-02T21:18:56.887098] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-02T21:18:57.073020] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-08. [2025-10-02T21:18:57.611009] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-02T21:18:57.873003] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-02. [2025-10-02T21:18:58.672996] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-09. [2025-10-02T21:18:59.475636] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2024-12. [2025-10-02T21:18:59.478735] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-02T21:18:59.578277] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-02T21:19:00.273015] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-10. [2025-10-02T21:19:01.005079] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-02T21:19:01.072996] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-01. [2025-10-02T21:19:01.583280] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-02T21:19:01.585744] [INFO ] [REMOTE ] RSG: Full fetch complete (68051 records). [2025-10-02T21:19:01.585915] [DEBUG] [VALIDATOR ] RSG: Validating primary data. [2025-10-02T21:19:01.879989] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-08. [2025-10-02T21:19:02.025745] [DEBUG] [VALIDATOR ] RSG: All expected trading days are present. [2025-10-02T21:19:02.025852] [DEBUG] [VALIDATOR ] RSG: Primary data validation passed. [2025-10-02T21:19:02.027170] [INFO ] [MAIN ] RSG: Fetched primary data is valid. [2025-10-02T21:19:02.027242] [DEBUG] [LOCAL ] RSG: Saving primary data. [2025-10-02T21:19:02.028972] [DEBUG] [LOCAL ] RSG: Trimmed 68051 records to 47804 (keeping 200 days of data) [2025-10-02T21:19:02.284351] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-02T21:19:02.375440] [DEBUG] [LOCAL ] RSG: Primary data saved (47804 records). [2025-10-02T21:19:02.375604] [INFO ] [MAIN ] RSG: Full history saved. [2025-10-02T21:19:02.375728] [INFO ] [MAIN ] Update Progress: 1836/2370 symbols completed. RSG took 25.5s. Estimated remaining: 1h 15m 19s. Rate: 7.1 symbols/min [2025-10-02T21:19:02.561055] [INFO ] [MAIN ] RTO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:19:02.561218] [DEBUG] [LOCAL ] RTO: No existing data file found in primary storage. [2025-10-02T21:19:02.561256] [WARN ] [MAIN ] RTO: No existing data found, performing full refresh instead. [2025-10-02T21:19:02.561419] [INFO ] [MAIN ] RTO: Wiping existing primary data before full refresh. [2025-10-02T21:19:02.561462] [INFO ] [LOCAL ] RTO: Starting deletion of primary data. [2025-10-02T21:19:02.561504] [DEBUG] [LOCAL ] RTO: No primary data file found to delete. [2025-10-02T21:19:02.561537] [INFO ] [MAIN ] RTO: Starting full primary refresh. [2025-10-02T21:19:02.674616] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-02. [2025-10-02T21:19:02.677214] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-02T21:19:02.954301] [INFO ] [REMOTE ] RTO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:19:03.473012] [INFO ] [REMOTE ] RTO: Fetching primary data for 2024-12. [2025-10-02T21:19:04.053980] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-02T21:19:04.273006] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-09. [2025-10-02T21:19:05.059532] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-02T21:19:05.081980] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-03. [2025-10-02T21:19:05.087914] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-02T21:19:05.872992] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-01. [2025-10-02T21:19:06.564701] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-02T21:19:06.672995] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-10. [2025-10-02T21:19:07.175091] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-02T21:19:07.175928] [INFO ] [REMOTE ] RSF: Full fetch complete (5651 records). [2025-10-02T21:19:07.176006] [DEBUG] [VALIDATOR ] RSF: Validating primary data. [2025-10-02T21:19:07.478104] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-04. [2025-10-02T21:19:07.638980] [DEBUG] [VALIDATOR ] RSF: All expected trading days are present. [2025-10-02T21:19:07.639404] [DEBUG] [VALIDATOR ] RSF: Primary data validation passed. [2025-10-02T21:19:07.640234] [INFO ] [MAIN ] RSF: Fetched primary data is valid. [2025-10-02T21:19:07.641852] [DEBUG] [LOCAL ] RSF: Saving primary data. [2025-10-02T21:19:07.641722] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-02T21:19:07.652855] [DEBUG] [LOCAL ] RSF: Trimmed 5651 records to 4250 (keeping 200 days of data) [2025-10-02T21:19:07.695840] [DEBUG] [LOCAL ] RSF: Primary data saved (4250 records). [2025-10-02T21:19:07.696154] [INFO ] [MAIN ] RSF: Full history saved. [2025-10-02T21:19:07.696309] [INFO ] [MAIN ] Update Progress: 1837/2370 symbols completed. RSF took 32.4s. Estimated remaining: 1h 15m 10s. Rate: 7.1 symbols/min [2025-10-02T21:19:08.273015] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-02. [2025-10-02T21:19:09.000266] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-02T21:19:09.072994] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-03. [2025-10-02T21:19:09.395774] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-02T21:19:09.873020] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-05. [2025-10-02T21:19:10.672984] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-03. [2025-10-02T21:19:10.973206] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-02T21:19:11.306390] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-02T21:19:11.473001] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-04. [2025-10-02T21:19:12.152156] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-02T21:19:12.272989] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-06. [2025-10-02T21:19:13.073028] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-04. [2025-10-02T21:19:13.171071] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-02T21:19:13.451599] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-02T21:19:13.873013] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-05. [2025-10-02T21:19:14.672982] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-07. [2025-10-02T21:19:14.751291] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-02T21:19:15.472975] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-05. [2025-10-02T21:19:15.665215] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-02T21:19:15.967740] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-02T21:19:16.273031] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-06. [2025-10-02T21:19:16.729033] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-02T21:19:17.072996] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-08. [2025-10-02T21:19:17.873037] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-06. [2025-10-02T21:19:18.025582] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-02T21:19:18.402852] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-02T21:19:18.673004] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-09. [2025-10-02T21:19:19.416334] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-02T21:19:19.473030] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-07. [2025-10-02T21:19:20.149243] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-02T21:19:20.273044] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-07. [2025-10-02T21:19:20.846379] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-02T21:19:21.073017] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-08. [2025-10-02T21:19:21.873020] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-10. [2025-10-02T21:19:21.994492] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-02T21:19:22.673010] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-08. [2025-10-02T21:19:22.879696] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-02T21:19:22.912477] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-02T21:19:22.914011] [INFO ] [REMOTE ] RSKD: Full fetch complete (48181 records). [2025-10-02T21:19:22.914101] [DEBUG] [VALIDATOR ] RSKD: Validating primary data. [2025-10-02T21:19:23.356900] [DEBUG] [VALIDATOR ] RSKD: All expected trading days are present. [2025-10-02T21:19:23.357011] [DEBUG] [VALIDATOR ] RSKD: Primary data validation passed. [2025-10-02T21:19:23.357910] [INFO ] [MAIN ] RSKD: Fetched primary data is valid. [2025-10-02T21:19:23.357987] [DEBUG] [LOCAL ] RSKD: Saving primary data. [2025-10-02T21:19:23.359200] [DEBUG] [LOCAL ] RSKD: Trimmed 48181 records to 33740 (keeping 200 days of data) [2025-10-02T21:19:23.473077] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-09. [2025-10-02T21:19:23.567827] [DEBUG] [LOCAL ] RSKD: Primary data saved (33740 records). [2025-10-02T21:19:23.567976] [INFO ] [MAIN ] RSKD: Full history saved. [2025-10-02T21:19:23.568217] [INFO ] [MAIN ] Update Progress: 1838/2370 symbols completed. RSKD took 28.3s. Estimated remaining: 1h 15m 4s. Rate: 7.1 symbols/min [2025-10-02T21:19:24.280273] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-02T21:19:24.289728] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-09. [2025-10-02T21:19:24.790473] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-02T21:19:25.073024] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-10. [2025-10-02T21:19:25.535409] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-02T21:19:25.873041] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-10. [2025-10-02T21:19:26.207768] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-02T21:19:26.210176] [INFO ] [REMOTE ] RSI: Full fetch complete (69438 records). [2025-10-02T21:19:26.210324] [DEBUG] [VALIDATOR ] RSI: Validating primary data. [2025-10-02T21:19:26.678325] [DEBUG] [VALIDATOR ] RSI: All expected trading days are present. [2025-10-02T21:19:26.678467] [DEBUG] [VALIDATOR ] RSI: Primary data validation passed. [2025-10-02T21:19:26.679754] [INFO ] [MAIN ] RSI: Fetched primary data is valid. [2025-10-02T21:19:26.679821] [DEBUG] [LOCAL ] RSI: Saving primary data. [2025-10-02T21:19:26.681369] [DEBUG] [LOCAL ] RSI: Trimmed 69438 records to 47217 (keeping 200 days of data) [2025-10-02T21:19:26.974630] [DEBUG] [LOCAL ] RSI: Primary data saved (47217 records). [2025-10-02T21:19:26.974810] [INFO ] [MAIN ] RSI: Full history saved. [2025-10-02T21:19:26.974891] [INFO ] [MAIN ] Update Progress: 1839/2370 symbols completed. RSI took 40.9s. Estimated remaining: 1h 14m 54s. Rate: 7.1 symbols/min [2025-10-02T21:19:27.067910] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-02T21:19:27.069706] [INFO ] [REMOTE ] RTO: Full fetch complete (58508 records). [2025-10-02T21:19:27.069805] [DEBUG] [VALIDATOR ] RTO: Validating primary data. [2025-10-02T21:19:27.477398] [DEBUG] [VALIDATOR ] RTO: All expected trading days are present. [2025-10-02T21:19:27.477535] [DEBUG] [VALIDATOR ] RTO: Primary data validation passed. [2025-10-02T21:19:27.478682] [INFO ] [MAIN ] RTO: Fetched primary data is valid. [2025-10-02T21:19:27.478747] [DEBUG] [LOCAL ] RTO: Saving primary data. [2025-10-02T21:19:27.480114] [DEBUG] [LOCAL ] RTO: Trimmed 58508 records to 40295 (keeping 200 days of data) [2025-10-02T21:19:27.736501] [DEBUG] [LOCAL ] RTO: Primary data saved (40295 records). [2025-10-02T21:19:27.736632] [INFO ] [MAIN ] RTO: Full history saved. [2025-10-02T21:19:27.736742] [INFO ] [MAIN ] Update Progress: 1840/2370 symbols completed. RTO took 25.4s. Estimated remaining: 1h 14m 43s. Rate: 7.1 symbols/min [2025-10-02T21:19:28.310929] [INFO ] [MAIN ] RVTY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:19:28.482619] [INFO ] [MAIN ] RVT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:19:28.513995] [INFO ] [MAIN ] RTX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:19:28.525432] [DEBUG] [LOCAL ] RVT: No existing data file found in primary storage. [2025-10-02T21:19:28.528462] [WARN ] [MAIN ] RVT: No existing data found, performing full refresh instead. [2025-10-02T21:19:28.556082] [INFO ] [MAIN ] RVT: Wiping existing primary data before full refresh. [2025-10-02T21:19:28.557493] [INFO ] [MAIN ] RVLV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:19:28.557677] [INFO ] [LOCAL ] RVT: Starting deletion of primary data. [2025-10-02T21:19:28.558143] [DEBUG] [LOCAL ] RVLV: No existing data file found in primary storage. [2025-10-02T21:19:28.558227] [WARN ] [MAIN ] RVLV: No existing data found, performing full refresh instead. [2025-10-02T21:19:28.558380] [INFO ] [MAIN ] RVLV: Wiping existing primary data before full refresh. [2025-10-02T21:19:28.558502] [DEBUG] [LOCAL ] RVT: No primary data file found to delete. [2025-10-02T21:19:28.558675] [INFO ] [LOCAL ] RVLV: Starting deletion of primary data. [2025-10-02T21:19:28.558595] [INFO ] [MAIN ] RVT: Starting full primary refresh. [2025-10-02T21:19:28.571669] [DEBUG] [LOCAL ] RVLV: No primary data file found to delete. [2025-10-02T21:19:28.598915] [INFO ] [MAIN ] RVLV: Starting full primary refresh. [2025-10-02T21:19:29.035357] [DEBUG] [LOCAL ] RVTY: Loaded 47521 existing records from primary storage. [2025-10-02T21:19:29.096006] [INFO ] [MAIN ] RVTY: Loaded 47521 existing records. [2025-10-02T21:19:29.154883] [DEBUG] [LOCAL ] RTX: Loaded 53707 existing records from primary storage. [2025-10-02T21:19:29.217315] [INFO ] [MAIN ] RTX: Loaded 53707 existing records. [2025-10-02T21:19:29.885991] [WARN ] [MAIN ] RVTY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:19:29.794629] [INFO ] [REMOTE ] RVT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:19:29.913778] [WARN ] [MAIN ] RTX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:19:29.919057] [INFO ] [MAIN ] RTX: Wiping existing primary data before full refresh. [2025-10-02T21:19:29.918916] [INFO ] [REMOTE ] RVT: Fetching primary data for 2024-12. [2025-10-02T21:19:29.919307] [INFO ] [LOCAL ] RTX: Starting deletion of primary data. [2025-10-02T21:19:29.918359] [INFO ] [MAIN ] RVTY: Wiping existing primary data before full refresh. [2025-10-02T21:19:29.919549] [INFO ] [LOCAL ] RVTY: Starting deletion of primary data. [2025-10-02T21:19:29.918122] [INFO ] [REMOTE ] RVLV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:19:29.920967] [DEBUG] [LOCAL ] RTX: Deleted primary data file. [2025-10-02T21:19:29.920913] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2024-12. [2025-10-02T21:19:29.921061] [INFO ] [MAIN ] RTX: Starting full primary refresh. [2025-10-02T21:19:29.944436] [DEBUG] [LOCAL ] RVTY: Deleted primary data file. [2025-10-02T21:19:29.972273] [INFO ] [MAIN ] RVTY: Starting full primary refresh. [2025-10-02T21:19:30.706934] [INFO ] [REMOTE ] RTX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:19:30.717761] [INFO ] [REMOTE ] RTX: Fetching primary data for 2024-12. [2025-10-02T21:19:30.741120] [INFO ] [REMOTE ] RVTY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:19:30.741745] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2024-12. [2025-10-02T21:19:31.401295] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-02T21:19:31.408639] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-01. [2025-10-02T21:19:32.317588] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-02T21:19:32.351164] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-01. [2025-10-02T21:19:32.354613] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2024-12 (2.43 seconds). [2025-10-02T21:19:32.365068] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-01. [2025-10-02T21:19:32.791967] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-02T21:19:32.803610] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-01. [2025-10-02T21:19:32.844613] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-02T21:19:33.073027] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-02. [2025-10-02T21:19:33.700537] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-02T21:19:33.873001] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-02. [2025-10-02T21:19:33.981551] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-02T21:19:34.042387] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-02T21:19:34.471250] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-02T21:19:34.673002] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-03. [2025-10-02T21:19:35.310432] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-02T21:19:35.473034] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-03. [2025-10-02T21:19:36.246371] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-02T21:19:36.272967] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-04. [2025-10-02T21:19:37.072967] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-02. [2025-10-02T21:19:37.119725] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-02T21:19:37.698228] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-02T21:19:37.873024] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-04. [2025-10-02T21:19:38.672989] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-05. [2025-10-02T21:19:39.100845] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-02T21:19:39.472974] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-03. [2025-10-02T21:19:39.901929] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-02T21:19:39.948283] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-02T21:19:40.273072] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-05. [2025-10-02T21:19:41.073031] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-06. [2025-10-02T21:19:41.332638] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-02T21:19:41.873033] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-02. [2025-10-02T21:19:42.011323] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-02T21:19:42.366529] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-02T21:19:42.673017] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-07. [2025-10-02T21:19:43.472981] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-04. [2025-10-02T21:19:43.616276] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-02T21:19:44.071940] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-02T21:19:44.272996] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-08. [2025-10-02T21:19:45.073049] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-06. [2025-10-02T21:19:45.625341] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-02T21:19:45.746558] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-02T21:19:45.873003] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-09. [2025-10-02T21:19:46.672990] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-03. [2025-10-02T21:19:47.097319] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-02T21:19:47.158779] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-02T21:19:47.473044] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-07. [2025-10-02T21:19:48.187200] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-02T21:19:48.273007] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-10. [2025-10-02T21:19:49.072988] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-05. [2025-10-02T21:19:49.237391] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-02T21:19:49.238813] [INFO ] [REMOTE ] RVT: Full fetch complete (39632 records). [2025-10-02T21:19:49.238910] [DEBUG] [VALIDATOR ] RVT: Validating primary data. [2025-10-02T21:19:49.652333] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-02T21:19:49.713331] [DEBUG] [VALIDATOR ] RVT: All expected trading days are present. [2025-10-02T21:19:49.713425] [DEBUG] [VALIDATOR ] RVT: Primary data validation passed. [2025-10-02T21:19:49.714381] [INFO ] [MAIN ] RVT: Fetched primary data is valid. [2025-10-02T21:19:49.714449] [DEBUG] [LOCAL ] RVT: Saving primary data. [2025-10-02T21:19:49.715616] [DEBUG] [LOCAL ] RVT: Trimmed 39632 records to 26786 (keeping 200 days of data) [2025-10-02T21:19:49.880432] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-04. [2025-10-02T21:19:49.896625] [DEBUG] [LOCAL ] RVT: Primary data saved (26786 records). [2025-10-02T21:19:49.896805] [INFO ] [MAIN ] RVT: Full history saved. [2025-10-02T21:19:49.896885] [INFO ] [MAIN ] Update Progress: 1841/2370 symbols completed. RVT took 22.1s. Estimated remaining: 1h 14m 39s. Rate: 7.1 symbols/min [2025-10-02T21:19:50.086125] [INFO ] [MAIN ] RWT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:19:50.125144] [DEBUG] [LOCAL ] RWT: Loaded 40850 existing records from primary storage. [2025-10-02T21:19:50.125436] [INFO ] [MAIN ] RWT: Loaded 40850 existing records. [2025-10-02T21:19:50.307123] [WARN ] [MAIN ] RWT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:19:50.307324] [INFO ] [MAIN ] RWT: Wiping existing primary data before full refresh. [2025-10-02T21:19:50.307374] [INFO ] [LOCAL ] RWT: Starting deletion of primary data. [2025-10-02T21:19:50.307606] [DEBUG] [LOCAL ] RWT: Deleted primary data file. [2025-10-02T21:19:50.307693] [INFO ] [MAIN ] RWT: Starting full primary refresh. [2025-10-02T21:19:50.675831] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-08. [2025-10-02T21:19:50.675730] [INFO ] [REMOTE ] RWT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:19:51.260134] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-02T21:19:51.342236] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-02T21:19:51.473018] [INFO ] [REMOTE ] RWT: Fetching primary data for 2024-12. [2025-10-02T21:19:52.190200] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-02T21:19:52.273014] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-09. [2025-10-02T21:19:53.072978] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-05. [2025-10-02T21:19:53.178492] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-02T21:19:53.872973] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-01. [2025-10-02T21:19:54.051477] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-02T21:19:54.673004] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-10. [2025-10-02T21:19:54.928682] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-02T21:19:55.474794] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-06. [2025-10-02T21:19:55.480052] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-02T21:19:55.781034] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-02T21:19:55.783091] [INFO ] [REMOTE ] RVTY: Full fetch complete (66746 records). [2025-10-02T21:19:55.783217] [DEBUG] [VALIDATOR ] RVTY: Validating primary data. [2025-10-02T21:19:56.217364] [DEBUG] [VALIDATOR ] RVTY: All expected trading days are present. [2025-10-02T21:19:56.217463] [DEBUG] [VALIDATOR ] RVTY: Primary data validation passed. [2025-10-02T21:19:56.218707] [INFO ] [MAIN ] RVTY: Fetched primary data is valid. [2025-10-02T21:19:56.218779] [DEBUG] [LOCAL ] RVTY: Saving primary data. [2025-10-02T21:19:56.220259] [DEBUG] [LOCAL ] RVTY: Trimmed 66746 records to 47883 (keeping 200 days of data) [2025-10-02T21:19:56.280275] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-06. [2025-10-02T21:19:56.540450] [DEBUG] [LOCAL ] RVTY: Primary data saved (47883 records). [2025-10-02T21:19:56.540602] [INFO ] [MAIN ] RVTY: Full history saved. [2025-10-02T21:19:56.540712] [INFO ] [MAIN ] Update Progress: 1842/2370 symbols completed. RVTY took 28.8s. Estimated remaining: 1h 14m 30s. Rate: 7.1 symbols/min [2025-10-02T21:19:56.731201] [INFO ] [MAIN ] RWTN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:19:56.731382] [DEBUG] [LOCAL ] RWTN: No existing data file found in primary storage. [2025-10-02T21:19:56.731420] [WARN ] [MAIN ] RWTN: No existing data found, performing full refresh instead. [2025-10-02T21:19:56.731527] [INFO ] [MAIN ] RWTN: Wiping existing primary data before full refresh. [2025-10-02T21:19:56.731569] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-10-02T21:19:56.731610] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-10-02T21:19:56.731663] [INFO ] [MAIN ] RWTN: Starting full primary refresh. [2025-10-02T21:19:57.078198] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-02. [2025-10-02T21:19:57.118254] [INFO ] [REMOTE ] RWTN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:19:57.674783] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-10-02T21:19:57.873043] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2024-12. [2025-10-02T21:19:58.117595] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-02T21:19:58.491323] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-02T21:19:58.517061] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-02T21:19:58.673003] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-07. [2025-10-02T21:19:59.473006] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-07. [2025-10-02T21:20:00.273001] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-01. [2025-10-02T21:20:00.865309] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-02T21:20:00.910390] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-02T21:20:00.929270] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-02T21:20:01.073000] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-02. [2025-10-02T21:20:01.638537] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-02T21:20:01.873003] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-03. [2025-10-02T21:20:02.672994] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-08. [2025-10-02T21:20:03.472988] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-03. [2025-10-02T21:20:03.745161] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-02T21:20:03.872033] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-02T21:20:04.272991] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-04. [2025-10-02T21:20:04.830770] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-02T21:20:04.957581] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-10-02T21:20:05.072999] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-05. [2025-10-02T21:20:05.653343] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-02T21:20:05.873013] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-09. [2025-10-02T21:20:06.673015] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-04. [2025-10-02T21:20:07.473043] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-06. [2025-10-02T21:20:07.925895] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-02T21:20:08.269550] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-10-02T21:20:08.280212] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-08. [2025-10-02T21:20:08.509040] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-02T21:20:09.073007] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-10. [2025-10-02T21:20:09.873012] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-07. [2025-10-02T21:20:10.104895] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-02T21:20:10.284681] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-02T21:20:10.673019] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-09. [2025-10-02T21:20:10.865554] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-02T21:20:10.867870] [INFO ] [REMOTE ] RTX: Full fetch complete (77730 records). [2025-10-02T21:20:10.868018] [DEBUG] [VALIDATOR ] RTX: Validating primary data. [2025-10-02T21:20:11.300697] [DEBUG] [VALIDATOR ] RTX: All expected trading days are present. [2025-10-02T21:20:11.300804] [DEBUG] [VALIDATOR ] RTX: Primary data validation passed. [2025-10-02T21:20:11.302012] [INFO ] [MAIN ] RTX: Fetched primary data is valid. [2025-10-02T21:20:11.302101] [DEBUG] [LOCAL ] RTX: Saving primary data. [2025-10-02T21:20:11.303766] [DEBUG] [LOCAL ] RTX: Trimmed 77730 records to 54094 (keeping 200 days of data) [2025-10-02T21:20:11.510991] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-08. [2025-10-02T21:20:11.681977] [DEBUG] [LOCAL ] RTX: Primary data saved (54094 records). [2025-10-02T21:20:11.682141] [INFO ] [MAIN ] RTX: Full history saved. [2025-10-02T21:20:11.684894] [INFO ] [MAIN ] Update Progress: 1843/2370 symbols completed. RTX took 43.9s. Estimated remaining: 1h 14m 23s. Rate: 7.1 symbols/min [2025-10-02T21:20:11.870323] [INFO ] [MAIN ] RWTO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:20:11.870519] [DEBUG] [LOCAL ] RWTO: No existing data file found in primary storage. [2025-10-02T21:20:11.870558] [WARN ] [MAIN ] RWTO: No existing data found, performing full refresh instead. [2025-10-02T21:20:11.870712] [INFO ] [MAIN ] RWTO: Wiping existing primary data before full refresh. [2025-10-02T21:20:11.870765] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-10-02T21:20:11.870809] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-10-02T21:20:11.870843] [INFO ] [MAIN ] RWTO: Starting full primary refresh. [2025-10-02T21:20:12.186803] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-02T21:20:12.275344] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-05. [2025-10-02T21:20:12.275225] [INFO ] [REMOTE ] RWTO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:20:12.307596] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-02T21:20:13.073018] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-09. [2025-10-02T21:20:13.626958] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-02T21:20:13.872973] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2024-12. [2025-10-02T21:20:13.972844] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-02T21:20:14.393464] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-10-02T21:20:14.673003] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-10. [2025-10-02T21:20:15.472992] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-01. [2025-10-02T21:20:15.949436] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-02T21:20:15.951387] [INFO ] [REMOTE ] RVLV: Full fetch complete (68686 records). [2025-10-02T21:20:15.951538] [DEBUG] [VALIDATOR ] RVLV: Validating primary data. [2025-10-02T21:20:16.278755] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-10. [2025-10-02T21:20:16.381941] [DEBUG] [VALIDATOR ] RVLV: All expected trading days are present. [2025-10-02T21:20:16.382031] [DEBUG] [VALIDATOR ] RVLV: Primary data validation passed. [2025-10-02T21:20:16.383119] [INFO ] [MAIN ] RVLV: Fetched primary data is valid. [2025-10-02T21:20:16.383189] [DEBUG] [LOCAL ] RVLV: Saving primary data. [2025-10-02T21:20:16.385159] [DEBUG] [LOCAL ] RVLV: Trimmed 68686 records to 47921 (keeping 200 days of data) [2025-10-02T21:20:16.678884] [DEBUG] [LOCAL ] RVLV: Primary data saved (47921 records). [2025-10-02T21:20:16.679018] [INFO ] [MAIN ] RVLV: Full history saved. [2025-10-02T21:20:16.679091] [INFO ] [MAIN ] Update Progress: 1844/2370 symbols completed. RVLV took 48.9s. Estimated remaining: 1h 14m 14s. Rate: 7.1 symbols/min [2025-10-02T21:20:16.870942] [INFO ] [MAIN ] RWTP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:20:16.871181] [DEBUG] [LOCAL ] RWTP: No existing data file found in primary storage. [2025-10-02T21:20:16.871242] [WARN ] [MAIN ] RWTP: No existing data found, performing full refresh instead. [2025-10-02T21:20:16.871359] [INFO ] [MAIN ] RWTP: Wiping existing primary data before full refresh. [2025-10-02T21:20:16.871401] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-10-02T21:20:16.871444] [DEBUG] [LOCAL ] RWTP: No primary data file found to delete. [2025-10-02T21:20:16.871483] [INFO ] [MAIN ] RWTP: Starting full primary refresh. [2025-10-02T21:20:17.099598] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-06. [2025-10-02T21:20:17.267241] [INFO ] [REMOTE ] RWTP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:20:17.282317] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-02T21:20:17.283120] [INFO ] [REMOTE ] RWTN: Full fetch complete (3139 records). [2025-10-02T21:20:17.283197] [DEBUG] [VALIDATOR ] RWTN: Validating primary data. [2025-10-02T21:20:17.482046] [WARN ] [VALIDATOR ] RWTN: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-02T21:20:17.482369] [FATAL] [MAIN ] RWTN: Fetched primary data is invalid. Refusing to save it. [2025-10-02T21:20:17.489229] [WARN ] [MAIN ] RWTN: Deleting existing primary and derivative data due to validation failure. [2025-10-02T21:20:17.490026] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-10-02T21:20:17.490545] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-10-02T21:20:17.490355] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-02T21:20:17.490683] [INFO ] [LOCAL ] RWTN: Starting deletion of derivative data. [2025-10-02T21:20:17.493761] [DEBUG] [LOCAL ] RWTN: No derivative data file found to delete. [2025-10-02T21:20:17.493861] [INFO ] [MAIN ] Update Progress: 1845/2370 symbols completed. RWTN took 21.0s. Estimated remaining: 1h 14m 3s. Rate: 7.1 symbols/min [2025-10-02T21:20:17.677988] [INFO ] [MAIN ] RXO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:20:17.723509] [DEBUG] [LOCAL ] RXO: Loaded 47845 existing records from primary storage. [2025-10-02T21:20:17.723881] [INFO ] [MAIN ] RXO: Loaded 47845 existing records. [2025-10-02T21:20:17.883245] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-02. [2025-10-02T21:20:17.917157] [WARN ] [MAIN ] RXO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:20:17.918492] [INFO ] [MAIN ] RXO: Wiping existing primary data before full refresh. [2025-10-02T21:20:17.918557] [INFO ] [LOCAL ] RXO: Starting deletion of primary data. [2025-10-02T21:20:17.918875] [DEBUG] [LOCAL ] RXO: Deleted primary data file. [2025-10-02T21:20:17.918937] [INFO ] [MAIN ] RXO: Starting full primary refresh. [2025-10-02T21:20:18.314327] [INFO ] [REMOTE ] RXO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:20:18.524557] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-02T21:20:18.672995] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-03. [2025-10-02T21:20:18.818227] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-02T21:20:19.180730] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-02T21:20:19.473014] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-04. [2025-10-02T21:20:20.047827] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-02T21:20:20.273054] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2024-12. [2025-10-02T21:20:20.601168] [DEBUG] [REMOTE ] RWTP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T21:20:20.601523] [WARN ] [REMOTE ] RWTP: No data returned for month 2024-12 [2025-10-02T21:20:20.601618] [FATAL] [REMOTE ] RWTP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T21:20:20.601723] [FATAL] [MAIN ] RWTP: Failed to fetch primary data. [2025-10-02T21:20:20.601800] [WARN ] [MAIN ] RWTP: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T21:20:20.601874] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-10-02T21:20:20.601940] [DEBUG] [LOCAL ] RWTP: No primary data file found to delete. [2025-10-02T21:20:20.601979] [INFO ] [LOCAL ] RWTP: Starting deletion of derivative data. [2025-10-02T21:20:20.602079] [DEBUG] [LOCAL ] RWTP: No derivative data file found to delete. [2025-10-02T21:20:20.602145] [INFO ] [MAIN ] Update Progress: 1846/2370 symbols completed. RWTP took 3.9s. Estimated remaining: 1h 13m 53s. Rate: 7.1 symbols/min [2025-10-02T21:20:20.794125] [INFO ] [MAIN ] RY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:20:20.841796] [DEBUG] [LOCAL ] RY: Loaded 47873 existing records from primary storage. [2025-10-02T21:20:20.842165] [INFO ] [MAIN ] RY: Loaded 47873 existing records. [2025-10-02T21:20:21.059127] [WARN ] [MAIN ] RY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:20:21.059381] [INFO ] [MAIN ] RY: Wiping existing primary data before full refresh. [2025-10-02T21:20:21.059436] [INFO ] [LOCAL ] RY: Starting deletion of primary data. [2025-10-02T21:20:21.059782] [DEBUG] [LOCAL ] RY: Deleted primary data file. [2025-10-02T21:20:21.059844] [INFO ] [MAIN ] RY: Starting full primary refresh. [2025-10-02T21:20:21.082797] [INFO ] [REMOTE ] RXO: Fetching primary data for 2024-12. [2025-10-02T21:20:21.474860] [INFO ] [REMOTE ] RY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:20:21.873038] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-05. [2025-10-02T21:20:22.516729] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-02T21:20:22.673017] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-07. [2025-10-02T21:20:22.849539] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-02T21:20:23.473071] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-01. [2025-10-02T21:20:24.273052] [INFO ] [REMOTE ] RY: Fetching primary data for 2024-12. [2025-10-02T21:20:24.389725] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-02T21:20:24.764602] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-02T21:20:25.073005] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-08. [2025-10-02T21:20:25.699516] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-02T21:20:25.873003] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-02. [2025-10-02T21:20:26.673021] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-06. [2025-10-02T21:20:26.746508] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-02T21:20:27.124246] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-02T21:20:27.472470] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-02T21:20:27.473571] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-09. [2025-10-02T21:20:28.273051] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-03. [2025-10-02T21:20:29.072996] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-07. [2025-10-02T21:20:29.235935] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-02T21:20:29.732517] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-02T21:20:29.872974] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-10. [2025-10-02T21:20:29.993818] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-02T21:20:30.673018] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-08. [2025-10-02T21:20:30.984474] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-02T21:20:30.986594] [INFO ] [REMOTE ] RWT: Full fetch complete (58793 records). [2025-10-02T21:20:30.986753] [DEBUG] [VALIDATOR ] RWT: Validating primary data. [2025-10-02T21:20:31.189947] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-02T21:20:31.438941] [DEBUG] [VALIDATOR ] RWT: All expected trading days are present. [2025-10-02T21:20:31.439139] [DEBUG] [VALIDATOR ] RWT: Primary data validation passed. [2025-10-02T21:20:31.440148] [INFO ] [MAIN ] RWT: Fetched primary data is valid. [2025-10-02T21:20:31.440210] [DEBUG] [LOCAL ] RWT: Saving primary data. [2025-10-02T21:20:31.441580] [DEBUG] [LOCAL ] RWT: Trimmed 58793 records to 41129 (keeping 200 days of data) [2025-10-02T21:20:31.494384] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-04. [2025-10-02T21:20:31.707750] [DEBUG] [LOCAL ] RWT: Primary data saved (41129 records). [2025-10-02T21:20:31.707894] [INFO ] [MAIN ] RWT: Full history saved. [2025-10-02T21:20:31.708019] [INFO ] [MAIN ] Update Progress: 1847/2370 symbols completed. RWT took 41.8s. Estimated remaining: 1h 13m 45s. Rate: 7.1 symbols/min [2025-10-02T21:20:31.902032] [INFO ] [MAIN ] RYAM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:20:31.937237] [DEBUG] [LOCAL ] RYAM: Loaded 35046 existing records from primary storage. [2025-10-02T21:20:31.937595] [INFO ] [MAIN ] RYAM: Loaded 35046 existing records. [2025-10-02T21:20:32.164374] [WARN ] [MAIN ] RYAM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:20:32.164808] [INFO ] [MAIN ] RYAM: Wiping existing primary data before full refresh. [2025-10-02T21:20:32.164870] [INFO ] [LOCAL ] RYAM: Starting deletion of primary data. [2025-10-02T21:20:32.165448] [DEBUG] [LOCAL ] RYAM: Deleted primary data file. [2025-10-02T21:20:32.165509] [INFO ] [MAIN ] RYAM: Starting full primary refresh. [2025-10-02T21:20:32.282878] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-01. [2025-10-02T21:20:32.636611] [INFO ] [REMOTE ] RYAM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:20:33.072990] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2024-12. [2025-10-02T21:20:33.379985] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-02T21:20:33.703494] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-02T21:20:33.873060] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-05. [2025-10-02T21:20:34.221593] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-02T21:20:34.673055] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-02. [2025-10-02T21:20:35.320765] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-02T21:20:35.473029] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-06. [2025-10-02T21:20:36.272992] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-01. [2025-10-02T21:20:36.433665] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-02T21:20:37.073048] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-09. [2025-10-02T21:20:37.158457] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-02T21:20:37.386454] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-02T21:20:37.567979] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-02T21:20:37.872998] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-10. [2025-10-02T21:20:38.342970] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-02T21:20:38.343893] [INFO ] [REMOTE ] RWTO: Full fetch complete (4823 records). [2025-10-02T21:20:38.343981] [DEBUG] [VALIDATOR ] RWTO: Validating primary data. [2025-10-02T21:20:38.563984] [WARN ] [VALIDATOR ] RWTO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-02T21:20:38.564214] [FATAL] [MAIN ] RWTO: Fetched primary data is invalid. Refusing to save it. [2025-10-02T21:20:38.564344] [WARN ] [MAIN ] RWTO: Deleting existing primary and derivative data due to validation failure. [2025-10-02T21:20:38.564422] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-10-02T21:20:38.564491] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-10-02T21:20:38.564545] [INFO ] [LOCAL ] RWTO: Starting deletion of derivative data. [2025-10-02T21:20:38.564672] [DEBUG] [LOCAL ] RWTO: No derivative data file found to delete. [2025-10-02T21:20:38.564763] [INFO ] [MAIN ] Update Progress: 1848/2370 symbols completed. RWTO took 26.9s. Estimated remaining: 1h 13m 36s. Rate: 7.1 symbols/min [2025-10-02T21:20:38.679289] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-07. [2025-10-02T21:20:38.769802] [INFO ] [MAIN ] RYAN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:20:38.819784] [DEBUG] [LOCAL ] RYAN: Loaded 44469 existing records from primary storage. [2025-10-02T21:20:38.820208] [INFO ] [MAIN ] RYAN: Loaded 44469 existing records. [2025-10-02T21:20:39.020273] [WARN ] [MAIN ] RYAN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:20:39.020549] [INFO ] [MAIN ] RYAN: Wiping existing primary data before full refresh. [2025-10-02T21:20:39.020602] [INFO ] [LOCAL ] RYAN: Starting deletion of primary data. [2025-10-02T21:20:39.020962] [DEBUG] [LOCAL ] RYAN: Deleted primary data file. [2025-10-02T21:20:39.021024] [INFO ] [MAIN ] RYAN: Starting full primary refresh. [2025-10-02T21:20:39.445016] [INFO ] [REMOTE ] RYAN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:20:39.473097] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-02. [2025-10-02T21:20:40.273036] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2024-12. [2025-10-02T21:20:40.598686] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-02T21:20:40.656959] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-02T21:20:41.073055] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-08. [2025-10-02T21:20:41.872991] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-03. [2025-10-02T21:20:41.910834] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-02T21:20:42.672986] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-03. [2025-10-02T21:20:42.805135] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-02T21:20:43.473057] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-09. [2025-10-02T21:20:43.636333] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-02T21:20:44.076917] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-02T21:20:44.273065] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-04. [2025-10-02T21:20:45.072997] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-01. [2025-10-02T21:20:45.711822] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-02T21:20:45.873001] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-05. [2025-10-02T21:20:46.607762] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-02T21:20:46.673019] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-02. [2025-10-02T21:20:47.120721] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-09 (3.65 seconds). [2025-10-02T21:20:47.340585] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-02T21:20:47.473011] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-06. [2025-10-02T21:20:48.273012] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-04. [2025-10-02T21:20:48.736137] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-02T21:20:49.073043] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-07. [2025-10-02T21:20:49.861040] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-02T21:20:49.876753] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-10. [2025-10-02T21:20:50.391833] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-02T21:20:50.673004] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-05. [2025-10-02T21:20:51.148263] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-02T21:20:51.152829] [INFO ] [REMOTE ] RXO: Full fetch complete (68395 records). [2025-10-02T21:20:51.152995] [DEBUG] [VALIDATOR ] RXO: Validating primary data. [2025-10-02T21:20:51.482069] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-08. [2025-10-02T21:20:51.648217] [DEBUG] [VALIDATOR ] RXO: All expected trading days are present. [2025-10-02T21:20:51.648376] [DEBUG] [VALIDATOR ] RXO: Primary data validation passed. [2025-10-02T21:20:51.649934] [INFO ] [MAIN ] RXO: Fetched primary data is valid. [2025-10-02T21:20:51.650039] [DEBUG] [LOCAL ] RXO: Saving primary data. [2025-10-02T21:20:51.655105] [DEBUG] [LOCAL ] RXO: Trimmed 68395 records to 48199 (keeping 200 days of data) [2025-10-02T21:20:52.004432] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-02 (5.33 seconds). [2025-10-02T21:20:52.033688] [DEBUG] [LOCAL ] RXO: Primary data saved (48199 records). [2025-10-02T21:20:52.033867] [INFO ] [MAIN ] RXO: Full history saved. [2025-10-02T21:20:52.033992] [INFO ] [MAIN ] Update Progress: 1849/2370 symbols completed. RXO took 34.5s. Estimated remaining: 1h 13m 29s. Rate: 7.1 symbols/min [2025-10-02T21:20:52.231846] [INFO ] [MAIN ] RYI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:20:52.255620] [DEBUG] [LOCAL ] RYI: Loaded 21545 existing records from primary storage. [2025-10-02T21:20:52.255938] [INFO ] [MAIN ] RYI: Loaded 21545 existing records. [2025-10-02T21:20:52.280444] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-03. [2025-10-02T21:20:52.458525] [WARN ] [MAIN ] RYI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:20:52.458893] [INFO ] [MAIN ] RYI: Wiping existing primary data before full refresh. [2025-10-02T21:20:52.459040] [INFO ] [LOCAL ] RYI: Starting deletion of primary data. [2025-10-02T21:20:52.459338] [DEBUG] [LOCAL ] RYI: Deleted primary data file. [2025-10-02T21:20:52.459528] [INFO ] [MAIN ] RYI: Starting full primary refresh. [2025-10-02T21:20:52.609882] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-02T21:20:52.901964] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-02T21:20:52.977155] [INFO ] [REMOTE ] RYI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:20:53.072999] [INFO ] [REMOTE ] RYI: Fetching primary data for 2024-12. [2025-10-02T21:20:53.867767] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-02T21:20:53.876628] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-09. [2025-10-02T21:20:54.229816] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-02T21:20:54.673058] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-04. [2025-10-02T21:20:55.324685] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-02T21:20:55.473016] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-10. [2025-10-02T21:20:56.133195] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-02T21:20:56.273001] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-01. [2025-10-02T21:20:56.494798] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-02T21:20:56.496395] [INFO ] [REMOTE ] RYAM: Full fetch complete (48989 records). [2025-10-02T21:20:56.496513] [DEBUG] [VALIDATOR ] RYAM: Validating primary data. [2025-10-02T21:20:56.931228] [DEBUG] [VALIDATOR ] RYAM: All expected trading days are present. [2025-10-02T21:20:56.931317] [DEBUG] [VALIDATOR ] RYAM: Primary data validation passed. [2025-10-02T21:20:56.932352] [INFO ] [MAIN ] RYAM: Fetched primary data is valid. [2025-10-02T21:20:56.932425] [DEBUG] [LOCAL ] RYAM: Saving primary data. [2025-10-02T21:20:56.933620] [DEBUG] [LOCAL ] RYAM: Trimmed 48989 records to 35276 (keeping 200 days of data) [2025-10-02T21:20:57.102160] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-06. [2025-10-02T21:20:57.161882] [DEBUG] [LOCAL ] RYAM: Primary data saved (35276 records). [2025-10-02T21:20:57.162037] [INFO ] [MAIN ] RYAM: Full history saved. [2025-10-02T21:20:57.162139] [INFO ] [MAIN ] Update Progress: 1850/2370 symbols completed. RYAM took 25.5s. Estimated remaining: 1h 13m 20s. Rate: 7.1 symbols/min [2025-10-02T21:20:57.354787] [INFO ] [MAIN ] RYN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:20:57.406020] [DEBUG] [LOCAL ] RYN: Loaded 45585 existing records from primary storage. [2025-10-02T21:20:57.406336] [INFO ] [MAIN ] RYN: Loaded 45585 existing records. [2025-10-02T21:20:57.599486] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-02T21:20:57.643881] [WARN ] [MAIN ] RYN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:20:57.644094] [INFO ] [MAIN ] RYN: Wiping existing primary data before full refresh. [2025-10-02T21:20:57.644164] [INFO ] [LOCAL ] RYN: Starting deletion of primary data. [2025-10-02T21:20:57.644627] [DEBUG] [LOCAL ] RYN: Deleted primary data file. [2025-10-02T21:20:57.644726] [INFO ] [MAIN ] RYN: Starting full primary refresh. [2025-10-02T21:20:57.878223] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-05. [2025-10-02T21:20:58.040016] [INFO ] [REMOTE ] RYN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:20:58.672985] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-02. [2025-10-02T21:20:58.744260] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-02T21:20:59.476512] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-07. [2025-10-02T21:20:59.482745] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-02T21:20:59.535369] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-02T21:21:00.273002] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-03. [2025-10-02T21:21:01.052222] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-02T21:21:01.072994] [INFO ] [REMOTE ] RYN: Fetching primary data for 2024-12. [2025-10-02T21:21:01.381589] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-02T21:21:01.872998] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-06. [2025-10-02T21:21:02.594829] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-02T21:21:02.672992] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-08. [2025-10-02T21:21:03.277772] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-02T21:21:03.473036] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-07. [2025-10-02T21:21:04.273005] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-04. [2025-10-02T21:21:04.357384] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-02T21:21:05.073104] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-09. [2025-10-02T21:21:05.144140] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-02T21:21:05.261118] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-02T21:21:05.873040] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-08. [2025-10-02T21:21:06.678137] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-01. [2025-10-02T21:21:06.693342] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-02T21:21:07.478259] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-10. [2025-10-02T21:21:07.484281] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-02T21:21:08.206109] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-02T21:21:08.272995] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-02. [2025-10-02T21:21:08.574330] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-02T21:21:08.576427] [INFO ] [REMOTE ] RY: Full fetch complete (68770 records). [2025-10-02T21:21:08.576537] [DEBUG] [VALIDATOR ] RY: Validating primary data. [2025-10-02T21:21:09.021312] [DEBUG] [VALIDATOR ] RY: All expected trading days are present. [2025-10-02T21:21:09.021395] [DEBUG] [VALIDATOR ] RY: Primary data validation passed. [2025-10-02T21:21:09.022430] [INFO ] [MAIN ] RY: Fetched primary data is valid. [2025-10-02T21:21:09.022497] [DEBUG] [LOCAL ] RY: Saving primary data. [2025-10-02T21:21:09.023910] [DEBUG] [LOCAL ] RY: Trimmed 68770 records to 48218 (keeping 200 days of data) [2025-10-02T21:21:09.089029] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-05. [2025-10-02T21:21:09.360947] [DEBUG] [LOCAL ] RY: Primary data saved (48218 records). [2025-10-02T21:21:09.361115] [INFO ] [MAIN ] RY: Full history saved. [2025-10-02T21:21:09.361250] [INFO ] [MAIN ] Update Progress: 1851/2370 symbols completed. RY took 48.8s. Estimated remaining: 1h 13m 12s. Rate: 7.1 symbols/min [2025-10-02T21:21:09.559578] [INFO ] [MAIN ] RZB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:21:09.568804] [DEBUG] [LOCAL ] RZB: Loaded 6201 existing records from primary storage. [2025-10-02T21:21:09.569037] [INFO ] [MAIN ] RZB: Loaded 6201 existing records. [2025-10-02T21:21:09.779589] [WARN ] [MAIN ] RZB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:21:09.780128] [INFO ] [MAIN ] RZB: Wiping existing primary data before full refresh. [2025-10-02T21:21:09.780249] [INFO ] [LOCAL ] RZB: Starting deletion of primary data. [2025-10-02T21:21:09.789202] [DEBUG] [LOCAL ] RZB: Deleted primary data file. [2025-10-02T21:21:09.806727] [INFO ] [MAIN ] RZB: Starting full primary refresh. [2025-10-02T21:21:09.817465] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-02T21:21:09.884268] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-09. [2025-10-02T21:21:10.217726] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-02T21:21:10.250327] [INFO ] [REMOTE ] RZB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:21:10.673217] [INFO ] [REMOTE ] RZB: Fetching primary data for 2024-12. [2025-10-02T21:21:11.392321] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-02T21:21:11.472976] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-03. [2025-10-02T21:21:11.661588] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-02T21:21:12.273010] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-01. [2025-10-02T21:21:13.083830] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-06. [2025-10-02T21:21:13.089900] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-02T21:21:13.872984] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-10. [2025-10-02T21:21:14.065360] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-02T21:21:14.673046] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-02. [2025-10-02T21:21:15.083443] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-02T21:21:15.085471] [INFO ] [REMOTE ] RYAN: Full fetch complete (63974 records). [2025-10-02T21:21:15.085577] [DEBUG] [VALIDATOR ] RYAN: Validating primary data. [2025-10-02T21:21:15.207712] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-02T21:21:15.483198] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-03. [2025-10-02T21:21:15.547214] [DEBUG] [VALIDATOR ] RYAN: All expected trading days are present. [2025-10-02T21:21:15.552487] [DEBUG] [VALIDATOR ] RYAN: Primary data validation passed. [2025-10-02T21:21:15.564085] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-10-02T21:21:15.563357] [INFO ] [MAIN ] RYAN: Fetched primary data is valid. [2025-10-02T21:21:15.564270] [DEBUG] [LOCAL ] RYAN: Saving primary data. [2025-10-02T21:21:15.570820] [DEBUG] [LOCAL ] RYAN: Trimmed 63974 records to 44815 (keeping 200 days of data) [2025-10-02T21:21:15.891843] [DEBUG] [LOCAL ] RYAN: Primary data saved (44815 records). [2025-10-02T21:21:15.891983] [INFO ] [MAIN ] RYAN: Full history saved. [2025-10-02T21:21:15.893376] [INFO ] [MAIN ] Update Progress: 1852/2370 symbols completed. RYAN took 37.3s. Estimated remaining: 1h 13m 3s. Rate: 7.1 symbols/min [2025-10-02T21:21:16.097879] [INFO ] [MAIN ] RZC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:21:16.108985] [DEBUG] [LOCAL ] RZC: Loaded 6792 existing records from primary storage. [2025-10-02T21:21:16.109221] [INFO ] [MAIN ] RZC: Loaded 6792 existing records. [2025-10-02T21:21:16.273697] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-07. [2025-10-02T21:21:16.315449] [WARN ] [MAIN ] RZC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:21:16.316023] [INFO ] [MAIN ] RZC: Wiping existing primary data before full refresh. [2025-10-02T21:21:16.316101] [INFO ] [LOCAL ] RZC: Starting deletion of primary data. [2025-10-02T21:21:16.316325] [DEBUG] [LOCAL ] RZC: Deleted primary data file. [2025-10-02T21:21:16.316389] [INFO ] [MAIN ] RZC: Starting full primary refresh. [2025-10-02T21:21:16.732175] [INFO ] [REMOTE ] RZC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:21:17.073026] [INFO ] [REMOTE ] RZC: Fetching primary data for 2024-12. [2025-10-02T21:21:17.414639] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-02T21:21:17.791516] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-02T21:21:17.857740] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-02T21:21:17.872974] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-04. [2025-10-02T21:21:18.310979] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-02T21:21:18.673027] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-08. [2025-10-02T21:21:19.473019] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-01. [2025-10-02T21:21:19.760415] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-02T21:21:20.229296] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-02T21:21:20.273033] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-02. [2025-10-02T21:21:21.072978] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-04. [2025-10-02T21:21:21.095327] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-02T21:21:21.873015] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-05. [2025-10-02T21:21:22.455540] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-02T21:21:22.672997] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-06. [2025-10-02T21:21:22.764247] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-02T21:21:23.473003] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-05. [2025-10-02T21:21:23.617614] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-02T21:21:24.273044] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-07. [2025-10-02T21:21:24.892992] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-02T21:21:25.073070] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-08. [2025-10-02T21:21:25.254419] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-02T21:21:25.757429] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-02T21:21:25.873087] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-09. [2025-10-02T21:21:26.458307] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-02T21:21:26.673028] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-10. [2025-10-02T21:21:26.959439] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-10-02T21:21:26.960354] [INFO ] [REMOTE ] RZB: Full fetch complete (8650 records). [2025-10-02T21:21:26.960440] [DEBUG] [VALIDATOR ] RZB: Validating primary data. [2025-10-02T21:21:27.353065] [DEBUG] [VALIDATOR ] RZB: All expected trading days are present. [2025-10-02T21:21:27.353148] [DEBUG] [VALIDATOR ] RZB: Primary data validation passed. [2025-10-02T21:21:27.353378] [INFO ] [MAIN ] RZB: Fetched primary data is valid. [2025-10-02T21:21:27.353611] [DEBUG] [LOCAL ] RZB: Saving primary data. [2025-10-02T21:21:27.354058] [DEBUG] [LOCAL ] RZB: Trimmed 8650 records to 6232 (keeping 200 days of data) [2025-10-02T21:21:27.396631] [DEBUG] [LOCAL ] RZB: Primary data saved (6232 records). [2025-10-02T21:21:27.396799] [INFO ] [MAIN ] RZB: Full history saved. [2025-10-02T21:21:27.396908] [INFO ] [MAIN ] Update Progress: 1853/2370 symbols completed. RZB took 18.0s. Estimated remaining: 1h 12m 56s. Rate: 7.1 symbols/min [2025-10-02T21:21:27.478172] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-09. [2025-10-02T21:21:27.583060] [INFO ] [MAIN ] S: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:21:27.646368] [DEBUG] [LOCAL ] S: Loaded 53535 existing records from primary storage. [2025-10-02T21:21:27.646756] [INFO ] [MAIN ] S: Loaded 53535 existing records. [2025-10-02T21:21:27.853130] [WARN ] [MAIN ] S: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:21:27.853436] [INFO ] [MAIN ] S: Wiping existing primary data before full refresh. [2025-10-02T21:21:27.853491] [INFO ] [LOCAL ] S: Starting deletion of primary data. [2025-10-02T21:21:27.853776] [DEBUG] [LOCAL ] S: Deleted primary data file. [2025-10-02T21:21:27.853838] [INFO ] [MAIN ] S: Starting full primary refresh. [2025-10-02T21:21:28.262251] [INFO ] [REMOTE ] S: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:21:28.273066] [INFO ] [REMOTE ] S: Fetching primary data for 2024-12. [2025-10-02T21:21:28.699837] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-02T21:21:29.073015] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-06. [2025-10-02T21:21:29.873000] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-03. [2025-10-02T21:21:30.602529] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-02T21:21:30.633179] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-02T21:21:30.673261] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-07. [2025-10-02T21:21:30.675160] [INFO ] [REMOTE ] S: Incremental fetch complete for 2024-12 (2.40 seconds). [2025-10-02T21:21:31.473003] [INFO ] [REMOTE ] S: Fetching primary data for 2025-01. [2025-10-02T21:21:32.273002] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-04. [2025-10-02T21:21:32.367324] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-02T21:21:33.007979] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-02T21:21:33.072990] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-05. [2025-10-02T21:21:33.211710] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-02T21:21:33.681104] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-02T21:21:33.873007] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-08. [2025-10-02T21:21:34.673039] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-10. [2025-10-02T21:21:35.473042] [INFO ] [REMOTE ] S: Fetching primary data for 2025-02. [2025-10-02T21:21:35.534405] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-02T21:21:35.607735] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-02T21:21:35.609085] [INFO ] [REMOTE ] RYI: Full fetch complete (32368 records). [2025-10-02T21:21:35.609176] [DEBUG] [VALIDATOR ] RYI: Validating primary data. [2025-10-02T21:21:36.111869] [DEBUG] [VALIDATOR ] RYI: All expected trading days are present. [2025-10-02T21:21:36.111953] [DEBUG] [VALIDATOR ] RYI: Primary data validation passed. [2025-10-02T21:21:36.112730] [INFO ] [MAIN ] RYI: Fetched primary data is valid. [2025-10-02T21:21:36.112813] [DEBUG] [LOCAL ] RYI: Saving primary data. [2025-10-02T21:21:36.113628] [DEBUG] [LOCAL ] RYI: Trimmed 32368 records to 21688 (keeping 200 days of data) [2025-10-02T21:21:36.254006] [DEBUG] [LOCAL ] RYI: Primary data saved (21688 records). [2025-10-02T21:21:36.254170] [INFO ] [MAIN ] RYI: Full history saved. [2025-10-02T21:21:36.254257] [INFO ] [MAIN ] Update Progress: 1854/2370 symbols completed. RYI took 44.2s. Estimated remaining: 1h 12m 47s. Rate: 7.1 symbols/min [2025-10-02T21:21:36.278113] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-06. [2025-10-02T21:21:36.439073] [INFO ] [MAIN ] SA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:21:36.483234] [DEBUG] [LOCAL ] SA: Loaded 43403 existing records from primary storage. [2025-10-02T21:21:36.483607] [INFO ] [MAIN ] SA: Loaded 43403 existing records. [2025-10-02T21:21:36.677163] [WARN ] [MAIN ] SA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:21:36.677404] [INFO ] [MAIN ] SA: Wiping existing primary data before full refresh. [2025-10-02T21:21:36.677454] [INFO ] [LOCAL ] SA: Starting deletion of primary data. [2025-10-02T21:21:36.677784] [DEBUG] [LOCAL ] SA: Deleted primary data file. [2025-10-02T21:21:36.677845] [INFO ] [MAIN ] SA: Starting full primary refresh. [2025-10-02T21:21:37.066546] [INFO ] [REMOTE ] SA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:21:37.072854] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-02T21:21:37.073012] [INFO ] [REMOTE ] SA: Fetching primary data for 2024-12. [2025-10-02T21:21:37.406505] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-02T21:21:37.872998] [INFO ] [REMOTE ] S: Fetching primary data for 2025-03. [2025-10-02T21:21:38.631781] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-02T21:21:38.673020] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-09. [2025-10-02T21:21:39.473067] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-07. [2025-10-02T21:21:39.908761] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-02T21:21:39.994546] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-02T21:21:40.157213] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-02T21:21:40.273022] [INFO ] [REMOTE ] S: Fetching primary data for 2025-04. [2025-10-02T21:21:41.073008] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-01. [2025-10-02T21:21:41.873083] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-08. [2025-10-02T21:21:42.231246] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-02T21:21:42.505870] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-02T21:21:42.537591] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-02T21:21:42.672999] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-09. [2025-10-02T21:21:43.407578] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-02T21:21:43.473044] [INFO ] [REMOTE ] S: Fetching primary data for 2025-05. [2025-10-02T21:21:44.273035] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-02. [2025-10-02T21:21:45.073040] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-10. [2025-10-02T21:21:45.514954] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-02T21:21:45.515874] [INFO ] [REMOTE ] RZC: Full fetch complete (9807 records). [2025-10-02T21:21:45.515947] [DEBUG] [VALIDATOR ] RZC: Validating primary data. [2025-10-02T21:21:45.705585] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-02T21:21:45.873597] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-10. [2025-10-02T21:21:45.971456] [DEBUG] [VALIDATOR ] RZC: All expected trading days are present. [2025-10-02T21:21:45.993199] [DEBUG] [VALIDATOR ] RZC: Primary data validation passed. [2025-10-02T21:21:45.993564] [INFO ] [MAIN ] RZC: Fetched primary data is valid. [2025-10-02T21:21:45.993839] [DEBUG] [LOCAL ] RZC: Saving primary data. [2025-10-02T21:21:45.995367] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-02T21:21:46.003969] [DEBUG] [LOCAL ] RZC: Trimmed 9807 records to 6820 (keeping 200 days of data) [2025-10-02T21:21:46.050766] [DEBUG] [LOCAL ] RZC: Primary data saved (6820 records). [2025-10-02T21:21:46.050898] [INFO ] [MAIN ] RZC: Full history saved. [2025-10-02T21:21:46.050981] [INFO ] [MAIN ] Update Progress: 1855/2370 symbols completed. RZC took 30.2s. Estimated remaining: 1h 12m 39s. Rate: 7.1 symbols/min [2025-10-02T21:21:46.234520] [INFO ] [MAIN ] SABA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:21:46.246486] [DEBUG] [LOCAL ] SABA: Loaded 9259 existing records from primary storage. [2025-10-02T21:21:46.246774] [INFO ] [MAIN ] SABA: Loaded 9259 existing records. [2025-10-02T21:21:46.442328] [WARN ] [MAIN ] SABA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:21:46.442555] [INFO ] [MAIN ] SABA: Wiping existing primary data before full refresh. [2025-10-02T21:21:46.442633] [INFO ] [LOCAL ] SABA: Starting deletion of primary data. [2025-10-02T21:21:46.442975] [DEBUG] [LOCAL ] SABA: Deleted primary data file. [2025-10-02T21:21:46.443099] [INFO ] [MAIN ] SABA: Starting full primary refresh. [2025-10-02T21:21:46.678154] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-03. [2025-10-02T21:21:46.868381] [INFO ] [REMOTE ] SABA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:21:46.950984] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-02T21:21:46.952863] [INFO ] [REMOTE ] RYN: Full fetch complete (64969 records). [2025-10-02T21:21:46.953021] [DEBUG] [VALIDATOR ] RYN: Validating primary data. [2025-10-02T21:21:47.368376] [DEBUG] [VALIDATOR ] RYN: All expected trading days are present. [2025-10-02T21:21:47.368459] [DEBUG] [VALIDATOR ] RYN: Primary data validation passed. [2025-10-02T21:21:47.369499] [INFO ] [MAIN ] RYN: Fetched primary data is valid. [2025-10-02T21:21:47.369563] [DEBUG] [LOCAL ] RYN: Saving primary data. [2025-10-02T21:21:47.370912] [DEBUG] [LOCAL ] RYN: Trimmed 64969 records to 45908 (keeping 200 days of data) [2025-10-02T21:21:47.473449] [INFO ] [REMOTE ] SABA: Fetching primary data for 2024-12. [2025-10-02T21:21:47.686590] [DEBUG] [LOCAL ] RYN: Primary data saved (45908 records). [2025-10-02T21:21:47.686796] [INFO ] [MAIN ] RYN: Full history saved. [2025-10-02T21:21:47.686930] [INFO ] [MAIN ] Update Progress: 1856/2370 symbols completed. RYN took 50.5s. Estimated remaining: 1h 12m 29s. Rate: 7.1 symbols/min [2025-10-02T21:21:47.878914] [INFO ] [MAIN ] SAFE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:21:47.913904] [DEBUG] [LOCAL ] SAFE: Loaded 30222 existing records from primary storage. [2025-10-02T21:21:47.914183] [INFO ] [MAIN ] SAFE: Loaded 30222 existing records. [2025-10-02T21:21:48.117724] [WARN ] [MAIN ] SAFE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:21:48.117968] [INFO ] [MAIN ] SAFE: Wiping existing primary data before full refresh. [2025-10-02T21:21:48.118018] [INFO ] [LOCAL ] SAFE: Starting deletion of primary data. [2025-10-02T21:21:48.118263] [DEBUG] [LOCAL ] SAFE: Deleted primary data file. [2025-10-02T21:21:48.118320] [INFO ] [MAIN ] SAFE: Starting full primary refresh. [2025-10-02T21:21:48.275940] [INFO ] [REMOTE ] S: Fetching primary data for 2025-06. [2025-10-02T21:21:48.401008] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-02T21:21:48.539465] [INFO ] [REMOTE ] SAFE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:21:48.556995] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-02T21:21:49.072997] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2024-12. [2025-10-02T21:21:49.873009] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-01. [2025-10-02T21:21:50.114990] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-02T21:21:50.275481] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-02T21:21:50.493760] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-02T21:21:50.672989] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-01. [2025-10-02T21:21:51.473008] [INFO ] [REMOTE ] S: Fetching primary data for 2025-07. [2025-10-02T21:21:52.084855] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-02T21:21:52.273016] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-02. [2025-10-02T21:21:53.073031] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-02. [2025-10-02T21:21:53.538686] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-02T21:21:53.689122] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-02T21:21:53.762360] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-02T21:21:53.873015] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-03. [2025-10-02T21:21:54.673000] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-04. [2025-10-02T21:21:55.134127] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-02T21:21:55.472998] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-04. [2025-10-02T21:21:56.272972] [INFO ] [REMOTE ] S: Fetching primary data for 2025-08. [2025-10-02T21:21:56.304288] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-02T21:21:56.922626] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-02T21:21:57.073007] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-03. [2025-10-02T21:21:57.873005] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-05. [2025-10-02T21:21:57.904738] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-02T21:21:58.671968] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-10-02T21:21:58.683364] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-05. [2025-10-02T21:21:59.074778] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-02T21:21:59.472999] [INFO ] [REMOTE ] S: Fetching primary data for 2025-09. [2025-10-02T21:21:59.916850] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-02T21:22:00.273029] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-04. [2025-10-02T21:22:01.076092] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-06. [2025-10-02T21:22:01.077209] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-02T21:22:01.255616] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-02T21:22:01.873041] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-05. [2025-10-02T21:22:02.673053] [INFO ] [REMOTE ] S: Fetching primary data for 2025-10. [2025-10-02T21:22:02.699112] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-02T21:22:02.730971] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-02T21:22:03.473055] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-07. [2025-10-02T21:22:04.273049] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-06. [2025-10-02T21:22:04.404991] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-02T21:22:04.407701] [INFO ] [REMOTE ] S: Full fetch complete (77546 records). [2025-10-02T21:22:04.407861] [DEBUG] [VALIDATOR ] S: Validating primary data. [2025-10-02T21:22:04.888036] [DEBUG] [VALIDATOR ] S: All expected trading days are present. [2025-10-02T21:22:04.888194] [DEBUG] [VALIDATOR ] S: Primary data validation passed. [2025-10-02T21:22:04.889614] [INFO ] [MAIN ] S: Fetched primary data is valid. [2025-10-02T21:22:04.889839] [DEBUG] [LOCAL ] S: Saving primary data. [2025-10-02T21:22:04.891771] [DEBUG] [LOCAL ] S: Trimmed 77546 records to 53922 (keeping 200 days of data) [2025-10-02T21:22:05.075719] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-06. [2025-10-02T21:22:05.148956] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-02T21:22:05.284461] [DEBUG] [LOCAL ] S: Primary data saved (53922 records). [2025-10-02T21:22:05.284619] [INFO ] [MAIN ] S: Full history saved. [2025-10-02T21:22:05.284744] [INFO ] [MAIN ] Update Progress: 1857/2370 symbols completed. S took 37.9s. Estimated remaining: 1h 12m 23s. Rate: 7.1 symbols/min [2025-10-02T21:22:05.474520] [INFO ] [MAIN ] SAH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:22:05.496928] [DEBUG] [LOCAL ] SAH: Loaded 21928 existing records from primary storage. [2025-10-02T21:22:05.497209] [INFO ] [MAIN ] SAH: Loaded 21928 existing records. [2025-10-02T21:22:05.635456] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-02T21:22:05.728763] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-02T21:22:05.735062] [WARN ] [MAIN ] SAH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:22:05.738636] [INFO ] [MAIN ] SAH: Wiping existing primary data before full refresh. [2025-10-02T21:22:05.738794] [INFO ] [LOCAL ] SAH: Starting deletion of primary data. [2025-10-02T21:22:05.739001] [DEBUG] [LOCAL ] SAH: Deleted primary data file. [2025-10-02T21:22:05.739063] [INFO ] [MAIN ] SAH: Starting full primary refresh. [2025-10-02T21:22:05.878165] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-07. [2025-10-02T21:22:06.161491] [INFO ] [REMOTE ] SAH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:22:06.673009] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-07. [2025-10-02T21:22:06.796431] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-02T21:22:07.473066] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-08. [2025-10-02T21:22:08.047441] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-02T21:22:08.062279] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-02T21:22:08.273004] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-09. [2025-10-02T21:22:09.072410] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-02T21:22:09.075432] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-08. [2025-10-02T21:22:09.873042] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-10. [2025-10-02T21:22:10.326182] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-02T21:22:10.327218] [INFO ] [REMOTE ] SABA: Full fetch complete (15521 records). [2025-10-02T21:22:10.327333] [DEBUG] [VALIDATOR ] SABA: Validating primary data. [2025-10-02T21:22:10.682318] [INFO ] [REMOTE ] SAH: Fetching primary data for 2024-12. [2025-10-02T21:22:10.759012] [DEBUG] [VALIDATOR ] SABA: All expected trading days are present. [2025-10-02T21:22:10.759129] [DEBUG] [VALIDATOR ] SABA: Primary data validation passed. [2025-10-02T21:22:10.759581] [INFO ] [MAIN ] SABA: Fetched primary data is valid. [2025-10-02T21:22:10.759693] [DEBUG] [LOCAL ] SABA: Saving primary data. [2025-10-02T21:22:10.760609] [DEBUG] [LOCAL ] SABA: Trimmed 15521 records to 9335 (keeping 200 days of data) [2025-10-02T21:22:10.833892] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-02T21:22:10.861134] [DEBUG] [LOCAL ] SABA: Primary data saved (9335 records). [2025-10-02T21:22:10.861316] [INFO ] [MAIN ] SABA: Full history saved. [2025-10-02T21:22:10.861423] [INFO ] [MAIN ] Update Progress: 1858/2370 symbols completed. SABA took 24.8s. Estimated remaining: 1h 12m 14s. Rate: 7.1 symbols/min [2025-10-02T21:22:11.045408] [INFO ] [MAIN ] SAJ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:22:11.045603] [DEBUG] [LOCAL ] SAJ: No existing data file found in primary storage. [2025-10-02T21:22:11.045668] [WARN ] [MAIN ] SAJ: No existing data found, performing full refresh instead. [2025-10-02T21:22:11.045792] [INFO ] [MAIN ] SAJ: Wiping existing primary data before full refresh. [2025-10-02T21:22:11.045837] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-10-02T21:22:11.045882] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-10-02T21:22:11.045918] [INFO ] [MAIN ] SAJ: Starting full primary refresh. [2025-10-02T21:22:11.445376] [INFO ] [REMOTE ] SAJ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:22:11.472965] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-08. [2025-10-02T21:22:11.559518] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-02T21:22:12.273032] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-01. [2025-10-02T21:22:12.546318] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-02T21:22:13.073066] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-09. [2025-10-02T21:22:13.141069] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-02T21:22:13.872988] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-09. [2025-10-02T21:22:14.673016] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2024-12. [2025-10-02T21:22:14.827394] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-02T21:22:14.893577] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-02T21:22:15.019694] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-10-02T21:22:15.473011] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-10. [2025-10-02T21:22:16.273023] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-01. [2025-10-02T21:22:16.634952] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-02T21:22:16.701559] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-02T21:22:16.703905] [INFO ] [REMOTE ] SA: Full fetch complete (62497 records). [2025-10-02T21:22:16.703997] [DEBUG] [VALIDATOR ] SA: Validating primary data. [2025-10-02T21:22:17.078162] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-02. [2025-10-02T21:22:17.158473] [DEBUG] [VALIDATOR ] SA: All expected trading days are present. [2025-10-02T21:22:17.158583] [DEBUG] [VALIDATOR ] SA: Primary data validation passed. [2025-10-02T21:22:17.159766] [INFO ] [MAIN ] SA: Fetched primary data is valid. [2025-10-02T21:22:17.159881] [DEBUG] [LOCAL ] SA: Saving primary data. [2025-10-02T21:22:17.161476] [DEBUG] [LOCAL ] SA: Trimmed 62497 records to 43787 (keeping 200 days of data) [2025-10-02T21:22:17.442131] [DEBUG] [LOCAL ] SA: Primary data saved (43787 records). [2025-10-02T21:22:17.442276] [INFO ] [MAIN ] SA: Full history saved. [2025-10-02T21:22:17.442409] [INFO ] [MAIN ] Update Progress: 1859/2370 symbols completed. SA took 41.2s. Estimated remaining: 1h 12m 5s. Rate: 7.1 symbols/min [2025-10-02T21:22:17.624157] [INFO ] [MAIN ] SAM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:22:17.648780] [DEBUG] [LOCAL ] SAM: Loaded 21433 existing records from primary storage. [2025-10-02T21:22:17.649070] [INFO ] [MAIN ] SAM: Loaded 21433 existing records. [2025-10-02T21:22:17.880566] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-10. [2025-10-02T21:22:17.931993] [WARN ] [MAIN ] SAM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:22:17.932413] [INFO ] [MAIN ] SAM: Wiping existing primary data before full refresh. [2025-10-02T21:22:17.932465] [INFO ] [LOCAL ] SAM: Starting deletion of primary data. [2025-10-02T21:22:17.932723] [DEBUG] [LOCAL ] SAM: Deleted primary data file. [2025-10-02T21:22:17.932784] [INFO ] [MAIN ] SAM: Starting full primary refresh. [2025-10-02T21:22:18.278980] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-02T21:22:18.516884] [INFO ] [REMOTE ] SAM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:22:18.673043] [INFO ] [REMOTE ] SAM: Fetching primary data for 2024-12. [2025-10-02T21:22:18.705047] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-02T21:22:18.707101] [INFO ] [REMOTE ] SAFE: Full fetch complete (45036 records). [2025-10-02T21:22:18.707263] [DEBUG] [VALIDATOR ] SAFE: Validating primary data. [2025-10-02T21:22:19.179189] [DEBUG] [VALIDATOR ] SAFE: All expected trading days are present. [2025-10-02T21:22:19.179277] [DEBUG] [VALIDATOR ] SAFE: Primary data validation passed. [2025-10-02T21:22:19.180222] [INFO ] [MAIN ] SAFE: Fetched primary data is valid. [2025-10-02T21:22:19.180292] [DEBUG] [LOCAL ] SAFE: Saving primary data. [2025-10-02T21:22:19.181474] [DEBUG] [LOCAL ] SAFE: Trimmed 45036 records to 30374 (keeping 200 days of data) [2025-10-02T21:22:19.359746] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-02T21:22:19.398857] [DEBUG] [LOCAL ] SAFE: Primary data saved (30374 records). [2025-10-02T21:22:19.399005] [INFO ] [MAIN ] SAFE: Full history saved. [2025-10-02T21:22:19.399092] [INFO ] [MAIN ] Update Progress: 1860/2370 symbols completed. SAFE took 31.7s. Estimated remaining: 1h 11m 55s. Rate: 7.1 symbols/min [2025-10-02T21:22:19.478171] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-01. [2025-10-02T21:22:19.585078] [INFO ] [MAIN ] SAN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:22:19.635752] [DEBUG] [LOCAL ] SAN: Loaded 52993 existing records from primary storage. [2025-10-02T21:22:19.636093] [INFO ] [MAIN ] SAN: Loaded 52993 existing records. [2025-10-02T21:22:19.833464] [WARN ] [MAIN ] SAN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:22:19.833732] [INFO ] [MAIN ] SAN: Wiping existing primary data before full refresh. [2025-10-02T21:22:19.833788] [INFO ] [LOCAL ] SAN: Starting deletion of primary data. [2025-10-02T21:22:19.834045] [DEBUG] [LOCAL ] SAN: Deleted primary data file. [2025-10-02T21:22:19.834108] [INFO ] [MAIN ] SAN: Starting full primary refresh. [2025-10-02T21:22:20.232343] [INFO ] [REMOTE ] SAN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:22:20.272996] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-02. [2025-10-02T21:22:20.594903] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-02T21:22:20.626071] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-02T21:22:21.073021] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-03. [2025-10-02T21:22:21.873041] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-03. [2025-10-02T21:22:22.208998] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-02T21:22:22.249085] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-02T21:22:22.672979] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-02. [2025-10-02T21:22:23.472970] [INFO ] [REMOTE ] SAN: Fetching primary data for 2024-12. [2025-10-02T21:22:23.780689] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-02T21:22:24.273100] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-04. [2025-10-02T21:22:24.588127] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-02T21:22:25.073023] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-04. [2025-10-02T21:22:25.297678] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-02T21:22:25.873045] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-05. [2025-10-02T21:22:26.064478] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-02T21:22:26.212608] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-02T21:22:26.673017] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-01. [2025-10-02T21:22:27.473050] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-03. [2025-10-02T21:22:28.273010] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-05. [2025-10-02T21:22:28.466344] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-02T21:22:28.587615] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-02T21:22:29.073047] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-04. [2025-10-02T21:22:29.132976] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-02T21:22:29.873011] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-06. [2025-10-02T21:22:30.160853] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-02T21:22:30.672997] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-02. [2025-10-02T21:22:31.092741] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-02T21:22:31.473016] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-05. [2025-10-02T21:22:32.272970] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-07. [2025-10-02T21:22:32.467927] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-02T21:22:32.525488] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-02T21:22:33.073046] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-06. [2025-10-02T21:22:33.413711] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-02T21:22:33.445155] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-02T21:22:33.873041] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-06. [2025-10-02T21:22:34.673207] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-07. [2025-10-02T21:22:34.932806] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-02T21:22:34.995843] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-02T21:22:35.473013] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-03. [2025-10-02T21:22:36.273046] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-08. [2025-10-02T21:22:37.072988] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-07. [2025-10-02T21:22:37.107885] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-02T21:22:37.658207] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-02T21:22:37.873047] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-09. [2025-10-02T21:22:38.096297] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-02T21:22:38.672976] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-08. [2025-10-02T21:22:38.871084] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-02T21:22:39.480511] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-04. [2025-10-02T21:22:39.484257] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-02T21:22:40.273007] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-10. [2025-10-02T21:22:40.982489] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-02T21:22:40.983814] [INFO ] [REMOTE ] SAH: Full fetch complete (30520 records). [2025-10-02T21:22:40.983900] [DEBUG] [VALIDATOR ] SAH: Validating primary data. [2025-10-02T21:22:41.082275] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-08. [2025-10-02T21:22:41.439435] [DEBUG] [VALIDATOR ] SAH: All expected trading days are present. [2025-10-02T21:22:41.439623] [DEBUG] [VALIDATOR ] SAH: Primary data validation passed. [2025-10-02T21:22:41.440446] [INFO ] [MAIN ] SAH: Fetched primary data is valid. [2025-10-02T21:22:41.440556] [DEBUG] [LOCAL ] SAH: Saving primary data. [2025-10-02T21:22:41.442338] [DEBUG] [LOCAL ] SAH: Trimmed 30520 records to 22028 (keeping 200 days of data) [2025-10-02T21:22:41.578476] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-02T21:22:41.641731] [DEBUG] [LOCAL ] SAH: Primary data saved (22028 records). [2025-10-02T21:22:41.641892] [INFO ] [MAIN ] SAH: Full history saved. [2025-10-02T21:22:41.641991] [INFO ] [MAIN ] Update Progress: 1861/2370 symbols completed. SAH took 36.4s. Estimated remaining: 1h 11m 50s. Rate: 7.1 symbols/min [2025-10-02T21:22:41.739294] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-02T21:22:41.847817] [INFO ] [MAIN ] SAND: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:22:41.881684] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-05. [2025-10-02T21:22:41.905876] [DEBUG] [LOCAL ] SAND: Loaded 51813 existing records from primary storage. [2025-10-02T21:22:41.906253] [INFO ] [MAIN ] SAND: Loaded 51813 existing records. [2025-10-02T21:22:42.120124] [WARN ] [MAIN ] SAND: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:22:42.120782] [INFO ] [MAIN ] SAND: Wiping existing primary data before full refresh. [2025-10-02T21:22:42.120848] [INFO ] [LOCAL ] SAND: Starting deletion of primary data. [2025-10-02T21:22:42.121464] [DEBUG] [LOCAL ] SAND: Deleted primary data file. [2025-10-02T21:22:42.121529] [INFO ] [MAIN ] SAND: Starting full primary refresh. [2025-10-02T21:22:42.505356] [INFO ] [REMOTE ] SAND: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:22:42.673026] [INFO ] [REMOTE ] SAND: Fetching primary data for 2024-12. [2025-10-02T21:22:43.473011] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-09. [2025-10-02T21:22:43.799000] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-02T21:22:43.847678] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-02T21:22:44.001449] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-02T21:22:44.273002] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-01. [2025-10-02T21:22:45.073008] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-09. [2025-10-02T21:22:45.872993] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-10. [2025-10-02T21:22:45.984586] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-02T21:22:46.085633] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-10 (0.21 seconds). [2025-10-02T21:22:46.086598] [INFO ] [REMOTE ] SAJ: Full fetch complete (924 records). [2025-10-02T21:22:46.086740] [DEBUG] [VALIDATOR ] SAJ: Validating primary data. [2025-10-02T21:22:46.303501] [WARN ] [VALIDATOR ] SAJ: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-02T21:22:46.303889] [FATAL] [MAIN ] SAJ: Fetched primary data is invalid. Refusing to save it. [2025-10-02T21:22:46.303971] [WARN ] [MAIN ] SAJ: Deleting existing primary and derivative data due to validation failure. [2025-10-02T21:22:46.304065] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-10-02T21:22:46.304240] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-10-02T21:22:46.304317] [INFO ] [LOCAL ] SAJ: Starting deletion of derivative data. [2025-10-02T21:22:46.304472] [DEBUG] [LOCAL ] SAJ: No derivative data file found to delete. [2025-10-02T21:22:46.304565] [INFO ] [MAIN ] Update Progress: 1862/2370 symbols completed. SAJ took 35.4s. Estimated remaining: 1h 11m 40s. Rate: 7.1 symbols/min [2025-10-02T21:22:46.415540] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-02T21:22:46.551634] [INFO ] [MAIN ] SAP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:22:46.607978] [DEBUG] [LOCAL ] SAP: Loaded 50011 existing records from primary storage. [2025-10-02T21:22:46.608505] [INFO ] [MAIN ] SAP: Loaded 50011 existing records. [2025-10-02T21:22:46.678142] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-06. [2025-10-02T21:22:46.825105] [WARN ] [MAIN ] SAP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:22:46.825317] [INFO ] [MAIN ] SAP: Wiping existing primary data before full refresh. [2025-10-02T21:22:46.825367] [INFO ] [LOCAL ] SAP: Starting deletion of primary data. [2025-10-02T21:22:46.825810] [DEBUG] [LOCAL ] SAP: Deleted primary data file. [2025-10-02T21:22:46.825872] [INFO ] [MAIN ] SAP: Starting full primary refresh. [2025-10-02T21:22:47.216729] [INFO ] [REMOTE ] SAP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:22:47.473026] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-10. [2025-10-02T21:22:48.272975] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-02. [2025-10-02T21:22:48.346291] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-02T21:22:48.347632] [INFO ] [REMOTE ] SAM: Full fetch complete (30704 records). [2025-10-02T21:22:48.347744] [DEBUG] [VALIDATOR ] SAM: Validating primary data. [2025-10-02T21:22:48.772431] [DEBUG] [VALIDATOR ] SAM: All expected trading days are present. [2025-10-02T21:22:48.772617] [DEBUG] [VALIDATOR ] SAM: Primary data validation passed. [2025-10-02T21:22:48.773481] [INFO ] [MAIN ] SAM: Fetched primary data is valid. [2025-10-02T21:22:48.773570] [DEBUG] [LOCAL ] SAM: Saving primary data. [2025-10-02T21:22:48.803886] [DEBUG] [LOCAL ] SAM: Trimmed 30704 records to 21580 (keeping 200 days of data) [2025-10-02T21:22:48.805736] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-02T21:22:48.953038] [DEBUG] [LOCAL ] SAM: Primary data saved (21580 records). [2025-10-02T21:22:48.953239] [INFO ] [MAIN ] SAM: Full history saved. [2025-10-02T21:22:48.953328] [INFO ] [MAIN ] Update Progress: 1863/2370 symbols completed. SAM took 31.5s. Estimated remaining: 1h 11m 30s. Rate: 7.1 symbols/min [2025-10-02T21:22:49.078220] [INFO ] [REMOTE ] SAP: Fetching primary data for 2024-12. [2025-10-02T21:22:49.153300] [INFO ] [MAIN ] SAR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:22:49.171604] [DEBUG] [LOCAL ] SAR: Loaded 16209 existing records from primary storage. [2025-10-02T21:22:49.171889] [INFO ] [MAIN ] SAR: Loaded 16209 existing records. [2025-10-02T21:22:49.382135] [WARN ] [MAIN ] SAR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:22:49.382406] [INFO ] [MAIN ] SAR: Wiping existing primary data before full refresh. [2025-10-02T21:22:49.382469] [INFO ] [LOCAL ] SAR: Starting deletion of primary data. [2025-10-02T21:22:49.382866] [DEBUG] [LOCAL ] SAR: Deleted primary data file. [2025-10-02T21:22:49.382953] [INFO ] [MAIN ] SAR: Starting full primary refresh. [2025-10-02T21:22:49.838456] [INFO ] [REMOTE ] SAR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:22:49.872974] [INFO ] [REMOTE ] SAR: Fetching primary data for 2024-12. [2025-10-02T21:22:49.955392] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-02T21:22:50.487475] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-02T21:22:50.604308] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-02T21:22:50.672994] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-01. [2025-10-02T21:22:51.465175] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-02T21:22:51.472960] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-02. [2025-10-02T21:22:52.273028] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-07. [2025-10-02T21:22:53.073047] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-01. [2025-10-02T21:22:53.873020] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-03. [2025-10-02T21:23:06.506071] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-07 (14.23 seconds). [2025-10-02T21:23:06.520382] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-08. [2025-10-02T21:23:06.532831] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-02 (15.06 seconds). [2025-10-02T21:23:06.537394] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-03. [2025-10-02T21:23:06.616629] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-01 (13.54 seconds). [2025-10-02T21:23:06.627662] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-02. [2025-10-02T21:23:07.682772] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-02T21:23:07.688503] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-04. [2025-10-02T21:23:08.169699] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-02T21:23:08.180163] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-03. [2025-10-02T21:23:08.484994] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-02T21:23:08.499451] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-02T21:23:08.507413] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-05. [2025-10-02T21:23:08.510562] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-09. [2025-10-02T21:23:09.532900] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-02T21:23:09.538477] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-06. [2025-10-02T21:23:10.081699] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-02T21:23:10.094118] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-04. [2025-10-02T21:23:10.286069] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-03 (16.41 seconds). [2025-10-02T21:23:10.317988] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-04. [2025-10-02T21:23:10.338983] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-02T21:23:10.352230] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-10. [2025-10-02T21:23:10.548690] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-02T21:23:10.552900] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-07. [2025-10-02T21:23:11.327252] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-02T21:23:11.333518] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-08. [2025-10-02T21:23:11.937026] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-02T21:23:11.949278] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-05. [2025-10-02T21:23:12.133411] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-02T21:23:12.145080] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-05. [2025-10-02T21:23:12.426680] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-02T21:23:12.431480] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-09. [2025-10-02T21:23:13.060560] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-10 (2.71 seconds). [2025-10-02T21:23:13.065509] [INFO ] [REMOTE ] SAN: Full fetch complete (76264 records). [2025-10-02T21:23:13.065719] [DEBUG] [VALIDATOR ] SAN: Validating primary data. [2025-10-02T21:23:13.284583] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-02T21:23:13.348553] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-10. [2025-10-02T21:23:13.555068] [DEBUG] [VALIDATOR ] SAN: All expected trading days are present. [2025-10-02T21:23:13.555168] [DEBUG] [VALIDATOR ] SAN: Primary data validation passed. [2025-10-02T21:23:13.556672] [INFO ] [MAIN ] SAN: Fetched primary data is valid. [2025-10-02T21:23:13.556777] [DEBUG] [LOCAL ] SAN: Saving primary data. [2025-10-02T21:23:13.559136] [DEBUG] [LOCAL ] SAN: Trimmed 76264 records to 53375 (keeping 200 days of data) [2025-10-02T21:23:13.833845] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-02T21:23:13.848036] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-06. [2025-10-02T21:23:13.967279] [DEBUG] [LOCAL ] SAN: Primary data saved (53375 records). [2025-10-02T21:23:13.967472] [INFO ] [MAIN ] SAN: Full history saved. [2025-10-02T21:23:13.967687] [INFO ] [MAIN ] Update Progress: 1864/2370 symbols completed. SAN took 54.6s. Estimated remaining: 1h 11m 26s. Rate: 7.1 symbols/min [2025-10-02T21:23:14.196383] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-02T21:23:14.199133] [INFO ] [MAIN ] SARO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:23:14.211851] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-06. [2025-10-02T21:23:14.231041] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-02T21:23:14.232507] [INFO ] [REMOTE ] SAR: Full fetch complete (22708 records). [2025-10-02T21:23:14.232612] [DEBUG] [VALIDATOR ] SAR: Validating primary data. [2025-10-02T21:23:14.406945] [DEBUG] [LOCAL ] SARO: Loaded 48609 existing records from primary storage. [2025-10-02T21:23:14.443328] [INFO ] [MAIN ] SARO: Loaded 48609 existing records. [2025-10-02T21:23:14.948951] [WARN ] [MAIN ] SARO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:23:14.949892] [DEBUG] [VALIDATOR ] SAR: All expected trading days are present. [2025-10-02T21:23:14.950095] [DEBUG] [VALIDATOR ] SAR: Primary data validation passed. [2025-10-02T21:23:14.950730] [INFO ] [MAIN ] SAR: Fetched primary data is valid. [2025-10-02T21:23:14.950810] [DEBUG] [LOCAL ] SAR: Saving primary data. [2025-10-02T21:23:14.951298] [INFO ] [MAIN ] SARO: Wiping existing primary data before full refresh. [2025-10-02T21:23:14.951811] [INFO ] [LOCAL ] SARO: Starting deletion of primary data. [2025-10-02T21:23:14.952450] [DEBUG] [LOCAL ] SAR: Trimmed 22708 records to 16340 (keeping 200 days of data) [2025-10-02T21:23:14.952351] [DEBUG] [LOCAL ] SARO: Deleted primary data file. [2025-10-02T21:23:14.952963] [INFO ] [MAIN ] SARO: Starting full primary refresh. [2025-10-02T21:23:15.493360] [INFO ] [REMOTE ] SARO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:23:15.494800] [INFO ] [REMOTE ] SARO: Fetching primary data for 2024-12. [2025-10-02T21:23:15.511474] [DEBUG] [LOCAL ] SAR: Primary data saved (16340 records). [2025-10-02T21:23:15.511706] [INFO ] [MAIN ] SAR: Full history saved. [2025-10-02T21:23:15.511848] [INFO ] [MAIN ] Update Progress: 1865/2370 symbols completed. SAR took 26.6s. Estimated remaining: 1h 11m 16s. Rate: 7.1 symbols/min [2025-10-02T21:23:15.722561] [INFO ] [MAIN ] SAT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:23:15.722900] [DEBUG] [LOCAL ] SAT: No existing data file found in primary storage. [2025-10-02T21:23:15.723137] [WARN ] [MAIN ] SAT: No existing data found, performing full refresh instead. [2025-10-02T21:23:15.723344] [INFO ] [MAIN ] SAT: Wiping existing primary data before full refresh. [2025-10-02T21:23:15.723437] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-10-02T21:23:15.723569] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-10-02T21:23:15.723863] [INFO ] [MAIN ] SAT: Starting full primary refresh. [2025-10-02T21:23:15.824494] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-02T21:23:15.884171] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-07. [2025-10-02T21:23:16.198839] [INFO ] [REMOTE ] SAT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:23:16.199216] [INFO ] [REMOTE ] SAT: Fetching primary data for 2024-12. [2025-10-02T21:23:16.228172] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-02T21:23:16.238810] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-07. [2025-10-02T21:23:16.656026] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-02T21:23:16.657199] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-01. [2025-10-02T21:23:17.007418] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-02T21:23:17.011457] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-02T21:23:17.009714] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-02. [2025-10-02T21:23:17.022113] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-01. [2025-10-02T21:23:17.304740] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-02T21:23:17.306524] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-03. [2025-10-02T21:23:17.454137] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-02T21:23:17.466719] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-08. [2025-10-02T21:23:17.745349] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-02T21:23:17.746730] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-04. [2025-10-02T21:23:17.879063] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-02T21:23:17.891079] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-08. [2025-10-02T21:23:18.191543] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-02T21:23:18.367390] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-02T21:23:18.672994] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-05. [2025-10-02T21:23:18.925440] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-10-02T21:23:19.302514] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-02T21:23:19.473041] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-02. [2025-10-02T21:23:19.928669] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-02T21:23:20.273019] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-09. [2025-10-02T21:23:20.887874] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-02T21:23:21.073016] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-03. [2025-10-02T21:23:21.695873] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-02T21:23:21.873043] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-09. [2025-10-02T21:23:22.551542] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-02T21:23:22.673003] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-10. [2025-10-02T21:23:23.472978] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-06. [2025-10-02T21:23:23.799137] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-02T21:23:23.833294] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-02T21:23:24.052058] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-02T21:23:24.054351] [INFO ] [REMOTE ] SAND: Full fetch complete (74454 records). [2025-10-02T21:23:24.054476] [DEBUG] [VALIDATOR ] SAND: Validating primary data. [2025-10-02T21:23:24.278739] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-04. [2025-10-02T21:23:24.513811] [DEBUG] [VALIDATOR ] SAND: All expected trading days are present. [2025-10-02T21:23:24.513935] [DEBUG] [VALIDATOR ] SAND: Primary data validation passed. [2025-10-02T21:23:24.515831] [INFO ] [MAIN ] SAND: Fetched primary data is valid. [2025-10-02T21:23:24.515904] [DEBUG] [LOCAL ] SAND: Saving primary data. [2025-10-02T21:23:24.518128] [DEBUG] [LOCAL ] SAND: Trimmed 74454 records to 52192 (keeping 200 days of data) [2025-10-02T21:23:24.874560] [DEBUG] [LOCAL ] SAND: Primary data saved (52192 records). [2025-10-02T21:23:24.874740] [INFO ] [MAIN ] SAND: Full history saved. [2025-10-02T21:23:24.874943] [INFO ] [MAIN ] Update Progress: 1866/2370 symbols completed. SAND took 43.2s. Estimated remaining: 1h 11m 8s. Rate: 7.1 symbols/min [2025-10-02T21:23:25.074884] [INFO ] [MAIN ] SAY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:23:25.075316] [DEBUG] [LOCAL ] SAY: No existing data file found in primary storage. [2025-10-02T21:23:25.074991] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-10. [2025-10-02T21:23:25.075504] [WARN ] [MAIN ] SAY: No existing data found, performing full refresh instead. [2025-10-02T21:23:25.077042] [INFO ] [MAIN ] SAY: Wiping existing primary data before full refresh. [2025-10-02T21:23:25.077092] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-10-02T21:23:25.077143] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-10-02T21:23:25.077182] [INFO ] [MAIN ] SAY: Starting full primary refresh. [2025-10-02T21:23:25.506495] [INFO ] [REMOTE ] SAY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:23:25.872964] [INFO ] [REMOTE ] SAY: Fetching primary data for 2024-12. [2025-10-02T21:23:26.000551] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-02T21:23:26.353545] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-02T21:23:26.673025] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-01. [2025-10-02T21:23:26.759348] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-02T21:23:26.761757] [INFO ] [REMOTE ] SAP: Full fetch complete (71855 records). [2025-10-02T21:23:26.761923] [DEBUG] [VALIDATOR ] SAP: Validating primary data. [2025-10-02T21:23:27.082762] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-02T21:23:27.223479] [DEBUG] [VALIDATOR ] SAP: All expected trading days are present. [2025-10-02T21:23:27.223567] [DEBUG] [VALIDATOR ] SAP: Primary data validation passed. [2025-10-02T21:23:27.224866] [INFO ] [MAIN ] SAP: Fetched primary data is valid. [2025-10-02T21:23:27.224938] [DEBUG] [LOCAL ] SAP: Saving primary data. [2025-10-02T21:23:27.226632] [DEBUG] [LOCAL ] SAP: Trimmed 71855 records to 50362 (keeping 200 days of data) [2025-10-02T21:23:27.497270] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-07. [2025-10-02T21:23:27.685711] [DEBUG] [LOCAL ] SAP: Primary data saved (50362 records). [2025-10-02T21:23:27.686034] [INFO ] [MAIN ] SAP: Full history saved. [2025-10-02T21:23:27.687544] [INFO ] [MAIN ] Update Progress: 1867/2370 symbols completed. SAP took 41.4s. Estimated remaining: 1h 10m 58s. Rate: 7.1 symbols/min [2025-10-02T21:23:27.859012] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-02T21:23:27.951417] [INFO ] [MAIN ] SAZ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:23:27.951631] [DEBUG] [LOCAL ] SAZ: No existing data file found in primary storage. [2025-10-02T21:23:27.951711] [WARN ] [MAIN ] SAZ: No existing data found, performing full refresh instead. [2025-10-02T21:23:27.951888] [INFO ] [MAIN ] SAZ: Wiping existing primary data before full refresh. [2025-10-02T21:23:27.951931] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-10-02T21:23:27.951972] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-10-02T21:23:27.952005] [INFO ] [MAIN ] SAZ: Starting full primary refresh. [2025-10-02T21:23:28.278265] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-02. [2025-10-02T21:23:28.430768] [INFO ] [REMOTE ] SAZ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:23:28.689688] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-02T21:23:29.073007] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-08. [2025-10-02T21:23:29.398017] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-02T21:23:29.873039] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2024-12. [2025-10-02T21:23:30.240978] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-10-02T21:23:30.673055] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-01. [2025-10-02T21:23:31.021542] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-02T21:23:31.473026] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-03. [2025-10-02T21:23:31.720298] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-10-02T21:23:32.273058] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-04. [2025-10-02T21:23:32.629487] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-02T21:23:33.073007] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-02. [2025-10-02T21:23:33.422872] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-02T21:23:33.873042] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-05. [2025-10-02T21:23:34.673059] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-09. [2025-10-02T21:23:35.016841] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-02T21:23:35.473004] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-03. [2025-10-02T21:23:35.517716] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-02T21:23:35.771050] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-10-02T21:23:36.273017] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-05. [2025-10-02T21:23:36.579471] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-02T21:23:37.073045] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-10. [2025-10-02T21:23:37.357586] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-10 (0.28 seconds). [2025-10-02T21:23:37.358630] [INFO ] [REMOTE ] SAT: Full fetch complete (1610 records). [2025-10-02T21:23:37.358753] [DEBUG] [VALIDATOR ] SAT: Validating primary data. [2025-10-02T21:23:37.590195] [WARN ] [VALIDATOR ] SAT: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-02T21:23:37.591324] [FATAL] [MAIN ] SAT: Fetched primary data is invalid. Refusing to save it. [2025-10-02T21:23:37.591403] [WARN ] [MAIN ] SAT: Deleting existing primary and derivative data due to validation failure. [2025-10-02T21:23:37.591483] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-10-02T21:23:37.591562] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-10-02T21:23:37.591619] [INFO ] [LOCAL ] SAT: Starting deletion of derivative data. [2025-10-02T21:23:37.591744] [DEBUG] [LOCAL ] SAT: No derivative data file found to delete. [2025-10-02T21:23:37.591831] [INFO ] [MAIN ] Update Progress: 1868/2370 symbols completed. SAT took 22.1s. Estimated remaining: 1h 10m 50s. Rate: 7.1 symbols/min [2025-10-02T21:23:37.818670] [INFO ] [MAIN ] SB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:23:37.865161] [DEBUG] [LOCAL ] SB: Loaded 33223 existing records from primary storage. [2025-10-02T21:23:37.865493] [INFO ] [MAIN ] SB: Loaded 33223 existing records. [2025-10-02T21:23:37.878175] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-04. [2025-10-02T21:23:38.072794] [WARN ] [MAIN ] SB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:23:38.073023] [INFO ] [MAIN ] SB: Wiping existing primary data before full refresh. [2025-10-02T21:23:38.073077] [INFO ] [LOCAL ] SB: Starting deletion of primary data. [2025-10-02T21:23:38.073695] [DEBUG] [LOCAL ] SB: Deleted primary data file. [2025-10-02T21:23:38.073776] [INFO ] [MAIN ] SB: Starting full primary refresh. [2025-10-02T21:23:38.473830] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-02T21:23:38.487662] [INFO ] [REMOTE ] SB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:23:38.672997] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-06. [2025-10-02T21:23:39.473006] [INFO ] [REMOTE ] SB: Fetching primary data for 2024-12. [2025-10-02T21:23:40.262271] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-02T21:23:40.272942] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-07. [2025-10-02T21:23:41.073007] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-05. [2025-10-02T21:23:41.126858] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-02T21:23:41.386586] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-02T21:23:41.878346] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-06. [2025-10-02T21:23:41.884881] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-02T21:23:42.232481] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-02T21:23:42.672997] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-01. [2025-10-02T21:23:43.473000] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-08. [2025-10-02T21:23:44.241502] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-02T21:23:44.272980] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-07. [2025-10-02T21:23:44.647228] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-02T21:23:44.769428] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-02T21:23:45.073006] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-08. [2025-10-02T21:23:45.419359] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-02T21:23:45.873048] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-09. [2025-10-02T21:23:46.673069] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-06. [2025-10-02T21:23:47.025730] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-02T21:23:47.473008] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-02. [2025-10-02T21:23:47.522599] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-02T21:23:48.273014] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-09. [2025-10-02T21:23:48.888582] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-02T21:23:48.915434] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-02T21:23:49.073036] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-10. [2025-10-02T21:23:49.340043] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-10 (0.27 seconds). [2025-10-02T21:23:49.340772] [INFO ] [REMOTE ] SAZ: Full fetch complete (1828 records). [2025-10-02T21:23:49.340845] [DEBUG] [VALIDATOR ] SAZ: Validating primary data. [2025-10-02T21:23:49.543408] [WARN ] [VALIDATOR ] SAZ: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-02T21:23:49.543612] [FATAL] [MAIN ] SAZ: Fetched primary data is invalid. Refusing to save it. [2025-10-02T21:23:49.543707] [WARN ] [MAIN ] SAZ: Deleting existing primary and derivative data due to validation failure. [2025-10-02T21:23:49.543789] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-10-02T21:23:49.543859] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-10-02T21:23:49.543899] [INFO ] [LOCAL ] SAZ: Starting deletion of derivative data. [2025-10-02T21:23:49.543941] [DEBUG] [LOCAL ] SAZ: No derivative data file found to delete. [2025-10-02T21:23:49.543998] [INFO ] [MAIN ] Update Progress: 1869/2370 symbols completed. SAZ took 21.9s. Estimated remaining: 1h 10m 42s. Rate: 7.1 symbols/min [2025-10-02T21:23:49.732664] [INFO ] [MAIN ] SBDS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:23:49.733094] [DEBUG] [LOCAL ] SBDS: No existing data file found in primary storage. [2025-10-02T21:23:49.733151] [WARN ] [MAIN ] SBDS: No existing data found, performing full refresh instead. [2025-10-02T21:23:49.733273] [INFO ] [MAIN ] SBDS: Wiping existing primary data before full refresh. [2025-10-02T21:23:49.733318] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-10-02T21:23:49.733363] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-10-02T21:23:49.733396] [INFO ] [MAIN ] SBDS: Starting full primary refresh. [2025-10-02T21:23:49.887018] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-10. [2025-10-02T21:23:50.150287] [INFO ] [REMOTE ] SBDS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:23:50.673041] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2024-12. [2025-10-02T21:23:50.897618] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T21:23:50.898212] [WARN ] [REMOTE ] SBDS: No data returned for month 2024-12 [2025-10-02T21:23:50.898328] [FATAL] [REMOTE ] SBDS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T21:23:50.898400] [FATAL] [MAIN ] SBDS: Failed to fetch primary data. [2025-10-02T21:23:50.898466] [WARN ] [MAIN ] SBDS: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T21:23:50.898536] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-10-02T21:23:50.898600] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-10-02T21:23:50.898636] [INFO ] [LOCAL ] SBDS: Starting deletion of derivative data. [2025-10-02T21:23:50.898724] [DEBUG] [LOCAL ] SBDS: No derivative data file found to delete. [2025-10-02T21:23:50.898778] [INFO ] [MAIN ] Update Progress: 1870/2370 symbols completed. SBDS took 1.4s. Estimated remaining: 1h 10m 32s. Rate: 7.1 symbols/min [2025-10-02T21:23:51.098325] [INFO ] [MAIN ] SBH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:23:51.105103] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-02T21:23:51.107608] [INFO ] [REMOTE ] SARO: Full fetch complete (69047 records). [2025-10-02T21:23:51.107762] [DEBUG] [VALIDATOR ] SARO: Validating primary data. [2025-10-02T21:23:51.479576] [DEBUG] [LOCAL ] SBH: Loaded 49787 existing records from primary storage. [2025-10-02T21:23:51.478140] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-03. [2025-10-02T21:23:51.515142] [INFO ] [MAIN ] SBH: Loaded 49787 existing records. [2025-10-02T21:23:51.765052] [DEBUG] [VALIDATOR ] SARO: All expected trading days are present. [2025-10-02T21:23:51.780598] [DEBUG] [VALIDATOR ] SARO: Primary data validation passed. [2025-10-02T21:23:51.804038] [INFO ] [MAIN ] SARO: Fetched primary data is valid. [2025-10-02T21:23:51.821471] [DEBUG] [LOCAL ] SARO: Saving primary data. [2025-10-02T21:23:51.844224] [WARN ] [MAIN ] SBH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:23:51.844558] [INFO ] [MAIN ] SBH: Wiping existing primary data before full refresh. [2025-10-02T21:23:51.844614] [INFO ] [LOCAL ] SBH: Starting deletion of primary data. [2025-10-02T21:23:51.844954] [DEBUG] [LOCAL ] SBH: Deleted primary data file. [2025-10-02T21:23:51.845041] [INFO ] [MAIN ] SBH: Starting full primary refresh. [2025-10-02T21:23:51.943732] [DEBUG] [LOCAL ] SARO: Trimmed 69047 records to 48990 (keeping 200 days of data) [2025-10-02T21:23:52.277449] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-07. [2025-10-02T21:23:52.386786] [INFO ] [REMOTE ] SBH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:23:52.640281] [DEBUG] [LOCAL ] SARO: Primary data saved (48990 records). [2025-10-02T21:23:52.640462] [INFO ] [MAIN ] SARO: Full history saved. [2025-10-02T21:23:52.640568] [INFO ] [MAIN ] Update Progress: 1871/2370 symbols completed. SARO took 38.7s. Estimated remaining: 1h 10m 22s. Rate: 7.1 symbols/min [2025-10-02T21:23:52.713625] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-02T21:23:52.850425] [INFO ] [MAIN ] SBI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:23:52.860988] [DEBUG] [LOCAL ] SBI: Loaded 7603 existing records from primary storage. [2025-10-02T21:23:52.861209] [INFO ] [MAIN ] SBI: Loaded 7603 existing records. [2025-10-02T21:23:53.073209] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-08. [2025-10-02T21:23:53.072833] [WARN ] [MAIN ] SBI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:23:53.075198] [INFO ] [MAIN ] SBI: Wiping existing primary data before full refresh. [2025-10-02T21:23:53.082769] [INFO ] [LOCAL ] SBI: Starting deletion of primary data. [2025-10-02T21:23:53.099254] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-02T21:23:53.099333] [DEBUG] [LOCAL ] SBI: Deleted primary data file. [2025-10-02T21:23:53.108996] [INFO ] [MAIN ] SBI: Starting full primary refresh. [2025-10-02T21:23:53.447193] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-02T21:23:53.537851] [INFO ] [REMOTE ] SBI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:23:53.873002] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-09. [2025-10-02T21:23:54.202068] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-02T21:23:54.673004] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-10. [2025-10-02T21:23:54.944522] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-10 (0.27 seconds). [2025-10-02T21:23:54.945382] [INFO ] [REMOTE ] SAY: Full fetch complete (1404 records). [2025-10-02T21:23:54.945467] [DEBUG] [VALIDATOR ] SAY: Validating primary data. [2025-10-02T21:23:55.158929] [WARN ] [VALIDATOR ] SAY: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-10-02T21:23:55.159130] [FATAL] [MAIN ] SAY: Fetched primary data is invalid. Refusing to save it. [2025-10-02T21:23:55.159198] [WARN ] [MAIN ] SAY: Deleting existing primary and derivative data due to validation failure. [2025-10-02T21:23:55.159274] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-10-02T21:23:55.159341] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-10-02T21:23:55.159437] [INFO ] [LOCAL ] SAY: Starting deletion of derivative data. [2025-10-02T21:23:55.159548] [DEBUG] [LOCAL ] SAY: No derivative data file found to delete. [2025-10-02T21:23:55.159664] [INFO ] [MAIN ] Update Progress: 1872/2370 symbols completed. SAY took 30.3s. Estimated remaining: 1h 10m 12s. Rate: 7.1 symbols/min [2025-10-02T21:23:55.349238] [INFO ] [MAIN ] SBR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:23:55.362022] [DEBUG] [LOCAL ] SBR: Loaded 7384 existing records from primary storage. [2025-10-02T21:23:55.362256] [INFO ] [MAIN ] SBR: Loaded 7384 existing records. [2025-10-02T21:23:55.478188] [INFO ] [REMOTE ] SBI: Fetching primary data for 2024-12. [2025-10-02T21:23:55.579699] [WARN ] [MAIN ] SBR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:23:55.579928] [INFO ] [MAIN ] SBR: Wiping existing primary data before full refresh. [2025-10-02T21:23:55.580033] [INFO ] [LOCAL ] SBR: Starting deletion of primary data. [2025-10-02T21:23:55.580248] [DEBUG] [LOCAL ] SBR: Deleted primary data file. [2025-10-02T21:23:55.580308] [INFO ] [MAIN ] SBR: Starting full primary refresh. [2025-10-02T21:23:55.979615] [INFO ] [REMOTE ] SBR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:23:56.251527] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-02T21:23:56.273004] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-01. [2025-10-02T21:23:56.904552] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-02T21:23:57.073050] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-02. [2025-10-02T21:23:57.692570] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-02T21:23:57.873031] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-03. [2025-10-02T21:23:58.618444] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-02T21:23:58.673018] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-04. [2025-10-02T21:23:59.243172] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-02T21:23:59.473029] [INFO ] [REMOTE ] SBH: Fetching primary data for 2024-12. [2025-10-02T21:24:00.273012] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-04. [2025-10-02T21:24:01.073064] [INFO ] [REMOTE ] SBR: Fetching primary data for 2024-12. [2025-10-02T21:24:01.296362] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-02T21:24:01.869562] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-02T21:24:01.869315] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-02T21:24:01.880525] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-01. [2025-10-02T21:24:02.637443] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-02T21:24:02.673032] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-05. [2025-10-02T21:24:03.291353] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-02T21:24:03.473057] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-02. [2025-10-02T21:24:04.009672] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-02T21:24:04.272994] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-01. [2025-10-02T21:24:05.073028] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-06. [2025-10-02T21:24:05.878362] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-03. [2025-10-02T21:24:05.906587] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-02T21:24:05.934369] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-02T21:24:06.673048] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-02. [2025-10-02T21:24:06.690346] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-02T21:24:07.473028] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-04. [2025-10-02T21:24:08.014724] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-02T21:24:08.273049] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-05. [2025-10-02T21:24:08.346709] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-02T21:24:09.073035] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-03. [2025-10-02T21:24:09.692474] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-02T21:24:09.873045] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-07. [2025-10-02T21:24:10.613539] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-02T21:24:10.672995] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-08. [2025-10-02T21:24:10.836440] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-02T21:24:11.405891] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-02T21:24:11.472987] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-05. [2025-10-02T21:24:12.147008] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-02T21:24:12.273036] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-04. [2025-10-02T21:24:13.073038] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-06. [2025-10-02T21:24:13.791891] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-02T21:24:13.872984] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-06. [2025-10-02T21:24:14.073988] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-02T21:24:14.672965] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-09. [2025-10-02T21:24:15.145899] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-02T21:24:15.146267] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-02T21:24:15.473036] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-10. [2025-10-02T21:24:15.911922] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-02T21:24:15.912836] [INFO ] [REMOTE ] SBI: Full fetch complete (10628 records). [2025-10-02T21:24:15.912911] [DEBUG] [VALIDATOR ] SBI: Validating primary data. [2025-10-02T21:24:16.284835] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-07. [2025-10-02T21:24:16.310238] [DEBUG] [VALIDATOR ] SBI: All expected trading days are present. [2025-10-02T21:24:16.310313] [DEBUG] [VALIDATOR ] SBI: Primary data validation passed. [2025-10-02T21:24:16.310571] [INFO ] [MAIN ] SBI: Fetched primary data is valid. [2025-10-02T21:24:16.310610] [DEBUG] [LOCAL ] SBI: Saving primary data. [2025-10-02T21:24:16.311071] [DEBUG] [LOCAL ] SBI: Trimmed 10628 records to 7614 (keeping 200 days of data) [2025-10-02T21:24:16.358178] [DEBUG] [LOCAL ] SBI: Primary data saved (7614 records). [2025-10-02T21:24:16.358314] [INFO ] [MAIN ] SBI: Full history saved. [2025-10-02T21:24:16.358395] [INFO ] [MAIN ] Update Progress: 1873/2370 symbols completed. SBI took 23.7s. Estimated remaining: 1h 10m 6s. Rate: 7.1 symbols/min [2025-10-02T21:24:16.542485] [INFO ] [MAIN ] SBS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:24:16.589189] [DEBUG] [LOCAL ] SBS: Loaded 49476 existing records from primary storage. [2025-10-02T21:24:16.589507] [INFO ] [MAIN ] SBS: Loaded 49476 existing records. [2025-10-02T21:24:16.785859] [WARN ] [MAIN ] SBS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:24:16.786095] [INFO ] [MAIN ] SBS: Wiping existing primary data before full refresh. [2025-10-02T21:24:16.786152] [INFO ] [LOCAL ] SBS: Starting deletion of primary data. [2025-10-02T21:24:16.786369] [DEBUG] [LOCAL ] SBS: Deleted primary data file. [2025-10-02T21:24:16.786429] [INFO ] [MAIN ] SBS: Starting full primary refresh. [2025-10-02T21:24:17.073772] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-07. [2025-10-02T21:24:17.087436] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-02T21:24:17.207321] [INFO ] [REMOTE ] SBS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:24:17.873010] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-08. [2025-10-02T21:24:18.320566] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-02T21:24:18.652559] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-02T21:24:18.672977] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-09. [2025-10-02T21:24:19.472967] [INFO ] [REMOTE ] SBS: Fetching primary data for 2024-12. [2025-10-02T21:24:19.560806] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-02T21:24:20.273089] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-08. [2025-10-02T21:24:21.073017] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-05. [2025-10-02T21:24:21.130885] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-02T21:24:21.590211] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-02T21:24:21.873038] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-10. [2025-10-02T21:24:22.420082] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-02T21:24:22.421022] [INFO ] [REMOTE ] SBR: Full fetch complete (11079 records). [2025-10-02T21:24:22.421097] [DEBUG] [VALIDATOR ] SBR: Validating primary data. [2025-10-02T21:24:22.678186] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-09. [2025-10-02T21:24:22.837726] [DEBUG] [VALIDATOR ] SBR: All expected trading days are present. [2025-10-02T21:24:22.837831] [DEBUG] [VALIDATOR ] SBR: Primary data validation passed. [2025-10-02T21:24:22.838283] [INFO ] [MAIN ] SBR: Fetched primary data is valid. [2025-10-02T21:24:22.838362] [DEBUG] [LOCAL ] SBR: Saving primary data. [2025-10-02T21:24:22.850288] [DEBUG] [LOCAL ] SBR: Trimmed 11079 records to 7447 (keeping 200 days of data) [2025-10-02T21:24:22.874900] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-02T21:24:22.949132] [DEBUG] [LOCAL ] SBR: Primary data saved (7447 records). [2025-10-02T21:24:22.949282] [INFO ] [MAIN ] SBR: Full history saved. [2025-10-02T21:24:22.949372] [INFO ] [MAIN ] Update Progress: 1874/2370 symbols completed. SBR took 27.8s. Estimated remaining: 1h 9m 58s. Rate: 7.1 symbols/min [2025-10-02T21:24:23.155020] [INFO ] [MAIN ] SBSI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:24:23.172327] [DEBUG] [LOCAL ] SBSI: Loaded 14756 existing records from primary storage. [2025-10-02T21:24:23.172577] [INFO ] [MAIN ] SBSI: Loaded 14756 existing records. [2025-10-02T21:24:23.378630] [WARN ] [MAIN ] SBSI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:24:23.378889] [INFO ] [MAIN ] SBSI: Wiping existing primary data before full refresh. [2025-10-02T21:24:23.378940] [INFO ] [LOCAL ] SBSI: Starting deletion of primary data. [2025-10-02T21:24:23.379154] [DEBUG] [LOCAL ] SBSI: Deleted primary data file. [2025-10-02T21:24:23.379214] [INFO ] [MAIN ] SBSI: Starting full primary refresh. [2025-10-02T21:24:23.478196] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-06. [2025-10-02T21:24:23.792680] [INFO ] [REMOTE ] SBSI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:24:23.964262] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-02T21:24:24.273020] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-10. [2025-10-02T21:24:25.080975] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-01. [2025-10-02T21:24:25.089500] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-02T21:24:25.208201] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-02T21:24:25.209993] [INFO ] [REMOTE ] SB: Full fetch complete (50320 records). [2025-10-02T21:24:25.210090] [DEBUG] [VALIDATOR ] SB: Validating primary data. [2025-10-02T21:24:25.638926] [DEBUG] [VALIDATOR ] SB: All expected trading days are present. [2025-10-02T21:24:25.639028] [DEBUG] [VALIDATOR ] SB: Primary data validation passed. [2025-10-02T21:24:25.640083] [INFO ] [MAIN ] SB: Fetched primary data is valid. [2025-10-02T21:24:25.640153] [DEBUG] [LOCAL ] SB: Saving primary data. [2025-10-02T21:24:25.641484] [DEBUG] [LOCAL ] SB: Trimmed 50320 records to 33455 (keeping 200 days of data) [2025-10-02T21:24:25.848091] [DEBUG] [LOCAL ] SB: Primary data saved (33455 records). [2025-10-02T21:24:25.848241] [INFO ] [MAIN ] SB: Full history saved. [2025-10-02T21:24:25.848335] [INFO ] [MAIN ] Update Progress: 1875/2370 symbols completed. SB took 48.3s. Estimated remaining: 1h 9m 48s. Rate: 7.1 symbols/min [2025-10-02T21:24:25.882539] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-07. [2025-10-02T21:24:26.044356] [INFO ] [MAIN ] SBSW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:24:26.097529] [DEBUG] [LOCAL ] SBSW: Loaded 53034 existing records from primary storage. [2025-10-02T21:24:26.097897] [INFO ] [MAIN ] SBSW: Loaded 53034 existing records. [2025-10-02T21:24:26.314846] [WARN ] [MAIN ] SBSW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:24:26.315287] [INFO ] [MAIN ] SBSW: Wiping existing primary data before full refresh. [2025-10-02T21:24:26.315436] [INFO ] [LOCAL ] SBSW: Starting deletion of primary data. [2025-10-02T21:24:26.315866] [DEBUG] [LOCAL ] SBSW: Deleted primary data file. [2025-10-02T21:24:26.315989] [INFO ] [MAIN ] SBSW: Starting full primary refresh. [2025-10-02T21:24:26.648971] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-02T21:24:26.675289] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2024-12. [2025-10-02T21:24:26.792794] [INFO ] [REMOTE ] SBSW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:24:27.472992] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-02. [2025-10-02T21:24:27.693494] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-02T21:24:27.692956] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-02T21:24:28.273025] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-01. [2025-10-02T21:24:29.015408] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-02T21:24:29.073014] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2024-12. [2025-10-02T21:24:29.218573] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-02T21:24:29.873014] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-03. [2025-10-02T21:24:30.673043] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-02. [2025-10-02T21:24:30.818411] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-02T21:24:31.473004] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-01. [2025-10-02T21:24:31.494607] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-02T21:24:31.609030] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-02T21:24:32.273000] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-03. [2025-10-02T21:24:33.073023] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-04. [2025-10-02T21:24:33.368083] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-02T21:24:33.406073] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-02T21:24:33.872990] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-08. [2025-10-02T21:24:34.507619] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-02T21:24:34.673007] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-05. [2025-10-02T21:24:35.473005] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-04. [2025-10-02T21:24:35.558017] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-02T21:24:35.932763] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-02T21:24:36.272990] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-02. [2025-10-02T21:24:36.341513] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-02T21:24:37.072997] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-09. [2025-10-02T21:24:37.872981] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-06. [2025-10-02T21:24:38.129424] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-02T21:24:38.673006] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-05. [2025-10-02T21:24:38.954679] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-02T21:24:39.473007] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-10. [2025-10-02T21:24:39.571431] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-02T21:24:39.588794] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-02T21:24:40.272992] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-06. [2025-10-02T21:24:40.823122] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-02T21:24:40.825209] [INFO ] [REMOTE ] SBH: Full fetch complete (72831 records). [2025-10-02T21:24:40.825305] [DEBUG] [VALIDATOR ] SBH: Validating primary data. [2025-10-02T21:24:41.078229] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-07. [2025-10-02T21:24:41.241562] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-02T21:24:41.264215] [DEBUG] [VALIDATOR ] SBH: All expected trading days are present. [2025-10-02T21:24:41.264705] [DEBUG] [VALIDATOR ] SBH: Primary data validation passed. [2025-10-02T21:24:41.265857] [INFO ] [MAIN ] SBH: Fetched primary data is valid. [2025-10-02T21:24:41.265943] [DEBUG] [LOCAL ] SBH: Saving primary data. [2025-10-02T21:24:41.267453] [DEBUG] [LOCAL ] SBH: Trimmed 72831 records to 50147 (keeping 200 days of data) [2025-10-02T21:24:41.590777] [DEBUG] [LOCAL ] SBH: Primary data saved (50147 records). [2025-10-02T21:24:41.590933] [INFO ] [MAIN ] SBH: Full history saved. [2025-10-02T21:24:41.591463] [INFO ] [MAIN ] Update Progress: 1876/2370 symbols completed. SBH took 50.7s. Estimated remaining: 1h 9m 41s. Rate: 7.1 symbols/min [2025-10-02T21:24:41.792292] [INFO ] [MAIN ] SBXD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:24:41.792483] [DEBUG] [LOCAL ] SBXD: No existing data file found in primary storage. [2025-10-02T21:24:41.792522] [WARN ] [MAIN ] SBXD: No existing data found, performing full refresh instead. [2025-10-02T21:24:41.792662] [INFO ] [MAIN ] SBXD: Wiping existing primary data before full refresh. [2025-10-02T21:24:41.792722] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-10-02T21:24:41.792770] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-10-02T21:24:41.792804] [INFO ] [MAIN ] SBXD: Starting full primary refresh. [2025-10-02T21:24:41.878132] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-07. [2025-10-02T21:24:42.175566] [INFO ] [REMOTE ] SBXD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:24:42.672986] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2024-12. [2025-10-02T21:24:42.887357] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-02T21:24:42.910389] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2024-12 (0.24 seconds). [2025-10-02T21:24:42.980344] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-02T21:24:43.473041] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-08. [2025-10-02T21:24:44.136560] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-02T21:24:44.273007] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-08. [2025-10-02T21:24:45.072994] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-03. [2025-10-02T21:24:45.872991] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-09. [2025-10-02T21:24:46.251976] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-02T21:24:46.673038] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-01. [2025-10-02T21:24:46.851988] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-02T21:24:46.914516] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-01 (0.24 seconds). [2025-10-02T21:24:46.993269] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-02T21:24:47.473046] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-10. [2025-10-02T21:24:48.148877] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-02T21:24:48.150287] [INFO ] [REMOTE ] SBSI: Full fetch complete (21256 records). [2025-10-02T21:24:48.150363] [DEBUG] [VALIDATOR ] SBSI: Validating primary data. [2025-10-02T21:24:48.278142] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-02. [2025-10-02T21:24:48.554806] [DEBUG] [VALIDATOR ] SBSI: All expected trading days are present. [2025-10-02T21:24:48.554960] [DEBUG] [VALIDATOR ] SBSI: Primary data validation passed. [2025-10-02T21:24:48.555461] [INFO ] [MAIN ] SBSI: Fetched primary data is valid. [2025-10-02T21:24:48.555507] [DEBUG] [LOCAL ] SBSI: Saving primary data. [2025-10-02T21:24:48.556255] [DEBUG] [LOCAL ] SBSI: Trimmed 21256 records to 14892 (keeping 200 days of data) [2025-10-02T21:24:48.609519] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-02T21:24:48.661503] [DEBUG] [LOCAL ] SBSI: Primary data saved (14892 records). [2025-10-02T21:24:48.661669] [INFO ] [MAIN ] SBSI: Full history saved. [2025-10-02T21:24:48.661776] [INFO ] [MAIN ] Update Progress: 1877/2370 symbols completed. SBSI took 25.7s. Estimated remaining: 1h 9m 32s. Rate: 7.1 symbols/min [2025-10-02T21:24:49.073028] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-03. [2025-10-02T21:24:49.295737] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-03 (0.22 seconds). [2025-10-02T21:24:49.873018] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-04. [2025-10-02T21:24:50.108709] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-04 (0.24 seconds). [2025-10-02T21:24:50.673050] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-09. [2025-10-02T21:24:51.473053] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-04. [2025-10-02T21:24:52.273040] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-05. [2025-10-02T21:24:52.340636] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-02T21:24:52.527363] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-10-02T21:24:53.073020] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-10. [2025-10-02T21:24:53.138264] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-02T21:24:53.872991] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-05. [2025-10-02T21:24:54.113471] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-02T21:24:54.116309] [INFO ] [REMOTE ] SBS: Full fetch complete (70134 records). [2025-10-02T21:24:54.116551] [DEBUG] [VALIDATOR ] SBS: Validating primary data. [2025-10-02T21:24:54.549436] [DEBUG] [VALIDATOR ] SBS: All expected trading days are present. [2025-10-02T21:24:54.549616] [DEBUG] [VALIDATOR ] SBS: Primary data validation passed. [2025-10-02T21:24:54.550733] [INFO ] [MAIN ] SBS: Fetched primary data is valid. [2025-10-02T21:24:54.550797] [DEBUG] [LOCAL ] SBS: Saving primary data. [2025-10-02T21:24:54.552508] [DEBUG] [LOCAL ] SBS: Trimmed 70134 records to 49841 (keeping 200 days of data) [2025-10-02T21:24:54.675181] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-06. [2025-10-02T21:24:54.867361] [DEBUG] [LOCAL ] SBS: Primary data saved (49841 records). [2025-10-02T21:24:54.867554] [INFO ] [MAIN ] SBS: Full history saved. [2025-10-02T21:24:54.867714] [INFO ] [MAIN ] Update Progress: 1878/2370 symbols completed. SBS took 38.5s. Estimated remaining: 1h 9m 23s. Rate: 7.1 symbols/min [2025-10-02T21:24:55.489266] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-02T21:24:55.492538] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-07. [2025-10-02T21:24:55.798468] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-02T21:24:55.832595] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-02T21:24:56.272997] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-08. [2025-10-02T21:24:56.763883] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-02T21:24:57.073009] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-06. [2025-10-02T21:24:57.873088] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-09. [2025-10-02T21:24:58.459944] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-02T21:24:58.672979] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-10. [2025-10-02T21:24:58.914112] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-02T21:24:59.001986] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-02T21:24:59.002694] [INFO ] [REMOTE ] SBXD: Full fetch complete (3092 records). [2025-10-02T21:24:59.002768] [DEBUG] [VALIDATOR ] SBXD: Validating primary data. [2025-10-02T21:24:59.206990] [WARN ] [VALIDATOR ] SBXD: Validation failed - insufficient historical data. Have 174 unique days, need 200 days [2025-10-02T21:24:59.207176] [FATAL] [MAIN ] SBXD: Fetched primary data is invalid. Refusing to save it. [2025-10-02T21:24:59.207247] [WARN ] [MAIN ] SBXD: Deleting existing primary and derivative data due to validation failure. [2025-10-02T21:24:59.207320] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-10-02T21:24:59.207383] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-10-02T21:24:59.207419] [INFO ] [LOCAL ] SBXD: Starting deletion of derivative data. [2025-10-02T21:24:59.207475] [DEBUG] [LOCAL ] SBXD: No derivative data file found to delete. [2025-10-02T21:24:59.207553] [INFO ] [MAIN ] Update Progress: 1879/2370 symbols completed. SBXD took 17.6s. Estimated remaining: 1h 9m 14s. Rate: 7.1 symbols/min [2025-10-02T21:24:59.473018] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-07. [2025-10-02T21:25:01.786302] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-02T21:25:01.799561] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-08. [2025-10-02T21:25:03.488676] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-02T21:25:03.501171] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-09. [2025-10-02T21:25:05.686506] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-02T21:25:05.698612] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-10. [2025-10-02T21:25:07.279349] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-02T21:25:07.281545] [INFO ] [REMOTE ] SBSW: Full fetch complete (76527 records). [2025-10-02T21:25:07.281698] [DEBUG] [VALIDATOR ] SBSW: Validating primary data. [2025-10-02T21:25:07.712178] [DEBUG] [VALIDATOR ] SBSW: All expected trading days are present. [2025-10-02T21:25:07.712281] [DEBUG] [VALIDATOR ] SBSW: Primary data validation passed. [2025-10-02T21:25:07.714099] [INFO ] [MAIN ] SBSW: Fetched primary data is valid. [2025-10-02T21:25:07.714188] [DEBUG] [LOCAL ] SBSW: Saving primary data. [2025-10-02T21:25:07.716432] [DEBUG] [LOCAL ] SBSW: Trimmed 76527 records to 53424 (keeping 200 days of data) [2025-10-02T21:25:08.040112] [DEBUG] [LOCAL ] SBSW: Primary data saved (53424 records). [2025-10-02T21:25:08.040294] [INFO ] [MAIN ] SBSW: Full history saved. [2025-10-02T21:25:08.040411] [INFO ] [MAIN ] Update Progress: 1880/2370 symbols completed. SBSW took 42.2s. Estimated remaining: 1h 9m 5s. Rate: 7.1 symbols/min [2025-10-02T21:25:08.719372] [INFO ] [MAIN ] SCCO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:25:08.763288] [INFO ] [MAIN ] SCD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:25:08.801162] [INFO ] [MAIN ] SCI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:25:08.822966] [INFO ] [MAIN ] SCHW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:25:08.835110] [DEBUG] [LOCAL ] SCD: Loaded 12798 existing records from primary storage. [2025-10-02T21:25:08.835541] [INFO ] [MAIN ] SCD: Loaded 12798 existing records. [2025-10-02T21:25:09.036399] [DEBUG] [LOCAL ] SCCO: Loaded 49412 existing records from primary storage. [2025-10-02T21:25:09.080209] [INFO ] [MAIN ] SCCO: Loaded 49412 existing records. [2025-10-02T21:25:09.138868] [DEBUG] [LOCAL ] SCHW: Loaded 53685 existing records from primary storage. [2025-10-02T21:25:09.189614] [INFO ] [MAIN ] SCHW: Loaded 53685 existing records. [2025-10-02T21:25:09.190356] [DEBUG] [LOCAL ] SCI: Loaded 46432 existing records from primary storage. [2025-10-02T21:25:09.201915] [WARN ] [MAIN ] SCD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:25:09.248723] [INFO ] [MAIN ] SCI: Loaded 46432 existing records. [2025-10-02T21:25:09.248495] [INFO ] [MAIN ] SCD: Wiping existing primary data before full refresh. [2025-10-02T21:25:09.274156] [INFO ] [LOCAL ] SCD: Starting deletion of primary data. [2025-10-02T21:25:09.310489] [DEBUG] [LOCAL ] SCD: Deleted primary data file. [2025-10-02T21:25:09.397590] [INFO ] [MAIN ] SCD: Starting full primary refresh. [2025-10-02T21:25:09.778099] [WARN ] [MAIN ] SCCO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:25:09.815730] [INFO ] [MAIN ] SCCO: Wiping existing primary data before full refresh. [2025-10-02T21:25:09.867846] [INFO ] [LOCAL ] SCCO: Starting deletion of primary data. [2025-10-02T21:25:09.887678] [WARN ] [MAIN ] SCHW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:25:09.933623] [INFO ] [MAIN ] SCHW: Wiping existing primary data before full refresh. [2025-10-02T21:25:09.933517] [WARN ] [MAIN ] SCI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:25:09.949395] [DEBUG] [LOCAL ] SCCO: Deleted primary data file. [2025-10-02T21:25:09.954894] [INFO ] [MAIN ] SCCO: Starting full primary refresh. [2025-10-02T21:25:09.965295] [INFO ] [MAIN ] SCI: Wiping existing primary data before full refresh. [2025-10-02T21:25:09.954824] [INFO ] [LOCAL ] SCHW: Starting deletion of primary data. [2025-10-02T21:25:09.999704] [INFO ] [LOCAL ] SCI: Starting deletion of primary data. [2025-10-02T21:25:10.012824] [DEBUG] [LOCAL ] SCI: Deleted primary data file. [2025-10-02T21:25:10.045705] [DEBUG] [LOCAL ] SCHW: Deleted primary data file. [2025-10-02T21:25:10.045897] [INFO ] [MAIN ] SCHW: Starting full primary refresh. [2025-10-02T21:25:10.040520] [INFO ] [MAIN ] SCI: Starting full primary refresh. [2025-10-02T21:25:10.934797] [INFO ] [REMOTE ] SCD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:25:10.956895] [INFO ] [REMOTE ] SCD: Fetching primary data for 2024-12. [2025-10-02T21:25:11.434861] [INFO ] [REMOTE ] SCHW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:25:11.513500] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2024-12. [2025-10-02T21:25:11.522304] [INFO ] [REMOTE ] SCCO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:25:11.547464] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2024-12. [2025-10-02T21:25:11.546873] [INFO ] [REMOTE ] SCI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:25:11.547908] [INFO ] [REMOTE ] SCI: Fetching primary data for 2024-12. [2025-10-02T21:25:12.048530] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-02T21:25:12.050743] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-01. [2025-10-02T21:25:12.876739] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-02T21:25:12.881578] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-02. [2025-10-02T21:25:13.081554] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-02T21:25:13.093362] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-01. [2025-10-02T21:25:13.124162] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-02T21:25:13.135708] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-01. [2025-10-02T21:25:13.178679] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-02T21:25:13.192032] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-01. [2025-10-02T21:25:13.607024] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-02T21:25:13.609555] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-03. [2025-10-02T21:25:14.137901] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-02T21:25:14.140412] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-04. [2025-10-02T21:25:14.472378] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-02T21:25:14.483132] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-02. [2025-10-02T21:25:14.546578] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-02T21:25:14.557428] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-02. [2025-10-02T21:25:14.916196] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-02T21:25:14.919895] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-05. [2025-10-02T21:25:15.050352] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-02T21:25:15.061901] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-02. [2025-10-02T21:25:15.482181] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-02T21:25:15.484631] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-06. [2025-10-02T21:25:16.123818] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-02T21:25:16.127839] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-07. [2025-10-02T21:25:16.174477] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-02T21:25:16.210039] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-02T21:25:16.272986] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-03. [2025-10-02T21:25:16.924760] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-02T21:25:17.073082] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-03. [2025-10-02T21:25:17.343874] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-02T21:25:17.878481] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-03. [2025-10-02T21:25:17.899519] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-02T21:25:18.672978] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-08. [2025-10-02T21:25:18.724295] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-02T21:25:19.478149] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-04. [2025-10-02T21:25:19.485766] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-02T21:25:19.544725] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-02T21:25:20.273003] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-09. [2025-10-02T21:25:21.072986] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-04. [2025-10-02T21:25:21.090065] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-02T21:25:21.312634] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-02T21:25:21.873028] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-05. [2025-10-02T21:25:22.673004] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-10. [2025-10-02T21:25:23.034503] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-02T21:25:23.337826] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-02T21:25:23.379194] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-02T21:25:23.380235] [INFO ] [REMOTE ] SCD: Full fetch complete (16530 records). [2025-10-02T21:25:23.380308] [DEBUG] [VALIDATOR ] SCD: Validating primary data. [2025-10-02T21:25:23.478193] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-06. [2025-10-02T21:25:23.783411] [DEBUG] [VALIDATOR ] SCD: All expected trading days are present. [2025-10-02T21:25:23.783497] [DEBUG] [VALIDATOR ] SCD: Primary data validation passed. [2025-10-02T21:25:23.783878] [INFO ] [MAIN ] SCD: Fetched primary data is valid. [2025-10-02T21:25:23.783943] [DEBUG] [LOCAL ] SCD: Saving primary data. [2025-10-02T21:25:23.784489] [DEBUG] [LOCAL ] SCD: Trimmed 16530 records to 12919 (keeping 200 days of data) [2025-10-02T21:25:23.875697] [DEBUG] [LOCAL ] SCD: Primary data saved (12919 records). [2025-10-02T21:25:23.875853] [INFO ] [MAIN ] SCD: Full history saved. [2025-10-02T21:25:23.875966] [INFO ] [MAIN ] Update Progress: 1881/2370 symbols completed. SCD took 15.8s. Estimated remaining: 1h 8m 59s. Rate: 7.1 symbols/min [2025-10-02T21:25:24.065254] [INFO ] [MAIN ] SCL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:25:24.083580] [DEBUG] [LOCAL ] SCL: Loaded 14887 existing records from primary storage. [2025-10-02T21:25:24.083872] [INFO ] [MAIN ] SCL: Loaded 14887 existing records. [2025-10-02T21:25:24.276358] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-04. [2025-10-02T21:25:24.280338] [WARN ] [MAIN ] SCL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:25:24.281670] [INFO ] [MAIN ] SCL: Wiping existing primary data before full refresh. [2025-10-02T21:25:24.281753] [INFO ] [LOCAL ] SCL: Starting deletion of primary data. [2025-10-02T21:25:24.281958] [DEBUG] [LOCAL ] SCL: Deleted primary data file. [2025-10-02T21:25:24.282018] [INFO ] [MAIN ] SCL: Starting full primary refresh. [2025-10-02T21:25:24.690220] [INFO ] [REMOTE ] SCL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:25:25.003804] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-02T21:25:25.073037] [INFO ] [REMOTE ] SCL: Fetching primary data for 2024-12. [2025-10-02T21:25:25.873016] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-05. [2025-10-02T21:25:25.921616] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-02T21:25:26.361922] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-02T21:25:26.673000] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-01. [2025-10-02T21:25:27.472975] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-07. [2025-10-02T21:25:27.650964] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-02T21:25:27.672455] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-02T21:25:28.273000] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-06. [2025-10-02T21:25:29.073016] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-02. [2025-10-02T21:25:29.184822] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-02T21:25:29.711611] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-02T21:25:29.872990] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-05. [2025-10-02T21:25:29.992987] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-02T21:25:30.672998] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-08. [2025-10-02T21:25:31.473014] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-03. [2025-10-02T21:25:31.888541] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-02T21:25:32.014798] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-02T21:25:32.272982] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-09. [2025-10-02T21:25:32.461278] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-02T21:25:33.073008] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-04. [2025-10-02T21:25:33.550709] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-02T21:25:33.873003] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-06. [2025-10-02T21:25:34.153941] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-02T21:25:34.673000] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-05. [2025-10-02T21:25:35.473005] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-10. [2025-10-02T21:25:35.673040] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-02T21:25:35.706768] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-02T21:25:36.272993] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-07. [2025-10-02T21:25:36.611863] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-02T21:25:36.613809] [INFO ] [REMOTE ] SCI: Full fetch complete (67337 records). [2025-10-02T21:25:36.614035] [DEBUG] [VALIDATOR ] SCI: Validating primary data. [2025-10-02T21:25:37.057243] [DEBUG] [VALIDATOR ] SCI: All expected trading days are present. [2025-10-02T21:25:37.057357] [DEBUG] [VALIDATOR ] SCI: Primary data validation passed. [2025-10-02T21:25:37.059061] [INFO ] [MAIN ] SCI: Fetched primary data is valid. [2025-10-02T21:25:37.059147] [DEBUG] [LOCAL ] SCI: Saving primary data. [2025-10-02T21:25:37.061267] [DEBUG] [LOCAL ] SCI: Trimmed 67337 records to 46770 (keeping 200 days of data) [2025-10-02T21:25:37.072982] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-07. [2025-10-02T21:25:37.388287] [DEBUG] [LOCAL ] SCI: Primary data saved (46770 records). [2025-10-02T21:25:37.388433] [INFO ] [MAIN ] SCI: Full history saved. [2025-10-02T21:25:37.388533] [INFO ] [MAIN ] Update Progress: 1882/2370 symbols completed. SCI took 29.3s. Estimated remaining: 1h 8m 52s. Rate: 7.1 symbols/min [2025-10-02T21:25:37.591300] [INFO ] [MAIN ] SCM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:25:37.614752] [DEBUG] [LOCAL ] SCM: Loaded 19787 existing records from primary storage. [2025-10-02T21:25:37.615032] [INFO ] [MAIN ] SCM: Loaded 19787 existing records. [2025-10-02T21:25:37.829850] [WARN ] [MAIN ] SCM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:25:37.830233] [INFO ] [MAIN ] SCM: Wiping existing primary data before full refresh. [2025-10-02T21:25:37.830389] [INFO ] [LOCAL ] SCM: Starting deletion of primary data. [2025-10-02T21:25:37.830788] [DEBUG] [LOCAL ] SCM: Deleted primary data file. [2025-10-02T21:25:37.830978] [INFO ] [MAIN ] SCM: Starting full primary refresh. [2025-10-02T21:25:37.878141] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-06. [2025-10-02T21:25:38.162909] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-02T21:25:38.292798] [INFO ] [REMOTE ] SCM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:25:38.673038] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-08. [2025-10-02T21:25:38.793113] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-02T21:25:39.301924] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-02T21:25:39.473046] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-07. [2025-10-02T21:25:40.021802] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-02T21:25:40.052062] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-02T21:25:40.273015] [INFO ] [REMOTE ] SCM: Fetching primary data for 2024-12. [2025-10-02T21:25:41.053053] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-02T21:25:41.072954] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-01. [2025-10-02T21:25:41.872996] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-09. [2025-10-02T21:25:42.076002] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-02T21:25:42.673005] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-02. [2025-10-02T21:25:43.473035] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-08. [2025-10-02T21:25:43.656841] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-02T21:25:43.687762] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-02T21:25:44.107527] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-02T21:25:44.272996] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-09. [2025-10-02T21:25:45.072993] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-03. [2025-10-02T21:25:45.272125] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-02T21:25:45.873280] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-08. [2025-10-02T21:25:46.297848] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-02T21:25:46.673005] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-04. [2025-10-02T21:25:47.473060] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-10. [2025-10-02T21:25:47.535122] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-02T21:25:47.681179] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-02T21:25:48.272994] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-05. [2025-10-02T21:25:48.879476] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-02T21:25:48.881629] [INFO ] [REMOTE ] SCCO: Full fetch complete (70934 records). [2025-10-02T21:25:48.881814] [DEBUG] [VALIDATOR ] SCCO: Validating primary data. [2025-10-02T21:25:49.078105] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-10. [2025-10-02T21:25:49.323922] [DEBUG] [VALIDATOR ] SCCO: All expected trading days are present. [2025-10-02T21:25:49.324066] [DEBUG] [VALIDATOR ] SCCO: Primary data validation passed. [2025-10-02T21:25:49.325362] [INFO ] [MAIN ] SCCO: Fetched primary data is valid. [2025-10-02T21:25:49.330687] [DEBUG] [LOCAL ] SCCO: Saving primary data. [2025-10-02T21:25:49.337392] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-02T21:25:49.342819] [DEBUG] [LOCAL ] SCCO: Trimmed 70934 records to 49786 (keeping 200 days of data) [2025-10-02T21:25:49.689673] [DEBUG] [LOCAL ] SCCO: Primary data saved (49786 records). [2025-10-02T21:25:49.689820] [INFO ] [MAIN ] SCCO: Full history saved. [2025-10-02T21:25:49.689956] [INFO ] [MAIN ] Update Progress: 1883/2370 symbols completed. SCCO took 41.6s. Estimated remaining: 1h 8m 44s. Rate: 7.1 symbols/min [2025-10-02T21:25:49.819329] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-02T21:25:49.841705] [INFO ] [REMOTE ] SCL: Full fetch complete (21293 records). [2025-10-02T21:25:49.859407] [DEBUG] [VALIDATOR ] SCL: Validating primary data. [2025-10-02T21:25:49.874125] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-06. [2025-10-02T21:25:49.905017] [INFO ] [MAIN ] SCS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:25:50.270126] [DEBUG] [LOCAL ] SCS: Loaded 43438 existing records from primary storage. [2025-10-02T21:25:50.294564] [INFO ] [MAIN ] SCS: Loaded 43438 existing records. [2025-10-02T21:25:50.433782] [DEBUG] [VALIDATOR ] SCL: All expected trading days are present. [2025-10-02T21:25:50.459578] [DEBUG] [VALIDATOR ] SCL: Primary data validation passed. [2025-10-02T21:25:50.460499] [INFO ] [MAIN ] SCL: Fetched primary data is valid. [2025-10-02T21:25:50.466006] [DEBUG] [LOCAL ] SCL: Saving primary data. [2025-10-02T21:25:50.510287] [DEBUG] [LOCAL ] SCL: Trimmed 21293 records to 15009 (keeping 200 days of data) [2025-10-02T21:25:50.559483] [WARN ] [MAIN ] SCS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:25:50.559757] [INFO ] [MAIN ] SCS: Wiping existing primary data before full refresh. [2025-10-02T21:25:50.559824] [INFO ] [LOCAL ] SCS: Starting deletion of primary data. [2025-10-02T21:25:50.560059] [DEBUG] [LOCAL ] SCS: Deleted primary data file. [2025-10-02T21:25:50.560120] [INFO ] [MAIN ] SCS: Starting full primary refresh. [2025-10-02T21:25:50.676604] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-09. [2025-10-02T21:25:51.044551] [INFO ] [REMOTE ] SCS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:25:51.059532] [DEBUG] [LOCAL ] SCL: Primary data saved (15009 records). [2025-10-02T21:25:51.059711] [INFO ] [MAIN ] SCL: Full history saved. [2025-10-02T21:25:51.059813] [INFO ] [MAIN ] Update Progress: 1884/2370 symbols completed. SCL took 27.2s. Estimated remaining: 1h 8m 34s. Rate: 7.1 symbols/min [2025-10-02T21:25:51.200802] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-02T21:25:51.263034] [INFO ] [MAIN ] SD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:25:51.295915] [DEBUG] [LOCAL ] SD: Loaded 28680 existing records from primary storage. [2025-10-02T21:25:51.296243] [INFO ] [MAIN ] SD: Loaded 28680 existing records. [2025-10-02T21:25:51.475100] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-07. [2025-10-02T21:25:51.499693] [WARN ] [MAIN ] SD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:25:51.500810] [INFO ] [MAIN ] SD: Wiping existing primary data before full refresh. [2025-10-02T21:25:51.500861] [INFO ] [LOCAL ] SD: Starting deletion of primary data. [2025-10-02T21:25:51.501098] [DEBUG] [LOCAL ] SD: Deleted primary data file. [2025-10-02T21:25:51.501156] [INFO ] [MAIN ] SD: Starting full primary refresh. [2025-10-02T21:25:51.886621] [INFO ] [REMOTE ] SD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:25:52.273024] [INFO ] [REMOTE ] SD: Fetching primary data for 2024-12. [2025-10-02T21:25:52.751035] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-02T21:25:52.777115] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-02T21:25:53.073015] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-10. [2025-10-02T21:25:53.576110] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-02T21:25:53.873027] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-01. [2025-10-02T21:25:54.412944] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-02T21:25:54.415319] [INFO ] [REMOTE ] SCHW: Full fetch complete (77704 records). [2025-10-02T21:25:54.415447] [DEBUG] [VALIDATOR ] SCHW: Validating primary data. [2025-10-02T21:25:54.683146] [INFO ] [REMOTE ] SCS: Fetching primary data for 2024-12. [2025-10-02T21:25:54.851693] [DEBUG] [VALIDATOR ] SCHW: All expected trading days are present. [2025-10-02T21:25:54.851786] [DEBUG] [VALIDATOR ] SCHW: Primary data validation passed. [2025-10-02T21:25:54.852892] [INFO ] [MAIN ] SCHW: Fetched primary data is valid. [2025-10-02T21:25:54.852957] [DEBUG] [LOCAL ] SCHW: Saving primary data. [2025-10-02T21:25:54.854465] [DEBUG] [LOCAL ] SCHW: Trimmed 77704 records to 54075 (keeping 200 days of data) [2025-10-02T21:25:55.125032] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-02T21:25:55.257737] [DEBUG] [LOCAL ] SCHW: Primary data saved (54075 records). [2025-10-02T21:25:55.257884] [INFO ] [MAIN ] SCHW: Full history saved. [2025-10-02T21:25:55.258981] [INFO ] [MAIN ] Update Progress: 1885/2370 symbols completed. SCHW took 47.2s. Estimated remaining: 1h 8m 24s. Rate: 7.1 symbols/min [2025-10-02T21:25:55.448313] [INFO ] [MAIN ] SDHC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:25:55.470770] [DEBUG] [LOCAL ] SDHC: Loaded 10361 existing records from primary storage. [2025-10-02T21:25:55.471018] [INFO ] [MAIN ] SDHC: Loaded 10361 existing records. [2025-10-02T21:25:55.482683] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-02. [2025-10-02T21:25:55.676363] [WARN ] [MAIN ] SDHC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:25:55.676628] [INFO ] [MAIN ] SDHC: Wiping existing primary data before full refresh. [2025-10-02T21:25:55.676728] [INFO ] [LOCAL ] SDHC: Starting deletion of primary data. [2025-10-02T21:25:55.676951] [DEBUG] [LOCAL ] SDHC: Deleted primary data file. [2025-10-02T21:25:55.677021] [INFO ] [MAIN ] SDHC: Starting full primary refresh. [2025-10-02T21:25:56.063236] [INFO ] [REMOTE ] SDHC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:25:56.278204] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-08. [2025-10-02T21:25:56.293105] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-02T21:25:56.690396] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-02T21:25:57.072997] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2024-12. [2025-10-02T21:25:57.302861] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-02T21:25:57.872973] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-01. [2025-10-02T21:25:58.073067] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-02T21:25:58.673024] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-03. [2025-10-02T21:25:59.298683] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-02T21:25:59.473032] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-09. [2025-10-02T21:25:59.687466] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-02T21:26:00.273020] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-04. [2025-10-02T21:26:00.620798] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-02T21:26:01.073045] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-02. [2025-10-02T21:26:01.410760] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-02T21:26:01.873018] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-05. [2025-10-02T21:26:02.529728] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-02T21:26:02.673017] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-01. [2025-10-02T21:26:03.261322] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-02T21:26:03.472972] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-03. [2025-10-02T21:26:03.616611] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-02T21:26:04.273148] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-10. [2025-10-02T21:26:04.921323] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-02T21:26:05.073019] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-06. [2025-10-02T21:26:05.138764] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-02T21:26:05.140454] [INFO ] [REMOTE ] SCM: Full fetch complete (28708 records). [2025-10-02T21:26:05.140605] [DEBUG] [VALIDATOR ] SCM: Validating primary data. [2025-10-02T21:26:05.622595] [DEBUG] [VALIDATOR ] SCM: All expected trading days are present. [2025-10-02T21:26:05.622725] [DEBUG] [VALIDATOR ] SCM: Primary data validation passed. [2025-10-02T21:26:05.623457] [INFO ] [MAIN ] SCM: Fetched primary data is valid. [2025-10-02T21:26:05.623532] [DEBUG] [LOCAL ] SCM: Saving primary data. [2025-10-02T21:26:05.624723] [DEBUG] [LOCAL ] SCM: Trimmed 28708 records to 19959 (keeping 200 days of data) [2025-10-02T21:26:05.768447] [DEBUG] [LOCAL ] SCM: Primary data saved (19959 records). [2025-10-02T21:26:05.768614] [INFO ] [MAIN ] SCM: Full history saved. [2025-10-02T21:26:05.768810] [INFO ] [MAIN ] Update Progress: 1886/2370 symbols completed. SCM took 28.4s. Estimated remaining: 1h 8m 16s. Rate: 7.1 symbols/min [2025-10-02T21:26:05.878154] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-04. [2025-10-02T21:26:05.971884] [INFO ] [MAIN ] SDHY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:26:05.985848] [DEBUG] [LOCAL ] SDHY: Loaded 10584 existing records from primary storage. [2025-10-02T21:26:05.986150] [INFO ] [MAIN ] SDHY: Loaded 10584 existing records. [2025-10-02T21:26:06.186166] [WARN ] [MAIN ] SDHY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:26:06.186592] [INFO ] [MAIN ] SDHY: Wiping existing primary data before full refresh. [2025-10-02T21:26:06.186785] [INFO ] [LOCAL ] SDHY: Starting deletion of primary data. [2025-10-02T21:26:06.187032] [DEBUG] [LOCAL ] SDHY: Deleted primary data file. [2025-10-02T21:26:06.187119] [INFO ] [MAIN ] SDHY: Starting full primary refresh. [2025-10-02T21:26:06.501244] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-02T21:26:06.642976] [INFO ] [REMOTE ] SDHY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:26:06.673020] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2024-12. [2025-10-02T21:26:07.472986] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-07. [2025-10-02T21:26:07.573347] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-02T21:26:07.634811] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-02T21:26:08.272995] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-01. [2025-10-02T21:26:08.762618] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-02T21:26:09.043397] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-02T21:26:09.072982] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-02. [2025-10-02T21:26:09.843623] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-02T21:26:09.872998] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-02. [2025-10-02T21:26:10.672974] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-08. [2025-10-02T21:26:10.696094] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-02T21:26:11.473048] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-03. [2025-10-02T21:26:12.002988] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-02T21:26:12.190748] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-02T21:26:12.273036] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-04. [2025-10-02T21:26:13.073051] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-03. [2025-10-02T21:26:13.242102] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-02T21:26:13.873029] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-09. [2025-10-02T21:26:13.981007] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-02T21:26:14.673038] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-05. [2025-10-02T21:26:14.788015] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-02T21:26:15.442874] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-02T21:26:15.473005] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-10. [2025-10-02T21:26:16.264697] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-02T21:26:16.266196] [INFO ] [REMOTE ] SD: Full fetch complete (40989 records). [2025-10-02T21:26:16.266312] [DEBUG] [VALIDATOR ] SD: Validating primary data. [2025-10-02T21:26:16.278213] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-04. [2025-10-02T21:26:16.694600] [DEBUG] [VALIDATOR ] SD: All expected trading days are present. [2025-10-02T21:26:16.694736] [DEBUG] [VALIDATOR ] SD: Primary data validation passed. [2025-10-02T21:26:16.695716] [INFO ] [MAIN ] SD: Fetched primary data is valid. [2025-10-02T21:26:16.695787] [DEBUG] [LOCAL ] SD: Saving primary data. [2025-10-02T21:26:16.696871] [DEBUG] [LOCAL ] SD: Trimmed 40989 records to 28887 (keeping 200 days of data) [2025-10-02T21:26:16.886380] [DEBUG] [LOCAL ] SD: Primary data saved (28887 records). [2025-10-02T21:26:16.886529] [INFO ] [MAIN ] SD: Full history saved. [2025-10-02T21:26:16.886636] [INFO ] [MAIN ] Update Progress: 1887/2370 symbols completed. SD took 25.8s. Estimated remaining: 1h 8m 8s. Rate: 7.1 symbols/min [2025-10-02T21:26:17.075181] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-05. [2025-10-02T21:26:17.075112] [INFO ] [MAIN ] SDRL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:26:17.116799] [DEBUG] [LOCAL ] SDRL: Loaded 41610 existing records from primary storage. [2025-10-02T21:26:17.117409] [INFO ] [MAIN ] SDRL: Loaded 41610 existing records. [2025-10-02T21:26:17.236393] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-02T21:26:17.324002] [WARN ] [MAIN ] SDRL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:26:17.324362] [INFO ] [MAIN ] SDRL: Wiping existing primary data before full refresh. [2025-10-02T21:26:17.324479] [INFO ] [LOCAL ] SDRL: Starting deletion of primary data. [2025-10-02T21:26:17.324861] [DEBUG] [LOCAL ] SDRL: Deleted primary data file. [2025-10-02T21:26:17.324954] [INFO ] [MAIN ] SDRL: Starting full primary refresh. [2025-10-02T21:26:17.733817] [INFO ] [REMOTE ] SDRL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:26:17.872992] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-06. [2025-10-02T21:26:18.483720] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-02T21:26:18.619726] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-02T21:26:18.672993] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-05. [2025-10-02T21:26:19.475287] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2024-12. [2025-10-02T21:26:19.477668] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-02T21:26:20.273037] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-06. [2025-10-02T21:26:21.078137] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-07. [2025-10-02T21:26:21.098528] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-02T21:26:21.401247] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-02T21:26:21.878225] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-07. [2025-10-02T21:26:21.881443] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-02T21:26:22.673012] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-06. [2025-10-02T21:26:23.122959] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-02T21:26:23.421145] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-02T21:26:23.473026] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-07. [2025-10-02T21:26:24.028302] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-02T21:26:24.273010] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-08. [2025-10-02T21:26:25.073019] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-08. [2025-10-02T21:26:25.782788] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-02T21:26:25.872989] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-09. [2025-10-02T21:26:26.075781] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-02T21:26:26.382388] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-02T21:26:26.673027] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-10. [2025-10-02T21:26:27.197965] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-02T21:26:27.198924] [INFO ] [REMOTE ] SDHY: Full fetch complete (15752 records). [2025-10-02T21:26:27.198999] [DEBUG] [VALIDATOR ] SDHY: Validating primary data. [2025-10-02T21:26:27.478109] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-08. [2025-10-02T21:26:27.599246] [DEBUG] [VALIDATOR ] SDHY: All expected trading days are present. [2025-10-02T21:26:27.599327] [DEBUG] [VALIDATOR ] SDHY: Primary data validation passed. [2025-10-02T21:26:27.599727] [INFO ] [MAIN ] SDHY: Fetched primary data is valid. [2025-10-02T21:26:27.599788] [DEBUG] [LOCAL ] SDHY: Saving primary data. [2025-10-02T21:26:27.600322] [DEBUG] [LOCAL ] SDHY: Trimmed 15752 records to 10624 (keeping 200 days of data) [2025-10-02T21:26:27.673316] [DEBUG] [LOCAL ] SDHY: Primary data saved (10624 records). [2025-10-02T21:26:27.673447] [INFO ] [MAIN ] SDHY: Full history saved. [2025-10-02T21:26:27.673532] [INFO ] [MAIN ] Update Progress: 1888/2370 symbols completed. SDHY took 21.9s. Estimated remaining: 1h 8m 1s. Rate: 7.1 symbols/min [2025-10-02T21:26:27.868257] [INFO ] [MAIN ] SE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:26:27.923549] [DEBUG] [LOCAL ] SE: Loaded 53362 existing records from primary storage. [2025-10-02T21:26:27.923936] [INFO ] [MAIN ] SE: Loaded 53362 existing records. [2025-10-02T21:26:28.120981] [WARN ] [MAIN ] SE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:26:28.121204] [INFO ] [MAIN ] SE: Wiping existing primary data before full refresh. [2025-10-02T21:26:28.121279] [INFO ] [LOCAL ] SE: Starting deletion of primary data. [2025-10-02T21:26:28.121592] [DEBUG] [LOCAL ] SE: Deleted primary data file. [2025-10-02T21:26:28.121684] [INFO ] [MAIN ] SE: Starting full primary refresh. [2025-10-02T21:26:28.280709] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-09. [2025-10-02T21:26:28.422782] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-02T21:26:28.562623] [INFO ] [REMOTE ] SE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:26:29.072999] [INFO ] [REMOTE ] SE: Fetching primary data for 2024-12. [2025-10-02T21:26:29.872976] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-01. [2025-10-02T21:26:29.911738] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-02T21:26:30.673006] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-09. [2025-10-02T21:26:31.141388] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-02T21:26:31.473343] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-01. [2025-10-02T21:26:31.476193] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-02T21:26:31.521069] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-02T21:26:32.273017] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-10. [2025-10-02T21:26:33.073004] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-02. [2025-10-02T21:26:33.357394] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-02T21:26:33.531084] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-02T21:26:33.533492] [INFO ] [REMOTE ] SCS: Full fetch complete (60800 records). [2025-10-02T21:26:33.533608] [DEBUG] [VALIDATOR ] SCS: Validating primary data. [2025-10-02T21:26:33.878158] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-02. [2025-10-02T21:26:33.993818] [DEBUG] [VALIDATOR ] SCS: All expected trading days are present. [2025-10-02T21:26:33.993904] [DEBUG] [VALIDATOR ] SCS: Primary data validation passed. [2025-10-02T21:26:33.995066] [INFO ] [MAIN ] SCS: Fetched primary data is valid. [2025-10-02T21:26:33.995134] [DEBUG] [LOCAL ] SCS: Saving primary data. [2025-10-02T21:26:33.996850] [DEBUG] [LOCAL ] SCS: Trimmed 60800 records to 43770 (keeping 200 days of data) [2025-10-02T21:26:34.288991] [DEBUG] [LOCAL ] SCS: Primary data saved (43770 records). [2025-10-02T21:26:34.289372] [INFO ] [MAIN ] SCS: Full history saved. [2025-10-02T21:26:34.289488] [INFO ] [MAIN ] Update Progress: 1889/2370 symbols completed. SCS took 44.6s. Estimated remaining: 1h 7m 52s. Rate: 7.1 symbols/min [2025-10-02T21:26:34.472395] [INFO ] [MAIN ] SEE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:26:34.524471] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-02T21:26:34.552355] [DEBUG] [LOCAL ] SEE: Loaded 48272 existing records from primary storage. [2025-10-02T21:26:34.552725] [INFO ] [MAIN ] SEE: Loaded 48272 existing records. [2025-10-02T21:26:34.678215] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-10. [2025-10-02T21:26:34.746587] [WARN ] [MAIN ] SEE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:26:34.746823] [INFO ] [MAIN ] SEE: Wiping existing primary data before full refresh. [2025-10-02T21:26:34.746875] [INFO ] [LOCAL ] SEE: Starting deletion of primary data. [2025-10-02T21:26:34.747585] [DEBUG] [LOCAL ] SEE: Deleted primary data file. [2025-10-02T21:26:34.747697] [INFO ] [MAIN ] SEE: Starting full primary refresh. [2025-10-02T21:26:35.135683] [INFO ] [REMOTE ] SEE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:26:35.240083] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-02T21:26:35.241362] [INFO ] [REMOTE ] SDHC: Full fetch complete (17207 records). [2025-10-02T21:26:35.241451] [DEBUG] [VALIDATOR ] SDHC: Validating primary data. [2025-10-02T21:26:35.478274] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-03. [2025-10-02T21:26:35.683246] [DEBUG] [VALIDATOR ] SDHC: All expected trading days are present. [2025-10-02T21:26:35.683351] [DEBUG] [VALIDATOR ] SDHC: Primary data validation passed. [2025-10-02T21:26:35.683885] [INFO ] [MAIN ] SDHC: Fetched primary data is valid. [2025-10-02T21:26:35.684007] [DEBUG] [LOCAL ] SDHC: Saving primary data. [2025-10-02T21:26:35.684742] [DEBUG] [LOCAL ] SDHC: Trimmed 17207 records to 10414 (keeping 200 days of data) [2025-10-02T21:26:35.756306] [DEBUG] [LOCAL ] SDHC: Primary data saved (10414 records). [2025-10-02T21:26:35.756450] [INFO ] [MAIN ] SDHC: Full history saved. [2025-10-02T21:26:35.756541] [INFO ] [MAIN ] Update Progress: 1890/2370 symbols completed. SDHC took 40.5s. Estimated remaining: 1h 7m 41s. Rate: 7.1 symbols/min [2025-10-02T21:26:35.953364] [INFO ] [MAIN ] SEG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:26:35.988396] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-02T21:26:36.005256] [DEBUG] [LOCAL ] SEG: Loaded 13650 existing records from primary storage. [2025-10-02T21:26:36.005508] [INFO ] [MAIN ] SEG: Loaded 13650 existing records. [2025-10-02T21:26:36.210488] [WARN ] [MAIN ] SEG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:26:36.210793] [INFO ] [MAIN ] SEG: Wiping existing primary data before full refresh. [2025-10-02T21:26:36.210845] [INFO ] [LOCAL ] SEG: Starting deletion of primary data. [2025-10-02T21:26:36.211070] [DEBUG] [LOCAL ] SEG: Deleted primary data file. [2025-10-02T21:26:36.211128] [INFO ] [MAIN ] SEG: Starting full primary refresh. [2025-10-02T21:26:36.278169] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-03. [2025-10-02T21:26:36.586204] [INFO ] [REMOTE ] SEG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:26:37.072962] [INFO ] [REMOTE ] SEG: Fetching primary data for 2024-12. [2025-10-02T21:26:37.177189] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-02T21:26:37.873034] [INFO ] [REMOTE ] SEE: Fetching primary data for 2024-12. [2025-10-02T21:26:37.909315] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-02T21:26:38.518339] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-10-02T21:26:38.673032] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-04. [2025-10-02T21:26:39.423344] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-02T21:26:39.473044] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-04. [2025-10-02T21:26:40.273048] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-01. [2025-10-02T21:26:40.825328] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-02T21:26:40.846564] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-02T21:26:41.075216] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-01. [2025-10-02T21:26:41.081068] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-02T21:26:41.873008] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-05. [2025-10-02T21:26:42.567014] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-02T21:26:42.673042] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-02. [2025-10-02T21:26:43.040320] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-02T21:26:43.382152] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-02T21:26:43.473032] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-02. [2025-10-02T21:26:44.273039] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-03. [2025-10-02T21:26:45.050254] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-02T21:26:45.072973] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-03. [2025-10-02T21:26:45.291466] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-02T21:26:45.872983] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-06. [2025-10-02T21:26:46.673004] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-05. [2025-10-02T21:26:46.862679] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-02T21:26:47.315484] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-02T21:26:47.473027] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-04. [2025-10-02T21:26:48.273020] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-07. [2025-10-02T21:26:48.532505] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-02T21:26:49.016252] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-10-02T21:26:49.072975] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-06. [2025-10-02T21:26:49.683435] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-02T21:26:49.873004] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-08. [2025-10-02T21:26:50.673017] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-04. [2025-10-02T21:26:51.079813] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-02T21:26:51.320117] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-02T21:26:51.473011] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-05. [2025-10-02T21:26:52.272984] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-07. [2025-10-02T21:26:52.308804] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-02T21:26:52.450101] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-02T21:26:53.073004] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-05. [2025-10-02T21:26:53.873023] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-06. [2025-10-02T21:26:54.504511] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-02T21:26:54.592718] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-02T21:26:54.673041] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-08. [2025-10-02T21:26:54.727805] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-02T21:26:55.473001] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-07. [2025-10-02T21:26:56.272995] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-06. [2025-10-02T21:26:56.300960] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-02T21:26:56.514294] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-02T21:26:57.072996] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-09. [2025-10-02T21:26:57.873970] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-08. [2025-10-02T21:26:57.873865] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-02T21:26:58.521333] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-02T21:26:58.673037] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-09. [2025-10-02T21:26:58.860999] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-02T21:26:59.473019] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-10. [2025-10-02T21:27:00.272996] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-07. [2025-10-02T21:27:00.601775] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-02T21:27:00.603577] [INFO ] [REMOTE ] SDRL: Full fetch complete (61607 records). [2025-10-02T21:27:00.603708] [DEBUG] [VALIDATOR ] SDRL: Validating primary data. [2025-10-02T21:27:00.978703] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-10-02T21:27:01.084701] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-09. [2025-10-02T21:27:01.087958] [DEBUG] [VALIDATOR ] SDRL: All expected trading days are present. [2025-10-02T21:27:01.088124] [DEBUG] [VALIDATOR ] SDRL: Primary data validation passed. [2025-10-02T21:27:01.090213] [INFO ] [MAIN ] SDRL: Fetched primary data is valid. [2025-10-02T21:27:01.090421] [DEBUG] [LOCAL ] SDRL: Saving primary data. [2025-10-02T21:27:01.091813] [DEBUG] [LOCAL ] SDRL: Trimmed 61607 records to 41889 (keeping 200 days of data) [2025-10-02T21:27:01.359019] [DEBUG] [LOCAL ] SDRL: Primary data saved (41889 records). [2025-10-02T21:27:01.359147] [INFO ] [MAIN ] SDRL: Full history saved. [2025-10-02T21:27:01.359230] [INFO ] [MAIN ] Update Progress: 1891/2370 symbols completed. SDRL took 44.5s. Estimated remaining: 1h 7m 37s. Rate: 7.1 symbols/min [2025-10-02T21:27:01.545434] [INFO ] [MAIN ] SEI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:27:01.591665] [DEBUG] [LOCAL ] SEI: Loaded 49654 existing records from primary storage. [2025-10-02T21:27:01.591996] [INFO ] [MAIN ] SEI: Loaded 49654 existing records. [2025-10-02T21:27:01.789613] [WARN ] [MAIN ] SEI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:27:01.790202] [INFO ] [MAIN ] SEI: Wiping existing primary data before full refresh. [2025-10-02T21:27:01.790357] [INFO ] [LOCAL ] SEI: Starting deletion of primary data. [2025-10-02T21:27:01.790638] [DEBUG] [LOCAL ] SEI: Deleted primary data file. [2025-10-02T21:27:01.790733] [INFO ] [MAIN ] SEI: Starting full primary refresh. [2025-10-02T21:27:01.897521] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-10. [2025-10-02T21:27:02.093261] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-02T21:27:02.182494] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-02T21:27:02.254579] [INFO ] [REMOTE ] SEI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:27:02.672995] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-10. [2025-10-02T21:27:03.186959] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-02T21:27:03.187946] [INFO ] [REMOTE ] SEG: Full fetch complete (19827 records). [2025-10-02T21:27:03.188019] [DEBUG] [VALIDATOR ] SEG: Validating primary data. [2025-10-02T21:27:03.474058] [INFO ] [REMOTE ] SEI: Fetching primary data for 2024-12. [2025-10-02T21:27:03.599520] [DEBUG] [VALIDATOR ] SEG: All expected trading days are present. [2025-10-02T21:27:03.599323] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-02T21:27:03.599705] [DEBUG] [VALIDATOR ] SEG: Primary data validation passed. [2025-10-02T21:27:03.601967] [INFO ] [MAIN ] SEG: Fetched primary data is valid. [2025-10-02T21:27:03.602166] [DEBUG] [LOCAL ] SEG: Saving primary data. [2025-10-02T21:27:03.602684] [INFO ] [REMOTE ] SE: Full fetch complete (77075 records). [2025-10-02T21:27:03.602907] [DEBUG] [VALIDATOR ] SE: Validating primary data. [2025-10-02T21:27:03.603247] [DEBUG] [LOCAL ] SEG: Trimmed 19827 records to 13706 (keeping 200 days of data) [2025-10-02T21:27:04.118445] [DEBUG] [VALIDATOR ] SE: All expected trading days are present. [2025-10-02T21:27:04.118850] [DEBUG] [VALIDATOR ] SE: Primary data validation passed. [2025-10-02T21:27:04.120563] [INFO ] [MAIN ] SE: Fetched primary data is valid. [2025-10-02T21:27:04.120982] [DEBUG] [LOCAL ] SE: Saving primary data. [2025-10-02T21:27:04.126002] [DEBUG] [LOCAL ] SE: Trimmed 77075 records to 53751 (keeping 200 days of data) [2025-10-02T21:27:04.193113] [DEBUG] [LOCAL ] SEG: Primary data saved (13706 records). [2025-10-02T21:27:04.219054] [INFO ] [MAIN ] SEG: Full history saved. [2025-10-02T21:27:04.219409] [INFO ] [MAIN ] Update Progress: 1892/2370 symbols completed. SEG took 28.5s. Estimated remaining: 1h 7m 27s. Rate: 7.1 symbols/min [2025-10-02T21:27:04.284068] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-08. [2025-10-02T21:27:04.429341] [INFO ] [MAIN ] SEM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:27:04.492460] [DEBUG] [LOCAL ] SEM: Loaded 42748 existing records from primary storage. [2025-10-02T21:27:04.493679] [INFO ] [MAIN ] SEM: Loaded 42748 existing records. [2025-10-02T21:27:04.795670] [WARN ] [MAIN ] SEM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:27:04.796969] [INFO ] [MAIN ] SEM: Wiping existing primary data before full refresh. [2025-10-02T21:27:04.797761] [INFO ] [LOCAL ] SEM: Starting deletion of primary data. [2025-10-02T21:27:04.798758] [DEBUG] [LOCAL ] SEM: Deleted primary data file. [2025-10-02T21:27:04.799710] [INFO ] [MAIN ] SEM: Starting full primary refresh. [2025-10-02T21:27:05.244037] [INFO ] [REMOTE ] SEM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:27:05.245536] [INFO ] [REMOTE ] SEM: Fetching primary data for 2024-12. [2025-10-02T21:27:05.281278] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-02T21:27:05.388609] [DEBUG] [LOCAL ] SE: Primary data saved (53751 records). [2025-10-02T21:27:05.388778] [INFO ] [MAIN ] SE: Full history saved. [2025-10-02T21:27:05.388867] [INFO ] [MAIN ] Update Progress: 1893/2370 symbols completed. SE took 37.7s. Estimated remaining: 1h 7m 17s. Rate: 7.1 symbols/min [2025-10-02T21:27:05.573907] [INFO ] [MAIN ] SEMR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:27:05.612496] [DEBUG] [LOCAL ] SEMR: Loaded 41589 existing records from primary storage. [2025-10-02T21:27:05.612850] [INFO ] [MAIN ] SEMR: Loaded 41589 existing records. [2025-10-02T21:27:05.813880] [WARN ] [MAIN ] SEMR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:27:05.814222] [INFO ] [MAIN ] SEMR: Wiping existing primary data before full refresh. [2025-10-02T21:27:05.814296] [INFO ] [LOCAL ] SEMR: Starting deletion of primary data. [2025-10-02T21:27:05.814706] [DEBUG] [LOCAL ] SEMR: Deleted primary data file. [2025-10-02T21:27:05.814767] [INFO ] [MAIN ] SEMR: Starting full primary refresh. [2025-10-02T21:27:05.878148] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-01. [2025-10-02T21:27:06.179863] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-02T21:27:06.269868] [INFO ] [REMOTE ] SEMR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:27:06.408604] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-02T21:27:06.673047] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-01. [2025-10-02T21:27:07.472969] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2024-12. [2025-10-02T21:27:07.504232] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-02T21:27:07.993737] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-02T21:27:08.273037] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-02. [2025-10-02T21:27:08.753154] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-02T21:27:09.073058] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-01. [2025-10-02T21:27:09.750143] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-02T21:27:09.872990] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-03. [2025-10-02T21:27:10.086329] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-02T21:27:10.673008] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-09. [2025-10-02T21:27:11.032874] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-02T21:27:11.473002] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-04. [2025-10-02T21:27:12.273042] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-02. [2025-10-02T21:27:12.360555] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-02T21:27:13.058553] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-02T21:27:13.072961] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-02. [2025-10-02T21:27:13.872955] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-10. [2025-10-02T21:27:13.947990] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-02T21:27:14.153709] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-02T21:27:14.673008] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-05. [2025-10-02T21:27:15.082432] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-02T21:27:15.085751] [INFO ] [REMOTE ] SEE: Full fetch complete (69657 records). [2025-10-02T21:27:15.085948] [DEBUG] [VALIDATOR ] SEE: Validating primary data. [2025-10-02T21:27:15.478210] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-03. [2025-10-02T21:27:15.731412] [DEBUG] [VALIDATOR ] SEE: All expected trading days are present. [2025-10-02T21:27:15.731523] [DEBUG] [VALIDATOR ] SEE: Primary data validation passed. [2025-10-02T21:27:15.732872] [INFO ] [MAIN ] SEE: Fetched primary data is valid. [2025-10-02T21:27:15.732952] [DEBUG] [LOCAL ] SEE: Saving primary data. [2025-10-02T21:27:15.734721] [DEBUG] [LOCAL ] SEE: Trimmed 69657 records to 48623 (keeping 200 days of data) [2025-10-02T21:27:16.120770] [DEBUG] [LOCAL ] SEE: Primary data saved (48623 records). [2025-10-02T21:27:16.120952] [INFO ] [MAIN ] SEE: Full history saved. [2025-10-02T21:27:16.121058] [INFO ] [MAIN ] Update Progress: 1894/2370 symbols completed. SEE took 41.8s. Estimated remaining: 1h 7m 9s. Rate: 7.1 symbols/min [2025-10-02T21:27:16.292587] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-03. [2025-10-02T21:27:16.328275] [INFO ] [MAIN ] SES: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:27:16.361390] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-02T21:27:16.415393] [DEBUG] [LOCAL ] SES: Loaded 51558 existing records from primary storage. [2025-10-02T21:27:16.415760] [INFO ] [MAIN ] SES: Loaded 51558 existing records. [2025-10-02T21:27:16.607737] [WARN ] [MAIN ] SES: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:27:16.608019] [INFO ] [MAIN ] SES: Wiping existing primary data before full refresh. [2025-10-02T21:27:16.608132] [INFO ] [LOCAL ] SES: Starting deletion of primary data. [2025-10-02T21:27:16.608416] [DEBUG] [LOCAL ] SES: Deleted primary data file. [2025-10-02T21:27:16.608504] [INFO ] [MAIN ] SES: Starting full primary refresh. [2025-10-02T21:27:17.007450] [INFO ] [REMOTE ] SES: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:27:17.034670] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-02T21:27:17.073056] [INFO ] [REMOTE ] SES: Fetching primary data for 2024-12. [2025-10-02T21:27:17.872955] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-04. [2025-10-02T21:27:18.146843] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-02T21:27:18.672977] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-04. [2025-10-02T21:27:18.874200] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-02T21:27:19.131406] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-02T21:27:19.472998] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-05. [2025-10-02T21:27:20.272982] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-01. [2025-10-02T21:27:20.502663] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-02T21:27:20.934200] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-02T21:27:21.073024] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-05. [2025-10-02T21:27:21.872981] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-06. [2025-10-02T21:27:22.663588] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-02T21:27:22.678395] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-06. [2025-10-02T21:27:22.853089] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-01 (2.58 seconds). [2025-10-02T21:27:23.471951] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-02T21:27:23.483339] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-06. [2025-10-02T21:27:24.210215] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-02T21:27:24.273030] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-07. [2025-10-02T21:27:24.941358] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-02T21:27:25.072970] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-07. [2025-10-02T21:27:25.842827] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-02T21:27:25.872989] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-02. [2025-10-02T21:27:26.673006] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-07. [2025-10-02T21:27:26.932509] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-02T21:27:27.473006] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-08. [2025-10-02T21:27:28.040864] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-02T21:27:28.146157] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-10-02T21:27:28.273000] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-03. [2025-10-02T21:27:29.072974] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-08. [2025-10-02T21:27:29.114335] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-02T21:27:29.872992] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-09. [2025-10-02T21:27:30.672990] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-08. [2025-10-02T21:27:30.827331] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-02T21:27:30.993426] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-03 (2.72 seconds). [2025-10-02T21:27:31.382458] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-02T21:27:31.472994] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-04. [2025-10-02T21:27:32.054554] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-02T21:27:32.273051] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-10. [2025-10-02T21:27:33.072991] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-09. [2025-10-02T21:27:33.137150] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-02T21:27:33.139135] [INFO ] [REMOTE ] SEM: Full fetch complete (61404 records). [2025-10-02T21:27:33.139227] [DEBUG] [VALIDATOR ] SEM: Validating primary data. [2025-10-02T21:27:33.560985] [DEBUG] [VALIDATOR ] SEM: All expected trading days are present. [2025-10-02T21:27:33.561212] [DEBUG] [VALIDATOR ] SEM: Primary data validation passed. [2025-10-02T21:27:33.562367] [INFO ] [MAIN ] SEM: Fetched primary data is valid. [2025-10-02T21:27:33.562482] [DEBUG] [LOCAL ] SEM: Saving primary data. [2025-10-02T21:27:33.564185] [DEBUG] [LOCAL ] SEM: Trimmed 61404 records to 43065 (keeping 200 days of data) [2025-10-02T21:27:33.693580] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-02T21:27:33.874000] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-05. [2025-10-02T21:27:33.884617] [DEBUG] [LOCAL ] SEM: Primary data saved (43065 records). [2025-10-02T21:27:33.884731] [INFO ] [MAIN ] SEM: Full history saved. [2025-10-02T21:27:33.885847] [INFO ] [MAIN ] Update Progress: 1895/2370 symbols completed. SEM took 29.7s. Estimated remaining: 1h 7m 3s. Rate: 7.1 symbols/min [2025-10-02T21:27:34.070039] [INFO ] [MAIN ] SF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:27:34.111737] [DEBUG] [LOCAL ] SF: Loaded 41562 existing records from primary storage. [2025-10-02T21:27:34.112048] [INFO ] [MAIN ] SF: Loaded 41562 existing records. [2025-10-02T21:27:34.298144] [WARN ] [MAIN ] SF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:27:34.298369] [INFO ] [MAIN ] SF: Wiping existing primary data before full refresh. [2025-10-02T21:27:34.298416] [INFO ] [LOCAL ] SF: Starting deletion of primary data. [2025-10-02T21:27:34.298620] [DEBUG] [LOCAL ] SF: Deleted primary data file. [2025-10-02T21:27:34.298706] [INFO ] [MAIN ] SF: Starting full primary refresh. [2025-10-02T21:27:34.674023] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-09. [2025-10-02T21:27:34.698840] [INFO ] [REMOTE ] SF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:27:34.732332] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-02T21:27:35.473049] [INFO ] [REMOTE ] SF: Fetching primary data for 2024-12. [2025-10-02T21:27:36.273030] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-10. [2025-10-02T21:27:36.352439] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-02T21:27:36.479460] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-05 (2.61 seconds). [2025-10-02T21:27:36.912281] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-02T21:27:37.073030] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-10. [2025-10-02T21:27:37.230967] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-02T21:27:37.233569] [INFO ] [REMOTE ] SEI: Full fetch complete (69916 records). [2025-10-02T21:27:37.233726] [DEBUG] [VALIDATOR ] SEI: Validating primary data. [2025-10-02T21:27:37.655930] [DEBUG] [VALIDATOR ] SEI: All expected trading days are present. [2025-10-02T21:27:37.656259] [DEBUG] [VALIDATOR ] SEI: Primary data validation passed. [2025-10-02T21:27:37.657689] [INFO ] [MAIN ] SEI: Fetched primary data is valid. [2025-10-02T21:27:37.657759] [DEBUG] [LOCAL ] SEI: Saving primary data. [2025-10-02T21:27:37.660029] [DEBUG] [LOCAL ] SEI: Trimmed 69916 records to 50044 (keeping 200 days of data) [2025-10-02T21:27:37.893086] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-01. [2025-10-02T21:27:37.996913] [DEBUG] [LOCAL ] SEI: Primary data saved (50044 records). [2025-10-02T21:27:37.997059] [INFO ] [MAIN ] SEI: Full history saved. [2025-10-02T21:27:37.997183] [INFO ] [MAIN ] Update Progress: 1896/2370 symbols completed. SEI took 36.6s. Estimated remaining: 1h 6m 54s. Rate: 7.1 symbols/min [2025-10-02T21:27:38.184990] [INFO ] [MAIN ] SFB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:27:38.192802] [DEBUG] [LOCAL ] SFB: Loaded 4130 existing records from primary storage. [2025-10-02T21:27:38.193020] [INFO ] [MAIN ] SFB: Loaded 4130 existing records. [2025-10-02T21:27:38.306114] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-02T21:27:38.319827] [INFO ] [REMOTE ] SEMR: Full fetch complete (59365 records). [2025-10-02T21:27:38.330273] [DEBUG] [VALIDATOR ] SEMR: Validating primary data. [2025-10-02T21:27:38.466558] [WARN ] [MAIN ] SFB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:27:38.502690] [INFO ] [MAIN ] SFB: Wiping existing primary data before full refresh. [2025-10-02T21:27:38.518226] [INFO ] [LOCAL ] SFB: Starting deletion of primary data. [2025-10-02T21:27:38.522009] [DEBUG] [LOCAL ] SFB: Deleted primary data file. [2025-10-02T21:27:38.532675] [INFO ] [MAIN ] SFB: Starting full primary refresh. [2025-10-02T21:27:38.694831] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-06. [2025-10-02T21:27:39.271631] [DEBUG] [VALIDATOR ] SEMR: All expected trading days are present. [2025-10-02T21:27:39.278580] [INFO ] [REMOTE ] SFB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:27:39.278832] [DEBUG] [VALIDATOR ] SEMR: Primary data validation passed. [2025-10-02T21:27:39.280196] [INFO ] [MAIN ] SEMR: Fetched primary data is valid. [2025-10-02T21:27:39.280618] [DEBUG] [LOCAL ] SEMR: Saving primary data. [2025-10-02T21:27:39.281999] [DEBUG] [LOCAL ] SEMR: Trimmed 59365 records to 41963 (keeping 200 days of data) [2025-10-02T21:27:39.490238] [INFO ] [REMOTE ] SFB: Fetching primary data for 2024-12. [2025-10-02T21:27:39.542517] [DEBUG] [LOCAL ] SEMR: Primary data saved (41963 records). [2025-10-02T21:27:39.542698] [INFO ] [MAIN ] SEMR: Full history saved. [2025-10-02T21:27:39.542793] [INFO ] [MAIN ] Update Progress: 1897/2370 symbols completed. SEMR took 34.2s. Estimated remaining: 1h 6m 43s. Rate: 7.1 symbols/min [2025-10-02T21:27:39.735569] [INFO ] [MAIN ] SFBS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:27:39.765694] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-02T21:27:39.794567] [DEBUG] [LOCAL ] SFBS: Loaded 21055 existing records from primary storage. [2025-10-02T21:27:39.794871] [INFO ] [MAIN ] SFBS: Loaded 21055 existing records. [2025-10-02T21:27:39.995075] [WARN ] [MAIN ] SFBS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:27:39.995295] [INFO ] [MAIN ] SFBS: Wiping existing primary data before full refresh. [2025-10-02T21:27:39.995347] [INFO ] [LOCAL ] SFBS: Starting deletion of primary data. [2025-10-02T21:27:39.995558] [DEBUG] [LOCAL ] SFBS: Deleted primary data file. [2025-10-02T21:27:39.995699] [INFO ] [MAIN ] SFBS: Starting full primary refresh. [2025-10-02T21:27:40.116009] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-02T21:27:40.278210] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-01. [2025-10-02T21:27:40.404714] [INFO ] [REMOTE ] SFBS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:27:40.545582] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-02T21:27:40.908280] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-02T21:27:41.073008] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-07. [2025-10-02T21:27:41.873036] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2024-12. [2025-10-02T21:27:42.672971] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-02. [2025-10-02T21:27:42.898449] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-02T21:27:43.061030] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-02T21:27:43.097943] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-02T21:27:43.472976] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-01. [2025-10-02T21:27:44.272984] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-02. [2025-10-02T21:27:44.562193] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-02T21:27:45.073015] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-08. [2025-10-02T21:27:45.457138] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-02T21:27:45.873031] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-03. [2025-10-02T21:27:46.535159] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-02T21:27:46.571777] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-02T21:27:46.673016] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-03. [2025-10-02T21:27:47.473015] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-02. [2025-10-02T21:27:48.272993] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-09. [2025-10-02T21:27:48.304194] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-02T21:27:48.520915] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-02T21:27:49.072995] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-03. [2025-10-02T21:27:49.873008] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-04. [2025-10-02T21:27:50.124594] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-02T21:27:50.167021] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-02T21:27:50.673035] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-10. [2025-10-02T21:27:51.473001] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-04. [2025-10-02T21:27:51.634402] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-02T21:27:52.047674] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-02T21:27:52.273020] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-05. [2025-10-02T21:27:52.371639] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-02T21:27:52.373906] [INFO ] [REMOTE ] SES: Full fetch complete (75197 records). [2025-10-02T21:27:52.374034] [DEBUG] [VALIDATOR ] SES: Validating primary data. [2025-10-02T21:27:52.809021] [DEBUG] [VALIDATOR ] SES: All expected trading days are present. [2025-10-02T21:27:52.809115] [DEBUG] [VALIDATOR ] SES: Primary data validation passed. [2025-10-02T21:27:52.810378] [INFO ] [MAIN ] SES: Fetched primary data is valid. [2025-10-02T21:27:52.810450] [DEBUG] [LOCAL ] SES: Saving primary data. [2025-10-02T21:27:52.812048] [DEBUG] [LOCAL ] SES: Trimmed 75197 records to 51946 (keeping 200 days of data) [2025-10-02T21:27:53.094300] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-04. [2025-10-02T21:27:53.149257] [DEBUG] [LOCAL ] SES: Primary data saved (51946 records). [2025-10-02T21:27:53.149593] [INFO ] [MAIN ] SES: Full history saved. [2025-10-02T21:27:53.149916] [INFO ] [MAIN ] Update Progress: 1898/2370 symbols completed. SES took 37.0s. Estimated remaining: 1h 6m 36s. Rate: 7.1 symbols/min [2025-10-02T21:27:53.349079] [INFO ] [MAIN ] SFL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:27:53.398713] [DEBUG] [LOCAL ] SFL: Loaded 45252 existing records from primary storage. [2025-10-02T21:27:53.399117] [INFO ] [MAIN ] SFL: Loaded 45252 existing records. [2025-10-02T21:27:53.677228] [WARN ] [MAIN ] SFL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:27:53.677770] [INFO ] [MAIN ] SFL: Wiping existing primary data before full refresh. [2025-10-02T21:27:53.677933] [INFO ] [LOCAL ] SFL: Starting deletion of primary data. [2025-10-02T21:27:53.678701] [DEBUG] [LOCAL ] SFL: Deleted primary data file. [2025-10-02T21:27:53.678840] [INFO ] [MAIN ] SFL: Starting full primary refresh. [2025-10-02T21:27:53.884740] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-05. [2025-10-02T21:27:54.080676] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-02T21:27:54.175524] [INFO ] [REMOTE ] SFL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:27:54.534689] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-02T21:27:54.673033] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-06. [2025-10-02T21:27:54.947047] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-02T21:27:55.272527] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-02T21:27:55.473000] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-07. [2025-10-02T21:27:56.034680] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-02T21:27:56.273008] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-08. [2025-10-02T21:27:56.790621] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-02T21:27:57.073010] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-09. [2025-10-02T21:27:57.647820] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-02T21:27:57.873011] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-05. [2025-10-02T21:27:58.673007] [INFO ] [REMOTE ] SFL: Fetching primary data for 2024-12. [2025-10-02T21:27:58.894986] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-02T21:27:59.473038] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-10. [2025-10-02T21:27:59.887061] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-02T21:27:59.887896] [INFO ] [REMOTE ] SFB: Full fetch complete (5907 records). [2025-10-02T21:27:59.887969] [DEBUG] [VALIDATOR ] SFB: Validating primary data. [2025-10-02T21:28:00.273725] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-06. [2025-10-02T21:28:00.320921] [DEBUG] [VALIDATOR ] SFB: All expected trading days are present. [2025-10-02T21:28:00.321025] [DEBUG] [VALIDATOR ] SFB: Primary data validation passed. [2025-10-02T21:28:00.321387] [INFO ] [MAIN ] SFB: Fetched primary data is valid. [2025-10-02T21:28:00.321468] [DEBUG] [LOCAL ] SFB: Saving primary data. [2025-10-02T21:28:00.322544] [DEBUG] [LOCAL ] SFB: Trimmed 5907 records to 4158 (keeping 200 days of data) [2025-10-02T21:28:00.352594] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-02T21:28:00.389602] [DEBUG] [LOCAL ] SFB: Primary data saved (4158 records). [2025-10-02T21:28:00.389763] [INFO ] [MAIN ] SFB: Full history saved. [2025-10-02T21:28:00.389880] [INFO ] [MAIN ] Update Progress: 1899/2370 symbols completed. SFB took 22.4s. Estimated remaining: 1h 6m 27s. Rate: 7.1 symbols/min [2025-10-02T21:28:00.577685] [INFO ] [MAIN ] SG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:28:00.647439] [DEBUG] [LOCAL ] SG: Loaded 53451 existing records from primary storage. [2025-10-02T21:28:00.647843] [INFO ] [MAIN ] SG: Loaded 53451 existing records. [2025-10-02T21:28:00.838629] [WARN ] [MAIN ] SG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:28:00.838899] [INFO ] [MAIN ] SG: Wiping existing primary data before full refresh. [2025-10-02T21:28:00.838961] [INFO ] [LOCAL ] SG: Starting deletion of primary data. [2025-10-02T21:28:00.839485] [DEBUG] [LOCAL ] SG: Deleted primary data file. [2025-10-02T21:28:00.839545] [INFO ] [MAIN ] SG: Starting full primary refresh. [2025-10-02T21:28:01.078152] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-01. [2025-10-02T21:28:01.236242] [INFO ] [REMOTE ] SG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:28:01.345872] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-02T21:28:01.872995] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-07. [2025-10-02T21:28:02.381879] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-02T21:28:02.672993] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-06. [2025-10-02T21:28:03.055300] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-02T21:28:03.473009] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-08. [2025-10-02T21:28:04.122763] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-02T21:28:04.144530] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-02T21:28:04.273015] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-09. [2025-10-02T21:28:05.073009] [INFO ] [REMOTE ] SG: Fetching primary data for 2024-12. [2025-10-02T21:28:05.281940] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-02T21:28:05.873022] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-02. [2025-10-02T21:28:06.672996] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-10. [2025-10-02T21:28:06.958690] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-02T21:28:07.236325] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-02T21:28:07.237639] [INFO ] [REMOTE ] SFBS: Full fetch complete (30335 records). [2025-10-02T21:28:07.237757] [DEBUG] [VALIDATOR ] SFBS: Validating primary data. [2025-10-02T21:28:07.475009] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-07. [2025-10-02T21:28:07.725219] [DEBUG] [VALIDATOR ] SFBS: All expected trading days are present. [2025-10-02T21:28:07.725348] [DEBUG] [VALIDATOR ] SFBS: Primary data validation passed. [2025-10-02T21:28:07.726489] [INFO ] [MAIN ] SFBS: Fetched primary data is valid. [2025-10-02T21:28:07.726612] [DEBUG] [LOCAL ] SFBS: Saving primary data. [2025-10-02T21:28:07.728287] [DEBUG] [LOCAL ] SFBS: Trimmed 30335 records to 21253 (keeping 200 days of data) [2025-10-02T21:28:07.765448] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-02T21:28:07.988023] [DEBUG] [LOCAL ] SFBS: Primary data saved (21253 records). [2025-10-02T21:28:07.988197] [INFO ] [MAIN ] SFBS: Full history saved. [2025-10-02T21:28:07.988311] [INFO ] [MAIN ] Update Progress: 1900/2370 symbols completed. SFBS took 28.4s. Estimated remaining: 1h 6m 19s. Rate: 7.1 symbols/min [2025-10-02T21:28:08.247016] [INFO ] [MAIN ] SGHC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:28:08.273080] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-03. [2025-10-02T21:28:08.316393] [DEBUG] [LOCAL ] SGHC: Loaded 46072 existing records from primary storage. [2025-10-02T21:28:08.316854] [INFO ] [MAIN ] SGHC: Loaded 46072 existing records. [2025-10-02T21:28:08.549811] [WARN ] [MAIN ] SGHC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:28:08.550051] [INFO ] [MAIN ] SGHC: Wiping existing primary data before full refresh. [2025-10-02T21:28:08.550101] [INFO ] [LOCAL ] SGHC: Starting deletion of primary data. [2025-10-02T21:28:08.550339] [DEBUG] [LOCAL ] SGHC: Deleted primary data file. [2025-10-02T21:28:08.550411] [INFO ] [MAIN ] SGHC: Starting full primary refresh. [2025-10-02T21:28:08.993486] [INFO ] [REMOTE ] SGHC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:28:09.021454] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-02T21:28:09.073030] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-08. [2025-10-02T21:28:09.870432] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-02T21:28:09.880175] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2024-12. [2025-10-02T21:28:10.543333] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-02T21:28:10.672983] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-04. [2025-10-02T21:28:11.335516] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-02T21:28:11.473037] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-01. [2025-10-02T21:28:12.215438] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-02T21:28:12.273100] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-05. [2025-10-02T21:28:12.940411] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-02T21:28:13.073010] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-01. [2025-10-02T21:28:13.746835] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-02T21:28:13.873008] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-02. [2025-10-02T21:28:14.025912] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-02T21:28:14.673058] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-09. [2025-10-02T21:28:15.472979] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-06. [2025-10-02T21:28:15.741546] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-02T21:28:16.273025] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-03. [2025-10-02T21:28:16.330938] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-02T21:28:17.026636] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-02T21:28:17.073028] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-02. [2025-10-02T21:28:17.872979] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-10. [2025-10-02T21:28:18.211491] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-02T21:28:18.251617] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-02T21:28:18.673045] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-04. [2025-10-02T21:28:18.783787] [DEBUG] [REMOTE ] SG: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-10-02T21:28:18.784163] [WARN ] [REMOTE ] SG: No data returned for month 2025-04 [2025-10-02T21:28:18.784260] [FATAL] [REMOTE ] SG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T21:28:18.784378] [FATAL] [MAIN ] SG: Failed to fetch primary data. [2025-10-02T21:28:18.784452] [WARN ] [MAIN ] SG: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T21:28:18.784529] [INFO ] [LOCAL ] SG: Starting deletion of primary data. [2025-10-02T21:28:18.784612] [DEBUG] [LOCAL ] SG: No primary data file found to delete. [2025-10-02T21:28:18.784697] [INFO ] [LOCAL ] SG: Starting deletion of derivative data. [2025-10-02T21:28:18.785229] [DEBUG] [LOCAL ] SG: Deleted derivative data file. [2025-10-02T21:28:18.785323] [INFO ] [MAIN ] Update Progress: 1901/2370 symbols completed. SG took 18.4s. Estimated remaining: 1h 6m 11s. Rate: 7.1 symbols/min [2025-10-02T21:28:18.982445] [INFO ] [MAIN ] SGI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:28:18.982622] [DEBUG] [LOCAL ] SGI: No existing data file found in primary storage. [2025-10-02T21:28:18.982695] [WARN ] [MAIN ] SGI: No existing data found, performing full refresh instead. [2025-10-02T21:28:18.982812] [INFO ] [MAIN ] SGI: Wiping existing primary data before full refresh. [2025-10-02T21:28:18.982854] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-10-02T21:28:18.982896] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-10-02T21:28:18.982929] [INFO ] [MAIN ] SGI: Starting full primary refresh. [2025-10-02T21:28:19.097433] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-02T21:28:19.126255] [INFO ] [REMOTE ] SF: Full fetch complete (59847 records). [2025-10-02T21:28:19.145576] [DEBUG] [VALIDATOR ] SF: Validating primary data. [2025-10-02T21:28:19.476413] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-03. [2025-10-02T21:28:19.589496] [INFO ] [REMOTE ] SGI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:28:19.861425] [DEBUG] [VALIDATOR ] SF: All expected trading days are present. [2025-10-02T21:28:19.861569] [DEBUG] [VALIDATOR ] SF: Primary data validation passed. [2025-10-02T21:28:19.862870] [INFO ] [MAIN ] SF: Fetched primary data is valid. [2025-10-02T21:28:19.862939] [DEBUG] [LOCAL ] SF: Saving primary data. [2025-10-02T21:28:19.864286] [DEBUG] [LOCAL ] SF: Trimmed 59847 records to 41845 (keeping 200 days of data) [2025-10-02T21:28:20.148621] [DEBUG] [LOCAL ] SF: Primary data saved (41845 records). [2025-10-02T21:28:20.148776] [INFO ] [MAIN ] SF: Full history saved. [2025-10-02T21:28:20.150018] [INFO ] [MAIN ] Update Progress: 1902/2370 symbols completed. SF took 46.3s. Estimated remaining: 1h 6m 1s. Rate: 7.1 symbols/min [2025-10-02T21:28:20.278169] [INFO ] [REMOTE ] SGI: Fetching primary data for 2024-12. [2025-10-02T21:28:20.340382] [INFO ] [MAIN ] SGU: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:28:20.354052] [DEBUG] [LOCAL ] SGU: Loaded 6708 existing records from primary storage. [2025-10-02T21:28:20.354356] [INFO ] [MAIN ] SGU: Loaded 6708 existing records. [2025-10-02T21:28:20.506071] [DEBUG] [REMOTE ] SGI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T21:28:20.528579] [WARN ] [REMOTE ] SGI: No data returned for month 2024-12 [2025-10-02T21:28:20.528801] [FATAL] [REMOTE ] SGI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T21:28:20.546627] [FATAL] [MAIN ] SGI: Failed to fetch primary data. [2025-10-02T21:28:20.547099] [WARN ] [MAIN ] SGI: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T21:28:20.568246] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-10-02T21:28:20.576806] [WARN ] [MAIN ] SGU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:28:20.577471] [INFO ] [MAIN ] SGU: Wiping existing primary data before full refresh. [2025-10-02T21:28:20.577752] [INFO ] [LOCAL ] SGU: Starting deletion of primary data. [2025-10-02T21:28:20.577671] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-10-02T21:28:20.577897] [INFO ] [LOCAL ] SGI: Starting deletion of derivative data. [2025-10-02T21:28:20.578133] [DEBUG] [LOCAL ] SGI: No derivative data file found to delete. [2025-10-02T21:28:20.578244] [INFO ] [MAIN ] Update Progress: 1903/2370 symbols completed. SGI took 1.8s. Estimated remaining: 1h 5m 50s. Rate: 7.1 symbols/min [2025-10-02T21:28:20.583729] [DEBUG] [LOCAL ] SGU: Deleted primary data file. [2025-10-02T21:28:20.624411] [INFO ] [MAIN ] SGU: Starting full primary refresh. [2025-10-02T21:28:20.929616] [INFO ] [MAIN ] SHAK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:28:21.076744] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-07. [2025-10-02T21:28:21.185261] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-02T21:28:21.282446] [DEBUG] [LOCAL ] SHAK: Loaded 48937 existing records from primary storage. [2025-10-02T21:28:21.297840] [INFO ] [REMOTE ] SGU: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:28:21.298389] [INFO ] [MAIN ] SHAK: Loaded 48937 existing records. [2025-10-02T21:28:21.487412] [WARN ] [MAIN ] SHAK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:28:21.487700] [INFO ] [MAIN ] SHAK: Wiping existing primary data before full refresh. [2025-10-02T21:28:21.487764] [INFO ] [LOCAL ] SHAK: Starting deletion of primary data. [2025-10-02T21:28:21.488042] [DEBUG] [LOCAL ] SHAK: Deleted primary data file. [2025-10-02T21:28:21.488122] [INFO ] [MAIN ] SHAK: Starting full primary refresh. [2025-10-02T21:28:21.879401] [INFO ] [REMOTE ] SGU: Fetching primary data for 2024-12. [2025-10-02T21:28:21.904507] [INFO ] [REMOTE ] SHAK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:28:22.493535] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-02T21:28:22.673012] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-01. [2025-10-02T21:28:22.727934] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-02T21:28:23.282482] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-02T21:28:23.473002] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-02. [2025-10-02T21:28:24.096751] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-02T21:28:24.272987] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-04. [2025-10-02T21:28:25.073010] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-03. [2025-10-02T21:28:25.812636] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-02T21:28:25.859984] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-02T21:28:25.872993] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-04. [2025-10-02T21:28:26.593823] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-02T21:28:26.672997] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2024-12. [2025-10-02T21:28:27.473000] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-05. [2025-10-02T21:28:27.764803] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-02T21:28:28.078351] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-02T21:28:28.272999] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-01. [2025-10-02T21:28:29.072990] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-05. [2025-10-02T21:28:29.872994] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-08. [2025-10-02T21:28:29.935032] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-02T21:28:30.672969] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-02. [2025-10-02T21:28:30.703617] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-02T21:28:31.473052] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-06. [2025-10-02T21:28:31.529191] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-02T21:28:32.219606] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-02T21:28:32.234638] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-02T21:28:32.272967] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-07. [2025-10-02T21:28:33.038292] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-02T21:28:33.072982] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-09. [2025-10-02T21:28:33.873012] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-03. [2025-10-02T21:28:34.554713] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-02T21:28:34.672952] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-06. [2025-10-02T21:28:35.379227] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-02T21:28:35.472997] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-10. [2025-10-02T21:28:36.178975] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-02T21:28:36.273032] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-07. [2025-10-02T21:28:36.654107] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-02T21:28:36.657508] [INFO ] [REMOTE ] SFL: Full fetch complete (65648 records). [2025-10-02T21:28:36.657685] [DEBUG] [VALIDATOR ] SFL: Validating primary data. [2025-10-02T21:28:37.081685] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-08. [2025-10-02T21:28:37.085345] [DEBUG] [VALIDATOR ] SFL: All expected trading days are present. [2025-10-02T21:28:37.086354] [DEBUG] [VALIDATOR ] SFL: Primary data validation passed. [2025-10-02T21:28:37.087549] [INFO ] [MAIN ] SFL: Fetched primary data is valid. [2025-10-02T21:28:37.087755] [DEBUG] [LOCAL ] SFL: Saving primary data. [2025-10-02T21:28:37.089318] [DEBUG] [LOCAL ] SFL: Trimmed 65648 records to 45558 (keeping 200 days of data) [2025-10-02T21:28:37.385822] [DEBUG] [LOCAL ] SFL: Primary data saved (45558 records). [2025-10-02T21:28:37.386032] [INFO ] [MAIN ] SFL: Full history saved. [2025-10-02T21:28:37.386142] [INFO ] [MAIN ] Update Progress: 1904/2370 symbols completed. SFL took 44.2s. Estimated remaining: 1h 5m 44s. Rate: 7.1 symbols/min [2025-10-02T21:28:37.581720] [INFO ] [MAIN ] SHCO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:28:37.607669] [DEBUG] [LOCAL ] SHCO: Loaded 25860 existing records from primary storage. [2025-10-02T21:28:37.607974] [INFO ] [MAIN ] SHCO: Loaded 25860 existing records. [2025-10-02T21:28:37.809130] [WARN ] [MAIN ] SHCO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:28:37.809383] [INFO ] [MAIN ] SHCO: Wiping existing primary data before full refresh. [2025-10-02T21:28:37.809436] [INFO ] [LOCAL ] SHCO: Starting deletion of primary data. [2025-10-02T21:28:37.809694] [DEBUG] [LOCAL ] SHCO: Deleted primary data file. [2025-10-02T21:28:37.809757] [INFO ] [MAIN ] SHCO: Starting full primary refresh. [2025-10-02T21:28:37.878228] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-04. [2025-10-02T21:28:37.917785] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-02T21:28:38.238231] [INFO ] [REMOTE ] SHCO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:28:38.266933] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-02T21:28:38.673011] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2024-12. [2025-10-02T21:28:39.398883] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-02T21:28:39.473035] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-09. [2025-10-02T21:28:39.628203] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-02T21:28:40.212130] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-02T21:28:40.272986] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-10. [2025-10-02T21:28:40.724621] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-02T21:28:40.725438] [INFO ] [REMOTE ] SGU: Full fetch complete (9005 records). [2025-10-02T21:28:40.725508] [DEBUG] [VALIDATOR ] SGU: Validating primary data. [2025-10-02T21:28:41.087501] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-05. [2025-10-02T21:28:41.135240] [DEBUG] [VALIDATOR ] SGU: All expected trading days are present. [2025-10-02T21:28:41.135320] [DEBUG] [VALIDATOR ] SGU: Primary data validation passed. [2025-10-02T21:28:41.135567] [INFO ] [MAIN ] SGU: Fetched primary data is valid. [2025-10-02T21:28:41.135610] [DEBUG] [LOCAL ] SGU: Saving primary data. [2025-10-02T21:28:41.136103] [DEBUG] [LOCAL ] SGU: Trimmed 9005 records to 6739 (keeping 200 days of data) [2025-10-02T21:28:41.179172] [DEBUG] [LOCAL ] SGU: Primary data saved (6739 records). [2025-10-02T21:28:41.179318] [INFO ] [MAIN ] SGU: Full history saved. [2025-10-02T21:28:41.179405] [INFO ] [MAIN ] Update Progress: 1905/2370 symbols completed. SGU took 21.0s. Estimated remaining: 1h 5m 34s. Rate: 7.1 symbols/min [2025-10-02T21:28:41.362166] [INFO ] [MAIN ] SHEL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:28:41.413371] [DEBUG] [LOCAL ] SHEL: Loaded 53671 existing records from primary storage. [2025-10-02T21:28:41.413734] [INFO ] [MAIN ] SHEL: Loaded 53671 existing records. [2025-10-02T21:28:41.605342] [WARN ] [MAIN ] SHEL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:28:41.605596] [INFO ] [MAIN ] SHEL: Wiping existing primary data before full refresh. [2025-10-02T21:28:41.605667] [INFO ] [LOCAL ] SHEL: Starting deletion of primary data. [2025-10-02T21:28:41.605926] [DEBUG] [LOCAL ] SHEL: Deleted primary data file. [2025-10-02T21:28:41.605984] [INFO ] [MAIN ] SHEL: Starting full primary refresh. [2025-10-02T21:28:41.878097] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-08. [2025-10-02T21:28:41.996249] [INFO ] [REMOTE ] SHEL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:28:42.672998] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-01. [2025-10-02T21:28:42.832151] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-02T21:28:43.120561] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-02T21:28:43.475075] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2024-12. [2025-10-02T21:28:43.477184] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-02T21:28:44.273029] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-06. [2025-10-02T21:28:45.073020] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-02. [2025-10-02T21:28:45.621331] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-02T21:28:45.699878] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-02T21:28:45.794554] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-02T21:28:45.873010] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-07. [2025-10-02T21:28:46.673031] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-01. [2025-10-02T21:28:47.263807] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-02T21:28:47.473044] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-09. [2025-10-02T21:28:48.273007] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-03. [2025-10-02T21:28:48.401954] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-02T21:28:48.738897] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-02T21:28:49.044910] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-02T21:28:49.072985] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-04. [2025-10-02T21:28:49.872995] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-02. [2025-10-02T21:28:50.366104] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-02T21:28:50.673043] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-05. [2025-10-02T21:28:51.472987] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-08. [2025-10-02T21:28:51.724989] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-02T21:28:51.772471] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-02T21:28:52.273039] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-06. [2025-10-02T21:28:53.073017] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-10. [2025-10-02T21:28:53.220942] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-02T21:28:53.309258] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-02T21:28:53.873008] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-03. [2025-10-02T21:28:54.479963] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-02T21:28:54.482227] [INFO ] [REMOTE ] SGHC: Full fetch complete (63842 records). [2025-10-02T21:28:54.482362] [DEBUG] [VALIDATOR ] SGHC: Validating primary data. [2025-10-02T21:28:54.674675] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-07. [2025-10-02T21:28:54.912837] [DEBUG] [VALIDATOR ] SGHC: All expected trading days are present. [2025-10-02T21:28:54.913022] [DEBUG] [VALIDATOR ] SGHC: Primary data validation passed. [2025-10-02T21:28:54.914266] [INFO ] [MAIN ] SGHC: Fetched primary data is valid. [2025-10-02T21:28:54.914430] [DEBUG] [LOCAL ] SGHC: Saving primary data. [2025-10-02T21:28:54.916135] [DEBUG] [LOCAL ] SGHC: Trimmed 63842 records to 46455 (keeping 200 days of data) [2025-10-02T21:28:55.213912] [DEBUG] [LOCAL ] SGHC: Primary data saved (46455 records). [2025-10-02T21:28:55.214049] [INFO ] [MAIN ] SGHC: Full history saved. [2025-10-02T21:28:55.214131] [INFO ] [MAIN ] Update Progress: 1906/2370 symbols completed. SGHC took 47.2s. Estimated remaining: 1h 5m 27s. Rate: 7.1 symbols/min [2025-10-02T21:28:55.400978] [INFO ] [MAIN ] SHG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:28:55.429974] [DEBUG] [LOCAL ] SHG: Loaded 26523 existing records from primary storage. [2025-10-02T21:28:55.430321] [INFO ] [MAIN ] SHG: Loaded 26523 existing records. [2025-10-02T21:28:55.476721] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-09. [2025-10-02T21:28:55.643431] [WARN ] [MAIN ] SHG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:28:55.644165] [INFO ] [MAIN ] SHG: Wiping existing primary data before full refresh. [2025-10-02T21:28:55.644327] [INFO ] [LOCAL ] SHG: Starting deletion of primary data. [2025-10-02T21:28:55.657366] [DEBUG] [LOCAL ] SHG: Deleted primary data file. [2025-10-02T21:28:55.679377] [INFO ] [MAIN ] SHG: Starting full primary refresh. [2025-10-02T21:28:55.742865] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-02T21:28:56.038603] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-02T21:28:56.127715] [INFO ] [REMOTE ] SHG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:28:56.273009] [INFO ] [REMOTE ] SHG: Fetching primary data for 2024-12. [2025-10-02T21:28:57.072971] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-04. [2025-10-02T21:28:57.250714] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-02T21:28:57.718913] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-02T21:28:57.873003] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-10. [2025-10-02T21:28:58.673028] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-01. [2025-10-02T21:28:58.896870] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-02T21:28:59.169117] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-02T21:28:59.171004] [INFO ] [REMOTE ] SHAK: Full fetch complete (70340 records). [2025-10-02T21:28:59.171131] [DEBUG] [VALIDATOR ] SHAK: Validating primary data. [2025-10-02T21:28:59.480788] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-08. [2025-10-02T21:28:59.592475] [DEBUG] [VALIDATOR ] SHAK: All expected trading days are present. [2025-10-02T21:28:59.592678] [DEBUG] [VALIDATOR ] SHAK: Primary data validation passed. [2025-10-02T21:28:59.594019] [INFO ] [MAIN ] SHAK: Fetched primary data is valid. [2025-10-02T21:28:59.594101] [DEBUG] [LOCAL ] SHAK: Saving primary data. [2025-10-02T21:28:59.595695] [DEBUG] [LOCAL ] SHAK: Trimmed 70340 records to 49276 (keeping 200 days of data) [2025-10-02T21:28:59.934126] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-02T21:28:59.968125] [DEBUG] [LOCAL ] SHAK: Primary data saved (49276 records). [2025-10-02T21:28:59.968319] [INFO ] [MAIN ] SHAK: Full history saved. [2025-10-02T21:28:59.968461] [INFO ] [MAIN ] Update Progress: 1907/2370 symbols completed. SHAK took 39.4s. Estimated remaining: 1h 5m 18s. Rate: 7.1 symbols/min [2025-10-02T21:29:00.223248] [INFO ] [MAIN ] SHO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:29:00.287370] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-02. [2025-10-02T21:29:00.293599] [DEBUG] [LOCAL ] SHO: Loaded 49689 existing records from primary storage. [2025-10-02T21:29:00.294301] [INFO ] [MAIN ] SHO: Loaded 49689 existing records. [2025-10-02T21:29:00.569625] [WARN ] [MAIN ] SHO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:29:00.570044] [INFO ] [MAIN ] SHO: Wiping existing primary data before full refresh. [2025-10-02T21:29:00.570107] [INFO ] [LOCAL ] SHO: Starting deletion of primary data. [2025-10-02T21:29:00.570621] [DEBUG] [LOCAL ] SHO: Deleted primary data file. [2025-10-02T21:29:00.570752] [INFO ] [MAIN ] SHO: Starting full primary refresh. [2025-10-02T21:29:01.079259] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-05. [2025-10-02T21:29:01.085900] [INFO ] [REMOTE ] SHO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:29:01.118361] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-02T21:29:01.872981] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-09. [2025-10-02T21:29:01.987082] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-02T21:29:02.672997] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-03. [2025-10-02T21:29:02.868811] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-02T21:29:03.473041] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-10. [2025-10-02T21:29:03.608977] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-10-02T21:29:04.171553] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-02T21:29:04.273017] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-06. [2025-10-02T21:29:04.303891] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-02T21:29:04.305310] [INFO ] [REMOTE ] SHCO: Full fetch complete (37852 records). [2025-10-02T21:29:04.305399] [DEBUG] [VALIDATOR ] SHCO: Validating primary data. [2025-10-02T21:29:04.712978] [DEBUG] [VALIDATOR ] SHCO: All expected trading days are present. [2025-10-02T21:29:04.713101] [DEBUG] [VALIDATOR ] SHCO: Primary data validation passed. [2025-10-02T21:29:04.713892] [INFO ] [MAIN ] SHCO: Fetched primary data is valid. [2025-10-02T21:29:04.713956] [DEBUG] [LOCAL ] SHCO: Saving primary data. [2025-10-02T21:29:04.714999] [DEBUG] [LOCAL ] SHCO: Trimmed 37852 records to 26008 (keeping 200 days of data) [2025-10-02T21:29:04.868359] [DEBUG] [LOCAL ] SHCO: Primary data saved (26008 records). [2025-10-02T21:29:04.868517] [INFO ] [MAIN ] SHCO: Full history saved. [2025-10-02T21:29:04.868615] [INFO ] [MAIN ] Update Progress: 1908/2370 symbols completed. SHCO took 27.5s. Estimated remaining: 1h 5m 8s. Rate: 7.1 symbols/min [2025-10-02T21:29:05.063163] [INFO ] [MAIN ] SHOC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:29:05.069440] [DEBUG] [LOCAL ] SHOC: Loaded 3478 existing records from primary storage. [2025-10-02T21:29:05.069630] [INFO ] [MAIN ] SHOC: Loaded 3478 existing records. [2025-10-02T21:29:05.081594] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-04. [2025-10-02T21:29:05.270567] [WARN ] [MAIN ] SHOC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:29:05.270813] [INFO ] [MAIN ] SHOC: Wiping existing primary data before full refresh. [2025-10-02T21:29:05.270864] [INFO ] [LOCAL ] SHOC: Starting deletion of primary data. [2025-10-02T21:29:05.271102] [DEBUG] [LOCAL ] SHOC: Deleted primary data file. [2025-10-02T21:29:05.271162] [INFO ] [MAIN ] SHOC: Starting full primary refresh. [2025-10-02T21:29:05.660931] [INFO ] [REMOTE ] SHOC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:29:05.873013] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2024-12. [2025-10-02T21:29:06.468276] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-10-02T21:29:06.564452] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-02T21:29:06.640369] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-02T21:29:06.672968] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-05. [2025-10-02T21:29:07.472976] [INFO ] [REMOTE ] SHO: Fetching primary data for 2024-12. [2025-10-02T21:29:07.575796] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-02T21:29:08.272983] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-06. [2025-10-02T21:29:08.787950] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-02T21:29:09.073000] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-01. [2025-10-02T21:29:09.556076] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-02T21:29:09.873031] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-07. [2025-10-02T21:29:10.658417] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-02T21:29:10.672949] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-02. [2025-10-02T21:29:11.228261] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-02T21:29:11.473003] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-08. [2025-10-02T21:29:12.282241] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-07. [2025-10-02T21:29:12.287164] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-02T21:29:12.563111] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-02T21:29:13.073071] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-01. [2025-10-02T21:29:13.715942] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-02T21:29:13.873017] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-09. [2025-10-02T21:29:14.133045] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-02T21:29:14.673004] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-02. [2025-10-02T21:29:15.072676] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-02T21:29:15.092711] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-02T21:29:15.473014] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-10. [2025-10-02T21:29:16.272985] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-08. [2025-10-02T21:29:16.278885] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-02T21:29:16.280224] [INFO ] [REMOTE ] SHG: Full fetch complete (41237 records). [2025-10-02T21:29:16.280301] [DEBUG] [VALIDATOR ] SHG: Validating primary data. [2025-10-02T21:29:16.707562] [DEBUG] [VALIDATOR ] SHG: All expected trading days are present. [2025-10-02T21:29:16.707670] [DEBUG] [VALIDATOR ] SHG: Primary data validation passed. [2025-10-02T21:29:16.708499] [INFO ] [MAIN ] SHG: Fetched primary data is valid. [2025-10-02T21:29:16.708562] [DEBUG] [LOCAL ] SHG: Saving primary data. [2025-10-02T21:29:16.709566] [DEBUG] [LOCAL ] SHG: Trimmed 41237 records to 26756 (keeping 200 days of data) [2025-10-02T21:29:16.883497] [DEBUG] [LOCAL ] SHG: Primary data saved (26756 records). [2025-10-02T21:29:16.883720] [INFO ] [MAIN ] SHG: Full history saved. [2025-10-02T21:29:16.883830] [INFO ] [MAIN ] Update Progress: 1909/2370 symbols completed. SHG took 21.7s. Estimated remaining: 1h 5m 1s. Rate: 7.1 symbols/min [2025-10-02T21:29:17.068924] [INFO ] [MAIN ] SHW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:29:17.073014] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-03. [2025-10-02T21:29:17.120568] [DEBUG] [LOCAL ] SHW: Loaded 50319 existing records from primary storage. [2025-10-02T21:29:17.121021] [INFO ] [MAIN ] SHW: Loaded 50319 existing records. [2025-10-02T21:29:17.328041] [WARN ] [MAIN ] SHW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:29:17.328306] [INFO ] [MAIN ] SHW: Wiping existing primary data before full refresh. [2025-10-02T21:29:17.328358] [INFO ] [LOCAL ] SHW: Starting deletion of primary data. [2025-10-02T21:29:17.328606] [DEBUG] [LOCAL ] SHW: Deleted primary data file. [2025-10-02T21:29:17.328694] [INFO ] [MAIN ] SHW: Starting full primary refresh. [2025-10-02T21:29:17.733064] [INFO ] [REMOTE ] SHW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:29:17.873002] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-03. [2025-10-02T21:29:18.413432] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-02T21:29:18.460125] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-02T21:29:18.673044] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-09. [2025-10-02T21:29:18.708336] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-02T21:29:19.473011] [INFO ] [REMOTE ] SHW: Fetching primary data for 2024-12. [2025-10-02T21:29:20.272974] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-04. [2025-10-02T21:29:20.463011] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-02T21:29:20.861839] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-02T21:29:21.072997] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-05. [2025-10-02T21:29:21.340673] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-02T21:29:21.578107] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-02T21:29:21.872997] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-04. [2025-10-02T21:29:22.673004] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-06. [2025-10-02T21:29:23.164529] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-02T21:29:23.472988] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-10. [2025-10-02T21:29:23.570204] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-02T21:29:24.272995] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-01. [2025-10-02T21:29:25.072974] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-05. [2025-10-02T21:29:25.123758] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-02T21:29:25.125893] [INFO ] [REMOTE ] SHEL: Full fetch complete (77694 records). [2025-10-02T21:29:25.126005] [DEBUG] [VALIDATOR ] SHEL: Validating primary data. [2025-10-02T21:29:25.561037] [DEBUG] [VALIDATOR ] SHEL: All expected trading days are present. [2025-10-02T21:29:25.561231] [DEBUG] [VALIDATOR ] SHEL: Primary data validation passed. [2025-10-02T21:29:25.562520] [INFO ] [MAIN ] SHEL: Fetched primary data is valid. [2025-10-02T21:29:25.562634] [DEBUG] [LOCAL ] SHEL: Saving primary data. [2025-10-02T21:29:25.564407] [DEBUG] [LOCAL ] SHEL: Trimmed 77694 records to 54061 (keeping 200 days of data) [2025-10-02T21:29:25.842008] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-02T21:29:25.873064] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-02. [2025-10-02T21:29:25.983406] [DEBUG] [LOCAL ] SHEL: Primary data saved (54061 records). [2025-10-02T21:29:25.983553] [INFO ] [MAIN ] SHEL: Full history saved. [2025-10-02T21:29:25.984193] [INFO ] [MAIN ] Update Progress: 1910/2370 symbols completed. SHEL took 44.8s. Estimated remaining: 1h 4m 52s. Rate: 7.1 symbols/min [2025-10-02T21:29:26.164794] [INFO ] [MAIN ] SI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:29:26.164961] [DEBUG] [LOCAL ] SI: No existing data file found in primary storage. [2025-10-02T21:29:26.165001] [WARN ] [MAIN ] SI: No existing data found, performing full refresh instead. [2025-10-02T21:29:26.165136] [INFO ] [MAIN ] SI: Wiping existing primary data before full refresh. [2025-10-02T21:29:26.165181] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-10-02T21:29:26.165225] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-10-02T21:29:26.165260] [INFO ] [MAIN ] SI: Starting full primary refresh. [2025-10-02T21:29:26.568519] [INFO ] [REMOTE ] SI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:29:26.599579] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-02T21:29:26.672995] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-06. [2025-10-02T21:29:27.472989] [INFO ] [REMOTE ] SI: Fetching primary data for 2024-12. [2025-10-02T21:29:27.644303] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-02T21:29:27.669997] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T21:29:27.670371] [WARN ] [REMOTE ] SI: No data returned for month 2024-12 [2025-10-02T21:29:27.670493] [FATAL] [REMOTE ] SI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T21:29:27.670580] [FATAL] [MAIN ] SI: Failed to fetch primary data. [2025-10-02T21:29:27.670686] [WARN ] [MAIN ] SI: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T21:29:27.670802] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-10-02T21:29:27.670926] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-10-02T21:29:27.670994] [INFO ] [LOCAL ] SI: Starting deletion of derivative data. [2025-10-02T21:29:27.671105] [DEBUG] [LOCAL ] SI: No derivative data file found to delete. [2025-10-02T21:29:27.671191] [INFO ] [MAIN ] Update Progress: 1911/2370 symbols completed. SI took 1.7s. Estimated remaining: 1h 4m 42s. Rate: 7.1 symbols/min [2025-10-02T21:29:27.880728] [INFO ] [MAIN ] SID: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:29:27.928011] [DEBUG] [LOCAL ] SID: Loaded 42317 existing records from primary storage. [2025-10-02T21:29:27.928435] [INFO ] [MAIN ] SID: Loaded 42317 existing records. [2025-10-02T21:29:28.144254] [WARN ] [MAIN ] SID: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:29:28.144552] [INFO ] [MAIN ] SID: Wiping existing primary data before full refresh. [2025-10-02T21:29:28.144715] [INFO ] [LOCAL ] SID: Starting deletion of primary data. [2025-10-02T21:29:28.144987] [DEBUG] [LOCAL ] SID: Deleted primary data file. [2025-10-02T21:29:28.145115] [INFO ] [MAIN ] SID: Starting full primary refresh. [2025-10-02T21:29:28.276112] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-07. [2025-10-02T21:29:28.387027] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-02T21:29:28.594542] [INFO ] [REMOTE ] SID: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:29:28.895103] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-02T21:29:29.073042] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-03. [2025-10-02T21:29:29.873042] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-07. [2025-10-02T21:29:30.673010] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-08. [2025-10-02T21:29:30.963685] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-02T21:29:31.248164] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-02T21:29:31.473022] [INFO ] [REMOTE ] SID: Fetching primary data for 2024-12. [2025-10-02T21:29:31.564122] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-02T21:29:32.273038] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-08. [2025-10-02T21:29:33.073001] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-04. [2025-10-02T21:29:33.190151] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-02T21:29:33.714091] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-02T21:29:33.873009] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-09. [2025-10-02T21:29:34.672972] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-01. [2025-10-02T21:29:34.795587] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-02T21:29:35.472968] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-05. [2025-10-02T21:29:35.592962] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-02T21:29:35.967832] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-02T21:29:36.273000] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-09. [2025-10-02T21:29:36.822832] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-02T21:29:37.072981] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-02. [2025-10-02T21:29:37.350439] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-02T21:29:37.872999] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-10. [2025-10-02T21:29:38.176424] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-10 (0.30 seconds). [2025-10-02T21:29:38.177257] [INFO ] [REMOTE ] SHOC: Full fetch complete (7336 records). [2025-10-02T21:29:38.177349] [DEBUG] [VALIDATOR ] SHOC: Validating primary data. [2025-10-02T21:29:38.654548] [DEBUG] [VALIDATOR ] SHOC: All expected trading days are present. [2025-10-02T21:29:38.656366] [DEBUG] [VALIDATOR ] SHOC: Primary data validation passed. [2025-10-02T21:29:38.656700] [INFO ] [MAIN ] SHOC: Fetched primary data is valid. [2025-10-02T21:29:38.656240] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-02T21:29:38.656847] [DEBUG] [LOCAL ] SHOC: Saving primary data. [2025-10-02T21:29:38.665528] [DEBUG] [LOCAL ] SHOC: Trimmed 7336 records to 3502 (keeping 200 days of data) [2025-10-02T21:29:38.680297] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-06. [2025-10-02T21:29:38.702237] [DEBUG] [LOCAL ] SHOC: Primary data saved (3502 records). [2025-10-02T21:29:38.702406] [INFO ] [MAIN ] SHOC: Full history saved. [2025-10-02T21:29:38.702514] [INFO ] [MAIN ] Update Progress: 1912/2370 symbols completed. SHOC took 33.8s. Estimated remaining: 1h 4m 35s. Rate: 7.1 symbols/min [2025-10-02T21:29:38.886433] [INFO ] [MAIN ] SIG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:29:38.933308] [DEBUG] [LOCAL ] SIG: Loaded 46221 existing records from primary storage. [2025-10-02T21:29:38.933775] [INFO ] [MAIN ] SIG: Loaded 46221 existing records. [2025-10-02T21:29:39.154182] [WARN ] [MAIN ] SIG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:29:39.154401] [INFO ] [MAIN ] SIG: Wiping existing primary data before full refresh. [2025-10-02T21:29:39.154452] [INFO ] [LOCAL ] SIG: Starting deletion of primary data. [2025-10-02T21:29:39.154772] [DEBUG] [LOCAL ] SIG: Deleted primary data file. [2025-10-02T21:29:39.154857] [INFO ] [MAIN ] SIG: Starting full primary refresh. [2025-10-02T21:29:39.478174] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-10. [2025-10-02T21:29:39.558347] [INFO ] [REMOTE ] SIG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:29:40.272990] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-03. [2025-10-02T21:29:40.345461] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-02T21:29:40.596808] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-02T21:29:40.598854] [INFO ] [REMOTE ] SHO: Full fetch complete (71038 records). [2025-10-02T21:29:40.598960] [DEBUG] [VALIDATOR ] SHO: Validating primary data. [2025-10-02T21:29:41.021300] [DEBUG] [VALIDATOR ] SHO: All expected trading days are present. [2025-10-02T21:29:41.021398] [DEBUG] [VALIDATOR ] SHO: Primary data validation passed. [2025-10-02T21:29:41.022589] [INFO ] [MAIN ] SHO: Fetched primary data is valid. [2025-10-02T21:29:41.022678] [DEBUG] [LOCAL ] SHO: Saving primary data. [2025-10-02T21:29:41.024212] [DEBUG] [LOCAL ] SHO: Trimmed 71038 records to 50021 (keeping 200 days of data) [2025-10-02T21:29:41.079171] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-07. [2025-10-02T21:29:41.343901] [DEBUG] [LOCAL ] SHO: Primary data saved (50021 records). [2025-10-02T21:29:41.344060] [INFO ] [MAIN ] SHO: Full history saved. [2025-10-02T21:29:41.344150] [INFO ] [MAIN ] Update Progress: 1913/2370 symbols completed. SHO took 41.4s. Estimated remaining: 1h 4m 25s. Rate: 7.1 symbols/min [2025-10-02T21:29:41.527160] [INFO ] [MAIN ] SII: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:29:41.551689] [DEBUG] [LOCAL ] SII: Loaded 23579 existing records from primary storage. [2025-10-02T21:29:41.552163] [INFO ] [MAIN ] SII: Loaded 23579 existing records. [2025-10-02T21:29:41.750844] [WARN ] [MAIN ] SII: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:29:41.751259] [INFO ] [MAIN ] SII: Wiping existing primary data before full refresh. [2025-10-02T21:29:41.751342] [INFO ] [LOCAL ] SII: Starting deletion of primary data. [2025-10-02T21:29:41.751873] [DEBUG] [LOCAL ] SII: Deleted primary data file. [2025-10-02T21:29:41.751939] [INFO ] [MAIN ] SII: Starting full primary refresh. [2025-10-02T21:29:41.877571] [INFO ] [REMOTE ] SIG: Fetching primary data for 2024-12. [2025-10-02T21:29:42.042969] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-02T21:29:42.196117] [INFO ] [REMOTE ] SII: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:29:42.673023] [INFO ] [REMOTE ] SII: Fetching primary data for 2024-12. [2025-10-02T21:29:42.985391] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-02T21:29:43.134348] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-02T21:29:43.322582] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-02T21:29:43.473015] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-08. [2025-10-02T21:29:44.273025] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-01. [2025-10-02T21:29:45.077981] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-01. [2025-10-02T21:29:45.083522] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-02T21:29:45.259721] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-02T21:29:45.873012] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-04. [2025-10-02T21:29:46.672990] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-02. [2025-10-02T21:29:46.822036] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-02T21:29:47.347010] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-02T21:29:47.473002] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-02. [2025-10-02T21:29:47.527884] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-02T21:29:48.272999] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-05. [2025-10-02T21:29:49.073005] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-03. [2025-10-02T21:29:49.169497] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-02T21:29:49.875391] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-03. [2025-10-02T21:29:49.882393] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-02T21:29:50.210081] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-02T21:29:50.673001] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-04. [2025-10-02T21:29:51.472978] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-06. [2025-10-02T21:29:51.629555] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-02T21:29:51.693379] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-02T21:29:52.273043] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-05. [2025-10-02T21:29:52.628612] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-02T21:29:53.073065] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-07. [2025-10-02T21:29:53.349100] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-02T21:29:53.873000] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-09. [2025-10-02T21:29:54.672987] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-06. [2025-10-02T21:29:54.826054] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-02T21:29:55.472976] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-08. [2025-10-02T21:29:55.656727] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-02T21:29:55.882417] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-02T21:29:56.272998] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-04. [2025-10-02T21:29:57.076931] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-10. [2025-10-02T21:29:57.084824] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-02T21:29:57.691818] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-02T21:29:57.873014] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-07. [2025-10-02T21:29:58.453262] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-02T21:29:58.455233] [INFO ] [REMOTE ] SHW: Full fetch complete (72978 records). [2025-10-02T21:29:58.455339] [DEBUG] [VALIDATOR ] SHW: Validating primary data. [2025-10-02T21:29:58.678212] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-09. [2025-10-02T21:29:58.881114] [DEBUG] [VALIDATOR ] SHW: All expected trading days are present. [2025-10-02T21:29:58.881234] [DEBUG] [VALIDATOR ] SHW: Primary data validation passed. [2025-10-02T21:29:58.882628] [INFO ] [MAIN ] SHW: Fetched primary data is valid. [2025-10-02T21:29:58.882722] [DEBUG] [LOCAL ] SHW: Saving primary data. [2025-10-02T21:29:58.884246] [DEBUG] [LOCAL ] SHW: Trimmed 72978 records to 50680 (keeping 200 days of data) [2025-10-02T21:29:59.129187] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-02T21:29:59.241528] [DEBUG] [LOCAL ] SHW: Primary data saved (50680 records). [2025-10-02T21:29:59.241743] [INFO ] [MAIN ] SHW: Full history saved. [2025-10-02T21:29:59.241868] [INFO ] [MAIN ] Update Progress: 1914/2370 symbols completed. SHW took 42.4s. Estimated remaining: 1h 4m 18s. Rate: 7.1 symbols/min [2025-10-02T21:29:59.454404] [INFO ] [MAIN ] SILA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:29:59.473898] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-05. [2025-10-02T21:29:59.490202] [DEBUG] [LOCAL ] SILA: Loaded 30819 existing records from primary storage. [2025-10-02T21:29:59.490561] [INFO ] [MAIN ] SILA: Loaded 30819 existing records. [2025-10-02T21:29:59.699059] [WARN ] [MAIN ] SILA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:29:59.699342] [INFO ] [MAIN ] SILA: Wiping existing primary data before full refresh. [2025-10-02T21:29:59.699418] [INFO ] [LOCAL ] SILA: Starting deletion of primary data. [2025-10-02T21:29:59.699708] [DEBUG] [LOCAL ] SILA: Deleted primary data file. [2025-10-02T21:29:59.699769] [INFO ] [MAIN ] SILA: Starting full primary refresh. [2025-10-02T21:30:00.122795] [INFO ] [REMOTE ] SILA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:30:00.208705] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-02T21:30:00.273043] [INFO ] [REMOTE ] SILA: Fetching primary data for 2024-12. [2025-10-02T21:30:00.957534] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-02T21:30:01.073007] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-06. [2025-10-02T21:30:01.240045] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-02T21:30:01.873041] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-10. [2025-10-02T21:30:02.672971] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-08. [2025-10-02T21:30:02.849580] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-02T21:30:02.851720] [INFO ] [REMOTE ] SID: Full fetch complete (60824 records). [2025-10-02T21:30:02.851886] [DEBUG] [VALIDATOR ] SID: Validating primary data. [2025-10-02T21:30:03.234240] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-10-02T21:30:03.376234] [DEBUG] [VALIDATOR ] SID: All expected trading days are present. [2025-10-02T21:30:03.376378] [DEBUG] [VALIDATOR ] SID: Primary data validation passed. [2025-10-02T21:30:03.377512] [INFO ] [MAIN ] SID: Fetched primary data is valid. [2025-10-02T21:30:03.377580] [DEBUG] [LOCAL ] SID: Saving primary data. [2025-10-02T21:30:03.379006] [DEBUG] [LOCAL ] SID: Trimmed 60824 records to 42611 (keeping 200 days of data) [2025-10-02T21:30:03.478158] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-07. [2025-10-02T21:30:03.659489] [DEBUG] [LOCAL ] SID: Primary data saved (42611 records). [2025-10-02T21:30:03.659633] [INFO ] [MAIN ] SID: Full history saved. [2025-10-02T21:30:03.660513] [INFO ] [MAIN ] Update Progress: 1915/2370 symbols completed. SID took 36.0s. Estimated remaining: 1h 4m 9s. Rate: 7.1 symbols/min [2025-10-02T21:30:03.863466] [INFO ] [MAIN ] SITC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:30:03.879218] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-02T21:30:03.919815] [DEBUG] [LOCAL ] SITC: Loaded 41600 existing records from primary storage. [2025-10-02T21:30:03.920168] [INFO ] [MAIN ] SITC: Loaded 41600 existing records. [2025-10-02T21:30:04.113947] [WARN ] [MAIN ] SITC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:30:04.114151] [INFO ] [MAIN ] SITC: Wiping existing primary data before full refresh. [2025-10-02T21:30:04.114202] [INFO ] [LOCAL ] SITC: Starting deletion of primary data. [2025-10-02T21:30:04.114458] [DEBUG] [LOCAL ] SITC: Deleted primary data file. [2025-10-02T21:30:04.114519] [INFO ] [MAIN ] SITC: Starting full primary refresh. [2025-10-02T21:30:04.273812] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-01. [2025-10-02T21:30:04.517425] [INFO ] [REMOTE ] SITC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:30:05.073015] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-09. [2025-10-02T21:30:05.208552] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-02T21:30:05.450524] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-02T21:30:05.873002] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-02. [2025-10-02T21:30:06.228677] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-02T21:30:06.673001] [INFO ] [REMOTE ] SITC: Fetching primary data for 2024-12. [2025-10-02T21:30:07.256720] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-02T21:30:07.473018] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-03. [2025-10-02T21:30:08.046527] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-02T21:30:08.272995] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-01. [2025-10-02T21:30:08.547108] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-02T21:30:09.073001] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-08. [2025-10-02T21:30:09.858564] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-02T21:30:09.872960] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-10. [2025-10-02T21:30:10.369765] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-02T21:30:10.673007] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-02. [2025-10-02T21:30:10.730080] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-02T21:30:10.731466] [INFO ] [REMOTE ] SII: Full fetch complete (30198 records). [2025-10-02T21:30:10.731617] [DEBUG] [VALIDATOR ] SII: Validating primary data. [2025-10-02T21:30:11.142429] [DEBUG] [VALIDATOR ] SII: All expected trading days are present. [2025-10-02T21:30:11.142511] [DEBUG] [VALIDATOR ] SII: Primary data validation passed. [2025-10-02T21:30:11.143132] [INFO ] [MAIN ] SII: Fetched primary data is valid. [2025-10-02T21:30:11.143194] [DEBUG] [LOCAL ] SII: Saving primary data. [2025-10-02T21:30:11.144016] [DEBUG] [LOCAL ] SII: Trimmed 30198 records to 23725 (keeping 200 days of data) [2025-10-02T21:30:11.295407] [DEBUG] [LOCAL ] SII: Primary data saved (23725 records). [2025-10-02T21:30:11.295548] [INFO ] [MAIN ] SII: Full history saved. [2025-10-02T21:30:11.295634] [INFO ] [MAIN ] Update Progress: 1916/2370 symbols completed. SII took 30.0s. Estimated remaining: 1h 4m 0s. Rate: 7.1 symbols/min [2025-10-02T21:30:11.477981] [INFO ] [MAIN ] SITE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:30:11.476390] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-04. [2025-10-02T21:30:11.515614] [DEBUG] [LOCAL ] SITE: Loaded 35012 existing records from primary storage. [2025-10-02T21:30:11.515924] [INFO ] [MAIN ] SITE: Loaded 35012 existing records. [2025-10-02T21:30:11.714095] [WARN ] [MAIN ] SITE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:30:11.714286] [INFO ] [MAIN ] SITE: Wiping existing primary data before full refresh. [2025-10-02T21:30:11.714335] [INFO ] [LOCAL ] SITE: Starting deletion of primary data. [2025-10-02T21:30:11.714807] [DEBUG] [LOCAL ] SITE: Deleted primary data file. [2025-10-02T21:30:11.714868] [INFO ] [MAIN ] SITE: Starting full primary refresh. [2025-10-02T21:30:12.118730] [INFO ] [REMOTE ] SITE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:30:12.242365] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-02T21:30:12.273032] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-03. [2025-10-02T21:30:12.619096] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-02T21:30:13.073007] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-05. [2025-10-02T21:30:13.873021] [INFO ] [REMOTE ] SITE: Fetching primary data for 2024-12. [2025-10-02T21:30:13.940562] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-02T21:30:14.138618] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-02T21:30:14.673009] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-04. [2025-10-02T21:30:15.167824] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-02T21:30:15.473061] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-06. [2025-10-02T21:30:16.036681] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-02T21:30:16.273007] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-09. [2025-10-02T21:30:16.529748] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-02T21:30:17.073021] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-05. [2025-10-02T21:30:17.881136] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-01. [2025-10-02T21:30:17.886848] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-02T21:30:18.579535] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-02T21:30:18.673012] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-07. [2025-10-02T21:30:19.342189] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-02T21:30:19.473005] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-06. [2025-10-02T21:30:20.064501] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-02T21:30:20.272993] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-10. [2025-10-02T21:30:20.609053] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-02T21:30:21.073007] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-02. [2025-10-02T21:30:21.293781] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-02T21:30:21.295785] [INFO ] [REMOTE ] SIG: Full fetch complete (67960 records). [2025-10-02T21:30:21.295926] [DEBUG] [VALIDATOR ] SIG: Validating primary data. [2025-10-02T21:30:21.755720] [DEBUG] [VALIDATOR ] SIG: All expected trading days are present. [2025-10-02T21:30:21.755821] [DEBUG] [VALIDATOR ] SIG: Primary data validation passed. [2025-10-02T21:30:21.756873] [INFO ] [MAIN ] SIG: Fetched primary data is valid. [2025-10-02T21:30:21.756939] [DEBUG] [LOCAL ] SIG: Saving primary data. [2025-10-02T21:30:21.758393] [DEBUG] [LOCAL ] SIG: Trimmed 67960 records to 46516 (keeping 200 days of data) [2025-10-02T21:30:21.873276] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-07. [2025-10-02T21:30:22.077976] [DEBUG] [LOCAL ] SIG: Primary data saved (46516 records). [2025-10-02T21:30:22.078194] [INFO ] [MAIN ] SIG: Full history saved. [2025-10-02T21:30:22.078313] [INFO ] [MAIN ] Update Progress: 1917/2370 symbols completed. SIG took 43.4s. Estimated remaining: 1h 3m 52s. Rate: 7.1 symbols/min [2025-10-02T21:30:22.443966] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-02T21:30:22.673003] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-03. [2025-10-02T21:30:23.472984] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-08. [2025-10-02T21:30:23.569358] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-02T21:30:23.794916] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-02T21:30:24.273001] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-08. [2025-10-02T21:30:24.713863] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-02T21:30:25.072996] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-09. [2025-10-02T21:30:25.649831] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-02T21:30:25.872999] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-04. [2025-10-02T21:30:26.224818] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-02T21:30:26.673003] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-10. [2025-10-02T21:30:27.165487] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-02T21:30:27.472989] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-05. [2025-10-02T21:30:27.622341] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-02T21:30:27.623837] [INFO ] [REMOTE ] SILA: Full fetch complete (45058 records). [2025-10-02T21:30:27.623925] [DEBUG] [VALIDATOR ] SILA: Validating primary data. [2025-10-02T21:30:28.033101] [DEBUG] [VALIDATOR ] SILA: All expected trading days are present. [2025-10-02T21:30:28.033206] [DEBUG] [VALIDATOR ] SILA: Primary data validation passed. [2025-10-02T21:30:28.034214] [INFO ] [MAIN ] SILA: Fetched primary data is valid. [2025-10-02T21:30:28.034289] [DEBUG] [LOCAL ] SILA: Saving primary data. [2025-10-02T21:30:28.035616] [DEBUG] [LOCAL ] SILA: Trimmed 45058 records to 31038 (keeping 200 days of data) [2025-10-02T21:30:28.231215] [DEBUG] [LOCAL ] SILA: Primary data saved (31038 records). [2025-10-02T21:30:28.231359] [INFO ] [MAIN ] SILA: Full history saved. [2025-10-02T21:30:28.231445] [INFO ] [MAIN ] Update Progress: 1918/2370 symbols completed. SILA took 29.0s. Estimated remaining: 1h 3m 43s. Rate: 7.1 symbols/min [2025-10-02T21:30:28.272981] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-09. [2025-10-02T21:30:28.869276] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-02T21:30:29.073004] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-06. [2025-10-02T21:30:29.925007] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-02T21:30:29.936216] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-10. [2025-10-02T21:30:29.984988] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-02T21:30:30.673020] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-07. [2025-10-02T21:30:30.808380] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-02T21:30:30.810161] [INFO ] [REMOTE ] SITC: Full fetch complete (60907 records). [2025-10-02T21:30:30.810261] [DEBUG] [VALIDATOR ] SITC: Validating primary data. [2025-10-02T21:30:31.227077] [DEBUG] [VALIDATOR ] SITC: All expected trading days are present. [2025-10-02T21:30:31.227167] [DEBUG] [VALIDATOR ] SITC: Primary data validation passed. [2025-10-02T21:30:31.228374] [INFO ] [MAIN ] SITC: Fetched primary data is valid. [2025-10-02T21:30:31.228441] [DEBUG] [LOCAL ] SITC: Saving primary data. [2025-10-02T21:30:31.230069] [DEBUG] [LOCAL ] SITC: Trimmed 60907 records to 41887 (keeping 200 days of data) [2025-10-02T21:30:31.497516] [DEBUG] [LOCAL ] SITC: Primary data saved (41887 records). [2025-10-02T21:30:31.497669] [INFO ] [MAIN ] SITC: Full history saved. [2025-10-02T21:30:31.498740] [INFO ] [MAIN ] Update Progress: 1919/2370 symbols completed. SITC took 27.8s. Estimated remaining: 1h 3m 34s. Rate: 7.1 symbols/min [2025-10-02T21:30:31.836408] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-02T21:30:31.845055] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-08. [2025-10-02T21:30:33.190816] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-02T21:30:33.202171] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-09. [2025-10-02T21:30:34.690694] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-02T21:30:34.702801] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-10. [2025-10-02T21:30:35.775618] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-02T21:30:35.777333] [INFO ] [REMOTE ] SITE: Full fetch complete (49718 records). [2025-10-02T21:30:35.777442] [DEBUG] [VALIDATOR ] SITE: Validating primary data. [2025-10-02T21:30:36.214762] [DEBUG] [VALIDATOR ] SITE: All expected trading days are present. [2025-10-02T21:30:36.214855] [DEBUG] [VALIDATOR ] SITE: Primary data validation passed. [2025-10-02T21:30:36.216261] [INFO ] [MAIN ] SITE: Fetched primary data is valid. [2025-10-02T21:30:36.216391] [DEBUG] [LOCAL ] SITE: Saving primary data. [2025-10-02T21:30:36.221777] [DEBUG] [LOCAL ] SITE: Trimmed 49718 records to 35303 (keeping 200 days of data) [2025-10-02T21:30:36.463661] [DEBUG] [LOCAL ] SITE: Primary data saved (35303 records). [2025-10-02T21:30:36.463819] [INFO ] [MAIN ] SITE: Full history saved. [2025-10-02T21:30:36.464007] [INFO ] [MAIN ] Update Progress: 1920/2370 symbols completed. SITE took 25.2s. Estimated remaining: 1h 3m 25s. Rate: 7.1 symbols/min [2025-10-02T21:30:37.078859] [INFO ] [MAIN ] SKIL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:30:37.199118] [INFO ] [MAIN ] SKE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:30:37.192023] [INFO ] [MAIN ] SJT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:30:37.261259] [INFO ] [MAIN ] SJM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:30:37.266032] [DEBUG] [LOCAL ] SKIL: Loaded 6339 existing records from primary storage. [2025-10-02T21:30:37.266893] [INFO ] [MAIN ] SKIL: Loaded 6339 existing records. [2025-10-02T21:30:37.411536] [DEBUG] [LOCAL ] SJT: Loaded 22413 existing records from primary storage. [2025-10-02T21:30:37.428225] [INFO ] [MAIN ] SJT: Loaded 22413 existing records. [2025-10-02T21:30:37.566871] [WARN ] [MAIN ] SKIL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:30:37.560608] [DEBUG] [LOCAL ] SKE: Loaded 35974 existing records from primary storage. [2025-10-02T21:30:37.594694] [INFO ] [MAIN ] SKE: Loaded 35974 existing records. [2025-10-02T21:30:37.594528] [INFO ] [MAIN ] SKIL: Wiping existing primary data before full refresh. [2025-10-02T21:30:37.600209] [INFO ] [LOCAL ] SKIL: Starting deletion of primary data. [2025-10-02T21:30:37.704521] [DEBUG] [LOCAL ] SKIL: Deleted primary data file. [2025-10-02T21:30:37.728261] [DEBUG] [LOCAL ] SJM: Loaded 50162 existing records from primary storage. [2025-10-02T21:30:37.738862] [INFO ] [MAIN ] SKIL: Starting full primary refresh. [2025-10-02T21:30:37.847626] [INFO ] [MAIN ] SJM: Loaded 50162 existing records. [2025-10-02T21:30:37.947547] [WARN ] [MAIN ] SJT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:30:38.083890] [INFO ] [MAIN ] SJT: Wiping existing primary data before full refresh. [2025-10-02T21:30:38.133125] [INFO ] [LOCAL ] SJT: Starting deletion of primary data. [2025-10-02T21:30:38.191091] [WARN ] [MAIN ] SKE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:30:38.258570] [DEBUG] [LOCAL ] SJT: Deleted primary data file. [2025-10-02T21:30:38.287072] [INFO ] [MAIN ] SJT: Starting full primary refresh. [2025-10-02T21:30:38.276983] [INFO ] [MAIN ] SKE: Wiping existing primary data before full refresh. [2025-10-02T21:30:38.288124] [INFO ] [LOCAL ] SKE: Starting deletion of primary data. [2025-10-02T21:30:38.374570] [DEBUG] [LOCAL ] SKE: Deleted primary data file. [2025-10-02T21:30:38.415714] [INFO ] [MAIN ] SKE: Starting full primary refresh. [2025-10-02T21:30:38.504932] [WARN ] [MAIN ] SJM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:30:38.594927] [INFO ] [MAIN ] SJM: Wiping existing primary data before full refresh. [2025-10-02T21:30:38.655474] [INFO ] [LOCAL ] SJM: Starting deletion of primary data. [2025-10-02T21:30:38.821022] [DEBUG] [LOCAL ] SJM: Deleted primary data file. [2025-10-02T21:30:38.879095] [INFO ] [MAIN ] SJM: Starting full primary refresh. [2025-10-02T21:30:38.869325] [INFO ] [REMOTE ] SKIL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:30:38.896053] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2024-12. [2025-10-02T21:30:39.744177] [INFO ] [REMOTE ] SKE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:30:39.748056] [INFO ] [REMOTE ] SKE: Fetching primary data for 2024-12. [2025-10-02T21:30:39.760047] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-02T21:30:39.759345] [INFO ] [REMOTE ] SJT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:30:39.770098] [INFO ] [REMOTE ] SJT: Fetching primary data for 2024-12. [2025-10-02T21:30:39.763083] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-01. [2025-10-02T21:30:39.875059] [INFO ] [REMOTE ] SJM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:30:39.875438] [INFO ] [REMOTE ] SJM: Fetching primary data for 2024-12. [2025-10-02T21:30:40.631560] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-02T21:30:40.634681] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-02. [2025-10-02T21:30:40.814526] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-02T21:30:40.823171] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-01. [2025-10-02T21:30:40.948032] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-02T21:30:40.954355] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-01. [2025-10-02T21:30:41.035081] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-02T21:30:41.045217] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-01. [2025-10-02T21:30:41.364497] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-02T21:30:41.366767] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-03. [2025-10-02T21:30:41.587441] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-02T21:30:41.845251] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-02T21:30:41.872972] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-02. [2025-10-02T21:30:42.034482] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-02T21:30:42.480604] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-02T21:30:42.623460] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-02T21:30:42.672989] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-03. [2025-10-02T21:30:43.473006] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-02. [2025-10-02T21:30:43.770091] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-02T21:30:44.273015] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-04. [2025-10-02T21:30:45.073077] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-04. [2025-10-02T21:30:45.117253] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-02T21:30:45.148132] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-02T21:30:45.872977] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-03. [2025-10-02T21:30:46.200720] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-02T21:30:46.673014] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-02. [2025-10-02T21:30:47.316075] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-02T21:30:47.473055] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-05. [2025-10-02T21:30:48.002709] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-02T21:30:48.272977] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-03. [2025-10-02T21:30:48.721500] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-02T21:30:49.073043] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-04. [2025-10-02T21:30:49.713558] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-02T21:30:49.873010] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-04. [2025-10-02T21:30:50.673000] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-05. [2025-10-02T21:30:50.805969] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-02T21:30:51.040265] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-02T21:30:51.295965] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-02T21:30:51.473040] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-05. [2025-10-02T21:30:52.273024] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-06. [2025-10-02T21:30:52.871606] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-02T21:30:53.073025] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-06. [2025-10-02T21:30:53.330691] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-02T21:30:53.873060] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-05. [2025-10-02T21:30:54.673044] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-06. [2025-10-02T21:30:54.994455] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-02T21:30:55.253127] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-02T21:30:55.451779] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-02T21:30:55.472949] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-07. [2025-10-02T21:30:56.213293] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-02T21:30:56.273052] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-06. [2025-10-02T21:30:57.073048] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-07. [2025-10-02T21:30:57.481801] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-02T21:30:57.873043] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-07. [2025-10-02T21:30:58.673012] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-07. [2025-10-02T21:30:58.977398] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-02T21:30:59.299928] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-02T21:30:59.416396] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-02T21:30:59.472987] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-08. [2025-10-02T21:31:00.273003] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-08. [2025-10-02T21:31:00.771123] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-02T21:31:01.073026] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-08. [2025-10-02T21:31:01.873062] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-08. [2025-10-02T21:31:01.938150] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-02T21:31:02.561226] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-02T21:31:02.561051] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-02T21:31:02.673218] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-09. [2025-10-02T21:31:03.472995] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-09. [2025-10-02T21:31:03.942280] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-02T21:31:04.273023] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-09. [2025-10-02T21:31:05.073012] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-09. [2025-10-02T21:31:05.099667] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-02T21:31:05.233567] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-02T21:31:05.873019] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-10. [2025-10-02T21:31:06.254520] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-02T21:31:06.673013] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-10. [2025-10-02T21:31:07.189281] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-02T21:31:07.191410] [INFO ] [REMOTE ] SKE: Full fetch complete (50581 records). [2025-10-02T21:31:07.191615] [DEBUG] [VALIDATOR ] SKE: Validating primary data. [2025-10-02T21:31:07.288538] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-02T21:31:07.307426] [INFO ] [REMOTE ] SKIL: Full fetch complete (9915 records). [2025-10-02T21:31:07.318264] [DEBUG] [VALIDATOR ] SKIL: Validating primary data. [2025-10-02T21:31:07.477821] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-10. [2025-10-02T21:31:08.012565] [DEBUG] [VALIDATOR ] SKE: All expected trading days are present. [2025-10-02T21:31:08.023074] [DEBUG] [VALIDATOR ] SKE: Primary data validation passed. [2025-10-02T21:31:08.055891] [INFO ] [MAIN ] SKE: Fetched primary data is valid. [2025-10-02T21:31:08.066855] [DEBUG] [LOCAL ] SKE: Saving primary data. [2025-10-02T21:31:08.093477] [DEBUG] [VALIDATOR ] SKIL: All expected trading days are present. [2025-10-02T21:31:08.093597] [DEBUG] [VALIDATOR ] SKIL: Primary data validation passed. [2025-10-02T21:31:08.093823] [INFO ] [MAIN ] SKIL: Fetched primary data is valid. [2025-10-02T21:31:08.093948] [DEBUG] [LOCAL ] SKIL: Saving primary data. [2025-10-02T21:31:08.094630] [DEBUG] [LOCAL ] SKE: Trimmed 50581 records to 36337 (keeping 200 days of data) [2025-10-02T21:31:08.095960] [DEBUG] [LOCAL ] SKIL: Trimmed 9915 records to 6387 (keeping 200 days of data) [2025-10-02T21:31:08.302633] [DEBUG] [LOCAL ] SKIL: Primary data saved (6387 records). [2025-10-02T21:31:08.302486] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-10. [2025-10-02T21:31:08.303759] [INFO ] [MAIN ] SKIL: Full history saved. [2025-10-02T21:31:08.303987] [INFO ] [MAIN ] Update Progress: 1921/2370 symbols completed. SKIL took 31.8s. Estimated remaining: 1h 3m 22s. Rate: 7.1 symbols/min [2025-10-02T21:31:08.444242] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-02T21:31:08.465459] [INFO ] [REMOTE ] SJT: Full fetch complete (32051 records). [2025-10-02T21:31:08.482520] [DEBUG] [VALIDATOR ] SJT: Validating primary data. [2025-10-02T21:31:08.599635] [INFO ] [MAIN ] SKLZ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:31:08.733100] [DEBUG] [LOCAL ] SKLZ: Loaded 11725 existing records from primary storage. [2025-10-02T21:31:08.745291] [INFO ] [MAIN ] SKLZ: Loaded 11725 existing records. [2025-10-02T21:31:09.192902] [WARN ] [MAIN ] SKLZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:31:09.203805] [INFO ] [MAIN ] SKLZ: Wiping existing primary data before full refresh. [2025-10-02T21:31:09.207714] [DEBUG] [LOCAL ] SKE: Primary data saved (36337 records). [2025-10-02T21:31:09.204605] [INFO ] [LOCAL ] SKLZ: Starting deletion of primary data. [2025-10-02T21:31:09.218399] [INFO ] [MAIN ] SKE: Full history saved. [2025-10-02T21:31:09.235179] [INFO ] [MAIN ] Update Progress: 1922/2370 symbols completed. SKE took 32.8s. Estimated remaining: 1h 3m 11s. Rate: 7.1 symbols/min [2025-10-02T21:31:09.235288] [DEBUG] [LOCAL ] SKLZ: Deleted primary data file. [2025-10-02T21:31:09.327560] [INFO ] [MAIN ] SKLZ: Starting full primary refresh. [2025-10-02T21:31:09.338061] [DEBUG] [VALIDATOR ] SJT: All expected trading days are present. [2025-10-02T21:31:09.343435] [DEBUG] [VALIDATOR ] SJT: Primary data validation passed. [2025-10-02T21:31:09.386443] [INFO ] [MAIN ] SJT: Fetched primary data is valid. [2025-10-02T21:31:09.402156] [DEBUG] [LOCAL ] SJT: Saving primary data. [2025-10-02T21:31:09.557948] [DEBUG] [LOCAL ] SJT: Trimmed 32051 records to 22551 (keeping 200 days of data) [2025-10-02T21:31:09.622424] [INFO ] [MAIN ] SKM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:31:09.808804] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-02T21:31:09.831943] [INFO ] [REMOTE ] SJM: Full fetch complete (72120 records). [2025-10-02T21:31:09.861300] [DEBUG] [VALIDATOR ] SJM: Validating primary data. [2025-10-02T21:31:10.000329] [DEBUG] [LOCAL ] SKM: Loaded 34920 existing records from primary storage. [2025-10-02T21:31:10.048414] [INFO ] [MAIN ] SKM: Loaded 34920 existing records. [2025-10-02T21:31:10.224080] [INFO ] [REMOTE ] SKLZ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:31:10.238875] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2024-12. [2025-10-02T21:31:10.390565] [DEBUG] [LOCAL ] SJT: Primary data saved (22551 records). [2025-10-02T21:31:10.397486] [INFO ] [MAIN ] SJT: Full history saved. [2025-10-02T21:31:10.441580] [INFO ] [MAIN ] Update Progress: 1923/2370 symbols completed. SJT took 34.0s. Estimated remaining: 1h 3m 1s. Rate: 7.1 symbols/min [2025-10-02T21:31:10.539798] [WARN ] [MAIN ] SKM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:31:10.590759] [INFO ] [MAIN ] SKM: Wiping existing primary data before full refresh. [2025-10-02T21:31:10.608715] [INFO ] [LOCAL ] SKM: Starting deletion of primary data. [2025-10-02T21:31:10.664956] [DEBUG] [LOCAL ] SKM: Deleted primary data file. [2025-10-02T21:31:10.717246] [INFO ] [MAIN ] SKM: Starting full primary refresh. [2025-10-02T21:31:11.042372] [INFO ] [MAIN ] SKT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:31:11.072112] [DEBUG] [VALIDATOR ] SJM: All expected trading days are present. [2025-10-02T21:31:11.088357] [DEBUG] [VALIDATOR ] SJM: Primary data validation passed. [2025-10-02T21:31:11.110715] [INFO ] [MAIN ] SJM: Fetched primary data is valid. [2025-10-02T21:31:11.126894] [DEBUG] [LOCAL ] SJM: Saving primary data. [2025-10-02T21:31:11.182823] [DEBUG] [LOCAL ] SJM: Trimmed 72120 records to 50512 (keeping 200 days of data) [2025-10-02T21:31:11.367372] [DEBUG] [LOCAL ] SKT: Loaded 42490 existing records from primary storage. [2025-10-02T21:31:11.408572] [INFO ] [MAIN ] SKT: Loaded 42490 existing records. [2025-10-02T21:31:11.538638] [INFO ] [REMOTE ] SKM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:31:11.545836] [INFO ] [REMOTE ] SKM: Fetching primary data for 2024-12. [2025-10-02T21:31:11.634043] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-02T21:31:11.640376] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-01. [2025-10-02T21:31:11.736253] [WARN ] [MAIN ] SKT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:31:11.738588] [INFO ] [MAIN ] SKT: Wiping existing primary data before full refresh. [2025-10-02T21:31:11.738689] [INFO ] [LOCAL ] SKT: Starting deletion of primary data. [2025-10-02T21:31:11.739507] [DEBUG] [LOCAL ] SKT: Deleted primary data file. [2025-10-02T21:31:11.739579] [INFO ] [MAIN ] SKT: Starting full primary refresh. [2025-10-02T21:31:12.233726] [INFO ] [REMOTE ] SKT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:31:12.244069] [INFO ] [REMOTE ] SKT: Fetching primary data for 2024-12. [2025-10-02T21:31:12.377127] [DEBUG] [LOCAL ] SJM: Primary data saved (50512 records). [2025-10-02T21:31:12.377268] [INFO ] [MAIN ] SJM: Full history saved. [2025-10-02T21:31:12.377350] [INFO ] [MAIN ] Update Progress: 1924/2370 symbols completed. SJM took 35.9s. Estimated remaining: 1h 2m 51s. Rate: 7.1 symbols/min [2025-10-02T21:31:12.563842] [INFO ] [MAIN ] SKY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:31:12.582558] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-02T21:31:12.590120] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-01. [2025-10-02T21:31:12.636139] [DEBUG] [LOCAL ] SKY: Loaded 37776 existing records from primary storage. [2025-10-02T21:31:12.636482] [INFO ] [MAIN ] SKY: Loaded 37776 existing records. [2025-10-02T21:31:12.763807] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-02T21:31:12.849524] [WARN ] [MAIN ] SKY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:31:12.849758] [INFO ] [MAIN ] SKY: Wiping existing primary data before full refresh. [2025-10-02T21:31:12.849861] [INFO ] [LOCAL ] SKY: Starting deletion of primary data. [2025-10-02T21:31:12.851020] [DEBUG] [LOCAL ] SKY: Deleted primary data file. [2025-10-02T21:31:12.851083] [INFO ] [MAIN ] SKY: Starting full primary refresh. [2025-10-02T21:31:13.081627] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-02. [2025-10-02T21:31:13.269394] [INFO ] [REMOTE ] SKY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:31:13.680218] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-02T21:31:13.697286] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-02T21:31:13.836078] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-02T21:31:13.873015] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-03. [2025-10-02T21:31:14.672992] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-02. [2025-10-02T21:31:14.794339] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-02T21:31:15.472976] [INFO ] [REMOTE ] SKY: Fetching primary data for 2024-12. [2025-10-02T21:31:15.923050] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-02T21:31:16.273016] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-01. [2025-10-02T21:31:16.805517] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-02T21:31:17.073000] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-03. [2025-10-02T21:31:17.602131] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-02T21:31:17.872997] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-01. [2025-10-02T21:31:18.459021] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-02T21:31:18.672978] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-04. [2025-10-02T21:31:18.969372] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-02T21:31:19.473005] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-02. [2025-10-02T21:31:19.831210] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-02T21:31:20.273017] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-02. [2025-10-02T21:31:20.378046] [DEBUG] [REMOTE ] SKY: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-10-02T21:31:20.378454] [WARN ] [REMOTE ] SKY: No data returned for month 2025-02 [2025-10-02T21:31:20.378572] [FATAL] [REMOTE ] SKY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T21:31:20.378718] [FATAL] [MAIN ] SKY: Failed to fetch primary data. [2025-10-02T21:31:20.378801] [WARN ] [MAIN ] SKY: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T21:31:20.378877] [INFO ] [LOCAL ] SKY: Starting deletion of primary data. [2025-10-02T21:31:20.378951] [DEBUG] [LOCAL ] SKY: No primary data file found to delete. [2025-10-02T21:31:20.378992] [INFO ] [LOCAL ] SKY: Starting deletion of derivative data. [2025-10-02T21:31:20.379493] [DEBUG] [LOCAL ] SKY: Deleted derivative data file. [2025-10-02T21:31:20.379584] [INFO ] [MAIN ] Update Progress: 1925/2370 symbols completed. SKY took 8.0s. Estimated remaining: 1h 2m 43s. Rate: 7.1 symbols/min [2025-10-02T21:31:20.594970] [INFO ] [MAIN ] SKYH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:31:20.615155] [DEBUG] [LOCAL ] SKYH: Loaded 16585 existing records from primary storage. [2025-10-02T21:31:20.615551] [INFO ] [MAIN ] SKYH: Loaded 16585 existing records. [2025-10-02T21:31:20.824778] [WARN ] [MAIN ] SKYH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:31:20.825187] [INFO ] [MAIN ] SKYH: Wiping existing primary data before full refresh. [2025-10-02T21:31:20.825285] [INFO ] [LOCAL ] SKYH: Starting deletion of primary data. [2025-10-02T21:31:20.825636] [DEBUG] [LOCAL ] SKYH: Deleted primary data file. [2025-10-02T21:31:20.825740] [INFO ] [MAIN ] SKYH: Starting full primary refresh. [2025-10-02T21:31:21.077161] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-02T21:31:21.075560] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-04. [2025-10-02T21:31:21.278586] [INFO ] [REMOTE ] SKYH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:31:21.814195] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-02T21:31:21.873010] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-05. [2025-10-02T21:31:22.673020] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2024-12. [2025-10-02T21:31:23.207095] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-02T21:31:23.472987] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-06. [2025-10-02T21:31:23.663922] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-02T21:31:24.273019] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-05. [2025-10-02T21:31:24.844417] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-02T21:31:24.862074] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-02T21:31:25.073034] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-01. [2025-10-02T21:31:25.873002] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-03. [2025-10-02T21:31:25.885813] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-02T21:31:26.673026] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-06. [2025-10-02T21:31:27.441000] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-02T21:31:27.472968] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-02. [2025-10-02T21:31:27.507580] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-02T21:31:27.918010] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-02T21:31:28.272992] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-03. [2025-10-02T21:31:29.073036] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-04. [2025-10-02T21:31:29.299462] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-02T21:31:29.873007] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-04. [2025-10-02T21:31:30.526342] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-02T21:31:30.673036] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-07. [2025-10-02T21:31:30.880066] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-02T21:31:31.473013] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-05. [2025-10-02T21:31:31.885050] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-02T21:31:32.273019] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-05. [2025-10-02T21:31:32.475940] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-02T21:31:33.073039] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-07. [2025-10-02T21:31:33.797718] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-02T21:31:33.817395] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-02T21:31:33.872975] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-08. [2025-10-02T21:31:34.673002] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-06. [2025-10-02T21:31:35.191253] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-02T21:31:35.473016] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-06. [2025-10-02T21:31:35.518189] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-02T21:31:36.273004] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-07. [2025-10-02T21:31:36.576205] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-02T21:31:37.073041] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-07. [2025-10-02T21:31:37.183920] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-02T21:31:37.873029] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-08. [2025-10-02T21:31:38.509038] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-02T21:31:38.673013] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-08. [2025-10-02T21:31:38.814083] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-02T21:31:39.473002] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-08. [2025-10-02T21:31:40.129588] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-02T21:31:40.181677] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-02T21:31:40.273015] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-09. [2025-10-02T21:31:41.073009] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-09. [2025-10-02T21:31:41.677171] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-02T21:31:41.873025] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-09. [2025-10-02T21:31:42.642197] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-02T21:31:42.672992] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-10. [2025-10-02T21:31:42.728101] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-02T21:31:43.472984] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-10. [2025-10-02T21:31:43.514409] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-02T21:31:43.515951] [INFO ] [REMOTE ] SKM: Full fetch complete (48127 records). [2025-10-02T21:31:43.516033] [DEBUG] [VALIDATOR ] SKM: Validating primary data. [2025-10-02T21:31:43.931565] [DEBUG] [VALIDATOR ] SKM: All expected trading days are present. [2025-10-02T21:31:43.931906] [DEBUG] [VALIDATOR ] SKM: Primary data validation passed. [2025-10-02T21:31:43.932909] [INFO ] [MAIN ] SKM: Fetched primary data is valid. [2025-10-02T21:31:43.932973] [DEBUG] [LOCAL ] SKM: Saving primary data. [2025-10-02T21:31:43.934190] [DEBUG] [LOCAL ] SKM: Trimmed 48127 records to 35157 (keeping 200 days of data) [2025-10-02T21:31:44.139720] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-02T21:31:44.141997] [INFO ] [REMOTE ] SKLZ: Full fetch complete (18794 records). [2025-10-02T21:31:44.142103] [DEBUG] [VALIDATOR ] SKLZ: Validating primary data. [2025-10-02T21:31:44.275837] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-09. [2025-10-02T21:31:44.575051] [DEBUG] [VALIDATOR ] SKLZ: All expected trading days are present. [2025-10-02T21:31:44.575730] [DEBUG] [VALIDATOR ] SKLZ: Primary data validation passed. [2025-10-02T21:31:44.576545] [INFO ] [MAIN ] SKLZ: Fetched primary data is valid. [2025-10-02T21:31:44.577620] [DEBUG] [LOCAL ] SKLZ: Saving primary data. [2025-10-02T21:31:44.579850] [DEBUG] [LOCAL ] SKLZ: Trimmed 18794 records to 11809 (keeping 200 days of data) [2025-10-02T21:31:44.643105] [DEBUG] [LOCAL ] SKM: Primary data saved (35157 records). [2025-10-02T21:31:44.644419] [INFO ] [MAIN ] SKM: Full history saved. [2025-10-02T21:31:44.644858] [INFO ] [MAIN ] Update Progress: 1926/2370 symbols completed. SKM took 35.4s. Estimated remaining: 1h 2m 38s. Rate: 7.1 symbols/min [2025-10-02T21:31:44.752541] [DEBUG] [LOCAL ] SKLZ: Primary data saved (11809 records). [2025-10-02T21:31:44.768420] [INFO ] [MAIN ] SKLZ: Full history saved. [2025-10-02T21:31:44.780934] [INFO ] [MAIN ] Update Progress: 1927/2370 symbols completed. SKLZ took 36.5s. Estimated remaining: 1h 2m 27s. Rate: 7.1 symbols/min [2025-10-02T21:31:44.970093] [INFO ] [MAIN ] SLB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:31:45.063722] [INFO ] [MAIN ] SLF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:31:45.072979] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-10. [2025-10-02T21:31:45.129132] [DEBUG] [LOCAL ] SLB: Loaded 53697 existing records from primary storage. [2025-10-02T21:31:45.129685] [INFO ] [MAIN ] SLB: Loaded 53697 existing records. [2025-10-02T21:31:45.256832] [DEBUG] [LOCAL ] SLF: Loaded 38732 existing records from primary storage. [2025-10-02T21:31:45.263032] [INFO ] [MAIN ] SLF: Loaded 38732 existing records. [2025-10-02T21:31:45.468717] [WARN ] [MAIN ] SLB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:31:45.453161] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-02T21:31:45.481052] [INFO ] [MAIN ] SLB: Wiping existing primary data before full refresh. [2025-10-02T21:31:45.495297] [INFO ] [LOCAL ] SLB: Starting deletion of primary data. [2025-10-02T21:31:45.566687] [DEBUG] [LOCAL ] SLB: Deleted primary data file. [2025-10-02T21:31:45.573391] [WARN ] [MAIN ] SLF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:31:45.573512] [INFO ] [MAIN ] SLB: Starting full primary refresh. [2025-10-02T21:31:45.643433] [INFO ] [MAIN ] SLF: Wiping existing primary data before full refresh. [2025-10-02T21:31:45.665104] [INFO ] [LOCAL ] SLF: Starting deletion of primary data. [2025-10-02T21:31:45.683015] [DEBUG] [LOCAL ] SLF: Deleted primary data file. [2025-10-02T21:31:45.697991] [INFO ] [MAIN ] SLF: Starting full primary refresh. [2025-10-02T21:31:45.873159] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-10. [2025-10-02T21:31:46.204356] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-02T21:31:46.289167] [INFO ] [REMOTE ] SKT: Full fetch complete (60373 records). [2025-10-02T21:31:46.293192] [INFO ] [REMOTE ] SLB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:31:46.321590] [DEBUG] [VALIDATOR ] SKT: Validating primary data. [2025-10-02T21:31:46.514694] [INFO ] [REMOTE ] SLF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:31:46.682051] [INFO ] [REMOTE ] SLB: Fetching primary data for 2024-12. [2025-10-02T21:31:46.809940] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-02T21:31:46.835149] [INFO ] [REMOTE ] SKYH: Full fetch complete (22358 records). [2025-10-02T21:31:46.850625] [DEBUG] [VALIDATOR ] SKT: All expected trading days are present. [2025-10-02T21:31:46.850895] [DEBUG] [VALIDATOR ] SKT: Primary data validation passed. [2025-10-02T21:31:46.850819] [DEBUG] [VALIDATOR ] SKYH: Validating primary data. [2025-10-02T21:31:46.852434] [INFO ] [MAIN ] SKT: Fetched primary data is valid. [2025-10-02T21:31:46.852747] [DEBUG] [LOCAL ] SKT: Saving primary data. [2025-10-02T21:31:46.962432] [DEBUG] [LOCAL ] SKT: Trimmed 60373 records to 42800 (keeping 200 days of data) [2025-10-02T21:31:47.374583] [DEBUG] [VALIDATOR ] SKYH: All expected trading days are present. [2025-10-02T21:31:47.375079] [DEBUG] [VALIDATOR ] SKYH: Primary data validation passed. [2025-10-02T21:31:47.375950] [INFO ] [MAIN ] SKYH: Fetched primary data is valid. [2025-10-02T21:31:47.376039] [DEBUG] [LOCAL ] SKYH: Saving primary data. [2025-10-02T21:31:47.378978] [DEBUG] [LOCAL ] SKYH: Trimmed 22358 records to 16683 (keeping 200 days of data) [2025-10-02T21:31:47.474558] [INFO ] [REMOTE ] SLF: Fetching primary data for 2024-12. [2025-10-02T21:31:47.598678] [DEBUG] [LOCAL ] SKYH: Primary data saved (16683 records). [2025-10-02T21:31:47.599835] [INFO ] [MAIN ] SKYH: Full history saved. [2025-10-02T21:31:47.599960] [INFO ] [MAIN ] Update Progress: 1928/2370 symbols completed. SKYH took 27.2s. Estimated remaining: 1h 2m 18s. Rate: 7.1 symbols/min [2025-10-02T21:31:47.796719] [INFO ] [MAIN ] SLG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:31:47.858361] [DEBUG] [LOCAL ] SLG: Loaded 45322 existing records from primary storage. [2025-10-02T21:31:47.864220] [INFO ] [MAIN ] SLG: Loaded 45322 existing records. [2025-10-02T21:31:47.996183] [DEBUG] [LOCAL ] SKT: Primary data saved (42800 records). [2025-10-02T21:31:48.006599] [INFO ] [MAIN ] SKT: Full history saved. [2025-10-02T21:31:48.029387] [INFO ] [MAIN ] Update Progress: 1929/2370 symbols completed. SKT took 37.5s. Estimated remaining: 1h 2m 7s. Rate: 7.1 symbols/min [2025-10-02T21:31:48.150064] [WARN ] [MAIN ] SLG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:31:48.168232] [INFO ] [MAIN ] SLG: Wiping existing primary data before full refresh. [2025-10-02T21:31:48.180747] [INFO ] [LOCAL ] SLG: Starting deletion of primary data. [2025-10-02T21:31:48.192371] [DEBUG] [LOCAL ] SLG: Deleted primary data file. [2025-10-02T21:31:48.202860] [INFO ] [MAIN ] SLG: Starting full primary refresh. [2025-10-02T21:31:48.279548] [INFO ] [MAIN ] SLGN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:31:48.609976] [DEBUG] [LOCAL ] SLGN: Loaded 40426 existing records from primary storage. [2025-10-02T21:31:48.614581] [INFO ] [MAIN ] SLGN: Loaded 40426 existing records. [2025-10-02T21:31:48.771544] [INFO ] [REMOTE ] SLG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:31:48.787924] [INFO ] [REMOTE ] SLG: Fetching primary data for 2024-12. [2025-10-02T21:31:48.963621] [WARN ] [MAIN ] SLGN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:31:48.959004] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-10-02T21:31:48.994123] [INFO ] [MAIN ] SLGN: Wiping existing primary data before full refresh. [2025-10-02T21:31:48.997067] [INFO ] [LOCAL ] SLGN: Starting deletion of primary data. [2025-10-02T21:31:48.997744] [DEBUG] [LOCAL ] SLGN: Deleted primary data file. [2025-10-02T21:31:48.998585] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-02T21:31:48.997808] [INFO ] [MAIN ] SLGN: Starting full primary refresh. [2025-10-02T21:31:49.078113] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-01. [2025-10-02T21:31:49.403910] [INFO ] [REMOTE ] SLGN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:31:49.873010] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2024-12. [2025-10-02T21:31:50.652448] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-02T21:31:50.672957] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-02. [2025-10-02T21:31:50.957574] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-10-02T21:31:51.422082] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-02T21:31:51.473020] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-01. [2025-10-02T21:31:52.214108] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-02T21:31:52.273028] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-01. [2025-10-02T21:31:52.467189] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-02T21:31:53.073025] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-01. [2025-10-02T21:31:53.872987] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-03. [2025-10-02T21:31:53.966870] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-02T21:31:54.673088] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-02. [2025-10-02T21:31:55.165826] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-02T21:31:55.329927] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-02T21:31:55.473055] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-02. [2025-10-02T21:31:56.188840] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-02T21:31:56.273027] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-04. [2025-10-02T21:31:56.950510] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-02T21:31:57.073046] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-03. [2025-10-02T21:31:57.773763] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-02T21:31:57.873030] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-03. [2025-10-02T21:31:58.592867] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-02T21:31:58.673029] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-02. [2025-10-02T21:31:59.447690] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-02T21:31:59.472972] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-04. [2025-10-02T21:32:00.273005] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-04. [2025-10-02T21:32:00.454997] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-02T21:32:00.929497] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-02T21:32:01.072995] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-03. [2025-10-02T21:32:01.873026] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-05. [2025-10-02T21:32:01.907183] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-02T21:32:02.672994] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-05. [2025-10-02T21:32:03.072409] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-02T21:32:03.473036] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-04. [2025-10-02T21:32:03.522150] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-02T21:32:04.116416] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-02T21:32:04.273000] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-06. [2025-10-02T21:32:05.073002] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-06. [2025-10-02T21:32:05.696072] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-02T21:32:05.753882] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-02T21:32:05.873047] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-05. [2025-10-02T21:32:06.639730] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-02T21:32:06.673004] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-07. [2025-10-02T21:32:07.061809] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-02T21:32:07.473001] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-05. [2025-10-02T21:32:08.225011] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-02T21:32:08.273027] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-06. [2025-10-02T21:32:09.072991] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-08. [2025-10-02T21:32:09.143137] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-02T21:32:09.772554] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-02T21:32:09.872978] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-06. [2025-10-02T21:32:10.372057] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-02T21:32:10.673020] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-07. [2025-10-02T21:32:11.472974] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-09. [2025-10-02T21:32:11.904256] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-02T21:32:12.229996] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-02T21:32:12.272964] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-08. [2025-10-02T21:32:12.811406] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-02T21:32:13.073029] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-10. [2025-10-02T21:32:13.845966] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-02T21:32:13.872957] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-09. [2025-10-02T21:32:14.088765] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-02T21:32:14.091380] [INFO ] [REMOTE ] SLGN: Full fetch complete (58489 records). [2025-10-02T21:32:14.091496] [DEBUG] [VALIDATOR ] SLGN: Validating primary data. [2025-10-02T21:32:14.541893] [DEBUG] [VALIDATOR ] SLGN: All expected trading days are present. [2025-10-02T21:32:14.541980] [DEBUG] [VALIDATOR ] SLGN: Primary data validation passed. [2025-10-02T21:32:14.543179] [INFO ] [MAIN ] SLGN: Fetched primary data is valid. [2025-10-02T21:32:14.543247] [DEBUG] [LOCAL ] SLGN: Saving primary data. [2025-10-02T21:32:14.544489] [DEBUG] [LOCAL ] SLGN: Trimmed 58489 records to 40713 (keeping 200 days of data) [2025-10-02T21:32:14.674936] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-07. [2025-10-02T21:32:14.809558] [DEBUG] [LOCAL ] SLGN: Primary data saved (40713 records). [2025-10-02T21:32:14.809749] [INFO ] [MAIN ] SLGN: Full history saved. [2025-10-02T21:32:14.809859] [INFO ] [MAIN ] Update Progress: 1930/2370 symbols completed. SLGN took 26.8s. Estimated remaining: 1h 2m 3s. Rate: 7.1 symbols/min [2025-10-02T21:32:14.992302] [INFO ] [MAIN ] SLNZ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:32:14.992548] [DEBUG] [LOCAL ] SLNZ: No existing data file found in primary storage. [2025-10-02T21:32:14.992621] [WARN ] [MAIN ] SLNZ: No existing data found, performing full refresh instead. [2025-10-02T21:32:14.992917] [INFO ] [MAIN ] SLNZ: Wiping existing primary data before full refresh. [2025-10-02T21:32:14.993085] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-10-02T21:32:14.993332] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-10-02T21:32:14.993441] [INFO ] [MAIN ] SLNZ: Starting full primary refresh. [2025-10-02T21:32:15.319816] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-02T21:32:15.473079] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-10. [2025-10-02T21:32:15.498317] [INFO ] [REMOTE ] SLNZ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:32:16.273045] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2024-12. [2025-10-02T21:32:16.559093] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-02T21:32:16.562701] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-02T21:32:16.573409] [INFO ] [REMOTE ] SLF: Full fetch complete (56287 records). [2025-10-02T21:32:16.574142] [DEBUG] [VALIDATOR ] SLF: Validating primary data. [2025-10-02T21:32:16.681672] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-10-02T21:32:17.028684] [DEBUG] [VALIDATOR ] SLF: All expected trading days are present. [2025-10-02T21:32:17.028777] [DEBUG] [VALIDATOR ] SLF: Primary data validation passed. [2025-10-02T21:32:17.029782] [INFO ] [MAIN ] SLF: Fetched primary data is valid. [2025-10-02T21:32:17.029851] [DEBUG] [LOCAL ] SLF: Saving primary data. [2025-10-02T21:32:17.031132] [DEBUG] [LOCAL ] SLF: Trimmed 56287 records to 38970 (keeping 200 days of data) [2025-10-02T21:32:17.091342] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-08. [2025-10-02T21:32:17.296861] [DEBUG] [LOCAL ] SLF: Primary data saved (38970 records). [2025-10-02T21:32:17.297033] [INFO ] [MAIN ] SLF: Full history saved. [2025-10-02T21:32:17.297130] [INFO ] [MAIN ] Update Progress: 1931/2370 symbols completed. SLF took 32.5s. Estimated remaining: 1h 1m 53s. Rate: 7.1 symbols/min [2025-10-02T21:32:17.489802] [INFO ] [MAIN ] SLQT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:32:17.533395] [DEBUG] [LOCAL ] SLQT: Loaded 43514 existing records from primary storage. [2025-10-02T21:32:17.533763] [INFO ] [MAIN ] SLQT: Loaded 43514 existing records. [2025-10-02T21:32:17.728752] [WARN ] [MAIN ] SLQT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:32:17.728999] [INFO ] [MAIN ] SLQT: Wiping existing primary data before full refresh. [2025-10-02T21:32:17.729047] [INFO ] [LOCAL ] SLQT: Starting deletion of primary data. [2025-10-02T21:32:17.729290] [DEBUG] [LOCAL ] SLQT: Deleted primary data file. [2025-10-02T21:32:17.729388] [INFO ] [MAIN ] SLQT: Starting full primary refresh. [2025-10-02T21:32:17.889068] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-01. [2025-10-02T21:32:18.143972] [INFO ] [REMOTE ] SLQT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:32:18.299064] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-02T21:32:18.672965] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-02. [2025-10-02T21:32:18.772702] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-02T21:32:19.008267] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-02T21:32:19.472992] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2024-12. [2025-10-02T21:32:20.273005] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-09. [2025-10-02T21:32:20.950549] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-02T21:32:21.073021] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-03. [2025-10-02T21:32:21.347991] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-10-02T21:32:21.872983] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-01. [2025-10-02T21:32:22.045275] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-02T21:32:22.673060] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-07. [2025-10-02T21:32:23.484187] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-10. [2025-10-02T21:32:23.491476] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-02T21:32:24.273029] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-04. [2025-10-02T21:32:24.555960] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-02T21:32:24.678696] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-02T21:32:24.680613] [INFO ] [REMOTE ] SLG: Full fetch complete (65046 records). [2025-10-02T21:32:24.680804] [DEBUG] [VALIDATOR ] SLG: Validating primary data. [2025-10-02T21:32:24.766470] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-02T21:32:25.079069] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-02. [2025-10-02T21:32:25.131947] [DEBUG] [VALIDATOR ] SLG: All expected trading days are present. [2025-10-02T21:32:25.132045] [DEBUG] [VALIDATOR ] SLG: Primary data validation passed. [2025-10-02T21:32:25.133265] [INFO ] [MAIN ] SLG: Fetched primary data is valid. [2025-10-02T21:32:25.133335] [DEBUG] [LOCAL ] SLG: Saving primary data. [2025-10-02T21:32:25.135010] [DEBUG] [LOCAL ] SLG: Trimmed 65046 records to 45570 (keeping 200 days of data) [2025-10-02T21:32:25.434082] [DEBUG] [LOCAL ] SLG: Primary data saved (45570 records). [2025-10-02T21:32:25.434229] [INFO ] [MAIN ] SLG: Full history saved. [2025-10-02T21:32:25.434315] [INFO ] [MAIN ] Update Progress: 1932/2370 symbols completed. SLG took 37.8s. Estimated remaining: 1h 1m 45s. Rate: 7.1 symbols/min [2025-10-02T21:32:25.631099] [INFO ] [MAIN ] SLVM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:32:25.661910] [DEBUG] [LOCAL ] SLVM: Loaded 27991 existing records from primary storage. [2025-10-02T21:32:25.662192] [INFO ] [MAIN ] SLVM: Loaded 27991 existing records. [2025-10-02T21:32:25.866515] [WARN ] [MAIN ] SLVM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:32:25.866834] [INFO ] [MAIN ] SLVM: Wiping existing primary data before full refresh. [2025-10-02T21:32:25.866894] [INFO ] [LOCAL ] SLVM: Starting deletion of primary data. [2025-10-02T21:32:25.867112] [DEBUG] [LOCAL ] SLVM: Deleted primary data file. [2025-10-02T21:32:25.867175] [INFO ] [MAIN ] SLVM: Starting full primary refresh. [2025-10-02T21:32:25.878964] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-05. [2025-10-02T21:32:26.284312] [INFO ] [REMOTE ] SLVM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:32:26.335282] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-02T21:32:26.673020] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2024-12. [2025-10-02T21:32:26.828504] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-02T21:32:27.473044] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-08. [2025-10-02T21:32:27.937378] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-02T21:32:28.273016] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-03. [2025-10-02T21:32:28.998158] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-02T21:32:29.073004] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-09. [2025-10-02T21:32:29.490431] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-02T21:32:29.873000] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-04. [2025-10-02T21:32:30.673021] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-06. [2025-10-02T21:32:30.808004] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-02T21:32:31.027876] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-02T21:32:31.381224] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-02T21:32:31.473042] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-07. [2025-10-02T21:32:31.868744] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-02T21:32:32.273004] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-05. [2025-10-02T21:32:33.073017] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-10. [2025-10-02T21:32:33.863020] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-02T21:32:33.872960] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-06. [2025-10-02T21:32:34.673041] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-08. [2025-10-02T21:32:34.708745] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-02T21:32:34.710842] [INFO ] [REMOTE ] SLB: Full fetch complete (77740 records). [2025-10-02T21:32:34.710950] [DEBUG] [VALIDATOR ] SLB: Validating primary data. [2025-10-02T21:32:35.145952] [DEBUG] [VALIDATOR ] SLB: All expected trading days are present. [2025-10-02T21:32:35.146099] [DEBUG] [VALIDATOR ] SLB: Primary data validation passed. [2025-10-02T21:32:35.147498] [INFO ] [MAIN ] SLB: Fetched primary data is valid. [2025-10-02T21:32:35.147583] [DEBUG] [LOCAL ] SLB: Saving primary data. [2025-10-02T21:32:35.152018] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-02T21:32:35.168725] [DEBUG] [LOCAL ] SLB: Trimmed 77740 records to 54087 (keeping 200 days of data) [2025-10-02T21:32:35.183394] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-02T21:32:35.484394] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-07. [2025-10-02T21:32:35.542010] [DEBUG] [LOCAL ] SLB: Primary data saved (54087 records). [2025-10-02T21:32:35.542161] [INFO ] [MAIN ] SLB: Full history saved. [2025-10-02T21:32:35.543098] [INFO ] [MAIN ] Update Progress: 1933/2370 symbols completed. SLB took 50.9s. Estimated remaining: 1h 1m 37s. Rate: 7.1 symbols/min [2025-10-02T21:32:35.725211] [INFO ] [MAIN ] SM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:32:35.780000] [DEBUG] [LOCAL ] SM: Loaded 52323 existing records from primary storage. [2025-10-02T21:32:35.780350] [INFO ] [MAIN ] SM: Loaded 52323 existing records. [2025-10-02T21:32:35.982272] [WARN ] [MAIN ] SM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:32:35.982513] [INFO ] [MAIN ] SM: Wiping existing primary data before full refresh. [2025-10-02T21:32:35.982570] [INFO ] [LOCAL ] SM: Starting deletion of primary data. [2025-10-02T21:32:35.982835] [DEBUG] [LOCAL ] SM: Deleted primary data file. [2025-10-02T21:32:35.982895] [INFO ] [MAIN ] SM: Starting full primary refresh. [2025-10-02T21:32:36.280730] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-01. [2025-10-02T21:32:36.370575] [INFO ] [REMOTE ] SM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:32:37.073010] [INFO ] [REMOTE ] SM: Fetching primary data for 2024-12. [2025-10-02T21:32:37.190821] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-02T21:32:37.437824] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-02T21:32:37.873033] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-02. [2025-10-02T21:32:38.672976] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-09. [2025-10-02T21:32:38.731419] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-02T21:32:39.012908] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-02T21:32:39.171631] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-02T21:32:39.473017] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-10. [2025-10-02T21:32:39.726337] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-10 (0.25 seconds). [2025-10-02T21:32:39.727155] [INFO ] [REMOTE ] SLNZ: Full fetch complete (1050 records). [2025-10-02T21:32:39.727231] [DEBUG] [VALIDATOR ] SLNZ: Validating primary data. [2025-10-02T21:32:39.926102] [WARN ] [VALIDATOR ] SLNZ: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-02T21:32:39.926290] [FATAL] [MAIN ] SLNZ: Fetched primary data is invalid. Refusing to save it. [2025-10-02T21:32:39.926358] [WARN ] [MAIN ] SLNZ: Deleting existing primary and derivative data due to validation failure. [2025-10-02T21:32:39.926481] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-10-02T21:32:39.926557] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-10-02T21:32:39.926595] [INFO ] [LOCAL ] SLNZ: Starting deletion of derivative data. [2025-10-02T21:32:39.926667] [DEBUG] [LOCAL ] SLNZ: No derivative data file found to delete. [2025-10-02T21:32:39.926750] [INFO ] [MAIN ] Update Progress: 1934/2370 symbols completed. SLNZ took 25.1s. Estimated remaining: 1h 1m 27s. Rate: 7.1 symbols/min [2025-10-02T21:32:40.118466] [INFO ] [MAIN ] SMA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:32:40.118681] [DEBUG] [LOCAL ] SMA: No existing data file found in primary storage. [2025-10-02T21:32:40.118738] [WARN ] [MAIN ] SMA: No existing data found, performing full refresh instead. [2025-10-02T21:32:40.118861] [INFO ] [MAIN ] SMA: Wiping existing primary data before full refresh. [2025-10-02T21:32:40.118940] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-10-02T21:32:40.119006] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-10-02T21:32:40.119047] [INFO ] [MAIN ] SMA: Starting full primary refresh. [2025-10-02T21:32:40.274236] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-01. [2025-10-02T21:32:40.505120] [INFO ] [REMOTE ] SMA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:32:41.073010] [INFO ] [REMOTE ] SMA: Fetching primary data for 2024-12. [2025-10-02T21:32:41.281047] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T21:32:41.281387] [WARN ] [REMOTE ] SMA: No data returned for month 2024-12 [2025-10-02T21:32:41.281475] [FATAL] [REMOTE ] SMA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T21:32:41.281525] [FATAL] [MAIN ] SMA: Failed to fetch primary data. [2025-10-02T21:32:41.281585] [WARN ] [MAIN ] SMA: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T21:32:41.281716] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-10-02T21:32:41.281779] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-10-02T21:32:41.281815] [INFO ] [LOCAL ] SMA: Starting deletion of derivative data. [2025-10-02T21:32:41.281854] [DEBUG] [LOCAL ] SMA: No derivative data file found to delete. [2025-10-02T21:32:41.281899] [INFO ] [MAIN ] Update Progress: 1935/2370 symbols completed. SMA took 1.4s. Estimated remaining: 1h 1m 17s. Rate: 7.1 symbols/min [2025-10-02T21:32:41.489043] [INFO ] [MAIN ] SMBK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:32:41.500091] [DEBUG] [LOCAL ] SMBK: Loaded 8141 existing records from primary storage. [2025-10-02T21:32:41.500352] [INFO ] [MAIN ] SMBK: Loaded 8141 existing records. [2025-10-02T21:32:41.725702] [WARN ] [MAIN ] SMBK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:32:41.725930] [INFO ] [MAIN ] SMBK: Wiping existing primary data before full refresh. [2025-10-02T21:32:41.725980] [INFO ] [LOCAL ] SMBK: Starting deletion of primary data. [2025-10-02T21:32:41.726283] [DEBUG] [LOCAL ] SMBK: Deleted primary data file. [2025-10-02T21:32:41.726342] [INFO ] [MAIN ] SMBK: Starting full primary refresh. [2025-10-02T21:32:41.879232] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-08. [2025-10-02T21:32:42.132959] [INFO ] [REMOTE ] SMBK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:32:42.165701] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-02T21:32:42.672998] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-02. [2025-10-02T21:32:43.473017] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-03. [2025-10-02T21:32:43.616932] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-02T21:32:43.991374] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-02T21:32:44.276237] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-09. [2025-10-02T21:32:44.281892] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-02T21:32:45.073009] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-04. [2025-10-02T21:32:45.722626] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-02T21:32:45.873044] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-03. [2025-10-02T21:32:46.099831] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-02T21:32:46.673074] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-05. [2025-10-02T21:32:47.473028] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-10. [2025-10-02T21:32:47.587637] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-02T21:32:47.838208] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-02T21:32:48.272982] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-04. [2025-10-02T21:32:48.295432] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-02T21:32:48.297426] [INFO ] [REMOTE ] SLQT: Full fetch complete (63694 records). [2025-10-02T21:32:48.297554] [DEBUG] [VALIDATOR ] SLQT: Validating primary data. [2025-10-02T21:32:48.721267] [DEBUG] [VALIDATOR ] SLQT: All expected trading days are present. [2025-10-02T21:32:48.721369] [DEBUG] [VALIDATOR ] SLQT: Primary data validation passed. [2025-10-02T21:32:48.722701] [INFO ] [MAIN ] SLQT: Fetched primary data is valid. [2025-10-02T21:32:48.722801] [DEBUG] [LOCAL ] SLQT: Saving primary data. [2025-10-02T21:32:48.724390] [DEBUG] [LOCAL ] SLQT: Trimmed 63694 records to 43830 (keeping 200 days of data) [2025-10-02T21:32:48.992888] [DEBUG] [LOCAL ] SLQT: Primary data saved (43830 records). [2025-10-02T21:32:48.993044] [INFO ] [MAIN ] SLQT: Full history saved. [2025-10-02T21:32:48.993143] [INFO ] [MAIN ] Update Progress: 1936/2370 symbols completed. SLQT took 31.7s. Estimated remaining: 1h 1m 9s. Rate: 7.1 symbols/min [2025-10-02T21:32:49.078188] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2024-12. [2025-10-02T21:32:49.195624] [INFO ] [MAIN ] SMC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:32:49.210620] [DEBUG] [LOCAL ] SMC: Loaded 11412 existing records from primary storage. [2025-10-02T21:32:49.210914] [INFO ] [MAIN ] SMC: Loaded 11412 existing records. [2025-10-02T21:32:49.403297] [WARN ] [MAIN ] SMC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:32:49.403565] [INFO ] [MAIN ] SMC: Wiping existing primary data before full refresh. [2025-10-02T21:32:49.403626] [INFO ] [LOCAL ] SMC: Starting deletion of primary data. [2025-10-02T21:32:49.403925] [DEBUG] [LOCAL ] SMC: Deleted primary data file. [2025-10-02T21:32:49.403988] [INFO ] [MAIN ] SMC: Starting full primary refresh. [2025-10-02T21:32:49.846438] [INFO ] [REMOTE ] SMC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:32:49.872968] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-06. [2025-10-02T21:32:49.888476] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-02T21:32:49.922994] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-02T21:32:50.672987] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-01. [2025-10-02T21:32:50.957220] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-02T21:32:51.427882] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-02T21:32:51.472989] [INFO ] [REMOTE ] SMC: Fetching primary data for 2024-12. [2025-10-02T21:32:52.072932] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-02T21:32:52.273012] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-02. [2025-10-02T21:32:52.888516] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-02T21:32:53.072992] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-07. [2025-10-02T21:32:53.873029] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-05. [2025-10-02T21:32:54.251938] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-02T21:32:54.673038] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-08. [2025-10-02T21:32:55.473023] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-03. [2025-10-02T21:32:55.779782] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-02T21:32:56.067003] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-02T21:32:56.221026] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-02T21:32:56.272995] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-09. [2025-10-02T21:32:57.073044] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-01. [2025-10-02T21:32:57.465786] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-02T21:32:57.812942] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-02T21:32:57.873003] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-06. [2025-10-02T21:32:58.673020] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-02. [2025-10-02T21:32:59.225360] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-02T21:32:59.472995] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-04. [2025-10-02T21:32:59.706022] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-02T21:33:00.246157] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-02T21:33:00.273025] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-03. [2025-10-02T21:33:01.073044] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-05. [2025-10-02T21:33:01.228844] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-02T21:33:01.865587] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-02T21:33:01.872955] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-06. [2025-10-02T21:33:02.673062] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-07. [2025-10-02T21:33:02.689085] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-02T21:33:03.473026] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-07. [2025-10-02T21:33:04.272981] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-04. [2025-10-02T21:33:04.303312] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-02T21:33:04.606745] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-02T21:33:05.073035] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-08. [2025-10-02T21:33:05.205871] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-02T21:33:05.873053] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-08. [2025-10-02T21:33:06.383851] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-02T21:33:06.535968] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-02T21:33:06.673034] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-10. [2025-10-02T21:33:07.472994] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-05. [2025-10-02T21:33:07.609044] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-02T21:33:07.614291] [INFO ] [REMOTE ] SLVM: Full fetch complete (39975 records). [2025-10-02T21:33:07.614435] [DEBUG] [VALIDATOR ] SLVM: Validating primary data. [2025-10-02T21:33:08.010890] [DEBUG] [VALIDATOR ] SLVM: All expected trading days are present. [2025-10-02T21:33:08.011005] [DEBUG] [VALIDATOR ] SLVM: Primary data validation passed. [2025-10-02T21:33:08.012483] [INFO ] [MAIN ] SLVM: Fetched primary data is valid. [2025-10-02T21:33:08.012581] [DEBUG] [LOCAL ] SLVM: Saving primary data. [2025-10-02T21:33:08.014306] [DEBUG] [LOCAL ] SLVM: Trimmed 39975 records to 28253 (keeping 200 days of data) [2025-10-02T21:33:08.217130] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-02T21:33:08.226565] [DEBUG] [LOCAL ] SLVM: Primary data saved (28253 records). [2025-10-02T21:33:08.226811] [INFO ] [MAIN ] SLVM: Full history saved. [2025-10-02T21:33:08.226981] [INFO ] [MAIN ] Update Progress: 1937/2370 symbols completed. SLVM took 42.8s. Estimated remaining: 1h 1m 3s. Rate: 7.1 symbols/min [2025-10-02T21:33:08.278209] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-09. [2025-10-02T21:33:08.431847] [INFO ] [MAIN ] SMFG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:33:08.482476] [DEBUG] [LOCAL ] SMFG: Loaded 48138 existing records from primary storage. [2025-10-02T21:33:08.482878] [INFO ] [MAIN ] SMFG: Loaded 48138 existing records. [2025-10-02T21:33:08.672039] [WARN ] [MAIN ] SMFG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:33:08.672268] [INFO ] [MAIN ] SMFG: Wiping existing primary data before full refresh. [2025-10-02T21:33:08.672327] [INFO ] [LOCAL ] SMFG: Starting deletion of primary data. [2025-10-02T21:33:08.672709] [DEBUG] [LOCAL ] SMFG: Deleted primary data file. [2025-10-02T21:33:08.672845] [INFO ] [MAIN ] SMFG: Starting full primary refresh. [2025-10-02T21:33:09.069142] [INFO ] [REMOTE ] SMFG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:33:09.072949] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2024-12. [2025-10-02T21:33:09.127079] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-02T21:33:09.873068] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-06. [2025-10-02T21:33:10.676129] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-09. [2025-10-02T21:33:10.680426] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-02T21:33:10.750975] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-02T21:33:11.473005] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-07. [2025-10-02T21:33:12.260857] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-02T21:33:12.272956] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-08. [2025-10-02T21:33:12.435929] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-02T21:33:13.079430] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-10. [2025-10-02T21:33:13.084726] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-02T21:33:13.872995] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-09. [2025-10-02T21:33:14.252329] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-02T21:33:14.254617] [INFO ] [REMOTE ] SM: Full fetch complete (75380 records). [2025-10-02T21:33:14.254806] [DEBUG] [VALIDATOR ] SM: Validating primary data. [2025-10-02T21:33:14.625505] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-02T21:33:14.683128] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-10. [2025-10-02T21:33:14.726222] [DEBUG] [VALIDATOR ] SM: All expected trading days are present. [2025-10-02T21:33:14.726311] [DEBUG] [VALIDATOR ] SM: Primary data validation passed. [2025-10-02T21:33:14.727447] [INFO ] [MAIN ] SM: Fetched primary data is valid. [2025-10-02T21:33:14.727516] [DEBUG] [LOCAL ] SM: Saving primary data. [2025-10-02T21:33:14.729264] [DEBUG] [LOCAL ] SM: Trimmed 75380 records to 52712 (keeping 200 days of data) [2025-10-02T21:33:15.084413] [DEBUG] [LOCAL ] SM: Primary data saved (52712 records). [2025-10-02T21:33:15.084575] [INFO ] [MAIN ] SM: Full history saved. [2025-10-02T21:33:15.085764] [INFO ] [MAIN ] Update Progress: 1938/2370 symbols completed. SM took 39.5s. Estimated remaining: 1h 0m 54s. Rate: 7.1 symbols/min [2025-10-02T21:33:15.210352] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-02T21:33:15.227751] [INFO ] [REMOTE ] SMBK: Full fetch complete (11746 records). [2025-10-02T21:33:15.243362] [DEBUG] [VALIDATOR ] SMBK: Validating primary data. [2025-10-02T21:33:15.343258] [INFO ] [MAIN ] SMG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:33:15.474681] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-10. [2025-10-02T21:33:15.738997] [DEBUG] [VALIDATOR ] SMBK: All expected trading days are present. [2025-10-02T21:33:15.739116] [DEBUG] [VALIDATOR ] SMBK: Primary data validation passed. [2025-10-02T21:33:15.739516] [INFO ] [MAIN ] SMBK: Fetched primary data is valid. [2025-10-02T21:33:15.741697] [DEBUG] [LOCAL ] SMBK: Saving primary data. [2025-10-02T21:33:15.742555] [DEBUG] [LOCAL ] SMBK: Trimmed 11746 records to 8194 (keeping 200 days of data) [2025-10-02T21:33:15.744603] [DEBUG] [LOCAL ] SMG: Loaded 43718 existing records from primary storage. [2025-10-02T21:33:15.745333] [INFO ] [MAIN ] SMG: Loaded 43718 existing records. [2025-10-02T21:33:15.941263] [DEBUG] [LOCAL ] SMBK: Primary data saved (8194 records). [2025-10-02T21:33:15.963009] [INFO ] [MAIN ] SMBK: Full history saved. [2025-10-02T21:33:15.996604] [INFO ] [MAIN ] Update Progress: 1939/2370 symbols completed. SMBK took 34.7s. Estimated remaining: 1h 0m 44s. Rate: 7.1 symbols/min [2025-10-02T21:33:16.002938] [WARN ] [MAIN ] SMG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:33:16.008457] [INFO ] [MAIN ] SMG: Wiping existing primary data before full refresh. [2025-10-02T21:33:16.008534] [INFO ] [LOCAL ] SMG: Starting deletion of primary data. [2025-10-02T21:33:16.095063] [DEBUG] [LOCAL ] SMG: Deleted primary data file. [2025-10-02T21:33:16.115951] [INFO ] [MAIN ] SMG: Starting full primary refresh. [2025-10-02T21:33:16.145941] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-02T21:33:16.240473] [INFO ] [REMOTE ] SMC: Full fetch complete (16532 records). [2025-10-02T21:33:16.253135] [DEBUG] [VALIDATOR ] SMC: Validating primary data. [2025-10-02T21:33:16.284343] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-01. [2025-10-02T21:33:16.350950] [INFO ] [MAIN ] SMHI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:33:16.395698] [DEBUG] [LOCAL ] SMHI: No existing data file found in primary storage. [2025-10-02T21:33:16.437221] [WARN ] [MAIN ] SMHI: No existing data found, performing full refresh instead. [2025-10-02T21:33:16.506469] [INFO ] [MAIN ] SMHI: Wiping existing primary data before full refresh. [2025-10-02T21:33:16.506562] [INFO ] [LOCAL ] SMHI: Starting deletion of primary data. [2025-10-02T21:33:16.520841] [DEBUG] [LOCAL ] SMHI: No primary data file found to delete. [2025-10-02T21:33:16.557911] [INFO ] [MAIN ] SMHI: Starting full primary refresh. [2025-10-02T21:33:17.069232] [INFO ] [REMOTE ] SMG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:33:17.157194] [INFO ] [REMOTE ] SMG: Fetching primary data for 2024-12. [2025-10-02T21:33:17.471567] [DEBUG] [VALIDATOR ] SMC: All expected trading days are present. [2025-10-02T21:33:17.482885] [DEBUG] [VALIDATOR ] SMC: Primary data validation passed. [2025-10-02T21:33:17.483467] [INFO ] [MAIN ] SMC: Fetched primary data is valid. [2025-10-02T21:33:17.483550] [DEBUG] [LOCAL ] SMC: Saving primary data. [2025-10-02T21:33:17.512481] [DEBUG] [LOCAL ] SMC: Trimmed 16532 records to 11513 (keeping 200 days of data) [2025-10-02T21:33:17.518166] [INFO ] [REMOTE ] SMHI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:33:17.592739] [DEBUG] [LOCAL ] SMC: Primary data saved (11513 records). [2025-10-02T21:33:17.592884] [INFO ] [MAIN ] SMC: Full history saved. [2025-10-02T21:33:17.593016] [INFO ] [MAIN ] Update Progress: 1940/2370 symbols completed. SMC took 28.6s. Estimated remaining: 1h 0m 34s. Rate: 7.1 symbols/min [2025-10-02T21:33:17.792569] [INFO ] [MAIN ] SMP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:33:17.817090] [DEBUG] [LOCAL ] SMP: Loaded 19309 existing records from primary storage. [2025-10-02T21:33:17.817344] [INFO ] [MAIN ] SMP: Loaded 19309 existing records. [2025-10-02T21:33:17.878742] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2024-12. [2025-10-02T21:33:18.002330] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-02T21:33:18.074174] [WARN ] [MAIN ] SMP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:33:18.074430] [INFO ] [MAIN ] SMP: Wiping existing primary data before full refresh. [2025-10-02T21:33:18.074496] [INFO ] [LOCAL ] SMP: Starting deletion of primary data. [2025-10-02T21:33:18.074770] [DEBUG] [LOCAL ] SMP: Deleted primary data file. [2025-10-02T21:33:18.074831] [INFO ] [MAIN ] SMP: Starting full primary refresh. [2025-10-02T21:33:18.506241] [INFO ] [REMOTE ] SMP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:33:18.522705] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-02T21:33:18.673026] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-01. [2025-10-02T21:33:19.167295] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-02T21:33:19.473083] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-02. [2025-10-02T21:33:20.143401] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-02T21:33:20.273013] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-01. [2025-10-02T21:33:21.045511] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-02T21:33:21.073002] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-02. [2025-10-02T21:33:21.124591] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-02T21:33:21.873006] [INFO ] [REMOTE ] SMP: Fetching primary data for 2024-12. [2025-10-02T21:33:22.024476] [DEBUG] [REMOTE ] SMP: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-10-02T21:33:22.024889] [WARN ] [REMOTE ] SMP: No data returned for month 2024-12 [2025-10-02T21:33:22.025046] [FATAL] [REMOTE ] SMP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T21:33:22.036303] [FATAL] [MAIN ] SMP: Failed to fetch primary data. [2025-10-02T21:33:22.036759] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-02T21:33:22.036910] [WARN ] [MAIN ] SMP: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T21:33:22.041320] [INFO ] [LOCAL ] SMP: Starting deletion of primary data. [2025-10-02T21:33:22.041714] [DEBUG] [LOCAL ] SMP: No primary data file found to delete. [2025-10-02T21:33:22.041770] [INFO ] [LOCAL ] SMP: Starting deletion of derivative data. [2025-10-02T21:33:22.042335] [DEBUG] [LOCAL ] SMP: Deleted derivative data file. [2025-10-02T21:33:22.042422] [INFO ] [MAIN ] Update Progress: 1941/2370 symbols completed. SMP took 4.4s. Estimated remaining: 1h 0m 24s. Rate: 7.1 symbols/min [2025-10-02T21:33:22.236768] [INFO ] [MAIN ] SMR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:33:22.297726] [DEBUG] [LOCAL ] SMR: Loaded 53797 existing records from primary storage. [2025-10-02T21:33:22.298161] [INFO ] [MAIN ] SMR: Loaded 53797 existing records. [2025-10-02T21:33:22.498106] [WARN ] [MAIN ] SMR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:33:22.498354] [INFO ] [MAIN ] SMR: Wiping existing primary data before full refresh. [2025-10-02T21:33:22.498405] [INFO ] [LOCAL ] SMR: Starting deletion of primary data. [2025-10-02T21:33:22.498682] [DEBUG] [LOCAL ] SMR: Deleted primary data file. [2025-10-02T21:33:22.498781] [INFO ] [MAIN ] SMR: Starting full primary refresh. [2025-10-02T21:33:22.677395] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-02. [2025-10-02T21:33:22.908687] [INFO ] [REMOTE ] SMR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:33:23.473015] [INFO ] [REMOTE ] SMR: Fetching primary data for 2024-12. [2025-10-02T21:33:24.273001] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-03. [2025-10-02T21:33:24.506050] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-02T21:33:25.073061] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-03. [2025-10-02T21:33:25.873033] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-03. [2025-10-02T21:33:25.913838] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2024-12 (2.44 seconds). [2025-10-02T21:33:25.982123] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-02T21:33:26.338609] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-02T21:33:26.673005] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-04. [2025-10-02T21:33:26.695977] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-02T21:33:27.473039] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-04. [2025-10-02T21:33:28.273034] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-04. [2025-10-02T21:33:28.406043] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-02T21:33:29.073015] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-05. [2025-10-02T21:33:29.133447] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-02T21:33:29.264095] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-02T21:33:29.873057] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-01. [2025-10-02T21:33:30.340189] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-02T21:33:30.673024] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-05. [2025-10-02T21:33:31.472987] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-05. [2025-10-02T21:33:31.640291] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-02T21:33:32.278180] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-06. [2025-10-02T21:33:32.293517] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-10-02T21:33:32.863610] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-02T21:33:33.073049] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-06. [2025-10-02T21:33:33.091701] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-02T21:33:33.873051] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-06. [2025-10-02T21:33:34.650400] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-02T21:33:34.672958] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-07. [2025-10-02T21:33:35.321162] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-02T21:33:35.472995] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-07. [2025-10-02T21:33:35.910668] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-02T21:33:36.272978] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-08. [2025-10-02T21:33:36.407244] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-02T21:33:37.073010] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-07. [2025-10-02T21:33:37.736384] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-02T21:33:37.872997] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-09. [2025-10-02T21:33:38.500524] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-02T21:33:38.673018] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-08. [2025-10-02T21:33:39.349178] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-02T21:33:39.476544] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-10. [2025-10-02T21:33:39.478138] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-02T21:33:40.273059] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-08. [2025-10-02T21:33:40.451733] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-02T21:33:40.453751] [INFO ] [REMOTE ] SMG: Full fetch complete (62717 records). [2025-10-02T21:33:40.453903] [DEBUG] [VALIDATOR ] SMG: Validating primary data. [2025-10-02T21:33:40.886193] [DEBUG] [VALIDATOR ] SMG: All expected trading days are present. [2025-10-02T21:33:40.886293] [DEBUG] [VALIDATOR ] SMG: Primary data validation passed. [2025-10-02T21:33:40.887456] [INFO ] [MAIN ] SMG: Fetched primary data is valid. [2025-10-02T21:33:40.887527] [DEBUG] [LOCAL ] SMG: Saving primary data. [2025-10-02T21:33:40.888890] [DEBUG] [LOCAL ] SMG: Trimmed 62717 records to 43987 (keeping 200 days of data) [2025-10-02T21:33:41.077522] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-09. [2025-10-02T21:33:41.180260] [DEBUG] [LOCAL ] SMG: Primary data saved (43987 records). [2025-10-02T21:33:41.180411] [INFO ] [MAIN ] SMG: Full history saved. [2025-10-02T21:33:41.180511] [INFO ] [MAIN ] Update Progress: 1942/2370 symbols completed. SMG took 26.1s. Estimated remaining: 1h 0m 18s. Rate: 7.1 symbols/min [2025-10-02T21:33:41.423187] [INFO ] [MAIN ] SMRT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:33:41.465595] [DEBUG] [LOCAL ] SMRT: Loaded 43885 existing records from primary storage. [2025-10-02T21:33:41.465945] [INFO ] [MAIN ] SMRT: Loaded 43885 existing records. [2025-10-02T21:33:41.693173] [WARN ] [MAIN ] SMRT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:33:41.693599] [INFO ] [MAIN ] SMRT: Wiping existing primary data before full refresh. [2025-10-02T21:33:41.693718] [INFO ] [LOCAL ] SMRT: Starting deletion of primary data. [2025-10-02T21:33:41.694045] [DEBUG] [LOCAL ] SMRT: Deleted primary data file. [2025-10-02T21:33:41.694123] [INFO ] [MAIN ] SMRT: Starting full primary refresh. [2025-10-02T21:33:41.873807] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-02. [2025-10-02T21:33:41.960119] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-02T21:33:42.168442] [INFO ] [REMOTE ] SMRT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:33:42.170555] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-02T21:33:42.673036] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2024-12. [2025-10-02T21:33:43.473017] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-10. [2025-10-02T21:33:43.950489] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-02T21:33:43.951385] [INFO ] [REMOTE ] SMHI: Full fetch complete (23088 records). [2025-10-02T21:33:43.951459] [DEBUG] [VALIDATOR ] SMHI: Validating primary data. [2025-10-02T21:33:44.290288] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-09. [2025-10-02T21:33:44.309120] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-02T21:33:44.469903] [DEBUG] [VALIDATOR ] SMHI: All expected trading days are present. [2025-10-02T21:33:44.470037] [DEBUG] [VALIDATOR ] SMHI: Primary data validation passed. [2025-10-02T21:33:44.470618] [INFO ] [MAIN ] SMHI: Fetched primary data is valid. [2025-10-02T21:33:44.470709] [DEBUG] [LOCAL ] SMHI: Saving primary data. [2025-10-02T21:33:44.471894] [DEBUG] [LOCAL ] SMHI: Trimmed 23088 records to 13233 (keeping 200 days of data) [2025-10-02T21:33:44.505550] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-02 (2.63 seconds). [2025-10-02T21:33:44.595278] [DEBUG] [LOCAL ] SMHI: Primary data saved (13233 records). [2025-10-02T21:33:44.595441] [INFO ] [MAIN ] SMHI: Full history saved. [2025-10-02T21:33:44.595522] [INFO ] [MAIN ] Update Progress: 1943/2370 symbols completed. SMHI took 28.6s. Estimated remaining: 1h 0m 9s. Rate: 7.1 symbols/min [2025-10-02T21:33:44.781809] [INFO ] [MAIN ] SMWB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:33:44.819098] [DEBUG] [LOCAL ] SMWB: Loaded 32455 existing records from primary storage. [2025-10-02T21:33:44.819418] [INFO ] [MAIN ] SMWB: Loaded 32455 existing records. [2025-10-02T21:33:45.020821] [WARN ] [MAIN ] SMWB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:33:45.021032] [INFO ] [MAIN ] SMWB: Wiping existing primary data before full refresh. [2025-10-02T21:33:45.021082] [INFO ] [LOCAL ] SMWB: Starting deletion of primary data. [2025-10-02T21:33:45.021365] [DEBUG] [LOCAL ] SMWB: Deleted primary data file. [2025-10-02T21:33:45.021426] [INFO ] [MAIN ] SMWB: Starting full primary refresh. [2025-10-02T21:33:45.082209] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-03. [2025-10-02T21:33:45.417954] [INFO ] [REMOTE ] SMWB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:33:45.872998] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-01. [2025-10-02T21:33:46.054441] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-02T21:33:46.673016] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2024-12. [2025-10-02T21:33:47.160325] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-02T21:33:47.473053] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-10. [2025-10-02T21:33:47.790973] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-03 (2.71 seconds). [2025-10-02T21:33:48.114218] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-02T21:33:48.273039] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-02. [2025-10-02T21:33:48.556381] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-02T21:33:48.558929] [INFO ] [REMOTE ] SMFG: Full fetch complete (69018 records). [2025-10-02T21:33:48.559122] [DEBUG] [VALIDATOR ] SMFG: Validating primary data. [2025-10-02T21:33:49.012721] [DEBUG] [VALIDATOR ] SMFG: All expected trading days are present. [2025-10-02T21:33:49.012849] [DEBUG] [VALIDATOR ] SMFG: Primary data validation passed. [2025-10-02T21:33:49.014061] [INFO ] [MAIN ] SMFG: Fetched primary data is valid. [2025-10-02T21:33:49.014131] [DEBUG] [LOCAL ] SMFG: Saving primary data. [2025-10-02T21:33:49.015691] [DEBUG] [LOCAL ] SMFG: Trimmed 69018 records to 48480 (keeping 200 days of data) [2025-10-02T21:33:49.081624] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-04. [2025-10-02T21:33:49.348578] [DEBUG] [LOCAL ] SMFG: Primary data saved (48480 records). [2025-10-02T21:33:49.348761] [INFO ] [MAIN ] SMFG: Full history saved. [2025-10-02T21:33:49.348855] [INFO ] [MAIN ] Update Progress: 1944/2370 symbols completed. SMFG took 41.1s. Estimated remaining: 59m 59s. Rate: 7.1 symbols/min [2025-10-02T21:33:49.597702] [INFO ] [MAIN ] SN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:33:49.599969] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-02T21:33:49.656597] [DEBUG] [LOCAL ] SN: Loaded 49773 existing records from primary storage. [2025-10-02T21:33:49.656997] [INFO ] [MAIN ] SN: Loaded 49773 existing records. [2025-10-02T21:33:49.855934] [WARN ] [MAIN ] SN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:33:49.856150] [INFO ] [MAIN ] SN: Wiping existing primary data before full refresh. [2025-10-02T21:33:49.856200] [INFO ] [LOCAL ] SN: Starting deletion of primary data. [2025-10-02T21:33:49.856747] [DEBUG] [LOCAL ] SN: Deleted primary data file. [2025-10-02T21:33:49.856832] [INFO ] [MAIN ] SN: Starting full primary refresh. [2025-10-02T21:33:49.878402] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-01. [2025-10-02T21:33:50.274018] [INFO ] [REMOTE ] SN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:33:50.673018] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-03. [2025-10-02T21:33:51.351159] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-02T21:33:51.473028] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-02. [2025-10-02T21:33:51.631311] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-04 (2.55 seconds). [2025-10-02T21:33:52.208370] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-02T21:33:52.272980] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-04. [2025-10-02T21:33:53.073033] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-05. [2025-10-02T21:33:53.097820] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-02T21:33:53.872998] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-03. [2025-10-02T21:33:53.923760] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-02T21:33:54.673040] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-05. [2025-10-02T21:33:55.271322] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-02T21:33:55.473013] [INFO ] [REMOTE ] SN: Fetching primary data for 2024-12. [2025-10-02T21:33:55.582238] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-10-02T21:33:56.273047] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-04. [2025-10-02T21:33:56.354611] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-02T21:33:57.073108] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-06. [2025-10-02T21:33:57.150564] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-02T21:33:57.332719] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-02T21:33:57.873078] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-05. [2025-10-02T21:33:58.240795] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-02T21:33:58.673116] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-07. [2025-10-02T21:33:59.259574] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-02T21:33:59.473049] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-06. [2025-10-02T21:34:00.272992] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-01. [2025-10-02T21:34:00.381677] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-02T21:34:00.867944] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-02T21:34:01.073053] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-06. [2025-10-02T21:34:01.873009] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-08. [2025-10-02T21:34:02.041855] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-02T21:34:02.673040] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-02. [2025-10-02T21:34:03.144751] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-02T21:34:03.477041] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-07. [2025-10-02T21:34:03.482181] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-02T21:34:04.272987] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-09. [2025-10-02T21:34:04.408210] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-02T21:34:04.703799] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-02T21:34:05.073061] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-08. [2025-10-02T21:34:05.527430] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-02T21:34:05.873018] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-07. [2025-10-02T21:34:06.540286] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-02T21:34:06.673004] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-09. [2025-10-02T21:34:07.473030] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-03. [2025-10-02T21:34:07.901831] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-02T21:34:08.273008] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-10. [2025-10-02T21:34:08.821613] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-07 (2.95 seconds). [2025-10-02T21:34:09.073042] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-10. [2025-10-02T21:34:09.095749] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-02T21:34:09.097364] [INFO ] [REMOTE ] SMWB: Full fetch complete (49688 records). [2025-10-02T21:34:09.097481] [DEBUG] [VALIDATOR ] SMWB: Validating primary data. [2025-10-02T21:34:09.430502] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-02T21:34:09.525956] [DEBUG] [VALIDATOR ] SMWB: All expected trading days are present. [2025-10-02T21:34:09.526046] [DEBUG] [VALIDATOR ] SMWB: Primary data validation passed. [2025-10-02T21:34:09.527672] [INFO ] [MAIN ] SMWB: Fetched primary data is valid. [2025-10-02T21:34:09.527738] [DEBUG] [LOCAL ] SMWB: Saving primary data. [2025-10-02T21:34:09.529027] [DEBUG] [LOCAL ] SMWB: Trimmed 49688 records to 32631 (keeping 200 days of data) [2025-10-02T21:34:09.730082] [DEBUG] [LOCAL ] SMWB: Primary data saved (32631 records). [2025-10-02T21:34:09.730237] [INFO ] [MAIN ] SMWB: Full history saved. [2025-10-02T21:34:09.730325] [INFO ] [MAIN ] Update Progress: 1945/2370 symbols completed. SMWB took 25.1s. Estimated remaining: 59m 54s. Rate: 7.1 symbols/min [2025-10-02T21:34:09.875225] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-04. [2025-10-02T21:34:09.869960] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-02T21:34:09.939742] [INFO ] [MAIN ] SNA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:34:09.940698] [INFO ] [REMOTE ] SMRT: Full fetch complete (62074 records). [2025-10-02T21:34:09.940820] [DEBUG] [VALIDATOR ] SMRT: Validating primary data. [2025-10-02T21:34:10.232098] [DEBUG] [LOCAL ] SNA: Loaded 25934 existing records from primary storage. [2025-10-02T21:34:10.253813] [INFO ] [MAIN ] SNA: Loaded 25934 existing records. [2025-10-02T21:34:10.532886] [DEBUG] [VALIDATOR ] SMRT: All expected trading days are present. [2025-10-02T21:34:10.538263] [DEBUG] [VALIDATOR ] SMRT: Primary data validation passed. [2025-10-02T21:34:10.538136] [WARN ] [MAIN ] SNA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:34:10.540085] [INFO ] [MAIN ] SMRT: Fetched primary data is valid. [2025-10-02T21:34:10.540185] [DEBUG] [LOCAL ] SMRT: Saving primary data. [2025-10-02T21:34:10.540441] [INFO ] [MAIN ] SNA: Wiping existing primary data before full refresh. [2025-10-02T21:34:10.540496] [INFO ] [LOCAL ] SNA: Starting deletion of primary data. [2025-10-02T21:34:10.541007] [DEBUG] [LOCAL ] SNA: Deleted primary data file. [2025-10-02T21:34:10.541110] [INFO ] [MAIN ] SNA: Starting full primary refresh. [2025-10-02T21:34:10.643489] [DEBUG] [LOCAL ] SMRT: Trimmed 62074 records to 44172 (keeping 200 days of data) [2025-10-02T21:34:10.686236] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-08. [2025-10-02T21:34:11.039991] [INFO ] [REMOTE ] SNA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:34:11.215063] [DEBUG] [LOCAL ] SMRT: Primary data saved (44172 records). [2025-10-02T21:34:11.215223] [INFO ] [MAIN ] SMRT: Full history saved. [2025-10-02T21:34:11.216307] [INFO ] [MAIN ] Update Progress: 1946/2370 symbols completed. SMRT took 30.0s. Estimated remaining: 59m 44s. Rate: 7.1 symbols/min [2025-10-02T21:34:11.411251] [INFO ] [MAIN ] SNAP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:34:11.471561] [DEBUG] [LOCAL ] SNAP: Loaded 53796 existing records from primary storage. [2025-10-02T21:34:11.472014] [INFO ] [MAIN ] SNAP: Loaded 53796 existing records. [2025-10-02T21:34:11.506243] [INFO ] [REMOTE ] SNA: Fetching primary data for 2024-12. [2025-10-02T21:34:11.683775] [WARN ] [MAIN ] SNAP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:34:11.684313] [INFO ] [MAIN ] SNAP: Wiping existing primary data before full refresh. [2025-10-02T21:34:11.684408] [INFO ] [LOCAL ] SNAP: Starting deletion of primary data. [2025-10-02T21:34:11.684896] [DEBUG] [LOCAL ] SNAP: Deleted primary data file. [2025-10-02T21:34:11.685018] [INFO ] [MAIN ] SNAP: Starting full primary refresh. [2025-10-02T21:34:12.066308] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-02T21:34:12.154605] [INFO ] [REMOTE ] SNAP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:34:12.272958] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2024-12. [2025-10-02T21:34:12.862716] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-02T21:34:13.073001] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-01. [2025-10-02T21:34:13.807011] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-08 (3.12 seconds). [2025-10-02T21:34:13.872963] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-09. [2025-10-02T21:34:14.326745] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-02T21:34:14.596449] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2024-12 (2.32 seconds). [2025-10-02T21:34:14.673065] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-01. [2025-10-02T21:34:15.473027] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-02. [2025-10-02T21:34:16.053678] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-02T21:34:16.273059] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-05. [2025-10-02T21:34:16.963279] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-02T21:34:17.078168] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-03. [2025-10-02T21:34:17.096288] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-10-02T21:34:17.872998] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-02. [2025-10-02T21:34:18.155017] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-02T21:34:18.184910] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-02T21:34:18.673017] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-04. [2025-10-02T21:34:19.472998] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-10. [2025-10-02T21:34:19.985062] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-02T21:34:20.176899] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-02T21:34:20.273067] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-05. [2025-10-02T21:34:21.073051] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-03. [2025-10-02T21:34:21.529572] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-02T21:34:21.723731] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-02T21:34:21.727002] [INFO ] [REMOTE ] SMR: Full fetch complete (77974 records). [2025-10-02T21:34:21.727146] [DEBUG] [VALIDATOR ] SMR: Validating primary data. [2025-10-02T21:34:21.881145] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-06. [2025-10-02T21:34:22.163893] [DEBUG] [VALIDATOR ] SMR: All expected trading days are present. [2025-10-02T21:34:22.163992] [DEBUG] [VALIDATOR ] SMR: Primary data validation passed. [2025-10-02T21:34:22.165197] [INFO ] [MAIN ] SMR: Fetched primary data is valid. [2025-10-02T21:34:22.165264] [DEBUG] [LOCAL ] SMR: Saving primary data. [2025-10-02T21:34:22.166944] [DEBUG] [LOCAL ] SMR: Trimmed 77974 records to 54187 (keeping 200 days of data) [2025-10-02T21:34:22.525706] [DEBUG] [LOCAL ] SMR: Primary data saved (54187 records). [2025-10-02T21:34:22.525875] [INFO ] [MAIN ] SMR: Full history saved. [2025-10-02T21:34:22.525972] [INFO ] [MAIN ] Update Progress: 1947/2370 symbols completed. SMR took 1m 0s. Estimated remaining: 59m 36s. Rate: 7.1 symbols/min [2025-10-02T21:34:22.682836] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-06. [2025-10-02T21:34:22.717375] [INFO ] [MAIN ] SNDA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:34:22.724813] [DEBUG] [LOCAL ] SNDA: Loaded 4515 existing records from primary storage. [2025-10-02T21:34:22.725596] [INFO ] [MAIN ] SNDA: Loaded 4515 existing records. [2025-10-02T21:34:22.935621] [WARN ] [MAIN ] SNDA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:34:22.935909] [INFO ] [MAIN ] SNDA: Wiping existing primary data before full refresh. [2025-10-02T21:34:22.935967] [INFO ] [LOCAL ] SNDA: Starting deletion of primary data. [2025-10-02T21:34:22.936187] [DEBUG] [LOCAL ] SNDA: Deleted primary data file. [2025-10-02T21:34:22.936248] [INFO ] [MAIN ] SNDA: Starting full primary refresh. [2025-10-02T21:34:23.297681] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-02T21:34:23.370411] [INFO ] [REMOTE ] SNDA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:34:23.404676] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-10-02T21:34:23.472984] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-07. [2025-10-02T21:34:24.272991] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2024-12. [2025-10-02T21:34:24.504512] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-02T21:34:24.750255] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-02T21:34:24.865415] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-02T21:34:25.073028] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-07. [2025-10-02T21:34:25.873017] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-04. [2025-10-02T21:34:26.672984] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-08. [2025-10-02T21:34:26.902785] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-02T21:34:27.473011] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-08. [2025-10-02T21:34:27.816612] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-02T21:34:28.211801] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-02T21:34:28.273031] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-09. [2025-10-02T21:34:28.953877] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-02T21:34:29.072975] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-09. [2025-10-02T21:34:29.385531] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-02T21:34:29.873007] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-05. [2025-10-02T21:34:30.673007] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-01. [2025-10-02T21:34:30.783896] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-02T21:34:31.473058] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-10. [2025-10-02T21:34:31.505481] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-02T21:34:31.987890] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-02T21:34:32.272976] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-02. [2025-10-02T21:34:32.739549] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-02T21:34:32.741900] [INFO ] [REMOTE ] SN: Full fetch complete (71000 records). [2025-10-02T21:34:32.742063] [DEBUG] [VALIDATOR ] SN: Validating primary data. [2025-10-02T21:34:33.075436] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-10. [2025-10-02T21:34:33.079447] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-02T21:34:33.189726] [DEBUG] [VALIDATOR ] SN: All expected trading days are present. [2025-10-02T21:34:33.189835] [DEBUG] [VALIDATOR ] SN: Primary data validation passed. [2025-10-02T21:34:33.191035] [INFO ] [MAIN ] SN: Fetched primary data is valid. [2025-10-02T21:34:33.191104] [DEBUG] [LOCAL ] SN: Saving primary data. [2025-10-02T21:34:33.192695] [DEBUG] [LOCAL ] SN: Trimmed 71000 records to 50121 (keeping 200 days of data) [2025-10-02T21:34:33.523161] [DEBUG] [LOCAL ] SN: Primary data saved (50121 records). [2025-10-02T21:34:33.523312] [INFO ] [MAIN ] SN: Full history saved. [2025-10-02T21:34:33.523403] [INFO ] [MAIN ] Update Progress: 1948/2370 symbols completed. SN took 44.2s. Estimated remaining: 59m 28s. Rate: 7.1 symbols/min [2025-10-02T21:34:33.718616] [INFO ] [MAIN ] SNDR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:34:33.757587] [DEBUG] [LOCAL ] SNDR: Loaded 40712 existing records from primary storage. [2025-10-02T21:34:33.757931] [INFO ] [MAIN ] SNDR: Loaded 40712 existing records. [2025-10-02T21:34:33.874973] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-03. [2025-10-02T21:34:33.880058] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-02T21:34:33.897423] [INFO ] [REMOTE ] SNA: Full fetch complete (38896 records). [2025-10-02T21:34:33.907969] [DEBUG] [VALIDATOR ] SNA: Validating primary data. [2025-10-02T21:34:34.041166] [WARN ] [MAIN ] SNDR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:34:34.085102] [INFO ] [MAIN ] SNDR: Wiping existing primary data before full refresh. [2025-10-02T21:34:34.085572] [INFO ] [LOCAL ] SNDR: Starting deletion of primary data. [2025-10-02T21:34:34.111973] [DEBUG] [LOCAL ] SNDR: Deleted primary data file. [2025-10-02T21:34:34.133044] [INFO ] [MAIN ] SNDR: Starting full primary refresh. [2025-10-02T21:34:34.682684] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-06. [2025-10-02T21:34:34.780292] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-02T21:34:34.791169] [DEBUG] [VALIDATOR ] SNA: All expected trading days are present. [2025-10-02T21:34:34.805977] [DEBUG] [VALIDATOR ] SNA: Primary data validation passed. [2025-10-02T21:34:34.820691] [INFO ] [MAIN ] SNA: Fetched primary data is valid. [2025-10-02T21:34:34.854787] [DEBUG] [LOCAL ] SNA: Saving primary data. [2025-10-02T21:34:34.854511] [INFO ] [REMOTE ] SNDR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:34:34.856092] [DEBUG] [LOCAL ] SNA: Trimmed 38896 records to 26059 (keeping 200 days of data) [2025-10-02T21:34:35.030318] [DEBUG] [LOCAL ] SNA: Primary data saved (26059 records). [2025-10-02T21:34:35.030457] [INFO ] [MAIN ] SNA: Full history saved. [2025-10-02T21:34:35.030547] [INFO ] [MAIN ] Update Progress: 1949/2370 symbols completed. SNA took 25.3s. Estimated remaining: 59m 18s. Rate: 7.1 symbols/min [2025-10-02T21:34:35.214292] [INFO ] [MAIN ] SNN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:34:35.256705] [DEBUG] [LOCAL ] SNN: Loaded 44238 existing records from primary storage. [2025-10-02T21:34:35.257074] [INFO ] [MAIN ] SNN: Loaded 44238 existing records. [2025-10-02T21:34:35.450874] [WARN ] [MAIN ] SNN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:34:35.451190] [INFO ] [MAIN ] SNN: Wiping existing primary data before full refresh. [2025-10-02T21:34:35.451243] [INFO ] [LOCAL ] SNN: Starting deletion of primary data. [2025-10-02T21:34:35.451456] [DEBUG] [LOCAL ] SNN: Deleted primary data file. [2025-10-02T21:34:35.451543] [INFO ] [MAIN ] SNN: Starting full primary refresh. [2025-10-02T21:34:35.485188] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2024-12. [2025-10-02T21:34:35.843738] [INFO ] [REMOTE ] SNN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:34:36.273020] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-04. [2025-10-02T21:34:37.021898] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-02T21:34:37.072959] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-01. [2025-10-02T21:34:37.128928] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-06 (2.45 seconds). [2025-10-02T21:34:37.146376] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-02T21:34:37.873034] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-07. [2025-10-02T21:34:38.673937] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-05. [2025-10-02T21:34:38.677291] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-02T21:34:39.424432] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-02T21:34:39.473031] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-02. [2025-10-02T21:34:40.126942] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-02T21:34:40.273033] [INFO ] [REMOTE ] SNN: Fetching primary data for 2024-12. [2025-10-02T21:34:40.944910] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-02T21:34:41.073041] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-06. [2025-10-02T21:34:41.669104] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-02T21:34:41.873030] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-03. [2025-10-02T21:34:41.927980] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-02T21:34:42.673078] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-08. [2025-10-02T21:34:43.163067] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-02T21:34:43.473024] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-07. [2025-10-02T21:34:44.046763] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-02T21:34:44.273091] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-01. [2025-10-02T21:34:45.073050] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-04. [2025-10-02T21:34:45.228962] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-08 (2.56 seconds). [2025-10-02T21:34:45.458045] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-02T21:34:45.873028] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-02. [2025-10-02T21:34:46.276677] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-02T21:34:46.673013] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-09. [2025-10-02T21:34:47.350510] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-02T21:34:47.473010] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-03. [2025-10-02T21:34:48.273066] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-08. [2025-10-02T21:34:48.883995] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-02T21:34:49.073027] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-09. [2025-10-02T21:34:49.121061] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-02T21:34:49.337041] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-09 (2.66 seconds). [2025-10-02T21:34:49.502593] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-02T21:34:49.873002] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-10. [2025-10-02T21:34:50.282468] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-02T21:34:50.283222] [INFO ] [REMOTE ] SNDA: Full fetch complete (8075 records). [2025-10-02T21:34:50.283291] [DEBUG] [VALIDATOR ] SNDA: Validating primary data. [2025-10-02T21:34:50.684336] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-10. [2025-10-02T21:34:50.693707] [DEBUG] [VALIDATOR ] SNDA: All expected trading days are present. [2025-10-02T21:34:50.693779] [DEBUG] [VALIDATOR ] SNDA: Primary data validation passed. [2025-10-02T21:34:50.694002] [INFO ] [MAIN ] SNDA: Fetched primary data is valid. [2025-10-02T21:34:50.694044] [DEBUG] [LOCAL ] SNDA: Saving primary data. [2025-10-02T21:34:50.694557] [DEBUG] [LOCAL ] SNDA: Trimmed 8075 records to 4544 (keeping 200 days of data) [2025-10-02T21:34:50.725944] [DEBUG] [LOCAL ] SNDA: Primary data saved (4544 records). [2025-10-02T21:34:50.726080] [INFO ] [MAIN ] SNDA: Full history saved. [2025-10-02T21:34:50.726199] [INFO ] [MAIN ] Update Progress: 1950/2370 symbols completed. SNDA took 28.2s. Estimated remaining: 59m 11s. Rate: 7.1 symbols/min [2025-10-02T21:34:50.910782] [INFO ] [MAIN ] SNOW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:34:50.965296] [DEBUG] [LOCAL ] SNOW: Loaded 53591 existing records from primary storage. [2025-10-02T21:34:50.965637] [INFO ] [MAIN ] SNOW: Loaded 53591 existing records. [2025-10-02T21:34:51.162524] [WARN ] [MAIN ] SNOW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:34:51.162757] [INFO ] [MAIN ] SNOW: Wiping existing primary data before full refresh. [2025-10-02T21:34:51.162811] [INFO ] [LOCAL ] SNOW: Starting deletion of primary data. [2025-10-02T21:34:51.163047] [DEBUG] [LOCAL ] SNOW: Deleted primary data file. [2025-10-02T21:34:51.163107] [INFO ] [MAIN ] SNOW: Starting full primary refresh. [2025-10-02T21:34:51.478120] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-05. [2025-10-02T21:34:51.593632] [INFO ] [REMOTE ] SNOW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:34:52.273036] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-04. [2025-10-02T21:34:52.803004] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-02T21:34:52.805480] [INFO ] [REMOTE ] SNAP: Full fetch complete (77934 records). [2025-10-02T21:34:52.805678] [DEBUG] [VALIDATOR ] SNAP: Validating primary data. [2025-10-02T21:34:53.090989] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2024-12. [2025-10-02T21:34:53.256101] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-02T21:34:53.312620] [DEBUG] [VALIDATOR ] SNAP: All expected trading days are present. [2025-10-02T21:34:53.313109] [DEBUG] [VALIDATOR ] SNAP: Primary data validation passed. [2025-10-02T21:34:53.314548] [INFO ] [MAIN ] SNAP: Fetched primary data is valid. [2025-10-02T21:34:53.314619] [DEBUG] [LOCAL ] SNAP: Saving primary data. [2025-10-02T21:34:53.316278] [DEBUG] [LOCAL ] SNAP: Trimmed 77934 records to 54186 (keeping 200 days of data) [2025-10-02T21:34:53.662129] [DEBUG] [LOCAL ] SNAP: Primary data saved (54186 records). [2025-10-02T21:34:53.662290] [INFO ] [MAIN ] SNAP: Full history saved. [2025-10-02T21:34:53.663060] [INFO ] [MAIN ] Update Progress: 1951/2370 symbols completed. SNAP took 42.4s. Estimated remaining: 59m 1s. Rate: 7.1 symbols/min [2025-10-02T21:34:53.882882] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-06. [2025-10-02T21:34:53.886789] [INFO ] [MAIN ] SNV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:34:53.957633] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-02T21:34:53.995351] [DEBUG] [LOCAL ] SNV: Loaded 48860 existing records from primary storage. [2025-10-02T21:34:53.995745] [INFO ] [MAIN ] SNV: Loaded 48860 existing records. [2025-10-02T21:34:54.181684] [WARN ] [MAIN ] SNV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:34:54.181945] [INFO ] [MAIN ] SNV: Wiping existing primary data before full refresh. [2025-10-02T21:34:54.181999] [INFO ] [LOCAL ] SNV: Starting deletion of primary data. [2025-10-02T21:34:54.182295] [DEBUG] [LOCAL ] SNV: Deleted primary data file. [2025-10-02T21:34:54.182363] [INFO ] [MAIN ] SNV: Starting full primary refresh. [2025-10-02T21:34:54.583726] [INFO ] [REMOTE ] SNV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:34:54.673021] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-05. [2025-10-02T21:34:55.001080] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-02T21:34:55.290664] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-10-02T21:34:55.473045] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-01. [2025-10-02T21:34:56.273053] [INFO ] [REMOTE ] SNV: Fetching primary data for 2024-12. [2025-10-02T21:34:56.334906] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-02T21:34:57.073071] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-07. [2025-10-02T21:34:57.880058] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-06. [2025-10-02T21:34:57.883323] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-01 (2.41 seconds). [2025-10-02T21:34:57.936762] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-02T21:34:58.335607] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-02T21:34:58.673024] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-02. [2025-10-02T21:34:59.458302] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-02T21:34:59.472958] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-07. [2025-10-02T21:35:00.272998] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-08. [2025-10-02T21:35:00.810033] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-10-02T21:35:01.073066] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-01. [2025-10-02T21:35:01.230239] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-02T21:35:01.822722] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-02T21:35:01.873013] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-09. [2025-10-02T21:35:02.672991] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-03. [2025-10-02T21:35:02.861026] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-02T21:35:03.435034] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-02T21:35:03.473024] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-10. [2025-10-02T21:35:04.273014] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-08. [2025-10-02T21:35:04.683331] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-02T21:35:04.685423] [INFO ] [REMOTE ] SNDR: Full fetch complete (59200 records). [2025-10-02T21:35:04.685788] [DEBUG] [VALIDATOR ] SNDR: Validating primary data. [2025-10-02T21:35:05.076096] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-02. [2025-10-02T21:35:05.137888] [DEBUG] [VALIDATOR ] SNDR: All expected trading days are present. [2025-10-02T21:35:05.138049] [DEBUG] [VALIDATOR ] SNDR: Primary data validation passed. [2025-10-02T21:35:05.139282] [INFO ] [MAIN ] SNDR: Fetched primary data is valid. [2025-10-02T21:35:05.139449] [DEBUG] [LOCAL ] SNDR: Saving primary data. [2025-10-02T21:35:05.141768] [DEBUG] [LOCAL ] SNDR: Trimmed 59200 records to 41042 (keeping 200 days of data) [2025-10-02T21:35:05.178228] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-03 (2.51 seconds). [2025-10-02T21:35:05.457234] [DEBUG] [LOCAL ] SNDR: Primary data saved (41042 records). [2025-10-02T21:35:05.457396] [INFO ] [MAIN ] SNDR: Full history saved. [2025-10-02T21:35:05.457486] [INFO ] [MAIN ] Update Progress: 1952/2370 symbols completed. SNDR took 31.9s. Estimated remaining: 58m 54s. Rate: 7.1 symbols/min [2025-10-02T21:35:05.666278] [INFO ] [MAIN ] SNX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:35:05.711471] [DEBUG] [LOCAL ] SNX: Loaded 40047 existing records from primary storage. [2025-10-02T21:35:05.711875] [INFO ] [MAIN ] SNX: Loaded 40047 existing records. [2025-10-02T21:35:05.877704] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-04. [2025-10-02T21:35:05.922773] [WARN ] [MAIN ] SNX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:35:05.923139] [INFO ] [MAIN ] SNX: Wiping existing primary data before full refresh. [2025-10-02T21:35:05.923358] [INFO ] [LOCAL ] SNX: Starting deletion of primary data. [2025-10-02T21:35:05.933671] [DEBUG] [LOCAL ] SNX: Deleted primary data file. [2025-10-02T21:35:05.951271] [INFO ] [MAIN ] SNX: Starting full primary refresh. [2025-10-02T21:35:06.021260] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-02T21:35:06.398810] [INFO ] [REMOTE ] SNX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:35:06.428420] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-02T21:35:06.673010] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-09. [2025-10-02T21:35:07.473002] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-03. [2025-10-02T21:35:08.272973] [INFO ] [REMOTE ] SNX: Fetching primary data for 2024-12. [2025-10-02T21:35:08.303085] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-02T21:35:08.398895] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-10-02T21:35:09.072984] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-10. [2025-10-02T21:35:09.125882] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-02T21:35:09.665292] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-02T21:35:09.873091] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-01. [2025-10-02T21:35:10.210367] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-02T21:35:10.212385] [INFO ] [REMOTE ] SNN: Full fetch complete (63082 records). [2025-10-02T21:35:10.212479] [DEBUG] [VALIDATOR ] SNN: Validating primary data. [2025-10-02T21:35:10.626341] [DEBUG] [VALIDATOR ] SNN: All expected trading days are present. [2025-10-02T21:35:10.626431] [DEBUG] [VALIDATOR ] SNN: Primary data validation passed. [2025-10-02T21:35:10.627440] [INFO ] [MAIN ] SNN: Fetched primary data is valid. [2025-10-02T21:35:10.627507] [DEBUG] [LOCAL ] SNN: Saving primary data. [2025-10-02T21:35:10.629608] [DEBUG] [LOCAL ] SNN: Trimmed 63082 records to 44528 (keeping 200 days of data) [2025-10-02T21:35:10.679749] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-05. [2025-10-02T21:35:10.907875] [DEBUG] [LOCAL ] SNN: Primary data saved (44528 records). [2025-10-02T21:35:10.908009] [INFO ] [MAIN ] SNN: Full history saved. [2025-10-02T21:35:10.908136] [INFO ] [MAIN ] Update Progress: 1953/2370 symbols completed. SNN took 35.9s. Estimated remaining: 58m 45s. Rate: 7.1 symbols/min [2025-10-02T21:35:11.092838] [INFO ] [MAIN ] SO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:35:11.144921] [DEBUG] [LOCAL ] SO: Loaded 53606 existing records from primary storage. [2025-10-02T21:35:11.145239] [INFO ] [MAIN ] SO: Loaded 53606 existing records. [2025-10-02T21:35:11.346358] [WARN ] [MAIN ] SO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:35:11.346577] [INFO ] [MAIN ] SO: Wiping existing primary data before full refresh. [2025-10-02T21:35:11.346668] [INFO ] [LOCAL ] SO: Starting deletion of primary data. [2025-10-02T21:35:11.347017] [DEBUG] [LOCAL ] SO: Deleted primary data file. [2025-10-02T21:35:11.347100] [INFO ] [MAIN ] SO: Starting full primary refresh. [2025-10-02T21:35:11.474869] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-04. [2025-10-02T21:35:11.654755] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-02T21:35:11.817229] [INFO ] [REMOTE ] SO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:35:12.273032] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-02. [2025-10-02T21:35:12.961108] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-10-02T21:35:13.072969] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-06. [2025-10-02T21:35:13.283938] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-02T21:35:13.767051] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-02T21:35:13.873029] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-05. [2025-10-02T21:35:14.673001] [INFO ] [REMOTE ] SO: Fetching primary data for 2024-12. [2025-10-02T21:35:15.297335] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-02T21:35:15.438922] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-10-02T21:35:15.473034] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-06. [2025-10-02T21:35:16.273034] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-03. [2025-10-02T21:35:16.587170] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-02T21:35:17.073000] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-01. [2025-10-02T21:35:17.370299] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-02T21:35:17.873077] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-07. [2025-10-02T21:35:17.966327] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-02T21:35:18.673009] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-04. [2025-10-02T21:35:18.911145] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-02T21:35:19.391103] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-02T21:35:19.473032] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-07. [2025-10-02T21:35:20.273036] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-02. [2025-10-02T21:35:20.418259] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-02T21:35:21.073039] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-08. [2025-10-02T21:35:21.720185] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-02T21:35:21.804046] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-10-02T21:35:21.873009] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-08. [2025-10-02T21:35:22.672963] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-05. [2025-10-02T21:35:22.885580] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-02T21:35:23.473033] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-09. [2025-10-02T21:35:23.577576] [DEBUG] [REMOTE ] SNV: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-10-02T21:35:23.577959] [WARN ] [REMOTE ] SNV: No data returned for month 2025-09 [2025-10-02T21:35:23.578118] [FATAL] [REMOTE ] SNV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T21:35:23.578233] [FATAL] [MAIN ] SNV: Failed to fetch primary data. [2025-10-02T21:35:23.578304] [WARN ] [MAIN ] SNV: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T21:35:23.578420] [INFO ] [LOCAL ] SNV: Starting deletion of primary data. [2025-10-02T21:35:23.578514] [DEBUG] [LOCAL ] SNV: No primary data file found to delete. [2025-10-02T21:35:23.578580] [INFO ] [LOCAL ] SNV: Starting deletion of derivative data. [2025-10-02T21:35:23.579140] [DEBUG] [LOCAL ] SNV: Deleted derivative data file. [2025-10-02T21:35:23.582173] [INFO ] [MAIN ] Update Progress: 1954/2370 symbols completed. SNV took 29.9s. Estimated remaining: 58m 37s. Rate: 7.1 symbols/min [2025-10-02T21:35:23.772980] [INFO ] [MAIN ] SOBO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:35:23.813590] [DEBUG] [LOCAL ] SOBO: Loaded 39455 existing records from primary storage. [2025-10-02T21:35:23.813926] [INFO ] [MAIN ] SOBO: Loaded 39455 existing records. [2025-10-02T21:35:24.029937] [WARN ] [MAIN ] SOBO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:35:24.030425] [INFO ] [MAIN ] SOBO: Wiping existing primary data before full refresh. [2025-10-02T21:35:24.030992] [INFO ] [LOCAL ] SOBO: Starting deletion of primary data. [2025-10-02T21:35:24.031438] [DEBUG] [LOCAL ] SOBO: Deleted primary data file. [2025-10-02T21:35:24.031638] [INFO ] [MAIN ] SOBO: Starting full primary refresh. [2025-10-02T21:35:24.283381] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-03. [2025-10-02T21:35:24.370586] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-02T21:35:24.478988] [INFO ] [REMOTE ] SOBO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:35:24.513523] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-08 (2.64 seconds). [2025-10-02T21:35:25.073044] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-09. [2025-10-02T21:35:25.873000] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2024-12. [2025-10-02T21:35:26.293507] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-02T21:35:26.672985] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-04. [2025-10-02T21:35:27.053181] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-02T21:35:27.329815] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-02T21:35:27.473047] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-06. [2025-10-02T21:35:28.256577] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-02T21:35:28.272949] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-05. [2025-10-02T21:35:28.943087] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-02T21:35:29.073001] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-01. [2025-10-02T21:35:29.873020] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-10. [2025-10-02T21:35:30.242419] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-02T21:35:30.314569] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-02T21:35:30.672999] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-06. [2025-10-02T21:35:31.473004] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-02. [2025-10-02T21:35:31.831726] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-02T21:35:31.834805] [INFO ] [REMOTE ] SNOW: Full fetch complete (77650 records). [2025-10-02T21:35:31.834969] [DEBUG] [VALIDATOR ] SNOW: Validating primary data. [2025-10-02T21:35:32.269467] [DEBUG] [VALIDATOR ] SNOW: All expected trading days are present. [2025-10-02T21:35:32.269587] [DEBUG] [VALIDATOR ] SNOW: Primary data validation passed. [2025-10-02T21:35:32.270772] [INFO ] [MAIN ] SNOW: Fetched primary data is valid. [2025-10-02T21:35:32.270863] [DEBUG] [LOCAL ] SNOW: Saving primary data. [2025-10-02T21:35:32.272451] [DEBUG] [LOCAL ] SNOW: Trimmed 77650 records to 53981 (keeping 200 days of data) [2025-10-02T21:35:32.273051] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-07. [2025-10-02T21:35:32.650661] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-02T21:35:32.681382] [DEBUG] [LOCAL ] SNOW: Primary data saved (53981 records). [2025-10-02T21:35:32.681528] [INFO ] [MAIN ] SNOW: Full history saved. [2025-10-02T21:35:32.681699] [INFO ] [MAIN ] Update Progress: 1955/2370 symbols completed. SNOW took 42.0s. Estimated remaining: 58m 29s. Rate: 7.1 symbols/min [2025-10-02T21:35:32.880991] [INFO ] [MAIN ] SOC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:35:32.905445] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-02T21:35:32.958488] [DEBUG] [LOCAL ] SOC: Loaded 50432 existing records from primary storage. [2025-10-02T21:35:32.958876] [INFO ] [MAIN ] SOC: Loaded 50432 existing records. [2025-10-02T21:35:33.078163] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-03. [2025-10-02T21:35:33.156120] [WARN ] [MAIN ] SOC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:35:33.156481] [INFO ] [MAIN ] SOC: Wiping existing primary data before full refresh. [2025-10-02T21:35:33.156548] [INFO ] [LOCAL ] SOC: Starting deletion of primary data. [2025-10-02T21:35:33.156841] [DEBUG] [LOCAL ] SOC: Deleted primary data file. [2025-10-02T21:35:33.156906] [INFO ] [MAIN ] SOC: Starting full primary refresh. [2025-10-02T21:35:33.561499] [INFO ] [REMOTE ] SOC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:35:33.587234] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-02T21:35:33.873007] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-07. [2025-10-02T21:35:34.672981] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-08. [2025-10-02T21:35:34.857618] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-02T21:35:35.472973] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-04. [2025-10-02T21:35:35.848150] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-02T21:35:36.235316] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-02T21:35:36.272970] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-09. [2025-10-02T21:35:36.523919] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-02T21:35:37.073001] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-05. [2025-10-02T21:35:37.632411] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-02T21:35:37.873010] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-10. [2025-10-02T21:35:38.209463] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-02T21:35:38.673039] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-06. [2025-10-02T21:35:38.959810] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-02T21:35:38.962586] [INFO ] [REMOTE ] SNX: Full fetch complete (57206 records). [2025-10-02T21:35:38.962806] [DEBUG] [VALIDATOR ] SNX: Validating primary data. [2025-10-02T21:35:39.420630] [DEBUG] [VALIDATOR ] SNX: All expected trading days are present. [2025-10-02T21:35:39.420771] [DEBUG] [VALIDATOR ] SNX: Primary data validation passed. [2025-10-02T21:35:39.421900] [INFO ] [MAIN ] SNX: Fetched primary data is valid. [2025-10-02T21:35:39.421968] [DEBUG] [LOCAL ] SNX: Saving primary data. [2025-10-02T21:35:39.423332] [DEBUG] [LOCAL ] SNX: Trimmed 57206 records to 40326 (keeping 200 days of data) [2025-10-02T21:35:39.490806] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-08. [2025-10-02T21:35:39.710581] [DEBUG] [LOCAL ] SNX: Primary data saved (40326 records). [2025-10-02T21:35:39.710747] [INFO ] [MAIN ] SNX: Full history saved. [2025-10-02T21:35:39.710858] [INFO ] [MAIN ] Update Progress: 1956/2370 symbols completed. SNX took 34.3s. Estimated remaining: 58m 20s. Rate: 7.1 symbols/min [2025-10-02T21:35:39.918482] [INFO ] [MAIN ] SOJC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:35:39.960205] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-02T21:35:39.976342] [DEBUG] [LOCAL ] SOJC: Loaded 5037 existing records from primary storage. [2025-10-02T21:35:39.976796] [INFO ] [MAIN ] SOJC: Loaded 5037 existing records. [2025-10-02T21:35:40.195252] [WARN ] [MAIN ] SOJC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:35:40.195537] [INFO ] [MAIN ] SOJC: Wiping existing primary data before full refresh. [2025-10-02T21:35:40.195587] [INFO ] [LOCAL ] SOJC: Starting deletion of primary data. [2025-10-02T21:35:40.195896] [DEBUG] [LOCAL ] SOJC: Deleted primary data file. [2025-10-02T21:35:40.195957] [INFO ] [MAIN ] SOJC: Starting full primary refresh. [2025-10-02T21:35:40.281432] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-07. [2025-10-02T21:35:40.646351] [INFO ] [REMOTE ] SOJC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:35:41.073413] [INFO ] [REMOTE ] SOC: Fetching primary data for 2024-12. [2025-10-02T21:35:41.444235] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-02T21:35:41.463913] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-02T21:35:41.873037] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-09. [2025-10-02T21:35:42.489362] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-02T21:35:42.673001] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-01. [2025-10-02T21:35:43.472973] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-08. [2025-10-02T21:35:43.755242] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-02T21:35:44.278370] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-10. [2025-10-02T21:35:44.291249] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-02T21:35:44.480038] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-02T21:35:45.073005] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2024-12. [2025-10-02T21:35:45.465551] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-02T21:35:45.467745] [INFO ] [REMOTE ] SO: Full fetch complete (77592 records). [2025-10-02T21:35:45.467911] [DEBUG] [VALIDATOR ] SO: Validating primary data. [2025-10-02T21:35:45.884885] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-02. [2025-10-02T21:35:45.890135] [DEBUG] [VALIDATOR ] SO: All expected trading days are present. [2025-10-02T21:35:45.890321] [DEBUG] [VALIDATOR ] SO: Primary data validation passed. [2025-10-02T21:35:45.891689] [INFO ] [MAIN ] SO: Fetched primary data is valid. [2025-10-02T21:35:45.892052] [DEBUG] [LOCAL ] SO: Saving primary data. [2025-10-02T21:35:45.895432] [DEBUG] [LOCAL ] SO: Trimmed 77592 records to 53996 (keeping 200 days of data) [2025-10-02T21:35:46.007129] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-02T21:35:46.269856] [DEBUG] [LOCAL ] SO: Primary data saved (53996 records). [2025-10-02T21:35:46.270266] [INFO ] [MAIN ] SO: Full history saved. [2025-10-02T21:35:46.270361] [INFO ] [MAIN ] Update Progress: 1957/2370 symbols completed. SO took 35.4s. Estimated remaining: 58m 11s. Rate: 7.1 symbols/min [2025-10-02T21:35:46.673068] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-01. [2025-10-02T21:35:47.379159] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-02T21:35:47.423016] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-02T21:35:47.473046] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-02. [2025-10-02T21:35:47.998913] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-02T21:35:48.273044] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-03. [2025-10-02T21:35:48.980852] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-02T21:35:49.073009] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-04. [2025-10-02T21:35:49.588476] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-02T21:35:49.873016] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-09. [2025-10-02T21:35:50.673072] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-05. [2025-10-02T21:35:51.290199] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-02T21:35:51.342556] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-02T21:35:51.473035] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-03. [2025-10-02T21:35:52.273008] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-10. [2025-10-02T21:35:53.073034] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-06. [2025-10-02T21:35:53.287557] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-02T21:35:53.351060] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-02T21:35:53.353129] [INFO ] [REMOTE ] SOBO: Full fetch complete (58461 records). [2025-10-02T21:35:53.353277] [DEBUG] [VALIDATOR ] SOBO: Validating primary data. [2025-10-02T21:35:53.743897] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-02T21:35:53.876027] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-07. [2025-10-02T21:35:53.896555] [DEBUG] [VALIDATOR ] SOBO: All expected trading days are present. [2025-10-02T21:35:53.896682] [DEBUG] [VALIDATOR ] SOBO: Primary data validation passed. [2025-10-02T21:35:53.897872] [INFO ] [MAIN ] SOBO: Fetched primary data is valid. [2025-10-02T21:35:53.898060] [DEBUG] [LOCAL ] SOBO: Saving primary data. [2025-10-02T21:35:53.899518] [DEBUG] [LOCAL ] SOBO: Trimmed 58461 records to 39774 (keeping 200 days of data) [2025-10-02T21:35:54.174602] [DEBUG] [LOCAL ] SOBO: Primary data saved (39774 records). [2025-10-02T21:35:54.174813] [INFO ] [MAIN ] SOBO: Full history saved. [2025-10-02T21:35:54.175354] [INFO ] [MAIN ] Update Progress: 1958/2370 symbols completed. SOBO took 30.6s. Estimated remaining: 58m 3s. Rate: 7.1 symbols/min [2025-10-02T21:35:54.651634] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-02T21:35:54.672973] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-04. [2025-10-02T21:35:55.473009] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-08. [2025-10-02T21:35:56.112363] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-02T21:35:56.146053] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-02T21:35:56.273004] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-05. [2025-10-02T21:35:57.072999] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-09. [2025-10-02T21:35:57.661517] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-02T21:35:57.766356] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-02T21:35:57.873013] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-10. [2025-10-02T21:35:58.263734] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-02T21:35:58.264523] [INFO ] [REMOTE ] SOJC: Full fetch complete (7777 records). [2025-10-02T21:35:58.264598] [DEBUG] [VALIDATOR ] SOJC: Validating primary data. [2025-10-02T21:35:58.664479] [DEBUG] [VALIDATOR ] SOJC: All expected trading days are present. [2025-10-02T21:35:58.664574] [DEBUG] [VALIDATOR ] SOJC: Primary data validation passed. [2025-10-02T21:35:58.664832] [INFO ] [MAIN ] SOJC: Fetched primary data is valid. [2025-10-02T21:35:58.664895] [DEBUG] [LOCAL ] SOJC: Saving primary data. [2025-10-02T21:35:58.665310] [DEBUG] [LOCAL ] SOJC: Trimmed 7777 records to 5063 (keeping 200 days of data) [2025-10-02T21:35:58.679739] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-06. [2025-10-02T21:35:58.699625] [DEBUG] [LOCAL ] SOJC: Primary data saved (5063 records). [2025-10-02T21:35:58.699750] [INFO ] [MAIN ] SOJC: Full history saved. [2025-10-02T21:35:58.699834] [INFO ] [MAIN ] Update Progress: 1959/2370 symbols completed. SOJC took 19.0s. Estimated remaining: 57m 53s. Rate: 7.1 symbols/min [2025-10-02T21:36:00.492958] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-02T21:36:00.503947] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-07. [2025-10-02T21:36:02.191365] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-02T21:36:02.203029] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-08. [2025-10-02T21:36:04.075384] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-02T21:36:04.086708] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-09. [2025-10-02T21:36:05.549539] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-02T21:36:05.561710] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-10. [2025-10-02T21:36:06.888526] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-02T21:36:06.890577] [INFO ] [REMOTE ] SOC: Full fetch complete (71615 records). [2025-10-02T21:36:06.890722] [DEBUG] [VALIDATOR ] SOC: Validating primary data. [2025-10-02T21:36:07.327975] [DEBUG] [VALIDATOR ] SOC: All expected trading days are present. [2025-10-02T21:36:07.328066] [DEBUG] [VALIDATOR ] SOC: Primary data validation passed. [2025-10-02T21:36:07.329324] [INFO ] [MAIN ] SOC: Fetched primary data is valid. [2025-10-02T21:36:07.329432] [DEBUG] [LOCAL ] SOC: Saving primary data. [2025-10-02T21:36:07.330961] [DEBUG] [LOCAL ] SOC: Trimmed 71615 records to 50819 (keeping 200 days of data) [2025-10-02T21:36:07.657911] [DEBUG] [LOCAL ] SOC: Primary data saved (50819 records). [2025-10-02T21:36:07.658357] [INFO ] [MAIN ] SOC: Full history saved. [2025-10-02T21:36:07.658459] [INFO ] [MAIN ] Update Progress: 1960/2370 symbols completed. SOC took 35.0s. Estimated remaining: 57m 45s. Rate: 7.1 symbols/min [2025-10-02T21:36:08.438627] [INFO ] [MAIN ] SOJF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:36:08.448053] [INFO ] [MAIN ] SOJD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:36:08.471861] [DEBUG] [LOCAL ] SOJF: No existing data file found in primary storage. [2025-10-02T21:36:08.474079] [WARN ] [MAIN ] SOJF: No existing data found, performing full refresh instead. [2025-10-02T21:36:08.536359] [INFO ] [MAIN ] SOJF: Wiping existing primary data before full refresh. [2025-10-02T21:36:08.546905] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-10-02T21:36:08.526259] [INFO ] [MAIN ] SOL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:36:08.559218] [DEBUG] [LOCAL ] SOJF: No primary data file found to delete. [2025-10-02T21:36:08.559705] [INFO ] [MAIN ] SOJF: Starting full primary refresh. [2025-10-02T21:36:08.558806] [INFO ] [MAIN ] SOJE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:36:08.652610] [DEBUG] [LOCAL ] SOJD: Loaded 13097 existing records from primary storage. [2025-10-02T21:36:08.679942] [INFO ] [MAIN ] SOJD: Loaded 13097 existing records. [2025-10-02T21:36:08.733079] [DEBUG] [LOCAL ] SOL: Loaded 13261 existing records from primary storage. [2025-10-02T21:36:08.766700] [INFO ] [MAIN ] SOL: Loaded 13261 existing records. [2025-10-02T21:36:08.738622] [DEBUG] [LOCAL ] SOJE: Loaded 9364 existing records from primary storage. [2025-10-02T21:36:08.845829] [INFO ] [MAIN ] SOJE: Loaded 9364 existing records. [2025-10-02T21:36:09.361229] [WARN ] [MAIN ] SOJD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:36:09.371812] [INFO ] [MAIN ] SOJD: Wiping existing primary data before full refresh. [2025-10-02T21:36:09.407399] [INFO ] [LOCAL ] SOJD: Starting deletion of primary data. [2025-10-02T21:36:09.470761] [DEBUG] [LOCAL ] SOJD: Deleted primary data file. [2025-10-02T21:36:09.527456] [WARN ] [MAIN ] SOL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:36:09.550077] [INFO ] [MAIN ] SOL: Wiping existing primary data before full refresh. [2025-10-02T21:36:09.560525] [INFO ] [MAIN ] SOJD: Starting full primary refresh. [2025-10-02T21:36:09.580576] [INFO ] [LOCAL ] SOL: Starting deletion of primary data. [2025-10-02T21:36:09.642926] [WARN ] [MAIN ] SOJE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:36:09.679737] [DEBUG] [LOCAL ] SOL: Deleted primary data file. [2025-10-02T21:36:09.722130] [INFO ] [MAIN ] SOL: Starting full primary refresh. [2025-10-02T21:36:09.713162] [INFO ] [MAIN ] SOJE: Wiping existing primary data before full refresh. [2025-10-02T21:36:09.737729] [INFO ] [LOCAL ] SOJE: Starting deletion of primary data. [2025-10-02T21:36:09.716874] [INFO ] [REMOTE ] SOJF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:36:09.760945] [DEBUG] [LOCAL ] SOJE: Deleted primary data file. [2025-10-02T21:36:09.761098] [INFO ] [MAIN ] SOJE: Starting full primary refresh. [2025-10-02T21:36:09.805514] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2024-12. [2025-10-02T21:36:10.256099] [DEBUG] [REMOTE ] SOJF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T21:36:10.295181] [WARN ] [REMOTE ] SOJF: No data returned for month 2024-12 [2025-10-02T21:36:10.378468] [FATAL] [REMOTE ] SOJF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T21:36:10.439443] [FATAL] [MAIN ] SOJF: Failed to fetch primary data. [2025-10-02T21:36:10.499988] [WARN ] [MAIN ] SOJF: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T21:36:10.546102] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-10-02T21:36:10.654803] [DEBUG] [LOCAL ] SOJF: No primary data file found to delete. [2025-10-02T21:36:10.714565] [INFO ] [LOCAL ] SOJF: Starting deletion of derivative data. [2025-10-02T21:36:10.738271] [DEBUG] [LOCAL ] SOJF: No derivative data file found to delete. [2025-10-02T21:36:10.747728] [INFO ] [MAIN ] Update Progress: 1961/2370 symbols completed. SOJF took 3.1s. Estimated remaining: 57m 35s. Rate: 7.1 symbols/min [2025-10-02T21:36:10.884751] [INFO ] [REMOTE ] SOJD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:36:11.007132] [INFO ] [REMOTE ] SOL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:36:11.010604] [INFO ] [REMOTE ] SOL: Fetching primary data for 2024-12. [2025-10-02T21:36:11.010230] [INFO ] [REMOTE ] SOJE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:36:10.921527] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2024-12. [2025-10-02T21:36:11.022756] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2024-12. [2025-10-02T21:36:11.149464] [INFO ] [MAIN ] SOLV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:36:11.194546] [DEBUG] [LOCAL ] SOLV: Loaded 43988 existing records from primary storage. [2025-10-02T21:36:11.194898] [INFO ] [MAIN ] SOLV: Loaded 43988 existing records. [2025-10-02T21:36:11.386836] [WARN ] [MAIN ] SOLV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:36:11.387078] [INFO ] [MAIN ] SOLV: Wiping existing primary data before full refresh. [2025-10-02T21:36:11.387129] [INFO ] [LOCAL ] SOLV: Starting deletion of primary data. [2025-10-02T21:36:11.387354] [DEBUG] [LOCAL ] SOLV: Deleted primary data file. [2025-10-02T21:36:11.387413] [INFO ] [MAIN ] SOLV: Starting full primary refresh. [2025-10-02T21:36:11.774016] [INFO ] [REMOTE ] SOLV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:36:11.774395] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2024-12. [2025-10-02T21:36:12.091428] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-02T21:36:12.095611] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-01. [2025-10-02T21:36:12.121769] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-02T21:36:12.126548] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-01. [2025-10-02T21:36:12.170537] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-02T21:36:12.175638] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-01. [2025-10-02T21:36:12.874893] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-02T21:36:12.878572] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-02. [2025-10-02T21:36:12.973879] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-02T21:36:12.978740] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-02. [2025-10-02T21:36:13.005921] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-02T21:36:13.016415] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-01. [2025-10-02T21:36:13.104961] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-02T21:36:13.109893] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-02. [2025-10-02T21:36:13.420346] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-02T21:36:13.423113] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-03. [2025-10-02T21:36:13.726522] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-02T21:36:13.730819] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-03. [2025-10-02T21:36:13.992437] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-02T21:36:13.996092] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-03. [2025-10-02T21:36:14.227507] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-02T21:36:14.305857] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-02T21:36:14.672974] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-04. [2025-10-02T21:36:14.796066] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-02T21:36:14.911992] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-02T21:36:15.472999] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-04. [2025-10-02T21:36:15.482252] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-02T21:36:16.273034] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-05. [2025-10-02T21:36:16.334907] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-02T21:36:17.040725] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-02T21:36:17.072989] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-06. [2025-10-02T21:36:17.833689] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-02T21:36:17.873031] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-07. [2025-10-02T21:36:18.626133] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-02T21:36:18.673029] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-02. [2025-10-02T21:36:19.473024] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-08. [2025-10-02T21:36:20.192486] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-02T21:36:20.248529] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-02T21:36:20.272984] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-09. [2025-10-02T21:36:20.656247] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-02T21:36:21.073019] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-03. [2025-10-02T21:36:21.873047] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-05. [2025-10-02T21:36:22.622503] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-02T21:36:22.655013] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-02T21:36:22.672957] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-06. [2025-10-02T21:36:23.473056] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-10. [2025-10-02T21:36:23.737577] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-02T21:36:23.912074] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-02T21:36:23.913157] [INFO ] [REMOTE ] SOJE: Full fetch complete (14334 records). [2025-10-02T21:36:23.913240] [DEBUG] [VALIDATOR ] SOJE: Validating primary data. [2025-10-02T21:36:24.279254] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-04. [2025-10-02T21:36:24.321304] [DEBUG] [VALIDATOR ] SOJE: All expected trading days are present. [2025-10-02T21:36:24.321450] [DEBUG] [VALIDATOR ] SOJE: Primary data validation passed. [2025-10-02T21:36:24.321953] [INFO ] [MAIN ] SOJE: Fetched primary data is valid. [2025-10-02T21:36:24.322034] [DEBUG] [LOCAL ] SOJE: Saving primary data. [2025-10-02T21:36:24.322603] [DEBUG] [LOCAL ] SOJE: Trimmed 14334 records to 9416 (keeping 200 days of data) [2025-10-02T21:36:24.387376] [DEBUG] [LOCAL ] SOJE: Primary data saved (9416 records). [2025-10-02T21:36:24.387570] [INFO ] [MAIN ] SOJE: Full history saved. [2025-10-02T21:36:24.387720] [INFO ] [MAIN ] Update Progress: 1962/2370 symbols completed. SOJE took 16.7s. Estimated remaining: 57m 28s. Rate: 7.1 symbols/min [2025-10-02T21:36:24.591915] [INFO ] [MAIN ] SON: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:36:24.643551] [DEBUG] [LOCAL ] SON: Loaded 43079 existing records from primary storage. [2025-10-02T21:36:24.643898] [INFO ] [MAIN ] SON: Loaded 43079 existing records. [2025-10-02T21:36:24.852565] [WARN ] [MAIN ] SON: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:36:24.853761] [INFO ] [MAIN ] SON: Wiping existing primary data before full refresh. [2025-10-02T21:36:24.853856] [INFO ] [LOCAL ] SON: Starting deletion of primary data. [2025-10-02T21:36:24.854147] [DEBUG] [LOCAL ] SON: Deleted primary data file. [2025-10-02T21:36:24.854214] [INFO ] [MAIN ] SON: Starting full primary refresh. [2025-10-02T21:36:25.078191] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-07. [2025-10-02T21:36:25.228743] [INFO ] [REMOTE ] SON: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:36:25.244795] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-02T21:36:25.872978] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-05. [2025-10-02T21:36:26.111124] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-02T21:36:26.673058] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-08. [2025-10-02T21:36:26.765210] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-02T21:36:27.474957] [INFO ] [REMOTE ] SON: Fetching primary data for 2024-12. [2025-10-02T21:36:27.476101] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-02T21:36:28.273036] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-09. [2025-10-02T21:36:28.942549] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-02T21:36:29.073004] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-01. [2025-10-02T21:36:29.160386] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-02T21:36:29.873061] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-04. [2025-10-02T21:36:30.637085] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-02T21:36:30.672990] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-02. [2025-10-02T21:36:31.466252] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-02T21:36:31.476118] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-10. [2025-10-02T21:36:32.136766] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-02T21:36:32.138006] [INFO ] [REMOTE ] SOL: Full fetch complete (21503 records). [2025-10-02T21:36:32.138188] [DEBUG] [VALIDATOR ] SOL: Validating primary data. [2025-10-02T21:36:32.276557] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-06. [2025-10-02T21:36:32.560698] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-02T21:36:32.589135] [DEBUG] [VALIDATOR ] SOL: All expected trading days are present. [2025-10-02T21:36:32.589249] [DEBUG] [VALIDATOR ] SOL: Primary data validation passed. [2025-10-02T21:36:32.589838] [INFO ] [MAIN ] SOL: Fetched primary data is valid. [2025-10-02T21:36:32.589905] [DEBUG] [LOCAL ] SOL: Saving primary data. [2025-10-02T21:36:32.590722] [DEBUG] [LOCAL ] SOL: Trimmed 21503 records to 13400 (keeping 200 days of data) [2025-10-02T21:36:32.670520] [DEBUG] [LOCAL ] SOL: Primary data saved (13400 records). [2025-10-02T21:36:32.670718] [INFO ] [MAIN ] SOL: Full history saved. [2025-10-02T21:36:32.670822] [INFO ] [MAIN ] Update Progress: 1963/2370 symbols completed. SOL took 25.0s. Estimated remaining: 57m 19s. Rate: 7.1 symbols/min [2025-10-02T21:36:32.843287] [INFO ] [MAIN ] SONY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:36:32.895392] [DEBUG] [LOCAL ] SONY: Loaded 53358 existing records from primary storage. [2025-10-02T21:36:32.895787] [INFO ] [MAIN ] SONY: Loaded 53358 existing records. [2025-10-02T21:36:33.079189] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-03. [2025-10-02T21:36:33.079031] [WARN ] [MAIN ] SONY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:36:33.079733] [INFO ] [MAIN ] SONY: Wiping existing primary data before full refresh. [2025-10-02T21:36:33.079849] [INFO ] [LOCAL ] SONY: Starting deletion of primary data. [2025-10-02T21:36:33.081442] [DEBUG] [LOCAL ] SONY: Deleted primary data file. [2025-10-02T21:36:33.081527] [INFO ] [MAIN ] SONY: Starting full primary refresh. [2025-10-02T21:36:33.258422] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-02T21:36:33.499094] [INFO ] [REMOTE ] SONY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:36:33.873138] [INFO ] [REMOTE ] SONY: Fetching primary data for 2024-12. [2025-10-02T21:36:34.673037] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-07. [2025-10-02T21:36:34.725108] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-02T21:36:35.473052] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-04. [2025-10-02T21:36:35.502230] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-02T21:36:35.622793] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-02T21:36:36.273037] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-01. [2025-10-02T21:36:37.032313] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-02T21:36:37.072959] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-05. [2025-10-02T21:36:37.885086] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-05. [2025-10-02T21:36:37.907506] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-02T21:36:38.682720] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-08. [2025-10-02T21:36:38.688331] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-02T21:36:39.139741] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-02T21:36:39.472982] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-06. [2025-10-02T21:36:39.490947] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-02T21:36:40.273050] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-06. [2025-10-02T21:36:40.927283] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-02T21:36:41.073023] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-07. [2025-10-02T21:36:41.804293] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-02T21:36:41.873037] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-02. [2025-10-02T21:36:42.427996] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-02T21:36:42.673061] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-07. [2025-10-02T21:36:43.472991] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-08. [2025-10-02T21:36:43.744913] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-02T21:36:44.214005] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-02T21:36:44.273003] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-08. [2025-10-02T21:36:44.977182] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-02T21:36:45.073057] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-03. [2025-10-02T21:36:45.483117] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-02T21:36:45.873038] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-09. [2025-10-02T21:36:46.672993] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-09. [2025-10-02T21:36:46.841951] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-02T21:36:47.473003] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-04. [2025-10-02T21:36:47.512233] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-02T21:36:48.280004] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-10. [2025-10-02T21:36:48.286342] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-02T21:36:49.073010] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-10. [2025-10-02T21:36:49.475537] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-02T21:36:49.505754] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-02T21:36:49.507713] [INFO ] [REMOTE ] SOLV: Full fetch complete (63298 records). [2025-10-02T21:36:49.507812] [DEBUG] [VALIDATOR ] SOLV: Validating primary data. [2025-10-02T21:36:49.873744] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-05. [2025-10-02T21:36:49.918418] [DEBUG] [VALIDATOR ] SOLV: All expected trading days are present. [2025-10-02T21:36:49.918562] [DEBUG] [VALIDATOR ] SOLV: Primary data validation passed. [2025-10-02T21:36:49.919723] [INFO ] [MAIN ] SOLV: Fetched primary data is valid. [2025-10-02T21:36:49.919790] [DEBUG] [LOCAL ] SOLV: Saving primary data. [2025-10-02T21:36:49.921332] [DEBUG] [LOCAL ] SOLV: Trimmed 63298 records to 44279 (keeping 200 days of data) [2025-10-02T21:36:50.203099] [DEBUG] [LOCAL ] SOLV: Primary data saved (44279 records). [2025-10-02T21:36:50.203238] [INFO ] [MAIN ] SOLV: Full history saved. [2025-10-02T21:36:50.203326] [INFO ] [MAIN ] Update Progress: 1964/2370 symbols completed. SOLV took 39.4s. Estimated remaining: 57m 13s. Rate: 7.1 symbols/min [2025-10-02T21:36:50.295958] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-02T21:36:50.326069] [INFO ] [REMOTE ] SON: Full fetch complete (62407 records). [2025-10-02T21:36:50.341960] [DEBUG] [VALIDATOR ] SON: Validating primary data. [2025-10-02T21:36:50.435210] [INFO ] [MAIN ] SOR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:36:50.544220] [DEBUG] [LOCAL ] SOR: Loaded 2877 existing records from primary storage. [2025-10-02T21:36:50.559940] [INFO ] [MAIN ] SOR: Loaded 2877 existing records. [2025-10-02T21:36:50.678209] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-09. [2025-10-02T21:36:51.009875] [WARN ] [MAIN ] SOR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:36:51.043297] [INFO ] [MAIN ] SOR: Wiping existing primary data before full refresh. [2025-10-02T21:36:51.045497] [INFO ] [LOCAL ] SOR: Starting deletion of primary data. [2025-10-02T21:36:51.064059] [DEBUG] [LOCAL ] SOR: Deleted primary data file. [2025-10-02T21:36:51.080832] [INFO ] [MAIN ] SOR: Starting full primary refresh. [2025-10-02T21:36:51.117631] [DEBUG] [VALIDATOR ] SON: All expected trading days are present. [2025-10-02T21:36:51.158797] [DEBUG] [VALIDATOR ] SON: Primary data validation passed. [2025-10-02T21:36:51.171586] [INFO ] [MAIN ] SON: Fetched primary data is valid. [2025-10-02T21:36:51.184562] [DEBUG] [LOCAL ] SON: Saving primary data. [2025-10-02T21:36:51.219290] [DEBUG] [LOCAL ] SON: Trimmed 62407 records to 43387 (keeping 200 days of data) [2025-10-02T21:36:51.594872] [INFO ] [REMOTE ] SOR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:36:51.598280] [INFO ] [REMOTE ] SOR: Fetching primary data for 2024-12. [2025-10-02T21:36:51.611068] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-02T21:36:51.816069] [DEBUG] [LOCAL ] SON: Primary data saved (43387 records). [2025-10-02T21:36:51.816384] [INFO ] [MAIN ] SON: Full history saved. [2025-10-02T21:36:51.817801] [INFO ] [MAIN ] Update Progress: 1965/2370 symbols completed. SON took 27.4s. Estimated remaining: 57m 3s. Rate: 7.1 symbols/min [2025-10-02T21:36:51.997756] [INFO ] [MAIN ] SOS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:36:52.038909] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-02T21:36:52.056613] [DEBUG] [LOCAL ] SOS: Loaded 8693 existing records from primary storage. [2025-10-02T21:36:52.056973] [INFO ] [MAIN ] SOS: Loaded 8693 existing records. [2025-10-02T21:36:52.256923] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-02T21:36:52.262596] [WARN ] [MAIN ] SOS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:36:52.262912] [INFO ] [MAIN ] SOS: Wiping existing primary data before full refresh. [2025-10-02T21:36:52.264278] [INFO ] [LOCAL ] SOS: Starting deletion of primary data. [2025-10-02T21:36:52.264577] [DEBUG] [LOCAL ] SOS: Deleted primary data file. [2025-10-02T21:36:52.264669] [INFO ] [MAIN ] SOS: Starting full primary refresh. [2025-10-02T21:36:52.278166] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-06. [2025-10-02T21:36:52.641668] [INFO ] [REMOTE ] SOS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:36:53.073014] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-01. [2025-10-02T21:36:53.688552] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-02T21:36:53.873058] [INFO ] [REMOTE ] SOS: Fetching primary data for 2024-12. [2025-10-02T21:36:54.255044] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-02T21:36:54.575220] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-02T21:36:54.672989] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-10. [2025-10-02T21:36:55.178589] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-02T21:36:55.179840] [INFO ] [REMOTE ] SOJD: Full fetch complete (19954 records). [2025-10-02T21:36:55.179919] [DEBUG] [VALIDATOR ] SOJD: Validating primary data. [2025-10-02T21:36:55.479920] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-01. [2025-10-02T21:36:55.600768] [DEBUG] [VALIDATOR ] SOJD: All expected trading days are present. [2025-10-02T21:36:55.600876] [DEBUG] [VALIDATOR ] SOJD: Primary data validation passed. [2025-10-02T21:36:55.601299] [INFO ] [MAIN ] SOJD: Fetched primary data is valid. [2025-10-02T21:36:55.601340] [DEBUG] [LOCAL ] SOJD: Saving primary data. [2025-10-02T21:36:55.602010] [DEBUG] [LOCAL ] SOJD: Trimmed 19954 records to 13201 (keeping 200 days of data) [2025-10-02T21:36:55.692259] [DEBUG] [LOCAL ] SOJD: Primary data saved (13201 records). [2025-10-02T21:36:55.692434] [INFO ] [MAIN ] SOJD: Full history saved. [2025-10-02T21:36:55.692537] [INFO ] [MAIN ] Update Progress: 1966/2370 symbols completed. SOJD took 48.0s. Estimated remaining: 56m 54s. Rate: 7.1 symbols/min [2025-10-02T21:36:55.874149] [INFO ] [MAIN ] SPB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:36:55.909727] [DEBUG] [LOCAL ] SPB: Loaded 34038 existing records from primary storage. [2025-10-02T21:36:55.910017] [INFO ] [MAIN ] SPB: Loaded 34038 existing records. [2025-10-02T21:36:56.096987] [WARN ] [MAIN ] SPB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:36:56.097202] [INFO ] [MAIN ] SPB: Wiping existing primary data before full refresh. [2025-10-02T21:36:56.097253] [INFO ] [LOCAL ] SPB: Starting deletion of primary data. [2025-10-02T21:36:56.097531] [DEBUG] [LOCAL ] SPB: Deleted primary data file. [2025-10-02T21:36:56.097592] [INFO ] [MAIN ] SPB: Starting full primary refresh. [2025-10-02T21:36:56.226782] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-02T21:36:56.273073] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-02. [2025-10-02T21:36:56.526549] [INFO ] [REMOTE ] SPB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:36:56.916098] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-02T21:36:57.073007] [INFO ] [REMOTE ] SPB: Fetching primary data for 2024-12. [2025-10-02T21:36:57.873003] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-07. [2025-10-02T21:36:58.121065] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-02T21:36:58.673006] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-01. [2025-10-02T21:36:59.473014] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-03. [2025-10-02T21:36:59.633879] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-02T21:36:59.943359] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-02T21:37:00.007982] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-02T21:37:00.273022] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-02. [2025-10-02T21:37:01.072993] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-04. [2025-10-02T21:37:01.682164] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-02T21:37:01.683993] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-02T21:37:01.873008] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-03. [2025-10-02T21:37:02.673005] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-02. [2025-10-02T21:37:03.026308] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-02T21:37:03.197016] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-02T21:37:03.473055] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-04. [2025-10-02T21:37:04.273057] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-03. [2025-10-02T21:37:04.745426] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-02T21:37:04.888355] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-02T21:37:05.073018] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-04. [2025-10-02T21:37:05.464476] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-02T21:37:05.873001] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-05. [2025-10-02T21:37:06.673003] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-08. [2025-10-02T21:37:07.280497] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-02T21:37:07.473001] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-05. [2025-10-02T21:37:07.848345] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-02T21:37:08.273027] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-06. [2025-10-02T21:37:08.341685] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-02T21:37:08.812689] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-02T21:37:09.073010] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-06. [2025-10-02T21:37:09.873056] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-09. [2025-10-02T21:37:10.511726] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-02T21:37:10.673022] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-07. [2025-10-02T21:37:11.459065] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-02T21:37:11.472950] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-10. [2025-10-02T21:37:11.893717] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-02T21:37:12.273005] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-07. [2025-10-02T21:37:12.867681] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-02T21:37:12.871484] [INFO ] [REMOTE ] SONY: Full fetch complete (77229 records). [2025-10-02T21:37:12.871613] [DEBUG] [VALIDATOR ] SONY: Validating primary data. [2025-10-02T21:37:13.080323] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-08. [2025-10-02T21:37:13.295732] [DEBUG] [VALIDATOR ] SONY: All expected trading days are present. [2025-10-02T21:37:13.295945] [DEBUG] [VALIDATOR ] SONY: Primary data validation passed. [2025-10-02T21:37:13.297329] [INFO ] [MAIN ] SONY: Fetched primary data is valid. [2025-10-02T21:37:13.297519] [DEBUG] [LOCAL ] SONY: Saving primary data. [2025-10-02T21:37:13.303008] [DEBUG] [LOCAL ] SONY: Trimmed 77229 records to 53748 (keeping 200 days of data) [2025-10-02T21:37:13.440604] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-02T21:37:13.669220] [DEBUG] [LOCAL ] SONY: Primary data saved (53748 records). [2025-10-02T21:37:13.669370] [INFO ] [MAIN ] SONY: Full history saved. [2025-10-02T21:37:13.669454] [INFO ] [MAIN ] Update Progress: 1967/2370 symbols completed. SONY took 41.0s. Estimated remaining: 56m 47s. Rate: 7.1 symbols/min [2025-10-02T21:37:13.856813] [INFO ] [MAIN ] SPCE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:37:13.882011] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-08. [2025-10-02T21:37:13.903856] [DEBUG] [LOCAL ] SPCE: Loaded 49928 existing records from primary storage. [2025-10-02T21:37:13.904239] [INFO ] [MAIN ] SPCE: Loaded 49928 existing records. [2025-10-02T21:37:14.102741] [WARN ] [MAIN ] SPCE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:37:14.103165] [INFO ] [MAIN ] SPCE: Wiping existing primary data before full refresh. [2025-10-02T21:37:14.103221] [INFO ] [LOCAL ] SPCE: Starting deletion of primary data. [2025-10-02T21:37:14.103471] [DEBUG] [LOCAL ] SPCE: Deleted primary data file. [2025-10-02T21:37:14.103530] [INFO ] [MAIN ] SPCE: Starting full primary refresh. [2025-10-02T21:37:14.255184] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-02T21:37:14.533342] [INFO ] [REMOTE ] SPCE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:37:14.673026] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-05. [2025-10-02T21:37:15.222724] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-02T21:37:15.343563] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-02T21:37:15.472996] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-06. [2025-10-02T21:37:16.057007] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-02T21:37:16.273025] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-09. [2025-10-02T21:37:17.073062] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-09. [2025-10-02T21:37:17.611435] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-02T21:37:17.873029] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-07. [2025-10-02T21:37:18.344462] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-02T21:37:18.419218] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-02T21:37:18.673015] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-10. [2025-10-02T21:37:19.473018] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-08. [2025-10-02T21:37:19.644949] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-02T21:37:19.645967] [INFO ] [REMOTE ] SOS: Full fetch complete (11077 records). [2025-10-02T21:37:19.646056] [DEBUG] [VALIDATOR ] SOS: Validating primary data. [2025-10-02T21:37:19.993530] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-02T21:37:20.082675] [DEBUG] [VALIDATOR ] SOS: All expected trading days are present. [2025-10-02T21:37:20.082782] [DEBUG] [VALIDATOR ] SOS: Primary data validation passed. [2025-10-02T21:37:20.083196] [INFO ] [MAIN ] SOS: Fetched primary data is valid. [2025-10-02T21:37:20.083245] [DEBUG] [LOCAL ] SOS: Saving primary data. [2025-10-02T21:37:20.083932] [DEBUG] [LOCAL ] SOS: Trimmed 11077 records to 8803 (keeping 200 days of data) [2025-10-02T21:37:20.136535] [DEBUG] [LOCAL ] SOS: Primary data saved (8803 records). [2025-10-02T21:37:20.136701] [INFO ] [MAIN ] SOS: Full history saved. [2025-10-02T21:37:20.136799] [INFO ] [MAIN ] Update Progress: 1968/2370 symbols completed. SOS took 28.3s. Estimated remaining: 56m 38s. Rate: 7.1 symbols/min [2025-10-02T21:37:20.284246] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-09. [2025-10-02T21:37:20.320134] [INFO ] [MAIN ] SPE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:37:20.329493] [DEBUG] [LOCAL ] SPE: Loaded 6350 existing records from primary storage. [2025-10-02T21:37:20.329738] [INFO ] [MAIN ] SPE: Loaded 6350 existing records. [2025-10-02T21:37:20.521133] [WARN ] [MAIN ] SPE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:37:20.521351] [INFO ] [MAIN ] SPE: Wiping existing primary data before full refresh. [2025-10-02T21:37:20.521440] [INFO ] [LOCAL ] SPE: Starting deletion of primary data. [2025-10-02T21:37:20.521632] [DEBUG] [LOCAL ] SPE: Deleted primary data file. [2025-10-02T21:37:20.521726] [INFO ] [MAIN ] SPE: Starting full primary refresh. [2025-10-02T21:37:20.844504] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-02T21:37:20.931155] [INFO ] [REMOTE ] SPE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:37:21.073017] [INFO ] [REMOTE ] SPE: Fetching primary data for 2024-12. [2025-10-02T21:37:21.613588] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-02T21:37:21.873021] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-10. [2025-10-02T21:37:22.672986] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2024-12. [2025-10-02T21:37:22.824071] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-02T21:37:22.825725] [INFO ] [REMOTE ] SPB: Full fetch complete (47520 records). [2025-10-02T21:37:22.825806] [DEBUG] [VALIDATOR ] SPB: Validating primary data. [2025-10-02T21:37:23.233639] [DEBUG] [VALIDATOR ] SPB: All expected trading days are present. [2025-10-02T21:37:23.233805] [DEBUG] [VALIDATOR ] SPB: Primary data validation passed. [2025-10-02T21:37:23.234939] [INFO ] [MAIN ] SPB: Fetched primary data is valid. [2025-10-02T21:37:23.235009] [DEBUG] [LOCAL ] SPB: Saving primary data. [2025-10-02T21:37:23.236185] [DEBUG] [LOCAL ] SPB: Trimmed 47520 records to 34265 (keeping 200 days of data) [2025-10-02T21:37:23.467687] [DEBUG] [LOCAL ] SPB: Primary data saved (34265 records). [2025-10-02T21:37:23.467860] [INFO ] [MAIN ] SPB: Full history saved. [2025-10-02T21:37:23.467972] [INFO ] [MAIN ] Update Progress: 1969/2370 symbols completed. SPB took 27.8s. Estimated remaining: 56m 29s. Rate: 7.1 symbols/min [2025-10-02T21:37:23.479582] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-01. [2025-10-02T21:37:23.666089] [INFO ] [MAIN ] SPG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:37:23.719360] [DEBUG] [LOCAL ] SPG: Loaded 50270 existing records from primary storage. [2025-10-02T21:37:23.719935] [INFO ] [MAIN ] SPG: Loaded 50270 existing records. [2025-10-02T21:37:23.921028] [WARN ] [MAIN ] SPG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:37:23.921304] [INFO ] [MAIN ] SPG: Wiping existing primary data before full refresh. [2025-10-02T21:37:23.921354] [INFO ] [LOCAL ] SPG: Starting deletion of primary data. [2025-10-02T21:37:23.921672] [DEBUG] [LOCAL ] SPG: Deleted primary data file. [2025-10-02T21:37:23.921731] [INFO ] [MAIN ] SPG: Starting full primary refresh. [2025-10-02T21:37:24.279525] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-10. [2025-10-02T21:37:24.317275] [INFO ] [REMOTE ] SPG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:37:24.324849] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-02T21:37:24.364934] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-02T21:37:24.608016] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-02T21:37:24.608823] [INFO ] [REMOTE ] SOR: Full fetch complete (4358 records). [2025-10-02T21:37:24.608932] [DEBUG] [VALIDATOR ] SOR: Validating primary data. [2025-10-02T21:37:25.002306] [DEBUG] [VALIDATOR ] SOR: All expected trading days are present. [2025-10-02T21:37:25.002392] [DEBUG] [VALIDATOR ] SOR: Primary data validation passed. [2025-10-02T21:37:25.002552] [INFO ] [MAIN ] SOR: Fetched primary data is valid. [2025-10-02T21:37:25.002595] [DEBUG] [LOCAL ] SOR: Saving primary data. [2025-10-02T21:37:25.003098] [DEBUG] [LOCAL ] SOR: Trimmed 4358 records to 2885 (keeping 200 days of data) [2025-10-02T21:37:25.022367] [DEBUG] [LOCAL ] SOR: Primary data saved (2885 records). [2025-10-02T21:37:25.022497] [INFO ] [MAIN ] SOR: Full history saved. [2025-10-02T21:37:25.022581] [INFO ] [MAIN ] Update Progress: 1970/2370 symbols completed. SOR took 34.8s. Estimated remaining: 56m 19s. Rate: 7.1 symbols/min [2025-10-02T21:37:25.082120] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-02. [2025-10-02T21:37:25.209793] [INFO ] [MAIN ] SPGI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:37:25.254704] [DEBUG] [LOCAL ] SPGI: Loaded 45757 existing records from primary storage. [2025-10-02T21:37:25.255095] [INFO ] [MAIN ] SPGI: Loaded 45757 existing records. [2025-10-02T21:37:25.457121] [WARN ] [MAIN ] SPGI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:37:25.457434] [INFO ] [MAIN ] SPGI: Wiping existing primary data before full refresh. [2025-10-02T21:37:25.457500] [INFO ] [LOCAL ] SPGI: Starting deletion of primary data. [2025-10-02T21:37:25.457846] [DEBUG] [LOCAL ] SPGI: Deleted primary data file. [2025-10-02T21:37:25.457930] [INFO ] [MAIN ] SPGI: Starting full primary refresh. [2025-10-02T21:37:25.878283] [INFO ] [REMOTE ] SPG: Fetching primary data for 2024-12. [2025-10-02T21:37:25.974732] [INFO ] [REMOTE ] SPGI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:37:26.054284] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-02T21:37:26.673055] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-03. [2025-10-02T21:37:27.413000] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-02T21:37:27.473009] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-01. [2025-10-02T21:37:27.509756] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-02T21:37:28.273062] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-01. [2025-10-02T21:37:29.073013] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-04. [2025-10-02T21:37:29.164106] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-02T21:37:29.794633] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-02T21:37:29.872976] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2024-12. [2025-10-02T21:37:30.083459] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-02T21:37:30.673014] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-02. [2025-10-02T21:37:31.473194] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-05. [2025-10-02T21:37:31.604498] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-02T21:37:31.837746] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-02T21:37:32.273019] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-01. [2025-10-02T21:37:32.563219] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-02T21:37:33.073033] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-02. [2025-10-02T21:37:33.872975] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-06. [2025-10-02T21:37:34.124097] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-02T21:37:34.575248] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-02T21:37:34.605060] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-02T21:37:34.673033] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-03. [2025-10-02T21:37:35.473014] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-03. [2025-10-02T21:37:36.272993] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-02. [2025-10-02T21:37:36.434122] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-02T21:37:37.073021] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-07. [2025-10-02T21:37:37.277995] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-02T21:37:37.872973] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-04. [2025-10-02T21:37:37.936593] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-02T21:37:38.061345] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-02T21:37:38.673008] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-08. [2025-10-02T21:37:39.290855] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-02T21:37:39.473037] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-03. [2025-10-02T21:37:39.731990] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-02T21:37:40.273026] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-09. [2025-10-02T21:37:41.020964] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-02T21:37:41.072990] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-04. [2025-10-02T21:37:41.412412] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-02T21:37:41.873049] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-04. [2025-10-02T21:37:42.673004] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-10. [2025-10-02T21:37:43.032401] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-02T21:37:43.136589] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-02T21:37:43.137429] [INFO ] [REMOTE ] SPE: Full fetch complete (10127 records). [2025-10-02T21:37:43.137555] [DEBUG] [VALIDATOR ] SPE: Validating primary data. [2025-10-02T21:37:43.478174] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-05. [2025-10-02T21:37:43.544768] [DEBUG] [VALIDATOR ] SPE: All expected trading days are present. [2025-10-02T21:37:43.544921] [DEBUG] [VALIDATOR ] SPE: Primary data validation passed. [2025-10-02T21:37:43.545252] [INFO ] [MAIN ] SPE: Fetched primary data is valid. [2025-10-02T21:37:43.545369] [DEBUG] [LOCAL ] SPE: Saving primary data. [2025-10-02T21:37:43.545951] [DEBUG] [LOCAL ] SPE: Trimmed 10127 records to 6374 (keeping 200 days of data) [2025-10-02T21:37:43.589574] [DEBUG] [LOCAL ] SPE: Primary data saved (6374 records). [2025-10-02T21:37:43.589729] [INFO ] [MAIN ] SPE: Full history saved. [2025-10-02T21:37:43.589840] [INFO ] [MAIN ] Update Progress: 1971/2370 symbols completed. SPE took 23.5s. Estimated remaining: 56m 13s. Rate: 7.1 symbols/min [2025-10-02T21:37:43.783423] [INFO ] [MAIN ] SPH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:37:43.806345] [DEBUG] [LOCAL ] SPH: Loaded 17477 existing records from primary storage. [2025-10-02T21:37:43.806597] [INFO ] [MAIN ] SPH: Loaded 17477 existing records. [2025-10-02T21:37:44.020076] [WARN ] [MAIN ] SPH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:37:44.020494] [INFO ] [MAIN ] SPH: Wiping existing primary data before full refresh. [2025-10-02T21:37:44.020569] [INFO ] [LOCAL ] SPH: Starting deletion of primary data. [2025-10-02T21:37:44.051528] [DEBUG] [LOCAL ] SPH: Deleted primary data file. [2025-10-02T21:37:44.051743] [INFO ] [MAIN ] SPH: Starting full primary refresh. [2025-10-02T21:37:44.127387] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-02T21:37:44.281879] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-05. [2025-10-02T21:37:44.446889] [INFO ] [REMOTE ] SPH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:37:45.072993] [INFO ] [REMOTE ] SPH: Fetching primary data for 2024-12. [2025-10-02T21:37:45.414671] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-02T21:37:45.872985] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-06. [2025-10-02T21:37:46.112585] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-02T21:37:46.292914] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-02T21:37:46.672982] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-01. [2025-10-02T21:37:47.472998] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-06. [2025-10-02T21:37:47.728843] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-02T21:37:47.756484] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-02T21:37:48.273002] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-07. [2025-10-02T21:37:49.073010] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-02. [2025-10-02T21:37:49.587671] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-02T21:37:49.873004] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-05. [2025-10-02T21:37:50.120008] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-02T21:37:50.194557] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-02T21:37:50.673008] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-03. [2025-10-02T21:37:51.472976] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-07. [2025-10-02T21:37:51.679710] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-02T21:37:51.872195] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-02T21:37:52.273021] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-04. [2025-10-02T21:37:53.072982] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-06. [2025-10-02T21:37:53.268055] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-02T21:37:53.390346] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-02T21:37:53.873004] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-08. [2025-10-02T21:37:54.633362] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-02T21:37:54.673013] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-07. [2025-10-02T21:37:55.450670] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-02T21:37:55.472958] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-09. [2025-10-02T21:37:56.272973] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-05. [2025-10-02T21:37:56.336049] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-02T21:37:57.016204] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-02T21:37:57.072989] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-06. [2025-10-02T21:37:57.107391] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-02T21:37:57.872970] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-08. [2025-10-02T21:37:58.186051] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-02T21:37:58.673008] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-10. [2025-10-02T21:37:59.472985] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-07. [2025-10-02T21:37:59.647877] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-02T21:37:59.777091] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-02T21:37:59.780261] [INFO ] [REMOTE ] SPG: Full fetch complete (71991 records). [2025-10-02T21:37:59.780438] [DEBUG] [VALIDATOR ] SPG: Validating primary data. [2025-10-02T21:38:00.203053] [DEBUG] [VALIDATOR ] SPG: All expected trading days are present. [2025-10-02T21:38:00.203204] [DEBUG] [VALIDATOR ] SPG: Primary data validation passed. [2025-10-02T21:38:00.204401] [INFO ] [MAIN ] SPG: Fetched primary data is valid. [2025-10-02T21:38:00.204468] [DEBUG] [LOCAL ] SPG: Saving primary data. [2025-10-02T21:38:00.207260] [DEBUG] [LOCAL ] SPG: Trimmed 71991 records to 50648 (keeping 200 days of data) [2025-10-02T21:38:00.274514] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-08. [2025-10-02T21:38:00.457389] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-02T21:38:00.579106] [DEBUG] [LOCAL ] SPG: Primary data saved (50648 records). [2025-10-02T21:38:00.579259] [INFO ] [MAIN ] SPG: Full history saved. [2025-10-02T21:38:00.579348] [INFO ] [MAIN ] Update Progress: 1972/2370 symbols completed. SPG took 37.1s. Estimated remaining: 56m 6s. Rate: 7.1 symbols/min [2025-10-02T21:38:00.770960] [INFO ] [MAIN ] SPHR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:38:00.988272] [DEBUG] [LOCAL ] SPHR: Loaded 40056 existing records from primary storage. [2025-10-02T21:38:00.988666] [INFO ] [MAIN ] SPHR: Loaded 40056 existing records. [2025-10-02T21:38:01.078163] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-09. [2025-10-02T21:38:01.202904] [WARN ] [MAIN ] SPHR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:38:01.203177] [INFO ] [MAIN ] SPHR: Wiping existing primary data before full refresh. [2025-10-02T21:38:01.203236] [INFO ] [LOCAL ] SPHR: Starting deletion of primary data. [2025-10-02T21:38:01.203561] [DEBUG] [LOCAL ] SPHR: Deleted primary data file. [2025-10-02T21:38:01.203634] [INFO ] [MAIN ] SPHR: Starting full primary refresh. [2025-10-02T21:38:01.601693] [INFO ] [REMOTE ] SPHR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:38:01.873005] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2024-12. [2025-10-02T21:38:02.433958] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-02T21:38:02.672968] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-09. [2025-10-02T21:38:03.030529] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-02T21:38:03.315028] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-02T21:38:03.473001] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-10. [2025-10-02T21:38:04.273027] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-01. [2025-10-02T21:38:04.610959] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-02T21:38:04.898254] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-02T21:38:04.901017] [INFO ] [REMOTE ] SPGI: Full fetch complete (66883 records). [2025-10-02T21:38:04.901130] [DEBUG] [VALIDATOR ] SPGI: Validating primary data. [2025-10-02T21:38:05.080801] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-08. [2025-10-02T21:38:05.329382] [DEBUG] [VALIDATOR ] SPGI: All expected trading days are present. [2025-10-02T21:38:05.329482] [DEBUG] [VALIDATOR ] SPGI: Primary data validation passed. [2025-10-02T21:38:05.330849] [INFO ] [MAIN ] SPGI: Fetched primary data is valid. [2025-10-02T21:38:05.330921] [DEBUG] [LOCAL ] SPGI: Saving primary data. [2025-10-02T21:38:05.332414] [DEBUG] [LOCAL ] SPGI: Trimmed 66883 records to 46117 (keeping 200 days of data) [2025-10-02T21:38:05.655046] [DEBUG] [LOCAL ] SPGI: Primary data saved (46117 records). [2025-10-02T21:38:05.655179] [INFO ] [MAIN ] SPGI: Full history saved. [2025-10-02T21:38:05.655264] [INFO ] [MAIN ] Update Progress: 1973/2370 symbols completed. SPGI took 40.6s. Estimated remaining: 55m 57s. Rate: 7.1 symbols/min [2025-10-02T21:38:05.844035] [INFO ] [MAIN ] SPIR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:38:05.867455] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-02T21:38:05.875696] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-10. [2025-10-02T21:38:05.908826] [DEBUG] [LOCAL ] SPIR: Loaded 37093 existing records from primary storage. [2025-10-02T21:38:05.909151] [INFO ] [MAIN ] SPIR: Loaded 37093 existing records. [2025-10-02T21:38:06.099818] [WARN ] [MAIN ] SPIR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:38:06.100030] [INFO ] [MAIN ] SPIR: Wiping existing primary data before full refresh. [2025-10-02T21:38:06.100080] [INFO ] [LOCAL ] SPIR: Starting deletion of primary data. [2025-10-02T21:38:06.100298] [DEBUG] [LOCAL ] SPIR: Deleted primary data file. [2025-10-02T21:38:06.100357] [INFO ] [MAIN ] SPIR: Starting full primary refresh. [2025-10-02T21:38:06.427791] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-02T21:38:06.508166] [INFO ] [REMOTE ] SPIR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:38:06.673001] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-02. [2025-10-02T21:38:07.428340] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-02T21:38:07.430486] [INFO ] [REMOTE ] SPCE: Full fetch complete (72365 records). [2025-10-02T21:38:07.430722] [DEBUG] [VALIDATOR ] SPCE: Validating primary data. [2025-10-02T21:38:07.479611] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2024-12. [2025-10-02T21:38:07.912195] [DEBUG] [VALIDATOR ] SPCE: All expected trading days are present. [2025-10-02T21:38:07.912376] [DEBUG] [VALIDATOR ] SPCE: Primary data validation passed. [2025-10-02T21:38:07.913668] [INFO ] [MAIN ] SPCE: Fetched primary data is valid. [2025-10-02T21:38:07.913747] [DEBUG] [LOCAL ] SPCE: Saving primary data. [2025-10-02T21:38:07.945728] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-02T21:38:07.953349] [DEBUG] [LOCAL ] SPCE: Trimmed 72365 records to 50307 (keeping 200 days of data) [2025-10-02T21:38:08.272293] [DEBUG] [LOCAL ] SPCE: Primary data saved (50307 records). [2025-10-02T21:38:08.272475] [INFO ] [MAIN ] SPCE: Full history saved. [2025-10-02T21:38:08.272665] [INFO ] [MAIN ] Update Progress: 1974/2370 symbols completed. SPCE took 54.6s. Estimated remaining: 55m 47s. Rate: 7.1 symbols/min [2025-10-02T21:38:08.278219] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-09. [2025-10-02T21:38:08.469141] [INFO ] [MAIN ] SPMC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:38:08.478838] [DEBUG] [LOCAL ] SPMC: Loaded 5380 existing records from primary storage. [2025-10-02T21:38:08.479075] [INFO ] [MAIN ] SPMC: Loaded 5380 existing records. [2025-10-02T21:38:08.713005] [WARN ] [MAIN ] SPMC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:38:08.713240] [INFO ] [MAIN ] SPMC: Wiping existing primary data before full refresh. [2025-10-02T21:38:08.713291] [INFO ] [LOCAL ] SPMC: Starting deletion of primary data. [2025-10-02T21:38:08.713484] [DEBUG] [LOCAL ] SPMC: Deleted primary data file. [2025-10-02T21:38:08.713543] [INFO ] [MAIN ] SPMC: Starting full primary refresh. [2025-10-02T21:38:09.081880] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-02T21:38:09.073927] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-03. [2025-10-02T21:38:09.151206] [INFO ] [REMOTE ] SPMC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:38:09.289853] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-02T21:38:09.872998] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-10. [2025-10-02T21:38:10.396128] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-02T21:38:10.556261] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-02T21:38:10.557359] [INFO ] [REMOTE ] SPH: Full fetch complete (28326 records). [2025-10-02T21:38:10.557430] [DEBUG] [VALIDATOR ] SPH: Validating primary data. [2025-10-02T21:38:10.675628] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-01. [2025-10-02T21:38:10.965069] [DEBUG] [VALIDATOR ] SPH: All expected trading days are present. [2025-10-02T21:38:10.965174] [DEBUG] [VALIDATOR ] SPH: Primary data validation passed. [2025-10-02T21:38:10.965851] [INFO ] [MAIN ] SPH: Fetched primary data is valid. [2025-10-02T21:38:10.965914] [DEBUG] [LOCAL ] SPH: Saving primary data. [2025-10-02T21:38:10.966629] [DEBUG] [LOCAL ] SPH: Trimmed 28326 records to 17585 (keeping 200 days of data) [2025-10-02T21:38:11.080508] [DEBUG] [LOCAL ] SPH: Primary data saved (17585 records). [2025-10-02T21:38:11.080699] [INFO ] [MAIN ] SPH: Full history saved. [2025-10-02T21:38:11.080852] [INFO ] [MAIN ] Update Progress: 1975/2370 symbols completed. SPH took 27.5s. Estimated remaining: 55m 37s. Rate: 7.1 symbols/min [2025-10-02T21:38:11.287176] [INFO ] [MAIN ] SPME: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:38:11.287355] [DEBUG] [LOCAL ] SPME: No existing data file found in primary storage. [2025-10-02T21:38:11.287413] [WARN ] [MAIN ] SPME: No existing data found, performing full refresh instead. [2025-10-02T21:38:11.287542] [INFO ] [MAIN ] SPME: Wiping existing primary data before full refresh. [2025-10-02T21:38:11.287597] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-10-02T21:38:11.287665] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-10-02T21:38:11.287722] [INFO ] [MAIN ] SPME: Starting full primary refresh. [2025-10-02T21:38:11.478895] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2024-12. [2025-10-02T21:38:11.683211] [INFO ] [REMOTE ] SPME: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:38:12.160601] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-02T21:38:12.185816] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-02T21:38:12.273004] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-01. [2025-10-02T21:38:12.855848] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-02T21:38:13.073050] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-04. [2025-10-02T21:38:13.873045] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-02. [2025-10-02T21:38:14.614452] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-02T21:38:14.673034] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-03. [2025-10-02T21:38:14.731349] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-02T21:38:15.389380] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-02T21:38:15.473005] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-04. [2025-10-02T21:38:16.200024] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-02T21:38:16.273049] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-02. [2025-10-02T21:38:17.073022] [INFO ] [REMOTE ] SPME: Fetching primary data for 2024-12. [2025-10-02T21:38:17.282213] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T21:38:17.282667] [WARN ] [REMOTE ] SPME: No data returned for month 2024-12 [2025-10-02T21:38:17.282759] [FATAL] [REMOTE ] SPME: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T21:38:17.282842] [FATAL] [MAIN ] SPME: Failed to fetch primary data. [2025-10-02T21:38:17.282922] [WARN ] [MAIN ] SPME: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T21:38:17.283010] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-10-02T21:38:17.283093] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-10-02T21:38:17.283146] [INFO ] [LOCAL ] SPME: Starting deletion of derivative data. [2025-10-02T21:38:17.283228] [DEBUG] [LOCAL ] SPME: No derivative data file found to delete. [2025-10-02T21:38:17.283314] [INFO ] [MAIN ] Update Progress: 1976/2370 symbols completed. SPME took 6.2s. Estimated remaining: 55m 29s. Rate: 7.1 symbols/min [2025-10-02T21:38:17.473545] [INFO ] [MAIN ] SPNT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:38:17.508387] [DEBUG] [LOCAL ] SPNT: Loaded 34829 existing records from primary storage. [2025-10-02T21:38:17.508712] [INFO ] [MAIN ] SPNT: Loaded 34829 existing records. [2025-10-02T21:38:17.727183] [WARN ] [MAIN ] SPNT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:38:17.728040] [INFO ] [MAIN ] SPNT: Wiping existing primary data before full refresh. [2025-10-02T21:38:17.729372] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-02T21:38:17.736807] [INFO ] [LOCAL ] SPNT: Starting deletion of primary data. [2025-10-02T21:38:17.737623] [DEBUG] [LOCAL ] SPNT: Deleted primary data file. [2025-10-02T21:38:17.737717] [INFO ] [MAIN ] SPNT: Starting full primary refresh. [2025-10-02T21:38:17.889353] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-05. [2025-10-02T21:38:18.122059] [INFO ] [REMOTE ] SPNT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:38:18.673052] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-03. [2025-10-02T21:38:19.431162] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-02T21:38:19.472957] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-06. [2025-10-02T21:38:19.627143] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-02T21:38:20.273005] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-04. [2025-10-02T21:38:20.821793] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-02T21:38:21.073081] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-05. [2025-10-02T21:38:21.720162] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-02T21:38:21.723613] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-02T21:38:21.873018] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2024-12. [2025-10-02T21:38:22.673054] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-07. [2025-10-02T21:38:23.208831] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-02T21:38:23.473052] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-06. [2025-10-02T21:38:24.094902] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-02T21:38:24.107414] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-02T21:38:24.273047] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-01. [2025-10-02T21:38:25.072974] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-07. [2025-10-02T21:38:25.361593] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-02T21:38:25.650471] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-02T21:38:25.873010] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-08. [2025-10-02T21:38:26.510756] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-02T21:38:26.673012] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-02. [2025-10-02T21:38:27.473053] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-05. [2025-10-02T21:38:27.941410] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-02T21:38:28.273094] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-03. [2025-10-02T21:38:28.933932] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-02T21:38:29.073032] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-08. [2025-10-02T21:38:29.398193] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-02T21:38:29.873009] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-06. [2025-10-02T21:38:30.550885] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-02T21:38:30.673008] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-09. [2025-10-02T21:38:31.234143] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-02T21:38:31.472989] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-04. [2025-10-02T21:38:31.577275] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-02T21:38:32.273014] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-09. [2025-10-02T21:38:32.588332] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-02T21:38:33.073049] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-10. [2025-10-02T21:38:33.471682] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-02T21:38:33.472476] [INFO ] [REMOTE ] SPMC: Full fetch complete (8154 records). [2025-10-02T21:38:33.472593] [DEBUG] [VALIDATOR ] SPMC: Validating primary data. [2025-10-02T21:38:33.875337] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-07. [2025-10-02T21:38:33.904194] [DEBUG] [VALIDATOR ] SPMC: All expected trading days are present. [2025-10-02T21:38:33.905473] [DEBUG] [VALIDATOR ] SPMC: Primary data validation passed. [2025-10-02T21:38:33.905853] [INFO ] [MAIN ] SPMC: Fetched primary data is valid. [2025-10-02T21:38:33.905940] [DEBUG] [LOCAL ] SPMC: Saving primary data. [2025-10-02T21:38:33.906917] [DEBUG] [LOCAL ] SPMC: Trimmed 8154 records to 5419 (keeping 200 days of data) [2025-10-02T21:38:33.945605] [DEBUG] [LOCAL ] SPMC: Primary data saved (5419 records). [2025-10-02T21:38:33.946375] [INFO ] [MAIN ] SPMC: Full history saved. [2025-10-02T21:38:33.946796] [INFO ] [MAIN ] Update Progress: 1977/2370 symbols completed. SPMC took 25.7s. Estimated remaining: 55m 22s. Rate: 7.1 symbols/min [2025-10-02T21:38:34.071521] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-02T21:38:34.186806] [INFO ] [MAIN ] SPOT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:38:34.240121] [DEBUG] [LOCAL ] SPOT: Loaded 50577 existing records from primary storage. [2025-10-02T21:38:34.240559] [INFO ] [MAIN ] SPOT: Loaded 50577 existing records. [2025-10-02T21:38:34.437889] [WARN ] [MAIN ] SPOT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:38:34.438186] [INFO ] [MAIN ] SPOT: Wiping existing primary data before full refresh. [2025-10-02T21:38:34.438242] [INFO ] [LOCAL ] SPOT: Starting deletion of primary data. [2025-10-02T21:38:34.438492] [DEBUG] [LOCAL ] SPOT: Deleted primary data file. [2025-10-02T21:38:34.438552] [INFO ] [MAIN ] SPOT: Starting full primary refresh. [2025-10-02T21:38:34.682383] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-05. [2025-10-02T21:38:34.814850] [INFO ] [REMOTE ] SPOT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:38:35.436885] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-02T21:38:35.473066] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-10. [2025-10-02T21:38:36.105977] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-02T21:38:36.273014] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-06. [2025-10-02T21:38:36.787030] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-02T21:38:36.788951] [INFO ] [REMOTE ] SPHR: Full fetch complete (57799 records). [2025-10-02T21:38:36.789047] [DEBUG] [VALIDATOR ] SPHR: Validating primary data. [2025-10-02T21:38:37.079550] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-08. [2025-10-02T21:38:37.216096] [DEBUG] [VALIDATOR ] SPHR: All expected trading days are present. [2025-10-02T21:38:37.216177] [DEBUG] [VALIDATOR ] SPHR: Primary data validation passed. [2025-10-02T21:38:37.217181] [INFO ] [MAIN ] SPHR: Fetched primary data is valid. [2025-10-02T21:38:37.217274] [DEBUG] [LOCAL ] SPHR: Saving primary data. [2025-10-02T21:38:37.218578] [DEBUG] [LOCAL ] SPHR: Trimmed 57799 records to 40384 (keeping 200 days of data) [2025-10-02T21:38:37.468715] [DEBUG] [LOCAL ] SPHR: Primary data saved (40384 records). [2025-10-02T21:38:37.468851] [INFO ] [MAIN ] SPHR: Full history saved. [2025-10-02T21:38:37.468948] [INFO ] [MAIN ] Update Progress: 1978/2370 symbols completed. SPHR took 36.9s. Estimated remaining: 55m 12s. Rate: 7.1 symbols/min [2025-10-02T21:38:37.661334] [INFO ] [MAIN ] SPR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:38:37.682013] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-02T21:38:37.727334] [DEBUG] [LOCAL ] SPR: Loaded 41174 existing records from primary storage. [2025-10-02T21:38:37.727693] [INFO ] [MAIN ] SPR: Loaded 41174 existing records. [2025-10-02T21:38:37.883685] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2024-12. [2025-10-02T21:38:37.930323] [WARN ] [MAIN ] SPR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:38:37.930751] [INFO ] [MAIN ] SPR: Wiping existing primary data before full refresh. [2025-10-02T21:38:37.930824] [INFO ] [LOCAL ] SPR: Starting deletion of primary data. [2025-10-02T21:38:37.931103] [DEBUG] [LOCAL ] SPR: Deleted primary data file. [2025-10-02T21:38:37.931162] [INFO ] [MAIN ] SPR: Starting full primary refresh. [2025-10-02T21:38:38.313885] [INFO ] [REMOTE ] SPR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:38:38.681587] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-07. [2025-10-02T21:38:38.686483] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-02T21:38:39.473064] [INFO ] [REMOTE ] SPR: Fetching primary data for 2024-12. [2025-10-02T21:38:40.208162] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2024-12 (2.32 seconds). [2025-10-02T21:38:40.240721] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-02T21:38:40.272972] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-08. [2025-10-02T21:38:41.000220] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-02T21:38:41.072983] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-01. [2025-10-02T21:38:41.454693] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-02T21:38:41.873023] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-01. [2025-10-02T21:38:42.673002] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-09. [2025-10-02T21:38:43.299318] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-02T21:38:43.338833] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-02T21:38:43.473005] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-02. [2025-10-02T21:38:43.801760] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-02T21:38:44.273030] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-10. [2025-10-02T21:38:44.632227] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-02T21:38:45.073043] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-03. [2025-10-02T21:38:45.409766] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-02T21:38:45.411447] [INFO ] [REMOTE ] SPIR: Full fetch complete (52782 records). [2025-10-02T21:38:45.411549] [DEBUG] [VALIDATOR ] SPIR: Validating primary data. [2025-10-02T21:38:45.830392] [DEBUG] [VALIDATOR ] SPIR: All expected trading days are present. [2025-10-02T21:38:45.830744] [DEBUG] [VALIDATOR ] SPIR: Primary data validation passed. [2025-10-02T21:38:45.831716] [INFO ] [MAIN ] SPIR: Fetched primary data is valid. [2025-10-02T21:38:45.831779] [DEBUG] [LOCAL ] SPIR: Saving primary data. [2025-10-02T21:38:45.832926] [DEBUG] [LOCAL ] SPIR: Trimmed 52782 records to 37398 (keeping 200 days of data) [2025-10-02T21:38:45.881706] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-02. [2025-10-02T21:38:46.058820] [DEBUG] [LOCAL ] SPIR: Primary data saved (37398 records). [2025-10-02T21:38:46.058967] [INFO ] [MAIN ] SPIR: Full history saved. [2025-10-02T21:38:46.059053] [INFO ] [MAIN ] Update Progress: 1979/2370 symbols completed. SPIR took 40.4s. Estimated remaining: 55m 4s. Rate: 7.1 symbols/min [2025-10-02T21:38:46.255709] [INFO ] [MAIN ] SPRU: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:38:46.269425] [DEBUG] [LOCAL ] SPRU: Loaded 9123 existing records from primary storage. [2025-10-02T21:38:46.269663] [INFO ] [MAIN ] SPRU: Loaded 9123 existing records. [2025-10-02T21:38:46.455751] [WARN ] [MAIN ] SPRU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:38:46.456053] [INFO ] [MAIN ] SPRU: Wiping existing primary data before full refresh. [2025-10-02T21:38:46.456106] [INFO ] [LOCAL ] SPRU: Starting deletion of primary data. [2025-10-02T21:38:46.456537] [DEBUG] [LOCAL ] SPRU: Deleted primary data file. [2025-10-02T21:38:46.456598] [INFO ] [MAIN ] SPRU: Starting full primary refresh. [2025-10-02T21:38:46.682299] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-09. [2025-10-02T21:38:46.851699] [INFO ] [REMOTE ] SPRU: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:38:46.879722] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-02T21:38:47.473012] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2024-12. [2025-10-02T21:38:47.985893] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-02T21:38:48.161213] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-02T21:38:48.273282] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-02 (2.39 seconds). [2025-10-02T21:38:48.273403] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-01. [2025-10-02T21:38:48.675349] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-02T21:38:49.073014] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-02. [2025-10-02T21:38:49.652386] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-02T21:38:49.872997] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-03. [2025-10-02T21:38:50.264869] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-02T21:38:50.673008] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-10. [2025-10-02T21:38:51.473006] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-03. [2025-10-02T21:38:51.676436] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-02T21:38:51.678141] [INFO ] [REMOTE ] SPNT: Full fetch complete (49079 records). [2025-10-02T21:38:51.678249] [DEBUG] [VALIDATOR ] SPNT: Validating primary data. [2025-10-02T21:38:52.125864] [DEBUG] [VALIDATOR ] SPNT: All expected trading days are present. [2025-10-02T21:38:52.125978] [DEBUG] [VALIDATOR ] SPNT: Primary data validation passed. [2025-10-02T21:38:52.127265] [INFO ] [MAIN ] SPNT: Fetched primary data is valid. [2025-10-02T21:38:52.127343] [DEBUG] [LOCAL ] SPNT: Saving primary data. [2025-10-02T21:38:52.132385] [DEBUG] [LOCAL ] SPNT: Trimmed 49079 records to 35084 (keeping 200 days of data) [2025-10-02T21:38:52.273059] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-04. [2025-10-02T21:38:52.388164] [DEBUG] [LOCAL ] SPNT: Primary data saved (35084 records). [2025-10-02T21:38:52.388370] [INFO ] [MAIN ] SPNT: Full history saved. [2025-10-02T21:38:52.389891] [INFO ] [MAIN ] Update Progress: 1980/2370 symbols completed. SPNT took 35.1s. Estimated remaining: 54m 55s. Rate: 7.1 symbols/min [2025-10-02T21:38:52.591274] [INFO ] [MAIN ] SPXC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:38:52.628152] [DEBUG] [LOCAL ] SPXC: Loaded 23393 existing records from primary storage. [2025-10-02T21:38:52.628456] [INFO ] [MAIN ] SPXC: Loaded 23393 existing records. [2025-10-02T21:38:52.832259] [WARN ] [MAIN ] SPXC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:38:52.832505] [INFO ] [MAIN ] SPXC: Wiping existing primary data before full refresh. [2025-10-02T21:38:52.832555] [INFO ] [LOCAL ] SPXC: Starting deletion of primary data. [2025-10-02T21:38:52.832828] [DEBUG] [LOCAL ] SPXC: Deleted primary data file. [2025-10-02T21:38:52.832893] [INFO ] [MAIN ] SPXC: Starting full primary refresh. [2025-10-02T21:38:53.078263] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-04. [2025-10-02T21:38:53.161121] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-02T21:38:53.249569] [INFO ] [REMOTE ] SPXC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:38:53.881633] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2024-12. [2025-10-02T21:38:53.905526] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-03 (2.43 seconds). [2025-10-02T21:38:54.673005] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-05. [2025-10-02T21:38:54.843701] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-02T21:38:55.094062] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-02T21:38:55.430316] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-02T21:38:55.472993] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-05. [2025-10-02T21:38:56.273025] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-06. [2025-10-02T21:38:56.901785] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-02T21:38:57.060256] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-02T21:38:57.072948] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-06. [2025-10-02T21:38:57.873029] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-07. [2025-10-02T21:38:58.426529] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-02T21:38:58.659761] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-02T21:38:58.673025] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-04. [2025-10-02T21:38:59.473023] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-07. [2025-10-02T21:39:00.272992] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-08. [2025-10-02T21:39:01.035222] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-02T21:39:01.084508] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-08. [2025-10-02T21:39:01.110956] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-10-02T21:39:01.191877] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-02T21:39:01.873008] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-09. [2025-10-02T21:39:02.249271] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-02T21:39:02.673005] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-01. [2025-10-02T21:39:02.719683] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-02T21:39:03.473006] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-05. [2025-10-02T21:39:03.947466] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-02T21:39:04.273036] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-10. [2025-10-02T21:39:04.930334] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-02T21:39:04.931451] [INFO ] [REMOTE ] SPRU: Full fetch complete (11723 records). [2025-10-02T21:39:04.931529] [DEBUG] [VALIDATOR ] SPRU: Validating primary data. [2025-10-02T21:39:05.081919] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-02. [2025-10-02T21:39:05.349001] [DEBUG] [VALIDATOR ] SPRU: All expected trading days are present. [2025-10-02T21:39:05.349273] [DEBUG] [VALIDATOR ] SPRU: Primary data validation passed. [2025-10-02T21:39:05.349771] [INFO ] [MAIN ] SPRU: Fetched primary data is valid. [2025-10-02T21:39:05.349837] [DEBUG] [LOCAL ] SPRU: Saving primary data. [2025-10-02T21:39:05.350407] [DEBUG] [LOCAL ] SPRU: Trimmed 11723 records to 9208 (keeping 200 days of data) [2025-10-02T21:39:05.407419] [DEBUG] [LOCAL ] SPRU: Primary data saved (9208 records). [2025-10-02T21:39:05.407557] [INFO ] [MAIN ] SPRU: Full history saved. [2025-10-02T21:39:05.407674] [INFO ] [MAIN ] Update Progress: 1981/2370 symbols completed. SPRU took 19.3s. Estimated remaining: 54m 47s. Rate: 7.1 symbols/min [2025-10-02T21:39:05.596062] [INFO ] [MAIN ] SPXX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:39:05.638335] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-02T21:39:05.638662] [DEBUG] [LOCAL ] SPXX: Loaded 9111 existing records from primary storage. [2025-10-02T21:39:05.649829] [INFO ] [MAIN ] SPXX: Loaded 9111 existing records. [2025-10-02T21:39:05.855930] [WARN ] [MAIN ] SPXX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:39:05.856177] [INFO ] [MAIN ] SPXX: Wiping existing primary data before full refresh. [2025-10-02T21:39:05.856228] [INFO ] [LOCAL ] SPXX: Starting deletion of primary data. [2025-10-02T21:39:05.856471] [DEBUG] [LOCAL ] SPXX: Deleted primary data file. [2025-10-02T21:39:05.856532] [INFO ] [MAIN ] SPXX: Starting full primary refresh. [2025-10-02T21:39:05.880184] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-06. [2025-10-02T21:39:06.270350] [INFO ] [REMOTE ] SPXX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:39:06.429019] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-02T21:39:06.673061] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2024-12. [2025-10-02T21:39:07.422941] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-02T21:39:07.472961] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-01. [2025-10-02T21:39:07.976769] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-02T21:39:07.983309] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-02T21:39:08.273027] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-07. [2025-10-02T21:39:09.073039] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-02. [2025-10-02T21:39:09.873006] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-03. [2025-10-02T21:39:09.953551] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-02T21:39:10.673009] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-09. [2025-10-02T21:39:10.801466] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-10-02T21:39:10.829042] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-02T21:39:11.473029] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-08. [2025-10-02T21:39:11.925565] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-02T21:39:12.273075] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-03. [2025-10-02T21:39:13.072980] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-10. [2025-10-02T21:39:13.171210] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-02T21:39:13.298992] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-02T21:39:13.873000] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-04. [2025-10-02T21:39:14.225386] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-02T21:39:14.227304] [INFO ] [REMOTE ] SPR: Full fetch complete (60101 records). [2025-10-02T21:39:14.227400] [DEBUG] [VALIDATOR ] SPR: Validating primary data. [2025-10-02T21:39:14.644821] [DEBUG] [VALIDATOR ] SPR: All expected trading days are present. [2025-10-02T21:39:14.644907] [DEBUG] [VALIDATOR ] SPR: Primary data validation passed. [2025-10-02T21:39:14.646038] [INFO ] [MAIN ] SPR: Fetched primary data is valid. [2025-10-02T21:39:14.646105] [DEBUG] [LOCAL ] SPR: Saving primary data. [2025-10-02T21:39:14.647534] [DEBUG] [LOCAL ] SPR: Trimmed 60101 records to 41503 (keeping 200 days of data) [2025-10-02T21:39:14.696343] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-09. [2025-10-02T21:39:14.901462] [DEBUG] [LOCAL ] SPR: Primary data saved (41503 records). [2025-10-02T21:39:14.901597] [INFO ] [MAIN ] SPR: Full history saved. [2025-10-02T21:39:14.901705] [INFO ] [MAIN ] Update Progress: 1982/2370 symbols completed. SPR took 37.4s. Estimated remaining: 54m 39s. Rate: 7.1 symbols/min [2025-10-02T21:39:15.085315] [INFO ] [MAIN ] SQM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:39:15.131403] [DEBUG] [LOCAL ] SQM: Loaded 48598 existing records from primary storage. [2025-10-02T21:39:15.131751] [INFO ] [MAIN ] SQM: Loaded 48598 existing records. [2025-10-02T21:39:15.258580] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-02T21:39:15.350188] [WARN ] [MAIN ] SQM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:39:15.350457] [INFO ] [MAIN ] SQM: Wiping existing primary data before full refresh. [2025-10-02T21:39:15.350519] [INFO ] [LOCAL ] SQM: Starting deletion of primary data. [2025-10-02T21:39:15.350784] [DEBUG] [LOCAL ] SQM: Deleted primary data file. [2025-10-02T21:39:15.350845] [INFO ] [MAIN ] SQM: Starting full primary refresh. [2025-10-02T21:39:15.478186] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-05. [2025-10-02T21:39:15.729894] [INFO ] [REMOTE ] SQM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:39:16.273003] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-04. [2025-10-02T21:39:16.368720] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-02T21:39:16.833675] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-02T21:39:16.884703] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-02T21:39:17.073002] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-05. [2025-10-02T21:39:17.793291] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-02T21:39:17.873002] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-06. [2025-10-02T21:39:18.673051] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-10. [2025-10-02T21:39:18.692775] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-02T21:39:19.473005] [INFO ] [REMOTE ] SQM: Fetching primary data for 2024-12. [2025-10-02T21:39:20.149392] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-02T21:39:20.151486] [INFO ] [REMOTE ] SPOT: Full fetch complete (73743 records). [2025-10-02T21:39:20.151781] [DEBUG] [VALIDATOR ] SPOT: Validating primary data. [2025-10-02T21:39:20.278118] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-07. [2025-10-02T21:39:20.569836] [DEBUG] [VALIDATOR ] SPOT: All expected trading days are present. [2025-10-02T21:39:20.569927] [DEBUG] [VALIDATOR ] SPOT: Primary data validation passed. [2025-10-02T21:39:20.571186] [INFO ] [MAIN ] SPOT: Fetched primary data is valid. [2025-10-02T21:39:20.571255] [DEBUG] [LOCAL ] SPOT: Saving primary data. [2025-10-02T21:39:20.572779] [DEBUG] [LOCAL ] SPOT: Trimmed 73743 records to 50918 (keeping 200 days of data) [2025-10-02T21:39:20.912319] [DEBUG] [LOCAL ] SPOT: Primary data saved (50918 records). [2025-10-02T21:39:20.912477] [INFO ] [MAIN ] SPOT: Full history saved. [2025-10-02T21:39:20.912581] [INFO ] [MAIN ] Update Progress: 1983/2370 symbols completed. SPOT took 47.0s. Estimated remaining: 54m 30s. Rate: 7.1 symbols/min [2025-10-02T21:39:21.089311] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-06. [2025-10-02T21:39:21.099098] [INFO ] [MAIN ] SQNS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:39:21.127020] [DEBUG] [LOCAL ] SQNS: Loaded 26380 existing records from primary storage. [2025-10-02T21:39:21.127284] [INFO ] [MAIN ] SQNS: Loaded 26380 existing records. [2025-10-02T21:39:21.216429] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-02T21:39:21.352150] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-02T21:39:21.366544] [WARN ] [MAIN ] SQNS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:39:21.377042] [INFO ] [MAIN ] SQNS: Wiping existing primary data before full refresh. [2025-10-02T21:39:21.377118] [INFO ] [LOCAL ] SQNS: Starting deletion of primary data. [2025-10-02T21:39:21.377316] [DEBUG] [LOCAL ] SQNS: Deleted primary data file. [2025-10-02T21:39:21.377377] [INFO ] [MAIN ] SQNS: Starting full primary refresh. [2025-10-02T21:39:21.776382] [INFO ] [REMOTE ] SQNS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:39:21.873001] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-01. [2025-10-02T21:39:22.200725] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-02T21:39:22.673032] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-07. [2025-10-02T21:39:23.383737] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-02T21:39:23.472985] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-02. [2025-10-02T21:39:23.793458] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-02T21:39:24.273015] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2024-12. [2025-10-02T21:39:25.072968] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-08. [2025-10-02T21:39:25.104558] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-02T21:39:25.158490] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-02T21:39:25.873024] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-03. [2025-10-02T21:39:26.111331] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-02T21:39:26.673019] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-09. [2025-10-02T21:39:27.336038] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-02T21:39:27.425926] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-02T21:39:27.473072] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-08. [2025-10-02T21:39:28.199471] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-02T21:39:28.273009] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-10. [2025-10-02T21:39:29.026613] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-02T21:39:29.028188] [INFO ] [REMOTE ] SPXC: Full fetch complete (34165 records). [2025-10-02T21:39:29.028275] [DEBUG] [VALIDATOR ] SPXC: Validating primary data. [2025-10-02T21:39:29.078107] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-09. [2025-10-02T21:39:29.461911] [DEBUG] [VALIDATOR ] SPXC: All expected trading days are present. [2025-10-02T21:39:29.462003] [DEBUG] [VALIDATOR ] SPXC: Primary data validation passed. [2025-10-02T21:39:29.462797] [INFO ] [MAIN ] SPXC: Fetched primary data is valid. [2025-10-02T21:39:29.462863] [DEBUG] [LOCAL ] SPXC: Saving primary data. [2025-10-02T21:39:29.463831] [DEBUG] [LOCAL ] SPXC: Trimmed 34165 records to 23572 (keeping 200 days of data) [2025-10-02T21:39:29.613700] [DEBUG] [LOCAL ] SPXC: Primary data saved (23572 records). [2025-10-02T21:39:29.613830] [INFO ] [MAIN ] SPXC: Full history saved. [2025-10-02T21:39:29.613913] [INFO ] [MAIN ] Update Progress: 1984/2370 symbols completed. SPXC took 37.2s. Estimated remaining: 54m 22s. Rate: 7.1 symbols/min [2025-10-02T21:39:29.803482] [INFO ] [MAIN ] SR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:39:29.841719] [DEBUG] [LOCAL ] SR: Loaded 32814 existing records from primary storage. [2025-10-02T21:39:29.842038] [INFO ] [MAIN ] SR: Loaded 32814 existing records. [2025-10-02T21:39:29.879984] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-04. [2025-10-02T21:39:30.070101] [WARN ] [MAIN ] SR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:39:30.071053] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-02T21:39:30.071274] [INFO ] [MAIN ] SR: Wiping existing primary data before full refresh. [2025-10-02T21:39:30.075765] [INFO ] [LOCAL ] SR: Starting deletion of primary data. [2025-10-02T21:39:30.076852] [DEBUG] [LOCAL ] SR: Deleted primary data file. [2025-10-02T21:39:30.076917] [INFO ] [MAIN ] SR: Starting full primary refresh. [2025-10-02T21:39:30.473938] [INFO ] [REMOTE ] SR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:39:30.673013] [INFO ] [REMOTE ] SR: Fetching primary data for 2024-12. [2025-10-02T21:39:31.472974] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-10. [2025-10-02T21:39:31.615355] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-02T21:39:31.659129] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-02T21:39:31.959465] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-02T21:39:31.960573] [INFO ] [REMOTE ] SPXX: Full fetch complete (12964 records). [2025-10-02T21:39:31.960736] [DEBUG] [VALIDATOR ] SPXX: Validating primary data. [2025-10-02T21:39:32.278194] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-01. [2025-10-02T21:39:32.374369] [DEBUG] [VALIDATOR ] SPXX: All expected trading days are present. [2025-10-02T21:39:32.374457] [DEBUG] [VALIDATOR ] SPXX: Primary data validation passed. [2025-10-02T21:39:32.374810] [INFO ] [MAIN ] SPXX: Fetched primary data is valid. [2025-10-02T21:39:32.374876] [DEBUG] [LOCAL ] SPXX: Saving primary data. [2025-10-02T21:39:32.375471] [DEBUG] [LOCAL ] SPXX: Trimmed 12964 records to 9234 (keeping 200 days of data) [2025-10-02T21:39:32.438401] [DEBUG] [LOCAL ] SPXX: Primary data saved (9234 records). [2025-10-02T21:39:32.438551] [INFO ] [MAIN ] SPXX: Full history saved. [2025-10-02T21:39:32.438636] [INFO ] [MAIN ] Update Progress: 1985/2370 symbols completed. SPXX took 27.0s. Estimated remaining: 54m 12s. Rate: 7.1 symbols/min [2025-10-02T21:39:32.628957] [INFO ] [MAIN ] SRE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:39:32.684388] [DEBUG] [LOCAL ] SRE: Loaded 53423 existing records from primary storage. [2025-10-02T21:39:32.684862] [INFO ] [MAIN ] SRE: Loaded 53423 existing records. [2025-10-02T21:39:32.880571] [WARN ] [MAIN ] SRE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:39:32.880876] [INFO ] [MAIN ] SRE: Wiping existing primary data before full refresh. [2025-10-02T21:39:32.880932] [INFO ] [LOCAL ] SRE: Starting deletion of primary data. [2025-10-02T21:39:32.881294] [DEBUG] [LOCAL ] SRE: Deleted primary data file. [2025-10-02T21:39:32.881358] [INFO ] [MAIN ] SRE: Starting full primary refresh. [2025-10-02T21:39:33.081510] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-05. [2025-10-02T21:39:33.296588] [INFO ] [REMOTE ] SRE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:39:33.307978] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-02T21:39:33.873006] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-02. [2025-10-02T21:39:34.641439] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-02T21:39:34.672959] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-03. [2025-10-02T21:39:34.805088] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-02T21:39:35.235491] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-02T21:39:35.473017] [INFO ] [REMOTE ] SRE: Fetching primary data for 2024-12. [2025-10-02T21:39:36.273020] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-01. [2025-10-02T21:39:37.073007] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-04. [2025-10-02T21:39:37.343935] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-02T21:39:37.580174] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-02T21:39:37.765052] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-02T21:39:37.873001] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-01. [2025-10-02T21:39:38.673023] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-06. [2025-10-02T21:39:39.473018] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-05. [2025-10-02T21:39:39.586537] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-02T21:39:40.101663] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-02T21:39:40.271738] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-02T21:39:40.280953] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-02. [2025-10-02T21:39:41.073003] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-02. [2025-10-02T21:39:41.855526] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-02T21:39:41.872963] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-03. [2025-10-02T21:39:42.471550] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-02T21:39:42.672995] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-03. [2025-10-02T21:39:43.409080] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-02T21:39:43.472995] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-07. [2025-10-02T21:39:44.077552] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-02T21:39:44.273020] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-06. [2025-10-02T21:39:45.072989] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-04. [2025-10-02T21:39:45.421798] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-02T21:39:45.469352] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-02T21:39:45.872999] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-07. [2025-10-02T21:39:46.553181] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-02T21:39:46.672997] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-05. [2025-10-02T21:39:47.473005] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-04. [2025-10-02T21:39:48.022578] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-02T21:39:48.216753] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-02T21:39:48.272973] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-08. [2025-10-02T21:39:48.973027] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-02T21:39:49.072996] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-05. [2025-10-02T21:39:49.878062] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-06. [2025-10-02T21:39:49.895807] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-02T21:39:50.673000] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-08. [2025-10-02T21:39:50.890659] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-02T21:39:51.255909] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-02T21:39:51.473000] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-07. [2025-10-02T21:39:52.272975] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-06. [2025-10-02T21:39:52.361470] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-02T21:39:52.597049] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-02T21:39:53.073006] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-08. [2025-10-02T21:39:53.873062] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-09. [2025-10-02T21:39:54.042815] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-02T21:39:54.540125] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-02T21:39:54.673007] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-09. [2025-10-02T21:39:55.386621] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-02T21:39:55.473006] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-10. [2025-10-02T21:39:56.190629] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-02T21:39:56.273009] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-09. [2025-10-02T21:39:56.828923] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-02T21:39:56.831724] [INFO ] [REMOTE ] SQM: Full fetch complete (68982 records). [2025-10-02T21:39:56.831896] [DEBUG] [VALIDATOR ] SQM: Validating primary data. [2025-10-02T21:39:57.080447] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-07. [2025-10-02T21:39:57.261839] [DEBUG] [VALIDATOR ] SQM: All expected trading days are present. [2025-10-02T21:39:57.261926] [DEBUG] [VALIDATOR ] SQM: Primary data validation passed. [2025-10-02T21:39:57.263215] [INFO ] [MAIN ] SQM: Fetched primary data is valid. [2025-10-02T21:39:57.263283] [DEBUG] [LOCAL ] SQM: Saving primary data. [2025-10-02T21:39:57.264935] [DEBUG] [LOCAL ] SQM: Trimmed 68982 records to 48970 (keeping 200 days of data) [2025-10-02T21:39:57.564099] [DEBUG] [LOCAL ] SQM: Primary data saved (48970 records). [2025-10-02T21:39:57.564247] [INFO ] [MAIN ] SQM: Full history saved. [2025-10-02T21:39:57.564340] [INFO ] [MAIN ] Update Progress: 1986/2370 symbols completed. SQM took 42.7s. Estimated remaining: 54m 7s. Rate: 7.1 symbols/min [2025-10-02T21:39:57.751223] [INFO ] [MAIN ] SREA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:39:57.764674] [DEBUG] [LOCAL ] SREA: Loaded 10419 existing records from primary storage. [2025-10-02T21:39:57.764961] [INFO ] [MAIN ] SREA: Loaded 10419 existing records. [2025-10-02T21:39:57.891774] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-10. [2025-10-02T21:39:57.984679] [WARN ] [MAIN ] SREA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:39:57.985502] [INFO ] [MAIN ] SREA: Wiping existing primary data before full refresh. [2025-10-02T21:39:57.985584] [INFO ] [LOCAL ] SREA: Starting deletion of primary data. [2025-10-02T21:39:57.985983] [DEBUG] [LOCAL ] SREA: Deleted primary data file. [2025-10-02T21:39:57.986064] [INFO ] [MAIN ] SREA: Starting full primary refresh. [2025-10-02T21:39:58.140670] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-02T21:39:58.397898] [INFO ] [REMOTE ] SREA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:39:58.672997] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-10. [2025-10-02T21:39:58.954084] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-02T21:39:58.955507] [INFO ] [REMOTE ] SR: Full fetch complete (46241 records). [2025-10-02T21:39:58.955587] [DEBUG] [VALIDATOR ] SR: Validating primary data. [2025-10-02T21:39:59.130871] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-02T21:39:59.429473] [DEBUG] [VALIDATOR ] SR: All expected trading days are present. [2025-10-02T21:39:59.429571] [DEBUG] [VALIDATOR ] SR: Primary data validation passed. [2025-10-02T21:39:59.430500] [INFO ] [MAIN ] SR: Fetched primary data is valid. [2025-10-02T21:39:59.430593] [DEBUG] [LOCAL ] SR: Saving primary data. [2025-10-02T21:39:59.431579] [DEBUG] [LOCAL ] SR: Trimmed 46241 records to 33043 (keeping 200 days of data) [2025-10-02T21:39:59.492845] [INFO ] [REMOTE ] SREA: Fetching primary data for 2024-12. [2025-10-02T21:39:59.656064] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-02T21:39:59.657638] [DEBUG] [LOCAL ] SR: Primary data saved (33043 records). [2025-10-02T21:39:59.659346] [INFO ] [MAIN ] SR: Full history saved. [2025-10-02T21:39:59.660099] [INFO ] [MAIN ] Update Progress: 1987/2370 symbols completed. SR took 30.0s. Estimated remaining: 53m 57s. Rate: 7.1 symbols/min [2025-10-02T21:39:59.660239] [INFO ] [REMOTE ] SQNS: Full fetch complete (32129 records). [2025-10-02T21:39:59.690252] [DEBUG] [VALIDATOR ] SQNS: Validating primary data. [2025-10-02T21:40:00.022202] [INFO ] [MAIN ] SRFM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:40:00.285880] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-08. [2025-10-02T21:40:00.304811] [DEBUG] [VALIDATOR ] SQNS: All expected trading days are present. [2025-10-02T21:40:00.304368] [DEBUG] [LOCAL ] SRFM: Loaded 36756 existing records from primary storage. [2025-10-02T21:40:00.306107] [DEBUG] [VALIDATOR ] SQNS: Primary data validation passed. [2025-10-02T21:40:00.306244] [INFO ] [MAIN ] SRFM: Loaded 36756 existing records. [2025-10-02T21:40:00.316751] [INFO ] [MAIN ] SQNS: Fetched primary data is valid. [2025-10-02T21:40:00.322256] [DEBUG] [LOCAL ] SQNS: Saving primary data. [2025-10-02T21:40:00.370483] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-02T21:40:00.436250] [DEBUG] [LOCAL ] SQNS: Trimmed 32129 records to 26511 (keeping 200 days of data) [2025-10-02T21:40:00.609907] [WARN ] [MAIN ] SRFM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:40:00.610893] [INFO ] [MAIN ] SRFM: Wiping existing primary data before full refresh. [2025-10-02T21:40:00.611222] [INFO ] [LOCAL ] SRFM: Starting deletion of primary data. [2025-10-02T21:40:00.612686] [DEBUG] [LOCAL ] SRFM: Deleted primary data file. [2025-10-02T21:40:00.613117] [INFO ] [MAIN ] SRFM: Starting full primary refresh. [2025-10-02T21:40:01.037608] [INFO ] [REMOTE ] SRFM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:40:01.075077] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2024-12. [2025-10-02T21:40:01.105744] [DEBUG] [LOCAL ] SQNS: Primary data saved (26511 records). [2025-10-02T21:40:01.105867] [INFO ] [MAIN ] SQNS: Full history saved. [2025-10-02T21:40:01.105978] [INFO ] [MAIN ] Update Progress: 1988/2370 symbols completed. SQNS took 40.2s. Estimated remaining: 53m 48s. Rate: 7.1 symbols/min [2025-10-02T21:40:01.307544] [INFO ] [MAIN ] SRG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:40:01.325703] [DEBUG] [LOCAL ] SRG: Loaded 15546 existing records from primary storage. [2025-10-02T21:40:01.325978] [INFO ] [MAIN ] SRG: Loaded 15546 existing records. [2025-10-02T21:40:01.533753] [WARN ] [MAIN ] SRG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:40:01.534006] [INFO ] [MAIN ] SRG: Wiping existing primary data before full refresh. [2025-10-02T21:40:01.534068] [INFO ] [LOCAL ] SRG: Starting deletion of primary data. [2025-10-02T21:40:01.534341] [DEBUG] [LOCAL ] SRG: Deleted primary data file. [2025-10-02T21:40:01.534436] [INFO ] [MAIN ] SRG: Starting full primary refresh. [2025-10-02T21:40:01.877485] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-01. [2025-10-02T21:40:01.970869] [INFO ] [REMOTE ] SRG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:40:02.269692] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-02T21:40:02.673022] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-09. [2025-10-02T21:40:02.830582] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-02T21:40:02.849460] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-02T21:40:03.473052] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-02. [2025-10-02T21:40:04.273039] [INFO ] [REMOTE ] SRG: Fetching primary data for 2024-12. [2025-10-02T21:40:04.292596] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-02T21:40:04.496889] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-02T21:40:05.073035] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-01. [2025-10-02T21:40:05.552273] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-02T21:40:05.873042] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-10. [2025-10-02T21:40:06.097227] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-02T21:40:06.673050] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-01. [2025-10-02T21:40:07.311499] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-02T21:40:07.313743] [INFO ] [REMOTE ] SRE: Full fetch complete (77296 records). [2025-10-02T21:40:07.313887] [DEBUG] [VALIDATOR ] SRE: Validating primary data. [2025-10-02T21:40:07.482064] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-02. [2025-10-02T21:40:07.715272] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-02T21:40:07.781164] [DEBUG] [VALIDATOR ] SRE: All expected trading days are present. [2025-10-02T21:40:07.781261] [DEBUG] [VALIDATOR ] SRE: Primary data validation passed. [2025-10-02T21:40:07.782757] [INFO ] [MAIN ] SRE: Fetched primary data is valid. [2025-10-02T21:40:07.782835] [DEBUG] [LOCAL ] SRE: Saving primary data. [2025-10-02T21:40:07.784675] [DEBUG] [LOCAL ] SRE: Trimmed 77296 records to 53812 (keeping 200 days of data) [2025-10-02T21:40:08.144278] [DEBUG] [LOCAL ] SRE: Primary data saved (53812 records). [2025-10-02T21:40:08.144481] [INFO ] [MAIN ] SRE: Full history saved. [2025-10-02T21:40:08.144619] [INFO ] [MAIN ] Update Progress: 1989/2370 symbols completed. SRE took 35.7s. Estimated remaining: 53m 39s. Rate: 7.1 symbols/min [2025-10-02T21:40:08.278226] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-02. [2025-10-02T21:40:08.326008] [INFO ] [MAIN ] SRI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:40:08.354237] [DEBUG] [LOCAL ] SRI: Loaded 27179 existing records from primary storage. [2025-10-02T21:40:08.354567] [INFO ] [MAIN ] SRI: Loaded 27179 existing records. [2025-10-02T21:40:08.546303] [WARN ] [MAIN ] SRI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:40:08.546551] [INFO ] [MAIN ] SRI: Wiping existing primary data before full refresh. [2025-10-02T21:40:08.546605] [INFO ] [LOCAL ] SRI: Starting deletion of primary data. [2025-10-02T21:40:08.546905] [DEBUG] [LOCAL ] SRI: Deleted primary data file. [2025-10-02T21:40:08.546968] [INFO ] [MAIN ] SRI: Starting full primary refresh. [2025-10-02T21:40:08.947447] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-02T21:40:08.972387] [INFO ] [REMOTE ] SRI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:40:09.073002] [INFO ] [REMOTE ] SRI: Fetching primary data for 2024-12. [2025-10-02T21:40:09.384528] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-02T21:40:09.873006] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-03. [2025-10-02T21:40:10.388358] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-02T21:40:10.672975] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-03. [2025-10-02T21:40:10.724167] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-02T21:40:11.473112] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-01. [2025-10-02T21:40:11.854794] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-02T21:40:12.273013] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-04. [2025-10-02T21:40:12.954503] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-02T21:40:13.073086] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-02. [2025-10-02T21:40:13.517911] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-02T21:40:13.873017] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-03. [2025-10-02T21:40:14.367057] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-02T21:40:14.673081] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-05. [2025-10-02T21:40:14.901486] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-02T21:40:15.473082] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-04. [2025-10-02T21:40:15.803234] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-02T21:40:16.272969] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-06. [2025-10-02T21:40:16.588062] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-02T21:40:17.073041] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-04. [2025-10-02T21:40:17.872984] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-05. [2025-10-02T21:40:17.903858] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-02T21:40:18.115298] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-02T21:40:18.672976] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-07. [2025-10-02T21:40:18.911830] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-02T21:40:19.473054] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-03. [2025-10-02T21:40:20.273033] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-05. [2025-10-02T21:40:20.803154] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-02T21:40:21.073028] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-04. [2025-10-02T21:40:21.272957] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-02T21:40:21.282853] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-07 (2.61 seconds). [2025-10-02T21:40:21.872975] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-06. [2025-10-02T21:40:22.344196] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-02T21:40:22.673018] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-08. [2025-10-02T21:40:22.718915] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-02T21:40:23.473131] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-07. [2025-10-02T21:40:24.109282] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-02T21:40:24.273041] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-05. [2025-10-02T21:40:24.786404] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-02T21:40:25.072994] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-09. [2025-10-02T21:40:25.443567] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-02T21:40:25.873006] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-06. [2025-10-02T21:40:26.678220] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-06. [2025-10-02T21:40:26.679886] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-02T21:40:27.187331] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-02T21:40:27.473024] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-07. [2025-10-02T21:40:28.039706] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-02T21:40:28.273105] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-08. [2025-10-02T21:40:28.306144] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-02T21:40:29.073013] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-07. [2025-10-02T21:40:29.270241] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-02T21:40:29.873000] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-10. [2025-10-02T21:40:30.440420] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-02T21:40:30.673074] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-08. [2025-10-02T21:40:31.473034] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-08. [2025-10-02T21:40:31.503791] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-02T21:40:31.571062] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-02T21:40:31.573213] [INFO ] [REMOTE ] SRFM: Full fetch complete (49575 records). [2025-10-02T21:40:31.573423] [DEBUG] [VALIDATOR ] SRFM: Validating primary data. [2025-10-02T21:40:31.976239] [DEBUG] [VALIDATOR ] SRFM: All expected trading days are present. [2025-10-02T21:40:31.976346] [DEBUG] [VALIDATOR ] SRFM: Primary data validation passed. [2025-10-02T21:40:31.977392] [INFO ] [MAIN ] SRFM: Fetched primary data is valid. [2025-10-02T21:40:31.977492] [DEBUG] [LOCAL ] SRFM: Saving primary data. [2025-10-02T21:40:31.978811] [DEBUG] [LOCAL ] SRFM: Trimmed 49575 records to 37139 (keeping 200 days of data) [2025-10-02T21:40:32.213227] [DEBUG] [LOCAL ] SRFM: Primary data saved (37139 records). [2025-10-02T21:40:32.213390] [INFO ] [MAIN ] SRFM: Full history saved. [2025-10-02T21:40:32.213547] [INFO ] [MAIN ] Update Progress: 1990/2370 symbols completed. SRFM took 32.6s. Estimated remaining: 53m 33s. Rate: 7.1 symbols/min [2025-10-02T21:40:32.276447] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-09. [2025-10-02T21:40:32.407286] [INFO ] [MAIN ] SRL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:40:32.407746] [DEBUG] [LOCAL ] SRL: No existing data file found in primary storage. [2025-10-02T21:40:32.407810] [WARN ] [MAIN ] SRL: No existing data found, performing full refresh instead. [2025-10-02T21:40:32.408144] [INFO ] [MAIN ] SRL: Wiping existing primary data before full refresh. [2025-10-02T21:40:32.408256] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-10-02T21:40:32.424129] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-10-02T21:40:32.424448] [INFO ] [MAIN ] SRL: Starting full primary refresh. [2025-10-02T21:40:32.462997] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-02T21:40:32.830980] [INFO ] [REMOTE ] SRL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:40:33.073002] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-09. [2025-10-02T21:40:33.277944] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-02T21:40:33.873000] [INFO ] [REMOTE ] SRL: Fetching primary data for 2024-12. [2025-10-02T21:40:34.246540] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-02T21:40:34.516980] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-02T21:40:34.672990] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-01. [2025-10-02T21:40:35.155386] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-02T21:40:35.473061] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-10. [2025-10-02T21:40:36.074962] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-02T21:40:36.076562] [INFO ] [REMOTE ] SRI: Full fetch complete (41108 records). [2025-10-02T21:40:36.076802] [DEBUG] [VALIDATOR ] SRI: Validating primary data. [2025-10-02T21:40:36.273212] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-10. [2025-10-02T21:40:36.497418] [DEBUG] [VALIDATOR ] SRI: All expected trading days are present. [2025-10-02T21:40:36.497541] [DEBUG] [VALIDATOR ] SRI: Primary data validation passed. [2025-10-02T21:40:36.499422] [INFO ] [MAIN ] SRI: Fetched primary data is valid. [2025-10-02T21:40:36.499497] [DEBUG] [LOCAL ] SRI: Saving primary data. [2025-10-02T21:40:36.501169] [DEBUG] [LOCAL ] SRI: Trimmed 41108 records to 27284 (keeping 200 days of data) [2025-10-02T21:40:36.683054] [DEBUG] [LOCAL ] SRI: Primary data saved (27284 records). [2025-10-02T21:40:36.683303] [INFO ] [MAIN ] SRI: Full history saved. [2025-10-02T21:40:36.683450] [INFO ] [MAIN ] Update Progress: 1991/2370 symbols completed. SRI took 28.5s. Estimated remaining: 53m 24s. Rate: 7.1 symbols/min [2025-10-02T21:40:36.860083] [INFO ] [MAIN ] SRV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:40:36.871489] [DEBUG] [LOCAL ] SRV: Loaded 7385 existing records from primary storage. [2025-10-02T21:40:36.871786] [INFO ] [MAIN ] SRV: Loaded 7385 existing records. [2025-10-02T21:40:37.029353] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-02T21:40:37.063797] [WARN ] [MAIN ] SRV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:40:37.064002] [INFO ] [REMOTE ] SRG: Full fetch complete (24540 records). [2025-10-02T21:40:37.064437] [INFO ] [MAIN ] SRV: Wiping existing primary data before full refresh. [2025-10-02T21:40:37.064680] [DEBUG] [VALIDATOR ] SRG: Validating primary data. [2025-10-02T21:40:37.064539] [INFO ] [LOCAL ] SRV: Starting deletion of primary data. [2025-10-02T21:40:37.070787] [DEBUG] [LOCAL ] SRV: Deleted primary data file. [2025-10-02T21:40:37.079607] [INFO ] [MAIN ] SRV: Starting full primary refresh. [2025-10-02T21:40:37.079346] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-09. [2025-10-02T21:40:37.883623] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-02. [2025-10-02T21:40:37.907981] [INFO ] [REMOTE ] SRV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:40:37.920811] [DEBUG] [VALIDATOR ] SRG: All expected trading days are present. [2025-10-02T21:40:37.921410] [DEBUG] [VALIDATOR ] SRG: Primary data validation passed. [2025-10-02T21:40:37.922631] [INFO ] [MAIN ] SRG: Fetched primary data is valid. [2025-10-02T21:40:37.930201] [DEBUG] [LOCAL ] SRG: Saving primary data. [2025-10-02T21:40:37.931941] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-02T21:40:37.936468] [DEBUG] [LOCAL ] SRG: Trimmed 24540 records to 15591 (keeping 200 days of data) [2025-10-02T21:40:38.040676] [DEBUG] [LOCAL ] SRG: Primary data saved (15591 records). [2025-10-02T21:40:38.040895] [INFO ] [MAIN ] SRG: Full history saved. [2025-10-02T21:40:38.041005] [INFO ] [MAIN ] Update Progress: 1992/2370 symbols completed. SRG took 36.9s. Estimated remaining: 53m 14s. Rate: 7.1 symbols/min [2025-10-02T21:40:38.213992] [INFO ] [MAIN ] SSB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:40:38.229190] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-02T21:40:38.265480] [DEBUG] [LOCAL ] SSB: Loaded 42655 existing records from primary storage. [2025-10-02T21:40:38.265985] [INFO ] [MAIN ] SSB: Loaded 42655 existing records. [2025-10-02T21:40:38.445033] [WARN ] [MAIN ] SSB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:40:38.445346] [INFO ] [MAIN ] SSB: Wiping existing primary data before full refresh. [2025-10-02T21:40:38.445399] [INFO ] [LOCAL ] SSB: Starting deletion of primary data. [2025-10-02T21:40:38.445787] [DEBUG] [LOCAL ] SSB: Deleted primary data file. [2025-10-02T21:40:38.445848] [INFO ] [MAIN ] SSB: Starting full primary refresh. [2025-10-02T21:40:38.678243] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-10. [2025-10-02T21:40:38.849317] [INFO ] [REMOTE ] SSB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:40:39.199163] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-02T21:40:39.200178] [INFO ] [REMOTE ] SREA: Full fetch complete (15765 records). [2025-10-02T21:40:39.200258] [DEBUG] [VALIDATOR ] SREA: Validating primary data. [2025-10-02T21:40:39.478213] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-03. [2025-10-02T21:40:39.597844] [DEBUG] [VALIDATOR ] SREA: All expected trading days are present. [2025-10-02T21:40:39.597931] [DEBUG] [VALIDATOR ] SREA: Primary data validation passed. [2025-10-02T21:40:39.598384] [INFO ] [MAIN ] SREA: Fetched primary data is valid. [2025-10-02T21:40:39.598450] [DEBUG] [LOCAL ] SREA: Saving primary data. [2025-10-02T21:40:39.599041] [DEBUG] [LOCAL ] SREA: Trimmed 15765 records to 10481 (keeping 200 days of data) [2025-10-02T21:40:39.675467] [DEBUG] [LOCAL ] SREA: Primary data saved (10481 records). [2025-10-02T21:40:39.675680] [INFO ] [MAIN ] SREA: Full history saved. [2025-10-02T21:40:39.675847] [INFO ] [MAIN ] Update Progress: 1993/2370 symbols completed. SREA took 42.1s. Estimated remaining: 53m 5s. Rate: 7.1 symbols/min [2025-10-02T21:40:39.868173] [INFO ] [MAIN ] SSD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:40:39.895375] [DEBUG] [LOCAL ] SSD: Loaded 22456 existing records from primary storage. [2025-10-02T21:40:39.895703] [INFO ] [MAIN ] SSD: Loaded 22456 existing records. [2025-10-02T21:40:39.981117] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-02T21:40:40.101831] [WARN ] [MAIN ] SSD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:40:40.102078] [INFO ] [MAIN ] SSD: Wiping existing primary data before full refresh. [2025-10-02T21:40:40.102129] [INFO ] [LOCAL ] SSD: Starting deletion of primary data. [2025-10-02T21:40:40.102367] [DEBUG] [LOCAL ] SSD: Deleted primary data file. [2025-10-02T21:40:40.102427] [INFO ] [MAIN ] SSD: Starting full primary refresh. [2025-10-02T21:40:40.281451] [INFO ] [REMOTE ] SRV: Fetching primary data for 2024-12. [2025-10-02T21:40:40.531629] [INFO ] [REMOTE ] SSD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:40:41.073032] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-04. [2025-10-02T21:40:41.179142] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-02T21:40:41.519482] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-02T21:40:41.873010] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-05. [2025-10-02T21:40:42.399692] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-02T21:40:42.672996] [INFO ] [REMOTE ] SSD: Fetching primary data for 2024-12. [2025-10-02T21:40:43.472980] [INFO ] [REMOTE ] SSB: Fetching primary data for 2024-12. [2025-10-02T21:40:43.850338] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-02T21:40:44.273088] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-06. [2025-10-02T21:40:44.625874] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-02T21:40:45.057132] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-02T21:40:45.072950] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-01. [2025-10-02T21:40:45.873033] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-01. [2025-10-02T21:40:46.441468] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-02T21:40:46.687683] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-01. [2025-10-02T21:40:46.717263] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-02T21:40:47.472976] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-02. [2025-10-02T21:40:47.845953] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-02T21:40:48.177953] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-02T21:40:48.273027] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-02. [2025-10-02T21:40:49.076536] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-03. [2025-10-02T21:40:49.087127] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-02T21:40:49.665540] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-02T21:40:49.873007] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-03. [2025-10-02T21:40:50.673006] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-07. [2025-10-02T21:40:51.062899] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-02T21:40:51.086996] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-02T21:40:51.473070] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-04. [2025-10-02T21:40:52.273056] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-02. [2025-10-02T21:40:52.687527] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-02T21:40:53.073034] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-05. [2025-10-02T21:40:53.798142] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-02T21:40:53.873058] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-03. [2025-10-02T21:40:54.142909] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-02T21:40:54.673079] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-06. [2025-10-02T21:40:55.473007] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-04. [2025-10-02T21:40:55.579050] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-02T21:40:55.834802] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-02T21:40:56.263473] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-02T21:40:56.272976] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-04. [2025-10-02T21:40:57.073085] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-08. [2025-10-02T21:40:57.454182] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-02T21:40:57.884131] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-07. [2025-10-02T21:40:57.892009] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-02T21:40:58.673078] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-05. [2025-10-02T21:40:58.984267] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-02T21:40:59.473084] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-08. [2025-10-02T21:41:00.275966] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-09. [2025-10-02T21:41:00.285800] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-02T21:41:00.705029] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-02T21:41:00.751428] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-02T21:41:01.073034] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-05. [2025-10-02T21:41:01.817990] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-02T21:41:01.873042] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-06. [2025-10-02T21:41:02.446105] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-02T21:41:02.673009] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-09. [2025-10-02T21:41:03.473116] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-06. [2025-10-02T21:41:03.897502] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-02T21:41:04.272996] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-10. [2025-10-02T21:41:04.784913] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-02T21:41:05.073024] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-10. [2025-10-02T21:41:05.174119] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-02T21:41:05.175438] [INFO ] [REMOTE ] SSD: Full fetch complete (32411 records). [2025-10-02T21:41:05.175549] [DEBUG] [VALIDATOR ] SSD: Validating primary data. [2025-10-02T21:41:05.430785] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-02T21:41:05.478677] [INFO ] [REMOTE ] SRL: Full fetch complete (1958 records). [2025-10-02T21:41:05.517056] [DEBUG] [VALIDATOR ] SRL: Validating primary data. [2025-10-02T21:41:05.864292] [DEBUG] [VALIDATOR ] SSD: All expected trading days are present. [2025-10-02T21:41:05.871399] [DEBUG] [VALIDATOR ] SSD: Primary data validation passed. [2025-10-02T21:41:05.872381] [INFO ] [MAIN ] SSD: Fetched primary data is valid. [2025-10-02T21:41:05.872468] [DEBUG] [LOCAL ] SSD: Saving primary data. [2025-10-02T21:41:05.871264] [WARN ] [VALIDATOR ] SRL: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-02T21:41:05.872718] [FATAL] [MAIN ] SRL: Fetched primary data is invalid. Refusing to save it. [2025-10-02T21:41:05.872806] [WARN ] [MAIN ] SRL: Deleting existing primary and derivative data due to validation failure. [2025-10-02T21:41:05.873152] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-10-02T21:41:05.873262] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-07. [2025-10-02T21:41:05.873418] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-10-02T21:41:05.874505] [INFO ] [LOCAL ] SRL: Starting deletion of derivative data. [2025-10-02T21:41:05.874850] [DEBUG] [LOCAL ] SRL: No derivative data file found to delete. [2025-10-02T21:41:05.875134] [INFO ] [MAIN ] Update Progress: 1994/2370 symbols completed. SRL took 33.7s. Estimated remaining: 52m 60s. Rate: 7.1 symbols/min [2025-10-02T21:41:05.875360] [DEBUG] [LOCAL ] SSD: Trimmed 32411 records to 22599 (keeping 200 days of data) [2025-10-02T21:41:06.177563] [INFO ] [MAIN ] SSL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:41:06.243458] [DEBUG] [LOCAL ] SSL: Loaded 41183 existing records from primary storage. [2025-10-02T21:41:06.245837] [INFO ] [MAIN ] SSL: Loaded 41183 existing records. [2025-10-02T21:41:06.381932] [DEBUG] [LOCAL ] SSD: Primary data saved (22599 records). [2025-10-02T21:41:06.392944] [INFO ] [MAIN ] SSD: Full history saved. [2025-10-02T21:41:06.403443] [INFO ] [MAIN ] Update Progress: 1995/2370 symbols completed. SSD took 26.7s. Estimated remaining: 52m 50s. Rate: 7.1 symbols/min [2025-10-02T21:41:06.547577] [WARN ] [MAIN ] SSL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:41:06.566579] [INFO ] [MAIN ] SSL: Wiping existing primary data before full refresh. [2025-10-02T21:41:06.587755] [INFO ] [LOCAL ] SSL: Starting deletion of primary data. [2025-10-02T21:41:06.591026] [DEBUG] [LOCAL ] SSL: Deleted primary data file. [2025-10-02T21:41:06.591099] [INFO ] [MAIN ] SSL: Starting full primary refresh. [2025-10-02T21:41:06.690312] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-07. [2025-10-02T21:41:06.779672] [INFO ] [MAIN ] SST: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:41:06.953898] [DEBUG] [LOCAL ] SST: Loaded 11876 existing records from primary storage. [2025-10-02T21:41:06.985471] [INFO ] [MAIN ] SST: Loaded 11876 existing records. [2025-10-02T21:41:07.242272] [INFO ] [REMOTE ] SSL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:41:07.281493] [WARN ] [MAIN ] SST: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:41:07.281807] [INFO ] [MAIN ] SST: Wiping existing primary data before full refresh. [2025-10-02T21:41:07.281903] [INFO ] [LOCAL ] SST: Starting deletion of primary data. [2025-10-02T21:41:07.282130] [DEBUG] [LOCAL ] SST: Deleted primary data file. [2025-10-02T21:41:07.282189] [INFO ] [MAIN ] SST: Starting full primary refresh. [2025-10-02T21:41:07.492787] [INFO ] [REMOTE ] SSL: Fetching primary data for 2024-12. [2025-10-02T21:41:07.614028] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-02T21:41:07.701279] [INFO ] [REMOTE ] SST: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:41:07.728055] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-02T21:41:08.273002] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-08. [2025-10-02T21:41:08.781255] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-02T21:41:08.843490] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-02T21:41:09.073024] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-01. [2025-10-02T21:41:09.873032] [INFO ] [REMOTE ] SST: Fetching primary data for 2024-12. [2025-10-02T21:41:10.273091] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-02T21:41:10.673011] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-08. [2025-10-02T21:41:10.760891] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-02T21:41:11.473001] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-01. [2025-10-02T21:41:11.876304] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-02T21:41:12.273063] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-09. [2025-10-02T21:41:12.569268] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-02T21:41:13.073051] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-02. [2025-10-02T21:41:13.608040] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-02T21:41:13.872983] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-02. [2025-10-02T21:41:13.929432] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-02T21:41:14.673009] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-09. [2025-10-02T21:41:15.386714] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-02T21:41:15.465442] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-02T21:41:15.473246] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-10. [2025-10-02T21:41:16.273041] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-03. [2025-10-02T21:41:16.663400] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-02T21:41:16.665251] [INFO ] [REMOTE ] SSB: Full fetch complete (61236 records). [2025-10-02T21:41:16.665373] [DEBUG] [VALIDATOR ] SSB: Validating primary data. [2025-10-02T21:41:17.079332] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-03. [2025-10-02T21:41:17.096065] [DEBUG] [VALIDATOR ] SSB: All expected trading days are present. [2025-10-02T21:41:17.096148] [DEBUG] [VALIDATOR ] SSB: Primary data validation passed. [2025-10-02T21:41:17.097392] [INFO ] [MAIN ] SSB: Fetched primary data is valid. [2025-10-02T21:41:17.097558] [DEBUG] [LOCAL ] SSB: Saving primary data. [2025-10-02T21:41:17.099079] [DEBUG] [LOCAL ] SSB: Trimmed 61236 records to 42929 (keeping 200 days of data) [2025-10-02T21:41:17.387802] [DEBUG] [LOCAL ] SSB: Primary data saved (42929 records). [2025-10-02T21:41:17.387943] [INFO ] [MAIN ] SSB: Full history saved. [2025-10-02T21:41:17.388057] [INFO ] [MAIN ] Update Progress: 1996/2370 symbols completed. SSB took 39.3s. Estimated remaining: 52m 42s. Rate: 7.1 symbols/min [2025-10-02T21:41:17.580737] [INFO ] [MAIN ] SSTK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:41:17.609033] [DEBUG] [LOCAL ] SSTK: Loaded 25942 existing records from primary storage. [2025-10-02T21:41:17.609303] [INFO ] [MAIN ] SSTK: Loaded 25942 existing records. [2025-10-02T21:41:17.801494] [WARN ] [MAIN ] SSTK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:41:17.801755] [INFO ] [MAIN ] SSTK: Wiping existing primary data before full refresh. [2025-10-02T21:41:17.801811] [INFO ] [LOCAL ] SSTK: Starting deletion of primary data. [2025-10-02T21:41:17.802209] [DEBUG] [LOCAL ] SSTK: Deleted primary data file. [2025-10-02T21:41:17.802274] [INFO ] [MAIN ] SSTK: Starting full primary refresh. [2025-10-02T21:41:17.877842] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-10. [2025-10-02T21:41:18.132316] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-02T21:41:18.174420] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-02T21:41:18.265825] [INFO ] [REMOTE ] SSTK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:41:18.326581] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-02T21:41:18.327468] [INFO ] [REMOTE ] SRV: Full fetch complete (11541 records). [2025-10-02T21:41:18.327552] [DEBUG] [VALIDATOR ] SRV: Validating primary data. [2025-10-02T21:41:18.681589] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-04. [2025-10-02T21:41:18.729416] [DEBUG] [VALIDATOR ] SRV: All expected trading days are present. [2025-10-02T21:41:18.729515] [DEBUG] [VALIDATOR ] SRV: Primary data validation passed. [2025-10-02T21:41:18.729850] [INFO ] [MAIN ] SRV: Fetched primary data is valid. [2025-10-02T21:41:18.729913] [DEBUG] [LOCAL ] SRV: Saving primary data. [2025-10-02T21:41:18.730494] [DEBUG] [LOCAL ] SRV: Trimmed 11541 records to 7423 (keeping 200 days of data) [2025-10-02T21:41:18.782375] [DEBUG] [LOCAL ] SRV: Primary data saved (7423 records). [2025-10-02T21:41:18.782512] [INFO ] [MAIN ] SRV: Full history saved. [2025-10-02T21:41:18.782599] [INFO ] [MAIN ] Update Progress: 1997/2370 symbols completed. SRV took 42.1s. Estimated remaining: 52m 32s. Rate: 7.1 symbols/min [2025-10-02T21:41:19.472990] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-04. [2025-10-02T21:41:19.578320] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-02T21:41:20.273032] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-05. [2025-10-02T21:41:20.756060] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-02T21:41:21.072995] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-05. [2025-10-02T21:41:21.105953] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-02T21:41:21.873015] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-06. [2025-10-02T21:41:22.572663] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-02T21:41:22.653158] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-02T21:41:22.672976] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-07. [2025-10-02T21:41:23.472992] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2024-12. [2025-10-02T21:41:23.594048] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-02T21:41:24.273042] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-08. [2025-10-02T21:41:25.034950] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-02T21:41:25.058501] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-02T21:41:25.072949] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-09. [2025-10-02T21:41:25.867566] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-02T21:41:25.872942] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-10. [2025-10-02T21:41:26.401882] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-02T21:41:26.402837] [INFO ] [REMOTE ] SST: Full fetch complete (18866 records). [2025-10-02T21:41:26.402912] [DEBUG] [VALIDATOR ] SST: Validating primary data. [2025-10-02T21:41:26.685451] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-06. [2025-10-02T21:41:26.815545] [DEBUG] [VALIDATOR ] SST: All expected trading days are present. [2025-10-02T21:41:26.815638] [DEBUG] [VALIDATOR ] SST: Primary data validation passed. [2025-10-02T21:41:26.816209] [INFO ] [MAIN ] SST: Fetched primary data is valid. [2025-10-02T21:41:26.816257] [DEBUG] [LOCAL ] SST: Saving primary data. [2025-10-02T21:41:26.817047] [DEBUG] [LOCAL ] SST: Trimmed 18866 records to 11918 (keeping 200 days of data) [2025-10-02T21:41:26.889281] [DEBUG] [LOCAL ] SST: Primary data saved (11918 records). [2025-10-02T21:41:26.889431] [INFO ] [MAIN ] SST: Full history saved. [2025-10-02T21:41:26.889516] [INFO ] [MAIN ] Update Progress: 1998/2370 symbols completed. SST took 20.5s. Estimated remaining: 52m 23s. Rate: 7.1 symbols/min [2025-10-02T21:41:27.473011] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-01. [2025-10-02T21:41:28.282308] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-02T21:41:28.291100] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-07. [2025-10-02T21:41:29.017372] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-02T21:41:29.073011] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-02. [2025-10-02T21:41:29.943970] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-02T21:41:29.955815] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-08. [2025-10-02T21:41:30.020953] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-02T21:41:30.673050] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-03. [2025-10-02T21:41:31.571845] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-02T21:41:31.582939] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-09. [2025-10-02T21:41:31.952762] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-02T21:41:32.273046] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-04. [2025-10-02T21:41:33.085965] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-02T21:41:33.095843] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-10. [2025-10-02T21:41:33.641309] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-02T21:41:33.873056] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-05. [2025-10-02T21:41:34.262904] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-02T21:41:34.264867] [INFO ] [REMOTE ] SSL: Full fetch complete (60060 records). [2025-10-02T21:41:34.264978] [DEBUG] [VALIDATOR ] SSL: Validating primary data. [2025-10-02T21:41:34.705357] [DEBUG] [VALIDATOR ] SSL: All expected trading days are present. [2025-10-02T21:41:34.705473] [DEBUG] [VALIDATOR ] SSL: Primary data validation passed. [2025-10-02T21:41:34.706605] [INFO ] [MAIN ] SSL: Fetched primary data is valid. [2025-10-02T21:41:34.706695] [DEBUG] [LOCAL ] SSL: Saving primary data. [2025-10-02T21:41:34.708014] [DEBUG] [LOCAL ] SSL: Trimmed 60060 records to 41452 (keeping 200 days of data) [2025-10-02T21:41:34.950125] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-02T21:41:34.962298] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-06. [2025-10-02T21:41:34.994789] [DEBUG] [LOCAL ] SSL: Primary data saved (41452 records). [2025-10-02T21:41:34.994931] [INFO ] [MAIN ] SSL: Full history saved. [2025-10-02T21:41:34.996150] [INFO ] [MAIN ] Update Progress: 1999/2370 symbols completed. SSL took 29.1s. Estimated remaining: 52m 15s. Rate: 7.1 symbols/min [2025-10-02T21:41:36.011589] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-02T21:41:36.017385] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-07. [2025-10-02T21:41:37.279887] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-02T21:41:37.286567] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-08. [2025-10-02T21:41:38.200610] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-02T21:41:38.206822] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-09. [2025-10-02T21:41:39.312844] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-02T21:41:39.318460] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-10. [2025-10-02T21:41:40.125804] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-02T21:41:40.127189] [INFO ] [REMOTE ] SSTK: Full fetch complete (41893 records). [2025-10-02T21:41:40.127287] [DEBUG] [VALIDATOR ] SSTK: Validating primary data. [2025-10-02T21:41:40.533102] [DEBUG] [VALIDATOR ] SSTK: All expected trading days are present. [2025-10-02T21:41:40.533194] [DEBUG] [VALIDATOR ] SSTK: Primary data validation passed. [2025-10-02T21:41:40.534165] [INFO ] [MAIN ] SSTK: Fetched primary data is valid. [2025-10-02T21:41:40.534235] [DEBUG] [LOCAL ] SSTK: Saving primary data. [2025-10-02T21:41:40.535344] [DEBUG] [LOCAL ] SSTK: Trimmed 41893 records to 26120 (keeping 200 days of data) [2025-10-02T21:41:40.705892] [DEBUG] [LOCAL ] SSTK: Primary data saved (26120 records). [2025-10-02T21:41:40.706034] [INFO ] [MAIN ] SSTK: Full history saved. [2025-10-02T21:41:40.706171] [INFO ] [MAIN ] Update Progress: 2000/2370 symbols completed. SSTK took 23.3s. Estimated remaining: 52m 6s. Rate: 7.1 symbols/min [2025-10-02T21:41:41.366252] [INFO ] [MAIN ] ST: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:41:41.437498] [INFO ] [MAIN ] STE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:41:41.425782] [INFO ] [MAIN ] STC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:41:41.487671] [INFO ] [MAIN ] STAG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:41:41.513637] [DEBUG] [LOCAL ] STC: Loaded 17459 existing records from primary storage. [2025-10-02T21:41:41.514104] [INFO ] [MAIN ] STC: Loaded 17459 existing records. [2025-10-02T21:41:41.683332] [DEBUG] [LOCAL ] STE: Loaded 35328 existing records from primary storage. [2025-10-02T21:41:41.718902] [INFO ] [MAIN ] STE: Loaded 35328 existing records. [2025-10-02T21:41:41.810318] [DEBUG] [LOCAL ] STAG: Loaded 50065 existing records from primary storage. [2025-10-02T21:41:41.880090] [INFO ] [MAIN ] STAG: Loaded 50065 existing records. [2025-10-02T21:41:41.820574] [DEBUG] [LOCAL ] ST: Loaded 49737 existing records from primary storage. [2025-10-02T21:41:41.874563] [WARN ] [MAIN ] STC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:41:41.890769] [INFO ] [MAIN ] ST: Loaded 49737 existing records. [2025-10-02T21:41:41.950241] [INFO ] [MAIN ] STC: Wiping existing primary data before full refresh. [2025-10-02T21:41:41.995408] [INFO ] [LOCAL ] STC: Starting deletion of primary data. [2025-10-02T21:41:42.184463] [DEBUG] [LOCAL ] STC: Deleted primary data file. [2025-10-02T21:41:42.232253] [WARN ] [MAIN ] STE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:41:42.279742] [INFO ] [MAIN ] STE: Wiping existing primary data before full refresh. [2025-10-02T21:41:42.274372] [INFO ] [MAIN ] STC: Starting full primary refresh. [2025-10-02T21:41:42.279911] [INFO ] [LOCAL ] STE: Starting deletion of primary data. [2025-10-02T21:41:42.312586] [DEBUG] [LOCAL ] STE: Deleted primary data file. [2025-10-02T21:41:42.385248] [INFO ] [MAIN ] STE: Starting full primary refresh. [2025-10-02T21:41:42.417205] [WARN ] [MAIN ] ST: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:41:42.528526] [INFO ] [MAIN ] ST: Wiping existing primary data before full refresh. [2025-10-02T21:41:42.548674] [INFO ] [LOCAL ] ST: Starting deletion of primary data. [2025-10-02T21:41:42.607921] [WARN ] [MAIN ] STAG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:41:42.616812] [DEBUG] [LOCAL ] ST: Deleted primary data file. [2025-10-02T21:41:42.650450] [INFO ] [MAIN ] ST: Starting full primary refresh. [2025-10-02T21:41:42.639933] [INFO ] [MAIN ] STAG: Wiping existing primary data before full refresh. [2025-10-02T21:41:42.717183] [INFO ] [LOCAL ] STAG: Starting deletion of primary data. [2025-10-02T21:41:42.777093] [DEBUG] [LOCAL ] STAG: Deleted primary data file. [2025-10-02T21:41:42.793258] [INFO ] [MAIN ] STAG: Starting full primary refresh. [2025-10-02T21:41:43.766376] [INFO ] [REMOTE ] STE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:41:43.775903] [INFO ] [REMOTE ] STC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:41:43.818063] [INFO ] [REMOTE ] STE: Fetching primary data for 2024-12. [2025-10-02T21:41:43.863066] [INFO ] [REMOTE ] STC: Fetching primary data for 2024-12. [2025-10-02T21:41:43.995972] [INFO ] [REMOTE ] ST: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:41:44.007171] [INFO ] [REMOTE ] ST: Fetching primary data for 2024-12. [2025-10-02T21:41:44.106833] [INFO ] [REMOTE ] STAG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:41:44.107164] [INFO ] [REMOTE ] STAG: Fetching primary data for 2024-12. [2025-10-02T21:41:45.032240] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-02T21:41:45.036874] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-01. [2025-10-02T21:41:45.563054] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-02T21:41:45.576078] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-01. [2025-10-02T21:41:45.616967] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-02T21:41:45.628020] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-01. [2025-10-02T21:41:45.651845] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-02T21:41:45.659929] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-01. [2025-10-02T21:41:45.703736] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-02T21:41:45.708850] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-02. [2025-10-02T21:41:46.775945] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-02T21:41:46.780522] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-03. [2025-10-02T21:41:46.933584] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-02T21:41:46.942343] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-02. [2025-10-02T21:41:47.230898] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-02T21:41:47.290920] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-02T21:41:47.473049] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-02. [2025-10-02T21:41:47.873545] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-02T21:41:47.970770] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-02T21:41:48.273009] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-03. [2025-10-02T21:41:48.820933] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-02T21:41:49.073024] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-03. [2025-10-02T21:41:49.824358] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-02T21:41:49.873025] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-02. [2025-10-02T21:41:50.673212] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-04. [2025-10-02T21:41:50.857063] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-02T21:41:51.468679] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-02T21:41:51.478150] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-04. [2025-10-02T21:41:51.731399] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-02T21:41:52.273018] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-04. [2025-10-02T21:41:53.073066] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-03. [2025-10-02T21:41:53.359748] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-02T21:41:53.849502] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-02T21:41:53.873014] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-05. [2025-10-02T21:41:54.497625] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-02T21:41:54.672997] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-05. [2025-10-02T21:41:54.990637] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-02T21:41:55.472994] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-05. [2025-10-02T21:41:56.213737] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-02T21:41:56.272962] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-06. [2025-10-02T21:41:57.073026] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-04. [2025-10-02T21:41:57.406151] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-02T21:41:57.738830] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-02T21:41:57.873022] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-07. [2025-10-02T21:41:58.673007] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-06. [2025-10-02T21:41:58.873280] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-02T21:41:59.426611] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-02T21:41:59.473025] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-08. [2025-10-02T21:41:59.669872] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-02T21:42:00.273022] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-05. [2025-10-02T21:42:01.072970] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-06. [2025-10-02T21:42:01.103450] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-02T21:42:01.873057] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-09. [2025-10-02T21:42:02.146708] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-02T21:42:02.673014] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-07. [2025-10-02T21:42:02.824826] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-02T21:42:03.222765] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-02T21:42:03.473039] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-06. [2025-10-02T21:42:03.808921] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-02T21:42:04.273026] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-08. [2025-10-02T21:42:05.031763] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-02T21:42:05.080413] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-10. [2025-10-02T21:42:05.099701] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-02T21:42:05.872986] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-07. [2025-10-02T21:42:06.203915] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-02T21:42:06.205827] [INFO ] [REMOTE ] STE: Full fetch complete (50569 records). [2025-10-02T21:42:06.206007] [DEBUG] [VALIDATOR ] STE: Validating primary data. [2025-10-02T21:42:06.625288] [DEBUG] [VALIDATOR ] STE: All expected trading days are present. [2025-10-02T21:42:06.625400] [DEBUG] [VALIDATOR ] STE: Primary data validation passed. [2025-10-02T21:42:06.626402] [INFO ] [MAIN ] STE: Fetched primary data is valid. [2025-10-02T21:42:06.626469] [DEBUG] [LOCAL ] STE: Saving primary data. [2025-10-02T21:42:06.627761] [DEBUG] [LOCAL ] STE: Trimmed 50569 records to 35569 (keeping 200 days of data) [2025-10-02T21:42:06.691957] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-09. [2025-10-02T21:42:06.872818] [DEBUG] [LOCAL ] STE: Primary data saved (35569 records). [2025-10-02T21:42:06.872974] [INFO ] [MAIN ] STE: Full history saved. [2025-10-02T21:42:06.873062] [INFO ] [MAIN ] Update Progress: 2001/2370 symbols completed. STE took 26.1s. Estimated remaining: 52m 1s. Rate: 7.1 symbols/min [2025-10-02T21:42:07.062951] [INFO ] [MAIN ] STEL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:42:07.087913] [DEBUG] [LOCAL ] STEL: Loaded 23143 existing records from primary storage. [2025-10-02T21:42:07.088210] [INFO ] [MAIN ] STEL: Loaded 23143 existing records. [2025-10-02T21:42:07.281911] [WARN ] [MAIN ] STEL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:42:07.282124] [INFO ] [MAIN ] STEL: Wiping existing primary data before full refresh. [2025-10-02T21:42:07.282176] [INFO ] [LOCAL ] STEL: Starting deletion of primary data. [2025-10-02T21:42:07.282577] [DEBUG] [LOCAL ] STEL: Deleted primary data file. [2025-10-02T21:42:07.282661] [INFO ] [MAIN ] STEL: Starting full primary refresh. [2025-10-02T21:42:07.474929] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-07. [2025-10-02T21:42:07.674450] [INFO ] [REMOTE ] STEL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:42:07.699384] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-02T21:42:07.778305] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-02T21:42:08.273046] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-10. [2025-10-02T21:42:08.954104] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-02T21:42:08.955166] [INFO ] [REMOTE ] STC: Full fetch complete (25848 records). [2025-10-02T21:42:08.955281] [DEBUG] [VALIDATOR ] STC: Validating primary data. [2025-10-02T21:42:09.078194] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-08. [2025-10-02T21:42:09.382210] [DEBUG] [VALIDATOR ] STC: All expected trading days are present. [2025-10-02T21:42:09.382334] [DEBUG] [VALIDATOR ] STC: Primary data validation passed. [2025-10-02T21:42:09.383037] [INFO ] [MAIN ] STC: Fetched primary data is valid. [2025-10-02T21:42:09.383167] [DEBUG] [LOCAL ] STC: Saving primary data. [2025-10-02T21:42:09.384327] [DEBUG] [LOCAL ] STC: Trimmed 25848 records to 17550 (keeping 200 days of data) [2025-10-02T21:42:09.507108] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-02T21:42:09.550454] [DEBUG] [LOCAL ] STC: Primary data saved (17550 records). [2025-10-02T21:42:09.550634] [INFO ] [MAIN ] STC: Full history saved. [2025-10-02T21:42:09.550769] [INFO ] [MAIN ] Update Progress: 2002/2370 symbols completed. STC took 28.8s. Estimated remaining: 51m 51s. Rate: 7.1 symbols/min [2025-10-02T21:42:09.737451] [INFO ] [MAIN ] STEM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:42:09.779337] [DEBUG] [LOCAL ] STEM: Loaded 39350 existing records from primary storage. [2025-10-02T21:42:09.779694] [INFO ] [MAIN ] STEM: Loaded 39350 existing records. [2025-10-02T21:42:09.878101] [INFO ] [REMOTE ] STEL: Fetching primary data for 2024-12. [2025-10-02T21:42:09.971381] [WARN ] [MAIN ] STEM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:42:09.971581] [INFO ] [MAIN ] STEM: Wiping existing primary data before full refresh. [2025-10-02T21:42:09.971629] [INFO ] [LOCAL ] STEM: Starting deletion of primary data. [2025-10-02T21:42:09.971870] [DEBUG] [LOCAL ] STEM: Deleted primary data file. [2025-10-02T21:42:09.971929] [INFO ] [MAIN ] STEM: Starting full primary refresh. [2025-10-02T21:42:10.381790] [INFO ] [REMOTE ] STEM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:42:10.541466] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-02T21:42:10.673011] [INFO ] [REMOTE ] STEM: Fetching primary data for 2024-12. [2025-10-02T21:42:10.736186] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-02T21:42:11.473047] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-01. [2025-10-02T21:42:12.272992] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-09. [2025-10-02T21:42:12.524068] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-02T21:42:12.705283] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-02T21:42:13.072982] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-02. [2025-10-02T21:42:13.873010] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-01. [2025-10-02T21:42:14.119862] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-02T21:42:14.148099] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-02T21:42:14.673018] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-10. [2025-10-02T21:42:15.473021] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-03. [2025-10-02T21:42:16.083586] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-02T21:42:16.085593] [INFO ] [REMOTE ] STAG: Full fetch complete (72080 records). [2025-10-02T21:42:16.085720] [DEBUG] [VALIDATOR ] STAG: Validating primary data. [2025-10-02T21:42:16.281439] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-08. [2025-10-02T21:42:16.530491] [DEBUG] [VALIDATOR ] STAG: All expected trading days are present. [2025-10-02T21:42:16.542699] [DEBUG] [VALIDATOR ] STAG: Primary data validation passed. [2025-10-02T21:42:16.544063] [INFO ] [MAIN ] STAG: Fetched primary data is valid. [2025-10-02T21:42:16.568016] [DEBUG] [LOCAL ] STAG: Saving primary data. [2025-10-02T21:42:16.595609] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-01 (2.72 seconds). [2025-10-02T21:42:16.597291] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-02T21:42:16.616709] [DEBUG] [LOCAL ] STAG: Trimmed 72080 records to 50438 (keeping 200 days of data) [2025-10-02T21:42:16.955165] [DEBUG] [LOCAL ] STAG: Primary data saved (50438 records). [2025-10-02T21:42:16.955313] [INFO ] [MAIN ] STAG: Full history saved. [2025-10-02T21:42:16.955448] [INFO ] [MAIN ] Update Progress: 2003/2370 symbols completed. STAG took 36.2s. Estimated remaining: 51m 43s. Rate: 7.1 symbols/min [2025-10-02T21:42:17.078170] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-04. [2025-10-02T21:42:17.174791] [INFO ] [MAIN ] STEW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:42:17.192692] [DEBUG] [LOCAL ] STEW: Loaded 16128 existing records from primary storage. [2025-10-02T21:42:17.192977] [INFO ] [MAIN ] STEW: Loaded 16128 existing records. [2025-10-02T21:42:17.378663] [WARN ] [MAIN ] STEW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:42:17.378873] [INFO ] [MAIN ] STEW: Wiping existing primary data before full refresh. [2025-10-02T21:42:17.378922] [INFO ] [LOCAL ] STEW: Starting deletion of primary data. [2025-10-02T21:42:17.379157] [DEBUG] [LOCAL ] STEW: Deleted primary data file. [2025-10-02T21:42:17.379216] [INFO ] [MAIN ] STEW: Starting full primary refresh. [2025-10-02T21:42:17.774029] [INFO ] [REMOTE ] STEW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:42:17.873049] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-02. [2025-10-02T21:42:18.096463] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-02T21:42:18.386624] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-02T21:42:18.673043] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-05. [2025-10-02T21:42:19.472999] [INFO ] [REMOTE ] STEW: Fetching primary data for 2024-12. [2025-10-02T21:42:19.539380] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-02T21:42:19.768092] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-02T21:42:20.273010] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-06. [2025-10-02T21:42:20.404003] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-02T21:42:21.072980] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-03. [2025-10-02T21:42:21.324761] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-02T21:42:21.873073] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-09. [2025-10-02T21:42:22.588871] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-02T21:42:22.673060] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-01. [2025-10-02T21:42:23.473024] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-04. [2025-10-02T21:42:23.550480] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-02T21:42:23.653952] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-02T21:42:24.273022] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-02. [2025-10-02T21:42:25.043986] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-02T21:42:25.072988] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-03. [2025-10-02T21:42:25.256888] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-02T21:42:25.872983] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-05. [2025-10-02T21:42:26.079375] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-02T21:42:26.673038] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-10. [2025-10-02T21:42:27.430719] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-02T21:42:27.473002] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-06. [2025-10-02T21:42:27.916612] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-02T21:42:27.919514] [INFO ] [REMOTE ] ST: Full fetch complete (71939 records). [2025-10-02T21:42:27.919816] [DEBUG] [VALIDATOR ] ST: Validating primary data. [2025-10-02T21:42:28.278576] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-04. [2025-10-02T21:42:28.387635] [DEBUG] [VALIDATOR ] ST: All expected trading days are present. [2025-10-02T21:42:28.387768] [DEBUG] [VALIDATOR ] ST: Primary data validation passed. [2025-10-02T21:42:28.389136] [INFO ] [MAIN ] ST: Fetched primary data is valid. [2025-10-02T21:42:28.389208] [DEBUG] [LOCAL ] ST: Saving primary data. [2025-10-02T21:42:28.390785] [DEBUG] [LOCAL ] ST: Trimmed 71939 records to 50112 (keeping 200 days of data) [2025-10-02T21:42:28.715505] [DEBUG] [LOCAL ] ST: Primary data saved (50112 records). [2025-10-02T21:42:28.715676] [INFO ] [MAIN ] ST: Full history saved. [2025-10-02T21:42:28.715832] [INFO ] [MAIN ] Update Progress: 2004/2370 symbols completed. ST took 48.0s. Estimated remaining: 51m 35s. Rate: 7.1 symbols/min [2025-10-02T21:42:28.902662] [INFO ] [MAIN ] STG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:42:28.902899] [DEBUG] [LOCAL ] STG: No existing data file found in primary storage. [2025-10-02T21:42:28.902956] [WARN ] [MAIN ] STG: No existing data found, performing full refresh instead. [2025-10-02T21:42:28.903076] [INFO ] [MAIN ] STG: Wiping existing primary data before full refresh. [2025-10-02T21:42:28.903118] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-10-02T21:42:28.903162] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-10-02T21:42:28.903197] [INFO ] [MAIN ] STG: Starting full primary refresh. [2025-10-02T21:42:29.084289] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-07. [2025-10-02T21:42:29.319481] [INFO ] [REMOTE ] STG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:42:29.348743] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-02T21:42:29.396286] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-02T21:42:29.873029] [INFO ] [REMOTE ] STG: Fetching primary data for 2024-12. [2025-10-02T21:42:30.143230] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2024-12 (0.27 seconds). [2025-10-02T21:42:30.407478] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-02T21:42:30.673023] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-07. [2025-10-02T21:42:31.473001] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-01. [2025-10-02T21:42:32.219430] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-02T21:42:32.273017] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-08. [2025-10-02T21:42:32.324290] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-02T21:42:33.053229] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-02T21:42:33.072978] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-08. [2025-10-02T21:42:33.873031] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-05. [2025-10-02T21:42:34.522413] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-02T21:42:34.673003] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-09. [2025-10-02T21:42:34.946211] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-02T21:42:35.473052] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-09. [2025-10-02T21:42:35.732816] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-02T21:42:36.273008] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-02. [2025-10-02T21:42:36.405526] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-02T21:42:36.618046] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-02T21:42:37.072986] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-03. [2025-10-02T21:42:37.423553] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-02T21:42:37.873007] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-04. [2025-10-02T21:42:38.436941] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-02T21:42:38.673001] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-05. [2025-10-02T21:42:39.025629] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-02T21:42:39.473039] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-06. [2025-10-02T21:42:40.273000] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-10. [2025-10-02T21:42:40.378132] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-02T21:42:40.879767] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-02T21:42:40.881286] [INFO ] [REMOTE ] STEL: Full fetch complete (32106 records). [2025-10-02T21:42:40.881368] [DEBUG] [VALIDATOR ] STEL: Validating primary data. [2025-10-02T21:42:41.079716] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-06. [2025-10-02T21:42:41.284966] [DEBUG] [VALIDATOR ] STEL: All expected trading days are present. [2025-10-02T21:42:41.285047] [DEBUG] [VALIDATOR ] STEL: Primary data validation passed. [2025-10-02T21:42:41.285812] [INFO ] [MAIN ] STEL: Fetched primary data is valid. [2025-10-02T21:42:41.285877] [DEBUG] [LOCAL ] STEL: Saving primary data. [2025-10-02T21:42:41.286692] [DEBUG] [LOCAL ] STEL: Trimmed 32106 records to 23316 (keeping 200 days of data) [2025-10-02T21:42:41.439553] [DEBUG] [LOCAL ] STEL: Primary data saved (23316 records). [2025-10-02T21:42:41.439721] [INFO ] [MAIN ] STEL: Full history saved. [2025-10-02T21:42:41.439825] [INFO ] [MAIN ] Update Progress: 2005/2370 symbols completed. STEL took 34.6s. Estimated remaining: 51m 27s. Rate: 7.1 symbols/min [2025-10-02T21:42:41.554347] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-02T21:42:41.628349] [INFO ] [MAIN ] STK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:42:41.640407] [DEBUG] [LOCAL ] STK: Loaded 9423 existing records from primary storage. [2025-10-02T21:42:41.640634] [INFO ] [MAIN ] STK: Loaded 9423 existing records. [2025-10-02T21:42:41.855842] [WARN ] [MAIN ] STK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:42:41.856128] [INFO ] [MAIN ] STK: Wiping existing primary data before full refresh. [2025-10-02T21:42:41.856192] [INFO ] [LOCAL ] STK: Starting deletion of primary data. [2025-10-02T21:42:41.856462] [DEBUG] [LOCAL ] STK: Deleted primary data file. [2025-10-02T21:42:41.856533] [INFO ] [MAIN ] STK: Starting full primary refresh. [2025-10-02T21:42:41.878178] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-07. [2025-10-02T21:42:42.295914] [INFO ] [REMOTE ] STK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:42:42.673012] [INFO ] [REMOTE ] STK: Fetching primary data for 2024-12. [2025-10-02T21:42:42.945563] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-02T21:42:43.247744] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-02T21:42:43.473026] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-08. [2025-10-02T21:42:44.272984] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-07. [2025-10-02T21:42:44.317288] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-02T21:42:45.022294] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-02T21:42:45.072990] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-10. [2025-10-02T21:42:45.873050] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-01. [2025-10-02T21:42:46.168045] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-02T21:42:46.170621] [INFO ] [REMOTE ] STEM: Full fetch complete (62127 records). [2025-10-02T21:42:46.170798] [DEBUG] [VALIDATOR ] STEM: Validating primary data. [2025-10-02T21:42:46.580810] [DEBUG] [VALIDATOR ] STEM: All expected trading days are present. [2025-10-02T21:42:46.580992] [DEBUG] [VALIDATOR ] STEM: Primary data validation passed. [2025-10-02T21:42:46.582083] [INFO ] [MAIN ] STEM: Fetched primary data is valid. [2025-10-02T21:42:46.582267] [DEBUG] [LOCAL ] STEM: Saving primary data. [2025-10-02T21:42:46.584151] [DEBUG] [LOCAL ] STEM: Trimmed 62127 records to 39628 (keeping 200 days of data) [2025-10-02T21:42:46.679468] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-09. [2025-10-02T21:42:46.692314] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-02T21:42:46.848610] [DEBUG] [LOCAL ] STEM: Primary data saved (39628 records). [2025-10-02T21:42:46.848801] [INFO ] [MAIN ] STEM: Full history saved. [2025-10-02T21:42:46.850024] [INFO ] [MAIN ] Update Progress: 2006/2370 symbols completed. STEM took 37.3s. Estimated remaining: 51m 18s. Rate: 7.1 symbols/min [2025-10-02T21:42:47.029069] [INFO ] [MAIN ] STLA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:42:47.088227] [DEBUG] [LOCAL ] STLA: Loaded 53543 existing records from primary storage. [2025-10-02T21:42:47.088565] [INFO ] [MAIN ] STLA: Loaded 53543 existing records. [2025-10-02T21:42:47.280607] [WARN ] [MAIN ] STLA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:42:47.281100] [INFO ] [MAIN ] STLA: Wiping existing primary data before full refresh. [2025-10-02T21:42:47.281245] [INFO ] [LOCAL ] STLA: Starting deletion of primary data. [2025-10-02T21:42:47.281497] [DEBUG] [LOCAL ] STLA: Deleted primary data file. [2025-10-02T21:42:47.281569] [INFO ] [MAIN ] STLA: Starting full primary refresh. [2025-10-02T21:42:47.419880] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-02T21:42:47.487946] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-10. [2025-10-02T21:42:47.687026] [INFO ] [REMOTE ] STLA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:42:48.204668] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-02T21:42:48.205880] [INFO ] [REMOTE ] STEW: Full fetch complete (21864 records). [2025-10-02T21:42:48.205960] [DEBUG] [VALIDATOR ] STEW: Validating primary data. [2025-10-02T21:42:48.283338] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-08. [2025-10-02T21:42:48.629830] [DEBUG] [VALIDATOR ] STEW: All expected trading days are present. [2025-10-02T21:42:48.629909] [DEBUG] [VALIDATOR ] STEW: Primary data validation passed. [2025-10-02T21:42:48.630424] [INFO ] [MAIN ] STEW: Fetched primary data is valid. [2025-10-02T21:42:48.630468] [DEBUG] [LOCAL ] STEW: Saving primary data. [2025-10-02T21:42:48.631105] [DEBUG] [LOCAL ] STEW: Trimmed 21864 records to 16227 (keeping 200 days of data) [2025-10-02T21:42:48.744673] [DEBUG] [LOCAL ] STEW: Primary data saved (16227 records). [2025-10-02T21:42:48.744835] [INFO ] [MAIN ] STEW: Full history saved. [2025-10-02T21:42:48.744933] [INFO ] [MAIN ] Update Progress: 2007/2370 symbols completed. STEW took 31.8s. Estimated remaining: 51m 8s. Rate: 7.1 symbols/min [2025-10-02T21:42:48.860471] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-02T21:42:48.938548] [INFO ] [MAIN ] STM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:42:48.999524] [DEBUG] [LOCAL ] STM: Loaded 53580 existing records from primary storage. [2025-10-02T21:42:48.999947] [INFO ] [MAIN ] STM: Loaded 53580 existing records. [2025-10-02T21:42:49.078307] [INFO ] [REMOTE ] STLA: Fetching primary data for 2024-12. [2025-10-02T21:42:49.204260] [WARN ] [MAIN ] STM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:42:49.204494] [INFO ] [MAIN ] STM: Wiping existing primary data before full refresh. [2025-10-02T21:42:49.204547] [INFO ] [LOCAL ] STM: Starting deletion of primary data. [2025-10-02T21:42:49.204841] [DEBUG] [LOCAL ] STM: Deleted primary data file. [2025-10-02T21:42:49.204915] [INFO ] [MAIN ] STM: Starting full primary refresh. [2025-10-02T21:42:49.617728] [INFO ] [REMOTE ] STM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:42:49.873068] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-02. [2025-10-02T21:42:50.382939] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-02T21:42:50.673019] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-03. [2025-10-02T21:42:51.474601] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-09. [2025-10-02T21:42:51.482695] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2024-12 (2.40 seconds). [2025-10-02T21:42:51.534913] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-02T21:42:51.936583] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-02T21:42:52.273003] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-10. [2025-10-02T21:42:52.560982] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-10-02T21:42:52.561761] [INFO ] [REMOTE ] STG: Full fetch complete (2480 records). [2025-10-02T21:42:52.561837] [DEBUG] [VALIDATOR ] STG: Validating primary data. [2025-10-02T21:42:52.775545] [WARN ] [VALIDATOR ] STG: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-10-02T21:42:52.775808] [FATAL] [MAIN ] STG: Fetched primary data is invalid. Refusing to save it. [2025-10-02T21:42:52.775880] [WARN ] [MAIN ] STG: Deleting existing primary and derivative data due to validation failure. [2025-10-02T21:42:52.775957] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-10-02T21:42:52.776052] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-10-02T21:42:52.776111] [INFO ] [LOCAL ] STG: Starting deletion of derivative data. [2025-10-02T21:42:52.776171] [DEBUG] [LOCAL ] STG: No derivative data file found to delete. [2025-10-02T21:42:52.776250] [INFO ] [MAIN ] Update Progress: 2008/2370 symbols completed. STG took 24.1s. Estimated remaining: 50m 59s. Rate: 7.1 symbols/min [2025-10-02T21:42:52.977841] [INFO ] [MAIN ] STN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:42:53.003169] [DEBUG] [LOCAL ] STN: Loaded 22870 existing records from primary storage. [2025-10-02T21:42:53.003505] [INFO ] [MAIN ] STN: Loaded 22870 existing records. [2025-10-02T21:42:53.081937] [INFO ] [REMOTE ] STM: Fetching primary data for 2024-12. [2025-10-02T21:42:53.212764] [WARN ] [MAIN ] STN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:42:53.212988] [INFO ] [MAIN ] STN: Wiping existing primary data before full refresh. [2025-10-02T21:42:53.213048] [INFO ] [LOCAL ] STN: Starting deletion of primary data. [2025-10-02T21:42:53.213288] [DEBUG] [LOCAL ] STN: Deleted primary data file. [2025-10-02T21:42:53.213345] [INFO ] [MAIN ] STN: Starting full primary refresh. [2025-10-02T21:42:53.602605] [INFO ] [REMOTE ] STN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:42:53.873040] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-01. [2025-10-02T21:42:54.673050] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-04. [2025-10-02T21:42:55.116543] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-02T21:42:55.473046] [INFO ] [REMOTE ] STN: Fetching primary data for 2024-12. [2025-10-02T21:42:55.488840] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-02T21:42:55.741360] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-02T21:42:56.217988] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-02T21:42:56.273008] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-05. [2025-10-02T21:42:56.946525] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-02T21:42:57.072987] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-02. [2025-10-02T21:42:57.873025] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-01. [2025-10-02T21:42:58.673009] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-01. [2025-10-02T21:42:58.954978] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-02T21:42:59.473012] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-06. [2025-10-02T21:42:59.781191] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-02T21:42:59.936892] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-02T21:43:00.046399] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-10-02T21:43:00.273018] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-07. [2025-10-02T21:43:01.048245] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-02T21:43:01.072986] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-08. [2025-10-02T21:43:01.860781] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-02T21:43:01.872985] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-09. [2025-10-02T21:43:02.673024] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-02. [2025-10-02T21:43:02.722548] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-02T21:43:03.473055] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-02. [2025-10-02T21:43:04.273041] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-03. [2025-10-02T21:43:04.633577] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-02T21:43:04.674223] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-02T21:43:05.073038] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-03. [2025-10-02T21:43:05.873063] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-10. [2025-10-02T21:43:06.184988] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-02T21:43:06.605788] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-02T21:43:06.617935] [INFO ] [REMOTE ] STK: Full fetch complete (14108 records). [2025-10-02T21:43:06.629029] [DEBUG] [VALIDATOR ] STK: Validating primary data. [2025-10-02T21:43:06.678158] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-03. [2025-10-02T21:43:06.669535] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-10-02T21:43:07.081015] [DEBUG] [VALIDATOR ] STK: All expected trading days are present. [2025-10-02T21:43:07.081098] [DEBUG] [VALIDATOR ] STK: Primary data validation passed. [2025-10-02T21:43:07.081460] [INFO ] [MAIN ] STK: Fetched primary data is valid. [2025-10-02T21:43:07.081504] [DEBUG] [LOCAL ] STK: Saving primary data. [2025-10-02T21:43:07.082090] [DEBUG] [LOCAL ] STK: Trimmed 14108 records to 9467 (keeping 200 days of data) [2025-10-02T21:43:07.150986] [DEBUG] [LOCAL ] STK: Primary data saved (9467 records). [2025-10-02T21:43:07.151139] [INFO ] [MAIN ] STK: Full history saved. [2025-10-02T21:43:07.151358] [INFO ] [MAIN ] Update Progress: 2009/2370 symbols completed. STK took 25.7s. Estimated remaining: 50m 52s. Rate: 7.1 symbols/min [2025-10-02T21:43:07.336970] [INFO ] [MAIN ] STNG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:43:07.390423] [DEBUG] [LOCAL ] STNG: Loaded 43841 existing records from primary storage. [2025-10-02T21:43:07.390774] [INFO ] [MAIN ] STNG: Loaded 43841 existing records. [2025-10-02T21:43:07.478103] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-04. [2025-10-02T21:43:07.605270] [WARN ] [MAIN ] STNG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:43:07.605494] [INFO ] [MAIN ] STNG: Wiping existing primary data before full refresh. [2025-10-02T21:43:07.605542] [INFO ] [LOCAL ] STNG: Starting deletion of primary data. [2025-10-02T21:43:07.605809] [DEBUG] [LOCAL ] STNG: Deleted primary data file. [2025-10-02T21:43:07.605867] [INFO ] [MAIN ] STNG: Starting full primary refresh. [2025-10-02T21:43:08.005232] [INFO ] [REMOTE ] STNG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:43:08.273032] [INFO ] [REMOTE ] STNG: Fetching primary data for 2024-12. [2025-10-02T21:43:08.927786] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-02T21:43:09.072994] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-04. [2025-10-02T21:43:09.643181] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-02T21:43:09.872983] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-04. [2025-10-02T21:43:09.910176] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-02T21:43:10.673057] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-01. [2025-10-02T21:43:11.018289] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-02T21:43:11.266426] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-02T21:43:11.473083] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-05. [2025-10-02T21:43:12.273191] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-05. [2025-10-02T21:43:12.372854] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-02T21:43:12.439530] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-02T21:43:13.073030] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-06. [2025-10-02T21:43:13.873009] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-05. [2025-10-02T21:43:14.246862] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-02T21:43:14.394856] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-02T21:43:14.673087] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-02. [2025-10-02T21:43:15.473004] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-06. [2025-10-02T21:43:15.888044] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-02T21:43:16.263030] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-02T21:43:16.273000] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-07. [2025-10-02T21:43:17.073032] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-06. [2025-10-02T21:43:17.445992] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-02T21:43:17.487634] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-02T21:43:17.873005] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-03. [2025-10-02T21:43:18.673061] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-07. [2025-10-02T21:43:18.896791] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-02T21:43:19.462703] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-02T21:43:19.472977] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-08. [2025-10-02T21:43:20.273005] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-04. [2025-10-02T21:43:20.769247] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-02T21:43:21.055210] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-10-02T21:43:21.072973] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-08. [2025-10-02T21:43:21.872998] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-07. [2025-10-02T21:43:21.946327] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-02T21:43:22.672997] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-05. [2025-10-02T21:43:23.069793] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-02T21:43:23.472996] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-09. [2025-10-02T21:43:24.171178] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-02T21:43:24.273037] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-09. [2025-10-02T21:43:24.325909] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-10-02T21:43:25.072980] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-08. [2025-10-02T21:43:25.331263] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-02T21:43:25.387563] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-02T21:43:25.873069] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-10. [2025-10-02T21:43:26.466988] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-02T21:43:26.468751] [INFO ] [REMOTE ] STN: Full fetch complete (32431 records). [2025-10-02T21:43:26.468891] [DEBUG] [VALIDATOR ] STN: Validating primary data. [2025-10-02T21:43:26.678199] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-06. [2025-10-02T21:43:26.981932] [DEBUG] [VALIDATOR ] STN: All expected trading days are present. [2025-10-02T21:43:26.982040] [DEBUG] [VALIDATOR ] STN: Primary data validation passed. [2025-10-02T21:43:26.983015] [INFO ] [MAIN ] STN: Fetched primary data is valid. [2025-10-02T21:43:26.983099] [DEBUG] [LOCAL ] STN: Saving primary data. [2025-10-02T21:43:27.020799] [DEBUG] [LOCAL ] STN: Trimmed 32431 records to 22995 (keeping 200 days of data) [2025-10-02T21:43:27.022231] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-02T21:43:27.204388] [DEBUG] [LOCAL ] STN: Primary data saved (22995 records). [2025-10-02T21:43:27.204525] [INFO ] [MAIN ] STN: Full history saved. [2025-10-02T21:43:27.204609] [INFO ] [MAIN ] Update Progress: 2010/2370 symbols completed. STN took 34.4s. Estimated remaining: 50m 45s. Rate: 7.1 symbols/min [2025-10-02T21:43:27.391252] [INFO ] [MAIN ] STRV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:43:27.406476] [DEBUG] [LOCAL ] STRV: Loaded 11394 existing records from primary storage. [2025-10-02T21:43:27.406755] [INFO ] [MAIN ] STRV: Loaded 11394 existing records. [2025-10-02T21:43:27.478135] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-10. [2025-10-02T21:43:27.618016] [WARN ] [MAIN ] STRV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:43:27.619571] [INFO ] [MAIN ] STRV: Wiping existing primary data before full refresh. [2025-10-02T21:43:27.619718] [INFO ] [LOCAL ] STRV: Starting deletion of primary data. [2025-10-02T21:43:27.620799] [DEBUG] [LOCAL ] STRV: Deleted primary data file. [2025-10-02T21:43:27.620889] [INFO ] [MAIN ] STRV: Starting full primary refresh. [2025-10-02T21:43:28.061710] [INFO ] [REMOTE ] STRV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:43:28.092977] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-02T21:43:28.273033] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-09. [2025-10-02T21:43:29.072997] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-07. [2025-10-02T21:43:29.339388] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-02T21:43:29.341465] [INFO ] [REMOTE ] STM: Full fetch complete (77527 records). [2025-10-02T21:43:29.341578] [DEBUG] [VALIDATOR ] STM: Validating primary data. [2025-10-02T21:43:29.777059] [DEBUG] [VALIDATOR ] STM: All expected trading days are present. [2025-10-02T21:43:29.777159] [DEBUG] [VALIDATOR ] STM: Primary data validation passed. [2025-10-02T21:43:29.778508] [INFO ] [MAIN ] STM: Fetched primary data is valid. [2025-10-02T21:43:29.778581] [DEBUG] [LOCAL ] STM: Saving primary data. [2025-10-02T21:43:29.781476] [DEBUG] [LOCAL ] STM: Trimmed 77527 records to 53968 (keeping 200 days of data) [2025-10-02T21:43:29.881004] [INFO ] [REMOTE ] STRV: Fetching primary data for 2024-12. [2025-10-02T21:43:30.082372] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-02T21:43:30.202314] [DEBUG] [LOCAL ] STM: Primary data saved (53968 records). [2025-10-02T21:43:30.202469] [INFO ] [MAIN ] STM: Full history saved. [2025-10-02T21:43:30.202557] [INFO ] [MAIN ] Update Progress: 2011/2370 symbols completed. STM took 41.5s. Estimated remaining: 50m 36s. Rate: 7.1 symbols/min [2025-10-02T21:43:30.389514] [INFO ] [MAIN ] STT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:43:30.444583] [DEBUG] [LOCAL ] STT: Loaded 50958 existing records from primary storage. [2025-10-02T21:43:30.444938] [INFO ] [MAIN ] STT: Loaded 50958 existing records. [2025-10-02T21:43:30.652934] [WARN ] [MAIN ] STT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:43:30.653703] [INFO ] [MAIN ] STT: Wiping existing primary data before full refresh. [2025-10-02T21:43:30.653841] [INFO ] [LOCAL ] STT: Starting deletion of primary data. [2025-10-02T21:43:30.654339] [DEBUG] [LOCAL ] STT: Deleted primary data file. [2025-10-02T21:43:30.654504] [INFO ] [MAIN ] STT: Starting full primary refresh. [2025-10-02T21:43:30.682054] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-10. [2025-10-02T21:43:30.802478] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-02T21:43:31.116625] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-02T21:43:31.141517] [INFO ] [REMOTE ] STT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:43:31.473003] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-08. [2025-10-02T21:43:32.273007] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-01. [2025-10-02T21:43:32.509323] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-02T21:43:32.514223] [INFO ] [REMOTE ] STLA: Full fetch complete (77535 records). [2025-10-02T21:43:32.514378] [DEBUG] [VALIDATOR ] STLA: Validating primary data. [2025-10-02T21:43:33.020125] [DEBUG] [VALIDATOR ] STLA: All expected trading days are present. [2025-10-02T21:43:33.020304] [DEBUG] [VALIDATOR ] STLA: Primary data validation passed. [2025-10-02T21:43:33.021703] [INFO ] [MAIN ] STLA: Fetched primary data is valid. [2025-10-02T21:43:33.021933] [DEBUG] [LOCAL ] STLA: Saving primary data. [2025-10-02T21:43:33.050443] [DEBUG] [LOCAL ] STLA: Trimmed 77535 records to 53933 (keeping 200 days of data) [2025-10-02T21:43:33.052025] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-02T21:43:33.072981] [INFO ] [REMOTE ] STT: Fetching primary data for 2024-12. [2025-10-02T21:43:33.307545] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-02T21:43:33.443034] [DEBUG] [LOCAL ] STLA: Primary data saved (53933 records). [2025-10-02T21:43:33.443189] [INFO ] [MAIN ] STLA: Full history saved. [2025-10-02T21:43:33.443844] [INFO ] [MAIN ] Update Progress: 2012/2370 symbols completed. STLA took 46.6s. Estimated remaining: 50m 27s. Rate: 7.1 symbols/min [2025-10-02T21:43:33.640165] [INFO ] [MAIN ] STUB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:43:33.640365] [DEBUG] [LOCAL ] STUB: No existing data file found in primary storage. [2025-10-02T21:43:33.640406] [WARN ] [MAIN ] STUB: No existing data found, performing full refresh instead. [2025-10-02T21:43:33.640520] [INFO ] [MAIN ] STUB: Wiping existing primary data before full refresh. [2025-10-02T21:43:33.640563] [INFO ] [LOCAL ] STUB: Starting deletion of primary data. [2025-10-02T21:43:33.640606] [DEBUG] [LOCAL ] STUB: No primary data file found to delete. [2025-10-02T21:43:33.640662] [INFO ] [MAIN ] STUB: Starting full primary refresh. [2025-10-02T21:43:33.878243] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-02. [2025-10-02T21:43:34.031683] [INFO ] [REMOTE ] STUB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:43:34.673016] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-09. [2025-10-02T21:43:34.725128] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-02T21:43:34.989239] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-02T21:43:35.472996] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-01. [2025-10-02T21:43:36.106601] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-02T21:43:36.272990] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-03. [2025-10-02T21:43:37.072979] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-10. [2025-10-02T21:43:37.106094] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-02T21:43:37.319808] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-02T21:43:37.873030] [INFO ] [REMOTE ] STUB: Fetching primary data for 2024-12. [2025-10-02T21:43:38.100139] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T21:43:38.100463] [WARN ] [REMOTE ] STUB: No data returned for month 2024-12 [2025-10-02T21:43:38.100558] [FATAL] [REMOTE ] STUB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T21:43:38.100632] [FATAL] [MAIN ] STUB: Failed to fetch primary data. [2025-10-02T21:43:38.100744] [WARN ] [MAIN ] STUB: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T21:43:38.100817] [INFO ] [LOCAL ] STUB: Starting deletion of primary data. [2025-10-02T21:43:38.100883] [DEBUG] [LOCAL ] STUB: No primary data file found to delete. [2025-10-02T21:43:38.100922] [INFO ] [LOCAL ] STUB: Starting deletion of derivative data. [2025-10-02T21:43:38.100964] [DEBUG] [LOCAL ] STUB: No derivative data file found to delete. [2025-10-02T21:43:38.101013] [INFO ] [MAIN ] Update Progress: 2013/2370 symbols completed. STUB took 4.7s. Estimated remaining: 50m 17s. Rate: 7.1 symbols/min [2025-10-02T21:43:38.291369] [INFO ] [MAIN ] STVN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:43:38.307124] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-02T21:43:38.309082] [INFO ] [REMOTE ] STNG: Full fetch complete (64434 records). [2025-10-02T21:43:38.309360] [DEBUG] [VALIDATOR ] STNG: Validating primary data. [2025-10-02T21:43:38.439939] [DEBUG] [LOCAL ] STVN: Loaded 26254 existing records from primary storage. [2025-10-02T21:43:38.450991] [INFO ] [MAIN ] STVN: Loaded 26254 existing records. [2025-10-02T21:43:38.682441] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-02. [2025-10-02T21:43:38.929585] [WARN ] [MAIN ] STVN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:43:38.952316] [INFO ] [MAIN ] STVN: Wiping existing primary data before full refresh. [2025-10-02T21:43:38.957608] [INFO ] [LOCAL ] STVN: Starting deletion of primary data. [2025-10-02T21:43:38.993810] [DEBUG] [LOCAL ] STVN: Deleted primary data file. [2025-10-02T21:43:38.996874] [INFO ] [MAIN ] STVN: Starting full primary refresh. [2025-10-02T21:43:39.056896] [DEBUG] [VALIDATOR ] STNG: All expected trading days are present. [2025-10-02T21:43:39.078234] [DEBUG] [VALIDATOR ] STNG: Primary data validation passed. [2025-10-02T21:43:39.098931] [INFO ] [MAIN ] STNG: Fetched primary data is valid. [2025-10-02T21:43:39.126519] [DEBUG] [LOCAL ] STNG: Saving primary data. [2025-10-02T21:43:39.225596] [DEBUG] [LOCAL ] STNG: Trimmed 64434 records to 44086 (keeping 200 days of data) [2025-10-02T21:43:39.474887] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-04. [2025-10-02T21:43:39.521636] [INFO ] [REMOTE ] STVN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:43:39.712035] [DEBUG] [LOCAL ] STNG: Primary data saved (44086 records). [2025-10-02T21:43:39.712186] [INFO ] [MAIN ] STNG: Full history saved. [2025-10-02T21:43:39.712275] [INFO ] [MAIN ] Update Progress: 2014/2370 symbols completed. STNG took 32.6s. Estimated remaining: 50m 8s. Rate: 7.1 symbols/min [2025-10-02T21:43:39.899726] [INFO ] [MAIN ] STWD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:43:39.950342] [DEBUG] [LOCAL ] STWD: Loaded 51884 existing records from primary storage. [2025-10-02T21:43:39.950685] [INFO ] [MAIN ] STWD: Loaded 51884 existing records. [2025-10-02T21:43:40.149479] [WARN ] [MAIN ] STWD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:43:40.149699] [INFO ] [MAIN ] STWD: Wiping existing primary data before full refresh. [2025-10-02T21:43:40.149758] [INFO ] [LOCAL ] STWD: Starting deletion of primary data. [2025-10-02T21:43:40.150032] [DEBUG] [LOCAL ] STWD: Deleted primary data file. [2025-10-02T21:43:40.150092] [INFO ] [MAIN ] STWD: Starting full primary refresh. [2025-10-02T21:43:40.278068] [INFO ] [REMOTE ] STVN: Fetching primary data for 2024-12. [2025-10-02T21:43:40.561799] [INFO ] [REMOTE ] STWD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:43:40.594194] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-02T21:43:40.685890] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-02T21:43:41.072984] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-03. [2025-10-02T21:43:41.667542] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-02T21:43:41.873004] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-01. [2025-10-02T21:43:42.672990] [INFO ] [REMOTE ] STWD: Fetching primary data for 2024-12. [2025-10-02T21:43:42.892795] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-02T21:43:43.176967] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-02T21:43:43.473023] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-02. [2025-10-02T21:43:44.273010] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-05. [2025-10-02T21:43:44.437770] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-02T21:43:44.662539] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-02T21:43:45.073055] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-03. [2025-10-02T21:43:45.157560] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-02T21:43:45.873025] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-06. [2025-10-02T21:43:46.191259] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-02T21:43:46.648151] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-02T21:43:46.672971] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-04. [2025-10-02T21:43:47.473012] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-07. [2025-10-02T21:43:47.968773] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-02T21:43:48.060729] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-02T21:43:48.273047] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-04. [2025-10-02T21:43:49.073004] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-01. [2025-10-02T21:43:49.873037] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-05. [2025-10-02T21:43:50.135732] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-02T21:43:50.541072] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-02T21:43:50.673022] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-08. [2025-10-02T21:43:50.967926] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-02T21:43:51.428546] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-02T21:43:51.472999] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-05. [2025-10-02T21:43:52.273028] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-09. [2025-10-02T21:43:52.821491] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-02T21:43:52.934707] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-02T21:43:53.072987] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-10. [2025-10-02T21:43:53.568218] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-02T21:43:53.569495] [INFO ] [REMOTE ] STRV: Full fetch complete (18206 records). [2025-10-02T21:43:53.569583] [DEBUG] [VALIDATOR ] STRV: Validating primary data. [2025-10-02T21:43:53.878192] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-06. [2025-10-02T21:43:53.989480] [DEBUG] [VALIDATOR ] STRV: All expected trading days are present. [2025-10-02T21:43:53.989563] [DEBUG] [VALIDATOR ] STRV: Primary data validation passed. [2025-10-02T21:43:53.990031] [INFO ] [MAIN ] STRV: Fetched primary data is valid. [2025-10-02T21:43:53.990095] [DEBUG] [LOCAL ] STRV: Saving primary data. [2025-10-02T21:43:53.990672] [DEBUG] [LOCAL ] STRV: Trimmed 18206 records to 11451 (keeping 200 days of data) [2025-10-02T21:43:54.068314] [DEBUG] [LOCAL ] STRV: Primary data saved (11451 records). [2025-10-02T21:43:54.068453] [INFO ] [MAIN ] STRV: Full history saved. [2025-10-02T21:43:54.068539] [INFO ] [MAIN ] Update Progress: 2015/2370 symbols completed. STRV took 26.9s. Estimated remaining: 50m 0s. Rate: 7.1 symbols/min [2025-10-02T21:43:54.257160] [INFO ] [MAIN ] STXD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:43:54.261128] [DEBUG] [LOCAL ] STXD: Loaded 1289 existing records from primary storage. [2025-10-02T21:43:54.261341] [INFO ] [MAIN ] STXD: Loaded 1289 existing records. [2025-10-02T21:43:54.455916] [WARN ] [MAIN ] STXD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:43:54.456190] [INFO ] [MAIN ] STXD: Wiping existing primary data before full refresh. [2025-10-02T21:43:54.456295] [INFO ] [LOCAL ] STXD: Starting deletion of primary data. [2025-10-02T21:43:54.456502] [DEBUG] [LOCAL ] STXD: Deleted primary data file. [2025-10-02T21:43:54.456561] [INFO ] [MAIN ] STXD: Starting full primary refresh. [2025-10-02T21:43:54.678985] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-02. [2025-10-02T21:43:54.858803] [INFO ] [REMOTE ] STXD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:43:55.472988] [INFO ] [REMOTE ] STXD: Fetching primary data for 2024-12. [2025-10-02T21:43:55.621157] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-02T21:43:55.976567] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-02T21:43:56.273028] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-01. [2025-10-02T21:43:56.335666] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-02T21:43:56.705965] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-02T21:43:57.072990] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-07. [2025-10-02T21:43:57.873064] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-06. [2025-10-02T21:43:58.673769] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-02T21:43:58.673892] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-03. [2025-10-02T21:43:59.156408] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-02T21:43:59.473020] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-02. [2025-10-02T21:43:59.915726] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-02T21:44:00.272990] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-03. [2025-10-02T21:44:00.649689] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-02T21:44:00.784403] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-02T21:44:01.072992] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-04. [2025-10-02T21:44:01.523816] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-02T21:44:01.873015] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-04. [2025-10-02T21:44:02.673044] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-05. [2025-10-02T21:44:03.091056] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-02T21:44:03.473029] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-08. [2025-10-02T21:44:03.609820] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-02T21:44:04.273000] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-07. [2025-10-02T21:44:05.072994] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-05. [2025-10-02T21:44:05.186730] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-02T21:44:05.214967] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-02T21:44:05.873027] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-08. [2025-10-02T21:44:06.673076] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-06. [2025-10-02T21:44:06.966035] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-02T21:44:07.016590] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-02T21:44:07.145587] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-02T21:44:07.473049] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-09. [2025-10-02T21:44:08.273028] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-09. [2025-10-02T21:44:08.781821] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-02T21:44:09.073039] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-06. [2025-10-02T21:44:09.873001] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-07. [2025-10-02T21:44:10.185229] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-02T21:44:10.231573] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-02T21:44:10.673017] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-10. [2025-10-02T21:44:10.808841] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-02T21:44:11.473005] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-08. [2025-10-02T21:44:11.824870] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-02T21:44:11.980697] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-02T21:44:11.983766] [INFO ] [REMOTE ] STT: Full fetch complete (74395 records). [2025-10-02T21:44:11.983965] [DEBUG] [VALIDATOR ] STT: Validating primary data. [2025-10-02T21:44:12.278152] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-07. [2025-10-02T21:44:12.492523] [DEBUG] [VALIDATOR ] STT: All expected trading days are present. [2025-10-02T21:44:12.492670] [DEBUG] [VALIDATOR ] STT: Primary data validation passed. [2025-10-02T21:44:12.493941] [INFO ] [MAIN ] STT: Fetched primary data is valid. [2025-10-02T21:44:12.494010] [DEBUG] [LOCAL ] STT: Saving primary data. [2025-10-02T21:44:12.495720] [DEBUG] [LOCAL ] STT: Trimmed 74395 records to 51328 (keeping 200 days of data) [2025-10-02T21:44:12.851384] [DEBUG] [LOCAL ] STT: Primary data saved (51328 records). [2025-10-02T21:44:12.851531] [INFO ] [MAIN ] STT: Full history saved. [2025-10-02T21:44:12.851622] [INFO ] [MAIN ] Update Progress: 2016/2370 symbols completed. STT took 42.6s. Estimated remaining: 49m 54s. Rate: 7.1 symbols/min [2025-10-02T21:44:13.041405] [INFO ] [MAIN ] STXE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:44:13.046864] [DEBUG] [LOCAL ] STXE: Loaded 2183 existing records from primary storage. [2025-10-02T21:44:13.047081] [INFO ] [MAIN ] STXE: Loaded 2183 existing records. [2025-10-02T21:44:13.082591] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-10. [2025-10-02T21:44:13.258068] [WARN ] [MAIN ] STXE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:44:13.258591] [INFO ] [MAIN ] STXE: Wiping existing primary data before full refresh. [2025-10-02T21:44:13.258666] [INFO ] [LOCAL ] STXE: Starting deletion of primary data. [2025-10-02T21:44:13.258853] [DEBUG] [LOCAL ] STXE: Deleted primary data file. [2025-10-02T21:44:13.258911] [INFO ] [MAIN ] STXE: Starting full primary refresh. [2025-10-02T21:44:13.656516] [INFO ] [REMOTE ] STXE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:44:13.873009] [INFO ] [REMOTE ] STXE: Fetching primary data for 2024-12. [2025-10-02T21:44:14.059961] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-02T21:44:14.061515] [INFO ] [REMOTE ] STVN: Full fetch complete (39357 records). [2025-10-02T21:44:14.061725] [DEBUG] [VALIDATOR ] STVN: Validating primary data. [2025-10-02T21:44:14.371247] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-02T21:44:14.472113] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-02T21:44:14.590007] [DEBUG] [VALIDATOR ] STVN: All expected trading days are present. [2025-10-02T21:44:14.590101] [DEBUG] [VALIDATOR ] STVN: Primary data validation passed. [2025-10-02T21:44:14.591031] [INFO ] [MAIN ] STVN: Fetched primary data is valid. [2025-10-02T21:44:14.591101] [DEBUG] [LOCAL ] STVN: Saving primary data. [2025-10-02T21:44:14.592335] [DEBUG] [LOCAL ] STVN: Trimmed 39357 records to 26391 (keeping 200 days of data) [2025-10-02T21:44:14.686738] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-01. [2025-10-02T21:44:14.776436] [DEBUG] [LOCAL ] STVN: Primary data saved (26391 records). [2025-10-02T21:44:14.776589] [INFO ] [MAIN ] STVN: Full history saved. [2025-10-02T21:44:14.776704] [INFO ] [MAIN ] Update Progress: 2017/2370 symbols completed. STVN took 36.7s. Estimated remaining: 49m 44s. Rate: 7.1 symbols/min [2025-10-02T21:44:14.979419] [INFO ] [MAIN ] STXG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:44:14.985020] [DEBUG] [LOCAL ] STXG: Loaded 2509 existing records from primary storage. [2025-10-02T21:44:14.985264] [INFO ] [MAIN ] STXG: Loaded 2509 existing records. [2025-10-02T21:44:15.195745] [WARN ] [MAIN ] STXG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:44:15.196012] [INFO ] [MAIN ] STXG: Wiping existing primary data before full refresh. [2025-10-02T21:44:15.196066] [INFO ] [LOCAL ] STXG: Starting deletion of primary data. [2025-10-02T21:44:15.196232] [DEBUG] [LOCAL ] STXG: Deleted primary data file. [2025-10-02T21:44:15.196291] [INFO ] [MAIN ] STXG: Starting full primary refresh. [2025-10-02T21:44:15.281735] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-02T21:44:15.478201] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-02. [2025-10-02T21:44:15.614489] [INFO ] [REMOTE ] STXG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:44:15.909988] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-02T21:44:16.273009] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-03. [2025-10-02T21:44:16.859687] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-02T21:44:17.072998] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-04. [2025-10-02T21:44:17.616832] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-02T21:44:17.873057] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-05. [2025-10-02T21:44:18.328799] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-02T21:44:18.673033] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-06. [2025-10-02T21:44:19.110353] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-02T21:44:19.473004] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-09. [2025-10-02T21:44:19.841878] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-02T21:44:20.273050] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-08. [2025-10-02T21:44:21.073071] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-07. [2025-10-02T21:44:21.418680] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-02T21:44:21.641202] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-02T21:44:21.873003] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-09. [2025-10-02T21:44:22.673012] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-08. [2025-10-02T21:44:22.963961] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-10-02T21:44:23.473011] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-09. [2025-10-02T21:44:23.674803] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-02T21:44:23.944765] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-02T21:44:24.272999] [INFO ] [REMOTE ] STXG: Fetching primary data for 2024-12. [2025-10-02T21:44:24.772417] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-02T21:44:25.073004] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-01. [2025-10-02T21:44:25.651726] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-02T21:44:25.873011] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-10. [2025-10-02T21:44:26.140771] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-10 (0.27 seconds). [2025-10-02T21:44:26.141487] [INFO ] [REMOTE ] STXD: Full fetch complete (2055 records). [2025-10-02T21:44:26.141558] [DEBUG] [VALIDATOR ] STXD: Validating primary data. [2025-10-02T21:44:26.555116] [DEBUG] [VALIDATOR ] STXD: All expected trading days are present. [2025-10-02T21:44:26.555199] [DEBUG] [VALIDATOR ] STXD: Primary data validation passed. [2025-10-02T21:44:26.555298] [INFO ] [MAIN ] STXD: Fetched primary data is valid. [2025-10-02T21:44:26.555339] [DEBUG] [LOCAL ] STXD: Saving primary data. [2025-10-02T21:44:26.555808] [DEBUG] [LOCAL ] STXD: Trimmed 2055 records to 1294 (keeping 200 days of data) [2025-10-02T21:44:26.565419] [DEBUG] [LOCAL ] STXD: Primary data saved (1294 records). [2025-10-02T21:44:26.565544] [INFO ] [MAIN ] STXD: Full history saved. [2025-10-02T21:44:26.565863] [INFO ] [MAIN ] Update Progress: 2018/2370 symbols completed. STXD took 32.5s. Estimated remaining: 49m 36s. Rate: 7.1 symbols/min [2025-10-02T21:44:26.681112] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-02. [2025-10-02T21:44:26.793106] [INFO ] [MAIN ] STXK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:44:26.797326] [DEBUG] [LOCAL ] STXK: Loaded 1483 existing records from primary storage. [2025-10-02T21:44:26.797495] [INFO ] [MAIN ] STXK: Loaded 1483 existing records. [2025-10-02T21:44:26.998842] [WARN ] [MAIN ] STXK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:44:26.999055] [INFO ] [MAIN ] STXK: Wiping existing primary data before full refresh. [2025-10-02T21:44:26.999104] [INFO ] [LOCAL ] STXK: Starting deletion of primary data. [2025-10-02T21:44:26.999312] [DEBUG] [LOCAL ] STXK: Deleted primary data file. [2025-10-02T21:44:26.999397] [INFO ] [MAIN ] STXK: Starting full primary refresh. [2025-10-02T21:44:27.322327] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-02T21:44:27.415345] [INFO ] [REMOTE ] STXK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:44:27.473001] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-10. [2025-10-02T21:44:27.825047] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-02T21:44:27.825812] [INFO ] [REMOTE ] STXE: Full fetch complete (3673 records). [2025-10-02T21:44:27.825883] [DEBUG] [VALIDATOR ] STXE: Validating primary data. [2025-10-02T21:44:28.253963] [DEBUG] [VALIDATOR ] STXE: All expected trading days are present. [2025-10-02T21:44:28.254088] [DEBUG] [VALIDATOR ] STXE: Primary data validation passed. [2025-10-02T21:44:28.254250] [INFO ] [MAIN ] STXE: Fetched primary data is valid. [2025-10-02T21:44:28.254350] [DEBUG] [LOCAL ] STXE: Saving primary data. [2025-10-02T21:44:28.255034] [DEBUG] [LOCAL ] STXE: Trimmed 3673 records to 2199 (keeping 200 days of data) [2025-10-02T21:44:28.270164] [DEBUG] [LOCAL ] STXE: Primary data saved (2199 records). [2025-10-02T21:44:28.270289] [INFO ] [MAIN ] STXE: Full history saved. [2025-10-02T21:44:28.270388] [INFO ] [MAIN ] Update Progress: 2019/2370 symbols completed. STXE took 15.4s. Estimated remaining: 49m 27s. Rate: 7.1 symbols/min [2025-10-02T21:44:28.283201] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-10. [2025-10-02T21:44:28.477193] [INFO ] [MAIN ] STXM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:44:28.477419] [DEBUG] [LOCAL ] STXM: No existing data file found in primary storage. [2025-10-02T21:44:28.477528] [WARN ] [MAIN ] STXM: No existing data found, performing full refresh instead. [2025-10-02T21:44:28.477682] [INFO ] [MAIN ] STXM: Wiping existing primary data before full refresh. [2025-10-02T21:44:28.477740] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-10-02T21:44:28.477786] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-10-02T21:44:28.477822] [INFO ] [MAIN ] STXM: Starting full primary refresh. [2025-10-02T21:44:28.858992] [INFO ] [REMOTE ] STXM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:44:29.073007] [INFO ] [REMOTE ] STXK: Fetching primary data for 2024-12. [2025-10-02T21:44:29.524190] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-02T21:44:29.735511] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-02T21:44:29.737891] [INFO ] [REMOTE ] STWD: Full fetch complete (75115 records). [2025-10-02T21:44:29.738051] [DEBUG] [VALIDATOR ] STWD: Validating primary data. [2025-10-02T21:44:29.878183] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-01. [2025-10-02T21:44:30.180383] [DEBUG] [VALIDATOR ] STWD: All expected trading days are present. [2025-10-02T21:44:30.180483] [DEBUG] [VALIDATOR ] STWD: Primary data validation passed. [2025-10-02T21:44:30.181626] [INFO ] [MAIN ] STWD: Fetched primary data is valid. [2025-10-02T21:44:30.181724] [DEBUG] [LOCAL ] STWD: Saving primary data. [2025-10-02T21:44:30.183313] [DEBUG] [LOCAL ] STWD: Trimmed 75115 records to 52264 (keeping 200 days of data) [2025-10-02T21:44:30.418917] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-02T21:44:30.546159] [DEBUG] [LOCAL ] STWD: Primary data saved (52264 records). [2025-10-02T21:44:30.546326] [INFO ] [MAIN ] STWD: Full history saved. [2025-10-02T21:44:30.546487] [INFO ] [MAIN ] Update Progress: 2020/2370 symbols completed. STWD took 50.8s. Estimated remaining: 49m 17s. Rate: 7.1 symbols/min [2025-10-02T21:44:30.679997] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-02. [2025-10-02T21:44:30.776341] [INFO ] [MAIN ] STXT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:44:30.783005] [DEBUG] [LOCAL ] STXT: Loaded 2540 existing records from primary storage. [2025-10-02T21:44:30.783217] [INFO ] [MAIN ] STXT: Loaded 2540 existing records. [2025-10-02T21:44:31.012527] [WARN ] [MAIN ] STXT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:44:31.012835] [INFO ] [MAIN ] STXT: Wiping existing primary data before full refresh. [2025-10-02T21:44:31.012899] [INFO ] [LOCAL ] STXT: Starting deletion of primary data. [2025-10-02T21:44:31.013083] [DEBUG] [LOCAL ] STXT: Deleted primary data file. [2025-10-02T21:44:31.013143] [INFO ] [MAIN ] STXT: Starting full primary refresh. [2025-10-02T21:44:31.225059] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-02T21:44:31.453331] [INFO ] [REMOTE ] STXT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:44:31.473002] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-03. [2025-10-02T21:44:32.060698] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-02T21:44:32.272995] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-04. [2025-10-02T21:44:32.921260] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-02T21:44:33.073033] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-05. [2025-10-02T21:44:33.601476] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-02T21:44:33.873044] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-06. [2025-10-02T21:44:34.321578] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-02T21:44:34.673015] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-03. [2025-10-02T21:44:34.973681] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-10-02T21:44:35.473070] [INFO ] [REMOTE ] STXM: Fetching primary data for 2024-12. [2025-10-02T21:44:35.856579] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-10-02T21:44:36.273021] [INFO ] [REMOTE ] STXT: Fetching primary data for 2024-12. [2025-10-02T21:44:36.666616] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-10-02T21:44:37.072997] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-07. [2025-10-02T21:44:37.515413] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-02T21:44:37.873015] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-01. [2025-10-02T21:44:38.299811] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-02T21:44:38.673057] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-04. [2025-10-02T21:44:39.134483] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-02T21:44:39.473015] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-08. [2025-10-02T21:44:39.914977] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-02T21:44:40.273000] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-09. [2025-10-02T21:44:40.742061] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-02T21:44:41.073025] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-05. [2025-10-02T21:44:41.516745] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-02T21:44:41.873064] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-02. [2025-10-02T21:44:42.303297] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-02T21:44:42.673009] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-03. [2025-10-02T21:44:43.033713] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-02T21:44:43.473003] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-04. [2025-10-02T21:44:43.895145] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-02T21:44:44.273030] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-05. [2025-10-02T21:44:44.615869] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-02T21:44:45.073014] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-10. [2025-10-02T21:44:45.457313] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-02T21:44:45.458220] [INFO ] [REMOTE ] STXG: Full fetch complete (4172 records). [2025-10-02T21:44:45.458298] [DEBUG] [VALIDATOR ] STXG: Validating primary data. [2025-10-02T21:44:45.856977] [DEBUG] [VALIDATOR ] STXG: All expected trading days are present. [2025-10-02T21:44:45.857070] [DEBUG] [VALIDATOR ] STXG: Primary data validation passed. [2025-10-02T21:44:45.857286] [INFO ] [MAIN ] STXG: Fetched primary data is valid. [2025-10-02T21:44:45.857351] [DEBUG] [LOCAL ] STXG: Saving primary data. [2025-10-02T21:44:45.857813] [DEBUG] [LOCAL ] STXG: Trimmed 4172 records to 2521 (keeping 200 days of data) [2025-10-02T21:44:45.873129] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-06. [2025-10-02T21:44:45.876100] [DEBUG] [LOCAL ] STXG: Primary data saved (2521 records). [2025-10-02T21:44:45.876182] [INFO ] [MAIN ] STXG: Full history saved. [2025-10-02T21:44:45.876284] [INFO ] [MAIN ] Update Progress: 2021/2370 symbols completed. STXG took 31.1s. Estimated remaining: 49m 10s. Rate: 7.1 symbols/min [2025-10-02T21:44:46.066491] [INFO ] [MAIN ] STXV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:44:46.070496] [DEBUG] [LOCAL ] STXV: Loaded 1575 existing records from primary storage. [2025-10-02T21:44:46.070661] [INFO ] [MAIN ] STXV: Loaded 1575 existing records. [2025-10-02T21:44:46.245566] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-02T21:44:46.269806] [WARN ] [MAIN ] STXV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:44:46.270012] [INFO ] [MAIN ] STXV: Wiping existing primary data before full refresh. [2025-10-02T21:44:46.270061] [INFO ] [LOCAL ] STXV: Starting deletion of primary data. [2025-10-02T21:44:46.270267] [DEBUG] [LOCAL ] STXV: Deleted primary data file. [2025-10-02T21:44:46.270328] [INFO ] [MAIN ] STXV: Starting full primary refresh. [2025-10-02T21:44:46.666272] [INFO ] [REMOTE ] STXV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:44:46.672964] [INFO ] [REMOTE ] STXV: Fetching primary data for 2024-12. [2025-10-02T21:44:46.998418] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-10-02T21:44:47.473055] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-06. [2025-10-02T21:44:47.950812] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-02T21:44:48.273004] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-07. [2025-10-02T21:44:48.673404] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-02T21:44:49.073009] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-01. [2025-10-02T21:44:49.549999] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-02T21:44:49.872996] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-07. [2025-10-02T21:44:50.281572] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-02T21:44:50.673025] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-08. [2025-10-02T21:44:51.101368] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-02T21:44:51.473014] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-09. [2025-10-02T21:44:51.776397] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-02T21:44:52.273018] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-01. [2025-10-02T21:44:52.760872] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-02T21:44:53.073017] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-10. [2025-10-02T21:44:53.310975] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-10 (0.24 seconds). [2025-10-02T21:44:53.311822] [INFO ] [REMOTE ] STXK: Full fetch complete (2403 records). [2025-10-02T21:44:53.311923] [DEBUG] [VALIDATOR ] STXK: Validating primary data. [2025-10-02T21:44:53.705530] [DEBUG] [VALIDATOR ] STXK: All expected trading days are present. [2025-10-02T21:44:53.705606] [DEBUG] [VALIDATOR ] STXK: Primary data validation passed. [2025-10-02T21:44:53.705737] [INFO ] [MAIN ] STXK: Fetched primary data is valid. [2025-10-02T21:44:53.705833] [DEBUG] [LOCAL ] STXK: Saving primary data. [2025-10-02T21:44:53.706204] [DEBUG] [LOCAL ] STXK: Trimmed 2403 records to 1497 (keeping 200 days of data) [2025-10-02T21:44:53.716636] [DEBUG] [LOCAL ] STXK: Primary data saved (1497 records). [2025-10-02T21:44:53.716734] [INFO ] [MAIN ] STXK: Full history saved. [2025-10-02T21:44:53.716828] [INFO ] [MAIN ] Update Progress: 2022/2370 symbols completed. STXK took 27.2s. Estimated remaining: 49m 1s. Rate: 7.1 symbols/min [2025-10-02T21:44:53.899585] [INFO ] [MAIN ] STZ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:44:53.876486] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-02. [2025-10-02T21:44:53.978862] [DEBUG] [LOCAL ] STZ: Loaded 52287 existing records from primary storage. [2025-10-02T21:44:53.979301] [INFO ] [MAIN ] STZ: Loaded 52287 existing records. [2025-10-02T21:44:54.189039] [WARN ] [MAIN ] STZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:44:54.189244] [INFO ] [MAIN ] STZ: Wiping existing primary data before full refresh. [2025-10-02T21:44:54.189294] [INFO ] [LOCAL ] STZ: Starting deletion of primary data. [2025-10-02T21:44:54.189598] [DEBUG] [LOCAL ] STZ: Deleted primary data file. [2025-10-02T21:44:54.189746] [INFO ] [MAIN ] STZ: Starting full primary refresh. [2025-10-02T21:44:54.501535] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-02T21:44:54.610494] [INFO ] [REMOTE ] STZ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:44:54.672999] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-08. [2025-10-02T21:44:55.013809] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-02T21:44:55.472997] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-09. [2025-10-02T21:44:55.811484] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-02T21:44:56.273008] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-03. [2025-10-02T21:44:56.806602] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-02T21:44:57.073025] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-02. [2025-10-02T21:44:57.529969] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-02T21:44:57.872994] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-03. [2025-10-02T21:44:58.356539] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-02T21:44:58.673039] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-04. [2025-10-02T21:44:59.124377] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-02T21:44:59.473063] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-04. [2025-10-02T21:44:59.910058] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-02T21:45:00.273026] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-10. [2025-10-02T21:45:00.529737] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-10 (0.26 seconds). [2025-10-02T21:45:00.530458] [INFO ] [REMOTE ] STXM: Full fetch complete (1437 records). [2025-10-02T21:45:00.530600] [DEBUG] [VALIDATOR ] STXM: Validating primary data. [2025-10-02T21:45:00.728771] [WARN ] [VALIDATOR ] STXM: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-02T21:45:00.728972] [FATAL] [MAIN ] STXM: Fetched primary data is invalid. Refusing to save it. [2025-10-02T21:45:00.729044] [WARN ] [MAIN ] STXM: Deleting existing primary and derivative data due to validation failure. [2025-10-02T21:45:00.729127] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-10-02T21:45:00.729224] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-10-02T21:45:00.729282] [INFO ] [LOCAL ] STXM: Starting deletion of derivative data. [2025-10-02T21:45:00.729348] [DEBUG] [LOCAL ] STXM: No derivative data file found to delete. [2025-10-02T21:45:00.729427] [INFO ] [MAIN ] Update Progress: 2023/2370 symbols completed. STXM took 32.5s. Estimated remaining: 48m 53s. Rate: 7.1 symbols/min [2025-10-02T21:45:00.913156] [INFO ] [MAIN ] SU: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:45:00.979695] [DEBUG] [LOCAL ] SU: Loaded 53452 existing records from primary storage. [2025-10-02T21:45:00.980023] [INFO ] [MAIN ] SU: Loaded 53452 existing records. [2025-10-02T21:45:01.078253] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-05. [2025-10-02T21:45:01.175348] [WARN ] [MAIN ] SU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:45:01.175665] [INFO ] [MAIN ] SU: Wiping existing primary data before full refresh. [2025-10-02T21:45:01.175729] [INFO ] [LOCAL ] SU: Starting deletion of primary data. [2025-10-02T21:45:01.175986] [DEBUG] [LOCAL ] SU: Deleted primary data file. [2025-10-02T21:45:01.176073] [INFO ] [MAIN ] SU: Starting full primary refresh. [2025-10-02T21:45:01.578603] [INFO ] [REMOTE ] SU: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:45:01.620679] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-02T21:45:01.873043] [INFO ] [REMOTE ] STZ: Fetching primary data for 2024-12. [2025-10-02T21:45:02.672998] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-06. [2025-10-02T21:45:03.152143] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-02T21:45:03.473047] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-07. [2025-10-02T21:45:03.759235] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-02T21:45:04.028197] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-02T21:45:04.273034] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-08. [2025-10-02T21:45:04.802494] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-02T21:45:05.073049] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-05. [2025-10-02T21:45:05.812877] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-02T21:45:05.872991] [INFO ] [REMOTE ] SU: Fetching primary data for 2024-12. [2025-10-02T21:45:06.673048] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-09. [2025-10-02T21:45:07.210040] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-02T21:45:07.473011] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-06. [2025-10-02T21:45:07.748883] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-02T21:45:07.823101] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-02T21:45:08.273012] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-10. [2025-10-02T21:45:08.641742] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-02T21:45:08.642546] [INFO ] [REMOTE ] STXT: Full fetch complete (3960 records). [2025-10-02T21:45:08.642624] [DEBUG] [VALIDATOR ] STXT: Validating primary data. [2025-10-02T21:45:09.043176] [DEBUG] [VALIDATOR ] STXT: All expected trading days are present. [2025-10-02T21:45:09.043254] [DEBUG] [VALIDATOR ] STXT: Primary data validation passed. [2025-10-02T21:45:09.043455] [INFO ] [MAIN ] STXT: Fetched primary data is valid. [2025-10-02T21:45:09.043507] [DEBUG] [LOCAL ] STXT: Saving primary data. [2025-10-02T21:45:09.043953] [DEBUG] [LOCAL ] STXT: Trimmed 3960 records to 2554 (keeping 200 days of data) [2025-10-02T21:45:09.062436] [DEBUG] [LOCAL ] STXT: Primary data saved (2554 records). [2025-10-02T21:45:09.062552] [INFO ] [MAIN ] STXT: Full history saved. [2025-10-02T21:45:09.062669] [INFO ] [MAIN ] Update Progress: 2024/2370 symbols completed. STXT took 38.5s. Estimated remaining: 48m 44s. Rate: 7.1 symbols/min [2025-10-02T21:45:09.078101] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-07. [2025-10-02T21:45:09.253805] [INFO ] [MAIN ] SUI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:45:09.306092] [DEBUG] [LOCAL ] SUI: Loaded 41743 existing records from primary storage. [2025-10-02T21:45:09.306404] [INFO ] [MAIN ] SUI: Loaded 41743 existing records. [2025-10-02T21:45:09.497976] [WARN ] [MAIN ] SUI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:45:09.498277] [INFO ] [MAIN ] SUI: Wiping existing primary data before full refresh. [2025-10-02T21:45:09.498332] [INFO ] [LOCAL ] SUI: Starting deletion of primary data. [2025-10-02T21:45:09.498568] [DEBUG] [LOCAL ] SUI: Deleted primary data file. [2025-10-02T21:45:09.498631] [INFO ] [MAIN ] SUI: Starting full primary refresh. [2025-10-02T21:45:09.627230] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-02T21:45:09.873827] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-01. [2025-10-02T21:45:09.904529] [INFO ] [REMOTE ] SUI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:45:10.672995] [INFO ] [REMOTE ] SUI: Fetching primary data for 2024-12. [2025-10-02T21:45:11.426369] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-02T21:45:11.472971] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-08. [2025-10-02T21:45:11.955944] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-02T21:45:12.272998] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-02. [2025-10-02T21:45:12.331427] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-02T21:45:13.073033] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-01. [2025-10-02T21:45:13.872980] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-09. [2025-10-02T21:45:14.377285] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-02T21:45:14.540433] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-02T21:45:14.672971] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-10. [2025-10-02T21:45:14.775677] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-02T21:45:15.015328] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-02T21:45:15.016040] [INFO ] [REMOTE ] STXV: Full fetch complete (2604 records). [2025-10-02T21:45:15.016112] [DEBUG] [VALIDATOR ] STXV: Validating primary data. [2025-10-02T21:45:15.445875] [DEBUG] [VALIDATOR ] STXV: All expected trading days are present. [2025-10-02T21:45:15.445954] [DEBUG] [VALIDATOR ] STXV: Primary data validation passed. [2025-10-02T21:45:15.446097] [INFO ] [MAIN ] STXV: Fetched primary data is valid. [2025-10-02T21:45:15.446160] [DEBUG] [LOCAL ] STXV: Saving primary data. [2025-10-02T21:45:15.446608] [DEBUG] [LOCAL ] STXV: Trimmed 2604 records to 1577 (keeping 200 days of data) [2025-10-02T21:45:15.458154] [DEBUG] [LOCAL ] STXV: Primary data saved (1577 records). [2025-10-02T21:45:15.458310] [INFO ] [MAIN ] STXV: Full history saved. [2025-10-02T21:45:15.458413] [INFO ] [MAIN ] Update Progress: 2025/2370 symbols completed. STXV took 29.6s. Estimated remaining: 48m 35s. Rate: 7.1 symbols/min [2025-10-02T21:45:15.481513] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-03. [2025-10-02T21:45:15.649267] [INFO ] [MAIN ] SUN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:45:15.689440] [DEBUG] [LOCAL ] SUN: Loaded 37534 existing records from primary storage. [2025-10-02T21:45:15.689943] [INFO ] [MAIN ] SUN: Loaded 37534 existing records. [2025-10-02T21:45:15.892995] [WARN ] [MAIN ] SUN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:45:15.893211] [INFO ] [MAIN ] SUN: Wiping existing primary data before full refresh. [2025-10-02T21:45:15.893262] [INFO ] [LOCAL ] SUN: Starting deletion of primary data. [2025-10-02T21:45:15.893491] [DEBUG] [LOCAL ] SUN: Deleted primary data file. [2025-10-02T21:45:15.893565] [INFO ] [MAIN ] SUN: Starting full primary refresh. [2025-10-02T21:45:16.273041] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-02. [2025-10-02T21:45:16.276867] [INFO ] [REMOTE ] SUN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:45:17.073020] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-01. [2025-10-02T21:45:17.681885] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-02T21:45:17.878140] [INFO ] [REMOTE ] SUN: Fetching primary data for 2024-12. [2025-10-02T21:45:17.904309] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-02T21:45:18.673004] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-04. [2025-10-02T21:45:18.789353] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-02T21:45:19.473011] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-02. [2025-10-02T21:45:19.516403] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-02T21:45:20.272982] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-01. [2025-10-02T21:45:20.826723] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-02T21:45:21.073028] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-03. [2025-10-02T21:45:21.137683] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-02T21:45:21.380405] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-02T21:45:21.873034] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-02. [2025-10-02T21:45:22.678186] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-03. [2025-10-02T21:45:22.690132] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-02T21:45:23.473003] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-04. [2025-10-02T21:45:23.503847] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-02T21:45:24.273010] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-05. [2025-10-02T21:45:24.356215] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-02T21:45:25.073013] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-04. [2025-10-02T21:45:25.239637] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-02T21:45:25.873044] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-05. [2025-10-02T21:45:26.673002] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-03. [2025-10-02T21:45:26.747172] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-02T21:45:27.082151] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-05 (2.81 seconds). [2025-10-02T21:45:27.472988] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-06. [2025-10-02T21:45:27.557376] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-02T21:45:28.130331] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-02T21:45:28.272956] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-06. [2025-10-02T21:45:29.073025] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-04. [2025-10-02T21:45:29.622684] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-02T21:45:29.873017] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-05. [2025-10-02T21:45:29.903375] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-02T21:45:30.272207] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-02T21:45:30.673088] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-07. [2025-10-02T21:45:31.473006] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-07. [2025-10-02T21:45:31.775665] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-02T21:45:32.128170] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-02T21:45:32.273046] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-05. [2025-10-02T21:45:33.072988] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-06. [2025-10-02T21:45:33.479498] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-02T21:45:33.545419] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-02T21:45:33.873049] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-08. [2025-10-02T21:45:34.672981] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-06. [2025-10-02T21:45:34.908092] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-02T21:45:35.473062] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-07. [2025-10-02T21:45:35.961494] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-02T21:45:36.237715] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-02T21:45:36.273016] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-08. [2025-10-02T21:45:37.059289] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-02T21:45:37.072946] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-08. [2025-10-02T21:45:37.749973] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-02T21:45:37.873019] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-07. [2025-10-02T21:45:38.658422] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-02T21:45:38.672947] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-09. [2025-10-02T21:45:39.423675] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-02T21:45:39.473029] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-08. [2025-10-02T21:45:40.005517] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-02T21:45:40.273045] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-10. [2025-10-02T21:45:40.866039] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-02T21:45:41.073026] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-09. [2025-10-02T21:45:41.666765] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-02T21:45:41.668962] [INFO ] [REMOTE ] SU: Full fetch complete (77396 records). [2025-10-02T21:45:41.669081] [DEBUG] [VALIDATOR ] SU: Validating primary data. [2025-10-02T21:45:41.886986] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-09. [2025-10-02T21:45:42.105830] [DEBUG] [VALIDATOR ] SU: All expected trading days are present. [2025-10-02T21:45:42.105924] [DEBUG] [VALIDATOR ] SU: Primary data validation passed. [2025-10-02T21:45:42.107345] [INFO ] [MAIN ] SU: Fetched primary data is valid. [2025-10-02T21:45:42.107536] [DEBUG] [LOCAL ] SU: Saving primary data. [2025-10-02T21:45:42.109296] [DEBUG] [LOCAL ] SU: Trimmed 77396 records to 53836 (keeping 200 days of data) [2025-10-02T21:45:42.471182] [DEBUG] [LOCAL ] SU: Primary data saved (53836 records). [2025-10-02T21:45:42.471344] [INFO ] [MAIN ] SU: Full history saved. [2025-10-02T21:45:42.471466] [INFO ] [MAIN ] Update Progress: 2026/2370 symbols completed. SU took 41.7s. Estimated remaining: 48m 30s. Rate: 7.1 symbols/min [2025-10-02T21:45:42.675759] [INFO ] [MAIN ] SUPV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:45:42.675835] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-09. [2025-10-02T21:45:42.721062] [DEBUG] [LOCAL ] SUPV: Loaded 47322 existing records from primary storage. [2025-10-02T21:45:42.721393] [INFO ] [MAIN ] SUPV: Loaded 47322 existing records. [2025-10-02T21:45:42.922700] [WARN ] [MAIN ] SUPV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:45:42.923005] [INFO ] [MAIN ] SUPV: Wiping existing primary data before full refresh. [2025-10-02T21:45:42.923104] [INFO ] [LOCAL ] SUPV: Starting deletion of primary data. [2025-10-02T21:45:42.923350] [DEBUG] [LOCAL ] SUPV: Deleted primary data file. [2025-10-02T21:45:42.923409] [INFO ] [MAIN ] SUPV: Starting full primary refresh. [2025-10-02T21:45:43.323406] [INFO ] [REMOTE ] SUPV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:45:43.370833] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-10-02T21:45:43.473055] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-10. [2025-10-02T21:45:43.596069] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-02T21:45:44.172430] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-02T21:45:44.273019] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-10. [2025-10-02T21:45:45.073007] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-10. [2025-10-02T21:45:45.167313] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-02T21:45:45.169160] [INFO ] [REMOTE ] SUN: Full fetch complete (54929 records). [2025-10-02T21:45:45.169292] [DEBUG] [VALIDATOR ] SUN: Validating primary data. [2025-10-02T21:45:45.292448] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-02T21:45:45.330509] [INFO ] [REMOTE ] STZ: Full fetch complete (75867 records). [2025-10-02T21:45:45.336339] [DEBUG] [VALIDATOR ] STZ: Validating primary data. [2025-10-02T21:45:45.937612] [DEBUG] [VALIDATOR ] SUN: All expected trading days are present. [2025-10-02T21:45:45.907114] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2024-12. [2025-10-02T21:45:45.959166] [DEBUG] [VALIDATOR ] SUN: Primary data validation passed. [2025-10-02T21:45:45.966635] [INFO ] [MAIN ] SUN: Fetched primary data is valid. [2025-10-02T21:45:45.966767] [DEBUG] [LOCAL ] SUN: Saving primary data. [2025-10-02T21:45:46.047262] [DEBUG] [LOCAL ] SUN: Trimmed 54929 records to 37823 (keeping 200 days of data) [2025-10-02T21:45:46.093930] [DEBUG] [VALIDATOR ] STZ: All expected trading days are present. [2025-10-02T21:45:46.094048] [DEBUG] [VALIDATOR ] STZ: Primary data validation passed. [2025-10-02T21:45:46.094911] [INFO ] [MAIN ] STZ: Fetched primary data is valid. [2025-10-02T21:45:46.095003] [DEBUG] [LOCAL ] STZ: Saving primary data. [2025-10-02T21:45:46.098966] [DEBUG] [LOCAL ] STZ: Trimmed 75867 records to 52676 (keeping 200 days of data) [2025-10-02T21:45:46.310388] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-02T21:45:46.317337] [INFO ] [REMOTE ] SUI: Full fetch complete (60899 records). [2025-10-02T21:45:46.318907] [DEBUG] [VALIDATOR ] SUI: Validating primary data. [2025-10-02T21:45:46.809904] [DEBUG] [VALIDATOR ] SUI: All expected trading days are present. [2025-10-02T21:45:46.810553] [DEBUG] [VALIDATOR ] SUI: Primary data validation passed. [2025-10-02T21:45:46.813072] [INFO ] [MAIN ] SUI: Fetched primary data is valid. [2025-10-02T21:45:46.814029] [DEBUG] [LOCAL ] SUI: Saving primary data. [2025-10-02T21:45:46.821591] [DEBUG] [LOCAL ] SUI: Trimmed 60899 records to 42015 (keeping 200 days of data) [2025-10-02T21:45:47.288531] [DEBUG] [LOCAL ] SUN: Primary data saved (37823 records). [2025-10-02T21:45:47.315267] [INFO ] [MAIN ] SUN: Full history saved. [2025-10-02T21:45:47.317022] [INFO ] [MAIN ] Update Progress: 2027/2370 symbols completed. SUN took 31.9s. Estimated remaining: 48m 21s. Rate: 7.1 symbols/min [2025-10-02T21:45:47.616860] [INFO ] [MAIN ] SUZ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:45:47.653671] [DEBUG] [LOCAL ] SUI: Primary data saved (42015 records). [2025-10-02T21:45:47.654691] [INFO ] [MAIN ] SUI: Full history saved. [2025-10-02T21:45:47.657704] [INFO ] [MAIN ] Update Progress: 2028/2370 symbols completed. SUI took 38.6s. Estimated remaining: 48m 11s. Rate: 7.1 symbols/min [2025-10-02T21:45:47.886817] [INFO ] [MAIN ] SVV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:45:47.905782] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-02T21:45:47.906765] [DEBUG] [LOCAL ] SUZ: Loaded 45628 existing records from primary storage. [2025-10-02T21:45:47.917804] [INFO ] [MAIN ] SUZ: Loaded 45628 existing records. [2025-10-02T21:45:47.924333] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-01. [2025-10-02T21:45:47.949340] [DEBUG] [LOCAL ] STZ: Primary data saved (52676 records). [2025-10-02T21:45:48.009621] [INFO ] [MAIN ] STZ: Full history saved. [2025-10-02T21:45:48.015330] [INFO ] [MAIN ] Update Progress: 2029/2370 symbols completed. STZ took 54.3s. Estimated remaining: 48m 1s. Rate: 7.1 symbols/min [2025-10-02T21:45:48.261456] [DEBUG] [LOCAL ] SVV: Loaded 39746 existing records from primary storage. [2025-10-02T21:45:48.273366] [WARN ] [MAIN ] SUZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:45:48.289206] [INFO ] [MAIN ] SUZ: Wiping existing primary data before full refresh. [2025-10-02T21:45:48.289030] [INFO ] [MAIN ] SVV: Loaded 39746 existing records. [2025-10-02T21:45:48.304338] [INFO ] [LOCAL ] SUZ: Starting deletion of primary data. [2025-10-02T21:45:48.405959] [DEBUG] [LOCAL ] SUZ: Deleted primary data file. [2025-10-02T21:45:48.406162] [INFO ] [MAIN ] SUZ: Starting full primary refresh. [2025-10-02T21:45:48.400407] [INFO ] [MAIN ] SW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:45:48.740817] [WARN ] [MAIN ] SVV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:45:48.788415] [INFO ] [MAIN ] SVV: Wiping existing primary data before full refresh. [2025-10-02T21:45:48.806391] [INFO ] [LOCAL ] SVV: Starting deletion of primary data. [2025-10-02T21:45:48.867629] [DEBUG] [LOCAL ] SVV: Deleted primary data file. [2025-10-02T21:45:48.887796] [INFO ] [MAIN ] SVV: Starting full primary refresh. [2025-10-02T21:45:49.061925] [DEBUG] [LOCAL ] SW: Loaded 53162 existing records from primary storage. [2025-10-02T21:45:49.133359] [INFO ] [MAIN ] SW: Loaded 53162 existing records. [2025-10-02T21:45:49.133138] [INFO ] [REMOTE ] SUZ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:45:49.133785] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2024-12. [2025-10-02T21:45:49.600600] [WARN ] [MAIN ] SW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:45:49.624365] [INFO ] [MAIN ] SW: Wiping existing primary data before full refresh. [2025-10-02T21:45:49.623884] [INFO ] [REMOTE ] SVV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:45:49.624804] [INFO ] [REMOTE ] SVV: Fetching primary data for 2024-12. [2025-10-02T21:45:49.624994] [INFO ] [LOCAL ] SW: Starting deletion of primary data. [2025-10-02T21:45:49.626267] [DEBUG] [LOCAL ] SW: Deleted primary data file. [2025-10-02T21:45:49.626328] [INFO ] [MAIN ] SW: Starting full primary refresh. [2025-10-02T21:45:50.045028] [INFO ] [REMOTE ] SW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:45:50.046169] [INFO ] [REMOTE ] SW: Fetching primary data for 2024-12. [2025-10-02T21:45:50.047745] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-02T21:45:50.059553] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-02. [2025-10-02T21:45:50.675184] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-02T21:45:50.683104] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-01. [2025-10-02T21:45:50.831110] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-02T21:45:51.472968] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-01. [2025-10-02T21:45:51.514939] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-02T21:45:51.654302] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-02T21:45:51.835575] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-02T21:45:52.273031] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-02. [2025-10-02T21:45:52.775523] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-02T21:45:53.073048] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-01. [2025-10-02T21:45:53.793247] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-02T21:45:53.873036] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-03. [2025-10-02T21:45:54.672997] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-02. [2025-10-02T21:45:54.901748] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-02T21:45:55.473012] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-02. [2025-10-02T21:45:56.147302] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-02T21:45:56.272999] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-04. [2025-10-02T21:45:56.442636] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-02T21:45:57.072989] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-03. [2025-10-02T21:45:57.249369] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-02T21:45:57.766212] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-02T21:45:57.873009] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-03. [2025-10-02T21:45:58.279954] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-02T21:45:58.673033] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-03. [2025-10-02T21:45:59.465560] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-02T21:45:59.475346] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-05. [2025-10-02T21:46:00.273032] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-04. [2025-10-02T21:46:00.604673] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-02T21:46:01.073016] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-04. [2025-10-02T21:46:01.134064] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-02T21:46:01.873053] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-06. [2025-10-02T21:46:01.924518] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-02T21:46:02.680197] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-05. [2025-10-02T21:46:02.700098] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-02T21:46:03.393051] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-02T21:46:03.472986] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-05. [2025-10-02T21:46:04.177845] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-02T21:46:04.273010] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-06. [2025-10-02T21:46:05.007428] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-02T21:46:05.073004] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-06. [2025-10-02T21:46:05.457201] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-02T21:46:05.873042] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-07. [2025-10-02T21:46:06.534139] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-02T21:46:06.673047] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-07. [2025-10-02T21:46:07.473001] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-07. [2025-10-02T21:46:07.604377] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-02T21:46:08.272998] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-08. [2025-10-02T21:46:08.428561] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-02T21:46:09.073011] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-04. [2025-10-02T21:46:09.518377] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-02T21:46:09.873072] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-08. [2025-10-02T21:46:09.954841] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-02T21:46:10.673037] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-09. [2025-10-02T21:46:11.083390] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-02T21:46:11.473017] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-08. [2025-10-02T21:46:11.608382] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-02T21:46:12.272977] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-09. [2025-10-02T21:46:12.476688] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-02T21:46:12.556914] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-02T21:46:13.072935] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-09. [2025-10-02T21:46:13.807734] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-02T21:46:13.872969] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-05. [2025-10-02T21:46:14.525186] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-02T21:46:14.673009] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-10. [2025-10-02T21:46:15.472969] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-10. [2025-10-02T21:46:15.738864] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-02T21:46:15.951993] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-02T21:46:15.953913] [INFO ] [REMOTE ] SVV: Full fetch complete (56360 records). [2025-10-02T21:46:15.954049] [DEBUG] [VALIDATOR ] SVV: Validating primary data. [2025-10-02T21:46:16.278149] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-10. [2025-10-02T21:46:16.402854] [DEBUG] [VALIDATOR ] SVV: All expected trading days are present. [2025-10-02T21:46:16.402955] [DEBUG] [VALIDATOR ] SVV: Primary data validation passed. [2025-10-02T21:46:16.404057] [INFO ] [MAIN ] SVV: Fetched primary data is valid. [2025-10-02T21:46:16.404133] [DEBUG] [LOCAL ] SVV: Saving primary data. [2025-10-02T21:46:16.405577] [DEBUG] [LOCAL ] SVV: Trimmed 56360 records to 40036 (keeping 200 days of data) [2025-10-02T21:46:16.659160] [DEBUG] [LOCAL ] SVV: Primary data saved (40036 records). [2025-10-02T21:46:16.659286] [INFO ] [MAIN ] SVV: Full history saved. [2025-10-02T21:46:16.659367] [INFO ] [MAIN ] Update Progress: 2030/2370 symbols completed. SVV took 29.0s. Estimated remaining: 47m 56s. Rate: 7.1 symbols/min [2025-10-02T21:46:16.752042] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-02T21:46:16.782780] [INFO ] [REMOTE ] SUZ: Full fetch complete (66772 records). [2025-10-02T21:46:16.786718] [DEBUG] [VALIDATOR ] SUZ: Validating primary data. [2025-10-02T21:46:16.951317] [INFO ] [MAIN ] SWK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:46:17.079199] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-06. [2025-10-02T21:46:17.333234] [DEBUG] [VALIDATOR ] SUZ: All expected trading days are present. [2025-10-02T21:46:17.333365] [DEBUG] [VALIDATOR ] SUZ: Primary data validation passed. [2025-10-02T21:46:17.334786] [INFO ] [MAIN ] SUZ: Fetched primary data is valid. [2025-10-02T21:46:17.336412] [DEBUG] [LOCAL ] SUZ: Saving primary data. [2025-10-02T21:46:17.336280] [DEBUG] [LOCAL ] SWK: Loaded 52406 existing records from primary storage. [2025-10-02T21:46:17.337065] [INFO ] [MAIN ] SWK: Loaded 52406 existing records. [2025-10-02T21:46:17.420436] [DEBUG] [LOCAL ] SUZ: Trimmed 66772 records to 45964 (keeping 200 days of data) [2025-10-02T21:46:17.637868] [WARN ] [MAIN ] SWK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:46:17.639897] [INFO ] [MAIN ] SWK: Wiping existing primary data before full refresh. [2025-10-02T21:46:17.640439] [INFO ] [LOCAL ] SWK: Starting deletion of primary data. [2025-10-02T21:46:17.641635] [DEBUG] [LOCAL ] SWK: Deleted primary data file. [2025-10-02T21:46:17.642357] [INFO ] [MAIN ] SWK: Starting full primary refresh. [2025-10-02T21:46:17.783281] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-02T21:46:17.819476] [INFO ] [REMOTE ] SUPV: Full fetch complete (68388 records). [2025-10-02T21:46:17.831359] [DEBUG] [VALIDATOR ] SUPV: Validating primary data. [2025-10-02T21:46:18.218045] [INFO ] [REMOTE ] SWK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:46:18.223972] [INFO ] [REMOTE ] SWK: Fetching primary data for 2024-12. [2025-10-02T21:46:18.540066] [DEBUG] [VALIDATOR ] SUPV: All expected trading days are present. [2025-10-02T21:46:18.540766] [DEBUG] [VALIDATOR ] SUPV: Primary data validation passed. [2025-10-02T21:46:18.542281] [INFO ] [MAIN ] SUPV: Fetched primary data is valid. [2025-10-02T21:46:18.542368] [DEBUG] [LOCAL ] SUPV: Saving primary data. [2025-10-02T21:46:18.547255] [DEBUG] [LOCAL ] SUPV: Trimmed 68388 records to 47694 (keeping 200 days of data) [2025-10-02T21:46:18.922977] [DEBUG] [LOCAL ] SUZ: Primary data saved (45964 records). [2025-10-02T21:46:18.925301] [INFO ] [MAIN ] SUZ: Full history saved. [2025-10-02T21:46:18.926899] [INFO ] [MAIN ] Update Progress: 2031/2370 symbols completed. SUZ took 31.6s. Estimated remaining: 47m 47s. Rate: 7.1 symbols/min [2025-10-02T21:46:19.100195] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-02T21:46:19.176854] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-07. [2025-10-02T21:46:19.176273] [INFO ] [MAIN ] SWX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:46:19.261936] [DEBUG] [LOCAL ] SWX: Loaded 31005 existing records from primary storage. [2025-10-02T21:46:19.264965] [DEBUG] [LOCAL ] SUPV: Primary data saved (47694 records). [2025-10-02T21:46:19.265111] [INFO ] [MAIN ] SUPV: Full history saved. [2025-10-02T21:46:19.265227] [INFO ] [MAIN ] Update Progress: 2032/2370 symbols completed. SUPV took 36.8s. Estimated remaining: 47m 37s. Rate: 7.1 symbols/min [2025-10-02T21:46:19.300354] [INFO ] [MAIN ] SWX: Loaded 31005 existing records. [2025-10-02T21:46:19.614029] [INFO ] [MAIN ] SWZ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:46:19.647050] [WARN ] [MAIN ] SWX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:46:19.647604] [INFO ] [MAIN ] SWX: Wiping existing primary data before full refresh. [2025-10-02T21:46:19.647682] [INFO ] [LOCAL ] SWX: Starting deletion of primary data. [2025-10-02T21:46:19.647935] [DEBUG] [LOCAL ] SWX: Deleted primary data file. [2025-10-02T21:46:19.647994] [INFO ] [MAIN ] SWX: Starting full primary refresh. [2025-10-02T21:46:19.768566] [DEBUG] [LOCAL ] SWZ: Loaded 6050 existing records from primary storage. [2025-10-02T21:46:19.790072] [INFO ] [MAIN ] SWZ: Loaded 6050 existing records. [2025-10-02T21:46:20.250885] [WARN ] [MAIN ] SWZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:46:20.277935] [INFO ] [REMOTE ] SWX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:46:20.278165] [INFO ] [MAIN ] SWZ: Wiping existing primary data before full refresh. [2025-10-02T21:46:20.278623] [INFO ] [REMOTE ] SWX: Fetching primary data for 2024-12. [2025-10-02T21:46:20.278860] [INFO ] [LOCAL ] SWZ: Starting deletion of primary data. [2025-10-02T21:46:20.279974] [DEBUG] [LOCAL ] SWZ: Deleted primary data file. [2025-10-02T21:46:20.280240] [INFO ] [MAIN ] SWZ: Starting full primary refresh. [2025-10-02T21:46:20.548866] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2024-12 (2.32 seconds). [2025-10-02T21:46:20.608613] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-01. [2025-10-02T21:46:20.724112] [INFO ] [REMOTE ] SWZ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:46:21.060475] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-02T21:46:21.073237] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2024-12. [2025-10-02T21:46:21.479176] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-10-02T21:46:21.577505] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-02T21:46:21.873008] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-08. [2025-10-02T21:46:22.102362] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-02T21:46:22.672985] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-02. [2025-10-02T21:46:23.473006] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-01. [2025-10-02T21:46:23.575670] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-02T21:46:23.954158] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-02T21:46:24.272998] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-02. [2025-10-02T21:46:24.366319] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-02T21:46:24.864587] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-02T21:46:25.073055] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-03. [2025-10-02T21:46:25.678942] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-02T21:46:25.873001] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-03. [2025-10-02T21:46:26.673056] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-04. [2025-10-02T21:46:27.472981] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-01. [2025-10-02T21:46:27.542502] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-02T21:46:27.565908] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-02T21:46:28.272999] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-04. [2025-10-02T21:46:28.808892] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-02T21:46:29.072985] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-09. [2025-10-02T21:46:29.873003] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-02. [2025-10-02T21:46:30.218665] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-02T21:46:30.509317] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-02T21:46:30.673008] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-10. [2025-10-02T21:46:31.108327] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-02T21:46:31.473014] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-05. [2025-10-02T21:46:32.011311] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-02T21:46:32.013835] [INFO ] [REMOTE ] SW: Full fetch complete (76803 records). [2025-10-02T21:46:32.013999] [DEBUG] [VALIDATOR ] SW: Validating primary data. [2025-10-02T21:46:32.278187] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-03. [2025-10-02T21:46:32.455303] [DEBUG] [VALIDATOR ] SW: All expected trading days are present. [2025-10-02T21:46:32.455431] [DEBUG] [VALIDATOR ] SW: Primary data validation passed. [2025-10-02T21:46:32.456975] [INFO ] [MAIN ] SW: Fetched primary data is valid. [2025-10-02T21:46:32.457058] [DEBUG] [LOCAL ] SW: Saving primary data. [2025-10-02T21:46:32.458890] [DEBUG] [LOCAL ] SW: Trimmed 76803 records to 53552 (keeping 200 days of data) [2025-10-02T21:46:32.810780] [DEBUG] [LOCAL ] SW: Primary data saved (53552 records). [2025-10-02T21:46:32.810924] [INFO ] [MAIN ] SW: Full history saved. [2025-10-02T21:46:32.811009] [INFO ] [MAIN ] Update Progress: 2033/2370 symbols completed. SW took 44.8s. Estimated remaining: 47m 29s. Rate: 7.1 symbols/min [2025-10-02T21:46:33.002130] [INFO ] [MAIN ] SXC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:46:33.042122] [DEBUG] [LOCAL ] SXC: Loaded 41433 existing records from primary storage. [2025-10-02T21:46:33.042560] [INFO ] [MAIN ] SXC: Loaded 41433 existing records. [2025-10-02T21:46:33.077509] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-05. [2025-10-02T21:46:33.254022] [WARN ] [MAIN ] SXC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:46:33.254775] [INFO ] [MAIN ] SXC: Wiping existing primary data before full refresh. [2025-10-02T21:46:33.254907] [INFO ] [LOCAL ] SXC: Starting deletion of primary data. [2025-10-02T21:46:33.255362] [DEBUG] [LOCAL ] SXC: Deleted primary data file. [2025-10-02T21:46:33.255429] [INFO ] [MAIN ] SXC: Starting full primary refresh. [2025-10-02T21:46:33.400166] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-02T21:46:33.719089] [INFO ] [REMOTE ] SXC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:46:33.720263] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-02T21:46:33.747313] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-02T21:46:33.873012] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-06. [2025-10-02T21:46:34.366321] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-02T21:46:34.673047] [INFO ] [REMOTE ] SXC: Fetching primary data for 2024-12. [2025-10-02T21:46:35.472994] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-04. [2025-10-02T21:46:36.273040] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-07. [2025-10-02T21:46:36.303960] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-02T21:46:36.856459] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-02T21:46:36.882933] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-02T21:46:37.073018] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-05. [2025-10-02T21:46:37.873007] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-08. [2025-10-02T21:46:38.548353] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-02T21:46:38.567963] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-02T21:46:38.673041] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-09. [2025-10-02T21:46:39.279622] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-02T21:46:39.473016] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-06. [2025-10-02T21:46:40.272997] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-10. [2025-10-02T21:46:40.826711] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-02T21:46:40.827497] [INFO ] [REMOTE ] SWZ: Full fetch complete (8122 records). [2025-10-02T21:46:40.827569] [DEBUG] [VALIDATOR ] SWZ: Validating primary data. [2025-10-02T21:46:41.080617] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-01. [2025-10-02T21:46:41.250860] [DEBUG] [VALIDATOR ] SWZ: All expected trading days are present. [2025-10-02T21:46:41.250946] [DEBUG] [VALIDATOR ] SWZ: Primary data validation passed. [2025-10-02T21:46:41.251214] [INFO ] [MAIN ] SWZ: Fetched primary data is valid. [2025-10-02T21:46:41.251258] [DEBUG] [LOCAL ] SWZ: Saving primary data. [2025-10-02T21:46:41.251726] [DEBUG] [LOCAL ] SWZ: Trimmed 8122 records to 6065 (keeping 200 days of data) [2025-10-02T21:46:41.288301] [DEBUG] [LOCAL ] SWZ: Primary data saved (6065 records). [2025-10-02T21:46:41.288435] [INFO ] [MAIN ] SWZ: Full history saved. [2025-10-02T21:46:41.288527] [INFO ] [MAIN ] Update Progress: 2034/2370 symbols completed. SWZ took 22.0s. Estimated remaining: 47m 21s. Rate: 7.1 symbols/min [2025-10-02T21:46:41.490572] [INFO ] [MAIN ] SXI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:46:41.528802] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-02T21:46:41.552938] [DEBUG] [LOCAL ] SXI: Loaded 11546 existing records from primary storage. [2025-10-02T21:46:41.553327] [INFO ] [MAIN ] SXI: Loaded 11546 existing records. [2025-10-02T21:46:41.808504] [WARN ] [MAIN ] SXI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:46:41.808786] [INFO ] [MAIN ] SXI: Wiping existing primary data before full refresh. [2025-10-02T21:46:41.808853] [INFO ] [LOCAL ] SXI: Starting deletion of primary data. [2025-10-02T21:46:41.809069] [DEBUG] [LOCAL ] SXI: Deleted primary data file. [2025-10-02T21:46:41.809129] [INFO ] [MAIN ] SXI: Starting full primary refresh. [2025-10-02T21:46:41.884326] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-07. [2025-10-02T21:46:42.244994] [INFO ] [REMOTE ] SXI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:46:42.663384] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-02T21:46:42.672947] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-02. [2025-10-02T21:46:43.473036] [INFO ] [REMOTE ] SXI: Fetching primary data for 2024-12. [2025-10-02T21:46:43.908446] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-02T21:46:43.969583] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-02T21:46:43.986929] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-02T21:46:44.273016] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-03. [2025-10-02T21:46:45.073039] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-08. [2025-10-02T21:46:45.872999] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-06. [2025-10-02T21:46:45.914579] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-02T21:46:46.476412] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-02T21:46:46.673033] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-09. [2025-10-02T21:46:47.305174] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-02T21:46:47.473048] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-07. [2025-10-02T21:46:48.273020] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-04. [2025-10-02T21:46:48.497669] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-02T21:46:48.585223] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-02T21:46:49.073063] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-10. [2025-10-02T21:46:49.675044] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-02T21:46:49.873000] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-08. [2025-10-02T21:46:50.470459] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-02T21:46:50.472991] [INFO ] [REMOTE ] SWK: Full fetch complete (75340 records). [2025-10-02T21:46:50.473155] [DEBUG] [VALIDATOR ] SWK: Validating primary data. [2025-10-02T21:46:50.681434] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-01. [2025-10-02T21:46:50.948157] [DEBUG] [VALIDATOR ] SWK: All expected trading days are present. [2025-10-02T21:46:50.948260] [DEBUG] [VALIDATOR ] SWK: Primary data validation passed. [2025-10-02T21:46:50.949424] [INFO ] [MAIN ] SWK: Fetched primary data is valid. [2025-10-02T21:46:50.949498] [DEBUG] [LOCAL ] SWK: Saving primary data. [2025-10-02T21:46:50.951176] [DEBUG] [LOCAL ] SWK: Trimmed 75340 records to 52774 (keeping 200 days of data) [2025-10-02T21:46:51.206872] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-02T21:46:51.333844] [DEBUG] [LOCAL ] SWK: Primary data saved (52774 records). [2025-10-02T21:46:51.333987] [INFO ] [MAIN ] SWK: Full history saved. [2025-10-02T21:46:51.334071] [INFO ] [MAIN ] Update Progress: 2035/2370 symbols completed. SWK took 34.7s. Estimated remaining: 47m 13s. Rate: 7.1 symbols/min [2025-10-02T21:46:51.531161] [INFO ] [MAIN ] SXT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:46:51.477234] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-05. [2025-10-02T21:46:51.532962] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-02T21:46:51.566247] [DEBUG] [LOCAL ] SXT: Loaded 29411 existing records from primary storage. [2025-10-02T21:46:51.566519] [INFO ] [MAIN ] SXT: Loaded 29411 existing records. [2025-10-02T21:46:51.773269] [WARN ] [MAIN ] SXT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:46:51.773515] [INFO ] [MAIN ] SXT: Wiping existing primary data before full refresh. [2025-10-02T21:46:51.773566] [INFO ] [LOCAL ] SXT: Starting deletion of primary data. [2025-10-02T21:46:51.773837] [DEBUG] [LOCAL ] SXT: Deleted primary data file. [2025-10-02T21:46:51.773899] [INFO ] [MAIN ] SXT: Starting full primary refresh. [2025-10-02T21:46:52.176728] [INFO ] [REMOTE ] SXT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:46:52.273000] [INFO ] [REMOTE ] SXT: Fetching primary data for 2024-12. [2025-10-02T21:46:52.821691] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-02T21:46:53.073005] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-06. [2025-10-02T21:46:53.364368] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-02T21:46:53.872999] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-01. [2025-10-02T21:46:54.639416] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-02T21:46:54.672984] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-09. [2025-10-02T21:46:54.973894] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-02T21:46:55.473051] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-07. [2025-10-02T21:46:55.656170] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-02T21:46:56.273045] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-02. [2025-10-02T21:46:57.027018] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-02T21:46:57.073011] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-08. [2025-10-02T21:46:57.321291] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-02T21:46:57.873016] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-10. [2025-10-02T21:46:58.611683] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-02T21:46:58.673022] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-02. [2025-10-02T21:46:58.734228] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-02T21:46:58.735712] [INFO ] [REMOTE ] SWX: Full fetch complete (43942 records). [2025-10-02T21:46:58.735798] [DEBUG] [VALIDATOR ] SWX: Validating primary data. [2025-10-02T21:46:59.162607] [DEBUG] [VALIDATOR ] SWX: All expected trading days are present. [2025-10-02T21:46:59.162723] [DEBUG] [VALIDATOR ] SWX: Primary data validation passed. [2025-10-02T21:46:59.163762] [INFO ] [MAIN ] SWX: Fetched primary data is valid. [2025-10-02T21:46:59.163909] [DEBUG] [LOCAL ] SWX: Saving primary data. [2025-10-02T21:46:59.165028] [DEBUG] [LOCAL ] SWX: Trimmed 43942 records to 31244 (keeping 200 days of data) [2025-10-02T21:46:59.375090] [DEBUG] [LOCAL ] SWX: Primary data saved (31244 records). [2025-10-02T21:46:59.375225] [INFO ] [MAIN ] SWX: Full history saved. [2025-10-02T21:46:59.375309] [INFO ] [MAIN ] Update Progress: 2036/2370 symbols completed. SWX took 40.4s. Estimated remaining: 47m 4s. Rate: 7.1 symbols/min [2025-10-02T21:46:59.477771] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-03. [2025-10-02T21:46:59.577225] [INFO ] [MAIN ] SYF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:46:59.578190] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-02T21:46:59.630388] [DEBUG] [LOCAL ] SYF: Loaded 53442 existing records from primary storage. [2025-10-02T21:46:59.630758] [INFO ] [MAIN ] SYF: Loaded 53442 existing records. [2025-10-02T21:46:59.833359] [WARN ] [MAIN ] SYF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:46:59.833575] [INFO ] [MAIN ] SYF: Wiping existing primary data before full refresh. [2025-10-02T21:46:59.833625] [INFO ] [LOCAL ] SYF: Starting deletion of primary data. [2025-10-02T21:46:59.833893] [DEBUG] [LOCAL ] SYF: Deleted primary data file. [2025-10-02T21:46:59.833953] [INFO ] [MAIN ] SYF: Starting full primary refresh. [2025-10-02T21:47:00.251052] [INFO ] [REMOTE ] SYF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:47:00.272990] [INFO ] [REMOTE ] SYF: Fetching primary data for 2024-12. [2025-10-02T21:47:00.868094] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-02T21:47:01.073013] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-04. [2025-10-02T21:47:01.873060] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-03. [2025-10-02T21:47:02.210156] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-02T21:47:02.262040] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-02T21:47:02.673033] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-05. [2025-10-02T21:47:02.731003] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-02T21:47:03.473009] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-09. [2025-10-02T21:47:03.924514] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-02T21:47:04.273031] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-04. [2025-10-02T21:47:05.072999] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-01. [2025-10-02T21:47:05.245376] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-02T21:47:05.359532] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-02T21:47:05.873001] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-05. [2025-10-02T21:47:06.673063] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-06. [2025-10-02T21:47:06.760922] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-02T21:47:06.838198] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-02T21:47:07.473034] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-10. [2025-10-02T21:47:07.827867] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-02T21:47:08.273001] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-07. [2025-10-02T21:47:08.562553] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-02T21:47:08.564516] [INFO ] [REMOTE ] SXC: Full fetch complete (61180 records). [2025-10-02T21:47:08.564611] [DEBUG] [VALIDATOR ] SXC: Validating primary data. [2025-10-02T21:47:08.989509] [DEBUG] [VALIDATOR ] SXC: All expected trading days are present. [2025-10-02T21:47:08.989607] [DEBUG] [VALIDATOR ] SXC: Primary data validation passed. [2025-10-02T21:47:08.990769] [INFO ] [MAIN ] SXC: Fetched primary data is valid. [2025-10-02T21:47:08.990842] [DEBUG] [LOCAL ] SXC: Saving primary data. [2025-10-02T21:47:08.992547] [DEBUG] [LOCAL ] SXC: Trimmed 61180 records to 41758 (keeping 200 days of data) [2025-10-02T21:47:09.086690] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-02. [2025-10-02T21:47:09.278878] [DEBUG] [LOCAL ] SXC: Primary data saved (41758 records). [2025-10-02T21:47:09.279024] [INFO ] [MAIN ] SXC: Full history saved. [2025-10-02T21:47:09.279111] [INFO ] [MAIN ] Update Progress: 2037/2370 symbols completed. SXC took 36.5s. Estimated remaining: 46m 56s. Rate: 7.1 symbols/min [2025-10-02T21:47:09.651635] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-02T21:47:09.873021] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-06. [2025-10-02T21:47:10.673052] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-08. [2025-10-02T21:47:10.796350] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-02T21:47:10.843046] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-02T21:47:11.473004] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-07. [2025-10-02T21:47:11.673359] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-02T21:47:12.273011] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-09. [2025-10-02T21:47:12.322477] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-02T21:47:13.072991] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-08. [2025-10-02T21:47:13.185849] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-02T21:47:13.742440] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-02T21:47:13.872991] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-09. [2025-10-02T21:47:14.549925] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-02T21:47:14.673030] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-10. [2025-10-02T21:47:15.375496] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-02T21:47:15.376550] [INFO ] [REMOTE ] SXI: Full fetch complete (14914 records). [2025-10-02T21:47:15.376629] [DEBUG] [VALIDATOR ] SXI: Validating primary data. [2025-10-02T21:47:15.480744] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-03. [2025-10-02T21:47:15.795149] [DEBUG] [VALIDATOR ] SXI: All expected trading days are present. [2025-10-02T21:47:15.795270] [DEBUG] [VALIDATOR ] SXI: Primary data validation passed. [2025-10-02T21:47:15.795723] [INFO ] [MAIN ] SXI: Fetched primary data is valid. [2025-10-02T21:47:15.795787] [DEBUG] [LOCAL ] SXI: Saving primary data. [2025-10-02T21:47:15.796427] [DEBUG] [LOCAL ] SXI: Trimmed 14914 records to 11652 (keeping 200 days of data) [2025-10-02T21:47:15.879169] [DEBUG] [LOCAL ] SXI: Primary data saved (11652 records). [2025-10-02T21:47:15.879318] [INFO ] [MAIN ] SXI: Full history saved. [2025-10-02T21:47:15.879407] [INFO ] [MAIN ] Update Progress: 2038/2370 symbols completed. SXI took 34.6s. Estimated remaining: 46m 47s. Rate: 7.1 symbols/min [2025-10-02T21:47:16.273036] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-10. [2025-10-02T21:47:17.492811] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-02T21:47:17.493102] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-02T21:47:17.507950] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-04. [2025-10-02T21:47:17.509324] [INFO ] [REMOTE ] SXT: Full fetch complete (38521 records). [2025-10-02T21:47:17.509522] [DEBUG] [VALIDATOR ] SXT: Validating primary data. [2025-10-02T21:47:17.935237] [DEBUG] [VALIDATOR ] SXT: All expected trading days are present. [2025-10-02T21:47:17.935318] [DEBUG] [VALIDATOR ] SXT: Primary data validation passed. [2025-10-02T21:47:17.936197] [INFO ] [MAIN ] SXT: Fetched primary data is valid. [2025-10-02T21:47:17.936264] [DEBUG] [LOCAL ] SXT: Saving primary data. [2025-10-02T21:47:17.937298] [DEBUG] [LOCAL ] SXT: Trimmed 38521 records to 29691 (keeping 200 days of data) [2025-10-02T21:47:18.132451] [DEBUG] [LOCAL ] SXT: Primary data saved (29691 records). [2025-10-02T21:47:18.132599] [INFO ] [MAIN ] SXT: Full history saved. [2025-10-02T21:47:18.132712] [INFO ] [MAIN ] Update Progress: 2039/2370 symbols completed. SXT took 26.8s. Estimated remaining: 46m 38s. Rate: 7.1 symbols/min [2025-10-02T21:47:19.353918] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-02T21:47:19.366054] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-05. [2025-10-02T21:47:21.240348] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-02T21:47:21.253118] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-06. [2025-10-02T21:47:22.924429] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-02T21:47:22.935724] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-07. [2025-10-02T21:47:25.099119] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-02T21:47:25.111381] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-08. [2025-10-02T21:47:26.986625] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-02T21:47:26.998346] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-09. [2025-10-02T21:47:28.827216] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-02T21:47:28.839007] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-10. [2025-10-02T21:47:30.228667] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-02T21:47:30.230940] [INFO ] [REMOTE ] SYF: Full fetch complete (77327 records). [2025-10-02T21:47:30.231069] [DEBUG] [VALIDATOR ] SYF: Validating primary data. [2025-10-02T21:47:30.676725] [DEBUG] [VALIDATOR ] SYF: All expected trading days are present. [2025-10-02T21:47:30.676858] [DEBUG] [VALIDATOR ] SYF: Primary data validation passed. [2025-10-02T21:47:30.678200] [INFO ] [MAIN ] SYF: Fetched primary data is valid. [2025-10-02T21:47:30.678273] [DEBUG] [LOCAL ] SYF: Saving primary data. [2025-10-02T21:47:30.680030] [DEBUG] [LOCAL ] SYF: Trimmed 77327 records to 53832 (keeping 200 days of data) [2025-10-02T21:47:31.031119] [DEBUG] [LOCAL ] SYF: Primary data saved (53832 records). [2025-10-02T21:47:31.031263] [INFO ] [MAIN ] SYF: Full history saved. [2025-10-02T21:47:31.032021] [INFO ] [MAIN ] Update Progress: 2040/2370 symbols completed. SYF took 31.7s. Estimated remaining: 46m 30s. Rate: 7.1 symbols/min [2025-10-02T21:47:31.672249] [INFO ] [MAIN ] T: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:47:31.805768] [INFO ] [MAIN ] SYY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:47:31.829549] [INFO ] [MAIN ] SYK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:47:31.831633] [INFO ] [MAIN ] TAC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:47:31.935522] [DEBUG] [LOCAL ] T: Loaded 53798 existing records from primary storage. [2025-10-02T21:47:31.936952] [DEBUG] [LOCAL ] TAC: Loaded 42555 existing records from primary storage. [2025-10-02T21:47:31.950893] [INFO ] [MAIN ] T: Loaded 53798 existing records. [2025-10-02T21:47:31.990362] [DEBUG] [LOCAL ] SYK: Loaded 46895 existing records from primary storage. [2025-10-02T21:47:32.007322] [INFO ] [MAIN ] TAC: Loaded 42555 existing records. [2025-10-02T21:47:32.029478] [INFO ] [MAIN ] SYK: Loaded 46895 existing records. [2025-10-02T21:47:32.018927] [DEBUG] [LOCAL ] SYY: Loaded 53221 existing records from primary storage. [2025-10-02T21:47:32.103833] [INFO ] [MAIN ] SYY: Loaded 53221 existing records. [2025-10-02T21:47:32.678208] [WARN ] [MAIN ] T: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:47:32.743097] [WARN ] [MAIN ] SYK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:47:32.750301] [INFO ] [MAIN ] T: Wiping existing primary data before full refresh. [2025-10-02T21:47:32.775533] [INFO ] [MAIN ] SYK: Wiping existing primary data before full refresh. [2025-10-02T21:47:32.759998] [INFO ] [LOCAL ] T: Starting deletion of primary data. [2025-10-02T21:47:32.782046] [WARN ] [MAIN ] TAC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:47:32.792432] [INFO ] [MAIN ] TAC: Wiping existing primary data before full refresh. [2025-10-02T21:47:32.794943] [INFO ] [LOCAL ] TAC: Starting deletion of primary data. [2025-10-02T21:47:32.820381] [DEBUG] [LOCAL ] TAC: Deleted primary data file. [2025-10-02T21:47:32.820119] [WARN ] [MAIN ] SYY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:47:32.820546] [INFO ] [MAIN ] TAC: Starting full primary refresh. [2025-10-02T21:47:32.820966] [DEBUG] [LOCAL ] T: Deleted primary data file. [2025-10-02T21:47:32.821195] [INFO ] [MAIN ] T: Starting full primary refresh. [2025-10-02T21:47:32.820259] [INFO ] [LOCAL ] SYK: Starting deletion of primary data. [2025-10-02T21:47:32.821557] [INFO ] [MAIN ] SYY: Wiping existing primary data before full refresh. [2025-10-02T21:47:32.857031] [DEBUG] [LOCAL ] SYK: Deleted primary data file. [2025-10-02T21:47:32.864333] [INFO ] [MAIN ] SYK: Starting full primary refresh. [2025-10-02T21:47:32.933118] [INFO ] [LOCAL ] SYY: Starting deletion of primary data. [2025-10-02T21:47:33.108981] [DEBUG] [LOCAL ] SYY: Deleted primary data file. [2025-10-02T21:47:33.124627] [INFO ] [MAIN ] SYY: Starting full primary refresh. [2025-10-02T21:47:34.229500] [INFO ] [REMOTE ] TAC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:47:34.297583] [INFO ] [REMOTE ] TAC: Fetching primary data for 2024-12. [2025-10-02T21:47:34.366854] [INFO ] [REMOTE ] SYK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:47:34.434461] [INFO ] [REMOTE ] SYK: Fetching primary data for 2024-12. [2025-10-02T21:47:34.480410] [INFO ] [REMOTE ] T: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:47:34.497418] [INFO ] [REMOTE ] T: Fetching primary data for 2024-12. [2025-10-02T21:47:34.505556] [INFO ] [REMOTE ] SYY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:47:34.505932] [INFO ] [REMOTE ] SYY: Fetching primary data for 2024-12. [2025-10-02T21:47:36.100632] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-02T21:47:36.110888] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-01. [2025-10-02T21:47:36.265732] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-02T21:47:36.277228] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-01. [2025-10-02T21:47:37.228840] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2024-12 (2.79 seconds). [2025-10-02T21:47:37.239478] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-01. [2025-10-02T21:47:37.748175] [INFO ] [REMOTE ] T: Incremental fetch complete for 2024-12 (3.25 seconds). [2025-10-02T21:47:37.759524] [INFO ] [REMOTE ] T: Fetching primary data for 2025-01. [2025-10-02T21:47:38.074915] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-02T21:47:38.085454] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-02. [2025-10-02T21:47:38.144618] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-02T21:47:38.156312] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-02. [2025-10-02T21:47:39.038514] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-02T21:47:39.049734] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-02. [2025-10-02T21:47:39.693276] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-02T21:47:39.703327] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-03. [2025-10-02T21:47:39.853178] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-02T21:47:39.863982] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-03. [2025-10-02T21:47:40.102273] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-10-02T21:47:40.114269] [INFO ] [REMOTE ] T: Fetching primary data for 2025-02. [2025-10-02T21:47:40.346931] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-02T21:47:40.357033] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-03. [2025-10-02T21:47:40.969179] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-02T21:47:40.979297] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-04. [2025-10-02T21:47:41.644038] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-02T21:47:41.661984] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-04. [2025-10-02T21:47:42.515886] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-02 (2.40 seconds). [2025-10-02T21:47:42.527284] [INFO ] [REMOTE ] T: Fetching primary data for 2025-03. [2025-10-02T21:47:42.558896] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-02T21:47:42.570491] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-04. [2025-10-02T21:47:42.876564] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-02T21:47:42.886720] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-05. [2025-10-02T21:47:43.398761] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-02T21:47:43.410456] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-05. [2025-10-02T21:47:44.015308] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-02T21:47:44.025399] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-06. [2025-10-02T21:47:44.492356] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-02T21:47:44.504192] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-05. [2025-10-02T21:47:44.581909] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-02T21:47:44.594174] [INFO ] [REMOTE ] T: Fetching primary data for 2025-04. [2025-10-02T21:47:45.327474] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-02T21:47:45.339607] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-06. [2025-10-02T21:47:45.626305] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-02T21:47:45.636680] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-07. [2025-10-02T21:47:46.318678] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-02T21:47:46.329144] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-06. [2025-10-02T21:47:47.147923] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-02T21:47:47.159949] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-07. [2025-10-02T21:47:47.198864] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-04 (2.60 seconds). [2025-10-02T21:47:47.212395] [INFO ] [REMOTE ] T: Fetching primary data for 2025-05. [2025-10-02T21:47:47.241609] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-02T21:47:47.252286] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-08. [2025-10-02T21:47:48.025550] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-02T21:47:48.035466] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-07. [2025-10-02T21:47:48.767749] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-02T21:47:48.812962] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-02T21:47:48.811269] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-09. [2025-10-02T21:47:48.826152] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-08. [2025-10-02T21:47:49.571478] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-02T21:47:49.582823] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-08. [2025-10-02T21:47:49.650509] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-10-02T21:47:49.873002] [INFO ] [REMOTE ] T: Fetching primary data for 2025-06. [2025-10-02T21:47:50.428317] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-02T21:47:50.513670] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-02T21:47:50.673027] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-09. [2025-10-02T21:47:50.858085] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-02T21:47:51.473035] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-10. [2025-10-02T21:47:52.241140] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-10-02T21:47:52.272982] [INFO ] [REMOTE ] T: Fetching primary data for 2025-07. [2025-10-02T21:47:52.447078] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-02T21:47:52.625234] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-02T21:47:52.627105] [INFO ] [REMOTE ] TAC: Full fetch complete (63939 records). [2025-10-02T21:47:52.627194] [DEBUG] [VALIDATOR ] TAC: Validating primary data. [2025-10-02T21:47:53.075727] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-10. [2025-10-02T21:47:53.075988] [DEBUG] [VALIDATOR ] TAC: All expected trading days are present. [2025-10-02T21:47:53.076830] [DEBUG] [VALIDATOR ] TAC: Primary data validation passed. [2025-10-02T21:47:53.077924] [INFO ] [MAIN ] TAC: Fetched primary data is valid. [2025-10-02T21:47:53.078120] [DEBUG] [LOCAL ] TAC: Saving primary data. [2025-10-02T21:47:53.079911] [DEBUG] [LOCAL ] TAC: Trimmed 63939 records to 42891 (keeping 200 days of data) [2025-10-02T21:47:53.351816] [DEBUG] [LOCAL ] TAC: Primary data saved (42891 records). [2025-10-02T21:47:53.351947] [INFO ] [MAIN ] TAC: Full history saved. [2025-10-02T21:47:53.353069] [INFO ] [MAIN ] Update Progress: 2041/2370 symbols completed. TAC took 22.3s. Estimated remaining: 46m 24s. Rate: 7.1 symbols/min [2025-10-02T21:47:53.537077] [INFO ] [MAIN ] TAK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:47:53.588198] [DEBUG] [LOCAL ] TAK: Loaded 49821 existing records from primary storage. [2025-10-02T21:47:53.588547] [INFO ] [MAIN ] TAK: Loaded 49821 existing records. [2025-10-02T21:47:53.787150] [WARN ] [MAIN ] TAK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:47:53.787394] [INFO ] [MAIN ] TAK: Wiping existing primary data before full refresh. [2025-10-02T21:47:53.787444] [INFO ] [LOCAL ] TAK: Starting deletion of primary data. [2025-10-02T21:47:53.787718] [DEBUG] [LOCAL ] TAK: Deleted primary data file. [2025-10-02T21:47:53.787778] [INFO ] [MAIN ] TAK: Starting full primary refresh. [2025-10-02T21:47:53.888378] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-09. [2025-10-02T21:47:54.209852] [INFO ] [REMOTE ] TAK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:47:54.515386] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-02T21:47:54.519952] [INFO ] [REMOTE ] SYY: Full fetch complete (76969 records). [2025-10-02T21:47:54.520202] [DEBUG] [VALIDATOR ] SYY: Validating primary data. [2025-10-02T21:47:54.680896] [INFO ] [REMOTE ] TAK: Fetching primary data for 2024-12. [2025-10-02T21:47:55.192166] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-07 (2.92 seconds). [2025-10-02T21:47:55.202878] [DEBUG] [VALIDATOR ] SYY: All expected trading days are present. [2025-10-02T21:47:55.208737] [DEBUG] [VALIDATOR ] SYY: Primary data validation passed. [2025-10-02T21:47:55.210391] [INFO ] [MAIN ] SYY: Fetched primary data is valid. [2025-10-02T21:47:55.210568] [DEBUG] [LOCAL ] SYY: Saving primary data. [2025-10-02T21:47:55.212979] [DEBUG] [LOCAL ] SYY: Trimmed 76969 records to 53608 (keeping 200 days of data) [2025-10-02T21:47:55.366247] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-02T21:47:55.488043] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-10. [2025-10-02T21:47:55.616385] [DEBUG] [LOCAL ] SYY: Primary data saved (53608 records). [2025-10-02T21:47:55.616529] [INFO ] [MAIN ] SYY: Full history saved. [2025-10-02T21:47:55.616615] [INFO ] [MAIN ] Update Progress: 2042/2370 symbols completed. SYY took 24.6s. Estimated remaining: 46m 14s. Rate: 7.1 symbols/min [2025-10-02T21:47:55.805243] [INFO ] [MAIN ] TAL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:47:55.859488] [DEBUG] [LOCAL ] TAL: Loaded 51940 existing records from primary storage. [2025-10-02T21:47:55.859844] [INFO ] [MAIN ] TAL: Loaded 51940 existing records. [2025-10-02T21:47:56.065174] [WARN ] [MAIN ] TAL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:47:56.065540] [INFO ] [MAIN ] TAL: Wiping existing primary data before full refresh. [2025-10-02T21:47:56.065590] [INFO ] [LOCAL ] TAL: Starting deletion of primary data. [2025-10-02T21:47:56.065896] [DEBUG] [LOCAL ] TAL: Deleted primary data file. [2025-10-02T21:47:56.065955] [INFO ] [MAIN ] TAL: Starting full primary refresh. [2025-10-02T21:47:56.276085] [INFO ] [REMOTE ] T: Fetching primary data for 2025-08. [2025-10-02T21:47:56.476889] [INFO ] [REMOTE ] TAL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:47:56.507375] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-02T21:47:56.539394] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-02T21:47:56.541635] [INFO ] [REMOTE ] SYK: Full fetch complete (68850 records). [2025-10-02T21:47:56.541830] [DEBUG] [VALIDATOR ] SYK: Validating primary data. [2025-10-02T21:47:56.961095] [DEBUG] [VALIDATOR ] SYK: All expected trading days are present. [2025-10-02T21:47:56.961214] [DEBUG] [VALIDATOR ] SYK: Primary data validation passed. [2025-10-02T21:47:56.963454] [INFO ] [MAIN ] SYK: Fetched primary data is valid. [2025-10-02T21:47:56.963562] [DEBUG] [LOCAL ] SYK: Saving primary data. [2025-10-02T21:47:56.968596] [DEBUG] [LOCAL ] SYK: Trimmed 68850 records to 47253 (keeping 200 days of data) [2025-10-02T21:47:57.073511] [INFO ] [REMOTE ] TAL: Fetching primary data for 2024-12. [2025-10-02T21:47:57.301488] [DEBUG] [LOCAL ] SYK: Primary data saved (47253 records). [2025-10-02T21:47:57.301722] [INFO ] [MAIN ] SYK: Full history saved. [2025-10-02T21:47:57.301934] [INFO ] [MAIN ] Update Progress: 2043/2370 symbols completed. SYK took 26.3s. Estimated remaining: 46m 5s. Rate: 7.1 symbols/min [2025-10-02T21:47:57.491971] [INFO ] [MAIN ] TALO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:47:57.553851] [DEBUG] [LOCAL ] TALO: Loaded 50794 existing records from primary storage. [2025-10-02T21:47:57.554317] [INFO ] [MAIN ] TALO: Loaded 50794 existing records. [2025-10-02T21:47:57.737944] [WARN ] [MAIN ] TALO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:47:57.738308] [INFO ] [MAIN ] TALO: Wiping existing primary data before full refresh. [2025-10-02T21:47:57.738362] [INFO ] [LOCAL ] TALO: Starting deletion of primary data. [2025-10-02T21:47:57.738630] [DEBUG] [LOCAL ] TALO: Deleted primary data file. [2025-10-02T21:47:57.738743] [INFO ] [MAIN ] TALO: Starting full primary refresh. [2025-10-02T21:47:57.878331] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-01. [2025-10-02T21:47:58.110629] [INFO ] [REMOTE ] TALO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:47:58.673114] [INFO ] [REMOTE ] TALO: Fetching primary data for 2024-12. [2025-10-02T21:47:58.751507] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-08 (2.48 seconds). [2025-10-02T21:47:58.825249] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-02T21:47:59.473027] [INFO ] [REMOTE ] T: Fetching primary data for 2025-09. [2025-10-02T21:47:59.719176] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-02T21:48:00.273807] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-02. [2025-10-02T21:48:00.276855] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-02T21:48:01.073005] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-01. [2025-10-02T21:48:01.880484] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-01. [2025-10-02T21:48:01.887862] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-10-02T21:48:02.673062] [INFO ] [REMOTE ] T: Fetching primary data for 2025-10. [2025-10-02T21:48:02.705884] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-02T21:48:02.748983] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-02 (2.48 seconds). [2025-10-02T21:48:03.445711] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-02T21:48:03.473005] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-02. [2025-10-02T21:48:04.273018] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-02. [2025-10-02T21:48:04.625446] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-02T21:48:04.628787] [INFO ] [REMOTE ] T: Full fetch complete (77935 records). [2025-10-02T21:48:04.628927] [DEBUG] [VALIDATOR ] T: Validating primary data. [2025-10-02T21:48:05.062898] [DEBUG] [VALIDATOR ] T: All expected trading days are present. [2025-10-02T21:48:05.063039] [DEBUG] [VALIDATOR ] T: Primary data validation passed. [2025-10-02T21:48:05.064386] [INFO ] [MAIN ] T: Fetched primary data is valid. [2025-10-02T21:48:05.064509] [DEBUG] [LOCAL ] T: Saving primary data. [2025-10-02T21:48:05.066880] [DEBUG] [LOCAL ] T: Trimmed 77935 records to 54188 (keeping 200 days of data) [2025-10-02T21:48:05.072999] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-03. [2025-10-02T21:48:05.204787] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-02T21:48:05.472423] [DEBUG] [LOCAL ] T: Primary data saved (54188 records). [2025-10-02T21:48:05.472603] [INFO ] [MAIN ] T: Full history saved. [2025-10-02T21:48:05.472745] [INFO ] [MAIN ] Update Progress: 2044/2370 symbols completed. T took 34.4s. Estimated remaining: 45m 56s. Rate: 7.1 symbols/min [2025-10-02T21:48:05.664268] [INFO ] [MAIN ] TAP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:48:05.717858] [DEBUG] [LOCAL ] TAP: Loaded 52899 existing records from primary storage. [2025-10-02T21:48:05.718396] [INFO ] [MAIN ] TAP: Loaded 52899 existing records. [2025-10-02T21:48:05.873001] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-03. [2025-10-02T21:48:05.875770] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-02T21:48:05.983578] [WARN ] [MAIN ] TAP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:48:05.983819] [INFO ] [MAIN ] TAP: Wiping existing primary data before full refresh. [2025-10-02T21:48:05.983903] [INFO ] [LOCAL ] TAP: Starting deletion of primary data. [2025-10-02T21:48:05.984355] [DEBUG] [LOCAL ] TAP: Deleted primary data file. [2025-10-02T21:48:05.984446] [INFO ] [MAIN ] TAP: Starting full primary refresh. [2025-10-02T21:48:06.364902] [INFO ] [REMOTE ] TAP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:48:06.673043] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-03. [2025-10-02T21:48:06.821941] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-02T21:48:07.472984] [INFO ] [REMOTE ] TAP: Fetching primary data for 2024-12. [2025-10-02T21:48:07.580032] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-02T21:48:08.273006] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-04. [2025-10-02T21:48:08.569085] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-02T21:48:08.741510] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-02T21:48:09.073001] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-04. [2025-10-02T21:48:09.872972] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-01. [2025-10-02T21:48:10.078592] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-02T21:48:10.673013] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-05. [2025-10-02T21:48:10.803691] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-02T21:48:11.428091] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-02T21:48:11.473010] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-05. [2025-10-02T21:48:11.932538] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-02T21:48:12.273021] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-02. [2025-10-02T21:48:13.073037] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-06. [2025-10-02T21:48:13.766332] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-10-02T21:48:13.873028] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-04. [2025-10-02T21:48:14.241177] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-02T21:48:14.384872] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-02T21:48:14.672998] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-06. [2025-10-02T21:48:15.473002] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-07. [2025-10-02T21:48:15.785237] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-02T21:48:16.062788] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-02T21:48:16.273000] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-07. [2025-10-02T21:48:16.882190] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-02T21:48:17.073012] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-03. [2025-10-02T21:48:17.873017] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-08. [2025-10-02T21:48:18.001302] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-02T21:48:18.673032] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-05. [2025-10-02T21:48:18.907887] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-02T21:48:19.466574] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-02T21:48:19.477785] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-08. [2025-10-02T21:48:20.104266] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-02T21:48:20.272929] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-04. [2025-10-02T21:48:21.072978] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-06. [2025-10-02T21:48:21.295577] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-02T21:48:21.873003] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-09. [2025-10-02T21:48:22.205617] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-02T21:48:22.401484] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-02T21:48:22.673004] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-07. [2025-10-02T21:48:23.200894] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-02T21:48:23.473007] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-09. [2025-10-02T21:48:24.161534] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-02T21:48:24.273024] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-08. [2025-10-02T21:48:25.078123] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-05. [2025-10-02T21:48:25.108684] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-02T21:48:25.873031] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-10. [2025-10-02T21:48:26.056033] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-02T21:48:26.673078] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-09. [2025-10-02T21:48:26.941844] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-02T21:48:26.944026] [INFO ] [REMOTE ] TAK: Full fetch complete (71603 records). [2025-10-02T21:48:26.944165] [DEBUG] [VALIDATOR ] TAK: Validating primary data. [2025-10-02T21:48:27.396440] [DEBUG] [VALIDATOR ] TAK: All expected trading days are present. [2025-10-02T21:48:27.396586] [DEBUG] [VALIDATOR ] TAK: Primary data validation passed. [2025-10-02T21:48:27.397941] [INFO ] [MAIN ] TAK: Fetched primary data is valid. [2025-10-02T21:48:27.398083] [DEBUG] [LOCAL ] TAK: Saving primary data. [2025-10-02T21:48:27.399783] [DEBUG] [LOCAL ] TAK: Trimmed 71603 records to 50184 (keeping 200 days of data) [2025-10-02T21:48:27.492129] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-10. [2025-10-02T21:48:27.543674] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-05 (2.47 seconds). [2025-10-02T21:48:27.771661] [DEBUG] [LOCAL ] TAK: Primary data saved (50184 records). [2025-10-02T21:48:27.771821] [INFO ] [MAIN ] TAK: Full history saved. [2025-10-02T21:48:27.772958] [INFO ] [MAIN ] Update Progress: 2045/2370 symbols completed. TAK took 34.4s. Estimated remaining: 45m 50s. Rate: 7.1 symbols/min [2025-10-02T21:48:27.960354] [INFO ] [MAIN ] TBB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:48:27.975680] [DEBUG] [LOCAL ] TBB: Loaded 11716 existing records from primary storage. [2025-10-02T21:48:27.975950] [INFO ] [MAIN ] TBB: Loaded 11716 existing records. [2025-10-02T21:48:28.169912] [WARN ] [MAIN ] TBB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:48:28.170207] [INFO ] [MAIN ] TBB: Wiping existing primary data before full refresh. [2025-10-02T21:48:28.170353] [INFO ] [LOCAL ] TBB: Starting deletion of primary data. [2025-10-02T21:48:28.170683] [DEBUG] [LOCAL ] TBB: Deleted primary data file. [2025-10-02T21:48:28.170743] [INFO ] [MAIN ] TBB: Starting full primary refresh. [2025-10-02T21:48:28.274029] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-06. [2025-10-02T21:48:28.551084] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-02T21:48:28.636555] [INFO ] [REMOTE ] TBB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:48:29.026546] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-02T21:48:29.030398] [INFO ] [REMOTE ] TALO: Full fetch complete (73298 records). [2025-10-02T21:48:29.030551] [DEBUG] [VALIDATOR ] TALO: Validating primary data. [2025-10-02T21:48:29.078727] [INFO ] [REMOTE ] TBB: Fetching primary data for 2024-12. [2025-10-02T21:48:29.454208] [DEBUG] [VALIDATOR ] TALO: All expected trading days are present. [2025-10-02T21:48:29.454290] [DEBUG] [VALIDATOR ] TALO: Primary data validation passed. [2025-10-02T21:48:29.455542] [INFO ] [MAIN ] TALO: Fetched primary data is valid. [2025-10-02T21:48:29.455611] [DEBUG] [LOCAL ] TALO: Saving primary data. [2025-10-02T21:48:29.457281] [DEBUG] [LOCAL ] TALO: Trimmed 73298 records to 51156 (keeping 200 days of data) [2025-10-02T21:48:29.773254] [DEBUG] [LOCAL ] TALO: Primary data saved (51156 records). [2025-10-02T21:48:29.773398] [INFO ] [MAIN ] TALO: Full history saved. [2025-10-02T21:48:29.773487] [INFO ] [MAIN ] Update Progress: 2046/2370 symbols completed. TALO took 32.5s. Estimated remaining: 45m 41s. Rate: 7.1 symbols/min [2025-10-02T21:48:29.874203] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-10. [2025-10-02T21:48:29.965465] [INFO ] [MAIN ] TBBB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:48:30.001709] [DEBUG] [LOCAL ] TBBB: Loaded 35666 existing records from primary storage. [2025-10-02T21:48:30.002002] [INFO ] [MAIN ] TBBB: Loaded 35666 existing records. [2025-10-02T21:48:30.211926] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-02T21:48:30.245789] [WARN ] [MAIN ] TBBB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:48:30.255538] [INFO ] [MAIN ] TBBB: Wiping existing primary data before full refresh. [2025-10-02T21:48:30.255983] [INFO ] [LOCAL ] TBBB: Starting deletion of primary data. [2025-10-02T21:48:30.257495] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-02T21:48:30.268867] [DEBUG] [LOCAL ] TBBB: Deleted primary data file. [2025-10-02T21:48:30.269448] [INFO ] [MAIN ] TBBB: Starting full primary refresh. [2025-10-02T21:48:30.674859] [INFO ] [REMOTE ] TBBB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:48:30.674976] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-01. [2025-10-02T21:48:31.094166] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-02T21:48:31.096478] [INFO ] [REMOTE ] TAL: Full fetch complete (75558 records). [2025-10-02T21:48:31.096877] [DEBUG] [VALIDATOR ] TAL: Validating primary data. [2025-10-02T21:48:31.473099] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-07. [2025-10-02T21:48:31.533088] [DEBUG] [VALIDATOR ] TAL: All expected trading days are present. [2025-10-02T21:48:31.533198] [DEBUG] [VALIDATOR ] TAL: Primary data validation passed. [2025-10-02T21:48:31.534698] [INFO ] [MAIN ] TAL: Fetched primary data is valid. [2025-10-02T21:48:31.534897] [DEBUG] [LOCAL ] TAL: Saving primary data. [2025-10-02T21:48:31.538311] [DEBUG] [LOCAL ] TAL: Trimmed 75558 records to 52324 (keeping 200 days of data) [2025-10-02T21:48:31.646338] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-02T21:48:31.890681] [DEBUG] [LOCAL ] TAL: Primary data saved (52324 records). [2025-10-02T21:48:31.890829] [INFO ] [MAIN ] TAL: Full history saved. [2025-10-02T21:48:31.890913] [INFO ] [MAIN ] Update Progress: 2047/2370 symbols completed. TAL took 36.3s. Estimated remaining: 45m 31s. Rate: 7.1 symbols/min [2025-10-02T21:48:32.076572] [INFO ] [MAIN ] TBI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:48:32.100086] [DEBUG] [LOCAL ] TBI: Loaded 22542 existing records from primary storage. [2025-10-02T21:48:32.100400] [INFO ] [MAIN ] TBI: Loaded 22542 existing records. [2025-10-02T21:48:32.285863] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-02. [2025-10-02T21:48:32.292552] [WARN ] [MAIN ] TBI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:48:32.294009] [INFO ] [MAIN ] TBI: Wiping existing primary data before full refresh. [2025-10-02T21:48:32.294085] [INFO ] [LOCAL ] TBI: Starting deletion of primary data. [2025-10-02T21:48:32.294366] [DEBUG] [LOCAL ] TBI: Deleted primary data file. [2025-10-02T21:48:32.294428] [INFO ] [MAIN ] TBI: Starting full primary refresh. [2025-10-02T21:48:32.686550] [INFO ] [REMOTE ] TBI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:48:33.072989] [INFO ] [REMOTE ] TBI: Fetching primary data for 2024-12. [2025-10-02T21:48:33.160018] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-02T21:48:33.362410] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-02T21:48:33.873015] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2024-12. [2025-10-02T21:48:33.916230] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-02T21:48:34.673046] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-03. [2025-10-02T21:48:35.335865] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-02T21:48:35.472974] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-01. [2025-10-02T21:48:35.561793] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-02T21:48:36.273011] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-01. [2025-10-02T21:48:36.441894] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-02T21:48:37.073034] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-02. [2025-10-02T21:48:37.465683] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-02T21:48:37.817096] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-02T21:48:37.873004] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-03. [2025-10-02T21:48:38.673017] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-04. [2025-10-02T21:48:38.976556] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-02T21:48:39.473027] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-08. [2025-10-02T21:48:39.554597] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-02T21:48:40.273048] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-04. [2025-10-02T21:48:41.072996] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-05. [2025-10-02T21:48:41.440254] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-02T21:48:41.872986] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-05. [2025-10-02T21:48:41.927609] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-02T21:48:42.673047] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-02. [2025-10-02T21:48:43.275533] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-02T21:48:43.473006] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-06. [2025-10-02T21:48:44.119523] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-02T21:48:44.273004] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-03. [2025-10-02T21:48:45.073053] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-06. [2025-10-02T21:48:45.335007] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-08 (5.86 seconds). [2025-10-02T21:48:45.759666] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-02T21:48:45.829728] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-10-02T21:48:45.873010] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-04. [2025-10-02T21:48:46.288996] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-02T21:48:46.673026] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-09. [2025-10-02T21:48:47.480550] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-07. [2025-10-02T21:48:47.487631] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-02T21:48:48.272982] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-07. [2025-10-02T21:48:48.306335] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-02T21:48:48.369333] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-02T21:48:49.072962] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-05. [2025-10-02T21:48:49.411201] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-02T21:48:49.873011] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-08. [2025-10-02T21:48:50.256021] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-02T21:48:50.659631] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-02T21:48:50.672944] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-09. [2025-10-02T21:48:51.475294] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-08. [2025-10-02T21:48:51.480735] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-02T21:48:52.272971] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-06. [2025-10-02T21:48:53.045331] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-02T21:48:53.073020] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-10. [2025-10-02T21:48:53.847680] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-02T21:48:53.872997] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-07. [2025-10-02T21:48:54.401614] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-02T21:48:54.406427] [INFO ] [REMOTE ] TAP: Full fetch complete (76156 records). [2025-10-02T21:48:54.406553] [DEBUG] [VALIDATOR ] TAP: Validating primary data. [2025-10-02T21:48:54.683084] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-09. [2025-10-02T21:48:54.829208] [DEBUG] [VALIDATOR ] TAP: All expected trading days are present. [2025-10-02T21:48:54.829335] [DEBUG] [VALIDATOR ] TAP: Primary data validation passed. [2025-10-02T21:48:54.830685] [INFO ] [MAIN ] TAP: Fetched primary data is valid. [2025-10-02T21:48:54.830760] [DEBUG] [LOCAL ] TAP: Saving primary data. [2025-10-02T21:48:54.832441] [DEBUG] [LOCAL ] TAP: Trimmed 76156 records to 53281 (keeping 200 days of data) [2025-10-02T21:48:55.183940] [DEBUG] [LOCAL ] TAP: Primary data saved (53281 records). [2025-10-02T21:48:55.184086] [INFO ] [MAIN ] TAP: Full history saved. [2025-10-02T21:48:55.184173] [INFO ] [MAIN ] Update Progress: 2048/2370 symbols completed. TAP took 49.7s. Estimated remaining: 45m 25s. Rate: 7.1 symbols/min [2025-10-02T21:48:55.377751] [INFO ] [MAIN ] TBLU: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:48:55.378247] [DEBUG] [LOCAL ] TBLU: No existing data file found in primary storage. [2025-10-02T21:48:55.378539] [WARN ] [MAIN ] TBLU: No existing data found, performing full refresh instead. [2025-10-02T21:48:55.379276] [INFO ] [MAIN ] TBLU: Wiping existing primary data before full refresh. [2025-10-02T21:48:55.379464] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-10-02T21:48:55.379546] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-10-02T21:48:55.379593] [INFO ] [MAIN ] TBLU: Starting full primary refresh. [2025-10-02T21:48:55.480254] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-10. [2025-10-02T21:48:55.551252] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-02T21:48:55.558267] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-02T21:48:55.851093] [INFO ] [REMOTE ] TBLU: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:48:56.134243] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-02T21:48:56.135345] [INFO ] [REMOTE ] TBB: Full fetch complete (17686 records). [2025-10-02T21:48:56.135424] [DEBUG] [VALIDATOR ] TBB: Validating primary data. [2025-10-02T21:48:56.278160] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-08. [2025-10-02T21:48:56.549545] [DEBUG] [VALIDATOR ] TBB: All expected trading days are present. [2025-10-02T21:48:56.549633] [DEBUG] [VALIDATOR ] TBB: Primary data validation passed. [2025-10-02T21:48:56.550073] [INFO ] [MAIN ] TBB: Fetched primary data is valid. [2025-10-02T21:48:56.550124] [DEBUG] [LOCAL ] TBB: Saving primary data. [2025-10-02T21:48:56.550961] [DEBUG] [LOCAL ] TBB: Trimmed 17686 records to 11768 (keeping 200 days of data) [2025-10-02T21:48:56.633012] [DEBUG] [LOCAL ] TBB: Primary data saved (11768 records). [2025-10-02T21:48:56.633159] [INFO ] [MAIN ] TBB: Full history saved. [2025-10-02T21:48:56.633244] [INFO ] [MAIN ] Update Progress: 2049/2370 symbols completed. TBB took 28.9s. Estimated remaining: 45m 15s. Rate: 7.1 symbols/min [2025-10-02T21:48:56.819398] [INFO ] [MAIN ] TBN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:48:56.826095] [DEBUG] [LOCAL ] TBN: Loaded 3526 existing records from primary storage. [2025-10-02T21:48:56.826317] [INFO ] [MAIN ] TBN: Loaded 3526 existing records. [2025-10-02T21:48:57.014843] [WARN ] [MAIN ] TBN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:48:57.015095] [INFO ] [MAIN ] TBN: Wiping existing primary data before full refresh. [2025-10-02T21:48:57.015213] [INFO ] [LOCAL ] TBN: Starting deletion of primary data. [2025-10-02T21:48:57.015467] [DEBUG] [LOCAL ] TBN: Deleted primary data file. [2025-10-02T21:48:57.015530] [INFO ] [MAIN ] TBN: Starting full primary refresh. [2025-10-02T21:48:57.084132] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2024-12. [2025-10-02T21:48:57.408613] [INFO ] [REMOTE ] TBN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:48:57.723756] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-02T21:48:57.745012] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-02T21:48:57.873015] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-10. [2025-10-02T21:48:58.673013] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-09. [2025-10-02T21:48:58.822823] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-02T21:48:58.824456] [INFO ] [REMOTE ] TBI: Full fetch complete (31786 records). [2025-10-02T21:48:58.824572] [DEBUG] [VALIDATOR ] TBI: Validating primary data. [2025-10-02T21:48:59.237116] [DEBUG] [VALIDATOR ] TBI: All expected trading days are present. [2025-10-02T21:48:59.237198] [DEBUG] [VALIDATOR ] TBI: Primary data validation passed. [2025-10-02T21:48:59.238045] [INFO ] [MAIN ] TBI: Fetched primary data is valid. [2025-10-02T21:48:59.238142] [DEBUG] [LOCAL ] TBI: Saving primary data. [2025-10-02T21:48:59.238975] [DEBUG] [LOCAL ] TBI: Trimmed 31786 records to 22726 (keeping 200 days of data) [2025-10-02T21:48:59.370251] [DEBUG] [LOCAL ] TBI: Primary data saved (22726 records). [2025-10-02T21:48:59.370381] [INFO ] [MAIN ] TBI: Full history saved. [2025-10-02T21:48:59.370499] [INFO ] [MAIN ] Update Progress: 2050/2370 symbols completed. TBI took 27.5s. Estimated remaining: 45m 6s. Rate: 7.1 symbols/min [2025-10-02T21:48:59.481767] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-01. [2025-10-02T21:48:59.558753] [INFO ] [MAIN ] TCAI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:48:59.558959] [DEBUG] [LOCAL ] TCAI: No existing data file found in primary storage. [2025-10-02T21:48:59.559022] [WARN ] [MAIN ] TCAI: No existing data found, performing full refresh instead. [2025-10-02T21:48:59.559144] [INFO ] [MAIN ] TCAI: Wiping existing primary data before full refresh. [2025-10-02T21:48:59.559186] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-10-02T21:48:59.559227] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-10-02T21:48:59.559259] [INFO ] [MAIN ] TCAI: Starting full primary refresh. [2025-10-02T21:48:59.874840] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-02T21:48:59.968132] [INFO ] [REMOTE ] TCAI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:48:59.990045] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-02T21:49:00.273058] [INFO ] [REMOTE ] TBN: Fetching primary data for 2024-12. [2025-10-02T21:49:00.638882] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-10-02T21:49:01.073042] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-02. [2025-10-02T21:49:01.413669] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-02T21:49:01.873044] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-03. [2025-10-02T21:49:02.244555] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-02T21:49:02.673053] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2024-12. [2025-10-02T21:49:02.900860] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T21:49:02.901270] [WARN ] [REMOTE ] TCAI: No data returned for month 2024-12 [2025-10-02T21:49:02.901366] [FATAL] [REMOTE ] TCAI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T21:49:02.901502] [FATAL] [MAIN ] TCAI: Failed to fetch primary data. [2025-10-02T21:49:02.901621] [WARN ] [MAIN ] TCAI: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T21:49:02.901728] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-10-02T21:49:02.901801] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-10-02T21:49:02.901842] [INFO ] [LOCAL ] TCAI: Starting deletion of derivative data. [2025-10-02T21:49:02.901891] [DEBUG] [LOCAL ] TCAI: No derivative data file found to delete. [2025-10-02T21:49:02.901940] [INFO ] [MAIN ] Update Progress: 2051/2370 symbols completed. TCAI took 3.5s. Estimated remaining: 44m 57s. Rate: 7.1 symbols/min [2025-10-02T21:49:03.084739] [INFO ] [MAIN ] TD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:49:03.142602] [DEBUG] [LOCAL ] TD: Loaded 52278 existing records from primary storage. [2025-10-02T21:49:03.142997] [INFO ] [MAIN ] TD: Loaded 52278 existing records. [2025-10-02T21:49:03.337969] [WARN ] [MAIN ] TD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:49:03.338233] [INFO ] [MAIN ] TD: Wiping existing primary data before full refresh. [2025-10-02T21:49:03.338296] [INFO ] [LOCAL ] TD: Starting deletion of primary data. [2025-10-02T21:49:03.338574] [DEBUG] [LOCAL ] TD: Deleted primary data file. [2025-10-02T21:49:03.338636] [INFO ] [MAIN ] TD: Starting full primary refresh. [2025-10-02T21:49:03.488890] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-01. [2025-10-02T21:49:03.727335] [INFO ] [REMOTE ] TD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:49:04.177060] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-02T21:49:04.273046] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-02. [2025-10-02T21:49:04.881725] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-02T21:49:05.073018] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-03. [2025-10-02T21:49:05.652383] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-02T21:49:05.873005] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-10. [2025-10-02T21:49:06.672998] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-04. [2025-10-02T21:49:06.849793] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-02T21:49:06.851586] [INFO ] [REMOTE ] TBBB: Full fetch complete (51380 records). [2025-10-02T21:49:06.851750] [DEBUG] [VALIDATOR ] TBBB: Validating primary data. [2025-10-02T21:49:07.165113] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-02T21:49:07.300334] [DEBUG] [VALIDATOR ] TBBB: All expected trading days are present. [2025-10-02T21:49:07.300417] [DEBUG] [VALIDATOR ] TBBB: Primary data validation passed. [2025-10-02T21:49:07.301488] [INFO ] [MAIN ] TBBB: Fetched primary data is valid. [2025-10-02T21:49:07.301595] [DEBUG] [LOCAL ] TBBB: Saving primary data. [2025-10-02T21:49:07.303014] [DEBUG] [LOCAL ] TBBB: Trimmed 51380 records to 35961 (keeping 200 days of data) [2025-10-02T21:49:07.478565] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-05. [2025-10-02T21:49:07.532742] [DEBUG] [LOCAL ] TBBB: Primary data saved (35961 records). [2025-10-02T21:49:07.532900] [INFO ] [MAIN ] TBBB: Full history saved. [2025-10-02T21:49:07.532988] [INFO ] [MAIN ] Update Progress: 2052/2370 symbols completed. TBBB took 37.8s. Estimated remaining: 44m 48s. Rate: 7.1 symbols/min [2025-10-02T21:49:07.733560] [INFO ] [MAIN ] TDC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:49:07.783368] [DEBUG] [LOCAL ] TDC: Loaded 46627 existing records from primary storage. [2025-10-02T21:49:07.783843] [INFO ] [MAIN ] TDC: Loaded 46627 existing records. [2025-10-02T21:49:07.970005] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-02T21:49:08.001501] [WARN ] [MAIN ] TDC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:49:08.001769] [INFO ] [MAIN ] TDC: Wiping existing primary data before full refresh. [2025-10-02T21:49:08.001835] [INFO ] [LOCAL ] TDC: Starting deletion of primary data. [2025-10-02T21:49:08.002079] [DEBUG] [LOCAL ] TDC: Deleted primary data file. [2025-10-02T21:49:08.002138] [INFO ] [MAIN ] TDC: Starting full primary refresh. [2025-10-02T21:49:08.278163] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-04. [2025-10-02T21:49:08.399200] [INFO ] [REMOTE ] TDC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:49:08.693891] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-02T21:49:09.073003] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-05. [2025-10-02T21:49:09.477999] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-02T21:49:09.873002] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-06. [2025-10-02T21:49:10.209893] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-02T21:49:10.672992] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-07. [2025-10-02T21:49:11.010709] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-02T21:49:11.473004] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-08. [2025-10-02T21:49:11.814480] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-02T21:49:12.272993] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-06. [2025-10-02T21:49:12.762448] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-02T21:49:13.073002] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-09. [2025-10-02T21:49:13.420624] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-02T21:49:13.873012] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-10. [2025-10-02T21:49:14.173083] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-10 (0.30 seconds). [2025-10-02T21:49:14.173794] [INFO ] [REMOTE ] TBLU: Full fetch complete (1173 records). [2025-10-02T21:49:14.173866] [DEBUG] [VALIDATOR ] TBLU: Validating primary data. [2025-10-02T21:49:14.377830] [WARN ] [VALIDATOR ] TBLU: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-02T21:49:14.378022] [FATAL] [MAIN ] TBLU: Fetched primary data is invalid. Refusing to save it. [2025-10-02T21:49:14.378125] [WARN ] [MAIN ] TBLU: Deleting existing primary and derivative data due to validation failure. [2025-10-02T21:49:14.378201] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-10-02T21:49:14.378269] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-10-02T21:49:14.378308] [INFO ] [LOCAL ] TBLU: Starting deletion of derivative data. [2025-10-02T21:49:14.378350] [DEBUG] [LOCAL ] TBLU: No derivative data file found to delete. [2025-10-02T21:49:14.378408] [INFO ] [MAIN ] Update Progress: 2053/2370 symbols completed. TBLU took 19.2s. Estimated remaining: 44m 39s. Rate: 7.1 symbols/min [2025-10-02T21:49:14.565669] [INFO ] [MAIN ] TDF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:49:14.575095] [DEBUG] [LOCAL ] TDF: Loaded 6409 existing records from primary storage. [2025-10-02T21:49:14.575310] [INFO ] [MAIN ] TDF: Loaded 6409 existing records. [2025-10-02T21:49:14.679677] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-07. [2025-10-02T21:49:14.771460] [WARN ] [MAIN ] TDF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:49:14.771727] [INFO ] [MAIN ] TDF: Wiping existing primary data before full refresh. [2025-10-02T21:49:14.771783] [INFO ] [LOCAL ] TDF: Starting deletion of primary data. [2025-10-02T21:49:14.771961] [DEBUG] [LOCAL ] TDF: Deleted primary data file. [2025-10-02T21:49:14.772020] [INFO ] [MAIN ] TDF: Starting full primary refresh. [2025-10-02T21:49:15.170752] [INFO ] [REMOTE ] TDF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:49:15.293180] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-02T21:49:15.472987] [INFO ] [REMOTE ] TD: Fetching primary data for 2024-12. [2025-10-02T21:49:16.272998] [INFO ] [REMOTE ] TDC: Fetching primary data for 2024-12. [2025-10-02T21:49:17.073000] [INFO ] [REMOTE ] TDF: Fetching primary data for 2024-12. [2025-10-02T21:49:17.387684] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-02T21:49:17.881948] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-08. [2025-10-02T21:49:17.883731] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-02T21:49:17.896029] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-02T21:49:18.536865] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-02T21:49:18.673007] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-01. [2025-10-02T21:49:19.473045] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-01. [2025-10-02T21:49:20.272973] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-09. [2025-10-02T21:49:20.522090] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-02T21:49:21.020982] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-02T21:49:21.073007] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-02. [2025-10-02T21:49:21.199964] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-02T21:49:21.873000] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-02. [2025-10-02T21:49:22.673052] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-01. [2025-10-02T21:49:22.723053] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-02T21:49:23.384558] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-02T21:49:23.419345] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-02T21:49:23.472992] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-03. [2025-10-02T21:49:24.273038] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-03. [2025-10-02T21:49:25.072989] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-10. [2025-10-02T21:49:25.283486] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-02T21:49:25.655054] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-02T21:49:25.656512] [INFO ] [REMOTE ] TBN: Full fetch complete (5461 records). [2025-10-02T21:49:25.656698] [DEBUG] [VALIDATOR ] TBN: Validating primary data. [2025-10-02T21:49:25.883570] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-02. [2025-10-02T21:49:26.088189] [DEBUG] [VALIDATOR ] TBN: All expected trading days are present. [2025-10-02T21:49:26.090217] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-02T21:49:26.090283] [DEBUG] [VALIDATOR ] TBN: Primary data validation passed. [2025-10-02T21:49:26.101344] [INFO ] [MAIN ] TBN: Fetched primary data is valid. [2025-10-02T21:49:26.101581] [DEBUG] [LOCAL ] TBN: Saving primary data. [2025-10-02T21:49:26.102856] [DEBUG] [LOCAL ] TBN: Trimmed 5461 records to 3627 (keeping 200 days of data) [2025-10-02T21:49:26.124717] [DEBUG] [LOCAL ] TBN: Primary data saved (3627 records). [2025-10-02T21:49:26.124796] [INFO ] [MAIN ] TBN: Full history saved. [2025-10-02T21:49:26.124871] [INFO ] [MAIN ] Update Progress: 2054/2370 symbols completed. TBN took 29.5s. Estimated remaining: 44m 31s. Rate: 7.1 symbols/min [2025-10-02T21:49:26.301339] [INFO ] [MAIN ] TDG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:49:26.327585] [DEBUG] [LOCAL ] TDG: Loaded 22010 existing records from primary storage. [2025-10-02T21:49:26.327938] [INFO ] [MAIN ] TDG: Loaded 22010 existing records. [2025-10-02T21:49:26.519042] [WARN ] [MAIN ] TDG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:49:26.519435] [INFO ] [MAIN ] TDG: Wiping existing primary data before full refresh. [2025-10-02T21:49:26.526225] [INFO ] [LOCAL ] TDG: Starting deletion of primary data. [2025-10-02T21:49:26.526936] [DEBUG] [LOCAL ] TDG: Deleted primary data file. [2025-10-02T21:49:26.527192] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-02T21:49:26.527381] [INFO ] [MAIN ] TDG: Starting full primary refresh. [2025-10-02T21:49:26.678991] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-04. [2025-10-02T21:49:26.943002] [INFO ] [REMOTE ] TDG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:49:27.473036] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-04. [2025-10-02T21:49:28.272994] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-03. [2025-10-02T21:49:28.371446] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-02T21:49:29.073039] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-05. [2025-10-02T21:49:29.088768] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-02T21:49:29.383269] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-02T21:49:29.872996] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-05. [2025-10-02T21:49:30.673028] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-04. [2025-10-02T21:49:30.884722] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-02T21:49:31.117249] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-02T21:49:31.473002] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-06. [2025-10-02T21:49:31.813534] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-02T21:49:32.273044] [INFO ] [REMOTE ] TDG: Fetching primary data for 2024-12. [2025-10-02T21:49:32.698715] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-02T21:49:33.073050] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-05. [2025-10-02T21:49:33.562351] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-02T21:49:33.783262] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-02T21:49:33.873030] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-06. [2025-10-02T21:49:34.673014] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-07. [2025-10-02T21:49:35.473066] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-06. [2025-10-02T21:49:35.554167] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-02T21:49:35.917155] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-02T21:49:36.273016] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-07. [2025-10-02T21:49:36.368375] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-02T21:49:36.794420] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-02T21:49:37.073042] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-08. [2025-10-02T21:49:37.770847] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-02T21:49:37.873016] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-07. [2025-10-02T21:49:38.673014] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-08. [2025-10-02T21:49:39.473046] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-09. [2025-10-02T21:49:39.618267] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-02T21:49:40.279293] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-08. [2025-10-02T21:49:40.285283] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-02T21:49:40.328186] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-02T21:49:41.073023] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-09. [2025-10-02T21:49:41.873043] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-01. [2025-10-02T21:49:42.142136] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-02T21:49:42.678244] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-10. [2025-10-02T21:49:42.696675] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-02T21:49:42.728758] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-02T21:49:43.207348] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-02T21:49:43.208251] [INFO ] [REMOTE ] TDF: Full fetch complete (10439 records). [2025-10-02T21:49:43.208325] [DEBUG] [VALIDATOR ] TDF: Validating primary data. [2025-10-02T21:49:43.478108] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-02. [2025-10-02T21:49:43.590370] [DEBUG] [VALIDATOR ] TDF: All expected trading days are present. [2025-10-02T21:49:43.590477] [DEBUG] [VALIDATOR ] TDF: Primary data validation passed. [2025-10-02T21:49:43.590782] [INFO ] [MAIN ] TDF: Fetched primary data is valid. [2025-10-02T21:49:43.590845] [DEBUG] [LOCAL ] TDF: Saving primary data. [2025-10-02T21:49:43.591316] [DEBUG] [LOCAL ] TDF: Trimmed 10439 records to 6445 (keeping 200 days of data) [2025-10-02T21:49:43.634159] [DEBUG] [LOCAL ] TDF: Primary data saved (6445 records). [2025-10-02T21:49:43.634289] [INFO ] [MAIN ] TDF: Full history saved. [2025-10-02T21:49:43.634374] [INFO ] [MAIN ] Update Progress: 2055/2370 symbols completed. TDF took 29.3s. Estimated remaining: 44m 24s. Rate: 7.1 symbols/min [2025-10-02T21:49:43.825350] [INFO ] [MAIN ] TDOC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:49:43.875419] [DEBUG] [LOCAL ] TDOC: Loaded 53345 existing records from primary storage. [2025-10-02T21:49:43.875798] [INFO ] [MAIN ] TDOC: Loaded 53345 existing records. [2025-10-02T21:49:44.071926] [WARN ] [MAIN ] TDOC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:49:44.072201] [INFO ] [MAIN ] TDOC: Wiping existing primary data before full refresh. [2025-10-02T21:49:44.072307] [INFO ] [LOCAL ] TDOC: Starting deletion of primary data. [2025-10-02T21:49:44.072686] [DEBUG] [LOCAL ] TDOC: Deleted primary data file. [2025-10-02T21:49:44.072759] [INFO ] [MAIN ] TDOC: Starting full primary refresh. [2025-10-02T21:49:44.275165] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-09. [2025-10-02T21:49:44.496068] [INFO ] [REMOTE ] TDOC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:49:44.569893] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-02T21:49:45.073013] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-03. [2025-10-02T21:49:45.794830] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-02T21:49:45.873005] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-10. [2025-10-02T21:49:46.238129] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-02T21:49:46.673062] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2024-12. [2025-10-02T21:49:47.196852] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-02T21:49:47.199046] [INFO ] [REMOTE ] TD: Full fetch complete (75789 records). [2025-10-02T21:49:47.199326] [DEBUG] [VALIDATOR ] TD: Validating primary data. [2025-10-02T21:49:47.480382] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-10. [2025-10-02T21:49:47.666636] [DEBUG] [VALIDATOR ] TD: All expected trading days are present. [2025-10-02T21:49:47.666765] [DEBUG] [VALIDATOR ] TD: Primary data validation passed. [2025-10-02T21:49:47.668126] [INFO ] [MAIN ] TD: Fetched primary data is valid. [2025-10-02T21:49:47.668198] [DEBUG] [LOCAL ] TD: Saving primary data. [2025-10-02T21:49:47.669884] [DEBUG] [LOCAL ] TD: Trimmed 75789 records to 52664 (keeping 200 days of data) [2025-10-02T21:49:48.011855] [DEBUG] [LOCAL ] TD: Primary data saved (52664 records). [2025-10-02T21:49:48.012012] [INFO ] [MAIN ] TD: Full history saved. [2025-10-02T21:49:48.012097] [INFO ] [MAIN ] Update Progress: 2056/2370 symbols completed. TD took 45.1s. Estimated remaining: 44m 15s. Rate: 7.1 symbols/min [2025-10-02T21:49:48.204356] [INFO ] [MAIN ] TDS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:49:48.245596] [DEBUG] [LOCAL ] TDS: Loaded 42745 existing records from primary storage. [2025-10-02T21:49:48.246011] [INFO ] [MAIN ] TDS: Loaded 42745 existing records. [2025-10-02T21:49:48.282446] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-04. [2025-10-02T21:49:48.461671] [WARN ] [MAIN ] TDS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:49:48.461939] [INFO ] [MAIN ] TDS: Wiping existing primary data before full refresh. [2025-10-02T21:49:48.461994] [INFO ] [LOCAL ] TDS: Starting deletion of primary data. [2025-10-02T21:49:48.462222] [DEBUG] [LOCAL ] TDS: Deleted primary data file. [2025-10-02T21:49:48.462315] [INFO ] [MAIN ] TDS: Starting full primary refresh. [2025-10-02T21:49:48.675008] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-02T21:49:48.699407] [INFO ] [REMOTE ] TDC: Full fetch complete (66985 records). [2025-10-02T21:49:48.709396] [DEBUG] [VALIDATOR ] TDC: Validating primary data. [2025-10-02T21:49:49.055815] [INFO ] [REMOTE ] TDS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:49:49.094953] [INFO ] [REMOTE ] TDS: Fetching primary data for 2024-12. [2025-10-02T21:49:49.204351] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2024-12 (2.53 seconds). [2025-10-02T21:49:49.393234] [DEBUG] [VALIDATOR ] TDC: All expected trading days are present. [2025-10-02T21:49:49.393325] [DEBUG] [VALIDATOR ] TDC: Primary data validation passed. [2025-10-02T21:49:49.394550] [INFO ] [MAIN ] TDC: Fetched primary data is valid. [2025-10-02T21:49:49.394627] [DEBUG] [LOCAL ] TDC: Saving primary data. [2025-10-02T21:49:49.396179] [DEBUG] [LOCAL ] TDC: Trimmed 66985 records to 46959 (keeping 200 days of data) [2025-10-02T21:49:49.686926] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-02T21:49:49.705825] [DEBUG] [LOCAL ] TDC: Primary data saved (46959 records). [2025-10-02T21:49:49.705973] [INFO ] [MAIN ] TDC: Full history saved. [2025-10-02T21:49:49.706062] [INFO ] [MAIN ] Update Progress: 2057/2370 symbols completed. TDC took 42.2s. Estimated remaining: 44m 5s. Rate: 7.1 symbols/min [2025-10-02T21:49:49.886510] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-05. [2025-10-02T21:49:49.891446] [INFO ] [MAIN ] TDW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:49:49.936339] [DEBUG] [LOCAL ] TDW: Loaded 45292 existing records from primary storage. [2025-10-02T21:49:49.936694] [INFO ] [MAIN ] TDW: Loaded 45292 existing records. [2025-10-02T21:49:50.125047] [WARN ] [MAIN ] TDW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:49:50.125280] [INFO ] [MAIN ] TDW: Wiping existing primary data before full refresh. [2025-10-02T21:49:50.125332] [INFO ] [LOCAL ] TDW: Starting deletion of primary data. [2025-10-02T21:49:50.125596] [DEBUG] [LOCAL ] TDW: Deleted primary data file. [2025-10-02T21:49:50.125693] [INFO ] [MAIN ] TDW: Starting full primary refresh. [2025-10-02T21:49:50.521840] [INFO ] [REMOTE ] TDW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:49:50.673050] [INFO ] [REMOTE ] TDW: Fetching primary data for 2024-12. [2025-10-02T21:49:50.706180] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-02T21:49:50.800755] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-02T21:49:51.473012] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-01. [2025-10-02T21:49:52.279942] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-01. [2025-10-02T21:49:52.283114] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-02T21:49:53.072971] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-01. [2025-10-02T21:49:53.340502] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-02T21:49:53.532928] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-02T21:49:53.873042] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-06. [2025-10-02T21:49:54.528428] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-02T21:49:54.673041] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-02. [2025-10-02T21:49:54.888769] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-02T21:49:55.473063] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-02. [2025-10-02T21:49:55.776909] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-02T21:49:56.273072] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-07. [2025-10-02T21:49:57.036298] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-02T21:49:57.072967] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-03. [2025-10-02T21:49:57.098326] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-02T21:49:57.873005] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-03. [2025-10-02T21:49:58.672983] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-08. [2025-10-02T21:49:58.779378] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-02T21:49:59.118285] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-02T21:49:59.472999] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-04. [2025-10-02T21:49:59.775870] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-02T21:50:00.273034] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-02. [2025-10-02T21:50:00.922864] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-02T21:50:01.073007] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-05. [2025-10-02T21:50:01.873020] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-09. [2025-10-02T21:50:02.278848] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-02T21:50:02.673008] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-03. [2025-10-02T21:50:02.810032] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-02T21:50:03.211558] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-02T21:50:03.473061] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-10. [2025-10-02T21:50:04.273009] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-06. [2025-10-02T21:50:04.667526] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-02T21:50:04.669281] [INFO ] [REMOTE ] TDG: Full fetch complete (32046 records). [2025-10-02T21:50:04.669374] [DEBUG] [VALIDATOR ] TDG: Validating primary data. [2025-10-02T21:50:05.084558] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-04. [2025-10-02T21:50:05.174578] [DEBUG] [VALIDATOR ] TDG: All expected trading days are present. [2025-10-02T21:50:05.177067] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-03 (2.50 seconds). [2025-10-02T21:50:05.174805] [DEBUG] [VALIDATOR ] TDG: Primary data validation passed. [2025-10-02T21:50:05.188953] [INFO ] [MAIN ] TDG: Fetched primary data is valid. [2025-10-02T21:50:05.189965] [DEBUG] [LOCAL ] TDG: Saving primary data. [2025-10-02T21:50:05.191594] [DEBUG] [LOCAL ] TDG: Trimmed 32046 records to 22151 (keeping 200 days of data) [2025-10-02T21:50:05.347378] [DEBUG] [LOCAL ] TDG: Primary data saved (22151 records). [2025-10-02T21:50:05.347513] [INFO ] [MAIN ] TDG: Full history saved. [2025-10-02T21:50:05.347598] [INFO ] [MAIN ] Update Progress: 2058/2370 symbols completed. TDG took 39.2s. Estimated remaining: 43m 58s. Rate: 7.1 symbols/min [2025-10-02T21:50:05.558777] [INFO ] [MAIN ] TDY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:50:05.582925] [DEBUG] [LOCAL ] TDY: Loaded 22602 existing records from primary storage. [2025-10-02T21:50:05.583193] [INFO ] [MAIN ] TDY: Loaded 22602 existing records. [2025-10-02T21:50:05.803568] [WARN ] [MAIN ] TDY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:50:05.803915] [INFO ] [MAIN ] TDY: Wiping existing primary data before full refresh. [2025-10-02T21:50:05.804067] [INFO ] [LOCAL ] TDY: Starting deletion of primary data. [2025-10-02T21:50:05.804350] [DEBUG] [LOCAL ] TDY: Deleted primary data file. [2025-10-02T21:50:05.804423] [INFO ] [MAIN ] TDY: Starting full primary refresh. [2025-10-02T21:50:05.880328] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-04. [2025-10-02T21:50:06.082605] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-02T21:50:06.244246] [INFO ] [REMOTE ] TDY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:50:06.680753] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-07. [2025-10-02T21:50:06.698910] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-02T21:50:07.472994] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-05. [2025-10-02T21:50:07.878832] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-02T21:50:08.272986] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-05. [2025-10-02T21:50:08.447089] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-02T21:50:08.711757] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-02T21:50:09.073017] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-06. [2025-10-02T21:50:09.872975] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-08. [2025-10-02T21:50:10.373837] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-02T21:50:10.583040] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-02T21:50:10.673004] [INFO ] [REMOTE ] TDY: Fetching primary data for 2024-12. [2025-10-02T21:50:11.181589] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-02T21:50:11.472996] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-09. [2025-10-02T21:50:11.691776] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-02T21:50:12.273011] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-01. [2025-10-02T21:50:13.081001] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-06. [2025-10-02T21:50:13.098974] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-02T21:50:13.873006] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-07. [2025-10-02T21:50:14.673022] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-10. [2025-10-02T21:50:15.520597] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-02T21:50:15.530943] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-08. [2025-10-02T21:50:15.820241] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-06 (2.74 seconds). [2025-10-02T21:50:16.273008] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-07. [2025-10-02T21:50:16.342472] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-02T21:50:16.344249] [INFO ] [REMOTE ] TDW: Full fetch complete (67121 records). [2025-10-02T21:50:16.344480] [DEBUG] [VALIDATOR ] TDW: Validating primary data. [2025-10-02T21:50:16.775882] [DEBUG] [VALIDATOR ] TDW: All expected trading days are present. [2025-10-02T21:50:16.775974] [DEBUG] [VALIDATOR ] TDW: Primary data validation passed. [2025-10-02T21:50:16.777190] [INFO ] [MAIN ] TDW: Fetched primary data is valid. [2025-10-02T21:50:16.777267] [DEBUG] [LOCAL ] TDW: Saving primary data. [2025-10-02T21:50:16.778864] [DEBUG] [LOCAL ] TDW: Trimmed 67121 records to 45600 (keeping 200 days of data) [2025-10-02T21:50:17.067420] [DEBUG] [LOCAL ] TDW: Primary data saved (45600 records). [2025-10-02T21:50:17.067913] [INFO ] [MAIN ] TDW: Full history saved. [2025-10-02T21:50:17.068090] [INFO ] [MAIN ] Update Progress: 2059/2370 symbols completed. TDW took 27.4s. Estimated remaining: 43m 50s. Rate: 7.1 symbols/min [2025-10-02T21:50:17.300348] [INFO ] [MAIN ] TE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:50:17.304045] [DEBUG] [LOCAL ] TE: No existing data file found in primary storage. [2025-10-02T21:50:17.304490] [WARN ] [MAIN ] TE: No existing data found, performing full refresh instead. [2025-10-02T21:50:17.308692] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-02T21:50:17.305000] [INFO ] [MAIN ] TE: Wiping existing primary data before full refresh. [2025-10-02T21:50:17.331303] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-10-02T21:50:17.331576] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-10-02T21:50:17.332212] [INFO ] [MAIN ] TE: Starting full primary refresh. [2025-10-02T21:50:17.333004] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-01 (5.06 seconds). [2025-10-02T21:50:17.333364] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-09. [2025-10-02T21:50:17.789621] [INFO ] [REMOTE ] TE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:50:17.872983] [INFO ] [REMOTE ] TE: Fetching primary data for 2024-12. [2025-10-02T21:50:18.187727] [DEBUG] [REMOTE ] TE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T21:50:18.188110] [WARN ] [REMOTE ] TE: No data returned for month 2024-12 [2025-10-02T21:50:18.188207] [FATAL] [REMOTE ] TE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T21:50:18.188256] [FATAL] [MAIN ] TE: Failed to fetch primary data. [2025-10-02T21:50:18.188381] [WARN ] [MAIN ] TE: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T21:50:18.188462] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-10-02T21:50:18.188526] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-10-02T21:50:18.188563] [INFO ] [LOCAL ] TE: Starting deletion of derivative data. [2025-10-02T21:50:18.188620] [DEBUG] [LOCAL ] TE: No derivative data file found to delete. [2025-10-02T21:50:18.188721] [INFO ] [MAIN ] Update Progress: 2060/2370 symbols completed. TE took 1.1s. Estimated remaining: 43m 41s. Rate: 7.1 symbols/min [2025-10-02T21:50:18.382680] [INFO ] [MAIN ] TEAF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:50:18.393890] [DEBUG] [LOCAL ] TEAF: Loaded 7618 existing records from primary storage. [2025-10-02T21:50:18.394138] [INFO ] [MAIN ] TEAF: Loaded 7618 existing records. [2025-10-02T21:50:18.592462] [WARN ] [MAIN ] TEAF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:50:18.592842] [INFO ] [MAIN ] TEAF: Wiping existing primary data before full refresh. [2025-10-02T21:50:18.592985] [INFO ] [LOCAL ] TEAF: Starting deletion of primary data. [2025-10-02T21:50:18.593438] [DEBUG] [LOCAL ] TEAF: Deleted primary data file. [2025-10-02T21:50:18.593560] [INFO ] [MAIN ] TEAF: Starting full primary refresh. [2025-10-02T21:50:18.675736] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-02. [2025-10-02T21:50:18.788907] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-07 (2.52 seconds). [2025-10-02T21:50:19.047207] [INFO ] [REMOTE ] TEAF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:50:19.075385] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-02T21:50:19.473009] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-10. [2025-10-02T21:50:19.894196] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-02T21:50:20.272996] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-03. [2025-10-02T21:50:20.611060] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-02T21:50:20.613118] [INFO ] [REMOTE ] TDS: Full fetch complete (61745 records). [2025-10-02T21:50:20.613240] [DEBUG] [VALIDATOR ] TDS: Validating primary data. [2025-10-02T21:50:21.053723] [DEBUG] [VALIDATOR ] TDS: All expected trading days are present. [2025-10-02T21:50:21.053864] [DEBUG] [VALIDATOR ] TDS: Primary data validation passed. [2025-10-02T21:50:21.055108] [INFO ] [MAIN ] TDS: Fetched primary data is valid. [2025-10-02T21:50:21.055182] [DEBUG] [LOCAL ] TDS: Saving primary data. [2025-10-02T21:50:21.057264] [DEBUG] [LOCAL ] TDS: Trimmed 61745 records to 43121 (keeping 200 days of data) [2025-10-02T21:50:21.113687] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2024-12. [2025-10-02T21:50:21.313563] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-02T21:50:21.377226] [DEBUG] [LOCAL ] TDS: Primary data saved (43121 records). [2025-10-02T21:50:21.377406] [INFO ] [MAIN ] TDS: Full history saved. [2025-10-02T21:50:21.377505] [INFO ] [MAIN ] Update Progress: 2061/2370 symbols completed. TDS took 33.4s. Estimated remaining: 43m 31s. Rate: 7.1 symbols/min [2025-10-02T21:50:21.574059] [INFO ] [MAIN ] TECK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:50:21.627734] [DEBUG] [LOCAL ] TECK: Loaded 53432 existing records from primary storage. [2025-10-02T21:50:21.628211] [INFO ] [MAIN ] TECK: Loaded 53432 existing records. [2025-10-02T21:50:21.852545] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-02T21:50:21.861387] [WARN ] [MAIN ] TECK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:50:21.864495] [INFO ] [MAIN ] TECK: Wiping existing primary data before full refresh. [2025-10-02T21:50:21.864604] [INFO ] [LOCAL ] TECK: Starting deletion of primary data. [2025-10-02T21:50:21.865014] [DEBUG] [LOCAL ] TECK: Deleted primary data file. [2025-10-02T21:50:21.865118] [INFO ] [MAIN ] TECK: Starting full primary refresh. [2025-10-02T21:50:21.878190] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-04. [2025-10-02T21:50:22.257773] [INFO ] [REMOTE ] TECK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:50:22.673004] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-08. [2025-10-02T21:50:22.855482] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-02T21:50:23.473025] [INFO ] [REMOTE ] TECK: Fetching primary data for 2024-12. [2025-10-02T21:50:24.272973] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-01. [2025-10-02T21:50:24.729347] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-02T21:50:24.889709] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-02T21:50:25.072969] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-09. [2025-10-02T21:50:25.274686] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-02T21:50:25.873003] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-02. [2025-10-02T21:50:26.249725] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-02T21:50:26.673032] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-03. [2025-10-02T21:50:26.830631] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-02T21:50:27.388473] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-02T21:50:27.473006] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-01. [2025-10-02T21:50:28.273044] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-05. [2025-10-02T21:50:29.072969] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-10. [2025-10-02T21:50:29.641849] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-10-02T21:50:29.668270] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-02T21:50:29.873007] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-02. [2025-10-02T21:50:30.465408] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-02T21:50:30.468978] [INFO ] [REMOTE ] TDOC: Full fetch complete (77290 records). [2025-10-02T21:50:30.469114] [DEBUG] [VALIDATOR ] TDOC: Validating primary data. [2025-10-02T21:50:30.680442] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-04. [2025-10-02T21:50:30.901414] [DEBUG] [VALIDATOR ] TDOC: All expected trading days are present. [2025-10-02T21:50:30.901527] [DEBUG] [VALIDATOR ] TDOC: Primary data validation passed. [2025-10-02T21:50:30.902898] [INFO ] [MAIN ] TDOC: Fetched primary data is valid. [2025-10-02T21:50:30.902967] [DEBUG] [LOCAL ] TDOC: Saving primary data. [2025-10-02T21:50:30.905480] [DEBUG] [LOCAL ] TDOC: Trimmed 77290 records to 53735 (keeping 200 days of data) [2025-10-02T21:50:31.271238] [DEBUG] [LOCAL ] TDOC: Primary data saved (53735 records). [2025-10-02T21:50:31.271096] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-02T21:50:31.281760] [INFO ] [MAIN ] TDOC: Full history saved. [2025-10-02T21:50:31.282458] [INFO ] [MAIN ] Update Progress: 2062/2370 symbols completed. TDOC took 47.6s. Estimated remaining: 43m 23s. Rate: 7.1 symbols/min [2025-10-02T21:50:31.468589] [INFO ] [MAIN ] TEF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:50:31.472969] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-06. [2025-10-02T21:50:31.507080] [DEBUG] [LOCAL ] TEF: Loaded 37342 existing records from primary storage. [2025-10-02T21:50:31.507421] [INFO ] [MAIN ] TEF: Loaded 37342 existing records. [2025-10-02T21:50:31.711056] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-02T21:50:31.716940] [WARN ] [MAIN ] TEF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:50:31.721034] [INFO ] [MAIN ] TEF: Wiping existing primary data before full refresh. [2025-10-02T21:50:31.721122] [INFO ] [LOCAL ] TEF: Starting deletion of primary data. [2025-10-02T21:50:31.721436] [DEBUG] [LOCAL ] TEF: Deleted primary data file. [2025-10-02T21:50:31.721498] [INFO ] [MAIN ] TEF: Starting full primary refresh. [2025-10-02T21:50:32.108310] [INFO ] [REMOTE ] TEF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:50:32.273006] [INFO ] [REMOTE ] TEF: Fetching primary data for 2024-12. [2025-10-02T21:50:32.343967] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-02T21:50:33.073021] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-05. [2025-10-02T21:50:33.576932] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-02T21:50:33.683832] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-02T21:50:33.873016] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-03. [2025-10-02T21:50:34.672997] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-01. [2025-10-02T21:50:35.473056] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-06. [2025-10-02T21:50:35.852694] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-02T21:50:35.904346] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-02T21:50:36.215976] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-02T21:50:36.273026] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-07. [2025-10-02T21:50:37.011270] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-02T21:50:37.073039] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-08. [2025-10-02T21:50:37.781850] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-02T21:50:37.873042] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-09. [2025-10-02T21:50:38.617352] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-02T21:50:38.673035] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-04. [2025-10-02T21:50:39.473014] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-02. [2025-10-02T21:50:40.188554] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-02T21:50:40.273010] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-07. [2025-10-02T21:50:40.829320] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-02T21:50:41.072995] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-03. [2025-10-02T21:50:41.610185] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-02T21:50:41.873024] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-08. [2025-10-02T21:50:42.555417] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-02T21:50:42.672987] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-10. [2025-10-02T21:50:42.975349] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-02T21:50:43.147921] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-02T21:50:43.148907] [INFO ] [REMOTE ] TEAF: Full fetch complete (10089 records). [2025-10-02T21:50:43.148983] [DEBUG] [VALIDATOR ] TEAF: Validating primary data. [2025-10-02T21:50:43.478190] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-09. [2025-10-02T21:50:43.579087] [DEBUG] [VALIDATOR ] TEAF: All expected trading days are present. [2025-10-02T21:50:43.579173] [DEBUG] [VALIDATOR ] TEAF: Primary data validation passed. [2025-10-02T21:50:43.579447] [INFO ] [MAIN ] TEAF: Fetched primary data is valid. [2025-10-02T21:50:43.579489] [DEBUG] [LOCAL ] TEAF: Saving primary data. [2025-10-02T21:50:43.579946] [DEBUG] [LOCAL ] TEAF: Trimmed 10089 records to 7674 (keeping 200 days of data) [2025-10-02T21:50:43.627437] [DEBUG] [LOCAL ] TEAF: Primary data saved (7674 records). [2025-10-02T21:50:43.627576] [INFO ] [MAIN ] TEAF: Full history saved. [2025-10-02T21:50:43.627691] [INFO ] [MAIN ] Update Progress: 2063/2370 symbols completed. TEAF took 25.4s. Estimated remaining: 43m 15s. Rate: 7.1 symbols/min [2025-10-02T21:50:43.813333] [INFO ] [MAIN ] TEI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:50:43.837289] [DEBUG] [LOCAL ] TEI: Loaded 21097 existing records from primary storage. [2025-10-02T21:50:43.837568] [INFO ] [MAIN ] TEI: Loaded 21097 existing records. [2025-10-02T21:50:44.031994] [WARN ] [MAIN ] TEI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:50:44.032206] [INFO ] [MAIN ] TEI: Wiping existing primary data before full refresh. [2025-10-02T21:50:44.032257] [INFO ] [LOCAL ] TEI: Starting deletion of primary data. [2025-10-02T21:50:44.032492] [DEBUG] [LOCAL ] TEI: Deleted primary data file. [2025-10-02T21:50:44.032553] [INFO ] [MAIN ] TEI: Starting full primary refresh. [2025-10-02T21:50:44.274589] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-05. [2025-10-02T21:50:44.441228] [INFO ] [REMOTE ] TEI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:50:44.574409] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-02T21:50:45.073008] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-10. [2025-10-02T21:50:45.817102] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-02T21:50:45.818280] [INFO ] [REMOTE ] TDY: Full fetch complete (32123 records). [2025-10-02T21:50:45.818354] [DEBUG] [VALIDATOR ] TDY: Validating primary data. [2025-10-02T21:50:45.883127] [INFO ] [REMOTE ] TEI: Fetching primary data for 2024-12. [2025-10-02T21:50:46.240437] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-02T21:50:46.287770] [DEBUG] [VALIDATOR ] TDY: All expected trading days are present. [2025-10-02T21:50:46.288274] [DEBUG] [VALIDATOR ] TDY: Primary data validation passed. [2025-10-02T21:50:46.289189] [INFO ] [MAIN ] TDY: Fetched primary data is valid. [2025-10-02T21:50:46.289257] [DEBUG] [LOCAL ] TDY: Saving primary data. [2025-10-02T21:50:46.290187] [DEBUG] [LOCAL ] TDY: Trimmed 32123 records to 22700 (keeping 200 days of data) [2025-10-02T21:50:46.433432] [DEBUG] [LOCAL ] TDY: Primary data saved (22700 records). [2025-10-02T21:50:46.433565] [INFO ] [MAIN ] TDY: Full history saved. [2025-10-02T21:50:46.433670] [INFO ] [MAIN ] Update Progress: 2064/2370 symbols completed. TDY took 41.1s. Estimated remaining: 43m 6s. Rate: 7.1 symbols/min [2025-10-02T21:50:46.618958] [INFO ] [MAIN ] TEL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:50:46.678239] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-04. [2025-10-02T21:50:46.681142] [DEBUG] [LOCAL ] TEL: Loaded 51107 existing records from primary storage. [2025-10-02T21:50:46.681687] [INFO ] [MAIN ] TEL: Loaded 51107 existing records. [2025-10-02T21:50:46.871705] [WARN ] [MAIN ] TEL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:50:46.872145] [INFO ] [MAIN ] TEL: Wiping existing primary data before full refresh. [2025-10-02T21:50:46.872259] [INFO ] [LOCAL ] TEL: Starting deletion of primary data. [2025-10-02T21:50:46.872609] [DEBUG] [LOCAL ] TEL: Deleted primary data file. [2025-10-02T21:50:46.872717] [INFO ] [MAIN ] TEL: Starting full primary refresh. [2025-10-02T21:50:47.010913] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-02T21:50:47.267862] [INFO ] [REMOTE ] TEL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:50:47.473017] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-01. [2025-10-02T21:50:48.273048] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-06. [2025-10-02T21:50:48.428863] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-02T21:50:48.554255] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-02T21:50:49.073060] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-05. [2025-10-02T21:50:49.873003] [INFO ] [REMOTE ] TEL: Fetching primary data for 2024-12. [2025-10-02T21:50:50.051947] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-02T21:50:50.545979] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-02T21:50:50.672998] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-06. [2025-10-02T21:50:51.159932] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-02T21:50:51.473006] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-01. [2025-10-02T21:50:52.043130] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-02T21:50:52.273032] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-02. [2025-10-02T21:50:53.073009] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-07. [2025-10-02T21:50:53.238876] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-02T21:50:53.323231] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-02T21:50:53.873013] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-03. [2025-10-02T21:50:54.554638] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-02T21:50:54.672997] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-08. [2025-10-02T21:50:54.912378] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-02T21:50:55.472984] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-04. [2025-10-02T21:50:55.789288] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-02T21:50:56.272981] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-09. [2025-10-02T21:50:56.586730] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-02T21:50:57.072998] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-05. [2025-10-02T21:50:57.711032] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-02T21:50:57.782589] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-02T21:50:57.873008] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-10. [2025-10-02T21:50:58.673036] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-07. [2025-10-02T21:50:58.931764] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-02T21:50:58.933699] [INFO ] [REMOTE ] TEF: Full fetch complete (54772 records). [2025-10-02T21:50:58.933954] [DEBUG] [VALIDATOR ] TEF: Validating primary data. [2025-10-02T21:50:59.351356] [DEBUG] [VALIDATOR ] TEF: All expected trading days are present. [2025-10-02T21:50:59.351480] [DEBUG] [VALIDATOR ] TEF: Primary data validation passed. [2025-10-02T21:50:59.352669] [INFO ] [MAIN ] TEF: Fetched primary data is valid. [2025-10-02T21:50:59.352791] [DEBUG] [LOCAL ] TEF: Saving primary data. [2025-10-02T21:50:59.354117] [DEBUG] [LOCAL ] TEF: Trimmed 54772 records to 37607 (keeping 200 days of data) [2025-10-02T21:50:59.473124] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-06. [2025-10-02T21:50:59.590846] [DEBUG] [LOCAL ] TEF: Primary data saved (37607 records). [2025-10-02T21:50:59.591001] [INFO ] [MAIN ] TEF: Full history saved. [2025-10-02T21:50:59.591109] [INFO ] [MAIN ] Update Progress: 2065/2370 symbols completed. TEF took 28.3s. Estimated remaining: 42m 58s. Rate: 7.1 symbols/min [2025-10-02T21:50:59.777796] [INFO ] [MAIN ] TEN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:50:59.812246] [DEBUG] [LOCAL ] TEN: Loaded 30676 existing records from primary storage. [2025-10-02T21:50:59.812580] [INFO ] [MAIN ] TEN: Loaded 30676 existing records. [2025-10-02T21:51:00.003742] [WARN ] [MAIN ] TEN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:51:00.003980] [INFO ] [MAIN ] TEN: Wiping existing primary data before full refresh. [2025-10-02T21:51:00.004029] [INFO ] [LOCAL ] TEN: Starting deletion of primary data. [2025-10-02T21:51:00.004258] [DEBUG] [LOCAL ] TEN: Deleted primary data file. [2025-10-02T21:51:00.004316] [INFO ] [MAIN ] TEN: Starting full primary refresh. [2025-10-02T21:51:00.273236] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-02. [2025-10-02T21:51:00.400699] [INFO ] [REMOTE ] TEN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:51:00.543575] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-02T21:51:00.820492] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-02T21:51:01.073001] [INFO ] [REMOTE ] TEN: Fetching primary data for 2024-12. [2025-10-02T21:51:01.872972] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-08. [2025-10-02T21:51:02.045578] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-02T21:51:02.510709] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-02T21:51:02.673008] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-03. [2025-10-02T21:51:03.472990] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-07. [2025-10-02T21:51:03.643790] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-02T21:51:04.137693] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-02T21:51:04.273025] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-04. [2025-10-02T21:51:04.586692] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-02T21:51:05.073016] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-01. [2025-10-02T21:51:05.872967] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-09. [2025-10-02T21:51:05.943446] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-02T21:51:06.482321] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-02T21:51:06.672997] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-05. [2025-10-02T21:51:07.473039] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-08. [2025-10-02T21:51:07.799007] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-02T21:51:08.282937] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-02. [2025-10-02T21:51:08.285914] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-02T21:51:08.601685] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-02T21:51:09.073003] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-09. [2025-10-02T21:51:09.426180] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-02T21:51:09.873008] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-03. [2025-10-02T21:51:10.161466] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-02T21:51:10.673016] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-10. [2025-10-02T21:51:10.980824] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-02T21:51:11.450516] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-02T21:51:11.452078] [INFO ] [REMOTE ] TEI: Full fetch complete (30517 records). [2025-10-02T21:51:11.452157] [DEBUG] [VALIDATOR ] TEI: Validating primary data. [2025-10-02T21:51:11.483530] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-04. [2025-10-02T21:51:11.874563] [DEBUG] [VALIDATOR ] TEI: All expected trading days are present. [2025-10-02T21:51:11.874673] [DEBUG] [VALIDATOR ] TEI: Primary data validation passed. [2025-10-02T21:51:11.875381] [INFO ] [MAIN ] TEI: Fetched primary data is valid. [2025-10-02T21:51:11.875424] [DEBUG] [LOCAL ] TEI: Saving primary data. [2025-10-02T21:51:11.876264] [DEBUG] [LOCAL ] TEI: Trimmed 30517 records to 21330 (keeping 200 days of data) [2025-10-02T21:51:12.012530] [DEBUG] [LOCAL ] TEI: Primary data saved (21330 records). [2025-10-02T21:51:12.012708] [INFO ] [MAIN ] TEI: Full history saved. [2025-10-02T21:51:12.012837] [INFO ] [MAIN ] Update Progress: 2066/2370 symbols completed. TEI took 28.4s. Estimated remaining: 42m 50s. Rate: 7.1 symbols/min [2025-10-02T21:51:12.214445] [INFO ] [MAIN ] TEO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:51:12.236689] [DEBUG] [LOCAL ] TEO: Loaded 22070 existing records from primary storage. [2025-10-02T21:51:12.236956] [INFO ] [MAIN ] TEO: Loaded 22070 existing records. [2025-10-02T21:51:12.280886] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-06. [2025-10-02T21:51:12.438783] [WARN ] [MAIN ] TEO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:51:12.439036] [INFO ] [MAIN ] TEO: Wiping existing primary data before full refresh. [2025-10-02T21:51:12.439099] [INFO ] [LOCAL ] TEO: Starting deletion of primary data. [2025-10-02T21:51:12.439316] [DEBUG] [LOCAL ] TEO: Deleted primary data file. [2025-10-02T21:51:12.439375] [INFO ] [MAIN ] TEO: Starting full primary refresh. [2025-10-02T21:51:12.905135] [INFO ] [REMOTE ] TEO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:51:12.980363] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-02T21:51:13.073050] [INFO ] [REMOTE ] TEO: Fetching primary data for 2024-12. [2025-10-02T21:51:13.872995] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-10. [2025-10-02T21:51:14.191723] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-02T21:51:14.318531] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-02T21:51:14.673015] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-01. [2025-10-02T21:51:15.217007] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-02T21:51:15.220142] [INFO ] [REMOTE ] TECK: Full fetch complete (77310 records). [2025-10-02T21:51:15.220261] [DEBUG] [VALIDATOR ] TECK: Validating primary data. [2025-10-02T21:51:15.478122] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-07. [2025-10-02T21:51:15.682174] [DEBUG] [VALIDATOR ] TECK: All expected trading days are present. [2025-10-02T21:51:15.683719] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-02T21:51:15.682930] [DEBUG] [VALIDATOR ] TECK: Primary data validation passed. [2025-10-02T21:51:15.691094] [INFO ] [MAIN ] TECK: Fetched primary data is valid. [2025-10-02T21:51:15.691902] [DEBUG] [LOCAL ] TECK: Saving primary data. [2025-10-02T21:51:15.695289] [DEBUG] [LOCAL ] TECK: Trimmed 77310 records to 53822 (keeping 200 days of data) [2025-10-02T21:51:16.055884] [DEBUG] [LOCAL ] TECK: Primary data saved (53822 records). [2025-10-02T21:51:16.056030] [INFO ] [MAIN ] TECK: Full history saved. [2025-10-02T21:51:16.056141] [INFO ] [MAIN ] Update Progress: 2067/2370 symbols completed. TECK took 54.7s. Estimated remaining: 42m 41s. Rate: 7.1 symbols/min [2025-10-02T21:51:16.238262] [INFO ] [MAIN ] TEVA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:51:16.273017] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-02. [2025-10-02T21:51:16.297849] [DEBUG] [LOCAL ] TEVA: Loaded 53632 existing records from primary storage. [2025-10-02T21:51:16.298236] [INFO ] [MAIN ] TEVA: Loaded 53632 existing records. [2025-10-02T21:51:16.500104] [WARN ] [MAIN ] TEVA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:51:16.500735] [INFO ] [MAIN ] TEVA: Wiping existing primary data before full refresh. [2025-10-02T21:51:16.500801] [INFO ] [LOCAL ] TEVA: Starting deletion of primary data. [2025-10-02T21:51:16.501258] [DEBUG] [LOCAL ] TEVA: Deleted primary data file. [2025-10-02T21:51:16.501378] [INFO ] [MAIN ] TEVA: Starting full primary refresh. [2025-10-02T21:51:16.887411] [INFO ] [REMOTE ] TEVA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:51:17.072974] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2024-12. [2025-10-02T21:51:17.368027] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-02T21:51:17.407780] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-02T21:51:17.873011] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-05. [2025-10-02T21:51:18.585121] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-02T21:51:18.672992] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-08. [2025-10-02T21:51:19.009112] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-02T21:51:19.473019] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-01. [2025-10-02T21:51:20.272992] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-03. [2025-10-02T21:51:20.489357] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-02T21:51:21.073057] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-09. [2025-10-02T21:51:21.306628] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-02T21:51:21.317286] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-02T21:51:21.873036] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-06. [2025-10-02T21:51:22.672981] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-02. [2025-10-02T21:51:22.842805] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-02T21:51:23.222257] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-02T21:51:23.473023] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-10. [2025-10-02T21:51:24.272975] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-04. [2025-10-02T21:51:24.760778] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-02T21:51:24.788901] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-02T21:51:24.791142] [INFO ] [REMOTE ] TEL: Full fetch complete (73403 records). [2025-10-02T21:51:24.791282] [DEBUG] [VALIDATOR ] TEL: Validating primary data. [2025-10-02T21:51:25.074667] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-03. [2025-10-02T21:51:25.219159] [DEBUG] [VALIDATOR ] TEL: All expected trading days are present. [2025-10-02T21:51:25.219309] [DEBUG] [VALIDATOR ] TEL: Primary data validation passed. [2025-10-02T21:51:25.220628] [INFO ] [MAIN ] TEL: Fetched primary data is valid. [2025-10-02T21:51:25.220748] [DEBUG] [LOCAL ] TEL: Saving primary data. [2025-10-02T21:51:25.222337] [DEBUG] [LOCAL ] TEL: Trimmed 73403 records to 51470 (keeping 200 days of data) [2025-10-02T21:51:25.496589] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-02T21:51:25.600928] [DEBUG] [LOCAL ] TEL: Primary data saved (51470 records). [2025-10-02T21:51:25.601084] [INFO ] [MAIN ] TEL: Full history saved. [2025-10-02T21:51:25.602159] [INFO ] [MAIN ] Update Progress: 2068/2370 symbols completed. TEL took 39.2s. Estimated remaining: 42m 33s. Rate: 7.1 symbols/min [2025-10-02T21:51:25.798085] [INFO ] [MAIN ] TEX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:51:25.842094] [DEBUG] [LOCAL ] TEX: Loaded 44214 existing records from primary storage. [2025-10-02T21:51:25.842435] [INFO ] [MAIN ] TEX: Loaded 44214 existing records. [2025-10-02T21:51:25.878222] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-05. [2025-10-02T21:51:26.035074] [WARN ] [MAIN ] TEX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:51:26.035411] [INFO ] [MAIN ] TEX: Wiping existing primary data before full refresh. [2025-10-02T21:51:26.035470] [INFO ] [LOCAL ] TEX: Starting deletion of primary data. [2025-10-02T21:51:26.035744] [DEBUG] [LOCAL ] TEX: Deleted primary data file. [2025-10-02T21:51:26.035804] [INFO ] [MAIN ] TEX: Starting full primary refresh. [2025-10-02T21:51:26.436426] [INFO ] [REMOTE ] TEX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:51:26.673034] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-07. [2025-10-02T21:51:26.807449] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-02T21:51:27.294515] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-02T21:51:27.473012] [INFO ] [REMOTE ] TEX: Fetching primary data for 2024-12. [2025-10-02T21:51:27.804310] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-02T21:51:28.273062] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-04. [2025-10-02T21:51:29.072978] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-06. [2025-10-02T21:51:29.109504] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-02T21:51:29.872971] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-01. [2025-10-02T21:51:30.119730] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-02T21:51:30.472347] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-02T21:51:30.673002] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-07. [2025-10-02T21:51:31.472970] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-05. [2025-10-02T21:51:31.555796] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-02T21:51:31.668027] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-02T21:51:32.273000] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-02. [2025-10-02T21:51:33.073008] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-08. [2025-10-02T21:51:33.833144] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-10-02T21:51:33.859895] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-02T21:51:33.872949] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-09. [2025-10-02T21:51:34.181258] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-02T21:51:34.672984] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-03. [2025-10-02T21:51:34.738675] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-02T21:51:35.473007] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-10. [2025-10-02T21:51:36.265001] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-02T21:51:36.267765] [INFO ] [REMOTE ] TEO: Full fetch complete (32736 records). [2025-10-02T21:51:36.267865] [DEBUG] [VALIDATOR ] TEO: Validating primary data. [2025-10-02T21:51:36.280024] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-06. [2025-10-02T21:51:36.718979] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-02T21:51:36.742247] [DEBUG] [VALIDATOR ] TEO: All expected trading days are present. [2025-10-02T21:51:36.742406] [DEBUG] [VALIDATOR ] TEO: Primary data validation passed. [2025-10-02T21:51:36.743182] [INFO ] [MAIN ] TEO: Fetched primary data is valid. [2025-10-02T21:51:36.743266] [DEBUG] [LOCAL ] TEO: Saving primary data. [2025-10-02T21:51:36.746407] [DEBUG] [LOCAL ] TEO: Trimmed 32736 records to 22243 (keeping 200 days of data) [2025-10-02T21:51:36.882953] [DEBUG] [LOCAL ] TEO: Primary data saved (22243 records). [2025-10-02T21:51:36.883112] [INFO ] [MAIN ] TEO: Full history saved. [2025-10-02T21:51:36.883205] [INFO ] [MAIN ] Update Progress: 2069/2370 symbols completed. TEO took 24.9s. Estimated remaining: 42m 25s. Rate: 7.1 symbols/min [2025-10-02T21:51:37.069988] [INFO ] [MAIN ] TFC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:51:37.073024] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-04. [2025-10-02T21:51:37.126810] [DEBUG] [LOCAL ] TFC: Loaded 53667 existing records from primary storage. [2025-10-02T21:51:37.127182] [INFO ] [MAIN ] TFC: Loaded 53667 existing records. [2025-10-02T21:51:37.316879] [WARN ] [MAIN ] TFC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:51:37.317098] [INFO ] [MAIN ] TFC: Wiping existing primary data before full refresh. [2025-10-02T21:51:37.317148] [INFO ] [LOCAL ] TFC: Starting deletion of primary data. [2025-10-02T21:51:37.317425] [DEBUG] [LOCAL ] TFC: Deleted primary data file. [2025-10-02T21:51:37.317485] [INFO ] [MAIN ] TFC: Starting full primary refresh. [2025-10-02T21:51:37.706679] [INFO ] [REMOTE ] TFC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:51:37.872985] [INFO ] [REMOTE ] TFC: Fetching primary data for 2024-12. [2025-10-02T21:51:38.387998] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-02T21:51:38.485984] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-02T21:51:38.673023] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-05. [2025-10-02T21:51:39.473049] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-08. [2025-10-02T21:51:39.815916] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-02T21:51:40.273029] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-01. [2025-10-02T21:51:40.436287] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-02T21:51:40.883008] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-02T21:51:41.073024] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-06. [2025-10-02T21:51:41.873070] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-07. [2025-10-02T21:51:42.066589] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-02T21:51:42.673024] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-09. [2025-10-02T21:51:42.935107] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-02T21:51:43.473049] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-02. [2025-10-02T21:51:44.102721] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-02T21:51:44.175815] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-02T21:51:44.273005] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-08. [2025-10-02T21:51:44.814126] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-02T21:51:45.073011] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-03. [2025-10-02T21:51:45.873062] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-10. [2025-10-02T21:51:46.410555] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-02T21:51:46.672983] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-09. [2025-10-02T21:51:46.785633] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-02T21:51:46.787547] [INFO ] [REMOTE ] TEN: Full fetch complete (44319 records). [2025-10-02T21:51:46.787723] [DEBUG] [VALIDATOR ] TEN: Validating primary data. [2025-10-02T21:51:47.199016] [DEBUG] [VALIDATOR ] TEN: All expected trading days are present. [2025-10-02T21:51:47.199113] [DEBUG] [VALIDATOR ] TEN: Primary data validation passed. [2025-10-02T21:51:47.200023] [INFO ] [MAIN ] TEN: Fetched primary data is valid. [2025-10-02T21:51:47.200091] [DEBUG] [LOCAL ] TEN: Saving primary data. [2025-10-02T21:51:47.201262] [DEBUG] [LOCAL ] TEN: Trimmed 44319 records to 30835 (keeping 200 days of data) [2025-10-02T21:51:47.404792] [DEBUG] [LOCAL ] TEN: Primary data saved (30835 records). [2025-10-02T21:51:47.404946] [INFO ] [MAIN ] TEN: Full history saved. [2025-10-02T21:51:47.405031] [INFO ] [MAIN ] Update Progress: 2070/2370 symbols completed. TEN took 47.8s. Estimated remaining: 42m 17s. Rate: 7.1 symbols/min [2025-10-02T21:51:47.474171] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-07. [2025-10-02T21:51:47.636924] [INFO ] [MAIN ] TFII: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:51:47.683113] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-03 (2.61 seconds). [2025-10-02T21:51:47.727033] [DEBUG] [LOCAL ] TFII: Loaded 33721 existing records from primary storage. [2025-10-02T21:51:47.727404] [INFO ] [MAIN ] TFII: Loaded 33721 existing records. [2025-10-02T21:51:47.935520] [WARN ] [MAIN ] TFII: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:51:47.935853] [INFO ] [MAIN ] TFII: Wiping existing primary data before full refresh. [2025-10-02T21:51:47.935916] [INFO ] [LOCAL ] TFII: Starting deletion of primary data. [2025-10-02T21:51:47.936389] [DEBUG] [LOCAL ] TFII: Deleted primary data file. [2025-10-02T21:51:47.936451] [INFO ] [MAIN ] TFII: Starting full primary refresh. [2025-10-02T21:51:48.285447] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-04. [2025-10-02T21:51:48.330940] [INFO ] [REMOTE ] TFII: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:51:49.044202] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-10-02T21:51:49.073014] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-10. [2025-10-02T21:51:49.162504] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-02T21:51:49.873000] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-08. [2025-10-02T21:51:50.378868] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-02T21:51:50.469710] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-02T21:51:50.471786] [INFO ] [REMOTE ] TEVA: Full fetch complete (77702 records). [2025-10-02T21:51:50.471895] [DEBUG] [VALIDATOR ] TEVA: Validating primary data. [2025-10-02T21:51:50.680556] [INFO ] [REMOTE ] TFII: Fetching primary data for 2024-12. [2025-10-02T21:51:50.889592] [DEBUG] [VALIDATOR ] TEVA: All expected trading days are present. [2025-10-02T21:51:50.889709] [DEBUG] [VALIDATOR ] TEVA: Primary data validation passed. [2025-10-02T21:51:50.890858] [INFO ] [MAIN ] TEVA: Fetched primary data is valid. [2025-10-02T21:51:50.890923] [DEBUG] [LOCAL ] TEVA: Saving primary data. [2025-10-02T21:51:50.892508] [DEBUG] [LOCAL ] TEVA: Trimmed 77702 records to 54022 (keeping 200 days of data) [2025-10-02T21:51:51.231167] [DEBUG] [LOCAL ] TEVA: Primary data saved (54022 records). [2025-10-02T21:51:51.231318] [INFO ] [MAIN ] TEVA: Full history saved. [2025-10-02T21:51:51.231402] [INFO ] [MAIN ] Update Progress: 2071/2370 symbols completed. TEVA took 35.2s. Estimated remaining: 42m 8s. Rate: 7.1 symbols/min [2025-10-02T21:51:51.431179] [INFO ] [MAIN ] TFIN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:51:51.459740] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-02T21:51:51.477129] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-09. [2025-10-02T21:51:51.490884] [DEBUG] [LOCAL ] TFIN: Loaded 23462 existing records from primary storage. [2025-10-02T21:51:51.491258] [INFO ] [MAIN ] TFIN: Loaded 23462 existing records. [2025-10-02T21:51:51.695523] [WARN ] [MAIN ] TFIN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:51:51.695760] [INFO ] [MAIN ] TFIN: Wiping existing primary data before full refresh. [2025-10-02T21:51:51.695814] [INFO ] [LOCAL ] TFIN: Starting deletion of primary data. [2025-10-02T21:51:51.696052] [DEBUG] [LOCAL ] TFIN: Deleted primary data file. [2025-10-02T21:51:51.696117] [INFO ] [MAIN ] TFIN: Starting full primary refresh. [2025-10-02T21:51:52.103121] [INFO ] [REMOTE ] TFIN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:51:52.120083] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-02T21:51:52.273051] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2024-12. [2025-10-02T21:51:52.996694] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-02T21:51:53.081275] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-10. [2025-10-02T21:51:53.083583] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-02T21:51:53.873006] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-01. [2025-10-02T21:51:54.436223] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-02T21:51:54.437979] [INFO ] [REMOTE ] TEX: Full fetch complete (64601 records). [2025-10-02T21:51:54.438106] [DEBUG] [VALIDATOR ] TEX: Validating primary data. [2025-10-02T21:51:54.681682] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-05. [2025-10-02T21:51:54.755717] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-02T21:51:54.900538] [DEBUG] [VALIDATOR ] TEX: All expected trading days are present. [2025-10-02T21:51:54.900694] [DEBUG] [VALIDATOR ] TEX: Primary data validation passed. [2025-10-02T21:51:54.901902] [INFO ] [MAIN ] TEX: Fetched primary data is valid. [2025-10-02T21:51:54.901968] [DEBUG] [LOCAL ] TEX: Saving primary data. [2025-10-02T21:51:54.903909] [DEBUG] [LOCAL ] TEX: Trimmed 64601 records to 44483 (keeping 200 days of data) [2025-10-02T21:51:55.199488] [DEBUG] [LOCAL ] TEX: Primary data saved (44483 records). [2025-10-02T21:51:55.199622] [INFO ] [MAIN ] TEX: Full history saved. [2025-10-02T21:51:55.200567] [INFO ] [MAIN ] Update Progress: 2072/2370 symbols completed. TEX took 29.6s. Estimated remaining: 41m 59s. Rate: 7.1 symbols/min [2025-10-02T21:51:55.388008] [INFO ] [MAIN ] TFPM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:51:55.430541] [DEBUG] [LOCAL ] TFPM: Loaded 37949 existing records from primary storage. [2025-10-02T21:51:55.430868] [INFO ] [MAIN ] TFPM: Loaded 37949 existing records. [2025-10-02T21:51:55.478186] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-01. [2025-10-02T21:51:55.628883] [WARN ] [MAIN ] TFPM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:51:55.629098] [INFO ] [MAIN ] TFPM: Wiping existing primary data before full refresh. [2025-10-02T21:51:55.629146] [INFO ] [LOCAL ] TFPM: Starting deletion of primary data. [2025-10-02T21:51:55.629377] [DEBUG] [LOCAL ] TFPM: Deleted primary data file. [2025-10-02T21:51:55.629436] [INFO ] [MAIN ] TFPM: Starting full primary refresh. [2025-10-02T21:51:56.010126] [INFO ] [REMOTE ] TFPM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:51:56.272999] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-02. [2025-10-02T21:51:56.640021] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-02T21:51:56.669056] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-02T21:51:57.073014] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-06. [2025-10-02T21:51:57.314341] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-02T21:51:57.873017] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2024-12. [2025-10-02T21:51:58.673005] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-03. [2025-10-02T21:51:58.935200] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-02T21:51:58.965729] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-02T21:51:59.473001] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-07. [2025-10-02T21:51:59.882338] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-02T21:52:00.272992] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-04. [2025-10-02T21:52:01.073004] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-02. [2025-10-02T21:52:01.472776] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-02T21:52:01.525939] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-02T21:52:01.873045] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-08. [2025-10-02T21:52:02.464625] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-02T21:52:02.673005] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-05. [2025-10-02T21:52:03.472996] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-03. [2025-10-02T21:52:03.836845] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-02T21:52:03.864145] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-02T21:52:04.273037] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-09. [2025-10-02T21:52:05.008986] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-02T21:52:05.072994] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-01. [2025-10-02T21:52:05.872985] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-06. [2025-10-02T21:52:06.158169] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-02T21:52:06.241869] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-02T21:52:06.672983] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-10. [2025-10-02T21:52:06.826353] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-02T21:52:07.472996] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-04. [2025-10-02T21:52:07.780801] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-02T21:52:07.782957] [INFO ] [REMOTE ] TFC: Full fetch complete (77670 records). [2025-10-02T21:52:07.783062] [DEBUG] [VALIDATOR ] TFC: Validating primary data. [2025-10-02T21:52:08.203446] [DEBUG] [VALIDATOR ] TFC: All expected trading days are present. [2025-10-02T21:52:08.203564] [DEBUG] [VALIDATOR ] TFC: Primary data validation passed. [2025-10-02T21:52:08.204878] [INFO ] [MAIN ] TFC: Fetched primary data is valid. [2025-10-02T21:52:08.204943] [DEBUG] [LOCAL ] TFC: Saving primary data. [2025-10-02T21:52:08.206504] [DEBUG] [LOCAL ] TFC: Trimmed 77670 records to 54057 (keeping 200 days of data) [2025-10-02T21:52:08.272983] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-07. [2025-10-02T21:52:08.562173] [DEBUG] [LOCAL ] TFC: Primary data saved (54057 records). [2025-10-02T21:52:08.562372] [INFO ] [MAIN ] TFC: Full history saved. [2025-10-02T21:52:08.562475] [INFO ] [MAIN ] Update Progress: 2073/2370 symbols completed. TFC took 31.7s. Estimated remaining: 41m 51s. Rate: 7.1 symbols/min [2025-10-02T21:52:08.760233] [INFO ] [MAIN ] TFX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:52:08.796854] [DEBUG] [LOCAL ] TFX: Loaded 37085 existing records from primary storage. [2025-10-02T21:52:08.797340] [INFO ] [MAIN ] TFX: Loaded 37085 existing records. [2025-10-02T21:52:09.024279] [WARN ] [MAIN ] TFX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:52:09.024696] [INFO ] [MAIN ] TFX: Wiping existing primary data before full refresh. [2025-10-02T21:52:09.024820] [INFO ] [LOCAL ] TFX: Starting deletion of primary data. [2025-10-02T21:52:09.025163] [DEBUG] [LOCAL ] TFX: Deleted primary data file. [2025-10-02T21:52:09.025239] [INFO ] [MAIN ] TFX: Starting full primary refresh. [2025-10-02T21:52:09.084940] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-02. [2025-10-02T21:52:09.329739] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-02T21:52:09.480024] [INFO ] [REMOTE ] TFX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:52:09.601036] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-02T21:52:09.873007] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-05. [2025-10-02T21:52:10.398131] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-02T21:52:10.673041] [INFO ] [REMOTE ] TFX: Fetching primary data for 2024-12. [2025-10-02T21:52:11.302066] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-02T21:52:11.473017] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-06. [2025-10-02T21:52:12.158006] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-02T21:52:12.273046] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-08. [2025-10-02T21:52:12.348305] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-02T21:52:13.072973] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-03. [2025-10-02T21:52:13.077090] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-02T21:52:13.872998] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-09. [2025-10-02T21:52:14.441064] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-02T21:52:14.662003] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-02T21:52:14.672944] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-10. [2025-10-02T21:52:15.473052] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-07. [2025-10-02T21:52:15.522047] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-02T21:52:15.523667] [INFO ] [REMOTE ] TFIN: Full fetch complete (31316 records). [2025-10-02T21:52:15.523791] [DEBUG] [VALIDATOR ] TFIN: Validating primary data. [2025-10-02T21:52:15.964815] [DEBUG] [VALIDATOR ] TFIN: All expected trading days are present. [2025-10-02T21:52:15.964896] [DEBUG] [VALIDATOR ] TFIN: Primary data validation passed. [2025-10-02T21:52:15.965627] [INFO ] [MAIN ] TFIN: Fetched primary data is valid. [2025-10-02T21:52:15.965715] [DEBUG] [LOCAL ] TFIN: Saving primary data. [2025-10-02T21:52:15.966495] [DEBUG] [LOCAL ] TFIN: Trimmed 31316 records to 23641 (keeping 200 days of data) [2025-10-02T21:52:16.113921] [DEBUG] [LOCAL ] TFIN: Primary data saved (23641 records). [2025-10-02T21:52:16.114059] [INFO ] [MAIN ] TFIN: Full history saved. [2025-10-02T21:52:16.114151] [INFO ] [MAIN ] Update Progress: 2074/2370 symbols completed. TFIN took 24.9s. Estimated remaining: 41m 42s. Rate: 7.1 symbols/min [2025-10-02T21:52:16.273687] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-01. [2025-10-02T21:52:16.297311] [INFO ] [MAIN ] TG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:52:16.310894] [DEBUG] [LOCAL ] TG: Loaded 10408 existing records from primary storage. [2025-10-02T21:52:16.311139] [INFO ] [MAIN ] TG: Loaded 10408 existing records. [2025-10-02T21:52:16.498374] [WARN ] [MAIN ] TG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:52:16.498611] [INFO ] [MAIN ] TG: Wiping existing primary data before full refresh. [2025-10-02T21:52:16.498687] [INFO ] [LOCAL ] TG: Starting deletion of primary data. [2025-10-02T21:52:16.498892] [DEBUG] [LOCAL ] TG: Deleted primary data file. [2025-10-02T21:52:16.498952] [INFO ] [MAIN ] TG: Starting full primary refresh. [2025-10-02T21:52:16.920377] [INFO ] [REMOTE ] TG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:52:16.946076] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-02T21:52:17.073000] [INFO ] [REMOTE ] TG: Fetching primary data for 2024-12. [2025-10-02T21:52:17.746413] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-02T21:52:17.872978] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-04. [2025-10-02T21:52:18.028633] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-02T21:52:18.673114] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-08. [2025-10-02T21:52:18.996436] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-02T21:52:19.473008] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-02. [2025-10-02T21:52:20.038748] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-02T21:52:20.273054] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-05. [2025-10-02T21:52:20.961276] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-02T21:52:21.072984] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-03. [2025-10-02T21:52:21.369241] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-02T21:52:21.873011] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-06. [2025-10-02T21:52:22.642612] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-02T21:52:22.672962] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-04. [2025-10-02T21:52:23.375113] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-02T21:52:23.473026] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-09. [2025-10-02T21:52:24.272981] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-01. [2025-10-02T21:52:24.322187] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-02T21:52:24.738237] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-02T21:52:25.038593] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-02T21:52:25.073005] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-02. [2025-10-02T21:52:25.807869] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-02T21:52:25.873049] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-07. [2025-10-02T21:52:26.673047] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-03. [2025-10-02T21:52:27.026887] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-02T21:52:27.369445] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-02T21:52:27.473073] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-05. [2025-10-02T21:52:28.273002] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-04. [2025-10-02T21:52:28.955053] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-02T21:52:29.073005] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-08. [2025-10-02T21:52:29.097570] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-02T21:52:29.873024] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-10. [2025-10-02T21:52:30.655920] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-02T21:52:30.658796] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-02T21:52:30.668595] [INFO ] [REMOTE ] TFII: Full fetch complete (47812 records). [2025-10-02T21:52:30.669108] [DEBUG] [VALIDATOR ] TFII: Validating primary data. [2025-10-02T21:52:30.681407] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-09. [2025-10-02T21:52:31.097177] [DEBUG] [VALIDATOR ] TFII: All expected trading days are present. [2025-10-02T21:52:31.097265] [DEBUG] [VALIDATOR ] TFII: Primary data validation passed. [2025-10-02T21:52:31.098384] [INFO ] [MAIN ] TFII: Fetched primary data is valid. [2025-10-02T21:52:31.098454] [DEBUG] [LOCAL ] TFII: Saving primary data. [2025-10-02T21:52:31.099588] [DEBUG] [LOCAL ] TFII: Trimmed 47812 records to 33919 (keeping 200 days of data) [2025-10-02T21:52:31.325164] [DEBUG] [LOCAL ] TFII: Primary data saved (33919 records). [2025-10-02T21:52:31.325310] [INFO ] [MAIN ] TFII: Full history saved. [2025-10-02T21:52:31.325395] [INFO ] [MAIN ] Update Progress: 2075/2370 symbols completed. TFII took 43.9s. Estimated remaining: 41m 35s. Rate: 7.1 symbols/min [2025-10-02T21:52:31.475807] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-06. [2025-10-02T21:52:31.510812] [INFO ] [MAIN ] TGE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:52:31.510984] [DEBUG] [LOCAL ] TGE: No existing data file found in primary storage. [2025-10-02T21:52:31.511023] [WARN ] [MAIN ] TGE: No existing data found, performing full refresh instead. [2025-10-02T21:52:31.511137] [INFO ] [MAIN ] TGE: Wiping existing primary data before full refresh. [2025-10-02T21:52:31.511179] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-10-02T21:52:31.511220] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-10-02T21:52:31.511254] [INFO ] [MAIN ] TGE: Starting full primary refresh. [2025-10-02T21:52:31.893765] [INFO ] [REMOTE ] TGE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:52:32.273025] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-05. [2025-10-02T21:52:32.396076] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-02T21:52:32.532384] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-02T21:52:33.074691] [INFO ] [REMOTE ] TGE: Fetching primary data for 2024-12. [2025-10-02T21:52:33.081788] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-02T21:52:33.290759] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T21:52:33.291204] [WARN ] [REMOTE ] TGE: No data returned for month 2024-12 [2025-10-02T21:52:33.291328] [FATAL] [REMOTE ] TGE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T21:52:33.291402] [FATAL] [MAIN ] TGE: Failed to fetch primary data. [2025-10-02T21:52:33.291465] [WARN ] [MAIN ] TGE: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T21:52:33.291523] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-10-02T21:52:33.291603] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-10-02T21:52:33.291687] [INFO ] [LOCAL ] TGE: Starting deletion of derivative data. [2025-10-02T21:52:33.291808] [DEBUG] [LOCAL ] TGE: No derivative data file found to delete. [2025-10-02T21:52:33.291897] [INFO ] [MAIN ] Update Progress: 2076/2370 symbols completed. TGE took 2.0s. Estimated remaining: 41m 25s. Rate: 7.1 symbols/min [2025-10-02T21:52:33.595108] [INFO ] [MAIN ] TGLS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:52:33.636956] [DEBUG] [LOCAL ] TGLS: Loaded 27989 existing records from primary storage. [2025-10-02T21:52:33.637354] [INFO ] [MAIN ] TGLS: Loaded 27989 existing records. [2025-10-02T21:52:33.885427] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-10. [2025-10-02T21:52:33.955261] [WARN ] [MAIN ] TGLS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:52:33.956097] [INFO ] [MAIN ] TGLS: Wiping existing primary data before full refresh. [2025-10-02T21:52:33.956337] [INFO ] [LOCAL ] TGLS: Starting deletion of primary data. [2025-10-02T21:52:33.956682] [DEBUG] [LOCAL ] TGLS: Deleted primary data file. [2025-10-02T21:52:33.956759] [INFO ] [MAIN ] TGLS: Starting full primary refresh. [2025-10-02T21:52:34.458067] [INFO ] [REMOTE ] TGLS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:52:34.672993] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2024-12. [2025-10-02T21:52:35.021010] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-02T21:52:35.023003] [INFO ] [REMOTE ] TFPM: Full fetch complete (51347 records). [2025-10-02T21:52:35.023129] [DEBUG] [VALIDATOR ] TFPM: Validating primary data. [2025-10-02T21:52:35.473801] [DEBUG] [VALIDATOR ] TFPM: All expected trading days are present. [2025-10-02T21:52:35.473976] [DEBUG] [VALIDATOR ] TFPM: Primary data validation passed. [2025-10-02T21:52:35.475229] [INFO ] [MAIN ] TFPM: Fetched primary data is valid. [2025-10-02T21:52:35.473348] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-06. [2025-10-02T21:52:35.475453] [DEBUG] [LOCAL ] TFPM: Saving primary data. [2025-10-02T21:52:35.477752] [DEBUG] [LOCAL ] TFPM: Trimmed 51347 records to 38300 (keeping 200 days of data) [2025-10-02T21:52:35.726455] [DEBUG] [LOCAL ] TFPM: Primary data saved (38300 records). [2025-10-02T21:52:35.726609] [INFO ] [MAIN ] TFPM: Full history saved. [2025-10-02T21:52:35.727229] [INFO ] [MAIN ] Update Progress: 2077/2370 symbols completed. TFPM took 40.5s. Estimated remaining: 41m 16s. Rate: 7.1 symbols/min [2025-10-02T21:52:35.798476] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-02T21:52:35.987474] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-02T21:52:36.273032] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-01. [2025-10-02T21:52:37.073065] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-07. [2025-10-02T21:52:37.570512] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-02T21:52:37.683040] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-02T21:52:37.873049] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-02. [2025-10-02T21:52:38.673033] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-08. [2025-10-02T21:52:39.140171] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-02T21:52:39.473029] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-07. [2025-10-02T21:52:39.529090] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-02T21:52:40.272996] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-09. [2025-10-02T21:52:41.063313] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-02T21:52:41.072950] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-08. [2025-10-02T21:52:41.166556] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-02T21:52:41.873054] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-10. [2025-10-02T21:52:42.462666] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-02T21:52:42.463704] [INFO ] [REMOTE ] TG: Full fetch complete (15118 records). [2025-10-02T21:52:42.463783] [DEBUG] [VALIDATOR ] TG: Validating primary data. [2025-10-02T21:52:42.675913] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-03. [2025-10-02T21:52:42.827118] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-02T21:52:42.935321] [DEBUG] [VALIDATOR ] TG: All expected trading days are present. [2025-10-02T21:52:42.935409] [DEBUG] [VALIDATOR ] TG: Primary data validation passed. [2025-10-02T21:52:42.935803] [INFO ] [MAIN ] TG: Fetched primary data is valid. [2025-10-02T21:52:42.935866] [DEBUG] [LOCAL ] TG: Saving primary data. [2025-10-02T21:52:42.936632] [DEBUG] [LOCAL ] TG: Trimmed 15118 records to 10488 (keeping 200 days of data) [2025-10-02T21:52:43.003433] [DEBUG] [LOCAL ] TG: Primary data saved (10488 records). [2025-10-02T21:52:43.003604] [INFO ] [MAIN ] TG: Full history saved. [2025-10-02T21:52:43.003733] [INFO ] [MAIN ] Update Progress: 2078/2370 symbols completed. TG took 26.9s. Estimated remaining: 41m 7s. Rate: 7.1 symbols/min [2025-10-02T21:52:43.473042] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-09. [2025-10-02T21:52:44.149549] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-02T21:52:44.273025] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-04. [2025-10-02T21:52:45.203125] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-02T21:52:45.212895] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-10. [2025-10-02T21:52:45.271157] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-02T21:52:45.873011] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-05. [2025-10-02T21:52:46.391079] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-02T21:52:46.392849] [INFO ] [REMOTE ] TFX: Full fetch complete (54498 records). [2025-10-02T21:52:46.392967] [DEBUG] [VALIDATOR ] TFX: Validating primary data. [2025-10-02T21:52:46.821137] [DEBUG] [VALIDATOR ] TFX: All expected trading days are present. [2025-10-02T21:52:46.821285] [DEBUG] [VALIDATOR ] TFX: Primary data validation passed. [2025-10-02T21:52:46.822430] [INFO ] [MAIN ] TFX: Fetched primary data is valid. [2025-10-02T21:52:46.822505] [DEBUG] [LOCAL ] TFX: Saving primary data. [2025-10-02T21:52:46.823967] [DEBUG] [LOCAL ] TFX: Trimmed 54498 records to 37363 (keeping 200 days of data) [2025-10-02T21:52:47.078060] [DEBUG] [LOCAL ] TFX: Primary data saved (37363 records). [2025-10-02T21:52:47.078218] [INFO ] [MAIN ] TFX: Full history saved. [2025-10-02T21:52:47.078311] [INFO ] [MAIN ] Update Progress: 2079/2370 symbols completed. TFX took 38.5s. Estimated remaining: 40m 58s. Rate: 7.1 symbols/min [2025-10-02T21:52:47.246959] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-02T21:52:47.254247] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-06. [2025-10-02T21:52:48.397531] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-02T21:52:48.403873] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-07. [2025-10-02T21:52:49.566357] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-02T21:52:49.572798] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-08. [2025-10-02T21:52:50.929522] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-02T21:52:50.936863] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-09. [2025-10-02T21:52:52.182966] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-02T21:52:52.193639] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-10. [2025-10-02T21:52:53.025951] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-02T21:52:53.027374] [INFO ] [REMOTE ] TGLS: Full fetch complete (40481 records). [2025-10-02T21:52:53.027460] [DEBUG] [VALIDATOR ] TGLS: Validating primary data. [2025-10-02T21:52:53.444659] [DEBUG] [VALIDATOR ] TGLS: All expected trading days are present. [2025-10-02T21:52:53.444760] [DEBUG] [VALIDATOR ] TGLS: Primary data validation passed. [2025-10-02T21:52:53.445727] [INFO ] [MAIN ] TGLS: Fetched primary data is valid. [2025-10-02T21:52:53.445795] [DEBUG] [LOCAL ] TGLS: Saving primary data. [2025-10-02T21:52:53.446856] [DEBUG] [LOCAL ] TGLS: Trimmed 40481 records to 28157 (keeping 200 days of data) [2025-10-02T21:52:53.635138] [DEBUG] [LOCAL ] TGLS: Primary data saved (28157 records). [2025-10-02T21:52:53.635287] [INFO ] [MAIN ] TGLS: Full history saved. [2025-10-02T21:52:53.635377] [INFO ] [MAIN ] Update Progress: 2080/2370 symbols completed. TGLS took 20.3s. Estimated remaining: 40m 50s. Rate: 7.1 symbols/min [2025-10-02T21:52:54.287859] [INFO ] [MAIN ] TGT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:52:54.388344] [INFO ] [MAIN ] TGNA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:52:54.384021] [INFO ] [MAIN ] TGS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:52:54.408578] [INFO ] [MAIN ] THC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:52:54.476749] [DEBUG] [LOCAL ] TGS: Loaded 32839 existing records from primary storage. [2025-10-02T21:52:54.487109] [INFO ] [MAIN ] TGS: Loaded 32839 existing records. [2025-10-02T21:52:54.650438] [DEBUG] [LOCAL ] TGNA: Loaded 48684 existing records from primary storage. [2025-10-02T21:52:54.650310] [DEBUG] [LOCAL ] TGT: Loaded 53778 existing records from primary storage. [2025-10-02T21:52:54.648486] [DEBUG] [LOCAL ] THC: Loaded 47674 existing records from primary storage. [2025-10-02T21:52:54.651100] [INFO ] [MAIN ] TGT: Loaded 53778 existing records. [2025-10-02T21:52:54.651689] [INFO ] [MAIN ] TGNA: Loaded 48684 existing records. [2025-10-02T21:52:54.706268] [INFO ] [MAIN ] THC: Loaded 47674 existing records. [2025-10-02T21:52:54.907993] [WARN ] [MAIN ] TGS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:52:54.958838] [INFO ] [MAIN ] TGS: Wiping existing primary data before full refresh. [2025-10-02T21:52:55.011918] [INFO ] [LOCAL ] TGS: Starting deletion of primary data. [2025-10-02T21:52:55.027634] [DEBUG] [LOCAL ] TGS: Deleted primary data file. [2025-10-02T21:52:55.071093] [INFO ] [MAIN ] TGS: Starting full primary refresh. [2025-10-02T21:52:55.360338] [WARN ] [MAIN ] TGNA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:52:55.439508] [INFO ] [MAIN ] TGNA: Wiping existing primary data before full refresh. [2025-10-02T21:52:55.460315] [WARN ] [MAIN ] THC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:52:55.460730] [INFO ] [MAIN ] THC: Wiping existing primary data before full refresh. [2025-10-02T21:52:55.460557] [INFO ] [LOCAL ] TGNA: Starting deletion of primary data. [2025-10-02T21:52:55.460824] [INFO ] [LOCAL ] THC: Starting deletion of primary data. [2025-10-02T21:52:55.466024] [WARN ] [MAIN ] TGT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:52:55.466403] [INFO ] [MAIN ] TGT: Wiping existing primary data before full refresh. [2025-10-02T21:52:55.466607] [DEBUG] [LOCAL ] THC: Deleted primary data file. [2025-10-02T21:52:55.466731] [INFO ] [LOCAL ] TGT: Starting deletion of primary data. [2025-10-02T21:52:55.466526] [DEBUG] [LOCAL ] TGNA: Deleted primary data file. [2025-10-02T21:52:55.487967] [INFO ] [MAIN ] TGNA: Starting full primary refresh. [2025-10-02T21:52:55.482661] [INFO ] [MAIN ] THC: Starting full primary refresh. [2025-10-02T21:52:55.498379] [DEBUG] [LOCAL ] TGT: Deleted primary data file. [2025-10-02T21:52:55.510735] [INFO ] [MAIN ] TGT: Starting full primary refresh. [2025-10-02T21:52:56.687977] [INFO ] [REMOTE ] TGS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:52:56.745402] [INFO ] [REMOTE ] TGS: Fetching primary data for 2024-12. [2025-10-02T21:52:56.739931] [INFO ] [REMOTE ] THC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:52:56.793469] [INFO ] [REMOTE ] THC: Fetching primary data for 2024-12. [2025-10-02T21:52:56.941862] [INFO ] [REMOTE ] TGNA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:52:56.966295] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2024-12. [2025-10-02T21:52:56.966009] [INFO ] [REMOTE ] TGT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:52:56.967442] [INFO ] [REMOTE ] TGT: Fetching primary data for 2024-12. [2025-10-02T21:52:57.955799] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-02T21:52:57.962765] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-01. [2025-10-02T21:52:58.551364] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-02T21:52:58.562401] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-01. [2025-10-02T21:52:58.590754] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-02T21:52:58.602540] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-01. [2025-10-02T21:52:59.358286] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-10-02T21:52:59.369899] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-01. [2025-10-02T21:52:59.394040] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-02T21:52:59.402218] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-02. [2025-10-02T21:52:59.835533] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-02T21:52:59.844971] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-02. [2025-10-02T21:52:59.983858] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-02T21:52:59.993912] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-02. [2025-10-02T21:53:00.395344] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-02T21:53:00.403211] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-03. [2025-10-02T21:53:01.471279] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-02T21:53:01.481781] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-03. [2025-10-02T21:53:01.651884] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-02T21:53:01.662199] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-03. [2025-10-02T21:53:01.710593] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-10-02T21:53:01.775617] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-02T21:53:01.872997] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-02. [2025-10-02T21:53:02.672986] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-04. [2025-10-02T21:53:02.757989] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-02T21:53:03.143683] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-02T21:53:03.473001] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-04. [2025-10-02T21:53:03.556703] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-02T21:53:03.991185] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-02T21:53:04.273013] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-05. [2025-10-02T21:53:05.074073] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-04. [2025-10-02T21:53:05.080110] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-02T21:53:05.575542] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-02T21:53:05.872996] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-03. [2025-10-02T21:53:06.673029] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-06. [2025-10-02T21:53:06.715560] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-02T21:53:07.473045] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-05. [2025-10-02T21:53:07.927925] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-02T21:53:08.264292] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-10-02T21:53:08.277585] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-05. [2025-10-02T21:53:09.073145] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-07. [2025-10-02T21:53:09.150421] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-02T21:53:09.829412] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-02T21:53:09.872966] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-06. [2025-10-02T21:53:10.492555] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-02T21:53:10.673035] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-06. [2025-10-02T21:53:11.473032] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-04. [2025-10-02T21:53:11.681460] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-02T21:53:12.247557] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-02T21:53:12.273000] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-07. [2025-10-02T21:53:13.073069] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-08. [2025-10-02T21:53:13.853356] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-10-02T21:53:13.872972] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-05. [2025-10-02T21:53:14.142443] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-02T21:53:14.417975] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-02T21:53:14.673020] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-08. [2025-10-02T21:53:15.473019] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-07. [2025-10-02T21:53:16.266024] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-02T21:53:16.278105] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-09. [2025-10-02T21:53:16.280883] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-10-02T21:53:16.770892] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-02T21:53:17.073002] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-08. [2025-10-02T21:53:17.447888] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-02T21:53:17.873015] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-06. [2025-10-02T21:53:18.672995] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-10. [2025-10-02T21:53:19.017878] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-02T21:53:19.473037] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-09. [2025-10-02T21:53:19.759382] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-02T21:53:19.820088] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-02T21:53:19.822139] [INFO ] [REMOTE ] TGS: Full fetch complete (47970 records). [2025-10-02T21:53:19.822222] [DEBUG] [VALIDATOR ] TGS: Validating primary data. [2025-10-02T21:53:20.232851] [DEBUG] [VALIDATOR ] TGS: All expected trading days are present. [2025-10-02T21:53:20.232944] [DEBUG] [VALIDATOR ] TGS: Primary data validation passed. [2025-10-02T21:53:20.233911] [INFO ] [MAIN ] TGS: Fetched primary data is valid. [2025-10-02T21:53:20.233975] [DEBUG] [LOCAL ] TGS: Saving primary data. [2025-10-02T21:53:20.234999] [DEBUG] [LOCAL ] TGS: Trimmed 47970 records to 33155 (keeping 200 days of data) [2025-10-02T21:53:20.285637] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-07. [2025-10-02T21:53:20.442528] [DEBUG] [LOCAL ] TGS: Primary data saved (33155 records). [2025-10-02T21:53:20.442730] [INFO ] [MAIN ] TGS: Full history saved. [2025-10-02T21:53:20.442863] [INFO ] [MAIN ] Update Progress: 2081/2370 symbols completed. TGS took 26.8s. Estimated remaining: 40m 44s. Rate: 7.1 symbols/min [2025-10-02T21:53:20.631425] [INFO ] [MAIN ] THG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:53:20.655282] [DEBUG] [LOCAL ] THG: Loaded 21689 existing records from primary storage. [2025-10-02T21:53:20.655553] [INFO ] [MAIN ] THG: Loaded 21689 existing records. [2025-10-02T21:53:20.851891] [WARN ] [MAIN ] THG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:53:20.852110] [INFO ] [MAIN ] THG: Wiping existing primary data before full refresh. [2025-10-02T21:53:20.852191] [INFO ] [LOCAL ] THG: Starting deletion of primary data. [2025-10-02T21:53:20.852544] [DEBUG] [LOCAL ] THG: Deleted primary data file. [2025-10-02T21:53:20.852604] [INFO ] [MAIN ] THG: Starting full primary refresh. [2025-10-02T21:53:21.079804] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-09. [2025-10-02T21:53:21.240046] [INFO ] [REMOTE ] THG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:53:21.265352] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-02T21:53:21.873009] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-10. [2025-10-02T21:53:22.691593] [INFO ] [REMOTE ] THG: Fetching primary data for 2024-12. [2025-10-02T21:53:22.695080] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-10-02T21:53:22.781675] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-02T21:53:23.141579] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-02T21:53:23.143403] [INFO ] [REMOTE ] THC: Full fetch complete (69182 records). [2025-10-02T21:53:23.143527] [DEBUG] [VALIDATOR ] THC: Validating primary data. [2025-10-02T21:53:23.480696] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-08. [2025-10-02T21:53:23.587540] [DEBUG] [VALIDATOR ] THC: All expected trading days are present. [2025-10-02T21:53:23.587717] [DEBUG] [VALIDATOR ] THC: Primary data validation passed. [2025-10-02T21:53:23.588969] [INFO ] [MAIN ] THC: Fetched primary data is valid. [2025-10-02T21:53:23.589040] [DEBUG] [LOCAL ] THC: Saving primary data. [2025-10-02T21:53:23.590501] [DEBUG] [LOCAL ] THC: Trimmed 69182 records to 47953 (keeping 200 days of data) [2025-10-02T21:53:23.905906] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-02T21:53:23.944208] [DEBUG] [LOCAL ] THC: Primary data saved (47953 records). [2025-10-02T21:53:23.944455] [INFO ] [MAIN ] THC: Full history saved. [2025-10-02T21:53:23.944815] [INFO ] [MAIN ] Update Progress: 2082/2370 symbols completed. THC took 30.3s. Estimated remaining: 40m 35s. Rate: 7.1 symbols/min [2025-10-02T21:53:24.194302] [INFO ] [MAIN ] THIR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:53:24.201810] [DEBUG] [LOCAL ] THIR: Loaded 2204 existing records from primary storage. [2025-10-02T21:53:24.202011] [INFO ] [MAIN ] THIR: Loaded 2204 existing records. [2025-10-02T21:53:24.282698] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-01. [2025-10-02T21:53:24.399007] [WARN ] [MAIN ] THIR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:53:24.399235] [INFO ] [MAIN ] THIR: Wiping existing primary data before full refresh. [2025-10-02T21:53:24.399286] [INFO ] [LOCAL ] THIR: Starting deletion of primary data. [2025-10-02T21:53:24.399469] [DEBUG] [LOCAL ] THIR: Deleted primary data file. [2025-10-02T21:53:24.399542] [INFO ] [MAIN ] THIR: Starting full primary refresh. [2025-10-02T21:53:24.789666] [INFO ] [REMOTE ] THIR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:53:25.073016] [INFO ] [REMOTE ] THIR: Fetching primary data for 2024-12. [2025-10-02T21:53:25.377727] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-02T21:53:25.467793] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-10-02T21:53:25.561366] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-02T21:53:25.872995] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-01. [2025-10-02T21:53:26.227190] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-02T21:53:26.673014] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-02. [2025-10-02T21:53:26.927191] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-02 (0.25 seconds). [2025-10-02T21:53:27.473042] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-03. [2025-10-02T21:53:27.900582] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-02T21:53:28.273011] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-09. [2025-10-02T21:53:29.073010] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-02. [2025-10-02T21:53:29.873032] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-04. [2025-10-02T21:53:29.922145] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-02T21:53:30.325517] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-02T21:53:30.629806] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-10-02T21:53:30.672988] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-10. [2025-10-02T21:53:31.473041] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-05. [2025-10-02T21:53:31.915887] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-02T21:53:32.272996] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-03. [2025-10-02T21:53:32.655515] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-02T21:53:32.657946] [INFO ] [REMOTE ] TGT: Full fetch complete (77860 records). [2025-10-02T21:53:32.658118] [DEBUG] [VALIDATOR ] TGT: Validating primary data. [2025-10-02T21:53:33.080621] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-06. [2025-10-02T21:53:33.085537] [DEBUG] [VALIDATOR ] TGT: All expected trading days are present. [2025-10-02T21:53:33.085599] [DEBUG] [VALIDATOR ] TGT: Primary data validation passed. [2025-10-02T21:53:33.086975] [INFO ] [MAIN ] TGT: Fetched primary data is valid. [2025-10-02T21:53:33.087101] [DEBUG] [LOCAL ] TGT: Saving primary data. [2025-10-02T21:53:33.089237] [DEBUG] [LOCAL ] TGT: Trimmed 77860 records to 54168 (keeping 200 days of data) [2025-10-02T21:53:33.445867] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-02T21:53:33.473610] [DEBUG] [LOCAL ] TGT: Primary data saved (54168 records). [2025-10-02T21:53:33.473771] [INFO ] [MAIN ] TGT: Full history saved. [2025-10-02T21:53:33.476296] [INFO ] [MAIN ] Update Progress: 2083/2370 symbols completed. TGT took 39.8s. Estimated remaining: 40m 26s. Rate: 7.1 symbols/min [2025-10-02T21:53:33.668409] [INFO ] [MAIN ] THLV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:53:33.672741] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-02T21:53:33.677792] [DEBUG] [LOCAL ] THLV: Loaded 1543 existing records from primary storage. [2025-10-02T21:53:33.677995] [INFO ] [MAIN ] THLV: Loaded 1543 existing records. [2025-10-02T21:53:33.866468] [WARN ] [MAIN ] THLV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:53:33.866741] [INFO ] [MAIN ] THLV: Wiping existing primary data before full refresh. [2025-10-02T21:53:33.866808] [INFO ] [LOCAL ] THLV: Starting deletion of primary data. [2025-10-02T21:53:33.867013] [DEBUG] [LOCAL ] THLV: Deleted primary data file. [2025-10-02T21:53:33.867072] [INFO ] [MAIN ] THLV: Starting full primary refresh. [2025-10-02T21:53:33.878219] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-07. [2025-10-02T21:53:34.255338] [INFO ] [REMOTE ] THLV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:53:34.437791] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-02T21:53:34.673008] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-08. [2025-10-02T21:53:35.267846] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-02T21:53:35.473056] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-04. [2025-10-02T21:53:36.273024] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-10. [2025-10-02T21:53:37.009955] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-02T21:53:37.073013] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-09. [2025-10-02T21:53:37.529703] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-02T21:53:37.873006] [INFO ] [REMOTE ] THLV: Fetching primary data for 2024-12. [2025-10-02T21:53:38.308152] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-02T21:53:38.490758] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-02T21:53:38.493697] [INFO ] [REMOTE ] TGNA: Full fetch complete (69995 records). [2025-10-02T21:53:38.493862] [DEBUG] [VALIDATOR ] TGNA: Validating primary data. [2025-10-02T21:53:38.674309] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-05. [2025-10-02T21:53:38.920030] [DEBUG] [VALIDATOR ] TGNA: All expected trading days are present. [2025-10-02T21:53:38.920181] [DEBUG] [VALIDATOR ] TGNA: Primary data validation passed. [2025-10-02T21:53:38.921503] [INFO ] [MAIN ] TGNA: Fetched primary data is valid. [2025-10-02T21:53:38.921570] [DEBUG] [LOCAL ] TGNA: Saving primary data. [2025-10-02T21:53:38.923008] [DEBUG] [LOCAL ] TGNA: Trimmed 69995 records to 49036 (keeping 200 days of data) [2025-10-02T21:53:39.254363] [DEBUG] [LOCAL ] TGNA: Primary data saved (49036 records). [2025-10-02T21:53:39.254500] [INFO ] [MAIN ] TGNA: Full history saved. [2025-10-02T21:53:39.255689] [INFO ] [MAIN ] Update Progress: 2084/2370 symbols completed. TGNA took 45.6s. Estimated remaining: 40m 17s. Rate: 7.1 symbols/min [2025-10-02T21:53:39.435828] [INFO ] [MAIN ] THO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:53:39.477446] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-01. [2025-10-02T21:53:39.479543] [DEBUG] [LOCAL ] THO: Loaded 41945 existing records from primary storage. [2025-10-02T21:53:39.479953] [INFO ] [MAIN ] THO: Loaded 41945 existing records. [2025-10-02T21:53:39.685472] [WARN ] [MAIN ] THO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:53:39.685738] [INFO ] [MAIN ] THO: Wiping existing primary data before full refresh. [2025-10-02T21:53:39.685795] [INFO ] [LOCAL ] THO: Starting deletion of primary data. [2025-10-02T21:53:39.686064] [DEBUG] [LOCAL ] THO: Deleted primary data file. [2025-10-02T21:53:39.686141] [INFO ] [MAIN ] THO: Starting full primary refresh. [2025-10-02T21:53:40.002578] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-02T21:53:40.013139] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-02T21:53:40.098919] [INFO ] [REMOTE ] THO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:53:40.272993] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-06. [2025-10-02T21:53:41.043603] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-02T21:53:41.072999] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-07. [2025-10-02T21:53:41.873057] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-10. [2025-10-02T21:53:42.196296] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-02T21:53:42.197389] [INFO ] [REMOTE ] THIR: Full fetch complete (2747 records). [2025-10-02T21:53:42.197508] [DEBUG] [VALIDATOR ] THIR: Validating primary data. [2025-10-02T21:53:42.677051] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-02. [2025-10-02T21:53:42.710666] [DEBUG] [VALIDATOR ] THIR: All expected trading days are present. [2025-10-02T21:53:42.710840] [DEBUG] [VALIDATOR ] THIR: Primary data validation passed. [2025-10-02T21:53:42.711149] [INFO ] [MAIN ] THIR: Fetched primary data is valid. [2025-10-02T21:53:42.711243] [DEBUG] [LOCAL ] THIR: Saving primary data. [2025-10-02T21:53:42.731303] [DEBUG] [LOCAL ] THIR: Trimmed 2747 records to 2221 (keeping 200 days of data) [2025-10-02T21:53:42.733709] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-02T21:53:42.754279] [DEBUG] [LOCAL ] THIR: Primary data saved (2221 records). [2025-10-02T21:53:42.754396] [INFO ] [MAIN ] THIR: Full history saved. [2025-10-02T21:53:42.754473] [INFO ] [MAIN ] Update Progress: 2085/2370 symbols completed. THIR took 18.8s. Estimated remaining: 40m 8s. Rate: 7.1 symbols/min [2025-10-02T21:53:42.949803] [INFO ] [MAIN ] THQ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:53:42.983307] [DEBUG] [LOCAL ] THQ: Loaded 24975 existing records from primary storage. [2025-10-02T21:53:42.983707] [INFO ] [MAIN ] THQ: Loaded 24975 existing records. [2025-10-02T21:53:43.098200] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-02T21:53:43.185092] [WARN ] [MAIN ] THQ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:53:43.185301] [INFO ] [MAIN ] THQ: Wiping existing primary data before full refresh. [2025-10-02T21:53:43.185350] [INFO ] [LOCAL ] THQ: Starting deletion of primary data. [2025-10-02T21:53:43.185595] [DEBUG] [LOCAL ] THQ: Deleted primary data file. [2025-10-02T21:53:43.185695] [INFO ] [MAIN ] THQ: Starting full primary refresh. [2025-10-02T21:53:43.481321] [INFO ] [REMOTE ] THO: Fetching primary data for 2024-12. [2025-10-02T21:53:43.568284] [INFO ] [REMOTE ] THQ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:53:44.273012] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-08. [2025-10-02T21:53:45.028442] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-02T21:53:45.073000] [INFO ] [REMOTE ] THQ: Fetching primary data for 2024-12. [2025-10-02T21:53:45.095680] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-02T21:53:45.872988] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-09. [2025-10-02T21:53:46.189245] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-02T21:53:46.673006] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-01. [2025-10-02T21:53:46.976123] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-02T21:53:47.472997] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-10. [2025-10-02T21:53:48.205082] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-02T21:53:48.218383] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-02T21:53:48.220238] [INFO ] [REMOTE ] THG: Full fetch complete (31196 records). [2025-10-02T21:53:48.220331] [DEBUG] [VALIDATOR ] THG: Validating primary data. [2025-10-02T21:53:48.278187] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-01. [2025-10-02T21:53:48.655190] [DEBUG] [VALIDATOR ] THG: All expected trading days are present. [2025-10-02T21:53:48.655280] [DEBUG] [VALIDATOR ] THG: Primary data validation passed. [2025-10-02T21:53:48.656076] [INFO ] [MAIN ] THG: Fetched primary data is valid. [2025-10-02T21:53:48.656148] [DEBUG] [LOCAL ] THG: Saving primary data. [2025-10-02T21:53:48.657153] [DEBUG] [LOCAL ] THG: Trimmed 31196 records to 21842 (keeping 200 days of data) [2025-10-02T21:53:48.814831] [DEBUG] [LOCAL ] THG: Primary data saved (21842 records). [2025-10-02T21:53:48.814974] [INFO ] [MAIN ] THG: Full history saved. [2025-10-02T21:53:48.815082] [INFO ] [MAIN ] Update Progress: 2086/2370 symbols completed. THG took 28.4s. Estimated remaining: 39m 60s. Rate: 7.1 symbols/min [2025-10-02T21:53:49.002313] [INFO ] [MAIN ] THR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:53:49.024224] [DEBUG] [LOCAL ] THR: Loaded 19834 existing records from primary storage. [2025-10-02T21:53:49.024503] [INFO ] [MAIN ] THR: Loaded 19834 existing records. [2025-10-02T21:53:49.081068] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-03. [2025-10-02T21:53:49.215924] [WARN ] [MAIN ] THR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:53:49.216127] [INFO ] [MAIN ] THR: Wiping existing primary data before full refresh. [2025-10-02T21:53:49.216179] [INFO ] [LOCAL ] THR: Starting deletion of primary data. [2025-10-02T21:53:49.216384] [DEBUG] [LOCAL ] THR: Deleted primary data file. [2025-10-02T21:53:49.216444] [INFO ] [MAIN ] THR: Starting full primary refresh. [2025-10-02T21:53:49.609378] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-02T21:53:49.609204] [INFO ] [REMOTE ] THR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:53:49.638123] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-02T21:53:49.873034] [INFO ] [REMOTE ] THR: Fetching primary data for 2024-12. [2025-10-02T21:53:50.672978] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-04. [2025-10-02T21:53:50.960143] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-02T21:53:51.102982] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-02T21:53:51.472999] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-01. [2025-10-02T21:53:52.273000] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-02. [2025-10-02T21:53:52.535827] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-02T21:53:53.073010] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-05. [2025-10-02T21:53:53.253850] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-02T21:53:53.392220] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-02T21:53:53.873023] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-02. [2025-10-02T21:53:54.673037] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-02. [2025-10-02T21:53:54.727131] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-02T21:53:55.473019] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-06. [2025-10-02T21:53:55.806380] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-02T21:53:56.101063] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-02T21:53:56.273013] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-03. [2025-10-02T21:53:57.046924] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-02T21:53:57.072993] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-04. [2025-10-02T21:53:57.850082] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-02T21:53:57.872957] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-03. [2025-10-02T21:53:58.672988] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-03. [2025-10-02T21:53:58.963240] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-02T21:53:59.472996] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-05. [2025-10-02T21:54:00.272967] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-07. [2025-10-02T21:54:00.321572] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-02T21:54:00.358381] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-02T21:54:00.647191] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-02T21:54:01.072993] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-08. [2025-10-02T21:54:01.494906] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-02T21:54:01.873246] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-04. [2025-10-02T21:54:02.672992] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-04. [2025-10-02T21:54:02.730311] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-02T21:54:03.473006] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-05. [2025-10-02T21:54:04.066310] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-02T21:54:04.273026] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-06. [2025-10-02T21:54:04.582826] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-02T21:54:05.073005] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-05. [2025-10-02T21:54:05.251916] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-02T21:54:05.873036] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-09. [2025-10-02T21:54:06.274312] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-02T21:54:06.673245] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-10. [2025-10-02T21:54:06.676216] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-02T21:54:06.953465] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-10 (0.28 seconds). [2025-10-02T21:54:06.954411] [INFO ] [REMOTE ] THLV: Full fetch complete (2636 records). [2025-10-02T21:54:06.954502] [DEBUG] [VALIDATOR ] THLV: Validating primary data. [2025-10-02T21:54:07.414824] [DEBUG] [VALIDATOR ] THLV: All expected trading days are present. [2025-10-02T21:54:07.414965] [DEBUG] [VALIDATOR ] THLV: Primary data validation passed. [2025-10-02T21:54:07.415173] [INFO ] [MAIN ] THLV: Fetched primary data is valid. [2025-10-02T21:54:07.415249] [DEBUG] [LOCAL ] THLV: Saving primary data. [2025-10-02T21:54:07.415760] [DEBUG] [LOCAL ] THLV: Trimmed 2636 records to 1553 (keeping 200 days of data) [2025-10-02T21:54:07.427006] [DEBUG] [LOCAL ] THLV: Primary data saved (1553 records). [2025-10-02T21:54:07.427129] [INFO ] [MAIN ] THLV: Full history saved. [2025-10-02T21:54:07.427287] [INFO ] [MAIN ] Update Progress: 2087/2370 symbols completed. THLV took 34.0s. Estimated remaining: 39m 52s. Rate: 7.1 symbols/min [2025-10-02T21:54:07.478146] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-07. [2025-10-02T21:54:07.614871] [INFO ] [MAIN ] THS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:54:07.670667] [DEBUG] [LOCAL ] THS: Loaded 38195 existing records from primary storage. [2025-10-02T21:54:07.671001] [INFO ] [MAIN ] THS: Loaded 38195 existing records. [2025-10-02T21:54:07.868282] [WARN ] [MAIN ] THS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:54:07.868496] [INFO ] [MAIN ] THS: Wiping existing primary data before full refresh. [2025-10-02T21:54:07.868545] [INFO ] [LOCAL ] THS: Starting deletion of primary data. [2025-10-02T21:54:07.868799] [DEBUG] [LOCAL ] THS: Deleted primary data file. [2025-10-02T21:54:07.868859] [INFO ] [MAIN ] THS: Starting full primary refresh. [2025-10-02T21:54:08.263144] [INFO ] [REMOTE ] THS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:54:08.273004] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-06. [2025-10-02T21:54:08.604019] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-02T21:54:09.072996] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-08. [2025-10-02T21:54:09.418102] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-02T21:54:09.872982] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-06. [2025-10-02T21:54:10.229222] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-02T21:54:10.673039] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-07. [2025-10-02T21:54:11.456315] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-02T21:54:11.472967] [INFO ] [REMOTE ] THS: Fetching primary data for 2024-12. [2025-10-02T21:54:12.089450] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-02T21:54:12.273043] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-09. [2025-10-02T21:54:12.547141] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-02T21:54:13.073029] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-07. [2025-10-02T21:54:13.349557] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-02T21:54:13.873016] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-10. [2025-10-02T21:54:14.640695] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-02T21:54:14.642915] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-02T21:54:14.653393] [INFO ] [REMOTE ] THR: Full fetch complete (28709 records). [2025-10-02T21:54:14.653910] [DEBUG] [VALIDATOR ] THR: Validating primary data. [2025-10-02T21:54:14.678121] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-08. [2025-10-02T21:54:15.086691] [DEBUG] [VALIDATOR ] THR: All expected trading days are present. [2025-10-02T21:54:15.086815] [DEBUG] [VALIDATOR ] THR: Primary data validation passed. [2025-10-02T21:54:15.087499] [INFO ] [MAIN ] THR: Fetched primary data is valid. [2025-10-02T21:54:15.087543] [DEBUG] [LOCAL ] THR: Saving primary data. [2025-10-02T21:54:15.088699] [DEBUG] [LOCAL ] THR: Trimmed 28709 records to 19967 (keeping 200 days of data) [2025-10-02T21:54:15.211281] [DEBUG] [LOCAL ] THR: Primary data saved (19967 records). [2025-10-02T21:54:15.211434] [INFO ] [MAIN ] THR: Full history saved. [2025-10-02T21:54:15.211519] [INFO ] [MAIN ] Update Progress: 2088/2370 symbols completed. THR took 26.4s. Estimated remaining: 39m 44s. Rate: 7.1 symbols/min [2025-10-02T21:54:15.397745] [INFO ] [MAIN ] THW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:54:15.418708] [DEBUG] [LOCAL ] THW: Loaded 19428 existing records from primary storage. [2025-10-02T21:54:15.418994] [INFO ] [MAIN ] THW: Loaded 19428 existing records. [2025-10-02T21:54:15.480863] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-08. [2025-10-02T21:54:15.626870] [WARN ] [MAIN ] THW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:54:15.627803] [INFO ] [MAIN ] THW: Wiping existing primary data before full refresh. [2025-10-02T21:54:15.627876] [INFO ] [LOCAL ] THW: Starting deletion of primary data. [2025-10-02T21:54:15.628159] [DEBUG] [LOCAL ] THW: Deleted primary data file. [2025-10-02T21:54:15.628462] [INFO ] [MAIN ] THW: Starting full primary refresh. [2025-10-02T21:54:16.044719] [INFO ] [REMOTE ] THW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:54:16.104298] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-02T21:54:16.273034] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-09. [2025-10-02T21:54:16.834811] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-02T21:54:17.072977] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-01. [2025-10-02T21:54:17.157481] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-02T21:54:17.872984] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-10. [2025-10-02T21:54:18.634253] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-02T21:54:18.672995] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-09. [2025-10-02T21:54:18.847787] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-02T21:54:18.849433] [INFO ] [REMOTE ] THQ: Full fetch complete (35102 records). [2025-10-02T21:54:18.849534] [DEBUG] [VALIDATOR ] THQ: Validating primary data. [2025-10-02T21:54:19.273150] [DEBUG] [VALIDATOR ] THQ: All expected trading days are present. [2025-10-02T21:54:19.273265] [DEBUG] [VALIDATOR ] THQ: Primary data validation passed. [2025-10-02T21:54:19.274112] [INFO ] [MAIN ] THQ: Fetched primary data is valid. [2025-10-02T21:54:19.274176] [DEBUG] [LOCAL ] THQ: Saving primary data. [2025-10-02T21:54:19.275187] [DEBUG] [LOCAL ] THQ: Trimmed 35102 records to 25177 (keeping 200 days of data) [2025-10-02T21:54:19.443500] [DEBUG] [LOCAL ] THQ: Primary data saved (25177 records). [2025-10-02T21:54:19.443674] [INFO ] [MAIN ] THQ: Full history saved. [2025-10-02T21:54:19.443841] [INFO ] [MAIN ] Update Progress: 2089/2370 symbols completed. THQ took 36.7s. Estimated remaining: 39m 35s. Rate: 7.1 symbols/min [2025-10-02T21:54:19.478238] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-02. [2025-10-02T21:54:19.630728] [INFO ] [MAIN ] TIC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:54:19.630971] [DEBUG] [LOCAL ] TIC: No existing data file found in primary storage. [2025-10-02T21:54:19.631039] [WARN ] [MAIN ] TIC: No existing data found, performing full refresh instead. [2025-10-02T21:54:19.631167] [INFO ] [MAIN ] TIC: Wiping existing primary data before full refresh. [2025-10-02T21:54:19.631211] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-10-02T21:54:19.631255] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-10-02T21:54:19.631289] [INFO ] [MAIN ] TIC: Starting full primary refresh. [2025-10-02T21:54:20.082763] [INFO ] [REMOTE ] TIC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:54:20.272983] [INFO ] [REMOTE ] THW: Fetching primary data for 2024-12. [2025-10-02T21:54:20.348369] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-02T21:54:21.012471] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-02T21:54:21.073033] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-03. [2025-10-02T21:54:21.347162] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-02T21:54:21.873068] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-01. [2025-10-02T21:54:22.450004] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-02T21:54:22.672973] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-04. [2025-10-02T21:54:23.074731] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-02T21:54:23.473062] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-10. [2025-10-02T21:54:24.095395] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-02T21:54:24.273015] [INFO ] [REMOTE ] TIC: Fetching primary data for 2024-12. [2025-10-02T21:54:24.450430] [DEBUG] [REMOTE ] TIC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T21:54:24.450785] [WARN ] [REMOTE ] TIC: No data returned for month 2024-12 [2025-10-02T21:54:24.450881] [FATAL] [REMOTE ] TIC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T21:54:24.450973] [FATAL] [MAIN ] TIC: Failed to fetch primary data. [2025-10-02T21:54:24.451046] [WARN ] [MAIN ] TIC: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T21:54:24.451122] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-10-02T21:54:24.451189] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-10-02T21:54:24.451228] [INFO ] [LOCAL ] TIC: Starting deletion of derivative data. [2025-10-02T21:54:24.451295] [DEBUG] [LOCAL ] TIC: No derivative data file found to delete. [2025-10-02T21:54:24.451367] [INFO ] [MAIN ] Update Progress: 2090/2370 symbols completed. TIC took 5.0s. Estimated remaining: 39m 26s. Rate: 7.1 symbols/min [2025-10-02T21:54:24.643318] [INFO ] [MAIN ] TIMB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:54:24.681577] [DEBUG] [LOCAL ] TIMB: Loaded 36109 existing records from primary storage. [2025-10-02T21:54:24.682036] [INFO ] [MAIN ] TIMB: Loaded 36109 existing records. [2025-10-02T21:54:24.782054] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-02T21:54:24.812208] [INFO ] [REMOTE ] THO: Full fetch complete (60115 records). [2025-10-02T21:54:24.823042] [DEBUG] [VALIDATOR ] THO: Validating primary data. [2025-10-02T21:54:25.021252] [WARN ] [MAIN ] TIMB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:54:25.024800] [INFO ] [MAIN ] TIMB: Wiping existing primary data before full refresh. [2025-10-02T21:54:25.025276] [INFO ] [LOCAL ] TIMB: Starting deletion of primary data. [2025-10-02T21:54:25.041292] [DEBUG] [LOCAL ] TIMB: Deleted primary data file. [2025-10-02T21:54:25.041443] [INFO ] [MAIN ] TIMB: Starting full primary refresh. [2025-10-02T21:54:25.083132] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-05. [2025-10-02T21:54:25.693254] [DEBUG] [VALIDATOR ] THO: All expected trading days are present. [2025-10-02T21:54:25.704305] [DEBUG] [VALIDATOR ] THO: Primary data validation passed. [2025-10-02T21:54:25.715763] [INFO ] [MAIN ] THO: Fetched primary data is valid. [2025-10-02T21:54:25.726169] [DEBUG] [LOCAL ] THO: Saving primary data. [2025-10-02T21:54:25.782680] [INFO ] [REMOTE ] TIMB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:54:25.784141] [DEBUG] [LOCAL ] THO: Trimmed 60115 records to 42163 (keeping 200 days of data) [2025-10-02T21:54:25.883899] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2024-12. [2025-10-02T21:54:26.069175] [DEBUG] [LOCAL ] THO: Primary data saved (42163 records). [2025-10-02T21:54:26.069323] [INFO ] [MAIN ] THO: Full history saved. [2025-10-02T21:54:26.070317] [INFO ] [MAIN ] Update Progress: 2091/2370 symbols completed. THO took 46.8s. Estimated remaining: 39m 17s. Rate: 7.1 symbols/min [2025-10-02T21:54:26.253458] [INFO ] [MAIN ] TISI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:54:26.262328] [DEBUG] [LOCAL ] TISI: Loaded 3733 existing records from primary storage. [2025-10-02T21:54:26.262560] [INFO ] [MAIN ] TISI: Loaded 3733 existing records. [2025-10-02T21:54:26.458453] [WARN ] [MAIN ] TISI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:54:26.458774] [INFO ] [MAIN ] TISI: Wiping existing primary data before full refresh. [2025-10-02T21:54:26.458826] [INFO ] [LOCAL ] TISI: Starting deletion of primary data. [2025-10-02T21:54:26.459054] [DEBUG] [LOCAL ] TISI: Deleted primary data file. [2025-10-02T21:54:26.459116] [INFO ] [MAIN ] TISI: Starting full primary refresh. [2025-10-02T21:54:26.685010] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-02. [2025-10-02T21:54:26.855272] [INFO ] [REMOTE ] TISI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:54:26.878897] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-02T21:54:27.399516] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-02T21:54:27.473016] [INFO ] [REMOTE ] TISI: Fetching primary data for 2024-12. [2025-10-02T21:54:27.583144] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-02T21:54:27.871428] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-10-02T21:54:28.273052] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-01. [2025-10-02T21:54:29.073016] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-06. [2025-10-02T21:54:29.736067] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-02T21:54:29.873025] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-03. [2025-10-02T21:54:30.464556] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-02T21:54:30.672997] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-01. [2025-10-02T21:54:30.859474] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-02T21:54:31.164466] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-02T21:54:31.473052] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-07. [2025-10-02T21:54:32.273033] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-02. [2025-10-02T21:54:32.937665] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-02T21:54:33.072999] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-04. [2025-10-02T21:54:33.758734] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-02T21:54:33.873028] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-08. [2025-10-02T21:54:33.887144] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-02T21:54:34.673029] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-02. [2025-10-02T21:54:35.019541] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-02T21:54:35.420594] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-02T21:54:35.473027] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-03. [2025-10-02T21:54:36.142416] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-02T21:54:36.273007] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-04. [2025-10-02T21:54:37.073018] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-05. [2025-10-02T21:54:37.173480] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-02T21:54:37.872999] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-05. [2025-10-02T21:54:38.084112] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-02T21:54:38.452719] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-02T21:54:38.673017] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-09. [2025-10-02T21:54:39.473097] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-03. [2025-10-02T21:54:40.281816] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-06. [2025-10-02T21:54:40.290166] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-02T21:54:40.481246] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-02T21:54:40.897455] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-02T21:54:41.073016] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-10. [2025-10-02T21:54:41.873054] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-07. [2025-10-02T21:54:42.243241] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-02T21:54:42.245284] [INFO ] [REMOTE ] THS: Full fetch complete (54095 records). [2025-10-02T21:54:42.245395] [DEBUG] [VALIDATOR ] THS: Validating primary data. [2025-10-02T21:54:42.360980] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-02T21:54:42.663948] [DEBUG] [VALIDATOR ] THS: All expected trading days are present. [2025-10-02T21:54:42.664037] [DEBUG] [VALIDATOR ] THS: Primary data validation passed. [2025-10-02T21:54:42.665132] [INFO ] [MAIN ] THS: Fetched primary data is valid. [2025-10-02T21:54:42.665199] [DEBUG] [LOCAL ] THS: Saving primary data. [2025-10-02T21:54:42.666582] [DEBUG] [LOCAL ] THS: Trimmed 54095 records to 38521 (keeping 200 days of data) [2025-10-02T21:54:42.731805] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-04. [2025-10-02T21:54:42.924157] [DEBUG] [LOCAL ] THS: Primary data saved (38521 records). [2025-10-02T21:54:42.924305] [INFO ] [MAIN ] THS: Full history saved. [2025-10-02T21:54:42.924395] [INFO ] [MAIN ] Update Progress: 2092/2370 symbols completed. THS took 35.5s. Estimated remaining: 39m 9s. Rate: 7.1 symbols/min [2025-10-02T21:54:43.115136] [INFO ] [MAIN ] TIXT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:54:43.146970] [DEBUG] [LOCAL ] TIXT: Loaded 31569 existing records from primary storage. [2025-10-02T21:54:43.147261] [INFO ] [MAIN ] TIXT: Loaded 31569 existing records. [2025-10-02T21:54:43.334947] [WARN ] [MAIN ] TIXT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:54:43.335172] [INFO ] [MAIN ] TIXT: Wiping existing primary data before full refresh. [2025-10-02T21:54:43.335263] [INFO ] [LOCAL ] TIXT: Starting deletion of primary data. [2025-10-02T21:54:43.335533] [DEBUG] [LOCAL ] TIXT: Deleted primary data file. [2025-10-02T21:54:43.335593] [INFO ] [MAIN ] TIXT: Starting full primary refresh. [2025-10-02T21:54:43.486384] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-06. [2025-10-02T21:54:43.751371] [INFO ] [REMOTE ] TIXT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:54:44.273141] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2024-12. [2025-10-02T21:54:44.273057] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-02T21:54:44.534730] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-02T21:54:45.072962] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-07. [2025-10-02T21:54:45.524488] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-02T21:54:45.872988] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-05. [2025-10-02T21:54:46.205430] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-02T21:54:46.673003] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-08. [2025-10-02T21:54:47.227828] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-02T21:54:47.231087] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-02T21:54:47.472998] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-09. [2025-10-02T21:54:47.853046] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-02T21:54:48.273009] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-01. [2025-10-02T21:54:49.072998] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-10. [2025-10-02T21:54:49.466165] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-02T21:54:49.467367] [INFO ] [REMOTE ] TISI: Full fetch complete (4921 records). [2025-10-02T21:54:49.467473] [DEBUG] [VALIDATOR ] TISI: Validating primary data. [2025-10-02T21:54:49.686822] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-02T21:54:49.883834] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-08. [2025-10-02T21:54:49.928887] [DEBUG] [VALIDATOR ] TISI: All expected trading days are present. [2025-10-02T21:54:49.928964] [DEBUG] [VALIDATOR ] TISI: Primary data validation passed. [2025-10-02T21:54:49.929119] [INFO ] [MAIN ] TISI: Fetched primary data is valid. [2025-10-02T21:54:49.929166] [DEBUG] [LOCAL ] TISI: Saving primary data. [2025-10-02T21:54:49.929539] [DEBUG] [LOCAL ] TISI: Trimmed 4921 records to 3764 (keeping 200 days of data) [2025-10-02T21:54:49.956290] [DEBUG] [LOCAL ] TISI: Primary data saved (3764 records). [2025-10-02T21:54:49.956407] [INFO ] [MAIN ] TISI: Full history saved. [2025-10-02T21:54:49.956492] [INFO ] [MAIN ] Update Progress: 2093/2370 symbols completed. TISI took 23.9s. Estimated remaining: 39m 1s. Rate: 7.1 symbols/min [2025-10-02T21:54:50.137816] [INFO ] [MAIN ] TJX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:54:50.199141] [DEBUG] [LOCAL ] TJX: Loaded 53668 existing records from primary storage. [2025-10-02T21:54:50.199494] [INFO ] [MAIN ] TJX: Loaded 53668 existing records. [2025-10-02T21:54:50.389055] [WARN ] [MAIN ] TJX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:54:50.389315] [INFO ] [MAIN ] TJX: Wiping existing primary data before full refresh. [2025-10-02T21:54:50.389364] [INFO ] [LOCAL ] TJX: Starting deletion of primary data. [2025-10-02T21:54:50.389678] [DEBUG] [LOCAL ] TJX: Deleted primary data file. [2025-10-02T21:54:50.389738] [INFO ] [MAIN ] TJX: Starting full primary refresh. [2025-10-02T21:54:50.679326] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-06. [2025-10-02T21:54:50.817916] [INFO ] [REMOTE ] TJX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:54:50.971953] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-02T21:54:51.473007] [INFO ] [REMOTE ] TJX: Fetching primary data for 2024-12. [2025-10-02T21:54:52.242013] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-02T21:54:52.272967] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-02. [2025-10-02T21:54:53.072996] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-09. [2025-10-02T21:54:53.405700] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-02T21:54:53.474022] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-02T21:54:53.873006] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-01. [2025-10-02T21:54:54.086497] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-02T21:54:54.672997] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-07. [2025-10-02T21:54:55.473024] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-10. [2025-10-02T21:54:55.671545] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-02T21:54:56.041437] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-02T21:54:56.042849] [INFO ] [REMOTE ] THW: Full fetch complete (29477 records). [2025-10-02T21:54:56.042941] [DEBUG] [VALIDATOR ] THW: Validating primary data. [2025-10-02T21:54:56.278111] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-03. [2025-10-02T21:54:56.429863] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-02T21:54:56.483446] [DEBUG] [VALIDATOR ] THW: All expected trading days are present. [2025-10-02T21:54:56.483526] [DEBUG] [VALIDATOR ] THW: Primary data validation passed. [2025-10-02T21:54:56.484243] [INFO ] [MAIN ] THW: Fetched primary data is valid. [2025-10-02T21:54:56.484308] [DEBUG] [LOCAL ] THW: Saving primary data. [2025-10-02T21:54:56.485064] [DEBUG] [LOCAL ] THW: Trimmed 29477 records to 19556 (keeping 200 days of data) [2025-10-02T21:54:56.608341] [DEBUG] [LOCAL ] THW: Primary data saved (19556 records). [2025-10-02T21:54:56.608489] [INFO ] [MAIN ] THW: Full history saved. [2025-10-02T21:54:56.608573] [INFO ] [MAIN ] Update Progress: 2094/2370 symbols completed. THW took 41.4s. Estimated remaining: 38m 52s. Rate: 7.1 symbols/min [2025-10-02T21:54:56.786396] [INFO ] [MAIN ] TK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:54:56.827842] [DEBUG] [LOCAL ] TK: Loaded 39476 existing records from primary storage. [2025-10-02T21:54:56.828199] [INFO ] [MAIN ] TK: Loaded 39476 existing records. [2025-10-02T21:54:57.022014] [WARN ] [MAIN ] TK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:54:57.022326] [INFO ] [MAIN ] TK: Wiping existing primary data before full refresh. [2025-10-02T21:54:57.022383] [INFO ] [LOCAL ] TK: Starting deletion of primary data. [2025-10-02T21:54:57.022801] [DEBUG] [LOCAL ] TK: Deleted primary data file. [2025-10-02T21:54:57.022862] [INFO ] [MAIN ] TK: Starting full primary refresh. [2025-10-02T21:54:57.083541] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-02. [2025-10-02T21:54:57.439496] [INFO ] [REMOTE ] TK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:54:57.492244] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-02T21:54:57.872997] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-04. [2025-10-02T21:54:58.672978] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-08. [2025-10-02T21:54:58.712788] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-02T21:54:58.992152] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-02T21:54:59.473001] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-05. [2025-10-02T21:55:00.145943] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-02T21:55:00.273021] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-03. [2025-10-02T21:55:00.648365] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-02T21:55:01.073046] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-06. [2025-10-02T21:55:01.873047] [INFO ] [REMOTE ] TK: Fetching primary data for 2024-12. [2025-10-02T21:55:02.187562] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-02T21:55:02.500986] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-02T21:55:02.673009] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-04. [2025-10-02T21:55:03.156133] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-02T21:55:03.473031] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-01. [2025-10-02T21:55:04.273005] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-07. [2025-10-02T21:55:04.703481] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-02T21:55:04.970309] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-02T21:55:05.073017] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-02. [2025-10-02T21:55:05.452305] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-02T21:55:05.873006] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-09. [2025-10-02T21:55:06.437106] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-02T21:55:06.673049] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-03. [2025-10-02T21:55:07.210008] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-02T21:55:07.473001] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-10. [2025-10-02T21:55:08.209619] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-02T21:55:08.272977] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-04. [2025-10-02T21:55:08.354745] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-02T21:55:08.356674] [INFO ] [REMOTE ] TIMB: Full fetch complete (54183 records). [2025-10-02T21:55:08.356790] [DEBUG] [VALIDATOR ] TIMB: Validating primary data. [2025-10-02T21:55:08.785725] [DEBUG] [VALIDATOR ] TIMB: All expected trading days are present. [2025-10-02T21:55:08.785824] [DEBUG] [VALIDATOR ] TIMB: Primary data validation passed. [2025-10-02T21:55:08.786929] [INFO ] [MAIN ] TIMB: Fetched primary data is valid. [2025-10-02T21:55:08.786995] [DEBUG] [LOCAL ] TIMB: Saving primary data. [2025-10-02T21:55:08.788256] [DEBUG] [LOCAL ] TIMB: Trimmed 54183 records to 36298 (keeping 200 days of data) [2025-10-02T21:55:09.023109] [DEBUG] [LOCAL ] TIMB: Primary data saved (36298 records). [2025-10-02T21:55:09.023256] [INFO ] [MAIN ] TIMB: Full history saved. [2025-10-02T21:55:09.023343] [INFO ] [MAIN ] Update Progress: 2095/2370 symbols completed. TIMB took 44.6s. Estimated remaining: 38m 44s. Rate: 7.1 symbols/min [2025-10-02T21:55:09.080532] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-08. [2025-10-02T21:55:09.206129] [INFO ] [MAIN ] TKC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:55:09.242744] [DEBUG] [LOCAL ] TKC: Loaded 39003 existing records from primary storage. [2025-10-02T21:55:09.243051] [INFO ] [MAIN ] TKC: Loaded 39003 existing records. [2025-10-02T21:55:09.440213] [WARN ] [MAIN ] TKC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:55:09.440605] [INFO ] [MAIN ] TKC: Wiping existing primary data before full refresh. [2025-10-02T21:55:09.440713] [INFO ] [LOCAL ] TKC: Starting deletion of primary data. [2025-10-02T21:55:09.441026] [DEBUG] [LOCAL ] TKC: Deleted primary data file. [2025-10-02T21:55:09.441088] [INFO ] [MAIN ] TKC: Starting full primary refresh. [2025-10-02T21:55:09.848690] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-02T21:55:09.875172] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-05. [2025-10-02T21:55:09.882141] [INFO ] [REMOTE ] TKC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:55:10.495048] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-02T21:55:10.673049] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-09. [2025-10-02T21:55:11.473037] [INFO ] [REMOTE ] TKC: Fetching primary data for 2024-12. [2025-10-02T21:55:11.943194] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-02T21:55:12.185212] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-02T21:55:12.272965] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-06. [2025-10-02T21:55:12.723607] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-02T21:55:13.073043] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-10. [2025-10-02T21:55:13.872983] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-01. [2025-10-02T21:55:14.215876] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-02T21:55:14.218376] [INFO ] [REMOTE ] TIXT: Full fetch complete (46067 records). [2025-10-02T21:55:14.218562] [DEBUG] [VALIDATOR ] TIXT: Validating primary data. [2025-10-02T21:55:14.507131] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-10-02T21:55:14.700830] [DEBUG] [VALIDATOR ] TIXT: All expected trading days are present. [2025-10-02T21:55:14.682464] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-05. [2025-10-02T21:55:14.701085] [DEBUG] [VALIDATOR ] TIXT: Primary data validation passed. [2025-10-02T21:55:14.702407] [INFO ] [MAIN ] TIXT: Fetched primary data is valid. [2025-10-02T21:55:14.703175] [DEBUG] [LOCAL ] TIXT: Saving primary data. [2025-10-02T21:55:14.704636] [DEBUG] [LOCAL ] TIXT: Trimmed 46067 records to 31892 (keeping 200 days of data) [2025-10-02T21:55:14.896941] [DEBUG] [LOCAL ] TIXT: Primary data saved (31892 records). [2025-10-02T21:55:14.897097] [INFO ] [MAIN ] TIXT: Full history saved. [2025-10-02T21:55:14.897185] [INFO ] [MAIN ] Update Progress: 2096/2370 symbols completed. TIXT took 32.0s. Estimated remaining: 38m 35s. Rate: 7.1 symbols/min [2025-10-02T21:55:15.083937] [INFO ] [MAIN ] TKO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:55:15.132079] [DEBUG] [LOCAL ] TKO: Loaded 44051 existing records from primary storage. [2025-10-02T21:55:15.132418] [INFO ] [MAIN ] TKO: Loaded 44051 existing records. [2025-10-02T21:55:15.283449] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-02T21:55:15.354835] [WARN ] [MAIN ] TKO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:55:15.355146] [INFO ] [MAIN ] TKO: Wiping existing primary data before full refresh. [2025-10-02T21:55:15.355203] [INFO ] [LOCAL ] TKO: Starting deletion of primary data. [2025-10-02T21:55:15.355453] [DEBUG] [LOCAL ] TKO: Deleted primary data file. [2025-10-02T21:55:15.355511] [INFO ] [MAIN ] TKO: Starting full primary refresh. [2025-10-02T21:55:15.473008] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-02. [2025-10-02T21:55:15.775896] [INFO ] [REMOTE ] TKO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:55:16.278085] [INFO ] [REMOTE ] TKO: Fetching primary data for 2024-12. [2025-10-02T21:55:16.291135] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-02T21:55:16.878635] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-02T21:55:17.073066] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-06. [2025-10-02T21:55:17.872983] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-07. [2025-10-02T21:55:17.918632] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-02T21:55:18.324529] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-02T21:55:18.673018] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-07. [2025-10-02T21:55:19.473040] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-03. [2025-10-02T21:55:19.796177] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-02T21:55:20.240821] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-02T21:55:20.272986] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-08. [2025-10-02T21:55:20.951586] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-02T21:55:21.073009] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-04. [2025-10-02T21:55:21.760130] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-02T21:55:21.872996] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-09. [2025-10-02T21:55:22.581757] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-02T21:55:22.673032] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-01. [2025-10-02T21:55:22.986290] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-02T21:55:23.473017] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-08. [2025-10-02T21:55:24.272989] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-10. [2025-10-02T21:55:24.357972] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-02T21:55:25.072997] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-02. [2025-10-02T21:55:25.168231] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-02T21:55:25.169921] [INFO ] [REMOTE ] TK: Full fetch complete (56535 records). [2025-10-02T21:55:25.170024] [DEBUG] [VALIDATOR ] TK: Validating primary data. [2025-10-02T21:55:25.624301] [DEBUG] [VALIDATOR ] TK: All expected trading days are present. [2025-10-02T21:55:25.636628] [DEBUG] [VALIDATOR ] TK: Primary data validation passed. [2025-10-02T21:55:25.642894] [INFO ] [MAIN ] TK: Fetched primary data is valid. [2025-10-02T21:55:25.642986] [DEBUG] [LOCAL ] TK: Saving primary data. [2025-10-02T21:55:25.659471] [DEBUG] [LOCAL ] TK: Trimmed 56535 records to 39741 (keeping 200 days of data) [2025-10-02T21:55:25.661225] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-02T21:55:25.878788] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-09. [2025-10-02T21:55:25.916449] [DEBUG] [LOCAL ] TK: Primary data saved (39741 records). [2025-10-02T21:55:25.916605] [INFO ] [MAIN ] TK: Full history saved. [2025-10-02T21:55:25.916723] [INFO ] [MAIN ] Update Progress: 2097/2370 symbols completed. TK took 29.3s. Estimated remaining: 38m 27s. Rate: 7.1 symbols/min [2025-10-02T21:55:26.114937] [INFO ] [MAIN ] TKR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:55:26.153080] [DEBUG] [LOCAL ] TKR: Loaded 40069 existing records from primary storage. [2025-10-02T21:55:26.153441] [INFO ] [MAIN ] TKR: Loaded 40069 existing records. [2025-10-02T21:55:26.345721] [WARN ] [MAIN ] TKR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:55:26.345934] [INFO ] [MAIN ] TKR: Wiping existing primary data before full refresh. [2025-10-02T21:55:26.345983] [INFO ] [LOCAL ] TKR: Starting deletion of primary data. [2025-10-02T21:55:26.346214] [DEBUG] [LOCAL ] TKR: Deleted primary data file. [2025-10-02T21:55:26.346273] [INFO ] [MAIN ] TKR: Starting full primary refresh. [2025-10-02T21:55:26.673556] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-05. [2025-10-02T21:55:26.742382] [INFO ] [REMOTE ] TKR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:55:26.773771] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-02T21:55:27.473081] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-03. [2025-10-02T21:55:27.975279] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-02T21:55:28.270530] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-02T21:55:28.273958] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-10. [2025-10-02T21:55:28.953742] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-02T21:55:29.073198] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-06. [2025-10-02T21:55:29.544335] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-02T21:55:29.546566] [INFO ] [REMOTE ] TJX: Full fetch complete (77680 records). [2025-10-02T21:55:29.546722] [DEBUG] [VALIDATOR ] TJX: Validating primary data. [2025-10-02T21:55:29.881472] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-04. [2025-10-02T21:55:30.002943] [DEBUG] [VALIDATOR ] TJX: All expected trading days are present. [2025-10-02T21:55:30.003050] [DEBUG] [VALIDATOR ] TJX: Primary data validation passed. [2025-10-02T21:55:30.004356] [INFO ] [MAIN ] TJX: Fetched primary data is valid. [2025-10-02T21:55:30.004431] [DEBUG] [LOCAL ] TJX: Saving primary data. [2025-10-02T21:55:30.006421] [DEBUG] [LOCAL ] TJX: Trimmed 77680 records to 54058 (keeping 200 days of data) [2025-10-02T21:55:30.281103] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-02T21:55:30.408963] [DEBUG] [LOCAL ] TJX: Primary data saved (54058 records). [2025-10-02T21:55:30.409118] [INFO ] [MAIN ] TJX: Full history saved. [2025-10-02T21:55:30.410154] [INFO ] [MAIN ] Update Progress: 2098/2370 symbols completed. TJX took 40.5s. Estimated remaining: 38m 18s. Rate: 7.1 symbols/min [2025-10-02T21:55:30.598225] [INFO ] [MAIN ] TLK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:55:30.647458] [DEBUG] [LOCAL ] TLK: Loaded 39238 existing records from primary storage. [2025-10-02T21:55:30.647787] [INFO ] [MAIN ] TLK: Loaded 39238 existing records. [2025-10-02T21:55:30.680060] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-07. [2025-10-02T21:55:30.845158] [WARN ] [MAIN ] TLK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:55:30.845431] [INFO ] [MAIN ] TLK: Wiping existing primary data before full refresh. [2025-10-02T21:55:30.845495] [INFO ] [LOCAL ] TLK: Starting deletion of primary data. [2025-10-02T21:55:30.845718] [DEBUG] [LOCAL ] TLK: Deleted primary data file. [2025-10-02T21:55:30.845777] [INFO ] [MAIN ] TLK: Starting full primary refresh. [2025-10-02T21:55:31.240939] [INFO ] [REMOTE ] TLK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:55:31.313556] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-02T21:55:31.473002] [INFO ] [REMOTE ] TKR: Fetching primary data for 2024-12. [2025-10-02T21:55:32.237687] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-02T21:55:32.272981] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-08. [2025-10-02T21:55:32.804812] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-02T21:55:33.073006] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-01. [2025-10-02T21:55:33.673414] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-02T21:55:33.873039] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-05. [2025-10-02T21:55:34.636013] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-02T21:55:34.673012] [INFO ] [REMOTE ] TLK: Fetching primary data for 2024-12. [2025-10-02T21:55:35.472963] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-02. [2025-10-02T21:55:35.597619] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-02T21:55:36.233546] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-02T21:55:36.273019] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-01. [2025-10-02T21:55:36.591162] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-02T21:55:37.073017] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-09. [2025-10-02T21:55:37.514866] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-02T21:55:37.873020] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-03. [2025-10-02T21:55:37.979121] [DEBUG] [REMOTE ] TKR: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-10-02T21:55:37.979445] [WARN ] [REMOTE ] TKR: No data returned for month 2025-03 [2025-10-02T21:55:37.979539] [FATAL] [REMOTE ] TKR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T21:55:37.979616] [FATAL] [MAIN ] TKR: Failed to fetch primary data. [2025-10-02T21:55:37.979708] [WARN ] [MAIN ] TKR: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T21:55:37.979781] [INFO ] [LOCAL ] TKR: Starting deletion of primary data. [2025-10-02T21:55:37.979872] [DEBUG] [LOCAL ] TKR: No primary data file found to delete. [2025-10-02T21:55:37.979928] [INFO ] [LOCAL ] TKR: Starting deletion of derivative data. [2025-10-02T21:55:37.980413] [DEBUG] [LOCAL ] TKR: Deleted derivative data file. [2025-10-02T21:55:37.980501] [INFO ] [MAIN ] Update Progress: 2099/2370 symbols completed. TKR took 12.1s. Estimated remaining: 38m 10s. Rate: 7.1 symbols/min [2025-10-02T21:55:38.162496] [INFO ] [MAIN ] TLYS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:55:38.180474] [DEBUG] [LOCAL ] TLYS: Loaded 16584 existing records from primary storage. [2025-10-02T21:55:38.180740] [INFO ] [MAIN ] TLYS: Loaded 16584 existing records. [2025-10-02T21:55:38.376591] [WARN ] [MAIN ] TLYS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:55:38.376817] [INFO ] [MAIN ] TLYS: Wiping existing primary data before full refresh. [2025-10-02T21:55:38.376870] [INFO ] [LOCAL ] TLYS: Starting deletion of primary data. [2025-10-02T21:55:38.377068] [DEBUG] [LOCAL ] TLYS: Deleted primary data file. [2025-10-02T21:55:38.377126] [INFO ] [MAIN ] TLYS: Starting full primary refresh. [2025-10-02T21:55:38.678246] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-06. [2025-10-02T21:55:38.789518] [INFO ] [REMOTE ] TLYS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:55:38.815585] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-02T21:55:39.472998] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2024-12. [2025-10-02T21:55:40.273030] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-10. [2025-10-02T21:55:40.451545] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-02T21:55:40.481335] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-02T21:55:41.073013] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-07. [2025-10-02T21:55:41.521769] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-02T21:55:41.523921] [INFO ] [REMOTE ] TKC: Full fetch complete (52324 records). [2025-10-02T21:55:41.524198] [DEBUG] [VALIDATOR ] TKC: Validating primary data. [2025-10-02T21:55:41.878128] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-02. [2025-10-02T21:55:41.967713] [DEBUG] [VALIDATOR ] TKC: All expected trading days are present. [2025-10-02T21:55:41.967806] [DEBUG] [VALIDATOR ] TKC: Primary data validation passed. [2025-10-02T21:55:41.968822] [INFO ] [MAIN ] TKC: Fetched primary data is valid. [2025-10-02T21:55:41.968886] [DEBUG] [LOCAL ] TKC: Saving primary data. [2025-10-02T21:55:41.970128] [DEBUG] [LOCAL ] TKC: Trimmed 52324 records to 39332 (keeping 200 days of data) [2025-10-02T21:55:42.209064] [DEBUG] [LOCAL ] TKC: Primary data saved (39332 records). [2025-10-02T21:55:42.209254] [INFO ] [MAIN ] TKC: Full history saved. [2025-10-02T21:55:42.209355] [INFO ] [MAIN ] Update Progress: 2100/2370 symbols completed. TKC took 33.2s. Estimated remaining: 38m 1s. Rate: 7.1 symbols/min [2025-10-02T21:55:42.400367] [INFO ] [MAIN ] TM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:55:42.427594] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-02T21:55:42.469535] [DEBUG] [LOCAL ] TM: Loaded 36397 existing records from primary storage. [2025-10-02T21:55:42.469848] [INFO ] [MAIN ] TM: Loaded 36397 existing records. [2025-10-02T21:55:42.671896] [WARN ] [MAIN ] TM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:55:42.672118] [INFO ] [MAIN ] TM: Wiping existing primary data before full refresh. [2025-10-02T21:55:42.672167] [INFO ] [LOCAL ] TM: Starting deletion of primary data. [2025-10-02T21:55:42.672424] [DEBUG] [LOCAL ] TM: Deleted primary data file. [2025-10-02T21:55:42.672484] [INFO ] [MAIN ] TM: Starting full primary refresh. [2025-10-02T21:55:42.684082] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-08. [2025-10-02T21:55:43.112337] [INFO ] [REMOTE ] TM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:55:43.136418] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-02T21:55:43.473019] [INFO ] [REMOTE ] TM: Fetching primary data for 2024-12. [2025-10-02T21:55:44.273001] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-01. [2025-10-02T21:55:44.416929] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-02T21:55:44.789120] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-02T21:55:45.072974] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-02. [2025-10-02T21:55:45.192134] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-02T21:55:45.815704] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-02T21:55:45.873002] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-01. [2025-10-02T21:55:46.673039] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-03. [2025-10-02T21:55:47.160829] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-02T21:55:47.473017] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-03. [2025-10-02T21:55:48.218299] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-02T21:55:48.274139] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-04. [2025-10-02T21:55:48.277855] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-02T21:55:49.073015] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-04. [2025-10-02T21:55:49.824968] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-02T21:55:49.873014] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-09. [2025-10-02T21:55:49.926626] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-02T21:55:50.673024] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-05. [2025-10-02T21:55:51.472958] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-05. [2025-10-02T21:55:51.526263] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-02T21:55:52.199237] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-02T21:55:52.273009] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-06. [2025-10-02T21:55:52.545414] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-02T21:55:53.073010] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-02. [2025-10-02T21:55:53.587111] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-02T21:55:53.873002] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-06. [2025-10-02T21:55:54.339251] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-02T21:55:54.673000] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-07. [2025-10-02T21:55:55.186995] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-02T21:55:55.472995] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-07. [2025-10-02T21:55:55.768247] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-02T21:55:56.273052] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-03. [2025-10-02T21:55:56.606049] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-02T21:55:57.073022] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-10. [2025-10-02T21:55:57.873043] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-08. [2025-10-02T21:55:57.910544] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-02T21:55:58.144305] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-02T21:55:58.146957] [INFO ] [REMOTE ] TKO: Full fetch complete (64909 records). [2025-10-02T21:55:58.147097] [DEBUG] [VALIDATOR ] TKO: Validating primary data. [2025-10-02T21:55:58.583531] [DEBUG] [VALIDATOR ] TKO: All expected trading days are present. [2025-10-02T21:55:58.583635] [DEBUG] [VALIDATOR ] TKO: Primary data validation passed. [2025-10-02T21:55:58.584834] [INFO ] [MAIN ] TKO: Fetched primary data is valid. [2025-10-02T21:55:58.584906] [DEBUG] [LOCAL ] TKO: Saving primary data. [2025-10-02T21:55:58.586743] [DEBUG] [LOCAL ] TKO: Trimmed 64909 records to 44401 (keeping 200 days of data) [2025-10-02T21:55:58.680595] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-08. [2025-10-02T21:55:58.827130] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-02T21:55:58.897347] [DEBUG] [LOCAL ] TKO: Primary data saved (44401 records). [2025-10-02T21:55:58.897512] [INFO ] [MAIN ] TKO: Full history saved. [2025-10-02T21:55:58.897608] [INFO ] [MAIN ] Update Progress: 2101/2370 symbols completed. TKO took 44.0s. Estimated remaining: 37m 53s. Rate: 7.1 symbols/min [2025-10-02T21:55:59.088684] [INFO ] [MAIN ] TME: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:55:59.142416] [DEBUG] [LOCAL ] TME: Loaded 53192 existing records from primary storage. [2025-10-02T21:55:59.142823] [INFO ] [MAIN ] TME: Loaded 53192 existing records. [2025-10-02T21:55:59.341125] [WARN ] [MAIN ] TME: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:55:59.341405] [INFO ] [MAIN ] TME: Wiping existing primary data before full refresh. [2025-10-02T21:55:59.341477] [INFO ] [LOCAL ] TME: Starting deletion of primary data. [2025-10-02T21:55:59.341870] [DEBUG] [LOCAL ] TME: Deleted primary data file. [2025-10-02T21:55:59.341942] [INFO ] [MAIN ] TME: Starting full primary refresh. [2025-10-02T21:55:59.478153] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-09. [2025-10-02T21:55:59.751959] [INFO ] [REMOTE ] TME: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:56:00.202947] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-02T21:56:00.273005] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-09. [2025-10-02T21:56:00.565887] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-02T21:56:01.073043] [INFO ] [REMOTE ] TME: Fetching primary data for 2024-12. [2025-10-02T21:56:01.873046] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-04. [2025-10-02T21:56:01.919662] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-02T21:56:02.592857] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-02T21:56:02.672997] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-01. [2025-10-02T21:56:03.473052] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-10. [2025-10-02T21:56:03.768715] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-02T21:56:04.046102] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-02T21:56:04.047226] [INFO ] [REMOTE ] TLYS: Full fetch complete (21769 records). [2025-10-02T21:56:04.047330] [DEBUG] [VALIDATOR ] TLYS: Validating primary data. [2025-10-02T21:56:04.281584] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-05. [2025-10-02T21:56:04.505045] [DEBUG] [VALIDATOR ] TLYS: All expected trading days are present. [2025-10-02T21:56:04.505225] [DEBUG] [VALIDATOR ] TLYS: Primary data validation passed. [2025-10-02T21:56:04.505884] [INFO ] [MAIN ] TLYS: Fetched primary data is valid. [2025-10-02T21:56:04.505961] [DEBUG] [LOCAL ] TLYS: Saving primary data. [2025-10-02T21:56:04.507163] [DEBUG] [LOCAL ] TLYS: Trimmed 21769 records to 16614 (keeping 200 days of data) [2025-10-02T21:56:04.613139] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-02T21:56:04.653098] [DEBUG] [LOCAL ] TLYS: Primary data saved (16614 records). [2025-10-02T21:56:04.653253] [INFO ] [MAIN ] TLYS: Full history saved. [2025-10-02T21:56:04.653342] [INFO ] [MAIN ] Update Progress: 2102/2370 symbols completed. TLYS took 26.7s. Estimated remaining: 37m 44s. Rate: 7.1 symbols/min [2025-10-02T21:56:04.837547] [INFO ] [MAIN ] TMHC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:56:04.881096] [DEBUG] [LOCAL ] TMHC: Loaded 45382 existing records from primary storage. [2025-10-02T21:56:04.881449] [INFO ] [MAIN ] TMHC: Loaded 45382 existing records. [2025-10-02T21:56:05.078170] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-10. [2025-10-02T21:56:05.083080] [WARN ] [MAIN ] TMHC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:56:05.084297] [INFO ] [MAIN ] TMHC: Wiping existing primary data before full refresh. [2025-10-02T21:56:05.084382] [INFO ] [LOCAL ] TMHC: Starting deletion of primary data. [2025-10-02T21:56:05.084638] [DEBUG] [LOCAL ] TMHC: Deleted primary data file. [2025-10-02T21:56:05.084730] [INFO ] [MAIN ] TMHC: Starting full primary refresh. [2025-10-02T21:56:05.476741] [INFO ] [REMOTE ] TMHC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:56:05.872984] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2024-12. [2025-10-02T21:56:05.961570] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-02T21:56:06.294410] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-02T21:56:06.296512] [INFO ] [REMOTE ] TLK: Full fetch complete (57309 records). [2025-10-02T21:56:06.296629] [DEBUG] [VALIDATOR ] TLK: Validating primary data. [2025-10-02T21:56:06.689187] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-02. [2025-10-02T21:56:06.712878] [DEBUG] [VALIDATOR ] TLK: All expected trading days are present. [2025-10-02T21:56:06.712951] [DEBUG] [VALIDATOR ] TLK: Primary data validation passed. [2025-10-02T21:56:06.714191] [INFO ] [MAIN ] TLK: Fetched primary data is valid. [2025-10-02T21:56:06.714363] [DEBUG] [LOCAL ] TLK: Saving primary data. [2025-10-02T21:56:06.715931] [DEBUG] [LOCAL ] TLK: Trimmed 57309 records to 39485 (keeping 200 days of data) [2025-10-02T21:56:06.995990] [DEBUG] [LOCAL ] TLK: Primary data saved (39485 records). [2025-10-02T21:56:06.996138] [INFO ] [MAIN ] TLK: Full history saved. [2025-10-02T21:56:06.996761] [INFO ] [MAIN ] Update Progress: 2103/2370 symbols completed. TLK took 36.6s. Estimated remaining: 37m 35s. Rate: 7.1 symbols/min [2025-10-02T21:56:07.188145] [INFO ] [MAIN ] TMO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:56:07.248503] [DEBUG] [LOCAL ] TMO: Loaded 52345 existing records from primary storage. [2025-10-02T21:56:07.248922] [INFO ] [MAIN ] TMO: Loaded 52345 existing records. [2025-10-02T21:56:07.442744] [WARN ] [MAIN ] TMO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:56:07.443131] [INFO ] [MAIN ] TMO: Wiping existing primary data before full refresh. [2025-10-02T21:56:07.443209] [INFO ] [LOCAL ] TMO: Starting deletion of primary data. [2025-10-02T21:56:07.443561] [DEBUG] [LOCAL ] TMO: Deleted primary data file. [2025-10-02T21:56:07.443670] [INFO ] [MAIN ] TMO: Starting full primary refresh. [2025-10-02T21:56:07.478383] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-06. [2025-10-02T21:56:07.751019] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-02T21:56:07.906973] [INFO ] [REMOTE ] TMO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:56:08.272980] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-01. [2025-10-02T21:56:08.646726] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-02T21:56:08.971096] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-02T21:56:09.073041] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-03. [2025-10-02T21:56:09.854473] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-02T21:56:09.872994] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-02. [2025-10-02T21:56:10.672975] [INFO ] [REMOTE ] TMO: Fetching primary data for 2024-12. [2025-10-02T21:56:10.945389] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-02T21:56:11.050464] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-02T21:56:11.473020] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-07. [2025-10-02T21:56:12.273077] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-04. [2025-10-02T21:56:12.538499] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-02T21:56:13.079950] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-03. [2025-10-02T21:56:13.084921] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-02T21:56:13.873003] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-01. [2025-10-02T21:56:14.305801] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-02T21:56:14.471864] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-02T21:56:14.673015] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-08. [2025-10-02T21:56:15.473045] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-04. [2025-10-02T21:56:16.042918] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-10-02T21:56:16.113546] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-02T21:56:16.273006] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-09. [2025-10-02T21:56:17.073026] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-05. [2025-10-02T21:56:17.204525] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-02T21:56:17.781167] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-02T21:56:17.873029] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-10. [2025-10-02T21:56:18.673003] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-05. [2025-10-02T21:56:18.915520] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-02T21:56:19.069292] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-02T21:56:19.071403] [INFO ] [REMOTE ] TM: Full fetch complete (52829 records). [2025-10-02T21:56:19.071712] [DEBUG] [VALIDATOR ] TM: Validating primary data. [2025-10-02T21:56:19.487798] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-02. [2025-10-02T21:56:19.508113] [DEBUG] [VALIDATOR ] TM: All expected trading days are present. [2025-10-02T21:56:19.508212] [DEBUG] [VALIDATOR ] TM: Primary data validation passed. [2025-10-02T21:56:19.509370] [INFO ] [MAIN ] TM: Fetched primary data is valid. [2025-10-02T21:56:19.509439] [DEBUG] [LOCAL ] TM: Saving primary data. [2025-10-02T21:56:19.510861] [DEBUG] [LOCAL ] TM: Trimmed 52829 records to 36607 (keeping 200 days of data) [2025-10-02T21:56:19.751911] [DEBUG] [LOCAL ] TM: Primary data saved (36607 records). [2025-10-02T21:56:19.752090] [INFO ] [MAIN ] TM: Full history saved. [2025-10-02T21:56:19.752200] [INFO ] [MAIN ] Update Progress: 2104/2370 symbols completed. TM took 37.5s. Estimated remaining: 37m 27s. Rate: 7.1 symbols/min [2025-10-02T21:56:19.951131] [INFO ] [MAIN ] TNC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:56:19.969827] [DEBUG] [LOCAL ] TNC: Loaded 14841 existing records from primary storage. [2025-10-02T21:56:19.970145] [INFO ] [MAIN ] TNC: Loaded 14841 existing records. [2025-10-02T21:56:20.205839] [WARN ] [MAIN ] TNC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:56:20.206284] [INFO ] [MAIN ] TNC: Wiping existing primary data before full refresh. [2025-10-02T21:56:20.206391] [INFO ] [LOCAL ] TNC: Starting deletion of primary data. [2025-10-02T21:56:20.206808] [DEBUG] [LOCAL ] TNC: Deleted primary data file. [2025-10-02T21:56:20.206872] [INFO ] [MAIN ] TNC: Starting full primary refresh. [2025-10-02T21:56:20.278257] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-06. [2025-10-02T21:56:20.483063] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-02T21:56:20.836495] [INFO ] [REMOTE ] TNC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:56:21.073062] [INFO ] [REMOTE ] TNC: Fetching primary data for 2024-12. [2025-10-02T21:56:21.337863] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-02T21:56:21.873031] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-03. [2025-10-02T21:56:22.158793] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-02T21:56:22.202162] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-02T21:56:22.673036] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-07. [2025-10-02T21:56:23.473013] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-06. [2025-10-02T21:56:23.799168] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-02T21:56:24.273046] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-04. [2025-10-02T21:56:24.653157] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-02T21:56:24.951351] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-02T21:56:25.073056] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-07. [2025-10-02T21:56:25.872997] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-01. [2025-10-02T21:56:25.932455] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-02T21:56:26.672973] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-08. [2025-10-02T21:56:26.834796] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-02T21:56:26.856901] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-02T21:56:27.473030] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-02. [2025-10-02T21:56:28.222064] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-02T21:56:28.273008] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-03. [2025-10-02T21:56:28.649910] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-02T21:56:29.051865] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-02T21:56:29.072960] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-04. [2025-10-02T21:56:29.873016] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-08. [2025-10-02T21:56:30.323253] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-02T21:56:30.673018] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-05. [2025-10-02T21:56:31.485810] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-05. [2025-10-02T21:56:31.493852] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-02T21:56:31.660229] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-02T21:56:32.273001] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-09. [2025-10-02T21:56:33.073009] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-06. [2025-10-02T21:56:33.538836] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-02T21:56:33.873006] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-06. [2025-10-02T21:56:34.024686] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-02T21:56:34.272433] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-02T21:56:34.673057] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-09. [2025-10-02T21:56:35.473032] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-07. [2025-10-02T21:56:35.820606] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-02T21:56:35.908576] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-02T21:56:36.272979] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-10. [2025-10-02T21:56:36.438832] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-02T21:56:37.073017] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-07. [2025-10-02T21:56:37.447849] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-02T21:56:37.449822] [INFO ] [REMOTE ] TMHC: Full fetch complete (65937 records). [2025-10-02T21:56:37.449941] [DEBUG] [VALIDATOR ] TMHC: Validating primary data. [2025-10-02T21:56:37.874110] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-10. [2025-10-02T21:56:37.917498] [DEBUG] [VALIDATOR ] TMHC: All expected trading days are present. [2025-10-02T21:56:37.917607] [DEBUG] [VALIDATOR ] TMHC: Primary data validation passed. [2025-10-02T21:56:37.918892] [INFO ] [MAIN ] TMHC: Fetched primary data is valid. [2025-10-02T21:56:37.918962] [DEBUG] [LOCAL ] TMHC: Saving primary data. [2025-10-02T21:56:37.920434] [DEBUG] [LOCAL ] TMHC: Trimmed 65937 records to 45663 (keeping 200 days of data) [2025-10-02T21:56:38.217072] [DEBUG] [LOCAL ] TMHC: Primary data saved (45663 records). [2025-10-02T21:56:38.217757] [INFO ] [MAIN ] TMHC: Full history saved. [2025-10-02T21:56:38.218011] [INFO ] [MAIN ] Update Progress: 2105/2370 symbols completed. TMHC took 33.6s. Estimated remaining: 37m 20s. Rate: 7.1 symbols/min [2025-10-02T21:56:38.421434] [INFO ] [MAIN ] TNET: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:56:38.460885] [DEBUG] [LOCAL ] TNET: Loaded 28523 existing records from primary storage. [2025-10-02T21:56:38.461185] [INFO ] [MAIN ] TNET: Loaded 28523 existing records. [2025-10-02T21:56:38.678585] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-08. [2025-10-02T21:56:38.678492] [WARN ] [MAIN ] TNET: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:56:38.680206] [INFO ] [MAIN ] TNET: Wiping existing primary data before full refresh. [2025-10-02T21:56:38.680369] [INFO ] [LOCAL ] TNET: Starting deletion of primary data. [2025-10-02T21:56:38.680658] [DEBUG] [LOCAL ] TNET: Deleted primary data file. [2025-10-02T21:56:38.680722] [INFO ] [MAIN ] TNET: Starting full primary refresh. [2025-10-02T21:56:39.073981] [INFO ] [REMOTE ] TNET: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:56:39.105626] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-02T21:56:39.246111] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-02T21:56:39.248537] [INFO ] [REMOTE ] TME: Full fetch complete (76924 records). [2025-10-02T21:56:39.248673] [DEBUG] [VALIDATOR ] TME: Validating primary data. [2025-10-02T21:56:39.480480] [INFO ] [REMOTE ] TNET: Fetching primary data for 2024-12. [2025-10-02T21:56:39.683334] [DEBUG] [VALIDATOR ] TME: All expected trading days are present. [2025-10-02T21:56:39.683532] [DEBUG] [VALIDATOR ] TME: Primary data validation passed. [2025-10-02T21:56:39.684823] [INFO ] [MAIN ] TME: Fetched primary data is valid. [2025-10-02T21:56:39.684902] [DEBUG] [LOCAL ] TME: Saving primary data. [2025-10-02T21:56:39.695639] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-02T21:56:39.701070] [DEBUG] [LOCAL ] TME: Trimmed 76924 records to 53582 (keeping 200 days of data) [2025-10-02T21:56:40.080445] [DEBUG] [LOCAL ] TME: Primary data saved (53582 records). [2025-10-02T21:56:40.080606] [INFO ] [MAIN ] TME: Full history saved. [2025-10-02T21:56:40.080723] [INFO ] [MAIN ] Update Progress: 2106/2370 symbols completed. TME took 41.2s. Estimated remaining: 37m 11s. Rate: 7.1 symbols/min [2025-10-02T21:56:40.273116] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-09. [2025-10-02T21:56:40.273034] [INFO ] [MAIN ] TNGY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:56:40.274183] [DEBUG] [LOCAL ] TNGY: No existing data file found in primary storage. [2025-10-02T21:56:40.274279] [WARN ] [MAIN ] TNGY: No existing data found, performing full refresh instead. [2025-10-02T21:56:40.274436] [INFO ] [MAIN ] TNGY: Wiping existing primary data before full refresh. [2025-10-02T21:56:40.274510] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-10-02T21:56:40.274608] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-10-02T21:56:40.274693] [INFO ] [MAIN ] TNGY: Starting full primary refresh. [2025-10-02T21:56:40.716963] [INFO ] [REMOTE ] TNGY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:56:40.905001] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-02T21:56:41.073027] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-01. [2025-10-02T21:56:41.281988] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-02T21:56:41.873017] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2024-12. [2025-10-02T21:56:41.946284] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-02T21:56:42.092012] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T21:56:42.092403] [WARN ] [REMOTE ] TNGY: No data returned for month 2024-12 [2025-10-02T21:56:42.092517] [FATAL] [REMOTE ] TNGY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T21:56:42.092611] [FATAL] [MAIN ] TNGY: Failed to fetch primary data. [2025-10-02T21:56:42.092715] [WARN ] [MAIN ] TNGY: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T21:56:42.092807] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-10-02T21:56:42.092902] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-10-02T21:56:42.092967] [INFO ] [LOCAL ] TNGY: Starting deletion of derivative data. [2025-10-02T21:56:42.093043] [DEBUG] [LOCAL ] TNGY: No derivative data file found to delete. [2025-10-02T21:56:42.093125] [INFO ] [MAIN ] Update Progress: 2107/2370 symbols completed. TNGY took 2.0s. Estimated remaining: 37m 2s. Rate: 7.1 symbols/min [2025-10-02T21:56:42.322874] [INFO ] [MAIN ] TNK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:56:42.360837] [DEBUG] [LOCAL ] TNK: Loaded 35156 existing records from primary storage. [2025-10-02T21:56:42.361190] [INFO ] [MAIN ] TNK: Loaded 35156 existing records. [2025-10-02T21:56:42.565322] [WARN ] [MAIN ] TNK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:56:42.565588] [INFO ] [MAIN ] TNK: Wiping existing primary data before full refresh. [2025-10-02T21:56:42.565639] [INFO ] [LOCAL ] TNK: Starting deletion of primary data. [2025-10-02T21:56:42.565900] [DEBUG] [LOCAL ] TNK: Deleted primary data file. [2025-10-02T21:56:42.565959] [INFO ] [MAIN ] TNK: Starting full primary refresh. [2025-10-02T21:56:42.674033] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-02. [2025-10-02T21:56:42.952104] [INFO ] [REMOTE ] TNK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:56:43.473022] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-08. [2025-10-02T21:56:44.030072] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-02T21:56:44.273000] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-03. [2025-10-02T21:56:45.073015] [INFO ] [REMOTE ] TNK: Fetching primary data for 2024-12. [2025-10-02T21:56:45.316732] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-02T21:56:45.386623] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-02T21:56:45.873004] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-10. [2025-10-02T21:56:46.410962] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-02T21:56:46.446668] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-02T21:56:46.447852] [INFO ] [REMOTE ] TNC: Full fetch complete (22906 records). [2025-10-02T21:56:46.447944] [DEBUG] [VALIDATOR ] TNC: Validating primary data. [2025-10-02T21:56:46.681584] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-04. [2025-10-02T21:56:46.853387] [DEBUG] [VALIDATOR ] TNC: All expected trading days are present. [2025-10-02T21:56:46.853474] [DEBUG] [VALIDATOR ] TNC: Primary data validation passed. [2025-10-02T21:56:46.854040] [INFO ] [MAIN ] TNC: Fetched primary data is valid. [2025-10-02T21:56:46.854105] [DEBUG] [LOCAL ] TNC: Saving primary data. [2025-10-02T21:56:46.854852] [DEBUG] [LOCAL ] TNC: Trimmed 22906 records to 14932 (keeping 200 days of data) [2025-10-02T21:56:46.953396] [DEBUG] [LOCAL ] TNC: Primary data saved (14932 records). [2025-10-02T21:56:46.953548] [INFO ] [MAIN ] TNC: Full history saved. [2025-10-02T21:56:46.953634] [INFO ] [MAIN ] Update Progress: 2108/2370 symbols completed. TNC took 27.2s. Estimated remaining: 36m 53s. Rate: 7.1 symbols/min [2025-10-02T21:56:47.141900] [INFO ] [MAIN ] TNL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:56:47.183313] [DEBUG] [LOCAL ] TNL: Loaded 41731 existing records from primary storage. [2025-10-02T21:56:47.183612] [INFO ] [MAIN ] TNL: Loaded 41731 existing records. [2025-10-02T21:56:47.385780] [WARN ] [MAIN ] TNL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:56:47.386057] [INFO ] [MAIN ] TNL: Wiping existing primary data before full refresh. [2025-10-02T21:56:47.386148] [INFO ] [LOCAL ] TNL: Starting deletion of primary data. [2025-10-02T21:56:47.386413] [DEBUG] [LOCAL ] TNL: Deleted primary data file. [2025-10-02T21:56:47.386490] [INFO ] [MAIN ] TNL: Starting full primary refresh. [2025-10-02T21:56:47.478214] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-09. [2025-10-02T21:56:47.799275] [INFO ] [REMOTE ] TNL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:56:48.182143] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-02T21:56:48.273000] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-05. [2025-10-02T21:56:49.073002] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-01. [2025-10-02T21:56:49.373672] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-02T21:56:49.511568] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-02T21:56:49.873004] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-06. [2025-10-02T21:56:50.229345] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-02T21:56:50.673012] [INFO ] [REMOTE ] TNL: Fetching primary data for 2024-12. [2025-10-02T21:56:50.785156] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-02T21:56:51.473043] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-02. [2025-10-02T21:56:52.186829] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-02T21:56:52.273054] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-07. [2025-10-02T21:56:52.901610] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-02T21:56:53.073005] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-03. [2025-10-02T21:56:53.742236] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-02T21:56:53.873017] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-08. [2025-10-02T21:56:54.450860] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-02T21:56:54.673000] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-10. [2025-10-02T21:56:54.945934] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-02T21:56:55.473046] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-09. [2025-10-02T21:56:56.114400] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-02T21:56:56.116734] [INFO ] [REMOTE ] TMO: Full fetch complete (75496 records). [2025-10-02T21:56:56.116891] [DEBUG] [VALIDATOR ] TMO: Validating primary data. [2025-10-02T21:56:56.280381] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-01. [2025-10-02T21:56:56.565253] [DEBUG] [VALIDATOR ] TMO: All expected trading days are present. [2025-10-02T21:56:56.565398] [DEBUG] [VALIDATOR ] TMO: Primary data validation passed. [2025-10-02T21:56:56.566749] [INFO ] [MAIN ] TMO: Fetched primary data is valid. [2025-10-02T21:56:56.566840] [DEBUG] [LOCAL ] TMO: Saving primary data. [2025-10-02T21:56:56.586265] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-02T21:56:56.593323] [DEBUG] [LOCAL ] TMO: Trimmed 75496 records to 52734 (keeping 200 days of data) [2025-10-02T21:56:56.947694] [DEBUG] [LOCAL ] TMO: Primary data saved (52734 records). [2025-10-02T21:56:56.947852] [INFO ] [MAIN ] TMO: Full history saved. [2025-10-02T21:56:56.950300] [INFO ] [MAIN ] Update Progress: 2109/2370 symbols completed. TMO took 50.0s. Estimated remaining: 36m 44s. Rate: 7.1 symbols/min [2025-10-02T21:56:57.078152] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-10. [2025-10-02T21:56:57.138127] [INFO ] [MAIN ] TOL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:56:57.195945] [DEBUG] [LOCAL ] TOL: Loaded 50831 existing records from primary storage. [2025-10-02T21:56:57.196299] [INFO ] [MAIN ] TOL: Loaded 50831 existing records. [2025-10-02T21:56:57.389283] [WARN ] [MAIN ] TOL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:56:57.389731] [INFO ] [MAIN ] TOL: Wiping existing primary data before full refresh. [2025-10-02T21:56:57.389867] [INFO ] [LOCAL ] TOL: Starting deletion of primary data. [2025-10-02T21:56:57.390190] [DEBUG] [LOCAL ] TOL: Deleted primary data file. [2025-10-02T21:56:57.390279] [INFO ] [MAIN ] TOL: Starting full primary refresh. [2025-10-02T21:56:57.802728] [INFO ] [REMOTE ] TOL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:56:57.805946] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-02T21:56:57.872967] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-02. [2025-10-02T21:56:57.950183] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-02T21:56:57.951523] [INFO ] [REMOTE ] TNET: Full fetch complete (41700 records). [2025-10-02T21:56:57.951610] [DEBUG] [VALIDATOR ] TNET: Validating primary data. [2025-10-02T21:56:58.360682] [DEBUG] [VALIDATOR ] TNET: All expected trading days are present. [2025-10-02T21:56:58.360783] [DEBUG] [VALIDATOR ] TNET: Primary data validation passed. [2025-10-02T21:56:58.361745] [INFO ] [MAIN ] TNET: Fetched primary data is valid. [2025-10-02T21:56:58.361811] [DEBUG] [LOCAL ] TNET: Saving primary data. [2025-10-02T21:56:58.362936] [DEBUG] [LOCAL ] TNET: Trimmed 41700 records to 28712 (keeping 200 days of data) [2025-10-02T21:56:58.558036] [DEBUG] [LOCAL ] TNET: Primary data saved (28712 records). [2025-10-02T21:56:58.558191] [INFO ] [MAIN ] TNET: Full history saved. [2025-10-02T21:56:58.558280] [INFO ] [MAIN ] Update Progress: 2110/2370 symbols completed. TNET took 20.3s. Estimated remaining: 36m 35s. Rate: 7.1 symbols/min [2025-10-02T21:56:58.678111] [INFO ] [REMOTE ] TOL: Fetching primary data for 2024-12. [2025-10-02T21:56:58.744103] [INFO ] [MAIN ] TOST: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:56:58.804768] [DEBUG] [LOCAL ] TOST: Loaded 53681 existing records from primary storage. [2025-10-02T21:56:58.805092] [INFO ] [MAIN ] TOST: Loaded 53681 existing records. [2025-10-02T21:56:58.992822] [WARN ] [MAIN ] TOST: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:56:58.993046] [INFO ] [MAIN ] TOST: Wiping existing primary data before full refresh. [2025-10-02T21:56:58.993102] [INFO ] [LOCAL ] TOST: Starting deletion of primary data. [2025-10-02T21:56:58.993460] [DEBUG] [LOCAL ] TOST: Deleted primary data file. [2025-10-02T21:56:58.993519] [INFO ] [MAIN ] TOST: Starting full primary refresh. [2025-10-02T21:56:59.391944] [INFO ] [REMOTE ] TOST: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:56:59.416536] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-02T21:56:59.473032] [INFO ] [REMOTE ] TOST: Fetching primary data for 2024-12. [2025-10-02T21:57:00.272962] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-03. [2025-10-02T21:57:00.639770] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-02T21:57:01.073011] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-04. [2025-10-02T21:57:01.696096] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-10-02T21:57:01.878190] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-01. [2025-10-02T21:57:01.895790] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-02T21:57:02.672980] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-01. [2025-10-02T21:57:02.702432] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-02T21:57:03.472985] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-04. [2025-10-02T21:57:03.831915] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-02T21:57:04.272986] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-02. [2025-10-02T21:57:04.493662] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-02T21:57:04.732770] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-02T21:57:05.072999] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-02. [2025-10-02T21:57:05.872992] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-05. [2025-10-02T21:57:06.370971] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-02T21:57:06.678154] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-03. [2025-10-02T21:57:06.692950] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-02T21:57:07.427833] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-02T21:57:07.473042] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-06. [2025-10-02T21:57:08.273000] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-05. [2025-10-02T21:57:08.554003] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-02T21:57:08.878050] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-02T21:57:09.073046] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-07. [2025-10-02T21:57:09.827966] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-02T21:57:09.872959] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-06. [2025-10-02T21:57:10.406253] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-02T21:57:10.672998] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-04. [2025-10-02T21:57:11.450304] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-02T21:57:11.473007] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-07. [2025-10-02T21:57:12.273053] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-03. [2025-10-02T21:57:12.314115] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-02T21:57:13.073005] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-05. [2025-10-02T21:57:13.131196] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-02T21:57:13.873004] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-08. [2025-10-02T21:57:14.192006] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-02T21:57:14.672989] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-04. [2025-10-02T21:57:14.885717] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-02T21:57:15.152690] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-02T21:57:15.473020] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-09. [2025-10-02T21:57:16.145714] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-02T21:57:16.273030] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-08. [2025-10-02T21:57:16.908460] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-02T21:57:17.073018] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-10. [2025-10-02T21:57:17.749994] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-02T21:57:17.873011] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-09. [2025-10-02T21:57:18.079284] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-02T21:57:18.080924] [INFO ] [REMOTE ] TNK: Full fetch complete (51882 records). [2025-10-02T21:57:18.081050] [DEBUG] [VALIDATOR ] TNK: Validating primary data. [2025-10-02T21:57:18.515240] [DEBUG] [VALIDATOR ] TNK: All expected trading days are present. [2025-10-02T21:57:18.515326] [DEBUG] [VALIDATOR ] TNK: Primary data validation passed. [2025-10-02T21:57:18.516460] [INFO ] [MAIN ] TNK: Fetched primary data is valid. [2025-10-02T21:57:18.516526] [DEBUG] [LOCAL ] TNK: Saving primary data. [2025-10-02T21:57:18.517730] [DEBUG] [LOCAL ] TNK: Trimmed 51882 records to 35408 (keeping 200 days of data) [2025-10-02T21:57:18.704500] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-06. [2025-10-02T21:57:18.766427] [DEBUG] [LOCAL ] TNK: Primary data saved (35408 records). [2025-10-02T21:57:18.766584] [INFO ] [MAIN ] TNK: Full history saved. [2025-10-02T21:57:18.766704] [INFO ] [MAIN ] Update Progress: 2111/2370 symbols completed. TNK took 36.7s. Estimated remaining: 36m 28s. Rate: 7.1 symbols/min [2025-10-02T21:57:18.958985] [INFO ] [MAIN ] TPB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:57:18.983196] [DEBUG] [LOCAL ] TPB: Loaded 25047 existing records from primary storage. [2025-10-02T21:57:18.983466] [INFO ] [MAIN ] TPB: Loaded 25047 existing records. [2025-10-02T21:57:19.180879] [WARN ] [MAIN ] TPB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:57:19.181354] [INFO ] [MAIN ] TPB: Wiping existing primary data before full refresh. [2025-10-02T21:57:19.181541] [INFO ] [LOCAL ] TPB: Starting deletion of primary data. [2025-10-02T21:57:19.190873] [DEBUG] [LOCAL ] TPB: Deleted primary data file. [2025-10-02T21:57:19.205340] [INFO ] [MAIN ] TPB: Starting full primary refresh. [2025-10-02T21:57:19.212080] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-02T21:57:19.478186] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-10. [2025-10-02T21:57:19.632610] [INFO ] [REMOTE ] TPB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:57:20.273028] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-05. [2025-10-02T21:57:20.385099] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-02T21:57:20.619803] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-02T21:57:20.622203] [INFO ] [REMOTE ] TNL: Full fetch complete (58950 records). [2025-10-02T21:57:20.622343] [DEBUG] [VALIDATOR ] TNL: Validating primary data. [2025-10-02T21:57:21.053727] [DEBUG] [VALIDATOR ] TNL: All expected trading days are present. [2025-10-02T21:57:21.053818] [DEBUG] [VALIDATOR ] TNL: Primary data validation passed. [2025-10-02T21:57:21.054942] [INFO ] [MAIN ] TNL: Fetched primary data is valid. [2025-10-02T21:57:21.055008] [DEBUG] [LOCAL ] TNL: Saving primary data. [2025-10-02T21:57:21.056247] [DEBUG] [LOCAL ] TNL: Trimmed 58950 records to 41980 (keeping 200 days of data) [2025-10-02T21:57:21.112614] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-07. [2025-10-02T21:57:21.326892] [DEBUG] [LOCAL ] TNL: Primary data saved (41980 records). [2025-10-02T21:57:21.327023] [INFO ] [MAIN ] TNL: Full history saved. [2025-10-02T21:57:21.327104] [INFO ] [MAIN ] Update Progress: 2112/2370 symbols completed. TNL took 34.4s. Estimated remaining: 36m 19s. Rate: 7.1 symbols/min [2025-10-02T21:57:21.504183] [INFO ] [MAIN ] TPC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:57:21.541990] [DEBUG] [LOCAL ] TPC: Loaded 38735 existing records from primary storage. [2025-10-02T21:57:21.542290] [INFO ] [MAIN ] TPC: Loaded 38735 existing records. [2025-10-02T21:57:21.742380] [WARN ] [MAIN ] TPC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:57:21.742581] [INFO ] [MAIN ] TPC: Wiping existing primary data before full refresh. [2025-10-02T21:57:21.742631] [INFO ] [LOCAL ] TPC: Starting deletion of primary data. [2025-10-02T21:57:21.742926] [DEBUG] [LOCAL ] TPC: Deleted primary data file. [2025-10-02T21:57:21.743002] [INFO ] [MAIN ] TPC: Starting full primary refresh. [2025-10-02T21:57:21.878161] [INFO ] [REMOTE ] TPB: Fetching primary data for 2024-12. [2025-10-02T21:57:22.182586] [INFO ] [REMOTE ] TPC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:57:22.216572] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-02T21:57:22.673012] [INFO ] [REMOTE ] TPC: Fetching primary data for 2024-12. [2025-10-02T21:57:22.953369] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-02T21:57:23.175140] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-02T21:57:23.473009] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-06. [2025-10-02T21:57:23.663882] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-02T21:57:24.273020] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-08. [2025-10-02T21:57:25.073023] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-01. [2025-10-02T21:57:25.276468] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-02T21:57:25.873040] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-07. [2025-10-02T21:57:26.142812] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-02T21:57:26.270718] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-02T21:57:26.673022] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-02. [2025-10-02T21:57:27.472989] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-09. [2025-10-02T21:57:27.721037] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-02T21:57:27.747159] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-02T21:57:28.272987] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-03. [2025-10-02T21:57:29.073042] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-08. [2025-10-02T21:57:29.475011] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-02T21:57:29.522111] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-02T21:57:29.873066] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-04. [2025-10-02T21:57:30.672968] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-10. [2025-10-02T21:57:30.996230] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-02T21:57:31.084197] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-02T21:57:31.472986] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-09. [2025-10-02T21:57:31.998483] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-02T21:57:32.001190] [INFO ] [REMOTE ] TOST: Full fetch complete (77699 records). [2025-10-02T21:57:32.001328] [DEBUG] [VALIDATOR ] TOST: Validating primary data. [2025-10-02T21:57:32.281519] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-05. [2025-10-02T21:57:32.443358] [DEBUG] [VALIDATOR ] TOST: All expected trading days are present. [2025-10-02T21:57:32.443442] [DEBUG] [VALIDATOR ] TOST: Primary data validation passed. [2025-10-02T21:57:32.444592] [INFO ] [MAIN ] TOST: Fetched primary data is valid. [2025-10-02T21:57:32.444680] [DEBUG] [LOCAL ] TOST: Saving primary data. [2025-10-02T21:57:32.448070] [DEBUG] [LOCAL ] TOST: Trimmed 77699 records to 54071 (keeping 200 days of data) [2025-10-02T21:57:32.791540] [DEBUG] [LOCAL ] TOST: Primary data saved (54071 records). [2025-10-02T21:57:32.791766] [INFO ] [MAIN ] TOST: Full history saved. [2025-10-02T21:57:32.791890] [INFO ] [MAIN ] Update Progress: 2113/2370 symbols completed. TOST took 34.2s. Estimated remaining: 36m 11s. Rate: 7.1 symbols/min [2025-10-02T21:57:32.980250] [INFO ] [MAIN ] TPH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:57:33.023413] [DEBUG] [LOCAL ] TPH: Loaded 44944 existing records from primary storage. [2025-10-02T21:57:33.023778] [INFO ] [MAIN ] TPH: Loaded 44944 existing records. [2025-10-02T21:57:33.075500] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-01. [2025-10-02T21:57:33.230850] [WARN ] [MAIN ] TPH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:57:33.231396] [INFO ] [MAIN ] TPH: Wiping existing primary data before full refresh. [2025-10-02T21:57:33.231726] [INFO ] [LOCAL ] TPH: Starting deletion of primary data. [2025-10-02T21:57:33.231998] [DEBUG] [LOCAL ] TPH: Deleted primary data file. [2025-10-02T21:57:33.232057] [INFO ] [MAIN ] TPH: Starting full primary refresh. [2025-10-02T21:57:33.673912] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-02T21:57:33.685369] [INFO ] [REMOTE ] TPH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:57:33.689265] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-02T21:57:33.873004] [INFO ] [REMOTE ] TPH: Fetching primary data for 2024-12. [2025-10-02T21:57:34.607364] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-02T21:57:34.672968] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-02. [2025-10-02T21:57:35.099339] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-02T21:57:35.473009] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-10. [2025-10-02T21:57:36.037556] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-02T21:57:36.273022] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-06. [2025-10-02T21:57:36.919268] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-02T21:57:36.921357] [INFO ] [REMOTE ] TOL: Full fetch complete (73740 records). [2025-10-02T21:57:36.921471] [DEBUG] [VALIDATOR ] TOL: Validating primary data. [2025-10-02T21:57:37.079788] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-03. [2025-10-02T21:57:37.363322] [DEBUG] [VALIDATOR ] TOL: All expected trading days are present. [2025-10-02T21:57:37.363570] [DEBUG] [VALIDATOR ] TOL: Primary data validation passed. [2025-10-02T21:57:37.370845] [INFO ] [MAIN ] TOL: Fetched primary data is valid. [2025-10-02T21:57:37.380199] [DEBUG] [LOCAL ] TOL: Saving primary data. [2025-10-02T21:57:37.381819] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-02T21:57:37.389522] [DEBUG] [LOCAL ] TOL: Trimmed 73740 records to 51170 (keeping 200 days of data) [2025-10-02T21:57:37.738779] [DEBUG] [LOCAL ] TOL: Primary data saved (51170 records). [2025-10-02T21:57:37.738938] [INFO ] [MAIN ] TOL: Full history saved. [2025-10-02T21:57:37.740184] [INFO ] [MAIN ] Update Progress: 2114/2370 symbols completed. TOL took 40.8s. Estimated remaining: 36m 2s. Rate: 7.1 symbols/min [2025-10-02T21:57:37.878160] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-01. [2025-10-02T21:57:37.931683] [INFO ] [MAIN ] TPL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:57:37.949908] [DEBUG] [LOCAL ] TPL: Loaded 12298 existing records from primary storage. [2025-10-02T21:57:37.950160] [INFO ] [MAIN ] TPL: Loaded 12298 existing records. [2025-10-02T21:57:38.159586] [WARN ] [MAIN ] TPL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:57:38.159912] [INFO ] [MAIN ] TPL: Wiping existing primary data before full refresh. [2025-10-02T21:57:38.159988] [INFO ] [LOCAL ] TPL: Starting deletion of primary data. [2025-10-02T21:57:38.160158] [DEBUG] [LOCAL ] TPL: Deleted primary data file. [2025-10-02T21:57:38.160200] [INFO ] [MAIN ] TPL: Starting full primary refresh. [2025-10-02T21:57:38.570565] [INFO ] [REMOTE ] TPL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:57:38.595469] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-02T21:57:38.673013] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-04. [2025-10-02T21:57:39.119824] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-02T21:57:39.472995] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-02. [2025-10-02T21:57:39.887406] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-02T21:57:40.272996] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-07. [2025-10-02T21:57:41.051273] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-02T21:57:41.073003] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-05. [2025-10-02T21:57:41.563000] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-02T21:57:41.872992] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-08. [2025-10-02T21:57:42.231374] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-02T21:57:42.673002] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-06. [2025-10-02T21:57:43.214338] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-02T21:57:43.473040] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-09. [2025-10-02T21:57:44.183346] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-02T21:57:44.272995] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-03. [2025-10-02T21:57:44.500374] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-02T21:57:45.072996] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-10. [2025-10-02T21:57:45.806766] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-02T21:57:45.808334] [INFO ] [REMOTE ] TPB: Full fetch complete (35112 records). [2025-10-02T21:57:45.808439] [DEBUG] [VALIDATOR ] TPB: Validating primary data. [2025-10-02T21:57:45.883242] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-07. [2025-10-02T21:57:46.025104] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-02T21:57:46.285605] [DEBUG] [VALIDATOR ] TPB: All expected trading days are present. [2025-10-02T21:57:46.285723] [DEBUG] [VALIDATOR ] TPB: Primary data validation passed. [2025-10-02T21:57:46.286440] [INFO ] [MAIN ] TPB: Fetched primary data is valid. [2025-10-02T21:57:46.286483] [DEBUG] [LOCAL ] TPB: Saving primary data. [2025-10-02T21:57:46.288216] [DEBUG] [LOCAL ] TPB: Trimmed 35112 records to 25252 (keeping 200 days of data) [2025-10-02T21:57:46.451610] [DEBUG] [LOCAL ] TPB: Primary data saved (25252 records). [2025-10-02T21:57:46.451775] [INFO ] [MAIN ] TPB: Full history saved. [2025-10-02T21:57:46.451873] [INFO ] [MAIN ] Update Progress: 2115/2370 symbols completed. TPB took 27.7s. Estimated remaining: 35m 54s. Rate: 7.1 symbols/min [2025-10-02T21:57:46.642246] [INFO ] [MAIN ] TPR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:57:46.673003] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-04. [2025-10-02T21:57:46.697793] [DEBUG] [LOCAL ] TPR: Loaded 53466 existing records from primary storage. [2025-10-02T21:57:46.698209] [INFO ] [MAIN ] TPR: Loaded 53466 existing records. [2025-10-02T21:57:46.901906] [WARN ] [MAIN ] TPR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:57:46.902143] [INFO ] [MAIN ] TPR: Wiping existing primary data before full refresh. [2025-10-02T21:57:46.902200] [INFO ] [LOCAL ] TPR: Starting deletion of primary data. [2025-10-02T21:57:46.902492] [DEBUG] [LOCAL ] TPR: Deleted primary data file. [2025-10-02T21:57:46.902551] [INFO ] [MAIN ] TPR: Starting full primary refresh. [2025-10-02T21:57:47.286892] [INFO ] [REMOTE ] TPR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:57:47.478140] [INFO ] [REMOTE ] TPL: Fetching primary data for 2024-12. [2025-10-02T21:57:47.490817] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-02T21:57:48.273010] [INFO ] [REMOTE ] TPR: Fetching primary data for 2024-12. [2025-10-02T21:57:48.295989] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-02T21:57:48.345099] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-02T21:57:49.073054] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-08. [2025-10-02T21:57:49.872984] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-01. [2025-10-02T21:57:50.129815] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-02T21:57:50.663807] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-02T21:57:50.672981] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-01. [2025-10-02T21:57:50.914867] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-02T21:57:51.473045] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-02. [2025-10-02T21:57:52.273007] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-09. [2025-10-02T21:57:52.332855] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-02T21:57:52.372692] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-02T21:57:53.073030] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-03. [2025-10-02T21:57:53.425431] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-02T21:57:53.873009] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-10. [2025-10-02T21:57:54.075577] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-02T21:57:54.673039] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-02. [2025-10-02T21:57:54.993546] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-02T21:57:54.995603] [INFO ] [REMOTE ] TPC: Full fetch complete (55239 records). [2025-10-02T21:57:54.995729] [DEBUG] [VALIDATOR ] TPC: Validating primary data. [2025-10-02T21:57:55.416162] [DEBUG] [VALIDATOR ] TPC: All expected trading days are present. [2025-10-02T21:57:55.416272] [DEBUG] [VALIDATOR ] TPC: Primary data validation passed. [2025-10-02T21:57:55.417398] [INFO ] [MAIN ] TPC: Fetched primary data is valid. [2025-10-02T21:57:55.417464] [DEBUG] [LOCAL ] TPC: Saving primary data. [2025-10-02T21:57:55.418814] [DEBUG] [LOCAL ] TPC: Trimmed 55239 records to 39075 (keeping 200 days of data) [2025-10-02T21:57:55.475692] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-05. [2025-10-02T21:57:55.673005] [DEBUG] [LOCAL ] TPC: Primary data saved (39075 records). [2025-10-02T21:57:55.673184] [INFO ] [MAIN ] TPC: Full history saved. [2025-10-02T21:57:55.673310] [INFO ] [MAIN ] Update Progress: 2116/2370 symbols completed. TPC took 34.3s. Estimated remaining: 35m 45s. Rate: 7.1 symbols/min [2025-10-02T21:57:55.865487] [INFO ] [MAIN ] TPVG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:57:55.893166] [DEBUG] [LOCAL ] TPVG: Loaded 26947 existing records from primary storage. [2025-10-02T21:57:55.893441] [INFO ] [MAIN ] TPVG: Loaded 26947 existing records. [2025-10-02T21:57:56.088183] [WARN ] [MAIN ] TPVG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:57:56.088395] [INFO ] [MAIN ] TPVG: Wiping existing primary data before full refresh. [2025-10-02T21:57:56.088444] [INFO ] [LOCAL ] TPVG: Starting deletion of primary data. [2025-10-02T21:57:56.088864] [DEBUG] [LOCAL ] TPVG: Deleted primary data file. [2025-10-02T21:57:56.088927] [INFO ] [MAIN ] TPVG: Starting full primary refresh. [2025-10-02T21:57:56.281928] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-04. [2025-10-02T21:57:56.489687] [INFO ] [REMOTE ] TPVG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:57:56.534485] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-02T21:57:57.072996] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-03. [2025-10-02T21:57:57.209633] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-02T21:57:57.404006] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-02T21:57:57.873040] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-06. [2025-10-02T21:57:58.672985] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2024-12. [2025-10-02T21:57:59.049833] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-02T21:57:59.414462] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-02T21:57:59.473003] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-05. [2025-10-02T21:58:00.170772] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-02T21:58:00.273045] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-01. [2025-10-02T21:58:00.397152] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-02T21:58:01.073046] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-06. [2025-10-02T21:58:01.609038] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-02T21:58:01.733857] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-02T21:58:01.873026] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-07. [2025-10-02T21:58:02.673005] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-04. [2025-10-02T21:58:02.870882] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-02T21:58:03.473022] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-07. [2025-10-02T21:58:04.273054] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-02. [2025-10-02T21:58:04.672761] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-02T21:58:04.717175] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-02T21:58:05.073010] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-08. [2025-10-02T21:58:05.452194] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-02T21:58:05.873063] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-03. [2025-10-02T21:58:06.632938] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-02T21:58:06.672962] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-09. [2025-10-02T21:58:07.028887] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-02T21:58:07.473025] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-08. [2025-10-02T21:58:07.864820] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-02T21:58:08.273033] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-05. [2025-10-02T21:58:08.376214] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-02T21:58:09.073030] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-04. [2025-10-02T21:58:09.764714] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-02T21:58:09.872998] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-10. [2025-10-02T21:58:10.448200] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-02T21:58:10.673054] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-06. [2025-10-02T21:58:11.008284] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-02T21:58:11.010448] [INFO ] [REMOTE ] TPH: Full fetch complete (64974 records). [2025-10-02T21:58:11.010605] [DEBUG] [VALIDATOR ] TPH: Validating primary data. [2025-10-02T21:58:11.443913] [DEBUG] [VALIDATOR ] TPH: All expected trading days are present. [2025-10-02T21:58:11.444004] [DEBUG] [VALIDATOR ] TPH: Primary data validation passed. [2025-10-02T21:58:11.445082] [INFO ] [MAIN ] TPH: Fetched primary data is valid. [2025-10-02T21:58:11.445148] [DEBUG] [LOCAL ] TPH: Saving primary data. [2025-10-02T21:58:11.446562] [DEBUG] [LOCAL ] TPH: Trimmed 64974 records to 45247 (keeping 200 days of data) [2025-10-02T21:58:11.499506] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-05. [2025-10-02T21:58:11.735583] [DEBUG] [LOCAL ] TPH: Primary data saved (45247 records). [2025-10-02T21:58:11.735760] [INFO ] [MAIN ] TPH: Full history saved. [2025-10-02T21:58:11.735857] [INFO ] [MAIN ] Update Progress: 2117/2370 symbols completed. TPH took 38.9s. Estimated remaining: 35m 38s. Rate: 7.1 symbols/min [2025-10-02T21:58:12.273006] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-09. [2025-10-02T21:58:12.432918] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-02T21:58:12.482824] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-02T21:58:13.072986] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-06. [2025-10-02T21:58:13.235212] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-02T21:58:13.872967] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-10. [2025-10-02T21:58:14.110083] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-02T21:58:14.397519] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-02T21:58:14.398550] [INFO ] [REMOTE ] TPL: Full fetch complete (17823 records). [2025-10-02T21:58:14.398630] [DEBUG] [VALIDATOR ] TPL: Validating primary data. [2025-10-02T21:58:14.681482] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-07. [2025-10-02T21:58:14.796394] [DEBUG] [VALIDATOR ] TPL: All expected trading days are present. [2025-10-02T21:58:14.796474] [DEBUG] [VALIDATOR ] TPL: Primary data validation passed. [2025-10-02T21:58:14.796940] [INFO ] [MAIN ] TPL: Fetched primary data is valid. [2025-10-02T21:58:14.797006] [DEBUG] [LOCAL ] TPL: Saving primary data. [2025-10-02T21:58:14.797618] [DEBUG] [LOCAL ] TPL: Trimmed 17823 records to 12395 (keeping 200 days of data) [2025-10-02T21:58:14.881477] [DEBUG] [LOCAL ] TPL: Primary data saved (12395 records). [2025-10-02T21:58:14.881625] [INFO ] [MAIN ] TPL: Full history saved. [2025-10-02T21:58:14.881762] [INFO ] [MAIN ] Update Progress: 2118/2370 symbols completed. TPL took 37.1s. Estimated remaining: 35m 29s. Rate: 7.1 symbols/min [2025-10-02T21:58:15.473036] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-07. [2025-10-02T21:58:16.621349] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-02T21:58:16.627678] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-08. [2025-10-02T21:58:16.726146] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-02T21:58:17.073088] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-08. [2025-10-02T21:58:17.929224] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-02T21:58:17.935406] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-09. [2025-10-02T21:58:18.577103] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-02T21:58:18.673054] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-09. [2025-10-02T21:58:19.342340] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-02T21:58:19.473034] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-10. [2025-10-02T21:58:20.388324] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-02T21:58:20.389780] [INFO ] [REMOTE ] TPVG: Full fetch complete (40384 records). [2025-10-02T21:58:20.389870] [DEBUG] [VALIDATOR ] TPVG: Validating primary data. [2025-10-02T21:58:20.831104] [DEBUG] [VALIDATOR ] TPVG: All expected trading days are present. [2025-10-02T21:58:20.831268] [DEBUG] [VALIDATOR ] TPVG: Primary data validation passed. [2025-10-02T21:58:20.832258] [INFO ] [MAIN ] TPVG: Fetched primary data is valid. [2025-10-02T21:58:20.832461] [DEBUG] [LOCAL ] TPVG: Saving primary data. [2025-10-02T21:58:20.844467] [DEBUG] [LOCAL ] TPVG: Trimmed 40384 records to 27131 (keeping 200 days of data) [2025-10-02T21:58:20.868546] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-02T21:58:20.966944] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-10. [2025-10-02T21:58:21.053314] [DEBUG] [LOCAL ] TPVG: Primary data saved (27131 records). [2025-10-02T21:58:21.053513] [INFO ] [MAIN ] TPVG: Full history saved. [2025-10-02T21:58:21.053674] [INFO ] [MAIN ] Update Progress: 2119/2370 symbols completed. TPVG took 25.4s. Estimated remaining: 35m 20s. Rate: 7.1 symbols/min [2025-10-02T21:58:22.310924] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-02T21:58:22.313716] [INFO ] [REMOTE ] TPR: Full fetch complete (77421 records). [2025-10-02T21:58:22.313872] [DEBUG] [VALIDATOR ] TPR: Validating primary data. [2025-10-02T21:58:22.872240] [DEBUG] [VALIDATOR ] TPR: All expected trading days are present. [2025-10-02T21:58:22.872375] [DEBUG] [VALIDATOR ] TPR: Primary data validation passed. [2025-10-02T21:58:22.873632] [INFO ] [MAIN ] TPR: Fetched primary data is valid. [2025-10-02T21:58:22.873755] [DEBUG] [LOCAL ] TPR: Saving primary data. [2025-10-02T21:58:22.878607] [DEBUG] [LOCAL ] TPR: Trimmed 77421 records to 53851 (keeping 200 days of data) [2025-10-02T21:58:23.246942] [DEBUG] [LOCAL ] TPR: Primary data saved (53851 records). [2025-10-02T21:58:23.247401] [INFO ] [MAIN ] TPR: Full history saved. [2025-10-02T21:58:23.247575] [INFO ] [MAIN ] Update Progress: 2120/2370 symbols completed. TPR took 36.8s. Estimated remaining: 35m 11s. Rate: 7.1 symbols/min [2025-10-02T21:58:23.967312] [INFO ] [MAIN ] TPYP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:58:24.087833] [INFO ] [MAIN ] TRAK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:58:24.094222] [INFO ] [MAIN ] TPZ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:58:24.095600] [INFO ] [MAIN ] TR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:58:24.111676] [DEBUG] [LOCAL ] TPYP: Loaded 7913 existing records from primary storage. [2025-10-02T21:58:24.111929] [INFO ] [MAIN ] TPYP: Loaded 7913 existing records. [2025-10-02T21:58:24.111348] [DEBUG] [LOCAL ] TPZ: Loaded 4914 existing records from primary storage. [2025-10-02T21:58:24.150846] [INFO ] [MAIN ] TPZ: Loaded 4914 existing records. [2025-10-02T21:58:24.216198] [DEBUG] [LOCAL ] TRAK: Loaded 9422 existing records from primary storage. [2025-10-02T21:58:24.276779] [INFO ] [MAIN ] TRAK: Loaded 9422 existing records. [2025-10-02T21:58:24.403847] [DEBUG] [LOCAL ] TR: Loaded 18492 existing records from primary storage. [2025-10-02T21:58:24.468188] [INFO ] [MAIN ] TR: Loaded 18492 existing records. [2025-10-02T21:58:24.714266] [WARN ] [MAIN ] TPZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:58:24.775026] [WARN ] [MAIN ] TPYP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:58:24.780896] [INFO ] [MAIN ] TPZ: Wiping existing primary data before full refresh. [2025-10-02T21:58:24.780591] [INFO ] [MAIN ] TPYP: Wiping existing primary data before full refresh. [2025-10-02T21:58:24.809863] [INFO ] [LOCAL ] TPZ: Starting deletion of primary data. [2025-10-02T21:58:24.815155] [INFO ] [LOCAL ] TPYP: Starting deletion of primary data. [2025-10-02T21:58:24.892705] [DEBUG] [LOCAL ] TPZ: Deleted primary data file. [2025-10-02T21:58:24.961437] [DEBUG] [LOCAL ] TPYP: Deleted primary data file. [2025-10-02T21:58:24.960982] [INFO ] [MAIN ] TPZ: Starting full primary refresh. [2025-10-02T21:58:24.960870] [WARN ] [MAIN ] TRAK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:58:24.988130] [INFO ] [MAIN ] TRAK: Wiping existing primary data before full refresh. [2025-10-02T21:58:24.972423] [INFO ] [MAIN ] TPYP: Starting full primary refresh. [2025-10-02T21:58:25.035472] [INFO ] [LOCAL ] TRAK: Starting deletion of primary data. [2025-10-02T21:58:25.064248] [DEBUG] [LOCAL ] TRAK: Deleted primary data file. [2025-10-02T21:58:25.168226] [INFO ] [MAIN ] TRAK: Starting full primary refresh. [2025-10-02T21:58:25.130852] [WARN ] [MAIN ] TR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:58:25.292063] [INFO ] [MAIN ] TR: Wiping existing primary data before full refresh. [2025-10-02T21:58:25.332173] [INFO ] [LOCAL ] TR: Starting deletion of primary data. [2025-10-02T21:58:25.412384] [DEBUG] [LOCAL ] TR: Deleted primary data file. [2025-10-02T21:58:25.455500] [INFO ] [MAIN ] TR: Starting full primary refresh. [2025-10-02T21:58:26.365379] [INFO ] [REMOTE ] TPYP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:58:26.455485] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2024-12. [2025-10-02T21:58:26.543043] [INFO ] [REMOTE ] TPZ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:58:26.609354] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2024-12. [2025-10-02T21:58:26.743973] [INFO ] [REMOTE ] TRAK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:58:26.785774] [INFO ] [REMOTE ] TR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:58:26.786564] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2024-12. [2025-10-02T21:58:26.786919] [INFO ] [REMOTE ] TR: Fetching primary data for 2024-12. [2025-10-02T21:58:27.200634] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-02T21:58:27.203063] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-01. [2025-10-02T21:58:27.391763] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-02T21:58:27.394181] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-01. [2025-10-02T21:58:27.471550] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-02T21:58:27.475231] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-01. [2025-10-02T21:58:27.660244] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-02T21:58:27.663369] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-01. [2025-10-02T21:58:27.823370] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-02T21:58:27.826870] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-02. [2025-10-02T21:58:28.070794] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-02T21:58:28.272993] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-02. [2025-10-02T21:58:28.353718] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-02T21:58:28.437772] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-02T21:58:28.549225] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-02T21:58:29.020444] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-02T21:58:29.073039] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-02. [2025-10-02T21:58:29.652806] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-02T21:58:29.873033] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-03. [2025-10-02T21:58:30.657832] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-02T21:58:30.672968] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-04. [2025-10-02T21:58:31.473193] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-03. [2025-10-02T21:58:31.473695] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-02T21:58:32.273006] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-02. [2025-10-02T21:58:32.295063] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-02T21:58:33.072993] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-03. [2025-10-02T21:58:33.139094] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-02T21:58:33.821726] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-02T21:58:33.873009] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-04. [2025-10-02T21:58:34.675438] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-04. [2025-10-02T21:58:34.678494] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-02T21:58:35.421847] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-02T21:58:35.473069] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-03. [2025-10-02T21:58:36.272995] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-05. [2025-10-02T21:58:36.431272] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-02T21:58:36.804241] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-02T21:58:37.073012] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-04. [2025-10-02T21:58:37.872997] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-05. [2025-10-02T21:58:38.083857] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-02T21:58:38.282338] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-02T21:58:38.673006] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-06. [2025-10-02T21:58:39.189913] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-02T21:58:39.472993] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-07. [2025-10-02T21:58:40.260845] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-02T21:58:40.272952] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-06. [2025-10-02T21:58:40.911882] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-02T21:58:41.073006] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-05. [2025-10-02T21:58:41.872970] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-07. [2025-10-02T21:58:42.205382] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-02T21:58:42.489291] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-02T21:58:42.672998] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-05. [2025-10-02T21:58:43.169147] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-02T21:58:43.472999] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-06. [2025-10-02T21:58:44.272987] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-06. [2025-10-02T21:58:44.534361] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-02T21:58:45.077260] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-07. [2025-10-02T21:58:45.078370] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-02T21:58:45.810907] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-02T21:58:45.873053] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-07. [2025-10-02T21:58:46.659567] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-02T21:58:46.672959] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-08. [2025-10-02T21:58:47.212908] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-02T21:58:47.473048] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-08. [2025-10-02T21:58:48.273027] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-08. [2025-10-02T21:58:48.564423] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-02T21:58:48.828762] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-02T21:58:49.073008] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-09. [2025-10-02T21:58:49.873016] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-09. [2025-10-02T21:58:50.234793] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-02T21:58:50.456582] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-02T21:58:50.673059] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-10. [2025-10-02T21:58:51.472981] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-09. [2025-10-02T21:58:51.477441] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-02T21:58:51.480396] [INFO ] [REMOTE ] TR: Full fetch complete (25187 records). [2025-10-02T21:58:51.480539] [DEBUG] [VALIDATOR ] TR: Validating primary data. [2025-10-02T21:58:51.900923] [DEBUG] [VALIDATOR ] TR: All expected trading days are present. [2025-10-02T21:58:51.901001] [DEBUG] [VALIDATOR ] TR: Primary data validation passed. [2025-10-02T21:58:51.901513] [INFO ] [MAIN ] TR: Fetched primary data is valid. [2025-10-02T21:58:51.901554] [DEBUG] [LOCAL ] TR: Saving primary data. [2025-10-02T21:58:51.902263] [DEBUG] [LOCAL ] TR: Trimmed 25187 records to 18638 (keeping 200 days of data) [2025-10-02T21:58:52.029298] [DEBUG] [LOCAL ] TR: Primary data saved (18638 records). [2025-10-02T21:58:52.029434] [INFO ] [MAIN ] TR: Full history saved. [2025-10-02T21:58:52.029514] [INFO ] [MAIN ] Update Progress: 2121/2370 symbols completed. TR took 28.7s. Estimated remaining: 35m 5s. Rate: 7.1 symbols/min [2025-10-02T21:58:52.212121] [INFO ] [MAIN ] TRC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:58:52.230065] [DEBUG] [LOCAL ] TRC: Loaded 15736 existing records from primary storage. [2025-10-02T21:58:52.230307] [INFO ] [MAIN ] TRC: Loaded 15736 existing records. [2025-10-02T21:58:52.277666] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-08. [2025-10-02T21:58:52.378452] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-02T21:58:52.436573] [WARN ] [MAIN ] TRC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:58:52.436872] [INFO ] [MAIN ] TRC: Wiping existing primary data before full refresh. [2025-10-02T21:58:52.436928] [INFO ] [LOCAL ] TRC: Starting deletion of primary data. [2025-10-02T21:58:52.437121] [DEBUG] [LOCAL ] TRC: Deleted primary data file. [2025-10-02T21:58:52.437179] [INFO ] [MAIN ] TRC: Starting full primary refresh. [2025-10-02T21:58:52.823854] [INFO ] [REMOTE ] TRC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:58:53.042478] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-02T21:58:53.073044] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-09. [2025-10-02T21:58:53.866173] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-02T21:58:53.872943] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-10. [2025-10-02T21:58:54.423831] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-02T21:58:54.424673] [INFO ] [REMOTE ] TPYP: Full fetch complete (12584 records). [2025-10-02T21:58:54.424762] [DEBUG] [VALIDATOR ] TPYP: Validating primary data. [2025-10-02T21:58:54.678171] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-10. [2025-10-02T21:58:54.845336] [DEBUG] [VALIDATOR ] TPYP: All expected trading days are present. [2025-10-02T21:58:54.845424] [DEBUG] [VALIDATOR ] TPYP: Primary data validation passed. [2025-10-02T21:58:54.845762] [INFO ] [MAIN ] TPYP: Fetched primary data is valid. [2025-10-02T21:58:54.845827] [DEBUG] [LOCAL ] TPYP: Saving primary data. [2025-10-02T21:58:54.846325] [DEBUG] [LOCAL ] TPYP: Trimmed 12584 records to 7958 (keeping 200 days of data) [2025-10-02T21:58:54.899336] [DEBUG] [LOCAL ] TPYP: Primary data saved (7958 records). [2025-10-02T21:58:54.899487] [INFO ] [MAIN ] TPYP: Full history saved. [2025-10-02T21:58:54.899572] [INFO ] [MAIN ] Update Progress: 2122/2370 symbols completed. TPYP took 31.7s. Estimated remaining: 34m 56s. Rate: 7.1 symbols/min [2025-10-02T21:58:55.081227] [INFO ] [MAIN ] TREX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:58:55.130125] [DEBUG] [LOCAL ] TREX: Loaded 49932 existing records from primary storage. [2025-10-02T21:58:55.130484] [INFO ] [MAIN ] TREX: Loaded 49932 existing records. [2025-10-02T21:58:55.253425] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-02T21:58:55.254596] [INFO ] [REMOTE ] TPZ: Full fetch complete (9208 records). [2025-10-02T21:58:55.255084] [DEBUG] [VALIDATOR ] TPZ: Validating primary data. [2025-10-02T21:58:55.476821] [INFO ] [REMOTE ] TRC: Fetching primary data for 2024-12. [2025-10-02T21:58:55.471103] [WARN ] [MAIN ] TREX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:58:55.484715] [INFO ] [MAIN ] TREX: Wiping existing primary data before full refresh. [2025-10-02T21:58:55.522021] [INFO ] [LOCAL ] TREX: Starting deletion of primary data. [2025-10-02T21:58:55.537904] [DEBUG] [LOCAL ] TREX: Deleted primary data file. [2025-10-02T21:58:55.558017] [INFO ] [MAIN ] TREX: Starting full primary refresh. [2025-10-02T21:58:56.016819] [DEBUG] [VALIDATOR ] TPZ: All expected trading days are present. [2025-10-02T21:58:56.037693] [DEBUG] [VALIDATOR ] TPZ: Primary data validation passed. [2025-10-02T21:58:56.091852] [INFO ] [MAIN ] TPZ: Fetched primary data is valid. [2025-10-02T21:58:56.118755] [DEBUG] [LOCAL ] TPZ: Saving primary data. [2025-10-02T21:58:56.125188] [DEBUG] [LOCAL ] TPZ: Trimmed 9208 records to 4967 (keeping 200 days of data) [2025-10-02T21:58:56.234794] [INFO ] [REMOTE ] TREX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:58:56.244838] [DEBUG] [LOCAL ] TPZ: Primary data saved (4967 records). [2025-10-02T21:58:56.244937] [INFO ] [MAIN ] TPZ: Full history saved. [2025-10-02T21:58:56.245014] [INFO ] [MAIN ] Update Progress: 2123/2370 symbols completed. TPZ took 33.0s. Estimated remaining: 34m 46s. Rate: 7.1 symbols/min [2025-10-02T21:58:56.277218] [INFO ] [REMOTE ] TREX: Fetching primary data for 2024-12. [2025-10-02T21:58:56.435091] [INFO ] [MAIN ] TRGP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:58:56.449439] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-02T21:58:56.517580] [DEBUG] [LOCAL ] TRGP: Loaded 50698 existing records from primary storage. [2025-10-02T21:58:56.518024] [INFO ] [MAIN ] TRGP: Loaded 50698 existing records. [2025-10-02T21:58:56.712211] [WARN ] [MAIN ] TRGP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:58:56.712427] [INFO ] [MAIN ] TRGP: Wiping existing primary data before full refresh. [2025-10-02T21:58:56.712477] [INFO ] [LOCAL ] TRGP: Starting deletion of primary data. [2025-10-02T21:58:56.712741] [DEBUG] [LOCAL ] TRGP: Deleted primary data file. [2025-10-02T21:58:56.712801] [INFO ] [MAIN ] TRGP: Starting full primary refresh. [2025-10-02T21:58:57.073508] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-01. [2025-10-02T21:58:57.097092] [INFO ] [REMOTE ] TRGP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:58:57.872978] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-10. [2025-10-02T21:58:57.930204] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-02T21:58:58.005983] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-02T21:58:58.350606] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-02T21:58:58.351621] [INFO ] [REMOTE ] TRAK: Full fetch complete (13496 records). [2025-10-02T21:58:58.351734] [DEBUG] [VALIDATOR ] TRAK: Validating primary data. [2025-10-02T21:58:58.677688] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-02. [2025-10-02T21:58:58.766133] [DEBUG] [VALIDATOR ] TRAK: All expected trading days are present. [2025-10-02T21:58:58.766219] [DEBUG] [VALIDATOR ] TRAK: Primary data validation passed. [2025-10-02T21:58:58.766553] [INFO ] [MAIN ] TRAK: Fetched primary data is valid. [2025-10-02T21:58:58.766597] [DEBUG] [LOCAL ] TRAK: Saving primary data. [2025-10-02T21:58:58.767112] [DEBUG] [LOCAL ] TRAK: Trimmed 13496 records to 9469 (keeping 200 days of data) [2025-10-02T21:58:58.834120] [DEBUG] [LOCAL ] TRAK: Primary data saved (9469 records). [2025-10-02T21:58:58.834257] [INFO ] [MAIN ] TRAK: Full history saved. [2025-10-02T21:58:58.834372] [INFO ] [MAIN ] Update Progress: 2124/2370 symbols completed. TRAK took 35.6s. Estimated remaining: 34m 37s. Rate: 7.1 symbols/min [2025-10-02T21:58:59.016002] [INFO ] [MAIN ] TRN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:58:59.052153] [DEBUG] [LOCAL ] TRN: Loaded 37021 existing records from primary storage. [2025-10-02T21:58:59.052481] [INFO ] [MAIN ] TRN: Loaded 37021 existing records. [2025-10-02T21:58:59.250483] [WARN ] [MAIN ] TRN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:58:59.250781] [INFO ] [MAIN ] TRN: Wiping existing primary data before full refresh. [2025-10-02T21:58:59.250834] [INFO ] [LOCAL ] TRN: Starting deletion of primary data. [2025-10-02T21:58:59.251048] [DEBUG] [LOCAL ] TRN: Deleted primary data file. [2025-10-02T21:58:59.251107] [INFO ] [MAIN ] TRN: Starting full primary refresh. [2025-10-02T21:58:59.482487] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-01. [2025-10-02T21:58:59.668096] [INFO ] [REMOTE ] TRN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:58:59.669251] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-02T21:59:00.273011] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-03. [2025-10-02T21:59:01.072998] [INFO ] [REMOTE ] TRN: Fetching primary data for 2024-12. [2025-10-02T21:59:01.195965] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-02T21:59:01.307048] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-02T21:59:01.873052] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-04. [2025-10-02T21:59:02.341113] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-02T21:59:02.672983] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-01. [2025-10-02T21:59:02.972439] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-02T21:59:03.473053] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-02. [2025-10-02T21:59:04.108929] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-02T21:59:04.273019] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2024-12. [2025-10-02T21:59:05.040999] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-02T21:59:05.072988] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-05. [2025-10-02T21:59:05.861177] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-02T21:59:05.872956] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-02. [2025-10-02T21:59:06.127110] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-02T21:59:06.673082] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-03. [2025-10-02T21:59:06.982828] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-02T21:59:07.473036] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-03. [2025-10-02T21:59:08.128787] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-02T21:59:08.273050] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-01. [2025-10-02T21:59:08.699376] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-02T21:59:09.072998] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-04. [2025-10-02T21:59:09.872990] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-06. [2025-10-02T21:59:09.914482] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-02T21:59:10.423695] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-02T21:59:10.673021] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-04. [2025-10-02T21:59:10.863996] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-02T21:59:11.472997] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-05. [2025-10-02T21:59:12.243419] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-02T21:59:12.272991] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-02. [2025-10-02T21:59:13.073011] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-05. [2025-10-02T21:59:13.144758] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-02T21:59:13.699683] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-02T21:59:13.873055] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-03. [2025-10-02T21:59:14.226597] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-02T21:59:14.673078] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-07. [2025-10-02T21:59:15.472995] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-06. [2025-10-02T21:59:15.601555] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-02T21:59:15.668043] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-02T21:59:16.272986] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-06. [2025-10-02T21:59:16.641048] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-02T21:59:17.073052] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-04. [2025-10-02T21:59:17.583953] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-02T21:59:17.873008] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-07. [2025-10-02T21:59:18.590159] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-02T21:59:18.673034] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-05. [2025-10-02T21:59:19.424152] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-02T21:59:19.472994] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-08. [2025-10-02T21:59:20.110271] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-02T21:59:20.272983] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-08. [2025-10-02T21:59:20.956711] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-02T21:59:21.072970] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-06. [2025-10-02T21:59:21.151922] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-02T21:59:21.873012] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-09. [2025-10-02T21:59:22.672989] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-09. [2025-10-02T21:59:22.825687] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-02T21:59:22.825266] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-02T21:59:23.473016] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-07. [2025-10-02T21:59:23.794347] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-02T21:59:24.273014] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-10. [2025-10-02T21:59:24.871256] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-02T21:59:25.073003] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-08. [2025-10-02T21:59:25.113719] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-02T21:59:25.115536] [INFO ] [REMOTE ] TRN: Full fetch complete (52836 records). [2025-10-02T21:59:25.115625] [DEBUG] [VALIDATOR ] TRN: Validating primary data. [2025-10-02T21:59:25.535302] [DEBUG] [VALIDATOR ] TRN: All expected trading days are present. [2025-10-02T21:59:25.535398] [DEBUG] [VALIDATOR ] TRN: Primary data validation passed. [2025-10-02T21:59:25.536502] [INFO ] [MAIN ] TRN: Fetched primary data is valid. [2025-10-02T21:59:25.536567] [DEBUG] [LOCAL ] TRN: Saving primary data. [2025-10-02T21:59:25.537882] [DEBUG] [LOCAL ] TRN: Trimmed 52836 records to 37268 (keeping 200 days of data) [2025-10-02T21:59:25.774787] [DEBUG] [LOCAL ] TRN: Primary data saved (37268 records). [2025-10-02T21:59:25.774930] [INFO ] [MAIN ] TRN: Full history saved. [2025-10-02T21:59:25.775012] [INFO ] [MAIN ] Update Progress: 2125/2370 symbols completed. TRN took 26.9s. Estimated remaining: 34m 31s. Rate: 7.1 symbols/min [2025-10-02T21:59:25.882420] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-07. [2025-10-02T21:59:25.971011] [INFO ] [MAIN ] TRNO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:59:26.013878] [DEBUG] [LOCAL ] TRNO: Loaded 43942 existing records from primary storage. [2025-10-02T21:59:26.014245] [INFO ] [MAIN ] TRNO: Loaded 43942 existing records. [2025-10-02T21:59:26.211203] [WARN ] [MAIN ] TRNO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:59:26.211509] [INFO ] [MAIN ] TRNO: Wiping existing primary data before full refresh. [2025-10-02T21:59:26.211576] [INFO ] [LOCAL ] TRNO: Starting deletion of primary data. [2025-10-02T21:59:26.211843] [DEBUG] [LOCAL ] TRNO: Deleted primary data file. [2025-10-02T21:59:26.211904] [INFO ] [MAIN ] TRNO: Starting full primary refresh. [2025-10-02T21:59:26.614700] [INFO ] [REMOTE ] TRNO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:59:26.673064] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2024-12. [2025-10-02T21:59:26.737045] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-02T21:59:27.472993] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-09. [2025-10-02T21:59:27.559926] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-02T21:59:28.139562] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-02T21:59:28.272984] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-08. [2025-10-02T21:59:29.073001] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-01. [2025-10-02T21:59:29.150413] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-02T21:59:29.873056] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-10. [2025-10-02T21:59:29.987721] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-02T21:59:30.588733] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-02T21:59:30.589749] [INFO ] [REMOTE ] TRC: Full fetch complete (22048 records). [2025-10-02T21:59:30.589827] [DEBUG] [VALIDATOR ] TRC: Validating primary data. [2025-10-02T21:59:30.681318] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-10. [2025-10-02T21:59:30.816309] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-02T21:59:31.045621] [DEBUG] [VALIDATOR ] TRC: All expected trading days are present. [2025-10-02T21:59:31.045761] [DEBUG] [VALIDATOR ] TRC: Primary data validation passed. [2025-10-02T21:59:31.046364] [INFO ] [MAIN ] TRC: Fetched primary data is valid. [2025-10-02T21:59:31.046470] [DEBUG] [LOCAL ] TRC: Saving primary data. [2025-10-02T21:59:31.047397] [DEBUG] [LOCAL ] TRC: Trimmed 22048 records to 15837 (keeping 200 days of data) [2025-10-02T21:59:31.147995] [DEBUG] [LOCAL ] TRC: Primary data saved (15837 records). [2025-10-02T21:59:31.148153] [INFO ] [MAIN ] TRC: Full history saved. [2025-10-02T21:59:31.148256] [INFO ] [MAIN ] Update Progress: 2126/2370 symbols completed. TRC took 39.1s. Estimated remaining: 34m 22s. Rate: 7.1 symbols/min [2025-10-02T21:59:31.332635] [INFO ] [MAIN ] TROX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:59:31.381004] [DEBUG] [LOCAL ] TROX: Loaded 51877 existing records from primary storage. [2025-10-02T21:59:31.381331] [INFO ] [MAIN ] TROX: Loaded 51877 existing records. [2025-10-02T21:59:31.478141] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-09. [2025-10-02T21:59:31.597885] [WARN ] [MAIN ] TROX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:59:31.598199] [INFO ] [MAIN ] TROX: Wiping existing primary data before full refresh. [2025-10-02T21:59:31.598279] [INFO ] [LOCAL ] TROX: Starting deletion of primary data. [2025-10-02T21:59:31.598577] [DEBUG] [LOCAL ] TROX: Deleted primary data file. [2025-10-02T21:59:31.598686] [INFO ] [MAIN ] TROX: Starting full primary refresh. [2025-10-02T21:59:32.012587] [INFO ] [REMOTE ] TROX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:59:32.031929] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-02T21:59:32.033991] [INFO ] [REMOTE ] TREX: Full fetch complete (71069 records). [2025-10-02T21:59:32.034130] [DEBUG] [VALIDATOR ] TREX: Validating primary data. [2025-10-02T21:59:32.278902] [INFO ] [REMOTE ] TROX: Fetching primary data for 2024-12. [2025-10-02T21:59:32.484022] [DEBUG] [VALIDATOR ] TREX: All expected trading days are present. [2025-10-02T21:59:32.484112] [DEBUG] [VALIDATOR ] TREX: Primary data validation passed. [2025-10-02T21:59:32.485242] [INFO ] [MAIN ] TREX: Fetched primary data is valid. [2025-10-02T21:59:32.485308] [DEBUG] [LOCAL ] TREX: Saving primary data. [2025-10-02T21:59:32.486896] [DEBUG] [LOCAL ] TREX: Trimmed 71069 records to 50298 (keeping 200 days of data) [2025-10-02T21:59:32.795465] [DEBUG] [LOCAL ] TREX: Primary data saved (50298 records). [2025-10-02T21:59:32.795606] [INFO ] [MAIN ] TREX: Full history saved. [2025-10-02T21:59:32.795718] [INFO ] [MAIN ] Update Progress: 2127/2370 symbols completed. TREX took 37.9s. Estimated remaining: 34m 13s. Rate: 7.1 symbols/min [2025-10-02T21:59:32.977563] [INFO ] [MAIN ] TRP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:59:33.026824] [DEBUG] [LOCAL ] TRP: Loaded 52101 existing records from primary storage. [2025-10-02T21:59:33.027179] [INFO ] [MAIN ] TRP: Loaded 52101 existing records. [2025-10-02T21:59:33.094536] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-02. [2025-10-02T21:59:33.222368] [WARN ] [MAIN ] TRP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:59:33.222593] [INFO ] [MAIN ] TRP: Wiping existing primary data before full refresh. [2025-10-02T21:59:33.222697] [INFO ] [LOCAL ] TRP: Starting deletion of primary data. [2025-10-02T21:59:33.223000] [DEBUG] [LOCAL ] TRP: Deleted primary data file. [2025-10-02T21:59:33.223112] [INFO ] [MAIN ] TRP: Starting full primary refresh. [2025-10-02T21:59:33.569966] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-02T21:59:33.658567] [INFO ] [REMOTE ] TRP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:59:33.872998] [INFO ] [REMOTE ] TRP: Fetching primary data for 2024-12. [2025-10-02T21:59:33.968821] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-02T21:59:34.445873] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-02T21:59:34.673021] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-01. [2025-10-02T21:59:35.473061] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-10. [2025-10-02T21:59:35.605489] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-02T21:59:35.912214] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-02T21:59:36.273023] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-02. [2025-10-02T21:59:36.502921] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-02T21:59:36.505108] [INFO ] [REMOTE ] TRGP: Full fetch complete (73496 records). [2025-10-02T21:59:36.505220] [DEBUG] [VALIDATOR ] TRGP: Validating primary data. [2025-10-02T21:59:36.940193] [DEBUG] [VALIDATOR ] TRGP: All expected trading days are present. [2025-10-02T21:59:36.940292] [DEBUG] [VALIDATOR ] TRGP: Primary data validation passed. [2025-10-02T21:59:36.941444] [INFO ] [MAIN ] TRGP: Fetched primary data is valid. [2025-10-02T21:59:36.941508] [DEBUG] [LOCAL ] TRGP: Saving primary data. [2025-10-02T21:59:36.943010] [DEBUG] [LOCAL ] TRGP: Trimmed 73496 records to 51077 (keeping 200 days of data) [2025-10-02T21:59:37.073004] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-03. [2025-10-02T21:59:37.285183] [DEBUG] [LOCAL ] TRGP: Primary data saved (51077 records). [2025-10-02T21:59:37.285323] [INFO ] [MAIN ] TRGP: Full history saved. [2025-10-02T21:59:37.286217] [INFO ] [MAIN ] Update Progress: 2128/2370 symbols completed. TRGP took 41.0s. Estimated remaining: 34m 4s. Rate: 7.1 symbols/min [2025-10-02T21:59:37.474579] [INFO ] [MAIN ] TRTX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:59:37.526033] [DEBUG] [LOCAL ] TRTX: Loaded 37574 existing records from primary storage. [2025-10-02T21:59:37.526397] [INFO ] [MAIN ] TRTX: Loaded 37574 existing records. [2025-10-02T21:59:37.737272] [WARN ] [MAIN ] TRTX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:59:37.738111] [INFO ] [MAIN ] TRTX: Wiping existing primary data before full refresh. [2025-10-02T21:59:37.738256] [INFO ] [LOCAL ] TRTX: Starting deletion of primary data. [2025-10-02T21:59:37.738719] [DEBUG] [LOCAL ] TRTX: Deleted primary data file. [2025-10-02T21:59:37.738813] [INFO ] [MAIN ] TRTX: Starting full primary refresh. [2025-10-02T21:59:37.882878] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-01. [2025-10-02T21:59:37.977483] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-02T21:59:38.184500] [INFO ] [REMOTE ] TRTX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:59:38.673009] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2024-12. [2025-10-02T21:59:38.729440] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-02T21:59:39.472967] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-04. [2025-10-02T21:59:39.744685] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-02T21:59:40.096271] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-02T21:59:40.273001] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-01. [2025-10-02T21:59:40.380080] [DEBUG] [REMOTE ] TRTX: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-02T21:59:40.380394] [WARN ] [REMOTE ] TRTX: No data returned for month 2025-01 [2025-10-02T21:59:40.380487] [FATAL] [REMOTE ] TRTX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T21:59:40.380620] [FATAL] [MAIN ] TRTX: Failed to fetch primary data. [2025-10-02T21:59:40.380737] [WARN ] [MAIN ] TRTX: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T21:59:40.380833] [INFO ] [LOCAL ] TRTX: Starting deletion of primary data. [2025-10-02T21:59:40.380924] [DEBUG] [LOCAL ] TRTX: No primary data file found to delete. [2025-10-02T21:59:40.381005] [INFO ] [LOCAL ] TRTX: Starting deletion of derivative data. [2025-10-02T21:59:40.381468] [DEBUG] [LOCAL ] TRTX: Deleted derivative data file. [2025-10-02T21:59:40.381952] [INFO ] [MAIN ] Update Progress: 2129/2370 symbols completed. TRTX took 3.1s. Estimated remaining: 33m 55s. Rate: 7.1 symbols/min [2025-10-02T21:59:40.557713] [INFO ] [MAIN ] TRU: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:59:40.613556] [DEBUG] [LOCAL ] TRU: Loaded 51238 existing records from primary storage. [2025-10-02T21:59:40.613941] [INFO ] [MAIN ] TRU: Loaded 51238 existing records. [2025-10-02T21:59:40.806903] [WARN ] [MAIN ] TRU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:59:40.807175] [INFO ] [MAIN ] TRU: Wiping existing primary data before full refresh. [2025-10-02T21:59:40.807230] [INFO ] [LOCAL ] TRU: Starting deletion of primary data. [2025-10-02T21:59:40.807880] [DEBUG] [LOCAL ] TRU: Deleted primary data file. [2025-10-02T21:59:40.807945] [INFO ] [MAIN ] TRU: Starting full primary refresh. [2025-10-02T21:59:41.075393] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-02. [2025-10-02T21:59:41.195429] [INFO ] [REMOTE ] TRU: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:59:41.226475] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-02T21:59:41.873006] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-05. [2025-10-02T21:59:42.672991] [INFO ] [REMOTE ] TRU: Fetching primary data for 2024-12. [2025-10-02T21:59:42.723222] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-02T21:59:43.411908] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-02T21:59:43.473044] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-03. [2025-10-02T21:59:44.273030] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-06. [2025-10-02T21:59:44.403509] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-02T21:59:45.073017] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-03. [2025-10-02T21:59:45.240200] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-02T21:59:45.791538] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-02T21:59:45.873007] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-04. [2025-10-02T21:59:46.321105] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-02T21:59:46.672999] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-07. [2025-10-02T21:59:47.473016] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-04. [2025-10-02T21:59:47.770373] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-02T21:59:48.198990] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-02T21:59:48.272982] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-05. [2025-10-02T21:59:49.072970] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-01. [2025-10-02T21:59:49.248215] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-02T21:59:49.873001] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-08. [2025-10-02T21:59:50.220000] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-02T21:59:50.337881] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-02T21:59:50.673018] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-06. [2025-10-02T21:59:51.044719] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-02T21:59:51.473009] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-05. [2025-10-02T21:59:52.116449] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-02T21:59:52.272986] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-07. [2025-10-02T21:59:53.073013] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-09. [2025-10-02T21:59:53.251299] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-02T21:59:53.872998] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-02. [2025-10-02T21:59:53.962879] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-02T21:59:54.606138] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-02T21:59:54.673007] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-08. [2025-10-02T21:59:55.471919] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-02T21:59:55.480961] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-10. [2025-10-02T21:59:55.999860] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-02T21:59:56.272983] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-03. [2025-10-02T21:59:56.542499] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-02T21:59:56.544351] [INFO ] [REMOTE ] TRNO: Full fetch complete (63727 records). [2025-10-02T21:59:56.544474] [DEBUG] [VALIDATOR ] TRNO: Validating primary data. [2025-10-02T21:59:56.968456] [DEBUG] [VALIDATOR ] TRNO: All expected trading days are present. [2025-10-02T21:59:56.968560] [DEBUG] [VALIDATOR ] TRNO: Primary data validation passed. [2025-10-02T21:59:56.969770] [INFO ] [MAIN ] TRNO: Fetched primary data is valid. [2025-10-02T21:59:56.969865] [DEBUG] [LOCAL ] TRNO: Saving primary data. [2025-10-02T21:59:56.971440] [DEBUG] [LOCAL ] TRNO: Trimmed 63727 records to 44244 (keeping 200 days of data) [2025-10-02T21:59:57.073692] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-09. [2025-10-02T21:59:57.267045] [DEBUG] [LOCAL ] TRNO: Primary data saved (44244 records). [2025-10-02T21:59:57.267280] [INFO ] [MAIN ] TRNO: Full history saved. [2025-10-02T21:59:57.267578] [INFO ] [MAIN ] Update Progress: 2130/2370 symbols completed. TRNO took 31.5s. Estimated remaining: 33m 47s. Rate: 7.1 symbols/min [2025-10-02T21:59:57.466179] [INFO ] [MAIN ] TRV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T21:59:57.516312] [DEBUG] [LOCAL ] TRV: Loaded 47782 existing records from primary storage. [2025-10-02T21:59:57.516617] [INFO ] [MAIN ] TRV: Loaded 47782 existing records. [2025-10-02T21:59:57.709542] [WARN ] [MAIN ] TRV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T21:59:57.709989] [INFO ] [MAIN ] TRV: Wiping existing primary data before full refresh. [2025-10-02T21:59:57.710131] [INFO ] [LOCAL ] TRV: Starting deletion of primary data. [2025-10-02T21:59:57.710934] [DEBUG] [LOCAL ] TRV: Deleted primary data file. [2025-10-02T21:59:57.711162] [INFO ] [MAIN ] TRV: Starting full primary refresh. [2025-10-02T21:59:57.873593] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-06. [2025-10-02T21:59:58.116458] [INFO ] [REMOTE ] TRV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T21:59:58.147895] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-02T21:59:58.672999] [INFO ] [REMOTE ] TRV: Fetching primary data for 2024-12. [2025-10-02T21:59:58.789805] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-02T21:59:59.481746] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-10. [2025-10-02T21:59:59.505609] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-02T22:00:00.096911] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-02T22:00:00.273018] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-01. [2025-10-02T22:00:00.762672] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-02T22:00:00.766920] [INFO ] [REMOTE ] TRP: Full fetch complete (75573 records). [2025-10-02T22:00:00.767104] [DEBUG] [VALIDATOR ] TRP: Validating primary data. [2025-10-02T22:00:01.081771] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-04. [2025-10-02T22:00:01.224763] [DEBUG] [VALIDATOR ] TRP: All expected trading days are present. [2025-10-02T22:00:01.224890] [DEBUG] [VALIDATOR ] TRP: Primary data validation passed. [2025-10-02T22:00:01.226425] [INFO ] [MAIN ] TRP: Fetched primary data is valid. [2025-10-02T22:00:01.226518] [DEBUG] [LOCAL ] TRP: Saving primary data. [2025-10-02T22:00:01.228506] [DEBUG] [LOCAL ] TRP: Trimmed 75573 records to 52487 (keeping 200 days of data) [2025-10-02T22:00:01.606956] [DEBUG] [LOCAL ] TRP: Primary data saved (52487 records). [2025-10-02T22:00:01.607228] [INFO ] [MAIN ] TRP: Full history saved. [2025-10-02T22:00:01.607358] [INFO ] [MAIN ] Update Progress: 2131/2370 symbols completed. TRP took 28.8s. Estimated remaining: 33m 39s. Rate: 7.1 symbols/min [2025-10-02T22:00:01.806440] [INFO ] [MAIN ] TS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:00:01.865840] [DEBUG] [LOCAL ] TS: Loaded 51685 existing records from primary storage. [2025-10-02T22:00:01.866210] [INFO ] [MAIN ] TS: Loaded 51685 existing records. [2025-10-02T22:00:01.902149] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-07. [2025-10-02T22:00:02.094491] [WARN ] [MAIN ] TS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:00:02.094998] [INFO ] [MAIN ] TS: Wiping existing primary data before full refresh. [2025-10-02T22:00:02.095127] [INFO ] [LOCAL ] TS: Starting deletion of primary data. [2025-10-02T22:00:02.095584] [DEBUG] [LOCAL ] TS: Deleted primary data file. [2025-10-02T22:00:02.095745] [INFO ] [MAIN ] TS: Starting full primary refresh. [2025-10-02T22:00:02.501985] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-02T22:00:02.585859] [INFO ] [REMOTE ] TS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:00:02.673010] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-02. [2025-10-02T22:00:02.757506] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-02T22:00:03.473057] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-05. [2025-10-02T22:00:03.953031] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-02T22:00:04.272999] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-08. [2025-10-02T22:00:04.615088] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-02T22:00:05.073052] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-03. [2025-10-02T22:00:05.339362] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-02T22:00:05.873015] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-06. [2025-10-02T22:00:06.166856] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-02T22:00:06.672973] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-09. [2025-10-02T22:00:07.020037] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-02T22:00:07.473022] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-04. [2025-10-02T22:00:07.566667] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-02T22:00:08.273070] [INFO ] [REMOTE ] TS: Fetching primary data for 2024-12. [2025-10-02T22:00:08.494753] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-02T22:00:09.073048] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-10. [2025-10-02T22:00:09.457229] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-02T22:00:09.697377] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-02T22:00:09.873005] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-01. [2025-10-02T22:00:10.673043] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-07. [2025-10-02T22:00:10.799018] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-02T22:00:10.802066] [INFO ] [REMOTE ] TROX: Full fetch complete (73143 records). [2025-10-02T22:00:10.802285] [DEBUG] [VALIDATOR ] TROX: Validating primary data. [2025-10-02T22:00:11.282569] [DEBUG] [VALIDATOR ] TROX: All expected trading days are present. [2025-10-02T22:00:11.282679] [DEBUG] [VALIDATOR ] TROX: Primary data validation passed. [2025-10-02T22:00:11.283945] [INFO ] [MAIN ] TROX: Fetched primary data is valid. [2025-10-02T22:00:11.284011] [DEBUG] [LOCAL ] TROX: Saving primary data. [2025-10-02T22:00:11.286468] [DEBUG] [LOCAL ] TROX: Trimmed 73143 records to 52262 (keeping 200 days of data) [2025-10-02T22:00:11.481568] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-05. [2025-10-02T22:00:11.557552] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-02T22:00:11.697822] [DEBUG] [LOCAL ] TROX: Primary data saved (52262 records). [2025-10-02T22:00:11.698003] [INFO ] [MAIN ] TROX: Full history saved. [2025-10-02T22:00:11.698108] [INFO ] [MAIN ] Update Progress: 2132/2370 symbols completed. TROX took 40.5s. Estimated remaining: 33m 30s. Rate: 7.1 symbols/min [2025-10-02T22:00:11.883533] [INFO ] [MAIN ] TSE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:00:11.912603] [DEBUG] [LOCAL ] TSE: Loaded 28310 existing records from primary storage. [2025-10-02T22:00:11.912926] [INFO ] [MAIN ] TSE: Loaded 28310 existing records. [2025-10-02T22:00:12.103736] [WARN ] [MAIN ] TSE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:00:12.103979] [INFO ] [MAIN ] TSE: Wiping existing primary data before full refresh. [2025-10-02T22:00:12.104030] [INFO ] [LOCAL ] TSE: Starting deletion of primary data. [2025-10-02T22:00:12.104270] [DEBUG] [LOCAL ] TSE: Deleted primary data file. [2025-10-02T22:00:12.104346] [INFO ] [MAIN ] TSE: Starting full primary refresh. [2025-10-02T22:00:12.283124] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-02. [2025-10-02T22:00:12.517051] [INFO ] [REMOTE ] TSE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:00:12.639952] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-02T22:00:13.072969] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-08. [2025-10-02T22:00:13.196766] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-02T22:00:13.873036] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-06. [2025-10-02T22:00:14.169637] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-02T22:00:14.346166] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-02T22:00:14.673060] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-09. [2025-10-02T22:00:15.347450] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-02T22:00:15.473050] [INFO ] [REMOTE ] TSE: Fetching primary data for 2024-12. [2025-10-02T22:00:16.273022] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-07. [2025-10-02T22:00:16.487957] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-02T22:00:16.795694] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-02T22:00:17.073005] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-01. [2025-10-02T22:00:17.873164] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-10. [2025-10-02T22:00:17.992003] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-02T22:00:18.298638] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-02T22:00:18.673033] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-08. [2025-10-02T22:00:19.225391] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-02T22:00:19.227480] [INFO ] [REMOTE ] TRU: Full fetch complete (73438 records). [2025-10-02T22:00:19.227580] [DEBUG] [VALIDATOR ] TRU: Validating primary data. [2025-10-02T22:00:19.483936] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-02. [2025-10-02T22:00:19.673229] [DEBUG] [VALIDATOR ] TRU: All expected trading days are present. [2025-10-02T22:00:19.673323] [DEBUG] [VALIDATOR ] TRU: Primary data validation passed. [2025-10-02T22:00:19.674613] [INFO ] [MAIN ] TRU: Fetched primary data is valid. [2025-10-02T22:00:19.674720] [DEBUG] [LOCAL ] TRU: Saving primary data. [2025-10-02T22:00:19.676325] [DEBUG] [LOCAL ] TRU: Trimmed 73438 records to 51628 (keeping 200 days of data) [2025-10-02T22:00:20.032345] [DEBUG] [LOCAL ] TRU: Primary data saved (51628 records). [2025-10-02T22:00:20.032493] [INFO ] [MAIN ] TRU: Full history saved. [2025-10-02T22:00:20.033624] [INFO ] [MAIN ] Update Progress: 2133/2370 symbols completed. TRU took 39.7s. Estimated remaining: 33m 22s. Rate: 7.1 symbols/min [2025-10-02T22:00:20.240834] [INFO ] [MAIN ] TSI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:00:20.278246] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-03. [2025-10-02T22:00:20.282623] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-02T22:00:20.298140] [DEBUG] [LOCAL ] TSI: Loaded 7354 existing records from primary storage. [2025-10-02T22:00:20.299692] [INFO ] [MAIN ] TSI: Loaded 7354 existing records. [2025-10-02T22:00:20.513863] [WARN ] [MAIN ] TSI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:00:20.514342] [INFO ] [MAIN ] TSI: Wiping existing primary data before full refresh. [2025-10-02T22:00:20.514518] [INFO ] [LOCAL ] TSI: Starting deletion of primary data. [2025-10-02T22:00:20.520991] [DEBUG] [LOCAL ] TSI: Deleted primary data file. [2025-10-02T22:00:20.531425] [INFO ] [MAIN ] TSI: Starting full primary refresh. [2025-10-02T22:00:20.532320] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-02T22:00:20.953953] [INFO ] [REMOTE ] TSI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:00:21.072996] [INFO ] [REMOTE ] TSI: Fetching primary data for 2024-12. [2025-10-02T22:00:21.777773] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-02T22:00:21.873013] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-03. [2025-10-02T22:00:22.051818] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-02T22:00:22.673027] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-09. [2025-10-02T22:00:22.906484] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-02T22:00:23.473042] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-04. [2025-10-02T22:00:24.273034] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-01. [2025-10-02T22:00:24.352596] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-02T22:00:24.479020] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-02T22:00:24.906411] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-02T22:00:25.073040] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-02. [2025-10-02T22:00:25.872972] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-04. [2025-10-02T22:00:26.103479] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-02T22:00:26.672992] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-10. [2025-10-02T22:00:27.472992] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-05. [2025-10-02T22:00:27.606749] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-02T22:00:27.762278] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-02T22:00:27.764116] [INFO ] [REMOTE ] TRV: Full fetch complete (69750 records). [2025-10-02T22:00:27.764247] [DEBUG] [VALIDATOR ] TRV: Validating primary data. [2025-10-02T22:00:28.209546] [DEBUG] [VALIDATOR ] TRV: All expected trading days are present. [2025-10-02T22:00:28.209697] [DEBUG] [VALIDATOR ] TRV: Primary data validation passed. [2025-10-02T22:00:28.211393] [INFO ] [MAIN ] TRV: Fetched primary data is valid. [2025-10-02T22:00:28.211464] [DEBUG] [LOCAL ] TRV: Saving primary data. [2025-10-02T22:00:28.213129] [DEBUG] [LOCAL ] TRV: Trimmed 69750 records to 48094 (keeping 200 days of data) [2025-10-02T22:00:28.283498] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-05. [2025-10-02T22:00:28.556123] [DEBUG] [LOCAL ] TRV: Primary data saved (48094 records). [2025-10-02T22:00:28.556284] [INFO ] [MAIN ] TRV: Full history saved. [2025-10-02T22:00:28.556390] [INFO ] [MAIN ] Update Progress: 2134/2370 symbols completed. TRV took 31.3s. Estimated remaining: 33m 13s. Rate: 7.1 symbols/min [2025-10-02T22:00:28.757172] [INFO ] [MAIN ] TSLX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:00:28.793011] [DEBUG] [LOCAL ] TSLX: Loaded 35196 existing records from primary storage. [2025-10-02T22:00:28.793338] [INFO ] [MAIN ] TSLX: Loaded 35196 existing records. [2025-10-02T22:00:29.002068] [WARN ] [MAIN ] TSLX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:00:29.021799] [INFO ] [MAIN ] TSLX: Wiping existing primary data before full refresh. [2025-10-02T22:00:29.022556] [INFO ] [LOCAL ] TSLX: Starting deletion of primary data. [2025-10-02T22:00:29.023460] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-02T22:00:29.030390] [DEBUG] [LOCAL ] TSLX: Deleted primary data file. [2025-10-02T22:00:29.031033] [INFO ] [MAIN ] TSLX: Starting full primary refresh. [2025-10-02T22:00:29.080689] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-03. [2025-10-02T22:00:29.439133] [INFO ] [REMOTE ] TSLX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:00:29.760220] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-02T22:00:29.873014] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2024-12. [2025-10-02T22:00:30.248678] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-02T22:00:30.673006] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-04. [2025-10-02T22:00:30.973288] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-02T22:00:31.475003] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-01. [2025-10-02T22:00:31.478415] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-02T22:00:32.273199] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-05. [2025-10-02T22:00:32.274228] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-02T22:00:32.908583] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-02T22:00:33.072999] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-02. [2025-10-02T22:00:33.872964] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-06. [2025-10-02T22:00:34.025677] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-02T22:00:34.672999] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-03. [2025-10-02T22:00:35.129724] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-02T22:00:35.472998] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-07. [2025-10-02T22:00:36.088485] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-02T22:00:36.272989] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-06. [2025-10-02T22:00:36.719369] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-02T22:00:37.072995] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-06. [2025-10-02T22:00:37.839684] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-02T22:00:37.872967] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-07. [2025-10-02T22:00:38.004393] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-02T22:00:38.355215] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-02T22:00:38.673003] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-08. [2025-10-02T22:00:39.432900] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-02T22:00:39.472966] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-09. [2025-10-02T22:00:40.256339] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-02T22:00:40.272982] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-10. [2025-10-02T22:00:40.666901] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-02T22:00:40.667705] [INFO ] [REMOTE ] TSI: Full fetch complete (13253 records). [2025-10-02T22:00:40.667779] [DEBUG] [VALIDATOR ] TSI: Validating primary data. [2025-10-02T22:00:41.074312] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-07. [2025-10-02T22:00:41.075706] [DEBUG] [VALIDATOR ] TSI: All expected trading days are present. [2025-10-02T22:00:41.075824] [DEBUG] [VALIDATOR ] TSI: Primary data validation passed. [2025-10-02T22:00:41.076196] [INFO ] [MAIN ] TSI: Fetched primary data is valid. [2025-10-02T22:00:41.076287] [DEBUG] [LOCAL ] TSI: Saving primary data. [2025-10-02T22:00:41.077194] [DEBUG] [LOCAL ] TSI: Trimmed 13253 records to 7378 (keeping 200 days of data) [2025-10-02T22:00:41.122744] [DEBUG] [LOCAL ] TSI: Primary data saved (7378 records). [2025-10-02T22:00:41.122887] [INFO ] [MAIN ] TSI: Full history saved. [2025-10-02T22:00:41.122989] [INFO ] [MAIN ] Update Progress: 2135/2370 symbols completed. TSI took 21.1s. Estimated remaining: 33m 5s. Rate: 7.1 symbols/min [2025-10-02T22:00:41.314199] [INFO ] [MAIN ] TSM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:00:41.380441] [DEBUG] [LOCAL ] TSM: Loaded 53819 existing records from primary storage. [2025-10-02T22:00:41.380887] [INFO ] [MAIN ] TSM: Loaded 53819 existing records. [2025-10-02T22:00:41.592279] [WARN ] [MAIN ] TSM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:00:41.592563] [INFO ] [MAIN ] TSM: Wiping existing primary data before full refresh. [2025-10-02T22:00:41.592611] [INFO ] [LOCAL ] TSM: Starting deletion of primary data. [2025-10-02T22:00:41.593144] [DEBUG] [LOCAL ] TSM: Deleted primary data file. [2025-10-02T22:00:41.593203] [INFO ] [MAIN ] TSM: Starting full primary refresh. [2025-10-02T22:00:41.878156] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-04. [2025-10-02T22:00:41.988487] [INFO ] [REMOTE ] TSM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:00:42.673039] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-08. [2025-10-02T22:00:43.026835] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-02T22:00:43.067059] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-02T22:00:43.473006] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-05. [2025-10-02T22:00:44.030814] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-02T22:00:44.273016] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-08. [2025-10-02T22:00:44.888366] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-02T22:00:45.073061] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-06. [2025-10-02T22:00:45.872981] [INFO ] [REMOTE ] TSM: Fetching primary data for 2024-12. [2025-10-02T22:00:45.983539] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-02T22:00:46.504502] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-02T22:00:46.673010] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-09. [2025-10-02T22:00:47.515342] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-09. [2025-10-02T22:00:47.527115] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-02T22:00:48.273002] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-07. [2025-10-02T22:00:48.684816] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2024-12 (2.81 seconds). [2025-10-02T22:00:48.831088] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-02T22:00:49.073016] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-10. [2025-10-02T22:00:49.873009] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-10. [2025-10-02T22:00:49.909941] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-02T22:00:49.910144] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-02T22:00:49.920334] [INFO ] [REMOTE ] TSE: Full fetch complete (41095 records). [2025-10-02T22:00:49.920619] [DEBUG] [VALIDATOR ] TSE: Validating primary data. [2025-10-02T22:00:50.325365] [DEBUG] [VALIDATOR ] TSE: All expected trading days are present. [2025-10-02T22:00:50.325449] [DEBUG] [VALIDATOR ] TSE: Primary data validation passed. [2025-10-02T22:00:50.326356] [INFO ] [MAIN ] TSE: Fetched primary data is valid. [2025-10-02T22:00:50.326453] [DEBUG] [LOCAL ] TSE: Saving primary data. [2025-10-02T22:00:50.327399] [DEBUG] [LOCAL ] TSE: Trimmed 41095 records to 28404 (keeping 200 days of data) [2025-10-02T22:00:50.513548] [DEBUG] [LOCAL ] TSE: Primary data saved (28404 records). [2025-10-02T22:00:50.513734] [INFO ] [MAIN ] TSE: Full history saved. [2025-10-02T22:00:50.513880] [INFO ] [MAIN ] Update Progress: 2136/2370 symbols completed. TSE took 38.8s. Estimated remaining: 32m 57s. Rate: 7.1 symbols/min [2025-10-02T22:00:50.682842] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-01. [2025-10-02T22:00:50.703763] [INFO ] [MAIN ] TSN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:00:50.755718] [DEBUG] [LOCAL ] TSN: Loaded 52908 existing records from primary storage. [2025-10-02T22:00:50.756059] [INFO ] [MAIN ] TSN: Loaded 52908 existing records. [2025-10-02T22:00:50.953337] [WARN ] [MAIN ] TSN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:00:50.953555] [INFO ] [MAIN ] TSN: Wiping existing primary data before full refresh. [2025-10-02T22:00:50.953631] [INFO ] [LOCAL ] TSN: Starting deletion of primary data. [2025-10-02T22:00:50.953925] [DEBUG] [LOCAL ] TSN: Deleted primary data file. [2025-10-02T22:00:50.953990] [INFO ] [MAIN ] TSN: Starting full primary refresh. [2025-10-02T22:00:51.266274] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-02T22:00:51.311561] [INFO ] [REMOTE ] TS: Full fetch complete (74523 records). [2025-10-02T22:00:51.324508] [DEBUG] [VALIDATOR ] TS: Validating primary data. [2025-10-02T22:00:51.350817] [INFO ] [REMOTE ] TSN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:00:51.478139] [INFO ] [REMOTE ] TSN: Fetching primary data for 2024-12. [2025-10-02T22:00:51.780956] [DEBUG] [VALIDATOR ] TS: All expected trading days are present. [2025-10-02T22:00:51.781049] [DEBUG] [VALIDATOR ] TS: Primary data validation passed. [2025-10-02T22:00:51.782237] [INFO ] [MAIN ] TS: Fetched primary data is valid. [2025-10-02T22:00:51.782312] [DEBUG] [LOCAL ] TS: Saving primary data. [2025-10-02T22:00:51.783924] [DEBUG] [LOCAL ] TS: Trimmed 74523 records to 52072 (keeping 200 days of data) [2025-10-02T22:00:52.121484] [DEBUG] [LOCAL ] TS: Primary data saved (52072 records). [2025-10-02T22:00:52.121954] [INFO ] [MAIN ] TS: Full history saved. [2025-10-02T22:00:52.122059] [INFO ] [MAIN ] Update Progress: 2137/2370 symbols completed. TS took 50.5s. Estimated remaining: 32m 48s. Rate: 7.1 symbols/min [2025-10-02T22:00:52.279783] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-08. [2025-10-02T22:00:52.314785] [INFO ] [MAIN ] TSQ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:00:52.329475] [DEBUG] [LOCAL ] TSQ: Loaded 12024 existing records from primary storage. [2025-10-02T22:00:52.329745] [INFO ] [MAIN ] TSQ: Loaded 12024 existing records. [2025-10-02T22:00:52.522149] [WARN ] [MAIN ] TSQ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:00:52.522426] [INFO ] [MAIN ] TSQ: Wiping existing primary data before full refresh. [2025-10-02T22:00:52.522475] [INFO ] [LOCAL ] TSQ: Starting deletion of primary data. [2025-10-02T22:00:52.522976] [DEBUG] [LOCAL ] TSQ: Deleted primary data file. [2025-10-02T22:00:52.523034] [INFO ] [MAIN ] TSQ: Starting full primary refresh. [2025-10-02T22:00:52.907667] [INFO ] [REMOTE ] TSQ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:00:53.072983] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2024-12. [2025-10-02T22:00:53.385837] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-02T22:00:53.496000] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-01 (2.81 seconds). [2025-10-02T22:00:53.736491] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-02T22:00:53.855436] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-02T22:00:53.872973] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-02. [2025-10-02T22:00:54.673010] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-01. [2025-10-02T22:00:55.473035] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-01. [2025-10-02T22:00:56.033945] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-02T22:00:56.278772] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-02. [2025-10-02T22:00:56.279875] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-02T22:00:56.488695] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-02 (2.62 seconds). [2025-10-02T22:00:57.073005] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-02. [2025-10-02T22:00:57.841780] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-02T22:00:57.873009] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-09. [2025-10-02T22:00:57.939727] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-02T22:00:58.673025] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-03. [2025-10-02T22:00:59.020023] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-02T22:00:59.473015] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-03. [2025-10-02T22:01:00.272992] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-10. [2025-10-02T22:01:00.562330] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-02T22:01:01.073019] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-04. [2025-10-02T22:01:01.133040] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-02T22:01:01.135433] [INFO ] [REMOTE ] TSLX: Full fetch complete (49517 records). [2025-10-02T22:01:01.135594] [DEBUG] [VALIDATOR ] TSLX: Validating primary data. [2025-10-02T22:01:01.577462] [DEBUG] [VALIDATOR ] TSLX: All expected trading days are present. [2025-10-02T22:01:01.577553] [DEBUG] [VALIDATOR ] TSLX: Primary data validation passed. [2025-10-02T22:01:01.578592] [INFO ] [MAIN ] TSLX: Fetched primary data is valid. [2025-10-02T22:01:01.578685] [DEBUG] [LOCAL ] TSLX: Saving primary data. [2025-10-02T22:01:01.579936] [DEBUG] [LOCAL ] TSLX: Trimmed 49517 records to 35503 (keeping 200 days of data) [2025-10-02T22:01:01.818509] [DEBUG] [LOCAL ] TSLX: Primary data saved (35503 records). [2025-10-02T22:01:01.818892] [INFO ] [MAIN ] TSLX: Full history saved. [2025-10-02T22:01:01.819001] [INFO ] [MAIN ] Update Progress: 2138/2370 symbols completed. TSLX took 33.3s. Estimated remaining: 32m 40s. Rate: 7.1 symbols/min [2025-10-02T22:01:01.891358] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-03. [2025-10-02T22:01:02.051207] [INFO ] [MAIN ] TT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:01:02.106401] [DEBUG] [LOCAL ] TT: Loaded 47697 existing records from primary storage. [2025-10-02T22:01:02.106811] [INFO ] [MAIN ] TT: Loaded 47697 existing records. [2025-10-02T22:01:02.311052] [WARN ] [MAIN ] TT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:01:02.311441] [INFO ] [MAIN ] TT: Wiping existing primary data before full refresh. [2025-10-02T22:01:02.311556] [INFO ] [LOCAL ] TT: Starting deletion of primary data. [2025-10-02T22:01:02.312104] [DEBUG] [LOCAL ] TT: Deleted primary data file. [2025-10-02T22:01:02.312224] [INFO ] [MAIN ] TT: Starting full primary refresh. [2025-10-02T22:01:02.546825] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-03 (3.07 seconds). [2025-10-02T22:01:02.676868] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-04. [2025-10-02T22:01:02.791771] [INFO ] [REMOTE ] TT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:01:02.801009] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-02T22:01:02.997423] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-02T22:01:03.473010] [INFO ] [REMOTE ] TT: Fetching primary data for 2024-12. [2025-10-02T22:01:04.273078] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-05. [2025-10-02T22:01:05.073104] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-04. [2025-10-02T22:01:05.153998] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-02T22:01:05.282304] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-04 (2.61 seconds). [2025-10-02T22:01:05.873077] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-01. [2025-10-02T22:01:05.894008] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-02T22:01:06.162009] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-02T22:01:06.673041] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-05. [2025-10-02T22:01:07.419109] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-02T22:01:07.473059] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-02. [2025-10-02T22:01:07.613316] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-02T22:01:08.272990] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-05. [2025-10-02T22:01:09.072992] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-06. [2025-10-02T22:01:09.256396] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-02T22:01:09.850603] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-02T22:01:09.872988] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-07. [2025-10-02T22:01:10.673039] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-03. [2025-10-02T22:01:10.745163] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-02T22:01:11.177849] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-05 (2.90 seconds). [2025-10-02T22:01:11.473093] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-08. [2025-10-02T22:01:12.070074] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-02T22:01:12.094324] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-02T22:01:12.273010] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-09. [2025-10-02T22:01:13.047833] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-02T22:01:13.072976] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-10. [2025-10-02T22:01:13.566968] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-02T22:01:13.567875] [INFO ] [REMOTE ] TSQ: Full fetch complete (16505 records). [2025-10-02T22:01:13.567945] [DEBUG] [VALIDATOR ] TSQ: Validating primary data. [2025-10-02T22:01:13.878096] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-06. [2025-10-02T22:01:13.961029] [DEBUG] [VALIDATOR ] TSQ: All expected trading days are present. [2025-10-02T22:01:13.961107] [DEBUG] [VALIDATOR ] TSQ: Primary data validation passed. [2025-10-02T22:01:13.961511] [INFO ] [MAIN ] TSQ: Fetched primary data is valid. [2025-10-02T22:01:13.961557] [DEBUG] [LOCAL ] TSQ: Saving primary data. [2025-10-02T22:01:13.962132] [DEBUG] [LOCAL ] TSQ: Trimmed 16505 records to 12068 (keeping 200 days of data) [2025-10-02T22:01:14.039877] [DEBUG] [LOCAL ] TSQ: Primary data saved (12068 records). [2025-10-02T22:01:14.040020] [INFO ] [MAIN ] TSQ: Full history saved. [2025-10-02T22:01:14.040105] [INFO ] [MAIN ] Update Progress: 2139/2370 symbols completed. TSQ took 21.9s. Estimated remaining: 32m 31s. Rate: 7.1 symbols/min [2025-10-02T22:01:14.228960] [INFO ] [MAIN ] TTAM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:01:14.229143] [DEBUG] [LOCAL ] TTAM: No existing data file found in primary storage. [2025-10-02T22:01:14.229181] [WARN ] [MAIN ] TTAM: No existing data found, performing full refresh instead. [2025-10-02T22:01:14.229295] [INFO ] [MAIN ] TTAM: Wiping existing primary data before full refresh. [2025-10-02T22:01:14.229339] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-10-02T22:01:14.229381] [DEBUG] [LOCAL ] TTAM: No primary data file found to delete. [2025-10-02T22:01:14.229413] [INFO ] [MAIN ] TTAM: Starting full primary refresh. [2025-10-02T22:01:14.648017] [INFO ] [REMOTE ] TTAM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:01:14.672998] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-04. [2025-10-02T22:01:15.473050] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-06. [2025-10-02T22:01:15.788112] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-02T22:01:16.273027] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2024-12. [2025-10-02T22:01:16.486405] [DEBUG] [REMOTE ] TTAM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T22:01:16.486771] [WARN ] [REMOTE ] TTAM: No data returned for month 2024-12 [2025-10-02T22:01:16.486877] [FATAL] [REMOTE ] TTAM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T22:01:16.486925] [FATAL] [MAIN ] TTAM: Failed to fetch primary data. [2025-10-02T22:01:16.486960] [WARN ] [MAIN ] TTAM: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T22:01:16.487003] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-10-02T22:01:16.487071] [DEBUG] [LOCAL ] TTAM: No primary data file found to delete. [2025-10-02T22:01:16.487112] [INFO ] [LOCAL ] TTAM: Starting deletion of derivative data. [2025-10-02T22:01:16.487174] [DEBUG] [LOCAL ] TTAM: No derivative data file found to delete. [2025-10-02T22:01:16.487248] [INFO ] [MAIN ] Update Progress: 2140/2370 symbols completed. TTAM took 2.4s. Estimated remaining: 32m 22s. Rate: 7.1 symbols/min [2025-10-02T22:01:16.694100] [INFO ] [MAIN ] TTC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:01:16.728424] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-02T22:01:16.778176] [DEBUG] [LOCAL ] TTC: Loaded 42098 existing records from primary storage. [2025-10-02T22:01:16.778606] [INFO ] [MAIN ] TTC: Loaded 42098 existing records. [2025-10-02T22:01:17.009706] [WARN ] [MAIN ] TTC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:01:17.009938] [INFO ] [MAIN ] TTC: Wiping existing primary data before full refresh. [2025-10-02T22:01:17.009991] [INFO ] [LOCAL ] TTC: Starting deletion of primary data. [2025-10-02T22:01:17.010300] [DEBUG] [LOCAL ] TTC: Deleted primary data file. [2025-10-02T22:01:17.010361] [INFO ] [MAIN ] TTC: Starting full primary refresh. [2025-10-02T22:01:17.084002] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-07. [2025-10-02T22:01:17.571296] [INFO ] [REMOTE ] TTC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:01:17.873059] [INFO ] [REMOTE ] TTC: Fetching primary data for 2024-12. [2025-10-02T22:01:18.192333] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-06 (2.72 seconds). [2025-10-02T22:01:18.684565] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-07. [2025-10-02T22:01:18.714993] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-02T22:01:19.472971] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-05. [2025-10-02T22:01:19.571833] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-02T22:01:20.272992] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-08. [2025-10-02T22:01:21.023144] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-02T22:01:21.073032] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-06. [2025-10-02T22:01:21.649495] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-07 (2.96 seconds). [2025-10-02T22:01:21.873052] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-08. [2025-10-02T22:01:22.176259] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-02T22:01:22.673004] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-01. [2025-10-02T22:01:22.797514] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-02T22:01:23.473009] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-07. [2025-10-02T22:01:24.272962] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-09. [2025-10-02T22:01:24.363232] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-02T22:01:24.463871] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-08 (2.59 seconds). [2025-10-02T22:01:24.866951] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-02T22:01:25.073002] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-08. [2025-10-02T22:01:25.872979] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-09. [2025-10-02T22:01:26.068476] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-02T22:01:26.673038] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-10. [2025-10-02T22:01:26.674629] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-02T22:01:27.473013] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-02. [2025-10-02T22:01:28.033861] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-02T22:01:28.063368] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-02T22:01:28.066863] [INFO ] [REMOTE ] TSN: Full fetch complete (76311 records). [2025-10-02T22:01:28.067014] [DEBUG] [VALIDATOR ] TSN: Validating primary data. [2025-10-02T22:01:28.286676] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-10. [2025-10-02T22:01:28.509922] [DEBUG] [VALIDATOR ] TSN: All expected trading days are present. [2025-10-02T22:01:28.510017] [DEBUG] [VALIDATOR ] TSN: Primary data validation passed. [2025-10-02T22:01:28.511390] [INFO ] [MAIN ] TSN: Fetched primary data is valid. [2025-10-02T22:01:28.511460] [DEBUG] [LOCAL ] TSN: Saving primary data. [2025-10-02T22:01:28.513290] [DEBUG] [LOCAL ] TSN: Trimmed 76311 records to 53293 (keeping 200 days of data) [2025-10-02T22:01:28.788755] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-02T22:01:28.909918] [DEBUG] [LOCAL ] TSN: Primary data saved (53293 records). [2025-10-02T22:01:28.910129] [INFO ] [MAIN ] TSN: Full history saved. [2025-10-02T22:01:28.910234] [INFO ] [MAIN ] Update Progress: 2141/2370 symbols completed. TSN took 38.4s. Estimated remaining: 32m 14s. Rate: 7.1 symbols/min [2025-10-02T22:01:29.087019] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-03. [2025-10-02T22:01:29.090837] [INFO ] [MAIN ] TTE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:01:29.140557] [DEBUG] [LOCAL ] TTE: Loaded 51637 existing records from primary storage. [2025-10-02T22:01:29.140933] [INFO ] [MAIN ] TTE: Loaded 51637 existing records. [2025-10-02T22:01:29.327385] [WARN ] [MAIN ] TTE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:01:29.327633] [INFO ] [MAIN ] TTE: Wiping existing primary data before full refresh. [2025-10-02T22:01:29.327725] [INFO ] [LOCAL ] TTE: Starting deletion of primary data. [2025-10-02T22:01:29.327950] [DEBUG] [LOCAL ] TTE: Deleted primary data file. [2025-10-02T22:01:29.328037] [INFO ] [MAIN ] TTE: Starting full primary refresh. [2025-10-02T22:01:29.708039] [INFO ] [REMOTE ] TTE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:01:29.873023] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-09. [2025-10-02T22:01:30.588766] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-02T22:01:30.604913] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-10 (2.32 seconds). [2025-10-02T22:01:30.607409] [INFO ] [REMOTE ] TSM: Full fetch complete (77990 records). [2025-10-02T22:01:30.607526] [DEBUG] [VALIDATOR ] TSM: Validating primary data. [2025-10-02T22:01:30.678112] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-04. [2025-10-02T22:01:31.029884] [DEBUG] [VALIDATOR ] TSM: All expected trading days are present. [2025-10-02T22:01:31.030014] [DEBUG] [VALIDATOR ] TSM: Primary data validation passed. [2025-10-02T22:01:31.031312] [INFO ] [MAIN ] TSM: Fetched primary data is valid. [2025-10-02T22:01:31.031397] [DEBUG] [LOCAL ] TSM: Saving primary data. [2025-10-02T22:01:31.032970] [DEBUG] [LOCAL ] TSM: Trimmed 77990 records to 54209 (keeping 200 days of data) [2025-10-02T22:01:31.454347] [DEBUG] [LOCAL ] TSM: Primary data saved (54209 records). [2025-10-02T22:01:31.454875] [INFO ] [MAIN ] TSM: Full history saved. [2025-10-02T22:01:31.457042] [INFO ] [MAIN ] Update Progress: 2142/2370 symbols completed. TSM took 50.3s. Estimated remaining: 32m 5s. Rate: 7.1 symbols/min [2025-10-02T22:01:31.456030] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-02T22:01:31.490822] [INFO ] [REMOTE ] TTE: Fetching primary data for 2024-12. [2025-10-02T22:01:31.660823] [INFO ] [MAIN ] TTI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:01:31.708605] [DEBUG] [LOCAL ] TTI: Loaded 45626 existing records from primary storage. [2025-10-02T22:01:31.708944] [INFO ] [MAIN ] TTI: Loaded 45626 existing records. [2025-10-02T22:01:31.904862] [WARN ] [MAIN ] TTI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:01:31.905091] [INFO ] [MAIN ] TTI: Wiping existing primary data before full refresh. [2025-10-02T22:01:31.905141] [INFO ] [LOCAL ] TTI: Starting deletion of primary data. [2025-10-02T22:01:31.905362] [DEBUG] [LOCAL ] TTI: Deleted primary data file. [2025-10-02T22:01:31.905422] [INFO ] [MAIN ] TTI: Starting full primary refresh. [2025-10-02T22:01:32.274817] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-10. [2025-10-02T22:01:32.309762] [INFO ] [REMOTE ] TTI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:01:32.339587] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-02T22:01:33.073000] [INFO ] [REMOTE ] TTI: Fetching primary data for 2024-12. [2025-10-02T22:01:33.474262] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-02T22:01:33.504403] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-02T22:01:33.506895] [INFO ] [REMOTE ] TT: Full fetch complete (69846 records). [2025-10-02T22:01:33.507050] [DEBUG] [VALIDATOR ] TT: Validating primary data. [2025-10-02T22:01:33.878158] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-01. [2025-10-02T22:01:33.969859] [DEBUG] [VALIDATOR ] TT: All expected trading days are present. [2025-10-02T22:01:33.969952] [DEBUG] [VALIDATOR ] TT: Primary data validation passed. [2025-10-02T22:01:33.971207] [INFO ] [MAIN ] TT: Fetched primary data is valid. [2025-10-02T22:01:33.971280] [DEBUG] [LOCAL ] TT: Saving primary data. [2025-10-02T22:01:33.972927] [DEBUG] [LOCAL ] TT: Trimmed 69846 records to 48026 (keeping 200 days of data) [2025-10-02T22:01:34.310763] [DEBUG] [LOCAL ] TT: Primary data saved (48026 records). [2025-10-02T22:01:34.310918] [INFO ] [MAIN ] TT: Full history saved. [2025-10-02T22:01:34.311007] [INFO ] [MAIN ] Update Progress: 2143/2370 symbols completed. TT took 32.5s. Estimated remaining: 31m 56s. Rate: 7.1 symbols/min [2025-10-02T22:01:34.517788] [INFO ] [MAIN ] TU: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:01:34.570337] [DEBUG] [LOCAL ] TU: Loaded 49853 existing records from primary storage. [2025-10-02T22:01:34.570673] [INFO ] [MAIN ] TU: Loaded 49853 existing records. [2025-10-02T22:01:34.676127] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-05. [2025-10-02T22:01:34.779076] [WARN ] [MAIN ] TU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:01:34.779560] [INFO ] [MAIN ] TU: Wiping existing primary data before full refresh. [2025-10-02T22:01:34.779836] [INFO ] [LOCAL ] TU: Starting deletion of primary data. [2025-10-02T22:01:34.788304] [DEBUG] [LOCAL ] TU: Deleted primary data file. [2025-10-02T22:01:34.793527] [INFO ] [MAIN ] TU: Starting full primary refresh. [2025-10-02T22:01:34.897817] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-02T22:01:35.245209] [INFO ] [REMOTE ] TU: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:01:35.472978] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-01. [2025-10-02T22:01:35.727750] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-02T22:01:36.272998] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-02. [2025-10-02T22:01:36.341836] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-02T22:01:37.073914] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-06. [2025-10-02T22:01:37.079980] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-02T22:01:37.873011] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-02. [2025-10-02T22:01:38.030986] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-02T22:01:38.654268] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-02T22:01:38.672972] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-07. [2025-10-02T22:01:39.051567] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-02T22:01:39.472977] [INFO ] [REMOTE ] TU: Fetching primary data for 2024-12. [2025-10-02T22:01:40.109583] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-02T22:01:40.273043] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-03. [2025-10-02T22:01:41.072999] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-08. [2025-10-02T22:01:41.297546] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-02T22:01:41.372341] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-02T22:01:41.873029] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-03. [2025-10-02T22:01:42.660232] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-02T22:01:42.672949] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-09. [2025-10-02T22:01:43.473039] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-04. [2025-10-02T22:01:43.864856] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-02T22:01:43.970948] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-02T22:01:44.273059] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-10. [2025-10-02T22:01:45.073014] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-01. [2025-10-02T22:01:45.167825] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-02T22:01:45.397464] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-02T22:01:45.399247] [INFO ] [REMOTE ] TTC: Full fetch complete (62187 records). [2025-10-02T22:01:45.399360] [DEBUG] [VALIDATOR ] TTC: Validating primary data. [2025-10-02T22:01:45.881183] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-05. [2025-10-02T22:01:45.884667] [DEBUG] [VALIDATOR ] TTC: All expected trading days are present. [2025-10-02T22:01:45.884795] [DEBUG] [VALIDATOR ] TTC: Primary data validation passed. [2025-10-02T22:01:45.885948] [INFO ] [MAIN ] TTC: Fetched primary data is valid. [2025-10-02T22:01:45.886961] [DEBUG] [LOCAL ] TTC: Saving primary data. [2025-10-02T22:01:45.889284] [DEBUG] [LOCAL ] TTC: Trimmed 62187 records to 42360 (keeping 200 days of data) [2025-10-02T22:01:46.157699] [DEBUG] [LOCAL ] TTC: Primary data saved (42360 records). [2025-10-02T22:01:46.157858] [INFO ] [MAIN ] TTC: Full history saved. [2025-10-02T22:01:46.157980] [INFO ] [MAIN ] Update Progress: 2144/2370 symbols completed. TTC took 29.7s. Estimated remaining: 31m 48s. Rate: 7.1 symbols/min [2025-10-02T22:01:46.343906] [INFO ] [MAIN ] TUYA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:01:46.388131] [DEBUG] [LOCAL ] TUYA: Loaded 46181 existing records from primary storage. [2025-10-02T22:01:46.388494] [INFO ] [MAIN ] TUYA: Loaded 46181 existing records. [2025-10-02T22:01:46.611786] [WARN ] [MAIN ] TUYA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:01:46.612129] [INFO ] [MAIN ] TUYA: Wiping existing primary data before full refresh. [2025-10-02T22:01:46.612255] [INFO ] [LOCAL ] TUYA: Starting deletion of primary data. [2025-10-02T22:01:46.612716] [DEBUG] [LOCAL ] TUYA: Deleted primary data file. [2025-10-02T22:01:46.612778] [INFO ] [MAIN ] TUYA: Starting full primary refresh. [2025-10-02T22:01:46.683524] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-04. [2025-10-02T22:01:46.967256] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-02T22:01:47.079088] [INFO ] [REMOTE ] TUYA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:01:47.435202] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-02T22:01:47.472993] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-06. [2025-10-02T22:01:48.273000] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-02. [2025-10-02T22:01:48.662770] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-02T22:01:49.073052] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2024-12. [2025-10-02T22:01:49.240725] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-02T22:01:49.353713] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-02T22:01:49.873005] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-03. [2025-10-02T22:01:50.539709] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-02T22:01:50.673014] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-01. [2025-10-02T22:01:51.473027] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-07. [2025-10-02T22:01:51.669229] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-02T22:01:52.198769] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-02T22:01:52.273039] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-02. [2025-10-02T22:01:52.819838] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-02T22:01:53.073049] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-08. [2025-10-02T22:01:53.873011] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-05. [2025-10-02T22:01:54.039775] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-02T22:01:54.673036] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-04. [2025-10-02T22:01:54.759300] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-02T22:01:55.381300] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-02T22:01:55.473238] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-03. [2025-10-02T22:01:56.273004] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-06. [2025-10-02T22:01:56.497795] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-02T22:01:57.073037] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-09. [2025-10-02T22:01:57.329190] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-02T22:01:57.704228] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-02T22:01:57.873027] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-04. [2025-10-02T22:01:58.275491] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-02T22:01:58.673060] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-07. [2025-10-02T22:01:59.472986] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-05. [2025-10-02T22:01:59.544345] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-02T22:02:00.273042] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-05. [2025-10-02T22:02:00.656583] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-02T22:02:01.073031] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-08. [2025-10-02T22:02:01.295723] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-02T22:02:01.730204] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-02T22:02:01.873054] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-06. [2025-10-02T22:02:02.673000] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-10. [2025-10-02T22:02:02.914947] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-02T22:02:03.260942] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-02T22:02:03.473003] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-09. [2025-10-02T22:02:03.934001] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-02T22:02:03.936068] [INFO ] [REMOTE ] TTI: Full fetch complete (65358 records). [2025-10-02T22:02:03.936217] [DEBUG] [VALIDATOR ] TTI: Validating primary data. [2025-10-02T22:02:04.278142] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-07. [2025-10-02T22:02:04.378002] [DEBUG] [VALIDATOR ] TTI: All expected trading days are present. [2025-10-02T22:02:04.378103] [DEBUG] [VALIDATOR ] TTI: Primary data validation passed. [2025-10-02T22:02:04.379469] [INFO ] [MAIN ] TTI: Fetched primary data is valid. [2025-10-02T22:02:04.379536] [DEBUG] [LOCAL ] TTI: Saving primary data. [2025-10-02T22:02:04.381219] [DEBUG] [LOCAL ] TTI: Trimmed 65358 records to 45989 (keeping 200 days of data) [2025-10-02T22:02:04.677044] [DEBUG] [LOCAL ] TTI: Primary data saved (45989 records). [2025-10-02T22:02:04.677259] [INFO ] [MAIN ] TTI: Full history saved. [2025-10-02T22:02:04.678696] [INFO ] [MAIN ] Update Progress: 2145/2370 symbols completed. TTI took 33.2s. Estimated remaining: 31m 41s. Rate: 7.1 symbols/min [2025-10-02T22:02:04.869137] [INFO ] [MAIN ] TV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:02:04.916673] [DEBUG] [LOCAL ] TV: Loaded 42694 existing records from primary storage. [2025-10-02T22:02:04.917094] [INFO ] [MAIN ] TV: Loaded 42694 existing records. [2025-10-02T22:02:05.076078] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-06. [2025-10-02T22:02:05.129756] [WARN ] [MAIN ] TV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:02:05.130024] [INFO ] [MAIN ] TV: Wiping existing primary data before full refresh. [2025-10-02T22:02:05.130119] [INFO ] [LOCAL ] TV: Starting deletion of primary data. [2025-10-02T22:02:05.130529] [DEBUG] [LOCAL ] TV: Deleted primary data file. [2025-10-02T22:02:05.130602] [INFO ] [MAIN ] TV: Starting full primary refresh. [2025-10-02T22:02:05.555217] [INFO ] [REMOTE ] TV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:02:05.595793] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-02T22:02:05.645694] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-02T22:02:05.873000] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-08. [2025-10-02T22:02:06.673008] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-10. [2025-10-02T22:02:06.785158] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-02T22:02:07.238518] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-02T22:02:07.473001] [INFO ] [REMOTE ] TV: Fetching primary data for 2024-12. [2025-10-02T22:02:08.015504] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-02T22:02:08.017586] [INFO ] [REMOTE ] TTE: Full fetch complete (75012 records). [2025-10-02T22:02:08.018028] [DEBUG] [VALIDATOR ] TTE: Validating primary data. [2025-10-02T22:02:08.278323] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-07. [2025-10-02T22:02:08.466319] [DEBUG] [VALIDATOR ] TTE: All expected trading days are present. [2025-10-02T22:02:08.466415] [DEBUG] [VALIDATOR ] TTE: Primary data validation passed. [2025-10-02T22:02:08.467831] [INFO ] [MAIN ] TTE: Fetched primary data is valid. [2025-10-02T22:02:08.467905] [DEBUG] [LOCAL ] TTE: Saving primary data. [2025-10-02T22:02:08.470835] [DEBUG] [LOCAL ] TTE: Trimmed 75012 records to 52003 (keeping 200 days of data) [2025-10-02T22:02:08.818562] [DEBUG] [LOCAL ] TTE: Primary data saved (52003 records). [2025-10-02T22:02:08.818762] [INFO ] [MAIN ] TTE: Full history saved. [2025-10-02T22:02:08.818876] [INFO ] [MAIN ] Update Progress: 2146/2370 symbols completed. TTE took 39.9s. Estimated remaining: 31m 32s. Rate: 7.1 symbols/min [2025-10-02T22:02:09.014956] [INFO ] [MAIN ] TVC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:02:09.059321] [DEBUG] [LOCAL ] TVC: Loaded 3341 existing records from primary storage. [2025-10-02T22:02:09.061930] [INFO ] [MAIN ] TVC: Loaded 3341 existing records. [2025-10-02T22:02:09.061568] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-02T22:02:09.083694] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-09. [2025-10-02T22:02:09.286287] [WARN ] [MAIN ] TVC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:02:09.286543] [INFO ] [MAIN ] TVC: Wiping existing primary data before full refresh. [2025-10-02T22:02:09.286596] [INFO ] [LOCAL ] TVC: Starting deletion of primary data. [2025-10-02T22:02:09.286900] [DEBUG] [LOCAL ] TVC: Deleted primary data file. [2025-10-02T22:02:09.286965] [INFO ] [MAIN ] TVC: Starting full primary refresh. [2025-10-02T22:02:09.721723] [INFO ] [REMOTE ] TVC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:02:09.877622] [INFO ] [REMOTE ] TVC: Fetching primary data for 2024-12. [2025-10-02T22:02:09.909269] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-02T22:02:10.561121] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-02T22:02:10.673029] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-01. [2025-10-02T22:02:10.708581] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-02T22:02:11.473044] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-10. [2025-10-02T22:02:12.273010] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-01. [2025-10-02T22:02:12.342456] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-02T22:02:12.627308] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-02T22:02:12.782664] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-02T22:02:12.785102] [INFO ] [REMOTE ] TU: Full fetch complete (72854 records). [2025-10-02T22:02:12.785262] [DEBUG] [VALIDATOR ] TU: Validating primary data. [2025-10-02T22:02:13.078150] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-08. [2025-10-02T22:02:13.235180] [DEBUG] [VALIDATOR ] TU: All expected trading days are present. [2025-10-02T22:02:13.235273] [DEBUG] [VALIDATOR ] TU: Primary data validation passed. [2025-10-02T22:02:13.236414] [INFO ] [MAIN ] TU: Fetched primary data is valid. [2025-10-02T22:02:13.236485] [DEBUG] [LOCAL ] TU: Saving primary data. [2025-10-02T22:02:13.238080] [DEBUG] [LOCAL ] TU: Trimmed 72854 records to 50205 (keeping 200 days of data) [2025-10-02T22:02:13.579627] [DEBUG] [LOCAL ] TU: Primary data saved (50205 records). [2025-10-02T22:02:13.579799] [INFO ] [MAIN ] TU: Full history saved. [2025-10-02T22:02:13.579884] [INFO ] [MAIN ] Update Progress: 2147/2370 symbols completed. TU took 39.3s. Estimated remaining: 31m 23s. Rate: 7.1 symbols/min [2025-10-02T22:02:13.773957] [INFO ] [MAIN ] TVE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:02:13.774208] [DEBUG] [LOCAL ] TVE: No existing data file found in primary storage. [2025-10-02T22:02:13.774263] [WARN ] [MAIN ] TVE: No existing data found, performing full refresh instead. [2025-10-02T22:02:13.774389] [INFO ] [MAIN ] TVE: Wiping existing primary data before full refresh. [2025-10-02T22:02:13.774441] [INFO ] [LOCAL ] TVE: Starting deletion of primary data. [2025-10-02T22:02:13.774510] [DEBUG] [LOCAL ] TVE: No primary data file found to delete. [2025-10-02T22:02:13.774546] [INFO ] [MAIN ] TVE: Starting full primary refresh. [2025-10-02T22:02:13.880965] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-02. [2025-10-02T22:02:14.181601] [INFO ] [REMOTE ] TVE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:02:14.673009] [INFO ] [REMOTE ] TVE: Fetching primary data for 2024-12. [2025-10-02T22:02:14.757847] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-02T22:02:14.938283] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-02T22:02:15.277017] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-02T22:02:15.473048] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-02. [2025-10-02T22:02:15.810342] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-02T22:02:16.273035] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-01. [2025-10-02T22:02:16.847583] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-02T22:02:17.073025] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-02. [2025-10-02T22:02:17.673831] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-02T22:02:17.873046] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-03. [2025-10-02T22:02:18.673043] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-03. [2025-10-02T22:02:19.291415] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-02T22:02:19.473021] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-09. [2025-10-02T22:02:19.543339] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-02T22:02:20.273043] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-04. [2025-10-02T22:02:21.072976] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-04. [2025-10-02T22:02:21.169456] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-02T22:02:21.656769] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-02T22:02:21.686939] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-02T22:02:21.873010] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-03. [2025-10-02T22:02:22.271787] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-02T22:02:22.673014] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-05. [2025-10-02T22:02:23.052996] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-02T22:02:23.473005] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-04. [2025-10-02T22:02:24.056835] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-02T22:02:24.272995] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-05. [2025-10-02T22:02:24.745077] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-02T22:02:25.073007] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-06. [2025-10-02T22:02:25.481625] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-02T22:02:25.873016] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-06. [2025-10-02T22:02:26.506278] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-02T22:02:26.672993] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-07. [2025-10-02T22:02:27.071624] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-02T22:02:27.472993] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-10. [2025-10-02T22:02:28.272997] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-07. [2025-10-02T22:02:28.749216] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-02T22:02:28.755159] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-02T22:02:28.757805] [INFO ] [REMOTE ] TUYA: Full fetch complete (65833 records). [2025-10-02T22:02:28.758071] [DEBUG] [VALIDATOR ] TUYA: Validating primary data. [2025-10-02T22:02:29.078111] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-05. [2025-10-02T22:02:29.209217] [DEBUG] [VALIDATOR ] TUYA: All expected trading days are present. [2025-10-02T22:02:29.209305] [DEBUG] [VALIDATOR ] TUYA: Primary data validation passed. [2025-10-02T22:02:29.210511] [INFO ] [MAIN ] TUYA: Fetched primary data is valid. [2025-10-02T22:02:29.210580] [DEBUG] [LOCAL ] TUYA: Saving primary data. [2025-10-02T22:02:29.212045] [DEBUG] [LOCAL ] TUYA: Trimmed 65833 records to 46550 (keeping 200 days of data) [2025-10-02T22:02:29.491868] [DEBUG] [LOCAL ] TUYA: Primary data saved (46550 records). [2025-10-02T22:02:29.492011] [INFO ] [MAIN ] TUYA: Full history saved. [2025-10-02T22:02:29.492100] [INFO ] [MAIN ] Update Progress: 2148/2370 symbols completed. TUYA took 43.3s. Estimated remaining: 31m 15s. Rate: 7.1 symbols/min [2025-10-02T22:02:29.701509] [INFO ] [MAIN ] TWI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:02:29.741718] [DEBUG] [LOCAL ] TWI: Loaded 34181 existing records from primary storage. [2025-10-02T22:02:29.742252] [INFO ] [MAIN ] TWI: Loaded 34181 existing records. [2025-10-02T22:02:29.878248] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-08. [2025-10-02T22:02:29.953435] [WARN ] [MAIN ] TWI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:02:29.953853] [INFO ] [MAIN ] TWI: Wiping existing primary data before full refresh. [2025-10-02T22:02:29.953918] [INFO ] [LOCAL ] TWI: Starting deletion of primary data. [2025-10-02T22:02:29.954172] [DEBUG] [LOCAL ] TWI: Deleted primary data file. [2025-10-02T22:02:29.954247] [INFO ] [MAIN ] TWI: Starting full primary refresh. [2025-10-02T22:02:30.291587] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-02T22:02:30.385788] [INFO ] [REMOTE ] TWI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:02:30.673051] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-08. [2025-10-02T22:02:30.712380] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-02T22:02:31.226266] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-02T22:02:31.473032] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-09. [2025-10-02T22:02:32.057076] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-02T22:02:32.273003] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-10. [2025-10-02T22:02:32.599021] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-02T22:02:32.599891] [INFO ] [REMOTE ] TVC: Full fetch complete (5541 records). [2025-10-02T22:02:32.599971] [DEBUG] [VALIDATOR ] TVC: Validating primary data. [2025-10-02T22:02:33.005605] [DEBUG] [VALIDATOR ] TVC: All expected trading days are present. [2025-10-02T22:02:33.005941] [DEBUG] [VALIDATOR ] TVC: Primary data validation passed. [2025-10-02T22:02:33.006184] [INFO ] [MAIN ] TVC: Fetched primary data is valid. [2025-10-02T22:02:33.006247] [DEBUG] [LOCAL ] TVC: Saving primary data. [2025-10-02T22:02:33.006796] [DEBUG] [LOCAL ] TVC: Trimmed 5541 records to 3349 (keeping 200 days of data) [2025-10-02T22:02:33.028984] [DEBUG] [LOCAL ] TVC: Primary data saved (3349 records). [2025-10-02T22:02:33.029130] [INFO ] [MAIN ] TVC: Full history saved. [2025-10-02T22:02:33.029284] [INFO ] [MAIN ] Update Progress: 2149/2370 symbols completed. TVC took 24.2s. Estimated remaining: 31m 6s. Rate: 7.1 symbols/min [2025-10-02T22:02:33.078197] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-06. [2025-10-02T22:02:33.225692] [INFO ] [MAIN ] TWLO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:02:33.287047] [DEBUG] [LOCAL ] TWLO: Loaded 52713 existing records from primary storage. [2025-10-02T22:02:33.287408] [INFO ] [MAIN ] TWLO: Loaded 52713 existing records. [2025-10-02T22:02:33.477794] [WARN ] [MAIN ] TWLO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:02:33.478071] [INFO ] [MAIN ] TWLO: Wiping existing primary data before full refresh. [2025-10-02T22:02:33.478126] [INFO ] [LOCAL ] TWLO: Starting deletion of primary data. [2025-10-02T22:02:33.478398] [DEBUG] [LOCAL ] TWLO: Deleted primary data file. [2025-10-02T22:02:33.478459] [INFO ] [MAIN ] TWLO: Starting full primary refresh. [2025-10-02T22:02:33.857038] [INFO ] [REMOTE ] TWLO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:02:33.872979] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-09. [2025-10-02T22:02:34.414363] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-02T22:02:34.681919] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2024-12. [2025-10-02T22:02:34.685436] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-02T22:02:35.473017] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-10. [2025-10-02T22:02:35.827848] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-02T22:02:35.828631] [INFO ] [REMOTE ] TVE: Full fetch complete (4432 records). [2025-10-02T22:02:35.828730] [DEBUG] [VALIDATOR ] TVE: Validating primary data. [2025-10-02T22:02:36.219832] [DEBUG] [VALIDATOR ] TVE: All expected trading days are present. [2025-10-02T22:02:36.219924] [DEBUG] [VALIDATOR ] TVE: Primary data validation passed. [2025-10-02T22:02:36.220071] [INFO ] [MAIN ] TVE: Fetched primary data is valid. [2025-10-02T22:02:36.220113] [DEBUG] [LOCAL ] TVE: Saving primary data. [2025-10-02T22:02:36.220480] [DEBUG] [LOCAL ] TVE: Trimmed 4432 records to 2788 (keeping 200 days of data) [2025-10-02T22:02:36.238951] [DEBUG] [LOCAL ] TVE: Primary data saved (2788 records). [2025-10-02T22:02:36.239108] [INFO ] [MAIN ] TVE: Full history saved. [2025-10-02T22:02:36.239216] [INFO ] [MAIN ] Update Progress: 2150/2370 symbols completed. TVE took 22.7s. Estimated remaining: 30m 57s. Rate: 7.1 symbols/min [2025-10-02T22:02:36.278320] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-07. [2025-10-02T22:02:36.440923] [INFO ] [MAIN ] TWN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:02:36.447341] [DEBUG] [LOCAL ] TWN: Loaded 3170 existing records from primary storage. [2025-10-02T22:02:36.447746] [INFO ] [MAIN ] TWN: Loaded 3170 existing records. [2025-10-02T22:02:36.656826] [WARN ] [MAIN ] TWN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:02:36.657436] [INFO ] [MAIN ] TWN: Wiping existing primary data before full refresh. [2025-10-02T22:02:36.657499] [INFO ] [LOCAL ] TWN: Starting deletion of primary data. [2025-10-02T22:02:36.669293] [DEBUG] [LOCAL ] TWN: Deleted primary data file. [2025-10-02T22:02:36.688468] [INFO ] [MAIN ] TWN: Starting full primary refresh. [2025-10-02T22:02:36.762283] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-02T22:02:37.078998] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-01. [2025-10-02T22:02:37.107580] [INFO ] [REMOTE ] TWN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:02:37.847929] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-02T22:02:37.872960] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-08. [2025-10-02T22:02:38.673054] [INFO ] [REMOTE ] TWN: Fetching primary data for 2024-12. [2025-10-02T22:02:39.230435] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-02T22:02:39.267719] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-02T22:02:39.306921] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-02T22:02:39.473054] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-02. [2025-10-02T22:02:40.273071] [INFO ] [REMOTE ] TWI: Fetching primary data for 2024-12. [2025-10-02T22:02:41.072996] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-09. [2025-10-02T22:02:41.268206] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-02T22:02:41.873074] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-03. [2025-10-02T22:02:41.875255] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-02T22:02:42.065488] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-02T22:02:42.672999] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-01. [2025-10-02T22:02:43.473027] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-10. [2025-10-02T22:02:43.762148] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-02T22:02:44.210614] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-02T22:02:44.272996] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-02. [2025-10-02T22:02:44.660556] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-02T22:02:44.662451] [INFO ] [REMOTE ] TV: Full fetch complete (61986 records). [2025-10-02T22:02:44.662593] [DEBUG] [VALIDATOR ] TV: Validating primary data. [2025-10-02T22:02:45.087379] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-01. [2025-10-02T22:02:45.177436] [DEBUG] [VALIDATOR ] TV: All expected trading days are present. [2025-10-02T22:02:45.177571] [DEBUG] [VALIDATOR ] TV: Primary data validation passed. [2025-10-02T22:02:45.178927] [INFO ] [MAIN ] TV: Fetched primary data is valid. [2025-10-02T22:02:45.179008] [DEBUG] [LOCAL ] TV: Saving primary data. [2025-10-02T22:02:45.183703] [DEBUG] [LOCAL ] TV: Trimmed 61986 records to 42891 (keeping 200 days of data) [2025-10-02T22:02:45.465365] [DEBUG] [LOCAL ] TV: Primary data saved (42891 records). [2025-10-02T22:02:45.465508] [INFO ] [MAIN ] TV: Full history saved. [2025-10-02T22:02:45.466279] [INFO ] [MAIN ] Update Progress: 2151/2370 symbols completed. TV took 40.8s. Estimated remaining: 30m 49s. Rate: 7.1 symbols/min [2025-10-02T22:02:45.664286] [INFO ] [MAIN ] TWO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:02:45.690084] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-02T22:02:45.749024] [DEBUG] [LOCAL ] TWO: Loaded 48359 existing records from primary storage. [2025-10-02T22:02:45.749563] [INFO ] [MAIN ] TWO: Loaded 48359 existing records. [2025-10-02T22:02:45.828383] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-02T22:02:45.878054] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-04. [2025-10-02T22:02:45.974057] [WARN ] [MAIN ] TWO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:02:45.974336] [INFO ] [MAIN ] TWO: Wiping existing primary data before full refresh. [2025-10-02T22:02:45.974386] [INFO ] [LOCAL ] TWO: Starting deletion of primary data. [2025-10-02T22:02:45.974697] [DEBUG] [LOCAL ] TWO: Deleted primary data file. [2025-10-02T22:02:45.974782] [INFO ] [MAIN ] TWO: Starting full primary refresh. [2025-10-02T22:02:46.359848] [INFO ] [REMOTE ] TWO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:02:46.673047] [INFO ] [REMOTE ] TWO: Fetching primary data for 2024-12. [2025-10-02T22:02:47.472966] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-02. [2025-10-02T22:02:47.590556] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-02T22:02:48.081316] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-02T22:02:48.283588] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-05. [2025-10-02T22:02:48.290601] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-02T22:02:49.073021] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-01. [2025-10-02T22:02:49.872999] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-03. [2025-10-02T22:02:50.301419] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-02T22:02:50.299741] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-02T22:02:50.345047] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-02T22:02:50.673037] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-02. [2025-10-02T22:02:51.473040] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-06. [2025-10-02T22:02:52.273052] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-03. [2025-10-02T22:02:52.323166] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-02T22:02:53.073020] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-03. [2025-10-02T22:02:53.321975] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-02T22:02:53.458256] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-02T22:02:53.873000] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-04. [2025-10-02T22:02:54.509146] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-02T22:02:54.673048] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-04. [2025-10-02T22:02:55.281767] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-02T22:02:55.438910] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-02T22:02:55.473045] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-05. [2025-10-02T22:02:56.273011] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-04. [2025-10-02T22:02:57.039394] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-02T22:02:57.073051] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-06. [2025-10-02T22:02:57.872989] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-05. [2025-10-02T22:02:58.131095] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-02T22:02:58.201012] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-02T22:02:58.472105] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-02T22:02:58.673025] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-07. [2025-10-02T22:02:59.473051] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-06. [2025-10-02T22:02:59.943558] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-02T22:03:00.273053] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-05. [2025-10-02T22:03:00.480723] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-02T22:03:01.072982] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-07. [2025-10-02T22:03:01.577348] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-02T22:03:01.873054] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-07. [2025-10-02T22:03:02.040207] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-02T22:03:02.673058] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-08. [2025-10-02T22:03:03.413952] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-02T22:03:03.473019] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-08. [2025-10-02T22:03:03.943478] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-02T22:03:04.273007] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-09. [2025-10-02T22:03:04.803448] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-02T22:03:04.930984] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-02T22:03:05.073077] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-10. [2025-10-02T22:03:05.560881] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-02T22:03:05.561761] [INFO ] [REMOTE ] TWN: Full fetch complete (5450 records). [2025-10-02T22:03:05.561835] [DEBUG] [VALIDATOR ] TWN: Validating primary data. [2025-10-02T22:03:05.878247] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-08. [2025-10-02T22:03:06.000562] [DEBUG] [VALIDATOR ] TWN: All expected trading days are present. [2025-10-02T22:03:06.000688] [DEBUG] [VALIDATOR ] TWN: Primary data validation passed. [2025-10-02T22:03:06.000882] [INFO ] [MAIN ] TWN: Fetched primary data is valid. [2025-10-02T22:03:06.000929] [DEBUG] [LOCAL ] TWN: Saving primary data. [2025-10-02T22:03:06.001468] [DEBUG] [LOCAL ] TWN: Trimmed 5450 records to 3245 (keeping 200 days of data) [2025-10-02T22:03:06.025131] [DEBUG] [LOCAL ] TWN: Primary data saved (3245 records). [2025-10-02T22:03:06.025284] [INFO ] [MAIN ] TWN: Full history saved. [2025-10-02T22:03:06.025424] [INFO ] [MAIN ] Update Progress: 2152/2370 symbols completed. TWN took 29.8s. Estimated remaining: 30m 42s. Rate: 7.1 symbols/min [2025-10-02T22:03:06.224084] [INFO ] [MAIN ] TWOD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:03:06.224261] [DEBUG] [LOCAL ] TWOD: No existing data file found in primary storage. [2025-10-02T22:03:06.224342] [WARN ] [MAIN ] TWOD: No existing data found, performing full refresh instead. [2025-10-02T22:03:06.224469] [INFO ] [MAIN ] TWOD: Wiping existing primary data before full refresh. [2025-10-02T22:03:06.224514] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-10-02T22:03:06.224558] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-10-02T22:03:06.224810] [INFO ] [MAIN ] TWOD: Starting full primary refresh. [2025-10-02T22:03:06.625088] [INFO ] [REMOTE ] TWOD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:03:06.672980] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2024-12. [2025-10-02T22:03:06.875813] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T22:03:06.876147] [WARN ] [REMOTE ] TWOD: No data returned for month 2024-12 [2025-10-02T22:03:06.876241] [FATAL] [REMOTE ] TWOD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T22:03:06.876315] [FATAL] [MAIN ] TWOD: Failed to fetch primary data. [2025-10-02T22:03:06.876382] [WARN ] [MAIN ] TWOD: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T22:03:06.876456] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-10-02T22:03:06.876523] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-10-02T22:03:06.876560] [INFO ] [LOCAL ] TWOD: Starting deletion of derivative data. [2025-10-02T22:03:06.876629] [DEBUG] [LOCAL ] TWOD: No derivative data file found to delete. [2025-10-02T22:03:06.876737] [INFO ] [MAIN ] Update Progress: 2153/2370 symbols completed. TWOD took 0.9s. Estimated remaining: 30m 33s. Rate: 7.1 symbols/min [2025-10-02T22:03:07.077147] [INFO ] [MAIN ] TX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:03:07.105218] [DEBUG] [LOCAL ] TX: Loaded 23378 existing records from primary storage. [2025-10-02T22:03:07.105451] [INFO ] [MAIN ] TX: Loaded 23378 existing records. [2025-10-02T22:03:07.306380] [WARN ] [MAIN ] TX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:03:07.306833] [INFO ] [MAIN ] TX: Wiping existing primary data before full refresh. [2025-10-02T22:03:07.306971] [INFO ] [LOCAL ] TX: Starting deletion of primary data. [2025-10-02T22:03:07.314256] [DEBUG] [LOCAL ] TX: Deleted primary data file. [2025-10-02T22:03:07.326980] [INFO ] [MAIN ] TX: Starting full primary refresh. [2025-10-02T22:03:07.334210] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-02T22:03:07.478186] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-06. [2025-10-02T22:03:07.755009] [INFO ] [REMOTE ] TX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:03:08.273027] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-09. [2025-10-02T22:03:09.072984] [INFO ] [REMOTE ] TX: Fetching primary data for 2024-12. [2025-10-02T22:03:09.145418] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-02T22:03:09.551474] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-02T22:03:09.873016] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-07. [2025-10-02T22:03:10.210549] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-02T22:03:10.673048] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-09. [2025-10-02T22:03:11.406795] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-02T22:03:11.473035] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-01. [2025-10-02T22:03:12.272976] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-08. [2025-10-02T22:03:12.745150] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-02T22:03:12.783425] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-02T22:03:13.073036] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-10. [2025-10-02T22:03:13.729307] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-02T22:03:13.873013] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-10. [2025-10-02T22:03:13.984426] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-02T22:03:13.986250] [INFO ] [REMOTE ] TWI: Full fetch complete (52768 records). [2025-10-02T22:03:13.986479] [DEBUG] [VALIDATOR ] TWI: Validating primary data. [2025-10-02T22:03:14.424883] [DEBUG] [VALIDATOR ] TWI: All expected trading days are present. [2025-10-02T22:03:14.424965] [DEBUG] [VALIDATOR ] TWI: Primary data validation passed. [2025-10-02T22:03:14.425939] [INFO ] [MAIN ] TWI: Fetched primary data is valid. [2025-10-02T22:03:14.426004] [DEBUG] [LOCAL ] TWI: Saving primary data. [2025-10-02T22:03:14.427247] [DEBUG] [LOCAL ] TWI: Trimmed 52768 records to 34440 (keeping 200 days of data) [2025-10-02T22:03:14.641099] [DEBUG] [LOCAL ] TWI: Primary data saved (34440 records). [2025-10-02T22:03:14.641344] [INFO ] [MAIN ] TWI: Full history saved. [2025-10-02T22:03:14.641467] [INFO ] [MAIN ] Update Progress: 2154/2370 symbols completed. TWI took 45.1s. Estimated remaining: 30m 24s. Rate: 7.1 symbols/min [2025-10-02T22:03:14.681077] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-02. [2025-10-02T22:03:14.852401] [INFO ] [MAIN ] TXNM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:03:14.897851] [DEBUG] [LOCAL ] TXNM: Loaded 43433 existing records from primary storage. [2025-10-02T22:03:14.898206] [INFO ] [MAIN ] TXNM: Loaded 43433 existing records. [2025-10-02T22:03:15.091568] [WARN ] [MAIN ] TXNM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:03:15.091883] [INFO ] [MAIN ] TXNM: Wiping existing primary data before full refresh. [2025-10-02T22:03:15.091935] [INFO ] [LOCAL ] TXNM: Starting deletion of primary data. [2025-10-02T22:03:15.092229] [DEBUG] [LOCAL ] TXNM: Deleted primary data file. [2025-10-02T22:03:15.092290] [INFO ] [MAIN ] TXNM: Starting full primary refresh. [2025-10-02T22:03:15.436835] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-02T22:03:15.457228] [INFO ] [REMOTE ] TWLO: Full fetch complete (76447 records). [2025-10-02T22:03:15.467726] [DEBUG] [VALIDATOR ] TWLO: Validating primary data. [2025-10-02T22:03:15.485391] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-09. [2025-10-02T22:03:15.538881] [INFO ] [REMOTE ] TXNM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:03:15.995101] [DEBUG] [VALIDATOR ] TWLO: All expected trading days are present. [2025-10-02T22:03:15.995313] [DEBUG] [VALIDATOR ] TWLO: Primary data validation passed. [2025-10-02T22:03:15.996755] [INFO ] [MAIN ] TWLO: Fetched primary data is valid. [2025-10-02T22:03:15.996835] [DEBUG] [LOCAL ] TWLO: Saving primary data. [2025-10-02T22:03:15.998741] [DEBUG] [LOCAL ] TWLO: Trimmed 76447 records to 53100 (keeping 200 days of data) [2025-10-02T22:03:16.116726] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-02T22:03:16.273089] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-03. [2025-10-02T22:03:16.374756] [DEBUG] [LOCAL ] TWLO: Primary data saved (53100 records). [2025-10-02T22:03:16.374895] [INFO ] [MAIN ] TWLO: Full history saved. [2025-10-02T22:03:16.374979] [INFO ] [MAIN ] Update Progress: 2155/2370 symbols completed. TWLO took 43.3s. Estimated remaining: 30m 15s. Rate: 7.1 symbols/min [2025-10-02T22:03:16.562481] [INFO ] [MAIN ] TXO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:03:16.583279] [DEBUG] [LOCAL ] TXO: Loaded 18939 existing records from primary storage. [2025-10-02T22:03:16.583527] [INFO ] [MAIN ] TXO: Loaded 18939 existing records. [2025-10-02T22:03:16.791187] [WARN ] [MAIN ] TXO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:03:16.791486] [INFO ] [MAIN ] TXO: Wiping existing primary data before full refresh. [2025-10-02T22:03:16.791564] [INFO ] [LOCAL ] TXO: Starting deletion of primary data. [2025-10-02T22:03:16.791853] [DEBUG] [LOCAL ] TXO: Deleted primary data file. [2025-10-02T22:03:16.791928] [INFO ] [MAIN ] TXO: Starting full primary refresh. [2025-10-02T22:03:17.078170] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2024-12. [2025-10-02T22:03:17.240541] [INFO ] [REMOTE ] TXO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:03:17.271167] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-02T22:03:17.318314] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-02T22:03:17.872997] [INFO ] [REMOTE ] TXO: Fetching primary data for 2024-12. [2025-10-02T22:03:18.653023] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-02T22:03:18.672338] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-02T22:03:18.673587] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-10. [2025-10-02T22:03:19.473201] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-01. [2025-10-02T22:03:20.043610] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-02T22:03:20.045755] [INFO ] [REMOTE ] TWO: Full fetch complete (69074 records). [2025-10-02T22:03:20.045890] [DEBUG] [VALIDATOR ] TWO: Validating primary data. [2025-10-02T22:03:20.279746] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-01. [2025-10-02T22:03:20.484540] [DEBUG] [VALIDATOR ] TWO: All expected trading days are present. [2025-10-02T22:03:20.484670] [DEBUG] [VALIDATOR ] TWO: Primary data validation passed. [2025-10-02T22:03:20.485982] [INFO ] [MAIN ] TWO: Fetched primary data is valid. [2025-10-02T22:03:20.486050] [DEBUG] [LOCAL ] TWO: Saving primary data. [2025-10-02T22:03:20.487758] [DEBUG] [LOCAL ] TWO: Trimmed 69074 records to 48729 (keeping 200 days of data) [2025-10-02T22:03:20.830798] [DEBUG] [LOCAL ] TWO: Primary data saved (48729 records). [2025-10-02T22:03:20.830949] [INFO ] [MAIN ] TWO: Full history saved. [2025-10-02T22:03:20.831814] [INFO ] [MAIN ] Update Progress: 2156/2370 symbols completed. TWO took 35.4s. Estimated remaining: 30m 6s. Rate: 7.1 symbols/min [2025-10-02T22:03:21.026764] [INFO ] [MAIN ] TXT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:03:21.078631] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-04. [2025-10-02T22:03:21.081793] [DEBUG] [LOCAL ] TXT: Loaded 49738 existing records from primary storage. [2025-10-02T22:03:21.082786] [INFO ] [MAIN ] TXT: Loaded 49738 existing records. [2025-10-02T22:03:21.365108] [WARN ] [MAIN ] TXT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:03:21.375523] [INFO ] [MAIN ] TXT: Wiping existing primary data before full refresh. [2025-10-02T22:03:21.375737] [INFO ] [LOCAL ] TXT: Starting deletion of primary data. [2025-10-02T22:03:21.377082] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-02T22:03:21.381307] [DEBUG] [LOCAL ] TXT: Deleted primary data file. [2025-10-02T22:03:21.408260] [INFO ] [MAIN ] TXT: Starting full primary refresh. [2025-10-02T22:03:21.429553] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-02T22:03:21.877707] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-02. [2025-10-02T22:03:21.882335] [INFO ] [REMOTE ] TXT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:03:21.992309] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-02T22:03:22.673013] [INFO ] [REMOTE ] TXT: Fetching primary data for 2024-12. [2025-10-02T22:03:22.900715] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-02T22:03:23.472999] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-03. [2025-10-02T22:03:24.181954] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-02T22:03:24.273207] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-04. [2025-10-02T22:03:24.337915] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-02T22:03:24.844904] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-02T22:03:25.073000] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-01. [2025-10-02T22:03:25.873002] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-05. [2025-10-02T22:03:26.673037] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-05. [2025-10-02T22:03:26.809815] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-02T22:03:26.954679] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-02T22:03:27.473040] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-06. [2025-10-02T22:03:27.597606] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-02T22:03:28.273007] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-02. [2025-10-02T22:03:28.675120] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-02T22:03:29.073008] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-02. [2025-10-02T22:03:29.833150] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-02T22:03:29.872968] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-03. [2025-10-02T22:03:30.672979] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-07. [2025-10-02T22:03:30.799879] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-02T22:03:31.243211] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-02T22:03:31.473048] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-06. [2025-10-02T22:03:31.560481] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-02T22:03:32.273049] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-08. [2025-10-02T22:03:32.636414] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-02T22:03:33.072981] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-07. [2025-10-02T22:03:33.473751] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-02T22:03:33.808952] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-02T22:03:33.872986] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-08. [2025-10-02T22:03:34.672975] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-03. [2025-10-02T22:03:34.933713] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-02T22:03:35.473006] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-09. [2025-10-02T22:03:36.273021] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-04. [2025-10-02T22:03:36.459474] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-02T22:03:36.486107] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-02T22:03:37.073053] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-10. [2025-10-02T22:03:37.737208] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-02T22:03:37.809147] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-02T22:03:37.810367] [INFO ] [REMOTE ] TXO: Full fetch complete (26328 records). [2025-10-02T22:03:37.810522] [DEBUG] [VALIDATOR ] TXO: Validating primary data. [2025-10-02T22:03:37.878139] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-04. [2025-10-02T22:03:38.240013] [DEBUG] [VALIDATOR ] TXO: All expected trading days are present. [2025-10-02T22:03:38.240132] [DEBUG] [VALIDATOR ] TXO: Primary data validation passed. [2025-10-02T22:03:38.240835] [INFO ] [MAIN ] TXO: Fetched primary data is valid. [2025-10-02T22:03:38.240902] [DEBUG] [LOCAL ] TXO: Saving primary data. [2025-10-02T22:03:38.241833] [DEBUG] [LOCAL ] TXO: Trimmed 26328 records to 19055 (keeping 200 days of data) [2025-10-02T22:03:38.374594] [DEBUG] [LOCAL ] TXO: Primary data saved (19055 records). [2025-10-02T22:03:38.374805] [INFO ] [MAIN ] TXO: Full history saved. [2025-10-02T22:03:38.374920] [INFO ] [MAIN ] Update Progress: 2157/2370 symbols completed. TXO took 22.0s. Estimated remaining: 29m 59s. Rate: 7.1 symbols/min [2025-10-02T22:03:38.673018] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-09. [2025-10-02T22:03:39.472975] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-05. [2025-10-02T22:03:39.748900] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-02T22:03:39.887229] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-02T22:03:40.273005] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-10. [2025-10-02T22:03:40.797331] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-02T22:03:41.041784] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-02T22:03:41.043476] [INFO ] [REMOTE ] TX: Full fetch complete (35929 records). [2025-10-02T22:03:41.043593] [DEBUG] [VALIDATOR ] TX: Validating primary data. [2025-10-02T22:03:41.079559] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-06. [2025-10-02T22:03:41.483384] [DEBUG] [VALIDATOR ] TX: All expected trading days are present. [2025-10-02T22:03:41.483474] [DEBUG] [VALIDATOR ] TX: Primary data validation passed. [2025-10-02T22:03:41.484273] [INFO ] [MAIN ] TX: Fetched primary data is valid. [2025-10-02T22:03:41.484341] [DEBUG] [LOCAL ] TX: Saving primary data. [2025-10-02T22:03:41.485403] [DEBUG] [LOCAL ] TX: Trimmed 35929 records to 23557 (keeping 200 days of data) [2025-10-02T22:03:41.648195] [DEBUG] [LOCAL ] TX: Primary data saved (23557 records). [2025-10-02T22:03:41.648341] [INFO ] [MAIN ] TX: Full history saved. [2025-10-02T22:03:41.648433] [INFO ] [MAIN ] Update Progress: 2158/2370 symbols completed. TX took 34.8s. Estimated remaining: 29m 50s. Rate: 7.1 symbols/min [2025-10-02T22:03:41.873078] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-05. [2025-10-02T22:03:42.951453] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-02T22:03:42.962392] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-07. [2025-10-02T22:03:43.396910] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-02T22:03:43.473060] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-06. [2025-10-02T22:03:44.636922] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-02T22:03:44.647625] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-08. [2025-10-02T22:03:45.132057] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-02T22:03:45.144004] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-07. [2025-10-02T22:03:46.253572] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-02T22:03:46.268383] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-09. [2025-10-02T22:03:46.641050] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-02T22:03:46.673052] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-08. [2025-10-02T22:03:47.735529] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-02T22:03:47.745172] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-10. [2025-10-02T22:03:48.464395] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-02T22:03:48.479159] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-09. [2025-10-02T22:03:48.810800] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-02T22:03:48.812677] [INFO ] [REMOTE ] TXNM: Full fetch complete (62708 records). [2025-10-02T22:03:48.812772] [DEBUG] [VALIDATOR ] TXNM: Validating primary data. [2025-10-02T22:03:49.281831] [DEBUG] [VALIDATOR ] TXNM: All expected trading days are present. [2025-10-02T22:03:49.281950] [DEBUG] [VALIDATOR ] TXNM: Primary data validation passed. [2025-10-02T22:03:49.283513] [INFO ] [MAIN ] TXNM: Fetched primary data is valid. [2025-10-02T22:03:49.283583] [DEBUG] [LOCAL ] TXNM: Saving primary data. [2025-10-02T22:03:49.285427] [DEBUG] [LOCAL ] TXNM: Trimmed 62708 records to 43718 (keeping 200 days of data) [2025-10-02T22:03:49.583056] [DEBUG] [LOCAL ] TXNM: Primary data saved (43718 records). [2025-10-02T22:03:49.583364] [INFO ] [MAIN ] TXNM: Full history saved. [2025-10-02T22:03:49.583503] [INFO ] [MAIN ] Update Progress: 2159/2370 symbols completed. TXNM took 34.9s. Estimated remaining: 29m 41s. Rate: 7.1 symbols/min [2025-10-02T22:03:50.226466] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-02T22:03:50.237829] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-10. [2025-10-02T22:03:51.559030] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-02T22:03:51.561159] [INFO ] [REMOTE ] TXT: Full fetch complete (72264 records). [2025-10-02T22:03:51.561282] [DEBUG] [VALIDATOR ] TXT: Validating primary data. [2025-10-02T22:03:51.984846] [DEBUG] [VALIDATOR ] TXT: All expected trading days are present. [2025-10-02T22:03:51.984936] [DEBUG] [VALIDATOR ] TXT: Primary data validation passed. [2025-10-02T22:03:51.986279] [INFO ] [MAIN ] TXT: Fetched primary data is valid. [2025-10-02T22:03:51.986375] [DEBUG] [LOCAL ] TXT: Saving primary data. [2025-10-02T22:03:51.988076] [DEBUG] [LOCAL ] TXT: Trimmed 72264 records to 50073 (keeping 200 days of data) [2025-10-02T22:03:52.322285] [DEBUG] [LOCAL ] TXT: Primary data saved (50073 records). [2025-10-02T22:03:52.322432] [INFO ] [MAIN ] TXT: Full history saved. [2025-10-02T22:03:52.323011] [INFO ] [MAIN ] Update Progress: 2160/2370 symbols completed. TXT took 31.5s. Estimated remaining: 29m 32s. Rate: 7.1 symbols/min [2025-10-02T22:03:53.094417] [INFO ] [MAIN ] TYG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:03:53.084793] [INFO ] [MAIN ] TYL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:03:53.120778] [INFO ] [MAIN ] TY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:03:53.100822] [INFO ] [MAIN ] U: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:03:53.155736] [DEBUG] [LOCAL ] TYG: Loaded 14151 existing records from primary storage. [2025-10-02T22:03:53.156711] [INFO ] [MAIN ] TYG: Loaded 14151 existing records. [2025-10-02T22:03:53.213516] [DEBUG] [LOCAL ] TYL: Loaded 22149 existing records from primary storage. [2025-10-02T22:03:53.212603] [DEBUG] [LOCAL ] TY: Loaded 7549 existing records from primary storage. [2025-10-02T22:03:53.230247] [INFO ] [MAIN ] TY: Loaded 7549 existing records. [2025-10-02T22:03:53.250972] [INFO ] [MAIN ] TYL: Loaded 22149 existing records. [2025-10-02T22:03:53.787215] [DEBUG] [LOCAL ] U: Loaded 53799 existing records from primary storage. [2025-10-02T22:03:53.841231] [WARN ] [MAIN ] TY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:03:53.870598] [INFO ] [MAIN ] TY: Wiping existing primary data before full refresh. [2025-10-02T22:03:53.860713] [INFO ] [MAIN ] U: Loaded 53799 existing records. [2025-10-02T22:03:53.864100] [WARN ] [MAIN ] TYG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:03:53.870840] [INFO ] [LOCAL ] TY: Starting deletion of primary data. [2025-10-02T22:03:53.876285] [INFO ] [MAIN ] TYG: Wiping existing primary data before full refresh. [2025-10-02T22:03:53.870363] [WARN ] [MAIN ] TYL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:03:53.898867] [INFO ] [MAIN ] TYL: Wiping existing primary data before full refresh. [2025-10-02T22:03:53.893494] [INFO ] [LOCAL ] TYG: Starting deletion of primary data. [2025-10-02T22:03:53.914899] [INFO ] [LOCAL ] TYL: Starting deletion of primary data. [2025-10-02T22:03:53.947013] [DEBUG] [LOCAL ] TYL: Deleted primary data file. [2025-10-02T22:03:53.946944] [DEBUG] [LOCAL ] TY: Deleted primary data file. [2025-10-02T22:03:53.947192] [INFO ] [MAIN ] TYL: Starting full primary refresh. [2025-10-02T22:03:53.952627] [DEBUG] [LOCAL ] TYG: Deleted primary data file. [2025-10-02T22:03:53.963168] [INFO ] [MAIN ] TY: Starting full primary refresh. [2025-10-02T22:03:53.957915] [INFO ] [MAIN ] TYG: Starting full primary refresh. [2025-10-02T22:03:54.480175] [WARN ] [MAIN ] U: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:03:54.588778] [INFO ] [MAIN ] U: Wiping existing primary data before full refresh. [2025-10-02T22:03:54.747815] [INFO ] [LOCAL ] U: Starting deletion of primary data. [2025-10-02T22:03:54.981833] [DEBUG] [LOCAL ] U: Deleted primary data file. [2025-10-02T22:03:55.048235] [INFO ] [MAIN ] U: Starting full primary refresh. [2025-10-02T22:03:55.596887] [INFO ] [REMOTE ] TY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:03:55.672128] [INFO ] [REMOTE ] TY: Fetching primary data for 2024-12. [2025-10-02T22:03:55.758786] [INFO ] [REMOTE ] TYL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:03:55.797272] [INFO ] [REMOTE ] TYG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:03:55.802002] [INFO ] [REMOTE ] TYL: Fetching primary data for 2024-12. [2025-10-02T22:03:55.801727] [INFO ] [REMOTE ] TYG: Fetching primary data for 2024-12. [2025-10-02T22:03:56.128088] [INFO ] [REMOTE ] U: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:03:56.128792] [INFO ] [REMOTE ] U: Fetching primary data for 2024-12. [2025-10-02T22:03:56.594100] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-02T22:03:56.597282] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-01. [2025-10-02T22:03:56.677510] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-02T22:03:56.681161] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-01. [2025-10-02T22:03:56.766602] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-02T22:03:56.771790] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-01. [2025-10-02T22:03:57.076023] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-02T22:03:57.079334] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-02. [2025-10-02T22:03:57.452034] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-02T22:03:57.458125] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-02. [2025-10-02T22:03:57.835068] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-02T22:03:57.840468] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-02. [2025-10-02T22:03:57.904288] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-02T22:03:57.907305] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-03. [2025-10-02T22:03:58.235024] [INFO ] [REMOTE ] U: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-02T22:03:58.429436] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-02T22:03:58.439293] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-02T22:03:58.673035] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-03. [2025-10-02T22:03:59.473025] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-04. [2025-10-02T22:03:59.584595] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-02T22:04:00.262413] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-02 (2.42 seconds). [2025-10-02T22:04:00.272963] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-04. [2025-10-02T22:04:00.308927] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-02T22:04:01.073216] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-05. [2025-10-02T22:04:01.320462] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-02T22:04:01.836987] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-02T22:04:01.873039] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-06. [2025-10-02T22:04:02.663467] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-02T22:04:02.672957] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-07. [2025-10-02T22:04:03.404423] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-02T22:04:03.473044] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-05. [2025-10-02T22:04:04.111979] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-02T22:04:04.273040] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-08. [2025-10-02T22:04:05.055306] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-02T22:04:05.073004] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-09. [2025-10-02T22:04:05.802582] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-02T22:04:05.873047] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-10. [2025-10-02T22:04:06.279579] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-02T22:04:06.280680] [INFO ] [REMOTE ] TY: Full fetch complete (11609 records). [2025-10-02T22:04:06.280792] [DEBUG] [VALIDATOR ] TY: Validating primary data. [2025-10-02T22:04:06.678256] [INFO ] [REMOTE ] U: Fetching primary data for 2025-01. [2025-10-02T22:04:06.749299] [DEBUG] [VALIDATOR ] TY: All expected trading days are present. [2025-10-02T22:04:06.749427] [DEBUG] [VALIDATOR ] TY: Primary data validation passed. [2025-10-02T22:04:06.749820] [INFO ] [MAIN ] TY: Fetched primary data is valid. [2025-10-02T22:04:06.749902] [DEBUG] [LOCAL ] TY: Saving primary data. [2025-10-02T22:04:06.750717] [DEBUG] [LOCAL ] TY: Trimmed 11609 records to 7578 (keeping 200 days of data) [2025-10-02T22:04:06.821735] [DEBUG] [LOCAL ] TY: Primary data saved (7578 records). [2025-10-02T22:04:06.821887] [INFO ] [MAIN ] TY: Full history saved. [2025-10-02T22:04:06.821989] [INFO ] [MAIN ] Update Progress: 2161/2370 symbols completed. TY took 14.5s. Estimated remaining: 29m 24s. Rate: 7.1 symbols/min [2025-10-02T22:04:07.031324] [INFO ] [MAIN ] UA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:04:07.085603] [DEBUG] [LOCAL ] UA: Loaded 50468 existing records from primary storage. [2025-10-02T22:04:07.085985] [INFO ] [MAIN ] UA: Loaded 50468 existing records. [2025-10-02T22:04:07.295354] [WARN ] [MAIN ] UA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:04:07.295627] [INFO ] [MAIN ] UA: Wiping existing primary data before full refresh. [2025-10-02T22:04:07.295718] [INFO ] [LOCAL ] UA: Starting deletion of primary data. [2025-10-02T22:04:07.296191] [DEBUG] [LOCAL ] UA: Deleted primary data file. [2025-10-02T22:04:07.296249] [INFO ] [MAIN ] UA: Starting full primary refresh. [2025-10-02T22:04:07.478220] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-03. [2025-10-02T22:04:07.720907] [INFO ] [REMOTE ] UA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:04:08.273040] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-06. [2025-10-02T22:04:08.888939] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-02T22:04:08.888586] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-02T22:04:08.970874] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-10-02T22:04:09.073006] [INFO ] [REMOTE ] U: Fetching primary data for 2025-02. [2025-10-02T22:04:09.873012] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-07. [2025-10-02T22:04:10.673001] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-04. [2025-10-02T22:04:10.959833] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-02T22:04:11.406246] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-10-02T22:04:11.473012] [INFO ] [REMOTE ] U: Fetching primary data for 2025-03. [2025-10-02T22:04:11.753506] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-02T22:04:12.273008] [INFO ] [REMOTE ] UA: Fetching primary data for 2024-12. [2025-10-02T22:04:13.073002] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-05. [2025-10-02T22:04:13.873009] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-08. [2025-10-02T22:04:14.005047] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-03 (2.53 seconds). [2025-10-02T22:04:14.221079] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-02T22:04:14.456835] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-10-02T22:04:14.672986] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-01. [2025-10-02T22:04:14.759007] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-02T22:04:15.473003] [INFO ] [REMOTE ] U: Fetching primary data for 2025-04. [2025-10-02T22:04:16.273013] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-06. [2025-10-02T22:04:16.361886] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-02T22:04:17.073022] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-02. [2025-10-02T22:04:17.349741] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-02T22:04:17.851923] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-10-02T22:04:17.872967] [INFO ] [REMOTE ] U: Fetching primary data for 2025-05. [2025-10-02T22:04:18.672991] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-07. [2025-10-02T22:04:18.765286] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-02T22:04:19.472963] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-09. [2025-10-02T22:04:19.573516] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-02T22:04:19.724288] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-02T22:04:20.272969] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-08. [2025-10-02T22:04:20.344789] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-02T22:04:21.072985] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-10. [2025-10-02T22:04:21.419367] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-02T22:04:21.615212] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-02T22:04:21.616202] [INFO ] [REMOTE ] TYG: Full fetch complete (22529 records). [2025-10-02T22:04:21.616276] [DEBUG] [VALIDATOR ] TYG: Validating primary data. [2025-10-02T22:04:21.878102] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-03. [2025-10-02T22:04:22.010384] [DEBUG] [VALIDATOR ] TYG: All expected trading days are present. [2025-10-02T22:04:22.010466] [DEBUG] [VALIDATOR ] TYG: Primary data validation passed. [2025-10-02T22:04:22.010965] [INFO ] [MAIN ] TYG: Fetched primary data is valid. [2025-10-02T22:04:22.011028] [DEBUG] [LOCAL ] TYG: Saving primary data. [2025-10-02T22:04:22.011758] [DEBUG] [LOCAL ] TYG: Trimmed 22529 records to 14224 (keeping 200 days of data) [2025-10-02T22:04:22.109029] [DEBUG] [LOCAL ] TYG: Primary data saved (14224 records). [2025-10-02T22:04:22.109188] [INFO ] [MAIN ] TYG: Full history saved. [2025-10-02T22:04:22.109282] [INFO ] [MAIN ] Update Progress: 2162/2370 symbols completed. TYG took 29.8s. Estimated remaining: 29m 17s. Rate: 7.1 symbols/min [2025-10-02T22:04:22.319524] [INFO ] [MAIN ] UAA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:04:22.376763] [DEBUG] [LOCAL ] UAA: Loaded 53507 existing records from primary storage. [2025-10-02T22:04:22.377194] [INFO ] [MAIN ] UAA: Loaded 53507 existing records. [2025-10-02T22:04:22.589700] [WARN ] [MAIN ] UAA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:04:22.589993] [INFO ] [MAIN ] UAA: Wiping existing primary data before full refresh. [2025-10-02T22:04:22.590081] [INFO ] [LOCAL ] UAA: Starting deletion of primary data. [2025-10-02T22:04:22.590372] [DEBUG] [LOCAL ] UAA: Deleted primary data file. [2025-10-02T22:04:22.590451] [INFO ] [MAIN ] UAA: Starting full primary refresh. [2025-10-02T22:04:22.682032] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-09. [2025-10-02T22:04:22.999456] [INFO ] [REMOTE ] UAA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:04:23.473020] [INFO ] [REMOTE ] UAA: Fetching primary data for 2024-12. [2025-10-02T22:04:23.713930] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-02T22:04:23.761984] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-02T22:04:24.273000] [INFO ] [REMOTE ] U: Fetching primary data for 2025-06. [2025-10-02T22:04:25.073008] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-04. [2025-10-02T22:04:25.591938] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-02T22:04:25.873056] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-01. [2025-10-02T22:04:26.558824] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-10-02T22:04:26.667823] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-02T22:04:26.674100] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-10. [2025-10-02T22:04:27.473058] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-05. [2025-10-02T22:04:27.534669] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-02T22:04:27.536739] [INFO ] [REMOTE ] TYL: Full fetch complete (31363 records). [2025-10-02T22:04:27.537031] [DEBUG] [VALIDATOR ] TYL: Validating primary data. [2025-10-02T22:04:28.056954] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-02T22:04:28.093475] [DEBUG] [VALIDATOR ] TYL: All expected trading days are present. [2025-10-02T22:04:28.093570] [DEBUG] [VALIDATOR ] TYL: Primary data validation passed. [2025-10-02T22:04:28.094706] [INFO ] [MAIN ] TYL: Fetched primary data is valid. [2025-10-02T22:04:28.094785] [DEBUG] [LOCAL ] TYL: Saving primary data. [2025-10-02T22:04:28.096504] [DEBUG] [LOCAL ] TYL: Trimmed 31363 records to 22325 (keeping 200 days of data) [2025-10-02T22:04:28.254625] [DEBUG] [LOCAL ] TYL: Primary data saved (22325 records). [2025-10-02T22:04:28.254782] [INFO ] [MAIN ] TYL: Full history saved. [2025-10-02T22:04:28.254881] [INFO ] [MAIN ] Update Progress: 2163/2370 symbols completed. TYL took 35.9s. Estimated remaining: 29m 8s. Rate: 7.1 symbols/min [2025-10-02T22:04:28.278167] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-02. [2025-10-02T22:04:28.439747] [INFO ] [MAIN ] UAN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:04:28.448115] [DEBUG] [LOCAL ] UAN: Loaded 5392 existing records from primary storage. [2025-10-02T22:04:28.448351] [INFO ] [MAIN ] UAN: Loaded 5392 existing records. [2025-10-02T22:04:28.663324] [WARN ] [MAIN ] UAN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:04:28.663632] [INFO ] [MAIN ] UAN: Wiping existing primary data before full refresh. [2025-10-02T22:04:28.663742] [INFO ] [LOCAL ] UAN: Starting deletion of primary data. [2025-10-02T22:04:28.664236] [DEBUG] [LOCAL ] UAN: Deleted primary data file. [2025-10-02T22:04:28.664313] [INFO ] [MAIN ] UAN: Starting full primary refresh. [2025-10-02T22:04:29.042357] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-02T22:04:29.074343] [INFO ] [REMOTE ] U: Fetching primary data for 2025-07. [2025-10-02T22:04:29.150493] [INFO ] [REMOTE ] UAN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:04:29.873004] [INFO ] [REMOTE ] UAN: Fetching primary data for 2024-12. [2025-10-02T22:04:30.095665] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-02T22:04:30.532613] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-02T22:04:30.673002] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-03. [2025-10-02T22:04:31.028148] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-02T22:04:31.473102] [INFO ] [REMOTE ] U: Fetching primary data for 2025-08. [2025-10-02T22:04:32.273026] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-01. [2025-10-02T22:04:32.637504] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-02T22:04:32.977525] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-02T22:04:33.073050] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-04. [2025-10-02T22:04:33.873035] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-06. [2025-10-02T22:04:34.018721] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-08 (2.55 seconds). [2025-10-02T22:04:34.673017] [INFO ] [REMOTE ] U: Fetching primary data for 2025-09. [2025-10-02T22:04:35.010249] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-02T22:04:35.473024] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-05. [2025-10-02T22:04:35.687361] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-02T22:04:36.273062] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-02. [2025-10-02T22:04:36.864930] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-02T22:04:37.073017] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-07. [2025-10-02T22:04:37.112362] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-09 (2.44 seconds). [2025-10-02T22:04:37.186133] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-02T22:04:37.873006] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-06. [2025-10-02T22:04:38.579593] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-02T22:04:38.673052] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-03. [2025-10-02T22:04:39.198719] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-02T22:04:39.472958] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-08. [2025-10-02T22:04:39.601077] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-02T22:04:40.273017] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-07. [2025-10-02T22:04:40.986663] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-02T22:04:41.073037] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-09. [2025-10-02T22:04:41.873036] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-04. [2025-10-02T22:04:42.256450] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-02T22:04:42.633618] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-02T22:04:42.673002] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-05. [2025-10-02T22:04:42.842079] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-02T22:04:43.173816] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-02T22:04:43.473023] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-06. [2025-10-02T22:04:44.119281] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-02T22:04:44.273056] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-08. [2025-10-02T22:04:45.073013] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-07. [2025-10-02T22:04:45.700858] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-02T22:04:45.873033] [INFO ] [REMOTE ] U: Fetching primary data for 2025-10. [2025-10-02T22:04:46.428966] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-02T22:04:46.673024] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-10. [2025-10-02T22:04:47.473057] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-09. [2025-10-02T22:04:47.883310] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-02T22:04:47.885455] [INFO ] [REMOTE ] U: Full fetch complete (77925 records). [2025-10-02T22:04:47.885570] [DEBUG] [VALIDATOR ] U: Validating primary data. [2025-10-02T22:04:48.184417] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-02T22:04:48.215467] [INFO ] [REMOTE ] UA: Full fetch complete (73021 records). [2025-10-02T22:04:48.226229] [DEBUG] [VALIDATOR ] UA: Validating primary data. [2025-10-02T22:04:48.283928] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-08. [2025-10-02T22:04:48.392902] [DEBUG] [VALIDATOR ] U: All expected trading days are present. [2025-10-02T22:04:48.420092] [DEBUG] [VALIDATOR ] U: Primary data validation passed. [2025-10-02T22:04:48.436406] [INFO ] [MAIN ] U: Fetched primary data is valid. [2025-10-02T22:04:48.439341] [DEBUG] [LOCAL ] U: Saving primary data. [2025-10-02T22:04:48.504629] [DEBUG] [LOCAL ] U: Trimmed 77925 records to 54189 (keeping 200 days of data) [2025-10-02T22:04:48.864239] [DEBUG] [VALIDATOR ] UA: All expected trading days are present. [2025-10-02T22:04:48.864773] [DEBUG] [VALIDATOR ] UA: Primary data validation passed. [2025-10-02T22:04:48.866577] [INFO ] [MAIN ] UA: Fetched primary data is valid. [2025-10-02T22:04:48.867010] [DEBUG] [LOCAL ] UA: Saving primary data. [2025-10-02T22:04:48.873150] [DEBUG] [LOCAL ] UA: Trimmed 73021 records to 50841 (keeping 200 days of data) [2025-10-02T22:04:49.096842] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-02T22:04:49.103561] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-09. [2025-10-02T22:04:49.421717] [DEBUG] [LOCAL ] U: Primary data saved (54189 records). [2025-10-02T22:04:49.424009] [INFO ] [MAIN ] U: Full history saved. [2025-10-02T22:04:49.426434] [INFO ] [MAIN ] Update Progress: 2164/2370 symbols completed. U took 57.1s. Estimated remaining: 29m 1s. Rate: 7.1 symbols/min [2025-10-02T22:04:49.425458] [DEBUG] [LOCAL ] UA: Primary data saved (50841 records). [2025-10-02T22:04:49.432697] [INFO ] [MAIN ] UA: Full history saved. [2025-10-02T22:04:49.432950] [INFO ] [MAIN ] Update Progress: 2165/2370 symbols completed. UA took 42.6s. Estimated remaining: 28m 51s. Rate: 7.1 symbols/min [2025-10-02T22:04:49.831124] [INFO ] [MAIN ] UBER: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:04:49.832576] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-02T22:04:49.855902] [INFO ] [MAIN ] UBS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:04:49.876768] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-10. [2025-10-02T22:04:49.895500] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-10-02T22:04:49.980352] [DEBUG] [LOCAL ] UBER: Loaded 53806 existing records from primary storage. [2025-10-02T22:04:49.981626] [DEBUG] [LOCAL ] UBS: Loaded 52398 existing records from primary storage. [2025-10-02T22:04:49.982232] [INFO ] [MAIN ] UBER: Loaded 53806 existing records. [2025-10-02T22:04:49.982434] [INFO ] [MAIN ] UBS: Loaded 52398 existing records. [2025-10-02T22:04:50.307767] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-02T22:04:50.359439] [WARN ] [MAIN ] UBER: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:04:50.367555] [INFO ] [REMOTE ] UAN: Full fetch complete (8115 records). [2025-10-02T22:04:50.380020] [DEBUG] [VALIDATOR ] UAN: Validating primary data. [2025-10-02T22:04:50.398806] [INFO ] [MAIN ] UBER: Wiping existing primary data before full refresh. [2025-10-02T22:04:50.425501] [WARN ] [MAIN ] UBS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:04:50.437083] [INFO ] [LOCAL ] UBER: Starting deletion of primary data. [2025-10-02T22:04:50.464946] [INFO ] [MAIN ] UBS: Wiping existing primary data before full refresh. [2025-10-02T22:04:50.480075] [INFO ] [LOCAL ] UBS: Starting deletion of primary data. [2025-10-02T22:04:50.493065] [DEBUG] [LOCAL ] UBER: Deleted primary data file. [2025-10-02T22:04:50.518214] [DEBUG] [LOCAL ] UBS: Deleted primary data file. [2025-10-02T22:04:50.518877] [INFO ] [MAIN ] UBS: Starting full primary refresh. [2025-10-02T22:04:50.518784] [INFO ] [MAIN ] UBER: Starting full primary refresh. [2025-10-02T22:04:50.714202] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-10. [2025-10-02T22:04:51.386396] [DEBUG] [VALIDATOR ] UAN: All expected trading days are present. [2025-10-02T22:04:51.454320] [DEBUG] [VALIDATOR ] UAN: Primary data validation passed. [2025-10-02T22:04:51.529797] [INFO ] [MAIN ] UAN: Fetched primary data is valid. [2025-10-02T22:04:51.550528] [DEBUG] [LOCAL ] UAN: Saving primary data. [2025-10-02T22:04:51.625011] [DEBUG] [LOCAL ] UAN: Trimmed 8115 records to 5425 (keeping 200 days of data) [2025-10-02T22:04:51.638528] [INFO ] [REMOTE ] UBS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:04:51.663849] [INFO ] [REMOTE ] UBS: Fetching primary data for 2024-12. [2025-10-02T22:04:51.698236] [INFO ] [REMOTE ] UBER: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:04:51.739268] [DEBUG] [LOCAL ] UAN: Primary data saved (5425 records). [2025-10-02T22:04:51.739447] [INFO ] [MAIN ] UAN: Full history saved. [2025-10-02T22:04:51.739592] [INFO ] [MAIN ] Update Progress: 2166/2370 symbols completed. UAN took 23.5s. Estimated remaining: 28m 42s. Rate: 7.1 symbols/min [2025-10-02T22:04:51.939899] [INFO ] [MAIN ] UCB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:04:51.982811] [DEBUG] [LOCAL ] UCB: Loaded 37802 existing records from primary storage. [2025-10-02T22:04:51.983118] [INFO ] [MAIN ] UCB: Loaded 37802 existing records. [2025-10-02T22:04:52.189178] [WARN ] [MAIN ] UCB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:04:52.189384] [INFO ] [MAIN ] UCB: Wiping existing primary data before full refresh. [2025-10-02T22:04:52.189434] [INFO ] [LOCAL ] UCB: Starting deletion of primary data. [2025-10-02T22:04:52.189690] [DEBUG] [LOCAL ] UCB: Deleted primary data file. [2025-10-02T22:04:52.189752] [INFO ] [MAIN ] UCB: Starting full primary refresh. [2025-10-02T22:04:52.274762] [INFO ] [REMOTE ] UBER: Fetching primary data for 2024-12. [2025-10-02T22:04:52.391528] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-02T22:04:52.467368] [INFO ] [REMOTE ] UAA: Full fetch complete (77485 records). [2025-10-02T22:04:52.479183] [DEBUG] [VALIDATOR ] UAA: Validating primary data. [2025-10-02T22:04:52.736949] [INFO ] [REMOTE ] UCB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:04:53.036175] [DEBUG] [VALIDATOR ] UAA: All expected trading days are present. [2025-10-02T22:04:53.036294] [DEBUG] [VALIDATOR ] UAA: Primary data validation passed. [2025-10-02T22:04:53.037679] [INFO ] [MAIN ] UAA: Fetched primary data is valid. [2025-10-02T22:04:53.037805] [DEBUG] [LOCAL ] UAA: Saving primary data. [2025-10-02T22:04:53.039469] [DEBUG] [LOCAL ] UAA: Trimmed 77485 records to 53897 (keeping 200 days of data) [2025-10-02T22:04:53.096861] [INFO ] [REMOTE ] UCB: Fetching primary data for 2024-12. [2025-10-02T22:04:53.290858] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-02T22:04:53.414506] [DEBUG] [LOCAL ] UAA: Primary data saved (53897 records). [2025-10-02T22:04:53.414701] [INFO ] [MAIN ] UAA: Full history saved. [2025-10-02T22:04:53.414799] [INFO ] [MAIN ] Update Progress: 2167/2370 symbols completed. UAA took 31.3s. Estimated remaining: 28m 33s. Rate: 7.1 symbols/min [2025-10-02T22:04:53.592837] [INFO ] [MAIN ] UDR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:04:53.640980] [DEBUG] [LOCAL ] UDR: Loaded 51828 existing records from primary storage. [2025-10-02T22:04:53.641306] [INFO ] [MAIN ] UDR: Loaded 51828 existing records. [2025-10-02T22:04:53.832231] [WARN ] [MAIN ] UDR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:04:53.832459] [INFO ] [MAIN ] UDR: Wiping existing primary data before full refresh. [2025-10-02T22:04:53.832507] [INFO ] [LOCAL ] UDR: Starting deletion of primary data. [2025-10-02T22:04:53.832760] [DEBUG] [LOCAL ] UDR: Deleted primary data file. [2025-10-02T22:04:53.832821] [INFO ] [MAIN ] UDR: Starting full primary refresh. [2025-10-02T22:04:53.879282] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-01. [2025-10-02T22:04:54.230517] [INFO ] [REMOTE ] UDR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:04:54.501267] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-02T22:04:54.577834] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-10-02T22:04:54.673016] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-01. [2025-10-02T22:04:55.473005] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-01. [2025-10-02T22:04:55.576726] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-02T22:04:56.273020] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-02. [2025-10-02T22:04:56.791065] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-02T22:04:56.902302] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-02T22:04:57.073044] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-02. [2025-10-02T22:04:57.686765] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-02T22:04:57.873008] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-03. [2025-10-02T22:04:58.673002] [INFO ] [REMOTE ] UDR: Fetching primary data for 2024-12. [2025-10-02T22:04:59.336344] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-10-02T22:04:59.473013] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-02. [2025-10-02T22:04:59.767346] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-02T22:04:59.995115] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-02T22:05:00.256465] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-02T22:05:00.272985] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-03. [2025-10-02T22:05:01.073034] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-01. [2025-10-02T22:05:01.847561] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-02T22:05:01.873027] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-04. [2025-10-02T22:05:02.668137] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-02T22:05:02.678245] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-03. [2025-10-02T22:05:03.063182] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-02T22:05:03.473033] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-04. [2025-10-02T22:05:04.273024] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-05. [2025-10-02T22:05:05.038153] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-10-02T22:05:05.073096] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-02. [2025-10-02T22:05:05.308678] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-02T22:05:05.519273] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-02T22:05:05.873086] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-04. [2025-10-02T22:05:06.358715] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-02T22:05:06.673019] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-03. [2025-10-02T22:05:07.473036] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-06. [2025-10-02T22:05:08.163551] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-02T22:05:08.273003] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-05. [2025-10-02T22:05:08.538487] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-02T22:05:08.901329] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-02T22:05:09.073000] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-04. [2025-10-02T22:05:09.872972] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-07. [2025-10-02T22:05:10.203430] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-02T22:05:10.672991] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-06. [2025-10-02T22:05:10.796866] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-02T22:05:11.380674] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-02T22:05:11.472990] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-05. [2025-10-02T22:05:12.273012] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-05. [2025-10-02T22:05:12.496460] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-02T22:05:13.072996] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-07. [2025-10-02T22:05:13.873030] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-08. [2025-10-02T22:05:13.929937] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-02T22:05:14.135039] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-05 (2.66 seconds). [2025-10-02T22:05:14.673013] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-06. [2025-10-02T22:05:14.735532] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-02T22:05:14.950982] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-02T22:05:15.473002] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-08. [2025-10-02T22:05:16.273053] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-09. [2025-10-02T22:05:16.397052] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-02T22:05:17.073044] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-06. [2025-10-02T22:05:17.330858] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-02T22:05:17.587606] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-02T22:05:17.873032] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-10. [2025-10-02T22:05:18.673067] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-09. [2025-10-02T22:05:18.909673] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-02T22:05:18.911575] [INFO ] [REMOTE ] UCB: Full fetch complete (54707 records). [2025-10-02T22:05:18.911725] [DEBUG] [VALIDATOR ] UCB: Validating primary data. [2025-10-02T22:05:19.340675] [DEBUG] [VALIDATOR ] UCB: All expected trading days are present. [2025-10-02T22:05:19.340919] [DEBUG] [VALIDATOR ] UCB: Primary data validation passed. [2025-10-02T22:05:19.341990] [INFO ] [MAIN ] UCB: Fetched primary data is valid. [2025-10-02T22:05:19.342069] [DEBUG] [LOCAL ] UCB: Saving primary data. [2025-10-02T22:05:19.343600] [DEBUG] [LOCAL ] UCB: Trimmed 54707 records to 38118 (keeping 200 days of data) [2025-10-02T22:05:19.476631] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-07. [2025-10-02T22:05:19.481217] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-06 (2.41 seconds). [2025-10-02T22:05:19.647337] [DEBUG] [LOCAL ] UCB: Primary data saved (38118 records). [2025-10-02T22:05:19.647488] [INFO ] [MAIN ] UCB: Full history saved. [2025-10-02T22:05:19.647600] [INFO ] [MAIN ] Update Progress: 2168/2370 symbols completed. UCB took 27.9s. Estimated remaining: 28m 27s. Rate: 7.1 symbols/min [2025-10-02T22:05:19.845511] [INFO ] [MAIN ] UE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:05:19.887381] [DEBUG] [LOCAL ] UE: Loaded 42710 existing records from primary storage. [2025-10-02T22:05:19.887744] [INFO ] [MAIN ] UE: Loaded 42710 existing records. [2025-10-02T22:05:20.091542] [WARN ] [MAIN ] UE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:05:20.091789] [INFO ] [MAIN ] UE: Wiping existing primary data before full refresh. [2025-10-02T22:05:20.091842] [INFO ] [LOCAL ] UE: Starting deletion of primary data. [2025-10-02T22:05:20.092075] [DEBUG] [LOCAL ] UE: Deleted primary data file. [2025-10-02T22:05:20.092137] [INFO ] [MAIN ] UE: Starting full primary refresh. [2025-10-02T22:05:20.278695] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-07. [2025-10-02T22:05:20.508802] [INFO ] [REMOTE ] UE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:05:20.569031] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-02T22:05:21.073041] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-10. [2025-10-02T22:05:21.390595] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-02T22:05:21.872999] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-08. [2025-10-02T22:05:22.297693] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-02T22:05:22.310217] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-02T22:05:22.313698] [INFO ] [REMOTE ] UBS: Full fetch complete (75695 records). [2025-10-02T22:05:22.313833] [DEBUG] [VALIDATOR ] UBS: Validating primary data. [2025-10-02T22:05:22.678144] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-08. [2025-10-02T22:05:22.763039] [DEBUG] [VALIDATOR ] UBS: All expected trading days are present. [2025-10-02T22:05:22.763133] [DEBUG] [VALIDATOR ] UBS: Primary data validation passed. [2025-10-02T22:05:22.764498] [INFO ] [MAIN ] UBS: Fetched primary data is valid. [2025-10-02T22:05:22.764573] [DEBUG] [LOCAL ] UBS: Saving primary data. [2025-10-02T22:05:22.766175] [DEBUG] [LOCAL ] UBS: Trimmed 75695 records to 52778 (keeping 200 days of data) [2025-10-02T22:05:23.109525] [DEBUG] [LOCAL ] UBS: Primary data saved (52778 records). [2025-10-02T22:05:23.109743] [INFO ] [MAIN ] UBS: Full history saved. [2025-10-02T22:05:23.109900] [INFO ] [MAIN ] Update Progress: 2169/2370 symbols completed. UBS took 33.7s. Estimated remaining: 28m 18s. Rate: 7.1 symbols/min [2025-10-02T22:05:23.346900] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-02T22:05:23.351770] [INFO ] [MAIN ] UFI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:05:23.374485] [DEBUG] [LOCAL ] UFI: Loaded 8076 existing records from primary storage. [2025-10-02T22:05:23.374877] [INFO ] [MAIN ] UFI: Loaded 8076 existing records. [2025-10-02T22:05:23.478272] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-09. [2025-10-02T22:05:23.598667] [WARN ] [MAIN ] UFI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:05:23.598944] [INFO ] [MAIN ] UFI: Wiping existing primary data before full refresh. [2025-10-02T22:05:23.599019] [INFO ] [LOCAL ] UFI: Starting deletion of primary data. [2025-10-02T22:05:23.599257] [DEBUG] [LOCAL ] UFI: Deleted primary data file. [2025-10-02T22:05:23.599333] [INFO ] [MAIN ] UFI: Starting full primary refresh. [2025-10-02T22:05:24.009747] [INFO ] [REMOTE ] UFI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:05:24.273016] [INFO ] [REMOTE ] UE: Fetching primary data for 2024-12. [2025-10-02T22:05:25.072991] [INFO ] [REMOTE ] UFI: Fetching primary data for 2024-12. [2025-10-02T22:05:25.226250] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-02T22:05:25.304194] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-08 (2.63 seconds). [2025-10-02T22:05:25.609517] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-02T22:05:25.828014] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-02T22:05:25.873014] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-09. [2025-10-02T22:05:26.673062] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-01. [2025-10-02T22:05:27.442841] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-02T22:05:27.473027] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-02. [2025-10-02T22:05:28.273021] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-01. [2025-10-02T22:05:28.624445] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-09 (2.75 seconds). [2025-10-02T22:05:28.669880] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-02T22:05:29.073053] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-03. [2025-10-02T22:05:29.628191] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-02T22:05:29.863338] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-02T22:05:29.872948] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-04. [2025-10-02T22:05:30.673033] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-02. [2025-10-02T22:05:30.705189] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-02T22:05:31.473028] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-10. [2025-10-02T22:05:32.104947] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-02T22:05:32.273020] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-03. [2025-10-02T22:05:32.735797] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-02T22:05:32.737995] [INFO ] [REMOTE ] UDR: Full fetch complete (74609 records). [2025-10-02T22:05:32.738325] [DEBUG] [VALIDATOR ] UDR: Validating primary data. [2025-10-02T22:05:33.076453] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-05. [2025-10-02T22:05:33.190736] [DEBUG] [VALIDATOR ] UDR: All expected trading days are present. [2025-10-02T22:05:33.190859] [DEBUG] [VALIDATOR ] UDR: Primary data validation passed. [2025-10-02T22:05:33.192324] [INFO ] [MAIN ] UDR: Fetched primary data is valid. [2025-10-02T22:05:33.192469] [DEBUG] [LOCAL ] UDR: Saving primary data. [2025-10-02T22:05:33.195497] [DEBUG] [LOCAL ] UDR: Trimmed 74609 records to 52218 (keeping 200 days of data) [2025-10-02T22:05:33.527439] [DEBUG] [LOCAL ] UDR: Primary data saved (52218 records). [2025-10-02T22:05:33.527579] [INFO ] [MAIN ] UDR: Full history saved. [2025-10-02T22:05:33.527695] [INFO ] [MAIN ] Update Progress: 2170/2370 symbols completed. UDR took 40.1s. Estimated remaining: 28m 9s. Rate: 7.1 symbols/min [2025-10-02T22:05:33.711406] [INFO ] [MAIN ] UGI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:05:33.763783] [DEBUG] [LOCAL ] UGI: Loaded 50508 existing records from primary storage. [2025-10-02T22:05:33.764157] [INFO ] [MAIN ] UGI: Loaded 50508 existing records. [2025-10-02T22:05:33.882014] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-10. [2025-10-02T22:05:33.948458] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-02T22:05:33.997240] [WARN ] [MAIN ] UGI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:05:33.997790] [INFO ] [MAIN ] UGI: Wiping existing primary data before full refresh. [2025-10-02T22:05:33.997897] [INFO ] [LOCAL ] UGI: Starting deletion of primary data. [2025-10-02T22:05:33.998424] [DEBUG] [LOCAL ] UGI: Deleted primary data file. [2025-10-02T22:05:33.998489] [INFO ] [MAIN ] UGI: Starting full primary refresh. [2025-10-02T22:05:34.278611] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-02T22:05:34.437303] [INFO ] [REMOTE ] UGI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:05:34.672997] [INFO ] [REMOTE ] UGI: Fetching primary data for 2024-12. [2025-10-02T22:05:35.472986] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-04. [2025-10-02T22:05:35.978240] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-02T22:05:35.981113] [INFO ] [REMOTE ] UBER: Full fetch complete (77978 records). [2025-10-02T22:05:35.981225] [DEBUG] [VALIDATOR ] UBER: Validating primary data. [2025-10-02T22:05:36.294482] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-06. [2025-10-02T22:05:36.438007] [DEBUG] [VALIDATOR ] UBER: All expected trading days are present. [2025-10-02T22:05:36.438170] [DEBUG] [VALIDATOR ] UBER: Primary data validation passed. [2025-10-02T22:05:36.439365] [INFO ] [MAIN ] UBER: Fetched primary data is valid. [2025-10-02T22:05:36.439451] [DEBUG] [LOCAL ] UBER: Saving primary data. [2025-10-02T22:05:36.441111] [DEBUG] [LOCAL ] UBER: Trimmed 77978 records to 54196 (keeping 200 days of data) [2025-10-02T22:05:36.563414] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-02T22:05:36.758557] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-02T22:05:36.880836] [DEBUG] [LOCAL ] UBER: Primary data saved (54196 records). [2025-10-02T22:05:36.880994] [INFO ] [MAIN ] UBER: Full history saved. [2025-10-02T22:05:36.881904] [INFO ] [MAIN ] Update Progress: 2171/2370 symbols completed. UBER took 47.5s. Estimated remaining: 28m 0s. Rate: 7.1 symbols/min [2025-10-02T22:05:37.009791] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-02T22:05:37.084877] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-07. [2025-10-02T22:05:37.090233] [INFO ] [MAIN ] UGP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:05:37.139674] [DEBUG] [LOCAL ] UGP: Loaded 42915 existing records from primary storage. [2025-10-02T22:05:37.139976] [INFO ] [MAIN ] UGP: Loaded 42915 existing records. [2025-10-02T22:05:37.329919] [WARN ] [MAIN ] UGP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:05:37.330168] [INFO ] [MAIN ] UGP: Wiping existing primary data before full refresh. [2025-10-02T22:05:37.330230] [INFO ] [LOCAL ] UGP: Starting deletion of primary data. [2025-10-02T22:05:37.330494] [DEBUG] [LOCAL ] UGP: Deleted primary data file. [2025-10-02T22:05:37.330556] [INFO ] [MAIN ] UGP: Starting full primary refresh. [2025-10-02T22:05:37.717676] [INFO ] [REMOTE ] UGP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:05:37.722783] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-02T22:05:37.873021] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-05. [2025-10-02T22:05:38.673015] [INFO ] [REMOTE ] UGP: Fetching primary data for 2024-12. [2025-10-02T22:05:39.361774] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-02T22:05:39.473004] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-01. [2025-10-02T22:05:39.989362] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-02T22:05:40.273000] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-01. [2025-10-02T22:05:41.073012] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-06. [2025-10-02T22:05:41.157536] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-02T22:05:41.873007] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-02. [2025-10-02T22:05:41.929513] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-02T22:05:42.562103] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-02T22:05:42.673017] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-07. [2025-10-02T22:05:43.114753] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-02T22:05:43.472999] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-08. [2025-10-02T22:05:43.943638] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-02T22:05:44.247992] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-02T22:05:44.272962] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-09. [2025-10-02T22:05:45.005118] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-02T22:05:45.073029] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-10. [2025-10-02T22:05:45.482760] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-02T22:05:45.483987] [INFO ] [REMOTE ] UFI: Full fetch complete (12406 records). [2025-10-02T22:05:45.484082] [DEBUG] [VALIDATOR ] UFI: Validating primary data. [2025-10-02T22:05:45.873915] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-08. [2025-10-02T22:05:45.903091] [DEBUG] [VALIDATOR ] UFI: All expected trading days are present. [2025-10-02T22:05:45.903189] [DEBUG] [VALIDATOR ] UFI: Primary data validation passed. [2025-10-02T22:05:45.903550] [INFO ] [MAIN ] UFI: Fetched primary data is valid. [2025-10-02T22:05:45.903613] [DEBUG] [LOCAL ] UFI: Saving primary data. [2025-10-02T22:05:45.904619] [DEBUG] [LOCAL ] UFI: Trimmed 12406 records to 8157 (keeping 200 days of data) [2025-10-02T22:05:45.953307] [DEBUG] [LOCAL ] UFI: Primary data saved (8157 records). [2025-10-02T22:05:45.953444] [INFO ] [MAIN ] UFI: Full history saved. [2025-10-02T22:05:45.953531] [INFO ] [MAIN ] Update Progress: 2172/2370 symbols completed. UFI took 22.8s. Estimated remaining: 27m 52s. Rate: 7.1 symbols/min [2025-10-02T22:05:46.148546] [INFO ] [MAIN ] UHAL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:05:46.167153] [DEBUG] [LOCAL ] UHAL: Loaded 16573 existing records from primary storage. [2025-10-02T22:05:46.167411] [INFO ] [MAIN ] UHAL: Loaded 16573 existing records. [2025-10-02T22:05:46.412300] [WARN ] [MAIN ] UHAL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:05:46.414088] [INFO ] [MAIN ] UHAL: Wiping existing primary data before full refresh. [2025-10-02T22:05:46.414161] [INFO ] [LOCAL ] UHAL: Starting deletion of primary data. [2025-10-02T22:05:46.415095] [DEBUG] [LOCAL ] UHAL: Deleted primary data file. [2025-10-02T22:05:46.415170] [INFO ] [MAIN ] UHAL: Starting full primary refresh. [2025-10-02T22:05:46.685422] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-02. [2025-10-02T22:05:46.819034] [INFO ] [REMOTE ] UHAL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:05:47.441631] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-02T22:05:47.473019] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-03. [2025-10-02T22:05:48.049298] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-02T22:05:48.273035] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-03. [2025-10-02T22:05:48.822607] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-02T22:05:49.073039] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-09. [2025-10-02T22:05:49.843567] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-02T22:05:49.873013] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-04. [2025-10-02T22:05:50.420970] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-02T22:05:50.673014] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-04. [2025-10-02T22:05:51.482130] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-10. [2025-10-02T22:05:51.490210] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-02T22:05:52.272980] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2024-12. [2025-10-02T22:05:52.310860] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-02T22:05:52.485199] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-02T22:05:52.487196] [INFO ] [REMOTE ] UE: Full fetch complete (61389 records). [2025-10-02T22:05:52.487332] [DEBUG] [VALIDATOR ] UE: Validating primary data. [2025-10-02T22:05:52.909550] [DEBUG] [VALIDATOR ] UE: All expected trading days are present. [2025-10-02T22:05:52.909785] [DEBUG] [VALIDATOR ] UE: Primary data validation passed. [2025-10-02T22:05:52.911236] [INFO ] [MAIN ] UE: Fetched primary data is valid. [2025-10-02T22:05:52.911326] [DEBUG] [LOCAL ] UE: Saving primary data. [2025-10-02T22:05:52.913424] [DEBUG] [LOCAL ] UE: Trimmed 61389 records to 43024 (keeping 200 days of data) [2025-10-02T22:05:53.029153] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-02T22:05:53.072966] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-01. [2025-10-02T22:05:53.221162] [DEBUG] [LOCAL ] UE: Primary data saved (43024 records). [2025-10-02T22:05:53.221301] [INFO ] [MAIN ] UE: Full history saved. [2025-10-02T22:05:53.221386] [INFO ] [MAIN ] Update Progress: 2173/2370 symbols completed. UE took 33.6s. Estimated remaining: 27m 44s. Rate: 7.1 symbols/min [2025-10-02T22:05:53.404237] [INFO ] [MAIN ] UHS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:05:53.447865] [DEBUG] [LOCAL ] UHS: Loaded 40867 existing records from primary storage. [2025-10-02T22:05:53.448268] [INFO ] [MAIN ] UHS: Loaded 40867 existing records. [2025-10-02T22:05:53.646882] [WARN ] [MAIN ] UHS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:05:53.647101] [INFO ] [MAIN ] UHS: Wiping existing primary data before full refresh. [2025-10-02T22:05:53.647151] [INFO ] [LOCAL ] UHS: Starting deletion of primary data. [2025-10-02T22:05:53.647404] [DEBUG] [LOCAL ] UHS: Deleted primary data file. [2025-10-02T22:05:53.647464] [INFO ] [MAIN ] UHS: Starting full primary refresh. [2025-10-02T22:05:53.878228] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-05. [2025-10-02T22:05:54.042676] [INFO ] [REMOTE ] UHS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:05:54.122859] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-02T22:05:54.673039] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-02. [2025-10-02T22:05:55.472995] [INFO ] [REMOTE ] UHS: Fetching primary data for 2024-12. [2025-10-02T22:05:55.544701] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-02T22:05:55.545138] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-02T22:05:56.273041] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-06. [2025-10-02T22:05:57.066124] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-02T22:05:57.074197] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-05. [2025-10-02T22:05:57.873002] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-03. [2025-10-02T22:05:58.012454] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-02T22:05:58.623968] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-02T22:05:58.655060] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-02T22:05:58.673027] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-04. [2025-10-02T22:05:59.473071] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-07. [2025-10-02T22:05:59.697692] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-02T22:06:00.273044] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-05. [2025-10-02T22:06:01.073007] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-01. [2025-10-02T22:06:01.153312] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-02T22:06:01.276294] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-02T22:06:01.873017] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-06. [2025-10-02T22:06:02.299058] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-02T22:06:02.672988] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-08. [2025-10-02T22:06:02.851239] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-02T22:06:03.473002] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-02. [2025-10-02T22:06:04.273009] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-07. [2025-10-02T22:06:04.360613] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-02T22:06:05.046514] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-02T22:06:05.072963] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-03. [2025-10-02T22:06:05.270094] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-02T22:06:05.872993] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-08. [2025-10-02T22:06:06.672992] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-06. [2025-10-02T22:06:06.750428] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-02T22:06:06.958894] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-02T22:06:07.473001] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-09. [2025-10-02T22:06:08.272995] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-09. [2025-10-02T22:06:08.497840] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-02T22:06:09.072988] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-10. [2025-10-02T22:06:09.146158] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-06 (2.47 seconds). [2025-10-02T22:06:09.542699] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-02T22:06:09.874661] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-02T22:06:09.874349] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-07. [2025-10-02T22:06:09.876850] [INFO ] [REMOTE ] UHAL: Full fetch complete (23179 records). [2025-10-02T22:06:09.876930] [DEBUG] [VALIDATOR ] UHAL: Validating primary data. [2025-10-02T22:06:10.279420] [DEBUG] [VALIDATOR ] UHAL: All expected trading days are present. [2025-10-02T22:06:10.279505] [DEBUG] [VALIDATOR ] UHAL: Primary data validation passed. [2025-10-02T22:06:10.280000] [INFO ] [MAIN ] UHAL: Fetched primary data is valid. [2025-10-02T22:06:10.280063] [DEBUG] [LOCAL ] UHAL: Saving primary data. [2025-10-02T22:06:10.280925] [DEBUG] [LOCAL ] UHAL: Trimmed 23179 records to 16684 (keeping 200 days of data) [2025-10-02T22:06:10.390802] [DEBUG] [LOCAL ] UHAL: Primary data saved (16684 records). [2025-10-02T22:06:10.390954] [INFO ] [MAIN ] UHAL: Full history saved. [2025-10-02T22:06:10.391042] [INFO ] [MAIN ] Update Progress: 2174/2370 symbols completed. UHAL took 24.4s. Estimated remaining: 27m 36s. Rate: 7.1 symbols/min [2025-10-02T22:06:10.583048] [INFO ] [MAIN ] UHT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:06:10.594786] [DEBUG] [LOCAL ] UHT: Loaded 9936 existing records from primary storage. [2025-10-02T22:06:10.595018] [INFO ] [MAIN ] UHT: Loaded 9936 existing records. [2025-10-02T22:06:10.678179] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-04. [2025-10-02T22:06:10.807349] [WARN ] [MAIN ] UHT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:06:10.807616] [INFO ] [MAIN ] UHT: Wiping existing primary data before full refresh. [2025-10-02T22:06:10.807697] [INFO ] [LOCAL ] UHT: Starting deletion of primary data. [2025-10-02T22:06:10.807898] [DEBUG] [LOCAL ] UHT: Deleted primary data file. [2025-10-02T22:06:10.808003] [INFO ] [MAIN ] UHT: Starting full primary refresh. [2025-10-02T22:06:11.242098] [INFO ] [REMOTE ] UHT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:06:11.472998] [INFO ] [REMOTE ] UHT: Fetching primary data for 2024-12. [2025-10-02T22:06:11.621223] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-02T22:06:12.273005] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-08. [2025-10-02T22:06:12.398418] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-02T22:06:12.487449] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-02T22:06:13.073027] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-10. [2025-10-02T22:06:13.579354] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-02T22:06:13.873016] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-01. [2025-10-02T22:06:13.882259] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-02T22:06:13.885472] [INFO ] [REMOTE ] UGP: Full fetch complete (62230 records). [2025-10-02T22:06:13.885594] [DEBUG] [VALIDATOR ] UGP: Validating primary data. [2025-10-02T22:06:14.322901] [DEBUG] [VALIDATOR ] UGP: All expected trading days are present. [2025-10-02T22:06:14.323040] [DEBUG] [VALIDATOR ] UGP: Primary data validation passed. [2025-10-02T22:06:14.324283] [INFO ] [MAIN ] UGP: Fetched primary data is valid. [2025-10-02T22:06:14.324352] [DEBUG] [LOCAL ] UGP: Saving primary data. [2025-10-02T22:06:14.328382] [DEBUG] [LOCAL ] UGP: Trimmed 62230 records to 43266 (keeping 200 days of data) [2025-10-02T22:06:14.595267] [DEBUG] [LOCAL ] UGP: Primary data saved (43266 records). [2025-10-02T22:06:14.595398] [INFO ] [MAIN ] UGP: Full history saved. [2025-10-02T22:06:14.596209] [INFO ] [MAIN ] Update Progress: 2175/2370 symbols completed. UGP took 37.7s. Estimated remaining: 27m 27s. Rate: 7.1 symbols/min [2025-10-02T22:06:14.679865] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-05. [2025-10-02T22:06:14.743130] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-02T22:06:14.809127] [INFO ] [MAIN ] UI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:06:14.826307] [DEBUG] [LOCAL ] UI: Loaded 13056 existing records from primary storage. [2025-10-02T22:06:14.826555] [INFO ] [MAIN ] UI: Loaded 13056 existing records. [2025-10-02T22:06:15.017907] [WARN ] [MAIN ] UI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:06:15.018159] [INFO ] [MAIN ] UI: Wiping existing primary data before full refresh. [2025-10-02T22:06:15.018215] [INFO ] [LOCAL ] UI: Starting deletion of primary data. [2025-10-02T22:06:15.018424] [DEBUG] [LOCAL ] UI: Deleted primary data file. [2025-10-02T22:06:15.018520] [INFO ] [MAIN ] UI: Starting full primary refresh. [2025-10-02T22:06:15.421824] [INFO ] [REMOTE ] UI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:06:15.472983] [INFO ] [REMOTE ] UI: Fetching primary data for 2024-12. [2025-10-02T22:06:16.272981] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-09. [2025-10-02T22:06:16.313922] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-02T22:06:16.395296] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-02T22:06:17.073039] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-06. [2025-10-02T22:06:17.584418] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-02T22:06:17.872999] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-01. [2025-10-02T22:06:18.673001] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-10. [2025-10-02T22:06:18.796045] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-02T22:06:19.108365] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-02T22:06:19.473005] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-07. [2025-10-02T22:06:20.031956] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-02T22:06:20.035193] [INFO ] [REMOTE ] UGI: Full fetch complete (73341 records). [2025-10-02T22:06:20.035407] [DEBUG] [VALIDATOR ] UGI: Validating primary data. [2025-10-02T22:06:20.278455] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-02. [2025-10-02T22:06:20.495767] [DEBUG] [VALIDATOR ] UGI: All expected trading days are present. [2025-10-02T22:06:20.495864] [DEBUG] [VALIDATOR ] UGI: Primary data validation passed. [2025-10-02T22:06:20.497015] [INFO ] [MAIN ] UGI: Fetched primary data is valid. [2025-10-02T22:06:20.497082] [DEBUG] [LOCAL ] UGI: Saving primary data. [2025-10-02T22:06:20.498627] [DEBUG] [LOCAL ] UGI: Trimmed 73341 records to 50869 (keeping 200 days of data) [2025-10-02T22:06:20.829201] [DEBUG] [LOCAL ] UGI: Primary data saved (50869 records). [2025-10-02T22:06:20.829360] [INFO ] [MAIN ] UGI: Full history saved. [2025-10-02T22:06:20.829456] [INFO ] [MAIN ] Update Progress: 2176/2370 symbols completed. UGI took 47.3s. Estimated remaining: 27m 18s. Rate: 7.1 symbols/min [2025-10-02T22:06:21.067048] [INFO ] [MAIN ] UIS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:06:21.073437] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-02T22:06:21.073608] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-02. [2025-10-02T22:06:21.125463] [DEBUG] [LOCAL ] UIS: Loaded 36978 existing records from primary storage. [2025-10-02T22:06:21.126120] [INFO ] [MAIN ] UIS: Loaded 36978 existing records. [2025-10-02T22:06:21.203575] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-02T22:06:21.389360] [WARN ] [MAIN ] UIS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:06:21.389614] [INFO ] [MAIN ] UIS: Wiping existing primary data before full refresh. [2025-10-02T22:06:21.389696] [INFO ] [LOCAL ] UIS: Starting deletion of primary data. [2025-10-02T22:06:21.389958] [DEBUG] [LOCAL ] UIS: Deleted primary data file. [2025-10-02T22:06:21.390018] [INFO ] [MAIN ] UIS: Starting full primary refresh. [2025-10-02T22:06:21.795161] [INFO ] [REMOTE ] UIS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:06:21.874296] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-03. [2025-10-02T22:06:21.876500] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-02T22:06:22.673038] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-08. [2025-10-02T22:06:22.689024] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-02T22:06:23.473044] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-03. [2025-10-02T22:06:24.225960] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-02T22:06:24.272997] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-04. [2025-10-02T22:06:24.285389] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-02T22:06:25.072975] [INFO ] [REMOTE ] UIS: Fetching primary data for 2024-12. [2025-10-02T22:06:25.160581] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-02T22:06:25.873013] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-09. [2025-10-02T22:06:26.575407] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-02T22:06:26.673000] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-01. [2025-10-02T22:06:27.336995] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-02T22:06:27.472993] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-05. [2025-10-02T22:06:27.835577] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-02T22:06:28.273041] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-10. [2025-10-02T22:06:28.300964] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-02T22:06:29.073045] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-06. [2025-10-02T22:06:29.251750] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-02T22:06:29.253477] [INFO ] [REMOTE ] UHS: Full fetch complete (58297 records). [2025-10-02T22:06:29.253588] [DEBUG] [VALIDATOR ] UHS: Validating primary data. [2025-10-02T22:06:29.690094] [DEBUG] [VALIDATOR ] UHS: All expected trading days are present. [2025-10-02T22:06:29.690251] [DEBUG] [VALIDATOR ] UHS: Primary data validation passed. [2025-10-02T22:06:29.691296] [INFO ] [MAIN ] UHS: Fetched primary data is valid. [2025-10-02T22:06:29.691360] [DEBUG] [LOCAL ] UHS: Saving primary data. [2025-10-02T22:06:29.692674] [DEBUG] [LOCAL ] UHS: Trimmed 58297 records to 41142 (keeping 200 days of data) [2025-10-02T22:06:29.795820] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-02T22:06:29.892913] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-07. [2025-10-02T22:06:29.975312] [DEBUG] [LOCAL ] UHS: Primary data saved (41142 records). [2025-10-02T22:06:29.975452] [INFO ] [MAIN ] UHS: Full history saved. [2025-10-02T22:06:29.975535] [INFO ] [MAIN ] Update Progress: 2177/2370 symbols completed. UHS took 36.8s. Estimated remaining: 27m 10s. Rate: 7.1 symbols/min [2025-10-02T22:06:30.151917] [INFO ] [MAIN ] UL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:06:30.203806] [DEBUG] [LOCAL ] UL: Loaded 53068 existing records from primary storage. [2025-10-02T22:06:30.204138] [INFO ] [MAIN ] UL: Loaded 53068 existing records. [2025-10-02T22:06:30.393183] [WARN ] [MAIN ] UL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:06:30.393432] [INFO ] [MAIN ] UL: Wiping existing primary data before full refresh. [2025-10-02T22:06:30.393482] [INFO ] [LOCAL ] UL: Starting deletion of primary data. [2025-10-02T22:06:30.393809] [DEBUG] [LOCAL ] UL: Deleted primary data file. [2025-10-02T22:06:30.393869] [INFO ] [MAIN ] UL: Starting full primary refresh. [2025-10-02T22:06:30.677790] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-02. [2025-10-02T22:06:30.779409] [INFO ] [REMOTE ] UL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:06:30.895174] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-02T22:06:31.473026] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-08. [2025-10-02T22:06:32.090953] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-02T22:06:32.272975] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-04. [2025-10-02T22:06:32.304246] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-02T22:06:32.774972] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-02T22:06:33.073036] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-05. [2025-10-02T22:06:33.851561] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-02T22:06:33.872955] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-06. [2025-10-02T22:06:34.623331] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-02T22:06:34.672992] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-09. [2025-10-02T22:06:35.473006] [INFO ] [REMOTE ] UL: Fetching primary data for 2024-12. [2025-10-02T22:06:35.760181] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-02T22:06:36.273047] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-07. [2025-10-02T22:06:37.073012] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-10. [2025-10-02T22:06:37.167583] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-02T22:06:37.203577] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-02T22:06:37.872994] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-08. [2025-10-02T22:06:37.879151] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-02T22:06:37.880439] [INFO ] [REMOTE ] UI: Full fetch complete (18592 records). [2025-10-02T22:06:37.880515] [DEBUG] [VALIDATOR ] UI: Validating primary data. [2025-10-02T22:06:38.274747] [DEBUG] [VALIDATOR ] UI: All expected trading days are present. [2025-10-02T22:06:38.274848] [DEBUG] [VALIDATOR ] UI: Primary data validation passed. [2025-10-02T22:06:38.275323] [INFO ] [MAIN ] UI: Fetched primary data is valid. [2025-10-02T22:06:38.275366] [DEBUG] [LOCAL ] UI: Saving primary data. [2025-10-02T22:06:38.276032] [DEBUG] [LOCAL ] UI: Trimmed 18592 records to 13213 (keeping 200 days of data) [2025-10-02T22:06:38.361360] [DEBUG] [LOCAL ] UI: Primary data saved (13213 records). [2025-10-02T22:06:38.361508] [INFO ] [MAIN ] UI: Full history saved. [2025-10-02T22:06:38.361592] [INFO ] [MAIN ] Update Progress: 2178/2370 symbols completed. UI took 23.8s. Estimated remaining: 27m 2s. Rate: 7.1 symbols/min [2025-10-02T22:06:38.540356] [INFO ] [MAIN ] ULS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:06:38.584603] [DEBUG] [LOCAL ] ULS: Loaded 39473 existing records from primary storage. [2025-10-02T22:06:38.584950] [INFO ] [MAIN ] ULS: Loaded 39473 existing records. [2025-10-02T22:06:38.678102] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-01. [2025-10-02T22:06:38.792874] [WARN ] [MAIN ] ULS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:06:38.787155] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-02T22:06:38.793169] [INFO ] [MAIN ] ULS: Wiping existing primary data before full refresh. [2025-10-02T22:06:38.795619] [INFO ] [LOCAL ] ULS: Starting deletion of primary data. [2025-10-02T22:06:38.796374] [DEBUG] [LOCAL ] ULS: Deleted primary data file. [2025-10-02T22:06:38.796441] [INFO ] [MAIN ] ULS: Starting full primary refresh. [2025-10-02T22:06:39.198175] [INFO ] [REMOTE ] ULS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:06:39.473026] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-03. [2025-10-02T22:06:40.272982] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-09. [2025-10-02T22:06:40.681766] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-02T22:06:40.846180] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-02T22:06:40.971704] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-02T22:06:41.073037] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-02. [2025-10-02T22:06:41.873043] [INFO ] [REMOTE ] ULS: Fetching primary data for 2024-12. [2025-10-02T22:06:42.672989] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-10. [2025-10-02T22:06:42.796629] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-02T22:06:43.172387] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-02T22:06:43.173443] [INFO ] [REMOTE ] UHT: Full fetch complete (15076 records). [2025-10-02T22:06:43.173522] [DEBUG] [VALIDATOR ] UHT: Validating primary data. [2025-10-02T22:06:43.473585] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-04. [2025-10-02T22:06:43.527426] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-02T22:06:43.602729] [DEBUG] [VALIDATOR ] UHT: All expected trading days are present. [2025-10-02T22:06:43.602844] [DEBUG] [VALIDATOR ] UHT: Primary data validation passed. [2025-10-02T22:06:43.615398] [INFO ] [MAIN ] UHT: Fetched primary data is valid. [2025-10-02T22:06:43.615509] [DEBUG] [LOCAL ] UHT: Saving primary data. [2025-10-02T22:06:43.616189] [DEBUG] [LOCAL ] UHT: Trimmed 15076 records to 9993 (keeping 200 days of data) [2025-10-02T22:06:43.681547] [DEBUG] [LOCAL ] UHT: Primary data saved (9993 records). [2025-10-02T22:06:43.681718] [INFO ] [MAIN ] UHT: Full history saved. [2025-10-02T22:06:43.681814] [INFO ] [MAIN ] Update Progress: 2179/2370 symbols completed. UHT took 33.3s. Estimated remaining: 26m 53s. Rate: 7.1 symbols/min [2025-10-02T22:06:43.868924] [INFO ] [MAIN ] UMC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:06:43.919633] [DEBUG] [LOCAL ] UMC: Loaded 52704 existing records from primary storage. [2025-10-02T22:06:43.919989] [INFO ] [MAIN ] UMC: Loaded 52704 existing records. [2025-10-02T22:06:44.107298] [WARN ] [MAIN ] UMC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:06:44.107580] [INFO ] [MAIN ] UMC: Wiping existing primary data before full refresh. [2025-10-02T22:06:44.107665] [INFO ] [LOCAL ] UMC: Starting deletion of primary data. [2025-10-02T22:06:44.108066] [DEBUG] [LOCAL ] UMC: Deleted primary data file. [2025-10-02T22:06:44.108129] [INFO ] [MAIN ] UMC: Starting full primary refresh. [2025-10-02T22:06:44.274668] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-01. [2025-10-02T22:06:44.524618] [INFO ] [REMOTE ] UMC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:06:44.574896] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-02T22:06:45.073028] [INFO ] [REMOTE ] UMC: Fetching primary data for 2024-12. [2025-10-02T22:06:45.585836] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-02T22:06:45.873053] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-03. [2025-10-02T22:06:46.673020] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-05. [2025-10-02T22:06:46.823053] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-02T22:06:47.473028] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-02. [2025-10-02T22:06:47.859256] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-02T22:06:47.943821] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-02T22:06:48.273035] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-06. [2025-10-02T22:06:49.073038] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-04. [2025-10-02T22:06:49.256344] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-02T22:06:49.666788] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-02T22:06:49.873000] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-03. [2025-10-02T22:06:50.673064] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-07. [2025-10-02T22:06:51.298082] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-02T22:06:51.473062] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-04. [2025-10-02T22:06:51.837138] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-04 (2.76 seconds). [2025-10-02T22:06:52.243614] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-02T22:06:52.273036] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-05. [2025-10-02T22:06:53.025547] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-02T22:06:53.072971] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-08. [2025-10-02T22:06:53.873000] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-05. [2025-10-02T22:06:54.211519] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-02T22:06:54.612067] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-02T22:06:54.673043] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-06. [2025-10-02T22:06:55.082907] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-02T22:06:55.472999] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-09. [2025-10-02T22:06:56.272974] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-06. [2025-10-02T22:06:56.628426] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-02T22:06:57.012923] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-02T22:06:57.072993] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-01. [2025-10-02T22:06:57.744745] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-02T22:06:57.873014] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-07. [2025-10-02T22:06:58.673020] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-07. [2025-10-02T22:06:58.959838] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-02T22:06:59.139837] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-02T22:06:59.473012] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-08. [2025-10-02T22:07:00.272981] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-10. [2025-10-02T22:07:00.643335] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-02T22:07:00.774262] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-02T22:07:01.073034] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-09. [2025-10-02T22:07:01.180315] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-02T22:07:01.182278] [INFO ] [REMOTE ] UIS: Full fetch complete (51844 records). [2025-10-02T22:07:01.182376] [DEBUG] [VALIDATOR ] UIS: Validating primary data. [2025-10-02T22:07:01.594193] [DEBUG] [VALIDATOR ] UIS: All expected trading days are present. [2025-10-02T22:07:01.594292] [DEBUG] [VALIDATOR ] UIS: Primary data validation passed. [2025-10-02T22:07:01.595399] [INFO ] [MAIN ] UIS: Fetched primary data is valid. [2025-10-02T22:07:01.595466] [DEBUG] [LOCAL ] UIS: Saving primary data. [2025-10-02T22:07:01.596775] [DEBUG] [LOCAL ] UIS: Trimmed 51844 records to 37283 (keeping 200 days of data) [2025-10-02T22:07:01.813155] [DEBUG] [LOCAL ] UIS: Primary data saved (37283 records). [2025-10-02T22:07:01.813302] [INFO ] [MAIN ] UIS: Full history saved. [2025-10-02T22:07:01.813389] [INFO ] [MAIN ] Update Progress: 2180/2370 symbols completed. UIS took 41.0s. Estimated remaining: 26m 45s. Rate: 7.1 symbols/min [2025-10-02T22:07:01.883783] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-02. [2025-10-02T22:07:01.999237] [INFO ] [MAIN ] UMH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:07:02.039230] [DEBUG] [LOCAL ] UMH: Loaded 33609 existing records from primary storage. [2025-10-02T22:07:02.039710] [INFO ] [MAIN ] UMH: Loaded 33609 existing records. [2025-10-02T22:07:02.249508] [WARN ] [MAIN ] UMH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:07:02.249738] [INFO ] [MAIN ] UMH: Wiping existing primary data before full refresh. [2025-10-02T22:07:02.249795] [INFO ] [LOCAL ] UMH: Starting deletion of primary data. [2025-10-02T22:07:02.250052] [DEBUG] [LOCAL ] UMH: Deleted primary data file. [2025-10-02T22:07:02.250113] [INFO ] [MAIN ] UMH: Starting full primary refresh. [2025-10-02T22:07:02.659450] [INFO ] [REMOTE ] UMH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:07:02.673004] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-08. [2025-10-02T22:07:02.683549] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-02T22:07:03.284531] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-02T22:07:03.473010] [INFO ] [REMOTE ] UMH: Fetching primary data for 2024-12. [2025-10-02T22:07:04.273037] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-03. [2025-10-02T22:07:04.591565] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-02T22:07:04.870314] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-02T22:07:05.072993] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-09. [2025-10-02T22:07:05.872977] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-01. [2025-10-02T22:07:06.192569] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-02T22:07:06.660949] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-02T22:07:06.672948] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-10. [2025-10-02T22:07:07.216043] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-02T22:07:07.472991] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-02. [2025-10-02T22:07:08.141212] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-02T22:07:08.143559] [INFO ] [REMOTE ] UL: Full fetch complete (76885 records). [2025-10-02T22:07:08.143712] [DEBUG] [VALIDATOR ] UL: Validating primary data. [2025-10-02T22:07:08.278074] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-04. [2025-10-02T22:07:08.567546] [DEBUG] [VALIDATOR ] UL: All expected trading days are present. [2025-10-02T22:07:08.567634] [DEBUG] [VALIDATOR ] UL: Primary data validation passed. [2025-10-02T22:07:08.573591] [INFO ] [MAIN ] UL: Fetched primary data is valid. [2025-10-02T22:07:08.574809] [DEBUG] [LOCAL ] UL: Saving primary data. [2025-10-02T22:07:08.592476] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-02T22:07:08.597667] [DEBUG] [LOCAL ] UL: Trimmed 76885 records to 53457 (keeping 200 days of data) [2025-10-02T22:07:08.946147] [DEBUG] [LOCAL ] UL: Primary data saved (53457 records). [2025-10-02T22:07:08.946299] [INFO ] [MAIN ] UL: Full history saved. [2025-10-02T22:07:08.946402] [INFO ] [MAIN ] Update Progress: 2181/2370 symbols completed. UL took 39.0s. Estimated remaining: 26m 37s. Rate: 7.1 symbols/min [2025-10-02T22:07:09.078144] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-10. [2025-10-02T22:07:09.146801] [INFO ] [MAIN ] UNF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:07:09.166843] [DEBUG] [LOCAL ] UNF: Loaded 12062 existing records from primary storage. [2025-10-02T22:07:09.167135] [INFO ] [MAIN ] UNF: Loaded 12062 existing records. [2025-10-02T22:07:09.372852] [WARN ] [MAIN ] UNF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:07:09.373064] [INFO ] [MAIN ] UNF: Wiping existing primary data before full refresh. [2025-10-02T22:07:09.373115] [INFO ] [LOCAL ] UNF: Starting deletion of primary data. [2025-10-02T22:07:09.373344] [DEBUG] [LOCAL ] UNF: Deleted primary data file. [2025-10-02T22:07:09.373421] [INFO ] [MAIN ] UNF: Starting full primary refresh. [2025-10-02T22:07:09.779202] [INFO ] [REMOTE ] UNF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:07:09.872972] [INFO ] [REMOTE ] UNF: Fetching primary data for 2024-12. [2025-10-02T22:07:09.944171] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-02T22:07:10.281921] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-02T22:07:10.284185] [INFO ] [REMOTE ] ULS: Full fetch complete (54379 records). [2025-10-02T22:07:10.284276] [DEBUG] [VALIDATOR ] ULS: Validating primary data. [2025-10-02T22:07:10.678226] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-03. [2025-10-02T22:07:10.733082] [DEBUG] [VALIDATOR ] ULS: All expected trading days are present. [2025-10-02T22:07:10.732031] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-02T22:07:10.736361] [DEBUG] [VALIDATOR ] ULS: Primary data validation passed. [2025-10-02T22:07:10.737683] [INFO ] [MAIN ] ULS: Fetched primary data is valid. [2025-10-02T22:07:10.737748] [DEBUG] [LOCAL ] ULS: Saving primary data. [2025-10-02T22:07:10.739196] [DEBUG] [LOCAL ] ULS: Trimmed 54379 records to 39708 (keeping 200 days of data) [2025-10-02T22:07:11.009045] [DEBUG] [LOCAL ] ULS: Primary data saved (39708 records). [2025-10-02T22:07:11.009199] [INFO ] [MAIN ] ULS: Full history saved. [2025-10-02T22:07:11.010288] [INFO ] [MAIN ] Update Progress: 2182/2370 symbols completed. ULS took 32.6s. Estimated remaining: 26m 28s. Rate: 7.1 symbols/min [2025-10-02T22:07:11.192986] [INFO ] [MAIN ] UNFI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:07:11.237207] [DEBUG] [LOCAL ] UNFI: Loaded 41973 existing records from primary storage. [2025-10-02T22:07:11.237499] [INFO ] [MAIN ] UNFI: Loaded 41973 existing records. [2025-10-02T22:07:11.434221] [WARN ] [MAIN ] UNFI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:07:11.434449] [INFO ] [MAIN ] UNFI: Wiping existing primary data before full refresh. [2025-10-02T22:07:11.434498] [INFO ] [LOCAL ] UNFI: Starting deletion of primary data. [2025-10-02T22:07:11.434810] [DEBUG] [LOCAL ] UNFI: Deleted primary data file. [2025-10-02T22:07:11.434870] [INFO ] [MAIN ] UNFI: Starting full primary refresh. [2025-10-02T22:07:11.480690] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-01. [2025-10-02T22:07:11.833710] [INFO ] [REMOTE ] UNFI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:07:12.163207] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-02T22:07:12.272981] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-05. [2025-10-02T22:07:12.579023] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-02T22:07:13.073013] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-02. [2025-10-02T22:07:13.872968] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-04. [2025-10-02T22:07:13.918838] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-02T22:07:14.173359] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-02T22:07:14.673001] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-06. [2025-10-02T22:07:15.003938] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-02T22:07:15.473004] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-03. [2025-10-02T22:07:16.272968] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2024-12. [2025-10-02T22:07:16.284897] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-02T22:07:16.588605] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-02T22:07:17.073026] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-05. [2025-10-02T22:07:17.853109] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-02T22:07:17.873010] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-04. [2025-10-02T22:07:18.499370] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-02T22:07:18.672998] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-07. [2025-10-02T22:07:18.953121] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-02T22:07:19.473050] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-05. [2025-10-02T22:07:20.272995] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-06. [2025-10-02T22:07:20.328219] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-02T22:07:20.605842] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-02T22:07:21.073021] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-01. [2025-10-02T22:07:21.656913] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-02T22:07:21.873084] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-07. [2025-10-02T22:07:22.153789] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-02T22:07:22.673100] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-02. [2025-10-02T22:07:23.473025] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-08. [2025-10-02T22:07:23.559064] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-02T22:07:23.927880] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-02T22:07:24.273001] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-08. [2025-10-02T22:07:25.020191] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-02T22:07:25.072985] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-09. [2025-10-02T22:07:25.779212] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-02T22:07:25.873035] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-03. [2025-10-02T22:07:26.673016] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-06. [2025-10-02T22:07:27.032988] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-02T22:07:27.472988] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-10. [2025-10-02T22:07:27.514943] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-02T22:07:27.612119] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-02T22:07:28.273027] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-09. [2025-10-02T22:07:29.024232] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-02T22:07:29.027200] [INFO ] [REMOTE ] UMC: Full fetch complete (76588 records). [2025-10-02T22:07:29.027369] [DEBUG] [VALIDATOR ] UMC: Validating primary data. [2025-10-02T22:07:29.078195] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-04. [2025-10-02T22:07:29.471450] [DEBUG] [VALIDATOR ] UMC: All expected trading days are present. [2025-10-02T22:07:29.471576] [DEBUG] [VALIDATOR ] UMC: Primary data validation passed. [2025-10-02T22:07:29.473071] [INFO ] [MAIN ] UMC: Fetched primary data is valid. [2025-10-02T22:07:29.473207] [DEBUG] [LOCAL ] UMC: Saving primary data. [2025-10-02T22:07:29.475352] [DEBUG] [LOCAL ] UMC: Trimmed 76588 records to 53092 (keeping 200 days of data) [2025-10-02T22:07:29.747605] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-02T22:07:29.844015] [DEBUG] [LOCAL ] UMC: Primary data saved (53092 records). [2025-10-02T22:07:29.844162] [INFO ] [MAIN ] UMC: Full history saved. [2025-10-02T22:07:29.844270] [INFO ] [MAIN ] Update Progress: 2183/2370 symbols completed. UMC took 46.2s. Estimated remaining: 26m 20s. Rate: 7.1 symbols/min [2025-10-02T22:07:29.878078] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-10. [2025-10-02T22:07:30.028012] [INFO ] [MAIN ] UNH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:07:30.080937] [DEBUG] [LOCAL ] UNH: Loaded 53795 existing records from primary storage. [2025-10-02T22:07:30.081374] [INFO ] [MAIN ] UNH: Loaded 53795 existing records. [2025-10-02T22:07:30.277044] [WARN ] [MAIN ] UNH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:07:30.277689] [INFO ] [MAIN ] UNH: Wiping existing primary data before full refresh. [2025-10-02T22:07:30.277765] [INFO ] [LOCAL ] UNH: Starting deletion of primary data. [2025-10-02T22:07:30.278100] [DEBUG] [LOCAL ] UNH: Deleted primary data file. [2025-10-02T22:07:30.278178] [INFO ] [MAIN ] UNH: Starting full primary refresh. [2025-10-02T22:07:30.657893] [INFO ] [REMOTE ] UNH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:07:30.680170] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-07. [2025-10-02T22:07:30.686405] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-02T22:07:30.941486] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-02T22:07:30.943269] [INFO ] [REMOTE ] UMH: Full fetch complete (46703 records). [2025-10-02T22:07:30.943379] [DEBUG] [VALIDATOR ] UMH: Validating primary data. [2025-10-02T22:07:31.345496] [DEBUG] [VALIDATOR ] UMH: All expected trading days are present. [2025-10-02T22:07:31.345591] [DEBUG] [VALIDATOR ] UMH: Primary data validation passed. [2025-10-02T22:07:31.346687] [INFO ] [MAIN ] UMH: Fetched primary data is valid. [2025-10-02T22:07:31.346755] [DEBUG] [LOCAL ] UMH: Saving primary data. [2025-10-02T22:07:31.348019] [DEBUG] [LOCAL ] UMH: Trimmed 46703 records to 33870 (keeping 200 days of data) [2025-10-02T22:07:31.477575] [INFO ] [REMOTE ] UNH: Fetching primary data for 2024-12. [2025-10-02T22:07:31.579381] [DEBUG] [LOCAL ] UMH: Primary data saved (33870 records). [2025-10-02T22:07:31.579530] [INFO ] [MAIN ] UMH: Full history saved. [2025-10-02T22:07:31.579634] [INFO ] [MAIN ] Update Progress: 2184/2370 symbols completed. UMH took 29.8s. Estimated remaining: 26m 11s. Rate: 7.1 symbols/min [2025-10-02T22:07:31.736165] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-02T22:07:31.798438] [INFO ] [MAIN ] UNM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:07:31.854411] [DEBUG] [LOCAL ] UNM: Loaded 48469 existing records from primary storage. [2025-10-02T22:07:31.854899] [INFO ] [MAIN ] UNM: Loaded 48469 existing records. [2025-10-02T22:07:32.087835] [WARN ] [MAIN ] UNM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:07:32.088116] [INFO ] [MAIN ] UNM: Wiping existing primary data before full refresh. [2025-10-02T22:07:32.088166] [INFO ] [LOCAL ] UNM: Starting deletion of primary data. [2025-10-02T22:07:32.088439] [DEBUG] [LOCAL ] UNM: Deleted primary data file. [2025-10-02T22:07:32.088497] [INFO ] [MAIN ] UNM: Starting full primary refresh. [2025-10-02T22:07:32.278714] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-08. [2025-10-02T22:07:32.488181] [INFO ] [REMOTE ] UNM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:07:33.051136] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-02T22:07:33.072968] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-09. [2025-10-02T22:07:33.808552] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-02T22:07:33.873004] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-10. [2025-10-02T22:07:34.136908] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2024-12 (2.66 seconds). [2025-10-02T22:07:34.396543] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-02T22:07:34.397525] [INFO ] [REMOTE ] UNF: Full fetch complete (17340 records). [2025-10-02T22:07:34.397722] [DEBUG] [VALIDATOR ] UNF: Validating primary data. [2025-10-02T22:07:34.678253] [INFO ] [REMOTE ] UNM: Fetching primary data for 2024-12. [2025-10-02T22:07:34.801132] [DEBUG] [VALIDATOR ] UNF: All expected trading days are present. [2025-10-02T22:07:34.801213] [DEBUG] [VALIDATOR ] UNF: Primary data validation passed. [2025-10-02T22:07:34.801588] [INFO ] [MAIN ] UNF: Fetched primary data is valid. [2025-10-02T22:07:34.801629] [DEBUG] [LOCAL ] UNF: Saving primary data. [2025-10-02T22:07:34.802215] [DEBUG] [LOCAL ] UNF: Trimmed 17340 records to 12130 (keeping 200 days of data) [2025-10-02T22:07:34.900755] [DEBUG] [LOCAL ] UNF: Primary data saved (12130 records). [2025-10-02T22:07:34.900903] [INFO ] [MAIN ] UNF: Full history saved. [2025-10-02T22:07:34.901010] [INFO ] [MAIN ] Update Progress: 2185/2370 symbols completed. UNF took 26.0s. Estimated remaining: 26m 2s. Rate: 7.1 symbols/min [2025-10-02T22:07:35.079747] [INFO ] [MAIN ] UNMA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:07:35.087618] [DEBUG] [LOCAL ] UNMA: Loaded 3513 existing records from primary storage. [2025-10-02T22:07:35.088040] [INFO ] [MAIN ] UNMA: Loaded 3513 existing records. [2025-10-02T22:07:35.286882] [WARN ] [MAIN ] UNMA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:07:35.287154] [INFO ] [MAIN ] UNMA: Wiping existing primary data before full refresh. [2025-10-02T22:07:35.287243] [INFO ] [LOCAL ] UNMA: Starting deletion of primary data. [2025-10-02T22:07:35.287507] [DEBUG] [LOCAL ] UNMA: Deleted primary data file. [2025-10-02T22:07:35.287566] [INFO ] [MAIN ] UNMA: Starting full primary refresh. [2025-10-02T22:07:35.481637] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-01. [2025-10-02T22:07:35.665512] [INFO ] [REMOTE ] UNMA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:07:36.272987] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2024-12. [2025-10-02T22:07:36.406695] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-02T22:07:36.872528] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-02T22:07:37.073035] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-01. [2025-10-02T22:07:37.878137] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-05. [2025-10-02T22:07:37.892104] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-01 (2.41 seconds). [2025-10-02T22:07:38.672972] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-01. [2025-10-02T22:07:38.782581] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-02T22:07:39.285154] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-02T22:07:39.410300] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-02T22:07:39.472992] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-02. [2025-10-02T22:07:40.062124] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-02T22:07:40.273029] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-02. [2025-10-02T22:07:41.073190] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-03. [2025-10-02T22:07:41.726249] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-02T22:07:41.873020] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-02. [2025-10-02T22:07:42.574068] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-10-02T22:07:42.672988] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-03. [2025-10-02T22:07:43.142061] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-02T22:07:43.473067] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-06. [2025-10-02T22:07:44.273057] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-03. [2025-10-02T22:07:44.636384] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-02T22:07:44.777304] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-02T22:07:45.073002] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-04. [2025-10-02T22:07:45.609154] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-02T22:07:45.873016] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-04. [2025-10-02T22:07:46.463091] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-02T22:07:46.673010] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-04. [2025-10-02T22:07:47.193366] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-02T22:07:47.473016] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-07. [2025-10-02T22:07:47.952393] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-02T22:07:48.273020] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-05. [2025-10-02T22:07:48.929563] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-02T22:07:49.073052] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-06. [2025-10-02T22:07:49.150323] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-02T22:07:49.661488] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-02T22:07:49.873009] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-08. [2025-10-02T22:07:50.673038] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-05. [2025-10-02T22:07:51.414386] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-02T22:07:51.473050] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-07. [2025-10-02T22:07:51.926008] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-02T22:07:52.076952] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-02T22:07:52.273020] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-05. [2025-10-02T22:07:53.073043] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-08. [2025-10-02T22:07:53.651011] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-02T22:07:53.873028] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-06. [2025-10-02T22:07:54.672976] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-09. [2025-10-02T22:07:54.838242] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-05 (2.57 seconds). [2025-10-02T22:07:55.473020] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-09. [2025-10-02T22:07:55.715371] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-02T22:07:55.789461] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-02T22:07:56.207220] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-02T22:07:56.273054] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-10. [2025-10-02T22:07:56.609594] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-02T22:07:56.610309] [INFO ] [REMOTE ] UNMA: Full fetch complete (5807 records). [2025-10-02T22:07:56.610377] [DEBUG] [VALIDATOR ] UNMA: Validating primary data. [2025-10-02T22:07:57.038224] [DEBUG] [VALIDATOR ] UNMA: All expected trading days are present. [2025-10-02T22:07:57.038303] [DEBUG] [VALIDATOR ] UNMA: Primary data validation passed. [2025-10-02T22:07:57.038471] [INFO ] [MAIN ] UNMA: Fetched primary data is valid. [2025-10-02T22:07:57.038512] [DEBUG] [LOCAL ] UNMA: Saving primary data. [2025-10-02T22:07:57.038921] [DEBUG] [LOCAL ] UNMA: Trimmed 5807 records to 3533 (keeping 200 days of data) [2025-10-02T22:07:57.062946] [DEBUG] [LOCAL ] UNMA: Primary data saved (3533 records). [2025-10-02T22:07:57.063091] [INFO ] [MAIN ] UNMA: Full history saved. [2025-10-02T22:07:57.063182] [INFO ] [MAIN ] Update Progress: 2186/2370 symbols completed. UNMA took 22.2s. Estimated remaining: 25m 55s. Rate: 7.1 symbols/min [2025-10-02T22:07:57.078100] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-06. [2025-10-02T22:07:57.249572] [INFO ] [MAIN ] UNP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:07:57.311776] [DEBUG] [LOCAL ] UNP: Loaded 53271 existing records from primary storage. [2025-10-02T22:07:57.312116] [INFO ] [MAIN ] UNP: Loaded 53271 existing records. [2025-10-02T22:07:57.508041] [WARN ] [MAIN ] UNP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:07:57.508215] [INFO ] [MAIN ] UNP: Wiping existing primary data before full refresh. [2025-10-02T22:07:57.508264] [INFO ] [LOCAL ] UNP: Starting deletion of primary data. [2025-10-02T22:07:57.508803] [DEBUG] [LOCAL ] UNP: Deleted primary data file. [2025-10-02T22:07:57.508863] [INFO ] [MAIN ] UNP: Starting full primary refresh. [2025-10-02T22:07:57.877031] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-10. [2025-10-02T22:07:57.891919] [INFO ] [REMOTE ] UNP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:07:58.673018] [INFO ] [REMOTE ] UNP: Fetching primary data for 2024-12. [2025-10-02T22:07:59.158683] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-02T22:07:59.160996] [INFO ] [REMOTE ] UNFI: Full fetch complete (59238 records). [2025-10-02T22:07:59.161125] [DEBUG] [VALIDATOR ] UNFI: Validating primary data. [2025-10-02T22:07:59.480589] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-07. [2025-10-02T22:07:59.616817] [DEBUG] [VALIDATOR ] UNFI: All expected trading days are present. [2025-10-02T22:07:59.616947] [DEBUG] [VALIDATOR ] UNFI: Primary data validation passed. [2025-10-02T22:07:59.618252] [INFO ] [MAIN ] UNFI: Fetched primary data is valid. [2025-10-02T22:07:59.618321] [DEBUG] [LOCAL ] UNFI: Saving primary data. [2025-10-02T22:07:59.619871] [DEBUG] [LOCAL ] UNFI: Trimmed 59238 records to 42348 (keeping 200 days of data) [2025-10-02T22:07:59.903335] [DEBUG] [LOCAL ] UNFI: Primary data saved (42348 records). [2025-10-02T22:07:59.903468] [INFO ] [MAIN ] UNFI: Full history saved. [2025-10-02T22:07:59.904371] [INFO ] [MAIN ] Update Progress: 2187/2370 symbols completed. UNFI took 48.9s. Estimated remaining: 25m 46s. Rate: 7.1 symbols/min [2025-10-02T22:08:00.137454] [INFO ] [MAIN ] UP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:08:00.187229] [DEBUG] [LOCAL ] UP: Loaded 43152 existing records from primary storage. [2025-10-02T22:08:00.187969] [INFO ] [MAIN ] UP: Loaded 43152 existing records. [2025-10-02T22:08:00.416815] [WARN ] [MAIN ] UP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:08:00.419920] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-06 (3.34 seconds). [2025-10-02T22:08:00.420058] [INFO ] [MAIN ] UP: Wiping existing primary data before full refresh. [2025-10-02T22:08:00.431243] [INFO ] [LOCAL ] UP: Starting deletion of primary data. [2025-10-02T22:08:00.433346] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-07. [2025-10-02T22:08:00.432700] [DEBUG] [LOCAL ] UP: Deleted primary data file. [2025-10-02T22:08:00.463817] [INFO ] [MAIN ] UP: Starting full primary refresh. [2025-10-02T22:08:00.482340] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-02T22:08:00.877294] [INFO ] [REMOTE ] UP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:08:01.072982] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-01. [2025-10-02T22:08:01.333740] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-02T22:08:01.872995] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-08. [2025-10-02T22:08:02.672997] [INFO ] [REMOTE ] UP: Fetching primary data for 2024-12. [2025-10-02T22:08:03.041403] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-02T22:08:03.126006] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-07 (2.69 seconds). [2025-10-02T22:08:03.443363] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-02T22:08:03.472991] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-08. [2025-10-02T22:08:03.936977] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-02T22:08:04.273014] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-02. [2025-10-02T22:08:05.072990] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-01. [2025-10-02T22:08:05.872998] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-09. [2025-10-02T22:08:06.172100] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-02T22:08:06.255014] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-02T22:08:06.438949] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-08 (2.97 seconds). [2025-10-02T22:08:06.673043] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-03. [2025-10-02T22:08:07.473024] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-09. [2025-10-02T22:08:07.550596] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-02T22:08:08.273004] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-10. [2025-10-02T22:08:08.593110] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-02T22:08:09.073047] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-02. [2025-10-02T22:08:09.493855] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-02T22:08:09.495813] [INFO ] [REMOTE ] UNM: Full fetch complete (70006 records). [2025-10-02T22:08:09.495933] [DEBUG] [VALIDATOR ] UNM: Validating primary data. [2025-10-02T22:08:09.873598] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-04. [2025-10-02T22:08:09.950183] [DEBUG] [VALIDATOR ] UNM: All expected trading days are present. [2025-10-02T22:08:09.950283] [DEBUG] [VALIDATOR ] UNM: Primary data validation passed. [2025-10-02T22:08:09.951606] [INFO ] [MAIN ] UNM: Fetched primary data is valid. [2025-10-02T22:08:09.951708] [DEBUG] [LOCAL ] UNM: Saving primary data. [2025-10-02T22:08:09.954212] [DEBUG] [LOCAL ] UNM: Trimmed 70006 records to 48812 (keeping 200 days of data) [2025-10-02T22:08:10.278770] [DEBUG] [LOCAL ] UNM: Primary data saved (48812 records). [2025-10-02T22:08:10.278999] [INFO ] [MAIN ] UNM: Full history saved. [2025-10-02T22:08:10.279128] [INFO ] [MAIN ] Update Progress: 2188/2370 symbols completed. UNM took 38.7s. Estimated remaining: 25m 38s. Rate: 7.1 symbols/min [2025-10-02T22:08:10.470851] [INFO ] [MAIN ] UPS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:08:10.471234] [DEBUG] [LOCAL ] UPS: No existing data file found in primary storage. [2025-10-02T22:08:10.471541] [WARN ] [MAIN ] UPS: No existing data found, performing full refresh instead. [2025-10-02T22:08:10.472072] [INFO ] [MAIN ] UPS: Wiping existing primary data before full refresh. [2025-10-02T22:08:10.472224] [INFO ] [LOCAL ] UPS: Starting deletion of primary data. [2025-10-02T22:08:10.472325] [DEBUG] [LOCAL ] UPS: No primary data file found to delete. [2025-10-02T22:08:10.472552] [INFO ] [MAIN ] UPS: Starting full primary refresh. [2025-10-02T22:08:10.615834] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-09 (3.14 seconds). [2025-10-02T22:08:10.682523] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-10. [2025-10-02T22:08:10.788471] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-02T22:08:10.953345] [INFO ] [REMOTE ] UPS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:08:11.472986] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-03. [2025-10-02T22:08:12.273005] [INFO ] [REMOTE ] UPS: Fetching primary data for 2024-12. [2025-10-02T22:08:12.314269] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-10-02T22:08:12.791402] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-02T22:08:12.996668] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-10 (2.31 seconds). [2025-10-02T22:08:13.003432] [INFO ] [REMOTE ] UNH: Full fetch complete (77866 records). [2025-10-02T22:08:13.003760] [DEBUG] [VALIDATOR ] UNH: Validating primary data. [2025-10-02T22:08:13.078184] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-05. [2025-10-02T22:08:13.439345] [DEBUG] [VALIDATOR ] UNH: All expected trading days are present. [2025-10-02T22:08:13.439553] [DEBUG] [VALIDATOR ] UNH: Primary data validation passed. [2025-10-02T22:08:13.440942] [INFO ] [MAIN ] UNH: Fetched primary data is valid. [2025-10-02T22:08:13.441013] [DEBUG] [LOCAL ] UNH: Saving primary data. [2025-10-02T22:08:13.442893] [DEBUG] [LOCAL ] UNH: Trimmed 77866 records to 54185 (keeping 200 days of data) [2025-10-02T22:08:13.829518] [DEBUG] [LOCAL ] UNH: Primary data saved (54185 records). [2025-10-02T22:08:13.829704] [INFO ] [MAIN ] UNH: Full history saved. [2025-10-02T22:08:13.829806] [INFO ] [MAIN ] Update Progress: 2189/2370 symbols completed. UNH took 44.0s. Estimated remaining: 25m 29s. Rate: 7.1 symbols/min [2025-10-02T22:08:13.878127] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-04. [2025-10-02T22:08:14.020747] [INFO ] [MAIN ] URI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:08:14.056550] [DEBUG] [LOCAL ] URI: Loaded 35649 existing records from primary storage. [2025-10-02T22:08:14.056870] [INFO ] [MAIN ] URI: Loaded 35649 existing records. [2025-10-02T22:08:14.264404] [WARN ] [MAIN ] URI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:08:14.264735] [INFO ] [MAIN ] URI: Wiping existing primary data before full refresh. [2025-10-02T22:08:14.264806] [INFO ] [LOCAL ] URI: Starting deletion of primary data. [2025-10-02T22:08:14.265087] [DEBUG] [LOCAL ] URI: Deleted primary data file. [2025-10-02T22:08:14.265154] [INFO ] [MAIN ] URI: Starting full primary refresh. [2025-10-02T22:08:14.714854] [INFO ] [REMOTE ] URI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:08:14.738095] [INFO ] [REMOTE ] URI: Fetching primary data for 2024-12. [2025-10-02T22:08:14.741953] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2024-12 (2.47 seconds). [2025-10-02T22:08:14.790258] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-02T22:08:15.013497] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-02T22:08:15.473010] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-06. [2025-10-02T22:08:16.272987] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-05. [2025-10-02T22:08:16.299375] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-02T22:08:17.073003] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-01. [2025-10-02T22:08:17.345624] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-02T22:08:17.872441] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-02T22:08:17.881352] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-07. [2025-10-02T22:08:18.672998] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-06. [2025-10-02T22:08:19.215186] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-02T22:08:19.472969] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-01. [2025-10-02T22:08:20.064279] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-02T22:08:20.272972] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-02. [2025-10-02T22:08:20.301672] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-02T22:08:20.914216] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-02T22:08:21.072998] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-08. [2025-10-02T22:08:21.873038] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-07. [2025-10-02T22:08:22.325782] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-02T22:08:22.559252] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-02T22:08:22.673032] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-03. [2025-10-02T22:08:23.183028] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-02T22:08:23.473020] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-09. [2025-10-02T22:08:24.272975] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-08. [2025-10-02T22:08:24.738635] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-02T22:08:25.072983] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-04. [2025-10-02T22:08:25.404596] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-02T22:08:25.872978] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-10. [2025-10-02T22:08:26.033836] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-02T22:08:26.673005] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-02. [2025-10-02T22:08:27.392148] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-10-02T22:08:27.409981] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-02T22:08:27.412335] [INFO ] [REMOTE ] UNP: Full fetch complete (76919 records). [2025-10-02T22:08:27.412442] [DEBUG] [VALIDATOR ] UNP: Validating primary data. [2025-10-02T22:08:27.480333] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-05. [2025-10-02T22:08:27.854426] [DEBUG] [VALIDATOR ] UNP: All expected trading days are present. [2025-10-02T22:08:27.854525] [DEBUG] [VALIDATOR ] UNP: Primary data validation passed. [2025-10-02T22:08:27.855912] [INFO ] [MAIN ] UNP: Fetched primary data is valid. [2025-10-02T22:08:27.855985] [DEBUG] [LOCAL ] UNP: Saving primary data. [2025-10-02T22:08:27.857561] [DEBUG] [LOCAL ] UNP: Trimmed 76919 records to 53658 (keeping 200 days of data) [2025-10-02T22:08:28.234068] [DEBUG] [LOCAL ] UNP: Primary data saved (53658 records). [2025-10-02T22:08:28.234229] [INFO ] [MAIN ] UNP: Full history saved. [2025-10-02T22:08:28.234315] [INFO ] [MAIN ] Update Progress: 2190/2370 symbols completed. UNP took 31.2s. Estimated remaining: 25m 21s. Rate: 7.1 symbols/min [2025-10-02T22:08:28.282226] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-09. [2025-10-02T22:08:28.425926] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-02T22:08:28.456620] [INFO ] [MAIN ] USA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:08:28.491511] [DEBUG] [LOCAL ] USA: Loaded 35974 existing records from primary storage. [2025-10-02T22:08:28.491850] [INFO ] [MAIN ] USA: Loaded 35974 existing records. [2025-10-02T22:08:28.709234] [WARN ] [MAIN ] USA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:08:28.709574] [INFO ] [MAIN ] USA: Wiping existing primary data before full refresh. [2025-10-02T22:08:28.709632] [INFO ] [LOCAL ] USA: Starting deletion of primary data. [2025-10-02T22:08:28.709955] [DEBUG] [LOCAL ] USA: Deleted primary data file. [2025-10-02T22:08:28.710024] [INFO ] [MAIN ] USA: Starting full primary refresh. [2025-10-02T22:08:29.078144] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-03. [2025-10-02T22:08:29.136569] [INFO ] [REMOTE ] USA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:08:29.477324] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-02T22:08:29.873071] [INFO ] [REMOTE ] USA: Fetching primary data for 2024-12. [2025-10-02T22:08:30.419322] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-02T22:08:30.672996] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-06. [2025-10-02T22:08:30.779828] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-02T22:08:31.004871] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-02T22:08:31.473015] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-04. [2025-10-02T22:08:32.273000] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-10. [2025-10-02T22:08:32.463886] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-02T22:08:32.971882] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-02T22:08:33.073035] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-05. [2025-10-02T22:08:33.857068] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-02T22:08:33.862943] [INFO ] [REMOTE ] UP: Full fetch complete (62415 records). [2025-10-02T22:08:33.863097] [DEBUG] [VALIDATOR ] UP: Validating primary data. [2025-10-02T22:08:33.878208] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-01. [2025-10-02T22:08:34.293627] [DEBUG] [VALIDATOR ] UP: All expected trading days are present. [2025-10-02T22:08:34.293835] [DEBUG] [VALIDATOR ] UP: Primary data validation passed. [2025-10-02T22:08:34.294917] [INFO ] [MAIN ] UP: Fetched primary data is valid. [2025-10-02T22:08:34.295026] [DEBUG] [LOCAL ] UP: Saving primary data. [2025-10-02T22:08:34.296583] [DEBUG] [LOCAL ] UP: Trimmed 62415 records to 43529 (keeping 200 days of data) [2025-10-02T22:08:34.403003] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-02T22:08:34.590971] [DEBUG] [LOCAL ] UP: Primary data saved (43529 records). [2025-10-02T22:08:34.591104] [INFO ] [MAIN ] UP: Full history saved. [2025-10-02T22:08:34.591925] [INFO ] [MAIN ] Update Progress: 2191/2370 symbols completed. UP took 34.7s. Estimated remaining: 25m 12s. Rate: 7.1 symbols/min [2025-10-02T22:08:34.678092] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-07. [2025-10-02T22:08:34.775715] [INFO ] [MAIN ] USAC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:08:34.799831] [DEBUG] [LOCAL ] USAC: Loaded 22250 existing records from primary storage. [2025-10-02T22:08:34.800093] [INFO ] [MAIN ] USAC: Loaded 22250 existing records. [2025-10-02T22:08:34.991151] [WARN ] [MAIN ] USAC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:08:34.991381] [INFO ] [MAIN ] USAC: Wiping existing primary data before full refresh. [2025-10-02T22:08:34.991430] [INFO ] [LOCAL ] USAC: Starting deletion of primary data. [2025-10-02T22:08:34.991797] [DEBUG] [LOCAL ] USAC: Deleted primary data file. [2025-10-02T22:08:34.991859] [INFO ] [MAIN ] USAC: Starting full primary refresh. [2025-10-02T22:08:35.369873] [INFO ] [REMOTE ] USAC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:08:35.390117] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-02T22:08:35.473011] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-02. [2025-10-02T22:08:36.273054] [INFO ] [REMOTE ] USAC: Fetching primary data for 2024-12. [2025-10-02T22:08:36.517767] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-02T22:08:36.725015] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-02T22:08:37.072993] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-03. [2025-10-02T22:08:37.444470] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-02T22:08:37.873041] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-06. [2025-10-02T22:08:38.632972] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-02T22:08:38.673006] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-01. [2025-10-02T22:08:39.299661] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-02T22:08:39.472996] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-04. [2025-10-02T22:08:39.937010] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-02T22:08:40.273000] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-07. [2025-10-02T22:08:40.577740] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-02T22:08:41.073029] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-02. [2025-10-02T22:08:41.476248] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-02T22:08:41.873032] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-05. [2025-10-02T22:08:42.420803] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-02T22:08:42.673011] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-08. [2025-10-02T22:08:42.913396] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-02T22:08:43.473020] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-03. [2025-10-02T22:08:44.273052] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-08. [2025-10-02T22:08:44.807598] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-02T22:08:44.869064] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-02T22:08:45.072998] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-09. [2025-10-02T22:08:45.694047] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-02T22:08:45.872992] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-04. [2025-10-02T22:08:46.672963] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-06. [2025-10-02T22:08:47.071794] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-02T22:08:47.472986] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-09. [2025-10-02T22:08:47.509928] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-09 (2.44 seconds). [2025-10-02T22:08:47.609982] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-02T22:08:48.273012] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-07. [2025-10-02T22:08:48.608321] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-02T22:08:49.073017] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-10. [2025-10-02T22:08:49.718119] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-02T22:08:49.873021] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-08. [2025-10-02T22:08:50.673059] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-05. [2025-10-02T22:08:51.057431] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-02T22:08:51.106476] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-02T22:08:51.109421] [INFO ] [REMOTE ] UPS: Full fetch complete (77755 records). [2025-10-02T22:08:51.109592] [DEBUG] [VALIDATOR ] UPS: Validating primary data. [2025-10-02T22:08:51.488134] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-09. [2025-10-02T22:08:51.553930] [DEBUG] [VALIDATOR ] UPS: All expected trading days are present. [2025-10-02T22:08:51.554165] [DEBUG] [VALIDATOR ] UPS: Primary data validation passed. [2025-10-02T22:08:51.555718] [INFO ] [MAIN ] UPS: Fetched primary data is valid. [2025-10-02T22:08:51.555850] [DEBUG] [LOCAL ] UPS: Saving primary data. [2025-10-02T22:08:51.574769] [DEBUG] [LOCAL ] UPS: Trimmed 77755 records to 54102 (keeping 200 days of data) [2025-10-02T22:08:51.575751] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-02T22:08:51.958840] [DEBUG] [LOCAL ] UPS: Primary data saved (54102 records). [2025-10-02T22:08:51.959036] [INFO ] [MAIN ] UPS: Full history saved. [2025-10-02T22:08:51.959133] [INFO ] [MAIN ] Update Progress: 2192/2370 symbols completed. UPS took 41.7s. Estimated remaining: 25m 5s. Rate: 7.1 symbols/min [2025-10-02T22:08:52.169596] [INFO ] [MAIN ] USB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:08:52.220972] [DEBUG] [LOCAL ] USB: Loaded 53688 existing records from primary storage. [2025-10-02T22:08:52.221299] [INFO ] [MAIN ] USB: Loaded 53688 existing records. [2025-10-02T22:08:52.278285] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-10. [2025-10-02T22:08:52.412922] [WARN ] [MAIN ] USB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:08:52.413234] [INFO ] [MAIN ] USB: Wiping existing primary data before full refresh. [2025-10-02T22:08:52.413297] [INFO ] [LOCAL ] USB: Starting deletion of primary data. [2025-10-02T22:08:52.413704] [DEBUG] [LOCAL ] USB: Deleted primary data file. [2025-10-02T22:08:52.413768] [INFO ] [MAIN ] USB: Starting full primary refresh. [2025-10-02T22:08:52.815081] [INFO ] [REMOTE ] USB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:08:53.032314] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-02T22:08:53.073072] [INFO ] [REMOTE ] USB: Fetching primary data for 2024-12. [2025-10-02T22:08:53.182031] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-02T22:08:53.183915] [INFO ] [REMOTE ] URI: Full fetch complete (53394 records). [2025-10-02T22:08:53.184095] [DEBUG] [VALIDATOR ] URI: Validating primary data. [2025-10-02T22:08:53.754736] [DEBUG] [VALIDATOR ] URI: All expected trading days are present. [2025-10-02T22:08:53.754856] [DEBUG] [VALIDATOR ] URI: Primary data validation passed. [2025-10-02T22:08:53.756349] [INFO ] [MAIN ] URI: Fetched primary data is valid. [2025-10-02T22:08:53.756469] [DEBUG] [LOCAL ] URI: Saving primary data. [2025-10-02T22:08:53.758229] [DEBUG] [LOCAL ] URI: Trimmed 53394 records to 35864 (keeping 200 days of data) [2025-10-02T22:08:53.873090] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-10. [2025-10-02T22:08:54.025547] [DEBUG] [LOCAL ] URI: Primary data saved (35864 records). [2025-10-02T22:08:54.025728] [INFO ] [MAIN ] URI: Full history saved. [2025-10-02T22:08:54.025826] [INFO ] [MAIN ] Update Progress: 2193/2370 symbols completed. URI took 40.2s. Estimated remaining: 24m 56s. Rate: 7.1 symbols/min [2025-10-02T22:08:54.215847] [INFO ] [MAIN ] USFD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:08:54.274674] [DEBUG] [LOCAL ] USFD: Loaded 51195 existing records from primary storage. [2025-10-02T22:08:54.275460] [INFO ] [MAIN ] USFD: Loaded 51195 existing records. [2025-10-02T22:08:54.487609] [WARN ] [MAIN ] USFD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:08:54.487994] [INFO ] [MAIN ] USFD: Wiping existing primary data before full refresh. [2025-10-02T22:08:54.488055] [INFO ] [LOCAL ] USFD: Starting deletion of primary data. [2025-10-02T22:08:54.488336] [DEBUG] [LOCAL ] USFD: Deleted primary data file. [2025-10-02T22:08:54.488396] [INFO ] [MAIN ] USFD: Starting full primary refresh. [2025-10-02T22:08:54.679041] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-06. [2025-10-02T22:08:54.889014] [INFO ] [REMOTE ] USFD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:08:54.978414] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-02T22:08:54.980297] [INFO ] [REMOTE ] USA: Full fetch complete (52151 records). [2025-10-02T22:08:54.980423] [DEBUG] [VALIDATOR ] USA: Validating primary data. [2025-10-02T22:08:55.381272] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-10-02T22:08:55.449611] [DEBUG] [VALIDATOR ] USA: All expected trading days are present. [2025-10-02T22:08:55.449736] [DEBUG] [VALIDATOR ] USA: Primary data validation passed. [2025-10-02T22:08:55.450802] [INFO ] [MAIN ] USA: Fetched primary data is valid. [2025-10-02T22:08:55.450867] [DEBUG] [LOCAL ] USA: Saving primary data. [2025-10-02T22:08:55.452063] [DEBUG] [LOCAL ] USA: Trimmed 52151 records to 36257 (keeping 200 days of data) [2025-10-02T22:08:55.500856] [INFO ] [REMOTE ] USFD: Fetching primary data for 2024-12. [2025-10-02T22:08:55.674761] [DEBUG] [LOCAL ] USA: Primary data saved (36257 records). [2025-10-02T22:08:55.674909] [INFO ] [MAIN ] USA: Full history saved. [2025-10-02T22:08:55.675009] [INFO ] [MAIN ] Update Progress: 2194/2370 symbols completed. USA took 27.4s. Estimated remaining: 24m 47s. Rate: 7.1 symbols/min [2025-10-02T22:08:55.860425] [INFO ] [MAIN ] USNA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:08:55.885900] [DEBUG] [LOCAL ] USNA: Loaded 17841 existing records from primary storage. [2025-10-02T22:08:55.886221] [INFO ] [MAIN ] USNA: Loaded 17841 existing records. [2025-10-02T22:08:56.074015] [WARN ] [MAIN ] USNA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:08:56.074256] [INFO ] [MAIN ] USNA: Wiping existing primary data before full refresh. [2025-10-02T22:08:56.074318] [INFO ] [LOCAL ] USNA: Starting deletion of primary data. [2025-10-02T22:08:56.074577] [DEBUG] [LOCAL ] USNA: Deleted primary data file. [2025-10-02T22:08:56.074637] [INFO ] [MAIN ] USNA: Starting full primary refresh. [2025-10-02T22:08:56.200060] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-02T22:08:56.284766] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-01. [2025-10-02T22:08:56.491220] [INFO ] [REMOTE ] USNA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:08:56.943408] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-02T22:08:57.073005] [INFO ] [REMOTE ] USNA: Fetching primary data for 2024-12. [2025-10-02T22:08:57.872975] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-01. [2025-10-02T22:08:58.066773] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-02T22:08:58.149638] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-02T22:08:58.673013] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-01. [2025-10-02T22:08:59.452189] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-02T22:08:59.472998] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-02. [2025-10-02T22:08:59.960220] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-02T22:09:00.272992] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-07. [2025-10-02T22:09:01.072976] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-02. [2025-10-02T22:09:01.419619] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-02T22:09:01.552406] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-02T22:09:01.872992] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-08. [2025-10-02T22:09:02.249862] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-02T22:09:02.672991] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-03. [2025-10-02T22:09:02.889843] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-02T22:09:03.473009] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-03. [2025-10-02T22:09:04.206986] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-02T22:09:04.272974] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-02. [2025-10-02T22:09:04.664945] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-02T22:09:05.073054] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-04. [2025-10-02T22:09:05.830182] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-02T22:09:05.872984] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-03. [2025-10-02T22:09:06.259710] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-02T22:09:06.673011] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-04. [2025-10-02T22:09:07.473008] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-09. [2025-10-02T22:09:07.858677] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-02T22:09:08.283417] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-04. [2025-10-02T22:09:08.286193] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-02T22:09:08.427550] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-02T22:09:09.073012] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-10. [2025-10-02T22:09:09.841608] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-02T22:09:09.842758] [INFO ] [REMOTE ] USAC: Full fetch complete (35414 records). [2025-10-02T22:09:09.842887] [DEBUG] [VALIDATOR ] USAC: Validating primary data. [2025-10-02T22:09:09.879733] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-05. [2025-10-02T22:09:10.305317] [DEBUG] [VALIDATOR ] USAC: All expected trading days are present. [2025-10-02T22:09:10.305435] [DEBUG] [VALIDATOR ] USAC: Primary data validation passed. [2025-10-02T22:09:10.306358] [INFO ] [MAIN ] USAC: Fetched primary data is valid. [2025-10-02T22:09:10.306507] [DEBUG] [LOCAL ] USAC: Saving primary data. [2025-10-02T22:09:10.307584] [DEBUG] [LOCAL ] USAC: Trimmed 35414 records to 22352 (keeping 200 days of data) [2025-10-02T22:09:10.444069] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-02T22:09:10.500582] [DEBUG] [LOCAL ] USAC: Primary data saved (22352 records). [2025-10-02T22:09:10.500741] [INFO ] [MAIN ] USAC: Full history saved. [2025-10-02T22:09:10.500853] [INFO ] [MAIN ] Update Progress: 2195/2370 symbols completed. USAC took 35.9s. Estimated remaining: 24m 39s. Rate: 7.1 symbols/min [2025-10-02T22:09:10.678351] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-05. [2025-10-02T22:09:10.678237] [INFO ] [MAIN ] USPH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:09:10.699593] [DEBUG] [LOCAL ] USPH: Loaded 16687 existing records from primary storage. [2025-10-02T22:09:10.699900] [INFO ] [MAIN ] USPH: Loaded 16687 existing records. [2025-10-02T22:09:10.894727] [WARN ] [MAIN ] USPH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:09:10.895014] [INFO ] [MAIN ] USPH: Wiping existing primary data before full refresh. [2025-10-02T22:09:10.895088] [INFO ] [LOCAL ] USPH: Starting deletion of primary data. [2025-10-02T22:09:10.895339] [DEBUG] [LOCAL ] USPH: Deleted primary data file. [2025-10-02T22:09:10.895412] [INFO ] [MAIN ] USPH: Starting full primary refresh. [2025-10-02T22:09:11.231284] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-02T22:09:11.324499] [INFO ] [REMOTE ] USPH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:09:11.473037] [INFO ] [REMOTE ] USPH: Fetching primary data for 2024-12. [2025-10-02T22:09:12.273045] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-05. [2025-10-02T22:09:12.418576] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-02T22:09:12.574756] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-02T22:09:13.072999] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-01. [2025-10-02T22:09:13.872988] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-06. [2025-10-02T22:09:14.058841] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-02T22:09:14.167242] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-02T22:09:14.673015] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-06. [2025-10-02T22:09:14.787154] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-02T22:09:15.473009] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-07. [2025-10-02T22:09:16.057279] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-02T22:09:16.273051] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-02. [2025-10-02T22:09:16.609496] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-02T22:09:17.073045] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-07. [2025-10-02T22:09:17.190079] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-02T22:09:17.873039] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-03. [2025-10-02T22:09:18.640069] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-02T22:09:18.672965] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-08. [2025-10-02T22:09:18.922606] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-02T22:09:19.473043] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-06. [2025-10-02T22:09:20.273027] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-08. [2025-10-02T22:09:20.614056] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-02T22:09:21.072987] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-04. [2025-10-02T22:09:21.240371] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-02T22:09:21.456747] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-02T22:09:21.872973] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-09. [2025-10-02T22:09:22.104839] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-02T22:09:22.673042] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-07. [2025-10-02T22:09:23.176546] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-02T22:09:23.473007] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-09. [2025-10-02T22:09:24.225250] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-02T22:09:24.273007] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-10. [2025-10-02T22:09:24.718990] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-02T22:09:25.072997] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-05. [2025-10-02T22:09:25.530742] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-02T22:09:25.532777] [INFO ] [REMOTE ] USFD: Full fetch complete (74004 records). [2025-10-02T22:09:25.532891] [DEBUG] [VALIDATOR ] USFD: Validating primary data. [2025-10-02T22:09:25.878127] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-10. [2025-10-02T22:09:25.973229] [DEBUG] [VALIDATOR ] USFD: All expected trading days are present. [2025-10-02T22:09:25.973438] [DEBUG] [VALIDATOR ] USFD: Primary data validation passed. [2025-10-02T22:09:25.974765] [INFO ] [MAIN ] USFD: Fetched primary data is valid. [2025-10-02T22:09:25.974899] [DEBUG] [LOCAL ] USFD: Saving primary data. [2025-10-02T22:09:25.977368] [DEBUG] [LOCAL ] USFD: Trimmed 74004 records to 51579 (keeping 200 days of data) [2025-10-02T22:09:26.080118] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-02T22:09:26.317744] [DEBUG] [LOCAL ] USFD: Primary data saved (51579 records). [2025-10-02T22:09:26.317922] [INFO ] [MAIN ] USFD: Full history saved. [2025-10-02T22:09:26.318067] [INFO ] [MAIN ] Update Progress: 2196/2370 symbols completed. USFD took 32.3s. Estimated remaining: 24m 31s. Rate: 7.1 symbols/min [2025-10-02T22:09:26.497540] [INFO ] [MAIN ] UTF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:09:26.534569] [DEBUG] [LOCAL ] UTF: Loaded 29257 existing records from primary storage. [2025-10-02T22:09:26.534946] [INFO ] [MAIN ] UTF: Loaded 29257 existing records. [2025-10-02T22:09:26.645987] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-02T22:09:26.664043] [INFO ] [REMOTE ] USNA: Full fetch complete (26621 records). [2025-10-02T22:09:26.674510] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-06. [2025-10-02T22:09:26.720806] [DEBUG] [VALIDATOR ] USNA: Validating primary data. [2025-10-02T22:09:26.752471] [WARN ] [MAIN ] UTF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:09:26.753301] [INFO ] [MAIN ] UTF: Wiping existing primary data before full refresh. [2025-10-02T22:09:26.767019] [INFO ] [LOCAL ] UTF: Starting deletion of primary data. [2025-10-02T22:09:26.843249] [DEBUG] [LOCAL ] UTF: Deleted primary data file. [2025-10-02T22:09:26.848618] [INFO ] [MAIN ] UTF: Starting full primary refresh. [2025-10-02T22:09:27.474677] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-08. [2025-10-02T22:09:27.515608] [DEBUG] [VALIDATOR ] USNA: All expected trading days are present. [2025-10-02T22:09:27.516037] [DEBUG] [VALIDATOR ] USNA: Primary data validation passed. [2025-10-02T22:09:27.534746] [INFO ] [MAIN ] USNA: Fetched primary data is valid. [2025-10-02T22:09:27.546191] [DEBUG] [LOCAL ] USNA: Saving primary data. [2025-10-02T22:09:27.626181] [INFO ] [REMOTE ] UTF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:09:27.619910] [DEBUG] [LOCAL ] USNA: Trimmed 26621 records to 17937 (keeping 200 days of data) [2025-10-02T22:09:27.641002] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-02T22:09:27.761007] [DEBUG] [LOCAL ] USNA: Primary data saved (17937 records). [2025-10-02T22:09:27.761161] [INFO ] [MAIN ] USNA: Full history saved. [2025-10-02T22:09:27.761278] [INFO ] [MAIN ] Update Progress: 2197/2370 symbols completed. USNA took 32.1s. Estimated remaining: 24m 22s. Rate: 7.1 symbols/min [2025-10-02T22:09:28.273009] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-07. [2025-10-02T22:09:29.073068] [INFO ] [REMOTE ] UTF: Fetching primary data for 2024-12. [2025-10-02T22:09:29.641287] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-02T22:09:29.780829] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-02T22:09:29.873010] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-08. [2025-10-02T22:09:30.416222] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-02T22:09:30.673033] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-01. [2025-10-02T22:09:30.862193] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-02T22:09:31.473012] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-09. [2025-10-02T22:09:31.955496] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-02T22:09:32.273017] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-02. [2025-10-02T22:09:33.073001] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-09. [2025-10-02T22:09:33.123283] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-02T22:09:33.521201] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-02T22:09:33.872964] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-10. [2025-10-02T22:09:34.026760] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-02T22:09:34.673068] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-03. [2025-10-02T22:09:35.089958] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-02T22:09:35.092537] [INFO ] [REMOTE ] USB: Full fetch complete (77710 records). [2025-10-02T22:09:35.092726] [DEBUG] [VALIDATOR ] USB: Validating primary data. [2025-10-02T22:09:35.478106] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-10. [2025-10-02T22:09:35.534961] [DEBUG] [VALIDATOR ] USB: All expected trading days are present. [2025-10-02T22:09:35.535054] [DEBUG] [VALIDATOR ] USB: Primary data validation passed. [2025-10-02T22:09:35.536325] [INFO ] [MAIN ] USB: Fetched primary data is valid. [2025-10-02T22:09:35.536391] [DEBUG] [LOCAL ] USB: Saving primary data. [2025-10-02T22:09:35.538125] [DEBUG] [LOCAL ] USB: Trimmed 77710 records to 54078 (keeping 200 days of data) [2025-10-02T22:09:35.917467] [DEBUG] [LOCAL ] USB: Primary data saved (54078 records). [2025-10-02T22:09:35.917720] [INFO ] [MAIN ] USB: Full history saved. [2025-10-02T22:09:35.917842] [INFO ] [MAIN ] Update Progress: 2198/2370 symbols completed. USB took 44.0s. Estimated remaining: 24m 13s. Rate: 7.1 symbols/min [2025-10-02T22:09:35.969795] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-02T22:09:36.273059] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-04. [2025-10-02T22:09:36.304771] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-02T22:09:36.306713] [INFO ] [REMOTE ] USPH: Full fetch complete (22811 records). [2025-10-02T22:09:36.306814] [DEBUG] [VALIDATOR ] USPH: Validating primary data. [2025-10-02T22:09:36.725094] [DEBUG] [VALIDATOR ] USPH: All expected trading days are present. [2025-10-02T22:09:36.725180] [DEBUG] [VALIDATOR ] USPH: Primary data validation passed. [2025-10-02T22:09:36.725731] [INFO ] [MAIN ] USPH: Fetched primary data is valid. [2025-10-02T22:09:36.725795] [DEBUG] [LOCAL ] USPH: Saving primary data. [2025-10-02T22:09:36.726505] [DEBUG] [LOCAL ] USPH: Trimmed 22811 records to 16902 (keeping 200 days of data) [2025-10-02T22:09:36.836901] [DEBUG] [LOCAL ] USPH: Primary data saved (16902 records). [2025-10-02T22:09:36.837045] [INFO ] [MAIN ] USPH: Full history saved. [2025-10-02T22:09:36.837135] [INFO ] [MAIN ] Update Progress: 2199/2370 symbols completed. USPH took 26.3s. Estimated remaining: 24m 4s. Rate: 7.1 symbols/min [2025-10-02T22:09:37.737744] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-02T22:09:37.745011] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-05. [2025-10-02T22:09:39.099716] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-02T22:09:39.107116] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-06. [2025-10-02T22:09:40.271676] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-02T22:09:40.277844] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-07. [2025-10-02T22:09:41.656376] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-02T22:09:41.662970] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-08. [2025-10-02T22:09:42.811028] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-02T22:09:42.817014] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-09. [2025-10-02T22:09:44.341392] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-02T22:09:44.350175] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-10. [2025-10-02T22:09:45.273959] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-02T22:09:45.275950] [INFO ] [REMOTE ] UTF: Full fetch complete (42140 records). [2025-10-02T22:09:45.276063] [DEBUG] [VALIDATOR ] UTF: Validating primary data. [2025-10-02T22:09:45.723335] [DEBUG] [VALIDATOR ] UTF: All expected trading days are present. [2025-10-02T22:09:45.723459] [DEBUG] [VALIDATOR ] UTF: Primary data validation passed. [2025-10-02T22:09:45.724738] [INFO ] [MAIN ] UTF: Fetched primary data is valid. [2025-10-02T22:09:45.724831] [DEBUG] [LOCAL ] UTF: Saving primary data. [2025-10-02T22:09:45.726561] [DEBUG] [LOCAL ] UTF: Trimmed 42140 records to 29608 (keeping 200 days of data) [2025-10-02T22:09:45.990169] [DEBUG] [LOCAL ] UTF: Primary data saved (29608 records). [2025-10-02T22:09:45.990355] [INFO ] [MAIN ] UTF: Full history saved. [2025-10-02T22:09:45.990496] [INFO ] [MAIN ] Update Progress: 2200/2370 symbols completed. UTF took 19.7s. Estimated remaining: 23m 56s. Rate: 7.1 symbols/min [2025-10-02T22:09:46.905395] [INFO ] [MAIN ] UTZ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:09:46.915280] [INFO ] [MAIN ] UVE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:09:46.964460] [INFO ] [MAIN ] UTL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:09:46.963488] [INFO ] [MAIN ] UTI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:09:46.997676] [DEBUG] [LOCAL ] UTL: Loaded 11321 existing records from primary storage. [2025-10-02T22:09:46.998816] [INFO ] [MAIN ] UTL: Loaded 11321 existing records. [2025-10-02T22:09:46.998482] [DEBUG] [LOCAL ] UVE: Loaded 21782 existing records from primary storage. [2025-10-02T22:09:47.016405] [INFO ] [MAIN ] UVE: Loaded 21782 existing records. [2025-10-02T22:09:47.279564] [DEBUG] [LOCAL ] UTZ: Loaded 44744 existing records from primary storage. [2025-10-02T22:09:47.280353] [DEBUG] [LOCAL ] UTI: Loaded 40440 existing records from primary storage. [2025-10-02T22:09:47.296922] [INFO ] [MAIN ] UTZ: Loaded 44744 existing records. [2025-10-02T22:09:47.318598] [INFO ] [MAIN ] UTI: Loaded 40440 existing records. [2025-10-02T22:09:47.464506] [WARN ] [MAIN ] UTL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:09:47.611065] [WARN ] [MAIN ] UVE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:09:47.607608] [INFO ] [MAIN ] UTL: Wiping existing primary data before full refresh. [2025-10-02T22:09:47.685702] [INFO ] [MAIN ] UVE: Wiping existing primary data before full refresh. [2025-10-02T22:09:47.699696] [INFO ] [LOCAL ] UVE: Starting deletion of primary data. [2025-10-02T22:09:47.699827] [INFO ] [LOCAL ] UTL: Starting deletion of primary data. [2025-10-02T22:09:47.716783] [DEBUG] [LOCAL ] UTL: Deleted primary data file. [2025-10-02T22:09:47.727396] [INFO ] [MAIN ] UTL: Starting full primary refresh. [2025-10-02T22:09:47.727225] [DEBUG] [LOCAL ] UVE: Deleted primary data file. [2025-10-02T22:09:47.766098] [INFO ] [MAIN ] UVE: Starting full primary refresh. [2025-10-02T22:09:47.988621] [WARN ] [MAIN ] UTI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:09:48.027390] [WARN ] [MAIN ] UTZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:09:48.079167] [INFO ] [MAIN ] UTZ: Wiping existing primary data before full refresh. [2025-10-02T22:09:48.089620] [INFO ] [LOCAL ] UTZ: Starting deletion of primary data. [2025-10-02T22:09:48.049795] [INFO ] [MAIN ] UTI: Wiping existing primary data before full refresh. [2025-10-02T22:09:48.120691] [INFO ] [LOCAL ] UTI: Starting deletion of primary data. [2025-10-02T22:09:48.175007] [DEBUG] [LOCAL ] UTI: Deleted primary data file. [2025-10-02T22:09:48.166498] [DEBUG] [LOCAL ] UTZ: Deleted primary data file. [2025-10-02T22:09:48.194764] [INFO ] [MAIN ] UTI: Starting full primary refresh. [2025-10-02T22:09:48.202416] [INFO ] [MAIN ] UTZ: Starting full primary refresh. [2025-10-02T22:09:48.898839] [INFO ] [REMOTE ] UTL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:09:48.940911] [INFO ] [REMOTE ] UTL: Fetching primary data for 2024-12. [2025-10-02T22:09:49.200004] [INFO ] [REMOTE ] UVE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:09:49.258173] [INFO ] [REMOTE ] UVE: Fetching primary data for 2024-12. [2025-10-02T22:09:49.406013] [INFO ] [REMOTE ] UTZ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:09:49.417036] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2024-12. [2025-10-02T22:09:49.537817] [INFO ] [REMOTE ] UTI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:09:49.538168] [INFO ] [REMOTE ] UTI: Fetching primary data for 2024-12. [2025-10-02T22:09:49.885576] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-02T22:09:49.888235] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-01. [2025-10-02T22:09:50.411834] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-02T22:09:50.415601] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-01. [2025-10-02T22:09:50.575360] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-02T22:09:50.583492] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-01. [2025-10-02T22:09:50.647089] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-02T22:09:50.655265] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-01. [2025-10-02T22:09:50.686470] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-02T22:09:50.690898] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-02. [2025-10-02T22:09:51.468083] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-02T22:09:51.472344] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-02. [2025-10-02T22:09:51.502023] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-02T22:09:51.504778] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-03. [2025-10-02T22:09:51.983268] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-02T22:09:51.985639] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-04. [2025-10-02T22:09:52.121803] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-02T22:09:52.129964] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-02. [2025-10-02T22:09:52.186275] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-02T22:09:52.219329] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-02T22:09:52.272994] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-03. [2025-10-02T22:09:52.846288] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-02T22:09:53.073001] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-05. [2025-10-02T22:09:53.322298] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-02T22:09:53.792777] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-02T22:09:53.873057] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-03. [2025-10-02T22:09:53.900690] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-02T22:09:54.673004] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-02. [2025-10-02T22:09:55.473007] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-06. [2025-10-02T22:09:55.582197] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-02T22:09:56.145451] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-02T22:09:56.272962] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-04. [2025-10-02T22:09:56.282490] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-02T22:09:57.073001] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-07. [2025-10-02T22:09:57.553356] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-02T22:09:57.607929] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-02T22:09:57.873002] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-03. [2025-10-02T22:09:58.672996] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-04. [2025-10-02T22:09:59.472968] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-05. [2025-10-02T22:09:59.577490] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-02T22:09:59.687625] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-02T22:10:00.272992] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-05. [2025-10-02T22:10:01.072991] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-08. [2025-10-02T22:10:01.220965] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-02T22:10:01.683252] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-02T22:10:01.872968] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-06. [2025-10-02T22:10:02.196150] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-02T22:10:02.673056] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-06. [2025-10-02T22:10:02.983689] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-02T22:10:03.473044] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-04. [2025-10-02T22:10:04.272982] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-09. [2025-10-02T22:10:04.445858] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-02T22:10:05.072970] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-07. [2025-10-02T22:10:05.238889] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-02T22:10:05.241021] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-02T22:10:05.873062] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-07. [2025-10-02T22:10:06.542915] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-02T22:10:06.673046] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-05. [2025-10-02T22:10:07.437235] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-02T22:10:07.473001] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-08. [2025-10-02T22:10:08.273027] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-10. [2025-10-02T22:10:08.439490] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-02T22:10:08.469042] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-02T22:10:09.031135] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-02T22:10:09.032360] [INFO ] [REMOTE ] UTL: Full fetch complete (15467 records). [2025-10-02T22:10:09.032460] [DEBUG] [VALIDATOR ] UTL: Validating primary data. [2025-10-02T22:10:09.078228] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-06. [2025-10-02T22:10:09.444183] [DEBUG] [VALIDATOR ] UTL: All expected trading days are present. [2025-10-02T22:10:09.444272] [DEBUG] [VALIDATOR ] UTL: Primary data validation passed. [2025-10-02T22:10:09.444683] [INFO ] [MAIN ] UTL: Fetched primary data is valid. [2025-10-02T22:10:09.444749] [DEBUG] [LOCAL ] UTL: Saving primary data. [2025-10-02T22:10:09.445445] [DEBUG] [LOCAL ] UTL: Trimmed 15467 records to 11437 (keeping 200 days of data) [2025-10-02T22:10:09.523386] [DEBUG] [LOCAL ] UTL: Primary data saved (11437 records). [2025-10-02T22:10:09.523536] [INFO ] [MAIN ] UTL: Full history saved. [2025-10-02T22:10:09.523627] [INFO ] [MAIN ] Update Progress: 2201/2370 symbols completed. UTL took 23.5s. Estimated remaining: 23m 49s. Rate: 7.1 symbols/min [2025-10-02T22:10:09.715004] [INFO ] [MAIN ] UVV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:10:09.739730] [DEBUG] [LOCAL ] UVV: Loaded 22514 existing records from primary storage. [2025-10-02T22:10:09.740028] [INFO ] [MAIN ] UVV: Loaded 22514 existing records. [2025-10-02T22:10:09.878074] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-08. [2025-10-02T22:10:09.934900] [WARN ] [MAIN ] UVV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:10:09.935098] [INFO ] [MAIN ] UVV: Wiping existing primary data before full refresh. [2025-10-02T22:10:09.935148] [INFO ] [LOCAL ] UVV: Starting deletion of primary data. [2025-10-02T22:10:09.935412] [DEBUG] [LOCAL ] UVV: Deleted primary data file. [2025-10-02T22:10:09.935473] [INFO ] [MAIN ] UVV: Starting full primary refresh. [2025-10-02T22:10:10.367058] [INFO ] [REMOTE ] UVV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:10:10.673004] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-09. [2025-10-02T22:10:10.793578] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-02T22:10:11.434289] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-02T22:10:11.473046] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-07. [2025-10-02T22:10:11.725305] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-02T22:10:12.273050] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-10. [2025-10-02T22:10:13.040841] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-02T22:10:13.042067] [INFO ] [REMOTE ] UVE: Full fetch complete (29813 records). [2025-10-02T22:10:13.042165] [DEBUG] [VALIDATOR ] UVE: Validating primary data. [2025-10-02T22:10:13.078096] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-09. [2025-10-02T22:10:13.465560] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-02T22:10:13.517360] [DEBUG] [VALIDATOR ] UVE: All expected trading days are present. [2025-10-02T22:10:13.517468] [DEBUG] [VALIDATOR ] UVE: Primary data validation passed. [2025-10-02T22:10:13.518633] [INFO ] [MAIN ] UVE: Fetched primary data is valid. [2025-10-02T22:10:13.518727] [DEBUG] [LOCAL ] UVE: Saving primary data. [2025-10-02T22:10:13.519479] [DEBUG] [LOCAL ] UVE: Trimmed 29813 records to 21949 (keeping 200 days of data) [2025-10-02T22:10:13.666306] [DEBUG] [LOCAL ] UVE: Primary data saved (21949 records). [2025-10-02T22:10:13.666442] [INFO ] [MAIN ] UVE: Full history saved. [2025-10-02T22:10:13.666526] [INFO ] [MAIN ] Update Progress: 2202/2370 symbols completed. UVE took 27.6s. Estimated remaining: 23m 40s. Rate: 7.1 symbols/min [2025-10-02T22:10:13.854029] [INFO ] [MAIN ] UWMC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:10:13.885002] [INFO ] [REMOTE ] UVV: Fetching primary data for 2024-12. [2025-10-02T22:10:13.909774] [DEBUG] [LOCAL ] UWMC: Loaded 52775 existing records from primary storage. [2025-10-02T22:10:13.910231] [INFO ] [MAIN ] UWMC: Loaded 52775 existing records. [2025-10-02T22:10:14.108314] [WARN ] [MAIN ] UWMC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:10:14.108619] [INFO ] [MAIN ] UWMC: Wiping existing primary data before full refresh. [2025-10-02T22:10:14.108725] [INFO ] [LOCAL ] UWMC: Starting deletion of primary data. [2025-10-02T22:10:14.109179] [DEBUG] [LOCAL ] UWMC: Deleted primary data file. [2025-10-02T22:10:14.109244] [INFO ] [MAIN ] UWMC: Starting full primary refresh. [2025-10-02T22:10:14.499718] [INFO ] [REMOTE ] UWMC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:10:14.675284] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2024-12. [2025-10-02T22:10:14.677842] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-02T22:10:14.959814] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-02T22:10:15.473005] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-01. [2025-10-02T22:10:16.272992] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-10. [2025-10-02T22:10:16.504319] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-02T22:10:16.623052] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-02T22:10:17.073065] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-02. [2025-10-02T22:10:17.523676] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-02T22:10:17.526304] [INFO ] [REMOTE ] UTI: Full fetch complete (58406 records). [2025-10-02T22:10:17.526440] [DEBUG] [VALIDATOR ] UTI: Validating primary data. [2025-10-02T22:10:17.873702] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-08. [2025-10-02T22:10:17.965449] [DEBUG] [VALIDATOR ] UTI: All expected trading days are present. [2025-10-02T22:10:17.965666] [DEBUG] [VALIDATOR ] UTI: Primary data validation passed. [2025-10-02T22:10:17.967025] [INFO ] [MAIN ] UTI: Fetched primary data is valid. [2025-10-02T22:10:17.967149] [DEBUG] [LOCAL ] UTI: Saving primary data. [2025-10-02T22:10:17.979418] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-02T22:10:17.984460] [DEBUG] [LOCAL ] UTI: Trimmed 58406 records to 40755 (keeping 200 days of data) [2025-10-02T22:10:18.252230] [DEBUG] [LOCAL ] UTI: Primary data saved (40755 records). [2025-10-02T22:10:18.252361] [INFO ] [MAIN ] UTI: Full history saved. [2025-10-02T22:10:18.252446] [INFO ] [MAIN ] Update Progress: 2203/2370 symbols completed. UTI took 32.3s. Estimated remaining: 23m 31s. Rate: 7.1 symbols/min [2025-10-02T22:10:18.446068] [INFO ] [MAIN ] UZD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:10:18.456389] [DEBUG] [LOCAL ] UZD: Loaded 6411 existing records from primary storage. [2025-10-02T22:10:18.456831] [INFO ] [MAIN ] UZD: Loaded 6411 existing records. [2025-10-02T22:10:18.649091] [WARN ] [MAIN ] UZD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:10:18.649326] [INFO ] [MAIN ] UZD: Wiping existing primary data before full refresh. [2025-10-02T22:10:18.649401] [INFO ] [LOCAL ] UZD: Starting deletion of primary data. [2025-10-02T22:10:18.649616] [DEBUG] [LOCAL ] UZD: Deleted primary data file. [2025-10-02T22:10:18.649716] [INFO ] [MAIN ] UZD: Starting full primary refresh. [2025-10-02T22:10:18.685088] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-03. [2025-10-02T22:10:19.030898] [INFO ] [REMOTE ] UZD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:10:19.454941] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-02T22:10:19.472960] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-09. [2025-10-02T22:10:19.840251] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-02T22:10:20.273041] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-01. [2025-10-02T22:10:21.039697] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-02T22:10:21.073003] [INFO ] [REMOTE ] UZD: Fetching primary data for 2024-12. [2025-10-02T22:10:21.537345] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-02T22:10:21.872961] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-10. [2025-10-02T22:10:21.913226] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-02T22:10:22.673008] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-04. [2025-10-02T22:10:23.067261] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-02T22:10:23.069091] [INFO ] [REMOTE ] UTZ: Full fetch complete (64261 records). [2025-10-02T22:10:23.069179] [DEBUG] [VALIDATOR ] UTZ: Validating primary data. [2025-10-02T22:10:23.486183] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-01. [2025-10-02T22:10:23.490745] [DEBUG] [VALIDATOR ] UTZ: All expected trading days are present. [2025-10-02T22:10:23.490929] [DEBUG] [VALIDATOR ] UTZ: Primary data validation passed. [2025-10-02T22:10:23.492204] [INFO ] [MAIN ] UTZ: Fetched primary data is valid. [2025-10-02T22:10:23.492391] [DEBUG] [LOCAL ] UTZ: Saving primary data. [2025-10-02T22:10:23.493940] [DEBUG] [LOCAL ] UTZ: Trimmed 64261 records to 45037 (keeping 200 days of data) [2025-10-02T22:10:23.808131] [DEBUG] [LOCAL ] UTZ: Primary data saved (45037 records). [2025-10-02T22:10:23.808278] [INFO ] [MAIN ] UTZ: Full history saved. [2025-10-02T22:10:23.809276] [INFO ] [MAIN ] Update Progress: 2204/2370 symbols completed. UTZ took 37.8s. Estimated remaining: 23m 22s. Rate: 7.1 symbols/min [2025-10-02T22:10:23.985383] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-02T22:10:24.021329] [INFO ] [MAIN ] UZE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:10:24.035051] [DEBUG] [LOCAL ] UZE: Loaded 7443 existing records from primary storage. [2025-10-02T22:10:24.035290] [INFO ] [MAIN ] UZE: Loaded 7443 existing records. [2025-10-02T22:10:24.240452] [WARN ] [MAIN ] UZE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:10:24.240744] [INFO ] [MAIN ] UZE: Wiping existing primary data before full refresh. [2025-10-02T22:10:24.240800] [INFO ] [LOCAL ] UZE: Starting deletion of primary data. [2025-10-02T22:10:24.240999] [DEBUG] [LOCAL ] UZE: Deleted primary data file. [2025-10-02T22:10:24.241058] [INFO ] [MAIN ] UZE: Starting full primary refresh. [2025-10-02T22:10:24.278149] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-02. [2025-10-02T22:10:24.371381] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-02T22:10:24.668012] [INFO ] [REMOTE ] UZE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:10:25.073029] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-02. [2025-10-02T22:10:25.753119] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-02T22:10:25.873023] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-05. [2025-10-02T22:10:26.026510] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-02T22:10:26.672998] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-03. [2025-10-02T22:10:26.788143] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-02T22:10:27.473064] [INFO ] [REMOTE ] UZE: Fetching primary data for 2024-12. [2025-10-02T22:10:28.273003] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-03. [2025-10-02T22:10:28.289801] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-02T22:10:28.434127] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-02T22:10:29.061894] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-02T22:10:29.072971] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-04. [2025-10-02T22:10:29.797035] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-02T22:10:29.873007] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-01. [2025-10-02T22:10:30.593633] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-02T22:10:30.673062] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-02. [2025-10-02T22:10:31.226928] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-02T22:10:31.473005] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-03. [2025-10-02T22:10:32.273005] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-05. [2025-10-02T22:10:32.289424] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-02T22:10:32.876811] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-02T22:10:33.073015] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-06. [2025-10-02T22:10:33.873005] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-06. [2025-10-02T22:10:34.263412] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-02T22:10:34.511290] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-02T22:10:34.673041] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-04. [2025-10-02T22:10:35.473022] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-04. [2025-10-02T22:10:36.181587] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-02T22:10:36.272974] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-07. [2025-10-02T22:10:36.429896] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-02T22:10:36.653459] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-02T22:10:37.073028] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-07. [2025-10-02T22:10:37.873005] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-05. [2025-10-02T22:10:38.351778] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-02T22:10:38.505129] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-02T22:10:38.673057] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-05. [2025-10-02T22:10:39.473021] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-08. [2025-10-02T22:10:40.273011] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-06. [2025-10-02T22:10:40.307591] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-02T22:10:40.571349] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-02T22:10:40.875616] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-02T22:10:41.073028] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-07. [2025-10-02T22:10:41.474771] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-02T22:10:41.873011] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-08. [2025-10-02T22:10:42.672993] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-09. [2025-10-02T22:10:43.034513] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-02T22:10:43.255398] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-02T22:10:43.472987] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-09. [2025-10-02T22:10:44.272995] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-10. [2025-10-02T22:10:44.686057] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-02T22:10:44.686984] [INFO ] [REMOTE ] UZD: Full fetch complete (9508 records). [2025-10-02T22:10:44.687120] [DEBUG] [VALIDATOR ] UZD: Validating primary data. [2025-10-02T22:10:44.829980] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-02T22:10:45.079791] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-08. [2025-10-02T22:10:45.104787] [DEBUG] [VALIDATOR ] UZD: All expected trading days are present. [2025-10-02T22:10:45.104859] [DEBUG] [VALIDATOR ] UZD: Primary data validation passed. [2025-10-02T22:10:45.105092] [INFO ] [MAIN ] UZD: Fetched primary data is valid. [2025-10-02T22:10:45.105132] [DEBUG] [LOCAL ] UZD: Saving primary data. [2025-10-02T22:10:45.105726] [DEBUG] [LOCAL ] UZD: Trimmed 9508 records to 6468 (keeping 200 days of data) [2025-10-02T22:10:45.147470] [DEBUG] [LOCAL ] UZD: Primary data saved (6468 records). [2025-10-02T22:10:45.147634] [INFO ] [MAIN ] UZD: Full history saved. [2025-10-02T22:10:45.147760] [INFO ] [MAIN ] Update Progress: 2205/2370 symbols completed. UZD took 26.9s. Estimated remaining: 23m 15s. Rate: 7.1 symbols/min [2025-10-02T22:10:45.330107] [INFO ] [MAIN ] UZF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:10:45.339582] [DEBUG] [LOCAL ] UZF: Loaded 6456 existing records from primary storage. [2025-10-02T22:10:45.339818] [INFO ] [MAIN ] UZF: Loaded 6456 existing records. [2025-10-02T22:10:45.527152] [WARN ] [MAIN ] UZF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:10:45.527383] [INFO ] [MAIN ] UZF: Wiping existing primary data before full refresh. [2025-10-02T22:10:45.527432] [INFO ] [LOCAL ] UZF: Starting deletion of primary data. [2025-10-02T22:10:45.527583] [DEBUG] [LOCAL ] UZF: Deleted primary data file. [2025-10-02T22:10:45.527673] [INFO ] [MAIN ] UZF: Starting full primary refresh. [2025-10-02T22:10:45.878135] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-10. [2025-10-02T22:10:45.910958] [INFO ] [REMOTE ] UZF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:10:46.056159] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-02T22:10:46.673017] [INFO ] [REMOTE ] UZF: Fetching primary data for 2024-12. [2025-10-02T22:10:46.687142] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-02T22:10:46.688780] [INFO ] [REMOTE ] UVV: Full fetch complete (29964 records). [2025-10-02T22:10:46.688857] [DEBUG] [VALIDATOR ] UVV: Validating primary data. [2025-10-02T22:10:47.095177] [DEBUG] [VALIDATOR ] UVV: All expected trading days are present. [2025-10-02T22:10:47.095344] [DEBUG] [VALIDATOR ] UVV: Primary data validation passed. [2025-10-02T22:10:47.096420] [INFO ] [MAIN ] UVV: Fetched primary data is valid. [2025-10-02T22:10:47.096506] [DEBUG] [LOCAL ] UVV: Saving primary data. [2025-10-02T22:10:47.097777] [DEBUG] [LOCAL ] UVV: Trimmed 29964 records to 22653 (keeping 200 days of data) [2025-10-02T22:10:47.243567] [DEBUG] [LOCAL ] UVV: Primary data saved (22653 records). [2025-10-02T22:10:47.243728] [INFO ] [MAIN ] UVV: Full history saved. [2025-10-02T22:10:47.243819] [INFO ] [MAIN ] Update Progress: 2206/2370 symbols completed. UVV took 37.7s. Estimated remaining: 23m 6s. Rate: 7.1 symbols/min [2025-10-02T22:10:47.432309] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-02T22:10:47.435900] [INFO ] [MAIN ] V: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:10:47.475204] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-01. [2025-10-02T22:10:47.497996] [DEBUG] [LOCAL ] V: Loaded 53755 existing records from primary storage. [2025-10-02T22:10:47.498343] [INFO ] [MAIN ] V: Loaded 53755 existing records. [2025-10-02T22:10:47.687065] [WARN ] [MAIN ] V: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:10:47.687310] [INFO ] [MAIN ] V: Wiping existing primary data before full refresh. [2025-10-02T22:10:47.687371] [INFO ] [LOCAL ] V: Starting deletion of primary data. [2025-10-02T22:10:47.687719] [DEBUG] [LOCAL ] V: Deleted primary data file. [2025-10-02T22:10:47.687781] [INFO ] [MAIN ] V: Starting full primary refresh. [2025-10-02T22:10:48.066182] [INFO ] [REMOTE ] V: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:10:48.152127] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-02T22:10:48.273012] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-06. [2025-10-02T22:10:49.072991] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-09. [2025-10-02T22:10:49.696854] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-02T22:10:49.872991] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-02. [2025-10-02T22:10:50.144427] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-02T22:10:50.462267] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-02T22:10:50.673034] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-03. [2025-10-02T22:10:51.421871] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-02T22:10:51.472992] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-07. [2025-10-02T22:10:52.272994] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-04. [2025-10-02T22:10:52.836188] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-02T22:10:53.072977] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-10. [2025-10-02T22:10:53.417218] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-02T22:10:53.431108] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-02T22:10:53.431949] [INFO ] [REMOTE ] UZE: Full fetch complete (10091 records). [2025-10-02T22:10:53.432361] [DEBUG] [VALIDATOR ] UZE: Validating primary data. [2025-10-02T22:10:53.838809] [DEBUG] [VALIDATOR ] UZE: All expected trading days are present. [2025-10-02T22:10:53.838935] [DEBUG] [VALIDATOR ] UZE: Primary data validation passed. [2025-10-02T22:10:53.839280] [INFO ] [MAIN ] UZE: Fetched primary data is valid. [2025-10-02T22:10:53.839349] [DEBUG] [LOCAL ] UZE: Saving primary data. [2025-10-02T22:10:53.840008] [DEBUG] [LOCAL ] UZE: Trimmed 10091 records to 7475 (keeping 200 days of data) [2025-10-02T22:10:53.875220] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-08. [2025-10-02T22:10:53.891894] [DEBUG] [LOCAL ] UZE: Primary data saved (7475 records). [2025-10-02T22:10:53.892049] [INFO ] [MAIN ] UZE: Full history saved. [2025-10-02T22:10:53.892139] [INFO ] [MAIN ] Update Progress: 2207/2370 symbols completed. UZE took 30.1s. Estimated remaining: 22m 57s. Rate: 7.1 symbols/min [2025-10-02T22:10:54.064239] [INFO ] [MAIN ] VAC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:10:54.101780] [DEBUG] [LOCAL ] VAC: Loaded 34393 existing records from primary storage. [2025-10-02T22:10:54.102078] [INFO ] [MAIN ] VAC: Loaded 34393 existing records. [2025-10-02T22:10:54.290299] [WARN ] [MAIN ] VAC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:10:54.290544] [INFO ] [MAIN ] VAC: Wiping existing primary data before full refresh. [2025-10-02T22:10:54.290597] [INFO ] [LOCAL ] VAC: Starting deletion of primary data. [2025-10-02T22:10:54.290948] [DEBUG] [LOCAL ] VAC: Deleted primary data file. [2025-10-02T22:10:54.291012] [INFO ] [MAIN ] VAC: Starting full primary refresh. [2025-10-02T22:10:54.659941] [INFO ] [REMOTE ] VAC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:10:54.672962] [INFO ] [REMOTE ] VAC: Fetching primary data for 2024-12. [2025-10-02T22:10:55.472995] [INFO ] [REMOTE ] V: Fetching primary data for 2024-12. [2025-10-02T22:10:55.818832] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-02T22:10:55.940246] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-02T22:10:56.273007] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-01. [2025-10-02T22:10:57.073003] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-05. [2025-10-02T22:10:57.587591] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-02T22:10:57.636175] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-02T22:10:57.719473] [INFO ] [REMOTE ] V: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-10-02T22:10:57.873005] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-02. [2025-10-02T22:10:58.673015] [INFO ] [REMOTE ] V: Fetching primary data for 2025-01. [2025-10-02T22:10:59.209245] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-02T22:10:59.473008] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-06. [2025-10-02T22:11:00.130903] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-02T22:11:00.273036] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-09. [2025-10-02T22:11:00.835390] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-02T22:11:01.073026] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-03. [2025-10-02T22:11:01.845226] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-02T22:11:01.872969] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-10. [2025-10-02T22:11:02.339348] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-02T22:11:02.672993] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-07. [2025-10-02T22:11:03.229520] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-02T22:11:03.244737] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-02T22:11:03.247919] [INFO ] [REMOTE ] UWMC: Full fetch complete (75618 records). [2025-10-02T22:11:03.248053] [DEBUG] [VALIDATOR ] UWMC: Validating primary data. [2025-10-02T22:11:03.479970] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-04. [2025-10-02T22:11:03.689510] [DEBUG] [VALIDATOR ] UWMC: All expected trading days are present. [2025-10-02T22:11:03.689594] [DEBUG] [VALIDATOR ] UWMC: Primary data validation passed. [2025-10-02T22:11:03.690802] [INFO ] [MAIN ] UWMC: Fetched primary data is valid. [2025-10-02T22:11:03.690868] [DEBUG] [LOCAL ] UWMC: Saving primary data. [2025-10-02T22:11:03.692458] [DEBUG] [LOCAL ] UWMC: Trimmed 75618 records to 53165 (keeping 200 days of data) [2025-10-02T22:11:04.017809] [DEBUG] [LOCAL ] UWMC: Primary data saved (53165 records). [2025-10-02T22:11:04.017982] [INFO ] [MAIN ] UWMC: Full history saved. [2025-10-02T22:11:04.018076] [INFO ] [MAIN ] Update Progress: 2208/2370 symbols completed. UWMC took 50.4s. Estimated remaining: 22m 49s. Rate: 7.1 symbols/min [2025-10-02T22:11:04.202054] [INFO ] [MAIN ] VAL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:11:04.247239] [DEBUG] [LOCAL ] VAL: Loaded 50306 existing records from primary storage. [2025-10-02T22:11:04.247576] [INFO ] [MAIN ] VAL: Loaded 50306 existing records. [2025-10-02T22:11:04.273021] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-08. [2025-10-02T22:11:04.448058] [WARN ] [MAIN ] VAL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:11:04.448322] [INFO ] [MAIN ] VAL: Wiping existing primary data before full refresh. [2025-10-02T22:11:04.448378] [INFO ] [LOCAL ] VAL: Starting deletion of primary data. [2025-10-02T22:11:04.448713] [DEBUG] [LOCAL ] VAL: Deleted primary data file. [2025-10-02T22:11:04.448774] [INFO ] [MAIN ] VAL: Starting full primary refresh. [2025-10-02T22:11:04.867598] [INFO ] [REMOTE ] VAL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:11:04.893236] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-02T22:11:05.072987] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-05. [2025-10-02T22:11:05.193147] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-02T22:11:05.873047] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-09. [2025-10-02T22:11:06.387089] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-02T22:11:06.500494] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-02T22:11:06.673045] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-06. [2025-10-02T22:11:07.473012] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-10. [2025-10-02T22:11:07.895082] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-02T22:11:07.896026] [INFO ] [REMOTE ] UZF: Full fetch complete (8871 records). [2025-10-02T22:11:07.896100] [DEBUG] [VALIDATOR ] UZF: Validating primary data. [2025-10-02T22:11:08.276083] [INFO ] [REMOTE ] VAL: Fetching primary data for 2024-12. [2025-10-02T22:11:08.336043] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-02T22:11:08.346680] [DEBUG] [VALIDATOR ] UZF: All expected trading days are present. [2025-10-02T22:11:08.346989] [DEBUG] [VALIDATOR ] UZF: Primary data validation passed. [2025-10-02T22:11:08.347269] [INFO ] [MAIN ] UZF: Fetched primary data is valid. [2025-10-02T22:11:08.354809] [DEBUG] [LOCAL ] UZF: Saving primary data. [2025-10-02T22:11:08.356368] [DEBUG] [LOCAL ] UZF: Trimmed 8871 records to 6493 (keeping 200 days of data) [2025-10-02T22:11:08.398795] [DEBUG] [LOCAL ] UZF: Primary data saved (6493 records). [2025-10-02T22:11:08.398937] [INFO ] [MAIN ] UZF: Full history saved. [2025-10-02T22:11:08.399032] [INFO ] [MAIN ] Update Progress: 2209/2370 symbols completed. UZF took 23.3s. Estimated remaining: 22m 40s. Rate: 7.1 symbols/min [2025-10-02T22:11:08.596922] [INFO ] [MAIN ] VALE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:11:08.655062] [DEBUG] [LOCAL ] VALE: Loaded 53694 existing records from primary storage. [2025-10-02T22:11:08.655406] [INFO ] [MAIN ] VALE: Loaded 53694 existing records. [2025-10-02T22:11:08.853547] [WARN ] [MAIN ] VALE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:11:08.853827] [INFO ] [MAIN ] VALE: Wiping existing primary data before full refresh. [2025-10-02T22:11:08.853879] [INFO ] [LOCAL ] VALE: Starting deletion of primary data. [2025-10-02T22:11:08.854461] [DEBUG] [LOCAL ] VALE: Deleted primary data file. [2025-10-02T22:11:08.854522] [INFO ] [MAIN ] VALE: Starting full primary refresh. [2025-10-02T22:11:09.084057] [INFO ] [REMOTE ] V: Fetching primary data for 2025-02. [2025-10-02T22:11:09.241759] [INFO ] [REMOTE ] VALE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:11:09.872998] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-07. [2025-10-02T22:11:10.017037] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-02T22:11:10.673031] [INFO ] [REMOTE ] VALE: Fetching primary data for 2024-12. [2025-10-02T22:11:11.120609] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-02T22:11:11.473021] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-08. [2025-10-02T22:11:11.520716] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-02 (2.44 seconds). [2025-10-02T22:11:12.273020] [INFO ] [REMOTE ] V: Fetching primary data for 2025-03. [2025-10-02T22:11:12.865597] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-02T22:11:12.908185] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-10-02T22:11:13.073002] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-01. [2025-10-02T22:11:13.873016] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-09. [2025-10-02T22:11:14.492826] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-02T22:11:14.673011] [INFO ] [REMOTE ] V: Fetching primary data for 2025-04. [2025-10-02T22:11:15.177003] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-02T22:11:15.292892] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-02T22:11:15.472998] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-02. [2025-10-02T22:11:16.273038] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-10. [2025-10-02T22:11:16.780916] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-02T22:11:17.072975] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-01. [2025-10-02T22:11:17.281681] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-02T22:11:17.285913] [INFO ] [REMOTE ] VAC: Full fetch complete (48296 records). [2025-10-02T22:11:17.286007] [DEBUG] [VALIDATOR ] VAC: Validating primary data. [2025-10-02T22:11:17.715165] [DEBUG] [VALIDATOR ] VAC: All expected trading days are present. [2025-10-02T22:11:17.715268] [DEBUG] [VALIDATOR ] VAC: Primary data validation passed. [2025-10-02T22:11:17.716384] [INFO ] [MAIN ] VAC: Fetched primary data is valid. [2025-10-02T22:11:17.716475] [DEBUG] [LOCAL ] VAC: Saving primary data. [2025-10-02T22:11:17.746814] [DEBUG] [LOCAL ] VAC: Trimmed 48296 records to 34605 (keeping 200 days of data) [2025-10-02T22:11:17.746664] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-10-02T22:11:17.873492] [INFO ] [REMOTE ] V: Fetching primary data for 2025-05. [2025-10-02T22:11:17.991371] [DEBUG] [LOCAL ] VAC: Primary data saved (34605 records). [2025-10-02T22:11:17.991527] [INFO ] [MAIN ] VAC: Full history saved. [2025-10-02T22:11:17.992517] [INFO ] [MAIN ] Update Progress: 2210/2370 symbols completed. VAC took 24.1s. Estimated remaining: 22m 32s. Rate: 7.1 symbols/min [2025-10-02T22:11:18.164968] [INFO ] [MAIN ] VATE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:11:18.173442] [DEBUG] [LOCAL ] VATE: Loaded 5334 existing records from primary storage. [2025-10-02T22:11:18.173711] [INFO ] [MAIN ] VATE: Loaded 5334 existing records. [2025-10-02T22:11:18.356138] [WARN ] [MAIN ] VATE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:11:18.356363] [INFO ] [MAIN ] VATE: Wiping existing primary data before full refresh. [2025-10-02T22:11:18.356415] [INFO ] [LOCAL ] VATE: Starting deletion of primary data. [2025-10-02T22:11:18.356667] [DEBUG] [LOCAL ] VATE: Deleted primary data file. [2025-10-02T22:11:18.356735] [INFO ] [MAIN ] VATE: Starting full primary refresh. [2025-10-02T22:11:18.678430] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-03. [2025-10-02T22:11:18.764875] [INFO ] [REMOTE ] VATE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:11:18.861084] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-02T22:11:19.473035] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-02. [2025-10-02T22:11:19.793990] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-02T22:11:20.273035] [INFO ] [REMOTE ] V: Fetching primary data for 2025-06. [2025-10-02T22:11:20.880610] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-02T22:11:20.968939] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-02T22:11:21.073045] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-03. [2025-10-02T22:11:21.873044] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-04. [2025-10-02T22:11:22.394684] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-02T22:11:22.673043] [INFO ] [REMOTE ] V: Fetching primary data for 2025-07. [2025-10-02T22:11:22.894830] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-02T22:11:23.473011] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-04. [2025-10-02T22:11:24.106628] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-02T22:11:24.273025] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-05. [2025-10-02T22:11:25.041983] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-10-02T22:11:25.072982] [INFO ] [REMOTE ] VATE: Fetching primary data for 2024-12. [2025-10-02T22:11:25.129372] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-02T22:11:25.535891] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-02T22:11:25.872992] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-05. [2025-10-02T22:11:26.379339] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-02T22:11:26.673027] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-06. [2025-10-02T22:11:27.296440] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-02T22:11:27.473028] [INFO ] [REMOTE ] V: Fetching primary data for 2025-08. [2025-10-02T22:11:28.273007] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-06. [2025-10-02T22:11:28.782439] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-02T22:11:29.072970] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-01. [2025-10-02T22:11:29.190923] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-02T22:11:29.654638] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-02T22:11:29.873008] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-07. [2025-10-02T22:11:30.125805] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-02T22:11:30.673072] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-07. [2025-10-02T22:11:31.472989] [INFO ] [REMOTE ] V: Fetching primary data for 2025-09. [2025-10-02T22:11:31.522913] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-02T22:11:32.273029] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-08. [2025-10-02T22:11:32.722598] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-02T22:11:33.073007] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-08. [2025-10-02T22:11:33.764397] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-02T22:11:33.814785] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-10-02T22:11:33.872995] [INFO ] [REMOTE ] V: Fetching primary data for 2025-10. [2025-10-02T22:11:34.673011] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-09. [2025-10-02T22:11:35.092834] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-02T22:11:35.472997] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-09. [2025-10-02T22:11:35.768355] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-02T22:11:35.770509] [INFO ] [REMOTE ] V: Full fetch complete (77822 records). [2025-10-02T22:11:35.770698] [DEBUG] [VALIDATOR ] V: Validating primary data. [2025-10-02T22:11:36.188725] [DEBUG] [VALIDATOR ] V: All expected trading days are present. [2025-10-02T22:11:36.188863] [DEBUG] [VALIDATOR ] V: Primary data validation passed. [2025-10-02T22:11:36.190421] [INFO ] [MAIN ] V: Fetched primary data is valid. [2025-10-02T22:11:36.190579] [DEBUG] [LOCAL ] V: Saving primary data. [2025-10-02T22:11:36.192402] [DEBUG] [LOCAL ] V: Trimmed 77822 records to 54145 (keeping 200 days of data) [2025-10-02T22:11:36.295804] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-02. [2025-10-02T22:11:36.469309] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-02T22:11:36.608247] [DEBUG] [LOCAL ] V: Primary data saved (54145 records). [2025-10-02T22:11:36.608398] [INFO ] [MAIN ] V: Full history saved. [2025-10-02T22:11:36.608482] [INFO ] [MAIN ] Update Progress: 2211/2370 symbols completed. V took 49.4s. Estimated remaining: 22m 24s. Rate: 7.1 symbols/min [2025-10-02T22:11:36.804230] [INFO ] [MAIN ] VBF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:11:36.815065] [DEBUG] [LOCAL ] VBF: Loaded 6911 existing records from primary storage. [2025-10-02T22:11:36.815307] [INFO ] [MAIN ] VBF: Loaded 6911 existing records. [2025-10-02T22:11:37.020612] [WARN ] [MAIN ] VBF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:11:37.021222] [INFO ] [MAIN ] VBF: Wiping existing primary data before full refresh. [2025-10-02T22:11:37.030159] [INFO ] [LOCAL ] VBF: Starting deletion of primary data. [2025-10-02T22:11:37.031335] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-02T22:11:37.031379] [DEBUG] [LOCAL ] VBF: Deleted primary data file. [2025-10-02T22:11:37.034756] [INFO ] [MAIN ] VBF: Starting full primary refresh. [2025-10-02T22:11:37.078259] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-10. [2025-10-02T22:11:37.474409] [INFO ] [REMOTE ] VBF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:11:37.477245] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-02T22:11:37.873017] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-03. [2025-10-02T22:11:38.419806] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-02T22:11:38.432193] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-02T22:11:38.435150] [INFO ] [REMOTE ] VAL: Full fetch complete (73237 records). [2025-10-02T22:11:38.435327] [DEBUG] [VALIDATOR ] VAL: Validating primary data. [2025-10-02T22:11:38.678146] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-04. [2025-10-02T22:11:38.889943] [DEBUG] [VALIDATOR ] VAL: All expected trading days are present. [2025-10-02T22:11:38.890061] [DEBUG] [VALIDATOR ] VAL: Primary data validation passed. [2025-10-02T22:11:38.891588] [INFO ] [MAIN ] VAL: Fetched primary data is valid. [2025-10-02T22:11:38.891680] [DEBUG] [LOCAL ] VAL: Saving primary data. [2025-10-02T22:11:38.893855] [DEBUG] [LOCAL ] VAL: Trimmed 73237 records to 50658 (keeping 200 days of data) [2025-10-02T22:11:39.208914] [DEBUG] [LOCAL ] VAL: Primary data saved (50658 records). [2025-10-02T22:11:39.209060] [INFO ] [MAIN ] VAL: Full history saved. [2025-10-02T22:11:39.209156] [INFO ] [MAIN ] Update Progress: 2212/2370 symbols completed. VAL took 35.2s. Estimated remaining: 22m 15s. Rate: 7.1 symbols/min [2025-10-02T22:11:39.396453] [INFO ] [MAIN ] VCV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:11:39.413931] [DEBUG] [LOCAL ] VCV: Loaded 13723 existing records from primary storage. [2025-10-02T22:11:39.414241] [INFO ] [MAIN ] VCV: Loaded 13723 existing records. [2025-10-02T22:11:39.480050] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-10. [2025-10-02T22:11:39.529024] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-02T22:11:39.616381] [WARN ] [MAIN ] VCV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:11:39.616707] [INFO ] [MAIN ] VCV: Wiping existing primary data before full refresh. [2025-10-02T22:11:39.616767] [INFO ] [LOCAL ] VCV: Starting deletion of primary data. [2025-10-02T22:11:39.616980] [DEBUG] [LOCAL ] VCV: Deleted primary data file. [2025-10-02T22:11:39.617052] [INFO ] [MAIN ] VCV: Starting full primary refresh. [2025-10-02T22:11:40.005451] [INFO ] [REMOTE ] VCV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:11:40.273036] [INFO ] [REMOTE ] VBF: Fetching primary data for 2024-12. [2025-10-02T22:11:40.651130] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-10-02T22:11:41.073014] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-01. [2025-10-02T22:11:41.121428] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-02T22:11:41.124814] [INFO ] [REMOTE ] VALE: Full fetch complete (77763 records). [2025-10-02T22:11:41.124954] [DEBUG] [VALIDATOR ] VALE: Validating primary data. [2025-10-02T22:11:41.555253] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-02T22:11:41.592794] [DEBUG] [VALIDATOR ] VALE: All expected trading days are present. [2025-10-02T22:11:41.592914] [DEBUG] [VALIDATOR ] VALE: Primary data validation passed. [2025-10-02T22:11:41.594506] [INFO ] [MAIN ] VALE: Fetched primary data is valid. [2025-10-02T22:11:41.594580] [DEBUG] [LOCAL ] VALE: Saving primary data. [2025-10-02T22:11:41.598280] [DEBUG] [LOCAL ] VALE: Trimmed 77763 records to 54083 (keeping 200 days of data) [2025-10-02T22:11:41.904739] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-05. [2025-10-02T22:11:41.960693] [DEBUG] [LOCAL ] VALE: Primary data saved (54083 records). [2025-10-02T22:11:41.960850] [INFO ] [MAIN ] VALE: Full history saved. [2025-10-02T22:11:41.960932] [INFO ] [MAIN ] Update Progress: 2213/2370 symbols completed. VALE took 33.6s. Estimated remaining: 22m 7s. Rate: 7.1 symbols/min [2025-10-02T22:11:42.145425] [INFO ] [MAIN ] VEEV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:11:42.193130] [DEBUG] [LOCAL ] VEEV: Loaded 47055 existing records from primary storage. [2025-10-02T22:11:42.193509] [INFO ] [MAIN ] VEEV: Loaded 47055 existing records. [2025-10-02T22:11:42.381922] [WARN ] [MAIN ] VEEV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:11:42.382131] [INFO ] [MAIN ] VEEV: Wiping existing primary data before full refresh. [2025-10-02T22:11:42.382181] [INFO ] [LOCAL ] VEEV: Starting deletion of primary data. [2025-10-02T22:11:42.382445] [DEBUG] [LOCAL ] VEEV: Deleted primary data file. [2025-10-02T22:11:42.382505] [INFO ] [MAIN ] VEEV: Starting full primary refresh. [2025-10-02T22:11:42.675473] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-02. [2025-10-02T22:11:42.729178] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-02T22:11:42.776484] [INFO ] [REMOTE ] VEEV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:11:43.472990] [INFO ] [REMOTE ] VCV: Fetching primary data for 2024-12. [2025-10-02T22:11:43.487529] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-02T22:11:44.272994] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-06. [2025-10-02T22:11:44.556787] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-02T22:11:44.934876] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-02T22:11:45.073003] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-01. [2025-10-02T22:11:45.873934] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-07. [2025-10-02T22:11:45.877135] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-02T22:11:46.411148] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-02T22:11:46.673008] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-02. [2025-10-02T22:11:47.360429] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-02T22:11:47.473030] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2024-12. [2025-10-02T22:11:48.272998] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-03. [2025-10-02T22:11:48.910574] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-02T22:11:49.072977] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-08. [2025-10-02T22:11:49.239015] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-02T22:11:49.732824] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-02T22:11:49.872991] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-04. [2025-10-02T22:11:50.527583] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-02T22:11:50.672983] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-01. [2025-10-02T22:11:51.473012] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-03. [2025-10-02T22:11:52.275754] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-09. [2025-10-02T22:11:52.282281] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-02T22:11:52.342825] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-02T22:11:52.923949] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-02T22:11:53.073009] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-04. [2025-10-02T22:11:53.873068] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-10. [2025-10-02T22:11:54.076636] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-02T22:11:54.211786] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-02T22:11:54.212621] [INFO ] [REMOTE ] VATE: Full fetch complete (10496 records). [2025-10-02T22:11:54.212722] [DEBUG] [VALIDATOR ] VATE: Validating primary data. [2025-10-02T22:11:54.599117] [DEBUG] [VALIDATOR ] VATE: All expected trading days are present. [2025-10-02T22:11:54.599236] [DEBUG] [VALIDATOR ] VATE: Primary data validation passed. [2025-10-02T22:11:54.599522] [INFO ] [MAIN ] VATE: Fetched primary data is valid. [2025-10-02T22:11:54.599566] [DEBUG] [LOCAL ] VATE: Saving primary data. [2025-10-02T22:11:54.600037] [DEBUG] [LOCAL ] VATE: Trimmed 10496 records to 5350 (keeping 200 days of data) [2025-10-02T22:11:54.632306] [DEBUG] [LOCAL ] VATE: Primary data saved (5350 records). [2025-10-02T22:11:54.632449] [INFO ] [MAIN ] VATE: Full history saved. [2025-10-02T22:11:54.632619] [INFO ] [MAIN ] Update Progress: 2214/2370 symbols completed. VATE took 36.6s. Estimated remaining: 21m 58s. Rate: 7.1 symbols/min [2025-10-02T22:11:54.678114] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-05. [2025-10-02T22:11:54.843431] [INFO ] [MAIN ] VEL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:11:54.859313] [DEBUG] [LOCAL ] VEL: Loaded 12787 existing records from primary storage. [2025-10-02T22:11:54.859566] [INFO ] [MAIN ] VEL: Loaded 12787 existing records. [2025-10-02T22:11:55.054569] [WARN ] [MAIN ] VEL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:11:55.054837] [INFO ] [MAIN ] VEL: Wiping existing primary data before full refresh. [2025-10-02T22:11:55.054889] [INFO ] [LOCAL ] VEL: Starting deletion of primary data. [2025-10-02T22:11:55.055066] [DEBUG] [LOCAL ] VEL: Deleted primary data file. [2025-10-02T22:11:55.055183] [INFO ] [MAIN ] VEL: Starting full primary refresh. [2025-10-02T22:11:55.373637] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-02T22:11:55.455480] [INFO ] [REMOTE ] VEL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:11:55.472971] [INFO ] [REMOTE ] VEL: Fetching primary data for 2024-12. [2025-10-02T22:11:56.004261] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-02T22:11:56.273033] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-05. [2025-10-02T22:11:57.070950] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-02T22:11:57.073728] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-02. [2025-10-02T22:11:57.873012] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-01. [2025-10-02T22:11:58.595412] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-02T22:11:58.672981] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-02. [2025-10-02T22:11:58.761366] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-02T22:11:59.473066] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-06. [2025-10-02T22:11:59.483638] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-02T22:12:00.273037] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-06. [2025-10-02T22:12:00.453599] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-02T22:12:00.812742] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-02T22:12:01.073007] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-07. [2025-10-02T22:12:01.705043] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-02T22:12:01.872984] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-08. [2025-10-02T22:12:02.672993] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-03. [2025-10-02T22:12:02.889298] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-02T22:12:03.473062] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-03. [2025-10-02T22:12:03.502141] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-02T22:12:04.272997] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-07. [2025-10-02T22:12:05.061210] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-02T22:12:05.072947] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-08. [2025-10-02T22:12:05.170335] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-02T22:12:05.616023] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-02T22:12:05.873048] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-09. [2025-10-02T22:12:06.673007] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-09. [2025-10-02T22:12:06.848814] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-02T22:12:07.091572] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-02T22:12:07.473009] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-04. [2025-10-02T22:12:08.273021] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-04. [2025-10-02T22:12:08.915448] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-02T22:12:09.073022] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-10. [2025-10-02T22:12:09.445705] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-02T22:12:09.644055] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-02T22:12:09.645075] [INFO ] [REMOTE ] VCV: Full fetch complete (19408 records). [2025-10-02T22:12:09.645149] [DEBUG] [VALIDATOR ] VCV: Validating primary data. [2025-10-02T22:12:09.878087] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-10. [2025-10-02T22:12:10.035991] [DEBUG] [VALIDATOR ] VCV: All expected trading days are present. [2025-10-02T22:12:10.036076] [DEBUG] [VALIDATOR ] VCV: Primary data validation passed. [2025-10-02T22:12:10.036538] [INFO ] [MAIN ] VCV: Fetched primary data is valid. [2025-10-02T22:12:10.036580] [DEBUG] [LOCAL ] VCV: Saving primary data. [2025-10-02T22:12:10.037354] [DEBUG] [LOCAL ] VCV: Trimmed 19408 records to 13773 (keeping 200 days of data) [2025-10-02T22:12:10.127488] [DEBUG] [LOCAL ] VCV: Primary data saved (13773 records). [2025-10-02T22:12:10.127631] [INFO ] [MAIN ] VCV: Full history saved. [2025-10-02T22:12:10.127776] [INFO ] [MAIN ] Update Progress: 2215/2370 symbols completed. VCV took 30.9s. Estimated remaining: 21m 50s. Rate: 7.1 symbols/min [2025-10-02T22:12:10.310628] [INFO ] [MAIN ] VET: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:12:10.350786] [DEBUG] [LOCAL ] VET: Loaded 43905 existing records from primary storage. [2025-10-02T22:12:10.351086] [INFO ] [MAIN ] VET: Loaded 43905 existing records. [2025-10-02T22:12:10.540915] [WARN ] [MAIN ] VET: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:12:10.541134] [INFO ] [MAIN ] VET: Wiping existing primary data before full refresh. [2025-10-02T22:12:10.541183] [INFO ] [LOCAL ] VET: Starting deletion of primary data. [2025-10-02T22:12:10.541419] [DEBUG] [LOCAL ] VET: Deleted primary data file. [2025-10-02T22:12:10.541479] [INFO ] [MAIN ] VET: Starting full primary refresh. [2025-10-02T22:12:10.626745] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-02T22:12:10.654141] [INFO ] [REMOTE ] VBF: Full fetch complete (10464 records). [2025-10-02T22:12:10.657449] [DEBUG] [VALIDATOR ] VBF: Validating primary data. [2025-10-02T22:12:10.674192] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-05. [2025-10-02T22:12:11.262717] [INFO ] [REMOTE ] VET: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:12:11.352937] [DEBUG] [VALIDATOR ] VBF: All expected trading days are present. [2025-10-02T22:12:11.353018] [DEBUG] [VALIDATOR ] VBF: Primary data validation passed. [2025-10-02T22:12:11.353304] [INFO ] [MAIN ] VBF: Fetched primary data is valid. [2025-10-02T22:12:11.353346] [DEBUG] [LOCAL ] VBF: Saving primary data. [2025-10-02T22:12:11.353821] [DEBUG] [LOCAL ] VBF: Trimmed 10464 records to 6990 (keeping 200 days of data) [2025-10-02T22:12:11.399270] [DEBUG] [LOCAL ] VBF: Primary data saved (6990 records). [2025-10-02T22:12:11.399386] [INFO ] [MAIN ] VBF: Full history saved. [2025-10-02T22:12:11.399469] [INFO ] [MAIN ] Update Progress: 2216/2370 symbols completed. VBF took 34.8s. Estimated remaining: 21m 41s. Rate: 7.1 symbols/min [2025-10-02T22:12:11.473088] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-05. [2025-10-02T22:12:11.596353] [INFO ] [MAIN ] VFC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:12:11.652708] [DEBUG] [LOCAL ] VFC: Loaded 53610 existing records from primary storage. [2025-10-02T22:12:11.653087] [INFO ] [MAIN ] VFC: Loaded 53610 existing records. [2025-10-02T22:12:11.884597] [WARN ] [MAIN ] VFC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:12:11.884797] [INFO ] [MAIN ] VFC: Wiping existing primary data before full refresh. [2025-10-02T22:12:11.884844] [INFO ] [LOCAL ] VFC: Starting deletion of primary data. [2025-10-02T22:12:11.885089] [DEBUG] [LOCAL ] VFC: Deleted primary data file. [2025-10-02T22:12:11.885185] [INFO ] [MAIN ] VFC: Starting full primary refresh. [2025-10-02T22:12:12.286783] [INFO ] [REMOTE ] VFC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:12:12.280599] [INFO ] [REMOTE ] VET: Fetching primary data for 2024-12. [2025-10-02T22:12:12.329449] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-02T22:12:12.617872] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-02T22:12:13.073055] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-06. [2025-10-02T22:12:13.620091] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-02T22:12:13.873033] [INFO ] [REMOTE ] VFC: Fetching primary data for 2024-12. [2025-10-02T22:12:14.610333] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-02T22:12:14.673019] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-01. [2025-10-02T22:12:15.473029] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-07. [2025-10-02T22:12:15.847020] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-02T22:12:16.273025] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-01. [2025-10-02T22:12:16.306158] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-02T22:12:17.072981] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-02. [2025-10-02T22:12:17.275513] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-02T22:12:17.873015] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-06. [2025-10-02T22:12:18.126207] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-02T22:12:18.240304] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-02T22:12:18.672995] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-02. [2025-10-02T22:12:18.806564] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-02T22:12:19.473019] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-08. [2025-10-02T22:12:20.272984] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-07. [2025-10-02T22:12:20.473245] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-02T22:12:21.073017] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-03. [2025-10-02T22:12:21.236682] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-02T22:12:21.279465] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-02T22:12:21.873006] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-09. [2025-10-02T22:12:22.673053] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-08. [2025-10-02T22:12:22.981126] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-02T22:12:23.382338] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-02T22:12:23.448898] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-02T22:12:23.472983] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-09. [2025-10-02T22:12:24.217028] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-02T22:12:24.273013] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-10. [2025-10-02T22:12:25.073004] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-10. [2025-10-02T22:12:25.510856] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-02T22:12:25.512890] [INFO ] [REMOTE ] VEEV: Full fetch complete (68230 records). [2025-10-02T22:12:25.513041] [DEBUG] [VALIDATOR ] VEEV: Validating primary data. [2025-10-02T22:12:25.642058] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-02T22:12:25.658770] [INFO ] [REMOTE ] VEL: Full fetch complete (17081 records). [2025-10-02T22:12:25.677870] [DEBUG] [VALIDATOR ] VEL: Validating primary data. [2025-10-02T22:12:25.872976] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-04. [2025-10-02T22:12:26.238321] [DEBUG] [VALIDATOR ] VEEV: All expected trading days are present. [2025-10-02T22:12:26.243586] [DEBUG] [VALIDATOR ] VEEV: Primary data validation passed. [2025-10-02T22:12:26.266539] [INFO ] [MAIN ] VEEV: Fetched primary data is valid. [2025-10-02T22:12:26.269780] [DEBUG] [LOCAL ] VEEV: Saving primary data. [2025-10-02T22:12:26.336191] [DEBUG] [LOCAL ] VEEV: Trimmed 68230 records to 47405 (keeping 200 days of data) [2025-10-02T22:12:26.364286] [DEBUG] [VALIDATOR ] VEL: All expected trading days are present. [2025-10-02T22:12:26.364381] [DEBUG] [VALIDATOR ] VEL: Primary data validation passed. [2025-10-02T22:12:26.364585] [INFO ] [MAIN ] VEL: Fetched primary data is valid. [2025-10-02T22:12:26.364630] [DEBUG] [LOCAL ] VEL: Saving primary data. [2025-10-02T22:12:26.365265] [DEBUG] [LOCAL ] VEL: Trimmed 17081 records to 12854 (keeping 200 days of data) [2025-10-02T22:12:26.550579] [DEBUG] [LOCAL ] VEL: Primary data saved (12854 records). [2025-10-02T22:12:26.552737] [INFO ] [MAIN ] VEL: Full history saved. [2025-10-02T22:12:26.552875] [INFO ] [MAIN ] Update Progress: 2217/2370 symbols completed. VEL took 31.9s. Estimated remaining: 21m 33s. Rate: 7.1 symbols/min [2025-10-02T22:12:26.675875] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-03. [2025-10-02T22:12:26.764003] [INFO ] [MAIN ] VG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:12:26.765829] [DEBUG] [LOCAL ] VG: No existing data file found in primary storage. [2025-10-02T22:12:26.765912] [WARN ] [MAIN ] VG: No existing data found, performing full refresh instead. [2025-10-02T22:12:26.766072] [INFO ] [MAIN ] VG: Wiping existing primary data before full refresh. [2025-10-02T22:12:26.766395] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-10-02T22:12:26.766832] [DEBUG] [LOCAL ] VG: No primary data file found to delete. [2025-10-02T22:12:26.767213] [INFO ] [MAIN ] VG: Starting full primary refresh. [2025-10-02T22:12:27.280349] [INFO ] [REMOTE ] VG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:12:27.361243] [DEBUG] [LOCAL ] VEEV: Primary data saved (47405 records). [2025-10-02T22:12:27.361394] [INFO ] [MAIN ] VEEV: Full history saved. [2025-10-02T22:12:27.361518] [INFO ] [MAIN ] Update Progress: 2218/2370 symbols completed. VEEV took 45.4s. Estimated remaining: 21m 24s. Rate: 7.1 symbols/min [2025-10-02T22:12:27.478097] [INFO ] [REMOTE ] VG: Fetching primary data for 2024-12. [2025-10-02T22:12:27.542459] [INFO ] [MAIN ] VGI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:12:27.551122] [DEBUG] [LOCAL ] VGI: Loaded 5152 existing records from primary storage. [2025-10-02T22:12:27.551834] [INFO ] [MAIN ] VGI: Loaded 5152 existing records. [2025-10-02T22:12:27.753715] [WARN ] [MAIN ] VGI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:12:27.754027] [INFO ] [MAIN ] VGI: Wiping existing primary data before full refresh. [2025-10-02T22:12:27.754316] [INFO ] [LOCAL ] VGI: Starting deletion of primary data. [2025-10-02T22:12:27.754596] [DEBUG] [LOCAL ] VGI: Deleted primary data file. [2025-10-02T22:12:27.754694] [INFO ] [MAIN ] VGI: Starting full primary refresh. [2025-10-02T22:12:27.777531] [DEBUG] [REMOTE ] VG: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T22:12:27.827404] [WARN ] [REMOTE ] VG: No data returned for month 2024-12 [2025-10-02T22:12:27.827688] [FATAL] [REMOTE ] VG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T22:12:27.865900] [FATAL] [MAIN ] VG: Failed to fetch primary data. [2025-10-02T22:12:27.871585] [WARN ] [MAIN ] VG: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T22:12:27.882754] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-10-02T22:12:27.917534] [DEBUG] [LOCAL ] VG: No primary data file found to delete. [2025-10-02T22:12:27.923217] [INFO ] [LOCAL ] VG: Starting deletion of derivative data. [2025-10-02T22:12:27.960635] [DEBUG] [LOCAL ] VG: No derivative data file found to delete. [2025-10-02T22:12:27.962335] [INFO ] [MAIN ] Update Progress: 2219/2370 symbols completed. VG took 1.4s. Estimated remaining: 21m 16s. Rate: 7.1 symbols/min [2025-10-02T22:12:28.336470] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-02T22:12:28.363098] [INFO ] [MAIN ] VGM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:12:28.411043] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-04. [2025-10-02T22:12:28.481026] [INFO ] [REMOTE ] VGI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:12:28.521059] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-04 (2.65 seconds). [2025-10-02T22:12:28.539955] [DEBUG] [LOCAL ] VGM: Loaded 18325 existing records from primary storage. [2025-10-02T22:12:28.540235] [INFO ] [MAIN ] VGM: Loaded 18325 existing records. [2025-10-02T22:12:28.733896] [WARN ] [MAIN ] VGM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:12:28.734223] [INFO ] [MAIN ] VGM: Wiping existing primary data before full refresh. [2025-10-02T22:12:28.734278] [INFO ] [LOCAL ] VGM: Starting deletion of primary data. [2025-10-02T22:12:28.734608] [DEBUG] [LOCAL ] VGM: Deleted primary data file. [2025-10-02T22:12:28.734707] [INFO ] [MAIN ] VGM: Starting full primary refresh. [2025-10-02T22:12:29.086539] [INFO ] [REMOTE ] VGI: Fetching primary data for 2024-12. [2025-10-02T22:12:29.132998] [INFO ] [REMOTE ] VGM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:12:29.711779] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-02T22:12:29.882571] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-05. [2025-10-02T22:12:29.890716] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-02T22:12:30.673038] [INFO ] [REMOTE ] VGM: Fetching primary data for 2024-12. [2025-10-02T22:12:31.345832] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-02T22:12:31.472987] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-01. [2025-10-02T22:12:31.904522] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-02T22:12:32.185365] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-02T22:12:32.273011] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-05. [2025-10-02T22:12:33.073019] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-01. [2025-10-02T22:12:33.873014] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-02. [2025-10-02T22:12:33.911126] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-02T22:12:34.046394] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-02T22:12:34.459191] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-02T22:12:34.673035] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-02. [2025-10-02T22:12:35.473010] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-06. [2025-10-02T22:12:35.712112] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-02T22:12:36.273040] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-06. [2025-10-02T22:12:37.073036] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-03. [2025-10-02T22:12:37.327424] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-02T22:12:37.674326] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-02T22:12:37.878191] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-03. [2025-10-02T22:12:37.900826] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-02T22:12:38.673030] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-04. [2025-10-02T22:12:38.895106] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-02T22:12:39.069722] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-02T22:12:39.473099] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-05. [2025-10-02T22:12:39.971797] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-02T22:12:40.273076] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-07. [2025-10-02T22:12:41.073018] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-06. [2025-10-02T22:12:41.606485] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-02T22:12:41.872318] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-02T22:12:41.873532] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-07. [2025-10-02T22:12:42.673035] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-08. [2025-10-02T22:12:43.473077] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-04. [2025-10-02T22:12:43.955024] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-02T22:12:44.279898] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-07. [2025-10-02T22:12:44.300600] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-02T22:12:44.312938] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-02T22:12:44.942681] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-02T22:12:45.072997] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-08. [2025-10-02T22:12:45.496523] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-02T22:12:45.873003] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-09. [2025-10-02T22:12:46.673490] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-02T22:12:46.673029] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-08. [2025-10-02T22:12:47.473019] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-10. [2025-10-02T22:12:47.841036] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-02T22:12:47.841997] [INFO ] [REMOTE ] VGI: Full fetch complete (7738 records). [2025-10-02T22:12:47.842070] [DEBUG] [VALIDATOR ] VGI: Validating primary data. [2025-10-02T22:12:48.280936] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-05. [2025-10-02T22:12:48.282372] [DEBUG] [VALIDATOR ] VGI: All expected trading days are present. [2025-10-02T22:12:48.282472] [DEBUG] [VALIDATOR ] VGI: Primary data validation passed. [2025-10-02T22:12:48.282828] [INFO ] [MAIN ] VGI: Fetched primary data is valid. [2025-10-02T22:12:48.282896] [DEBUG] [LOCAL ] VGI: Saving primary data. [2025-10-02T22:12:48.283687] [DEBUG] [LOCAL ] VGI: Trimmed 7738 records to 5169 (keeping 200 days of data) [2025-10-02T22:12:48.319200] [DEBUG] [LOCAL ] VGI: Primary data saved (5169 records). [2025-10-02T22:12:48.319365] [INFO ] [MAIN ] VGI: Full history saved. [2025-10-02T22:12:48.319463] [INFO ] [MAIN ] Update Progress: 2220/2370 symbols completed. VGI took 21.0s. Estimated remaining: 21m 8s. Rate: 7.1 symbols/min [2025-10-02T22:12:48.513004] [INFO ] [MAIN ] VHI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:12:48.518896] [DEBUG] [LOCAL ] VHI: Loaded 2766 existing records from primary storage. [2025-10-02T22:12:48.519110] [INFO ] [MAIN ] VHI: Loaded 2766 existing records. [2025-10-02T22:12:48.676933] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-02T22:12:48.770743] [WARN ] [MAIN ] VHI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:12:48.770973] [INFO ] [MAIN ] VHI: Wiping existing primary data before full refresh. [2025-10-02T22:12:48.771023] [INFO ] [LOCAL ] VHI: Starting deletion of primary data. [2025-10-02T22:12:48.771249] [DEBUG] [LOCAL ] VHI: Deleted primary data file. [2025-10-02T22:12:48.771309] [INFO ] [MAIN ] VHI: Starting full primary refresh. [2025-10-02T22:12:49.086272] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-09. [2025-10-02T22:12:49.181447] [INFO ] [REMOTE ] VHI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:12:49.191907] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-02T22:12:49.873033] [INFO ] [REMOTE ] VHI: Fetching primary data for 2024-12. [2025-10-02T22:12:50.342479] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-02T22:12:50.646680] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-02T22:12:50.673052] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-01. [2025-10-02T22:12:51.348412] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-02T22:12:51.473015] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-10. [2025-10-02T22:12:52.273066] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-06. [2025-10-02T22:12:52.607419] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-02T22:12:52.609739] [INFO ] [REMOTE ] VET: Full fetch complete (64562 records). [2025-10-02T22:12:52.609864] [DEBUG] [VALIDATOR ] VET: Validating primary data. [2025-10-02T22:12:53.019966] [DEBUG] [VALIDATOR ] VET: All expected trading days are present. [2025-10-02T22:12:53.020108] [DEBUG] [VALIDATOR ] VET: Primary data validation passed. [2025-10-02T22:12:53.022364] [INFO ] [MAIN ] VET: Fetched primary data is valid. [2025-10-02T22:12:53.022517] [DEBUG] [LOCAL ] VET: Saving primary data. [2025-10-02T22:12:53.024954] [DEBUG] [LOCAL ] VET: Trimmed 64562 records to 44247 (keeping 200 days of data) [2025-10-02T22:12:53.079896] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-02. [2025-10-02T22:12:53.327751] [DEBUG] [LOCAL ] VET: Primary data saved (44247 records). [2025-10-02T22:12:53.328002] [INFO ] [MAIN ] VET: Full history saved. [2025-10-02T22:12:53.328124] [INFO ] [MAIN ] Update Progress: 2221/2370 symbols completed. VET took 43.2s. Estimated remaining: 20m 59s. Rate: 7.1 symbols/min [2025-10-02T22:12:53.449708] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-02T22:12:53.528853] [INFO ] [MAIN ] VIA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:12:53.529103] [DEBUG] [LOCAL ] VIA: No existing data file found in primary storage. [2025-10-02T22:12:53.529143] [WARN ] [MAIN ] VIA: No existing data found, performing full refresh instead. [2025-10-02T22:12:53.529274] [INFO ] [MAIN ] VIA: Wiping existing primary data before full refresh. [2025-10-02T22:12:53.529319] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-10-02T22:12:53.529361] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-10-02T22:12:53.529396] [INFO ] [MAIN ] VIA: Starting full primary refresh. [2025-10-02T22:12:53.755066] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-02T22:12:53.880873] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-09. [2025-10-02T22:12:53.914005] [INFO ] [REMOTE ] VIA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:12:54.673037] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-07. [2025-10-02T22:12:55.473003] [INFO ] [REMOTE ] VIA: Fetching primary data for 2024-12. [2025-10-02T22:12:55.749875] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-02T22:12:55.827028] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T22:12:55.827589] [WARN ] [REMOTE ] VIA: No data returned for month 2024-12 [2025-10-02T22:12:55.827716] [FATAL] [REMOTE ] VIA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T22:12:55.827769] [FATAL] [MAIN ] VIA: Failed to fetch primary data. [2025-10-02T22:12:55.827804] [WARN ] [MAIN ] VIA: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T22:12:55.827861] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-10-02T22:12:55.827965] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-10-02T22:12:55.828016] [INFO ] [LOCAL ] VIA: Starting deletion of derivative data. [2025-10-02T22:12:55.828058] [DEBUG] [LOCAL ] VIA: No derivative data file found to delete. [2025-10-02T22:12:55.828110] [INFO ] [MAIN ] Update Progress: 2222/2370 symbols completed. VIA took 2.5s. Estimated remaining: 20m 50s. Rate: 7.1 symbols/min [2025-10-02T22:12:56.027002] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-02T22:12:56.046482] [INFO ] [MAIN ] VICI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:12:56.116640] [DEBUG] [LOCAL ] VICI: Loaded 53647 existing records from primary storage. [2025-10-02T22:12:56.117116] [INFO ] [MAIN ] VICI: Loaded 53647 existing records. [2025-10-02T22:12:56.290425] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-08. [2025-10-02T22:12:56.296414] [WARN ] [MAIN ] VICI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:12:56.297753] [INFO ] [MAIN ] VICI: Wiping existing primary data before full refresh. [2025-10-02T22:12:56.297814] [INFO ] [LOCAL ] VICI: Starting deletion of primary data. [2025-10-02T22:12:56.298302] [DEBUG] [LOCAL ] VICI: Deleted primary data file. [2025-10-02T22:12:56.298362] [INFO ] [MAIN ] VICI: Starting full primary refresh. [2025-10-02T22:12:56.672936] [INFO ] [REMOTE ] VICI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:12:57.078155] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-03. [2025-10-02T22:12:57.080977] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-02T22:12:57.696088] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-02T22:12:57.873046] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-10. [2025-10-02T22:12:58.673040] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-09. [2025-10-02T22:12:59.282986] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-02T22:12:59.286064] [INFO ] [REMOTE ] VFC: Full fetch complete (77589 records). [2025-10-02T22:12:59.286201] [DEBUG] [VALIDATOR ] VFC: Validating primary data. [2025-10-02T22:12:59.474821] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-04. [2025-10-02T22:12:59.705870] [DEBUG] [VALIDATOR ] VFC: All expected trading days are present. [2025-10-02T22:12:59.705973] [DEBUG] [VALIDATOR ] VFC: Primary data validation passed. [2025-10-02T22:12:59.707362] [INFO ] [MAIN ] VFC: Fetched primary data is valid. [2025-10-02T22:12:59.707440] [DEBUG] [LOCAL ] VFC: Saving primary data. [2025-10-02T22:12:59.709133] [DEBUG] [LOCAL ] VFC: Trimmed 77589 records to 54000 (keeping 200 days of data) [2025-10-02T22:12:59.944240] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-02T22:13:00.083664] [DEBUG] [LOCAL ] VFC: Primary data saved (54000 records). [2025-10-02T22:13:00.083837] [INFO ] [MAIN ] VFC: Full history saved. [2025-10-02T22:13:00.083933] [INFO ] [MAIN ] Update Progress: 2223/2370 symbols completed. VFC took 48.7s. Estimated remaining: 20m 42s. Rate: 7.1 symbols/min [2025-10-02T22:13:00.206580] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-02T22:13:00.285921] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-10. [2025-10-02T22:13:00.290725] [INFO ] [MAIN ] VIK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:13:00.345056] [DEBUG] [LOCAL ] VIK: Loaded 52494 existing records from primary storage. [2025-10-02T22:13:00.345491] [INFO ] [MAIN ] VIK: Loaded 52494 existing records. [2025-10-02T22:13:00.540307] [WARN ] [MAIN ] VIK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:13:00.540555] [INFO ] [MAIN ] VIK: Wiping existing primary data before full refresh. [2025-10-02T22:13:00.540604] [INFO ] [LOCAL ] VIK: Starting deletion of primary data. [2025-10-02T22:13:00.540957] [DEBUG] [LOCAL ] VIK: Deleted primary data file. [2025-10-02T22:13:00.541019] [INFO ] [MAIN ] VIK: Starting full primary refresh. [2025-10-02T22:13:00.930872] [INFO ] [REMOTE ] VIK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:13:00.991184] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-02T22:13:00.992789] [INFO ] [REMOTE ] VGM: Full fetch complete (26217 records). [2025-10-02T22:13:00.992870] [DEBUG] [VALIDATOR ] VGM: Validating primary data. [2025-10-02T22:13:01.078216] [INFO ] [REMOTE ] VIK: Fetching primary data for 2024-12. [2025-10-02T22:13:01.383762] [DEBUG] [VALIDATOR ] VGM: All expected trading days are present. [2025-10-02T22:13:01.383881] [DEBUG] [VALIDATOR ] VGM: Primary data validation passed. [2025-10-02T22:13:01.385309] [INFO ] [MAIN ] VGM: Fetched primary data is valid. [2025-10-02T22:13:01.385380] [DEBUG] [LOCAL ] VGM: Saving primary data. [2025-10-02T22:13:01.386313] [DEBUG] [LOCAL ] VGM: Trimmed 26217 records to 18428 (keeping 200 days of data) [2025-10-02T22:13:01.511773] [DEBUG] [LOCAL ] VGM: Primary data saved (18428 records). [2025-10-02T22:13:01.511996] [INFO ] [MAIN ] VGM: Full history saved. [2025-10-02T22:13:01.512106] [INFO ] [MAIN ] Update Progress: 2224/2370 symbols completed. VGM took 33.5s. Estimated remaining: 20m 33s. Rate: 7.1 symbols/min [2025-10-02T22:13:01.688761] [INFO ] [MAIN ] VIPS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:13:01.744733] [DEBUG] [LOCAL ] VIPS: Loaded 51338 existing records from primary storage. [2025-10-02T22:13:01.745078] [INFO ] [MAIN ] VIPS: Loaded 51338 existing records. [2025-10-02T22:13:01.878248] [INFO ] [REMOTE ] VICI: Fetching primary data for 2024-12. [2025-10-02T22:13:01.940956] [WARN ] [MAIN ] VIPS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:13:01.941212] [INFO ] [MAIN ] VIPS: Wiping existing primary data before full refresh. [2025-10-02T22:13:01.941267] [INFO ] [LOCAL ] VIPS: Starting deletion of primary data. [2025-10-02T22:13:01.941535] [DEBUG] [LOCAL ] VIPS: Deleted primary data file. [2025-10-02T22:13:01.941597] [INFO ] [MAIN ] VIPS: Starting full primary refresh. [2025-10-02T22:13:02.323760] [INFO ] [REMOTE ] VIPS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:13:02.672998] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2024-12. [2025-10-02T22:13:02.861966] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-02T22:13:03.473060] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-01. [2025-10-02T22:13:04.018842] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-10-02T22:13:04.273017] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-01. [2025-10-02T22:13:04.353420] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-02T22:13:05.073043] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-01. [2025-10-02T22:13:05.222291] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-02T22:13:05.873042] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-02. [2025-10-02T22:13:06.292469] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-02T22:13:06.673058] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-05. [2025-10-02T22:13:06.807241] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-02T22:13:07.012509] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-02T22:13:07.482000] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-02. [2025-10-02T22:13:07.503831] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-02T22:13:08.273033] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-06. [2025-10-02T22:13:08.913140] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-02T22:13:09.073090] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-07. [2025-10-02T22:13:09.372042] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-02T22:13:09.651219] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-02T22:13:09.873026] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-03. [2025-10-02T22:13:10.673045] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-03. [2025-10-02T22:13:11.473089] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-02. [2025-10-02T22:13:11.680506] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-02T22:13:12.273024] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-08. [2025-10-02T22:13:12.767805] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-02T22:13:12.775413] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-02T22:13:13.072988] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-04. [2025-10-02T22:13:13.259632] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-02T22:13:13.873043] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-04. [2025-10-02T22:13:14.673047] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-09. [2025-10-02T22:13:15.194547] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-02T22:13:15.203061] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-02T22:13:15.316746] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-02T22:13:15.473020] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-10. [2025-10-02T22:13:15.840811] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-02T22:13:15.841512] [INFO ] [REMOTE ] VHI: Full fetch complete (4471 records). [2025-10-02T22:13:15.841583] [DEBUG] [VALIDATOR ] VHI: Validating primary data. [2025-10-02T22:13:16.231232] [DEBUG] [VALIDATOR ] VHI: All expected trading days are present. [2025-10-02T22:13:16.231338] [DEBUG] [VALIDATOR ] VHI: Primary data validation passed. [2025-10-02T22:13:16.231510] [INFO ] [MAIN ] VHI: Fetched primary data is valid. [2025-10-02T22:13:16.231559] [DEBUG] [LOCAL ] VHI: Saving primary data. [2025-10-02T22:13:16.231979] [DEBUG] [LOCAL ] VHI: Trimmed 4471 records to 2787 (keeping 200 days of data) [2025-10-02T22:13:16.249546] [DEBUG] [LOCAL ] VHI: Primary data saved (2787 records). [2025-10-02T22:13:16.249721] [INFO ] [MAIN ] VHI: Full history saved. [2025-10-02T22:13:16.249825] [INFO ] [MAIN ] Update Progress: 2225/2370 symbols completed. VHI took 27.9s. Estimated remaining: 20m 25s. Rate: 7.1 symbols/min [2025-10-02T22:13:16.280746] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-03. [2025-10-02T22:13:16.437571] [INFO ] [MAIN ] VIRT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:13:16.479753] [DEBUG] [LOCAL ] VIRT: Loaded 46652 existing records from primary storage. [2025-10-02T22:13:16.480079] [INFO ] [MAIN ] VIRT: Loaded 46652 existing records. [2025-10-02T22:13:16.671606] [WARN ] [MAIN ] VIRT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:13:16.671867] [INFO ] [MAIN ] VIRT: Wiping existing primary data before full refresh. [2025-10-02T22:13:16.671915] [INFO ] [LOCAL ] VIRT: Starting deletion of primary data. [2025-10-02T22:13:16.672147] [DEBUG] [LOCAL ] VIRT: Deleted primary data file. [2025-10-02T22:13:16.672205] [INFO ] [MAIN ] VIRT: Starting full primary refresh. [2025-10-02T22:13:17.074884] [INFO ] [REMOTE ] VIRT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:13:17.075034] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-05. [2025-10-02T22:13:17.873035] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-05. [2025-10-02T22:13:18.198808] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-02T22:13:18.372901] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-02T22:13:18.673029] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-06. [2025-10-02T22:13:19.473005] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-04. [2025-10-02T22:13:19.533892] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-02T22:13:20.272997] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-06. [2025-10-02T22:13:20.411966] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-02T22:13:20.901593] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-02T22:13:21.072966] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-07. [2025-10-02T22:13:21.873031] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-05. [2025-10-02T22:13:22.199503] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-02T22:13:22.673016] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-07. [2025-10-02T22:13:22.731004] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-02T22:13:23.472983] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2024-12. [2025-10-02T22:13:23.685329] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-02T22:13:24.273046] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-06. [2025-10-02T22:13:24.675830] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-02T22:13:25.073035] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-08. [2025-10-02T22:13:25.101347] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-02T22:13:25.872963] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-01. [2025-10-02T22:13:26.039463] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-02T22:13:26.672969] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-08. [2025-10-02T22:13:27.255353] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-02T22:13:27.381138] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-10-02T22:13:27.472985] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-09. [2025-10-02T22:13:28.273001] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-07. [2025-10-02T22:13:28.534637] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-02T22:13:29.079189] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-02. [2025-10-02T22:13:29.101304] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-02T22:13:29.873028] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-10. [2025-10-02T22:13:29.954736] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-02T22:13:30.391948] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-02T22:13:30.673031] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-08. [2025-10-02T22:13:31.384073] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-02T22:13:31.387309] [INFO ] [REMOTE ] VICI: Full fetch complete (77657 records). [2025-10-02T22:13:31.387422] [DEBUG] [VALIDATOR ] VICI: Validating primary data. [2025-10-02T22:13:31.482525] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-03. [2025-10-02T22:13:31.818390] [DEBUG] [VALIDATOR ] VICI: All expected trading days are present. [2025-10-02T22:13:31.818509] [DEBUG] [VALIDATOR ] VICI: Primary data validation passed. [2025-10-02T22:13:31.819912] [INFO ] [MAIN ] VICI: Fetched primary data is valid. [2025-10-02T22:13:31.819983] [DEBUG] [LOCAL ] VICI: Saving primary data. [2025-10-02T22:13:31.821557] [DEBUG] [LOCAL ] VICI: Trimmed 77657 records to 54037 (keeping 200 days of data) [2025-10-02T22:13:32.181671] [DEBUG] [LOCAL ] VICI: Primary data saved (54037 records). [2025-10-02T22:13:32.181877] [INFO ] [MAIN ] VICI: Full history saved. [2025-10-02T22:13:32.182001] [INFO ] [MAIN ] Update Progress: 2226/2370 symbols completed. VICI took 36.4s. Estimated remaining: 20m 17s. Rate: 7.1 symbols/min [2025-10-02T22:13:32.275152] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-09. [2025-10-02T22:13:32.396600] [INFO ] [MAIN ] VIST: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:13:32.435187] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-02T22:13:32.497468] [DEBUG] [LOCAL ] VIST: Loaded 45965 existing records from primary storage. [2025-10-02T22:13:32.498078] [INFO ] [MAIN ] VIST: Loaded 45965 existing records. [2025-10-02T22:13:32.771628] [WARN ] [MAIN ] VIST: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:13:32.771960] [INFO ] [MAIN ] VIST: Wiping existing primary data before full refresh. [2025-10-02T22:13:32.772024] [INFO ] [LOCAL ] VIST: Starting deletion of primary data. [2025-10-02T22:13:32.772392] [DEBUG] [LOCAL ] VIST: Deleted primary data file. [2025-10-02T22:13:32.772453] [INFO ] [MAIN ] VIST: Starting full primary refresh. [2025-10-02T22:13:33.085861] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-09. [2025-10-02T22:13:33.289427] [INFO ] [REMOTE ] VIST: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:13:33.461076] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-02T22:13:33.872996] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-04. [2025-10-02T22:13:34.084962] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-02T22:13:34.673009] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-10. [2025-10-02T22:13:35.024760] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-02T22:13:35.335296] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-02T22:13:35.473021] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-05. [2025-10-02T22:13:36.023143] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-02T22:13:36.026284] [INFO ] [REMOTE ] VIK: Full fetch complete (75891 records). [2025-10-02T22:13:36.026456] [DEBUG] [VALIDATOR ] VIK: Validating primary data. [2025-10-02T22:13:36.278164] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-10. [2025-10-02T22:13:36.491827] [DEBUG] [VALIDATOR ] VIK: All expected trading days are present. [2025-10-02T22:13:36.491913] [DEBUG] [VALIDATOR ] VIK: Primary data validation passed. [2025-10-02T22:13:36.493074] [INFO ] [MAIN ] VIK: Fetched primary data is valid. [2025-10-02T22:13:36.493140] [DEBUG] [LOCAL ] VIK: Saving primary data. [2025-10-02T22:13:36.494710] [DEBUG] [LOCAL ] VIK: Trimmed 75891 records to 52883 (keeping 200 days of data) [2025-10-02T22:13:36.828199] [DEBUG] [LOCAL ] VIK: Primary data saved (52883 records). [2025-10-02T22:13:36.828347] [INFO ] [MAIN ] VIK: Full history saved. [2025-10-02T22:13:36.828434] [INFO ] [MAIN ] Update Progress: 2227/2370 symbols completed. VIK took 36.7s. Estimated remaining: 20m 8s. Rate: 7.1 symbols/min [2025-10-02T22:13:37.015038] [INFO ] [MAIN ] VIV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:13:37.076362] [INFO ] [REMOTE ] VIST: Fetching primary data for 2024-12. [2025-10-02T22:13:37.094180] [DEBUG] [LOCAL ] VIV: Loaded 44969 existing records from primary storage. [2025-10-02T22:13:37.096426] [INFO ] [MAIN ] VIV: Loaded 44969 existing records. [2025-10-02T22:13:37.095928] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-02T22:13:37.312436] [WARN ] [MAIN ] VIV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:13:37.312693] [INFO ] [MAIN ] VIV: Wiping existing primary data before full refresh. [2025-10-02T22:13:37.312754] [INFO ] [LOCAL ] VIV: Starting deletion of primary data. [2025-10-02T22:13:37.313037] [DEBUG] [LOCAL ] VIV: Deleted primary data file. [2025-10-02T22:13:37.313097] [INFO ] [MAIN ] VIV: Starting full primary refresh. [2025-10-02T22:13:37.479044] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-02T22:13:37.531233] [INFO ] [REMOTE ] VIPS: Full fetch complete (74633 records). [2025-10-02T22:13:37.559097] [DEBUG] [VALIDATOR ] VIPS: Validating primary data. [2025-10-02T22:13:37.903767] [INFO ] [REMOTE ] VIV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:13:37.897183] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-06. [2025-10-02T22:13:38.214246] [DEBUG] [VALIDATOR ] VIPS: All expected trading days are present. [2025-10-02T22:13:38.214346] [DEBUG] [VALIDATOR ] VIPS: Primary data validation passed. [2025-10-02T22:13:38.215677] [INFO ] [MAIN ] VIPS: Fetched primary data is valid. [2025-10-02T22:13:38.215744] [DEBUG] [LOCAL ] VIPS: Saving primary data. [2025-10-02T22:13:38.217263] [DEBUG] [LOCAL ] VIPS: Trimmed 74633 records to 51710 (keeping 200 days of data) [2025-10-02T22:13:38.577303] [DEBUG] [LOCAL ] VIPS: Primary data saved (51710 records). [2025-10-02T22:13:38.577928] [INFO ] [MAIN ] VIPS: Full history saved. [2025-10-02T22:13:38.579338] [INFO ] [MAIN ] Update Progress: 2228/2370 symbols completed. VIPS took 37.1s. Estimated remaining: 19m 59s. Rate: 7.1 symbols/min [2025-10-02T22:13:38.678391] [INFO ] [REMOTE ] VIV: Fetching primary data for 2024-12. [2025-10-02T22:13:38.769223] [INFO ] [MAIN ] VKQ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:13:38.796373] [DEBUG] [LOCAL ] VKQ: Loaded 17622 existing records from primary storage. [2025-10-02T22:13:38.796628] [INFO ] [MAIN ] VKQ: Loaded 17622 existing records. [2025-10-02T22:13:39.018586] [WARN ] [MAIN ] VKQ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:13:39.031035] [INFO ] [MAIN ] VKQ: Wiping existing primary data before full refresh. [2025-10-02T22:13:39.031481] [INFO ] [LOCAL ] VKQ: Starting deletion of primary data. [2025-10-02T22:13:39.033281] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-02T22:13:39.033332] [DEBUG] [LOCAL ] VKQ: Deleted primary data file. [2025-10-02T22:13:39.033525] [INFO ] [MAIN ] VKQ: Starting full primary refresh. [2025-10-02T22:13:39.445185] [INFO ] [REMOTE ] VKQ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:13:39.472998] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2024-12. [2025-10-02T22:13:39.559419] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-02T22:13:40.277730] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-01. [2025-10-02T22:13:40.283101] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-02T22:13:40.588190] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-02T22:13:41.073012] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-01. [2025-10-02T22:13:41.721576] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-02T22:13:41.873014] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-01. [2025-10-02T22:13:42.052754] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-02T22:13:42.673005] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-02. [2025-10-02T22:13:43.189064] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-02T22:13:43.472978] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-07. [2025-10-02T22:13:43.597188] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-02T22:13:44.273008] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-02. [2025-10-02T22:13:45.073063] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-02. [2025-10-02T22:13:45.210490] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-02T22:13:45.879438] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-03. [2025-10-02T22:13:45.885058] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-02T22:13:46.609036] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-02T22:13:46.673008] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-03. [2025-10-02T22:13:46.836058] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-02T22:13:47.473042] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-04. [2025-10-02T22:13:48.240584] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-02T22:13:48.272967] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-04. [2025-10-02T22:13:48.559952] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-02T22:13:49.073024] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-03. [2025-10-02T22:13:49.873013] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-08. [2025-10-02T22:13:50.081847] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-02T22:13:50.233011] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-02T22:13:50.673000] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-05. [2025-10-02T22:13:50.781103] [DEBUG] [REMOTE ] VKQ: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-02T22:13:50.781462] [WARN ] [REMOTE ] VKQ: No data returned for month 2025-05 [2025-10-02T22:13:50.781558] [FATAL] [REMOTE ] VKQ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T22:13:50.781699] [FATAL] [MAIN ] VKQ: Failed to fetch primary data. [2025-10-02T22:13:50.781786] [WARN ] [MAIN ] VKQ: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T22:13:50.781873] [INFO ] [LOCAL ] VKQ: Starting deletion of primary data. [2025-10-02T22:13:50.781957] [DEBUG] [LOCAL ] VKQ: No primary data file found to delete. [2025-10-02T22:13:50.782028] [INFO ] [LOCAL ] VKQ: Starting deletion of derivative data. [2025-10-02T22:13:50.782489] [DEBUG] [LOCAL ] VKQ: Deleted derivative data file. [2025-10-02T22:13:50.782600] [INFO ] [MAIN ] Update Progress: 2229/2370 symbols completed. VKQ took 12.2s. Estimated remaining: 19m 51s. Rate: 7.1 symbols/min [2025-10-02T22:13:50.971166] [INFO ] [MAIN ] VLN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:13:51.002844] [DEBUG] [LOCAL ] VLN: Loaded 29086 existing records from primary storage. [2025-10-02T22:13:51.003153] [INFO ] [MAIN ] VLN: Loaded 29086 existing records. [2025-10-02T22:13:51.217622] [WARN ] [MAIN ] VLN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:13:51.217856] [INFO ] [MAIN ] VLN: Wiping existing primary data before full refresh. [2025-10-02T22:13:51.217938] [INFO ] [LOCAL ] VLN: Starting deletion of primary data. [2025-10-02T22:13:51.218543] [DEBUG] [LOCAL ] VLN: Deleted primary data file. [2025-10-02T22:13:51.218604] [INFO ] [MAIN ] VLN: Starting full primary refresh. [2025-10-02T22:13:51.478211] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-04. [2025-10-02T22:13:51.625121] [INFO ] [REMOTE ] VLN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:13:51.653284] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-02T22:13:52.273036] [INFO ] [REMOTE ] VLN: Fetching primary data for 2024-12. [2025-10-02T22:13:53.072973] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-05. [2025-10-02T22:13:53.174799] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-02T22:13:53.520343] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-02T22:13:53.872999] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-01. [2025-10-02T22:13:54.636866] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-02T22:13:54.673013] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-05. [2025-10-02T22:13:55.334956] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-02T22:13:55.473011] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-06. [2025-10-02T22:13:56.272980] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-02. [2025-10-02T22:13:56.310713] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-02T22:13:57.073049] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-09. [2025-10-02T22:13:57.217288] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-02T22:13:57.406747] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-02T22:13:57.873014] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-07. [2025-10-02T22:13:58.672993] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-06. [2025-10-02T22:13:58.724436] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-02T22:13:59.472999] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-10. [2025-10-02T22:13:59.655000] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-02T22:14:00.269165] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-02T22:14:00.278492] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-03. [2025-10-02T22:14:00.581915] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-02T22:14:00.585148] [INFO ] [REMOTE ] VIRT: Full fetch complete (67093 records). [2025-10-02T22:14:00.585344] [DEBUG] [VALIDATOR ] VIRT: Validating primary data. [2025-10-02T22:14:01.017912] [DEBUG] [VALIDATOR ] VIRT: All expected trading days are present. [2025-10-02T22:14:01.018017] [DEBUG] [VALIDATOR ] VIRT: Primary data validation passed. [2025-10-02T22:14:01.019139] [INFO ] [MAIN ] VIRT: Fetched primary data is valid. [2025-10-02T22:14:01.019235] [DEBUG] [LOCAL ] VIRT: Saving primary data. [2025-10-02T22:14:01.021433] [DEBUG] [LOCAL ] VIRT: Trimmed 67093 records to 46992 (keeping 200 days of data) [2025-10-02T22:14:01.080633] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-08. [2025-10-02T22:14:01.267547] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-02T22:14:01.368299] [DEBUG] [LOCAL ] VIRT: Primary data saved (46992 records). [2025-10-02T22:14:01.368541] [INFO ] [MAIN ] VIRT: Full history saved. [2025-10-02T22:14:01.368708] [INFO ] [MAIN ] Update Progress: 2230/2370 symbols completed. VIRT took 45.1s. Estimated remaining: 19m 43s. Rate: 7.1 symbols/min [2025-10-02T22:14:01.554836] [INFO ] [MAIN ] VLO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:14:01.628950] [DEBUG] [LOCAL ] VLO: Loaded 53073 existing records from primary storage. [2025-10-02T22:14:01.629355] [INFO ] [MAIN ] VLO: Loaded 53073 existing records. [2025-10-02T22:14:01.850702] [WARN ] [MAIN ] VLO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:14:01.850930] [INFO ] [MAIN ] VLO: Wiping existing primary data before full refresh. [2025-10-02T22:14:01.850990] [INFO ] [LOCAL ] VLO: Starting deletion of primary data. [2025-10-02T22:14:01.851361] [DEBUG] [LOCAL ] VLO: Deleted primary data file. [2025-10-02T22:14:01.851436] [INFO ] [MAIN ] VLO: Starting full primary refresh. [2025-10-02T22:14:01.884945] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-04. [2025-10-02T22:14:02.245577] [INFO ] [REMOTE ] VLO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:14:02.672980] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-07. [2025-10-02T22:14:02.782401] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-02T22:14:03.352219] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-02T22:14:03.473089] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-05. [2025-10-02T22:14:04.273013] [INFO ] [REMOTE ] VLO: Fetching primary data for 2024-12. [2025-10-02T22:14:04.354436] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-02T22:14:04.642082] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-02T22:14:05.073020] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-06. [2025-10-02T22:14:05.872989] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-08. [2025-10-02T22:14:06.193553] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-02T22:14:06.340388] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-02T22:14:06.673020] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-01. [2025-10-02T22:14:07.476014] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-09. [2025-10-02T22:14:07.480541] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-02T22:14:08.273017] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-07. [2025-10-02T22:14:08.544946] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-02T22:14:08.942741] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-02T22:14:09.073027] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-10. [2025-10-02T22:14:09.374004] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-02T22:14:09.873005] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-02. [2025-10-02T22:14:10.145319] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-02T22:14:10.147369] [INFO ] [REMOTE ] VIST: Full fetch complete (66831 records). [2025-10-02T22:14:10.147499] [DEBUG] [VALIDATOR ] VIST: Validating primary data. [2025-10-02T22:14:10.618051] [DEBUG] [VALIDATOR ] VIST: All expected trading days are present. [2025-10-02T22:14:10.618177] [DEBUG] [VALIDATOR ] VIST: Primary data validation passed. [2025-10-02T22:14:10.619558] [INFO ] [MAIN ] VIST: Fetched primary data is valid. [2025-10-02T22:14:10.619624] [DEBUG] [LOCAL ] VIST: Saving primary data. [2025-10-02T22:14:10.621344] [DEBUG] [LOCAL ] VIST: Trimmed 66831 records to 46326 (keeping 200 days of data) [2025-10-02T22:14:10.682107] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-09. [2025-10-02T22:14:10.913868] [DEBUG] [LOCAL ] VIST: Primary data saved (46326 records). [2025-10-02T22:14:10.914015] [INFO ] [MAIN ] VIST: Full history saved. [2025-10-02T22:14:10.914119] [INFO ] [MAIN ] Update Progress: 2231/2370 symbols completed. VIST took 38.7s. Estimated remaining: 19m 34s. Rate: 7.1 symbols/min [2025-10-02T22:14:11.105990] [INFO ] [MAIN ] VLRS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:14:11.149417] [DEBUG] [LOCAL ] VLRS: Loaded 40366 existing records from primary storage. [2025-10-02T22:14:11.149796] [INFO ] [MAIN ] VLRS: Loaded 40366 existing records. [2025-10-02T22:14:11.370386] [WARN ] [MAIN ] VLRS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:14:11.370823] [INFO ] [MAIN ] VLRS: Wiping existing primary data before full refresh. [2025-10-02T22:14:11.370953] [INFO ] [LOCAL ] VLRS: Starting deletion of primary data. [2025-10-02T22:14:11.371255] [DEBUG] [LOCAL ] VLRS: Deleted primary data file. [2025-10-02T22:14:11.371317] [INFO ] [MAIN ] VLRS: Starting full primary refresh. [2025-10-02T22:14:11.478111] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-08. [2025-10-02T22:14:11.823517] [INFO ] [REMOTE ] VLRS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:14:11.853035] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-02T22:14:12.219885] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-02T22:14:12.272988] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-10. [2025-10-02T22:14:13.024941] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-02T22:14:13.073014] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2024-12. [2025-10-02T22:14:13.405587] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-02T22:14:13.407573] [INFO ] [REMOTE ] VIV: Full fetch complete (64725 records). [2025-10-02T22:14:13.407822] [DEBUG] [VALIDATOR ] VIV: Validating primary data. [2025-10-02T22:14:13.828896] [DEBUG] [VALIDATOR ] VIV: All expected trading days are present. [2025-10-02T22:14:13.828986] [DEBUG] [VALIDATOR ] VIV: Primary data validation passed. [2025-10-02T22:14:13.830213] [INFO ] [MAIN ] VIV: Fetched primary data is valid. [2025-10-02T22:14:13.830280] [DEBUG] [LOCAL ] VIV: Saving primary data. [2025-10-02T22:14:13.831726] [DEBUG] [LOCAL ] VIV: Trimmed 64725 records to 45321 (keeping 200 days of data) [2025-10-02T22:14:13.898207] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-03. [2025-10-02T22:14:14.146828] [DEBUG] [LOCAL ] VIV: Primary data saved (45321 records). [2025-10-02T22:14:14.147069] [INFO ] [MAIN ] VIV: Full history saved. [2025-10-02T22:14:14.147305] [INFO ] [MAIN ] Update Progress: 2232/2370 symbols completed. VIV took 37.3s. Estimated remaining: 19m 25s. Rate: 7.1 symbols/min [2025-10-02T22:14:14.332121] [INFO ] [MAIN ] VLT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:14:14.340112] [DEBUG] [LOCAL ] VLT: Loaded 4542 existing records from primary storage. [2025-10-02T22:14:14.340434] [INFO ] [MAIN ] VLT: Loaded 4542 existing records. [2025-10-02T22:14:14.542225] [WARN ] [MAIN ] VLT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:14:14.542546] [INFO ] [MAIN ] VLT: Wiping existing primary data before full refresh. [2025-10-02T22:14:14.542680] [INFO ] [LOCAL ] VLT: Starting deletion of primary data. [2025-10-02T22:14:14.543098] [DEBUG] [LOCAL ] VLT: Deleted primary data file. [2025-10-02T22:14:14.543168] [INFO ] [MAIN ] VLT: Starting full primary refresh. [2025-10-02T22:14:14.680240] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-09. [2025-10-02T22:14:14.687356] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-02T22:14:14.966863] [INFO ] [REMOTE ] VLT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:14:15.472975] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-01. [2025-10-02T22:14:15.803827] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-02T22:14:15.956638] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-02T22:14:16.273004] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-10. [2025-10-02T22:14:16.590910] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-02T22:14:17.073004] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-04. [2025-10-02T22:14:17.420968] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-02T22:14:17.422968] [INFO ] [REMOTE ] VLN: Full fetch complete (43164 records). [2025-10-02T22:14:17.423085] [DEBUG] [VALIDATOR ] VLN: Validating primary data. [2025-10-02T22:14:17.846421] [DEBUG] [VALIDATOR ] VLN: All expected trading days are present. [2025-10-02T22:14:17.846568] [DEBUG] [VALIDATOR ] VLN: Primary data validation passed. [2025-10-02T22:14:17.847804] [INFO ] [MAIN ] VLN: Fetched primary data is valid. [2025-10-02T22:14:17.847870] [DEBUG] [LOCAL ] VLN: Saving primary data. [2025-10-02T22:14:17.849186] [DEBUG] [LOCAL ] VLN: Trimmed 43164 records to 29371 (keeping 200 days of data) [2025-10-02T22:14:17.897415] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-02. [2025-10-02T22:14:18.035794] [DEBUG] [LOCAL ] VLN: Primary data saved (29371 records). [2025-10-02T22:14:18.036029] [INFO ] [MAIN ] VLN: Full history saved. [2025-10-02T22:14:18.036211] [INFO ] [MAIN ] Update Progress: 2233/2370 symbols completed. VLN took 27.3s. Estimated remaining: 19m 17s. Rate: 7.1 symbols/min [2025-10-02T22:14:18.221329] [INFO ] [MAIN ] VLTO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:14:18.272114] [DEBUG] [LOCAL ] VLTO: Loaded 46023 existing records from primary storage. [2025-10-02T22:14:18.272425] [INFO ] [MAIN ] VLTO: Loaded 46023 existing records. [2025-10-02T22:14:18.474168] [WARN ] [MAIN ] VLTO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:14:18.474409] [INFO ] [MAIN ] VLTO: Wiping existing primary data before full refresh. [2025-10-02T22:14:18.474474] [INFO ] [LOCAL ] VLTO: Starting deletion of primary data. [2025-10-02T22:14:18.474804] [DEBUG] [LOCAL ] VLTO: Deleted primary data file. [2025-10-02T22:14:18.474866] [INFO ] [MAIN ] VLTO: Starting full primary refresh. [2025-10-02T22:14:18.698200] [INFO ] [REMOTE ] VLT: Fetching primary data for 2024-12. [2025-10-02T22:14:18.858013] [INFO ] [REMOTE ] VLTO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:14:19.080607] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-02T22:14:19.115573] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-02T22:14:19.370955] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-02T22:14:19.473007] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2024-12. [2025-10-02T22:14:20.272993] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-01. [2025-10-02T22:14:20.813611] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-02T22:14:21.070554] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-02T22:14:21.079390] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-02. [2025-10-02T22:14:21.771764] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-02T22:14:21.872997] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-01. [2025-10-02T22:14:22.673008] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-05. [2025-10-02T22:14:23.473046] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-03. [2025-10-02T22:14:23.511972] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-02T22:14:23.912593] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-02T22:14:24.149394] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-02T22:14:24.273021] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-02. [2025-10-02T22:14:25.073044] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-06. [2025-10-02T22:14:25.873032] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-03. [2025-10-02T22:14:25.949867] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-02T22:14:26.672995] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-03. [2025-10-02T22:14:27.127057] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-02T22:14:27.472970] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-07. [2025-10-02T22:14:27.507833] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-02T22:14:28.272973] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-04. [2025-10-02T22:14:28.403774] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-02T22:14:28.995283] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-02T22:14:29.079263] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-04. [2025-10-02T22:14:29.086190] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-02T22:14:29.873012] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-04. [2025-10-02T22:14:30.672983] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-05. [2025-10-02T22:14:30.825839] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-02T22:14:31.231546] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-02T22:14:31.473029] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-05. [2025-10-02T22:14:31.836928] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-02T22:14:32.273012] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-05. [2025-10-02T22:14:33.072999] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-06. [2025-10-02T22:14:33.133197] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-02T22:14:33.641336] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-02T22:14:33.872983] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-06. [2025-10-02T22:14:33.960284] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-02T22:14:34.673038] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-08. [2025-10-02T22:14:34.856637] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-02T22:14:35.472999] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-07. [2025-10-02T22:14:36.240024] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-02T22:14:36.272973] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-08. [2025-10-02T22:14:36.507074] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-02T22:14:36.862947] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-02T22:14:37.073020] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-07. [2025-10-02T22:14:37.872993] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-09. [2025-10-02T22:14:38.678012] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-06. [2025-10-02T22:14:38.683724] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-02T22:14:39.285521] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-02T22:14:39.473006] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-08. [2025-10-02T22:14:39.838182] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-02T22:14:40.273003] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-07. [2025-10-02T22:14:40.868836] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-02T22:14:41.072996] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-09. [2025-10-02T22:14:41.704506] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-02T22:14:41.872993] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-09. [2025-10-02T22:14:42.013025] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-02T22:14:42.673046] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-10. [2025-10-02T22:14:43.297351] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-02T22:14:43.473016] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-10. [2025-10-02T22:14:44.153569] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-02T22:14:44.155888] [INFO ] [REMOTE ] VLO: Full fetch complete (76922 records). [2025-10-02T22:14:44.156171] [DEBUG] [VALIDATOR ] VLO: Validating primary data. [2025-10-02T22:14:44.278097] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-10. [2025-10-02T22:14:44.512186] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-02T22:14:44.530880] [INFO ] [REMOTE ] VLRS: Full fetch complete (58527 records). [2025-10-02T22:14:44.557244] [DEBUG] [VALIDATOR ] VLRS: Validating primary data. [2025-10-02T22:14:44.713376] [DEBUG] [VALIDATOR ] VLO: All expected trading days are present. [2025-10-02T22:14:44.739558] [DEBUG] [VALIDATOR ] VLO: Primary data validation passed. [2025-10-02T22:14:44.741374] [INFO ] [MAIN ] VLO: Fetched primary data is valid. [2025-10-02T22:14:44.762522] [DEBUG] [LOCAL ] VLO: Saving primary data. [2025-10-02T22:14:44.815752] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-02T22:14:44.832798] [INFO ] [REMOTE ] VLT: Full fetch complete (7500 records). [2025-10-02T22:14:44.869185] [DEBUG] [VALIDATOR ] VLT: Validating primary data. [2025-10-02T22:14:44.886490] [DEBUG] [LOCAL ] VLO: Trimmed 76922 records to 53462 (keeping 200 days of data) [2025-10-02T22:14:45.086124] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-08. [2025-10-02T22:14:45.297512] [DEBUG] [VALIDATOR ] VLRS: All expected trading days are present. [2025-10-02T22:14:45.311375] [DEBUG] [VALIDATOR ] VLRS: Primary data validation passed. [2025-10-02T22:14:45.318815] [INFO ] [MAIN ] VLRS: Fetched primary data is valid. [2025-10-02T22:14:45.333080] [DEBUG] [LOCAL ] VLRS: Saving primary data. [2025-10-02T22:14:45.416908] [DEBUG] [LOCAL ] VLRS: Trimmed 58527 records to 40672 (keeping 200 days of data) [2025-10-02T22:14:45.822780] [DEBUG] [VALIDATOR ] VLT: All expected trading days are present. [2025-10-02T22:14:45.823224] [DEBUG] [VALIDATOR ] VLT: Primary data validation passed. [2025-10-02T22:14:45.823935] [INFO ] [MAIN ] VLT: Fetched primary data is valid. [2025-10-02T22:14:45.824285] [DEBUG] [LOCAL ] VLT: Saving primary data. [2025-10-02T22:14:45.826799] [DEBUG] [LOCAL ] VLT: Trimmed 7500 records to 4564 (keeping 200 days of data) [2025-10-02T22:14:45.883187] [DEBUG] [LOCAL ] VLT: Primary data saved (4564 records). [2025-10-02T22:14:45.884278] [INFO ] [MAIN ] VLT: Full history saved. [2025-10-02T22:14:45.885020] [INFO ] [MAIN ] Update Progress: 2234/2370 symbols completed. VLT took 31.7s. Estimated remaining: 19m 9s. Rate: 7.1 symbols/min [2025-10-02T22:14:46.090116] [INFO ] [MAIN ] VMC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:14:46.241091] [DEBUG] [LOCAL ] VMC: Loaded 43268 existing records from primary storage. [2025-10-02T22:14:46.242701] [INFO ] [MAIN ] VMC: Loaded 43268 existing records. [2025-10-02T22:14:46.544886] [WARN ] [MAIN ] VMC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:14:46.547526] [INFO ] [MAIN ] VMC: Wiping existing primary data before full refresh. [2025-10-02T22:14:46.548990] [INFO ] [LOCAL ] VMC: Starting deletion of primary data. [2025-10-02T22:14:46.551185] [DEBUG] [LOCAL ] VMC: Deleted primary data file. [2025-10-02T22:14:46.551637] [INFO ] [MAIN ] VMC: Starting full primary refresh. [2025-10-02T22:14:46.888434] [DEBUG] [LOCAL ] VLRS: Primary data saved (40672 records). [2025-10-02T22:14:46.904727] [INFO ] [MAIN ] VLRS: Full history saved. [2025-10-02T22:14:46.916931] [INFO ] [MAIN ] Update Progress: 2235/2370 symbols completed. VLRS took 36.0s. Estimated remaining: 19m 1s. Rate: 7.1 symbols/min [2025-10-02T22:14:47.083396] [INFO ] [REMOTE ] VMC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:14:47.105521] [INFO ] [REMOTE ] VMC: Fetching primary data for 2024-12. [2025-10-02T22:14:47.125350] [DEBUG] [LOCAL ] VLO: Primary data saved (53462 records). [2025-10-02T22:14:47.136833] [INFO ] [MAIN ] VLO: Full history saved. [2025-10-02T22:14:47.147079] [INFO ] [MAIN ] Update Progress: 2236/2370 symbols completed. VLO took 45.8s. Estimated remaining: 18m 52s. Rate: 7.1 symbols/min [2025-10-02T22:14:47.345132] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-10-02T22:14:47.346487] [INFO ] [MAIN ] VMI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:14:47.401243] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-09. [2025-10-02T22:14:47.471133] [INFO ] [MAIN ] VMO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:14:47.479880] [DEBUG] [LOCAL ] VMI: Loaded 15418 existing records from primary storage. [2025-10-02T22:14:47.480288] [INFO ] [MAIN ] VMI: Loaded 15418 existing records. [2025-10-02T22:14:47.670504] [DEBUG] [LOCAL ] VMO: Loaded 21043 existing records from primary storage. [2025-10-02T22:14:47.692340] [WARN ] [MAIN ] VMI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:14:47.692607] [INFO ] [MAIN ] VMI: Wiping existing primary data before full refresh. [2025-10-02T22:14:47.692748] [INFO ] [MAIN ] VMO: Loaded 21043 existing records. [2025-10-02T22:14:47.697973] [INFO ] [LOCAL ] VMI: Starting deletion of primary data. [2025-10-02T22:14:47.709953] [DEBUG] [LOCAL ] VMI: Deleted primary data file. [2025-10-02T22:14:47.729741] [INFO ] [MAIN ] VMI: Starting full primary refresh. [2025-10-02T22:14:48.074170] [WARN ] [MAIN ] VMO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:14:48.084251] [INFO ] [MAIN ] VMO: Wiping existing primary data before full refresh. [2025-10-02T22:14:48.092213] [INFO ] [LOCAL ] VMO: Starting deletion of primary data. [2025-10-02T22:14:48.134630] [DEBUG] [LOCAL ] VMO: Deleted primary data file. [2025-10-02T22:14:48.163077] [INFO ] [MAIN ] VMO: Starting full primary refresh. [2025-10-02T22:14:48.527564] [INFO ] [REMOTE ] VMI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:14:48.545580] [INFO ] [REMOTE ] VMI: Fetching primary data for 2024-12. [2025-10-02T22:14:48.726637] [INFO ] [REMOTE ] VMO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:14:48.727111] [INFO ] [REMOTE ] VMO: Fetching primary data for 2024-12. [2025-10-02T22:14:48.756487] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-02T22:14:49.073092] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-01. [2025-10-02T22:14:49.173593] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-02T22:14:49.523193] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-02T22:14:49.827997] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-02T22:14:49.873002] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-01. [2025-10-02T22:14:50.388088] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-02T22:14:50.556342] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-02T22:14:50.673025] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-01. [2025-10-02T22:14:51.472979] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-10. [2025-10-02T22:14:51.601154] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-02T22:14:52.273017] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-02. [2025-10-02T22:14:52.518548] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-02T22:14:52.522471] [INFO ] [REMOTE ] VLTO: Full fetch complete (66892 records). [2025-10-02T22:14:52.522599] [DEBUG] [VALIDATOR ] VLTO: Validating primary data. [2025-10-02T22:14:52.941635] [DEBUG] [VALIDATOR ] VLTO: All expected trading days are present. [2025-10-02T22:14:52.941765] [DEBUG] [VALIDATOR ] VLTO: Primary data validation passed. [2025-10-02T22:14:52.943095] [INFO ] [MAIN ] VLTO: Fetched primary data is valid. [2025-10-02T22:14:52.943170] [DEBUG] [LOCAL ] VLTO: Saving primary data. [2025-10-02T22:14:52.944711] [DEBUG] [LOCAL ] VLTO: Trimmed 66892 records to 46347 (keeping 200 days of data) [2025-10-02T22:14:53.078957] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-02. [2025-10-02T22:14:53.283254] [DEBUG] [LOCAL ] VLTO: Primary data saved (46347 records). [2025-10-02T22:14:53.283401] [INFO ] [MAIN ] VLTO: Full history saved. [2025-10-02T22:14:53.284900] [INFO ] [MAIN ] Update Progress: 2237/2370 symbols completed. VLTO took 35.2s. Estimated remaining: 18m 43s. Rate: 7.1 symbols/min [2025-10-02T22:14:53.545565] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-02T22:14:53.873009] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-03. [2025-10-02T22:14:54.672976] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-02. [2025-10-02T22:14:54.767556] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-02T22:14:54.951766] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-02T22:14:55.473038] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-03. [2025-10-02T22:14:55.576400] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-02T22:14:56.272996] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-03. [2025-10-02T22:14:57.072985] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-04. [2025-10-02T22:14:57.214025] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-02T22:14:57.391985] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-02T22:14:57.873010] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-04. [2025-10-02T22:14:58.289578] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-02T22:14:58.673019] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-05. [2025-10-02T22:14:59.403128] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-02T22:14:59.473040] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-05. [2025-10-02T22:14:59.669197] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-02T22:15:00.273073] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-04. [2025-10-02T22:15:01.072989] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-06. [2025-10-02T22:15:01.142749] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-02T22:15:01.164291] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-02T22:15:01.873003] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-06. [2025-10-02T22:15:02.176495] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-02T22:15:02.672992] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-07. [2025-10-02T22:15:03.472985] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-05. [2025-10-02T22:15:03.587732] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-02T22:15:03.741219] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-02T22:15:04.272978] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-08. [2025-10-02T22:15:04.391359] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-02T22:15:05.073024] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-07. [2025-10-02T22:15:05.691073] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-02T22:15:05.873060] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-09. [2025-10-02T22:15:06.678313] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-06. [2025-10-02T22:15:06.699196] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-02T22:15:07.187589] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-02T22:15:07.473098] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-10. [2025-10-02T22:15:07.839831] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-02T22:15:08.273051] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-08. [2025-10-02T22:15:08.375496] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-02T22:15:08.376877] [INFO ] [REMOTE ] VMO: Full fetch complete (31396 records). [2025-10-02T22:15:08.376958] [DEBUG] [VALIDATOR ] VMO: Validating primary data. [2025-10-02T22:15:08.806481] [DEBUG] [VALIDATOR ] VMO: All expected trading days are present. [2025-10-02T22:15:08.806602] [DEBUG] [VALIDATOR ] VMO: Primary data validation passed. [2025-10-02T22:15:08.807580] [INFO ] [MAIN ] VMO: Fetched primary data is valid. [2025-10-02T22:15:08.807704] [DEBUG] [LOCAL ] VMO: Saving primary data. [2025-10-02T22:15:08.809139] [DEBUG] [LOCAL ] VMO: Trimmed 31396 records to 21243 (keeping 200 days of data) [2025-10-02T22:15:08.955738] [DEBUG] [LOCAL ] VMO: Primary data saved (21243 records). [2025-10-02T22:15:08.955876] [INFO ] [MAIN ] VMO: Full history saved. [2025-10-02T22:15:08.955965] [INFO ] [MAIN ] Update Progress: 2238/2370 symbols completed. VMO took 21.8s. Estimated remaining: 18m 35s. Rate: 7.1 symbols/min [2025-10-02T22:15:09.073047] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-07. [2025-10-02T22:15:09.565194] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-02T22:15:09.872983] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-09. [2025-10-02T22:15:10.221279] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-02T22:15:10.673066] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-08. [2025-10-02T22:15:11.456841] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-02T22:15:11.472993] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-10. [2025-10-02T22:15:11.647542] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-02T22:15:12.272997] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-09. [2025-10-02T22:15:12.728974] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-02T22:15:12.730776] [INFO ] [REMOTE ] VMC: Full fetch complete (62538 records). [2025-10-02T22:15:12.730868] [DEBUG] [VALIDATOR ] VMC: Validating primary data. [2025-10-02T22:15:13.154285] [DEBUG] [VALIDATOR ] VMC: All expected trading days are present. [2025-10-02T22:15:13.154467] [DEBUG] [VALIDATOR ] VMC: Primary data validation passed. [2025-10-02T22:15:13.155829] [INFO ] [MAIN ] VMC: Fetched primary data is valid. [2025-10-02T22:15:13.155897] [DEBUG] [LOCAL ] VMC: Saving primary data. [2025-10-02T22:15:13.157265] [DEBUG] [LOCAL ] VMC: Trimmed 62538 records to 43571 (keeping 200 days of data) [2025-10-02T22:15:13.296156] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-02T22:15:13.301278] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-10. [2025-10-02T22:15:13.468882] [DEBUG] [LOCAL ] VMC: Primary data saved (43571 records). [2025-10-02T22:15:13.469031] [INFO ] [MAIN ] VMC: Full history saved. [2025-10-02T22:15:13.469118] [INFO ] [MAIN ] Update Progress: 2239/2370 symbols completed. VMC took 27.6s. Estimated remaining: 18m 26s. Rate: 7.1 symbols/min [2025-10-02T22:15:14.003587] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-02T22:15:14.004879] [INFO ] [REMOTE ] VMI: Full fetch complete (21180 records). [2025-10-02T22:15:14.004965] [DEBUG] [VALIDATOR ] VMI: Validating primary data. [2025-10-02T22:15:14.404755] [DEBUG] [VALIDATOR ] VMI: All expected trading days are present. [2025-10-02T22:15:14.404837] [DEBUG] [VALIDATOR ] VMI: Primary data validation passed. [2025-10-02T22:15:14.405336] [INFO ] [MAIN ] VMI: Fetched primary data is valid. [2025-10-02T22:15:14.405377] [DEBUG] [LOCAL ] VMI: Saving primary data. [2025-10-02T22:15:14.406022] [DEBUG] [LOCAL ] VMI: Trimmed 21180 records to 15488 (keeping 200 days of data) [2025-10-02T22:15:14.515517] [DEBUG] [LOCAL ] VMI: Primary data saved (15488 records). [2025-10-02T22:15:14.515702] [INFO ] [MAIN ] VMI: Full history saved. [2025-10-02T22:15:14.515809] [INFO ] [MAIN ] Update Progress: 2240/2370 symbols completed. VMI took 27.6s. Estimated remaining: 18m 17s. Rate: 7.1 symbols/min [2025-10-02T22:15:15.222411] [INFO ] [MAIN ] VOC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:15:15.238693] [INFO ] [MAIN ] VNT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:15:15.282381] [INFO ] [MAIN ] VNO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:15:15.334524] [INFO ] [MAIN ] VNCE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:15:15.344946] [DEBUG] [LOCAL ] VOC: Loaded 8913 existing records from primary storage. [2025-10-02T22:15:15.345367] [INFO ] [MAIN ] VOC: Loaded 8913 existing records. [2025-10-02T22:15:15.468366] [DEBUG] [LOCAL ] VNCE: Loaded 8032 existing records from primary storage. [2025-10-02T22:15:15.488941] [INFO ] [MAIN ] VNCE: Loaded 8032 existing records. [2025-10-02T22:15:15.622926] [DEBUG] [LOCAL ] VNT: Loaded 43549 existing records from primary storage. [2025-10-02T22:15:15.642159] [INFO ] [MAIN ] VNT: Loaded 43549 existing records. [2025-10-02T22:15:15.693367] [WARN ] [MAIN ] VOC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:15:15.776441] [INFO ] [MAIN ] VOC: Wiping existing primary data before full refresh. [2025-10-02T22:15:15.793362] [INFO ] [LOCAL ] VOC: Starting deletion of primary data. [2025-10-02T22:15:15.782951] [DEBUG] [LOCAL ] VNO: Loaded 48848 existing records from primary storage. [2025-10-02T22:15:15.806378] [DEBUG] [LOCAL ] VOC: Deleted primary data file. [2025-10-02T22:15:15.815842] [INFO ] [MAIN ] VNO: Loaded 48848 existing records. [2025-10-02T22:15:15.841097] [INFO ] [MAIN ] VOC: Starting full primary refresh. [2025-10-02T22:15:16.141731] [WARN ] [MAIN ] VNCE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:15:16.250776] [INFO ] [MAIN ] VNCE: Wiping existing primary data before full refresh. [2025-10-02T22:15:16.264521] [INFO ] [LOCAL ] VNCE: Starting deletion of primary data. [2025-10-02T22:15:16.290233] [DEBUG] [LOCAL ] VNCE: Deleted primary data file. [2025-10-02T22:15:16.297919] [WARN ] [MAIN ] VNT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:15:16.319467] [INFO ] [MAIN ] VNCE: Starting full primary refresh. [2025-10-02T22:15:16.346099] [INFO ] [MAIN ] VNT: Wiping existing primary data before full refresh. [2025-10-02T22:15:16.453530] [INFO ] [LOCAL ] VNT: Starting deletion of primary data. [2025-10-02T22:15:16.571333] [DEBUG] [LOCAL ] VNT: Deleted primary data file. [2025-10-02T22:15:16.596329] [WARN ] [MAIN ] VNO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:15:16.633557] [INFO ] [MAIN ] VNT: Starting full primary refresh. [2025-10-02T22:15:16.654463] [INFO ] [MAIN ] VNO: Wiping existing primary data before full refresh. [2025-10-02T22:15:16.700057] [INFO ] [LOCAL ] VNO: Starting deletion of primary data. [2025-10-02T22:15:16.833947] [DEBUG] [LOCAL ] VNO: Deleted primary data file. [2025-10-02T22:15:16.854602] [INFO ] [MAIN ] VNO: Starting full primary refresh. [2025-10-02T22:15:17.240926] [INFO ] [REMOTE ] VOC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:15:17.266925] [INFO ] [REMOTE ] VOC: Fetching primary data for 2024-12. [2025-10-02T22:15:17.509249] [INFO ] [REMOTE ] VNCE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:15:17.641991] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2024-12. [2025-10-02T22:15:18.033553] [INFO ] [REMOTE ] VNT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:15:18.078744] [INFO ] [REMOTE ] VNT: Fetching primary data for 2024-12. [2025-10-02T22:15:18.148023] [INFO ] [REMOTE ] VNO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:15:18.148528] [INFO ] [REMOTE ] VNO: Fetching primary data for 2024-12. [2025-10-02T22:15:18.264769] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-02T22:15:18.267560] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-01. [2025-10-02T22:15:18.542182] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-02T22:15:18.549273] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-01. [2025-10-02T22:15:19.096748] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-02T22:15:19.100001] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-02. [2025-10-02T22:15:19.370660] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-02T22:15:19.472958] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-01. [2025-10-02T22:15:19.873368] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-02T22:15:19.899971] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-02T22:15:19.925486] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-02T22:15:20.273000] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-01. [2025-10-02T22:15:21.086509] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-03. [2025-10-02T22:15:21.093912] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-02T22:15:21.872987] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-02. [2025-10-02T22:15:21.914789] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-02T22:15:21.946217] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-02T22:15:22.673049] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-02. [2025-10-02T22:15:23.172497] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-02T22:15:23.472992] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-03. [2025-10-02T22:15:23.485013] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-02T22:15:24.273022] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-03. [2025-10-02T22:15:24.870022] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-02T22:15:25.073007] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-04. [2025-10-02T22:15:25.123730] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-02T22:15:25.698267] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-02T22:15:25.873003] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-04. [2025-10-02T22:15:26.673025] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-04. [2025-10-02T22:15:27.480106] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-02. [2025-10-02T22:15:27.484915] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-02T22:15:27.505246] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-02T22:15:28.273004] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-05. [2025-10-02T22:15:28.928509] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-02T22:15:28.982253] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-02T22:15:29.072975] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-06. [2025-10-02T22:15:29.806339] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-02T22:15:29.873004] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-05. [2025-10-02T22:15:30.347710] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-02T22:15:30.672999] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-05. [2025-10-02T22:15:31.472983] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-03. [2025-10-02T22:15:32.238180] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-02T22:15:32.272968] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-06. [2025-10-02T22:15:32.931323] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-02T22:15:33.073018] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-04. [2025-10-02T22:15:33.877198] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-07. [2025-10-02T22:15:33.880054] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-02T22:15:34.485792] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-02T22:15:34.599032] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-02T22:15:34.672998] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-05. [2025-10-02T22:15:35.472995] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-08. [2025-10-02T22:15:36.060399] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-02T22:15:36.269768] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-02T22:15:36.272867] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-09. [2025-10-02T22:15:37.073000] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-07. [2025-10-02T22:15:37.102038] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-02T22:15:37.873018] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-10. [2025-10-02T22:15:38.291385] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-02T22:15:38.292508] [INFO ] [REMOTE ] VOC: Full fetch complete (13055 records). [2025-10-02T22:15:38.292614] [DEBUG] [VALIDATOR ] VOC: Validating primary data. [2025-10-02T22:15:38.674886] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-06. [2025-10-02T22:15:38.721318] [DEBUG] [VALIDATOR ] VOC: All expected trading days are present. [2025-10-02T22:15:38.721412] [DEBUG] [VALIDATOR ] VOC: Primary data validation passed. [2025-10-02T22:15:38.721917] [INFO ] [MAIN ] VOC: Fetched primary data is valid. [2025-10-02T22:15:38.722124] [DEBUG] [LOCAL ] VOC: Saving primary data. [2025-10-02T22:15:38.723202] [DEBUG] [LOCAL ] VOC: Trimmed 13055 records to 8949 (keeping 200 days of data) [2025-10-02T22:15:38.794189] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-02T22:15:38.819895] [DEBUG] [LOCAL ] VOC: Primary data saved (8949 records). [2025-10-02T22:15:38.820038] [INFO ] [MAIN ] VOC: Full history saved. [2025-10-02T22:15:38.820125] [INFO ] [MAIN ] Update Progress: 2241/2370 symbols completed. VOC took 24.3s. Estimated remaining: 18m 10s. Rate: 7.1 symbols/min [2025-10-02T22:15:39.006035] [INFO ] [MAIN ] VOYA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:15:39.048420] [DEBUG] [LOCAL ] VOYA: Loaded 42502 existing records from primary storage. [2025-10-02T22:15:39.048939] [INFO ] [MAIN ] VOYA: Loaded 42502 existing records. [2025-10-02T22:15:39.254965] [WARN ] [MAIN ] VOYA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:15:39.255209] [INFO ] [MAIN ] VOYA: Wiping existing primary data before full refresh. [2025-10-02T22:15:39.255258] [INFO ] [LOCAL ] VOYA: Starting deletion of primary data. [2025-10-02T22:15:39.255505] [DEBUG] [LOCAL ] VOYA: Deleted primary data file. [2025-10-02T22:15:39.255564] [INFO ] [MAIN ] VOYA: Starting full primary refresh. [2025-10-02T22:15:39.484618] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-08. [2025-10-02T22:15:39.648723] [INFO ] [REMOTE ] VOYA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:15:39.977707] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-02T22:15:40.273022] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-07. [2025-10-02T22:15:41.073002] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-06. [2025-10-02T22:15:41.247243] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-02T22:15:41.626164] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-02T22:15:41.866701] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-02T22:15:41.877091] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-09. [2025-10-02T22:15:42.673030] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2024-12. [2025-10-02T22:15:43.374054] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-02T22:15:43.472973] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-08. [2025-10-02T22:15:44.273053] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-07. [2025-10-02T22:15:44.325083] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-02T22:15:44.883322] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-02T22:15:44.900613] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-02T22:15:45.073014] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-01. [2025-10-02T22:15:45.872997] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-10. [2025-10-02T22:15:46.655623] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-02T22:15:46.672972] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-02. [2025-10-02T22:15:46.968686] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-02T22:15:46.970730] [INFO ] [REMOTE ] VNT: Full fetch complete (63390 records). [2025-10-02T22:15:46.970839] [DEBUG] [VALIDATOR ] VNT: Validating primary data. [2025-10-02T22:15:47.456223] [DEBUG] [VALIDATOR ] VNT: All expected trading days are present. [2025-10-02T22:15:47.456329] [DEBUG] [VALIDATOR ] VNT: Primary data validation passed. [2025-10-02T22:15:47.457549] [INFO ] [MAIN ] VNT: Fetched primary data is valid. [2025-10-02T22:15:47.457625] [DEBUG] [LOCAL ] VNT: Saving primary data. [2025-10-02T22:15:47.459456] [DEBUG] [LOCAL ] VNT: Trimmed 63390 records to 43857 (keeping 200 days of data) [2025-10-02T22:15:47.517128] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-09. [2025-10-02T22:15:47.755733] [DEBUG] [LOCAL ] VNT: Primary data saved (43857 records). [2025-10-02T22:15:47.755878] [INFO ] [MAIN ] VNT: Full history saved. [2025-10-02T22:15:47.755963] [INFO ] [MAIN ] Update Progress: 2242/2370 symbols completed. VNT took 33.2s. Estimated remaining: 18m 2s. Rate: 7.1 symbols/min [2025-10-02T22:15:47.947517] [INFO ] [MAIN ] VOYG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:15:47.947745] [DEBUG] [LOCAL ] VOYG: No existing data file found in primary storage. [2025-10-02T22:15:47.947798] [WARN ] [MAIN ] VOYG: No existing data found, performing full refresh instead. [2025-10-02T22:15:47.947952] [INFO ] [MAIN ] VOYG: Wiping existing primary data before full refresh. [2025-10-02T22:15:47.948000] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-10-02T22:15:47.948043] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-10-02T22:15:47.948079] [INFO ] [MAIN ] VOYG: Starting full primary refresh. [2025-10-02T22:15:48.272971] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-08. [2025-10-02T22:15:48.388867] [INFO ] [REMOTE ] VOYG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:15:48.392815] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-02T22:15:48.916426] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-02T22:15:48.921282] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-02T22:15:49.073049] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-09. [2025-10-02T22:15:49.873047] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2024-12. [2025-10-02T22:15:50.087266] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T22:15:50.087684] [WARN ] [REMOTE ] VOYG: No data returned for month 2024-12 [2025-10-02T22:15:50.087814] [FATAL] [REMOTE ] VOYG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T22:15:50.087928] [FATAL] [MAIN ] VOYG: Failed to fetch primary data. [2025-10-02T22:15:50.088010] [WARN ] [MAIN ] VOYG: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T22:15:50.088087] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-10-02T22:15:50.088163] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-10-02T22:15:50.088243] [INFO ] [LOCAL ] VOYG: Starting deletion of derivative data. [2025-10-02T22:15:50.088335] [DEBUG] [LOCAL ] VOYG: No derivative data file found to delete. [2025-10-02T22:15:50.088426] [INFO ] [MAIN ] Update Progress: 2243/2370 symbols completed. VOYG took 2.3s. Estimated remaining: 17m 53s. Rate: 7.1 symbols/min [2025-10-02T22:15:50.280340] [INFO ] [MAIN ] VPG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:15:50.296496] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-02T22:15:50.317251] [DEBUG] [LOCAL ] VPG: Loaded 17071 existing records from primary storage. [2025-10-02T22:15:50.317534] [INFO ] [MAIN ] VPG: Loaded 17071 existing records. [2025-10-02T22:15:50.506368] [WARN ] [MAIN ] VPG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:15:50.506682] [INFO ] [MAIN ] VPG: Wiping existing primary data before full refresh. [2025-10-02T22:15:50.506744] [INFO ] [LOCAL ] VPG: Starting deletion of primary data. [2025-10-02T22:15:50.506978] [DEBUG] [LOCAL ] VPG: Deleted primary data file. [2025-10-02T22:15:50.507038] [INFO ] [MAIN ] VPG: Starting full primary refresh. [2025-10-02T22:15:50.679071] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-10. [2025-10-02T22:15:50.917718] [INFO ] [REMOTE ] VPG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:15:51.473035] [INFO ] [REMOTE ] VPG: Fetching primary data for 2024-12. [2025-10-02T22:15:51.878872] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-02T22:15:51.880152] [INFO ] [REMOTE ] VNCE: Full fetch complete (16064 records). [2025-10-02T22:15:51.880227] [DEBUG] [VALIDATOR ] VNCE: Validating primary data. [2025-10-02T22:15:52.277080] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-03. [2025-10-02T22:15:52.288691] [DEBUG] [VALIDATOR ] VNCE: All expected trading days are present. [2025-10-02T22:15:52.289499] [DEBUG] [VALIDATOR ] VNCE: Primary data validation passed. [2025-10-02T22:15:52.290221] [INFO ] [MAIN ] VNCE: Fetched primary data is valid. [2025-10-02T22:15:52.290859] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-02T22:15:52.294798] [DEBUG] [LOCAL ] VNCE: Saving primary data. [2025-10-02T22:15:52.296219] [DEBUG] [LOCAL ] VNCE: Trimmed 16064 records to 8168 (keeping 200 days of data) [2025-10-02T22:15:52.345361] [DEBUG] [LOCAL ] VNCE: Primary data saved (8168 records). [2025-10-02T22:15:52.345509] [INFO ] [MAIN ] VNCE: Full history saved. [2025-10-02T22:15:52.345603] [INFO ] [MAIN ] Update Progress: 2244/2370 symbols completed. VNCE took 37.8s. Estimated remaining: 17m 44s. Rate: 7.1 symbols/min [2025-10-02T22:15:52.526733] [INFO ] [MAIN ] VPV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:15:52.542451] [DEBUG] [LOCAL ] VPV: Loaded 5397 existing records from primary storage. [2025-10-02T22:15:52.542816] [INFO ] [MAIN ] VPV: Loaded 5397 existing records. [2025-10-02T22:15:52.744719] [WARN ] [MAIN ] VPV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:15:52.744988] [INFO ] [MAIN ] VPV: Wiping existing primary data before full refresh. [2025-10-02T22:15:52.745053] [INFO ] [LOCAL ] VPV: Starting deletion of primary data. [2025-10-02T22:15:52.745338] [DEBUG] [LOCAL ] VPV: Deleted primary data file. [2025-10-02T22:15:52.745399] [INFO ] [MAIN ] VPV: Starting full primary refresh. [2025-10-02T22:15:53.078155] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-10. [2025-10-02T22:15:53.140197] [INFO ] [REMOTE ] VPV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:15:53.872994] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-01. [2025-10-02T22:15:53.972672] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-02T22:15:54.283903] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-02T22:15:54.285875] [INFO ] [REMOTE ] VNO: Full fetch complete (70478 records). [2025-10-02T22:15:54.285996] [DEBUG] [VALIDATOR ] VNO: Validating primary data. [2025-10-02T22:15:54.676390] [INFO ] [REMOTE ] VPV: Fetching primary data for 2024-12. [2025-10-02T22:15:54.719489] [DEBUG] [VALIDATOR ] VNO: All expected trading days are present. [2025-10-02T22:15:54.719558] [DEBUG] [VALIDATOR ] VNO: Primary data validation passed. [2025-10-02T22:15:54.720876] [INFO ] [MAIN ] VNO: Fetched primary data is valid. [2025-10-02T22:15:54.721179] [DEBUG] [LOCAL ] VNO: Saving primary data. [2025-10-02T22:15:54.722705] [DEBUG] [LOCAL ] VNO: Trimmed 70478 records to 49196 (keeping 200 days of data) [2025-10-02T22:15:54.820333] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-02T22:15:55.041568] [DEBUG] [LOCAL ] VNO: Primary data saved (49196 records). [2025-10-02T22:15:55.041746] [INFO ] [MAIN ] VNO: Full history saved. [2025-10-02T22:15:55.041843] [INFO ] [MAIN ] Update Progress: 2245/2370 symbols completed. VNO took 40.5s. Estimated remaining: 17m 35s. Rate: 7.1 symbols/min [2025-10-02T22:15:55.235340] [INFO ] [MAIN ] VRE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:15:55.272871] [DEBUG] [LOCAL ] VRE: Loaded 34992 existing records from primary storage. [2025-10-02T22:15:55.273277] [INFO ] [MAIN ] VRE: Loaded 34992 existing records. [2025-10-02T22:15:55.478108] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-04. [2025-10-02T22:15:55.507176] [WARN ] [MAIN ] VRE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:15:55.508623] [INFO ] [MAIN ] VRE: Wiping existing primary data before full refresh. [2025-10-02T22:15:55.517670] [INFO ] [LOCAL ] VRE: Starting deletion of primary data. [2025-10-02T22:15:55.519324] [DEBUG] [LOCAL ] VRE: Deleted primary data file. [2025-10-02T22:15:55.519240] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-02T22:15:55.519474] [INFO ] [MAIN ] VRE: Starting full primary refresh. [2025-10-02T22:15:55.942545] [INFO ] [REMOTE ] VRE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:15:56.273001] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-02. [2025-10-02T22:15:56.865361] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-02T22:15:57.073007] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-03. [2025-10-02T22:15:57.322475] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-02T22:15:57.787334] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-02T22:15:57.872981] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-04. [2025-10-02T22:15:58.673019] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-05. [2025-10-02T22:15:59.028507] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-02T22:15:59.473022] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-01. [2025-10-02T22:15:59.970696] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-02T22:16:00.273059] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-05. [2025-10-02T22:16:00.286374] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-02T22:16:01.073032] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-02. [2025-10-02T22:16:01.451014] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-02T22:16:01.853804] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-02T22:16:01.872992] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-03. [2025-10-02T22:16:02.506995] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-02T22:16:02.673084] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-06. [2025-10-02T22:16:03.473057] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-06. [2025-10-02T22:16:04.115266] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-02T22:16:04.251729] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-02T22:16:04.272971] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-07. [2025-10-02T22:16:05.073057] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-04. [2025-10-02T22:16:05.338882] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-02T22:16:05.813413] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-02T22:16:05.873046] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-08. [2025-10-02T22:16:06.673019] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-07. [2025-10-02T22:16:06.803602] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-02T22:16:07.473025] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-05. [2025-10-02T22:16:07.918747] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-02T22:16:08.272985] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-09. [2025-10-02T22:16:08.422696] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-02T22:16:08.914548] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-02T22:16:09.073012] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-06. [2025-10-02T22:16:09.506457] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-02T22:16:09.873026] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-07. [2025-10-02T22:16:10.577632] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-02T22:16:10.673008] [INFO ] [REMOTE ] VRE: Fetching primary data for 2024-12. [2025-10-02T22:16:11.473026] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-08. [2025-10-02T22:16:11.975602] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-02T22:16:12.121498] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-02T22:16:12.273039] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-09. [2025-10-02T22:16:12.765227] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-02T22:16:13.073064] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-01. [2025-10-02T22:16:13.872970] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-10. [2025-10-02T22:16:14.363145] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-02T22:16:14.362426] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-02T22:16:14.370587] [INFO ] [REMOTE ] VPV: Full fetch complete (9282 records). [2025-10-02T22:16:14.370760] [DEBUG] [VALIDATOR ] VPV: Validating primary data. [2025-10-02T22:16:14.678154] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-10. [2025-10-02T22:16:14.765423] [DEBUG] [VALIDATOR ] VPV: All expected trading days are present. [2025-10-02T22:16:14.765511] [DEBUG] [VALIDATOR ] VPV: Primary data validation passed. [2025-10-02T22:16:14.765757] [INFO ] [MAIN ] VPV: Fetched primary data is valid. [2025-10-02T22:16:14.765818] [DEBUG] [LOCAL ] VPV: Saving primary data. [2025-10-02T22:16:14.766272] [DEBUG] [LOCAL ] VPV: Trimmed 9282 records to 5432 (keeping 200 days of data) [2025-10-02T22:16:14.800945] [DEBUG] [LOCAL ] VPV: Primary data saved (5432 records). [2025-10-02T22:16:14.801070] [INFO ] [MAIN ] VPV: Full history saved. [2025-10-02T22:16:14.801167] [INFO ] [MAIN ] Update Progress: 2246/2370 symbols completed. VPV took 22.5s. Estimated remaining: 17m 27s. Rate: 7.1 symbols/min [2025-10-02T22:16:14.987745] [INFO ] [MAIN ] VRT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:16:15.056513] [DEBUG] [LOCAL ] VRT: Loaded 53753 existing records from primary storage. [2025-10-02T22:16:15.056940] [INFO ] [MAIN ] VRT: Loaded 53753 existing records. [2025-10-02T22:16:15.258234] [WARN ] [MAIN ] VRT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:16:15.258494] [INFO ] [MAIN ] VRT: Wiping existing primary data before full refresh. [2025-10-02T22:16:15.258562] [INFO ] [LOCAL ] VRT: Starting deletion of primary data. [2025-10-02T22:16:15.258977] [DEBUG] [LOCAL ] VRT: Deleted primary data file. [2025-10-02T22:16:15.259040] [INFO ] [MAIN ] VRT: Starting full primary refresh. [2025-10-02T22:16:15.380908] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-02T22:16:15.382518] [INFO ] [REMOTE ] VPG: Full fetch complete (22853 records). [2025-10-02T22:16:15.398307] [DEBUG] [VALIDATOR ] VPG: Validating primary data. [2025-10-02T22:16:15.477044] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-02. [2025-10-02T22:16:15.961971] [INFO ] [REMOTE ] VRT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:16:16.090034] [DEBUG] [VALIDATOR ] VPG: All expected trading days are present. [2025-10-02T22:16:16.090112] [DEBUG] [VALIDATOR ] VPG: Primary data validation passed. [2025-10-02T22:16:16.090732] [INFO ] [MAIN ] VPG: Fetched primary data is valid. [2025-10-02T22:16:16.090811] [DEBUG] [LOCAL ] VPG: Saving primary data. [2025-10-02T22:16:16.091561] [DEBUG] [LOCAL ] VPG: Trimmed 22853 records to 17197 (keeping 200 days of data) [2025-10-02T22:16:16.202399] [DEBUG] [LOCAL ] VPG: Primary data saved (17197 records). [2025-10-02T22:16:16.202578] [INFO ] [MAIN ] VPG: Full history saved. [2025-10-02T22:16:16.202725] [INFO ] [MAIN ] Update Progress: 2247/2370 symbols completed. VPG took 26.1s. Estimated remaining: 17m 19s. Rate: 7.1 symbols/min [2025-10-02T22:16:16.278196] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-08. [2025-10-02T22:16:16.396100] [INFO ] [MAIN ] VRTS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:16:16.409380] [DEBUG] [LOCAL ] VRTS: Loaded 9308 existing records from primary storage. [2025-10-02T22:16:16.409725] [INFO ] [MAIN ] VRTS: Loaded 9308 existing records. [2025-10-02T22:16:16.618767] [WARN ] [MAIN ] VRTS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:16:16.619060] [INFO ] [MAIN ] VRTS: Wiping existing primary data before full refresh. [2025-10-02T22:16:16.619120] [INFO ] [LOCAL ] VRTS: Starting deletion of primary data. [2025-10-02T22:16:16.619352] [DEBUG] [LOCAL ] VRTS: Deleted primary data file. [2025-10-02T22:16:16.619412] [INFO ] [MAIN ] VRTS: Starting full primary refresh. [2025-10-02T22:16:16.939997] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-02T22:16:17.031862] [INFO ] [REMOTE ] VRTS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:16:17.073130] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-03. [2025-10-02T22:16:17.558941] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-02T22:16:17.873033] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-09. [2025-10-02T22:16:18.175990] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-02T22:16:18.673017] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-04. [2025-10-02T22:16:19.448356] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-02T22:16:19.472981] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-10. [2025-10-02T22:16:20.202006] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-02T22:16:20.273055] [INFO ] [REMOTE ] VRT: Fetching primary data for 2024-12. [2025-10-02T22:16:20.515733] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-02T22:16:20.517538] [INFO ] [REMOTE ] VOYA: Full fetch complete (61909 records). [2025-10-02T22:16:20.517776] [DEBUG] [VALIDATOR ] VOYA: Validating primary data. [2025-10-02T22:16:21.019392] [DEBUG] [VALIDATOR ] VOYA: All expected trading days are present. [2025-10-02T22:16:21.019488] [DEBUG] [VALIDATOR ] VOYA: Primary data validation passed. [2025-10-02T22:16:21.020788] [INFO ] [MAIN ] VOYA: Fetched primary data is valid. [2025-10-02T22:16:21.020895] [DEBUG] [LOCAL ] VOYA: Saving primary data. [2025-10-02T22:16:21.026849] [DEBUG] [LOCAL ] VOYA: Trimmed 61909 records to 42817 (keeping 200 days of data) [2025-10-02T22:16:21.090127] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2024-12. [2025-10-02T22:16:21.332061] [DEBUG] [LOCAL ] VOYA: Primary data saved (42817 records). [2025-10-02T22:16:21.332195] [INFO ] [MAIN ] VOYA: Full history saved. [2025-10-02T22:16:21.332308] [INFO ] [MAIN ] Update Progress: 2248/2370 symbols completed. VOYA took 42.5s. Estimated remaining: 17m 10s. Rate: 7.1 symbols/min [2025-10-02T22:16:21.550316] [INFO ] [MAIN ] VSCO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:16:21.621795] [DEBUG] [LOCAL ] VSCO: Loaded 52765 existing records from primary storage. [2025-10-02T22:16:21.622282] [INFO ] [MAIN ] VSCO: Loaded 52765 existing records. [2025-10-02T22:16:21.863914] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-02T22:16:21.873360] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-05. [2025-10-02T22:16:21.904016] [WARN ] [MAIN ] VSCO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:16:21.905710] [INFO ] [MAIN ] VSCO: Wiping existing primary data before full refresh. [2025-10-02T22:16:21.907938] [INFO ] [LOCAL ] VSCO: Starting deletion of primary data. [2025-10-02T22:16:21.908277] [DEBUG] [LOCAL ] VSCO: Deleted primary data file. [2025-10-02T22:16:21.908361] [INFO ] [MAIN ] VSCO: Starting full primary refresh. [2025-10-02T22:16:22.307765] [INFO ] [REMOTE ] VSCO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:16:22.672994] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2024-12. [2025-10-02T22:16:22.790480] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2024-12 (2.52 seconds). [2025-10-02T22:16:23.023441] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-02T22:16:23.473068] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-06. [2025-10-02T22:16:24.273056] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-01. [2025-10-02T22:16:24.571132] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-02T22:16:24.583851] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-02T22:16:25.073003] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-07. [2025-10-02T22:16:25.872985] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-01. [2025-10-02T22:16:26.088179] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-02T22:16:26.235155] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-02T22:16:26.488220] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-02T22:16:26.673053] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-02. [2025-10-02T22:16:27.473017] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-08. [2025-10-02T22:16:28.273026] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-01. [2025-10-02T22:16:28.776176] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-02T22:16:28.814480] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-10-02T22:16:29.073024] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-09. [2025-10-02T22:16:29.873010] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-02. [2025-10-02T22:16:30.048991] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-02T22:16:30.605746] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-02T22:16:30.653230] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-02T22:16:30.672959] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-03. [2025-10-02T22:16:31.159035] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-02T22:16:31.473024] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-10. [2025-10-02T22:16:32.273004] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-04. [2025-10-02T22:16:32.447418] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-02T22:16:32.449371] [INFO ] [REMOTE ] VRE: Full fetch complete (48252 records). [2025-10-02T22:16:32.449476] [DEBUG] [VALIDATOR ] VRE: Validating primary data. [2025-10-02T22:16:32.878908] [DEBUG] [VALIDATOR ] VRE: All expected trading days are present. [2025-10-02T22:16:32.879108] [DEBUG] [VALIDATOR ] VRE: Primary data validation passed. [2025-10-02T22:16:32.880160] [INFO ] [MAIN ] VRE: Fetched primary data is valid. [2025-10-02T22:16:32.880234] [DEBUG] [LOCAL ] VRE: Saving primary data. [2025-10-02T22:16:32.881778] [DEBUG] [LOCAL ] VRE: Trimmed 48252 records to 35252 (keeping 200 days of data) [2025-10-02T22:16:33.077495] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-02. [2025-10-02T22:16:33.109131] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-02T22:16:33.144895] [DEBUG] [LOCAL ] VRE: Primary data saved (35252 records). [2025-10-02T22:16:33.145047] [INFO ] [MAIN ] VRE: Full history saved. [2025-10-02T22:16:33.145161] [INFO ] [MAIN ] Update Progress: 2249/2370 symbols completed. VRE took 38.1s. Estimated remaining: 17m 2s. Rate: 7.1 symbols/min [2025-10-02T22:16:33.346185] [INFO ] [MAIN ] VSH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:16:33.403497] [DEBUG] [LOCAL ] VSH: Loaded 48344 existing records from primary storage. [2025-10-02T22:16:33.403869] [INFO ] [MAIN ] VSH: Loaded 48344 existing records. [2025-10-02T22:16:33.608308] [WARN ] [MAIN ] VSH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:16:33.608574] [INFO ] [MAIN ] VSH: Wiping existing primary data before full refresh. [2025-10-02T22:16:33.608641] [INFO ] [LOCAL ] VSH: Starting deletion of primary data. [2025-10-02T22:16:33.609057] [DEBUG] [LOCAL ] VSH: Deleted primary data file. [2025-10-02T22:16:33.609117] [INFO ] [MAIN ] VSH: Starting full primary refresh. [2025-10-02T22:16:33.874678] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-05. [2025-10-02T22:16:34.005987] [INFO ] [REMOTE ] VSH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:16:34.623091] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-02T22:16:34.644100] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-02T22:16:34.672973] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-03. [2025-10-02T22:16:35.473025] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-03. [2025-10-02T22:16:36.273010] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-06. [2025-10-02T22:16:36.529147] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-02T22:16:37.073032] [INFO ] [REMOTE ] VSH: Fetching primary data for 2024-12. [2025-10-02T22:16:37.223074] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-02T22:16:37.848798] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-10-02T22:16:37.872985] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-04. [2025-10-02T22:16:38.673042] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-04. [2025-10-02T22:16:38.728729] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-02T22:16:39.473064] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-01. [2025-10-02T22:16:40.094610] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-02T22:16:40.273021] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-07. [2025-10-02T22:16:40.558002] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-02T22:16:40.887358] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-02T22:16:41.072972] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-08. [2025-10-02T22:16:41.197420] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-02T22:16:41.702798] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-02T22:16:41.873095] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-05. [2025-10-02T22:16:42.673022] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-09. [2025-10-02T22:16:43.413310] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-02T22:16:43.472961] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-10. [2025-10-02T22:16:44.040740] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-02T22:16:44.041837] [INFO ] [REMOTE ] VRTS: Full fetch complete (11445 records). [2025-10-02T22:16:44.041918] [DEBUG] [VALIDATOR ] VRTS: Validating primary data. [2025-10-02T22:16:44.280427] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-05. [2025-10-02T22:16:44.464787] [DEBUG] [VALIDATOR ] VRTS: All expected trading days are present. [2025-10-02T22:16:44.464940] [DEBUG] [VALIDATOR ] VRTS: Primary data validation passed. [2025-10-02T22:16:44.465408] [INFO ] [MAIN ] VRTS: Fetched primary data is valid. [2025-10-02T22:16:44.465499] [DEBUG] [LOCAL ] VRTS: Saving primary data. [2025-10-02T22:16:44.466615] [DEBUG] [LOCAL ] VRTS: Trimmed 11445 records to 9342 (keeping 200 days of data) [2025-10-02T22:16:44.551465] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-05 (2.68 seconds). [2025-10-02T22:16:44.580549] [DEBUG] [LOCAL ] VRTS: Primary data saved (9342 records). [2025-10-02T22:16:44.580746] [INFO ] [MAIN ] VRTS: Full history saved. [2025-10-02T22:16:44.580883] [INFO ] [MAIN ] Update Progress: 2250/2370 symbols completed. VRTS took 28.4s. Estimated remaining: 16m 53s. Rate: 7.1 symbols/min [2025-10-02T22:16:44.781585] [INFO ] [MAIN ] VST: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:16:44.850272] [DEBUG] [LOCAL ] VST: Loaded 53718 existing records from primary storage. [2025-10-02T22:16:44.850673] [INFO ] [MAIN ] VST: Loaded 53718 existing records. [2025-10-02T22:16:45.061119] [WARN ] [MAIN ] VST: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:16:45.061361] [INFO ] [MAIN ] VST: Wiping existing primary data before full refresh. [2025-10-02T22:16:45.061469] [INFO ] [LOCAL ] VST: Starting deletion of primary data. [2025-10-02T22:16:45.061748] [DEBUG] [LOCAL ] VST: Deleted primary data file. [2025-10-02T22:16:45.061837] [INFO ] [MAIN ] VST: Starting full primary refresh. [2025-10-02T22:16:45.078163] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-06. [2025-10-02T22:16:45.471607] [INFO ] [REMOTE ] VST: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:16:45.873051] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-02. [2025-10-02T22:16:46.262346] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-02T22:16:46.673039] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-06. [2025-10-02T22:16:47.271444] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-02T22:16:47.473002] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-03. [2025-10-02T22:16:47.649078] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-06 (2.57 seconds). [2025-10-02T22:16:48.272998] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-07. [2025-10-02T22:16:48.513060] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-02T22:16:49.006829] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-02T22:16:49.073029] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-04. [2025-10-02T22:16:49.873013] [INFO ] [REMOTE ] VST: Fetching primary data for 2024-12. [2025-10-02T22:16:50.593946] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-02T22:16:50.673047] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-08. [2025-10-02T22:16:50.792334] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-02T22:16:51.473034] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-07. [2025-10-02T22:16:51.983373] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-02T22:16:52.273049] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-05. [2025-10-02T22:16:52.900698] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-02T22:16:52.979931] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-02T22:16:53.073009] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-09. [2025-10-02T22:16:53.872991] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-08. [2025-10-02T22:16:54.031100] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-02T22:16:54.673047] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-01. [2025-10-02T22:16:55.367221] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-10-02T22:16:55.473006] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-10. [2025-10-02T22:16:55.605743] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-02T22:16:56.273046] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-09. [2025-10-02T22:16:57.072988] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-06. [2025-10-02T22:16:57.318397] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-01 (2.65 seconds). [2025-10-02T22:16:57.791465] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-10 (2.32 seconds). [2025-10-02T22:16:57.794451] [INFO ] [REMOTE ] VRT: Full fetch complete (77831 records). [2025-10-02T22:16:57.794615] [DEBUG] [VALIDATOR ] VRT: Validating primary data. [2025-10-02T22:16:57.880320] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-02. [2025-10-02T22:16:58.237904] [DEBUG] [VALIDATOR ] VRT: All expected trading days are present. [2025-10-02T22:16:58.238235] [DEBUG] [VALIDATOR ] VRT: Primary data validation passed. [2025-10-02T22:16:58.239901] [INFO ] [MAIN ] VRT: Fetched primary data is valid. [2025-10-02T22:16:58.240137] [DEBUG] [LOCAL ] VRT: Saving primary data. [2025-10-02T22:16:58.258270] [DEBUG] [LOCAL ] VRT: Trimmed 77831 records to 54143 (keeping 200 days of data) [2025-10-02T22:16:58.277233] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-02T22:16:58.427043] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-02T22:16:58.674888] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-07. [2025-10-02T22:16:58.707338] [DEBUG] [LOCAL ] VRT: Primary data saved (54143 records). [2025-10-02T22:16:58.707503] [INFO ] [MAIN ] VRT: Full history saved. [2025-10-02T22:16:58.708992] [INFO ] [MAIN ] Update Progress: 2251/2370 symbols completed. VRT took 43.9s. Estimated remaining: 16m 45s. Rate: 7.1 symbols/min [2025-10-02T22:16:58.898877] [INFO ] [MAIN ] VSTS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:16:58.948810] [DEBUG] [LOCAL ] VSTS: Loaded 49026 existing records from primary storage. [2025-10-02T22:16:58.949146] [INFO ] [MAIN ] VSTS: Loaded 49026 existing records. [2025-10-02T22:16:59.147422] [WARN ] [MAIN ] VSTS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:16:59.148167] [INFO ] [MAIN ] VSTS: Wiping existing primary data before full refresh. [2025-10-02T22:16:59.148229] [INFO ] [LOCAL ] VSTS: Starting deletion of primary data. [2025-10-02T22:16:59.148719] [DEBUG] [LOCAL ] VSTS: Deleted primary data file. [2025-10-02T22:16:59.148836] [INFO ] [MAIN ] VSTS: Starting full primary refresh. [2025-10-02T22:16:59.484410] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-10. [2025-10-02T22:16:59.577945] [INFO ] [REMOTE ] VSTS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:17:00.080378] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-02T22:17:00.273005] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2024-12. [2025-10-02T22:17:00.560157] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-02 (2.68 seconds). [2025-10-02T22:17:00.946011] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-02T22:17:00.948184] [INFO ] [REMOTE ] VSCO: Full fetch complete (76174 records). [2025-10-02T22:17:00.948328] [DEBUG] [VALIDATOR ] VSCO: Validating primary data. [2025-10-02T22:17:01.078099] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-08. [2025-10-02T22:17:01.390593] [DEBUG] [VALIDATOR ] VSCO: All expected trading days are present. [2025-10-02T22:17:01.390731] [DEBUG] [VALIDATOR ] VSCO: Primary data validation passed. [2025-10-02T22:17:01.392058] [INFO ] [MAIN ] VSCO: Fetched primary data is valid. [2025-10-02T22:17:01.392164] [DEBUG] [LOCAL ] VSCO: Saving primary data. [2025-10-02T22:17:01.393961] [DEBUG] [LOCAL ] VSCO: Trimmed 76174 records to 53154 (keeping 200 days of data) [2025-10-02T22:17:01.745191] [DEBUG] [LOCAL ] VSCO: Primary data saved (53154 records). [2025-10-02T22:17:01.745357] [INFO ] [MAIN ] VSCO: Full history saved. [2025-10-02T22:17:01.745451] [INFO ] [MAIN ] Update Progress: 2252/2370 symbols completed. VSCO took 40.4s. Estimated remaining: 16m 36s. Rate: 7.1 symbols/min [2025-10-02T22:17:01.873802] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-03. [2025-10-02T22:17:01.944708] [INFO ] [MAIN ] VTEX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:17:01.999667] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-02T22:17:02.026667] [DEBUG] [LOCAL ] VTEX: Loaded 43194 existing records from primary storage. [2025-10-02T22:17:02.026983] [INFO ] [MAIN ] VTEX: Loaded 43194 existing records. [2025-10-02T22:17:02.225048] [WARN ] [MAIN ] VTEX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:17:02.225302] [INFO ] [MAIN ] VTEX: Wiping existing primary data before full refresh. [2025-10-02T22:17:02.225355] [INFO ] [LOCAL ] VTEX: Starting deletion of primary data. [2025-10-02T22:17:02.225721] [DEBUG] [LOCAL ] VTEX: Deleted primary data file. [2025-10-02T22:17:02.225782] [INFO ] [MAIN ] VTEX: Starting full primary refresh. [2025-10-02T22:17:02.621283] [INFO ] [REMOTE ] VTEX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:17:02.670215] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-02T22:17:02.685191] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2024-12. [2025-10-02T22:17:03.472997] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-01. [2025-10-02T22:17:04.142754] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-02T22:17:04.273061] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-01. [2025-10-02T22:17:04.541883] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-03 (2.67 seconds). [2025-10-02T22:17:05.072998] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-09. [2025-10-02T22:17:05.164702] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-02T22:17:05.232742] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-02T22:17:05.872998] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-02. [2025-10-02T22:17:06.649302] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-02T22:17:06.672973] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-02. [2025-10-02T22:17:06.953395] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-02T22:17:07.472990] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-04. [2025-10-02T22:17:08.208103] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-02T22:17:08.273009] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-10. [2025-10-02T22:17:09.073001] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-03. [2025-10-02T22:17:09.484578] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-02T22:17:09.486583] [INFO ] [REMOTE ] VSH: Full fetch complete (70972 records). [2025-10-02T22:17:09.486756] [DEBUG] [VALIDATOR ] VSH: Validating primary data. [2025-10-02T22:17:09.891528] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-03. [2025-10-02T22:17:09.915992] [DEBUG] [VALIDATOR ] VSH: All expected trading days are present. [2025-10-02T22:17:09.916181] [DEBUG] [VALIDATOR ] VSH: Primary data validation passed. [2025-10-02T22:17:09.917443] [INFO ] [MAIN ] VSH: Fetched primary data is valid. [2025-10-02T22:17:09.917537] [DEBUG] [LOCAL ] VSH: Saving primary data. [2025-10-02T22:17:09.919520] [DEBUG] [LOCAL ] VSH: Trimmed 70972 records to 48691 (keeping 200 days of data) [2025-10-02T22:17:10.068003] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-04 (2.60 seconds). [2025-10-02T22:17:10.310103] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-02T22:17:10.335446] [DEBUG] [LOCAL ] VSH: Primary data saved (48691 records). [2025-10-02T22:17:10.335602] [INFO ] [MAIN ] VSH: Full history saved. [2025-10-02T22:17:10.335781] [INFO ] [MAIN ] Update Progress: 2253/2370 symbols completed. VSH took 37.2s. Estimated remaining: 16m 28s. Rate: 7.1 symbols/min [2025-10-02T22:17:10.521479] [INFO ] [MAIN ] VTLE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:17:10.569959] [DEBUG] [LOCAL ] VTLE: Loaded 48471 existing records from primary storage. [2025-10-02T22:17:10.570365] [INFO ] [MAIN ] VTLE: Loaded 48471 existing records. [2025-10-02T22:17:10.678542] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-04. [2025-10-02T22:17:10.766713] [WARN ] [MAIN ] VTLE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:17:10.766945] [INFO ] [MAIN ] VTLE: Wiping existing primary data before full refresh. [2025-10-02T22:17:10.766994] [INFO ] [LOCAL ] VTLE: Starting deletion of primary data. [2025-10-02T22:17:10.767524] [DEBUG] [LOCAL ] VTLE: Deleted primary data file. [2025-10-02T22:17:10.767585] [INFO ] [MAIN ] VTLE: Starting full primary refresh. [2025-10-02T22:17:11.177842] [INFO ] [REMOTE ] VTLE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:17:11.472983] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-05. [2025-10-02T22:17:11.574478] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-02T22:17:12.049613] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-02T22:17:12.273071] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-05. [2025-10-02T22:17:13.073031] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2024-12. [2025-10-02T22:17:13.807987] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-02T22:17:13.872992] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-04. [2025-10-02T22:17:13.927969] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-05 (2.45 seconds). [2025-10-02T22:17:14.623095] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-02T22:17:14.673024] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-06. [2025-10-02T22:17:15.473010] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-06. [2025-10-02T22:17:15.508441] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-02T22:17:16.273039] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-05. [2025-10-02T22:17:16.796428] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-02T22:17:16.847455] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-02T22:17:17.073024] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-07. [2025-10-02T22:17:17.260690] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-02T22:17:17.873018] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-06. [2025-10-02T22:17:18.673010] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-01. [2025-10-02T22:17:19.396154] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-02T22:17:19.473014] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-07. [2025-10-02T22:17:19.752021] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-07 (2.68 seconds). [2025-10-02T22:17:20.273064] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-08. [2025-10-02T22:17:20.476813] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-02T22:17:21.072979] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-02. [2025-10-02T22:17:21.160715] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-02T22:17:21.873013] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-08. [2025-10-02T22:17:22.665831] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-02T22:17:22.677388] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-07. [2025-10-02T22:17:22.750920] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-08 (2.48 seconds). [2025-10-02T22:17:23.112633] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-02T22:17:23.472992] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-03. [2025-10-02T22:17:24.273002] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-09. [2025-10-02T22:17:24.357007] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-02T22:17:25.072990] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-09. [2025-10-02T22:17:25.297592] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-02T22:17:25.873023] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-08. [2025-10-02T22:17:26.672993] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-04. [2025-10-02T22:17:26.735696] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-10-02T22:17:26.780376] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-02T22:17:27.472990] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-10. [2025-10-02T22:17:27.519333] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-02T22:17:28.272992] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-10. [2025-10-02T22:17:28.379058] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-02T22:17:29.072969] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-05. [2025-10-02T22:17:29.246429] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-02T22:17:29.248914] [INFO ] [REMOTE ] VST: Full fetch complete (77807 records). [2025-10-02T22:17:29.249082] [DEBUG] [VALIDATOR ] VST: Validating primary data. [2025-10-02T22:17:29.447404] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-02T22:17:29.487238] [INFO ] [REMOTE ] VSTS: Full fetch complete (69797 records). [2025-10-02T22:17:29.532311] [DEBUG] [VALIDATOR ] VSTS: Validating primary data. [2025-10-02T22:17:29.880977] [DEBUG] [VALIDATOR ] VST: All expected trading days are present. [2025-10-02T22:17:29.876689] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-09. [2025-10-02T22:17:29.892706] [DEBUG] [VALIDATOR ] VST: Primary data validation passed. [2025-10-02T22:17:29.925022] [INFO ] [MAIN ] VST: Fetched primary data is valid. [2025-10-02T22:17:29.960703] [DEBUG] [LOCAL ] VST: Saving primary data. [2025-10-02T22:17:30.073484] [DEBUG] [LOCAL ] VST: Trimmed 77807 records to 54108 (keeping 200 days of data) [2025-10-02T22:17:30.305519] [DEBUG] [VALIDATOR ] VSTS: All expected trading days are present. [2025-10-02T22:17:30.306037] [DEBUG] [VALIDATOR ] VSTS: Primary data validation passed. [2025-10-02T22:17:30.307982] [INFO ] [MAIN ] VSTS: Fetched primary data is valid. [2025-10-02T22:17:30.308441] [DEBUG] [LOCAL ] VSTS: Saving primary data. [2025-10-02T22:17:30.313329] [DEBUG] [LOCAL ] VSTS: Trimmed 69797 records to 49392 (keeping 200 days of data) [2025-10-02T22:17:30.610925] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-02T22:17:30.683161] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-06. [2025-10-02T22:17:30.939812] [DEBUG] [LOCAL ] VSTS: Primary data saved (49392 records). [2025-10-02T22:17:30.940466] [INFO ] [MAIN ] VSTS: Full history saved. [2025-10-02T22:17:30.943278] [INFO ] [MAIN ] Update Progress: 2254/2370 symbols completed. VSTS took 32.2s. Estimated remaining: 16m 20s. Rate: 7.1 symbols/min [2025-10-02T22:17:31.067109] [DEBUG] [LOCAL ] VST: Primary data saved (54108 records). [2025-10-02T22:17:31.070421] [INFO ] [MAIN ] VST: Full history saved. [2025-10-02T22:17:31.070875] [INFO ] [MAIN ] Update Progress: 2255/2370 symbols completed. VST took 46.5s. Estimated remaining: 16m 11s. Rate: 7.1 symbols/min [2025-10-02T22:17:31.201980] [INFO ] [MAIN ] VTMX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:17:31.351273] [INFO ] [MAIN ] VTN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:17:31.361021] [DEBUG] [LOCAL ] VTMX: Loaded 17524 existing records from primary storage. [2025-10-02T22:17:31.361577] [INFO ] [MAIN ] VTMX: Loaded 17524 existing records. [2025-10-02T22:17:31.449967] [DEBUG] [LOCAL ] VTN: Loaded 7038 existing records from primary storage. [2025-10-02T22:17:31.484178] [INFO ] [MAIN ] VTN: Loaded 7038 existing records. [2025-10-02T22:17:31.667218] [WARN ] [MAIN ] VTMX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:17:31.686923] [INFO ] [MAIN ] VTMX: Wiping existing primary data before full refresh. [2025-10-02T22:17:31.692210] [INFO ] [LOCAL ] VTMX: Starting deletion of primary data. [2025-10-02T22:17:31.749852] [DEBUG] [LOCAL ] VTMX: Deleted primary data file. [2025-10-02T22:17:31.790440] [INFO ] [MAIN ] VTMX: Starting full primary refresh. [2025-10-02T22:17:31.790310] [WARN ] [MAIN ] VTN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:17:31.827608] [INFO ] [MAIN ] VTN: Wiping existing primary data before full refresh. [2025-10-02T22:17:31.828365] [INFO ] [LOCAL ] VTN: Starting deletion of primary data. [2025-10-02T22:17:31.839936] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-02T22:17:31.840075] [DEBUG] [LOCAL ] VTN: Deleted primary data file. [2025-10-02T22:17:31.914308] [INFO ] [MAIN ] VTN: Starting full primary refresh. [2025-10-02T22:17:31.976171] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-10. [2025-10-02T22:17:32.587610] [INFO ] [REMOTE ] VTMX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:17:32.593441] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2024-12. [2025-10-02T22:17:32.755720] [INFO ] [REMOTE ] VTN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:17:32.755796] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-02T22:17:33.072981] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-07. [2025-10-02T22:17:33.221904] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-02T22:17:33.223538] [INFO ] [REMOTE ] VTEX: Full fetch complete (60604 records). [2025-10-02T22:17:33.223624] [DEBUG] [VALIDATOR ] VTEX: Validating primary data. [2025-10-02T22:17:33.629805] [DEBUG] [VALIDATOR ] VTEX: All expected trading days are present. [2025-10-02T22:17:33.629906] [DEBUG] [VALIDATOR ] VTEX: Primary data validation passed. [2025-10-02T22:17:33.631200] [INFO ] [MAIN ] VTEX: Fetched primary data is valid. [2025-10-02T22:17:33.631266] [DEBUG] [LOCAL ] VTEX: Saving primary data. [2025-10-02T22:17:33.632617] [DEBUG] [LOCAL ] VTEX: Trimmed 60604 records to 43470 (keeping 200 days of data) [2025-10-02T22:17:33.747901] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-02T22:17:33.873062] [INFO ] [REMOTE ] VTN: Fetching primary data for 2024-12. [2025-10-02T22:17:33.926753] [DEBUG] [LOCAL ] VTEX: Primary data saved (43470 records). [2025-10-02T22:17:33.926911] [INFO ] [MAIN ] VTEX: Full history saved. [2025-10-02T22:17:33.927066] [INFO ] [MAIN ] Update Progress: 2256/2370 symbols completed. VTEX took 32.2s. Estimated remaining: 16m 3s. Rate: 7.1 symbols/min [2025-10-02T22:17:34.110234] [INFO ] [MAIN ] VTOL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:17:34.130545] [DEBUG] [LOCAL ] VTOL: Loaded 19565 existing records from primary storage. [2025-10-02T22:17:34.130849] [INFO ] [MAIN ] VTOL: Loaded 19565 existing records. [2025-10-02T22:17:34.318166] [WARN ] [MAIN ] VTOL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:17:34.318400] [INFO ] [MAIN ] VTOL: Wiping existing primary data before full refresh. [2025-10-02T22:17:34.318448] [INFO ] [LOCAL ] VTOL: Starting deletion of primary data. [2025-10-02T22:17:34.318701] [DEBUG] [LOCAL ] VTOL: Deleted primary data file. [2025-10-02T22:17:34.318772] [INFO ] [MAIN ] VTOL: Starting full primary refresh. [2025-10-02T22:17:34.708863] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-01. [2025-10-02T22:17:34.708777] [INFO ] [REMOTE ] VTOL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:17:34.721097] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-02T22:17:34.922199] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-02T22:17:35.472979] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2024-12. [2025-10-02T22:17:35.672968] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-02T22:17:36.273016] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-02. [2025-10-02T22:17:36.567247] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-02T22:17:37.073034] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-01. [2025-10-02T22:17:37.395637] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-02T22:17:37.847699] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-02T22:17:37.873016] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-08. [2025-10-02T22:17:38.673046] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-03. [2025-10-02T22:17:39.472992] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-01. [2025-10-02T22:17:39.565639] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-02T22:17:39.615028] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-02T22:17:40.234687] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-02T22:17:40.272999] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-02. [2025-10-02T22:17:41.072986] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-04. [2025-10-02T22:17:41.225040] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-02T22:17:41.872982] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-09. [2025-10-02T22:17:42.118884] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-02T22:17:42.673017] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-05. [2025-10-02T22:17:43.472995] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-03. [2025-10-02T22:17:43.533208] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-02T22:17:43.590802] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-02T22:17:44.273002] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-10. [2025-10-02T22:17:44.475820] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-02T22:17:45.073043] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-04. [2025-10-02T22:17:45.335317] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-02T22:17:45.337199] [INFO ] [REMOTE ] VTLE: Full fetch complete (68887 records). [2025-10-02T22:17:45.337447] [DEBUG] [VALIDATOR ] VTLE: Validating primary data. [2025-10-02T22:17:45.758736] [DEBUG] [VALIDATOR ] VTLE: All expected trading days are present. [2025-10-02T22:17:45.758857] [DEBUG] [VALIDATOR ] VTLE: Primary data validation passed. [2025-10-02T22:17:45.760349] [INFO ] [MAIN ] VTLE: Fetched primary data is valid. [2025-10-02T22:17:45.761004] [DEBUG] [LOCAL ] VTLE: Saving primary data. [2025-10-02T22:17:45.762543] [DEBUG] [LOCAL ] VTLE: Trimmed 68887 records to 48776 (keeping 200 days of data) [2025-10-02T22:17:45.873008] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-02. [2025-10-02T22:17:46.069309] [DEBUG] [LOCAL ] VTLE: Primary data saved (48776 records). [2025-10-02T22:17:46.069669] [INFO ] [MAIN ] VTLE: Full history saved. [2025-10-02T22:17:46.069818] [INFO ] [MAIN ] Update Progress: 2257/2370 symbols completed. VTLE took 35.7s. Estimated remaining: 15m 54s. Rate: 7.1 symbols/min [2025-10-02T22:17:46.187847] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-02T22:17:46.285021] [INFO ] [MAIN ] VTR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:17:46.339672] [DEBUG] [LOCAL ] VTR: Loaded 52809 existing records from primary storage. [2025-10-02T22:17:46.340030] [INFO ] [MAIN ] VTR: Loaded 52809 existing records. [2025-10-02T22:17:46.539877] [WARN ] [MAIN ] VTR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:17:46.540180] [INFO ] [MAIN ] VTR: Wiping existing primary data before full refresh. [2025-10-02T22:17:46.540302] [INFO ] [LOCAL ] VTR: Starting deletion of primary data. [2025-10-02T22:17:46.546748] [DEBUG] [LOCAL ] VTR: Deleted primary data file. [2025-10-02T22:17:46.546837] [INFO ] [MAIN ] VTR: Starting full primary refresh. [2025-10-02T22:17:46.608100] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-02T22:17:46.678177] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-05. [2025-10-02T22:17:46.954807] [INFO ] [REMOTE ] VTR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:17:47.472994] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-03. [2025-10-02T22:17:47.909322] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-02T22:17:48.247204] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-02T22:17:48.272976] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-04. [2025-10-02T22:17:49.043857] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-02T22:17:49.072968] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-05. [2025-10-02T22:17:49.663113] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-02T22:17:49.873055] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-06. [2025-10-02T22:17:50.672996] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-06. [2025-10-02T22:17:50.872870] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-02T22:17:51.393490] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-02T22:17:51.472974] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-07. [2025-10-02T22:17:52.273050] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-07. [2025-10-02T22:17:52.314675] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-02T22:17:53.073018] [INFO ] [REMOTE ] VTR: Fetching primary data for 2024-12. [2025-10-02T22:17:53.249321] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-02T22:17:53.873061] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-08. [2025-10-02T22:17:54.671627] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-02T22:17:54.674940] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-08. [2025-10-02T22:17:54.890216] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-02T22:17:55.221174] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-02T22:17:55.472982] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-09. [2025-10-02T22:17:56.272993] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-09. [2025-10-02T22:17:56.467983] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-02T22:17:57.042975] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-02T22:17:57.072984] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-10. [2025-10-02T22:17:57.736710] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-02T22:17:57.737814] [INFO ] [REMOTE ] VTMX: Full fetch complete (25871 records). [2025-10-02T22:17:57.737930] [DEBUG] [VALIDATOR ] VTMX: Validating primary data. [2025-10-02T22:17:57.878119] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-10. [2025-10-02T22:17:58.170207] [DEBUG] [VALIDATOR ] VTMX: All expected trading days are present. [2025-10-02T22:17:58.170291] [DEBUG] [VALIDATOR ] VTMX: Primary data validation passed. [2025-10-02T22:17:58.170834] [INFO ] [MAIN ] VTMX: Fetched primary data is valid. [2025-10-02T22:17:58.170896] [DEBUG] [LOCAL ] VTMX: Saving primary data. [2025-10-02T22:17:58.171590] [DEBUG] [LOCAL ] VTMX: Trimmed 25871 records to 17619 (keeping 200 days of data) [2025-10-02T22:17:58.286774] [DEBUG] [LOCAL ] VTMX: Primary data saved (17619 records). [2025-10-02T22:17:58.286925] [INFO ] [MAIN ] VTMX: Full history saved. [2025-10-02T22:17:58.287011] [INFO ] [MAIN ] Update Progress: 2258/2370 symbols completed. VTMX took 27.3s. Estimated remaining: 15m 46s. Rate: 7.1 symbols/min [2025-10-02T22:17:58.460885] [INFO ] [MAIN ] VTS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:17:58.495738] [DEBUG] [LOCAL ] VTS: Loaded 30516 existing records from primary storage. [2025-10-02T22:17:58.496032] [INFO ] [MAIN ] VTS: Loaded 30516 existing records. [2025-10-02T22:17:58.688007] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-01. [2025-10-02T22:17:58.694257] [WARN ] [MAIN ] VTS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:17:58.695562] [INFO ] [MAIN ] VTS: Wiping existing primary data before full refresh. [2025-10-02T22:17:58.695620] [INFO ] [LOCAL ] VTS: Starting deletion of primary data. [2025-10-02T22:17:58.695912] [DEBUG] [LOCAL ] VTS: Deleted primary data file. [2025-10-02T22:17:58.695973] [INFO ] [MAIN ] VTS: Starting full primary refresh. [2025-10-02T22:17:58.769421] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-02T22:17:58.788950] [INFO ] [REMOTE ] VTN: Full fetch complete (11291 records). [2025-10-02T22:17:58.811961] [DEBUG] [VALIDATOR ] VTN: Validating primary data. [2025-10-02T22:17:59.442590] [INFO ] [REMOTE ] VTS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:17:59.489028] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-06. [2025-10-02T22:17:59.537153] [DEBUG] [VALIDATOR ] VTN: All expected trading days are present. [2025-10-02T22:17:59.537274] [DEBUG] [VALIDATOR ] VTN: Primary data validation passed. [2025-10-02T22:17:59.537571] [INFO ] [MAIN ] VTN: Fetched primary data is valid. [2025-10-02T22:17:59.537613] [DEBUG] [LOCAL ] VTN: Saving primary data. [2025-10-02T22:17:59.538191] [DEBUG] [LOCAL ] VTN: Trimmed 11291 records to 7084 (keeping 200 days of data) [2025-10-02T22:17:59.585369] [DEBUG] [LOCAL ] VTN: Primary data saved (7084 records). [2025-10-02T22:17:59.585521] [INFO ] [MAIN ] VTN: Full history saved. [2025-10-02T22:17:59.585638] [INFO ] [MAIN ] Update Progress: 2259/2370 symbols completed. VTN took 28.5s. Estimated remaining: 15m 37s. Rate: 7.1 symbols/min [2025-10-02T22:17:59.771811] [INFO ] [MAIN ] VVR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:17:59.804007] [DEBUG] [LOCAL ] VVR: Loaded 31186 existing records from primary storage. [2025-10-02T22:17:59.804295] [INFO ] [MAIN ] VVR: Loaded 31186 existing records. [2025-10-02T22:17:59.995862] [WARN ] [MAIN ] VVR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:17:59.996075] [INFO ] [MAIN ] VVR: Wiping existing primary data before full refresh. [2025-10-02T22:17:59.996123] [INFO ] [LOCAL ] VVR: Starting deletion of primary data. [2025-10-02T22:17:59.996359] [DEBUG] [LOCAL ] VVR: Deleted primary data file. [2025-10-02T22:17:59.996440] [INFO ] [MAIN ] VVR: Starting full primary refresh. [2025-10-02T22:18:00.274322] [INFO ] [REMOTE ] VTS: Fetching primary data for 2024-12. [2025-10-02T22:18:00.385181] [INFO ] [REMOTE ] VVR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:18:00.640767] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-02T22:18:00.767678] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-02T22:18:01.072995] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-02. [2025-10-02T22:18:01.491965] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-02T22:18:01.873054] [INFO ] [REMOTE ] VVR: Fetching primary data for 2024-12. [2025-10-02T22:18:02.564975] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-02T22:18:02.672985] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-03. [2025-10-02T22:18:02.820180] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-02T22:18:03.472994] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-01. [2025-10-02T22:18:04.273029] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-01. [2025-10-02T22:18:04.499448] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-02T22:18:05.009131] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-02T22:18:05.071920] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-02T22:18:05.076923] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-02. [2025-10-02T22:18:05.872991] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-07. [2025-10-02T22:18:06.440882] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-02T22:18:06.673045] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-04. [2025-10-02T22:18:07.016319] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-02T22:18:07.473052] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-08. [2025-10-02T22:18:08.273033] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-02. [2025-10-02T22:18:08.559455] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-02T22:18:08.641709] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-02T22:18:09.053408] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-02T22:18:09.072989] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-09. [2025-10-02T22:18:09.873043] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-03. [2025-10-02T22:18:10.089218] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-02T22:18:10.673014] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-05. [2025-10-02T22:18:10.997294] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-02T22:18:11.472996] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-10. [2025-10-02T22:18:12.272996] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-03. [2025-10-02T22:18:12.470468] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-02T22:18:12.475667] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-02T22:18:12.490206] [INFO ] [REMOTE ] VTOL: Full fetch complete (26007 records). [2025-10-02T22:18:12.498155] [DEBUG] [VALIDATOR ] VTOL: Validating primary data. [2025-10-02T22:18:13.036151] [DEBUG] [VALIDATOR ] VTOL: All expected trading days are present. [2025-10-02T22:18:13.036300] [DEBUG] [VALIDATOR ] VTOL: Primary data validation passed. [2025-10-02T22:18:13.037026] [INFO ] [MAIN ] VTOL: Fetched primary data is valid. [2025-10-02T22:18:13.037092] [DEBUG] [LOCAL ] VTOL: Saving primary data. [2025-10-02T22:18:13.038334] [DEBUG] [LOCAL ] VTOL: Trimmed 26007 records to 19682 (keeping 200 days of data) [2025-10-02T22:18:13.093720] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-04. [2025-10-02T22:18:13.182307] [DEBUG] [LOCAL ] VTOL: Primary data saved (19682 records). [2025-10-02T22:18:13.182458] [INFO ] [MAIN ] VTOL: Full history saved. [2025-10-02T22:18:13.182545] [INFO ] [MAIN ] Update Progress: 2260/2370 symbols completed. VTOL took 39.3s. Estimated remaining: 15m 29s. Rate: 7.1 symbols/min [2025-10-02T22:18:13.377343] [INFO ] [MAIN ] VVV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:18:13.426182] [DEBUG] [LOCAL ] VVV: Loaded 50187 existing records from primary storage. [2025-10-02T22:18:13.426547] [INFO ] [MAIN ] VVV: Loaded 50187 existing records. [2025-10-02T22:18:13.641461] [WARN ] [MAIN ] VVV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:18:13.642040] [INFO ] [MAIN ] VVV: Wiping existing primary data before full refresh. [2025-10-02T22:18:13.642151] [INFO ] [LOCAL ] VVV: Starting deletion of primary data. [2025-10-02T22:18:13.642397] [DEBUG] [LOCAL ] VVV: Deleted primary data file. [2025-10-02T22:18:13.642460] [INFO ] [MAIN ] VVV: Starting full primary refresh. [2025-10-02T22:18:13.876101] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-06. [2025-10-02T22:18:14.029159] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-02T22:18:14.124446] [INFO ] [REMOTE ] VVV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:18:14.569717] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-02T22:18:14.673002] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-04. [2025-10-02T22:18:15.319288] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-02T22:18:15.473013] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-05. [2025-10-02T22:18:15.631867] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-02T22:18:16.273007] [INFO ] [REMOTE ] VVV: Fetching primary data for 2024-12. [2025-10-02T22:18:16.387599] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-02T22:18:17.072992] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-05. [2025-10-02T22:18:17.764101] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-02T22:18:17.872997] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-07. [2025-10-02T22:18:18.092375] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-02T22:18:18.672998] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-06. [2025-10-02T22:18:19.463996] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-02T22:18:19.475684] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-06. [2025-10-02T22:18:20.046633] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-02T22:18:20.272999] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-07. [2025-10-02T22:18:20.501557] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-02T22:18:21.072999] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-01. [2025-10-02T22:18:21.621123] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-02T22:18:21.872992] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-08. [2025-10-02T22:18:22.672971] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-08. [2025-10-02T22:18:22.818675] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-02T22:18:23.133264] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-02T22:18:23.472969] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-02. [2025-10-02T22:18:24.272995] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-09. [2025-10-02T22:18:24.374803] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-02T22:18:25.049051] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-02T22:18:25.072981] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-09. [2025-10-02T22:18:25.363953] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-02T22:18:25.873009] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-03. [2025-10-02T22:18:26.673010] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-07. [2025-10-02T22:18:26.928817] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-02T22:18:27.163467] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-02T22:18:27.472970] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-04. [2025-10-02T22:18:27.499418] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-02T22:18:28.272990] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-08. [2025-10-02T22:18:29.073061] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-10. [2025-10-02T22:18:29.216666] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-02T22:18:29.264818] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-02T22:18:29.872998] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-05. [2025-10-02T22:18:30.438388] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-02T22:18:30.440727] [INFO ] [REMOTE ] VTR: Full fetch complete (76349 records). [2025-10-02T22:18:30.440903] [DEBUG] [VALIDATOR ] VTR: Validating primary data. [2025-10-02T22:18:30.682765] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-10. [2025-10-02T22:18:30.892975] [DEBUG] [VALIDATOR ] VTR: All expected trading days are present. [2025-10-02T22:18:30.893085] [DEBUG] [VALIDATOR ] VTR: Primary data validation passed. [2025-10-02T22:18:30.894406] [INFO ] [MAIN ] VTR: Fetched primary data is valid. [2025-10-02T22:18:30.894477] [DEBUG] [LOCAL ] VTR: Saving primary data. [2025-10-02T22:18:30.896193] [DEBUG] [LOCAL ] VTR: Trimmed 76349 records to 53197 (keeping 200 days of data) [2025-10-02T22:18:31.256505] [DEBUG] [LOCAL ] VTR: Primary data saved (53197 records). [2025-10-02T22:18:31.256724] [INFO ] [MAIN ] VTR: Full history saved. [2025-10-02T22:18:31.256844] [INFO ] [MAIN ] Update Progress: 2261/2370 symbols completed. VTR took 45.2s. Estimated remaining: 15m 21s. Rate: 7.1 symbols/min [2025-10-02T22:18:31.488434] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-02T22:18:31.483337] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-09. [2025-10-02T22:18:31.490355] [INFO ] [MAIN ] VVX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:18:31.530813] [DEBUG] [LOCAL ] VVX: Loaded 23138 existing records from primary storage. [2025-10-02T22:18:31.531163] [INFO ] [MAIN ] VVX: Loaded 23138 existing records. [2025-10-02T22:18:31.733435] [WARN ] [MAIN ] VVX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:18:31.733693] [INFO ] [MAIN ] VVX: Wiping existing primary data before full refresh. [2025-10-02T22:18:31.733762] [INFO ] [LOCAL ] VVX: Starting deletion of primary data. [2025-10-02T22:18:31.734046] [DEBUG] [LOCAL ] VVX: Deleted primary data file. [2025-10-02T22:18:31.734107] [INFO ] [MAIN ] VVX: Starting full primary refresh. [2025-10-02T22:18:31.943579] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-02T22:18:31.998617] [INFO ] [REMOTE ] VVR: Full fetch complete (46357 records). [2025-10-02T22:18:32.029394] [DEBUG] [VALIDATOR ] VVR: Validating primary data. [2025-10-02T22:18:32.277602] [INFO ] [REMOTE ] VVX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:18:32.283144] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-06. [2025-10-02T22:18:32.585337] [DEBUG] [VALIDATOR ] VVR: All expected trading days are present. [2025-10-02T22:18:32.585456] [DEBUG] [VALIDATOR ] VVR: Primary data validation passed. [2025-10-02T22:18:32.586806] [INFO ] [MAIN ] VVR: Fetched primary data is valid. [2025-10-02T22:18:32.586889] [DEBUG] [LOCAL ] VVR: Saving primary data. [2025-10-02T22:18:32.588552] [DEBUG] [LOCAL ] VVR: Trimmed 46357 records to 31541 (keeping 200 days of data) [2025-10-02T22:18:32.611788] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-02T22:18:32.814701] [DEBUG] [LOCAL ] VVR: Primary data saved (31541 records). [2025-10-02T22:18:32.814853] [INFO ] [MAIN ] VVR: Full history saved. [2025-10-02T22:18:32.814947] [INFO ] [MAIN ] Update Progress: 2262/2370 symbols completed. VVR took 33.2s. Estimated remaining: 15m 12s. Rate: 7.1 symbols/min [2025-10-02T22:18:32.993844] [INFO ] [MAIN ] VYX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:18:33.041031] [DEBUG] [LOCAL ] VYX: Loaded 48753 existing records from primary storage. [2025-10-02T22:18:33.041346] [INFO ] [MAIN ] VYX: Loaded 48753 existing records. [2025-10-02T22:18:33.078182] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-10. [2025-10-02T22:18:33.230160] [WARN ] [MAIN ] VYX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:18:33.230366] [INFO ] [MAIN ] VYX: Wiping existing primary data before full refresh. [2025-10-02T22:18:33.230415] [INFO ] [LOCAL ] VYX: Starting deletion of primary data. [2025-10-02T22:18:33.230752] [DEBUG] [LOCAL ] VYX: Deleted primary data file. [2025-10-02T22:18:33.230896] [INFO ] [MAIN ] VYX: Starting full primary refresh. [2025-10-02T22:18:33.611053] [INFO ] [REMOTE ] VYX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:18:33.872969] [INFO ] [REMOTE ] VVX: Fetching primary data for 2024-12. [2025-10-02T22:18:33.993521] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-02T22:18:34.011743] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-02T22:18:34.013410] [INFO ] [REMOTE ] VTS: Full fetch complete (41531 records). [2025-10-02T22:18:34.013496] [DEBUG] [VALIDATOR ] VTS: Validating primary data. [2025-10-02T22:18:34.433378] [DEBUG] [VALIDATOR ] VTS: All expected trading days are present. [2025-10-02T22:18:34.433499] [DEBUG] [VALIDATOR ] VTS: Primary data validation passed. [2025-10-02T22:18:34.434749] [INFO ] [MAIN ] VTS: Fetched primary data is valid. [2025-10-02T22:18:34.434849] [DEBUG] [LOCAL ] VTS: Saving primary data. [2025-10-02T22:18:34.437150] [DEBUG] [LOCAL ] VTS: Trimmed 41531 records to 30733 (keeping 200 days of data) [2025-10-02T22:18:34.647280] [DEBUG] [LOCAL ] VTS: Primary data saved (30733 records). [2025-10-02T22:18:34.647423] [INFO ] [MAIN ] VTS: Full history saved. [2025-10-02T22:18:34.649255] [INFO ] [MAIN ] Update Progress: 2263/2370 symbols completed. VTS took 36.4s. Estimated remaining: 15m 4s. Rate: 7.1 symbols/min [2025-10-02T22:18:34.678181] [INFO ] [REMOTE ] VYX: Fetching primary data for 2024-12. [2025-10-02T22:18:34.855383] [INFO ] [MAIN ] VZ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:18:34.915447] [DEBUG] [LOCAL ] VZ: Loaded 53791 existing records from primary storage. [2025-10-02T22:18:34.915832] [INFO ] [MAIN ] VZ: Loaded 53791 existing records. [2025-10-02T22:18:35.115253] [WARN ] [MAIN ] VZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:18:35.115926] [INFO ] [MAIN ] VZ: Wiping existing primary data before full refresh. [2025-10-02T22:18:35.116073] [INFO ] [LOCAL ] VZ: Starting deletion of primary data. [2025-10-02T22:18:35.116319] [DEBUG] [LOCAL ] VZ: Deleted primary data file. [2025-10-02T22:18:35.116391] [INFO ] [MAIN ] VZ: Starting full primary refresh. [2025-10-02T22:18:35.293331] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-02T22:18:35.485670] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-07. [2025-10-02T22:18:35.532045] [INFO ] [REMOTE ] VZ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:18:36.272991] [INFO ] [REMOTE ] VZ: Fetching primary data for 2024-12. [2025-10-02T22:18:36.311809] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-02T22:18:37.072999] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-01. [2025-10-02T22:18:37.332167] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-02T22:18:37.872997] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-08. [2025-10-02T22:18:38.121126] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-02T22:18:38.673068] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-02. [2025-10-02T22:18:38.763583] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2024-12 (2.49 seconds). [2025-10-02T22:18:39.472980] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-01. [2025-10-02T22:18:39.685977] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-02T22:18:39.711113] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-02T22:18:40.273001] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-01. [2025-10-02T22:18:41.053136] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-02T22:18:41.072971] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-02. [2025-10-02T22:18:41.873011] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-03. [2025-10-02T22:18:42.579466] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-02T22:18:42.673008] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-03. [2025-10-02T22:18:42.908015] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-01 (2.64 seconds). [2025-10-02T22:18:43.066568] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-02T22:18:43.473039] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-09. [2025-10-02T22:18:44.273010] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-04. [2025-10-02T22:18:44.430080] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-02T22:18:45.072963] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-04. [2025-10-02T22:18:45.181822] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-02T22:18:45.349712] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-02T22:18:45.873004] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-05. [2025-10-02T22:18:46.552008] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-02T22:18:46.672981] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-02. [2025-10-02T22:18:46.923769] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-02T22:18:47.473003] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-10. [2025-10-02T22:18:48.273031] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-05. [2025-10-02T22:18:48.738545] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-02T22:18:48.740558] [INFO ] [REMOTE ] VVV: Full fetch complete (72347 records). [2025-10-02T22:18:48.740791] [DEBUG] [VALIDATOR ] VVV: Validating primary data. [2025-10-02T22:18:49.073290] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-06. [2025-10-02T22:18:49.212180] [DEBUG] [VALIDATOR ] VVV: All expected trading days are present. [2025-10-02T22:18:49.214778] [DEBUG] [VALIDATOR ] VVV: Primary data validation passed. [2025-10-02T22:18:49.214632] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-02 (2.54 seconds). [2025-10-02T22:18:49.226321] [INFO ] [MAIN ] VVV: Fetched primary data is valid. [2025-10-02T22:18:49.227151] [DEBUG] [LOCAL ] VVV: Saving primary data. [2025-10-02T22:18:49.230387] [DEBUG] [LOCAL ] VVV: Trimmed 72347 records to 50522 (keeping 200 days of data) [2025-10-02T22:18:49.550324] [DEBUG] [LOCAL ] VVV: Primary data saved (50522 records). [2025-10-02T22:18:49.550501] [INFO ] [MAIN ] VVV: Full history saved. [2025-10-02T22:18:49.550631] [INFO ] [MAIN ] Update Progress: 2264/2370 symbols completed. VVV took 36.4s. Estimated remaining: 14m 55s. Rate: 7.1 symbols/min [2025-10-02T22:18:49.781675] [INFO ] [MAIN ] W: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:18:49.838035] [DEBUG] [LOCAL ] W: Loaded 53481 existing records from primary storage. [2025-10-02T22:18:49.838452] [INFO ] [MAIN ] W: Loaded 53481 existing records. [2025-10-02T22:18:49.878102] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-03. [2025-10-02T22:18:50.046726] [WARN ] [MAIN ] W: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:18:50.047066] [INFO ] [MAIN ] W: Wiping existing primary data before full refresh. [2025-10-02T22:18:50.047155] [INFO ] [LOCAL ] W: Starting deletion of primary data. [2025-10-02T22:18:50.047514] [DEBUG] [LOCAL ] W: Deleted primary data file. [2025-10-02T22:18:50.047585] [INFO ] [MAIN ] W: Starting full primary refresh. [2025-10-02T22:18:50.185908] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-02T22:18:50.514555] [INFO ] [REMOTE ] W: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:18:50.517029] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-02T22:18:50.672977] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-07. [2025-10-02T22:18:51.472987] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-06. [2025-10-02T22:18:51.878950] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-02T22:18:52.272975] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-08. [2025-10-02T22:18:52.376032] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-03 (2.50 seconds). [2025-10-02T22:18:52.847510] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-02T22:18:53.073008] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-04. [2025-10-02T22:18:53.750432] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-02T22:18:53.873007] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-07. [2025-10-02T22:18:54.673066] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-09. [2025-10-02T22:18:55.160501] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-02T22:18:55.472973] [INFO ] [REMOTE ] W: Fetching primary data for 2024-12. [2025-10-02T22:18:55.721269] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-02T22:18:55.936091] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-02T22:18:56.273020] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-05. [2025-10-02T22:18:57.078080] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-08. [2025-10-02T22:18:57.099011] [INFO ] [REMOTE ] W: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-02T22:18:57.872971] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-10. [2025-10-02T22:18:58.426140] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-02T22:18:58.672970] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-06. [2025-10-02T22:18:58.803387] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-02T22:18:58.805081] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-02T22:18:58.816256] [INFO ] [REMOTE ] VVX: Full fetch complete (33466 records). [2025-10-02T22:18:58.816496] [DEBUG] [VALIDATOR ] VVX: Validating primary data. [2025-10-02T22:18:59.225725] [DEBUG] [VALIDATOR ] VVX: All expected trading days are present. [2025-10-02T22:18:59.225824] [DEBUG] [VALIDATOR ] VVX: Primary data validation passed. [2025-10-02T22:18:59.226503] [INFO ] [MAIN ] VVX: Fetched primary data is valid. [2025-10-02T22:18:59.226547] [DEBUG] [LOCAL ] VVX: Saving primary data. [2025-10-02T22:18:59.227550] [DEBUG] [LOCAL ] VVX: Trimmed 33466 records to 23279 (keeping 200 days of data) [2025-10-02T22:18:59.383140] [DEBUG] [LOCAL ] VVX: Primary data saved (23279 records). [2025-10-02T22:18:59.383310] [INFO ] [MAIN ] VVX: Full history saved. [2025-10-02T22:18:59.383481] [INFO ] [MAIN ] Update Progress: 2265/2370 symbols completed. VVX took 28.1s. Estimated remaining: 14m 47s. Rate: 7.1 symbols/min [2025-10-02T22:18:59.478123] [INFO ] [REMOTE ] W: Fetching primary data for 2025-01. [2025-10-02T22:18:59.587059] [INFO ] [MAIN ] WAB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:18:59.639109] [DEBUG] [LOCAL ] WAB: Loaded 44059 existing records from primary storage. [2025-10-02T22:18:59.639432] [INFO ] [MAIN ] WAB: Loaded 44059 existing records. [2025-10-02T22:18:59.830792] [WARN ] [MAIN ] WAB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:18:59.831015] [INFO ] [MAIN ] WAB: Wiping existing primary data before full refresh. [2025-10-02T22:18:59.831065] [INFO ] [LOCAL ] WAB: Starting deletion of primary data. [2025-10-02T22:18:59.831258] [DEBUG] [LOCAL ] WAB: Deleted primary data file. [2025-10-02T22:18:59.831331] [INFO ] [MAIN ] WAB: Starting full primary refresh. [2025-10-02T22:19:00.230303] [INFO ] [REMOTE ] WAB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:19:00.273042] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-09. [2025-10-02T22:19:01.072977] [INFO ] [REMOTE ] WAB: Fetching primary data for 2024-12. [2025-10-02T22:19:01.160629] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-06 (2.49 seconds). [2025-10-02T22:19:01.222436] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-02T22:19:01.873040] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-07. [2025-10-02T22:19:02.005226] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-02T22:19:02.544285] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-02T22:19:02.673005] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-01. [2025-10-02T22:19:03.472996] [INFO ] [REMOTE ] W: Fetching primary data for 2025-02. [2025-10-02T22:19:04.273119] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-10. [2025-10-02T22:19:04.454306] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-10-02T22:19:04.501284] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-02T22:19:05.073067] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-02. [2025-10-02T22:19:05.341341] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-02T22:19:05.344703] [INFO ] [REMOTE ] VYX: Full fetch complete (70217 records). [2025-10-02T22:19:05.344894] [DEBUG] [VALIDATOR ] VYX: Validating primary data. [2025-10-02T22:19:05.635326] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-10-02T22:19:05.878293] [INFO ] [REMOTE ] W: Fetching primary data for 2025-03. [2025-10-02T22:19:06.009373] [DEBUG] [VALIDATOR ] VYX: All expected trading days are present. [2025-10-02T22:19:06.009468] [DEBUG] [VALIDATOR ] VYX: Primary data validation passed. [2025-10-02T22:19:06.010771] [INFO ] [MAIN ] VYX: Fetched primary data is valid. [2025-10-02T22:19:06.010846] [DEBUG] [LOCAL ] VYX: Saving primary data. [2025-10-02T22:19:06.012517] [DEBUG] [LOCAL ] VYX: Trimmed 70217 records to 49071 (keeping 200 days of data) [2025-10-02T22:19:06.337813] [DEBUG] [LOCAL ] VYX: Primary data saved (49071 records). [2025-10-02T22:19:06.338007] [INFO ] [MAIN ] VYX: Full history saved. [2025-10-02T22:19:06.338207] [INFO ] [MAIN ] Update Progress: 2266/2370 symbols completed. VYX took 33.5s. Estimated remaining: 14m 39s. Rate: 7.1 symbols/min [2025-10-02T22:19:06.522272] [INFO ] [MAIN ] WAL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:19:06.569998] [DEBUG] [LOCAL ] WAL: Loaded 45226 existing records from primary storage. [2025-10-02T22:19:06.570373] [INFO ] [MAIN ] WAL: Loaded 45226 existing records. [2025-10-02T22:19:06.677959] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-08. [2025-10-02T22:19:06.783457] [WARN ] [MAIN ] WAL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:19:06.784247] [INFO ] [MAIN ] WAL: Wiping existing primary data before full refresh. [2025-10-02T22:19:06.784402] [INFO ] [LOCAL ] WAL: Starting deletion of primary data. [2025-10-02T22:19:06.784775] [DEBUG] [LOCAL ] WAL: Deleted primary data file. [2025-10-02T22:19:06.784843] [INFO ] [MAIN ] WAL: Starting full primary refresh. [2025-10-02T22:19:07.106535] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-02T22:19:07.246338] [INFO ] [REMOTE ] WAL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:19:07.473046] [INFO ] [REMOTE ] WAL: Fetching primary data for 2024-12. [2025-10-02T22:19:07.933730] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-02T22:19:08.273006] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-03. [2025-10-02T22:19:08.602206] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-02T22:19:09.073013] [INFO ] [REMOTE ] W: Fetching primary data for 2025-04. [2025-10-02T22:19:09.144222] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-02T22:19:09.873026] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-01. [2025-10-02T22:19:10.100669] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-02T22:19:10.672977] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-04. [2025-10-02T22:19:11.209428] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-02T22:19:11.285137] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-02T22:19:11.473010] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-02. [2025-10-02T22:19:12.272984] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-09. [2025-10-02T22:19:12.519793] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-02T22:19:13.083521] [INFO ] [REMOTE ] W: Fetching primary data for 2025-05. [2025-10-02T22:19:13.089078] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-02T22:19:13.873010] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-05. [2025-10-02T22:19:14.609287] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-10-02T22:19:14.683873] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-10. [2025-10-02T22:19:14.690347] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-02T22:19:15.473055] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-03. [2025-10-02T22:19:15.517959] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-02T22:19:16.273032] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-06. [2025-10-02T22:19:16.594909] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-02T22:19:16.597287] [INFO ] [REMOTE ] VZ: Full fetch complete (77958 records). [2025-10-02T22:19:16.597433] [DEBUG] [VALIDATOR ] VZ: Validating primary data. [2025-10-02T22:19:17.045302] [DEBUG] [VALIDATOR ] VZ: All expected trading days are present. [2025-10-02T22:19:17.045500] [DEBUG] [VALIDATOR ] VZ: Primary data validation passed. [2025-10-02T22:19:17.047828] [INFO ] [MAIN ] VZ: Fetched primary data is valid. [2025-10-02T22:19:17.047941] [DEBUG] [LOCAL ] VZ: Saving primary data. [2025-10-02T22:19:17.049627] [DEBUG] [LOCAL ] VZ: Trimmed 77958 records to 54181 (keeping 200 days of data) [2025-10-02T22:19:17.118410] [INFO ] [REMOTE ] W: Fetching primary data for 2025-06. [2025-10-02T22:19:17.211852] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-02T22:19:17.461708] [DEBUG] [LOCAL ] VZ: Primary data saved (54181 records). [2025-10-02T22:19:17.461854] [INFO ] [MAIN ] VZ: Full history saved. [2025-10-02T22:19:17.462618] [INFO ] [MAIN ] Update Progress: 2267/2370 symbols completed. VZ took 42.8s. Estimated remaining: 14m 30s. Rate: 7.1 symbols/min [2025-10-02T22:19:17.652741] [INFO ] [MAIN ] WAT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:19:17.679947] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-02T22:19:17.723883] [DEBUG] [LOCAL ] WAT: Loaded 35254 existing records from primary storage. [2025-10-02T22:19:17.724180] [INFO ] [MAIN ] WAT: Loaded 35254 existing records. [2025-10-02T22:19:17.878137] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-07. [2025-10-02T22:19:17.920249] [WARN ] [MAIN ] WAT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:19:17.920872] [INFO ] [MAIN ] WAT: Wiping existing primary data before full refresh. [2025-10-02T22:19:17.920933] [INFO ] [LOCAL ] WAT: Starting deletion of primary data. [2025-10-02T22:19:17.921180] [DEBUG] [LOCAL ] WAT: Deleted primary data file. [2025-10-02T22:19:17.921240] [INFO ] [MAIN ] WAT: Starting full primary refresh. [2025-10-02T22:19:18.292227] [INFO ] [REMOTE ] WAT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:19:18.672993] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-04. [2025-10-02T22:19:18.987826] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-02T22:19:19.410676] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-02T22:19:19.472998] [INFO ] [REMOTE ] WAT: Fetching primary data for 2024-12. [2025-10-02T22:19:20.272984] [INFO ] [REMOTE ] W: Fetching primary data for 2025-07. [2025-10-02T22:19:20.355974] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-02T22:19:20.737387] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-02T22:19:21.073010] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-05. [2025-10-02T22:19:21.873032] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-08. [2025-10-02T22:19:22.103204] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-02T22:19:22.242921] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-02T22:19:22.673013] [INFO ] [REMOTE ] W: Fetching primary data for 2025-08. [2025-10-02T22:19:23.203673] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-02T22:19:23.473017] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-06. [2025-10-02T22:19:24.254321] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-02T22:19:24.272960] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-01. [2025-10-02T22:19:24.983963] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-02T22:19:25.073002] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-07. [2025-10-02T22:19:25.412428] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-02T22:19:25.873000] [INFO ] [REMOTE ] W: Fetching primary data for 2025-09. [2025-10-02T22:19:26.678184] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-09. [2025-10-02T22:19:26.694585] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-02T22:19:27.473045] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-02. [2025-10-02T22:19:27.810369] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-02T22:19:28.055304] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-02T22:19:28.273040] [INFO ] [REMOTE ] W: Fetching primary data for 2025-10. [2025-10-02T22:19:28.864349] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-02T22:19:29.073005] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-03. [2025-10-02T22:19:29.773690] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-02T22:19:29.776172] [INFO ] [REMOTE ] W: Full fetch complete (77405 records). [2025-10-02T22:19:29.776343] [DEBUG] [VALIDATOR ] W: Validating primary data. [2025-10-02T22:19:29.878703] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-08. [2025-10-02T22:19:30.251557] [DEBUG] [VALIDATOR ] W: All expected trading days are present. [2025-10-02T22:19:30.251758] [DEBUG] [VALIDATOR ] W: Primary data validation passed. [2025-10-02T22:19:30.253363] [INFO ] [MAIN ] W: Fetched primary data is valid. [2025-10-02T22:19:30.253491] [DEBUG] [LOCAL ] W: Saving primary data. [2025-10-02T22:19:30.255434] [DEBUG] [LOCAL ] W: Trimmed 77405 records to 53851 (keeping 200 days of data) [2025-10-02T22:19:30.602749] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-02T22:19:30.630991] [DEBUG] [LOCAL ] W: Primary data saved (53851 records). [2025-10-02T22:19:30.631182] [INFO ] [MAIN ] W: Full history saved. [2025-10-02T22:19:30.631335] [INFO ] [MAIN ] Update Progress: 2268/2370 symbols completed. W took 41.1s. Estimated remaining: 14m 22s. Rate: 7.1 symbols/min [2025-10-02T22:19:30.678262] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-10. [2025-10-02T22:19:30.819224] [INFO ] [MAIN ] WBI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:19:30.819428] [DEBUG] [LOCAL ] WBI: No existing data file found in primary storage. [2025-10-02T22:19:30.819489] [WARN ] [MAIN ] WBI: No existing data found, performing full refresh instead. [2025-10-02T22:19:30.819604] [INFO ] [MAIN ] WBI: Wiping existing primary data before full refresh. [2025-10-02T22:19:30.819671] [INFO ] [LOCAL ] WBI: Starting deletion of primary data. [2025-10-02T22:19:30.819738] [DEBUG] [LOCAL ] WBI: No primary data file found to delete. [2025-10-02T22:19:30.819773] [INFO ] [MAIN ] WBI: Starting full primary refresh. [2025-10-02T22:19:31.252064] [INFO ] [REMOTE ] WBI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:19:31.284189] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-02T22:19:31.473052] [INFO ] [REMOTE ] WBI: Fetching primary data for 2024-12. [2025-10-02T22:19:31.716491] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T22:19:31.716931] [WARN ] [REMOTE ] WBI: No data returned for month 2024-12 [2025-10-02T22:19:31.717020] [FATAL] [REMOTE ] WBI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T22:19:31.717073] [FATAL] [MAIN ] WBI: Failed to fetch primary data. [2025-10-02T22:19:31.717107] [WARN ] [MAIN ] WBI: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T22:19:31.717146] [INFO ] [LOCAL ] WBI: Starting deletion of primary data. [2025-10-02T22:19:31.717204] [DEBUG] [LOCAL ] WBI: No primary data file found to delete. [2025-10-02T22:19:31.717242] [INFO ] [LOCAL ] WBI: Starting deletion of derivative data. [2025-10-02T22:19:31.717285] [DEBUG] [LOCAL ] WBI: No derivative data file found to delete. [2025-10-02T22:19:31.717370] [INFO ] [MAIN ] Update Progress: 2269/2370 symbols completed. WBI took 1.1s. Estimated remaining: 14m 13s. Rate: 7.1 symbols/min [2025-10-02T22:19:31.920751] [INFO ] [MAIN ] WBS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:19:31.974447] [DEBUG] [LOCAL ] WBS: Loaded 48701 existing records from primary storage. [2025-10-02T22:19:31.975347] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-02T22:19:31.975758] [INFO ] [MAIN ] WBS: Loaded 48701 existing records. [2025-10-02T22:19:32.012491] [INFO ] [REMOTE ] WAB: Full fetch complete (64344 records). [2025-10-02T22:19:32.052328] [DEBUG] [VALIDATOR ] WAB: Validating primary data. [2025-10-02T22:19:32.275023] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-09. [2025-10-02T22:19:32.333599] [WARN ] [MAIN ] WBS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:19:32.381148] [INFO ] [MAIN ] WBS: Wiping existing primary data before full refresh. [2025-10-02T22:19:32.397807] [INFO ] [LOCAL ] WBS: Starting deletion of primary data. [2025-10-02T22:19:32.417808] [DEBUG] [LOCAL ] WBS: Deleted primary data file. [2025-10-02T22:19:32.435229] [INFO ] [MAIN ] WBS: Starting full primary refresh. [2025-10-02T22:19:32.875210] [DEBUG] [VALIDATOR ] WAB: All expected trading days are present. [2025-10-02T22:19:32.930829] [DEBUG] [VALIDATOR ] WAB: Primary data validation passed. [2025-10-02T22:19:32.947514] [INFO ] [MAIN ] WAB: Fetched primary data is valid. [2025-10-02T22:19:32.953827] [DEBUG] [LOCAL ] WAB: Saving primary data. [2025-10-02T22:19:33.046912] [DEBUG] [LOCAL ] WAB: Trimmed 64344 records to 44385 (keeping 200 days of data) [2025-10-02T22:19:33.075060] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-04. [2025-10-02T22:19:33.074696] [INFO ] [REMOTE ] WBS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:19:33.373211] [DEBUG] [LOCAL ] WAB: Primary data saved (44385 records). [2025-10-02T22:19:33.373344] [INFO ] [MAIN ] WAB: Full history saved. [2025-10-02T22:19:33.373427] [INFO ] [MAIN ] Update Progress: 2270/2370 symbols completed. WAB took 34.0s. Estimated remaining: 14m 4s. Rate: 7.1 symbols/min [2025-10-02T22:19:33.576163] [INFO ] [MAIN ] WBX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:19:33.590272] [DEBUG] [LOCAL ] WBX: Loaded 11587 existing records from primary storage. [2025-10-02T22:19:33.590598] [INFO ] [MAIN ] WBX: Loaded 11587 existing records. [2025-10-02T22:19:33.794515] [WARN ] [MAIN ] WBX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:19:33.794858] [INFO ] [MAIN ] WBX: Wiping existing primary data before full refresh. [2025-10-02T22:19:33.794941] [INFO ] [LOCAL ] WBX: Starting deletion of primary data. [2025-10-02T22:19:33.795452] [DEBUG] [LOCAL ] WBX: Deleted primary data file. [2025-10-02T22:19:33.795614] [INFO ] [MAIN ] WBX: Starting full primary refresh. [2025-10-02T22:19:33.878019] [INFO ] [REMOTE ] WBS: Fetching primary data for 2024-12. [2025-10-02T22:19:34.028234] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-02T22:19:34.296884] [INFO ] [REMOTE ] WBX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:19:34.678087] [INFO ] [REMOTE ] WBX: Fetching primary data for 2024-12. [2025-10-02T22:19:34.692952] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-02T22:19:35.473051] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-05. [2025-10-02T22:19:35.615261] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-02T22:19:35.980865] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-02T22:19:36.273037] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-01. [2025-10-02T22:19:36.420514] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-02T22:19:37.073019] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-10. [2025-10-02T22:19:37.502496] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-02T22:19:37.873003] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-01. [2025-10-02T22:19:38.342230] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-02T22:19:38.344566] [INFO ] [REMOTE ] WAL: Full fetch complete (66676 records). [2025-10-02T22:19:38.344705] [DEBUG] [VALIDATOR ] WAL: Validating primary data. [2025-10-02T22:19:38.678136] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-02. [2025-10-02T22:19:38.782213] [DEBUG] [VALIDATOR ] WAL: All expected trading days are present. [2025-10-02T22:19:38.782303] [DEBUG] [VALIDATOR ] WAL: Primary data validation passed. [2025-10-02T22:19:38.783487] [INFO ] [MAIN ] WAL: Fetched primary data is valid. [2025-10-02T22:19:38.783556] [DEBUG] [LOCAL ] WAL: Saving primary data. [2025-10-02T22:19:38.785002] [DEBUG] [LOCAL ] WAL: Trimmed 66676 records to 45569 (keeping 200 days of data) [2025-10-02T22:19:39.091501] [DEBUG] [LOCAL ] WAL: Primary data saved (45569 records). [2025-10-02T22:19:39.091693] [INFO ] [MAIN ] WAL: Full history saved. [2025-10-02T22:19:39.091792] [INFO ] [MAIN ] Update Progress: 2271/2370 symbols completed. WAL took 32.8s. Estimated remaining: 13m 56s. Rate: 7.1 symbols/min [2025-10-02T22:19:39.277604] [INFO ] [MAIN ] WCC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:19:39.325007] [DEBUG] [LOCAL ] WCC: Loaded 39634 existing records from primary storage. [2025-10-02T22:19:39.325351] [INFO ] [MAIN ] WCC: Loaded 39634 existing records. [2025-10-02T22:19:39.482876] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-06. [2025-10-02T22:19:39.531003] [WARN ] [MAIN ] WCC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:19:39.531662] [INFO ] [MAIN ] WCC: Wiping existing primary data before full refresh. [2025-10-02T22:19:39.532013] [INFO ] [LOCAL ] WCC: Starting deletion of primary data. [2025-10-02T22:19:39.532639] [DEBUG] [LOCAL ] WCC: Deleted primary data file. [2025-10-02T22:19:39.532745] [INFO ] [MAIN ] WCC: Starting full primary refresh. [2025-10-02T22:19:39.731264] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-02T22:19:39.738261] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-02T22:19:40.020432] [INFO ] [REMOTE ] WCC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:19:40.273020] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-03. [2025-10-02T22:19:40.855289] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-02T22:19:41.073023] [INFO ] [REMOTE ] WCC: Fetching primary data for 2024-12. [2025-10-02T22:19:41.225143] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-02T22:19:41.873048] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-04. [2025-10-02T22:19:42.197738] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-02T22:19:42.673041] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-01. [2025-10-02T22:19:42.895792] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-02T22:19:43.473025] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-05. [2025-10-02T22:19:44.269740] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-02T22:19:44.278108] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-02. [2025-10-02T22:19:44.465777] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-02T22:19:45.072989] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-06. [2025-10-02T22:19:45.835709] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-02T22:19:45.872972] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-03. [2025-10-02T22:19:46.118880] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-02T22:19:46.673014] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-07. [2025-10-02T22:19:47.270209] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-02T22:19:47.473002] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-07. [2025-10-02T22:19:47.525695] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-02T22:19:48.273045] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-08. [2025-10-02T22:19:48.931178] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-02T22:19:49.078103] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-02. [2025-10-02T22:19:49.093587] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-02T22:19:49.873035] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-08. [2025-10-02T22:19:50.494887] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-02T22:19:50.673038] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-04. [2025-10-02T22:19:51.407712] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-02T22:19:51.473042] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-09. [2025-10-02T22:19:51.879432] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-02T22:19:52.273022] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-03. [2025-10-02T22:19:52.372472] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-02T22:19:53.073026] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-10. [2025-10-02T22:19:53.409688] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-02T22:19:53.410676] [INFO ] [REMOTE ] WBX: Full fetch complete (24658 records). [2025-10-02T22:19:53.410764] [DEBUG] [VALIDATOR ] WBX: Validating primary data. [2025-10-02T22:19:53.828800] [DEBUG] [VALIDATOR ] WBX: All expected trading days are present. [2025-10-02T22:19:53.828912] [DEBUG] [VALIDATOR ] WBX: Primary data validation passed. [2025-10-02T22:19:53.829468] [INFO ] [MAIN ] WBX: Fetched primary data is valid. [2025-10-02T22:19:53.829548] [DEBUG] [LOCAL ] WBX: Saving primary data. [2025-10-02T22:19:53.830454] [DEBUG] [LOCAL ] WBX: Trimmed 24658 records to 11609 (keeping 200 days of data) [2025-10-02T22:19:53.877396] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-05. [2025-10-02T22:19:53.920401] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-02T22:19:53.950957] [DEBUG] [LOCAL ] WBX: Primary data saved (11609 records). [2025-10-02T22:19:53.951114] [INFO ] [MAIN ] WBX: Full history saved. [2025-10-02T22:19:53.951207] [INFO ] [MAIN ] Update Progress: 2272/2370 symbols completed. WBX took 20.6s. Estimated remaining: 13m 48s. Rate: 7.1 symbols/min [2025-10-02T22:19:54.134869] [INFO ] [MAIN ] WCN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:19:54.181785] [DEBUG] [LOCAL ] WCN: Loaded 47968 existing records from primary storage. [2025-10-02T22:19:54.182093] [INFO ] [MAIN ] WCN: Loaded 47968 existing records. [2025-10-02T22:19:54.382843] [WARN ] [MAIN ] WCN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:19:54.383094] [INFO ] [MAIN ] WCN: Wiping existing primary data before full refresh. [2025-10-02T22:19:54.383152] [INFO ] [LOCAL ] WCN: Starting deletion of primary data. [2025-10-02T22:19:54.383389] [DEBUG] [LOCAL ] WCN: Deleted primary data file. [2025-10-02T22:19:54.383459] [INFO ] [MAIN ] WCN: Starting full primary refresh. [2025-10-02T22:19:54.678205] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-04. [2025-10-02T22:19:54.787704] [INFO ] [REMOTE ] WCN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:19:55.473020] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-09. [2025-10-02T22:19:55.568769] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-02T22:19:56.161447] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-02T22:19:56.273056] [INFO ] [REMOTE ] WCN: Fetching primary data for 2024-12. [2025-10-02T22:19:56.574047] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-02T22:19:57.073061] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-10. [2025-10-02T22:19:57.677455] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-02T22:19:57.873001] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-01. [2025-10-02T22:19:58.105018] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-02T22:19:58.106758] [INFO ] [REMOTE ] WAT: Full fetch complete (50179 records). [2025-10-02T22:19:58.106845] [DEBUG] [VALIDATOR ] WAT: Validating primary data. [2025-10-02T22:19:58.514414] [DEBUG] [VALIDATOR ] WAT: All expected trading days are present. [2025-10-02T22:19:58.514527] [DEBUG] [VALIDATOR ] WAT: Primary data validation passed. [2025-10-02T22:19:58.515567] [INFO ] [MAIN ] WAT: Fetched primary data is valid. [2025-10-02T22:19:58.515633] [DEBUG] [LOCAL ] WAT: Saving primary data. [2025-10-02T22:19:58.516837] [DEBUG] [LOCAL ] WAT: Trimmed 50179 records to 35539 (keeping 200 days of data) [2025-10-02T22:19:58.694560] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-06. [2025-10-02T22:19:58.757315] [DEBUG] [LOCAL ] WAT: Primary data saved (35539 records). [2025-10-02T22:19:58.757474] [INFO ] [MAIN ] WAT: Full history saved. [2025-10-02T22:19:58.758098] [INFO ] [MAIN ] Update Progress: 2273/2370 symbols completed. WAT took 41.3s. Estimated remaining: 13m 39s. Rate: 7.1 symbols/min [2025-10-02T22:19:58.943571] [INFO ] [MAIN ] WD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:19:58.974303] [DEBUG] [LOCAL ] WD: Loaded 23190 existing records from primary storage. [2025-10-02T22:19:58.974615] [INFO ] [MAIN ] WD: Loaded 23190 existing records. [2025-10-02T22:19:59.183892] [WARN ] [MAIN ] WD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:19:59.184235] [INFO ] [MAIN ] WD: Wiping existing primary data before full refresh. [2025-10-02T22:19:59.184286] [INFO ] [LOCAL ] WD: Starting deletion of primary data. [2025-10-02T22:19:59.184524] [DEBUG] [LOCAL ] WD: Deleted primary data file. [2025-10-02T22:19:59.184582] [INFO ] [MAIN ] WD: Starting full primary refresh. [2025-10-02T22:19:59.481374] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-05. [2025-10-02T22:19:59.583368] [INFO ] [REMOTE ] WD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:19:59.613313] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-02T22:20:00.273042] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-02. [2025-10-02T22:20:00.333316] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-02T22:20:01.073004] [INFO ] [REMOTE ] WD: Fetching primary data for 2024-12. [2025-10-02T22:20:01.260543] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-02T22:20:01.798537] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-02T22:20:01.873012] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-07. [2025-10-02T22:20:02.154737] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-02T22:20:02.673030] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-03. [2025-10-02T22:20:03.318722] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-02T22:20:03.473012] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-01. [2025-10-02T22:20:04.273063] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-06. [2025-10-02T22:20:04.312210] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-02T22:20:04.625734] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-02T22:20:05.073003] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-08. [2025-10-02T22:20:05.727745] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-02T22:20:05.873004] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-02. [2025-10-02T22:20:06.634920] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-02T22:20:06.672977] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-09. [2025-10-02T22:20:07.473061] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-07. [2025-10-02T22:20:08.272985] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-04. [2025-10-02T22:20:08.510948] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-02T22:20:08.909304] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-02T22:20:09.073019] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-08. [2025-10-02T22:20:09.158487] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-02 (3.29 seconds). [2025-10-02T22:20:09.839521] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-02T22:20:09.873096] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-05. [2025-10-02T22:20:10.673020] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-03. [2025-10-02T22:20:10.720927] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-02T22:20:11.472986] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-09. [2025-10-02T22:20:11.845548] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-02T22:20:12.273011] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-04. [2025-10-02T22:20:13.046937] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-02T22:20:13.073010] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-10. [2025-10-02T22:20:13.116174] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-02T22:20:13.572269] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-05 (3.70 seconds). [2025-10-02T22:20:13.872990] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-05. [2025-10-02T22:20:14.382510] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-02T22:20:14.384668] [INFO ] [REMOTE ] WBS: Full fetch complete (69649 records). [2025-10-02T22:20:14.384851] [DEBUG] [VALIDATOR ] WBS: Validating primary data. [2025-10-02T22:20:14.676940] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-06. [2025-10-02T22:20:14.827954] [DEBUG] [VALIDATOR ] WBS: All expected trading days are present. [2025-10-02T22:20:14.828049] [DEBUG] [VALIDATOR ] WBS: Primary data validation passed. [2025-10-02T22:20:14.829177] [INFO ] [MAIN ] WBS: Fetched primary data is valid. [2025-10-02T22:20:14.829243] [DEBUG] [LOCAL ] WBS: Saving primary data. [2025-10-02T22:20:14.830947] [DEBUG] [LOCAL ] WBS: Trimmed 69649 records to 49050 (keeping 200 days of data) [2025-10-02T22:20:14.971468] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-02T22:20:15.177632] [DEBUG] [LOCAL ] WBS: Primary data saved (49050 records). [2025-10-02T22:20:15.177808] [INFO ] [MAIN ] WBS: Full history saved. [2025-10-02T22:20:15.177952] [INFO ] [MAIN ] Update Progress: 2274/2370 symbols completed. WBS took 43.5s. Estimated remaining: 13m 31s. Rate: 7.1 symbols/min [2025-10-02T22:20:15.375554] [INFO ] [MAIN ] WDH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:20:15.399867] [DEBUG] [LOCAL ] WDH: Loaded 17463 existing records from primary storage. [2025-10-02T22:20:15.400198] [INFO ] [MAIN ] WDH: Loaded 17463 existing records. [2025-10-02T22:20:15.483433] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-06. [2025-10-02T22:20:15.689294] [WARN ] [MAIN ] WDH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:20:15.689630] [INFO ] [MAIN ] WDH: Wiping existing primary data before full refresh. [2025-10-02T22:20:15.689738] [INFO ] [LOCAL ] WDH: Starting deletion of primary data. [2025-10-02T22:20:15.689980] [DEBUG] [LOCAL ] WDH: Deleted primary data file. [2025-10-02T22:20:15.690061] [INFO ] [MAIN ] WDH: Starting full primary refresh. [2025-10-02T22:20:16.215419] [INFO ] [REMOTE ] WDH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:20:16.262245] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-02T22:20:16.276994] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-10. [2025-10-02T22:20:16.723189] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-02T22:20:17.073007] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-07. [2025-10-02T22:20:17.339810] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-02T22:20:17.342561] [INFO ] [REMOTE ] WCC: Full fetch complete (57792 records). [2025-10-02T22:20:17.342747] [DEBUG] [VALIDATOR ] WCC: Validating primary data. [2025-10-02T22:20:17.772915] [DEBUG] [VALIDATOR ] WCC: All expected trading days are present. [2025-10-02T22:20:17.773045] [DEBUG] [VALIDATOR ] WCC: Primary data validation passed. [2025-10-02T22:20:17.774087] [INFO ] [MAIN ] WCC: Fetched primary data is valid. [2025-10-02T22:20:17.774152] [DEBUG] [LOCAL ] WCC: Saving primary data. [2025-10-02T22:20:17.775438] [DEBUG] [LOCAL ] WCC: Trimmed 57792 records to 39818 (keeping 200 days of data) [2025-10-02T22:20:17.873207] [INFO ] [REMOTE ] WDH: Fetching primary data for 2024-12. [2025-10-02T22:20:18.048915] [DEBUG] [LOCAL ] WCC: Primary data saved (39818 records). [2025-10-02T22:20:18.049068] [INFO ] [MAIN ] WCC: Full history saved. [2025-10-02T22:20:18.049153] [INFO ] [MAIN ] Update Progress: 2275/2370 symbols completed. WCC took 39.0s. Estimated remaining: 13m 22s. Rate: 7.1 symbols/min [2025-10-02T22:20:18.232905] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-02T22:20:18.251462] [INFO ] [MAIN ] WDI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:20:18.282492] [DEBUG] [LOCAL ] WDI: Loaded 21082 existing records from primary storage. [2025-10-02T22:20:18.282744] [INFO ] [MAIN ] WDI: Loaded 21082 existing records. [2025-10-02T22:20:18.493028] [WARN ] [MAIN ] WDI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:20:18.493247] [INFO ] [MAIN ] WDI: Wiping existing primary data before full refresh. [2025-10-02T22:20:18.493299] [INFO ] [LOCAL ] WDI: Starting deletion of primary data. [2025-10-02T22:20:18.493705] [DEBUG] [LOCAL ] WDI: Deleted primary data file. [2025-10-02T22:20:18.493768] [INFO ] [MAIN ] WDI: Starting full primary refresh. [2025-10-02T22:20:18.681103] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-08. [2025-10-02T22:20:18.897549] [INFO ] [REMOTE ] WDI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:20:18.899170] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-02T22:20:19.473034] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-07. [2025-10-02T22:20:19.777826] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-02T22:20:20.273051] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-01. [2025-10-02T22:20:21.071769] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-02T22:20:21.074288] [INFO ] [REMOTE ] WDI: Fetching primary data for 2024-12. [2025-10-02T22:20:21.267909] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-02T22:20:21.873020] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-02. [2025-10-02T22:20:22.197265] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-02T22:20:22.672997] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-08. [2025-10-02T22:20:22.890476] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-02T22:20:23.473040] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-01. [2025-10-02T22:20:24.211089] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-02T22:20:24.256546] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-02T22:20:24.272970] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-02. [2025-10-02T22:20:25.073020] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-09. [2025-10-02T22:20:25.292341] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-02T22:20:25.816569] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-02T22:20:25.873031] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-10. [2025-10-02T22:20:26.606122] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-02T22:20:26.607454] [INFO ] [REMOTE ] WD: Full fetch complete (33222 records). [2025-10-02T22:20:26.607553] [DEBUG] [VALIDATOR ] WD: Validating primary data. [2025-10-02T22:20:26.678112] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-03. [2025-10-02T22:20:27.069188] [DEBUG] [VALIDATOR ] WD: All expected trading days are present. [2025-10-02T22:20:27.069268] [DEBUG] [VALIDATOR ] WD: Primary data validation passed. [2025-10-02T22:20:27.069987] [INFO ] [MAIN ] WD: Fetched primary data is valid. [2025-10-02T22:20:27.070050] [DEBUG] [LOCAL ] WD: Saving primary data. [2025-10-02T22:20:27.070825] [DEBUG] [LOCAL ] WD: Trimmed 33222 records to 23350 (keeping 200 days of data) [2025-10-02T22:20:27.231765] [DEBUG] [LOCAL ] WD: Primary data saved (23350 records). [2025-10-02T22:20:27.231911] [INFO ] [MAIN ] WD: Full history saved. [2025-10-02T22:20:27.232002] [INFO ] [MAIN ] Update Progress: 2276/2370 symbols completed. WD took 28.5s. Estimated remaining: 13m 14s. Rate: 7.1 symbols/min [2025-10-02T22:20:27.446310] [INFO ] [MAIN ] WDS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:20:27.473034] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-03. [2025-10-02T22:20:27.490927] [DEBUG] [LOCAL ] WDS: Loaded 43297 existing records from primary storage. [2025-10-02T22:20:27.491249] [INFO ] [MAIN ] WDS: Loaded 43297 existing records. [2025-10-02T22:20:27.688686] [WARN ] [MAIN ] WDS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:20:27.689176] [INFO ] [MAIN ] WDS: Wiping existing primary data before full refresh. [2025-10-02T22:20:27.689261] [INFO ] [LOCAL ] WDS: Starting deletion of primary data. [2025-10-02T22:20:27.689600] [DEBUG] [LOCAL ] WDS: Deleted primary data file. [2025-10-02T22:20:27.689707] [INFO ] [MAIN ] WDS: Starting full primary refresh. [2025-10-02T22:20:27.896157] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-02T22:20:28.097741] [INFO ] [REMOTE ] WDS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:20:28.273007] [INFO ] [REMOTE ] WDS: Fetching primary data for 2024-12. [2025-10-02T22:20:28.463074] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-02T22:20:29.073032] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-09. [2025-10-02T22:20:29.600125] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-02T22:20:29.873004] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-04. [2025-10-02T22:20:30.407550] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-02T22:20:30.672987] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-04. [2025-10-02T22:20:31.078482] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-02T22:20:31.472983] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-10. [2025-10-02T22:20:31.491193] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-02T22:20:32.273008] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-01. [2025-10-02T22:20:32.787427] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-02T22:20:32.789469] [INFO ] [REMOTE ] WCN: Full fetch complete (69468 records). [2025-10-02T22:20:32.789585] [DEBUG] [VALIDATOR ] WCN: Validating primary data. [2025-10-02T22:20:33.078155] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-05. [2025-10-02T22:20:33.217558] [DEBUG] [VALIDATOR ] WCN: All expected trading days are present. [2025-10-02T22:20:33.217682] [DEBUG] [VALIDATOR ] WCN: Primary data validation passed. [2025-10-02T22:20:33.219084] [INFO ] [MAIN ] WCN: Fetched primary data is valid. [2025-10-02T22:20:33.219158] [DEBUG] [LOCAL ] WCN: Saving primary data. [2025-10-02T22:20:33.221442] [DEBUG] [LOCAL ] WCN: Trimmed 69468 records to 48313 (keeping 200 days of data) [2025-10-02T22:20:33.549314] [DEBUG] [LOCAL ] WCN: Primary data saved (48313 records). [2025-10-02T22:20:33.549462] [INFO ] [MAIN ] WCN: Full history saved. [2025-10-02T22:20:33.549581] [INFO ] [MAIN ] Update Progress: 2277/2370 symbols completed. WCN took 39.6s. Estimated remaining: 13m 5s. Rate: 7.1 symbols/min [2025-10-02T22:20:33.872980] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-05. [2025-10-02T22:20:33.949440] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-02T22:20:34.173164] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-02T22:20:34.635457] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-02T22:20:34.673008] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-02. [2025-10-02T22:20:35.473043] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-06. [2025-10-02T22:20:35.798581] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-02T22:20:36.272976] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-06. [2025-10-02T22:20:36.472631] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-02T22:20:37.072972] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-07. [2025-10-02T22:20:37.082730] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-02T22:20:37.873036] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-07. [2025-10-02T22:20:38.448236] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-02T22:20:38.673048] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-08. [2025-10-02T22:20:39.041628] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-02T22:20:39.472979] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-08. [2025-10-02T22:20:39.725034] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-02T22:20:40.273037] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-03. [2025-10-02T22:20:40.461012] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-02T22:20:41.073048] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-09. [2025-10-02T22:20:41.872986] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-09. [2025-10-02T22:20:42.010855] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-02T22:20:42.179541] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-02T22:20:42.528752] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-02T22:20:42.673028] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-10. [2025-10-02T22:20:43.473005] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-04. [2025-10-02T22:20:43.678540] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-02T22:20:43.679823] [INFO ] [REMOTE ] WDH: Full fetch complete (23323 records). [2025-10-02T22:20:43.679904] [DEBUG] [VALIDATOR ] WDH: Validating primary data. [2025-10-02T22:20:44.114865] [DEBUG] [VALIDATOR ] WDH: All expected trading days are present. [2025-10-02T22:20:44.115092] [DEBUG] [VALIDATOR ] WDH: Primary data validation passed. [2025-10-02T22:20:44.115815] [INFO ] [MAIN ] WDH: Fetched primary data is valid. [2025-10-02T22:20:44.115879] [DEBUG] [LOCAL ] WDH: Saving primary data. [2025-10-02T22:20:44.116798] [DEBUG] [LOCAL ] WDH: Trimmed 23323 records to 17649 (keeping 200 days of data) [2025-10-02T22:20:44.224908] [DEBUG] [LOCAL ] WDH: Primary data saved (17649 records). [2025-10-02T22:20:44.225121] [INFO ] [MAIN ] WDH: Full history saved. [2025-10-02T22:20:44.225261] [INFO ] [MAIN ] Update Progress: 2278/2370 symbols completed. WDH took 29.0s. Estimated remaining: 12m 57s. Rate: 7.1 symbols/min [2025-10-02T22:20:44.273107] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-10. [2025-10-02T22:20:44.998891] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-02T22:20:45.000318] [INFO ] [REMOTE ] WDI: Full fetch complete (30827 records). [2025-10-02T22:20:45.000410] [DEBUG] [VALIDATOR ] WDI: Validating primary data. [2025-10-02T22:20:45.324610] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-02T22:20:45.364714] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-05. [2025-10-02T22:20:45.454899] [DEBUG] [VALIDATOR ] WDI: All expected trading days are present. [2025-10-02T22:20:45.455008] [DEBUG] [VALIDATOR ] WDI: Primary data validation passed. [2025-10-02T22:20:45.455696] [INFO ] [MAIN ] WDI: Fetched primary data is valid. [2025-10-02T22:20:45.455765] [DEBUG] [LOCAL ] WDI: Saving primary data. [2025-10-02T22:20:45.456635] [DEBUG] [LOCAL ] WDI: Trimmed 30827 records to 21232 (keeping 200 days of data) [2025-10-02T22:20:45.598146] [DEBUG] [LOCAL ] WDI: Primary data saved (21232 records). [2025-10-02T22:20:45.598282] [INFO ] [MAIN ] WDI: Full history saved. [2025-10-02T22:20:45.598374] [INFO ] [MAIN ] Update Progress: 2279/2370 symbols completed. WDI took 27.5s. Estimated remaining: 12m 48s. Rate: 7.1 symbols/min [2025-10-02T22:20:47.051866] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-02T22:20:47.061415] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-06. [2025-10-02T22:20:49.247875] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-02T22:20:49.258626] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-07. [2025-10-02T22:20:50.819637] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-02T22:20:50.829720] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-08. [2025-10-02T22:20:52.385202] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-02T22:20:52.394527] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-09. [2025-10-02T22:20:54.004613] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-02T22:20:54.014760] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-10. [2025-10-02T22:20:55.232806] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-02T22:20:55.234976] [INFO ] [REMOTE ] WDS: Full fetch complete (64495 records). [2025-10-02T22:20:55.235150] [DEBUG] [VALIDATOR ] WDS: Validating primary data. [2025-10-02T22:20:55.655983] [DEBUG] [VALIDATOR ] WDS: All expected trading days are present. [2025-10-02T22:20:55.656070] [DEBUG] [VALIDATOR ] WDS: Primary data validation passed. [2025-10-02T22:20:55.657284] [INFO ] [MAIN ] WDS: Fetched primary data is valid. [2025-10-02T22:20:55.657394] [DEBUG] [LOCAL ] WDS: Saving primary data. [2025-10-02T22:20:55.659680] [DEBUG] [LOCAL ] WDS: Trimmed 64495 records to 43591 (keeping 200 days of data) [2025-10-02T22:20:55.961601] [DEBUG] [LOCAL ] WDS: Primary data saved (43591 records). [2025-10-02T22:20:55.961808] [INFO ] [MAIN ] WDS: Full history saved. [2025-10-02T22:20:55.964037] [INFO ] [MAIN ] Update Progress: 2280/2370 symbols completed. WDS took 28.7s. Estimated remaining: 12m 40s. Rate: 7.1 symbols/min [2025-10-02T22:20:56.834410] [INFO ] [MAIN ] WELL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:20:56.753882] [INFO ] [MAIN ] WEAV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:20:56.839538] [INFO ] [MAIN ] WEA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:20:56.863755] [INFO ] [MAIN ] WEC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:20:56.881939] [DEBUG] [LOCAL ] WEA: Loaded 7284 existing records from primary storage. [2025-10-02T22:20:56.882340] [INFO ] [MAIN ] WEA: Loaded 7284 existing records. [2025-10-02T22:20:57.125567] [WARN ] [MAIN ] WEA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:20:57.146968] [INFO ] [MAIN ] WEA: Wiping existing primary data before full refresh. [2025-10-02T22:20:57.147194] [INFO ] [LOCAL ] WEA: Starting deletion of primary data. [2025-10-02T22:20:57.162104] [DEBUG] [LOCAL ] WEAV: Loaded 41883 existing records from primary storage. [2025-10-02T22:20:57.164447] [INFO ] [MAIN ] WEAV: Loaded 41883 existing records. [2025-10-02T22:20:57.179718] [DEBUG] [LOCAL ] WEC: Loaded 52186 existing records from primary storage. [2025-10-02T22:20:57.164246] [DEBUG] [LOCAL ] WEA: Deleted primary data file. [2025-10-02T22:20:57.200955] [INFO ] [MAIN ] WEC: Loaded 52186 existing records. [2025-10-02T22:20:57.201050] [INFO ] [MAIN ] WEA: Starting full primary refresh. [2025-10-02T22:20:57.409669] [DEBUG] [LOCAL ] WELL: Loaded 52362 existing records from primary storage. [2025-10-02T22:20:57.461609] [INFO ] [MAIN ] WELL: Loaded 52362 existing records. [2025-10-02T22:20:57.885456] [WARN ] [MAIN ] WEAV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:20:57.922086] [INFO ] [MAIN ] WEAV: Wiping existing primary data before full refresh. [2025-10-02T22:20:57.951628] [INFO ] [LOCAL ] WEAV: Starting deletion of primary data. [2025-10-02T22:20:57.964155] [WARN ] [MAIN ] WEC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:20:57.994710] [INFO ] [MAIN ] WEC: Wiping existing primary data before full refresh. [2025-10-02T22:20:58.050821] [DEBUG] [LOCAL ] WEAV: Deleted primary data file. [2025-10-02T22:20:58.045558] [INFO ] [LOCAL ] WEC: Starting deletion of primary data. [2025-10-02T22:20:58.087397] [INFO ] [MAIN ] WEAV: Starting full primary refresh. [2025-10-02T22:20:58.188885] [WARN ] [MAIN ] WELL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:20:58.120587] [DEBUG] [LOCAL ] WEC: Deleted primary data file. [2025-10-02T22:20:58.245756] [INFO ] [MAIN ] WEC: Starting full primary refresh. [2025-10-02T22:20:58.235264] [INFO ] [MAIN ] WELL: Wiping existing primary data before full refresh. [2025-10-02T22:20:58.256405] [INFO ] [LOCAL ] WELL: Starting deletion of primary data. [2025-10-02T22:20:58.311496] [DEBUG] [LOCAL ] WELL: Deleted primary data file. [2025-10-02T22:20:58.336416] [INFO ] [MAIN ] WELL: Starting full primary refresh. [2025-10-02T22:20:58.587010] [INFO ] [REMOTE ] WEA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:20:58.651836] [INFO ] [REMOTE ] WEA: Fetching primary data for 2024-12. [2025-10-02T22:20:59.406596] [INFO ] [REMOTE ] WEAV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:20:59.464711] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2024-12. [2025-10-02T22:20:59.526945] [INFO ] [REMOTE ] WELL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:20:59.543421] [INFO ] [REMOTE ] WELL: Fetching primary data for 2024-12. [2025-10-02T22:20:59.577809] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-02T22:20:59.582583] [INFO ] [REMOTE ] WEC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:20:59.583141] [INFO ] [REMOTE ] WEC: Fetching primary data for 2024-12. [2025-10-02T22:20:59.585882] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-01. [2025-10-02T22:21:00.091077] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-02T22:21:00.093186] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-02. [2025-10-02T22:21:00.820071] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-02T22:21:00.821809] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-03. [2025-10-02T22:21:01.105353] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-02T22:21:01.115333] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-01. [2025-10-02T22:21:01.365180] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-02T22:21:01.376041] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-01. [2025-10-02T22:21:01.445156] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-02T22:21:01.447118] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-04. [2025-10-02T22:21:01.725909] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-10-02T22:21:01.737311] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-01. [2025-10-02T22:21:02.091627] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-02T22:21:02.093696] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-05. [2025-10-02T22:21:02.592023] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-02T22:21:02.603380] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-02. [2025-10-02T22:21:02.650344] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-02T22:21:02.653087] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-06. [2025-10-02T22:21:02.682332] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-02T22:21:02.692002] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-02. [2025-10-02T22:21:03.413840] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-02T22:21:03.416422] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-07. [2025-10-02T22:21:03.626435] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-02T22:21:03.637770] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-02. [2025-10-02T22:21:03.945867] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-02T22:21:03.949075] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-08. [2025-10-02T22:21:04.014116] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-02T22:21:04.277789] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-03. [2025-10-02T22:21:04.280945] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-02T22:21:04.581503] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-02T22:21:05.072998] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-03. [2025-10-02T22:21:05.553352] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-02T22:21:05.591754] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-02T22:21:05.872998] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-04. [2025-10-02T22:21:06.673038] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-03. [2025-10-02T22:21:06.971315] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-02T22:21:07.307038] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-02T22:21:07.473006] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-09. [2025-10-02T22:21:08.196020] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-02T22:21:08.273052] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-05. [2025-10-02T22:21:08.518108] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-02T22:21:09.073023] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-04. [2025-10-02T22:21:09.504796] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-02T22:21:09.873004] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-10. [2025-10-02T22:21:10.259791] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-02T22:21:10.260562] [INFO ] [REMOTE ] WEA: Full fetch complete (9739 records). [2025-10-02T22:21:10.260634] [DEBUG] [VALIDATOR ] WEA: Validating primary data. [2025-10-02T22:21:10.685628] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-06. [2025-10-02T22:21:10.696920] [DEBUG] [VALIDATOR ] WEA: All expected trading days are present. [2025-10-02T22:21:10.697041] [DEBUG] [VALIDATOR ] WEA: Primary data validation passed. [2025-10-02T22:21:10.697503] [INFO ] [MAIN ] WEA: Fetched primary data is valid. [2025-10-02T22:21:10.697762] [DEBUG] [LOCAL ] WEA: Saving primary data. [2025-10-02T22:21:10.698902] [DEBUG] [LOCAL ] WEA: Trimmed 9739 records to 7309 (keeping 200 days of data) [2025-10-02T22:21:10.769577] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-02T22:21:10.793743] [DEBUG] [LOCAL ] WEA: Primary data saved (7309 records). [2025-10-02T22:21:10.793894] [INFO ] [MAIN ] WEA: Full history saved. [2025-10-02T22:21:10.794011] [INFO ] [MAIN ] Update Progress: 2281/2370 symbols completed. WEA took 14.8s. Estimated remaining: 12m 32s. Rate: 7.1 symbols/min [2025-10-02T22:21:10.983991] [INFO ] [MAIN ] WES: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:21:11.033745] [DEBUG] [LOCAL ] WES: Loaded 48098 existing records from primary storage. [2025-10-02T22:21:11.034080] [INFO ] [MAIN ] WES: Loaded 48098 existing records. [2025-10-02T22:21:11.236385] [WARN ] [MAIN ] WES: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:21:11.236626] [INFO ] [MAIN ] WES: Wiping existing primary data before full refresh. [2025-10-02T22:21:11.236712] [INFO ] [LOCAL ] WES: Starting deletion of primary data. [2025-10-02T22:21:11.236973] [DEBUG] [LOCAL ] WES: Deleted primary data file. [2025-10-02T22:21:11.237036] [INFO ] [MAIN ] WES: Starting full primary refresh. [2025-10-02T22:21:11.478369] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-05. [2025-10-02T22:21:11.652201] [INFO ] [REMOTE ] WES: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:21:11.986894] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-02T22:21:12.273001] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-07. [2025-10-02T22:21:13.072975] [INFO ] [REMOTE ] WES: Fetching primary data for 2024-12. [2025-10-02T22:21:13.364969] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-02T22:21:13.406893] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-02T22:21:13.873005] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-04. [2025-10-02T22:21:14.257064] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-02T22:21:14.673007] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-06. [2025-10-02T22:21:15.473001] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-01. [2025-10-02T22:21:15.679937] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-02T22:21:16.272987] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-05. [2025-10-02T22:21:16.465899] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-02T22:21:16.979695] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-02T22:21:17.073006] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-02. [2025-10-02T22:21:17.805243] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-02T22:21:17.873003] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-08. [2025-10-02T22:21:18.672974] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-06. [2025-10-02T22:21:18.785660] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-02T22:21:19.388456] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-02T22:21:19.472990] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-03. [2025-10-02T22:21:20.273017] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-07. [2025-10-02T22:21:20.415800] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-02T22:21:21.023059] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-02T22:21:21.073278] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-09. [2025-10-02T22:21:21.873248] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-04. [2025-10-02T22:21:22.145323] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-02T22:21:22.184699] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-02T22:21:22.673111] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-08. [2025-10-02T22:21:23.298506] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-02T22:21:23.473006] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-05. [2025-10-02T22:21:24.272986] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-07. [2025-10-02T22:21:24.343066] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-02T22:21:25.072997] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-09. [2025-10-02T22:21:25.249785] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-02T22:21:25.873020] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-10. [2025-10-02T22:21:26.178289] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-02T22:21:26.582982] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-02T22:21:26.673040] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-08. [2025-10-02T22:21:27.059499] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-02T22:21:27.065017] [INFO ] [REMOTE ] WEAV: Full fetch complete (61581 records). [2025-10-02T22:21:27.065262] [DEBUG] [VALIDATOR ] WEAV: Validating primary data. [2025-10-02T22:21:27.478586] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-06. [2025-10-02T22:21:27.480352] [DEBUG] [VALIDATOR ] WEAV: All expected trading days are present. [2025-10-02T22:21:27.480413] [DEBUG] [VALIDATOR ] WEAV: Primary data validation passed. [2025-10-02T22:21:27.481600] [INFO ] [MAIN ] WEAV: Fetched primary data is valid. [2025-10-02T22:21:27.481804] [DEBUG] [LOCAL ] WEAV: Saving primary data. [2025-10-02T22:21:27.483164] [DEBUG] [LOCAL ] WEAV: Trimmed 61581 records to 42221 (keeping 200 days of data) [2025-10-02T22:21:27.741446] [DEBUG] [LOCAL ] WEAV: Primary data saved (42221 records). [2025-10-02T22:21:27.741579] [INFO ] [MAIN ] WEAV: Full history saved. [2025-10-02T22:21:27.741702] [INFO ] [MAIN ] Update Progress: 2282/2370 symbols completed. WEAV took 31.8s. Estimated remaining: 12m 24s. Rate: 7.1 symbols/min [2025-10-02T22:21:27.923379] [INFO ] [MAIN ] WEX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:21:27.959726] [DEBUG] [LOCAL ] WEX: Loaded 34563 existing records from primary storage. [2025-10-02T22:21:27.960026] [INFO ] [MAIN ] WEX: Loaded 34563 existing records. [2025-10-02T22:21:28.143632] [WARN ] [MAIN ] WEX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:21:28.143858] [INFO ] [MAIN ] WEX: Wiping existing primary data before full refresh. [2025-10-02T22:21:28.143905] [INFO ] [LOCAL ] WEX: Starting deletion of primary data. [2025-10-02T22:21:28.144172] [DEBUG] [LOCAL ] WEX: Deleted primary data file. [2025-10-02T22:21:28.144230] [INFO ] [MAIN ] WEX: Starting full primary refresh. [2025-10-02T22:21:28.273872] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-10. [2025-10-02T22:21:28.547458] [INFO ] [REMOTE ] WEX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:21:28.586063] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-02T22:21:29.072982] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-09. [2025-10-02T22:21:29.193100] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-02T22:21:29.600981] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-02T22:21:29.603698] [INFO ] [REMOTE ] WEC: Full fetch complete (75523 records). [2025-10-02T22:21:29.603836] [DEBUG] [VALIDATOR ] WEC: Validating primary data. [2025-10-02T22:21:29.878165] [INFO ] [REMOTE ] WEX: Fetching primary data for 2024-12. [2025-10-02T22:21:30.070150] [DEBUG] [VALIDATOR ] WEC: All expected trading days are present. [2025-10-02T22:21:30.070253] [DEBUG] [VALIDATOR ] WEC: Primary data validation passed. [2025-10-02T22:21:30.071567] [INFO ] [MAIN ] WEC: Fetched primary data is valid. [2025-10-02T22:21:30.071671] [DEBUG] [LOCAL ] WEC: Saving primary data. [2025-10-02T22:21:30.073441] [DEBUG] [LOCAL ] WEC: Trimmed 75523 records to 52569 (keeping 200 days of data) [2025-10-02T22:21:30.455627] [DEBUG] [LOCAL ] WEC: Primary data saved (52569 records). [2025-10-02T22:21:30.455821] [INFO ] [MAIN ] WEC: Full history saved. [2025-10-02T22:21:30.455960] [INFO ] [MAIN ] Update Progress: 2283/2370 symbols completed. WEC took 34.5s. Estimated remaining: 12m 15s. Rate: 7.1 symbols/min [2025-10-02T22:21:30.658740] [INFO ] [MAIN ] WF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:21:30.673988] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-07. [2025-10-02T22:21:30.674321] [DEBUG] [LOCAL ] WF: Loaded 10731 existing records from primary storage. [2025-10-02T22:21:30.675848] [INFO ] [MAIN ] WF: Loaded 10731 existing records. [2025-10-02T22:21:30.897944] [WARN ] [MAIN ] WF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:21:30.898353] [INFO ] [MAIN ] WF: Wiping existing primary data before full refresh. [2025-10-02T22:21:30.898533] [INFO ] [LOCAL ] WF: Starting deletion of primary data. [2025-10-02T22:21:30.898942] [DEBUG] [LOCAL ] WF: Deleted primary data file. [2025-10-02T22:21:30.899018] [INFO ] [MAIN ] WF: Starting full primary refresh. [2025-10-02T22:21:31.272756] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-02T22:21:31.404923] [INFO ] [REMOTE ] WF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:21:31.424764] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-02T22:21:31.473024] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-01. [2025-10-02T22:21:32.272977] [INFO ] [REMOTE ] WF: Fetching primary data for 2024-12. [2025-10-02T22:21:32.441456] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-02T22:21:32.479251] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-02T22:21:33.072966] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-08. [2025-10-02T22:21:33.221386] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-02T22:21:33.873010] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-10. [2025-10-02T22:21:34.673028] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-01. [2025-10-02T22:21:34.766735] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-02T22:21:35.096094] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-02T22:21:35.099304] [INFO ] [REMOTE ] WELL: Full fetch complete (75758 records). [2025-10-02T22:21:35.100069] [DEBUG] [VALIDATOR ] WELL: Validating primary data. [2025-10-02T22:21:35.478085] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-09. [2025-10-02T22:21:35.600982] [DEBUG] [VALIDATOR ] WELL: All expected trading days are present. [2025-10-02T22:21:35.600785] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-02T22:21:35.601147] [DEBUG] [VALIDATOR ] WELL: Primary data validation passed. [2025-10-02T22:21:35.606277] [INFO ] [MAIN ] WELL: Fetched primary data is valid. [2025-10-02T22:21:35.606362] [DEBUG] [LOCAL ] WELL: Saving primary data. [2025-10-02T22:21:35.608406] [DEBUG] [LOCAL ] WELL: Trimmed 75758 records to 52752 (keeping 200 days of data) [2025-10-02T22:21:35.984161] [DEBUG] [LOCAL ] WELL: Primary data saved (52752 records). [2025-10-02T22:21:35.984337] [INFO ] [MAIN ] WELL: Full history saved. [2025-10-02T22:21:35.985800] [INFO ] [MAIN ] Update Progress: 2284/2370 symbols completed. WELL took 40.0s. Estimated remaining: 12m 6s. Rate: 7.1 symbols/min [2025-10-02T22:21:36.176476] [INFO ] [MAIN ] WFC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:21:36.240351] [DEBUG] [LOCAL ] WFC: Loaded 53748 existing records from primary storage. [2025-10-02T22:21:36.240817] [INFO ] [MAIN ] WFC: Loaded 53748 existing records. [2025-10-02T22:21:36.278740] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-02. [2025-10-02T22:21:36.483081] [WARN ] [MAIN ] WFC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:21:36.483316] [INFO ] [MAIN ] WFC: Wiping existing primary data before full refresh. [2025-10-02T22:21:36.483368] [INFO ] [LOCAL ] WFC: Starting deletion of primary data. [2025-10-02T22:21:36.483623] [DEBUG] [LOCAL ] WFC: Deleted primary data file. [2025-10-02T22:21:36.483713] [INFO ] [MAIN ] WFC: Starting full primary refresh. [2025-10-02T22:21:36.936523] [INFO ] [REMOTE ] WFC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:21:37.072990] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-02. [2025-10-02T22:21:37.297021] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-02T22:21:37.307951] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-02T22:21:37.873067] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-10. [2025-10-02T22:21:38.464621] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-02T22:21:38.673053] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-03. [2025-10-02T22:21:39.168635] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-02T22:21:39.174138] [INFO ] [REMOTE ] WES: Full fetch complete (69961 records). [2025-10-02T22:21:39.174374] [DEBUG] [VALIDATOR ] WES: Validating primary data. [2025-10-02T22:21:39.478244] [INFO ] [REMOTE ] WFC: Fetching primary data for 2024-12. [2025-10-02T22:21:39.672289] [DEBUG] [VALIDATOR ] WES: All expected trading days are present. [2025-10-02T22:21:39.672388] [DEBUG] [VALIDATOR ] WES: Primary data validation passed. [2025-10-02T22:21:39.674007] [INFO ] [MAIN ] WES: Fetched primary data is valid. [2025-10-02T22:21:39.674087] [DEBUG] [LOCAL ] WES: Saving primary data. [2025-10-02T22:21:39.675890] [DEBUG] [LOCAL ] WES: Trimmed 69961 records to 48472 (keeping 200 days of data) [2025-10-02T22:21:40.025690] [DEBUG] [LOCAL ] WES: Primary data saved (48472 records). [2025-10-02T22:21:40.025844] [INFO ] [MAIN ] WES: Full history saved. [2025-10-02T22:21:40.025929] [INFO ] [MAIN ] Update Progress: 2285/2370 symbols completed. WES took 29.2s. Estimated remaining: 11m 58s. Rate: 7.1 symbols/min [2025-10-02T22:21:40.231493] [INFO ] [MAIN ] WFG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:21:40.256970] [DEBUG] [LOCAL ] WFG: Loaded 24756 existing records from primary storage. [2025-10-02T22:21:40.257264] [INFO ] [MAIN ] WFG: Loaded 24756 existing records. [2025-10-02T22:21:40.281767] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-03. [2025-10-02T22:21:40.501462] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-02T22:21:40.499793] [WARN ] [MAIN ] WFG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:21:40.511661] [INFO ] [MAIN ] WFG: Wiping existing primary data before full refresh. [2025-10-02T22:21:40.512142] [INFO ] [LOCAL ] WFG: Starting deletion of primary data. [2025-10-02T22:21:40.512994] [DEBUG] [LOCAL ] WFG: Deleted primary data file. [2025-10-02T22:21:40.513058] [INFO ] [MAIN ] WFG: Starting full primary refresh. [2025-10-02T22:21:40.936053] [INFO ] [REMOTE ] WFG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:21:41.041073] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-02T22:21:41.072957] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-01. [2025-10-02T22:21:41.157616] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-02T22:21:41.873013] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-04. [2025-10-02T22:21:42.673056] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-04. [2025-10-02T22:21:43.086812] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-02T22:21:43.481040] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-02. [2025-10-02T22:21:43.489954] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-02T22:21:43.654147] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-02T22:21:44.273009] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-05. [2025-10-02T22:21:45.073027] [INFO ] [REMOTE ] WFG: Fetching primary data for 2024-12. [2025-10-02T22:21:45.319687] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-02T22:21:45.666531] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-02T22:21:45.873049] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-03. [2025-10-02T22:21:46.150016] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-02T22:21:46.672999] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-05. [2025-10-02T22:21:47.452891] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-02T22:21:47.472980] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-06. [2025-10-02T22:21:48.041009] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-02T22:21:48.273021] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-06. [2025-10-02T22:21:48.544014] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-02T22:21:49.073009] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-04. [2025-10-02T22:21:49.321510] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-02T22:21:49.872997] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-07. [2025-10-02T22:21:50.673016] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-07. [2025-10-02T22:21:51.261580] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-02T22:21:51.428417] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-02T22:21:51.472971] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-01. [2025-10-02T22:21:51.637513] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-02T22:21:52.272976] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-05. [2025-10-02T22:21:52.610838] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-02T22:21:53.073035] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-08. [2025-10-02T22:21:53.792755] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-02T22:21:53.873058] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-08. [2025-10-02T22:21:54.104303] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-02T22:21:54.673020] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-02. [2025-10-02T22:21:54.890903] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-02T22:21:55.473220] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-09. [2025-10-02T22:21:55.575310] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-02T22:21:56.273001] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-06. [2025-10-02T22:21:56.437142] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-02T22:21:57.073028] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-03. [2025-10-02T22:21:57.873033] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-09. [2025-10-02T22:21:58.288037] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-02T22:21:58.371821] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-02T22:21:58.469326] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-02T22:21:58.673013] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-10. [2025-10-02T22:21:59.303266] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-02T22:21:59.304252] [INFO ] [REMOTE ] WF: Full fetch complete (16255 records). [2025-10-02T22:21:59.304326] [DEBUG] [VALIDATOR ] WF: Validating primary data. [2025-10-02T22:21:59.477441] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-10. [2025-10-02T22:21:59.739688] [DEBUG] [VALIDATOR ] WF: All expected trading days are present. [2025-10-02T22:21:59.739795] [DEBUG] [VALIDATOR ] WF: Primary data validation passed. [2025-10-02T22:21:59.740388] [INFO ] [MAIN ] WF: Fetched primary data is valid. [2025-10-02T22:21:59.740461] [DEBUG] [LOCAL ] WF: Saving primary data. [2025-10-02T22:21:59.741396] [DEBUG] [LOCAL ] WF: Trimmed 16255 records to 10768 (keeping 200 days of data) [2025-10-02T22:21:59.810626] [DEBUG] [LOCAL ] WF: Primary data saved (10768 records). [2025-10-02T22:21:59.810790] [INFO ] [MAIN ] WF: Full history saved. [2025-10-02T22:21:59.810872] [INFO ] [MAIN ] Update Progress: 2286/2370 symbols completed. WF took 29.4s. Estimated remaining: 11m 50s. Rate: 7.1 symbols/min [2025-10-02T22:22:00.004020] [INFO ] [MAIN ] WGO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:22:00.047066] [DEBUG] [LOCAL ] WGO: Loaded 38946 existing records from primary storage. [2025-10-02T22:22:00.047383] [INFO ] [MAIN ] WGO: Loaded 38946 existing records. [2025-10-02T22:22:00.242187] [WARN ] [MAIN ] WGO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:22:00.242446] [INFO ] [MAIN ] WGO: Wiping existing primary data before full refresh. [2025-10-02T22:22:00.242495] [INFO ] [LOCAL ] WGO: Starting deletion of primary data. [2025-10-02T22:22:00.242773] [DEBUG] [LOCAL ] WGO: Deleted primary data file. [2025-10-02T22:22:00.242833] [INFO ] [MAIN ] WGO: Starting full primary refresh. [2025-10-02T22:22:00.278162] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-07. [2025-10-02T22:22:00.554159] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-02T22:22:00.582189] [INFO ] [REMOTE ] WEX: Full fetch complete (50596 records). [2025-10-02T22:22:00.597828] [DEBUG] [VALIDATOR ] WEX: Validating primary data. [2025-10-02T22:22:00.847170] [INFO ] [REMOTE ] WGO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:22:01.078179] [INFO ] [REMOTE ] WGO: Fetching primary data for 2024-12. [2025-10-02T22:22:01.286082] [DEBUG] [VALIDATOR ] WEX: All expected trading days are present. [2025-10-02T22:22:01.286186] [DEBUG] [VALIDATOR ] WEX: Primary data validation passed. [2025-10-02T22:22:01.288294] [INFO ] [MAIN ] WEX: Fetched primary data is valid. [2025-10-02T22:22:01.288422] [DEBUG] [LOCAL ] WEX: Saving primary data. [2025-10-02T22:22:01.289944] [DEBUG] [LOCAL ] WEX: Trimmed 50596 records to 34737 (keeping 200 days of data) [2025-10-02T22:22:01.610311] [DEBUG] [LOCAL ] WEX: Primary data saved (34737 records). [2025-10-02T22:22:01.610490] [INFO ] [MAIN ] WEX: Full history saved. [2025-10-02T22:22:01.610624] [INFO ] [MAIN ] Update Progress: 2287/2370 symbols completed. WEX took 33.9s. Estimated remaining: 11m 41s. Rate: 7.1 symbols/min [2025-10-02T22:22:01.874156] [INFO ] [MAIN ] WH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:22:01.874300] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-04. [2025-10-02T22:22:01.922164] [DEBUG] [LOCAL ] WH: Loaded 45457 existing records from primary storage. [2025-10-02T22:22:01.922545] [INFO ] [MAIN ] WH: Loaded 45457 existing records. [2025-10-02T22:22:02.158364] [WARN ] [MAIN ] WH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:22:02.158615] [INFO ] [MAIN ] WH: Wiping existing primary data before full refresh. [2025-10-02T22:22:02.158700] [INFO ] [LOCAL ] WH: Starting deletion of primary data. [2025-10-02T22:22:02.158985] [DEBUG] [LOCAL ] WH: Deleted primary data file. [2025-10-02T22:22:02.159046] [INFO ] [MAIN ] WH: Starting full primary refresh. [2025-10-02T22:22:02.573608] [INFO ] [REMOTE ] WH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:22:02.607378] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-02T22:22:02.672980] [INFO ] [REMOTE ] WH: Fetching primary data for 2024-12. [2025-10-02T22:22:02.745267] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-10-02T22:22:03.320567] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-02T22:22:03.472995] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-05. [2025-10-02T22:22:04.167344] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-02T22:22:04.273037] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-01. [2025-10-02T22:22:04.617034] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-02T22:22:05.073018] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-01. [2025-10-02T22:22:05.873016] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-06. [2025-10-02T22:22:05.938803] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-02T22:22:06.673006] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-08. [2025-10-02T22:22:06.702021] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-02T22:22:06.791841] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-02T22:22:07.473002] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-02. [2025-10-02T22:22:08.272999] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-02. [2025-10-02T22:22:08.470394] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-02T22:22:08.974733] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-02T22:22:09.073019] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-03. [2025-10-02T22:22:09.512061] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-02T22:22:09.872992] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-09. [2025-10-02T22:22:10.428385] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-02T22:22:10.673022] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-03. [2025-10-02T22:22:11.473048] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-07. [2025-10-02T22:22:11.979528] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-02T22:22:12.272997] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-04. [2025-10-02T22:22:12.354722] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-02T22:22:12.396461] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-02T22:22:13.072998] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-08. [2025-10-02T22:22:13.874908] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-10. [2025-10-02T22:22:13.881250] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-02T22:22:14.252830] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-02T22:22:14.672995] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-09. [2025-10-02T22:22:15.472984] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-04. [2025-10-02T22:22:15.545105] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-02T22:22:15.547438] [INFO ] [REMOTE ] WFC: Full fetch complete (77791 records). [2025-10-02T22:22:15.547569] [DEBUG] [VALIDATOR ] WFC: Validating primary data. [2025-10-02T22:22:16.076617] [DEBUG] [VALIDATOR ] WFC: All expected trading days are present. [2025-10-02T22:22:16.076768] [DEBUG] [VALIDATOR ] WFC: Primary data validation passed. [2025-10-02T22:22:16.078172] [INFO ] [MAIN ] WFC: Fetched primary data is valid. [2025-10-02T22:22:16.078297] [DEBUG] [LOCAL ] WFC: Saving primary data. [2025-10-02T22:22:16.097561] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-02T22:22:16.105722] [DEBUG] [LOCAL ] WFC: Trimmed 77791 records to 54138 (keeping 200 days of data) [2025-10-02T22:22:16.305669] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-05. [2025-10-02T22:22:16.487594] [DEBUG] [LOCAL ] WFC: Primary data saved (54138 records). [2025-10-02T22:22:16.487780] [INFO ] [MAIN ] WFC: Full history saved. [2025-10-02T22:22:16.488668] [INFO ] [MAIN ] Update Progress: 2288/2370 symbols completed. WFC took 40.5s. Estimated remaining: 11m 33s. Rate: 7.1 symbols/min [2025-10-02T22:22:16.681568] [INFO ] [MAIN ] WHD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:22:16.731209] [DEBUG] [LOCAL ] WHD: Loaded 40276 existing records from primary storage. [2025-10-02T22:22:16.731855] [INFO ] [MAIN ] WHD: Loaded 40276 existing records. [2025-10-02T22:22:16.957001] [WARN ] [MAIN ] WHD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:22:16.957452] [INFO ] [MAIN ] WHD: Wiping existing primary data before full refresh. [2025-10-02T22:22:16.957565] [INFO ] [LOCAL ] WHD: Starting deletion of primary data. [2025-10-02T22:22:16.958022] [DEBUG] [LOCAL ] WHD: Deleted primary data file. [2025-10-02T22:22:16.958085] [INFO ] [MAIN ] WHD: Starting full primary refresh. [2025-10-02T22:22:17.085116] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-10. [2025-10-02T22:22:17.419102] [INFO ] [REMOTE ] WHD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:22:17.470594] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-02T22:22:17.529724] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-02T22:22:17.872958] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-06. [2025-10-02T22:22:18.021969] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-02T22:22:18.023200] [INFO ] [REMOTE ] WFG: Full fetch complete (35835 records). [2025-10-02T22:22:18.023277] [DEBUG] [VALIDATOR ] WFG: Validating primary data. [2025-10-02T22:22:18.446752] [DEBUG] [VALIDATOR ] WFG: All expected trading days are present. [2025-10-02T22:22:18.446992] [DEBUG] [VALIDATOR ] WFG: Primary data validation passed. [2025-10-02T22:22:18.448105] [INFO ] [MAIN ] WFG: Fetched primary data is valid. [2025-10-02T22:22:18.448179] [DEBUG] [LOCAL ] WFG: Saving primary data. [2025-10-02T22:22:18.449549] [DEBUG] [LOCAL ] WFG: Trimmed 35835 records to 24878 (keeping 200 days of data) [2025-10-02T22:22:18.617260] [DEBUG] [LOCAL ] WFG: Primary data saved (24878 records). [2025-10-02T22:22:18.617441] [INFO ] [MAIN ] WFG: Full history saved. [2025-10-02T22:22:18.617637] [INFO ] [MAIN ] Update Progress: 2289/2370 symbols completed. WFG took 38.6s. Estimated remaining: 11m 24s. Rate: 7.1 symbols/min [2025-10-02T22:22:18.678212] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-05. [2025-10-02T22:22:18.834633] [INFO ] [MAIN ] WHG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:22:18.842100] [DEBUG] [LOCAL ] WHG: Loaded 3304 existing records from primary storage. [2025-10-02T22:22:18.842354] [INFO ] [MAIN ] WHG: Loaded 3304 existing records. [2025-10-02T22:22:19.032007] [WARN ] [MAIN ] WHG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:22:19.032224] [INFO ] [MAIN ] WHG: Wiping existing primary data before full refresh. [2025-10-02T22:22:19.032298] [INFO ] [LOCAL ] WHG: Starting deletion of primary data. [2025-10-02T22:22:19.032562] [DEBUG] [LOCAL ] WHG: Deleted primary data file. [2025-10-02T22:22:19.032622] [INFO ] [MAIN ] WHG: Starting full primary refresh. [2025-10-02T22:22:19.426002] [INFO ] [REMOTE ] WHG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:22:19.472988] [INFO ] [REMOTE ] WHG: Fetching primary data for 2024-12. [2025-10-02T22:22:19.510352] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-02T22:22:20.076954] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-02T22:22:20.146276] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-02T22:22:20.273060] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-07. [2025-10-02T22:22:21.073067] [INFO ] [REMOTE ] WHD: Fetching primary data for 2024-12. [2025-10-02T22:22:21.685693] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-02T22:22:21.873023] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-06. [2025-10-02T22:22:22.566120] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-02T22:22:22.673024] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-08. [2025-10-02T22:22:23.182130] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-02T22:22:23.473023] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-01. [2025-10-02T22:22:23.880217] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-02T22:22:23.945405] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-02T22:22:24.273038] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-02. [2025-10-02T22:22:24.605911] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-02T22:22:25.073051] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-01. [2025-10-02T22:22:25.873028] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-07. [2025-10-02T22:22:26.574811] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-02T22:22:26.673044] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-09. [2025-10-02T22:22:27.239605] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-02T22:22:27.473051] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-02. [2025-10-02T22:22:28.131384] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-02T22:22:28.273092] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-10. [2025-10-02T22:22:28.574796] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-02T22:22:29.073062] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-03. [2025-10-02T22:22:29.342352] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-02T22:22:29.344847] [INFO ] [REMOTE ] WGO: Full fetch complete (57558 records). [2025-10-02T22:22:29.345000] [DEBUG] [VALIDATOR ] WGO: Validating primary data. [2025-10-02T22:22:29.480255] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-02T22:22:29.796547] [DEBUG] [VALIDATOR ] WGO: All expected trading days are present. [2025-10-02T22:22:29.796639] [DEBUG] [VALIDATOR ] WGO: Primary data validation passed. [2025-10-02T22:22:29.797844] [INFO ] [MAIN ] WGO: Fetched primary data is valid. [2025-10-02T22:22:29.797939] [DEBUG] [LOCAL ] WGO: Saving primary data. [2025-10-02T22:22:29.799256] [DEBUG] [LOCAL ] WGO: Trimmed 57558 records to 39165 (keeping 200 days of data) [2025-10-02T22:22:29.896202] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-08. [2025-10-02T22:22:30.073717] [DEBUG] [LOCAL ] WGO: Primary data saved (39165 records). [2025-10-02T22:22:30.073863] [INFO ] [MAIN ] WGO: Full history saved. [2025-10-02T22:22:30.073948] [INFO ] [MAIN ] Update Progress: 2290/2370 symbols completed. WGO took 30.3s. Estimated remaining: 11m 16s. Rate: 7.1 symbols/min [2025-10-02T22:22:30.289134] [INFO ] [MAIN ] WHR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:22:30.338376] [DEBUG] [LOCAL ] WHR: Loaded 48132 existing records from primary storage. [2025-10-02T22:22:30.338767] [INFO ] [MAIN ] WHR: Loaded 48132 existing records. [2025-10-02T22:22:30.546092] [WARN ] [MAIN ] WHR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:22:30.546371] [INFO ] [MAIN ] WHR: Wiping existing primary data before full refresh. [2025-10-02T22:22:30.546435] [INFO ] [LOCAL ] WHR: Starting deletion of primary data. [2025-10-02T22:22:30.546756] [DEBUG] [LOCAL ] WHR: Deleted primary data file. [2025-10-02T22:22:30.546832] [INFO ] [MAIN ] WHR: Starting full primary refresh. [2025-10-02T22:22:30.675447] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-04. [2025-10-02T22:22:30.966887] [INFO ] [REMOTE ] WHR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:22:31.297169] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-02T22:22:31.473045] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-03. [2025-10-02T22:22:31.538316] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-02T22:22:32.273032] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-09. [2025-10-02T22:22:33.073035] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-05. [2025-10-02T22:22:33.157093] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-02T22:22:33.555793] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-02T22:22:33.655949] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-02T22:22:33.873052] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-06. [2025-10-02T22:22:34.476979] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-02T22:22:34.673015] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-04. [2025-10-02T22:22:35.473036] [INFO ] [REMOTE ] WHR: Fetching primary data for 2024-12. [2025-10-02T22:22:36.273218] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-07. [2025-10-02T22:22:36.381708] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-02T22:22:36.722398] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-02T22:22:36.914383] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-02T22:22:37.073009] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-10. [2025-10-02T22:22:37.873024] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-01. [2025-10-02T22:22:38.101868] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-02T22:22:38.103912] [INFO ] [REMOTE ] WH: Full fetch complete (64999 records). [2025-10-02T22:22:38.104068] [DEBUG] [VALIDATOR ] WH: Validating primary data. [2025-10-02T22:22:38.534115] [DEBUG] [VALIDATOR ] WH: All expected trading days are present. [2025-10-02T22:22:38.534207] [DEBUG] [VALIDATOR ] WH: Primary data validation passed. [2025-10-02T22:22:38.535489] [INFO ] [MAIN ] WH: Fetched primary data is valid. [2025-10-02T22:22:38.535567] [DEBUG] [LOCAL ] WH: Saving primary data. [2025-10-02T22:22:38.537321] [DEBUG] [LOCAL ] WH: Trimmed 64999 records to 45765 (keeping 200 days of data) [2025-10-02T22:22:38.673694] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-05. [2025-10-02T22:22:38.859194] [DEBUG] [LOCAL ] WH: Primary data saved (45765 records). [2025-10-02T22:22:38.859345] [INFO ] [MAIN ] WH: Full history saved. [2025-10-02T22:22:38.859469] [INFO ] [MAIN ] Update Progress: 2291/2370 symbols completed. WH took 37.2s. Estimated remaining: 11m 7s. Rate: 7.1 symbols/min [2025-10-02T22:22:39.069440] [INFO ] [MAIN ] WIA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:22:39.079213] [DEBUG] [LOCAL ] WIA: Loaded 4807 existing records from primary storage. [2025-10-02T22:22:39.079484] [INFO ] [MAIN ] WIA: Loaded 4807 existing records. [2025-10-02T22:22:39.293675] [WARN ] [MAIN ] WIA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:22:39.294178] [INFO ] [MAIN ] WIA: Wiping existing primary data before full refresh. [2025-10-02T22:22:39.294276] [INFO ] [LOCAL ] WIA: Starting deletion of primary data. [2025-10-02T22:22:39.294522] [DEBUG] [LOCAL ] WIA: Deleted primary data file. [2025-10-02T22:22:39.294746] [INFO ] [MAIN ] WIA: Starting full primary refresh. [2025-10-02T22:22:39.475735] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-08. [2025-10-02T22:22:39.732614] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-02T22:22:39.776883] [INFO ] [REMOTE ] WIA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:22:40.070914] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-02T22:22:40.273257] [INFO ] [REMOTE ] WIA: Fetching primary data for 2024-12. [2025-10-02T22:22:40.325921] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-02T22:22:40.811217] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-02T22:22:41.073080] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-02. [2025-10-02T22:22:41.873017] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-01. [2025-10-02T22:22:42.478292] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-02T22:22:42.672977] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-06. [2025-10-02T22:22:42.783405] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-02T22:22:43.473008] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-02. [2025-10-02T22:22:44.087383] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-02T22:22:44.202054] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-02T22:22:44.273016] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-07. [2025-10-02T22:22:45.073038] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-03. [2025-10-02T22:22:45.664757] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-02T22:22:45.754699] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-02T22:22:45.873027] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-08. [2025-10-02T22:22:46.672993] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-09. [2025-10-02T22:22:47.219858] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-02T22:22:47.469939] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-02T22:22:47.478387] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-04. [2025-10-02T22:22:48.095903] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-02T22:22:48.273205] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-10. [2025-10-02T22:22:48.584313] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-10-02T22:22:48.585143] [INFO ] [REMOTE ] WHG: Full fetch complete (4626 records). [2025-10-02T22:22:48.585216] [DEBUG] [VALIDATOR ] WHG: Validating primary data. [2025-10-02T22:22:48.965061] [DEBUG] [VALIDATOR ] WHG: All expected trading days are present. [2025-10-02T22:22:48.965141] [DEBUG] [VALIDATOR ] WHG: Primary data validation passed. [2025-10-02T22:22:48.965281] [INFO ] [MAIN ] WHG: Fetched primary data is valid. [2025-10-02T22:22:48.965321] [DEBUG] [LOCAL ] WHG: Saving primary data. [2025-10-02T22:22:48.965769] [DEBUG] [LOCAL ] WHG: Trimmed 4626 records to 3320 (keeping 200 days of data) [2025-10-02T22:22:48.988291] [DEBUG] [LOCAL ] WHG: Primary data saved (3320 records). [2025-10-02T22:22:48.988451] [INFO ] [MAIN ] WHG: Full history saved. [2025-10-02T22:22:48.988566] [INFO ] [MAIN ] Update Progress: 2292/2370 symbols completed. WHG took 30.4s. Estimated remaining: 10m 59s. Rate: 7.1 symbols/min [2025-10-02T22:22:49.078244] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-03. [2025-10-02T22:22:49.215594] [INFO ] [MAIN ] WINN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:22:49.234534] [DEBUG] [LOCAL ] WINN: Loaded 11626 existing records from primary storage. [2025-10-02T22:22:49.234821] [INFO ] [MAIN ] WINN: Loaded 11626 existing records. [2025-10-02T22:22:49.428484] [WARN ] [MAIN ] WINN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:22:49.428794] [INFO ] [MAIN ] WINN: Wiping existing primary data before full refresh. [2025-10-02T22:22:49.428858] [INFO ] [LOCAL ] WINN: Starting deletion of primary data. [2025-10-02T22:22:49.429095] [DEBUG] [LOCAL ] WINN: Deleted primary data file. [2025-10-02T22:22:49.429155] [INFO ] [MAIN ] WINN: Starting full primary refresh. [2025-10-02T22:22:49.882883] [INFO ] [REMOTE ] WINN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:22:49.878412] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-05. [2025-10-02T22:22:50.521622] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-02T22:22:50.672973] [INFO ] [REMOTE ] WINN: Fetching primary data for 2024-12. [2025-10-02T22:22:50.772335] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-02T22:22:51.472998] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-04. [2025-10-02T22:22:51.538202] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-02T22:22:52.273019] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-06. [2025-10-02T22:22:53.073065] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-01. [2025-10-02T22:22:53.873035] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-09. [2025-10-02T22:23:05.576817] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-01 (12.50 seconds). [2025-10-02T22:23:05.581352] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-02. [2025-10-02T22:23:05.678011] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-06 (13.40 seconds). [2025-10-02T22:23:05.679945] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-07. [2025-10-02T22:23:06.536340] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-09 (12.66 seconds). [2025-10-02T22:23:06.545908] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-10. [2025-10-02T22:23:06.793228] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-02T22:23:06.795118] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-08. [2025-10-02T22:23:07.003529] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-02T22:23:07.007694] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-03. [2025-10-02T22:23:07.275241] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-04 (15.80 seconds). [2025-10-02T22:23:07.287322] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-05. [2025-10-02T22:23:07.420450] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-02T22:23:07.422633] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-09. [2025-10-02T22:23:07.586039] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-02T22:23:07.588947] [INFO ] [REMOTE ] WHD: Full fetch complete (57519 records). [2025-10-02T22:23:07.589200] [DEBUG] [VALIDATOR ] WHD: Validating primary data. [2025-10-02T22:23:08.027730] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-02T22:23:08.054793] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-04. [2025-10-02T22:23:08.094898] [DEBUG] [VALIDATOR ] WHD: All expected trading days are present. [2025-10-02T22:23:08.094989] [DEBUG] [VALIDATOR ] WHD: Primary data validation passed. [2025-10-02T22:23:08.096151] [INFO ] [MAIN ] WHD: Fetched primary data is valid. [2025-10-02T22:23:08.096222] [DEBUG] [LOCAL ] WHD: Saving primary data. [2025-10-02T22:23:08.097563] [DEBUG] [LOCAL ] WHD: Trimmed 57519 records to 40598 (keeping 200 days of data) [2025-10-02T22:23:08.204948] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-02T22:23:08.211092] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-10. [2025-10-02T22:23:08.399916] [DEBUG] [LOCAL ] WHD: Primary data saved (40598 records). [2025-10-02T22:23:08.400059] [INFO ] [MAIN ] WHD: Full history saved. [2025-10-02T22:23:08.401113] [INFO ] [MAIN ] Update Progress: 2293/2370 symbols completed. WHD took 51.9s. Estimated remaining: 10m 51s. Rate: 7.1 symbols/min [2025-10-02T22:23:08.609582] [INFO ] [MAIN ] WIT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:23:08.618743] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-02T22:23:08.619890] [INFO ] [REMOTE ] WIA: Full fetch complete (7271 records). [2025-10-02T22:23:08.619967] [DEBUG] [VALIDATOR ] WIA: Validating primary data. [2025-10-02T22:23:08.968494] [DEBUG] [LOCAL ] WIT: Loaded 52357 existing records from primary storage. [2025-10-02T22:23:08.984775] [INFO ] [MAIN ] WIT: Loaded 52357 existing records. [2025-10-02T22:23:09.129873] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-02T22:23:09.212170] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-05. [2025-10-02T22:23:09.278481] [DEBUG] [VALIDATOR ] WIA: All expected trading days are present. [2025-10-02T22:23:09.290113] [DEBUG] [VALIDATOR ] WIA: Primary data validation passed. [2025-10-02T22:23:09.302419] [INFO ] [MAIN ] WIA: Fetched primary data is valid. [2025-10-02T22:23:09.302610] [DEBUG] [LOCAL ] WIA: Saving primary data. [2025-10-02T22:23:09.330313] [DEBUG] [LOCAL ] WIA: Trimmed 7271 records to 4835 (keeping 200 days of data) [2025-10-02T22:23:09.384445] [WARN ] [MAIN ] WIT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:23:09.386026] [INFO ] [MAIN ] WIT: Wiping existing primary data before full refresh. [2025-10-02T22:23:09.399740] [INFO ] [LOCAL ] WIT: Starting deletion of primary data. [2025-10-02T22:23:09.410828] [DEBUG] [LOCAL ] WIT: Deleted primary data file. [2025-10-02T22:23:09.411359] [INFO ] [MAIN ] WIT: Starting full primary refresh. [2025-10-02T22:23:09.519673] [DEBUG] [LOCAL ] WIA: Primary data saved (4835 records). [2025-10-02T22:23:09.550038] [INFO ] [MAIN ] WIA: Full history saved. [2025-10-02T22:23:09.551187] [INFO ] [MAIN ] Update Progress: 2294/2370 symbols completed. WIA took 30.7s. Estimated remaining: 10m 42s. Rate: 7.1 symbols/min [2025-10-02T22:23:10.049422] [INFO ] [MAIN ] WIW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:23:10.102450] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-05 (2.82 seconds). [2025-10-02T22:23:10.129510] [INFO ] [REMOTE ] WIT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:23:10.130283] [INFO ] [REMOTE ] WIT: Fetching primary data for 2024-12. [2025-10-02T22:23:10.145503] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-06. [2025-10-02T22:23:10.163169] [DEBUG] [LOCAL ] WIW: Loaded 20296 existing records from primary storage. [2025-10-02T22:23:10.163444] [INFO ] [MAIN ] WIW: Loaded 20296 existing records. [2025-10-02T22:23:10.375692] [WARN ] [MAIN ] WIW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:23:10.376291] [INFO ] [MAIN ] WIW: Wiping existing primary data before full refresh. [2025-10-02T22:23:10.376388] [INFO ] [LOCAL ] WIW: Starting deletion of primary data. [2025-10-02T22:23:10.382165] [DEBUG] [LOCAL ] WIW: Deleted primary data file. [2025-10-02T22:23:10.386110] [INFO ] [MAIN ] WIW: Starting full primary refresh. [2025-10-02T22:23:10.392330] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-02T22:23:10.444209] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-06. [2025-10-02T22:23:10.844817] [INFO ] [REMOTE ] WIW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:23:10.845295] [INFO ] [REMOTE ] WIW: Fetching primary data for 2024-12. [2025-10-02T22:23:11.196379] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-02T22:23:11.200637] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-07. [2025-10-02T22:23:11.727366] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-02T22:23:11.738701] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-07. [2025-10-02T22:23:11.829946] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-02T22:23:11.833176] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-08. [2025-10-02T22:23:11.947444] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-02T22:23:11.954010] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-01. [2025-10-02T22:23:12.208011] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-02T22:23:12.220189] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-01. [2025-10-02T22:23:12.400865] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-02T22:23:12.403824] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-09. [2025-10-02T22:23:12.901875] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-02T22:23:12.904909] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-10. [2025-10-02T22:23:12.965617] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-02T22:23:12.972100] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-02. [2025-10-02T22:23:13.374445] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-02T22:23:13.375991] [INFO ] [REMOTE ] WINN: Full fetch complete (17581 records). [2025-10-02T22:23:13.376121] [DEBUG] [VALIDATOR ] WINN: Validating primary data. [2025-10-02T22:23:13.788504] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-02T22:23:13.819512] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-08. [2025-10-02T22:23:13.953437] [DEBUG] [VALIDATOR ] WINN: All expected trading days are present. [2025-10-02T22:23:13.953154] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-02T22:23:13.953582] [DEBUG] [VALIDATOR ] WINN: Primary data validation passed. [2025-10-02T22:23:13.954404] [INFO ] [MAIN ] WINN: Fetched primary data is valid. [2025-10-02T22:23:13.966739] [DEBUG] [LOCAL ] WINN: Saving primary data. [2025-10-02T22:23:13.967317] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-02. [2025-10-02T22:23:13.982389] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-02T22:23:13.982538] [DEBUG] [LOCAL ] WINN: Trimmed 17581 records to 11698 (keeping 200 days of data) [2025-10-02T22:23:13.988965] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-03. [2025-10-02T22:23:14.078575] [DEBUG] [LOCAL ] WINN: Primary data saved (11698 records). [2025-10-02T22:23:14.078787] [INFO ] [MAIN ] WINN: Full history saved. [2025-10-02T22:23:14.078914] [INFO ] [MAIN ] Update Progress: 2295/2370 symbols completed. WINN took 25.1s. Estimated remaining: 10m 34s. Rate: 7.1 symbols/min [2025-10-02T22:23:14.273287] [INFO ] [MAIN ] WK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:23:14.317786] [DEBUG] [LOCAL ] WK: Loaded 37163 existing records from primary storage. [2025-10-02T22:23:14.318219] [INFO ] [MAIN ] WK: Loaded 37163 existing records. [2025-10-02T22:23:14.523331] [WARN ] [MAIN ] WK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:23:14.523567] [INFO ] [MAIN ] WK: Wiping existing primary data before full refresh. [2025-10-02T22:23:14.523619] [INFO ] [LOCAL ] WK: Starting deletion of primary data. [2025-10-02T22:23:14.523882] [DEBUG] [LOCAL ] WK: Deleted primary data file. [2025-10-02T22:23:14.523944] [INFO ] [MAIN ] WK: Starting full primary refresh. [2025-10-02T22:23:14.891199] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-02T22:23:14.934282] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-04. [2025-10-02T22:23:15.038879] [INFO ] [REMOTE ] WK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:23:15.473060] [INFO ] [REMOTE ] WK: Fetching primary data for 2024-12. [2025-10-02T22:23:15.635792] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-02T22:23:15.820780] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-02T22:23:16.148336] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-02T22:23:16.273074] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-03. [2025-10-02T22:23:16.476030] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-02T22:23:17.073023] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-05. [2025-10-02T22:23:17.872997] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-01. [2025-10-02T22:23:18.080585] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-02T22:23:18.111801] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-02T22:23:18.673049] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-04. [2025-10-02T22:23:19.279183] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-02T22:23:19.473065] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-06. [2025-10-02T22:23:20.273024] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-02. [2025-10-02T22:23:20.517507] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-02T22:23:20.519359] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-02T22:23:21.073061] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-07. [2025-10-02T22:23:21.818858] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-02T22:23:21.873001] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-09. [2025-10-02T22:23:22.193359] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-02T22:23:22.673048] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-08. [2025-10-02T22:23:23.473055] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-05. [2025-10-02T22:23:23.625887] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-02T22:23:23.956292] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-02T22:23:24.273247] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-03. [2025-10-02T22:23:25.073051] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-09. [2025-10-02T22:23:25.248457] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-02T22:23:25.378879] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-02T22:23:25.872987] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-10. [2025-10-02T22:23:25.875894] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-02T22:23:26.673014] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-06. [2025-10-02T22:23:27.311949] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-02T22:23:27.317149] [INFO ] [REMOTE ] WHR: Full fetch complete (68588 records). [2025-10-02T22:23:27.317309] [DEBUG] [VALIDATOR ] WHR: Validating primary data. [2025-10-02T22:23:27.478145] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-10. [2025-10-02T22:23:27.764821] [DEBUG] [VALIDATOR ] WHR: All expected trading days are present. [2025-10-02T22:23:27.764907] [DEBUG] [VALIDATOR ] WHR: Primary data validation passed. [2025-10-02T22:23:27.766159] [INFO ] [MAIN ] WHR: Fetched primary data is valid. [2025-10-02T22:23:27.766229] [DEBUG] [LOCAL ] WHR: Saving primary data. [2025-10-02T22:23:27.768011] [DEBUG] [LOCAL ] WHR: Trimmed 68588 records to 48506 (keeping 200 days of data) [2025-10-02T22:23:28.105533] [DEBUG] [LOCAL ] WHR: Primary data saved (48506 records). [2025-10-02T22:23:28.105720] [INFO ] [MAIN ] WHR: Full history saved. [2025-10-02T22:23:28.105868] [INFO ] [MAIN ] Update Progress: 2296/2370 symbols completed. WHR took 58.0s. Estimated remaining: 10m 25s. Rate: 7.1 symbols/min [2025-10-02T22:23:28.295284] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-04. [2025-10-02T22:23:28.262370] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-02T22:23:28.311533] [INFO ] [REMOTE ] WIW: Full fetch complete (29949 records). [2025-10-02T22:23:28.316704] [DEBUG] [VALIDATOR ] WIW: Validating primary data. [2025-10-02T22:23:28.343306] [INFO ] [MAIN ] WKC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:23:28.524831] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-02T22:23:28.764308] [DEBUG] [LOCAL ] WKC: Loaded 34861 existing records from primary storage. [2025-10-02T22:23:28.787074] [INFO ] [MAIN ] WKC: Loaded 34861 existing records. [2025-10-02T22:23:29.102712] [DEBUG] [VALIDATOR ] WIW: All expected trading days are present. [2025-10-02T22:23:29.082754] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-07. [2025-10-02T22:23:29.102866] [DEBUG] [VALIDATOR ] WIW: Primary data validation passed. [2025-10-02T22:23:29.130356] [INFO ] [MAIN ] WIW: Fetched primary data is valid. [2025-10-02T22:23:29.137202] [DEBUG] [LOCAL ] WIW: Saving primary data. [2025-10-02T22:23:29.174917] [WARN ] [MAIN ] WKC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:23:29.175695] [DEBUG] [LOCAL ] WIW: Trimmed 29949 records to 20534 (keeping 200 days of data) [2025-10-02T22:23:29.176202] [INFO ] [MAIN ] WKC: Wiping existing primary data before full refresh. [2025-10-02T22:23:29.176267] [INFO ] [LOCAL ] WKC: Starting deletion of primary data. [2025-10-02T22:23:29.176926] [DEBUG] [LOCAL ] WKC: Deleted primary data file. [2025-10-02T22:23:29.176990] [INFO ] [MAIN ] WKC: Starting full primary refresh. [2025-10-02T22:23:29.747354] [INFO ] [REMOTE ] WKC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:23:29.748353] [DEBUG] [LOCAL ] WIW: Primary data saved (20534 records). [2025-10-02T22:23:29.749046] [INFO ] [MAIN ] WIW: Full history saved. [2025-10-02T22:23:29.749348] [INFO ] [MAIN ] Update Progress: 2297/2370 symbols completed. WIW took 20.2s. Estimated remaining: 10m 17s. Rate: 7.1 symbols/min [2025-10-02T22:23:29.876766] [INFO ] [REMOTE ] WKC: Fetching primary data for 2024-12. [2025-10-02T22:23:29.947793] [INFO ] [MAIN ] WLK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:23:29.974958] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-02T22:23:30.025813] [DEBUG] [LOCAL ] WLK: Loaded 45534 existing records from primary storage. [2025-10-02T22:23:30.026150] [INFO ] [MAIN ] WLK: Loaded 45534 existing records. [2025-10-02T22:23:30.220234] [WARN ] [MAIN ] WLK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:23:30.220467] [INFO ] [MAIN ] WLK: Wiping existing primary data before full refresh. [2025-10-02T22:23:30.220515] [INFO ] [LOCAL ] WLK: Starting deletion of primary data. [2025-10-02T22:23:30.220830] [DEBUG] [LOCAL ] WLK: Deleted primary data file. [2025-10-02T22:23:30.220890] [INFO ] [MAIN ] WLK: Starting full primary refresh. [2025-10-02T22:23:30.622662] [INFO ] [REMOTE ] WLK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:23:30.672986] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-05. [2025-10-02T22:23:31.085146] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-02T22:23:31.417887] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-02T22:23:31.472993] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-01. [2025-10-02T22:23:32.048912] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-02T22:23:32.278088] [INFO ] [REMOTE ] WLK: Fetching primary data for 2024-12. [2025-10-02T22:23:32.291982] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-02T22:23:33.073043] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-06. [2025-10-02T22:23:33.844294] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-02T22:23:33.872984] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-01. [2025-10-02T22:23:34.128627] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-02T22:23:34.673042] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-02. [2025-10-02T22:23:35.414860] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-02T22:23:35.473024] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-02. [2025-10-02T22:23:35.898120] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-02T22:23:36.273014] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-08. [2025-10-02T22:23:36.922170] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-02T22:23:37.073064] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-03. [2025-10-02T22:23:37.873150] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-07. [2025-10-02T22:23:38.097506] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-02T22:23:38.272330] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-02T22:23:38.673012] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-03. [2025-10-02T22:23:39.221335] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-02T22:23:39.473049] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-08. [2025-10-02T22:23:40.015513] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-02T22:23:40.273001] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-04. [2025-10-02T22:23:41.008324] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-02T22:23:41.072980] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-09. [2025-10-02T22:23:41.518680] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-02T22:23:41.873024] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-09. [2025-10-02T22:23:42.529914] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-02T22:23:42.672998] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-10. [2025-10-02T22:23:43.191493] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-02T22:23:43.473061] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-10. [2025-10-02T22:23:44.026358] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-02T22:23:44.028973] [INFO ] [REMOTE ] WIT: Full fetch complete (75648 records). [2025-10-02T22:23:44.029156] [DEBUG] [VALIDATOR ] WIT: Validating primary data. [2025-10-02T22:23:44.278971] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-04. [2025-10-02T22:23:44.474729] [DEBUG] [VALIDATOR ] WIT: All expected trading days are present. [2025-10-02T22:23:44.474851] [DEBUG] [VALIDATOR ] WIT: Primary data validation passed. [2025-10-02T22:23:44.476206] [INFO ] [MAIN ] WIT: Fetched primary data is valid. [2025-10-02T22:23:44.476280] [DEBUG] [LOCAL ] WIT: Saving primary data. [2025-10-02T22:23:44.477961] [DEBUG] [LOCAL ] WIT: Trimmed 75648 records to 52740 (keeping 200 days of data) [2025-10-02T22:23:44.791984] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-02T22:23:44.796393] [INFO ] [REMOTE ] WK: Full fetch complete (52682 records). [2025-10-02T22:23:44.797166] [DEBUG] [VALIDATOR ] WK: Validating primary data. [2025-10-02T22:23:45.075448] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-05. [2025-10-02T22:23:45.230425] [DEBUG] [LOCAL ] WIT: Primary data saved (52740 records). [2025-10-02T22:23:45.244131] [INFO ] [MAIN ] WIT: Full history saved. [2025-10-02T22:23:45.245455] [DEBUG] [VALIDATOR ] WK: All expected trading days are present. [2025-10-02T22:23:45.245352] [INFO ] [MAIN ] Update Progress: 2298/2370 symbols completed. WIT took 36.8s. Estimated remaining: 10m 9s. Rate: 7.1 symbols/min [2025-10-02T22:23:45.245584] [DEBUG] [VALIDATOR ] WK: Primary data validation passed. [2025-10-02T22:23:45.252256] [INFO ] [MAIN ] WK: Fetched primary data is valid. [2025-10-02T22:23:45.309674] [DEBUG] [LOCAL ] WK: Saving primary data. [2025-10-02T22:23:45.366913] [DEBUG] [LOCAL ] WK: Trimmed 52682 records to 37436 (keeping 200 days of data) [2025-10-02T22:23:45.535742] [INFO ] [MAIN ] WLKP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:23:45.573387] [DEBUG] [LOCAL ] WLKP: Loaded 6828 existing records from primary storage. [2025-10-02T22:23:45.574703] [INFO ] [MAIN ] WLKP: Loaded 6828 existing records. [2025-10-02T22:23:45.826190] [WARN ] [MAIN ] WLKP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:23:45.830763] [INFO ] [MAIN ] WLKP: Wiping existing primary data before full refresh. [2025-10-02T22:23:45.830907] [INFO ] [LOCAL ] WLKP: Starting deletion of primary data. [2025-10-02T22:23:45.831157] [DEBUG] [LOCAL ] WLKP: Deleted primary data file. [2025-10-02T22:23:45.831225] [INFO ] [MAIN ] WLKP: Starting full primary refresh. [2025-10-02T22:23:46.225011] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-02T22:23:46.272193] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-05. [2025-10-02T22:23:46.383031] [INFO ] [REMOTE ] WLKP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:23:46.397222] [DEBUG] [LOCAL ] WK: Primary data saved (37436 records). [2025-10-02T22:23:46.397344] [INFO ] [MAIN ] WK: Full history saved. [2025-10-02T22:23:46.397425] [INFO ] [MAIN ] Update Progress: 2299/2370 symbols completed. WK took 32.3s. Estimated remaining: 9m 60s. Rate: 7.1 symbols/min [2025-10-02T22:23:46.613850] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-02T22:23:46.617549] [INFO ] [MAIN ] WLTG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:23:46.626491] [DEBUG] [LOCAL ] WLTG: No existing data file found in primary storage. [2025-10-02T22:23:46.626767] [WARN ] [MAIN ] WLTG: No existing data found, performing full refresh instead. [2025-10-02T22:23:46.627283] [INFO ] [MAIN ] WLTG: Wiping existing primary data before full refresh. [2025-10-02T22:23:46.627331] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-10-02T22:23:46.627375] [DEBUG] [LOCAL ] WLTG: No primary data file found to delete. [2025-10-02T22:23:46.627408] [INFO ] [MAIN ] WLTG: Starting full primary refresh. [2025-10-02T22:23:46.678192] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2024-12. [2025-10-02T22:23:47.044586] [INFO ] [REMOTE ] WLTG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:23:47.473062] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-06. [2025-10-02T22:23:47.502309] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-02T22:23:47.768398] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-02T22:23:48.272997] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2024-12. [2025-10-02T22:23:48.496539] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-02T22:23:48.634398] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-10-02T22:23:49.072997] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-01. [2025-10-02T22:23:49.433901] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-02T22:23:49.873020] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-02. [2025-10-02T22:23:50.220150] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-02T22:23:50.673010] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-01. [2025-10-02T22:23:51.244281] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-02T22:23:51.473004] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-06. [2025-10-02T22:23:52.273021] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-03. [2025-10-02T22:23:52.627695] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-02T22:23:53.072969] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-02. [2025-10-02T22:23:53.106547] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-02T22:23:53.706176] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-02T22:23:53.873031] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-07. [2025-10-02T22:23:54.673013] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-03. [2025-10-02T22:23:55.278522] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-02T22:23:55.478113] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-07. [2025-10-02T22:23:55.496908] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-02T22:23:56.273022] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-04. [2025-10-02T22:23:56.702728] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-02T22:23:56.931999] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-02T22:23:57.073109] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-05. [2025-10-02T22:23:57.427505] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-02T22:23:57.873015] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-08. [2025-10-02T22:23:58.673002] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-08. [2025-10-02T22:23:59.472970] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-06. [2025-10-02T22:23:59.614019] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-02T22:23:59.739499] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-10-02T22:24:00.107745] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-02T22:24:00.273006] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-09. [2025-10-02T22:24:01.073018] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-09. [2025-10-02T22:24:01.873000] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-07. [2025-10-02T22:24:01.969974] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-02T22:24:02.177041] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-02T22:24:02.337947] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-02T22:24:02.673009] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-04. [2025-10-02T22:24:03.388789] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-02T22:24:03.472996] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-05. [2025-10-02T22:24:04.214805] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-02T22:24:04.273024] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-10. [2025-10-02T22:24:05.073066] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-10. [2025-10-02T22:24:05.436280] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-02T22:24:05.439775] [INFO ] [REMOTE ] WLK: Full fetch complete (63115 records). [2025-10-02T22:24:05.439969] [DEBUG] [VALIDATOR ] WLK: Validating primary data. [2025-10-02T22:24:05.881377] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-06. [2025-10-02T22:24:05.884832] [DEBUG] [VALIDATOR ] WLK: All expected trading days are present. [2025-10-02T22:24:05.885958] [DEBUG] [VALIDATOR ] WLK: Primary data validation passed. [2025-10-02T22:24:05.887240] [INFO ] [MAIN ] WLK: Fetched primary data is valid. [2025-10-02T22:24:05.887447] [DEBUG] [LOCAL ] WLK: Saving primary data. [2025-10-02T22:24:05.889231] [DEBUG] [LOCAL ] WLK: Trimmed 63115 records to 45898 (keeping 200 days of data) [2025-10-02T22:24:06.203226] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-02T22:24:06.206188] [INFO ] [REMOTE ] WKC: Full fetch complete (50932 records). [2025-10-02T22:24:06.207085] [DEBUG] [VALIDATOR ] WKC: Validating primary data. [2025-10-02T22:24:06.208850] [DEBUG] [LOCAL ] WLK: Primary data saved (45898 records). [2025-10-02T22:24:06.208937] [INFO ] [MAIN ] WLK: Full history saved. [2025-10-02T22:24:06.209021] [INFO ] [MAIN ] Update Progress: 2300/2370 symbols completed. WLK took 36.5s. Estimated remaining: 9m 52s. Rate: 7.1 symbols/min [2025-10-02T22:24:06.657639] [INFO ] [MAIN ] WLY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:24:06.673973] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-08. [2025-10-02T22:24:06.752798] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-02T22:24:06.931818] [DEBUG] [LOCAL ] WLY: Loaded 29680 existing records from primary storage. [2025-10-02T22:24:06.952588] [DEBUG] [VALIDATOR ] WKC: All expected trading days are present. [2025-10-02T22:24:06.952712] [DEBUG] [VALIDATOR ] WKC: Primary data validation passed. [2025-10-02T22:24:06.953779] [INFO ] [MAIN ] WKC: Fetched primary data is valid. [2025-10-02T22:24:06.954134] [INFO ] [MAIN ] WLY: Loaded 29680 existing records. [2025-10-02T22:24:06.953993] [DEBUG] [LOCAL ] WKC: Saving primary data. [2025-10-02T22:24:07.082572] [DEBUG] [LOCAL ] WKC: Trimmed 50932 records to 35105 (keeping 200 days of data) [2025-10-02T22:24:07.256164] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-02T22:24:07.259856] [WARN ] [MAIN ] WLY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:24:07.295958] [INFO ] [MAIN ] WLY: Wiping existing primary data before full refresh. [2025-10-02T22:24:07.296505] [INFO ] [LOCAL ] WLY: Starting deletion of primary data. [2025-10-02T22:24:07.297690] [DEBUG] [LOCAL ] WLY: Deleted primary data file. [2025-10-02T22:24:07.298076] [INFO ] [MAIN ] WLY: Starting full primary refresh. [2025-10-02T22:24:07.482018] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-07. [2025-10-02T22:24:07.719071] [INFO ] [REMOTE ] WLY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:24:07.843534] [DEBUG] [LOCAL ] WKC: Primary data saved (35105 records). [2025-10-02T22:24:07.843714] [INFO ] [MAIN ] WKC: Full history saved. [2025-10-02T22:24:07.843811] [INFO ] [MAIN ] Update Progress: 2301/2370 symbols completed. WKC took 39.7s. Estimated remaining: 9m 43s. Rate: 7.1 symbols/min [2025-10-02T22:24:08.030892] [INFO ] [MAIN ] WM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:24:08.082759] [DEBUG] [LOCAL ] WM: Loaded 50913 existing records from primary storage. [2025-10-02T22:24:08.083100] [INFO ] [MAIN ] WM: Loaded 50913 existing records. [2025-10-02T22:24:08.212836] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-02T22:24:08.284260] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-08. [2025-10-02T22:24:08.292538] [WARN ] [MAIN ] WM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:24:08.292791] [INFO ] [MAIN ] WM: Wiping existing primary data before full refresh. [2025-10-02T22:24:08.292845] [INFO ] [LOCAL ] WM: Starting deletion of primary data. [2025-10-02T22:24:08.293147] [DEBUG] [LOCAL ] WM: Deleted primary data file. [2025-10-02T22:24:08.293907] [INFO ] [MAIN ] WM: Starting full primary refresh. [2025-10-02T22:24:08.673394] [INFO ] [REMOTE ] WM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:24:09.073017] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-09. [2025-10-02T22:24:09.148974] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-02T22:24:09.446422] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-02T22:24:09.873003] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-09. [2025-10-02T22:24:10.615388] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-02T22:24:10.673015] [INFO ] [REMOTE ] WLY: Fetching primary data for 2024-12. [2025-10-02T22:24:11.473007] [INFO ] [REMOTE ] WM: Fetching primary data for 2024-12. [2025-10-02T22:24:11.990170] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-02T22:24:12.273015] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-01. [2025-10-02T22:24:13.078098] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-10. [2025-10-02T22:24:13.093324] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-02T22:24:13.208394] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-02T22:24:13.339681] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-10 (0.26 seconds). [2025-10-02T22:24:13.340414] [INFO ] [REMOTE ] WLTG: Full fetch complete (1670 records). [2025-10-02T22:24:13.340490] [DEBUG] [VALIDATOR ] WLTG: Validating primary data. [2025-10-02T22:24:13.539396] [WARN ] [VALIDATOR ] WLTG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-02T22:24:13.539616] [FATAL] [MAIN ] WLTG: Fetched primary data is invalid. Refusing to save it. [2025-10-02T22:24:13.539708] [WARN ] [MAIN ] WLTG: Deleting existing primary and derivative data due to validation failure. [2025-10-02T22:24:13.539786] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-10-02T22:24:13.539852] [DEBUG] [LOCAL ] WLTG: No primary data file found to delete. [2025-10-02T22:24:13.539981] [INFO ] [LOCAL ] WLTG: Starting deletion of derivative data. [2025-10-02T22:24:13.540047] [DEBUG] [LOCAL ] WLTG: No derivative data file found to delete. [2025-10-02T22:24:13.540110] [INFO ] [MAIN ] Update Progress: 2302/2370 symbols completed. WLTG took 27.1s. Estimated remaining: 9m 35s. Rate: 7.1 symbols/min [2025-10-02T22:24:13.733470] [INFO ] [MAIN ] WMB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:24:13.785266] [DEBUG] [LOCAL ] WMB: Loaded 53671 existing records from primary storage. [2025-10-02T22:24:13.785664] [INFO ] [MAIN ] WMB: Loaded 53671 existing records. [2025-10-02T22:24:13.878136] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-10. [2025-10-02T22:24:13.982844] [WARN ] [MAIN ] WMB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:24:13.983059] [INFO ] [MAIN ] WMB: Wiping existing primary data before full refresh. [2025-10-02T22:24:13.983110] [INFO ] [LOCAL ] WMB: Starting deletion of primary data. [2025-10-02T22:24:13.983367] [DEBUG] [LOCAL ] WMB: Deleted primary data file. [2025-10-02T22:24:13.983428] [INFO ] [MAIN ] WMB: Starting full primary refresh. [2025-10-02T22:24:14.428838] [INFO ] [REMOTE ] WMB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:24:14.435203] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-02T22:24:14.436545] [INFO ] [REMOTE ] WLKP: Full fetch complete (10371 records). [2025-10-02T22:24:14.436666] [DEBUG] [VALIDATOR ] WLKP: Validating primary data. [2025-10-02T22:24:14.681869] [INFO ] [REMOTE ] WMB: Fetching primary data for 2024-12. [2025-10-02T22:24:14.854692] [DEBUG] [VALIDATOR ] WLKP: All expected trading days are present. [2025-10-02T22:24:14.854788] [DEBUG] [VALIDATOR ] WLKP: Primary data validation passed. [2025-10-02T22:24:14.855074] [INFO ] [MAIN ] WLKP: Fetched primary data is valid. [2025-10-02T22:24:14.855120] [DEBUG] [LOCAL ] WLKP: Saving primary data. [2025-10-02T22:24:14.855637] [DEBUG] [LOCAL ] WLKP: Trimmed 10371 records to 6891 (keeping 200 days of data) [2025-10-02T22:24:14.901071] [DEBUG] [LOCAL ] WLKP: Primary data saved (6891 records). [2025-10-02T22:24:14.901241] [INFO ] [MAIN ] WLKP: Full history saved. [2025-10-02T22:24:14.901351] [INFO ] [MAIN ] Update Progress: 2303/2370 symbols completed. WLKP took 29.7s. Estimated remaining: 9m 26s. Rate: 7.1 symbols/min [2025-10-02T22:24:15.086001] [INFO ] [MAIN ] WMK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:24:15.108615] [DEBUG] [LOCAL ] WMK: Loaded 14515 existing records from primary storage. [2025-10-02T22:24:15.108896] [INFO ] [MAIN ] WMK: Loaded 14515 existing records. [2025-10-02T22:24:15.301692] [WARN ] [MAIN ] WMK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:24:15.302046] [INFO ] [MAIN ] WMK: Wiping existing primary data before full refresh. [2025-10-02T22:24:15.302105] [INFO ] [LOCAL ] WMK: Starting deletion of primary data. [2025-10-02T22:24:15.302291] [DEBUG] [LOCAL ] WMK: Deleted primary data file. [2025-10-02T22:24:15.302350] [INFO ] [MAIN ] WMK: Starting full primary refresh. [2025-10-02T22:24:15.477689] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-02. [2025-10-02T22:24:15.717586] [INFO ] [REMOTE ] WMK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:24:16.272992] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-01. [2025-10-02T22:24:16.704010] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-02T22:24:16.830991] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-02T22:24:17.073009] [INFO ] [REMOTE ] WMK: Fetching primary data for 2024-12. [2025-10-02T22:24:17.873012] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-03. [2025-10-02T22:24:17.974680] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-02T22:24:18.250485] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-02T22:24:18.673028] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-02. [2025-10-02T22:24:19.185251] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-02T22:24:19.473019] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-01. [2025-10-02T22:24:20.273005] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-04. [2025-10-02T22:24:20.317293] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-02T22:24:20.529865] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-02T22:24:21.073013] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-03. [2025-10-02T22:24:21.653480] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-02T22:24:21.873062] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-02. [2025-10-02T22:24:22.673007] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-05. [2025-10-02T22:24:22.703744] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-02T22:24:23.078446] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-02T22:24:23.473032] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-04. [2025-10-02T22:24:24.095718] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-02T22:24:24.273050] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-06. [2025-10-02T22:24:25.073057] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-03. [2025-10-02T22:24:25.467896] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-02T22:24:25.582346] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-02T22:24:25.784309] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-02T22:24:25.873015] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-05. [2025-10-02T22:24:26.672998] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-07. [2025-10-02T22:24:27.473020] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-01. [2025-10-02T22:24:27.661726] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-02T22:24:28.072525] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-02T22:24:28.273003] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-06. [2025-10-02T22:24:29.073033] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-08. [2025-10-02T22:24:29.464495] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-02T22:24:29.873009] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-02. [2025-10-02T22:24:30.180762] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-02T22:24:30.229834] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-02T22:24:30.672999] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-07. [2025-10-02T22:24:31.473039] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-09. [2025-10-02T22:24:31.838405] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-02T22:24:32.272991] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-04. [2025-10-02T22:24:32.400753] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-02T22:24:32.485602] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-02T22:24:33.079141] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-03. [2025-10-02T22:24:33.084437] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-02T22:24:33.873032] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-10. [2025-10-02T22:24:34.617115] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-02T22:24:34.618879] [INFO ] [REMOTE ] WLY: Full fetch complete (42822 records). [2025-10-02T22:24:34.618976] [DEBUG] [VALIDATOR ] WLY: Validating primary data. [2025-10-02T22:24:34.678079] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-05. [2025-10-02T22:24:35.083741] [DEBUG] [VALIDATOR ] WLY: All expected trading days are present. [2025-10-02T22:24:35.083986] [DEBUG] [VALIDATOR ] WLY: Primary data validation passed. [2025-10-02T22:24:35.085192] [INFO ] [MAIN ] WLY: Fetched primary data is valid. [2025-10-02T22:24:35.085298] [DEBUG] [LOCAL ] WLY: Saving primary data. [2025-10-02T22:24:35.097335] [DEBUG] [LOCAL ] WLY: Trimmed 42822 records to 29858 (keeping 200 days of data) [2025-10-02T22:24:35.121047] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-02T22:24:35.327257] [DEBUG] [LOCAL ] WLY: Primary data saved (29858 records). [2025-10-02T22:24:35.327400] [INFO ] [MAIN ] WLY: Full history saved. [2025-10-02T22:24:35.327489] [INFO ] [MAIN ] Update Progress: 2304/2370 symbols completed. WLY took 29.1s. Estimated remaining: 9m 18s. Rate: 7.1 symbols/min [2025-10-02T22:24:35.513083] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-04. [2025-10-02T22:24:35.516994] [INFO ] [MAIN ] WMS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:24:35.532293] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-02T22:24:35.575300] [DEBUG] [LOCAL ] WMS: Loaded 39561 existing records from primary storage. [2025-10-02T22:24:35.575634] [INFO ] [MAIN ] WMS: Loaded 39561 existing records. [2025-10-02T22:24:35.769892] [WARN ] [MAIN ] WMS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:24:35.770125] [INFO ] [MAIN ] WMS: Wiping existing primary data before full refresh. [2025-10-02T22:24:35.770173] [INFO ] [LOCAL ] WMS: Starting deletion of primary data. [2025-10-02T22:24:35.770457] [DEBUG] [LOCAL ] WMS: Deleted primary data file. [2025-10-02T22:24:35.770523] [INFO ] [MAIN ] WMS: Starting full primary refresh. [2025-10-02T22:24:36.151812] [INFO ] [REMOTE ] WMS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:24:36.273090] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-08. [2025-10-02T22:24:37.072998] [INFO ] [REMOTE ] WMS: Fetching primary data for 2024-12. [2025-10-02T22:24:37.151180] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-02T22:24:37.873042] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-06. [2025-10-02T22:24:38.235340] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-02T22:24:38.316308] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-02T22:24:38.672982] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-09. [2025-10-02T22:24:38.713714] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-02T22:24:39.473043] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-01. [2025-10-02T22:24:40.272962] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-07. [2025-10-02T22:24:40.562355] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-02T22:24:40.921448] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-02T22:24:40.985213] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-02T22:24:41.072994] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-02. [2025-10-02T22:24:41.873009] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-10. [2025-10-02T22:24:42.373011] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-02T22:24:42.673028] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-08. [2025-10-02T22:24:43.244455] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-02T22:24:43.246742] [INFO ] [REMOTE ] WM: Full fetch complete (73786 records). [2025-10-02T22:24:43.246870] [DEBUG] [VALIDATOR ] WM: Validating primary data. [2025-10-02T22:24:43.478624] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-03. [2025-10-02T22:24:43.626239] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-02T22:24:43.716765] [DEBUG] [VALIDATOR ] WM: All expected trading days are present. [2025-10-02T22:24:43.716853] [DEBUG] [VALIDATOR ] WM: Primary data validation passed. [2025-10-02T22:24:43.718052] [INFO ] [MAIN ] WM: Fetched primary data is valid. [2025-10-02T22:24:43.718119] [DEBUG] [LOCAL ] WM: Saving primary data. [2025-10-02T22:24:43.719607] [DEBUG] [LOCAL ] WM: Trimmed 73786 records to 51286 (keeping 200 days of data) [2025-10-02T22:24:44.082424] [DEBUG] [LOCAL ] WM: Primary data saved (51286 records). [2025-10-02T22:24:44.082564] [INFO ] [MAIN ] WM: Full history saved. [2025-10-02T22:24:44.082668] [INFO ] [MAIN ] Update Progress: 2305/2370 symbols completed. WM took 36.2s. Estimated remaining: 9m 9s. Rate: 7.1 symbols/min [2025-10-02T22:24:44.269006] [INFO ] [MAIN ] WMT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:24:44.272991] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-09. [2025-10-02T22:24:44.322159] [DEBUG] [LOCAL ] WMT: Loaded 53800 existing records from primary storage. [2025-10-02T22:24:44.322500] [INFO ] [MAIN ] WMT: Loaded 53800 existing records. [2025-10-02T22:24:44.529505] [WARN ] [MAIN ] WMT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:24:44.529771] [INFO ] [MAIN ] WMT: Wiping existing primary data before full refresh. [2025-10-02T22:24:44.529853] [INFO ] [LOCAL ] WMT: Starting deletion of primary data. [2025-10-02T22:24:44.530236] [DEBUG] [LOCAL ] WMT: Deleted primary data file. [2025-10-02T22:24:44.530318] [INFO ] [MAIN ] WMT: Starting full primary refresh. [2025-10-02T22:24:44.938938] [INFO ] [REMOTE ] WMT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:24:45.016475] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-02T22:24:45.073064] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-04. [2025-10-02T22:24:45.349584] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-02T22:24:45.873024] [INFO ] [REMOTE ] WMT: Fetching primary data for 2024-12. [2025-10-02T22:24:46.416196] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-02T22:24:46.672988] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-10. [2025-10-02T22:24:47.397531] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-02T22:24:47.398976] [INFO ] [REMOTE ] WMK: Full fetch complete (19627 records). [2025-10-02T22:24:47.399213] [DEBUG] [VALIDATOR ] WMK: Validating primary data. [2025-10-02T22:24:47.485565] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-05. [2025-10-02T22:24:47.827843] [DEBUG] [VALIDATOR ] WMK: All expected trading days are present. [2025-10-02T22:24:47.827963] [DEBUG] [VALIDATOR ] WMK: Primary data validation passed. [2025-10-02T22:24:47.828431] [INFO ] [MAIN ] WMK: Fetched primary data is valid. [2025-10-02T22:24:47.828482] [DEBUG] [LOCAL ] WMK: Saving primary data. [2025-10-02T22:24:47.829162] [DEBUG] [LOCAL ] WMK: Trimmed 19627 records to 14606 (keeping 200 days of data) [2025-10-02T22:24:47.924345] [DEBUG] [LOCAL ] WMK: Primary data saved (14606 records). [2025-10-02T22:24:47.924490] [INFO ] [MAIN ] WMK: Full history saved. [2025-10-02T22:24:47.924585] [INFO ] [MAIN ] Update Progress: 2306/2370 symbols completed. WMK took 33.0s. Estimated remaining: 9m 1s. Rate: 7.1 symbols/min [2025-10-02T22:24:48.108271] [INFO ] [MAIN ] WNC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:24:48.150880] [DEBUG] [LOCAL ] WNC: Loaded 39363 existing records from primary storage. [2025-10-02T22:24:48.151245] [INFO ] [MAIN ] WNC: Loaded 39363 existing records. [2025-10-02T22:24:48.278086] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-05. [2025-10-02T22:24:48.356454] [WARN ] [MAIN ] WNC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:24:48.357556] [INFO ] [MAIN ] WNC: Wiping existing primary data before full refresh. [2025-10-02T22:24:48.357609] [INFO ] [LOCAL ] WNC: Starting deletion of primary data. [2025-10-02T22:24:48.357949] [DEBUG] [LOCAL ] WNC: Deleted primary data file. [2025-10-02T22:24:48.358008] [INFO ] [MAIN ] WNC: Starting full primary refresh. [2025-10-02T22:24:48.800931] [INFO ] [REMOTE ] WNC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:24:48.824670] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2024-12 (2.95 seconds). [2025-10-02T22:24:49.053741] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-02T22:24:49.073008] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-06. [2025-10-02T22:24:49.872999] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-01. [2025-10-02T22:24:50.104630] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-02T22:24:50.238447] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-02T22:24:50.672992] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-06. [2025-10-02T22:24:51.473017] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-07. [2025-10-02T22:24:52.275826] [INFO ] [REMOTE ] WNC: Fetching primary data for 2024-12. [2025-10-02T22:24:52.289390] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-10-02T22:24:52.511824] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-02T22:24:52.965073] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-02T22:24:53.072997] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-08. [2025-10-02T22:24:53.372189] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-02T22:24:53.872994] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-01. [2025-10-02T22:24:54.669522] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-02T22:24:54.678158] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-07. [2025-10-02T22:24:55.369690] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-02T22:24:55.473032] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-02. [2025-10-02T22:24:56.273045] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-02. [2025-10-02T22:24:56.659348] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-02T22:24:56.726629] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-02T22:24:57.073066] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-08. [2025-10-02T22:24:57.873013] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-09. [2025-10-02T22:24:58.672978] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-03. [2025-10-02T22:24:58.866486] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-02 (2.59 seconds). [2025-10-02T22:24:58.961310] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-02T22:24:59.472971] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-03. [2025-10-02T22:24:59.506609] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-02T22:25:00.273000] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-10. [2025-10-02T22:25:00.420811] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-02T22:25:01.073001] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-09. [2025-10-02T22:25:01.524801] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-02T22:25:01.526544] [INFO ] [REMOTE ] WMS: Full fetch complete (57255 records). [2025-10-02T22:25:01.526710] [DEBUG] [VALIDATOR ] WMS: Validating primary data. [2025-10-02T22:25:01.876623] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-04. [2025-10-02T22:25:01.996615] [DEBUG] [VALIDATOR ] WMS: All expected trading days are present. [2025-10-02T22:25:01.996790] [DEBUG] [VALIDATOR ] WMS: Primary data validation passed. [2025-10-02T22:25:01.998124] [INFO ] [MAIN ] WMS: Fetched primary data is valid. [2025-10-02T22:25:01.998336] [DEBUG] [LOCAL ] WMS: Saving primary data. [2025-10-02T22:25:02.000802] [DEBUG] [LOCAL ] WMS: Trimmed 57255 records to 39844 (keeping 200 days of data) [2025-10-02T22:25:02.131638] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-03 (2.66 seconds). [2025-10-02T22:25:02.315978] [DEBUG] [LOCAL ] WMS: Primary data saved (39844 records). [2025-10-02T22:25:02.316136] [INFO ] [MAIN ] WMS: Full history saved. [2025-10-02T22:25:02.316249] [INFO ] [MAIN ] Update Progress: 2307/2370 symbols completed. WMS took 27.0s. Estimated remaining: 8m 52s. Rate: 7.1 symbols/min [2025-10-02T22:25:02.510474] [INFO ] [MAIN ] WNS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:25:02.553524] [DEBUG] [LOCAL ] WNS: Loaded 39903 existing records from primary storage. [2025-10-02T22:25:02.553875] [INFO ] [MAIN ] WNS: Loaded 39903 existing records. [2025-10-02T22:25:02.676023] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-04. [2025-10-02T22:25:02.778196] [WARN ] [MAIN ] WNS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:25:02.798845] [INFO ] [MAIN ] WNS: Wiping existing primary data before full refresh. [2025-10-02T22:25:02.799164] [INFO ] [LOCAL ] WNS: Starting deletion of primary data. [2025-10-02T22:25:02.799597] [DEBUG] [LOCAL ] WNS: Deleted primary data file. [2025-10-02T22:25:02.799721] [INFO ] [MAIN ] WNS: Starting full primary refresh. [2025-10-02T22:25:02.807215] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-02T22:25:03.213263] [INFO ] [REMOTE ] WNS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:25:03.473018] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-10. [2025-10-02T22:25:03.704373] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-02T22:25:04.273006] [INFO ] [REMOTE ] WNS: Fetching primary data for 2024-12. [2025-10-02T22:25:04.765045] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-02T22:25:04.768913] [INFO ] [REMOTE ] WMB: Full fetch complete (77690 records). [2025-10-02T22:25:04.769107] [DEBUG] [VALIDATOR ] WMB: Validating primary data. [2025-10-02T22:25:05.075837] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-05. [2025-10-02T22:25:05.247398] [DEBUG] [VALIDATOR ] WMB: All expected trading days are present. [2025-10-02T22:25:05.247573] [DEBUG] [VALIDATOR ] WMB: Primary data validation passed. [2025-10-02T22:25:05.249014] [INFO ] [MAIN ] WMB: Fetched primary data is valid. [2025-10-02T22:25:05.249253] [DEBUG] [LOCAL ] WMB: Saving primary data. [2025-10-02T22:25:05.252749] [DEBUG] [LOCAL ] WMB: Trimmed 77690 records to 54061 (keeping 200 days of data) [2025-10-02T22:25:05.392829] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-04 (2.72 seconds). [2025-10-02T22:25:05.673129] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-02T22:25:05.706687] [DEBUG] [LOCAL ] WMB: Primary data saved (54061 records). [2025-10-02T22:25:05.706889] [INFO ] [MAIN ] WMB: Full history saved. [2025-10-02T22:25:05.707037] [INFO ] [MAIN ] Update Progress: 2308/2370 symbols completed. WMB took 52.2s. Estimated remaining: 8m 44s. Rate: 7.1 symbols/min [2025-10-02T22:25:05.878175] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-05. [2025-10-02T22:25:05.910309] [INFO ] [MAIN ] WOLF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:25:05.972292] [DEBUG] [LOCAL ] WOLF: Loaded 53184 existing records from primary storage. [2025-10-02T22:25:05.972722] [INFO ] [MAIN ] WOLF: Loaded 53184 existing records. [2025-10-02T22:25:06.174542] [WARN ] [MAIN ] WOLF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:25:06.174852] [INFO ] [MAIN ] WOLF: Wiping existing primary data before full refresh. [2025-10-02T22:25:06.174914] [INFO ] [LOCAL ] WOLF: Starting deletion of primary data. [2025-10-02T22:25:06.175158] [DEBUG] [LOCAL ] WOLF: Deleted primary data file. [2025-10-02T22:25:06.175231] [INFO ] [MAIN ] WOLF: Starting full primary refresh. [2025-10-02T22:25:06.592953] [INFO ] [REMOTE ] WOLF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:25:06.672960] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-01. [2025-10-02T22:25:06.741462] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-02T22:25:07.473034] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-06. [2025-10-02T22:25:08.194380] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-02T22:25:08.273016] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2024-12. [2025-10-02T22:25:08.666450] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-05 (2.79 seconds). [2025-10-02T22:25:08.839268] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-02T22:25:09.073015] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-06. [2025-10-02T22:25:09.873004] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-07. [2025-10-02T22:25:10.529952] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-10-02T22:25:10.673004] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-01. [2025-10-02T22:25:11.439808] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-02T22:25:11.472970] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-08. [2025-10-02T22:25:11.546931] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-06 (2.47 seconds). [2025-10-02T22:25:12.273016] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-07. [2025-10-02T22:25:12.732534] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-02T22:25:12.966932] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-02T22:25:13.073008] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-09. [2025-10-02T22:25:13.873010] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-02. [2025-10-02T22:25:14.403773] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-02T22:25:14.672980] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-10. [2025-10-02T22:25:14.985682] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-07 (2.71 seconds). [2025-10-02T22:25:15.159930] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-02T22:25:15.473038] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-03. [2025-10-02T22:25:15.814270] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-02T22:25:15.816217] [INFO ] [REMOTE ] WNC: Full fetch complete (57582 records). [2025-10-02T22:25:15.816337] [DEBUG] [VALIDATOR ] WNC: Validating primary data. [2025-10-02T22:25:16.226197] [DEBUG] [VALIDATOR ] WNC: All expected trading days are present. [2025-10-02T22:25:16.226313] [DEBUG] [VALIDATOR ] WNC: Primary data validation passed. [2025-10-02T22:25:16.227701] [INFO ] [MAIN ] WNC: Fetched primary data is valid. [2025-10-02T22:25:16.227769] [DEBUG] [LOCAL ] WNC: Saving primary data. [2025-10-02T22:25:16.229246] [DEBUG] [LOCAL ] WNC: Trimmed 57582 records to 39582 (keeping 200 days of data) [2025-10-02T22:25:16.290265] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-08. [2025-10-02T22:25:16.498564] [DEBUG] [LOCAL ] WNC: Primary data saved (39582 records). [2025-10-02T22:25:16.498752] [INFO ] [MAIN ] WNC: Full history saved. [2025-10-02T22:25:16.501258] [INFO ] [MAIN ] Update Progress: 2309/2370 symbols completed. WNC took 28.6s. Estimated remaining: 8m 35s. Rate: 7.1 symbols/min [2025-10-02T22:25:16.711697] [INFO ] [MAIN ] WOR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:25:16.737605] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-02T22:25:16.767322] [DEBUG] [LOCAL ] WOR: Loaded 24902 existing records from primary storage. [2025-10-02T22:25:16.767671] [INFO ] [MAIN ] WOR: Loaded 24902 existing records. [2025-10-02T22:25:16.977848] [WARN ] [MAIN ] WOR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:25:16.978114] [INFO ] [MAIN ] WOR: Wiping existing primary data before full refresh. [2025-10-02T22:25:16.978167] [INFO ] [LOCAL ] WOR: Starting deletion of primary data. [2025-10-02T22:25:16.978429] [DEBUG] [LOCAL ] WOR: Deleted primary data file. [2025-10-02T22:25:16.978489] [INFO ] [MAIN ] WOR: Starting full primary refresh. [2025-10-02T22:25:17.081047] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-02. [2025-10-02T22:25:17.379284] [INFO ] [REMOTE ] WOR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:25:17.873073] [INFO ] [REMOTE ] WOR: Fetching primary data for 2024-12. [2025-10-02T22:25:18.673085] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-04. [2025-10-02T22:25:18.876372] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-08 (2.59 seconds). [2025-10-02T22:25:18.905093] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-02T22:25:18.956785] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-02T22:25:19.473087] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-03. [2025-10-02T22:25:19.959032] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-02T22:25:20.273016] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-01. [2025-10-02T22:25:21.073055] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-05. [2025-10-02T22:25:21.448701] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-02T22:25:21.878796] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-02. [2025-10-02T22:25:21.904848] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-03 (2.43 seconds). [2025-10-02T22:25:22.357046] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-02T22:25:22.672999] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-04. [2025-10-02T22:25:23.093139] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-02T22:25:23.473003] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-06. [2025-10-02T22:25:24.273006] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-03. [2025-10-02T22:25:24.520560] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-02T22:25:25.057847] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-10-02T22:25:25.072941] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-05. [2025-10-02T22:25:25.756058] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-02T22:25:25.873049] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-04. [2025-10-02T22:25:26.673074] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-09. [2025-10-02T22:25:27.129973] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-02T22:25:27.473012] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-07. [2025-10-02T22:25:27.582233] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-10-02T22:25:28.273044] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-05. [2025-10-02T22:25:28.696379] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-02T22:25:28.859090] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-02T22:25:29.073019] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-10. [2025-10-02T22:25:29.347289] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-02T22:25:29.873027] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-06. [2025-10-02T22:25:30.673009] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-08. [2025-10-02T22:25:31.141982] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-02T22:25:31.144103] [INFO ] [REMOTE ] WMT: Full fetch complete (77968 records). [2025-10-02T22:25:31.144254] [DEBUG] [VALIDATOR ] WMT: Validating primary data. [2025-10-02T22:25:31.478275] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-06. [2025-10-02T22:25:31.622587] [DEBUG] [VALIDATOR ] WMT: All expected trading days are present. [2025-10-02T22:25:31.622762] [DEBUG] [VALIDATOR ] WMT: Primary data validation passed. [2025-10-02T22:25:31.624361] [INFO ] [MAIN ] WMT: Fetched primary data is valid. [2025-10-02T22:25:31.624440] [DEBUG] [LOCAL ] WMT: Saving primary data. [2025-10-02T22:25:31.628227] [DEBUG] [LOCAL ] WMT: Trimmed 77968 records to 54190 (keeping 200 days of data) [2025-10-02T22:25:31.927094] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-02T22:25:32.046266] [DEBUG] [LOCAL ] WMT: Primary data saved (54190 records). [2025-10-02T22:25:32.046423] [INFO ] [MAIN ] WMT: Full history saved. [2025-10-02T22:25:32.046602] [INFO ] [MAIN ] Update Progress: 2310/2370 symbols completed. WMT took 48.0s. Estimated remaining: 8m 27s. Rate: 7.1 symbols/min [2025-10-02T22:25:32.236377] [INFO ] [MAIN ] WOW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:25:32.268472] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-10-02T22:25:32.278719] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-09. [2025-10-02T22:25:32.306710] [DEBUG] [LOCAL ] WOW: Loaded 30384 existing records from primary storage. [2025-10-02T22:25:32.307005] [INFO ] [MAIN ] WOW: Loaded 30384 existing records. [2025-10-02T22:25:32.504670] [WARN ] [MAIN ] WOW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:25:32.504887] [INFO ] [MAIN ] WOW: Wiping existing primary data before full refresh. [2025-10-02T22:25:32.504937] [INFO ] [LOCAL ] WOW: Starting deletion of primary data. [2025-10-02T22:25:32.505191] [DEBUG] [LOCAL ] WOW: Deleted primary data file. [2025-10-02T22:25:32.505251] [INFO ] [MAIN ] WOW: Starting full primary refresh. [2025-10-02T22:25:32.832700] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-02T22:25:32.922539] [INFO ] [REMOTE ] WOW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:25:33.073004] [INFO ] [REMOTE ] WOW: Fetching primary data for 2024-12. [2025-10-02T22:25:33.783984] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-02T22:25:33.873006] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-07. [2025-10-02T22:25:34.270011] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-02T22:25:34.673034] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-07. [2025-10-02T22:25:35.473043] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-10. [2025-10-02T22:25:35.907828] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-02T22:25:36.272989] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-08. [2025-10-02T22:25:36.562683] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-02T22:25:36.564731] [INFO ] [REMOTE ] WNS: Full fetch complete (55032 records). [2025-10-02T22:25:36.564881] [DEBUG] [VALIDATOR ] WNS: Validating primary data. [2025-10-02T22:25:36.790891] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-07 (2.92 seconds). [2025-10-02T22:25:37.058071] [DEBUG] [VALIDATOR ] WNS: All expected trading days are present. [2025-10-02T22:25:37.058162] [DEBUG] [VALIDATOR ] WNS: Primary data validation passed. [2025-10-02T22:25:37.059358] [INFO ] [MAIN ] WNS: Fetched primary data is valid. [2025-10-02T22:25:37.059434] [DEBUG] [LOCAL ] WNS: Saving primary data. [2025-10-02T22:25:37.060872] [DEBUG] [LOCAL ] WNS: Trimmed 55032 records to 40206 (keeping 200 days of data) [2025-10-02T22:25:37.112057] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-08. [2025-10-02T22:25:37.288211] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-02T22:25:37.334960] [DEBUG] [LOCAL ] WNS: Primary data saved (40206 records). [2025-10-02T22:25:37.335090] [INFO ] [MAIN ] WNS: Full history saved. [2025-10-02T22:25:37.335171] [INFO ] [MAIN ] Update Progress: 2311/2370 symbols completed. WNS took 35.0s. Estimated remaining: 8m 19s. Rate: 7.1 symbols/min [2025-10-02T22:25:37.520404] [INFO ] [MAIN ] WPC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:25:37.566317] [DEBUG] [LOCAL ] WPC: Loaded 48374 existing records from primary storage. [2025-10-02T22:25:37.566678] [INFO ] [MAIN ] WPC: Loaded 48374 existing records. [2025-10-02T22:25:37.761275] [WARN ] [MAIN ] WPC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:25:37.761582] [INFO ] [MAIN ] WPC: Wiping existing primary data before full refresh. [2025-10-02T22:25:37.761678] [INFO ] [LOCAL ] WPC: Starting deletion of primary data. [2025-10-02T22:25:37.762049] [DEBUG] [LOCAL ] WPC: Deleted primary data file. [2025-10-02T22:25:37.762126] [INFO ] [MAIN ] WPC: Starting full primary refresh. [2025-10-02T22:25:37.874542] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-09. [2025-10-02T22:25:38.155993] [INFO ] [REMOTE ] WPC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:25:38.673012] [INFO ] [REMOTE ] WPC: Fetching primary data for 2024-12. [2025-10-02T22:25:39.079117] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-02T22:25:39.121552] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-02T22:25:39.473020] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-10. [2025-10-02T22:25:40.046336] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-02T22:25:40.163636] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-02T22:25:40.165163] [INFO ] [REMOTE ] WOR: Full fetch complete (36632 records). [2025-10-02T22:25:40.165265] [DEBUG] [VALIDATOR ] WOR: Validating primary data. [2025-10-02T22:25:40.274806] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-09. [2025-10-02T22:25:40.569257] [DEBUG] [VALIDATOR ] WOR: All expected trading days are present. [2025-10-02T22:25:40.569340] [DEBUG] [VALIDATOR ] WOR: Primary data validation passed. [2025-10-02T22:25:40.570155] [INFO ] [MAIN ] WOR: Fetched primary data is valid. [2025-10-02T22:25:40.570220] [DEBUG] [LOCAL ] WOR: Saving primary data. [2025-10-02T22:25:40.571202] [DEBUG] [LOCAL ] WOR: Trimmed 36632 records to 25101 (keeping 200 days of data) [2025-10-02T22:25:40.739316] [DEBUG] [LOCAL ] WOR: Primary data saved (25101 records). [2025-10-02T22:25:40.739515] [INFO ] [MAIN ] WOR: Full history saved. [2025-10-02T22:25:40.739662] [INFO ] [MAIN ] Update Progress: 2312/2370 symbols completed. WOR took 24.2s. Estimated remaining: 8m 10s. Rate: 7.1 symbols/min [2025-10-02T22:25:40.921086] [INFO ] [MAIN ] WPM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:25:40.975069] [DEBUG] [LOCAL ] WPM: Loaded 52726 existing records from primary storage. [2025-10-02T22:25:40.975408] [INFO ] [MAIN ] WPM: Loaded 52726 existing records. [2025-10-02T22:25:41.078126] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-01. [2025-10-02T22:25:41.175002] [WARN ] [MAIN ] WPM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:25:41.175238] [INFO ] [MAIN ] WPM: Wiping existing primary data before full refresh. [2025-10-02T22:25:41.175294] [INFO ] [LOCAL ] WPM: Starting deletion of primary data. [2025-10-02T22:25:41.175590] [DEBUG] [LOCAL ] WPM: Deleted primary data file. [2025-10-02T22:25:41.175693] [INFO ] [MAIN ] WPM: Starting full primary refresh. [2025-10-02T22:25:41.574939] [INFO ] [REMOTE ] WPM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:25:41.872996] [INFO ] [REMOTE ] WPM: Fetching primary data for 2024-12. [2025-10-02T22:25:42.194479] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-02T22:25:42.678107] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-01. [2025-10-02T22:25:42.698046] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-10-02T22:25:43.406848] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-02T22:25:43.472994] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-02. [2025-10-02T22:25:44.139254] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-02T22:25:44.176965] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-02T22:25:44.273004] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-03. [2025-10-02T22:25:45.072982] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-10. [2025-10-02T22:25:45.500602] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-02T22:25:45.872994] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-01. [2025-10-02T22:25:46.673010] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-04. [2025-10-02T22:25:47.176845] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-02T22:25:47.179491] [INFO ] [REMOTE ] WOLF: Full fetch complete (77250 records). [2025-10-02T22:25:47.179674] [DEBUG] [VALIDATOR ] WOLF: Validating primary data. [2025-10-02T22:25:47.479509] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-02. [2025-10-02T22:25:47.637386] [DEBUG] [VALIDATOR ] WOLF: All expected trading days are present. [2025-10-02T22:25:47.637635] [DEBUG] [VALIDATOR ] WOLF: Primary data validation passed. [2025-10-02T22:25:47.639074] [INFO ] [MAIN ] WOLF: Fetched primary data is valid. [2025-10-02T22:25:47.639199] [DEBUG] [LOCAL ] WOLF: Saving primary data. [2025-10-02T22:25:47.670819] [DEBUG] [LOCAL ] WOLF: Trimmed 77250 records to 53572 (keeping 200 days of data) [2025-10-02T22:25:47.673355] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-02T22:25:47.925552] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-02T22:25:48.060921] [DEBUG] [LOCAL ] WOLF: Primary data saved (53572 records). [2025-10-02T22:25:48.061072] [INFO ] [MAIN ] WOLF: Full history saved. [2025-10-02T22:25:48.061157] [INFO ] [MAIN ] Update Progress: 2313/2370 symbols completed. WOLF took 42.4s. Estimated remaining: 8m 2s. Rate: 7.1 symbols/min [2025-10-02T22:25:48.255576] [INFO ] [MAIN ] WPP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:25:48.275926] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-02. [2025-10-02T22:25:48.291732] [DEBUG] [LOCAL ] WPP: Loaded 33916 existing records from primary storage. [2025-10-02T22:25:48.292031] [INFO ] [MAIN ] WPP: Loaded 33916 existing records. [2025-10-02T22:25:48.486305] [WARN ] [MAIN ] WPP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:25:48.486540] [INFO ] [MAIN ] WPP: Wiping existing primary data before full refresh. [2025-10-02T22:25:48.486596] [INFO ] [LOCAL ] WPP: Starting deletion of primary data. [2025-10-02T22:25:48.487197] [DEBUG] [LOCAL ] WPP: Deleted primary data file. [2025-10-02T22:25:48.487257] [INFO ] [MAIN ] WPP: Starting full primary refresh. [2025-10-02T22:25:48.902257] [INFO ] [REMOTE ] WPP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:25:49.072983] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-05. [2025-10-02T22:25:49.226808] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-02T22:25:49.773939] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-02T22:25:49.873003] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-03. [2025-10-02T22:25:50.125703] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-02T22:25:50.673032] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-03. [2025-10-02T22:25:51.473079] [INFO ] [REMOTE ] WPP: Fetching primary data for 2024-12. [2025-10-02T22:25:51.775853] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-02T22:25:52.015752] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-02T22:25:52.273002] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-04. [2025-10-02T22:25:52.520539] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-02T22:25:53.073009] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-06. [2025-10-02T22:25:53.872989] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-04. [2025-10-02T22:25:54.115961] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-02T22:25:54.162280] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-02T22:25:54.673002] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-07. [2025-10-02T22:25:55.472964] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-01. [2025-10-02T22:25:55.899481] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-02T22:25:55.907381] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-02T22:25:56.272998] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-08. [2025-10-02T22:25:56.793407] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-02T22:25:57.072999] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-02. [2025-10-02T22:25:57.827490] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-02T22:25:57.872996] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-09. [2025-10-02T22:25:58.159892] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-02T22:25:58.672998] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-05. [2025-10-02T22:25:59.288937] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-02T22:25:59.473059] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-05. [2025-10-02T22:26:00.273105] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-10. [2025-10-02T22:26:00.598461] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-02T22:26:01.073038] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-06. [2025-10-02T22:26:01.261970] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-02T22:26:01.541308] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-02T22:26:01.544566] [INFO ] [REMOTE ] WOW: Full fetch complete (42334 records). [2025-10-02T22:26:01.544766] [DEBUG] [VALIDATOR ] WOW: Validating primary data. [2025-10-02T22:26:01.878176] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-06. [2025-10-02T22:26:01.990896] [DEBUG] [VALIDATOR ] WOW: All expected trading days are present. [2025-10-02T22:26:01.990997] [DEBUG] [VALIDATOR ] WOW: Primary data validation passed. [2025-10-02T22:26:01.992091] [INFO ] [MAIN ] WOW: Fetched primary data is valid. [2025-10-02T22:26:01.992162] [DEBUG] [LOCAL ] WOW: Saving primary data. [2025-10-02T22:26:01.993402] [DEBUG] [LOCAL ] WOW: Trimmed 42334 records to 30711 (keeping 200 days of data) [2025-10-02T22:26:02.197212] [DEBUG] [LOCAL ] WOW: Primary data saved (30711 records). [2025-10-02T22:26:02.197361] [INFO ] [MAIN ] WOW: Full history saved. [2025-10-02T22:26:02.197527] [INFO ] [MAIN ] Update Progress: 2314/2370 symbols completed. WOW took 30.2s. Estimated remaining: 7m 53s. Rate: 7.1 symbols/min [2025-10-02T22:26:02.382783] [INFO ] [MAIN ] WRB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:26:02.435146] [DEBUG] [LOCAL ] WRB: Loaded 50568 existing records from primary storage. [2025-10-02T22:26:02.435498] [INFO ] [MAIN ] WRB: Loaded 50568 existing records. [2025-10-02T22:26:02.632628] [WARN ] [MAIN ] WRB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:26:02.632973] [INFO ] [MAIN ] WRB: Wiping existing primary data before full refresh. [2025-10-02T22:26:02.633033] [INFO ] [LOCAL ] WRB: Starting deletion of primary data. [2025-10-02T22:26:02.633284] [DEBUG] [LOCAL ] WRB: Deleted primary data file. [2025-10-02T22:26:02.633343] [INFO ] [MAIN ] WRB: Starting full primary refresh. [2025-10-02T22:26:02.689854] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-03. [2025-10-02T22:26:03.037528] [INFO ] [REMOTE ] WRB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:26:03.072534] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-02T22:26:03.472980] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-07. [2025-10-02T22:26:03.620717] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-02T22:26:04.255046] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-02T22:26:04.272984] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-04. [2025-10-02T22:26:05.073018] [INFO ] [REMOTE ] WRB: Fetching primary data for 2024-12. [2025-10-02T22:26:05.517172] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-02T22:26:05.831898] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-02T22:26:05.873003] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-05. [2025-10-02T22:26:06.673005] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-08. [2025-10-02T22:26:06.762457] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-02T22:26:07.265706] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-02T22:26:07.473031] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-07. [2025-10-02T22:26:08.272971] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-06. [2025-10-02T22:26:08.307191] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-02T22:26:09.072972] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-09. [2025-10-02T22:26:09.184223] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-02T22:26:09.686788] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-02T22:26:09.873072] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-08. [2025-10-02T22:26:10.672998] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-01. [2025-10-02T22:26:11.155554] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-02T22:26:11.472983] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-07. [2025-10-02T22:26:11.589258] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-02T22:26:12.073944] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-02T22:26:12.272971] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-02. [2025-10-02T22:26:13.069384] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-02T22:26:13.077491] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-10. [2025-10-02T22:26:13.872991] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-09. [2025-10-02T22:26:14.013329] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-02T22:26:14.342024] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-02T22:26:14.344845] [INFO ] [REMOTE ] WPM: Full fetch complete (75920 records). [2025-10-02T22:26:14.344985] [DEBUG] [VALIDATOR ] WPM: Validating primary data. [2025-10-02T22:26:14.678158] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-03. [2025-10-02T22:26:14.778263] [DEBUG] [VALIDATOR ] WPM: All expected trading days are present. [2025-10-02T22:26:14.778363] [DEBUG] [VALIDATOR ] WPM: Primary data validation passed. [2025-10-02T22:26:14.779615] [INFO ] [MAIN ] WPM: Fetched primary data is valid. [2025-10-02T22:26:14.779724] [DEBUG] [LOCAL ] WPM: Saving primary data. [2025-10-02T22:26:14.781321] [DEBUG] [LOCAL ] WPM: Trimmed 75920 records to 53116 (keeping 200 days of data) [2025-10-02T22:26:15.152866] [DEBUG] [LOCAL ] WPM: Primary data saved (53116 records). [2025-10-02T22:26:15.153021] [INFO ] [MAIN ] WPM: Full history saved. [2025-10-02T22:26:15.153875] [INFO ] [MAIN ] Update Progress: 2315/2370 symbols completed. WPM took 34.4s. Estimated remaining: 7m 45s. Rate: 7.1 symbols/min [2025-10-02T22:26:15.343563] [INFO ] [MAIN ] WRBY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:26:15.401537] [DEBUG] [LOCAL ] WRBY: Loaded 50766 existing records from primary storage. [2025-10-02T22:26:15.402073] [INFO ] [MAIN ] WRBY: Loaded 50766 existing records. [2025-10-02T22:26:15.477046] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-08. [2025-10-02T22:26:15.610530] [WARN ] [MAIN ] WRBY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:26:15.610907] [INFO ] [MAIN ] WRBY: Wiping existing primary data before full refresh. [2025-10-02T22:26:15.611014] [INFO ] [LOCAL ] WRBY: Starting deletion of primary data. [2025-10-02T22:26:15.611371] [DEBUG] [LOCAL ] WRBY: Deleted primary data file. [2025-10-02T22:26:15.611452] [INFO ] [MAIN ] WRBY: Starting full primary refresh. [2025-10-02T22:26:15.756419] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-02T22:26:16.047179] [INFO ] [REMOTE ] WRBY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:26:16.272979] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-10. [2025-10-02T22:26:16.528852] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-02T22:26:16.694324] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-02T22:26:17.073008] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-04. [2025-10-02T22:26:17.208789] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-02T22:26:17.210949] [INFO ] [REMOTE ] WPC: Full fetch complete (70729 records). [2025-10-02T22:26:17.211098] [DEBUG] [VALIDATOR ] WPC: Validating primary data. [2025-10-02T22:26:17.652968] [DEBUG] [VALIDATOR ] WPC: All expected trading days are present. [2025-10-02T22:26:17.653070] [DEBUG] [VALIDATOR ] WPC: Primary data validation passed. [2025-10-02T22:26:17.654394] [INFO ] [MAIN ] WPC: Fetched primary data is valid. [2025-10-02T22:26:17.654464] [DEBUG] [LOCAL ] WPC: Saving primary data. [2025-10-02T22:26:17.655985] [DEBUG] [LOCAL ] WPC: Trimmed 70729 records to 48701 (keeping 200 days of data) [2025-10-02T22:26:17.880274] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2024-12. [2025-10-02T22:26:17.977928] [DEBUG] [LOCAL ] WPC: Primary data saved (48701 records). [2025-10-02T22:26:17.978123] [INFO ] [MAIN ] WPC: Full history saved. [2025-10-02T22:26:17.978211] [INFO ] [MAIN ] Update Progress: 2316/2370 symbols completed. WPC took 40.6s. Estimated remaining: 7m 36s. Rate: 7.1 symbols/min [2025-10-02T22:26:18.163265] [INFO ] [MAIN ] WS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:26:18.186905] [DEBUG] [LOCAL ] WS: Loaded 24026 existing records from primary storage. [2025-10-02T22:26:18.187193] [INFO ] [MAIN ] WS: Loaded 24026 existing records. [2025-10-02T22:26:18.376931] [WARN ] [MAIN ] WS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:26:18.377139] [INFO ] [MAIN ] WS: Wiping existing primary data before full refresh. [2025-10-02T22:26:18.377189] [INFO ] [LOCAL ] WS: Starting deletion of primary data. [2025-10-02T22:26:18.377468] [DEBUG] [LOCAL ] WS: Deleted primary data file. [2025-10-02T22:26:18.377545] [INFO ] [MAIN ] WS: Starting full primary refresh. [2025-10-02T22:26:18.678189] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-09. [2025-10-02T22:26:18.774012] [INFO ] [REMOTE ] WS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:26:18.959269] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-02T22:26:19.473027] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-05. [2025-10-02T22:26:19.565199] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-02T22:26:20.229797] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-02T22:26:20.273011] [INFO ] [REMOTE ] WS: Fetching primary data for 2024-12. [2025-10-02T22:26:20.780770] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-02T22:26:21.073041] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-01. [2025-10-02T22:26:21.498858] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-02T22:26:21.873021] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-01. [2025-10-02T22:26:22.672993] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-06. [2025-10-02T22:26:22.826434] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-02T22:26:22.887678] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-02T22:26:23.473056] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-02. [2025-10-02T22:26:24.015712] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-02T22:26:24.273008] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-10. [2025-10-02T22:26:25.036304] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-02T22:26:25.072986] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-03. [2025-10-02T22:26:25.170899] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-02T22:26:25.173098] [INFO ] [REMOTE ] WPP: Full fetch complete (45662 records). [2025-10-02T22:26:25.173188] [DEBUG] [VALIDATOR ] WPP: Validating primary data. [2025-10-02T22:26:25.616982] [DEBUG] [VALIDATOR ] WPP: All expected trading days are present. [2025-10-02T22:26:25.617097] [DEBUG] [VALIDATOR ] WPP: Primary data validation passed. [2025-10-02T22:26:25.618359] [INFO ] [MAIN ] WPP: Fetched primary data is valid. [2025-10-02T22:26:25.618428] [DEBUG] [LOCAL ] WPP: Saving primary data. [2025-10-02T22:26:25.619579] [DEBUG] [LOCAL ] WPP: Trimmed 45662 records to 34147 (keeping 200 days of data) [2025-10-02T22:26:25.836271] [DEBUG] [LOCAL ] WPP: Primary data saved (34147 records). [2025-10-02T22:26:25.836459] [INFO ] [MAIN ] WPP: Full history saved. [2025-10-02T22:26:25.836594] [INFO ] [MAIN ] Update Progress: 2317/2370 symbols completed. WPP took 37.8s. Estimated remaining: 7m 28s. Rate: 7.1 symbols/min [2025-10-02T22:26:25.873007] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-02. [2025-10-02T22:26:26.673093] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-07. [2025-10-02T22:26:26.829215] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-02T22:26:26.986383] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-02T22:26:27.473007] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-04. [2025-10-02T22:26:28.273033] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-03. [2025-10-02T22:26:28.533674] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-02T22:26:28.867418] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-02T22:26:29.073020] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-05. [2025-10-02T22:26:29.657424] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-02T22:26:29.873076] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-04. [2025-10-02T22:26:30.672980] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-08. [2025-10-02T22:26:30.785578] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-02T22:26:30.954776] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-02T22:26:31.473029] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-05. [2025-10-02T22:26:32.273039] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-06. [2025-10-02T22:26:32.420011] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-02T22:26:32.539593] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-02T22:26:33.073019] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-09. [2025-10-02T22:26:33.872970] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-06. [2025-10-02T22:26:33.917180] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-02T22:26:34.673036] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-07. [2025-10-02T22:26:34.816108] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-02T22:26:35.170822] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-02T22:26:35.473024] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-07. [2025-10-02T22:26:36.137029] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-02T22:26:36.273017] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-08. [2025-10-02T22:26:36.679582] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-02T22:26:37.073004] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-10. [2025-10-02T22:26:37.871488] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-02T22:26:37.882192] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-08. [2025-10-02T22:26:38.356067] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-02T22:26:38.358173] [INFO ] [REMOTE ] WRB: Full fetch complete (73335 records). [2025-10-02T22:26:38.358297] [DEBUG] [VALIDATOR ] WRB: Validating primary data. [2025-10-02T22:26:38.675299] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-09. [2025-10-02T22:26:38.783564] [DEBUG] [VALIDATOR ] WRB: All expected trading days are present. [2025-10-02T22:26:38.783748] [DEBUG] [VALIDATOR ] WRB: Primary data validation passed. [2025-10-02T22:26:38.785232] [INFO ] [MAIN ] WRB: Fetched primary data is valid. [2025-10-02T22:26:38.785335] [DEBUG] [LOCAL ] WRB: Saving primary data. [2025-10-02T22:26:38.787049] [DEBUG] [LOCAL ] WRB: Trimmed 73335 records to 50945 (keeping 200 days of data) [2025-10-02T22:26:38.924925] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-02T22:26:39.149085] [DEBUG] [LOCAL ] WRB: Primary data saved (50945 records). [2025-10-02T22:26:39.149270] [INFO ] [MAIN ] WRB: Full history saved. [2025-10-02T22:26:39.149385] [INFO ] [MAIN ] Update Progress: 2318/2370 symbols completed. WRB took 37.0s. Estimated remaining: 7m 20s. Rate: 7.1 symbols/min [2025-10-02T22:26:39.472989] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-09. [2025-10-02T22:26:40.303689] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-02T22:26:40.315293] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-10. [2025-10-02T22:26:40.607473] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-02T22:26:41.073047] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-10. [2025-10-02T22:26:41.400546] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-02T22:26:41.403726] [INFO ] [REMOTE ] WRBY: Full fetch complete (73473 records). [2025-10-02T22:26:41.403918] [DEBUG] [VALIDATOR ] WRBY: Validating primary data. [2025-10-02T22:26:41.878415] [DEBUG] [VALIDATOR ] WRBY: All expected trading days are present. [2025-10-02T22:26:41.878524] [DEBUG] [VALIDATOR ] WRBY: Primary data validation passed. [2025-10-02T22:26:41.879906] [INFO ] [MAIN ] WRBY: Fetched primary data is valid. [2025-10-02T22:26:41.879989] [DEBUG] [LOCAL ] WRBY: Saving primary data. [2025-10-02T22:26:41.881602] [DEBUG] [LOCAL ] WRBY: Trimmed 73473 records to 51140 (keeping 200 days of data) [2025-10-02T22:26:41.978247] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-02T22:26:41.981931] [INFO ] [REMOTE ] WS: Full fetch complete (36640 records). [2025-10-02T22:26:41.982976] [DEBUG] [VALIDATOR ] WS: Validating primary data. [2025-10-02T22:26:42.491583] [DEBUG] [VALIDATOR ] WS: All expected trading days are present. [2025-10-02T22:26:42.492085] [DEBUG] [VALIDATOR ] WS: Primary data validation passed. [2025-10-02T22:26:42.493268] [INFO ] [MAIN ] WS: Fetched primary data is valid. [2025-10-02T22:26:42.493959] [DEBUG] [LOCAL ] WS: Saving primary data. [2025-10-02T22:26:42.498432] [DEBUG] [LOCAL ] WS: Trimmed 36640 records to 24178 (keeping 200 days of data) [2025-10-02T22:26:42.851503] [DEBUG] [LOCAL ] WS: Primary data saved (24178 records). [2025-10-02T22:26:42.852280] [INFO ] [MAIN ] WS: Full history saved. [2025-10-02T22:26:42.852718] [INFO ] [MAIN ] Update Progress: 2319/2370 symbols completed. WS took 24.9s. Estimated remaining: 7m 11s. Rate: 7.1 symbols/min [2025-10-02T22:26:42.859548] [DEBUG] [LOCAL ] WRBY: Primary data saved (51140 records). [2025-10-02T22:26:42.859629] [INFO ] [MAIN ] WRBY: Full history saved. [2025-10-02T22:26:42.860174] [INFO ] [MAIN ] Update Progress: 2320/2370 symbols completed. WRBY took 27.7s. Estimated remaining: 7m 2s. Rate: 7.1 symbols/min [2025-10-02T22:26:43.675460] [INFO ] [MAIN ] WSM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:26:43.791487] [INFO ] [MAIN ] WSO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:26:43.883251] [INFO ] [MAIN ] WST: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:26:43.894000] [INFO ] [MAIN ] WSR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:26:43.918352] [DEBUG] [LOCAL ] WSO: Loaded 24720 existing records from primary storage. [2025-10-02T22:26:43.918852] [INFO ] [MAIN ] WSO: Loaded 24720 existing records. [2025-10-02T22:26:44.105472] [DEBUG] [LOCAL ] WSR: Loaded 23003 existing records from primary storage. [2025-10-02T22:26:44.123206] [INFO ] [MAIN ] WSR: Loaded 23003 existing records. [2025-10-02T22:26:44.124964] [DEBUG] [LOCAL ] WSM: Loaded 49645 existing records from primary storage. [2025-10-02T22:26:44.147048] [INFO ] [MAIN ] WSM: Loaded 49645 existing records. [2025-10-02T22:26:44.280980] [DEBUG] [LOCAL ] WST: Loaded 37243 existing records from primary storage. [2025-10-02T22:26:44.361933] [WARN ] [MAIN ] WSO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:26:44.362055] [INFO ] [MAIN ] WST: Loaded 37243 existing records. [2025-10-02T22:26:44.392742] [INFO ] [MAIN ] WSO: Wiping existing primary data before full refresh. [2025-10-02T22:26:44.419167] [INFO ] [LOCAL ] WSO: Starting deletion of primary data. [2025-10-02T22:26:44.483145] [DEBUG] [LOCAL ] WSO: Deleted primary data file. [2025-10-02T22:26:44.542981] [INFO ] [MAIN ] WSO: Starting full primary refresh. [2025-10-02T22:26:44.794171] [WARN ] [MAIN ] WSM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:26:44.886166] [INFO ] [MAIN ] WSM: Wiping existing primary data before full refresh. [2025-10-02T22:26:44.897729] [WARN ] [MAIN ] WSR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:26:44.963830] [INFO ] [LOCAL ] WSM: Starting deletion of primary data. [2025-10-02T22:26:45.005630] [WARN ] [MAIN ] WST: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:26:45.006009] [INFO ] [MAIN ] WSR: Wiping existing primary data before full refresh. [2025-10-02T22:26:45.006284] [INFO ] [MAIN ] WST: Wiping existing primary data before full refresh. [2025-10-02T22:26:45.006471] [DEBUG] [LOCAL ] WSM: Deleted primary data file. [2025-10-02T22:26:45.012368] [INFO ] [LOCAL ] WSR: Starting deletion of primary data. [2025-10-02T22:26:45.012300] [INFO ] [LOCAL ] WST: Starting deletion of primary data. [2025-10-02T22:26:45.023141] [DEBUG] [LOCAL ] WSR: Deleted primary data file. [2025-10-02T22:26:45.012247] [INFO ] [MAIN ] WSM: Starting full primary refresh. [2025-10-02T22:26:45.028406] [INFO ] [MAIN ] WSR: Starting full primary refresh. [2025-10-02T22:26:45.067282] [DEBUG] [LOCAL ] WST: Deleted primary data file. [2025-10-02T22:26:45.144203] [INFO ] [MAIN ] WST: Starting full primary refresh. [2025-10-02T22:26:46.134756] [INFO ] [REMOTE ] WSO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:26:46.175017] [INFO ] [REMOTE ] WSO: Fetching primary data for 2024-12. [2025-10-02T22:26:46.466272] [INFO ] [REMOTE ] WSR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:26:46.500865] [INFO ] [REMOTE ] WSM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:26:46.529538] [INFO ] [REMOTE ] WSR: Fetching primary data for 2024-12. [2025-10-02T22:26:46.530164] [INFO ] [REMOTE ] WSM: Fetching primary data for 2024-12. [2025-10-02T22:26:46.582778] [INFO ] [REMOTE ] WST: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:26:46.583378] [INFO ] [REMOTE ] WST: Fetching primary data for 2024-12. [2025-10-02T22:26:47.421423] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-02T22:26:47.426049] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-01. [2025-10-02T22:26:47.658753] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-02T22:26:47.679262] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-01. [2025-10-02T22:26:47.680946] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-02T22:26:47.687480] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-01. [2025-10-02T22:26:48.519105] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-02T22:26:48.524330] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-02. [2025-10-02T22:26:48.571068] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-02T22:26:48.573552] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-02T22:26:48.578909] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-02. [2025-10-02T22:26:48.801304] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-02T22:26:49.073017] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-02. [2025-10-02T22:26:49.591163] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-02T22:26:49.841106] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-02T22:26:49.872982] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-03. [2025-10-02T22:26:50.672984] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-01. [2025-10-02T22:26:50.760011] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-02T22:26:51.139922] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-02T22:26:51.473013] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-03. [2025-10-02T22:26:52.275974] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-04. [2025-10-02T22:26:52.279267] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-02T22:26:52.337092] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-02T22:26:53.073003] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-04. [2025-10-02T22:26:53.285110] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-02T22:26:53.872969] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-02. [2025-10-02T22:26:54.272928] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-02T22:26:54.672994] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-05. [2025-10-02T22:26:55.472972] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-05. [2025-10-02T22:26:55.516408] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-02T22:26:55.817546] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-02T22:26:56.273011] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-06. [2025-10-02T22:26:56.307410] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-02T22:26:57.072980] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-03. [2025-10-02T22:26:57.485124] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-02T22:26:57.873041] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-03. [2025-10-02T22:26:58.673131] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-07. [2025-10-02T22:26:58.769622] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-02T22:26:59.473029] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-06. [2025-10-02T22:26:59.742894] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-02T22:26:59.854329] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-02T22:27:00.256854] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-02T22:27:00.272953] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-07. [2025-10-02T22:27:01.073025] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-08. [2025-10-02T22:27:01.633947] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-02T22:27:01.757081] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-02T22:27:01.873038] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-09. [2025-10-02T22:27:02.672999] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-08. [2025-10-02T22:27:02.967120] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-02T22:27:03.473010] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-10. [2025-10-02T22:27:03.962045] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-02T22:27:04.238329] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-02T22:27:04.239505] [INFO ] [REMOTE ] WSR: Full fetch complete (32851 records). [2025-10-02T22:27:04.239580] [DEBUG] [VALIDATOR ] WSR: Validating primary data. [2025-10-02T22:27:04.278215] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-04. [2025-10-02T22:27:04.671461] [DEBUG] [VALIDATOR ] WSR: All expected trading days are present. [2025-10-02T22:27:04.671550] [DEBUG] [VALIDATOR ] WSR: Primary data validation passed. [2025-10-02T22:27:04.672333] [INFO ] [MAIN ] WSR: Fetched primary data is valid. [2025-10-02T22:27:04.672399] [DEBUG] [LOCAL ] WSR: Saving primary data. [2025-10-02T22:27:04.673478] [DEBUG] [LOCAL ] WSR: Trimmed 32851 records to 23174 (keeping 200 days of data) [2025-10-02T22:27:04.832042] [DEBUG] [LOCAL ] WSR: Primary data saved (23174 records). [2025-10-02T22:27:04.832199] [INFO ] [MAIN ] WSR: Full history saved. [2025-10-02T22:27:04.832293] [INFO ] [MAIN ] Update Progress: 2321/2370 symbols completed. WSR took 22.0s. Estimated remaining: 6m 54s. Rate: 7.1 symbols/min [2025-10-02T22:27:05.048200] [INFO ] [MAIN ] WT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:27:05.073006] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-09. [2025-10-02T22:27:05.095351] [DEBUG] [LOCAL ] WT: Loaded 47693 existing records from primary storage. [2025-10-02T22:27:05.095711] [INFO ] [MAIN ] WT: Loaded 47693 existing records. [2025-10-02T22:27:05.298108] [WARN ] [MAIN ] WT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:27:05.298353] [INFO ] [MAIN ] WT: Wiping existing primary data before full refresh. [2025-10-02T22:27:05.298403] [INFO ] [LOCAL ] WT: Starting deletion of primary data. [2025-10-02T22:27:05.298693] [DEBUG] [LOCAL ] WT: Deleted primary data file. [2025-10-02T22:27:05.298754] [INFO ] [MAIN ] WT: Starting full primary refresh. [2025-10-02T22:27:05.690279] [INFO ] [REMOTE ] WT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:27:05.873025] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-04. [2025-10-02T22:27:05.963124] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-02T22:27:06.051587] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-02T22:27:06.673001] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-05. [2025-10-02T22:27:07.473022] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-10. [2025-10-02T22:27:07.615273] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-02T22:27:07.845469] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-02T22:27:08.273038] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-06. [2025-10-02T22:27:08.495166] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-02T22:27:08.497113] [INFO ] [REMOTE ] WSO: Full fetch complete (34562 records). [2025-10-02T22:27:08.497223] [DEBUG] [VALIDATOR ] WSO: Validating primary data. [2025-10-02T22:27:08.910192] [DEBUG] [VALIDATOR ] WSO: All expected trading days are present. [2025-10-02T22:27:08.910411] [DEBUG] [VALIDATOR ] WSO: Primary data validation passed. [2025-10-02T22:27:08.911288] [INFO ] [MAIN ] WSO: Fetched primary data is valid. [2025-10-02T22:27:08.911360] [DEBUG] [LOCAL ] WSO: Saving primary data. [2025-10-02T22:27:08.912588] [DEBUG] [LOCAL ] WSO: Trimmed 34562 records to 24887 (keeping 200 days of data) [2025-10-02T22:27:09.073141] [INFO ] [REMOTE ] WT: Fetching primary data for 2024-12. [2025-10-02T22:27:09.080289] [DEBUG] [LOCAL ] WSO: Primary data saved (24887 records). [2025-10-02T22:27:09.080384] [INFO ] [MAIN ] WSO: Full history saved. [2025-10-02T22:27:09.080497] [INFO ] [MAIN ] Update Progress: 2322/2370 symbols completed. WSO took 26.2s. Estimated remaining: 6m 46s. Rate: 7.1 symbols/min [2025-10-02T22:27:09.263353] [INFO ] [MAIN ] WTI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:27:09.306780] [DEBUG] [LOCAL ] WTI: Loaded 43964 existing records from primary storage. [2025-10-02T22:27:09.307182] [INFO ] [MAIN ] WTI: Loaded 43964 existing records. [2025-10-02T22:27:09.501171] [WARN ] [MAIN ] WTI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:27:09.501422] [INFO ] [MAIN ] WTI: Wiping existing primary data before full refresh. [2025-10-02T22:27:09.501608] [INFO ] [LOCAL ] WTI: Starting deletion of primary data. [2025-10-02T22:27:09.501999] [DEBUG] [LOCAL ] WTI: Deleted primary data file. [2025-10-02T22:27:09.502060] [INFO ] [MAIN ] WTI: Starting full primary refresh. [2025-10-02T22:27:09.873997] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-05. [2025-10-02T22:27:09.907175] [INFO ] [REMOTE ] WTI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:27:09.931551] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-02T22:27:10.672971] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-07. [2025-10-02T22:27:10.787912] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-02T22:27:11.473028] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-01. [2025-10-02T22:27:11.720034] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-02T22:27:11.920288] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-02T22:27:12.273041] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-06. [2025-10-02T22:27:13.072977] [INFO ] [REMOTE ] WTI: Fetching primary data for 2024-12. [2025-10-02T22:27:13.192029] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-02T22:27:13.872998] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-02. [2025-10-02T22:27:14.031214] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-02T22:27:14.672981] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-08. [2025-10-02T22:27:14.864443] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-02T22:27:15.401497] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-02T22:27:15.473037] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-07. [2025-10-02T22:27:15.991857] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-02T22:27:16.273015] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-03. [2025-10-02T22:27:16.867198] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-02T22:27:17.072993] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-01. [2025-10-02T22:27:17.873030] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-08. [2025-10-02T22:27:17.957041] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-02T22:27:18.670206] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-02T22:27:18.679210] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-09. [2025-10-02T22:27:19.473020] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-02. [2025-10-02T22:27:19.543957] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-02T22:27:20.272983] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-09. [2025-10-02T22:27:20.441850] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-02T22:27:20.818341] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-02T22:27:21.073046] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-10. [2025-10-02T22:27:21.447433] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-02T22:27:21.873044] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-03. [2025-10-02T22:27:22.278019] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-02T22:27:22.279877] [INFO ] [REMOTE ] WST: Full fetch complete (53934 records). [2025-10-02T22:27:22.279966] [DEBUG] [VALIDATOR ] WST: Validating primary data. [2025-10-02T22:27:22.687846] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-04. [2025-10-02T22:27:22.708596] [DEBUG] [VALIDATOR ] WST: All expected trading days are present. [2025-10-02T22:27:22.709522] [DEBUG] [VALIDATOR ] WST: Primary data validation passed. [2025-10-02T22:27:22.710811] [INFO ] [MAIN ] WST: Fetched primary data is valid. [2025-10-02T22:27:22.711020] [DEBUG] [LOCAL ] WST: Saving primary data. [2025-10-02T22:27:22.712403] [DEBUG] [LOCAL ] WST: Trimmed 53934 records to 37510 (keeping 200 days of data) [2025-10-02T22:27:22.971462] [DEBUG] [LOCAL ] WST: Primary data saved (37510 records). [2025-10-02T22:27:22.971619] [INFO ] [MAIN ] WST: Full history saved. [2025-10-02T22:27:22.973548] [INFO ] [MAIN ] Update Progress: 2323/2370 symbols completed. WST took 40.1s. Estimated remaining: 6m 37s. Rate: 7.1 symbols/min [2025-10-02T22:27:23.174033] [INFO ] [MAIN ] WTM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:27:23.174308] [DEBUG] [LOCAL ] WTM: No existing data file found in primary storage. [2025-10-02T22:27:23.174420] [WARN ] [MAIN ] WTM: No existing data found, performing full refresh instead. [2025-10-02T22:27:23.175069] [INFO ] [MAIN ] WTM: Wiping existing primary data before full refresh. [2025-10-02T22:27:23.175156] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-10-02T22:27:23.175208] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-10-02T22:27:23.175246] [INFO ] [MAIN ] WTM: Starting full primary refresh. [2025-10-02T22:27:23.478186] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-10. [2025-10-02T22:27:23.531701] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-02T22:27:23.641307] [INFO ] [REMOTE ] WTM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:27:24.273008] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-04. [2025-10-02T22:27:24.431781] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-02T22:27:24.682532] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-02T22:27:24.685217] [INFO ] [REMOTE ] WSM: Full fetch complete (71914 records). [2025-10-02T22:27:24.685403] [DEBUG] [VALIDATOR ] WSM: Validating primary data. [2025-10-02T22:27:25.079634] [INFO ] [REMOTE ] WTM: Fetching primary data for 2024-12. [2025-10-02T22:27:25.124904] [DEBUG] [VALIDATOR ] WSM: All expected trading days are present. [2025-10-02T22:27:25.125004] [DEBUG] [VALIDATOR ] WSM: Primary data validation passed. [2025-10-02T22:27:25.126173] [INFO ] [MAIN ] WSM: Fetched primary data is valid. [2025-10-02T22:27:25.126237] [DEBUG] [LOCAL ] WSM: Saving primary data. [2025-10-02T22:27:25.127789] [DEBUG] [LOCAL ] WSM: Trimmed 71914 records to 49937 (keeping 200 days of data) [2025-10-02T22:27:25.457219] [DEBUG] [LOCAL ] WSM: Primary data saved (49937 records). [2025-10-02T22:27:25.457371] [INFO ] [MAIN ] WSM: Full history saved. [2025-10-02T22:27:25.457460] [INFO ] [MAIN ] Update Progress: 2324/2370 symbols completed. WSM took 42.6s. Estimated remaining: 6m 29s. Rate: 7.1 symbols/min [2025-10-02T22:27:25.535924] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-02T22:27:25.673037] [INFO ] [MAIN ] WTRG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:27:25.739353] [DEBUG] [LOCAL ] WTRG: Loaded 50905 existing records from primary storage. [2025-10-02T22:27:25.739758] [INFO ] [MAIN ] WTRG: Loaded 50905 existing records. [2025-10-02T22:27:25.876500] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-01. [2025-10-02T22:27:25.943751] [WARN ] [MAIN ] WTRG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:27:25.944679] [INFO ] [MAIN ] WTRG: Wiping existing primary data before full refresh. [2025-10-02T22:27:25.944848] [INFO ] [LOCAL ] WTRG: Starting deletion of primary data. [2025-10-02T22:27:25.945269] [DEBUG] [LOCAL ] WTRG: Deleted primary data file. [2025-10-02T22:27:25.945424] [INFO ] [MAIN ] WTRG: Starting full primary refresh. [2025-10-02T22:27:26.064729] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-02T22:27:26.321398] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-02T22:27:26.405985] [INFO ] [REMOTE ] WTRG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:27:26.673012] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2024-12. [2025-10-02T22:27:27.473001] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-02. [2025-10-02T22:27:27.865938] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-02T22:27:28.273053] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-05. [2025-10-02T22:27:28.354176] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-02T22:27:29.073048] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-03. [2025-10-02T22:27:29.545621] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-02T22:27:29.873068] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-05. [2025-10-02T22:27:30.021277] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-02T22:27:30.673000] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-06. [2025-10-02T22:27:31.378194] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-02T22:27:31.473047] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-01. [2025-10-02T22:27:31.933150] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-02T22:27:32.273018] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-07. [2025-10-02T22:27:33.073013] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-06. [2025-10-02T22:27:33.177153] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-02T22:27:33.872978] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-02. [2025-10-02T22:27:34.061267] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-02T22:27:34.238520] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-02T22:27:34.673021] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-04. [2025-10-02T22:27:35.103151] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-02T22:27:35.223959] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-02T22:27:35.473013] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-03. [2025-10-02T22:27:36.273002] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-05. [2025-10-02T22:27:36.689636] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-02T22:27:37.073033] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-06. [2025-10-02T22:27:37.233415] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-02T22:27:37.561051] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-02T22:27:37.872992] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-08. [2025-10-02T22:27:38.673002] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-07. [2025-10-02T22:27:39.428867] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-02T22:27:39.472969] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-09. [2025-10-02T22:27:40.273049] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-07. [2025-10-02T22:27:40.523133] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-02T22:27:40.734609] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-02T22:27:41.073350] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-08. [2025-10-02T22:27:41.077307] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-02T22:27:41.872995] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-04. [2025-10-02T22:27:42.645724] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-02T22:27:42.672990] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-09. [2025-10-02T22:27:43.473005] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-10. [2025-10-02T22:27:43.616074] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-02T22:27:44.272968] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-05. [2025-10-02T22:27:44.324355] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-02T22:27:44.504465] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-02T22:27:44.506338] [INFO ] [REMOTE ] WTI: Full fetch complete (64064 records). [2025-10-02T22:27:44.506527] [DEBUG] [VALIDATOR ] WTI: Validating primary data. [2025-10-02T22:27:44.932028] [DEBUG] [VALIDATOR ] WTI: All expected trading days are present. [2025-10-02T22:27:44.932125] [DEBUG] [VALIDATOR ] WTI: Primary data validation passed. [2025-10-02T22:27:44.933282] [INFO ] [MAIN ] WTI: Fetched primary data is valid. [2025-10-02T22:27:44.933384] [DEBUG] [LOCAL ] WTI: Saving primary data. [2025-10-02T22:27:44.934954] [DEBUG] [LOCAL ] WTI: Trimmed 64064 records to 44224 (keeping 200 days of data) [2025-10-02T22:27:45.120043] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-08. [2025-10-02T22:27:45.225491] [DEBUG] [LOCAL ] WTI: Primary data saved (44224 records). [2025-10-02T22:27:45.225701] [INFO ] [MAIN ] WTI: Full history saved. [2025-10-02T22:27:45.225850] [INFO ] [MAIN ] Update Progress: 2325/2370 symbols completed. WTI took 36.1s. Estimated remaining: 6m 21s. Rate: 7.1 symbols/min [2025-10-02T22:27:45.420466] [INFO ] [MAIN ] WTS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:27:45.441789] [DEBUG] [LOCAL ] WTS: Loaded 18134 existing records from primary storage. [2025-10-02T22:27:45.442045] [INFO ] [MAIN ] WTS: Loaded 18134 existing records. [2025-10-02T22:27:45.672155] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-02T22:27:45.671852] [WARN ] [MAIN ] WTS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:27:45.674345] [INFO ] [MAIN ] WTS: Wiping existing primary data before full refresh. [2025-10-02T22:27:45.674429] [INFO ] [LOCAL ] WTS: Starting deletion of primary data. [2025-10-02T22:27:45.674733] [DEBUG] [LOCAL ] WTS: Deleted primary data file. [2025-10-02T22:27:45.674865] [INFO ] [MAIN ] WTS: Starting full primary refresh. [2025-10-02T22:27:45.878304] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-10. [2025-10-02T22:27:46.075893] [INFO ] [REMOTE ] WTS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:27:46.109377] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-02T22:27:46.672997] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-09. [2025-10-02T22:27:47.261950] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-02T22:27:47.264116] [INFO ] [REMOTE ] WT: Full fetch complete (69218 records). [2025-10-02T22:27:47.264232] [DEBUG] [VALIDATOR ] WT: Validating primary data. [2025-10-02T22:27:47.364691] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-02T22:27:47.474365] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-06. [2025-10-02T22:27:47.738570] [DEBUG] [VALIDATOR ] WT: All expected trading days are present. [2025-10-02T22:27:47.738687] [DEBUG] [VALIDATOR ] WT: Primary data validation passed. [2025-10-02T22:27:47.739985] [INFO ] [MAIN ] WT: Fetched primary data is valid. [2025-10-02T22:27:47.740070] [DEBUG] [LOCAL ] WT: Saving primary data. [2025-10-02T22:27:47.741614] [DEBUG] [LOCAL ] WT: Trimmed 69218 records to 48073 (keeping 200 days of data) [2025-10-02T22:27:48.055148] [DEBUG] [LOCAL ] WT: Primary data saved (48073 records). [2025-10-02T22:27:48.055308] [INFO ] [MAIN ] WT: Full history saved. [2025-10-02T22:27:48.055427] [INFO ] [MAIN ] Update Progress: 2326/2370 symbols completed. WT took 43.2s. Estimated remaining: 6m 12s. Rate: 7.1 symbols/min [2025-10-02T22:27:48.244385] [INFO ] [MAIN ] WTTR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:27:48.273005] [INFO ] [REMOTE ] WTS: Fetching primary data for 2024-12. [2025-10-02T22:27:48.290625] [DEBUG] [LOCAL ] WTTR: Loaded 44935 existing records from primary storage. [2025-10-02T22:27:48.291022] [INFO ] [MAIN ] WTTR: Loaded 44935 existing records. [2025-10-02T22:27:48.483686] [WARN ] [MAIN ] WTTR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:27:48.483930] [INFO ] [MAIN ] WTTR: Wiping existing primary data before full refresh. [2025-10-02T22:27:48.483995] [INFO ] [LOCAL ] WTTR: Starting deletion of primary data. [2025-10-02T22:27:48.484285] [DEBUG] [LOCAL ] WTTR: Deleted primary data file. [2025-10-02T22:27:48.484343] [INFO ] [MAIN ] WTTR: Starting full primary refresh. [2025-10-02T22:27:48.877711] [INFO ] [REMOTE ] WTTR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:27:48.972959] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-02T22:27:49.073017] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-07. [2025-10-02T22:27:49.319989] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-02T22:27:49.873004] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-01. [2025-10-02T22:27:50.672551] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-02T22:27:50.683272] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-10. [2025-10-02T22:27:50.859982] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-02T22:27:51.128283] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-02T22:27:51.129110] [INFO ] [REMOTE ] WTM: Full fetch complete (2408 records). [2025-10-02T22:27:51.129185] [DEBUG] [VALIDATOR ] WTM: Validating primary data. [2025-10-02T22:27:51.327442] [WARN ] [VALIDATOR ] WTM: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-02T22:27:51.327673] [FATAL] [MAIN ] WTM: Fetched primary data is invalid. Refusing to save it. [2025-10-02T22:27:51.327746] [WARN ] [MAIN ] WTM: Deleting existing primary and derivative data due to validation failure. [2025-10-02T22:27:51.327817] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-10-02T22:27:51.327923] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-10-02T22:27:51.327977] [INFO ] [LOCAL ] WTM: Starting deletion of derivative data. [2025-10-02T22:27:51.328053] [DEBUG] [LOCAL ] WTM: No derivative data file found to delete. [2025-10-02T22:27:51.328153] [INFO ] [MAIN ] Update Progress: 2327/2370 symbols completed. WTM took 28.4s. Estimated remaining: 6m 3s. Rate: 7.1 symbols/min [2025-10-02T22:27:51.478883] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2024-12. [2025-10-02T22:27:51.508018] [INFO ] [MAIN ] WU: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:27:51.563544] [DEBUG] [LOCAL ] WU: Loaded 53453 existing records from primary storage. [2025-10-02T22:27:51.563896] [INFO ] [MAIN ] WU: Loaded 53453 existing records. [2025-10-02T22:27:51.758478] [WARN ] [MAIN ] WU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:27:51.758771] [INFO ] [MAIN ] WU: Wiping existing primary data before full refresh. [2025-10-02T22:27:51.758835] [INFO ] [LOCAL ] WU: Starting deletion of primary data. [2025-10-02T22:27:51.759061] [DEBUG] [LOCAL ] WU: Deleted primary data file. [2025-10-02T22:27:51.759118] [INFO ] [MAIN ] WU: Starting full primary refresh. [2025-10-02T22:27:52.147757] [INFO ] [REMOTE ] WU: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:27:52.273033] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-08. [2025-10-02T22:27:53.025017] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-02T22:27:53.073008] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-02. [2025-10-02T22:27:53.872986] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-01. [2025-10-02T22:27:53.946124] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-02T22:27:54.247202] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-02T22:27:54.673034] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-09. [2025-10-02T22:27:55.415576] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-02T22:27:55.473041] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-02. [2025-10-02T22:27:56.103314] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-02T22:27:56.272992] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-10. [2025-10-02T22:27:56.669107] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-02T22:27:57.073055] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-03. [2025-10-02T22:27:57.683190] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-02T22:27:57.686291] [INFO ] [REMOTE ] WTRG: Full fetch complete (73424 records). [2025-10-02T22:27:57.686434] [DEBUG] [VALIDATOR ] WTRG: Validating primary data. [2025-10-02T22:27:57.879611] [INFO ] [REMOTE ] WU: Fetching primary data for 2024-12. [2025-10-02T22:27:58.124859] [DEBUG] [VALIDATOR ] WTRG: All expected trading days are present. [2025-10-02T22:27:58.124974] [DEBUG] [VALIDATOR ] WTRG: Primary data validation passed. [2025-10-02T22:27:58.126247] [INFO ] [MAIN ] WTRG: Fetched primary data is valid. [2025-10-02T22:27:58.126336] [DEBUG] [LOCAL ] WTRG: Saving primary data. [2025-10-02T22:27:58.128238] [DEBUG] [LOCAL ] WTRG: Trimmed 73424 records to 51286 (keeping 200 days of data) [2025-10-02T22:27:58.255019] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-02T22:27:58.503384] [DEBUG] [LOCAL ] WTRG: Primary data saved (51286 records). [2025-10-02T22:27:58.503537] [INFO ] [MAIN ] WTRG: Full history saved. [2025-10-02T22:27:58.503672] [INFO ] [MAIN ] Update Progress: 2328/2370 symbols completed. WTRG took 33.0s. Estimated remaining: 5m 55s. Rate: 7.1 symbols/min [2025-10-02T22:27:58.682684] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-04. [2025-10-02T22:27:58.710995] [INFO ] [MAIN ] WWW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:27:58.762028] [DEBUG] [LOCAL ] WWW: Loaded 49139 existing records from primary storage. [2025-10-02T22:27:58.762366] [INFO ] [MAIN ] WWW: Loaded 49139 existing records. [2025-10-02T22:27:58.962683] [WARN ] [MAIN ] WWW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:27:58.962964] [INFO ] [MAIN ] WWW: Wiping existing primary data before full refresh. [2025-10-02T22:27:58.963029] [INFO ] [LOCAL ] WWW: Starting deletion of primary data. [2025-10-02T22:27:58.963317] [DEBUG] [LOCAL ] WWW: Deleted primary data file. [2025-10-02T22:27:58.963392] [INFO ] [MAIN ] WWW: Starting full primary refresh. [2025-10-02T22:27:59.366807] [INFO ] [REMOTE ] WWW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:27:59.473062] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-03. [2025-10-02T22:27:59.789268] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-02T22:27:59.938678] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-02T22:28:00.273045] [INFO ] [REMOTE ] WWW: Fetching primary data for 2024-12. [2025-10-02T22:28:00.865531] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-02T22:28:01.073017] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-04. [2025-10-02T22:28:01.869668] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-02T22:28:01.879312] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-05. [2025-10-02T22:28:02.672962] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-01. [2025-10-02T22:28:02.756028] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-02T22:28:03.075401] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-02T22:28:03.473024] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-06. [2025-10-02T22:28:04.281217] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-05. [2025-10-02T22:28:04.287835] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-02T22:28:04.514414] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-02T22:28:05.073042] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-01. [2025-10-02T22:28:05.800546] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-02T22:28:05.873024] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-02. [2025-10-02T22:28:06.276063] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-02T22:28:06.673015] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-06. [2025-10-02T22:28:07.353154] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-02T22:28:07.473062] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-03. [2025-10-02T22:28:08.186017] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-02T22:28:08.273083] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-07. [2025-10-02T22:28:09.072971] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-02. [2025-10-02T22:28:09.115858] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-02T22:28:09.405410] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-02T22:28:09.873012] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-08. [2025-10-02T22:28:10.644389] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-02T22:28:10.678089] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-04. [2025-10-02T22:28:10.691125] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-02T22:28:11.473000] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-09. [2025-10-02T22:28:12.272997] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-03. [2025-10-02T22:28:12.426354] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-02T22:28:12.673922] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-02T22:28:13.073043] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-07. [2025-10-02T22:28:13.840912] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-02T22:28:13.872985] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-04. [2025-10-02T22:28:14.241489] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-02T22:28:14.673096] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-08. [2025-10-02T22:28:15.431294] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-02T22:28:15.472976] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-10. [2025-10-02T22:28:16.245604] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-02T22:28:16.247300] [INFO ] [REMOTE ] WTS: Full fetch complete (26117 records). [2025-10-02T22:28:16.247941] [DEBUG] [VALIDATOR ] WTS: Validating primary data. [2025-10-02T22:28:16.249532] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-02T22:28:16.280984] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-05. [2025-10-02T22:28:16.694228] [DEBUG] [VALIDATOR ] WTS: All expected trading days are present. [2025-10-02T22:28:16.694317] [DEBUG] [VALIDATOR ] WTS: Primary data validation passed. [2025-10-02T22:28:16.694883] [INFO ] [MAIN ] WTS: Fetched primary data is valid. [2025-10-02T22:28:16.694948] [DEBUG] [LOCAL ] WTS: Saving primary data. [2025-10-02T22:28:16.695770] [DEBUG] [LOCAL ] WTS: Trimmed 26117 records to 18239 (keeping 200 days of data) [2025-10-02T22:28:16.818773] [DEBUG] [LOCAL ] WTS: Primary data saved (18239 records). [2025-10-02T22:28:16.818943] [INFO ] [MAIN ] WTS: Full history saved. [2025-10-02T22:28:16.819129] [INFO ] [MAIN ] Update Progress: 2329/2370 symbols completed. WTS took 31.6s. Estimated remaining: 5m 47s. Rate: 7.1 symbols/min [2025-10-02T22:28:16.998117] [INFO ] [MAIN ] WY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:28:17.062040] [DEBUG] [LOCAL ] WY: Loaded 53131 existing records from primary storage. [2025-10-02T22:28:17.062411] [INFO ] [MAIN ] WY: Loaded 53131 existing records. [2025-10-02T22:28:17.078320] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-05. [2025-10-02T22:28:17.261001] [WARN ] [MAIN ] WY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:28:17.261212] [INFO ] [MAIN ] WY: Wiping existing primary data before full refresh. [2025-10-02T22:28:17.261260] [INFO ] [LOCAL ] WY: Starting deletion of primary data. [2025-10-02T22:28:17.261610] [DEBUG] [LOCAL ] WY: Deleted primary data file. [2025-10-02T22:28:17.261706] [INFO ] [MAIN ] WY: Starting full primary refresh. [2025-10-02T22:28:17.666133] [INFO ] [REMOTE ] WY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:28:17.872997] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-09. [2025-10-02T22:28:18.087630] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-02T22:28:18.673028] [INFO ] [REMOTE ] WY: Fetching primary data for 2024-12. [2025-10-02T22:28:19.019101] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-02T22:28:19.098270] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-02T22:28:19.472995] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-06. [2025-10-02T22:28:20.131777] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-02T22:28:20.273037] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-10. [2025-10-02T22:28:20.968092] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-02T22:28:21.073043] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-01. [2025-10-02T22:28:21.487744] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-02T22:28:21.489953] [INFO ] [REMOTE ] WTTR: Full fetch complete (65657 records). [2025-10-02T22:28:21.490055] [DEBUG] [VALIDATOR ] WTTR: Validating primary data. [2025-10-02T22:28:21.889195] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-06. [2025-10-02T22:28:21.951332] [DEBUG] [VALIDATOR ] WTTR: All expected trading days are present. [2025-10-02T22:28:21.951433] [DEBUG] [VALIDATOR ] WTTR: Primary data validation passed. [2025-10-02T22:28:21.952584] [INFO ] [MAIN ] WTTR: Fetched primary data is valid. [2025-10-02T22:28:21.952686] [DEBUG] [LOCAL ] WTTR: Saving primary data. [2025-10-02T22:28:21.954309] [DEBUG] [LOCAL ] WTTR: Trimmed 65657 records to 45266 (keeping 200 days of data) [2025-10-02T22:28:22.240425] [DEBUG] [LOCAL ] WTTR: Primary data saved (45266 records). [2025-10-02T22:28:22.240558] [INFO ] [MAIN ] WTTR: Full history saved. [2025-10-02T22:28:22.240673] [INFO ] [MAIN ] Update Progress: 2330/2370 symbols completed. WTTR took 34.2s. Estimated remaining: 5m 38s. Rate: 7.1 symbols/min [2025-10-02T22:28:22.413843] [INFO ] [MAIN ] XFLT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:28:22.444806] [DEBUG] [LOCAL ] XFLT: Loaded 29830 existing records from primary storage. [2025-10-02T22:28:22.445698] [INFO ] [MAIN ] XFLT: Loaded 29830 existing records. [2025-10-02T22:28:22.650164] [WARN ] [MAIN ] XFLT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:28:22.650408] [INFO ] [MAIN ] XFLT: Wiping existing primary data before full refresh. [2025-10-02T22:28:22.650465] [INFO ] [LOCAL ] XFLT: Starting deletion of primary data. [2025-10-02T22:28:22.650912] [DEBUG] [LOCAL ] XFLT: Deleted primary data file. [2025-10-02T22:28:22.650976] [INFO ] [MAIN ] XFLT: Starting full primary refresh. [2025-10-02T22:28:22.686536] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-07. [2025-10-02T22:28:23.052913] [INFO ] [REMOTE ] XFLT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:28:23.086047] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-02T22:28:23.473004] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2024-12. [2025-10-02T22:28:23.604557] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-02T22:28:24.273021] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-07. [2025-10-02T22:28:24.723303] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-02T22:28:24.841051] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-02T22:28:25.073037] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-02. [2025-10-02T22:28:25.642502] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-02T22:28:25.873057] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-08. [2025-10-02T22:28:26.673030] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-08. [2025-10-02T22:28:26.721016] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-02T22:28:27.473016] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-03. [2025-10-02T22:28:27.660487] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-02T22:28:28.273054] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-09. [2025-10-02T22:28:28.805635] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-02T22:28:28.945829] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-02T22:28:29.073049] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-04. [2025-10-02T22:28:29.644989] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-02T22:28:29.872994] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-01. [2025-10-02T22:28:30.672993] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-09. [2025-10-02T22:28:30.885067] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-02T22:28:31.330784] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-02T22:28:31.473040] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-02. [2025-10-02T22:28:32.272984] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-05. [2025-10-02T22:28:32.579280] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-02T22:28:32.714125] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-02T22:28:33.073009] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-10. [2025-10-02T22:28:33.873027] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-10. [2025-10-02T22:28:34.117676] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-02T22:28:34.341021] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-02T22:28:34.343364] [INFO ] [REMOTE ] WU: Full fetch complete (77353 records). [2025-10-02T22:28:34.343499] [DEBUG] [VALIDATOR ] WU: Validating primary data. [2025-10-02T22:28:34.678144] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-06. [2025-10-02T22:28:34.780111] [DEBUG] [VALIDATOR ] WU: All expected trading days are present. [2025-10-02T22:28:34.780259] [DEBUG] [VALIDATOR ] WU: Primary data validation passed. [2025-10-02T22:28:34.781679] [INFO ] [MAIN ] WU: Fetched primary data is valid. [2025-10-02T22:28:34.781769] [DEBUG] [LOCAL ] WU: Saving primary data. [2025-10-02T22:28:34.783472] [DEBUG] [LOCAL ] WU: Trimmed 77353 records to 53843 (keeping 200 days of data) [2025-10-02T22:28:35.141119] [DEBUG] [LOCAL ] WU: Primary data saved (53843 records). [2025-10-02T22:28:35.141264] [INFO ] [MAIN ] WU: Full history saved. [2025-10-02T22:28:35.142221] [INFO ] [MAIN ] Update Progress: 2331/2370 symbols completed. WU took 43.8s. Estimated remaining: 5m 30s. Rate: 7.1 symbols/min [2025-10-02T22:28:35.325013] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-02T22:28:35.334462] [INFO ] [MAIN ] XHR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:28:35.336809] [INFO ] [REMOTE ] WWW: Full fetch complete (70209 records). [2025-10-02T22:28:35.337009] [DEBUG] [VALIDATOR ] WWW: Validating primary data. [2025-10-02T22:28:35.476623] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-03. [2025-10-02T22:28:35.707845] [DEBUG] [LOCAL ] XHR: Loaded 43695 existing records from primary storage. [2025-10-02T22:28:35.719223] [INFO ] [MAIN ] XHR: Loaded 43695 existing records. [2025-10-02T22:28:35.931495] [DEBUG] [VALIDATOR ] WWW: All expected trading days are present. [2025-10-02T22:28:35.931698] [DEBUG] [VALIDATOR ] WWW: Primary data validation passed. [2025-10-02T22:28:35.933428] [INFO ] [MAIN ] WWW: Fetched primary data is valid. [2025-10-02T22:28:35.939042] [DEBUG] [LOCAL ] WWW: Saving primary data. [2025-10-02T22:28:36.011409] [DEBUG] [LOCAL ] WWW: Trimmed 70209 records to 49485 (keeping 200 days of data) [2025-10-02T22:28:36.027554] [WARN ] [MAIN ] XHR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:28:36.028639] [INFO ] [MAIN ] XHR: Wiping existing primary data before full refresh. [2025-10-02T22:28:36.028759] [INFO ] [LOCAL ] XHR: Starting deletion of primary data. [2025-10-02T22:28:36.029517] [DEBUG] [LOCAL ] XHR: Deleted primary data file. [2025-10-02T22:28:36.029584] [INFO ] [MAIN ] XHR: Starting full primary refresh. [2025-10-02T22:28:36.566964] [INFO ] [REMOTE ] XHR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:28:36.588379] [INFO ] [REMOTE ] XHR: Fetching primary data for 2024-12. [2025-10-02T22:28:36.594340] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-02T22:28:36.817169] [DEBUG] [LOCAL ] WWW: Primary data saved (49485 records). [2025-10-02T22:28:36.817351] [INFO ] [MAIN ] WWW: Full history saved. [2025-10-02T22:28:36.817475] [INFO ] [MAIN ] Update Progress: 2332/2370 symbols completed. WWW took 38.3s. Estimated remaining: 5m 21s. Rate: 7.1 symbols/min [2025-10-02T22:28:36.980563] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-02T22:28:37.061523] [INFO ] [MAIN ] XIFR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:28:37.061748] [DEBUG] [LOCAL ] XIFR: No existing data file found in primary storage. [2025-10-02T22:28:37.061798] [WARN ] [MAIN ] XIFR: No existing data found, performing full refresh instead. [2025-10-02T22:28:37.061957] [INFO ] [MAIN ] XIFR: Wiping existing primary data before full refresh. [2025-10-02T22:28:37.062012] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-10-02T22:28:37.062058] [DEBUG] [LOCAL ] XIFR: No primary data file found to delete. [2025-10-02T22:28:37.062091] [INFO ] [MAIN ] XIFR: Starting full primary refresh. [2025-10-02T22:28:37.078185] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-07. [2025-10-02T22:28:37.524585] [INFO ] [REMOTE ] XIFR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:28:37.872963] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-04. [2025-10-02T22:28:38.048828] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-02T22:28:38.673003] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-01. [2025-10-02T22:28:38.972404] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-02T22:28:39.247307] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-02T22:28:39.473006] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2024-12. [2025-10-02T22:28:39.679156] [DEBUG] [REMOTE ] XIFR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T22:28:39.679478] [WARN ] [REMOTE ] XIFR: No data returned for month 2024-12 [2025-10-02T22:28:39.679571] [FATAL] [REMOTE ] XIFR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T22:28:39.679623] [FATAL] [MAIN ] XIFR: Failed to fetch primary data. [2025-10-02T22:28:39.679695] [WARN ] [MAIN ] XIFR: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T22:28:39.679769] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-10-02T22:28:39.679832] [DEBUG] [LOCAL ] XIFR: No primary data file found to delete. [2025-10-02T22:28:39.679869] [INFO ] [LOCAL ] XIFR: Starting deletion of derivative data. [2025-10-02T22:28:39.679926] [DEBUG] [LOCAL ] XIFR: No derivative data file found to delete. [2025-10-02T22:28:39.679995] [INFO ] [MAIN ] Update Progress: 2333/2370 symbols completed. XIFR took 2.9s. Estimated remaining: 5m 13s. Rate: 7.1 symbols/min [2025-10-02T22:28:39.889387] [INFO ] [MAIN ] XOM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:28:39.899086] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-02T22:28:39.962693] [DEBUG] [LOCAL ] XOM: Loaded 53793 existing records from primary storage. [2025-10-02T22:28:39.963058] [INFO ] [MAIN ] XOM: Loaded 53793 existing records. [2025-10-02T22:28:40.160096] [WARN ] [MAIN ] XOM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:28:40.160302] [INFO ] [MAIN ] XOM: Wiping existing primary data before full refresh. [2025-10-02T22:28:40.160351] [INFO ] [LOCAL ] XOM: Starting deletion of primary data. [2025-10-02T22:28:40.160614] [DEBUG] [LOCAL ] XOM: Deleted primary data file. [2025-10-02T22:28:40.160710] [INFO ] [MAIN ] XOM: Starting full primary refresh. [2025-10-02T22:28:40.280869] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-08. [2025-10-02T22:28:40.595778] [INFO ] [REMOTE ] XOM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:28:41.073028] [INFO ] [REMOTE ] XOM: Fetching primary data for 2024-12. [2025-10-02T22:28:41.873043] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-02. [2025-10-02T22:28:42.169739] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-02T22:28:42.673023] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-09. [2025-10-02T22:28:43.303868] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-10-02T22:28:43.343983] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-02T22:28:43.473057] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-01. [2025-10-02T22:28:44.215822] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-02T22:28:44.273030] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-05. [2025-10-02T22:28:45.073040] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-03. [2025-10-02T22:28:45.583679] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-02T22:28:45.873031] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-06. [2025-10-02T22:28:46.008957] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-01 (2.54 seconds). [2025-10-02T22:28:46.672999] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-02. [2025-10-02T22:28:46.885968] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-02T22:28:47.086964] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-02T22:28:47.473003] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-07. [2025-10-02T22:28:48.273025] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-04. [2025-10-02T22:28:48.753221] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-02T22:28:48.869013] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-02T22:28:49.073006] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-03. [2025-10-02T22:28:49.589540] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-02T22:28:49.873014] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-10. [2025-10-02T22:28:50.673018] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-05. [2025-10-02T22:28:51.285009] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-02T22:28:51.288243] [INFO ] [REMOTE ] WY: Full fetch complete (76855 records). [2025-10-02T22:28:51.288439] [DEBUG] [VALIDATOR ] WY: Validating primary data. [2025-10-02T22:28:51.482239] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-08. [2025-10-02T22:28:51.757348] [DEBUG] [VALIDATOR ] WY: All expected trading days are present. [2025-10-02T22:28:51.758239] [DEBUG] [VALIDATOR ] WY: Primary data validation passed. [2025-10-02T22:28:51.760374] [INFO ] [MAIN ] WY: Fetched primary data is valid. [2025-10-02T22:28:51.760508] [DEBUG] [LOCAL ] WY: Saving primary data. [2025-10-02T22:28:51.762576] [DEBUG] [LOCAL ] WY: Trimmed 76855 records to 53514 (keeping 200 days of data) [2025-10-02T22:28:52.165540] [DEBUG] [LOCAL ] WY: Primary data saved (53514 records). [2025-10-02T22:28:52.165791] [INFO ] [MAIN ] WY: Full history saved. [2025-10-02T22:28:52.165912] [INFO ] [MAIN ] Update Progress: 2334/2370 symbols completed. WY took 35.3s. Estimated remaining: 5m 4s. Rate: 7.1 symbols/min [2025-10-02T22:28:52.439161] [INFO ] [MAIN ] XPER: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:28:52.442046] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-02T22:28:52.453842] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-06. [2025-10-02T22:28:52.476191] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-02T22:28:52.509095] [DEBUG] [LOCAL ] XPER: Loaded 29760 existing records from primary storage. [2025-10-02T22:28:52.538919] [INFO ] [MAIN ] XPER: Loaded 29760 existing records. [2025-10-02T22:28:52.597323] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-03 (3.52 seconds). [2025-10-02T22:28:52.768206] [WARN ] [MAIN ] XPER: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:28:52.768461] [INFO ] [MAIN ] XPER: Wiping existing primary data before full refresh. [2025-10-02T22:28:52.768522] [INFO ] [LOCAL ] XPER: Starting deletion of primary data. [2025-10-02T22:28:52.768802] [DEBUG] [LOCAL ] XPER: Deleted primary data file. [2025-10-02T22:28:52.768860] [INFO ] [MAIN ] XPER: Starting full primary refresh. [2025-10-02T22:28:53.078180] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-09. [2025-10-02T22:28:53.164996] [INFO ] [REMOTE ] XPER: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:28:53.872970] [INFO ] [REMOTE ] XPER: Fetching primary data for 2024-12. [2025-10-02T22:28:54.068039] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-02T22:28:54.516886] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-02T22:28:54.673012] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-10. [2025-10-02T22:28:55.329428] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-02T22:28:55.473014] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-04. [2025-10-02T22:28:55.580509] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-02T22:28:55.582436] [INFO ] [REMOTE ] XFLT: Full fetch complete (44134 records). [2025-10-02T22:28:55.582560] [DEBUG] [VALIDATOR ] XFLT: Validating primary data. [2025-10-02T22:28:56.006417] [DEBUG] [VALIDATOR ] XFLT: All expected trading days are present. [2025-10-02T22:28:56.006531] [DEBUG] [VALIDATOR ] XFLT: Primary data validation passed. [2025-10-02T22:28:56.008489] [INFO ] [MAIN ] XFLT: Fetched primary data is valid. [2025-10-02T22:28:56.008576] [DEBUG] [LOCAL ] XFLT: Saving primary data. [2025-10-02T22:28:56.010077] [DEBUG] [LOCAL ] XFLT: Trimmed 44134 records to 30037 (keeping 200 days of data) [2025-10-02T22:28:56.199352] [DEBUG] [LOCAL ] XFLT: Primary data saved (30037 records). [2025-10-02T22:28:56.199490] [INFO ] [MAIN ] XFLT: Full history saved. [2025-10-02T22:28:56.199574] [INFO ] [MAIN ] Update Progress: 2335/2370 symbols completed. XFLT took 34.0s. Estimated remaining: 4m 56s. Rate: 7.1 symbols/min [2025-10-02T22:28:56.281075] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-07. [2025-10-02T22:28:56.386890] [INFO ] [MAIN ] XPEV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:28:56.440053] [DEBUG] [LOCAL ] XPEV: Loaded 53636 existing records from primary storage. [2025-10-02T22:28:56.440431] [INFO ] [MAIN ] XPEV: Loaded 53636 existing records. [2025-10-02T22:28:56.627176] [WARN ] [MAIN ] XPEV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:28:56.627403] [INFO ] [MAIN ] XPEV: Wiping existing primary data before full refresh. [2025-10-02T22:28:56.627450] [INFO ] [LOCAL ] XPEV: Starting deletion of primary data. [2025-10-02T22:28:56.627717] [DEBUG] [LOCAL ] XPEV: Deleted primary data file. [2025-10-02T22:28:56.627776] [INFO ] [MAIN ] XPEV: Starting full primary refresh. [2025-10-02T22:28:57.019326] [INFO ] [REMOTE ] XPEV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:28:57.073044] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-01. [2025-10-02T22:28:57.873016] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2024-12. [2025-10-02T22:28:57.917170] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-10-02T22:28:57.964013] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-02T22:28:58.390403] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-02T22:28:58.673013] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-05. [2025-10-02T22:28:59.473020] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-08. [2025-10-02T22:29:00.284271] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-02. [2025-10-02T22:29:00.290494] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2024-12 (2.42 seconds). [2025-10-02T22:29:01.063485] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-02T22:29:01.073769] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-01. [2025-10-02T22:29:01.220620] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-05 (2.55 seconds). [2025-10-02T22:29:01.609314] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-02T22:29:01.873029] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-06. [2025-10-02T22:29:02.673013] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-09. [2025-10-02T22:29:03.004105] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-02T22:29:03.473024] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-02. [2025-10-02T22:29:04.253007] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-06 (2.38 seconds). [2025-10-02T22:29:04.272971] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-07. [2025-10-02T22:29:04.322566] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-02T22:29:05.073053] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-03. [2025-10-02T22:29:05.860377] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-02 (2.39 seconds). [2025-10-02T22:29:05.872943] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-03. [2025-10-02T22:29:05.992058] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-02T22:29:06.526550] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-02T22:29:06.673026] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-10. [2025-10-02T22:29:07.472988] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-04. [2025-10-02T22:29:07.753595] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-02T22:29:07.755526] [INFO ] [REMOTE ] XHR: Full fetch complete (61619 records). [2025-10-02T22:29:07.755638] [DEBUG] [VALIDATOR ] XHR: Validating primary data. [2025-10-02T22:29:08.176410] [DEBUG] [VALIDATOR ] XHR: All expected trading days are present. [2025-10-02T22:29:08.176560] [DEBUG] [VALIDATOR ] XHR: Primary data validation passed. [2025-10-02T22:29:08.177751] [INFO ] [MAIN ] XHR: Fetched primary data is valid. [2025-10-02T22:29:08.177822] [DEBUG] [LOCAL ] XHR: Saving primary data. [2025-10-02T22:29:08.179227] [DEBUG] [LOCAL ] XHR: Trimmed 61619 records to 44004 (keeping 200 days of data) [2025-10-02T22:29:08.278933] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-08. [2025-10-02T22:29:08.481348] [DEBUG] [LOCAL ] XHR: Primary data saved (44004 records). [2025-10-02T22:29:08.481499] [INFO ] [MAIN ] XHR: Full history saved. [2025-10-02T22:29:08.482568] [INFO ] [MAIN ] Update Progress: 2336/2370 symbols completed. XHR took 33.3s. Estimated remaining: 4m 47s. Rate: 7.1 symbols/min [2025-10-02T22:29:08.673342] [INFO ] [MAIN ] XPO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:29:08.709127] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-03 (2.84 seconds). [2025-10-02T22:29:08.761401] [DEBUG] [LOCAL ] XPO: Loaded 47817 existing records from primary storage. [2025-10-02T22:29:08.761809] [INFO ] [MAIN ] XPO: Loaded 47817 existing records. [2025-10-02T22:29:08.956519] [WARN ] [MAIN ] XPO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:29:08.956909] [INFO ] [MAIN ] XPO: Wiping existing primary data before full refresh. [2025-10-02T22:29:08.957054] [INFO ] [LOCAL ] XPO: Starting deletion of primary data. [2025-10-02T22:29:08.957539] [DEBUG] [LOCAL ] XPO: Deleted primary data file. [2025-10-02T22:29:08.957632] [INFO ] [MAIN ] XPO: Starting full primary refresh. [2025-10-02T22:29:09.078133] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-04. [2025-10-02T22:29:09.290538] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-02T22:29:09.387591] [INFO ] [REMOTE ] XPO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:29:09.873016] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-05. [2025-10-02T22:29:10.673033] [INFO ] [REMOTE ] XPO: Fetching primary data for 2024-12. [2025-10-02T22:29:10.865720] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-08 (2.59 seconds). [2025-10-02T22:29:11.131547] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-02T22:29:11.276950] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-02T22:29:11.472997] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-05. [2025-10-02T22:29:12.273013] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-09. [2025-10-02T22:29:12.436666] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-02T22:29:13.073042] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-06. [2025-10-02T22:29:13.872999] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-01. [2025-10-02T22:29:13.967934] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-10-02T22:29:14.207316] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-02T22:29:14.672980] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-06. [2025-10-02T22:29:14.707811] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-10-02T22:29:15.285391] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-02T22:29:15.473016] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-10. [2025-10-02T22:29:16.273058] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-07. [2025-10-02T22:29:16.805027] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-02T22:29:17.073049] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-07. [2025-10-02T22:29:17.362571] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-02T22:29:17.364937] [INFO ] [REMOTE ] XOM: Full fetch complete (77922 records). [2025-10-02T22:29:17.365088] [DEBUG] [VALIDATOR ] XOM: Validating primary data. [2025-10-02T22:29:17.720388] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-02T22:29:17.878301] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-02. [2025-10-02T22:29:17.906354] [DEBUG] [VALIDATOR ] XOM: All expected trading days are present. [2025-10-02T22:29:17.906472] [DEBUG] [VALIDATOR ] XOM: Primary data validation passed. [2025-10-02T22:29:17.907996] [INFO ] [MAIN ] XOM: Fetched primary data is valid. [2025-10-02T22:29:17.908101] [DEBUG] [LOCAL ] XOM: Saving primary data. [2025-10-02T22:29:17.909984] [DEBUG] [LOCAL ] XOM: Trimmed 77922 records to 54183 (keeping 200 days of data) [2025-10-02T22:29:18.316905] [DEBUG] [LOCAL ] XOM: Primary data saved (54183 records). [2025-10-02T22:29:18.317068] [INFO ] [MAIN ] XOM: Full history saved. [2025-10-02T22:29:18.317195] [INFO ] [MAIN ] Update Progress: 2337/2370 symbols completed. XOM took 38.6s. Estimated remaining: 4m 39s. Rate: 7.1 symbols/min [2025-10-02T22:29:18.541580] [INFO ] [MAIN ] XPOF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:29:18.581961] [DEBUG] [LOCAL ] XPOF: Loaded 38055 existing records from primary storage. [2025-10-02T22:29:18.582340] [INFO ] [MAIN ] XPOF: Loaded 38055 existing records. [2025-10-02T22:29:18.683757] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-08. [2025-10-02T22:29:18.788686] [WARN ] [MAIN ] XPOF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:29:18.788990] [INFO ] [MAIN ] XPOF: Wiping existing primary data before full refresh. [2025-10-02T22:29:18.789042] [INFO ] [LOCAL ] XPOF: Starting deletion of primary data. [2025-10-02T22:29:18.789585] [DEBUG] [LOCAL ] XPOF: Deleted primary data file. [2025-10-02T22:29:18.789712] [INFO ] [MAIN ] XPOF: Starting full primary refresh. [2025-10-02T22:29:19.236073] [INFO ] [REMOTE ] XPOF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:29:19.274214] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-02T22:29:19.317922] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-02T22:29:19.473003] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-03. [2025-10-02T22:29:20.091830] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-02T22:29:20.273006] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-09. [2025-10-02T22:29:21.072994] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-08. [2025-10-02T22:29:21.216520] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-02T22:29:21.275512] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-02T22:29:21.873016] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-04. [2025-10-02T22:29:22.673056] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-10. [2025-10-02T22:29:23.268669] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-02T22:29:23.472993] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2024-12. [2025-10-02T22:29:23.654711] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-02T22:29:23.656289] [INFO ] [REMOTE ] XPER: Full fetch complete (43300 records). [2025-10-02T22:29:23.656387] [DEBUG] [VALIDATOR ] XPER: Validating primary data. [2025-10-02T22:29:24.071367] [DEBUG] [VALIDATOR ] XPER: All expected trading days are present. [2025-10-02T22:29:24.071460] [DEBUG] [VALIDATOR ] XPER: Primary data validation passed. [2025-10-02T22:29:24.072361] [INFO ] [MAIN ] XPER: Fetched primary data is valid. [2025-10-02T22:29:24.072429] [DEBUG] [LOCAL ] XPER: Saving primary data. [2025-10-02T22:29:24.073695] [DEBUG] [LOCAL ] XPER: Trimmed 43300 records to 30056 (keeping 200 days of data) [2025-10-02T22:29:24.246922] [DEBUG] [LOCAL ] XPER: Primary data saved (30056 records). [2025-10-02T22:29:24.247057] [INFO ] [MAIN ] XPER: Full history saved. [2025-10-02T22:29:24.247141] [INFO ] [MAIN ] Update Progress: 2338/2370 symbols completed. XPER took 32.1s. Estimated remaining: 4m 30s. Rate: 7.1 symbols/min [2025-10-02T22:29:24.285916] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-09. [2025-10-02T22:29:24.431979] [INFO ] [MAIN ] XPRO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:29:24.468752] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-04 (2.60 seconds). [2025-10-02T22:29:24.515920] [DEBUG] [LOCAL ] XPRO: Loaded 45876 existing records from primary storage. [2025-10-02T22:29:24.516242] [INFO ] [MAIN ] XPRO: Loaded 45876 existing records. [2025-10-02T22:29:24.713414] [WARN ] [MAIN ] XPRO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:29:24.713825] [INFO ] [MAIN ] XPRO: Wiping existing primary data before full refresh. [2025-10-02T22:29:24.714000] [INFO ] [LOCAL ] XPRO: Starting deletion of primary data. [2025-10-02T22:29:24.714516] [DEBUG] [LOCAL ] XPRO: Deleted primary data file. [2025-10-02T22:29:24.714578] [INFO ] [MAIN ] XPRO: Starting full primary refresh. [2025-10-02T22:29:24.863037] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-02T22:29:25.084334] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-05. [2025-10-02T22:29:25.129813] [INFO ] [REMOTE ] XPRO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:29:25.873001] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2024-12. [2025-10-02T22:29:26.673910] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-01. [2025-10-02T22:29:26.677329] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-02T22:29:26.824697] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-09 (2.54 seconds). [2025-10-02T22:29:27.469221] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-02T22:29:27.478946] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-06. [2025-10-02T22:29:28.000904] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-02T22:29:28.273037] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-01. [2025-10-02T22:29:28.937719] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-02T22:29:29.073025] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-07. [2025-10-02T22:29:29.620935] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-02T22:29:29.873027] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-10. [2025-10-02T22:29:30.672982] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-02. [2025-10-02T22:29:30.781808] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-02T22:29:31.473083] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-08. [2025-10-02T22:29:31.917325] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-02T22:29:31.922075] [INFO ] [REMOTE ] XPEV: Full fetch complete (77679 records). [2025-10-02T22:29:31.922293] [DEBUG] [VALIDATOR ] XPEV: Validating primary data. [2025-10-02T22:29:32.058057] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-02T22:29:32.279901] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-03. [2025-10-02T22:29:32.429343] [DEBUG] [VALIDATOR ] XPEV: All expected trading days are present. [2025-10-02T22:29:32.429446] [DEBUG] [VALIDATOR ] XPEV: Primary data validation passed. [2025-10-02T22:29:32.430690] [INFO ] [MAIN ] XPEV: Fetched primary data is valid. [2025-10-02T22:29:32.430763] [DEBUG] [LOCAL ] XPEV: Saving primary data. [2025-10-02T22:29:32.434029] [DEBUG] [LOCAL ] XPEV: Trimmed 77679 records to 54026 (keeping 200 days of data) [2025-10-02T22:29:32.790502] [DEBUG] [LOCAL ] XPEV: Primary data saved (54026 records). [2025-10-02T22:29:32.790680] [INFO ] [MAIN ] XPEV: Full history saved. [2025-10-02T22:29:32.790806] [INFO ] [MAIN ] Update Progress: 2339/2370 symbols completed. XPEV took 36.6s. Estimated remaining: 4m 22s. Rate: 7.1 symbols/min [2025-10-02T22:29:32.982279] [INFO ] [MAIN ] XYF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:29:33.018068] [DEBUG] [LOCAL ] XYF: Loaded 28441 existing records from primary storage. [2025-10-02T22:29:33.018371] [INFO ] [MAIN ] XYF: Loaded 28441 existing records. [2025-10-02T22:29:33.080894] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-02. [2025-10-02T22:29:33.237170] [WARN ] [MAIN ] XYF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:29:33.237581] [INFO ] [MAIN ] XYF: Wiping existing primary data before full refresh. [2025-10-02T22:29:33.237696] [INFO ] [LOCAL ] XYF: Starting deletion of primary data. [2025-10-02T22:29:33.238067] [DEBUG] [LOCAL ] XYF: Deleted primary data file. [2025-10-02T22:29:33.238273] [INFO ] [MAIN ] XYF: Starting full primary refresh. [2025-10-02T22:29:33.381758] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-02T22:29:33.689082] [INFO ] [REMOTE ] XYF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:29:33.878125] [INFO ] [REMOTE ] XYF: Fetching primary data for 2024-12. [2025-10-02T22:29:33.899088] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-02T22:29:34.286960] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-10-02T22:29:34.595350] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-02T22:29:34.672980] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-09. [2025-10-02T22:29:35.473038] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-03. [2025-10-02T22:29:35.983555] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-02T22:29:36.272999] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-10. [2025-10-02T22:29:36.955438] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-02T22:29:37.073011] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-01. [2025-10-02T22:29:37.246055] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-02T22:29:37.248565] [INFO ] [REMOTE ] XPO: Full fetch complete (69870 records). [2025-10-02T22:29:37.248766] [DEBUG] [VALIDATOR ] XPO: Validating primary data. [2025-10-02T22:29:37.744177] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-02T22:29:37.880475] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-04. [2025-10-02T22:29:37.887515] [DEBUG] [VALIDATOR ] XPO: All expected trading days are present. [2025-10-02T22:29:37.887610] [DEBUG] [VALIDATOR ] XPO: Primary data validation passed. [2025-10-02T22:29:37.889967] [INFO ] [MAIN ] XPO: Fetched primary data is valid. [2025-10-02T22:29:37.890103] [DEBUG] [LOCAL ] XPO: Saving primary data. [2025-10-02T22:29:37.892197] [DEBUG] [LOCAL ] XPO: Trimmed 69870 records to 48181 (keeping 200 days of data) [2025-10-02T22:29:38.342913] [DEBUG] [LOCAL ] XPO: Primary data saved (48181 records). [2025-10-02T22:29:38.343068] [INFO ] [MAIN ] XPO: Full history saved. [2025-10-02T22:29:38.344974] [INFO ] [MAIN ] Update Progress: 2340/2370 symbols completed. XPO took 29.9s. Estimated remaining: 4m 14s. Rate: 7.1 symbols/min [2025-10-02T22:29:38.548911] [INFO ] [MAIN ] XYL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:29:38.601173] [DEBUG] [LOCAL ] XYL: Loaded 47951 existing records from primary storage. [2025-10-02T22:29:38.601508] [INFO ] [MAIN ] XYL: Loaded 47951 existing records. [2025-10-02T22:29:38.678115] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-02. [2025-10-02T22:29:38.798876] [WARN ] [MAIN ] XYL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:29:38.799135] [INFO ] [MAIN ] XYL: Wiping existing primary data before full refresh. [2025-10-02T22:29:38.799203] [INFO ] [LOCAL ] XYL: Starting deletion of primary data. [2025-10-02T22:29:38.799482] [DEBUG] [LOCAL ] XYL: Deleted primary data file. [2025-10-02T22:29:38.799553] [INFO ] [MAIN ] XYL: Starting full primary refresh. [2025-10-02T22:29:39.214790] [INFO ] [REMOTE ] XYL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:29:39.473013] [INFO ] [REMOTE ] XYL: Fetching primary data for 2024-12. [2025-10-02T22:29:39.529932] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-02T22:29:39.548276] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-02T22:29:40.272995] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-03. [2025-10-02T22:29:41.072997] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-04. [2025-10-02T22:29:41.117313] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-02T22:29:41.445448] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-02T22:29:41.872996] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-01. [2025-10-02T22:29:42.255233] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-02T22:29:42.672990] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-05. [2025-10-02T22:29:43.473006] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-05. [2025-10-02T22:29:43.600682] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-02T22:29:43.834065] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-02T22:29:44.273013] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-06. [2025-10-02T22:29:45.018764] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-02T22:29:45.072994] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-06. [2025-10-02T22:29:45.602353] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-02T22:29:45.872996] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-02. [2025-10-02T22:29:46.327677] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-02T22:29:46.672984] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-04. [2025-10-02T22:29:47.472963] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-07. [2025-10-02T22:29:47.522042] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-02T22:29:47.912149] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-02T22:29:48.273042] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-07. [2025-10-02T22:29:48.614969] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-02T22:29:49.073054] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-05. [2025-10-02T22:29:49.868148] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-02T22:29:49.876594] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-08. [2025-10-02T22:29:49.965356] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-02T22:29:50.673015] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-06. [2025-10-02T22:29:51.180053] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-02T22:29:51.473028] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-09. [2025-10-02T22:29:52.087476] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-02T22:29:52.273052] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-07. [2025-10-02T22:29:52.982132] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-02T22:29:53.072999] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-08. [2025-10-02T22:29:53.598261] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-02T22:29:53.873034] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-03. [2025-10-02T22:29:54.595267] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-02T22:29:54.672997] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-10. [2025-10-02T22:29:55.472992] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-08. [2025-10-02T22:29:55.749375] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-02T22:29:55.892140] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-02T22:29:55.894979] [INFO ] [REMOTE ] XPRO: Full fetch complete (66448 records). [2025-10-02T22:29:55.895134] [DEBUG] [VALIDATOR ] XPRO: Validating primary data. [2025-10-02T22:29:56.278148] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-09. [2025-10-02T22:29:56.353630] [DEBUG] [VALIDATOR ] XPRO: All expected trading days are present. [2025-10-02T22:29:56.353749] [DEBUG] [VALIDATOR ] XPRO: Primary data validation passed. [2025-10-02T22:29:56.355042] [INFO ] [MAIN ] XPRO: Fetched primary data is valid. [2025-10-02T22:29:56.355109] [DEBUG] [LOCAL ] XPRO: Saving primary data. [2025-10-02T22:29:56.356471] [DEBUG] [LOCAL ] XPRO: Trimmed 66448 records to 46175 (keeping 200 days of data) [2025-10-02T22:29:56.648146] [DEBUG] [LOCAL ] XPRO: Primary data saved (46175 records). [2025-10-02T22:29:56.648281] [INFO ] [MAIN ] XPRO: Full history saved. [2025-10-02T22:29:56.648404] [INFO ] [MAIN ] Update Progress: 2341/2370 symbols completed. XPRO took 32.4s. Estimated remaining: 4m 5s. Rate: 7.1 symbols/min [2025-10-02T22:29:56.843002] [INFO ] [MAIN ] XYZ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:29:56.843275] [DEBUG] [LOCAL ] XYZ: No existing data file found in primary storage. [2025-10-02T22:29:56.843369] [WARN ] [MAIN ] XYZ: No existing data found, performing full refresh instead. [2025-10-02T22:29:56.843493] [INFO ] [MAIN ] XYZ: Wiping existing primary data before full refresh. [2025-10-02T22:29:56.843542] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-10-02T22:29:56.843598] [DEBUG] [LOCAL ] XYZ: No primary data file found to delete. [2025-10-02T22:29:56.843637] [INFO ] [MAIN ] XYZ: Starting full primary refresh. [2025-10-02T22:29:57.079242] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-04. [2025-10-02T22:29:57.275814] [INFO ] [REMOTE ] XYZ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:29:57.293192] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-02T22:29:57.719962] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-02T22:29:57.873017] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-09. [2025-10-02T22:29:58.644955] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-02T22:29:58.672968] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-05. [2025-10-02T22:29:58.963472] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-02T22:29:59.473042] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2024-12. [2025-10-02T22:29:59.682952] [DEBUG] [REMOTE ] XYZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T22:29:59.683282] [WARN ] [REMOTE ] XYZ: No data returned for month 2024-12 [2025-10-02T22:29:59.683377] [FATAL] [REMOTE ] XYZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T22:29:59.683442] [FATAL] [MAIN ] XYZ: Failed to fetch primary data. [2025-10-02T22:29:59.683523] [WARN ] [MAIN ] XYZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T22:29:59.683609] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-10-02T22:29:59.683729] [DEBUG] [LOCAL ] XYZ: No primary data file found to delete. [2025-10-02T22:29:59.683788] [INFO ] [LOCAL ] XYZ: Starting deletion of derivative data. [2025-10-02T22:29:59.683882] [DEBUG] [LOCAL ] XYZ: No derivative data file found to delete. [2025-10-02T22:29:59.683993] [INFO ] [MAIN ] Update Progress: 2342/2370 symbols completed. XYZ took 3.0s. Estimated remaining: 3m 57s. Rate: 7.1 symbols/min [2025-10-02T22:29:59.890742] [INFO ] [MAIN ] YALA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:29:59.927308] [DEBUG] [LOCAL ] YALA: Loaded 37194 existing records from primary storage. [2025-10-02T22:29:59.927624] [INFO ] [MAIN ] YALA: Loaded 37194 existing records. [2025-10-02T22:30:00.146402] [WARN ] [MAIN ] YALA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:30:00.146815] [INFO ] [MAIN ] YALA: Wiping existing primary data before full refresh. [2025-10-02T22:30:00.146977] [INFO ] [LOCAL ] YALA: Starting deletion of primary data. [2025-10-02T22:30:00.147268] [DEBUG] [LOCAL ] YALA: Deleted primary data file. [2025-10-02T22:30:00.147327] [INFO ] [MAIN ] YALA: Starting full primary refresh. [2025-10-02T22:30:00.278069] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-10. [2025-10-02T22:30:00.591454] [INFO ] [REMOTE ] YALA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:30:00.593637] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-02T22:30:01.073017] [INFO ] [REMOTE ] YALA: Fetching primary data for 2024-12. [2025-10-02T22:30:01.360697] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-02T22:30:01.363767] [INFO ] [REMOTE ] XPOF: Full fetch complete (52288 records). [2025-10-02T22:30:01.363978] [DEBUG] [VALIDATOR ] XPOF: Validating primary data. [2025-10-02T22:30:01.808521] [DEBUG] [VALIDATOR ] XPOF: All expected trading days are present. [2025-10-02T22:30:01.808616] [DEBUG] [VALIDATOR ] XPOF: Primary data validation passed. [2025-10-02T22:30:01.810019] [INFO ] [MAIN ] XPOF: Fetched primary data is valid. [2025-10-02T22:30:01.810115] [DEBUG] [LOCAL ] XPOF: Saving primary data. [2025-10-02T22:30:01.811496] [DEBUG] [LOCAL ] XPOF: Trimmed 52288 records to 38298 (keeping 200 days of data) [2025-10-02T22:30:01.876339] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-10. [2025-10-02T22:30:02.077163] [DEBUG] [LOCAL ] XPOF: Primary data saved (38298 records). [2025-10-02T22:30:02.077384] [INFO ] [MAIN ] XPOF: Full history saved. [2025-10-02T22:30:02.077555] [INFO ] [MAIN ] Update Progress: 2343/2370 symbols completed. XPOF took 43.8s. Estimated remaining: 3m 48s. Rate: 7.1 symbols/min [2025-10-02T22:30:02.280004] [INFO ] [MAIN ] YELP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:30:02.328813] [DEBUG] [LOCAL ] YELP: Loaded 45285 existing records from primary storage. [2025-10-02T22:30:02.329226] [INFO ] [MAIN ] YELP: Loaded 45285 existing records. [2025-10-02T22:30:02.546779] [WARN ] [MAIN ] YELP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:30:02.547079] [INFO ] [MAIN ] YELP: Wiping existing primary data before full refresh. [2025-10-02T22:30:02.547134] [INFO ] [LOCAL ] YELP: Starting deletion of primary data. [2025-10-02T22:30:02.547407] [DEBUG] [LOCAL ] YELP: Deleted primary data file. [2025-10-02T22:30:02.547471] [INFO ] [MAIN ] YELP: Starting full primary refresh. [2025-10-02T22:30:02.675774] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-06. [2025-10-02T22:30:02.838068] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-02T22:30:02.879477] [INFO ] [REMOTE ] XYF: Full fetch complete (32067 records). [2025-10-02T22:30:02.915372] [DEBUG] [VALIDATOR ] XYF: Validating primary data. [2025-10-02T22:30:02.918074] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-02T22:30:03.129515] [INFO ] [REMOTE ] YELP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:30:03.434733] [DEBUG] [VALIDATOR ] XYF: All expected trading days are present. [2025-10-02T22:30:03.434854] [DEBUG] [VALIDATOR ] XYF: Primary data validation passed. [2025-10-02T22:30:03.435619] [INFO ] [MAIN ] XYF: Fetched primary data is valid. [2025-10-02T22:30:03.435694] [DEBUG] [LOCAL ] XYF: Saving primary data. [2025-10-02T22:30:03.436577] [DEBUG] [LOCAL ] XYF: Trimmed 32067 records to 28667 (keeping 200 days of data) [2025-10-02T22:30:03.491867] [INFO ] [REMOTE ] YELP: Fetching primary data for 2024-12. [2025-10-02T22:30:03.629064] [DEBUG] [LOCAL ] XYF: Primary data saved (28667 records). [2025-10-02T22:30:03.629207] [INFO ] [MAIN ] XYF: Full history saved. [2025-10-02T22:30:03.629294] [INFO ] [MAIN ] Update Progress: 2344/2370 symbols completed. XYF took 30.8s. Estimated remaining: 3m 40s. Rate: 7.1 symbols/min [2025-10-02T22:30:03.827178] [INFO ] [MAIN ] YETI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:30:03.896074] [DEBUG] [LOCAL ] YETI: Loaded 52495 existing records from primary storage. [2025-10-02T22:30:03.896588] [INFO ] [MAIN ] YETI: Loaded 52495 existing records. [2025-10-02T22:30:04.150799] [WARN ] [MAIN ] YETI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:30:04.151017] [INFO ] [MAIN ] YETI: Wiping existing primary data before full refresh. [2025-10-02T22:30:04.151123] [INFO ] [LOCAL ] YETI: Starting deletion of primary data. [2025-10-02T22:30:04.151378] [DEBUG] [LOCAL ] YETI: Deleted primary data file. [2025-10-02T22:30:04.151437] [INFO ] [MAIN ] YETI: Starting full primary refresh. [2025-10-02T22:30:04.279196] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-01. [2025-10-02T22:30:04.574337] [INFO ] [REMOTE ] YETI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:30:04.603332] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-02T22:30:05.016524] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-02T22:30:05.053620] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-02T22:30:05.072957] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-01. [2025-10-02T22:30:05.872995] [INFO ] [REMOTE ] YETI: Fetching primary data for 2024-12. [2025-10-02T22:30:06.682952] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-02. [2025-10-02T22:30:06.688458] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-02T22:30:07.380060] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-02T22:30:07.473010] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-02. [2025-10-02T22:30:07.795171] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-02T22:30:08.273023] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-01. [2025-10-02T22:30:08.941638] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-02T22:30:09.073044] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-03. [2025-10-02T22:30:09.828980] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-02T22:30:09.872987] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-02. [2025-10-02T22:30:10.456503] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-02T22:30:10.673005] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-04. [2025-10-02T22:30:11.472994] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-07. [2025-10-02T22:30:11.582883] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-02T22:30:12.273096] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-03. [2025-10-02T22:30:12.457083] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-02T22:30:12.806047] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-02T22:30:13.073024] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-08. [2025-10-02T22:30:13.757076] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-02T22:30:13.873000] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-05. [2025-10-02T22:30:14.681300] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-03. [2025-10-02T22:30:14.708910] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-02T22:30:15.048026] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-02T22:30:15.473051] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-06. [2025-10-02T22:30:16.060526] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-02T22:30:16.273024] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-09. [2025-10-02T22:30:16.702783] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-02T22:30:17.073032] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-04. [2025-10-02T22:30:17.873045] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-07. [2025-10-02T22:30:17.940690] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-02T22:30:18.445788] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-02T22:30:18.673020] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-04. [2025-10-02T22:30:19.414877] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-02T22:30:19.473021] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-05. [2025-10-02T22:30:20.195635] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-02T22:30:20.273005] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-08. [2025-10-02T22:30:20.948506] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-02T22:30:21.073029] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-05. [2025-10-02T22:30:21.873053] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-10. [2025-10-02T22:30:21.945981] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-02T22:30:22.422534] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-02T22:30:22.673042] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-09. [2025-10-02T22:30:23.096873] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-02T22:30:23.101930] [INFO ] [REMOTE ] XYL: Full fetch complete (69786 records). [2025-10-02T22:30:23.102071] [DEBUG] [VALIDATOR ] XYL: Validating primary data. [2025-10-02T22:30:23.478175] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-06. [2025-10-02T22:30:23.542344] [DEBUG] [VALIDATOR ] XYL: All expected trading days are present. [2025-10-02T22:30:23.542458] [DEBUG] [VALIDATOR ] XYL: Primary data validation passed. [2025-10-02T22:30:23.543901] [INFO ] [MAIN ] XYL: Fetched primary data is valid. [2025-10-02T22:30:23.543971] [DEBUG] [LOCAL ] XYL: Saving primary data. [2025-10-02T22:30:23.545545] [DEBUG] [LOCAL ] XYL: Trimmed 69786 records to 48309 (keeping 200 days of data) [2025-10-02T22:30:23.884371] [DEBUG] [LOCAL ] XYL: Primary data saved (48309 records). [2025-10-02T22:30:23.884802] [INFO ] [MAIN ] XYL: Full history saved. [2025-10-02T22:30:23.885950] [INFO ] [MAIN ] Update Progress: 2345/2370 symbols completed. XYL took 45.5s. Estimated remaining: 3m 31s. Rate: 7.1 symbols/min [2025-10-02T22:30:24.109933] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-02T22:30:24.111693] [INFO ] [MAIN ] YEXT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:30:24.177311] [DEBUG] [LOCAL ] YEXT: Loaded 43075 existing records from primary storage. [2025-10-02T22:30:24.177625] [INFO ] [MAIN ] YEXT: Loaded 43075 existing records. [2025-10-02T22:30:24.278071] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-10. [2025-10-02T22:30:24.379896] [WARN ] [MAIN ] YEXT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:30:24.380122] [INFO ] [MAIN ] YEXT: Wiping existing primary data before full refresh. [2025-10-02T22:30:24.380175] [INFO ] [LOCAL ] YEXT: Starting deletion of primary data. [2025-10-02T22:30:24.380714] [DEBUG] [LOCAL ] YEXT: Deleted primary data file. [2025-10-02T22:30:24.380780] [INFO ] [MAIN ] YEXT: Starting full primary refresh. [2025-10-02T22:30:24.773021] [INFO ] [REMOTE ] YEXT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:30:25.072999] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-06. [2025-10-02T22:30:25.303868] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-02T22:30:25.366799] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-02T22:30:25.368740] [INFO ] [REMOTE ] YELP: Full fetch complete (64425 records). [2025-10-02T22:30:25.368844] [DEBUG] [VALIDATOR ] YELP: Validating primary data. [2025-10-02T22:30:25.839609] [DEBUG] [VALIDATOR ] YELP: All expected trading days are present. [2025-10-02T22:30:25.839779] [DEBUG] [VALIDATOR ] YELP: Primary data validation passed. [2025-10-02T22:30:25.841057] [INFO ] [MAIN ] YELP: Fetched primary data is valid. [2025-10-02T22:30:25.841125] [DEBUG] [LOCAL ] YELP: Saving primary data. [2025-10-02T22:30:25.842774] [DEBUG] [LOCAL ] YELP: Trimmed 64425 records to 45636 (keeping 200 days of data) [2025-10-02T22:30:25.894043] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2024-12. [2025-10-02T22:30:26.149050] [DEBUG] [LOCAL ] YELP: Primary data saved (45636 records). [2025-10-02T22:30:26.149199] [INFO ] [MAIN ] YELP: Full history saved. [2025-10-02T22:30:26.149287] [INFO ] [MAIN ] Update Progress: 2346/2370 symbols completed. YELP took 24.1s. Estimated remaining: 3m 23s. Rate: 7.1 symbols/min [2025-10-02T22:30:26.348199] [INFO ] [MAIN ] YMM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:30:26.404797] [DEBUG] [LOCAL ] YMM: Loaded 52637 existing records from primary storage. [2025-10-02T22:30:26.405286] [INFO ] [MAIN ] YMM: Loaded 52637 existing records. [2025-10-02T22:30:26.616801] [WARN ] [MAIN ] YMM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:30:26.617327] [INFO ] [MAIN ] YMM: Wiping existing primary data before full refresh. [2025-10-02T22:30:26.617394] [INFO ] [LOCAL ] YMM: Starting deletion of primary data. [2025-10-02T22:30:26.642582] [DEBUG] [LOCAL ] YMM: Deleted primary data file. [2025-10-02T22:30:26.644293] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-02T22:30:26.644473] [INFO ] [MAIN ] YMM: Starting full primary refresh. [2025-10-02T22:30:26.678154] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-07. [2025-10-02T22:30:27.087707] [INFO ] [REMOTE ] YMM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:30:27.314387] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-02T22:30:27.473001] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-01. [2025-10-02T22:30:28.260507] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-02T22:30:28.272867] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-08. [2025-10-02T22:30:28.900871] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-02T22:30:29.073030] [INFO ] [REMOTE ] YMM: Fetching primary data for 2024-12. [2025-10-02T22:30:29.777834] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-02T22:30:29.873075] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-02. [2025-10-02T22:30:30.673068] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-09. [2025-10-02T22:30:30.887594] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-02T22:30:30.926144] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-02T22:30:31.473038] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-03. [2025-10-02T22:30:32.273006] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-07. [2025-10-02T22:30:32.368427] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-02T22:30:33.078126] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-10. [2025-10-02T22:30:33.097510] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-02T22:30:33.637766] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-02T22:30:33.873064] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-04. [2025-10-02T22:30:34.403399] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-02T22:30:34.405978] [INFO ] [REMOTE ] YETI: Full fetch complete (75473 records). [2025-10-02T22:30:34.406139] [DEBUG] [VALIDATOR ] YETI: Validating primary data. [2025-10-02T22:30:34.682792] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-01. [2025-10-02T22:30:34.847119] [DEBUG] [VALIDATOR ] YETI: All expected trading days are present. [2025-10-02T22:30:34.847238] [DEBUG] [VALIDATOR ] YETI: Primary data validation passed. [2025-10-02T22:30:34.848718] [INFO ] [MAIN ] YETI: Fetched primary data is valid. [2025-10-02T22:30:34.848787] [DEBUG] [LOCAL ] YETI: Saving primary data. [2025-10-02T22:30:34.850632] [DEBUG] [LOCAL ] YETI: Trimmed 75473 records to 52866 (keeping 200 days of data) [2025-10-02T22:30:35.185425] [DEBUG] [LOCAL ] YETI: Primary data saved (52866 records). [2025-10-02T22:30:35.185574] [INFO ] [MAIN ] YETI: Full history saved. [2025-10-02T22:30:35.185678] [INFO ] [MAIN ] Update Progress: 2347/2370 symbols completed. YETI took 31.6s. Estimated remaining: 3m 14s. Rate: 7.1 symbols/min [2025-10-02T22:30:35.383356] [INFO ] [MAIN ] YOU: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:30:35.430288] [DEBUG] [LOCAL ] YOU: Loaded 49688 existing records from primary storage. [2025-10-02T22:30:35.430917] [INFO ] [MAIN ] YOU: Loaded 49688 existing records. [2025-10-02T22:30:35.478416] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-08. [2025-10-02T22:30:35.671277] [WARN ] [MAIN ] YOU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:30:35.673465] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-02T22:30:35.673737] [INFO ] [MAIN ] YOU: Wiping existing primary data before full refresh. [2025-10-02T22:30:35.683797] [INFO ] [LOCAL ] YOU: Starting deletion of primary data. [2025-10-02T22:30:35.684477] [DEBUG] [LOCAL ] YOU: Deleted primary data file. [2025-10-02T22:30:35.684541] [INFO ] [MAIN ] YOU: Starting full primary refresh. [2025-10-02T22:30:36.089882] [INFO ] [REMOTE ] YOU: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:30:36.273044] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-05. [2025-10-02T22:30:36.430818] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-02T22:30:36.960040] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-02T22:30:37.073002] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-09. [2025-10-02T22:30:37.399230] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-02T22:30:37.873004] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-06. [2025-10-02T22:30:38.375209] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-02T22:30:38.673046] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-10. [2025-10-02T22:30:39.289926] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-02T22:30:39.473001] [INFO ] [REMOTE ] YOU: Fetching primary data for 2024-12. [2025-10-02T22:30:39.500769] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-02T22:30:39.503612] [INFO ] [REMOTE ] YALA: Full fetch complete (46573 records). [2025-10-02T22:30:39.503769] [DEBUG] [VALIDATOR ] YALA: Validating primary data. [2025-10-02T22:30:39.930693] [DEBUG] [VALIDATOR ] YALA: All expected trading days are present. [2025-10-02T22:30:39.930791] [DEBUG] [VALIDATOR ] YALA: Primary data validation passed. [2025-10-02T22:30:39.931849] [INFO ] [MAIN ] YALA: Fetched primary data is valid. [2025-10-02T22:30:39.931914] [DEBUG] [LOCAL ] YALA: Saving primary data. [2025-10-02T22:30:39.933156] [DEBUG] [LOCAL ] YALA: Trimmed 46573 records to 37423 (keeping 200 days of data) [2025-10-02T22:30:40.157900] [DEBUG] [LOCAL ] YALA: Primary data saved (37423 records). [2025-10-02T22:30:40.158062] [INFO ] [MAIN ] YALA: Full history saved. [2025-10-02T22:30:40.158193] [INFO ] [MAIN ] Update Progress: 2348/2370 symbols completed. YALA took 40.5s. Estimated remaining: 3m 6s. Rate: 7.1 symbols/min [2025-10-02T22:30:40.274366] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-07. [2025-10-02T22:30:40.349893] [INFO ] [MAIN ] YPF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:30:40.402721] [DEBUG] [LOCAL ] YPF: Loaded 50501 existing records from primary storage. [2025-10-02T22:30:40.403080] [INFO ] [MAIN ] YPF: Loaded 50501 existing records. [2025-10-02T22:30:40.594705] [WARN ] [MAIN ] YPF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:30:40.594924] [INFO ] [MAIN ] YPF: Wiping existing primary data before full refresh. [2025-10-02T22:30:40.594972] [INFO ] [LOCAL ] YPF: Starting deletion of primary data. [2025-10-02T22:30:40.595266] [DEBUG] [LOCAL ] YPF: Deleted primary data file. [2025-10-02T22:30:40.595330] [INFO ] [MAIN ] YPF: Starting full primary refresh. [2025-10-02T22:30:41.009805] [INFO ] [REMOTE ] YPF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:30:41.073003] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-02. [2025-10-02T22:30:41.275274] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-02T22:30:41.390502] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-02T22:30:41.872999] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-01. [2025-10-02T22:30:42.672995] [INFO ] [REMOTE ] YPF: Fetching primary data for 2024-12. [2025-10-02T22:30:43.344806] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-10-02T22:30:43.473005] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-08. [2025-10-02T22:30:43.612050] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-02T22:30:44.141183] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-02T22:30:44.273006] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-02. [2025-10-02T22:30:45.072977] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-01. [2025-10-02T22:30:45.386931] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-02T22:30:45.534117] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-02T22:30:45.873025] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-09. [2025-10-02T22:30:46.672989] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-03. [2025-10-02T22:30:46.969863] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-02T22:30:47.030675] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-02T22:30:47.473006] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-10. [2025-10-02T22:30:48.273009] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-03. [2025-10-02T22:30:48.506145] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-02T22:30:48.682824] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-02T22:30:48.685025] [INFO ] [REMOTE ] YEXT: Full fetch complete (63250 records). [2025-10-02T22:30:48.685178] [DEBUG] [VALIDATOR ] YEXT: Validating primary data. [2025-10-02T22:30:49.078963] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-02. [2025-10-02T22:30:49.132076] [DEBUG] [VALIDATOR ] YEXT: All expected trading days are present. [2025-10-02T22:30:49.132222] [DEBUG] [VALIDATOR ] YEXT: Primary data validation passed. [2025-10-02T22:30:49.133473] [INFO ] [MAIN ] YEXT: Fetched primary data is valid. [2025-10-02T22:30:49.133543] [DEBUG] [LOCAL ] YEXT: Saving primary data. [2025-10-02T22:30:49.135109] [DEBUG] [LOCAL ] YEXT: Trimmed 63250 records to 43429 (keeping 200 days of data) [2025-10-02T22:30:49.406288] [DEBUG] [LOCAL ] YEXT: Primary data saved (43429 records). [2025-10-02T22:30:49.406433] [INFO ] [MAIN ] YEXT: Full history saved. [2025-10-02T22:30:49.407269] [INFO ] [MAIN ] Update Progress: 2349/2370 symbols completed. YEXT took 25.5s. Estimated remaining: 2m 57s. Rate: 7.1 symbols/min [2025-10-02T22:30:49.591926] [INFO ] [MAIN ] YRD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:30:49.608137] [DEBUG] [LOCAL ] YRD: Loaded 12607 existing records from primary storage. [2025-10-02T22:30:49.608382] [INFO ] [MAIN ] YRD: Loaded 12607 existing records. [2025-10-02T22:30:49.810925] [WARN ] [MAIN ] YRD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:30:49.811222] [INFO ] [MAIN ] YRD: Wiping existing primary data before full refresh. [2025-10-02T22:30:49.811279] [INFO ] [LOCAL ] YRD: Starting deletion of primary data. [2025-10-02T22:30:49.811488] [DEBUG] [LOCAL ] YRD: Deleted primary data file. [2025-10-02T22:30:49.811546] [INFO ] [MAIN ] YRD: Starting full primary refresh. [2025-10-02T22:30:49.879536] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-04. [2025-10-02T22:30:50.248598] [INFO ] [REMOTE ] YRD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:30:50.274431] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-02T22:30:50.672982] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-04. [2025-10-02T22:30:50.850230] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-02T22:30:51.472959] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-03. [2025-10-02T22:30:52.043270] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-02T22:30:52.273029] [INFO ] [REMOTE ] YRD: Fetching primary data for 2024-12. [2025-10-02T22:30:52.578382] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-02T22:30:52.855289] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-02T22:30:52.994493] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-02T22:30:53.073013] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-04. [2025-10-02T22:30:53.873013] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-01. [2025-10-02T22:30:54.672998] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-05. [2025-10-02T22:30:54.751877] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-02T22:30:54.975480] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-02T22:30:55.473007] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-02. [2025-10-02T22:30:56.272994] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-05. [2025-10-02T22:30:56.509880] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-02T22:30:56.510286] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-02T22:30:57.073040] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-06. [2025-10-02T22:30:57.873054] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-05. [2025-10-02T22:30:58.043120] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-02T22:30:58.672985] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-06. [2025-10-02T22:30:58.915986] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-02T22:30:59.472991] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-03. [2025-10-02T22:30:59.714091] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-02T22:31:00.274592] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-07. [2025-10-02T22:31:00.281116] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-02T22:31:00.640860] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-02T22:31:01.073063] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-04. [2025-10-02T22:31:01.873037] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-07. [2025-10-02T22:31:02.094738] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-02T22:31:02.143584] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-02T22:31:02.673011] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-05. [2025-10-02T22:31:03.310382] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-02T22:31:03.473021] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-06. [2025-10-02T22:31:03.768836] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-02T22:31:04.273049] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-08. [2025-10-02T22:31:04.971398] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-02T22:31:05.073000] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-07. [2025-10-02T22:31:05.678095] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-02T22:31:05.872983] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-09. [2025-10-02T22:31:06.672967] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-08. [2025-10-02T22:31:06.937207] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-02T22:31:07.473021] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-08. [2025-10-02T22:31:07.685291] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-02T22:31:08.273030] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-10. [2025-10-02T22:31:08.412440] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-02T22:31:08.952481] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-02T22:31:09.073049] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-09. [2025-10-02T22:31:09.325913] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-02T22:31:09.328081] [INFO ] [REMOTE ] YOU: Full fetch complete (72123 records). [2025-10-02T22:31:09.328216] [DEBUG] [VALIDATOR ] YOU: Validating primary data. [2025-10-02T22:31:09.776815] [DEBUG] [VALIDATOR ] YOU: All expected trading days are present. [2025-10-02T22:31:09.776927] [DEBUG] [VALIDATOR ] YOU: Primary data validation passed. [2025-10-02T22:31:09.778272] [INFO ] [MAIN ] YOU: Fetched primary data is valid. [2025-10-02T22:31:09.778370] [DEBUG] [LOCAL ] YOU: Saving primary data. [2025-10-02T22:31:09.780079] [DEBUG] [LOCAL ] YOU: Trimmed 72123 records to 50069 (keeping 200 days of data) [2025-10-02T22:31:09.874266] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-09. [2025-10-02T22:31:10.117020] [DEBUG] [LOCAL ] YOU: Primary data saved (50069 records). [2025-10-02T22:31:10.117170] [INFO ] [MAIN ] YOU: Full history saved. [2025-10-02T22:31:10.117260] [INFO ] [MAIN ] Update Progress: 2350/2370 symbols completed. YOU took 34.9s. Estimated remaining: 2m 49s. Rate: 7.1 symbols/min [2025-10-02T22:31:10.311692] [INFO ] [MAIN ] YSG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:31:10.337810] [DEBUG] [LOCAL ] YSG: Loaded 25415 existing records from primary storage. [2025-10-02T22:31:10.338105] [INFO ] [MAIN ] YSG: Loaded 25415 existing records. [2025-10-02T22:31:10.531927] [WARN ] [MAIN ] YSG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:31:10.532259] [INFO ] [MAIN ] YSG: Wiping existing primary data before full refresh. [2025-10-02T22:31:10.532425] [INFO ] [LOCAL ] YSG: Starting deletion of primary data. [2025-10-02T22:31:10.532731] [DEBUG] [LOCAL ] YSG: Deleted primary data file. [2025-10-02T22:31:10.532792] [INFO ] [MAIN ] YSG: Starting full primary refresh. [2025-10-02T22:31:10.675637] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-06. [2025-10-02T22:31:10.940639] [INFO ] [REMOTE ] YSG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:31:10.976507] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-02T22:31:11.472996] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-10. [2025-10-02T22:31:11.600915] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-02T22:31:11.635925] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-02T22:31:12.272997] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-07. [2025-10-02T22:31:12.873466] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-02T22:31:12.877144] [INFO ] [REMOTE ] YMM: Full fetch complete (76393 records). [2025-10-02T22:31:12.877383] [DEBUG] [VALIDATOR ] YMM: Validating primary data. [2025-10-02T22:31:13.078123] [INFO ] [REMOTE ] YSG: Fetching primary data for 2024-12. [2025-10-02T22:31:13.230856] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-02T22:31:13.392076] [DEBUG] [VALIDATOR ] YMM: All expected trading days are present. [2025-10-02T22:31:13.392175] [DEBUG] [VALIDATOR ] YMM: Primary data validation passed. [2025-10-02T22:31:13.393520] [INFO ] [MAIN ] YMM: Fetched primary data is valid. [2025-10-02T22:31:13.393600] [DEBUG] [LOCAL ] YMM: Saving primary data. [2025-10-02T22:31:13.395322] [DEBUG] [LOCAL ] YMM: Trimmed 76393 records to 53027 (keeping 200 days of data) [2025-10-02T22:31:13.755059] [DEBUG] [LOCAL ] YMM: Primary data saved (53027 records). [2025-10-02T22:31:13.755206] [INFO ] [MAIN ] YMM: Full history saved. [2025-10-02T22:31:13.755292] [INFO ] [MAIN ] Update Progress: 2351/2370 symbols completed. YMM took 47.6s. Estimated remaining: 2m 41s. Rate: 7.1 symbols/min [2025-10-02T22:31:13.881395] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-10. [2025-10-02T22:31:13.968129] [INFO ] [MAIN ] YUM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:31:14.025110] [DEBUG] [LOCAL ] YUM: Loaded 51188 existing records from primary storage. [2025-10-02T22:31:14.025494] [INFO ] [MAIN ] YUM: Loaded 51188 existing records. [2025-10-02T22:31:14.223446] [WARN ] [MAIN ] YUM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:31:14.223708] [INFO ] [MAIN ] YUM: Wiping existing primary data before full refresh. [2025-10-02T22:31:14.223769] [INFO ] [LOCAL ] YUM: Starting deletion of primary data. [2025-10-02T22:31:14.224038] [DEBUG] [LOCAL ] YUM: Deleted primary data file. [2025-10-02T22:31:14.224098] [INFO ] [MAIN ] YUM: Starting full primary refresh. [2025-10-02T22:31:14.559299] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-02T22:31:14.653394] [INFO ] [REMOTE ] YUM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:31:14.672986] [INFO ] [REMOTE ] YUM: Fetching primary data for 2024-12. [2025-10-02T22:31:15.339538] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-02T22:31:15.343030] [INFO ] [REMOTE ] YPF: Full fetch complete (73500 records). [2025-10-02T22:31:15.343188] [DEBUG] [VALIDATOR ] YPF: Validating primary data. [2025-10-02T22:31:15.478232] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-08. [2025-10-02T22:31:15.804546] [DEBUG] [VALIDATOR ] YPF: All expected trading days are present. [2025-10-02T22:31:15.804696] [DEBUG] [VALIDATOR ] YPF: Primary data validation passed. [2025-10-02T22:31:15.806291] [INFO ] [MAIN ] YPF: Fetched primary data is valid. [2025-10-02T22:31:15.806366] [DEBUG] [LOCAL ] YPF: Saving primary data. [2025-10-02T22:31:15.808068] [DEBUG] [LOCAL ] YPF: Trimmed 73500 records to 50883 (keeping 200 days of data) [2025-10-02T22:31:16.141220] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-02T22:31:16.152387] [DEBUG] [LOCAL ] YPF: Primary data saved (50883 records). [2025-10-02T22:31:16.152570] [INFO ] [MAIN ] YPF: Full history saved. [2025-10-02T22:31:16.153047] [INFO ] [MAIN ] Update Progress: 2352/2370 symbols completed. YPF took 36.0s. Estimated remaining: 2m 32s. Rate: 7.1 symbols/min [2025-10-02T22:31:16.279083] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-01. [2025-10-02T22:31:16.287076] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-02T22:31:16.405474] [INFO ] [MAIN ] YUMC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:31:16.460553] [DEBUG] [LOCAL ] YUMC: Loaded 52663 existing records from primary storage. [2025-10-02T22:31:16.461021] [INFO ] [MAIN ] YUMC: Loaded 52663 existing records. [2025-10-02T22:31:16.657786] [WARN ] [MAIN ] YUMC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:31:16.658093] [INFO ] [MAIN ] YUMC: Wiping existing primary data before full refresh. [2025-10-02T22:31:16.658160] [INFO ] [LOCAL ] YUMC: Starting deletion of primary data. [2025-10-02T22:31:16.658427] [DEBUG] [LOCAL ] YUMC: Deleted primary data file. [2025-10-02T22:31:16.658492] [INFO ] [MAIN ] YUMC: Starting full primary refresh. [2025-10-02T22:31:17.059263] [INFO ] [REMOTE ] YUMC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:31:17.072973] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-01. [2025-10-02T22:31:17.237484] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-02T22:31:17.873004] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-02. [2025-10-02T22:31:18.673007] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-09. [2025-10-02T22:31:18.719925] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-02T22:31:18.844890] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-02T22:31:19.473041] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-02. [2025-10-02T22:31:19.490750] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-02T22:31:20.273046] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-10. [2025-10-02T22:31:21.066707] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-02T22:31:21.067863] [INFO ] [REMOTE ] YRD: Full fetch complete (19047 records). [2025-10-02T22:31:21.067971] [DEBUG] [VALIDATOR ] YRD: Validating primary data. [2025-10-02T22:31:21.080665] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-03. [2025-10-02T22:31:21.359714] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-02T22:31:21.521371] [DEBUG] [VALIDATOR ] YRD: All expected trading days are present. [2025-10-02T22:31:21.521464] [DEBUG] [VALIDATOR ] YRD: Primary data validation passed. [2025-10-02T22:31:21.521881] [INFO ] [MAIN ] YRD: Fetched primary data is valid. [2025-10-02T22:31:21.521947] [DEBUG] [LOCAL ] YRD: Saving primary data. [2025-10-02T22:31:21.522777] [DEBUG] [LOCAL ] YRD: Trimmed 19047 records to 12702 (keeping 200 days of data) [2025-10-02T22:31:21.601171] [DEBUG] [LOCAL ] YRD: Primary data saved (12702 records). [2025-10-02T22:31:21.601312] [INFO ] [MAIN ] YRD: Full history saved. [2025-10-02T22:31:21.601412] [INFO ] [MAIN ] Update Progress: 2353/2370 symbols completed. YRD took 32.2s. Estimated remaining: 2m 24s. Rate: 7.1 symbols/min [2025-10-02T22:31:21.776328] [INFO ] [MAIN ] ZBH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:31:21.847783] [DEBUG] [LOCAL ] ZBH: Loaded 51086 existing records from primary storage. [2025-10-02T22:31:21.848149] [INFO ] [MAIN ] ZBH: Loaded 51086 existing records. [2025-10-02T22:31:21.879112] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-03. [2025-10-02T22:31:22.037858] [WARN ] [MAIN ] ZBH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:31:22.038150] [INFO ] [MAIN ] ZBH: Wiping existing primary data before full refresh. [2025-10-02T22:31:22.038203] [INFO ] [LOCAL ] ZBH: Starting deletion of primary data. [2025-10-02T22:31:22.038629] [DEBUG] [LOCAL ] ZBH: Deleted primary data file. [2025-10-02T22:31:22.038752] [INFO ] [MAIN ] ZBH: Starting full primary refresh. [2025-10-02T22:31:22.430749] [INFO ] [REMOTE ] ZBH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:31:22.574623] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-02T22:31:22.672989] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2024-12. [2025-10-02T22:31:23.472974] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2024-12. [2025-10-02T22:31:23.575686] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-02T22:31:24.272995] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-04. [2025-10-02T22:31:24.379085] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-02T22:31:25.073000] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-04. [2025-10-02T22:31:25.236769] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-02T22:31:25.795938] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-02T22:31:25.873038] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-01. [2025-10-02T22:31:26.067123] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-02T22:31:26.673004] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-05. [2025-10-02T22:31:27.472981] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-01. [2025-10-02T22:31:27.674026] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-02T22:31:28.273002] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-02. [2025-10-02T22:31:28.622313] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-02T22:31:29.073030] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-06. [2025-10-02T22:31:29.249184] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-02T22:31:29.873013] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-05. [2025-10-02T22:31:30.053320] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-02T22:31:30.672969] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-03. [2025-10-02T22:31:30.717056] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-02T22:31:30.741797] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-02T22:31:31.473025] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-02. [2025-10-02T22:31:32.273001] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-07. [2025-10-02T22:31:32.615173] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-02T22:31:33.072971] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-04. [2025-10-02T22:31:33.185496] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-02T22:31:33.872990] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-03. [2025-10-02T22:31:34.233504] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-02T22:31:34.672999] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-08. [2025-10-02T22:31:35.000677] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-02T22:31:35.478126] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-06. [2025-10-02T22:31:35.492145] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-02T22:31:36.125393] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-02T22:31:36.272998] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-09. [2025-10-02T22:31:36.822389] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-02T22:31:37.073018] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-05. [2025-10-02T22:31:37.872988] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-07. [2025-10-02T22:31:38.067150] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-02T22:31:38.673010] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-10. [2025-10-02T22:31:38.859751] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-02T22:31:39.328308] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-02T22:31:39.473065] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-08. [2025-10-02T22:31:39.845265] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-02T22:31:39.848735] [INFO ] [REMOTE ] YUM: Full fetch complete (74478 records). [2025-10-02T22:31:39.849019] [DEBUG] [VALIDATOR ] YUM: Validating primary data. [2025-10-02T22:31:40.274296] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-06. [2025-10-02T22:31:40.404886] [DEBUG] [VALIDATOR ] YUM: All expected trading days are present. [2025-10-02T22:31:40.405068] [DEBUG] [VALIDATOR ] YUM: Primary data validation passed. [2025-10-02T22:31:40.407015] [INFO ] [MAIN ] YUM: Fetched primary data is valid. [2025-10-02T22:31:40.407182] [DEBUG] [LOCAL ] YUM: Saving primary data. [2025-10-02T22:31:40.418061] [DEBUG] [LOCAL ] YUM: Trimmed 74478 records to 51575 (keeping 200 days of data) [2025-10-02T22:31:40.782510] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-02T22:31:40.810126] [DEBUG] [LOCAL ] YUM: Primary data saved (51575 records). [2025-10-02T22:31:40.810304] [INFO ] [MAIN ] YUM: Full history saved. [2025-10-02T22:31:40.810445] [INFO ] [MAIN ] Update Progress: 2354/2370 symbols completed. YUM took 27.1s. Estimated remaining: 2m 15s. Rate: 7.1 symbols/min [2025-10-02T22:31:41.001842] [INFO ] [MAIN ] ZEPP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:31:41.025980] [DEBUG] [LOCAL ] ZEPP: Loaded 17655 existing records from primary storage. [2025-10-02T22:31:41.026286] [INFO ] [MAIN ] ZEPP: Loaded 17655 existing records. [2025-10-02T22:31:41.078224] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-09. [2025-10-02T22:31:41.278143] [WARN ] [MAIN ] ZEPP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:31:41.278399] [INFO ] [MAIN ] ZEPP: Wiping existing primary data before full refresh. [2025-10-02T22:31:41.278449] [INFO ] [LOCAL ] ZEPP: Starting deletion of primary data. [2025-10-02T22:31:41.278678] [DEBUG] [LOCAL ] ZEPP: Deleted primary data file. [2025-10-02T22:31:41.278742] [INFO ] [MAIN ] ZEPP: Starting full primary refresh. [2025-10-02T22:31:41.672553] [INFO ] [REMOTE ] ZEPP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:31:41.772764] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-02T22:31:41.873018] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2024-12. [2025-10-02T22:31:41.984445] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-02T22:31:42.360849] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-10-02T22:31:42.673039] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-01. [2025-10-02T22:31:43.158879] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-02T22:31:43.473075] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-02. [2025-10-02T22:31:43.973879] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-02T22:31:44.273054] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-10. [2025-10-02T22:31:44.979620] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-02T22:31:44.981138] [INFO ] [REMOTE ] YSG: Full fetch complete (32551 records). [2025-10-02T22:31:44.981219] [DEBUG] [VALIDATOR ] YSG: Validating primary data. [2025-10-02T22:31:45.078207] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-04. [2025-10-02T22:31:45.405261] [DEBUG] [VALIDATOR ] YSG: All expected trading days are present. [2025-10-02T22:31:45.405368] [DEBUG] [VALIDATOR ] YSG: Primary data validation passed. [2025-10-02T22:31:45.406454] [INFO ] [MAIN ] YSG: Fetched primary data is valid. [2025-10-02T22:31:45.406539] [DEBUG] [LOCAL ] YSG: Saving primary data. [2025-10-02T22:31:45.407963] [DEBUG] [LOCAL ] YSG: Trimmed 32551 records to 25699 (keeping 200 days of data) [2025-10-02T22:31:45.579278] [DEBUG] [LOCAL ] YSG: Primary data saved (25699 records). [2025-10-02T22:31:45.579427] [INFO ] [MAIN ] YSG: Full history saved. [2025-10-02T22:31:45.579542] [INFO ] [MAIN ] Update Progress: 2355/2370 symbols completed. YSG took 35.5s. Estimated remaining: 2m 7s. Rate: 7.1 symbols/min [2025-10-02T22:31:45.761281] [INFO ] [MAIN ] ZETA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:31:45.819117] [DEBUG] [LOCAL ] ZETA: Loaded 53597 existing records from primary storage. [2025-10-02T22:31:45.819558] [INFO ] [MAIN ] ZETA: Loaded 53597 existing records. [2025-10-02T22:31:45.885989] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-07. [2025-10-02T22:31:46.012069] [WARN ] [MAIN ] ZETA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:31:46.012276] [INFO ] [MAIN ] ZETA: Wiping existing primary data before full refresh. [2025-10-02T22:31:46.012324] [INFO ] [LOCAL ] ZETA: Starting deletion of primary data. [2025-10-02T22:31:46.012560] [DEBUG] [LOCAL ] ZETA: Deleted primary data file. [2025-10-02T22:31:46.012628] [INFO ] [MAIN ] ZETA: Starting full primary refresh. [2025-10-02T22:31:46.389685] [INFO ] [REMOTE ] ZETA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:31:46.673005] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2024-12. [2025-10-02T22:31:47.017910] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-02T22:31:47.472998] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-05. [2025-10-02T22:31:47.768578] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-02T22:31:48.273060] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-03. [2025-10-02T22:31:48.863765] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-02T22:31:48.921537] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-10-02T22:31:49.073026] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-08. [2025-10-02T22:31:49.393707] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-02T22:31:49.873009] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-01. [2025-10-02T22:31:50.489837] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-02T22:31:50.673037] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-06. [2025-10-02T22:31:51.473003] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-04. [2025-10-02T22:31:51.896854] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-02T22:31:52.052961] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-02T22:31:52.142231] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-02T22:31:52.273005] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-09. [2025-10-02T22:31:53.073044] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-05. [2025-10-02T22:31:53.776492] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-02T22:31:53.873048] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-02. [2025-10-02T22:31:54.187047] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-02T22:31:54.673026] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-06. [2025-10-02T22:31:55.270289] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-02T22:31:55.473007] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-10. [2025-10-02T22:31:56.125875] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-10-02T22:31:56.273040] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-07. [2025-10-02T22:31:56.782824] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-02T22:31:56.784997] [INFO ] [REMOTE ] YUMC: Full fetch complete (76177 records). [2025-10-02T22:31:56.785134] [DEBUG] [VALIDATOR ] YUMC: Validating primary data. [2025-10-02T22:31:57.078193] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-03. [2025-10-02T22:31:57.221037] [DEBUG] [VALIDATOR ] YUMC: All expected trading days are present. [2025-10-02T22:31:57.221131] [DEBUG] [VALIDATOR ] YUMC: Primary data validation passed. [2025-10-02T22:31:57.222425] [INFO ] [MAIN ] YUMC: Fetched primary data is valid. [2025-10-02T22:31:57.222511] [DEBUG] [LOCAL ] YUMC: Saving primary data. [2025-10-02T22:31:57.224142] [DEBUG] [LOCAL ] YUMC: Trimmed 76177 records to 53032 (keeping 200 days of data) [2025-10-02T22:31:57.635029] [DEBUG] [LOCAL ] YUMC: Primary data saved (53032 records). [2025-10-02T22:31:57.635242] [INFO ] [MAIN ] YUMC: Full history saved. [2025-10-02T22:31:57.635421] [INFO ] [MAIN ] Update Progress: 2356/2370 symbols completed. YUMC took 41.5s. Estimated remaining: 1m 58s. Rate: 7.1 symbols/min [2025-10-02T22:31:57.842401] [INFO ] [MAIN ] ZGN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:31:57.880613] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-07. [2025-10-02T22:31:57.884930] [DEBUG] [LOCAL ] ZGN: Loaded 40685 existing records from primary storage. [2025-10-02T22:31:57.885409] [INFO ] [MAIN ] ZGN: Loaded 40685 existing records. [2025-10-02T22:31:58.091334] [WARN ] [MAIN ] ZGN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:31:58.091735] [INFO ] [MAIN ] ZGN: Wiping existing primary data before full refresh. [2025-10-02T22:31:58.091813] [INFO ] [LOCAL ] ZGN: Starting deletion of primary data. [2025-10-02T22:31:58.092325] [DEBUG] [LOCAL ] ZGN: Deleted primary data file. [2025-10-02T22:31:58.092450] [INFO ] [MAIN ] ZGN: Starting full primary refresh. [2025-10-02T22:31:58.267244] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-02T22:31:58.563265] [INFO ] [REMOTE ] ZGN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:31:58.673140] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2024-12. [2025-10-02T22:31:58.945300] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-02T22:31:59.473051] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-08. [2025-10-02T22:31:59.500325] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-02T22:31:59.838568] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-02T22:32:00.273018] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-04. [2025-10-02T22:32:01.073054] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-08. [2025-10-02T22:32:01.385554] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-02T22:32:01.873012] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-09. [2025-10-02T22:32:02.322682] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-02T22:32:02.519271] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-02T22:32:02.673015] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-05. [2025-10-02T22:32:03.472969] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-09. [2025-10-02T22:32:03.739512] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-02T22:32:04.273006] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-10. [2025-10-02T22:32:04.570272] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-02T22:32:05.017146] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-02T22:32:05.073020] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-01. [2025-10-02T22:32:05.522001] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-02T22:32:05.524071] [INFO ] [REMOTE ] ZBH: Full fetch complete (73860 records). [2025-10-02T22:32:05.524176] [DEBUG] [VALIDATOR ] ZBH: Validating primary data. [2025-10-02T22:32:05.880521] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-10. [2025-10-02T22:32:05.951743] [DEBUG] [VALIDATOR ] ZBH: All expected trading days are present. [2025-10-02T22:32:05.951856] [DEBUG] [VALIDATOR ] ZBH: Primary data validation passed. [2025-10-02T22:32:05.953677] [INFO ] [MAIN ] ZBH: Fetched primary data is valid. [2025-10-02T22:32:05.953745] [DEBUG] [LOCAL ] ZBH: Saving primary data. [2025-10-02T22:32:05.955437] [DEBUG] [LOCAL ] ZBH: Trimmed 73860 records to 51404 (keeping 200 days of data) [2025-10-02T22:32:06.319378] [DEBUG] [LOCAL ] ZBH: Primary data saved (51404 records). [2025-10-02T22:32:06.319547] [INFO ] [MAIN ] ZBH: Full history saved. [2025-10-02T22:32:06.320719] [INFO ] [MAIN ] Update Progress: 2357/2370 symbols completed. ZBH took 44.7s. Estimated remaining: 1m 50s. Rate: 7.1 symbols/min [2025-10-02T22:32:06.344207] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-02T22:32:06.673008] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-02. [2025-10-02T22:32:06.981747] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-02T22:32:06.982905] [INFO ] [REMOTE ] ZEPP: Full fetch complete (19160 records). [2025-10-02T22:32:06.983002] [DEBUG] [VALIDATOR ] ZEPP: Validating primary data. [2025-10-02T22:32:07.424186] [DEBUG] [VALIDATOR ] ZEPP: All expected trading days are present. [2025-10-02T22:32:07.424270] [DEBUG] [VALIDATOR ] ZEPP: Primary data validation passed. [2025-10-02T22:32:07.424769] [INFO ] [MAIN ] ZEPP: Fetched primary data is valid. [2025-10-02T22:32:07.424833] [DEBUG] [LOCAL ] ZEPP: Saving primary data. [2025-10-02T22:32:07.425447] [DEBUG] [LOCAL ] ZEPP: Trimmed 19160 records to 17773 (keeping 200 days of data) [2025-10-02T22:32:07.473041] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-06. [2025-10-02T22:32:07.544818] [DEBUG] [LOCAL ] ZEPP: Primary data saved (17773 records). [2025-10-02T22:32:07.545037] [INFO ] [MAIN ] ZEPP: Full history saved. [2025-10-02T22:32:07.545138] [INFO ] [MAIN ] Update Progress: 2358/2370 symbols completed. ZEPP took 26.7s. Estimated remaining: 1m 41s. Rate: 7.1 symbols/min [2025-10-02T22:32:07.836199] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-02T22:32:08.272994] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-03. [2025-10-02T22:32:09.459285] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-02T22:32:09.471231] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-07. [2025-10-02T22:32:09.864071] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-02T22:32:09.873852] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-04. [2025-10-02T22:32:11.510550] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-02T22:32:11.521056] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-05. [2025-10-02T22:32:11.620623] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-02T22:32:11.634587] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-08. [2025-10-02T22:32:12.945065] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-02T22:32:12.955521] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-06. [2025-10-02T22:32:14.094383] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-10-02T22:32:14.106586] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-09. [2025-10-02T22:32:14.507030] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-02T22:32:14.516421] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-07. [2025-10-02T22:32:15.771668] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-02T22:32:15.782370] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-08. [2025-10-02T22:32:16.569347] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-10-02T22:32:16.581632] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-10. [2025-10-02T22:32:17.348967] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-02T22:32:17.361955] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-09. [2025-10-02T22:32:18.550453] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-02T22:32:18.552704] [INFO ] [REMOTE ] ZETA: Full fetch complete (77679 records). [2025-10-02T22:32:18.552914] [DEBUG] [VALIDATOR ] ZETA: Validating primary data. [2025-10-02T22:32:19.034046] [DEBUG] [VALIDATOR ] ZETA: All expected trading days are present. [2025-10-02T22:32:19.035587] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-02T22:32:19.035748] [DEBUG] [VALIDATOR ] ZETA: Primary data validation passed. [2025-10-02T22:32:19.046135] [INFO ] [MAIN ] ZETA: Fetched primary data is valid. [2025-10-02T22:32:19.046387] [DEBUG] [LOCAL ] ZETA: Saving primary data. [2025-10-02T22:32:19.048100] [DEBUG] [LOCAL ] ZETA: Trimmed 77679 records to 53987 (keeping 200 days of data) [2025-10-02T22:32:19.049001] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-10. [2025-10-02T22:32:19.402949] [DEBUG] [LOCAL ] ZETA: Primary data saved (53987 records). [2025-10-02T22:32:19.403194] [INFO ] [MAIN ] ZETA: Full history saved. [2025-10-02T22:32:19.403320] [INFO ] [MAIN ] Update Progress: 2359/2370 symbols completed. ZETA took 33.8s. Estimated remaining: 1m 33s. Rate: 7.1 symbols/min [2025-10-02T22:32:20.236279] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-02T22:32:20.238382] [INFO ] [REMOTE ] ZGN: Full fetch complete (58246 records). [2025-10-02T22:32:20.238538] [DEBUG] [VALIDATOR ] ZGN: Validating primary data. [2025-10-02T22:32:20.686301] [DEBUG] [VALIDATOR ] ZGN: All expected trading days are present. [2025-10-02T22:32:20.686396] [DEBUG] [VALIDATOR ] ZGN: Primary data validation passed. [2025-10-02T22:32:20.687605] [INFO ] [MAIN ] ZGN: Fetched primary data is valid. [2025-10-02T22:32:20.687751] [DEBUG] [LOCAL ] ZGN: Saving primary data. [2025-10-02T22:32:20.690330] [DEBUG] [LOCAL ] ZGN: Trimmed 58246 records to 41016 (keeping 200 days of data) [2025-10-02T22:32:20.948613] [DEBUG] [LOCAL ] ZGN: Primary data saved (41016 records). [2025-10-02T22:32:20.948769] [INFO ] [MAIN ] ZGN: Full history saved. [2025-10-02T22:32:20.948879] [INFO ] [MAIN ] Update Progress: 2360/2370 symbols completed. ZGN took 23.3s. Estimated remaining: 1m 24s. Rate: 7.1 symbols/min [2025-10-02T22:32:21.697255] [INFO ] [MAIN ] ZK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:32:21.734742] [INFO ] [MAIN ] ZH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:32:21.776914] [INFO ] [MAIN ] ZIP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:32:21.783204] [INFO ] [MAIN ] ZIM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:32:21.784776] [DEBUG] [LOCAL ] ZIM: No existing data file found in primary storage. [2025-10-02T22:32:21.784845] [WARN ] [MAIN ] ZIM: No existing data found, performing full refresh instead. [2025-10-02T22:32:21.784964] [INFO ] [MAIN ] ZIM: Wiping existing primary data before full refresh. [2025-10-02T22:32:21.785009] [INFO ] [LOCAL ] ZIM: Starting deletion of primary data. [2025-10-02T22:32:21.785055] [DEBUG] [LOCAL ] ZIM: No primary data file found to delete. [2025-10-02T22:32:21.785098] [INFO ] [MAIN ] ZIM: Starting full primary refresh. [2025-10-02T22:32:22.006134] [DEBUG] [LOCAL ] ZH: Loaded 26456 existing records from primary storage. [2025-10-02T22:32:22.019241] [INFO ] [MAIN ] ZH: Loaded 26456 existing records. [2025-10-02T22:32:22.200226] [DEBUG] [LOCAL ] ZK: Loaded 39609 existing records from primary storage. [2025-10-02T22:32:22.247048] [INFO ] [MAIN ] ZK: Loaded 39609 existing records. [2025-10-02T22:32:22.393779] [DEBUG] [LOCAL ] ZIP: Loaded 44097 existing records from primary storage. [2025-10-02T22:32:22.527589] [INFO ] [MAIN ] ZIP: Loaded 44097 existing records. [2025-10-02T22:32:22.591596] [WARN ] [MAIN ] ZH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:32:22.656353] [INFO ] [REMOTE ] ZIM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:32:22.661609] [INFO ] [MAIN ] ZH: Wiping existing primary data before full refresh. [2025-10-02T22:32:22.703519] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2024-12. [2025-10-02T22:32:22.703631] [INFO ] [LOCAL ] ZH: Starting deletion of primary data. [2025-10-02T22:32:22.781862] [DEBUG] [LOCAL ] ZH: Deleted primary data file. [2025-10-02T22:32:22.786360] [WARN ] [MAIN ] ZK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:32:22.802310] [INFO ] [MAIN ] ZH: Starting full primary refresh. [2025-10-02T22:32:22.802539] [INFO ] [MAIN ] ZK: Wiping existing primary data before full refresh. [2025-10-02T22:32:22.842734] [INFO ] [LOCAL ] ZK: Starting deletion of primary data. [2025-10-02T22:32:22.921954] [DEBUG] [LOCAL ] ZK: Deleted primary data file. [2025-10-02T22:32:22.963172] [INFO ] [MAIN ] ZK: Starting full primary refresh. [2025-10-02T22:32:23.040342] [WARN ] [MAIN ] ZIP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:32:23.068973] [INFO ] [MAIN ] ZIP: Wiping existing primary data before full refresh. [2025-10-02T22:32:23.089139] [INFO ] [LOCAL ] ZIP: Starting deletion of primary data. [2025-10-02T22:32:23.118797] [DEBUG] [LOCAL ] ZIP: Deleted primary data file. [2025-10-02T22:32:23.192724] [INFO ] [MAIN ] ZIP: Starting full primary refresh. [2025-10-02T22:32:23.926874] [INFO ] [REMOTE ] ZH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:32:23.950778] [INFO ] [REMOTE ] ZH: Fetching primary data for 2024-12. [2025-10-02T22:32:24.105491] [INFO ] [REMOTE ] ZK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:32:24.123580] [INFO ] [REMOTE ] ZK: Fetching primary data for 2024-12. [2025-10-02T22:32:24.220747] [INFO ] [REMOTE ] ZIP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:32:24.221169] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2024-12. [2025-10-02T22:32:24.968916] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-02T22:32:24.974824] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-01. [2025-10-02T22:32:25.078237] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2024-12 (2.37 seconds). [2025-10-02T22:32:25.089759] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-01. [2025-10-02T22:32:25.227985] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-02T22:32:25.235260] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-01. [2025-10-02T22:32:25.446378] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-02T22:32:25.455947] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-01. [2025-10-02T22:32:25.666272] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-02T22:32:25.671099] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-02. [2025-10-02T22:32:26.101294] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-02T22:32:26.108277] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-02. [2025-10-02T22:32:26.778816] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-02T22:32:26.787254] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-02. [2025-10-02T22:32:26.879787] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-02T22:32:26.889565] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-03. [2025-10-02T22:32:26.973673] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-02T22:32:27.473015] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-02. [2025-10-02T22:32:27.497171] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-02T22:32:27.995928] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-02T22:32:28.273011] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-03. [2025-10-02T22:32:28.398034] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-02T22:32:29.072999] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-03. [2025-10-02T22:32:29.429822] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-02T22:32:29.873056] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-03. [2025-10-02T22:32:29.969681] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-02T22:32:30.624262] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-02T22:32:30.672969] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-04. [2025-10-02T22:32:31.473057] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-04. [2025-10-02T22:32:32.087123] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-02T22:32:32.170931] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-10-02T22:32:32.273015] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-05. [2025-10-02T22:32:33.081389] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-04. [2025-10-02T22:32:33.104065] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-02T22:32:33.291869] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-02T22:32:33.873048] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-05. [2025-10-02T22:32:34.678101] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-04. [2025-10-02T22:32:34.695279] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-02T22:32:35.473012] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-06. [2025-10-02T22:32:35.630014] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-02T22:32:36.273003] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-06. [2025-10-02T22:32:36.558031] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-02T22:32:36.740480] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-02T22:32:37.073012] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-07. [2025-10-02T22:32:37.704850] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-02T22:32:37.872995] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-05. [2025-10-02T22:32:38.391151] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-02T22:32:38.673004] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-05. [2025-10-02T22:32:39.448082] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-02T22:32:39.472975] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-06. [2025-10-02T22:32:40.273028] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-07. [2025-10-02T22:32:40.777536] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-02T22:32:40.968956] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-02T22:32:41.073023] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-07. [2025-10-02T22:32:41.612933] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-02T22:32:41.873018] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-08. [2025-10-02T22:32:42.587320] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-02T22:32:42.673045] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-08. [2025-10-02T22:32:42.946588] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-02T22:32:43.473041] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-08. [2025-10-02T22:32:44.215208] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-02T22:32:44.272963] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-09. [2025-10-02T22:32:44.979387] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-02T22:32:45.073000] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-09. [2025-10-02T22:32:45.823450] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-02T22:32:45.873015] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-10. [2025-10-02T22:32:46.591691] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-02T22:32:46.672975] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-06. [2025-10-02T22:32:46.929973] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-02T22:32:46.931797] [INFO ] [REMOTE ] ZIP: Full fetch complete (59714 records). [2025-10-02T22:32:46.931893] [DEBUG] [VALIDATOR ] ZIP: Validating primary data. [2025-10-02T22:32:47.339452] [DEBUG] [VALIDATOR ] ZIP: All expected trading days are present. [2025-10-02T22:32:47.339543] [DEBUG] [VALIDATOR ] ZIP: Primary data validation passed. [2025-10-02T22:32:47.340712] [INFO ] [MAIN ] ZIP: Fetched primary data is valid. [2025-10-02T22:32:47.340785] [DEBUG] [LOCAL ] ZIP: Saving primary data. [2025-10-02T22:32:47.342162] [DEBUG] [LOCAL ] ZIP: Trimmed 59714 records to 44430 (keeping 200 days of data) [2025-10-02T22:32:47.513152] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-09. [2025-10-02T22:32:47.615265] [DEBUG] [LOCAL ] ZIP: Primary data saved (44430 records). [2025-10-02T22:32:47.615416] [INFO ] [MAIN ] ZIP: Full history saved. [2025-10-02T22:32:47.615519] [INFO ] [MAIN ] Update Progress: 2361/2370 symbols completed. ZIP took 26.7s. Estimated remaining: 1m 16s. Rate: 7.1 symbols/min [2025-10-02T22:32:47.807563] [INFO ] [MAIN ] ZKH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:32:47.818199] [DEBUG] [LOCAL ] ZKH: Loaded 7814 existing records from primary storage. [2025-10-02T22:32:47.818442] [INFO ] [MAIN ] ZKH: Loaded 7814 existing records. [2025-10-02T22:32:48.011607] [WARN ] [MAIN ] ZKH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:32:48.011890] [INFO ] [MAIN ] ZKH: Wiping existing primary data before full refresh. [2025-10-02T22:32:48.011963] [INFO ] [LOCAL ] ZKH: Starting deletion of primary data. [2025-10-02T22:32:48.012255] [DEBUG] [LOCAL ] ZKH: Deleted primary data file. [2025-10-02T22:32:48.012316] [INFO ] [MAIN ] ZKH: Starting full primary refresh. [2025-10-02T22:32:48.279919] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-10. [2025-10-02T22:32:48.400453] [INFO ] [REMOTE ] ZKH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:32:48.849793] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-02T22:32:48.936033] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-10-02T22:32:49.072998] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-07. [2025-10-02T22:32:49.488416] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-02T22:32:49.490232] [INFO ] [REMOTE ] ZK: Full fetch complete (56999 records). [2025-10-02T22:32:49.490363] [DEBUG] [VALIDATOR ] ZK: Validating primary data. [2025-10-02T22:32:49.878077] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-10. [2025-10-02T22:32:49.924979] [DEBUG] [VALIDATOR ] ZK: All expected trading days are present. [2025-10-02T22:32:49.925067] [DEBUG] [VALIDATOR ] ZK: Primary data validation passed. [2025-10-02T22:32:49.926331] [INFO ] [MAIN ] ZK: Fetched primary data is valid. [2025-10-02T22:32:49.926406] [DEBUG] [LOCAL ] ZK: Saving primary data. [2025-10-02T22:32:49.927780] [DEBUG] [LOCAL ] ZK: Trimmed 56999 records to 39862 (keeping 200 days of data) [2025-10-02T22:32:50.180576] [DEBUG] [LOCAL ] ZK: Primary data saved (39862 records). [2025-10-02T22:32:50.180751] [INFO ] [MAIN ] ZK: Full history saved. [2025-10-02T22:32:50.180863] [INFO ] [MAIN ] Update Progress: 2362/2370 symbols completed. ZK took 29.2s. Estimated remaining: 1m 8s. Rate: 7.1 symbols/min [2025-10-02T22:32:50.370006] [INFO ] [MAIN ] ZTO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:32:50.423308] [DEBUG] [LOCAL ] ZTO: Loaded 49877 existing records from primary storage. [2025-10-02T22:32:50.423687] [INFO ] [MAIN ] ZTO: Loaded 49877 existing records. [2025-10-02T22:32:50.622429] [WARN ] [MAIN ] ZTO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:32:50.622714] [INFO ] [MAIN ] ZTO: Wiping existing primary data before full refresh. [2025-10-02T22:32:50.622772] [INFO ] [LOCAL ] ZTO: Starting deletion of primary data. [2025-10-02T22:32:50.623036] [DEBUG] [LOCAL ] ZTO: Deleted primary data file. [2025-10-02T22:32:50.623095] [INFO ] [MAIN ] ZTO: Starting full primary refresh. [2025-10-02T22:32:50.682544] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2024-12. [2025-10-02T22:32:51.025789] [INFO ] [REMOTE ] ZTO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:32:51.044669] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-02T22:32:51.046175] [INFO ] [REMOTE ] ZH: Full fetch complete (40137 records). [2025-10-02T22:32:51.046272] [DEBUG] [VALIDATOR ] ZH: Validating primary data. [2025-10-02T22:32:51.477946] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2024-12. [2025-10-02T22:32:51.483722] [DEBUG] [VALIDATOR ] ZH: All expected trading days are present. [2025-10-02T22:32:51.485068] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-02T22:32:51.484752] [DEBUG] [VALIDATOR ] ZH: Primary data validation passed. [2025-10-02T22:32:51.490017] [INFO ] [MAIN ] ZH: Fetched primary data is valid. [2025-10-02T22:32:51.490145] [DEBUG] [LOCAL ] ZH: Saving primary data. [2025-10-02T22:32:51.492206] [DEBUG] [LOCAL ] ZH: Trimmed 40137 records to 26565 (keeping 200 days of data) [2025-10-02T22:32:51.615859] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-10-02T22:32:51.707355] [DEBUG] [LOCAL ] ZH: Primary data saved (26565 records). [2025-10-02T22:32:51.707530] [INFO ] [MAIN ] ZH: Full history saved. [2025-10-02T22:32:51.707680] [INFO ] [MAIN ] Update Progress: 2363/2370 symbols completed. ZH took 30.8s. Estimated remaining: 59.2s. Rate: 7.1 symbols/min [2025-10-02T22:32:51.911300] [INFO ] [MAIN ] ZTR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:32:51.930763] [DEBUG] [LOCAL ] ZTR: Loaded 16679 existing records from primary storage. [2025-10-02T22:32:51.931066] [INFO ] [MAIN ] ZTR: Loaded 16679 existing records. [2025-10-02T22:32:52.162057] [WARN ] [MAIN ] ZTR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:32:52.162322] [INFO ] [MAIN ] ZTR: Wiping existing primary data before full refresh. [2025-10-02T22:32:52.162417] [INFO ] [LOCAL ] ZTR: Starting deletion of primary data. [2025-10-02T22:32:52.162635] [DEBUG] [LOCAL ] ZTR: Deleted primary data file. [2025-10-02T22:32:52.162745] [INFO ] [MAIN ] ZTR: Starting full primary refresh. [2025-10-02T22:32:52.278173] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-01. [2025-10-02T22:32:52.610705] [INFO ] [REMOTE ] ZTR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:32:53.041984] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-02T22:32:53.072984] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-02. [2025-10-02T22:32:53.246919] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-02T22:32:53.873041] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2024-12. [2025-10-02T22:32:53.890258] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-02T22:32:54.673041] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-03. [2025-10-02T22:32:54.876265] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-02T22:32:55.473008] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-01. [2025-10-02T22:32:55.511599] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-02T22:32:56.273006] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-01. [2025-10-02T22:32:57.073028] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-04. [2025-10-02T22:32:57.155096] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-02T22:32:57.631917] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-02T22:32:57.691303] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-02T22:32:57.872987] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-02. [2025-10-02T22:32:58.673008] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-02. [2025-10-02T22:32:58.789896] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-02T22:32:59.473072] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-05. [2025-10-02T22:33:00.206792] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-02T22:33:00.273137] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-03. [2025-10-02T22:33:00.279086] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-02T22:33:01.073006] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-03. [2025-10-02T22:33:01.125420] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-02T22:33:01.873058] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-04. [2025-10-02T22:33:02.673002] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-06. [2025-10-02T22:33:02.922976] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-02T22:33:02.936553] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-02T22:33:03.248989] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-02T22:33:03.473002] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-05. [2025-10-02T22:33:04.273038] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-04. [2025-10-02T22:33:04.389605] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-02T22:33:05.073065] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-07. [2025-10-02T22:33:05.873022] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-06. [2025-10-02T22:33:05.981229] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-02T22:33:06.056819] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-02T22:33:06.673044] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-08. [2025-10-02T22:33:06.815207] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-02T22:33:07.473008] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-07. [2025-10-02T22:33:08.273026] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-05. [2025-10-02T22:33:08.623875] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-02T22:33:08.764415] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-02T22:33:09.073042] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-09. [2025-10-02T22:33:09.772698] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-02T22:33:09.873017] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-08. [2025-10-02T22:33:10.514814] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-02T22:33:10.672970] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-06. [2025-10-02T22:33:11.224782] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-02T22:33:11.473040] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-09. [2025-10-02T22:33:12.200086] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-02T22:33:12.272997] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-10. [2025-10-02T22:33:12.315583] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-02T22:33:12.778123] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-02T22:33:12.778936] [INFO ] [REMOTE ] ZKH: Full fetch complete (11867 records). [2025-10-02T22:33:12.779011] [DEBUG] [VALIDATOR ] ZKH: Validating primary data. [2025-10-02T22:33:13.078083] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-07. [2025-10-02T22:33:13.197335] [DEBUG] [VALIDATOR ] ZKH: All expected trading days are present. [2025-10-02T22:33:13.197418] [DEBUG] [VALIDATOR ] ZKH: Primary data validation passed. [2025-10-02T22:33:13.197870] [INFO ] [MAIN ] ZKH: Fetched primary data is valid. [2025-10-02T22:33:13.197980] [DEBUG] [LOCAL ] ZKH: Saving primary data. [2025-10-02T22:33:13.198534] [DEBUG] [LOCAL ] ZKH: Trimmed 11867 records to 7854 (keeping 200 days of data) [2025-10-02T22:33:13.243600] [DEBUG] [LOCAL ] ZKH: Primary data saved (7854 records). [2025-10-02T22:33:13.243768] [INFO ] [MAIN ] ZKH: Full history saved. [2025-10-02T22:33:13.243861] [INFO ] [MAIN ] Update Progress: 2364/2370 symbols completed. ZKH took 25.6s. Estimated remaining: 50.7s. Rate: 7.1 symbols/min [2025-10-02T22:33:13.448745] [INFO ] [MAIN ] ZTS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:33:13.505205] [DEBUG] [LOCAL ] ZTS: Loaded 52994 existing records from primary storage. [2025-10-02T22:33:13.505562] [INFO ] [MAIN ] ZTS: Loaded 52994 existing records. [2025-10-02T22:33:13.721679] [WARN ] [MAIN ] ZTS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:33:13.721964] [INFO ] [MAIN ] ZTS: Wiping existing primary data before full refresh. [2025-10-02T22:33:13.722020] [INFO ] [LOCAL ] ZTS: Starting deletion of primary data. [2025-10-02T22:33:13.722363] [DEBUG] [LOCAL ] ZTS: Deleted primary data file. [2025-10-02T22:33:13.722424] [INFO ] [MAIN ] ZTS: Starting full primary refresh. [2025-10-02T22:33:13.878170] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-10. [2025-10-02T22:33:14.139573] [INFO ] [REMOTE ] ZTS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:33:14.672998] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-08. [2025-10-02T22:33:14.939980] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-02T22:33:15.473017] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-08. [2025-10-02T22:33:15.686930] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-02T22:33:15.739816] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-02T22:33:15.742044] [INFO ] [REMOTE ] ZIM: Full fetch complete (77495 records). [2025-10-02T22:33:15.742159] [DEBUG] [VALIDATOR ] ZIM: Validating primary data. [2025-10-02T22:33:16.197778] [DEBUG] [VALIDATOR ] ZIM: All expected trading days are present. [2025-10-02T22:33:16.197917] [DEBUG] [VALIDATOR ] ZIM: Primary data validation passed. [2025-10-02T22:33:16.199298] [INFO ] [MAIN ] ZIM: Fetched primary data is valid. [2025-10-02T22:33:16.199368] [DEBUG] [LOCAL ] ZIM: Saving primary data. [2025-10-02T22:33:16.201135] [DEBUG] [LOCAL ] ZIM: Trimmed 77495 records to 53904 (keeping 200 days of data) [2025-10-02T22:33:16.292096] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-09. [2025-10-02T22:33:16.563507] [DEBUG] [LOCAL ] ZIM: Primary data saved (53904 records). [2025-10-02T22:33:16.563685] [INFO ] [MAIN ] ZIM: Full history saved. [2025-10-02T22:33:16.563780] [INFO ] [MAIN ] Update Progress: 2365/2370 symbols completed. ZIM took 55.6s. Estimated remaining: 42.3s. Rate: 7.1 symbols/min [2025-10-02T22:33:16.754364] [INFO ] [MAIN ] ZVIA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:33:16.789759] [DEBUG] [LOCAL ] ZVIA: Loaded 35420 existing records from primary storage. [2025-10-02T22:33:16.790163] [INFO ] [MAIN ] ZVIA: Loaded 35420 existing records. [2025-10-02T22:33:16.990117] [WARN ] [MAIN ] ZVIA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:33:16.990539] [INFO ] [MAIN ] ZVIA: Wiping existing primary data before full refresh. [2025-10-02T22:33:16.990597] [INFO ] [LOCAL ] ZVIA: Starting deletion of primary data. [2025-10-02T22:33:16.990860] [DEBUG] [LOCAL ] ZVIA: Deleted primary data file. [2025-10-02T22:33:16.990981] [INFO ] [MAIN ] ZVIA: Starting full primary refresh. [2025-10-02T22:33:17.077631] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2024-12. [2025-10-02T22:33:17.365720] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-02T22:33:17.403438] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-02T22:33:17.501962] [INFO ] [REMOTE ] ZVIA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:33:17.873049] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-09. [2025-10-02T22:33:18.673048] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-10. [2025-10-02T22:33:18.940260] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-02T22:33:19.206370] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-02T22:33:19.208084] [INFO ] [REMOTE ] ZTR: Full fetch complete (26950 records). [2025-10-02T22:33:19.208211] [DEBUG] [VALIDATOR ] ZTR: Validating primary data. [2025-10-02T22:33:19.478742] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2024-12. [2025-10-02T22:33:19.634857] [DEBUG] [VALIDATOR ] ZTR: All expected trading days are present. [2025-10-02T22:33:19.634983] [DEBUG] [VALIDATOR ] ZTR: Primary data validation passed. [2025-10-02T22:33:19.635808] [INFO ] [MAIN ] ZTR: Fetched primary data is valid. [2025-10-02T22:33:19.635919] [DEBUG] [LOCAL ] ZTR: Saving primary data. [2025-10-02T22:33:19.666264] [DEBUG] [LOCAL ] ZTR: Trimmed 26950 records to 16811 (keeping 200 days of data) [2025-10-02T22:33:19.668634] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-02T22:33:19.785774] [DEBUG] [LOCAL ] ZTR: Primary data saved (16811 records). [2025-10-02T22:33:19.785934] [INFO ] [MAIN ] ZTR: Full history saved. [2025-10-02T22:33:19.786019] [INFO ] [MAIN ] Update Progress: 2366/2370 symbols completed. ZTR took 28.1s. Estimated remaining: 33.8s. Rate: 7.1 symbols/min [2025-10-02T22:33:19.971704] [INFO ] [MAIN ] ZWS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T22:33:20.021692] [DEBUG] [LOCAL ] ZWS: Loaded 42295 existing records from primary storage. [2025-10-02T22:33:20.022016] [INFO ] [MAIN ] ZWS: Loaded 42295 existing records. [2025-10-02T22:33:20.220403] [WARN ] [MAIN ] ZWS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T22:33:20.220663] [INFO ] [MAIN ] ZWS: Wiping existing primary data before full refresh. [2025-10-02T22:33:20.220726] [INFO ] [LOCAL ] ZWS: Starting deletion of primary data. [2025-10-02T22:33:20.220970] [DEBUG] [LOCAL ] ZWS: Deleted primary data file. [2025-10-02T22:33:20.221031] [INFO ] [MAIN ] ZWS: Starting full primary refresh. [2025-10-02T22:33:20.281620] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-10. [2025-10-02T22:33:20.631515] [INFO ] [REMOTE ] ZWS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T22:33:21.022490] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-02T22:33:21.072972] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2024-12. [2025-10-02T22:33:21.595267] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-02T22:33:21.597226] [INFO ] [REMOTE ] ZTO: Full fetch complete (72995 records). [2025-10-02T22:33:21.597348] [DEBUG] [VALIDATOR ] ZTO: Validating primary data. [2025-10-02T22:33:21.878092] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-01. [2025-10-02T22:33:22.045692] [DEBUG] [VALIDATOR ] ZTO: All expected trading days are present. [2025-10-02T22:33:22.045780] [DEBUG] [VALIDATOR ] ZTO: Primary data validation passed. [2025-10-02T22:33:22.047083] [INFO ] [MAIN ] ZTO: Fetched primary data is valid. [2025-10-02T22:33:22.047227] [DEBUG] [LOCAL ] ZTO: Saving primary data. [2025-10-02T22:33:22.049223] [DEBUG] [LOCAL ] ZTO: Trimmed 72995 records to 50213 (keeping 200 days of data) [2025-10-02T22:33:22.386788] [DEBUG] [LOCAL ] ZTO: Primary data saved (50213 records). [2025-10-02T22:33:22.386933] [INFO ] [MAIN ] ZTO: Full history saved. [2025-10-02T22:33:22.387032] [INFO ] [MAIN ] Update Progress: 2367/2370 symbols completed. ZTO took 32.2s. Estimated remaining: 25.3s. Rate: 7.1 symbols/min [2025-10-02T22:33:22.663358] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-02T22:33:22.672916] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-01. [2025-10-02T22:33:23.473018] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-01. [2025-10-02T22:33:23.794681] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-02T22:33:23.925342] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-02T22:33:24.273071] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-02. [2025-10-02T22:33:25.073080] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-02. [2025-10-02T22:33:25.125882] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-02T22:33:25.776626] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-02T22:33:25.873007] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-03. [2025-10-02T22:33:26.673014] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-02. [2025-10-02T22:33:26.947496] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-02T22:33:27.473006] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-03. [2025-10-02T22:33:27.633864] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-02T22:33:28.083500] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-02T22:33:28.273053] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-04. [2025-10-02T22:33:29.073008] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-03. [2025-10-02T22:33:29.344159] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-02T22:33:29.872998] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-04. [2025-10-02T22:33:30.015116] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-02T22:33:30.162790] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-02T22:33:30.673031] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-05. [2025-10-02T22:33:31.423129] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-02T22:33:31.473013] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-05. [2025-10-02T22:33:32.136990] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-02T22:33:32.273044] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-04. [2025-10-02T22:33:33.076006] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-06. [2025-10-02T22:33:33.081998] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-02T22:33:33.512546] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-02T22:33:33.872997] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-06. [2025-10-02T22:33:34.461332] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-02T22:33:34.672997] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-07. [2025-10-02T22:33:35.472977] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-05. [2025-10-02T22:33:35.686236] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-02T22:33:36.278072] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-07. [2025-10-02T22:33:36.293956] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-02T22:33:36.726904] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-02T22:33:37.073055] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-08. [2025-10-02T22:33:37.873052] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-06. [2025-10-02T22:33:38.428731] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-02T22:33:38.673093] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-08. [2025-10-02T22:33:38.720196] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-02T22:33:39.410232] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-02T22:33:39.472991] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-07. [2025-10-02T22:33:40.273010] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-09. [2025-10-02T22:33:40.558201] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-02T22:33:40.899673] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-02T22:33:41.073049] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-09. [2025-10-02T22:33:41.875496] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-08. [2025-10-02T22:33:41.878078] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-02T22:33:42.673012] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-10. [2025-10-02T22:33:42.994273] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-02T22:33:43.429760] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-02T22:33:43.472978] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-09. [2025-10-02T22:33:43.895858] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-02T22:33:43.898452] [INFO ] [REMOTE ] ZWS: Full fetch complete (62002 records). [2025-10-02T22:33:43.898597] [DEBUG] [VALIDATOR ] ZWS: Validating primary data. [2025-10-02T22:33:44.285043] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-10. [2025-10-02T22:33:44.345585] [DEBUG] [VALIDATOR ] ZWS: All expected trading days are present. [2025-10-02T22:33:44.345706] [DEBUG] [VALIDATOR ] ZWS: Primary data validation passed. [2025-10-02T22:33:44.346975] [INFO ] [MAIN ] ZWS: Fetched primary data is valid. [2025-10-02T22:33:44.347042] [DEBUG] [LOCAL ] ZWS: Saving primary data. [2025-10-02T22:33:44.348456] [DEBUG] [LOCAL ] ZWS: Trimmed 62002 records to 42597 (keeping 200 days of data) [2025-10-02T22:33:44.637316] [DEBUG] [LOCAL ] ZWS: Primary data saved (42597 records). [2025-10-02T22:33:44.637448] [INFO ] [MAIN ] ZWS: Full history saved. [2025-10-02T22:33:44.638416] [INFO ] [MAIN ] Update Progress: 2368/2370 symbols completed. ZWS took 24.9s. Estimated remaining: 16.9s. Rate: 7.1 symbols/min [2025-10-02T22:33:45.754275] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-02T22:33:45.763085] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-10. [2025-10-02T22:33:45.948047] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-02T22:33:45.950252] [INFO ] [REMOTE ] ZTS: Full fetch complete (76705 records). [2025-10-02T22:33:45.950389] [DEBUG] [VALIDATOR ] ZTS: Validating primary data. [2025-10-02T22:33:46.390969] [DEBUG] [VALIDATOR ] ZTS: All expected trading days are present. [2025-10-02T22:33:46.391069] [DEBUG] [VALIDATOR ] ZTS: Primary data validation passed. [2025-10-02T22:33:46.392426] [INFO ] [MAIN ] ZTS: Fetched primary data is valid. [2025-10-02T22:33:46.392500] [DEBUG] [LOCAL ] ZTS: Saving primary data. [2025-10-02T22:33:46.394333] [DEBUG] [LOCAL ] ZTS: Trimmed 76705 records to 53383 (keeping 200 days of data) [2025-10-02T22:33:46.751749] [DEBUG] [LOCAL ] ZTS: Primary data saved (53383 records). [2025-10-02T22:33:46.751900] [INFO ] [MAIN ] ZTS: Full history saved. [2025-10-02T22:33:46.752044] [INFO ] [MAIN ] Update Progress: 2369/2370 symbols completed. ZTS took 33.5s. Estimated remaining: 8.5s. Rate: 7.1 symbols/min [2025-10-02T22:33:47.018985] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-02T22:33:47.020801] [INFO ] [REMOTE ] ZVIA: Full fetch complete (52654 records). [2025-10-02T22:33:47.020913] [DEBUG] [VALIDATOR ] ZVIA: Validating primary data. [2025-10-02T22:33:47.455211] [DEBUG] [VALIDATOR ] ZVIA: All expected trading days are present. [2025-10-02T22:33:47.455315] [DEBUG] [VALIDATOR ] ZVIA: Primary data validation passed. [2025-10-02T22:33:47.456546] [INFO ] [MAIN ] ZVIA: Fetched primary data is valid. [2025-10-02T22:33:47.456613] [DEBUG] [LOCAL ] ZVIA: Saving primary data. [2025-10-02T22:33:47.457859] [DEBUG] [LOCAL ] ZVIA: Trimmed 52654 records to 35700 (keeping 200 days of data) [2025-10-02T22:33:47.676306] [DEBUG] [LOCAL ] ZVIA: Primary data saved (35700 records). [2025-10-02T22:33:47.676461] [INFO ] [MAIN ] ZVIA: Full history saved. [2025-10-02T22:33:47.676563] [INFO ] [MAIN ] Update Progress: 2370/2370 symbols completed. ZVIA took 31.1s. Estimated remaining: 0.0s. Rate: 7.1 symbols/min [2025-10-02T22:33:47.678073] [INFO ] [MAIN ] Parallel update completed in 5h 33m 44s [2025-10-02T22:33:47.678296] [WARN ] [MAIN ] Failed symbols (395): AAMI, AAM, AAUC, ABM, ACEL, AD, ADC, AEXA, AGI, AHL... [2025-10-02T22:33:47.678388] [INFO ] [MAIN ] Update success rate: 83.3% (1975/2370 symbols) [2025-10-02T22:33:48.247325] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Primary Update Completed (1975/2370 @ 83.33%)' [2025-10-02T22:33:48.247824] [INFO ] [MAIN ] Primary update successful. Now generating derivatives... [2025-10-02T22:33:48.247950] [INFO ] [MAIN ] Refreshing symbols list before derivative generation... [2025-10-02T22:33:48.248002] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-10-02T22:33:48.248098] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-10-02T22:33:48.248161] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-10-02T22:33:49.132135] [DEBUG] [SYMBOL ] Found 2422 valid NYSE symbols. [2025-10-02T22:33:49.132295] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-10-02T22:33:49.132532] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-10-02T22:33:49.134310] [INFO ] [LOCAL ] Symbols cache updated with 2370 symbols. [2025-10-02T22:33:49.134372] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-10-02T22:33:49.134406] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-10-02T22:33:49.134491] [INFO ] [MAIN ] Pruning stale symbols... [2025-10-02T22:33:49.134559] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-10-02T22:33:49.134600] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-02T22:33:49.135034] [DEBUG] [LOCAL ] Found 2370 symbols in cached list. [2025-10-02T22:33:49.135086] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-02T22:33:49.135267] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-10-02T22:33:49.135301] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2370 valid symbols. [2025-10-02T22:33:49.135332] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-10-02T22:33:49.135362] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-10-02T22:33:49.162511] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-10-02T22:33:49.181949] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-10-02T22:33:49.182033] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-10-02T22:33:49.182068] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-10-02T22:33:49.182099] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-10-02T22:33:49.182155] [INFO ] [MAIN ] Running derivative generation in parallel mode [2025-10-02T22:33:49.182208] [INFO ] [MAIN ] Wiping all existing derivative data before regeneration. [2025-10-02T22:33:49.182246] [INFO ] [LOCAL ] Starting deletion of all local derivative data. [2025-10-02T22:33:49.183349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMC.csv [2025-10-02T22:33:49.183553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FF.csv [2025-10-02T22:33:49.183773] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTN.csv [2025-10-02T22:33:49.183978] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBR.csv [2025-10-02T22:33:49.184170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTI.csv [2025-10-02T22:33:49.184403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TX.csv [2025-10-02T22:33:49.184555] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTZ.csv [2025-10-02T22:33:49.184807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ERO.csv [2025-10-02T22:33:49.184993] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGD.csv [2025-10-02T22:33:49.185158] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMWL.csv [2025-10-02T22:33:49.185319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDST.csv [2025-10-02T22:33:49.185518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEN.csv [2025-10-02T22:33:49.185700] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGO.csv [2025-10-02T22:33:49.185861] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DXYZ.csv [2025-10-02T22:33:49.185995] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMX.csv [2025-10-02T22:33:49.186231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHE.csv [2025-10-02T22:33:49.186413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RZC.csv [2025-10-02T22:33:49.186570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SII.csv [2025-10-02T22:33:49.186767] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNK.csv [2025-10-02T22:33:49.186912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADM.csv [2025-10-02T22:33:49.187104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIN.csv [2025-10-02T22:33:49.187287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TREX.csv [2025-10-02T22:33:49.187440] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKM.csv [2025-10-02T22:33:49.187572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SITC.csv [2025-10-02T22:33:49.187726] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLGN.csv [2025-10-02T22:33:49.187950] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVN.csv [2025-10-02T22:33:49.188116] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGI.csv [2025-10-02T22:33:49.188272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CEPU.csv [2025-10-02T22:33:49.188421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMPX.csv [2025-10-02T22:33:49.188568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AAT.csv [2025-10-02T22:33:49.188781] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEN.csv [2025-10-02T22:33:49.188959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMS.csv [2025-10-02T22:33:49.189130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSV.csv [2025-10-02T22:33:49.189276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNNE.csv [2025-10-02T22:33:49.189453] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVX.csv [2025-10-02T22:33:49.189611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLNK.csv [2025-10-02T22:33:49.189850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINV.csv [2025-10-02T22:33:49.189978] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/S.csv [2025-10-02T22:33:49.190147] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSS.csv [2025-10-02T22:33:49.190319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JELD.csv [2025-10-02T22:33:49.190516] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JKS.csv [2025-10-02T22:33:49.190719] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAT.csv [2025-10-02T22:33:49.190877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNB.csv [2025-10-02T22:33:49.191003] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTE.csv [2025-10-02T22:33:49.191153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPI.csv [2025-10-02T22:33:49.191329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAZ.csv [2025-10-02T22:33:49.191482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YPF.csv [2025-10-02T22:33:49.191606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTL.csv [2025-10-02T22:33:49.191771] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UFI.csv [2025-10-02T22:33:49.191930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFC.csv [2025-10-02T22:33:49.192069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTHY.csv [2025-10-02T22:33:49.192259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPHR.csv [2025-10-02T22:33:49.192424] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCV.csv [2025-10-02T22:33:49.192603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BP.csv [2025-10-02T22:33:49.192751] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRC.csv [2025-10-02T22:33:49.192927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BB.csv [2025-10-02T22:33:49.193060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDOT.csv [2025-10-02T22:33:49.193221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FVR.csv [2025-10-02T22:33:49.193459] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALL.csv [2025-10-02T22:33:49.193622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVB.csv [2025-10-02T22:33:49.193772] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMR.csv [2025-10-02T22:33:49.193896] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVH.csv [2025-10-02T22:33:49.194052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLCO.csv [2025-10-02T22:33:49.194223] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WY.csv [2025-10-02T22:33:49.194392] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BR.csv [2025-10-02T22:33:49.194549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGLS.csv [2025-10-02T22:33:49.194714] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TD.csv [2025-10-02T22:33:49.194889] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMU.csv [2025-10-02T22:33:49.195062] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XYL.csv [2025-10-02T22:33:49.195231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUMN.csv [2025-10-02T22:33:49.195350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIX.csv [2025-10-02T22:33:49.195473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGR.csv [2025-10-02T22:33:49.195629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHF.csv [2025-10-02T22:33:49.195771] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBX.csv [2025-10-02T22:33:49.195949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENO.csv [2025-10-02T22:33:49.196114] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPB.csv [2025-10-02T22:33:49.196287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTY.csv [2025-10-02T22:33:49.196417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPG.csv [2025-10-02T22:33:49.196582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUZ.csv [2025-10-02T22:33:49.196900] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRX.csv [2025-10-02T22:33:49.197042] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPI.csv [2025-10-02T22:33:49.197188] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNQ.csv [2025-10-02T22:33:49.197324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIT.csv [2025-10-02T22:33:49.197471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTRG.csv [2025-10-02T22:33:49.197617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGP.csv [2025-10-02T22:33:49.197798] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPOR.csv [2025-10-02T22:33:49.197997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRH.csv [2025-10-02T22:33:49.198145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCPT.csv [2025-10-02T22:33:49.198302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TOL.csv [2025-10-02T22:33:49.198442] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYB.csv [2025-10-02T22:33:49.198590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNF.csv [2025-10-02T22:33:49.198764] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOR.csv [2025-10-02T22:33:49.198896] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IMAX.csv [2025-10-02T22:33:49.199026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIZN.csv [2025-10-02T22:33:49.199188] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WS.csv [2025-10-02T22:33:49.199354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAL.csv [2025-10-02T22:33:49.199520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLR.csv [2025-10-02T22:33:49.199680] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BK.csv [2025-10-02T22:33:49.199823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIM.csv [2025-10-02T22:33:49.199987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCN.csv [2025-10-02T22:33:49.200135] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLO.csv [2025-10-02T22:33:49.200275] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOV.csv [2025-10-02T22:33:49.200416] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPR.csv [2025-10-02T22:33:49.200550] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTL.csv [2025-10-02T22:33:49.200706] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KWR.csv [2025-10-02T22:33:49.200825] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWNB.csv [2025-10-02T22:33:49.200958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAN.csv [2025-10-02T22:33:49.201108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAPL.csv [2025-10-02T22:33:49.201238] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USB.csv [2025-10-02T22:33:49.201377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMY.csv [2025-10-02T22:33:49.201506] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLO.csv [2025-10-02T22:33:49.201705] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCS.csv [2025-10-02T22:33:49.201874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YSG.csv [2025-10-02T22:33:49.202004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSL.csv [2025-10-02T22:33:49.202148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFG.csv [2025-10-02T22:33:49.202267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIVI.csv [2025-10-02T22:33:49.202407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNT.csv [2025-10-02T22:33:49.202525] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KIM.csv [2025-10-02T22:33:49.202701] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAI.csv [2025-10-02T22:33:49.202886] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TMO.csv [2025-10-02T22:33:49.203019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTH.csv [2025-10-02T22:33:49.203175] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRO.csv [2025-10-02T22:33:49.203305] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARDT.csv [2025-10-02T22:33:49.203434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNG.csv [2025-10-02T22:33:49.203547] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXU.csv [2025-10-02T22:33:49.203722] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRGP.csv [2025-10-02T22:33:49.203859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMEZ.csv [2025-10-02T22:33:49.203965] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHAL.csv [2025-10-02T22:33:49.204102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOB.csv [2025-10-02T22:33:49.204215] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPER.csv [2025-10-02T22:33:49.204327] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPH.csv [2025-10-02T22:33:49.204458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WST.csv [2025-10-02T22:33:49.204593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPK.csv [2025-10-02T22:33:49.204836] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GL.csv [2025-10-02T22:33:49.205025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRS.csv [2025-10-02T22:33:49.205164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FR.csv [2025-10-02T22:33:49.205290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTR.csv [2025-10-02T22:33:49.205415] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MD.csv [2025-10-02T22:33:49.205534] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FHI.csv [2025-10-02T22:33:49.205703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRG.csv [2025-10-02T22:33:49.205849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHW.csv [2025-10-02T22:33:49.205982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACM.csv [2025-10-02T22:33:49.206128] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEE.csv [2025-10-02T22:33:49.206248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTR.csv [2025-10-02T22:33:49.206390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFA.csv [2025-10-02T22:33:49.206521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNV.csv [2025-10-02T22:33:49.206635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBZ.csv [2025-10-02T22:33:49.206809] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPMC.csv [2025-10-02T22:33:49.206945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIO.csv [2025-10-02T22:33:49.207068] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWA.csv [2025-10-02T22:33:49.207206] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRI.csv [2025-10-02T22:33:49.207343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNY.csv [2025-10-02T22:33:49.207482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGG.csv [2025-10-02T22:33:49.207593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GUT.csv [2025-10-02T22:33:49.207780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSD.csv [2025-10-02T22:33:49.207892] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHC.csv [2025-10-02T22:33:49.208006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLB.csv [2025-10-02T22:33:49.208130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNED.csv [2025-10-02T22:33:49.208245] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWLP.csv [2025-10-02T22:33:49.208385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNA.csv [2025-10-02T22:33:49.208522] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFG.csv [2025-10-02T22:33:49.208684] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXNM.csv [2025-10-02T22:33:49.208803] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ULS.csv [2025-10-02T22:33:49.208935] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFS.csv [2025-10-02T22:33:49.209065] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSD.csv [2025-10-02T22:33:49.209186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSG.csv [2025-10-02T22:33:49.209318] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYL.csv [2025-10-02T22:33:49.209492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIMB.csv [2025-10-02T22:33:49.209662] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EE.csv [2025-10-02T22:33:49.209805] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPS.csv [2025-10-02T22:33:49.209932] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRK.csv [2025-10-02T22:33:49.210043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIZ.csv [2025-10-02T22:33:49.210176] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAC.csv [2025-10-02T22:33:49.210323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLNG.csv [2025-10-02T22:33:49.210421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRD.csv [2025-10-02T22:33:49.210500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABEV.csv [2025-10-02T22:33:49.210669] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAC.csv [2025-10-02T22:33:49.210801] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SF.csv [2025-10-02T22:33:49.210961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMI.csv [2025-10-02T22:33:49.211108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FHN.csv [2025-10-02T22:33:49.211233] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYAN.csv [2025-10-02T22:33:49.211382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMBT.csv [2025-10-02T22:33:49.211520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VICI.csv [2025-10-02T22:33:49.211674] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACI.csv [2025-10-02T22:33:49.211802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHG.csv [2025-10-02T22:33:49.211940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDN.csv [2025-10-02T22:33:49.212077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AX.csv [2025-10-02T22:33:49.212199] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPC.csv [2025-10-02T22:33:49.212318] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRX.csv [2025-10-02T22:33:49.212442] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRC.csv [2025-10-02T22:33:49.212568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHE.csv [2025-10-02T22:33:49.212910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBER.csv [2025-10-02T22:33:49.213053] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEO.csv [2025-10-02T22:33:49.213202] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEI.csv [2025-10-02T22:33:49.213364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RXO.csv [2025-10-02T22:33:49.213477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AJG.csv [2025-10-02T22:33:49.213627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTN.csv [2025-10-02T22:33:49.213770] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFB.csv [2025-10-02T22:33:49.213904] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFLY.csv [2025-10-02T22:33:49.214018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBU.csv [2025-10-02T22:33:49.214132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHY.csv [2025-10-02T22:33:49.214250] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BH.csv [2025-10-02T22:33:49.214403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITGR.csv [2025-10-02T22:33:49.214521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRV.csv [2025-10-02T22:33:49.214637] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOR.csv [2025-10-02T22:33:49.214773] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWT.csv [2025-10-02T22:33:49.214895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFZ.csv [2025-10-02T22:33:49.215018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TLK.csv [2025-10-02T22:33:49.215155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WD.csv [2025-10-02T22:33:49.215277] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BVN.csv [2025-10-02T22:33:49.215411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEAV.csv [2025-10-02T22:33:49.215538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHN.csv [2025-10-02T22:33:49.215685] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WK.csv [2025-10-02T22:33:49.215799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSL.csv [2025-10-02T22:33:49.215934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLY.csv [2025-10-02T22:33:49.216048] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGF.csv [2025-10-02T22:33:49.216194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEL.csv [2025-10-02T22:33:49.216306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRBK.csv [2025-10-02T22:33:49.216424] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOLV.csv [2025-10-02T22:33:49.216545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIXT.csv [2025-10-02T22:33:49.216684] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOG.csv [2025-10-02T22:33:49.216793] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LRN.csv [2025-10-02T22:33:49.216903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGA.csv [2025-10-02T22:33:49.217043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXC.csv [2025-10-02T22:33:49.217164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHI.csv [2025-10-02T22:33:49.217284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEG.csv [2025-10-02T22:33:49.217413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMT.csv [2025-10-02T22:33:49.217589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LC.csv [2025-10-02T22:33:49.217751] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ES.csv [2025-10-02T22:33:49.217864] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BARK.csv [2025-10-02T22:33:49.218023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHG.csv [2025-10-02T22:33:49.218142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XHR.csv [2025-10-02T22:33:49.218268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TROX.csv [2025-10-02T22:33:49.218383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNW.csv [2025-10-02T22:33:49.218498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDV.csv [2025-10-02T22:33:49.218604] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BILL.csv [2025-10-02T22:33:49.218736] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRBY.csv [2025-10-02T22:33:49.218870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STC.csv [2025-10-02T22:33:49.219013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IQI.csv [2025-10-02T22:33:49.219170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCI.csv [2025-10-02T22:33:49.219303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCX.csv [2025-10-02T22:33:49.219435] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOC.csv [2025-10-02T22:33:49.219582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATGE.csv [2025-10-02T22:33:49.219714] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALUR.csv [2025-10-02T22:33:49.219854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CEE.csv [2025-10-02T22:33:49.220029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIMN.csv [2025-10-02T22:33:49.220145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKE.csv [2025-10-02T22:33:49.220273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLXR.csv [2025-10-02T22:33:49.220392] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPM.csv [2025-10-02T22:33:49.220506] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTS.csv [2025-10-02T22:33:49.220619] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSV.csv [2025-10-02T22:33:49.220884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAA.csv [2025-10-02T22:33:49.221015] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THS.csv [2025-10-02T22:33:49.221142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDIV.csv [2025-10-02T22:33:49.221291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BALL.csv [2025-10-02T22:33:49.221411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IR.csv [2025-10-02T22:33:49.221543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDL.csv [2025-10-02T22:33:49.221677] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMI.csv [2025-10-02T22:33:49.221800] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CW.csv [2025-10-02T22:33:49.221932] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBCI.csv [2025-10-02T22:33:49.222044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRDN.csv [2025-10-02T22:33:49.222150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COP.csv [2025-10-02T22:33:49.222278] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAC.csv [2025-10-02T22:33:49.222381] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AU.csv [2025-10-02T22:33:49.222543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AKR.csv [2025-10-02T22:33:49.222688] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMM.csv [2025-10-02T22:33:49.222821] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHF.csv [2025-10-02T22:33:49.222980] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADT.csv [2025-10-02T22:33:49.223117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLDR.csv [2025-10-02T22:33:49.223224] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIT.csv [2025-10-02T22:33:49.223345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTS.csv [2025-10-02T22:33:49.223463] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARCO.csv [2025-10-02T22:33:49.223591] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHC.csv [2025-10-02T22:33:49.223743] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THLV.csv [2025-10-02T22:33:49.223893] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXTA.csv [2025-10-02T22:33:49.224020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MA.csv [2025-10-02T22:33:49.224169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIRT.csv [2025-10-02T22:33:49.224304] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAR.csv [2025-10-02T22:33:49.224467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BW.csv [2025-10-02T22:33:49.224571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRA.csv [2025-10-02T22:33:49.224740] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATUS.csv [2025-10-02T22:33:49.224849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MODG.csv [2025-10-02T22:33:49.224979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AQNB.csv [2025-10-02T22:33:49.225120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STK.csv [2025-10-02T22:33:49.225288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWZ.csv [2025-10-02T22:33:49.225401] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABR.csv [2025-10-02T22:33:49.225548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATR.csv [2025-10-02T22:33:49.225691] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CF.csv [2025-10-02T22:33:49.225802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTBB.csv [2025-10-02T22:33:49.225905] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GROV.csv [2025-10-02T22:33:49.226017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLX.csv [2025-10-02T22:33:49.226132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRGY.csv [2025-10-02T22:33:49.226258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLVT.csv [2025-10-02T22:33:49.226377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTO.csv [2025-10-02T22:33:49.226508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEA.csv [2025-10-02T22:33:49.226627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRAK.csv [2025-10-02T22:33:49.226761] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPG.csv [2025-10-02T22:33:49.226873] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIG.csv [2025-10-02T22:33:49.227000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVV.csv [2025-10-02T22:33:49.227123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPC.csv [2025-10-02T22:33:49.227247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IH.csv [2025-10-02T22:33:49.227358] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VZ.csv [2025-10-02T22:33:49.227489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECL.csv [2025-10-02T22:33:49.227666] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXT.csv [2025-10-02T22:33:49.227782] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSTS.csv [2025-10-02T22:33:49.227921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESS.csv [2025-10-02T22:33:49.228032] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALK.csv [2025-10-02T22:33:49.228157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FICO.csv [2025-10-02T22:33:49.228271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USA.csv [2025-10-02T22:33:49.228438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNC.csv [2025-10-02T22:33:49.228551] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSCO.csv [2025-10-02T22:33:49.228777] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KF.csv [2025-10-02T22:33:49.228898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DVA.csv [2025-10-02T22:33:49.229040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPRU.csv [2025-10-02T22:33:49.229151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFN.csv [2025-10-02T22:33:49.229270] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPB.csv [2025-10-02T22:33:49.229383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXK.csv [2025-10-02T22:33:49.229505] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKKT.csv [2025-10-02T22:33:49.229617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHGG.csv [2025-10-02T22:33:49.229745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIS.csv [2025-10-02T22:33:49.229850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHOC.csv [2025-10-02T22:33:49.229999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBGS.csv [2025-10-02T22:33:49.230130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVD.csv [2025-10-02T22:33:49.230247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KLC.csv [2025-10-02T22:33:49.230350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLQT.csv [2025-10-02T22:33:49.230452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FVRR.csv [2025-10-02T22:33:49.230570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMB.csv [2025-10-02T22:33:49.230708] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVNA.csv [2025-10-02T22:33:49.230820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGR.csv [2025-10-02T22:33:49.230931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BZH.csv [2025-10-02T22:33:49.231045] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRA.csv [2025-10-02T22:33:49.231169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPP.csv [2025-10-02T22:33:49.231302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KB.csv [2025-10-02T22:33:49.231413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGL.csv [2025-10-02T22:33:49.231507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEFC.csv [2025-10-02T22:33:49.231679] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUI.csv [2025-10-02T22:33:49.231796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHEL.csv [2025-10-02T22:33:49.231904] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNT.csv [2025-10-02T22:33:49.232024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETV.csv [2025-10-02T22:33:49.232134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WM.csv [2025-10-02T22:33:49.232258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDW.csv [2025-10-02T22:33:49.232353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COLD.csv [2025-10-02T22:33:49.232478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CYH.csv [2025-10-02T22:33:49.232571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BJ.csv [2025-10-02T22:33:49.232670] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THW.csv [2025-10-02T22:33:49.232785] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNO.csv [2025-10-02T22:33:49.232891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXG.csv [2025-10-02T22:33:49.233008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COUR.csv [2025-10-02T22:33:49.233127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CP.csv [2025-10-02T22:33:49.233241] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCK.csv [2025-10-02T22:33:49.233367] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVT.csv [2025-10-02T22:33:49.233486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHR.csv [2025-10-02T22:33:49.233610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPRO.csv [2025-10-02T22:33:49.233750] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHC.csv [2025-10-02T22:33:49.233864] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLTO.csv [2025-10-02T22:33:49.233967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEI.csv [2025-10-02T22:33:49.234093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EAT.csv [2025-10-02T22:33:49.234196] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXC.csv [2025-10-02T22:33:49.234308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPOT.csv [2025-10-02T22:33:49.234404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEM.csv [2025-10-02T22:33:49.234485] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWP.csv [2025-10-02T22:33:49.234583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AQN.csv [2025-10-02T22:33:49.234721] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VALE.csv [2025-10-02T22:33:49.234857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRM.csv [2025-10-02T22:33:49.234961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMS.csv [2025-10-02T22:33:49.235054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWR.csv [2025-10-02T22:33:49.235140] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CFR.csv [2025-10-02T22:33:49.235263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GENI.csv [2025-10-02T22:33:49.235360] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VFC.csv [2025-10-02T22:33:49.235430] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMFG.csv [2025-10-02T22:33:49.235509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECC.csv [2025-10-02T22:33:49.235682] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CR.csv [2025-10-02T22:33:49.235809] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFI.csv [2025-10-02T22:33:49.235914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SM.csv [2025-10-02T22:33:49.236043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CB.csv [2025-10-02T22:33:49.236157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDT.csv [2025-10-02T22:33:49.236262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TJX.csv [2025-10-02T22:33:49.236384] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMN.csv [2025-10-02T22:33:49.236489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHH.csv [2025-10-02T22:33:49.236609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBDC.csv [2025-10-02T22:33:49.236953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPR.csv [2025-10-02T22:33:49.237096] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARI.csv [2025-10-02T22:33:49.237283] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOS.csv [2025-10-02T22:33:49.237405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GETY.csv [2025-10-02T22:33:49.237499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKH.csv [2025-10-02T22:33:49.237596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAB.csv [2025-10-02T22:33:49.237726] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SIG.csv [2025-10-02T22:33:49.237873] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AZZ.csv [2025-10-02T22:33:49.238010] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRT.csv [2025-10-02T22:33:49.238127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITUB.csv [2025-10-02T22:33:49.238230] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXP.csv [2025-10-02T22:33:49.238345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVNS.csv [2025-10-02T22:33:49.238436] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SILA.csv [2025-10-02T22:33:49.238504] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIW.csv [2025-10-02T22:33:49.238586] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNC.csv [2025-10-02T22:33:49.238713] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUBE.csv [2025-10-02T22:33:49.238840] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRND.csv [2025-10-02T22:33:49.238946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCTS.csv [2025-10-02T22:33:49.239075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNX.csv [2025-10-02T22:33:49.239180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBX.csv [2025-10-02T22:33:49.239271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACCO.csv [2025-10-02T22:33:49.239339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTEX.csv [2025-10-02T22:33:49.239412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AL.csv [2025-10-02T22:33:49.239524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEX.csv [2025-10-02T22:33:49.239630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNL.csv [2025-10-02T22:33:49.239757] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VATE.csv [2025-10-02T22:33:49.239859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDS.csv [2025-10-02T22:33:49.239970] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWK.csv [2025-10-02T22:33:49.240074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EARN.csv [2025-10-02T22:33:49.240193] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNP.csv [2025-10-02T22:33:49.240296] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRI.csv [2025-10-02T22:33:49.240409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOI.csv [2025-10-02T22:33:49.240511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSB.csv [2025-10-02T22:33:49.240616] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FG.csv [2025-10-02T22:33:49.240751] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKT.csv [2025-10-02T22:33:49.240837] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUV.csv [2025-10-02T22:33:49.240949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXT.csv [2025-10-02T22:33:49.241126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLE.csv [2025-10-02T22:33:49.241271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHMI.csv [2025-10-02T22:33:49.241369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LW.csv [2025-10-02T22:33:49.241500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTWO.csv [2025-10-02T22:33:49.241632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/J.csv [2025-10-02T22:33:49.241926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAE.csv [2025-10-02T22:33:49.242018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXS.csv [2025-10-02T22:33:49.242106] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFY.csv [2025-10-02T22:33:49.242231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSN.csv [2025-10-02T22:33:49.242343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TLYS.csv [2025-10-02T22:33:49.242437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBRE.csv [2025-10-02T22:33:49.242593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWO.csv [2025-10-02T22:33:49.242754] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFB.csv [2025-10-02T22:33:49.242887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDY.csv [2025-10-02T22:33:49.242991] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLG.csv [2025-10-02T22:33:49.243094] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNET.csv [2025-10-02T22:33:49.243192] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNL.csv [2025-10-02T22:33:49.243300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBND.csv [2025-10-02T22:33:49.243433] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTB.csv [2025-10-02T22:33:49.243547] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESAB.csv [2025-10-02T22:33:49.243688] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDJ.csv [2025-10-02T22:33:49.243835] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SONY.csv [2025-10-02T22:33:49.243970] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOC.csv [2025-10-02T22:33:49.244085] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAC.csv [2025-10-02T22:33:49.244191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JXN.csv [2025-10-02T22:33:49.244359] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOT.csv [2025-10-02T22:33:49.244465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDI.csv [2025-10-02T22:33:49.244560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNRC.csv [2025-10-02T22:33:49.244785] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIY.csv [2025-10-02T22:33:49.244900] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIA.csv [2025-10-02T22:33:49.245000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MITP.csv [2025-10-02T22:33:49.245118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DG.csv [2025-10-02T22:33:49.245244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MANU.csv [2025-10-02T22:33:49.245348] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHD.csv [2025-10-02T22:33:49.245475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELME.csv [2025-10-02T22:33:49.245563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XOM.csv [2025-10-02T22:33:49.245700] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIPS.csv [2025-10-02T22:33:49.245807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOL.csv [2025-10-02T22:33:49.245915] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GD.csv [2025-10-02T22:33:49.246052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPYP.csv [2025-10-02T22:33:49.246173] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTF.csv [2025-10-02T22:33:49.246278] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDP.csv [2025-10-02T22:33:49.246392] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STNG.csv [2025-10-02T22:33:49.246508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHT.csv [2025-10-02T22:33:49.246610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPAC.csv [2025-10-02T22:33:49.246757] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VYX.csv [2025-10-02T22:33:49.246872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETO.csv [2025-10-02T22:33:49.246977] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCO.csv [2025-10-02T22:33:49.247161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUK.csv [2025-10-02T22:33:49.247267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUCK.csv [2025-10-02T22:33:49.247373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LVS.csv [2025-10-02T22:33:49.247477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JFR.csv [2025-10-02T22:33:49.247597] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IEX.csv [2025-10-02T22:33:49.247740] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MET.csv [2025-10-02T22:33:49.247846] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBS.csv [2025-10-02T22:33:49.248079] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SQNS.csv [2025-10-02T22:33:49.248218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETN.csv [2025-10-02T22:33:49.248329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVYO.csv [2025-10-02T22:33:49.248449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVR.csv [2025-10-02T22:33:49.248561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VET.csv [2025-10-02T22:33:49.248840] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBS.csv [2025-10-02T22:33:49.248947] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTV.csv [2025-10-02T22:33:49.249060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STM.csv [2025-10-02T22:33:49.249181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDI.csv [2025-10-02T22:33:49.249284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALTG.csv [2025-10-02T22:33:49.249396] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOCL.csv [2025-10-02T22:33:49.249520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSE.csv [2025-10-02T22:33:49.249662] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIT.csv [2025-10-02T22:33:49.249812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAL.csv [2025-10-02T22:33:49.249912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHH.csv [2025-10-02T22:33:49.250019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ED.csv [2025-10-02T22:33:49.250133] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JGH.csv [2025-10-02T22:33:49.250239] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMT.csv [2025-10-02T22:33:49.250334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RWT.csv [2025-10-02T22:33:49.250403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MC.csv [2025-10-02T22:33:49.250497] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBTA.csv [2025-10-02T22:33:49.250687] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APH.csv [2025-10-02T22:33:49.250814] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWI.csv [2025-10-02T22:33:49.250908] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAO.csv [2025-10-02T22:33:49.250986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UWMC.csv [2025-10-02T22:33:49.251089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFY.csv [2025-10-02T22:33:49.251193] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEEV.csv [2025-10-02T22:33:49.251332] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOC.csv [2025-10-02T22:33:49.251444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WES.csv [2025-10-02T22:33:49.251538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRS.csv [2025-10-02T22:33:49.251765] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIPR.csv [2025-10-02T22:33:49.251898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDD.csv [2025-10-02T22:33:49.252003] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEM.csv [2025-10-02T22:33:49.252115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YETI.csv [2025-10-02T22:33:49.252221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/U.csv [2025-10-02T22:33:49.252340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAC.csv [2025-10-02T22:33:49.252454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KR.csv [2025-10-02T22:33:49.252562] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JCE.csv [2025-10-02T22:33:49.252718] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBRT.csv [2025-10-02T22:33:49.252844] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALEX.csv [2025-10-02T22:33:49.252990] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNP.csv [2025-10-02T22:33:49.253094] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOW.csv [2025-10-02T22:33:49.253213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBP.csv [2025-10-02T22:33:49.253324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEN.csv [2025-10-02T22:33:49.253421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UAA.csv [2025-10-02T22:33:49.253497] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKD.csv [2025-10-02T22:33:49.253625] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SO.csv [2025-10-02T22:33:49.253751] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JNJ.csv [2025-10-02T22:33:49.253845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGY.csv [2025-10-02T22:33:49.254148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LH.csv [2025-10-02T22:33:49.254282] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGS.csv [2025-10-02T22:33:49.254364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOOT.csv [2025-10-02T22:33:49.254457] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AESI.csv [2025-10-02T22:33:49.254534] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATHS.csv [2025-10-02T22:33:49.254626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGE.csv [2025-10-02T22:33:49.254745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENVA.csv [2025-10-02T22:33:49.254884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAG.csv [2025-10-02T22:33:49.254988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWF.csv [2025-10-02T22:33:49.255100] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYY.csv [2025-10-02T22:33:49.255211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AP.csv [2025-10-02T22:33:49.255302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVR.csv [2025-10-02T22:33:49.255427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDP.csv [2025-10-02T22:33:49.255526] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAN.csv [2025-10-02T22:33:49.255637] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMN.csv [2025-10-02T22:33:49.255783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZH.csv [2025-10-02T22:33:49.255895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SD.csv [2025-10-02T22:33:49.255999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKLZ.csv [2025-10-02T22:33:49.256135] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINS.csv [2025-10-02T22:33:49.256243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LANV.csv [2025-10-02T22:33:49.256339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALX.csv [2025-10-02T22:33:49.256419] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBN.csv [2025-10-02T22:33:49.256515] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFA.csv [2025-10-02T22:33:49.256594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYN.csv [2025-10-02T22:33:49.256827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KKR.csv [2025-10-02T22:33:49.256939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CURB.csv [2025-10-02T22:33:49.257060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPR.csv [2025-10-02T22:33:49.257166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPJ.csv [2025-10-02T22:33:49.257256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDL.csv [2025-10-02T22:33:49.257347] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBH.csv [2025-10-02T22:33:49.257459] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWK.csv [2025-10-02T22:33:49.257566] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYAM.csv [2025-10-02T22:33:49.257698] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHC.csv [2025-10-02T22:33:49.257798] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTI.csv [2025-10-02T22:33:49.257945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOLE.csv [2025-10-02T22:33:49.258053] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHD.csv [2025-10-02T22:33:49.258188] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMCM.csv [2025-10-02T22:33:49.258299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMO.csv [2025-10-02T22:33:49.258408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WWW.csv [2025-10-02T22:33:49.258499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AI.csv [2025-10-02T22:33:49.258611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFP.csv [2025-10-02T22:33:49.258751] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USFD.csv [2025-10-02T22:33:49.258913] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDP.csv [2025-10-02T22:33:49.259021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIGS.csv [2025-10-02T22:33:49.259126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MG.csv [2025-10-02T22:33:49.259249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOBY.csv [2025-10-02T22:33:49.259354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRI.csv [2025-10-02T22:33:49.259468] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGSF.csv [2025-10-02T22:33:49.259565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNK.csv [2025-10-02T22:33:49.259671] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/M.csv [2025-10-02T22:33:49.259791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGX.csv [2025-10-02T22:33:49.259876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIST.csv [2025-10-02T22:33:49.259954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDC.csv [2025-10-02T22:33:49.260095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STE.csv [2025-10-02T22:33:49.260212] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUPV.csv [2025-10-02T22:33:49.260366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAF.csv [2025-10-02T22:33:49.260473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAP.csv [2025-10-02T22:33:49.260598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPR.csv [2025-10-02T22:33:49.260728] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AYI.csv [2025-10-02T22:33:49.260824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LU.csv [2025-10-02T22:33:49.260938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALV.csv [2025-10-02T22:33:49.261040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEF.csv [2025-10-02T22:33:49.261134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHT.csv [2025-10-02T22:33:49.261213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGD.csv [2025-10-02T22:33:49.261316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LITB.csv [2025-10-02T22:33:49.261417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUN.csv [2025-10-02T22:33:49.261521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UL.csv [2025-10-02T22:33:49.261627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXG.csv [2025-10-02T22:33:49.261757] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MATV.csv [2025-10-02T22:33:49.261859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOUR.csv [2025-10-02T22:33:49.261994] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AB.csv [2025-10-02T22:33:49.262124] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBI.csv [2025-10-02T22:33:49.262250] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUL.csv [2025-10-02T22:33:49.262346] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELP.csv [2025-10-02T22:33:49.262437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMG.csv [2025-10-02T22:33:49.262514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPNG.csv [2025-10-02T22:33:49.262627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AZO.csv [2025-10-02T22:33:49.262806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COOK.csv [2025-10-02T22:33:49.262919] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHR.csv [2025-10-02T22:33:49.263042] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YUMC.csv [2025-10-02T22:33:49.263150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKO.csv [2025-10-02T22:33:49.263243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSC.csv [2025-10-02T22:33:49.263327] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGHC.csv [2025-10-02T22:33:49.263417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DX.csv [2025-10-02T22:33:49.263486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMK.csv [2025-10-02T22:33:49.263562] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SID.csv [2025-10-02T22:33:49.263689] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFPM.csv [2025-10-02T22:33:49.263804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDF.csv [2025-10-02T22:33:49.263939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPIR.csv [2025-10-02T22:33:49.264060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOF.csv [2025-10-02T22:33:49.264218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMP.csv [2025-10-02T22:33:49.264330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMO.csv [2025-10-02T22:33:49.264443] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOD.csv [2025-10-02T22:33:49.264577] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBW.csv [2025-10-02T22:33:49.264767] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WKC.csv [2025-10-02T22:33:49.264869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOS.csv [2025-10-02T22:33:49.264963] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOF.csv [2025-10-02T22:33:49.265045] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETR.csv [2025-10-02T22:33:49.265136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXMT.csv [2025-10-02T22:33:49.265212] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAL.csv [2025-10-02T22:33:49.265341] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZVIA.csv [2025-10-02T22:33:49.265433] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEVA.csv [2025-10-02T22:33:49.265534] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVS.csv [2025-10-02T22:33:49.265669] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNF.csv [2025-10-02T22:33:49.265776] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SST.csv [2025-10-02T22:33:49.265876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNCE.csv [2025-10-02T22:33:49.265988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WNS.csv [2025-10-02T22:33:49.266091] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUZ.csv [2025-10-02T22:33:49.266194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CGV.csv [2025-10-02T22:33:49.266293] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WT.csv [2025-10-02T22:33:49.266420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBI.csv [2025-10-02T22:33:49.266511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELAN.csv [2025-10-02T22:33:49.266593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMS.csv [2025-10-02T22:33:49.266725] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOP.csv [2025-10-02T22:33:49.266835] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CX.csv [2025-10-02T22:33:49.266911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRB.csv [2025-10-02T22:33:49.266977] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BROS.csv [2025-10-02T22:33:49.267064] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXT.csv [2025-10-02T22:33:49.267172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTES.csv [2025-10-02T22:33:49.267278] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPRK.csv [2025-10-02T22:33:49.267381] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVF.csv [2025-10-02T22:33:49.267494] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMN.csv [2025-10-02T22:33:49.267604] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCO.csv [2025-10-02T22:33:49.267747] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTS.csv [2025-10-02T22:33:49.267861] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRC.csv [2025-10-02T22:33:49.267991] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRN.csv [2025-10-02T22:33:49.268145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFR.csv [2025-10-02T22:33:49.268246] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DK.csv [2025-10-02T22:33:49.268342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPN.csv [2025-10-02T22:33:49.268418] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BURL.csv [2025-10-02T22:33:49.268520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHG.csv [2025-10-02T22:33:49.268633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LLY.csv [2025-10-02T22:33:49.268861] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMA.csv [2025-10-02T22:33:49.268932] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CALX.csv [2025-10-02T22:33:49.268996] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DVN.csv [2025-10-02T22:33:49.269094] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCO.csv [2025-10-02T22:33:49.269201] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SREA.csv [2025-10-02T22:33:49.269317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDG.csv [2025-10-02T22:33:49.269447] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSR.csv [2025-10-02T22:33:49.269541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATEN.csv [2025-10-02T22:33:49.269634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STLA.csv [2025-10-02T22:33:49.269772] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMC.csv [2025-10-02T22:33:49.269876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXV.csv [2025-10-02T22:33:49.270015] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLOB.csv [2025-10-02T22:33:49.270123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMG.csv [2025-10-02T22:33:49.270293] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVA.csv [2025-10-02T22:33:49.270408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YMM.csv [2025-10-02T22:33:49.270515] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YALA.csv [2025-10-02T22:33:49.270628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IP.csv [2025-10-02T22:33:49.270755] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVY.csv [2025-10-02T22:33:49.270852] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TMHC.csv [2025-10-02T22:33:49.270941] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPC.csv [2025-10-02T22:33:49.271037] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/K.csv [2025-10-02T22:33:49.271130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAFE.csv [2025-10-02T22:33:49.271221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATHM.csv [2025-10-02T22:33:49.271313] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPCE.csv [2025-10-02T22:33:49.271440] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOAR.csv [2025-10-02T22:33:49.271548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFX.csv [2025-10-02T22:33:49.271695] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNDR.csv [2025-10-02T22:33:49.271804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMX.csv [2025-10-02T22:33:49.271952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTO.csv [2025-10-02T22:33:49.272047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JLS.csv [2025-10-02T22:33:49.272133] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TM.csv [2025-10-02T22:33:49.272247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ERJ.csv [2025-10-02T22:33:49.272367] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WNC.csv [2025-10-02T22:33:49.272460] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MED.csv [2025-10-02T22:33:49.272571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPE.csv [2025-10-02T22:33:49.272850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIK.csv [2025-10-02T22:33:49.272967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGR.csv [2025-10-02T22:33:49.273063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFWM.csv [2025-10-02T22:33:49.273130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPF.csv [2025-10-02T22:33:49.273213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSI.csv [2025-10-02T22:33:49.273313] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDU.csv [2025-10-02T22:33:49.273409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTMX.csv [2025-10-02T22:33:49.273477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUR.csv [2025-10-02T22:33:49.273552] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECG.csv [2025-10-02T22:33:49.273668] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFT.csv [2025-10-02T22:33:49.273761] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CANG.csv [2025-10-02T22:33:49.273906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTI.csv [2025-10-02T22:33:49.274023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UIS.csv [2025-10-02T22:33:49.274127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/C.csv [2025-10-02T22:33:49.274228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LII.csv [2025-10-02T22:33:49.274335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVH.csv [2025-10-02T22:33:49.274438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPRT.csv [2025-10-02T22:33:49.274557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCI.csv [2025-10-02T22:33:49.274709] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SABA.csv [2025-10-02T22:33:49.274814] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSH.csv [2025-10-02T22:33:49.274916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVK.csv [2025-10-02T22:33:49.275021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHLD.csv [2025-10-02T22:33:49.275120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDD.csv [2025-10-02T22:33:49.275232] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESE.csv [2025-10-02T22:33:49.275325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GF.csv [2025-10-02T22:33:49.275408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GE.csv [2025-10-02T22:33:49.275508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBSI.csv [2025-10-02T22:33:49.275602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGC.csv [2025-10-02T22:33:49.275720] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FT.csv [2025-10-02T22:33:49.275824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOOS.csv [2025-10-02T22:33:49.275938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNMA.csv [2025-10-02T22:33:49.276083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAR.csv [2025-10-02T22:33:49.276174] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIP.csv [2025-10-02T22:33:49.276241] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKIL.csv [2025-10-02T22:33:49.276346] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFH.csv [2025-10-02T22:33:49.276449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTOL.csv [2025-10-02T22:33:49.276575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATMU.csv [2025-10-02T22:33:49.276689] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXL.csv [2025-10-02T22:33:49.276779] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLI.csv [2025-10-02T22:33:49.276855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEE.csv [2025-10-02T22:33:49.276971] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AA.csv [2025-10-02T22:33:49.277080] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFL.csv [2025-10-02T22:33:49.277174] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WINN.csv [2025-10-02T22:33:49.277282] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UE.csv [2025-10-02T22:33:49.277386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBAB.csv [2025-10-02T22:33:49.277487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEL.csv [2025-10-02T22:33:49.277663] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHI.csv [2025-10-02T22:33:49.277790] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGM.csv [2025-10-02T22:33:49.277919] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTD.csv [2025-10-02T22:33:49.278013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOLF.csv [2025-10-02T22:33:49.278080] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELC.csv [2025-10-02T22:33:49.278144] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWH.csv [2025-10-02T22:33:49.278218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNN.csv [2025-10-02T22:33:49.278322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LCII.csv [2025-10-02T22:33:49.278416] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOS.csv [2025-10-02T22:33:49.278509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNOP.csv [2025-10-02T22:33:49.278618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBC.csv [2025-10-02T22:33:49.278751] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLF.csv [2025-10-02T22:33:49.278842] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMI.csv [2025-10-02T22:33:49.278921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAIN.csv [2025-10-02T22:33:49.279028] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAK.csv [2025-10-02T22:33:49.279141] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLG.csv [2025-10-02T22:33:49.279248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEAF.csv [2025-10-02T22:33:49.279354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSM.csv [2025-10-02T22:33:49.279450] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELS.csv [2025-10-02T22:33:49.279537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WH.csv [2025-10-02T22:33:49.279663] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGNA.csv [2025-10-02T22:33:49.279819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CC.csv [2025-10-02T22:33:49.279932] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAM.csv [2025-10-02T22:33:49.280036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COTY.csv [2025-10-02T22:33:49.280132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFH.csv [2025-10-02T22:33:49.280234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAY.csv [2025-10-02T22:33:49.280341] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMWB.csv [2025-10-02T22:33:49.280463] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRO.csv [2025-10-02T22:33:49.280588] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPRI.csv [2025-10-02T22:33:49.280753] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPL.csv [2025-10-02T22:33:49.280860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDN.csv [2025-10-02T22:33:49.280965] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOTU.csv [2025-10-02T22:33:49.281081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAD.csv [2025-10-02T22:33:49.281172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BYD.csv [2025-10-02T22:33:49.281243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEW.csv [2025-10-02T22:33:49.281316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIN.csv [2025-10-02T22:33:49.281418] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOF.csv [2025-10-02T22:33:49.281527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THR.csv [2025-10-02T22:33:49.281639] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHR.csv [2025-10-02T22:33:49.281774] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSX.csv [2025-10-02T22:33:49.281907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCM.csv [2025-10-02T22:33:49.282053] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AM.csv [2025-10-02T22:33:49.282191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEG.csv [2025-10-02T22:33:49.282343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASA.csv [2025-10-02T22:33:49.282483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNSO.csv [2025-10-02T22:33:49.282575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARW.csv [2025-10-02T22:33:49.282693] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHM.csv [2025-10-02T22:33:49.282786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EW.csv [2025-10-02T22:33:49.282856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FGN.csv [2025-10-02T22:33:49.282930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTO.csv [2025-10-02T22:33:49.283060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DD.csv [2025-10-02T22:33:49.283168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWLO.csv [2025-10-02T22:33:49.283275] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRNO.csv [2025-10-02T22:33:49.283373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UDR.csv [2025-10-02T22:33:49.283458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAAP.csv [2025-10-02T22:33:49.283571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSL.csv [2025-10-02T22:33:49.283728] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMPY.csv [2025-10-02T22:33:49.283847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ISD.csv [2025-10-02T22:33:49.283957] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THG.csv [2025-10-02T22:33:49.284048] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETB.csv [2025-10-02T22:33:49.284116] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AROC.csv [2025-10-02T22:33:49.284191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNK.csv [2025-10-02T22:33:49.284300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRE.csv [2025-10-02T22:33:49.284403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYI.csv [2025-10-02T22:33:49.284499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FE.csv [2025-10-02T22:33:49.284578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXK.csv [2025-10-02T22:33:49.284734] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFF.csv [2025-10-02T22:33:49.284862] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGM.csv [2025-10-02T22:33:49.284993] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTI.csv [2025-10-02T22:33:49.285163] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMP.csv [2025-10-02T22:33:49.285264] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCS.csv [2025-10-02T22:33:49.285372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAM.csv [2025-10-02T22:33:49.285520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNT.csv [2025-10-02T22:33:49.285665] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSI.csv [2025-10-02T22:33:49.285761] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COF.csv [2025-10-02T22:33:49.285866] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIV.csv [2025-10-02T22:33:49.285980] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNH.csv [2025-10-02T22:33:49.286088] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXM.csv [2025-10-02T22:33:49.286242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRL.csv [2025-10-02T22:33:49.286353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGT.csv [2025-10-02T22:33:49.286443] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CACI.csv [2025-10-02T22:33:49.286522] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SJM.csv [2025-10-02T22:33:49.286618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SN.csv [2025-10-02T22:33:49.286727] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DV.csv [2025-10-02T22:33:49.286938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BG.csv [2025-10-02T22:33:49.287042] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGC.csv [2025-10-02T22:33:49.287168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHAK.csv [2025-10-02T22:33:49.287274] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALSN.csv [2025-10-02T22:33:49.287417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNC.csv [2025-10-02T22:33:49.287562] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IQV.csv [2025-10-02T22:33:49.287703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESI.csv [2025-10-02T22:33:49.287809] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCJ.csv [2025-10-02T22:33:49.287938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TG.csv [2025-10-02T22:33:49.288051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDH.csv [2025-10-02T22:33:49.288144] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBNA.csv [2025-10-02T22:33:49.288249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/G.csv [2025-10-02T22:33:49.288371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRT.csv [2025-10-02T22:33:49.288443] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VCV.csv [2025-10-02T22:33:49.288520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESNT.csv [2025-10-02T22:33:49.288624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNH.csv [2025-10-02T22:33:49.288867] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOE.csv [2025-10-02T22:33:49.288953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSU.csv [2025-10-02T22:33:49.289067] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRNT.csv [2025-10-02T22:33:49.289181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETW.csv [2025-10-02T22:33:49.289310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSW.csv [2025-10-02T22:33:49.289436] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATS.csv [2025-10-02T22:33:49.289548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGY.csv [2025-10-02T22:33:49.289671] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEL.csv [2025-10-02T22:33:49.289826] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KT.csv [2025-10-02T22:33:49.289934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GS.csv [2025-10-02T22:33:49.290025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CARS.csv [2025-10-02T22:33:49.290112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEO.csv [2025-10-02T22:33:49.290215] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPG.csv [2025-10-02T22:33:49.290314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LFT.csv [2025-10-02T22:33:49.290397] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPJA.csv [2025-10-02T22:33:49.290500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKU.csv [2025-10-02T22:33:49.290638] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIIN.csv [2025-10-02T22:33:49.290772] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTE.csv [2025-10-02T22:33:49.290877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TK.csv [2025-10-02T22:33:49.290987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQH.csv [2025-10-02T22:33:49.291096] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBH.csv [2025-10-02T22:33:49.291212] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USAC.csv [2025-10-02T22:33:49.291311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSM.csv [2025-10-02T22:33:49.291379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALLY.csv [2025-10-02T22:33:49.291455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAVA.csv [2025-10-02T22:33:49.291559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBR.csv [2025-10-02T22:33:49.291695] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZKH.csv [2025-10-02T22:33:49.291800] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/T.csv [2025-10-02T22:33:49.291906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STRV.csv [2025-10-02T22:33:49.292000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FXED.csv [2025-10-02T22:33:49.292098] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THQ.csv [2025-10-02T22:33:49.292206] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWH.csv [2025-10-02T22:33:49.292313] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMR.csv [2025-10-02T22:33:49.292420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOUG.csv [2025-10-02T22:33:49.292518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEGI.csv [2025-10-02T22:33:49.292627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CE.csv [2025-10-02T22:33:49.292773] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LMND.csv [2025-10-02T22:33:49.292871] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNN.csv [2025-10-02T22:33:49.292948] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMG.csv [2025-10-02T22:33:49.293042] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIG.csv [2025-10-02T22:33:49.293123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCCO.csv [2025-10-02T22:33:49.293219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFC.csv [2025-10-02T22:33:49.293289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPK.csv [2025-10-02T22:33:49.293440] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEX.csv [2025-10-02T22:33:49.293558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASB.csv [2025-10-02T22:33:49.293699] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMC.csv [2025-10-02T22:33:49.293805] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SES.csv [2025-10-02T22:33:49.293910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFL.csv [2025-10-02T22:33:49.294004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWX.csv [2025-10-02T22:33:49.294081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSBD.csv [2025-10-02T22:33:49.294177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXE.csv [2025-10-02T22:33:49.294269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEP.csv [2025-10-02T22:33:49.294374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDOS.csv [2025-10-02T22:33:49.294479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPX.csv [2025-10-02T22:33:49.294588] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOBO.csv [2025-10-02T22:33:49.294745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEC.csv [2025-10-02T22:33:49.294867] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOYA.csv [2025-10-02T22:33:49.294969] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXP.csv [2025-10-02T22:33:49.295078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENR.csv [2025-10-02T22:33:49.295183] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMX.csv [2025-10-02T22:33:49.295288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VST.csv [2025-10-02T22:33:49.295385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZK.csv [2025-10-02T22:33:49.295524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNFI.csv [2025-10-02T22:33:49.295621] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/E.csv [2025-10-02T22:33:49.295768] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRC.csv [2025-10-02T22:33:49.295875] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBWI.csv [2025-10-02T22:33:49.295983] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TR.csv [2025-10-02T22:33:49.296088] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEL.csv [2025-10-02T22:33:49.296184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEX.csv [2025-10-02T22:33:49.296270] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKT.csv [2025-10-02T22:33:49.296379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ING.csv [2025-10-02T22:33:49.296483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARMK.csv [2025-10-02T22:33:49.296588] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGU.csv [2025-10-02T22:33:49.296966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARE.csv [2025-10-02T22:33:49.297076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXMX.csv [2025-10-02T22:33:49.297195] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTTR.csv [2025-10-02T22:33:49.297352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRTS.csv [2025-10-02T22:33:49.297451] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAN.csv [2025-10-02T22:33:49.297561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFRC.csv [2025-10-02T22:33:49.297698] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GME.csv [2025-10-02T22:33:49.297805] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGB.csv [2025-10-02T22:33:49.297928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASGI.csv [2025-10-02T22:33:49.298027] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UCB.csv [2025-10-02T22:33:49.298101] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLT.csv [2025-10-02T22:33:49.298169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRE.csv [2025-10-02T22:33:49.298235] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMI.csv [2025-10-02T22:33:49.298311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USPH.csv [2025-10-02T22:33:49.298406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTC.csv [2025-10-02T22:33:49.298485] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCL.csv [2025-10-02T22:33:49.298582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DKS.csv [2025-10-02T22:33:49.298687] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETX.csv [2025-10-02T22:33:49.298793] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRT.csv [2025-10-02T22:33:49.298900] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACN.csv [2025-10-02T22:33:49.299001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVTY.csv [2025-10-02T22:33:49.299110] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMPO.csv [2025-10-02T22:33:49.299197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPJ.csv [2025-10-02T22:33:49.299274] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHD.csv [2025-10-02T22:33:49.299377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KD.csv [2025-10-02T22:33:49.299481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOLF.csv [2025-10-02T22:33:49.299577] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPGI.csv [2025-10-02T22:33:49.299697] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIR.csv [2025-10-02T22:33:49.299801] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBSW.csv [2025-10-02T22:33:49.299922] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SITE.csv [2025-10-02T22:33:49.300070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AG.csv [2025-10-02T22:33:49.300165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAH.csv [2025-10-02T22:33:49.300302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIF.csv [2025-10-02T22:33:49.300406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRG.csv [2025-10-02T22:33:49.300503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEO.csv [2025-10-02T22:33:49.300632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KIO.csv [2025-10-02T22:33:49.300760] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KN.csv [2025-10-02T22:33:49.300856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCT.csv [2025-10-02T22:33:49.300936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GATX.csv [2025-10-02T22:33:49.301044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJC.csv [2025-10-02T22:33:49.301156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEC.csv [2025-10-02T22:33:49.301310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WGO.csv [2025-10-02T22:33:49.301440] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CARR.csv [2025-10-02T22:33:49.301534] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHX.csv [2025-10-02T22:33:49.301603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GKOS.csv [2025-10-02T22:33:49.301713] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKE.csv [2025-10-02T22:33:49.301819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMD.csv [2025-10-02T22:33:49.301898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICL.csv [2025-10-02T22:33:49.302018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSR.csv [2025-10-02T22:33:49.302143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADNT.csv [2025-10-02T22:33:49.302246] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTR.csv [2025-10-02T22:33:49.302350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGM.csv [2025-10-02T22:33:49.302457] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCO.csv [2025-10-02T22:33:49.302553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLW.csv [2025-10-02T22:33:49.302694] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MITT.csv [2025-10-02T22:33:49.302787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQT.csv [2025-10-02T22:33:49.302903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALE.csv [2025-10-02T22:33:49.302996] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOD.csv [2025-10-02T22:33:49.303090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LB.csv [2025-10-02T22:33:49.303200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPL.csv [2025-10-02T22:33:49.303335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNSL.csv [2025-10-02T22:33:49.303443] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STVN.csv [2025-10-02T22:33:49.303553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAL.csv [2025-10-02T22:33:49.303690] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LND.csv [2025-10-02T22:33:49.303807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFF.csv [2025-10-02T22:33:49.303903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMTG.csv [2025-10-02T22:33:49.303973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JILL.csv [2025-10-02T22:33:49.304041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SB.csv [2025-10-02T22:33:49.304116] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JMIA.csv [2025-10-02T22:33:49.304212] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIC.csv [2025-10-02T22:33:49.304286] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMC.csv [2025-10-02T22:33:49.304354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGS.csv [2025-10-02T22:33:49.304433] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TU.csv [2025-10-02T22:33:49.304527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGI.csv [2025-10-02T22:33:49.304595] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASPN.csv [2025-10-02T22:33:49.304798] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRI.csv [2025-10-02T22:33:49.304930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TV.csv [2025-10-02T22:33:49.305041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBB.csv [2025-10-02T22:33:49.305137] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCH.csv [2025-10-02T22:33:49.305240] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNDA.csv [2025-10-02T22:33:49.305336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCK.csv [2025-10-02T22:33:49.305415] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAH.csv [2025-10-02T22:33:49.305527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FND.csv [2025-10-02T22:33:49.305633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TISI.csv [2025-10-02T22:33:49.305849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRFM.csv [2025-10-02T22:33:49.305934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMO.csv [2025-10-02T22:33:49.306002] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOCN.csv [2025-10-02T22:33:49.306095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMH.csv [2025-10-02T22:33:49.306190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNTK.csv [2025-10-02T22:33:49.306291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATI.csv [2025-10-02T22:33:49.306384] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STT.csv [2025-10-02T22:33:49.306454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPC.csv [2025-10-02T22:33:49.306521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNM.csv [2025-10-02T22:33:49.306597] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDA.csv [2025-10-02T22:33:49.306726] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETD.csv [2025-10-02T22:33:49.306834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHK.csv [2025-10-02T22:33:49.306945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEI.csv [2025-10-02T22:33:49.307053] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SE.csv [2025-10-02T22:33:49.307145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TALO.csv [2025-10-02T22:33:49.307213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LMT.csv [2025-10-02T22:33:49.307299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDLR.csv [2025-10-02T22:33:49.307401] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADCT.csv [2025-10-02T22:33:49.307493] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKC.csv [2025-10-02T22:33:49.307572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKYH.csv [2025-10-02T22:33:49.307708] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIHL.csv [2025-10-02T22:33:49.307813] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DKL.csv [2025-10-02T22:33:49.307943] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHR.csv [2025-10-02T22:33:49.308055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDF.csv [2025-10-02T22:33:49.308170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIP.csv [2025-10-02T22:33:49.308271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHCO.csv [2025-10-02T22:33:49.308375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TOST.csv [2025-10-02T22:33:49.308470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOND.csv [2025-10-02T22:33:49.308597] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPG.csv [2025-10-02T22:33:49.308750] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AON.csv [2025-10-02T22:33:49.308881] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXW.csv [2025-10-02T22:33:49.308979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KSS.csv [2025-10-02T22:33:49.309058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEC.csv [2025-10-02T22:33:49.309152] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBY.csv [2025-10-02T22:33:49.309230] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRE.csv [2025-10-02T22:33:49.309325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTM.csv [2025-10-02T22:33:49.309403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LBRT.csv [2025-10-02T22:33:49.309498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGT.csv [2025-10-02T22:33:49.309601] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAK.csv [2025-10-02T22:33:49.309873] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VHI.csv [2025-10-02T22:33:49.309967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNOW.csv [2025-10-02T22:33:49.310063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FI.csv [2025-10-02T22:33:49.310143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YOU.csv [2025-10-02T22:33:49.310248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHAB.csv [2025-10-02T22:33:49.310356] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAR.csv [2025-10-02T22:33:49.310446] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENOV.csv [2025-10-02T22:33:49.310515] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVV.csv [2025-10-02T22:33:49.310590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEN.csv [2025-10-02T22:33:49.310710] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YEXT.csv [2025-10-02T22:33:49.310802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMI.csv [2025-10-02T22:33:49.310906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTB.csv [2025-10-02T22:33:49.311000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIF.csv [2025-10-02T22:33:49.311088] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AUB.csv [2025-10-02T22:33:49.311185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVEX.csv [2025-10-02T22:33:49.311268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACVA.csv [2025-10-02T22:33:49.311368] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMF.csv [2025-10-02T22:33:49.311463] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXD.csv [2025-10-02T22:33:49.311601] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BA.csv [2025-10-02T22:33:49.311740] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YUM.csv [2025-10-02T22:33:49.311839] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLN.csv [2025-10-02T22:33:49.311930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SQM.csv [2025-10-02T22:33:49.312021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIX.csv [2025-10-02T22:33:49.312206] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLNG.csv [2025-10-02T22:33:49.312343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLY.csv [2025-10-02T22:33:49.312468] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNX.csv [2025-10-02T22:33:49.312545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSLY.csv [2025-10-02T22:33:49.312612] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNA.csv [2025-10-02T22:33:49.312754] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XFLT.csv [2025-10-02T22:33:49.312852] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIB.csv [2025-10-02T22:33:49.312924] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USNA.csv [2025-10-02T22:33:49.312992] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRV.csv [2025-10-02T22:33:49.313069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYK.csv [2025-10-02T22:33:49.313167] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FET.csv [2025-10-02T22:33:49.313237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMN.csv [2025-10-02T22:33:49.313302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMCR.csv [2025-10-02T22:33:49.313376] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADX.csv [2025-10-02T22:33:49.313469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CFG.csv [2025-10-02T22:33:49.313599] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THIR.csv [2025-10-02T22:33:49.313736] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCE.csv [2025-10-02T22:33:49.313839] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACP.csv [2025-10-02T22:33:49.313945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRP.csv [2025-10-02T22:33:49.314063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYG.csv [2025-10-02T22:33:49.314154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOH.csv [2025-10-02T22:33:49.314234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKL.csv [2025-10-02T22:33:49.314339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDT.csv [2025-10-02T22:33:49.314448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/W.csv [2025-10-02T22:33:49.314560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WU.csv [2025-10-02T22:33:49.314630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASAN.csv [2025-10-02T22:33:49.314743] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCN.csv [2025-10-02T22:33:49.314850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLH.csv [2025-10-02T22:33:49.314940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASC.csv [2025-10-02T22:33:49.315010] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTS.csv [2025-10-02T22:33:49.315129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCC.csv [2025-10-02T22:33:49.315232] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TUYA.csv [2025-10-02T22:33:49.315326] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSBR.csv [2025-10-02T22:33:49.315396] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FAF.csv [2025-10-02T22:33:49.315472] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAR.csv [2025-10-02T22:33:49.315568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAP.csv [2025-10-02T22:33:49.315713] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFAM.csv [2025-10-02T22:33:49.315840] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/F.csv [2025-10-02T22:33:49.315927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVE.csv [2025-10-02T22:33:49.316031] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEYS.csv [2025-10-02T22:33:49.316137] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXI.csv [2025-10-02T22:33:49.316232] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBT.csv [2025-10-02T22:33:49.316312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSK.csv [2025-10-02T22:33:49.316465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVNT.csv [2025-10-02T22:33:49.316615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSA.csv [2025-10-02T22:33:49.316775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ST.csv [2025-10-02T22:33:49.316880] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALG.csv [2025-10-02T22:33:49.316975] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWG.csv [2025-10-02T22:33:49.317044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPI.csv [2025-10-02T22:33:49.317121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOW.csv [2025-10-02T22:33:49.317226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/V.csv [2025-10-02T22:33:49.317322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHY.csv [2025-10-02T22:33:49.317392] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TY.csv [2025-10-02T22:33:49.317492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEA.csv [2025-10-02T22:33:49.317597] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLW.csv [2025-10-02T22:33:49.317867] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KYN.csv [2025-10-02T22:33:49.317991] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCS.csv [2025-10-02T22:33:49.318069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPI.csv [2025-10-02T22:33:49.318161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYV.csv [2025-10-02T22:33:49.318226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPXX.csv [2025-10-02T22:33:49.318299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRGE.csv [2025-10-02T22:33:49.318392] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPEV.csv [2025-10-02T22:33:49.318468] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YRD.csv [2025-10-02T22:33:49.318590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESRT.csv [2025-10-02T22:33:49.318691] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KW.csv [2025-10-02T22:33:49.318780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENB.csv [2025-10-02T22:33:49.318864] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITW.csv [2025-10-02T22:33:49.318973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SVV.csv [2025-10-02T22:33:49.319070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLF.csv [2025-10-02T22:33:49.319144] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLB.csv [2025-10-02T22:33:49.319210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSM.csv [2025-10-02T22:33:49.319280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCHW.csv [2025-10-02T22:33:49.319352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGM.csv [2025-10-02T22:33:49.319444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANET.csv [2025-10-02T22:33:49.319509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQV.csv [2025-10-02T22:33:49.319571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THC.csv [2025-10-02T22:33:49.319660] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBS.csv [2025-10-02T22:33:49.319763] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZEPP.csv [2025-10-02T22:33:49.319896] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIA.csv [2025-10-02T22:33:49.319995] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNM.csv [2025-10-02T22:33:49.320086] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLRS.csv [2025-10-02T22:33:49.320152] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IT.csv [2025-10-02T22:33:49.320215] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTC.csv [2025-10-02T22:33:49.320288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFIN.csv [2025-10-02T22:33:49.320389] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCI.csv [2025-10-02T22:33:49.320493] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CATO.csv [2025-10-02T22:33:49.320584] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGX.csv [2025-10-02T22:33:49.320685] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IX.csv [2025-10-02T22:33:49.320786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/L.csv [2025-10-02T22:33:49.320880] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGY.csv [2025-10-02T22:33:49.320950] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDS.csv [2025-10-02T22:33:49.321070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AR.csv [2025-10-02T22:33:49.321171] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCL.csv [2025-10-02T22:33:49.321265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPAY.csv [2025-10-02T22:33:49.321358] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEG.csv [2025-10-02T22:33:49.321461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBD.csv [2025-10-02T22:33:49.321554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWMX.csv [2025-10-02T22:33:49.321663] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RTX.csv [2025-10-02T22:33:49.321765] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AER.csv [2025-10-02T22:33:49.321858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRCC.csv [2025-10-02T22:33:49.321927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SU.csv [2025-10-02T22:33:49.322015] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMC.csv [2025-10-02T22:33:49.322108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGH.csv [2025-10-02T22:33:49.322176] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEF.csv [2025-10-02T22:33:49.322252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNS.csv [2025-10-02T22:33:49.322347] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNR.csv [2025-10-02T22:33:49.322474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMRE.csv [2025-10-02T22:33:49.322565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLR.csv [2025-10-02T22:33:49.322706] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GM.csv [2025-10-02T22:33:49.322804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JCI.csv [2025-10-02T22:33:49.322898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGP.csv [2025-10-02T22:33:49.322982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLUT.csv [2025-10-02T22:33:49.323082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEO.csv [2025-10-02T22:33:49.323187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLVM.csv [2025-10-02T22:33:49.323280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/A.csv [2025-10-02T22:33:49.323348] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPT.csv [2025-10-02T22:33:49.323415] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZE.csv [2025-10-02T22:33:49.323486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXH.csv [2025-10-02T22:33:49.323579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIS.csv [2025-10-02T22:33:49.323682] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAS.csv [2025-10-02T22:33:49.323786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LVWR.csv [2025-10-02T22:33:49.323879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSP.csv [2025-10-02T22:33:49.323958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTS.csv [2025-10-02T22:33:49.324051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCI.csv [2025-10-02T22:33:49.324117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBTG.csv [2025-10-02T22:33:49.324191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWN.csv [2025-10-02T22:33:49.324293] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SR.csv [2025-10-02T22:33:49.324387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNH.csv [2025-10-02T22:33:49.324454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHS.csv [2025-10-02T22:33:49.324559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLK.csv [2025-10-02T22:33:49.324688] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPOF.csv [2025-10-02T22:33:49.324806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BME.csv [2025-10-02T22:33:49.324898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDT.csv [2025-10-02T22:33:49.324981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CYD.csv [2025-10-02T22:33:49.325075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSCO.csv [2025-10-02T22:33:49.325139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLX.csv [2025-10-02T22:33:49.325203] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GES.csv [2025-10-02T22:33:49.325283] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAX.csv [2025-10-02T22:33:49.325381] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLP.csv [2025-10-02T22:33:49.325472] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTB.csv [2025-10-02T22:33:49.325548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INN.csv [2025-10-02T22:33:49.325754] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPXC.csv [2025-10-02T22:33:49.325848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSK.csv [2025-10-02T22:33:49.325915] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CQP.csv [2025-10-02T22:33:49.325987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STWD.csv [2025-10-02T22:33:49.326110] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACR.csv [2025-10-02T22:33:49.326203] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDRE.csv [2025-10-02T22:33:49.326279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LSPD.csv [2025-10-02T22:33:49.326371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LGI.csv [2025-10-02T22:33:49.326482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHN.csv [2025-10-02T22:33:49.326583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEMR.csv [2025-10-02T22:33:49.326699] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOE.csv [2025-10-02T22:33:49.326794] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFR.csv [2025-10-02T22:33:49.326898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/URI.csv [2025-10-02T22:33:49.326994] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHP.csv [2025-10-02T22:33:49.327062] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGI.csv [2025-10-02T22:33:49.327153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZWS.csv [2025-10-02T22:33:49.327251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DGX.csv [2025-10-02T22:33:49.327349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBIN.csv [2025-10-02T22:33:49.327424] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFL.csv [2025-10-02T22:33:49.327504] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABG.csv [2025-10-02T22:33:49.327595] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YELP.csv [2025-10-02T22:33:49.327689] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UI.csv [2025-10-02T22:33:49.327806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITT.csv [2025-10-02T22:33:49.327922] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLK.csv [2025-10-02T22:33:49.328012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJE.csv [2025-10-02T22:33:49.328079] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGCO.csv [2025-10-02T22:33:49.328178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFIN.csv [2025-10-02T22:33:49.328320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MATX.csv [2025-10-02T22:33:49.328415] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWSN.csv [2025-10-02T22:33:49.328484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBR.csv [2025-10-02T22:33:49.328549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMY.csv [2025-10-02T22:33:49.328730] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COR.csv [2025-10-02T22:33:49.328826] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEG.csv [2025-10-02T22:33:49.328912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZD.csv [2025-10-02T22:33:49.329034] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LADR.csv [2025-10-02T22:33:49.329143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMRT.csv [2025-10-02T22:33:49.329250] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESTC.csv [2025-10-02T22:33:49.329357] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLM.csv [2025-10-02T22:33:49.329491] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARLO.csv [2025-10-02T22:33:49.329572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNAP.csv [2025-10-02T22:33:49.329667] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHS.csv [2025-10-02T22:33:49.329773] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCR.csv [2025-10-02T22:33:49.329902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSAN.csv [2025-10-02T22:33:49.329979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXE.csv [2025-10-02T22:33:49.330064] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCRD.csv [2025-10-02T22:33:49.330151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHT.csv [2025-10-02T22:33:49.330225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGO.csv [2025-10-02T22:33:49.330324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DT.csv [2025-10-02T22:33:49.330427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAW.csv [2025-10-02T22:33:49.330532] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SW.csv [2025-10-02T22:33:49.330628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELF.csv [2025-10-02T22:33:49.330753] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TME.csv [2025-10-02T22:33:49.330851] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYG.csv [2025-10-02T22:33:49.330918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AES.csv [2025-10-02T22:33:49.331004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAI.csv [2025-10-02T22:33:49.331098] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXPD.csv [2025-10-02T22:33:49.331167] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBI.csv [2025-10-02T22:33:49.331246] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UA.csv [2025-10-02T22:33:49.331341] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTOS.csv [2025-10-02T22:33:49.331489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDE.csv [2025-10-02T22:33:49.331584] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVC.csv [2025-10-02T22:33:49.331688] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOW.csv [2025-10-02T22:33:49.331780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFS.csv [2025-10-02T22:33:49.331850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFBS.csv [2025-10-02T22:33:49.331915] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXP.csv [2025-10-02T22:33:49.332015] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSL.csv [2025-10-02T22:33:49.332122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFK.csv [2025-10-02T22:33:49.332280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DELL.csv [2025-10-02T22:33:49.332391] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THO.csv [2025-10-02T22:33:49.332496] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAP.csv [2025-10-02T22:33:49.332623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALLE.csv [2025-10-02T22:33:49.332759] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLCO.csv [2025-10-02T22:33:49.332836] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMH.csv [2025-10-02T22:33:49.332903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBL.csv [2025-10-02T22:33:49.332993] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOCS.csv [2025-10-02T22:33:49.333110] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUN.csv [2025-10-02T22:33:49.333209] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BN.csv [2025-10-02T22:33:49.333288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQNR.csv [2025-10-02T22:33:49.333367] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHO.csv [2025-10-02T22:33:49.333462] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOMR.csv [2025-10-02T22:33:49.333556] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMBK.csv [2025-10-02T22:33:49.333842] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAGN.csv [2025-10-02T22:33:49.333952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPH.csv [2025-10-02T22:33:49.334048] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOA.csv [2025-10-02T22:33:49.334119] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVC.csv [2025-10-02T22:33:49.334205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSO.csv [2025-10-02T22:33:49.334319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STZ.csv [2025-10-02T22:33:49.334413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIO.csv [2025-10-02T22:33:49.334484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVX.csv [2025-10-02T22:33:49.334550] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDE.csv [2025-10-02T22:33:49.334633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDS.csv [2025-10-02T22:33:49.334760] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FERG.csv [2025-10-02T22:33:49.334899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBK.csv [2025-10-02T22:33:49.334994] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASIX.csv [2025-10-02T22:33:49.335121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOR.csv [2025-10-02T22:33:49.335199] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPC.csv [2025-10-02T22:33:49.335295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XYF.csv [2025-10-02T22:33:49.335423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBI.csv [2025-10-02T22:33:49.335559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TECK.csv [2025-10-02T22:33:49.335720] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCB.csv [2025-10-02T22:33:49.335817] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKC.csv [2025-10-02T22:33:49.335912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLX.csv [2025-10-02T22:33:49.336018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVZ.csv [2025-10-02T22:33:49.336180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMC.csv [2025-10-02T22:33:49.336273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDX.csv [2025-10-02T22:33:49.336358] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCN.csv [2025-10-02T22:33:49.336448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LHX.csv [2025-10-02T22:33:49.336514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARDC.csv [2025-10-02T22:33:49.336631] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WF.csv [2025-10-02T22:33:49.336804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMRE.csv [2025-10-02T22:33:49.336878] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AS.csv [2025-10-02T22:33:49.336945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWXT.csv [2025-10-02T22:33:49.337010] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANRO.csv [2025-10-02T22:33:49.337134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPVG.csv [2025-10-02T22:33:49.337229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFC.csv [2025-10-02T22:33:49.337306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNE.csv [2025-10-02T22:33:49.337410] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPV.csv [2025-10-02T22:33:49.337506] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SARO.csv [2025-10-02T22:33:49.337603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLND.csv [2025-10-02T22:33:49.337738] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLR.csv [2025-10-02T22:33:49.337865] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPAM.csv [2025-10-02T22:33:49.337981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPZ.csv [2025-10-02T22:33:49.338062] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRLL.csv [2025-10-02T22:33:49.338205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEM.csv [2025-10-02T22:33:49.338300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBN.csv [2025-10-02T22:33:49.338368] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCF.csv [2025-10-02T22:33:49.338496] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHD.csv [2025-10-02T22:33:49.338606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETY.csv [2025-10-02T22:33:49.338733] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZETA.csv [2025-10-02T22:33:49.338817] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WFC.csv [2025-10-02T22:33:49.338889] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UP.csv [2025-10-02T22:33:49.338957] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLS.csv [2025-10-02T22:33:49.339022] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACHR.csv [2025-10-02T22:33:49.339091] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STAG.csv [2025-10-02T22:33:49.339156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCIF.csv [2025-10-02T22:33:49.339224] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KODK.csv [2025-10-02T22:33:49.339335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALB.csv [2025-10-02T22:33:49.339430] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VBF.csv [2025-10-02T22:33:49.339543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RY.csv [2025-10-02T22:33:49.339697] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDRL.csv [2025-10-02T22:33:49.339804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATKR.csv [2025-10-02T22:33:49.339919] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BX.csv [2025-10-02T22:33:49.340046] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GVA.csv [2025-10-02T22:33:49.340189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIRK.csv [2025-10-02T22:33:49.340294] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOMA.csv [2025-10-02T22:33:49.340390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNP.csv [2025-10-02T22:33:49.340484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNS.csv [2025-10-02T22:33:49.340578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQR.csv [2025-10-02T22:33:49.340682] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECO.csv [2025-10-02T22:33:49.340788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBI.csv [2025-10-02T22:33:49.340886] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEV.csv [2025-10-02T22:33:49.340957] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAB.csv [2025-10-02T22:33:49.341025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMRC.csv [2025-10-02T22:33:49.341090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNMD.csv [2025-10-02T22:33:49.341156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DY.csv [2025-10-02T22:33:49.341232] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMA.csv [2025-10-02T22:33:49.341349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALIT.csv [2025-10-02T22:33:49.341489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UAN.csv [2025-10-02T22:33:49.341621] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AME.csv [2025-10-02T22:33:49.341944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZB.csv [2025-10-02T22:33:49.342020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CABO.csv [2025-10-02T22:33:49.342099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KKRS.csv [2025-10-02T22:33:49.342209] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJD.csv [2025-10-02T22:33:49.342305] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRC.csv [2025-10-02T22:33:49.342374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGA.csv [2025-10-02T22:33:49.342481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BE.csv [2025-10-02T22:33:49.342577] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASG.csv [2025-10-02T22:33:49.342681] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGB.csv [2025-10-02T22:33:49.342784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTM.csv [2025-10-02T22:33:49.342879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BANC.csv [2025-10-02T22:33:49.342949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSTK.csv [2025-10-02T22:33:49.343015] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FC.csv [2025-10-02T22:33:49.343081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CADE.csv [2025-10-02T22:33:49.343148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMED.csv [2025-10-02T22:33:49.343230] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EL.csv [2025-10-02T22:33:49.343321] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBVA.csv [2025-10-02T22:33:49.343391] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SJT.csv [2025-10-02T22:33:49.343468] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEI.csv [2025-10-02T22:33:49.343561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEKE.csv [2025-10-02T22:33:49.343684] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGS.csv [2025-10-02T22:33:49.343810] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTI.csv [2025-10-02T22:33:49.343887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTLE.csv [2025-10-02T22:33:49.343977] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELV.csv [2025-10-02T22:33:49.344071] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAH.csv [2025-10-02T22:33:49.344151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSQ.csv [2025-10-02T22:33:49.344247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIL.csv [2025-10-02T22:33:49.344326] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHVN.csv [2025-10-02T22:33:49.344480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHS.csv [2025-10-02T22:33:49.344572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTE.csv [2025-10-02T22:33:49.344665] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHG.csv [2025-10-02T22:33:49.344777] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASR.csv [2025-10-02T22:33:49.344903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFS.csv [2025-10-02T22:33:49.344971] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APD.csv [2025-10-02T22:33:49.345036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BORR.csv [2025-10-02T22:33:49.345113] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BY.csv [2025-10-02T22:33:49.345217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IONQ.csv [2025-10-02T22:33:49.345323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBBB.csv [2025-10-02T22:33:49.345418] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JEQ.csv [2025-10-02T22:33:49.345505] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZF.csv [2025-10-02T22:33:49.345596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPH.csv [2025-10-02T22:33:49.345691] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFII.csv [2025-10-02T22:33:49.345782] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHO.csv [2025-10-02T22:33:49.345897] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPO.csv [2025-10-02T22:33:49.345987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RZB.csv [2025-10-02T22:33:49.346064] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXFR.csv [2025-10-02T22:33:49.346158] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBL.csv [2025-10-02T22:33:49.346227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCSF.csv [2025-10-02T22:33:49.346300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKN.csv [2025-10-02T22:33:49.346396] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WFG.csv [2025-10-02T22:33:49.346462] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOC.csv [2025-10-02T22:33:49.346536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSLX.csv [2025-10-02T22:33:49.346628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AUNA.csv [2025-10-02T22:33:49.346755] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVG.csv [2025-10-02T22:33:49.346858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHG.csv [2025-10-02T22:33:49.346953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVR.csv [2025-10-02T22:33:49.347021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPD.csv [2025-10-02T22:33:49.347086] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANVS.csv [2025-10-02T22:33:49.347186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUBO.csv [2025-10-02T22:33:49.347280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IOT.csv [2025-10-02T22:33:49.347405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLW.csv [2025-10-02T22:33:49.347496] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOF.csv [2025-10-02T22:33:49.347566] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAL.csv [2025-10-02T22:33:49.347667] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMR.csv [2025-10-02T22:33:49.347773] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHI.csv [2025-10-02T22:33:49.347917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TS.csv [2025-10-02T22:33:49.348023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICE.csv [2025-10-02T22:33:49.348132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPNT.csv [2025-10-02T22:33:49.348228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CODI.csv [2025-10-02T22:33:49.348298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZM.csv [2025-10-02T22:33:49.348386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAT.csv [2025-10-02T22:33:49.348503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAND.csv [2025-10-02T22:33:49.348609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRH.csv [2025-10-02T22:33:49.348739] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABT.csv [2025-10-02T22:33:49.348815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRBG.csv [2025-10-02T22:33:49.348883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRMN.csv [2025-10-02T22:33:49.348950] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPB.csv [2025-10-02T22:33:49.349024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JQC.csv [2025-10-02T22:33:49.349119] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDDY.csv [2025-10-02T22:33:49.349198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCY.csv [2025-10-02T22:33:49.349291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DE.csv [2025-10-02T22:33:49.349362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FN.csv [2025-10-02T22:33:49.349480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFA.csv [2025-10-02T22:33:49.349574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAM.csv [2025-10-02T22:33:49.349827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIN.csv [2025-10-02T22:33:49.349963] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFX.csv [2025-10-02T22:33:49.350052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDO.csv [2025-10-02T22:33:49.350158] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDOC.csv [2025-10-02T22:33:49.350275] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMT.csv [2025-10-02T22:33:49.350370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDU.csv [2025-10-02T22:33:49.350439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXSL.csv [2025-10-02T22:33:49.350549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPM.csv [2025-10-02T22:33:49.350701] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZGN.csv [2025-10-02T22:33:49.350791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIR.csv [2025-10-02T22:33:49.350870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETJ.csv [2025-10-02T22:33:49.350975] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLC.csv [2025-10-02T22:33:49.351092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEVI.csv [2025-10-02T22:33:49.351215] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMB.csv [2025-10-02T22:33:49.351309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTK.csv [2025-10-02T22:33:49.351435] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BABA.csv [2025-10-02T22:33:49.351503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ET.csv [2025-10-02T22:33:49.351572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTF.csv [2025-10-02T22:33:49.351636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMT.csv [2025-10-02T22:33:49.351752] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZBH.csv [2025-10-02T22:33:49.351833] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STN.csv [2025-10-02T22:33:49.351939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGT.csv [2025-10-02T22:33:49.352038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDV.csv [2025-10-02T22:33:49.352132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPI.csv [2025-10-02T22:33:49.352201] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WELL.csv [2025-10-02T22:33:49.352295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMC.csv [2025-10-02T22:33:49.352455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASH.csv [2025-10-02T22:33:49.352549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVT.csv [2025-10-02T22:33:49.352627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACRE.csv [2025-10-02T22:33:49.352764] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TT.csv [2025-10-02T22:33:49.352860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYF.csv [2025-10-02T22:33:49.352944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCC.csv [2025-10-02T22:33:49.353032] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDX.csv [2025-10-02T22:33:49.353102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KREF.csv [2025-10-02T22:33:49.353177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRO.csv [2025-10-02T22:33:49.353306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AAP.csv [2025-10-02T22:33:49.353407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCX.csv [2025-10-02T22:33:49.353515] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPMT.csv [2025-10-02T22:33:49.353614] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SON.csv [2025-10-02T22:33:49.353739] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXP.csv [2025-10-02T22:33:49.353815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPF.csv [2025-10-02T22:33:49.353899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAP.csv [2025-10-02T22:33:49.353993] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLKP.csv [2025-10-02T22:33:49.354069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCD.csv [2025-10-02T22:33:49.354209] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DCO.csv [2025-10-02T22:33:49.354342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRP.csv [2025-10-02T22:33:49.354450] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTC.csv [2025-10-02T22:33:49.354545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVUE.csv [2025-10-02T22:33:49.354624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWK.csv [2025-10-02T22:33:49.354741] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXR.csv [2025-10-02T22:33:49.354823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SA.csv [2025-10-02T22:33:49.354957] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNL.csv [2025-10-02T22:33:49.355045] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXO.csv [2025-10-02T22:33:49.355124] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRU.csv [2025-10-02T22:33:49.355264] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CM.csv [2025-10-02T22:33:49.355361] [INFO ] [LOCAL ] Deleted 1492 derivative data files. [2025-10-02T22:33:49.355398] [INFO ] [LOCAL ] Scanning primary storage for available symbols. [2025-10-02T22:33:49.357543] [INFO ] [LOCAL ] Found 1975 symbols with primary data. [2025-10-02T22:33:49.358234] [INFO ] [MAIN ] Starting parallel derivative generation with 3 worker threads for 1975 symbols [2025-10-02T22:33:49.359207] [INFO ] [MAIN ] A: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:33:49.359575] [INFO ] [MAIN ] AA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:33:49.360226] [INFO ] [MAIN ] AAP: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:33:49.435235] [DEBUG] [LOCAL ] AAP: Loaded 52300 existing records from primary storage. [2025-10-02T22:33:49.449233] [INFO ] [MAIN ] AAP: Loaded 52300 primary data records. [2025-10-02T22:33:49.585595] [DEBUG] [LOCAL ] AA: Loaded 54005 existing records from primary storage. [2025-10-02T22:33:49.598436] [INFO ] [MAIN ] AA: Loaded 54005 primary data records. [2025-10-02T22:33:49.681269] [DEBUG] [LOCAL ] A: Loaded 51103 existing records from primary storage. [2025-10-02T22:33:49.732468] [INFO ] [MAIN ] A: Loaded 51103 primary data records. [2025-10-02T22:33:50.606094] [DEBUG] [MAIN ] AAP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:33:50.608724] [INFO ] [MAIN ] AAP: Generated 1807 derivative records from 52300 primary records. [2025-10-02T22:33:50.610782] [DEBUG] [LOCAL ] AAP: Saving derivative data. [2025-10-02T22:33:50.629004] [DEBUG] [MAIN ] AA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:33:50.658375] [INFO ] [MAIN ] AA: Generated 1807 derivative records from 54005 primary records. [2025-10-02T22:33:50.660029] [DEBUG] [MAIN ] A: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:33:50.660218] [DEBUG] [LOCAL ] AA: Saving derivative data. [2025-10-02T22:33:50.660959] [INFO ] [MAIN ] A: Generated 1807 derivative records from 51103 primary records. [2025-10-02T22:33:50.662178] [DEBUG] [LOCAL ] A: Saving derivative data. [2025-10-02T22:33:50.664195] [DEBUG] [LOCAL ] AAP: Derivative data saved (1807 records). [2025-10-02T22:33:50.673252] [INFO ] [MAIN ] AAP: Successfully saved derivative data. [2025-10-02T22:33:50.678602] [INFO ] [MAIN ] Derivative Progress: 1/1975 symbols completed. AAP took 1.3s. Estimated remaining: 43m 28s. Rate: 45.4 symbols/min [2025-10-02T22:33:50.679723] [INFO ] [MAIN ] AAT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:33:50.706045] [DEBUG] [LOCAL ] AA: Derivative data saved (1807 records). [2025-10-02T22:33:50.707160] [INFO ] [MAIN ] AA: Successfully saved derivative data. [2025-10-02T22:33:50.709917] [INFO ] [MAIN ] Derivative Progress: 2/1975 symbols completed. AA took 1.4s. Estimated remaining: 22m 14s. Rate: 88.7 symbols/min [2025-10-02T22:33:50.710148] [INFO ] [MAIN ] AB: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:33:50.711474] [DEBUG] [LOCAL ] A: Derivative data saved (1807 records). [2025-10-02T22:33:50.711542] [INFO ] [MAIN ] A: Successfully saved derivative data. [2025-10-02T22:33:50.714175] [INFO ] [MAIN ] Derivative Progress: 3/1975 symbols completed. A took 1.4s. Estimated remaining: 14m 52s. Rate: 132.7 symbols/min [2025-10-02T22:33:50.714450] [INFO ] [MAIN ] ABBV: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:33:50.753400] [DEBUG] [LOCAL ] AAT: Loaded 30621 existing records from primary storage. [2025-10-02T22:33:50.753602] [INFO ] [MAIN ] AAT: Loaded 30621 primary data records. [2025-10-02T22:33:50.878005] [DEBUG] [LOCAL ] AB: Loaded 27632 existing records from primary storage. [2025-10-02T22:33:50.882472] [INFO ] [MAIN ] AB: Loaded 27632 primary data records. [2025-10-02T22:33:51.258449] [DEBUG] [LOCAL ] ABBV: Loaded 54074 existing records from primary storage. [2025-10-02T22:33:51.264010] [INFO ] [MAIN ] ABBV: Loaded 54074 primary data records. [2025-10-02T22:33:51.917970] [DEBUG] [MAIN ] AAT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:33:51.919933] [INFO ] [MAIN ] AAT: Generated 1807 derivative records from 30621 primary records. [2025-10-02T22:33:51.920196] [DEBUG] [LOCAL ] AAT: Saving derivative data. [2025-10-02T22:33:51.961338] [DEBUG] [MAIN ] AB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:33:51.963568] [DEBUG] [LOCAL ] AAT: Derivative data saved (1807 records). [2025-10-02T22:33:51.964811] [INFO ] [MAIN ] AAT: Successfully saved derivative data. [2025-10-02T22:33:51.964575] [INFO ] [MAIN ] AB: Generated 1807 derivative records from 27632 primary records. [2025-10-02T22:33:51.966884] [INFO ] [MAIN ] Derivative Progress: 4/1975 symbols completed. AAT took 1.3s. Estimated remaining: 21m 26s. Rate: 92.0 symbols/min [2025-10-02T22:33:51.967094] [DEBUG] [LOCAL ] AB: Saving derivative data. [2025-10-02T22:33:51.967415] [INFO ] [MAIN ] ABCB: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:33:51.988513] [DEBUG] [LOCAL ] AB: Derivative data saved (1807 records). [2025-10-02T22:33:51.989903] [INFO ] [MAIN ] AB: Successfully saved derivative data. [2025-10-02T22:33:51.993396] [INFO ] [MAIN ] Derivative Progress: 5/1975 symbols completed. AB took 1.3s. Estimated remaining: 17m 18s. Rate: 113.8 symbols/min [2025-10-02T22:33:51.993917] [INFO ] [MAIN ] ABEV: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:33:52.023275] [DEBUG] [MAIN ] ABBV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:33:52.024410] [INFO ] [MAIN ] ABBV: Generated 1807 derivative records from 54074 primary records. [2025-10-02T22:33:52.024683] [DEBUG] [LOCAL ] ABBV: Saving derivative data. [2025-10-02T22:33:52.054965] [DEBUG] [LOCAL ] ABCB: Loaded 30713 existing records from primary storage. [2025-10-02T22:33:52.056423] [INFO ] [MAIN ] ABCB: Loaded 30713 primary data records. [2025-10-02T22:33:52.099765] [DEBUG] [LOCAL ] ABBV: Derivative data saved (1807 records). [2025-10-02T22:33:52.130435] [INFO ] [MAIN ] ABBV: Successfully saved derivative data. [2025-10-02T22:33:52.152305] [INFO ] [MAIN ] Derivative Progress: 6/1975 symbols completed. ABBV took 1.4s. Estimated remaining: 15m 17s. Rate: 128.8 symbols/min [2025-10-02T22:33:52.194821] [INFO ] [MAIN ] ABG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:33:52.437326] [DEBUG] [LOCAL ] ABEV: Loaded 53668 existing records from primary storage. [2025-10-02T22:33:52.442737] [INFO ] [MAIN ] ABEV: Loaded 53668 primary data records. [2025-10-02T22:33:52.519157] [DEBUG] [LOCAL ] ABG: Loaded 18742 existing records from primary storage. [2025-10-02T22:33:52.534416] [INFO ] [MAIN ] ABG: Loaded 18742 primary data records. [2025-10-02T22:33:53.194963] [DEBUG] [MAIN ] ABCB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:33:53.196075] [INFO ] [MAIN ] ABCB: Generated 1807 derivative records from 30713 primary records. [2025-10-02T22:33:53.196452] [DEBUG] [LOCAL ] ABCB: Saving derivative data. [2025-10-02T22:33:53.219997] [DEBUG] [LOCAL ] ABCB: Derivative data saved (1807 records). [2025-10-02T22:33:53.220614] [INFO ] [MAIN ] ABCB: Successfully saved derivative data. [2025-10-02T22:33:53.223516] [INFO ] [MAIN ] Derivative Progress: 7/1975 symbols completed. ABCB took 1.3s. Estimated remaining: 18m 7s. Rate: 108.6 symbols/min [2025-10-02T22:33:53.223865] [INFO ] [MAIN ] ABR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:33:53.246228] [DEBUG] [MAIN ] ABEV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:33:53.247592] [INFO ] [MAIN ] ABEV: Generated 1807 derivative records from 53668 primary records. [2025-10-02T22:33:53.260102] [DEBUG] [LOCAL ] ABEV: Saving derivative data. [2025-10-02T22:33:53.261272] [DEBUG] [MAIN ] ABG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:33:53.262962] [INFO ] [MAIN ] ABG: Generated 1807 derivative records from 18742 primary records. [2025-10-02T22:33:53.263405] [DEBUG] [LOCAL ] ABG: Saving derivative data. [2025-10-02T22:33:53.295013] [DEBUG] [LOCAL ] ABG: Derivative data saved (1807 records). [2025-10-02T22:33:53.296226] [INFO ] [MAIN ] ABG: Successfully saved derivative data. [2025-10-02T22:33:53.299157] [INFO ] [MAIN ] Derivative Progress: 8/1975 symbols completed. ABG took 1.1s. Estimated remaining: 16m 9s. Rate: 121.8 symbols/min [2025-10-02T22:33:53.300132] [INFO ] [MAIN ] ABT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:33:53.301196] [DEBUG] [LOCAL ] ABEV: Derivative data saved (1807 records). [2025-10-02T22:33:53.301298] [INFO ] [MAIN ] ABEV: Successfully saved derivative data. [2025-10-02T22:33:53.303423] [INFO ] [MAIN ] Derivative Progress: 9/1975 symbols completed. ABEV took 1.3s. Estimated remaining: 14m 22s. Rate: 136.9 symbols/min [2025-10-02T22:33:53.303949] [INFO ] [MAIN ] ACA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:33:53.350527] [DEBUG] [LOCAL ] ABR: Loaded 52372 existing records from primary storage. [2025-10-02T22:33:53.351630] [INFO ] [MAIN ] ABR: Loaded 52372 primary data records. [2025-10-02T22:33:53.434473] [DEBUG] [LOCAL ] ACA: Loaded 23486 existing records from primary storage. [2025-10-02T22:33:53.464183] [INFO ] [MAIN ] ACA: Loaded 23486 primary data records. [2025-10-02T22:33:53.897298] [DEBUG] [LOCAL ] ABT: Loaded 54010 existing records from primary storage. [2025-10-02T22:33:53.919830] [INFO ] [MAIN ] ABT: Loaded 54010 primary data records. [2025-10-02T22:33:54.556541] [DEBUG] [MAIN ] ABR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:33:54.561357] [INFO ] [MAIN ] ABR: Generated 1807 derivative records from 52372 primary records. [2025-10-02T22:33:54.563406] [DEBUG] [LOCAL ] ABR: Saving derivative data. [2025-10-02T22:33:54.593035] [DEBUG] [MAIN ] ACA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:33:54.594069] [INFO ] [MAIN ] ACA: Generated 1807 derivative records from 23486 primary records. [2025-10-02T22:33:54.595046] [DEBUG] [LOCAL ] ACA: Saving derivative data. [2025-10-02T22:33:54.596599] [DEBUG] [LOCAL ] ABR: Derivative data saved (1807 records). [2025-10-02T22:33:54.596818] [INFO ] [MAIN ] ABR: Successfully saved derivative data. [2025-10-02T22:33:54.599281] [INFO ] [MAIN ] Derivative Progress: 10/1975 symbols completed. ABR took 1.4s. Estimated remaining: 17m 10s. Rate: 114.5 symbols/min [2025-10-02T22:33:54.599708] [INFO ] [MAIN ] ACCO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:33:54.620267] [DEBUG] [LOCAL ] ACA: Derivative data saved (1807 records). [2025-10-02T22:33:54.620681] [INFO ] [MAIN ] ACA: Successfully saved derivative data. [2025-10-02T22:33:54.622771] [INFO ] [MAIN ] Derivative Progress: 11/1975 symbols completed. ACA took 1.3s. Estimated remaining: 15m 40s. Rate: 125.4 symbols/min [2025-10-02T22:33:54.623002] [INFO ] [MAIN ] ACHR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:33:54.636771] [DEBUG] [MAIN ] ABT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:33:54.637596] [INFO ] [MAIN ] ABT: Generated 1807 derivative records from 54010 primary records. [2025-10-02T22:33:54.637711] [DEBUG] [LOCAL ] ABT: Saving derivative data. [2025-10-02T22:33:54.666053] [DEBUG] [LOCAL ] ABT: Derivative data saved (1807 records). [2025-10-02T22:33:54.666375] [INFO ] [MAIN ] ABT: Successfully saved derivative data. [2025-10-02T22:33:54.669712] [INFO ] [MAIN ] Derivative Progress: 12/1975 symbols completed. ABT took 1.4s. Estimated remaining: 14m 29s. Rate: 135.5 symbols/min [2025-10-02T22:33:54.681933] [INFO ] [MAIN ] ACI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:33:54.684437] [DEBUG] [LOCAL ] ACCO: Loaded 37574 existing records from primary storage. [2025-10-02T22:33:54.684608] [INFO ] [MAIN ] ACCO: Loaded 37574 primary data records. [2025-10-02T22:33:54.872267] [DEBUG] [LOCAL ] ACHR: Loaded 54208 existing records from primary storage. [2025-10-02T22:33:54.890147] [INFO ] [MAIN ] ACHR: Loaded 54208 primary data records. [2025-10-02T22:33:55.233537] [DEBUG] [LOCAL ] ACI: Loaded 53643 existing records from primary storage. [2025-10-02T22:33:55.261794] [INFO ] [MAIN ] ACI: Loaded 53643 primary data records. [2025-10-02T22:33:55.779407] [DEBUG] [MAIN ] ACCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:33:55.780458] [INFO ] [MAIN ] ACCO: Generated 1807 derivative records from 37574 primary records. [2025-10-02T22:33:55.780671] [DEBUG] [LOCAL ] ACCO: Saving derivative data. [2025-10-02T22:33:55.803421] [DEBUG] [LOCAL ] ACCO: Derivative data saved (1807 records). [2025-10-02T22:33:55.803937] [INFO ] [MAIN ] ACCO: Successfully saved derivative data. [2025-10-02T22:33:55.814286] [INFO ] [MAIN ] Derivative Progress: 13/1975 symbols completed. ACCO took 1.2s. Estimated remaining: 16m 14s. Rate: 120.8 symbols/min [2025-10-02T22:33:55.819920] [DEBUG] [MAIN ] ACHR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:33:55.820785] [INFO ] [MAIN ] ACHR: Generated 1807 derivative records from 54208 primary records. [2025-10-02T22:33:55.820870] [DEBUG] [LOCAL ] ACHR: Saving derivative data. [2025-10-02T22:33:55.844493] [DEBUG] [LOCAL ] ACHR: Derivative data saved (1807 records). [2025-10-02T22:33:55.844962] [INFO ] [MAIN ] ACHR: Successfully saved derivative data. [2025-10-02T22:33:55.846964] [INFO ] [MAIN ] Derivative Progress: 14/1975 symbols completed. ACHR took 1.2s. Estimated remaining: 15m 9s. Rate: 129.4 symbols/min [2025-10-02T22:33:55.865129] [DEBUG] [MAIN ] ACI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:33:55.865899] [INFO ] [MAIN ] ACI: Generated 1807 derivative records from 53643 primary records. [2025-10-02T22:33:55.865961] [DEBUG] [LOCAL ] ACI: Saving derivative data. [2025-10-02T22:33:55.884211] [DEBUG] [LOCAL ] ACI: Derivative data saved (1807 records). [2025-10-02T22:33:55.884361] [INFO ] [MAIN ] ACI: Successfully saved derivative data. [2025-10-02T22:33:55.886947] [INFO ] [MAIN ] Derivative Progress: 15/1975 symbols completed. ACI took 1.2s. Estimated remaining: 14m 13s. Rate: 137.8 symbols/min [2025-10-02T22:33:55.887638] [INFO ] [MAIN ] ACM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:33:55.887539] [INFO ] [MAIN ] ACN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:33:55.888017] [INFO ] [MAIN ] ACP: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:33:55.957695] [DEBUG] [LOCAL ] ACP: Loaded 31272 existing records from primary storage. [2025-10-02T22:33:55.972767] [INFO ] [MAIN ] ACP: Loaded 31272 primary data records. [2025-10-02T22:33:55.991229] [DEBUG] [LOCAL ] ACN: Loaded 53816 existing records from primary storage. [2025-10-02T22:33:56.005471] [INFO ] [MAIN ] ACN: Loaded 53816 primary data records. [2025-10-02T22:33:56.012390] [DEBUG] [LOCAL ] ACM: Loaded 43361 existing records from primary storage. [2025-10-02T22:33:56.040030] [INFO ] [MAIN ] ACM: Loaded 43361 primary data records. [2025-10-02T22:33:57.108586] [DEBUG] [MAIN ] ACN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:33:57.109764] [INFO ] [MAIN ] ACN: Generated 1807 derivative records from 53816 primary records. [2025-10-02T22:33:57.109869] [DEBUG] [LOCAL ] ACN: Saving derivative data. [2025-10-02T22:33:57.147794] [DEBUG] [LOCAL ] ACN: Derivative data saved (1807 records). [2025-10-02T22:33:57.148116] [INFO ] [MAIN ] ACN: Successfully saved derivative data. [2025-10-02T22:33:57.148638] [DEBUG] [MAIN ] ACM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:33:57.150883] [INFO ] [MAIN ] Derivative Progress: 16/1975 symbols completed. ACN took 1.3s. Estimated remaining: 15m 54s. Rate: 123.2 symbols/min [2025-10-02T22:33:57.151288] [INFO ] [MAIN ] ACR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:33:57.160867] [INFO ] [MAIN ] ACM: Generated 1807 derivative records from 43361 primary records. [2025-10-02T22:33:57.161093] [DEBUG] [LOCAL ] ACM: Saving derivative data. [2025-10-02T22:33:57.168033] [DEBUG] [MAIN ] ACP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:33:57.170978] [INFO ] [MAIN ] ACP: Generated 1807 derivative records from 31272 primary records. [2025-10-02T22:33:57.171442] [DEBUG] [LOCAL ] ACP: Saving derivative data. [2025-10-02T22:33:57.204576] [DEBUG] [LOCAL ] ACM: Derivative data saved (1807 records). [2025-10-02T22:33:57.206703] [INFO ] [MAIN ] ACM: Successfully saved derivative data. [2025-10-02T22:33:57.203395] [DEBUG] [LOCAL ] ACR: Loaded 5990 existing records from primary storage. [2025-10-02T22:33:57.209227] [INFO ] [MAIN ] Derivative Progress: 17/1975 symbols completed. ACM took 1.3s. Estimated remaining: 15m 4s. Rate: 129.9 symbols/min [2025-10-02T22:33:57.210573] [INFO ] [MAIN ] ACR: Loaded 5990 primary data records. [2025-10-02T22:33:57.210048] [INFO ] [MAIN ] ACRE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:33:57.303442] [DEBUG] [LOCAL ] ACP: Derivative data saved (1807 records). [2025-10-02T22:33:57.318681] [INFO ] [MAIN ] ACP: Successfully saved derivative data. [2025-10-02T22:33:57.337120] [INFO ] [MAIN ] Derivative Progress: 18/1975 symbols completed. ACP took 1.4s. Estimated remaining: 14m 28s. Rate: 135.3 symbols/min [2025-10-02T22:33:57.352894] [INFO ] [MAIN ] ACV: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:33:57.588368] [DEBUG] [LOCAL ] ACV: Loaded 7383 existing records from primary storage. [2025-10-02T22:33:57.588585] [INFO ] [MAIN ] ACV: Loaded 7383 primary data records. [2025-10-02T22:33:57.678945] [DEBUG] [LOCAL ] ACRE: Loaded 33897 existing records from primary storage. [2025-10-02T22:33:57.705293] [INFO ] [MAIN ] ACRE: Loaded 33897 primary data records. [2025-10-02T22:33:58.306515] [DEBUG] [MAIN ] ACR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:33:58.308490] [INFO ] [MAIN ] ACR: Generated 1807 derivative records from 5990 primary records. [2025-10-02T22:33:58.309317] [DEBUG] [LOCAL ] ACR: Saving derivative data. [2025-10-02T22:33:58.334434] [DEBUG] [LOCAL ] ACR: Derivative data saved (1807 records). [2025-10-02T22:33:58.337252] [INFO ] [MAIN ] ACR: Successfully saved derivative data. [2025-10-02T22:33:58.340856] [INFO ] [MAIN ] Derivative Progress: 19/1975 symbols completed. ACR took 1.2s. Estimated remaining: 15m 25s. Rate: 126.9 symbols/min [2025-10-02T22:33:58.341483] [INFO ] [MAIN ] ACVA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:33:58.355931] [DEBUG] [MAIN ] ACV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:33:58.356825] [INFO ] [MAIN ] ACV: Generated 1807 derivative records from 7383 primary records. [2025-10-02T22:33:58.357039] [DEBUG] [LOCAL ] ACV: Saving derivative data. [2025-10-02T22:33:58.376551] [DEBUG] [LOCAL ] ACV: Derivative data saved (1807 records). [2025-10-02T22:33:58.377580] [INFO ] [MAIN ] ACV: Successfully saved derivative data. [2025-10-02T22:33:58.379820] [INFO ] [MAIN ] Derivative Progress: 20/1975 symbols completed. ACV took 1.0s. Estimated remaining: 14m 42s. Rate: 133.0 symbols/min [2025-10-02T22:33:58.380010] [INFO ] [MAIN ] ADCT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:33:58.396613] [DEBUG] [MAIN ] ACRE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:33:58.397534] [INFO ] [MAIN ] ACRE: Generated 1807 derivative records from 33897 primary records. [2025-10-02T22:33:58.397737] [DEBUG] [LOCAL ] ACRE: Saving derivative data. [2025-10-02T22:33:58.428543] [DEBUG] [LOCAL ] ACRE: Derivative data saved (1807 records). [2025-10-02T22:33:58.436318] [INFO ] [MAIN ] ACRE: Successfully saved derivative data. [2025-10-02T22:33:58.439202] [INFO ] [MAIN ] Derivative Progress: 21/1975 symbols completed. ACRE took 1.2s. Estimated remaining: 14m 5s. Rate: 138.7 symbols/min [2025-10-02T22:33:58.439546] [INFO ] [MAIN ] ADM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:33:58.469742] [DEBUG] [LOCAL ] ACVA: Loaded 49607 existing records from primary storage. [2025-10-02T22:33:58.471225] [INFO ] [MAIN ] ACVA: Loaded 49607 primary data records. [2025-10-02T22:33:58.477204] [DEBUG] [LOCAL ] ADCT: Loaded 34861 existing records from primary storage. [2025-10-02T22:33:58.484674] [INFO ] [MAIN ] ADCT: Loaded 34861 primary data records. [2025-10-02T22:33:59.218419] [DEBUG] [LOCAL ] ADM: Loaded 53777 existing records from primary storage. [2025-10-02T22:33:59.219571] [INFO ] [MAIN ] ADM: Loaded 53777 primary data records. [2025-10-02T22:33:59.587267] [DEBUG] [MAIN ] ADCT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:33:59.589218] [INFO ] [MAIN ] ADCT: Generated 1807 derivative records from 34861 primary records. [2025-10-02T22:33:59.589487] [DEBUG] [LOCAL ] ADCT: Saving derivative data. [2025-10-02T22:33:59.616360] [DEBUG] [MAIN ] ACVA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:33:59.620712] [INFO ] [MAIN ] ACVA: Generated 1807 derivative records from 49607 primary records. [2025-10-02T22:33:59.625720] [DEBUG] [LOCAL ] ACVA: Saving derivative data. [2025-10-02T22:33:59.625621] [DEBUG] [LOCAL ] ADCT: Derivative data saved (1807 records). [2025-10-02T22:33:59.626749] [INFO ] [MAIN ] ADCT: Successfully saved derivative data. [2025-10-02T22:33:59.628949] [INFO ] [MAIN ] Derivative Progress: 22/1975 symbols completed. ADCT took 1.2s. Estimated remaining: 15m 12s. Rate: 128.5 symbols/min [2025-10-02T22:33:59.629793] [INFO ] [MAIN ] ADNT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:33:59.649208] [DEBUG] [LOCAL ] ACVA: Derivative data saved (1807 records). [2025-10-02T22:33:59.650901] [INFO ] [MAIN ] ACVA: Successfully saved derivative data. [2025-10-02T22:33:59.654528] [INFO ] [MAIN ] Derivative Progress: 23/1975 symbols completed. ACVA took 1.3s. Estimated remaining: 14m 34s. Rate: 134.0 symbols/min [2025-10-02T22:33:59.655025] [INFO ] [MAIN ] ADT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:33:59.669723] [DEBUG] [MAIN ] ADM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:33:59.670515] [INFO ] [MAIN ] ADM: Generated 1807 derivative records from 53777 primary records. [2025-10-02T22:33:59.670676] [DEBUG] [LOCAL ] ADM: Saving derivative data. [2025-10-02T22:33:59.688446] [DEBUG] [LOCAL ] ADM: Derivative data saved (1807 records). [2025-10-02T22:33:59.688586] [INFO ] [MAIN ] ADM: Successfully saved derivative data. [2025-10-02T22:33:59.690992] [INFO ] [MAIN ] Derivative Progress: 24/1975 symbols completed. ADM took 1.3s. Estimated remaining: 14m 0s. Rate: 139.4 symbols/min [2025-10-02T22:33:59.691214] [INFO ] [MAIN ] ADX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:33:59.746831] [DEBUG] [LOCAL ] ADNT: Loaded 47495 existing records from primary storage. [2025-10-02T22:33:59.747073] [INFO ] [MAIN ] ADNT: Loaded 47495 primary data records. [2025-10-02T22:33:59.793477] [DEBUG] [LOCAL ] ADX: Loaded 27720 existing records from primary storage. [2025-10-02T22:33:59.819084] [INFO ] [MAIN ] ADX: Loaded 27720 primary data records. [2025-10-02T22:33:59.862919] [DEBUG] [LOCAL ] ADT: Loaded 53842 existing records from primary storage. [2025-10-02T22:33:59.979850] [INFO ] [MAIN ] ADT: Loaded 53842 primary data records. [2025-10-02T22:34:00.884232] [DEBUG] [MAIN ] ADX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:00.885334] [INFO ] [MAIN ] ADX: Generated 1807 derivative records from 27720 primary records. [2025-10-02T22:34:00.893339] [DEBUG] [LOCAL ] ADX: Saving derivative data. [2025-10-02T22:34:00.913522] [DEBUG] [MAIN ] ADNT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:00.920493] [INFO ] [MAIN ] ADNT: Generated 1807 derivative records from 47495 primary records. [2025-10-02T22:34:00.920822] [DEBUG] [LOCAL ] ADNT: Saving derivative data. [2025-10-02T22:34:00.950070] [DEBUG] [LOCAL ] ADX: Derivative data saved (1807 records). [2025-10-02T22:34:00.949616] [DEBUG] [MAIN ] ADT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:00.954845] [INFO ] [MAIN ] ADT: Generated 1807 derivative records from 53842 primary records. [2025-10-02T22:34:00.953105] [INFO ] [MAIN ] ADX: Successfully saved derivative data. [2025-10-02T22:34:00.955805] [DEBUG] [LOCAL ] ADT: Saving derivative data. [2025-10-02T22:34:00.959050] [INFO ] [MAIN ] Derivative Progress: 25/1975 symbols completed. ADX took 1.3s. Estimated remaining: 15m 5s. Rate: 129.3 symbols/min [2025-10-02T22:34:00.960602] [INFO ] [MAIN ] AEE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:00.977063] [DEBUG] [LOCAL ] ADNT: Derivative data saved (1807 records). [2025-10-02T22:34:00.977692] [INFO ] [MAIN ] ADNT: Successfully saved derivative data. [2025-10-02T22:34:00.980034] [INFO ] [MAIN ] Derivative Progress: 26/1975 symbols completed. ADNT took 1.4s. Estimated remaining: 14m 31s. Rate: 134.2 symbols/min [2025-10-02T22:34:00.980601] [INFO ] [MAIN ] AEFC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:00.985233] [DEBUG] [LOCAL ] ADT: Derivative data saved (1807 records). [2025-10-02T22:34:00.985372] [INFO ] [MAIN ] ADT: Successfully saved derivative data. [2025-10-02T22:34:00.988125] [INFO ] [MAIN ] Derivative Progress: 27/1975 symbols completed. ADT took 1.3s. Estimated remaining: 13m 59s. Rate: 139.3 symbols/min [2025-10-02T22:34:00.990574] [INFO ] [MAIN ] AEG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:00.997477] [DEBUG] [LOCAL ] AEFC: Loaded 8541 existing records from primary storage. [2025-10-02T22:34:00.997872] [INFO ] [MAIN ] AEFC: Loaded 8541 primary data records. [2025-10-02T22:34:01.229813] [DEBUG] [LOCAL ] AEE: Loaded 50446 existing records from primary storage. [2025-10-02T22:34:01.251956] [INFO ] [MAIN ] AEE: Loaded 50446 primary data records. [2025-10-02T22:34:01.501875] [DEBUG] [LOCAL ] AEG: Loaded 49924 existing records from primary storage. [2025-10-02T22:34:01.527767] [INFO ] [MAIN ] AEG: Loaded 49924 primary data records. [2025-10-02T22:34:02.139786] [DEBUG] [MAIN ] AEFC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:02.140699] [INFO ] [MAIN ] AEFC: Generated 1807 derivative records from 8541 primary records. [2025-10-02T22:34:02.141461] [DEBUG] [LOCAL ] AEFC: Saving derivative data. [2025-10-02T22:34:02.161691] [DEBUG] [LOCAL ] AEFC: Derivative data saved (1807 records). [2025-10-02T22:34:02.161857] [INFO ] [MAIN ] AEFC: Successfully saved derivative data. [2025-10-02T22:34:02.163871] [INFO ] [MAIN ] Derivative Progress: 28/1975 symbols completed. AEFC took 1.2s. Estimated remaining: 14m 50s. Rate: 131.2 symbols/min [2025-10-02T22:34:02.181313] [DEBUG] [MAIN ] AEE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:02.182010] [INFO ] [MAIN ] AEE: Generated 1807 derivative records from 50446 primary records. [2025-10-02T22:34:02.182161] [DEBUG] [LOCAL ] AEE: Saving derivative data. [2025-10-02T22:34:02.199024] [DEBUG] [LOCAL ] AEE: Derivative data saved (1807 records). [2025-10-02T22:34:02.199285] [INFO ] [MAIN ] AEE: Successfully saved derivative data. [2025-10-02T22:34:02.201328] [INFO ] [MAIN ] Derivative Progress: 29/1975 symbols completed. AEE took 1.2s. Estimated remaining: 14m 22s. Rate: 135.5 symbols/min [2025-10-02T22:34:02.223852] [DEBUG] [MAIN ] AEG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:02.224547] [INFO ] [MAIN ] AEG: Generated 1807 derivative records from 49924 primary records. [2025-10-02T22:34:02.224618] [DEBUG] [LOCAL ] AEG: Saving derivative data. [2025-10-02T22:34:02.248390] [DEBUG] [LOCAL ] AEG: Derivative data saved (1807 records). [2025-10-02T22:34:02.248470] [INFO ] [MAIN ] AEG: Successfully saved derivative data. [2025-10-02T22:34:02.250958] [INFO ] [MAIN ] Derivative Progress: 30/1975 symbols completed. AEG took 1.3s. Estimated remaining: 13m 56s. Rate: 139.6 symbols/min [2025-10-02T22:34:02.251550] [INFO ] [MAIN ] AEO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:02.251469] [INFO ] [MAIN ] AER: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:02.251414] [INFO ] [MAIN ] AEM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:02.341904] [DEBUG] [LOCAL ] AEO: Loaded 53947 existing records from primary storage. [2025-10-02T22:34:02.343190] [INFO ] [MAIN ] AEO: Loaded 53947 primary data records. [2025-10-02T22:34:02.355804] [DEBUG] [LOCAL ] AER: Loaded 48702 existing records from primary storage. [2025-10-02T22:34:02.382450] [INFO ] [MAIN ] AER: Loaded 48702 primary data records. [2025-10-02T22:34:02.561590] [DEBUG] [LOCAL ] AEM: Loaded 53853 existing records from primary storage. [2025-10-02T22:34:02.561796] [INFO ] [MAIN ] AEM: Loaded 53853 primary data records. [2025-10-02T22:34:03.433786] [DEBUG] [MAIN ] AEO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:03.440066] [DEBUG] [MAIN ] AER: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:03.441000] [INFO ] [MAIN ] AER: Generated 1807 derivative records from 48702 primary records. [2025-10-02T22:34:03.442079] [DEBUG] [LOCAL ] AER: Saving derivative data. [2025-10-02T22:34:03.439742] [INFO ] [MAIN ] AEO: Generated 1807 derivative records from 53947 primary records. [2025-10-02T22:34:03.442545] [DEBUG] [LOCAL ] AEO: Saving derivative data. [2025-10-02T22:34:03.486844] [DEBUG] [LOCAL ] AER: Derivative data saved (1807 records). [2025-10-02T22:34:03.489623] [INFO ] [MAIN ] AER: Successfully saved derivative data. [2025-10-02T22:34:03.492568] [INFO ] [MAIN ] Derivative Progress: 31/1975 symbols completed. AER took 1.2s. Estimated remaining: 14m 46s. Rate: 131.6 symbols/min [2025-10-02T22:34:03.494337] [DEBUG] [LOCAL ] AEO: Derivative data saved (1807 records). [2025-10-02T22:34:03.489965] [DEBUG] [MAIN ] AEM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:03.495466] [INFO ] [MAIN ] AEM: Generated 1807 derivative records from 53853 primary records. [2025-10-02T22:34:03.495572] [DEBUG] [LOCAL ] AEM: Saving derivative data. [2025-10-02T22:34:03.494548] [INFO ] [MAIN ] AES: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:03.496488] [INFO ] [MAIN ] AEO: Successfully saved derivative data. [2025-10-02T22:34:03.499311] [INFO ] [MAIN ] Derivative Progress: 32/1975 symbols completed. AEO took 1.2s. Estimated remaining: 14m 19s. Rate: 135.8 symbols/min [2025-10-02T22:34:03.499543] [INFO ] [MAIN ] AESI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:03.519549] [DEBUG] [LOCAL ] AEM: Derivative data saved (1807 records). [2025-10-02T22:34:03.519714] [INFO ] [MAIN ] AEM: Successfully saved derivative data. [2025-10-02T22:34:03.522002] [INFO ] [MAIN ] Derivative Progress: 33/1975 symbols completed. AEM took 1.3s. Estimated remaining: 13m 54s. Rate: 139.8 symbols/min [2025-10-02T22:34:03.522431] [INFO ] [MAIN ] AFB: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:03.538743] [DEBUG] [LOCAL ] AFB: Loaded 11470 existing records from primary storage. [2025-10-02T22:34:03.538959] [INFO ] [MAIN ] AFB: Loaded 11470 primary data records. [2025-10-02T22:34:03.924873] [DEBUG] [LOCAL ] AES: Loaded 54060 existing records from primary storage. [2025-10-02T22:34:03.925870] [INFO ] [MAIN ] AES: Loaded 54060 primary data records. [2025-10-02T22:34:03.926907] [DEBUG] [LOCAL ] AESI: Loaded 49859 existing records from primary storage. [2025-10-02T22:34:03.927209] [INFO ] [MAIN ] AESI: Loaded 49859 primary data records. [2025-10-02T22:34:04.625599] [DEBUG] [MAIN ] AFB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:04.627060] [INFO ] [MAIN ] AFB: Generated 1807 derivative records from 11470 primary records. [2025-10-02T22:34:04.627245] [DEBUG] [LOCAL ] AFB: Saving derivative data. [2025-10-02T22:34:04.649791] [DEBUG] [LOCAL ] AFB: Derivative data saved (1807 records). [2025-10-02T22:34:04.650292] [INFO ] [MAIN ] AFB: Successfully saved derivative data. [2025-10-02T22:34:04.652633] [INFO ] [MAIN ] Derivative Progress: 34/1975 symbols completed. AFB took 1.1s. Estimated remaining: 14m 33s. Rate: 133.4 symbols/min [2025-10-02T22:34:04.653392] [INFO ] [MAIN ] AFG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:04.673562] [DEBUG] [MAIN ] AES: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:04.687160] [INFO ] [MAIN ] AES: Generated 1807 derivative records from 54060 primary records. [2025-10-02T22:34:04.687592] [DEBUG] [LOCAL ] AES: Saving derivative data. [2025-10-02T22:34:04.687929] [DEBUG] [MAIN ] AESI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:04.689458] [INFO ] [MAIN ] AESI: Generated 1807 derivative records from 49859 primary records. [2025-10-02T22:34:04.689821] [DEBUG] [LOCAL ] AESI: Saving derivative data. [2025-10-02T22:34:04.718659] [DEBUG] [LOCAL ] AES: Derivative data saved (1807 records). [2025-10-02T22:34:04.730127] [INFO ] [MAIN ] AES: Successfully saved derivative data. [2025-10-02T22:34:04.732622] [INFO ] [MAIN ] Derivative Progress: 35/1975 symbols completed. AES took 1.2s. Estimated remaining: 14m 12s. Rate: 136.6 symbols/min [2025-10-02T22:34:04.733327] [INFO ] [MAIN ] AFGB: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:04.734384] [DEBUG] [LOCAL ] AESI: Derivative data saved (1807 records). [2025-10-02T22:34:04.734767] [INFO ] [MAIN ] AESI: Successfully saved derivative data. [2025-10-02T22:34:04.738826] [INFO ] [MAIN ] Derivative Progress: 36/1975 symbols completed. AESI took 1.2s. Estimated remaining: 13m 48s. Rate: 140.4 symbols/min [2025-10-02T22:34:04.739221] [INFO ] [MAIN ] AFGC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:04.752508] [DEBUG] [LOCAL ] AFG: Loaded 32624 existing records from primary storage. [2025-10-02T22:34:04.755095] [DEBUG] [LOCAL ] AFGB: Loaded 2357 existing records from primary storage. [2025-10-02T22:34:04.752907] [INFO ] [MAIN ] AFG: Loaded 32624 primary data records. [2025-10-02T22:34:04.755299] [INFO ] [MAIN ] AFGB: Loaded 2357 primary data records. [2025-10-02T22:34:04.757269] [DEBUG] [LOCAL ] AFGC: Loaded 2561 existing records from primary storage. [2025-10-02T22:34:04.785450] [INFO ] [MAIN ] AFGC: Loaded 2561 primary data records. [2025-10-02T22:34:05.883133] [DEBUG] [MAIN ] AFGB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:05.884471] [INFO ] [MAIN ] AFGB: Generated 1807 derivative records from 2357 primary records. [2025-10-02T22:34:05.885006] [DEBUG] [MAIN ] AFG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:05.885269] [DEBUG] [LOCAL ] AFGB: Saving derivative data. [2025-10-02T22:34:05.886347] [INFO ] [MAIN ] AFG: Generated 1807 derivative records from 32624 primary records. [2025-10-02T22:34:05.887085] [DEBUG] [LOCAL ] AFG: Saving derivative data. [2025-10-02T22:34:05.917939] [DEBUG] [MAIN ] AFGC: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-02T22:34:05.930568] [DEBUG] [LOCAL ] AFGB: Derivative data saved (1807 records). [2025-10-02T22:34:05.936606] [INFO ] [MAIN ] AFGB: Successfully saved derivative data. [2025-10-02T22:34:05.940138] [INFO ] [MAIN ] Derivative Progress: 37/1975 symbols completed. AFGB took 1.2s. Estimated remaining: 14m 29s. Rate: 133.9 symbols/min [2025-10-02T22:34:05.936220] [INFO ] [MAIN ] AFGC: Generated 1806 derivative records from 2561 primary records. [2025-10-02T22:34:05.940733] [INFO ] [MAIN ] AFGD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:05.943724] [DEBUG] [LOCAL ] AFGC: Saving derivative data. [2025-10-02T22:34:05.945603] [DEBUG] [LOCAL ] AFG: Derivative data saved (1807 records). [2025-10-02T22:34:05.946773] [INFO ] [MAIN ] AFG: Successfully saved derivative data. [2025-10-02T22:34:05.960912] [INFO ] [MAIN ] Derivative Progress: 38/1975 symbols completed. AFG took 1.3s. Estimated remaining: 14m 6s. Rate: 137.3 symbols/min [2025-10-02T22:34:05.965601] [INFO ] [MAIN ] AFGE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:05.968094] [DEBUG] [LOCAL ] AFGD: Loaded 1827 existing records from primary storage. [2025-10-02T22:34:05.968218] [INFO ] [MAIN ] AFGD: Loaded 1827 primary data records. [2025-10-02T22:34:05.965734] [DEBUG] [LOCAL ] AFGC: Derivative data saved (1806 records). [2025-10-02T22:34:06.009460] [INFO ] [MAIN ] AFGC: Successfully saved derivative data. [2025-10-02T22:34:06.063436] [INFO ] [MAIN ] Derivative Progress: 39/1975 symbols completed. AFGC took 1.3s. Estimated remaining: 13m 49s. Rate: 140.1 symbols/min [2025-10-02T22:34:06.068991] [INFO ] [MAIN ] AFL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:06.055755] [DEBUG] [LOCAL ] AFGE: Loaded 2467 existing records from primary storage. [2025-10-02T22:34:06.090257] [INFO ] [MAIN ] AFGE: Loaded 2467 primary data records. [2025-10-02T22:34:06.668365] [DEBUG] [LOCAL ] AFL: Loaded 53536 existing records from primary storage. [2025-10-02T22:34:06.668987] [INFO ] [MAIN ] AFL: Loaded 53536 primary data records. [2025-10-02T22:34:06.842119] [DEBUG] [MAIN ] AFGD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:06.853483] [INFO ] [MAIN ] AFGD: Generated 1807 derivative records from 1827 primary records. [2025-10-02T22:34:06.863832] [DEBUG] [LOCAL ] AFGD: Saving derivative data. [2025-10-02T22:34:07.042767] [DEBUG] [MAIN ] AFGE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:07.042276] [DEBUG] [LOCAL ] AFGD: Derivative data saved (1807 records). [2025-10-02T22:34:07.043636] [INFO ] [MAIN ] AFGE: Generated 1807 derivative records from 2467 primary records. [2025-10-02T22:34:07.044688] [DEBUG] [LOCAL ] AFGE: Saving derivative data. [2025-10-02T22:34:07.044150] [INFO ] [MAIN ] AFGD: Successfully saved derivative data. [2025-10-02T22:34:07.046934] [INFO ] [MAIN ] Derivative Progress: 40/1975 symbols completed. AFGD took 1.1s. Estimated remaining: 14m 16s. Rate: 135.7 symbols/min [2025-10-02T22:34:07.048267] [INFO ] [MAIN ] AG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:07.064494] [DEBUG] [LOCAL ] AFGE: Derivative data saved (1807 records). [2025-10-02T22:34:07.064726] [INFO ] [MAIN ] AFGE: Successfully saved derivative data. [2025-10-02T22:34:07.066956] [INFO ] [MAIN ] Derivative Progress: 41/1975 symbols completed. AFGE took 1.1s. Estimated remaining: 13m 55s. Rate: 138.9 symbols/min [2025-10-02T22:34:07.067719] [INFO ] [MAIN ] AGCO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:07.090866] [DEBUG] [MAIN ] AFL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:07.091678] [INFO ] [MAIN ] AFL: Generated 1807 derivative records from 53536 primary records. [2025-10-02T22:34:07.091838] [DEBUG] [LOCAL ] AFL: Saving derivative data. [2025-10-02T22:34:07.110430] [DEBUG] [LOCAL ] AFL: Derivative data saved (1807 records). [2025-10-02T22:34:07.124061] [INFO ] [MAIN ] AFL: Successfully saved derivative data. [2025-10-02T22:34:07.126755] [INFO ] [MAIN ] Derivative Progress: 42/1975 symbols completed. AFL took 1.1s. Estimated remaining: 13m 38s. Rate: 141.8 symbols/min [2025-10-02T22:34:07.135439] [INFO ] [MAIN ] AGD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:07.175140] [DEBUG] [LOCAL ] AG: Loaded 54032 existing records from primary storage. [2025-10-02T22:34:07.175370] [INFO ] [MAIN ] AG: Loaded 54032 primary data records. [2025-10-02T22:34:07.181241] [DEBUG] [LOCAL ] AGCO: Loaded 42677 existing records from primary storage. [2025-10-02T22:34:07.209370] [INFO ] [MAIN ] AGCO: Loaded 42677 primary data records. [2025-10-02T22:34:07.272805] [DEBUG] [LOCAL ] AGD: Loaded 18158 existing records from primary storage. [2025-10-02T22:34:07.294745] [INFO ] [MAIN ] AGD: Loaded 18158 primary data records. [2025-10-02T22:34:08.225609] [DEBUG] [MAIN ] AG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:08.226982] [INFO ] [MAIN ] AG: Generated 1807 derivative records from 54032 primary records. [2025-10-02T22:34:08.227212] [DEBUG] [LOCAL ] AG: Saving derivative data. [2025-10-02T22:34:08.261388] [DEBUG] [LOCAL ] AG: Derivative data saved (1807 records). [2025-10-02T22:34:08.267216] [INFO ] [MAIN ] AG: Successfully saved derivative data. [2025-10-02T22:34:08.269502] [INFO ] [MAIN ] Derivative Progress: 43/1975 symbols completed. AG took 1.2s. Estimated remaining: 14m 10s. Rate: 136.4 symbols/min [2025-10-02T22:34:08.278030] [DEBUG] [MAIN ] AGD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:08.284101] [DEBUG] [MAIN ] AGCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:08.286049] [INFO ] [MAIN ] AGCO: Generated 1807 derivative records from 42677 primary records. [2025-10-02T22:34:08.286133] [DEBUG] [LOCAL ] AGCO: Saving derivative data. [2025-10-02T22:34:08.285179] [INFO ] [MAIN ] AGD: Generated 1807 derivative records from 18158 primary records. [2025-10-02T22:34:08.286908] [DEBUG] [LOCAL ] AGD: Saving derivative data. [2025-10-02T22:34:08.319661] [DEBUG] [LOCAL ] AGD: Derivative data saved (1807 records). [2025-10-02T22:34:08.319761] [DEBUG] [LOCAL ] AGCO: Derivative data saved (1807 records). [2025-10-02T22:34:08.320017] [INFO ] [MAIN ] AGD: Successfully saved derivative data. [2025-10-02T22:34:08.322370] [INFO ] [MAIN ] Derivative Progress: 44/1975 symbols completed. AGD took 1.2s. Estimated remaining: 13m 52s. Rate: 139.2 symbols/min [2025-10-02T22:34:08.320113] [INFO ] [MAIN ] AGCO: Successfully saved derivative data. [2025-10-02T22:34:08.325086] [INFO ] [MAIN ] Derivative Progress: 45/1975 symbols completed. AGCO took 1.3s. Estimated remaining: 13m 33s. Rate: 142.3 symbols/min [2025-10-02T22:34:08.325598] [INFO ] [MAIN ] AGL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:08.325817] [INFO ] [MAIN ] AGM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:08.325686] [INFO ] [MAIN ] AGO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:08.341302] [DEBUG] [LOCAL ] AGM: Loaded 10296 existing records from primary storage. [2025-10-02T22:34:08.341455] [INFO ] [MAIN ] AGM: Loaded 10296 primary data records. [2025-10-02T22:34:08.502281] [DEBUG] [LOCAL ] AGO: Loaded 28176 existing records from primary storage. [2025-10-02T22:34:08.545934] [INFO ] [MAIN ] AGO: Loaded 28176 primary data records. [2025-10-02T22:34:08.843268] [DEBUG] [LOCAL ] AGL: Loaded 52833 existing records from primary storage. [2025-10-02T22:34:08.856402] [INFO ] [MAIN ] AGL: Loaded 52833 primary data records. [2025-10-02T22:34:09.479679] [DEBUG] [MAIN ] AGM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:09.480950] [INFO ] [MAIN ] AGM: Generated 1807 derivative records from 10296 primary records. [2025-10-02T22:34:09.481601] [DEBUG] [LOCAL ] AGM: Saving derivative data. [2025-10-02T22:34:09.501443] [DEBUG] [LOCAL ] AGM: Derivative data saved (1807 records). [2025-10-02T22:34:09.502045] [INFO ] [MAIN ] AGM: Successfully saved derivative data. [2025-10-02T22:34:09.504003] [INFO ] [MAIN ] Derivative Progress: 46/1975 symbols completed. AGM took 1.2s. Estimated remaining: 14m 5s. Rate: 137.0 symbols/min [2025-10-02T22:34:09.504472] [INFO ] [MAIN ] AGRO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:09.525814] [DEBUG] [MAIN ] AGO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:09.526822] [INFO ] [MAIN ] AGO: Generated 1807 derivative records from 28176 primary records. [2025-10-02T22:34:09.527081] [DEBUG] [LOCAL ] AGO: Saving derivative data. [2025-10-02T22:34:09.548850] [DEBUG] [LOCAL ] AGO: Derivative data saved (1807 records). [2025-10-02T22:34:09.550628] [INFO ] [MAIN ] AGO: Successfully saved derivative data. [2025-10-02T22:34:09.554440] [INFO ] [MAIN ] Derivative Progress: 47/1975 symbols completed. AGO took 1.2s. Estimated remaining: 13m 48s. Rate: 139.6 symbols/min [2025-10-02T22:34:09.554714] [INFO ] [MAIN ] AGX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:09.578330] [DEBUG] [MAIN ] AGL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:09.579183] [INFO ] [MAIN ] AGL: Generated 1807 derivative records from 52833 primary records. [2025-10-02T22:34:09.579362] [DEBUG] [LOCAL ] AGL: Saving derivative data. [2025-10-02T22:34:09.607149] [DEBUG] [LOCAL ] AGL: Derivative data saved (1807 records). [2025-10-02T22:34:09.607421] [INFO ] [MAIN ] AGL: Successfully saved derivative data. [2025-10-02T22:34:09.610551] [INFO ] [MAIN ] Derivative Progress: 48/1975 symbols completed. AGL took 1.3s. Estimated remaining: 13m 33s. Rate: 142.2 symbols/min [2025-10-02T22:34:09.608095] [DEBUG] [LOCAL ] AGRO: Loaded 33687 existing records from primary storage. [2025-10-02T22:34:09.610790] [INFO ] [MAIN ] AGRO: Loaded 33687 primary data records. [2025-10-02T22:34:09.611008] [INFO ] [MAIN ] AHH: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:09.756214] [DEBUG] [LOCAL ] AGX: Loaded 33402 existing records from primary storage. [2025-10-02T22:34:09.772395] [INFO ] [MAIN ] AGX: Loaded 33402 primary data records. [2025-10-02T22:34:10.000739] [DEBUG] [LOCAL ] AHH: Loaded 41379 existing records from primary storage. [2025-10-02T22:34:10.140493] [INFO ] [MAIN ] AHH: Loaded 41379 primary data records. [2025-10-02T22:34:10.738130] [DEBUG] [MAIN ] AGRO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:10.739350] [INFO ] [MAIN ] AGRO: Generated 1807 derivative records from 33687 primary records. [2025-10-02T22:34:10.739527] [DEBUG] [LOCAL ] AGRO: Saving derivative data. [2025-10-02T22:34:10.758225] [DEBUG] [LOCAL ] AGRO: Derivative data saved (1807 records). [2025-10-02T22:34:10.758551] [INFO ] [MAIN ] AGRO: Successfully saved derivative data. [2025-10-02T22:34:10.761054] [INFO ] [MAIN ] Derivative Progress: 49/1975 symbols completed. AGRO took 1.3s. Estimated remaining: 14m 1s. Rate: 137.4 symbols/min [2025-10-02T22:34:10.761374] [INFO ] [MAIN ] AHR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:10.779895] [DEBUG] [MAIN ] AGX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:10.780728] [INFO ] [MAIN ] AGX: Generated 1807 derivative records from 33402 primary records. [2025-10-02T22:34:10.780923] [DEBUG] [LOCAL ] AGX: Saving derivative data. [2025-10-02T22:34:10.801412] [DEBUG] [LOCAL ] AGX: Derivative data saved (1807 records). [2025-10-02T22:34:10.801791] [INFO ] [MAIN ] AGX: Successfully saved derivative data. [2025-10-02T22:34:10.804061] [INFO ] [MAIN ] Derivative Progress: 50/1975 symbols completed. AGX took 1.2s. Estimated remaining: 13m 46s. Rate: 139.9 symbols/min [2025-10-02T22:34:10.812252] [INFO ] [MAIN ] AHT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:10.818455] [DEBUG] [MAIN ] AHH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:10.819205] [INFO ] [MAIN ] AHH: Generated 1807 derivative records from 41379 primary records. [2025-10-02T22:34:10.819270] [DEBUG] [LOCAL ] AHH: Saving derivative data. [2025-10-02T22:34:10.851576] [DEBUG] [LOCAL ] AHH: Derivative data saved (1807 records). [2025-10-02T22:34:10.851501] [DEBUG] [LOCAL ] AHT: Loaded 6188 existing records from primary storage. [2025-10-02T22:34:10.851762] [INFO ] [MAIN ] AHH: Successfully saved derivative data. [2025-10-02T22:34:10.851826] [INFO ] [MAIN ] AHT: Loaded 6188 primary data records. [2025-10-02T22:34:10.854392] [INFO ] [MAIN ] Derivative Progress: 51/1975 symbols completed. AHH took 1.2s. Estimated remaining: 13m 31s. Rate: 142.3 symbols/min [2025-10-02T22:34:10.854699] [INFO ] [MAIN ] AI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:10.991052] [DEBUG] [LOCAL ] AHR: Loaded 49515 existing records from primary storage. [2025-10-02T22:34:11.006838] [INFO ] [MAIN ] AHR: Loaded 49515 primary data records. [2025-10-02T22:34:11.592775] [DEBUG] [LOCAL ] AI: Loaded 54140 existing records from primary storage. [2025-10-02T22:34:11.595034] [INFO ] [MAIN ] AI: Loaded 54140 primary data records. [2025-10-02T22:34:11.993018] [DEBUG] [MAIN ] AHT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:12.009600] [INFO ] [MAIN ] AHT: Generated 1807 derivative records from 6188 primary records. [2025-10-02T22:34:12.010799] [DEBUG] [LOCAL ] AHT: Saving derivative data. [2025-10-02T22:34:12.030161] [DEBUG] [LOCAL ] AHT: Derivative data saved (1807 records). [2025-10-02T22:34:12.031524] [INFO ] [MAIN ] AHT: Successfully saved derivative data. [2025-10-02T22:34:12.034389] [INFO ] [MAIN ] Derivative Progress: 52/1975 symbols completed. AHT took 1.2s. Estimated remaining: 13m 59s. Rate: 137.6 symbols/min [2025-10-02T22:34:12.036814] [INFO ] [MAIN ] AIG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:12.053099] [DEBUG] [MAIN ] AHR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:12.054196] [INFO ] [MAIN ] AHR: Generated 1807 derivative records from 49515 primary records. [2025-10-02T22:34:12.054439] [DEBUG] [LOCAL ] AHR: Saving derivative data. [2025-10-02T22:34:12.074692] [DEBUG] [LOCAL ] AHR: Derivative data saved (1807 records). [2025-10-02T22:34:12.075626] [INFO ] [MAIN ] AHR: Successfully saved derivative data. [2025-10-02T22:34:12.078023] [INFO ] [MAIN ] Derivative Progress: 53/1975 symbols completed. AHR took 1.3s. Estimated remaining: 13m 44s. Rate: 140.0 symbols/min [2025-10-02T22:34:12.080474] [INFO ] [MAIN ] AIN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:12.099616] [DEBUG] [MAIN ] AI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:12.100401] [INFO ] [MAIN ] AI: Generated 1807 derivative records from 54140 primary records. [2025-10-02T22:34:12.100623] [DEBUG] [LOCAL ] AI: Saving derivative data. [2025-10-02T22:34:12.132412] [DEBUG] [LOCAL ] AI: Derivative data saved (1807 records). [2025-10-02T22:34:12.138394] [INFO ] [MAIN ] AI: Successfully saved derivative data. [2025-10-02T22:34:12.140704] [INFO ] [MAIN ] Derivative Progress: 54/1975 symbols completed. AI took 1.3s. Estimated remaining: 13m 30s. Rate: 142.2 symbols/min [2025-10-02T22:34:12.141068] [INFO ] [MAIN ] AIO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:12.170105] [DEBUG] [LOCAL ] AIN: Loaded 24750 existing records from primary storage. [2025-10-02T22:34:12.170447] [INFO ] [MAIN ] AIN: Loaded 24750 primary data records. [2025-10-02T22:34:12.184413] [DEBUG] [LOCAL ] AIG: Loaded 53862 existing records from primary storage. [2025-10-02T22:34:12.206707] [INFO ] [MAIN ] AIG: Loaded 53862 primary data records. [2025-10-02T22:34:12.350942] [DEBUG] [LOCAL ] AIO: Loaded 13422 existing records from primary storage. [2025-10-02T22:34:12.401564] [INFO ] [MAIN ] AIO: Loaded 13422 primary data records. [2025-10-02T22:34:13.301405] [DEBUG] [MAIN ] AIN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:13.302606] [INFO ] [MAIN ] AIN: Generated 1807 derivative records from 24750 primary records. [2025-10-02T22:34:13.303273] [DEBUG] [LOCAL ] AIN: Saving derivative data. [2025-10-02T22:34:13.327297] [DEBUG] [LOCAL ] AIN: Derivative data saved (1807 records). [2025-10-02T22:34:13.327669] [INFO ] [MAIN ] AIN: Successfully saved derivative data. [2025-10-02T22:34:13.343803] [INFO ] [MAIN ] Derivative Progress: 55/1975 symbols completed. AIN took 1.3s. Estimated remaining: 13m 57s. Rate: 137.6 symbols/min [2025-10-02T22:34:13.346572] [INFO ] [MAIN ] AIR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:13.347342] [DEBUG] [MAIN ] AIG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:13.357026] [INFO ] [MAIN ] AIG: Generated 1807 derivative records from 53862 primary records. [2025-10-02T22:34:13.357271] [DEBUG] [LOCAL ] AIG: Saving derivative data. [2025-10-02T22:34:13.364232] [DEBUG] [MAIN ] AIO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:13.374395] [INFO ] [MAIN ] AIO: Generated 1807 derivative records from 13422 primary records. [2025-10-02T22:34:13.378742] [DEBUG] [LOCAL ] AIO: Saving derivative data. [2025-10-02T22:34:13.382808] [DEBUG] [LOCAL ] AIG: Derivative data saved (1807 records). [2025-10-02T22:34:13.382988] [INFO ] [MAIN ] AIG: Successfully saved derivative data. [2025-10-02T22:34:13.385443] [INFO ] [MAIN ] Derivative Progress: 56/1975 symbols completed. AIG took 1.3s. Estimated remaining: 13m 43s. Rate: 139.8 symbols/min [2025-10-02T22:34:13.397639] [INFO ] [MAIN ] AIT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:13.414244] [DEBUG] [LOCAL ] AIO: Derivative data saved (1807 records). [2025-10-02T22:34:13.414459] [INFO ] [MAIN ] AIO: Successfully saved derivative data. [2025-10-02T22:34:13.416910] [INFO ] [MAIN ] Derivative Progress: 57/1975 symbols completed. AIO took 1.3s. Estimated remaining: 13m 30s. Rate: 142.1 symbols/min [2025-10-02T22:34:13.417231] [INFO ] [MAIN ] AIZ: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:13.431603] [DEBUG] [LOCAL ] AIR: Loaded 28562 existing records from primary storage. [2025-10-02T22:34:13.431835] [INFO ] [MAIN ] AIR: Loaded 28562 primary data records. [2025-10-02T22:34:13.586237] [DEBUG] [LOCAL ] AIT: Loaded 27668 existing records from primary storage. [2025-10-02T22:34:13.683518] [DEBUG] [LOCAL ] AIZ: Loaded 30062 existing records from primary storage. [2025-10-02T22:34:13.682871] [INFO ] [MAIN ] AIT: Loaded 27668 primary data records. [2025-10-02T22:34:13.683725] [INFO ] [MAIN ] AIZ: Loaded 30062 primary data records. [2025-10-02T22:34:14.565290] [DEBUG] [MAIN ] AIR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:14.567372] [INFO ] [MAIN ] AIR: Generated 1807 derivative records from 28562 primary records. [2025-10-02T22:34:14.567473] [DEBUG] [LOCAL ] AIR: Saving derivative data. [2025-10-02T22:34:14.586980] [DEBUG] [LOCAL ] AIR: Derivative data saved (1807 records). [2025-10-02T22:34:14.587165] [INFO ] [MAIN ] AIR: Successfully saved derivative data. [2025-10-02T22:34:14.589551] [INFO ] [MAIN ] Derivative Progress: 58/1975 symbols completed. AIR took 1.2s. Estimated remaining: 13m 54s. Rate: 137.9 symbols/min [2025-10-02T22:34:14.609923] [DEBUG] [MAIN ] AIZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:14.610787] [INFO ] [MAIN ] AIZ: Generated 1807 derivative records from 30062 primary records. [2025-10-02T22:34:14.623089] [DEBUG] [MAIN ] AIT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:14.623157] [DEBUG] [LOCAL ] AIZ: Saving derivative data. [2025-10-02T22:34:14.623796] [INFO ] [MAIN ] AIT: Generated 1807 derivative records from 27668 primary records. [2025-10-02T22:34:14.624279] [DEBUG] [LOCAL ] AIT: Saving derivative data. [2025-10-02T22:34:14.656768] [DEBUG] [LOCAL ] AIZ: Derivative data saved (1807 records). [2025-10-02T22:34:14.658032] [DEBUG] [LOCAL ] AIT: Derivative data saved (1807 records). [2025-10-02T22:34:14.658131] [INFO ] [MAIN ] AIZ: Successfully saved derivative data. [2025-10-02T22:34:14.658195] [INFO ] [MAIN ] AIT: Successfully saved derivative data. [2025-10-02T22:34:14.660384] [INFO ] [MAIN ] Derivative Progress: 59/1975 symbols completed. AIZ took 1.2s. Estimated remaining: 13m 42s. Rate: 139.9 symbols/min [2025-10-02T22:34:14.662841] [INFO ] [MAIN ] Derivative Progress: 60/1975 symbols completed. AIT took 1.3s. Estimated remaining: 13m 28s. Rate: 142.3 symbols/min [2025-10-02T22:34:14.663497] [INFO ] [MAIN ] AIZN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:14.663615] [INFO ] [MAIN ] AKR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:14.664125] [INFO ] [MAIN ] AJG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:14.671409] [DEBUG] [LOCAL ] AIZN: Loaded 4082 existing records from primary storage. [2025-10-02T22:34:14.671634] [INFO ] [MAIN ] AIZN: Loaded 4082 primary data records. [2025-10-02T22:34:15.053188] [DEBUG] [LOCAL ] AKR: Loaded 46065 existing records from primary storage. [2025-10-02T22:34:15.053554] [INFO ] [MAIN ] AKR: Loaded 46065 primary data records. [2025-10-02T22:34:15.196002] [DEBUG] [LOCAL ] AJG: Loaded 47189 existing records from primary storage. [2025-10-02T22:34:15.226729] [INFO ] [MAIN ] AJG: Loaded 47189 primary data records. [2025-10-02T22:34:15.782272] [DEBUG] [MAIN ] AIZN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:15.783527] [INFO ] [MAIN ] AIZN: Generated 1807 derivative records from 4082 primary records. [2025-10-02T22:34:15.783681] [DEBUG] [LOCAL ] AIZN: Saving derivative data. [2025-10-02T22:34:15.802673] [DEBUG] [LOCAL ] AIZN: Derivative data saved (1807 records). [2025-10-02T22:34:15.803041] [INFO ] [MAIN ] AIZN: Successfully saved derivative data. [2025-10-02T22:34:15.805689] [INFO ] [MAIN ] Derivative Progress: 61/1975 symbols completed. AIZN took 1.1s. Estimated remaining: 13m 50s. Rate: 138.4 symbols/min [2025-10-02T22:34:15.806346] [INFO ] [MAIN ] AL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:15.823889] [DEBUG] [MAIN ] AKR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:15.825028] [INFO ] [MAIN ] AKR: Generated 1807 derivative records from 46065 primary records. [2025-10-02T22:34:15.825328] [DEBUG] [LOCAL ] AKR: Saving derivative data. [2025-10-02T22:34:15.844281] [DEBUG] [LOCAL ] AKR: Derivative data saved (1807 records). [2025-10-02T22:34:15.844457] [INFO ] [MAIN ] AKR: Successfully saved derivative data. [2025-10-02T22:34:15.846408] [INFO ] [MAIN ] Derivative Progress: 62/1975 symbols completed. AKR took 1.2s. Estimated remaining: 13m 37s. Rate: 140.4 symbols/min [2025-10-02T22:34:15.846716] [INFO ] [MAIN ] ALB: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:15.864464] [DEBUG] [MAIN ] AJG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:15.865278] [INFO ] [MAIN ] AJG: Generated 1807 derivative records from 47189 primary records. [2025-10-02T22:34:15.865468] [DEBUG] [LOCAL ] AJG: Saving derivative data. [2025-10-02T22:34:15.894207] [DEBUG] [LOCAL ] AJG: Derivative data saved (1807 records). [2025-10-02T22:34:15.894451] [INFO ] [MAIN ] AJG: Successfully saved derivative data. [2025-10-02T22:34:15.897219] [INFO ] [MAIN ] Derivative Progress: 63/1975 symbols completed. AJG took 1.2s. Estimated remaining: 13m 25s. Rate: 142.4 symbols/min [2025-10-02T22:34:15.897638] [INFO ] [MAIN ] ALE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:15.914596] [DEBUG] [LOCAL ] AL: Loaded 44640 existing records from primary storage. [2025-10-02T22:34:15.914949] [INFO ] [MAIN ] AL: Loaded 44640 primary data records. [2025-10-02T22:34:16.109039] [DEBUG] [LOCAL ] ALB: Loaded 53622 existing records from primary storage. [2025-10-02T22:34:16.178722] [INFO ] [MAIN ] ALB: Loaded 53622 primary data records. [2025-10-02T22:34:16.307128] [DEBUG] [LOCAL ] ALE: Loaded 30960 existing records from primary storage. [2025-10-02T22:34:16.346307] [INFO ] [MAIN ] ALE: Loaded 30960 primary data records. [2025-10-02T22:34:17.247383] [DEBUG] [MAIN ] AL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:17.251053] [INFO ] [MAIN ] AL: Generated 1807 derivative records from 44640 primary records. [2025-10-02T22:34:17.255236] [DEBUG] [LOCAL ] AL: Saving derivative data. [2025-10-02T22:34:17.291206] [DEBUG] [LOCAL ] AL: Derivative data saved (1807 records). [2025-10-02T22:34:17.291446] [INFO ] [MAIN ] AL: Successfully saved derivative data. [2025-10-02T22:34:17.296171] [INFO ] [MAIN ] Derivative Progress: 64/1975 symbols completed. AL took 1.5s. Estimated remaining: 13m 54s. Rate: 137.4 symbols/min [2025-10-02T22:34:17.297490] [INFO ] [MAIN ] ALEX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:17.318474] [DEBUG] [MAIN ] ALB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:17.319639] [INFO ] [MAIN ] ALB: Generated 1807 derivative records from 53622 primary records. [2025-10-02T22:34:17.320606] [DEBUG] [LOCAL ] ALB: Saving derivative data. [2025-10-02T22:34:17.377047] [DEBUG] [LOCAL ] ALB: Derivative data saved (1807 records). [2025-10-02T22:34:17.390327] [INFO ] [MAIN ] ALB: Successfully saved derivative data. [2025-10-02T22:34:17.390217] [DEBUG] [MAIN ] ALE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:17.393389] [INFO ] [MAIN ] Derivative Progress: 65/1975 symbols completed. ALB took 1.5s. Estimated remaining: 13m 44s. Rate: 139.1 symbols/min [2025-10-02T22:34:17.395246] [INFO ] [MAIN ] ALG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:17.395058] [INFO ] [MAIN ] ALE: Generated 1807 derivative records from 30960 primary records. [2025-10-02T22:34:17.396106] [DEBUG] [LOCAL ] ALE: Saving derivative data. [2025-10-02T22:34:17.437675] [DEBUG] [LOCAL ] ALE: Derivative data saved (1807 records). [2025-10-02T22:34:17.444687] [DEBUG] [LOCAL ] ALEX: Loaded 31342 existing records from primary storage. [2025-10-02T22:34:17.444987] [INFO ] [MAIN ] ALE: Successfully saved derivative data. [2025-10-02T22:34:17.448327] [INFO ] [MAIN ] Derivative Progress: 66/1975 symbols completed. ALE took 1.6s. Estimated remaining: 13m 33s. Rate: 141.0 symbols/min [2025-10-02T22:34:17.448599] [INFO ] [MAIN ] ALIT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:17.445320] [DEBUG] [LOCAL ] ALG: Loaded 10293 existing records from primary storage. [2025-10-02T22:34:17.449032] [INFO ] [MAIN ] ALG: Loaded 10293 primary data records. [2025-10-02T22:34:17.448946] [INFO ] [MAIN ] ALEX: Loaded 31342 primary data records. [2025-10-02T22:34:18.273987] [DEBUG] [LOCAL ] ALIT: Loaded 53155 existing records from primary storage. [2025-10-02T22:34:18.275298] [INFO ] [MAIN ] ALIT: Loaded 53155 primary data records. [2025-10-02T22:34:18.667857] [DEBUG] [MAIN ] ALG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:18.668883] [INFO ] [MAIN ] ALG: Generated 1807 derivative records from 10293 primary records. [2025-10-02T22:34:18.669017] [DEBUG] [LOCAL ] ALG: Saving derivative data. [2025-10-02T22:34:18.683866] [DEBUG] [MAIN ] ALEX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:18.692385] [INFO ] [MAIN ] ALEX: Generated 1807 derivative records from 31342 primary records. [2025-10-02T22:34:18.693725] [DEBUG] [LOCAL ] ALEX: Saving derivative data. [2025-10-02T22:34:18.716421] [DEBUG] [LOCAL ] ALG: Derivative data saved (1807 records). [2025-10-02T22:34:18.717534] [INFO ] [MAIN ] ALG: Successfully saved derivative data. [2025-10-02T22:34:18.720423] [INFO ] [MAIN ] Derivative Progress: 67/1975 symbols completed. ALG took 1.3s. Estimated remaining: 13m 56s. Rate: 136.9 symbols/min [2025-10-02T22:34:18.723835] [DEBUG] [LOCAL ] ALEX: Derivative data saved (1807 records). [2025-10-02T22:34:18.721696] [INFO ] [MAIN ] ALK: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:18.724038] [INFO ] [MAIN ] ALEX: Successfully saved derivative data. [2025-10-02T22:34:18.726587] [INFO ] [MAIN ] Derivative Progress: 68/1975 symbols completed. ALEX took 1.4s. Estimated remaining: 13m 44s. Rate: 138.9 symbols/min [2025-10-02T22:34:18.728207] [INFO ] [MAIN ] ALL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:18.744891] [DEBUG] [MAIN ] ALIT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:18.745736] [INFO ] [MAIN ] ALIT: Generated 1807 derivative records from 53155 primary records. [2025-10-02T22:34:18.745901] [DEBUG] [LOCAL ] ALIT: Saving derivative data. [2025-10-02T22:34:18.772411] [DEBUG] [LOCAL ] ALIT: Derivative data saved (1807 records). [2025-10-02T22:34:18.772841] [INFO ] [MAIN ] ALIT: Successfully saved derivative data. [2025-10-02T22:34:18.775353] [INFO ] [MAIN ] Derivative Progress: 69/1975 symbols completed. ALIT took 1.3s. Estimated remaining: 13m 33s. Rate: 140.7 symbols/min [2025-10-02T22:34:18.775631] [INFO ] [MAIN ] ALLE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:18.838993] [DEBUG] [LOCAL ] ALK: Loaded 53444 existing records from primary storage. [2025-10-02T22:34:18.840627] [INFO ] [MAIN ] ALK: Loaded 53444 primary data records. [2025-10-02T22:34:18.841418] [DEBUG] [LOCAL ] ALL: Loaded 50411 existing records from primary storage. [2025-10-02T22:34:18.846805] [INFO ] [MAIN ] ALL: Loaded 50411 primary data records. [2025-10-02T22:34:19.145361] [DEBUG] [LOCAL ] ALLE: Loaded 45033 existing records from primary storage. [2025-10-02T22:34:19.197621] [INFO ] [MAIN ] ALLE: Loaded 45033 primary data records. [2025-10-02T22:34:20.017151] [DEBUG] [MAIN ] ALK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:20.018369] [INFO ] [MAIN ] ALK: Generated 1807 derivative records from 53444 primary records. [2025-10-02T22:34:20.018764] [DEBUG] [LOCAL ] ALK: Saving derivative data. [2025-10-02T22:34:20.041972] [DEBUG] [MAIN ] ALL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:20.048576] [INFO ] [MAIN ] ALL: Generated 1807 derivative records from 50411 primary records. [2025-10-02T22:34:20.051107] [DEBUG] [LOCAL ] ALL: Saving derivative data. [2025-10-02T22:34:20.053914] [DEBUG] [LOCAL ] ALK: Derivative data saved (1807 records). [2025-10-02T22:34:20.054056] [INFO ] [MAIN ] ALK: Successfully saved derivative data. [2025-10-02T22:34:20.056276] [INFO ] [MAIN ] Derivative Progress: 70/1975 symbols completed. ALK took 1.3s. Estimated remaining: 13m 55s. Rate: 136.8 symbols/min [2025-10-02T22:34:20.068317] [INFO ] [MAIN ] ALLY: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:20.092119] [DEBUG] [MAIN ] ALLE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:20.093175] [INFO ] [MAIN ] ALLE: Generated 1807 derivative records from 45033 primary records. [2025-10-02T22:34:20.093431] [DEBUG] [LOCAL ] ALLE: Saving derivative data. [2025-10-02T22:34:20.092232] [DEBUG] [LOCAL ] ALL: Derivative data saved (1807 records). [2025-10-02T22:34:20.093554] [INFO ] [MAIN ] ALL: Successfully saved derivative data. [2025-10-02T22:34:20.096467] [INFO ] [MAIN ] Derivative Progress: 71/1975 symbols completed. ALL took 1.4s. Estimated remaining: 13m 44s. Rate: 138.6 symbols/min [2025-10-02T22:34:20.096706] [INFO ] [MAIN ] ALSN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:20.117205] [DEBUG] [LOCAL ] ALLE: Derivative data saved (1807 records). [2025-10-02T22:34:20.117470] [INFO ] [MAIN ] ALLE: Successfully saved derivative data. [2025-10-02T22:34:20.121543] [INFO ] [MAIN ] Derivative Progress: 72/1975 symbols completed. ALLE took 1.3s. Estimated remaining: 13m 33s. Rate: 140.4 symbols/min [2025-10-02T22:34:20.121999] [INFO ] [MAIN ] ALTG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:20.192631] [DEBUG] [LOCAL ] ALLY: Loaded 53605 existing records from primary storage. [2025-10-02T22:34:20.194215] [INFO ] [MAIN ] ALLY: Loaded 53605 primary data records. [2025-10-02T22:34:20.195033] [DEBUG] [LOCAL ] ALSN: Loaded 43607 existing records from primary storage. [2025-10-02T22:34:20.195517] [INFO ] [MAIN ] ALSN: Loaded 43607 primary data records. [2025-10-02T22:34:20.243003] [DEBUG] [LOCAL ] ALTG: Loaded 23685 existing records from primary storage. [2025-10-02T22:34:20.342928] [INFO ] [MAIN ] ALTG: Loaded 23685 primary data records. [2025-10-02T22:34:21.348687] [DEBUG] [MAIN ] ALLY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:21.365085] [DEBUG] [MAIN ] ALSN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:21.363904] [INFO ] [MAIN ] ALLY: Generated 1807 derivative records from 53605 primary records. [2025-10-02T22:34:21.365913] [INFO ] [MAIN ] ALSN: Generated 1807 derivative records from 43607 primary records. [2025-10-02T22:34:21.366100] [DEBUG] [LOCAL ] ALLY: Saving derivative data. [2025-10-02T22:34:21.366981] [DEBUG] [LOCAL ] ALSN: Saving derivative data. [2025-10-02T22:34:21.389597] [DEBUG] [MAIN ] ALTG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:21.395040] [INFO ] [MAIN ] ALTG: Generated 1807 derivative records from 23685 primary records. [2025-10-02T22:34:21.410141] [DEBUG] [LOCAL ] ALTG: Saving derivative data. [2025-10-02T22:34:21.412616] [DEBUG] [LOCAL ] ALLY: Derivative data saved (1807 records). [2025-10-02T22:34:21.415283] [INFO ] [MAIN ] ALLY: Successfully saved derivative data. [2025-10-02T22:34:21.416268] [DEBUG] [LOCAL ] ALSN: Derivative data saved (1807 records). [2025-10-02T22:34:21.419745] [INFO ] [MAIN ] Derivative Progress: 73/1975 symbols completed. ALLY took 1.4s. Estimated remaining: 13m 55s. Rate: 136.6 symbols/min [2025-10-02T22:34:21.420294] [INFO ] [MAIN ] ALSN: Successfully saved derivative data. [2025-10-02T22:34:21.430254] [INFO ] [MAIN ] Derivative Progress: 74/1975 symbols completed. ALSN took 1.3s. Estimated remaining: 13m 44s. Rate: 138.4 symbols/min [2025-10-02T22:34:21.439091] [DEBUG] [LOCAL ] ALTG: Derivative data saved (1807 records). [2025-10-02T22:34:21.439204] [INFO ] [MAIN ] ALTG: Successfully saved derivative data. [2025-10-02T22:34:21.441626] [INFO ] [MAIN ] Derivative Progress: 75/1975 symbols completed. ALTG took 1.3s. Estimated remaining: 13m 33s. Rate: 140.3 symbols/min [2025-10-02T22:34:21.442177] [INFO ] [MAIN ] ALX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:21.442301] [INFO ] [MAIN ] ALUR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:21.442475] [INFO ] [MAIN ] ALV: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:21.458248] [DEBUG] [LOCAL ] ALX: Loaded 6303 existing records from primary storage. [2025-10-02T22:34:21.458432] [INFO ] [MAIN ] ALX: Loaded 6303 primary data records. [2025-10-02T22:34:21.505052] [DEBUG] [LOCAL ] ALUR: Loaded 10816 existing records from primary storage. [2025-10-02T22:34:21.529605] [INFO ] [MAIN ] ALUR: Loaded 10816 primary data records. [2025-10-02T22:34:21.987544] [DEBUG] [LOCAL ] ALV: Loaded 42666 existing records from primary storage. [2025-10-02T22:34:22.003943] [INFO ] [MAIN ] ALV: Loaded 42666 primary data records. [2025-10-02T22:34:22.580616] [DEBUG] [MAIN ] ALX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:22.581969] [INFO ] [MAIN ] ALX: Generated 1807 derivative records from 6303 primary records. [2025-10-02T22:34:22.582476] [DEBUG] [LOCAL ] ALX: Saving derivative data. [2025-10-02T22:34:22.617098] [DEBUG] [MAIN ] ALUR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:22.619350] [INFO ] [MAIN ] ALUR: Generated 1807 derivative records from 10816 primary records. [2025-10-02T22:34:22.620533] [DEBUG] [LOCAL ] ALUR: Saving derivative data. [2025-10-02T22:34:22.635782] [DEBUG] [LOCAL ] ALX: Derivative data saved (1807 records). [2025-10-02T22:34:22.638922] [INFO ] [MAIN ] ALX: Successfully saved derivative data. [2025-10-02T22:34:22.640979] [DEBUG] [LOCAL ] ALUR: Derivative data saved (1807 records). [2025-10-02T22:34:22.643195] [INFO ] [MAIN ] ALUR: Successfully saved derivative data. [2025-10-02T22:34:22.643066] [INFO ] [MAIN ] Derivative Progress: 76/1975 symbols completed. ALX took 1.2s. Estimated remaining: 13m 52s. Rate: 137.0 symbols/min [2025-10-02T22:34:22.647276] [INFO ] [MAIN ] Derivative Progress: 77/1975 symbols completed. ALUR took 1.2s. Estimated remaining: 13m 41s. Rate: 138.8 symbols/min [2025-10-02T22:34:22.645985] [INFO ] [MAIN ] AM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:22.648402] [INFO ] [MAIN ] AMBP: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:22.664792] [DEBUG] [MAIN ] ALV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:22.665733] [INFO ] [MAIN ] ALV: Generated 1807 derivative records from 42666 primary records. [2025-10-02T22:34:22.665849] [DEBUG] [LOCAL ] ALV: Saving derivative data. [2025-10-02T22:34:22.695351] [DEBUG] [LOCAL ] ALV: Derivative data saved (1807 records). [2025-10-02T22:34:22.695550] [INFO ] [MAIN ] ALV: Successfully saved derivative data. [2025-10-02T22:34:22.698766] [INFO ] [MAIN ] Derivative Progress: 78/1975 symbols completed. ALV took 1.3s. Estimated remaining: 13m 31s. Rate: 140.4 symbols/min [2025-10-02T22:34:22.699176] [INFO ] [MAIN ] AMC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:22.744384] [DEBUG] [LOCAL ] AMBP: Loaded 45246 existing records from primary storage. [2025-10-02T22:34:22.744736] [INFO ] [MAIN ] AMBP: Loaded 45246 primary data records. [2025-10-02T22:34:22.866008] [DEBUG] [LOCAL ] AM: Loaded 52439 existing records from primary storage. [2025-10-02T22:34:22.894151] [INFO ] [MAIN ] AM: Loaded 52439 primary data records. [2025-10-02T22:34:23.231955] [DEBUG] [LOCAL ] AMC: Loaded 54150 existing records from primary storage. [2025-10-02T22:34:23.246571] [INFO ] [MAIN ] AMC: Loaded 54150 primary data records. [2025-10-02T22:34:23.872468] [DEBUG] [MAIN ] AMBP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:23.874360] [INFO ] [MAIN ] AMBP: Generated 1807 derivative records from 45246 primary records. [2025-10-02T22:34:23.874880] [DEBUG] [LOCAL ] AMBP: Saving derivative data. [2025-10-02T22:34:23.898252] [DEBUG] [LOCAL ] AMBP: Derivative data saved (1807 records). [2025-10-02T22:34:23.898812] [INFO ] [MAIN ] AMBP: Successfully saved derivative data. [2025-10-02T22:34:23.913486] [INFO ] [MAIN ] Derivative Progress: 79/1975 symbols completed. AMBP took 1.3s. Estimated remaining: 13m 49s. Rate: 137.2 symbols/min [2025-10-02T22:34:23.914540] [INFO ] [MAIN ] AMCR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:23.915528] [DEBUG] [MAIN ] AM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:23.916991] [INFO ] [MAIN ] AM: Generated 1807 derivative records from 52439 primary records. [2025-10-02T22:34:23.917206] [DEBUG] [LOCAL ] AM: Saving derivative data. [2025-10-02T22:34:23.954956] [DEBUG] [MAIN ] AMC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:23.954738] [DEBUG] [LOCAL ] AM: Derivative data saved (1807 records). [2025-10-02T22:34:23.955145] [INFO ] [MAIN ] AM: Successfully saved derivative data. [2025-10-02T22:34:23.956047] [INFO ] [MAIN ] AMC: Generated 1807 derivative records from 54150 primary records. [2025-10-02T22:34:23.958722] [DEBUG] [LOCAL ] AMC: Saving derivative data. [2025-10-02T22:34:23.958494] [INFO ] [MAIN ] Derivative Progress: 80/1975 symbols completed. AM took 1.3s. Estimated remaining: 13m 40s. Rate: 138.7 symbols/min [2025-10-02T22:34:23.959498] [INFO ] [MAIN ] AME: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:23.978231] [DEBUG] [LOCAL ] AMC: Derivative data saved (1807 records). [2025-10-02T22:34:23.978457] [INFO ] [MAIN ] AMC: Successfully saved derivative data. [2025-10-02T22:34:23.982286] [INFO ] [MAIN ] Derivative Progress: 81/1975 symbols completed. AMC took 1.3s. Estimated remaining: 13m 30s. Rate: 140.4 symbols/min [2025-10-02T22:34:23.982513] [INFO ] [MAIN ] AMG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:24.023503] [DEBUG] [LOCAL ] AMCR: Loaded 54059 existing records from primary storage. [2025-10-02T22:34:24.023958] [INFO ] [MAIN ] AMCR: Loaded 54059 primary data records. [2025-10-02T22:34:24.160975] [DEBUG] [LOCAL ] AMG: Loaded 20522 existing records from primary storage. [2025-10-02T22:34:24.187146] [INFO ] [MAIN ] AMG: Loaded 20522 primary data records. [2025-10-02T22:34:24.268637] [DEBUG] [LOCAL ] AME: Loaded 48837 existing records from primary storage. [2025-10-02T22:34:24.332475] [INFO ] [MAIN ] AME: Loaded 48837 primary data records. [2025-10-02T22:34:25.094864] [DEBUG] [MAIN ] AMCR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:25.097247] [INFO ] [MAIN ] AMCR: Generated 1807 derivative records from 54059 primary records. [2025-10-02T22:34:25.097485] [DEBUG] [LOCAL ] AMCR: Saving derivative data. [2025-10-02T22:34:25.119785] [DEBUG] [LOCAL ] AMCR: Derivative data saved (1807 records). [2025-10-02T22:34:25.134352] [DEBUG] [MAIN ] AMG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:25.133979] [INFO ] [MAIN ] AMCR: Successfully saved derivative data. [2025-10-02T22:34:25.136742] [INFO ] [MAIN ] Derivative Progress: 82/1975 symbols completed. AMCR took 1.2s. Estimated remaining: 13m 46s. Rate: 137.5 symbols/min [2025-10-02T22:34:25.137634] [INFO ] [MAIN ] AMG: Generated 1807 derivative records from 20522 primary records. [2025-10-02T22:34:25.137823] [INFO ] [MAIN ] AMH: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:25.138545] [DEBUG] [LOCAL ] AMG: Saving derivative data. [2025-10-02T22:34:25.177113] [DEBUG] [MAIN ] AME: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:25.181513] [DEBUG] [LOCAL ] AMG: Derivative data saved (1807 records). [2025-10-02T22:34:25.181076] [INFO ] [MAIN ] AME: Generated 1807 derivative records from 48837 primary records. [2025-10-02T22:34:25.181866] [DEBUG] [LOCAL ] AME: Saving derivative data. [2025-10-02T22:34:25.182043] [INFO ] [MAIN ] AMG: Successfully saved derivative data. [2025-10-02T22:34:25.185782] [INFO ] [MAIN ] Derivative Progress: 83/1975 symbols completed. AMG took 1.2s. Estimated remaining: 13m 37s. Rate: 139.0 symbols/min [2025-10-02T22:34:25.186000] [INFO ] [MAIN ] AMN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:25.204488] [DEBUG] [LOCAL ] AME: Derivative data saved (1807 records). [2025-10-02T22:34:25.204735] [INFO ] [MAIN ] AME: Successfully saved derivative data. [2025-10-02T22:34:25.207248] [INFO ] [MAIN ] Derivative Progress: 84/1975 symbols completed. AME took 1.2s. Estimated remaining: 13m 27s. Rate: 140.6 symbols/min [2025-10-02T22:34:25.207555] [INFO ] [MAIN ] AMP: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:25.277273] [DEBUG] [LOCAL ] AMH: Loaded 52100 existing records from primary storage. [2025-10-02T22:34:25.278466] [INFO ] [MAIN ] AMH: Loaded 52100 primary data records. [2025-10-02T22:34:25.353234] [DEBUG] [LOCAL ] AMP: Loaded 32439 existing records from primary storage. [2025-10-02T22:34:25.392697] [INFO ] [MAIN ] AMP: Loaded 32439 primary data records. [2025-10-02T22:34:25.417350] [DEBUG] [LOCAL ] AMN: Loaded 42097 existing records from primary storage. [2025-10-02T22:34:25.417621] [INFO ] [MAIN ] AMN: Loaded 42097 primary data records. [2025-10-02T22:34:26.360082] [DEBUG] [MAIN ] AMH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:26.361227] [INFO ] [MAIN ] AMH: Generated 1807 derivative records from 52100 primary records. [2025-10-02T22:34:26.361599] [DEBUG] [LOCAL ] AMH: Saving derivative data. [2025-10-02T22:34:26.396288] [DEBUG] [MAIN ] AMP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:26.398042] [INFO ] [MAIN ] AMP: Generated 1807 derivative records from 32439 primary records. [2025-10-02T22:34:26.405928] [DEBUG] [LOCAL ] AMP: Saving derivative data. [2025-10-02T22:34:26.423867] [DEBUG] [MAIN ] AMN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:26.427993] [DEBUG] [LOCAL ] AMH: Derivative data saved (1807 records). [2025-10-02T22:34:26.431534] [INFO ] [MAIN ] AMN: Generated 1807 derivative records from 42097 primary records. [2025-10-02T22:34:26.432827] [DEBUG] [LOCAL ] AMN: Saving derivative data. [2025-10-02T22:34:26.432762] [INFO ] [MAIN ] AMH: Successfully saved derivative data. [2025-10-02T22:34:26.434926] [INFO ] [MAIN ] Derivative Progress: 85/1975 symbols completed. AMH took 1.3s. Estimated remaining: 13m 44s. Rate: 137.6 symbols/min [2025-10-02T22:34:26.435054] [DEBUG] [LOCAL ] AMP: Derivative data saved (1807 records). [2025-10-02T22:34:26.435211] [INFO ] [MAIN ] AMPX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:26.435707] [INFO ] [MAIN ] AMP: Successfully saved derivative data. [2025-10-02T22:34:26.439168] [INFO ] [MAIN ] Derivative Progress: 86/1975 symbols completed. AMP took 1.2s. Estimated remaining: 13m 35s. Rate: 139.2 symbols/min [2025-10-02T22:34:26.439780] [INFO ] [MAIN ] AMPY: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:26.457353] [DEBUG] [LOCAL ] AMN: Derivative data saved (1807 records). [2025-10-02T22:34:26.457499] [INFO ] [MAIN ] AMN: Successfully saved derivative data. [2025-10-02T22:34:26.460611] [INFO ] [MAIN ] Derivative Progress: 87/1975 symbols completed. AMN took 1.3s. Estimated remaining: 13m 25s. Rate: 140.7 symbols/min [2025-10-02T22:34:26.460980] [INFO ] [MAIN ] AMR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:26.515180] [DEBUG] [LOCAL ] AMPY: Loaded 38186 existing records from primary storage. [2025-10-02T22:34:26.515427] [INFO ] [MAIN ] AMPY: Loaded 38186 primary data records. [2025-10-02T22:34:26.654015] [DEBUG] [LOCAL ] AMPX: Loaded 52687 existing records from primary storage. [2025-10-02T22:34:26.641547] [DEBUG] [LOCAL ] AMR: Loaded 29181 existing records from primary storage. [2025-10-02T22:34:26.654201] [INFO ] [MAIN ] AMR: Loaded 29181 primary data records. [2025-10-02T22:34:26.654277] [INFO ] [MAIN ] AMPX: Loaded 52687 primary data records. [2025-10-02T22:34:27.532213] [DEBUG] [MAIN ] AMPY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:27.533397] [INFO ] [MAIN ] AMPY: Generated 1807 derivative records from 38186 primary records. [2025-10-02T22:34:27.533824] [DEBUG] [LOCAL ] AMPY: Saving derivative data. [2025-10-02T22:34:27.554027] [DEBUG] [LOCAL ] AMPY: Derivative data saved (1807 records). [2025-10-02T22:34:27.554459] [INFO ] [MAIN ] AMPY: Successfully saved derivative data. [2025-10-02T22:34:27.556772] [INFO ] [MAIN ] Derivative Progress: 88/1975 symbols completed. AMPY took 1.1s. Estimated remaining: 13m 39s. Rate: 138.2 symbols/min [2025-10-02T22:34:27.574538] [DEBUG] [MAIN ] AMR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:27.577019] [INFO ] [MAIN ] AMR: Generated 1807 derivative records from 29181 primary records. [2025-10-02T22:34:27.577830] [DEBUG] [LOCAL ] AMR: Saving derivative data. [2025-10-02T22:34:27.601268] [DEBUG] [MAIN ] AMPX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:27.605027] [INFO ] [MAIN ] AMPX: Generated 1807 derivative records from 52687 primary records. [2025-10-02T22:34:27.605345] [DEBUG] [LOCAL ] AMPX: Saving derivative data. [2025-10-02T22:34:27.622852] [DEBUG] [LOCAL ] AMR: Derivative data saved (1807 records). [2025-10-02T22:34:27.623432] [INFO ] [MAIN ] AMR: Successfully saved derivative data. [2025-10-02T22:34:27.626057] [INFO ] [MAIN ] Derivative Progress: 89/1975 symbols completed. AMR took 1.2s. Estimated remaining: 13m 31s. Rate: 139.5 symbols/min [2025-10-02T22:34:27.629283] [DEBUG] [LOCAL ] AMPX: Derivative data saved (1807 records). [2025-10-02T22:34:27.629346] [INFO ] [MAIN ] AMPX: Successfully saved derivative data. [2025-10-02T22:34:27.631394] [INFO ] [MAIN ] Derivative Progress: 90/1975 symbols completed. AMPX took 1.2s. Estimated remaining: 13m 22s. Rate: 141.1 symbols/min [2025-10-02T22:34:27.631836] [INFO ] [MAIN ] AMTB: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:27.631929] [INFO ] [MAIN ] AMT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:27.632388] [INFO ] [MAIN ] AMRC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:27.655907] [DEBUG] [LOCAL ] AMTB: Loaded 20465 existing records from primary storage. [2025-10-02T22:34:27.666019] [INFO ] [MAIN ] AMTB: Loaded 20465 primary data records. [2025-10-02T22:34:27.812577] [DEBUG] [LOCAL ] AMRC: Loaded 38431 existing records from primary storage. [2025-10-02T22:34:27.818550] [INFO ] [MAIN ] AMRC: Loaded 38431 primary data records. [2025-10-02T22:34:27.982555] [DEBUG] [LOCAL ] AMT: Loaded 52808 existing records from primary storage. [2025-10-02T22:34:28.199289] [INFO ] [MAIN ] AMT: Loaded 52808 primary data records. [2025-10-02T22:34:28.804324] [DEBUG] [MAIN ] AMTB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:28.805386] [INFO ] [MAIN ] AMTB: Generated 1807 derivative records from 20465 primary records. [2025-10-02T22:34:28.807057] [DEBUG] [LOCAL ] AMTB: Saving derivative data. [2025-10-02T22:34:28.847017] [DEBUG] [LOCAL ] AMTB: Derivative data saved (1807 records). [2025-10-02T22:34:28.846624] [DEBUG] [MAIN ] AMRC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:28.847198] [INFO ] [MAIN ] AMTB: Successfully saved derivative data. [2025-10-02T22:34:28.848074] [INFO ] [MAIN ] AMRC: Generated 1807 derivative records from 38431 primary records. [2025-10-02T22:34:28.850356] [DEBUG] [LOCAL ] AMRC: Saving derivative data. [2025-10-02T22:34:28.850018] [INFO ] [MAIN ] Derivative Progress: 91/1975 symbols completed. AMTB took 1.2s. Estimated remaining: 13m 38s. Rate: 138.3 symbols/min [2025-10-02T22:34:28.852381] [INFO ] [MAIN ] AMTD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:28.882922] [DEBUG] [MAIN ] AMT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:28.884966] [INFO ] [MAIN ] AMT: Generated 1807 derivative records from 52808 primary records. [2025-10-02T22:34:28.889997] [DEBUG] [LOCAL ] AMRC: Derivative data saved (1807 records). [2025-10-02T22:34:28.886862] [DEBUG] [LOCAL ] AMT: Saving derivative data. [2025-10-02T22:34:28.889582] [DEBUG] [LOCAL ] AMTD: Loaded 3668 existing records from primary storage. [2025-10-02T22:34:28.890203] [INFO ] [MAIN ] AMTD: Loaded 3668 primary data records. [2025-10-02T22:34:28.902247] [INFO ] [MAIN ] AMRC: Successfully saved derivative data. [2025-10-02T22:34:28.931549] [INFO ] [MAIN ] Derivative Progress: 92/1975 symbols completed. AMRC took 1.3s. Estimated remaining: 13m 30s. Rate: 139.5 symbols/min [2025-10-02T22:34:28.986821] [INFO ] [MAIN ] AMTM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:29.057208] [DEBUG] [LOCAL ] AMT: Derivative data saved (1807 records). [2025-10-02T22:34:29.088219] [INFO ] [MAIN ] AMT: Successfully saved derivative data. [2025-10-02T22:34:29.120052] [INFO ] [MAIN ] Derivative Progress: 93/1975 symbols completed. AMT took 1.5s. Estimated remaining: 13m 25s. Rate: 140.3 symbols/min [2025-10-02T22:34:29.242409] [INFO ] [MAIN ] AMWL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:29.270344] [DEBUG] [LOCAL ] AMWL: Loaded 8926 existing records from primary storage. [2025-10-02T22:34:29.270517] [INFO ] [MAIN ] AMWL: Loaded 8926 primary data records. [2025-10-02T22:34:29.404701] [DEBUG] [LOCAL ] AMTM: Loaded 51033 existing records from primary storage. [2025-10-02T22:34:29.409531] [INFO ] [MAIN ] AMTM: Loaded 51033 primary data records. [2025-10-02T22:34:29.748376] [DEBUG] [MAIN ] AMTD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:29.762433] [INFO ] [MAIN ] AMTD: Generated 1807 derivative records from 3668 primary records. [2025-10-02T22:34:29.764177] [DEBUG] [LOCAL ] AMTD: Saving derivative data. [2025-10-02T22:34:29.866398] [DEBUG] [LOCAL ] AMTD: Derivative data saved (1807 records). [2025-10-02T22:34:30.045777] [INFO ] [MAIN ] AMTD: Successfully saved derivative data. [2025-10-02T22:34:30.049309] [INFO ] [MAIN ] Derivative Progress: 94/1975 symbols completed. AMTD took 1.2s. Estimated remaining: 13m 34s. Rate: 138.6 symbols/min [2025-10-02T22:34:30.049623] [INFO ] [MAIN ] AMX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:30.073577] [DEBUG] [MAIN ] AMWL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:30.074691] [INFO ] [MAIN ] AMWL: Generated 1807 derivative records from 8926 primary records. [2025-10-02T22:34:30.075060] [DEBUG] [LOCAL ] AMWL: Saving derivative data. [2025-10-02T22:34:30.093863] [DEBUG] [LOCAL ] AMWL: Derivative data saved (1807 records). [2025-10-02T22:34:30.094305] [INFO ] [MAIN ] AMWL: Successfully saved derivative data. [2025-10-02T22:34:30.096521] [INFO ] [MAIN ] Derivative Progress: 95/1975 symbols completed. AMWL took 0.9s. Estimated remaining: 13m 26s. Rate: 139.9 symbols/min [2025-10-02T22:34:30.096828] [INFO ] [MAIN ] ANET: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:30.125343] [DEBUG] [MAIN ] AMTM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:30.126353] [INFO ] [MAIN ] AMTM: Generated 1807 derivative records from 51033 primary records. [2025-10-02T22:34:30.126469] [DEBUG] [LOCAL ] AMTM: Saving derivative data. [2025-10-02T22:34:30.145152] [DEBUG] [LOCAL ] AMTM: Derivative data saved (1807 records). [2025-10-02T22:34:30.146231] [INFO ] [MAIN ] AMTM: Successfully saved derivative data. [2025-10-02T22:34:30.148670] [INFO ] [MAIN ] Derivative Progress: 96/1975 symbols completed. AMTM took 1.2s. Estimated remaining: 13m 18s. Rate: 141.2 symbols/min [2025-10-02T22:34:30.149039] [INFO ] [MAIN ] ANRO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:30.166721] [DEBUG] [LOCAL ] AMX: Loaded 49493 existing records from primary storage. [2025-10-02T22:34:30.167040] [INFO ] [MAIN ] AMX: Loaded 49493 primary data records. [2025-10-02T22:34:30.315009] [DEBUG] [LOCAL ] ANRO: Loaded 18833 existing records from primary storage. [2025-10-02T22:34:30.326276] [INFO ] [MAIN ] ANRO: Loaded 18833 primary data records. [2025-10-02T22:34:30.445836] [DEBUG] [LOCAL ] ANET: Loaded 54156 existing records from primary storage. [2025-10-02T22:34:30.506155] [INFO ] [MAIN ] ANET: Loaded 54156 primary data records. [2025-10-02T22:34:31.304021] [DEBUG] [MAIN ] AMX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:31.305172] [INFO ] [MAIN ] AMX: Generated 1807 derivative records from 49493 primary records. [2025-10-02T22:34:31.305587] [DEBUG] [LOCAL ] AMX: Saving derivative data. [2025-10-02T22:34:31.332178] [DEBUG] [MAIN ] ANRO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:31.334762] [INFO ] [MAIN ] ANRO: Generated 1807 derivative records from 18833 primary records. [2025-10-02T22:34:31.335028] [DEBUG] [LOCAL ] ANRO: Saving derivative data. [2025-10-02T22:34:31.354433] [DEBUG] [LOCAL ] AMX: Derivative data saved (1807 records). [2025-10-02T22:34:31.371771] [DEBUG] [LOCAL ] ANRO: Derivative data saved (1807 records). [2025-10-02T22:34:31.371704] [INFO ] [MAIN ] AMX: Successfully saved derivative data. [2025-10-02T22:34:31.374181] [INFO ] [MAIN ] Derivative Progress: 97/1975 symbols completed. AMX took 1.3s. Estimated remaining: 13m 33s. Rate: 138.5 symbols/min [2025-10-02T22:34:31.371876] [INFO ] [MAIN ] ANRO: Successfully saved derivative data. [2025-10-02T22:34:31.374718] [DEBUG] [MAIN ] ANET: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:31.374870] [INFO ] [MAIN ] ANVS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:31.378061] [INFO ] [MAIN ] ANET: Generated 1807 derivative records from 54156 primary records. [2025-10-02T22:34:31.377149] [INFO ] [MAIN ] Derivative Progress: 98/1975 symbols completed. ANRO took 1.2s. Estimated remaining: 13m 25s. Rate: 139.9 symbols/min [2025-10-02T22:34:31.378231] [INFO ] [MAIN ] AOD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:31.378340] [DEBUG] [LOCAL ] ANET: Saving derivative data. [2025-10-02T22:34:31.396340] [DEBUG] [LOCAL ] ANET: Derivative data saved (1807 records). [2025-10-02T22:34:31.396710] [INFO ] [MAIN ] ANET: Successfully saved derivative data. [2025-10-02T22:34:31.400082] [INFO ] [MAIN ] Derivative Progress: 99/1975 symbols completed. ANET took 1.3s. Estimated remaining: 13m 17s. Rate: 141.3 symbols/min [2025-10-02T22:34:31.400468] [INFO ] [MAIN ] AOMR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:31.434526] [DEBUG] [LOCAL ] AOD: Loaded 30406 existing records from primary storage. [2025-10-02T22:34:31.443255] [INFO ] [MAIN ] AOD: Loaded 30406 primary data records. [2025-10-02T22:34:31.456626] [DEBUG] [LOCAL ] ANVS: Loaded 23369 existing records from primary storage. [2025-10-02T22:34:31.450373] [DEBUG] [LOCAL ] AOMR: Loaded 16644 existing records from primary storage. [2025-10-02T22:34:31.532273] [INFO ] [MAIN ] ANVS: Loaded 23369 primary data records. [2025-10-02T22:34:31.532145] [INFO ] [MAIN ] AOMR: Loaded 16644 primary data records. [2025-10-02T22:34:32.602704] [DEBUG] [MAIN ] AOD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:32.604253] [INFO ] [MAIN ] AOD: Generated 1807 derivative records from 30406 primary records. [2025-10-02T22:34:32.604455] [DEBUG] [LOCAL ] AOD: Saving derivative data. [2025-10-02T22:34:32.631568] [DEBUG] [MAIN ] AOMR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:32.656155] [DEBUG] [MAIN ] ANVS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:32.653775] [INFO ] [MAIN ] AOMR: Generated 1807 derivative records from 16644 primary records. [2025-10-02T22:34:32.656711] [DEBUG] [LOCAL ] AOMR: Saving derivative data. [2025-10-02T22:34:32.656816] [DEBUG] [LOCAL ] AOD: Derivative data saved (1807 records). [2025-10-02T22:34:32.657741] [INFO ] [MAIN ] ANVS: Generated 1807 derivative records from 23369 primary records. [2025-10-02T22:34:32.657909] [DEBUG] [LOCAL ] ANVS: Saving derivative data. [2025-10-02T22:34:32.659408] [INFO ] [MAIN ] AOD: Successfully saved derivative data. [2025-10-02T22:34:32.661927] [INFO ] [MAIN ] Derivative Progress: 100/1975 symbols completed. AOD took 1.3s. Estimated remaining: 13m 32s. Rate: 138.6 symbols/min [2025-10-02T22:34:32.671688] [INFO ] [MAIN ] AON: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:32.692467] [DEBUG] [LOCAL ] ANVS: Derivative data saved (1807 records). [2025-10-02T22:34:32.694150] [INFO ] [MAIN ] ANVS: Successfully saved derivative data. [2025-10-02T22:34:32.697957] [INFO ] [MAIN ] Derivative Progress: 101/1975 symbols completed. ANVS took 1.3s. Estimated remaining: 13m 24s. Rate: 139.8 symbols/min [2025-10-02T22:34:32.698583] [INFO ] [MAIN ] AOS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:32.700690] [DEBUG] [LOCAL ] AOMR: Derivative data saved (1807 records). [2025-10-02T22:34:32.701099] [INFO ] [MAIN ] AOMR: Successfully saved derivative data. [2025-10-02T22:34:32.703382] [INFO ] [MAIN ] Derivative Progress: 102/1975 symbols completed. AOMR took 1.3s. Estimated remaining: 13m 16s. Rate: 141.2 symbols/min [2025-10-02T22:34:32.703892] [INFO ] [MAIN ] AP: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:32.718941] [DEBUG] [LOCAL ] AP: Loaded 7211 existing records from primary storage. [2025-10-02T22:34:32.719108] [INFO ] [MAIN ] AP: Loaded 7211 primary data records. [2025-10-02T22:34:33.007872] [DEBUG] [LOCAL ] AOS: Loaded 49194 existing records from primary storage. [2025-10-02T22:34:33.097701] [INFO ] [MAIN ] AOS: Loaded 49194 primary data records. [2025-10-02T22:34:33.089357] [DEBUG] [LOCAL ] AON: Loaded 45726 existing records from primary storage. [2025-10-02T22:34:33.098413] [INFO ] [MAIN ] AON: Loaded 45726 primary data records. [2025-10-02T22:34:33.786565] [DEBUG] [MAIN ] AP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:33.788431] [INFO ] [MAIN ] AP: Generated 1807 derivative records from 7211 primary records. [2025-10-02T22:34:33.788594] [DEBUG] [LOCAL ] AP: Saving derivative data. [2025-10-02T22:34:33.807490] [DEBUG] [LOCAL ] AP: Derivative data saved (1807 records). [2025-10-02T22:34:33.809168] [INFO ] [MAIN ] AP: Successfully saved derivative data. [2025-10-02T22:34:33.811684] [INFO ] [MAIN ] Derivative Progress: 103/1975 symbols completed. AP took 1.1s. Estimated remaining: 13m 28s. Rate: 139.0 symbols/min [2025-10-02T22:34:33.844028] [DEBUG] [MAIN ] AON: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:33.843782] [DEBUG] [MAIN ] AOS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:33.844827] [INFO ] [MAIN ] AOS: Generated 1807 derivative records from 49194 primary records. [2025-10-02T22:34:33.845385] [INFO ] [MAIN ] AON: Generated 1807 derivative records from 45726 primary records. [2025-10-02T22:34:33.845448] [DEBUG] [LOCAL ] AOS: Saving derivative data. [2025-10-02T22:34:33.845538] [DEBUG] [LOCAL ] AON: Saving derivative data. [2025-10-02T22:34:33.876223] [DEBUG] [LOCAL ] AON: Derivative data saved (1807 records). [2025-10-02T22:34:33.877743] [INFO ] [MAIN ] AON: Successfully saved derivative data. [2025-10-02T22:34:33.881146] [INFO ] [MAIN ] Derivative Progress: 104/1975 symbols completed. AON took 1.2s. Estimated remaining: 13m 21s. Rate: 140.2 symbols/min [2025-10-02T22:34:33.882197] [DEBUG] [LOCAL ] AOS: Derivative data saved (1807 records). [2025-10-02T22:34:33.882413] [INFO ] [MAIN ] AOS: Successfully saved derivative data. [2025-10-02T22:34:33.884480] [INFO ] [MAIN ] Derivative Progress: 105/1975 symbols completed. AOS took 1.2s. Estimated remaining: 13m 13s. Rate: 141.5 symbols/min [2025-10-02T22:34:33.884941] [INFO ] [MAIN ] APAM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:33.884876] [INFO ] [MAIN ] APD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:33.885035] [INFO ] [MAIN ] APG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:33.952123] [DEBUG] [LOCAL ] APAM: Loaded 36350 existing records from primary storage. [2025-10-02T22:34:33.952907] [INFO ] [MAIN ] APAM: Loaded 36350 primary data records. [2025-10-02T22:34:34.009258] [DEBUG] [LOCAL ] APG: Loaded 50572 existing records from primary storage. [2025-10-02T22:34:34.030864] [INFO ] [MAIN ] APG: Loaded 50572 primary data records. [2025-10-02T22:34:34.092690] [DEBUG] [LOCAL ] APD: Loaded 45731 existing records from primary storage. [2025-10-02T22:34:34.152996] [INFO ] [MAIN ] APD: Loaded 45731 primary data records. [2025-10-02T22:34:35.075977] [DEBUG] [MAIN ] APAM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:35.076795] [INFO ] [MAIN ] APAM: Generated 1807 derivative records from 36350 primary records. [2025-10-02T22:34:35.077082] [DEBUG] [LOCAL ] APAM: Saving derivative data. [2025-10-02T22:34:35.104690] [DEBUG] [LOCAL ] APAM: Derivative data saved (1807 records). [2025-10-02T22:34:35.105797] [INFO ] [MAIN ] APAM: Successfully saved derivative data. [2025-10-02T22:34:35.108037] [INFO ] [MAIN ] Derivative Progress: 106/1975 symbols completed. APAM took 1.2s. Estimated remaining: 13m 27s. Rate: 139.0 symbols/min [2025-10-02T22:34:35.108861] [INFO ] [MAIN ] APH: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:35.138177] [DEBUG] [MAIN ] APD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:35.139047] [DEBUG] [MAIN ] APG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:35.140162] [INFO ] [MAIN ] APD: Generated 1807 derivative records from 45731 primary records. [2025-10-02T22:34:35.140626] [DEBUG] [LOCAL ] APD: Saving derivative data. [2025-10-02T22:34:35.141547] [INFO ] [MAIN ] APG: Generated 1807 derivative records from 50572 primary records. [2025-10-02T22:34:35.142581] [DEBUG] [LOCAL ] APG: Saving derivative data. [2025-10-02T22:34:35.168447] [DEBUG] [LOCAL ] APD: Derivative data saved (1807 records). [2025-10-02T22:34:35.176622] [INFO ] [MAIN ] APD: Successfully saved derivative data. [2025-10-02T22:34:35.179462] [INFO ] [MAIN ] Derivative Progress: 107/1975 symbols completed. APD took 1.3s. Estimated remaining: 13m 20s. Rate: 140.1 symbols/min [2025-10-02T22:34:35.181402] [INFO ] [MAIN ] APO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:35.181694] [DEBUG] [LOCAL ] APG: Derivative data saved (1807 records). [2025-10-02T22:34:35.182311] [INFO ] [MAIN ] APG: Successfully saved derivative data. [2025-10-02T22:34:35.185541] [INFO ] [MAIN ] Derivative Progress: 108/1975 symbols completed. APG took 1.3s. Estimated remaining: 13m 12s. Rate: 141.4 symbols/min [2025-10-02T22:34:35.185890] [INFO ] [MAIN ] APTV: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:35.227637] [DEBUG] [LOCAL ] APH: Loaded 54081 existing records from primary storage. [2025-10-02T22:34:35.227929] [INFO ] [MAIN ] APH: Loaded 54081 primary data records. [2025-10-02T22:34:35.456688] [DEBUG] [LOCAL ] APO: Loaded 53773 existing records from primary storage. [2025-10-02T22:34:35.459700] [INFO ] [MAIN ] APO: Loaded 53773 primary data records. [2025-10-02T22:34:35.472810] [DEBUG] [LOCAL ] APTV: Loaded 52472 existing records from primary storage. [2025-10-02T22:34:35.505626] [INFO ] [MAIN ] APTV: Loaded 52472 primary data records. [2025-10-02T22:34:36.317943] [DEBUG] [MAIN ] APH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:36.326683] [INFO ] [MAIN ] APH: Generated 1807 derivative records from 54081 primary records. [2025-10-02T22:34:36.332081] [DEBUG] [MAIN ] APO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:36.332217] [DEBUG] [LOCAL ] APH: Saving derivative data. [2025-10-02T22:34:36.332938] [INFO ] [MAIN ] APO: Generated 1807 derivative records from 53773 primary records. [2025-10-02T22:34:36.334117] [DEBUG] [LOCAL ] APO: Saving derivative data. [2025-10-02T22:34:36.369928] [DEBUG] [LOCAL ] APO: Derivative data saved (1807 records). [2025-10-02T22:34:36.370899] [INFO ] [MAIN ] APO: Successfully saved derivative data. [2025-10-02T22:34:36.374587] [INFO ] [MAIN ] Derivative Progress: 109/1975 symbols completed. APO took 1.2s. Estimated remaining: 13m 25s. Rate: 139.1 symbols/min [2025-10-02T22:34:36.388187] [INFO ] [MAIN ] AQN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:36.390788] [DEBUG] [LOCAL ] APH: Derivative data saved (1807 records). [2025-10-02T22:34:36.390930] [INFO ] [MAIN ] APH: Successfully saved derivative data. [2025-10-02T22:34:36.389790] [DEBUG] [MAIN ] APTV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:36.393626] [INFO ] [MAIN ] Derivative Progress: 110/1975 symbols completed. APH took 1.3s. Estimated remaining: 13m 17s. Rate: 140.3 symbols/min [2025-10-02T22:34:36.393935] [INFO ] [MAIN ] AQNB: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:36.395067] [INFO ] [MAIN ] APTV: Generated 1807 derivative records from 52472 primary records. [2025-10-02T22:34:36.395430] [DEBUG] [LOCAL ] APTV: Saving derivative data. [2025-10-02T22:34:36.414262] [DEBUG] [LOCAL ] APTV: Derivative data saved (1807 records). [2025-10-02T22:34:36.417755] [INFO ] [MAIN ] APTV: Successfully saved derivative data. [2025-10-02T22:34:36.418047] [DEBUG] [LOCAL ] AQNB: Loaded 4183 existing records from primary storage. [2025-10-02T22:34:36.422148] [INFO ] [MAIN ] Derivative Progress: 111/1975 symbols completed. APTV took 1.2s. Estimated remaining: 13m 10s. Rate: 141.5 symbols/min [2025-10-02T22:34:36.422516] [INFO ] [MAIN ] AR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:36.422671] [INFO ] [MAIN ] AQNB: Loaded 4183 primary data records. [2025-10-02T22:34:36.837053] [DEBUG] [LOCAL ] AQN: Loaded 52288 existing records from primary storage. [2025-10-02T22:34:36.838074] [INFO ] [MAIN ] AQN: Loaded 52288 primary data records. [2025-10-02T22:34:36.914332] [DEBUG] [LOCAL ] AR: Loaded 53973 existing records from primary storage. [2025-10-02T22:34:36.938198] [INFO ] [MAIN ] AR: Loaded 53973 primary data records. [2025-10-02T22:34:37.534114] [DEBUG] [MAIN ] AQNB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:37.535447] [INFO ] [MAIN ] AQNB: Generated 1807 derivative records from 4183 primary records. [2025-10-02T22:34:37.536433] [DEBUG] [LOCAL ] AQNB: Saving derivative data. [2025-10-02T22:34:37.556896] [DEBUG] [LOCAL ] AQNB: Derivative data saved (1807 records). [2025-10-02T22:34:37.558137] [INFO ] [MAIN ] AQNB: Successfully saved derivative data. [2025-10-02T22:34:37.561003] [INFO ] [MAIN ] Derivative Progress: 112/1975 symbols completed. AQNB took 1.2s. Estimated remaining: 13m 22s. Rate: 139.4 symbols/min [2025-10-02T22:34:37.563279] [INFO ] [MAIN ] ARCO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:37.580709] [DEBUG] [MAIN ] AQN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:37.581464] [INFO ] [MAIN ] AQN: Generated 1807 derivative records from 52288 primary records. [2025-10-02T22:34:37.581711] [DEBUG] [LOCAL ] AQN: Saving derivative data. [2025-10-02T22:34:37.617630] [DEBUG] [LOCAL ] AQN: Derivative data saved (1807 records). [2025-10-02T22:34:37.628206] [INFO ] [MAIN ] AQN: Successfully saved derivative data. [2025-10-02T22:34:37.630266] [INFO ] [MAIN ] Derivative Progress: 113/1975 symbols completed. AQN took 1.2s. Estimated remaining: 13m 15s. Rate: 140.5 symbols/min [2025-10-02T22:34:37.630544] [INFO ] [MAIN ] ARDC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:37.628023] [DEBUG] [MAIN ] AR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:37.631909] [INFO ] [MAIN ] AR: Generated 1807 derivative records from 53973 primary records. [2025-10-02T22:34:37.632100] [DEBUG] [LOCAL ] AR: Saving derivative data. [2025-10-02T22:34:37.649245] [DEBUG] [LOCAL ] AR: Derivative data saved (1807 records). [2025-10-02T22:34:37.662295] [INFO ] [MAIN ] AR: Successfully saved derivative data. [2025-10-02T22:34:37.665037] [INFO ] [MAIN ] Derivative Progress: 114/1975 symbols completed. AR took 1.2s. Estimated remaining: 13m 9s. Rate: 141.6 symbols/min [2025-10-02T22:34:37.668782] [INFO ] [MAIN ] ARDT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:37.670095] [DEBUG] [LOCAL ] ARCO: Loaded 44724 existing records from primary storage. [2025-10-02T22:34:37.670553] [INFO ] [MAIN ] ARCO: Loaded 44724 primary data records. [2025-10-02T22:34:37.762719] [DEBUG] [LOCAL ] ARDC: Loaded 14882 existing records from primary storage. [2025-10-02T22:34:37.801702] [INFO ] [MAIN ] ARDC: Loaded 14882 primary data records. [2025-10-02T22:34:38.112943] [DEBUG] [LOCAL ] ARDT: Loaded 27847 existing records from primary storage. [2025-10-02T22:34:38.119383] [INFO ] [MAIN ] ARDT: Loaded 27847 primary data records. [2025-10-02T22:34:38.855987] [DEBUG] [MAIN ] ARCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:38.858449] [INFO ] [MAIN ] ARCO: Generated 1807 derivative records from 44724 primary records. [2025-10-02T22:34:38.858793] [DEBUG] [LOCAL ] ARCO: Saving derivative data. [2025-10-02T22:34:38.883496] [DEBUG] [LOCAL ] ARCO: Derivative data saved (1807 records). [2025-10-02T22:34:38.884778] [INFO ] [MAIN ] ARCO: Successfully saved derivative data. [2025-10-02T22:34:38.890375] [INFO ] [MAIN ] Derivative Progress: 115/1975 symbols completed. ARCO took 1.3s. Estimated remaining: 13m 21s. Rate: 139.3 symbols/min [2025-10-02T22:34:38.891472] [INFO ] [MAIN ] ARE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:38.919256] [DEBUG] [MAIN ] ARDT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:38.920811] [INFO ] [MAIN ] ARDT: Generated 1807 derivative records from 27847 primary records. [2025-10-02T22:34:38.920014] [DEBUG] [MAIN ] ARDC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:38.920959] [DEBUG] [LOCAL ] ARDT: Saving derivative data. [2025-10-02T22:34:38.921570] [INFO ] [MAIN ] ARDC: Generated 1807 derivative records from 14882 primary records. [2025-10-02T22:34:38.922111] [DEBUG] [LOCAL ] ARDC: Saving derivative data. [2025-10-02T22:34:38.956154] [DEBUG] [LOCAL ] ARDT: Derivative data saved (1807 records). [2025-10-02T22:34:38.957536] [DEBUG] [LOCAL ] ARDC: Derivative data saved (1807 records). [2025-10-02T22:34:38.957758] [INFO ] [MAIN ] ARDT: Successfully saved derivative data. [2025-10-02T22:34:38.957867] [INFO ] [MAIN ] ARDC: Successfully saved derivative data. [2025-10-02T22:34:38.960439] [INFO ] [MAIN ] Derivative Progress: 116/1975 symbols completed. ARDC took 1.3s. Estimated remaining: 13m 15s. Rate: 140.3 symbols/min [2025-10-02T22:34:38.963409] [INFO ] [MAIN ] Derivative Progress: 117/1975 symbols completed. ARDT took 1.3s. Estimated remaining: 13m 8s. Rate: 141.5 symbols/min [2025-10-02T22:34:38.963281] [INFO ] [MAIN ] ARES: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:38.963687] [INFO ] [MAIN ] ARI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:39.017866] [DEBUG] [LOCAL ] ARE: Loaded 51001 existing records from primary storage. [2025-10-02T22:34:39.018288] [INFO ] [MAIN ] ARE: Loaded 51001 primary data records. [2025-10-02T22:34:39.163628] [DEBUG] [LOCAL ] ARI: Loaded 43834 existing records from primary storage. [2025-10-02T22:34:39.169690] [INFO ] [MAIN ] ARI: Loaded 43834 primary data records. [2025-10-02T22:34:39.329303] [DEBUG] [LOCAL ] ARES: Loaded 49934 existing records from primary storage. [2025-10-02T22:34:39.463669] [INFO ] [MAIN ] ARES: Loaded 49934 primary data records. [2025-10-02T22:34:40.208478] [DEBUG] [MAIN ] ARE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:40.209557] [INFO ] [MAIN ] ARE: Generated 1807 derivative records from 51001 primary records. [2025-10-02T22:34:40.209863] [DEBUG] [LOCAL ] ARE: Saving derivative data. [2025-10-02T22:34:40.233538] [DEBUG] [LOCAL ] ARE: Derivative data saved (1807 records). [2025-10-02T22:34:40.233942] [INFO ] [MAIN ] ARE: Successfully saved derivative data. [2025-10-02T22:34:40.236437] [INFO ] [MAIN ] Derivative Progress: 118/1975 symbols completed. ARE took 1.3s. Estimated remaining: 13m 21s. Rate: 139.2 symbols/min [2025-10-02T22:34:40.258820] [DEBUG] [MAIN ] ARI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:40.271783] [DEBUG] [MAIN ] ARES: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:40.272668] [INFO ] [MAIN ] ARES: Generated 1807 derivative records from 49934 primary records. [2025-10-02T22:34:40.274571] [INFO ] [MAIN ] ARI: Generated 1807 derivative records from 43834 primary records. [2025-10-02T22:34:40.274925] [DEBUG] [LOCAL ] ARES: Saving derivative data. [2025-10-02T22:34:40.274877] [DEBUG] [LOCAL ] ARI: Saving derivative data. [2025-10-02T22:34:40.328380] [DEBUG] [LOCAL ] ARES: Derivative data saved (1807 records). [2025-10-02T22:34:40.328717] [INFO ] [MAIN ] ARES: Successfully saved derivative data. [2025-10-02T22:34:40.331180] [INFO ] [MAIN ] Derivative Progress: 119/1975 symbols completed. ARES took 1.4s. Estimated remaining: 13m 15s. Rate: 140.1 symbols/min [2025-10-02T22:34:40.328487] [DEBUG] [LOCAL ] ARI: Derivative data saved (1807 records). [2025-10-02T22:34:40.331574] [INFO ] [MAIN ] ARI: Successfully saved derivative data. [2025-10-02T22:34:40.336077] [INFO ] [MAIN ] Derivative Progress: 120/1975 symbols completed. ARI took 1.4s. Estimated remaining: 13m 8s. Rate: 141.2 symbols/min [2025-10-02T22:34:40.336962] [INFO ] [MAIN ] AROC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:40.336826] [INFO ] [MAIN ] ARLO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:40.337800] [INFO ] [MAIN ] ARMK: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:40.416364] [DEBUG] [LOCAL ] ARLO: Loaded 44159 existing records from primary storage. [2025-10-02T22:34:40.416605] [INFO ] [MAIN ] ARLO: Loaded 44159 primary data records. [2025-10-02T22:34:40.423453] [DEBUG] [LOCAL ] ARMK: Loaded 50699 existing records from primary storage. [2025-10-02T22:34:40.444473] [INFO ] [MAIN ] ARMK: Loaded 50699 primary data records. [2025-10-02T22:34:40.698841] [DEBUG] [LOCAL ] AROC: Loaded 49327 existing records from primary storage. [2025-10-02T22:34:40.745599] [INFO ] [MAIN ] AROC: Loaded 49327 primary data records. [2025-10-02T22:34:41.613579] [DEBUG] [MAIN ] ARLO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:41.615766] [INFO ] [MAIN ] ARLO: Generated 1807 derivative records from 44159 primary records. [2025-10-02T22:34:41.615980] [DEBUG] [LOCAL ] ARLO: Saving derivative data. [2025-10-02T22:34:41.652442] [DEBUG] [MAIN ] ARMK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:41.654284] [INFO ] [MAIN ] ARMK: Generated 1807 derivative records from 50699 primary records. [2025-10-02T22:34:41.655228] [DEBUG] [LOCAL ] ARMK: Saving derivative data. [2025-10-02T22:34:41.657540] [DEBUG] [LOCAL ] ARLO: Derivative data saved (1807 records). [2025-10-02T22:34:41.657746] [INFO ] [MAIN ] ARLO: Successfully saved derivative data. [2025-10-02T22:34:41.660832] [INFO ] [MAIN ] Derivative Progress: 121/1975 symbols completed. ARLO took 1.3s. Estimated remaining: 13m 21s. Rate: 138.8 symbols/min [2025-10-02T22:34:41.662334] [INFO ] [MAIN ] ARR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:41.683942] [DEBUG] [LOCAL ] ARMK: Derivative data saved (1807 records). [2025-10-02T22:34:41.684381] [INFO ] [MAIN ] ARMK: Successfully saved derivative data. [2025-10-02T22:34:41.686744] [INFO ] [MAIN ] Derivative Progress: 122/1975 symbols completed. ARMK took 1.3s. Estimated remaining: 13m 15s. Rate: 139.9 symbols/min [2025-10-02T22:34:41.687405] [INFO ] [MAIN ] ARW: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:41.702352] [DEBUG] [MAIN ] AROC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:41.703272] [INFO ] [MAIN ] AROC: Generated 1807 derivative records from 49327 primary records. [2025-10-02T22:34:41.703413] [DEBUG] [LOCAL ] AROC: Saving derivative data. [2025-10-02T22:34:41.721426] [DEBUG] [LOCAL ] AROC: Derivative data saved (1807 records). [2025-10-02T22:34:41.721669] [INFO ] [MAIN ] AROC: Successfully saved derivative data. [2025-10-02T22:34:41.724100] [INFO ] [MAIN ] Derivative Progress: 123/1975 symbols completed. AROC took 1.4s. Estimated remaining: 13m 8s. Rate: 140.9 symbols/min [2025-10-02T22:34:41.724399] [INFO ] [MAIN ] AS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:41.771073] [DEBUG] [LOCAL ] ARW: Loaded 33339 existing records from primary storage. [2025-10-02T22:34:41.786194] [INFO ] [MAIN ] ARW: Loaded 33339 primary data records. [2025-10-02T22:34:41.793110] [DEBUG] [LOCAL ] ARR: Loaded 52419 existing records from primary storage. [2025-10-02T22:34:41.825203] [INFO ] [MAIN ] ARR: Loaded 52419 primary data records. [2025-10-02T22:34:42.178437] [DEBUG] [LOCAL ] AS: Loaded 53472 existing records from primary storage. [2025-10-02T22:34:42.298120] [INFO ] [MAIN ] AS: Loaded 53472 primary data records. [2025-10-02T22:34:42.852631] [DEBUG] [MAIN ] ARW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:42.854776] [INFO ] [MAIN ] ARW: Generated 1807 derivative records from 33339 primary records. [2025-10-02T22:34:42.857040] [DEBUG] [LOCAL ] ARW: Saving derivative data. [2025-10-02T22:34:42.879331] [DEBUG] [MAIN ] ARR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:42.887668] [INFO ] [MAIN ] ARR: Generated 1807 derivative records from 52419 primary records. [2025-10-02T22:34:42.890813] [DEBUG] [LOCAL ] ARR: Saving derivative data. [2025-10-02T22:34:42.893357] [DEBUG] [LOCAL ] ARW: Derivative data saved (1807 records). [2025-10-02T22:34:42.901542] [INFO ] [MAIN ] ARW: Successfully saved derivative data. [2025-10-02T22:34:42.920936] [INFO ] [MAIN ] Derivative Progress: 124/1975 symbols completed. ARW took 1.2s. Estimated remaining: 13m 20s. Rate: 138.9 symbols/min [2025-10-02T22:34:42.921706] [DEBUG] [MAIN ] AS: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-02T22:34:42.922956] [INFO ] [MAIN ] AS: Generated 1806 derivative records from 53472 primary records. [2025-10-02T22:34:42.923062] [DEBUG] [LOCAL ] AS: Saving derivative data. [2025-10-02T22:34:42.923456] [INFO ] [MAIN ] ASA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:42.949015] [DEBUG] [LOCAL ] ARR: Derivative data saved (1807 records). [2025-10-02T22:34:42.949750] [INFO ] [MAIN ] ARR: Successfully saved derivative data. [2025-10-02T22:34:42.952351] [INFO ] [MAIN ] Derivative Progress: 125/1975 symbols completed. ARR took 1.3s. Estimated remaining: 13m 13s. Rate: 139.9 symbols/min [2025-10-02T22:34:42.953035] [INFO ] [MAIN ] ASAN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:42.953875] [DEBUG] [LOCAL ] AS: Derivative data saved (1806 records). [2025-10-02T22:34:42.954052] [INFO ] [MAIN ] AS: Successfully saved derivative data. [2025-10-02T22:34:42.958485] [INFO ] [MAIN ] Derivative Progress: 126/1975 symbols completed. AS took 1.2s. Estimated remaining: 13m 7s. Rate: 141.0 symbols/min [2025-10-02T22:34:42.964611] [INFO ] [MAIN ] ASB: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:42.965346] [DEBUG] [LOCAL ] ASA: Loaded 14321 existing records from primary storage. [2025-10-02T22:34:42.966077] [INFO ] [MAIN ] ASA: Loaded 14321 primary data records. [2025-10-02T22:34:43.333323] [DEBUG] [LOCAL ] ASAN: Loaded 53110 existing records from primary storage. [2025-10-02T22:34:43.334686] [INFO ] [MAIN ] ASAN: Loaded 53110 primary data records. [2025-10-02T22:34:43.419070] [DEBUG] [LOCAL ] ASB: Loaded 49883 existing records from primary storage. [2025-10-02T22:34:43.436774] [INFO ] [MAIN ] ASB: Loaded 49883 primary data records. [2025-10-02T22:34:43.973838] [DEBUG] [MAIN ] ASA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:44.091448] [INFO ] [MAIN ] ASA: Generated 1807 derivative records from 14321 primary records. [2025-10-02T22:34:44.100703] [DEBUG] [LOCAL ] ASA: Saving derivative data. [2025-10-02T22:34:44.123444] [DEBUG] [LOCAL ] ASA: Derivative data saved (1807 records). [2025-10-02T22:34:44.124509] [INFO ] [MAIN ] ASA: Successfully saved derivative data. [2025-10-02T22:34:44.126942] [INFO ] [MAIN ] Derivative Progress: 127/1975 symbols completed. ASA took 1.2s. Estimated remaining: 13m 17s. Rate: 139.1 symbols/min [2025-10-02T22:34:44.127605] [INFO ] [MAIN ] ASBA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:44.139675] [DEBUG] [LOCAL ] ASBA: Loaded 3476 existing records from primary storage. [2025-10-02T22:34:44.140197] [INFO ] [MAIN ] ASBA: Loaded 3476 primary data records. [2025-10-02T22:34:44.243664] [DEBUG] [MAIN ] ASAN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:44.274594] [INFO ] [MAIN ] ASAN: Generated 1807 derivative records from 53110 primary records. [2025-10-02T22:34:44.292130] [DEBUG] [LOCAL ] ASAN: Saving derivative data. [2025-10-02T22:34:44.528458] [DEBUG] [MAIN ] ASB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:44.529903] [INFO ] [MAIN ] ASB: Generated 1807 derivative records from 49883 primary records. [2025-10-02T22:34:44.531104] [DEBUG] [LOCAL ] ASB: Saving derivative data. [2025-10-02T22:34:44.531292] [DEBUG] [LOCAL ] ASAN: Derivative data saved (1807 records). [2025-10-02T22:34:44.534008] [INFO ] [MAIN ] ASAN: Successfully saved derivative data. [2025-10-02T22:34:44.536893] [INFO ] [MAIN ] Derivative Progress: 128/1975 symbols completed. ASAN took 1.6s. Estimated remaining: 13m 16s. Rate: 139.2 symbols/min [2025-10-02T22:34:44.550121] [INFO ] [MAIN ] ASC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:44.558626] [DEBUG] [LOCAL ] ASB: Derivative data saved (1807 records). [2025-10-02T22:34:44.559306] [INFO ] [MAIN ] ASB: Successfully saved derivative data. [2025-10-02T22:34:44.561786] [INFO ] [MAIN ] Derivative Progress: 129/1975 symbols completed. ASB took 1.6s. Estimated remaining: 13m 10s. Rate: 140.2 symbols/min [2025-10-02T22:34:44.562144] [INFO ] [MAIN ] ASG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:44.582352] [DEBUG] [MAIN ] ASBA: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-02T22:34:44.583300] [INFO ] [MAIN ] ASBA: Generated 1806 derivative records from 3476 primary records. [2025-10-02T22:34:44.583363] [DEBUG] [LOCAL ] ASBA: Saving derivative data. [2025-10-02T22:34:44.621302] [DEBUG] [LOCAL ] ASG: Loaded 19972 existing records from primary storage. [2025-10-02T22:34:44.632337] [INFO ] [MAIN ] ASG: Loaded 19972 primary data records. [2025-10-02T22:34:44.682358] [DEBUG] [LOCAL ] ASC: Loaded 37698 existing records from primary storage. [2025-10-02T22:34:44.696962] [INFO ] [MAIN ] ASC: Loaded 37698 primary data records. [2025-10-02T22:34:44.782808] [DEBUG] [LOCAL ] ASBA: Derivative data saved (1806 records). [2025-10-02T22:34:44.820819] [INFO ] [MAIN ] ASBA: Successfully saved derivative data. [2025-10-02T22:34:44.864903] [INFO ] [MAIN ] Derivative Progress: 130/1975 symbols completed. ASBA took 0.7s. Estimated remaining: 13m 8s. Rate: 140.5 symbols/min [2025-10-02T22:34:44.916092] [INFO ] [MAIN ] ASGI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:45.327512] [DEBUG] [LOCAL ] ASGI: Loaded 22922 existing records from primary storage. [2025-10-02T22:34:45.328491] [INFO ] [MAIN ] ASGI: Loaded 22922 primary data records. [2025-10-02T22:34:45.719065] [DEBUG] [MAIN ] ASG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:45.732171] [INFO ] [MAIN ] ASG: Generated 1807 derivative records from 19972 primary records. [2025-10-02T22:34:45.732416] [DEBUG] [LOCAL ] ASG: Saving derivative data. [2025-10-02T22:34:45.747557] [DEBUG] [MAIN ] ASC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:45.762253] [INFO ] [MAIN ] ASC: Generated 1807 derivative records from 37698 primary records. [2025-10-02T22:34:45.763224] [DEBUG] [LOCAL ] ASC: Saving derivative data. [2025-10-02T22:34:45.789147] [DEBUG] [LOCAL ] ASG: Derivative data saved (1807 records). [2025-10-02T22:34:45.789965] [INFO ] [MAIN ] ASG: Successfully saved derivative data. [2025-10-02T22:34:45.792246] [INFO ] [MAIN ] Derivative Progress: 131/1975 symbols completed. ASG took 1.2s. Estimated remaining: 13m 14s. Rate: 139.3 symbols/min [2025-10-02T22:34:45.793204] [DEBUG] [LOCAL ] ASC: Derivative data saved (1807 records). [2025-10-02T22:34:45.793810] [INFO ] [MAIN ] ASH: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:45.793668] [INFO ] [MAIN ] ASC: Successfully saved derivative data. [2025-10-02T22:34:45.797359] [INFO ] [MAIN ] Derivative Progress: 132/1975 symbols completed. ASC took 1.2s. Estimated remaining: 13m 8s. Rate: 140.3 symbols/min [2025-10-02T22:34:45.797684] [INFO ] [MAIN ] ASIX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:45.816809] [DEBUG] [MAIN ] ASGI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:45.817740] [INFO ] [MAIN ] ASGI: Generated 1807 derivative records from 22922 primary records. [2025-10-02T22:34:45.817926] [DEBUG] [LOCAL ] ASGI: Saving derivative data. [2025-10-02T22:34:45.851418] [DEBUG] [LOCAL ] ASIX: Loaded 22820 existing records from primary storage. [2025-10-02T22:34:45.863977] [INFO ] [MAIN ] ASIX: Loaded 22820 primary data records. [2025-10-02T22:34:45.863858] [DEBUG] [LOCAL ] ASGI: Derivative data saved (1807 records). [2025-10-02T22:34:45.864187] [INFO ] [MAIN ] ASGI: Successfully saved derivative data. [2025-10-02T22:34:45.866507] [INFO ] [MAIN ] Derivative Progress: 133/1975 symbols completed. ASGI took 1.0s. Estimated remaining: 13m 3s. Rate: 141.2 symbols/min [2025-10-02T22:34:45.983270] [DEBUG] [LOCAL ] ASH: Loaded 38041 existing records from primary storage. [2025-10-02T22:34:45.989360] [INFO ] [MAIN ] ASH: Loaded 38041 primary data records. [2025-10-02T22:34:46.557974] [DEBUG] [MAIN ] ASIX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:46.561996] [INFO ] [MAIN ] ASIX: Generated 1807 derivative records from 22820 primary records. [2025-10-02T22:34:46.562345] [DEBUG] [LOCAL ] ASIX: Saving derivative data. [2025-10-02T22:34:46.577300] [DEBUG] [MAIN ] ASH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:46.585547] [INFO ] [MAIN ] ASH: Generated 1807 derivative records from 38041 primary records. [2025-10-02T22:34:46.589864] [DEBUG] [LOCAL ] ASH: Saving derivative data. [2025-10-02T22:34:46.595556] [DEBUG] [LOCAL ] ASIX: Derivative data saved (1807 records). [2025-10-02T22:34:46.603197] [INFO ] [MAIN ] ASIX: Successfully saved derivative data. [2025-10-02T22:34:46.609937] [INFO ] [MAIN ] Derivative Progress: 134/1975 symbols completed. ASIX took 0.8s. Estimated remaining: 13m 7s. Rate: 140.4 symbols/min [2025-10-02T22:34:46.615724] [DEBUG] [LOCAL ] ASH: Derivative data saved (1807 records). [2025-10-02T22:34:46.615792] [INFO ] [MAIN ] ASH: Successfully saved derivative data. [2025-10-02T22:34:46.617893] [INFO ] [MAIN ] Derivative Progress: 135/1975 symbols completed. ASH took 0.8s. Estimated remaining: 13m 0s. Rate: 141.5 symbols/min [2025-10-02T22:34:46.618288] [INFO ] [MAIN ] ASPN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:46.618462] [INFO ] [MAIN ] ASR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:46.618607] [INFO ] [MAIN ] ATEN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:46.634532] [DEBUG] [LOCAL ] ASR: Loaded 9377 existing records from primary storage. [2025-10-02T22:34:46.634769] [INFO ] [MAIN ] ASR: Loaded 9377 primary data records. [2025-10-02T22:34:46.843713] [DEBUG] [LOCAL ] ATEN: Loaded 39637 existing records from primary storage. [2025-10-02T22:34:46.999753] [INFO ] [MAIN ] ATEN: Loaded 39637 primary data records. [2025-10-02T22:34:47.113612] [DEBUG] [LOCAL ] ASPN: Loaded 49942 existing records from primary storage. [2025-10-02T22:34:47.135734] [INFO ] [MAIN ] ASPN: Loaded 49942 primary data records. [2025-10-02T22:34:47.757406] [DEBUG] [MAIN ] ASR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:47.760168] [INFO ] [MAIN ] ASR: Generated 1807 derivative records from 9377 primary records. [2025-10-02T22:34:47.761310] [DEBUG] [LOCAL ] ASR: Saving derivative data. [2025-10-02T22:34:47.789695] [DEBUG] [LOCAL ] ASR: Derivative data saved (1807 records). [2025-10-02T22:34:47.791028] [INFO ] [MAIN ] ASR: Successfully saved derivative data. [2025-10-02T22:34:47.796209] [INFO ] [MAIN ] Derivative Progress: 136/1975 symbols completed. ASR took 1.2s. Estimated remaining: 13m 10s. Rate: 139.6 symbols/min [2025-10-02T22:34:47.797304] [INFO ] [MAIN ] ATGE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:47.812180] [DEBUG] [MAIN ] ATEN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:47.813296] [INFO ] [MAIN ] ATEN: Generated 1807 derivative records from 39637 primary records. [2025-10-02T22:34:47.813565] [DEBUG] [LOCAL ] ATEN: Saving derivative data. [2025-10-02T22:34:47.831533] [DEBUG] [LOCAL ] ATEN: Derivative data saved (1807 records). [2025-10-02T22:34:47.831825] [INFO ] [MAIN ] ATEN: Successfully saved derivative data. [2025-10-02T22:34:47.835685] [INFO ] [MAIN ] Derivative Progress: 137/1975 symbols completed. ATEN took 1.2s. Estimated remaining: 13m 5s. Rate: 140.6 symbols/min [2025-10-02T22:34:47.835989] [INFO ] [MAIN ] ATHM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:47.852818] [DEBUG] [MAIN ] ASPN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:47.864882] [INFO ] [MAIN ] ASPN: Generated 1807 derivative records from 49942 primary records. [2025-10-02T22:34:47.865083] [DEBUG] [LOCAL ] ASPN: Saving derivative data. [2025-10-02T22:34:47.884323] [DEBUG] [LOCAL ] ASPN: Derivative data saved (1807 records). [2025-10-02T22:34:47.884629] [INFO ] [MAIN ] ASPN: Successfully saved derivative data. [2025-10-02T22:34:47.904801] [INFO ] [MAIN ] Derivative Progress: 138/1975 symbols completed. ASPN took 1.3s. Estimated remaining: 12m 59s. Rate: 141.4 symbols/min [2025-10-02T22:34:47.905135] [INFO ] [MAIN ] ATHS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:47.906793] [DEBUG] [LOCAL ] ATGE: Loaded 31630 existing records from primary storage. [2025-10-02T22:34:47.907139] [INFO ] [MAIN ] ATGE: Loaded 31630 primary data records. [2025-10-02T22:34:48.022158] [DEBUG] [LOCAL ] ATHM: Loaded 32341 existing records from primary storage. [2025-10-02T22:34:48.034066] [INFO ] [MAIN ] ATHM: Loaded 32341 primary data records. [2025-10-02T22:34:48.061285] [DEBUG] [LOCAL ] ATHS: Loaded 6987 existing records from primary storage. [2025-10-02T22:34:48.115846] [INFO ] [MAIN ] ATHS: Loaded 6987 primary data records. [2025-10-02T22:34:49.024971] [DEBUG] [MAIN ] ATGE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:49.026463] [INFO ] [MAIN ] ATGE: Generated 1807 derivative records from 31630 primary records. [2025-10-02T22:34:49.026787] [DEBUG] [LOCAL ] ATGE: Saving derivative data. [2025-10-02T22:34:49.079587] [DEBUG] [MAIN ] ATHS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:49.080328] [DEBUG] [MAIN ] ATHM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:49.083071] [DEBUG] [LOCAL ] ATGE: Derivative data saved (1807 records). [2025-10-02T22:34:49.082017] [INFO ] [MAIN ] ATHM: Generated 1807 derivative records from 32341 primary records. [2025-10-02T22:34:49.084427] [INFO ] [MAIN ] ATHS: Generated 1807 derivative records from 6987 primary records. [2025-10-02T22:34:49.083271] [INFO ] [MAIN ] ATGE: Successfully saved derivative data. [2025-10-02T22:34:49.084632] [DEBUG] [LOCAL ] ATHS: Saving derivative data. [2025-10-02T22:34:49.084557] [DEBUG] [LOCAL ] ATHM: Saving derivative data. [2025-10-02T22:34:49.087419] [INFO ] [MAIN ] Derivative Progress: 139/1975 symbols completed. ATGE took 1.3s. Estimated remaining: 13m 9s. Rate: 139.6 symbols/min [2025-10-02T22:34:49.088605] [INFO ] [MAIN ] ATI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:49.123616] [DEBUG] [LOCAL ] ATHS: Derivative data saved (1807 records). [2025-10-02T22:34:49.124086] [INFO ] [MAIN ] ATHS: Successfully saved derivative data. [2025-10-02T22:34:49.124683] [DEBUG] [LOCAL ] ATHM: Derivative data saved (1807 records). [2025-10-02T22:34:49.126831] [INFO ] [MAIN ] Derivative Progress: 140/1975 symbols completed. ATHS took 1.2s. Estimated remaining: 13m 3s. Rate: 140.5 symbols/min [2025-10-02T22:34:49.126985] [INFO ] [MAIN ] ATHM: Successfully saved derivative data. [2025-10-02T22:34:49.129787] [INFO ] [MAIN ] Derivative Progress: 141/1975 symbols completed. ATHM took 1.3s. Estimated remaining: 12m 57s. Rate: 141.5 symbols/min [2025-10-02T22:34:49.127196] [INFO ] [MAIN ] ATKR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:49.130215] [INFO ] [MAIN ] ATMU: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:49.192186] [DEBUG] [LOCAL ] ATI: Loaded 51863 existing records from primary storage. [2025-10-02T22:34:49.192513] [INFO ] [MAIN ] ATI: Loaded 51863 primary data records. [2025-10-02T22:34:49.276516] [DEBUG] [LOCAL ] ATMU: Loaded 39581 existing records from primary storage. [2025-10-02T22:34:49.299212] [INFO ] [MAIN ] ATMU: Loaded 39581 primary data records. [2025-10-02T22:34:49.324303] [DEBUG] [LOCAL ] ATKR: Loaded 35963 existing records from primary storage. [2025-10-02T22:34:49.335415] [INFO ] [MAIN ] ATKR: Loaded 35963 primary data records. [2025-10-02T22:34:50.318170] [DEBUG] [MAIN ] ATI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:50.319346] [INFO ] [MAIN ] ATI: Generated 1807 derivative records from 51863 primary records. [2025-10-02T22:34:50.320078] [DEBUG] [LOCAL ] ATI: Saving derivative data. [2025-10-02T22:34:50.362019] [DEBUG] [MAIN ] ATMU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:50.378876] [DEBUG] [LOCAL ] ATI: Derivative data saved (1807 records). [2025-10-02T22:34:50.377926] [INFO ] [MAIN ] ATMU: Generated 1807 derivative records from 39581 primary records. [2025-10-02T22:34:50.376028] [DEBUG] [MAIN ] ATKR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:50.379022] [INFO ] [MAIN ] ATI: Successfully saved derivative data. [2025-10-02T22:34:50.383204] [INFO ] [MAIN ] ATKR: Generated 1807 derivative records from 35963 primary records. [2025-10-02T22:34:50.383510] [DEBUG] [LOCAL ] ATMU: Saving derivative data. [2025-10-02T22:34:50.382225] [INFO ] [MAIN ] Derivative Progress: 142/1975 symbols completed. ATI took 1.3s. Estimated remaining: 13m 8s. Rate: 139.6 symbols/min [2025-10-02T22:34:50.383360] [DEBUG] [LOCAL ] ATKR: Saving derivative data. [2025-10-02T22:34:50.384728] [INFO ] [MAIN ] ATO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:50.421155] [DEBUG] [LOCAL ] ATKR: Derivative data saved (1807 records). [2025-10-02T22:34:50.422130] [INFO ] [MAIN ] ATKR: Successfully saved derivative data. [2025-10-02T22:34:50.422493] [DEBUG] [LOCAL ] ATMU: Derivative data saved (1807 records). [2025-10-02T22:34:50.425301] [INFO ] [MAIN ] Derivative Progress: 143/1975 symbols completed. ATKR took 1.3s. Estimated remaining: 13m 2s. Rate: 140.5 symbols/min [2025-10-02T22:34:50.425696] [INFO ] [MAIN ] ATMU: Successfully saved derivative data. [2025-10-02T22:34:50.425594] [INFO ] [MAIN ] ATR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:50.428558] [INFO ] [MAIN ] Derivative Progress: 144/1975 symbols completed. ATMU took 1.3s. Estimated remaining: 12m 57s. Rate: 141.5 symbols/min [2025-10-02T22:34:50.428966] [INFO ] [MAIN ] ATS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:50.449668] [DEBUG] [LOCAL ] ATS: Loaded 17921 existing records from primary storage. [2025-10-02T22:34:50.451056] [INFO ] [MAIN ] ATS: Loaded 17921 primary data records. [2025-10-02T22:34:50.607173] [DEBUG] [LOCAL ] ATR: Loaded 30648 existing records from primary storage. [2025-10-02T22:34:50.617805] [INFO ] [MAIN ] ATR: Loaded 30648 primary data records. [2025-10-02T22:34:50.629235] [DEBUG] [LOCAL ] ATO: Loaded 42177 existing records from primary storage. [2025-10-02T22:34:50.695000] [INFO ] [MAIN ] ATO: Loaded 42177 primary data records. [2025-10-02T22:34:51.494141] [DEBUG] [MAIN ] ATS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:51.495166] [INFO ] [MAIN ] ATS: Generated 1807 derivative records from 17921 primary records. [2025-10-02T22:34:51.495368] [DEBUG] [LOCAL ] ATS: Saving derivative data. [2025-10-02T22:34:51.527087] [DEBUG] [MAIN ] ATR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:51.530142] [INFO ] [MAIN ] ATR: Generated 1807 derivative records from 30648 primary records. [2025-10-02T22:34:51.530291] [DEBUG] [LOCAL ] ATR: Saving derivative data. [2025-10-02T22:34:51.532631] [DEBUG] [LOCAL ] ATS: Derivative data saved (1807 records). [2025-10-02T22:34:51.532817] [INFO ] [MAIN ] ATS: Successfully saved derivative data. [2025-10-02T22:34:51.534955] [INFO ] [MAIN ] Derivative Progress: 145/1975 symbols completed. ATS took 1.1s. Estimated remaining: 13m 5s. Rate: 139.9 symbols/min [2025-10-02T22:34:51.549220] [INFO ] [MAIN ] ATUS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:51.567089] [DEBUG] [MAIN ] ATO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:51.568678] [INFO ] [MAIN ] ATO: Generated 1807 derivative records from 42177 primary records. [2025-10-02T22:34:51.569696] [DEBUG] [LOCAL ] ATO: Saving derivative data. [2025-10-02T22:34:51.585311] [DEBUG] [LOCAL ] ATR: Derivative data saved (1807 records). [2025-10-02T22:34:51.586815] [INFO ] [MAIN ] ATR: Successfully saved derivative data. [2025-10-02T22:34:51.589149] [INFO ] [MAIN ] Derivative Progress: 146/1975 symbols completed. ATR took 1.2s. Estimated remaining: 12m 60s. Rate: 140.8 symbols/min [2025-10-02T22:34:51.590168] [INFO ] [MAIN ] AU: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:51.594427] [DEBUG] [LOCAL ] ATO: Derivative data saved (1807 records). [2025-10-02T22:34:51.594561] [INFO ] [MAIN ] ATO: Successfully saved derivative data. [2025-10-02T22:34:51.596672] [INFO ] [MAIN ] Derivative Progress: 147/1975 symbols completed. ATO took 1.2s. Estimated remaining: 12m 54s. Rate: 141.7 symbols/min [2025-10-02T22:34:51.597041] [INFO ] [MAIN ] AUB: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:51.632152] [DEBUG] [LOCAL ] ATUS: Loaded 49646 existing records from primary storage. [2025-10-02T22:34:51.632386] [INFO ] [MAIN ] ATUS: Loaded 49646 primary data records. [2025-10-02T22:34:51.924567] [DEBUG] [LOCAL ] AUB: Loaded 46648 existing records from primary storage. [2025-10-02T22:34:51.923409] [DEBUG] [LOCAL ] AU: Loaded 53383 existing records from primary storage. [2025-10-02T22:34:51.946599] [INFO ] [MAIN ] AU: Loaded 53383 primary data records. [2025-10-02T22:34:51.946507] [INFO ] [MAIN ] AUB: Loaded 46648 primary data records. [2025-10-02T22:34:52.742056] [DEBUG] [MAIN ] ATUS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:52.743757] [INFO ] [MAIN ] ATUS: Generated 1807 derivative records from 49646 primary records. [2025-10-02T22:34:52.743848] [DEBUG] [LOCAL ] ATUS: Saving derivative data. [2025-10-02T22:34:52.792187] [DEBUG] [MAIN ] AU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:52.793395] [DEBUG] [MAIN ] AUB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:52.794786] [INFO ] [MAIN ] AU: Generated 1807 derivative records from 53383 primary records. [2025-10-02T22:34:52.795421] [INFO ] [MAIN ] AUB: Generated 1807 derivative records from 46648 primary records. [2025-10-02T22:34:52.795755] [DEBUG] [LOCAL ] AUB: Saving derivative data. [2025-10-02T22:34:52.795607] [DEBUG] [LOCAL ] ATUS: Derivative data saved (1807 records). [2025-10-02T22:34:52.795977] [INFO ] [MAIN ] ATUS: Successfully saved derivative data. [2025-10-02T22:34:52.795527] [DEBUG] [LOCAL ] AU: Saving derivative data. [2025-10-02T22:34:52.798253] [INFO ] [MAIN ] Derivative Progress: 148/1975 symbols completed. ATUS took 1.2s. Estimated remaining: 13m 3s. Rate: 140.0 symbols/min [2025-10-02T22:34:52.830757] [DEBUG] [LOCAL ] AUB: Derivative data saved (1807 records). [2025-10-02T22:34:52.831441] [DEBUG] [LOCAL ] AU: Derivative data saved (1807 records). [2025-10-02T22:34:52.831096] [INFO ] [MAIN ] AUB: Successfully saved derivative data. [2025-10-02T22:34:52.831586] [INFO ] [MAIN ] AU: Successfully saved derivative data. [2025-10-02T22:34:52.834691] [INFO ] [MAIN ] Derivative Progress: 149/1975 symbols completed. AUB took 1.2s. Estimated remaining: 12m 58s. Rate: 140.8 symbols/min [2025-10-02T22:34:52.837181] [INFO ] [MAIN ] Derivative Progress: 150/1975 symbols completed. AU took 1.2s. Estimated remaining: 12m 52s. Rate: 141.8 symbols/min [2025-10-02T22:34:52.837722] [INFO ] [MAIN ] AVAL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:52.837668] [INFO ] [MAIN ] AUNA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:52.837990] [INFO ] [MAIN ] AVA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:52.846738] [DEBUG] [LOCAL ] AUNA: Loaded 4958 existing records from primary storage. [2025-10-02T22:34:52.847027] [INFO ] [MAIN ] AUNA: Loaded 4958 primary data records. [2025-10-02T22:34:52.946086] [DEBUG] [LOCAL ] AVAL: Loaded 8795 existing records from primary storage. [2025-10-02T22:34:52.973516] [INFO ] [MAIN ] AVAL: Loaded 8795 primary data records. [2025-10-02T22:34:53.324146] [DEBUG] [LOCAL ] AVA: Loaded 39686 existing records from primary storage. [2025-10-02T22:34:53.325056] [INFO ] [MAIN ] AVA: Loaded 39686 primary data records. [2025-10-02T22:34:53.920905] [DEBUG] [MAIN ] AUNA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:53.922896] [INFO ] [MAIN ] AUNA: Generated 1807 derivative records from 4958 primary records. [2025-10-02T22:34:53.923956] [DEBUG] [LOCAL ] AUNA: Saving derivative data. [2025-10-02T22:34:53.954826] [DEBUG] [LOCAL ] AUNA: Derivative data saved (1807 records). [2025-10-02T22:34:53.975316] [INFO ] [MAIN ] AUNA: Successfully saved derivative data. [2025-10-02T22:34:53.981683] [INFO ] [MAIN ] Derivative Progress: 151/1975 symbols completed. AUNA took 1.1s. Estimated remaining: 13m 1s. Rate: 140.2 symbols/min [2025-10-02T22:34:53.982572] [INFO ] [MAIN ] AVB: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:53.983464] [DEBUG] [MAIN ] AVAL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:53.985826] [INFO ] [MAIN ] AVAL: Generated 1807 derivative records from 8795 primary records. [2025-10-02T22:34:53.986044] [DEBUG] [LOCAL ] AVAL: Saving derivative data. [2025-10-02T22:34:54.021893] [DEBUG] [MAIN ] AVA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:54.023962] [INFO ] [MAIN ] AVA: Generated 1807 derivative records from 39686 primary records. [2025-10-02T22:34:54.025182] [DEBUG] [LOCAL ] AVA: Saving derivative data. [2025-10-02T22:34:54.037709] [DEBUG] [LOCAL ] AVAL: Derivative data saved (1807 records). [2025-10-02T22:34:54.041953] [INFO ] [MAIN ] AVAL: Successfully saved derivative data. [2025-10-02T22:34:54.045032] [INFO ] [MAIN ] Derivative Progress: 152/1975 symbols completed. AVAL took 1.2s. Estimated remaining: 12m 56s. Rate: 141.0 symbols/min [2025-10-02T22:34:54.045605] [INFO ] [MAIN ] AVD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:54.051323] [DEBUG] [LOCAL ] AVA: Derivative data saved (1807 records). [2025-10-02T22:34:54.051567] [INFO ] [MAIN ] AVA: Successfully saved derivative data. [2025-10-02T22:34:54.054042] [INFO ] [MAIN ] Derivative Progress: 153/1975 symbols completed. AVA took 1.2s. Estimated remaining: 12m 50s. Rate: 141.9 symbols/min [2025-10-02T22:34:54.054376] [INFO ] [MAIN ] AVK: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:54.100591] [DEBUG] [LOCAL ] AVD: Loaded 22716 existing records from primary storage. [2025-10-02T22:34:54.100862] [INFO ] [MAIN ] AVD: Loaded 22716 primary data records. [2025-10-02T22:34:54.115466] [DEBUG] [LOCAL ] AVB: Loaded 42269 existing records from primary storage. [2025-10-02T22:34:54.132811] [INFO ] [MAIN ] AVB: Loaded 42269 primary data records. [2025-10-02T22:34:54.149698] [DEBUG] [LOCAL ] AVK: Loaded 18153 existing records from primary storage. [2025-10-02T22:34:54.160373] [INFO ] [MAIN ] AVK: Loaded 18153 primary data records. [2025-10-02T22:34:55.267782] [DEBUG] [MAIN ] AVD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:55.282313] [INFO ] [MAIN ] AVD: Generated 1807 derivative records from 22716 primary records. [2025-10-02T22:34:55.282778] [DEBUG] [MAIN ] AVB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:55.296806] [DEBUG] [LOCAL ] AVD: Saving derivative data. [2025-10-02T22:34:55.296498] [INFO ] [MAIN ] AVB: Generated 1807 derivative records from 42269 primary records. [2025-10-02T22:34:55.297545] [DEBUG] [LOCAL ] AVB: Saving derivative data. [2025-10-02T22:34:55.297465] [DEBUG] [MAIN ] AVK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:55.298868] [INFO ] [MAIN ] AVK: Generated 1807 derivative records from 18153 primary records. [2025-10-02T22:34:55.299989] [DEBUG] [LOCAL ] AVK: Saving derivative data. [2025-10-02T22:34:55.350227] [DEBUG] [LOCAL ] AVB: Derivative data saved (1807 records). [2025-10-02T22:34:55.350927] [DEBUG] [LOCAL ] AVK: Derivative data saved (1807 records). [2025-10-02T22:34:55.351137] [INFO ] [MAIN ] AVK: Successfully saved derivative data. [2025-10-02T22:34:55.353753] [INFO ] [MAIN ] Derivative Progress: 154/1975 symbols completed. AVK took 1.3s. Estimated remaining: 13m 0s. Rate: 140.0 symbols/min [2025-10-02T22:34:55.353953] [DEBUG] [LOCAL ] AVD: Derivative data saved (1807 records). [2025-10-02T22:34:55.354111] [INFO ] [MAIN ] AVD: Successfully saved derivative data. [2025-10-02T22:34:55.354216] [INFO ] [MAIN ] AVNS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:55.358961] [INFO ] [MAIN ] Derivative Progress: 155/1975 symbols completed. AVD took 1.3s. Estimated remaining: 12m 55s. Rate: 140.9 symbols/min [2025-10-02T22:34:55.351022] [INFO ] [MAIN ] AVB: Successfully saved derivative data. [2025-10-02T22:34:55.362053] [INFO ] [MAIN ] Derivative Progress: 156/1975 symbols completed. AVB took 1.4s. Estimated remaining: 12m 50s. Rate: 141.8 symbols/min [2025-10-02T22:34:55.359442] [INFO ] [MAIN ] AVNT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:55.362458] [INFO ] [MAIN ] AVTR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:55.422355] [DEBUG] [LOCAL ] AVNS: Loaded 33967 existing records from primary storage. [2025-10-02T22:34:55.431059] [INFO ] [MAIN ] AVNS: Loaded 33967 primary data records. [2025-10-02T22:34:55.575446] [DEBUG] [LOCAL ] AVNT: Loaded 39453 existing records from primary storage. [2025-10-02T22:34:55.588590] [INFO ] [MAIN ] AVNT: Loaded 39453 primary data records. [2025-10-02T22:34:55.693713] [DEBUG] [LOCAL ] AVTR: Loaded 53952 existing records from primary storage. [2025-10-02T22:34:55.734409] [INFO ] [MAIN ] AVTR: Loaded 53952 primary data records. [2025-10-02T22:34:56.506229] [DEBUG] [MAIN ] AVNS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:56.507503] [INFO ] [MAIN ] AVNS: Generated 1807 derivative records from 33967 primary records. [2025-10-02T22:34:56.508384] [DEBUG] [LOCAL ] AVNS: Saving derivative data. [2025-10-02T22:34:56.532148] [DEBUG] [LOCAL ] AVNS: Derivative data saved (1807 records). [2025-10-02T22:34:56.533855] [INFO ] [MAIN ] AVNS: Successfully saved derivative data. [2025-10-02T22:34:56.536399] [INFO ] [MAIN ] Derivative Progress: 157/1975 symbols completed. AVNS took 1.2s. Estimated remaining: 12m 58s. Rate: 140.2 symbols/min [2025-10-02T22:34:56.538335] [INFO ] [MAIN ] AVY: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:56.557973] [DEBUG] [MAIN ] AVNT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:56.559362] [INFO ] [MAIN ] AVNT: Generated 1807 derivative records from 39453 primary records. [2025-10-02T22:34:56.559696] [DEBUG] [LOCAL ] AVNT: Saving derivative data. [2025-10-02T22:34:56.584618] [DEBUG] [LOCAL ] AVNT: Derivative data saved (1807 records). [2025-10-02T22:34:56.585175] [INFO ] [MAIN ] AVNT: Successfully saved derivative data. [2025-10-02T22:34:56.588308] [INFO ] [MAIN ] Derivative Progress: 158/1975 symbols completed. AVNT took 1.2s. Estimated remaining: 12m 53s. Rate: 141.0 symbols/min [2025-10-02T22:34:56.601527] [INFO ] [MAIN ] AWF: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:56.602768] [DEBUG] [MAIN ] AVTR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:56.603452] [INFO ] [MAIN ] AVTR: Generated 1807 derivative records from 53952 primary records. [2025-10-02T22:34:56.603515] [DEBUG] [LOCAL ] AVTR: Saving derivative data. [2025-10-02T22:34:56.633769] [DEBUG] [LOCAL ] AVTR: Derivative data saved (1807 records). [2025-10-02T22:34:56.633930] [INFO ] [MAIN ] AVTR: Successfully saved derivative data. [2025-10-02T22:34:56.636258] [INFO ] [MAIN ] Derivative Progress: 159/1975 symbols completed. AVTR took 1.3s. Estimated remaining: 12m 48s. Rate: 141.8 symbols/min [2025-10-02T22:34:56.642374] [INFO ] [MAIN ] AWK: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:56.657083] [DEBUG] [LOCAL ] AVY: Loaded 37777 existing records from primary storage. [2025-10-02T22:34:56.667555] [INFO ] [MAIN ] AVY: Loaded 37777 primary data records. [2025-10-02T22:34:56.668371] [DEBUG] [LOCAL ] AWF: Loaded 24560 existing records from primary storage. [2025-10-02T22:34:56.703711] [INFO ] [MAIN ] AWF: Loaded 24560 primary data records. [2025-10-02T22:34:57.300920] [DEBUG] [LOCAL ] AWK: Loaded 49037 existing records from primary storage. [2025-10-02T22:34:57.301264] [INFO ] [MAIN ] AWK: Loaded 49037 primary data records. [2025-10-02T22:34:57.792736] [DEBUG] [MAIN ] AVY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:57.793709] [INFO ] [MAIN ] AVY: Generated 1807 derivative records from 37777 primary records. [2025-10-02T22:34:57.793994] [DEBUG] [LOCAL ] AVY: Saving derivative data. [2025-10-02T22:34:57.815232] [DEBUG] [LOCAL ] AVY: Derivative data saved (1807 records). [2025-10-02T22:34:57.815389] [INFO ] [MAIN ] AVY: Successfully saved derivative data. [2025-10-02T22:34:57.818866] [INFO ] [MAIN ] Derivative Progress: 160/1975 symbols completed. AVY took 1.3s. Estimated remaining: 12m 57s. Rate: 140.2 symbols/min [2025-10-02T22:34:57.820187] [INFO ] [MAIN ] AWP: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:57.838171] [DEBUG] [MAIN ] AWF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:57.839262] [INFO ] [MAIN ] AWF: Generated 1807 derivative records from 24560 primary records. [2025-10-02T22:34:57.839438] [DEBUG] [LOCAL ] AWF: Saving derivative data. [2025-10-02T22:34:57.862562] [DEBUG] [LOCAL ] AWF: Derivative data saved (1807 records). [2025-10-02T22:34:57.864987] [INFO ] [MAIN ] AWF: Successfully saved derivative data. [2025-10-02T22:34:57.867352] [INFO ] [MAIN ] Derivative Progress: 161/1975 symbols completed. AWF took 1.3s. Estimated remaining: 12m 52s. Rate: 141.0 symbols/min [2025-10-02T22:34:57.868771] [INFO ] [MAIN ] AWR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:57.895314] [DEBUG] [LOCAL ] AWP: Loaded 21611 existing records from primary storage. [2025-10-02T22:34:57.896070] [DEBUG] [MAIN ] AWK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:57.897098] [INFO ] [MAIN ] AWK: Generated 1807 derivative records from 49037 primary records. [2025-10-02T22:34:57.896137] [INFO ] [MAIN ] AWP: Loaded 21611 primary data records. [2025-10-02T22:34:57.897249] [DEBUG] [LOCAL ] AWK: Saving derivative data. [2025-10-02T22:34:58.044500] [DEBUG] [LOCAL ] AWR: Loaded 22776 existing records from primary storage. [2025-10-02T22:34:58.050617] [INFO ] [MAIN ] AWR: Loaded 22776 primary data records. [2025-10-02T22:34:58.140294] [DEBUG] [LOCAL ] AWK: Derivative data saved (1807 records). [2025-10-02T22:34:58.148786] [INFO ] [MAIN ] AWK: Successfully saved derivative data. [2025-10-02T22:34:58.157390] [INFO ] [MAIN ] Derivative Progress: 162/1975 symbols completed. AWK took 1.5s. Estimated remaining: 12m 50s. Rate: 141.3 symbols/min [2025-10-02T22:34:58.211889] [INFO ] [MAIN ] AX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:58.627866] [DEBUG] [LOCAL ] AX: Loaded 28542 existing records from primary storage. [2025-10-02T22:34:58.628513] [INFO ] [MAIN ] AX: Loaded 28542 primary data records. [2025-10-02T22:34:58.783071] [DEBUG] [MAIN ] AWP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:58.794459] [INFO ] [MAIN ] AWP: Generated 1807 derivative records from 21611 primary records. [2025-10-02T22:34:58.815038] [DEBUG] [LOCAL ] AWP: Saving derivative data. [2025-10-02T22:34:59.089992] [DEBUG] [LOCAL ] AWP: Derivative data saved (1807 records). [2025-10-02T22:34:59.093888] [INFO ] [MAIN ] AWP: Successfully saved derivative data. [2025-10-02T22:34:59.096300] [INFO ] [MAIN ] Derivative Progress: 163/1975 symbols completed. AWP took 1.3s. Estimated remaining: 12m 55s. Rate: 140.2 symbols/min [2025-10-02T22:34:59.113560] [DEBUG] [MAIN ] AWR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:59.114853] [INFO ] [MAIN ] AWR: Generated 1807 derivative records from 22776 primary records. [2025-10-02T22:34:59.114942] [DEBUG] [LOCAL ] AWR: Saving derivative data. [2025-10-02T22:34:59.135244] [DEBUG] [LOCAL ] AWR: Derivative data saved (1807 records). [2025-10-02T22:34:59.135340] [INFO ] [MAIN ] AWR: Successfully saved derivative data. [2025-10-02T22:34:59.137805] [INFO ] [MAIN ] Derivative Progress: 164/1975 symbols completed. AWR took 1.3s. Estimated remaining: 12m 51s. Rate: 141.0 symbols/min [2025-10-02T22:34:59.154588] [DEBUG] [MAIN ] AX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:34:59.155306] [INFO ] [MAIN ] AX: Generated 1807 derivative records from 28542 primary records. [2025-10-02T22:34:59.155371] [DEBUG] [LOCAL ] AX: Saving derivative data. [2025-10-02T22:34:59.171817] [DEBUG] [LOCAL ] AX: Derivative data saved (1807 records). [2025-10-02T22:34:59.171933] [INFO ] [MAIN ] AX: Successfully saved derivative data. [2025-10-02T22:34:59.174328] [INFO ] [MAIN ] Derivative Progress: 165/1975 symbols completed. AX took 1.0s. Estimated remaining: 12m 46s. Rate: 141.8 symbols/min [2025-10-02T22:34:59.174909] [INFO ] [MAIN ] AXL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:59.175116] [INFO ] [MAIN ] AXS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:59.175031] [INFO ] [MAIN ] AXP: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:34:59.257678] [DEBUG] [LOCAL ] AXS: Loaded 38703 existing records from primary storage. [2025-10-02T22:34:59.258786] [DEBUG] [LOCAL ] AXL: Loaded 50866 existing records from primary storage. [2025-10-02T22:34:59.258029] [INFO ] [MAIN ] AXS: Loaded 38703 primary data records. [2025-10-02T22:34:59.259199] [INFO ] [MAIN ] AXL: Loaded 50866 primary data records. [2025-10-02T22:34:59.448849] [DEBUG] [LOCAL ] AXP: Loaded 53579 existing records from primary storage. [2025-10-02T22:34:59.514786] [INFO ] [MAIN ] AXP: Loaded 53579 primary data records. [2025-10-02T22:35:00.350933] [DEBUG] [MAIN ] AXS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:00.352331] [INFO ] [MAIN ] AXS: Generated 1807 derivative records from 38703 primary records. [2025-10-02T22:35:00.352789] [DEBUG] [LOCAL ] AXS: Saving derivative data. [2025-10-02T22:35:00.395346] [DEBUG] [LOCAL ] AXS: Derivative data saved (1807 records). [2025-10-02T22:35:00.395563] [INFO ] [MAIN ] AXS: Successfully saved derivative data. [2025-10-02T22:35:00.406868] [INFO ] [MAIN ] Derivative Progress: 166/1975 symbols completed. AXS took 1.2s. Estimated remaining: 12m 54s. Rate: 140.2 symbols/min [2025-10-02T22:35:00.404482] [DEBUG] [MAIN ] AXL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:00.414941] [DEBUG] [MAIN ] AXP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:00.413837] [INFO ] [MAIN ] AXL: Generated 1807 derivative records from 50866 primary records. [2025-10-02T22:35:00.415207] [DEBUG] [LOCAL ] AXL: Saving derivative data. [2025-10-02T22:35:00.413974] [INFO ] [MAIN ] AXTA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:00.416027] [INFO ] [MAIN ] AXP: Generated 1807 derivative records from 53579 primary records. [2025-10-02T22:35:00.417447] [DEBUG] [LOCAL ] AXP: Saving derivative data. [2025-10-02T22:35:00.456141] [DEBUG] [LOCAL ] AXP: Derivative data saved (1807 records). [2025-10-02T22:35:00.460087] [INFO ] [MAIN ] AXP: Successfully saved derivative data. [2025-10-02T22:35:00.462741] [INFO ] [MAIN ] Derivative Progress: 167/1975 symbols completed. AXP took 1.3s. Estimated remaining: 12m 50s. Rate: 140.9 symbols/min [2025-10-02T22:35:00.464412] [INFO ] [MAIN ] AYI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:00.465921] [DEBUG] [LOCAL ] AXL: Derivative data saved (1807 records). [2025-10-02T22:35:00.466086] [INFO ] [MAIN ] AXL: Successfully saved derivative data. [2025-10-02T22:35:00.468270] [INFO ] [MAIN ] Derivative Progress: 168/1975 symbols completed. AXL took 1.3s. Estimated remaining: 12m 45s. Rate: 141.8 symbols/min [2025-10-02T22:35:00.468687] [INFO ] [MAIN ] AZO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:00.503426] [DEBUG] [LOCAL ] AZO: Loaded 11370 existing records from primary storage. [2025-10-02T22:35:00.503574] [INFO ] [MAIN ] AZO: Loaded 11370 primary data records. [2025-10-02T22:35:00.575143] [DEBUG] [LOCAL ] AYI: Loaded 25458 existing records from primary storage. [2025-10-02T22:35:00.598244] [INFO ] [MAIN ] AYI: Loaded 25458 primary data records. [2025-10-02T22:35:00.710824] [DEBUG] [LOCAL ] AXTA: Loaded 52453 existing records from primary storage. [2025-10-02T22:35:00.735003] [INFO ] [MAIN ] AXTA: Loaded 52453 primary data records. [2025-10-02T22:35:01.739809] [DEBUG] [MAIN ] AZO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:01.741074] [INFO ] [MAIN ] AZO: Generated 1807 derivative records from 11370 primary records. [2025-10-02T22:35:01.741280] [DEBUG] [LOCAL ] AZO: Saving derivative data. [2025-10-02T22:35:01.778549] [DEBUG] [LOCAL ] AZO: Derivative data saved (1807 records). [2025-10-02T22:35:01.779255] [DEBUG] [MAIN ] AYI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:01.788097] [INFO ] [MAIN ] AZO: Successfully saved derivative data. [2025-10-02T22:35:01.780069] [INFO ] [MAIN ] AYI: Generated 1807 derivative records from 25458 primary records. [2025-10-02T22:35:01.795479] [INFO ] [MAIN ] Derivative Progress: 169/1975 symbols completed. AZO took 1.3s. Estimated remaining: 12m 54s. Rate: 140.0 symbols/min [2025-10-02T22:35:01.796007] [INFO ] [MAIN ] AZZ: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:01.796083] [DEBUG] [LOCAL ] AYI: Saving derivative data. [2025-10-02T22:35:01.796971] [DEBUG] [MAIN ] AXTA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:01.799320] [INFO ] [MAIN ] AXTA: Generated 1807 derivative records from 52453 primary records. [2025-10-02T22:35:01.799541] [DEBUG] [LOCAL ] AXTA: Saving derivative data. [2025-10-02T22:35:01.833564] [DEBUG] [LOCAL ] AYI: Derivative data saved (1807 records). [2025-10-02T22:35:01.841110] [DEBUG] [LOCAL ] AXTA: Derivative data saved (1807 records). [2025-10-02T22:35:01.841406] [INFO ] [MAIN ] AYI: Successfully saved derivative data. [2025-10-02T22:35:01.841699] [INFO ] [MAIN ] AXTA: Successfully saved derivative data. [2025-10-02T22:35:01.844724] [INFO ] [MAIN ] Derivative Progress: 170/1975 symbols completed. AYI took 1.4s. Estimated remaining: 12m 50s. Rate: 140.7 symbols/min [2025-10-02T22:35:01.853992] [INFO ] [MAIN ] Derivative Progress: 171/1975 symbols completed. AXTA took 1.4s. Estimated remaining: 12m 45s. Rate: 141.5 symbols/min [2025-10-02T22:35:01.848098] [INFO ] [MAIN ] BA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:01.854870] [INFO ] [MAIN ] BABA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:01.867183] [DEBUG] [LOCAL ] AZZ: Loaded 22158 existing records from primary storage. [2025-10-02T22:35:01.867410] [INFO ] [MAIN ] AZZ: Loaded 22158 primary data records. [2025-10-02T22:35:02.254744] [DEBUG] [LOCAL ] BABA: Loaded 54210 existing records from primary storage. [2025-10-02T22:35:02.271401] [INFO ] [MAIN ] BABA: Loaded 54210 primary data records. [2025-10-02T22:35:02.285943] [DEBUG] [LOCAL ] BA: Loaded 54180 existing records from primary storage. [2025-10-02T22:35:02.305202] [INFO ] [MAIN ] BA: Loaded 54180 primary data records. [2025-10-02T22:35:03.029573] [DEBUG] [MAIN ] AZZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:03.031893] [INFO ] [MAIN ] AZZ: Generated 1807 derivative records from 22158 primary records. [2025-10-02T22:35:03.032906] [DEBUG] [LOCAL ] AZZ: Saving derivative data. [2025-10-02T22:35:03.053131] [DEBUG] [LOCAL ] AZZ: Derivative data saved (1807 records). [2025-10-02T22:35:03.053294] [INFO ] [MAIN ] AZZ: Successfully saved derivative data. [2025-10-02T22:35:03.056115] [INFO ] [MAIN ] Derivative Progress: 172/1975 symbols completed. AZZ took 1.3s. Estimated remaining: 12m 53s. Rate: 140.0 symbols/min [2025-10-02T22:35:03.056699] [INFO ] [MAIN ] BAC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:03.080362] [DEBUG] [MAIN ] BABA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:03.081688] [INFO ] [MAIN ] BABA: Generated 1807 derivative records from 54210 primary records. [2025-10-02T22:35:03.081795] [DEBUG] [LOCAL ] BABA: Saving derivative data. [2025-10-02T22:35:03.102887] [DEBUG] [LOCAL ] BABA: Derivative data saved (1807 records). [2025-10-02T22:35:03.104330] [INFO ] [MAIN ] BABA: Successfully saved derivative data. [2025-10-02T22:35:03.108271] [INFO ] [MAIN ] Derivative Progress: 173/1975 symbols completed. BABA took 1.3s. Estimated remaining: 12m 48s. Rate: 140.7 symbols/min [2025-10-02T22:35:03.108950] [INFO ] [MAIN ] BAH: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:03.123555] [DEBUG] [MAIN ] BA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:03.140375] [INFO ] [MAIN ] BA: Generated 1807 derivative records from 54180 primary records. [2025-10-02T22:35:03.140764] [DEBUG] [LOCAL ] BA: Saving derivative data. [2025-10-02T22:35:03.159149] [DEBUG] [LOCAL ] BA: Derivative data saved (1807 records). [2025-10-02T22:35:03.159287] [INFO ] [MAIN ] BA: Successfully saved derivative data. [2025-10-02T22:35:03.162875] [INFO ] [MAIN ] Derivative Progress: 174/1975 symbols completed. BA took 1.3s. Estimated remaining: 12m 44s. Rate: 141.5 symbols/min [2025-10-02T22:35:03.179321] [INFO ] [MAIN ] BAK: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:03.181881] [DEBUG] [LOCAL ] BAC: Loaded 54198 existing records from primary storage. [2025-10-02T22:35:03.182706] [INFO ] [MAIN ] BAC: Loaded 54198 primary data records. [2025-10-02T22:35:03.406747] [DEBUG] [LOCAL ] BAH: Loaded 52055 existing records from primary storage. [2025-10-02T22:35:03.437158] [INFO ] [MAIN ] BAH: Loaded 52055 primary data records. [2025-10-02T22:35:03.648227] [DEBUG] [LOCAL ] BAK: Loaded 39471 existing records from primary storage. [2025-10-02T22:35:03.673759] [INFO ] [MAIN ] BAK: Loaded 39471 primary data records. [2025-10-02T22:35:04.357146] [DEBUG] [MAIN ] BAC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:04.358362] [INFO ] [MAIN ] BAC: Generated 1807 derivative records from 54198 primary records. [2025-10-02T22:35:04.358959] [DEBUG] [LOCAL ] BAC: Saving derivative data. [2025-10-02T22:35:04.381121] [DEBUG] [LOCAL ] BAC: Derivative data saved (1807 records). [2025-10-02T22:35:04.381866] [INFO ] [MAIN ] BAC: Successfully saved derivative data. [2025-10-02T22:35:04.384154] [INFO ] [MAIN ] Derivative Progress: 175/1975 symbols completed. BAC took 1.3s. Estimated remaining: 12m 52s. Rate: 140.0 symbols/min [2025-10-02T22:35:04.384539] [INFO ] [MAIN ] BALL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:04.405718] [DEBUG] [MAIN ] BAH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:04.406485] [INFO ] [MAIN ] BAH: Generated 1807 derivative records from 52055 primary records. [2025-10-02T22:35:04.406810] [DEBUG] [LOCAL ] BAH: Saving derivative data. [2025-10-02T22:35:04.428162] [DEBUG] [LOCAL ] BAH: Derivative data saved (1807 records). [2025-10-02T22:35:04.428917] [INFO ] [MAIN ] BAH: Successfully saved derivative data. [2025-10-02T22:35:04.431136] [INFO ] [MAIN ] Derivative Progress: 176/1975 symbols completed. BAH took 1.3s. Estimated remaining: 12m 47s. Rate: 140.7 symbols/min [2025-10-02T22:35:04.431489] [INFO ] [MAIN ] BAM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:04.447471] [DEBUG] [MAIN ] BAK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:04.448520] [INFO ] [MAIN ] BAK: Generated 1807 derivative records from 39471 primary records. [2025-10-02T22:35:04.448701] [DEBUG] [LOCAL ] BAK: Saving derivative data. [2025-10-02T22:35:04.481212] [DEBUG] [LOCAL ] BAK: Derivative data saved (1807 records). [2025-10-02T22:35:04.481359] [INFO ] [MAIN ] BAK: Successfully saved derivative data. [2025-10-02T22:35:04.483713] [INFO ] [MAIN ] Derivative Progress: 177/1975 symbols completed. BAK took 1.3s. Estimated remaining: 12m 43s. Rate: 141.4 symbols/min [2025-10-02T22:35:04.484759] [INFO ] [MAIN ] BANC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:04.501886] [DEBUG] [LOCAL ] BALL: Loaded 52177 existing records from primary storage. [2025-10-02T22:35:04.502158] [INFO ] [MAIN ] BALL: Loaded 52177 primary data records. [2025-10-02T22:35:04.712890] [DEBUG] [LOCAL ] BAM: Loaded 52385 existing records from primary storage. [2025-10-02T22:35:04.752124] [INFO ] [MAIN ] BAM: Loaded 52385 primary data records. [2025-10-02T22:35:04.986482] [DEBUG] [LOCAL ] BANC: Loaded 51623 existing records from primary storage. [2025-10-02T22:35:05.007192] [INFO ] [MAIN ] BANC: Loaded 51623 primary data records. [2025-10-02T22:35:05.578122] [DEBUG] [MAIN ] BALL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:05.578998] [INFO ] [MAIN ] BALL: Generated 1807 derivative records from 52177 primary records. [2025-10-02T22:35:05.579226] [DEBUG] [LOCAL ] BALL: Saving derivative data. [2025-10-02T22:35:05.603588] [DEBUG] [LOCAL ] BALL: Derivative data saved (1807 records). [2025-10-02T22:35:05.603865] [INFO ] [MAIN ] BALL: Successfully saved derivative data. [2025-10-02T22:35:05.606832] [INFO ] [MAIN ] Derivative Progress: 178/1975 symbols completed. BALL took 1.2s. Estimated remaining: 12m 50s. Rate: 140.1 symbols/min [2025-10-02T22:35:05.628158] [DEBUG] [MAIN ] BAM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:05.629429] [INFO ] [MAIN ] BAM: Generated 1807 derivative records from 52385 primary records. [2025-10-02T22:35:05.629529] [DEBUG] [LOCAL ] BAM: Saving derivative data. [2025-10-02T22:35:05.659946] [DEBUG] [MAIN ] BANC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:05.661345] [INFO ] [MAIN ] BANC: Generated 1807 derivative records from 51623 primary records. [2025-10-02T22:35:05.661718] [DEBUG] [LOCAL ] BANC: Saving derivative data. [2025-10-02T22:35:05.677306] [DEBUG] [LOCAL ] BAM: Derivative data saved (1807 records). [2025-10-02T22:35:05.677745] [INFO ] [MAIN ] BAM: Successfully saved derivative data. [2025-10-02T22:35:05.680609] [INFO ] [MAIN ] Derivative Progress: 179/1975 symbols completed. BAM took 1.2s. Estimated remaining: 12m 46s. Rate: 140.7 symbols/min [2025-10-02T22:35:05.684408] [DEBUG] [LOCAL ] BANC: Derivative data saved (1807 records). [2025-10-02T22:35:05.684475] [INFO ] [MAIN ] BANC: Successfully saved derivative data. [2025-10-02T22:35:05.686800] [INFO ] [MAIN ] Derivative Progress: 180/1975 symbols completed. BANC took 1.2s. Estimated remaining: 12m 41s. Rate: 141.5 symbols/min [2025-10-02T22:35:05.687304] [INFO ] [MAIN ] BAP: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:05.687562] [INFO ] [MAIN ] BARK: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:05.687379] [INFO ] [MAIN ] BB: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:05.718691] [DEBUG] [LOCAL ] BAP: Loaded 26325 existing records from primary storage. [2025-10-02T22:35:05.726994] [INFO ] [MAIN ] BAP: Loaded 26325 primary data records. [2025-10-02T22:35:05.875544] [DEBUG] [LOCAL ] BARK: Loaded 38304 existing records from primary storage. [2025-10-02T22:35:05.881553] [INFO ] [MAIN ] BARK: Loaded 38304 primary data records. [2025-10-02T22:35:06.232297] [DEBUG] [LOCAL ] BB: Loaded 53320 existing records from primary storage. [2025-10-02T22:35:06.252860] [INFO ] [MAIN ] BB: Loaded 53320 primary data records. [2025-10-02T22:35:06.837973] [DEBUG] [MAIN ] BAP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:06.840074] [INFO ] [MAIN ] BAP: Generated 1807 derivative records from 26325 primary records. [2025-10-02T22:35:06.840919] [DEBUG] [LOCAL ] BAP: Saving derivative data. [2025-10-02T22:35:06.877562] [DEBUG] [MAIN ] BARK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:06.879422] [INFO ] [MAIN ] BARK: Generated 1807 derivative records from 38304 primary records. [2025-10-02T22:35:06.879695] [DEBUG] [LOCAL ] BARK: Saving derivative data. [2025-10-02T22:35:06.878490] [DEBUG] [LOCAL ] BAP: Derivative data saved (1807 records). [2025-10-02T22:35:06.881738] [INFO ] [MAIN ] BAP: Successfully saved derivative data. [2025-10-02T22:35:06.884106] [INFO ] [MAIN ] Derivative Progress: 181/1975 symbols completed. BAP took 1.2s. Estimated remaining: 12m 48s. Rate: 140.1 symbols/min [2025-10-02T22:35:06.885330] [INFO ] [MAIN ] BBAI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:06.913186] [DEBUG] [MAIN ] BB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:06.914373] [INFO ] [MAIN ] BB: Generated 1807 derivative records from 53320 primary records. [2025-10-02T22:35:06.914978] [DEBUG] [LOCAL ] BB: Saving derivative data. [2025-10-02T22:35:06.919444] [DEBUG] [LOCAL ] BARK: Derivative data saved (1807 records). [2025-10-02T22:35:06.920094] [INFO ] [MAIN ] BARK: Successfully saved derivative data. [2025-10-02T22:35:06.930859] [INFO ] [MAIN ] Derivative Progress: 182/1975 symbols completed. BARK took 1.2s. Estimated remaining: 12m 44s. Rate: 140.8 symbols/min [2025-10-02T22:35:06.933770] [INFO ] [MAIN ] BBAR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:06.940083] [DEBUG] [LOCAL ] BB: Derivative data saved (1807 records). [2025-10-02T22:35:06.940226] [INFO ] [MAIN ] BB: Successfully saved derivative data. [2025-10-02T22:35:06.942874] [INFO ] [MAIN ] Derivative Progress: 183/1975 symbols completed. BB took 1.3s. Estimated remaining: 12m 40s. Rate: 141.5 symbols/min [2025-10-02T22:35:06.943176] [INFO ] [MAIN ] BBD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:06.984753] [DEBUG] [LOCAL ] BBAI: Loaded 54210 existing records from primary storage. [2025-10-02T22:35:06.984973] [INFO ] [MAIN ] BBAI: Loaded 54210 primary data records. [2025-10-02T22:35:07.138774] [DEBUG] [LOCAL ] BBAR: Loaded 41882 existing records from primary storage. [2025-10-02T22:35:07.144786] [INFO ] [MAIN ] BBAR: Loaded 41882 primary data records. [2025-10-02T22:35:07.319159] [DEBUG] [LOCAL ] BBD: Loaded 53587 existing records from primary storage. [2025-10-02T22:35:07.461808] [INFO ] [MAIN ] BBD: Loaded 53587 primary data records. [2025-10-02T22:35:08.091983] [DEBUG] [MAIN ] BBAI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:08.093389] [INFO ] [MAIN ] BBAI: Generated 1807 derivative records from 54210 primary records. [2025-10-02T22:35:08.094633] [DEBUG] [LOCAL ] BBAI: Saving derivative data. [2025-10-02T22:35:08.130507] [DEBUG] [MAIN ] BBAR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:08.132951] [INFO ] [MAIN ] BBAR: Generated 1807 derivative records from 41882 primary records. [2025-10-02T22:35:08.133153] [DEBUG] [LOCAL ] BBAR: Saving derivative data. [2025-10-02T22:35:08.134950] [DEBUG] [LOCAL ] BBAI: Derivative data saved (1807 records). [2025-10-02T22:35:08.143696] [INFO ] [MAIN ] BBAI: Successfully saved derivative data. [2025-10-02T22:35:08.148614] [INFO ] [MAIN ] Derivative Progress: 184/1975 symbols completed. BBAI took 1.3s. Estimated remaining: 12m 47s. Rate: 140.1 symbols/min [2025-10-02T22:35:08.151911] [INFO ] [MAIN ] BBN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:08.167594] [DEBUG] [MAIN ] BBD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:08.169407] [INFO ] [MAIN ] BBD: Generated 1807 derivative records from 53587 primary records. [2025-10-02T22:35:08.169922] [DEBUG] [LOCAL ] BBD: Saving derivative data. [2025-10-02T22:35:08.180146] [DEBUG] [LOCAL ] BBAR: Derivative data saved (1807 records). [2025-10-02T22:35:08.184687] [INFO ] [MAIN ] BBAR: Successfully saved derivative data. [2025-10-02T22:35:08.188010] [INFO ] [MAIN ] Derivative Progress: 185/1975 symbols completed. BBAR took 1.3s. Estimated remaining: 12m 43s. Rate: 140.8 symbols/min [2025-10-02T22:35:08.190987] [INFO ] [MAIN ] BBVA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:08.197109] [DEBUG] [LOCAL ] BBD: Derivative data saved (1807 records). [2025-10-02T22:35:08.197369] [INFO ] [MAIN ] BBD: Successfully saved derivative data. [2025-10-02T22:35:08.199697] [INFO ] [MAIN ] Derivative Progress: 186/1975 symbols completed. BBD took 1.3s. Estimated remaining: 12m 38s. Rate: 141.5 symbols/min [2025-10-02T22:35:08.200044] [INFO ] [MAIN ] BBW: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:08.209081] [DEBUG] [LOCAL ] BBN: Loaded 18177 existing records from primary storage. [2025-10-02T22:35:08.209339] [INFO ] [MAIN ] BBN: Loaded 18177 primary data records. [2025-10-02T22:35:08.433620] [DEBUG] [LOCAL ] BBW: Loaded 26905 existing records from primary storage. [2025-10-02T22:35:08.452110] [INFO ] [MAIN ] BBW: Loaded 26905 primary data records. [2025-10-02T22:35:08.602306] [DEBUG] [LOCAL ] BBVA: Loaded 49642 existing records from primary storage. [2025-10-02T22:35:08.614452] [INFO ] [MAIN ] BBVA: Loaded 49642 primary data records. [2025-10-02T22:35:09.253491] [DEBUG] [MAIN ] BBN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:09.255334] [INFO ] [MAIN ] BBN: Generated 1807 derivative records from 18177 primary records. [2025-10-02T22:35:09.256414] [DEBUG] [LOCAL ] BBN: Saving derivative data. [2025-10-02T22:35:09.276800] [DEBUG] [LOCAL ] BBN: Derivative data saved (1807 records). [2025-10-02T22:35:09.278150] [INFO ] [MAIN ] BBN: Successfully saved derivative data. [2025-10-02T22:35:09.280490] [INFO ] [MAIN ] Derivative Progress: 187/1975 symbols completed. BBN took 1.1s. Estimated remaining: 12m 44s. Rate: 140.4 symbols/min [2025-10-02T22:35:09.282797] [INFO ] [MAIN ] BBWI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:09.299985] [DEBUG] [MAIN ] BBW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:09.314076] [DEBUG] [MAIN ] BBVA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:09.313745] [INFO ] [MAIN ] BBW: Generated 1807 derivative records from 26905 primary records. [2025-10-02T22:35:09.314979] [INFO ] [MAIN ] BBVA: Generated 1807 derivative records from 49642 primary records. [2025-10-02T22:35:09.314326] [DEBUG] [LOCAL ] BBW: Saving derivative data. [2025-10-02T22:35:09.315636] [DEBUG] [LOCAL ] BBVA: Saving derivative data. [2025-10-02T22:35:09.346329] [DEBUG] [LOCAL ] BBVA: Derivative data saved (1807 records). [2025-10-02T22:35:09.347216] [INFO ] [MAIN ] BBVA: Successfully saved derivative data. [2025-10-02T22:35:09.349747] [INFO ] [MAIN ] Derivative Progress: 188/1975 symbols completed. BBVA took 1.2s. Estimated remaining: 12m 40s. Rate: 141.0 symbols/min [2025-10-02T22:35:09.350399] [INFO ] [MAIN ] BBY: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:09.354738] [DEBUG] [LOCAL ] BBW: Derivative data saved (1807 records). [2025-10-02T22:35:09.355163] [INFO ] [MAIN ] BBW: Successfully saved derivative data. [2025-10-02T22:35:09.358445] [INFO ] [MAIN ] Derivative Progress: 189/1975 symbols completed. BBW took 1.2s. Estimated remaining: 12m 36s. Rate: 141.7 symbols/min [2025-10-02T22:35:09.359179] [INFO ] [MAIN ] BC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:09.450151] [DEBUG] [LOCAL ] BBY: Loaded 53854 existing records from primary storage. [2025-10-02T22:35:09.449169] [DEBUG] [LOCAL ] BBWI: Loaded 53970 existing records from primary storage. [2025-10-02T22:35:09.462781] [INFO ] [MAIN ] BBY: Loaded 53854 primary data records. [2025-10-02T22:35:09.462854] [INFO ] [MAIN ] BBWI: Loaded 53970 primary data records. [2025-10-02T22:35:09.468921] [DEBUG] [LOCAL ] BC: Loaded 44455 existing records from primary storage. [2025-10-02T22:35:09.497902] [INFO ] [MAIN ] BC: Loaded 44455 primary data records. [2025-10-02T22:35:10.561720] [DEBUG] [MAIN ] BBY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:10.593890] [INFO ] [MAIN ] BBY: Generated 1807 derivative records from 53854 primary records. [2025-10-02T22:35:10.594423] [DEBUG] [LOCAL ] BBY: Saving derivative data. [2025-10-02T22:35:10.595061] [DEBUG] [MAIN ] BC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:10.596236] [INFO ] [MAIN ] BC: Generated 1807 derivative records from 44455 primary records. [2025-10-02T22:35:10.594744] [DEBUG] [MAIN ] BBWI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:10.596958] [INFO ] [MAIN ] BBWI: Generated 1807 derivative records from 53970 primary records. [2025-10-02T22:35:10.597291] [DEBUG] [LOCAL ] BC: Saving derivative data. [2025-10-02T22:35:10.597358] [DEBUG] [LOCAL ] BBWI: Saving derivative data. [2025-10-02T22:35:10.644981] [DEBUG] [LOCAL ] BBWI: Derivative data saved (1807 records). [2025-10-02T22:35:10.647850] [INFO ] [MAIN ] BBWI: Successfully saved derivative data. [2025-10-02T22:35:10.650915] [INFO ] [MAIN ] Derivative Progress: 190/1975 symbols completed. BBWI took 1.4s. Estimated remaining: 12m 44s. Rate: 140.2 symbols/min [2025-10-02T22:35:10.653695] [DEBUG] [LOCAL ] BC: Derivative data saved (1807 records). [2025-10-02T22:35:10.653940] [INFO ] [MAIN ] BC: Successfully saved derivative data. [2025-10-02T22:35:10.653859] [INFO ] [MAIN ] BCC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:10.658307] [INFO ] [MAIN ] Derivative Progress: 191/1975 symbols completed. BC took 1.3s. Estimated remaining: 12m 39s. Rate: 141.0 symbols/min [2025-10-02T22:35:10.655622] [DEBUG] [LOCAL ] BBY: Derivative data saved (1807 records). [2025-10-02T22:35:10.658934] [INFO ] [MAIN ] BCE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:10.659139] [INFO ] [MAIN ] BBY: Successfully saved derivative data. [2025-10-02T22:35:10.661553] [INFO ] [MAIN ] Derivative Progress: 192/1975 symbols completed. BBY took 1.3s. Estimated remaining: 12m 35s. Rate: 141.7 symbols/min [2025-10-02T22:35:10.661832] [INFO ] [MAIN ] BCH: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:10.731456] [DEBUG] [LOCAL ] BCC: Loaded 28408 existing records from primary storage. [2025-10-02T22:35:10.730884] [DEBUG] [LOCAL ] BCH: Loaded 29843 existing records from primary storage. [2025-10-02T22:35:10.731718] [INFO ] [MAIN ] BCC: Loaded 28408 primary data records. [2025-10-02T22:35:10.731965] [INFO ] [MAIN ] BCH: Loaded 29843 primary data records. [2025-10-02T22:35:10.898812] [DEBUG] [LOCAL ] BCE: Loaded 52641 existing records from primary storage. [2025-10-02T22:35:10.926708] [INFO ] [MAIN ] BCE: Loaded 52641 primary data records. [2025-10-02T22:35:11.870756] [DEBUG] [MAIN ] BCC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:11.875110] [INFO ] [MAIN ] BCC: Generated 1807 derivative records from 28408 primary records. [2025-10-02T22:35:11.876696] [DEBUG] [LOCAL ] BCC: Saving derivative data. [2025-10-02T22:35:11.904890] [DEBUG] [MAIN ] BCH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:11.910160] [INFO ] [MAIN ] BCH: Generated 1807 derivative records from 29843 primary records. [2025-10-02T22:35:11.912418] [DEBUG] [LOCAL ] BCC: Derivative data saved (1807 records). [2025-10-02T22:35:11.912639] [INFO ] [MAIN ] BCC: Successfully saved derivative data. [2025-10-02T22:35:11.912740] [DEBUG] [LOCAL ] BCH: Saving derivative data. [2025-10-02T22:35:11.930488] [DEBUG] [MAIN ] BCE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:11.929985] [INFO ] [MAIN ] Derivative Progress: 193/1975 symbols completed. BCC took 1.3s. Estimated remaining: 12m 42s. Rate: 140.2 symbols/min [2025-10-02T22:35:11.938902] [INFO ] [MAIN ] BCE: Generated 1807 derivative records from 52641 primary records. [2025-10-02T22:35:11.942884] [DEBUG] [LOCAL ] BCE: Saving derivative data. [2025-10-02T22:35:11.960368] [DEBUG] [LOCAL ] BCH: Derivative data saved (1807 records). [2025-10-02T22:35:11.961794] [INFO ] [MAIN ] BCH: Successfully saved derivative data. [2025-10-02T22:35:11.964965] [INFO ] [MAIN ] Derivative Progress: 194/1975 symbols completed. BCH took 1.3s. Estimated remaining: 12m 38s. Rate: 140.9 symbols/min [2025-10-02T22:35:11.967432] [DEBUG] [LOCAL ] BCE: Derivative data saved (1807 records). [2025-10-02T22:35:11.967500] [INFO ] [MAIN ] BCE: Successfully saved derivative data. [2025-10-02T22:35:11.970078] [INFO ] [MAIN ] Derivative Progress: 195/1975 symbols completed. BCE took 1.3s. Estimated remaining: 12m 34s. Rate: 141.6 symbols/min [2025-10-02T22:35:11.970676] [INFO ] [MAIN ] BCSF: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:11.970778] [INFO ] [MAIN ] BCS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:11.970574] [INFO ] [MAIN ] BCO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:12.011378] [DEBUG] [LOCAL ] BCO: Loaded 26183 existing records from primary storage. [2025-10-02T22:35:12.011722] [INFO ] [MAIN ] BCO: Loaded 26183 primary data records. [2025-10-02T22:35:12.107373] [DEBUG] [LOCAL ] BCSF: Loaded 27982 existing records from primary storage. [2025-10-02T22:35:12.161276] [INFO ] [MAIN ] BCSF: Loaded 27982 primary data records. [2025-10-02T22:35:12.485027] [DEBUG] [LOCAL ] BCS: Loaded 53841 existing records from primary storage. [2025-10-02T22:35:12.507791] [INFO ] [MAIN ] BCS: Loaded 53841 primary data records. [2025-10-02T22:35:13.160111] [DEBUG] [MAIN ] BCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:13.161894] [INFO ] [MAIN ] BCO: Generated 1807 derivative records from 26183 primary records. [2025-10-02T22:35:13.162297] [DEBUG] [LOCAL ] BCO: Saving derivative data. [2025-10-02T22:35:13.182526] [DEBUG] [LOCAL ] BCO: Derivative data saved (1807 records). [2025-10-02T22:35:13.183061] [INFO ] [MAIN ] BCO: Successfully saved derivative data. [2025-10-02T22:35:13.186427] [INFO ] [MAIN ] Derivative Progress: 196/1975 symbols completed. BCO took 1.2s. Estimated remaining: 12m 41s. Rate: 140.3 symbols/min [2025-10-02T22:35:13.187003] [INFO ] [MAIN ] BCX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:13.207285] [DEBUG] [MAIN ] BCSF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:13.208190] [INFO ] [MAIN ] BCSF: Generated 1807 derivative records from 27982 primary records. [2025-10-02T22:35:13.208547] [DEBUG] [LOCAL ] BCSF: Saving derivative data. [2025-10-02T22:35:13.251018] [DEBUG] [LOCAL ] BCSF: Derivative data saved (1807 records). [2025-10-02T22:35:13.256036] [INFO ] [MAIN ] BCSF: Successfully saved derivative data. [2025-10-02T22:35:13.241411] [DEBUG] [LOCAL ] BCX: Loaded 21876 existing records from primary storage. [2025-10-02T22:35:13.258514] [INFO ] [MAIN ] Derivative Progress: 197/1975 symbols completed. BCSF took 1.3s. Estimated remaining: 12m 37s. Rate: 140.9 symbols/min [2025-10-02T22:35:13.258901] [INFO ] [MAIN ] BCX: Loaded 21876 primary data records. [2025-10-02T22:35:13.259280] [DEBUG] [MAIN ] BCS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:13.259386] [INFO ] [MAIN ] BDJ: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:13.265601] [INFO ] [MAIN ] BCS: Generated 1807 derivative records from 53841 primary records. [2025-10-02T22:35:13.283604] [DEBUG] [LOCAL ] BCS: Saving derivative data. [2025-10-02T22:35:13.399446] [DEBUG] [LOCAL ] BCS: Derivative data saved (1807 records). [2025-10-02T22:35:13.400034] [INFO ] [MAIN ] BCS: Successfully saved derivative data. [2025-10-02T22:35:13.454745] [INFO ] [MAIN ] Derivative Progress: 198/1975 symbols completed. BCS took 1.5s. Estimated remaining: 12m 35s. Rate: 141.3 symbols/min [2025-10-02T22:35:13.498815] [INFO ] [MAIN ] BDN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:13.637710] [DEBUG] [LOCAL ] BDJ: Loaded 29159 existing records from primary storage. [2025-10-02T22:35:13.637820] [INFO ] [MAIN ] BDJ: Loaded 29159 primary data records. [2025-10-02T22:35:14.003270] [DEBUG] [LOCAL ] BDN: Loaded 47839 existing records from primary storage. [2025-10-02T22:35:14.003915] [INFO ] [MAIN ] BDN: Loaded 47839 primary data records. [2025-10-02T22:35:14.119371] [DEBUG] [MAIN ] BCX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:14.142351] [INFO ] [MAIN ] BCX: Generated 1807 derivative records from 21876 primary records. [2025-10-02T22:35:14.142561] [DEBUG] [LOCAL ] BCX: Saving derivative data. [2025-10-02T22:35:14.383360] [DEBUG] [LOCAL ] BCX: Derivative data saved (1807 records). [2025-10-02T22:35:14.383495] [INFO ] [MAIN ] BCX: Successfully saved derivative data. [2025-10-02T22:35:14.386723] [INFO ] [MAIN ] Derivative Progress: 199/1975 symbols completed. BCX took 1.2s. Estimated remaining: 12m 39s. Rate: 140.4 symbols/min [2025-10-02T22:35:14.390053] [INFO ] [MAIN ] BDX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:14.408964] [DEBUG] [MAIN ] BDJ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:14.410053] [INFO ] [MAIN ] BDJ: Generated 1807 derivative records from 29159 primary records. [2025-10-02T22:35:14.410758] [DEBUG] [LOCAL ] BDJ: Saving derivative data. [2025-10-02T22:35:14.432974] [DEBUG] [LOCAL ] BDJ: Derivative data saved (1807 records). [2025-10-02T22:35:14.433240] [INFO ] [MAIN ] BDJ: Successfully saved derivative data. [2025-10-02T22:35:14.435968] [INFO ] [MAIN ] Derivative Progress: 200/1975 symbols completed. BDJ took 1.2s. Estimated remaining: 12m 35s. Rate: 141.0 symbols/min [2025-10-02T22:35:14.436981] [INFO ] [MAIN ] BE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:14.470131] [DEBUG] [MAIN ] BDN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:14.471199] [INFO ] [MAIN ] BDN: Generated 1807 derivative records from 47839 primary records. [2025-10-02T22:35:14.471264] [DEBUG] [LOCAL ] BDN: Saving derivative data. [2025-10-02T22:35:14.488898] [DEBUG] [LOCAL ] BDN: Derivative data saved (1807 records). [2025-10-02T22:35:14.490221] [INFO ] [MAIN ] BDN: Successfully saved derivative data. [2025-10-02T22:35:14.492439] [INFO ] [MAIN ] Derivative Progress: 201/1975 symbols completed. BDN took 1.0s. Estimated remaining: 12m 31s. Rate: 141.7 symbols/min [2025-10-02T22:35:14.492909] [INFO ] [MAIN ] BEKE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:14.514557] [DEBUG] [LOCAL ] BDX: Loaded 52730 existing records from primary storage. [2025-10-02T22:35:14.514954] [INFO ] [MAIN ] BDX: Loaded 52730 primary data records. [2025-10-02T22:35:14.691888] [DEBUG] [LOCAL ] BE: Loaded 54043 existing records from primary storage. [2025-10-02T22:35:14.707678] [INFO ] [MAIN ] BE: Loaded 54043 primary data records. [2025-10-02T22:35:15.100431] [DEBUG] [LOCAL ] BEKE: Loaded 53629 existing records from primary storage. [2025-10-02T22:35:15.106157] [INFO ] [MAIN ] BEKE: Loaded 53629 primary data records. [2025-10-02T22:35:15.687492] [DEBUG] [MAIN ] BDX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:15.688482] [INFO ] [MAIN ] BDX: Generated 1807 derivative records from 52730 primary records. [2025-10-02T22:35:15.689084] [DEBUG] [LOCAL ] BDX: Saving derivative data. [2025-10-02T22:35:15.711835] [DEBUG] [LOCAL ] BDX: Derivative data saved (1807 records). [2025-10-02T22:35:15.724565] [INFO ] [MAIN ] BDX: Successfully saved derivative data. [2025-10-02T22:35:15.725487] [DEBUG] [MAIN ] BE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:15.727557] [INFO ] [MAIN ] Derivative Progress: 202/1975 symbols completed. BDX took 1.3s. Estimated remaining: 12m 38s. Rate: 140.3 symbols/min [2025-10-02T22:35:15.728734] [INFO ] [MAIN ] BEN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:15.728527] [INFO ] [MAIN ] BE: Generated 1807 derivative records from 54043 primary records. [2025-10-02T22:35:15.728974] [DEBUG] [LOCAL ] BE: Saving derivative data. [2025-10-02T22:35:15.763508] [DEBUG] [LOCAL ] BE: Derivative data saved (1807 records). [2025-10-02T22:35:15.764161] [DEBUG] [MAIN ] BEKE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:15.764238] [INFO ] [MAIN ] BE: Successfully saved derivative data. [2025-10-02T22:35:15.767108] [INFO ] [MAIN ] Derivative Progress: 203/1975 symbols completed. BE took 1.3s. Estimated remaining: 12m 34s. Rate: 141.0 symbols/min [2025-10-02T22:35:15.768176] [INFO ] [MAIN ] BEKE: Generated 1807 derivative records from 53629 primary records. [2025-10-02T22:35:15.768418] [DEBUG] [LOCAL ] BEKE: Saving derivative data. [2025-10-02T22:35:15.768562] [INFO ] [MAIN ] BEP: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:15.787444] [DEBUG] [LOCAL ] BEKE: Derivative data saved (1807 records). [2025-10-02T22:35:15.787681] [INFO ] [MAIN ] BEKE: Successfully saved derivative data. [2025-10-02T22:35:15.790115] [INFO ] [MAIN ] Derivative Progress: 204/1975 symbols completed. BEKE took 1.3s. Estimated remaining: 12m 30s. Rate: 141.6 symbols/min [2025-10-02T22:35:15.790349] [INFO ] [MAIN ] BEPC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:15.847582] [DEBUG] [LOCAL ] BEP: Loaded 38963 existing records from primary storage. [2025-10-02T22:35:15.847873] [INFO ] [MAIN ] BEP: Loaded 38963 primary data records. [2025-10-02T22:35:15.980190] [DEBUG] [LOCAL ] BEN: Loaded 53426 existing records from primary storage. [2025-10-02T22:35:15.995211] [INFO ] [MAIN ] BEN: Loaded 53426 primary data records. [2025-10-02T22:35:16.331296] [DEBUG] [LOCAL ] BEPC: Loaded 46818 existing records from primary storage. [2025-10-02T22:35:16.361816] [INFO ] [MAIN ] BEPC: Loaded 46818 primary data records. [2025-10-02T22:35:17.102386] [DEBUG] [MAIN ] BEP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:17.103689] [INFO ] [MAIN ] BEP: Generated 1807 derivative records from 38963 primary records. [2025-10-02T22:35:17.104607] [DEBUG] [LOCAL ] BEP: Saving derivative data. [2025-10-02T22:35:17.140056] [DEBUG] [LOCAL ] BEP: Derivative data saved (1807 records). [2025-10-02T22:35:17.141038] [INFO ] [MAIN ] BEP: Successfully saved derivative data. [2025-10-02T22:35:17.141369] [DEBUG] [MAIN ] BEN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:17.143594] [INFO ] [MAIN ] Derivative Progress: 205/1975 symbols completed. BEP took 1.4s. Estimated remaining: 12m 38s. Rate: 140.1 symbols/min [2025-10-02T22:35:17.144189] [INFO ] [MAIN ] BEPI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:17.145177] [INFO ] [MAIN ] BEN: Generated 1807 derivative records from 53426 primary records. [2025-10-02T22:35:17.146039] [DEBUG] [LOCAL ] BEN: Saving derivative data. [2025-10-02T22:35:17.165949] [DEBUG] [LOCAL ] BEPI: Loaded 3556 existing records from primary storage. [2025-10-02T22:35:17.168607] [INFO ] [MAIN ] BEPI: Loaded 3556 primary data records. [2025-10-02T22:35:17.182408] [DEBUG] [LOCAL ] BEN: Derivative data saved (1807 records). [2025-10-02T22:35:17.182575] [INFO ] [MAIN ] BEN: Successfully saved derivative data. [2025-10-02T22:35:17.201230] [INFO ] [MAIN ] Derivative Progress: 206/1975 symbols completed. BEN took 1.5s. Estimated remaining: 12m 34s. Rate: 140.7 symbols/min [2025-10-02T22:35:17.228867] [INFO ] [MAIN ] BEPJ: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:17.277420] [DEBUG] [MAIN ] BEPC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:17.284307] [INFO ] [MAIN ] BEPC: Generated 1807 derivative records from 46818 primary records. [2025-10-02T22:35:17.305825] [DEBUG] [LOCAL ] BEPC: Saving derivative data. [2025-10-02T22:35:17.316897] [DEBUG] [LOCAL ] BEPJ: Loaded 3156 existing records from primary storage. [2025-10-02T22:35:17.341098] [DEBUG] [LOCAL ] BEPC: Derivative data saved (1807 records). [2025-10-02T22:35:17.334928] [INFO ] [MAIN ] BEPJ: Loaded 3156 primary data records. [2025-10-02T22:35:17.341220] [INFO ] [MAIN ] BEPC: Successfully saved derivative data. [2025-10-02T22:35:17.358949] [INFO ] [MAIN ] Derivative Progress: 207/1975 symbols completed. BEPC took 1.6s. Estimated remaining: 12m 32s. Rate: 141.1 symbols/min [2025-10-02T22:35:17.395556] [INFO ] [MAIN ] BFAM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:17.910319] [DEBUG] [LOCAL ] BFAM: Loaded 33413 existing records from primary storage. [2025-10-02T22:35:17.910627] [INFO ] [MAIN ] BFAM: Loaded 33413 primary data records. [2025-10-02T22:35:18.249216] [DEBUG] [MAIN ] BEPI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:18.268878] [INFO ] [MAIN ] BEPI: Generated 1807 derivative records from 3556 primary records. [2025-10-02T22:35:18.269761] [DEBUG] [LOCAL ] BEPI: Saving derivative data. [2025-10-02T22:35:18.302098] [DEBUG] [MAIN ] BEPJ: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-02T22:35:18.305298] [INFO ] [MAIN ] BEPJ: Generated 1806 derivative records from 3156 primary records. [2025-10-02T22:35:18.306319] [DEBUG] [LOCAL ] BEPI: Derivative data saved (1807 records). [2025-10-02T22:35:18.306549] [DEBUG] [LOCAL ] BEPJ: Saving derivative data. [2025-10-02T22:35:18.307120] [INFO ] [MAIN ] BEPI: Successfully saved derivative data. [2025-10-02T22:35:18.309528] [INFO ] [MAIN ] Derivative Progress: 208/1975 symbols completed. BEPI took 1.2s. Estimated remaining: 12m 36s. Rate: 140.3 symbols/min [2025-10-02T22:35:18.325744] [DEBUG] [LOCAL ] BEPJ: Derivative data saved (1806 records). [2025-10-02T22:35:18.325859] [INFO ] [MAIN ] BEPJ: Successfully saved derivative data. [2025-10-02T22:35:18.328318] [INFO ] [MAIN ] Derivative Progress: 209/1975 symbols completed. BEPJ took 1.1s. Estimated remaining: 12m 32s. Rate: 140.9 symbols/min [2025-10-02T22:35:18.346007] [DEBUG] [MAIN ] BFAM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:18.346754] [INFO ] [MAIN ] BFAM: Generated 1807 derivative records from 33413 primary records. [2025-10-02T22:35:18.346822] [DEBUG] [LOCAL ] BFAM: Saving derivative data. [2025-10-02T22:35:18.363242] [DEBUG] [LOCAL ] BFAM: Derivative data saved (1807 records). [2025-10-02T22:35:18.363310] [INFO ] [MAIN ] BFAM: Successfully saved derivative data. [2025-10-02T22:35:18.365674] [INFO ] [MAIN ] Derivative Progress: 210/1975 symbols completed. BFAM took 1.0s. Estimated remaining: 12m 28s. Rate: 141.6 symbols/min [2025-10-02T22:35:18.366127] [INFO ] [MAIN ] BFH: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:18.366364] [INFO ] [MAIN ] BFLY: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:18.366255] [INFO ] [MAIN ] BFK: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:18.384851] [DEBUG] [LOCAL ] BFK: Loaded 13980 existing records from primary storage. [2025-10-02T22:35:18.385363] [INFO ] [MAIN ] BFK: Loaded 13980 primary data records. [2025-10-02T22:35:18.637552] [DEBUG] [LOCAL ] BFLY: Loaded 52160 existing records from primary storage. [2025-10-02T22:35:18.637821] [INFO ] [MAIN ] BFLY: Loaded 52160 primary data records. [2025-10-02T22:35:18.796532] [DEBUG] [LOCAL ] BFH: Loaded 41897 existing records from primary storage. [2025-10-02T22:35:18.827842] [INFO ] [MAIN ] BFH: Loaded 41897 primary data records. [2025-10-02T22:35:19.496230] [DEBUG] [MAIN ] BFK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:19.497536] [INFO ] [MAIN ] BFK: Generated 1807 derivative records from 13980 primary records. [2025-10-02T22:35:19.497847] [DEBUG] [LOCAL ] BFK: Saving derivative data. [2025-10-02T22:35:19.519461] [DEBUG] [LOCAL ] BFK: Derivative data saved (1807 records). [2025-10-02T22:35:19.519823] [INFO ] [MAIN ] BFK: Successfully saved derivative data. [2025-10-02T22:35:19.522091] [INFO ] [MAIN ] Derivative Progress: 211/1975 symbols completed. BFK took 1.2s. Estimated remaining: 12m 34s. Rate: 140.4 symbols/min [2025-10-02T22:35:19.523299] [INFO ] [MAIN ] BFS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:19.544714] [DEBUG] [MAIN ] BFLY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:19.545628] [INFO ] [MAIN ] BFLY: Generated 1807 derivative records from 52160 primary records. [2025-10-02T22:35:19.545930] [DEBUG] [LOCAL ] BFLY: Saving derivative data. [2025-10-02T22:35:19.562612] [DEBUG] [LOCAL ] BFS: Loaded 9213 existing records from primary storage. [2025-10-02T22:35:19.567132] [DEBUG] [LOCAL ] BFLY: Derivative data saved (1807 records). [2025-10-02T22:35:19.567702] [INFO ] [MAIN ] BFS: Loaded 9213 primary data records. [2025-10-02T22:35:19.567599] [INFO ] [MAIN ] BFLY: Successfully saved derivative data. [2025-10-02T22:35:19.571421] [INFO ] [MAIN ] Derivative Progress: 212/1975 symbols completed. BFLY took 1.2s. Estimated remaining: 12m 30s. Rate: 141.0 symbols/min [2025-10-02T22:35:19.573149] [INFO ] [MAIN ] BFZ: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:19.678274] [DEBUG] [MAIN ] BFH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:19.702671] [INFO ] [MAIN ] BFH: Generated 1807 derivative records from 41897 primary records. [2025-10-02T22:35:19.707405] [DEBUG] [LOCAL ] BFH: Saving derivative data. [2025-10-02T22:35:19.758307] [DEBUG] [LOCAL ] BFZ: Loaded 12227 existing records from primary storage. [2025-10-02T22:35:19.800030] [INFO ] [MAIN ] BFZ: Loaded 12227 primary data records. [2025-10-02T22:35:20.140090] [DEBUG] [LOCAL ] BFH: Derivative data saved (1807 records). [2025-10-02T22:35:20.178555] [INFO ] [MAIN ] BFH: Successfully saved derivative data. [2025-10-02T22:35:20.188616] [INFO ] [MAIN ] Derivative Progress: 213/1975 symbols completed. BFH took 1.8s. Estimated remaining: 12m 31s. Rate: 140.7 symbols/min [2025-10-02T22:35:20.315514] [INFO ] [MAIN ] BG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:20.339399] [DEBUG] [MAIN ] BFS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:20.340312] [INFO ] [MAIN ] BFS: Generated 1807 derivative records from 9213 primary records. [2025-10-02T22:35:20.340490] [DEBUG] [LOCAL ] BFS: Saving derivative data. [2025-10-02T22:35:20.358077] [DEBUG] [LOCAL ] BFS: Derivative data saved (1807 records). [2025-10-02T22:35:20.358418] [INFO ] [MAIN ] BFS: Successfully saved derivative data. [2025-10-02T22:35:20.360693] [INFO ] [MAIN ] Derivative Progress: 214/1975 symbols completed. BFS took 0.8s. Estimated remaining: 12m 29s. Rate: 141.1 symbols/min [2025-10-02T22:35:20.361388] [INFO ] [MAIN ] BGB: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:20.379546] [DEBUG] [MAIN ] BFZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:20.380359] [INFO ] [MAIN ] BFZ: Generated 1807 derivative records from 12227 primary records. [2025-10-02T22:35:20.380797] [DEBUG] [LOCAL ] BFZ: Saving derivative data. [2025-10-02T22:35:20.422145] [DEBUG] [LOCAL ] BGB: Loaded 17717 existing records from primary storage. [2025-10-02T22:35:20.422353] [INFO ] [MAIN ] BGB: Loaded 17717 primary data records. [2025-10-02T22:35:20.430575] [DEBUG] [LOCAL ] BFZ: Derivative data saved (1807 records). [2025-10-02T22:35:20.437665] [INFO ] [MAIN ] BFZ: Successfully saved derivative data. [2025-10-02T22:35:20.468418] [INFO ] [MAIN ] Derivative Progress: 215/1975 symbols completed. BFZ took 0.9s. Estimated remaining: 12m 26s. Rate: 141.6 symbols/min [2025-10-02T22:35:20.510203] [DEBUG] [LOCAL ] BG: Loaded 50788 existing records from primary storage. [2025-10-02T22:35:20.525103] [INFO ] [MAIN ] BG: Loaded 50788 primary data records. [2025-10-02T22:35:20.508975] [INFO ] [MAIN ] BGH: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:20.901302] [DEBUG] [LOCAL ] BGH: Loaded 17043 existing records from primary storage. [2025-10-02T22:35:20.931781] [INFO ] [MAIN ] BGH: Loaded 17043 primary data records. [2025-10-02T22:35:21.547561] [DEBUG] [MAIN ] BGB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:21.553801] [INFO ] [MAIN ] BGB: Generated 1807 derivative records from 17717 primary records. [2025-10-02T22:35:21.553910] [DEBUG] [LOCAL ] BGB: Saving derivative data. [2025-10-02T22:35:21.553082] [DEBUG] [MAIN ] BG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:21.555243] [INFO ] [MAIN ] BG: Generated 1807 derivative records from 50788 primary records. [2025-10-02T22:35:21.555333] [DEBUG] [LOCAL ] BG: Saving derivative data. [2025-10-02T22:35:21.584666] [DEBUG] [LOCAL ] BGB: Derivative data saved (1807 records). [2025-10-02T22:35:21.585317] [INFO ] [MAIN ] BGB: Successfully saved derivative data. [2025-10-02T22:35:21.587325] [INFO ] [MAIN ] Derivative Progress: 216/1975 symbols completed. BGB took 1.2s. Estimated remaining: 12m 31s. Rate: 140.5 symbols/min [2025-10-02T22:35:21.587762] [INFO ] [MAIN ] BGS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:21.594625] [DEBUG] [LOCAL ] BG: Derivative data saved (1807 records). [2025-10-02T22:35:21.594999] [INFO ] [MAIN ] BG: Successfully saved derivative data. [2025-10-02T22:35:21.597506] [INFO ] [MAIN ] Derivative Progress: 217/1975 symbols completed. BG took 1.3s. Estimated remaining: 12m 27s. Rate: 141.2 symbols/min [2025-10-02T22:35:21.597812] [INFO ] [MAIN ] BGSF: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:21.611513] [DEBUG] [MAIN ] BGH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:21.612403] [INFO ] [MAIN ] BGH: Generated 1807 derivative records from 17043 primary records. [2025-10-02T22:35:21.612550] [DEBUG] [LOCAL ] BGH: Saving derivative data. [2025-10-02T22:35:21.632423] [DEBUG] [LOCAL ] BGH: Derivative data saved (1807 records). [2025-10-02T22:35:21.632867] [INFO ] [MAIN ] BGH: Successfully saved derivative data. [2025-10-02T22:35:21.635700] [INFO ] [MAIN ] Derivative Progress: 218/1975 symbols completed. BGH took 1.1s. Estimated remaining: 12m 24s. Rate: 141.7 symbols/min [2025-10-02T22:35:21.635891] [INFO ] [MAIN ] BGT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:21.639978] [DEBUG] [LOCAL ] BGSF: Loaded 7557 existing records from primary storage. [2025-10-02T22:35:21.640324] [INFO ] [MAIN ] BGSF: Loaded 7557 primary data records. [2025-10-02T22:35:21.883853] [DEBUG] [LOCAL ] BGS: Loaded 50795 existing records from primary storage. [2025-10-02T22:35:21.892273] [INFO ] [MAIN ] BGS: Loaded 50795 primary data records. [2025-10-02T22:35:21.884209] [DEBUG] [LOCAL ] BGT: Loaded 16702 existing records from primary storage. [2025-10-02T22:35:21.895776] [INFO ] [MAIN ] BGT: Loaded 16702 primary data records. [2025-10-02T22:35:22.752081] [DEBUG] [MAIN ] BGSF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:22.754019] [INFO ] [MAIN ] BGSF: Generated 1807 derivative records from 7557 primary records. [2025-10-02T22:35:22.754383] [DEBUG] [LOCAL ] BGSF: Saving derivative data. [2025-10-02T22:35:22.771390] [DEBUG] [LOCAL ] BGSF: Derivative data saved (1807 records). [2025-10-02T22:35:22.771594] [INFO ] [MAIN ] BGSF: Successfully saved derivative data. [2025-10-02T22:35:22.773756] [INFO ] [MAIN ] Derivative Progress: 219/1975 symbols completed. BGSF took 1.2s. Estimated remaining: 12m 29s. Rate: 140.7 symbols/min [2025-10-02T22:35:22.774203] [INFO ] [MAIN ] BGX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:22.808895] [DEBUG] [MAIN ] BGS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:22.809859] [INFO ] [MAIN ] BGS: Generated 1807 derivative records from 50795 primary records. [2025-10-02T22:35:22.810296] [DEBUG] [LOCAL ] BGS: Saving derivative data. [2025-10-02T22:35:22.810142] [DEBUG] [MAIN ] BGT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:22.811572] [INFO ] [MAIN ] BGT: Generated 1807 derivative records from 16702 primary records. [2025-10-02T22:35:22.811945] [DEBUG] [LOCAL ] BGT: Saving derivative data. [2025-10-02T22:35:22.828929] [DEBUG] [LOCAL ] BGX: Loaded 11102 existing records from primary storage. [2025-10-02T22:35:22.838103] [INFO ] [MAIN ] BGX: Loaded 11102 primary data records. [2025-10-02T22:35:22.908060] [DEBUG] [LOCAL ] BGS: Derivative data saved (1807 records). [2025-10-02T22:35:22.931678] [INFO ] [MAIN ] BGS: Successfully saved derivative data. [2025-10-02T22:35:22.946922] [INFO ] [MAIN ] Derivative Progress: 220/1975 symbols completed. BGS took 1.4s. Estimated remaining: 12m 27s. Rate: 141.0 symbols/min [2025-10-02T22:35:22.955983] [DEBUG] [LOCAL ] BGT: Derivative data saved (1807 records). [2025-10-02T22:35:22.969957] [INFO ] [MAIN ] BGY: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:22.980924] [INFO ] [MAIN ] BGT: Successfully saved derivative data. [2025-10-02T22:35:22.999581] [INFO ] [MAIN ] Derivative Progress: 221/1975 symbols completed. BGT took 1.4s. Estimated remaining: 12m 23s. Rate: 141.6 symbols/min [2025-10-02T22:35:23.060035] [INFO ] [MAIN ] BH: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:23.210229] [DEBUG] [LOCAL ] BGY: Loaded 22528 existing records from primary storage. [2025-10-02T22:35:23.210531] [INFO ] [MAIN ] BGY: Loaded 22528 primary data records. [2025-10-02T22:35:23.279688] [DEBUG] [LOCAL ] BH: Loaded 15980 existing records from primary storage. [2025-10-02T22:35:23.324595] [INFO ] [MAIN ] BH: Loaded 15980 primary data records. [2025-10-02T22:35:23.760937] [DEBUG] [MAIN ] BGX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:23.796020] [INFO ] [MAIN ] BGX: Generated 1807 derivative records from 11102 primary records. [2025-10-02T22:35:23.819863] [DEBUG] [LOCAL ] BGX: Saving derivative data. [2025-10-02T22:35:23.963801] [DEBUG] [LOCAL ] BGX: Derivative data saved (1807 records). [2025-10-02T22:35:23.966835] [INFO ] [MAIN ] BGX: Successfully saved derivative data. [2025-10-02T22:35:23.969858] [INFO ] [MAIN ] Derivative Progress: 222/1975 symbols completed. BGX took 1.2s. Estimated remaining: 12m 27s. Rate: 140.8 symbols/min [2025-10-02T22:35:23.970692] [INFO ] [MAIN ] BHC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:23.994074] [DEBUG] [MAIN ] BGY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:23.994913] [INFO ] [MAIN ] BGY: Generated 1807 derivative records from 22528 primary records. [2025-10-02T22:35:23.995112] [DEBUG] [LOCAL ] BGY: Saving derivative data. [2025-10-02T22:35:24.016313] [DEBUG] [LOCAL ] BGY: Derivative data saved (1807 records). [2025-10-02T22:35:24.035152] [INFO ] [MAIN ] BGY: Successfully saved derivative data. [2025-10-02T22:35:24.042963] [INFO ] [MAIN ] Derivative Progress: 223/1975 symbols completed. BGY took 1.1s. Estimated remaining: 12m 24s. Rate: 141.3 symbols/min [2025-10-02T22:35:24.043332] [DEBUG] [MAIN ] BH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:24.044356] [INFO ] [MAIN ] BH: Generated 1807 derivative records from 15980 primary records. [2025-10-02T22:35:24.044629] [DEBUG] [LOCAL ] BH: Saving derivative data. [2025-10-02T22:35:24.076263] [DEBUG] [LOCAL ] BH: Derivative data saved (1807 records). [2025-10-02T22:35:24.076426] [INFO ] [MAIN ] BH: Successfully saved derivative data. [2025-10-02T22:35:24.079110] [INFO ] [MAIN ] Derivative Progress: 224/1975 symbols completed. BH took 1.0s. Estimated remaining: 12m 20s. Rate: 141.9 symbols/min [2025-10-02T22:35:24.080546] [DEBUG] [LOCAL ] BHC: Loaded 47149 existing records from primary storage. [2025-10-02T22:35:24.080735] [INFO ] [MAIN ] BHC: Loaded 47149 primary data records. [2025-10-02T22:35:24.434048] [DEBUG] [MAIN ] BHC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:24.434991] [INFO ] [MAIN ] BHC: Generated 1807 derivative records from 47149 primary records. [2025-10-02T22:35:24.435073] [DEBUG] [LOCAL ] BHC: Saving derivative data. [2025-10-02T22:35:24.451569] [DEBUG] [LOCAL ] BHC: Derivative data saved (1807 records). [2025-10-02T22:35:24.451759] [INFO ] [MAIN ] BHC: Successfully saved derivative data. [2025-10-02T22:35:24.454077] [INFO ] [MAIN ] Derivative Progress: 225/1975 symbols completed. BHC took 0.5s. Estimated remaining: 12m 20s. Rate: 142.0 symbols/min [2025-10-02T22:35:24.454768] [INFO ] [MAIN ] BHP: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:24.454686] [INFO ] [MAIN ] BHE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:24.454896] [INFO ] [MAIN ] BHK: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:24.495187] [DEBUG] [LOCAL ] BHK: Loaded 23155 existing records from primary storage. [2025-10-02T22:35:24.495566] [INFO ] [MAIN ] BHK: Loaded 23155 primary data records. [2025-10-02T22:35:24.496083] [DEBUG] [LOCAL ] BHE: Loaded 24774 existing records from primary storage. [2025-10-02T22:35:24.514051] [INFO ] [MAIN ] BHE: Loaded 24774 primary data records. [2025-10-02T22:35:24.874949] [DEBUG] [LOCAL ] BHP: Loaded 53758 existing records from primary storage. [2025-10-02T22:35:25.100526] [INFO ] [MAIN ] BHP: Loaded 53758 primary data records. [2025-10-02T22:35:25.688723] [DEBUG] [MAIN ] BHK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:25.691813] [DEBUG] [MAIN ] BHE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:25.691350] [INFO ] [MAIN ] BHK: Generated 1807 derivative records from 23155 primary records. [2025-10-02T22:35:25.692343] [DEBUG] [LOCAL ] BHK: Saving derivative data. [2025-10-02T22:35:25.693039] [INFO ] [MAIN ] BHE: Generated 1807 derivative records from 24774 primary records. [2025-10-02T22:35:25.694142] [DEBUG] [LOCAL ] BHE: Saving derivative data. [2025-10-02T22:35:25.735208] [DEBUG] [LOCAL ] BHK: Derivative data saved (1807 records). [2025-10-02T22:35:25.735505] [INFO ] [MAIN ] BHK: Successfully saved derivative data. [2025-10-02T22:35:25.732398] [DEBUG] [LOCAL ] BHE: Derivative data saved (1807 records). [2025-10-02T22:35:25.735807] [INFO ] [MAIN ] BHE: Successfully saved derivative data. [2025-10-02T22:35:25.738638] [INFO ] [MAIN ] Derivative Progress: 226/1975 symbols completed. BHE took 1.3s. Estimated remaining: 12m 26s. Rate: 140.7 symbols/min [2025-10-02T22:35:25.756599] [INFO ] [MAIN ] BHR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:25.756461] [DEBUG] [MAIN ] BHP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:25.756673] [INFO ] [MAIN ] Derivative Progress: 227/1975 symbols completed. BHK took 1.3s. Estimated remaining: 12m 22s. Rate: 141.3 symbols/min [2025-10-02T22:35:25.758468] [INFO ] [MAIN ] BHP: Generated 1807 derivative records from 53758 primary records. [2025-10-02T22:35:25.758994] [DEBUG] [LOCAL ] BHP: Saving derivative data. [2025-10-02T22:35:25.758687] [INFO ] [MAIN ] BHVN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:25.780179] [DEBUG] [LOCAL ] BHP: Derivative data saved (1807 records). [2025-10-02T22:35:25.780525] [INFO ] [MAIN ] BHP: Successfully saved derivative data. [2025-10-02T22:35:25.783432] [INFO ] [MAIN ] Derivative Progress: 228/1975 symbols completed. BHP took 1.3s. Estimated remaining: 12m 19s. Rate: 141.9 symbols/min [2025-10-02T22:35:25.784083] [INFO ] [MAIN ] BILL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:25.803921] [DEBUG] [LOCAL ] BHR: Loaded 21586 existing records from primary storage. [2025-10-02T22:35:25.804181] [INFO ] [MAIN ] BHR: Loaded 21586 primary data records. [2025-10-02T22:35:25.993778] [DEBUG] [LOCAL ] BHVN: Loaded 50165 existing records from primary storage. [2025-10-02T22:35:26.051779] [INFO ] [MAIN ] BHVN: Loaded 50165 primary data records. [2025-10-02T22:35:26.329072] [DEBUG] [LOCAL ] BILL: Loaded 52726 existing records from primary storage. [2025-10-02T22:35:26.336743] [INFO ] [MAIN ] BILL: Loaded 52726 primary data records. [2025-10-02T22:35:26.918151] [DEBUG] [MAIN ] BHR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:27.059221] [INFO ] [MAIN ] BHR: Generated 1807 derivative records from 21586 primary records. [2025-10-02T22:35:27.081087] [DEBUG] [LOCAL ] BHR: Saving derivative data. [2025-10-02T22:35:27.271079] [DEBUG] [LOCAL ] BHR: Derivative data saved (1807 records). [2025-10-02T22:35:27.272212] [INFO ] [MAIN ] BHR: Successfully saved derivative data. [2025-10-02T22:35:27.274602] [INFO ] [MAIN ] Derivative Progress: 229/1975 symbols completed. BHR took 1.5s. Estimated remaining: 12m 27s. Rate: 140.3 symbols/min [2025-10-02T22:35:27.275206] [INFO ] [MAIN ] BIO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:27.298150] [DEBUG] [MAIN ] BHVN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:27.299578] [INFO ] [MAIN ] BHVN: Generated 1807 derivative records from 50165 primary records. [2025-10-02T22:35:27.299889] [DEBUG] [LOCAL ] BHVN: Saving derivative data. [2025-10-02T22:35:27.345293] [DEBUG] [LOCAL ] BIO: Loaded 25067 existing records from primary storage. [2025-10-02T22:35:27.353819] [DEBUG] [MAIN ] BILL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:27.353390] [DEBUG] [LOCAL ] BHVN: Derivative data saved (1807 records). [2025-10-02T22:35:27.355449] [INFO ] [MAIN ] BHVN: Successfully saved derivative data. [2025-10-02T22:35:27.355000] [INFO ] [MAIN ] BILL: Generated 1807 derivative records from 52726 primary records. [2025-10-02T22:35:27.355138] [INFO ] [MAIN ] BIO: Loaded 25067 primary data records. [2025-10-02T22:35:27.358258] [INFO ] [MAIN ] Derivative Progress: 230/1975 symbols completed. BHVN took 1.6s. Estimated remaining: 12m 24s. Rate: 140.8 symbols/min [2025-10-02T22:35:27.358699] [INFO ] [MAIN ] BIP: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:27.359327] [DEBUG] [LOCAL ] BILL: Saving derivative data. [2025-10-02T22:35:27.507017] [DEBUG] [LOCAL ] BILL: Derivative data saved (1807 records). [2025-10-02T22:35:27.507350] [INFO ] [MAIN ] BILL: Successfully saved derivative data. [2025-10-02T22:35:27.509859] [INFO ] [MAIN ] Derivative Progress: 231/1975 symbols completed. BILL took 1.7s. Estimated remaining: 12m 21s. Rate: 141.2 symbols/min [2025-10-02T22:35:27.515713] [INFO ] [MAIN ] BIPC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:27.749369] [DEBUG] [LOCAL ] BIP: Loaded 39822 existing records from primary storage. [2025-10-02T22:35:27.753945] [INFO ] [MAIN ] BIP: Loaded 39822 primary data records. [2025-10-02T22:35:27.954096] [DEBUG] [LOCAL ] BIPC: Loaded 41695 existing records from primary storage. [2025-10-02T22:35:27.987110] [INFO ] [MAIN ] BIPC: Loaded 41695 primary data records. [2025-10-02T22:35:28.317985] [DEBUG] [MAIN ] BIO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:28.336676] [INFO ] [MAIN ] BIO: Generated 1807 derivative records from 25067 primary records. [2025-10-02T22:35:28.342260] [DEBUG] [LOCAL ] BIO: Saving derivative data. [2025-10-02T22:35:28.540125] [DEBUG] [LOCAL ] BIO: Derivative data saved (1807 records). [2025-10-02T22:35:28.540383] [INFO ] [MAIN ] BIO: Successfully saved derivative data. [2025-10-02T22:35:28.542900] [INFO ] [MAIN ] Derivative Progress: 232/1975 symbols completed. BIO took 1.3s. Estimated remaining: 12m 25s. Rate: 140.3 symbols/min [2025-10-02T22:35:28.543210] [INFO ] [MAIN ] BIPI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:28.558695] [DEBUG] [MAIN ] BIP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:28.562310] [INFO ] [MAIN ] BIP: Generated 1807 derivative records from 39822 primary records. [2025-10-02T22:35:28.563073] [DEBUG] [LOCAL ] BIP: Saving derivative data. [2025-10-02T22:35:28.566338] [DEBUG] [LOCAL ] BIPI: Loaded 3215 existing records from primary storage. [2025-10-02T22:35:28.566814] [INFO ] [MAIN ] BIPI: Loaded 3215 primary data records. [2025-10-02T22:35:28.649054] [DEBUG] [LOCAL ] BIP: Derivative data saved (1807 records). [2025-10-02T22:35:28.664665] [INFO ] [MAIN ] BIP: Successfully saved derivative data. [2025-10-02T22:35:28.675689] [INFO ] [MAIN ] Derivative Progress: 233/1975 symbols completed. BIP took 1.3s. Estimated remaining: 12m 23s. Rate: 140.8 symbols/min [2025-10-02T22:35:28.706219] [INFO ] [MAIN ] BIPJ: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:28.809057] [DEBUG] [MAIN ] BIPC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:28.925911] [DEBUG] [LOCAL ] BIPJ: Loaded 3136 existing records from primary storage. [2025-10-02T22:35:28.925627] [INFO ] [MAIN ] BIPC: Generated 1807 derivative records from 41695 primary records. [2025-10-02T22:35:28.935681] [INFO ] [MAIN ] BIPJ: Loaded 3136 primary data records. [2025-10-02T22:35:28.935571] [DEBUG] [LOCAL ] BIPC: Saving derivative data. [2025-10-02T22:35:29.059423] [DEBUG] [LOCAL ] BIPC: Derivative data saved (1807 records). [2025-10-02T22:35:29.074035] [INFO ] [MAIN ] BIPC: Successfully saved derivative data. [2025-10-02T22:35:29.077014] [INFO ] [MAIN ] Derivative Progress: 234/1975 symbols completed. BIPC took 1.6s. Estimated remaining: 12m 22s. Rate: 140.8 symbols/min [2025-10-02T22:35:29.104186] [INFO ] [MAIN ] BIRK: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:29.315158] [DEBUG] [MAIN ] BIPI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:29.316591] [INFO ] [MAIN ] BIPI: Generated 1807 derivative records from 3215 primary records. [2025-10-02T22:35:29.317029] [DEBUG] [LOCAL ] BIPI: Saving derivative data. [2025-10-02T22:35:29.349717] [DEBUG] [LOCAL ] BIPI: Derivative data saved (1807 records). [2025-10-02T22:35:29.350205] [INFO ] [MAIN ] BIPI: Successfully saved derivative data. [2025-10-02T22:35:29.352742] [INFO ] [MAIN ] Derivative Progress: 235/1975 symbols completed. BIPI took 0.8s. Estimated remaining: 12m 20s. Rate: 141.0 symbols/min [2025-10-02T22:35:29.353410] [INFO ] [MAIN ] BIT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:29.373340] [DEBUG] [LOCAL ] BIRK: Loaded 51310 existing records from primary storage. [2025-10-02T22:35:29.373848] [INFO ] [MAIN ] BIRK: Loaded 51310 primary data records. [2025-10-02T22:35:29.433889] [DEBUG] [MAIN ] BIPJ: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-02T22:35:29.458592] [INFO ] [MAIN ] BIPJ: Generated 1806 derivative records from 3136 primary records. [2025-10-02T22:35:29.470374] [DEBUG] [LOCAL ] BIPJ: Saving derivative data. [2025-10-02T22:35:29.556068] [DEBUG] [LOCAL ] BIPJ: Derivative data saved (1806 records). [2025-10-02T22:35:29.562424] [INFO ] [MAIN ] BIPJ: Successfully saved derivative data. [2025-10-02T22:35:29.584375] [DEBUG] [LOCAL ] BIT: Loaded 23002 existing records from primary storage. [2025-10-02T22:35:29.604917] [INFO ] [MAIN ] BIT: Loaded 23002 primary data records. [2025-10-02T22:35:29.595932] [INFO ] [MAIN ] Derivative Progress: 236/1975 symbols completed. BIPJ took 0.9s. Estimated remaining: 12m 19s. Rate: 141.3 symbols/min [2025-10-02T22:35:29.731727] [INFO ] [MAIN ] BJ: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:30.139593] [DEBUG] [MAIN ] BIRK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:30.155240] [INFO ] [MAIN ] BIRK: Generated 1807 derivative records from 51310 primary records. [2025-10-02T22:35:30.155391] [DEBUG] [LOCAL ] BIRK: Saving derivative data. [2025-10-02T22:35:30.158173] [DEBUG] [LOCAL ] BJ: Loaded 51762 existing records from primary storage. [2025-10-02T22:35:30.158618] [INFO ] [MAIN ] BJ: Loaded 51762 primary data records. [2025-10-02T22:35:30.215387] [DEBUG] [LOCAL ] BIRK: Derivative data saved (1807 records). [2025-10-02T22:35:30.230892] [INFO ] [MAIN ] BIRK: Successfully saved derivative data. [2025-10-02T22:35:30.238345] [INFO ] [MAIN ] Derivative Progress: 237/1975 symbols completed. BIRK took 1.1s. Estimated remaining: 12m 20s. Rate: 141.0 symbols/min [2025-10-02T22:35:30.251912] [INFO ] [MAIN ] BK: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:30.520227] [DEBUG] [MAIN ] BIT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:30.576859] [INFO ] [MAIN ] BIT: Generated 1807 derivative records from 23002 primary records. [2025-10-02T22:35:30.586418] [DEBUG] [LOCAL ] BIT: Saving derivative data. [2025-10-02T22:35:30.622721] [DEBUG] [LOCAL ] BIT: Derivative data saved (1807 records). [2025-10-02T22:35:30.623128] [INFO ] [MAIN ] BIT: Successfully saved derivative data. [2025-10-02T22:35:30.625690] [INFO ] [MAIN ] Derivative Progress: 238/1975 symbols completed. BIT took 1.3s. Estimated remaining: 12m 19s. Rate: 141.0 symbols/min [2025-10-02T22:35:30.654765] [DEBUG] [LOCAL ] BK: Loaded 53927 existing records from primary storage. [2025-10-02T22:35:30.655089] [INFO ] [MAIN ] BK: Loaded 53927 primary data records. [2025-10-02T22:35:30.789861] [DEBUG] [MAIN ] BJ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:30.801485] [INFO ] [MAIN ] BJ: Generated 1807 derivative records from 51762 primary records. [2025-10-02T22:35:30.801621] [DEBUG] [LOCAL ] BJ: Saving derivative data. [2025-10-02T22:35:31.018461] [DEBUG] [LOCAL ] BJ: Derivative data saved (1807 records). [2025-10-02T22:35:31.018604] [INFO ] [MAIN ] BJ: Successfully saved derivative data. [2025-10-02T22:35:31.020930] [INFO ] [MAIN ] Derivative Progress: 239/1975 symbols completed. BJ took 1.3s. Estimated remaining: 12m 18s. Rate: 141.1 symbols/min [2025-10-02T22:35:31.044319] [DEBUG] [MAIN ] BK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:31.045061] [INFO ] [MAIN ] BK: Generated 1807 derivative records from 53927 primary records. [2025-10-02T22:35:31.045132] [DEBUG] [LOCAL ] BK: Saving derivative data. [2025-10-02T22:35:31.061786] [DEBUG] [LOCAL ] BK: Derivative data saved (1807 records). [2025-10-02T22:35:31.061857] [INFO ] [MAIN ] BK: Successfully saved derivative data. [2025-10-02T22:35:31.064414] [INFO ] [MAIN ] Derivative Progress: 240/1975 symbols completed. BK took 0.8s. Estimated remaining: 12m 15s. Rate: 141.6 symbols/min [2025-10-02T22:35:31.065235] [INFO ] [MAIN ] BKE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:31.065018] [INFO ] [MAIN ] BKD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:31.065124] [INFO ] [MAIN ] BKH: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:31.128106] [DEBUG] [LOCAL ] BKH: Loaded 36907 existing records from primary storage. [2025-10-02T22:35:31.138601] [INFO ] [MAIN ] BKH: Loaded 36907 primary data records. [2025-10-02T22:35:31.139177] [DEBUG] [LOCAL ] BKE: Loaded 34657 existing records from primary storage. [2025-10-02T22:35:31.139343] [INFO ] [MAIN ] BKE: Loaded 34657 primary data records. [2025-10-02T22:35:31.319008] [DEBUG] [LOCAL ] BKD: Loaded 50577 existing records from primary storage. [2025-10-02T22:35:31.379174] [INFO ] [MAIN ] BKD: Loaded 50577 primary data records. [2025-10-02T22:35:32.195200] [DEBUG] [MAIN ] BKE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:32.210148] [INFO ] [MAIN ] BKE: Generated 1807 derivative records from 34657 primary records. [2025-10-02T22:35:32.210769] [DEBUG] [LOCAL ] BKE: Saving derivative data. [2025-10-02T22:35:32.210512] [DEBUG] [MAIN ] BKH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:32.212263] [INFO ] [MAIN ] BKH: Generated 1807 derivative records from 36907 primary records. [2025-10-02T22:35:32.212487] [DEBUG] [LOCAL ] BKH: Saving derivative data. [2025-10-02T22:35:32.245189] [DEBUG] [LOCAL ] BKE: Derivative data saved (1807 records). [2025-10-02T22:35:32.246202] [INFO ] [MAIN ] BKE: Successfully saved derivative data. [2025-10-02T22:35:32.261785] [INFO ] [MAIN ] Derivative Progress: 241/1975 symbols completed. BKE took 1.2s. Estimated remaining: 12m 20s. Rate: 140.5 symbols/min [2025-10-02T22:35:32.263128] [INFO ] [MAIN ] BKKT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:32.266126] [DEBUG] [LOCAL ] BKH: Derivative data saved (1807 records). [2025-10-02T22:35:32.267023] [INFO ] [MAIN ] BKH: Successfully saved derivative data. [2025-10-02T22:35:32.269744] [INFO ] [MAIN ] Derivative Progress: 242/1975 symbols completed. BKH took 1.2s. Estimated remaining: 12m 17s. Rate: 141.1 symbols/min [2025-10-02T22:35:32.270002] [INFO ] [MAIN ] BKN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:32.267597] [DEBUG] [MAIN ] BKD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:32.271871] [INFO ] [MAIN ] BKD: Generated 1807 derivative records from 50577 primary records. [2025-10-02T22:35:32.272147] [DEBUG] [LOCAL ] BKD: Saving derivative data. [2025-10-02T22:35:32.294273] [DEBUG] [LOCAL ] BKN: Loaded 7808 existing records from primary storage. [2025-10-02T22:35:32.295695] [INFO ] [MAIN ] BKN: Loaded 7808 primary data records. [2025-10-02T22:35:32.374030] [DEBUG] [LOCAL ] BKD: Derivative data saved (1807 records). [2025-10-02T22:35:32.411167] [INFO ] [MAIN ] BKD: Successfully saved derivative data. [2025-10-02T22:35:32.424880] [INFO ] [MAIN ] Derivative Progress: 243/1975 symbols completed. BKD took 1.4s. Estimated remaining: 12m 15s. Rate: 141.5 symbols/min [2025-10-02T22:35:32.445947] [INFO ] [MAIN ] BKT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:32.445232] [DEBUG] [LOCAL ] BKKT: Loaded 35643 existing records from primary storage. [2025-10-02T22:35:32.462523] [INFO ] [MAIN ] BKKT: Loaded 35643 primary data records. [2025-10-02T22:35:32.707532] [DEBUG] [LOCAL ] BKT: Loaded 11524 existing records from primary storage. [2025-10-02T22:35:32.816820] [INFO ] [MAIN ] BKT: Loaded 11524 primary data records. [2025-10-02T22:35:33.449316] [DEBUG] [MAIN ] BKN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:33.450690] [INFO ] [MAIN ] BKN: Generated 1807 derivative records from 7808 primary records. [2025-10-02T22:35:33.450907] [DEBUG] [LOCAL ] BKN: Saving derivative data. [2025-10-02T22:35:33.489899] [DEBUG] [MAIN ] BKKT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:33.491549] [INFO ] [MAIN ] BKKT: Generated 1807 derivative records from 35643 primary records. [2025-10-02T22:35:33.500030] [DEBUG] [LOCAL ] BKKT: Saving derivative data. [2025-10-02T22:35:33.492055] [DEBUG] [LOCAL ] BKN: Derivative data saved (1807 records). [2025-10-02T22:35:33.505877] [INFO ] [MAIN ] BKN: Successfully saved derivative data. [2025-10-02T22:35:33.515034] [DEBUG] [MAIN ] BKT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:33.519952] [INFO ] [MAIN ] Derivative Progress: 244/1975 symbols completed. BKN took 1.2s. Estimated remaining: 12m 19s. Rate: 140.5 symbols/min [2025-10-02T22:35:33.520907] [INFO ] [MAIN ] BKT: Generated 1807 derivative records from 11524 primary records. [2025-10-02T22:35:33.521102] [INFO ] [MAIN ] BKU: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:33.521012] [DEBUG] [LOCAL ] BKT: Saving derivative data. [2025-10-02T22:35:33.538839] [DEBUG] [LOCAL ] BKKT: Derivative data saved (1807 records). [2025-10-02T22:35:33.541252] [INFO ] [MAIN ] BKKT: Successfully saved derivative data. [2025-10-02T22:35:33.544175] [INFO ] [MAIN ] Derivative Progress: 245/1975 symbols completed. BKKT took 1.3s. Estimated remaining: 12m 16s. Rate: 141.1 symbols/min [2025-10-02T22:35:33.545375] [INFO ] [MAIN ] BLCO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:33.546813] [DEBUG] [LOCAL ] BKT: Derivative data saved (1807 records). [2025-10-02T22:35:33.547382] [INFO ] [MAIN ] BKT: Successfully saved derivative data. [2025-10-02T22:35:33.550117] [INFO ] [MAIN ] Derivative Progress: 246/1975 symbols completed. BKT took 1.1s. Estimated remaining: 12m 12s. Rate: 141.7 symbols/min [2025-10-02T22:35:33.551822] [INFO ] [MAIN ] BLDR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:33.600513] [DEBUG] [LOCAL ] BKU: Loaded 41707 existing records from primary storage. [2025-10-02T22:35:33.600820] [INFO ] [MAIN ] BKU: Loaded 41707 primary data records. [2025-10-02T22:35:33.723711] [DEBUG] [LOCAL ] BLCO: Loaded 35657 existing records from primary storage. [2025-10-02T22:35:33.755164] [INFO ] [MAIN ] BLCO: Loaded 35657 primary data records. [2025-10-02T22:35:33.831530] [DEBUG] [LOCAL ] BLDR: Loaded 52007 existing records from primary storage. [2025-10-02T22:35:33.850214] [INFO ] [MAIN ] BLDR: Loaded 52007 primary data records. [2025-10-02T22:35:34.709437] [DEBUG] [MAIN ] BKU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:34.711142] [INFO ] [MAIN ] BKU: Generated 1807 derivative records from 41707 primary records. [2025-10-02T22:35:34.712055] [DEBUG] [LOCAL ] BKU: Saving derivative data. [2025-10-02T22:35:34.732290] [DEBUG] [LOCAL ] BKU: Derivative data saved (1807 records). [2025-10-02T22:35:34.732620] [INFO ] [MAIN ] BKU: Successfully saved derivative data. [2025-10-02T22:35:34.734879] [INFO ] [MAIN ] Derivative Progress: 247/1975 symbols completed. BKU took 1.2s. Estimated remaining: 12m 17s. Rate: 140.6 symbols/min [2025-10-02T22:35:34.735503] [INFO ] [MAIN ] BLE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:34.781569] [DEBUG] [MAIN ] BLCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:34.781231] [DEBUG] [MAIN ] BLDR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:34.783438] [INFO ] [MAIN ] BLCO: Generated 1807 derivative records from 35657 primary records. [2025-10-02T22:35:34.782682] [INFO ] [MAIN ] BLDR: Generated 1807 derivative records from 52007 primary records. [2025-10-02T22:35:34.783618] [DEBUG] [LOCAL ] BLDR: Saving derivative data. [2025-10-02T22:35:34.784771] [DEBUG] [LOCAL ] BLCO: Saving derivative data. [2025-10-02T22:35:34.802224] [DEBUG] [LOCAL ] BLE: Loaded 14402 existing records from primary storage. [2025-10-02T22:35:34.815323] [INFO ] [MAIN ] BLE: Loaded 14402 primary data records. [2025-10-02T22:35:34.901406] [DEBUG] [LOCAL ] BLCO: Derivative data saved (1807 records). [2025-10-02T22:35:34.907544] [INFO ] [MAIN ] BLCO: Successfully saved derivative data. [2025-10-02T22:35:34.918746] [INFO ] [MAIN ] Derivative Progress: 248/1975 symbols completed. BLCO took 1.4s. Estimated remaining: 12m 15s. Rate: 141.0 symbols/min [2025-10-02T22:35:34.925015] [DEBUG] [LOCAL ] BLDR: Derivative data saved (1807 records). [2025-10-02T22:35:34.924928] [INFO ] [MAIN ] BLK: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:34.925203] [INFO ] [MAIN ] BLDR: Successfully saved derivative data. [2025-10-02T22:35:34.941582] [INFO ] [MAIN ] Derivative Progress: 249/1975 symbols completed. BLDR took 1.4s. Estimated remaining: 12m 12s. Rate: 141.5 symbols/min [2025-10-02T22:35:34.941809] [INFO ] [MAIN ] BLND: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:35.250559] [DEBUG] [LOCAL ] BLK: Loaded 34684 existing records from primary storage. [2025-10-02T22:35:35.252357] [INFO ] [MAIN ] BLK: Loaded 34684 primary data records. [2025-10-02T22:35:35.380974] [DEBUG] [LOCAL ] BLND: Loaded 49624 existing records from primary storage. [2025-10-02T22:35:35.381487] [INFO ] [MAIN ] BLND: Loaded 49624 primary data records. [2025-10-02T22:35:35.611278] [DEBUG] [MAIN ] BLE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:35.724896] [INFO ] [MAIN ] BLE: Generated 1807 derivative records from 14402 primary records. [2025-10-02T22:35:35.725572] [DEBUG] [LOCAL ] BLE: Saving derivative data. [2025-10-02T22:35:35.957685] [DEBUG] [LOCAL ] BLE: Derivative data saved (1807 records). [2025-10-02T22:35:35.957904] [INFO ] [MAIN ] BLE: Successfully saved derivative data. [2025-10-02T22:35:35.960261] [INFO ] [MAIN ] Derivative Progress: 250/1975 symbols completed. BLE took 1.2s. Estimated remaining: 12m 16s. Rate: 140.7 symbols/min [2025-10-02T22:35:35.961163] [INFO ] [MAIN ] BLW: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:35.992374] [DEBUG] [LOCAL ] BLW: Loaded 13258 existing records from primary storage. [2025-10-02T22:35:35.997842] [INFO ] [MAIN ] BLW: Loaded 13258 primary data records. [2025-10-02T22:35:35.998151] [DEBUG] [MAIN ] BLK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:36.012441] [INFO ] [MAIN ] BLK: Generated 1807 derivative records from 34684 primary records. [2025-10-02T22:35:36.039190] [DEBUG] [LOCAL ] BLK: Saving derivative data. [2025-10-02T22:35:36.105161] [DEBUG] [MAIN ] BLND: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:36.124212] [INFO ] [MAIN ] BLND: Generated 1807 derivative records from 49624 primary records. [2025-10-02T22:35:36.148818] [DEBUG] [LOCAL ] BLND: Saving derivative data. [2025-10-02T22:35:36.183301] [DEBUG] [LOCAL ] BLK: Derivative data saved (1807 records). [2025-10-02T22:35:36.198354] [INFO ] [MAIN ] BLK: Successfully saved derivative data. [2025-10-02T22:35:36.251065] [INFO ] [MAIN ] Derivative Progress: 251/1975 symbols completed. BLK took 1.3s. Estimated remaining: 12m 14s. Rate: 140.9 symbols/min [2025-10-02T22:35:36.257957] [INFO ] [MAIN ] BLX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:36.385212] [DEBUG] [LOCAL ] BLND: Derivative data saved (1807 records). [2025-10-02T22:35:36.385881] [INFO ] [MAIN ] BLND: Successfully saved derivative data. [2025-10-02T22:35:36.389032] [INFO ] [MAIN ] Derivative Progress: 252/1975 symbols completed. BLND took 1.4s. Estimated remaining: 12m 12s. Rate: 141.3 symbols/min [2025-10-02T22:35:36.389260] [INFO ] [MAIN ] BMA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:36.409191] [DEBUG] [LOCAL ] BLX: Loaded 15738 existing records from primary storage. [2025-10-02T22:35:36.409357] [INFO ] [MAIN ] BLX: Loaded 15738 primary data records. [2025-10-02T22:35:36.588787] [DEBUG] [LOCAL ] BMA: Loaded 35644 existing records from primary storage. [2025-10-02T22:35:36.601066] [INFO ] [MAIN ] BMA: Loaded 35644 primary data records. [2025-10-02T22:35:36.902571] [DEBUG] [MAIN ] BLW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:36.924329] [INFO ] [MAIN ] BLW: Generated 1807 derivative records from 13258 primary records. [2025-10-02T22:35:36.925510] [DEBUG] [LOCAL ] BLW: Saving derivative data. [2025-10-02T22:35:37.212838] [DEBUG] [LOCAL ] BLW: Derivative data saved (1807 records). [2025-10-02T22:35:37.213379] [INFO ] [MAIN ] BLW: Successfully saved derivative data. [2025-10-02T22:35:37.216810] [INFO ] [MAIN ] Derivative Progress: 253/1975 symbols completed. BLW took 1.3s. Estimated remaining: 12m 14s. Rate: 140.7 symbols/min [2025-10-02T22:35:37.237261] [DEBUG] [MAIN ] BLX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:37.238166] [INFO ] [MAIN ] BLX: Generated 1807 derivative records from 15738 primary records. [2025-10-02T22:35:37.238439] [DEBUG] [LOCAL ] BLX: Saving derivative data. [2025-10-02T22:35:37.275515] [DEBUG] [LOCAL ] BLX: Derivative data saved (1807 records). [2025-10-02T22:35:37.275866] [DEBUG] [MAIN ] BMA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:37.276005] [INFO ] [MAIN ] BLX: Successfully saved derivative data. [2025-10-02T22:35:37.278189] [INFO ] [MAIN ] Derivative Progress: 254/1975 symbols completed. BLX took 1.0s. Estimated remaining: 12m 11s. Rate: 141.2 symbols/min [2025-10-02T22:35:37.279023] [INFO ] [MAIN ] BMA: Generated 1807 derivative records from 35644 primary records. [2025-10-02T22:35:37.279238] [DEBUG] [LOCAL ] BMA: Saving derivative data. [2025-10-02T22:35:37.294742] [DEBUG] [LOCAL ] BMA: Derivative data saved (1807 records). [2025-10-02T22:35:37.294805] [INFO ] [MAIN ] BMA: Successfully saved derivative data. [2025-10-02T22:35:37.297314] [INFO ] [MAIN ] Derivative Progress: 255/1975 symbols completed. BMA took 0.9s. Estimated remaining: 12m 8s. Rate: 141.7 symbols/min [2025-10-02T22:35:37.297789] [INFO ] [MAIN ] BME: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:37.297965] [INFO ] [MAIN ] BMI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:37.298009] [INFO ] [MAIN ] BMEZ: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:37.312629] [DEBUG] [LOCAL ] BME: Loaded 11009 existing records from primary storage. [2025-10-02T22:35:37.312788] [INFO ] [MAIN ] BME: Loaded 11009 primary data records. [2025-10-02T22:35:37.460405] [DEBUG] [LOCAL ] BMEZ: Loaded 26437 existing records from primary storage. [2025-10-02T22:35:37.460950] [DEBUG] [LOCAL ] BMI: Loaded 24385 existing records from primary storage. [2025-10-02T22:35:37.461334] [INFO ] [MAIN ] BMEZ: Loaded 26437 primary data records. [2025-10-02T22:35:37.477008] [INFO ] [MAIN ] BMI: Loaded 24385 primary data records. [2025-10-02T22:35:38.346058] [DEBUG] [MAIN ] BME: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:38.347203] [INFO ] [MAIN ] BME: Generated 1807 derivative records from 11009 primary records. [2025-10-02T22:35:38.347711] [DEBUG] [LOCAL ] BME: Saving derivative data. [2025-10-02T22:35:38.370398] [DEBUG] [LOCAL ] BME: Derivative data saved (1807 records). [2025-10-02T22:35:38.378283] [INFO ] [MAIN ] BME: Successfully saved derivative data. [2025-10-02T22:35:38.386120] [DEBUG] [MAIN ] BMEZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:38.385058] [INFO ] [MAIN ] Derivative Progress: 256/1975 symbols completed. BME took 1.1s. Estimated remaining: 12m 12s. Rate: 140.9 symbols/min [2025-10-02T22:35:38.386548] [INFO ] [MAIN ] BMN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:38.399997] [INFO ] [MAIN ] BMEZ: Generated 1807 derivative records from 26437 primary records. [2025-10-02T22:35:38.400573] [DEBUG] [LOCAL ] BMEZ: Saving derivative data. [2025-10-02T22:35:38.401366] [DEBUG] [MAIN ] BMI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:38.402386] [INFO ] [MAIN ] BMI: Generated 1807 derivative records from 24385 primary records. [2025-10-02T22:35:38.402805] [DEBUG] [LOCAL ] BMI: Saving derivative data. [2025-10-02T22:35:38.430546] [DEBUG] [LOCAL ] BMN: Loaded 2594 existing records from primary storage. [2025-10-02T22:35:38.432357] [INFO ] [MAIN ] BMN: Loaded 2594 primary data records. [2025-10-02T22:35:38.462148] [DEBUG] [LOCAL ] BMI: Derivative data saved (1807 records). [2025-10-02T22:35:38.475688] [INFO ] [MAIN ] BMI: Successfully saved derivative data. [2025-10-02T22:35:38.491283] [INFO ] [MAIN ] Derivative Progress: 257/1975 symbols completed. BMI took 1.2s. Estimated remaining: 12m 10s. Rate: 141.3 symbols/min [2025-10-02T22:35:38.497313] [INFO ] [MAIN ] BMO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:38.530118] [DEBUG] [LOCAL ] BMEZ: Derivative data saved (1807 records). [2025-10-02T22:35:38.540850] [INFO ] [MAIN ] BMEZ: Successfully saved derivative data. [2025-10-02T22:35:38.551253] [INFO ] [MAIN ] Derivative Progress: 258/1975 symbols completed. BMEZ took 1.3s. Estimated remaining: 12m 7s. Rate: 141.8 symbols/min [2025-10-02T22:35:38.560300] [INFO ] [MAIN ] BMY: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:38.841452] [DEBUG] [LOCAL ] BMO: Loaded 41494 existing records from primary storage. [2025-10-02T22:35:38.842673] [INFO ] [MAIN ] BMO: Loaded 41494 primary data records. [2025-10-02T22:35:38.928606] [DEBUG] [LOCAL ] BMY: Loaded 54147 existing records from primary storage. [2025-10-02T22:35:38.954613] [INFO ] [MAIN ] BMY: Loaded 54147 primary data records. [2025-10-02T22:35:39.394691] [DEBUG] [MAIN ] BMN: Filtered 6966 bins outside market hours, 7765 incomplete bins [2025-10-02T22:35:39.434488] [INFO ] [MAIN ] BMN: Generated 1801 derivative records from 2594 primary records. [2025-10-02T22:35:39.459627] [DEBUG] [LOCAL ] BMN: Saving derivative data. [2025-10-02T22:35:39.607298] [DEBUG] [LOCAL ] BMN: Derivative data saved (1801 records). [2025-10-02T22:35:39.608218] [INFO ] [MAIN ] BMN: Successfully saved derivative data. [2025-10-02T22:35:39.610677] [INFO ] [MAIN ] Derivative Progress: 259/1975 symbols completed. BMN took 1.2s. Estimated remaining: 12m 10s. Rate: 140.9 symbols/min [2025-10-02T22:35:39.611010] [INFO ] [MAIN ] BN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:39.637994] [DEBUG] [MAIN ] BMO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:39.641147] [INFO ] [MAIN ] BMO: Generated 1807 derivative records from 41494 primary records. [2025-10-02T22:35:39.641243] [DEBUG] [LOCAL ] BMO: Saving derivative data. [2025-10-02T22:35:39.665429] [DEBUG] [MAIN ] BMY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:39.674173] [DEBUG] [LOCAL ] BMO: Derivative data saved (1807 records). [2025-10-02T22:35:39.674382] [INFO ] [MAIN ] BMO: Successfully saved derivative data. [2025-10-02T22:35:39.671959] [INFO ] [MAIN ] BMY: Generated 1807 derivative records from 54147 primary records. [2025-10-02T22:35:39.676458] [INFO ] [MAIN ] Derivative Progress: 260/1975 symbols completed. BMO took 1.2s. Estimated remaining: 12m 8s. Rate: 141.4 symbols/min [2025-10-02T22:35:39.676909] [INFO ] [MAIN ] BNED: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:39.676700] [DEBUG] [LOCAL ] BMY: Saving derivative data. [2025-10-02T22:35:39.713896] [DEBUG] [LOCAL ] BMY: Derivative data saved (1807 records). [2025-10-02T22:35:39.714027] [INFO ] [MAIN ] BMY: Successfully saved derivative data. [2025-10-02T22:35:39.716510] [INFO ] [MAIN ] Derivative Progress: 261/1975 symbols completed. BMY took 1.2s. Estimated remaining: 12m 5s. Rate: 141.9 symbols/min [2025-10-02T22:35:39.716822] [INFO ] [MAIN ] BNH: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:39.741557] [DEBUG] [LOCAL ] BN: Loaded 53383 existing records from primary storage. [2025-10-02T22:35:39.743365] [INFO ] [MAIN ] BN: Loaded 53383 primary data records. [2025-10-02T22:35:39.852889] [DEBUG] [LOCAL ] BNED: Loaded 29657 existing records from primary storage. [2025-10-02T22:35:39.869828] [INFO ] [MAIN ] BNED: Loaded 29657 primary data records. [2025-10-02T22:35:39.833358] [DEBUG] [LOCAL ] BNH: Loaded 5161 existing records from primary storage. [2025-10-02T22:35:39.874682] [INFO ] [MAIN ] BNH: Loaded 5161 primary data records. [2025-10-02T22:35:40.776844] [DEBUG] [MAIN ] BN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:40.777869] [INFO ] [MAIN ] BN: Generated 1807 derivative records from 53383 primary records. [2025-10-02T22:35:40.780450] [DEBUG] [LOCAL ] BN: Saving derivative data. [2025-10-02T22:35:40.812790] [DEBUG] [MAIN ] BNH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:40.815893] [DEBUG] [LOCAL ] BN: Derivative data saved (1807 records). [2025-10-02T22:35:40.816874] [INFO ] [MAIN ] BNH: Generated 1807 derivative records from 5161 primary records. [2025-10-02T22:35:40.824500] [INFO ] [MAIN ] BN: Successfully saved derivative data. [2025-10-02T22:35:40.824583] [DEBUG] [LOCAL ] BNH: Saving derivative data. [2025-10-02T22:35:40.827084] [INFO ] [MAIN ] Derivative Progress: 262/1975 symbols completed. BN took 1.2s. Estimated remaining: 12m 9s. Rate: 141.0 symbols/min [2025-10-02T22:35:40.833422] [INFO ] [MAIN ] BNL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:40.834188] [DEBUG] [MAIN ] BNED: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:40.842014] [INFO ] [MAIN ] BNED: Generated 1807 derivative records from 29657 primary records. [2025-10-02T22:35:40.846085] [DEBUG] [LOCAL ] BNED: Saving derivative data. [2025-10-02T22:35:40.864155] [DEBUG] [LOCAL ] BNH: Derivative data saved (1807 records). [2025-10-02T22:35:40.866289] [INFO ] [MAIN ] BNH: Successfully saved derivative data. [2025-10-02T22:35:40.868845] [INFO ] [MAIN ] Derivative Progress: 263/1975 symbols completed. BNH took 1.2s. Estimated remaining: 12m 6s. Rate: 141.5 symbols/min [2025-10-02T22:35:40.872087] [INFO ] [MAIN ] BNS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:40.874399] [DEBUG] [LOCAL ] BNED: Derivative data saved (1807 records). [2025-10-02T22:35:40.874512] [INFO ] [MAIN ] BNED: Successfully saved derivative data. [2025-10-02T22:35:40.876746] [INFO ] [MAIN ] Derivative Progress: 264/1975 symbols completed. BNED took 1.2s. Estimated remaining: 12m 3s. Rate: 142.0 symbols/min [2025-10-02T22:35:40.877399] [INFO ] [MAIN ] BNT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:40.896407] [DEBUG] [LOCAL ] BNT: Loaded 3393 existing records from primary storage. [2025-10-02T22:35:40.896756] [INFO ] [MAIN ] BNT: Loaded 3393 primary data records. [2025-10-02T22:35:41.022429] [DEBUG] [LOCAL ] BNL: Loaded 47291 existing records from primary storage. [2025-10-02T22:35:41.040516] [INFO ] [MAIN ] BNL: Loaded 47291 primary data records. [2025-10-02T22:35:41.368207] [DEBUG] [LOCAL ] BNS: Loaded 51859 existing records from primary storage. [2025-10-02T22:35:41.386594] [INFO ] [MAIN ] BNS: Loaded 51859 primary data records. [2025-10-02T22:35:42.021786] [DEBUG] [MAIN ] BNT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:42.023448] [INFO ] [MAIN ] BNT: Generated 1807 derivative records from 3393 primary records. [2025-10-02T22:35:42.023763] [DEBUG] [LOCAL ] BNT: Saving derivative data. [2025-10-02T22:35:42.047347] [DEBUG] [LOCAL ] BNT: Derivative data saved (1807 records). [2025-10-02T22:35:42.047804] [INFO ] [MAIN ] BNT: Successfully saved derivative data. [2025-10-02T22:35:42.050480] [INFO ] [MAIN ] Derivative Progress: 265/1975 symbols completed. BNT took 1.2s. Estimated remaining: 12m 7s. Rate: 141.1 symbols/min [2025-10-02T22:35:42.050971] [INFO ] [MAIN ] BNY: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:42.065429] [DEBUG] [MAIN ] BNL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:42.066508] [INFO ] [MAIN ] BNL: Generated 1807 derivative records from 47291 primary records. [2025-10-02T22:35:42.066720] [DEBUG] [LOCAL ] BNL: Saving derivative data. [2025-10-02T22:35:42.093400] [DEBUG] [LOCAL ] BNY: Loaded 7174 existing records from primary storage. [2025-10-02T22:35:42.094278] [INFO ] [MAIN ] BNY: Loaded 7174 primary data records. [2025-10-02T22:35:42.107540] [DEBUG] [LOCAL ] BNL: Derivative data saved (1807 records). [2025-10-02T22:35:42.138726] [INFO ] [MAIN ] BNL: Successfully saved derivative data. [2025-10-02T22:35:42.151668] [INFO ] [MAIN ] Derivative Progress: 266/1975 symbols completed. BNL took 1.3s. Estimated remaining: 12m 5s. Rate: 141.5 symbols/min [2025-10-02T22:35:42.174927] [INFO ] [MAIN ] BOC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:42.157678] [DEBUG] [MAIN ] BNS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:42.209919] [INFO ] [MAIN ] BNS: Generated 1807 derivative records from 51859 primary records. [2025-10-02T22:35:42.220568] [DEBUG] [LOCAL ] BNS: Saving derivative data. [2025-10-02T22:35:42.366473] [DEBUG] [LOCAL ] BNS: Derivative data saved (1807 records). [2025-10-02T22:35:42.488845] [DEBUG] [LOCAL ] BOC: Loaded 18384 existing records from primary storage. [2025-10-02T22:35:42.498613] [INFO ] [MAIN ] BNS: Successfully saved derivative data. [2025-10-02T22:35:42.501167] [INFO ] [MAIN ] Derivative Progress: 267/1975 symbols completed. BNS took 1.6s. Estimated remaining: 12m 4s. Rate: 141.6 symbols/min [2025-10-02T22:35:42.501347] [INFO ] [MAIN ] BOE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:42.498521] [INFO ] [MAIN ] BOC: Loaded 18384 primary data records. [2025-10-02T22:35:42.655339] [DEBUG] [LOCAL ] BOE: Loaded 17889 existing records from primary storage. [2025-10-02T22:35:42.676483] [INFO ] [MAIN ] BOE: Loaded 17889 primary data records. [2025-10-02T22:35:43.013003] [DEBUG] [MAIN ] BNY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:43.031912] [INFO ] [MAIN ] BNY: Generated 1807 derivative records from 7174 primary records. [2025-10-02T22:35:43.074190] [DEBUG] [LOCAL ] BNY: Saving derivative data. [2025-10-02T22:35:43.219186] [DEBUG] [LOCAL ] BNY: Derivative data saved (1807 records). [2025-10-02T22:35:43.220281] [INFO ] [MAIN ] BNY: Successfully saved derivative data. [2025-10-02T22:35:43.222614] [INFO ] [MAIN ] Derivative Progress: 268/1975 symbols completed. BNY took 1.2s. Estimated remaining: 12m 5s. Rate: 141.2 symbols/min [2025-10-02T22:35:43.239378] [DEBUG] [MAIN ] BOC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:43.240179] [INFO ] [MAIN ] BOC: Generated 1807 derivative records from 18384 primary records. [2025-10-02T22:35:43.240336] [DEBUG] [LOCAL ] BOC: Saving derivative data. [2025-10-02T22:35:43.273221] [DEBUG] [LOCAL ] BOC: Derivative data saved (1807 records). [2025-10-02T22:35:43.273752] [INFO ] [MAIN ] BOC: Successfully saved derivative data. [2025-10-02T22:35:43.273689] [DEBUG] [MAIN ] BOE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:43.276010] [INFO ] [MAIN ] Derivative Progress: 269/1975 symbols completed. BOC took 1.1s. Estimated remaining: 12m 2s. Rate: 141.7 symbols/min [2025-10-02T22:35:43.276897] [INFO ] [MAIN ] BOE: Generated 1807 derivative records from 17889 primary records. [2025-10-02T22:35:43.276967] [DEBUG] [LOCAL ] BOE: Saving derivative data. [2025-10-02T22:35:43.292467] [DEBUG] [LOCAL ] BOE: Derivative data saved (1807 records). [2025-10-02T22:35:43.292532] [INFO ] [MAIN ] BOE: Successfully saved derivative data. [2025-10-02T22:35:43.294927] [INFO ] [MAIN ] Derivative Progress: 270/1975 symbols completed. BOE took 0.8s. Estimated remaining: 11m 59s. Rate: 142.2 symbols/min [2025-10-02T22:35:43.295326] [INFO ] [MAIN ] BOND: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:43.295466] [INFO ] [MAIN ] BOH: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:43.295590] [INFO ] [MAIN ] BOOT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:43.356918] [DEBUG] [LOCAL ] BOH: Loaded 30959 existing records from primary storage. [2025-10-02T22:35:43.357496] [INFO ] [MAIN ] BOH: Loaded 30959 primary data records. [2025-10-02T22:35:43.358091] [DEBUG] [LOCAL ] BOND: Loaded 32444 existing records from primary storage. [2025-10-02T22:35:43.369954] [INFO ] [MAIN ] BOND: Loaded 32444 primary data records. [2025-10-02T22:35:43.417167] [DEBUG] [LOCAL ] BOOT: Loaded 40795 existing records from primary storage. [2025-10-02T22:35:43.479404] [INFO ] [MAIN ] BOOT: Loaded 40795 primary data records. [2025-10-02T22:35:44.433170] [DEBUG] [MAIN ] BOH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:44.448525] [DEBUG] [MAIN ] BOND: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-02T22:35:44.442274] [INFO ] [MAIN ] BOH: Generated 1807 derivative records from 30959 primary records. [2025-10-02T22:35:44.450003] [INFO ] [MAIN ] BOND: Generated 1806 derivative records from 32444 primary records. [2025-10-02T22:35:44.449214] [DEBUG] [LOCAL ] BOH: Saving derivative data. [2025-10-02T22:35:44.450101] [DEBUG] [LOCAL ] BOND: Saving derivative data. [2025-10-02T22:35:44.495850] [DEBUG] [MAIN ] BOOT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:44.497952] [DEBUG] [LOCAL ] BOH: Derivative data saved (1807 records). [2025-10-02T22:35:44.498070] [DEBUG] [LOCAL ] BOND: Derivative data saved (1806 records). [2025-10-02T22:35:44.497856] [INFO ] [MAIN ] BOOT: Generated 1807 derivative records from 40795 primary records. [2025-10-02T22:35:44.498196] [INFO ] [MAIN ] BOH: Successfully saved derivative data. [2025-10-02T22:35:44.498440] [DEBUG] [LOCAL ] BOOT: Saving derivative data. [2025-10-02T22:35:44.500751] [INFO ] [MAIN ] Derivative Progress: 271/1975 symbols completed. BOH took 1.2s. Estimated remaining: 12m 4s. Rate: 141.2 symbols/min [2025-10-02T22:35:44.498326] [INFO ] [MAIN ] BOND: Successfully saved derivative data. [2025-10-02T22:35:44.500912] [INFO ] [MAIN ] BORR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:44.504093] [INFO ] [MAIN ] Derivative Progress: 272/1975 symbols completed. BOND took 1.2s. Estimated remaining: 12m 1s. Rate: 141.7 symbols/min [2025-10-02T22:35:44.504921] [INFO ] [MAIN ] BOW: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:44.522811] [DEBUG] [LOCAL ] BOOT: Derivative data saved (1807 records). [2025-10-02T22:35:44.523066] [INFO ] [MAIN ] BOOT: Successfully saved derivative data. [2025-10-02T22:35:44.525473] [INFO ] [MAIN ] Derivative Progress: 273/1975 symbols completed. BOOT took 1.2s. Estimated remaining: 11m 58s. Rate: 142.2 symbols/min [2025-10-02T22:35:44.525777] [INFO ] [MAIN ] BOX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:44.565492] [DEBUG] [LOCAL ] BOW: Loaded 23861 existing records from primary storage. [2025-10-02T22:35:44.565777] [INFO ] [MAIN ] BOW: Loaded 23861 primary data records. [2025-10-02T22:35:44.642263] [DEBUG] [LOCAL ] BORR: Loaded 51498 existing records from primary storage. [2025-10-02T22:35:44.642404] [INFO ] [MAIN ] BORR: Loaded 51498 primary data records. [2025-10-02T22:35:44.884040] [DEBUG] [LOCAL ] BOX: Loaded 50593 existing records from primary storage. [2025-10-02T22:35:44.919767] [INFO ] [MAIN ] BOX: Loaded 50593 primary data records. [2025-10-02T22:35:45.699615] [DEBUG] [MAIN ] BOW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:45.701102] [INFO ] [MAIN ] BOW: Generated 1807 derivative records from 23861 primary records. [2025-10-02T22:35:45.701326] [DEBUG] [LOCAL ] BOW: Saving derivative data. [2025-10-02T22:35:45.723860] [DEBUG] [MAIN ] BORR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:45.729539] [INFO ] [MAIN ] BORR: Generated 1807 derivative records from 51498 primary records. [2025-10-02T22:35:45.730119] [DEBUG] [LOCAL ] BORR: Saving derivative data. [2025-10-02T22:35:45.750780] [DEBUG] [LOCAL ] BOW: Derivative data saved (1807 records). [2025-10-02T22:35:45.751526] [INFO ] [MAIN ] BOW: Successfully saved derivative data. [2025-10-02T22:35:45.754472] [INFO ] [MAIN ] Derivative Progress: 274/1975 symbols completed. BOW took 1.2s. Estimated remaining: 12m 3s. Rate: 141.2 symbols/min [2025-10-02T22:35:45.769203] [INFO ] [MAIN ] BP: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:45.769808] [DEBUG] [MAIN ] BOX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:45.771607] [INFO ] [MAIN ] BOX: Generated 1807 derivative records from 50593 primary records. [2025-10-02T22:35:45.771727] [DEBUG] [LOCAL ] BOX: Saving derivative data. [2025-10-02T22:35:45.774320] [DEBUG] [LOCAL ] BORR: Derivative data saved (1807 records). [2025-10-02T22:35:45.782202] [INFO ] [MAIN ] BORR: Successfully saved derivative data. [2025-10-02T22:35:45.784803] [INFO ] [MAIN ] Derivative Progress: 275/1975 symbols completed. BORR took 1.3s. Estimated remaining: 11m 60s. Rate: 141.7 symbols/min [2025-10-02T22:35:45.790226] [INFO ] [MAIN ] BR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:45.793902] [DEBUG] [LOCAL ] BOX: Derivative data saved (1807 records). [2025-10-02T22:35:45.794105] [INFO ] [MAIN ] BOX: Successfully saved derivative data. [2025-10-02T22:35:45.796612] [INFO ] [MAIN ] Derivative Progress: 276/1975 symbols completed. BOX took 1.3s. Estimated remaining: 11m 57s. Rate: 142.2 symbols/min [2025-10-02T22:35:45.796837] [INFO ] [MAIN ] BRBR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:45.876895] [DEBUG] [LOCAL ] BR: Loaded 34933 existing records from primary storage. [2025-10-02T22:35:45.877135] [INFO ] [MAIN ] BR: Loaded 34933 primary data records. [2025-10-02T22:35:45.878623] [DEBUG] [LOCAL ] BP: Loaded 54101 existing records from primary storage. [2025-10-02T22:35:45.883944] [INFO ] [MAIN ] BP: Loaded 54101 primary data records. [2025-10-02T22:35:46.134112] [DEBUG] [LOCAL ] BRBR: Loaded 51682 existing records from primary storage. [2025-10-02T22:35:46.160844] [INFO ] [MAIN ] BRBR: Loaded 51682 primary data records. [2025-10-02T22:35:46.959333] [DEBUG] [MAIN ] BR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:46.961751] [INFO ] [MAIN ] BR: Generated 1807 derivative records from 34933 primary records. [2025-10-02T22:35:46.961968] [DEBUG] [LOCAL ] BR: Saving derivative data. [2025-10-02T22:35:46.976164] [DEBUG] [MAIN ] BP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:46.978113] [INFO ] [MAIN ] BP: Generated 1807 derivative records from 54101 primary records. [2025-10-02T22:35:46.978414] [DEBUG] [LOCAL ] BP: Saving derivative data. [2025-10-02T22:35:47.009613] [DEBUG] [LOCAL ] BR: Derivative data saved (1807 records). [2025-10-02T22:35:47.012525] [INFO ] [MAIN ] BR: Successfully saved derivative data. [2025-10-02T22:35:47.016803] [INFO ] [MAIN ] Derivative Progress: 277/1975 symbols completed. BR took 1.2s. Estimated remaining: 12m 1s. Rate: 141.3 symbols/min [2025-10-02T22:35:47.017107] [INFO ] [MAIN ] BRC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:47.018914] [DEBUG] [LOCAL ] BP: Derivative data saved (1807 records). [2025-10-02T22:35:47.019306] [INFO ] [MAIN ] BP: Successfully saved derivative data. [2025-10-02T22:35:47.023097] [INFO ] [MAIN ] Derivative Progress: 278/1975 symbols completed. BP took 1.3s. Estimated remaining: 11m 58s. Rate: 141.8 symbols/min [2025-10-02T22:35:47.024348] [INFO ] [MAIN ] BRCC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:47.038212] [DEBUG] [MAIN ] BRBR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:47.039160] [INFO ] [MAIN ] BRBR: Generated 1807 derivative records from 51682 primary records. [2025-10-02T22:35:47.039277] [DEBUG] [LOCAL ] BRBR: Saving derivative data. [2025-10-02T22:35:47.072460] [DEBUG] [LOCAL ] BRC: Loaded 19152 existing records from primary storage. [2025-10-02T22:35:47.073395] [DEBUG] [LOCAL ] BRBR: Derivative data saved (1807 records). [2025-10-02T22:35:47.073340] [INFO ] [MAIN ] BRC: Loaded 19152 primary data records. [2025-10-02T22:35:47.073597] [INFO ] [MAIN ] BRBR: Successfully saved derivative data. [2025-10-02T22:35:47.111406] [INFO ] [MAIN ] Derivative Progress: 279/1975 symbols completed. BRBR took 1.3s. Estimated remaining: 11m 56s. Rate: 142.2 symbols/min [2025-10-02T22:35:47.137734] [INFO ] [MAIN ] BRO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:47.265362] [DEBUG] [LOCAL ] BRCC: Loaded 40474 existing records from primary storage. [2025-10-02T22:35:47.306817] [INFO ] [MAIN ] BRCC: Loaded 40474 primary data records. [2025-10-02T22:35:47.839775] [DEBUG] [LOCAL ] BRO: Loaded 52266 existing records from primary storage. [2025-10-02T22:35:47.840427] [INFO ] [MAIN ] BRO: Loaded 52266 primary data records. [2025-10-02T22:35:47.999726] [DEBUG] [MAIN ] BRC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:48.154032] [INFO ] [MAIN ] BRC: Generated 1807 derivative records from 19152 primary records. [2025-10-02T22:35:48.191861] [DEBUG] [LOCAL ] BRC: Saving derivative data. [2025-10-02T22:35:48.211675] [DEBUG] [LOCAL ] BRC: Derivative data saved (1807 records). [2025-10-02T22:35:48.212752] [INFO ] [MAIN ] BRC: Successfully saved derivative data. [2025-10-02T22:35:48.216475] [INFO ] [MAIN ] Derivative Progress: 280/1975 symbols completed. BRC took 1.2s. Estimated remaining: 11m 60s. Rate: 141.3 symbols/min [2025-10-02T22:35:48.218897] [INFO ] [MAIN ] BROS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:48.234597] [DEBUG] [MAIN ] BRCC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:48.235801] [INFO ] [MAIN ] BRCC: Generated 1807 derivative records from 40474 primary records. [2025-10-02T22:35:48.236102] [DEBUG] [LOCAL ] BRCC: Saving derivative data. [2025-10-02T22:35:48.257700] [DEBUG] [LOCAL ] BRCC: Derivative data saved (1807 records). [2025-10-02T22:35:48.259443] [INFO ] [MAIN ] BRCC: Successfully saved derivative data. [2025-10-02T22:35:48.263011] [INFO ] [MAIN ] Derivative Progress: 281/1975 symbols completed. BRCC took 1.2s. Estimated remaining: 11m 57s. Rate: 141.8 symbols/min [2025-10-02T22:35:48.263370] [INFO ] [MAIN ] BRW: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:48.278547] [DEBUG] [MAIN ] BRO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:48.279366] [INFO ] [MAIN ] BRO: Generated 1807 derivative records from 52266 primary records. [2025-10-02T22:35:48.279543] [DEBUG] [LOCAL ] BRO: Saving derivative data. [2025-10-02T22:35:48.296816] [DEBUG] [LOCAL ] BRO: Derivative data saved (1807 records). [2025-10-02T22:35:48.314467] [INFO ] [MAIN ] BRO: Successfully saved derivative data. [2025-10-02T22:35:48.317039] [INFO ] [MAIN ] Derivative Progress: 282/1975 symbols completed. BRO took 1.2s. Estimated remaining: 11m 54s. Rate: 142.2 symbols/min [2025-10-02T22:35:48.317386] [INFO ] [MAIN ] BRX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:48.327163] [DEBUG] [LOCAL ] BRW: Loaded 20369 existing records from primary storage. [2025-10-02T22:35:48.327322] [INFO ] [MAIN ] BRW: Loaded 20369 primary data records. [2025-10-02T22:35:48.458461] [DEBUG] [LOCAL ] BROS: Loaded 53681 existing records from primary storage. [2025-10-02T22:35:48.463476] [INFO ] [MAIN ] BROS: Loaded 53681 primary data records. [2025-10-02T22:35:48.872550] [DEBUG] [LOCAL ] BRX: Loaded 52084 existing records from primary storage. [2025-10-02T22:35:48.923025] [INFO ] [MAIN ] BRX: Loaded 52084 primary data records. [2025-10-02T22:35:49.409905] [DEBUG] [MAIN ] BRW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:49.413326] [INFO ] [MAIN ] BRW: Generated 1807 derivative records from 20369 primary records. [2025-10-02T22:35:49.414477] [DEBUG] [LOCAL ] BRW: Saving derivative data. [2025-10-02T22:35:49.444113] [DEBUG] [MAIN ] BROS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:49.448935] [INFO ] [MAIN ] BROS: Generated 1807 derivative records from 53681 primary records. [2025-10-02T22:35:49.449205] [DEBUG] [LOCAL ] BROS: Saving derivative data. [2025-10-02T22:35:49.447970] [DEBUG] [LOCAL ] BRW: Derivative data saved (1807 records). [2025-10-02T22:35:49.449326] [INFO ] [MAIN ] BRW: Successfully saved derivative data. [2025-10-02T22:35:49.452926] [INFO ] [MAIN ] Derivative Progress: 283/1975 symbols completed. BRW took 1.2s. Estimated remaining: 11m 58s. Rate: 141.4 symbols/min [2025-10-02T22:35:49.470375] [DEBUG] [LOCAL ] BROS: Derivative data saved (1807 records). [2025-10-02T22:35:49.470613] [INFO ] [MAIN ] BROS: Successfully saved derivative data. [2025-10-02T22:35:49.473889] [INFO ] [MAIN ] Derivative Progress: 284/1975 symbols completed. BROS took 1.3s. Estimated remaining: 11m 55s. Rate: 141.9 symbols/min [2025-10-02T22:35:49.491578] [DEBUG] [MAIN ] BRX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:49.492319] [INFO ] [MAIN ] BRX: Generated 1807 derivative records from 52084 primary records. [2025-10-02T22:35:49.492382] [DEBUG] [LOCAL ] BRX: Saving derivative data. [2025-10-02T22:35:49.509341] [DEBUG] [LOCAL ] BRX: Derivative data saved (1807 records). [2025-10-02T22:35:49.509483] [INFO ] [MAIN ] BRX: Successfully saved derivative data. [2025-10-02T22:35:49.511775] [INFO ] [MAIN ] Derivative Progress: 285/1975 symbols completed. BRX took 1.2s. Estimated remaining: 11m 52s. Rate: 142.3 symbols/min [2025-10-02T22:35:49.512333] [INFO ] [MAIN ] BSBR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:49.512462] [INFO ] [MAIN ] BSX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:49.512242] [INFO ] [MAIN ] BSAC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:49.583427] [DEBUG] [LOCAL ] BSAC: Loaded 33243 existing records from primary storage. [2025-10-02T22:35:49.584302] [INFO ] [MAIN ] BSAC: Loaded 33243 primary data records. [2025-10-02T22:35:49.584088] [DEBUG] [LOCAL ] BSBR: Loaded 35696 existing records from primary storage. [2025-10-02T22:35:49.592408] [INFO ] [MAIN ] BSBR: Loaded 35696 primary data records. [2025-10-02T22:35:49.816096] [DEBUG] [LOCAL ] BSX: Loaded 54078 existing records from primary storage. [2025-10-02T22:35:49.841422] [INFO ] [MAIN ] BSX: Loaded 54078 primary data records. [2025-10-02T22:35:50.691779] [DEBUG] [MAIN ] BSAC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:50.692943] [INFO ] [MAIN ] BSAC: Generated 1807 derivative records from 33243 primary records. [2025-10-02T22:35:50.693013] [DEBUG] [LOCAL ] BSAC: Saving derivative data. [2025-10-02T22:35:50.725155] [DEBUG] [MAIN ] BSBR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:50.742292] [INFO ] [MAIN ] BSBR: Generated 1807 derivative records from 35696 primary records. [2025-10-02T22:35:50.742854] [DEBUG] [LOCAL ] BSBR: Saving derivative data. [2025-10-02T22:35:50.742712] [DEBUG] [MAIN ] BSX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:50.746763] [INFO ] [MAIN ] BSX: Generated 1807 derivative records from 54078 primary records. [2025-10-02T22:35:50.754245] [DEBUG] [LOCAL ] BSX: Saving derivative data. [2025-10-02T22:35:50.757608] [DEBUG] [LOCAL ] BSAC: Derivative data saved (1807 records). [2025-10-02T22:35:50.760577] [INFO ] [MAIN ] BSAC: Successfully saved derivative data. [2025-10-02T22:35:50.762579] [INFO ] [MAIN ] Derivative Progress: 286/1975 symbols completed. BSAC took 1.3s. Estimated remaining: 11m 57s. Rate: 141.3 symbols/min [2025-10-02T22:35:50.764595] [INFO ] [MAIN ] BTCM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:50.783105] [DEBUG] [LOCAL ] BSBR: Derivative data saved (1807 records). [2025-10-02T22:35:50.785365] [DEBUG] [LOCAL ] BSX: Derivative data saved (1807 records). [2025-10-02T22:35:50.785611] [INFO ] [MAIN ] BSBR: Successfully saved derivative data. [2025-10-02T22:35:50.789316] [INFO ] [MAIN ] BSX: Successfully saved derivative data. [2025-10-02T22:35:50.789198] [INFO ] [MAIN ] Derivative Progress: 287/1975 symbols completed. BSBR took 1.3s. Estimated remaining: 11m 54s. Rate: 141.8 symbols/min [2025-10-02T22:35:50.791908] [INFO ] [MAIN ] BTE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:50.792035] [INFO ] [MAIN ] Derivative Progress: 288/1975 symbols completed. BSX took 1.3s. Estimated remaining: 11m 51s. Rate: 142.3 symbols/min [2025-10-02T22:35:50.792204] [INFO ] [MAIN ] BTI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:50.810065] [DEBUG] [LOCAL ] BTCM: Loaded 15505 existing records from primary storage. [2025-10-02T22:35:50.810235] [INFO ] [MAIN ] BTCM: Loaded 15505 primary data records. [2025-10-02T22:35:51.202166] [DEBUG] [LOCAL ] BTI: Loaded 53946 existing records from primary storage. [2025-10-02T22:35:51.217249] [INFO ] [MAIN ] BTI: Loaded 53946 primary data records. [2025-10-02T22:35:51.223968] [DEBUG] [LOCAL ] BTE: Loaded 53107 existing records from primary storage. [2025-10-02T22:35:51.241922] [INFO ] [MAIN ] BTE: Loaded 53107 primary data records. [2025-10-02T22:35:51.890885] [DEBUG] [MAIN ] BTCM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:51.892667] [INFO ] [MAIN ] BTCM: Generated 1807 derivative records from 15505 primary records. [2025-10-02T22:35:51.893355] [DEBUG] [LOCAL ] BTCM: Saving derivative data. [2025-10-02T22:35:51.910872] [DEBUG] [LOCAL ] BTCM: Derivative data saved (1807 records). [2025-10-02T22:35:51.911875] [INFO ] [MAIN ] BTCM: Successfully saved derivative data. [2025-10-02T22:35:51.914498] [INFO ] [MAIN ] Derivative Progress: 289/1975 symbols completed. BTCM took 1.1s. Estimated remaining: 11m 55s. Rate: 141.5 symbols/min [2025-10-02T22:35:51.914906] [INFO ] [MAIN ] BTO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:51.960418] [DEBUG] [MAIN ] BTE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:51.961536] [INFO ] [MAIN ] BTE: Generated 1807 derivative records from 53107 primary records. [2025-10-02T22:35:51.959912] [DEBUG] [MAIN ] BTI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:51.966162] [INFO ] [MAIN ] BTI: Generated 1807 derivative records from 53946 primary records. [2025-10-02T22:35:51.966312] [DEBUG] [LOCAL ] BTE: Saving derivative data. [2025-10-02T22:35:51.966672] [DEBUG] [LOCAL ] BTI: Saving derivative data. [2025-10-02T22:35:51.966591] [DEBUG] [LOCAL ] BTO: Loaded 8811 existing records from primary storage. [2025-10-02T22:35:51.966804] [INFO ] [MAIN ] BTO: Loaded 8811 primary data records. [2025-10-02T22:35:52.047959] [DEBUG] [LOCAL ] BTI: Derivative data saved (1807 records). [2025-10-02T22:35:52.085072] [INFO ] [MAIN ] BTI: Successfully saved derivative data. [2025-10-02T22:35:52.094604] [INFO ] [MAIN ] Derivative Progress: 290/1975 symbols completed. BTI took 1.3s. Estimated remaining: 11m 53s. Rate: 141.8 symbols/min [2025-10-02T22:35:52.111449] [INFO ] [MAIN ] BTZ: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:52.112055] [DEBUG] [LOCAL ] BTE: Derivative data saved (1807 records). [2025-10-02T22:35:52.116993] [INFO ] [MAIN ] BTE: Successfully saved derivative data. [2025-10-02T22:35:52.119886] [INFO ] [MAIN ] Derivative Progress: 291/1975 symbols completed. BTE took 1.3s. Estimated remaining: 11m 50s. Rate: 142.2 symbols/min [2025-10-02T22:35:52.120102] [INFO ] [MAIN ] BUR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:52.380209] [DEBUG] [LOCAL ] BTZ: Loaded 22996 existing records from primary storage. [2025-10-02T22:35:52.381108] [INFO ] [MAIN ] BTZ: Loaded 22996 primary data records. [2025-10-02T22:35:52.595011] [DEBUG] [LOCAL ] BUR: Loaded 45456 existing records from primary storage. [2025-10-02T22:35:52.620580] [INFO ] [MAIN ] BUR: Loaded 45456 primary data records. [2025-10-02T22:35:53.128123] [DEBUG] [MAIN ] BTO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:53.130422] [INFO ] [MAIN ] BTO: Generated 1807 derivative records from 8811 primary records. [2025-10-02T22:35:53.130512] [DEBUG] [LOCAL ] BTO: Saving derivative data. [2025-10-02T22:35:53.150622] [DEBUG] [LOCAL ] BTO: Derivative data saved (1807 records). [2025-10-02T22:35:53.151667] [INFO ] [MAIN ] BTO: Successfully saved derivative data. [2025-10-02T22:35:53.154155] [INFO ] [MAIN ] Derivative Progress: 292/1975 symbols completed. BTO took 1.2s. Estimated remaining: 11m 54s. Rate: 141.5 symbols/min [2025-10-02T22:35:53.154570] [INFO ] [MAIN ] BURL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:53.173990] [DEBUG] [MAIN ] BTZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:53.175037] [INFO ] [MAIN ] BTZ: Generated 1807 derivative records from 22996 primary records. [2025-10-02T22:35:53.175407] [DEBUG] [LOCAL ] BTZ: Saving derivative data. [2025-10-02T22:35:53.193794] [DEBUG] [LOCAL ] BTZ: Derivative data saved (1807 records). [2025-10-02T22:35:53.193939] [INFO ] [MAIN ] BTZ: Successfully saved derivative data. [2025-10-02T22:35:53.196510] [INFO ] [MAIN ] Derivative Progress: 293/1975 symbols completed. BTZ took 1.1s. Estimated remaining: 11m 51s. Rate: 142.0 symbols/min [2025-10-02T22:35:53.197455] [INFO ] [MAIN ] BUXX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:53.235585] [DEBUG] [MAIN ] BUR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:53.240302] [INFO ] [MAIN ] BUR: Generated 1807 derivative records from 45456 primary records. [2025-10-02T22:35:53.240500] [DEBUG] [LOCAL ] BUR: Saving derivative data. [2025-10-02T22:35:53.276052] [DEBUG] [LOCAL ] BUXX: Loaded 15276 existing records from primary storage. [2025-10-02T22:35:53.278270] [INFO ] [MAIN ] BUXX: Loaded 15276 primary data records. [2025-10-02T22:35:53.278409] [DEBUG] [LOCAL ] BUR: Derivative data saved (1807 records). [2025-10-02T22:35:53.278620] [INFO ] [MAIN ] BUR: Successfully saved derivative data. [2025-10-02T22:35:53.297278] [DEBUG] [LOCAL ] BURL: Loaded 46323 existing records from primary storage. [2025-10-02T22:35:53.303580] [INFO ] [MAIN ] BURL: Loaded 46323 primary data records. [2025-10-02T22:35:53.306775] [INFO ] [MAIN ] Derivative Progress: 294/1975 symbols completed. BUR took 1.2s. Estimated remaining: 11m 49s. Rate: 142.3 symbols/min [2025-10-02T22:35:53.306960] [INFO ] [MAIN ] BV: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:54.004118] [DEBUG] [LOCAL ] BV: Loaded 38582 existing records from primary storage. [2025-10-02T22:35:54.004864] [INFO ] [MAIN ] BV: Loaded 38582 primary data records. [2025-10-02T22:35:54.426186] [DEBUG] [MAIN ] BURL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:54.428090] [INFO ] [MAIN ] BURL: Generated 1807 derivative records from 46323 primary records. [2025-10-02T22:35:54.441399] [DEBUG] [LOCAL ] BURL: Saving derivative data. [2025-10-02T22:35:54.443106] [DEBUG] [MAIN ] BUXX: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-02T22:35:54.444293] [INFO ] [MAIN ] BUXX: Generated 1806 derivative records from 15276 primary records. [2025-10-02T22:35:54.444416] [DEBUG] [LOCAL ] BUXX: Saving derivative data. [2025-10-02T22:35:54.473383] [DEBUG] [LOCAL ] BURL: Derivative data saved (1807 records). [2025-10-02T22:35:54.480431] [INFO ] [MAIN ] BURL: Successfully saved derivative data. [2025-10-02T22:35:54.482824] [INFO ] [MAIN ] Derivative Progress: 295/1975 symbols completed. BURL took 1.3s. Estimated remaining: 11m 53s. Rate: 141.5 symbols/min [2025-10-02T22:35:54.483979] [INFO ] [MAIN ] BVN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:54.483497] [DEBUG] [LOCAL ] BUXX: Derivative data saved (1806 records). [2025-10-02T22:35:54.484550] [INFO ] [MAIN ] BUXX: Successfully saved derivative data. [2025-10-02T22:35:54.487500] [INFO ] [MAIN ] Derivative Progress: 296/1975 symbols completed. BUXX took 1.3s. Estimated remaining: 11m 50s. Rate: 141.9 symbols/min [2025-10-02T22:35:54.488109] [INFO ] [MAIN ] BW: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:54.506801] [DEBUG] [MAIN ] BV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:54.507615] [INFO ] [MAIN ] BV: Generated 1807 derivative records from 38582 primary records. [2025-10-02T22:35:54.508100] [DEBUG] [LOCAL ] BV: Saving derivative data. [2025-10-02T22:35:54.546267] [DEBUG] [LOCAL ] BV: Derivative data saved (1807 records). [2025-10-02T22:35:54.546466] [INFO ] [MAIN ] BV: Successfully saved derivative data. [2025-10-02T22:35:54.548670] [INFO ] [MAIN ] Derivative Progress: 297/1975 symbols completed. BV took 1.2s. Estimated remaining: 11m 47s. Rate: 142.3 symbols/min [2025-10-02T22:35:54.548938] [INFO ] [MAIN ] BWA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:54.566794] [DEBUG] [LOCAL ] BW: Loaded 40202 existing records from primary storage. [2025-10-02T22:35:54.582832] [INFO ] [MAIN ] BW: Loaded 40202 primary data records. [2025-10-02T22:35:54.583759] [DEBUG] [LOCAL ] BVN: Loaded 44365 existing records from primary storage. [2025-10-02T22:35:54.589222] [INFO ] [MAIN ] BVN: Loaded 44365 primary data records. [2025-10-02T22:35:55.312846] [DEBUG] [LOCAL ] BWA: Loaded 52569 existing records from primary storage. [2025-10-02T22:35:55.314234] [INFO ] [MAIN ] BWA: Loaded 52569 primary data records. [2025-10-02T22:35:55.691940] [DEBUG] [MAIN ] BW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:55.707538] [INFO ] [MAIN ] BW: Generated 1807 derivative records from 40202 primary records. [2025-10-02T22:35:55.707722] [DEBUG] [LOCAL ] BW: Saving derivative data. [2025-10-02T22:35:55.706566] [DEBUG] [MAIN ] BVN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:55.717417] [INFO ] [MAIN ] BVN: Generated 1807 derivative records from 44365 primary records. [2025-10-02T22:35:55.722233] [DEBUG] [LOCAL ] BVN: Saving derivative data. [2025-10-02T22:35:55.728448] [DEBUG] [LOCAL ] BW: Derivative data saved (1807 records). [2025-10-02T22:35:55.736059] [INFO ] [MAIN ] BW: Successfully saved derivative data. [2025-10-02T22:35:55.738912] [INFO ] [MAIN ] Derivative Progress: 298/1975 symbols completed. BW took 1.3s. Estimated remaining: 11m 51s. Rate: 141.5 symbols/min [2025-10-02T22:35:55.749507] [DEBUG] [LOCAL ] BVN: Derivative data saved (1807 records). [2025-10-02T22:35:55.749633] [INFO ] [MAIN ] BVN: Successfully saved derivative data. [2025-10-02T22:35:55.752675] [INFO ] [MAIN ] Derivative Progress: 299/1975 symbols completed. BVN took 1.3s. Estimated remaining: 11m 48s. Rate: 141.9 symbols/min [2025-10-02T22:35:55.766266] [DEBUG] [MAIN ] BWA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:55.766969] [INFO ] [MAIN ] BWA: Generated 1807 derivative records from 52569 primary records. [2025-10-02T22:35:55.767034] [DEBUG] [LOCAL ] BWA: Saving derivative data. [2025-10-02T22:35:55.784107] [DEBUG] [LOCAL ] BWA: Derivative data saved (1807 records). [2025-10-02T22:35:55.784175] [INFO ] [MAIN ] BWA: Successfully saved derivative data. [2025-10-02T22:35:55.786622] [INFO ] [MAIN ] Derivative Progress: 300/1975 symbols completed. BWA took 1.2s. Estimated remaining: 11m 46s. Rate: 142.4 symbols/min [2025-10-02T22:35:55.787159] [INFO ] [MAIN ] BWG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:55.787293] [INFO ] [MAIN ] BWLP: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:55.787378] [INFO ] [MAIN ] BWMX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:55.803477] [DEBUG] [LOCAL ] BWMX: Loaded 7725 existing records from primary storage. [2025-10-02T22:35:55.803715] [INFO ] [MAIN ] BWMX: Loaded 7725 primary data records. [2025-10-02T22:35:55.856859] [DEBUG] [LOCAL ] BWG: Loaded 12660 existing records from primary storage. [2025-10-02T22:35:55.885476] [INFO ] [MAIN ] BWG: Loaded 12660 primary data records. [2025-10-02T22:35:56.128334] [DEBUG] [LOCAL ] BWLP: Loaded 32667 existing records from primary storage. [2025-10-02T22:35:56.155139] [INFO ] [MAIN ] BWLP: Loaded 32667 primary data records. [2025-10-02T22:35:56.891862] [DEBUG] [MAIN ] BWMX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:56.893056] [INFO ] [MAIN ] BWMX: Generated 1807 derivative records from 7725 primary records. [2025-10-02T22:35:56.893168] [DEBUG] [LOCAL ] BWMX: Saving derivative data. [2025-10-02T22:35:56.922695] [DEBUG] [MAIN ] BWG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:56.924424] [INFO ] [MAIN ] BWG: Generated 1807 derivative records from 12660 primary records. [2025-10-02T22:35:56.924826] [DEBUG] [LOCAL ] BWG: Saving derivative data. [2025-10-02T22:35:56.942879] [DEBUG] [LOCAL ] BWMX: Derivative data saved (1807 records). [2025-10-02T22:35:56.945187] [INFO ] [MAIN ] BWMX: Successfully saved derivative data. [2025-10-02T22:35:56.947560] [INFO ] [MAIN ] Derivative Progress: 301/1975 symbols completed. BWMX took 1.2s. Estimated remaining: 11m 50s. Rate: 141.5 symbols/min [2025-10-02T22:35:56.948489] [DEBUG] [LOCAL ] BWG: Derivative data saved (1807 records). [2025-10-02T22:35:56.948981] [INFO ] [MAIN ] BWG: Successfully saved derivative data. [2025-10-02T22:35:56.964252] [INFO ] [MAIN ] Derivative Progress: 302/1975 symbols completed. BWG took 1.2s. Estimated remaining: 11m 47s. Rate: 142.0 symbols/min [2025-10-02T22:35:56.961579] [INFO ] [MAIN ] BWNB: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:56.964555] [INFO ] [MAIN ] BWSN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:56.965742] [DEBUG] [MAIN ] BWLP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:56.966405] [INFO ] [MAIN ] BWLP: Generated 1807 derivative records from 32667 primary records. [2025-10-02T22:35:56.966618] [DEBUG] [LOCAL ] BWLP: Saving derivative data. [2025-10-02T22:35:56.989539] [DEBUG] [LOCAL ] BWLP: Derivative data saved (1807 records). [2025-10-02T22:35:56.988595] [DEBUG] [LOCAL ] BWSN: Loaded 5127 existing records from primary storage. [2025-10-02T22:35:56.989788] [INFO ] [MAIN ] BWSN: Loaded 5127 primary data records. [2025-10-02T22:35:56.995053] [INFO ] [MAIN ] BWLP: Successfully saved derivative data. [2025-10-02T22:35:57.004616] [DEBUG] [LOCAL ] BWNB: Loaded 4466 existing records from primary storage. [2025-10-02T22:35:57.012406] [INFO ] [MAIN ] Derivative Progress: 303/1975 symbols completed. BWLP took 1.2s. Estimated remaining: 11m 44s. Rate: 142.4 symbols/min [2025-10-02T22:35:57.029875] [INFO ] [MAIN ] BWNB: Loaded 4466 primary data records. [2025-10-02T22:35:57.030011] [INFO ] [MAIN ] BWXT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:57.675131] [DEBUG] [LOCAL ] BWXT: Loaded 47232 existing records from primary storage. [2025-10-02T22:35:57.676009] [INFO ] [MAIN ] BWXT: Loaded 47232 primary data records. [2025-10-02T22:35:58.029418] [DEBUG] [MAIN ] BWSN: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-02T22:35:58.031166] [INFO ] [MAIN ] BWSN: Generated 1806 derivative records from 5127 primary records. [2025-10-02T22:35:58.031783] [DEBUG] [LOCAL ] BWSN: Saving derivative data. [2025-10-02T22:35:58.063222] [DEBUG] [MAIN ] BWNB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:58.067445] [INFO ] [MAIN ] BWNB: Generated 1807 derivative records from 4466 primary records. [2025-10-02T22:35:58.067858] [DEBUG] [LOCAL ] BWNB: Saving derivative data. [2025-10-02T22:35:58.068444] [DEBUG] [LOCAL ] BWSN: Derivative data saved (1806 records). [2025-10-02T22:35:58.069610] [INFO ] [MAIN ] BWSN: Successfully saved derivative data. [2025-10-02T22:35:58.083018] [INFO ] [MAIN ] Derivative Progress: 304/1975 symbols completed. BWSN took 1.1s. Estimated remaining: 11m 48s. Rate: 141.7 symbols/min [2025-10-02T22:35:58.084034] [INFO ] [MAIN ] BX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:58.090071] [DEBUG] [LOCAL ] BWNB: Derivative data saved (1807 records). [2025-10-02T22:35:58.090187] [INFO ] [MAIN ] BWNB: Successfully saved derivative data. [2025-10-02T22:35:58.092756] [INFO ] [MAIN ] Derivative Progress: 305/1975 symbols completed. BWNB took 1.1s. Estimated remaining: 11m 45s. Rate: 142.2 symbols/min [2025-10-02T22:35:58.093019] [INFO ] [MAIN ] BXC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:58.118324] [DEBUG] [MAIN ] BWXT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:58.126285] [INFO ] [MAIN ] BWXT: Generated 1807 derivative records from 47232 primary records. [2025-10-02T22:35:58.126384] [DEBUG] [LOCAL ] BWXT: Saving derivative data. [2025-10-02T22:35:58.125446] [DEBUG] [LOCAL ] BXC: Loaded 13732 existing records from primary storage. [2025-10-02T22:35:58.127010] [INFO ] [MAIN ] BXC: Loaded 13732 primary data records. [2025-10-02T22:35:58.273421] [DEBUG] [LOCAL ] BWXT: Derivative data saved (1807 records). [2025-10-02T22:35:58.278973] [INFO ] [MAIN ] BWXT: Successfully saved derivative data. [2025-10-02T22:35:58.296719] [INFO ] [MAIN ] Derivative Progress: 306/1975 symbols completed. BWXT took 1.3s. Estimated remaining: 11m 43s. Rate: 142.4 symbols/min [2025-10-02T22:35:58.312527] [INFO ] [MAIN ] BXMT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:58.343045] [DEBUG] [LOCAL ] BX: Loaded 53877 existing records from primary storage. [2025-10-02T22:35:58.361411] [INFO ] [MAIN ] BX: Loaded 53877 primary data records. [2025-10-02T22:35:58.923757] [DEBUG] [LOCAL ] BXMT: Loaded 47578 existing records from primary storage. [2025-10-02T22:35:58.924347] [INFO ] [MAIN ] BXMT: Loaded 47578 primary data records. [2025-10-02T22:35:59.108406] [DEBUG] [MAIN ] BXC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:59.146860] [INFO ] [MAIN ] BXC: Generated 1807 derivative records from 13732 primary records. [2025-10-02T22:35:59.272163] [DEBUG] [LOCAL ] BXC: Saving derivative data. [2025-10-02T22:35:59.293298] [DEBUG] [LOCAL ] BXC: Derivative data saved (1807 records). [2025-10-02T22:35:59.294251] [INFO ] [MAIN ] BXC: Successfully saved derivative data. [2025-10-02T22:35:59.296665] [INFO ] [MAIN ] Derivative Progress: 307/1975 symbols completed. BXC took 1.2s. Estimated remaining: 11m 46s. Rate: 141.8 symbols/min [2025-10-02T22:35:59.296904] [INFO ] [MAIN ] BXMX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:59.313402] [DEBUG] [MAIN ] BX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:59.314229] [INFO ] [MAIN ] BX: Generated 1807 derivative records from 53877 primary records. [2025-10-02T22:35:59.314448] [DEBUG] [LOCAL ] BX: Saving derivative data. [2025-10-02T22:35:59.340390] [DEBUG] [LOCAL ] BX: Derivative data saved (1807 records). [2025-10-02T22:35:59.340617] [INFO ] [MAIN ] BX: Successfully saved derivative data. [2025-10-02T22:35:59.343259] [INFO ] [MAIN ] Derivative Progress: 308/1975 symbols completed. BX took 1.3s. Estimated remaining: 11m 44s. Rate: 142.2 symbols/min [2025-10-02T22:35:59.343756] [INFO ] [MAIN ] BXP: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:35:59.352391] [DEBUG] [LOCAL ] BXMX: Loaded 19738 existing records from primary storage. [2025-10-02T22:35:59.352560] [INFO ] [MAIN ] BXMX: Loaded 19738 primary data records. [2025-10-02T22:35:59.495858] [DEBUG] [MAIN ] BXMT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:35:59.513754] [INFO ] [MAIN ] BXMT: Generated 1807 derivative records from 47578 primary records. [2025-10-02T22:35:59.537637] [DEBUG] [LOCAL ] BXMT: Saving derivative data. [2025-10-02T22:35:59.745982] [DEBUG] [LOCAL ] BXMT: Derivative data saved (1807 records). [2025-10-02T22:35:59.746995] [INFO ] [MAIN ] BXMT: Successfully saved derivative data. [2025-10-02T22:35:59.749621] [INFO ] [MAIN ] Derivative Progress: 309/1975 symbols completed. BXMT took 1.4s. Estimated remaining: 11m 43s. Rate: 142.2 symbols/min [2025-10-02T22:35:59.751532] [DEBUG] [LOCAL ] BXP: Loaded 50225 existing records from primary storage. [2025-10-02T22:35:59.752023] [INFO ] [MAIN ] BXP: Loaded 50225 primary data records. [2025-10-02T22:35:59.752754] [INFO ] [MAIN ] BXSL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:00.136707] [DEBUG] [LOCAL ] BXSL: Loaded 48025 existing records from primary storage. [2025-10-02T22:36:00.137462] [INFO ] [MAIN ] BXSL: Loaded 48025 primary data records. [2025-10-02T22:36:00.211109] [DEBUG] [MAIN ] BXMX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:00.228201] [INFO ] [MAIN ] BXMX: Generated 1807 derivative records from 19738 primary records. [2025-10-02T22:36:00.228353] [DEBUG] [LOCAL ] BXMX: Saving derivative data. [2025-10-02T22:36:00.322252] [DEBUG] [LOCAL ] BXMX: Derivative data saved (1807 records). [2025-10-02T22:36:00.327597] [INFO ] [MAIN ] BXMX: Successfully saved derivative data. [2025-10-02T22:36:00.340231] [INFO ] [MAIN ] Derivative Progress: 310/1975 symbols completed. BXMX took 1.0s. Estimated remaining: 11m 44s. Rate: 142.0 symbols/min [2025-10-02T22:36:00.345572] [INFO ] [MAIN ] BY: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:00.578817] [DEBUG] [MAIN ] BXP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:00.586515] [DEBUG] [LOCAL ] BY: Loaded 21841 existing records from primary storage. [2025-10-02T22:36:00.586839] [INFO ] [MAIN ] BY: Loaded 21841 primary data records. [2025-10-02T22:36:00.587875] [INFO ] [MAIN ] BXP: Generated 1807 derivative records from 50225 primary records. [2025-10-02T22:36:00.588423] [DEBUG] [LOCAL ] BXP: Saving derivative data. [2025-10-02T22:36:00.686078] [DEBUG] [LOCAL ] BXP: Derivative data saved (1807 records). [2025-10-02T22:36:00.686484] [INFO ] [MAIN ] BXP: Successfully saved derivative data. [2025-10-02T22:36:00.699238] [INFO ] [MAIN ] Derivative Progress: 311/1975 symbols completed. BXP took 1.4s. Estimated remaining: 11m 43s. Rate: 142.1 symbols/min [2025-10-02T22:36:00.705762] [INFO ] [MAIN ] BYD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:00.986728] [DEBUG] [MAIN ] BXSL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:00.987552] [INFO ] [MAIN ] BXSL: Generated 1807 derivative records from 48025 primary records. [2025-10-02T22:36:00.988686] [DEBUG] [LOCAL ] BXSL: Saving derivative data. [2025-10-02T22:36:01.019584] [DEBUG] [LOCAL ] BXSL: Derivative data saved (1807 records). [2025-10-02T22:36:01.020471] [INFO ] [MAIN ] BXSL: Successfully saved derivative data. [2025-10-02T22:36:01.035678] [INFO ] [MAIN ] Derivative Progress: 312/1975 symbols completed. BXSL took 1.3s. Estimated remaining: 11m 42s. Rate: 142.2 symbols/min [2025-10-02T22:36:01.038297] [INFO ] [MAIN ] BZH: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:01.039279] [DEBUG] [LOCAL ] BYD: Loaded 45277 existing records from primary storage. [2025-10-02T22:36:01.040086] [INFO ] [MAIN ] BYD: Loaded 45277 primary data records. [2025-10-02T22:36:01.288539] [DEBUG] [LOCAL ] BZH: Loaded 32621 existing records from primary storage. [2025-10-02T22:36:01.294335] [DEBUG] [MAIN ] BY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:01.294386] [INFO ] [MAIN ] BZH: Loaded 32621 primary data records. [2025-10-02T22:36:01.439351] [INFO ] [MAIN ] BY: Generated 1807 derivative records from 21841 primary records. [2025-10-02T22:36:01.475638] [DEBUG] [LOCAL ] BY: Saving derivative data. [2025-10-02T22:36:01.603251] [DEBUG] [LOCAL ] BY: Derivative data saved (1807 records). [2025-10-02T22:36:01.603725] [INFO ] [MAIN ] BY: Successfully saved derivative data. [2025-10-02T22:36:01.606557] [INFO ] [MAIN ] Derivative Progress: 313/1975 symbols completed. BY took 1.3s. Estimated remaining: 11m 42s. Rate: 142.0 symbols/min [2025-10-02T22:36:01.850163] [DEBUG] [MAIN ] BYD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:01.852133] [INFO ] [MAIN ] BYD: Generated 1807 derivative records from 45277 primary records. [2025-10-02T22:36:01.852476] [DEBUG] [LOCAL ] BYD: Saving derivative data. [2025-10-02T22:36:01.870984] [DEBUG] [LOCAL ] BYD: Derivative data saved (1807 records). [2025-10-02T22:36:01.871821] [INFO ] [MAIN ] BYD: Successfully saved derivative data. [2025-10-02T22:36:01.874544] [INFO ] [MAIN ] Derivative Progress: 314/1975 symbols completed. BYD took 1.2s. Estimated remaining: 11m 41s. Rate: 142.2 symbols/min [2025-10-02T22:36:01.892483] [DEBUG] [MAIN ] BZH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:01.893148] [INFO ] [MAIN ] BZH: Generated 1807 derivative records from 32621 primary records. [2025-10-02T22:36:01.893212] [DEBUG] [LOCAL ] BZH: Saving derivative data. [2025-10-02T22:36:01.908669] [DEBUG] [LOCAL ] BZH: Derivative data saved (1807 records). [2025-10-02T22:36:01.908747] [INFO ] [MAIN ] BZH: Successfully saved derivative data. [2025-10-02T22:36:01.911055] [INFO ] [MAIN ] Derivative Progress: 315/1975 symbols completed. BZH took 0.9s. Estimated remaining: 11m 39s. Rate: 142.6 symbols/min [2025-10-02T22:36:01.911719] [INFO ] [MAIN ] C: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:01.911784] [INFO ] [MAIN ] CAAP: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:01.912143] [INFO ] [MAIN ] CABO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:01.940224] [DEBUG] [LOCAL ] CAAP: Loaded 20146 existing records from primary storage. [2025-10-02T22:36:01.947489] [INFO ] [MAIN ] CAAP: Loaded 20146 primary data records. [2025-10-02T22:36:01.947416] [DEBUG] [LOCAL ] CABO: Loaded 17118 existing records from primary storage. [2025-10-02T22:36:01.947716] [INFO ] [MAIN ] CABO: Loaded 17118 primary data records. [2025-10-02T22:36:02.276780] [DEBUG] [LOCAL ] C: Loaded 54130 existing records from primary storage. [2025-10-02T22:36:02.282662] [INFO ] [MAIN ] C: Loaded 54130 primary data records. [2025-10-02T22:36:03.086766] [DEBUG] [MAIN ] CAAP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:03.100531] [INFO ] [MAIN ] CAAP: Generated 1807 derivative records from 20146 primary records. [2025-10-02T22:36:03.101607] [DEBUG] [LOCAL ] CAAP: Saving derivative data. [2025-10-02T22:36:03.101424] [DEBUG] [MAIN ] CABO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:03.103718] [INFO ] [MAIN ] CABO: Generated 1807 derivative records from 17118 primary records. [2025-10-02T22:36:03.103831] [DEBUG] [LOCAL ] CABO: Saving derivative data. [2025-10-02T22:36:03.153531] [DEBUG] [LOCAL ] CABO: Derivative data saved (1807 records). [2025-10-02T22:36:03.154089] [DEBUG] [MAIN ] C: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:03.153119] [DEBUG] [LOCAL ] CAAP: Derivative data saved (1807 records). [2025-10-02T22:36:03.155032] [INFO ] [MAIN ] C: Generated 1807 derivative records from 54130 primary records. [2025-10-02T22:36:03.154312] [INFO ] [MAIN ] CABO: Successfully saved derivative data. [2025-10-02T22:36:03.157464] [INFO ] [MAIN ] Derivative Progress: 316/1975 symbols completed. CABO took 1.2s. Estimated remaining: 11m 42s. Rate: 141.7 symbols/min [2025-10-02T22:36:03.157661] [INFO ] [MAIN ] CACI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:03.157774] [DEBUG] [LOCAL ] C: Saving derivative data. [2025-10-02T22:36:03.158364] [INFO ] [MAIN ] CAAP: Successfully saved derivative data. [2025-10-02T22:36:03.161270] [INFO ] [MAIN ] Derivative Progress: 317/1975 symbols completed. CAAP took 1.2s. Estimated remaining: 11m 40s. Rate: 142.1 symbols/min [2025-10-02T22:36:03.161949] [INFO ] [MAIN ] CADE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:03.179531] [DEBUG] [LOCAL ] C: Derivative data saved (1807 records). [2025-10-02T22:36:03.179866] [INFO ] [MAIN ] C: Successfully saved derivative data. [2025-10-02T22:36:03.182288] [INFO ] [MAIN ] Derivative Progress: 318/1975 symbols completed. C took 1.3s. Estimated remaining: 11m 37s. Rate: 142.6 symbols/min [2025-10-02T22:36:03.182574] [INFO ] [MAIN ] CAE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:03.202023] [DEBUG] [LOCAL ] CACI: Loaded 24689 existing records from primary storage. [2025-10-02T22:36:03.202174] [INFO ] [MAIN ] CACI: Loaded 24689 primary data records. [2025-10-02T22:36:03.414402] [DEBUG] [LOCAL ] CAE: Loaded 39353 existing records from primary storage. [2025-10-02T22:36:03.446878] [INFO ] [MAIN ] CAE: Loaded 39353 primary data records. [2025-10-02T22:36:03.624194] [DEBUG] [LOCAL ] CADE: Loaded 49221 existing records from primary storage. [2025-10-02T22:36:03.624437] [INFO ] [MAIN ] CADE: Loaded 49221 primary data records. [2025-10-02T22:36:04.297349] [DEBUG] [MAIN ] CACI: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-02T22:36:04.298602] [INFO ] [MAIN ] CACI: Generated 1806 derivative records from 24689 primary records. [2025-10-02T22:36:04.298922] [DEBUG] [LOCAL ] CACI: Saving derivative data. [2025-10-02T22:36:04.323978] [DEBUG] [LOCAL ] CACI: Derivative data saved (1806 records). [2025-10-02T22:36:04.324229] [INFO ] [MAIN ] CACI: Successfully saved derivative data. [2025-10-02T22:36:04.326517] [INFO ] [MAIN ] Derivative Progress: 319/1975 symbols completed. CACI took 1.2s. Estimated remaining: 11m 41s. Rate: 141.8 symbols/min [2025-10-02T22:36:04.327515] [INFO ] [MAIN ] CAF: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:04.342740] [DEBUG] [LOCAL ] CAF: Loaded 3421 existing records from primary storage. [2025-10-02T22:36:04.357222] [INFO ] [MAIN ] CAF: Loaded 3421 primary data records. [2025-10-02T22:36:04.357716] [DEBUG] [MAIN ] CAE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:04.388234] [INFO ] [MAIN ] CAE: Generated 1807 derivative records from 39353 primary records. [2025-10-02T22:36:04.403246] [DEBUG] [LOCAL ] CAE: Saving derivative data. [2025-10-02T22:36:04.397983] [DEBUG] [MAIN ] CADE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:04.412332] [INFO ] [MAIN ] CADE: Generated 1807 derivative records from 49221 primary records. [2025-10-02T22:36:04.427622] [DEBUG] [LOCAL ] CADE: Saving derivative data. [2025-10-02T22:36:04.516163] [DEBUG] [LOCAL ] CAE: Derivative data saved (1807 records). [2025-10-02T22:36:04.534540] [INFO ] [MAIN ] CAE: Successfully saved derivative data. [2025-10-02T22:36:04.538295] [INFO ] [MAIN ] Derivative Progress: 320/1975 symbols completed. CAE took 1.4s. Estimated remaining: 11m 39s. Rate: 142.0 symbols/min [2025-10-02T22:36:04.544810] [INFO ] [MAIN ] CAG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:04.561736] [DEBUG] [LOCAL ] CADE: Derivative data saved (1807 records). [2025-10-02T22:36:04.572485] [INFO ] [MAIN ] CADE: Successfully saved derivative data. [2025-10-02T22:36:04.614491] [INFO ] [MAIN ] Derivative Progress: 321/1975 symbols completed. CADE took 1.5s. Estimated remaining: 11m 37s. Rate: 142.4 symbols/min [2025-10-02T22:36:04.617160] [INFO ] [MAIN ] CAH: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:04.828409] [DEBUG] [MAIN ] CAF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:04.845155] [INFO ] [MAIN ] CAF: Generated 1807 derivative records from 3421 primary records. [2025-10-02T22:36:04.845431] [DEBUG] [LOCAL ] CAF: Saving derivative data. [2025-10-02T22:36:04.847184] [DEBUG] [LOCAL ] CAG: Loaded 54053 existing records from primary storage. [2025-10-02T22:36:04.848255] [INFO ] [MAIN ] CAG: Loaded 54053 primary data records. [2025-10-02T22:36:04.930787] [DEBUG] [LOCAL ] CAH: Loaded 51794 existing records from primary storage. [2025-10-02T22:36:04.953756] [INFO ] [MAIN ] CAH: Loaded 51794 primary data records. [2025-10-02T22:36:04.963928] [DEBUG] [LOCAL ] CAF: Derivative data saved (1807 records). [2025-10-02T22:36:04.974566] [INFO ] [MAIN ] CAF: Successfully saved derivative data. [2025-10-02T22:36:04.983845] [INFO ] [MAIN ] Derivative Progress: 322/1975 symbols completed. CAF took 0.7s. Estimated remaining: 11m 36s. Rate: 142.5 symbols/min [2025-10-02T22:36:05.008222] [INFO ] [MAIN ] CAL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:05.641381] [DEBUG] [LOCAL ] CAL: Loaded 43440 existing records from primary storage. [2025-10-02T22:36:05.641763] [INFO ] [MAIN ] CAL: Loaded 43440 primary data records. [2025-10-02T22:36:06.042777] [DEBUG] [MAIN ] CAH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:06.044616] [DEBUG] [MAIN ] CAG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:06.046560] [INFO ] [MAIN ] CAG: Generated 1807 derivative records from 54053 primary records. [2025-10-02T22:36:06.045615] [INFO ] [MAIN ] CAH: Generated 1807 derivative records from 51794 primary records. [2025-10-02T22:36:06.047282] [DEBUG] [LOCAL ] CAH: Saving derivative data. [2025-10-02T22:36:06.047356] [DEBUG] [LOCAL ] CAG: Saving derivative data. [2025-10-02T22:36:06.080443] [DEBUG] [LOCAL ] CAH: Derivative data saved (1807 records). [2025-10-02T22:36:06.082093] [INFO ] [MAIN ] CAH: Successfully saved derivative data. [2025-10-02T22:36:06.083669] [DEBUG] [LOCAL ] CAG: Derivative data saved (1807 records). [2025-10-02T22:36:06.086122] [INFO ] [MAIN ] Derivative Progress: 323/1975 symbols completed. CAH took 1.5s. Estimated remaining: 11m 39s. Rate: 141.7 symbols/min [2025-10-02T22:36:06.083815] [INFO ] [MAIN ] CAG: Successfully saved derivative data. [2025-10-02T22:36:06.089875] [INFO ] [MAIN ] CALX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:06.090136] [INFO ] [MAIN ] Derivative Progress: 324/1975 symbols completed. CAG took 1.5s. Estimated remaining: 11m 37s. Rate: 142.2 symbols/min [2025-10-02T22:36:06.091195] [INFO ] [MAIN ] CANG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:06.112432] [DEBUG] [MAIN ] CAL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:06.113382] [INFO ] [MAIN ] CAL: Generated 1807 derivative records from 43440 primary records. [2025-10-02T22:36:06.113571] [DEBUG] [LOCAL ] CAL: Saving derivative data. [2025-10-02T22:36:06.147506] [DEBUG] [LOCAL ] CAL: Derivative data saved (1807 records). [2025-10-02T22:36:06.147961] [INFO ] [MAIN ] CAL: Successfully saved derivative data. [2025-10-02T22:36:06.157722] [INFO ] [MAIN ] Derivative Progress: 325/1975 symbols completed. CAL took 1.1s. Estimated remaining: 11m 35s. Rate: 142.5 symbols/min [2025-10-02T22:36:06.159990] [INFO ] [MAIN ] CAPL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:06.159868] [DEBUG] [LOCAL ] CANG: Loaded 27199 existing records from primary storage. [2025-10-02T22:36:06.160513] [INFO ] [MAIN ] CANG: Loaded 27199 primary data records. [2025-10-02T22:36:06.250328] [DEBUG] [LOCAL ] CALX: Loaded 38123 existing records from primary storage. [2025-10-02T22:36:06.269000] [INFO ] [MAIN ] CALX: Loaded 38123 primary data records. [2025-10-02T22:36:06.294373] [DEBUG] [LOCAL ] CAPL: Loaded 5818 existing records from primary storage. [2025-10-02T22:36:06.331876] [INFO ] [MAIN ] CAPL: Loaded 5818 primary data records. [2025-10-02T22:36:07.217875] [DEBUG] [MAIN ] CANG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:07.219149] [INFO ] [MAIN ] CANG: Generated 1807 derivative records from 27199 primary records. [2025-10-02T22:36:07.220860] [DEBUG] [LOCAL ] CANG: Saving derivative data. [2025-10-02T22:36:07.239885] [DEBUG] [LOCAL ] CANG: Derivative data saved (1807 records). [2025-10-02T22:36:07.240456] [INFO ] [MAIN ] CANG: Successfully saved derivative data. [2025-10-02T22:36:07.242633] [INFO ] [MAIN ] Derivative Progress: 326/1975 symbols completed. CANG took 1.2s. Estimated remaining: 11m 37s. Rate: 141.9 symbols/min [2025-10-02T22:36:07.243597] [INFO ] [MAIN ] CARR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:07.279156] [DEBUG] [MAIN ] CALX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:07.279758] [DEBUG] [MAIN ] CAPL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:07.280598] [INFO ] [MAIN ] CALX: Generated 1807 derivative records from 38123 primary records. [2025-10-02T22:36:07.281737] [DEBUG] [LOCAL ] CALX: Saving derivative data. [2025-10-02T22:36:07.281604] [INFO ] [MAIN ] CAPL: Generated 1807 derivative records from 5818 primary records. [2025-10-02T22:36:07.282938] [DEBUG] [LOCAL ] CAPL: Saving derivative data. [2025-10-02T22:36:07.310625] [DEBUG] [LOCAL ] CALX: Derivative data saved (1807 records). [2025-10-02T22:36:07.310992] [INFO ] [MAIN ] CALX: Successfully saved derivative data. [2025-10-02T22:36:07.316263] [INFO ] [MAIN ] Derivative Progress: 327/1975 symbols completed. CALX took 1.2s. Estimated remaining: 11m 35s. Rate: 142.2 symbols/min [2025-10-02T22:36:07.317052] [INFO ] [MAIN ] CARS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:07.337849] [DEBUG] [LOCAL ] CAPL: Derivative data saved (1807 records). [2025-10-02T22:36:07.338046] [INFO ] [MAIN ] CAPL: Successfully saved derivative data. [2025-10-02T22:36:07.340477] [INFO ] [MAIN ] Derivative Progress: 328/1975 symbols completed. CAPL took 1.2s. Estimated remaining: 11m 33s. Rate: 142.6 symbols/min [2025-10-02T22:36:07.363935] [DEBUG] [LOCAL ] CARR: Loaded 53984 existing records from primary storage. [2025-10-02T22:36:07.373280] [INFO ] [MAIN ] CARR: Loaded 53984 primary data records. [2025-10-02T22:36:07.509618] [DEBUG] [LOCAL ] CARS: Loaded 40093 existing records from primary storage. [2025-10-02T22:36:07.525711] [INFO ] [MAIN ] CARS: Loaded 40093 primary data records. [2025-10-02T22:36:08.187001] [DEBUG] [MAIN ] CARR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:08.188061] [INFO ] [MAIN ] CARR: Generated 1807 derivative records from 53984 primary records. [2025-10-02T22:36:08.188151] [DEBUG] [LOCAL ] CARR: Saving derivative data. [2025-10-02T22:36:08.207903] [DEBUG] [LOCAL ] CARR: Derivative data saved (1807 records). [2025-10-02T22:36:08.208538] [INFO ] [MAIN ] CARR: Successfully saved derivative data. [2025-10-02T22:36:08.211875] [INFO ] [MAIN ] Derivative Progress: 329/1975 symbols completed. CARR took 1.0s. Estimated remaining: 11m 35s. Rate: 142.2 symbols/min [2025-10-02T22:36:08.231512] [DEBUG] [MAIN ] CARS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:08.232341] [INFO ] [MAIN ] CARS: Generated 1807 derivative records from 40093 primary records. [2025-10-02T22:36:08.232409] [DEBUG] [LOCAL ] CARS: Saving derivative data. [2025-10-02T22:36:08.249225] [DEBUG] [LOCAL ] CARS: Derivative data saved (1807 records). [2025-10-02T22:36:08.249333] [INFO ] [MAIN ] CARS: Successfully saved derivative data. [2025-10-02T22:36:08.251607] [INFO ] [MAIN ] Derivative Progress: 330/1975 symbols completed. CARS took 0.9s. Estimated remaining: 11m 32s. Rate: 142.6 symbols/min [2025-10-02T22:36:08.252451] [INFO ] [MAIN ] CAVA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:08.252348] [INFO ] [MAIN ] CAT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:08.252574] [INFO ] [MAIN ] CATO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:08.264110] [DEBUG] [LOCAL ] CATO: Loaded 7127 existing records from primary storage. [2025-10-02T22:36:08.264399] [INFO ] [MAIN ] CATO: Loaded 7127 primary data records. [2025-10-02T22:36:08.671834] [DEBUG] [LOCAL ] CAT: Loaded 53308 existing records from primary storage. [2025-10-02T22:36:08.673608] [DEBUG] [LOCAL ] CAVA: Loaded 53942 existing records from primary storage. [2025-10-02T22:36:08.674006] [INFO ] [MAIN ] CAT: Loaded 53308 primary data records. [2025-10-02T22:36:08.674106] [INFO ] [MAIN ] CAVA: Loaded 53942 primary data records. [2025-10-02T22:36:09.425445] [DEBUG] [MAIN ] CATO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:09.426910] [INFO ] [MAIN ] CATO: Generated 1807 derivative records from 7127 primary records. [2025-10-02T22:36:09.427326] [DEBUG] [LOCAL ] CATO: Saving derivative data. [2025-10-02T22:36:09.448721] [DEBUG] [LOCAL ] CATO: Derivative data saved (1807 records). [2025-10-02T22:36:09.449587] [INFO ] [MAIN ] CATO: Successfully saved derivative data. [2025-10-02T22:36:09.452907] [INFO ] [MAIN ] Derivative Progress: 331/1975 symbols completed. CATO took 1.2s. Estimated remaining: 11m 36s. Rate: 141.8 symbols/min [2025-10-02T22:36:09.453571] [INFO ] [MAIN ] CB: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:09.485115] [DEBUG] [MAIN ] CAVA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:09.491181] [INFO ] [MAIN ] CAVA: Generated 1807 derivative records from 53942 primary records. [2025-10-02T22:36:09.491555] [DEBUG] [LOCAL ] CAVA: Saving derivative data. [2025-10-02T22:36:09.492464] [DEBUG] [MAIN ] CAT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:09.494557] [INFO ] [MAIN ] CAT: Generated 1807 derivative records from 53308 primary records. [2025-10-02T22:36:09.502203] [DEBUG] [LOCAL ] CAT: Saving derivative data. [2025-10-02T22:36:09.529131] [DEBUG] [LOCAL ] CAT: Derivative data saved (1807 records). [2025-10-02T22:36:09.530176] [INFO ] [MAIN ] CAT: Successfully saved derivative data. [2025-10-02T22:36:09.533362] [INFO ] [MAIN ] Derivative Progress: 332/1975 symbols completed. CAT took 1.3s. Estimated remaining: 11m 34s. Rate: 142.1 symbols/min [2025-10-02T22:36:09.534313] [INFO ] [MAIN ] CBL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:09.546964] [DEBUG] [LOCAL ] CAVA: Derivative data saved (1807 records). [2025-10-02T22:36:09.547280] [INFO ] [MAIN ] CAVA: Successfully saved derivative data. [2025-10-02T22:36:09.549512] [INFO ] [MAIN ] Derivative Progress: 333/1975 symbols completed. CAVA took 1.3s. Estimated remaining: 11m 31s. Rate: 142.5 symbols/min [2025-10-02T22:36:09.550285] [INFO ] [MAIN ] CBNA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:09.557138] [DEBUG] [LOCAL ] CBNA: Loaded 2927 existing records from primary storage. [2025-10-02T22:36:09.557522] [INFO ] [MAIN ] CBNA: Loaded 2927 primary data records. [2025-10-02T22:36:09.663854] [DEBUG] [LOCAL ] CB: Loaded 50296 existing records from primary storage. [2025-10-02T22:36:09.697621] [INFO ] [MAIN ] CB: Loaded 50296 primary data records. [2025-10-02T22:36:09.692716] [DEBUG] [LOCAL ] CBL: Loaded 16371 existing records from primary storage. [2025-10-02T22:36:09.721753] [INFO ] [MAIN ] CBL: Loaded 16371 primary data records. [2025-10-02T22:36:10.678231] [DEBUG] [MAIN ] CBNA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:10.680505] [INFO ] [MAIN ] CBNA: Generated 1807 derivative records from 2927 primary records. [2025-10-02T22:36:10.680809] [DEBUG] [LOCAL ] CBNA: Saving derivative data. [2025-10-02T22:36:10.727715] [DEBUG] [LOCAL ] CBNA: Derivative data saved (1807 records). [2025-10-02T22:36:10.727593] [DEBUG] [MAIN ] CBL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:10.728110] [DEBUG] [MAIN ] CB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:10.729072] [INFO ] [MAIN ] CBL: Generated 1807 derivative records from 16371 primary records. [2025-10-02T22:36:10.729854] [DEBUG] [LOCAL ] CBL: Saving derivative data. [2025-10-02T22:36:10.729780] [INFO ] [MAIN ] CB: Generated 1807 derivative records from 50296 primary records. [2025-10-02T22:36:10.728239] [INFO ] [MAIN ] CBNA: Successfully saved derivative data. [2025-10-02T22:36:10.729956] [DEBUG] [LOCAL ] CB: Saving derivative data. [2025-10-02T22:36:10.733955] [INFO ] [MAIN ] Derivative Progress: 334/1975 symbols completed. CBNA took 1.2s. Estimated remaining: 11m 35s. Rate: 141.7 symbols/min [2025-10-02T22:36:10.753590] [INFO ] [MAIN ] CBRE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:10.768508] [DEBUG] [LOCAL ] CBL: Derivative data saved (1807 records). [2025-10-02T22:36:10.768716] [INFO ] [MAIN ] CBL: Successfully saved derivative data. [2025-10-02T22:36:10.771465] [INFO ] [MAIN ] Derivative Progress: 335/1975 symbols completed. CBL took 1.2s. Estimated remaining: 11m 32s. Rate: 142.1 symbols/min [2025-10-02T22:36:10.771768] [INFO ] [MAIN ] CBT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:10.767155] [DEBUG] [LOCAL ] CB: Derivative data saved (1807 records). [2025-10-02T22:36:10.771963] [INFO ] [MAIN ] CB: Successfully saved derivative data. [2025-10-02T22:36:10.774761] [INFO ] [MAIN ] Derivative Progress: 336/1975 symbols completed. CB took 1.3s. Estimated remaining: 11m 30s. Rate: 142.6 symbols/min [2025-10-02T22:36:10.775106] [INFO ] [MAIN ] CBU: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:10.807341] [DEBUG] [LOCAL ] CBU: Loaded 22817 existing records from primary storage. [2025-10-02T22:36:10.807526] [INFO ] [MAIN ] CBU: Loaded 22817 primary data records. [2025-10-02T22:36:10.912695] [DEBUG] [LOCAL ] CBT: Loaded 31073 existing records from primary storage. [2025-10-02T22:36:10.966161] [INFO ] [MAIN ] CBT: Loaded 31073 primary data records. [2025-10-02T22:36:10.972740] [DEBUG] [LOCAL ] CBRE: Loaded 50924 existing records from primary storage. [2025-10-02T22:36:10.991094] [INFO ] [MAIN ] CBRE: Loaded 50924 primary data records. [2025-10-02T22:36:11.972183] [DEBUG] [MAIN ] CBU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:11.973481] [INFO ] [MAIN ] CBU: Generated 1807 derivative records from 22817 primary records. [2025-10-02T22:36:11.973726] [DEBUG] [LOCAL ] CBU: Saving derivative data. [2025-10-02T22:36:12.011134] [DEBUG] [MAIN ] CBT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:12.012323] [DEBUG] [LOCAL ] CBU: Derivative data saved (1807 records). [2025-10-02T22:36:12.013215] [INFO ] [MAIN ] CBT: Generated 1807 derivative records from 31073 primary records. [2025-10-02T22:36:12.013539] [INFO ] [MAIN ] CBU: Successfully saved derivative data. [2025-10-02T22:36:12.021706] [DEBUG] [LOCAL ] CBT: Saving derivative data. [2025-10-02T22:36:12.030132] [DEBUG] [MAIN ] CBRE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:12.029777] [INFO ] [MAIN ] Derivative Progress: 337/1975 symbols completed. CBU took 1.3s. Estimated remaining: 11m 33s. Rate: 141.7 symbols/min [2025-10-02T22:36:12.038215] [INFO ] [MAIN ] CBZ: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:12.039376] [INFO ] [MAIN ] CBRE: Generated 1807 derivative records from 50924 primary records. [2025-10-02T22:36:12.039984] [DEBUG] [LOCAL ] CBRE: Saving derivative data. [2025-10-02T22:36:12.057963] [DEBUG] [LOCAL ] CBT: Derivative data saved (1807 records). [2025-10-02T22:36:12.058155] [INFO ] [MAIN ] CBT: Successfully saved derivative data. [2025-10-02T22:36:12.060488] [INFO ] [MAIN ] Derivative Progress: 338/1975 symbols completed. CBT took 1.3s. Estimated remaining: 11m 31s. Rate: 142.1 symbols/min [2025-10-02T22:36:12.062120] [INFO ] [MAIN ] CC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:12.074511] [DEBUG] [LOCAL ] CBRE: Derivative data saved (1807 records). [2025-10-02T22:36:12.077305] [INFO ] [MAIN ] CBRE: Successfully saved derivative data. [2025-10-02T22:36:12.080368] [INFO ] [MAIN ] Derivative Progress: 339/1975 symbols completed. CBRE took 1.3s. Estimated remaining: 11m 29s. Rate: 142.5 symbols/min [2025-10-02T22:36:12.080544] [INFO ] [MAIN ] CCI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:12.122981] [DEBUG] [LOCAL ] CBZ: Loaded 33974 existing records from primary storage. [2025-10-02T22:36:12.123297] [INFO ] [MAIN ] CBZ: Loaded 33974 primary data records. [2025-10-02T22:36:12.257923] [DEBUG] [LOCAL ] CC: Loaded 53386 existing records from primary storage. [2025-10-02T22:36:12.274200] [INFO ] [MAIN ] CC: Loaded 53386 primary data records. [2025-10-02T22:36:12.643125] [DEBUG] [LOCAL ] CCI: Loaded 53529 existing records from primary storage. [2025-10-02T22:36:12.649372] [INFO ] [MAIN ] CCI: Loaded 53529 primary data records. [2025-10-02T22:36:13.236616] [DEBUG] [MAIN ] CBZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:13.237758] [INFO ] [MAIN ] CBZ: Generated 1807 derivative records from 33974 primary records. [2025-10-02T22:36:13.238941] [DEBUG] [LOCAL ] CBZ: Saving derivative data. [2025-10-02T22:36:13.271525] [DEBUG] [MAIN ] CC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:13.273578] [INFO ] [MAIN ] CC: Generated 1807 derivative records from 53386 primary records. [2025-10-02T22:36:13.273935] [DEBUG] [LOCAL ] CC: Saving derivative data. [2025-10-02T22:36:13.275223] [DEBUG] [LOCAL ] CBZ: Derivative data saved (1807 records). [2025-10-02T22:36:13.275867] [INFO ] [MAIN ] CBZ: Successfully saved derivative data. [2025-10-02T22:36:13.280163] [INFO ] [MAIN ] Derivative Progress: 340/1975 symbols completed. CBZ took 1.2s. Estimated remaining: 11m 32s. Rate: 141.7 symbols/min [2025-10-02T22:36:13.289191] [INFO ] [MAIN ] CCIF: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:13.317067] [DEBUG] [MAIN ] CCI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:13.321854] [INFO ] [MAIN ] CCI: Generated 1807 derivative records from 53529 primary records. [2025-10-02T22:36:13.316754] [DEBUG] [LOCAL ] CC: Derivative data saved (1807 records). [2025-10-02T22:36:13.322071] [INFO ] [MAIN ] CC: Successfully saved derivative data. [2025-10-02T22:36:13.322005] [DEBUG] [LOCAL ] CCI: Saving derivative data. [2025-10-02T22:36:13.324478] [INFO ] [MAIN ] Derivative Progress: 341/1975 symbols completed. CC took 1.3s. Estimated remaining: 11m 30s. Rate: 142.1 symbols/min [2025-10-02T22:36:13.325377] [INFO ] [MAIN ] CCJ: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:13.345307] [DEBUG] [LOCAL ] CCIF: Loaded 15844 existing records from primary storage. [2025-10-02T22:36:13.346414] [INFO ] [MAIN ] CCIF: Loaded 15844 primary data records. [2025-10-02T22:36:13.453934] [DEBUG] [LOCAL ] CCI: Derivative data saved (1807 records). [2025-10-02T22:36:13.466972] [INFO ] [MAIN ] CCI: Successfully saved derivative data. [2025-10-02T22:36:13.469828] [INFO ] [MAIN ] Derivative Progress: 342/1975 symbols completed. CCI took 1.4s. Estimated remaining: 11m 28s. Rate: 142.4 symbols/min [2025-10-02T22:36:13.496681] [INFO ] [MAIN ] CCK: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:13.720095] [DEBUG] [LOCAL ] CCJ: Loaded 54063 existing records from primary storage. [2025-10-02T22:36:13.721162] [INFO ] [MAIN ] CCJ: Loaded 54063 primary data records. [2025-10-02T22:36:14.086767] [DEBUG] [LOCAL ] CCK: Loaded 46518 existing records from primary storage. [2025-10-02T22:36:14.087349] [INFO ] [MAIN ] CCK: Loaded 46518 primary data records. [2025-10-02T22:36:14.252186] [DEBUG] [MAIN ] CCIF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:14.310485] [INFO ] [MAIN ] CCIF: Generated 1807 derivative records from 15844 primary records. [2025-10-02T22:36:14.480059] [DEBUG] [LOCAL ] CCIF: Saving derivative data. [2025-10-02T22:36:14.519309] [DEBUG] [LOCAL ] CCIF: Derivative data saved (1807 records). [2025-10-02T22:36:14.519822] [INFO ] [MAIN ] CCIF: Successfully saved derivative data. [2025-10-02T22:36:14.523127] [INFO ] [MAIN ] Derivative Progress: 343/1975 symbols completed. CCIF took 1.2s. Estimated remaining: 11m 31s. Rate: 141.8 symbols/min [2025-10-02T22:36:14.537915] [DEBUG] [MAIN ] CCJ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:14.539122] [INFO ] [MAIN ] CCJ: Generated 1807 derivative records from 54063 primary records. [2025-10-02T22:36:14.539230] [DEBUG] [LOCAL ] CCJ: Saving derivative data. [2025-10-02T22:36:14.560158] [DEBUG] [LOCAL ] CCJ: Derivative data saved (1807 records). [2025-10-02T22:36:14.560366] [INFO ] [MAIN ] CCJ: Successfully saved derivative data. [2025-10-02T22:36:14.562872] [INFO ] [MAIN ] Derivative Progress: 344/1975 symbols completed. CCJ took 1.2s. Estimated remaining: 11m 28s. Rate: 142.1 symbols/min [2025-10-02T22:36:14.576228] [DEBUG] [MAIN ] CCK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:14.577008] [INFO ] [MAIN ] CCK: Generated 1807 derivative records from 46518 primary records. [2025-10-02T22:36:14.577072] [DEBUG] [LOCAL ] CCK: Saving derivative data. [2025-10-02T22:36:14.593805] [DEBUG] [LOCAL ] CCK: Derivative data saved (1807 records). [2025-10-02T22:36:14.593874] [INFO ] [MAIN ] CCK: Successfully saved derivative data. [2025-10-02T22:36:14.596430] [INFO ] [MAIN ] Derivative Progress: 345/1975 symbols completed. CCK took 1.1s. Estimated remaining: 11m 26s. Rate: 142.5 symbols/min [2025-10-02T22:36:14.597062] [INFO ] [MAIN ] CCRD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:14.596923] [INFO ] [MAIN ] CCL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:14.597011] [INFO ] [MAIN ] CCO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:14.608700] [DEBUG] [LOCAL ] CCRD: Loaded 9134 existing records from primary storage. [2025-10-02T22:36:14.608836] [INFO ] [MAIN ] CCRD: Loaded 9134 primary data records. [2025-10-02T22:36:14.984993] [DEBUG] [LOCAL ] CCO: Loaded 48249 existing records from primary storage. [2025-10-02T22:36:14.985268] [INFO ] [MAIN ] CCO: Loaded 48249 primary data records. [2025-10-02T22:36:15.024574] [DEBUG] [LOCAL ] CCL: Loaded 54190 existing records from primary storage. [2025-10-02T22:36:15.051305] [INFO ] [MAIN ] CCL: Loaded 54190 primary data records. [2025-10-02T22:36:15.704125] [DEBUG] [MAIN ] CCRD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:15.705708] [INFO ] [MAIN ] CCRD: Generated 1807 derivative records from 9134 primary records. [2025-10-02T22:36:15.706111] [DEBUG] [LOCAL ] CCRD: Saving derivative data. [2025-10-02T22:36:15.729309] [DEBUG] [LOCAL ] CCRD: Derivative data saved (1807 records). [2025-10-02T22:36:15.729676] [INFO ] [MAIN ] CCRD: Successfully saved derivative data. [2025-10-02T22:36:15.732212] [INFO ] [MAIN ] Derivative Progress: 346/1975 symbols completed. CCRD took 1.1s. Estimated remaining: 11m 29s. Rate: 141.8 symbols/min [2025-10-02T22:36:15.732578] [INFO ] [MAIN ] CCS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:15.752352] [DEBUG] [MAIN ] CCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:15.754365] [INFO ] [MAIN ] CCO: Generated 1807 derivative records from 48249 primary records. [2025-10-02T22:36:15.754619] [DEBUG] [LOCAL ] CCO: Saving derivative data. [2025-10-02T22:36:15.796506] [DEBUG] [MAIN ] CCL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:15.799831] [INFO ] [MAIN ] CCL: Generated 1807 derivative records from 54190 primary records. [2025-10-02T22:36:15.800505] [DEBUG] [LOCAL ] CCO: Derivative data saved (1807 records). [2025-10-02T22:36:15.800693] [INFO ] [MAIN ] CCO: Successfully saved derivative data. [2025-10-02T22:36:15.800817] [DEBUG] [LOCAL ] CCL: Saving derivative data. [2025-10-02T22:36:15.802796] [INFO ] [MAIN ] Derivative Progress: 347/1975 symbols completed. CCO took 1.2s. Estimated remaining: 11m 27s. Rate: 142.2 symbols/min [2025-10-02T22:36:15.803792] [INFO ] [MAIN ] CDE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:15.832495] [DEBUG] [LOCAL ] CCL: Derivative data saved (1807 records). [2025-10-02T22:36:15.831088] [DEBUG] [LOCAL ] CCS: Loaded 30685 existing records from primary storage. [2025-10-02T22:36:15.832825] [INFO ] [MAIN ] CCL: Successfully saved derivative data. [2025-10-02T22:36:15.832957] [INFO ] [MAIN ] CCS: Loaded 30685 primary data records. [2025-10-02T22:36:15.834992] [INFO ] [MAIN ] Derivative Progress: 348/1975 symbols completed. CCL took 1.2s. Estimated remaining: 11m 25s. Rate: 142.5 symbols/min [2025-10-02T22:36:15.847711] [INFO ] [MAIN ] CDLR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:15.966712] [DEBUG] [LOCAL ] CDLR: Loaded 9932 existing records from primary storage. [2025-10-02T22:36:15.977915] [INFO ] [MAIN ] CDLR: Loaded 9932 primary data records. [2025-10-02T22:36:16.358991] [DEBUG] [LOCAL ] CDE: Loaded 54032 existing records from primary storage. [2025-10-02T22:36:16.380709] [INFO ] [MAIN ] CDE: Loaded 54032 primary data records. [2025-10-02T22:36:16.969068] [DEBUG] [MAIN ] CCS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:16.970746] [INFO ] [MAIN ] CCS: Generated 1807 derivative records from 30685 primary records. [2025-10-02T22:36:16.971120] [DEBUG] [LOCAL ] CCS: Saving derivative data. [2025-10-02T22:36:17.008315] [DEBUG] [LOCAL ] CCS: Derivative data saved (1807 records). [2025-10-02T22:36:17.009557] [DEBUG] [MAIN ] CDLR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:17.009776] [INFO ] [MAIN ] CCS: Successfully saved derivative data. [2025-10-02T22:36:17.010735] [INFO ] [MAIN ] CDLR: Generated 1807 derivative records from 9932 primary records. [2025-10-02T22:36:17.014311] [DEBUG] [LOCAL ] CDLR: Saving derivative data. [2025-10-02T22:36:17.013877] [INFO ] [MAIN ] Derivative Progress: 349/1975 symbols completed. CCS took 1.3s. Estimated remaining: 11m 28s. Rate: 141.8 symbols/min [2025-10-02T22:36:17.015734] [INFO ] [MAIN ] CDP: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:17.049317] [DEBUG] [LOCAL ] CDLR: Derivative data saved (1807 records). [2025-10-02T22:36:17.050223] [DEBUG] [MAIN ] CDE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:17.050329] [INFO ] [MAIN ] CDLR: Successfully saved derivative data. [2025-10-02T22:36:17.054636] [INFO ] [MAIN ] CDE: Generated 1807 derivative records from 54032 primary records. [2025-10-02T22:36:17.054831] [DEBUG] [LOCAL ] CDE: Saving derivative data. [2025-10-02T22:36:17.053606] [INFO ] [MAIN ] Derivative Progress: 350/1975 symbols completed. CDLR took 1.2s. Estimated remaining: 11m 26s. Rate: 142.2 symbols/min [2025-10-02T22:36:17.055130] [INFO ] [MAIN ] CDRE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:17.074822] [DEBUG] [LOCAL ] CDE: Derivative data saved (1807 records). [2025-10-02T22:36:17.074966] [INFO ] [MAIN ] CDE: Successfully saved derivative data. [2025-10-02T22:36:17.077494] [INFO ] [MAIN ] Derivative Progress: 351/1975 symbols completed. CDE took 1.3s. Estimated remaining: 11m 23s. Rate: 142.6 symbols/min [2025-10-02T22:36:17.077767] [INFO ] [MAIN ] CE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:17.110891] [DEBUG] [LOCAL ] CDRE: Loaded 25140 existing records from primary storage. [2025-10-02T22:36:17.111069] [INFO ] [MAIN ] CDRE: Loaded 25140 primary data records. [2025-10-02T22:36:17.252794] [DEBUG] [LOCAL ] CDP: Loaded 42936 existing records from primary storage. [2025-10-02T22:36:17.257201] [INFO ] [MAIN ] CDP: Loaded 42936 primary data records. [2025-10-02T22:36:17.611682] [DEBUG] [LOCAL ] CE: Loaded 51874 existing records from primary storage. [2025-10-02T22:36:17.617943] [INFO ] [MAIN ] CE: Loaded 51874 primary data records. [2025-10-02T22:36:18.241972] [DEBUG] [MAIN ] CDRE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:18.244772] [INFO ] [MAIN ] CDRE: Generated 1807 derivative records from 25140 primary records. [2025-10-02T22:36:18.245215] [DEBUG] [LOCAL ] CDRE: Saving derivative data. [2025-10-02T22:36:18.273903] [DEBUG] [MAIN ] CDP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:18.281275] [INFO ] [MAIN ] CDP: Generated 1807 derivative records from 42936 primary records. [2025-10-02T22:36:18.285204] [DEBUG] [LOCAL ] CDRE: Derivative data saved (1807 records). [2025-10-02T22:36:18.285411] [DEBUG] [LOCAL ] CDP: Saving derivative data. [2025-10-02T22:36:18.285528] [INFO ] [MAIN ] CDRE: Successfully saved derivative data. [2025-10-02T22:36:18.289214] [INFO ] [MAIN ] Derivative Progress: 352/1975 symbols completed. CDRE took 1.2s. Estimated remaining: 11m 27s. Rate: 141.8 symbols/min [2025-10-02T22:36:18.307798] [INFO ] [MAIN ] CEE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:18.315604] [DEBUG] [LOCAL ] CDP: Derivative data saved (1807 records). [2025-10-02T22:36:18.316231] [INFO ] [MAIN ] CDP: Successfully saved derivative data. [2025-10-02T22:36:18.318797] [INFO ] [MAIN ] Derivative Progress: 353/1975 symbols completed. CDP took 1.3s. Estimated remaining: 11m 24s. Rate: 142.2 symbols/min [2025-10-02T22:36:18.322060] [INFO ] [MAIN ] CEPU: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:18.341883] [DEBUG] [MAIN ] CE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:18.342878] [INFO ] [MAIN ] CE: Generated 1807 derivative records from 51874 primary records. [2025-10-02T22:36:18.342991] [DEBUG] [LOCAL ] CE: Saving derivative data. [2025-10-02T22:36:18.358098] [DEBUG] [LOCAL ] CEE: Loaded 5968 existing records from primary storage. [2025-10-02T22:36:18.362374] [INFO ] [MAIN ] CEE: Loaded 5968 primary data records. [2025-10-02T22:36:18.509200] [DEBUG] [LOCAL ] CEPU: Loaded 26149 existing records from primary storage. [2025-10-02T22:36:18.502674] [DEBUG] [LOCAL ] CE: Derivative data saved (1807 records). [2025-10-02T22:36:18.530305] [INFO ] [MAIN ] CEPU: Loaded 26149 primary data records. [2025-10-02T22:36:18.530213] [INFO ] [MAIN ] CE: Successfully saved derivative data. [2025-10-02T22:36:18.562538] [INFO ] [MAIN ] Derivative Progress: 354/1975 symbols completed. CE took 1.5s. Estimated remaining: 11m 23s. Rate: 142.4 symbols/min [2025-10-02T22:36:18.575874] [INFO ] [MAIN ] CF: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:19.367137] [DEBUG] [LOCAL ] CF: Loaded 52560 existing records from primary storage. [2025-10-02T22:36:19.368789] [INFO ] [MAIN ] CF: Loaded 52560 primary data records. [2025-10-02T22:36:19.583940] [DEBUG] [MAIN ] CEE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:19.734611] [INFO ] [MAIN ] CEE: Generated 1807 derivative records from 5968 primary records. [2025-10-02T22:36:19.745583] [DEBUG] [LOCAL ] CEE: Saving derivative data. [2025-10-02T22:36:19.767630] [DEBUG] [LOCAL ] CEE: Derivative data saved (1807 records). [2025-10-02T22:36:19.783753] [INFO ] [MAIN ] CEE: Successfully saved derivative data. [2025-10-02T22:36:19.786107] [INFO ] [MAIN ] Derivative Progress: 355/1975 symbols completed. CEE took 1.5s. Estimated remaining: 11m 26s. Rate: 141.6 symbols/min [2025-10-02T22:36:19.786360] [INFO ] [MAIN ] CFG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:19.783631] [DEBUG] [MAIN ] CEPU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:19.788598] [INFO ] [MAIN ] CEPU: Generated 1807 derivative records from 26149 primary records. [2025-10-02T22:36:19.789041] [DEBUG] [LOCAL ] CEPU: Saving derivative data. [2025-10-02T22:36:19.818235] [DEBUG] [LOCAL ] CEPU: Derivative data saved (1807 records). [2025-10-02T22:36:19.818632] [INFO ] [MAIN ] CEPU: Successfully saved derivative data. [2025-10-02T22:36:19.821683] [INFO ] [MAIN ] Derivative Progress: 356/1975 symbols completed. CEPU took 1.5s. Estimated remaining: 11m 24s. Rate: 142.0 symbols/min [2025-10-02T22:36:19.822282] [INFO ] [MAIN ] CFR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:19.864853] [DEBUG] [MAIN ] CF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:19.866123] [INFO ] [MAIN ] CF: Generated 1807 derivative records from 52560 primary records. [2025-10-02T22:36:19.866339] [DEBUG] [LOCAL ] CF: Saving derivative data. [2025-10-02T22:36:19.917309] [DEBUG] [LOCAL ] CFG: Loaded 54014 existing records from primary storage. [2025-10-02T22:36:19.917964] [INFO ] [MAIN ] CFG: Loaded 54014 primary data records. [2025-10-02T22:36:19.918538] [DEBUG] [LOCAL ] CF: Derivative data saved (1807 records). [2025-10-02T22:36:19.936810] [INFO ] [MAIN ] CF: Successfully saved derivative data. [2025-10-02T22:36:19.965320] [INFO ] [MAIN ] Derivative Progress: 357/1975 symbols completed. CF took 1.4s. Estimated remaining: 11m 23s. Rate: 142.2 symbols/min [2025-10-02T22:36:20.041854] [INFO ] [MAIN ] CGV: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:20.042533] [DEBUG] [LOCAL ] CFR: Loaded 33393 existing records from primary storage. [2025-10-02T22:36:20.043077] [INFO ] [MAIN ] CFR: Loaded 33393 primary data records. [2025-10-02T22:36:20.143294] [DEBUG] [LOCAL ] CGV: Loaded 1408 existing records from primary storage. [2025-10-02T22:36:20.191787] [INFO ] [MAIN ] CGV: Loaded 1408 primary data records. [2025-10-02T22:36:21.049788] [DEBUG] [MAIN ] CFG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:21.051154] [INFO ] [MAIN ] CFG: Generated 1807 derivative records from 54014 primary records. [2025-10-02T22:36:21.051451] [DEBUG] [LOCAL ] CFG: Saving derivative data. [2025-10-02T22:36:21.073605] [DEBUG] [MAIN ] CFR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:21.079050] [INFO ] [MAIN ] CFR: Generated 1807 derivative records from 33393 primary records. [2025-10-02T22:36:21.080073] [DEBUG] [LOCAL ] CFR: Saving derivative data. [2025-10-02T22:36:21.094111] [DEBUG] [LOCAL ] CFG: Derivative data saved (1807 records). [2025-10-02T22:36:21.099574] [INFO ] [MAIN ] CFG: Successfully saved derivative data. [2025-10-02T22:36:21.103959] [INFO ] [MAIN ] Derivative Progress: 358/1975 symbols completed. CFG took 1.3s. Estimated remaining: 11m 25s. Rate: 141.6 symbols/min [2025-10-02T22:36:21.119638] [DEBUG] [LOCAL ] CFR: Derivative data saved (1807 records). [2025-10-02T22:36:21.119804] [INFO ] [MAIN ] CFR: Successfully saved derivative data. [2025-10-02T22:36:21.122297] [INFO ] [MAIN ] Derivative Progress: 359/1975 symbols completed. CFR took 1.3s. Estimated remaining: 11m 23s. Rate: 141.9 symbols/min [2025-10-02T22:36:21.123121] [DEBUG] [MAIN ] CGV: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-02T22:36:21.123839] [INFO ] [MAIN ] CGV: Generated 1806 derivative records from 1408 primary records. [2025-10-02T22:36:21.123903] [DEBUG] [LOCAL ] CGV: Saving derivative data. [2025-10-02T22:36:21.137742] [DEBUG] [LOCAL ] CGV: Derivative data saved (1806 records). [2025-10-02T22:36:21.137815] [INFO ] [MAIN ] CGV: Successfully saved derivative data. [2025-10-02T22:36:21.139983] [INFO ] [MAIN ] Derivative Progress: 360/1975 symbols completed. CGV took 1.1s. Estimated remaining: 11m 21s. Rate: 142.3 symbols/min [2025-10-02T22:36:21.140405] [INFO ] [MAIN ] CHD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:21.140871] [INFO ] [MAIN ] CHE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:21.140551] [INFO ] [MAIN ] CHGG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:21.162823] [DEBUG] [LOCAL ] CHE: Loaded 15178 existing records from primary storage. [2025-10-02T22:36:21.163090] [INFO ] [MAIN ] CHE: Loaded 15178 primary data records. [2025-10-02T22:36:21.577619] [DEBUG] [LOCAL ] CHD: Loaded 52490 existing records from primary storage. [2025-10-02T22:36:21.579360] [DEBUG] [LOCAL ] CHGG: Loaded 47996 existing records from primary storage. [2025-10-02T22:36:21.579762] [INFO ] [MAIN ] CHGG: Loaded 47996 primary data records. [2025-10-02T22:36:21.579684] [INFO ] [MAIN ] CHD: Loaded 52490 primary data records. [2025-10-02T22:36:22.322739] [DEBUG] [MAIN ] CHE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:22.324297] [INFO ] [MAIN ] CHE: Generated 1807 derivative records from 15178 primary records. [2025-10-02T22:36:22.324552] [DEBUG] [LOCAL ] CHE: Saving derivative data. [2025-10-02T22:36:22.347956] [DEBUG] [LOCAL ] CHE: Derivative data saved (1807 records). [2025-10-02T22:36:22.349140] [INFO ] [MAIN ] CHE: Successfully saved derivative data. [2025-10-02T22:36:22.351889] [INFO ] [MAIN ] Derivative Progress: 361/1975 symbols completed. CHE took 1.2s. Estimated remaining: 11m 24s. Rate: 141.6 symbols/min [2025-10-02T22:36:22.353018] [INFO ] [MAIN ] CHH: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:22.367370] [DEBUG] [MAIN ] CHGG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:22.369279] [INFO ] [MAIN ] CHGG: Generated 1807 derivative records from 47996 primary records. [2025-10-02T22:36:22.369371] [DEBUG] [LOCAL ] CHGG: Saving derivative data. [2025-10-02T22:36:22.389043] [DEBUG] [LOCAL ] CHGG: Derivative data saved (1807 records). [2025-10-02T22:36:22.389172] [INFO ] [MAIN ] CHGG: Successfully saved derivative data. [2025-10-02T22:36:22.391212] [INFO ] [MAIN ] Derivative Progress: 362/1975 symbols completed. CHGG took 1.3s. Estimated remaining: 11m 22s. Rate: 141.9 symbols/min [2025-10-02T22:36:22.393374] [INFO ] [MAIN ] CHMI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:22.409192] [DEBUG] [MAIN ] CHD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:22.410174] [INFO ] [MAIN ] CHD: Generated 1807 derivative records from 52490 primary records. [2025-10-02T22:36:22.410275] [DEBUG] [LOCAL ] CHD: Saving derivative data. [2025-10-02T22:36:22.452275] [DEBUG] [LOCAL ] CHMI: Loaded 22017 existing records from primary storage. [2025-10-02T22:36:22.453679] [INFO ] [MAIN ] CHMI: Loaded 22017 primary data records. [2025-10-02T22:36:22.528361] [DEBUG] [LOCAL ] CHD: Derivative data saved (1807 records). [2025-10-02T22:36:22.550611] [INFO ] [MAIN ] CHD: Successfully saved derivative data. [2025-10-02T22:36:22.564259] [INFO ] [MAIN ] Derivative Progress: 363/1975 symbols completed. CHD took 1.4s. Estimated remaining: 11m 20s. Rate: 142.2 symbols/min [2025-10-02T22:36:22.587793] [INFO ] [MAIN ] CHN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:22.573183] [DEBUG] [LOCAL ] CHH: Loaded 32209 existing records from primary storage. [2025-10-02T22:36:22.588264] [INFO ] [MAIN ] CHH: Loaded 32209 primary data records. [2025-10-02T22:36:22.763481] [DEBUG] [LOCAL ] CHN: Loaded 4849 existing records from primary storage. [2025-10-02T22:36:22.887180] [INFO ] [MAIN ] CHN: Loaded 4849 primary data records. [2025-10-02T22:36:23.677542] [DEBUG] [MAIN ] CHMI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:23.679316] [INFO ] [MAIN ] CHMI: Generated 1807 derivative records from 22017 primary records. [2025-10-02T22:36:23.679426] [DEBUG] [LOCAL ] CHMI: Saving derivative data. [2025-10-02T22:36:23.697587] [DEBUG] [LOCAL ] CHMI: Derivative data saved (1807 records). [2025-10-02T22:36:23.698514] [INFO ] [MAIN ] CHMI: Successfully saved derivative data. [2025-10-02T22:36:23.700680] [INFO ] [MAIN ] Derivative Progress: 364/1975 symbols completed. CHMI took 1.3s. Estimated remaining: 11m 23s. Rate: 141.5 symbols/min [2025-10-02T22:36:23.700847] [INFO ] [MAIN ] CHT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:23.740550] [DEBUG] [MAIN ] CHH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:23.739904] [DEBUG] [LOCAL ] CHT: Loaded 19829 existing records from primary storage. [2025-10-02T22:36:23.748793] [INFO ] [MAIN ] CHT: Loaded 19829 primary data records. [2025-10-02T22:36:23.749598] [INFO ] [MAIN ] CHH: Generated 1807 derivative records from 32209 primary records. [2025-10-02T22:36:23.755088] [DEBUG] [LOCAL ] CHH: Saving derivative data. [2025-10-02T22:36:23.761565] [DEBUG] [MAIN ] CHN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:23.778804] [INFO ] [MAIN ] CHN: Generated 1807 derivative records from 4849 primary records. [2025-10-02T22:36:23.781525] [DEBUG] [LOCAL ] CHN: Saving derivative data. [2025-10-02T22:36:23.809332] [DEBUG] [LOCAL ] CHH: Derivative data saved (1807 records). [2025-10-02T22:36:23.814798] [INFO ] [MAIN ] CHH: Successfully saved derivative data. [2025-10-02T22:36:23.862955] [INFO ] [MAIN ] Derivative Progress: 365/1975 symbols completed. CHH took 1.5s. Estimated remaining: 11m 22s. Rate: 141.7 symbols/min [2025-10-02T22:36:23.884844] [DEBUG] [LOCAL ] CHN: Derivative data saved (1807 records). [2025-10-02T22:36:23.894446] [INFO ] [MAIN ] CHWY: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:23.894708] [INFO ] [MAIN ] CHN: Successfully saved derivative data. [2025-10-02T22:36:23.912354] [INFO ] [MAIN ] Derivative Progress: 366/1975 symbols completed. CHN took 1.3s. Estimated remaining: 11m 19s. Rate: 142.1 symbols/min [2025-10-02T22:36:23.936525] [INFO ] [MAIN ] CI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:24.194011] [DEBUG] [MAIN ] CHT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:24.194997] [INFO ] [MAIN ] CHT: Generated 1807 derivative records from 19829 primary records. [2025-10-02T22:36:24.195153] [DEBUG] [LOCAL ] CHT: Saving derivative data. [2025-10-02T22:36:24.223477] [DEBUG] [LOCAL ] CHWY: Loaded 54044 existing records from primary storage. [2025-10-02T22:36:24.243554] [INFO ] [MAIN ] CHWY: Loaded 54044 primary data records. [2025-10-02T22:36:24.245863] [DEBUG] [LOCAL ] CI: Loaded 50086 existing records from primary storage. [2025-10-02T22:36:24.258988] [INFO ] [MAIN ] CI: Loaded 50086 primary data records. [2025-10-02T22:36:24.488638] [DEBUG] [LOCAL ] CHT: Derivative data saved (1807 records). [2025-10-02T22:36:24.519830] [INFO ] [MAIN ] CHT: Successfully saved derivative data. [2025-10-02T22:36:24.550890] [INFO ] [MAIN ] Derivative Progress: 367/1975 symbols completed. CHT took 0.9s. Estimated remaining: 11m 20s. Rate: 141.9 symbols/min [2025-10-02T22:36:24.616626] [INFO ] [MAIN ] CIA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:24.954333] [DEBUG] [LOCAL ] CIA: Loaded 17134 existing records from primary storage. [2025-10-02T22:36:24.954730] [INFO ] [MAIN ] CIA: Loaded 17134 primary data records. [2025-10-02T22:36:25.154856] [DEBUG] [MAIN ] CHWY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:25.181188] [INFO ] [MAIN ] CHWY: Generated 1807 derivative records from 54044 primary records. [2025-10-02T22:36:25.311536] [DEBUG] [LOCAL ] CHWY: Saving derivative data. [2025-10-02T22:36:25.344857] [DEBUG] [MAIN ] CI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:25.346612] [INFO ] [MAIN ] CI: Generated 1807 derivative records from 50086 primary records. [2025-10-02T22:36:25.346953] [DEBUG] [LOCAL ] CI: Saving derivative data. [2025-10-02T22:36:25.349021] [DEBUG] [LOCAL ] CHWY: Derivative data saved (1807 records). [2025-10-02T22:36:25.349248] [INFO ] [MAIN ] CHWY: Successfully saved derivative data. [2025-10-02T22:36:25.351462] [INFO ] [MAIN ] Derivative Progress: 368/1975 symbols completed. CHWY took 1.5s. Estimated remaining: 11m 21s. Rate: 141.5 symbols/min [2025-10-02T22:36:25.351793] [INFO ] [MAIN ] CIF: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:25.374490] [DEBUG] [LOCAL ] CIF: Loaded 4220 existing records from primary storage. [2025-10-02T22:36:25.376032] [DEBUG] [LOCAL ] CI: Derivative data saved (1807 records). [2025-10-02T22:36:25.376166] [INFO ] [MAIN ] CI: Successfully saved derivative data. [2025-10-02T22:36:25.378544] [INFO ] [MAIN ] CIF: Loaded 4220 primary data records. [2025-10-02T22:36:25.378292] [INFO ] [MAIN ] Derivative Progress: 369/1975 symbols completed. CI took 1.4s. Estimated remaining: 11m 19s. Rate: 141.9 symbols/min [2025-10-02T22:36:25.384184] [INFO ] [MAIN ] CIM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:25.625086] [DEBUG] [MAIN ] CIA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:25.785174] [DEBUG] [LOCAL ] CIM: Loaded 37813 existing records from primary storage. [2025-10-02T22:36:25.795867] [INFO ] [MAIN ] CIA: Generated 1807 derivative records from 17134 primary records. [2025-10-02T22:36:25.794914] [INFO ] [MAIN ] CIM: Loaded 37813 primary data records. [2025-10-02T22:36:25.796020] [DEBUG] [LOCAL ] CIA: Saving derivative data. [2025-10-02T22:36:25.918550] [DEBUG] [LOCAL ] CIA: Derivative data saved (1807 records). [2025-10-02T22:36:25.930563] [INFO ] [MAIN ] CIA: Successfully saved derivative data. [2025-10-02T22:36:25.932948] [INFO ] [MAIN ] Derivative Progress: 370/1975 symbols completed. CIA took 1.3s. Estimated remaining: 11m 19s. Rate: 141.8 symbols/min [2025-10-02T22:36:25.933464] [INFO ] [MAIN ] CIMN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:26.139565] [DEBUG] [LOCAL ] CIMN: Loaded 2697 existing records from primary storage. [2025-10-02T22:36:26.140792] [INFO ] [MAIN ] CIMN: Loaded 2697 primary data records. [2025-10-02T22:36:26.270372] [DEBUG] [MAIN ] CIF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:26.282461] [INFO ] [MAIN ] CIF: Generated 1807 derivative records from 4220 primary records. [2025-10-02T22:36:26.352378] [DEBUG] [LOCAL ] CIF: Saving derivative data. [2025-10-02T22:36:26.497043] [DEBUG] [LOCAL ] CIF: Derivative data saved (1807 records). [2025-10-02T22:36:26.498148] [INFO ] [MAIN ] CIF: Successfully saved derivative data. [2025-10-02T22:36:26.500398] [INFO ] [MAIN ] Derivative Progress: 371/1975 symbols completed. CIF took 1.1s. Estimated remaining: 11m 19s. Rate: 141.7 symbols/min [2025-10-02T22:36:26.500591] [INFO ] [MAIN ] CINT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:26.527055] [DEBUG] [MAIN ] CIM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:26.527953] [INFO ] [MAIN ] CIM: Generated 1807 derivative records from 37813 primary records. [2025-10-02T22:36:26.528281] [DEBUG] [LOCAL ] CIM: Saving derivative data. [2025-10-02T22:36:26.555896] [DEBUG] [LOCAL ] CINT: Loaded 18940 existing records from primary storage. [2025-10-02T22:36:26.555222] [DEBUG] [LOCAL ] CIM: Derivative data saved (1807 records). [2025-10-02T22:36:26.556167] [INFO ] [MAIN ] CINT: Loaded 18940 primary data records. [2025-10-02T22:36:26.556370] [INFO ] [MAIN ] CIM: Successfully saved derivative data. [2025-10-02T22:36:26.558661] [INFO ] [MAIN ] Derivative Progress: 372/1975 symbols completed. CIM took 1.2s. Estimated remaining: 11m 17s. Rate: 142.0 symbols/min [2025-10-02T22:36:26.605364] [DEBUG] [MAIN ] CIMN: Filtered 6966 bins outside market hours, 7761 incomplete bins [2025-10-02T22:36:26.610638] [INFO ] [MAIN ] CIO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:26.616805] [INFO ] [MAIN ] CIMN: Generated 1805 derivative records from 2697 primary records. [2025-10-02T22:36:26.633861] [DEBUG] [LOCAL ] CIMN: Saving derivative data. [2025-10-02T22:36:26.797084] [DEBUG] [LOCAL ] CIMN: Derivative data saved (1805 records). [2025-10-02T22:36:26.797270] [INFO ] [MAIN ] CIMN: Successfully saved derivative data. [2025-10-02T22:36:26.800097] [INFO ] [MAIN ] Derivative Progress: 373/1975 symbols completed. CIMN took 0.9s. Estimated remaining: 11m 16s. Rate: 142.1 symbols/min [2025-10-02T22:36:26.948805] [DEBUG] [LOCAL ] CIO: Loaded 20557 existing records from primary storage. [2025-10-02T22:36:26.949087] [INFO ] [MAIN ] CIO: Loaded 20557 primary data records. [2025-10-02T22:36:27.312425] [DEBUG] [MAIN ] CINT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:27.313601] [INFO ] [MAIN ] CINT: Generated 1807 derivative records from 18940 primary records. [2025-10-02T22:36:27.313716] [DEBUG] [LOCAL ] CINT: Saving derivative data. [2025-10-02T22:36:27.331772] [DEBUG] [LOCAL ] CINT: Derivative data saved (1807 records). [2025-10-02T22:36:27.332018] [INFO ] [MAIN ] CINT: Successfully saved derivative data. [2025-10-02T22:36:27.334291] [INFO ] [MAIN ] Derivative Progress: 374/1975 symbols completed. CINT took 0.8s. Estimated remaining: 11m 16s. Rate: 142.0 symbols/min [2025-10-02T22:36:27.349932] [DEBUG] [MAIN ] CIO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:27.350602] [INFO ] [MAIN ] CIO: Generated 1807 derivative records from 20557 primary records. [2025-10-02T22:36:27.350697] [DEBUG] [LOCAL ] CIO: Saving derivative data. [2025-10-02T22:36:27.366731] [DEBUG] [LOCAL ] CIO: Derivative data saved (1807 records). [2025-10-02T22:36:27.366869] [INFO ] [MAIN ] CIO: Successfully saved derivative data. [2025-10-02T22:36:27.369229] [INFO ] [MAIN ] Derivative Progress: 375/1975 symbols completed. CIO took 0.8s. Estimated remaining: 11m 14s. Rate: 142.4 symbols/min [2025-10-02T22:36:27.369677] [INFO ] [MAIN ] CION: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:27.369781] [INFO ] [MAIN ] CLB: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:27.369927] [INFO ] [MAIN ] CIVI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:27.411426] [DEBUG] [LOCAL ] CION: Loaded 29036 existing records from primary storage. [2025-10-02T22:36:27.425813] [INFO ] [MAIN ] CION: Loaded 29036 primary data records. [2025-10-02T22:36:27.517177] [DEBUG] [LOCAL ] CLB: Loaded 33203 existing records from primary storage. [2025-10-02T22:36:27.553710] [INFO ] [MAIN ] CLB: Loaded 33203 primary data records. [2025-10-02T22:36:27.583029] [DEBUG] [LOCAL ] CIVI: Loaded 52985 existing records from primary storage. [2025-10-02T22:36:27.623094] [INFO ] [MAIN ] CIVI: Loaded 52985 primary data records. [2025-10-02T22:36:28.555358] [DEBUG] [MAIN ] CION: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:28.557197] [INFO ] [MAIN ] CION: Generated 1807 derivative records from 29036 primary records. [2025-10-02T22:36:28.557315] [DEBUG] [LOCAL ] CION: Saving derivative data. [2025-10-02T22:36:28.579105] [DEBUG] [LOCAL ] CION: Derivative data saved (1807 records). [2025-10-02T22:36:28.580542] [INFO ] [MAIN ] CION: Successfully saved derivative data. [2025-10-02T22:36:28.583515] [INFO ] [MAIN ] Derivative Progress: 376/1975 symbols completed. CION took 1.2s. Estimated remaining: 11m 17s. Rate: 141.7 symbols/min [2025-10-02T22:36:28.584297] [INFO ] [MAIN ] CLCO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:28.601038] [DEBUG] [MAIN ] CLB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:28.603116] [INFO ] [MAIN ] CLB: Generated 1807 derivative records from 33203 primary records. [2025-10-02T22:36:28.603394] [DEBUG] [LOCAL ] CLB: Saving derivative data. [2025-10-02T22:36:28.635736] [DEBUG] [MAIN ] CIVI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:28.641549] [INFO ] [MAIN ] CIVI: Generated 1807 derivative records from 52985 primary records. [2025-10-02T22:36:28.647810] [DEBUG] [LOCAL ] CIVI: Saving derivative data. [2025-10-02T22:36:28.647711] [DEBUG] [LOCAL ] CLCO: Loaded 12817 existing records from primary storage. [2025-10-02T22:36:28.650093] [DEBUG] [LOCAL ] CLB: Derivative data saved (1807 records). [2025-10-02T22:36:28.650512] [INFO ] [MAIN ] CLB: Successfully saved derivative data. [2025-10-02T22:36:28.663760] [INFO ] [MAIN ] CLCO: Loaded 12817 primary data records. [2025-10-02T22:36:28.668487] [DEBUG] [LOCAL ] CIVI: Derivative data saved (1807 records). [2025-10-02T22:36:28.668828] [INFO ] [MAIN ] CIVI: Successfully saved derivative data. [2025-10-02T22:36:28.671057] [INFO ] [MAIN ] Derivative Progress: 377/1975 symbols completed. CIVI took 1.3s. Estimated remaining: 11m 15s. Rate: 142.0 symbols/min [2025-10-02T22:36:28.722046] [INFO ] [MAIN ] CLDT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:28.732919] [INFO ] [MAIN ] Derivative Progress: 378/1975 symbols completed. CLB took 1.3s. Estimated remaining: 11m 13s. Rate: 142.3 symbols/min [2025-10-02T22:36:28.763474] [INFO ] [MAIN ] CLF: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:29.040029] [DEBUG] [LOCAL ] CLDT: Loaded 25578 existing records from primary storage. [2025-10-02T22:36:29.040594] [INFO ] [MAIN ] CLDT: Loaded 25578 primary data records. [2025-10-02T22:36:29.221113] [DEBUG] [LOCAL ] CLF: Loaded 54131 existing records from primary storage. [2025-10-02T22:36:29.238377] [INFO ] [MAIN ] CLF: Loaded 54131 primary data records. [2025-10-02T22:36:29.546694] [DEBUG] [MAIN ] CLCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:29.561638] [INFO ] [MAIN ] CLCO: Generated 1807 derivative records from 12817 primary records. [2025-10-02T22:36:29.589579] [DEBUG] [LOCAL ] CLCO: Saving derivative data. [2025-10-02T22:36:29.807327] [DEBUG] [LOCAL ] CLCO: Derivative data saved (1807 records). [2025-10-02T22:36:29.808216] [INFO ] [MAIN ] CLCO: Successfully saved derivative data. [2025-10-02T22:36:29.810432] [INFO ] [MAIN ] Derivative Progress: 379/1975 symbols completed. CLCO took 1.2s. Estimated remaining: 11m 16s. Rate: 141.7 symbols/min [2025-10-02T22:36:29.811014] [INFO ] [MAIN ] CLH: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:29.838026] [DEBUG] [MAIN ] CLDT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:29.839137] [INFO ] [MAIN ] CLDT: Generated 1807 derivative records from 25578 primary records. [2025-10-02T22:36:29.839479] [DEBUG] [LOCAL ] CLDT: Saving derivative data. [2025-10-02T22:36:29.886832] [DEBUG] [LOCAL ] CLH: Loaded 28009 existing records from primary storage. [2025-10-02T22:36:29.888298] [INFO ] [MAIN ] CLH: Loaded 28009 primary data records. [2025-10-02T22:36:29.888369] [DEBUG] [LOCAL ] CLDT: Derivative data saved (1807 records). [2025-10-02T22:36:29.913701] [DEBUG] [MAIN ] CLF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:29.949451] [INFO ] [MAIN ] CLF: Generated 1807 derivative records from 54131 primary records. [2025-10-02T22:36:29.940748] [INFO ] [MAIN ] CLDT: Successfully saved derivative data. [2025-10-02T22:36:29.954759] [DEBUG] [LOCAL ] CLF: Saving derivative data. [2025-10-02T22:36:29.976696] [INFO ] [MAIN ] Derivative Progress: 380/1975 symbols completed. CLDT took 1.3s. Estimated remaining: 11m 14s. Rate: 142.0 symbols/min [2025-10-02T22:36:30.004941] [INFO ] [MAIN ] CLVT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:30.064919] [DEBUG] [LOCAL ] CLF: Derivative data saved (1807 records). [2025-10-02T22:36:30.088404] [INFO ] [MAIN ] CLF: Successfully saved derivative data. [2025-10-02T22:36:30.105850] [INFO ] [MAIN ] Derivative Progress: 381/1975 symbols completed. CLF took 1.3s. Estimated remaining: 11m 13s. Rate: 142.2 symbols/min [2025-10-02T22:36:30.115126] [INFO ] [MAIN ] CLW: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:30.345167] [DEBUG] [LOCAL ] CLW: Loaded 21887 existing records from primary storage. [2025-10-02T22:36:30.345584] [INFO ] [MAIN ] CLW: Loaded 21887 primary data records. [2025-10-02T22:36:30.346841] [DEBUG] [LOCAL ] CLVT: Loaded 52342 existing records from primary storage. [2025-10-02T22:36:30.389802] [INFO ] [MAIN ] CLVT: Loaded 52342 primary data records. [2025-10-02T22:36:30.952936] [DEBUG] [MAIN ] CLH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:30.998894] [INFO ] [MAIN ] CLH: Generated 1807 derivative records from 28009 primary records. [2025-10-02T22:36:31.078045] [DEBUG] [LOCAL ] CLH: Saving derivative data. [2025-10-02T22:36:31.109956] [DEBUG] [LOCAL ] CLH: Derivative data saved (1807 records). [2025-10-02T22:36:31.110668] [INFO ] [MAIN ] CLH: Successfully saved derivative data. [2025-10-02T22:36:31.113971] [INFO ] [MAIN ] Derivative Progress: 382/1975 symbols completed. CLH took 1.3s. Estimated remaining: 11m 15s. Rate: 141.7 symbols/min [2025-10-02T22:36:31.115436] [INFO ] [MAIN ] CLX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:31.150758] [DEBUG] [MAIN ] CLW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:31.164421] [INFO ] [MAIN ] CLW: Generated 1807 derivative records from 21887 primary records. [2025-10-02T22:36:31.165635] [DEBUG] [MAIN ] CLVT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:31.165096] [DEBUG] [LOCAL ] CLW: Saving derivative data. [2025-10-02T22:36:31.166491] [INFO ] [MAIN ] CLVT: Generated 1807 derivative records from 52342 primary records. [2025-10-02T22:36:31.167478] [DEBUG] [LOCAL ] CLVT: Saving derivative data. [2025-10-02T22:36:31.199841] [DEBUG] [LOCAL ] CLVT: Derivative data saved (1807 records). [2025-10-02T22:36:31.218801] [INFO ] [MAIN ] CLVT: Successfully saved derivative data. [2025-10-02T22:36:31.222002] [INFO ] [MAIN ] Derivative Progress: 383/1975 symbols completed. CLVT took 1.2s. Estimated remaining: 11m 13s. Rate: 142.0 symbols/min [2025-10-02T22:36:31.223102] [INFO ] [MAIN ] CM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:31.223814] [DEBUG] [LOCAL ] CLW: Derivative data saved (1807 records). [2025-10-02T22:36:31.224182] [INFO ] [MAIN ] CLW: Successfully saved derivative data. [2025-10-02T22:36:31.226789] [INFO ] [MAIN ] Derivative Progress: 384/1975 symbols completed. CLW took 1.1s. Estimated remaining: 11m 11s. Rate: 142.3 symbols/min [2025-10-02T22:36:31.227111] [INFO ] [MAIN ] CMBT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:31.292045] [DEBUG] [LOCAL ] CLX: Loaded 51852 existing records from primary storage. [2025-10-02T22:36:31.297706] [INFO ] [MAIN ] CLX: Loaded 51852 primary data records. [2025-10-02T22:36:31.439108] [DEBUG] [LOCAL ] CMBT: Loaded 23828 existing records from primary storage. [2025-10-02T22:36:31.443687] [INFO ] [MAIN ] CMBT: Loaded 23828 primary data records. [2025-10-02T22:36:31.781674] [DEBUG] [LOCAL ] CM: Loaded 48929 existing records from primary storage. [2025-10-02T22:36:31.782731] [INFO ] [MAIN ] CM: Loaded 48929 primary data records. [2025-10-02T22:36:32.445924] [DEBUG] [MAIN ] CLX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:32.446998] [INFO ] [MAIN ] CLX: Generated 1807 derivative records from 51852 primary records. [2025-10-02T22:36:32.447298] [DEBUG] [LOCAL ] CLX: Saving derivative data. [2025-10-02T22:36:32.492853] [DEBUG] [MAIN ] CMBT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:32.492379] [DEBUG] [LOCAL ] CLX: Derivative data saved (1807 records). [2025-10-02T22:36:32.495161] [INFO ] [MAIN ] CMBT: Generated 1807 derivative records from 23828 primary records. [2025-10-02T22:36:32.495323] [DEBUG] [LOCAL ] CMBT: Saving derivative data. [2025-10-02T22:36:32.495391] [INFO ] [MAIN ] CLX: Successfully saved derivative data. [2025-10-02T22:36:32.500793] [INFO ] [MAIN ] Derivative Progress: 385/1975 symbols completed. CLX took 1.4s. Estimated remaining: 11m 14s. Rate: 141.6 symbols/min [2025-10-02T22:36:32.509923] [INFO ] [MAIN ] CMC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:32.525022] [DEBUG] [LOCAL ] CMBT: Derivative data saved (1807 records). [2025-10-02T22:36:32.536977] [INFO ] [MAIN ] CMBT: Successfully saved derivative data. [2025-10-02T22:36:32.540930] [INFO ] [MAIN ] Derivative Progress: 386/1975 symbols completed. CMBT took 1.3s. Estimated remaining: 11m 12s. Rate: 141.9 symbols/min [2025-10-02T22:36:32.541925] [INFO ] [MAIN ] CMCM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:32.541613] [DEBUG] [MAIN ] CM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:32.543603] [INFO ] [MAIN ] CM: Generated 1807 derivative records from 48929 primary records. [2025-10-02T22:36:32.543894] [DEBUG] [LOCAL ] CM: Saving derivative data. [2025-10-02T22:36:32.563967] [DEBUG] [LOCAL ] CMCM: Loaded 4758 existing records from primary storage. [2025-10-02T22:36:32.564908] [INFO ] [MAIN ] CMCM: Loaded 4758 primary data records. [2025-10-02T22:36:32.644894] [DEBUG] [LOCAL ] CM: Derivative data saved (1807 records). [2025-10-02T22:36:32.677248] [INFO ] [MAIN ] CM: Successfully saved derivative data. [2025-10-02T22:36:32.711673] [INFO ] [MAIN ] Derivative Progress: 387/1975 symbols completed. CM took 1.5s. Estimated remaining: 11m 10s. Rate: 142.1 symbols/min [2025-10-02T22:36:32.723774] [INFO ] [MAIN ] CMG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:32.813314] [DEBUG] [LOCAL ] CMC: Loaded 45898 existing records from primary storage. [2025-10-02T22:36:32.903853] [INFO ] [MAIN ] CMC: Loaded 45898 primary data records. [2025-10-02T22:36:33.420380] [DEBUG] [LOCAL ] CMG: Loaded 54111 existing records from primary storage. [2025-10-02T22:36:33.421825] [INFO ] [MAIN ] CMG: Loaded 54111 primary data records. [2025-10-02T22:36:33.611381] [DEBUG] [MAIN ] CMCM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:33.645860] [INFO ] [MAIN ] CMCM: Generated 1807 derivative records from 4758 primary records. [2025-10-02T22:36:33.772814] [DEBUG] [LOCAL ] CMCM: Saving derivative data. [2025-10-02T22:36:33.791734] [DEBUG] [LOCAL ] CMCM: Derivative data saved (1807 records). [2025-10-02T22:36:33.793154] [INFO ] [MAIN ] CMCM: Successfully saved derivative data. [2025-10-02T22:36:33.795811] [INFO ] [MAIN ] Derivative Progress: 388/1975 symbols completed. CMCM took 1.3s. Estimated remaining: 11m 13s. Rate: 141.6 symbols/min [2025-10-02T22:36:33.812809] [DEBUG] [MAIN ] CMC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:33.813564] [INFO ] [MAIN ] CMC: Generated 1807 derivative records from 45898 primary records. [2025-10-02T22:36:33.813815] [DEBUG] [LOCAL ] CMC: Saving derivative data. [2025-10-02T22:36:33.831466] [DEBUG] [LOCAL ] CMC: Derivative data saved (1807 records). [2025-10-02T22:36:33.831578] [INFO ] [MAIN ] CMC: Successfully saved derivative data. [2025-10-02T22:36:33.833719] [INFO ] [MAIN ] Derivative Progress: 389/1975 symbols completed. CMC took 1.3s. Estimated remaining: 11m 11s. Rate: 141.9 symbols/min [2025-10-02T22:36:33.849907] [DEBUG] [MAIN ] CMG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:33.850583] [INFO ] [MAIN ] CMG: Generated 1807 derivative records from 54111 primary records. [2025-10-02T22:36:33.850696] [DEBUG] [LOCAL ] CMG: Saving derivative data. [2025-10-02T22:36:33.866991] [DEBUG] [LOCAL ] CMG: Derivative data saved (1807 records). [2025-10-02T22:36:33.867086] [INFO ] [MAIN ] CMG: Successfully saved derivative data. [2025-10-02T22:36:33.869218] [INFO ] [MAIN ] Derivative Progress: 390/1975 symbols completed. CMG took 1.1s. Estimated remaining: 11m 9s. Rate: 142.2 symbols/min [2025-10-02T22:36:33.869788] [INFO ] [MAIN ] CMP: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:33.869856] [INFO ] [MAIN ] CMPO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:33.869713] [INFO ] [MAIN ] CMI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:33.933733] [DEBUG] [LOCAL ] CMPO: Loaded 39512 existing records from primary storage. [2025-10-02T22:36:33.934393] [DEBUG] [LOCAL ] CMP: Loaded 36460 existing records from primary storage. [2025-10-02T22:36:33.934494] [INFO ] [MAIN ] CMP: Loaded 36460 primary data records. [2025-10-02T22:36:33.934585] [INFO ] [MAIN ] CMPO: Loaded 39512 primary data records. [2025-10-02T22:36:34.230232] [DEBUG] [LOCAL ] CMI: Loaded 42060 existing records from primary storage. [2025-10-02T22:36:34.266710] [INFO ] [MAIN ] CMI: Loaded 42060 primary data records. [2025-10-02T22:36:35.037750] [DEBUG] [MAIN ] CMP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:35.040144] [INFO ] [MAIN ] CMP: Generated 1807 derivative records from 36460 primary records. [2025-10-02T22:36:35.040327] [DEBUG] [LOCAL ] CMP: Saving derivative data. [2025-10-02T22:36:35.063384] [DEBUG] [MAIN ] CMPO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:35.068392] [INFO ] [MAIN ] CMPO: Generated 1807 derivative records from 39512 primary records. [2025-10-02T22:36:35.069033] [DEBUG] [LOCAL ] CMPO: Saving derivative data. [2025-10-02T22:36:35.087146] [DEBUG] [LOCAL ] CMP: Derivative data saved (1807 records). [2025-10-02T22:36:35.088927] [INFO ] [MAIN ] CMP: Successfully saved derivative data. [2025-10-02T22:36:35.092182] [INFO ] [MAIN ] Derivative Progress: 391/1975 symbols completed. CMP took 1.2s. Estimated remaining: 11m 11s. Rate: 141.6 symbols/min [2025-10-02T22:36:35.094615] [INFO ] [MAIN ] CMRE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:35.111294] [DEBUG] [MAIN ] CMI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:35.113538] [DEBUG] [LOCAL ] CMPO: Derivative data saved (1807 records). [2025-10-02T22:36:35.112840] [INFO ] [MAIN ] CMI: Generated 1807 derivative records from 42060 primary records. [2025-10-02T22:36:35.113760] [INFO ] [MAIN ] CMPO: Successfully saved derivative data. [2025-10-02T22:36:35.113712] [DEBUG] [LOCAL ] CMI: Saving derivative data. [2025-10-02T22:36:35.116816] [INFO ] [MAIN ] Derivative Progress: 392/1975 symbols completed. CMPO took 1.2s. Estimated remaining: 11m 9s. Rate: 141.9 symbols/min [2025-10-02T22:36:35.117289] [INFO ] [MAIN ] CMS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:35.135516] [DEBUG] [LOCAL ] CMI: Derivative data saved (1807 records). [2025-10-02T22:36:35.135688] [INFO ] [MAIN ] CMI: Successfully saved derivative data. [2025-10-02T22:36:35.138623] [INFO ] [MAIN ] Derivative Progress: 393/1975 symbols completed. CMI took 1.3s. Estimated remaining: 11m 7s. Rate: 142.2 symbols/min [2025-10-02T22:36:35.139300] [INFO ] [MAIN ] CMSA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:35.158893] [DEBUG] [LOCAL ] CMSA: Loaded 3530 existing records from primary storage. [2025-10-02T22:36:35.159096] [INFO ] [MAIN ] CMSA: Loaded 3530 primary data records. [2025-10-02T22:36:35.303901] [DEBUG] [LOCAL ] CMRE: Loaded 35698 existing records from primary storage. [2025-10-02T22:36:35.315430] [INFO ] [MAIN ] CMRE: Loaded 35698 primary data records. [2025-10-02T22:36:35.446383] [DEBUG] [LOCAL ] CMS: Loaded 52995 existing records from primary storage. [2025-10-02T22:36:35.570340] [INFO ] [MAIN ] CMS: Loaded 52995 primary data records. [2025-10-02T22:36:36.217230] [DEBUG] [MAIN ] CMSA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:36.218533] [INFO ] [MAIN ] CMSA: Generated 1807 derivative records from 3530 primary records. [2025-10-02T22:36:36.219059] [DEBUG] [LOCAL ] CMSA: Saving derivative data. [2025-10-02T22:36:36.236669] [DEBUG] [LOCAL ] CMSA: Derivative data saved (1807 records). [2025-10-02T22:36:36.237083] [INFO ] [MAIN ] CMSA: Successfully saved derivative data. [2025-10-02T22:36:36.239166] [INFO ] [MAIN ] Derivative Progress: 394/1975 symbols completed. CMSA took 1.1s. Estimated remaining: 11m 10s. Rate: 141.7 symbols/min [2025-10-02T22:36:36.239444] [INFO ] [MAIN ] CMSC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:36.261431] [DEBUG] [LOCAL ] CMSC: Loaded 5108 existing records from primary storage. [2025-10-02T22:36:36.261221] [DEBUG] [MAIN ] CMRE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:36.262208] [INFO ] [MAIN ] CMRE: Generated 1807 derivative records from 35698 primary records. [2025-10-02T22:36:36.262389] [DEBUG] [LOCAL ] CMRE: Saving derivative data. [2025-10-02T22:36:36.262328] [INFO ] [MAIN ] CMSC: Loaded 5108 primary data records. [2025-10-02T22:36:36.369879] [DEBUG] [MAIN ] CMS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:36.386407] [INFO ] [MAIN ] CMS: Generated 1807 derivative records from 52995 primary records. [2025-10-02T22:36:36.398140] [DEBUG] [LOCAL ] CMS: Saving derivative data. [2025-10-02T22:36:36.405468] [DEBUG] [LOCAL ] CMRE: Derivative data saved (1807 records). [2025-10-02T22:36:36.414699] [INFO ] [MAIN ] CMRE: Successfully saved derivative data. [2025-10-02T22:36:36.421586] [INFO ] [MAIN ] Derivative Progress: 395/1975 symbols completed. CMRE took 1.3s. Estimated remaining: 11m 8s. Rate: 141.9 symbols/min [2025-10-02T22:36:36.422018] [INFO ] [MAIN ] CMSD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:36.521687] [DEBUG] [LOCAL ] CMS: Derivative data saved (1807 records). [2025-10-02T22:36:36.655536] [DEBUG] [LOCAL ] CMSD: Loaded 8137 existing records from primary storage. [2025-10-02T22:36:36.650969] [INFO ] [MAIN ] CMS: Successfully saved derivative data. [2025-10-02T22:36:36.657877] [INFO ] [MAIN ] Derivative Progress: 396/1975 symbols completed. CMS took 1.5s. Estimated remaining: 11m 7s. Rate: 142.0 symbols/min [2025-10-02T22:36:36.655885] [INFO ] [MAIN ] CMSD: Loaded 8137 primary data records. [2025-10-02T22:36:36.670895] [INFO ] [MAIN ] CMTG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:37.080937] [DEBUG] [LOCAL ] CMTG: Loaded 37088 existing records from primary storage. [2025-10-02T22:36:37.081958] [INFO ] [MAIN ] CMTG: Loaded 37088 primary data records. [2025-10-02T22:36:37.225971] [DEBUG] [MAIN ] CMSC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:37.248437] [INFO ] [MAIN ] CMSC: Generated 1807 derivative records from 5108 primary records. [2025-10-02T22:36:37.273932] [DEBUG] [LOCAL ] CMSC: Saving derivative data. [2025-10-02T22:36:37.451210] [DEBUG] [LOCAL ] CMSC: Derivative data saved (1807 records). [2025-10-02T22:36:37.454390] [INFO ] [MAIN ] CMSC: Successfully saved derivative data. [2025-10-02T22:36:37.457309] [INFO ] [MAIN ] Derivative Progress: 397/1975 symbols completed. CMSC took 1.2s. Estimated remaining: 11m 8s. Rate: 141.7 symbols/min [2025-10-02T22:36:37.472026] [DEBUG] [MAIN ] CMSD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:37.471725] [INFO ] [MAIN ] CMU: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:37.473184] [INFO ] [MAIN ] CMSD: Generated 1807 derivative records from 8137 primary records. [2025-10-02T22:36:37.473329] [DEBUG] [LOCAL ] CMSD: Saving derivative data. [2025-10-02T22:36:37.494825] [DEBUG] [LOCAL ] CMU: Loaded 6891 existing records from primary storage. [2025-10-02T22:36:37.495616] [INFO ] [MAIN ] CMU: Loaded 6891 primary data records. [2025-10-02T22:36:37.604857] [DEBUG] [LOCAL ] CMSD: Derivative data saved (1807 records). [2025-10-02T22:36:37.638590] [INFO ] [MAIN ] CMSD: Successfully saved derivative data. [2025-10-02T22:36:37.641615] [INFO ] [MAIN ] Derivative Progress: 398/1975 symbols completed. CMSD took 1.2s. Estimated remaining: 11m 7s. Rate: 141.9 symbols/min [2025-10-02T22:36:37.659132] [INFO ] [MAIN ] CNA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:37.716183] [DEBUG] [MAIN ] CMTG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:37.780783] [INFO ] [MAIN ] CMTG: Generated 1807 derivative records from 37088 primary records. [2025-10-02T22:36:37.867775] [DEBUG] [LOCAL ] CMTG: Saving derivative data. [2025-10-02T22:36:37.906153] [DEBUG] [LOCAL ] CMTG: Derivative data saved (1807 records). [2025-10-02T22:36:37.906825] [INFO ] [MAIN ] CMTG: Successfully saved derivative data. [2025-10-02T22:36:37.909204] [INFO ] [MAIN ] Derivative Progress: 399/1975 symbols completed. CMTG took 1.2s. Estimated remaining: 11m 6s. Rate: 142.0 symbols/min [2025-10-02T22:36:37.909892] [INFO ] [MAIN ] CNC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:37.923170] [DEBUG] [LOCAL ] CNA: Loaded 33010 existing records from primary storage. [2025-10-02T22:36:37.923414] [INFO ] [MAIN ] CNA: Loaded 33010 primary data records. [2025-10-02T22:36:38.281387] [DEBUG] [MAIN ] CMU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:38.298280] [INFO ] [MAIN ] CMU: Generated 1807 derivative records from 6891 primary records. [2025-10-02T22:36:38.299770] [DEBUG] [LOCAL ] CMU: Saving derivative data. [2025-10-02T22:36:38.301870] [DEBUG] [LOCAL ] CNC: Loaded 54129 existing records from primary storage. [2025-10-02T22:36:38.303267] [INFO ] [MAIN ] CNC: Loaded 54129 primary data records. [2025-10-02T22:36:38.393912] [DEBUG] [LOCAL ] CMU: Derivative data saved (1807 records). [2025-10-02T22:36:38.421846] [INFO ] [MAIN ] CMU: Successfully saved derivative data. [2025-10-02T22:36:38.433051] [INFO ] [MAIN ] Derivative Progress: 400/1975 symbols completed. CMU took 1.0s. Estimated remaining: 11m 6s. Rate: 141.9 symbols/min [2025-10-02T22:36:38.438387] [INFO ] [MAIN ] CNH: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:38.674128] [DEBUG] [MAIN ] CNA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:38.675501] [INFO ] [MAIN ] CNA: Generated 1807 derivative records from 33010 primary records. [2025-10-02T22:36:38.675832] [DEBUG] [LOCAL ] CNA: Saving derivative data. [2025-10-02T22:36:38.710793] [DEBUG] [LOCAL ] CNA: Derivative data saved (1807 records). [2025-10-02T22:36:38.711101] [INFO ] [MAIN ] CNA: Successfully saved derivative data. [2025-10-02T22:36:38.713805] [INFO ] [MAIN ] Derivative Progress: 401/1975 symbols completed. CNA took 1.1s. Estimated remaining: 11m 5s. Rate: 142.1 symbols/min [2025-10-02T22:36:38.714291] [INFO ] [MAIN ] CNK: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:38.737042] [DEBUG] [LOCAL ] CNH: Loaded 53944 existing records from primary storage. [2025-10-02T22:36:38.750686] [INFO ] [MAIN ] CNH: Loaded 53944 primary data records. [2025-10-02T22:36:38.750988] [DEBUG] [MAIN ] CNC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:38.751888] [INFO ] [MAIN ] CNC: Generated 1807 derivative records from 54129 primary records. [2025-10-02T22:36:38.757218] [DEBUG] [LOCAL ] CNC: Saving derivative data. [2025-10-02T22:36:39.063888] [DEBUG] [LOCAL ] CNC: Derivative data saved (1807 records). [2025-10-02T22:36:39.073392] [INFO ] [MAIN ] CNC: Successfully saved derivative data. [2025-10-02T22:36:39.172176] [INFO ] [MAIN ] Derivative Progress: 402/1975 symbols completed. CNC took 1.3s. Estimated remaining: 11m 4s. Rate: 142.0 symbols/min [2025-10-02T22:36:39.172506] [INFO ] [MAIN ] CNM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:39.173881] [DEBUG] [LOCAL ] CNK: Loaded 53264 existing records from primary storage. [2025-10-02T22:36:39.174142] [INFO ] [MAIN ] CNK: Loaded 53264 primary data records. [2025-10-02T22:36:39.560273] [DEBUG] [LOCAL ] CNM: Loaded 51367 existing records from primary storage. [2025-10-02T22:36:39.561714] [INFO ] [MAIN ] CNM: Loaded 51367 primary data records. [2025-10-02T22:36:39.607577] [DEBUG] [MAIN ] CNH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:39.643430] [INFO ] [MAIN ] CNH: Generated 1807 derivative records from 53944 primary records. [2025-10-02T22:36:39.697430] [DEBUG] [LOCAL ] CNH: Saving derivative data. [2025-10-02T22:36:39.923235] [DEBUG] [LOCAL ] CNH: Derivative data saved (1807 records). [2025-10-02T22:36:39.937432] [INFO ] [MAIN ] CNH: Successfully saved derivative data. [2025-10-02T22:36:39.940513] [INFO ] [MAIN ] Derivative Progress: 403/1975 symbols completed. CNH took 1.5s. Estimated remaining: 11m 5s. Rate: 141.7 symbols/min [2025-10-02T22:36:39.961321] [DEBUG] [MAIN ] CNK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:39.962634] [INFO ] [MAIN ] CNK: Generated 1807 derivative records from 53264 primary records. [2025-10-02T22:36:39.962803] [DEBUG] [LOCAL ] CNK: Saving derivative data. [2025-10-02T22:36:39.982735] [DEBUG] [LOCAL ] CNK: Derivative data saved (1807 records). [2025-10-02T22:36:39.983153] [INFO ] [MAIN ] CNK: Successfully saved derivative data. [2025-10-02T22:36:39.985345] [INFO ] [MAIN ] Derivative Progress: 404/1975 symbols completed. CNK took 1.3s. Estimated remaining: 11m 4s. Rate: 142.1 symbols/min [2025-10-02T22:36:40.003352] [DEBUG] [MAIN ] CNM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:40.004046] [INFO ] [MAIN ] CNM: Generated 1807 derivative records from 51367 primary records. [2025-10-02T22:36:40.004112] [DEBUG] [LOCAL ] CNM: Saving derivative data. [2025-10-02T22:36:40.020556] [DEBUG] [LOCAL ] CNM: Derivative data saved (1807 records). [2025-10-02T22:36:40.020674] [INFO ] [MAIN ] CNM: Successfully saved derivative data. [2025-10-02T22:36:40.022815] [INFO ] [MAIN ] Derivative Progress: 405/1975 symbols completed. CNM took 0.9s. Estimated remaining: 11m 2s. Rate: 142.4 symbols/min [2025-10-02T22:36:40.023460] [INFO ] [MAIN ] CNNE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:40.023390] [INFO ] [MAIN ] CNO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:40.023301] [INFO ] [MAIN ] CNMD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:40.087912] [DEBUG] [LOCAL ] CNNE: Loaded 36641 existing records from primary storage. [2025-10-02T22:36:40.097599] [INFO ] [MAIN ] CNNE: Loaded 36641 primary data records. [2025-10-02T22:36:40.109737] [DEBUG] [LOCAL ] CNMD: Loaded 32498 existing records from primary storage. [2025-10-02T22:36:40.168970] [DEBUG] [LOCAL ] CNO: Loaded 41454 existing records from primary storage. [2025-10-02T22:36:40.160717] [INFO ] [MAIN ] CNMD: Loaded 32498 primary data records. [2025-10-02T22:36:40.197404] [INFO ] [MAIN ] CNO: Loaded 41454 primary data records. [2025-10-02T22:36:41.200836] [DEBUG] [MAIN ] CNNE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:41.214354] [INFO ] [MAIN ] CNNE: Generated 1807 derivative records from 36641 primary records. [2025-10-02T22:36:41.214564] [DEBUG] [MAIN ] CNO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:41.222983] [INFO ] [MAIN ] CNO: Generated 1807 derivative records from 41454 primary records. [2025-10-02T22:36:41.228197] [DEBUG] [MAIN ] CNMD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:41.227631] [DEBUG] [LOCAL ] CNNE: Saving derivative data. [2025-10-02T22:36:41.227962] [DEBUG] [LOCAL ] CNO: Saving derivative data. [2025-10-02T22:36:41.228902] [INFO ] [MAIN ] CNMD: Generated 1807 derivative records from 32498 primary records. [2025-10-02T22:36:41.230728] [DEBUG] [LOCAL ] CNMD: Saving derivative data. [2025-10-02T22:36:41.273011] [DEBUG] [LOCAL ] CNNE: Derivative data saved (1807 records). [2025-10-02T22:36:41.274133] [INFO ] [MAIN ] CNNE: Successfully saved derivative data. [2025-10-02T22:36:41.276153] [INFO ] [MAIN ] Derivative Progress: 406/1975 symbols completed. CNNE took 1.3s. Estimated remaining: 11m 4s. Rate: 141.7 symbols/min [2025-10-02T22:36:41.276577] [INFO ] [MAIN ] CNP: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:41.282955] [DEBUG] [LOCAL ] CNO: Derivative data saved (1807 records). [2025-10-02T22:36:41.283500] [DEBUG] [LOCAL ] CNMD: Derivative data saved (1807 records). [2025-10-02T22:36:41.283788] [INFO ] [MAIN ] CNO: Successfully saved derivative data. [2025-10-02T22:36:41.283703] [INFO ] [MAIN ] CNMD: Successfully saved derivative data. [2025-10-02T22:36:41.285862] [INFO ] [MAIN ] Derivative Progress: 407/1975 symbols completed. CNMD took 1.3s. Estimated remaining: 11m 2s. Rate: 142.0 symbols/min [2025-10-02T22:36:41.288398] [INFO ] [MAIN ] CNQ: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:41.288571] [INFO ] [MAIN ] Derivative Progress: 408/1975 symbols completed. CNO took 1.3s. Estimated remaining: 11m 0s. Rate: 142.4 symbols/min [2025-10-02T22:36:41.288740] [INFO ] [MAIN ] CNS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:41.311614] [DEBUG] [LOCAL ] CNS: Loaded 20779 existing records from primary storage. [2025-10-02T22:36:41.311886] [INFO ] [MAIN ] CNS: Loaded 20779 primary data records. [2025-10-02T22:36:41.501667] [DEBUG] [LOCAL ] CNP: Loaded 53859 existing records from primary storage. [2025-10-02T22:36:41.527704] [INFO ] [MAIN ] CNP: Loaded 53859 primary data records. [2025-10-02T22:36:41.717960] [DEBUG] [LOCAL ] CNQ: Loaded 53970 existing records from primary storage. [2025-10-02T22:36:41.737036] [INFO ] [MAIN ] CNQ: Loaded 53970 primary data records. [2025-10-02T22:36:42.422829] [DEBUG] [MAIN ] CNS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:42.424868] [INFO ] [MAIN ] CNS: Generated 1807 derivative records from 20779 primary records. [2025-10-02T22:36:42.425285] [DEBUG] [LOCAL ] CNS: Saving derivative data. [2025-10-02T22:36:42.443840] [DEBUG] [LOCAL ] CNS: Derivative data saved (1807 records). [2025-10-02T22:36:42.444164] [INFO ] [MAIN ] CNS: Successfully saved derivative data. [2025-10-02T22:36:42.446230] [INFO ] [MAIN ] Derivative Progress: 409/1975 symbols completed. CNS took 1.2s. Estimated remaining: 11m 3s. Rate: 141.8 symbols/min [2025-10-02T22:36:42.446571] [INFO ] [MAIN ] CODI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:42.467760] [DEBUG] [MAIN ] CNP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:42.469537] [INFO ] [MAIN ] CNP: Generated 1807 derivative records from 53859 primary records. [2025-10-02T22:36:42.470306] [DEBUG] [LOCAL ] CNP: Saving derivative data. [2025-10-02T22:36:42.498801] [DEBUG] [MAIN ] CNQ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:42.501054] [DEBUG] [LOCAL ] CNP: Derivative data saved (1807 records). [2025-10-02T22:36:42.512346] [INFO ] [MAIN ] CNP: Successfully saved derivative data. [2025-10-02T22:36:42.501786] [INFO ] [MAIN ] CNQ: Generated 1807 derivative records from 53970 primary records. [2025-10-02T22:36:42.512439] [DEBUG] [LOCAL ] CNQ: Saving derivative data. [2025-10-02T22:36:42.514396] [INFO ] [MAIN ] Derivative Progress: 410/1975 symbols completed. CNP took 1.2s. Estimated remaining: 11m 1s. Rate: 142.1 symbols/min [2025-10-02T22:36:42.515361] [INFO ] [MAIN ] COF: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:42.545669] [DEBUG] [LOCAL ] CODI: Loaded 40283 existing records from primary storage. [2025-10-02T22:36:42.547076] [INFO ] [MAIN ] CODI: Loaded 40283 primary data records. [2025-10-02T22:36:42.584709] [DEBUG] [LOCAL ] CNQ: Derivative data saved (1807 records). [2025-10-02T22:36:42.599475] [INFO ] [MAIN ] CNQ: Successfully saved derivative data. [2025-10-02T22:36:42.617187] [INFO ] [MAIN ] Derivative Progress: 411/1975 symbols completed. CNQ took 1.3s. Estimated remaining: 10m 59s. Rate: 142.3 symbols/min [2025-10-02T22:36:42.642240] [INFO ] [MAIN ] COLD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:42.915680] [DEBUG] [LOCAL ] COF: Loaded 53999 existing records from primary storage. [2025-10-02T22:36:42.916055] [INFO ] [MAIN ] COF: Loaded 53999 primary data records. [2025-10-02T22:36:43.115845] [DEBUG] [LOCAL ] COLD: Loaded 52465 existing records from primary storage. [2025-10-02T22:36:43.122562] [INFO ] [MAIN ] COLD: Loaded 52465 primary data records. [2025-10-02T22:36:43.615807] [DEBUG] [MAIN ] CODI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:43.709141] [INFO ] [MAIN ] CODI: Generated 1807 derivative records from 40283 primary records. [2025-10-02T22:36:43.743410] [DEBUG] [LOCAL ] CODI: Saving derivative data. [2025-10-02T22:36:43.764027] [DEBUG] [LOCAL ] CODI: Derivative data saved (1807 records). [2025-10-02T22:36:43.764579] [INFO ] [MAIN ] CODI: Successfully saved derivative data. [2025-10-02T22:36:43.767034] [INFO ] [MAIN ] Derivative Progress: 412/1975 symbols completed. CODI took 1.3s. Estimated remaining: 11m 2s. Rate: 141.7 symbols/min [2025-10-02T22:36:43.767709] [INFO ] [MAIN ] CON: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:43.787752] [DEBUG] [MAIN ] COF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:43.788858] [INFO ] [MAIN ] COF: Generated 1807 derivative records from 53999 primary records. [2025-10-02T22:36:43.789129] [DEBUG] [LOCAL ] COF: Saving derivative data. [2025-10-02T22:36:43.807867] [DEBUG] [LOCAL ] COF: Derivative data saved (1807 records). [2025-10-02T22:36:43.808910] [INFO ] [MAIN ] COF: Successfully saved derivative data. [2025-10-02T22:36:43.811079] [INFO ] [MAIN ] Derivative Progress: 413/1975 symbols completed. COF took 1.3s. Estimated remaining: 10m 60s. Rate: 142.0 symbols/min [2025-10-02T22:36:43.812238] [INFO ] [MAIN ] COOK: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:43.837302] [DEBUG] [MAIN ] COLD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:43.838127] [INFO ] [MAIN ] COLD: Generated 1807 derivative records from 52465 primary records. [2025-10-02T22:36:43.838258] [DEBUG] [LOCAL ] COLD: Saving derivative data. [2025-10-02T22:36:43.869103] [DEBUG] [LOCAL ] CON: Loaded 39102 existing records from primary storage. [2025-10-02T22:36:43.869886] [INFO ] [MAIN ] CON: Loaded 39102 primary data records. [2025-10-02T22:36:43.940946] [DEBUG] [LOCAL ] COOK: Loaded 24479 existing records from primary storage. [2025-10-02T22:36:43.957351] [DEBUG] [LOCAL ] COLD: Derivative data saved (1807 records). [2025-10-02T22:36:43.957227] [INFO ] [MAIN ] COOK: Loaded 24479 primary data records. [2025-10-02T22:36:43.957542] [INFO ] [MAIN ] COLD: Successfully saved derivative data. [2025-10-02T22:36:43.986601] [INFO ] [MAIN ] Derivative Progress: 414/1975 symbols completed. COLD took 1.3s. Estimated remaining: 10m 58s. Rate: 142.2 symbols/min [2025-10-02T22:36:44.068932] [INFO ] [MAIN ] COP: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:44.594306] [DEBUG] [LOCAL ] COP: Loaded 54117 existing records from primary storage. [2025-10-02T22:36:44.594695] [INFO ] [MAIN ] COP: Loaded 54117 primary data records. [2025-10-02T22:36:44.804914] [DEBUG] [MAIN ] COOK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:44.850627] [DEBUG] [MAIN ] CON: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:44.850275] [INFO ] [MAIN ] COOK: Generated 1807 derivative records from 24479 primary records. [2025-10-02T22:36:44.966057] [INFO ] [MAIN ] CON: Generated 1807 derivative records from 39102 primary records. [2025-10-02T22:36:44.966212] [DEBUG] [LOCAL ] COOK: Saving derivative data. [2025-10-02T22:36:44.980606] [DEBUG] [LOCAL ] CON: Saving derivative data. [2025-10-02T22:36:45.020906] [DEBUG] [LOCAL ] CON: Derivative data saved (1807 records). [2025-10-02T22:36:45.022797] [INFO ] [MAIN ] CON: Successfully saved derivative data. [2025-10-02T22:36:45.025280] [INFO ] [MAIN ] Derivative Progress: 415/1975 symbols completed. CON took 1.3s. Estimated remaining: 11m 0s. Rate: 141.7 symbols/min [2025-10-02T22:36:45.025478] [DEBUG] [LOCAL ] COOK: Derivative data saved (1807 records). [2025-10-02T22:36:45.025974] [INFO ] [MAIN ] COR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:45.026181] [INFO ] [MAIN ] COOK: Successfully saved derivative data. [2025-10-02T22:36:45.028969] [INFO ] [MAIN ] Derivative Progress: 416/1975 symbols completed. COOK took 1.2s. Estimated remaining: 10m 58s. Rate: 142.1 symbols/min [2025-10-02T22:36:45.030418] [INFO ] [MAIN ] COTY: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:45.064887] [DEBUG] [MAIN ] COP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:45.065689] [INFO ] [MAIN ] COP: Generated 1807 derivative records from 54117 primary records. [2025-10-02T22:36:45.066012] [DEBUG] [LOCAL ] COP: Saving derivative data. [2025-10-02T22:36:45.113393] [DEBUG] [LOCAL ] COP: Derivative data saved (1807 records). [2025-10-02T22:36:45.128012] [INFO ] [MAIN ] COP: Successfully saved derivative data. [2025-10-02T22:36:45.130375] [INFO ] [MAIN ] Derivative Progress: 417/1975 symbols completed. COP took 1.1s. Estimated remaining: 10m 57s. Rate: 142.3 symbols/min [2025-10-02T22:36:45.131731] [INFO ] [MAIN ] COUR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:45.131392] [DEBUG] [LOCAL ] COR: Loaded 47382 existing records from primary storage. [2025-10-02T22:36:45.132574] [INFO ] [MAIN ] COR: Loaded 47382 primary data records. [2025-10-02T22:36:45.254674] [DEBUG] [LOCAL ] COTY: Loaded 53616 existing records from primary storage. [2025-10-02T22:36:45.267566] [INFO ] [MAIN ] COTY: Loaded 53616 primary data records. [2025-10-02T22:36:45.718258] [DEBUG] [LOCAL ] COUR: Loaded 49263 existing records from primary storage. [2025-10-02T22:36:45.765075] [INFO ] [MAIN ] COUR: Loaded 49263 primary data records. [2025-10-02T22:36:46.350224] [DEBUG] [MAIN ] COR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:46.361118] [INFO ] [MAIN ] COR: Generated 1807 derivative records from 47382 primary records. [2025-10-02T22:36:46.362134] [DEBUG] [LOCAL ] COR: Saving derivative data. [2025-10-02T22:36:46.391753] [DEBUG] [MAIN ] COTY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:46.394198] [INFO ] [MAIN ] COTY: Generated 1807 derivative records from 53616 primary records. [2025-10-02T22:36:46.394797] [DEBUG] [LOCAL ] COTY: Saving derivative data. [2025-10-02T22:36:46.412891] [DEBUG] [LOCAL ] COR: Derivative data saved (1807 records). [2025-10-02T22:36:46.417173] [DEBUG] [LOCAL ] COTY: Derivative data saved (1807 records). [2025-10-02T22:36:46.418419] [INFO ] [MAIN ] COTY: Successfully saved derivative data. [2025-10-02T22:36:46.420744] [INFO ] [MAIN ] Derivative Progress: 418/1975 symbols completed. COTY took 1.4s. Estimated remaining: 10m 60s. Rate: 141.6 symbols/min [2025-10-02T22:36:46.418293] [INFO ] [MAIN ] COR: Successfully saved derivative data. [2025-10-02T22:36:46.423335] [INFO ] [MAIN ] Derivative Progress: 419/1975 symbols completed. COR took 1.4s. Estimated remaining: 10m 58s. Rate: 142.0 symbols/min [2025-10-02T22:36:46.441868] [DEBUG] [MAIN ] COUR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:46.442543] [INFO ] [MAIN ] COUR: Generated 1807 derivative records from 49263 primary records. [2025-10-02T22:36:46.442607] [DEBUG] [LOCAL ] COUR: Saving derivative data. [2025-10-02T22:36:46.459887] [DEBUG] [LOCAL ] COUR: Derivative data saved (1807 records). [2025-10-02T22:36:46.460024] [INFO ] [MAIN ] COUR: Successfully saved derivative data. [2025-10-02T22:36:46.462906] [INFO ] [MAIN ] Derivative Progress: 420/1975 symbols completed. COUR took 1.3s. Estimated remaining: 10m 56s. Rate: 142.3 symbols/min [2025-10-02T22:36:46.463388] [INFO ] [MAIN ] CP: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:46.463483] [INFO ] [MAIN ] CPF: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:46.463619] [INFO ] [MAIN ] CPAY: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:46.487812] [DEBUG] [LOCAL ] CPF: Loaded 15271 existing records from primary storage. [2025-10-02T22:36:46.488074] [INFO ] [MAIN ] CPF: Loaded 15271 primary data records. [2025-10-02T22:36:46.647782] [DEBUG] [LOCAL ] CPAY: Loaded 30849 existing records from primary storage. [2025-10-02T22:36:46.663004] [INFO ] [MAIN ] CPAY: Loaded 30849 primary data records. [2025-10-02T22:36:46.848915] [DEBUG] [LOCAL ] CP: Loaded 53656 existing records from primary storage. [2025-10-02T22:36:46.961267] [INFO ] [MAIN ] CP: Loaded 53656 primary data records. [2025-10-02T22:36:47.579756] [DEBUG] [MAIN ] CPF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:47.583857] [INFO ] [MAIN ] CPF: Generated 1807 derivative records from 15271 primary records. [2025-10-02T22:36:47.584259] [DEBUG] [LOCAL ] CPF: Saving derivative data. [2025-10-02T22:36:47.614104] [DEBUG] [MAIN ] CPAY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:47.616308] [INFO ] [MAIN ] CPAY: Generated 1807 derivative records from 30849 primary records. [2025-10-02T22:36:47.616850] [DEBUG] [LOCAL ] CPAY: Saving derivative data. [2025-10-02T22:36:47.618084] [DEBUG] [LOCAL ] CPF: Derivative data saved (1807 records). [2025-10-02T22:36:47.618932] [INFO ] [MAIN ] CPF: Successfully saved derivative data. [2025-10-02T22:36:47.621004] [INFO ] [MAIN ] Derivative Progress: 421/1975 symbols completed. CPF took 1.2s. Estimated remaining: 10m 58s. Rate: 141.7 symbols/min [2025-10-02T22:36:47.629175] [INFO ] [MAIN ] CPK: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:47.641163] [DEBUG] [LOCAL ] CPAY: Derivative data saved (1807 records). [2025-10-02T22:36:47.654422] [INFO ] [MAIN ] CPAY: Successfully saved derivative data. [2025-10-02T22:36:47.657302] [DEBUG] [MAIN ] CP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:47.656889] [INFO ] [MAIN ] Derivative Progress: 422/1975 symbols completed. CPAY took 1.2s. Estimated remaining: 10m 56s. Rate: 142.0 symbols/min [2025-10-02T22:36:47.658259] [INFO ] [MAIN ] CP: Generated 1807 derivative records from 53656 primary records. [2025-10-02T22:36:47.662357] [INFO ] [MAIN ] CPNG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:47.662730] [DEBUG] [LOCAL ] CP: Saving derivative data. [2025-10-02T22:36:47.683624] [DEBUG] [LOCAL ] CPK: Loaded 13609 existing records from primary storage. [2025-10-02T22:36:47.686232] [DEBUG] [LOCAL ] CP: Derivative data saved (1807 records). [2025-10-02T22:36:47.686324] [INFO ] [MAIN ] CP: Successfully saved derivative data. [2025-10-02T22:36:47.685447] [INFO ] [MAIN ] CPK: Loaded 13609 primary data records. [2025-10-02T22:36:47.694778] [INFO ] [MAIN ] Derivative Progress: 423/1975 symbols completed. CP took 1.2s. Estimated remaining: 10m 54s. Rate: 142.3 symbols/min [2025-10-02T22:36:47.712178] [INFO ] [MAIN ] CPRI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:48.098251] [DEBUG] [LOCAL ] CPNG: Loaded 54061 existing records from primary storage. [2025-10-02T22:36:48.099321] [INFO ] [MAIN ] CPNG: Loaded 54061 primary data records. [2025-10-02T22:36:48.229689] [DEBUG] [LOCAL ] CPRI: Loaded 52920 existing records from primary storage. [2025-10-02T22:36:48.234179] [INFO ] [MAIN ] CPRI: Loaded 52920 primary data records. [2025-10-02T22:36:48.805978] [DEBUG] [MAIN ] CPK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:48.807743] [INFO ] [MAIN ] CPK: Generated 1807 derivative records from 13609 primary records. [2025-10-02T22:36:48.808026] [DEBUG] [LOCAL ] CPK: Saving derivative data. [2025-10-02T22:36:48.829567] [DEBUG] [LOCAL ] CPK: Derivative data saved (1807 records). [2025-10-02T22:36:48.830033] [INFO ] [MAIN ] CPK: Successfully saved derivative data. [2025-10-02T22:36:48.832718] [INFO ] [MAIN ] Derivative Progress: 424/1975 symbols completed. CPK took 1.2s. Estimated remaining: 10m 57s. Rate: 141.7 symbols/min [2025-10-02T22:36:48.833504] [INFO ] [MAIN ] CPS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:48.856533] [DEBUG] [MAIN ] CPNG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:48.857407] [INFO ] [MAIN ] CPNG: Generated 1807 derivative records from 54061 primary records. [2025-10-02T22:36:48.857669] [DEBUG] [LOCAL ] CPNG: Saving derivative data. [2025-10-02T22:36:48.899270] [DEBUG] [LOCAL ] CPNG: Derivative data saved (1807 records). [2025-10-02T22:36:48.907975] [DEBUG] [MAIN ] CPRI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:48.907673] [INFO ] [MAIN ] CPNG: Successfully saved derivative data. [2025-10-02T22:36:48.911576] [INFO ] [MAIN ] Derivative Progress: 425/1975 symbols completed. CPNG took 1.2s. Estimated remaining: 10m 55s. Rate: 142.0 symbols/min [2025-10-02T22:36:48.913424] [INFO ] [MAIN ] CPRI: Generated 1807 derivative records from 52920 primary records. [2025-10-02T22:36:48.912538] [DEBUG] [LOCAL ] CPS: Loaded 26039 existing records from primary storage. [2025-10-02T22:36:48.913626] [INFO ] [MAIN ] CPS: Loaded 26039 primary data records. [2025-10-02T22:36:48.913768] [DEBUG] [LOCAL ] CPRI: Saving derivative data. [2025-10-02T22:36:48.913900] [INFO ] [MAIN ] CPT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:49.062566] [DEBUG] [LOCAL ] CPRI: Derivative data saved (1807 records). [2025-10-02T22:36:49.068062] [INFO ] [MAIN ] CPRI: Successfully saved derivative data. [2025-10-02T22:36:49.075350] [INFO ] [MAIN ] Derivative Progress: 426/1975 symbols completed. CPRI took 1.4s. Estimated remaining: 10m 53s. Rate: 142.2 symbols/min [2025-10-02T22:36:49.075604] [INFO ] [MAIN ] CQP: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:49.291187] [DEBUG] [LOCAL ] CQP: Loaded 19574 existing records from primary storage. [2025-10-02T22:36:49.293450] [INFO ] [MAIN ] CQP: Loaded 19574 primary data records. [2025-10-02T22:36:49.371808] [DEBUG] [LOCAL ] CPT: Loaded 44684 existing records from primary storage. [2025-10-02T22:36:49.399335] [INFO ] [MAIN ] CPT: Loaded 44684 primary data records. [2025-10-02T22:36:49.879738] [DEBUG] [MAIN ] CPS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:50.057382] [INFO ] [MAIN ] CPS: Generated 1807 derivative records from 26039 primary records. [2025-10-02T22:36:50.058560] [DEBUG] [LOCAL ] CPS: Saving derivative data. [2025-10-02T22:36:50.079827] [DEBUG] [LOCAL ] CPS: Derivative data saved (1807 records). [2025-10-02T22:36:50.080184] [INFO ] [MAIN ] CPS: Successfully saved derivative data. [2025-10-02T22:36:50.082974] [INFO ] [MAIN ] Derivative Progress: 427/1975 symbols completed. CPS took 1.2s. Estimated remaining: 10m 55s. Rate: 141.8 symbols/min [2025-10-02T22:36:50.083359] [INFO ] [MAIN ] CR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:50.102033] [DEBUG] [MAIN ] CQP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:50.102981] [INFO ] [MAIN ] CQP: Generated 1807 derivative records from 19574 primary records. [2025-10-02T22:36:50.103349] [DEBUG] [LOCAL ] CQP: Saving derivative data. [2025-10-02T22:36:50.127248] [DEBUG] [LOCAL ] CQP: Derivative data saved (1807 records). [2025-10-02T22:36:50.128119] [INFO ] [MAIN ] CQP: Successfully saved derivative data. [2025-10-02T22:36:50.130364] [INFO ] [MAIN ] Derivative Progress: 428/1975 symbols completed. CQP took 1.1s. Estimated remaining: 10m 53s. Rate: 142.1 symbols/min [2025-10-02T22:36:50.132956] [INFO ] [MAIN ] CRBD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:50.162380] [DEBUG] [MAIN ] CPT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:50.163190] [INFO ] [MAIN ] CPT: Generated 1807 derivative records from 44684 primary records. [2025-10-02T22:36:50.165563] [DEBUG] [LOCAL ] CPT: Saving derivative data. [2025-10-02T22:36:50.167313] [DEBUG] [LOCAL ] CR: Loaded 24566 existing records from primary storage. [2025-10-02T22:36:50.167609] [INFO ] [MAIN ] CR: Loaded 24566 primary data records. [2025-10-02T22:36:50.229417] [DEBUG] [LOCAL ] CRBD: Loaded 9065 existing records from primary storage. [2025-10-02T22:36:50.240730] [INFO ] [MAIN ] CRBD: Loaded 9065 primary data records. [2025-10-02T22:36:50.433585] [DEBUG] [LOCAL ] CPT: Derivative data saved (1807 records). [2025-10-02T22:36:50.438942] [INFO ] [MAIN ] CPT: Successfully saved derivative data. [2025-10-02T22:36:50.489319] [INFO ] [MAIN ] Derivative Progress: 429/1975 symbols completed. CPT took 1.6s. Estimated remaining: 10m 53s. Rate: 142.1 symbols/min [2025-10-02T22:36:50.513813] [INFO ] [MAIN ] CRBG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:50.923566] [DEBUG] [MAIN ] CR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:50.924491] [INFO ] [MAIN ] CR: Generated 1807 derivative records from 24566 primary records. [2025-10-02T22:36:50.927692] [DEBUG] [LOCAL ] CR: Saving derivative data. [2025-10-02T22:36:50.975549] [DEBUG] [MAIN ] CRBD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:50.978420] [INFO ] [MAIN ] CRBD: Generated 1807 derivative records from 9065 primary records. [2025-10-02T22:36:50.979282] [DEBUG] [LOCAL ] CRBD: Saving derivative data. [2025-10-02T22:36:50.977009] [DEBUG] [LOCAL ] CRBG: Loaded 52747 existing records from primary storage. [2025-10-02T22:36:50.981064] [INFO ] [MAIN ] CRBG: Loaded 52747 primary data records. [2025-10-02T22:36:51.045291] [DEBUG] [LOCAL ] CR: Derivative data saved (1807 records). [2025-10-02T22:36:51.051286] [INFO ] [MAIN ] CR: Successfully saved derivative data. [2025-10-02T22:36:51.070920] [INFO ] [MAIN ] Derivative Progress: 430/1975 symbols completed. CR took 1.0s. Estimated remaining: 10m 53s. Rate: 142.0 symbols/min [2025-10-02T22:36:51.101706] [DEBUG] [LOCAL ] CRBD: Derivative data saved (1807 records). [2025-10-02T22:36:51.124888] [INFO ] [MAIN ] CRBD: Successfully saved derivative data. [2025-10-02T22:36:51.119679] [INFO ] [MAIN ] CRC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:51.145778] [INFO ] [MAIN ] Derivative Progress: 431/1975 symbols completed. CRBD took 1.0s. Estimated remaining: 10m 51s. Rate: 142.3 symbols/min [2025-10-02T22:36:51.146391] [INFO ] [MAIN ] CRGY: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:51.416278] [DEBUG] [LOCAL ] CRC: Loaded 44370 existing records from primary storage. [2025-10-02T22:36:51.418833] [INFO ] [MAIN ] CRC: Loaded 44370 primary data records. [2025-10-02T22:36:51.506805] [DEBUG] [LOCAL ] CRGY: Loaded 52894 existing records from primary storage. [2025-10-02T22:36:51.534732] [INFO ] [MAIN ] CRGY: Loaded 52894 primary data records. [2025-10-02T22:36:51.540553] [DEBUG] [MAIN ] CRBG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:51.567786] [INFO ] [MAIN ] CRBG: Generated 1807 derivative records from 52747 primary records. [2025-10-02T22:36:51.640261] [DEBUG] [LOCAL ] CRBG: Saving derivative data. [2025-10-02T22:36:52.125355] [DEBUG] [LOCAL ] CRBG: Derivative data saved (1807 records). [2025-10-02T22:36:52.125755] [INFO ] [MAIN ] CRBG: Successfully saved derivative data. [2025-10-02T22:36:52.128170] [INFO ] [MAIN ] Derivative Progress: 432/1975 symbols completed. CRBG took 1.6s. Estimated remaining: 10m 53s. Rate: 141.8 symbols/min [2025-10-02T22:36:52.128578] [INFO ] [MAIN ] CRH: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:52.160129] [DEBUG] [MAIN ] CRC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:52.162329] [INFO ] [MAIN ] CRC: Generated 1807 derivative records from 44370 primary records. [2025-10-02T22:36:52.162475] [DEBUG] [LOCAL ] CRC: Saving derivative data. [2025-10-02T22:36:52.189112] [DEBUG] [MAIN ] CRGY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:52.191160] [INFO ] [MAIN ] CRGY: Generated 1807 derivative records from 52894 primary records. [2025-10-02T22:36:52.191498] [DEBUG] [LOCAL ] CRGY: Saving derivative data. [2025-10-02T22:36:52.224263] [DEBUG] [LOCAL ] CRC: Derivative data saved (1807 records). [2025-10-02T22:36:52.224918] [INFO ] [MAIN ] CRC: Successfully saved derivative data. [2025-10-02T22:36:52.228446] [INFO ] [MAIN ] Derivative Progress: 433/1975 symbols completed. CRC took 1.1s. Estimated remaining: 10m 51s. Rate: 142.1 symbols/min [2025-10-02T22:36:52.246814] [DEBUG] [LOCAL ] CRGY: Derivative data saved (1807 records). [2025-10-02T22:36:52.246968] [INFO ] [MAIN ] CRGY: Successfully saved derivative data. [2025-10-02T22:36:52.249192] [INFO ] [MAIN ] Derivative Progress: 434/1975 symbols completed. CRGY took 1.1s. Estimated remaining: 10m 49s. Rate: 142.4 symbols/min [2025-10-02T22:36:52.250353] [DEBUG] [LOCAL ] CRH: Loaded 53852 existing records from primary storage. [2025-10-02T22:36:52.250724] [INFO ] [MAIN ] CRH: Loaded 53852 primary data records. [2025-10-02T22:36:52.643338] [DEBUG] [MAIN ] CRH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:52.644137] [INFO ] [MAIN ] CRH: Generated 1807 derivative records from 53852 primary records. [2025-10-02T22:36:52.644206] [DEBUG] [LOCAL ] CRH: Saving derivative data. [2025-10-02T22:36:52.661192] [DEBUG] [LOCAL ] CRH: Derivative data saved (1807 records). [2025-10-02T22:36:52.661318] [INFO ] [MAIN ] CRH: Successfully saved derivative data. [2025-10-02T22:36:52.663514] [INFO ] [MAIN ] Derivative Progress: 435/1975 symbols completed. CRH took 0.5s. Estimated remaining: 10m 49s. Rate: 142.4 symbols/min [2025-10-02T22:36:52.664262] [INFO ] [MAIN ] CRL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:52.664190] [INFO ] [MAIN ] CRK: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:52.664095] [INFO ] [MAIN ] CRI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:52.755099] [DEBUG] [LOCAL ] CRL: Loaded 43331 existing records from primary storage. [2025-10-02T22:36:52.756848] [INFO ] [MAIN ] CRL: Loaded 43331 primary data records. [2025-10-02T22:36:52.770728] [DEBUG] [LOCAL ] CRK: Loaded 52539 existing records from primary storage. [2025-10-02T22:36:52.824791] [INFO ] [MAIN ] CRK: Loaded 52539 primary data records. [2025-10-02T22:36:52.909294] [DEBUG] [LOCAL ] CRI: Loaded 50218 existing records from primary storage. [2025-10-02T22:36:52.931444] [INFO ] [MAIN ] CRI: Loaded 50218 primary data records. [2025-10-02T22:36:53.863716] [DEBUG] [MAIN ] CRL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:53.870568] [INFO ] [MAIN ] CRL: Generated 1807 derivative records from 43331 primary records. [2025-10-02T22:36:53.870711] [DEBUG] [LOCAL ] CRL: Saving derivative data. [2025-10-02T22:36:53.869704] [DEBUG] [MAIN ] CRK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:53.872483] [INFO ] [MAIN ] CRK: Generated 1807 derivative records from 52539 primary records. [2025-10-02T22:36:53.872912] [DEBUG] [LOCAL ] CRK: Saving derivative data. [2025-10-02T22:36:53.892843] [DEBUG] [LOCAL ] CRL: Derivative data saved (1807 records). [2025-10-02T22:36:53.900711] [INFO ] [MAIN ] CRL: Successfully saved derivative data. [2025-10-02T22:36:53.920771] [DEBUG] [MAIN ] CRI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:53.920304] [INFO ] [MAIN ] Derivative Progress: 436/1975 symbols completed. CRL took 1.3s. Estimated remaining: 10m 51s. Rate: 141.7 symbols/min [2025-10-02T22:36:53.921986] [INFO ] [MAIN ] CRI: Generated 1807 derivative records from 50218 primary records. [2025-10-02T22:36:53.922461] [INFO ] [MAIN ] CRM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:53.922371] [DEBUG] [LOCAL ] CRI: Saving derivative data. [2025-10-02T22:36:53.941002] [DEBUG] [LOCAL ] CRK: Derivative data saved (1807 records). [2025-10-02T22:36:53.941799] [INFO ] [MAIN ] CRK: Successfully saved derivative data. [2025-10-02T22:36:53.944275] [INFO ] [MAIN ] Derivative Progress: 437/1975 symbols completed. CRK took 1.3s. Estimated remaining: 10m 50s. Rate: 142.0 symbols/min [2025-10-02T22:36:53.946396] [INFO ] [MAIN ] CRS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:53.947383] [DEBUG] [LOCAL ] CRI: Derivative data saved (1807 records). [2025-10-02T22:36:53.947608] [INFO ] [MAIN ] CRI: Successfully saved derivative data. [2025-10-02T22:36:53.949769] [INFO ] [MAIN ] Derivative Progress: 438/1975 symbols completed. CRI took 1.3s. Estimated remaining: 10m 48s. Rate: 142.4 symbols/min [2025-10-02T22:36:53.950392] [INFO ] [MAIN ] CRT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:53.959114] [DEBUG] [LOCAL ] CRT: Loaded 5011 existing records from primary storage. [2025-10-02T22:36:53.959316] [INFO ] [MAIN ] CRT: Loaded 5011 primary data records. [2025-10-02T22:36:54.180977] [DEBUG] [LOCAL ] CRM: Loaded 54160 existing records from primary storage. [2025-10-02T22:36:54.212971] [INFO ] [MAIN ] CRM: Loaded 54160 primary data records. [2025-10-02T22:36:54.401596] [DEBUG] [LOCAL ] CRS: Loaded 43533 existing records from primary storage. [2025-10-02T22:36:54.416554] [INFO ] [MAIN ] CRS: Loaded 43533 primary data records. [2025-10-02T22:36:55.154515] [DEBUG] [MAIN ] CRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:55.155701] [INFO ] [MAIN ] CRT: Generated 1807 derivative records from 5011 primary records. [2025-10-02T22:36:55.156461] [DEBUG] [LOCAL ] CRT: Saving derivative data. [2025-10-02T22:36:55.178995] [DEBUG] [LOCAL ] CRT: Derivative data saved (1807 records). [2025-10-02T22:36:55.180962] [INFO ] [MAIN ] CRT: Successfully saved derivative data. [2025-10-02T22:36:55.183595] [INFO ] [MAIN ] Derivative Progress: 439/1975 symbols completed. CRT took 1.2s. Estimated remaining: 10m 50s. Rate: 141.7 symbols/min [2025-10-02T22:36:55.185487] [INFO ] [MAIN ] CSAN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:55.210633] [DEBUG] [MAIN ] CRS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:55.224509] [INFO ] [MAIN ] CRS: Generated 1807 derivative records from 43533 primary records. [2025-10-02T22:36:55.225905] [DEBUG] [MAIN ] CRM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:55.226887] [INFO ] [MAIN ] CRM: Generated 1807 derivative records from 54160 primary records. [2025-10-02T22:36:55.226146] [DEBUG] [LOCAL ] CRS: Saving derivative data. [2025-10-02T22:36:55.226978] [DEBUG] [LOCAL ] CRM: Saving derivative data. [2025-10-02T22:36:55.284358] [DEBUG] [LOCAL ] CRS: Derivative data saved (1807 records). [2025-10-02T22:36:55.286118] [INFO ] [MAIN ] CRS: Successfully saved derivative data. [2025-10-02T22:36:55.287748] [DEBUG] [LOCAL ] CSAN: Loaded 42614 existing records from primary storage. [2025-10-02T22:36:55.290119] [INFO ] [MAIN ] Derivative Progress: 440/1975 symbols completed. CRS took 1.3s. Estimated remaining: 10m 49s. Rate: 142.0 symbols/min [2025-10-02T22:36:55.287910] [INFO ] [MAIN ] CSAN: Loaded 42614 primary data records. [2025-10-02T22:36:55.290899] [INFO ] [MAIN ] CSL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:55.331757] [DEBUG] [LOCAL ] CRM: Derivative data saved (1807 records). [2025-10-02T22:36:55.353290] [INFO ] [MAIN ] CRM: Successfully saved derivative data. [2025-10-02T22:36:55.377868] [INFO ] [MAIN ] Derivative Progress: 441/1975 symbols completed. CRM took 1.5s. Estimated remaining: 10m 47s. Rate: 142.2 symbols/min [2025-10-02T22:36:55.411066] [INFO ] [MAIN ] CSR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:55.685259] [DEBUG] [LOCAL ] CSL: Loaded 31700 existing records from primary storage. [2025-10-02T22:36:55.684470] [DEBUG] [LOCAL ] CSR: Loaded 12887 existing records from primary storage. [2025-10-02T22:36:55.686190] [INFO ] [MAIN ] CSL: Loaded 31700 primary data records. [2025-10-02T22:36:55.686450] [INFO ] [MAIN ] CSR: Loaded 12887 primary data records. [2025-10-02T22:36:56.403395] [DEBUG] [MAIN ] CSAN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:56.405784] [INFO ] [MAIN ] CSAN: Generated 1807 derivative records from 42614 primary records. [2025-10-02T22:36:56.406103] [DEBUG] [LOCAL ] CSAN: Saving derivative data. [2025-10-02T22:36:56.429444] [DEBUG] [LOCAL ] CSAN: Derivative data saved (1807 records). [2025-10-02T22:36:56.430687] [INFO ] [MAIN ] CSAN: Successfully saved derivative data. [2025-10-02T22:36:56.434184] [INFO ] [MAIN ] Derivative Progress: 442/1975 symbols completed. CSAN took 1.2s. Estimated remaining: 10m 49s. Rate: 141.8 symbols/min [2025-10-02T22:36:56.434509] [INFO ] [MAIN ] CSTM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:56.464842] [DEBUG] [MAIN ] CSR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:56.465217] [DEBUG] [MAIN ] CSL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:56.466794] [INFO ] [MAIN ] CSR: Generated 1807 derivative records from 12887 primary records. [2025-10-02T22:36:56.466184] [INFO ] [MAIN ] CSL: Generated 1807 derivative records from 31700 primary records. [2025-10-02T22:36:56.466918] [DEBUG] [LOCAL ] CSR: Saving derivative data. [2025-10-02T22:36:56.467034] [DEBUG] [LOCAL ] CSL: Saving derivative data. [2025-10-02T22:36:56.500768] [DEBUG] [LOCAL ] CSL: Derivative data saved (1807 records). [2025-10-02T22:36:56.501873] [INFO ] [MAIN ] CSL: Successfully saved derivative data. [2025-10-02T22:36:56.501799] [DEBUG] [LOCAL ] CSR: Derivative data saved (1807 records). [2025-10-02T22:36:56.504075] [INFO ] [MAIN ] CSR: Successfully saved derivative data. [2025-10-02T22:36:56.503971] [INFO ] [MAIN ] Derivative Progress: 443/1975 symbols completed. CSL took 1.2s. Estimated remaining: 10m 47s. Rate: 142.0 symbols/min [2025-10-02T22:36:56.506170] [INFO ] [MAIN ] CSV: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:56.506389] [INFO ] [MAIN ] Derivative Progress: 444/1975 symbols completed. CSR took 1.1s. Estimated remaining: 10m 45s. Rate: 142.3 symbols/min [2025-10-02T22:36:56.506806] [INFO ] [MAIN ] CTBB: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:56.521403] [DEBUG] [LOCAL ] CSV: Loaded 12924 existing records from primary storage. [2025-10-02T22:36:56.521538] [INFO ] [MAIN ] CSV: Loaded 12924 primary data records. [2025-10-02T22:36:56.586689] [DEBUG] [LOCAL ] CTBB: Loaded 7097 existing records from primary storage. [2025-10-02T22:36:56.592123] [INFO ] [MAIN ] CTBB: Loaded 7097 primary data records. [2025-10-02T22:36:56.763945] [DEBUG] [LOCAL ] CSTM: Loaded 47784 existing records from primary storage. [2025-10-02T22:36:56.814195] [INFO ] [MAIN ] CSTM: Loaded 47784 primary data records. [2025-10-02T22:36:57.643758] [DEBUG] [MAIN ] CSV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:57.645524] [INFO ] [MAIN ] CSV: Generated 1807 derivative records from 12924 primary records. [2025-10-02T22:36:57.645630] [DEBUG] [LOCAL ] CSV: Saving derivative data. [2025-10-02T22:36:57.646543] [DEBUG] [MAIN ] CTBB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:57.648387] [INFO ] [MAIN ] CTBB: Generated 1807 derivative records from 7097 primary records. [2025-10-02T22:36:57.657965] [DEBUG] [LOCAL ] CTBB: Saving derivative data. [2025-10-02T22:36:57.683118] [DEBUG] [LOCAL ] CSV: Derivative data saved (1807 records). [2025-10-02T22:36:57.684512] [INFO ] [MAIN ] CSV: Successfully saved derivative data. [2025-10-02T22:36:57.687463] [INFO ] [MAIN ] Derivative Progress: 445/1975 symbols completed. CSV took 1.2s. Estimated remaining: 10m 48s. Rate: 141.8 symbols/min [2025-10-02T22:36:57.689284] [DEBUG] [LOCAL ] CTBB: Derivative data saved (1807 records). [2025-10-02T22:36:57.690732] [INFO ] [MAIN ] CTDD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:57.689613] [INFO ] [MAIN ] CTBB: Successfully saved derivative data. [2025-10-02T22:36:57.695014] [INFO ] [MAIN ] Derivative Progress: 446/1975 symbols completed. CTBB took 1.2s. Estimated remaining: 10m 46s. Rate: 142.1 symbols/min [2025-10-02T22:36:57.695287] [INFO ] [MAIN ] CTO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:57.711931] [DEBUG] [MAIN ] CSTM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:57.712804] [INFO ] [MAIN ] CSTM: Generated 1807 derivative records from 47784 primary records. [2025-10-02T22:36:57.712884] [DEBUG] [LOCAL ] CSTM: Saving derivative data. [2025-10-02T22:36:57.729798] [DEBUG] [LOCAL ] CTDD: Loaded 5926 existing records from primary storage. [2025-10-02T22:36:57.730400] [INFO ] [MAIN ] CTDD: Loaded 5926 primary data records. [2025-10-02T22:36:57.868350] [DEBUG] [LOCAL ] CSTM: Derivative data saved (1807 records). [2025-10-02T22:36:57.904111] [INFO ] [MAIN ] CSTM: Successfully saved derivative data. [2025-10-02T22:36:57.907193] [INFO ] [MAIN ] Derivative Progress: 447/1975 symbols completed. CSTM took 1.5s. Estimated remaining: 10m 45s. Rate: 142.2 symbols/min [2025-10-02T22:36:57.898867] [DEBUG] [LOCAL ] CTO: Loaded 28044 existing records from primary storage. [2025-10-02T22:36:57.912567] [INFO ] [MAIN ] CTOS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:57.946961] [INFO ] [MAIN ] CTO: Loaded 28044 primary data records. [2025-10-02T22:36:58.324226] [DEBUG] [LOCAL ] CTOS: Loaded 36860 existing records from primary storage. [2025-10-02T22:36:58.350591] [INFO ] [MAIN ] CTOS: Loaded 36860 primary data records. [2025-10-02T22:36:58.723667] [DEBUG] [MAIN ] CTDD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:58.741451] [INFO ] [MAIN ] CTDD: Generated 1807 derivative records from 5926 primary records. [2025-10-02T22:36:58.741593] [DEBUG] [LOCAL ] CTDD: Saving derivative data. [2025-10-02T22:36:58.937144] [DEBUG] [LOCAL ] CTDD: Derivative data saved (1807 records). [2025-10-02T22:36:58.937562] [INFO ] [MAIN ] CTDD: Successfully saved derivative data. [2025-10-02T22:36:58.941086] [INFO ] [MAIN ] Derivative Progress: 448/1975 symbols completed. CTDD took 1.3s. Estimated remaining: 10m 46s. Rate: 141.8 symbols/min [2025-10-02T22:36:58.959597] [DEBUG] [MAIN ] CTO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:58.960838] [INFO ] [MAIN ] CTO: Generated 1807 derivative records from 28044 primary records. [2025-10-02T22:36:58.961092] [DEBUG] [LOCAL ] CTO: Saving derivative data. [2025-10-02T22:36:58.984028] [DEBUG] [LOCAL ] CTO: Derivative data saved (1807 records). [2025-10-02T22:36:58.984282] [INFO ] [MAIN ] CTO: Successfully saved derivative data. [2025-10-02T22:36:58.986333] [INFO ] [MAIN ] Derivative Progress: 449/1975 symbols completed. CTO took 1.3s. Estimated remaining: 10m 44s. Rate: 142.1 symbols/min [2025-10-02T22:36:58.999524] [DEBUG] [MAIN ] CTOS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:36:59.000158] [INFO ] [MAIN ] CTOS: Generated 1807 derivative records from 36860 primary records. [2025-10-02T22:36:59.000222] [DEBUG] [LOCAL ] CTOS: Saving derivative data. [2025-10-02T22:36:59.016389] [DEBUG] [LOCAL ] CTOS: Derivative data saved (1807 records). [2025-10-02T22:36:59.016484] [INFO ] [MAIN ] CTOS: Successfully saved derivative data. [2025-10-02T22:36:59.019664] [INFO ] [MAIN ] Derivative Progress: 450/1975 symbols completed. CTOS took 1.1s. Estimated remaining: 10m 43s. Rate: 142.4 symbols/min [2025-10-02T22:36:59.020070] [INFO ] [MAIN ] CTRA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:59.020279] [INFO ] [MAIN ] CTRI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:59.020226] [INFO ] [MAIN ] CTRE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:36:59.091548] [DEBUG] [LOCAL ] CTRA: Loaded 54038 existing records from primary storage. [2025-10-02T22:36:59.091959] [INFO ] [MAIN ] CTRA: Loaded 54038 primary data records. [2025-10-02T22:36:59.189765] [DEBUG] [LOCAL ] CTRI: Loaded 39023 existing records from primary storage. [2025-10-02T22:36:59.205692] [INFO ] [MAIN ] CTRI: Loaded 39023 primary data records. [2025-10-02T22:36:59.273176] [DEBUG] [LOCAL ] CTRE: Loaded 49617 existing records from primary storage. [2025-10-02T22:36:59.300385] [INFO ] [MAIN ] CTRE: Loaded 49617 primary data records. [2025-10-02T22:37:00.162853] [DEBUG] [MAIN ] CTRA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:00.173158] [INFO ] [MAIN ] CTRA: Generated 1807 derivative records from 54038 primary records. [2025-10-02T22:37:00.180762] [DEBUG] [MAIN ] CTRI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:00.181632] [INFO ] [MAIN ] CTRI: Generated 1807 derivative records from 39023 primary records. [2025-10-02T22:37:00.180379] [DEBUG] [LOCAL ] CTRA: Saving derivative data. [2025-10-02T22:37:00.181856] [DEBUG] [LOCAL ] CTRI: Saving derivative data. [2025-10-02T22:37:00.221375] [DEBUG] [LOCAL ] CTRI: Derivative data saved (1807 records). [2025-10-02T22:37:00.221902] [DEBUG] [MAIN ] CTRE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:00.226772] [INFO ] [MAIN ] CTRE: Generated 1807 derivative records from 49617 primary records. [2025-10-02T22:37:00.225930] [INFO ] [MAIN ] CTRI: Successfully saved derivative data. [2025-10-02T22:37:00.230576] [INFO ] [MAIN ] Derivative Progress: 451/1975 symbols completed. CTRI took 1.2s. Estimated remaining: 10m 45s. Rate: 141.8 symbols/min [2025-10-02T22:37:00.230972] [DEBUG] [LOCAL ] CTRE: Saving derivative data. [2025-10-02T22:37:00.231085] [INFO ] [MAIN ] CTS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:00.235776] [DEBUG] [LOCAL ] CTRA: Derivative data saved (1807 records). [2025-10-02T22:37:00.247310] [INFO ] [MAIN ] CTRA: Successfully saved derivative data. [2025-10-02T22:37:00.249308] [INFO ] [MAIN ] Derivative Progress: 452/1975 symbols completed. CTRA took 1.2s. Estimated remaining: 10m 43s. Rate: 142.1 symbols/min [2025-10-02T22:37:00.252084] [INFO ] [MAIN ] CUBE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:00.256555] [DEBUG] [LOCAL ] CTRE: Derivative data saved (1807 records). [2025-10-02T22:37:00.256822] [INFO ] [MAIN ] CTRE: Successfully saved derivative data. [2025-10-02T22:37:00.259069] [INFO ] [MAIN ] Derivative Progress: 453/1975 symbols completed. CTRE took 1.2s. Estimated remaining: 10m 41s. Rate: 142.4 symbols/min [2025-10-02T22:37:00.259424] [INFO ] [MAIN ] CUBI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:00.280023] [DEBUG] [LOCAL ] CTS: Loaded 19508 existing records from primary storage. [2025-10-02T22:37:00.280199] [INFO ] [MAIN ] CTS: Loaded 19508 primary data records. [2025-10-02T22:37:00.445695] [DEBUG] [LOCAL ] CUBI: Loaded 27296 existing records from primary storage. [2025-10-02T22:37:00.467089] [INFO ] [MAIN ] CUBI: Loaded 27296 primary data records. [2025-10-02T22:37:00.738539] [DEBUG] [LOCAL ] CUBE: Loaded 51004 existing records from primary storage. [2025-10-02T22:37:00.752824] [INFO ] [MAIN ] CUBE: Loaded 51004 primary data records. [2025-10-02T22:37:01.420605] [DEBUG] [MAIN ] CTS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:01.422475] [INFO ] [MAIN ] CTS: Generated 1807 derivative records from 19508 primary records. [2025-10-02T22:37:01.423309] [DEBUG] [LOCAL ] CTS: Saving derivative data. [2025-10-02T22:37:01.462276] [DEBUG] [MAIN ] CUBI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:01.461894] [DEBUG] [LOCAL ] CTS: Derivative data saved (1807 records). [2025-10-02T22:37:01.463363] [INFO ] [MAIN ] CUBI: Generated 1807 derivative records from 27296 primary records. [2025-10-02T22:37:01.463621] [DEBUG] [LOCAL ] CUBI: Saving derivative data. [2025-10-02T22:37:01.464035] [INFO ] [MAIN ] CTS: Successfully saved derivative data. [2025-10-02T22:37:01.466504] [INFO ] [MAIN ] Derivative Progress: 454/1975 symbols completed. CTS took 1.2s. Estimated remaining: 10m 44s. Rate: 141.8 symbols/min [2025-10-02T22:37:01.481848] [INFO ] [MAIN ] CUK: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:01.500291] [DEBUG] [MAIN ] CUBE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:01.501896] [INFO ] [MAIN ] CUBE: Generated 1807 derivative records from 51004 primary records. [2025-10-02T22:37:01.502016] [DEBUG] [LOCAL ] CUBE: Saving derivative data. [2025-10-02T22:37:01.514143] [DEBUG] [LOCAL ] CUBI: Derivative data saved (1807 records). [2025-10-02T22:37:01.517312] [INFO ] [MAIN ] CUBI: Successfully saved derivative data. [2025-10-02T22:37:01.519632] [INFO ] [MAIN ] Derivative Progress: 455/1975 symbols completed. CUBI took 1.3s. Estimated remaining: 10m 42s. Rate: 142.1 symbols/min [2025-10-02T22:37:01.520909] [INFO ] [MAIN ] CULP: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:01.525897] [DEBUG] [LOCAL ] CUBE: Derivative data saved (1807 records). [2025-10-02T22:37:01.526031] [INFO ] [MAIN ] CUBE: Successfully saved derivative data. [2025-10-02T22:37:01.528242] [INFO ] [MAIN ] Derivative Progress: 456/1975 symbols completed. CUBE took 1.3s. Estimated remaining: 10m 40s. Rate: 142.4 symbols/min [2025-10-02T22:37:01.528396] [INFO ] [MAIN ] CURB: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:01.555819] [DEBUG] [LOCAL ] CULP: Loaded 2954 existing records from primary storage. [2025-10-02T22:37:01.556058] [INFO ] [MAIN ] CULP: Loaded 2954 primary data records. [2025-10-02T22:37:01.706876] [DEBUG] [LOCAL ] CURB: Loaded 32869 existing records from primary storage. [2025-10-02T22:37:01.718096] [INFO ] [MAIN ] CURB: Loaded 32869 primary data records. [2025-10-02T22:37:01.797329] [DEBUG] [LOCAL ] CUK: Loaded 51371 existing records from primary storage. [2025-10-02T22:37:02.025517] [INFO ] [MAIN ] CUK: Loaded 51371 primary data records. [2025-10-02T22:37:02.624611] [DEBUG] [MAIN ] CULP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:02.626242] [INFO ] [MAIN ] CULP: Generated 1807 derivative records from 2954 primary records. [2025-10-02T22:37:02.626465] [DEBUG] [LOCAL ] CULP: Saving derivative data. [2025-10-02T22:37:02.641700] [DEBUG] [LOCAL ] CULP: Derivative data saved (1807 records). [2025-10-02T22:37:02.641994] [INFO ] [MAIN ] CULP: Successfully saved derivative data. [2025-10-02T22:37:02.643945] [INFO ] [MAIN ] Derivative Progress: 457/1975 symbols completed. CULP took 1.1s. Estimated remaining: 10m 42s. Rate: 141.9 symbols/min [2025-10-02T22:37:02.645508] [INFO ] [MAIN ] CUZ: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:02.664983] [DEBUG] [MAIN ] CURB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:02.666286] [INFO ] [MAIN ] CURB: Generated 1807 derivative records from 32869 primary records. [2025-10-02T22:37:02.666546] [DEBUG] [LOCAL ] CURB: Saving derivative data. [2025-10-02T22:37:02.705743] [DEBUG] [MAIN ] CUK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:02.707273] [INFO ] [MAIN ] CUK: Generated 1807 derivative records from 51371 primary records. [2025-10-02T22:37:02.707413] [DEBUG] [LOCAL ] CURB: Derivative data saved (1807 records). [2025-10-02T22:37:02.707492] [DEBUG] [LOCAL ] CUK: Saving derivative data. [2025-10-02T22:37:02.707711] [INFO ] [MAIN ] CURB: Successfully saved derivative data. [2025-10-02T22:37:02.710469] [INFO ] [MAIN ] Derivative Progress: 458/1975 symbols completed. CURB took 1.2s. Estimated remaining: 10m 40s. Rate: 142.1 symbols/min [2025-10-02T22:37:02.710738] [INFO ] [MAIN ] CVEO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:02.744052] [DEBUG] [LOCAL ] CUK: Derivative data saved (1807 records). [2025-10-02T22:37:02.744461] [INFO ] [MAIN ] CUK: Successfully saved derivative data. [2025-10-02T22:37:02.746913] [INFO ] [MAIN ] Derivative Progress: 459/1975 symbols completed. CUK took 1.3s. Estimated remaining: 10m 39s. Rate: 142.4 symbols/min [2025-10-02T22:37:02.766971] [INFO ] [MAIN ] CVNA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:02.768778] [DEBUG] [LOCAL ] CUZ: Loaded 49712 existing records from primary storage. [2025-10-02T22:37:02.769083] [INFO ] [MAIN ] CUZ: Loaded 49712 primary data records. [2025-10-02T22:37:02.834381] [DEBUG] [LOCAL ] CVEO: Loaded 15211 existing records from primary storage. [2025-10-02T22:37:02.859683] [INFO ] [MAIN ] CVEO: Loaded 15211 primary data records. [2025-10-02T22:37:03.318963] [DEBUG] [LOCAL ] CVNA: Loaded 53343 existing records from primary storage. [2025-10-02T22:37:03.328450] [INFO ] [MAIN ] CVNA: Loaded 53343 primary data records. [2025-10-02T22:37:03.886949] [DEBUG] [MAIN ] CUZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:03.889000] [INFO ] [MAIN ] CUZ: Generated 1807 derivative records from 49712 primary records. [2025-10-02T22:37:03.889119] [DEBUG] [LOCAL ] CUZ: Saving derivative data. [2025-10-02T22:37:03.911822] [DEBUG] [LOCAL ] CUZ: Derivative data saved (1807 records). [2025-10-02T22:37:03.912252] [INFO ] [MAIN ] CUZ: Successfully saved derivative data. [2025-10-02T22:37:03.923201] [INFO ] [MAIN ] Derivative Progress: 460/1975 symbols completed. CUZ took 1.3s. Estimated remaining: 10m 41s. Rate: 141.9 symbols/min [2025-10-02T22:37:03.928569] [INFO ] [MAIN ] CVS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:03.929004] [DEBUG] [MAIN ] CVEO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:03.930382] [INFO ] [MAIN ] CVEO: Generated 1807 derivative records from 15211 primary records. [2025-10-02T22:37:03.930769] [DEBUG] [LOCAL ] CVEO: Saving derivative data. [2025-10-02T22:37:03.966375] [DEBUG] [LOCAL ] CVEO: Derivative data saved (1807 records). [2025-10-02T22:37:03.966750] [INFO ] [MAIN ] CVEO: Successfully saved derivative data. [2025-10-02T22:37:03.969254] [DEBUG] [MAIN ] CVNA: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-02T22:37:03.968911] [INFO ] [MAIN ] Derivative Progress: 461/1975 symbols completed. CVEO took 1.3s. Estimated remaining: 10m 39s. Rate: 142.1 symbols/min [2025-10-02T22:37:03.970473] [INFO ] [MAIN ] CVNA: Generated 1806 derivative records from 53343 primary records. [2025-10-02T22:37:03.969565] [INFO ] [MAIN ] CVX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:03.971140] [DEBUG] [LOCAL ] CVNA: Saving derivative data. [2025-10-02T22:37:03.988629] [DEBUG] [LOCAL ] CVNA: Derivative data saved (1806 records). [2025-10-02T22:37:03.988778] [INFO ] [MAIN ] CVNA: Successfully saved derivative data. [2025-10-02T22:37:03.990984] [INFO ] [MAIN ] Derivative Progress: 462/1975 symbols completed. CVNA took 1.2s. Estimated remaining: 10m 37s. Rate: 142.4 symbols/min [2025-10-02T22:37:03.991255] [INFO ] [MAIN ] CW: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:04.036246] [DEBUG] [LOCAL ] CVS: Loaded 54086 existing records from primary storage. [2025-10-02T22:37:04.036517] [INFO ] [MAIN ] CVS: Loaded 54086 primary data records. [2025-10-02T22:37:04.128856] [DEBUG] [LOCAL ] CW: Loaded 22388 existing records from primary storage. [2025-10-02T22:37:04.146502] [INFO ] [MAIN ] CW: Loaded 22388 primary data records. [2025-10-02T22:37:04.259347] [DEBUG] [LOCAL ] CVX: Loaded 54150 existing records from primary storage. [2025-10-02T22:37:04.329358] [INFO ] [MAIN ] CVX: Loaded 54150 primary data records. [2025-10-02T22:37:05.141735] [DEBUG] [MAIN ] CVS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:05.142734] [INFO ] [MAIN ] CVS: Generated 1807 derivative records from 54086 primary records. [2025-10-02T22:37:05.142904] [DEBUG] [LOCAL ] CVS: Saving derivative data. [2025-10-02T22:37:05.157757] [DEBUG] [MAIN ] CW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:05.158763] [INFO ] [MAIN ] CW: Generated 1807 derivative records from 22388 primary records. [2025-10-02T22:37:05.159059] [DEBUG] [LOCAL ] CW: Saving derivative data. [2025-10-02T22:37:05.193263] [DEBUG] [LOCAL ] CW: Derivative data saved (1807 records). [2025-10-02T22:37:05.202184] [INFO ] [MAIN ] CW: Successfully saved derivative data. [2025-10-02T22:37:05.211341] [DEBUG] [MAIN ] CVX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:05.212354] [INFO ] [MAIN ] CVX: Generated 1807 derivative records from 54150 primary records. [2025-10-02T22:37:05.204385] [INFO ] [MAIN ] Derivative Progress: 463/1975 symbols completed. CW took 1.2s. Estimated remaining: 10m 40s. Rate: 141.8 symbols/min [2025-10-02T22:37:05.213017] [DEBUG] [LOCAL ] CVS: Derivative data saved (1807 records). [2025-10-02T22:37:05.213071] [DEBUG] [LOCAL ] CVX: Saving derivative data. [2025-10-02T22:37:05.213545] [INFO ] [MAIN ] CVS: Successfully saved derivative data. [2025-10-02T22:37:05.215786] [INFO ] [MAIN ] Derivative Progress: 464/1975 symbols completed. CVS took 1.3s. Estimated remaining: 10m 38s. Rate: 142.1 symbols/min [2025-10-02T22:37:05.232455] [DEBUG] [LOCAL ] CVX: Derivative data saved (1807 records). [2025-10-02T22:37:05.232529] [INFO ] [MAIN ] CVX: Successfully saved derivative data. [2025-10-02T22:37:05.234560] [INFO ] [MAIN ] Derivative Progress: 465/1975 symbols completed. CVX took 1.3s. Estimated remaining: 10m 36s. Rate: 142.4 symbols/min [2025-10-02T22:37:05.235023] [INFO ] [MAIN ] CWEN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:05.235182] [INFO ] [MAIN ] CWH: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:05.235105] [INFO ] [MAIN ] CWK: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:05.313726] [DEBUG] [LOCAL ] CWK: Loaded 49782 existing records from primary storage. [2025-10-02T22:37:05.328226] [INFO ] [MAIN ] CWK: Loaded 49782 primary data records. [2025-10-02T22:37:05.343224] [DEBUG] [LOCAL ] CWH: Loaded 51715 existing records from primary storage. [2025-10-02T22:37:05.397973] [DEBUG] [LOCAL ] CWEN: Loaded 45415 existing records from primary storage. [2025-10-02T22:37:05.380505] [INFO ] [MAIN ] CWH: Loaded 51715 primary data records. [2025-10-02T22:37:05.412118] [INFO ] [MAIN ] CWEN: Loaded 45415 primary data records. [2025-10-02T22:37:06.475316] [DEBUG] [MAIN ] CWK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:06.476568] [INFO ] [MAIN ] CWK: Generated 1807 derivative records from 49782 primary records. [2025-10-02T22:37:06.477447] [DEBUG] [LOCAL ] CWK: Saving derivative data. [2025-10-02T22:37:06.522215] [DEBUG] [MAIN ] CWH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:06.527689] [DEBUG] [LOCAL ] CWK: Derivative data saved (1807 records). [2025-10-02T22:37:06.528472] [INFO ] [MAIN ] CWH: Generated 1807 derivative records from 51715 primary records. [2025-10-02T22:37:06.528837] [INFO ] [MAIN ] CWK: Successfully saved derivative data. [2025-10-02T22:37:06.528957] [DEBUG] [LOCAL ] CWH: Saving derivative data. [2025-10-02T22:37:06.531180] [DEBUG] [MAIN ] CWEN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:06.530730] [INFO ] [MAIN ] Derivative Progress: 466/1975 symbols completed. CWK took 1.3s. Estimated remaining: 10m 38s. Rate: 141.8 symbols/min [2025-10-02T22:37:06.532958] [INFO ] [MAIN ] CWEN: Generated 1807 derivative records from 45415 primary records. [2025-10-02T22:37:06.533303] [INFO ] [MAIN ] CWT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:06.541105] [DEBUG] [LOCAL ] CWEN: Saving derivative data. [2025-10-02T22:37:06.588932] [DEBUG] [LOCAL ] CWH: Derivative data saved (1807 records). [2025-10-02T22:37:06.589294] [INFO ] [MAIN ] CWH: Successfully saved derivative data. [2025-10-02T22:37:06.591972] [INFO ] [MAIN ] Derivative Progress: 467/1975 symbols completed. CWH took 1.4s. Estimated remaining: 10m 37s. Rate: 142.1 symbols/min [2025-10-02T22:37:06.593429] [INFO ] [MAIN ] CX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:06.593268] [DEBUG] [LOCAL ] CWEN: Derivative data saved (1807 records). [2025-10-02T22:37:06.594075] [INFO ] [MAIN ] CWEN: Successfully saved derivative data. [2025-10-02T22:37:06.596439] [INFO ] [MAIN ] Derivative Progress: 468/1975 symbols completed. CWEN took 1.4s. Estimated remaining: 10m 35s. Rate: 142.4 symbols/min [2025-10-02T22:37:06.596924] [INFO ] [MAIN ] CXE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:06.608272] [DEBUG] [LOCAL ] CWT: Loaded 28121 existing records from primary storage. [2025-10-02T22:37:06.608460] [INFO ] [MAIN ] CWT: Loaded 28121 primary data records. [2025-10-02T22:37:06.705830] [DEBUG] [LOCAL ] CXE: Loaded 6615 existing records from primary storage. [2025-10-02T22:37:06.718732] [INFO ] [MAIN ] CXE: Loaded 6615 primary data records. [2025-10-02T22:37:07.129285] [DEBUG] [LOCAL ] CX: Loaded 53213 existing records from primary storage. [2025-10-02T22:37:07.153155] [INFO ] [MAIN ] CX: Loaded 53213 primary data records. [2025-10-02T22:37:07.685879] [DEBUG] [MAIN ] CWT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:07.688022] [INFO ] [MAIN ] CWT: Generated 1807 derivative records from 28121 primary records. [2025-10-02T22:37:07.688579] [DEBUG] [LOCAL ] CWT: Saving derivative data. [2025-10-02T22:37:07.711088] [DEBUG] [LOCAL ] CWT: Derivative data saved (1807 records). [2025-10-02T22:37:07.711662] [INFO ] [MAIN ] CWT: Successfully saved derivative data. [2025-10-02T22:37:07.713625] [INFO ] [MAIN ] Derivative Progress: 469/1975 symbols completed. CWT took 1.2s. Estimated remaining: 10m 37s. Rate: 141.9 symbols/min [2025-10-02T22:37:07.721924] [INFO ] [MAIN ] CXH: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:07.728500] [DEBUG] [MAIN ] CXE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:07.729559] [INFO ] [MAIN ] CXE: Generated 1807 derivative records from 6615 primary records. [2025-10-02T22:37:07.729965] [DEBUG] [LOCAL ] CXE: Saving derivative data. [2025-10-02T22:37:07.747999] [DEBUG] [LOCAL ] CXH: Loaded 4422 existing records from primary storage. [2025-10-02T22:37:07.749626] [INFO ] [MAIN ] CXH: Loaded 4422 primary data records. [2025-10-02T22:37:07.852000] [DEBUG] [LOCAL ] CXE: Derivative data saved (1807 records). [2025-10-02T22:37:07.878479] [DEBUG] [MAIN ] CX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:07.900349] [INFO ] [MAIN ] CXE: Successfully saved derivative data. [2025-10-02T22:37:07.901620] [INFO ] [MAIN ] CX: Generated 1807 derivative records from 53213 primary records. [2025-10-02T22:37:07.904368] [INFO ] [MAIN ] Derivative Progress: 470/1975 symbols completed. CXE took 1.3s. Estimated remaining: 10m 36s. Rate: 142.0 symbols/min [2025-10-02T22:37:07.905033] [DEBUG] [LOCAL ] CX: Saving derivative data. [2025-10-02T22:37:07.911581] [INFO ] [MAIN ] CXM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:08.176554] [DEBUG] [LOCAL ] CX: Derivative data saved (1807 records). [2025-10-02T22:37:08.177253] [INFO ] [MAIN ] CX: Successfully saved derivative data. [2025-10-02T22:37:08.179420] [INFO ] [MAIN ] Derivative Progress: 471/1975 symbols completed. CX took 1.6s. Estimated remaining: 10m 35s. Rate: 142.1 symbols/min [2025-10-02T22:37:08.180187] [INFO ] [MAIN ] CXW: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:08.232187] [DEBUG] [MAIN ] CXH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:08.234339] [INFO ] [MAIN ] CXH: Generated 1807 derivative records from 4422 primary records. [2025-10-02T22:37:08.234507] [DEBUG] [LOCAL ] CXH: Saving derivative data. [2025-10-02T22:37:08.235445] [DEBUG] [LOCAL ] CXM: Loaded 47964 existing records from primary storage. [2025-10-02T22:37:08.245597] [INFO ] [MAIN ] CXM: Loaded 47964 primary data records. [2025-10-02T22:37:08.349078] [DEBUG] [LOCAL ] CXH: Derivative data saved (1807 records). [2025-10-02T22:37:08.355887] [INFO ] [MAIN ] CXH: Successfully saved derivative data. [2025-10-02T22:37:08.376975] [INFO ] [MAIN ] Derivative Progress: 472/1975 symbols completed. CXH took 0.7s. Estimated remaining: 10m 34s. Rate: 142.3 symbols/min [2025-10-02T22:37:08.406080] [DEBUG] [LOCAL ] CXW: Loaded 44355 existing records from primary storage. [2025-10-02T22:37:08.412085] [INFO ] [MAIN ] CXW: Loaded 44355 primary data records. [2025-10-02T22:37:08.406195] [INFO ] [MAIN ] CYD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:08.811327] [DEBUG] [LOCAL ] CYD: Loaded 26748 existing records from primary storage. [2025-10-02T22:37:08.821842] [INFO ] [MAIN ] CYD: Loaded 26748 primary data records. [2025-10-02T22:37:09.366539] [DEBUG] [MAIN ] CXM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:09.368192] [INFO ] [MAIN ] CXM: Generated 1807 derivative records from 47964 primary records. [2025-10-02T22:37:09.368520] [DEBUG] [LOCAL ] CXM: Saving derivative data. [2025-10-02T22:37:09.392768] [DEBUG] [LOCAL ] CXM: Derivative data saved (1807 records). [2025-10-02T22:37:09.401198] [INFO ] [MAIN ] CXM: Successfully saved derivative data. [2025-10-02T22:37:09.409243] [INFO ] [MAIN ] Derivative Progress: 473/1975 symbols completed. CXM took 1.5s. Estimated remaining: 10m 35s. Rate: 141.9 symbols/min [2025-10-02T22:37:09.407253] [DEBUG] [MAIN ] CXW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:09.410937] [INFO ] [MAIN ] CXW: Generated 1807 derivative records from 44355 primary records. [2025-10-02T22:37:09.409482] [INFO ] [MAIN ] CYH: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:09.411087] [DEBUG] [LOCAL ] CXW: Saving derivative data. [2025-10-02T22:37:09.444991] [DEBUG] [MAIN ] CYD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:09.447594] [INFO ] [MAIN ] CYD: Generated 1807 derivative records from 26748 primary records. [2025-10-02T22:37:09.447823] [DEBUG] [LOCAL ] CYD: Saving derivative data. [2025-10-02T22:37:09.449178] [DEBUG] [LOCAL ] CXW: Derivative data saved (1807 records). [2025-10-02T22:37:09.450226] [INFO ] [MAIN ] CXW: Successfully saved derivative data. [2025-10-02T22:37:09.452940] [INFO ] [MAIN ] Derivative Progress: 474/1975 symbols completed. CXW took 1.3s. Estimated remaining: 10m 34s. Rate: 142.1 symbols/min [2025-10-02T22:37:09.462718] [INFO ] [MAIN ] DAL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:09.471624] [DEBUG] [LOCAL ] CYD: Derivative data saved (1807 records). [2025-10-02T22:37:09.472022] [INFO ] [MAIN ] CYD: Successfully saved derivative data. [2025-10-02T22:37:09.473964] [INFO ] [MAIN ] Derivative Progress: 475/1975 symbols completed. CYD took 1.1s. Estimated remaining: 10m 32s. Rate: 142.4 symbols/min [2025-10-02T22:37:09.474225] [INFO ] [MAIN ] DAR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:09.511929] [DEBUG] [LOCAL ] CYH: Loaded 47856 existing records from primary storage. [2025-10-02T22:37:09.512189] [INFO ] [MAIN ] CYH: Loaded 47856 primary data records. [2025-10-02T22:37:09.891240] [DEBUG] [LOCAL ] DAL: Loaded 54143 existing records from primary storage. [2025-10-02T22:37:09.892126] [DEBUG] [LOCAL ] DAR: Loaded 52218 existing records from primary storage. [2025-10-02T22:37:09.892234] [INFO ] [MAIN ] DAL: Loaded 54143 primary data records. [2025-10-02T22:37:09.892332] [INFO ] [MAIN ] DAR: Loaded 52218 primary data records. [2025-10-02T22:37:10.702782] [DEBUG] [MAIN ] CYH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:10.704074] [INFO ] [MAIN ] CYH: Generated 1807 derivative records from 47856 primary records. [2025-10-02T22:37:10.704922] [DEBUG] [LOCAL ] CYH: Saving derivative data. [2025-10-02T22:37:10.733267] [DEBUG] [LOCAL ] CYH: Derivative data saved (1807 records). [2025-10-02T22:37:10.736552] [INFO ] [MAIN ] CYH: Successfully saved derivative data. [2025-10-02T22:37:10.739829] [INFO ] [MAIN ] Derivative Progress: 476/1975 symbols completed. CYH took 1.3s. Estimated remaining: 10m 34s. Rate: 141.8 symbols/min [2025-10-02T22:37:10.740997] [INFO ] [MAIN ] DAVA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:10.758943] [DEBUG] [MAIN ] DAR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:10.761373] [INFO ] [MAIN ] DAR: Generated 1807 derivative records from 52218 primary records. [2025-10-02T22:37:10.761740] [DEBUG] [LOCAL ] DAR: Saving derivative data. [2025-10-02T22:37:10.797333] [DEBUG] [MAIN ] DAL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:10.798607] [INFO ] [MAIN ] DAL: Generated 1807 derivative records from 54143 primary records. [2025-10-02T22:37:10.801812] [DEBUG] [LOCAL ] DAL: Saving derivative data. [2025-10-02T22:37:10.828444] [DEBUG] [LOCAL ] DAR: Derivative data saved (1807 records). [2025-10-02T22:37:10.831163] [DEBUG] [LOCAL ] DAL: Derivative data saved (1807 records). [2025-10-02T22:37:10.831695] [INFO ] [MAIN ] DAR: Successfully saved derivative data. [2025-10-02T22:37:10.831780] [INFO ] [MAIN ] DAL: Successfully saved derivative data. [2025-10-02T22:37:10.835411] [INFO ] [MAIN ] Derivative Progress: 477/1975 symbols completed. DAR took 1.4s. Estimated remaining: 10m 33s. Rate: 142.1 symbols/min [2025-10-02T22:37:10.839780] [INFO ] [MAIN ] DAY: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:10.852240] [INFO ] [MAIN ] Derivative Progress: 478/1975 symbols completed. DAL took 1.4s. Estimated remaining: 10m 31s. Rate: 142.3 symbols/min [2025-10-02T22:37:10.876734] [DEBUG] [LOCAL ] DAVA: Loaded 41312 existing records from primary storage. [2025-10-02T22:37:10.876923] [INFO ] [MAIN ] DAVA: Loaded 41312 primary data records. [2025-10-02T22:37:11.194969] [DEBUG] [LOCAL ] DAY: Loaded 49792 existing records from primary storage. [2025-10-02T22:37:11.239412] [INFO ] [MAIN ] DAY: Loaded 49792 primary data records. [2025-10-02T22:37:11.811841] [DEBUG] [MAIN ] DAVA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:11.812771] [INFO ] [MAIN ] DAVA: Generated 1807 derivative records from 41312 primary records. [2025-10-02T22:37:11.813136] [DEBUG] [LOCAL ] DAVA: Saving derivative data. [2025-10-02T22:37:11.831779] [DEBUG] [LOCAL ] DAVA: Derivative data saved (1807 records). [2025-10-02T22:37:11.832297] [INFO ] [MAIN ] DAVA: Successfully saved derivative data. [2025-10-02T22:37:11.835027] [INFO ] [MAIN ] Derivative Progress: 479/1975 symbols completed. DAVA took 1.1s. Estimated remaining: 10m 32s. Rate: 141.9 symbols/min [2025-10-02T22:37:11.855085] [DEBUG] [MAIN ] DAY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:11.855853] [INFO ] [MAIN ] DAY: Generated 1807 derivative records from 49792 primary records. [2025-10-02T22:37:11.855920] [DEBUG] [LOCAL ] DAY: Saving derivative data. [2025-10-02T22:37:11.873101] [DEBUG] [LOCAL ] DAY: Derivative data saved (1807 records). [2025-10-02T22:37:11.873206] [INFO ] [MAIN ] DAY: Successfully saved derivative data. [2025-10-02T22:37:11.875502] [INFO ] [MAIN ] Derivative Progress: 480/1975 symbols completed. DAY took 1.0s. Estimated remaining: 10m 31s. Rate: 142.2 symbols/min [2025-10-02T22:37:11.876177] [INFO ] [MAIN ] DBI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:11.876245] [INFO ] [MAIN ] DBL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:11.876388] [INFO ] [MAIN ] DCO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:11.957174] [DEBUG] [LOCAL ] DCO: Loaded 13948 existing records from primary storage. [2025-10-02T22:37:11.957340] [INFO ] [MAIN ] DCO: Loaded 13948 primary data records. [2025-10-02T22:37:12.020143] [DEBUG] [LOCAL ] DBL: Loaded 9352 existing records from primary storage. [2025-10-02T22:37:12.034160] [INFO ] [MAIN ] DBL: Loaded 9352 primary data records. [2025-10-02T22:37:12.576120] [DEBUG] [LOCAL ] DBI: Loaded 44841 existing records from primary storage. [2025-10-02T22:37:12.606524] [INFO ] [MAIN ] DBI: Loaded 44841 primary data records. [2025-10-02T22:37:13.159248] [DEBUG] [MAIN ] DCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:13.160573] [INFO ] [MAIN ] DCO: Generated 1807 derivative records from 13948 primary records. [2025-10-02T22:37:13.160832] [DEBUG] [LOCAL ] DCO: Saving derivative data. [2025-10-02T22:37:13.199565] [DEBUG] [MAIN ] DBL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:13.202125] [INFO ] [MAIN ] DBL: Generated 1807 derivative records from 9352 primary records. [2025-10-02T22:37:13.203921] [DEBUG] [LOCAL ] DBL: Saving derivative data. [2025-10-02T22:37:13.224747] [DEBUG] [LOCAL ] DCO: Derivative data saved (1807 records). [2025-10-02T22:37:13.230697] [DEBUG] [LOCAL ] DBL: Derivative data saved (1807 records). [2025-10-02T22:37:13.232108] [INFO ] [MAIN ] DBL: Successfully saved derivative data. [2025-10-02T22:37:13.234927] [INFO ] [MAIN ] Derivative Progress: 481/1975 symbols completed. DBL took 1.4s. Estimated remaining: 10m 33s. Rate: 141.6 symbols/min [2025-10-02T22:37:13.230831] [INFO ] [MAIN ] DCO: Successfully saved derivative data. [2025-10-02T22:37:13.239274] [INFO ] [MAIN ] Derivative Progress: 482/1975 symbols completed. DCO took 1.4s. Estimated remaining: 10m 32s. Rate: 141.8 symbols/min [2025-10-02T22:37:13.235236] [INFO ] [MAIN ] DD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:13.241203] [INFO ] [MAIN ] DDD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:13.256484] [DEBUG] [MAIN ] DBI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:13.257421] [INFO ] [MAIN ] DBI: Generated 1807 derivative records from 44841 primary records. [2025-10-02T22:37:13.257529] [DEBUG] [LOCAL ] DBI: Saving derivative data. [2025-10-02T22:37:13.277547] [DEBUG] [LOCAL ] DBI: Derivative data saved (1807 records). [2025-10-02T22:37:13.277829] [INFO ] [MAIN ] DBI: Successfully saved derivative data. [2025-10-02T22:37:13.279935] [INFO ] [MAIN ] Derivative Progress: 483/1975 symbols completed. DBI took 1.4s. Estimated remaining: 10m 30s. Rate: 142.1 symbols/min [2025-10-02T22:37:13.280210] [INFO ] [MAIN ] DDL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:13.318795] [DEBUG] [LOCAL ] DDL: Loaded 37057 existing records from primary storage. [2025-10-02T22:37:13.334207] [INFO ] [MAIN ] DDL: Loaded 37057 primary data records. [2025-10-02T22:37:13.512235] [DEBUG] [LOCAL ] DD: Loaded 53213 existing records from primary storage. [2025-10-02T22:37:13.512515] [INFO ] [MAIN ] DD: Loaded 53213 primary data records. [2025-10-02T22:37:13.519096] [DEBUG] [LOCAL ] DDD: Loaded 51270 existing records from primary storage. [2025-10-02T22:37:13.559463] [INFO ] [MAIN ] DDD: Loaded 51270 primary data records. [2025-10-02T22:37:14.520403] [DEBUG] [MAIN ] DDL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:14.521542] [INFO ] [MAIN ] DDL: Generated 1807 derivative records from 37057 primary records. [2025-10-02T22:37:14.522830] [DEBUG] [LOCAL ] DDL: Saving derivative data. [2025-10-02T22:37:14.555118] [DEBUG] [MAIN ] DDD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:14.558681] [INFO ] [MAIN ] DDD: Generated 1807 derivative records from 51270 primary records. [2025-10-02T22:37:14.562021] [DEBUG] [LOCAL ] DDD: Saving derivative data. [2025-10-02T22:37:14.564835] [DEBUG] [LOCAL ] DDL: Derivative data saved (1807 records). [2025-10-02T22:37:14.565268] [INFO ] [MAIN ] DDL: Successfully saved derivative data. [2025-10-02T22:37:14.568048] [INFO ] [MAIN ] Derivative Progress: 484/1975 symbols completed. DDL took 1.3s. Estimated remaining: 10m 32s. Rate: 141.5 symbols/min [2025-10-02T22:37:14.583767] [INFO ] [MAIN ] DDT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:14.594201] [DEBUG] [MAIN ] DD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:14.595701] [INFO ] [MAIN ] DD: Generated 1807 derivative records from 53213 primary records. [2025-10-02T22:37:14.595785] [DEBUG] [LOCAL ] DD: Saving derivative data. [2025-10-02T22:37:14.615422] [DEBUG] [LOCAL ] DDT: Loaded 2086 existing records from primary storage. [2025-10-02T22:37:14.616970] [INFO ] [MAIN ] DDT: Loaded 2086 primary data records. [2025-10-02T22:37:14.622540] [DEBUG] [LOCAL ] DDD: Derivative data saved (1807 records). [2025-10-02T22:37:14.623343] [INFO ] [MAIN ] DDD: Successfully saved derivative data. [2025-10-02T22:37:14.638293] [INFO ] [MAIN ] Derivative Progress: 485/1975 symbols completed. DDD took 1.4s. Estimated remaining: 10m 31s. Rate: 141.8 symbols/min [2025-10-02T22:37:14.646267] [INFO ] [MAIN ] DE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:14.746537] [DEBUG] [LOCAL ] DD: Derivative data saved (1807 records). [2025-10-02T22:37:14.746772] [INFO ] [MAIN ] DD: Successfully saved derivative data. [2025-10-02T22:37:14.749265] [INFO ] [MAIN ] Derivative Progress: 486/1975 symbols completed. DD took 1.5s. Estimated remaining: 10m 29s. Rate: 142.0 symbols/min [2025-10-02T22:37:14.754944] [INFO ] [MAIN ] DEC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:15.048146] [DEBUG] [LOCAL ] DE: Loaded 47908 existing records from primary storage. [2025-10-02T22:37:15.060343] [INFO ] [MAIN ] DE: Loaded 47908 primary data records. [2025-10-02T22:37:15.084956] [DEBUG] [LOCAL ] DEC: Loaded 30765 existing records from primary storage. [2025-10-02T22:37:15.112202] [INFO ] [MAIN ] DEC: Loaded 30765 primary data records. [2025-10-02T22:37:15.558077] [DEBUG] [MAIN ] DDT: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-02T22:37:15.611938] [INFO ] [MAIN ] DDT: Generated 1806 derivative records from 2086 primary records. [2025-10-02T22:37:15.612078] [DEBUG] [LOCAL ] DDT: Saving derivative data. [2025-10-02T22:37:15.780693] [DEBUG] [LOCAL ] DDT: Derivative data saved (1806 records). [2025-10-02T22:37:15.780864] [INFO ] [MAIN ] DDT: Successfully saved derivative data. [2025-10-02T22:37:15.782925] [INFO ] [MAIN ] Derivative Progress: 487/1975 symbols completed. DDT took 1.2s. Estimated remaining: 10m 31s. Rate: 141.6 symbols/min [2025-10-02T22:37:15.783996] [INFO ] [MAIN ] DECK: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:15.812670] [DEBUG] [MAIN ] DE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:15.813924] [INFO ] [MAIN ] DE: Generated 1807 derivative records from 47908 primary records. [2025-10-02T22:37:15.814048] [DEBUG] [LOCAL ] DE: Saving derivative data. [2025-10-02T22:37:15.850589] [DEBUG] [MAIN ] DEC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:15.851918] [DEBUG] [LOCAL ] DE: Derivative data saved (1807 records). [2025-10-02T22:37:15.866201] [INFO ] [MAIN ] DE: Successfully saved derivative data. [2025-10-02T22:37:15.867222] [INFO ] [MAIN ] DEC: Generated 1807 derivative records from 30765 primary records. [2025-10-02T22:37:15.867393] [DEBUG] [LOCAL ] DEC: Saving derivative data. [2025-10-02T22:37:15.869700] [INFO ] [MAIN ] Derivative Progress: 488/1975 symbols completed. DE took 1.2s. Estimated remaining: 10m 29s. Rate: 141.8 symbols/min [2025-10-02T22:37:15.870346] [INFO ] [MAIN ] DEI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:15.887358] [DEBUG] [LOCAL ] DEC: Derivative data saved (1807 records). [2025-10-02T22:37:15.888285] [INFO ] [MAIN ] DEC: Successfully saved derivative data. [2025-10-02T22:37:15.890386] [INFO ] [MAIN ] Derivative Progress: 489/1975 symbols completed. DEC took 1.1s. Estimated remaining: 10m 28s. Rate: 142.1 symbols/min [2025-10-02T22:37:15.890838] [INFO ] [MAIN ] DELL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:15.909119] [DEBUG] [LOCAL ] DECK: Loaded 53683 existing records from primary storage. [2025-10-02T22:37:15.909378] [INFO ] [MAIN ] DECK: Loaded 53683 primary data records. [2025-10-02T22:37:16.258455] [DEBUG] [LOCAL ] DEI: Loaded 48684 existing records from primary storage. [2025-10-02T22:37:16.273763] [INFO ] [MAIN ] DEI: Loaded 48684 primary data records. [2025-10-02T22:37:16.379250] [DEBUG] [LOCAL ] DELL: Loaded 54125 existing records from primary storage. [2025-10-02T22:37:16.398433] [INFO ] [MAIN ] DELL: Loaded 54125 primary data records. [2025-10-02T22:37:16.867499] [DEBUG] [MAIN ] DECK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:16.993499] [INFO ] [MAIN ] DECK: Generated 1807 derivative records from 53683 primary records. [2025-10-02T22:37:16.994314] [DEBUG] [LOCAL ] DECK: Saving derivative data. [2025-10-02T22:37:17.019880] [DEBUG] [LOCAL ] DECK: Derivative data saved (1807 records). [2025-10-02T22:37:17.020789] [INFO ] [MAIN ] DECK: Successfully saved derivative data. [2025-10-02T22:37:17.022920] [INFO ] [MAIN ] Derivative Progress: 490/1975 symbols completed. DECK took 1.2s. Estimated remaining: 10m 29s. Rate: 141.6 symbols/min [2025-10-02T22:37:17.023247] [INFO ] [MAIN ] DFH: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:17.038127] [DEBUG] [MAIN ] DEI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:17.039086] [INFO ] [MAIN ] DEI: Generated 1807 derivative records from 48684 primary records. [2025-10-02T22:37:17.039283] [DEBUG] [LOCAL ] DEI: Saving derivative data. [2025-10-02T22:37:17.072154] [DEBUG] [LOCAL ] DEI: Derivative data saved (1807 records). [2025-10-02T22:37:17.072302] [INFO ] [MAIN ] DEI: Successfully saved derivative data. [2025-10-02T22:37:17.074319] [INFO ] [MAIN ] Derivative Progress: 491/1975 symbols completed. DEI took 1.2s. Estimated remaining: 10m 28s. Rate: 141.8 symbols/min [2025-10-02T22:37:17.074754] [INFO ] [MAIN ] DFIN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:17.088475] [DEBUG] [MAIN ] DELL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:17.089234] [INFO ] [MAIN ] DELL: Generated 1807 derivative records from 54125 primary records. [2025-10-02T22:37:17.089383] [DEBUG] [LOCAL ] DELL: Saving derivative data. [2025-10-02T22:37:17.116491] [DEBUG] [LOCAL ] DELL: Derivative data saved (1807 records). [2025-10-02T22:37:17.117560] [DEBUG] [LOCAL ] DFH: Loaded 32447 existing records from primary storage. [2025-10-02T22:37:17.117857] [INFO ] [MAIN ] DELL: Successfully saved derivative data. [2025-10-02T22:37:17.121443] [INFO ] [MAIN ] Derivative Progress: 492/1975 symbols completed. DELL took 1.2s. Estimated remaining: 10m 26s. Rate: 142.1 symbols/min [2025-10-02T22:37:17.117700] [INFO ] [MAIN ] DFH: Loaded 32447 primary data records. [2025-10-02T22:37:17.121878] [INFO ] [MAIN ] DFP: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:17.239950] [DEBUG] [LOCAL ] DFIN: Loaded 23174 existing records from primary storage. [2025-10-02T22:37:17.267526] [INFO ] [MAIN ] DFIN: Loaded 23174 primary data records. [2025-10-02T22:37:17.278385] [DEBUG] [LOCAL ] DFP: Loaded 11492 existing records from primary storage. [2025-10-02T22:37:17.283638] [INFO ] [MAIN ] DFP: Loaded 11492 primary data records. [2025-10-02T22:37:18.205490] [DEBUG] [MAIN ] DFH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:18.206553] [INFO ] [MAIN ] DFH: Generated 1807 derivative records from 32447 primary records. [2025-10-02T22:37:18.207683] [DEBUG] [LOCAL ] DFH: Saving derivative data. [2025-10-02T22:37:18.226734] [DEBUG] [LOCAL ] DFH: Derivative data saved (1807 records). [2025-10-02T22:37:18.227852] [INFO ] [MAIN ] DFH: Successfully saved derivative data. [2025-10-02T22:37:18.230808] [INFO ] [MAIN ] Derivative Progress: 493/1975 symbols completed. DFH took 1.2s. Estimated remaining: 10m 28s. Rate: 141.6 symbols/min [2025-10-02T22:37:18.244748] [DEBUG] [MAIN ] DFIN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:18.245530] [INFO ] [MAIN ] DFIN: Generated 1807 derivative records from 23174 primary records. [2025-10-02T22:37:18.245611] [DEBUG] [LOCAL ] DFIN: Saving derivative data. [2025-10-02T22:37:18.275131] [DEBUG] [MAIN ] DFP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:18.276492] [INFO ] [MAIN ] DFP: Generated 1807 derivative records from 11492 primary records. [2025-10-02T22:37:18.276808] [DEBUG] [LOCAL ] DFP: Saving derivative data. [2025-10-02T22:37:18.278984] [DEBUG] [LOCAL ] DFIN: Derivative data saved (1807 records). [2025-10-02T22:37:18.279190] [INFO ] [MAIN ] DFIN: Successfully saved derivative data. [2025-10-02T22:37:18.281408] [INFO ] [MAIN ] Derivative Progress: 494/1975 symbols completed. DFIN took 1.2s. Estimated remaining: 10m 26s. Rate: 141.9 symbols/min [2025-10-02T22:37:18.297229] [DEBUG] [LOCAL ] DFP: Derivative data saved (1807 records). [2025-10-02T22:37:18.297298] [INFO ] [MAIN ] DFP: Successfully saved derivative data. [2025-10-02T22:37:18.299441] [INFO ] [MAIN ] Derivative Progress: 495/1975 symbols completed. DFP took 1.2s. Estimated remaining: 10m 25s. Rate: 142.1 symbols/min [2025-10-02T22:37:18.299975] [INFO ] [MAIN ] DHF: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:18.299917] [INFO ] [MAIN ] DG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:18.300126] [INFO ] [MAIN ] DGX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:18.372236] [DEBUG] [LOCAL ] DHF: Loaded 21198 existing records from primary storage. [2025-10-02T22:37:18.372517] [INFO ] [MAIN ] DHF: Loaded 21198 primary data records. [2025-10-02T22:37:18.619806] [DEBUG] [LOCAL ] DGX: Loaded 45232 existing records from primary storage. [2025-10-02T22:37:18.641358] [INFO ] [MAIN ] DGX: Loaded 45232 primary data records. [2025-10-02T22:37:18.758364] [DEBUG] [LOCAL ] DG: Loaded 53672 existing records from primary storage. [2025-10-02T22:37:18.786420] [INFO ] [MAIN ] DG: Loaded 53672 primary data records. [2025-10-02T22:37:19.509684] [DEBUG] [MAIN ] DHF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:19.511566] [INFO ] [MAIN ] DHF: Generated 1807 derivative records from 21198 primary records. [2025-10-02T22:37:19.512565] [DEBUG] [LOCAL ] DHF: Saving derivative data. [2025-10-02T22:37:19.533349] [DEBUG] [LOCAL ] DHF: Derivative data saved (1807 records). [2025-10-02T22:37:19.534000] [INFO ] [MAIN ] DHF: Successfully saved derivative data. [2025-10-02T22:37:19.536120] [INFO ] [MAIN ] Derivative Progress: 496/1975 symbols completed. DHF took 1.2s. Estimated remaining: 10m 27s. Rate: 141.6 symbols/min [2025-10-02T22:37:19.536436] [INFO ] [MAIN ] DHI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:19.554709] [DEBUG] [MAIN ] DGX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:19.555479] [INFO ] [MAIN ] DGX: Generated 1807 derivative records from 45232 primary records. [2025-10-02T22:37:19.555912] [DEBUG] [LOCAL ] DGX: Saving derivative data. [2025-10-02T22:37:19.591110] [DEBUG] [LOCAL ] DGX: Derivative data saved (1807 records). [2025-10-02T22:37:19.591219] [INFO ] [MAIN ] DGX: Successfully saved derivative data. [2025-10-02T22:37:19.593210] [INFO ] [MAIN ] Derivative Progress: 497/1975 symbols completed. DGX took 1.3s. Estimated remaining: 10m 25s. Rate: 141.8 symbols/min [2025-10-02T22:37:19.593406] [INFO ] [MAIN ] DHR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:19.590519] [DEBUG] [MAIN ] DG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:19.594625] [INFO ] [MAIN ] DG: Generated 1807 derivative records from 53672 primary records. [2025-10-02T22:37:19.594881] [DEBUG] [LOCAL ] DG: Saving derivative data. [2025-10-02T22:37:19.616716] [DEBUG] [LOCAL ] DG: Derivative data saved (1807 records). [2025-10-02T22:37:19.616879] [INFO ] [MAIN ] DG: Successfully saved derivative data. [2025-10-02T22:37:19.619189] [INFO ] [MAIN ] Derivative Progress: 498/1975 symbols completed. DG took 1.3s. Estimated remaining: 10m 24s. Rate: 142.1 symbols/min [2025-10-02T22:37:19.619455] [INFO ] [MAIN ] DHT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:19.684712] [DEBUG] [LOCAL ] DHR: Loaded 53756 existing records from primary storage. [2025-10-02T22:37:19.684892] [INFO ] [MAIN ] DHR: Loaded 53756 primary data records. [2025-10-02T22:37:19.869857] [DEBUG] [LOCAL ] DHI: Loaded 53731 existing records from primary storage. [2025-10-02T22:37:19.880344] [INFO ] [MAIN ] DHI: Loaded 53731 primary data records. [2025-10-02T22:37:19.940262] [DEBUG] [LOCAL ] DHT: Loaded 48248 existing records from primary storage. [2025-10-02T22:37:19.947971] [INFO ] [MAIN ] DHT: Loaded 48248 primary data records. [2025-10-02T22:37:20.758119] [DEBUG] [MAIN ] DHR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:20.759776] [INFO ] [MAIN ] DHR: Generated 1807 derivative records from 53756 primary records. [2025-10-02T22:37:20.761073] [DEBUG] [LOCAL ] DHR: Saving derivative data. [2025-10-02T22:37:20.813766] [DEBUG] [MAIN ] DHT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:20.814161] [DEBUG] [MAIN ] DHI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:20.816138] [INFO ] [MAIN ] DHI: Generated 1807 derivative records from 53731 primary records. [2025-10-02T22:37:20.815412] [INFO ] [MAIN ] DHT: Generated 1807 derivative records from 48248 primary records. [2025-10-02T22:37:20.816811] [DEBUG] [LOCAL ] DHR: Derivative data saved (1807 records). [2025-10-02T22:37:20.816882] [DEBUG] [LOCAL ] DHI: Saving derivative data. [2025-10-02T22:37:20.817054] [INFO ] [MAIN ] DHR: Successfully saved derivative data. [2025-10-02T22:37:20.817134] [DEBUG] [LOCAL ] DHT: Saving derivative data. [2025-10-02T22:37:20.820584] [INFO ] [MAIN ] Derivative Progress: 499/1975 symbols completed. DHR took 1.2s. Estimated remaining: 10m 25s. Rate: 141.6 symbols/min [2025-10-02T22:37:20.829699] [INFO ] [MAIN ] DIAX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:20.854068] [DEBUG] [LOCAL ] DHT: Derivative data saved (1807 records). [2025-10-02T22:37:20.854723] [INFO ] [MAIN ] DHT: Successfully saved derivative data. [2025-10-02T22:37:20.857087] [INFO ] [MAIN ] Derivative Progress: 500/1975 symbols completed. DHT took 1.2s. Estimated remaining: 10m 24s. Rate: 141.8 symbols/min [2025-10-02T22:37:20.858063] [INFO ] [MAIN ] DIN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:20.859039] [DEBUG] [LOCAL ] DHI: Derivative data saved (1807 records). [2025-10-02T22:37:20.859120] [INFO ] [MAIN ] DHI: Successfully saved derivative data. [2025-10-02T22:37:20.861961] [INFO ] [MAIN ] Derivative Progress: 501/1975 symbols completed. DHI took 1.3s. Estimated remaining: 10m 22s. Rate: 142.1 symbols/min [2025-10-02T22:37:20.862277] [INFO ] [MAIN ] DK: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:20.874067] [DEBUG] [LOCAL ] DIAX: Loaded 13011 existing records from primary storage. [2025-10-02T22:37:20.874360] [INFO ] [MAIN ] DIAX: Loaded 13011 primary data records. [2025-10-02T22:37:21.248140] [DEBUG] [LOCAL ] DIN: Loaded 37507 existing records from primary storage. [2025-10-02T22:37:21.261719] [INFO ] [MAIN ] DIN: Loaded 37507 primary data records. [2025-10-02T22:37:21.276396] [DEBUG] [LOCAL ] DK: Loaded 49690 existing records from primary storage. [2025-10-02T22:37:21.288036] [INFO ] [MAIN ] DK: Loaded 49690 primary data records. [2025-10-02T22:37:21.989884] [DEBUG] [MAIN ] DIAX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:21.990871] [INFO ] [MAIN ] DIAX: Generated 1807 derivative records from 13011 primary records. [2025-10-02T22:37:21.991919] [DEBUG] [LOCAL ] DIAX: Saving derivative data. [2025-10-02T22:37:22.013902] [DEBUG] [LOCAL ] DIAX: Derivative data saved (1807 records). [2025-10-02T22:37:22.016154] [INFO ] [MAIN ] DIAX: Successfully saved derivative data. [2025-10-02T22:37:22.019335] [INFO ] [MAIN ] Derivative Progress: 502/1975 symbols completed. DIAX took 1.2s. Estimated remaining: 10m 24s. Rate: 141.6 symbols/min [2025-10-02T22:37:22.019729] [INFO ] [MAIN ] DKL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:22.036926] [DEBUG] [MAIN ] DIN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:22.038848] [INFO ] [MAIN ] DIN: Generated 1807 derivative records from 37507 primary records. [2025-10-02T22:37:22.038946] [DEBUG] [LOCAL ] DIN: Saving derivative data. [2025-10-02T22:37:22.065005] [DEBUG] [MAIN ] DK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:22.067084] [INFO ] [MAIN ] DK: Generated 1807 derivative records from 49690 primary records. [2025-10-02T22:37:22.069233] [DEBUG] [LOCAL ] DK: Saving derivative data. [2025-10-02T22:37:22.074143] [DEBUG] [LOCAL ] DIN: Derivative data saved (1807 records). [2025-10-02T22:37:22.074233] [INFO ] [MAIN ] DIN: Successfully saved derivative data. [2025-10-02T22:37:22.076228] [INFO ] [MAIN ] Derivative Progress: 503/1975 symbols completed. DIN took 1.2s. Estimated remaining: 10m 23s. Rate: 141.9 symbols/min [2025-10-02T22:37:22.076445] [INFO ] [MAIN ] DKS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:22.095243] [DEBUG] [LOCAL ] DK: Derivative data saved (1807 records). [2025-10-02T22:37:22.102678] [DEBUG] [LOCAL ] DKL: Loaded 18727 existing records from primary storage. [2025-10-02T22:37:22.101329] [INFO ] [MAIN ] DK: Successfully saved derivative data. [2025-10-02T22:37:22.105911] [INFO ] [MAIN ] DKL: Loaded 18727 primary data records. [2025-10-02T22:37:22.105784] [INFO ] [MAIN ] Derivative Progress: 504/1975 symbols completed. DK took 1.2s. Estimated remaining: 10m 21s. Rate: 142.1 symbols/min [2025-10-02T22:37:22.106369] [INFO ] [MAIN ] DLB: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:22.484704] [DEBUG] [LOCAL ] DLB: Loaded 32228 existing records from primary storage. [2025-10-02T22:37:22.499312] [INFO ] [MAIN ] DLB: Loaded 32228 primary data records. [2025-10-02T22:37:22.500456] [DEBUG] [LOCAL ] DKS: Loaded 50084 existing records from primary storage. [2025-10-02T22:37:22.500670] [INFO ] [MAIN ] DKS: Loaded 50084 primary data records. [2025-10-02T22:37:23.173385] [DEBUG] [MAIN ] DKL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:23.175265] [INFO ] [MAIN ] DKL: Generated 1807 derivative records from 18727 primary records. [2025-10-02T22:37:23.175952] [DEBUG] [LOCAL ] DKL: Saving derivative data. [2025-10-02T22:37:23.197237] [DEBUG] [LOCAL ] DKL: Derivative data saved (1807 records). [2025-10-02T22:37:23.198171] [INFO ] [MAIN ] DKL: Successfully saved derivative data. [2025-10-02T22:37:23.201149] [INFO ] [MAIN ] Derivative Progress: 505/1975 symbols completed. DKL took 1.2s. Estimated remaining: 10m 22s. Rate: 141.7 symbols/min [2025-10-02T22:37:23.201928] [INFO ] [MAIN ] DLNG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:23.231958] [DEBUG] [LOCAL ] DLNG: Loaded 6130 existing records from primary storage. [2025-10-02T22:37:23.232583] [DEBUG] [MAIN ] DLB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:23.233637] [INFO ] [MAIN ] DLB: Generated 1807 derivative records from 32228 primary records. [2025-10-02T22:37:23.232864] [INFO ] [MAIN ] DLNG: Loaded 6130 primary data records. [2025-10-02T22:37:23.239159] [DEBUG] [LOCAL ] DLB: Saving derivative data. [2025-10-02T22:37:23.307303] [DEBUG] [MAIN ] DKS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:23.353261] [INFO ] [MAIN ] DKS: Generated 1807 derivative records from 50084 primary records. [2025-10-02T22:37:23.371402] [DEBUG] [LOCAL ] DLB: Derivative data saved (1807 records). [2025-10-02T22:37:23.370269] [DEBUG] [LOCAL ] DKS: Saving derivative data. [2025-10-02T22:37:23.379614] [INFO ] [MAIN ] DLB: Successfully saved derivative data. [2025-10-02T22:37:23.387489] [INFO ] [MAIN ] Derivative Progress: 506/1975 symbols completed. DLB took 1.3s. Estimated remaining: 10m 21s. Rate: 141.8 symbols/min [2025-10-02T22:37:23.387983] [INFO ] [MAIN ] DLR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:23.620282] [DEBUG] [LOCAL ] DKS: Derivative data saved (1807 records). [2025-10-02T22:37:23.620488] [INFO ] [MAIN ] DKS: Successfully saved derivative data. [2025-10-02T22:37:23.622982] [INFO ] [MAIN ] Derivative Progress: 507/1975 symbols completed. DKS took 1.5s. Estimated remaining: 10m 20s. Rate: 142.0 symbols/min [2025-10-02T22:37:23.623994] [INFO ] [MAIN ] DLX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:23.689929] [DEBUG] [MAIN ] DLNG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:23.691453] [DEBUG] [LOCAL ] DLR: Loaded 51291 existing records from primary storage. [2025-10-02T22:37:23.692520] [INFO ] [MAIN ] DLNG: Generated 1807 derivative records from 6130 primary records. [2025-10-02T22:37:23.691691] [INFO ] [MAIN ] DLR: Loaded 51291 primary data records. [2025-10-02T22:37:23.692714] [DEBUG] [LOCAL ] DLNG: Saving derivative data. [2025-10-02T22:37:23.795043] [DEBUG] [LOCAL ] DLX: Loaded 28713 existing records from primary storage. [2025-10-02T22:37:23.806406] [INFO ] [MAIN ] DLX: Loaded 28713 primary data records. [2025-10-02T22:37:23.966224] [DEBUG] [LOCAL ] DLNG: Derivative data saved (1807 records). [2025-10-02T22:37:23.976873] [INFO ] [MAIN ] DLNG: Successfully saved derivative data. [2025-10-02T22:37:24.056473] [INFO ] [MAIN ] Derivative Progress: 508/1975 symbols completed. DLNG took 0.9s. Estimated remaining: 10m 20s. Rate: 142.0 symbols/min [2025-10-02T22:37:24.479389] [DEBUG] [MAIN ] DLR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:24.480389] [INFO ] [MAIN ] DLR: Generated 1807 derivative records from 51291 primary records. [2025-10-02T22:37:24.480672] [DEBUG] [LOCAL ] DLR: Saving derivative data. [2025-10-02T22:37:24.499604] [DEBUG] [LOCAL ] DLR: Derivative data saved (1807 records). [2025-10-02T22:37:24.499789] [INFO ] [MAIN ] DLR: Successfully saved derivative data. [2025-10-02T22:37:24.501871] [INFO ] [MAIN ] Derivative Progress: 509/1975 symbols completed. DLR took 1.1s. Estimated remaining: 10m 20s. Rate: 142.0 symbols/min [2025-10-02T22:37:24.520488] [DEBUG] [MAIN ] DLX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:24.521464] [INFO ] [MAIN ] DLX: Generated 1807 derivative records from 28713 primary records. [2025-10-02T22:37:24.521534] [DEBUG] [LOCAL ] DLX: Saving derivative data. [2025-10-02T22:37:24.541629] [DEBUG] [LOCAL ] DLX: Derivative data saved (1807 records). [2025-10-02T22:37:24.541811] [INFO ] [MAIN ] DLX: Successfully saved derivative data. [2025-10-02T22:37:24.544219] [INFO ] [MAIN ] Derivative Progress: 510/1975 symbols completed. DLX took 0.9s. Estimated remaining: 10m 18s. Rate: 142.2 symbols/min [2025-10-02T22:37:24.545032] [INFO ] [MAIN ] DMA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:24.544920] [INFO ] [MAIN ] DLY: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:24.545205] [INFO ] [MAIN ] DMB: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:24.554987] [DEBUG] [LOCAL ] DMA: Loaded 4570 existing records from primary storage. [2025-10-02T22:37:24.557914] [INFO ] [MAIN ] DMA: Loaded 4570 primary data records. [2025-10-02T22:37:24.648818] [DEBUG] [LOCAL ] DMB: Loaded 10281 existing records from primary storage. [2025-10-02T22:37:24.669378] [INFO ] [MAIN ] DMB: Loaded 10281 primary data records. [2025-10-02T22:37:24.703142] [DEBUG] [LOCAL ] DLY: Loaded 20149 existing records from primary storage. [2025-10-02T22:37:24.703253] [INFO ] [MAIN ] DLY: Loaded 20149 primary data records. [2025-10-02T22:37:25.594836] [DEBUG] [MAIN ] DMA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:25.596009] [INFO ] [MAIN ] DMA: Generated 1807 derivative records from 4570 primary records. [2025-10-02T22:37:25.596247] [DEBUG] [LOCAL ] DMA: Saving derivative data. [2025-10-02T22:37:25.628832] [DEBUG] [LOCAL ] DMA: Derivative data saved (1807 records). [2025-10-02T22:37:25.630142] [INFO ] [MAIN ] DMA: Successfully saved derivative data. [2025-10-02T22:37:25.648107] [DEBUG] [MAIN ] DMB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:25.647447] [INFO ] [MAIN ] Derivative Progress: 511/1975 symbols completed. DMA took 1.1s. Estimated remaining: 10m 20s. Rate: 141.8 symbols/min [2025-10-02T22:37:25.661031] [INFO ] [MAIN ] DMB: Generated 1807 derivative records from 10281 primary records. [2025-10-02T22:37:25.661247] [INFO ] [MAIN ] DMO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:25.661698] [DEBUG] [LOCAL ] DMB: Saving derivative data. [2025-10-02T22:37:25.662348] [DEBUG] [MAIN ] DLY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:25.663128] [INFO ] [MAIN ] DLY: Generated 1807 derivative records from 20149 primary records. [2025-10-02T22:37:25.663828] [DEBUG] [LOCAL ] DLY: Saving derivative data. [2025-10-02T22:37:25.696031] [DEBUG] [LOCAL ] DLY: Derivative data saved (1807 records). [2025-10-02T22:37:25.694916] [DEBUG] [LOCAL ] DMB: Derivative data saved (1807 records). [2025-10-02T22:37:25.698428] [INFO ] [MAIN ] DMB: Successfully saved derivative data. [2025-10-02T22:37:25.698363] [INFO ] [MAIN ] DLY: Successfully saved derivative data. [2025-10-02T22:37:25.703332] [INFO ] [MAIN ] Derivative Progress: 512/1975 symbols completed. DMB took 1.2s. Estimated remaining: 10m 18s. Rate: 142.0 symbols/min [2025-10-02T22:37:25.705874] [INFO ] [MAIN ] Derivative Progress: 513/1975 symbols completed. DLY took 1.2s. Estimated remaining: 10m 17s. Rate: 142.3 symbols/min [2025-10-02T22:37:25.706156] [INFO ] [MAIN ] DNOW: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:25.705811] [INFO ] [MAIN ] DNA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:25.712123] [DEBUG] [LOCAL ] DMO: Loaded 9961 existing records from primary storage. [2025-10-02T22:37:25.712459] [INFO ] [MAIN ] DMO: Loaded 9961 primary data records. [2025-10-02T22:37:26.125922] [DEBUG] [LOCAL ] DNA: Loaded 48642 existing records from primary storage. [2025-10-02T22:37:26.127013] [DEBUG] [LOCAL ] DNOW: Loaded 44016 existing records from primary storage. [2025-10-02T22:37:26.127548] [INFO ] [MAIN ] DNOW: Loaded 44016 primary data records. [2025-10-02T22:37:26.127430] [INFO ] [MAIN ] DNA: Loaded 48642 primary data records. [2025-10-02T22:37:26.840886] [DEBUG] [MAIN ] DMO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:26.841900] [INFO ] [MAIN ] DMO: Generated 1807 derivative records from 9961 primary records. [2025-10-02T22:37:26.842132] [DEBUG] [LOCAL ] DMO: Saving derivative data. [2025-10-02T22:37:26.864360] [DEBUG] [LOCAL ] DMO: Derivative data saved (1807 records). [2025-10-02T22:37:26.864809] [INFO ] [MAIN ] DMO: Successfully saved derivative data. [2025-10-02T22:37:26.867377] [INFO ] [MAIN ] Derivative Progress: 514/1975 symbols completed. DMO took 1.2s. Estimated remaining: 10m 18s. Rate: 141.8 symbols/min [2025-10-02T22:37:26.868073] [INFO ] [MAIN ] DNP: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:26.886753] [DEBUG] [MAIN ] DNOW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:26.890248] [INFO ] [MAIN ] DNOW: Generated 1807 derivative records from 44016 primary records. [2025-10-02T22:37:26.890672] [DEBUG] [LOCAL ] DNOW: Saving derivative data. [2025-10-02T22:37:26.917496] [DEBUG] [MAIN ] DNA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:26.918869] [INFO ] [MAIN ] DNA: Generated 1807 derivative records from 48642 primary records. [2025-10-02T22:37:26.919412] [DEBUG] [LOCAL ] DNA: Saving derivative data. [2025-10-02T22:37:26.959536] [DEBUG] [LOCAL ] DNA: Derivative data saved (1807 records). [2025-10-02T22:37:26.960820] [DEBUG] [LOCAL ] DNOW: Derivative data saved (1807 records). [2025-10-02T22:37:26.961028] [INFO ] [MAIN ] DNA: Successfully saved derivative data. [2025-10-02T22:37:26.963062] [INFO ] [MAIN ] Derivative Progress: 515/1975 symbols completed. DNA took 1.3s. Estimated remaining: 10m 17s. Rate: 142.0 symbols/min [2025-10-02T22:37:26.960980] [INFO ] [MAIN ] DNOW: Successfully saved derivative data. [2025-10-02T22:37:26.966431] [INFO ] [MAIN ] DOC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:26.963950] [DEBUG] [LOCAL ] DNP: Loaded 33447 existing records from primary storage. [2025-10-02T22:37:26.966524] [INFO ] [MAIN ] Derivative Progress: 516/1975 symbols completed. DNOW took 1.3s. Estimated remaining: 10m 15s. Rate: 142.3 symbols/min [2025-10-02T22:37:26.967370] [INFO ] [MAIN ] DNP: Loaded 33447 primary data records. [2025-10-02T22:37:26.967829] [INFO ] [MAIN ] DOCN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:27.346913] [DEBUG] [LOCAL ] DOC: Loaded 53930 existing records from primary storage. [2025-10-02T22:37:27.345570] [DEBUG] [LOCAL ] DOCN: Loaded 50952 existing records from primary storage. [2025-10-02T22:37:27.347487] [INFO ] [MAIN ] DOCN: Loaded 50952 primary data records. [2025-10-02T22:37:27.347420] [INFO ] [MAIN ] DOC: Loaded 53930 primary data records. [2025-10-02T22:37:28.068922] [DEBUG] [MAIN ] DNP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:28.071067] [INFO ] [MAIN ] DNP: Generated 1807 derivative records from 33447 primary records. [2025-10-02T22:37:28.071224] [DEBUG] [LOCAL ] DNP: Saving derivative data. [2025-10-02T22:37:28.092795] [DEBUG] [LOCAL ] DNP: Derivative data saved (1807 records). [2025-10-02T22:37:28.093416] [INFO ] [MAIN ] DNP: Successfully saved derivative data. [2025-10-02T22:37:28.097140] [INFO ] [MAIN ] Derivative Progress: 517/1975 symbols completed. DNP took 1.2s. Estimated remaining: 10m 17s. Rate: 141.8 symbols/min [2025-10-02T22:37:28.098014] [INFO ] [MAIN ] DOCS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:28.119730] [DEBUG] [MAIN ] DOCN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:28.122494] [INFO ] [MAIN ] DOCN: Generated 1807 derivative records from 50952 primary records. [2025-10-02T22:37:28.122871] [DEBUG] [LOCAL ] DOCN: Saving derivative data. [2025-10-02T22:37:28.137152] [DEBUG] [MAIN ] DOC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:28.150369] [INFO ] [MAIN ] DOC: Generated 1807 derivative records from 53930 primary records. [2025-10-02T22:37:28.155667] [DEBUG] [LOCAL ] DOCN: Derivative data saved (1807 records). [2025-10-02T22:37:28.155773] [DEBUG] [LOCAL ] DOC: Saving derivative data. [2025-10-02T22:37:28.155910] [INFO ] [MAIN ] DOCN: Successfully saved derivative data. [2025-10-02T22:37:28.157913] [INFO ] [MAIN ] Derivative Progress: 518/1975 symbols completed. DOCN took 1.2s. Estimated remaining: 10m 15s. Rate: 142.0 symbols/min [2025-10-02T22:37:28.158766] [INFO ] [MAIN ] DOLE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:28.179506] [DEBUG] [LOCAL ] DOC: Derivative data saved (1807 records). [2025-10-02T22:37:28.193515] [INFO ] [MAIN ] DOC: Successfully saved derivative data. [2025-10-02T22:37:28.196355] [INFO ] [MAIN ] Derivative Progress: 519/1975 symbols completed. DOC took 1.2s. Estimated remaining: 10m 14s. Rate: 142.3 symbols/min [2025-10-02T22:37:28.196920] [INFO ] [MAIN ] DOUG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:28.230633] [DEBUG] [LOCAL ] DOCS: Loaded 51492 existing records from primary storage. [2025-10-02T22:37:28.231515] [INFO ] [MAIN ] DOCS: Loaded 51492 primary data records. [2025-10-02T22:37:28.291980] [DEBUG] [LOCAL ] DOLE: Loaded 38730 existing records from primary storage. [2025-10-02T22:37:28.301008] [INFO ] [MAIN ] DOLE: Loaded 38730 primary data records. [2025-10-02T22:37:28.474112] [DEBUG] [LOCAL ] DOUG: Loaded 34608 existing records from primary storage. [2025-10-02T22:37:28.561212] [INFO ] [MAIN ] DOUG: Loaded 34608 primary data records. [2025-10-02T22:37:29.281957] [DEBUG] [MAIN ] DOCS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:29.283064] [INFO ] [MAIN ] DOCS: Generated 1807 derivative records from 51492 primary records. [2025-10-02T22:37:29.283168] [DEBUG] [LOCAL ] DOCS: Saving derivative data. [2025-10-02T22:37:29.305833] [DEBUG] [LOCAL ] DOCS: Derivative data saved (1807 records). [2025-10-02T22:37:29.319839] [INFO ] [MAIN ] DOCS: Successfully saved derivative data. [2025-10-02T22:37:29.322921] [INFO ] [MAIN ] Derivative Progress: 520/1975 symbols completed. DOCS took 1.2s. Estimated remaining: 10m 15s. Rate: 141.8 symbols/min [2025-10-02T22:37:29.323295] [INFO ] [MAIN ] DOV: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:29.320240] [DEBUG] [MAIN ] DOLE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:29.324805] [INFO ] [MAIN ] DOLE: Generated 1807 derivative records from 38730 primary records. [2025-10-02T22:37:29.325144] [DEBUG] [LOCAL ] DOLE: Saving derivative data. [2025-10-02T22:37:29.359834] [DEBUG] [MAIN ] DOUG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:29.360789] [DEBUG] [LOCAL ] DOLE: Derivative data saved (1807 records). [2025-10-02T22:37:29.361791] [INFO ] [MAIN ] DOLE: Successfully saved derivative data. [2025-10-02T22:37:29.361705] [INFO ] [MAIN ] DOUG: Generated 1807 derivative records from 34608 primary records. [2025-10-02T22:37:29.363979] [INFO ] [MAIN ] Derivative Progress: 521/1975 symbols completed. DOLE took 1.2s. Estimated remaining: 10m 14s. Rate: 142.1 symbols/min [2025-10-02T22:37:29.361897] [DEBUG] [LOCAL ] DOUG: Saving derivative data. [2025-10-02T22:37:29.364233] [INFO ] [MAIN ] DOW: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:29.384903] [DEBUG] [LOCAL ] DOUG: Derivative data saved (1807 records). [2025-10-02T22:37:29.385054] [INFO ] [MAIN ] DOUG: Successfully saved derivative data. [2025-10-02T22:37:29.387392] [INFO ] [MAIN ] Derivative Progress: 522/1975 symbols completed. DOUG took 1.2s. Estimated remaining: 10m 12s. Rate: 142.3 symbols/min [2025-10-02T22:37:29.387708] [INFO ] [MAIN ] DQ: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:29.452220] [DEBUG] [LOCAL ] DOV: Loaded 45755 existing records from primary storage. [2025-10-02T22:37:29.464778] [INFO ] [MAIN ] DOV: Loaded 45755 primary data records. [2025-10-02T22:37:29.504327] [DEBUG] [LOCAL ] DQ: Loaded 43712 existing records from primary storage. [2025-10-02T22:37:29.535231] [INFO ] [MAIN ] DQ: Loaded 43712 primary data records. [2025-10-02T22:37:29.616422] [DEBUG] [LOCAL ] DOW: Loaded 54123 existing records from primary storage. [2025-10-02T22:37:29.689822] [INFO ] [MAIN ] DOW: Loaded 54123 primary data records. [2025-10-02T22:37:30.575636] [DEBUG] [MAIN ] DOV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:30.577601] [INFO ] [MAIN ] DOV: Generated 1807 derivative records from 45755 primary records. [2025-10-02T22:37:30.578924] [DEBUG] [LOCAL ] DOV: Saving derivative data. [2025-10-02T22:37:30.615130] [DEBUG] [LOCAL ] DOV: Derivative data saved (1807 records). [2025-10-02T22:37:30.614215] [DEBUG] [MAIN ] DQ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:30.629039] [INFO ] [MAIN ] DQ: Generated 1807 derivative records from 43712 primary records. [2025-10-02T22:37:30.628075] [INFO ] [MAIN ] DOV: Successfully saved derivative data. [2025-10-02T22:37:30.629174] [DEBUG] [LOCAL ] DQ: Saving derivative data. [2025-10-02T22:37:30.632105] [INFO ] [MAIN ] Derivative Progress: 523/1975 symbols completed. DOV took 1.3s. Estimated remaining: 10m 14s. Rate: 141.8 symbols/min [2025-10-02T22:37:30.633317] [DEBUG] [MAIN ] DOW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:30.634726] [INFO ] [MAIN ] DOW: Generated 1807 derivative records from 54123 primary records. [2025-10-02T22:37:30.642239] [DEBUG] [LOCAL ] DOW: Saving derivative data. [2025-10-02T22:37:30.665726] [DEBUG] [LOCAL ] DQ: Derivative data saved (1807 records). [2025-10-02T22:37:30.668187] [INFO ] [MAIN ] DQ: Successfully saved derivative data. [2025-10-02T22:37:30.670347] [INFO ] [MAIN ] Derivative Progress: 524/1975 symbols completed. DQ took 1.3s. Estimated remaining: 10m 13s. Rate: 142.1 symbols/min [2025-10-02T22:37:30.668084] [DEBUG] [LOCAL ] DOW: Derivative data saved (1807 records). [2025-10-02T22:37:30.670677] [INFO ] [MAIN ] DOW: Successfully saved derivative data. [2025-10-02T22:37:30.673143] [INFO ] [MAIN ] Derivative Progress: 525/1975 symbols completed. DOW took 1.3s. Estimated remaining: 10m 11s. Rate: 142.3 symbols/min [2025-10-02T22:37:30.673549] [INFO ] [MAIN ] DRI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:30.673707] [INFO ] [MAIN ] DRLL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:30.673770] [INFO ] [MAIN ] DRH: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:30.687485] [DEBUG] [LOCAL ] DRLL: Loaded 9485 existing records from primary storage. [2025-10-02T22:37:30.687715] [INFO ] [MAIN ] DRLL: Loaded 9485 primary data records. [2025-10-02T22:37:31.076552] [DEBUG] [LOCAL ] DRH: Loaded 50844 existing records from primary storage. [2025-10-02T22:37:31.076846] [INFO ] [MAIN ] DRH: Loaded 50844 primary data records. [2025-10-02T22:37:31.077844] [DEBUG] [LOCAL ] DRI: Loaded 48135 existing records from primary storage. [2025-10-02T22:37:31.078220] [INFO ] [MAIN ] DRI: Loaded 48135 primary data records. [2025-10-02T22:37:31.800225] [DEBUG] [MAIN ] DRLL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:31.802314] [INFO ] [MAIN ] DRLL: Generated 1807 derivative records from 9485 primary records. [2025-10-02T22:37:31.802602] [DEBUG] [LOCAL ] DRLL: Saving derivative data. [2025-10-02T22:37:31.824085] [DEBUG] [LOCAL ] DRLL: Derivative data saved (1807 records). [2025-10-02T22:37:31.824243] [INFO ] [MAIN ] DRLL: Successfully saved derivative data. [2025-10-02T22:37:31.826333] [INFO ] [MAIN ] Derivative Progress: 526/1975 symbols completed. DRLL took 1.2s. Estimated remaining: 10m 13s. Rate: 141.9 symbols/min [2025-10-02T22:37:31.826876] [INFO ] [MAIN ] DSL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:31.875931] [DEBUG] [MAIN ] DRH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:31.882091] [INFO ] [MAIN ] DRH: Generated 1807 derivative records from 50844 primary records. [2025-10-02T22:37:31.882989] [DEBUG] [MAIN ] DRI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:31.883080] [DEBUG] [LOCAL ] DRH: Saving derivative data. [2025-10-02T22:37:31.884411] [INFO ] [MAIN ] DRI: Generated 1807 derivative records from 48135 primary records. [2025-10-02T22:37:31.884622] [DEBUG] [LOCAL ] DRI: Saving derivative data. [2025-10-02T22:37:31.928145] [DEBUG] [LOCAL ] DSL: Loaded 28612 existing records from primary storage. [2025-10-02T22:37:31.928324] [INFO ] [MAIN ] DSL: Loaded 28612 primary data records. [2025-10-02T22:37:31.926860] [DEBUG] [LOCAL ] DRH: Derivative data saved (1807 records). [2025-10-02T22:37:31.928470] [INFO ] [MAIN ] DRH: Successfully saved derivative data. [2025-10-02T22:37:31.931713] [INFO ] [MAIN ] Derivative Progress: 527/1975 symbols completed. DRH took 1.3s. Estimated remaining: 10m 12s. Rate: 142.1 symbols/min [2025-10-02T22:37:31.968693] [INFO ] [MAIN ] DSM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:32.057241] [DEBUG] [LOCAL ] DRI: Derivative data saved (1807 records). [2025-10-02T22:37:32.057445] [INFO ] [MAIN ] DRI: Successfully saved derivative data. [2025-10-02T22:37:32.059902] [INFO ] [MAIN ] Derivative Progress: 528/1975 symbols completed. DRI took 1.4s. Estimated remaining: 10m 10s. Rate: 142.3 symbols/min [2025-10-02T22:37:32.060150] [INFO ] [MAIN ] DSU: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:32.170820] [DEBUG] [LOCAL ] DSM: Loaded 15196 existing records from primary storage. [2025-10-02T22:37:32.296252] [INFO ] [MAIN ] DSM: Loaded 15196 primary data records. [2025-10-02T22:37:32.371952] [DEBUG] [LOCAL ] DSU: Loaded 22729 existing records from primary storage. [2025-10-02T22:37:32.400517] [INFO ] [MAIN ] DSU: Loaded 22729 primary data records. [2025-10-02T22:37:33.038511] [DEBUG] [MAIN ] DSL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:33.039498] [INFO ] [MAIN ] DSL: Generated 1807 derivative records from 28612 primary records. [2025-10-02T22:37:33.040035] [DEBUG] [LOCAL ] DSL: Saving derivative data. [2025-10-02T22:37:33.060979] [DEBUG] [LOCAL ] DSL: Derivative data saved (1807 records). [2025-10-02T22:37:33.061745] [INFO ] [MAIN ] DSL: Successfully saved derivative data. [2025-10-02T22:37:33.064533] [INFO ] [MAIN ] Derivative Progress: 529/1975 symbols completed. DSL took 1.2s. Estimated remaining: 10m 11s. Rate: 141.9 symbols/min [2025-10-02T22:37:33.065037] [INFO ] [MAIN ] DSX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:33.083535] [DEBUG] [MAIN ] DSM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:33.084542] [INFO ] [MAIN ] DSM: Generated 1807 derivative records from 15196 primary records. [2025-10-02T22:37:33.085511] [DEBUG] [LOCAL ] DSM: Saving derivative data. [2025-10-02T22:37:33.120610] [DEBUG] [MAIN ] DSU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:33.122396] [INFO ] [MAIN ] DSU: Generated 1807 derivative records from 22729 primary records. [2025-10-02T22:37:33.122746] [DEBUG] [LOCAL ] DSU: Saving derivative data. [2025-10-02T22:37:33.123600] [DEBUG] [LOCAL ] DSM: Derivative data saved (1807 records). [2025-10-02T22:37:33.123711] [INFO ] [MAIN ] DSM: Successfully saved derivative data. [2025-10-02T22:37:33.126034] [INFO ] [MAIN ] Derivative Progress: 530/1975 symbols completed. DSM took 1.2s. Estimated remaining: 10m 10s. Rate: 142.1 symbols/min [2025-10-02T22:37:33.126206] [INFO ] [MAIN ] DT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:33.152036] [DEBUG] [LOCAL ] DSU: Derivative data saved (1807 records). [2025-10-02T22:37:33.150753] [DEBUG] [LOCAL ] DSX: Loaded 24147 existing records from primary storage. [2025-10-02T22:37:33.152323] [INFO ] [MAIN ] DSU: Successfully saved derivative data. [2025-10-02T22:37:33.152423] [INFO ] [MAIN ] DSX: Loaded 24147 primary data records. [2025-10-02T22:37:33.154763] [INFO ] [MAIN ] Derivative Progress: 531/1975 symbols completed. DSU took 1.1s. Estimated remaining: 10m 9s. Rate: 142.4 symbols/min [2025-10-02T22:37:33.160292] [INFO ] [MAIN ] DTB: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:33.270159] [DEBUG] [LOCAL ] DTB: Loaded 4947 existing records from primary storage. [2025-10-02T22:37:33.278216] [INFO ] [MAIN ] DTB: Loaded 4947 primary data records. [2025-10-02T22:37:33.847827] [DEBUG] [LOCAL ] DT: Loaded 53316 existing records from primary storage. [2025-10-02T22:37:33.857181] [INFO ] [MAIN ] DT: Loaded 53316 primary data records. [2025-10-02T22:37:34.217336] [DEBUG] [MAIN ] DSX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:34.218694] [INFO ] [MAIN ] DSX: Generated 1807 derivative records from 24147 primary records. [2025-10-02T22:37:34.219286] [DEBUG] [LOCAL ] DSX: Saving derivative data. [2025-10-02T22:37:34.239782] [DEBUG] [LOCAL ] DSX: Derivative data saved (1807 records). [2025-10-02T22:37:34.241012] [INFO ] [MAIN ] DSX: Successfully saved derivative data. [2025-10-02T22:37:34.244147] [INFO ] [MAIN ] Derivative Progress: 532/1975 symbols completed. DSX took 1.2s. Estimated remaining: 10m 10s. Rate: 141.9 symbols/min [2025-10-02T22:37:34.244552] [INFO ] [MAIN ] DTE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:34.259359] [DEBUG] [MAIN ] DTB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:34.261240] [INFO ] [MAIN ] DTB: Generated 1807 derivative records from 4947 primary records. [2025-10-02T22:37:34.261602] [DEBUG] [LOCAL ] DTB: Saving derivative data. [2025-10-02T22:37:34.284822] [DEBUG] [LOCAL ] DTB: Derivative data saved (1807 records). [2025-10-02T22:37:34.285004] [INFO ] [MAIN ] DTB: Successfully saved derivative data. [2025-10-02T22:37:34.287294] [INFO ] [MAIN ] Derivative Progress: 533/1975 symbols completed. DTB took 1.1s. Estimated remaining: 10m 9s. Rate: 142.2 symbols/min [2025-10-02T22:37:34.295631] [INFO ] [MAIN ] DTM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:34.301544] [DEBUG] [MAIN ] DT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:34.314976] [INFO ] [MAIN ] DT: Generated 1807 derivative records from 53316 primary records. [2025-10-02T22:37:34.315180] [DEBUG] [LOCAL ] DT: Saving derivative data. [2025-10-02T22:37:34.332754] [DEBUG] [LOCAL ] DT: Derivative data saved (1807 records). [2025-10-02T22:37:34.332855] [INFO ] [MAIN ] DT: Successfully saved derivative data. [2025-10-02T22:37:34.336062] [INFO ] [MAIN ] Derivative Progress: 534/1975 symbols completed. DT took 1.2s. Estimated remaining: 10m 7s. Rate: 142.4 symbols/min [2025-10-02T22:37:34.336492] [INFO ] [MAIN ] DTW: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:34.353555] [DEBUG] [LOCAL ] DTE: Loaded 48040 existing records from primary storage. [2025-10-02T22:37:34.354064] [INFO ] [MAIN ] DTE: Loaded 48040 primary data records. [2025-10-02T22:37:34.460881] [DEBUG] [LOCAL ] DTW: Loaded 4936 existing records from primary storage. [2025-10-02T22:37:34.479275] [INFO ] [MAIN ] DTW: Loaded 4936 primary data records. [2025-10-02T22:37:34.645344] [DEBUG] [LOCAL ] DTM: Loaded 44445 existing records from primary storage. [2025-10-02T22:37:34.861391] [INFO ] [MAIN ] DTM: Loaded 44445 primary data records. [2025-10-02T22:37:35.459003] [DEBUG] [MAIN ] DTE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:35.459917] [INFO ] [MAIN ] DTE: Generated 1807 derivative records from 48040 primary records. [2025-10-02T22:37:35.460215] [DEBUG] [LOCAL ] DTE: Saving derivative data. [2025-10-02T22:37:35.481527] [DEBUG] [LOCAL ] DTE: Derivative data saved (1807 records). [2025-10-02T22:37:35.482663] [INFO ] [MAIN ] DTE: Successfully saved derivative data. [2025-10-02T22:37:35.484868] [INFO ] [MAIN ] Derivative Progress: 535/1975 symbols completed. DTE took 1.2s. Estimated remaining: 10m 9s. Rate: 142.0 symbols/min [2025-10-02T22:37:35.485264] [INFO ] [MAIN ] DUK: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:35.499585] [DEBUG] [MAIN ] DTW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:35.500729] [INFO ] [MAIN ] DTW: Generated 1807 derivative records from 4936 primary records. [2025-10-02T22:37:35.500933] [DEBUG] [LOCAL ] DTW: Saving derivative data. [2025-10-02T22:37:35.521489] [DEBUG] [LOCAL ] DTW: Derivative data saved (1807 records). [2025-10-02T22:37:35.534632] [INFO ] [MAIN ] DTW: Successfully saved derivative data. [2025-10-02T22:37:35.537422] [INFO ] [MAIN ] Derivative Progress: 536/1975 symbols completed. DTW took 1.2s. Estimated remaining: 10m 7s. Rate: 142.2 symbols/min [2025-10-02T22:37:35.535053] [DEBUG] [MAIN ] DTM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:35.537708] [INFO ] [MAIN ] DUKB: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:35.538938] [INFO ] [MAIN ] DTM: Generated 1807 derivative records from 44445 primary records. [2025-10-02T22:37:35.539439] [DEBUG] [LOCAL ] DTM: Saving derivative data. [2025-10-02T22:37:35.562600] [DEBUG] [LOCAL ] DUKB: Loaded 6410 existing records from primary storage. [2025-10-02T22:37:35.562763] [INFO ] [MAIN ] DUKB: Loaded 6410 primary data records. [2025-10-02T22:37:35.645474] [DEBUG] [LOCAL ] DTM: Derivative data saved (1807 records). [2025-10-02T22:37:35.662761] [INFO ] [MAIN ] DTM: Successfully saved derivative data. [2025-10-02T22:37:35.693174] [INFO ] [MAIN ] Derivative Progress: 537/1975 symbols completed. DTM took 1.4s. Estimated remaining: 10m 6s. Rate: 142.4 symbols/min [2025-10-02T22:37:35.704898] [INFO ] [MAIN ] DV: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:35.767917] [DEBUG] [LOCAL ] DUK: Loaded 53845 existing records from primary storage. [2025-10-02T22:37:35.773318] [INFO ] [MAIN ] DUK: Loaded 53845 primary data records. [2025-10-02T22:37:36.261613] [DEBUG] [LOCAL ] DV: Loaded 51670 existing records from primary storage. [2025-10-02T22:37:36.271260] [INFO ] [MAIN ] DV: Loaded 51670 primary data records. [2025-10-02T22:37:36.815719] [DEBUG] [MAIN ] DUKB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:36.817382] [INFO ] [MAIN ] DUKB: Generated 1807 derivative records from 6410 primary records. [2025-10-02T22:37:36.817856] [DEBUG] [LOCAL ] DUKB: Saving derivative data. [2025-10-02T22:37:36.837798] [DEBUG] [LOCAL ] DUKB: Derivative data saved (1807 records). [2025-10-02T22:37:36.838508] [INFO ] [MAIN ] DUKB: Successfully saved derivative data. [2025-10-02T22:37:36.840906] [INFO ] [MAIN ] Derivative Progress: 538/1975 symbols completed. DUKB took 1.3s. Estimated remaining: 10m 8s. Rate: 141.9 symbols/min [2025-10-02T22:37:36.860245] [DEBUG] [MAIN ] DUK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:36.861470] [INFO ] [MAIN ] DUK: Generated 1807 derivative records from 53845 primary records. [2025-10-02T22:37:36.861685] [DEBUG] [LOCAL ] DUK: Saving derivative data. [2025-10-02T22:37:36.885417] [DEBUG] [LOCAL ] DUK: Derivative data saved (1807 records). [2025-10-02T22:37:36.885860] [INFO ] [MAIN ] DUK: Successfully saved derivative data. [2025-10-02T22:37:36.888124] [INFO ] [MAIN ] Derivative Progress: 539/1975 symbols completed. DUK took 1.4s. Estimated remaining: 10m 6s. Rate: 142.1 symbols/min [2025-10-02T22:37:36.901016] [DEBUG] [MAIN ] DV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:36.901770] [INFO ] [MAIN ] DV: Generated 1807 derivative records from 51670 primary records. [2025-10-02T22:37:36.901836] [DEBUG] [LOCAL ] DV: Saving derivative data. [2025-10-02T22:37:36.917380] [DEBUG] [LOCAL ] DV: Derivative data saved (1807 records). [2025-10-02T22:37:36.917482] [INFO ] [MAIN ] DV: Successfully saved derivative data. [2025-10-02T22:37:36.919499] [INFO ] [MAIN ] Derivative Progress: 540/1975 symbols completed. DV took 1.2s. Estimated remaining: 10m 5s. Rate: 142.4 symbols/min [2025-10-02T22:37:36.920157] [INFO ] [MAIN ] DX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:36.920091] [INFO ] [MAIN ] DVA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:36.920275] [INFO ] [MAIN ] DVN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:36.982844] [DEBUG] [LOCAL ] DVA: Loaded 41335 existing records from primary storage. [2025-10-02T22:37:36.983164] [INFO ] [MAIN ] DVA: Loaded 41335 primary data records. [2025-10-02T22:37:37.140950] [DEBUG] [LOCAL ] DX: Loaded 52848 existing records from primary storage. [2025-10-02T22:37:37.151775] [INFO ] [MAIN ] DX: Loaded 52848 primary data records. [2025-10-02T22:37:37.435095] [DEBUG] [LOCAL ] DVN: Loaded 54089 existing records from primary storage. [2025-10-02T22:37:37.440487] [INFO ] [MAIN ] DVN: Loaded 54089 primary data records. [2025-10-02T22:37:38.059322] [DEBUG] [MAIN ] DVA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:38.060386] [INFO ] [MAIN ] DVA: Generated 1807 derivative records from 41335 primary records. [2025-10-02T22:37:38.060715] [DEBUG] [LOCAL ] DVA: Saving derivative data. [2025-10-02T22:37:38.112349] [DEBUG] [MAIN ] DX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:38.114845] [DEBUG] [MAIN ] DVN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:38.114467] [INFO ] [MAIN ] DX: Generated 1807 derivative records from 52848 primary records. [2025-10-02T22:37:38.115836] [DEBUG] [LOCAL ] DVA: Derivative data saved (1807 records). [2025-10-02T22:37:38.116563] [INFO ] [MAIN ] DVN: Generated 1807 derivative records from 54089 primary records. [2025-10-02T22:37:38.115906] [DEBUG] [LOCAL ] DX: Saving derivative data. [2025-10-02T22:37:38.116760] [INFO ] [MAIN ] DVA: Successfully saved derivative data. [2025-10-02T22:37:38.119614] [INFO ] [MAIN ] Derivative Progress: 541/1975 symbols completed. DVA took 1.2s. Estimated remaining: 10m 6s. Rate: 141.9 symbols/min [2025-10-02T22:37:38.116869] [DEBUG] [LOCAL ] DVN: Saving derivative data. [2025-10-02T22:37:38.120076] [INFO ] [MAIN ] DXYZ: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:38.150501] [DEBUG] [LOCAL ] DX: Derivative data saved (1807 records). [2025-10-02T22:37:38.152048] [INFO ] [MAIN ] DX: Successfully saved derivative data. [2025-10-02T22:37:38.154318] [INFO ] [MAIN ] Derivative Progress: 542/1975 symbols completed. DX took 1.2s. Estimated remaining: 10m 5s. Rate: 142.1 symbols/min [2025-10-02T22:37:38.154933] [INFO ] [MAIN ] DY: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:38.159241] [DEBUG] [LOCAL ] DVN: Derivative data saved (1807 records). [2025-10-02T22:37:38.159367] [INFO ] [MAIN ] DVN: Successfully saved derivative data. [2025-10-02T22:37:38.161370] [INFO ] [MAIN ] Derivative Progress: 543/1975 symbols completed. DVN took 1.2s. Estimated remaining: 10m 3s. Rate: 142.4 symbols/min [2025-10-02T22:37:38.161695] [INFO ] [MAIN ] E: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:38.214541] [DEBUG] [LOCAL ] E: Loaded 33524 existing records from primary storage. [2025-10-02T22:37:38.214797] [INFO ] [MAIN ] E: Loaded 33524 primary data records. [2025-10-02T22:37:38.342981] [DEBUG] [LOCAL ] DY: Loaded 29225 existing records from primary storage. [2025-10-02T22:37:38.346924] [INFO ] [MAIN ] DY: Loaded 29225 primary data records. [2025-10-02T22:37:38.376793] [DEBUG] [LOCAL ] DXYZ: Loaded 37235 existing records from primary storage. [2025-10-02T22:37:38.430893] [INFO ] [MAIN ] DXYZ: Loaded 37235 primary data records. [2025-10-02T22:37:39.303021] [DEBUG] [MAIN ] E: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:39.305214] [INFO ] [MAIN ] E: Generated 1807 derivative records from 33524 primary records. [2025-10-02T22:37:39.307180] [DEBUG] [LOCAL ] E: Saving derivative data. [2025-10-02T22:37:39.335279] [DEBUG] [MAIN ] DY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:39.337155] [INFO ] [MAIN ] DY: Generated 1807 derivative records from 29225 primary records. [2025-10-02T22:37:39.337364] [DEBUG] [LOCAL ] DY: Saving derivative data. [2025-10-02T22:37:39.358829] [DEBUG] [LOCAL ] DY: Derivative data saved (1807 records). [2025-10-02T22:37:39.372446] [INFO ] [MAIN ] DY: Successfully saved derivative data. [2025-10-02T22:37:39.375325] [DEBUG] [MAIN ] DXYZ: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-02T22:37:39.374896] [INFO ] [MAIN ] Derivative Progress: 544/1975 symbols completed. DY took 1.2s. Estimated remaining: 10m 5s. Rate: 141.9 symbols/min [2025-10-02T22:37:39.375492] [INFO ] [MAIN ] EAF: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:39.376398] [INFO ] [MAIN ] DXYZ: Generated 1806 derivative records from 37235 primary records. [2025-10-02T22:37:39.372368] [DEBUG] [LOCAL ] E: Derivative data saved (1807 records). [2025-10-02T22:37:39.376707] [INFO ] [MAIN ] E: Successfully saved derivative data. [2025-10-02T22:37:39.376569] [DEBUG] [LOCAL ] DXYZ: Saving derivative data. [2025-10-02T22:37:39.379581] [INFO ] [MAIN ] Derivative Progress: 545/1975 symbols completed. E took 1.2s. Estimated remaining: 10m 4s. Rate: 142.2 symbols/min [2025-10-02T22:37:39.380075] [INFO ] [MAIN ] EARN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:39.398857] [DEBUG] [LOCAL ] DXYZ: Derivative data saved (1806 records). [2025-10-02T22:37:39.399127] [INFO ] [MAIN ] DXYZ: Successfully saved derivative data. [2025-10-02T22:37:39.401859] [INFO ] [MAIN ] Derivative Progress: 546/1975 symbols completed. DXYZ took 1.3s. Estimated remaining: 10m 2s. Rate: 142.4 symbols/min [2025-10-02T22:37:39.402202] [INFO ] [MAIN ] EAT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:39.438285] [DEBUG] [LOCAL ] EARN: Loaded 29843 existing records from primary storage. [2025-10-02T22:37:39.451222] [INFO ] [MAIN ] EARN: Loaded 29843 primary data records. [2025-10-02T22:37:39.490894] [DEBUG] [LOCAL ] EAF: Loaded 42985 existing records from primary storage. [2025-10-02T22:37:39.510202] [INFO ] [MAIN ] EAF: Loaded 42985 primary data records. [2025-10-02T22:37:39.770963] [DEBUG] [LOCAL ] EAT: Loaded 50148 existing records from primary storage. [2025-10-02T22:37:39.795514] [INFO ] [MAIN ] EAT: Loaded 50148 primary data records. [2025-10-02T22:37:40.565247] [DEBUG] [MAIN ] EARN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:40.567054] [INFO ] [MAIN ] EARN: Generated 1807 derivative records from 29843 primary records. [2025-10-02T22:37:40.576020] [DEBUG] [LOCAL ] EARN: Saving derivative data. [2025-10-02T22:37:40.583610] [DEBUG] [MAIN ] EAF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:40.601100] [INFO ] [MAIN ] EAF: Generated 1807 derivative records from 42985 primary records. [2025-10-02T22:37:40.602156] [DEBUG] [LOCAL ] EAF: Saving derivative data. [2025-10-02T22:37:40.642213] [DEBUG] [LOCAL ] EARN: Derivative data saved (1807 records). [2025-10-02T22:37:40.642836] [DEBUG] [MAIN ] EAT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:40.644522] [INFO ] [MAIN ] EAT: Generated 1807 derivative records from 50148 primary records. [2025-10-02T22:37:40.645123] [DEBUG] [LOCAL ] EAT: Saving derivative data. [2025-10-02T22:37:40.643749] [INFO ] [MAIN ] EARN: Successfully saved derivative data. [2025-10-02T22:37:40.645475] [DEBUG] [LOCAL ] EAF: Derivative data saved (1807 records). [2025-10-02T22:37:40.645700] [INFO ] [MAIN ] EAF: Successfully saved derivative data. [2025-10-02T22:37:40.648413] [INFO ] [MAIN ] Derivative Progress: 547/1975 symbols completed. EARN took 1.3s. Estimated remaining: 10m 4s. Rate: 141.9 symbols/min [2025-10-02T22:37:40.651273] [INFO ] [MAIN ] Derivative Progress: 548/1975 symbols completed. EAF took 1.3s. Estimated remaining: 10m 2s. Rate: 142.2 symbols/min [2025-10-02T22:37:40.651503] [INFO ] [MAIN ] EC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:40.648767] [INFO ] [MAIN ] EBR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:40.673047] [DEBUG] [LOCAL ] EAT: Derivative data saved (1807 records). [2025-10-02T22:37:40.673233] [INFO ] [MAIN ] EAT: Successfully saved derivative data. [2025-10-02T22:37:40.675776] [INFO ] [MAIN ] Derivative Progress: 549/1975 symbols completed. EAT took 1.3s. Estimated remaining: 10m 1s. Rate: 142.4 symbols/min [2025-10-02T22:37:40.676206] [INFO ] [MAIN ] ECC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:40.763560] [DEBUG] [LOCAL ] EBR: Loaded 43379 existing records from primary storage. [2025-10-02T22:37:40.764534] [INFO ] [MAIN ] EBR: Loaded 43379 primary data records. [2025-10-02T22:37:40.765309] [DEBUG] [LOCAL ] ECC: Loaded 43668 existing records from primary storage. [2025-10-02T22:37:40.816312] [DEBUG] [LOCAL ] EC: Loaded 49591 existing records from primary storage. [2025-10-02T22:37:40.807110] [INFO ] [MAIN ] ECC: Loaded 43668 primary data records. [2025-10-02T22:37:40.821940] [INFO ] [MAIN ] EC: Loaded 49591 primary data records. [2025-10-02T22:37:41.894678] [DEBUG] [MAIN ] EC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:41.921910] [INFO ] [MAIN ] EC: Generated 1807 derivative records from 49591 primary records. [2025-10-02T22:37:41.920876] [DEBUG] [MAIN ] ECC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:41.922811] [DEBUG] [MAIN ] EBR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:41.923518] [INFO ] [MAIN ] ECC: Generated 1807 derivative records from 43668 primary records. [2025-10-02T22:37:41.924441] [INFO ] [MAIN ] EBR: Generated 1807 derivative records from 43379 primary records. [2025-10-02T22:37:41.923678] [DEBUG] [LOCAL ] EC: Saving derivative data. [2025-10-02T22:37:41.925134] [DEBUG] [LOCAL ] ECC: Saving derivative data. [2025-10-02T22:37:41.924600] [DEBUG] [LOCAL ] EBR: Saving derivative data. [2025-10-02T22:37:41.966880] [DEBUG] [LOCAL ] EC: Derivative data saved (1807 records). [2025-10-02T22:37:41.967025] [INFO ] [MAIN ] EC: Successfully saved derivative data. [2025-10-02T22:37:41.973746] [INFO ] [MAIN ] Derivative Progress: 550/1975 symbols completed. EC took 1.3s. Estimated remaining: 10m 3s. Rate: 141.9 symbols/min [2025-10-02T22:37:41.965989] [DEBUG] [LOCAL ] EBR: Derivative data saved (1807 records). [2025-10-02T22:37:41.974267] [INFO ] [MAIN ] ECG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:41.977601] [INFO ] [MAIN ] EBR: Successfully saved derivative data. [2025-10-02T22:37:41.981930] [INFO ] [MAIN ] Derivative Progress: 551/1975 symbols completed. EBR took 1.3s. Estimated remaining: 10m 1s. Rate: 142.1 symbols/min [2025-10-02T22:37:41.979717] [DEBUG] [LOCAL ] ECC: Derivative data saved (1807 records). [2025-10-02T22:37:41.982217] [INFO ] [MAIN ] ECC: Successfully saved derivative data. [2025-10-02T22:37:41.984633] [INFO ] [MAIN ] ECL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:41.985180] [INFO ] [MAIN ] Derivative Progress: 552/1975 symbols completed. ECC took 1.3s. Estimated remaining: 9m 60s. Rate: 142.4 symbols/min [2025-10-02T22:37:41.985588] [INFO ] [MAIN ] ECO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:42.017466] [DEBUG] [LOCAL ] ECO: Loaded 18558 existing records from primary storage. [2025-10-02T22:37:42.017743] [INFO ] [MAIN ] ECO: Loaded 18558 primary data records. [2025-10-02T22:37:42.103711] [DEBUG] [LOCAL ] ECG: Loaded 34056 existing records from primary storage. [2025-10-02T22:37:42.125946] [INFO ] [MAIN ] ECG: Loaded 34056 primary data records. [2025-10-02T22:37:42.253562] [DEBUG] [LOCAL ] ECL: Loaded 47096 existing records from primary storage. [2025-10-02T22:37:42.268031] [INFO ] [MAIN ] ECL: Loaded 47096 primary data records. [2025-10-02T22:37:43.114105] [DEBUG] [MAIN ] ECO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:43.115400] [INFO ] [MAIN ] ECO: Generated 1807 derivative records from 18558 primary records. [2025-10-02T22:37:43.115910] [DEBUG] [LOCAL ] ECO: Saving derivative data. [2025-10-02T22:37:43.137582] [DEBUG] [LOCAL ] ECO: Derivative data saved (1807 records). [2025-10-02T22:37:43.153547] [INFO ] [MAIN ] ECO: Successfully saved derivative data. [2025-10-02T22:37:43.155842] [INFO ] [MAIN ] Derivative Progress: 553/1975 symbols completed. ECO took 1.2s. Estimated remaining: 10m 1s. Rate: 141.9 symbols/min [2025-10-02T22:37:43.156944] [DEBUG] [MAIN ] ECG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:43.158381] [INFO ] [MAIN ] ECG: Generated 1807 derivative records from 34056 primary records. [2025-10-02T22:37:43.158491] [DEBUG] [LOCAL ] ECG: Saving derivative data. [2025-10-02T22:37:43.173080] [DEBUG] [MAIN ] ECL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:43.174312] [INFO ] [MAIN ] ECL: Generated 1807 derivative records from 47096 primary records. [2025-10-02T22:37:43.174703] [DEBUG] [LOCAL ] ECL: Saving derivative data. [2025-10-02T22:37:43.192883] [DEBUG] [LOCAL ] ECG: Derivative data saved (1807 records). [2025-10-02T22:37:43.205276] [INFO ] [MAIN ] ECG: Successfully saved derivative data. [2025-10-02T22:37:43.209903] [INFO ] [MAIN ] Derivative Progress: 554/1975 symbols completed. ECG took 1.2s. Estimated remaining: 9m 60s. Rate: 142.1 symbols/min [2025-10-02T22:37:43.212371] [DEBUG] [LOCAL ] ECL: Derivative data saved (1807 records). [2025-10-02T22:37:43.212809] [INFO ] [MAIN ] ECL: Successfully saved derivative data. [2025-10-02T22:37:43.214960] [INFO ] [MAIN ] Derivative Progress: 555/1975 symbols completed. ECL took 1.2s. Estimated remaining: 9m 58s. Rate: 142.4 symbols/min [2025-10-02T22:37:43.215408] [INFO ] [MAIN ] ED: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:43.215713] [INFO ] [MAIN ] ECVT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:43.215975] [INFO ] [MAIN ] EDD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:43.275728] [DEBUG] [LOCAL ] EDD: Loaded 27357 existing records from primary storage. [2025-10-02T22:37:43.276023] [INFO ] [MAIN ] EDD: Loaded 27357 primary data records. [2025-10-02T22:37:43.474749] [DEBUG] [LOCAL ] ED: Loaded 53131 existing records from primary storage. [2025-10-02T22:37:43.497783] [DEBUG] [LOCAL ] ECVT: Loaded 43382 existing records from primary storage. [2025-10-02T22:37:43.537720] [INFO ] [MAIN ] ED: Loaded 53131 primary data records. [2025-10-02T22:37:43.640279] [INFO ] [MAIN ] ECVT: Loaded 43382 primary data records. [2025-10-02T22:37:44.414517] [DEBUG] [MAIN ] EDD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:44.415629] [INFO ] [MAIN ] EDD: Generated 1807 derivative records from 27357 primary records. [2025-10-02T22:37:44.415852] [DEBUG] [LOCAL ] EDD: Saving derivative data. [2025-10-02T22:37:44.438540] [DEBUG] [LOCAL ] EDD: Derivative data saved (1807 records). [2025-10-02T22:37:44.439287] [INFO ] [MAIN ] EDD: Successfully saved derivative data. [2025-10-02T22:37:44.441332] [INFO ] [MAIN ] Derivative Progress: 556/1975 symbols completed. EDD took 1.2s. Estimated remaining: 9m 60s. Rate: 141.9 symbols/min [2025-10-02T22:37:44.441751] [INFO ] [MAIN ] EDF: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:44.467056] [DEBUG] [MAIN ] ED: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:44.468306] [INFO ] [MAIN ] ED: Generated 1807 derivative records from 53131 primary records. [2025-10-02T22:37:44.468460] [DEBUG] [LOCAL ] ED: Saving derivative data. [2025-10-02T22:37:44.485625] [DEBUG] [LOCAL ] EDF: Loaded 13420 existing records from primary storage. [2025-10-02T22:37:44.489795] [INFO ] [MAIN ] EDF: Loaded 13420 primary data records. [2025-10-02T22:37:44.565871] [DEBUG] [MAIN ] ECVT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:44.587524] [INFO ] [MAIN ] ECVT: Generated 1807 derivative records from 43382 primary records. [2025-10-02T22:37:44.593305] [DEBUG] [LOCAL ] ECVT: Saving derivative data. [2025-10-02T22:37:44.608857] [DEBUG] [LOCAL ] ED: Derivative data saved (1807 records). [2025-10-02T22:37:44.635421] [INFO ] [MAIN ] ED: Successfully saved derivative data. [2025-10-02T22:37:44.657381] [INFO ] [MAIN ] Derivative Progress: 557/1975 symbols completed. ED took 1.4s. Estimated remaining: 9m 59s. Rate: 142.0 symbols/min [2025-10-02T22:37:44.669768] [INFO ] [MAIN ] EDN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:44.725451] [DEBUG] [LOCAL ] ECVT: Derivative data saved (1807 records). [2025-10-02T22:37:44.746781] [INFO ] [MAIN ] ECVT: Successfully saved derivative data. [2025-10-02T22:37:44.872297] [INFO ] [MAIN ] Derivative Progress: 558/1975 symbols completed. ECVT took 1.7s. Estimated remaining: 9m 58s. Rate: 142.2 symbols/min [2025-10-02T22:37:44.872621] [INFO ] [MAIN ] EDU: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:44.889902] [DEBUG] [LOCAL ] EDN: Loaded 18336 existing records from primary storage. [2025-10-02T22:37:44.890156] [INFO ] [MAIN ] EDN: Loaded 18336 primary data records. [2025-10-02T22:37:45.247117] [DEBUG] [LOCAL ] EDU: Loaded 45267 existing records from primary storage. [2025-10-02T22:37:45.247697] [INFO ] [MAIN ] EDU: Loaded 45267 primary data records. [2025-10-02T22:37:45.393962] [DEBUG] [MAIN ] EDF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:45.415790] [INFO ] [MAIN ] EDF: Generated 1807 derivative records from 13420 primary records. [2025-10-02T22:37:45.430712] [DEBUG] [LOCAL ] EDF: Saving derivative data. [2025-10-02T22:37:45.673711] [DEBUG] [LOCAL ] EDF: Derivative data saved (1807 records). [2025-10-02T22:37:45.673867] [INFO ] [MAIN ] EDF: Successfully saved derivative data. [2025-10-02T22:37:45.676341] [INFO ] [MAIN ] Derivative Progress: 559/1975 symbols completed. EDF took 1.2s. Estimated remaining: 9m 59s. Rate: 141.9 symbols/min [2025-10-02T22:37:45.676748] [INFO ] [MAIN ] EE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:45.697137] [DEBUG] [MAIN ] EDN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:45.698040] [INFO ] [MAIN ] EDN: Generated 1807 derivative records from 18336 primary records. [2025-10-02T22:37:45.698195] [DEBUG] [LOCAL ] EDN: Saving derivative data. [2025-10-02T22:37:45.717494] [DEBUG] [LOCAL ] EDN: Derivative data saved (1807 records). [2025-10-02T22:37:45.717922] [INFO ] [MAIN ] EDN: Successfully saved derivative data. [2025-10-02T22:37:45.720160] [INFO ] [MAIN ] Derivative Progress: 560/1975 symbols completed. EDN took 1.1s. Estimated remaining: 9m 57s. Rate: 142.2 symbols/min [2025-10-02T22:37:45.721149] [INFO ] [MAIN ] EFC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:45.750772] [DEBUG] [MAIN ] EDU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:45.760709] [INFO ] [MAIN ] EDU: Generated 1807 derivative records from 45267 primary records. [2025-10-02T22:37:45.761087] [DEBUG] [LOCAL ] EDU: Saving derivative data. [2025-10-02T22:37:45.762488] [DEBUG] [LOCAL ] EE: Loaded 32660 existing records from primary storage. [2025-10-02T22:37:45.762826] [INFO ] [MAIN ] EE: Loaded 32660 primary data records. [2025-10-02T22:37:45.866068] [DEBUG] [LOCAL ] EDU: Derivative data saved (1807 records). [2025-10-02T22:37:45.894684] [INFO ] [MAIN ] EDU: Successfully saved derivative data. [2025-10-02T22:37:45.907248] [INFO ] [MAIN ] Derivative Progress: 561/1975 symbols completed. EDU took 1.0s. Estimated remaining: 9m 56s. Rate: 142.3 symbols/min [2025-10-02T22:37:45.924087] [INFO ] [MAIN ] EFR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:46.133826] [DEBUG] [LOCAL ] EFC: Loaded 46536 existing records from primary storage. [2025-10-02T22:37:46.134185] [INFO ] [MAIN ] EFC: Loaded 46536 primary data records. [2025-10-02T22:37:46.253937] [DEBUG] [LOCAL ] EFR: Loaded 14752 existing records from primary storage. [2025-10-02T22:37:46.275473] [INFO ] [MAIN ] EFR: Loaded 14752 primary data records. [2025-10-02T22:37:46.857904] [DEBUG] [MAIN ] EE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:46.866318] [INFO ] [MAIN ] EE: Generated 1807 derivative records from 32660 primary records. [2025-10-02T22:37:46.868204] [DEBUG] [LOCAL ] EE: Saving derivative data. [2025-10-02T22:37:46.892398] [DEBUG] [LOCAL ] EE: Derivative data saved (1807 records). [2025-10-02T22:37:46.892898] [INFO ] [MAIN ] EE: Successfully saved derivative data. [2025-10-02T22:37:46.897134] [INFO ] [MAIN ] Derivative Progress: 562/1975 symbols completed. EE took 1.2s. Estimated remaining: 9m 57s. Rate: 142.0 symbols/min [2025-10-02T22:37:46.897527] [INFO ] [MAIN ] EFT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:46.917393] [DEBUG] [MAIN ] EFC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:46.918798] [INFO ] [MAIN ] EFC: Generated 1807 derivative records from 46536 primary records. [2025-10-02T22:37:46.924510] [DEBUG] [LOCAL ] EFC: Saving derivative data. [2025-10-02T22:37:46.943545] [DEBUG] [LOCAL ] EFC: Derivative data saved (1807 records). [2025-10-02T22:37:46.951266] [INFO ] [MAIN ] EFC: Successfully saved derivative data. [2025-10-02T22:37:46.950941] [DEBUG] [LOCAL ] EFT: Loaded 13189 existing records from primary storage. [2025-10-02T22:37:46.956528] [INFO ] [MAIN ] EFT: Loaded 13189 primary data records. [2025-10-02T22:37:46.956159] [INFO ] [MAIN ] Derivative Progress: 563/1975 symbols completed. EFC took 1.2s. Estimated remaining: 9m 56s. Rate: 142.2 symbols/min [2025-10-02T22:37:46.956916] [INFO ] [MAIN ] EFX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:47.069112] [DEBUG] [MAIN ] EFR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:47.087516] [INFO ] [MAIN ] EFR: Generated 1807 derivative records from 14752 primary records. [2025-10-02T22:37:47.099254] [DEBUG] [LOCAL ] EFR: Saving derivative data. [2025-10-02T22:37:47.159963] [DEBUG] [LOCAL ] EFR: Derivative data saved (1807 records). [2025-10-02T22:37:47.209058] [INFO ] [MAIN ] EFR: Successfully saved derivative data. [2025-10-02T22:37:47.215346] [INFO ] [MAIN ] Derivative Progress: 564/1975 symbols completed. EFR took 1.3s. Estimated remaining: 9m 55s. Rate: 142.3 symbols/min [2025-10-02T22:37:47.353360] [INFO ] [MAIN ] EG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:47.355775] [DEBUG] [LOCAL ] EFX: Loaded 44908 existing records from primary storage. [2025-10-02T22:37:47.356018] [INFO ] [MAIN ] EFX: Loaded 44908 primary data records. [2025-10-02T22:37:47.728045] [DEBUG] [LOCAL ] EG: Loaded 28356 existing records from primary storage. [2025-10-02T22:37:47.729542] [INFO ] [MAIN ] EG: Loaded 28356 primary data records. [2025-10-02T22:37:47.966228] [DEBUG] [MAIN ] EFT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:48.159940] [INFO ] [MAIN ] EFT: Generated 1807 derivative records from 13189 primary records. [2025-10-02T22:37:48.160697] [DEBUG] [LOCAL ] EFT: Saving derivative data. [2025-10-02T22:37:48.198117] [DEBUG] [MAIN ] EFX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:48.199937] [INFO ] [MAIN ] EFX: Generated 1807 derivative records from 44908 primary records. [2025-10-02T22:37:48.200388] [DEBUG] [LOCAL ] EFX: Saving derivative data. [2025-10-02T22:37:48.203224] [DEBUG] [LOCAL ] EFT: Derivative data saved (1807 records). [2025-10-02T22:37:48.203680] [INFO ] [MAIN ] EFT: Successfully saved derivative data. [2025-10-02T22:37:48.206900] [INFO ] [MAIN ] Derivative Progress: 565/1975 symbols completed. EFT took 1.3s. Estimated remaining: 9m 56s. Rate: 141.9 symbols/min [2025-10-02T22:37:48.214502] [INFO ] [MAIN ] EGO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:48.226992] [DEBUG] [LOCAL ] EFX: Derivative data saved (1807 records). [2025-10-02T22:37:48.227176] [INFO ] [MAIN ] EFX: Successfully saved derivative data. [2025-10-02T22:37:48.230739] [INFO ] [MAIN ] Derivative Progress: 566/1975 symbols completed. EFX took 1.3s. Estimated remaining: 9m 55s. Rate: 142.2 symbols/min [2025-10-02T22:37:48.231282] [INFO ] [MAIN ] EGP: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:48.252251] [DEBUG] [MAIN ] EG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:48.253239] [INFO ] [MAIN ] EG: Generated 1807 derivative records from 28356 primary records. [2025-10-02T22:37:48.253549] [DEBUG] [LOCAL ] EG: Saving derivative data. [2025-10-02T22:37:48.279828] [DEBUG] [LOCAL ] EG: Derivative data saved (1807 records). [2025-10-02T22:37:48.300294] [INFO ] [MAIN ] EG: Successfully saved derivative data. [2025-10-02T22:37:48.310110] [INFO ] [MAIN ] Derivative Progress: 567/1975 symbols completed. EG took 1.0s. Estimated remaining: 9m 53s. Rate: 142.4 symbols/min [2025-10-02T22:37:48.310578] [INFO ] [MAIN ] EGY: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:48.327174] [DEBUG] [LOCAL ] EGP: Loaded 31092 existing records from primary storage. [2025-10-02T22:37:48.327425] [INFO ] [MAIN ] EGP: Loaded 31092 primary data records. [2025-10-02T22:37:48.401221] [DEBUG] [LOCAL ] EGO: Loaded 51982 existing records from primary storage. [2025-10-02T22:37:48.426354] [INFO ] [MAIN ] EGO: Loaded 51982 primary data records. [2025-10-02T22:37:48.705015] [DEBUG] [LOCAL ] EGY: Loaded 42435 existing records from primary storage. [2025-10-02T22:37:48.705712] [INFO ] [MAIN ] EGY: Loaded 42435 primary data records. [2025-10-02T22:37:49.440541] [DEBUG] [MAIN ] EGP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:49.455477] [INFO ] [MAIN ] EGP: Generated 1807 derivative records from 31092 primary records. [2025-10-02T22:37:49.455945] [DEBUG] [LOCAL ] EGP: Saving derivative data. [2025-10-02T22:37:49.457985] [DEBUG] [MAIN ] EGO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:49.459587] [INFO ] [MAIN ] EGO: Generated 1807 derivative records from 51982 primary records. [2025-10-02T22:37:49.460370] [DEBUG] [LOCAL ] EGO: Saving derivative data. [2025-10-02T22:37:49.494930] [DEBUG] [LOCAL ] EGP: Derivative data saved (1807 records). [2025-10-02T22:37:49.495503] [INFO ] [MAIN ] EGP: Successfully saved derivative data. [2025-10-02T22:37:49.501823] [INFO ] [MAIN ] Derivative Progress: 568/1975 symbols completed. EGP took 1.3s. Estimated remaining: 9m 55s. Rate: 141.9 symbols/min [2025-10-02T22:37:49.519784] [DEBUG] [MAIN ] EGY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:49.520720] [DEBUG] [LOCAL ] EGO: Derivative data saved (1807 records). [2025-10-02T22:37:49.521742] [INFO ] [MAIN ] EGY: Generated 1807 derivative records from 42435 primary records. [2025-10-02T22:37:49.521868] [INFO ] [MAIN ] EGO: Successfully saved derivative data. [2025-10-02T22:37:49.521975] [DEBUG] [LOCAL ] EGY: Saving derivative data. [2025-10-02T22:37:49.524600] [INFO ] [MAIN ] Derivative Progress: 569/1975 symbols completed. EGO took 1.3s. Estimated remaining: 9m 53s. Rate: 142.2 symbols/min [2025-10-02T22:37:49.541979] [DEBUG] [LOCAL ] EGY: Derivative data saved (1807 records). [2025-10-02T22:37:49.542094] [INFO ] [MAIN ] EGY: Successfully saved derivative data. [2025-10-02T22:37:49.544525] [INFO ] [MAIN ] Derivative Progress: 570/1975 symbols completed. EGY took 1.2s. Estimated remaining: 9m 52s. Rate: 142.4 symbols/min [2025-10-02T22:37:49.545377] [INFO ] [MAIN ] EHC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:49.545226] [INFO ] [MAIN ] EHAB: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:49.545605] [INFO ] [MAIN ] EHI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:49.562706] [DEBUG] [LOCAL ] EHI: Loaded 10681 existing records from primary storage. [2025-10-02T22:37:49.562889] [INFO ] [MAIN ] EHI: Loaded 10681 primary data records. [2025-10-02T22:37:49.713200] [DEBUG] [LOCAL ] EHAB: Loaded 29810 existing records from primary storage. [2025-10-02T22:37:49.718965] [INFO ] [MAIN ] EHAB: Loaded 29810 primary data records. [2025-10-02T22:37:50.109879] [DEBUG] [LOCAL ] EHC: Loaded 41398 existing records from primary storage. [2025-10-02T22:37:50.126326] [INFO ] [MAIN ] EHC: Loaded 41398 primary data records. [2025-10-02T22:37:50.744245] [DEBUG] [MAIN ] EHI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:50.746062] [INFO ] [MAIN ] EHI: Generated 1807 derivative records from 10681 primary records. [2025-10-02T22:37:50.746169] [DEBUG] [LOCAL ] EHI: Saving derivative data. [2025-10-02T22:37:50.775402] [DEBUG] [MAIN ] EHAB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:50.777435] [INFO ] [MAIN ] EHAB: Generated 1807 derivative records from 29810 primary records. [2025-10-02T22:37:50.778562] [DEBUG] [LOCAL ] EHAB: Saving derivative data. [2025-10-02T22:37:50.796102] [DEBUG] [LOCAL ] EHI: Derivative data saved (1807 records). [2025-10-02T22:37:50.799297] [INFO ] [MAIN ] EHI: Successfully saved derivative data. [2025-10-02T22:37:50.803379] [INFO ] [MAIN ] Derivative Progress: 571/1975 symbols completed. EHI took 1.3s. Estimated remaining: 9m 54s. Rate: 141.9 symbols/min [2025-10-02T22:37:50.803666] [INFO ] [MAIN ] EIC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:50.803503] [DEBUG] [LOCAL ] EHAB: Derivative data saved (1807 records). [2025-10-02T22:37:50.804746] [INFO ] [MAIN ] EHAB: Successfully saved derivative data. [2025-10-02T22:37:50.807933] [INFO ] [MAIN ] Derivative Progress: 572/1975 symbols completed. EHAB took 1.3s. Estimated remaining: 9m 52s. Rate: 142.1 symbols/min [2025-10-02T22:37:50.808390] [INFO ] [MAIN ] EIG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:50.826956] [DEBUG] [MAIN ] EHC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:50.828287] [INFO ] [MAIN ] EHC: Generated 1807 derivative records from 41398 primary records. [2025-10-02T22:37:50.828481] [DEBUG] [LOCAL ] EHC: Saving derivative data. [2025-10-02T22:37:50.875619] [DEBUG] [LOCAL ] EHC: Derivative data saved (1807 records). [2025-10-02T22:37:50.876748] [INFO ] [MAIN ] EHC: Successfully saved derivative data. [2025-10-02T22:37:50.877203] [DEBUG] [LOCAL ] EIG: Loaded 20444 existing records from primary storage. [2025-10-02T22:37:50.880084] [INFO ] [MAIN ] Derivative Progress: 573/1975 symbols completed. EHC took 1.3s. Estimated remaining: 9m 51s. Rate: 142.3 symbols/min [2025-10-02T22:37:50.876457] [DEBUG] [LOCAL ] EIC: Loaded 23651 existing records from primary storage. [2025-10-02T22:37:50.880763] [INFO ] [MAIN ] EIC: Loaded 23651 primary data records. [2025-10-02T22:37:50.880606] [INFO ] [MAIN ] EIX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:50.880297] [INFO ] [MAIN ] EIG: Loaded 20444 primary data records. [2025-10-02T22:37:51.581442] [DEBUG] [LOCAL ] EIX: Loaded 53730 existing records from primary storage. [2025-10-02T22:37:51.582199] [INFO ] [MAIN ] EIX: Loaded 53730 primary data records. [2025-10-02T22:37:52.031563] [DEBUG] [MAIN ] EIC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:52.039444] [INFO ] [MAIN ] EIC: Generated 1807 derivative records from 23651 primary records. [2025-10-02T22:37:52.039944] [DEBUG] [LOCAL ] EIC: Saving derivative data. [2025-10-02T22:37:52.039839] [DEBUG] [MAIN ] EIG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:52.043294] [INFO ] [MAIN ] EIG: Generated 1807 derivative records from 20444 primary records. [2025-10-02T22:37:52.055180] [DEBUG] [LOCAL ] EIG: Saving derivative data. [2025-10-02T22:37:52.077420] [DEBUG] [LOCAL ] EIC: Derivative data saved (1807 records). [2025-10-02T22:37:52.078242] [INFO ] [MAIN ] EIC: Successfully saved derivative data. [2025-10-02T22:37:52.080958] [INFO ] [MAIN ] Derivative Progress: 574/1975 symbols completed. EIC took 1.3s. Estimated remaining: 9m 52s. Rate: 141.9 symbols/min [2025-10-02T22:37:52.081221] [INFO ] [MAIN ] EL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:52.085824] [DEBUG] [LOCAL ] EIG: Derivative data saved (1807 records). [2025-10-02T22:37:52.086585] [INFO ] [MAIN ] EIG: Successfully saved derivative data. [2025-10-02T22:37:52.089899] [INFO ] [MAIN ] Derivative Progress: 575/1975 symbols completed. EIG took 1.3s. Estimated remaining: 9m 51s. Rate: 142.1 symbols/min [2025-10-02T22:37:52.090372] [INFO ] [MAIN ] ELAN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:52.109077] [DEBUG] [MAIN ] EIX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:52.110121] [INFO ] [MAIN ] EIX: Generated 1807 derivative records from 53730 primary records. [2025-10-02T22:37:52.110325] [DEBUG] [LOCAL ] EIX: Saving derivative data. [2025-10-02T22:37:52.134274] [DEBUG] [LOCAL ] EIX: Derivative data saved (1807 records). [2025-10-02T22:37:52.134494] [INFO ] [MAIN ] EIX: Successfully saved derivative data. [2025-10-02T22:37:52.139552] [INFO ] [MAIN ] Derivative Progress: 576/1975 symbols completed. EIX took 1.3s. Estimated remaining: 9m 50s. Rate: 142.3 symbols/min [2025-10-02T22:37:52.139765] [INFO ] [MAIN ] ELC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:52.164798] [DEBUG] [LOCAL ] ELC: Loaded 3504 existing records from primary storage. [2025-10-02T22:37:52.165101] [INFO ] [MAIN ] ELC: Loaded 3504 primary data records. [2025-10-02T22:37:52.323754] [DEBUG] [LOCAL ] EL: Loaded 53778 existing records from primary storage. [2025-10-02T22:37:52.363160] [INFO ] [MAIN ] EL: Loaded 53778 primary data records. [2025-10-02T22:37:52.380265] [DEBUG] [LOCAL ] ELAN: Loaded 53643 existing records from primary storage. [2025-10-02T22:37:52.415288] [INFO ] [MAIN ] ELAN: Loaded 53643 primary data records. [2025-10-02T22:37:53.376129] [DEBUG] [MAIN ] ELC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:53.378135] [INFO ] [MAIN ] ELC: Generated 1807 derivative records from 3504 primary records. [2025-10-02T22:37:53.378490] [DEBUG] [LOCAL ] ELC: Saving derivative data. [2025-10-02T22:37:53.407064] [DEBUG] [LOCAL ] ELC: Derivative data saved (1807 records). [2025-10-02T22:37:53.420495] [INFO ] [MAIN ] ELC: Successfully saved derivative data. [2025-10-02T22:37:53.420889] [DEBUG] [MAIN ] EL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:53.424104] [INFO ] [MAIN ] Derivative Progress: 577/1975 symbols completed. ELC took 1.3s. Estimated remaining: 9m 51s. Rate: 141.8 symbols/min [2025-10-02T22:37:53.426800] [INFO ] [MAIN ] EL: Generated 1807 derivative records from 53778 primary records. [2025-10-02T22:37:53.427057] [INFO ] [MAIN ] ELF: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:53.427476] [DEBUG] [LOCAL ] EL: Saving derivative data. [2025-10-02T22:37:53.464903] [DEBUG] [MAIN ] ELAN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:53.466717] [INFO ] [MAIN ] ELAN: Generated 1807 derivative records from 53643 primary records. [2025-10-02T22:37:53.467482] [DEBUG] [LOCAL ] ELAN: Saving derivative data. [2025-10-02T22:37:53.482919] [DEBUG] [LOCAL ] EL: Derivative data saved (1807 records). [2025-10-02T22:37:53.484829] [INFO ] [MAIN ] EL: Successfully saved derivative data. [2025-10-02T22:37:53.489622] [INFO ] [MAIN ] Derivative Progress: 578/1975 symbols completed. EL took 1.4s. Estimated remaining: 9m 50s. Rate: 142.1 symbols/min [2025-10-02T22:37:53.492664] [INFO ] [MAIN ] ELME: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:53.492378] [DEBUG] [LOCAL ] ELAN: Derivative data saved (1807 records). [2025-10-02T22:37:53.493161] [INFO ] [MAIN ] ELAN: Successfully saved derivative data. [2025-10-02T22:37:53.496809] [INFO ] [MAIN ] Derivative Progress: 579/1975 symbols completed. ELAN took 1.4s. Estimated remaining: 9m 49s. Rate: 142.3 symbols/min [2025-10-02T22:37:53.516234] [INFO ] [MAIN ] ELP: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:53.541947] [DEBUG] [LOCAL ] ELF: Loaded 52560 existing records from primary storage. [2025-10-02T22:37:53.551634] [INFO ] [MAIN ] ELF: Loaded 52560 primary data records. [2025-10-02T22:37:53.680345] [DEBUG] [LOCAL ] ELP: Loaded 25797 existing records from primary storage. [2025-10-02T22:37:53.716708] [INFO ] [MAIN ] ELP: Loaded 25797 primary data records. [2025-10-02T22:37:53.832523] [DEBUG] [LOCAL ] ELME: Loaded 39517 existing records from primary storage. [2025-10-02T22:37:53.973808] [INFO ] [MAIN ] ELME: Loaded 39517 primary data records. [2025-10-02T22:37:54.703450] [DEBUG] [MAIN ] ELF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:54.705371] [INFO ] [MAIN ] ELF: Generated 1807 derivative records from 52560 primary records. [2025-10-02T22:37:54.706146] [DEBUG] [LOCAL ] ELF: Saving derivative data. [2025-10-02T22:37:54.725868] [DEBUG] [LOCAL ] ELF: Derivative data saved (1807 records). [2025-10-02T22:37:54.731779] [INFO ] [MAIN ] ELF: Successfully saved derivative data. [2025-10-02T22:37:54.734423] [INFO ] [MAIN ] Derivative Progress: 580/1975 symbols completed. ELF took 1.3s. Estimated remaining: 9m 50s. Rate: 141.8 symbols/min [2025-10-02T22:37:54.734637] [INFO ] [MAIN ] ELS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:54.748777] [DEBUG] [MAIN ] ELP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:54.750692] [INFO ] [MAIN ] ELP: Generated 1807 derivative records from 25797 primary records. [2025-10-02T22:37:54.751153] [DEBUG] [LOCAL ] ELP: Saving derivative data. [2025-10-02T22:37:54.785427] [DEBUG] [LOCAL ] ELP: Derivative data saved (1807 records). [2025-10-02T22:37:54.786101] [INFO ] [MAIN ] ELP: Successfully saved derivative data. [2025-10-02T22:37:54.797306] [INFO ] [MAIN ] Derivative Progress: 581/1975 symbols completed. ELP took 1.3s. Estimated remaining: 9m 49s. Rate: 142.0 symbols/min [2025-10-02T22:37:54.797562] [INFO ] [MAIN ] ELV: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:54.805746] [DEBUG] [MAIN ] ELME: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:54.807579] [INFO ] [MAIN ] ELME: Generated 1807 derivative records from 39517 primary records. [2025-10-02T22:37:54.807696] [DEBUG] [LOCAL ] ELME: Saving derivative data. [2025-10-02T22:37:54.826466] [DEBUG] [LOCAL ] ELME: Derivative data saved (1807 records). [2025-10-02T22:37:54.826880] [INFO ] [MAIN ] ELME: Successfully saved derivative data. [2025-10-02T22:37:54.830637] [INFO ] [MAIN ] Derivative Progress: 582/1975 symbols completed. ELME took 1.3s. Estimated remaining: 9m 48s. Rate: 142.3 symbols/min [2025-10-02T22:37:54.843447] [INFO ] [MAIN ] EMD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:54.869738] [DEBUG] [LOCAL ] ELS: Loaded 49822 existing records from primary storage. [2025-10-02T22:37:54.870043] [INFO ] [MAIN ] ELS: Loaded 49822 primary data records. [2025-10-02T22:37:55.029375] [DEBUG] [LOCAL ] EMD: Loaded 21348 existing records from primary storage. [2025-10-02T22:37:55.057411] [INFO ] [MAIN ] EMD: Loaded 21348 primary data records. [2025-10-02T22:37:55.155063] [DEBUG] [LOCAL ] ELV: Loaded 50927 existing records from primary storage. [2025-10-02T22:37:55.263138] [INFO ] [MAIN ] ELV: Loaded 50927 primary data records. [2025-10-02T22:37:56.024592] [DEBUG] [MAIN ] ELS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:56.026554] [INFO ] [MAIN ] ELS: Generated 1807 derivative records from 49822 primary records. [2025-10-02T22:37:56.026704] [DEBUG] [LOCAL ] ELS: Saving derivative data. [2025-10-02T22:37:56.053907] [DEBUG] [LOCAL ] ELS: Derivative data saved (1807 records). [2025-10-02T22:37:56.054276] [INFO ] [MAIN ] ELS: Successfully saved derivative data. [2025-10-02T22:37:56.072147] [INFO ] [MAIN ] Derivative Progress: 583/1975 symbols completed. ELS took 1.3s. Estimated remaining: 9m 49s. Rate: 141.8 symbols/min [2025-10-02T22:37:56.073756] [DEBUG] [MAIN ] EMD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:56.075244] [INFO ] [MAIN ] EMD: Generated 1807 derivative records from 21348 primary records. [2025-10-02T22:37:56.075554] [DEBUG] [LOCAL ] EMD: Saving derivative data. [2025-10-02T22:37:56.089154] [DEBUG] [MAIN ] ELV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:56.091234] [INFO ] [MAIN ] ELV: Generated 1807 derivative records from 50927 primary records. [2025-10-02T22:37:56.091673] [DEBUG] [LOCAL ] ELV: Saving derivative data. [2025-10-02T22:37:56.117638] [DEBUG] [LOCAL ] EMD: Derivative data saved (1807 records). [2025-10-02T22:37:56.120745] [INFO ] [MAIN ] EMD: Successfully saved derivative data. [2025-10-02T22:37:56.125403] [DEBUG] [LOCAL ] ELV: Derivative data saved (1807 records). [2025-10-02T22:37:56.128685] [INFO ] [MAIN ] Derivative Progress: 584/1975 symbols completed. EMD took 1.3s. Estimated remaining: 9m 48s. Rate: 142.0 symbols/min [2025-10-02T22:37:56.129002] [INFO ] [MAIN ] ELV: Successfully saved derivative data. [2025-10-02T22:37:56.131855] [INFO ] [MAIN ] Derivative Progress: 585/1975 symbols completed. ELV took 1.3s. Estimated remaining: 9m 46s. Rate: 142.2 symbols/min [2025-10-02T22:37:56.132555] [INFO ] [MAIN ] EMN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:56.132453] [INFO ] [MAIN ] EME: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:56.132633] [INFO ] [MAIN ] EMF: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:56.141293] [DEBUG] [LOCAL ] EMF: Loaded 3431 existing records from primary storage. [2025-10-02T22:37:56.141518] [INFO ] [MAIN ] EMF: Loaded 3431 primary data records. [2025-10-02T22:37:56.360865] [DEBUG] [LOCAL ] EME: Loaded 31497 existing records from primary storage. [2025-10-02T22:37:56.489797] [INFO ] [MAIN ] EME: Loaded 31497 primary data records. [2025-10-02T22:37:56.610862] [DEBUG] [LOCAL ] EMN: Loaded 50840 existing records from primary storage. [2025-10-02T22:37:56.643608] [INFO ] [MAIN ] EMN: Loaded 50840 primary data records. [2025-10-02T22:37:57.382461] [DEBUG] [MAIN ] EMF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:57.383973] [INFO ] [MAIN ] EMF: Generated 1807 derivative records from 3431 primary records. [2025-10-02T22:37:57.384314] [DEBUG] [LOCAL ] EMF: Saving derivative data. [2025-10-02T22:37:57.406864] [DEBUG] [LOCAL ] EMF: Derivative data saved (1807 records). [2025-10-02T22:37:57.407551] [INFO ] [MAIN ] EMF: Successfully saved derivative data. [2025-10-02T22:37:57.411008] [INFO ] [MAIN ] Derivative Progress: 586/1975 symbols completed. EMF took 1.3s. Estimated remaining: 9m 48s. Rate: 141.7 symbols/min [2025-10-02T22:37:57.411218] [INFO ] [MAIN ] EMO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:57.431928] [DEBUG] [MAIN ] EME: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:57.437913] [INFO ] [MAIN ] EME: Generated 1807 derivative records from 31497 primary records. [2025-10-02T22:37:57.438679] [DEBUG] [LOCAL ] EME: Saving derivative data. [2025-10-02T22:37:57.460166] [DEBUG] [LOCAL ] EMO: Loaded 12644 existing records from primary storage. [2025-10-02T22:37:57.462716] [INFO ] [MAIN ] EMO: Loaded 12644 primary data records. [2025-10-02T22:37:57.524775] [DEBUG] [LOCAL ] EME: Derivative data saved (1807 records). [2025-10-02T22:37:57.535823] [INFO ] [MAIN ] EME: Successfully saved derivative data. [2025-10-02T22:37:57.544560] [INFO ] [MAIN ] Derivative Progress: 587/1975 symbols completed. EME took 1.4s. Estimated remaining: 9m 47s. Rate: 141.9 symbols/min [2025-10-02T22:37:57.557015] [INFO ] [MAIN ] EMR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:57.618534] [DEBUG] [MAIN ] EMN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:57.648043] [INFO ] [MAIN ] EMN: Generated 1807 derivative records from 50840 primary records. [2025-10-02T22:37:57.682892] [DEBUG] [LOCAL ] EMN: Saving derivative data. [2025-10-02T22:37:57.829117] [DEBUG] [LOCAL ] EMN: Derivative data saved (1807 records). [2025-10-02T22:37:57.829471] [INFO ] [MAIN ] EMN: Successfully saved derivative data. [2025-10-02T22:37:57.833529] [INFO ] [MAIN ] Derivative Progress: 588/1975 symbols completed. EMN took 1.7s. Estimated remaining: 9m 46s. Rate: 142.0 symbols/min [2025-10-02T22:37:57.833896] [INFO ] [MAIN ] ENB: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:57.897857] [DEBUG] [MAIN ] EMO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:57.901329] [INFO ] [MAIN ] EMO: Generated 1807 derivative records from 12644 primary records. [2025-10-02T22:37:57.901529] [DEBUG] [LOCAL ] EMO: Saving derivative data. [2025-10-02T22:37:57.904308] [DEBUG] [LOCAL ] EMR: Loaded 53633 existing records from primary storage. [2025-10-02T22:37:57.920978] [INFO ] [MAIN ] EMR: Loaded 53633 primary data records. [2025-10-02T22:37:57.980850] [DEBUG] [LOCAL ] EMO: Derivative data saved (1807 records). [2025-10-02T22:37:57.994123] [INFO ] [MAIN ] EMO: Successfully saved derivative data. [2025-10-02T22:37:58.019018] [INFO ] [MAIN ] Derivative Progress: 589/1975 symbols completed. EMO took 0.6s. Estimated remaining: 9m 45s. Rate: 142.1 symbols/min [2025-10-02T22:37:58.033194] [INFO ] [MAIN ] ENIC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:58.115096] [DEBUG] [LOCAL ] ENB: Loaded 53900 existing records from primary storage. [2025-10-02T22:37:58.115364] [INFO ] [MAIN ] ENB: Loaded 53900 primary data records. [2025-10-02T22:37:58.537933] [DEBUG] [LOCAL ] ENIC: Loaded 36637 existing records from primary storage. [2025-10-02T22:37:58.663729] [INFO ] [MAIN ] ENIC: Loaded 36637 primary data records. [2025-10-02T22:37:58.949580] [DEBUG] [MAIN ] EMR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:59.005861] [INFO ] [MAIN ] EMR: Generated 1807 derivative records from 53633 primary records. [2025-10-02T22:37:59.016178] [DEBUG] [LOCAL ] EMR: Saving derivative data. [2025-10-02T22:37:59.037930] [DEBUG] [LOCAL ] EMR: Derivative data saved (1807 records). [2025-10-02T22:37:59.038317] [INFO ] [MAIN ] EMR: Successfully saved derivative data. [2025-10-02T22:37:59.040908] [INFO ] [MAIN ] Derivative Progress: 590/1975 symbols completed. EMR took 1.5s. Estimated remaining: 9m 46s. Rate: 141.8 symbols/min [2025-10-02T22:37:59.042352] [INFO ] [MAIN ] ENO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:59.052149] [DEBUG] [LOCAL ] ENO: Loaded 1926 existing records from primary storage. [2025-10-02T22:37:59.065483] [INFO ] [MAIN ] ENO: Loaded 1926 primary data records. [2025-10-02T22:37:59.071152] [DEBUG] [MAIN ] ENB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:59.095739] [INFO ] [MAIN ] ENB: Generated 1807 derivative records from 53900 primary records. [2025-10-02T22:37:59.110246] [DEBUG] [LOCAL ] ENB: Saving derivative data. [2025-10-02T22:37:59.259810] [DEBUG] [LOCAL ] ENB: Derivative data saved (1807 records). [2025-10-02T22:37:59.263507] [INFO ] [MAIN ] ENB: Successfully saved derivative data. [2025-10-02T22:37:59.266734] [INFO ] [MAIN ] Derivative Progress: 591/1975 symbols completed. ENB took 1.4s. Estimated remaining: 9m 45s. Rate: 141.9 symbols/min [2025-10-02T22:37:59.266896] [INFO ] [MAIN ] ENOV: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:59.510788] [DEBUG] [MAIN ] ENIC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:59.511909] [INFO ] [MAIN ] ENIC: Generated 1807 derivative records from 36637 primary records. [2025-10-02T22:37:59.512058] [DEBUG] [LOCAL ] ENIC: Saving derivative data. [2025-10-02T22:37:59.558969] [DEBUG] [LOCAL ] ENIC: Derivative data saved (1807 records). [2025-10-02T22:37:59.559585] [INFO ] [MAIN ] ENIC: Successfully saved derivative data. [2025-10-02T22:37:59.562631] [INFO ] [MAIN ] Derivative Progress: 592/1975 symbols completed. ENIC took 1.5s. Estimated remaining: 9m 45s. Rate: 142.0 symbols/min [2025-10-02T22:37:59.563285] [INFO ] [MAIN ] ENR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:37:59.582985] [DEBUG] [LOCAL ] ENOV: Loaded 45207 existing records from primary storage. [2025-10-02T22:37:59.584122] [INFO ] [MAIN ] ENOV: Loaded 45207 primary data records. [2025-10-02T22:37:59.700122] [DEBUG] [MAIN ] ENO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:37:59.704833] [INFO ] [MAIN ] ENO: Generated 1807 derivative records from 1926 primary records. [2025-10-02T22:37:59.715741] [DEBUG] [LOCAL ] ENO: Saving derivative data. [2025-10-02T22:37:59.943833] [DEBUG] [LOCAL ] ENO: Derivative data saved (1807 records). [2025-10-02T22:37:59.944087] [INFO ] [MAIN ] ENO: Successfully saved derivative data. [2025-10-02T22:37:59.945149] [DEBUG] [LOCAL ] ENR: Loaded 43162 existing records from primary storage. [2025-10-02T22:37:59.945569] [INFO ] [MAIN ] ENR: Loaded 43162 primary data records. [2025-10-02T22:37:59.957046] [INFO ] [MAIN ] Derivative Progress: 593/1975 symbols completed. ENO took 0.9s. Estimated remaining: 9m 44s. Rate: 142.0 symbols/min [2025-10-02T22:37:59.973048] [INFO ] [MAIN ] ENVA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:00.328550] [DEBUG] [LOCAL ] ENVA: Loaded 25450 existing records from primary storage. [2025-10-02T22:38:00.330231] [INFO ] [MAIN ] ENVA: Loaded 25450 primary data records. [2025-10-02T22:38:00.431245] [DEBUG] [MAIN ] ENOV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:00.450029] [INFO ] [MAIN ] ENOV: Generated 1807 derivative records from 45207 primary records. [2025-10-02T22:38:00.458931] [DEBUG] [LOCAL ] ENOV: Saving derivative data. [2025-10-02T22:38:00.709788] [DEBUG] [LOCAL ] ENOV: Derivative data saved (1807 records). [2025-10-02T22:38:00.710185] [INFO ] [MAIN ] ENOV: Successfully saved derivative data. [2025-10-02T22:38:00.712909] [INFO ] [MAIN ] Derivative Progress: 594/1975 symbols completed. ENOV took 1.4s. Estimated remaining: 9m 44s. Rate: 141.8 symbols/min [2025-10-02T22:38:00.713560] [INFO ] [MAIN ] EOG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:00.735908] [DEBUG] [MAIN ] ENR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:00.736959] [INFO ] [MAIN ] ENR: Generated 1807 derivative records from 43162 primary records. [2025-10-02T22:38:00.737938] [DEBUG] [LOCAL ] ENR: Saving derivative data. [2025-10-02T22:38:00.757785] [DEBUG] [LOCAL ] ENR: Derivative data saved (1807 records). [2025-10-02T22:38:00.758229] [INFO ] [MAIN ] ENR: Successfully saved derivative data. [2025-10-02T22:38:00.760817] [INFO ] [MAIN ] Derivative Progress: 595/1975 symbols completed. ENR took 1.2s. Estimated remaining: 9m 43s. Rate: 142.0 symbols/min [2025-10-02T22:38:00.760978] [INFO ] [MAIN ] EOI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:00.786787] [DEBUG] [MAIN ] ENVA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:00.791889] [DEBUG] [LOCAL ] EOI: Loaded 10789 existing records from primary storage. [2025-10-02T22:38:00.793726] [INFO ] [MAIN ] EOI: Loaded 10789 primary data records. [2025-10-02T22:38:00.793585] [INFO ] [MAIN ] ENVA: Generated 1807 derivative records from 25450 primary records. [2025-10-02T22:38:00.794091] [DEBUG] [LOCAL ] ENVA: Saving derivative data. [2025-10-02T22:38:00.972174] [DEBUG] [LOCAL ] ENVA: Derivative data saved (1807 records). [2025-10-02T22:38:00.980550] [DEBUG] [LOCAL ] EOG: Loaded 53734 existing records from primary storage. [2025-10-02T22:38:00.986797] [INFO ] [MAIN ] EOG: Loaded 53734 primary data records. [2025-10-02T22:38:00.978317] [INFO ] [MAIN ] ENVA: Successfully saved derivative data. [2025-10-02T22:38:00.990475] [INFO ] [MAIN ] Derivative Progress: 596/1975 symbols completed. ENVA took 1.0s. Estimated remaining: 9m 42s. Rate: 142.1 symbols/min [2025-10-02T22:38:01.024801] [INFO ] [MAIN ] EOT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:01.422883] [DEBUG] [LOCAL ] EOT: Loaded 6929 existing records from primary storage. [2025-10-02T22:38:01.442723] [INFO ] [MAIN ] EOT: Loaded 6929 primary data records. [2025-10-02T22:38:02.048998] [DEBUG] [MAIN ] EOI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:02.051528] [INFO ] [MAIN ] EOI: Generated 1807 derivative records from 10789 primary records. [2025-10-02T22:38:02.051768] [DEBUG] [LOCAL ] EOI: Saving derivative data. [2025-10-02T22:38:02.090405] [DEBUG] [MAIN ] EOG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:02.092453] [INFO ] [MAIN ] EOG: Generated 1807 derivative records from 53734 primary records. [2025-10-02T22:38:02.094392] [DEBUG] [LOCAL ] EOI: Derivative data saved (1807 records). [2025-10-02T22:38:02.094292] [DEBUG] [LOCAL ] EOG: Saving derivative data. [2025-10-02T22:38:02.094773] [INFO ] [MAIN ] EOI: Successfully saved derivative data. [2025-10-02T22:38:02.097436] [INFO ] [MAIN ] Derivative Progress: 597/1975 symbols completed. EOI took 1.3s. Estimated remaining: 9m 43s. Rate: 141.7 symbols/min [2025-10-02T22:38:02.107290] [INFO ] [MAIN ] EPAC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:02.119713] [DEBUG] [LOCAL ] EOG: Derivative data saved (1807 records). [2025-10-02T22:38:02.120427] [INFO ] [MAIN ] EOG: Successfully saved derivative data. [2025-10-02T22:38:02.123872] [INFO ] [MAIN ] Derivative Progress: 598/1975 symbols completed. EOG took 1.4s. Estimated remaining: 9m 42s. Rate: 141.9 symbols/min [2025-10-02T22:38:02.143914] [DEBUG] [MAIN ] EOT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:02.144891] [INFO ] [MAIN ] EOT: Generated 1807 derivative records from 6929 primary records. [2025-10-02T22:38:02.144978] [DEBUG] [LOCAL ] EOT: Saving derivative data. [2025-10-02T22:38:02.180182] [DEBUG] [LOCAL ] EOT: Derivative data saved (1807 records). [2025-10-02T22:38:02.181767] [INFO ] [MAIN ] EOT: Successfully saved derivative data. [2025-10-02T22:38:02.184887] [INFO ] [MAIN ] Derivative Progress: 599/1975 symbols completed. EOT took 1.2s. Estimated remaining: 9m 41s. Rate: 142.2 symbols/min [2025-10-02T22:38:02.182560] [DEBUG] [LOCAL ] EPAC: Loaded 27163 existing records from primary storage. [2025-10-02T22:38:02.185123] [INFO ] [MAIN ] EPAC: Loaded 27163 primary data records. [2025-10-02T22:38:02.537094] [DEBUG] [MAIN ] EPAC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:02.537867] [INFO ] [MAIN ] EPAC: Generated 1807 derivative records from 27163 primary records. [2025-10-02T22:38:02.537963] [DEBUG] [LOCAL ] EPAC: Saving derivative data. [2025-10-02T22:38:02.555002] [DEBUG] [LOCAL ] EPAC: Derivative data saved (1807 records). [2025-10-02T22:38:02.555144] [INFO ] [MAIN ] EPAC: Successfully saved derivative data. [2025-10-02T22:38:02.557342] [INFO ] [MAIN ] Derivative Progress: 600/1975 symbols completed. EPAC took 0.5s. Estimated remaining: 9m 40s. Rate: 142.2 symbols/min [2025-10-02T22:38:02.558106] [INFO ] [MAIN ] EPAM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:02.558035] [INFO ] [MAIN ] EPD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:02.558197] [INFO ] [MAIN ] EPR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:02.664479] [DEBUG] [LOCAL ] EPR: Loaded 44243 existing records from primary storage. [2025-10-02T22:38:02.664817] [INFO ] [MAIN ] EPR: Loaded 44243 primary data records. [2025-10-02T22:38:02.691663] [DEBUG] [LOCAL ] EPAM: Loaded 40032 existing records from primary storage. [2025-10-02T22:38:02.716983] [INFO ] [MAIN ] EPAM: Loaded 40032 primary data records. [2025-10-02T22:38:02.717765] [DEBUG] [LOCAL ] EPD: Loaded 53999 existing records from primary storage. [2025-10-02T22:38:02.767986] [INFO ] [MAIN ] EPD: Loaded 53999 primary data records. [2025-10-02T22:38:04.009952] [DEBUG] [MAIN ] EPAM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:04.010734] [DEBUG] [MAIN ] EPR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:04.014547] [INFO ] [MAIN ] EPR: Generated 1807 derivative records from 44243 primary records. [2025-10-02T22:38:04.015185] [INFO ] [MAIN ] EPAM: Generated 1807 derivative records from 40032 primary records. [2025-10-02T22:38:04.015371] [DEBUG] [LOCAL ] EPR: Saving derivative data. [2025-10-02T22:38:04.015687] [DEBUG] [LOCAL ] EPAM: Saving derivative data. [2025-10-02T22:38:04.046407] [DEBUG] [MAIN ] EPD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:04.061962] [INFO ] [MAIN ] EPD: Generated 1807 derivative records from 53999 primary records. [2025-10-02T22:38:04.064584] [DEBUG] [LOCAL ] EPD: Saving derivative data. [2025-10-02T22:38:04.069687] [DEBUG] [LOCAL ] EPAM: Derivative data saved (1807 records). [2025-10-02T22:38:04.070953] [INFO ] [MAIN ] EPAM: Successfully saved derivative data. [2025-10-02T22:38:04.073867] [INFO ] [MAIN ] Derivative Progress: 601/1975 symbols completed. EPAM took 1.5s. Estimated remaining: 9m 42s. Rate: 141.6 symbols/min [2025-10-02T22:38:04.074940] [INFO ] [MAIN ] EPRT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:04.091256] [DEBUG] [LOCAL ] EPR: Derivative data saved (1807 records). [2025-10-02T22:38:04.092140] [INFO ] [MAIN ] EPR: Successfully saved derivative data. [2025-10-02T22:38:04.094988] [INFO ] [MAIN ] Derivative Progress: 602/1975 symbols completed. EPR took 1.5s. Estimated remaining: 9m 41s. Rate: 141.8 symbols/min [2025-10-02T22:38:04.096332] [INFO ] [MAIN ] EQH: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:04.103082] [DEBUG] [LOCAL ] EPD: Derivative data saved (1807 records). [2025-10-02T22:38:04.103260] [INFO ] [MAIN ] EPD: Successfully saved derivative data. [2025-10-02T22:38:04.106702] [INFO ] [MAIN ] Derivative Progress: 603/1975 symbols completed. EPD took 1.5s. Estimated remaining: 9m 40s. Rate: 142.0 symbols/min [2025-10-02T22:38:04.107029] [INFO ] [MAIN ] EQNR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:04.231080] [DEBUG] [LOCAL ] EPRT: Loaded 48821 existing records from primary storage. [2025-10-02T22:38:04.232997] [INFO ] [MAIN ] EPRT: Loaded 48821 primary data records. [2025-10-02T22:38:04.239381] [DEBUG] [LOCAL ] EQH: Loaded 53042 existing records from primary storage. [2025-10-02T22:38:04.261849] [INFO ] [MAIN ] EQH: Loaded 53042 primary data records. [2025-10-02T22:38:04.407113] [DEBUG] [LOCAL ] EQNR: Loaded 53416 existing records from primary storage. [2025-10-02T22:38:04.456931] [INFO ] [MAIN ] EQNR: Loaded 53416 primary data records. [2025-10-02T22:38:05.368330] [DEBUG] [MAIN ] EPRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:05.369337] [INFO ] [MAIN ] EPRT: Generated 1807 derivative records from 48821 primary records. [2025-10-02T22:38:05.369565] [DEBUG] [LOCAL ] EPRT: Saving derivative data. [2025-10-02T22:38:05.390830] [DEBUG] [LOCAL ] EPRT: Derivative data saved (1807 records). [2025-10-02T22:38:05.391270] [INFO ] [MAIN ] EPRT: Successfully saved derivative data. [2025-10-02T22:38:05.394164] [INFO ] [MAIN ] Derivative Progress: 604/1975 symbols completed. EPRT took 1.3s. Estimated remaining: 9m 41s. Rate: 141.5 symbols/min [2025-10-02T22:38:05.396412] [INFO ] [MAIN ] EQR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:05.429251] [DEBUG] [MAIN ] EQH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:05.429685] [DEBUG] [MAIN ] EQNR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:05.431517] [INFO ] [MAIN ] EQH: Generated 1807 derivative records from 53042 primary records. [2025-10-02T22:38:05.431633] [INFO ] [MAIN ] EQNR: Generated 1807 derivative records from 53416 primary records. [2025-10-02T22:38:05.431955] [DEBUG] [LOCAL ] EQNR: Saving derivative data. [2025-10-02T22:38:05.432053] [DEBUG] [LOCAL ] EQH: Saving derivative data. [2025-10-02T22:38:05.465763] [DEBUG] [LOCAL ] EQH: Derivative data saved (1807 records). [2025-10-02T22:38:05.466775] [INFO ] [MAIN ] EQH: Successfully saved derivative data. [2025-10-02T22:38:05.470733] [INFO ] [MAIN ] Derivative Progress: 605/1975 symbols completed. EQH took 1.4s. Estimated remaining: 9m 40s. Rate: 141.7 symbols/min [2025-10-02T22:38:05.471071] [INFO ] [MAIN ] EQT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:05.474444] [DEBUG] [LOCAL ] EQNR: Derivative data saved (1807 records). [2025-10-02T22:38:05.474742] [INFO ] [MAIN ] EQNR: Successfully saved derivative data. [2025-10-02T22:38:05.477340] [INFO ] [MAIN ] Derivative Progress: 606/1975 symbols completed. EQNR took 1.4s. Estimated remaining: 9m 39s. Rate: 142.0 symbols/min [2025-10-02T22:38:05.477739] [INFO ] [MAIN ] EQV: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:05.483514] [DEBUG] [LOCAL ] EQV: Loaded 2747 existing records from primary storage. [2025-10-02T22:38:05.483709] [INFO ] [MAIN ] EQV: Loaded 2747 primary data records. [2025-10-02T22:38:05.739819] [DEBUG] [LOCAL ] EQR: Loaded 51894 existing records from primary storage. [2025-10-02T22:38:05.862435] [INFO ] [MAIN ] EQR: Loaded 51894 primary data records. [2025-10-02T22:38:06.000262] [DEBUG] [LOCAL ] EQT: Loaded 54072 existing records from primary storage. [2025-10-02T22:38:06.012116] [INFO ] [MAIN ] EQT: Loaded 54072 primary data records. [2025-10-02T22:38:06.639186] [DEBUG] [MAIN ] EQV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:06.640581] [INFO ] [MAIN ] EQV: Generated 1807 derivative records from 2747 primary records. [2025-10-02T22:38:06.641773] [DEBUG] [LOCAL ] EQV: Saving derivative data. [2025-10-02T22:38:06.658947] [DEBUG] [LOCAL ] EQV: Derivative data saved (1807 records). [2025-10-02T22:38:06.661637] [INFO ] [MAIN ] EQV: Successfully saved derivative data. [2025-10-02T22:38:06.664074] [INFO ] [MAIN ] Derivative Progress: 607/1975 symbols completed. EQV took 1.2s. Estimated remaining: 9m 40s. Rate: 141.5 symbols/min [2025-10-02T22:38:06.665064] [INFO ] [MAIN ] ERJ: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:06.682276] [DEBUG] [MAIN ] EQR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:06.683532] [INFO ] [MAIN ] EQR: Generated 1807 derivative records from 51894 primary records. [2025-10-02T22:38:06.683783] [DEBUG] [LOCAL ] EQR: Saving derivative data. [2025-10-02T22:38:06.705498] [DEBUG] [LOCAL ] EQR: Derivative data saved (1807 records). [2025-10-02T22:38:06.706180] [INFO ] [MAIN ] EQR: Successfully saved derivative data. [2025-10-02T22:38:06.708596] [INFO ] [MAIN ] Derivative Progress: 608/1975 symbols completed. EQR took 1.3s. Estimated remaining: 9m 39s. Rate: 141.8 symbols/min [2025-10-02T22:38:06.709282] [INFO ] [MAIN ] ERO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:06.728725] [DEBUG] [MAIN ] EQT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:06.729601] [INFO ] [MAIN ] EQT: Generated 1807 derivative records from 54072 primary records. [2025-10-02T22:38:06.729763] [DEBUG] [LOCAL ] EQT: Saving derivative data. [2025-10-02T22:38:06.767491] [DEBUG] [LOCAL ] EQT: Derivative data saved (1807 records). [2025-10-02T22:38:06.784538] [INFO ] [MAIN ] EQT: Successfully saved derivative data. [2025-10-02T22:38:06.787222] [INFO ] [MAIN ] Derivative Progress: 609/1975 symbols completed. EQT took 1.3s. Estimated remaining: 9m 37s. Rate: 141.9 symbols/min [2025-10-02T22:38:06.789010] [DEBUG] [LOCAL ] ERJ: Loaded 51007 existing records from primary storage. [2025-10-02T22:38:06.789152] [INFO ] [MAIN ] ERJ: Loaded 51007 primary data records. [2025-10-02T22:38:06.789321] [INFO ] [MAIN ] ES: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:06.941136] [DEBUG] [LOCAL ] ERO: Loaded 41598 existing records from primary storage. [2025-10-02T22:38:06.957719] [INFO ] [MAIN ] ERO: Loaded 41598 primary data records. [2025-10-02T22:38:07.364883] [DEBUG] [LOCAL ] ES: Loaded 52959 existing records from primary storage. [2025-10-02T22:38:07.407842] [INFO ] [MAIN ] ES: Loaded 52959 primary data records. [2025-10-02T22:38:07.900164] [DEBUG] [MAIN ] ERJ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:07.901218] [INFO ] [MAIN ] ERJ: Generated 1807 derivative records from 51007 primary records. [2025-10-02T22:38:07.901334] [DEBUG] [LOCAL ] ERJ: Saving derivative data. [2025-10-02T22:38:07.922137] [DEBUG] [LOCAL ] ERJ: Derivative data saved (1807 records). [2025-10-02T22:38:07.924137] [INFO ] [MAIN ] ERJ: Successfully saved derivative data. [2025-10-02T22:38:07.926870] [INFO ] [MAIN ] Derivative Progress: 610/1975 symbols completed. ERJ took 1.3s. Estimated remaining: 9m 39s. Rate: 141.5 symbols/min [2025-10-02T22:38:07.927021] [INFO ] [MAIN ] ESAB: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:07.945064] [DEBUG] [MAIN ] ERO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:07.946360] [INFO ] [MAIN ] ERO: Generated 1807 derivative records from 41598 primary records. [2025-10-02T22:38:07.946743] [DEBUG] [LOCAL ] ERO: Saving derivative data. [2025-10-02T22:38:07.977785] [DEBUG] [LOCAL ] ERO: Derivative data saved (1807 records). [2025-10-02T22:38:08.001195] [INFO ] [MAIN ] ERO: Successfully saved derivative data. [2025-10-02T22:38:08.005107] [INFO ] [MAIN ] Derivative Progress: 611/1975 symbols completed. ERO took 1.3s. Estimated remaining: 9m 37s. Rate: 141.7 symbols/min [2025-10-02T22:38:08.006704] [DEBUG] [LOCAL ] ESAB: Loaded 26272 existing records from primary storage. [2025-10-02T22:38:08.007122] [INFO ] [MAIN ] ESAB: Loaded 26272 primary data records. [2025-10-02T22:38:08.006838] [INFO ] [MAIN ] ESE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:08.005495] [DEBUG] [MAIN ] ES: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:08.025130] [INFO ] [MAIN ] ES: Generated 1807 derivative records from 52959 primary records. [2025-10-02T22:38:08.036323] [DEBUG] [LOCAL ] ES: Saving derivative data. [2025-10-02T22:38:08.165819] [DEBUG] [LOCAL ] ES: Derivative data saved (1807 records). [2025-10-02T22:38:08.166026] [INFO ] [MAIN ] ES: Successfully saved derivative data. [2025-10-02T22:38:08.191760] [INFO ] [MAIN ] Derivative Progress: 612/1975 symbols completed. ES took 1.4s. Estimated remaining: 9m 36s. Rate: 141.9 symbols/min [2025-10-02T22:38:08.219715] [INFO ] [MAIN ] ESI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:08.229511] [DEBUG] [LOCAL ] ESE: Loaded 16803 existing records from primary storage. [2025-10-02T22:38:08.258696] [INFO ] [MAIN ] ESE: Loaded 16803 primary data records. [2025-10-02T22:38:08.833093] [DEBUG] [LOCAL ] ESI: Loaded 51102 existing records from primary storage. [2025-10-02T22:38:08.836516] [INFO ] [MAIN ] ESI: Loaded 51102 primary data records. [2025-10-02T22:38:08.917795] [DEBUG] [MAIN ] ESAB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:08.956924] [INFO ] [MAIN ] ESAB: Generated 1807 derivative records from 26272 primary records. [2025-10-02T22:38:08.978714] [DEBUG] [LOCAL ] ESAB: Saving derivative data. [2025-10-02T22:38:09.211578] [DEBUG] [LOCAL ] ESAB: Derivative data saved (1807 records). [2025-10-02T22:38:09.211761] [INFO ] [MAIN ] ESAB: Successfully saved derivative data. [2025-10-02T22:38:09.213800] [INFO ] [MAIN ] Derivative Progress: 613/1975 symbols completed. ESAB took 1.3s. Estimated remaining: 9m 37s. Rate: 141.5 symbols/min [2025-10-02T22:38:09.235790] [DEBUG] [MAIN ] ESE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:09.237276] [INFO ] [MAIN ] ESE: Generated 1807 derivative records from 16803 primary records. [2025-10-02T22:38:09.237396] [DEBUG] [LOCAL ] ESE: Saving derivative data. [2025-10-02T22:38:09.257683] [DEBUG] [LOCAL ] ESE: Derivative data saved (1807 records). [2025-10-02T22:38:09.257868] [INFO ] [MAIN ] ESE: Successfully saved derivative data. [2025-10-02T22:38:09.260530] [INFO ] [MAIN ] Derivative Progress: 614/1975 symbols completed. ESE took 1.3s. Estimated remaining: 9m 36s. Rate: 141.7 symbols/min [2025-10-02T22:38:09.279120] [DEBUG] [MAIN ] ESI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:09.279884] [INFO ] [MAIN ] ESI: Generated 1807 derivative records from 51102 primary records. [2025-10-02T22:38:09.279950] [DEBUG] [LOCAL ] ESI: Saving derivative data. [2025-10-02T22:38:09.296071] [DEBUG] [LOCAL ] ESI: Derivative data saved (1807 records). [2025-10-02T22:38:09.296160] [INFO ] [MAIN ] ESI: Successfully saved derivative data. [2025-10-02T22:38:09.298538] [INFO ] [MAIN ] Derivative Progress: 615/1975 symbols completed. ESI took 1.1s. Estimated remaining: 9m 35s. Rate: 142.0 symbols/min [2025-10-02T22:38:09.299154] [INFO ] [MAIN ] ESNT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:09.299405] [INFO ] [MAIN ] ESRT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:09.299250] [INFO ] [MAIN ] ESS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:09.367903] [DEBUG] [LOCAL ] ESNT: Loaded 38632 existing records from primary storage. [2025-10-02T22:38:09.368491] [DEBUG] [LOCAL ] ESS: Loaded 30187 existing records from primary storage. [2025-10-02T22:38:09.368756] [INFO ] [MAIN ] ESNT: Loaded 38632 primary data records. [2025-10-02T22:38:09.369016] [INFO ] [MAIN ] ESS: Loaded 30187 primary data records. [2025-10-02T22:38:09.533345] [DEBUG] [LOCAL ] ESRT: Loaded 46767 existing records from primary storage. [2025-10-02T22:38:09.581901] [INFO ] [MAIN ] ESRT: Loaded 46767 primary data records. [2025-10-02T22:38:10.538241] [DEBUG] [MAIN ] ESNT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:10.539808] [INFO ] [MAIN ] ESNT: Generated 1807 derivative records from 38632 primary records. [2025-10-02T22:38:10.540036] [DEBUG] [LOCAL ] ESNT: Saving derivative data. [2025-10-02T22:38:10.562733] [DEBUG] [LOCAL ] ESNT: Derivative data saved (1807 records). [2025-10-02T22:38:10.578990] [DEBUG] [MAIN ] ESS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:10.578572] [INFO ] [MAIN ] ESNT: Successfully saved derivative data. [2025-10-02T22:38:10.579912] [INFO ] [MAIN ] ESS: Generated 1807 derivative records from 30187 primary records. [2025-10-02T22:38:10.581959] [INFO ] [MAIN ] Derivative Progress: 616/1975 symbols completed. ESNT took 1.3s. Estimated remaining: 9m 36s. Rate: 141.5 symbols/min [2025-10-02T22:38:10.582442] [INFO ] [MAIN ] ESTC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:10.582348] [DEBUG] [LOCAL ] ESS: Saving derivative data. [2025-10-02T22:38:10.599855] [DEBUG] [MAIN ] ESRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:10.614174] [INFO ] [MAIN ] ESRT: Generated 1807 derivative records from 46767 primary records. [2025-10-02T22:38:10.615901] [DEBUG] [LOCAL ] ESRT: Saving derivative data. [2025-10-02T22:38:10.629545] [DEBUG] [LOCAL ] ESS: Derivative data saved (1807 records). [2025-10-02T22:38:10.632993] [INFO ] [MAIN ] ESS: Successfully saved derivative data. [2025-10-02T22:38:10.636045] [INFO ] [MAIN ] Derivative Progress: 617/1975 symbols completed. ESS took 1.3s. Estimated remaining: 9m 35s. Rate: 141.7 symbols/min [2025-10-02T22:38:10.638449] [INFO ] [MAIN ] ET: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:10.640946] [DEBUG] [LOCAL ] ESRT: Derivative data saved (1807 records). [2025-10-02T22:38:10.641456] [INFO ] [MAIN ] ESRT: Successfully saved derivative data. [2025-10-02T22:38:10.643737] [INFO ] [MAIN ] Derivative Progress: 618/1975 symbols completed. ESRT took 1.3s. Estimated remaining: 9m 34s. Rate: 141.9 symbols/min [2025-10-02T22:38:10.644086] [INFO ] [MAIN ] ETB: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:10.673607] [DEBUG] [LOCAL ] ETB: Loaded 12219 existing records from primary storage. [2025-10-02T22:38:10.673884] [INFO ] [MAIN ] ETB: Loaded 12219 primary data records. [2025-10-02T22:38:10.798834] [DEBUG] [LOCAL ] ESTC: Loaded 50315 existing records from primary storage. [2025-10-02T22:38:10.832218] [INFO ] [MAIN ] ESTC: Loaded 50315 primary data records. [2025-10-02T22:38:11.045746] [DEBUG] [LOCAL ] ET: Loaded 54179 existing records from primary storage. [2025-10-02T22:38:11.169214] [INFO ] [MAIN ] ET: Loaded 54179 primary data records. [2025-10-02T22:38:11.834715] [DEBUG] [MAIN ] ETB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:11.836254] [INFO ] [MAIN ] ETB: Generated 1807 derivative records from 12219 primary records. [2025-10-02T22:38:11.836864] [DEBUG] [LOCAL ] ETB: Saving derivative data. [2025-10-02T22:38:11.861623] [DEBUG] [LOCAL ] ETB: Derivative data saved (1807 records). [2025-10-02T22:38:11.862048] [INFO ] [MAIN ] ETB: Successfully saved derivative data. [2025-10-02T22:38:11.863904] [INFO ] [MAIN ] Derivative Progress: 619/1975 symbols completed. ETB took 1.2s. Estimated remaining: 9m 35s. Rate: 141.5 symbols/min [2025-10-02T22:38:11.864218] [INFO ] [MAIN ] ETD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:11.879346] [DEBUG] [MAIN ] ESTC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:11.880923] [INFO ] [MAIN ] ESTC: Generated 1807 derivative records from 50315 primary records. [2025-10-02T22:38:11.881206] [DEBUG] [LOCAL ] ESTC: Saving derivative data. [2025-10-02T22:38:11.917602] [DEBUG] [MAIN ] ET: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:11.916841] [DEBUG] [LOCAL ] ESTC: Derivative data saved (1807 records). [2025-10-02T22:38:11.917912] [INFO ] [MAIN ] ESTC: Successfully saved derivative data. [2025-10-02T22:38:11.921403] [INFO ] [MAIN ] ET: Generated 1807 derivative records from 54179 primary records. [2025-10-02T22:38:11.920291] [INFO ] [MAIN ] Derivative Progress: 620/1975 symbols completed. ESTC took 1.3s. Estimated remaining: 9m 34s. Rate: 141.7 symbols/min [2025-10-02T22:38:11.929519] [DEBUG] [LOCAL ] ET: Saving derivative data. [2025-10-02T22:38:11.930686] [INFO ] [MAIN ] ETJ: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:11.960492] [DEBUG] [LOCAL ] ETD: Loaded 27624 existing records from primary storage. [2025-10-02T22:38:11.959797] [DEBUG] [LOCAL ] ET: Derivative data saved (1807 records). [2025-10-02T22:38:11.960761] [INFO ] [MAIN ] ET: Successfully saved derivative data. [2025-10-02T22:38:11.960842] [INFO ] [MAIN ] ETD: Loaded 27624 primary data records. [2025-10-02T22:38:11.963132] [INFO ] [MAIN ] Derivative Progress: 621/1975 symbols completed. ET took 1.3s. Estimated remaining: 9m 33s. Rate: 141.9 symbols/min [2025-10-02T22:38:11.969725] [INFO ] [MAIN ] ETN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:12.100358] [DEBUG] [LOCAL ] ETJ: Loaded 16912 existing records from primary storage. [2025-10-02T22:38:12.106123] [INFO ] [MAIN ] ETJ: Loaded 16912 primary data records. [2025-10-02T22:38:12.593585] [DEBUG] [LOCAL ] ETN: Loaded 53136 existing records from primary storage. [2025-10-02T22:38:12.716239] [INFO ] [MAIN ] ETN: Loaded 53136 primary data records. [2025-10-02T22:38:12.925701] [DEBUG] [MAIN ] ETD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:12.951374] [INFO ] [MAIN ] ETD: Generated 1807 derivative records from 27624 primary records. [2025-10-02T22:38:13.083531] [DEBUG] [LOCAL ] ETD: Saving derivative data. [2025-10-02T22:38:13.123020] [DEBUG] [LOCAL ] ETD: Derivative data saved (1807 records). [2025-10-02T22:38:13.123457] [INFO ] [MAIN ] ETD: Successfully saved derivative data. [2025-10-02T22:38:13.122335] [DEBUG] [MAIN ] ETJ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:13.126788] [INFO ] [MAIN ] ETJ: Generated 1807 derivative records from 16912 primary records. [2025-10-02T22:38:13.125715] [INFO ] [MAIN ] Derivative Progress: 622/1975 symbols completed. ETD took 1.3s. Estimated remaining: 9m 34s. Rate: 141.5 symbols/min [2025-10-02T22:38:13.126955] [DEBUG] [LOCAL ] ETJ: Saving derivative data. [2025-10-02T22:38:13.127603] [INFO ] [MAIN ] ETO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:13.148878] [DEBUG] [LOCAL ] ETJ: Derivative data saved (1807 records). [2025-10-02T22:38:13.149260] [INFO ] [MAIN ] ETJ: Successfully saved derivative data. [2025-10-02T22:38:13.151274] [INFO ] [MAIN ] Derivative Progress: 623/1975 symbols completed. ETJ took 1.2s. Estimated remaining: 9m 32s. Rate: 141.7 symbols/min [2025-10-02T22:38:13.151536] [INFO ] [MAIN ] ETR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:13.155911] [DEBUG] [LOCAL ] ETO: Loaded 6595 existing records from primary storage. [2025-10-02T22:38:13.156079] [INFO ] [MAIN ] ETO: Loaded 6595 primary data records. [2025-10-02T22:38:13.339369] [DEBUG] [MAIN ] ETN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:13.381192] [INFO ] [MAIN ] ETN: Generated 1807 derivative records from 53136 primary records. [2025-10-02T22:38:13.556022] [DEBUG] [LOCAL ] ETN: Saving derivative data. [2025-10-02T22:38:13.610283] [DEBUG] [LOCAL ] ETN: Derivative data saved (1807 records). [2025-10-02T22:38:13.610501] [INFO ] [MAIN ] ETN: Successfully saved derivative data. [2025-10-02T22:38:13.613838] [INFO ] [MAIN ] Derivative Progress: 624/1975 symbols completed. ETN took 1.6s. Estimated remaining: 9m 32s. Rate: 141.7 symbols/min [2025-10-02T22:38:13.615976] [DEBUG] [LOCAL ] ETR: Loaded 53613 existing records from primary storage. [2025-10-02T22:38:13.616318] [INFO ] [MAIN ] ETR: Loaded 53613 primary data records. [2025-10-02T22:38:13.614234] [INFO ] [MAIN ] ETV: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:13.818687] [DEBUG] [LOCAL ] ETV: Loaded 21812 existing records from primary storage. [2025-10-02T22:38:13.835939] [INFO ] [MAIN ] ETV: Loaded 21812 primary data records. [2025-10-02T22:38:14.060373] [DEBUG] [MAIN ] ETO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:14.095343] [INFO ] [MAIN ] ETO: Generated 1807 derivative records from 6595 primary records. [2025-10-02T22:38:14.101402] [DEBUG] [LOCAL ] ETO: Saving derivative data. [2025-10-02T22:38:14.333120] [DEBUG] [LOCAL ] ETO: Derivative data saved (1807 records). [2025-10-02T22:38:14.335539] [INFO ] [MAIN ] ETO: Successfully saved derivative data. [2025-10-02T22:38:14.338744] [INFO ] [MAIN ] Derivative Progress: 625/1975 symbols completed. ETO took 1.2s. Estimated remaining: 9m 32s. Rate: 141.5 symbols/min [2025-10-02T22:38:14.339243] [INFO ] [MAIN ] ETW: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:14.353992] [DEBUG] [MAIN ] ETR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:14.355092] [INFO ] [MAIN ] ETR: Generated 1807 derivative records from 53613 primary records. [2025-10-02T22:38:14.355400] [DEBUG] [LOCAL ] ETR: Saving derivative data. [2025-10-02T22:38:14.383861] [DEBUG] [LOCAL ] ETR: Derivative data saved (1807 records). [2025-10-02T22:38:14.392038] [INFO ] [MAIN ] ETR: Successfully saved derivative data. [2025-10-02T22:38:14.394256] [INFO ] [MAIN ] Derivative Progress: 626/1975 symbols completed. ETR took 1.2s. Estimated remaining: 9m 31s. Rate: 141.7 symbols/min [2025-10-02T22:38:14.395401] [DEBUG] [LOCAL ] ETW: Loaded 25372 existing records from primary storage. [2025-10-02T22:38:14.395591] [INFO ] [MAIN ] ETW: Loaded 25372 primary data records. [2025-10-02T22:38:14.394597] [INFO ] [MAIN ] ETX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:14.442026] [DEBUG] [MAIN ] ETV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:14.456384] [INFO ] [MAIN ] ETV: Generated 1807 derivative records from 21812 primary records. [2025-10-02T22:38:14.497156] [DEBUG] [LOCAL ] ETV: Saving derivative data. [2025-10-02T22:38:14.556567] [DEBUG] [LOCAL ] ETX: Loaded 5194 existing records from primary storage. [2025-10-02T22:38:14.563599] [INFO ] [MAIN ] ETX: Loaded 5194 primary data records. [2025-10-02T22:38:14.702052] [DEBUG] [LOCAL ] ETV: Derivative data saved (1807 records). [2025-10-02T22:38:14.726171] [INFO ] [MAIN ] ETV: Successfully saved derivative data. [2025-10-02T22:38:14.883307] [INFO ] [MAIN ] Derivative Progress: 627/1975 symbols completed. ETV took 1.3s. Estimated remaining: 9m 31s. Rate: 141.7 symbols/min [2025-10-02T22:38:14.911194] [INFO ] [MAIN ] ETY: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:15.187204] [DEBUG] [LOCAL ] ETY: Loaded 23009 existing records from primary storage. [2025-10-02T22:38:15.188052] [INFO ] [MAIN ] ETY: Loaded 23009 primary data records. [2025-10-02T22:38:15.227710] [DEBUG] [MAIN ] ETW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:15.245953] [INFO ] [MAIN ] ETW: Generated 1807 derivative records from 25372 primary records. [2025-10-02T22:38:15.268217] [DEBUG] [LOCAL ] ETW: Saving derivative data. [2025-10-02T22:38:15.342754] [DEBUG] [LOCAL ] ETW: Derivative data saved (1807 records). [2025-10-02T22:38:15.343566] [INFO ] [MAIN ] ETW: Successfully saved derivative data. [2025-10-02T22:38:15.373806] [INFO ] [MAIN ] Derivative Progress: 628/1975 symbols completed. ETW took 1.0s. Estimated remaining: 9m 31s. Rate: 141.6 symbols/min [2025-10-02T22:38:15.454482] [DEBUG] [MAIN ] ETX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:15.600076] [INFO ] [MAIN ] ETX: Generated 1807 derivative records from 5194 primary records. [2025-10-02T22:38:15.620328] [DEBUG] [LOCAL ] ETX: Saving derivative data. [2025-10-02T22:38:15.641608] [DEBUG] [LOCAL ] ETX: Derivative data saved (1807 records). [2025-10-02T22:38:15.641997] [INFO ] [MAIN ] ETX: Successfully saved derivative data. [2025-10-02T22:38:15.644580] [INFO ] [MAIN ] Derivative Progress: 629/1975 symbols completed. ETX took 1.2s. Estimated remaining: 9m 30s. Rate: 141.7 symbols/min [2025-10-02T22:38:15.665669] [DEBUG] [MAIN ] ETY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:15.666368] [INFO ] [MAIN ] ETY: Generated 1807 derivative records from 23009 primary records. [2025-10-02T22:38:15.666431] [DEBUG] [LOCAL ] ETY: Saving derivative data. [2025-10-02T22:38:15.683979] [DEBUG] [LOCAL ] ETY: Derivative data saved (1807 records). [2025-10-02T22:38:15.684122] [INFO ] [MAIN ] ETY: Successfully saved derivative data. [2025-10-02T22:38:15.686241] [INFO ] [MAIN ] Derivative Progress: 630/1975 symbols completed. ETY took 0.8s. Estimated remaining: 9m 29s. Rate: 141.9 symbols/min [2025-10-02T22:38:15.686764] [INFO ] [MAIN ] EVF: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:15.686892] [INFO ] [MAIN ] EVEX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:15.687037] [INFO ] [MAIN ] EVC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:15.701117] [DEBUG] [LOCAL ] EVF: Loaded 9459 existing records from primary storage. [2025-10-02T22:38:15.701353] [INFO ] [MAIN ] EVF: Loaded 9459 primary data records. [2025-10-02T22:38:15.831564] [DEBUG] [LOCAL ] EVC: Loaded 18719 existing records from primary storage. [2025-10-02T22:38:15.843725] [INFO ] [MAIN ] EVC: Loaded 18719 primary data records. [2025-10-02T22:38:15.905561] [DEBUG] [LOCAL ] EVEX: Loaded 30868 existing records from primary storage. [2025-10-02T22:38:15.974489] [INFO ] [MAIN ] EVEX: Loaded 30868 primary data records. [2025-10-02T22:38:16.916350] [DEBUG] [MAIN ] EVF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:16.917677] [INFO ] [MAIN ] EVF: Generated 1807 derivative records from 9459 primary records. [2025-10-02T22:38:16.926009] [DEBUG] [LOCAL ] EVF: Saving derivative data. [2025-10-02T22:38:16.934022] [DEBUG] [MAIN ] EVC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:16.952176] [DEBUG] [LOCAL ] EVF: Derivative data saved (1807 records). [2025-10-02T22:38:16.952355] [INFO ] [MAIN ] EVF: Successfully saved derivative data. [2025-10-02T22:38:16.948019] [INFO ] [MAIN ] EVC: Generated 1807 derivative records from 18719 primary records. [2025-10-02T22:38:16.954964] [INFO ] [MAIN ] Derivative Progress: 631/1975 symbols completed. EVF took 1.3s. Estimated remaining: 9m 30s. Rate: 141.5 symbols/min [2025-10-02T22:38:16.952905] [DEBUG] [LOCAL ] EVC: Saving derivative data. [2025-10-02T22:38:16.956754] [INFO ] [MAIN ] EVG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:16.995602] [DEBUG] [MAIN ] EVEX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:16.997800] [DEBUG] [LOCAL ] EVC: Derivative data saved (1807 records). [2025-10-02T22:38:16.996917] [INFO ] [MAIN ] EVEX: Generated 1807 derivative records from 30868 primary records. [2025-10-02T22:38:17.001197] [DEBUG] [LOCAL ] EVEX: Saving derivative data. [2025-10-02T22:38:17.002396] [DEBUG] [LOCAL ] EVG: Loaded 5992 existing records from primary storage. [2025-10-02T22:38:17.001879] [INFO ] [MAIN ] EVC: Successfully saved derivative data. [2025-10-02T22:38:17.002829] [INFO ] [MAIN ] EVG: Loaded 5992 primary data records. [2025-10-02T22:38:17.012476] [INFO ] [MAIN ] Derivative Progress: 632/1975 symbols completed. EVC took 1.3s. Estimated remaining: 9m 29s. Rate: 141.7 symbols/min [2025-10-02T22:38:17.022390] [INFO ] [MAIN ] EVH: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:17.139287] [DEBUG] [LOCAL ] EVEX: Derivative data saved (1807 records). [2025-10-02T22:38:17.139582] [INFO ] [MAIN ] EVEX: Successfully saved derivative data. [2025-10-02T22:38:17.142031] [INFO ] [MAIN ] Derivative Progress: 633/1975 symbols completed. EVEX took 1.5s. Estimated remaining: 9m 28s. Rate: 141.8 symbols/min [2025-10-02T22:38:17.148212] [INFO ] [MAIN ] EVN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:17.378846] [DEBUG] [LOCAL ] EVN: Loaded 11253 existing records from primary storage. [2025-10-02T22:38:17.392009] [INFO ] [MAIN ] EVN: Loaded 11253 primary data records. [2025-10-02T22:38:17.407127] [DEBUG] [LOCAL ] EVH: Loaded 49734 existing records from primary storage. [2025-10-02T22:38:17.436394] [INFO ] [MAIN ] EVH: Loaded 49734 primary data records. [2025-10-02T22:38:18.141943] [DEBUG] [MAIN ] EVG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:18.144432] [INFO ] [MAIN ] EVG: Generated 1807 derivative records from 5992 primary records. [2025-10-02T22:38:18.145333] [DEBUG] [LOCAL ] EVG: Saving derivative data. [2025-10-02T22:38:18.167693] [DEBUG] [LOCAL ] EVG: Derivative data saved (1807 records). [2025-10-02T22:38:18.168956] [INFO ] [MAIN ] EVG: Successfully saved derivative data. [2025-10-02T22:38:18.172127] [INFO ] [MAIN ] Derivative Progress: 634/1975 symbols completed. EVG took 1.2s. Estimated remaining: 9m 29s. Rate: 141.5 symbols/min [2025-10-02T22:38:18.173472] [INFO ] [MAIN ] EVR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:18.193881] [DEBUG] [MAIN ] EVN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:18.196810] [INFO ] [MAIN ] EVN: Generated 1807 derivative records from 11253 primary records. [2025-10-02T22:38:18.197820] [DEBUG] [LOCAL ] EVN: Saving derivative data. [2025-10-02T22:38:18.219803] [DEBUG] [MAIN ] EVH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:18.225426] [INFO ] [MAIN ] EVH: Generated 1807 derivative records from 49734 primary records. [2025-10-02T22:38:18.225803] [DEBUG] [LOCAL ] EVH: Saving derivative data. [2025-10-02T22:38:18.250125] [DEBUG] [LOCAL ] EVN: Derivative data saved (1807 records). [2025-10-02T22:38:18.250872] [INFO ] [MAIN ] EVN: Successfully saved derivative data. [2025-10-02T22:38:18.253390] [INFO ] [MAIN ] Derivative Progress: 635/1975 symbols completed. EVN took 1.1s. Estimated remaining: 9m 27s. Rate: 141.7 symbols/min [2025-10-02T22:38:18.253842] [INFO ] [MAIN ] EVT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:18.268963] [DEBUG] [LOCAL ] EVH: Derivative data saved (1807 records). [2025-10-02T22:38:18.269099] [INFO ] [MAIN ] EVH: Successfully saved derivative data. [2025-10-02T22:38:18.271330] [INFO ] [MAIN ] Derivative Progress: 636/1975 symbols completed. EVH took 1.2s. Estimated remaining: 9m 26s. Rate: 141.9 symbols/min [2025-10-02T22:38:18.271605] [INFO ] [MAIN ] EVTC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:18.289894] [DEBUG] [LOCAL ] EVR: Loaded 35117 existing records from primary storage. [2025-10-02T22:38:18.290167] [INFO ] [MAIN ] EVR: Loaded 35117 primary data records. [2025-10-02T22:38:18.349885] [DEBUG] [LOCAL ] EVT: Loaded 17068 existing records from primary storage. [2025-10-02T22:38:18.369693] [INFO ] [MAIN ] EVT: Loaded 17068 primary data records. [2025-10-02T22:38:18.767221] [DEBUG] [LOCAL ] EVTC: Loaded 26492 existing records from primary storage. [2025-10-02T22:38:18.779082] [INFO ] [MAIN ] EVTC: Loaded 26492 primary data records. [2025-10-02T22:38:19.367869] [DEBUG] [MAIN ] EVR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:19.371030] [INFO ] [MAIN ] EVR: Generated 1807 derivative records from 35117 primary records. [2025-10-02T22:38:19.371792] [DEBUG] [LOCAL ] EVR: Saving derivative data. [2025-10-02T22:38:19.401954] [DEBUG] [MAIN ] EVT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:19.403804] [INFO ] [MAIN ] EVT: Generated 1807 derivative records from 17068 primary records. [2025-10-02T22:38:19.404051] [DEBUG] [LOCAL ] EVT: Saving derivative data. [2025-10-02T22:38:19.423243] [DEBUG] [LOCAL ] EVR: Derivative data saved (1807 records). [2025-10-02T22:38:19.424676] [INFO ] [MAIN ] EVR: Successfully saved derivative data. [2025-10-02T22:38:19.429703] [INFO ] [MAIN ] Derivative Progress: 637/1975 symbols completed. EVR took 1.3s. Estimated remaining: 9m 27s. Rate: 141.5 symbols/min [2025-10-02T22:38:19.430227] [INFO ] [MAIN ] EVTL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:19.438543] [DEBUG] [LOCAL ] EVT: Derivative data saved (1807 records). [2025-10-02T22:38:19.446863] [INFO ] [MAIN ] EVT: Successfully saved derivative data. [2025-10-02T22:38:19.453291] [DEBUG] [MAIN ] EVTC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:19.455583] [INFO ] [MAIN ] Derivative Progress: 638/1975 symbols completed. EVT took 1.2s. Estimated remaining: 9m 26s. Rate: 141.7 symbols/min [2025-10-02T22:38:19.457107] [INFO ] [MAIN ] EVTC: Generated 1807 derivative records from 26492 primary records. [2025-10-02T22:38:19.457217] [INFO ] [MAIN ] EVTR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:19.457746] [DEBUG] [LOCAL ] EVTC: Saving derivative data. [2025-10-02T22:38:19.486970] [DEBUG] [LOCAL ] EVTC: Derivative data saved (1807 records). [2025-10-02T22:38:19.487227] [INFO ] [MAIN ] EVTC: Successfully saved derivative data. [2025-10-02T22:38:19.489680] [INFO ] [MAIN ] Derivative Progress: 639/1975 symbols completed. EVTC took 1.2s. Estimated remaining: 9m 25s. Rate: 141.9 symbols/min [2025-10-02T22:38:19.490099] [INFO ] [MAIN ] EW: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:19.521291] [DEBUG] [LOCAL ] EVTL: Loaded 38644 existing records from primary storage. [2025-10-02T22:38:19.521506] [INFO ] [MAIN ] EVTL: Loaded 38644 primary data records. [2025-10-02T22:38:19.544292] [DEBUG] [LOCAL ] EVTR: Loaded 23911 existing records from primary storage. [2025-10-02T22:38:19.568106] [INFO ] [MAIN ] EVTR: Loaded 23911 primary data records. [2025-10-02T22:38:20.087230] [DEBUG] [LOCAL ] EW: Loaded 53791 existing records from primary storage. [2025-10-02T22:38:20.256926] [INFO ] [MAIN ] EW: Loaded 53791 primary data records. [2025-10-02T22:38:20.631868] [DEBUG] [MAIN ] EVTR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:20.648130] [DEBUG] [MAIN ] EVTL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:20.650566] [INFO ] [MAIN ] EVTR: Generated 1807 derivative records from 23911 primary records. [2025-10-02T22:38:20.651918] [DEBUG] [LOCAL ] EVTR: Saving derivative data. [2025-10-02T22:38:20.651708] [INFO ] [MAIN ] EVTL: Generated 1807 derivative records from 38644 primary records. [2025-10-02T22:38:20.652896] [DEBUG] [LOCAL ] EVTL: Saving derivative data. [2025-10-02T22:38:20.687253] [DEBUG] [LOCAL ] EVTL: Derivative data saved (1807 records). [2025-10-02T22:38:20.687975] [INFO ] [MAIN ] EVTL: Successfully saved derivative data. [2025-10-02T22:38:20.692602] [INFO ] [MAIN ] Derivative Progress: 640/1975 symbols completed. EVTL took 1.3s. Estimated remaining: 9m 26s. Rate: 141.5 symbols/min [2025-10-02T22:38:20.695676] [INFO ] [MAIN ] EXG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:20.698260] [DEBUG] [LOCAL ] EVTR: Derivative data saved (1807 records). [2025-10-02T22:38:20.698533] [INFO ] [MAIN ] EVTR: Successfully saved derivative data. [2025-10-02T22:38:20.701035] [INFO ] [MAIN ] Derivative Progress: 641/1975 symbols completed. EVTR took 1.2s. Estimated remaining: 9m 25s. Rate: 141.7 symbols/min [2025-10-02T22:38:20.716151] [INFO ] [MAIN ] EXK: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:20.716953] [DEBUG] [MAIN ] EW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:20.718330] [INFO ] [MAIN ] EW: Generated 1807 derivative records from 53791 primary records. [2025-10-02T22:38:20.718525] [DEBUG] [LOCAL ] EW: Saving derivative data. [2025-10-02T22:38:20.737024] [DEBUG] [LOCAL ] EW: Derivative data saved (1807 records). [2025-10-02T22:38:20.737181] [INFO ] [MAIN ] EW: Successfully saved derivative data. [2025-10-02T22:38:20.739608] [INFO ] [MAIN ] Derivative Progress: 642/1975 symbols completed. EW took 1.2s. Estimated remaining: 9m 23s. Rate: 141.9 symbols/min [2025-10-02T22:38:20.740199] [INFO ] [MAIN ] EXP: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:20.769828] [DEBUG] [LOCAL ] EXG: Loaded 34342 existing records from primary storage. [2025-10-02T22:38:20.770158] [INFO ] [MAIN ] EXG: Loaded 34342 primary data records. [2025-10-02T22:38:20.934537] [DEBUG] [LOCAL ] EXP: Loaded 29797 existing records from primary storage. [2025-10-02T22:38:20.934877] [INFO ] [MAIN ] EXP: Loaded 29797 primary data records. [2025-10-02T22:38:20.976922] [DEBUG] [LOCAL ] EXK: Loaded 53526 existing records from primary storage. [2025-10-02T22:38:21.014402] [INFO ] [MAIN ] EXK: Loaded 53526 primary data records. [2025-10-02T22:38:21.874118] [DEBUG] [MAIN ] EXG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:21.875678] [INFO ] [MAIN ] EXG: Generated 1807 derivative records from 34342 primary records. [2025-10-02T22:38:21.876196] [DEBUG] [LOCAL ] EXG: Saving derivative data. [2025-10-02T22:38:21.897383] [DEBUG] [LOCAL ] EXG: Derivative data saved (1807 records). [2025-10-02T22:38:21.900069] [INFO ] [MAIN ] EXG: Successfully saved derivative data. [2025-10-02T22:38:21.904884] [INFO ] [MAIN ] Derivative Progress: 643/1975 symbols completed. EXG took 1.2s. Estimated remaining: 9m 25s. Rate: 141.6 symbols/min [2025-10-02T22:38:21.937047] [DEBUG] [MAIN ] EXP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:21.938469] [INFO ] [MAIN ] EXP: Generated 1807 derivative records from 29797 primary records. [2025-10-02T22:38:21.937405] [DEBUG] [MAIN ] EXK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:21.939405] [INFO ] [MAIN ] EXK: Generated 1807 derivative records from 53526 primary records. [2025-10-02T22:38:21.939514] [DEBUG] [LOCAL ] EXP: Saving derivative data. [2025-10-02T22:38:21.940190] [DEBUG] [LOCAL ] EXK: Saving derivative data. [2025-10-02T22:38:21.971717] [DEBUG] [LOCAL ] EXP: Derivative data saved (1807 records). [2025-10-02T22:38:21.972366] [INFO ] [MAIN ] EXP: Successfully saved derivative data. [2025-10-02T22:38:21.975076] [INFO ] [MAIN ] Derivative Progress: 644/1975 symbols completed. EXP took 1.2s. Estimated remaining: 9m 23s. Rate: 141.7 symbols/min [2025-10-02T22:38:21.977371] [DEBUG] [LOCAL ] EXK: Derivative data saved (1807 records). [2025-10-02T22:38:21.977518] [INFO ] [MAIN ] EXK: Successfully saved derivative data. [2025-10-02T22:38:21.980009] [INFO ] [MAIN ] Derivative Progress: 645/1975 symbols completed. EXK took 1.3s. Estimated remaining: 9m 22s. Rate: 142.0 symbols/min [2025-10-02T22:38:21.980421] [INFO ] [MAIN ] F: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:21.980681] [INFO ] [MAIN ] EXPD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:21.980576] [INFO ] [MAIN ] EXR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:22.070487] [DEBUG] [LOCAL ] F: Loaded 54210 existing records from primary storage. [2025-10-02T22:38:22.070755] [INFO ] [MAIN ] F: Loaded 54210 primary data records. [2025-10-02T22:38:22.071910] [DEBUG] [LOCAL ] EXPD: Loaded 48284 existing records from primary storage. [2025-10-02T22:38:22.106910] [INFO ] [MAIN ] EXPD: Loaded 48284 primary data records. [2025-10-02T22:38:22.163336] [DEBUG] [LOCAL ] EXR: Loaded 45592 existing records from primary storage. [2025-10-02T22:38:22.195024] [INFO ] [MAIN ] EXR: Loaded 45592 primary data records. [2025-10-02T22:38:23.212391] [DEBUG] [MAIN ] F: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:23.221764] [INFO ] [MAIN ] F: Generated 1807 derivative records from 54210 primary records. [2025-10-02T22:38:23.228077] [DEBUG] [LOCAL ] F: Saving derivative data. [2025-10-02T22:38:23.231280] [DEBUG] [MAIN ] EXPD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:23.246570] [INFO ] [MAIN ] EXPD: Generated 1807 derivative records from 48284 primary records. [2025-10-02T22:38:23.251784] [DEBUG] [LOCAL ] F: Derivative data saved (1807 records). [2025-10-02T22:38:23.264976] [INFO ] [MAIN ] F: Successfully saved derivative data. [2025-10-02T22:38:23.267051] [INFO ] [MAIN ] Derivative Progress: 646/1975 symbols completed. F took 1.3s. Estimated remaining: 9m 24s. Rate: 141.5 symbols/min [2025-10-02T22:38:23.267352] [INFO ] [MAIN ] FAF: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:23.265139] [DEBUG] [LOCAL ] EXPD: Saving derivative data. [2025-10-02T22:38:23.267807] [DEBUG] [MAIN ] EXR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:23.269868] [INFO ] [MAIN ] EXR: Generated 1807 derivative records from 45592 primary records. [2025-10-02T22:38:23.270035] [DEBUG] [LOCAL ] EXR: Saving derivative data. [2025-10-02T22:38:23.302948] [DEBUG] [LOCAL ] EXR: Derivative data saved (1807 records). [2025-10-02T22:38:23.303988] [INFO ] [MAIN ] EXR: Successfully saved derivative data. [2025-10-02T22:38:23.306115] [INFO ] [MAIN ] Derivative Progress: 647/1975 symbols completed. EXR took 1.3s. Estimated remaining: 9m 22s. Rate: 141.7 symbols/min [2025-10-02T22:38:23.306946] [INFO ] [MAIN ] FBIN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:23.311874] [DEBUG] [LOCAL ] EXPD: Derivative data saved (1807 records). [2025-10-02T22:38:23.314452] [INFO ] [MAIN ] EXPD: Successfully saved derivative data. [2025-10-02T22:38:23.316550] [INFO ] [MAIN ] Derivative Progress: 648/1975 symbols completed. EXPD took 1.3s. Estimated remaining: 9m 21s. Rate: 141.9 symbols/min [2025-10-02T22:38:23.316885] [INFO ] [MAIN ] FBK: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:23.355503] [DEBUG] [LOCAL ] FAF: Loaded 41936 existing records from primary storage. [2025-10-02T22:38:23.363934] [INFO ] [MAIN ] FAF: Loaded 41936 primary data records. [2025-10-02T22:38:23.488551] [DEBUG] [LOCAL ] FBK: Loaded 26281 existing records from primary storage. [2025-10-02T22:38:23.500074] [INFO ] [MAIN ] FBK: Loaded 26281 primary data records. [2025-10-02T22:38:23.585449] [DEBUG] [LOCAL ] FBIN: Loaded 50693 existing records from primary storage. [2025-10-02T22:38:23.629795] [INFO ] [MAIN ] FBIN: Loaded 50693 primary data records. [2025-10-02T22:38:24.494713] [DEBUG] [MAIN ] FAF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:24.496151] [INFO ] [MAIN ] FAF: Generated 1807 derivative records from 41936 primary records. [2025-10-02T22:38:24.496841] [DEBUG] [LOCAL ] FAF: Saving derivative data. [2025-10-02T22:38:24.523516] [DEBUG] [LOCAL ] FAF: Derivative data saved (1807 records). [2025-10-02T22:38:24.523992] [INFO ] [MAIN ] FAF: Successfully saved derivative data. [2025-10-02T22:38:24.539546] [INFO ] [MAIN ] Derivative Progress: 649/1975 symbols completed. FAF took 1.3s. Estimated remaining: 9m 22s. Rate: 141.5 symbols/min [2025-10-02T22:38:24.540788] [INFO ] [MAIN ] FBP: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:24.541529] [DEBUG] [MAIN ] FBIN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:24.556755] [DEBUG] [MAIN ] FBK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:24.556410] [INFO ] [MAIN ] FBIN: Generated 1807 derivative records from 50693 primary records. [2025-10-02T22:38:24.557460] [INFO ] [MAIN ] FBK: Generated 1807 derivative records from 26281 primary records. [2025-10-02T22:38:24.557810] [DEBUG] [LOCAL ] FBIN: Saving derivative data. [2025-10-02T22:38:24.558565] [DEBUG] [LOCAL ] FBK: Saving derivative data. [2025-10-02T22:38:24.588952] [DEBUG] [LOCAL ] FBK: Derivative data saved (1807 records). [2025-10-02T22:38:24.589356] [INFO ] [MAIN ] FBK: Successfully saved derivative data. [2025-10-02T22:38:24.592373] [INFO ] [MAIN ] Derivative Progress: 650/1975 symbols completed. FBK took 1.3s. Estimated remaining: 9m 21s. Rate: 141.7 symbols/min [2025-10-02T22:38:24.592944] [INFO ] [MAIN ] FBRT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:24.596343] [DEBUG] [LOCAL ] FBIN: Derivative data saved (1807 records). [2025-10-02T22:38:24.597058] [INFO ] [MAIN ] FBIN: Successfully saved derivative data. [2025-10-02T22:38:24.600095] [INFO ] [MAIN ] Derivative Progress: 651/1975 symbols completed. FBIN took 1.3s. Estimated remaining: 9m 20s. Rate: 141.9 symbols/min [2025-10-02T22:38:24.600617] [INFO ] [MAIN ] FC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:24.631188] [DEBUG] [LOCAL ] FC: Loaded 15565 existing records from primary storage. [2025-10-02T22:38:24.646474] [INFO ] [MAIN ] FC: Loaded 15565 primary data records. [2025-10-02T22:38:24.653405] [DEBUG] [LOCAL ] FBP: Loaded 46270 existing records from primary storage. [2025-10-02T22:38:24.670870] [INFO ] [MAIN ] FBP: Loaded 46270 primary data records. [2025-10-02T22:38:24.880955] [DEBUG] [LOCAL ] FBRT: Loaded 34942 existing records from primary storage. [2025-10-02T22:38:24.939177] [INFO ] [MAIN ] FBRT: Loaded 34942 primary data records. [2025-10-02T22:38:25.739015] [DEBUG] [MAIN ] FC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:25.741917] [INFO ] [MAIN ] FC: Generated 1807 derivative records from 15565 primary records. [2025-10-02T22:38:25.742693] [DEBUG] [LOCAL ] FC: Saving derivative data. [2025-10-02T22:38:25.766834] [DEBUG] [MAIN ] FBP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:25.769283] [INFO ] [MAIN ] FBP: Generated 1807 derivative records from 46270 primary records. [2025-10-02T22:38:25.775920] [DEBUG] [LOCAL ] FBP: Saving derivative data. [2025-10-02T22:38:25.802711] [DEBUG] [MAIN ] FBRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:25.807865] [INFO ] [MAIN ] FBRT: Generated 1807 derivative records from 34942 primary records. [2025-10-02T22:38:25.808058] [DEBUG] [LOCAL ] FBRT: Saving derivative data. [2025-10-02T22:38:25.814568] [DEBUG] [LOCAL ] FBP: Derivative data saved (1807 records). [2025-10-02T22:38:25.826744] [INFO ] [MAIN ] FBP: Successfully saved derivative data. [2025-10-02T22:38:25.829839] [INFO ] [MAIN ] Derivative Progress: 652/1975 symbols completed. FBP took 1.3s. Estimated remaining: 9m 21s. Rate: 141.5 symbols/min [2025-10-02T22:38:25.830723] [INFO ] [MAIN ] FCF: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:25.830527] [DEBUG] [LOCAL ] FC: Derivative data saved (1807 records). [2025-10-02T22:38:25.831688] [INFO ] [MAIN ] FC: Successfully saved derivative data. [2025-10-02T22:38:25.834604] [INFO ] [MAIN ] Derivative Progress: 653/1975 symbols completed. FC took 1.2s. Estimated remaining: 9m 20s. Rate: 141.7 symbols/min [2025-10-02T22:38:25.836289] [INFO ] [MAIN ] FCN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:25.840713] [DEBUG] [LOCAL ] FBRT: Derivative data saved (1807 records). [2025-10-02T22:38:25.840828] [INFO ] [MAIN ] FBRT: Successfully saved derivative data. [2025-10-02T22:38:25.843044] [INFO ] [MAIN ] Derivative Progress: 654/1975 symbols completed. FBRT took 1.3s. Estimated remaining: 9m 18s. Rate: 141.9 symbols/min [2025-10-02T22:38:25.843459] [INFO ] [MAIN ] FCPT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:25.891807] [DEBUG] [LOCAL ] FCF: Loaded 39650 existing records from primary storage. [2025-10-02T22:38:25.892176] [INFO ] [MAIN ] FCF: Loaded 39650 primary data records. [2025-10-02T22:38:25.964452] [DEBUG] [LOCAL ] FCN: Loaded 26094 existing records from primary storage. [2025-10-02T22:38:25.989825] [INFO ] [MAIN ] FCN: Loaded 26094 primary data records. [2025-10-02T22:38:26.085197] [DEBUG] [LOCAL ] FCPT: Loaded 37618 existing records from primary storage. [2025-10-02T22:38:26.129606] [INFO ] [MAIN ] FCPT: Loaded 37618 primary data records. [2025-10-02T22:38:27.039698] [DEBUG] [MAIN ] FCF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:27.041069] [INFO ] [MAIN ] FCF: Generated 1807 derivative records from 39650 primary records. [2025-10-02T22:38:27.041457] [DEBUG] [LOCAL ] FCF: Saving derivative data. [2025-10-02T22:38:27.077281] [DEBUG] [LOCAL ] FCF: Derivative data saved (1807 records). [2025-10-02T22:38:27.079109] [INFO ] [MAIN ] FCF: Successfully saved derivative data. [2025-10-02T22:38:27.078171] [DEBUG] [MAIN ] FCN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:27.079953] [INFO ] [MAIN ] FCN: Generated 1807 derivative records from 26094 primary records. [2025-10-02T22:38:27.083896] [INFO ] [MAIN ] Derivative Progress: 655/1975 symbols completed. FCF took 1.3s. Estimated remaining: 9m 20s. Rate: 141.5 symbols/min [2025-10-02T22:38:27.081093] [DEBUG] [LOCAL ] FCN: Saving derivative data. [2025-10-02T22:38:27.085280] [INFO ] [MAIN ] FCT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:27.116728] [DEBUG] [MAIN ] FCPT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:27.118147] [INFO ] [MAIN ] FCPT: Generated 1807 derivative records from 37618 primary records. [2025-10-02T22:38:27.119040] [DEBUG] [LOCAL ] FCPT: Saving derivative data. [2025-10-02T22:38:27.121178] [DEBUG] [LOCAL ] FCN: Derivative data saved (1807 records). [2025-10-02T22:38:27.121438] [INFO ] [MAIN ] FCN: Successfully saved derivative data. [2025-10-02T22:38:27.128411] [INFO ] [MAIN ] Derivative Progress: 656/1975 symbols completed. FCN took 1.3s. Estimated remaining: 9m 19s. Rate: 141.7 symbols/min [2025-10-02T22:38:27.128574] [INFO ] [MAIN ] FCX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:27.145983] [DEBUG] [LOCAL ] FCPT: Derivative data saved (1807 records). [2025-10-02T22:38:27.146104] [INFO ] [MAIN ] FCPT: Successfully saved derivative data. [2025-10-02T22:38:27.149243] [INFO ] [MAIN ] Derivative Progress: 657/1975 symbols completed. FCPT took 1.3s. Estimated remaining: 9m 17s. Rate: 141.9 symbols/min [2025-10-02T22:38:27.149621] [INFO ] [MAIN ] FDP: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:27.156725] [DEBUG] [LOCAL ] FCT: Loaded 14789 existing records from primary storage. [2025-10-02T22:38:27.156871] [INFO ] [MAIN ] FCT: Loaded 14789 primary data records. [2025-10-02T22:38:27.542828] [DEBUG] [LOCAL ] FDP: Loaded 30317 existing records from primary storage. [2025-10-02T22:38:27.544711] [DEBUG] [LOCAL ] FCX: Loaded 54090 existing records from primary storage. [2025-10-02T22:38:27.545244] [INFO ] [MAIN ] FDP: Loaded 30317 primary data records. [2025-10-02T22:38:27.545151] [INFO ] [MAIN ] FCX: Loaded 54090 primary data records. [2025-10-02T22:38:28.216049] [DEBUG] [MAIN ] FCT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:28.217450] [INFO ] [MAIN ] FCT: Generated 1807 derivative records from 14789 primary records. [2025-10-02T22:38:28.217632] [DEBUG] [LOCAL ] FCT: Saving derivative data. [2025-10-02T22:38:28.240877] [DEBUG] [LOCAL ] FCT: Derivative data saved (1807 records). [2025-10-02T22:38:28.241245] [INFO ] [MAIN ] FCT: Successfully saved derivative data. [2025-10-02T22:38:28.243746] [INFO ] [MAIN ] Derivative Progress: 658/1975 symbols completed. FCT took 1.2s. Estimated remaining: 9m 18s. Rate: 141.6 symbols/min [2025-10-02T22:38:28.275575] [DEBUG] [MAIN ] FCX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:28.276769] [INFO ] [MAIN ] FCX: Generated 1807 derivative records from 54090 primary records. [2025-10-02T22:38:28.277055] [DEBUG] [LOCAL ] FCX: Saving derivative data. [2025-10-02T22:38:28.277006] [DEBUG] [MAIN ] FDP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:28.278335] [INFO ] [MAIN ] FDP: Generated 1807 derivative records from 30317 primary records. [2025-10-02T22:38:28.278421] [DEBUG] [LOCAL ] FDP: Saving derivative data. [2025-10-02T22:38:28.311610] [DEBUG] [LOCAL ] FDP: Derivative data saved (1807 records). [2025-10-02T22:38:28.312082] [DEBUG] [LOCAL ] FCX: Derivative data saved (1807 records). [2025-10-02T22:38:28.312295] [INFO ] [MAIN ] FDP: Successfully saved derivative data. [2025-10-02T22:38:28.312380] [INFO ] [MAIN ] FCX: Successfully saved derivative data. [2025-10-02T22:38:28.314940] [INFO ] [MAIN ] Derivative Progress: 659/1975 symbols completed. FDP took 1.2s. Estimated remaining: 9m 17s. Rate: 141.7 symbols/min [2025-10-02T22:38:28.317816] [INFO ] [MAIN ] Derivative Progress: 660/1975 symbols completed. FCX took 1.2s. Estimated remaining: 9m 16s. Rate: 142.0 symbols/min [2025-10-02T22:38:28.318349] [INFO ] [MAIN ] FDS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:28.318454] [INFO ] [MAIN ] FDX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:28.318601] [INFO ] [MAIN ] FE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:28.350506] [DEBUG] [LOCAL ] FDS: Loaded 26895 existing records from primary storage. [2025-10-02T22:38:28.350691] [INFO ] [MAIN ] FDS: Loaded 26895 primary data records. [2025-10-02T22:38:28.773042] [DEBUG] [LOCAL ] FDX: Loaded 51922 existing records from primary storage. [2025-10-02T22:38:28.775297] [INFO ] [MAIN ] FDX: Loaded 51922 primary data records. [2025-10-02T22:38:28.782228] [DEBUG] [LOCAL ] FE: Loaded 53818 existing records from primary storage. [2025-10-02T22:38:28.829027] [INFO ] [MAIN ] FE: Loaded 53818 primary data records. [2025-10-02T22:38:29.536426] [DEBUG] [MAIN ] FDS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:29.537767] [INFO ] [MAIN ] FDS: Generated 1807 derivative records from 26895 primary records. [2025-10-02T22:38:29.539193] [DEBUG] [LOCAL ] FDS: Saving derivative data. [2025-10-02T22:38:29.564981] [DEBUG] [LOCAL ] FDS: Derivative data saved (1807 records). [2025-10-02T22:38:29.565263] [INFO ] [MAIN ] FDS: Successfully saved derivative data. [2025-10-02T22:38:29.567999] [INFO ] [MAIN ] Derivative Progress: 661/1975 symbols completed. FDS took 1.2s. Estimated remaining: 9m 17s. Rate: 141.5 symbols/min [2025-10-02T22:38:29.568309] [INFO ] [MAIN ] FERG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:29.599391] [DEBUG] [MAIN ] FDX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:29.605778] [INFO ] [MAIN ] FDX: Generated 1807 derivative records from 51922 primary records. [2025-10-02T22:38:29.605940] [DEBUG] [LOCAL ] FDX: Saving derivative data. [2025-10-02T22:38:29.606147] [DEBUG] [MAIN ] FE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:29.608062] [INFO ] [MAIN ] FE: Generated 1807 derivative records from 53818 primary records. [2025-10-02T22:38:29.608309] [DEBUG] [LOCAL ] FE: Saving derivative data. [2025-10-02T22:38:29.640699] [DEBUG] [LOCAL ] FE: Derivative data saved (1807 records). [2025-10-02T22:38:29.641488] [INFO ] [MAIN ] FE: Successfully saved derivative data. [2025-10-02T22:38:29.644068] [INFO ] [MAIN ] Derivative Progress: 662/1975 symbols completed. FE took 1.3s. Estimated remaining: 9m 16s. Rate: 141.7 symbols/min [2025-10-02T22:38:29.644913] [INFO ] [MAIN ] FET: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:29.659323] [DEBUG] [LOCAL ] FDX: Derivative data saved (1807 records). [2025-10-02T22:38:29.659575] [INFO ] [MAIN ] FDX: Successfully saved derivative data. [2025-10-02T22:38:29.663692] [INFO ] [MAIN ] Derivative Progress: 663/1975 symbols completed. FDX took 1.3s. Estimated remaining: 9m 15s. Rate: 141.9 symbols/min [2025-10-02T22:38:29.664041] [INFO ] [MAIN ] FF: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:29.676575] [DEBUG] [LOCAL ] FET: Loaded 12979 existing records from primary storage. [2025-10-02T22:38:29.690942] [INFO ] [MAIN ] FET: Loaded 12979 primary data records. [2025-10-02T22:38:29.715333] [DEBUG] [LOCAL ] FERG: Loaded 49230 existing records from primary storage. [2025-10-02T22:38:29.764595] [INFO ] [MAIN ] FERG: Loaded 49230 primary data records. [2025-10-02T22:38:29.986752] [DEBUG] [LOCAL ] FF: Loaded 25097 existing records from primary storage. [2025-10-02T22:38:30.048127] [INFO ] [MAIN ] FF: Loaded 25097 primary data records. [2025-10-02T22:38:30.760133] [DEBUG] [MAIN ] FET: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:30.761224] [INFO ] [MAIN ] FET: Generated 1807 derivative records from 12979 primary records. [2025-10-02T22:38:30.761410] [DEBUG] [LOCAL ] FET: Saving derivative data. [2025-10-02T22:38:30.797759] [DEBUG] [MAIN ] FERG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:30.800029] [DEBUG] [LOCAL ] FET: Derivative data saved (1807 records). [2025-10-02T22:38:30.800170] [INFO ] [MAIN ] FET: Successfully saved derivative data. [2025-10-02T22:38:30.799478] [INFO ] [MAIN ] FERG: Generated 1807 derivative records from 49230 primary records. [2025-10-02T22:38:30.801236] [DEBUG] [LOCAL ] FERG: Saving derivative data. [2025-10-02T22:38:30.803354] [INFO ] [MAIN ] Derivative Progress: 664/1975 symbols completed. FET took 1.2s. Estimated remaining: 9m 16s. Rate: 141.6 symbols/min [2025-10-02T22:38:30.806057] [INFO ] [MAIN ] FFA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:30.833583] [DEBUG] [MAIN ] FF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:30.835231] [INFO ] [MAIN ] FF: Generated 1807 derivative records from 25097 primary records. [2025-10-02T22:38:30.836186] [DEBUG] [LOCAL ] FF: Saving derivative data. [2025-10-02T22:38:30.849119] [DEBUG] [LOCAL ] FERG: Derivative data saved (1807 records). [2025-10-02T22:38:30.856208] [INFO ] [MAIN ] FERG: Successfully saved derivative data. [2025-10-02T22:38:30.858769] [INFO ] [MAIN ] Derivative Progress: 665/1975 symbols completed. FERG took 1.3s. Estimated remaining: 9m 15s. Rate: 141.7 symbols/min [2025-10-02T22:38:30.859254] [INFO ] [MAIN ] FFC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:30.856508] [DEBUG] [LOCAL ] FFA: Loaded 5933 existing records from primary storage. [2025-10-02T22:38:30.862700] [INFO ] [MAIN ] FFA: Loaded 5933 primary data records. [2025-10-02T22:38:30.876782] [DEBUG] [LOCAL ] FF: Derivative data saved (1807 records). [2025-10-02T22:38:30.888776] [INFO ] [MAIN ] FF: Successfully saved derivative data. [2025-10-02T22:38:30.907775] [INFO ] [MAIN ] Derivative Progress: 666/1975 symbols completed. FF took 1.2s. Estimated remaining: 9m 13s. Rate: 141.9 symbols/min [2025-10-02T22:38:30.921766] [INFO ] [MAIN ] FFWM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:31.024666] [DEBUG] [LOCAL ] FFC: Loaded 16849 existing records from primary storage. [2025-10-02T22:38:31.050904] [INFO ] [MAIN ] FFC: Loaded 16849 primary data records. [2025-10-02T22:38:31.403828] [DEBUG] [LOCAL ] FFWM: Loaded 36004 existing records from primary storage. [2025-10-02T22:38:31.416392] [INFO ] [MAIN ] FFWM: Loaded 36004 primary data records. [2025-10-02T22:38:31.992147] [DEBUG] [MAIN ] FFA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:31.994216] [INFO ] [MAIN ] FFA: Generated 1807 derivative records from 5933 primary records. [2025-10-02T22:38:31.994532] [DEBUG] [LOCAL ] FFA: Saving derivative data. [2025-10-02T22:38:32.022266] [DEBUG] [LOCAL ] FFA: Derivative data saved (1807 records). [2025-10-02T22:38:32.022628] [INFO ] [MAIN ] FFA: Successfully saved derivative data. [2025-10-02T22:38:32.024963] [INFO ] [MAIN ] Derivative Progress: 667/1975 symbols completed. FFA took 1.2s. Estimated remaining: 9m 14s. Rate: 141.6 symbols/min [2025-10-02T22:38:32.033360] [INFO ] [MAIN ] FG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:32.039796] [DEBUG] [MAIN ] FFC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:32.040911] [INFO ] [MAIN ] FFC: Generated 1807 derivative records from 16849 primary records. [2025-10-02T22:38:32.041012] [DEBUG] [LOCAL ] FFC: Saving derivative data. [2025-10-02T22:38:32.081628] [DEBUG] [MAIN ] FFWM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:32.084056] [INFO ] [MAIN ] FFWM: Generated 1807 derivative records from 36004 primary records. [2025-10-02T22:38:32.084290] [DEBUG] [LOCAL ] FFWM: Saving derivative data. [2025-10-02T22:38:32.083050] [DEBUG] [LOCAL ] FFC: Derivative data saved (1807 records). [2025-10-02T22:38:32.085130] [INFO ] [MAIN ] FFC: Successfully saved derivative data. [2025-10-02T22:38:32.088548] [INFO ] [MAIN ] Derivative Progress: 668/1975 symbols completed. FFC took 1.2s. Estimated remaining: 9m 13s. Rate: 141.8 symbols/min [2025-10-02T22:38:32.089302] [INFO ] [MAIN ] FGN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:32.110917] [DEBUG] [LOCAL ] FG: Loaded 22965 existing records from primary storage. [2025-10-02T22:38:32.117748] [DEBUG] [LOCAL ] FFWM: Derivative data saved (1807 records). [2025-10-02T22:38:32.118299] [INFO ] [MAIN ] FFWM: Successfully saved derivative data. [2025-10-02T22:38:32.122437] [INFO ] [MAIN ] FG: Loaded 22965 primary data records. [2025-10-02T22:38:32.122275] [INFO ] [MAIN ] Derivative Progress: 669/1975 symbols completed. FFWM took 1.2s. Estimated remaining: 9m 12s. Rate: 142.0 symbols/min [2025-10-02T22:38:32.123057] [INFO ] [MAIN ] FHI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:32.144284] [DEBUG] [LOCAL ] FGN: Loaded 3909 existing records from primary storage. [2025-10-02T22:38:32.170165] [INFO ] [MAIN ] FGN: Loaded 3909 primary data records. [2025-10-02T22:38:32.785526] [DEBUG] [LOCAL ] FHI: Loaded 40514 existing records from primary storage. [2025-10-02T22:38:32.919357] [INFO ] [MAIN ] FHI: Loaded 40514 primary data records. [2025-10-02T22:38:33.288704] [DEBUG] [MAIN ] FG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:33.303184] [INFO ] [MAIN ] FG: Generated 1807 derivative records from 22965 primary records. [2025-10-02T22:38:33.303972] [DEBUG] [LOCAL ] FG: Saving derivative data. [2025-10-02T22:38:33.304373] [DEBUG] [MAIN ] FGN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:33.315572] [INFO ] [MAIN ] FGN: Generated 1807 derivative records from 3909 primary records. [2025-10-02T22:38:33.317577] [DEBUG] [LOCAL ] FGN: Saving derivative data. [2025-10-02T22:38:33.339237] [DEBUG] [LOCAL ] FG: Derivative data saved (1807 records). [2025-10-02T22:38:33.341819] [INFO ] [MAIN ] FG: Successfully saved derivative data. [2025-10-02T22:38:33.347303] [DEBUG] [LOCAL ] FGN: Derivative data saved (1807 records). [2025-10-02T22:38:33.347510] [INFO ] [MAIN ] FGN: Successfully saved derivative data. [2025-10-02T22:38:33.345601] [INFO ] [MAIN ] Derivative Progress: 670/1975 symbols completed. FG took 1.3s. Estimated remaining: 9m 13s. Rate: 141.6 symbols/min [2025-10-02T22:38:33.350705] [INFO ] [MAIN ] Derivative Progress: 671/1975 symbols completed. FGN took 1.3s. Estimated remaining: 9m 12s. Rate: 141.8 symbols/min [2025-10-02T22:38:33.350580] [INFO ] [MAIN ] FHN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:33.351984] [INFO ] [MAIN ] FI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:33.369760] [DEBUG] [MAIN ] FHI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:33.370746] [INFO ] [MAIN ] FHI: Generated 1807 derivative records from 40514 primary records. [2025-10-02T22:38:33.370883] [DEBUG] [LOCAL ] FHI: Saving derivative data. [2025-10-02T22:38:33.390683] [DEBUG] [LOCAL ] FHI: Derivative data saved (1807 records). [2025-10-02T22:38:33.390922] [INFO ] [MAIN ] FHI: Successfully saved derivative data. [2025-10-02T22:38:33.394039] [INFO ] [MAIN ] Derivative Progress: 672/1975 symbols completed. FHI took 1.3s. Estimated remaining: 9m 11s. Rate: 142.0 symbols/min [2025-10-02T22:38:33.394314] [INFO ] [MAIN ] FICO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:33.451700] [DEBUG] [LOCAL ] FICO: Loaded 20838 existing records from primary storage. [2025-10-02T22:38:33.452171] [INFO ] [MAIN ] FICO: Loaded 20838 primary data records. [2025-10-02T22:38:33.535686] [DEBUG] [LOCAL ] FI: Loaded 53888 existing records from primary storage. [2025-10-02T22:38:33.541210] [INFO ] [MAIN ] FI: Loaded 53888 primary data records. [2025-10-02T22:38:33.533696] [DEBUG] [LOCAL ] FHN: Loaded 53755 existing records from primary storage. [2025-10-02T22:38:33.560279] [INFO ] [MAIN ] FHN: Loaded 53755 primary data records. [2025-10-02T22:38:34.581053] [DEBUG] [MAIN ] FI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:34.582964] [INFO ] [MAIN ] FI: Generated 1807 derivative records from 53888 primary records. [2025-10-02T22:38:34.583142] [DEBUG] [LOCAL ] FI: Saving derivative data. [2025-10-02T22:38:34.615366] [DEBUG] [MAIN ] FICO: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-02T22:38:34.630452] [DEBUG] [MAIN ] FHN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:34.632040] [INFO ] [MAIN ] FICO: Generated 1806 derivative records from 20838 primary records. [2025-10-02T22:38:34.633504] [DEBUG] [LOCAL ] FICO: Saving derivative data. [2025-10-02T22:38:34.634477] [INFO ] [MAIN ] FHN: Generated 1807 derivative records from 53755 primary records. [2025-10-02T22:38:34.635254] [DEBUG] [LOCAL ] FHN: Saving derivative data. [2025-10-02T22:38:34.635720] [DEBUG] [LOCAL ] FI: Derivative data saved (1807 records). [2025-10-02T22:38:34.645316] [INFO ] [MAIN ] FI: Successfully saved derivative data. [2025-10-02T22:38:34.653356] [INFO ] [MAIN ] Derivative Progress: 673/1975 symbols completed. FI took 1.3s. Estimated remaining: 9m 12s. Rate: 141.5 symbols/min [2025-10-02T22:38:34.673436] [DEBUG] [LOCAL ] FICO: Derivative data saved (1806 records). [2025-10-02T22:38:34.674840] [INFO ] [MAIN ] FICO: Successfully saved derivative data. [2025-10-02T22:38:34.679103] [INFO ] [MAIN ] Derivative Progress: 674/1975 symbols completed. FICO took 1.3s. Estimated remaining: 9m 11s. Rate: 141.7 symbols/min [2025-10-02T22:38:34.676580] [DEBUG] [LOCAL ] FHN: Derivative data saved (1807 records). [2025-10-02T22:38:34.679522] [INFO ] [MAIN ] FHN: Successfully saved derivative data. [2025-10-02T22:38:34.682020] [INFO ] [MAIN ] Derivative Progress: 675/1975 symbols completed. FHN took 1.3s. Estimated remaining: 9m 10s. Rate: 141.9 symbols/min [2025-10-02T22:38:34.682539] [INFO ] [MAIN ] FIGS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:34.682622] [INFO ] [MAIN ] FIHL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:34.682887] [INFO ] [MAIN ] FINS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:34.698018] [DEBUG] [LOCAL ] FINS: Loaded 8316 existing records from primary storage. [2025-10-02T22:38:34.698256] [INFO ] [MAIN ] FINS: Loaded 8316 primary data records. [2025-10-02T22:38:34.930301] [DEBUG] [LOCAL ] FIHL: Loaded 40141 existing records from primary storage. [2025-10-02T22:38:35.066689] [INFO ] [MAIN ] FIHL: Loaded 40141 primary data records. [2025-10-02T22:38:35.067577] [DEBUG] [LOCAL ] FIGS: Loaded 49208 existing records from primary storage. [2025-10-02T22:38:35.068196] [INFO ] [MAIN ] FIGS: Loaded 49208 primary data records. [2025-10-02T22:38:35.828150] [DEBUG] [MAIN ] FINS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:35.831309] [INFO ] [MAIN ] FINS: Generated 1807 derivative records from 8316 primary records. [2025-10-02T22:38:35.831553] [DEBUG] [LOCAL ] FINS: Saving derivative data. [2025-10-02T22:38:35.856395] [DEBUG] [LOCAL ] FINS: Derivative data saved (1807 records). [2025-10-02T22:38:35.857189] [INFO ] [MAIN ] FINS: Successfully saved derivative data. [2025-10-02T22:38:35.859683] [INFO ] [MAIN ] Derivative Progress: 676/1975 symbols completed. FINS took 1.2s. Estimated remaining: 9m 11s. Rate: 141.6 symbols/min [2025-10-02T22:38:35.860195] [INFO ] [MAIN ] FINV: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:35.898203] [DEBUG] [MAIN ] FIHL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:35.899807] [INFO ] [MAIN ] FIHL: Generated 1807 derivative records from 40141 primary records. [2025-10-02T22:38:35.898626] [DEBUG] [MAIN ] FIGS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:35.900073] [DEBUG] [LOCAL ] FIHL: Saving derivative data. [2025-10-02T22:38:35.902084] [INFO ] [MAIN ] FIGS: Generated 1807 derivative records from 49208 primary records. [2025-10-02T22:38:35.910469] [DEBUG] [LOCAL ] FIGS: Saving derivative data. [2025-10-02T22:38:35.920852] [DEBUG] [LOCAL ] FIHL: Derivative data saved (1807 records). [2025-10-02T22:38:35.928073] [INFO ] [MAIN ] FIHL: Successfully saved derivative data. [2025-10-02T22:38:35.932608] [INFO ] [MAIN ] Derivative Progress: 677/1975 symbols completed. FIHL took 1.2s. Estimated remaining: 9m 9s. Rate: 141.7 symbols/min [2025-10-02T22:38:35.936447] [INFO ] [MAIN ] FIS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:35.952007] [DEBUG] [LOCAL ] FIGS: Derivative data saved (1807 records). [2025-10-02T22:38:35.952162] [INFO ] [MAIN ] FIGS: Successfully saved derivative data. [2025-10-02T22:38:35.954785] [INFO ] [MAIN ] Derivative Progress: 678/1975 symbols completed. FIGS took 1.3s. Estimated remaining: 9m 8s. Rate: 141.9 symbols/min [2025-10-02T22:38:35.955234] [INFO ] [MAIN ] FIX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:35.971679] [DEBUG] [LOCAL ] FINV: Loaded 45625 existing records from primary storage. [2025-10-02T22:38:35.971916] [INFO ] [MAIN ] FINV: Loaded 45625 primary data records. [2025-10-02T22:38:36.358616] [DEBUG] [LOCAL ] FIS: Loaded 53751 existing records from primary storage. [2025-10-02T22:38:36.359678] [INFO ] [MAIN ] FIS: Loaded 53751 primary data records. [2025-10-02T22:38:36.360142] [DEBUG] [LOCAL ] FIX: Loaded 29974 existing records from primary storage. [2025-10-02T22:38:36.360559] [INFO ] [MAIN ] FIX: Loaded 29974 primary data records. [2025-10-02T22:38:37.064166] [DEBUG] [MAIN ] FINV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:37.065259] [INFO ] [MAIN ] FINV: Generated 1807 derivative records from 45625 primary records. [2025-10-02T22:38:37.065625] [DEBUG] [LOCAL ] FINV: Saving derivative data. [2025-10-02T22:38:37.086523] [DEBUG] [LOCAL ] FINV: Derivative data saved (1807 records). [2025-10-02T22:38:37.086843] [INFO ] [MAIN ] FINV: Successfully saved derivative data. [2025-10-02T22:38:37.090448] [INFO ] [MAIN ] Derivative Progress: 679/1975 symbols completed. FINV took 1.2s. Estimated remaining: 9m 9s. Rate: 141.6 symbols/min [2025-10-02T22:38:37.090843] [INFO ] [MAIN ] FLC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:37.109467] [DEBUG] [MAIN ] FIS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:37.112249] [INFO ] [MAIN ] FIS: Generated 1807 derivative records from 53751 primary records. [2025-10-02T22:38:37.112515] [DEBUG] [LOCAL ] FIS: Saving derivative data. [2025-10-02T22:38:37.128754] [DEBUG] [LOCAL ] FLC: Loaded 5441 existing records from primary storage. [2025-10-02T22:38:37.131886] [INFO ] [MAIN ] FLC: Loaded 5441 primary data records. [2025-10-02T22:38:37.170082] [DEBUG] [LOCAL ] FIS: Derivative data saved (1807 records). [2025-10-02T22:38:37.177204] [INFO ] [MAIN ] FIS: Successfully saved derivative data. [2025-10-02T22:38:37.192125] [INFO ] [MAIN ] Derivative Progress: 680/1975 symbols completed. FIS took 1.3s. Estimated remaining: 9m 8s. Rate: 141.7 symbols/min [2025-10-02T22:38:37.211458] [INFO ] [MAIN ] FLG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:37.188971] [DEBUG] [MAIN ] FIX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:37.239242] [INFO ] [MAIN ] FIX: Generated 1807 derivative records from 29974 primary records. [2025-10-02T22:38:37.262188] [DEBUG] [LOCAL ] FIX: Saving derivative data. [2025-10-02T22:38:37.354845] [DEBUG] [LOCAL ] FIX: Derivative data saved (1807 records). [2025-10-02T22:38:37.377566] [INFO ] [MAIN ] FIX: Successfully saved derivative data. [2025-10-02T22:38:37.505044] [INFO ] [MAIN ] Derivative Progress: 681/1975 symbols completed. FIX took 1.5s. Estimated remaining: 9m 8s. Rate: 141.8 symbols/min [2025-10-02T22:38:37.516881] [INFO ] [MAIN ] FLNG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:37.566495] [DEBUG] [LOCAL ] FLG: Loaded 53710 existing records from primary storage. [2025-10-02T22:38:37.578760] [INFO ] [MAIN ] FLG: Loaded 53710 primary data records. [2025-10-02T22:38:37.718847] [DEBUG] [LOCAL ] FLNG: Loaded 33928 existing records from primary storage. [2025-10-02T22:38:37.719813] [INFO ] [MAIN ] FLNG: Loaded 33928 primary data records. [2025-10-02T22:38:37.857307] [DEBUG] [MAIN ] FLC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:37.908992] [INFO ] [MAIN ] FLC: Generated 1807 derivative records from 5441 primary records. [2025-10-02T22:38:37.928012] [DEBUG] [LOCAL ] FLC: Saving derivative data. [2025-10-02T22:38:38.354943] [DEBUG] [LOCAL ] FLC: Derivative data saved (1807 records). [2025-10-02T22:38:38.364448] [INFO ] [MAIN ] FLC: Successfully saved derivative data. [2025-10-02T22:38:38.368142] [INFO ] [MAIN ] Derivative Progress: 682/1975 symbols completed. FLC took 1.3s. Estimated remaining: 9m 8s. Rate: 141.6 symbols/min [2025-10-02T22:38:38.368508] [INFO ] [MAIN ] FLO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:38.400321] [DEBUG] [MAIN ] FLG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:38.401685] [INFO ] [MAIN ] FLG: Generated 1807 derivative records from 53710 primary records. [2025-10-02T22:38:38.402750] [DEBUG] [LOCAL ] FLG: Saving derivative data. [2025-10-02T22:38:38.432341] [DEBUG] [MAIN ] FLNG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:38.434253] [INFO ] [MAIN ] FLNG: Generated 1807 derivative records from 33928 primary records. [2025-10-02T22:38:38.434862] [DEBUG] [LOCAL ] FLNG: Saving derivative data. [2025-10-02T22:38:38.452209] [DEBUG] [LOCAL ] FLG: Derivative data saved (1807 records). [2025-10-02T22:38:38.452406] [INFO ] [MAIN ] FLG: Successfully saved derivative data. [2025-10-02T22:38:38.455492] [INFO ] [MAIN ] Derivative Progress: 683/1975 symbols completed. FLG took 1.2s. Estimated remaining: 9m 7s. Rate: 141.8 symbols/min [2025-10-02T22:38:38.456538] [INFO ] [MAIN ] FLR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:38.495036] [DEBUG] [LOCAL ] FLNG: Derivative data saved (1807 records). [2025-10-02T22:38:38.497540] [INFO ] [MAIN ] FLNG: Successfully saved derivative data. [2025-10-02T22:38:38.500682] [INFO ] [MAIN ] Derivative Progress: 684/1975 symbols completed. FLNG took 1.0s. Estimated remaining: 9m 6s. Rate: 141.9 symbols/min [2025-10-02T22:38:38.497353] [DEBUG] [LOCAL ] FLO: Loaded 52293 existing records from primary storage. [2025-10-02T22:38:38.501065] [INFO ] [MAIN ] FLS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:38.501549] [INFO ] [MAIN ] FLO: Loaded 52293 primary data records. [2025-10-02T22:38:38.868524] [DEBUG] [LOCAL ] FLR: Loaded 53509 existing records from primary storage. [2025-10-02T22:38:38.868965] [INFO ] [MAIN ] FLR: Loaded 53509 primary data records. [2025-10-02T22:38:38.999268] [DEBUG] [LOCAL ] FLS: Loaded 50554 existing records from primary storage. [2025-10-02T22:38:39.005506] [INFO ] [MAIN ] FLS: Loaded 50554 primary data records. [2025-10-02T22:38:39.604552] [DEBUG] [MAIN ] FLO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:39.605938] [INFO ] [MAIN ] FLO: Generated 1807 derivative records from 52293 primary records. [2025-10-02T22:38:39.606388] [DEBUG] [LOCAL ] FLO: Saving derivative data. [2025-10-02T22:38:39.627867] [DEBUG] [LOCAL ] FLO: Derivative data saved (1807 records). [2025-10-02T22:38:39.628572] [INFO ] [MAIN ] FLO: Successfully saved derivative data. [2025-10-02T22:38:39.631854] [INFO ] [MAIN ] Derivative Progress: 685/1975 symbols completed. FLO took 1.3s. Estimated remaining: 9m 7s. Rate: 141.6 symbols/min [2025-10-02T22:38:39.635211] [INFO ] [MAIN ] FLUT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:39.653385] [DEBUG] [MAIN ] FLR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:39.654676] [INFO ] [MAIN ] FLR: Generated 1807 derivative records from 53509 primary records. [2025-10-02T22:38:39.655079] [DEBUG] [LOCAL ] FLR: Saving derivative data. [2025-10-02T22:38:39.677285] [DEBUG] [LOCAL ] FLR: Derivative data saved (1807 records). [2025-10-02T22:38:39.680319] [INFO ] [MAIN ] FLR: Successfully saved derivative data. [2025-10-02T22:38:39.683947] [INFO ] [MAIN ] Derivative Progress: 686/1975 symbols completed. FLR took 1.2s. Estimated remaining: 9m 6s. Rate: 141.8 symbols/min [2025-10-02T22:38:39.685200] [INFO ] [MAIN ] FLXR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:39.700761] [DEBUG] [MAIN ] FLS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:39.701756] [INFO ] [MAIN ] FLS: Generated 1807 derivative records from 50554 primary records. [2025-10-02T22:38:39.702062] [DEBUG] [LOCAL ] FLS: Saving derivative data. [2025-10-02T22:38:39.742414] [DEBUG] [LOCAL ] FLS: Derivative data saved (1807 records). [2025-10-02T22:38:39.757752] [INFO ] [MAIN ] FLS: Successfully saved derivative data. [2025-10-02T22:38:39.761511] [INFO ] [MAIN ] Derivative Progress: 687/1975 symbols completed. FLS took 1.3s. Estimated remaining: 9m 4s. Rate: 141.9 symbols/min [2025-10-02T22:38:39.769205] [INFO ] [MAIN ] FMC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:39.769945] [DEBUG] [LOCAL ] FLXR: Loaded 20621 existing records from primary storage. [2025-10-02T22:38:39.772144] [DEBUG] [LOCAL ] FLUT: Loaded 51173 existing records from primary storage. [2025-10-02T22:38:39.772519] [INFO ] [MAIN ] FLUT: Loaded 51173 primary data records. [2025-10-02T22:38:39.772248] [INFO ] [MAIN ] FLXR: Loaded 20621 primary data records. [2025-10-02T22:38:40.540894] [DEBUG] [LOCAL ] FMC: Loaded 52171 existing records from primary storage. [2025-10-02T22:38:40.541133] [INFO ] [MAIN ] FMC: Loaded 52171 primary data records. [2025-10-02T22:38:40.901159] [DEBUG] [MAIN ] FLUT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:40.910752] [INFO ] [MAIN ] FLUT: Generated 1807 derivative records from 51173 primary records. [2025-10-02T22:38:40.917391] [DEBUG] [LOCAL ] FLUT: Saving derivative data. [2025-10-02T22:38:40.932063] [DEBUG] [MAIN ] FLXR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:40.939943] [INFO ] [MAIN ] FLXR: Generated 1807 derivative records from 20621 primary records. [2025-10-02T22:38:40.946270] [DEBUG] [LOCAL ] FLXR: Saving derivative data. [2025-10-02T22:38:40.949131] [DEBUG] [LOCAL ] FLUT: Derivative data saved (1807 records). [2025-10-02T22:38:40.949973] [INFO ] [MAIN ] FLUT: Successfully saved derivative data. [2025-10-02T22:38:40.953205] [INFO ] [MAIN ] Derivative Progress: 688/1975 symbols completed. FLUT took 1.3s. Estimated remaining: 9m 5s. Rate: 141.6 symbols/min [2025-10-02T22:38:40.971283] [DEBUG] [LOCAL ] FLXR: Derivative data saved (1807 records). [2025-10-02T22:38:40.971832] [INFO ] [MAIN ] FLXR: Successfully saved derivative data. [2025-10-02T22:38:40.975424] [INFO ] [MAIN ] Derivative Progress: 689/1975 symbols completed. FLXR took 1.3s. Estimated remaining: 9m 4s. Rate: 141.8 symbols/min [2025-10-02T22:38:40.992546] [DEBUG] [MAIN ] FMC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:40.993392] [INFO ] [MAIN ] FMC: Generated 1807 derivative records from 52171 primary records. [2025-10-02T22:38:40.993461] [DEBUG] [LOCAL ] FMC: Saving derivative data. [2025-10-02T22:38:41.010268] [DEBUG] [LOCAL ] FMC: Derivative data saved (1807 records). [2025-10-02T22:38:41.010375] [INFO ] [MAIN ] FMC: Successfully saved derivative data. [2025-10-02T22:38:41.013373] [INFO ] [MAIN ] Derivative Progress: 690/1975 symbols completed. FMC took 1.2s. Estimated remaining: 9m 3s. Rate: 141.9 symbols/min [2025-10-02T22:38:41.014234] [INFO ] [MAIN ] FMN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:41.014510] [INFO ] [MAIN ] FMS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:41.014369] [INFO ] [MAIN ] FMX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:41.027601] [DEBUG] [LOCAL ] FMN: Loaded 5624 existing records from primary storage. [2025-10-02T22:38:41.027870] [INFO ] [MAIN ] FMN: Loaded 5624 primary data records. [2025-10-02T22:38:41.312368] [DEBUG] [LOCAL ] FMS: Loaded 30247 existing records from primary storage. [2025-10-02T22:38:41.414707] [DEBUG] [LOCAL ] FMX: Loaded 40981 existing records from primary storage. [2025-10-02T22:38:41.403231] [INFO ] [MAIN ] FMS: Loaded 30247 primary data records. [2025-10-02T22:38:41.416344] [INFO ] [MAIN ] FMX: Loaded 40981 primary data records. [2025-10-02T22:38:42.097493] [DEBUG] [MAIN ] FMN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:42.099103] [INFO ] [MAIN ] FMN: Generated 1807 derivative records from 5624 primary records. [2025-10-02T22:38:42.099574] [DEBUG] [LOCAL ] FMN: Saving derivative data. [2025-10-02T22:38:42.118703] [DEBUG] [LOCAL ] FMN: Derivative data saved (1807 records). [2025-10-02T22:38:42.119378] [INFO ] [MAIN ] FMN: Successfully saved derivative data. [2025-10-02T22:38:42.122748] [INFO ] [MAIN ] Derivative Progress: 691/1975 symbols completed. FMN took 1.1s. Estimated remaining: 9m 4s. Rate: 141.6 symbols/min [2025-10-02T22:38:42.123488] [INFO ] [MAIN ] FMY: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:42.156251] [DEBUG] [LOCAL ] FMY: Loaded 1399 existing records from primary storage. [2025-10-02T22:38:42.162993] [DEBUG] [MAIN ] FMS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:42.163374] [INFO ] [MAIN ] FMY: Loaded 1399 primary data records. [2025-10-02T22:38:42.164011] [DEBUG] [MAIN ] FMX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:42.177819] [INFO ] [MAIN ] FMS: Generated 1807 derivative records from 30247 primary records. [2025-10-02T22:38:42.215525] [DEBUG] [LOCAL ] FMS: Saving derivative data. [2025-10-02T22:38:42.216860] [INFO ] [MAIN ] FMX: Generated 1807 derivative records from 40981 primary records. [2025-10-02T22:38:42.223745] [DEBUG] [LOCAL ] FMX: Saving derivative data. [2025-10-02T22:38:42.349064] [DEBUG] [LOCAL ] FMS: Derivative data saved (1807 records). [2025-10-02T22:38:42.383225] [INFO ] [MAIN ] FMS: Successfully saved derivative data. [2025-10-02T22:38:42.408553] [INFO ] [MAIN ] Derivative Progress: 692/1975 symbols completed. FMS took 1.4s. Estimated remaining: 9m 3s. Rate: 141.7 symbols/min [2025-10-02T22:38:42.585356] [INFO ] [MAIN ] FN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:42.594721] [DEBUG] [LOCAL ] FMX: Derivative data saved (1807 records). [2025-10-02T22:38:42.595052] [INFO ] [MAIN ] FMX: Successfully saved derivative data. [2025-10-02T22:38:42.597765] [INFO ] [MAIN ] Derivative Progress: 693/1975 symbols completed. FMX took 1.6s. Estimated remaining: 9m 2s. Rate: 141.8 symbols/min [2025-10-02T22:38:42.598174] [INFO ] [MAIN ] FNB: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:42.630154] [DEBUG] [MAIN ] FMY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:42.641332] [INFO ] [MAIN ] FMY: Generated 1807 derivative records from 1399 primary records. [2025-10-02T22:38:42.641667] [DEBUG] [LOCAL ] FMY: Saving derivative data. [2025-10-02T22:38:42.693405] [DEBUG] [LOCAL ] FMY: Derivative data saved (1807 records). [2025-10-02T22:38:42.693919] [INFO ] [MAIN ] FMY: Successfully saved derivative data. [2025-10-02T22:38:42.693225] [DEBUG] [LOCAL ] FN: Loaded 38785 existing records from primary storage. [2025-10-02T22:38:42.697996] [INFO ] [MAIN ] FN: Loaded 38785 primary data records. [2025-10-02T22:38:42.697665] [INFO ] [MAIN ] Derivative Progress: 694/1975 symbols completed. FMY took 0.6s. Estimated remaining: 9m 1s. Rate: 142.0 symbols/min [2025-10-02T22:38:42.698826] [INFO ] [MAIN ] FND: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:42.831410] [DEBUG] [LOCAL ] FNB: Loaded 52848 existing records from primary storage. [2025-10-02T22:38:42.859209] [INFO ] [MAIN ] FNB: Loaded 52848 primary data records. [2025-10-02T22:38:43.236131] [DEBUG] [LOCAL ] FND: Loaded 52478 existing records from primary storage. [2025-10-02T22:38:43.254463] [INFO ] [MAIN ] FND: Loaded 52478 primary data records. [2025-10-02T22:38:43.772674] [DEBUG] [MAIN ] FN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:43.774275] [INFO ] [MAIN ] FN: Generated 1807 derivative records from 38785 primary records. [2025-10-02T22:38:43.774631] [DEBUG] [LOCAL ] FN: Saving derivative data. [2025-10-02T22:38:43.795144] [DEBUG] [LOCAL ] FN: Derivative data saved (1807 records). [2025-10-02T22:38:43.795912] [INFO ] [MAIN ] FN: Successfully saved derivative data. [2025-10-02T22:38:43.798757] [INFO ] [MAIN ] Derivative Progress: 695/1975 symbols completed. FN took 1.2s. Estimated remaining: 9m 2s. Rate: 141.6 symbols/min [2025-10-02T22:38:43.799136] [INFO ] [MAIN ] FNF: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:43.817167] [DEBUG] [MAIN ] FNB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:43.818251] [INFO ] [MAIN ] FNB: Generated 1807 derivative records from 52848 primary records. [2025-10-02T22:38:43.818512] [DEBUG] [LOCAL ] FNB: Saving derivative data. [2025-10-02T22:38:43.839220] [DEBUG] [LOCAL ] FNB: Derivative data saved (1807 records). [2025-10-02T22:38:43.839439] [INFO ] [MAIN ] FNB: Successfully saved derivative data. [2025-10-02T22:38:43.854784] [INFO ] [MAIN ] Derivative Progress: 696/1975 symbols completed. FNB took 1.3s. Estimated remaining: 9m 1s. Rate: 141.8 symbols/min [2025-10-02T22:38:43.855138] [INFO ] [MAIN ] FNV: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:43.857383] [DEBUG] [MAIN ] FND: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:43.858550] [INFO ] [MAIN ] FND: Generated 1807 derivative records from 52478 primary records. [2025-10-02T22:38:43.858797] [DEBUG] [LOCAL ] FND: Saving derivative data. [2025-10-02T22:38:43.889182] [DEBUG] [LOCAL ] FND: Derivative data saved (1807 records). [2025-10-02T22:38:43.889404] [INFO ] [MAIN ] FND: Successfully saved derivative data. [2025-10-02T22:38:43.892938] [INFO ] [MAIN ] Derivative Progress: 697/1975 symbols completed. FND took 1.2s. Estimated remaining: 9m 0s. Rate: 142.0 symbols/min [2025-10-02T22:38:43.893322] [INFO ] [MAIN ] FOA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:43.930696] [DEBUG] [LOCAL ] FNF: Loaded 49364 existing records from primary storage. [2025-10-02T22:38:43.931082] [INFO ] [MAIN ] FNF: Loaded 49364 primary data records. [2025-10-02T22:38:44.011312] [DEBUG] [LOCAL ] FOA: Loaded 13189 existing records from primary storage. [2025-10-02T22:38:44.051624] [INFO ] [MAIN ] FOA: Loaded 13189 primary data records. [2025-10-02T22:38:44.099977] [DEBUG] [LOCAL ] FNV: Loaded 46489 existing records from primary storage. [2025-10-02T22:38:44.127245] [INFO ] [MAIN ] FNV: Loaded 46489 primary data records. [2025-10-02T22:38:45.124835] [DEBUG] [MAIN ] FNF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:45.126832] [INFO ] [MAIN ] FNF: Generated 1807 derivative records from 49364 primary records. [2025-10-02T22:38:45.127005] [DEBUG] [LOCAL ] FNF: Saving derivative data. [2025-10-02T22:38:45.158565] [DEBUG] [MAIN ] FOA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:45.160066] [INFO ] [MAIN ] FOA: Generated 1807 derivative records from 13189 primary records. [2025-10-02T22:38:45.160543] [DEBUG] [LOCAL ] FOA: Saving derivative data. [2025-10-02T22:38:45.185440] [DEBUG] [MAIN ] FNV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:45.192790] [INFO ] [MAIN ] FNV: Generated 1807 derivative records from 46489 primary records. [2025-10-02T22:38:45.193242] [DEBUG] [LOCAL ] FNV: Saving derivative data. [2025-10-02T22:38:45.196484] [DEBUG] [LOCAL ] FNF: Derivative data saved (1807 records). [2025-10-02T22:38:45.216862] [DEBUG] [LOCAL ] FNV: Derivative data saved (1807 records). [2025-10-02T22:38:45.218528] [INFO ] [MAIN ] FNV: Successfully saved derivative data. [2025-10-02T22:38:45.217631] [INFO ] [MAIN ] FNF: Successfully saved derivative data. [2025-10-02T22:38:45.221459] [INFO ] [MAIN ] Derivative Progress: 698/1975 symbols completed. FNF took 1.4s. Estimated remaining: 9m 1s. Rate: 141.6 symbols/min [2025-10-02T22:38:45.225271] [INFO ] [MAIN ] FOF: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:45.225716] [INFO ] [MAIN ] Derivative Progress: 699/1975 symbols completed. FNV took 1.4s. Estimated remaining: 9m 0s. Rate: 141.8 symbols/min [2025-10-02T22:38:45.226714] [DEBUG] [LOCAL ] FOA: Derivative data saved (1807 records). [2025-10-02T22:38:45.226887] [INFO ] [MAIN ] FOA: Successfully saved derivative data. [2025-10-02T22:38:45.230182] [INFO ] [MAIN ] FOR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:45.231275] [INFO ] [MAIN ] Derivative Progress: 700/1975 symbols completed. FOA took 1.3s. Estimated remaining: 8m 59s. Rate: 142.0 symbols/min [2025-10-02T22:38:45.231771] [INFO ] [MAIN ] FOUR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:45.246793] [DEBUG] [LOCAL ] FOF: Loaded 8487 existing records from primary storage. [2025-10-02T22:38:45.247127] [INFO ] [MAIN ] FOF: Loaded 8487 primary data records. [2025-10-02T22:38:45.363828] [DEBUG] [LOCAL ] FOR: Loaded 19927 existing records from primary storage. [2025-10-02T22:38:45.405399] [INFO ] [MAIN ] FOR: Loaded 19927 primary data records. [2025-10-02T22:38:45.796249] [DEBUG] [LOCAL ] FOUR: Loaded 49921 existing records from primary storage. [2025-10-02T22:38:45.844801] [INFO ] [MAIN ] FOUR: Loaded 49921 primary data records. [2025-10-02T22:38:46.331806] [DEBUG] [MAIN ] FOF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:46.333896] [INFO ] [MAIN ] FOF: Generated 1807 derivative records from 8487 primary records. [2025-10-02T22:38:46.334526] [DEBUG] [LOCAL ] FOF: Saving derivative data. [2025-10-02T22:38:46.374761] [DEBUG] [MAIN ] FOR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:46.376839] [INFO ] [MAIN ] FOR: Generated 1807 derivative records from 19927 primary records. [2025-10-02T22:38:46.375936] [DEBUG] [LOCAL ] FOF: Derivative data saved (1807 records). [2025-10-02T22:38:46.377208] [DEBUG] [LOCAL ] FOR: Saving derivative data. [2025-10-02T22:38:46.377336] [INFO ] [MAIN ] FOF: Successfully saved derivative data. [2025-10-02T22:38:46.379526] [INFO ] [MAIN ] Derivative Progress: 701/1975 symbols completed. FOF took 1.2s. Estimated remaining: 8m 60s. Rate: 141.6 symbols/min [2025-10-02T22:38:46.380885] [INFO ] [MAIN ] FPF: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:46.409559] [DEBUG] [LOCAL ] FOR: Derivative data saved (1807 records). [2025-10-02T22:38:46.417840] [INFO ] [MAIN ] FOR: Successfully saved derivative data. [2025-10-02T22:38:46.426126] [DEBUG] [MAIN ] FOUR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:46.427060] [INFO ] [MAIN ] FOUR: Generated 1807 derivative records from 49921 primary records. [2025-10-02T22:38:46.427277] [DEBUG] [LOCAL ] FOUR: Saving derivative data. [2025-10-02T22:38:46.425726] [INFO ] [MAIN ] Derivative Progress: 702/1975 symbols completed. FOR took 1.2s. Estimated remaining: 8m 59s. Rate: 141.8 symbols/min [2025-10-02T22:38:46.427609] [INFO ] [MAIN ] FPH: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:46.436129] [DEBUG] [LOCAL ] FPF: Loaded 18405 existing records from primary storage. [2025-10-02T22:38:46.444515] [INFO ] [MAIN ] FPF: Loaded 18405 primary data records. [2025-10-02T22:38:46.495449] [DEBUG] [LOCAL ] FOUR: Derivative data saved (1807 records). [2025-10-02T22:38:46.509444] [INFO ] [MAIN ] FOUR: Successfully saved derivative data. [2025-10-02T22:38:46.529535] [INFO ] [MAIN ] Derivative Progress: 703/1975 symbols completed. FOUR took 1.3s. Estimated remaining: 8m 58s. Rate: 141.9 symbols/min [2025-10-02T22:38:46.615725] [DEBUG] [LOCAL ] FPH: Loaded 19546 existing records from primary storage. [2025-10-02T22:38:46.626253] [INFO ] [MAIN ] FPH: Loaded 19546 primary data records. [2025-10-02T22:38:47.200884] [DEBUG] [MAIN ] FPF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:47.201919] [INFO ] [MAIN ] FPF: Generated 1807 derivative records from 18405 primary records. [2025-10-02T22:38:47.202307] [DEBUG] [LOCAL ] FPF: Saving derivative data. [2025-10-02T22:38:47.235319] [DEBUG] [MAIN ] FPH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:47.236485] [INFO ] [MAIN ] FPH: Generated 1807 derivative records from 19546 primary records. [2025-10-02T22:38:47.236568] [DEBUG] [LOCAL ] FPH: Saving derivative data. [2025-10-02T22:38:47.247476] [DEBUG] [LOCAL ] FPF: Derivative data saved (1807 records). [2025-10-02T22:38:47.251286] [INFO ] [MAIN ] FPF: Successfully saved derivative data. [2025-10-02T22:38:47.254090] [INFO ] [MAIN ] Derivative Progress: 704/1975 symbols completed. FPF took 0.9s. Estimated remaining: 8m 58s. Rate: 141.8 symbols/min [2025-10-02T22:38:47.257939] [DEBUG] [LOCAL ] FPH: Derivative data saved (1807 records). [2025-10-02T22:38:47.258076] [INFO ] [MAIN ] FPH: Successfully saved derivative data. [2025-10-02T22:38:47.260249] [INFO ] [MAIN ] Derivative Progress: 705/1975 symbols completed. FPH took 0.8s. Estimated remaining: 8m 57s. Rate: 142.0 symbols/min [2025-10-02T22:38:47.260725] [INFO ] [MAIN ] FRA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:47.260636] [INFO ] [MAIN ] FPI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:47.260835] [INFO ] [MAIN ] FR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:47.287912] [DEBUG] [LOCAL ] FRA: Loaded 14628 existing records from primary storage. [2025-10-02T22:38:47.288182] [INFO ] [MAIN ] FRA: Loaded 14628 primary data records. [2025-10-02T22:38:47.420881] [DEBUG] [LOCAL ] FPI: Loaded 31264 existing records from primary storage. [2025-10-02T22:38:47.431999] [INFO ] [MAIN ] FPI: Loaded 31264 primary data records. [2025-10-02T22:38:47.781340] [DEBUG] [LOCAL ] FR: Loaded 46743 existing records from primary storage. [2025-10-02T22:38:47.799227] [INFO ] [MAIN ] FR: Loaded 46743 primary data records. [2025-10-02T22:38:48.213596] [DEBUG] [MAIN ] FRA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:48.368003] [INFO ] [MAIN ] FRA: Generated 1807 derivative records from 14628 primary records. [2025-10-02T22:38:48.382965] [DEBUG] [LOCAL ] FRA: Saving derivative data. [2025-10-02T22:38:48.422081] [DEBUG] [LOCAL ] FRA: Derivative data saved (1807 records). [2025-10-02T22:38:48.422327] [INFO ] [MAIN ] FRA: Successfully saved derivative data. [2025-10-02T22:38:48.425751] [INFO ] [MAIN ] Derivative Progress: 706/1975 symbols completed. FRA took 1.2s. Estimated remaining: 8m 58s. Rate: 141.6 symbols/min [2025-10-02T22:38:48.422639] [DEBUG] [MAIN ] FPI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:48.426813] [INFO ] [MAIN ] FRGE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:48.428043] [INFO ] [MAIN ] FPI: Generated 1807 derivative records from 31264 primary records. [2025-10-02T22:38:48.428182] [DEBUG] [LOCAL ] FPI: Saving derivative data. [2025-10-02T22:38:48.454289] [DEBUG] [LOCAL ] FPI: Derivative data saved (1807 records). [2025-10-02T22:38:48.456432] [INFO ] [MAIN ] FPI: Successfully saved derivative data. [2025-10-02T22:38:48.465057] [INFO ] [MAIN ] Derivative Progress: 707/1975 symbols completed. FPI took 1.2s. Estimated remaining: 8m 56s. Rate: 141.8 symbols/min [2025-10-02T22:38:48.479118] [INFO ] [MAIN ] FRO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:48.466026] [DEBUG] [LOCAL ] FRGE: Loaded 17758 existing records from primary storage. [2025-10-02T22:38:48.479740] [INFO ] [MAIN ] FRGE: Loaded 17758 primary data records. [2025-10-02T22:38:48.480515] [DEBUG] [MAIN ] FR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:48.481406] [INFO ] [MAIN ] FR: Generated 1807 derivative records from 46743 primary records. [2025-10-02T22:38:48.486799] [DEBUG] [LOCAL ] FR: Saving derivative data. [2025-10-02T22:38:48.630788] [DEBUG] [LOCAL ] FR: Derivative data saved (1807 records). [2025-10-02T22:38:48.702591] [INFO ] [MAIN ] FR: Successfully saved derivative data. [2025-10-02T22:38:48.824359] [INFO ] [MAIN ] Derivative Progress: 708/1975 symbols completed. FR took 1.6s. Estimated remaining: 8m 56s. Rate: 141.9 symbols/min [2025-10-02T22:38:48.839174] [INFO ] [MAIN ] FSCO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:48.864974] [DEBUG] [LOCAL ] FRO: Loaded 52117 existing records from primary storage. [2025-10-02T22:38:48.866322] [INFO ] [MAIN ] FRO: Loaded 52117 primary data records. [2025-10-02T22:38:49.012089] [DEBUG] [LOCAL ] FSCO: Loaded 37913 existing records from primary storage. [2025-10-02T22:38:49.033591] [INFO ] [MAIN ] FSCO: Loaded 37913 primary data records. [2025-10-02T22:38:49.105800] [DEBUG] [MAIN ] FRGE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:49.258627] [INFO ] [MAIN ] FRGE: Generated 1807 derivative records from 17758 primary records. [2025-10-02T22:38:49.302231] [DEBUG] [LOCAL ] FRGE: Saving derivative data. [2025-10-02T22:38:49.496379] [DEBUG] [LOCAL ] FRGE: Derivative data saved (1807 records). [2025-10-02T22:38:49.616902] [INFO ] [MAIN ] FRGE: Successfully saved derivative data. [2025-10-02T22:38:49.636160] [INFO ] [MAIN ] Derivative Progress: 709/1975 symbols completed. FRGE took 1.2s. Estimated remaining: 8m 56s. Rate: 141.7 symbols/min [2025-10-02T22:38:49.636701] [INFO ] [MAIN ] FSK: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:49.665623] [DEBUG] [MAIN ] FRO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:49.679208] [INFO ] [MAIN ] FRO: Generated 1807 derivative records from 52117 primary records. [2025-10-02T22:38:49.679568] [DEBUG] [LOCAL ] FRO: Saving derivative data. [2025-10-02T22:38:49.722144] [DEBUG] [MAIN ] FSCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:49.727009] [DEBUG] [LOCAL ] FRO: Derivative data saved (1807 records). [2025-10-02T22:38:49.727167] [INFO ] [MAIN ] FRO: Successfully saved derivative data. [2025-10-02T22:38:49.729355] [INFO ] [MAIN ] Derivative Progress: 710/1975 symbols completed. FRO took 1.3s. Estimated remaining: 8m 55s. Rate: 141.8 symbols/min [2025-10-02T22:38:49.729591] [INFO ] [MAIN ] FSLY: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:49.726382] [INFO ] [MAIN ] FSCO: Generated 1807 derivative records from 37913 primary records. [2025-10-02T22:38:49.730391] [DEBUG] [LOCAL ] FSCO: Saving derivative data. [2025-10-02T22:38:49.763791] [DEBUG] [LOCAL ] FSK: Loaded 49800 existing records from primary storage. [2025-10-02T22:38:49.764032] [INFO ] [MAIN ] FSK: Loaded 49800 primary data records. [2025-10-02T22:38:49.762831] [DEBUG] [LOCAL ] FSCO: Derivative data saved (1807 records). [2025-10-02T22:38:49.765350] [INFO ] [MAIN ] FSCO: Successfully saved derivative data. [2025-10-02T22:38:49.800859] [INFO ] [MAIN ] Derivative Progress: 711/1975 symbols completed. FSCO took 1.0s. Estimated remaining: 8m 54s. Rate: 142.0 symbols/min [2025-10-02T22:38:49.819381] [INFO ] [MAIN ] FSM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:50.123890] [DEBUG] [LOCAL ] FSLY: Loaded 51615 existing records from primary storage. [2025-10-02T22:38:50.124252] [INFO ] [MAIN ] FSLY: Loaded 51615 primary data records. [2025-10-02T22:38:50.309306] [DEBUG] [LOCAL ] FSM: Loaded 53680 existing records from primary storage. [2025-10-02T22:38:50.368157] [INFO ] [MAIN ] FSM: Loaded 53680 primary data records. [2025-10-02T22:38:50.762996] [DEBUG] [MAIN ] FSK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:50.838220] [INFO ] [MAIN ] FSK: Generated 1807 derivative records from 49800 primary records. [2025-10-02T22:38:50.848331] [DEBUG] [LOCAL ] FSK: Saving derivative data. [2025-10-02T22:38:50.870310] [DEBUG] [LOCAL ] FSK: Derivative data saved (1807 records). [2025-10-02T22:38:50.872825] [INFO ] [MAIN ] FSK: Successfully saved derivative data. [2025-10-02T22:38:50.876697] [INFO ] [MAIN ] Derivative Progress: 712/1975 symbols completed. FSK took 1.2s. Estimated remaining: 8m 55s. Rate: 141.7 symbols/min [2025-10-02T22:38:50.877638] [INFO ] [MAIN ] FSS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:50.893445] [DEBUG] [MAIN ] FSLY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:50.894376] [INFO ] [MAIN ] FSLY: Generated 1807 derivative records from 51615 primary records. [2025-10-02T22:38:50.894579] [DEBUG] [LOCAL ] FSLY: Saving derivative data. [2025-10-02T22:38:50.918802] [DEBUG] [LOCAL ] FSLY: Derivative data saved (1807 records). [2025-10-02T22:38:50.919464] [INFO ] [MAIN ] FSLY: Successfully saved derivative data. [2025-10-02T22:38:50.934231] [INFO ] [MAIN ] Derivative Progress: 713/1975 symbols completed. FSLY took 1.2s. Estimated remaining: 8m 54s. Rate: 141.9 symbols/min [2025-10-02T22:38:50.934941] [INFO ] [MAIN ] FT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:50.935324] [DEBUG] [MAIN ] FSM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:50.936934] [INFO ] [MAIN ] FSM: Generated 1807 derivative records from 53680 primary records. [2025-10-02T22:38:50.945778] [DEBUG] [LOCAL ] FSM: Saving derivative data. [2025-10-02T22:38:50.963793] [DEBUG] [LOCAL ] FSM: Derivative data saved (1807 records). [2025-10-02T22:38:50.963981] [INFO ] [MAIN ] FSM: Successfully saved derivative data. [2025-10-02T22:38:50.966451] [INFO ] [MAIN ] Derivative Progress: 714/1975 symbols completed. FSM took 1.1s. Estimated remaining: 8m 53s. Rate: 142.0 symbols/min [2025-10-02T22:38:50.966847] [INFO ] [MAIN ] FTHY: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:50.981248] [DEBUG] [LOCAL ] FT: Loaded 6571 existing records from primary storage. [2025-10-02T22:38:50.982814] [INFO ] [MAIN ] FT: Loaded 6571 primary data records. [2025-10-02T22:38:51.016776] [DEBUG] [LOCAL ] FSS: Loaded 34339 existing records from primary storage. [2025-10-02T22:38:51.022597] [INFO ] [MAIN ] FSS: Loaded 34339 primary data records. [2025-10-02T22:38:51.182492] [DEBUG] [LOCAL ] FTHY: Loaded 12100 existing records from primary storage. [2025-10-02T22:38:51.206902] [INFO ] [MAIN ] FTHY: Loaded 12100 primary data records. [2025-10-02T22:38:52.128337] [DEBUG] [MAIN ] FSS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:52.144569] [INFO ] [MAIN ] FSS: Generated 1807 derivative records from 34339 primary records. [2025-10-02T22:38:52.143410] [DEBUG] [MAIN ] FT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:52.148180] [DEBUG] [LOCAL ] FSS: Saving derivative data. [2025-10-02T22:38:52.150356] [INFO ] [MAIN ] FT: Generated 1807 derivative records from 6571 primary records. [2025-10-02T22:38:52.151604] [DEBUG] [LOCAL ] FT: Saving derivative data. [2025-10-02T22:38:52.198186] [DEBUG] [MAIN ] FTHY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:52.199572] [INFO ] [MAIN ] FTHY: Generated 1807 derivative records from 12100 primary records. [2025-10-02T22:38:52.205266] [DEBUG] [LOCAL ] FSS: Derivative data saved (1807 records). [2025-10-02T22:38:52.203610] [DEBUG] [LOCAL ] FTHY: Saving derivative data. [2025-10-02T22:38:52.207274] [INFO ] [MAIN ] FSS: Successfully saved derivative data. [2025-10-02T22:38:52.214401] [INFO ] [MAIN ] Derivative Progress: 715/1975 symbols completed. FSS took 1.3s. Estimated remaining: 8m 54s. Rate: 141.7 symbols/min [2025-10-02T22:38:52.214739] [DEBUG] [LOCAL ] FT: Derivative data saved (1807 records). [2025-10-02T22:38:52.215477] [INFO ] [MAIN ] FT: Successfully saved derivative data. [2025-10-02T22:38:52.223350] [INFO ] [MAIN ] FTI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:52.231259] [INFO ] [MAIN ] Derivative Progress: 716/1975 symbols completed. FT took 1.3s. Estimated remaining: 8m 53s. Rate: 141.8 symbols/min [2025-10-02T22:38:52.232312] [INFO ] [MAIN ] FTK: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:52.238010] [DEBUG] [LOCAL ] FTHY: Derivative data saved (1807 records). [2025-10-02T22:38:52.238284] [INFO ] [MAIN ] FTHY: Successfully saved derivative data. [2025-10-02T22:38:52.240409] [INFO ] [MAIN ] Derivative Progress: 717/1975 symbols completed. FTHY took 1.3s. Estimated remaining: 8m 51s. Rate: 142.0 symbols/min [2025-10-02T22:38:52.240628] [INFO ] [MAIN ] FTS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:52.308716] [DEBUG] [LOCAL ] FTK: Loaded 32441 existing records from primary storage. [2025-10-02T22:38:52.323941] [INFO ] [MAIN ] FTK: Loaded 32441 primary data records. [2025-10-02T22:38:52.337771] [DEBUG] [LOCAL ] FTI: Loaded 53689 existing records from primary storage. [2025-10-02T22:38:52.366226] [INFO ] [MAIN ] FTI: Loaded 53689 primary data records. [2025-10-02T22:38:52.476783] [DEBUG] [LOCAL ] FTS: Loaded 42461 existing records from primary storage. [2025-10-02T22:38:52.531124] [INFO ] [MAIN ] FTS: Loaded 42461 primary data records. [2025-10-02T22:38:53.442220] [DEBUG] [MAIN ] FTK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:53.446592] [INFO ] [MAIN ] FTK: Generated 1807 derivative records from 32441 primary records. [2025-10-02T22:38:53.447052] [DEBUG] [LOCAL ] FTK: Saving derivative data. [2025-10-02T22:38:53.470208] [DEBUG] [MAIN ] FTI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:53.475399] [INFO ] [MAIN ] FTI: Generated 1807 derivative records from 53689 primary records. [2025-10-02T22:38:53.475827] [DEBUG] [LOCAL ] FTI: Saving derivative data. [2025-10-02T22:38:53.514326] [DEBUG] [MAIN ] FTS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:53.516311] [INFO ] [MAIN ] FTS: Generated 1807 derivative records from 42461 primary records. [2025-10-02T22:38:53.515097] [DEBUG] [LOCAL ] FTK: Derivative data saved (1807 records). [2025-10-02T22:38:53.517283] [DEBUG] [LOCAL ] FTS: Saving derivative data. [2025-10-02T22:38:53.518777] [INFO ] [MAIN ] FTK: Successfully saved derivative data. [2025-10-02T22:38:53.523870] [INFO ] [MAIN ] Derivative Progress: 718/1975 symbols completed. FTK took 1.3s. Estimated remaining: 8m 53s. Rate: 141.6 symbols/min [2025-10-02T22:38:53.540271] [DEBUG] [LOCAL ] FTI: Derivative data saved (1807 records). [2025-10-02T22:38:53.540996] [INFO ] [MAIN ] FTI: Successfully saved derivative data. [2025-10-02T22:38:53.543598] [INFO ] [MAIN ] Derivative Progress: 719/1975 symbols completed. FTI took 1.3s. Estimated remaining: 8m 51s. Rate: 141.8 symbols/min [2025-10-02T22:38:53.546821] [DEBUG] [LOCAL ] FTS: Derivative data saved (1807 records). [2025-10-02T22:38:53.546924] [INFO ] [MAIN ] FTS: Successfully saved derivative data. [2025-10-02T22:38:53.549400] [INFO ] [MAIN ] Derivative Progress: 720/1975 symbols completed. FTS took 1.3s. Estimated remaining: 8m 50s. Rate: 142.0 symbols/min [2025-10-02T22:38:53.549975] [INFO ] [MAIN ] FUBO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:53.550190] [INFO ] [MAIN ] FTV: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:53.549877] [INFO ] [MAIN ] FTWO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:53.559327] [DEBUG] [LOCAL ] FTWO: Loaded 1836 existing records from primary storage. [2025-10-02T22:38:53.559621] [INFO ] [MAIN ] FTWO: Loaded 1836 primary data records. [2025-10-02T22:38:53.952064] [DEBUG] [LOCAL ] FTV: Loaded 53318 existing records from primary storage. [2025-10-02T22:38:53.967995] [INFO ] [MAIN ] FTV: Loaded 53318 primary data records. [2025-10-02T22:38:54.003194] [DEBUG] [LOCAL ] FUBO: Loaded 54087 existing records from primary storage. [2025-10-02T22:38:54.024301] [INFO ] [MAIN ] FUBO: Loaded 54087 primary data records. [2025-10-02T22:38:54.555018] [DEBUG] [MAIN ] FTWO: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-02T22:38:54.656049] [INFO ] [MAIN ] FTWO: Generated 1806 derivative records from 1836 primary records. [2025-10-02T22:38:54.658087] [DEBUG] [LOCAL ] FTWO: Saving derivative data. [2025-10-02T22:38:54.677255] [DEBUG] [LOCAL ] FTWO: Derivative data saved (1806 records). [2025-10-02T22:38:54.678134] [INFO ] [MAIN ] FTWO: Successfully saved derivative data. [2025-10-02T22:38:54.682061] [INFO ] [MAIN ] Derivative Progress: 721/1975 symbols completed. FTWO took 1.1s. Estimated remaining: 8m 51s. Rate: 141.7 symbols/min [2025-10-02T22:38:54.682401] [INFO ] [MAIN ] FUL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:54.740996] [DEBUG] [MAIN ] FTV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:54.741293] [DEBUG] [MAIN ] FUBO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:54.743056] [INFO ] [MAIN ] FUBO: Generated 1807 derivative records from 54087 primary records. [2025-10-02T22:38:54.742374] [INFO ] [MAIN ] FTV: Generated 1807 derivative records from 53318 primary records. [2025-10-02T22:38:54.743286] [DEBUG] [LOCAL ] FUBO: Saving derivative data. [2025-10-02T22:38:54.743359] [DEBUG] [LOCAL ] FTV: Saving derivative data. [2025-10-02T22:38:54.788293] [DEBUG] [LOCAL ] FUBO: Derivative data saved (1807 records). [2025-10-02T22:38:54.790614] [INFO ] [MAIN ] FUBO: Successfully saved derivative data. [2025-10-02T22:38:54.795285] [INFO ] [MAIN ] Derivative Progress: 722/1975 symbols completed. FUBO took 1.2s. Estimated remaining: 8m 50s. Rate: 141.8 symbols/min [2025-10-02T22:38:54.791284] [DEBUG] [LOCAL ] FUL: Loaded 33213 existing records from primary storage. [2025-10-02T22:38:54.796187] [INFO ] [MAIN ] FUN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:54.796056] [INFO ] [MAIN ] FUL: Loaded 33213 primary data records. [2025-10-02T22:38:54.798875] [DEBUG] [LOCAL ] FTV: Derivative data saved (1807 records). [2025-10-02T22:38:54.799110] [INFO ] [MAIN ] FTV: Successfully saved derivative data. [2025-10-02T22:38:54.806491] [INFO ] [MAIN ] Derivative Progress: 723/1975 symbols completed. FTV took 1.3s. Estimated remaining: 8m 49s. Rate: 142.0 symbols/min [2025-10-02T22:38:54.806843] [INFO ] [MAIN ] FVR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:55.015715] [DEBUG] [LOCAL ] FVR: Loaded 21880 existing records from primary storage. [2025-10-02T22:38:55.036180] [INFO ] [MAIN ] FVR: Loaded 21880 primary data records. [2025-10-02T22:38:55.279703] [DEBUG] [LOCAL ] FUN: Loaded 51989 existing records from primary storage. [2025-10-02T22:38:55.299742] [INFO ] [MAIN ] FUN: Loaded 51989 primary data records. [2025-10-02T22:38:55.889843] [DEBUG] [MAIN ] FUL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:55.891391] [INFO ] [MAIN ] FUL: Generated 1807 derivative records from 33213 primary records. [2025-10-02T22:38:55.892106] [DEBUG] [LOCAL ] FUL: Saving derivative data. [2025-10-02T22:38:55.912949] [DEBUG] [LOCAL ] FUL: Derivative data saved (1807 records). [2025-10-02T22:38:55.913532] [INFO ] [MAIN ] FUL: Successfully saved derivative data. [2025-10-02T22:38:55.915587] [INFO ] [MAIN ] Derivative Progress: 724/1975 symbols completed. FUL took 1.2s. Estimated remaining: 8m 50s. Rate: 141.7 symbols/min [2025-10-02T22:38:55.915878] [INFO ] [MAIN ] FVRR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:55.936668] [DEBUG] [MAIN ] FVR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:55.937593] [INFO ] [MAIN ] FVR: Generated 1807 derivative records from 21880 primary records. [2025-10-02T22:38:55.937819] [DEBUG] [LOCAL ] FVR: Saving derivative data. [2025-10-02T22:38:55.971016] [DEBUG] [LOCAL ] FVR: Derivative data saved (1807 records). [2025-10-02T22:38:55.969390] [DEBUG] [MAIN ] FUN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:55.981841] [INFO ] [MAIN ] FVR: Successfully saved derivative data. [2025-10-02T22:38:55.981691] [INFO ] [MAIN ] FUN: Generated 1807 derivative records from 51989 primary records. [2025-10-02T22:38:55.984135] [DEBUG] [LOCAL ] FUN: Saving derivative data. [2025-10-02T22:38:55.984051] [INFO ] [MAIN ] Derivative Progress: 725/1975 symbols completed. FVR took 1.2s. Estimated remaining: 8m 49s. Rate: 141.9 symbols/min [2025-10-02T22:38:55.985012] [INFO ] [MAIN ] FXED: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:56.006555] [DEBUG] [LOCAL ] FUN: Derivative data saved (1807 records). [2025-10-02T22:38:56.004051] [DEBUG] [LOCAL ] FXED: Loaded 1253 existing records from primary storage. [2025-10-02T22:38:56.021393] [INFO ] [MAIN ] FUN: Successfully saved derivative data. [2025-10-02T22:38:56.021224] [INFO ] [MAIN ] FXED: Loaded 1253 primary data records. [2025-10-02T22:38:56.024007] [INFO ] [MAIN ] Derivative Progress: 726/1975 symbols completed. FUN took 1.2s. Estimated remaining: 8m 48s. Rate: 142.0 symbols/min [2025-10-02T22:38:56.037545] [INFO ] [MAIN ] G: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:56.037793] [DEBUG] [LOCAL ] FVRR: Loaded 40323 existing records from primary storage. [2025-10-02T22:38:56.060064] [INFO ] [MAIN ] FVRR: Loaded 40323 primary data records. [2025-10-02T22:38:56.701110] [DEBUG] [LOCAL ] G: Loaded 50210 existing records from primary storage. [2025-10-02T22:38:56.702345] [INFO ] [MAIN ] G: Loaded 50210 primary data records. [2025-10-02T22:38:57.043319] [DEBUG] [MAIN ] FXED: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-02T22:38:57.047734] [INFO ] [MAIN ] FXED: Generated 1806 derivative records from 1253 primary records. [2025-10-02T22:38:57.048214] [DEBUG] [LOCAL ] FXED: Saving derivative data. [2025-10-02T22:38:57.076905] [DEBUG] [LOCAL ] FXED: Derivative data saved (1806 records). [2025-10-02T22:38:57.077492] [DEBUG] [MAIN ] FVRR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:57.078921] [INFO ] [MAIN ] FVRR: Generated 1807 derivative records from 40323 primary records. [2025-10-02T22:38:57.077929] [INFO ] [MAIN ] FXED: Successfully saved derivative data. [2025-10-02T22:38:57.081006] [INFO ] [MAIN ] Derivative Progress: 727/1975 symbols completed. FXED took 1.1s. Estimated remaining: 8m 48s. Rate: 141.8 symbols/min [2025-10-02T22:38:57.079048] [DEBUG] [LOCAL ] FVRR: Saving derivative data. [2025-10-02T22:38:57.081165] [INFO ] [MAIN ] GAB: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:57.102487] [DEBUG] [LOCAL ] FVRR: Derivative data saved (1807 records). [2025-10-02T22:38:57.102783] [INFO ] [MAIN ] FVRR: Successfully saved derivative data. [2025-10-02T22:38:57.105112] [INFO ] [MAIN ] Derivative Progress: 728/1975 symbols completed. FVRR took 1.2s. Estimated remaining: 8m 47s. Rate: 141.9 symbols/min [2025-10-02T22:38:57.105454] [INFO ] [MAIN ] GAM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:57.125135] [DEBUG] [MAIN ] G: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:57.127590] [DEBUG] [LOCAL ] GAM: Loaded 4081 existing records from primary storage. [2025-10-02T22:38:57.135040] [INFO ] [MAIN ] GAM: Loaded 4081 primary data records. [2025-10-02T22:38:57.141104] [INFO ] [MAIN ] G: Generated 1807 derivative records from 50210 primary records. [2025-10-02T22:38:57.175344] [DEBUG] [LOCAL ] G: Saving derivative data. [2025-10-02T22:38:57.281365] [DEBUG] [LOCAL ] GAB: Loaded 28112 existing records from primary storage. [2025-10-02T22:38:57.286593] [DEBUG] [LOCAL ] G: Derivative data saved (1807 records). [2025-10-02T22:38:57.302230] [INFO ] [MAIN ] GAB: Loaded 28112 primary data records. [2025-10-02T22:38:57.333248] [INFO ] [MAIN ] G: Successfully saved derivative data. [2025-10-02T22:38:57.405190] [INFO ] [MAIN ] Derivative Progress: 729/1975 symbols completed. G took 1.4s. Estimated remaining: 8m 47s. Rate: 142.0 symbols/min [2025-10-02T22:38:57.535040] [INFO ] [MAIN ] GAP: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:57.911096] [DEBUG] [MAIN ] GAM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:57.927831] [INFO ] [MAIN ] GAM: Generated 1807 derivative records from 4081 primary records. [2025-10-02T22:38:57.928185] [DEBUG] [LOCAL ] GAM: Saving derivative data. [2025-10-02T22:38:57.929142] [DEBUG] [LOCAL ] GAP: Loaded 54045 existing records from primary storage. [2025-10-02T22:38:57.931405] [INFO ] [MAIN ] GAP: Loaded 54045 primary data records. [2025-10-02T22:38:58.050166] [DEBUG] [LOCAL ] GAM: Derivative data saved (1807 records). [2025-10-02T22:38:58.065987] [INFO ] [MAIN ] GAM: Successfully saved derivative data. [2025-10-02T22:38:58.079952] [INFO ] [MAIN ] Derivative Progress: 730/1975 symbols completed. GAM took 1.0s. Estimated remaining: 8m 47s. Rate: 141.9 symbols/min [2025-10-02T22:38:58.103789] [INFO ] [MAIN ] GATX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:58.165114] [DEBUG] [MAIN ] GAB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:58.172187] [INFO ] [MAIN ] GAB: Generated 1807 derivative records from 28112 primary records. [2025-10-02T22:38:58.293271] [DEBUG] [LOCAL ] GAB: Saving derivative data. [2025-10-02T22:38:58.311880] [DEBUG] [LOCAL ] GAB: Derivative data saved (1807 records). [2025-10-02T22:38:58.317631] [INFO ] [MAIN ] GAB: Successfully saved derivative data. [2025-10-02T22:38:58.320412] [INFO ] [MAIN ] Derivative Progress: 731/1975 symbols completed. GAB took 1.2s. Estimated remaining: 8m 46s. Rate: 142.0 symbols/min [2025-10-02T22:38:58.321001] [INFO ] [MAIN ] GBAB: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:58.331253] [DEBUG] [LOCAL ] GATX: Loaded 18259 existing records from primary storage. [2025-10-02T22:38:58.331729] [INFO ] [MAIN ] GATX: Loaded 18259 primary data records. [2025-10-02T22:38:58.449808] [DEBUG] [LOCAL ] GBAB: Loaded 13143 existing records from primary storage. [2025-10-02T22:38:58.464983] [INFO ] [MAIN ] GBAB: Loaded 13143 primary data records. [2025-10-02T22:38:58.775553] [DEBUG] [MAIN ] GAP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:58.808605] [INFO ] [MAIN ] GAP: Generated 1807 derivative records from 54045 primary records. [2025-10-02T22:38:58.812813] [DEBUG] [LOCAL ] GAP: Saving derivative data. [2025-10-02T22:38:59.030992] [DEBUG] [LOCAL ] GAP: Derivative data saved (1807 records). [2025-10-02T22:38:59.032681] [INFO ] [MAIN ] GAP: Successfully saved derivative data. [2025-10-02T22:38:59.035069] [INFO ] [MAIN ] Derivative Progress: 732/1975 symbols completed. GAP took 1.5s. Estimated remaining: 8m 46s. Rate: 141.8 symbols/min [2025-10-02T22:38:59.036158] [INFO ] [MAIN ] GBCI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:59.058381] [DEBUG] [MAIN ] GATX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:59.059160] [INFO ] [MAIN ] GATX: Generated 1807 derivative records from 18259 primary records. [2025-10-02T22:38:59.059348] [DEBUG] [LOCAL ] GATX: Saving derivative data. [2025-10-02T22:38:59.077370] [DEBUG] [LOCAL ] GATX: Derivative data saved (1807 records). [2025-10-02T22:38:59.077610] [INFO ] [MAIN ] GATX: Successfully saved derivative data. [2025-10-02T22:38:59.079816] [INFO ] [MAIN ] Derivative Progress: 733/1975 symbols completed. GATX took 1.0s. Estimated remaining: 8m 45s. Rate: 142.0 symbols/min [2025-10-02T22:38:59.105848] [DEBUG] [MAIN ] GBAB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:59.106571] [INFO ] [MAIN ] GBAB: Generated 1807 derivative records from 13143 primary records. [2025-10-02T22:38:59.106662] [DEBUG] [LOCAL ] GBAB: Saving derivative data. [2025-10-02T22:38:59.130778] [DEBUG] [LOCAL ] GBCI: Loaded 40436 existing records from primary storage. [2025-10-02T22:38:59.134127] [INFO ] [MAIN ] GBCI: Loaded 40436 primary data records. [2025-10-02T22:38:59.135242] [DEBUG] [LOCAL ] GBAB: Derivative data saved (1807 records). [2025-10-02T22:38:59.153683] [INFO ] [MAIN ] GBAB: Successfully saved derivative data. [2025-10-02T22:38:59.193203] [INFO ] [MAIN ] Derivative Progress: 734/1975 symbols completed. GBAB took 0.9s. Estimated remaining: 8m 44s. Rate: 142.1 symbols/min [2025-10-02T22:38:59.481918] [DEBUG] [MAIN ] GBCI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:38:59.482604] [INFO ] [MAIN ] GBCI: Generated 1807 derivative records from 40436 primary records. [2025-10-02T22:38:59.482695] [DEBUG] [LOCAL ] GBCI: Saving derivative data. [2025-10-02T22:38:59.499066] [DEBUG] [LOCAL ] GBCI: Derivative data saved (1807 records). [2025-10-02T22:38:59.499147] [INFO ] [MAIN ] GBCI: Successfully saved derivative data. [2025-10-02T22:38:59.501261] [INFO ] [MAIN ] Derivative Progress: 735/1975 symbols completed. GBCI took 0.5s. Estimated remaining: 8m 43s. Rate: 142.2 symbols/min [2025-10-02T22:38:59.501735] [INFO ] [MAIN ] GBTG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:59.501871] [INFO ] [MAIN ] GBX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:59.502499] [INFO ] [MAIN ] GCI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:38:59.587196] [DEBUG] [LOCAL ] GBX: Loaded 29327 existing records from primary storage. [2025-10-02T22:38:59.587444] [INFO ] [MAIN ] GBX: Loaded 29327 primary data records. [2025-10-02T22:38:59.588218] [DEBUG] [LOCAL ] GCI: Loaded 44426 existing records from primary storage. [2025-10-02T22:38:59.594552] [DEBUG] [LOCAL ] GBTG: Loaded 40317 existing records from primary storage. [2025-10-02T22:38:59.611147] [INFO ] [MAIN ] GCI: Loaded 44426 primary data records. [2025-10-02T22:38:59.622005] [INFO ] [MAIN ] GBTG: Loaded 40317 primary data records. [2025-10-02T22:39:00.648286] [DEBUG] [MAIN ] GCI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:00.651220] [INFO ] [MAIN ] GCI: Generated 1807 derivative records from 44426 primary records. [2025-10-02T22:39:00.665839] [DEBUG] [LOCAL ] GCI: Saving derivative data. [2025-10-02T22:39:00.679054] [DEBUG] [MAIN ] GBX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:00.680670] [DEBUG] [MAIN ] GBTG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:00.682687] [INFO ] [MAIN ] GBX: Generated 1807 derivative records from 29327 primary records. [2025-10-02T22:39:00.681879] [INFO ] [MAIN ] GBTG: Generated 1807 derivative records from 40317 primary records. [2025-10-02T22:39:00.683061] [DEBUG] [LOCAL ] GBTG: Saving derivative data. [2025-10-02T22:39:00.691066] [DEBUG] [LOCAL ] GBX: Saving derivative data. [2025-10-02T22:39:00.734361] [DEBUG] [LOCAL ] GBTG: Derivative data saved (1807 records). [2025-10-02T22:39:00.734556] [INFO ] [MAIN ] GBTG: Successfully saved derivative data. [2025-10-02T22:39:00.735304] [DEBUG] [LOCAL ] GCI: Derivative data saved (1807 records). [2025-10-02T22:39:00.737782] [INFO ] [MAIN ] Derivative Progress: 736/1975 symbols completed. GBTG took 1.2s. Estimated remaining: 8m 44s. Rate: 141.8 symbols/min [2025-10-02T22:39:00.738158] [INFO ] [MAIN ] GCO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:00.738381] [INFO ] [MAIN ] GCI: Successfully saved derivative data. [2025-10-02T22:39:00.733807] [DEBUG] [LOCAL ] GBX: Derivative data saved (1807 records). [2025-10-02T22:39:00.738548] [INFO ] [MAIN ] GBX: Successfully saved derivative data. [2025-10-02T22:39:00.740550] [INFO ] [MAIN ] Derivative Progress: 737/1975 symbols completed. GCI took 1.2s. Estimated remaining: 8m 43s. Rate: 142.0 symbols/min [2025-10-02T22:39:00.744753] [INFO ] [MAIN ] GCTS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:00.744896] [INFO ] [MAIN ] Derivative Progress: 738/1975 symbols completed. GBX took 1.2s. Estimated remaining: 8m 42s. Rate: 142.2 symbols/min [2025-10-02T22:39:00.745320] [INFO ] [MAIN ] GCV: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:00.763322] [DEBUG] [LOCAL ] GCV: Loaded 7454 existing records from primary storage. [2025-10-02T22:39:00.763533] [INFO ] [MAIN ] GCV: Loaded 7454 primary data records. [2025-10-02T22:39:00.858686] [DEBUG] [LOCAL ] GCTS: Loaded 20086 existing records from primary storage. [2025-10-02T22:39:00.864005] [INFO ] [MAIN ] GCTS: Loaded 20086 primary data records. [2025-10-02T22:39:00.923514] [DEBUG] [LOCAL ] GCO: Loaded 24786 existing records from primary storage. [2025-10-02T22:39:00.954401] [INFO ] [MAIN ] GCO: Loaded 24786 primary data records. [2025-10-02T22:39:01.917259] [DEBUG] [MAIN ] GCV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:01.918453] [INFO ] [MAIN ] GCV: Generated 1807 derivative records from 7454 primary records. [2025-10-02T22:39:01.925535] [DEBUG] [LOCAL ] GCV: Saving derivative data. [2025-10-02T22:39:01.962212] [DEBUG] [MAIN ] GCTS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:01.965315] [INFO ] [MAIN ] GCTS: Generated 1807 derivative records from 20086 primary records. [2025-10-02T22:39:01.965508] [DEBUG] [LOCAL ] GCTS: Saving derivative data. [2025-10-02T22:39:01.965435] [DEBUG] [LOCAL ] GCV: Derivative data saved (1807 records). [2025-10-02T22:39:01.968159] [INFO ] [MAIN ] GCV: Successfully saved derivative data. [2025-10-02T22:39:01.970635] [INFO ] [MAIN ] Derivative Progress: 739/1975 symbols completed. GCV took 1.2s. Estimated remaining: 8m 43s. Rate: 141.8 symbols/min [2025-10-02T22:39:01.985419] [INFO ] [MAIN ] GD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:01.991191] [DEBUG] [LOCAL ] GCTS: Derivative data saved (1807 records). [2025-10-02T22:39:02.006066] [INFO ] [MAIN ] GCTS: Successfully saved derivative data. [2025-10-02T22:39:02.006462] [DEBUG] [MAIN ] GCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:02.008916] [INFO ] [MAIN ] Derivative Progress: 740/1975 symbols completed. GCTS took 1.3s. Estimated remaining: 8m 42s. Rate: 142.0 symbols/min [2025-10-02T22:39:02.010027] [INFO ] [MAIN ] GCO: Generated 1807 derivative records from 24786 primary records. [2025-10-02T22:39:02.010276] [DEBUG] [LOCAL ] GCO: Saving derivative data. [2025-10-02T22:39:02.010421] [INFO ] [MAIN ] GDDY: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:02.029695] [DEBUG] [LOCAL ] GCO: Derivative data saved (1807 records). [2025-10-02T22:39:02.029845] [INFO ] [MAIN ] GCO: Successfully saved derivative data. [2025-10-02T22:39:02.033036] [INFO ] [MAIN ] Derivative Progress: 741/1975 symbols completed. GCO took 1.3s. Estimated remaining: 8m 41s. Rate: 142.2 symbols/min [2025-10-02T22:39:02.033390] [INFO ] [MAIN ] GDIV: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:02.052187] [DEBUG] [LOCAL ] GDIV: Loaded 3648 existing records from primary storage. [2025-10-02T22:39:02.063059] [INFO ] [MAIN ] GDIV: Loaded 3648 primary data records. [2025-10-02T22:39:02.219994] [DEBUG] [LOCAL ] GD: Loaded 47468 existing records from primary storage. [2025-10-02T22:39:02.279308] [INFO ] [MAIN ] GD: Loaded 47468 primary data records. [2025-10-02T22:39:02.269336] [DEBUG] [LOCAL ] GDDY: Loaded 50069 existing records from primary storage. [2025-10-02T22:39:02.313324] [INFO ] [MAIN ] GDDY: Loaded 50069 primary data records. [2025-10-02T22:39:03.136065] [DEBUG] [MAIN ] GDIV: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-02T22:39:03.137279] [INFO ] [MAIN ] GDIV: Generated 1806 derivative records from 3648 primary records. [2025-10-02T22:39:03.137702] [DEBUG] [LOCAL ] GDIV: Saving derivative data. [2025-10-02T22:39:03.170560] [DEBUG] [MAIN ] GD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:03.172883] [INFO ] [MAIN ] GD: Generated 1807 derivative records from 47468 primary records. [2025-10-02T22:39:03.173072] [DEBUG] [LOCAL ] GD: Saving derivative data. [2025-10-02T22:39:03.182281] [DEBUG] [LOCAL ] GDIV: Derivative data saved (1806 records). [2025-10-02T22:39:03.183345] [INFO ] [MAIN ] GDIV: Successfully saved derivative data. [2025-10-02T22:39:03.188131] [INFO ] [MAIN ] Derivative Progress: 742/1975 symbols completed. GDIV took 1.2s. Estimated remaining: 8m 42s. Rate: 141.9 symbols/min [2025-10-02T22:39:03.202010] [INFO ] [MAIN ] GDL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:03.203378] [DEBUG] [MAIN ] GDDY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:03.204246] [INFO ] [MAIN ] GDDY: Generated 1807 derivative records from 50069 primary records. [2025-10-02T22:39:03.204876] [DEBUG] [LOCAL ] GDDY: Saving derivative data. [2025-10-02T22:39:03.221309] [DEBUG] [LOCAL ] GD: Derivative data saved (1807 records). [2025-10-02T22:39:03.225705] [DEBUG] [LOCAL ] GDL: Loaded 2576 existing records from primary storage. [2025-10-02T22:39:03.226300] [INFO ] [MAIN ] GD: Successfully saved derivative data. [2025-10-02T22:39:03.226360] [INFO ] [MAIN ] GDL: Loaded 2576 primary data records. [2025-10-02T22:39:03.234134] [INFO ] [MAIN ] Derivative Progress: 743/1975 symbols completed. GD took 1.2s. Estimated remaining: 8m 40s. Rate: 142.0 symbols/min [2025-10-02T22:39:03.252922] [INFO ] [MAIN ] GDO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:03.283853] [DEBUG] [LOCAL ] GDDY: Derivative data saved (1807 records). [2025-10-02T22:39:03.284112] [INFO ] [MAIN ] GDDY: Successfully saved derivative data. [2025-10-02T22:39:03.294117] [INFO ] [MAIN ] Derivative Progress: 744/1975 symbols completed. GDDY took 1.3s. Estimated remaining: 8m 39s. Rate: 142.2 symbols/min [2025-10-02T22:39:03.318175] [INFO ] [MAIN ] GDOT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:03.404550] [DEBUG] [LOCAL ] GDO: Loaded 6027 existing records from primary storage. [2025-10-02T22:39:03.561066] [INFO ] [MAIN ] GDO: Loaded 6027 primary data records. [2025-10-02T22:39:03.787043] [DEBUG] [LOCAL ] GDOT: Loaded 38623 existing records from primary storage. [2025-10-02T22:39:03.793343] [INFO ] [MAIN ] GDOT: Loaded 38623 primary data records. [2025-10-02T22:39:04.313910] [DEBUG] [MAIN ] GDL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:04.315370] [INFO ] [MAIN ] GDL: Generated 1807 derivative records from 2576 primary records. [2025-10-02T22:39:04.315785] [DEBUG] [LOCAL ] GDL: Saving derivative data. [2025-10-02T22:39:04.343270] [DEBUG] [LOCAL ] GDL: Derivative data saved (1807 records). [2025-10-02T22:39:04.343611] [INFO ] [MAIN ] GDL: Successfully saved derivative data. [2025-10-02T22:39:04.346964] [INFO ] [MAIN ] Derivative Progress: 745/1975 symbols completed. GDL took 1.1s. Estimated remaining: 8m 40s. Rate: 141.9 symbols/min [2025-10-02T22:39:04.360730] [INFO ] [MAIN ] GDV: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:04.362346] [DEBUG] [MAIN ] GDO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:04.363247] [INFO ] [MAIN ] GDO: Generated 1807 derivative records from 6027 primary records. [2025-10-02T22:39:04.363630] [DEBUG] [LOCAL ] GDO: Saving derivative data. [2025-10-02T22:39:04.388184] [DEBUG] [LOCAL ] GDO: Derivative data saved (1807 records). [2025-10-02T22:39:04.388362] [INFO ] [MAIN ] GDO: Successfully saved derivative data. [2025-10-02T22:39:04.391318] [INFO ] [MAIN ] Derivative Progress: 746/1975 symbols completed. GDO took 1.1s. Estimated remaining: 8m 39s. Rate: 142.1 symbols/min [2025-10-02T22:39:04.391603] [INFO ] [MAIN ] GE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:04.413291] [DEBUG] [MAIN ] GDOT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:04.414306] [INFO ] [MAIN ] GDOT: Generated 1807 derivative records from 38623 primary records. [2025-10-02T22:39:04.415011] [DEBUG] [LOCAL ] GDOT: Saving derivative data. [2025-10-02T22:39:04.414812] [DEBUG] [LOCAL ] GDV: Loaded 19585 existing records from primary storage. [2025-10-02T22:39:04.415604] [INFO ] [MAIN ] GDV: Loaded 19585 primary data records. [2025-10-02T22:39:04.560892] [DEBUG] [LOCAL ] GDOT: Derivative data saved (1807 records). [2025-10-02T22:39:04.571884] [INFO ] [MAIN ] GDOT: Successfully saved derivative data. [2025-10-02T22:39:04.586097] [INFO ] [MAIN ] Derivative Progress: 747/1975 symbols completed. GDOT took 1.3s. Estimated remaining: 8m 38s. Rate: 142.2 symbols/min [2025-10-02T22:39:04.631809] [INFO ] [MAIN ] GEF: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:04.812065] [DEBUG] [LOCAL ] GE: Loaded 54103 existing records from primary storage. [2025-10-02T22:39:04.812595] [INFO ] [MAIN ] GE: Loaded 54103 primary data records. [2025-10-02T22:39:04.923178] [DEBUG] [LOCAL ] GEF: Loaded 20830 existing records from primary storage. [2025-10-02T22:39:04.945555] [INFO ] [MAIN ] GEF: Loaded 20830 primary data records. [2025-10-02T22:39:05.348548] [DEBUG] [MAIN ] GDV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:05.497341] [INFO ] [MAIN ] GDV: Generated 1807 derivative records from 19585 primary records. [2025-10-02T22:39:05.512672] [DEBUG] [LOCAL ] GDV: Saving derivative data. [2025-10-02T22:39:05.541286] [DEBUG] [LOCAL ] GDV: Derivative data saved (1807 records). [2025-10-02T22:39:05.542727] [INFO ] [MAIN ] GDV: Successfully saved derivative data. [2025-10-02T22:39:05.545415] [INFO ] [MAIN ] Derivative Progress: 748/1975 symbols completed. GDV took 1.2s. Estimated remaining: 8m 39s. Rate: 141.9 symbols/min [2025-10-02T22:39:05.564582] [DEBUG] [MAIN ] GE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:05.565412] [INFO ] [MAIN ] GE: Generated 1807 derivative records from 54103 primary records. [2025-10-02T22:39:05.565748] [DEBUG] [LOCAL ] GE: Saving derivative data. [2025-10-02T22:39:05.586819] [DEBUG] [LOCAL ] GE: Derivative data saved (1807 records). [2025-10-02T22:39:05.586922] [INFO ] [MAIN ] GE: Successfully saved derivative data. [2025-10-02T22:39:05.589149] [INFO ] [MAIN ] Derivative Progress: 749/1975 symbols completed. GE took 1.2s. Estimated remaining: 8m 38s. Rate: 142.1 symbols/min [2025-10-02T22:39:05.609856] [DEBUG] [MAIN ] GEF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:05.610906] [INFO ] [MAIN ] GEF: Generated 1807 derivative records from 20830 primary records. [2025-10-02T22:39:05.610988] [DEBUG] [LOCAL ] GEF: Saving derivative data. [2025-10-02T22:39:05.635160] [DEBUG] [LOCAL ] GEF: Derivative data saved (1807 records). [2025-10-02T22:39:05.635322] [INFO ] [MAIN ] GEF: Successfully saved derivative data. [2025-10-02T22:39:05.638197] [INFO ] [MAIN ] Derivative Progress: 750/1975 symbols completed. GEF took 1.0s. Estimated remaining: 8m 37s. Rate: 142.3 symbols/min [2025-10-02T22:39:05.639083] [INFO ] [MAIN ] GEO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:05.638990] [INFO ] [MAIN ] GENI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:05.638884] [INFO ] [MAIN ] GEL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:05.696784] [DEBUG] [LOCAL ] GEL: Loaded 33312 existing records from primary storage. [2025-10-02T22:39:05.697024] [INFO ] [MAIN ] GEL: Loaded 33312 primary data records. [2025-10-02T22:39:05.847352] [DEBUG] [LOCAL ] GENI: Loaded 53320 existing records from primary storage. [2025-10-02T22:39:05.861526] [INFO ] [MAIN ] GENI: Loaded 53320 primary data records. [2025-10-02T22:39:05.896416] [DEBUG] [LOCAL ] GEO: Loaded 52324 existing records from primary storage. [2025-10-02T22:39:05.983959] [INFO ] [MAIN ] GEO: Loaded 52324 primary data records. [2025-10-02T22:39:06.839341] [DEBUG] [MAIN ] GEL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:06.840411] [INFO ] [MAIN ] GEL: Generated 1807 derivative records from 33312 primary records. [2025-10-02T22:39:06.840617] [DEBUG] [LOCAL ] GEL: Saving derivative data. [2025-10-02T22:39:06.875380] [DEBUG] [MAIN ] GENI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:06.880392] [DEBUG] [LOCAL ] GEL: Derivative data saved (1807 records). [2025-10-02T22:39:06.880303] [INFO ] [MAIN ] GENI: Generated 1807 derivative records from 53320 primary records. [2025-10-02T22:39:06.881295] [INFO ] [MAIN ] GEL: Successfully saved derivative data. [2025-10-02T22:39:06.883479] [INFO ] [MAIN ] Derivative Progress: 751/1975 symbols completed. GEL took 1.2s. Estimated remaining: 8m 38s. Rate: 141.9 symbols/min [2025-10-02T22:39:06.883970] [INFO ] [MAIN ] GES: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:06.883590] [DEBUG] [LOCAL ] GENI: Saving derivative data. [2025-10-02T22:39:06.913013] [DEBUG] [MAIN ] GEO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:06.915086] [INFO ] [MAIN ] GEO: Generated 1807 derivative records from 52324 primary records. [2025-10-02T22:39:06.915606] [DEBUG] [LOCAL ] GEO: Saving derivative data. [2025-10-02T22:39:06.933148] [DEBUG] [LOCAL ] GENI: Derivative data saved (1807 records). [2025-10-02T22:39:06.934023] [INFO ] [MAIN ] GENI: Successfully saved derivative data. [2025-10-02T22:39:06.936624] [INFO ] [MAIN ] Derivative Progress: 752/1975 symbols completed. GENI took 1.3s. Estimated remaining: 8m 36s. Rate: 142.1 symbols/min [2025-10-02T22:39:06.936869] [INFO ] [MAIN ] GETY: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:06.940495] [DEBUG] [LOCAL ] GEO: Derivative data saved (1807 records). [2025-10-02T22:39:06.940637] [INFO ] [MAIN ] GEO: Successfully saved derivative data. [2025-10-02T22:39:06.943130] [INFO ] [MAIN ] Derivative Progress: 753/1975 symbols completed. GEO took 1.3s. Estimated remaining: 8m 35s. Rate: 142.3 symbols/min [2025-10-02T22:39:06.943383] [INFO ] [MAIN ] GEV: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:06.973088] [DEBUG] [LOCAL ] GES: Loaded 39655 existing records from primary storage. [2025-10-02T22:39:06.974459] [INFO ] [MAIN ] GES: Loaded 39655 primary data records. [2025-10-02T22:39:07.179268] [DEBUG] [LOCAL ] GETY: Loaded 35780 existing records from primary storage. [2025-10-02T22:39:07.221779] [INFO ] [MAIN ] GETY: Loaded 35780 primary data records. [2025-10-02T22:39:07.412282] [DEBUG] [LOCAL ] GEV: Loaded 53424 existing records from primary storage. [2025-10-02T22:39:07.436355] [INFO ] [MAIN ] GEV: Loaded 53424 primary data records. [2025-10-02T22:39:08.043119] [DEBUG] [MAIN ] GES: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:08.044707] [INFO ] [MAIN ] GES: Generated 1807 derivative records from 39655 primary records. [2025-10-02T22:39:08.045234] [DEBUG] [LOCAL ] GES: Saving derivative data. [2025-10-02T22:39:08.067357] [DEBUG] [LOCAL ] GES: Derivative data saved (1807 records). [2025-10-02T22:39:08.068583] [INFO ] [MAIN ] GES: Successfully saved derivative data. [2025-10-02T22:39:08.071701] [INFO ] [MAIN ] Derivative Progress: 754/1975 symbols completed. GES took 1.2s. Estimated remaining: 8m 36s. Rate: 141.9 symbols/min [2025-10-02T22:39:08.072139] [INFO ] [MAIN ] GF: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:08.087422] [DEBUG] [MAIN ] GETY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:08.088519] [INFO ] [MAIN ] GETY: Generated 1807 derivative records from 35780 primary records. [2025-10-02T22:39:08.090428] [DEBUG] [LOCAL ] GETY: Saving derivative data. [2025-10-02T22:39:08.107057] [DEBUG] [LOCAL ] GF: Loaded 2981 existing records from primary storage. [2025-10-02T22:39:08.108617] [INFO ] [MAIN ] GF: Loaded 2981 primary data records. [2025-10-02T22:39:08.162026] [DEBUG] [MAIN ] GEV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:08.176394] [INFO ] [MAIN ] GEV: Generated 1807 derivative records from 53424 primary records. [2025-10-02T22:39:08.184828] [DEBUG] [LOCAL ] GEV: Saving derivative data. [2025-10-02T22:39:08.274086] [DEBUG] [LOCAL ] GETY: Derivative data saved (1807 records). [2025-10-02T22:39:08.296599] [INFO ] [MAIN ] GETY: Successfully saved derivative data. [2025-10-02T22:39:08.332722] [INFO ] [MAIN ] Derivative Progress: 755/1975 symbols completed. GETY took 1.4s. Estimated remaining: 8m 35s. Rate: 142.0 symbols/min [2025-10-02T22:39:08.337241] [INFO ] [MAIN ] GFF: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:08.503665] [DEBUG] [LOCAL ] GEV: Derivative data saved (1807 records). [2025-10-02T22:39:08.503934] [INFO ] [MAIN ] GEV: Successfully saved derivative data. [2025-10-02T22:39:08.507442] [INFO ] [MAIN ] Derivative Progress: 756/1975 symbols completed. GEV took 1.6s. Estimated remaining: 8m 35s. Rate: 142.1 symbols/min [2025-10-02T22:39:08.508498] [INFO ] [MAIN ] GFI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:08.533979] [DEBUG] [MAIN ] GF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:08.534860] [INFO ] [MAIN ] GF: Generated 1807 derivative records from 2981 primary records. [2025-10-02T22:39:08.535075] [DEBUG] [LOCAL ] GF: Saving derivative data. [2025-10-02T22:39:08.572341] [DEBUG] [LOCAL ] GF: Derivative data saved (1807 records). [2025-10-02T22:39:08.573940] [INFO ] [MAIN ] GF: Successfully saved derivative data. [2025-10-02T22:39:08.577821] [DEBUG] [LOCAL ] GFF: Loaded 30582 existing records from primary storage. [2025-10-02T22:39:08.576445] [INFO ] [MAIN ] Derivative Progress: 757/1975 symbols completed. GF took 0.5s. Estimated remaining: 8m 34s. Rate: 142.3 symbols/min [2025-10-02T22:39:08.578063] [INFO ] [MAIN ] GFF: Loaded 30582 primary data records. [2025-10-02T22:39:08.578184] [INFO ] [MAIN ] GFL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:08.812840] [DEBUG] [LOCAL ] GFI: Loaded 53491 existing records from primary storage. [2025-10-02T22:39:08.945747] [INFO ] [MAIN ] GFI: Loaded 53491 primary data records. [2025-10-02T22:39:09.099140] [DEBUG] [LOCAL ] GFL: Loaded 48290 existing records from primary storage. [2025-10-02T22:39:09.105084] [INFO ] [MAIN ] GFL: Loaded 48290 primary data records. [2025-10-02T22:39:09.686081] [DEBUG] [MAIN ] GFF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:09.687270] [INFO ] [MAIN ] GFF: Generated 1807 derivative records from 30582 primary records. [2025-10-02T22:39:09.687675] [DEBUG] [LOCAL ] GFF: Saving derivative data. [2025-10-02T22:39:09.712699] [DEBUG] [LOCAL ] GFF: Derivative data saved (1807 records). [2025-10-02T22:39:09.713118] [INFO ] [MAIN ] GFF: Successfully saved derivative data. [2025-10-02T22:39:09.728147] [INFO ] [MAIN ] Derivative Progress: 758/1975 symbols completed. GFF took 1.4s. Estimated remaining: 8m 34s. Rate: 142.0 symbols/min [2025-10-02T22:39:09.729458] [DEBUG] [MAIN ] GFI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:09.730337] [INFO ] [MAIN ] GFI: Generated 1807 derivative records from 53491 primary records. [2025-10-02T22:39:09.730481] [INFO ] [MAIN ] GFR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:09.730589] [DEBUG] [LOCAL ] GFI: Saving derivative data. [2025-10-02T22:39:09.757763] [DEBUG] [LOCAL ] GFR: Loaded 8355 existing records from primary storage. [2025-10-02T22:39:09.758604] [INFO ] [MAIN ] GFR: Loaded 8355 primary data records. [2025-10-02T22:39:09.760928] [DEBUG] [LOCAL ] GFI: Derivative data saved (1807 records). [2025-10-02T22:39:09.778552] [INFO ] [MAIN ] GFI: Successfully saved derivative data. [2025-10-02T22:39:09.803803] [INFO ] [MAIN ] Derivative Progress: 759/1975 symbols completed. GFI took 1.3s. Estimated remaining: 8m 33s. Rate: 142.1 symbols/min [2025-10-02T22:39:09.816957] [INFO ] [MAIN ] GGB: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:09.849607] [DEBUG] [MAIN ] GFL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:09.863109] [INFO ] [MAIN ] GFL: Generated 1807 derivative records from 48290 primary records. [2025-10-02T22:39:09.880698] [DEBUG] [LOCAL ] GFL: Saving derivative data. [2025-10-02T22:39:10.127492] [DEBUG] [LOCAL ] GFL: Derivative data saved (1807 records). [2025-10-02T22:39:10.128894] [INFO ] [MAIN ] GFL: Successfully saved derivative data. [2025-10-02T22:39:10.131154] [INFO ] [MAIN ] Derivative Progress: 760/1975 symbols completed. GFL took 1.6s. Estimated remaining: 8m 33s. Rate: 142.2 symbols/min [2025-10-02T22:39:10.131570] [INFO ] [MAIN ] GGG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:10.152262] [DEBUG] [LOCAL ] GGB: Loaded 51478 existing records from primary storage. [2025-10-02T22:39:10.152712] [INFO ] [MAIN ] GGB: Loaded 51478 primary data records. [2025-10-02T22:39:10.335273] [DEBUG] [MAIN ] GFR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:10.375402] [INFO ] [MAIN ] GFR: Generated 1807 derivative records from 8355 primary records. [2025-10-02T22:39:10.381713] [DEBUG] [LOCAL ] GFR: Saving derivative data. [2025-10-02T22:39:10.526770] [DEBUG] [LOCAL ] GGG: Loaded 41247 existing records from primary storage. [2025-10-02T22:39:10.534218] [INFO ] [MAIN ] GGG: Loaded 41247 primary data records. [2025-10-02T22:39:10.644556] [DEBUG] [LOCAL ] GFR: Derivative data saved (1807 records). [2025-10-02T22:39:10.662464] [INFO ] [MAIN ] GFR: Successfully saved derivative data. [2025-10-02T22:39:10.678976] [INFO ] [MAIN ] Derivative Progress: 761/1975 symbols completed. GFR took 0.9s. Estimated remaining: 8m 33s. Rate: 142.1 symbols/min [2025-10-02T22:39:10.684892] [INFO ] [MAIN ] GGT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:10.968457] [DEBUG] [LOCAL ] GGT: Loaded 14175 existing records from primary storage. [2025-10-02T22:39:10.968834] [INFO ] [MAIN ] GGT: Loaded 14175 primary data records. [2025-10-02T22:39:11.107272] [DEBUG] [MAIN ] GGB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:11.130006] [INFO ] [MAIN ] GGB: Generated 1807 derivative records from 51478 primary records. [2025-10-02T22:39:11.140412] [DEBUG] [LOCAL ] GGB: Saving derivative data. [2025-10-02T22:39:11.352985] [DEBUG] [LOCAL ] GGB: Derivative data saved (1807 records). [2025-10-02T22:39:11.355819] [INFO ] [MAIN ] GGB: Successfully saved derivative data. [2025-10-02T22:39:11.358915] [INFO ] [MAIN ] Derivative Progress: 762/1975 symbols completed. GGB took 1.5s. Estimated remaining: 8m 33s. Rate: 142.0 symbols/min [2025-10-02T22:39:11.373419] [INFO ] [MAIN ] GHC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:11.375339] [DEBUG] [MAIN ] GGG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:11.376507] [INFO ] [MAIN ] GGG: Generated 1807 derivative records from 41247 primary records. [2025-10-02T22:39:11.376739] [DEBUG] [LOCAL ] GGG: Saving derivative data. [2025-10-02T22:39:11.396413] [DEBUG] [LOCAL ] GHC: Loaded 2690 existing records from primary storage. [2025-10-02T22:39:11.398543] [INFO ] [MAIN ] GHC: Loaded 2690 primary data records. [2025-10-02T22:39:11.489308] [DEBUG] [LOCAL ] GGG: Derivative data saved (1807 records). [2025-10-02T22:39:11.500135] [INFO ] [MAIN ] GGG: Successfully saved derivative data. [2025-10-02T22:39:11.553567] [DEBUG] [MAIN ] GGT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:11.553002] [INFO ] [MAIN ] Derivative Progress: 763/1975 symbols completed. GGG took 1.4s. Estimated remaining: 8m 32s. Rate: 142.1 symbols/min [2025-10-02T22:39:11.561732] [INFO ] [MAIN ] GGT: Generated 1807 derivative records from 14175 primary records. [2025-10-02T22:39:11.567722] [DEBUG] [LOCAL ] GGT: Saving derivative data. [2025-10-02T22:39:11.789242] [DEBUG] [LOCAL ] GGT: Derivative data saved (1807 records). [2025-10-02T22:39:11.789384] [INFO ] [MAIN ] GGT: Successfully saved derivative data. [2025-10-02T22:39:11.792054] [INFO ] [MAIN ] Derivative Progress: 764/1975 symbols completed. GGT took 1.1s. Estimated remaining: 8m 31s. Rate: 142.2 symbols/min [2025-10-02T22:39:11.814423] [DEBUG] [MAIN ] GHC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:11.815128] [INFO ] [MAIN ] GHC: Generated 1807 derivative records from 2690 primary records. [2025-10-02T22:39:11.815194] [DEBUG] [LOCAL ] GHC: Saving derivative data. [2025-10-02T22:39:11.830258] [DEBUG] [LOCAL ] GHC: Derivative data saved (1807 records). [2025-10-02T22:39:11.830379] [INFO ] [MAIN ] GHC: Successfully saved derivative data. [2025-10-02T22:39:11.832498] [INFO ] [MAIN ] Derivative Progress: 765/1975 symbols completed. GHC took 0.5s. Estimated remaining: 8m 30s. Rate: 142.3 symbols/min [2025-10-02T22:39:11.833116] [INFO ] [MAIN ] GHG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:11.833229] [INFO ] [MAIN ] GHLD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:11.833544] [INFO ] [MAIN ] GHI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:11.840693] [DEBUG] [LOCAL ] GHG: Loaded 3197 existing records from primary storage. [2025-10-02T22:39:11.842522] [INFO ] [MAIN ] GHG: Loaded 3197 primary data records. [2025-10-02T22:39:11.881228] [DEBUG] [LOCAL ] GHLD: Loaded 4203 existing records from primary storage. [2025-10-02T22:39:11.901467] [INFO ] [MAIN ] GHLD: Loaded 4203 primary data records. [2025-10-02T22:39:11.949612] [DEBUG] [LOCAL ] GHI: Loaded 7089 existing records from primary storage. [2025-10-02T22:39:12.041696] [INFO ] [MAIN ] GHI: Loaded 7089 primary data records. [2025-10-02T22:39:13.101786] [DEBUG] [MAIN ] GHG: Filtered 6966 bins outside market hours, 7761 incomplete bins [2025-10-02T22:39:13.103611] [INFO ] [MAIN ] GHG: Generated 1805 derivative records from 3197 primary records. [2025-10-02T22:39:13.104249] [DEBUG] [LOCAL ] GHG: Saving derivative data. [2025-10-02T22:39:13.142284] [DEBUG] [MAIN ] GHLD: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-02T22:39:13.144518] [INFO ] [MAIN ] GHLD: Generated 1806 derivative records from 4203 primary records. [2025-10-02T22:39:13.144829] [DEBUG] [LOCAL ] GHLD: Saving derivative data. [2025-10-02T22:39:13.143495] [DEBUG] [LOCAL ] GHG: Derivative data saved (1805 records). [2025-10-02T22:39:13.146307] [INFO ] [MAIN ] GHG: Successfully saved derivative data. [2025-10-02T22:39:13.148809] [INFO ] [MAIN ] Derivative Progress: 766/1975 symbols completed. GHG took 1.3s. Estimated remaining: 8m 31s. Rate: 141.9 symbols/min [2025-10-02T22:39:13.149543] [INFO ] [MAIN ] GHM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:13.209755] [DEBUG] [LOCAL ] GHM: Loaded 14163 existing records from primary storage. [2025-10-02T22:39:13.208792] [DEBUG] [MAIN ] GHI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:13.210917] [INFO ] [MAIN ] GHI: Generated 1807 derivative records from 7089 primary records. [2025-10-02T22:39:13.211561] [INFO ] [MAIN ] GHM: Loaded 14163 primary data records. [2025-10-02T22:39:13.211839] [DEBUG] [LOCAL ] GHLD: Derivative data saved (1806 records). [2025-10-02T22:39:13.211942] [INFO ] [MAIN ] GHLD: Successfully saved derivative data. [2025-10-02T22:39:13.217159] [DEBUG] [LOCAL ] GHI: Saving derivative data. [2025-10-02T22:39:13.243373] [INFO ] [MAIN ] Derivative Progress: 767/1975 symbols completed. GHLD took 1.4s. Estimated remaining: 8m 30s. Rate: 142.1 symbols/min [2025-10-02T22:39:13.273695] [INFO ] [MAIN ] GHY: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:13.393922] [DEBUG] [LOCAL ] GHI: Derivative data saved (1807 records). [2025-10-02T22:39:13.397330] [INFO ] [MAIN ] GHI: Successfully saved derivative data. [2025-10-02T22:39:13.426744] [INFO ] [MAIN ] Derivative Progress: 768/1975 symbols completed. GHI took 1.6s. Estimated remaining: 8m 29s. Rate: 142.2 symbols/min [2025-10-02T22:39:13.447935] [INFO ] [MAIN ] GIB: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:13.496050] [DEBUG] [LOCAL ] GHY: Loaded 20989 existing records from primary storage. [2025-10-02T22:39:13.496452] [INFO ] [MAIN ] GHY: Loaded 20989 primary data records. [2025-10-02T22:39:13.874252] [DEBUG] [LOCAL ] GIB: Loaded 32317 existing records from primary storage. [2025-10-02T22:39:13.918082] [INFO ] [MAIN ] GIB: Loaded 32317 primary data records. [2025-10-02T22:39:14.315275] [DEBUG] [MAIN ] GHM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:14.391829] [INFO ] [MAIN ] GHM: Generated 1807 derivative records from 14163 primary records. [2025-10-02T22:39:14.392235] [DEBUG] [LOCAL ] GHM: Saving derivative data. [2025-10-02T22:39:14.423754] [DEBUG] [LOCAL ] GHM: Derivative data saved (1807 records). [2025-10-02T22:39:14.429414] [DEBUG] [MAIN ] GHY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:14.429627] [INFO ] [MAIN ] GHM: Successfully saved derivative data. [2025-10-02T22:39:14.430398] [INFO ] [MAIN ] GHY: Generated 1807 derivative records from 20989 primary records. [2025-10-02T22:39:14.432859] [DEBUG] [LOCAL ] GHY: Saving derivative data. [2025-10-02T22:39:14.432790] [INFO ] [MAIN ] Derivative Progress: 769/1975 symbols completed. GHM took 1.3s. Estimated remaining: 8m 30s. Rate: 141.9 symbols/min [2025-10-02T22:39:14.434764] [INFO ] [MAIN ] GIC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:14.457965] [DEBUG] [LOCAL ] GHY: Derivative data saved (1807 records). [2025-10-02T22:39:14.459848] [INFO ] [MAIN ] GHY: Successfully saved derivative data. [2025-10-02T22:39:14.462470] [INFO ] [MAIN ] Derivative Progress: 770/1975 symbols completed. GHY took 1.2s. Estimated remaining: 8m 29s. Rate: 142.1 symbols/min [2025-10-02T22:39:14.467789] [INFO ] [MAIN ] GIL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:14.468217] [DEBUG] [LOCAL ] GIC: Loaded 13577 existing records from primary storage. [2025-10-02T22:39:14.468881] [INFO ] [MAIN ] GIC: Loaded 13577 primary data records. [2025-10-02T22:39:14.516675] [DEBUG] [MAIN ] GIB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:14.543477] [INFO ] [MAIN ] GIB: Generated 1807 derivative records from 32317 primary records. [2025-10-02T22:39:14.566719] [DEBUG] [LOCAL ] GIB: Saving derivative data. [2025-10-02T22:39:14.837976] [DEBUG] [LOCAL ] GIB: Derivative data saved (1807 records). [2025-10-02T22:39:14.838137] [INFO ] [MAIN ] GIB: Successfully saved derivative data. [2025-10-02T22:39:14.840415] [INFO ] [MAIN ] Derivative Progress: 771/1975 symbols completed. GIB took 1.4s. Estimated remaining: 8m 28s. Rate: 142.1 symbols/min [2025-10-02T22:39:14.841388] [INFO ] [MAIN ] GIS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:14.859165] [DEBUG] [LOCAL ] GIL: Loaded 43689 existing records from primary storage. [2025-10-02T22:39:14.859621] [INFO ] [MAIN ] GIL: Loaded 43689 primary data records. [2025-10-02T22:39:15.303995] [DEBUG] [MAIN ] GIC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:15.314975] [INFO ] [MAIN ] GIC: Generated 1807 derivative records from 13577 primary records. [2025-10-02T22:39:15.316791] [DEBUG] [LOCAL ] GIS: Loaded 54062 existing records from primary storage. [2025-10-02T22:39:15.317081] [INFO ] [MAIN ] GIS: Loaded 54062 primary data records. [2025-10-02T22:39:15.316989] [DEBUG] [LOCAL ] GIC: Saving derivative data. [2025-10-02T22:39:15.500631] [DEBUG] [LOCAL ] GIC: Derivative data saved (1807 records). [2025-10-02T22:39:15.526222] [INFO ] [MAIN ] GIC: Successfully saved derivative data. [2025-10-02T22:39:15.565639] [INFO ] [MAIN ] Derivative Progress: 772/1975 symbols completed. GIC took 1.1s. Estimated remaining: 8m 28s. Rate: 142.0 symbols/min [2025-10-02T22:39:15.650912] [INFO ] [MAIN ] GKOS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:15.723940] [DEBUG] [MAIN ] GIL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:15.725029] [INFO ] [MAIN ] GIL: Generated 1807 derivative records from 43689 primary records. [2025-10-02T22:39:15.725228] [DEBUG] [LOCAL ] GIL: Saving derivative data. [2025-10-02T22:39:15.757057] [DEBUG] [LOCAL ] GIL: Derivative data saved (1807 records). [2025-10-02T22:39:15.757470] [INFO ] [MAIN ] GIL: Successfully saved derivative data. [2025-10-02T22:39:15.760961] [INFO ] [MAIN ] Derivative Progress: 773/1975 symbols completed. GIL took 1.3s. Estimated remaining: 8m 28s. Rate: 142.1 symbols/min [2025-10-02T22:39:15.762533] [INFO ] [MAIN ] GL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:15.779428] [DEBUG] [MAIN ] GIS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:15.793254] [INFO ] [MAIN ] GIS: Generated 1807 derivative records from 54062 primary records. [2025-10-02T22:39:15.793549] [DEBUG] [LOCAL ] GIS: Saving derivative data. [2025-10-02T22:39:15.795176] [DEBUG] [LOCAL ] GKOS: Loaded 42984 existing records from primary storage. [2025-10-02T22:39:15.795604] [INFO ] [MAIN ] GKOS: Loaded 42984 primary data records. [2025-10-02T22:39:15.969984] [DEBUG] [LOCAL ] GIS: Derivative data saved (1807 records). [2025-10-02T22:39:15.970732] [INFO ] [MAIN ] GIS: Successfully saved derivative data. [2025-10-02T22:39:16.016887] [INFO ] [MAIN ] Derivative Progress: 774/1975 symbols completed. GIS took 1.2s. Estimated remaining: 8m 27s. Rate: 142.2 symbols/min [2025-10-02T22:39:16.050779] [INFO ] [MAIN ] GLOB: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:16.051954] [DEBUG] [LOCAL ] GL: Loaded 38054 existing records from primary storage. [2025-10-02T22:39:16.054890] [INFO ] [MAIN ] GL: Loaded 38054 primary data records. [2025-10-02T22:39:16.585402] [DEBUG] [LOCAL ] GLOB: Loaded 47963 existing records from primary storage. [2025-10-02T22:39:16.585789] [INFO ] [MAIN ] GLOB: Loaded 47963 primary data records. [2025-10-02T22:39:16.674966] [DEBUG] [MAIN ] GKOS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:16.692042] [INFO ] [MAIN ] GKOS: Generated 1807 derivative records from 42984 primary records. [2025-10-02T22:39:16.701331] [DEBUG] [LOCAL ] GKOS: Saving derivative data. [2025-10-02T22:39:16.857800] [DEBUG] [MAIN ] GL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:16.985522] [INFO ] [MAIN ] GL: Generated 1807 derivative records from 38054 primary records. [2025-10-02T22:39:16.994916] [DEBUG] [LOCAL ] GL: Saving derivative data. [2025-10-02T22:39:17.011086] [DEBUG] [LOCAL ] GKOS: Derivative data saved (1807 records). [2025-10-02T22:39:17.011474] [INFO ] [MAIN ] GKOS: Successfully saved derivative data. [2025-10-02T22:39:17.014137] [INFO ] [MAIN ] Derivative Progress: 775/1975 symbols completed. GKOS took 1.4s. Estimated remaining: 8m 27s. Rate: 141.9 symbols/min [2025-10-02T22:39:17.014528] [INFO ] [MAIN ] GLW: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:17.023619] [DEBUG] [LOCAL ] GL: Derivative data saved (1807 records). [2025-10-02T22:39:17.023783] [INFO ] [MAIN ] GL: Successfully saved derivative data. [2025-10-02T22:39:17.027100] [INFO ] [MAIN ] Derivative Progress: 776/1975 symbols completed. GL took 1.3s. Estimated remaining: 8m 26s. Rate: 142.1 symbols/min [2025-10-02T22:39:17.027908] [INFO ] [MAIN ] GM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:17.051566] [DEBUG] [MAIN ] GLOB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:17.052375] [INFO ] [MAIN ] GLOB: Generated 1807 derivative records from 47963 primary records. [2025-10-02T22:39:17.052513] [DEBUG] [LOCAL ] GLOB: Saving derivative data. [2025-10-02T22:39:17.085280] [DEBUG] [LOCAL ] GLOB: Derivative data saved (1807 records). [2025-10-02T22:39:17.085541] [INFO ] [MAIN ] GLOB: Successfully saved derivative data. [2025-10-02T22:39:17.087829] [INFO ] [MAIN ] Derivative Progress: 777/1975 symbols completed. GLOB took 1.0s. Estimated remaining: 8m 25s. Rate: 142.3 symbols/min [2025-10-02T22:39:17.088889] [INFO ] [MAIN ] GME: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:17.107811] [DEBUG] [LOCAL ] GLW: Loaded 54026 existing records from primary storage. [2025-10-02T22:39:17.108138] [INFO ] [MAIN ] GLW: Loaded 54026 primary data records. [2025-10-02T22:39:17.361557] [DEBUG] [LOCAL ] GM: Loaded 54118 existing records from primary storage. [2025-10-02T22:39:17.473037] [INFO ] [MAIN ] GM: Loaded 54118 primary data records. [2025-10-02T22:39:17.634159] [DEBUG] [LOCAL ] GME: Loaded 54152 existing records from primary storage. [2025-10-02T22:39:17.685288] [INFO ] [MAIN ] GME: Loaded 54152 primary data records. [2025-10-02T22:39:18.228859] [DEBUG] [MAIN ] GLW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:18.229861] [INFO ] [MAIN ] GLW: Generated 1807 derivative records from 54026 primary records. [2025-10-02T22:39:18.230173] [DEBUG] [LOCAL ] GLW: Saving derivative data. [2025-10-02T22:39:18.269101] [DEBUG] [MAIN ] GM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:18.271164] [INFO ] [MAIN ] GM: Generated 1807 derivative records from 54118 primary records. [2025-10-02T22:39:18.271409] [DEBUG] [LOCAL ] GM: Saving derivative data. [2025-10-02T22:39:18.271602] [DEBUG] [LOCAL ] GLW: Derivative data saved (1807 records). [2025-10-02T22:39:18.271873] [INFO ] [MAIN ] GLW: Successfully saved derivative data. [2025-10-02T22:39:18.274914] [INFO ] [MAIN ] Derivative Progress: 778/1975 symbols completed. GLW took 1.3s. Estimated remaining: 8m 26s. Rate: 141.9 symbols/min [2025-10-02T22:39:18.293694] [DEBUG] [LOCAL ] GM: Derivative data saved (1807 records). [2025-10-02T22:39:18.293829] [INFO ] [MAIN ] GM: Successfully saved derivative data. [2025-10-02T22:39:18.296186] [INFO ] [MAIN ] Derivative Progress: 779/1975 symbols completed. GM took 1.3s. Estimated remaining: 8m 25s. Rate: 142.1 symbols/min [2025-10-02T22:39:18.314141] [DEBUG] [MAIN ] GME: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:18.314811] [INFO ] [MAIN ] GME: Generated 1807 derivative records from 54152 primary records. [2025-10-02T22:39:18.314874] [DEBUG] [LOCAL ] GME: Saving derivative data. [2025-10-02T22:39:18.331403] [DEBUG] [LOCAL ] GME: Derivative data saved (1807 records). [2025-10-02T22:39:18.331546] [INFO ] [MAIN ] GME: Successfully saved derivative data. [2025-10-02T22:39:18.333824] [INFO ] [MAIN ] Derivative Progress: 780/1975 symbols completed. GME took 1.2s. Estimated remaining: 8m 24s. Rate: 142.3 symbols/min [2025-10-02T22:39:18.334271] [INFO ] [MAIN ] GMED: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:18.334609] [INFO ] [MAIN ] GNE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:18.335336] [INFO ] [MAIN ] GMRE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:18.359728] [DEBUG] [LOCAL ] GNE: Loaded 17926 existing records from primary storage. [2025-10-02T22:39:18.360416] [INFO ] [MAIN ] GNE: Loaded 17926 primary data records. [2025-10-02T22:39:18.617801] [DEBUG] [LOCAL ] GMRE: Loaded 37572 existing records from primary storage. [2025-10-02T22:39:18.744132] [INFO ] [MAIN ] GMRE: Loaded 37572 primary data records. [2025-10-02T22:39:18.730214] [DEBUG] [LOCAL ] GMED: Loaded 48729 existing records from primary storage. [2025-10-02T22:39:18.745010] [INFO ] [MAIN ] GMED: Loaded 48729 primary data records. [2025-10-02T22:39:19.423930] [DEBUG] [MAIN ] GNE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:19.425742] [INFO ] [MAIN ] GNE: Generated 1807 derivative records from 17926 primary records. [2025-10-02T22:39:19.425926] [DEBUG] [LOCAL ] GNE: Saving derivative data. [2025-10-02T22:39:19.450398] [DEBUG] [LOCAL ] GNE: Derivative data saved (1807 records). [2025-10-02T22:39:19.450669] [INFO ] [MAIN ] GNE: Successfully saved derivative data. [2025-10-02T22:39:19.453003] [INFO ] [MAIN ] Derivative Progress: 781/1975 symbols completed. GNE took 1.1s. Estimated remaining: 8m 25s. Rate: 142.0 symbols/min [2025-10-02T22:39:19.453892] [INFO ] [MAIN ] GNK: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:19.486779] [DEBUG] [MAIN ] GMED: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:19.488251] [INFO ] [MAIN ] GMED: Generated 1807 derivative records from 48729 primary records. [2025-10-02T22:39:19.487336] [DEBUG] [MAIN ] GMRE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:19.489314] [DEBUG] [LOCAL ] GMED: Saving derivative data. [2025-10-02T22:39:19.489237] [INFO ] [MAIN ] GMRE: Generated 1807 derivative records from 37572 primary records. [2025-10-02T22:39:19.490156] [DEBUG] [LOCAL ] GMRE: Saving derivative data. [2025-10-02T22:39:19.533265] [DEBUG] [LOCAL ] GMED: Derivative data saved (1807 records). [2025-10-02T22:39:19.534191] [DEBUG] [LOCAL ] GMRE: Derivative data saved (1807 records). [2025-10-02T22:39:19.534302] [INFO ] [MAIN ] GMRE: Successfully saved derivative data. [2025-10-02T22:39:19.534381] [INFO ] [MAIN ] GMED: Successfully saved derivative data. [2025-10-02T22:39:19.536580] [INFO ] [MAIN ] Derivative Progress: 782/1975 symbols completed. GMRE took 1.2s. Estimated remaining: 8m 24s. Rate: 142.1 symbols/min [2025-10-02T22:39:19.539531] [INFO ] [MAIN ] Derivative Progress: 783/1975 symbols completed. GMED took 1.2s. Estimated remaining: 8m 23s. Rate: 142.3 symbols/min [2025-10-02T22:39:19.539258] [INFO ] [MAIN ] GNL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:19.540590] [INFO ] [MAIN ] GNRC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:19.560122] [DEBUG] [LOCAL ] GNK: Loaded 40592 existing records from primary storage. [2025-10-02T22:39:19.560359] [INFO ] [MAIN ] GNK: Loaded 40592 primary data records. [2025-10-02T22:39:19.973115] [DEBUG] [LOCAL ] GNL: Loaded 47148 existing records from primary storage. [2025-10-02T22:39:19.973481] [INFO ] [MAIN ] GNL: Loaded 47148 primary data records. [2025-10-02T22:39:19.985571] [DEBUG] [LOCAL ] GNRC: Loaded 45434 existing records from primary storage. [2025-10-02T22:39:20.007822] [INFO ] [MAIN ] GNRC: Loaded 45434 primary data records. [2025-10-02T22:39:20.667433] [DEBUG] [MAIN ] GNK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:20.669398] [INFO ] [MAIN ] GNK: Generated 1807 derivative records from 40592 primary records. [2025-10-02T22:39:20.669676] [DEBUG] [LOCAL ] GNK: Saving derivative data. [2025-10-02T22:39:20.699885] [DEBUG] [LOCAL ] GNK: Derivative data saved (1807 records). [2025-10-02T22:39:20.728002] [INFO ] [MAIN ] GNK: Successfully saved derivative data. [2025-10-02T22:39:20.727368] [DEBUG] [MAIN ] GNRC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:20.727863] [DEBUG] [MAIN ] GNL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:20.728972] [INFO ] [MAIN ] GNRC: Generated 1807 derivative records from 45434 primary records. [2025-10-02T22:39:20.733481] [INFO ] [MAIN ] Derivative Progress: 784/1975 symbols completed. GNK took 1.3s. Estimated remaining: 8m 23s. Rate: 142.0 symbols/min [2025-10-02T22:39:20.733729] [INFO ] [MAIN ] GNT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:20.733910] [DEBUG] [LOCAL ] GNRC: Saving derivative data. [2025-10-02T22:39:20.730009] [INFO ] [MAIN ] GNL: Generated 1807 derivative records from 47148 primary records. [2025-10-02T22:39:20.735601] [DEBUG] [LOCAL ] GNL: Saving derivative data. [2025-10-02T22:39:20.774549] [DEBUG] [LOCAL ] GNT: Loaded 8217 existing records from primary storage. [2025-10-02T22:39:20.775059] [INFO ] [MAIN ] GNT: Loaded 8217 primary data records. [2025-10-02T22:39:20.813965] [DEBUG] [LOCAL ] GNRC: Derivative data saved (1807 records). [2025-10-02T22:39:20.834335] [INFO ] [MAIN ] GNRC: Successfully saved derivative data. [2025-10-02T22:39:20.863708] [INFO ] [MAIN ] Derivative Progress: 785/1975 symbols completed. GNRC took 1.3s. Estimated remaining: 8m 23s. Rate: 142.1 symbols/min [2025-10-02T22:39:20.861543] [DEBUG] [LOCAL ] GNL: Derivative data saved (1807 records). [2025-10-02T22:39:20.872468] [INFO ] [MAIN ] GNL: Successfully saved derivative data. [2025-10-02T22:39:20.900299] [INFO ] [MAIN ] GNW: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:20.905868] [INFO ] [MAIN ] Derivative Progress: 786/1975 symbols completed. GNL took 1.3s. Estimated remaining: 8m 22s. Rate: 142.2 symbols/min [2025-10-02T22:39:20.911734] [INFO ] [MAIN ] GOF: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:21.205005] [DEBUG] [LOCAL ] GNW: Loaded 51722 existing records from primary storage. [2025-10-02T22:39:21.213507] [DEBUG] [LOCAL ] GOF: Loaded 42879 existing records from primary storage. [2025-10-02T22:39:21.219063] [INFO ] [MAIN ] GNW: Loaded 51722 primary data records. [2025-10-02T22:39:21.219174] [INFO ] [MAIN ] GOF: Loaded 42879 primary data records. [2025-10-02T22:39:21.243090] [DEBUG] [MAIN ] GNT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:21.311785] [INFO ] [MAIN ] GNT: Generated 1807 derivative records from 8217 primary records. [2025-10-02T22:39:21.330324] [DEBUG] [LOCAL ] GNT: Saving derivative data. [2025-10-02T22:39:21.988955] [DEBUG] [LOCAL ] GNT: Derivative data saved (1807 records). [2025-10-02T22:39:21.989131] [INFO ] [MAIN ] GNT: Successfully saved derivative data. [2025-10-02T22:39:21.991435] [INFO ] [MAIN ] Derivative Progress: 787/1975 symbols completed. GNT took 1.3s. Estimated remaining: 8m 22s. Rate: 142.0 symbols/min [2025-10-02T22:39:21.991776] [INFO ] [MAIN ] GOLF: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:22.034712] [DEBUG] [MAIN ] GOF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:22.045457] [INFO ] [MAIN ] GOF: Generated 1807 derivative records from 42879 primary records. [2025-10-02T22:39:22.060218] [DEBUG] [LOCAL ] GOLF: Loaded 31420 existing records from primary storage. [2025-10-02T22:39:22.060634] [INFO ] [MAIN ] GOLF: Loaded 31420 primary data records. [2025-10-02T22:39:22.060491] [DEBUG] [MAIN ] GNW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:22.060771] [DEBUG] [LOCAL ] GOF: Saving derivative data. [2025-10-02T22:39:22.067256] [INFO ] [MAIN ] GNW: Generated 1807 derivative records from 51722 primary records. [2025-10-02T22:39:22.068351] [DEBUG] [LOCAL ] GNW: Saving derivative data. [2025-10-02T22:39:22.261262] [DEBUG] [LOCAL ] GOF: Derivative data saved (1807 records). [2025-10-02T22:39:22.293987] [INFO ] [MAIN ] GOF: Successfully saved derivative data. [2025-10-02T22:39:22.407111] [DEBUG] [LOCAL ] GNW: Derivative data saved (1807 records). [2025-10-02T22:39:22.422847] [INFO ] [MAIN ] Derivative Progress: 788/1975 symbols completed. GOF took 1.5s. Estimated remaining: 8m 22s. Rate: 142.0 symbols/min [2025-10-02T22:39:22.424253] [INFO ] [MAIN ] GNW: Successfully saved derivative data. [2025-10-02T22:39:22.426719] [INFO ] [MAIN ] GOOS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:22.426847] [INFO ] [MAIN ] Derivative Progress: 789/1975 symbols completed. GNW took 1.5s. Estimated remaining: 8m 21s. Rate: 142.1 symbols/min [2025-10-02T22:39:22.427264] [INFO ] [MAIN ] GOTU: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:22.456980] [DEBUG] [MAIN ] GOLF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:22.457779] [INFO ] [MAIN ] GOLF: Generated 1807 derivative records from 31420 primary records. [2025-10-02T22:39:22.458053] [DEBUG] [LOCAL ] GOLF: Saving derivative data. [2025-10-02T22:39:22.494625] [DEBUG] [LOCAL ] GOLF: Derivative data saved (1807 records). [2025-10-02T22:39:22.494794] [INFO ] [MAIN ] GOLF: Successfully saved derivative data. [2025-10-02T22:39:22.497024] [INFO ] [MAIN ] Derivative Progress: 790/1975 symbols completed. GOLF took 0.5s. Estimated remaining: 8m 20s. Rate: 142.3 symbols/min [2025-10-02T22:39:22.509213] [INFO ] [MAIN ] GPC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:22.511720] [DEBUG] [LOCAL ] GOTU: Loaded 38626 existing records from primary storage. [2025-10-02T22:39:22.511939] [INFO ] [MAIN ] GOTU: Loaded 38626 primary data records. [2025-10-02T22:39:22.640139] [DEBUG] [LOCAL ] GOOS: Loaded 45342 existing records from primary storage. [2025-10-02T22:39:22.654472] [INFO ] [MAIN ] GOOS: Loaded 45342 primary data records. [2025-10-02T22:39:23.087069] [DEBUG] [LOCAL ] GPC: Loaded 46702 existing records from primary storage. [2025-10-02T22:39:23.114244] [INFO ] [MAIN ] GPC: Loaded 46702 primary data records. [2025-10-02T22:39:23.679512] [DEBUG] [MAIN ] GOTU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:23.681986] [INFO ] [MAIN ] GOTU: Generated 1807 derivative records from 38626 primary records. [2025-10-02T22:39:23.682511] [DEBUG] [LOCAL ] GOTU: Saving derivative data. [2025-10-02T22:39:23.717837] [DEBUG] [MAIN ] GOOS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:23.719446] [INFO ] [MAIN ] GOOS: Generated 1807 derivative records from 45342 primary records. [2025-10-02T22:39:23.719686] [DEBUG] [LOCAL ] GOOS: Saving derivative data. [2025-10-02T22:39:23.738502] [DEBUG] [LOCAL ] GOTU: Derivative data saved (1807 records). [2025-10-02T22:39:23.739426] [INFO ] [MAIN ] GOTU: Successfully saved derivative data. [2025-10-02T22:39:23.741735] [INFO ] [MAIN ] Derivative Progress: 791/1975 symbols completed. GOTU took 1.3s. Estimated remaining: 8m 21s. Rate: 141.9 symbols/min [2025-10-02T22:39:23.742150] [INFO ] [MAIN ] GPI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:23.749188] [DEBUG] [LOCAL ] GOOS: Derivative data saved (1807 records). [2025-10-02T22:39:23.749698] [INFO ] [MAIN ] GOOS: Successfully saved derivative data. [2025-10-02T22:39:23.752711] [INFO ] [MAIN ] Derivative Progress: 792/1975 symbols completed. GOOS took 1.3s. Estimated remaining: 8m 19s. Rate: 142.1 symbols/min [2025-10-02T22:39:23.753512] [INFO ] [MAIN ] GPJA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:23.767919] [DEBUG] [MAIN ] GPC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:23.768913] [INFO ] [MAIN ] GPC: Generated 1807 derivative records from 46702 primary records. [2025-10-02T22:39:23.773363] [DEBUG] [LOCAL ] GPC: Saving derivative data. [2025-10-02T22:39:23.797312] [DEBUG] [LOCAL ] GPI: Loaded 14747 existing records from primary storage. [2025-10-02T22:39:23.791935] [DEBUG] [LOCAL ] GPJA: Loaded 4260 existing records from primary storage. [2025-10-02T22:39:23.798308] [INFO ] [MAIN ] GPJA: Loaded 4260 primary data records. [2025-10-02T22:39:23.798240] [INFO ] [MAIN ] GPI: Loaded 14747 primary data records. [2025-10-02T22:39:24.037232] [DEBUG] [LOCAL ] GPC: Derivative data saved (1807 records). [2025-10-02T22:39:24.089616] [INFO ] [MAIN ] GPC: Successfully saved derivative data. [2025-10-02T22:39:24.196456] [INFO ] [MAIN ] Derivative Progress: 793/1975 symbols completed. GPC took 1.7s. Estimated remaining: 8m 19s. Rate: 142.1 symbols/min [2025-10-02T22:39:24.546097] [DEBUG] [MAIN ] GPI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:24.548220] [INFO ] [MAIN ] GPI: Generated 1807 derivative records from 14747 primary records. [2025-10-02T22:39:24.549306] [DEBUG] [LOCAL ] GPI: Saving derivative data. [2025-10-02T22:39:24.577449] [DEBUG] [MAIN ] GPJA: Filtered 6966 bins outside market hours, 7761 incomplete bins [2025-10-02T22:39:24.579440] [INFO ] [MAIN ] GPJA: Generated 1805 derivative records from 4260 primary records. [2025-10-02T22:39:24.579746] [DEBUG] [LOCAL ] GPJA: Saving derivative data. [2025-10-02T22:39:24.596170] [DEBUG] [LOCAL ] GPI: Derivative data saved (1807 records). [2025-10-02T22:39:24.596940] [INFO ] [MAIN ] GPI: Successfully saved derivative data. [2025-10-02T22:39:24.599880] [INFO ] [MAIN ] Derivative Progress: 794/1975 symbols completed. GPI took 0.9s. Estimated remaining: 8m 19s. Rate: 142.1 symbols/min [2025-10-02T22:39:24.603436] [DEBUG] [LOCAL ] GPJA: Derivative data saved (1805 records). [2025-10-02T22:39:24.603591] [INFO ] [MAIN ] GPJA: Successfully saved derivative data. [2025-10-02T22:39:24.605661] [INFO ] [MAIN ] Derivative Progress: 795/1975 symbols completed. GPJA took 0.9s. Estimated remaining: 8m 18s. Rate: 142.3 symbols/min [2025-10-02T22:39:24.606390] [INFO ] [MAIN ] GPMT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:24.606554] [INFO ] [MAIN ] GPN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:24.606302] [INFO ] [MAIN ] GPK: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:24.645633] [DEBUG] [LOCAL ] GPMT: Loaded 26208 existing records from primary storage. [2025-10-02T22:39:24.660805] [INFO ] [MAIN ] GPMT: Loaded 26208 primary data records. [2025-10-02T22:39:24.816212] [DEBUG] [LOCAL ] GPN: Loaded 52423 existing records from primary storage. [2025-10-02T22:39:24.839028] [DEBUG] [LOCAL ] GPK: Loaded 53044 existing records from primary storage. [2025-10-02T22:39:24.844369] [INFO ] [MAIN ] GPK: Loaded 53044 primary data records. [2025-10-02T22:39:24.832588] [INFO ] [MAIN ] GPN: Loaded 52423 primary data records. [2025-10-02T22:39:25.756025] [DEBUG] [MAIN ] GPMT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:25.757295] [INFO ] [MAIN ] GPMT: Generated 1807 derivative records from 26208 primary records. [2025-10-02T22:39:25.757495] [DEBUG] [LOCAL ] GPMT: Saving derivative data. [2025-10-02T22:39:25.805560] [DEBUG] [LOCAL ] GPMT: Derivative data saved (1807 records). [2025-10-02T22:39:25.800178] [DEBUG] [MAIN ] GPN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:25.805715] [INFO ] [MAIN ] GPMT: Successfully saved derivative data. [2025-10-02T22:39:25.808840] [INFO ] [MAIN ] Derivative Progress: 796/1975 symbols completed. GPMT took 1.2s. Estimated remaining: 8m 18s. Rate: 142.0 symbols/min [2025-10-02T22:39:25.809301] [DEBUG] [MAIN ] GPK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:25.806563] [INFO ] [MAIN ] GPN: Generated 1807 derivative records from 52423 primary records. [2025-10-02T22:39:25.809419] [DEBUG] [LOCAL ] GPN: Saving derivative data. [2025-10-02T22:39:25.809540] [INFO ] [MAIN ] GPOR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:25.811679] [INFO ] [MAIN ] GPK: Generated 1807 derivative records from 53044 primary records. [2025-10-02T22:39:25.822993] [DEBUG] [LOCAL ] GPK: Saving derivative data. [2025-10-02T22:39:25.828467] [DEBUG] [LOCAL ] GPN: Derivative data saved (1807 records). [2025-10-02T22:39:25.828769] [INFO ] [MAIN ] GPN: Successfully saved derivative data. [2025-10-02T22:39:25.831121] [INFO ] [MAIN ] Derivative Progress: 797/1975 symbols completed. GPN took 1.2s. Estimated remaining: 8m 17s. Rate: 142.1 symbols/min [2025-10-02T22:39:25.838959] [INFO ] [MAIN ] GPRK: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:25.857279] [DEBUG] [LOCAL ] GPK: Derivative data saved (1807 records). [2025-10-02T22:39:25.857610] [INFO ] [MAIN ] GPK: Successfully saved derivative data. [2025-10-02T22:39:25.859759] [INFO ] [MAIN ] Derivative Progress: 798/1975 symbols completed. GPK took 1.3s. Estimated remaining: 8m 16s. Rate: 142.3 symbols/min [2025-10-02T22:39:25.860050] [INFO ] [MAIN ] GRBK: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:25.884754] [DEBUG] [LOCAL ] GPOR: Loaded 23347 existing records from primary storage. [2025-10-02T22:39:25.885041] [INFO ] [MAIN ] GPOR: Loaded 23347 primary data records. [2025-10-02T22:39:26.021906] [DEBUG] [LOCAL ] GPRK: Loaded 39690 existing records from primary storage. [2025-10-02T22:39:26.035756] [INFO ] [MAIN ] GPRK: Loaded 39690 primary data records. [2025-10-02T22:39:26.047681] [DEBUG] [LOCAL ] GRBK: Loaded 27074 existing records from primary storage. [2025-10-02T22:39:26.087786] [INFO ] [MAIN ] GRBK: Loaded 27074 primary data records. [2025-10-02T22:39:26.973277] [DEBUG] [MAIN ] GPOR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:26.975795] [INFO ] [MAIN ] GPOR: Generated 1807 derivative records from 23347 primary records. [2025-10-02T22:39:26.976388] [DEBUG] [LOCAL ] GPOR: Saving derivative data. [2025-10-02T22:39:27.009030] [DEBUG] [LOCAL ] GPOR: Derivative data saved (1807 records). [2025-10-02T22:39:27.017682] [INFO ] [MAIN ] GPOR: Successfully saved derivative data. [2025-10-02T22:39:27.025321] [INFO ] [MAIN ] Derivative Progress: 799/1975 symbols completed. GPOR took 1.2s. Estimated remaining: 8m 17s. Rate: 142.0 symbols/min [2025-10-02T22:39:27.039313] [DEBUG] [MAIN ] GPRK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:27.039752] [INFO ] [MAIN ] GRC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:27.041043] [DEBUG] [MAIN ] GRBK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:27.040784] [INFO ] [MAIN ] GPRK: Generated 1807 derivative records from 39690 primary records. [2025-10-02T22:39:27.041621] [DEBUG] [LOCAL ] GPRK: Saving derivative data. [2025-10-02T22:39:27.042846] [INFO ] [MAIN ] GRBK: Generated 1807 derivative records from 27074 primary records. [2025-10-02T22:39:27.043138] [DEBUG] [LOCAL ] GRBK: Saving derivative data. [2025-10-02T22:39:27.072488] [DEBUG] [LOCAL ] GPRK: Derivative data saved (1807 records). [2025-10-02T22:39:27.075743] [INFO ] [MAIN ] GPRK: Successfully saved derivative data. [2025-10-02T22:39:27.079916] [INFO ] [MAIN ] Derivative Progress: 800/1975 symbols completed. GPRK took 1.2s. Estimated remaining: 8m 16s. Rate: 142.1 symbols/min [2025-10-02T22:39:27.080211] [INFO ] [MAIN ] GRDN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:27.086206] [DEBUG] [LOCAL ] GRC: Loaded 9062 existing records from primary storage. [2025-10-02T22:39:27.088614] [INFO ] [MAIN ] GRC: Loaded 9062 primary data records. [2025-10-02T22:39:27.132989] [DEBUG] [LOCAL ] GRBK: Derivative data saved (1807 records). [2025-10-02T22:39:27.170183] [INFO ] [MAIN ] GRBK: Successfully saved derivative data. [2025-10-02T22:39:27.205210] [INFO ] [MAIN ] Derivative Progress: 801/1975 symbols completed. GRBK took 1.3s. Estimated remaining: 8m 15s. Rate: 142.3 symbols/min [2025-10-02T22:39:27.218291] [INFO ] [MAIN ] GRMN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:27.268014] [DEBUG] [LOCAL ] GRDN: Loaded 20716 existing records from primary storage. [2025-10-02T22:39:27.287303] [INFO ] [MAIN ] GRDN: Loaded 20716 primary data records. [2025-10-02T22:39:27.815554] [DEBUG] [LOCAL ] GRMN: Loaded 41310 existing records from primary storage. [2025-10-02T22:39:27.816954] [INFO ] [MAIN ] GRMN: Loaded 41310 primary data records. [2025-10-02T22:39:28.014912] [DEBUG] [MAIN ] GRC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:28.042818] [INFO ] [MAIN ] GRC: Generated 1807 derivative records from 9062 primary records. [2025-10-02T22:39:28.187696] [DEBUG] [LOCAL ] GRC: Saving derivative data. [2025-10-02T22:39:28.228418] [DEBUG] [MAIN ] GRDN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:28.230437] [INFO ] [MAIN ] GRDN: Generated 1807 derivative records from 20716 primary records. [2025-10-02T22:39:28.231388] [DEBUG] [LOCAL ] GRDN: Saving derivative data. [2025-10-02T22:39:28.254363] [DEBUG] [LOCAL ] GRC: Derivative data saved (1807 records). [2025-10-02T22:39:28.255085] [INFO ] [MAIN ] GRC: Successfully saved derivative data. [2025-10-02T22:39:28.258290] [INFO ] [MAIN ] Derivative Progress: 802/1975 symbols completed. GRC took 1.2s. Estimated remaining: 8m 16s. Rate: 142.0 symbols/min [2025-10-02T22:39:28.256099] [DEBUG] [LOCAL ] GRDN: Derivative data saved (1807 records). [2025-10-02T22:39:28.258780] [INFO ] [MAIN ] GRDN: Successfully saved derivative data. [2025-10-02T22:39:28.258926] [INFO ] [MAIN ] GRND: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:28.262692] [INFO ] [MAIN ] Derivative Progress: 803/1975 symbols completed. GRDN took 1.2s. Estimated remaining: 8m 15s. Rate: 142.2 symbols/min [2025-10-02T22:39:28.263168] [INFO ] [MAIN ] GRNT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:28.289008] [DEBUG] [MAIN ] GRMN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:28.290211] [INFO ] [MAIN ] GRMN: Generated 1807 derivative records from 41310 primary records. [2025-10-02T22:39:28.290436] [DEBUG] [LOCAL ] GRMN: Saving derivative data. [2025-10-02T22:39:28.332144] [DEBUG] [LOCAL ] GRMN: Derivative data saved (1807 records). [2025-10-02T22:39:28.332509] [INFO ] [MAIN ] GRMN: Successfully saved derivative data. [2025-10-02T22:39:28.336066] [DEBUG] [LOCAL ] GRNT: Loaded 34012 existing records from primary storage. [2025-10-02T22:39:28.334889] [INFO ] [MAIN ] Derivative Progress: 804/1975 symbols completed. GRMN took 1.1s. Estimated remaining: 8m 14s. Rate: 142.3 symbols/min [2025-10-02T22:39:28.336610] [INFO ] [MAIN ] GRNT: Loaded 34012 primary data records. [2025-10-02T22:39:28.336318] [INFO ] [MAIN ] GROV: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:28.498377] [DEBUG] [LOCAL ] GROV: Loaded 8931 existing records from primary storage. [2025-10-02T22:39:28.511268] [INFO ] [MAIN ] GROV: Loaded 8931 primary data records. [2025-10-02T22:39:28.518240] [DEBUG] [LOCAL ] GRND: Loaded 50304 existing records from primary storage. [2025-10-02T22:39:28.583679] [INFO ] [MAIN ] GRND: Loaded 50304 primary data records. [2025-10-02T22:39:29.485293] [DEBUG] [MAIN ] GRNT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:29.487537] [INFO ] [MAIN ] GRNT: Generated 1807 derivative records from 34012 primary records. [2025-10-02T22:39:29.487760] [DEBUG] [LOCAL ] GRNT: Saving derivative data. [2025-10-02T22:39:29.512200] [DEBUG] [LOCAL ] GRNT: Derivative data saved (1807 records). [2025-10-02T22:39:29.514027] [INFO ] [MAIN ] GRNT: Successfully saved derivative data. [2025-10-02T22:39:29.517320] [INFO ] [MAIN ] Derivative Progress: 805/1975 symbols completed. GRNT took 1.3s. Estimated remaining: 8m 14s. Rate: 142.0 symbols/min [2025-10-02T22:39:29.517625] [INFO ] [MAIN ] GRX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:29.545265] [DEBUG] [MAIN ] GROV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:29.546723] [INFO ] [MAIN ] GROV: Generated 1807 derivative records from 8931 primary records. [2025-10-02T22:39:29.545811] [DEBUG] [MAIN ] GRND: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:29.548240] [DEBUG] [LOCAL ] GROV: Saving derivative data. [2025-10-02T22:39:29.549040] [INFO ] [MAIN ] GRND: Generated 1807 derivative records from 50304 primary records. [2025-10-02T22:39:29.550036] [DEBUG] [LOCAL ] GRND: Saving derivative data. [2025-10-02T22:39:29.561625] [DEBUG] [LOCAL ] GRX: Loaded 4740 existing records from primary storage. [2025-10-02T22:39:29.565749] [INFO ] [MAIN ] GRX: Loaded 4740 primary data records. [2025-10-02T22:39:29.724265] [DEBUG] [LOCAL ] GROV: Derivative data saved (1807 records). [2025-10-02T22:39:29.729686] [INFO ] [MAIN ] GROV: Successfully saved derivative data. [2025-10-02T22:39:29.737932] [INFO ] [MAIN ] Derivative Progress: 806/1975 symbols completed. GROV took 1.4s. Estimated remaining: 8m 14s. Rate: 142.1 symbols/min [2025-10-02T22:39:29.789321] [DEBUG] [LOCAL ] GRND: Derivative data saved (1807 records). [2025-10-02T22:39:29.907571] [INFO ] [MAIN ] GRND: Successfully saved derivative data. [2025-10-02T22:39:29.912964] [INFO ] [MAIN ] GS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:29.924741] [INFO ] [MAIN ] Derivative Progress: 807/1975 symbols completed. GRND took 1.7s. Estimated remaining: 8m 13s. Rate: 142.2 symbols/min [2025-10-02T22:39:29.925704] [INFO ] [MAIN ] GSBD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:29.955076] [DEBUG] [MAIN ] GRX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:29.956055] [INFO ] [MAIN ] GRX: Generated 1807 derivative records from 4740 primary records. [2025-10-02T22:39:29.956310] [DEBUG] [LOCAL ] GRX: Saving derivative data. [2025-10-02T22:39:29.972597] [DEBUG] [LOCAL ] GRX: Derivative data saved (1807 records). [2025-10-02T22:39:29.972785] [INFO ] [MAIN ] GRX: Successfully saved derivative data. [2025-10-02T22:39:29.974816] [INFO ] [MAIN ] Derivative Progress: 808/1975 symbols completed. GRX took 0.5s. Estimated remaining: 8m 12s. Rate: 142.3 symbols/min [2025-10-02T22:39:30.015870] [DEBUG] [LOCAL ] GSBD: Loaded 39460 existing records from primary storage. [2025-10-02T22:39:30.031466] [INFO ] [MAIN ] GSBD: Loaded 39460 primary data records. [2025-10-02T22:39:30.057021] [DEBUG] [LOCAL ] GS: Loaded 52244 existing records from primary storage. [2025-10-02T22:39:30.105827] [INFO ] [MAIN ] GS: Loaded 52244 primary data records. [2025-10-02T22:39:30.744293] [DEBUG] [MAIN ] GSBD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:30.745244] [INFO ] [MAIN ] GSBD: Generated 1807 derivative records from 39460 primary records. [2025-10-02T22:39:30.745561] [DEBUG] [LOCAL ] GSBD: Saving derivative data. [2025-10-02T22:39:30.777904] [DEBUG] [MAIN ] GS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:30.779379] [INFO ] [MAIN ] GS: Generated 1807 derivative records from 52244 primary records. [2025-10-02T22:39:30.780116] [DEBUG] [LOCAL ] GS: Saving derivative data. [2025-10-02T22:39:30.780765] [DEBUG] [LOCAL ] GSBD: Derivative data saved (1807 records). [2025-10-02T22:39:30.781585] [INFO ] [MAIN ] GSBD: Successfully saved derivative data. [2025-10-02T22:39:30.783542] [INFO ] [MAIN ] Derivative Progress: 809/1975 symbols completed. GSBD took 0.9s. Estimated remaining: 8m 12s. Rate: 142.2 symbols/min [2025-10-02T22:39:30.800034] [DEBUG] [LOCAL ] GS: Derivative data saved (1807 records). [2025-10-02T22:39:30.800115] [INFO ] [MAIN ] GS: Successfully saved derivative data. [2025-10-02T22:39:30.809003] [INFO ] [MAIN ] Derivative Progress: 810/1975 symbols completed. GS took 0.9s. Estimated remaining: 8m 11s. Rate: 142.3 symbols/min [2025-10-02T22:39:30.809609] [INFO ] [MAIN ] GSL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:30.809499] [INFO ] [MAIN ] GSK: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:30.809901] [INFO ] [MAIN ] GTES: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:30.878999] [DEBUG] [LOCAL ] GSL: Loaded 33513 existing records from primary storage. [2025-10-02T22:39:30.893249] [INFO ] [MAIN ] GSL: Loaded 33513 primary data records. [2025-10-02T22:39:30.936052] [DEBUG] [LOCAL ] GTES: Loaded 50882 existing records from primary storage. [2025-10-02T22:39:30.983229] [INFO ] [MAIN ] GTES: Loaded 50882 primary data records. [2025-10-02T22:39:31.094482] [DEBUG] [LOCAL ] GSK: Loaded 53882 existing records from primary storage. [2025-10-02T22:39:31.131697] [INFO ] [MAIN ] GSK: Loaded 53882 primary data records. [2025-10-02T22:39:31.965950] [DEBUG] [MAIN ] GSL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:31.967923] [INFO ] [MAIN ] GSL: Generated 1807 derivative records from 33513 primary records. [2025-10-02T22:39:31.968171] [DEBUG] [LOCAL ] GSL: Saving derivative data. [2025-10-02T22:39:31.999674] [DEBUG] [MAIN ] GTES: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:32.001338] [INFO ] [MAIN ] GTES: Generated 1807 derivative records from 50882 primary records. [2025-10-02T22:39:32.001749] [DEBUG] [LOCAL ] GTES: Saving derivative data. [2025-10-02T22:39:32.012458] [DEBUG] [LOCAL ] GSL: Derivative data saved (1807 records). [2025-10-02T22:39:32.016023] [INFO ] [MAIN ] GSL: Successfully saved derivative data. [2025-10-02T22:39:32.019997] [INFO ] [MAIN ] Derivative Progress: 811/1975 symbols completed. GSL took 1.2s. Estimated remaining: 8m 12s. Rate: 142.0 symbols/min [2025-10-02T22:39:32.021583] [INFO ] [MAIN ] GTN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:32.040017] [DEBUG] [LOCAL ] GTES: Derivative data saved (1807 records). [2025-10-02T22:39:32.039380] [DEBUG] [MAIN ] GSK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:32.040274] [INFO ] [MAIN ] GTES: Successfully saved derivative data. [2025-10-02T22:39:32.041068] [INFO ] [MAIN ] GSK: Generated 1807 derivative records from 53882 primary records. [2025-10-02T22:39:32.043930] [INFO ] [MAIN ] Derivative Progress: 812/1975 symbols completed. GTES took 1.2s. Estimated remaining: 8m 11s. Rate: 142.2 symbols/min [2025-10-02T22:39:32.044269] [DEBUG] [LOCAL ] GSK: Saving derivative data. [2025-10-02T22:39:32.044440] [INFO ] [MAIN ] GTY: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:32.062521] [DEBUG] [LOCAL ] GSK: Derivative data saved (1807 records). [2025-10-02T22:39:32.062694] [INFO ] [MAIN ] GSK: Successfully saved derivative data. [2025-10-02T22:39:32.081994] [INFO ] [MAIN ] Derivative Progress: 813/1975 symbols completed. GSK took 1.3s. Estimated remaining: 8m 10s. Rate: 142.3 symbols/min [2025-10-02T22:39:32.082332] [INFO ] [MAIN ] GUG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:32.142295] [DEBUG] [LOCAL ] GTN: Loaded 45825 existing records from primary storage. [2025-10-02T22:39:32.141050] [DEBUG] [LOCAL ] GUG: Loaded 12171 existing records from primary storage. [2025-10-02T22:39:32.142492] [INFO ] [MAIN ] GTN: Loaded 45825 primary data records. [2025-10-02T22:39:32.149007] [INFO ] [MAIN ] GUG: Loaded 12171 primary data records. [2025-10-02T22:39:32.143570] [DEBUG] [LOCAL ] GTY: Loaded 30501 existing records from primary storage. [2025-10-02T22:39:32.206259] [INFO ] [MAIN ] GTY: Loaded 30501 primary data records. [2025-10-02T22:39:33.247157] [DEBUG] [MAIN ] GUG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:33.252631] [INFO ] [MAIN ] GUG: Generated 1807 derivative records from 12171 primary records. [2025-10-02T22:39:33.252965] [DEBUG] [LOCAL ] GUG: Saving derivative data. [2025-10-02T22:39:33.253389] [DEBUG] [MAIN ] GTN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:33.254199] [INFO ] [MAIN ] GTN: Generated 1807 derivative records from 45825 primary records. [2025-10-02T22:39:33.254967] [DEBUG] [LOCAL ] GTN: Saving derivative data. [2025-10-02T22:39:33.287970] [DEBUG] [LOCAL ] GUG: Derivative data saved (1807 records). [2025-10-02T22:39:33.301159] [INFO ] [MAIN ] GUG: Successfully saved derivative data. [2025-10-02T22:39:33.302076] [DEBUG] [LOCAL ] GTN: Derivative data saved (1807 records). [2025-10-02T22:39:33.302416] [DEBUG] [MAIN ] GTY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:33.302475] [INFO ] [MAIN ] GTN: Successfully saved derivative data. [2025-10-02T22:39:33.305491] [INFO ] [MAIN ] GTY: Generated 1807 derivative records from 30501 primary records. [2025-10-02T22:39:33.304673] [INFO ] [MAIN ] Derivative Progress: 814/1975 symbols completed. GUG took 1.2s. Estimated remaining: 8m 11s. Rate: 142.0 symbols/min [2025-10-02T22:39:33.307572] [DEBUG] [LOCAL ] GTY: Saving derivative data. [2025-10-02T22:39:33.308713] [INFO ] [MAIN ] Derivative Progress: 815/1975 symbols completed. GTN took 1.3s. Estimated remaining: 8m 10s. Rate: 142.2 symbols/min [2025-10-02T22:39:33.307829] [INFO ] [MAIN ] GUT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:33.308931] [INFO ] [MAIN ] GVA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:33.331825] [DEBUG] [LOCAL ] GTY: Derivative data saved (1807 records). [2025-10-02T22:39:33.332004] [INFO ] [MAIN ] GTY: Successfully saved derivative data. [2025-10-02T22:39:33.334242] [INFO ] [MAIN ] Derivative Progress: 816/1975 symbols completed. GTY took 1.3s. Estimated remaining: 8m 9s. Rate: 142.3 symbols/min [2025-10-02T22:39:33.334443] [INFO ] [MAIN ] GWH: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:33.342115] [DEBUG] [LOCAL ] GUT: Loaded 15401 existing records from primary storage. [2025-10-02T22:39:33.342769] [INFO ] [MAIN ] GUT: Loaded 15401 primary data records. [2025-10-02T22:39:33.500101] [DEBUG] [LOCAL ] GVA: Loaded 33350 existing records from primary storage. [2025-10-02T22:39:33.500396] [INFO ] [MAIN ] GVA: Loaded 33350 primary data records. [2025-10-02T22:39:33.535625] [DEBUG] [LOCAL ] GWH: Loaded 16198 existing records from primary storage. [2025-10-02T22:39:33.589513] [INFO ] [MAIN ] GWH: Loaded 16198 primary data records. [2025-10-02T22:39:34.479500] [DEBUG] [MAIN ] GUT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:34.481531] [INFO ] [MAIN ] GUT: Generated 1807 derivative records from 15401 primary records. [2025-10-02T22:39:34.481677] [DEBUG] [LOCAL ] GUT: Saving derivative data. [2025-10-02T22:39:34.516117] [DEBUG] [MAIN ] GWH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:34.517922] [INFO ] [MAIN ] GWH: Generated 1807 derivative records from 16198 primary records. [2025-10-02T22:39:34.519337] [DEBUG] [LOCAL ] GWH: Saving derivative data. [2025-10-02T22:39:34.519247] [DEBUG] [LOCAL ] GUT: Derivative data saved (1807 records). [2025-10-02T22:39:34.520882] [INFO ] [MAIN ] GUT: Successfully saved derivative data. [2025-10-02T22:39:34.523110] [INFO ] [MAIN ] Derivative Progress: 817/1975 symbols completed. GUT took 1.2s. Estimated remaining: 8m 9s. Rate: 142.0 symbols/min [2025-10-02T22:39:34.523991] [INFO ] [MAIN ] IAG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:34.545344] [DEBUG] [LOCAL ] GWH: Derivative data saved (1807 records). [2025-10-02T22:39:34.546696] [INFO ] [MAIN ] GWH: Successfully saved derivative data. [2025-10-02T22:39:34.549597] [INFO ] [MAIN ] Derivative Progress: 818/1975 symbols completed. GWH took 1.2s. Estimated remaining: 8m 8s. Rate: 142.2 symbols/min [2025-10-02T22:39:34.550231] [INFO ] [MAIN ] IBM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:34.572198] [DEBUG] [MAIN ] GVA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:34.573473] [INFO ] [MAIN ] GVA: Generated 1807 derivative records from 33350 primary records. [2025-10-02T22:39:34.573812] [DEBUG] [LOCAL ] GVA: Saving derivative data. [2025-10-02T22:39:34.602482] [DEBUG] [LOCAL ] GVA: Derivative data saved (1807 records). [2025-10-02T22:39:34.602731] [INFO ] [MAIN ] GVA: Successfully saved derivative data. [2025-10-02T22:39:34.604945] [INFO ] [MAIN ] Derivative Progress: 819/1975 symbols completed. GVA took 1.3s. Estimated remaining: 8m 7s. Rate: 142.3 symbols/min [2025-10-02T22:39:34.605412] [INFO ] [MAIN ] IBN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:34.657073] [DEBUG] [LOCAL ] IAG: Loaded 53844 existing records from primary storage. [2025-10-02T22:39:34.657374] [INFO ] [MAIN ] IAG: Loaded 53844 primary data records. [2025-10-02T22:39:34.828574] [DEBUG] [LOCAL ] IBM: Loaded 54023 existing records from primary storage. [2025-10-02T22:39:34.850770] [INFO ] [MAIN ] IBM: Loaded 54023 primary data records. [2025-10-02T22:39:35.071586] [DEBUG] [LOCAL ] IBN: Loaded 53259 existing records from primary storage. [2025-10-02T22:39:35.094439] [INFO ] [MAIN ] IBN: Loaded 53259 primary data records. [2025-10-02T22:39:35.801087] [DEBUG] [MAIN ] IAG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:35.803346] [INFO ] [MAIN ] IAG: Generated 1807 derivative records from 53844 primary records. [2025-10-02T22:39:35.804351] [DEBUG] [LOCAL ] IAG: Saving derivative data. [2025-10-02T22:39:35.837475] [DEBUG] [LOCAL ] IAG: Derivative data saved (1807 records). [2025-10-02T22:39:35.838576] [INFO ] [MAIN ] IAG: Successfully saved derivative data. [2025-10-02T22:39:35.838140] [DEBUG] [MAIN ] IBM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:35.839445] [INFO ] [MAIN ] IBM: Generated 1807 derivative records from 54023 primary records. [2025-10-02T22:39:35.842112] [INFO ] [MAIN ] Derivative Progress: 820/1975 symbols completed. IAG took 1.3s. Estimated remaining: 8m 8s. Rate: 142.0 symbols/min [2025-10-02T22:39:35.842268] [DEBUG] [LOCAL ] IBM: Saving derivative data. [2025-10-02T22:39:35.842496] [INFO ] [MAIN ] IBP: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:35.865267] [DEBUG] [LOCAL ] IBM: Derivative data saved (1807 records). [2025-10-02T22:39:35.865493] [INFO ] [MAIN ] IBM: Successfully saved derivative data. [2025-10-02T22:39:35.876003] [INFO ] [MAIN ] Derivative Progress: 821/1975 symbols completed. IBM took 1.3s. Estimated remaining: 8m 7s. Rate: 142.2 symbols/min [2025-10-02T22:39:35.881900] [INFO ] [MAIN ] IBTA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:35.881627] [DEBUG] [MAIN ] IBN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:35.883185] [INFO ] [MAIN ] IBN: Generated 1807 derivative records from 53259 primary records. [2025-10-02T22:39:35.883431] [DEBUG] [LOCAL ] IBN: Saving derivative data. [2025-10-02T22:39:35.908925] [DEBUG] [LOCAL ] IBN: Derivative data saved (1807 records). [2025-10-02T22:39:35.909077] [INFO ] [MAIN ] IBN: Successfully saved derivative data. [2025-10-02T22:39:35.911442] [INFO ] [MAIN ] Derivative Progress: 822/1975 symbols completed. IBN took 1.3s. Estimated remaining: 8m 6s. Rate: 142.3 symbols/min [2025-10-02T22:39:35.911932] [INFO ] [MAIN ] ICE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:35.931690] [DEBUG] [LOCAL ] IBP: Loaded 29050 existing records from primary storage. [2025-10-02T22:39:35.932021] [INFO ] [MAIN ] IBP: Loaded 29050 primary data records. [2025-10-02T22:39:36.036071] [DEBUG] [LOCAL ] IBTA: Loaded 37847 existing records from primary storage. [2025-10-02T22:39:36.048557] [INFO ] [MAIN ] IBTA: Loaded 37847 primary data records. [2025-10-02T22:39:36.514431] [DEBUG] [LOCAL ] ICE: Loaded 53392 existing records from primary storage. [2025-10-02T22:39:36.515016] [INFO ] [MAIN ] ICE: Loaded 53392 primary data records. [2025-10-02T22:39:37.026237] [DEBUG] [MAIN ] IBP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:37.029815] [INFO ] [MAIN ] IBP: Generated 1807 derivative records from 29050 primary records. [2025-10-02T22:39:37.030031] [DEBUG] [LOCAL ] IBP: Saving derivative data. [2025-10-02T22:39:37.069004] [DEBUG] [MAIN ] IBTA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:37.073795] [INFO ] [MAIN ] IBTA: Generated 1807 derivative records from 37847 primary records. [2025-10-02T22:39:37.074413] [DEBUG] [LOCAL ] IBTA: Saving derivative data. [2025-10-02T22:39:37.092195] [DEBUG] [LOCAL ] IBP: Derivative data saved (1807 records). [2025-10-02T22:39:37.094170] [INFO ] [MAIN ] IBP: Successfully saved derivative data. [2025-10-02T22:39:37.097372] [INFO ] [MAIN ] Derivative Progress: 823/1975 symbols completed. IBP took 1.3s. Estimated remaining: 8m 7s. Rate: 142.0 symbols/min [2025-10-02T22:39:37.100869] [DEBUG] [LOCAL ] IBTA: Derivative data saved (1807 records). [2025-10-02T22:39:37.101539] [INFO ] [MAIN ] IBTA: Successfully saved derivative data. [2025-10-02T22:39:37.104145] [INFO ] [MAIN ] Derivative Progress: 824/1975 symbols completed. IBTA took 1.2s. Estimated remaining: 8m 6s. Rate: 142.2 symbols/min [2025-10-02T22:39:37.121415] [DEBUG] [MAIN ] ICE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:37.122257] [INFO ] [MAIN ] ICE: Generated 1807 derivative records from 53392 primary records. [2025-10-02T22:39:37.122325] [DEBUG] [LOCAL ] ICE: Saving derivative data. [2025-10-02T22:39:37.139050] [DEBUG] [LOCAL ] ICE: Derivative data saved (1807 records). [2025-10-02T22:39:37.139136] [INFO ] [MAIN ] ICE: Successfully saved derivative data. [2025-10-02T22:39:37.141325] [INFO ] [MAIN ] Derivative Progress: 825/1975 symbols completed. ICE took 1.2s. Estimated remaining: 8m 5s. Rate: 142.3 symbols/min [2025-10-02T22:39:37.141870] [INFO ] [MAIN ] IDE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:37.142366] [INFO ] [MAIN ] ICL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:37.141996] [INFO ] [MAIN ] IDA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:37.155156] [DEBUG] [LOCAL ] IDE: Loaded 8807 existing records from primary storage. [2025-10-02T22:39:37.155496] [INFO ] [MAIN ] IDE: Loaded 8807 primary data records. [2025-10-02T22:39:37.360020] [DEBUG] [LOCAL ] IDA: Loaded 32394 existing records from primary storage. [2025-10-02T22:39:37.552930] [INFO ] [MAIN ] IDA: Loaded 32394 primary data records. [2025-10-02T22:39:37.554522] [DEBUG] [LOCAL ] ICL: Loaded 38682 existing records from primary storage. [2025-10-02T22:39:37.559768] [INFO ] [MAIN ] ICL: Loaded 38682 primary data records. [2025-10-02T22:39:38.282055] [DEBUG] [MAIN ] IDE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:38.283400] [INFO ] [MAIN ] IDE: Generated 1807 derivative records from 8807 primary records. [2025-10-02T22:39:38.283558] [DEBUG] [LOCAL ] IDE: Saving derivative data. [2025-10-02T22:39:38.304354] [DEBUG] [LOCAL ] IDE: Derivative data saved (1807 records). [2025-10-02T22:39:38.304720] [INFO ] [MAIN ] IDE: Successfully saved derivative data. [2025-10-02T22:39:38.307235] [INFO ] [MAIN ] Derivative Progress: 826/1975 symbols completed. IDE took 1.2s. Estimated remaining: 8m 5s. Rate: 142.0 symbols/min [2025-10-02T22:39:38.307684] [INFO ] [MAIN ] IDT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:38.335172] [DEBUG] [MAIN ] IDA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:38.336091] [INFO ] [MAIN ] IDA: Generated 1807 derivative records from 32394 primary records. [2025-10-02T22:39:38.336226] [DEBUG] [LOCAL ] IDA: Saving derivative data. [2025-10-02T22:39:38.372781] [DEBUG] [MAIN ] ICL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:38.376162] [INFO ] [MAIN ] ICL: Generated 1807 derivative records from 38682 primary records. [2025-10-02T22:39:38.377841] [DEBUG] [LOCAL ] ICL: Saving derivative data. [2025-10-02T22:39:38.376636] [DEBUG] [LOCAL ] IDT: Loaded 18168 existing records from primary storage. [2025-10-02T22:39:38.378057] [INFO ] [MAIN ] IDT: Loaded 18168 primary data records. [2025-10-02T22:39:38.442828] [DEBUG] [LOCAL ] ICL: Derivative data saved (1807 records). [2025-10-02T22:39:38.456546] [INFO ] [MAIN ] ICL: Successfully saved derivative data. [2025-10-02T22:39:38.459971] [DEBUG] [LOCAL ] IDA: Derivative data saved (1807 records). [2025-10-02T22:39:38.459879] [INFO ] [MAIN ] Derivative Progress: 827/1975 symbols completed. ICL took 1.3s. Estimated remaining: 8m 5s. Rate: 142.1 symbols/min [2025-10-02T22:39:38.471292] [INFO ] [MAIN ] IDA: Successfully saved derivative data. [2025-10-02T22:39:38.479141] [INFO ] [MAIN ] IEX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:38.506358] [INFO ] [MAIN ] Derivative Progress: 828/1975 symbols completed. IDA took 1.3s. Estimated remaining: 8m 4s. Rate: 142.3 symbols/min [2025-10-02T22:39:38.519101] [INFO ] [MAIN ] IFF: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:38.801445] [DEBUG] [MAIN ] IDT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:38.816512] [INFO ] [MAIN ] IDT: Generated 1807 derivative records from 18168 primary records. [2025-10-02T22:39:38.817919] [DEBUG] [LOCAL ] IDT: Saving derivative data. [2025-10-02T22:39:38.820315] [DEBUG] [LOCAL ] IEX: Loaded 38652 existing records from primary storage. [2025-10-02T22:39:38.828562] [INFO ] [MAIN ] IEX: Loaded 38652 primary data records. [2025-10-02T22:39:38.891474] [DEBUG] [LOCAL ] IDT: Derivative data saved (1807 records). [2025-10-02T22:39:38.901200] [DEBUG] [LOCAL ] IFF: Loaded 51357 existing records from primary storage. [2025-10-02T22:39:38.915024] [INFO ] [MAIN ] IDT: Successfully saved derivative data. [2025-10-02T22:39:38.924538] [INFO ] [MAIN ] IFF: Loaded 51357 primary data records. [2025-10-02T22:39:38.926742] [INFO ] [MAIN ] Derivative Progress: 829/1975 symbols completed. IDT took 0.6s. Estimated remaining: 8m 3s. Rate: 142.3 symbols/min [2025-10-02T22:39:38.926966] [INFO ] [MAIN ] IFN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:39.400849] [DEBUG] [LOCAL ] IFN: Loaded 18372 existing records from primary storage. [2025-10-02T22:39:39.401757] [INFO ] [MAIN ] IFN: Loaded 18372 primary data records. [2025-10-02T22:39:39.936775] [DEBUG] [MAIN ] IEX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:39.938940] [INFO ] [MAIN ] IEX: Generated 1807 derivative records from 38652 primary records. [2025-10-02T22:39:39.939299] [DEBUG] [LOCAL ] IEX: Saving derivative data. [2025-10-02T22:39:39.962751] [DEBUG] [LOCAL ] IEX: Derivative data saved (1807 records). [2025-10-02T22:39:39.963153] [INFO ] [MAIN ] IEX: Successfully saved derivative data. [2025-10-02T22:39:39.980889] [INFO ] [MAIN ] Derivative Progress: 830/1975 symbols completed. IEX took 1.5s. Estimated remaining: 8m 4s. Rate: 142.0 symbols/min [2025-10-02T22:39:39.977766] [DEBUG] [MAIN ] IFF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:39.982082] [INFO ] [MAIN ] IFF: Generated 1807 derivative records from 51357 primary records. [2025-10-02T22:39:39.982560] [INFO ] [MAIN ] IFS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:39.983409] [DEBUG] [LOCAL ] IFF: Saving derivative data. [2025-10-02T22:39:40.026879] [DEBUG] [LOCAL ] IFF: Derivative data saved (1807 records). [2025-10-02T22:39:40.027719] [INFO ] [MAIN ] IFF: Successfully saved derivative data. [2025-10-02T22:39:40.027561] [DEBUG] [MAIN ] IFN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:40.030952] [INFO ] [MAIN ] IFN: Generated 1807 derivative records from 18372 primary records. [2025-10-02T22:39:40.030065] [INFO ] [MAIN ] Derivative Progress: 831/1975 symbols completed. IFF took 1.5s. Estimated remaining: 8m 3s. Rate: 142.2 symbols/min [2025-10-02T22:39:40.031326] [INFO ] [MAIN ] IGA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:40.031227] [DEBUG] [LOCAL ] IFN: Saving derivative data. [2025-10-02T22:39:40.059714] [DEBUG] [LOCAL ] IFN: Derivative data saved (1807 records). [2025-10-02T22:39:40.064137] [INFO ] [MAIN ] IFN: Successfully saved derivative data. [2025-10-02T22:39:40.067060] [INFO ] [MAIN ] Derivative Progress: 832/1975 symbols completed. IFN took 1.1s. Estimated remaining: 8m 2s. Rate: 142.3 symbols/min [2025-10-02T22:39:40.064810] [DEBUG] [LOCAL ] IFS: Loaded 23264 existing records from primary storage. [2025-10-02T22:39:40.067296] [INFO ] [MAIN ] IGD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:40.067603] [INFO ] [MAIN ] IFS: Loaded 23264 primary data records. [2025-10-02T22:39:40.120388] [DEBUG] [LOCAL ] IGA: Loaded 9918 existing records from primary storage. [2025-10-02T22:39:40.164760] [INFO ] [MAIN ] IGA: Loaded 9918 primary data records. [2025-10-02T22:39:40.292886] [DEBUG] [LOCAL ] IGD: Loaded 19256 existing records from primary storage. [2025-10-02T22:39:40.298285] [INFO ] [MAIN ] IGD: Loaded 19256 primary data records. [2025-10-02T22:39:41.111769] [DEBUG] [MAIN ] IFS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:41.124836] [INFO ] [MAIN ] IFS: Generated 1807 derivative records from 23264 primary records. [2025-10-02T22:39:41.126378] [DEBUG] [MAIN ] IGA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:41.127125] [INFO ] [MAIN ] IGA: Generated 1807 derivative records from 9918 primary records. [2025-10-02T22:39:41.127240] [DEBUG] [LOCAL ] IFS: Saving derivative data. [2025-10-02T22:39:41.127355] [DEBUG] [LOCAL ] IGA: Saving derivative data. [2025-10-02T22:39:41.172417] [DEBUG] [LOCAL ] IFS: Derivative data saved (1807 records). [2025-10-02T22:39:41.175274] [DEBUG] [MAIN ] IGD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:41.176126] [INFO ] [MAIN ] IGD: Generated 1807 derivative records from 19256 primary records. [2025-10-02T22:39:41.174961] [DEBUG] [LOCAL ] IGA: Derivative data saved (1807 records). [2025-10-02T22:39:41.176263] [DEBUG] [LOCAL ] IGD: Saving derivative data. [2025-10-02T22:39:41.176480] [INFO ] [MAIN ] IGA: Successfully saved derivative data. [2025-10-02T22:39:41.179013] [INFO ] [MAIN ] Derivative Progress: 833/1975 symbols completed. IGA took 1.1s. Estimated remaining: 8m 2s. Rate: 142.1 symbols/min [2025-10-02T22:39:41.176411] [INFO ] [MAIN ] IFS: Successfully saved derivative data. [2025-10-02T22:39:41.182585] [INFO ] [MAIN ] Derivative Progress: 834/1975 symbols completed. IFS took 1.2s. Estimated remaining: 8m 1s. Rate: 142.2 symbols/min [2025-10-02T22:39:41.183446] [INFO ] [MAIN ] IGR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:41.179249] [INFO ] [MAIN ] IGI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:41.201248] [DEBUG] [LOCAL ] IGD: Derivative data saved (1807 records). [2025-10-02T22:39:41.201445] [INFO ] [MAIN ] IGD: Successfully saved derivative data. [2025-10-02T22:39:41.203588] [INFO ] [MAIN ] Derivative Progress: 835/1975 symbols completed. IGD took 1.1s. Estimated remaining: 8m 0s. Rate: 142.4 symbols/min [2025-10-02T22:39:41.204032] [INFO ] [MAIN ] IH: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:41.207409] [DEBUG] [LOCAL ] IGI: Loaded 3658 existing records from primary storage. [2025-10-02T22:39:41.207734] [INFO ] [MAIN ] IGI: Loaded 3658 primary data records. [2025-10-02T22:39:41.282366] [DEBUG] [LOCAL ] IH: Loaded 3128 existing records from primary storage. [2025-10-02T22:39:41.301330] [INFO ] [MAIN ] IH: Loaded 3128 primary data records. [2025-10-02T22:39:41.508784] [DEBUG] [LOCAL ] IGR: Loaded 30686 existing records from primary storage. [2025-10-02T22:39:41.557336] [INFO ] [MAIN ] IGR: Loaded 30686 primary data records. [2025-10-02T22:39:42.335725] [DEBUG] [MAIN ] IGI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:42.337988] [INFO ] [MAIN ] IGI: Generated 1807 derivative records from 3658 primary records. [2025-10-02T22:39:42.338157] [DEBUG] [LOCAL ] IGI: Saving derivative data. [2025-10-02T22:39:42.363584] [DEBUG] [MAIN ] IH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:42.365288] [INFO ] [MAIN ] IH: Generated 1807 derivative records from 3128 primary records. [2025-10-02T22:39:42.365857] [DEBUG] [LOCAL ] IH: Saving derivative data. [2025-10-02T22:39:42.384270] [DEBUG] [LOCAL ] IGI: Derivative data saved (1807 records). [2025-10-02T22:39:42.385503] [DEBUG] [LOCAL ] IH: Derivative data saved (1807 records). [2025-10-02T22:39:42.385789] [INFO ] [MAIN ] IGI: Successfully saved derivative data. [2025-10-02T22:39:42.388117] [INFO ] [MAIN ] Derivative Progress: 836/1975 symbols completed. IGI took 1.2s. Estimated remaining: 8m 1s. Rate: 142.1 symbols/min [2025-10-02T22:39:42.385882] [INFO ] [MAIN ] IH: Successfully saved derivative data. [2025-10-02T22:39:42.388316] [INFO ] [MAIN ] IHD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:42.390978] [INFO ] [MAIN ] Derivative Progress: 837/1975 symbols completed. IH took 1.2s. Estimated remaining: 7m 60s. Rate: 142.3 symbols/min [2025-10-02T22:39:42.391146] [INFO ] [MAIN ] IHG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:42.414071] [DEBUG] [MAIN ] IGR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:42.415240] [INFO ] [MAIN ] IGR: Generated 1807 derivative records from 30686 primary records. [2025-10-02T22:39:42.415431] [DEBUG] [LOCAL ] IGR: Saving derivative data. [2025-10-02T22:39:42.414455] [DEBUG] [LOCAL ] IHD: Loaded 6998 existing records from primary storage. [2025-10-02T22:39:42.416329] [INFO ] [MAIN ] IHD: Loaded 6998 primary data records. [2025-10-02T22:39:42.562961] [DEBUG] [LOCAL ] IGR: Derivative data saved (1807 records). [2025-10-02T22:39:42.567838] [INFO ] [MAIN ] IGR: Successfully saved derivative data. [2025-10-02T22:39:42.570939] [INFO ] [MAIN ] Derivative Progress: 838/1975 symbols completed. IGR took 1.4s. Estimated remaining: 7m 59s. Rate: 142.4 symbols/min [2025-10-02T22:39:42.567715] [DEBUG] [LOCAL ] IHG: Loaded 24606 existing records from primary storage. [2025-10-02T22:39:42.577101] [INFO ] [MAIN ] IHG: Loaded 24606 primary data records. [2025-10-02T22:39:43.134310] [DEBUG] [MAIN ] IHD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:43.135325] [INFO ] [MAIN ] IHD: Generated 1807 derivative records from 6998 primary records. [2025-10-02T22:39:43.135620] [DEBUG] [LOCAL ] IHD: Saving derivative data. [2025-10-02T22:39:43.154321] [DEBUG] [LOCAL ] IHD: Derivative data saved (1807 records). [2025-10-02T22:39:43.154514] [INFO ] [MAIN ] IHD: Successfully saved derivative data. [2025-10-02T22:39:43.156779] [INFO ] [MAIN ] Derivative Progress: 839/1975 symbols completed. IHD took 0.8s. Estimated remaining: 7m 59s. Rate: 142.3 symbols/min [2025-10-02T22:39:43.170456] [DEBUG] [MAIN ] IHG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:43.171341] [INFO ] [MAIN ] IHG: Generated 1807 derivative records from 24606 primary records. [2025-10-02T22:39:43.171423] [DEBUG] [LOCAL ] IHG: Saving derivative data. [2025-10-02T22:39:43.187219] [DEBUG] [LOCAL ] IHG: Derivative data saved (1807 records). [2025-10-02T22:39:43.187302] [INFO ] [MAIN ] IHG: Successfully saved derivative data. [2025-10-02T22:39:43.189423] [INFO ] [MAIN ] Derivative Progress: 840/1975 symbols completed. IHG took 0.8s. Estimated remaining: 7m 58s. Rate: 142.4 symbols/min [2025-10-02T22:39:43.189894] [INFO ] [MAIN ] IHS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:43.190136] [INFO ] [MAIN ] IIIN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:43.190062] [INFO ] [MAIN ] IIF: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:43.199179] [DEBUG] [LOCAL ] IIF: Loaded 5734 existing records from primary storage. [2025-10-02T22:39:43.199350] [INFO ] [MAIN ] IIF: Loaded 5734 primary data records. [2025-10-02T22:39:43.319174] [DEBUG] [LOCAL ] IIIN: Loaded 16475 existing records from primary storage. [2025-10-02T22:39:43.332198] [INFO ] [MAIN ] IIIN: Loaded 16475 primary data records. [2025-10-02T22:39:43.650926] [DEBUG] [LOCAL ] IHS: Loaded 39304 existing records from primary storage. [2025-10-02T22:39:43.664916] [INFO ] [MAIN ] IHS: Loaded 39304 primary data records. [2025-10-02T22:39:44.280856] [DEBUG] [MAIN ] IIF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:44.282286] [INFO ] [MAIN ] IIF: Generated 1807 derivative records from 5734 primary records. [2025-10-02T22:39:44.282404] [DEBUG] [LOCAL ] IIF: Saving derivative data. [2025-10-02T22:39:44.313115] [DEBUG] [MAIN ] IIIN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:44.317338] [INFO ] [MAIN ] IIIN: Generated 1807 derivative records from 16475 primary records. [2025-10-02T22:39:44.317685] [DEBUG] [LOCAL ] IIIN: Saving derivative data. [2025-10-02T22:39:44.318576] [DEBUG] [LOCAL ] IIF: Derivative data saved (1807 records). [2025-10-02T22:39:44.319393] [INFO ] [MAIN ] IIF: Successfully saved derivative data. [2025-10-02T22:39:44.321985] [INFO ] [MAIN ] Derivative Progress: 841/1975 symbols completed. IIF took 1.1s. Estimated remaining: 7m 59s. Rate: 142.2 symbols/min [2025-10-02T22:39:44.322275] [INFO ] [MAIN ] IIM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:44.341972] [DEBUG] [LOCAL ] IIIN: Derivative data saved (1807 records). [2025-10-02T22:39:44.343015] [INFO ] [MAIN ] IIIN: Successfully saved derivative data. [2025-10-02T22:39:44.350070] [INFO ] [MAIN ] Derivative Progress: 842/1975 symbols completed. IIIN took 1.2s. Estimated remaining: 7m 58s. Rate: 142.3 symbols/min [2025-10-02T22:39:44.350553] [INFO ] [MAIN ] IIPR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:44.365401] [DEBUG] [MAIN ] IHS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:44.373868] [DEBUG] [LOCAL ] IIM: Loaded 16251 existing records from primary storage. [2025-10-02T22:39:44.373385] [INFO ] [MAIN ] IHS: Generated 1807 derivative records from 39304 primary records. [2025-10-02T22:39:44.374112] [INFO ] [MAIN ] IIM: Loaded 16251 primary data records. [2025-10-02T22:39:44.374041] [DEBUG] [LOCAL ] IHS: Saving derivative data. [2025-10-02T22:39:44.583823] [DEBUG] [LOCAL ] IHS: Derivative data saved (1807 records). [2025-10-02T22:39:44.583740] [DEBUG] [LOCAL ] IIPR: Loaded 30075 existing records from primary storage. [2025-10-02T22:39:44.584023] [INFO ] [MAIN ] IIPR: Loaded 30075 primary data records. [2025-10-02T22:39:44.599050] [INFO ] [MAIN ] IHS: Successfully saved derivative data. [2025-10-02T22:39:44.612324] [INFO ] [MAIN ] Derivative Progress: 843/1975 symbols completed. IHS took 1.4s. Estimated remaining: 7m 57s. Rate: 142.4 symbols/min [2025-10-02T22:39:44.759979] [INFO ] [MAIN ] IMAX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:45.102007] [DEBUG] [LOCAL ] IMAX: Loaded 43087 existing records from primary storage. [2025-10-02T22:39:45.102273] [INFO ] [MAIN ] IMAX: Loaded 43087 primary data records. [2025-10-02T22:39:45.155877] [DEBUG] [MAIN ] IIM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:45.191314] [INFO ] [MAIN ] IIM: Generated 1807 derivative records from 16251 primary records. [2025-10-02T22:39:45.209664] [DEBUG] [LOCAL ] IIM: Saving derivative data. [2025-10-02T22:39:45.463920] [DEBUG] [LOCAL ] IIM: Derivative data saved (1807 records). [2025-10-02T22:39:45.474462] [INFO ] [MAIN ] IIM: Successfully saved derivative data. [2025-10-02T22:39:45.474372] [DEBUG] [MAIN ] IIPR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:45.476811] [INFO ] [MAIN ] Derivative Progress: 844/1975 symbols completed. IIM took 1.2s. Estimated remaining: 7m 57s. Rate: 142.2 symbols/min [2025-10-02T22:39:45.477959] [INFO ] [MAIN ] INFA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:45.477824] [INFO ] [MAIN ] IIPR: Generated 1807 derivative records from 30075 primary records. [2025-10-02T22:39:45.478244] [DEBUG] [LOCAL ] IIPR: Saving derivative data. [2025-10-02T22:39:45.498263] [DEBUG] [LOCAL ] IIPR: Derivative data saved (1807 records). [2025-10-02T22:39:45.498621] [INFO ] [MAIN ] IIPR: Successfully saved derivative data. [2025-10-02T22:39:45.501117] [INFO ] [MAIN ] Derivative Progress: 845/1975 symbols completed. IIPR took 1.2s. Estimated remaining: 7m 56s. Rate: 142.4 symbols/min [2025-10-02T22:39:45.501488] [INFO ] [MAIN ] INFY: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:45.537332] [DEBUG] [MAIN ] IMAX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:45.538249] [INFO ] [MAIN ] IMAX: Generated 1807 derivative records from 43087 primary records. [2025-10-02T22:39:45.538456] [DEBUG] [LOCAL ] IMAX: Saving derivative data. [2025-10-02T22:39:45.584878] [DEBUG] [LOCAL ] IMAX: Derivative data saved (1807 records). [2025-10-02T22:39:45.586093] [DEBUG] [LOCAL ] INFA: Loaded 49887 existing records from primary storage. [2025-10-02T22:39:45.586184] [INFO ] [MAIN ] IMAX: Successfully saved derivative data. [2025-10-02T22:39:45.588588] [INFO ] [MAIN ] INFA: Loaded 49887 primary data records. [2025-10-02T22:39:45.588493] [INFO ] [MAIN ] Derivative Progress: 846/1975 symbols completed. IMAX took 0.8s. Estimated remaining: 7m 55s. Rate: 142.5 symbols/min [2025-10-02T22:39:45.588973] [INFO ] [MAIN ] ING: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:45.711024] [DEBUG] [LOCAL ] INFY: Loaded 53985 existing records from primary storage. [2025-10-02T22:39:45.715034] [INFO ] [MAIN ] INFY: Loaded 53985 primary data records. [2025-10-02T22:39:46.321397] [DEBUG] [LOCAL ] ING: Loaded 51091 existing records from primary storage. [2025-10-02T22:39:46.321789] [INFO ] [MAIN ] ING: Loaded 51091 primary data records. [2025-10-02T22:39:46.657163] [DEBUG] [MAIN ] INFA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:46.673494] [INFO ] [MAIN ] INFA: Generated 1807 derivative records from 49887 primary records. [2025-10-02T22:39:46.673674] [DEBUG] [LOCAL ] INFA: Saving derivative data. [2025-10-02T22:39:46.696839] [DEBUG] [LOCAL ] INFA: Derivative data saved (1807 records). [2025-10-02T22:39:46.697087] [INFO ] [MAIN ] INFA: Successfully saved derivative data. [2025-10-02T22:39:46.712431] [INFO ] [MAIN ] Derivative Progress: 847/1975 symbols completed. INFA took 1.2s. Estimated remaining: 7m 56s. Rate: 142.2 symbols/min [2025-10-02T22:39:46.714160] [DEBUG] [MAIN ] INFY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:46.714338] [INFO ] [MAIN ] INGM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:46.715441] [INFO ] [MAIN ] INFY: Generated 1807 derivative records from 53985 primary records. [2025-10-02T22:39:46.715551] [DEBUG] [LOCAL ] INFY: Saving derivative data. [2025-10-02T22:39:46.738515] [DEBUG] [LOCAL ] INFY: Derivative data saved (1807 records). [2025-10-02T22:39:46.738899] [INFO ] [MAIN ] INFY: Successfully saved derivative data. [2025-10-02T22:39:46.742718] [INFO ] [MAIN ] Derivative Progress: 848/1975 symbols completed. INFY took 1.2s. Estimated remaining: 7m 55s. Rate: 142.4 symbols/min [2025-10-02T22:39:46.744753] [INFO ] [MAIN ] INGR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:46.766999] [DEBUG] [MAIN ] ING: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:46.767822] [INFO ] [MAIN ] ING: Generated 1807 derivative records from 51091 primary records. [2025-10-02T22:39:46.768024] [DEBUG] [LOCAL ] ING: Saving derivative data. [2025-10-02T22:39:46.791773] [DEBUG] [LOCAL ] INGM: Loaded 28854 existing records from primary storage. [2025-10-02T22:39:46.792494] [INFO ] [MAIN ] INGM: Loaded 28854 primary data records. [2025-10-02T22:39:46.892970] [DEBUG] [LOCAL ] ING: Derivative data saved (1807 records). [2025-10-02T22:39:46.908500] [INFO ] [MAIN ] ING: Successfully saved derivative data. [2025-10-02T22:39:46.916746] [INFO ] [MAIN ] Derivative Progress: 849/1975 symbols completed. ING took 1.3s. Estimated remaining: 7m 54s. Rate: 142.5 symbols/min [2025-10-02T22:39:46.926156] [INFO ] [MAIN ] INN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:47.008108] [DEBUG] [LOCAL ] INGR: Loaded 33646 existing records from primary storage. [2025-10-02T22:39:47.019866] [INFO ] [MAIN ] INGR: Loaded 33646 primary data records. [2025-10-02T22:39:47.369043] [DEBUG] [LOCAL ] INN: Loaded 41983 existing records from primary storage. [2025-10-02T22:39:47.392262] [INFO ] [MAIN ] INN: Loaded 41983 primary data records. [2025-10-02T22:39:47.915449] [DEBUG] [MAIN ] INGM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:47.917586] [INFO ] [MAIN ] INGM: Generated 1807 derivative records from 28854 primary records. [2025-10-02T22:39:47.918321] [DEBUG] [LOCAL ] INGM: Saving derivative data. [2025-10-02T22:39:47.959166] [DEBUG] [MAIN ] INGR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:47.960277] [INFO ] [MAIN ] INGR: Generated 1807 derivative records from 33646 primary records. [2025-10-02T22:39:47.961368] [DEBUG] [LOCAL ] INGR: Saving derivative data. [2025-10-02T22:39:47.961601] [DEBUG] [LOCAL ] INGM: Derivative data saved (1807 records). [2025-10-02T22:39:47.962240] [INFO ] [MAIN ] INGM: Successfully saved derivative data. [2025-10-02T22:39:47.965696] [INFO ] [MAIN ] Derivative Progress: 850/1975 symbols completed. INGM took 1.3s. Estimated remaining: 7m 55s. Rate: 142.2 symbols/min [2025-10-02T22:39:47.974030] [INFO ] [MAIN ] INSP: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:48.002498] [DEBUG] [MAIN ] INN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:48.002615] [DEBUG] [LOCAL ] INGR: Derivative data saved (1807 records). [2025-10-02T22:39:48.003639] [INFO ] [MAIN ] INGR: Successfully saved derivative data. [2025-10-02T22:39:48.006375] [INFO ] [MAIN ] Derivative Progress: 851/1975 symbols completed. INGR took 1.3s. Estimated remaining: 7m 54s. Rate: 142.4 symbols/min [2025-10-02T22:39:48.003491] [INFO ] [MAIN ] INN: Generated 1807 derivative records from 41983 primary records. [2025-10-02T22:39:48.006786] [DEBUG] [LOCAL ] INN: Saving derivative data. [2025-10-02T22:39:48.006613] [INFO ] [MAIN ] INSW: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:48.034879] [DEBUG] [LOCAL ] INN: Derivative data saved (1807 records). [2025-10-02T22:39:48.035074] [INFO ] [MAIN ] INN: Successfully saved derivative data. [2025-10-02T22:39:48.037599] [INFO ] [MAIN ] Derivative Progress: 852/1975 symbols completed. INN took 1.1s. Estimated remaining: 7m 53s. Rate: 142.5 symbols/min [2025-10-02T22:39:48.038060] [INFO ] [MAIN ] INVH: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:48.056524] [DEBUG] [LOCAL ] INSP: Loaded 37471 existing records from primary storage. [2025-10-02T22:39:48.056858] [INFO ] [MAIN ] INSP: Loaded 37471 primary data records. [2025-10-02T22:39:48.270234] [DEBUG] [LOCAL ] INSW: Loaded 40240 existing records from primary storage. [2025-10-02T22:39:48.335914] [INFO ] [MAIN ] INSW: Loaded 40240 primary data records. [2025-10-02T22:39:48.531208] [DEBUG] [LOCAL ] INVH: Loaded 53521 existing records from primary storage. [2025-10-02T22:39:48.550533] [INFO ] [MAIN ] INVH: Loaded 53521 primary data records. [2025-10-02T22:39:49.163892] [DEBUG] [MAIN ] INSP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:49.164953] [INFO ] [MAIN ] INSP: Generated 1807 derivative records from 37471 primary records. [2025-10-02T22:39:49.165051] [DEBUG] [LOCAL ] INSP: Saving derivative data. [2025-10-02T22:39:49.203040] [DEBUG] [LOCAL ] INSP: Derivative data saved (1807 records). [2025-10-02T22:39:49.202585] [DEBUG] [MAIN ] INSW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:49.203357] [INFO ] [MAIN ] INSP: Successfully saved derivative data. [2025-10-02T22:39:49.206480] [INFO ] [MAIN ] Derivative Progress: 853/1975 symbols completed. INSP took 1.2s. Estimated remaining: 7m 53s. Rate: 142.2 symbols/min [2025-10-02T22:39:49.204148] [INFO ] [MAIN ] INSW: Generated 1807 derivative records from 40240 primary records. [2025-10-02T22:39:49.206842] [DEBUG] [LOCAL ] INSW: Saving derivative data. [2025-10-02T22:39:49.220519] [DEBUG] [MAIN ] INVH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:49.221459] [INFO ] [MAIN ] INVH: Generated 1807 derivative records from 53521 primary records. [2025-10-02T22:39:49.229584] [DEBUG] [LOCAL ] INVH: Saving derivative data. [2025-10-02T22:39:49.252680] [DEBUG] [LOCAL ] INVH: Derivative data saved (1807 records). [2025-10-02T22:39:49.253430] [INFO ] [MAIN ] INVH: Successfully saved derivative data. [2025-10-02T22:39:49.256744] [INFO ] [MAIN ] Derivative Progress: 854/1975 symbols completed. INVH took 1.2s. Estimated remaining: 7m 52s. Rate: 142.4 symbols/min [2025-10-02T22:39:49.257540] [DEBUG] [LOCAL ] INSW: Derivative data saved (1807 records). [2025-10-02T22:39:49.257611] [INFO ] [MAIN ] INSW: Successfully saved derivative data. [2025-10-02T22:39:49.259568] [INFO ] [MAIN ] Derivative Progress: 855/1975 symbols completed. INSW took 1.3s. Estimated remaining: 7m 51s. Rate: 142.5 symbols/min [2025-10-02T22:39:49.260053] [INFO ] [MAIN ] IONQ: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:49.260110] [INFO ] [MAIN ] IOT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:49.260005] [INFO ] [MAIN ] INVX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:49.307093] [DEBUG] [LOCAL ] INVX: Loaded 29238 existing records from primary storage. [2025-10-02T22:39:49.307338] [INFO ] [MAIN ] INVX: Loaded 29238 primary data records. [2025-10-02T22:39:49.480436] [DEBUG] [LOCAL ] IOT: Loaded 53861 existing records from primary storage. [2025-10-02T22:39:49.507281] [INFO ] [MAIN ] IOT: Loaded 53861 primary data records. [2025-10-02T22:39:49.747523] [DEBUG] [LOCAL ] IONQ: Loaded 54178 existing records from primary storage. [2025-10-02T22:39:49.763839] [INFO ] [MAIN ] IONQ: Loaded 54178 primary data records. [2025-10-02T22:39:50.441461] [DEBUG] [MAIN ] INVX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:50.442731] [INFO ] [MAIN ] INVX: Generated 1807 derivative records from 29238 primary records. [2025-10-02T22:39:50.443408] [DEBUG] [LOCAL ] INVX: Saving derivative data. [2025-10-02T22:39:50.463881] [DEBUG] [LOCAL ] INVX: Derivative data saved (1807 records). [2025-10-02T22:39:50.464192] [INFO ] [MAIN ] INVX: Successfully saved derivative data. [2025-10-02T22:39:50.467666] [INFO ] [MAIN ] Derivative Progress: 856/1975 symbols completed. INVX took 1.2s. Estimated remaining: 7m 52s. Rate: 142.2 symbols/min [2025-10-02T22:39:50.468372] [INFO ] [MAIN ] IP: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:50.485955] [DEBUG] [MAIN ] IOT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:50.486978] [INFO ] [MAIN ] IOT: Generated 1807 derivative records from 53861 primary records. [2025-10-02T22:39:50.487214] [DEBUG] [LOCAL ] IOT: Saving derivative data. [2025-10-02T22:39:50.507814] [DEBUG] [LOCAL ] IOT: Derivative data saved (1807 records). [2025-10-02T22:39:50.513003] [INFO ] [MAIN ] IOT: Successfully saved derivative data. [2025-10-02T22:39:50.523213] [INFO ] [MAIN ] Derivative Progress: 857/1975 symbols completed. IOT took 1.3s. Estimated remaining: 7m 51s. Rate: 142.4 symbols/min [2025-10-02T22:39:50.528614] [DEBUG] [MAIN ] IONQ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:50.529575] [INFO ] [MAIN ] IONQ: Generated 1807 derivative records from 54178 primary records. [2025-10-02T22:39:50.529789] [INFO ] [MAIN ] IPG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:50.529698] [DEBUG] [LOCAL ] IONQ: Saving derivative data. [2025-10-02T22:39:50.562690] [DEBUG] [LOCAL ] IONQ: Derivative data saved (1807 records). [2025-10-02T22:39:50.562888] [INFO ] [MAIN ] IONQ: Successfully saved derivative data. [2025-10-02T22:39:50.565189] [INFO ] [MAIN ] Derivative Progress: 858/1975 symbols completed. IONQ took 1.3s. Estimated remaining: 7m 50s. Rate: 142.5 symbols/min [2025-10-02T22:39:50.565500] [INFO ] [MAIN ] IPI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:50.591176] [DEBUG] [LOCAL ] IP: Loaded 53702 existing records from primary storage. [2025-10-02T22:39:50.595725] [INFO ] [MAIN ] IP: Loaded 53702 primary data records. [2025-10-02T22:39:50.696954] [DEBUG] [LOCAL ] IPI: Loaded 21605 existing records from primary storage. [2025-10-02T22:39:50.730372] [INFO ] [MAIN ] IPI: Loaded 21605 primary data records. [2025-10-02T22:39:50.783352] [DEBUG] [LOCAL ] IPG: Loaded 53719 existing records from primary storage. [2025-10-02T22:39:50.826316] [INFO ] [MAIN ] IPG: Loaded 53719 primary data records. [2025-10-02T22:39:51.637527] [DEBUG] [MAIN ] IP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:51.651311] [INFO ] [MAIN ] IP: Generated 1807 derivative records from 53702 primary records. [2025-10-02T22:39:51.652049] [DEBUG] [MAIN ] IPI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:51.652776] [INFO ] [MAIN ] IPI: Generated 1807 derivative records from 21605 primary records. [2025-10-02T22:39:51.653019] [DEBUG] [LOCAL ] IPI: Saving derivative data. [2025-10-02T22:39:51.651802] [DEBUG] [LOCAL ] IP: Saving derivative data. [2025-10-02T22:39:51.697052] [DEBUG] [MAIN ] IPG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:51.698788] [INFO ] [MAIN ] IPG: Generated 1807 derivative records from 53719 primary records. [2025-10-02T22:39:51.699418] [DEBUG] [LOCAL ] IP: Derivative data saved (1807 records). [2025-10-02T22:39:51.699926] [INFO ] [MAIN ] IP: Successfully saved derivative data. [2025-10-02T22:39:51.699820] [DEBUG] [LOCAL ] IPG: Saving derivative data. [2025-10-02T22:39:51.703803] [INFO ] [MAIN ] Derivative Progress: 859/1975 symbols completed. IP took 1.2s. Estimated remaining: 7m 51s. Rate: 142.2 symbols/min [2025-10-02T22:39:51.704230] [INFO ] [MAIN ] IQI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:51.721271] [DEBUG] [LOCAL ] IPI: Derivative data saved (1807 records). [2025-10-02T22:39:51.721779] [INFO ] [MAIN ] IPI: Successfully saved derivative data. [2025-10-02T22:39:51.724474] [INFO ] [MAIN ] Derivative Progress: 860/1975 symbols completed. IPI took 1.2s. Estimated remaining: 7m 50s. Rate: 142.4 symbols/min [2025-10-02T22:39:51.724690] [INFO ] [MAIN ] IQV: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:51.735820] [DEBUG] [LOCAL ] IPG: Derivative data saved (1807 records). [2025-10-02T22:39:51.735961] [INFO ] [MAIN ] IPG: Successfully saved derivative data. [2025-10-02T22:39:51.738324] [INFO ] [MAIN ] Derivative Progress: 861/1975 symbols completed. IPG took 1.2s. Estimated remaining: 7m 49s. Rate: 142.6 symbols/min [2025-10-02T22:39:51.745063] [INFO ] [MAIN ] IR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:51.745561] [DEBUG] [LOCAL ] IQI: Loaded 18227 existing records from primary storage. [2025-10-02T22:39:51.745765] [INFO ] [MAIN ] IQI: Loaded 18227 primary data records. [2025-10-02T22:39:52.129352] [DEBUG] [LOCAL ] IQV: Loaded 50465 existing records from primary storage. [2025-10-02T22:39:52.129680] [INFO ] [MAIN ] IQV: Loaded 50465 primary data records. [2025-10-02T22:39:52.268710] [DEBUG] [LOCAL ] IR: Loaded 53077 existing records from primary storage. [2025-10-02T22:39:52.284604] [INFO ] [MAIN ] IR: Loaded 53077 primary data records. [2025-10-02T22:39:52.887514] [DEBUG] [MAIN ] IQI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:52.888995] [INFO ] [MAIN ] IQI: Generated 1807 derivative records from 18227 primary records. [2025-10-02T22:39:52.889271] [DEBUG] [LOCAL ] IQI: Saving derivative data. [2025-10-02T22:39:52.925121] [DEBUG] [LOCAL ] IQI: Derivative data saved (1807 records). [2025-10-02T22:39:52.939376] [INFO ] [MAIN ] IQI: Successfully saved derivative data. [2025-10-02T22:39:52.943163] [DEBUG] [MAIN ] IQV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:52.944628] [INFO ] [MAIN ] IQV: Generated 1807 derivative records from 50465 primary records. [2025-10-02T22:39:52.944956] [DEBUG] [LOCAL ] IQV: Saving derivative data. [2025-10-02T22:39:52.942745] [INFO ] [MAIN ] Derivative Progress: 862/1975 symbols completed. IQI took 1.2s. Estimated remaining: 7m 49s. Rate: 142.3 symbols/min [2025-10-02T22:39:52.946045] [INFO ] [MAIN ] IRM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:52.978603] [DEBUG] [MAIN ] IR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:52.980308] [INFO ] [MAIN ] IR: Generated 1807 derivative records from 53077 primary records. [2025-10-02T22:39:52.980503] [DEBUG] [LOCAL ] IR: Saving derivative data. [2025-10-02T22:39:52.995296] [DEBUG] [LOCAL ] IQV: Derivative data saved (1807 records). [2025-10-02T22:39:52.995700] [INFO ] [MAIN ] IQV: Successfully saved derivative data. [2025-10-02T22:39:52.999131] [INFO ] [MAIN ] Derivative Progress: 863/1975 symbols completed. IQV took 1.3s. Estimated remaining: 7m 49s. Rate: 142.4 symbols/min [2025-10-02T22:39:52.999582] [INFO ] [MAIN ] IRS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:53.005085] [DEBUG] [LOCAL ] IR: Derivative data saved (1807 records). [2025-10-02T22:39:53.005303] [INFO ] [MAIN ] IR: Successfully saved derivative data. [2025-10-02T22:39:53.007745] [INFO ] [MAIN ] Derivative Progress: 864/1975 symbols completed. IR took 1.3s. Estimated remaining: 7m 48s. Rate: 142.6 symbols/min [2025-10-02T22:39:53.007982] [INFO ] [MAIN ] IRT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:53.037848] [DEBUG] [LOCAL ] IRS: Loaded 22194 existing records from primary storage. [2025-10-02T22:39:53.038067] [INFO ] [MAIN ] IRS: Loaded 22194 primary data records. [2025-10-02T22:39:53.106254] [DEBUG] [LOCAL ] IRM: Loaded 49653 existing records from primary storage. [2025-10-02T22:39:53.126892] [INFO ] [MAIN ] IRM: Loaded 49653 primary data records. [2025-10-02T22:39:53.724340] [DEBUG] [LOCAL ] IRT: Loaded 50773 existing records from primary storage. [2025-10-02T22:39:53.724637] [INFO ] [MAIN ] IRT: Loaded 50773 primary data records. [2025-10-02T22:39:54.102350] [DEBUG] [MAIN ] IRS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:54.103748] [INFO ] [MAIN ] IRS: Generated 1807 derivative records from 22194 primary records. [2025-10-02T22:39:54.104264] [DEBUG] [LOCAL ] IRS: Saving derivative data. [2025-10-02T22:39:54.104041] [DEBUG] [MAIN ] IRM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:54.105801] [INFO ] [MAIN ] IRM: Generated 1807 derivative records from 49653 primary records. [2025-10-02T22:39:54.106392] [DEBUG] [LOCAL ] IRM: Saving derivative data. [2025-10-02T22:39:54.139921] [DEBUG] [LOCAL ] IRM: Derivative data saved (1807 records). [2025-10-02T22:39:54.140112] [INFO ] [MAIN ] IRM: Successfully saved derivative data. [2025-10-02T22:39:54.142855] [INFO ] [MAIN ] Derivative Progress: 865/1975 symbols completed. IRM took 1.2s. Estimated remaining: 7m 48s. Rate: 142.3 symbols/min [2025-10-02T22:39:54.143888] [INFO ] [MAIN ] ISD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:54.160867] [DEBUG] [LOCAL ] IRS: Derivative data saved (1807 records). [2025-10-02T22:39:54.161027] [INFO ] [MAIN ] IRS: Successfully saved derivative data. [2025-10-02T22:39:54.160020] [DEBUG] [MAIN ] IRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:54.164053] [INFO ] [MAIN ] Derivative Progress: 866/1975 symbols completed. IRS took 1.2s. Estimated remaining: 7m 47s. Rate: 142.4 symbols/min [2025-10-02T22:39:54.164344] [INFO ] [MAIN ] IT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:54.161934] [INFO ] [MAIN ] IRT: Generated 1807 derivative records from 50773 primary records. [2025-10-02T22:39:54.164548] [DEBUG] [LOCAL ] IRT: Saving derivative data. [2025-10-02T22:39:54.193034] [DEBUG] [LOCAL ] ISD: Loaded 15710 existing records from primary storage. [2025-10-02T22:39:54.194533] [INFO ] [MAIN ] ISD: Loaded 15710 primary data records. [2025-10-02T22:39:54.194421] [DEBUG] [LOCAL ] IRT: Derivative data saved (1807 records). [2025-10-02T22:39:54.200004] [INFO ] [MAIN ] IRT: Successfully saved derivative data. [2025-10-02T22:39:54.209173] [INFO ] [MAIN ] Derivative Progress: 867/1975 symbols completed. IRT took 1.2s. Estimated remaining: 7m 46s. Rate: 142.6 symbols/min [2025-10-02T22:39:54.236017] [INFO ] [MAIN ] ITGR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:54.597552] [DEBUG] [LOCAL ] IT: Loaded 42328 existing records from primary storage. [2025-10-02T22:39:54.598002] [INFO ] [MAIN ] IT: Loaded 42328 primary data records. [2025-10-02T22:39:54.669010] [DEBUG] [LOCAL ] ITGR: Loaded 31551 existing records from primary storage. [2025-10-02T22:39:54.669709] [INFO ] [MAIN ] ITGR: Loaded 31551 primary data records. [2025-10-02T22:39:55.274534] [DEBUG] [MAIN ] ISD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:55.276931] [INFO ] [MAIN ] ISD: Generated 1807 derivative records from 15710 primary records. [2025-10-02T22:39:55.277193] [DEBUG] [LOCAL ] ISD: Saving derivative data. [2025-10-02T22:39:55.295956] [DEBUG] [LOCAL ] ISD: Derivative data saved (1807 records). [2025-10-02T22:39:55.297471] [INFO ] [MAIN ] ISD: Successfully saved derivative data. [2025-10-02T22:39:55.299992] [INFO ] [MAIN ] Derivative Progress: 868/1975 symbols completed. ISD took 1.2s. Estimated remaining: 7m 47s. Rate: 142.3 symbols/min [2025-10-02T22:39:55.318372] [DEBUG] [MAIN ] IT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:55.319452] [INFO ] [MAIN ] IT: Generated 1807 derivative records from 42328 primary records. [2025-10-02T22:39:55.319688] [DEBUG] [LOCAL ] IT: Saving derivative data. [2025-10-02T22:39:55.352717] [DEBUG] [MAIN ] ITGR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:55.353912] [DEBUG] [LOCAL ] IT: Derivative data saved (1807 records). [2025-10-02T22:39:55.354821] [INFO ] [MAIN ] ITGR: Generated 1807 derivative records from 31551 primary records. [2025-10-02T22:39:55.355024] [DEBUG] [LOCAL ] ITGR: Saving derivative data. [2025-10-02T22:39:55.354934] [INFO ] [MAIN ] IT: Successfully saved derivative data. [2025-10-02T22:39:55.357354] [INFO ] [MAIN ] Derivative Progress: 869/1975 symbols completed. IT took 1.2s. Estimated remaining: 7m 46s. Rate: 142.5 symbols/min [2025-10-02T22:39:55.373944] [DEBUG] [LOCAL ] ITGR: Derivative data saved (1807 records). [2025-10-02T22:39:55.374016] [INFO ] [MAIN ] ITGR: Successfully saved derivative data. [2025-10-02T22:39:55.376055] [INFO ] [MAIN ] Derivative Progress: 870/1975 symbols completed. ITGR took 1.1s. Estimated remaining: 7m 45s. Rate: 142.6 symbols/min [2025-10-02T22:39:55.376463] [INFO ] [MAIN ] ITT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:55.376678] [INFO ] [MAIN ] ITUB: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:55.376615] [INFO ] [MAIN ] ITW: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:55.415877] [DEBUG] [LOCAL ] ITT: Loaded 32995 existing records from primary storage. [2025-10-02T22:39:55.416271] [INFO ] [MAIN ] ITT: Loaded 32995 primary data records. [2025-10-02T22:39:55.643437] [DEBUG] [LOCAL ] ITW: Loaded 46101 existing records from primary storage. [2025-10-02T22:39:55.696076] [INFO ] [MAIN ] ITW: Loaded 46101 primary data records. [2025-10-02T22:39:55.848878] [DEBUG] [LOCAL ] ITUB: Loaded 53711 existing records from primary storage. [2025-10-02T22:39:55.880820] [INFO ] [MAIN ] ITUB: Loaded 53711 primary data records. [2025-10-02T22:39:56.506249] [DEBUG] [MAIN ] ITT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:56.507393] [INFO ] [MAIN ] ITT: Generated 1807 derivative records from 32995 primary records. [2025-10-02T22:39:56.507632] [DEBUG] [LOCAL ] ITT: Saving derivative data. [2025-10-02T22:39:56.528514] [DEBUG] [LOCAL ] ITT: Derivative data saved (1807 records). [2025-10-02T22:39:56.529171] [INFO ] [MAIN ] ITT: Successfully saved derivative data. [2025-10-02T22:39:56.531527] [INFO ] [MAIN ] Derivative Progress: 871/1975 symbols completed. ITT took 1.2s. Estimated remaining: 7m 45s. Rate: 142.3 symbols/min [2025-10-02T22:39:56.531948] [INFO ] [MAIN ] IVR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:56.552849] [DEBUG] [MAIN ] ITW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:56.554141] [INFO ] [MAIN ] ITW: Generated 1807 derivative records from 46101 primary records. [2025-10-02T22:39:56.554301] [DEBUG] [LOCAL ] ITW: Saving derivative data. [2025-10-02T22:39:56.576752] [DEBUG] [MAIN ] ITUB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:56.581753] [INFO ] [MAIN ] ITUB: Generated 1807 derivative records from 53711 primary records. [2025-10-02T22:39:56.582010] [DEBUG] [LOCAL ] ITUB: Saving derivative data. [2025-10-02T22:39:56.603264] [DEBUG] [LOCAL ] ITUB: Derivative data saved (1807 records). [2025-10-02T22:39:56.616357] [DEBUG] [LOCAL ] ITW: Derivative data saved (1807 records). [2025-10-02T22:39:56.616782] [INFO ] [MAIN ] ITW: Successfully saved derivative data. [2025-10-02T22:39:56.616495] [INFO ] [MAIN ] ITUB: Successfully saved derivative data. [2025-10-02T22:39:56.618970] [INFO ] [MAIN ] Derivative Progress: 872/1975 symbols completed. ITUB took 1.2s. Estimated remaining: 7m 45s. Rate: 142.5 symbols/min [2025-10-02T22:39:56.621581] [INFO ] [MAIN ] IVT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:56.621891] [INFO ] [MAIN ] Derivative Progress: 873/1975 symbols completed. ITW took 1.2s. Estimated remaining: 7m 44s. Rate: 142.6 symbols/min [2025-10-02T22:39:56.622362] [INFO ] [MAIN ] IVZ: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:56.639748] [DEBUG] [LOCAL ] IVR: Loaded 48258 existing records from primary storage. [2025-10-02T22:39:56.639893] [INFO ] [MAIN ] IVR: Loaded 48258 primary data records. [2025-10-02T22:39:56.845733] [DEBUG] [LOCAL ] IVT: Loaded 30940 existing records from primary storage. [2025-10-02T22:39:56.869351] [INFO ] [MAIN ] IVT: Loaded 30940 primary data records. [2025-10-02T22:39:57.147628] [DEBUG] [LOCAL ] IVZ: Loaded 53517 existing records from primary storage. [2025-10-02T22:39:57.158667] [INFO ] [MAIN ] IVZ: Loaded 53517 primary data records. [2025-10-02T22:39:57.725025] [DEBUG] [MAIN ] IVR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:57.726593] [INFO ] [MAIN ] IVR: Generated 1807 derivative records from 48258 primary records. [2025-10-02T22:39:57.726912] [DEBUG] [LOCAL ] IVR: Saving derivative data. [2025-10-02T22:39:57.750143] [DEBUG] [LOCAL ] IVR: Derivative data saved (1807 records). [2025-10-02T22:39:57.750471] [INFO ] [MAIN ] IVR: Successfully saved derivative data. [2025-10-02T22:39:57.753435] [INFO ] [MAIN ] Derivative Progress: 874/1975 symbols completed. IVR took 1.2s. Estimated remaining: 7m 44s. Rate: 142.3 symbols/min [2025-10-02T22:39:57.754513] [INFO ] [MAIN ] IX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:57.776412] [DEBUG] [MAIN ] IVT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:57.777395] [INFO ] [MAIN ] IVT: Generated 1807 derivative records from 30940 primary records. [2025-10-02T22:39:57.777477] [DEBUG] [LOCAL ] IVT: Saving derivative data. [2025-10-02T22:39:57.823678] [DEBUG] [MAIN ] IVZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:57.824730] [DEBUG] [LOCAL ] IX: Loaded 22607 existing records from primary storage. [2025-10-02T22:39:57.824855] [INFO ] [MAIN ] IX: Loaded 22607 primary data records. [2025-10-02T22:39:57.825808] [INFO ] [MAIN ] IVZ: Generated 1807 derivative records from 53517 primary records. [2025-10-02T22:39:57.826411] [DEBUG] [LOCAL ] IVZ: Saving derivative data. [2025-10-02T22:39:57.907050] [DEBUG] [LOCAL ] IVT: Derivative data saved (1807 records). [2025-10-02T22:39:57.926792] [INFO ] [MAIN ] IVT: Successfully saved derivative data. [2025-10-02T22:39:57.936100] [INFO ] [MAIN ] Derivative Progress: 875/1975 symbols completed. IVT took 1.3s. Estimated remaining: 7m 43s. Rate: 142.4 symbols/min [2025-10-02T22:39:57.946984] [INFO ] [MAIN ] J: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:57.971952] [DEBUG] [LOCAL ] IVZ: Derivative data saved (1807 records). [2025-10-02T22:39:57.976715] [INFO ] [MAIN ] IVZ: Successfully saved derivative data. [2025-10-02T22:39:57.979074] [INFO ] [MAIN ] Derivative Progress: 876/1975 symbols completed. IVZ took 1.4s. Estimated remaining: 7m 42s. Rate: 142.6 symbols/min [2025-10-02T22:39:57.985386] [INFO ] [MAIN ] JBGS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:58.228690] [DEBUG] [LOCAL ] J: Loaded 40454 existing records from primary storage. [2025-10-02T22:39:58.229112] [INFO ] [MAIN ] J: Loaded 40454 primary data records. [2025-10-02T22:39:58.375133] [DEBUG] [LOCAL ] JBGS: Loaded 42686 existing records from primary storage. [2025-10-02T22:39:58.376532] [DEBUG] [MAIN ] IX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:58.387201] [INFO ] [MAIN ] JBGS: Loaded 42686 primary data records. [2025-10-02T22:39:58.393501] [INFO ] [MAIN ] IX: Generated 1807 derivative records from 22607 primary records. [2025-10-02T22:39:58.398911] [DEBUG] [LOCAL ] IX: Saving derivative data. [2025-10-02T22:39:58.741773] [DEBUG] [LOCAL ] IX: Derivative data saved (1807 records). [2025-10-02T22:39:58.781867] [INFO ] [MAIN ] IX: Successfully saved derivative data. [2025-10-02T22:39:58.784405] [INFO ] [MAIN ] Derivative Progress: 877/1975 symbols completed. IX took 1.0s. Estimated remaining: 7m 43s. Rate: 142.4 symbols/min [2025-10-02T22:39:58.794256] [INFO ] [MAIN ] JBI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:59.028719] [DEBUG] [MAIN ] J: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:59.030479] [INFO ] [MAIN ] J: Generated 1807 derivative records from 40454 primary records. [2025-10-02T22:39:59.030802] [DEBUG] [LOCAL ] J: Saving derivative data. [2025-10-02T22:39:59.061677] [DEBUG] [LOCAL ] J: Derivative data saved (1807 records). [2025-10-02T22:39:59.063191] [INFO ] [MAIN ] J: Successfully saved derivative data. [2025-10-02T22:39:59.065555] [INFO ] [MAIN ] Derivative Progress: 878/1975 symbols completed. J took 1.1s. Estimated remaining: 7m 42s. Rate: 142.5 symbols/min [2025-10-02T22:39:59.066041] [INFO ] [MAIN ] JBL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:59.068232] [DEBUG] [LOCAL ] JBI: Loaded 43831 existing records from primary storage. [2025-10-02T22:39:59.068437] [INFO ] [MAIN ] JBI: Loaded 43831 primary data records. [2025-10-02T22:39:59.200471] [DEBUG] [MAIN ] JBGS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:39:59.209216] [INFO ] [MAIN ] JBGS: Generated 1807 derivative records from 42686 primary records. [2025-10-02T22:39:59.209449] [DEBUG] [LOCAL ] JBGS: Saving derivative data. [2025-10-02T22:39:59.451861] [DEBUG] [LOCAL ] JBGS: Derivative data saved (1807 records). [2025-10-02T22:39:59.452904] [INFO ] [MAIN ] JBGS: Successfully saved derivative data. [2025-10-02T22:39:59.455896] [INFO ] [MAIN ] Derivative Progress: 879/1975 symbols completed. JBGS took 1.5s. Estimated remaining: 7m 41s. Rate: 142.5 symbols/min [2025-10-02T22:39:59.456156] [INFO ] [MAIN ] JBND: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:39:59.473297] [DEBUG] [LOCAL ] JBL: Loaded 48752 existing records from primary storage. [2025-10-02T22:39:59.473684] [INFO ] [MAIN ] JBL: Loaded 48752 primary data records. [2025-10-02T22:39:59.797452] [DEBUG] [LOCAL ] JBND: Loaded 26305 existing records from primary storage. [2025-10-02T22:39:59.811567] [INFO ] [MAIN ] JBND: Loaded 26305 primary data records. [2025-10-02T22:39:59.992282] [DEBUG] [MAIN ] JBI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:00.013100] [INFO ] [MAIN ] JBI: Generated 1807 derivative records from 43831 primary records. [2025-10-02T22:40:00.036804] [DEBUG] [LOCAL ] JBI: Saving derivative data. [2025-10-02T22:40:00.183978] [DEBUG] [LOCAL ] JBI: Derivative data saved (1807 records). [2025-10-02T22:40:00.184288] [INFO ] [MAIN ] JBI: Successfully saved derivative data. [2025-10-02T22:40:00.200846] [DEBUG] [MAIN ] JBL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:00.201915] [INFO ] [MAIN ] JBL: Generated 1807 derivative records from 48752 primary records. [2025-10-02T22:40:00.202033] [DEBUG] [LOCAL ] JBL: Saving derivative data. [2025-10-02T22:40:00.199376] [INFO ] [MAIN ] Derivative Progress: 880/1975 symbols completed. JBI took 1.4s. Estimated remaining: 7m 41s. Rate: 142.4 symbols/min [2025-10-02T22:40:00.202531] [INFO ] [MAIN ] JCE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:00.227576] [DEBUG] [LOCAL ] JCE: Loaded 6893 existing records from primary storage. [2025-10-02T22:40:00.228471] [INFO ] [MAIN ] JCE: Loaded 6893 primary data records. [2025-10-02T22:40:00.251059] [DEBUG] [LOCAL ] JBL: Derivative data saved (1807 records). [2025-10-02T22:40:00.299343] [INFO ] [MAIN ] JBL: Successfully saved derivative data. [2025-10-02T22:40:00.372968] [DEBUG] [MAIN ] JBND: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:00.376163] [INFO ] [MAIN ] Derivative Progress: 881/1975 symbols completed. JBL took 1.3s. Estimated remaining: 7m 41s. Rate: 142.5 symbols/min [2025-10-02T22:40:00.377600] [INFO ] [MAIN ] JBND: Generated 1807 derivative records from 26305 primary records. [2025-10-02T22:40:00.377763] [INFO ] [MAIN ] JCI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:00.378418] [DEBUG] [LOCAL ] JBND: Saving derivative data. [2025-10-02T22:40:00.612459] [DEBUG] [LOCAL ] JBND: Derivative data saved (1807 records). [2025-10-02T22:40:00.613580] [INFO ] [MAIN ] JBND: Successfully saved derivative data. [2025-10-02T22:40:00.615948] [INFO ] [MAIN ] Derivative Progress: 882/1975 symbols completed. JBND took 1.2s. Estimated remaining: 7m 40s. Rate: 142.5 symbols/min [2025-10-02T22:40:00.616310] [INFO ] [MAIN ] JEF: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:00.660483] [DEBUG] [MAIN ] JCE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:00.661297] [INFO ] [MAIN ] JCE: Generated 1807 derivative records from 6893 primary records. [2025-10-02T22:40:00.661407] [DEBUG] [LOCAL ] JCE: Saving derivative data. [2025-10-02T22:40:00.678170] [DEBUG] [LOCAL ] JCE: Derivative data saved (1807 records). [2025-10-02T22:40:00.679274] [INFO ] [MAIN ] JCE: Successfully saved derivative data. [2025-10-02T22:40:00.691576] [INFO ] [MAIN ] Derivative Progress: 883/1975 symbols completed. JCE took 0.5s. Estimated remaining: 7m 39s. Rate: 142.7 symbols/min [2025-10-02T22:40:00.709033] [DEBUG] [LOCAL ] JCI: Loaded 53933 existing records from primary storage. [2025-10-02T22:40:00.709253] [INFO ] [MAIN ] JCI: Loaded 53933 primary data records. [2025-10-02T22:40:00.844518] [DEBUG] [LOCAL ] JEF: Loaded 50415 existing records from primary storage. [2025-10-02T22:40:00.860017] [INFO ] [MAIN ] JEF: Loaded 50415 primary data records. [2025-10-02T22:40:01.462496] [DEBUG] [MAIN ] JCI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:01.463508] [INFO ] [MAIN ] JCI: Generated 1807 derivative records from 53933 primary records. [2025-10-02T22:40:01.463784] [DEBUG] [LOCAL ] JCI: Saving derivative data. [2025-10-02T22:40:01.497071] [DEBUG] [MAIN ] JEF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:01.496756] [DEBUG] [LOCAL ] JCI: Derivative data saved (1807 records). [2025-10-02T22:40:01.498052] [INFO ] [MAIN ] JEF: Generated 1807 derivative records from 50415 primary records. [2025-10-02T22:40:01.498164] [DEBUG] [LOCAL ] JEF: Saving derivative data. [2025-10-02T22:40:01.498242] [INFO ] [MAIN ] JCI: Successfully saved derivative data. [2025-10-02T22:40:01.501038] [INFO ] [MAIN ] Derivative Progress: 884/1975 symbols completed. JCI took 1.1s. Estimated remaining: 7m 39s. Rate: 142.5 symbols/min [2025-10-02T22:40:01.517199] [DEBUG] [LOCAL ] JEF: Derivative data saved (1807 records). [2025-10-02T22:40:01.517337] [INFO ] [MAIN ] JEF: Successfully saved derivative data. [2025-10-02T22:40:01.519294] [INFO ] [MAIN ] Derivative Progress: 885/1975 symbols completed. JEF took 0.9s. Estimated remaining: 7m 38s. Rate: 142.7 symbols/min [2025-10-02T22:40:01.519793] [INFO ] [MAIN ] JELD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:01.520231] [INFO ] [MAIN ] JFR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:01.519853] [INFO ] [MAIN ] JEQ: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:01.534541] [DEBUG] [LOCAL ] JEQ: Loaded 8924 existing records from primary storage. [2025-10-02T22:40:01.534812] [INFO ] [MAIN ] JEQ: Loaded 8924 primary data records. [2025-10-02T22:40:01.790193] [DEBUG] [LOCAL ] JFR: Loaded 30936 existing records from primary storage. [2025-10-02T22:40:01.927010] [DEBUG] [LOCAL ] JELD: Loaded 46427 existing records from primary storage. [2025-10-02T22:40:01.925536] [INFO ] [MAIN ] JFR: Loaded 30936 primary data records. [2025-10-02T22:40:01.928133] [INFO ] [MAIN ] JELD: Loaded 46427 primary data records. [2025-10-02T22:40:02.687607] [DEBUG] [MAIN ] JEQ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:02.688905] [INFO ] [MAIN ] JEQ: Generated 1807 derivative records from 8924 primary records. [2025-10-02T22:40:02.690044] [DEBUG] [LOCAL ] JEQ: Saving derivative data. [2025-10-02T22:40:02.708949] [DEBUG] [LOCAL ] JEQ: Derivative data saved (1807 records). [2025-10-02T22:40:02.709332] [INFO ] [MAIN ] JEQ: Successfully saved derivative data. [2025-10-02T22:40:02.711335] [INFO ] [MAIN ] Derivative Progress: 886/1975 symbols completed. JEQ took 1.2s. Estimated remaining: 7m 39s. Rate: 142.4 symbols/min [2025-10-02T22:40:02.711853] [INFO ] [MAIN ] JGH: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:02.727947] [DEBUG] [LOCAL ] JGH: Loaded 11163 existing records from primary storage. [2025-10-02T22:40:02.729765] [INFO ] [MAIN ] JGH: Loaded 11163 primary data records. [2025-10-02T22:40:02.793551] [DEBUG] [MAIN ] JELD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:02.844571] [INFO ] [MAIN ] JELD: Generated 1807 derivative records from 46427 primary records. [2025-10-02T22:40:02.844973] [DEBUG] [MAIN ] JFR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:02.862475] [DEBUG] [LOCAL ] JELD: Saving derivative data. [2025-10-02T22:40:02.875945] [INFO ] [MAIN ] JFR: Generated 1807 derivative records from 30936 primary records. [2025-10-02T22:40:02.876932] [DEBUG] [LOCAL ] JFR: Saving derivative data. [2025-10-02T22:40:03.108519] [DEBUG] [LOCAL ] JELD: Derivative data saved (1807 records). [2025-10-02T22:40:03.123042] [INFO ] [MAIN ] JELD: Successfully saved derivative data. [2025-10-02T22:40:03.126042] [INFO ] [MAIN ] Derivative Progress: 887/1975 symbols completed. JELD took 1.6s. Estimated remaining: 7m 38s. Rate: 142.4 symbols/min [2025-10-02T22:40:03.126826] [INFO ] [MAIN ] JHG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:03.129622] [DEBUG] [LOCAL ] JFR: Derivative data saved (1807 records). [2025-10-02T22:40:03.130325] [INFO ] [MAIN ] JFR: Successfully saved derivative data. [2025-10-02T22:40:03.132752] [INFO ] [MAIN ] Derivative Progress: 888/1975 symbols completed. JFR took 1.6s. Estimated remaining: 7m 38s. Rate: 142.5 symbols/min [2025-10-02T22:40:03.134779] [INFO ] [MAIN ] JHI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:03.142861] [DEBUG] [LOCAL ] JHI: Loaded 3612 existing records from primary storage. [2025-10-02T22:40:03.143361] [INFO ] [MAIN ] JHI: Loaded 3612 primary data records. [2025-10-02T22:40:03.328615] [DEBUG] [MAIN ] JGH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:03.427535] [INFO ] [MAIN ] JGH: Generated 1807 derivative records from 11163 primary records. [2025-10-02T22:40:03.428515] [DEBUG] [LOCAL ] JGH: Saving derivative data. [2025-10-02T22:40:03.573086] [DEBUG] [LOCAL ] JHG: Loaded 47986 existing records from primary storage. [2025-10-02T22:40:03.588377] [INFO ] [MAIN ] JHG: Loaded 47986 primary data records. [2025-10-02T22:40:03.683896] [DEBUG] [LOCAL ] JGH: Derivative data saved (1807 records). [2025-10-02T22:40:03.694450] [INFO ] [MAIN ] JGH: Successfully saved derivative data. [2025-10-02T22:40:03.715940] [INFO ] [MAIN ] Derivative Progress: 889/1975 symbols completed. JGH took 1.0s. Estimated remaining: 7m 37s. Rate: 142.5 symbols/min [2025-10-02T22:40:03.722350] [INFO ] [MAIN ] JHS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:03.932793] [DEBUG] [LOCAL ] JHS: Loaded 2834 existing records from primary storage. [2025-10-02T22:40:03.933427] [INFO ] [MAIN ] JHS: Loaded 2834 primary data records. [2025-10-02T22:40:04.121543] [DEBUG] [MAIN ] JHI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:04.156482] [INFO ] [MAIN ] JHI: Generated 1807 derivative records from 3612 primary records. [2025-10-02T22:40:04.265201] [DEBUG] [LOCAL ] JHI: Saving derivative data. [2025-10-02T22:40:04.300133] [DEBUG] [LOCAL ] JHI: Derivative data saved (1807 records). [2025-10-02T22:40:04.302367] [INFO ] [MAIN ] JHI: Successfully saved derivative data. [2025-10-02T22:40:04.305163] [INFO ] [MAIN ] Derivative Progress: 890/1975 symbols completed. JHI took 1.2s. Estimated remaining: 7m 37s. Rate: 142.4 symbols/min [2025-10-02T22:40:04.305726] [INFO ] [MAIN ] JHX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:04.320709] [DEBUG] [MAIN ] JHG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:04.321709] [INFO ] [MAIN ] JHG: Generated 1807 derivative records from 47986 primary records. [2025-10-02T22:40:04.321872] [DEBUG] [LOCAL ] JHG: Saving derivative data. [2025-10-02T22:40:04.341300] [DEBUG] [LOCAL ] JHG: Derivative data saved (1807 records). [2025-10-02T22:40:04.341529] [INFO ] [MAIN ] JHG: Successfully saved derivative data. [2025-10-02T22:40:04.343801] [INFO ] [MAIN ] Derivative Progress: 891/1975 symbols completed. JHG took 1.2s. Estimated remaining: 7m 36s. Rate: 142.6 symbols/min [2025-10-02T22:40:04.344237] [INFO ] [MAIN ] JILL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:04.365484] [DEBUG] [MAIN ] JHS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:04.366386] [INFO ] [MAIN ] JHS: Generated 1807 derivative records from 2834 primary records. [2025-10-02T22:40:04.366773] [DEBUG] [LOCAL ] JHS: Saving derivative data. [2025-10-02T22:40:04.405098] [DEBUG] [LOCAL ] JILL: Loaded 16768 existing records from primary storage. [2025-10-02T22:40:04.405872] [INFO ] [MAIN ] JILL: Loaded 16768 primary data records. [2025-10-02T22:40:04.431899] [DEBUG] [LOCAL ] JHS: Derivative data saved (1807 records). [2025-10-02T22:40:04.470795] [INFO ] [MAIN ] JHS: Successfully saved derivative data. [2025-10-02T22:40:04.503831] [INFO ] [MAIN ] Derivative Progress: 892/1975 symbols completed. JHS took 0.8s. Estimated remaining: 7m 35s. Rate: 142.7 symbols/min [2025-10-02T22:40:04.545756] [INFO ] [MAIN ] JKS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:04.532821] [DEBUG] [LOCAL ] JHX: Loaded 52271 existing records from primary storage. [2025-10-02T22:40:04.546075] [INFO ] [MAIN ] JHX: Loaded 52271 primary data records. [2025-10-02T22:40:05.209309] [DEBUG] [LOCAL ] JKS: Loaded 40360 existing records from primary storage. [2025-10-02T22:40:05.212837] [INFO ] [MAIN ] JKS: Loaded 40360 primary data records. [2025-10-02T22:40:05.401870] [DEBUG] [MAIN ] JILL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:05.403825] [INFO ] [MAIN ] JILL: Generated 1807 derivative records from 16768 primary records. [2025-10-02T22:40:05.403940] [DEBUG] [LOCAL ] JILL: Saving derivative data. [2025-10-02T22:40:05.472365] [DEBUG] [LOCAL ] JILL: Derivative data saved (1807 records). [2025-10-02T22:40:05.500342] [INFO ] [MAIN ] JILL: Successfully saved derivative data. [2025-10-02T22:40:05.515055] [INFO ] [MAIN ] Derivative Progress: 893/1975 symbols completed. JILL took 1.2s. Estimated remaining: 7m 36s. Rate: 142.4 symbols/min [2025-10-02T22:40:05.536371] [INFO ] [MAIN ] JLS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:05.829056] [DEBUG] [LOCAL ] JLS: Loaded 4162 existing records from primary storage. [2025-10-02T22:40:05.829515] [DEBUG] [MAIN ] JHX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:05.829588] [INFO ] [MAIN ] JLS: Loaded 4162 primary data records. [2025-10-02T22:40:05.830388] [INFO ] [MAIN ] JHX: Generated 1807 derivative records from 52271 primary records. [2025-10-02T22:40:05.835847] [DEBUG] [LOCAL ] JHX: Saving derivative data. [2025-10-02T22:40:05.951362] [DEBUG] [LOCAL ] JHX: Derivative data saved (1807 records). [2025-10-02T22:40:05.995684] [INFO ] [MAIN ] JHX: Successfully saved derivative data. [2025-10-02T22:40:06.016697] [INFO ] [MAIN ] Derivative Progress: 894/1975 symbols completed. JHX took 1.7s. Estimated remaining: 7m 35s. Rate: 142.4 symbols/min [2025-10-02T22:40:06.016966] [INFO ] [MAIN ] JMIA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:06.251189] [DEBUG] [MAIN ] JKS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:06.252513] [INFO ] [MAIN ] JKS: Generated 1807 derivative records from 40360 primary records. [2025-10-02T22:40:06.253179] [DEBUG] [LOCAL ] JKS: Saving derivative data. [2025-10-02T22:40:06.290927] [DEBUG] [LOCAL ] JKS: Derivative data saved (1807 records). [2025-10-02T22:40:06.291193] [INFO ] [MAIN ] JKS: Successfully saved derivative data. [2025-10-02T22:40:06.293343] [INFO ] [MAIN ] Derivative Progress: 895/1975 symbols completed. JKS took 1.7s. Estimated remaining: 7m 35s. Rate: 142.5 symbols/min [2025-10-02T22:40:06.293683] [INFO ] [MAIN ] JNJ: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:06.329362] [DEBUG] [MAIN ] JLS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:06.331404] [INFO ] [MAIN ] JLS: Generated 1807 derivative records from 4162 primary records. [2025-10-02T22:40:06.330552] [DEBUG] [LOCAL ] JMIA: Loaded 51046 existing records from primary storage. [2025-10-02T22:40:06.331566] [DEBUG] [LOCAL ] JLS: Saving derivative data. [2025-10-02T22:40:06.331965] [INFO ] [MAIN ] JMIA: Loaded 51046 primary data records. [2025-10-02T22:40:06.505485] [DEBUG] [LOCAL ] JLS: Derivative data saved (1807 records). [2025-10-02T22:40:06.557838] [INFO ] [MAIN ] JLS: Successfully saved derivative data. [2025-10-02T22:40:06.690764] [INFO ] [MAIN ] Derivative Progress: 896/1975 symbols completed. JLS took 1.2s. Estimated remaining: 7m 34s. Rate: 142.5 symbols/min [2025-10-02T22:40:06.692723] [INFO ] [MAIN ] JOBY: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:06.710974] [DEBUG] [LOCAL ] JNJ: Loaded 54143 existing records from primary storage. [2025-10-02T22:40:06.711576] [INFO ] [MAIN ] JNJ: Loaded 54143 primary data records. [2025-10-02T22:40:07.108486] [DEBUG] [LOCAL ] JOBY: Loaded 54189 existing records from primary storage. [2025-10-02T22:40:07.109818] [INFO ] [MAIN ] JOBY: Loaded 54189 primary data records. [2025-10-02T22:40:07.110421] [DEBUG] [MAIN ] JMIA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:07.159803] [INFO ] [MAIN ] JMIA: Generated 1807 derivative records from 51046 primary records. [2025-10-02T22:40:07.184175] [DEBUG] [LOCAL ] JMIA: Saving derivative data. [2025-10-02T22:40:07.247767] [DEBUG] [LOCAL ] JMIA: Derivative data saved (1807 records). [2025-10-02T22:40:07.253879] [INFO ] [MAIN ] JMIA: Successfully saved derivative data. [2025-10-02T22:40:07.277210] [INFO ] [MAIN ] Derivative Progress: 897/1975 symbols completed. JMIA took 1.3s. Estimated remaining: 7m 34s. Rate: 142.4 symbols/min [2025-10-02T22:40:07.295507] [INFO ] [MAIN ] JOE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:07.507672] [DEBUG] [MAIN ] JNJ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:07.516755] [INFO ] [MAIN ] JNJ: Generated 1807 derivative records from 54143 primary records. [2025-10-02T22:40:07.517238] [DEBUG] [LOCAL ] JNJ: Saving derivative data. [2025-10-02T22:40:07.551340] [DEBUG] [LOCAL ] JOE: Loaded 24297 existing records from primary storage. [2025-10-02T22:40:07.552492] [DEBUG] [LOCAL ] JNJ: Derivative data saved (1807 records). [2025-10-02T22:40:07.552737] [INFO ] [MAIN ] JOE: Loaded 24297 primary data records. [2025-10-02T22:40:07.553058] [INFO ] [MAIN ] JNJ: Successfully saved derivative data. [2025-10-02T22:40:07.572505] [INFO ] [MAIN ] Derivative Progress: 898/1975 symbols completed. JNJ took 1.3s. Estimated remaining: 7m 34s. Rate: 142.5 symbols/min [2025-10-02T22:40:07.750520] [DEBUG] [MAIN ] JOBY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:07.786887] [INFO ] [MAIN ] JOBY: Generated 1807 derivative records from 54189 primary records. [2025-10-02T22:40:07.787060] [DEBUG] [LOCAL ] JOBY: Saving derivative data. [2025-10-02T22:40:07.972893] [DEBUG] [LOCAL ] JOBY: Derivative data saved (1807 records). [2025-10-02T22:40:07.973292] [INFO ] [MAIN ] JOBY: Successfully saved derivative data. [2025-10-02T22:40:07.975778] [INFO ] [MAIN ] Derivative Progress: 899/1975 symbols completed. JOBY took 1.3s. Estimated remaining: 7m 33s. Rate: 142.5 symbols/min [2025-10-02T22:40:07.993552] [DEBUG] [MAIN ] JOE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:07.994174] [INFO ] [MAIN ] JOE: Generated 1807 derivative records from 24297 primary records. [2025-10-02T22:40:07.994235] [DEBUG] [LOCAL ] JOE: Saving derivative data. [2025-10-02T22:40:08.009710] [DEBUG] [LOCAL ] JOE: Derivative data saved (1807 records). [2025-10-02T22:40:08.009786] [INFO ] [MAIN ] JOE: Successfully saved derivative data. [2025-10-02T22:40:08.012227] [INFO ] [MAIN ] Derivative Progress: 900/1975 symbols completed. JOE took 0.7s. Estimated remaining: 7m 32s. Rate: 142.6 symbols/min [2025-10-02T22:40:08.012744] [INFO ] [MAIN ] JPC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:08.012677] [INFO ] [MAIN ] JOF: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:08.012980] [INFO ] [MAIN ] JPM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:08.027259] [DEBUG] [LOCAL ] JOF: Loaded 7036 existing records from primary storage. [2025-10-02T22:40:08.027555] [INFO ] [MAIN ] JOF: Loaded 7036 primary data records. [2025-10-02T22:40:08.390544] [DEBUG] [LOCAL ] JPC: Loaded 37383 existing records from primary storage. [2025-10-02T22:40:08.390997] [INFO ] [MAIN ] JPC: Loaded 37383 primary data records. [2025-10-02T22:40:08.537288] [DEBUG] [LOCAL ] JPM: Loaded 54184 existing records from primary storage. [2025-10-02T22:40:08.538193] [INFO ] [MAIN ] JPM: Loaded 54184 primary data records. [2025-10-02T22:40:08.996273] [DEBUG] [MAIN ] JOF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:09.060567] [INFO ] [MAIN ] JOF: Generated 1807 derivative records from 7036 primary records. [2025-10-02T22:40:09.131159] [DEBUG] [LOCAL ] JOF: Saving derivative data. [2025-10-02T22:40:09.156292] [DEBUG] [LOCAL ] JOF: Derivative data saved (1807 records). [2025-10-02T22:40:09.157172] [INFO ] [MAIN ] JOF: Successfully saved derivative data. [2025-10-02T22:40:09.161427] [INFO ] [MAIN ] Derivative Progress: 901/1975 symbols completed. JOF took 1.1s. Estimated remaining: 7m 33s. Rate: 142.3 symbols/min [2025-10-02T22:40:09.161803] [INFO ] [MAIN ] JQC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:09.185328] [DEBUG] [MAIN ] JPC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:09.186229] [INFO ] [MAIN ] JPC: Generated 1807 derivative records from 37383 primary records. [2025-10-02T22:40:09.186743] [DEBUG] [LOCAL ] JPC: Saving derivative data. [2025-10-02T22:40:09.226043] [DEBUG] [LOCAL ] JPC: Derivative data saved (1807 records). [2025-10-02T22:40:09.232248] [DEBUG] [MAIN ] JPM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:09.243472] [INFO ] [MAIN ] JPC: Successfully saved derivative data. [2025-10-02T22:40:09.245703] [INFO ] [MAIN ] Derivative Progress: 902/1975 symbols completed. JPC took 1.2s. Estimated remaining: 7m 32s. Rate: 142.5 symbols/min [2025-10-02T22:40:09.243384] [INFO ] [MAIN ] JPM: Generated 1807 derivative records from 54184 primary records. [2025-10-02T22:40:09.246034] [INFO ] [MAIN ] JRI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:09.247486] [DEBUG] [LOCAL ] JPM: Saving derivative data. [2025-10-02T22:40:09.247256] [DEBUG] [LOCAL ] JQC: Loaded 34592 existing records from primary storage. [2025-10-02T22:40:09.248602] [INFO ] [MAIN ] JQC: Loaded 34592 primary data records. [2025-10-02T22:40:09.328444] [DEBUG] [LOCAL ] JPM: Derivative data saved (1807 records). [2025-10-02T22:40:09.351829] [INFO ] [MAIN ] JPM: Successfully saved derivative data. [2025-10-02T22:40:09.359751] [INFO ] [MAIN ] Derivative Progress: 903/1975 symbols completed. JPM took 1.3s. Estimated remaining: 7m 31s. Rate: 142.6 symbols/min [2025-10-02T22:40:09.402926] [INFO ] [MAIN ] JRS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:09.408007] [DEBUG] [LOCAL ] JRI: Loaded 14997 existing records from primary storage. [2025-10-02T22:40:09.408416] [INFO ] [MAIN ] JRI: Loaded 14997 primary data records. [2025-10-02T22:40:09.612386] [DEBUG] [LOCAL ] JRS: Loaded 11452 existing records from primary storage. [2025-10-02T22:40:09.739511] [INFO ] [MAIN ] JRS: Loaded 11452 primary data records. [2025-10-02T22:40:10.355002] [DEBUG] [MAIN ] JQC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:10.357363] [INFO ] [MAIN ] JQC: Generated 1807 derivative records from 34592 primary records. [2025-10-02T22:40:10.357580] [DEBUG] [LOCAL ] JQC: Saving derivative data. [2025-10-02T22:40:10.391077] [DEBUG] [MAIN ] JRI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:10.392135] [INFO ] [MAIN ] JRI: Generated 1807 derivative records from 14997 primary records. [2025-10-02T22:40:10.390747] [DEBUG] [LOCAL ] JQC: Derivative data saved (1807 records). [2025-10-02T22:40:10.392378] [DEBUG] [LOCAL ] JRI: Saving derivative data. [2025-10-02T22:40:10.392469] [INFO ] [MAIN ] JQC: Successfully saved derivative data. [2025-10-02T22:40:10.395593] [INFO ] [MAIN ] Derivative Progress: 904/1975 symbols completed. JQC took 1.2s. Estimated remaining: 7m 31s. Rate: 142.3 symbols/min [2025-10-02T22:40:10.397149] [INFO ] [MAIN ] JXN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:10.414528] [DEBUG] [LOCAL ] JRI: Derivative data saved (1807 records). [2025-10-02T22:40:10.415623] [INFO ] [MAIN ] JRI: Successfully saved derivative data. [2025-10-02T22:40:10.418960] [INFO ] [MAIN ] Derivative Progress: 905/1975 symbols completed. JRI took 1.2s. Estimated remaining: 7m 31s. Rate: 142.5 symbols/min [2025-10-02T22:40:10.419952] [INFO ] [MAIN ] K: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:10.435921] [DEBUG] [MAIN ] JRS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:10.436835] [INFO ] [MAIN ] JRS: Generated 1807 derivative records from 11452 primary records. [2025-10-02T22:40:10.437096] [DEBUG] [LOCAL ] JRS: Saving derivative data. [2025-10-02T22:40:10.457674] [DEBUG] [LOCAL ] JRS: Derivative data saved (1807 records). [2025-10-02T22:40:10.457990] [INFO ] [MAIN ] JRS: Successfully saved derivative data. [2025-10-02T22:40:10.461134] [INFO ] [MAIN ] Derivative Progress: 906/1975 symbols completed. JRS took 1.1s. Estimated remaining: 7m 30s. Rate: 142.6 symbols/min [2025-10-02T22:40:10.461532] [INFO ] [MAIN ] KAI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:10.500892] [DEBUG] [LOCAL ] KAI: Loaded 13381 existing records from primary storage. [2025-10-02T22:40:10.515792] [INFO ] [MAIN ] KAI: Loaded 13381 primary data records. [2025-10-02T22:40:10.540138] [DEBUG] [LOCAL ] K: Loaded 50366 existing records from primary storage. [2025-10-02T22:40:10.591615] [INFO ] [MAIN ] K: Loaded 50366 primary data records. [2025-10-02T22:40:10.666637] [DEBUG] [LOCAL ] JXN: Loaded 45845 existing records from primary storage. [2025-10-02T22:40:10.736598] [INFO ] [MAIN ] JXN: Loaded 45845 primary data records. [2025-10-02T22:40:11.548764] [DEBUG] [MAIN ] KAI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:11.550782] [INFO ] [MAIN ] KAI: Generated 1807 derivative records from 13381 primary records. [2025-10-02T22:40:11.551951] [DEBUG] [LOCAL ] KAI: Saving derivative data. [2025-10-02T22:40:11.579619] [DEBUG] [MAIN ] K: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:11.580677] [INFO ] [MAIN ] K: Generated 1807 derivative records from 50366 primary records. [2025-10-02T22:40:11.581127] [DEBUG] [LOCAL ] K: Saving derivative data. [2025-10-02T22:40:11.621285] [DEBUG] [LOCAL ] KAI: Derivative data saved (1807 records). [2025-10-02T22:40:11.615082] [DEBUG] [LOCAL ] K: Derivative data saved (1807 records). [2025-10-02T22:40:11.621720] [INFO ] [MAIN ] K: Successfully saved derivative data. [2025-10-02T22:40:11.621555] [INFO ] [MAIN ] KAI: Successfully saved derivative data. [2025-10-02T22:40:11.623564] [INFO ] [MAIN ] Derivative Progress: 907/1975 symbols completed. KAI took 1.2s. Estimated remaining: 7m 30s. Rate: 142.4 symbols/min [2025-10-02T22:40:11.626536] [DEBUG] [MAIN ] JXN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:11.626700] [INFO ] [MAIN ] KAR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:11.627858] [INFO ] [MAIN ] JXN: Generated 1807 derivative records from 45845 primary records. [2025-10-02T22:40:11.628114] [DEBUG] [LOCAL ] JXN: Saving derivative data. [2025-10-02T22:40:11.626869] [INFO ] [MAIN ] Derivative Progress: 908/1975 symbols completed. K took 1.2s. Estimated remaining: 7m 29s. Rate: 142.5 symbols/min [2025-10-02T22:40:11.629003] [INFO ] [MAIN ] KB: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:11.647394] [DEBUG] [LOCAL ] JXN: Derivative data saved (1807 records). [2025-10-02T22:40:11.647679] [INFO ] [MAIN ] JXN: Successfully saved derivative data. [2025-10-02T22:40:11.651194] [INFO ] [MAIN ] Derivative Progress: 909/1975 symbols completed. JXN took 1.3s. Estimated remaining: 7m 28s. Rate: 142.7 symbols/min [2025-10-02T22:40:11.651426] [INFO ] [MAIN ] KBDC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:11.671674] [DEBUG] [LOCAL ] KB: Loaded 24074 existing records from primary storage. [2025-10-02T22:40:11.672088] [INFO ] [MAIN ] KB: Loaded 24074 primary data records. [2025-10-02T22:40:11.784392] [DEBUG] [LOCAL ] KBDC: Loaded 21392 existing records from primary storage. [2025-10-02T22:40:11.828490] [DEBUG] [LOCAL ] KAR: Loaded 40252 existing records from primary storage. [2025-10-02T22:40:11.833971] [INFO ] [MAIN ] KBDC: Loaded 21392 primary data records. [2025-10-02T22:40:11.839406] [INFO ] [MAIN ] KAR: Loaded 40252 primary data records. [2025-10-02T22:40:12.893837] [DEBUG] [MAIN ] KB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:12.895229] [INFO ] [MAIN ] KB: Generated 1807 derivative records from 24074 primary records. [2025-10-02T22:40:12.895564] [DEBUG] [LOCAL ] KB: Saving derivative data. [2025-10-02T22:40:12.918293] [DEBUG] [LOCAL ] KB: Derivative data saved (1807 records). [2025-10-02T22:40:12.933940] [DEBUG] [MAIN ] KBDC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:12.934921] [INFO ] [MAIN ] KBDC: Generated 1807 derivative records from 21392 primary records. [2025-10-02T22:40:12.933544] [INFO ] [MAIN ] KB: Successfully saved derivative data. [2025-10-02T22:40:12.942665] [DEBUG] [LOCAL ] KBDC: Saving derivative data. [2025-10-02T22:40:12.955206] [INFO ] [MAIN ] Derivative Progress: 910/1975 symbols completed. KB took 1.3s. Estimated remaining: 7m 29s. Rate: 142.3 symbols/min [2025-10-02T22:40:12.956207] [DEBUG] [MAIN ] KAR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:12.957602] [INFO ] [MAIN ] KAR: Generated 1807 derivative records from 40252 primary records. [2025-10-02T22:40:12.957781] [INFO ] [MAIN ] KBH: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:12.970057] [DEBUG] [LOCAL ] KAR: Saving derivative data. [2025-10-02T22:40:12.992997] [DEBUG] [LOCAL ] KAR: Derivative data saved (1807 records). [2025-10-02T22:40:12.993373] [INFO ] [MAIN ] KAR: Successfully saved derivative data. [2025-10-02T22:40:12.995943] [INFO ] [MAIN ] Derivative Progress: 911/1975 symbols completed. KAR took 1.4s. Estimated remaining: 7m 28s. Rate: 142.5 symbols/min [2025-10-02T22:40:12.996935] [INFO ] [MAIN ] KBR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:12.996732] [DEBUG] [LOCAL ] KBDC: Derivative data saved (1807 records). [2025-10-02T22:40:12.997334] [INFO ] [MAIN ] KBDC: Successfully saved derivative data. [2025-10-02T22:40:13.001746] [INFO ] [MAIN ] Derivative Progress: 912/1975 symbols completed. KBDC took 1.4s. Estimated remaining: 7m 27s. Rate: 142.6 symbols/min [2025-10-02T22:40:13.002684] [INFO ] [MAIN ] KD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:13.056940] [DEBUG] [LOCAL ] KBH: Loaded 49218 existing records from primary storage. [2025-10-02T22:40:13.057215] [INFO ] [MAIN ] KBH: Loaded 49218 primary data records. [2025-10-02T22:40:13.192090] [DEBUG] [LOCAL ] KBR: Loaded 48339 existing records from primary storage. [2025-10-02T22:40:13.205078] [INFO ] [MAIN ] KBR: Loaded 48339 primary data records. [2025-10-02T22:40:13.427944] [DEBUG] [LOCAL ] KD: Loaded 52682 existing records from primary storage. [2025-10-02T22:40:13.559346] [INFO ] [MAIN ] KD: Loaded 52682 primary data records. [2025-10-02T22:40:14.161022] [DEBUG] [MAIN ] KBH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:14.162231] [INFO ] [MAIN ] KBH: Generated 1807 derivative records from 49218 primary records. [2025-10-02T22:40:14.162437] [DEBUG] [LOCAL ] KBH: Saving derivative data. [2025-10-02T22:40:14.196770] [DEBUG] [MAIN ] KBR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:14.199373] [DEBUG] [LOCAL ] KBH: Derivative data saved (1807 records). [2025-10-02T22:40:14.198608] [INFO ] [MAIN ] KBR: Generated 1807 derivative records from 48339 primary records. [2025-10-02T22:40:14.199482] [INFO ] [MAIN ] KBH: Successfully saved derivative data. [2025-10-02T22:40:14.201573] [INFO ] [MAIN ] Derivative Progress: 913/1975 symbols completed. KBH took 1.2s. Estimated remaining: 7m 28s. Rate: 142.3 symbols/min [2025-10-02T22:40:14.199611] [DEBUG] [LOCAL ] KBR: Saving derivative data. [2025-10-02T22:40:14.220820] [DEBUG] [LOCAL ] KBR: Derivative data saved (1807 records). [2025-10-02T22:40:14.233584] [INFO ] [MAIN ] KBR: Successfully saved derivative data. [2025-10-02T22:40:14.233889] [DEBUG] [MAIN ] KD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:14.236054] [INFO ] [MAIN ] Derivative Progress: 914/1975 symbols completed. KBR took 1.2s. Estimated remaining: 7m 27s. Rate: 142.5 symbols/min [2025-10-02T22:40:14.236938] [INFO ] [MAIN ] KD: Generated 1807 derivative records from 52682 primary records. [2025-10-02T22:40:14.237161] [DEBUG] [LOCAL ] KD: Saving derivative data. [2025-10-02T22:40:14.253436] [DEBUG] [LOCAL ] KD: Derivative data saved (1807 records). [2025-10-02T22:40:14.253504] [INFO ] [MAIN ] KD: Successfully saved derivative data. [2025-10-02T22:40:14.256102] [INFO ] [MAIN ] Derivative Progress: 915/1975 symbols completed. KD took 1.3s. Estimated remaining: 7m 26s. Rate: 142.6 symbols/min [2025-10-02T22:40:14.256557] [INFO ] [MAIN ] KEN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:14.256757] [INFO ] [MAIN ] KEX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:14.256610] [INFO ] [MAIN ] KEP: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:14.267451] [DEBUG] [LOCAL ] KEN: Loaded 4749 existing records from primary storage. [2025-10-02T22:40:14.267595] [INFO ] [MAIN ] KEN: Loaded 4749 primary data records. [2025-10-02T22:40:14.464831] [DEBUG] [LOCAL ] KEX: Loaded 38410 existing records from primary storage. [2025-10-02T22:40:14.485797] [INFO ] [MAIN ] KEX: Loaded 38410 primary data records. [2025-10-02T22:40:14.526086] [DEBUG] [LOCAL ] KEP: Loaded 31283 existing records from primary storage. [2025-10-02T22:40:14.749948] [INFO ] [MAIN ] KEP: Loaded 31283 primary data records. [2025-10-02T22:40:15.387288] [DEBUG] [MAIN ] KEN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:15.388240] [INFO ] [MAIN ] KEN: Generated 1807 derivative records from 4749 primary records. [2025-10-02T22:40:15.388347] [DEBUG] [LOCAL ] KEN: Saving derivative data. [2025-10-02T22:40:15.409187] [DEBUG] [LOCAL ] KEN: Derivative data saved (1807 records). [2025-10-02T22:40:15.409897] [INFO ] [MAIN ] KEN: Successfully saved derivative data. [2025-10-02T22:40:15.425086] [INFO ] [MAIN ] Derivative Progress: 916/1975 symbols completed. KEN took 1.2s. Estimated remaining: 7m 26s. Rate: 142.4 symbols/min [2025-10-02T22:40:15.426293] [DEBUG] [MAIN ] KEX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:15.425849] [INFO ] [MAIN ] KEYS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:15.427587] [INFO ] [MAIN ] KEX: Generated 1807 derivative records from 38410 primary records. [2025-10-02T22:40:15.427766] [DEBUG] [LOCAL ] KEX: Saving derivative data. [2025-10-02T22:40:15.448387] [DEBUG] [LOCAL ] KEX: Derivative data saved (1807 records). [2025-10-02T22:40:15.449321] [INFO ] [MAIN ] KEX: Successfully saved derivative data. [2025-10-02T22:40:15.451723] [INFO ] [MAIN ] Derivative Progress: 917/1975 symbols completed. KEX took 1.2s. Estimated remaining: 7m 25s. Rate: 142.5 symbols/min [2025-10-02T22:40:15.452111] [INFO ] [MAIN ] KF: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:15.467425] [DEBUG] [MAIN ] KEP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:15.470721] [DEBUG] [LOCAL ] KF: Loaded 2452 existing records from primary storage. [2025-10-02T22:40:15.468516] [INFO ] [MAIN ] KEP: Generated 1807 derivative records from 31283 primary records. [2025-10-02T22:40:15.470891] [DEBUG] [LOCAL ] KEP: Saving derivative data. [2025-10-02T22:40:15.470941] [INFO ] [MAIN ] KF: Loaded 2452 primary data records. [2025-10-02T22:40:15.669534] [DEBUG] [LOCAL ] KEYS: Loaded 43450 existing records from primary storage. [2025-10-02T22:40:15.687767] [INFO ] [MAIN ] KEYS: Loaded 43450 primary data records. [2025-10-02T22:40:15.687691] [DEBUG] [LOCAL ] KEP: Derivative data saved (1807 records). [2025-10-02T22:40:15.875602] [INFO ] [MAIN ] KEP: Successfully saved derivative data. [2025-10-02T22:40:15.930169] [INFO ] [MAIN ] Derivative Progress: 918/1975 symbols completed. KEP took 1.7s. Estimated remaining: 7m 25s. Rate: 142.5 symbols/min [2025-10-02T22:40:15.951131] [INFO ] [MAIN ] KFRC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:16.204158] [DEBUG] [LOCAL ] KFRC: Loaded 19732 existing records from primary storage. [2025-10-02T22:40:16.204761] [INFO ] [MAIN ] KFRC: Loaded 19732 primary data records. [2025-10-02T22:40:16.389211] [DEBUG] [MAIN ] KF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:16.429929] [INFO ] [MAIN ] KF: Generated 1807 derivative records from 2452 primary records. [2025-10-02T22:40:16.606545] [DEBUG] [LOCAL ] KF: Saving derivative data. [2025-10-02T22:40:16.637248] [DEBUG] [LOCAL ] KF: Derivative data saved (1807 records). [2025-10-02T22:40:16.651979] [INFO ] [MAIN ] KF: Successfully saved derivative data. [2025-10-02T22:40:16.652410] [DEBUG] [MAIN ] KEYS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:16.654578] [INFO ] [MAIN ] Derivative Progress: 919/1975 symbols completed. KF took 1.2s. Estimated remaining: 7m 25s. Rate: 142.4 symbols/min [2025-10-02T22:40:16.655867] [INFO ] [MAIN ] KEYS: Generated 1807 derivative records from 43450 primary records. [2025-10-02T22:40:16.657095] [DEBUG] [LOCAL ] KEYS: Saving derivative data. [2025-10-02T22:40:16.657250] [INFO ] [MAIN ] KFS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:16.686541] [DEBUG] [LOCAL ] KEYS: Derivative data saved (1807 records). [2025-10-02T22:40:16.686724] [INFO ] [MAIN ] KEYS: Successfully saved derivative data. [2025-10-02T22:40:16.689520] [INFO ] [MAIN ] Derivative Progress: 920/1975 symbols completed. KEYS took 1.3s. Estimated remaining: 7m 24s. Rate: 142.5 symbols/min [2025-10-02T22:40:16.694866] [DEBUG] [LOCAL ] KFS: Loaded 8523 existing records from primary storage. [2025-10-02T22:40:16.695281] [INFO ] [MAIN ] KFY: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:16.695093] [INFO ] [MAIN ] KFS: Loaded 8523 primary data records. [2025-10-02T22:40:16.904531] [DEBUG] [MAIN ] KFRC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:16.928486] [INFO ] [MAIN ] KFRC: Generated 1807 derivative records from 19732 primary records. [2025-10-02T22:40:16.938676] [DEBUG] [LOCAL ] KFRC: Saving derivative data. [2025-10-02T22:40:17.056900] [DEBUG] [LOCAL ] KFY: Loaded 30268 existing records from primary storage. [2025-10-02T22:40:17.067407] [INFO ] [MAIN ] KFY: Loaded 30268 primary data records. [2025-10-02T22:40:17.134673] [DEBUG] [LOCAL ] KFRC: Derivative data saved (1807 records). [2025-10-02T22:40:17.172554] [INFO ] [MAIN ] KFRC: Successfully saved derivative data. [2025-10-02T22:40:17.204448] [INFO ] [MAIN ] Derivative Progress: 921/1975 symbols completed. KFRC took 1.3s. Estimated remaining: 7m 24s. Rate: 142.5 symbols/min [2025-10-02T22:40:17.232083] [INFO ] [MAIN ] KGC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:17.439568] [DEBUG] [MAIN ] KFS: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-02T22:40:17.440773] [INFO ] [MAIN ] KFS: Generated 1806 derivative records from 8523 primary records. [2025-10-02T22:40:17.440874] [DEBUG] [LOCAL ] KFS: Saving derivative data. [2025-10-02T22:40:17.474551] [DEBUG] [LOCAL ] KFS: Derivative data saved (1806 records). [2025-10-02T22:40:17.474724] [INFO ] [MAIN ] KFS: Successfully saved derivative data. [2025-10-02T22:40:17.476868] [INFO ] [MAIN ] Derivative Progress: 922/1975 symbols completed. KFS took 0.8s. Estimated remaining: 7m 23s. Rate: 142.5 symbols/min [2025-10-02T22:40:17.477135] [INFO ] [MAIN ] KGS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:17.497427] [DEBUG] [MAIN ] KFY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:17.498361] [INFO ] [MAIN ] KFY: Generated 1807 derivative records from 30268 primary records. [2025-10-02T22:40:17.498545] [DEBUG] [LOCAL ] KFY: Saving derivative data. [2025-10-02T22:40:17.515766] [DEBUG] [LOCAL ] KGC: Loaded 54089 existing records from primary storage. [2025-10-02T22:40:17.527986] [INFO ] [MAIN ] KGC: Loaded 54089 primary data records. [2025-10-02T22:40:17.531953] [DEBUG] [LOCAL ] KFY: Derivative data saved (1807 records). [2025-10-02T22:40:17.532200] [INFO ] [MAIN ] KFY: Successfully saved derivative data. [2025-10-02T22:40:17.534601] [INFO ] [MAIN ] Derivative Progress: 923/1975 symbols completed. KFY took 0.8s. Estimated remaining: 7m 22s. Rate: 142.7 symbols/min [2025-10-02T22:40:17.546810] [INFO ] [MAIN ] KIM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:17.770427] [DEBUG] [LOCAL ] KGS: Loaded 46001 existing records from primary storage. [2025-10-02T22:40:17.886511] [INFO ] [MAIN ] KGS: Loaded 46001 primary data records. [2025-10-02T22:40:18.137337] [DEBUG] [LOCAL ] KIM: Loaded 53419 existing records from primary storage. [2025-10-02T22:40:18.266469] [INFO ] [MAIN ] KIM: Loaded 53419 primary data records. [2025-10-02T22:40:18.485050] [DEBUG] [MAIN ] KGC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:18.599292] [INFO ] [MAIN ] KGC: Generated 1807 derivative records from 54089 primary records. [2025-10-02T22:40:18.607924] [DEBUG] [LOCAL ] KGC: Saving derivative data. [2025-10-02T22:40:18.633767] [DEBUG] [LOCAL ] KGC: Derivative data saved (1807 records). [2025-10-02T22:40:18.647714] [INFO ] [MAIN ] KGC: Successfully saved derivative data. [2025-10-02T22:40:18.648297] [DEBUG] [MAIN ] KGS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:18.651627] [INFO ] [MAIN ] KGS: Generated 1807 derivative records from 46001 primary records. [2025-10-02T22:40:18.651769] [DEBUG] [LOCAL ] KGS: Saving derivative data. [2025-10-02T22:40:18.650705] [INFO ] [MAIN ] Derivative Progress: 924/1975 symbols completed. KGC took 1.4s. Estimated remaining: 7m 23s. Rate: 142.4 symbols/min [2025-10-02T22:40:18.652944] [INFO ] [MAIN ] KIO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:18.670713] [DEBUG] [LOCAL ] KGS: Derivative data saved (1807 records). [2025-10-02T22:40:18.670979] [INFO ] [MAIN ] KGS: Successfully saved derivative data. [2025-10-02T22:40:18.673849] [INFO ] [MAIN ] Derivative Progress: 925/1975 symbols completed. KGS took 1.2s. Estimated remaining: 7m 22s. Rate: 142.6 symbols/min [2025-10-02T22:40:18.674052] [INFO ] [MAIN ] KKR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:18.697501] [DEBUG] [MAIN ] KIM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:18.698335] [INFO ] [MAIN ] KIM: Generated 1807 derivative records from 53419 primary records. [2025-10-02T22:40:18.698545] [DEBUG] [LOCAL ] KIM: Saving derivative data. [2025-10-02T22:40:18.724327] [DEBUG] [LOCAL ] KIO: Loaded 21442 existing records from primary storage. [2025-10-02T22:40:18.723762] [DEBUG] [LOCAL ] KIM: Derivative data saved (1807 records). [2025-10-02T22:40:18.724572] [INFO ] [MAIN ] KIM: Successfully saved derivative data. [2025-10-02T22:40:18.724693] [INFO ] [MAIN ] KIO: Loaded 21442 primary data records. [2025-10-02T22:40:18.726924] [INFO ] [MAIN ] Derivative Progress: 926/1975 symbols completed. KIM took 1.2s. Estimated remaining: 7m 21s. Rate: 142.7 symbols/min [2025-10-02T22:40:18.735034] [INFO ] [MAIN ] KKRS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:18.862836] [DEBUG] [LOCAL ] KKRS: Loaded 5729 existing records from primary storage. [2025-10-02T22:40:18.872941] [INFO ] [MAIN ] KKRS: Loaded 5729 primary data records. [2025-10-02T22:40:19.266496] [DEBUG] [LOCAL ] KKR: Loaded 53890 existing records from primary storage. [2025-10-02T22:40:19.298260] [INFO ] [MAIN ] KKR: Loaded 53890 primary data records. [2025-10-02T22:40:19.805190] [DEBUG] [MAIN ] KIO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:19.821201] [INFO ] [MAIN ] KIO: Generated 1807 derivative records from 21442 primary records. [2025-10-02T22:40:19.821350] [DEBUG] [LOCAL ] KIO: Saving derivative data. [2025-10-02T22:40:19.820244] [DEBUG] [MAIN ] KKRS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:19.822055] [INFO ] [MAIN ] KKRS: Generated 1807 derivative records from 5729 primary records. [2025-10-02T22:40:19.822152] [DEBUG] [LOCAL ] KKRS: Saving derivative data. [2025-10-02T22:40:19.856277] [DEBUG] [LOCAL ] KKRS: Derivative data saved (1807 records). [2025-10-02T22:40:19.857852] [INFO ] [MAIN ] KKRS: Successfully saved derivative data. [2025-10-02T22:40:19.860155] [INFO ] [MAIN ] Derivative Progress: 927/1975 symbols completed. KKRS took 1.1s. Estimated remaining: 7m 21s. Rate: 142.4 symbols/min [2025-10-02T22:40:19.860825] [INFO ] [MAIN ] KLC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:19.860700] [DEBUG] [LOCAL ] KIO: Derivative data saved (1807 records). [2025-10-02T22:40:19.863836] [INFO ] [MAIN ] KIO: Successfully saved derivative data. [2025-10-02T22:40:19.867187] [INFO ] [MAIN ] Derivative Progress: 928/1975 symbols completed. KIO took 1.2s. Estimated remaining: 7m 21s. Rate: 142.6 symbols/min [2025-10-02T22:40:19.881134] [DEBUG] [MAIN ] KKR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:19.882028] [INFO ] [MAIN ] KKR: Generated 1807 derivative records from 53890 primary records. [2025-10-02T22:40:19.882157] [DEBUG] [LOCAL ] KKR: Saving derivative data. [2025-10-02T22:40:19.899897] [DEBUG] [LOCAL ] KKR: Derivative data saved (1807 records). [2025-10-02T22:40:19.900006] [INFO ] [MAIN ] KKR: Successfully saved derivative data. [2025-10-02T22:40:19.902427] [INFO ] [MAIN ] Derivative Progress: 929/1975 symbols completed. KKR took 1.2s. Estimated remaining: 7m 20s. Rate: 142.7 symbols/min [2025-10-02T22:40:19.931886] [DEBUG] [LOCAL ] KLC: Loaded 36984 existing records from primary storage. [2025-10-02T22:40:19.932067] [INFO ] [MAIN ] KLC: Loaded 36984 primary data records. [2025-10-02T22:40:20.276007] [DEBUG] [MAIN ] KLC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:20.276759] [INFO ] [MAIN ] KLC: Generated 1807 derivative records from 36984 primary records. [2025-10-02T22:40:20.276828] [DEBUG] [LOCAL ] KLC: Saving derivative data. [2025-10-02T22:40:20.293161] [DEBUG] [LOCAL ] KLC: Derivative data saved (1807 records). [2025-10-02T22:40:20.293288] [INFO ] [MAIN ] KLC: Successfully saved derivative data. [2025-10-02T22:40:20.295286] [INFO ] [MAIN ] Derivative Progress: 930/1975 symbols completed. KLC took 0.4s. Estimated remaining: 7m 19s. Rate: 142.7 symbols/min [2025-10-02T22:40:20.296079] [INFO ] [MAIN ] KMPR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:20.295903] [INFO ] [MAIN ] KMI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:20.295993] [INFO ] [MAIN ] KMPB: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:20.308086] [DEBUG] [LOCAL ] KMPB: Loaded 3795 existing records from primary storage. [2025-10-02T22:40:20.308547] [INFO ] [MAIN ] KMPB: Loaded 3795 primary data records. [2025-10-02T22:40:20.539498] [DEBUG] [LOCAL ] KMPR: Loaded 39204 existing records from primary storage. [2025-10-02T22:40:20.563868] [INFO ] [MAIN ] KMPR: Loaded 39204 primary data records. [2025-10-02T22:40:20.763934] [DEBUG] [LOCAL ] KMI: Loaded 54083 existing records from primary storage. [2025-10-02T22:40:20.816864] [INFO ] [MAIN ] KMI: Loaded 54083 primary data records. [2025-10-02T22:40:21.456681] [DEBUG] [MAIN ] KMPB: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-02T22:40:21.459065] [INFO ] [MAIN ] KMPB: Generated 1806 derivative records from 3795 primary records. [2025-10-02T22:40:21.459413] [DEBUG] [LOCAL ] KMPB: Saving derivative data. [2025-10-02T22:40:21.481117] [DEBUG] [LOCAL ] KMPB: Derivative data saved (1806 records). [2025-10-02T22:40:21.481520] [INFO ] [MAIN ] KMPB: Successfully saved derivative data. [2025-10-02T22:40:21.485123] [INFO ] [MAIN ] Derivative Progress: 931/1975 symbols completed. KMPB took 1.2s. Estimated remaining: 7m 20s. Rate: 142.5 symbols/min [2025-10-02T22:40:21.500758] [INFO ] [MAIN ] KMT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:21.501077] [DEBUG] [MAIN ] KMPR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:21.502202] [INFO ] [MAIN ] KMPR: Generated 1807 derivative records from 39204 primary records. [2025-10-02T22:40:21.502380] [DEBUG] [LOCAL ] KMPR: Saving derivative data. [2025-10-02T22:40:21.531351] [DEBUG] [MAIN ] KMI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:21.536272] [INFO ] [MAIN ] KMI: Generated 1807 derivative records from 54083 primary records. [2025-10-02T22:40:21.539153] [DEBUG] [LOCAL ] KMI: Saving derivative data. [2025-10-02T22:40:21.541448] [DEBUG] [LOCAL ] KMPR: Derivative data saved (1807 records). [2025-10-02T22:40:21.553496] [INFO ] [MAIN ] KMPR: Successfully saved derivative data. [2025-10-02T22:40:21.561663] [INFO ] [MAIN ] Derivative Progress: 932/1975 symbols completed. KMPR took 1.3s. Estimated remaining: 7m 19s. Rate: 142.6 symbols/min [2025-10-02T22:40:21.562181] [INFO ] [MAIN ] KMX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:21.580428] [DEBUG] [LOCAL ] KMI: Derivative data saved (1807 records). [2025-10-02T22:40:21.580576] [INFO ] [MAIN ] KMI: Successfully saved derivative data. [2025-10-02T22:40:21.583728] [INFO ] [MAIN ] Derivative Progress: 933/1975 symbols completed. KMI took 1.3s. Estimated remaining: 7m 18s. Rate: 142.7 symbols/min [2025-10-02T22:40:21.584174] [INFO ] [MAIN ] KN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:21.601792] [DEBUG] [LOCAL ] KMT: Loaded 43222 existing records from primary storage. [2025-10-02T22:40:21.601988] [INFO ] [MAIN ] KMT: Loaded 43222 primary data records. [2025-10-02T22:40:22.007603] [DEBUG] [LOCAL ] KMX: Loaded 53551 existing records from primary storage. [2025-10-02T22:40:22.006105] [DEBUG] [LOCAL ] KN: Loaded 38880 existing records from primary storage. [2025-10-02T22:40:22.007917] [INFO ] [MAIN ] KN: Loaded 38880 primary data records. [2025-10-02T22:40:22.016950] [INFO ] [MAIN ] KMX: Loaded 53551 primary data records. [2025-10-02T22:40:22.740886] [DEBUG] [MAIN ] KMT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:22.742482] [INFO ] [MAIN ] KMT: Generated 1807 derivative records from 43222 primary records. [2025-10-02T22:40:22.743894] [DEBUG] [LOCAL ] KMT: Saving derivative data. [2025-10-02T22:40:22.767157] [DEBUG] [LOCAL ] KMT: Derivative data saved (1807 records). [2025-10-02T22:40:22.767371] [INFO ] [MAIN ] KMT: Successfully saved derivative data. [2025-10-02T22:40:22.769842] [INFO ] [MAIN ] Derivative Progress: 934/1975 symbols completed. KMT took 1.3s. Estimated remaining: 7m 18s. Rate: 142.4 symbols/min [2025-10-02T22:40:22.770300] [INFO ] [MAIN ] KNF: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:22.790763] [DEBUG] [MAIN ] KMX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:22.791595] [INFO ] [MAIN ] KMX: Generated 1807 derivative records from 53551 primary records. [2025-10-02T22:40:22.791879] [DEBUG] [LOCAL ] KMX: Saving derivative data. [2025-10-02T22:40:22.819827] [DEBUG] [MAIN ] KN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:22.821553] [INFO ] [MAIN ] KN: Generated 1807 derivative records from 38880 primary records. [2025-10-02T22:40:22.821793] [DEBUG] [LOCAL ] KN: Saving derivative data. [2025-10-02T22:40:22.850579] [DEBUG] [LOCAL ] KMX: Derivative data saved (1807 records). [2025-10-02T22:40:22.851242] [INFO ] [MAIN ] KMX: Successfully saved derivative data. [2025-10-02T22:40:22.853418] [INFO ] [MAIN ] Derivative Progress: 935/1975 symbols completed. KMX took 1.3s. Estimated remaining: 7m 18s. Rate: 142.6 symbols/min [2025-10-02T22:40:22.853955] [INFO ] [MAIN ] KNOP: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:22.858363] [DEBUG] [LOCAL ] KN: Derivative data saved (1807 records). [2025-10-02T22:40:22.858632] [INFO ] [MAIN ] KN: Successfully saved derivative data. [2025-10-02T22:40:22.861157] [INFO ] [MAIN ] Derivative Progress: 936/1975 symbols completed. KN took 1.3s. Estimated remaining: 7m 17s. Rate: 142.7 symbols/min [2025-10-02T22:40:22.861456] [INFO ] [MAIN ] KNSL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:22.874390] [DEBUG] [LOCAL ] KNF: Loaded 36189 existing records from primary storage. [2025-10-02T22:40:22.874499] [INFO ] [MAIN ] KNF: Loaded 36189 primary data records. [2025-10-02T22:40:22.972490] [DEBUG] [LOCAL ] KNOP: Loaded 10514 existing records from primary storage. [2025-10-02T22:40:23.010004] [INFO ] [MAIN ] KNOP: Loaded 10514 primary data records. [2025-10-02T22:40:23.182633] [DEBUG] [LOCAL ] KNSL: Loaded 18336 existing records from primary storage. [2025-10-02T22:40:23.391359] [INFO ] [MAIN ] KNSL: Loaded 18336 primary data records. [2025-10-02T22:40:23.987480] [DEBUG] [MAIN ] KNF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:24.001504] [DEBUG] [MAIN ] KNOP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:24.003798] [INFO ] [MAIN ] KNOP: Generated 1807 derivative records from 10514 primary records. [2025-10-02T22:40:24.002497] [INFO ] [MAIN ] KNF: Generated 1807 derivative records from 36189 primary records. [2025-10-02T22:40:24.003947] [DEBUG] [LOCAL ] KNOP: Saving derivative data. [2025-10-02T22:40:24.004836] [DEBUG] [LOCAL ] KNF: Saving derivative data. [2025-10-02T22:40:24.059068] [DEBUG] [LOCAL ] KNOP: Derivative data saved (1807 records). [2025-10-02T22:40:24.059755] [INFO ] [MAIN ] KNOP: Successfully saved derivative data. [2025-10-02T22:40:24.063270] [INFO ] [MAIN ] Derivative Progress: 937/1975 symbols completed. KNOP took 1.2s. Estimated remaining: 7m 17s. Rate: 142.4 symbols/min [2025-10-02T22:40:24.060628] [DEBUG] [LOCAL ] KNF: Derivative data saved (1807 records). [2025-10-02T22:40:24.063865] [INFO ] [MAIN ] KNF: Successfully saved derivative data. [2025-10-02T22:40:24.064077] [INFO ] [MAIN ] KNTK: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:24.063616] [DEBUG] [MAIN ] KNSL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:24.067574] [INFO ] [MAIN ] Derivative Progress: 938/1975 symbols completed. KNF took 1.3s. Estimated remaining: 7m 16s. Rate: 142.6 symbols/min [2025-10-02T22:40:24.068355] [INFO ] [MAIN ] KNX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:24.069365] [INFO ] [MAIN ] KNSL: Generated 1807 derivative records from 18336 primary records. [2025-10-02T22:40:24.070125] [DEBUG] [LOCAL ] KNSL: Saving derivative data. [2025-10-02T22:40:24.088477] [DEBUG] [LOCAL ] KNSL: Derivative data saved (1807 records). [2025-10-02T22:40:24.088790] [INFO ] [MAIN ] KNSL: Successfully saved derivative data. [2025-10-02T22:40:24.091221] [INFO ] [MAIN ] Derivative Progress: 939/1975 symbols completed. KNSL took 1.2s. Estimated remaining: 7m 16s. Rate: 142.7 symbols/min [2025-10-02T22:40:24.091446] [INFO ] [MAIN ] KODK: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:24.149398] [DEBUG] [LOCAL ] KNTK: Loaded 46533 existing records from primary storage. [2025-10-02T22:40:24.160422] [INFO ] [MAIN ] KNTK: Loaded 46533 primary data records. [2025-10-02T22:40:24.278407] [DEBUG] [LOCAL ] KODK: Loaded 43779 existing records from primary storage. [2025-10-02T22:40:24.297227] [DEBUG] [LOCAL ] KNX: Loaded 52978 existing records from primary storage. [2025-10-02T22:40:24.318118] [INFO ] [MAIN ] KODK: Loaded 43779 primary data records. [2025-10-02T22:40:24.318215] [INFO ] [MAIN ] KNX: Loaded 52978 primary data records. [2025-10-02T22:40:25.260862] [DEBUG] [MAIN ] KNTK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:25.262351] [INFO ] [MAIN ] KNTK: Generated 1807 derivative records from 46533 primary records. [2025-10-02T22:40:25.263300] [DEBUG] [LOCAL ] KNTK: Saving derivative data. [2025-10-02T22:40:25.302306] [DEBUG] [MAIN ] KODK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:25.308399] [DEBUG] [MAIN ] KNX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:25.309856] [INFO ] [MAIN ] KODK: Generated 1807 derivative records from 43779 primary records. [2025-10-02T22:40:25.310310] [DEBUG] [LOCAL ] KODK: Saving derivative data. [2025-10-02T22:40:25.312419] [INFO ] [MAIN ] KNX: Generated 1807 derivative records from 52978 primary records. [2025-10-02T22:40:25.312557] [DEBUG] [LOCAL ] KNX: Saving derivative data. [2025-10-02T22:40:25.346028] [DEBUG] [LOCAL ] KODK: Derivative data saved (1807 records). [2025-10-02T22:40:25.346752] [INFO ] [MAIN ] KODK: Successfully saved derivative data. [2025-10-02T22:40:25.349996] [INFO ] [MAIN ] Derivative Progress: 940/1975 symbols completed. KODK took 1.3s. Estimated remaining: 7m 16s. Rate: 142.4 symbols/min [2025-10-02T22:40:25.351080] [INFO ] [MAIN ] KOF: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:25.353267] [DEBUG] [LOCAL ] KNTK: Derivative data saved (1807 records). [2025-10-02T22:40:25.354079] [INFO ] [MAIN ] KNTK: Successfully saved derivative data. [2025-10-02T22:40:25.356201] [INFO ] [MAIN ] Derivative Progress: 941/1975 symbols completed. KNTK took 1.3s. Estimated remaining: 7m 15s. Rate: 142.6 symbols/min [2025-10-02T22:40:25.358821] [DEBUG] [LOCAL ] KNX: Derivative data saved (1807 records). [2025-10-02T22:40:25.358928] [INFO ] [MAIN ] KNX: Successfully saved derivative data. [2025-10-02T22:40:25.361719] [INFO ] [MAIN ] Derivative Progress: 942/1975 symbols completed. KNX took 1.3s. Estimated remaining: 7m 14s. Rate: 142.7 symbols/min [2025-10-02T22:40:25.359159] [INFO ] [MAIN ] KOP: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:25.362037] [INFO ] [MAIN ] KORE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:25.367456] [DEBUG] [LOCAL ] KORE: Loaded 2034 existing records from primary storage. [2025-10-02T22:40:25.367805] [INFO ] [MAIN ] KORE: Loaded 2034 primary data records. [2025-10-02T22:40:25.501923] [DEBUG] [LOCAL ] KOP: Loaded 17741 existing records from primary storage. [2025-10-02T22:40:25.506482] [DEBUG] [LOCAL ] KOF: Loaded 26353 existing records from primary storage. [2025-10-02T22:40:25.506769] [INFO ] [MAIN ] KOP: Loaded 17741 primary data records. [2025-10-02T22:40:25.506971] [INFO ] [MAIN ] KOF: Loaded 26353 primary data records. [2025-10-02T22:40:26.440307] [DEBUG] [MAIN ] KORE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:26.441707] [INFO ] [MAIN ] KORE: Generated 1807 derivative records from 2034 primary records. [2025-10-02T22:40:26.442013] [DEBUG] [LOCAL ] KORE: Saving derivative data. [2025-10-02T22:40:26.458829] [DEBUG] [LOCAL ] KORE: Derivative data saved (1807 records). [2025-10-02T22:40:26.462663] [INFO ] [MAIN ] KORE: Successfully saved derivative data. [2025-10-02T22:40:26.465058] [INFO ] [MAIN ] Derivative Progress: 943/1975 symbols completed. KORE took 1.1s. Estimated remaining: 7m 15s. Rate: 142.5 symbols/min [2025-10-02T22:40:26.491437] [DEBUG] [MAIN ] KOP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:26.492910] [DEBUG] [MAIN ] KOF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:26.492493] [INFO ] [MAIN ] KOP: Generated 1807 derivative records from 17741 primary records. [2025-10-02T22:40:26.493753] [INFO ] [MAIN ] KOF: Generated 1807 derivative records from 26353 primary records. [2025-10-02T22:40:26.493900] [DEBUG] [LOCAL ] KOP: Saving derivative data. [2025-10-02T22:40:26.494003] [DEBUG] [LOCAL ] KOF: Saving derivative data. [2025-10-02T22:40:26.524138] [DEBUG] [LOCAL ] KOF: Derivative data saved (1807 records). [2025-10-02T22:40:26.524777] [INFO ] [MAIN ] KOF: Successfully saved derivative data. [2025-10-02T22:40:26.527245] [INFO ] [MAIN ] Derivative Progress: 944/1975 symbols completed. KOF took 1.2s. Estimated remaining: 7m 14s. Rate: 142.6 symbols/min [2025-10-02T22:40:26.530180] [DEBUG] [LOCAL ] KOP: Derivative data saved (1807 records). [2025-10-02T22:40:26.530244] [INFO ] [MAIN ] KOP: Successfully saved derivative data. [2025-10-02T22:40:26.532574] [INFO ] [MAIN ] Derivative Progress: 945/1975 symbols completed. KOP took 1.2s. Estimated remaining: 7m 13s. Rate: 142.8 symbols/min [2025-10-02T22:40:26.532956] [INFO ] [MAIN ] KOS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:26.533073] [INFO ] [MAIN ] KR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:26.533186] [INFO ] [MAIN ] KRC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:26.631296] [DEBUG] [LOCAL ] KRC: Loaded 48621 existing records from primary storage. [2025-10-02T22:40:26.631967] [INFO ] [MAIN ] KRC: Loaded 48621 primary data records. [2025-10-02T22:40:26.630623] [DEBUG] [LOCAL ] KOS: Loaded 53441 existing records from primary storage. [2025-10-02T22:40:26.632308] [INFO ] [MAIN ] KOS: Loaded 53441 primary data records. [2025-10-02T22:40:26.759144] [DEBUG] [LOCAL ] KR: Loaded 54071 existing records from primary storage. [2025-10-02T22:40:26.838527] [INFO ] [MAIN ] KR: Loaded 54071 primary data records. [2025-10-02T22:40:27.714534] [DEBUG] [MAIN ] KOS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:27.715552] [INFO ] [MAIN ] KOS: Generated 1807 derivative records from 53441 primary records. [2025-10-02T22:40:27.715781] [DEBUG] [LOCAL ] KOS: Saving derivative data. [2025-10-02T22:40:27.746067] [DEBUG] [MAIN ] KRC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:27.747454] [INFO ] [MAIN ] KRC: Generated 1807 derivative records from 48621 primary records. [2025-10-02T22:40:27.750478] [DEBUG] [LOCAL ] KRC: Saving derivative data. [2025-10-02T22:40:27.751822] [DEBUG] [LOCAL ] KOS: Derivative data saved (1807 records). [2025-10-02T22:40:27.752335] [INFO ] [MAIN ] KOS: Successfully saved derivative data. [2025-10-02T22:40:27.755020] [INFO ] [MAIN ] Derivative Progress: 946/1975 symbols completed. KOS took 1.2s. Estimated remaining: 7m 13s. Rate: 142.5 symbols/min [2025-10-02T22:40:27.755430] [INFO ] [MAIN ] KREF: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:27.782180] [DEBUG] [MAIN ] KR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:27.783467] [INFO ] [MAIN ] KR: Generated 1807 derivative records from 54071 primary records. [2025-10-02T22:40:27.783663] [DEBUG] [LOCAL ] KR: Saving derivative data. [2025-10-02T22:40:27.808366] [DEBUG] [LOCAL ] KRC: Derivative data saved (1807 records). [2025-10-02T22:40:27.808989] [INFO ] [MAIN ] KRC: Successfully saved derivative data. [2025-10-02T22:40:27.811116] [INFO ] [MAIN ] Derivative Progress: 947/1975 symbols completed. KRC took 1.3s. Estimated remaining: 7m 13s. Rate: 142.6 symbols/min [2025-10-02T22:40:27.811552] [INFO ] [MAIN ] KRG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:27.823423] [DEBUG] [LOCAL ] KR: Derivative data saved (1807 records). [2025-10-02T22:40:27.823788] [INFO ] [MAIN ] KR: Successfully saved derivative data. [2025-10-02T22:40:27.826756] [INFO ] [MAIN ] Derivative Progress: 948/1975 symbols completed. KR took 1.3s. Estimated remaining: 7m 12s. Rate: 142.7 symbols/min [2025-10-02T22:40:27.827023] [INFO ] [MAIN ] KRO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:27.843126] [DEBUG] [LOCAL ] KREF: Loaded 37907 existing records from primary storage. [2025-10-02T22:40:27.843375] [INFO ] [MAIN ] KREF: Loaded 37907 primary data records. [2025-10-02T22:40:28.078577] [DEBUG] [LOCAL ] KRO: Loaded 26251 existing records from primary storage. [2025-10-02T22:40:28.092862] [INFO ] [MAIN ] KRO: Loaded 26251 primary data records. [2025-10-02T22:40:28.175937] [DEBUG] [LOCAL ] KRG: Loaded 49512 existing records from primary storage. [2025-10-02T22:40:28.277610] [INFO ] [MAIN ] KRG: Loaded 49512 primary data records. [2025-10-02T22:40:28.922196] [DEBUG] [MAIN ] KREF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:28.923844] [INFO ] [MAIN ] KREF: Generated 1807 derivative records from 37907 primary records. [2025-10-02T22:40:28.925041] [DEBUG] [LOCAL ] KREF: Saving derivative data. [2025-10-02T22:40:28.946983] [DEBUG] [LOCAL ] KREF: Derivative data saved (1807 records). [2025-10-02T22:40:28.947429] [INFO ] [MAIN ] KREF: Successfully saved derivative data. [2025-10-02T22:40:28.951517] [INFO ] [MAIN ] Derivative Progress: 949/1975 symbols completed. KREF took 1.2s. Estimated remaining: 7m 12s. Rate: 142.5 symbols/min [2025-10-02T22:40:28.952482] [INFO ] [MAIN ] KRP: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:28.969267] [DEBUG] [MAIN ] KRO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:28.970409] [INFO ] [MAIN ] KRO: Generated 1807 derivative records from 26251 primary records. [2025-10-02T22:40:28.970571] [DEBUG] [LOCAL ] KRO: Saving derivative data. [2025-10-02T22:40:28.997501] [DEBUG] [MAIN ] KRG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:28.999031] [INFO ] [MAIN ] KRG: Generated 1807 derivative records from 49512 primary records. [2025-10-02T22:40:28.999678] [DEBUG] [LOCAL ] KRG: Saving derivative data. [2025-10-02T22:40:29.017811] [DEBUG] [LOCAL ] KRO: Derivative data saved (1807 records). [2025-10-02T22:40:29.019394] [INFO ] [MAIN ] KRO: Successfully saved derivative data. [2025-10-02T22:40:29.021403] [INFO ] [MAIN ] Derivative Progress: 950/1975 symbols completed. KRO took 1.2s. Estimated remaining: 7m 11s. Rate: 142.6 symbols/min [2025-10-02T22:40:29.022077] [INFO ] [MAIN ] KSS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:29.034832] [DEBUG] [LOCAL ] KRG: Derivative data saved (1807 records). [2025-10-02T22:40:29.034982] [INFO ] [MAIN ] KRG: Successfully saved derivative data. [2025-10-02T22:40:29.037753] [INFO ] [MAIN ] Derivative Progress: 951/1975 symbols completed. KRG took 1.2s. Estimated remaining: 7m 10s. Rate: 142.8 symbols/min [2025-10-02T22:40:29.038148] [INFO ] [MAIN ] KT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:29.056215] [DEBUG] [LOCAL ] KRP: Loaded 37273 existing records from primary storage. [2025-10-02T22:40:29.056443] [INFO ] [MAIN ] KRP: Loaded 37273 primary data records. [2025-10-02T22:40:29.433451] [DEBUG] [LOCAL ] KT: Loaded 46056 existing records from primary storage. [2025-10-02T22:40:29.433622] [INFO ] [MAIN ] KT: Loaded 46056 primary data records. [2025-10-02T22:40:29.439635] [DEBUG] [LOCAL ] KSS: Loaded 53992 existing records from primary storage. [2025-10-02T22:40:29.471894] [INFO ] [MAIN ] KSS: Loaded 53992 primary data records. [2025-10-02T22:40:30.148697] [DEBUG] [MAIN ] KRP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:30.150787] [INFO ] [MAIN ] KRP: Generated 1807 derivative records from 37273 primary records. [2025-10-02T22:40:30.151138] [DEBUG] [LOCAL ] KRP: Saving derivative data. [2025-10-02T22:40:30.171497] [DEBUG] [LOCAL ] KRP: Derivative data saved (1807 records). [2025-10-02T22:40:30.171843] [INFO ] [MAIN ] KRP: Successfully saved derivative data. [2025-10-02T22:40:30.175288] [INFO ] [MAIN ] Derivative Progress: 952/1975 symbols completed. KRP took 1.2s. Estimated remaining: 7m 11s. Rate: 142.5 symbols/min [2025-10-02T22:40:30.175942] [INFO ] [MAIN ] KTB: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:30.199166] [DEBUG] [MAIN ] KT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:30.200415] [INFO ] [MAIN ] KT: Generated 1807 derivative records from 46056 primary records. [2025-10-02T22:40:30.200635] [DEBUG] [LOCAL ] KT: Saving derivative data. [2025-10-02T22:40:30.214281] [DEBUG] [MAIN ] KSS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:30.215151] [INFO ] [MAIN ] KSS: Generated 1807 derivative records from 53992 primary records. [2025-10-02T22:40:30.216162] [DEBUG] [LOCAL ] KSS: Saving derivative data. [2025-10-02T22:40:30.266290] [DEBUG] [LOCAL ] KT: Derivative data saved (1807 records). [2025-10-02T22:40:30.267286] [INFO ] [MAIN ] KT: Successfully saved derivative data. [2025-10-02T22:40:30.267152] [DEBUG] [LOCAL ] KSS: Derivative data saved (1807 records). [2025-10-02T22:40:30.278022] [INFO ] [MAIN ] KSS: Successfully saved derivative data. [2025-10-02T22:40:30.280146] [INFO ] [MAIN ] Derivative Progress: 953/1975 symbols completed. KT took 1.2s. Estimated remaining: 7m 10s. Rate: 142.6 symbols/min [2025-10-02T22:40:30.281939] [INFO ] [MAIN ] KTF: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:30.285216] [INFO ] [MAIN ] Derivative Progress: 954/1975 symbols completed. KSS took 1.3s. Estimated remaining: 7m 9s. Rate: 142.8 symbols/min [2025-10-02T22:40:30.285443] [INFO ] [MAIN ] KVUE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:30.286829] [DEBUG] [LOCAL ] KTB: Loaded 41321 existing records from primary storage. [2025-10-02T22:40:30.287141] [INFO ] [MAIN ] KTB: Loaded 41321 primary data records. [2025-10-02T22:40:30.408599] [DEBUG] [LOCAL ] KTF: Loaded 12632 existing records from primary storage. [2025-10-02T22:40:30.419774] [INFO ] [MAIN ] KTF: Loaded 12632 primary data records. [2025-10-02T22:40:30.970322] [DEBUG] [LOCAL ] KVUE: Loaded 54057 existing records from primary storage. [2025-10-02T22:40:30.970563] [INFO ] [MAIN ] KVUE: Loaded 54057 primary data records. [2025-10-02T22:40:31.317832] [DEBUG] [MAIN ] KTB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:31.319493] [INFO ] [MAIN ] KTB: Generated 1807 derivative records from 41321 primary records. [2025-10-02T22:40:31.319902] [DEBUG] [LOCAL ] KTB: Saving derivative data. [2025-10-02T22:40:31.355707] [DEBUG] [LOCAL ] KTB: Derivative data saved (1807 records). [2025-10-02T22:40:31.356448] [INFO ] [MAIN ] KTB: Successfully saved derivative data. [2025-10-02T22:40:31.358547] [INFO ] [MAIN ] Derivative Progress: 955/1975 symbols completed. KTB took 1.2s. Estimated remaining: 7m 9s. Rate: 142.5 symbols/min [2025-10-02T22:40:31.358727] [INFO ] [MAIN ] KVYO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:31.356378] [DEBUG] [MAIN ] KTF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:31.360144] [INFO ] [MAIN ] KTF: Generated 1807 derivative records from 12632 primary records. [2025-10-02T22:40:31.360763] [DEBUG] [LOCAL ] KTF: Saving derivative data. [2025-10-02T22:40:31.381702] [DEBUG] [LOCAL ] KTF: Derivative data saved (1807 records). [2025-10-02T22:40:31.383618] [INFO ] [MAIN ] KTF: Successfully saved derivative data. [2025-10-02T22:40:31.387099] [INFO ] [MAIN ] Derivative Progress: 956/1975 symbols completed. KTF took 1.1s. Estimated remaining: 7m 9s. Rate: 142.7 symbols/min [2025-10-02T22:40:31.388278] [INFO ] [MAIN ] KW: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:31.403946] [DEBUG] [MAIN ] KVUE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:31.404794] [INFO ] [MAIN ] KVUE: Generated 1807 derivative records from 54057 primary records. [2025-10-02T22:40:31.405025] [DEBUG] [LOCAL ] KVUE: Saving derivative data. [2025-10-02T22:40:31.452360] [DEBUG] [LOCAL ] KVUE: Derivative data saved (1807 records). [2025-10-02T22:40:31.452565] [INFO ] [MAIN ] KVUE: Successfully saved derivative data. [2025-10-02T22:40:31.455775] [INFO ] [MAIN ] Derivative Progress: 957/1975 symbols completed. KVUE took 1.2s. Estimated remaining: 7m 8s. Rate: 142.8 symbols/min [2025-10-02T22:40:31.455980] [INFO ] [MAIN ] KWR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:31.457325] [DEBUG] [LOCAL ] KVYO: Loaded 50458 existing records from primary storage. [2025-10-02T22:40:31.457511] [INFO ] [MAIN ] KVYO: Loaded 50458 primary data records. [2025-10-02T22:40:31.621531] [DEBUG] [LOCAL ] KW: Loaded 40831 existing records from primary storage. [2025-10-02T22:40:31.655361] [INFO ] [MAIN ] KW: Loaded 40831 primary data records. [2025-10-02T22:40:31.887145] [DEBUG] [LOCAL ] KWR: Loaded 16654 existing records from primary storage. [2025-10-02T22:40:31.893707] [INFO ] [MAIN ] KWR: Loaded 16654 primary data records. [2025-10-02T22:40:32.546815] [DEBUG] [MAIN ] KVYO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:32.548279] [INFO ] [MAIN ] KVYO: Generated 1807 derivative records from 50458 primary records. [2025-10-02T22:40:32.548491] [DEBUG] [LOCAL ] KVYO: Saving derivative data. [2025-10-02T22:40:32.583667] [DEBUG] [MAIN ] KW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:32.585134] [INFO ] [MAIN ] KW: Generated 1807 derivative records from 40831 primary records. [2025-10-02T22:40:32.588370] [DEBUG] [LOCAL ] KVYO: Derivative data saved (1807 records). [2025-10-02T22:40:32.587966] [DEBUG] [LOCAL ] KW: Saving derivative data. [2025-10-02T22:40:32.589871] [INFO ] [MAIN ] KVYO: Successfully saved derivative data. [2025-10-02T22:40:32.592202] [INFO ] [MAIN ] Derivative Progress: 958/1975 symbols completed. KVYO took 1.2s. Estimated remaining: 7m 8s. Rate: 142.5 symbols/min [2025-10-02T22:40:32.619379] [DEBUG] [MAIN ] KWR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:32.620770] [INFO ] [MAIN ] KWR: Generated 1807 derivative records from 16654 primary records. [2025-10-02T22:40:32.621435] [DEBUG] [LOCAL ] KWR: Saving derivative data. [2025-10-02T22:40:32.631749] [DEBUG] [LOCAL ] KW: Derivative data saved (1807 records). [2025-10-02T22:40:32.635353] [INFO ] [MAIN ] KW: Successfully saved derivative data. [2025-10-02T22:40:32.638270] [INFO ] [MAIN ] Derivative Progress: 959/1975 symbols completed. KW took 1.2s. Estimated remaining: 7m 7s. Rate: 142.7 symbols/min [2025-10-02T22:40:32.642590] [DEBUG] [LOCAL ] KWR: Derivative data saved (1807 records). [2025-10-02T22:40:32.642680] [INFO ] [MAIN ] KWR: Successfully saved derivative data. [2025-10-02T22:40:32.645130] [INFO ] [MAIN ] Derivative Progress: 960/1975 symbols completed. KWR took 1.2s. Estimated remaining: 7m 6s. Rate: 142.8 symbols/min [2025-10-02T22:40:32.645559] [INFO ] [MAIN ] KYN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:32.645762] [INFO ] [MAIN ] L: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:32.645623] [INFO ] [MAIN ] LAC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:32.704438] [DEBUG] [LOCAL ] L: Loaded 41305 existing records from primary storage. [2025-10-02T22:40:32.704616] [INFO ] [MAIN ] L: Loaded 41305 primary data records. [2025-10-02T22:40:32.819458] [DEBUG] [LOCAL ] KYN: Loaded 30181 existing records from primary storage. [2025-10-02T22:40:32.853009] [INFO ] [MAIN ] KYN: Loaded 30181 primary data records. [2025-10-02T22:40:32.925699] [DEBUG] [LOCAL ] LAC: Loaded 52752 existing records from primary storage. [2025-10-02T22:40:32.976058] [INFO ] [MAIN ] LAC: Loaded 52752 primary data records. [2025-10-02T22:40:33.785088] [DEBUG] [MAIN ] L: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:33.786757] [INFO ] [MAIN ] L: Generated 1807 derivative records from 41305 primary records. [2025-10-02T22:40:33.787007] [DEBUG] [LOCAL ] L: Saving derivative data. [2025-10-02T22:40:33.819904] [DEBUG] [MAIN ] KYN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:33.820762] [DEBUG] [LOCAL ] L: Derivative data saved (1807 records). [2025-10-02T22:40:33.821681] [INFO ] [MAIN ] KYN: Generated 1807 derivative records from 30181 primary records. [2025-10-02T22:40:33.822055] [DEBUG] [LOCAL ] KYN: Saving derivative data. [2025-10-02T22:40:33.821910] [INFO ] [MAIN ] L: Successfully saved derivative data. [2025-10-02T22:40:33.824668] [INFO ] [MAIN ] Derivative Progress: 961/1975 symbols completed. L took 1.2s. Estimated remaining: 7m 7s. Rate: 142.6 symbols/min [2025-10-02T22:40:33.826686] [INFO ] [MAIN ] LAD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:33.856583] [DEBUG] [LOCAL ] KYN: Derivative data saved (1807 records). [2025-10-02T22:40:33.856976] [INFO ] [MAIN ] KYN: Successfully saved derivative data. [2025-10-02T22:40:33.859914] [INFO ] [MAIN ] Derivative Progress: 962/1975 symbols completed. KYN took 1.2s. Estimated remaining: 7m 6s. Rate: 142.7 symbols/min [2025-10-02T22:40:33.857262] [DEBUG] [MAIN ] LAC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:33.861164] [INFO ] [MAIN ] LAC: Generated 1807 derivative records from 52752 primary records. [2025-10-02T22:40:33.860122] [INFO ] [MAIN ] LADR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:33.861414] [DEBUG] [LOCAL ] LAC: Saving derivative data. [2025-10-02T22:40:33.888075] [DEBUG] [LOCAL ] LAC: Derivative data saved (1807 records). [2025-10-02T22:40:33.888425] [INFO ] [MAIN ] LAC: Successfully saved derivative data. [2025-10-02T22:40:33.897100] [INFO ] [MAIN ] Derivative Progress: 963/1975 symbols completed. LAC took 1.3s. Estimated remaining: 7m 5s. Rate: 142.8 symbols/min [2025-10-02T22:40:33.898443] [INFO ] [MAIN ] LANV: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:33.899494] [DEBUG] [LOCAL ] LAD: Loaded 23644 existing records from primary storage. [2025-10-02T22:40:33.899723] [INFO ] [MAIN ] LAD: Loaded 23644 primary data records. [2025-10-02T22:40:33.990193] [DEBUG] [LOCAL ] LANV: Loaded 2845 existing records from primary storage. [2025-10-02T22:40:34.018770] [INFO ] [MAIN ] LANV: Loaded 2845 primary data records. [2025-10-02T22:40:34.232610] [DEBUG] [LOCAL ] LADR: Loaded 39182 existing records from primary storage. [2025-10-02T22:40:34.245019] [INFO ] [MAIN ] LADR: Loaded 39182 primary data records. [2025-10-02T22:40:34.984328] [DEBUG] [MAIN ] LAD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:34.985708] [INFO ] [MAIN ] LAD: Generated 1807 derivative records from 23644 primary records. [2025-10-02T22:40:34.985849] [DEBUG] [LOCAL ] LAD: Saving derivative data. [2025-10-02T22:40:35.017596] [DEBUG] [MAIN ] LANV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:35.019101] [INFO ] [MAIN ] LANV: Generated 1807 derivative records from 2845 primary records. [2025-10-02T22:40:35.019789] [DEBUG] [LOCAL ] LANV: Saving derivative data. [2025-10-02T22:40:35.022480] [DEBUG] [LOCAL ] LAD: Derivative data saved (1807 records). [2025-10-02T22:40:35.028298] [INFO ] [MAIN ] LAD: Successfully saved derivative data. [2025-10-02T22:40:35.034578] [INFO ] [MAIN ] Derivative Progress: 964/1975 symbols completed. LAD took 1.2s. Estimated remaining: 7m 5s. Rate: 142.6 symbols/min [2025-10-02T22:40:35.035379] [INFO ] [MAIN ] LAW: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:35.043364] [DEBUG] [LOCAL ] LANV: Derivative data saved (1807 records). [2025-10-02T22:40:35.043553] [INFO ] [MAIN ] LANV: Successfully saved derivative data. [2025-10-02T22:40:35.046047] [INFO ] [MAIN ] Derivative Progress: 965/1975 symbols completed. LANV took 1.1s. Estimated remaining: 7m 5s. Rate: 142.7 symbols/min [2025-10-02T22:40:35.046434] [INFO ] [MAIN ] LAZ: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:35.061131] [DEBUG] [MAIN ] LADR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:35.061918] [INFO ] [MAIN ] LADR: Generated 1807 derivative records from 39182 primary records. [2025-10-02T22:40:35.065892] [DEBUG] [LOCAL ] LADR: Saving derivative data. [2025-10-02T22:40:35.086972] [DEBUG] [LOCAL ] LAW: Loaded 14185 existing records from primary storage. [2025-10-02T22:40:35.088453] [INFO ] [MAIN ] LAW: Loaded 14185 primary data records. [2025-10-02T22:40:35.102165] [DEBUG] [LOCAL ] LADR: Derivative data saved (1807 records). [2025-10-02T22:40:35.114622] [INFO ] [MAIN ] LADR: Successfully saved derivative data. [2025-10-02T22:40:35.137206] [INFO ] [MAIN ] Derivative Progress: 966/1975 symbols completed. LADR took 1.3s. Estimated remaining: 7m 4s. Rate: 142.8 symbols/min [2025-10-02T22:40:35.162827] [INFO ] [MAIN ] LB: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:35.457833] [DEBUG] [LOCAL ] LAZ: Loaded 45182 existing records from primary storage. [2025-10-02T22:40:35.458262] [INFO ] [MAIN ] LAZ: Loaded 45182 primary data records. [2025-10-02T22:40:35.649053] [DEBUG] [LOCAL ] LB: Loaded 37995 existing records from primary storage. [2025-10-02T22:40:35.779865] [INFO ] [MAIN ] LB: Loaded 37995 primary data records. [2025-10-02T22:40:36.036994] [DEBUG] [MAIN ] LAW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:36.207437] [INFO ] [MAIN ] LAW: Generated 1807 derivative records from 14185 primary records. [2025-10-02T22:40:36.208730] [DEBUG] [LOCAL ] LAW: Saving derivative data. [2025-10-02T22:40:36.227258] [DEBUG] [LOCAL ] LAW: Derivative data saved (1807 records). [2025-10-02T22:40:36.227636] [INFO ] [MAIN ] LAW: Successfully saved derivative data. [2025-10-02T22:40:36.229911] [INFO ] [MAIN ] Derivative Progress: 967/1975 symbols completed. LAW took 1.2s. Estimated remaining: 7m 4s. Rate: 142.6 symbols/min [2025-10-02T22:40:36.230550] [INFO ] [MAIN ] LBRT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:36.249439] [DEBUG] [MAIN ] LAZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:36.250314] [INFO ] [MAIN ] LAZ: Generated 1807 derivative records from 45182 primary records. [2025-10-02T22:40:36.250409] [DEBUG] [LOCAL ] LAZ: Saving derivative data. [2025-10-02T22:40:36.271782] [DEBUG] [LOCAL ] LAZ: Derivative data saved (1807 records). [2025-10-02T22:40:36.273018] [INFO ] [MAIN ] LAZ: Successfully saved derivative data. [2025-10-02T22:40:36.275621] [INFO ] [MAIN ] Derivative Progress: 968/1975 symbols completed. LAZ took 1.2s. Estimated remaining: 7m 3s. Rate: 142.7 symbols/min [2025-10-02T22:40:36.276722] [INFO ] [MAIN ] LC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:36.291711] [DEBUG] [MAIN ] LB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:36.292564] [INFO ] [MAIN ] LB: Generated 1807 derivative records from 37995 primary records. [2025-10-02T22:40:36.292848] [DEBUG] [LOCAL ] LB: Saving derivative data. [2025-10-02T22:40:36.324479] [DEBUG] [LOCAL ] LB: Derivative data saved (1807 records). [2025-10-02T22:40:36.325464] [INFO ] [MAIN ] LB: Successfully saved derivative data. [2025-10-02T22:40:36.328307] [INFO ] [MAIN ] Derivative Progress: 969/1975 symbols completed. LB took 1.2s. Estimated remaining: 7m 3s. Rate: 142.9 symbols/min [2025-10-02T22:40:36.328681] [INFO ] [MAIN ] LCII: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:36.346962] [DEBUG] [LOCAL ] LBRT: Loaded 53299 existing records from primary storage. [2025-10-02T22:40:36.347415] [INFO ] [MAIN ] LBRT: Loaded 53299 primary data records. [2025-10-02T22:40:36.570793] [DEBUG] [LOCAL ] LC: Loaded 48187 existing records from primary storage. [2025-10-02T22:40:36.595470] [INFO ] [MAIN ] LC: Loaded 48187 primary data records. [2025-10-02T22:40:36.673756] [DEBUG] [LOCAL ] LCII: Loaded 28181 existing records from primary storage. [2025-10-02T22:40:36.719895] [INFO ] [MAIN ] LCII: Loaded 28181 primary data records. [2025-10-02T22:40:37.415411] [DEBUG] [MAIN ] LBRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:37.417093] [INFO ] [MAIN ] LBRT: Generated 1807 derivative records from 53299 primary records. [2025-10-02T22:40:37.417632] [DEBUG] [LOCAL ] LBRT: Saving derivative data. [2025-10-02T22:40:37.443082] [DEBUG] [LOCAL ] LBRT: Derivative data saved (1807 records). [2025-10-02T22:40:37.443685] [INFO ] [MAIN ] LBRT: Successfully saved derivative data. [2025-10-02T22:40:37.446043] [INFO ] [MAIN ] Derivative Progress: 970/1975 symbols completed. LBRT took 1.2s. Estimated remaining: 7m 3s. Rate: 142.6 symbols/min [2025-10-02T22:40:37.446528] [INFO ] [MAIN ] LDI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:37.461579] [DEBUG] [MAIN ] LC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:37.462991] [INFO ] [MAIN ] LC: Generated 1807 derivative records from 48187 primary records. [2025-10-02T22:40:37.463380] [DEBUG] [LOCAL ] LC: Saving derivative data. [2025-10-02T22:40:37.492618] [DEBUG] [LOCAL ] LC: Derivative data saved (1807 records). [2025-10-02T22:40:37.497849] [INFO ] [MAIN ] LC: Successfully saved derivative data. [2025-10-02T22:40:37.500403] [INFO ] [MAIN ] Derivative Progress: 971/1975 symbols completed. LC took 1.2s. Estimated remaining: 7m 2s. Rate: 142.7 symbols/min [2025-10-02T22:40:37.501047] [DEBUG] [MAIN ] LCII: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:37.502284] [INFO ] [MAIN ] LDOS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:37.502138] [INFO ] [MAIN ] LCII: Generated 1807 derivative records from 28181 primary records. [2025-10-02T22:40:37.502551] [DEBUG] [LOCAL ] LCII: Saving derivative data. [2025-10-02T22:40:37.536625] [DEBUG] [LOCAL ] LCII: Derivative data saved (1807 records). [2025-10-02T22:40:37.536870] [INFO ] [MAIN ] LCII: Successfully saved derivative data. [2025-10-02T22:40:37.539458] [INFO ] [MAIN ] Derivative Progress: 972/1975 symbols completed. LCII took 1.2s. Estimated remaining: 7m 1s. Rate: 142.9 symbols/min [2025-10-02T22:40:37.539914] [INFO ] [MAIN ] LDP: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:37.562022] [DEBUG] [LOCAL ] LDI: Loaded 44523 existing records from primary storage. [2025-10-02T22:40:37.562389] [INFO ] [MAIN ] LDI: Loaded 44523 primary data records. [2025-10-02T22:40:37.693081] [DEBUG] [LOCAL ] LDP: Loaded 13028 existing records from primary storage. [2025-10-02T22:40:37.698255] [INFO ] [MAIN ] LDP: Loaded 13028 primary data records. [2025-10-02T22:40:38.048754] [DEBUG] [LOCAL ] LDOS: Loaded 45923 existing records from primary storage. [2025-10-02T22:40:38.055015] [INFO ] [MAIN ] LDOS: Loaded 45923 primary data records. [2025-10-02T22:40:38.636684] [DEBUG] [MAIN ] LDI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:38.638230] [INFO ] [MAIN ] LDI: Generated 1807 derivative records from 44523 primary records. [2025-10-02T22:40:38.638399] [DEBUG] [LOCAL ] LDI: Saving derivative data. [2025-10-02T22:40:38.672919] [DEBUG] [MAIN ] LDP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:38.674045] [DEBUG] [LOCAL ] LDI: Derivative data saved (1807 records). [2025-10-02T22:40:38.674940] [INFO ] [MAIN ] LDP: Generated 1807 derivative records from 13028 primary records. [2025-10-02T22:40:38.675250] [DEBUG] [LOCAL ] LDP: Saving derivative data. [2025-10-02T22:40:38.675462] [INFO ] [MAIN ] LDI: Successfully saved derivative data. [2025-10-02T22:40:38.677720] [INFO ] [MAIN ] Derivative Progress: 973/1975 symbols completed. LDI took 1.2s. Estimated remaining: 7m 2s. Rate: 142.6 symbols/min [2025-10-02T22:40:38.710300] [DEBUG] [MAIN ] LDOS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:38.711718] [INFO ] [MAIN ] LDOS: Generated 1807 derivative records from 45923 primary records. [2025-10-02T22:40:38.712030] [DEBUG] [LOCAL ] LDOS: Saving derivative data. [2025-10-02T22:40:38.713468] [DEBUG] [LOCAL ] LDP: Derivative data saved (1807 records). [2025-10-02T22:40:38.721407] [INFO ] [MAIN ] LDP: Successfully saved derivative data. [2025-10-02T22:40:38.728126] [INFO ] [MAIN ] Derivative Progress: 974/1975 symbols completed. LDP took 1.2s. Estimated remaining: 7m 1s. Rate: 142.8 symbols/min [2025-10-02T22:40:38.732503] [DEBUG] [LOCAL ] LDOS: Derivative data saved (1807 records). [2025-10-02T22:40:38.732618] [INFO ] [MAIN ] LDOS: Successfully saved derivative data. [2025-10-02T22:40:38.735055] [INFO ] [MAIN ] Derivative Progress: 975/1975 symbols completed. LDOS took 1.2s. Estimated remaining: 6m 60s. Rate: 142.9 symbols/min [2025-10-02T22:40:38.735691] [INFO ] [MAIN ] LEN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:38.735587] [INFO ] [MAIN ] LEG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:38.735509] [INFO ] [MAIN ] LEA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:38.819051] [DEBUG] [LOCAL ] LEA: Loaded 42058 existing records from primary storage. [2025-10-02T22:40:38.848230] [INFO ] [MAIN ] LEA: Loaded 42058 primary data records. [2025-10-02T22:40:38.849629] [DEBUG] [LOCAL ] LEN: Loaded 53562 existing records from primary storage. [2025-10-02T22:40:38.850268] [DEBUG] [LOCAL ] LEG: Loaded 50600 existing records from primary storage. [2025-10-02T22:40:38.850712] [INFO ] [MAIN ] LEG: Loaded 50600 primary data records. [2025-10-02T22:40:38.855905] [INFO ] [MAIN ] LEN: Loaded 53562 primary data records. [2025-10-02T22:40:39.915893] [DEBUG] [MAIN ] LEN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:39.931993] [INFO ] [MAIN ] LEN: Generated 1807 derivative records from 53562 primary records. [2025-10-02T22:40:39.945454] [DEBUG] [MAIN ] LEA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:39.946278] [DEBUG] [MAIN ] LEG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:39.945609] [DEBUG] [LOCAL ] LEN: Saving derivative data. [2025-10-02T22:40:39.948074] [INFO ] [MAIN ] LEA: Generated 1807 derivative records from 42058 primary records. [2025-10-02T22:40:39.948848] [DEBUG] [LOCAL ] LEA: Saving derivative data. [2025-10-02T22:40:39.948765] [INFO ] [MAIN ] LEG: Generated 1807 derivative records from 50600 primary records. [2025-10-02T22:40:39.949274] [DEBUG] [LOCAL ] LEG: Saving derivative data. [2025-10-02T22:40:39.994277] [DEBUG] [LOCAL ] LEA: Derivative data saved (1807 records). [2025-10-02T22:40:39.995982] [INFO ] [MAIN ] LEA: Successfully saved derivative data. [2025-10-02T22:40:39.999576] [INFO ] [MAIN ] Derivative Progress: 976/1975 symbols completed. LEA took 1.3s. Estimated remaining: 7m 0s. Rate: 142.6 symbols/min [2025-10-02T22:40:40.000530] [INFO ] [MAIN ] LEO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:40.003265] [DEBUG] [LOCAL ] LEG: Derivative data saved (1807 records). [2025-10-02T22:40:40.003368] [INFO ] [MAIN ] LEG: Successfully saved derivative data. [2025-10-02T22:40:40.005585] [INFO ] [MAIN ] Derivative Progress: 977/1975 symbols completed. LEG took 1.3s. Estimated remaining: 6m 59s. Rate: 142.8 symbols/min [2025-10-02T22:40:40.006214] [INFO ] [MAIN ] LEVI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:40.007177] [DEBUG] [LOCAL ] LEN: Derivative data saved (1807 records). [2025-10-02T22:40:40.007803] [INFO ] [MAIN ] LEN: Successfully saved derivative data. [2025-10-02T22:40:40.010418] [INFO ] [MAIN ] Derivative Progress: 978/1975 symbols completed. LEN took 1.3s. Estimated remaining: 6m 59s. Rate: 142.9 symbols/min [2025-10-02T22:40:40.010924] [INFO ] [MAIN ] LFT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:40.034235] [DEBUG] [LOCAL ] LEO: Loaded 17395 existing records from primary storage. [2025-10-02T22:40:40.034448] [INFO ] [MAIN ] LEO: Loaded 17395 primary data records. [2025-10-02T22:40:40.096092] [DEBUG] [LOCAL ] LFT: Loaded 18394 existing records from primary storage. [2025-10-02T22:40:40.120171] [INFO ] [MAIN ] LFT: Loaded 18394 primary data records. [2025-10-02T22:40:40.524385] [DEBUG] [LOCAL ] LEVI: Loaded 51949 existing records from primary storage. [2025-10-02T22:40:40.541345] [INFO ] [MAIN ] LEVI: Loaded 51949 primary data records. [2025-10-02T22:40:41.143061] [DEBUG] [MAIN ] LEO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:41.144567] [INFO ] [MAIN ] LEO: Generated 1807 derivative records from 17395 primary records. [2025-10-02T22:40:41.145045] [DEBUG] [LOCAL ] LEO: Saving derivative data. [2025-10-02T22:40:41.178580] [DEBUG] [LOCAL ] LEO: Derivative data saved (1807 records). [2025-10-02T22:40:41.179118] [INFO ] [MAIN ] LEO: Successfully saved derivative data. [2025-10-02T22:40:41.181466] [INFO ] [MAIN ] Derivative Progress: 979/1975 symbols completed. LEO took 1.2s. Estimated remaining: 6m 59s. Rate: 142.6 symbols/min [2025-10-02T22:40:41.179439] [DEBUG] [MAIN ] LFT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:41.182701] [INFO ] [MAIN ] LFT: Generated 1807 derivative records from 18394 primary records. [2025-10-02T22:40:41.181715] [INFO ] [MAIN ] LGI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:41.183316] [DEBUG] [LOCAL ] LFT: Saving derivative data. [2025-10-02T22:40:41.216869] [DEBUG] [MAIN ] LEVI: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-02T22:40:41.221815] [DEBUG] [LOCAL ] LGI: Loaded 9893 existing records from primary storage. [2025-10-02T22:40:41.223504] [INFO ] [MAIN ] LGI: Loaded 9893 primary data records. [2025-10-02T22:40:41.223067] [INFO ] [MAIN ] LEVI: Generated 1806 derivative records from 51949 primary records. [2025-10-02T22:40:41.236239] [DEBUG] [LOCAL ] LFT: Derivative data saved (1807 records). [2025-10-02T22:40:41.236374] [DEBUG] [LOCAL ] LEVI: Saving derivative data. [2025-10-02T22:40:41.237064] [INFO ] [MAIN ] LFT: Successfully saved derivative data. [2025-10-02T22:40:41.239411] [INFO ] [MAIN ] Derivative Progress: 980/1975 symbols completed. LFT took 1.2s. Estimated remaining: 6m 58s. Rate: 142.8 symbols/min [2025-10-02T22:40:41.261776] [INFO ] [MAIN ] LH: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:41.320090] [DEBUG] [LOCAL ] LEVI: Derivative data saved (1806 records). [2025-10-02T22:40:41.327941] [INFO ] [MAIN ] LEVI: Successfully saved derivative data. [2025-10-02T22:40:41.348756] [INFO ] [MAIN ] Derivative Progress: 981/1975 symbols completed. LEVI took 1.3s. Estimated remaining: 6m 57s. Rate: 142.9 symbols/min [2025-10-02T22:40:41.362176] [INFO ] [MAIN ] LHX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:41.615715] [DEBUG] [LOCAL ] LH: Loaded 38094 existing records from primary storage. [2025-10-02T22:40:41.616233] [INFO ] [MAIN ] LH: Loaded 38094 primary data records. [2025-10-02T22:40:41.757997] [DEBUG] [LOCAL ] LHX: Loaded 49032 existing records from primary storage. [2025-10-02T22:40:41.758354] [INFO ] [MAIN ] LHX: Loaded 49032 primary data records. [2025-10-02T22:40:41.832395] [DEBUG] [MAIN ] LGI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:41.916459] [INFO ] [MAIN ] LGI: Generated 1807 derivative records from 9893 primary records. [2025-10-02T22:40:41.972598] [DEBUG] [LOCAL ] LGI: Saving derivative data. [2025-10-02T22:40:42.335226] [DEBUG] [LOCAL ] LGI: Derivative data saved (1807 records). [2025-10-02T22:40:42.336327] [INFO ] [MAIN ] LGI: Successfully saved derivative data. [2025-10-02T22:40:42.338487] [INFO ] [MAIN ] Derivative Progress: 982/1975 symbols completed. LGI took 1.2s. Estimated remaining: 6m 58s. Rate: 142.7 symbols/min [2025-10-02T22:40:42.338901] [INFO ] [MAIN ] LII: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:42.376163] [DEBUG] [MAIN ] LH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:42.377023] [INFO ] [MAIN ] LH: Generated 1807 derivative records from 38094 primary records. [2025-10-02T22:40:42.377223] [DEBUG] [LOCAL ] LH: Saving derivative data. [2025-10-02T22:40:42.389626] [DEBUG] [LOCAL ] LII: Loaded 28170 existing records from primary storage. [2025-10-02T22:40:42.399714] [INFO ] [MAIN ] LII: Loaded 28170 primary data records. [2025-10-02T22:40:42.462028] [DEBUG] [LOCAL ] LH: Derivative data saved (1807 records). [2025-10-02T22:40:42.470050] [INFO ] [MAIN ] LH: Successfully saved derivative data. [2025-10-02T22:40:42.472938] [INFO ] [MAIN ] Derivative Progress: 983/1975 symbols completed. LH took 1.2s. Estimated remaining: 6m 57s. Rate: 142.8 symbols/min [2025-10-02T22:40:42.486740] [INFO ] [MAIN ] LITB: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:42.470487] [DEBUG] [MAIN ] LHX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:42.510157] [INFO ] [MAIN ] LHX: Generated 1807 derivative records from 49032 primary records. [2025-10-02T22:40:42.510579] [DEBUG] [LOCAL ] LHX: Saving derivative data. [2025-10-02T22:40:42.564033] [DEBUG] [LOCAL ] LHX: Derivative data saved (1807 records). [2025-10-02T22:40:42.567435] [INFO ] [MAIN ] LHX: Successfully saved derivative data. [2025-10-02T22:40:42.581273] [INFO ] [MAIN ] Derivative Progress: 984/1975 symbols completed. LHX took 1.2s. Estimated remaining: 6m 56s. Rate: 142.9 symbols/min [2025-10-02T22:40:42.567627] [DEBUG] [LOCAL ] LITB: Loaded 4368 existing records from primary storage. [2025-10-02T22:40:42.621836] [INFO ] [MAIN ] LITB: Loaded 4368 primary data records. [2025-10-02T22:40:42.612134] [INFO ] [MAIN ] LLY: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:43.206742] [DEBUG] [MAIN ] LII: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:43.208436] [DEBUG] [LOCAL ] LLY: Loaded 53674 existing records from primary storage. [2025-10-02T22:40:43.209490] [INFO ] [MAIN ] LII: Generated 1807 derivative records from 28170 primary records. [2025-10-02T22:40:43.209597] [DEBUG] [LOCAL ] LII: Saving derivative data. [2025-10-02T22:40:43.209810] [INFO ] [MAIN ] LLY: Loaded 53674 primary data records. [2025-10-02T22:40:43.342985] [DEBUG] [MAIN ] LITB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:43.366249] [INFO ] [MAIN ] LITB: Generated 1807 derivative records from 4368 primary records. [2025-10-02T22:40:43.379630] [DEBUG] [LOCAL ] LITB: Saving derivative data. [2025-10-02T22:40:43.391901] [DEBUG] [LOCAL ] LII: Derivative data saved (1807 records). [2025-10-02T22:40:43.423994] [INFO ] [MAIN ] LII: Successfully saved derivative data. [2025-10-02T22:40:43.467398] [INFO ] [MAIN ] Derivative Progress: 985/1975 symbols completed. LII took 1.1s. Estimated remaining: 6m 56s. Rate: 142.7 symbols/min [2025-10-02T22:40:43.538407] [INFO ] [MAIN ] LMND: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:43.609360] [DEBUG] [LOCAL ] LITB: Derivative data saved (1807 records). [2025-10-02T22:40:43.610202] [INFO ] [MAIN ] LITB: Successfully saved derivative data. [2025-10-02T22:40:43.613761] [INFO ] [MAIN ] Derivative Progress: 986/1975 symbols completed. LITB took 1.1s. Estimated remaining: 6m 56s. Rate: 142.8 symbols/min [2025-10-02T22:40:43.614339] [INFO ] [MAIN ] LMT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:43.638499] [DEBUG] [MAIN ] LLY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:43.639482] [INFO ] [MAIN ] LLY: Generated 1807 derivative records from 53674 primary records. [2025-10-02T22:40:43.639683] [DEBUG] [LOCAL ] LLY: Saving derivative data. [2025-10-02T22:40:43.657325] [DEBUG] [LOCAL ] LLY: Derivative data saved (1807 records). [2025-10-02T22:40:43.657525] [INFO ] [MAIN ] LLY: Successfully saved derivative data. [2025-10-02T22:40:43.659856] [INFO ] [MAIN ] Derivative Progress: 987/1975 symbols completed. LLY took 1.0s. Estimated remaining: 6m 55s. Rate: 142.9 symbols/min [2025-10-02T22:40:43.660138] [INFO ] [MAIN ] LNC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:43.731558] [DEBUG] [LOCAL ] LMND: Loaded 52254 existing records from primary storage. [2025-10-02T22:40:43.732071] [INFO ] [MAIN ] LMND: Loaded 52254 primary data records. [2025-10-02T22:40:43.747348] [DEBUG] [LOCAL ] LMT: Loaded 50172 existing records from primary storage. [2025-10-02T22:40:43.765409] [INFO ] [MAIN ] LMT: Loaded 50172 primary data records. [2025-10-02T22:40:44.028011] [DEBUG] [LOCAL ] LNC: Loaded 51991 existing records from primary storage. [2025-10-02T22:40:44.082283] [INFO ] [MAIN ] LNC: Loaded 51991 primary data records. [2025-10-02T22:40:44.894029] [DEBUG] [MAIN ] LMND: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:44.895021] [INFO ] [MAIN ] LMND: Generated 1807 derivative records from 52254 primary records. [2025-10-02T22:40:44.895419] [DEBUG] [LOCAL ] LMND: Saving derivative data. [2025-10-02T22:40:44.911126] [DEBUG] [MAIN ] LMT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:44.912037] [INFO ] [MAIN ] LMT: Generated 1807 derivative records from 50172 primary records. [2025-10-02T22:40:44.912286] [DEBUG] [LOCAL ] LMT: Saving derivative data. [2025-10-02T22:40:44.949561] [DEBUG] [LOCAL ] LMND: Derivative data saved (1807 records). [2025-10-02T22:40:44.962280] [DEBUG] [LOCAL ] LMT: Derivative data saved (1807 records). [2025-10-02T22:40:44.962391] [INFO ] [MAIN ] LMND: Successfully saved derivative data. [2025-10-02T22:40:44.962830] [INFO ] [MAIN ] LMT: Successfully saved derivative data. [2025-10-02T22:40:44.964861] [INFO ] [MAIN ] Derivative Progress: 988/1975 symbols completed. LMND took 1.4s. Estimated remaining: 6m 55s. Rate: 142.6 symbols/min [2025-10-02T22:40:44.967509] [INFO ] [MAIN ] Derivative Progress: 989/1975 symbols completed. LMT took 1.4s. Estimated remaining: 6m 54s. Rate: 142.8 symbols/min [2025-10-02T22:40:44.968236] [DEBUG] [MAIN ] LNC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:44.969293] [INFO ] [MAIN ] LNC: Generated 1807 derivative records from 51991 primary records. [2025-10-02T22:40:44.969393] [DEBUG] [LOCAL ] LNC: Saving derivative data. [2025-10-02T22:40:44.986587] [DEBUG] [LOCAL ] LNC: Derivative data saved (1807 records). [2025-10-02T22:40:44.986770] [INFO ] [MAIN ] LNC: Successfully saved derivative data. [2025-10-02T22:40:44.990354] [INFO ] [MAIN ] Derivative Progress: 990/1975 symbols completed. LNC took 1.3s. Estimated remaining: 6m 54s. Rate: 142.9 symbols/min [2025-10-02T22:40:44.991137] [INFO ] [MAIN ] LNN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:44.990959] [INFO ] [MAIN ] LND: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:44.991051] [INFO ] [MAIN ] LNG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:45.000345] [DEBUG] [LOCAL ] LND: Loaded 4941 existing records from primary storage. [2025-10-02T22:40:45.000545] [INFO ] [MAIN ] LND: Loaded 4941 primary data records. [2025-10-02T22:40:45.102108] [DEBUG] [LOCAL ] LNN: Loaded 11250 existing records from primary storage. [2025-10-02T22:40:45.124845] [INFO ] [MAIN ] LNN: Loaded 11250 primary data records. [2025-10-02T22:40:45.684918] [DEBUG] [LOCAL ] LNG: Loaded 51737 existing records from primary storage. [2025-10-02T22:40:45.699579] [INFO ] [MAIN ] LNG: Loaded 51737 primary data records. [2025-10-02T22:40:46.049175] [DEBUG] [MAIN ] LND: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:46.051089] [INFO ] [MAIN ] LND: Generated 1807 derivative records from 4941 primary records. [2025-10-02T22:40:46.051468] [DEBUG] [LOCAL ] LND: Saving derivative data. [2025-10-02T22:40:46.084536] [DEBUG] [MAIN ] LNN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:46.086177] [INFO ] [MAIN ] LNN: Generated 1807 derivative records from 11250 primary records. [2025-10-02T22:40:46.087993] [DEBUG] [LOCAL ] LND: Derivative data saved (1807 records). [2025-10-02T22:40:46.088101] [DEBUG] [LOCAL ] LNN: Saving derivative data. [2025-10-02T22:40:46.088953] [INFO ] [MAIN ] LND: Successfully saved derivative data. [2025-10-02T22:40:46.092276] [INFO ] [MAIN ] Derivative Progress: 991/1975 symbols completed. LND took 1.1s. Estimated remaining: 6m 54s. Rate: 142.7 symbols/min [2025-10-02T22:40:46.100132] [INFO ] [MAIN ] LOAR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:46.112025] [DEBUG] [LOCAL ] LNN: Derivative data saved (1807 records). [2025-10-02T22:40:46.114515] [INFO ] [MAIN ] LNN: Successfully saved derivative data. [2025-10-02T22:40:46.117952] [INFO ] [MAIN ] Derivative Progress: 992/1975 symbols completed. LNN took 1.1s. Estimated remaining: 6m 53s. Rate: 142.8 symbols/min [2025-10-02T22:40:46.118402] [INFO ] [MAIN ] LOB: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:46.139990] [DEBUG] [MAIN ] LNG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:46.140876] [INFO ] [MAIN ] LNG: Generated 1807 derivative records from 51737 primary records. [2025-10-02T22:40:46.141154] [DEBUG] [LOCAL ] LNG: Saving derivative data. [2025-10-02T22:40:46.192901] [DEBUG] [LOCAL ] LNG: Derivative data saved (1807 records). [2025-10-02T22:40:46.193079] [INFO ] [MAIN ] LNG: Successfully saved derivative data. [2025-10-02T22:40:46.195270] [INFO ] [MAIN ] Derivative Progress: 993/1975 symbols completed. LNG took 1.2s. Estimated remaining: 6m 52s. Rate: 142.9 symbols/min [2025-10-02T22:40:46.196629] [DEBUG] [LOCAL ] LOAR: Loaded 41885 existing records from primary storage. [2025-10-02T22:40:46.205694] [INFO ] [MAIN ] LOCL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:46.206701] [INFO ] [MAIN ] LOAR: Loaded 41885 primary data records. [2025-10-02T22:40:46.206271] [DEBUG] [LOCAL ] LOB: Loaded 27571 existing records from primary storage. [2025-10-02T22:40:46.212152] [INFO ] [MAIN ] LOB: Loaded 27571 primary data records. [2025-10-02T22:40:46.370241] [DEBUG] [LOCAL ] LOCL: Loaded 3642 existing records from primary storage. [2025-10-02T22:40:46.393210] [INFO ] [MAIN ] LOCL: Loaded 3642 primary data records. [2025-10-02T22:40:47.279961] [DEBUG] [MAIN ] LOAR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:47.281056] [INFO ] [MAIN ] LOAR: Generated 1807 derivative records from 41885 primary records. [2025-10-02T22:40:47.281193] [DEBUG] [LOCAL ] LOAR: Saving derivative data. [2025-10-02T22:40:47.302304] [DEBUG] [LOCAL ] LOAR: Derivative data saved (1807 records). [2025-10-02T22:40:47.303826] [INFO ] [MAIN ] LOAR: Successfully saved derivative data. [2025-10-02T22:40:47.320731] [DEBUG] [MAIN ] LOCL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:47.320268] [INFO ] [MAIN ] Derivative Progress: 994/1975 symbols completed. LOAR took 1.2s. Estimated remaining: 6m 52s. Rate: 142.7 symbols/min [2025-10-02T22:40:47.321000] [INFO ] [MAIN ] LOMA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:47.321965] [INFO ] [MAIN ] LOCL: Generated 1807 derivative records from 3642 primary records. [2025-10-02T22:40:47.322449] [DEBUG] [LOCAL ] LOCL: Saving derivative data. [2025-10-02T22:40:47.342219] [DEBUG] [MAIN ] LOB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:47.346983] [INFO ] [MAIN ] LOB: Generated 1807 derivative records from 27571 primary records. [2025-10-02T22:40:47.347208] [DEBUG] [LOCAL ] LOB: Saving derivative data. [2025-10-02T22:40:47.370019] [DEBUG] [LOCAL ] LOB: Derivative data saved (1807 records). [2025-10-02T22:40:47.370154] [DEBUG] [LOCAL ] LOCL: Derivative data saved (1807 records). [2025-10-02T22:40:47.370403] [INFO ] [MAIN ] LOCL: Successfully saved derivative data. [2025-10-02T22:40:47.372828] [INFO ] [MAIN ] Derivative Progress: 995/1975 symbols completed. LOCL took 1.2s. Estimated remaining: 6m 52s. Rate: 142.8 symbols/min [2025-10-02T22:40:47.370474] [INFO ] [MAIN ] LOB: Successfully saved derivative data. [2025-10-02T22:40:47.373188] [INFO ] [MAIN ] LOW: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:47.384173] [INFO ] [MAIN ] Derivative Progress: 996/1975 symbols completed. LOB took 1.3s. Estimated remaining: 6m 51s. Rate: 143.0 symbols/min [2025-10-02T22:40:47.384497] [INFO ] [MAIN ] LPG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:47.401949] [DEBUG] [LOCAL ] LOMA: Loaded 32305 existing records from primary storage. [2025-10-02T22:40:47.402106] [INFO ] [MAIN ] LOMA: Loaded 32305 primary data records. [2025-10-02T22:40:47.808835] [DEBUG] [LOCAL ] LPG: Loaded 40198 existing records from primary storage. [2025-10-02T22:40:47.809555] [INFO ] [MAIN ] LPG: Loaded 40198 primary data records. [2025-10-02T22:40:47.822275] [DEBUG] [LOCAL ] LOW: Loaded 53319 existing records from primary storage. [2025-10-02T22:40:47.848762] [INFO ] [MAIN ] LOW: Loaded 53319 primary data records. [2025-10-02T22:40:48.495353] [DEBUG] [MAIN ] LOMA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:48.496486] [INFO ] [MAIN ] LOMA: Generated 1807 derivative records from 32305 primary records. [2025-10-02T22:40:48.497184] [DEBUG] [LOCAL ] LOMA: Saving derivative data. [2025-10-02T22:40:48.518901] [DEBUG] [LOCAL ] LOMA: Derivative data saved (1807 records). [2025-10-02T22:40:48.519370] [INFO ] [MAIN ] LOMA: Successfully saved derivative data. [2025-10-02T22:40:48.521740] [INFO ] [MAIN ] Derivative Progress: 997/1975 symbols completed. LOMA took 1.2s. Estimated remaining: 6m 51s. Rate: 142.7 symbols/min [2025-10-02T22:40:48.522088] [INFO ] [MAIN ] LPL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:48.557419] [DEBUG] [MAIN ] LOW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:48.557211] [DEBUG] [MAIN ] LPG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:48.558517] [INFO ] [MAIN ] LPG: Generated 1807 derivative records from 40198 primary records. [2025-10-02T22:40:48.558754] [DEBUG] [LOCAL ] LPG: Saving derivative data. [2025-10-02T22:40:48.567942] [INFO ] [MAIN ] LOW: Generated 1807 derivative records from 53319 primary records. [2025-10-02T22:40:48.568271] [DEBUG] [LOCAL ] LOW: Saving derivative data. [2025-10-02T22:40:48.606183] [DEBUG] [LOCAL ] LPL: Loaded 26772 existing records from primary storage. [2025-10-02T22:40:48.607329] [INFO ] [MAIN ] LPL: Loaded 26772 primary data records. [2025-10-02T22:40:48.646883] [DEBUG] [LOCAL ] LPG: Derivative data saved (1807 records). [2025-10-02T22:40:48.665064] [INFO ] [MAIN ] LPG: Successfully saved derivative data. [2025-10-02T22:40:48.673215] [DEBUG] [LOCAL ] LOW: Derivative data saved (1807 records). [2025-10-02T22:40:48.708086] [INFO ] [MAIN ] LOW: Successfully saved derivative data. [2025-10-02T22:40:48.702857] [INFO ] [MAIN ] Derivative Progress: 998/1975 symbols completed. LPG took 1.3s. Estimated remaining: 6m 51s. Rate: 142.8 symbols/min [2025-10-02T22:40:48.715898] [INFO ] [MAIN ] Derivative Progress: 999/1975 symbols completed. LOW took 1.3s. Estimated remaining: 6m 50s. Rate: 142.9 symbols/min [2025-10-02T22:40:48.708373] [INFO ] [MAIN ] LPX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:48.721306] [INFO ] [MAIN ] LRN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:48.995837] [DEBUG] [LOCAL ] LRN: Loaded 40020 existing records from primary storage. [2025-10-02T22:40:48.996398] [INFO ] [MAIN ] LRN: Loaded 40020 primary data records. [2025-10-02T22:40:48.997074] [DEBUG] [LOCAL ] LPX: Loaded 39976 existing records from primary storage. [2025-10-02T22:40:49.010035] [INFO ] [MAIN ] LPX: Loaded 39976 primary data records. [2025-10-02T22:40:49.702165] [DEBUG] [MAIN ] LPL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:49.717992] [INFO ] [MAIN ] LPL: Generated 1807 derivative records from 26772 primary records. [2025-10-02T22:40:49.719264] [DEBUG] [LOCAL ] LPL: Saving derivative data. [2025-10-02T22:40:49.745617] [DEBUG] [LOCAL ] LPL: Derivative data saved (1807 records). [2025-10-02T22:40:49.746485] [INFO ] [MAIN ] LPL: Successfully saved derivative data. [2025-10-02T22:40:49.749249] [INFO ] [MAIN ] Derivative Progress: 1000/1975 symbols completed. LPL took 1.2s. Estimated remaining: 6m 50s. Rate: 142.7 symbols/min [2025-10-02T22:40:49.749476] [INFO ] [MAIN ] LSPD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:49.785920] [DEBUG] [MAIN ] LRN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:49.792693] [INFO ] [MAIN ] LRN: Generated 1807 derivative records from 40020 primary records. [2025-10-02T22:40:49.793294] [DEBUG] [LOCAL ] LRN: Saving derivative data. [2025-10-02T22:40:49.793513] [DEBUG] [MAIN ] LPX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:49.795243] [INFO ] [MAIN ] LPX: Generated 1807 derivative records from 39976 primary records. [2025-10-02T22:40:49.803499] [DEBUG] [LOCAL ] LPX: Saving derivative data. [2025-10-02T22:40:49.823196] [DEBUG] [LOCAL ] LRN: Derivative data saved (1807 records). [2025-10-02T22:40:49.823618] [INFO ] [MAIN ] LRN: Successfully saved derivative data. [2025-10-02T22:40:49.833717] [INFO ] [MAIN ] Derivative Progress: 1001/1975 symbols completed. LRN took 1.1s. Estimated remaining: 6m 49s. Rate: 142.8 symbols/min [2025-10-02T22:40:49.838386] [INFO ] [MAIN ] LTC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:49.855955] [DEBUG] [LOCAL ] LPX: Derivative data saved (1807 records). [2025-10-02T22:40:49.857372] [INFO ] [MAIN ] LPX: Successfully saved derivative data. [2025-10-02T22:40:49.859896] [INFO ] [MAIN ] Derivative Progress: 1002/1975 symbols completed. LPX took 1.2s. Estimated remaining: 6m 48s. Rate: 143.0 symbols/min [2025-10-02T22:40:49.857169] [DEBUG] [LOCAL ] LSPD: Loaded 43183 existing records from primary storage. [2025-10-02T22:40:49.860342] [INFO ] [MAIN ] LSPD: Loaded 43183 primary data records. [2025-10-02T22:40:49.860081] [INFO ] [MAIN ] LTH: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:50.222675] [DEBUG] [LOCAL ] LTC: Loaded 30459 existing records from primary storage. [2025-10-02T22:40:50.223614] [INFO ] [MAIN ] LTC: Loaded 30459 primary data records. [2025-10-02T22:40:50.311363] [DEBUG] [LOCAL ] LTH: Loaded 52100 existing records from primary storage. [2025-10-02T22:40:50.316996] [INFO ] [MAIN ] LTH: Loaded 52100 primary data records. [2025-10-02T22:40:50.943666] [DEBUG] [MAIN ] LSPD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:50.946126] [INFO ] [MAIN ] LSPD: Generated 1807 derivative records from 43183 primary records. [2025-10-02T22:40:50.946686] [DEBUG] [LOCAL ] LSPD: Saving derivative data. [2025-10-02T22:40:50.972023] [DEBUG] [LOCAL ] LSPD: Derivative data saved (1807 records). [2025-10-02T22:40:50.972745] [INFO ] [MAIN ] LSPD: Successfully saved derivative data. [2025-10-02T22:40:50.976973] [INFO ] [MAIN ] Derivative Progress: 1003/1975 symbols completed. LSPD took 1.2s. Estimated remaining: 6m 49s. Rate: 142.7 symbols/min [2025-10-02T22:40:50.999275] [DEBUG] [MAIN ] LTC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:51.000346] [INFO ] [MAIN ] LTC: Generated 1807 derivative records from 30459 primary records. [2025-10-02T22:40:51.000443] [DEBUG] [LOCAL ] LTC: Saving derivative data. [2025-10-02T22:40:51.025149] [DEBUG] [LOCAL ] LTC: Derivative data saved (1807 records). [2025-10-02T22:40:51.025369] [INFO ] [MAIN ] LTC: Successfully saved derivative data. [2025-10-02T22:40:51.040078] [INFO ] [MAIN ] Derivative Progress: 1004/1975 symbols completed. LTC took 1.2s. Estimated remaining: 6m 48s. Rate: 142.9 symbols/min [2025-10-02T22:40:51.040849] [DEBUG] [MAIN ] LTH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:51.041625] [INFO ] [MAIN ] LTH: Generated 1807 derivative records from 52100 primary records. [2025-10-02T22:40:51.041870] [DEBUG] [LOCAL ] LTH: Saving derivative data. [2025-10-02T22:40:51.057949] [DEBUG] [LOCAL ] LTH: Derivative data saved (1807 records). [2025-10-02T22:40:51.058053] [INFO ] [MAIN ] LTH: Successfully saved derivative data. [2025-10-02T22:40:51.060334] [INFO ] [MAIN ] Derivative Progress: 1005/1975 symbols completed. LTH took 1.2s. Estimated remaining: 6m 47s. Rate: 143.0 symbols/min [2025-10-02T22:40:51.060803] [INFO ] [MAIN ] LTM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:51.060986] [INFO ] [MAIN ] LUCK: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:51.060910] [INFO ] [MAIN ] LU: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:51.089220] [DEBUG] [LOCAL ] LUCK: Loaded 24825 existing records from primary storage. [2025-10-02T22:40:51.089415] [INFO ] [MAIN ] LUCK: Loaded 24825 primary data records. [2025-10-02T22:40:51.342931] [DEBUG] [LOCAL ] LTM: Loaded 37342 existing records from primary storage. [2025-10-02T22:40:51.437503] [DEBUG] [LOCAL ] LU: Loaded 49348 existing records from primary storage. [2025-10-02T22:40:51.343127] [INFO ] [MAIN ] LTM: Loaded 37342 primary data records. [2025-10-02T22:40:51.489923] [INFO ] [MAIN ] LU: Loaded 49348 primary data records. [2025-10-02T22:40:52.164721] [DEBUG] [MAIN ] LUCK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:52.166708] [INFO ] [MAIN ] LUCK: Generated 1807 derivative records from 24825 primary records. [2025-10-02T22:40:52.166968] [DEBUG] [LOCAL ] LUCK: Saving derivative data. [2025-10-02T22:40:52.185408] [DEBUG] [LOCAL ] LUCK: Derivative data saved (1807 records). [2025-10-02T22:40:52.185751] [INFO ] [MAIN ] LUCK: Successfully saved derivative data. [2025-10-02T22:40:52.187913] [INFO ] [MAIN ] Derivative Progress: 1006/1975 symbols completed. LUCK took 1.1s. Estimated remaining: 6m 47s. Rate: 142.8 symbols/min [2025-10-02T22:40:52.188320] [INFO ] [MAIN ] LUMN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:52.207041] [DEBUG] [MAIN ] LU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:52.208684] [INFO ] [MAIN ] LU: Generated 1807 derivative records from 49348 primary records. [2025-10-02T22:40:52.209488] [DEBUG] [LOCAL ] LU: Saving derivative data. [2025-10-02T22:40:52.235350] [DEBUG] [MAIN ] LTM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:52.236883] [INFO ] [MAIN ] LTM: Generated 1807 derivative records from 37342 primary records. [2025-10-02T22:40:52.237205] [DEBUG] [LOCAL ] LTM: Saving derivative data. [2025-10-02T22:40:52.254243] [DEBUG] [LOCAL ] LU: Derivative data saved (1807 records). [2025-10-02T22:40:52.255108] [INFO ] [MAIN ] LU: Successfully saved derivative data. [2025-10-02T22:40:52.257729] [INFO ] [MAIN ] Derivative Progress: 1007/1975 symbols completed. LU took 1.2s. Estimated remaining: 6m 47s. Rate: 142.9 symbols/min [2025-10-02T22:40:52.258199] [INFO ] [MAIN ] LUV: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:52.275460] [DEBUG] [LOCAL ] LTM: Derivative data saved (1807 records). [2025-10-02T22:40:52.275602] [INFO ] [MAIN ] LTM: Successfully saved derivative data. [2025-10-02T22:40:52.277926] [INFO ] [MAIN ] Derivative Progress: 1008/1975 symbols completed. LTM took 1.2s. Estimated remaining: 6m 46s. Rate: 143.0 symbols/min [2025-10-02T22:40:52.278201] [INFO ] [MAIN ] LVS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:52.300374] [DEBUG] [LOCAL ] LUMN: Loaded 54024 existing records from primary storage. [2025-10-02T22:40:52.300698] [INFO ] [MAIN ] LUMN: Loaded 54024 primary data records. [2025-10-02T22:40:52.693109] [DEBUG] [LOCAL ] LVS: Loaded 53953 existing records from primary storage. [2025-10-02T22:40:52.693344] [INFO ] [MAIN ] LVS: Loaded 53953 primary data records. [2025-10-02T22:40:52.717434] [DEBUG] [LOCAL ] LUV: Loaded 54079 existing records from primary storage. [2025-10-02T22:40:52.734282] [INFO ] [MAIN ] LUV: Loaded 54079 primary data records. [2025-10-02T22:40:53.427287] [DEBUG] [MAIN ] LUMN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:53.428883] [INFO ] [MAIN ] LUMN: Generated 1807 derivative records from 54024 primary records. [2025-10-02T22:40:53.429196] [DEBUG] [LOCAL ] LUMN: Saving derivative data. [2025-10-02T22:40:53.449614] [DEBUG] [LOCAL ] LUMN: Derivative data saved (1807 records). [2025-10-02T22:40:53.450067] [INFO ] [MAIN ] LUMN: Successfully saved derivative data. [2025-10-02T22:40:53.453370] [INFO ] [MAIN ] Derivative Progress: 1009/1975 symbols completed. LUMN took 1.3s. Estimated remaining: 6m 46s. Rate: 142.8 symbols/min [2025-10-02T22:40:53.454131] [INFO ] [MAIN ] LVWR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:53.490960] [DEBUG] [MAIN ] LVS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:53.492778] [INFO ] [MAIN ] LVS: Generated 1807 derivative records from 53953 primary records. [2025-10-02T22:40:53.493099] [DEBUG] [MAIN ] LUV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:53.493735] [INFO ] [MAIN ] LUV: Generated 1807 derivative records from 54079 primary records. [2025-10-02T22:40:53.498462] [DEBUG] [LOCAL ] LUV: Saving derivative data. [2025-10-02T22:40:53.498355] [DEBUG] [LOCAL ] LVS: Saving derivative data. [2025-10-02T22:40:53.540028] [DEBUG] [LOCAL ] LVWR: Loaded 17935 existing records from primary storage. [2025-10-02T22:40:53.541183] [INFO ] [MAIN ] LVWR: Loaded 17935 primary data records. [2025-10-02T22:40:53.585011] [DEBUG] [LOCAL ] LVS: Derivative data saved (1807 records). [2025-10-02T22:40:53.600536] [INFO ] [MAIN ] LVS: Successfully saved derivative data. [2025-10-02T22:40:53.604206] [INFO ] [MAIN ] Derivative Progress: 1010/1975 symbols completed. LVS took 1.3s. Estimated remaining: 6m 45s. Rate: 142.8 symbols/min [2025-10-02T22:40:53.615373] [DEBUG] [LOCAL ] LUV: Derivative data saved (1807 records). [2025-10-02T22:40:53.615626] [INFO ] [MAIN ] LW: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:53.629282] [INFO ] [MAIN ] LUV: Successfully saved derivative data. [2025-10-02T22:40:53.636833] [INFO ] [MAIN ] Derivative Progress: 1011/1975 symbols completed. LUV took 1.4s. Estimated remaining: 6m 45s. Rate: 143.0 symbols/min [2025-10-02T22:40:53.637355] [INFO ] [MAIN ] LXFR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:53.904595] [DEBUG] [LOCAL ] LXFR: Loaded 16949 existing records from primary storage. [2025-10-02T22:40:53.904770] [INFO ] [MAIN ] LXFR: Loaded 16949 primary data records. [2025-10-02T22:40:54.080507] [DEBUG] [LOCAL ] LW: Loaded 51548 existing records from primary storage. [2025-10-02T22:40:54.101199] [INFO ] [MAIN ] LW: Loaded 51548 primary data records. [2025-10-02T22:40:54.614543] [DEBUG] [MAIN ] LVWR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:54.621714] [INFO ] [MAIN ] LVWR: Generated 1807 derivative records from 17935 primary records. [2025-10-02T22:40:54.631945] [DEBUG] [LOCAL ] LVWR: Saving derivative data. [2025-10-02T22:40:54.653437] [DEBUG] [LOCAL ] LVWR: Derivative data saved (1807 records). [2025-10-02T22:40:54.654798] [INFO ] [MAIN ] LVWR: Successfully saved derivative data. [2025-10-02T22:40:54.658684] [INFO ] [MAIN ] Derivative Progress: 1012/1975 symbols completed. LVWR took 1.2s. Estimated remaining: 6m 45s. Rate: 142.8 symbols/min [2025-10-02T22:40:54.659140] [INFO ] [MAIN ] LXP: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:54.675181] [DEBUG] [MAIN ] LXFR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:54.676377] [INFO ] [MAIN ] LXFR: Generated 1807 derivative records from 16949 primary records. [2025-10-02T22:40:54.676527] [DEBUG] [LOCAL ] LXFR: Saving derivative data. [2025-10-02T22:40:54.699705] [DEBUG] [LOCAL ] LXFR: Derivative data saved (1807 records). [2025-10-02T22:40:54.700104] [INFO ] [MAIN ] LXFR: Successfully saved derivative data. [2025-10-02T22:40:54.702486] [INFO ] [MAIN ] Derivative Progress: 1013/1975 symbols completed. LXFR took 1.1s. Estimated remaining: 6m 44s. Rate: 142.9 symbols/min [2025-10-02T22:40:54.702704] [INFO ] [MAIN ] LXU: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:54.716779] [DEBUG] [MAIN ] LW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:54.717537] [INFO ] [MAIN ] LW: Generated 1807 derivative records from 51548 primary records. [2025-10-02T22:40:54.717605] [DEBUG] [LOCAL ] LW: Saving derivative data. [2025-10-02T22:40:54.749210] [DEBUG] [LOCAL ] LW: Derivative data saved (1807 records). [2025-10-02T22:40:54.749528] [INFO ] [MAIN ] LW: Successfully saved derivative data. [2025-10-02T22:40:54.751875] [INFO ] [MAIN ] Derivative Progress: 1014/1975 symbols completed. LW took 1.1s. Estimated remaining: 6m 43s. Rate: 143.0 symbols/min [2025-10-02T22:40:54.752212] [INFO ] [MAIN ] LYB: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:54.779890] [DEBUG] [LOCAL ] LXP: Loaded 51071 existing records from primary storage. [2025-10-02T22:40:54.780223] [INFO ] [MAIN ] LXP: Loaded 51071 primary data records. [2025-10-02T22:40:54.884962] [DEBUG] [LOCAL ] LXU: Loaded 31890 existing records from primary storage. [2025-10-02T22:40:54.900629] [INFO ] [MAIN ] LXU: Loaded 31890 primary data records. [2025-10-02T22:40:55.317489] [DEBUG] [LOCAL ] LYB: Loaded 53992 existing records from primary storage. [2025-10-02T22:40:55.466705] [INFO ] [MAIN ] LYB: Loaded 53992 primary data records. [2025-10-02T22:40:55.884224] [DEBUG] [MAIN ] LXP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:55.885629] [INFO ] [MAIN ] LXP: Generated 1807 derivative records from 51071 primary records. [2025-10-02T22:40:55.886961] [DEBUG] [LOCAL ] LXP: Saving derivative data. [2025-10-02T22:40:55.921472] [DEBUG] [MAIN ] LXU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:55.923025] [INFO ] [MAIN ] LXU: Generated 1807 derivative records from 31890 primary records. [2025-10-02T22:40:55.923269] [DEBUG] [LOCAL ] LXU: Saving derivative data. [2025-10-02T22:40:55.933977] [DEBUG] [LOCAL ] LXP: Derivative data saved (1807 records). [2025-10-02T22:40:55.934195] [INFO ] [MAIN ] LXP: Successfully saved derivative data. [2025-10-02T22:40:55.940607] [INFO ] [MAIN ] Derivative Progress: 1015/1975 symbols completed. LXP took 1.3s. Estimated remaining: 6m 43s. Rate: 142.8 symbols/min [2025-10-02T22:40:55.941263] [INFO ] [MAIN ] LYG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:55.948197] [DEBUG] [LOCAL ] LXU: Derivative data saved (1807 records). [2025-10-02T22:40:55.949107] [INFO ] [MAIN ] LXU: Successfully saved derivative data. [2025-10-02T22:40:55.951466] [INFO ] [MAIN ] Derivative Progress: 1016/1975 symbols completed. LXU took 1.2s. Estimated remaining: 6m 43s. Rate: 142.9 symbols/min [2025-10-02T22:40:55.951770] [INFO ] [MAIN ] LYV: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:55.967020] [DEBUG] [MAIN ] LYB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:55.968015] [INFO ] [MAIN ] LYB: Generated 1807 derivative records from 53992 primary records. [2025-10-02T22:40:55.968162] [DEBUG] [LOCAL ] LYB: Saving derivative data. [2025-10-02T22:40:55.986245] [DEBUG] [LOCAL ] LYB: Derivative data saved (1807 records). [2025-10-02T22:40:55.986484] [INFO ] [MAIN ] LYB: Successfully saved derivative data. [2025-10-02T22:40:55.988794] [INFO ] [MAIN ] Derivative Progress: 1017/1975 symbols completed. LYB took 1.2s. Estimated remaining: 6m 42s. Rate: 143.0 symbols/min [2025-10-02T22:40:55.989047] [INFO ] [MAIN ] LZB: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:56.048111] [DEBUG] [LOCAL ] LYG: Loaded 53179 existing records from primary storage. [2025-10-02T22:40:56.058521] [INFO ] [MAIN ] LYG: Loaded 53179 primary data records. [2025-10-02T22:40:56.141913] [DEBUG] [LOCAL ] LZB: Loaded 35687 existing records from primary storage. [2025-10-02T22:40:56.201345] [INFO ] [MAIN ] LZB: Loaded 35687 primary data records. [2025-10-02T22:40:56.201699] [DEBUG] [LOCAL ] LYV: Loaded 51500 existing records from primary storage. [2025-10-02T22:40:56.224856] [INFO ] [MAIN ] LYV: Loaded 51500 primary data records. [2025-10-02T22:40:57.169638] [DEBUG] [MAIN ] LYG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:57.171556] [INFO ] [MAIN ] LYG: Generated 1807 derivative records from 53179 primary records. [2025-10-02T22:40:57.172135] [DEBUG] [LOCAL ] LYG: Saving derivative data. [2025-10-02T22:40:57.222040] [DEBUG] [MAIN ] LZB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:57.224994] [INFO ] [MAIN ] LZB: Generated 1807 derivative records from 35687 primary records. [2025-10-02T22:40:57.226570] [DEBUG] [LOCAL ] LYG: Derivative data saved (1807 records). [2025-10-02T22:40:57.226717] [DEBUG] [LOCAL ] LZB: Saving derivative data. [2025-10-02T22:40:57.238806] [INFO ] [MAIN ] LYG: Successfully saved derivative data. [2025-10-02T22:40:57.249109] [INFO ] [MAIN ] Derivative Progress: 1018/1975 symbols completed. LYG took 1.3s. Estimated remaining: 6m 42s. Rate: 142.7 symbols/min [2025-10-02T22:40:57.245242] [DEBUG] [MAIN ] LYV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:57.251617] [INFO ] [MAIN ] LYV: Generated 1807 derivative records from 51500 primary records. [2025-10-02T22:40:57.260268] [DEBUG] [LOCAL ] LYV: Saving derivative data. [2025-10-02T22:40:57.272676] [DEBUG] [LOCAL ] LZB: Derivative data saved (1807 records). [2025-10-02T22:40:57.273252] [INFO ] [MAIN ] LZB: Successfully saved derivative data. [2025-10-02T22:40:57.276392] [INFO ] [MAIN ] Derivative Progress: 1019/1975 symbols completed. LZB took 1.3s. Estimated remaining: 6m 41s. Rate: 142.9 symbols/min [2025-10-02T22:40:57.301754] [DEBUG] [LOCAL ] LYV: Derivative data saved (1807 records). [2025-10-02T22:40:57.301937] [INFO ] [MAIN ] LYV: Successfully saved derivative data. [2025-10-02T22:40:57.304344] [INFO ] [MAIN ] Derivative Progress: 1020/1975 symbols completed. LYV took 1.4s. Estimated remaining: 6m 41s. Rate: 143.0 symbols/min [2025-10-02T22:40:57.305286] [INFO ] [MAIN ] MA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:57.305389] [INFO ] [MAIN ] M: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:57.305174] [INFO ] [MAIN ] LZM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:57.332522] [DEBUG] [LOCAL ] LZM: Loaded 14138 existing records from primary storage. [2025-10-02T22:40:57.332842] [INFO ] [MAIN ] LZM: Loaded 14138 primary data records. [2025-10-02T22:40:57.611068] [DEBUG] [LOCAL ] MA: Loaded 52903 existing records from primary storage. [2025-10-02T22:40:57.627202] [INFO ] [MAIN ] MA: Loaded 52903 primary data records. [2025-10-02T22:40:57.697412] [DEBUG] [LOCAL ] M: Loaded 53924 existing records from primary storage. [2025-10-02T22:40:57.697693] [INFO ] [MAIN ] M: Loaded 53924 primary data records. [2025-10-02T22:40:58.704905] [DEBUG] [MAIN ] LZM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:58.706611] [INFO ] [MAIN ] LZM: Generated 1807 derivative records from 14138 primary records. [2025-10-02T22:40:58.706844] [DEBUG] [LOCAL ] LZM: Saving derivative data. [2025-10-02T22:40:58.740499] [DEBUG] [LOCAL ] LZM: Derivative data saved (1807 records). [2025-10-02T22:40:58.741619] [INFO ] [MAIN ] LZM: Successfully saved derivative data. [2025-10-02T22:40:58.741348] [DEBUG] [MAIN ] M: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:58.743614] [INFO ] [MAIN ] Derivative Progress: 1021/1975 symbols completed. LZM took 1.4s. Estimated remaining: 6m 41s. Rate: 142.7 symbols/min [2025-10-02T22:40:58.744784] [INFO ] [MAIN ] MAA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:58.745944] [INFO ] [MAIN ] M: Generated 1807 derivative records from 53924 primary records. [2025-10-02T22:40:58.746084] [DEBUG] [LOCAL ] M: Saving derivative data. [2025-10-02T22:40:58.775539] [DEBUG] [LOCAL ] M: Derivative data saved (1807 records). [2025-10-02T22:40:58.780972] [INFO ] [MAIN ] M: Successfully saved derivative data. [2025-10-02T22:40:58.783802] [INFO ] [MAIN ] Derivative Progress: 1022/1975 symbols completed. M took 1.5s. Estimated remaining: 6m 40s. Rate: 142.8 symbols/min [2025-10-02T22:40:58.784020] [INFO ] [MAIN ] MAC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:58.784520] [DEBUG] [MAIN ] MA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:58.785823] [INFO ] [MAIN ] MA: Generated 1807 derivative records from 52903 primary records. [2025-10-02T22:40:58.786006] [DEBUG] [LOCAL ] MA: Saving derivative data. [2025-10-02T22:40:58.813823] [DEBUG] [LOCAL ] MA: Derivative data saved (1807 records). [2025-10-02T22:40:58.813980] [INFO ] [MAIN ] MA: Successfully saved derivative data. [2025-10-02T22:40:58.816350] [INFO ] [MAIN ] Derivative Progress: 1023/1975 symbols completed. MA took 1.5s. Estimated remaining: 6m 40s. Rate: 142.9 symbols/min [2025-10-02T22:40:58.816624] [INFO ] [MAIN ] MAGN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:58.838503] [DEBUG] [LOCAL ] MAA: Loaded 42948 existing records from primary storage. [2025-10-02T22:40:58.838746] [INFO ] [MAIN ] MAA: Loaded 42948 primary data records. [2025-10-02T22:40:59.044460] [DEBUG] [LOCAL ] MAC: Loaded 50021 existing records from primary storage. [2025-10-02T22:40:59.070585] [INFO ] [MAIN ] MAC: Loaded 50021 primary data records. [2025-10-02T22:40:59.245049] [DEBUG] [LOCAL ] MAGN: Loaded 35225 existing records from primary storage. [2025-10-02T22:40:59.258377] [INFO ] [MAIN ] MAGN: Loaded 35225 primary data records. [2025-10-02T22:40:59.925124] [DEBUG] [MAIN ] MAA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:59.926840] [INFO ] [MAIN ] MAA: Generated 1807 derivative records from 42948 primary records. [2025-10-02T22:40:59.927190] [DEBUG] [LOCAL ] MAA: Saving derivative data. [2025-10-02T22:40:59.950073] [DEBUG] [LOCAL ] MAA: Derivative data saved (1807 records). [2025-10-02T22:40:59.950307] [INFO ] [MAIN ] MAA: Successfully saved derivative data. [2025-10-02T22:40:59.953960] [INFO ] [MAIN ] Derivative Progress: 1024/1975 symbols completed. MAA took 1.2s. Estimated remaining: 6m 40s. Rate: 142.7 symbols/min [2025-10-02T22:40:59.954582] [INFO ] [MAIN ] MAIN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:40:59.983296] [DEBUG] [MAIN ] MAGN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:59.989484] [INFO ] [MAIN ] MAGN: Generated 1807 derivative records from 35225 primary records. [2025-10-02T22:40:59.988768] [DEBUG] [MAIN ] MAC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:40:59.990217] [INFO ] [MAIN ] MAC: Generated 1807 derivative records from 50021 primary records. [2025-10-02T22:40:59.990382] [DEBUG] [LOCAL ] MAGN: Saving derivative data. [2025-10-02T22:40:59.991181] [DEBUG] [LOCAL ] MAC: Saving derivative data. [2025-10-02T22:41:00.023927] [DEBUG] [LOCAL ] MAGN: Derivative data saved (1807 records). [2025-10-02T22:41:00.024619] [INFO ] [MAIN ] MAGN: Successfully saved derivative data. [2025-10-02T22:41:00.027440] [INFO ] [MAIN ] Derivative Progress: 1025/1975 symbols completed. MAGN took 1.2s. Estimated remaining: 6m 39s. Rate: 142.8 symbols/min [2025-10-02T22:41:00.028127] [INFO ] [MAIN ] MAN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:00.042524] [DEBUG] [LOCAL ] MAC: Derivative data saved (1807 records). [2025-10-02T22:41:00.042901] [INFO ] [MAIN ] MAC: Successfully saved derivative data. [2025-10-02T22:41:00.045355] [INFO ] [MAIN ] Derivative Progress: 1026/1975 symbols completed. MAC took 1.3s. Estimated remaining: 6m 38s. Rate: 142.9 symbols/min [2025-10-02T22:41:00.045889] [INFO ] [MAIN ] MANU: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:00.066367] [DEBUG] [LOCAL ] MAIN: Loaded 41439 existing records from primary storage. [2025-10-02T22:41:00.067312] [INFO ] [MAIN ] MAIN: Loaded 41439 primary data records. [2025-10-02T22:41:00.267819] [DEBUG] [LOCAL ] MANU: Loaded 26976 existing records from primary storage. [2025-10-02T22:41:00.295268] [INFO ] [MAIN ] MANU: Loaded 26976 primary data records. [2025-10-02T22:41:00.334910] [DEBUG] [LOCAL ] MAN: Loaded 43848 existing records from primary storage. [2025-10-02T22:41:00.447693] [INFO ] [MAIN ] MAN: Loaded 43848 primary data records. [2025-10-02T22:41:01.214032] [DEBUG] [MAIN ] MAIN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:01.214888] [INFO ] [MAIN ] MAIN: Generated 1807 derivative records from 41439 primary records. [2025-10-02T22:41:01.215420] [DEBUG] [LOCAL ] MAIN: Saving derivative data. [2025-10-02T22:41:01.234748] [DEBUG] [LOCAL ] MAIN: Derivative data saved (1807 records). [2025-10-02T22:41:01.234872] [INFO ] [MAIN ] MAIN: Successfully saved derivative data. [2025-10-02T22:41:01.237755] [INFO ] [MAIN ] Derivative Progress: 1027/1975 symbols completed. MAIN took 1.3s. Estimated remaining: 6m 39s. Rate: 142.7 symbols/min [2025-10-02T22:41:01.238214] [INFO ] [MAIN ] MAS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:01.258435] [DEBUG] [MAIN ] MAN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:01.261238] [INFO ] [MAIN ] MAN: Generated 1807 derivative records from 43848 primary records. [2025-10-02T22:41:01.262097] [DEBUG] [LOCAL ] MAN: Saving derivative data. [2025-10-02T22:41:01.291179] [DEBUG] [MAIN ] MANU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:01.293165] [INFO ] [MAIN ] MANU: Generated 1807 derivative records from 26976 primary records. [2025-10-02T22:41:01.293672] [DEBUG] [LOCAL ] MANU: Saving derivative data. [2025-10-02T22:41:01.307177] [DEBUG] [LOCAL ] MAN: Derivative data saved (1807 records). [2025-10-02T22:41:01.307365] [INFO ] [MAIN ] MAN: Successfully saved derivative data. [2025-10-02T22:41:01.309909] [INFO ] [MAIN ] Derivative Progress: 1028/1975 symbols completed. MAN took 1.3s. Estimated remaining: 6m 38s. Rate: 142.8 symbols/min [2025-10-02T22:41:01.311473] [INFO ] [MAIN ] MATV: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:01.322976] [DEBUG] [LOCAL ] MANU: Derivative data saved (1807 records). [2025-10-02T22:41:01.338592] [INFO ] [MAIN ] MANU: Successfully saved derivative data. [2025-10-02T22:41:01.341284] [INFO ] [MAIN ] Derivative Progress: 1029/1975 symbols completed. MANU took 1.3s. Estimated remaining: 6m 37s. Rate: 142.9 symbols/min [2025-10-02T22:41:01.342727] [INFO ] [MAIN ] MATX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:01.366357] [DEBUG] [LOCAL ] MAS: Loaded 52702 existing records from primary storage. [2025-10-02T22:41:01.366740] [INFO ] [MAIN ] MAS: Loaded 52702 primary data records. [2025-10-02T22:41:01.547840] [DEBUG] [LOCAL ] MATV: Loaded 36941 existing records from primary storage. [2025-10-02T22:41:01.558940] [DEBUG] [LOCAL ] MATX: Loaded 31728 existing records from primary storage. [2025-10-02T22:41:01.569702] [INFO ] [MAIN ] MATX: Loaded 31728 primary data records. [2025-10-02T22:41:01.569543] [INFO ] [MAIN ] MATV: Loaded 36941 primary data records. [2025-10-02T22:41:02.514119] [DEBUG] [MAIN ] MAS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:02.514945] [INFO ] [MAIN ] MAS: Generated 1807 derivative records from 52702 primary records. [2025-10-02T22:41:02.515344] [DEBUG] [LOCAL ] MAS: Saving derivative data. [2025-10-02T22:41:02.538324] [DEBUG] [LOCAL ] MAS: Derivative data saved (1807 records). [2025-10-02T22:41:02.538967] [INFO ] [MAIN ] MAS: Successfully saved derivative data. [2025-10-02T22:41:02.540909] [INFO ] [MAIN ] Derivative Progress: 1030/1975 symbols completed. MAS took 1.3s. Estimated remaining: 6m 37s. Rate: 142.7 symbols/min [2025-10-02T22:41:02.541181] [INFO ] [MAIN ] MAX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:02.555348] [DEBUG] [MAIN ] MATV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:02.556537] [INFO ] [MAIN ] MATV: Generated 1807 derivative records from 36941 primary records. [2025-10-02T22:41:02.556746] [DEBUG] [LOCAL ] MATV: Saving derivative data. [2025-10-02T22:41:02.593663] [DEBUG] [MAIN ] MATX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:02.603471] [INFO ] [MAIN ] MATX: Generated 1807 derivative records from 31728 primary records. [2025-10-02T22:41:02.604379] [DEBUG] [LOCAL ] MATX: Saving derivative data. [2025-10-02T22:41:02.605946] [DEBUG] [LOCAL ] MATV: Derivative data saved (1807 records). [2025-10-02T22:41:02.606039] [INFO ] [MAIN ] MATV: Successfully saved derivative data. [2025-10-02T22:41:02.608821] [INFO ] [MAIN ] Derivative Progress: 1031/1975 symbols completed. MATV took 1.3s. Estimated remaining: 6m 37s. Rate: 142.8 symbols/min [2025-10-02T22:41:02.622037] [INFO ] [MAIN ] MBC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:02.637212] [DEBUG] [LOCAL ] MAX: Loaded 30922 existing records from primary storage. [2025-10-02T22:41:02.638011] [INFO ] [MAIN ] MAX: Loaded 30922 primary data records. [2025-10-02T22:41:02.684491] [DEBUG] [LOCAL ] MATX: Derivative data saved (1807 records). [2025-10-02T22:41:02.704343] [INFO ] [MAIN ] MATX: Successfully saved derivative data. [2025-10-02T22:41:02.759954] [INFO ] [MAIN ] Derivative Progress: 1032/1975 symbols completed. MATX took 1.4s. Estimated remaining: 6m 36s. Rate: 142.9 symbols/min [2025-10-02T22:41:02.772511] [INFO ] [MAIN ] MBI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:03.012078] [DEBUG] [LOCAL ] MBC: Loaded 43591 existing records from primary storage. [2025-10-02T22:41:03.012405] [INFO ] [MAIN ] MBC: Loaded 43591 primary data records. [2025-10-02T22:41:03.091271] [DEBUG] [LOCAL ] MBI: Loaded 24438 existing records from primary storage. [2025-10-02T22:41:03.116316] [INFO ] [MAIN ] MBI: Loaded 24438 primary data records. [2025-10-02T22:41:03.688401] [DEBUG] [MAIN ] MAX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:03.689233] [INFO ] [MAIN ] MAX: Generated 1807 derivative records from 30922 primary records. [2025-10-02T22:41:03.689589] [DEBUG] [LOCAL ] MAX: Saving derivative data. [2025-10-02T22:41:03.710711] [DEBUG] [LOCAL ] MAX: Derivative data saved (1807 records). [2025-10-02T22:41:03.710964] [INFO ] [MAIN ] MAX: Successfully saved derivative data. [2025-10-02T22:41:03.713361] [INFO ] [MAIN ] Derivative Progress: 1033/1975 symbols completed. MAX took 1.2s. Estimated remaining: 6m 36s. Rate: 142.7 symbols/min [2025-10-02T22:41:03.730728] [DEBUG] [MAIN ] MBC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:03.731451] [INFO ] [MAIN ] MBC: Generated 1807 derivative records from 43591 primary records. [2025-10-02T22:41:03.731605] [DEBUG] [LOCAL ] MBC: Saving derivative data. [2025-10-02T22:41:03.764781] [DEBUG] [LOCAL ] MBC: Derivative data saved (1807 records). [2025-10-02T22:41:03.765075] [DEBUG] [MAIN ] MBI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:03.765869] [INFO ] [MAIN ] MBI: Generated 1807 derivative records from 24438 primary records. [2025-10-02T22:41:03.765990] [INFO ] [MAIN ] MBC: Successfully saved derivative data. [2025-10-02T22:41:03.768376] [DEBUG] [LOCAL ] MBI: Saving derivative data. [2025-10-02T22:41:03.768296] [INFO ] [MAIN ] Derivative Progress: 1034/1975 symbols completed. MBC took 1.1s. Estimated remaining: 6m 35s. Rate: 142.8 symbols/min [2025-10-02T22:41:03.784557] [DEBUG] [LOCAL ] MBI: Derivative data saved (1807 records). [2025-10-02T22:41:03.784639] [INFO ] [MAIN ] MBI: Successfully saved derivative data. [2025-10-02T22:41:03.787010] [INFO ] [MAIN ] Derivative Progress: 1035/1975 symbols completed. MBI took 1.0s. Estimated remaining: 6m 35s. Rate: 142.9 symbols/min [2025-10-02T22:41:03.787415] [INFO ] [MAIN ] MC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:03.787514] [INFO ] [MAIN ] MCI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:03.787684] [INFO ] [MAIN ] MCB: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:03.801627] [DEBUG] [LOCAL ] MCI: Loaded 6458 existing records from primary storage. [2025-10-02T22:41:03.806397] [DEBUG] [LOCAL ] MCB: Loaded 11457 existing records from primary storage. [2025-10-02T22:41:03.806147] [INFO ] [MAIN ] MCI: Loaded 6458 primary data records. [2025-10-02T22:41:03.806528] [INFO ] [MAIN ] MCB: Loaded 11457 primary data records. [2025-10-02T22:41:04.474270] [DEBUG] [LOCAL ] MC: Loaded 44384 existing records from primary storage. [2025-10-02T22:41:04.501358] [INFO ] [MAIN ] MC: Loaded 44384 primary data records. [2025-10-02T22:41:04.931244] [DEBUG] [MAIN ] MCB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:04.932215] [INFO ] [MAIN ] MCB: Generated 1807 derivative records from 11457 primary records. [2025-10-02T22:41:04.932467] [DEBUG] [LOCAL ] MCB: Saving derivative data. [2025-10-02T22:41:04.930934] [DEBUG] [MAIN ] MCI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:04.933424] [INFO ] [MAIN ] MCI: Generated 1807 derivative records from 6458 primary records. [2025-10-02T22:41:04.934105] [DEBUG] [LOCAL ] MCI: Saving derivative data. [2025-10-02T22:41:04.971164] [DEBUG] [LOCAL ] MCI: Derivative data saved (1807 records). [2025-10-02T22:41:04.972205] [INFO ] [MAIN ] MCI: Successfully saved derivative data. [2025-10-02T22:41:04.975023] [INFO ] [MAIN ] Derivative Progress: 1036/1975 symbols completed. MCI took 1.2s. Estimated remaining: 6m 35s. Rate: 142.7 symbols/min [2025-10-02T22:41:04.975544] [INFO ] [MAIN ] MCK: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:04.977982] [DEBUG] [LOCAL ] MCB: Derivative data saved (1807 records). [2025-10-02T22:41:04.979035] [INFO ] [MAIN ] MCB: Successfully saved derivative data. [2025-10-02T22:41:04.981959] [INFO ] [MAIN ] Derivative Progress: 1037/1975 symbols completed. MCB took 1.2s. Estimated remaining: 6m 34s. Rate: 142.8 symbols/min [2025-10-02T22:41:04.982282] [INFO ] [MAIN ] MCN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:04.996362] [DEBUG] [MAIN ] MC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:04.997312] [INFO ] [MAIN ] MC: Generated 1807 derivative records from 44384 primary records. [2025-10-02T22:41:04.997766] [DEBUG] [LOCAL ] MC: Saving derivative data. [2025-10-02T22:41:05.018830] [DEBUG] [LOCAL ] MC: Derivative data saved (1807 records). [2025-10-02T22:41:05.018981] [INFO ] [MAIN ] MC: Successfully saved derivative data. [2025-10-02T22:41:05.021463] [INFO ] [MAIN ] Derivative Progress: 1038/1975 symbols completed. MC took 1.2s. Estimated remaining: 6m 33s. Rate: 143.0 symbols/min [2025-10-02T22:41:05.026315] [INFO ] [MAIN ] MCO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:05.026122] [DEBUG] [LOCAL ] MCN: Loaded 8254 existing records from primary storage. [2025-10-02T22:41:05.027128] [INFO ] [MAIN ] MCN: Loaded 8254 primary data records. [2025-10-02T22:41:05.267039] [DEBUG] [LOCAL ] MCK: Loaded 39384 existing records from primary storage. [2025-10-02T22:41:05.394280] [INFO ] [MAIN ] MCK: Loaded 39384 primary data records. [2025-10-02T22:41:05.554316] [DEBUG] [LOCAL ] MCO: Loaded 39604 existing records from primary storage. [2025-10-02T22:41:05.587749] [INFO ] [MAIN ] MCO: Loaded 39604 primary data records. [2025-10-02T22:41:06.113138] [DEBUG] [MAIN ] MCN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:06.115249] [INFO ] [MAIN ] MCN: Generated 1807 derivative records from 8254 primary records. [2025-10-02T22:41:06.115485] [DEBUG] [LOCAL ] MCN: Saving derivative data. [2025-10-02T22:41:06.152690] [DEBUG] [MAIN ] MCK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:06.154767] [DEBUG] [LOCAL ] MCN: Derivative data saved (1807 records). [2025-10-02T22:41:06.154460] [INFO ] [MAIN ] MCK: Generated 1807 derivative records from 39384 primary records. [2025-10-02T22:41:06.155086] [INFO ] [MAIN ] MCN: Successfully saved derivative data. [2025-10-02T22:41:06.155188] [DEBUG] [LOCAL ] MCK: Saving derivative data. [2025-10-02T22:41:06.157576] [INFO ] [MAIN ] Derivative Progress: 1039/1975 symbols completed. MCN took 1.2s. Estimated remaining: 6m 33s. Rate: 142.7 symbols/min [2025-10-02T22:41:06.159388] [INFO ] [MAIN ] MCR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:06.178672] [DEBUG] [LOCAL ] MCK: Derivative data saved (1807 records). [2025-10-02T22:41:06.179003] [INFO ] [MAIN ] MCK: Successfully saved derivative data. [2025-10-02T22:41:06.181268] [INFO ] [MAIN ] Derivative Progress: 1040/1975 symbols completed. MCK took 1.2s. Estimated remaining: 6m 33s. Rate: 142.8 symbols/min [2025-10-02T22:41:06.181674] [INFO ] [MAIN ] MCS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:06.210172] [DEBUG] [LOCAL ] MCR: Loaded 8814 existing records from primary storage. [2025-10-02T22:41:06.209581] [DEBUG] [MAIN ] MCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:06.211330] [INFO ] [MAIN ] MCR: Loaded 8814 primary data records. [2025-10-02T22:41:06.211234] [INFO ] [MAIN ] MCO: Generated 1807 derivative records from 39604 primary records. [2025-10-02T22:41:06.224153] [DEBUG] [LOCAL ] MCO: Saving derivative data. [2025-10-02T22:41:06.362342] [DEBUG] [LOCAL ] MCS: Loaded 21177 existing records from primary storage. [2025-10-02T22:41:06.363260] [INFO ] [MAIN ] MCS: Loaded 21177 primary data records. [2025-10-02T22:41:06.508175] [DEBUG] [LOCAL ] MCO: Derivative data saved (1807 records). [2025-10-02T22:41:06.604559] [INFO ] [MAIN ] MCO: Successfully saved derivative data. [2025-10-02T22:41:06.696799] [INFO ] [MAIN ] Derivative Progress: 1041/1975 symbols completed. MCO took 1.7s. Estimated remaining: 6m 32s. Rate: 142.8 symbols/min [2025-10-02T22:41:06.702252] [INFO ] [MAIN ] MCY: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:06.974556] [DEBUG] [LOCAL ] MCY: Loaded 24525 existing records from primary storage. [2025-10-02T22:41:06.975034] [INFO ] [MAIN ] MCY: Loaded 24525 primary data records. [2025-10-02T22:41:07.180517] [DEBUG] [MAIN ] MCR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:07.204860] [INFO ] [MAIN ] MCR: Generated 1807 derivative records from 8814 primary records. [2025-10-02T22:41:07.324533] [DEBUG] [LOCAL ] MCR: Saving derivative data. [2025-10-02T22:41:07.342136] [DEBUG] [LOCAL ] MCR: Derivative data saved (1807 records). [2025-10-02T22:41:07.342407] [INFO ] [MAIN ] MCR: Successfully saved derivative data. [2025-10-02T22:41:07.345584] [INFO ] [MAIN ] Derivative Progress: 1042/1975 symbols completed. MCR took 1.2s. Estimated remaining: 6m 32s. Rate: 142.7 symbols/min [2025-10-02T22:41:07.345952] [INFO ] [MAIN ] MD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:07.365867] [DEBUG] [MAIN ] MCS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:07.367021] [INFO ] [MAIN ] MCS: Generated 1807 derivative records from 21177 primary records. [2025-10-02T22:41:07.367145] [DEBUG] [LOCAL ] MCS: Saving derivative data. [2025-10-02T22:41:07.386248] [DEBUG] [LOCAL ] MCS: Derivative data saved (1807 records). [2025-10-02T22:41:07.386517] [INFO ] [MAIN ] MCS: Successfully saved derivative data. [2025-10-02T22:41:07.389035] [INFO ] [MAIN ] Derivative Progress: 1043/1975 symbols completed. MCS took 1.2s. Estimated remaining: 6m 31s. Rate: 142.9 symbols/min [2025-10-02T22:41:07.389379] [INFO ] [MAIN ] MDST: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:07.409102] [DEBUG] [MAIN ] MCY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:07.409999] [INFO ] [MAIN ] MCY: Generated 1807 derivative records from 24525 primary records. [2025-10-02T22:41:07.410155] [DEBUG] [LOCAL ] MCY: Saving derivative data. [2025-10-02T22:41:07.443385] [DEBUG] [LOCAL ] MCY: Derivative data saved (1807 records). [2025-10-02T22:41:07.442951] [DEBUG] [LOCAL ] MDST: Loaded 5730 existing records from primary storage. [2025-10-02T22:41:07.443768] [INFO ] [MAIN ] MCY: Successfully saved derivative data. [2025-10-02T22:41:07.443900] [INFO ] [MAIN ] MDST: Loaded 5730 primary data records. [2025-10-02T22:41:07.446383] [INFO ] [MAIN ] Derivative Progress: 1044/1975 symbols completed. MCY took 0.7s. Estimated remaining: 6m 31s. Rate: 143.0 symbols/min [2025-10-02T22:41:07.474042] [INFO ] [MAIN ] MDT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:07.495375] [DEBUG] [LOCAL ] MD: Loaded 38594 existing records from primary storage. [2025-10-02T22:41:07.513531] [INFO ] [MAIN ] MD: Loaded 38594 primary data records. [2025-10-02T22:41:08.161730] [DEBUG] [LOCAL ] MDT: Loaded 54068 existing records from primary storage. [2025-10-02T22:41:08.162061] [INFO ] [MAIN ] MDT: Loaded 54068 primary data records. [2025-10-02T22:41:08.537447] [DEBUG] [MAIN ] MD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:08.539099] [INFO ] [MAIN ] MD: Generated 1807 derivative records from 38594 primary records. [2025-10-02T22:41:08.539231] [DEBUG] [LOCAL ] MD: Saving derivative data. [2025-10-02T22:41:08.541017] [DEBUG] [MAIN ] MDST: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:08.554342] [INFO ] [MAIN ] MDST: Generated 1807 derivative records from 5730 primary records. [2025-10-02T22:41:08.554583] [DEBUG] [LOCAL ] MDST: Saving derivative data. [2025-10-02T22:41:08.559771] [DEBUG] [LOCAL ] MD: Derivative data saved (1807 records). [2025-10-02T22:41:08.560027] [INFO ] [MAIN ] MD: Successfully saved derivative data. [2025-10-02T22:41:08.562637] [INFO ] [MAIN ] Derivative Progress: 1045/1975 symbols completed. MD took 1.2s. Estimated remaining: 6m 31s. Rate: 142.8 symbols/min [2025-10-02T22:41:08.570457] [INFO ] [MAIN ] MDU: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:08.580132] [DEBUG] [LOCAL ] MDST: Derivative data saved (1807 records). [2025-10-02T22:41:08.580362] [INFO ] [MAIN ] MDST: Successfully saved derivative data. [2025-10-02T22:41:08.583298] [INFO ] [MAIN ] Derivative Progress: 1046/1975 symbols completed. MDST took 1.2s. Estimated remaining: 6m 30s. Rate: 142.9 symbols/min [2025-10-02T22:41:08.583935] [INFO ] [MAIN ] MDV: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:08.605091] [DEBUG] [MAIN ] MDT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:08.605992] [INFO ] [MAIN ] MDT: Generated 1807 derivative records from 54068 primary records. [2025-10-02T22:41:08.606157] [DEBUG] [LOCAL ] MDT: Saving derivative data. [2025-10-02T22:41:08.611175] [DEBUG] [LOCAL ] MDV: Loaded 8576 existing records from primary storage. [2025-10-02T22:41:08.611420] [INFO ] [MAIN ] MDV: Loaded 8576 primary data records. [2025-10-02T22:41:08.679984] [DEBUG] [LOCAL ] MDT: Derivative data saved (1807 records). [2025-10-02T22:41:08.703383] [INFO ] [MAIN ] MDT: Successfully saved derivative data. [2025-10-02T22:41:08.729784] [INFO ] [MAIN ] Derivative Progress: 1047/1975 symbols completed. MDT took 1.3s. Estimated remaining: 6m 29s. Rate: 143.0 symbols/min [2025-10-02T22:41:08.729999] [INFO ] [MAIN ] MEC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:09.024616] [DEBUG] [LOCAL ] MDU: Loaded 48324 existing records from primary storage. [2025-10-02T22:41:09.034723] [INFO ] [MAIN ] MDU: Loaded 48324 primary data records. [2025-10-02T22:41:09.067761] [DEBUG] [LOCAL ] MEC: Loaded 16383 existing records from primary storage. [2025-10-02T22:41:09.100233] [INFO ] [MAIN ] MEC: Loaded 16383 primary data records. [2025-10-02T22:41:09.783304] [DEBUG] [MAIN ] MDV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:09.785060] [INFO ] [MAIN ] MDV: Generated 1807 derivative records from 8576 primary records. [2025-10-02T22:41:09.785486] [DEBUG] [LOCAL ] MDV: Saving derivative data. [2025-10-02T22:41:09.814780] [DEBUG] [LOCAL ] MDV: Derivative data saved (1807 records). [2025-10-02T22:41:09.816259] [INFO ] [MAIN ] MDV: Successfully saved derivative data. [2025-10-02T22:41:09.819342] [INFO ] [MAIN ] Derivative Progress: 1048/1975 symbols completed. MDV took 1.2s. Estimated remaining: 6m 30s. Rate: 142.8 symbols/min [2025-10-02T22:41:09.835354] [DEBUG] [MAIN ] MDU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:09.836165] [INFO ] [MAIN ] MDU: Generated 1807 derivative records from 48324 primary records. [2025-10-02T22:41:09.836249] [DEBUG] [LOCAL ] MDU: Saving derivative data. [2025-10-02T22:41:09.855591] [DEBUG] [LOCAL ] MDU: Derivative data saved (1807 records). [2025-10-02T22:41:09.855765] [INFO ] [MAIN ] MDU: Successfully saved derivative data. [2025-10-02T22:41:09.858148] [INFO ] [MAIN ] Derivative Progress: 1049/1975 symbols completed. MDU took 1.3s. Estimated remaining: 6m 29s. Rate: 142.9 symbols/min [2025-10-02T22:41:09.872076] [DEBUG] [MAIN ] MEC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:09.872745] [INFO ] [MAIN ] MEC: Generated 1807 derivative records from 16383 primary records. [2025-10-02T22:41:09.872811] [DEBUG] [LOCAL ] MEC: Saving derivative data. [2025-10-02T22:41:09.889763] [DEBUG] [LOCAL ] MEC: Derivative data saved (1807 records). [2025-10-02T22:41:09.889853] [INFO ] [MAIN ] MEC: Successfully saved derivative data. [2025-10-02T22:41:09.892001] [INFO ] [MAIN ] Derivative Progress: 1050/1975 symbols completed. MEC took 1.2s. Estimated remaining: 6m 28s. Rate: 143.0 symbols/min [2025-10-02T22:41:09.892676] [INFO ] [MAIN ] MEGI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:09.892598] [INFO ] [MAIN ] MED: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:09.893067] [INFO ] [MAIN ] MEG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:09.935099] [DEBUG] [LOCAL ] MEGI: Loaded 20228 existing records from primary storage. [2025-10-02T22:41:09.934595] [DEBUG] [LOCAL ] MED: Loaded 21638 existing records from primary storage. [2025-10-02T22:41:09.935335] [INFO ] [MAIN ] MEGI: Loaded 20228 primary data records. [2025-10-02T22:41:09.935398] [INFO ] [MAIN ] MED: Loaded 21638 primary data records. [2025-10-02T22:41:10.102032] [DEBUG] [LOCAL ] MEG: Loaded 32074 existing records from primary storage. [2025-10-02T22:41:10.178469] [INFO ] [MAIN ] MEG: Loaded 32074 primary data records. [2025-10-02T22:41:10.995742] [DEBUG] [MAIN ] MED: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:11.010252] [INFO ] [MAIN ] MED: Generated 1807 derivative records from 21638 primary records. [2025-10-02T22:41:11.010823] [DEBUG] [MAIN ] MEGI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:11.011461] [INFO ] [MAIN ] MEGI: Generated 1807 derivative records from 20228 primary records. [2025-10-02T22:41:11.011636] [DEBUG] [LOCAL ] MEGI: Saving derivative data. [2025-10-02T22:41:11.011564] [DEBUG] [LOCAL ] MED: Saving derivative data. [2025-10-02T22:41:11.045966] [DEBUG] [LOCAL ] MEGI: Derivative data saved (1807 records). [2025-10-02T22:41:11.047188] [INFO ] [MAIN ] MEGI: Successfully saved derivative data. [2025-10-02T22:41:11.048807] [DEBUG] [LOCAL ] MED: Derivative data saved (1807 records). [2025-10-02T22:41:11.048909] [INFO ] [MAIN ] MED: Successfully saved derivative data. [2025-10-02T22:41:11.051736] [INFO ] [MAIN ] Derivative Progress: 1051/1975 symbols completed. MEGI took 1.2s. Estimated remaining: 6m 28s. Rate: 142.8 symbols/min [2025-10-02T22:41:11.052010] [INFO ] [MAIN ] MEI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:11.054491] [INFO ] [MAIN ] Derivative Progress: 1052/1975 symbols completed. MED took 1.2s. Estimated remaining: 6m 28s. Rate: 142.9 symbols/min [2025-10-02T22:41:11.055124] [INFO ] [MAIN ] MET: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:11.070599] [DEBUG] [MAIN ] MEG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:11.071340] [INFO ] [MAIN ] MEG: Generated 1807 derivative records from 32074 primary records. [2025-10-02T22:41:11.071538] [DEBUG] [LOCAL ] MEG: Saving derivative data. [2025-10-02T22:41:11.088963] [DEBUG] [LOCAL ] MEG: Derivative data saved (1807 records). [2025-10-02T22:41:11.089138] [INFO ] [MAIN ] MEG: Successfully saved derivative data. [2025-10-02T22:41:11.091251] [INFO ] [MAIN ] Derivative Progress: 1053/1975 symbols completed. MEG took 1.2s. Estimated remaining: 6m 27s. Rate: 143.0 symbols/min [2025-10-02T22:41:11.091590] [INFO ] [MAIN ] MFA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:11.118391] [DEBUG] [LOCAL ] MEI: Loaded 32265 existing records from primary storage. [2025-10-02T22:41:11.131892] [INFO ] [MAIN ] MEI: Loaded 32265 primary data records. [2025-10-02T22:41:11.285400] [DEBUG] [LOCAL ] MET: Loaded 53701 existing records from primary storage. [2025-10-02T22:41:11.309130] [INFO ] [MAIN ] MET: Loaded 53701 primary data records. [2025-10-02T22:41:11.355257] [DEBUG] [LOCAL ] MFA: Loaded 45805 existing records from primary storage. [2025-10-02T22:41:11.371733] [INFO ] [MAIN ] MFA: Loaded 45805 primary data records. [2025-10-02T22:41:12.255536] [DEBUG] [MAIN ] MEI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:12.256997] [INFO ] [MAIN ] MEI: Generated 1807 derivative records from 32265 primary records. [2025-10-02T22:41:12.257227] [DEBUG] [LOCAL ] MEI: Saving derivative data. [2025-10-02T22:41:12.278983] [DEBUG] [LOCAL ] MEI: Derivative data saved (1807 records). [2025-10-02T22:41:12.279847] [INFO ] [MAIN ] MEI: Successfully saved derivative data. [2025-10-02T22:41:12.283231] [INFO ] [MAIN ] Derivative Progress: 1054/1975 symbols completed. MEI took 1.2s. Estimated remaining: 6m 27s. Rate: 142.8 symbols/min [2025-10-02T22:41:12.299988] [INFO ] [MAIN ] MFAN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:12.298795] [DEBUG] [MAIN ] MET: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:12.302303] [INFO ] [MAIN ] MET: Generated 1807 derivative records from 53701 primary records. [2025-10-02T22:41:12.302993] [DEBUG] [LOCAL ] MET: Saving derivative data. [2025-10-02T22:41:12.324949] [DEBUG] [MAIN ] MFA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:12.331462] [INFO ] [MAIN ] MFA: Generated 1807 derivative records from 45805 primary records. [2025-10-02T22:41:12.334603] [DEBUG] [LOCAL ] MFA: Saving derivative data. [2025-10-02T22:41:12.340342] [DEBUG] [LOCAL ] MFAN: Loaded 4277 existing records from primary storage. [2025-10-02T22:41:12.353058] [DEBUG] [LOCAL ] MET: Derivative data saved (1807 records). [2025-10-02T22:41:12.352973] [INFO ] [MAIN ] MFAN: Loaded 4277 primary data records. [2025-10-02T22:41:12.357801] [DEBUG] [LOCAL ] MFA: Derivative data saved (1807 records). [2025-10-02T22:41:12.354328] [INFO ] [MAIN ] MET: Successfully saved derivative data. [2025-10-02T22:41:12.384218] [INFO ] [MAIN ] MFA: Successfully saved derivative data. [2025-10-02T22:41:12.384028] [INFO ] [MAIN ] Derivative Progress: 1055/1975 symbols completed. MET took 1.3s. Estimated remaining: 6m 26s. Rate: 142.9 symbols/min [2025-10-02T22:41:12.411944] [INFO ] [MAIN ] MFAO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:12.417536] [INFO ] [MAIN ] Derivative Progress: 1056/1975 symbols completed. MFA took 1.3s. Estimated remaining: 6m 26s. Rate: 143.0 symbols/min [2025-10-02T22:41:12.437146] [INFO ] [MAIN ] MFC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:12.494785] [DEBUG] [LOCAL ] MFAO: Loaded 3857 existing records from primary storage. [2025-10-02T22:41:12.521037] [INFO ] [MAIN ] MFAO: Loaded 3857 primary data records. [2025-10-02T22:41:13.061956] [DEBUG] [LOCAL ] MFC: Loaded 51524 existing records from primary storage. [2025-10-02T22:41:13.077543] [INFO ] [MAIN ] MFC: Loaded 51524 primary data records. [2025-10-02T22:41:13.465589] [DEBUG] [MAIN ] MFAN: Filtered 6966 bins outside market hours, 7761 incomplete bins [2025-10-02T22:41:13.467595] [INFO ] [MAIN ] MFAN: Generated 1805 derivative records from 4277 primary records. [2025-10-02T22:41:13.468207] [DEBUG] [LOCAL ] MFAN: Saving derivative data. [2025-10-02T22:41:13.488799] [DEBUG] [LOCAL ] MFAN: Derivative data saved (1805 records). [2025-10-02T22:41:13.489862] [INFO ] [MAIN ] MFAN: Successfully saved derivative data. [2025-10-02T22:41:13.492342] [INFO ] [MAIN ] Derivative Progress: 1057/1975 symbols completed. MFAN took 1.2s. Estimated remaining: 6m 26s. Rate: 142.8 symbols/min [2025-10-02T22:41:13.493095] [INFO ] [MAIN ] MFG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:13.508383] [DEBUG] [MAIN ] MFAO: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-02T22:41:13.509311] [INFO ] [MAIN ] MFAO: Generated 1806 derivative records from 3857 primary records. [2025-10-02T22:41:13.509469] [DEBUG] [LOCAL ] MFAO: Saving derivative data. [2025-10-02T22:41:13.531158] [DEBUG] [LOCAL ] MFAO: Derivative data saved (1806 records). [2025-10-02T22:41:13.531529] [INFO ] [MAIN ] MFAO: Successfully saved derivative data. [2025-10-02T22:41:13.534259] [INFO ] [MAIN ] Derivative Progress: 1058/1975 symbols completed. MFAO took 1.1s. Estimated remaining: 6m 25s. Rate: 142.9 symbols/min [2025-10-02T22:41:13.534474] [INFO ] [MAIN ] MFSG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:13.565688] [DEBUG] [MAIN ] MFC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:13.566673] [INFO ] [MAIN ] MFC: Generated 1807 derivative records from 51524 primary records. [2025-10-02T22:41:13.566878] [DEBUG] [LOCAL ] MFC: Saving derivative data. [2025-10-02T22:41:13.570863] [DEBUG] [LOCAL ] MFSG: Loaded 5433 existing records from primary storage. [2025-10-02T22:41:13.571207] [INFO ] [MAIN ] MFSG: Loaded 5433 primary data records. [2025-10-02T22:41:13.722634] [DEBUG] [LOCAL ] MFC: Derivative data saved (1807 records). [2025-10-02T22:41:13.722871] [INFO ] [MAIN ] MFC: Successfully saved derivative data. [2025-10-02T22:41:13.715544] [DEBUG] [LOCAL ] MFG: Loaded 49581 existing records from primary storage. [2025-10-02T22:41:13.725503] [INFO ] [MAIN ] Derivative Progress: 1059/1975 symbols completed. MFC took 1.3s. Estimated remaining: 6m 24s. Rate: 143.0 symbols/min [2025-10-02T22:41:13.731738] [INFO ] [MAIN ] MFSI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:13.731599] [INFO ] [MAIN ] MFG: Loaded 49581 primary data records. [2025-10-02T22:41:14.094885] [DEBUG] [LOCAL ] MFSI: Loaded 11578 existing records from primary storage. [2025-10-02T22:41:14.131537] [INFO ] [MAIN ] MFSI: Loaded 11578 primary data records. [2025-10-02T22:41:14.661467] [DEBUG] [MAIN ] MFSG: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-02T22:41:14.663290] [INFO ] [MAIN ] MFSG: Generated 1806 derivative records from 5433 primary records. [2025-10-02T22:41:14.663514] [DEBUG] [LOCAL ] MFSG: Saving derivative data. [2025-10-02T22:41:14.700041] [DEBUG] [LOCAL ] MFSG: Derivative data saved (1806 records). [2025-10-02T22:41:14.700572] [DEBUG] [MAIN ] MFG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:14.700749] [INFO ] [MAIN ] MFSG: Successfully saved derivative data. [2025-10-02T22:41:14.703521] [INFO ] [MAIN ] Derivative Progress: 1060/1975 symbols completed. MFSG took 1.2s. Estimated remaining: 6m 24s. Rate: 142.8 symbols/min [2025-10-02T22:41:14.703878] [INFO ] [MAIN ] MFSV: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:14.701472] [INFO ] [MAIN ] MFG: Generated 1807 derivative records from 49581 primary records. [2025-10-02T22:41:14.704123] [DEBUG] [LOCAL ] MFG: Saving derivative data. [2025-10-02T22:41:14.723186] [DEBUG] [LOCAL ] MFG: Derivative data saved (1807 records). [2025-10-02T22:41:14.723536] [INFO ] [MAIN ] MFG: Successfully saved derivative data. [2025-10-02T22:41:14.725916] [DEBUG] [LOCAL ] MFSV: Loaded 2596 existing records from primary storage. [2025-10-02T22:41:14.728257] [INFO ] [MAIN ] Derivative Progress: 1061/1975 symbols completed. MFG took 1.2s. Estimated remaining: 6m 24s. Rate: 142.9 symbols/min [2025-10-02T22:41:14.728693] [INFO ] [MAIN ] MFSV: Loaded 2596 primary data records. [2025-10-02T22:41:14.746032] [INFO ] [MAIN ] MG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:14.892678] [DEBUG] [MAIN ] MFSI: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-02T22:41:14.937779] [DEBUG] [LOCAL ] MG: Loaded 16524 existing records from primary storage. [2025-10-02T22:41:14.936712] [INFO ] [MAIN ] MFSI: Generated 1806 derivative records from 11578 primary records. [2025-10-02T22:41:14.959012] [DEBUG] [LOCAL ] MFSI: Saving derivative data. [2025-10-02T22:41:14.959136] [INFO ] [MAIN ] MG: Loaded 16524 primary data records. [2025-10-02T22:41:15.219142] [DEBUG] [LOCAL ] MFSI: Derivative data saved (1806 records). [2025-10-02T22:41:15.219484] [INFO ] [MAIN ] MFSI: Successfully saved derivative data. [2025-10-02T22:41:15.227433] [INFO ] [MAIN ] Derivative Progress: 1062/1975 symbols completed. MFSI took 1.5s. Estimated remaining: 6m 23s. Rate: 142.9 symbols/min [2025-10-02T22:41:15.232847] [INFO ] [MAIN ] MGA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:15.502339] [DEBUG] [MAIN ] MFSV: Filtered 6966 bins outside market hours, 7761 incomplete bins [2025-10-02T22:41:15.503474] [INFO ] [MAIN ] MFSV: Generated 1805 derivative records from 2596 primary records. [2025-10-02T22:41:15.503555] [DEBUG] [LOCAL ] MFSV: Saving derivative data. [2025-10-02T22:41:15.520268] [DEBUG] [LOCAL ] MFSV: Derivative data saved (1805 records). [2025-10-02T22:41:15.534133] [INFO ] [MAIN ] MFSV: Successfully saved derivative data. [2025-10-02T22:41:15.536357] [INFO ] [MAIN ] Derivative Progress: 1063/1975 symbols completed. MFSV took 0.8s. Estimated remaining: 6m 23s. Rate: 142.9 symbols/min [2025-10-02T22:41:15.573612] [DEBUG] [LOCAL ] MGA: Loaded 51045 existing records from primary storage. [2025-10-02T22:41:15.573816] [INFO ] [MAIN ] MGA: Loaded 51045 primary data records. [2025-10-02T22:41:15.572481] [DEBUG] [MAIN ] MG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:15.575062] [INFO ] [MAIN ] MG: Generated 1807 derivative records from 16524 primary records. [2025-10-02T22:41:15.642493] [DEBUG] [LOCAL ] MG: Saving derivative data. [2025-10-02T22:41:15.766238] [DEBUG] [LOCAL ] MG: Derivative data saved (1807 records). [2025-10-02T22:41:15.784709] [INFO ] [MAIN ] MG: Successfully saved derivative data. [2025-10-02T22:41:15.793914] [INFO ] [MAIN ] Derivative Progress: 1064/1975 symbols completed. MG took 1.0s. Estimated remaining: 6m 22s. Rate: 143.0 symbols/min [2025-10-02T22:41:15.941410] [DEBUG] [MAIN ] MGA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:15.942144] [INFO ] [MAIN ] MGA: Generated 1807 derivative records from 51045 primary records. [2025-10-02T22:41:15.942212] [DEBUG] [LOCAL ] MGA: Saving derivative data. [2025-10-02T22:41:15.958190] [DEBUG] [LOCAL ] MGA: Derivative data saved (1807 records). [2025-10-02T22:41:15.958257] [INFO ] [MAIN ] MGA: Successfully saved derivative data. [2025-10-02T22:41:15.960729] [INFO ] [MAIN ] Derivative Progress: 1065/1975 symbols completed. MGA took 0.7s. Estimated remaining: 6m 22s. Rate: 143.1 symbols/min [2025-10-02T22:41:15.961364] [INFO ] [MAIN ] MGF: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:15.961137] [INFO ] [MAIN ] MGR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:15.961253] [INFO ] [MAIN ] MGM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:15.971992] [DEBUG] [LOCAL ] MGR: Loaded 5639 existing records from primary storage. [2025-10-02T22:41:15.976572] [DEBUG] [LOCAL ] MGF: Loaded 4296 existing records from primary storage. [2025-10-02T22:41:15.976864] [INFO ] [MAIN ] MGR: Loaded 5639 primary data records. [2025-10-02T22:41:15.989729] [INFO ] [MAIN ] MGF: Loaded 4296 primary data records. [2025-10-02T22:41:16.672362] [DEBUG] [LOCAL ] MGM: Loaded 53997 existing records from primary storage. [2025-10-02T22:41:16.673284] [INFO ] [MAIN ] MGM: Loaded 53997 primary data records. [2025-10-02T22:41:17.027073] [DEBUG] [MAIN ] MGR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:17.028874] [INFO ] [MAIN ] MGR: Generated 1807 derivative records from 5639 primary records. [2025-10-02T22:41:17.029070] [DEBUG] [LOCAL ] MGR: Saving derivative data. [2025-10-02T22:41:17.043094] [DEBUG] [MAIN ] MGF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:17.044217] [INFO ] [MAIN ] MGF: Generated 1807 derivative records from 4296 primary records. [2025-10-02T22:41:17.055899] [DEBUG] [LOCAL ] MGF: Saving derivative data. [2025-10-02T22:41:17.070851] [DEBUG] [LOCAL ] MGR: Derivative data saved (1807 records). [2025-10-02T22:41:17.070980] [INFO ] [MAIN ] MGR: Successfully saved derivative data. [2025-10-02T22:41:17.078023] [INFO ] [MAIN ] Derivative Progress: 1066/1975 symbols completed. MGR took 1.1s. Estimated remaining: 6m 22s. Rate: 142.9 symbols/min [2025-10-02T22:41:17.078521] [INFO ] [MAIN ] MGRB: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:17.083436] [DEBUG] [LOCAL ] MGF: Derivative data saved (1807 records). [2025-10-02T22:41:17.085867] [INFO ] [MAIN ] MGF: Successfully saved derivative data. [2025-10-02T22:41:17.089287] [INFO ] [MAIN ] Derivative Progress: 1067/1975 symbols completed. MGF took 1.1s. Estimated remaining: 6m 21s. Rate: 143.0 symbols/min [2025-10-02T22:41:17.090453] [INFO ] [MAIN ] MGRD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:17.093387] [DEBUG] [LOCAL ] MGRB: Loaded 4079 existing records from primary storage. [2025-10-02T22:41:17.093521] [INFO ] [MAIN ] MGRB: Loaded 4079 primary data records. [2025-10-02T22:41:17.140890] [DEBUG] [MAIN ] MGM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:17.161030] [INFO ] [MAIN ] MGM: Generated 1807 derivative records from 53997 primary records. [2025-10-02T22:41:17.181489] [DEBUG] [LOCAL ] MGRD: Loaded 2248 existing records from primary storage. [2025-10-02T22:41:17.199614] [INFO ] [MAIN ] MGRD: Loaded 2248 primary data records. [2025-10-02T22:41:17.194385] [DEBUG] [LOCAL ] MGM: Saving derivative data. [2025-10-02T22:41:17.843254] [DEBUG] [LOCAL ] MGM: Derivative data saved (1807 records). [2025-10-02T22:41:17.858461] [INFO ] [MAIN ] MGM: Successfully saved derivative data. [2025-10-02T22:41:17.861961] [INFO ] [MAIN ] Derivative Progress: 1068/1975 symbols completed. MGM took 1.9s. Estimated remaining: 6m 21s. Rate: 142.9 symbols/min [2025-10-02T22:41:17.862369] [INFO ] [MAIN ] MGRE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:17.877132] [DEBUG] [LOCAL ] MGRE: Loaded 6725 existing records from primary storage. [2025-10-02T22:41:17.878197] [INFO ] [MAIN ] MGRE: Loaded 6725 primary data records. [2025-10-02T22:41:18.234544] [DEBUG] [MAIN ] MGRD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:18.235305] [DEBUG] [MAIN ] MGRB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:18.236774] [INFO ] [MAIN ] MGRD: Generated 1807 derivative records from 2248 primary records. [2025-10-02T22:41:18.236100] [INFO ] [MAIN ] MGRB: Generated 1807 derivative records from 4079 primary records. [2025-10-02T22:41:18.236963] [DEBUG] [LOCAL ] MGRD: Saving derivative data. [2025-10-02T22:41:18.237052] [DEBUG] [LOCAL ] MGRB: Saving derivative data. [2025-10-02T22:41:18.265677] [DEBUG] [LOCAL ] MGRB: Derivative data saved (1807 records). [2025-10-02T22:41:18.266092] [INFO ] [MAIN ] MGRB: Successfully saved derivative data. [2025-10-02T22:41:18.269150] [INFO ] [MAIN ] Derivative Progress: 1069/1975 symbols completed. MGRB took 1.2s. Estimated remaining: 6m 20s. Rate: 142.9 symbols/min [2025-10-02T22:41:18.269845] [INFO ] [MAIN ] MGY: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:18.273810] [DEBUG] [LOCAL ] MGRD: Derivative data saved (1807 records). [2025-10-02T22:41:18.274167] [INFO ] [MAIN ] MGRD: Successfully saved derivative data. [2025-10-02T22:41:18.276696] [INFO ] [MAIN ] Derivative Progress: 1070/1975 symbols completed. MGRD took 1.2s. Estimated remaining: 6m 20s. Rate: 143.0 symbols/min [2025-10-02T22:41:18.276974] [INFO ] [MAIN ] MHD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:18.302498] [DEBUG] [MAIN ] MGRE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:18.303340] [INFO ] [MAIN ] MGRE: Generated 1807 derivative records from 6725 primary records. [2025-10-02T22:41:18.309359] [DEBUG] [LOCAL ] MGRE: Saving derivative data. [2025-10-02T22:41:18.309263] [DEBUG] [LOCAL ] MHD: Loaded 12563 existing records from primary storage. [2025-10-02T22:41:18.310288] [INFO ] [MAIN ] MHD: Loaded 12563 primary data records. [2025-10-02T22:41:18.400398] [DEBUG] [LOCAL ] MGRE: Derivative data saved (1807 records). [2025-10-02T22:41:18.433667] [INFO ] [MAIN ] MGRE: Successfully saved derivative data. [2025-10-02T22:41:18.442107] [INFO ] [MAIN ] Derivative Progress: 1071/1975 symbols completed. MGRE took 0.6s. Estimated remaining: 6m 19s. Rate: 143.1 symbols/min [2025-10-02T22:41:18.460221] [INFO ] [MAIN ] MHF: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:18.676331] [DEBUG] [LOCAL ] MGY: Loaded 52801 existing records from primary storage. [2025-10-02T22:41:18.689729] [DEBUG] [LOCAL ] MHF: Loaded 8733 existing records from primary storage. [2025-10-02T22:41:18.689942] [INFO ] [MAIN ] MHF: Loaded 8733 primary data records. [2025-10-02T22:41:18.690032] [INFO ] [MAIN ] MGY: Loaded 52801 primary data records. [2025-10-02T22:41:19.354181] [DEBUG] [MAIN ] MHD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:19.355684] [INFO ] [MAIN ] MHD: Generated 1807 derivative records from 12563 primary records. [2025-10-02T22:41:19.356626] [DEBUG] [LOCAL ] MHD: Saving derivative data. [2025-10-02T22:41:19.382409] [DEBUG] [LOCAL ] MHD: Derivative data saved (1807 records). [2025-10-02T22:41:19.390811] [INFO ] [MAIN ] MHD: Successfully saved derivative data. [2025-10-02T22:41:19.397916] [DEBUG] [MAIN ] MHF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:19.400245] [INFO ] [MAIN ] Derivative Progress: 1072/1975 symbols completed. MHD took 1.1s. Estimated remaining: 6m 19s. Rate: 142.9 symbols/min [2025-10-02T22:41:19.401269] [INFO ] [MAIN ] MHF: Generated 1807 derivative records from 8733 primary records. [2025-10-02T22:41:19.402407] [INFO ] [MAIN ] MHK: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:19.403542] [DEBUG] [LOCAL ] MHF: Saving derivative data. [2025-10-02T22:41:19.430277] [DEBUG] [MAIN ] MGY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:19.433262] [INFO ] [MAIN ] MGY: Generated 1807 derivative records from 52801 primary records. [2025-10-02T22:41:19.435831] [DEBUG] [LOCAL ] MHF: Derivative data saved (1807 records). [2025-10-02T22:41:19.436056] [DEBUG] [LOCAL ] MGY: Saving derivative data. [2025-10-02T22:41:19.436579] [INFO ] [MAIN ] MHF: Successfully saved derivative data. [2025-10-02T22:41:19.439381] [INFO ] [MAIN ] Derivative Progress: 1073/1975 symbols completed. MHF took 1.0s. Estimated remaining: 6m 18s. Rate: 143.0 symbols/min [2025-10-02T22:41:19.447459] [INFO ] [MAIN ] MHN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:19.456852] [DEBUG] [LOCAL ] MGY: Derivative data saved (1807 records). [2025-10-02T22:41:19.457179] [INFO ] [MAIN ] MGY: Successfully saved derivative data. [2025-10-02T22:41:19.459682] [INFO ] [MAIN ] Derivative Progress: 1074/1975 symbols completed. MGY took 1.2s. Estimated remaining: 6m 18s. Rate: 143.2 symbols/min [2025-10-02T22:41:19.460046] [INFO ] [MAIN ] MHO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:19.468868] [DEBUG] [LOCAL ] MHN: Loaded 7634 existing records from primary storage. [2025-10-02T22:41:19.469125] [INFO ] [MAIN ] MHN: Loaded 7634 primary data records. [2025-10-02T22:41:19.641466] [DEBUG] [LOCAL ] MHK: Loaded 42458 existing records from primary storage. [2025-10-02T22:41:19.657500] [DEBUG] [LOCAL ] MHO: Loaded 24076 existing records from primary storage. [2025-10-02T22:41:19.687932] [INFO ] [MAIN ] MHK: Loaded 42458 primary data records. [2025-10-02T22:41:19.688282] [INFO ] [MAIN ] MHO: Loaded 24076 primary data records. [2025-10-02T22:41:20.598489] [DEBUG] [MAIN ] MHN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:20.599836] [INFO ] [MAIN ] MHN: Generated 1807 derivative records from 7634 primary records. [2025-10-02T22:41:20.601153] [DEBUG] [LOCAL ] MHN: Saving derivative data. [2025-10-02T22:41:20.621035] [DEBUG] [LOCAL ] MHN: Derivative data saved (1807 records). [2025-10-02T22:41:20.621421] [INFO ] [MAIN ] MHN: Successfully saved derivative data. [2025-10-02T22:41:20.624190] [INFO ] [MAIN ] Derivative Progress: 1075/1975 symbols completed. MHN took 1.2s. Estimated remaining: 6m 18s. Rate: 142.9 symbols/min [2025-10-02T22:41:20.624722] [INFO ] [MAIN ] MIN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:20.648151] [DEBUG] [MAIN ] MHO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:20.668416] [INFO ] [MAIN ] MHO: Generated 1807 derivative records from 24076 primary records. [2025-10-02T22:41:20.669226] [DEBUG] [MAIN ] MHK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:20.670716] [DEBUG] [LOCAL ] MHO: Saving derivative data. [2025-10-02T22:41:20.670515] [INFO ] [MAIN ] MHK: Generated 1807 derivative records from 42458 primary records. [2025-10-02T22:41:20.672380] [DEBUG] [LOCAL ] MHK: Saving derivative data. [2025-10-02T22:41:20.707381] [DEBUG] [LOCAL ] MHO: Derivative data saved (1807 records). [2025-10-02T22:41:20.714725] [INFO ] [MAIN ] MHO: Successfully saved derivative data. [2025-10-02T22:41:20.713852] [DEBUG] [LOCAL ] MIN: Loaded 13399 existing records from primary storage. [2025-10-02T22:41:20.720876] [INFO ] [MAIN ] Derivative Progress: 1076/1975 symbols completed. MHO took 1.3s. Estimated remaining: 6m 17s. Rate: 143.0 symbols/min [2025-10-02T22:41:20.721483] [INFO ] [MAIN ] MIN: Loaded 13399 primary data records. [2025-10-02T22:41:20.718148] [DEBUG] [LOCAL ] MHK: Derivative data saved (1807 records). [2025-10-02T22:41:20.721348] [INFO ] [MAIN ] MIR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:20.734040] [INFO ] [MAIN ] MHK: Successfully saved derivative data. [2025-10-02T22:41:20.737661] [INFO ] [MAIN ] Derivative Progress: 1077/1975 symbols completed. MHK took 1.3s. Estimated remaining: 6m 16s. Rate: 143.2 symbols/min [2025-10-02T22:41:20.749118] [INFO ] [MAIN ] MITP: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:20.837476] [DEBUG] [LOCAL ] MITP: Loaded 2411 existing records from primary storage. [2025-10-02T22:41:20.837676] [INFO ] [MAIN ] MITP: Loaded 2411 primary data records. [2025-10-02T22:41:21.330520] [DEBUG] [LOCAL ] MIR: Loaded 51410 existing records from primary storage. [2025-10-02T22:41:21.331427] [INFO ] [MAIN ] MIR: Loaded 51410 primary data records. [2025-10-02T22:41:21.931188] [DEBUG] [MAIN ] MIN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:21.933064] [INFO ] [MAIN ] MIN: Generated 1807 derivative records from 13399 primary records. [2025-10-02T22:41:21.933444] [DEBUG] [LOCAL ] MIN: Saving derivative data. [2025-10-02T22:41:21.979965] [DEBUG] [LOCAL ] MIN: Derivative data saved (1807 records). [2025-10-02T22:41:21.982633] [INFO ] [MAIN ] MIN: Successfully saved derivative data. [2025-10-02T22:41:21.987079] [INFO ] [MAIN ] Derivative Progress: 1078/1975 symbols completed. MIN took 1.4s. Estimated remaining: 6m 17s. Rate: 142.9 symbols/min [2025-10-02T22:41:21.983532] [DEBUG] [MAIN ] MITP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:21.989494] [INFO ] [MAIN ] MITP: Generated 1807 derivative records from 2411 primary records. [2025-10-02T22:41:21.990023] [DEBUG] [LOCAL ] MITP: Saving derivative data. [2025-10-02T22:41:22.007583] [DEBUG] [LOCAL ] MITP: Derivative data saved (1807 records). [2025-10-02T22:41:22.009036] [INFO ] [MAIN ] MITP: Successfully saved derivative data. [2025-10-02T22:41:22.011519] [INFO ] [MAIN ] Derivative Progress: 1079/1975 symbols completed. MITP took 1.3s. Estimated remaining: 6m 16s. Rate: 143.0 symbols/min [2025-10-02T22:41:22.026697] [DEBUG] [MAIN ] MIR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:22.027528] [INFO ] [MAIN ] MIR: Generated 1807 derivative records from 51410 primary records. [2025-10-02T22:41:22.027595] [DEBUG] [LOCAL ] MIR: Saving derivative data. [2025-10-02T22:41:22.044457] [DEBUG] [LOCAL ] MIR: Derivative data saved (1807 records). [2025-10-02T22:41:22.044533] [INFO ] [MAIN ] MIR: Successfully saved derivative data. [2025-10-02T22:41:22.047569] [INFO ] [MAIN ] Derivative Progress: 1080/1975 symbols completed. MIR took 1.3s. Estimated remaining: 6m 15s. Rate: 143.1 symbols/min [2025-10-02T22:41:22.048554] [INFO ] [MAIN ] MITT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:22.048759] [INFO ] [MAIN ] MIY: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:22.048897] [INFO ] [MAIN ] MKC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:22.061915] [DEBUG] [LOCAL ] MIY: Loaded 6023 existing records from primary storage. [2025-10-02T22:41:22.062247] [INFO ] [MAIN ] MIY: Loaded 6023 primary data records. [2025-10-02T22:41:22.193413] [DEBUG] [LOCAL ] MITT: Loaded 23090 existing records from primary storage. [2025-10-02T22:41:22.218513] [INFO ] [MAIN ] MITT: Loaded 23090 primary data records. [2025-10-02T22:41:22.579050] [DEBUG] [LOCAL ] MKC: Loaded 52828 existing records from primary storage. [2025-10-02T22:41:22.590223] [INFO ] [MAIN ] MKC: Loaded 52828 primary data records. [2025-10-02T22:41:23.136594] [DEBUG] [MAIN ] MIY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:23.139452] [INFO ] [MAIN ] MIY: Generated 1807 derivative records from 6023 primary records. [2025-10-02T22:41:23.139744] [DEBUG] [LOCAL ] MIY: Saving derivative data. [2025-10-02T22:41:23.175596] [DEBUG] [MAIN ] MITT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:23.177187] [INFO ] [MAIN ] MITT: Generated 1807 derivative records from 23090 primary records. [2025-10-02T22:41:23.178069] [DEBUG] [LOCAL ] MITT: Saving derivative data. [2025-10-02T22:41:23.195968] [DEBUG] [LOCAL ] MIY: Derivative data saved (1807 records). [2025-10-02T22:41:23.206072] [INFO ] [MAIN ] MIY: Successfully saved derivative data. [2025-10-02T22:41:23.211954] [DEBUG] [MAIN ] MKC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:23.215868] [INFO ] [MAIN ] MKC: Generated 1807 derivative records from 52828 primary records. [2025-10-02T22:41:23.214850] [INFO ] [MAIN ] Derivative Progress: 1081/1975 symbols completed. MIY took 1.2s. Estimated remaining: 6m 15s. Rate: 142.9 symbols/min [2025-10-02T22:41:23.216876] [DEBUG] [LOCAL ] MKC: Saving derivative data. [2025-10-02T22:41:23.218572] [DEBUG] [LOCAL ] MITT: Derivative data saved (1807 records). [2025-10-02T22:41:23.219696] [INFO ] [MAIN ] MITT: Successfully saved derivative data. [2025-10-02T22:41:23.222694] [INFO ] [MAIN ] MKL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:23.222814] [INFO ] [MAIN ] Derivative Progress: 1082/1975 symbols completed. MITT took 1.2s. Estimated remaining: 6m 15s. Rate: 143.0 symbols/min [2025-10-02T22:41:23.235472] [INFO ] [MAIN ] MLI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:23.241700] [DEBUG] [LOCAL ] MKC: Derivative data saved (1807 records). [2025-10-02T22:41:23.241991] [INFO ] [MAIN ] MKC: Successfully saved derivative data. [2025-10-02T22:41:23.244524] [INFO ] [MAIN ] Derivative Progress: 1083/1975 symbols completed. MKC took 1.2s. Estimated remaining: 6m 14s. Rate: 143.2 symbols/min [2025-10-02T22:41:23.244832] [INFO ] [MAIN ] MLM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:23.319863] [DEBUG] [LOCAL ] MKL: Loaded 34273 existing records from primary storage. [2025-10-02T22:41:23.321498] [DEBUG] [LOCAL ] MLI: Loaded 43830 existing records from primary storage. [2025-10-02T22:41:23.321699] [INFO ] [MAIN ] MKL: Loaded 34273 primary data records. [2025-10-02T22:41:23.322040] [INFO ] [MAIN ] MLI: Loaded 43830 primary data records. [2025-10-02T22:41:23.423372] [DEBUG] [LOCAL ] MLM: Loaded 30160 existing records from primary storage. [2025-10-02T22:41:23.428758] [INFO ] [MAIN ] MLM: Loaded 30160 primary data records. [2025-10-02T22:41:24.490049] [DEBUG] [MAIN ] MKL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:24.491468] [DEBUG] [MAIN ] MLI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:24.494716] [INFO ] [MAIN ] MKL: Generated 1807 derivative records from 34273 primary records. [2025-10-02T22:41:24.493058] [INFO ] [MAIN ] MLI: Generated 1807 derivative records from 43830 primary records. [2025-10-02T22:41:24.494870] [DEBUG] [LOCAL ] MLI: Saving derivative data. [2025-10-02T22:41:24.494936] [DEBUG] [LOCAL ] MKL: Saving derivative data. [2025-10-02T22:41:24.531701] [DEBUG] [LOCAL ] MKL: Derivative data saved (1807 records). [2025-10-02T22:41:24.547372] [DEBUG] [MAIN ] MLM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:24.548561] [INFO ] [MAIN ] MLM: Generated 1807 derivative records from 30160 primary records. [2025-10-02T22:41:24.547034] [INFO ] [MAIN ] MKL: Successfully saved derivative data. [2025-10-02T22:41:24.549349] [DEBUG] [LOCAL ] MLM: Saving derivative data. [2025-10-02T22:41:24.549229] [DEBUG] [LOCAL ] MLI: Derivative data saved (1807 records). [2025-10-02T22:41:24.551603] [INFO ] [MAIN ] Derivative Progress: 1084/1975 symbols completed. MKL took 1.3s. Estimated remaining: 6m 14s. Rate: 142.9 symbols/min [2025-10-02T22:41:24.552814] [INFO ] [MAIN ] MLNK: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:24.552633] [INFO ] [MAIN ] MLI: Successfully saved derivative data. [2025-10-02T22:41:24.566419] [INFO ] [MAIN ] Derivative Progress: 1085/1975 symbols completed. MLI took 1.3s. Estimated remaining: 6m 13s. Rate: 143.0 symbols/min [2025-10-02T22:41:24.571133] [INFO ] [MAIN ] MLP: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:24.578307] [DEBUG] [LOCAL ] MLM: Derivative data saved (1807 records). [2025-10-02T22:41:24.578813] [INFO ] [MAIN ] MLM: Successfully saved derivative data. [2025-10-02T22:41:24.581920] [INFO ] [MAIN ] Derivative Progress: 1086/1975 symbols completed. MLM took 1.3s. Estimated remaining: 6m 13s. Rate: 143.1 symbols/min [2025-10-02T22:41:24.583006] [INFO ] [MAIN ] MLR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:24.586798] [DEBUG] [LOCAL ] MLP: Loaded 3007 existing records from primary storage. [2025-10-02T22:41:24.587128] [INFO ] [MAIN ] MLP: Loaded 3007 primary data records. [2025-10-02T22:41:24.725260] [DEBUG] [LOCAL ] MLR: Loaded 12560 existing records from primary storage. [2025-10-02T22:41:24.732433] [DEBUG] [LOCAL ] MLNK: Loaded 25666 existing records from primary storage. [2025-10-02T22:41:24.732967] [INFO ] [MAIN ] MLR: Loaded 12560 primary data records. [2025-10-02T22:41:24.764220] [INFO ] [MAIN ] MLNK: Loaded 25666 primary data records. [2025-10-02T22:41:25.623480] [DEBUG] [MAIN ] MLP: Filtered 6966 bins outside market hours, 7761 incomplete bins [2025-10-02T22:41:25.624686] [INFO ] [MAIN ] MLP: Generated 1805 derivative records from 3007 primary records. [2025-10-02T22:41:25.624796] [DEBUG] [LOCAL ] MLP: Saving derivative data. [2025-10-02T22:41:25.653509] [DEBUG] [LOCAL ] MLP: Derivative data saved (1805 records). [2025-10-02T22:41:25.660193] [INFO ] [MAIN ] MLP: Successfully saved derivative data. [2025-10-02T22:41:25.662556] [INFO ] [MAIN ] Derivative Progress: 1087/1975 symbols completed. MLP took 1.1s. Estimated remaining: 6m 13s. Rate: 142.9 symbols/min [2025-10-02T22:41:25.660130] [DEBUG] [MAIN ] MLR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:25.663710] [INFO ] [MAIN ] MLR: Generated 1807 derivative records from 12560 primary records. [2025-10-02T22:41:25.663992] [INFO ] [MAIN ] MMC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:25.664052] [DEBUG] [LOCAL ] MLR: Saving derivative data. [2025-10-02T22:41:25.686513] [DEBUG] [MAIN ] MLNK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:25.691239] [INFO ] [MAIN ] MLNK: Generated 1807 derivative records from 25666 primary records. [2025-10-02T22:41:25.693473] [DEBUG] [LOCAL ] MLNK: Saving derivative data. [2025-10-02T22:41:25.696629] [DEBUG] [LOCAL ] MLR: Derivative data saved (1807 records). [2025-10-02T22:41:25.703883] [INFO ] [MAIN ] MLR: Successfully saved derivative data. [2025-10-02T22:41:25.706743] [INFO ] [MAIN ] Derivative Progress: 1088/1975 symbols completed. MLR took 1.1s. Estimated remaining: 6m 12s. Rate: 143.0 symbols/min [2025-10-02T22:41:25.708177] [INFO ] [MAIN ] MMD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:25.717184] [DEBUG] [LOCAL ] MLNK: Derivative data saved (1807 records). [2025-10-02T22:41:25.717397] [INFO ] [MAIN ] MLNK: Successfully saved derivative data. [2025-10-02T22:41:25.720089] [INFO ] [MAIN ] Derivative Progress: 1089/1975 symbols completed. MLNK took 1.2s. Estimated remaining: 6m 11s. Rate: 143.2 symbols/min [2025-10-02T22:41:25.723818] [INFO ] [MAIN ] MMI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:25.731012] [DEBUG] [LOCAL ] MMD: Loaded 11435 existing records from primary storage. [2025-10-02T22:41:25.731465] [INFO ] [MAIN ] MMD: Loaded 11435 primary data records. [2025-10-02T22:41:25.883140] [DEBUG] [LOCAL ] MMI: Loaded 15236 existing records from primary storage. [2025-10-02T22:41:25.921027] [INFO ] [MAIN ] MMI: Loaded 15236 primary data records. [2025-10-02T22:41:26.018086] [DEBUG] [LOCAL ] MMC: Loaded 52173 existing records from primary storage. [2025-10-02T22:41:26.059113] [INFO ] [MAIN ] MMC: Loaded 52173 primary data records. [2025-10-02T22:41:26.838006] [DEBUG] [MAIN ] MMD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:26.839514] [INFO ] [MAIN ] MMD: Generated 1807 derivative records from 11435 primary records. [2025-10-02T22:41:26.840774] [DEBUG] [LOCAL ] MMD: Saving derivative data. [2025-10-02T22:41:26.872453] [DEBUG] [MAIN ] MMI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:26.875621] [INFO ] [MAIN ] MMI: Generated 1807 derivative records from 15236 primary records. [2025-10-02T22:41:26.875718] [DEBUG] [LOCAL ] MMI: Saving derivative data. [2025-10-02T22:41:26.899984] [DEBUG] [LOCAL ] MMI: Derivative data saved (1807 records). [2025-10-02T22:41:26.901111] [DEBUG] [LOCAL ] MMD: Derivative data saved (1807 records). [2025-10-02T22:41:26.901266] [INFO ] [MAIN ] MMI: Successfully saved derivative data. [2025-10-02T22:41:26.901515] [INFO ] [MAIN ] MMD: Successfully saved derivative data. [2025-10-02T22:41:26.904362] [INFO ] [MAIN ] Derivative Progress: 1090/1975 symbols completed. MMI took 1.2s. Estimated remaining: 6m 11s. Rate: 142.9 symbols/min [2025-10-02T22:41:26.915090] [INFO ] [MAIN ] MMM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:26.920364] [INFO ] [MAIN ] Derivative Progress: 1091/1975 symbols completed. MMD took 1.2s. Estimated remaining: 6m 11s. Rate: 143.1 symbols/min [2025-10-02T22:41:26.921284] [INFO ] [MAIN ] MMS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:26.921733] [DEBUG] [MAIN ] MMC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:26.922625] [INFO ] [MAIN ] MMC: Generated 1807 derivative records from 52173 primary records. [2025-10-02T22:41:26.922730] [DEBUG] [LOCAL ] MMC: Saving derivative data. [2025-10-02T22:41:26.942166] [DEBUG] [LOCAL ] MMC: Derivative data saved (1807 records). [2025-10-02T22:41:26.942576] [INFO ] [MAIN ] MMC: Successfully saved derivative data. [2025-10-02T22:41:26.945242] [INFO ] [MAIN ] Derivative Progress: 1092/1975 symbols completed. MMC took 1.3s. Estimated remaining: 6m 10s. Rate: 143.2 symbols/min [2025-10-02T22:41:26.945692] [INFO ] [MAIN ] MMT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:26.974526] [DEBUG] [LOCAL ] MMS: Loaded 34135 existing records from primary storage. [2025-10-02T22:41:26.989009] [INFO ] [MAIN ] MMS: Loaded 34135 primary data records. [2025-10-02T22:41:27.017186] [DEBUG] [LOCAL ] MMT: Loaded 10865 existing records from primary storage. [2025-10-02T22:41:27.042756] [INFO ] [MAIN ] MMT: Loaded 10865 primary data records. [2025-10-02T22:41:27.216238] [DEBUG] [LOCAL ] MMM: Loaded 53550 existing records from primary storage. [2025-10-02T22:41:27.262747] [INFO ] [MAIN ] MMM: Loaded 53550 primary data records. [2025-10-02T22:41:28.061012] [DEBUG] [MAIN ] MMS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:28.062370] [INFO ] [MAIN ] MMS: Generated 1807 derivative records from 34135 primary records. [2025-10-02T22:41:28.063710] [DEBUG] [LOCAL ] MMS: Saving derivative data. [2025-10-02T22:41:28.108317] [DEBUG] [MAIN ] MMT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:28.109569] [INFO ] [MAIN ] MMT: Generated 1807 derivative records from 10865 primary records. [2025-10-02T22:41:28.109893] [DEBUG] [LOCAL ] MMT: Saving derivative data. [2025-10-02T22:41:28.110162] [DEBUG] [MAIN ] MMM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:28.112635] [INFO ] [MAIN ] MMM: Generated 1807 derivative records from 53550 primary records. [2025-10-02T22:41:28.119720] [DEBUG] [LOCAL ] MMM: Saving derivative data. [2025-10-02T22:41:28.136885] [DEBUG] [LOCAL ] MMS: Derivative data saved (1807 records). [2025-10-02T22:41:28.141144] [INFO ] [MAIN ] MMS: Successfully saved derivative data. [2025-10-02T22:41:28.144509] [INFO ] [MAIN ] Derivative Progress: 1093/1975 symbols completed. MMS took 1.2s. Estimated remaining: 6m 10s. Rate: 142.9 symbols/min [2025-10-02T22:41:28.147628] [DEBUG] [LOCAL ] MMT: Derivative data saved (1807 records). [2025-10-02T22:41:28.148242] [INFO ] [MAIN ] MMT: Successfully saved derivative data. [2025-10-02T22:41:28.151385] [INFO ] [MAIN ] Derivative Progress: 1094/1975 symbols completed. MMT took 1.2s. Estimated remaining: 6m 9s. Rate: 143.1 symbols/min [2025-10-02T22:41:28.153909] [DEBUG] [LOCAL ] MMM: Derivative data saved (1807 records). [2025-10-02T22:41:28.153998] [INFO ] [MAIN ] MMM: Successfully saved derivative data. [2025-10-02T22:41:28.156254] [INFO ] [MAIN ] Derivative Progress: 1095/1975 symbols completed. MMM took 1.2s. Estimated remaining: 6m 9s. Rate: 143.2 symbols/min [2025-10-02T22:41:28.156723] [INFO ] [MAIN ] MMU: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:28.157266] [INFO ] [MAIN ] MNR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:28.157358] [INFO ] [MAIN ] MNSO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:28.183098] [DEBUG] [LOCAL ] MMU: Loaded 16945 existing records from primary storage. [2025-10-02T22:41:28.183368] [INFO ] [MAIN ] MMU: Loaded 16945 primary data records. [2025-10-02T22:41:28.295115] [DEBUG] [LOCAL ] MNR: Loaded 24586 existing records from primary storage. [2025-10-02T22:41:28.330116] [INFO ] [MAIN ] MNR: Loaded 24586 primary data records. [2025-10-02T22:41:28.374305] [DEBUG] [LOCAL ] MNSO: Loaded 44754 existing records from primary storage. [2025-10-02T22:41:28.418493] [INFO ] [MAIN ] MNSO: Loaded 44754 primary data records. [2025-10-02T22:41:29.301804] [DEBUG] [MAIN ] MMU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:29.303011] [INFO ] [MAIN ] MMU: Generated 1807 derivative records from 16945 primary records. [2025-10-02T22:41:29.303321] [DEBUG] [LOCAL ] MMU: Saving derivative data. [2025-10-02T22:41:29.339380] [DEBUG] [MAIN ] MNR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:29.342850] [INFO ] [MAIN ] MNR: Generated 1807 derivative records from 24586 primary records. [2025-10-02T22:41:29.343392] [DEBUG] [LOCAL ] MNR: Saving derivative data. [2025-10-02T22:41:29.344974] [DEBUG] [LOCAL ] MMU: Derivative data saved (1807 records). [2025-10-02T22:41:29.345473] [INFO ] [MAIN ] MMU: Successfully saved derivative data. [2025-10-02T22:41:29.347898] [INFO ] [MAIN ] Derivative Progress: 1096/1975 symbols completed. MMU took 1.2s. Estimated remaining: 6m 9s. Rate: 143.0 symbols/min [2025-10-02T22:41:29.348155] [INFO ] [MAIN ] MOD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:29.379399] [DEBUG] [MAIN ] MNSO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:29.387595] [INFO ] [MAIN ] MNSO: Generated 1807 derivative records from 44754 primary records. [2025-10-02T22:41:29.389047] [DEBUG] [LOCAL ] MNSO: Saving derivative data. [2025-10-02T22:41:29.388833] [DEBUG] [LOCAL ] MNR: Derivative data saved (1807 records). [2025-10-02T22:41:29.389356] [INFO ] [MAIN ] MNR: Successfully saved derivative data. [2025-10-02T22:41:29.393525] [INFO ] [MAIN ] Derivative Progress: 1097/1975 symbols completed. MNR took 1.2s. Estimated remaining: 6m 8s. Rate: 143.1 symbols/min [2025-10-02T22:41:29.393856] [INFO ] [MAIN ] MODG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:29.420723] [DEBUG] [LOCAL ] MNSO: Derivative data saved (1807 records). [2025-10-02T22:41:29.420919] [INFO ] [MAIN ] MNSO: Successfully saved derivative data. [2025-10-02T22:41:29.423720] [INFO ] [MAIN ] Derivative Progress: 1098/1975 symbols completed. MNSO took 1.3s. Estimated remaining: 6m 7s. Rate: 143.2 symbols/min [2025-10-02T22:41:29.424086] [INFO ] [MAIN ] MOH: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:29.471845] [DEBUG] [LOCAL ] MOD: Loaded 45531 existing records from primary storage. [2025-10-02T22:41:29.472057] [INFO ] [MAIN ] MOD: Loaded 45531 primary data records. [2025-10-02T22:41:29.636109] [DEBUG] [LOCAL ] MODG: Loaded 51905 existing records from primary storage. [2025-10-02T22:41:29.677217] [INFO ] [MAIN ] MODG: Loaded 51905 primary data records. [2025-10-02T22:41:29.703825] [DEBUG] [LOCAL ] MOH: Loaded 42055 existing records from primary storage. [2025-10-02T22:41:29.852795] [INFO ] [MAIN ] MOH: Loaded 42055 primary data records. [2025-10-02T22:41:30.626508] [DEBUG] [MAIN ] MOD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:30.627946] [INFO ] [MAIN ] MOD: Generated 1807 derivative records from 45531 primary records. [2025-10-02T22:41:30.629021] [DEBUG] [LOCAL ] MOD: Saving derivative data. [2025-10-02T22:41:30.688126] [DEBUG] [MAIN ] MOH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:30.690595] [INFO ] [MAIN ] MOH: Generated 1807 derivative records from 42055 primary records. [2025-10-02T22:41:30.688947] [DEBUG] [MAIN ] MODG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:30.692012] [DEBUG] [LOCAL ] MOD: Derivative data saved (1807 records). [2025-10-02T22:41:30.693091] [DEBUG] [LOCAL ] MOH: Saving derivative data. [2025-10-02T22:41:30.693010] [INFO ] [MAIN ] MODG: Generated 1807 derivative records from 51905 primary records. [2025-10-02T22:41:30.694077] [INFO ] [MAIN ] MOD: Successfully saved derivative data. [2025-10-02T22:41:30.694929] [DEBUG] [LOCAL ] MODG: Saving derivative data. [2025-10-02T22:41:30.698486] [INFO ] [MAIN ] Derivative Progress: 1099/1975 symbols completed. MOD took 1.4s. Estimated remaining: 6m 8s. Rate: 142.9 symbols/min [2025-10-02T22:41:30.711609] [INFO ] [MAIN ] MOS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:30.734996] [DEBUG] [LOCAL ] MODG: Derivative data saved (1807 records). [2025-10-02T22:41:30.735207] [INFO ] [MAIN ] MODG: Successfully saved derivative data. [2025-10-02T22:41:30.734568] [DEBUG] [LOCAL ] MOH: Derivative data saved (1807 records). [2025-10-02T22:41:30.738322] [INFO ] [MAIN ] Derivative Progress: 1100/1975 symbols completed. MODG took 1.3s. Estimated remaining: 6m 7s. Rate: 143.0 symbols/min [2025-10-02T22:41:30.738714] [INFO ] [MAIN ] MOV: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:30.738596] [INFO ] [MAIN ] MOH: Successfully saved derivative data. [2025-10-02T22:41:30.742177] [INFO ] [MAIN ] Derivative Progress: 1101/1975 symbols completed. MOH took 1.3s. Estimated remaining: 6m 6s. Rate: 143.2 symbols/min [2025-10-02T22:41:30.742526] [INFO ] [MAIN ] MPA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:30.775280] [DEBUG] [LOCAL ] MPA: Loaded 5304 existing records from primary storage. [2025-10-02T22:41:30.775538] [INFO ] [MAIN ] MPA: Loaded 5304 primary data records. [2025-10-02T22:41:30.882897] [DEBUG] [LOCAL ] MOV: Loaded 22121 existing records from primary storage. [2025-10-02T22:41:30.913888] [DEBUG] [LOCAL ] MOS: Loaded 53889 existing records from primary storage. [2025-10-02T22:41:30.928666] [INFO ] [MAIN ] MOS: Loaded 53889 primary data records. [2025-10-02T22:41:30.912500] [INFO ] [MAIN ] MOV: Loaded 22121 primary data records. [2025-10-02T22:41:31.866212] [DEBUG] [MAIN ] MPA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:31.868165] [INFO ] [MAIN ] MPA: Generated 1807 derivative records from 5304 primary records. [2025-10-02T22:41:31.868592] [DEBUG] [LOCAL ] MPA: Saving derivative data. [2025-10-02T22:41:31.894833] [DEBUG] [MAIN ] MOS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:31.896316] [INFO ] [MAIN ] MOS: Generated 1807 derivative records from 53889 primary records. [2025-10-02T22:41:31.896864] [DEBUG] [LOCAL ] MOS: Saving derivative data. [2025-10-02T22:41:31.917237] [DEBUG] [LOCAL ] MPA: Derivative data saved (1807 records). [2025-10-02T22:41:31.918889] [INFO ] [MAIN ] MPA: Successfully saved derivative data. [2025-10-02T22:41:31.921134] [INFO ] [MAIN ] Derivative Progress: 1102/1975 symbols completed. MPA took 1.2s. Estimated remaining: 6m 6s. Rate: 142.9 symbols/min [2025-10-02T22:41:31.921666] [INFO ] [MAIN ] MPC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:31.936317] [DEBUG] [MAIN ] MOV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:31.938154] [INFO ] [MAIN ] MOV: Generated 1807 derivative records from 22121 primary records. [2025-10-02T22:41:31.938533] [DEBUG] [LOCAL ] MOV: Saving derivative data. [2025-10-02T22:41:31.939982] [DEBUG] [LOCAL ] MOS: Derivative data saved (1807 records). [2025-10-02T22:41:31.940199] [INFO ] [MAIN ] MOS: Successfully saved derivative data. [2025-10-02T22:41:31.942958] [INFO ] [MAIN ] Derivative Progress: 1103/1975 symbols completed. MOS took 1.2s. Estimated remaining: 6m 6s. Rate: 143.1 symbols/min [2025-10-02T22:41:31.952012] [INFO ] [MAIN ] MPLX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:31.960628] [DEBUG] [LOCAL ] MOV: Derivative data saved (1807 records). [2025-10-02T22:41:31.960737] [INFO ] [MAIN ] MOV: Successfully saved derivative data. [2025-10-02T22:41:31.963062] [INFO ] [MAIN ] Derivative Progress: 1104/1975 symbols completed. MOV took 1.2s. Estimated remaining: 6m 5s. Rate: 143.2 symbols/min [2025-10-02T22:41:31.963380] [INFO ] [MAIN ] MPV: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:31.972508] [DEBUG] [LOCAL ] MPV: Loaded 4975 existing records from primary storage. [2025-10-02T22:41:31.972638] [INFO ] [MAIN ] MPV: Loaded 4975 primary data records. [2025-10-02T22:41:32.244553] [DEBUG] [LOCAL ] MPC: Loaded 52458 existing records from primary storage. [2025-10-02T22:41:32.358793] [INFO ] [MAIN ] MPC: Loaded 52458 primary data records. [2025-10-02T22:41:32.358688] [DEBUG] [LOCAL ] MPLX: Loaded 51112 existing records from primary storage. [2025-10-02T22:41:32.368485] [INFO ] [MAIN ] MPLX: Loaded 51112 primary data records. [2025-10-02T22:41:33.107904] [DEBUG] [MAIN ] MPV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:33.109693] [INFO ] [MAIN ] MPV: Generated 1807 derivative records from 4975 primary records. [2025-10-02T22:41:33.110149] [DEBUG] [LOCAL ] MPV: Saving derivative data. [2025-10-02T22:41:33.131997] [DEBUG] [LOCAL ] MPV: Derivative data saved (1807 records). [2025-10-02T22:41:33.132337] [INFO ] [MAIN ] MPV: Successfully saved derivative data. [2025-10-02T22:41:33.135178] [INFO ] [MAIN ] Derivative Progress: 1105/1975 symbols completed. MPV took 1.2s. Estimated remaining: 6m 5s. Rate: 143.0 symbols/min [2025-10-02T22:41:33.135892] [INFO ] [MAIN ] MPW: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:33.153768] [DEBUG] [MAIN ] MPC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:33.154953] [INFO ] [MAIN ] MPC: Generated 1807 derivative records from 52458 primary records. [2025-10-02T22:41:33.156786] [DEBUG] [LOCAL ] MPC: Saving derivative data. [2025-10-02T22:41:33.184594] [DEBUG] [MAIN ] MPLX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:33.186406] [INFO ] [MAIN ] MPLX: Generated 1807 derivative records from 51112 primary records. [2025-10-02T22:41:33.186553] [DEBUG] [LOCAL ] MPLX: Saving derivative data. [2025-10-02T22:41:33.211054] [DEBUG] [LOCAL ] MPLX: Derivative data saved (1807 records). [2025-10-02T22:41:33.212067] [INFO ] [MAIN ] MPLX: Successfully saved derivative data. [2025-10-02T22:41:33.214609] [INFO ] [MAIN ] Derivative Progress: 1106/1975 symbols completed. MPLX took 1.3s. Estimated remaining: 6m 4s. Rate: 143.1 symbols/min [2025-10-02T22:41:33.215724] [DEBUG] [LOCAL ] MPC: Derivative data saved (1807 records). [2025-10-02T22:41:33.215990] [INFO ] [MAIN ] MPC: Successfully saved derivative data. [2025-10-02T22:41:33.219054] [INFO ] [MAIN ] Derivative Progress: 1107/1975 symbols completed. MPC took 1.3s. Estimated remaining: 6m 4s. Rate: 143.2 symbols/min [2025-10-02T22:41:33.215607] [INFO ] [MAIN ] MPX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:33.219794] [INFO ] [MAIN ] MQT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:33.240306] [DEBUG] [LOCAL ] MPX: Loaded 4077 existing records from primary storage. [2025-10-02T22:41:33.242569] [INFO ] [MAIN ] MPX: Loaded 4077 primary data records. [2025-10-02T22:41:33.295791] [DEBUG] [LOCAL ] MQT: Loaded 8739 existing records from primary storage. [2025-10-02T22:41:33.332358] [INFO ] [MAIN ] MQT: Loaded 8739 primary data records. [2025-10-02T22:41:33.406590] [DEBUG] [LOCAL ] MPW: Loaded 53885 existing records from primary storage. [2025-10-02T22:41:33.461112] [INFO ] [MAIN ] MPW: Loaded 53885 primary data records. [2025-10-02T22:41:34.326738] [DEBUG] [MAIN ] MPX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:34.328172] [INFO ] [MAIN ] MPX: Generated 1807 derivative records from 4077 primary records. [2025-10-02T22:41:34.329179] [DEBUG] [LOCAL ] MPX: Saving derivative data. [2025-10-02T22:41:34.364073] [DEBUG] [LOCAL ] MPX: Derivative data saved (1807 records). [2025-10-02T22:41:34.364899] [INFO ] [MAIN ] MPX: Successfully saved derivative data. [2025-10-02T22:41:34.367393] [INFO ] [MAIN ] Derivative Progress: 1108/1975 symbols completed. MPX took 1.2s. Estimated remaining: 6m 4s. Rate: 143.0 symbols/min [2025-10-02T22:41:34.364716] [DEBUG] [MAIN ] MQT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:34.369163] [INFO ] [MAIN ] MQT: Generated 1807 derivative records from 8739 primary records. [2025-10-02T22:41:34.369609] [DEBUG] [LOCAL ] MQT: Saving derivative data. [2025-10-02T22:41:34.407715] [DEBUG] [LOCAL ] MQT: Derivative data saved (1807 records). [2025-10-02T22:41:34.408163] [INFO ] [MAIN ] MQT: Successfully saved derivative data. [2025-10-02T22:41:34.411044] [INFO ] [MAIN ] Derivative Progress: 1109/1975 symbols completed. MQT took 1.2s. Estimated remaining: 6m 3s. Rate: 143.1 symbols/min [2025-10-02T22:41:34.411682] [DEBUG] [MAIN ] MPW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:34.412788] [INFO ] [MAIN ] MPW: Generated 1807 derivative records from 53885 primary records. [2025-10-02T22:41:34.412879] [DEBUG] [LOCAL ] MPW: Saving derivative data. [2025-10-02T22:41:34.438313] [DEBUG] [LOCAL ] MPW: Derivative data saved (1807 records). [2025-10-02T22:41:34.438501] [INFO ] [MAIN ] MPW: Successfully saved derivative data. [2025-10-02T22:41:34.442442] [INFO ] [MAIN ] Derivative Progress: 1110/1975 symbols completed. MPW took 1.3s. Estimated remaining: 6m 2s. Rate: 143.2 symbols/min [2025-10-02T22:41:34.443113] [INFO ] [MAIN ] MRC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:34.443027] [INFO ] [MAIN ] MQY: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:34.443295] [INFO ] [MAIN ] MS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:34.471982] [DEBUG] [LOCAL ] MQY: Loaded 17140 existing records from primary storage. [2025-10-02T22:41:34.472133] [INFO ] [MAIN ] MQY: Loaded 17140 primary data records. [2025-10-02T22:41:34.657177] [DEBUG] [LOCAL ] MRC: Loaded 37651 existing records from primary storage. [2025-10-02T22:41:34.694688] [INFO ] [MAIN ] MRC: Loaded 37651 primary data records. [2025-10-02T22:41:35.059029] [DEBUG] [LOCAL ] MS: Loaded 54081 existing records from primary storage. [2025-10-02T22:41:35.125228] [INFO ] [MAIN ] MS: Loaded 54081 primary data records. [2025-10-02T22:41:35.431711] [DEBUG] [MAIN ] MQY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:35.579424] [INFO ] [MAIN ] MQY: Generated 1807 derivative records from 17140 primary records. [2025-10-02T22:41:35.594181] [DEBUG] [LOCAL ] MQY: Saving derivative data. [2025-10-02T22:41:35.618939] [DEBUG] [LOCAL ] MQY: Derivative data saved (1807 records). [2025-10-02T22:41:35.631855] [INFO ] [MAIN ] MQY: Successfully saved derivative data. [2025-10-02T22:41:35.635205] [INFO ] [MAIN ] Derivative Progress: 1111/1975 symbols completed. MQY took 1.2s. Estimated remaining: 6m 3s. Rate: 143.0 symbols/min [2025-10-02T22:41:35.636286] [DEBUG] [MAIN ] MRC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:35.635810] [INFO ] [MAIN ] MSA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:35.637264] [INFO ] [MAIN ] MRC: Generated 1807 derivative records from 37651 primary records. [2025-10-02T22:41:35.637500] [DEBUG] [LOCAL ] MRC: Saving derivative data. [2025-10-02T22:41:35.660317] [DEBUG] [LOCAL ] MRC: Derivative data saved (1807 records). [2025-10-02T22:41:35.660615] [INFO ] [MAIN ] MRC: Successfully saved derivative data. [2025-10-02T22:41:35.663275] [INFO ] [MAIN ] Derivative Progress: 1112/1975 symbols completed. MRC took 1.2s. Estimated remaining: 6m 2s. Rate: 143.1 symbols/min [2025-10-02T22:41:35.663619] [INFO ] [MAIN ] MSB: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:35.685032] [DEBUG] [MAIN ] MS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:35.685931] [INFO ] [MAIN ] MS: Generated 1807 derivative records from 54081 primary records. [2025-10-02T22:41:35.688144] [DEBUG] [LOCAL ] MS: Saving derivative data. [2025-10-02T22:41:35.708151] [DEBUG] [LOCAL ] MSB: Loaded 7883 existing records from primary storage. [2025-10-02T22:41:35.713210] [DEBUG] [LOCAL ] MSA: Loaded 19007 existing records from primary storage. [2025-10-02T22:41:35.713361] [INFO ] [MAIN ] MSA: Loaded 19007 primary data records. [2025-10-02T22:41:35.713497] [INFO ] [MAIN ] MSB: Loaded 7883 primary data records. [2025-10-02T22:41:35.917884] [DEBUG] [LOCAL ] MS: Derivative data saved (1807 records). [2025-10-02T22:41:35.926549] [INFO ] [MAIN ] MS: Successfully saved derivative data. [2025-10-02T22:41:35.947065] [INFO ] [MAIN ] Derivative Progress: 1113/1975 symbols completed. MS took 1.5s. Estimated remaining: 6m 1s. Rate: 143.1 symbols/min [2025-10-02T22:41:35.980525] [INFO ] [MAIN ] MSCI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:36.419082] [DEBUG] [LOCAL ] MSCI: Loaded 34810 existing records from primary storage. [2025-10-02T22:41:36.419705] [INFO ] [MAIN ] MSCI: Loaded 34810 primary data records. [2025-10-02T22:41:36.560511] [DEBUG] [MAIN ] MSA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:36.562266] [INFO ] [MAIN ] MSA: Generated 1807 derivative records from 19007 primary records. [2025-10-02T22:41:36.578309] [DEBUG] [LOCAL ] MSA: Saving derivative data. [2025-10-02T22:41:36.681032] [DEBUG] [MAIN ] MSB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:36.808059] [INFO ] [MAIN ] MSB: Generated 1807 derivative records from 7883 primary records. [2025-10-02T22:41:36.824406] [DEBUG] [LOCAL ] MSB: Saving derivative data. [2025-10-02T22:41:36.847052] [DEBUG] [LOCAL ] MSA: Derivative data saved (1807 records). [2025-10-02T22:41:36.848554] [DEBUG] [LOCAL ] MSB: Derivative data saved (1807 records). [2025-10-02T22:41:36.848485] [INFO ] [MAIN ] MSA: Successfully saved derivative data. [2025-10-02T22:41:36.849327] [INFO ] [MAIN ] MSB: Successfully saved derivative data. [2025-10-02T22:41:36.852485] [INFO ] [MAIN ] Derivative Progress: 1114/1975 symbols completed. MSB took 1.2s. Estimated remaining: 6m 1s. Rate: 143.0 symbols/min [2025-10-02T22:41:36.855627] [INFO ] [MAIN ] Derivative Progress: 1115/1975 symbols completed. MSA took 1.2s. Estimated remaining: 6m 1s. Rate: 143.1 symbols/min [2025-10-02T22:41:36.855502] [INFO ] [MAIN ] MSD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:36.857034] [INFO ] [MAIN ] MSDL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:36.892409] [DEBUG] [LOCAL ] MSD: Loaded 15944 existing records from primary storage. [2025-10-02T22:41:36.893182] [DEBUG] [MAIN ] MSCI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:36.894393] [INFO ] [MAIN ] MSCI: Generated 1807 derivative records from 34810 primary records. [2025-10-02T22:41:36.894748] [INFO ] [MAIN ] MSD: Loaded 15944 primary data records. [2025-10-02T22:41:36.894673] [DEBUG] [LOCAL ] MSCI: Saving derivative data. [2025-10-02T22:41:37.100922] [DEBUG] [LOCAL ] MSDL: Loaded 38548 existing records from primary storage. [2025-10-02T22:41:37.111385] [INFO ] [MAIN ] MSDL: Loaded 38548 primary data records. [2025-10-02T22:41:37.111927] [DEBUG] [LOCAL ] MSCI: Derivative data saved (1807 records). [2025-10-02T22:41:37.117157] [INFO ] [MAIN ] MSCI: Successfully saved derivative data. [2025-10-02T22:41:37.139962] [INFO ] [MAIN ] Derivative Progress: 1116/1975 symbols completed. MSCI took 1.2s. Estimated remaining: 6m 0s. Rate: 143.1 symbols/min [2025-10-02T22:41:37.145257] [INFO ] [MAIN ] MSGE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:37.692948] [DEBUG] [LOCAL ] MSGE: Loaded 27150 existing records from primary storage. [2025-10-02T22:41:37.693220] [INFO ] [MAIN ] MSGE: Loaded 27150 primary data records. [2025-10-02T22:41:38.053608] [DEBUG] [MAIN ] MSD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:38.059314] [INFO ] [MAIN ] MSD: Generated 1807 derivative records from 15944 primary records. [2025-10-02T22:41:38.060184] [DEBUG] [LOCAL ] MSD: Saving derivative data. [2025-10-02T22:41:38.087231] [DEBUG] [MAIN ] MSDL: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-02T22:41:38.088886] [INFO ] [MAIN ] MSDL: Generated 1806 derivative records from 38548 primary records. [2025-10-02T22:41:38.089163] [DEBUG] [LOCAL ] MSDL: Saving derivative data. [2025-10-02T22:41:38.113055] [DEBUG] [LOCAL ] MSD: Derivative data saved (1807 records). [2025-10-02T22:41:38.114796] [INFO ] [MAIN ] MSD: Successfully saved derivative data. [2025-10-02T22:41:38.117564] [INFO ] [MAIN ] Derivative Progress: 1117/1975 symbols completed. MSD took 1.3s. Estimated remaining: 6m 0s. Rate: 143.0 symbols/min [2025-10-02T22:41:38.119057] [INFO ] [MAIN ] MSGS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:38.120007] [DEBUG] [LOCAL ] MSDL: Derivative data saved (1806 records). [2025-10-02T22:41:38.120881] [INFO ] [MAIN ] MSDL: Successfully saved derivative data. [2025-10-02T22:41:38.124357] [INFO ] [MAIN ] Derivative Progress: 1118/1975 symbols completed. MSDL took 1.3s. Estimated remaining: 5m 59s. Rate: 143.1 symbols/min [2025-10-02T22:41:38.125043] [INFO ] [MAIN ] MSI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:38.149512] [DEBUG] [MAIN ] MSGE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:38.150585] [INFO ] [MAIN ] MSGE: Generated 1807 derivative records from 27150 primary records. [2025-10-02T22:41:38.150930] [DEBUG] [LOCAL ] MSGE: Saving derivative data. [2025-10-02T22:41:38.172943] [DEBUG] [LOCAL ] MSGS: Loaded 17372 existing records from primary storage. [2025-10-02T22:41:38.173765] [INFO ] [MAIN ] MSGS: Loaded 17372 primary data records. [2025-10-02T22:41:38.278717] [DEBUG] [LOCAL ] MSGE: Derivative data saved (1807 records). [2025-10-02T22:41:38.308584] [INFO ] [MAIN ] MSGE: Successfully saved derivative data. [2025-10-02T22:41:38.327436] [INFO ] [MAIN ] Derivative Progress: 1119/1975 symbols completed. MSGE took 1.2s. Estimated remaining: 5m 59s. Rate: 143.2 symbols/min [2025-10-02T22:41:38.329492] [INFO ] [MAIN ] MSM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:38.356387] [DEBUG] [LOCAL ] MSI: Loaded 40527 existing records from primary storage. [2025-10-02T22:41:38.407130] [INFO ] [MAIN ] MSI: Loaded 40527 primary data records. [2025-10-02T22:41:38.905026] [DEBUG] [LOCAL ] MSM: Loaded 35699 existing records from primary storage. [2025-10-02T22:41:38.906874] [INFO ] [MAIN ] MSM: Loaded 35699 primary data records. [2025-10-02T22:41:39.135137] [DEBUG] [MAIN ] MSGS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:39.311061] [INFO ] [MAIN ] MSGS: Generated 1807 derivative records from 17372 primary records. [2025-10-02T22:41:39.320242] [DEBUG] [LOCAL ] MSGS: Saving derivative data. [2025-10-02T22:41:39.343488] [DEBUG] [LOCAL ] MSGS: Derivative data saved (1807 records). [2025-10-02T22:41:39.344229] [INFO ] [MAIN ] MSGS: Successfully saved derivative data. [2025-10-02T22:41:39.346774] [INFO ] [MAIN ] Derivative Progress: 1120/1975 symbols completed. MSGS took 1.2s. Estimated remaining: 5m 59s. Rate: 143.0 symbols/min [2025-10-02T22:41:39.347082] [INFO ] [MAIN ] MT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:39.365669] [DEBUG] [MAIN ] MSI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:39.367374] [INFO ] [MAIN ] MSI: Generated 1807 derivative records from 40527 primary records. [2025-10-02T22:41:39.367460] [DEBUG] [LOCAL ] MSI: Saving derivative data. [2025-10-02T22:41:39.391050] [DEBUG] [LOCAL ] MSI: Derivative data saved (1807 records). [2025-10-02T22:41:39.391428] [INFO ] [MAIN ] MSI: Successfully saved derivative data. [2025-10-02T22:41:39.394167] [INFO ] [MAIN ] Derivative Progress: 1121/1975 symbols completed. MSI took 1.3s. Estimated remaining: 5m 58s. Rate: 143.1 symbols/min [2025-10-02T22:41:39.394685] [INFO ] [MAIN ] MTAL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:39.408818] [DEBUG] [MAIN ] MSM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:39.409621] [INFO ] [MAIN ] MSM: Generated 1807 derivative records from 35699 primary records. [2025-10-02T22:41:39.409917] [DEBUG] [LOCAL ] MSM: Saving derivative data. [2025-10-02T22:41:39.443531] [DEBUG] [LOCAL ] MSM: Derivative data saved (1807 records). [2025-10-02T22:41:39.443844] [INFO ] [MAIN ] MSM: Successfully saved derivative data. [2025-10-02T22:41:39.446629] [INFO ] [MAIN ] Derivative Progress: 1122/1975 symbols completed. MSM took 1.1s. Estimated remaining: 5m 57s. Rate: 143.2 symbols/min [2025-10-02T22:41:39.452099] [INFO ] [MAIN ] MTB: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:39.485560] [DEBUG] [LOCAL ] MT: Loaded 50965 existing records from primary storage. [2025-10-02T22:41:39.485911] [INFO ] [MAIN ] MT: Loaded 50965 primary data records. [2025-10-02T22:41:39.602538] [DEBUG] [LOCAL ] MTAL: Loaded 36775 existing records from primary storage. [2025-10-02T22:41:39.625808] [INFO ] [MAIN ] MTAL: Loaded 36775 primary data records. [2025-10-02T22:41:40.056188] [DEBUG] [LOCAL ] MTB: Loaded 47003 existing records from primary storage. [2025-10-02T22:41:40.125897] [INFO ] [MAIN ] MTB: Loaded 47003 primary data records. [2025-10-02T22:41:40.609591] [DEBUG] [MAIN ] MT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:40.610627] [INFO ] [MAIN ] MT: Generated 1807 derivative records from 50965 primary records. [2025-10-02T22:41:40.610848] [DEBUG] [LOCAL ] MT: Saving derivative data. [2025-10-02T22:41:40.650871] [DEBUG] [LOCAL ] MT: Derivative data saved (1807 records). [2025-10-02T22:41:40.651195] [INFO ] [MAIN ] MT: Successfully saved derivative data. [2025-10-02T22:41:40.651636] [DEBUG] [MAIN ] MTAL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:40.655422] [INFO ] [MAIN ] MTAL: Generated 1807 derivative records from 36775 primary records. [2025-10-02T22:41:40.656520] [DEBUG] [LOCAL ] MTAL: Saving derivative data. [2025-10-02T22:41:40.654448] [INFO ] [MAIN ] Derivative Progress: 1123/1975 symbols completed. MT took 1.3s. Estimated remaining: 5m 58s. Rate: 143.0 symbols/min [2025-10-02T22:41:40.678334] [DEBUG] [LOCAL ] MTAL: Derivative data saved (1807 records). [2025-10-02T22:41:40.678819] [INFO ] [MAIN ] MTAL: Successfully saved derivative data. [2025-10-02T22:41:40.681440] [INFO ] [MAIN ] Derivative Progress: 1124/1975 symbols completed. MTAL took 1.3s. Estimated remaining: 5m 57s. Rate: 143.1 symbols/min [2025-10-02T22:41:40.700156] [DEBUG] [MAIN ] MTB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:40.701080] [INFO ] [MAIN ] MTB: Generated 1807 derivative records from 47003 primary records. [2025-10-02T22:41:40.701148] [DEBUG] [LOCAL ] MTB: Saving derivative data. [2025-10-02T22:41:40.720827] [DEBUG] [LOCAL ] MTB: Derivative data saved (1807 records). [2025-10-02T22:41:40.720965] [INFO ] [MAIN ] MTB: Successfully saved derivative data. [2025-10-02T22:41:40.727747] [INFO ] [MAIN ] Derivative Progress: 1125/1975 symbols completed. MTB took 1.3s. Estimated remaining: 5m 56s. Rate: 143.2 symbols/min [2025-10-02T22:41:40.728594] [INFO ] [MAIN ] MTDR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:40.728696] [INFO ] [MAIN ] MTG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:40.728501] [INFO ] [MAIN ] MTD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:40.750795] [DEBUG] [LOCAL ] MTD: Loaded 15267 existing records from primary storage. [2025-10-02T22:41:40.751033] [INFO ] [MAIN ] MTD: Loaded 15267 primary data records. [2025-10-02T22:41:41.123318] [DEBUG] [LOCAL ] MTDR: Loaded 51967 existing records from primary storage. [2025-10-02T22:41:41.139691] [INFO ] [MAIN ] MTDR: Loaded 51967 primary data records. [2025-10-02T22:41:41.153417] [DEBUG] [LOCAL ] MTG: Loaded 51648 existing records from primary storage. [2025-10-02T22:41:41.181598] [INFO ] [MAIN ] MTG: Loaded 51648 primary data records. [2025-10-02T22:41:41.867082] [DEBUG] [MAIN ] MTD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:41.868627] [INFO ] [MAIN ] MTD: Generated 1807 derivative records from 15267 primary records. [2025-10-02T22:41:41.868870] [DEBUG] [LOCAL ] MTD: Saving derivative data. [2025-10-02T22:41:41.899960] [DEBUG] [MAIN ] MTDR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:41.901739] [INFO ] [MAIN ] MTDR: Generated 1807 derivative records from 51967 primary records. [2025-10-02T22:41:41.902224] [DEBUG] [LOCAL ] MTDR: Saving derivative data. [2025-10-02T22:41:41.912867] [DEBUG] [LOCAL ] MTD: Derivative data saved (1807 records). [2025-10-02T22:41:41.912967] [INFO ] [MAIN ] MTD: Successfully saved derivative data. [2025-10-02T22:41:41.920091] [INFO ] [MAIN ] Derivative Progress: 1126/1975 symbols completed. MTD took 1.2s. Estimated remaining: 5m 56s. Rate: 143.0 symbols/min [2025-10-02T22:41:41.920593] [INFO ] [MAIN ] MTH: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:41.924958] [DEBUG] [LOCAL ] MTDR: Derivative data saved (1807 records). [2025-10-02T22:41:41.926608] [INFO ] [MAIN ] MTDR: Successfully saved derivative data. [2025-10-02T22:41:41.929114] [INFO ] [MAIN ] Derivative Progress: 1127/1975 symbols completed. MTDR took 1.2s. Estimated remaining: 5m 56s. Rate: 143.1 symbols/min [2025-10-02T22:41:41.929398] [INFO ] [MAIN ] MTN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:41.943209] [DEBUG] [MAIN ] MTG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:41.943912] [INFO ] [MAIN ] MTG: Generated 1807 derivative records from 51648 primary records. [2025-10-02T22:41:41.944029] [DEBUG] [LOCAL ] MTG: Saving derivative data. [2025-10-02T22:41:41.962999] [DEBUG] [LOCAL ] MTG: Derivative data saved (1807 records). [2025-10-02T22:41:41.963204] [INFO ] [MAIN ] MTG: Successfully saved derivative data. [2025-10-02T22:41:41.965476] [INFO ] [MAIN ] Derivative Progress: 1128/1975 symbols completed. MTG took 1.2s. Estimated remaining: 5m 55s. Rate: 143.2 symbols/min [2025-10-02T22:41:41.965811] [INFO ] [MAIN ] MTRN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:42.022964] [DEBUG] [LOCAL ] MTRN: Loaded 18219 existing records from primary storage. [2025-10-02T22:41:42.024146] [INFO ] [MAIN ] MTRN: Loaded 18219 primary data records. [2025-10-02T22:41:42.024063] [DEBUG] [LOCAL ] MTN: Loaded 39368 existing records from primary storage. [2025-10-02T22:41:42.036348] [INFO ] [MAIN ] MTN: Loaded 39368 primary data records. [2025-10-02T22:41:42.081624] [DEBUG] [LOCAL ] MTH: Loaded 43930 existing records from primary storage. [2025-10-02T22:41:42.121909] [INFO ] [MAIN ] MTH: Loaded 43930 primary data records. [2025-10-02T22:41:43.050393] [DEBUG] [MAIN ] MTN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:43.052212] [INFO ] [MAIN ] MTN: Generated 1807 derivative records from 39368 primary records. [2025-10-02T22:41:43.052603] [DEBUG] [LOCAL ] MTN: Saving derivative data. [2025-10-02T22:41:43.077392] [DEBUG] [MAIN ] MTH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:43.082627] [INFO ] [MAIN ] MTH: Generated 1807 derivative records from 43930 primary records. [2025-10-02T22:41:43.083365] [DEBUG] [LOCAL ] MTH: Saving derivative data. [2025-10-02T22:41:43.099173] [DEBUG] [MAIN ] MTRN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:43.108834] [INFO ] [MAIN ] MTRN: Generated 1807 derivative records from 18219 primary records. [2025-10-02T22:41:43.114421] [DEBUG] [LOCAL ] MTRN: Saving derivative data. [2025-10-02T22:41:43.116685] [DEBUG] [LOCAL ] MTN: Derivative data saved (1807 records). [2025-10-02T22:41:43.125744] [INFO ] [MAIN ] MTN: Successfully saved derivative data. [2025-10-02T22:41:43.127749] [INFO ] [MAIN ] Derivative Progress: 1129/1975 symbols completed. MTN took 1.2s. Estimated remaining: 5m 55s. Rate: 143.0 symbols/min [2025-10-02T22:41:43.128368] [INFO ] [MAIN ] MTUS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:43.141428] [DEBUG] [LOCAL ] MTH: Derivative data saved (1807 records). [2025-10-02T22:41:43.141769] [INFO ] [MAIN ] MTH: Successfully saved derivative data. [2025-10-02T22:41:43.144346] [INFO ] [MAIN ] Derivative Progress: 1130/1975 symbols completed. MTH took 1.2s. Estimated remaining: 5m 54s. Rate: 143.1 symbols/min [2025-10-02T22:41:43.144584] [INFO ] [MAIN ] MTW: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:43.147282] [DEBUG] [LOCAL ] MTRN: Derivative data saved (1807 records). [2025-10-02T22:41:43.147569] [INFO ] [MAIN ] MTRN: Successfully saved derivative data. [2025-10-02T22:41:43.150230] [INFO ] [MAIN ] Derivative Progress: 1131/1975 symbols completed. MTRN took 1.2s. Estimated remaining: 5m 54s. Rate: 143.2 symbols/min [2025-10-02T22:41:43.150636] [INFO ] [MAIN ] MTX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:43.183376] [DEBUG] [LOCAL ] MTUS: Loaded 28407 existing records from primary storage. [2025-10-02T22:41:43.183719] [INFO ] [MAIN ] MTUS: Loaded 28407 primary data records. [2025-10-02T22:41:43.305385] [DEBUG] [LOCAL ] MTW: Loaded 26640 existing records from primary storage. [2025-10-02T22:41:43.310750] [INFO ] [MAIN ] MTW: Loaded 26640 primary data records. [2025-10-02T22:41:43.325355] [DEBUG] [LOCAL ] MTX: Loaded 22888 existing records from primary storage. [2025-10-02T22:41:43.343865] [INFO ] [MAIN ] MTX: Loaded 22888 primary data records. [2025-10-02T22:41:44.262568] [DEBUG] [MAIN ] MTUS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:44.263949] [INFO ] [MAIN ] MTUS: Generated 1807 derivative records from 28407 primary records. [2025-10-02T22:41:44.264132] [DEBUG] [LOCAL ] MTUS: Saving derivative data. [2025-10-02T22:41:44.283857] [DEBUG] [LOCAL ] MTUS: Derivative data saved (1807 records). [2025-10-02T22:41:44.284033] [INFO ] [MAIN ] MTUS: Successfully saved derivative data. [2025-10-02T22:41:44.286174] [INFO ] [MAIN ] Derivative Progress: 1132/1975 symbols completed. MTUS took 1.2s. Estimated remaining: 5m 54s. Rate: 143.0 symbols/min [2025-10-02T22:41:44.286508] [INFO ] [MAIN ] MTZ: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:44.305894] [DEBUG] [MAIN ] MTW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:44.306830] [INFO ] [MAIN ] MTW: Generated 1807 derivative records from 26640 primary records. [2025-10-02T22:41:44.314902] [DEBUG] [LOCAL ] MTW: Saving derivative data. [2025-10-02T22:41:44.321159] [DEBUG] [MAIN ] MTX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:44.321871] [INFO ] [MAIN ] MTX: Generated 1807 derivative records from 22888 primary records. [2025-10-02T22:41:44.331248] [DEBUG] [LOCAL ] MTX: Saving derivative data. [2025-10-02T22:41:44.365465] [DEBUG] [LOCAL ] MTW: Derivative data saved (1807 records). [2025-10-02T22:41:44.366842] [INFO ] [MAIN ] MTW: Successfully saved derivative data. [2025-10-02T22:41:44.369431] [INFO ] [MAIN ] Derivative Progress: 1133/1975 symbols completed. MTW took 1.2s. Estimated remaining: 5m 53s. Rate: 143.1 symbols/min [2025-10-02T22:41:44.369562] [DEBUG] [LOCAL ] MTX: Derivative data saved (1807 records). [2025-10-02T22:41:44.369895] [INFO ] [MAIN ] MUA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:44.369800] [INFO ] [MAIN ] MTX: Successfully saved derivative data. [2025-10-02T22:41:44.372470] [INFO ] [MAIN ] Derivative Progress: 1134/1975 symbols completed. MTX took 1.2s. Estimated remaining: 5m 52s. Rate: 143.2 symbols/min [2025-10-02T22:41:44.373464] [INFO ] [MAIN ] MUC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:44.390569] [DEBUG] [LOCAL ] MTZ: Loaded 43383 existing records from primary storage. [2025-10-02T22:41:44.394272] [INFO ] [MAIN ] MTZ: Loaded 43383 primary data records. [2025-10-02T22:41:44.479610] [DEBUG] [LOCAL ] MUA: Loaded 12395 existing records from primary storage. [2025-10-02T22:41:44.495386] [INFO ] [MAIN ] MUA: Loaded 12395 primary data records. [2025-10-02T22:41:44.563937] [DEBUG] [LOCAL ] MUC: Loaded 20780 existing records from primary storage. [2025-10-02T22:41:44.581378] [INFO ] [MAIN ] MUC: Loaded 20780 primary data records. [2025-10-02T22:41:45.438250] [DEBUG] [MAIN ] MTZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:45.439362] [INFO ] [MAIN ] MTZ: Generated 1807 derivative records from 43383 primary records. [2025-10-02T22:41:45.440306] [DEBUG] [LOCAL ] MTZ: Saving derivative data. [2025-10-02T22:41:45.483939] [DEBUG] [MAIN ] MUC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:45.486040] [INFO ] [MAIN ] MUC: Generated 1807 derivative records from 20780 primary records. [2025-10-02T22:41:45.486379] [DEBUG] [LOCAL ] MUC: Saving derivative data. [2025-10-02T22:41:45.486711] [DEBUG] [MAIN ] MUA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:45.488142] [INFO ] [MAIN ] MUA: Generated 1807 derivative records from 12395 primary records. [2025-10-02T22:41:45.488424] [DEBUG] [LOCAL ] MUA: Saving derivative data. [2025-10-02T22:41:45.506469] [DEBUG] [LOCAL ] MTZ: Derivative data saved (1807 records). [2025-10-02T22:41:45.511351] [INFO ] [MAIN ] MTZ: Successfully saved derivative data. [2025-10-02T22:41:45.516464] [INFO ] [MAIN ] Derivative Progress: 1135/1975 symbols completed. MTZ took 1.2s. Estimated remaining: 5m 52s. Rate: 143.0 symbols/min [2025-10-02T22:41:45.517171] [INFO ] [MAIN ] MUE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:45.529820] [DEBUG] [LOCAL ] MUA: Derivative data saved (1807 records). [2025-10-02T22:41:45.529315] [DEBUG] [LOCAL ] MUC: Derivative data saved (1807 records). [2025-10-02T22:41:45.529959] [INFO ] [MAIN ] MUC: Successfully saved derivative data. [2025-10-02T22:41:45.530009] [INFO ] [MAIN ] MUA: Successfully saved derivative data. [2025-10-02T22:41:45.532359] [INFO ] [MAIN ] Derivative Progress: 1136/1975 symbols completed. MUC took 1.2s. Estimated remaining: 5m 52s. Rate: 143.1 symbols/min [2025-10-02T22:41:45.532569] [INFO ] [MAIN ] MUFG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:45.534844] [INFO ] [MAIN ] Derivative Progress: 1137/1975 symbols completed. MUA took 1.2s. Estimated remaining: 5m 51s. Rate: 143.3 symbols/min [2025-10-02T22:41:45.535538] [INFO ] [MAIN ] MUJ: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:45.541570] [DEBUG] [LOCAL ] MUE: Loaded 11972 existing records from primary storage. [2025-10-02T22:41:45.541914] [INFO ] [MAIN ] MUE: Loaded 11972 primary data records. [2025-10-02T22:41:45.661816] [DEBUG] [LOCAL ] MUJ: Loaded 13577 existing records from primary storage. [2025-10-02T22:41:45.670523] [INFO ] [MAIN ] MUJ: Loaded 13577 primary data records. [2025-10-02T22:41:46.093813] [DEBUG] [LOCAL ] MUFG: Loaded 52941 existing records from primary storage. [2025-10-02T22:41:46.129553] [INFO ] [MAIN ] MUFG: Loaded 52941 primary data records. [2025-10-02T22:41:46.634799] [DEBUG] [MAIN ] MUE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:46.636688] [INFO ] [MAIN ] MUE: Generated 1807 derivative records from 11972 primary records. [2025-10-02T22:41:46.637625] [DEBUG] [LOCAL ] MUE: Saving derivative data. [2025-10-02T22:41:46.666405] [DEBUG] [MAIN ] MUJ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:46.668118] [INFO ] [MAIN ] MUJ: Generated 1807 derivative records from 13577 primary records. [2025-10-02T22:41:46.668477] [DEBUG] [LOCAL ] MUJ: Saving derivative data. [2025-10-02T22:41:46.684874] [DEBUG] [LOCAL ] MUE: Derivative data saved (1807 records). [2025-10-02T22:41:46.685460] [INFO ] [MAIN ] MUE: Successfully saved derivative data. [2025-10-02T22:41:46.688464] [INFO ] [MAIN ] Derivative Progress: 1138/1975 symbols completed. MUE took 1.2s. Estimated remaining: 5m 51s. Rate: 143.0 symbols/min [2025-10-02T22:41:46.693184] [DEBUG] [LOCAL ] MUJ: Derivative data saved (1807 records). [2025-10-02T22:41:46.695565] [INFO ] [MAIN ] MUJ: Successfully saved derivative data. [2025-10-02T22:41:46.698242] [INFO ] [MAIN ] Derivative Progress: 1139/1975 symbols completed. MUJ took 1.2s. Estimated remaining: 5m 50s. Rate: 143.2 symbols/min [2025-10-02T22:41:46.712208] [DEBUG] [MAIN ] MUFG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:46.712968] [INFO ] [MAIN ] MUFG: Generated 1807 derivative records from 52941 primary records. [2025-10-02T22:41:46.713034] [DEBUG] [LOCAL ] MUFG: Saving derivative data. [2025-10-02T22:41:46.729813] [DEBUG] [LOCAL ] MUFG: Derivative data saved (1807 records). [2025-10-02T22:41:46.729885] [INFO ] [MAIN ] MUFG: Successfully saved derivative data. [2025-10-02T22:41:46.732231] [INFO ] [MAIN ] Derivative Progress: 1140/1975 symbols completed. MUFG took 1.2s. Estimated remaining: 5m 50s. Rate: 143.3 symbols/min [2025-10-02T22:41:46.732729] [INFO ] [MAIN ] MUR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:46.732839] [INFO ] [MAIN ] MUX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:46.733148] [INFO ] [MAIN ] MUSA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:46.761828] [DEBUG] [LOCAL ] MUSA: Loaded 24863 existing records from primary storage. [2025-10-02T22:41:46.771144] [INFO ] [MAIN ] MUSA: Loaded 24863 primary data records. [2025-10-02T22:41:46.923602] [DEBUG] [LOCAL ] MUX: Loaded 43201 existing records from primary storage. [2025-10-02T22:41:46.924238] [INFO ] [MAIN ] MUX: Loaded 43201 primary data records. [2025-10-02T22:41:47.053396] [DEBUG] [LOCAL ] MUR: Loaded 53312 existing records from primary storage. [2025-10-02T22:41:47.122455] [INFO ] [MAIN ] MUR: Loaded 53312 primary data records. [2025-10-02T22:41:47.854960] [DEBUG] [MAIN ] MUSA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:47.857736] [INFO ] [MAIN ] MUSA: Generated 1807 derivative records from 24863 primary records. [2025-10-02T22:41:47.858168] [DEBUG] [LOCAL ] MUSA: Saving derivative data. [2025-10-02T22:41:47.880586] [DEBUG] [MAIN ] MUX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:47.885870] [INFO ] [MAIN ] MUX: Generated 1807 derivative records from 43201 primary records. [2025-10-02T22:41:47.886209] [DEBUG] [LOCAL ] MUX: Saving derivative data. [2025-10-02T22:41:47.920596] [DEBUG] [LOCAL ] MUSA: Derivative data saved (1807 records). [2025-10-02T22:41:47.921096] [DEBUG] [MAIN ] MUR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:47.921934] [INFO ] [MAIN ] MUR: Generated 1807 derivative records from 53312 primary records. [2025-10-02T22:41:47.921168] [INFO ] [MAIN ] MUSA: Successfully saved derivative data. [2025-10-02T22:41:47.922467] [DEBUG] [LOCAL ] MUR: Saving derivative data. [2025-10-02T22:41:47.925784] [INFO ] [MAIN ] Derivative Progress: 1141/1975 symbols completed. MUSA took 1.2s. Estimated remaining: 5m 50s. Rate: 143.1 symbols/min [2025-10-02T22:41:47.926172] [INFO ] [MAIN ] MVF: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:47.927270] [DEBUG] [LOCAL ] MUX: Derivative data saved (1807 records). [2025-10-02T22:41:47.938242] [INFO ] [MAIN ] MUX: Successfully saved derivative data. [2025-10-02T22:41:47.941677] [INFO ] [MAIN ] Derivative Progress: 1142/1975 symbols completed. MUX took 1.2s. Estimated remaining: 5m 49s. Rate: 143.2 symbols/min [2025-10-02T22:41:47.942217] [INFO ] [MAIN ] MVO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:47.948276] [DEBUG] [LOCAL ] MUR: Derivative data saved (1807 records). [2025-10-02T22:41:47.948497] [INFO ] [MAIN ] MUR: Successfully saved derivative data. [2025-10-02T22:41:47.950861] [INFO ] [MAIN ] Derivative Progress: 1143/1975 symbols completed. MUR took 1.2s. Estimated remaining: 5m 48s. Rate: 143.3 symbols/min [2025-10-02T22:41:47.956790] [INFO ] [MAIN ] MVT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:47.962463] [DEBUG] [LOCAL ] MVO: Loaded 8973 existing records from primary storage. [2025-10-02T22:41:47.967662] [INFO ] [MAIN ] MVO: Loaded 8973 primary data records. [2025-10-02T22:41:47.967488] [DEBUG] [LOCAL ] MVF: Loaded 13165 existing records from primary storage. [2025-10-02T22:41:47.972997] [INFO ] [MAIN ] MVF: Loaded 13165 primary data records. [2025-10-02T22:41:48.236532] [DEBUG] [LOCAL ] MVT: Loaded 10328 existing records from primary storage. [2025-10-02T22:41:48.240989] [INFO ] [MAIN ] MVT: Loaded 10328 primary data records. [2025-10-02T22:41:49.049842] [DEBUG] [MAIN ] MVO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:49.054985] [DEBUG] [MAIN ] MVF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:49.055871] [INFO ] [MAIN ] MVO: Generated 1807 derivative records from 8973 primary records. [2025-10-02T22:41:49.056150] [DEBUG] [LOCAL ] MVO: Saving derivative data. [2025-10-02T22:41:49.058077] [INFO ] [MAIN ] MVF: Generated 1807 derivative records from 13165 primary records. [2025-10-02T22:41:49.059610] [DEBUG] [LOCAL ] MVF: Saving derivative data. [2025-10-02T22:41:49.101161] [DEBUG] [MAIN ] MVT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:49.103399] [INFO ] [MAIN ] MVT: Generated 1807 derivative records from 10328 primary records. [2025-10-02T22:41:49.103793] [DEBUG] [LOCAL ] MVT: Saving derivative data. [2025-10-02T22:41:49.115405] [DEBUG] [LOCAL ] MVO: Derivative data saved (1807 records). [2025-10-02T22:41:49.119885] [DEBUG] [LOCAL ] MVF: Derivative data saved (1807 records). [2025-10-02T22:41:49.119387] [INFO ] [MAIN ] MVO: Successfully saved derivative data. [2025-10-02T22:41:49.123248] [INFO ] [MAIN ] MVF: Successfully saved derivative data. [2025-10-02T22:41:49.123149] [INFO ] [MAIN ] Derivative Progress: 1144/1975 symbols completed. MVO took 1.2s. Estimated remaining: 5m 49s. Rate: 143.1 symbols/min [2025-10-02T22:41:49.126625] [INFO ] [MAIN ] MWA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:49.127070] [INFO ] [MAIN ] Derivative Progress: 1145/1975 symbols completed. MVF took 1.2s. Estimated remaining: 5m 48s. Rate: 143.2 symbols/min [2025-10-02T22:41:49.127522] [INFO ] [MAIN ] MX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:49.130495] [DEBUG] [LOCAL ] MVT: Derivative data saved (1807 records). [2025-10-02T22:41:49.130600] [INFO ] [MAIN ] MVT: Successfully saved derivative data. [2025-10-02T22:41:49.133062] [INFO ] [MAIN ] Derivative Progress: 1146/1975 symbols completed. MVT took 1.2s. Estimated remaining: 5m 47s. Rate: 143.3 symbols/min [2025-10-02T22:41:49.133470] [INFO ] [MAIN ] MXF: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:49.144282] [DEBUG] [LOCAL ] MXF: Loaded 5795 existing records from primary storage. [2025-10-02T22:41:49.144608] [INFO ] [MAIN ] MXF: Loaded 5795 primary data records. [2025-10-02T22:41:49.282268] [DEBUG] [LOCAL ] MX: Loaded 22864 existing records from primary storage. [2025-10-02T22:41:49.288428] [INFO ] [MAIN ] MX: Loaded 22864 primary data records. [2025-10-02T22:41:49.648358] [DEBUG] [LOCAL ] MWA: Loaded 46871 existing records from primary storage. [2025-10-02T22:41:49.674792] [INFO ] [MAIN ] MWA: Loaded 46871 primary data records. [2025-10-02T22:41:50.467275] [DEBUG] [MAIN ] MXF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:50.486670] [INFO ] [MAIN ] MXF: Generated 1807 derivative records from 5795 primary records. [2025-10-02T22:41:50.488979] [DEBUG] [LOCAL ] MXF: Saving derivative data. [2025-10-02T22:41:50.520762] [DEBUG] [MAIN ] MX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:50.523212] [INFO ] [MAIN ] MX: Generated 1807 derivative records from 22864 primary records. [2025-10-02T22:41:50.524334] [DEBUG] [LOCAL ] MX: Saving derivative data. [2025-10-02T22:41:50.547226] [DEBUG] [LOCAL ] MXF: Derivative data saved (1807 records). [2025-10-02T22:41:50.548594] [INFO ] [MAIN ] MXF: Successfully saved derivative data. [2025-10-02T22:41:50.553422] [INFO ] [MAIN ] Derivative Progress: 1147/1975 symbols completed. MXF took 1.4s. Estimated remaining: 5m 47s. Rate: 143.0 symbols/min [2025-10-02T22:41:50.554706] [INFO ] [MAIN ] MYD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:50.561437] [DEBUG] [LOCAL ] MX: Derivative data saved (1807 records). [2025-10-02T22:41:50.561833] [INFO ] [MAIN ] MX: Successfully saved derivative data. [2025-10-02T22:41:50.564576] [INFO ] [MAIN ] Derivative Progress: 1148/1975 symbols completed. MX took 1.4s. Estimated remaining: 5m 47s. Rate: 143.1 symbols/min [2025-10-02T22:41:50.565469] [INFO ] [MAIN ] MYE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:50.583050] [DEBUG] [LOCAL ] MYD: Loaded 13825 existing records from primary storage. [2025-10-02T22:41:50.591405] [INFO ] [MAIN ] MYD: Loaded 13825 primary data records. [2025-10-02T22:41:50.597938] [DEBUG] [MAIN ] MWA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:50.622326] [INFO ] [MAIN ] MWA: Generated 1807 derivative records from 46871 primary records. [2025-10-02T22:41:50.639627] [DEBUG] [LOCAL ] MWA: Saving derivative data. [2025-10-02T22:41:50.758281] [DEBUG] [LOCAL ] MYE: Loaded 24709 existing records from primary storage. [2025-10-02T22:41:50.778567] [INFO ] [MAIN ] MYE: Loaded 24709 primary data records. [2025-10-02T22:41:51.080687] [DEBUG] [LOCAL ] MWA: Derivative data saved (1807 records). [2025-10-02T22:41:51.080821] [INFO ] [MAIN ] MWA: Successfully saved derivative data. [2025-10-02T22:41:51.083776] [INFO ] [MAIN ] Derivative Progress: 1149/1975 symbols completed. MWA took 2.0s. Estimated remaining: 5m 46s. Rate: 143.1 symbols/min [2025-10-02T22:41:51.089381] [INFO ] [MAIN ] MYI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:51.344443] [DEBUG] [LOCAL ] MYI: Loaded 19536 existing records from primary storage. [2025-10-02T22:41:51.345274] [INFO ] [MAIN ] MYI: Loaded 19536 primary data records. [2025-10-02T22:41:51.455934] [DEBUG] [MAIN ] MYD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:51.474987] [INFO ] [MAIN ] MYD: Generated 1807 derivative records from 13825 primary records. [2025-10-02T22:41:51.487124] [DEBUG] [LOCAL ] MYD: Saving derivative data. [2025-10-02T22:41:51.752491] [DEBUG] [LOCAL ] MYD: Derivative data saved (1807 records). [2025-10-02T22:41:51.754408] [INFO ] [MAIN ] MYD: Successfully saved derivative data. [2025-10-02T22:41:51.754279] [DEBUG] [MAIN ] MYE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:51.756747] [INFO ] [MAIN ] Derivative Progress: 1150/1975 symbols completed. MYD took 1.2s. Estimated remaining: 5m 46s. Rate: 143.0 symbols/min [2025-10-02T22:41:51.757117] [INFO ] [MAIN ] MYN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:51.758322] [INFO ] [MAIN ] MYE: Generated 1807 derivative records from 24709 primary records. [2025-10-02T22:41:51.758580] [DEBUG] [LOCAL ] MYE: Saving derivative data. [2025-10-02T22:41:51.788431] [DEBUG] [LOCAL ] MYN: Loaded 10046 existing records from primary storage. [2025-10-02T22:41:51.790320] [INFO ] [MAIN ] MYN: Loaded 10046 primary data records. [2025-10-02T22:41:51.790216] [DEBUG] [LOCAL ] MYE: Derivative data saved (1807 records). [2025-10-02T22:41:51.842121] [INFO ] [MAIN ] MYE: Successfully saved derivative data. [2025-10-02T22:41:51.874673] [INFO ] [MAIN ] Derivative Progress: 1151/1975 symbols completed. MYE took 1.3s. Estimated remaining: 5m 45s. Rate: 143.1 symbols/min [2025-10-02T22:41:51.883836] [INFO ] [MAIN ] NABL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:52.148207] [DEBUG] [MAIN ] MYI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:52.149101] [INFO ] [MAIN ] MYI: Generated 1807 derivative records from 19536 primary records. [2025-10-02T22:41:52.149398] [DEBUG] [LOCAL ] MYI: Saving derivative data. [2025-10-02T22:41:52.182769] [DEBUG] [LOCAL ] NABL: Loaded 39614 existing records from primary storage. [2025-10-02T22:41:52.183512] [INFO ] [MAIN ] NABL: Loaded 39614 primary data records. [2025-10-02T22:41:52.197530] [DEBUG] [LOCAL ] MYI: Derivative data saved (1807 records). [2025-10-02T22:41:52.229470] [INFO ] [MAIN ] MYI: Successfully saved derivative data. [2025-10-02T22:41:52.275683] [INFO ] [MAIN ] Derivative Progress: 1152/1975 symbols completed. MYI took 1.2s. Estimated remaining: 5m 45s. Rate: 143.1 symbols/min [2025-10-02T22:41:52.294883] [INFO ] [MAIN ] NAC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:52.589883] [DEBUG] [MAIN ] MYN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:52.591605] [INFO ] [MAIN ] MYN: Generated 1807 derivative records from 10046 primary records. [2025-10-02T22:41:52.600262] [DEBUG] [LOCAL ] MYN: Saving derivative data. [2025-10-02T22:41:52.602767] [DEBUG] [LOCAL ] NAC: Loaded 25056 existing records from primary storage. [2025-10-02T22:41:52.603006] [INFO ] [MAIN ] NAC: Loaded 25056 primary data records. [2025-10-02T22:41:52.713544] [DEBUG] [LOCAL ] MYN: Derivative data saved (1807 records). [2025-10-02T22:41:52.740522] [INFO ] [MAIN ] MYN: Successfully saved derivative data. [2025-10-02T22:41:52.747042] [INFO ] [MAIN ] Derivative Progress: 1153/1975 symbols completed. MYN took 1.0s. Estimated remaining: 5m 45s. Rate: 143.1 symbols/min [2025-10-02T22:41:52.981684] [DEBUG] [MAIN ] NABL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:52.982539] [INFO ] [MAIN ] NABL: Generated 1807 derivative records from 39614 primary records. [2025-10-02T22:41:52.982746] [DEBUG] [LOCAL ] NABL: Saving derivative data. [2025-10-02T22:41:53.003479] [DEBUG] [LOCAL ] NABL: Derivative data saved (1807 records). [2025-10-02T22:41:53.003689] [INFO ] [MAIN ] NABL: Successfully saved derivative data. [2025-10-02T22:41:53.006061] [INFO ] [MAIN ] Derivative Progress: 1154/1975 symbols completed. NABL took 1.1s. Estimated remaining: 5m 44s. Rate: 143.2 symbols/min [2025-10-02T22:41:53.030106] [DEBUG] [MAIN ] NAC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:53.030841] [INFO ] [MAIN ] NAC: Generated 1807 derivative records from 25056 primary records. [2025-10-02T22:41:53.030937] [DEBUG] [LOCAL ] NAC: Saving derivative data. [2025-10-02T22:41:53.047307] [DEBUG] [LOCAL ] NAC: Derivative data saved (1807 records). [2025-10-02T22:41:53.047429] [INFO ] [MAIN ] NAC: Successfully saved derivative data. [2025-10-02T22:41:53.049877] [INFO ] [MAIN ] Derivative Progress: 1155/1975 symbols completed. NAC took 0.8s. Estimated remaining: 5m 43s. Rate: 143.3 symbols/min [2025-10-02T22:41:53.050294] [INFO ] [MAIN ] NAD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:53.050361] [INFO ] [MAIN ] NAN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:53.050553] [INFO ] [MAIN ] NAT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:53.069052] [DEBUG] [LOCAL ] NAN: Loaded 8900 existing records from primary storage. [2025-10-02T22:41:53.069222] [INFO ] [MAIN ] NAN: Loaded 8900 primary data records. [2025-10-02T22:41:53.329020] [DEBUG] [LOCAL ] NAD: Loaded 34199 existing records from primary storage. [2025-10-02T22:41:53.382880] [INFO ] [MAIN ] NAD: Loaded 34199 primary data records. [2025-10-02T22:41:53.382761] [DEBUG] [LOCAL ] NAT: Loaded 49548 existing records from primary storage. [2025-10-02T22:41:53.440940] [INFO ] [MAIN ] NAT: Loaded 49548 primary data records. [2025-10-02T22:41:54.141902] [DEBUG] [MAIN ] NAN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:54.143333] [INFO ] [MAIN ] NAN: Generated 1807 derivative records from 8900 primary records. [2025-10-02T22:41:54.143591] [DEBUG] [LOCAL ] NAN: Saving derivative data. [2025-10-02T22:41:54.167521] [DEBUG] [LOCAL ] NAN: Derivative data saved (1807 records). [2025-10-02T22:41:54.167731] [INFO ] [MAIN ] NAN: Successfully saved derivative data. [2025-10-02T22:41:54.170043] [INFO ] [MAIN ] Derivative Progress: 1156/1975 symbols completed. NAN took 1.1s. Estimated remaining: 5m 43s. Rate: 143.1 symbols/min [2025-10-02T22:41:54.181933] [INFO ] [MAIN ] NAZ: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:54.187987] [DEBUG] [MAIN ] NAD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:54.189380] [INFO ] [MAIN ] NAD: Generated 1807 derivative records from 34199 primary records. [2025-10-02T22:41:54.190574] [DEBUG] [LOCAL ] NAD: Saving derivative data. [2025-10-02T22:41:54.223999] [DEBUG] [LOCAL ] NAZ: Loaded 2658 existing records from primary storage. [2025-10-02T22:41:54.225232] [DEBUG] [MAIN ] NAT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:54.224901] [INFO ] [MAIN ] NAZ: Loaded 2658 primary data records. [2025-10-02T22:41:54.239255] [INFO ] [MAIN ] NAT: Generated 1807 derivative records from 49548 primary records. [2025-10-02T22:41:54.262103] [DEBUG] [LOCAL ] NAT: Saving derivative data. [2025-10-02T22:41:54.292523] [DEBUG] [LOCAL ] NAD: Derivative data saved (1807 records). [2025-10-02T22:41:54.329603] [INFO ] [MAIN ] NAD: Successfully saved derivative data. [2025-10-02T22:41:54.342589] [INFO ] [MAIN ] Derivative Progress: 1157/1975 symbols completed. NAD took 1.3s. Estimated remaining: 5m 43s. Rate: 143.1 symbols/min [2025-10-02T22:41:54.366976] [DEBUG] [LOCAL ] NAT: Derivative data saved (1807 records). [2025-10-02T22:41:54.366740] [INFO ] [MAIN ] NBB: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:54.367507] [INFO ] [MAIN ] NAT: Successfully saved derivative data. [2025-10-02T22:41:54.370876] [INFO ] [MAIN ] Derivative Progress: 1158/1975 symbols completed. NAT took 1.3s. Estimated remaining: 5m 42s. Rate: 143.3 symbols/min [2025-10-02T22:41:54.376822] [INFO ] [MAIN ] NBHC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:54.620852] [DEBUG] [LOCAL ] NBB: Loaded 9149 existing records from primary storage. [2025-10-02T22:41:54.636058] [INFO ] [MAIN ] NBB: Loaded 9149 primary data records. [2025-10-02T22:41:54.719841] [DEBUG] [LOCAL ] NBHC: Loaded 23469 existing records from primary storage. [2025-10-02T22:41:54.734843] [INFO ] [MAIN ] NBHC: Loaded 23469 primary data records. [2025-10-02T22:41:55.331399] [DEBUG] [MAIN ] NAZ: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-02T22:41:55.333044] [INFO ] [MAIN ] NAZ: Generated 1806 derivative records from 2658 primary records. [2025-10-02T22:41:55.333425] [DEBUG] [LOCAL ] NAZ: Saving derivative data. [2025-10-02T22:41:55.353339] [DEBUG] [LOCAL ] NAZ: Derivative data saved (1806 records). [2025-10-02T22:41:55.354199] [INFO ] [MAIN ] NAZ: Successfully saved derivative data. [2025-10-02T22:41:55.356488] [INFO ] [MAIN ] Derivative Progress: 1159/1975 symbols completed. NAZ took 1.2s. Estimated remaining: 5m 42s. Rate: 143.1 symbols/min [2025-10-02T22:41:55.356714] [INFO ] [MAIN ] NBR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:55.370894] [DEBUG] [MAIN ] NBB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:55.371881] [INFO ] [MAIN ] NBB: Generated 1807 derivative records from 9149 primary records. [2025-10-02T22:41:55.372027] [DEBUG] [LOCAL ] NBB: Saving derivative data. [2025-10-02T22:41:55.403412] [DEBUG] [MAIN ] NBHC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:55.405076] [DEBUG] [LOCAL ] NBB: Derivative data saved (1807 records). [2025-10-02T22:41:55.405937] [INFO ] [MAIN ] NBHC: Generated 1807 derivative records from 23469 primary records. [2025-10-02T22:41:55.406427] [INFO ] [MAIN ] NBB: Successfully saved derivative data. [2025-10-02T22:41:55.408818] [DEBUG] [LOCAL ] NBHC: Saving derivative data. [2025-10-02T22:41:55.408707] [INFO ] [MAIN ] Derivative Progress: 1160/1975 symbols completed. NBB took 1.0s. Estimated remaining: 5m 41s. Rate: 143.2 symbols/min [2025-10-02T22:41:55.409998] [INFO ] [MAIN ] NBXG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:55.437034] [DEBUG] [LOCAL ] NBHC: Derivative data saved (1807 records). [2025-10-02T22:41:55.447605] [INFO ] [MAIN ] NBHC: Successfully saved derivative data. [2025-10-02T22:41:55.450068] [INFO ] [MAIN ] Derivative Progress: 1161/1975 symbols completed. NBHC took 1.1s. Estimated remaining: 5m 41s. Rate: 143.3 symbols/min [2025-10-02T22:41:55.451242] [DEBUG] [LOCAL ] NBR: Loaded 34765 existing records from primary storage. [2025-10-02T22:41:55.451502] [INFO ] [MAIN ] NBR: Loaded 34765 primary data records. [2025-10-02T22:41:55.451590] [INFO ] [MAIN ] NC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:55.560638] [DEBUG] [LOCAL ] NBXG: Loaded 22472 existing records from primary storage. [2025-10-02T22:41:55.567840] [DEBUG] [LOCAL ] NC: Loaded 1944 existing records from primary storage. [2025-10-02T22:41:55.568000] [INFO ] [MAIN ] NC: Loaded 1944 primary data records. [2025-10-02T22:41:55.586277] [INFO ] [MAIN ] NBXG: Loaded 22472 primary data records. [2025-10-02T22:41:56.479965] [DEBUG] [MAIN ] NBR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:56.482222] [INFO ] [MAIN ] NBR: Generated 1807 derivative records from 34765 primary records. [2025-10-02T22:41:56.483323] [DEBUG] [LOCAL ] NBR: Saving derivative data. [2025-10-02T22:41:56.509711] [DEBUG] [MAIN ] NBXG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:56.510911] [INFO ] [MAIN ] NBXG: Generated 1807 derivative records from 22472 primary records. [2025-10-02T22:41:56.511086] [DEBUG] [LOCAL ] NBXG: Saving derivative data. [2025-10-02T22:41:56.511626] [DEBUG] [MAIN ] NC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:56.520723] [INFO ] [MAIN ] NC: Generated 1807 derivative records from 1944 primary records. [2025-10-02T22:41:56.532327] [DEBUG] [LOCAL ] NC: Saving derivative data. [2025-10-02T22:41:56.557532] [DEBUG] [LOCAL ] NBR: Derivative data saved (1807 records). [2025-10-02T22:41:56.558685] [INFO ] [MAIN ] NBR: Successfully saved derivative data. [2025-10-02T22:41:56.561229] [INFO ] [MAIN ] Derivative Progress: 1162/1975 symbols completed. NBR took 1.2s. Estimated remaining: 5m 41s. Rate: 143.1 symbols/min [2025-10-02T22:41:56.562870] [DEBUG] [LOCAL ] NBXG: Derivative data saved (1807 records). [2025-10-02T22:41:56.563146] [INFO ] [MAIN ] NBXG: Successfully saved derivative data. [2025-10-02T22:41:56.562206] [INFO ] [MAIN ] NCA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:56.565949] [INFO ] [MAIN ] Derivative Progress: 1163/1975 symbols completed. NBXG took 1.2s. Estimated remaining: 5m 40s. Rate: 143.2 symbols/min [2025-10-02T22:41:56.566214] [INFO ] [MAIN ] NCDL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:56.566989] [DEBUG] [LOCAL ] NC: Derivative data saved (1807 records). [2025-10-02T22:41:56.567801] [INFO ] [MAIN ] NC: Successfully saved derivative data. [2025-10-02T22:41:56.570391] [INFO ] [MAIN ] Derivative Progress: 1164/1975 symbols completed. NC took 1.1s. Estimated remaining: 5m 39s. Rate: 143.3 symbols/min [2025-10-02T22:41:56.570628] [INFO ] [MAIN ] NCV: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:56.582437] [DEBUG] [LOCAL ] NCA: Loaded 10308 existing records from primary storage. [2025-10-02T22:41:56.582773] [INFO ] [MAIN ] NCA: Loaded 10308 primary data records. [2025-10-02T22:41:56.697167] [DEBUG] [LOCAL ] NCV: Loaded 13797 existing records from primary storage. [2025-10-02T22:41:56.710344] [INFO ] [MAIN ] NCV: Loaded 13797 primary data records. [2025-10-02T22:41:56.710889] [DEBUG] [LOCAL ] NCDL: Loaded 21767 existing records from primary storage. [2025-10-02T22:41:56.734896] [INFO ] [MAIN ] NCDL: Loaded 21767 primary data records. [2025-10-02T22:41:57.699455] [DEBUG] [MAIN ] NCA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:57.701535] [INFO ] [MAIN ] NCA: Generated 1807 derivative records from 10308 primary records. [2025-10-02T22:41:57.701987] [DEBUG] [LOCAL ] NCA: Saving derivative data. [2025-10-02T22:41:57.730297] [DEBUG] [MAIN ] NCV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:57.739127] [INFO ] [MAIN ] NCV: Generated 1807 derivative records from 13797 primary records. [2025-10-02T22:41:57.741566] [DEBUG] [LOCAL ] NCV: Saving derivative data. [2025-10-02T22:41:57.741357] [DEBUG] [LOCAL ] NCA: Derivative data saved (1807 records). [2025-10-02T22:41:57.742884] [INFO ] [MAIN ] NCA: Successfully saved derivative data. [2025-10-02T22:41:57.756872] [INFO ] [MAIN ] Derivative Progress: 1165/1975 symbols completed. NCA took 1.2s. Estimated remaining: 5m 40s. Rate: 143.1 symbols/min [2025-10-02T22:41:57.765515] [INFO ] [MAIN ] NCZ: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:57.777539] [DEBUG] [MAIN ] NCDL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:57.779864] [INFO ] [MAIN ] NCDL: Generated 1807 derivative records from 21767 primary records. [2025-10-02T22:41:57.780716] [DEBUG] [LOCAL ] NCDL: Saving derivative data. [2025-10-02T22:41:57.806877] [DEBUG] [LOCAL ] NCV: Derivative data saved (1807 records). [2025-10-02T22:41:57.807804] [INFO ] [MAIN ] NCV: Successfully saved derivative data. [2025-10-02T22:41:57.817432] [DEBUG] [LOCAL ] NCZ: Loaded 12088 existing records from primary storage. [2025-10-02T22:41:57.816868] [INFO ] [MAIN ] Derivative Progress: 1166/1975 symbols completed. NCV took 1.2s. Estimated remaining: 5m 39s. Rate: 143.2 symbols/min [2025-10-02T22:41:57.818330] [INFO ] [MAIN ] NDMO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:57.819192] [INFO ] [MAIN ] NCZ: Loaded 12088 primary data records. [2025-10-02T22:41:57.858616] [DEBUG] [LOCAL ] NCDL: Derivative data saved (1807 records). [2025-10-02T22:41:57.878183] [INFO ] [MAIN ] NCDL: Successfully saved derivative data. [2025-10-02T22:41:57.911409] [INFO ] [MAIN ] Derivative Progress: 1167/1975 symbols completed. NCDL took 1.3s. Estimated remaining: 5m 38s. Rate: 143.3 symbols/min [2025-10-02T22:41:57.947589] [INFO ] [MAIN ] NE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:57.965459] [DEBUG] [LOCAL ] NDMO: Loaded 17082 existing records from primary storage. [2025-10-02T22:41:57.986989] [INFO ] [MAIN ] NDMO: Loaded 17082 primary data records. [2025-10-02T22:41:58.556594] [DEBUG] [LOCAL ] NE: Loaded 52725 existing records from primary storage. [2025-10-02T22:41:58.557615] [INFO ] [MAIN ] NE: Loaded 52725 primary data records. [2025-10-02T22:41:58.643185] [DEBUG] [MAIN ] NCZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:58.658421] [INFO ] [MAIN ] NCZ: Generated 1807 derivative records from 12088 primary records. [2025-10-02T22:41:58.678202] [DEBUG] [LOCAL ] NCZ: Saving derivative data. [2025-10-02T22:41:58.972585] [DEBUG] [LOCAL ] NCZ: Derivative data saved (1807 records). [2025-10-02T22:41:58.978029] [DEBUG] [MAIN ] NDMO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:58.979976] [INFO ] [MAIN ] NDMO: Generated 1807 derivative records from 17082 primary records. [2025-10-02T22:41:58.979116] [INFO ] [MAIN ] NCZ: Successfully saved derivative data. [2025-10-02T22:41:58.983710] [DEBUG] [LOCAL ] NDMO: Saving derivative data. [2025-10-02T22:41:58.983552] [INFO ] [MAIN ] Derivative Progress: 1168/1975 symbols completed. NCZ took 1.2s. Estimated remaining: 5m 38s. Rate: 143.1 symbols/min [2025-10-02T22:41:59.012304] [DEBUG] [LOCAL ] NDMO: Derivative data saved (1807 records). [2025-10-02T22:41:59.012698] [INFO ] [MAIN ] NDMO: Successfully saved derivative data. [2025-10-02T22:41:59.015967] [INFO ] [MAIN ] Derivative Progress: 1169/1975 symbols completed. NDMO took 1.2s. Estimated remaining: 5m 38s. Rate: 143.2 symbols/min [2025-10-02T22:41:59.036276] [DEBUG] [MAIN ] NE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:41:59.037036] [INFO ] [MAIN ] NE: Generated 1807 derivative records from 52725 primary records. [2025-10-02T22:41:59.037107] [DEBUG] [LOCAL ] NE: Saving derivative data. [2025-10-02T22:41:59.054280] [DEBUG] [LOCAL ] NE: Derivative data saved (1807 records). [2025-10-02T22:41:59.054361] [INFO ] [MAIN ] NE: Successfully saved derivative data. [2025-10-02T22:41:59.056833] [INFO ] [MAIN ] Derivative Progress: 1170/1975 symbols completed. NE took 1.1s. Estimated remaining: 5m 37s. Rate: 143.4 symbols/min [2025-10-02T22:41:59.057345] [INFO ] [MAIN ] NET: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:59.057914] [INFO ] [MAIN ] NEU: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:59.058023] [INFO ] [MAIN ] NEA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:41:59.070467] [DEBUG] [LOCAL ] NEU: Loaded 8349 existing records from primary storage. [2025-10-02T22:41:59.070731] [INFO ] [MAIN ] NEU: Loaded 8349 primary data records. [2025-10-02T22:41:59.276404] [DEBUG] [LOCAL ] NEA: Loaded 35701 existing records from primary storage. [2025-10-02T22:41:59.287893] [INFO ] [MAIN ] NEA: Loaded 35701 primary data records. [2025-10-02T22:41:59.436310] [DEBUG] [LOCAL ] NET: Loaded 53363 existing records from primary storage. [2025-10-02T22:41:59.471006] [INFO ] [MAIN ] NET: Loaded 53363 primary data records. [2025-10-02T22:42:00.310833] [DEBUG] [MAIN ] NEU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:00.312063] [INFO ] [MAIN ] NEU: Generated 1807 derivative records from 8349 primary records. [2025-10-02T22:42:00.313137] [DEBUG] [LOCAL ] NEU: Saving derivative data. [2025-10-02T22:42:00.347327] [DEBUG] [MAIN ] NEA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:00.349448] [INFO ] [MAIN ] NEA: Generated 1807 derivative records from 35701 primary records. [2025-10-02T22:42:00.350490] [DEBUG] [LOCAL ] NEA: Saving derivative data. [2025-10-02T22:42:00.353517] [DEBUG] [LOCAL ] NEU: Derivative data saved (1807 records). [2025-10-02T22:42:00.355181] [INFO ] [MAIN ] NEU: Successfully saved derivative data. [2025-10-02T22:42:00.357844] [INFO ] [MAIN ] Derivative Progress: 1171/1975 symbols completed. NEU took 1.3s. Estimated remaining: 5m 37s. Rate: 143.1 symbols/min [2025-10-02T22:42:00.368983] [INFO ] [MAIN ] NEXA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:00.400121] [DEBUG] [LOCAL ] NEA: Derivative data saved (1807 records). [2025-10-02T22:42:00.400515] [INFO ] [MAIN ] NEA: Successfully saved derivative data. [2025-10-02T22:42:00.403165] [INFO ] [MAIN ] Derivative Progress: 1172/1975 symbols completed. NEA took 1.3s. Estimated remaining: 5m 36s. Rate: 143.2 symbols/min [2025-10-02T22:42:00.407489] [DEBUG] [LOCAL ] NEXA: Loaded 4393 existing records from primary storage. [2025-10-02T22:42:00.403849] [DEBUG] [MAIN ] NET: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-02T22:42:00.407725] [INFO ] [MAIN ] NEXA: Loaded 4393 primary data records. [2025-10-02T22:42:00.409202] [INFO ] [MAIN ] NFG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:00.408844] [INFO ] [MAIN ] NET: Generated 1806 derivative records from 53363 primary records. [2025-10-02T22:42:00.409393] [DEBUG] [LOCAL ] NET: Saving derivative data. [2025-10-02T22:42:00.744289] [DEBUG] [LOCAL ] NET: Derivative data saved (1806 records). [2025-10-02T22:42:00.759675] [INFO ] [MAIN ] NET: Successfully saved derivative data. [2025-10-02T22:42:00.763205] [INFO ] [MAIN ] Derivative Progress: 1173/1975 symbols completed. NET took 1.7s. Estimated remaining: 5m 36s. Rate: 143.2 symbols/min [2025-10-02T22:42:00.764252] [INFO ] [MAIN ] NFJ: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:00.780923] [DEBUG] [LOCAL ] NFG: Loaded 38850 existing records from primary storage. [2025-10-02T22:42:00.781595] [INFO ] [MAIN ] NFG: Loaded 38850 primary data records. [2025-10-02T22:42:00.930910] [DEBUG] [LOCAL ] NFJ: Loaded 20601 existing records from primary storage. [2025-10-02T22:42:00.947024] [INFO ] [MAIN ] NFJ: Loaded 20601 primary data records. [2025-10-02T22:42:01.312488] [DEBUG] [MAIN ] NEXA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:01.328406] [INFO ] [MAIN ] NEXA: Generated 1807 derivative records from 4393 primary records. [2025-10-02T22:42:01.329019] [DEBUG] [LOCAL ] NEXA: Saving derivative data. [2025-10-02T22:42:01.434324] [DEBUG] [LOCAL ] NEXA: Derivative data saved (1807 records). [2025-10-02T22:42:01.553070] [INFO ] [MAIN ] NEXA: Successfully saved derivative data. [2025-10-02T22:42:01.578997] [INFO ] [MAIN ] Derivative Progress: 1174/1975 symbols completed. NEXA took 1.2s. Estimated remaining: 5m 36s. Rate: 143.1 symbols/min [2025-10-02T22:42:01.579495] [INFO ] [MAIN ] NGG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:01.604613] [DEBUG] [MAIN ] NFG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:01.605839] [INFO ] [MAIN ] NFG: Generated 1807 derivative records from 38850 primary records. [2025-10-02T22:42:01.607249] [DEBUG] [LOCAL ] NFG: Saving derivative data. [2025-10-02T22:42:01.645201] [DEBUG] [LOCAL ] NFG: Derivative data saved (1807 records). [2025-10-02T22:42:01.645748] [INFO ] [MAIN ] NFG: Successfully saved derivative data. [2025-10-02T22:42:01.649870] [INFO ] [MAIN ] Derivative Progress: 1175/1975 symbols completed. NFG took 1.2s. Estimated remaining: 5m 35s. Rate: 143.2 symbols/min [2025-10-02T22:42:01.651728] [INFO ] [MAIN ] NGL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:01.670445] [DEBUG] [LOCAL ] NGG: Loaded 46520 existing records from primary storage. [2025-10-02T22:42:01.691993] [DEBUG] [MAIN ] NFJ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:01.691546] [INFO ] [MAIN ] NGG: Loaded 46520 primary data records. [2025-10-02T22:42:01.693214] [INFO ] [MAIN ] NFJ: Generated 1807 derivative records from 20601 primary records. [2025-10-02T22:42:01.735320] [DEBUG] [LOCAL ] NFJ: Saving derivative data. [2025-10-02T22:42:01.885845] [DEBUG] [LOCAL ] NGL: Loaded 30447 existing records from primary storage. [2025-10-02T22:42:01.899348] [INFO ] [MAIN ] NGL: Loaded 30447 primary data records. [2025-10-02T22:42:02.082382] [DEBUG] [LOCAL ] NFJ: Derivative data saved (1807 records). [2025-10-02T22:42:02.111376] [INFO ] [MAIN ] NFJ: Successfully saved derivative data. [2025-10-02T22:42:02.184090] [INFO ] [MAIN ] Derivative Progress: 1176/1975 symbols completed. NFJ took 1.4s. Estimated remaining: 5m 35s. Rate: 143.2 symbols/min [2025-10-02T22:42:02.197458] [INFO ] [MAIN ] NGS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:02.418059] [DEBUG] [LOCAL ] NGS: Loaded 11618 existing records from primary storage. [2025-10-02T22:42:02.418483] [INFO ] [MAIN ] NGS: Loaded 11618 primary data records. [2025-10-02T22:42:02.576874] [DEBUG] [MAIN ] NGG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:02.589356] [INFO ] [MAIN ] NGG: Generated 1807 derivative records from 46520 primary records. [2025-10-02T22:42:02.642896] [DEBUG] [LOCAL ] NGG: Saving derivative data. [2025-10-02T22:42:02.801738] [DEBUG] [LOCAL ] NGG: Derivative data saved (1807 records). [2025-10-02T22:42:02.814949] [INFO ] [MAIN ] NGG: Successfully saved derivative data. [2025-10-02T22:42:02.815309] [DEBUG] [MAIN ] NGL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:02.817731] [INFO ] [MAIN ] Derivative Progress: 1177/1975 symbols completed. NGG took 1.2s. Estimated remaining: 5m 35s. Rate: 143.1 symbols/min [2025-10-02T22:42:02.817953] [INFO ] [MAIN ] NGVC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:02.819205] [INFO ] [MAIN ] NGL: Generated 1807 derivative records from 30447 primary records. [2025-10-02T22:42:02.820925] [DEBUG] [LOCAL ] NGL: Saving derivative data. [2025-10-02T22:42:02.846007] [DEBUG] [LOCAL ] NGL: Derivative data saved (1807 records). [2025-10-02T22:42:02.846580] [INFO ] [MAIN ] NGL: Successfully saved derivative data. [2025-10-02T22:42:02.851044] [INFO ] [MAIN ] Derivative Progress: 1178/1975 symbols completed. NGL took 1.2s. Estimated remaining: 5m 34s. Rate: 143.2 symbols/min [2025-10-02T22:42:02.851339] [INFO ] [MAIN ] NGVT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:02.873998] [DEBUG] [LOCAL ] NGVC: Loaded 22532 existing records from primary storage. [2025-10-02T22:42:02.874616] [INFO ] [MAIN ] NGVC: Loaded 22532 primary data records. [2025-10-02T22:42:02.874401] [DEBUG] [MAIN ] NGS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:02.893839] [INFO ] [MAIN ] NGS: Generated 1807 derivative records from 11618 primary records. [2025-10-02T22:42:02.917102] [DEBUG] [LOCAL ] NGS: Saving derivative data. [2025-10-02T22:42:03.032263] [DEBUG] [LOCAL ] NGVT: Loaded 24311 existing records from primary storage. [2025-10-02T22:42:03.047403] [INFO ] [MAIN ] NGVT: Loaded 24311 primary data records. [2025-10-02T22:42:03.063933] [DEBUG] [LOCAL ] NGS: Derivative data saved (1807 records). [2025-10-02T22:42:03.095511] [INFO ] [MAIN ] NGS: Successfully saved derivative data. [2025-10-02T22:42:03.154446] [INFO ] [MAIN ] Derivative Progress: 1179/1975 symbols completed. NGS took 1.0s. Estimated remaining: 5m 33s. Rate: 143.3 symbols/min [2025-10-02T22:42:03.168977] [INFO ] [MAIN ] NHI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:03.670232] [DEBUG] [LOCAL ] NHI: Loaded 22052 existing records from primary storage. [2025-10-02T22:42:03.670760] [INFO ] [MAIN ] NHI: Loaded 22052 primary data records. [2025-10-02T22:42:03.893996] [DEBUG] [MAIN ] NGVC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:04.013980] [INFO ] [MAIN ] NGVC: Generated 1807 derivative records from 22532 primary records. [2025-10-02T22:42:04.023468] [DEBUG] [LOCAL ] NGVC: Saving derivative data. [2025-10-02T22:42:04.047436] [DEBUG] [LOCAL ] NGVC: Derivative data saved (1807 records). [2025-10-02T22:42:04.055468] [INFO ] [MAIN ] NGVC: Successfully saved derivative data. [2025-10-02T22:42:04.062506] [INFO ] [MAIN ] Derivative Progress: 1180/1975 symbols completed. NGVC took 1.2s. Estimated remaining: 5m 33s. Rate: 143.1 symbols/min [2025-10-02T22:42:04.063768] [DEBUG] [MAIN ] NGVT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:04.063388] [INFO ] [MAIN ] NIC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:04.065816] [INFO ] [MAIN ] NGVT: Generated 1807 derivative records from 24311 primary records. [2025-10-02T22:42:04.065978] [DEBUG] [LOCAL ] NGVT: Saving derivative data. [2025-10-02T22:42:04.085683] [DEBUG] [LOCAL ] NGVT: Derivative data saved (1807 records). [2025-10-02T22:42:04.086031] [INFO ] [MAIN ] NGVT: Successfully saved derivative data. [2025-10-02T22:42:04.088533] [INFO ] [MAIN ] Derivative Progress: 1181/1975 symbols completed. NGVT took 1.2s. Estimated remaining: 5m 33s. Rate: 143.2 symbols/min [2025-10-02T22:42:04.089082] [INFO ] [MAIN ] NIE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:04.093224] [DEBUG] [LOCAL ] NIC: Loaded 9018 existing records from primary storage. [2025-10-02T22:42:04.093796] [INFO ] [MAIN ] NIC: Loaded 9018 primary data records. [2025-10-02T22:42:04.233247] [DEBUG] [LOCAL ] NIE: Loaded 11993 existing records from primary storage. [2025-10-02T22:42:04.255003] [INFO ] [MAIN ] NIE: Loaded 11993 primary data records. [2025-10-02T22:42:04.254925] [DEBUG] [MAIN ] NHI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:04.260967] [INFO ] [MAIN ] NHI: Generated 1807 derivative records from 22052 primary records. [2025-10-02T22:42:04.290736] [DEBUG] [LOCAL ] NHI: Saving derivative data. [2025-10-02T22:42:04.783449] [DEBUG] [LOCAL ] NHI: Derivative data saved (1807 records). [2025-10-02T22:42:04.812123] [INFO ] [MAIN ] NHI: Successfully saved derivative data. [2025-10-02T22:42:04.814731] [INFO ] [MAIN ] Derivative Progress: 1182/1975 symbols completed. NHI took 1.6s. Estimated remaining: 5m 32s. Rate: 143.1 symbols/min [2025-10-02T22:42:04.816394] [INFO ] [MAIN ] NIM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:04.829123] [DEBUG] [LOCAL ] NIM: Loaded 4079 existing records from primary storage. [2025-10-02T22:42:04.830568] [INFO ] [MAIN ] NIM: Loaded 4079 primary data records. [2025-10-02T22:42:04.987423] [DEBUG] [MAIN ] NIC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:05.000593] [INFO ] [MAIN ] NIC: Generated 1807 derivative records from 9018 primary records. [2025-10-02T22:42:05.011713] [DEBUG] [LOCAL ] NIC: Saving derivative data. [2025-10-02T22:42:05.237273] [DEBUG] [MAIN ] NIE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:05.244030] [INFO ] [MAIN ] NIE: Generated 1807 derivative records from 11993 primary records. [2025-10-02T22:42:05.253988] [DEBUG] [LOCAL ] NIE: Saving derivative data. [2025-10-02T22:42:05.276519] [DEBUG] [LOCAL ] NIE: Derivative data saved (1807 records). [2025-10-02T22:42:05.277420] [INFO ] [MAIN ] NIE: Successfully saved derivative data. [2025-10-02T22:42:05.281799] [DEBUG] [LOCAL ] NIC: Derivative data saved (1807 records). [2025-10-02T22:42:05.280677] [INFO ] [MAIN ] Derivative Progress: 1183/1975 symbols completed. NIE took 1.2s. Estimated remaining: 5m 32s. Rate: 143.1 symbols/min [2025-10-02T22:42:05.282209] [INFO ] [MAIN ] NIC: Successfully saved derivative data. [2025-10-02T22:42:05.285112] [INFO ] [MAIN ] Derivative Progress: 1184/1975 symbols completed. NIC took 1.2s. Estimated remaining: 5m 31s. Rate: 143.2 symbols/min [2025-10-02T22:42:05.307282] [DEBUG] [MAIN ] NIM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:05.308080] [INFO ] [MAIN ] NIM: Generated 1807 derivative records from 4079 primary records. [2025-10-02T22:42:05.308145] [DEBUG] [LOCAL ] NIM: Saving derivative data. [2025-10-02T22:42:05.323962] [DEBUG] [LOCAL ] NIM: Derivative data saved (1807 records). [2025-10-02T22:42:05.324271] [INFO ] [MAIN ] NIM: Successfully saved derivative data. [2025-10-02T22:42:05.326921] [INFO ] [MAIN ] Derivative Progress: 1185/1975 symbols completed. NIM took 0.5s. Estimated remaining: 5m 31s. Rate: 143.4 symbols/min [2025-10-02T22:42:05.327486] [INFO ] [MAIN ] NINE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:05.327681] [INFO ] [MAIN ] NJR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:05.327605] [INFO ] [MAIN ] NIO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:05.365527] [DEBUG] [LOCAL ] NINE: Loaded 28398 existing records from primary storage. [2025-10-02T22:42:05.365947] [INFO ] [MAIN ] NINE: Loaded 28398 primary data records. [2025-10-02T22:42:05.588192] [DEBUG] [LOCAL ] NJR: Loaded 38448 existing records from primary storage. [2025-10-02T22:42:05.622012] [DEBUG] [LOCAL ] NIO: Loaded 54192 existing records from primary storage. [2025-10-02T22:42:05.622141] [INFO ] [MAIN ] NJR: Loaded 38448 primary data records. [2025-10-02T22:42:05.750160] [INFO ] [MAIN ] NIO: Loaded 54192 primary data records. [2025-10-02T22:42:06.487534] [DEBUG] [MAIN ] NINE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:06.489130] [INFO ] [MAIN ] NINE: Generated 1807 derivative records from 28398 primary records. [2025-10-02T22:42:06.489442] [DEBUG] [LOCAL ] NINE: Saving derivative data. [2025-10-02T22:42:06.513471] [DEBUG] [LOCAL ] NINE: Derivative data saved (1807 records). [2025-10-02T22:42:06.513928] [INFO ] [MAIN ] NINE: Successfully saved derivative data. [2025-10-02T22:42:06.516196] [INFO ] [MAIN ] Derivative Progress: 1186/1975 symbols completed. NINE took 1.2s. Estimated remaining: 5m 31s. Rate: 143.1 symbols/min [2025-10-02T22:42:06.516502] [INFO ] [MAIN ] NKX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:06.550710] [DEBUG] [MAIN ] NIO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:06.556157] [INFO ] [MAIN ] NIO: Generated 1807 derivative records from 54192 primary records. [2025-10-02T22:42:06.555178] [DEBUG] [MAIN ] NJR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:06.557220] [INFO ] [MAIN ] NJR: Generated 1807 derivative records from 38448 primary records. [2025-10-02T22:42:06.556371] [DEBUG] [LOCAL ] NIO: Saving derivative data. [2025-10-02T22:42:06.558273] [DEBUG] [LOCAL ] NJR: Saving derivative data. [2025-10-02T22:42:06.576540] [DEBUG] [LOCAL ] NKX: Loaded 13792 existing records from primary storage. [2025-10-02T22:42:06.586607] [INFO ] [MAIN ] NKX: Loaded 13792 primary data records. [2025-10-02T22:42:06.697602] [DEBUG] [LOCAL ] NIO: Derivative data saved (1807 records). [2025-10-02T22:42:06.714721] [INFO ] [MAIN ] NIO: Successfully saved derivative data. [2025-10-02T22:42:06.724543] [DEBUG] [LOCAL ] NJR: Derivative data saved (1807 records). [2025-10-02T22:42:06.732571] [INFO ] [MAIN ] NJR: Successfully saved derivative data. [2025-10-02T22:42:06.727596] [INFO ] [MAIN ] Derivative Progress: 1187/1975 symbols completed. NIO took 1.4s. Estimated remaining: 5m 30s. Rate: 143.2 symbols/min [2025-10-02T22:42:06.736762] [INFO ] [MAIN ] NLOP: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:06.736874] [INFO ] [MAIN ] Derivative Progress: 1188/1975 symbols completed. NJR took 1.4s. Estimated remaining: 5m 29s. Rate: 143.3 symbols/min [2025-10-02T22:42:06.743391] [INFO ] [MAIN ] NLY: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:06.952492] [DEBUG] [LOCAL ] NLOP: Loaded 11794 existing records from primary storage. [2025-10-02T22:42:06.952726] [INFO ] [MAIN ] NLOP: Loaded 11794 primary data records. [2025-10-02T22:42:07.312260] [DEBUG] [LOCAL ] NLY: Loaded 53969 existing records from primary storage. [2025-10-02T22:42:07.313084] [INFO ] [MAIN ] NLY: Loaded 53969 primary data records. [2025-10-02T22:42:07.480242] [DEBUG] [MAIN ] NKX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:07.529544] [INFO ] [MAIN ] NKX: Generated 1807 derivative records from 13792 primary records. [2025-10-02T22:42:07.696337] [DEBUG] [LOCAL ] NKX: Saving derivative data. [2025-10-02T22:42:07.744891] [DEBUG] [MAIN ] NLOP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:07.744713] [DEBUG] [LOCAL ] NKX: Derivative data saved (1807 records). [2025-10-02T22:42:07.745999] [INFO ] [MAIN ] NLOP: Generated 1807 derivative records from 11794 primary records. [2025-10-02T22:42:07.747262] [DEBUG] [LOCAL ] NLOP: Saving derivative data. [2025-10-02T22:42:07.747412] [INFO ] [MAIN ] NKX: Successfully saved derivative data. [2025-10-02T22:42:07.751013] [INFO ] [MAIN ] Derivative Progress: 1189/1975 symbols completed. NKX took 1.2s. Estimated remaining: 5m 29s. Rate: 143.1 symbols/min [2025-10-02T22:42:07.751288] [INFO ] [MAIN ] NMAI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:07.776107] [DEBUG] [LOCAL ] NLOP: Derivative data saved (1807 records). [2025-10-02T22:42:07.776417] [INFO ] [MAIN ] NLOP: Successfully saved derivative data. [2025-10-02T22:42:07.779016] [INFO ] [MAIN ] Derivative Progress: 1190/1975 symbols completed. NLOP took 1.0s. Estimated remaining: 5m 29s. Rate: 143.3 symbols/min [2025-10-02T22:42:07.779263] [INFO ] [MAIN ] NMCO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:07.799434] [DEBUG] [LOCAL ] NMAI: Loaded 12985 existing records from primary storage. [2025-10-02T22:42:07.799718] [INFO ] [MAIN ] NMAI: Loaded 12985 primary data records. [2025-10-02T22:42:07.799937] [DEBUG] [MAIN ] NLY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:07.834761] [INFO ] [MAIN ] NLY: Generated 1807 derivative records from 53969 primary records. [2025-10-02T22:42:07.850425] [DEBUG] [LOCAL ] NLY: Saving derivative data. [2025-10-02T22:42:07.968578] [DEBUG] [LOCAL ] NMCO: Loaded 16840 existing records from primary storage. [2025-10-02T22:42:07.985109] [INFO ] [MAIN ] NMCO: Loaded 16840 primary data records. [2025-10-02T22:42:08.259960] [DEBUG] [LOCAL ] NLY: Derivative data saved (1807 records). [2025-10-02T22:42:08.276678] [INFO ] [MAIN ] NLY: Successfully saved derivative data. [2025-10-02T22:42:08.301210] [INFO ] [MAIN ] Derivative Progress: 1191/1975 symbols completed. NLY took 1.6s. Estimated remaining: 5m 28s. Rate: 143.2 symbols/min [2025-10-02T22:42:08.313962] [INFO ] [MAIN ] NMG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:08.530357] [DEBUG] [LOCAL ] NMG: Loaded 8349 existing records from primary storage. [2025-10-02T22:42:08.530832] [INFO ] [MAIN ] NMG: Loaded 8349 primary data records. [2025-10-02T22:42:08.886038] [DEBUG] [MAIN ] NMAI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:08.887411] [INFO ] [MAIN ] NMAI: Generated 1807 derivative records from 12985 primary records. [2025-10-02T22:42:08.887726] [DEBUG] [LOCAL ] NMAI: Saving derivative data. [2025-10-02T22:42:08.917240] [DEBUG] [LOCAL ] NMAI: Derivative data saved (1807 records). [2025-10-02T22:42:08.917739] [INFO ] [MAIN ] NMAI: Successfully saved derivative data. [2025-10-02T22:42:08.920431] [INFO ] [MAIN ] Derivative Progress: 1192/1975 symbols completed. NMAI took 1.2s. Estimated remaining: 5m 28s. Rate: 143.2 symbols/min [2025-10-02T22:42:08.936667] [DEBUG] [MAIN ] NMCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:08.936237] [INFO ] [MAIN ] NMI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:08.938409] [INFO ] [MAIN ] NMCO: Generated 1807 derivative records from 16840 primary records. [2025-10-02T22:42:08.938599] [DEBUG] [LOCAL ] NMCO: Saving derivative data. [2025-10-02T22:42:08.970602] [DEBUG] [LOCAL ] NMI: Loaded 4082 existing records from primary storage. [2025-10-02T22:42:08.977440] [INFO ] [MAIN ] NMI: Loaded 4082 primary data records. [2025-10-02T22:42:08.977705] [DEBUG] [MAIN ] NMG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:08.998379] [INFO ] [MAIN ] NMG: Generated 1807 derivative records from 8349 primary records. [2025-10-02T22:42:09.006238] [DEBUG] [LOCAL ] NMG: Saving derivative data. [2025-10-02T22:42:08.999144] [DEBUG] [LOCAL ] NMCO: Derivative data saved (1807 records). [2025-10-02T22:42:09.052830] [INFO ] [MAIN ] NMCO: Successfully saved derivative data. [2025-10-02T22:42:09.107134] [INFO ] [MAIN ] Derivative Progress: 1193/1975 symbols completed. NMCO took 1.3s. Estimated remaining: 5m 28s. Rate: 143.2 symbols/min [2025-10-02T22:42:09.124462] [INFO ] [MAIN ] NMM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:09.350390] [DEBUG] [LOCAL ] NMG: Derivative data saved (1807 records). [2025-10-02T22:42:09.361736] [INFO ] [MAIN ] NMG: Successfully saved derivative data. [2025-10-02T22:42:09.364384] [INFO ] [MAIN ] Derivative Progress: 1194/1975 symbols completed. NMG took 1.1s. Estimated remaining: 5m 27s. Rate: 143.3 symbols/min [2025-10-02T22:42:09.365002] [INFO ] [MAIN ] NMR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:09.373553] [DEBUG] [LOCAL ] NMM: Loaded 14430 existing records from primary storage. [2025-10-02T22:42:09.374341] [INFO ] [MAIN ] NMM: Loaded 14430 primary data records. [2025-10-02T22:42:09.593448] [DEBUG] [LOCAL ] NMR: Loaded 35236 existing records from primary storage. [2025-10-02T22:42:09.597035] [INFO ] [MAIN ] NMR: Loaded 35236 primary data records. [2025-10-02T22:42:09.940284] [DEBUG] [MAIN ] NMI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:09.956864] [INFO ] [MAIN ] NMI: Generated 1807 derivative records from 4082 primary records. [2025-10-02T22:42:09.972777] [DEBUG] [LOCAL ] NMI: Saving derivative data. [2025-10-02T22:42:10.169984] [DEBUG] [LOCAL ] NMI: Derivative data saved (1807 records). [2025-10-02T22:42:10.171537] [INFO ] [MAIN ] NMI: Successfully saved derivative data. [2025-10-02T22:42:10.173989] [INFO ] [MAIN ] Derivative Progress: 1195/1975 symbols completed. NMI took 1.2s. Estimated remaining: 5m 27s. Rate: 143.2 symbols/min [2025-10-02T22:42:10.174485] [INFO ] [MAIN ] NMS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:10.188566] [DEBUG] [MAIN ] NMM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:10.189685] [INFO ] [MAIN ] NMM: Generated 1807 derivative records from 14430 primary records. [2025-10-02T22:42:10.189853] [DEBUG] [LOCAL ] NMM: Saving derivative data. [2025-10-02T22:42:10.210910] [DEBUG] [LOCAL ] NMS: Loaded 2875 existing records from primary storage. [2025-10-02T22:42:10.211066] [INFO ] [MAIN ] NMS: Loaded 2875 primary data records. [2025-10-02T22:42:10.304387] [DEBUG] [LOCAL ] NMM: Derivative data saved (1807 records). [2025-10-02T22:42:10.318081] [INFO ] [MAIN ] NMM: Successfully saved derivative data. [2025-10-02T22:42:10.328912] [INFO ] [MAIN ] Derivative Progress: 1196/1975 symbols completed. NMM took 1.2s. Estimated remaining: 5m 26s. Rate: 143.2 symbols/min [2025-10-02T22:42:10.332957] [INFO ] [MAIN ] NMT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:10.391168] [DEBUG] [LOCAL ] NMT: Loaded 2883 existing records from primary storage. [2025-10-02T22:42:10.548552] [INFO ] [MAIN ] NMT: Loaded 2883 primary data records. [2025-10-02T22:42:10.583147] [DEBUG] [MAIN ] NMR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:10.607487] [INFO ] [MAIN ] NMR: Generated 1807 derivative records from 35236 primary records. [2025-10-02T22:42:10.607787] [DEBUG] [LOCAL ] NMR: Saving derivative data. [2025-10-02T22:42:10.920838] [DEBUG] [LOCAL ] NMR: Derivative data saved (1807 records). [2025-10-02T22:42:10.921036] [INFO ] [MAIN ] NMR: Successfully saved derivative data. [2025-10-02T22:42:10.923965] [INFO ] [MAIN ] Derivative Progress: 1197/1975 symbols completed. NMR took 1.6s. Estimated remaining: 5m 26s. Rate: 143.2 symbols/min [2025-10-02T22:42:10.924368] [INFO ] [MAIN ] NMZ: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:10.949469] [DEBUG] [MAIN ] NMS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:10.950536] [INFO ] [MAIN ] NMS: Generated 1807 derivative records from 2875 primary records. [2025-10-02T22:42:10.956272] [DEBUG] [LOCAL ] NMS: Saving derivative data. [2025-10-02T22:42:10.980792] [DEBUG] [LOCAL ] NMZ: Loaded 21855 existing records from primary storage. [2025-10-02T22:42:10.981591] [INFO ] [MAIN ] NMZ: Loaded 21855 primary data records. [2025-10-02T22:42:10.988774] [DEBUG] [LOCAL ] NMS: Derivative data saved (1807 records). [2025-10-02T22:42:11.023462] [INFO ] [MAIN ] NMS: Successfully saved derivative data. [2025-10-02T22:42:11.025818] [INFO ] [MAIN ] Derivative Progress: 1198/1975 symbols completed. NMS took 0.9s. Estimated remaining: 5m 25s. Rate: 143.3 symbols/min [2025-10-02T22:42:11.117732] [DEBUG] [MAIN ] NMT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:11.128978] [INFO ] [MAIN ] NMT: Generated 1807 derivative records from 2883 primary records. [2025-10-02T22:42:11.139349] [DEBUG] [LOCAL ] NMT: Saving derivative data. [2025-10-02T22:42:11.360338] [DEBUG] [LOCAL ] NMT: Derivative data saved (1807 records). [2025-10-02T22:42:11.360491] [INFO ] [MAIN ] NMT: Successfully saved derivative data. [2025-10-02T22:42:11.363007] [INFO ] [MAIN ] Derivative Progress: 1199/1975 symbols completed. NMT took 1.0s. Estimated remaining: 5m 25s. Rate: 143.3 symbols/min [2025-10-02T22:42:11.390098] [DEBUG] [MAIN ] NMZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:11.390882] [INFO ] [MAIN ] NMZ: Generated 1807 derivative records from 21855 primary records. [2025-10-02T22:42:11.390956] [DEBUG] [LOCAL ] NMZ: Saving derivative data. [2025-10-02T22:42:11.408746] [DEBUG] [LOCAL ] NMZ: Derivative data saved (1807 records). [2025-10-02T22:42:11.408921] [INFO ] [MAIN ] NMZ: Successfully saved derivative data. [2025-10-02T22:42:11.411500] [INFO ] [MAIN ] Derivative Progress: 1200/1975 symbols completed. NMZ took 0.5s. Estimated remaining: 5m 24s. Rate: 143.4 symbols/min [2025-10-02T22:42:11.412311] [INFO ] [MAIN ] NNN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:11.412384] [INFO ] [MAIN ] NNY: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:11.412220] [INFO ] [MAIN ] NNI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:11.424577] [DEBUG] [LOCAL ] NNY: Loaded 5763 existing records from primary storage. [2025-10-02T22:42:11.424878] [INFO ] [MAIN ] NNY: Loaded 5763 primary data records. [2025-10-02T22:42:11.487127] [DEBUG] [LOCAL ] NNI: Loaded 10284 existing records from primary storage. [2025-10-02T22:42:11.516169] [INFO ] [MAIN ] NNI: Loaded 10284 primary data records. [2025-10-02T22:42:11.821899] [DEBUG] [LOCAL ] NNN: Loaded 48691 existing records from primary storage. [2025-10-02T22:42:11.952147] [INFO ] [MAIN ] NNN: Loaded 48691 primary data records. [2025-10-02T22:42:12.597491] [DEBUG] [MAIN ] NNY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:12.599516] [INFO ] [MAIN ] NNY: Generated 1807 derivative records from 5763 primary records. [2025-10-02T22:42:12.600408] [DEBUG] [LOCAL ] NNY: Saving derivative data. [2025-10-02T22:42:12.630194] [DEBUG] [LOCAL ] NNY: Derivative data saved (1807 records). [2025-10-02T22:42:12.630764] [INFO ] [MAIN ] NNY: Successfully saved derivative data. [2025-10-02T22:42:12.632848] [INFO ] [MAIN ] Derivative Progress: 1201/1975 symbols completed. NNY took 1.2s. Estimated remaining: 5m 24s. Rate: 143.2 symbols/min [2025-10-02T22:42:12.633342] [INFO ] [MAIN ] NOA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:12.648334] [DEBUG] [MAIN ] NNI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:12.649397] [INFO ] [MAIN ] NNI: Generated 1807 derivative records from 10284 primary records. [2025-10-02T22:42:12.649632] [DEBUG] [LOCAL ] NNI: Saving derivative data. [2025-10-02T22:42:12.689860] [DEBUG] [MAIN ] NNN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:12.699925] [DEBUG] [LOCAL ] NNI: Derivative data saved (1807 records). [2025-10-02T22:42:12.697444] [INFO ] [MAIN ] NNN: Generated 1807 derivative records from 48691 primary records. [2025-10-02T22:42:12.700067] [DEBUG] [LOCAL ] NNN: Saving derivative data. [2025-10-02T22:42:12.700774] [INFO ] [MAIN ] NNI: Successfully saved derivative data. [2025-10-02T22:42:12.701566] [DEBUG] [LOCAL ] NOA: Loaded 16282 existing records from primary storage. [2025-10-02T22:42:12.704690] [INFO ] [MAIN ] NOA: Loaded 16282 primary data records. [2025-10-02T22:42:12.704362] [INFO ] [MAIN ] Derivative Progress: 1202/1975 symbols completed. NNI took 1.3s. Estimated remaining: 5m 24s. Rate: 143.3 symbols/min [2025-10-02T22:42:12.727284] [INFO ] [MAIN ] NOAH: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:12.855958] [DEBUG] [LOCAL ] NNN: Derivative data saved (1807 records). [2025-10-02T22:42:12.871949] [INFO ] [MAIN ] NNN: Successfully saved derivative data. [2025-10-02T22:42:12.951484] [INFO ] [MAIN ] Derivative Progress: 1203/1975 symbols completed. NNN took 1.5s. Estimated remaining: 5m 23s. Rate: 143.3 symbols/min [2025-10-02T22:42:13.079831] [DEBUG] [LOCAL ] NOAH: Loaded 20504 existing records from primary storage. [2025-10-02T22:42:13.085193] [INFO ] [MAIN ] NOC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:13.095349] [INFO ] [MAIN ] NOAH: Loaded 20504 primary data records. [2025-10-02T22:42:13.475198] [DEBUG] [LOCAL ] NOC: Loaded 42344 existing records from primary storage. [2025-10-02T22:42:13.476160] [INFO ] [MAIN ] NOC: Loaded 42344 primary data records. [2025-10-02T22:42:13.541781] [DEBUG] [MAIN ] NOA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:13.577634] [INFO ] [MAIN ] NOA: Generated 1807 derivative records from 16282 primary records. [2025-10-02T22:42:13.605218] [DEBUG] [LOCAL ] NOA: Saving derivative data. [2025-10-02T22:42:13.796432] [DEBUG] [LOCAL ] NOA: Derivative data saved (1807 records). [2025-10-02T22:42:13.838952] [INFO ] [MAIN ] NOA: Successfully saved derivative data. [2025-10-02T22:42:13.841212] [INFO ] [MAIN ] Derivative Progress: 1204/1975 symbols completed. NOA took 1.2s. Estimated remaining: 5m 23s. Rate: 143.2 symbols/min [2025-10-02T22:42:13.841719] [INFO ] [MAIN ] NOG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:13.862620] [DEBUG] [MAIN ] NOAH: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-02T22:42:13.863951] [INFO ] [MAIN ] NOAH: Generated 1806 derivative records from 20504 primary records. [2025-10-02T22:42:13.864344] [DEBUG] [LOCAL ] NOAH: Saving derivative data. [2025-10-02T22:42:13.887437] [DEBUG] [LOCAL ] NOAH: Derivative data saved (1806 records). [2025-10-02T22:42:13.888859] [INFO ] [MAIN ] NOAH: Successfully saved derivative data. [2025-10-02T22:42:13.892625] [INFO ] [MAIN ] Derivative Progress: 1205/1975 symbols completed. NOAH took 1.2s. Estimated remaining: 5m 22s. Rate: 143.3 symbols/min [2025-10-02T22:42:13.893984] [INFO ] [MAIN ] NOK: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:13.922344] [DEBUG] [MAIN ] NOC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:13.923229] [INFO ] [MAIN ] NOC: Generated 1807 derivative records from 42344 primary records. [2025-10-02T22:42:13.923369] [DEBUG] [LOCAL ] NOC: Saving derivative data. [2025-10-02T22:42:13.956725] [DEBUG] [LOCAL ] NOG: Loaded 51580 existing records from primary storage. [2025-10-02T22:42:13.957274] [INFO ] [MAIN ] NOG: Loaded 51580 primary data records. [2025-10-02T22:42:13.957956] [DEBUG] [LOCAL ] NOC: Derivative data saved (1807 records). [2025-10-02T22:42:13.958163] [INFO ] [MAIN ] NOC: Successfully saved derivative data. [2025-10-02T22:42:13.965661] [INFO ] [MAIN ] Derivative Progress: 1206/1975 symbols completed. NOC took 0.9s. Estimated remaining: 5m 22s. Rate: 143.4 symbols/min [2025-10-02T22:42:13.965838] [INFO ] [MAIN ] NOMD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:14.373969] [DEBUG] [LOCAL ] NOK: Loaded 54011 existing records from primary storage. [2025-10-02T22:42:14.397129] [INFO ] [MAIN ] NOK: Loaded 54011 primary data records. [2025-10-02T22:42:14.398441] [DEBUG] [LOCAL ] NOMD: Loaded 41855 existing records from primary storage. [2025-10-02T22:42:14.417749] [INFO ] [MAIN ] NOMD: Loaded 41855 primary data records. [2025-10-02T22:42:15.120195] [DEBUG] [MAIN ] NOG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:15.121851] [INFO ] [MAIN ] NOG: Generated 1807 derivative records from 51580 primary records. [2025-10-02T22:42:15.122250] [DEBUG] [LOCAL ] NOG: Saving derivative data. [2025-10-02T22:42:15.152631] [DEBUG] [LOCAL ] NOG: Derivative data saved (1807 records). [2025-10-02T22:42:15.156386] [INFO ] [MAIN ] NOG: Successfully saved derivative data. [2025-10-02T22:42:15.159410] [INFO ] [MAIN ] Derivative Progress: 1207/1975 symbols completed. NOG took 1.3s. Estimated remaining: 5m 22s. Rate: 143.2 symbols/min [2025-10-02T22:42:15.159908] [INFO ] [MAIN ] NOTE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:15.189727] [DEBUG] [MAIN ] NOMD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:15.189238] [DEBUG] [MAIN ] NOK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:15.190606] [INFO ] [MAIN ] NOMD: Generated 1807 derivative records from 41855 primary records. [2025-10-02T22:42:15.191732] [INFO ] [MAIN ] NOK: Generated 1807 derivative records from 54011 primary records. [2025-10-02T22:42:15.191823] [DEBUG] [LOCAL ] NOK: Saving derivative data. [2025-10-02T22:42:15.190790] [DEBUG] [LOCAL ] NOMD: Saving derivative data. [2025-10-02T22:42:15.222927] [DEBUG] [LOCAL ] NOK: Derivative data saved (1807 records). [2025-10-02T22:42:15.223544] [INFO ] [MAIN ] NOK: Successfully saved derivative data. [2025-10-02T22:42:15.226637] [INFO ] [MAIN ] Derivative Progress: 1208/1975 symbols completed. NOK took 1.3s. Estimated remaining: 5m 21s. Rate: 143.3 symbols/min [2025-10-02T22:42:15.227174] [INFO ] [MAIN ] NOV: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:15.234579] [DEBUG] [LOCAL ] NOMD: Derivative data saved (1807 records). [2025-10-02T22:42:15.234774] [INFO ] [MAIN ] NOMD: Successfully saved derivative data. [2025-10-02T22:42:15.237506] [INFO ] [MAIN ] Derivative Progress: 1209/1975 symbols completed. NOMD took 1.3s. Estimated remaining: 5m 21s. Rate: 143.4 symbols/min [2025-10-02T22:42:15.237901] [INFO ] [MAIN ] NPCT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:15.287600] [DEBUG] [LOCAL ] NPCT: Loaded 17141 existing records from primary storage. [2025-10-02T22:42:15.287804] [INFO ] [MAIN ] NPCT: Loaded 17141 primary data records. [2025-10-02T22:42:15.394506] [DEBUG] [LOCAL ] NOTE: Loaded 42000 existing records from primary storage. [2025-10-02T22:42:15.438468] [INFO ] [MAIN ] NOTE: Loaded 42000 primary data records. [2025-10-02T22:42:15.439258] [DEBUG] [LOCAL ] NOV: Loaded 53570 existing records from primary storage. [2025-10-02T22:42:15.450735] [INFO ] [MAIN ] NOV: Loaded 53570 primary data records. [2025-10-02T22:42:16.460912] [DEBUG] [MAIN ] NPCT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:16.462484] [INFO ] [MAIN ] NPCT: Generated 1807 derivative records from 17141 primary records. [2025-10-02T22:42:16.462728] [DEBUG] [LOCAL ] NPCT: Saving derivative data. [2025-10-02T22:42:16.501208] [DEBUG] [MAIN ] NOTE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:16.503890] [INFO ] [MAIN ] NOTE: Generated 1807 derivative records from 42000 primary records. [2025-10-02T22:42:16.504006] [DEBUG] [LOCAL ] NOTE: Saving derivative data. [2025-10-02T22:42:16.505180] [DEBUG] [LOCAL ] NPCT: Derivative data saved (1807 records). [2025-10-02T22:42:16.527374] [INFO ] [MAIN ] NPCT: Successfully saved derivative data. [2025-10-02T22:42:16.533488] [INFO ] [MAIN ] Derivative Progress: 1210/1975 symbols completed. NPCT took 1.3s. Estimated remaining: 5m 21s. Rate: 143.1 symbols/min [2025-10-02T22:42:16.534352] [INFO ] [MAIN ] NPFD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:16.530630] [DEBUG] [MAIN ] NOV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:16.536008] [INFO ] [MAIN ] NOV: Generated 1807 derivative records from 53570 primary records. [2025-10-02T22:42:16.536687] [DEBUG] [LOCAL ] NOV: Saving derivative data. [2025-10-02T22:42:16.554120] [DEBUG] [LOCAL ] NOTE: Derivative data saved (1807 records). [2025-10-02T22:42:16.554799] [INFO ] [MAIN ] NOTE: Successfully saved derivative data. [2025-10-02T22:42:16.562171] [INFO ] [MAIN ] Derivative Progress: 1211/1975 symbols completed. NOTE took 1.4s. Estimated remaining: 5m 20s. Rate: 143.3 symbols/min [2025-10-02T22:42:16.564086] [INFO ] [MAIN ] NPK: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:16.565398] [DEBUG] [LOCAL ] NOV: Derivative data saved (1807 records). [2025-10-02T22:42:16.571603] [INFO ] [MAIN ] NOV: Successfully saved derivative data. [2025-10-02T22:42:16.573188] [DEBUG] [LOCAL ] NPFD: Loaded 9915 existing records from primary storage. [2025-10-02T22:42:16.576168] [INFO ] [MAIN ] Derivative Progress: 1212/1975 symbols completed. NOV took 1.3s. Estimated remaining: 5m 19s. Rate: 143.4 symbols/min [2025-10-02T22:42:16.576774] [INFO ] [MAIN ] NPFD: Loaded 9915 primary data records. [2025-10-02T22:42:16.576609] [INFO ] [MAIN ] NPO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:16.674966] [DEBUG] [LOCAL ] NPK: Loaded 8119 existing records from primary storage. [2025-10-02T22:42:16.718584] [INFO ] [MAIN ] NPK: Loaded 8119 primary data records. [2025-10-02T22:42:16.902872] [DEBUG] [LOCAL ] NPO: Loaded 13098 existing records from primary storage. [2025-10-02T22:42:16.963580] [INFO ] [MAIN ] NPO: Loaded 13098 primary data records. [2025-10-02T22:42:17.673843] [DEBUG] [MAIN ] NPFD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:17.676191] [INFO ] [MAIN ] NPFD: Generated 1807 derivative records from 9915 primary records. [2025-10-02T22:42:17.677724] [DEBUG] [LOCAL ] NPFD: Saving derivative data. [2025-10-02T22:42:17.711001] [DEBUG] [MAIN ] NPK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:17.712835] [INFO ] [MAIN ] NPK: Generated 1807 derivative records from 8119 primary records. [2025-10-02T22:42:17.713826] [DEBUG] [LOCAL ] NPK: Saving derivative data. [2025-10-02T22:42:17.716938] [DEBUG] [LOCAL ] NPFD: Derivative data saved (1807 records). [2025-10-02T22:42:17.725510] [INFO ] [MAIN ] NPFD: Successfully saved derivative data. [2025-10-02T22:42:17.728255] [INFO ] [MAIN ] Derivative Progress: 1213/1975 symbols completed. NPFD took 1.2s. Estimated remaining: 5m 19s. Rate: 143.2 symbols/min [2025-10-02T22:42:17.747468] [DEBUG] [MAIN ] NPO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:17.749957] [INFO ] [MAIN ] NPO: Generated 1807 derivative records from 13098 primary records. [2025-10-02T22:42:17.750307] [DEBUG] [LOCAL ] NPO: Saving derivative data. [2025-10-02T22:42:17.766421] [DEBUG] [LOCAL ] NPK: Derivative data saved (1807 records). [2025-10-02T22:42:17.767139] [INFO ] [MAIN ] NPK: Successfully saved derivative data. [2025-10-02T22:42:17.770278] [INFO ] [MAIN ] Derivative Progress: 1214/1975 symbols completed. NPK took 1.2s. Estimated remaining: 5m 19s. Rate: 143.3 symbols/min [2025-10-02T22:42:17.773798] [DEBUG] [LOCAL ] NPO: Derivative data saved (1807 records). [2025-10-02T22:42:17.773917] [INFO ] [MAIN ] NPO: Successfully saved derivative data. [2025-10-02T22:42:17.776289] [INFO ] [MAIN ] Derivative Progress: 1215/1975 symbols completed. NPO took 1.2s. Estimated remaining: 5m 18s. Rate: 143.4 symbols/min [2025-10-02T22:42:17.776943] [INFO ] [MAIN ] NPWR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:17.776869] [INFO ] [MAIN ] NPV: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:17.777054] [INFO ] [MAIN ] NQP: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:17.789882] [DEBUG] [LOCAL ] NPV: Loaded 5083 existing records from primary storage. [2025-10-02T22:42:17.790144] [INFO ] [MAIN ] NPV: Loaded 5083 primary data records. [2025-10-02T22:42:17.848914] [DEBUG] [LOCAL ] NQP: Loaded 9362 existing records from primary storage. [2025-10-02T22:42:17.872845] [INFO ] [MAIN ] NQP: Loaded 9362 primary data records. [2025-10-02T22:42:18.307801] [DEBUG] [LOCAL ] NPWR: Loaded 43122 existing records from primary storage. [2025-10-02T22:42:18.307967] [INFO ] [MAIN ] NPWR: Loaded 43122 primary data records. [2025-10-02T22:42:18.935791] [DEBUG] [MAIN ] NPV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:18.937169] [INFO ] [MAIN ] NPV: Generated 1807 derivative records from 5083 primary records. [2025-10-02T22:42:18.938499] [DEBUG] [LOCAL ] NPV: Saving derivative data. [2025-10-02T22:42:18.971019] [DEBUG] [MAIN ] NQP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:18.972451] [INFO ] [MAIN ] NQP: Generated 1807 derivative records from 9362 primary records. [2025-10-02T22:42:18.973172] [DEBUG] [LOCAL ] NQP: Saving derivative data. [2025-10-02T22:42:18.976127] [DEBUG] [LOCAL ] NPV: Derivative data saved (1807 records). [2025-10-02T22:42:18.983580] [INFO ] [MAIN ] NPV: Successfully saved derivative data. [2025-10-02T22:42:18.989736] [INFO ] [MAIN ] Derivative Progress: 1216/1975 symbols completed. NPV took 1.2s. Estimated remaining: 5m 18s. Rate: 143.2 symbols/min [2025-10-02T22:42:18.990993] [INFO ] [MAIN ] NRDY: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:19.013190] [DEBUG] [MAIN ] NPWR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:19.014238] [INFO ] [MAIN ] NPWR: Generated 1807 derivative records from 43122 primary records. [2025-10-02T22:42:19.012825] [DEBUG] [LOCAL ] NQP: Derivative data saved (1807 records). [2025-10-02T22:42:19.014559] [INFO ] [MAIN ] NQP: Successfully saved derivative data. [2025-10-02T22:42:19.017007] [INFO ] [MAIN ] Derivative Progress: 1217/1975 symbols completed. NQP took 1.2s. Estimated remaining: 5m 17s. Rate: 143.3 symbols/min [2025-10-02T22:42:19.014482] [DEBUG] [LOCAL ] NPWR: Saving derivative data. [2025-10-02T22:42:19.017241] [INFO ] [MAIN ] NREF: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:19.054615] [DEBUG] [LOCAL ] NREF: Loaded 7915 existing records from primary storage. [2025-10-02T22:42:19.055527] [INFO ] [MAIN ] NREF: Loaded 7915 primary data records. [2025-10-02T22:42:19.056151] [DEBUG] [LOCAL ] NPWR: Derivative data saved (1807 records). [2025-10-02T22:42:19.068378] [INFO ] [MAIN ] NPWR: Successfully saved derivative data. [2025-10-02T22:42:19.103544] [INFO ] [MAIN ] Derivative Progress: 1218/1975 symbols completed. NPWR took 1.3s. Estimated remaining: 5m 17s. Rate: 143.4 symbols/min [2025-10-02T22:42:19.139948] [DEBUG] [LOCAL ] NRDY: Loaded 32941 existing records from primary storage. [2025-10-02T22:42:19.154389] [INFO ] [MAIN ] NRDY: Loaded 32941 primary data records. [2025-10-02T22:42:19.140092] [INFO ] [MAIN ] NRGV: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:19.783238] [DEBUG] [LOCAL ] NRGV: Loaded 43740 existing records from primary storage. [2025-10-02T22:42:19.783680] [INFO ] [MAIN ] NRGV: Loaded 43740 primary data records. [2025-10-02T22:42:20.171582] [DEBUG] [MAIN ] NREF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:20.174682] [INFO ] [MAIN ] NREF: Generated 1807 derivative records from 7915 primary records. [2025-10-02T22:42:20.175062] [DEBUG] [LOCAL ] NREF: Saving derivative data. [2025-10-02T22:42:20.189589] [DEBUG] [MAIN ] NRDY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:20.197931] [INFO ] [MAIN ] NRDY: Generated 1807 derivative records from 32941 primary records. [2025-10-02T22:42:20.198069] [DEBUG] [LOCAL ] NRDY: Saving derivative data. [2025-10-02T22:42:20.207949] [DEBUG] [LOCAL ] NREF: Derivative data saved (1807 records). [2025-10-02T22:42:20.208613] [INFO ] [MAIN ] NREF: Successfully saved derivative data. [2025-10-02T22:42:20.211073] [INFO ] [MAIN ] Derivative Progress: 1219/1975 symbols completed. NREF took 1.2s. Estimated remaining: 5m 17s. Rate: 143.2 symbols/min [2025-10-02T22:42:20.211565] [INFO ] [MAIN ] NRK: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:20.231490] [DEBUG] [LOCAL ] NRDY: Derivative data saved (1807 records). [2025-10-02T22:42:20.238609] [INFO ] [MAIN ] NRDY: Successfully saved derivative data. [2025-10-02T22:42:20.241520] [INFO ] [MAIN ] Derivative Progress: 1220/1975 symbols completed. NRDY took 1.3s. Estimated remaining: 5m 16s. Rate: 143.3 symbols/min [2025-10-02T22:42:20.241942] [INFO ] [MAIN ] NRP: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:20.265888] [DEBUG] [LOCAL ] NRK: Loaded 20132 existing records from primary storage. [2025-10-02T22:42:20.266082] [INFO ] [MAIN ] NRK: Loaded 20132 primary data records. [2025-10-02T22:42:20.274201] [DEBUG] [LOCAL ] NRP: Loaded 4103 existing records from primary storage. [2025-10-02T22:42:20.274329] [INFO ] [MAIN ] NRP: Loaded 4103 primary data records. [2025-10-02T22:42:20.265393] [DEBUG] [MAIN ] NRGV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:20.408746] [INFO ] [MAIN ] NRGV: Generated 1807 derivative records from 43740 primary records. [2025-10-02T22:42:20.491084] [DEBUG] [LOCAL ] NRGV: Saving derivative data. [2025-10-02T22:42:21.032908] [DEBUG] [LOCAL ] NRGV: Derivative data saved (1807 records). [2025-10-02T22:42:21.033673] [INFO ] [MAIN ] NRGV: Successfully saved derivative data. [2025-10-02T22:42:21.036588] [INFO ] [MAIN ] Derivative Progress: 1221/1975 symbols completed. NRGV took 1.9s. Estimated remaining: 5m 16s. Rate: 143.2 symbols/min [2025-10-02T22:42:21.037885] [INFO ] [MAIN ] NRT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:21.050820] [DEBUG] [LOCAL ] NRT: Loaded 5012 existing records from primary storage. [2025-10-02T22:42:21.052638] [INFO ] [MAIN ] NRT: Loaded 5012 primary data records. [2025-10-02T22:42:21.128860] [DEBUG] [MAIN ] NRK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:21.152626] [INFO ] [MAIN ] NRK: Generated 1807 derivative records from 20132 primary records. [2025-10-02T22:42:21.183081] [DEBUG] [LOCAL ] NRK: Saving derivative data. [2025-10-02T22:42:21.434251] [DEBUG] [MAIN ] NRP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:21.435991] [INFO ] [MAIN ] NRP: Generated 1807 derivative records from 4103 primary records. [2025-10-02T22:42:21.436686] [DEBUG] [LOCAL ] NRP: Saving derivative data. [2025-10-02T22:42:21.455881] [DEBUG] [LOCAL ] NRK: Derivative data saved (1807 records). [2025-10-02T22:42:21.458617] [DEBUG] [LOCAL ] NRP: Derivative data saved (1807 records). [2025-10-02T22:42:21.458052] [INFO ] [MAIN ] NRK: Successfully saved derivative data. [2025-10-02T22:42:21.461425] [INFO ] [MAIN ] Derivative Progress: 1222/1975 symbols completed. NRK took 1.2s. Estimated remaining: 5m 16s. Rate: 143.2 symbols/min [2025-10-02T22:42:21.461773] [INFO ] [MAIN ] NRP: Successfully saved derivative data. [2025-10-02T22:42:21.461891] [INFO ] [MAIN ] NRUC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:21.465003] [INFO ] [MAIN ] Derivative Progress: 1223/1975 symbols completed. NRP took 1.2s. Estimated remaining: 5m 15s. Rate: 143.3 symbols/min [2025-10-02T22:42:21.466036] [INFO ] [MAIN ] NSA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:21.475107] [DEBUG] [LOCAL ] NRUC: Loaded 3105 existing records from primary storage. [2025-10-02T22:42:21.475708] [INFO ] [MAIN ] NRUC: Loaded 3105 primary data records. [2025-10-02T22:42:21.717537] [DEBUG] [MAIN ] NRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:21.844324] [INFO ] [MAIN ] NRT: Generated 1807 derivative records from 5012 primary records. [2025-10-02T22:42:21.859193] [DEBUG] [LOCAL ] NRT: Saving derivative data. [2025-10-02T22:42:21.883845] [DEBUG] [LOCAL ] NSA: Loaded 45004 existing records from primary storage. [2025-10-02T22:42:21.887637] [INFO ] [MAIN ] NSA: Loaded 45004 primary data records. [2025-10-02T22:42:22.011393] [DEBUG] [LOCAL ] NRT: Derivative data saved (1807 records). [2025-10-02T22:42:22.022549] [INFO ] [MAIN ] NRT: Successfully saved derivative data. [2025-10-02T22:42:22.040863] [INFO ] [MAIN ] Derivative Progress: 1224/1975 symbols completed. NRT took 1.0s. Estimated remaining: 5m 15s. Rate: 143.2 symbols/min [2025-10-02T22:42:22.069238] [INFO ] [MAIN ] NSP: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:22.251002] [DEBUG] [MAIN ] NRUC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:22.252326] [INFO ] [MAIN ] NRUC: Generated 1807 derivative records from 3105 primary records. [2025-10-02T22:42:22.252476] [DEBUG] [LOCAL ] NRUC: Saving derivative data. [2025-10-02T22:42:22.284056] [DEBUG] [LOCAL ] NRUC: Derivative data saved (1807 records). [2025-10-02T22:42:22.284328] [INFO ] [MAIN ] NRUC: Successfully saved derivative data. [2025-10-02T22:42:22.287357] [INFO ] [MAIN ] Derivative Progress: 1225/1975 symbols completed. NRUC took 0.8s. Estimated remaining: 5m 14s. Rate: 143.3 symbols/min [2025-10-02T22:42:22.288273] [INFO ] [MAIN ] NTB: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:22.326003] [DEBUG] [MAIN ] NSA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:22.325625] [DEBUG] [LOCAL ] NSP: Loaded 35259 existing records from primary storage. [2025-10-02T22:42:22.326269] [INFO ] [MAIN ] NSP: Loaded 35259 primary data records. [2025-10-02T22:42:22.327192] [INFO ] [MAIN ] NSA: Generated 1807 derivative records from 45004 primary records. [2025-10-02T22:42:22.355947] [DEBUG] [LOCAL ] NSA: Saving derivative data. [2025-10-02T22:42:22.465583] [DEBUG] [LOCAL ] NTB: Loaded 20329 existing records from primary storage. [2025-10-02T22:42:22.471045] [INFO ] [MAIN ] NTB: Loaded 20329 primary data records. [2025-10-02T22:42:22.594196] [DEBUG] [LOCAL ] NSA: Derivative data saved (1807 records). [2025-10-02T22:42:22.810414] [INFO ] [MAIN ] NSA: Successfully saved derivative data. [2025-10-02T22:42:22.813466] [INFO ] [MAIN ] Derivative Progress: 1226/1975 symbols completed. NSA took 1.3s. Estimated remaining: 5m 14s. Rate: 143.3 symbols/min [2025-10-02T22:42:22.824451] [INFO ] [MAIN ] NTR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:23.109166] [DEBUG] [MAIN ] NSP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:23.110080] [INFO ] [MAIN ] NSP: Generated 1807 derivative records from 35259 primary records. [2025-10-02T22:42:23.110196] [DEBUG] [LOCAL ] NSP: Saving derivative data. [2025-10-02T22:42:23.160274] [DEBUG] [MAIN ] NTB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:23.160939] [DEBUG] [LOCAL ] NSP: Derivative data saved (1807 records). [2025-10-02T22:42:23.161799] [INFO ] [MAIN ] NTB: Generated 1807 derivative records from 20329 primary records. [2025-10-02T22:42:23.161983] [DEBUG] [LOCAL ] NTB: Saving derivative data. [2025-10-02T22:42:23.162076] [INFO ] [MAIN ] NSP: Successfully saved derivative data. [2025-10-02T22:42:23.165533] [INFO ] [MAIN ] Derivative Progress: 1227/1975 symbols completed. NSP took 1.1s. Estimated remaining: 5m 13s. Rate: 143.3 symbols/min [2025-10-02T22:42:23.174319] [INFO ] [MAIN ] NTST: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:23.201810] [DEBUG] [LOCAL ] NTR: Loaded 52959 existing records from primary storage. [2025-10-02T22:42:23.203131] [INFO ] [MAIN ] NTR: Loaded 52959 primary data records. [2025-10-02T22:42:23.209773] [DEBUG] [LOCAL ] NTB: Derivative data saved (1807 records). [2025-10-02T22:42:23.210011] [INFO ] [MAIN ] NTB: Successfully saved derivative data. [2025-10-02T22:42:23.212752] [INFO ] [MAIN ] Derivative Progress: 1228/1975 symbols completed. NTB took 0.9s. Estimated remaining: 5m 13s. Rate: 143.4 symbols/min [2025-10-02T22:42:23.575067] [DEBUG] [LOCAL ] NTST: Loaded 43828 existing records from primary storage. [2025-10-02T22:42:23.583448] [INFO ] [MAIN ] NTST: Loaded 43828 primary data records. [2025-10-02T22:42:24.000255] [DEBUG] [MAIN ] NTR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:24.001620] [INFO ] [MAIN ] NTR: Generated 1807 derivative records from 52959 primary records. [2025-10-02T22:42:24.002177] [DEBUG] [LOCAL ] NTR: Saving derivative data. [2025-10-02T22:42:24.023764] [DEBUG] [LOCAL ] NTR: Derivative data saved (1807 records). [2025-10-02T22:42:24.023921] [INFO ] [MAIN ] NTR: Successfully saved derivative data. [2025-10-02T22:42:24.026820] [INFO ] [MAIN ] Derivative Progress: 1229/1975 symbols completed. NTR took 1.2s. Estimated remaining: 5m 12s. Rate: 143.3 symbols/min [2025-10-02T22:42:24.045956] [DEBUG] [MAIN ] NTST: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:24.046726] [INFO ] [MAIN ] NTST: Generated 1807 derivative records from 43828 primary records. [2025-10-02T22:42:24.046798] [DEBUG] [LOCAL ] NTST: Saving derivative data. [2025-10-02T22:42:24.065110] [DEBUG] [LOCAL ] NTST: Derivative data saved (1807 records). [2025-10-02T22:42:24.065283] [INFO ] [MAIN ] NTST: Successfully saved derivative data. [2025-10-02T22:42:24.067477] [INFO ] [MAIN ] Derivative Progress: 1230/1975 symbols completed. NTST took 0.9s. Estimated remaining: 5m 12s. Rate: 143.4 symbols/min [2025-10-02T22:42:24.068153] [INFO ] [MAIN ] NUV: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:24.068052] [INFO ] [MAIN ] NU: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:24.068417] [INFO ] [MAIN ] NUS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:24.098585] [DEBUG] [LOCAL ] NUV: Loaded 23717 existing records from primary storage. [2025-10-02T22:42:24.098846] [INFO ] [MAIN ] NUV: Loaded 23717 primary data records. [2025-10-02T22:42:24.245815] [DEBUG] [LOCAL ] NUS: Loaded 36660 existing records from primary storage. [2025-10-02T22:42:24.256858] [INFO ] [MAIN ] NUS: Loaded 36660 primary data records. [2025-10-02T22:42:24.613579] [DEBUG] [LOCAL ] NU: Loaded 54136 existing records from primary storage. [2025-10-02T22:42:24.625868] [INFO ] [MAIN ] NU: Loaded 54136 primary data records. [2025-10-02T22:42:25.235675] [DEBUG] [MAIN ] NUV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:25.237063] [INFO ] [MAIN ] NUV: Generated 1807 derivative records from 23717 primary records. [2025-10-02T22:42:25.237166] [DEBUG] [LOCAL ] NUV: Saving derivative data. [2025-10-02T22:42:25.275347] [DEBUG] [MAIN ] NUS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:25.276719] [INFO ] [MAIN ] NUS: Generated 1807 derivative records from 36660 primary records. [2025-10-02T22:42:25.275809] [DEBUG] [LOCAL ] NUV: Derivative data saved (1807 records). [2025-10-02T22:42:25.277172] [INFO ] [MAIN ] NUV: Successfully saved derivative data. [2025-10-02T22:42:25.276963] [DEBUG] [LOCAL ] NUS: Saving derivative data. [2025-10-02T22:42:25.279904] [INFO ] [MAIN ] Derivative Progress: 1231/1975 symbols completed. NUV took 1.2s. Estimated remaining: 5m 12s. Rate: 143.2 symbols/min [2025-10-02T22:42:25.281284] [INFO ] [MAIN ] NUVB: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:25.305812] [DEBUG] [LOCAL ] NUS: Derivative data saved (1807 records). [2025-10-02T22:42:25.318088] [INFO ] [MAIN ] NUS: Successfully saved derivative data. [2025-10-02T22:42:25.326462] [INFO ] [MAIN ] Derivative Progress: 1232/1975 symbols completed. NUS took 1.3s. Estimated remaining: 5m 11s. Rate: 143.3 symbols/min [2025-10-02T22:42:25.328220] [INFO ] [MAIN ] NVG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:25.328091] [DEBUG] [MAIN ] NU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:25.329486] [INFO ] [MAIN ] NU: Generated 1807 derivative records from 54136 primary records. [2025-10-02T22:42:25.329555] [DEBUG] [LOCAL ] NU: Saving derivative data. [2025-10-02T22:42:25.368947] [DEBUG] [LOCAL ] NU: Derivative data saved (1807 records). [2025-10-02T22:42:25.376759] [INFO ] [MAIN ] NU: Successfully saved derivative data. [2025-10-02T22:42:25.379341] [INFO ] [MAIN ] Derivative Progress: 1233/1975 symbols completed. NU took 1.3s. Estimated remaining: 5m 11s. Rate: 143.4 symbols/min [2025-10-02T22:42:25.379678] [INFO ] [MAIN ] NVGS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:25.406214] [DEBUG] [LOCAL ] NVG: Loaded 27690 existing records from primary storage. [2025-10-02T22:42:25.406465] [INFO ] [MAIN ] NVG: Loaded 27690 primary data records. [2025-10-02T22:42:25.545818] [DEBUG] [LOCAL ] NUVB: Loaded 51636 existing records from primary storage. [2025-10-02T22:42:25.551171] [INFO ] [MAIN ] NUVB: Loaded 51636 primary data records. [2025-10-02T22:42:25.846812] [DEBUG] [LOCAL ] NVGS: Loaded 30804 existing records from primary storage. [2025-10-02T22:42:25.875988] [INFO ] [MAIN ] NVGS: Loaded 30804 primary data records. [2025-10-02T22:42:26.469668] [DEBUG] [MAIN ] NVG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:26.470909] [INFO ] [MAIN ] NVG: Generated 1807 derivative records from 27690 primary records. [2025-10-02T22:42:26.471108] [DEBUG] [LOCAL ] NVG: Saving derivative data. [2025-10-02T22:42:26.502220] [DEBUG] [MAIN ] NUVB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:26.503500] [INFO ] [MAIN ] NUVB: Generated 1807 derivative records from 51636 primary records. [2025-10-02T22:42:26.504737] [DEBUG] [LOCAL ] NUVB: Saving derivative data. [2025-10-02T22:42:26.521187] [DEBUG] [LOCAL ] NVG: Derivative data saved (1807 records). [2025-10-02T22:42:26.521925] [INFO ] [MAIN ] NVG: Successfully saved derivative data. [2025-10-02T22:42:26.524702] [INFO ] [MAIN ] Derivative Progress: 1234/1975 symbols completed. NVG took 1.2s. Estimated remaining: 5m 11s. Rate: 143.2 symbols/min [2025-10-02T22:42:26.532683] [INFO ] [MAIN ] NVO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:26.539611] [DEBUG] [MAIN ] NVGS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:26.540854] [INFO ] [MAIN ] NVGS: Generated 1807 derivative records from 30804 primary records. [2025-10-02T22:42:26.541309] [DEBUG] [LOCAL ] NVGS: Saving derivative data. [2025-10-02T22:42:26.558315] [DEBUG] [LOCAL ] NUVB: Derivative data saved (1807 records). [2025-10-02T22:42:26.559148] [INFO ] [MAIN ] NUVB: Successfully saved derivative data. [2025-10-02T22:42:26.562786] [INFO ] [MAIN ] Derivative Progress: 1235/1975 symbols completed. NUVB took 1.3s. Estimated remaining: 5m 10s. Rate: 143.3 symbols/min [2025-10-02T22:42:26.563467] [INFO ] [MAIN ] NVR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:26.567777] [DEBUG] [LOCAL ] NVGS: Derivative data saved (1807 records). [2025-10-02T22:42:26.567942] [INFO ] [MAIN ] NVGS: Successfully saved derivative data. [2025-10-02T22:42:26.570801] [INFO ] [MAIN ] Derivative Progress: 1236/1975 symbols completed. NVGS took 1.2s. Estimated remaining: 5m 9s. Rate: 143.4 symbols/min [2025-10-02T22:42:26.571231] [INFO ] [MAIN ] NVRI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:26.602703] [DEBUG] [LOCAL ] NVR: Loaded 18746 existing records from primary storage. [2025-10-02T22:42:26.602981] [INFO ] [MAIN ] NVR: Loaded 18746 primary data records. [2025-10-02T22:42:26.751681] [DEBUG] [LOCAL ] NVO: Loaded 54174 existing records from primary storage. [2025-10-02T22:42:26.782689] [INFO ] [MAIN ] NVO: Loaded 54174 primary data records. [2025-10-02T22:42:27.028944] [DEBUG] [LOCAL ] NVRI: Loaded 39035 existing records from primary storage. [2025-10-02T22:42:27.061553] [INFO ] [MAIN ] NVRI: Loaded 39035 primary data records. [2025-10-02T22:42:27.709400] [DEBUG] [MAIN ] NVR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:27.711735] [INFO ] [MAIN ] NVR: Generated 1807 derivative records from 18746 primary records. [2025-10-02T22:42:27.712255] [DEBUG] [LOCAL ] NVR: Saving derivative data. [2025-10-02T22:42:27.738400] [DEBUG] [LOCAL ] NVR: Derivative data saved (1807 records). [2025-10-02T22:42:27.741288] [INFO ] [MAIN ] NVR: Successfully saved derivative data. [2025-10-02T22:42:27.743977] [INFO ] [MAIN ] Derivative Progress: 1237/1975 symbols completed. NVR took 1.2s. Estimated remaining: 5m 9s. Rate: 143.2 symbols/min [2025-10-02T22:42:27.744685] [INFO ] [MAIN ] NVS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:27.759725] [DEBUG] [MAIN ] NVO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:27.760524] [INFO ] [MAIN ] NVO: Generated 1807 derivative records from 54174 primary records. [2025-10-02T22:42:27.760766] [DEBUG] [LOCAL ] NVO: Saving derivative data. [2025-10-02T22:42:27.794854] [DEBUG] [LOCAL ] NVO: Derivative data saved (1807 records). [2025-10-02T22:42:27.794983] [INFO ] [MAIN ] NVO: Successfully saved derivative data. [2025-10-02T22:42:27.794768] [DEBUG] [MAIN ] NVRI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:27.798696] [INFO ] [MAIN ] NVRI: Generated 1807 derivative records from 39035 primary records. [2025-10-02T22:42:27.797694] [INFO ] [MAIN ] Derivative Progress: 1238/1975 symbols completed. NVO took 1.3s. Estimated remaining: 5m 9s. Rate: 143.3 symbols/min [2025-10-02T22:42:27.801537] [INFO ] [MAIN ] NVST: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:27.802041] [DEBUG] [LOCAL ] NVRI: Saving derivative data. [2025-10-02T22:42:27.835147] [DEBUG] [LOCAL ] NVRI: Derivative data saved (1807 records). [2025-10-02T22:42:27.835366] [INFO ] [MAIN ] NVRI: Successfully saved derivative data. [2025-10-02T22:42:27.838084] [INFO ] [MAIN ] Derivative Progress: 1239/1975 symbols completed. NVRI took 1.3s. Estimated remaining: 5m 8s. Rate: 143.4 symbols/min [2025-10-02T22:42:27.838440] [INFO ] [MAIN ] NVT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:27.866776] [DEBUG] [LOCAL ] NVS: Loaded 51944 existing records from primary storage. [2025-10-02T22:42:27.867199] [INFO ] [MAIN ] NVS: Loaded 51944 primary data records. [2025-10-02T22:42:28.057599] [DEBUG] [LOCAL ] NVST: Loaded 51965 existing records from primary storage. [2025-10-02T22:42:28.078686] [INFO ] [MAIN ] NVST: Loaded 51965 primary data records. [2025-10-02T22:42:28.367875] [DEBUG] [LOCAL ] NVT: Loaded 51890 existing records from primary storage. [2025-10-02T22:42:28.389024] [INFO ] [MAIN ] NVT: Loaded 51890 primary data records. [2025-10-02T22:42:28.941951] [DEBUG] [MAIN ] NVS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:28.943437] [INFO ] [MAIN ] NVS: Generated 1807 derivative records from 51944 primary records. [2025-10-02T22:42:28.943685] [DEBUG] [LOCAL ] NVS: Saving derivative data. [2025-10-02T22:42:28.963422] [DEBUG] [LOCAL ] NVS: Derivative data saved (1807 records). [2025-10-02T22:42:28.963948] [INFO ] [MAIN ] NVS: Successfully saved derivative data. [2025-10-02T22:42:28.968392] [INFO ] [MAIN ] Derivative Progress: 1240/1975 symbols completed. NVS took 1.2s. Estimated remaining: 5m 8s. Rate: 143.2 symbols/min [2025-10-02T22:42:28.970006] [INFO ] [MAIN ] NWG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:28.988531] [DEBUG] [MAIN ] NVST: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:28.989591] [INFO ] [MAIN ] NVST: Generated 1807 derivative records from 51965 primary records. [2025-10-02T22:42:28.989876] [DEBUG] [LOCAL ] NVST: Saving derivative data. [2025-10-02T22:42:29.009746] [DEBUG] [LOCAL ] NVST: Derivative data saved (1807 records). [2025-10-02T22:42:29.011492] [INFO ] [MAIN ] NVST: Successfully saved derivative data. [2025-10-02T22:42:29.014158] [INFO ] [MAIN ] Derivative Progress: 1241/1975 symbols completed. NVST took 1.2s. Estimated remaining: 5m 7s. Rate: 143.3 symbols/min [2025-10-02T22:42:29.014451] [INFO ] [MAIN ] NWN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:29.029679] [DEBUG] [MAIN ] NVT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:29.030723] [INFO ] [MAIN ] NVT: Generated 1807 derivative records from 51890 primary records. [2025-10-02T22:42:29.030954] [DEBUG] [LOCAL ] NVT: Saving derivative data. [2025-10-02T22:42:29.062998] [DEBUG] [LOCAL ] NVT: Derivative data saved (1807 records). [2025-10-02T22:42:29.063204] [INFO ] [MAIN ] NVT: Successfully saved derivative data. [2025-10-02T22:42:29.067526] [INFO ] [MAIN ] Derivative Progress: 1242/1975 symbols completed. NVT took 1.2s. Estimated remaining: 5m 7s. Rate: 143.4 symbols/min [2025-10-02T22:42:29.068012] [INFO ] [MAIN ] NX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:29.102051] [DEBUG] [LOCAL ] NWN: Loaded 26885 existing records from primary storage. [2025-10-02T22:42:29.103704] [INFO ] [MAIN ] NWN: Loaded 26885 primary data records. [2025-10-02T22:42:29.116610] [DEBUG] [LOCAL ] NWG: Loaded 51874 existing records from primary storage. [2025-10-02T22:42:29.164479] [INFO ] [MAIN ] NWG: Loaded 51874 primary data records. [2025-10-02T22:42:29.472265] [DEBUG] [LOCAL ] NX: Loaded 33364 existing records from primary storage. [2025-10-02T22:42:29.502839] [INFO ] [MAIN ] NX: Loaded 33364 primary data records. [2025-10-02T22:42:30.196112] [DEBUG] [MAIN ] NWG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:30.195850] [DEBUG] [MAIN ] NWN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:30.196894] [INFO ] [MAIN ] NWG: Generated 1807 derivative records from 51874 primary records. [2025-10-02T22:42:30.197710] [INFO ] [MAIN ] NWN: Generated 1807 derivative records from 26885 primary records. [2025-10-02T22:42:30.197908] [DEBUG] [LOCAL ] NWN: Saving derivative data. [2025-10-02T22:42:30.197810] [DEBUG] [LOCAL ] NWG: Saving derivative data. [2025-10-02T22:42:30.224221] [DEBUG] [LOCAL ] NWG: Derivative data saved (1807 records). [2025-10-02T22:42:30.227737] [INFO ] [MAIN ] NWG: Successfully saved derivative data. [2025-10-02T22:42:30.231931] [INFO ] [MAIN ] Derivative Progress: 1243/1975 symbols completed. NWG took 1.3s. Estimated remaining: 5m 7s. Rate: 143.2 symbols/min [2025-10-02T22:42:30.236143] [DEBUG] [LOCAL ] NWN: Derivative data saved (1807 records). [2025-10-02T22:42:30.236380] [INFO ] [MAIN ] NWN: Successfully saved derivative data. [2025-10-02T22:42:30.239388] [INFO ] [MAIN ] Derivative Progress: 1244/1975 symbols completed. NWN took 1.2s. Estimated remaining: 5m 6s. Rate: 143.3 symbols/min [2025-10-02T22:42:30.254067] [DEBUG] [MAIN ] NX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:30.254674] [INFO ] [MAIN ] NX: Generated 1807 derivative records from 33364 primary records. [2025-10-02T22:42:30.254739] [DEBUG] [LOCAL ] NX: Saving derivative data. [2025-10-02T22:42:30.270266] [DEBUG] [LOCAL ] NX: Derivative data saved (1807 records). [2025-10-02T22:42:30.270331] [INFO ] [MAIN ] NX: Successfully saved derivative data. [2025-10-02T22:42:30.272989] [INFO ] [MAIN ] Derivative Progress: 1245/1975 symbols completed. NX took 1.2s. Estimated remaining: 5m 5s. Rate: 143.4 symbols/min [2025-10-02T22:42:30.273537] [INFO ] [MAIN ] NXE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:30.273465] [INFO ] [MAIN ] NXC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:30.273614] [INFO ] [MAIN ] NXDT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:30.285157] [DEBUG] [LOCAL ] NXC: Loaded 4216 existing records from primary storage. [2025-10-02T22:42:30.285464] [INFO ] [MAIN ] NXC: Loaded 4216 primary data records. [2025-10-02T22:42:30.414941] [DEBUG] [LOCAL ] NXDT: Loaded 16245 existing records from primary storage. [2025-10-02T22:42:30.415903] [INFO ] [MAIN ] NXDT: Loaded 16245 primary data records. [2025-10-02T22:42:30.775284] [DEBUG] [LOCAL ] NXE: Loaded 53380 existing records from primary storage. [2025-10-02T22:42:30.790368] [INFO ] [MAIN ] NXE: Loaded 53380 primary data records. [2025-10-02T22:42:31.372788] [DEBUG] [MAIN ] NXC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:31.374330] [INFO ] [MAIN ] NXC: Generated 1807 derivative records from 4216 primary records. [2025-10-02T22:42:31.375070] [DEBUG] [LOCAL ] NXC: Saving derivative data. [2025-10-02T22:42:31.396812] [DEBUG] [LOCAL ] NXC: Derivative data saved (1807 records). [2025-10-02T22:42:31.397457] [INFO ] [MAIN ] NXC: Successfully saved derivative data. [2025-10-02T22:42:31.407950] [INFO ] [MAIN ] Derivative Progress: 1246/1975 symbols completed. NXC took 1.1s. Estimated remaining: 5m 5s. Rate: 143.2 symbols/min [2025-10-02T22:42:31.408564] [INFO ] [MAIN ] NXG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:31.418298] [DEBUG] [MAIN ] NXDT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:31.419475] [INFO ] [MAIN ] NXDT: Generated 1807 derivative records from 16245 primary records. [2025-10-02T22:42:31.419913] [DEBUG] [LOCAL ] NXDT: Saving derivative data. [2025-10-02T22:42:31.466838] [DEBUG] [MAIN ] NXE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:31.466204] [DEBUG] [LOCAL ] NXG: Loaded 10491 existing records from primary storage. [2025-10-02T22:42:31.468339] [INFO ] [MAIN ] NXE: Generated 1807 derivative records from 53380 primary records. [2025-10-02T22:42:31.468841] [DEBUG] [LOCAL ] NXE: Saving derivative data. [2025-10-02T22:42:31.468754] [INFO ] [MAIN ] NXG: Loaded 10491 primary data records. [2025-10-02T22:42:31.515087] [DEBUG] [LOCAL ] NXDT: Derivative data saved (1807 records). [2025-10-02T22:42:31.535736] [INFO ] [MAIN ] NXDT: Successfully saved derivative data. [2025-10-02T22:42:31.569218] [INFO ] [MAIN ] Derivative Progress: 1247/1975 symbols completed. NXDT took 1.3s. Estimated remaining: 5m 5s. Rate: 143.3 symbols/min [2025-10-02T22:42:31.579247] [INFO ] [MAIN ] NXJ: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:31.579076] [DEBUG] [LOCAL ] NXE: Derivative data saved (1807 records). [2025-10-02T22:42:31.597142] [INFO ] [MAIN ] NXE: Successfully saved derivative data. [2025-10-02T22:42:31.614167] [INFO ] [MAIN ] Derivative Progress: 1248/1975 symbols completed. NXE took 1.3s. Estimated remaining: 5m 4s. Rate: 143.4 symbols/min [2025-10-02T22:42:31.625811] [INFO ] [MAIN ] NXN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:31.847068] [DEBUG] [LOCAL ] NXN: Loaded 2335 existing records from primary storage. [2025-10-02T22:42:31.861792] [INFO ] [MAIN ] NXN: Loaded 2335 primary data records. [2025-10-02T22:42:31.890822] [DEBUG] [LOCAL ] NXJ: Loaded 15045 existing records from primary storage. [2025-10-02T22:42:31.908340] [INFO ] [MAIN ] NXJ: Loaded 15045 primary data records. [2025-10-02T22:42:32.576196] [DEBUG] [MAIN ] NXG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:32.577598] [INFO ] [MAIN ] NXG: Generated 1807 derivative records from 10491 primary records. [2025-10-02T22:42:32.577945] [DEBUG] [LOCAL ] NXG: Saving derivative data. [2025-10-02T22:42:32.599464] [DEBUG] [LOCAL ] NXG: Derivative data saved (1807 records). [2025-10-02T22:42:32.600233] [INFO ] [MAIN ] NXG: Successfully saved derivative data. [2025-10-02T22:42:32.602824] [INFO ] [MAIN ] Derivative Progress: 1249/1975 symbols completed. NXG took 1.2s. Estimated remaining: 5m 4s. Rate: 143.2 symbols/min [2025-10-02T22:42:32.603625] [INFO ] [MAIN ] NXP: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:32.631363] [DEBUG] [MAIN ] NXN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:32.645627] [INFO ] [MAIN ] NXN: Generated 1807 derivative records from 2335 primary records. [2025-10-02T22:42:32.646075] [DEBUG] [MAIN ] NXJ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:32.646237] [DEBUG] [LOCAL ] NXN: Saving derivative data. [2025-10-02T22:42:32.652938] [INFO ] [MAIN ] NXJ: Generated 1807 derivative records from 15045 primary records. [2025-10-02T22:42:32.654499] [DEBUG] [LOCAL ] NXJ: Saving derivative data. [2025-10-02T22:42:32.653550] [DEBUG] [LOCAL ] NXP: Loaded 12563 existing records from primary storage. [2025-10-02T22:42:32.674983] [INFO ] [MAIN ] NXP: Loaded 12563 primary data records. [2025-10-02T22:42:32.702875] [DEBUG] [LOCAL ] NXJ: Derivative data saved (1807 records). [2025-10-02T22:42:32.718202] [INFO ] [MAIN ] NXJ: Successfully saved derivative data. [2025-10-02T22:42:32.729888] [INFO ] [MAIN ] Derivative Progress: 1250/1975 symbols completed. NXJ took 1.2s. Estimated remaining: 5m 4s. Rate: 143.3 symbols/min [2025-10-02T22:42:32.744911] [INFO ] [MAIN ] NXRT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:32.778773] [DEBUG] [LOCAL ] NXN: Derivative data saved (1807 records). [2025-10-02T22:42:32.793828] [INFO ] [MAIN ] NXN: Successfully saved derivative data. [2025-10-02T22:42:32.807364] [INFO ] [MAIN ] Derivative Progress: 1251/1975 symbols completed. NXN took 1.2s. Estimated remaining: 5m 3s. Rate: 143.4 symbols/min [2025-10-02T22:42:32.826299] [INFO ] [MAIN ] NYT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:33.047110] [DEBUG] [LOCAL ] NXRT: Loaded 19068 existing records from primary storage. [2025-10-02T22:42:33.047289] [INFO ] [MAIN ] NXRT: Loaded 19068 primary data records. [2025-10-02T22:42:33.239275] [DEBUG] [LOCAL ] NYT: Loaded 50204 existing records from primary storage. [2025-10-02T22:42:33.257172] [INFO ] [MAIN ] NYT: Loaded 50204 primary data records. [2025-10-02T22:42:33.751261] [DEBUG] [MAIN ] NXP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:33.763182] [INFO ] [MAIN ] NXP: Generated 1807 derivative records from 12563 primary records. [2025-10-02T22:42:33.763620] [DEBUG] [LOCAL ] NXP: Saving derivative data. [2025-10-02T22:42:33.787806] [DEBUG] [LOCAL ] NXP: Derivative data saved (1807 records). [2025-10-02T22:42:33.789699] [INFO ] [MAIN ] NXP: Successfully saved derivative data. [2025-10-02T22:42:33.793057] [INFO ] [MAIN ] Derivative Progress: 1252/1975 symbols completed. NXP took 1.2s. Estimated remaining: 5m 3s. Rate: 143.2 symbols/min [2025-10-02T22:42:33.793697] [INFO ] [MAIN ] NZF: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:33.807539] [DEBUG] [MAIN ] NXRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:33.808893] [INFO ] [MAIN ] NXRT: Generated 1807 derivative records from 19068 primary records. [2025-10-02T22:42:33.809184] [DEBUG] [LOCAL ] NXRT: Saving derivative data. [2025-10-02T22:42:33.828044] [DEBUG] [LOCAL ] NXRT: Derivative data saved (1807 records). [2025-10-02T22:42:33.828345] [INFO ] [MAIN ] NXRT: Successfully saved derivative data. [2025-10-02T22:42:33.830836] [INFO ] [MAIN ] Derivative Progress: 1253/1975 symbols completed. NXRT took 1.1s. Estimated remaining: 5m 2s. Rate: 143.3 symbols/min [2025-10-02T22:42:33.832179] [INFO ] [MAIN ] OBDC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:33.848674] [DEBUG] [MAIN ] NYT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:33.857696] [INFO ] [MAIN ] NYT: Generated 1807 derivative records from 50204 primary records. [2025-10-02T22:42:33.857791] [DEBUG] [LOCAL ] NYT: Saving derivative data. [2025-10-02T22:42:33.885977] [DEBUG] [LOCAL ] NZF: Loaded 29328 existing records from primary storage. [2025-10-02T22:42:33.886870] [INFO ] [MAIN ] NZF: Loaded 29328 primary data records. [2025-10-02T22:42:33.928350] [DEBUG] [LOCAL ] NYT: Derivative data saved (1807 records). [2025-10-02T22:42:33.942201] [INFO ] [MAIN ] NYT: Successfully saved derivative data. [2025-10-02T22:42:33.954141] [INFO ] [MAIN ] Derivative Progress: 1254/1975 symbols completed. NYT took 1.1s. Estimated remaining: 5m 2s. Rate: 143.4 symbols/min [2025-10-02T22:42:33.997293] [INFO ] [MAIN ] OBK: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:34.126793] [DEBUG] [LOCAL ] OBDC: Loaded 52051 existing records from primary storage. [2025-10-02T22:42:34.273804] [INFO ] [MAIN ] OBDC: Loaded 52051 primary data records. [2025-10-02T22:42:34.273676] [DEBUG] [LOCAL ] OBK: Loaded 16248 existing records from primary storage. [2025-10-02T22:42:34.290747] [INFO ] [MAIN ] OBK: Loaded 16248 primary data records. [2025-10-02T22:42:35.010573] [DEBUG] [MAIN ] NZF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:35.012687] [INFO ] [MAIN ] NZF: Generated 1807 derivative records from 29328 primary records. [2025-10-02T22:42:35.013795] [DEBUG] [LOCAL ] NZF: Saving derivative data. [2025-10-02T22:42:35.042249] [DEBUG] [LOCAL ] NZF: Derivative data saved (1807 records). [2025-10-02T22:42:35.042556] [INFO ] [MAIN ] NZF: Successfully saved derivative data. [2025-10-02T22:42:35.057755] [INFO ] [MAIN ] Derivative Progress: 1255/1975 symbols completed. NZF took 1.3s. Estimated remaining: 5m 2s. Rate: 143.2 symbols/min [2025-10-02T22:42:35.058921] [DEBUG] [MAIN ] OBDC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:35.060376] [INFO ] [MAIN ] OBDC: Generated 1807 derivative records from 52051 primary records. [2025-10-02T22:42:35.060614] [DEBUG] [LOCAL ] OBDC: Saving derivative data. [2025-10-02T22:42:35.059914] [INFO ] [MAIN ] OC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:35.081756] [DEBUG] [LOCAL ] OBDC: Derivative data saved (1807 records). [2025-10-02T22:42:35.082054] [INFO ] [MAIN ] OBDC: Successfully saved derivative data. [2025-10-02T22:42:35.084525] [INFO ] [MAIN ] Derivative Progress: 1256/1975 symbols completed. OBDC took 1.3s. Estimated remaining: 5m 1s. Rate: 143.3 symbols/min [2025-10-02T22:42:35.084784] [INFO ] [MAIN ] OCFT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:35.100011] [DEBUG] [MAIN ] OBK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:35.100876] [INFO ] [MAIN ] OBK: Generated 1807 derivative records from 16248 primary records. [2025-10-02T22:42:35.101016] [DEBUG] [LOCAL ] OBK: Saving derivative data. [2025-10-02T22:42:35.122243] [DEBUG] [LOCAL ] OCFT: Loaded 8212 existing records from primary storage. [2025-10-02T22:42:35.123556] [INFO ] [MAIN ] OCFT: Loaded 8212 primary data records. [2025-10-02T22:42:35.168495] [DEBUG] [LOCAL ] OBK: Derivative data saved (1807 records). [2025-10-02T22:42:35.203247] [INFO ] [MAIN ] OBK: Successfully saved derivative data. [2025-10-02T22:42:35.229723] [INFO ] [MAIN ] Derivative Progress: 1257/1975 symbols completed. OBK took 1.2s. Estimated remaining: 5m 0s. Rate: 143.4 symbols/min [2025-10-02T22:42:35.263111] [INFO ] [MAIN ] ODC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:35.330010] [DEBUG] [LOCAL ] OC: Loaded 44907 existing records from primary storage. [2025-10-02T22:42:35.485554] [INFO ] [MAIN ] OC: Loaded 44907 primary data records. [2025-10-02T22:42:35.522951] [DEBUG] [LOCAL ] ODC: Loaded 8465 existing records from primary storage. [2025-10-02T22:42:35.561349] [INFO ] [MAIN ] ODC: Loaded 8465 primary data records. [2025-10-02T22:42:36.275058] [DEBUG] [MAIN ] OCFT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:36.276359] [INFO ] [MAIN ] OCFT: Generated 1807 derivative records from 8212 primary records. [2025-10-02T22:42:36.276892] [DEBUG] [LOCAL ] OCFT: Saving derivative data. [2025-10-02T22:42:36.294467] [DEBUG] [LOCAL ] OCFT: Derivative data saved (1807 records). [2025-10-02T22:42:36.295102] [INFO ] [MAIN ] OCFT: Successfully saved derivative data. [2025-10-02T22:42:36.299805] [INFO ] [MAIN ] Derivative Progress: 1258/1975 symbols completed. OCFT took 1.2s. Estimated remaining: 5m 0s. Rate: 143.2 symbols/min [2025-10-02T22:42:36.319562] [DEBUG] [MAIN ] OC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:36.320691] [INFO ] [MAIN ] OC: Generated 1807 derivative records from 44907 primary records. [2025-10-02T22:42:36.320917] [DEBUG] [LOCAL ] OC: Saving derivative data. [2025-10-02T22:42:36.335498] [DEBUG] [MAIN ] ODC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:36.344120] [INFO ] [MAIN ] ODC: Generated 1807 derivative records from 8465 primary records. [2025-10-02T22:42:36.348366] [DEBUG] [LOCAL ] ODC: Saving derivative data. [2025-10-02T22:42:36.367844] [DEBUG] [LOCAL ] ODC: Derivative data saved (1807 records). [2025-10-02T22:42:36.369287] [INFO ] [MAIN ] ODC: Successfully saved derivative data. [2025-10-02T22:42:36.372163] [INFO ] [MAIN ] Derivative Progress: 1259/1975 symbols completed. ODC took 1.1s. Estimated remaining: 4m 60s. Rate: 143.3 symbols/min [2025-10-02T22:42:36.373398] [DEBUG] [LOCAL ] OC: Derivative data saved (1807 records). [2025-10-02T22:42:36.373552] [INFO ] [MAIN ] OC: Successfully saved derivative data. [2025-10-02T22:42:36.377096] [INFO ] [MAIN ] Derivative Progress: 1260/1975 symbols completed. OC took 1.3s. Estimated remaining: 4m 59s. Rate: 143.4 symbols/min [2025-10-02T22:42:36.377629] [INFO ] [MAIN ] ODV: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:36.377832] [INFO ] [MAIN ] OEC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:36.378007] [INFO ] [MAIN ] OFG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:36.414775] [DEBUG] [LOCAL ] OFG: Loaded 21648 existing records from primary storage. [2025-10-02T22:42:36.423930] [INFO ] [MAIN ] OFG: Loaded 21648 primary data records. [2025-10-02T22:42:36.446158] [DEBUG] [LOCAL ] ODV: Loaded 27146 existing records from primary storage. [2025-10-02T22:42:36.446288] [INFO ] [MAIN ] ODV: Loaded 27146 primary data records. [2025-10-02T22:42:36.622832] [DEBUG] [LOCAL ] OEC: Loaded 37258 existing records from primary storage. [2025-10-02T22:42:36.658585] [INFO ] [MAIN ] OEC: Loaded 37258 primary data records. [2025-10-02T22:42:37.513968] [DEBUG] [MAIN ] ODV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:37.519845] [DEBUG] [MAIN ] OFG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:37.521881] [INFO ] [MAIN ] ODV: Generated 1807 derivative records from 27146 primary records. [2025-10-02T22:42:37.524186] [DEBUG] [LOCAL ] ODV: Saving derivative data. [2025-10-02T22:42:37.523591] [INFO ] [MAIN ] OFG: Generated 1807 derivative records from 21648 primary records. [2025-10-02T22:42:37.538447] [DEBUG] [LOCAL ] OFG: Saving derivative data. [2025-10-02T22:42:37.541195] [DEBUG] [MAIN ] OEC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:37.543012] [INFO ] [MAIN ] OEC: Generated 1807 derivative records from 37258 primary records. [2025-10-02T22:42:37.552298] [DEBUG] [LOCAL ] OEC: Saving derivative data. [2025-10-02T22:42:37.596403] [DEBUG] [LOCAL ] OEC: Derivative data saved (1807 records). [2025-10-02T22:42:37.597026] [INFO ] [MAIN ] OEC: Successfully saved derivative data. [2025-10-02T22:42:37.594055] [DEBUG] [LOCAL ] OFG: Derivative data saved (1807 records). [2025-10-02T22:42:37.599670] [INFO ] [MAIN ] Derivative Progress: 1261/1975 symbols completed. OEC took 1.2s. Estimated remaining: 4m 59s. Rate: 143.2 symbols/min [2025-10-02T22:42:37.604542] [DEBUG] [LOCAL ] ODV: Derivative data saved (1807 records). [2025-10-02T22:42:37.600568] [INFO ] [MAIN ] OFG: Successfully saved derivative data. [2025-10-02T22:42:37.600948] [INFO ] [MAIN ] OGE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:37.608562] [INFO ] [MAIN ] ODV: Successfully saved derivative data. [2025-10-02T22:42:37.608339] [INFO ] [MAIN ] Derivative Progress: 1262/1975 symbols completed. OFG took 1.2s. Estimated remaining: 4m 58s. Rate: 143.3 symbols/min [2025-10-02T22:42:37.611673] [INFO ] [MAIN ] OGN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:37.611837] [INFO ] [MAIN ] Derivative Progress: 1263/1975 symbols completed. ODV took 1.2s. Estimated remaining: 4m 58s. Rate: 143.5 symbols/min [2025-10-02T22:42:37.612149] [INFO ] [MAIN ] OGS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:37.681179] [DEBUG] [LOCAL ] OGE: Loaded 46690 existing records from primary storage. [2025-10-02T22:42:37.682253] [INFO ] [MAIN ] OGE: Loaded 46690 primary data records. [2025-10-02T22:42:37.682142] [DEBUG] [LOCAL ] OGS: Loaded 34415 existing records from primary storage. [2025-10-02T22:42:37.705437] [INFO ] [MAIN ] OGS: Loaded 34415 primary data records. [2025-10-02T22:42:37.993998] [DEBUG] [LOCAL ] OGN: Loaded 53480 existing records from primary storage. [2025-10-02T22:42:38.031566] [INFO ] [MAIN ] OGN: Loaded 53480 primary data records. [2025-10-02T22:42:38.971608] [DEBUG] [MAIN ] OGE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:38.973150] [INFO ] [MAIN ] OGE: Generated 1807 derivative records from 46690 primary records. [2025-10-02T22:42:38.973440] [DEBUG] [LOCAL ] OGE: Saving derivative data. [2025-10-02T22:42:39.008804] [DEBUG] [LOCAL ] OGE: Derivative data saved (1807 records). [2025-10-02T22:42:39.009578] [INFO ] [MAIN ] OGE: Successfully saved derivative data. [2025-10-02T22:42:39.010014] [DEBUG] [MAIN ] OGS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:39.012593] [INFO ] [MAIN ] Derivative Progress: 1264/1975 symbols completed. OGE took 1.4s. Estimated remaining: 4m 58s. Rate: 143.2 symbols/min [2025-10-02T22:42:39.014099] [INFO ] [MAIN ] OGS: Generated 1807 derivative records from 34415 primary records. [2025-10-02T22:42:39.015247] [INFO ] [MAIN ] OHI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:39.015420] [DEBUG] [LOCAL ] OGS: Saving derivative data. [2025-10-02T22:42:39.049734] [DEBUG] [MAIN ] OGN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:39.051156] [INFO ] [MAIN ] OGN: Generated 1807 derivative records from 53480 primary records. [2025-10-02T22:42:39.049277] [DEBUG] [LOCAL ] OGS: Derivative data saved (1807 records). [2025-10-02T22:42:39.051278] [DEBUG] [LOCAL ] OGN: Saving derivative data. [2025-10-02T22:42:39.052587] [INFO ] [MAIN ] OGS: Successfully saved derivative data. [2025-10-02T22:42:39.054975] [INFO ] [MAIN ] Derivative Progress: 1265/1975 symbols completed. OGS took 1.4s. Estimated remaining: 4m 57s. Rate: 143.3 symbols/min [2025-10-02T22:42:39.055670] [INFO ] [MAIN ] OI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:39.079168] [DEBUG] [LOCAL ] OGN: Derivative data saved (1807 records). [2025-10-02T22:42:39.079490] [INFO ] [MAIN ] OGN: Successfully saved derivative data. [2025-10-02T22:42:39.082991] [INFO ] [MAIN ] Derivative Progress: 1266/1975 symbols completed. OGN took 1.5s. Estimated remaining: 4m 57s. Rate: 143.4 symbols/min [2025-10-02T22:42:39.083429] [INFO ] [MAIN ] OIA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:39.128004] [DEBUG] [LOCAL ] OIA: Loaded 13841 existing records from primary storage. [2025-10-02T22:42:39.128401] [INFO ] [MAIN ] OIA: Loaded 13841 primary data records. [2025-10-02T22:42:39.197435] [DEBUG] [LOCAL ] OHI: Loaded 52342 existing records from primary storage. [2025-10-02T22:42:39.248613] [INFO ] [MAIN ] OHI: Loaded 52342 primary data records. [2025-10-02T22:42:39.277322] [DEBUG] [LOCAL ] OI: Loaded 47454 existing records from primary storage. [2025-10-02T22:42:39.282968] [INFO ] [MAIN ] OI: Loaded 47454 primary data records. [2025-10-02T22:42:40.230065] [DEBUG] [MAIN ] OIA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:40.231523] [INFO ] [MAIN ] OIA: Generated 1807 derivative records from 13841 primary records. [2025-10-02T22:42:40.231989] [DEBUG] [LOCAL ] OIA: Saving derivative data. [2025-10-02T22:42:40.267973] [DEBUG] [MAIN ] OI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:40.269596] [INFO ] [MAIN ] OI: Generated 1807 derivative records from 47454 primary records. [2025-10-02T22:42:40.278551] [DEBUG] [LOCAL ] OI: Saving derivative data. [2025-10-02T22:42:40.286521] [DEBUG] [LOCAL ] OIA: Derivative data saved (1807 records). [2025-10-02T22:42:40.286972] [INFO ] [MAIN ] OIA: Successfully saved derivative data. [2025-10-02T22:42:40.289020] [INFO ] [MAIN ] Derivative Progress: 1267/1975 symbols completed. OIA took 1.2s. Estimated remaining: 4m 57s. Rate: 143.2 symbols/min [2025-10-02T22:42:40.286142] [DEBUG] [MAIN ] OHI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:40.289179] [INFO ] [MAIN ] OII: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:40.303272] [INFO ] [MAIN ] OHI: Generated 1807 derivative records from 52342 primary records. [2025-10-02T22:42:40.305835] [DEBUG] [LOCAL ] OHI: Saving derivative data. [2025-10-02T22:42:40.309277] [DEBUG] [LOCAL ] OI: Derivative data saved (1807 records). [2025-10-02T22:42:40.309448] [INFO ] [MAIN ] OI: Successfully saved derivative data. [2025-10-02T22:42:40.311726] [INFO ] [MAIN ] Derivative Progress: 1268/1975 symbols completed. OI took 1.3s. Estimated remaining: 4m 56s. Rate: 143.3 symbols/min [2025-10-02T22:42:40.311893] [INFO ] [MAIN ] OIS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:40.337174] [DEBUG] [LOCAL ] OHI: Derivative data saved (1807 records). [2025-10-02T22:42:40.337386] [INFO ] [MAIN ] OHI: Successfully saved derivative data. [2025-10-02T22:42:40.340952] [INFO ] [MAIN ] Derivative Progress: 1269/1975 symbols completed. OHI took 1.3s. Estimated remaining: 4m 55s. Rate: 143.4 symbols/min [2025-10-02T22:42:40.341492] [INFO ] [MAIN ] OKE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:40.379399] [DEBUG] [LOCAL ] OII: Loaded 42794 existing records from primary storage. [2025-10-02T22:42:40.379575] [INFO ] [MAIN ] OII: Loaded 42794 primary data records. [2025-10-02T22:42:40.531583] [DEBUG] [LOCAL ] OIS: Loaded 40676 existing records from primary storage. [2025-10-02T22:42:40.562038] [INFO ] [MAIN ] OIS: Loaded 40676 primary data records. [2025-10-02T22:42:40.944718] [DEBUG] [LOCAL ] OKE: Loaded 53927 existing records from primary storage. [2025-10-02T22:42:40.962344] [INFO ] [MAIN ] OKE: Loaded 53927 primary data records. [2025-10-02T22:42:41.640969] [DEBUG] [MAIN ] OII: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:41.642220] [INFO ] [MAIN ] OII: Generated 1807 derivative records from 42794 primary records. [2025-10-02T22:42:41.642553] [DEBUG] [LOCAL ] OII: Saving derivative data. [2025-10-02T22:42:41.667227] [DEBUG] [LOCAL ] OII: Derivative data saved (1807 records). [2025-10-02T22:42:41.680906] [INFO ] [MAIN ] OII: Successfully saved derivative data. [2025-10-02T22:42:41.690759] [INFO ] [MAIN ] Derivative Progress: 1270/1975 symbols completed. OII took 1.4s. Estimated remaining: 4m 56s. Rate: 143.1 symbols/min [2025-10-02T22:42:41.691323] [INFO ] [MAIN ] OLN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:41.692369] [DEBUG] [MAIN ] OIS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:41.701136] [INFO ] [MAIN ] OIS: Generated 1807 derivative records from 40676 primary records. [2025-10-02T22:42:41.706013] [DEBUG] [LOCAL ] OIS: Saving derivative data. [2025-10-02T22:42:41.706985] [DEBUG] [MAIN ] OKE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:41.707755] [INFO ] [MAIN ] OKE: Generated 1807 derivative records from 53927 primary records. [2025-10-02T22:42:41.707834] [DEBUG] [LOCAL ] OKE: Saving derivative data. [2025-10-02T22:42:41.742070] [DEBUG] [LOCAL ] OIS: Derivative data saved (1807 records). [2025-10-02T22:42:41.742677] [INFO ] [MAIN ] OIS: Successfully saved derivative data. [2025-10-02T22:42:41.744757] [INFO ] [MAIN ] Derivative Progress: 1271/1975 symbols completed. OIS took 1.4s. Estimated remaining: 4m 55s. Rate: 143.2 symbols/min [2025-10-02T22:42:41.745761] [DEBUG] [LOCAL ] OKE: Derivative data saved (1807 records). [2025-10-02T22:42:41.746121] [INFO ] [MAIN ] OKE: Successfully saved derivative data. [2025-10-02T22:42:41.748228] [INFO ] [MAIN ] Derivative Progress: 1272/1975 symbols completed. OKE took 1.4s. Estimated remaining: 4m 54s. Rate: 143.4 symbols/min [2025-10-02T22:42:41.744964] [INFO ] [MAIN ] OLP: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:41.748541] [INFO ] [MAIN ] OMC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:41.766930] [DEBUG] [LOCAL ] OLP: Loaded 9962 existing records from primary storage. [2025-10-02T22:42:41.767175] [INFO ] [MAIN ] OLP: Loaded 9962 primary data records. [2025-10-02T22:42:41.960844] [DEBUG] [LOCAL ] OLN: Loaded 52160 existing records from primary storage. [2025-10-02T22:42:42.026696] [INFO ] [MAIN ] OLN: Loaded 52160 primary data records. [2025-10-02T22:42:42.180804] [DEBUG] [LOCAL ] OMC: Loaded 53679 existing records from primary storage. [2025-10-02T22:42:42.206460] [INFO ] [MAIN ] OMC: Loaded 53679 primary data records. [2025-10-02T22:42:42.872523] [DEBUG] [MAIN ] OLP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:42.873456] [INFO ] [MAIN ] OLP: Generated 1807 derivative records from 9962 primary records. [2025-10-02T22:42:42.873771] [DEBUG] [LOCAL ] OLP: Saving derivative data. [2025-10-02T22:42:42.902050] [DEBUG] [LOCAL ] OLP: Derivative data saved (1807 records). [2025-10-02T22:42:42.918068] [INFO ] [MAIN ] OLP: Successfully saved derivative data. [2025-10-02T22:42:42.920416] [INFO ] [MAIN ] Derivative Progress: 1273/1975 symbols completed. OLP took 1.2s. Estimated remaining: 4m 54s. Rate: 143.2 symbols/min [2025-10-02T22:42:42.917835] [DEBUG] [MAIN ] OLN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:42.936116] [INFO ] [MAIN ] OLN: Generated 1807 derivative records from 52160 primary records. [2025-10-02T22:42:42.936819] [DEBUG] [LOCAL ] OLN: Saving derivative data. [2025-10-02T22:42:42.936770] [DEBUG] [MAIN ] OMC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:42.938098] [INFO ] [MAIN ] OMC: Generated 1807 derivative records from 53679 primary records. [2025-10-02T22:42:42.938187] [DEBUG] [LOCAL ] OMC: Saving derivative data. [2025-10-02T22:42:42.973485] [DEBUG] [LOCAL ] OLN: Derivative data saved (1807 records). [2025-10-02T22:42:42.973009] [DEBUG] [LOCAL ] OMC: Derivative data saved (1807 records). [2025-10-02T22:42:42.973677] [INFO ] [MAIN ] OLN: Successfully saved derivative data. [2025-10-02T22:42:42.975855] [INFO ] [MAIN ] Derivative Progress: 1274/1975 symbols completed. OLN took 1.3s. Estimated remaining: 4m 54s. Rate: 143.2 symbols/min [2025-10-02T22:42:42.975984] [INFO ] [MAIN ] OMC: Successfully saved derivative data. [2025-10-02T22:42:42.978287] [INFO ] [MAIN ] Derivative Progress: 1275/1975 symbols completed. OMC took 1.2s. Estimated remaining: 4m 53s. Rate: 143.4 symbols/min [2025-10-02T22:42:42.978730] [INFO ] [MAIN ] OMI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:42.978631] [INFO ] [MAIN ] OMF: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:42.978897] [INFO ] [MAIN ] ONIT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:42.991868] [DEBUG] [LOCAL ] ONIT: Loaded 7761 existing records from primary storage. [2025-10-02T22:42:42.992045] [INFO ] [MAIN ] ONIT: Loaded 7761 primary data records. [2025-10-02T22:42:43.408973] [DEBUG] [LOCAL ] OMI: Loaded 46195 existing records from primary storage. [2025-10-02T22:42:43.414834] [DEBUG] [LOCAL ] OMF: Loaded 46561 existing records from primary storage. [2025-10-02T22:42:43.424275] [INFO ] [MAIN ] OMI: Loaded 46195 primary data records. [2025-10-02T22:42:43.424612] [INFO ] [MAIN ] OMF: Loaded 46561 primary data records. [2025-10-02T22:42:44.107045] [DEBUG] [MAIN ] ONIT: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-02T22:42:44.108954] [INFO ] [MAIN ] ONIT: Generated 1806 derivative records from 7761 primary records. [2025-10-02T22:42:44.109245] [DEBUG] [LOCAL ] ONIT: Saving derivative data. [2025-10-02T22:42:44.130717] [DEBUG] [LOCAL ] ONIT: Derivative data saved (1806 records). [2025-10-02T22:42:44.132924] [INFO ] [MAIN ] ONIT: Successfully saved derivative data. [2025-10-02T22:42:44.136771] [INFO ] [MAIN ] Derivative Progress: 1276/1975 symbols completed. ONIT took 1.2s. Estimated remaining: 4m 53s. Rate: 143.2 symbols/min [2025-10-02T22:42:44.137238] [INFO ] [MAIN ] ONL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:44.153087] [DEBUG] [MAIN ] OMI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:44.154913] [INFO ] [MAIN ] OMI: Generated 1807 derivative records from 46195 primary records. [2025-10-02T22:42:44.155084] [DEBUG] [LOCAL ] OMI: Saving derivative data. [2025-10-02T22:42:44.181766] [DEBUG] [MAIN ] OMF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:44.183123] [INFO ] [MAIN ] OMF: Generated 1807 derivative records from 46561 primary records. [2025-10-02T22:42:44.183499] [DEBUG] [LOCAL ] OMF: Saving derivative data. [2025-10-02T22:42:44.202709] [DEBUG] [LOCAL ] OMI: Derivative data saved (1807 records). [2025-10-02T22:42:44.208158] [DEBUG] [LOCAL ] OMF: Derivative data saved (1807 records). [2025-10-02T22:42:44.208339] [INFO ] [MAIN ] OMF: Successfully saved derivative data. [2025-10-02T22:42:44.208264] [INFO ] [MAIN ] OMI: Successfully saved derivative data. [2025-10-02T22:42:44.218498] [INFO ] [MAIN ] Derivative Progress: 1277/1975 symbols completed. OMF took 1.2s. Estimated remaining: 4m 52s. Rate: 143.3 symbols/min [2025-10-02T22:42:44.221014] [INFO ] [MAIN ] ONON: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:44.221094] [INFO ] [MAIN ] Derivative Progress: 1278/1975 symbols completed. OMI took 1.2s. Estimated remaining: 4m 52s. Rate: 143.4 symbols/min [2025-10-02T22:42:44.221503] [INFO ] [MAIN ] ONTF: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:44.235964] [DEBUG] [LOCAL ] ONL: Loaded 30689 existing records from primary storage. [2025-10-02T22:42:44.236096] [INFO ] [MAIN ] ONL: Loaded 30689 primary data records. [2025-10-02T22:42:44.374056] [DEBUG] [LOCAL ] ONTF: Loaded 22684 existing records from primary storage. [2025-10-02T22:42:44.386145] [INFO ] [MAIN ] ONTF: Loaded 22684 primary data records. [2025-10-02T22:42:44.806924] [DEBUG] [LOCAL ] ONON: Loaded 54003 existing records from primary storage. [2025-10-02T22:42:44.949087] [INFO ] [MAIN ] ONON: Loaded 54003 primary data records. [2025-10-02T22:42:45.353335] [DEBUG] [MAIN ] ONL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:45.358875] [INFO ] [MAIN ] ONL: Generated 1807 derivative records from 30689 primary records. [2025-10-02T22:42:45.359399] [DEBUG] [LOCAL ] ONL: Saving derivative data. [2025-10-02T22:42:45.395358] [DEBUG] [LOCAL ] ONL: Derivative data saved (1807 records). [2025-10-02T22:42:45.395821] [INFO ] [MAIN ] ONL: Successfully saved derivative data. [2025-10-02T22:42:45.398774] [INFO ] [MAIN ] Derivative Progress: 1279/1975 symbols completed. ONL took 1.3s. Estimated remaining: 4m 52s. Rate: 143.2 symbols/min [2025-10-02T22:42:45.396195] [DEBUG] [MAIN ] ONTF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:45.400571] [INFO ] [MAIN ] ONTF: Generated 1807 derivative records from 22684 primary records. [2025-10-02T22:42:45.401455] [INFO ] [MAIN ] ONTO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:45.402387] [DEBUG] [LOCAL ] ONTF: Saving derivative data. [2025-10-02T22:42:45.424255] [DEBUG] [LOCAL ] ONTF: Derivative data saved (1807 records). [2025-10-02T22:42:45.425223] [INFO ] [MAIN ] ONTF: Successfully saved derivative data. [2025-10-02T22:42:45.427390] [INFO ] [MAIN ] Derivative Progress: 1280/1975 symbols completed. ONTF took 1.2s. Estimated remaining: 4m 51s. Rate: 143.3 symbols/min [2025-10-02T22:42:45.427733] [INFO ] [MAIN ] OOMA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:45.442536] [DEBUG] [MAIN ] ONON: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:45.443377] [INFO ] [MAIN ] ONON: Generated 1807 derivative records from 54003 primary records. [2025-10-02T22:42:45.443551] [DEBUG] [LOCAL ] ONON: Saving derivative data. [2025-10-02T22:42:45.477695] [DEBUG] [LOCAL ] ONON: Derivative data saved (1807 records). [2025-10-02T22:42:45.477934] [INFO ] [MAIN ] ONON: Successfully saved derivative data. [2025-10-02T22:42:45.480135] [INFO ] [MAIN ] Derivative Progress: 1281/1975 symbols completed. ONON took 1.3s. Estimated remaining: 4m 50s. Rate: 143.4 symbols/min [2025-10-02T22:42:45.480457] [INFO ] [MAIN ] OPAD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:45.488532] [DEBUG] [LOCAL ] OOMA: Loaded 18967 existing records from primary storage. [2025-10-02T22:42:45.488719] [INFO ] [MAIN ] OOMA: Loaded 18967 primary data records. [2025-10-02T22:42:45.570384] [DEBUG] [LOCAL ] ONTO: Loaded 47013 existing records from primary storage. [2025-10-02T22:42:45.619082] [INFO ] [MAIN ] ONTO: Loaded 47013 primary data records. [2025-10-02T22:42:45.667231] [DEBUG] [LOCAL ] OPAD: Loaded 22121 existing records from primary storage. [2025-10-02T22:42:45.723472] [INFO ] [MAIN ] OPAD: Loaded 22121 primary data records. [2025-10-02T22:42:46.582793] [DEBUG] [MAIN ] OOMA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:46.583624] [INFO ] [MAIN ] OOMA: Generated 1807 derivative records from 18967 primary records. [2025-10-02T22:42:46.584012] [DEBUG] [LOCAL ] OOMA: Saving derivative data. [2025-10-02T22:42:46.622752] [DEBUG] [MAIN ] ONTO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:46.625085] [INFO ] [MAIN ] ONTO: Generated 1807 derivative records from 47013 primary records. [2025-10-02T22:42:46.639887] [DEBUG] [LOCAL ] OOMA: Derivative data saved (1807 records). [2025-10-02T22:42:46.640532] [INFO ] [MAIN ] OOMA: Successfully saved derivative data. [2025-10-02T22:42:46.640436] [DEBUG] [MAIN ] OPAD: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-02T22:42:46.640015] [DEBUG] [LOCAL ] ONTO: Saving derivative data. [2025-10-02T22:42:46.641371] [INFO ] [MAIN ] OPAD: Generated 1806 derivative records from 22121 primary records. [2025-10-02T22:42:46.644444] [DEBUG] [LOCAL ] OPAD: Saving derivative data. [2025-10-02T22:42:46.644347] [INFO ] [MAIN ] Derivative Progress: 1282/1975 symbols completed. OOMA took 1.2s. Estimated remaining: 4m 50s. Rate: 143.2 symbols/min [2025-10-02T22:42:46.646221] [INFO ] [MAIN ] OPFI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:46.682421] [DEBUG] [LOCAL ] ONTO: Derivative data saved (1807 records). [2025-10-02T22:42:46.682998] [INFO ] [MAIN ] ONTO: Successfully saved derivative data. [2025-10-02T22:42:46.685980] [INFO ] [MAIN ] Derivative Progress: 1283/1975 symbols completed. ONTO took 1.3s. Estimated remaining: 4m 50s. Rate: 143.3 symbols/min [2025-10-02T22:42:46.686265] [INFO ] [MAIN ] OPP: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:46.686825] [DEBUG] [LOCAL ] OPAD: Derivative data saved (1806 records). [2025-10-02T22:42:46.687074] [INFO ] [MAIN ] OPAD: Successfully saved derivative data. [2025-10-02T22:42:46.689572] [INFO ] [MAIN ] Derivative Progress: 1284/1975 symbols completed. OPAD took 1.2s. Estimated remaining: 4m 49s. Rate: 143.4 symbols/min [2025-10-02T22:42:46.690250] [INFO ] [MAIN ] OR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:46.716813] [DEBUG] [LOCAL ] OPP: Loaded 11686 existing records from primary storage. [2025-10-02T22:42:46.716953] [INFO ] [MAIN ] OPP: Loaded 11686 primary data records. [2025-10-02T22:42:46.857469] [DEBUG] [LOCAL ] OPFI: Loaded 46774 existing records from primary storage. [2025-10-02T22:42:46.858019] [INFO ] [MAIN ] OPFI: Loaded 46774 primary data records. [2025-10-02T22:42:47.082867] [DEBUG] [LOCAL ] OR: Loaded 46493 existing records from primary storage. [2025-10-02T22:42:47.211580] [INFO ] [MAIN ] OR: Loaded 46493 primary data records. [2025-10-02T22:42:47.903557] [DEBUG] [MAIN ] OPP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:47.905275] [INFO ] [MAIN ] OPP: Generated 1807 derivative records from 11686 primary records. [2025-10-02T22:42:47.905480] [DEBUG] [LOCAL ] OPP: Saving derivative data. [2025-10-02T22:42:47.937914] [DEBUG] [MAIN ] OPFI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:47.939953] [INFO ] [MAIN ] OPFI: Generated 1807 derivative records from 46774 primary records. [2025-10-02T22:42:47.940454] [DEBUG] [LOCAL ] OPFI: Saving derivative data. [2025-10-02T22:42:47.959509] [DEBUG] [LOCAL ] OPP: Derivative data saved (1807 records). [2025-10-02T22:42:47.961287] [INFO ] [MAIN ] OPP: Successfully saved derivative data. [2025-10-02T22:42:47.964958] [INFO ] [MAIN ] Derivative Progress: 1285/1975 symbols completed. OPP took 1.3s. Estimated remaining: 4m 49s. Rate: 143.1 symbols/min [2025-10-02T22:42:47.966207] [INFO ] [MAIN ] ORA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:47.983494] [DEBUG] [LOCAL ] OPFI: Derivative data saved (1807 records). [2025-10-02T22:42:47.983741] [INFO ] [MAIN ] OPFI: Successfully saved derivative data. [2025-10-02T22:42:47.985998] [INFO ] [MAIN ] Derivative Progress: 1286/1975 symbols completed. OPFI took 1.3s. Estimated remaining: 4m 49s. Rate: 143.3 symbols/min [2025-10-02T22:42:47.986212] [INFO ] [MAIN ] ORC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:47.986738] [DEBUG] [MAIN ] OR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:47.988099] [INFO ] [MAIN ] OR: Generated 1807 derivative records from 46493 primary records. [2025-10-02T22:42:47.988291] [DEBUG] [LOCAL ] OR: Saving derivative data. [2025-10-02T22:42:48.007383] [DEBUG] [LOCAL ] OR: Derivative data saved (1807 records). [2025-10-02T22:42:48.007536] [INFO ] [MAIN ] OR: Successfully saved derivative data. [2025-10-02T22:42:48.010099] [INFO ] [MAIN ] Derivative Progress: 1287/1975 symbols completed. OR took 1.3s. Estimated remaining: 4m 48s. Rate: 143.4 symbols/min [2025-10-02T22:42:48.020013] [INFO ] [MAIN ] ORN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:48.037226] [DEBUG] [LOCAL ] ORA: Loaded 32793 existing records from primary storage. [2025-10-02T22:42:48.037668] [INFO ] [MAIN ] ORA: Loaded 32793 primary data records. [2025-10-02T22:42:48.229475] [DEBUG] [LOCAL ] ORN: Loaded 31198 existing records from primary storage. [2025-10-02T22:42:48.269874] [INFO ] [MAIN ] ORN: Loaded 31198 primary data records. [2025-10-02T22:42:48.319354] [DEBUG] [LOCAL ] ORC: Loaded 52772 existing records from primary storage. [2025-10-02T22:42:48.324724] [INFO ] [MAIN ] ORC: Loaded 52772 primary data records. [2025-10-02T22:42:49.170330] [DEBUG] [MAIN ] ORA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:49.172972] [INFO ] [MAIN ] ORA: Generated 1807 derivative records from 32793 primary records. [2025-10-02T22:42:49.173543] [DEBUG] [LOCAL ] ORA: Saving derivative data. [2025-10-02T22:42:49.211563] [DEBUG] [LOCAL ] ORA: Derivative data saved (1807 records). [2025-10-02T22:42:49.211927] [DEBUG] [MAIN ] ORN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:49.213387] [INFO ] [MAIN ] ORN: Generated 1807 derivative records from 31198 primary records. [2025-10-02T22:42:49.212613] [INFO ] [MAIN ] ORA: Successfully saved derivative data. [2025-10-02T22:42:49.213592] [DEBUG] [LOCAL ] ORN: Saving derivative data. [2025-10-02T22:42:49.216597] [INFO ] [MAIN ] Derivative Progress: 1288/1975 symbols completed. ORA took 1.3s. Estimated remaining: 4m 48s. Rate: 143.1 symbols/min [2025-10-02T22:42:49.248924] [DEBUG] [LOCAL ] ORN: Derivative data saved (1807 records). [2025-10-02T22:42:49.249480] [INFO ] [MAIN ] ORN: Successfully saved derivative data. [2025-10-02T22:42:49.249410] [DEBUG] [MAIN ] ORC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:49.250267] [INFO ] [MAIN ] ORC: Generated 1807 derivative records from 52772 primary records. [2025-10-02T22:42:49.252598] [DEBUG] [LOCAL ] ORC: Saving derivative data. [2025-10-02T22:42:49.252528] [INFO ] [MAIN ] Derivative Progress: 1289/1975 symbols completed. ORN took 1.2s. Estimated remaining: 4m 47s. Rate: 143.3 symbols/min [2025-10-02T22:42:49.268616] [DEBUG] [LOCAL ] ORC: Derivative data saved (1807 records). [2025-10-02T22:42:49.268719] [INFO ] [MAIN ] ORC: Successfully saved derivative data. [2025-10-02T22:42:49.270658] [INFO ] [MAIN ] Derivative Progress: 1290/1975 symbols completed. ORC took 1.3s. Estimated remaining: 4m 47s. Rate: 143.4 symbols/min [2025-10-02T22:42:49.271245] [INFO ] [MAIN ] OUT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:49.271128] [INFO ] [MAIN ] OSCR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:49.271601] [INFO ] [MAIN ] OTIS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:49.371632] [DEBUG] [LOCAL ] OUT: Loaded 48152 existing records from primary storage. [2025-10-02T22:42:49.371847] [INFO ] [MAIN ] OUT: Loaded 48152 primary data records. [2025-10-02T22:42:49.372610] [DEBUG] [LOCAL ] OTIS: Loaded 53094 existing records from primary storage. [2025-10-02T22:42:49.378076] [INFO ] [MAIN ] OTIS: Loaded 53094 primary data records. [2025-10-02T22:42:49.598201] [DEBUG] [LOCAL ] OSCR: Loaded 54112 existing records from primary storage. [2025-10-02T22:42:49.632155] [INFO ] [MAIN ] OSCR: Loaded 54112 primary data records. [2025-10-02T22:42:50.487705] [DEBUG] [MAIN ] OUT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:50.488686] [INFO ] [MAIN ] OUT: Generated 1807 derivative records from 48152 primary records. [2025-10-02T22:42:50.489024] [DEBUG] [LOCAL ] OUT: Saving derivative data. [2025-10-02T22:42:50.503808] [DEBUG] [MAIN ] OTIS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:50.513208] [INFO ] [MAIN ] OTIS: Generated 1807 derivative records from 53094 primary records. [2025-10-02T22:42:50.517667] [DEBUG] [LOCAL ] OTIS: Saving derivative data. [2025-10-02T22:42:50.557799] [DEBUG] [LOCAL ] OTIS: Derivative data saved (1807 records). [2025-10-02T22:42:50.558491] [INFO ] [MAIN ] OTIS: Successfully saved derivative data. [2025-10-02T22:42:50.560626] [INFO ] [MAIN ] Derivative Progress: 1291/1975 symbols completed. OTIS took 1.3s. Estimated remaining: 4m 47s. Rate: 143.1 symbols/min [2025-10-02T22:42:50.558387] [DEBUG] [MAIN ] OSCR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:50.560798] [DEBUG] [LOCAL ] OUT: Derivative data saved (1807 records). [2025-10-02T22:42:50.562100] [INFO ] [MAIN ] OVV: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:50.561960] [INFO ] [MAIN ] OSCR: Generated 1807 derivative records from 54112 primary records. [2025-10-02T22:42:50.562252] [INFO ] [MAIN ] OUT: Successfully saved derivative data. [2025-10-02T22:42:50.564995] [INFO ] [MAIN ] Derivative Progress: 1292/1975 symbols completed. OUT took 1.3s. Estimated remaining: 4m 46s. Rate: 143.2 symbols/min [2025-10-02T22:42:50.562386] [DEBUG] [LOCAL ] OSCR: Saving derivative data. [2025-10-02T22:42:50.565722] [INFO ] [MAIN ] OWL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:50.587053] [DEBUG] [LOCAL ] OSCR: Derivative data saved (1807 records). [2025-10-02T22:42:50.587375] [INFO ] [MAIN ] OSCR: Successfully saved derivative data. [2025-10-02T22:42:50.590717] [INFO ] [MAIN ] Derivative Progress: 1293/1975 symbols completed. OSCR took 1.3s. Estimated remaining: 4m 45s. Rate: 143.3 symbols/min [2025-10-02T22:42:50.591420] [INFO ] [MAIN ] OWLT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:50.605634] [DEBUG] [LOCAL ] OWLT: Loaded 8861 existing records from primary storage. [2025-10-02T22:42:50.620349] [INFO ] [MAIN ] OWLT: Loaded 8861 primary data records. [2025-10-02T22:42:50.768692] [DEBUG] [LOCAL ] OWL: Loaded 53945 existing records from primary storage. [2025-10-02T22:42:50.780575] [INFO ] [MAIN ] OWL: Loaded 53945 primary data records. [2025-10-02T22:42:50.905637] [DEBUG] [LOCAL ] OVV: Loaded 53905 existing records from primary storage. [2025-10-02T22:42:50.930126] [INFO ] [MAIN ] OVV: Loaded 53905 primary data records. [2025-10-02T22:42:51.719226] [DEBUG] [MAIN ] OWLT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:51.720140] [INFO ] [MAIN ] OWLT: Generated 1807 derivative records from 8861 primary records. [2025-10-02T22:42:51.720406] [DEBUG] [LOCAL ] OWLT: Saving derivative data. [2025-10-02T22:42:51.739968] [DEBUG] [LOCAL ] OWLT: Derivative data saved (1807 records). [2025-10-02T22:42:51.755289] [INFO ] [MAIN ] OWLT: Successfully saved derivative data. [2025-10-02T22:42:51.755625] [DEBUG] [MAIN ] OWL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:51.758377] [INFO ] [MAIN ] Derivative Progress: 1294/1975 symbols completed. OWLT took 1.2s. Estimated remaining: 4m 45s. Rate: 143.1 symbols/min [2025-10-02T22:42:51.759238] [INFO ] [MAIN ] OWL: Generated 1807 derivative records from 53945 primary records. [2025-10-02T22:42:51.759528] [DEBUG] [LOCAL ] OWL: Saving derivative data. [2025-10-02T22:42:51.762860] [INFO ] [MAIN ] OXM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:51.797367] [DEBUG] [LOCAL ] OWL: Derivative data saved (1807 records). [2025-10-02T22:42:51.797797] [INFO ] [MAIN ] OWL: Successfully saved derivative data. [2025-10-02T22:42:51.799979] [INFO ] [MAIN ] Derivative Progress: 1295/1975 symbols completed. OWL took 1.2s. Estimated remaining: 4m 45s. Rate: 143.2 symbols/min [2025-10-02T22:42:51.800529] [DEBUG] [MAIN ] OVV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:51.800725] [INFO ] [MAIN ] PAAS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:51.801963] [INFO ] [MAIN ] OVV: Generated 1807 derivative records from 53905 primary records. [2025-10-02T22:42:51.802280] [DEBUG] [LOCAL ] OVV: Saving derivative data. [2025-10-02T22:42:51.829882] [DEBUG] [LOCAL ] OVV: Derivative data saved (1807 records). [2025-10-02T22:42:51.830042] [INFO ] [MAIN ] OVV: Successfully saved derivative data. [2025-10-02T22:42:51.832166] [INFO ] [MAIN ] Derivative Progress: 1296/1975 symbols completed. OVV took 1.3s. Estimated remaining: 4m 44s. Rate: 143.3 symbols/min [2025-10-02T22:42:51.832512] [INFO ] [MAIN ] PAC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:51.845225] [DEBUG] [LOCAL ] OXM: Loaded 33490 existing records from primary storage. [2025-10-02T22:42:51.845387] [INFO ] [MAIN ] OXM: Loaded 33490 primary data records. [2025-10-02T22:42:51.993045] [DEBUG] [LOCAL ] PAC: Loaded 11658 existing records from primary storage. [2025-10-02T22:42:51.998696] [INFO ] [MAIN ] PAC: Loaded 11658 primary data records. [2025-10-02T22:42:52.252352] [DEBUG] [LOCAL ] PAAS: Loaded 53994 existing records from primary storage. [2025-10-02T22:42:52.268221] [INFO ] [MAIN ] PAAS: Loaded 53994 primary data records. [2025-10-02T22:42:53.074132] [DEBUG] [MAIN ] OXM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:53.075382] [INFO ] [MAIN ] OXM: Generated 1807 derivative records from 33490 primary records. [2025-10-02T22:42:53.075495] [DEBUG] [LOCAL ] OXM: Saving derivative data. [2025-10-02T22:42:53.098917] [DEBUG] [LOCAL ] OXM: Derivative data saved (1807 records). [2025-10-02T22:42:53.099025] [INFO ] [MAIN ] OXM: Successfully saved derivative data. [2025-10-02T22:42:53.101014] [INFO ] [MAIN ] Derivative Progress: 1297/1975 symbols completed. OXM took 1.3s. Estimated remaining: 4m 44s. Rate: 143.1 symbols/min [2025-10-02T22:42:53.101333] [INFO ] [MAIN ] PACK: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:53.117416] [DEBUG] [MAIN ] PAC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:53.118492] [INFO ] [MAIN ] PAC: Generated 1807 derivative records from 11658 primary records. [2025-10-02T22:42:53.118589] [DEBUG] [LOCAL ] PAC: Saving derivative data. [2025-10-02T22:42:53.171950] [DEBUG] [MAIN ] PAAS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:53.175458] [INFO ] [MAIN ] PAAS: Generated 1807 derivative records from 53994 primary records. [2025-10-02T22:42:53.174480] [DEBUG] [LOCAL ] PAC: Derivative data saved (1807 records). [2025-10-02T22:42:53.186555] [INFO ] [MAIN ] PAC: Successfully saved derivative data. [2025-10-02T22:42:53.186429] [DEBUG] [LOCAL ] PAAS: Saving derivative data. [2025-10-02T22:42:53.192156] [INFO ] [MAIN ] Derivative Progress: 1298/1975 symbols completed. PAC took 1.4s. Estimated remaining: 4m 44s. Rate: 143.2 symbols/min [2025-10-02T22:42:53.193596] [DEBUG] [LOCAL ] PACK: Loaded 32109 existing records from primary storage. [2025-10-02T22:42:53.193773] [INFO ] [MAIN ] PACS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:53.210300] [INFO ] [MAIN ] PACK: Loaded 32109 primary data records. [2025-10-02T22:42:53.242299] [DEBUG] [LOCAL ] PAAS: Derivative data saved (1807 records). [2025-10-02T22:42:53.256945] [INFO ] [MAIN ] PAAS: Successfully saved derivative data. [2025-10-02T22:42:53.259583] [INFO ] [MAIN ] Derivative Progress: 1299/1975 symbols completed. PAAS took 1.5s. Estimated remaining: 4m 43s. Rate: 143.3 symbols/min [2025-10-02T22:42:53.270191] [INFO ] [MAIN ] PAG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:53.624272] [DEBUG] [LOCAL ] PAG: Loaded 21862 existing records from primary storage. [2025-10-02T22:42:53.627334] [INFO ] [MAIN ] PAG: Loaded 21862 primary data records. [2025-10-02T22:42:53.626872] [DEBUG] [LOCAL ] PACS: Loaded 34614 existing records from primary storage. [2025-10-02T22:42:53.627519] [INFO ] [MAIN ] PACS: Loaded 34614 primary data records. [2025-10-02T22:42:54.405771] [DEBUG] [MAIN ] PACK: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-02T22:42:54.407678] [INFO ] [MAIN ] PACK: Generated 1806 derivative records from 32109 primary records. [2025-10-02T22:42:54.408046] [DEBUG] [LOCAL ] PACK: Saving derivative data. [2025-10-02T22:42:54.429609] [DEBUG] [LOCAL ] PACK: Derivative data saved (1806 records). [2025-10-02T22:42:54.430381] [INFO ] [MAIN ] PACK: Successfully saved derivative data. [2025-10-02T22:42:54.433187] [INFO ] [MAIN ] Derivative Progress: 1300/1975 symbols completed. PACK took 1.3s. Estimated remaining: 4m 43s. Rate: 143.1 symbols/min [2025-10-02T22:42:54.433599] [INFO ] [MAIN ] PAGS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:54.456442] [DEBUG] [MAIN ] PACS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:54.471084] [INFO ] [MAIN ] PACS: Generated 1807 derivative records from 34614 primary records. [2025-10-02T22:42:54.470255] [DEBUG] [MAIN ] PAG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:54.471842] [INFO ] [MAIN ] PAG: Generated 1807 derivative records from 21862 primary records. [2025-10-02T22:42:54.471942] [DEBUG] [LOCAL ] PAG: Saving derivative data. [2025-10-02T22:42:54.472516] [DEBUG] [LOCAL ] PACS: Saving derivative data. [2025-10-02T22:42:54.507118] [DEBUG] [LOCAL ] PAG: Derivative data saved (1807 records). [2025-10-02T22:42:54.521742] [INFO ] [MAIN ] PAG: Successfully saved derivative data. [2025-10-02T22:42:54.523088] [DEBUG] [LOCAL ] PACS: Derivative data saved (1807 records). [2025-10-02T22:42:54.525853] [INFO ] [MAIN ] PACS: Successfully saved derivative data. [2025-10-02T22:42:54.525588] [INFO ] [MAIN ] Derivative Progress: 1301/1975 symbols completed. PAG took 1.3s. Estimated remaining: 4m 42s. Rate: 143.2 symbols/min [2025-10-02T22:42:54.528758] [INFO ] [MAIN ] PAI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:54.528910] [INFO ] [MAIN ] Derivative Progress: 1302/1975 symbols completed. PACS took 1.3s. Estimated remaining: 4m 42s. Rate: 143.3 symbols/min [2025-10-02T22:42:54.529918] [INFO ] [MAIN ] PAM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:54.537919] [DEBUG] [LOCAL ] PAI: Loaded 2695 existing records from primary storage. [2025-10-02T22:42:54.539210] [INFO ] [MAIN ] PAI: Loaded 2695 primary data records. [2025-10-02T22:42:54.623847] [DEBUG] [LOCAL ] PAGS: Loaded 53105 existing records from primary storage. [2025-10-02T22:42:54.674850] [INFO ] [MAIN ] PAGS: Loaded 53105 primary data records. [2025-10-02T22:42:54.755136] [DEBUG] [LOCAL ] PAM: Loaded 28448 existing records from primary storage. [2025-10-02T22:42:54.880498] [INFO ] [MAIN ] PAM: Loaded 28448 primary data records. [2025-10-02T22:42:55.664699] [DEBUG] [MAIN ] PAI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:55.666831] [INFO ] [MAIN ] PAI: Generated 1807 derivative records from 2695 primary records. [2025-10-02T22:42:55.676260] [DEBUG] [LOCAL ] PAI: Saving derivative data. [2025-10-02T22:42:55.683217] [DEBUG] [MAIN ] PAGS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:55.693995] [INFO ] [MAIN ] PAGS: Generated 1807 derivative records from 53105 primary records. [2025-10-02T22:42:55.700466] [DEBUG] [LOCAL ] PAGS: Saving derivative data. [2025-10-02T22:42:55.726105] [DEBUG] [LOCAL ] PAI: Derivative data saved (1807 records). [2025-10-02T22:42:55.727063] [INFO ] [MAIN ] PAI: Successfully saved derivative data. [2025-10-02T22:42:55.730691] [INFO ] [MAIN ] Derivative Progress: 1303/1975 symbols completed. PAI took 1.2s. Estimated remaining: 4m 42s. Rate: 143.1 symbols/min [2025-10-02T22:42:55.732987] [DEBUG] [LOCAL ] PAGS: Derivative data saved (1807 records). [2025-10-02T22:42:55.734775] [INFO ] [MAIN ] PAGS: Successfully saved derivative data. [2025-10-02T22:42:55.737234] [INFO ] [MAIN ] Derivative Progress: 1304/1975 symbols completed. PAGS took 1.3s. Estimated remaining: 4m 41s. Rate: 143.2 symbols/min [2025-10-02T22:42:55.752823] [DEBUG] [MAIN ] PAM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:55.753530] [INFO ] [MAIN ] PAM: Generated 1807 derivative records from 28448 primary records. [2025-10-02T22:42:55.753594] [DEBUG] [LOCAL ] PAM: Saving derivative data. [2025-10-02T22:42:55.769969] [DEBUG] [LOCAL ] PAM: Derivative data saved (1807 records). [2025-10-02T22:42:55.770106] [INFO ] [MAIN ] PAM: Successfully saved derivative data. [2025-10-02T22:42:55.772321] [INFO ] [MAIN ] Derivative Progress: 1305/1975 symbols completed. PAM took 1.2s. Estimated remaining: 4m 41s. Rate: 143.3 symbols/min [2025-10-02T22:42:55.773000] [INFO ] [MAIN ] PAR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:55.773139] [INFO ] [MAIN ] PARR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:55.773256] [INFO ] [MAIN ] PATH: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:55.845397] [DEBUG] [LOCAL ] PAR: Loaded 33104 existing records from primary storage. [2025-10-02T22:42:55.846150] [INFO ] [MAIN ] PAR: Loaded 33104 primary data records. [2025-10-02T22:42:55.904852] [DEBUG] [LOCAL ] PARR: Loaded 48667 existing records from primary storage. [2025-10-02T22:42:55.926822] [INFO ] [MAIN ] PARR: Loaded 48667 primary data records. [2025-10-02T22:42:55.971580] [DEBUG] [LOCAL ] PATH: Loaded 54067 existing records from primary storage. [2025-10-02T22:42:56.014135] [INFO ] [MAIN ] PATH: Loaded 54067 primary data records. [2025-10-02T22:42:57.010708] [DEBUG] [MAIN ] PAR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:57.028899] [INFO ] [MAIN ] PAR: Generated 1807 derivative records from 33104 primary records. [2025-10-02T22:42:57.042907] [DEBUG] [LOCAL ] PAR: Saving derivative data. [2025-10-02T22:42:57.042520] [DEBUG] [MAIN ] PATH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:57.044260] [INFO ] [MAIN ] PATH: Generated 1807 derivative records from 54067 primary records. [2025-10-02T22:42:57.043351] [DEBUG] [MAIN ] PARR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:57.044388] [DEBUG] [LOCAL ] PATH: Saving derivative data. [2025-10-02T22:42:57.045846] [INFO ] [MAIN ] PARR: Generated 1807 derivative records from 48667 primary records. [2025-10-02T22:42:57.046939] [DEBUG] [LOCAL ] PARR: Saving derivative data. [2025-10-02T22:42:57.088335] [DEBUG] [LOCAL ] PATH: Derivative data saved (1807 records). [2025-10-02T22:42:57.089280] [INFO ] [MAIN ] PATH: Successfully saved derivative data. [2025-10-02T22:42:57.091811] [INFO ] [MAIN ] Derivative Progress: 1306/1975 symbols completed. PATH took 1.3s. Estimated remaining: 4m 41s. Rate: 143.1 symbols/min [2025-10-02T22:42:57.093159] [INFO ] [MAIN ] PAXS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:57.097260] [DEBUG] [LOCAL ] PAR: Derivative data saved (1807 records). [2025-10-02T22:42:57.098355] [INFO ] [MAIN ] PAR: Successfully saved derivative data. [2025-10-02T22:42:57.100687] [INFO ] [MAIN ] Derivative Progress: 1307/1975 symbols completed. PAR took 1.3s. Estimated remaining: 4m 40s. Rate: 143.2 symbols/min [2025-10-02T22:42:57.101735] [INFO ] [MAIN ] PAY: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:57.104360] [DEBUG] [LOCAL ] PARR: Derivative data saved (1807 records). [2025-10-02T22:42:57.104428] [INFO ] [MAIN ] PARR: Successfully saved derivative data. [2025-10-02T22:42:57.106804] [INFO ] [MAIN ] Derivative Progress: 1308/1975 symbols completed. PARR took 1.3s. Estimated remaining: 4m 39s. Rate: 143.3 symbols/min [2025-10-02T22:42:57.107193] [INFO ] [MAIN ] PAYC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:57.127668] [DEBUG] [LOCAL ] PAXS: Loaded 20955 existing records from primary storage. [2025-10-02T22:42:57.127814] [INFO ] [MAIN ] PAXS: Loaded 20955 primary data records. [2025-10-02T22:42:57.326199] [DEBUG] [LOCAL ] PAY: Loaded 38293 existing records from primary storage. [2025-10-02T22:42:57.342317] [INFO ] [MAIN ] PAY: Loaded 38293 primary data records. [2025-10-02T22:42:57.571626] [DEBUG] [LOCAL ] PAYC: Loaded 36666 existing records from primary storage. [2025-10-02T22:42:57.582731] [INFO ] [MAIN ] PAYC: Loaded 36666 primary data records. [2025-10-02T22:42:58.227042] [DEBUG] [MAIN ] PAXS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:58.229844] [INFO ] [MAIN ] PAXS: Generated 1807 derivative records from 20955 primary records. [2025-10-02T22:42:58.231246] [DEBUG] [LOCAL ] PAXS: Saving derivative data. [2025-10-02T22:42:58.250064] [DEBUG] [LOCAL ] PAXS: Derivative data saved (1807 records). [2025-10-02T22:42:58.250287] [INFO ] [MAIN ] PAXS: Successfully saved derivative data. [2025-10-02T22:42:58.252405] [INFO ] [MAIN ] Derivative Progress: 1309/1975 symbols completed. PAXS took 1.2s. Estimated remaining: 4m 39s. Rate: 143.1 symbols/min [2025-10-02T22:42:58.252864] [INFO ] [MAIN ] PB: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:58.271962] [DEBUG] [MAIN ] PAY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:58.272933] [INFO ] [MAIN ] PAY: Generated 1807 derivative records from 38293 primary records. [2025-10-02T22:42:58.273075] [DEBUG] [LOCAL ] PAY: Saving derivative data. [2025-10-02T22:42:58.303591] [DEBUG] [MAIN ] PAYC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:58.304985] [INFO ] [MAIN ] PAYC: Generated 1807 derivative records from 36666 primary records. [2025-10-02T22:42:58.305631] [DEBUG] [LOCAL ] PAYC: Saving derivative data. [2025-10-02T22:42:58.336070] [DEBUG] [LOCAL ] PAY: Derivative data saved (1807 records). [2025-10-02T22:42:58.336194] [INFO ] [MAIN ] PAY: Successfully saved derivative data. [2025-10-02T22:42:58.338365] [INFO ] [MAIN ] Derivative Progress: 1310/1975 symbols completed. PAY took 1.2s. Estimated remaining: 4m 39s. Rate: 143.2 symbols/min [2025-10-02T22:42:58.335564] [DEBUG] [LOCAL ] PAYC: Derivative data saved (1807 records). [2025-10-02T22:42:58.338667] [INFO ] [MAIN ] PAYC: Successfully saved derivative data. [2025-10-02T22:42:58.341044] [INFO ] [MAIN ] Derivative Progress: 1311/1975 symbols completed. PAYC took 1.2s. Estimated remaining: 4m 38s. Rate: 143.3 symbols/min [2025-10-02T22:42:58.338785] [INFO ] [MAIN ] PBA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:58.341391] [INFO ] [MAIN ] PBF: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:58.356122] [DEBUG] [LOCAL ] PB: Loaded 41835 existing records from primary storage. [2025-10-02T22:42:58.356493] [INFO ] [MAIN ] PB: Loaded 41835 primary data records. [2025-10-02T22:42:58.751337] [DEBUG] [LOCAL ] PBA: Loaded 49243 existing records from primary storage. [2025-10-02T22:42:58.768060] [INFO ] [MAIN ] PBA: Loaded 49243 primary data records. [2025-10-02T22:42:58.808029] [DEBUG] [LOCAL ] PBF: Loaded 53502 existing records from primary storage. [2025-10-02T22:42:58.827675] [INFO ] [MAIN ] PBF: Loaded 53502 primary data records. [2025-10-02T22:42:59.529340] [DEBUG] [MAIN ] PB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:59.531437] [INFO ] [MAIN ] PB: Generated 1807 derivative records from 41835 primary records. [2025-10-02T22:42:59.531999] [DEBUG] [LOCAL ] PB: Saving derivative data. [2025-10-02T22:42:59.552505] [DEBUG] [LOCAL ] PB: Derivative data saved (1807 records). [2025-10-02T22:42:59.553505] [INFO ] [MAIN ] PB: Successfully saved derivative data. [2025-10-02T22:42:59.556108] [INFO ] [MAIN ] Derivative Progress: 1312/1975 symbols completed. PB took 1.3s. Estimated remaining: 4m 38s. Rate: 143.1 symbols/min [2025-10-02T22:42:59.556763] [INFO ] [MAIN ] PBH: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:59.583406] [DEBUG] [MAIN ] PBA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:59.584511] [INFO ] [MAIN ] PBA: Generated 1807 derivative records from 49243 primary records. [2025-10-02T22:42:59.584796] [DEBUG] [LOCAL ] PBA: Saving derivative data. [2025-10-02T22:42:59.627531] [DEBUG] [MAIN ] PBF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:42:59.629472] [INFO ] [MAIN ] PBF: Generated 1807 derivative records from 53502 primary records. [2025-10-02T22:42:59.630150] [DEBUG] [LOCAL ] PBF: Saving derivative data. [2025-10-02T22:42:59.633496] [DEBUG] [LOCAL ] PBA: Derivative data saved (1807 records). [2025-10-02T22:42:59.642050] [INFO ] [MAIN ] PBA: Successfully saved derivative data. [2025-10-02T22:42:59.644358] [INFO ] [MAIN ] Derivative Progress: 1313/1975 symbols completed. PBA took 1.3s. Estimated remaining: 4m 37s. Rate: 143.2 symbols/min [2025-10-02T22:42:59.649811] [INFO ] [MAIN ] PBI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:42:59.663484] [DEBUG] [LOCAL ] PBH: Loaded 32101 existing records from primary storage. [2025-10-02T22:42:59.663745] [INFO ] [MAIN ] PBH: Loaded 32101 primary data records. [2025-10-02T22:42:59.762532] [DEBUG] [LOCAL ] PBF: Derivative data saved (1807 records). [2025-10-02T22:42:59.784080] [INFO ] [MAIN ] PBF: Successfully saved derivative data. [2025-10-02T22:42:59.791288] [INFO ] [MAIN ] Derivative Progress: 1314/1975 symbols completed. PBF took 1.4s. Estimated remaining: 4m 37s. Rate: 143.2 symbols/min [2025-10-02T22:42:59.823048] [INFO ] [MAIN ] PBR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:00.034051] [DEBUG] [LOCAL ] PBI: Loaded 50322 existing records from primary storage. [2025-10-02T22:43:00.034481] [INFO ] [MAIN ] PBI: Loaded 50322 primary data records. [2025-10-02T22:43:00.409201] [DEBUG] [LOCAL ] PBR: Loaded 54102 existing records from primary storage. [2025-10-02T22:43:00.409791] [INFO ] [MAIN ] PBR: Loaded 54102 primary data records. [2025-10-02T22:43:00.547435] [DEBUG] [MAIN ] PBH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:00.554513] [INFO ] [MAIN ] PBH: Generated 1807 derivative records from 32101 primary records. [2025-10-02T22:43:00.554787] [DEBUG] [LOCAL ] PBH: Saving derivative data. [2025-10-02T22:43:00.799872] [DEBUG] [LOCAL ] PBH: Derivative data saved (1807 records). [2025-10-02T22:43:00.800284] [INFO ] [MAIN ] PBH: Successfully saved derivative data. [2025-10-02T22:43:00.803823] [INFO ] [MAIN ] Derivative Progress: 1315/1975 symbols completed. PBH took 1.2s. Estimated remaining: 4m 37s. Rate: 143.1 symbols/min [2025-10-02T22:43:00.804598] [INFO ] [MAIN ] PBT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:00.825225] [DEBUG] [MAIN ] PBI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:00.826410] [INFO ] [MAIN ] PBI: Generated 1807 derivative records from 50322 primary records. [2025-10-02T22:43:00.826813] [DEBUG] [LOCAL ] PBI: Saving derivative data. [2025-10-02T22:43:00.854409] [DEBUG] [LOCAL ] PBI: Derivative data saved (1807 records). [2025-10-02T22:43:00.854872] [INFO ] [MAIN ] PBI: Successfully saved derivative data. [2025-10-02T22:43:00.858022] [INFO ] [MAIN ] Derivative Progress: 1316/1975 symbols completed. PBI took 1.2s. Estimated remaining: 4m 36s. Rate: 143.2 symbols/min [2025-10-02T22:43:00.858579] [INFO ] [MAIN ] PCF: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:00.872199] [DEBUG] [LOCAL ] PBT: Loaded 17399 existing records from primary storage. [2025-10-02T22:43:00.873379] [INFO ] [MAIN ] PBT: Loaded 17399 primary data records. [2025-10-02T22:43:00.960269] [DEBUG] [MAIN ] PBR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:00.995508] [INFO ] [MAIN ] PBR: Generated 1807 derivative records from 54102 primary records. [2025-10-02T22:43:01.006582] [DEBUG] [LOCAL ] PCF: Loaded 8961 existing records from primary storage. [2025-10-02T22:43:01.027540] [DEBUG] [LOCAL ] PBR: Saving derivative data. [2025-10-02T22:43:01.027682] [INFO ] [MAIN ] PCF: Loaded 8961 primary data records. [2025-10-02T22:43:01.497763] [DEBUG] [LOCAL ] PBR: Derivative data saved (1807 records). [2025-10-02T22:43:01.498552] [INFO ] [MAIN ] PBR: Successfully saved derivative data. [2025-10-02T22:43:01.517259] [INFO ] [MAIN ] Derivative Progress: 1317/1975 symbols completed. PBR took 1.7s. Estimated remaining: 4m 36s. Rate: 143.1 symbols/min [2025-10-02T22:43:01.553217] [INFO ] [MAIN ] PCM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:01.747994] [DEBUG] [LOCAL ] PCM: Loaded 6752 existing records from primary storage. [2025-10-02T22:43:01.748581] [INFO ] [MAIN ] PCM: Loaded 6752 primary data records. [2025-10-02T22:43:01.834212] [DEBUG] [MAIN ] PBT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:01.835365] [INFO ] [MAIN ] PBT: Generated 1807 derivative records from 17399 primary records. [2025-10-02T22:43:01.835494] [DEBUG] [LOCAL ] PBT: Saving derivative data. [2025-10-02T22:43:01.952471] [DEBUG] [LOCAL ] PBT: Derivative data saved (1807 records). [2025-10-02T22:43:01.952706] [INFO ] [MAIN ] PBT: Successfully saved derivative data. [2025-10-02T22:43:01.955814] [INFO ] [MAIN ] Derivative Progress: 1318/1975 symbols completed. PBT took 1.2s. Estimated remaining: 4m 35s. Rate: 143.1 symbols/min [2025-10-02T22:43:02.090481] [DEBUG] [MAIN ] PCF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:02.099303] [INFO ] [MAIN ] PCF: Generated 1807 derivative records from 8961 primary records. [2025-10-02T22:43:02.099447] [DEBUG] [LOCAL ] PCF: Saving derivative data. [2025-10-02T22:43:02.346162] [DEBUG] [LOCAL ] PCF: Derivative data saved (1807 records). [2025-10-02T22:43:02.346537] [INFO ] [MAIN ] PCF: Successfully saved derivative data. [2025-10-02T22:43:02.349471] [INFO ] [MAIN ] Derivative Progress: 1319/1975 symbols completed. PCF took 1.5s. Estimated remaining: 4m 35s. Rate: 143.1 symbols/min [2025-10-02T22:43:02.374429] [DEBUG] [MAIN ] PCM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:02.375214] [INFO ] [MAIN ] PCM: Generated 1807 derivative records from 6752 primary records. [2025-10-02T22:43:02.375282] [DEBUG] [LOCAL ] PCM: Saving derivative data. [2025-10-02T22:43:02.391363] [DEBUG] [LOCAL ] PCM: Derivative data saved (1807 records). [2025-10-02T22:43:02.391539] [INFO ] [MAIN ] PCM: Successfully saved derivative data. [2025-10-02T22:43:02.393960] [INFO ] [MAIN ] Derivative Progress: 1320/1975 symbols completed. PCM took 0.8s. Estimated remaining: 4m 34s. Rate: 143.2 symbols/min [2025-10-02T22:43:02.394676] [INFO ] [MAIN ] PCQ: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:02.394606] [INFO ] [MAIN ] PCN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:02.394887] [INFO ] [MAIN ] PCOR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:02.423607] [DEBUG] [LOCAL ] PCQ: Loaded 12305 existing records from primary storage. [2025-10-02T22:43:02.424156] [INFO ] [MAIN ] PCQ: Loaded 12305 primary data records. [2025-10-02T22:43:02.493216] [DEBUG] [LOCAL ] PCN: Loaded 24652 existing records from primary storage. [2025-10-02T22:43:02.493418] [INFO ] [MAIN ] PCN: Loaded 24652 primary data records. [2025-10-02T22:43:02.905153] [DEBUG] [LOCAL ] PCOR: Loaded 48348 existing records from primary storage. [2025-10-02T22:43:03.164065] [INFO ] [MAIN ] PCOR: Loaded 48348 primary data records. [2025-10-02T22:43:03.631278] [DEBUG] [MAIN ] PCQ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:03.633486] [INFO ] [MAIN ] PCQ: Generated 1807 derivative records from 12305 primary records. [2025-10-02T22:43:03.633796] [DEBUG] [LOCAL ] PCQ: Saving derivative data. [2025-10-02T22:43:03.662873] [DEBUG] [MAIN ] PCN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:03.665989] [INFO ] [MAIN ] PCN: Generated 1807 derivative records from 24652 primary records. [2025-10-02T22:43:03.667259] [DEBUG] [LOCAL ] PCN: Saving derivative data. [2025-10-02T22:43:03.683009] [DEBUG] [LOCAL ] PCQ: Derivative data saved (1807 records). [2025-10-02T22:43:03.686297] [INFO ] [MAIN ] PCQ: Successfully saved derivative data. [2025-10-02T22:43:03.688926] [INFO ] [MAIN ] Derivative Progress: 1321/1975 symbols completed. PCQ took 1.3s. Estimated remaining: 4m 34s. Rate: 143.0 symbols/min [2025-10-02T22:43:03.689516] [INFO ] [MAIN ] PD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:03.711347] [DEBUG] [LOCAL ] PCN: Derivative data saved (1807 records). [2025-10-02T22:43:03.711905] [DEBUG] [MAIN ] PCOR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:03.712083] [INFO ] [MAIN ] PCN: Successfully saved derivative data. [2025-10-02T22:43:03.713004] [INFO ] [MAIN ] PCOR: Generated 1807 derivative records from 48348 primary records. [2025-10-02T22:43:03.715730] [INFO ] [MAIN ] Derivative Progress: 1322/1975 symbols completed. PCN took 1.3s. Estimated remaining: 4m 34s. Rate: 143.1 symbols/min [2025-10-02T22:43:03.715859] [DEBUG] [LOCAL ] PCOR: Saving derivative data. [2025-10-02T22:43:03.716104] [INFO ] [MAIN ] PDI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:03.735020] [DEBUG] [LOCAL ] PCOR: Derivative data saved (1807 records). [2025-10-02T22:43:03.735203] [INFO ] [MAIN ] PCOR: Successfully saved derivative data. [2025-10-02T22:43:03.737449] [INFO ] [MAIN ] Derivative Progress: 1323/1975 symbols completed. PCOR took 1.3s. Estimated remaining: 4m 33s. Rate: 143.2 symbols/min [2025-10-02T22:43:03.737771] [INFO ] [MAIN ] PDM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:03.814333] [DEBUG] [LOCAL ] PD: Loaded 48248 existing records from primary storage. [2025-10-02T22:43:03.814617] [INFO ] [MAIN ] PD: Loaded 48248 primary data records. [2025-10-02T22:43:03.815384] [DEBUG] [LOCAL ] PDM: Loaded 39853 existing records from primary storage. [2025-10-02T22:43:03.820893] [INFO ] [MAIN ] PDM: Loaded 39853 primary data records. [2025-10-02T22:43:04.019437] [DEBUG] [LOCAL ] PDI: Loaded 50434 existing records from primary storage. [2025-10-02T22:43:04.044369] [INFO ] [MAIN ] PDI: Loaded 50434 primary data records. [2025-10-02T22:43:04.963587] [DEBUG] [MAIN ] PD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:04.964455] [DEBUG] [MAIN ] PDM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:04.965459] [INFO ] [MAIN ] PD: Generated 1807 derivative records from 48248 primary records. [2025-10-02T22:43:04.967363] [DEBUG] [LOCAL ] PD: Saving derivative data. [2025-10-02T22:43:04.966133] [INFO ] [MAIN ] PDM: Generated 1807 derivative records from 39853 primary records. [2025-10-02T22:43:04.968305] [DEBUG] [LOCAL ] PDM: Saving derivative data. [2025-10-02T22:43:05.014851] [DEBUG] [MAIN ] PDI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:05.016805] [INFO ] [MAIN ] PDI: Generated 1807 derivative records from 50434 primary records. [2025-10-02T22:43:05.017782] [DEBUG] [LOCAL ] PDI: Saving derivative data. [2025-10-02T22:43:05.030623] [DEBUG] [LOCAL ] PDM: Derivative data saved (1807 records). [2025-10-02T22:43:05.034967] [INFO ] [MAIN ] PDM: Successfully saved derivative data. [2025-10-02T22:43:05.032022] [DEBUG] [LOCAL ] PD: Derivative data saved (1807 records). [2025-10-02T22:43:05.038288] [INFO ] [MAIN ] PD: Successfully saved derivative data. [2025-10-02T22:43:05.038200] [INFO ] [MAIN ] Derivative Progress: 1324/1975 symbols completed. PDM took 1.3s. Estimated remaining: 4m 33s. Rate: 143.0 symbols/min [2025-10-02T22:43:05.041135] [INFO ] [MAIN ] PDS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:05.041591] [INFO ] [MAIN ] Derivative Progress: 1325/1975 symbols completed. PD took 1.4s. Estimated remaining: 4m 33s. Rate: 143.1 symbols/min [2025-10-02T22:43:05.041818] [INFO ] [MAIN ] PDT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:05.046001] [DEBUG] [LOCAL ] PDI: Derivative data saved (1807 records). [2025-10-02T22:43:05.046231] [INFO ] [MAIN ] PDI: Successfully saved derivative data. [2025-10-02T22:43:05.048542] [INFO ] [MAIN ] Derivative Progress: 1326/1975 symbols completed. PDI took 1.3s. Estimated remaining: 4m 32s. Rate: 143.2 symbols/min [2025-10-02T22:43:05.048799] [INFO ] [MAIN ] PDX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:05.070067] [DEBUG] [LOCAL ] PDS: Loaded 17719 existing records from primary storage. [2025-10-02T22:43:05.070205] [INFO ] [MAIN ] PDS: Loaded 17719 primary data records. [2025-10-02T22:43:05.161468] [DEBUG] [LOCAL ] PDT: Loaded 17545 existing records from primary storage. [2025-10-02T22:43:05.185249] [INFO ] [MAIN ] PDT: Loaded 17545 primary data records. [2025-10-02T22:43:05.185783] [DEBUG] [LOCAL ] PDX: Loaded 14464 existing records from primary storage. [2025-10-02T22:43:05.245237] [INFO ] [MAIN ] PDX: Loaded 14464 primary data records. [2025-10-02T22:43:06.187735] [DEBUG] [MAIN ] PDS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:06.188805] [INFO ] [MAIN ] PDS: Generated 1807 derivative records from 17719 primary records. [2025-10-02T22:43:06.188970] [DEBUG] [LOCAL ] PDS: Saving derivative data. [2025-10-02T22:43:06.213451] [DEBUG] [MAIN ] PDT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:06.220189] [INFO ] [MAIN ] PDT: Generated 1807 derivative records from 17545 primary records. [2025-10-02T22:43:06.220913] [DEBUG] [LOCAL ] PDT: Saving derivative data. [2025-10-02T22:43:06.249518] [DEBUG] [MAIN ] PDX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:06.251831] [INFO ] [MAIN ] PDX: Generated 1807 derivative records from 14464 primary records. [2025-10-02T22:43:06.252797] [DEBUG] [LOCAL ] PDX: Saving derivative data. [2025-10-02T22:43:06.254758] [DEBUG] [LOCAL ] PDS: Derivative data saved (1807 records). [2025-10-02T22:43:06.255092] [INFO ] [MAIN ] PDS: Successfully saved derivative data. [2025-10-02T22:43:06.257880] [INFO ] [MAIN ] Derivative Progress: 1327/1975 symbols completed. PDS took 1.2s. Estimated remaining: 4m 32s. Rate: 143.0 symbols/min [2025-10-02T22:43:06.259047] [INFO ] [MAIN ] PEB: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:06.273005] [DEBUG] [LOCAL ] PDT: Derivative data saved (1807 records). [2025-10-02T22:43:06.276314] [DEBUG] [LOCAL ] PDX: Derivative data saved (1807 records). [2025-10-02T22:43:06.275279] [INFO ] [MAIN ] PDT: Successfully saved derivative data. [2025-10-02T22:43:06.279161] [INFO ] [MAIN ] Derivative Progress: 1328/1975 symbols completed. PDT took 1.2s. Estimated remaining: 4m 31s. Rate: 143.1 symbols/min [2025-10-02T22:43:06.279515] [INFO ] [MAIN ] PEN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:06.279845] [INFO ] [MAIN ] PDX: Successfully saved derivative data. [2025-10-02T22:43:06.282382] [INFO ] [MAIN ] Derivative Progress: 1329/1975 symbols completed. PDX took 1.2s. Estimated remaining: 4m 31s. Rate: 143.2 symbols/min [2025-10-02T22:43:06.282704] [INFO ] [MAIN ] PERF: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:06.300313] [DEBUG] [LOCAL ] PERF: Loaded 14100 existing records from primary storage. [2025-10-02T22:43:06.300699] [INFO ] [MAIN ] PERF: Loaded 14100 primary data records. [2025-10-02T22:43:06.468545] [DEBUG] [LOCAL ] PEN: Loaded 30405 existing records from primary storage. [2025-10-02T22:43:06.479077] [INFO ] [MAIN ] PEN: Loaded 30405 primary data records. [2025-10-02T22:43:06.783961] [DEBUG] [LOCAL ] PEB: Loaded 51018 existing records from primary storage. [2025-10-02T22:43:06.801807] [INFO ] [MAIN ] PEB: Loaded 51018 primary data records. [2025-10-02T22:43:07.380208] [DEBUG] [MAIN ] PERF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:07.382036] [INFO ] [MAIN ] PERF: Generated 1807 derivative records from 14100 primary records. [2025-10-02T22:43:07.382161] [DEBUG] [LOCAL ] PERF: Saving derivative data. [2025-10-02T22:43:07.409999] [DEBUG] [LOCAL ] PERF: Derivative data saved (1807 records). [2025-10-02T22:43:07.415176] [INFO ] [MAIN ] PERF: Successfully saved derivative data. [2025-10-02T22:43:07.417944] [INFO ] [MAIN ] Derivative Progress: 1330/1975 symbols completed. PERF took 1.1s. Estimated remaining: 4m 31s. Rate: 143.0 symbols/min [2025-10-02T22:43:07.418290] [INFO ] [MAIN ] PFD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:07.418719] [DEBUG] [MAIN ] PEN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:07.420084] [INFO ] [MAIN ] PEN: Generated 1807 derivative records from 30405 primary records. [2025-10-02T22:43:07.420555] [DEBUG] [LOCAL ] PEN: Saving derivative data. [2025-10-02T22:43:07.455705] [DEBUG] [LOCAL ] PFD: Loaded 5172 existing records from primary storage. [2025-10-02T22:43:07.462179] [DEBUG] [MAIN ] PEB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:07.463048] [INFO ] [MAIN ] PEB: Generated 1807 derivative records from 51018 primary records. [2025-10-02T22:43:07.463565] [DEBUG] [LOCAL ] PEB: Saving derivative data. [2025-10-02T22:43:07.461613] [INFO ] [MAIN ] PFD: Loaded 5172 primary data records. [2025-10-02T22:43:07.463486] [DEBUG] [LOCAL ] PEN: Derivative data saved (1807 records). [2025-10-02T22:43:07.464559] [INFO ] [MAIN ] PEN: Successfully saved derivative data. [2025-10-02T22:43:07.520883] [INFO ] [MAIN ] Derivative Progress: 1331/1975 symbols completed. PEN took 1.2s. Estimated remaining: 4m 30s. Rate: 143.1 symbols/min [2025-10-02T22:43:07.532350] [INFO ] [MAIN ] PFGC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:07.646270] [DEBUG] [LOCAL ] PEB: Derivative data saved (1807 records). [2025-10-02T22:43:07.662116] [INFO ] [MAIN ] PEB: Successfully saved derivative data. [2025-10-02T22:43:07.717171] [INFO ] [MAIN ] Derivative Progress: 1332/1975 symbols completed. PEB took 1.5s. Estimated remaining: 4m 30s. Rate: 143.1 symbols/min [2025-10-02T22:43:07.741898] [INFO ] [MAIN ] PFH: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:07.890482] [DEBUG] [LOCAL ] PFGC: Loaded 47161 existing records from primary storage. [2025-10-02T22:43:07.890630] [INFO ] [MAIN ] PFGC: Loaded 47161 primary data records. [2025-10-02T22:43:07.889252] [DEBUG] [LOCAL ] PFH: Loaded 6858 existing records from primary storage. [2025-10-02T22:43:07.890941] [INFO ] [MAIN ] PFH: Loaded 6858 primary data records. [2025-10-02T22:43:08.631219] [DEBUG] [MAIN ] PFD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:08.633223] [INFO ] [MAIN ] PFD: Generated 1807 derivative records from 5172 primary records. [2025-10-02T22:43:08.634326] [DEBUG] [LOCAL ] PFD: Saving derivative data. [2025-10-02T22:43:08.657342] [DEBUG] [LOCAL ] PFD: Derivative data saved (1807 records). [2025-10-02T22:43:08.657992] [INFO ] [MAIN ] PFD: Successfully saved derivative data. [2025-10-02T22:43:08.660549] [INFO ] [MAIN ] Derivative Progress: 1333/1975 symbols completed. PFD took 1.2s. Estimated remaining: 4m 29s. Rate: 143.0 symbols/min [2025-10-02T22:43:08.683221] [DEBUG] [MAIN ] PFH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:08.689847] [INFO ] [MAIN ] PFH: Generated 1807 derivative records from 6858 primary records. [2025-10-02T22:43:08.701802] [DEBUG] [LOCAL ] PFH: Saving derivative data. [2025-10-02T22:43:08.702270] [DEBUG] [MAIN ] PFGC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:08.703903] [INFO ] [MAIN ] PFGC: Generated 1807 derivative records from 47161 primary records. [2025-10-02T22:43:08.704178] [DEBUG] [LOCAL ] PFGC: Saving derivative data. [2025-10-02T22:43:08.741398] [DEBUG] [LOCAL ] PFH: Derivative data saved (1807 records). [2025-10-02T22:43:08.742007] [INFO ] [MAIN ] PFH: Successfully saved derivative data. [2025-10-02T22:43:08.745198] [INFO ] [MAIN ] Derivative Progress: 1334/1975 symbols completed. PFH took 1.0s. Estimated remaining: 4m 29s. Rate: 143.1 symbols/min [2025-10-02T22:43:08.746301] [DEBUG] [LOCAL ] PFGC: Derivative data saved (1807 records). [2025-10-02T22:43:08.746373] [INFO ] [MAIN ] PFGC: Successfully saved derivative data. [2025-10-02T22:43:08.749290] [INFO ] [MAIN ] Derivative Progress: 1335/1975 symbols completed. PFGC took 1.2s. Estimated remaining: 4m 28s. Rate: 143.2 symbols/min [2025-10-02T22:43:08.750072] [INFO ] [MAIN ] PFN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:08.749940] [INFO ] [MAIN ] PFL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:08.750018] [INFO ] [MAIN ] PFLT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:08.769741] [DEBUG] [LOCAL ] PFL: Loaded 13775 existing records from primary storage. [2025-10-02T22:43:08.769895] [INFO ] [MAIN ] PFL: Loaded 13775 primary data records. [2025-10-02T22:43:08.848914] [DEBUG] [LOCAL ] PFN: Loaded 22007 existing records from primary storage. [2025-10-02T22:43:08.868305] [INFO ] [MAIN ] PFN: Loaded 22007 primary data records. [2025-10-02T22:43:09.144556] [DEBUG] [LOCAL ] PFLT: Loaded 44136 existing records from primary storage. [2025-10-02T22:43:09.193624] [INFO ] [MAIN ] PFLT: Loaded 44136 primary data records. [2025-10-02T22:43:09.944478] [DEBUG] [MAIN ] PFN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:09.946437] [INFO ] [MAIN ] PFN: Generated 1807 derivative records from 22007 primary records. [2025-10-02T22:43:09.945174] [DEBUG] [MAIN ] PFL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:09.947182] [DEBUG] [LOCAL ] PFN: Saving derivative data. [2025-10-02T22:43:09.948229] [INFO ] [MAIN ] PFL: Generated 1807 derivative records from 13775 primary records. [2025-10-02T22:43:09.948624] [DEBUG] [LOCAL ] PFL: Saving derivative data. [2025-10-02T22:43:09.983668] [DEBUG] [LOCAL ] PFL: Derivative data saved (1807 records). [2025-10-02T22:43:09.985515] [INFO ] [MAIN ] PFL: Successfully saved derivative data. [2025-10-02T22:43:09.988307] [INFO ] [MAIN ] Derivative Progress: 1336/1975 symbols completed. PFL took 1.2s. Estimated remaining: 4m 28s. Rate: 143.0 symbols/min [2025-10-02T22:43:09.989469] [INFO ] [MAIN ] PFO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:10.008320] [DEBUG] [MAIN ] PFLT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:10.011754] [INFO ] [MAIN ] PFLT: Generated 1807 derivative records from 44136 primary records. [2025-10-02T22:43:10.012185] [DEBUG] [LOCAL ] PFLT: Saving derivative data. [2025-10-02T22:43:10.013129] [DEBUG] [LOCAL ] PFN: Derivative data saved (1807 records). [2025-10-02T22:43:10.014386] [INFO ] [MAIN ] PFN: Successfully saved derivative data. [2025-10-02T22:43:10.033717] [DEBUG] [LOCAL ] PFO: Loaded 6008 existing records from primary storage. [2025-10-02T22:43:10.026982] [INFO ] [MAIN ] Derivative Progress: 1337/1975 symbols completed. PFN took 1.3s. Estimated remaining: 4m 28s. Rate: 143.1 symbols/min [2025-10-02T22:43:10.035144] [INFO ] [MAIN ] PFS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:10.035032] [INFO ] [MAIN ] PFO: Loaded 6008 primary data records. [2025-10-02T22:43:10.130154] [DEBUG] [LOCAL ] PFLT: Derivative data saved (1807 records). [2025-10-02T22:43:10.141152] [INFO ] [MAIN ] PFLT: Successfully saved derivative data. [2025-10-02T22:43:10.150114] [INFO ] [MAIN ] Derivative Progress: 1338/1975 symbols completed. PFLT took 1.4s. Estimated remaining: 4m 27s. Rate: 143.2 symbols/min [2025-10-02T22:43:10.169101] [INFO ] [MAIN ] PFSI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:10.343942] [DEBUG] [LOCAL ] PFS: Loaded 35837 existing records from primary storage. [2025-10-02T22:43:10.457817] [INFO ] [MAIN ] PFS: Loaded 35837 primary data records. [2025-10-02T22:43:10.607389] [DEBUG] [LOCAL ] PFSI: Loaded 28951 existing records from primary storage. [2025-10-02T22:43:10.623282] [INFO ] [MAIN ] PFSI: Loaded 28951 primary data records. [2025-10-02T22:43:11.191397] [DEBUG] [MAIN ] PFO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:11.192334] [INFO ] [MAIN ] PFO: Generated 1807 derivative records from 6008 primary records. [2025-10-02T22:43:11.192576] [DEBUG] [LOCAL ] PFO: Saving derivative data. [2025-10-02T22:43:11.216932] [DEBUG] [LOCAL ] PFO: Derivative data saved (1807 records). [2025-10-02T22:43:11.217074] [INFO ] [MAIN ] PFO: Successfully saved derivative data. [2025-10-02T22:43:11.219683] [INFO ] [MAIN ] Derivative Progress: 1339/1975 symbols completed. PFO took 1.2s. Estimated remaining: 4m 27s. Rate: 143.0 symbols/min [2025-10-02T22:43:11.220411] [INFO ] [MAIN ] PGP: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:11.237149] [DEBUG] [MAIN ] PFS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:11.238402] [INFO ] [MAIN ] PFS: Generated 1807 derivative records from 35837 primary records. [2025-10-02T22:43:11.238564] [DEBUG] [LOCAL ] PFS: Saving derivative data. [2025-10-02T22:43:11.258026] [DEBUG] [LOCAL ] PGP: Loaded 5544 existing records from primary storage. [2025-10-02T22:43:11.258335] [INFO ] [MAIN ] PGP: Loaded 5544 primary data records. [2025-10-02T22:43:11.365127] [DEBUG] [LOCAL ] PFS: Derivative data saved (1807 records). [2025-10-02T22:43:11.397955] [INFO ] [MAIN ] PFS: Successfully saved derivative data. [2025-10-02T22:43:11.400735] [INFO ] [MAIN ] Derivative Progress: 1340/1975 symbols completed. PFS took 1.4s. Estimated remaining: 4m 26s. Rate: 143.0 symbols/min [2025-10-02T22:43:11.400914] [INFO ] [MAIN ] PGR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:11.405817] [DEBUG] [MAIN ] PFSI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:11.407116] [INFO ] [MAIN ] PFSI: Generated 1807 derivative records from 28951 primary records. [2025-10-02T22:43:11.407233] [DEBUG] [LOCAL ] PFSI: Saving derivative data. [2025-10-02T22:43:11.638189] [DEBUG] [LOCAL ] PFSI: Derivative data saved (1807 records). [2025-10-02T22:43:11.638967] [INFO ] [MAIN ] PFSI: Successfully saved derivative data. [2025-10-02T22:43:11.642166] [INFO ] [MAIN ] Derivative Progress: 1341/1975 symbols completed. PFSI took 1.5s. Estimated remaining: 4m 26s. Rate: 143.1 symbols/min [2025-10-02T22:43:11.642688] [INFO ] [MAIN ] PGRE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:11.685915] [DEBUG] [LOCAL ] PGR: Loaded 53322 existing records from primary storage. [2025-10-02T22:43:11.699357] [INFO ] [MAIN ] PGR: Loaded 53322 primary data records. [2025-10-02T22:43:11.704325] [DEBUG] [MAIN ] PGP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:11.705462] [INFO ] [MAIN ] PGP: Generated 1807 derivative records from 5544 primary records. [2025-10-02T22:43:11.727708] [DEBUG] [LOCAL ] PGP: Saving derivative data. [2025-10-02T22:43:11.945015] [DEBUG] [LOCAL ] PGP: Derivative data saved (1807 records). [2025-10-02T22:43:11.945150] [INFO ] [MAIN ] PGP: Successfully saved derivative data. [2025-10-02T22:43:11.947176] [INFO ] [MAIN ] Derivative Progress: 1342/1975 symbols completed. PGP took 0.7s. Estimated remaining: 4m 25s. Rate: 143.1 symbols/min [2025-10-02T22:43:12.076899] [INFO ] [MAIN ] PGZ: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:12.076575] [DEBUG] [LOCAL ] PGRE: Loaded 46986 existing records from primary storage. [2025-10-02T22:43:12.077505] [INFO ] [MAIN ] PGRE: Loaded 46986 primary data records. [2025-10-02T22:43:12.173498] [DEBUG] [LOCAL ] PGZ: Loaded 5505 existing records from primary storage. [2025-10-02T22:43:12.184404] [INFO ] [MAIN ] PGZ: Loaded 5505 primary data records. [2025-10-02T22:43:12.830478] [DEBUG] [MAIN ] PGR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:12.833792] [INFO ] [MAIN ] PGR: Generated 1807 derivative records from 53322 primary records. [2025-10-02T22:43:12.834146] [DEBUG] [LOCAL ] PGR: Saving derivative data. [2025-10-02T22:43:12.853870] [DEBUG] [LOCAL ] PGR: Derivative data saved (1807 records). [2025-10-02T22:43:12.854290] [INFO ] [MAIN ] PGR: Successfully saved derivative data. [2025-10-02T22:43:12.857781] [INFO ] [MAIN ] Derivative Progress: 1343/1975 symbols completed. PGR took 1.5s. Estimated remaining: 4m 25s. Rate: 143.0 symbols/min [2025-10-02T22:43:12.858108] [INFO ] [MAIN ] PH: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:12.893028] [DEBUG] [MAIN ] PGRE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:12.893632] [DEBUG] [MAIN ] PGZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:12.894986] [INFO ] [MAIN ] PGZ: Generated 1807 derivative records from 5505 primary records. [2025-10-02T22:43:12.895159] [DEBUG] [LOCAL ] PGZ: Saving derivative data. [2025-10-02T22:43:12.894305] [INFO ] [MAIN ] PGRE: Generated 1807 derivative records from 46986 primary records. [2025-10-02T22:43:12.895322] [DEBUG] [LOCAL ] PGRE: Saving derivative data. [2025-10-02T22:43:12.938025] [DEBUG] [LOCAL ] PGRE: Derivative data saved (1807 records). [2025-10-02T22:43:12.939394] [DEBUG] [LOCAL ] PGZ: Derivative data saved (1807 records). [2025-10-02T22:43:12.939606] [INFO ] [MAIN ] PGZ: Successfully saved derivative data. [2025-10-02T22:43:12.939688] [INFO ] [MAIN ] PGRE: Successfully saved derivative data. [2025-10-02T22:43:12.942013] [INFO ] [MAIN ] Derivative Progress: 1344/1975 symbols completed. PGZ took 0.9s. Estimated remaining: 4m 25s. Rate: 143.1 symbols/min [2025-10-02T22:43:12.944811] [INFO ] [MAIN ] Derivative Progress: 1345/1975 symbols completed. PGRE took 1.3s. Estimated remaining: 4m 24s. Rate: 143.2 symbols/min [2025-10-02T22:43:12.944556] [INFO ] [MAIN ] PHD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:12.957737] [DEBUG] [LOCAL ] PH: Loaded 38286 existing records from primary storage. [2025-10-02T22:43:12.956540] [INFO ] [MAIN ] PHG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:12.958035] [INFO ] [MAIN ] PH: Loaded 38286 primary data records. [2025-10-02T22:43:13.080990] [DEBUG] [LOCAL ] PHD: Loaded 10664 existing records from primary storage. [2025-10-02T22:43:13.081274] [INFO ] [MAIN ] PHD: Loaded 10664 primary data records. [2025-10-02T22:43:13.467142] [DEBUG] [LOCAL ] PHG: Loaded 46334 existing records from primary storage. [2025-10-02T22:43:13.479488] [INFO ] [MAIN ] PHG: Loaded 46334 primary data records. [2025-10-02T22:43:14.081476] [DEBUG] [MAIN ] PH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:14.083374] [INFO ] [MAIN ] PH: Generated 1807 derivative records from 38286 primary records. [2025-10-02T22:43:14.083513] [DEBUG] [LOCAL ] PH: Saving derivative data. [2025-10-02T22:43:14.107936] [DEBUG] [LOCAL ] PH: Derivative data saved (1807 records). [2025-10-02T22:43:14.108389] [INFO ] [MAIN ] PH: Successfully saved derivative data. [2025-10-02T22:43:14.123111] [INFO ] [MAIN ] Derivative Progress: 1346/1975 symbols completed. PH took 1.3s. Estimated remaining: 4m 24s. Rate: 143.0 symbols/min [2025-10-02T22:43:14.124265] [INFO ] [MAIN ] PHI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:14.124777] [DEBUG] [MAIN ] PHD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:14.125782] [INFO ] [MAIN ] PHD: Generated 1807 derivative records from 10664 primary records. [2025-10-02T22:43:14.125946] [DEBUG] [LOCAL ] PHD: Saving derivative data. [2025-10-02T22:43:14.153819] [DEBUG] [LOCAL ] PHD: Derivative data saved (1807 records). [2025-10-02T22:43:14.159346] [INFO ] [MAIN ] PHD: Successfully saved derivative data. [2025-10-02T22:43:14.161838] [INFO ] [MAIN ] Derivative Progress: 1347/1975 symbols completed. PHD took 1.2s. Estimated remaining: 4m 23s. Rate: 143.1 symbols/min [2025-10-02T22:43:14.162271] [DEBUG] [MAIN ] PHG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:14.162415] [INFO ] [MAIN ] PHIN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:14.163565] [INFO ] [MAIN ] PHG: Generated 1807 derivative records from 46334 primary records. [2025-10-02T22:43:14.163728] [DEBUG] [LOCAL ] PHG: Saving derivative data. [2025-10-02T22:43:14.190032] [DEBUG] [LOCAL ] PHI: Loaded 15208 existing records from primary storage. [2025-10-02T22:43:14.190791] [INFO ] [MAIN ] PHI: Loaded 15208 primary data records. [2025-10-02T22:43:14.316536] [DEBUG] [LOCAL ] PHG: Derivative data saved (1807 records). [2025-10-02T22:43:14.317119] [INFO ] [MAIN ] PHG: Successfully saved derivative data. [2025-10-02T22:43:14.331072] [INFO ] [MAIN ] Derivative Progress: 1348/1975 symbols completed. PHG took 1.4s. Estimated remaining: 4m 23s. Rate: 143.2 symbols/min [2025-10-02T22:43:14.375032] [DEBUG] [LOCAL ] PHIN: Loaded 32840 existing records from primary storage. [2025-10-02T22:43:14.392554] [INFO ] [MAIN ] PHIN: Loaded 32840 primary data records. [2025-10-02T22:43:14.929094] [DEBUG] [MAIN ] PHI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:14.930040] [INFO ] [MAIN ] PHI: Generated 1807 derivative records from 15208 primary records. [2025-10-02T22:43:14.930304] [DEBUG] [LOCAL ] PHI: Saving derivative data. [2025-10-02T22:43:14.948984] [DEBUG] [LOCAL ] PHI: Derivative data saved (1807 records). [2025-10-02T22:43:14.962118] [INFO ] [MAIN ] PHI: Successfully saved derivative data. [2025-10-02T22:43:14.964396] [INFO ] [MAIN ] Derivative Progress: 1349/1975 symbols completed. PHI took 0.8s. Estimated remaining: 4m 22s. Rate: 143.1 symbols/min [2025-10-02T22:43:14.962032] [DEBUG] [MAIN ] PHIN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:14.965424] [INFO ] [MAIN ] PHIN: Generated 1807 derivative records from 32840 primary records. [2025-10-02T22:43:14.965617] [DEBUG] [LOCAL ] PHIN: Saving derivative data. [2025-10-02T22:43:14.981732] [DEBUG] [LOCAL ] PHIN: Derivative data saved (1807 records). [2025-10-02T22:43:14.981813] [INFO ] [MAIN ] PHIN: Successfully saved derivative data. [2025-10-02T22:43:14.984185] [INFO ] [MAIN ] Derivative Progress: 1350/1975 symbols completed. PHIN took 0.8s. Estimated remaining: 4m 22s. Rate: 143.2 symbols/min [2025-10-02T22:43:14.984936] [INFO ] [MAIN ] PHR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:14.985165] [INFO ] [MAIN ] PII: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:14.985081] [INFO ] [MAIN ] PIM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:14.996223] [DEBUG] [LOCAL ] PIM: Loaded 4816 existing records from primary storage. [2025-10-02T22:43:14.996441] [INFO ] [MAIN ] PIM: Loaded 4816 primary data records. [2025-10-02T22:43:15.369333] [DEBUG] [LOCAL ] PHR: Loaded 37647 existing records from primary storage. [2025-10-02T22:43:15.369567] [INFO ] [MAIN ] PHR: Loaded 37647 primary data records. [2025-10-02T22:43:15.383765] [DEBUG] [LOCAL ] PII: Loaded 49297 existing records from primary storage. [2025-10-02T22:43:15.417412] [INFO ] [MAIN ] PII: Loaded 49297 primary data records. [2025-10-02T22:43:16.088826] [DEBUG] [MAIN ] PIM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:16.090674] [INFO ] [MAIN ] PIM: Generated 1807 derivative records from 4816 primary records. [2025-10-02T22:43:16.090913] [DEBUG] [LOCAL ] PIM: Saving derivative data. [2025-10-02T22:43:16.112789] [DEBUG] [LOCAL ] PIM: Derivative data saved (1807 records). [2025-10-02T22:43:16.113954] [INFO ] [MAIN ] PIM: Successfully saved derivative data. [2025-10-02T22:43:16.117162] [INFO ] [MAIN ] Derivative Progress: 1351/1975 symbols completed. PIM took 1.1s. Estimated remaining: 4m 22s. Rate: 143.0 symbols/min [2025-10-02T22:43:16.117744] [INFO ] [MAIN ] PINE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:16.133340] [DEBUG] [MAIN ] PHR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:16.134169] [INFO ] [MAIN ] PHR: Generated 1807 derivative records from 37647 primary records. [2025-10-02T22:43:16.134421] [DEBUG] [LOCAL ] PHR: Saving derivative data. [2025-10-02T22:43:16.176362] [DEBUG] [MAIN ] PII: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:16.175789] [DEBUG] [LOCAL ] PINE: Loaded 14200 existing records from primary storage. [2025-10-02T22:43:16.177424] [INFO ] [MAIN ] PII: Generated 1807 derivative records from 49297 primary records. [2025-10-02T22:43:16.177896] [INFO ] [MAIN ] PINE: Loaded 14200 primary data records. [2025-10-02T22:43:16.183131] [DEBUG] [LOCAL ] PII: Saving derivative data. [2025-10-02T22:43:16.231020] [DEBUG] [LOCAL ] PHR: Derivative data saved (1807 records). [2025-10-02T22:43:16.253957] [INFO ] [MAIN ] PHR: Successfully saved derivative data. [2025-10-02T22:43:16.269293] [INFO ] [MAIN ] Derivative Progress: 1352/1975 symbols completed. PHR took 1.3s. Estimated remaining: 4m 21s. Rate: 143.1 symbols/min [2025-10-02T22:43:16.274683] [INFO ] [MAIN ] PINS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:16.334631] [DEBUG] [LOCAL ] PII: Derivative data saved (1807 records). [2025-10-02T22:43:16.345283] [INFO ] [MAIN ] PII: Successfully saved derivative data. [2025-10-02T22:43:16.359928] [INFO ] [MAIN ] Derivative Progress: 1353/1975 symbols completed. PII took 1.4s. Estimated remaining: 4m 21s. Rate: 143.2 symbols/min [2025-10-02T22:43:16.402200] [INFO ] [MAIN ] PIPR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:16.579567] [DEBUG] [MAIN ] PINE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:16.580874] [INFO ] [MAIN ] PINE: Generated 1807 derivative records from 14200 primary records. [2025-10-02T22:43:16.587600] [DEBUG] [LOCAL ] PINE: Saving derivative data. [2025-10-02T22:43:16.588105] [DEBUG] [LOCAL ] PIPR: Loaded 14894 existing records from primary storage. [2025-10-02T22:43:16.589697] [INFO ] [MAIN ] PIPR: Loaded 14894 primary data records. [2025-10-02T22:43:16.707696] [DEBUG] [LOCAL ] PINS: Loaded 54083 existing records from primary storage. [2025-10-02T22:43:16.713792] [INFO ] [MAIN ] PINS: Loaded 54083 primary data records. [2025-10-02T22:43:16.720132] [DEBUG] [LOCAL ] PINE: Derivative data saved (1807 records). [2025-10-02T22:43:16.732190] [INFO ] [MAIN ] PINE: Successfully saved derivative data. [2025-10-02T22:43:16.741076] [INFO ] [MAIN ] Derivative Progress: 1354/1975 symbols completed. PINE took 0.6s. Estimated remaining: 4m 20s. Rate: 143.2 symbols/min [2025-10-02T22:43:16.749897] [INFO ] [MAIN ] PJT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:17.344124] [DEBUG] [LOCAL ] PJT: Loaded 21733 existing records from primary storage. [2025-10-02T22:43:17.344357] [INFO ] [MAIN ] PJT: Loaded 21733 primary data records. [2025-10-02T22:43:17.697119] [DEBUG] [MAIN ] PIPR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:17.697978] [INFO ] [MAIN ] PIPR: Generated 1807 derivative records from 14894 primary records. [2025-10-02T22:43:17.698085] [DEBUG] [LOCAL ] PIPR: Saving derivative data. [2025-10-02T22:43:17.720495] [DEBUG] [LOCAL ] PIPR: Derivative data saved (1807 records). [2025-10-02T22:43:17.722391] [INFO ] [MAIN ] PIPR: Successfully saved derivative data. [2025-10-02T22:43:17.724870] [INFO ] [MAIN ] Derivative Progress: 1355/1975 symbols completed. PIPR took 1.3s. Estimated remaining: 4m 20s. Rate: 143.0 symbols/min [2025-10-02T22:43:17.725256] [INFO ] [MAIN ] PK: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:17.745383] [DEBUG] [MAIN ] PINS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:17.746234] [INFO ] [MAIN ] PINS: Generated 1807 derivative records from 54083 primary records. [2025-10-02T22:43:17.747797] [DEBUG] [LOCAL ] PINS: Saving derivative data. [2025-10-02T22:43:17.782850] [DEBUG] [MAIN ] PJT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:17.784117] [INFO ] [MAIN ] PJT: Generated 1807 derivative records from 21733 primary records. [2025-10-02T22:43:17.784768] [DEBUG] [LOCAL ] PJT: Saving derivative data. [2025-10-02T22:43:17.786388] [DEBUG] [LOCAL ] PINS: Derivative data saved (1807 records). [2025-10-02T22:43:17.793873] [INFO ] [MAIN ] PINS: Successfully saved derivative data. [2025-10-02T22:43:17.796231] [INFO ] [MAIN ] Derivative Progress: 1356/1975 symbols completed. PINS took 1.5s. Estimated remaining: 4m 19s. Rate: 143.1 symbols/min [2025-10-02T22:43:17.800131] [INFO ] [MAIN ] PKE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:17.820066] [DEBUG] [LOCAL ] PJT: Derivative data saved (1807 records). [2025-10-02T22:43:17.820205] [INFO ] [MAIN ] PJT: Successfully saved derivative data. [2025-10-02T22:43:17.822506] [INFO ] [MAIN ] Derivative Progress: 1357/1975 symbols completed. PJT took 1.1s. Estimated remaining: 4m 19s. Rate: 143.2 symbols/min [2025-10-02T22:43:17.822767] [INFO ] [MAIN ] PKG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:17.852326] [DEBUG] [LOCAL ] PKE: Loaded 13081 existing records from primary storage. [2025-10-02T22:43:17.853728] [INFO ] [MAIN ] PKE: Loaded 13081 primary data records. [2025-10-02T22:43:17.853551] [DEBUG] [LOCAL ] PK: Loaded 53206 existing records from primary storage. [2025-10-02T22:43:17.859224] [INFO ] [MAIN ] PK: Loaded 53206 primary data records. [2025-10-02T22:43:18.248187] [DEBUG] [LOCAL ] PKG: Loaded 39238 existing records from primary storage. [2025-10-02T22:43:18.333782] [INFO ] [MAIN ] PKG: Loaded 39238 primary data records. [2025-10-02T22:43:19.048566] [DEBUG] [MAIN ] PKE: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-02T22:43:19.049471] [DEBUG] [MAIN ] PK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:19.050423] [INFO ] [MAIN ] PKE: Generated 1806 derivative records from 13081 primary records. [2025-10-02T22:43:19.053030] [INFO ] [MAIN ] PK: Generated 1807 derivative records from 53206 primary records. [2025-10-02T22:43:19.051918] [DEBUG] [LOCAL ] PKE: Saving derivative data. [2025-10-02T22:43:19.054417] [DEBUG] [LOCAL ] PK: Saving derivative data. [2025-10-02T22:43:19.072959] [DEBUG] [LOCAL ] PKE: Derivative data saved (1806 records). [2025-10-02T22:43:19.085739] [INFO ] [MAIN ] PKE: Successfully saved derivative data. [2025-10-02T22:43:19.093019] [INFO ] [MAIN ] Derivative Progress: 1358/1975 symbols completed. PKE took 1.3s. Estimated remaining: 4m 19s. Rate: 143.0 symbols/min [2025-10-02T22:43:19.090365] [DEBUG] [LOCAL ] PK: Derivative data saved (1807 records). [2025-10-02T22:43:19.093731] [INFO ] [MAIN ] PK: Successfully saved derivative data. [2025-10-02T22:43:19.093821] [INFO ] [MAIN ] PKST: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:19.096122] [INFO ] [MAIN ] Derivative Progress: 1359/1975 symbols completed. PK took 1.4s. Estimated remaining: 4m 18s. Rate: 143.1 symbols/min [2025-10-02T22:43:19.096686] [INFO ] [MAIN ] PKX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:19.117100] [DEBUG] [MAIN ] PKG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:19.118018] [INFO ] [MAIN ] PKG: Generated 1807 derivative records from 39238 primary records. [2025-10-02T22:43:19.118204] [DEBUG] [LOCAL ] PKG: Saving derivative data. [2025-10-02T22:43:19.146597] [DEBUG] [LOCAL ] PKG: Derivative data saved (1807 records). [2025-10-02T22:43:19.146879] [INFO ] [MAIN ] PKG: Successfully saved derivative data. [2025-10-02T22:43:19.149545] [INFO ] [MAIN ] Derivative Progress: 1360/1975 symbols completed. PKG took 1.3s. Estimated remaining: 4m 18s. Rate: 143.2 symbols/min [2025-10-02T22:43:19.158323] [DEBUG] [LOCAL ] PKST: Loaded 18921 existing records from primary storage. [2025-10-02T22:43:19.157719] [INFO ] [MAIN ] PL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:19.158563] [INFO ] [MAIN ] PKST: Loaded 18921 primary data records. [2025-10-02T22:43:19.219696] [DEBUG] [LOCAL ] PKX: Loaded 24461 existing records from primary storage. [2025-10-02T22:43:19.246540] [INFO ] [MAIN ] PKX: Loaded 24461 primary data records. [2025-10-02T22:43:19.890998] [DEBUG] [LOCAL ] PL: Loaded 53521 existing records from primary storage. [2025-10-02T22:43:19.892275] [INFO ] [MAIN ] PL: Loaded 53521 primary data records. [2025-10-02T22:43:20.267300] [DEBUG] [MAIN ] PKX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:20.280681] [INFO ] [MAIN ] PKX: Generated 1807 derivative records from 24461 primary records. [2025-10-02T22:43:20.280836] [DEBUG] [LOCAL ] PKX: Saving derivative data. [2025-10-02T22:43:20.282430] [DEBUG] [MAIN ] PKST: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:20.283445] [INFO ] [MAIN ] PKST: Generated 1807 derivative records from 18921 primary records. [2025-10-02T22:43:20.283538] [DEBUG] [LOCAL ] PKST: Saving derivative data. [2025-10-02T22:43:20.314637] [DEBUG] [LOCAL ] PKX: Derivative data saved (1807 records). [2025-10-02T22:43:20.317829] [INFO ] [MAIN ] PKX: Successfully saved derivative data. [2025-10-02T22:43:20.319437] [DEBUG] [LOCAL ] PKST: Derivative data saved (1807 records). [2025-10-02T22:43:20.322692] [INFO ] [MAIN ] PKST: Successfully saved derivative data. [2025-10-02T22:43:20.322491] [INFO ] [MAIN ] Derivative Progress: 1361/1975 symbols completed. PKX took 1.2s. Estimated remaining: 4m 18s. Rate: 143.0 symbols/min [2025-10-02T22:43:20.325694] [INFO ] [MAIN ] PLD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:20.326274] [INFO ] [MAIN ] Derivative Progress: 1362/1975 symbols completed. PKST took 1.2s. Estimated remaining: 4m 17s. Rate: 143.1 symbols/min [2025-10-02T22:43:20.327355] [INFO ] [MAIN ] PLNT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:20.348875] [DEBUG] [MAIN ] PL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:20.349625] [INFO ] [MAIN ] PL: Generated 1807 derivative records from 53521 primary records. [2025-10-02T22:43:20.349793] [DEBUG] [LOCAL ] PL: Saving derivative data. [2025-10-02T22:43:20.368441] [DEBUG] [LOCAL ] PL: Derivative data saved (1807 records). [2025-10-02T22:43:20.368790] [INFO ] [MAIN ] PL: Successfully saved derivative data. [2025-10-02T22:43:20.371476] [INFO ] [MAIN ] Derivative Progress: 1363/1975 symbols completed. PL took 1.2s. Estimated remaining: 4m 16s. Rate: 143.2 symbols/min [2025-10-02T22:43:20.433465] [DEBUG] [LOCAL ] PLD: Loaded 53823 existing records from primary storage. [2025-10-02T22:43:20.434239] [INFO ] [MAIN ] PLD: Loaded 53823 primary data records. [2025-10-02T22:43:20.533197] [DEBUG] [LOCAL ] PLNT: Loaded 48596 existing records from primary storage. [2025-10-02T22:43:20.545926] [INFO ] [MAIN ] PLNT: Loaded 48596 primary data records. [2025-10-02T22:43:21.169196] [DEBUG] [MAIN ] PLD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:21.171947] [INFO ] [MAIN ] PLD: Generated 1807 derivative records from 53823 primary records. [2025-10-02T22:43:21.172049] [DEBUG] [LOCAL ] PLD: Saving derivative data. [2025-10-02T22:43:21.204745] [DEBUG] [MAIN ] PLNT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:21.206321] [INFO ] [MAIN ] PLNT: Generated 1807 derivative records from 48596 primary records. [2025-10-02T22:43:21.206759] [DEBUG] [LOCAL ] PLNT: Saving derivative data. [2025-10-02T22:43:21.221392] [DEBUG] [LOCAL ] PLD: Derivative data saved (1807 records). [2025-10-02T22:43:21.222162] [INFO ] [MAIN ] PLD: Successfully saved derivative data. [2025-10-02T22:43:21.225067] [INFO ] [MAIN ] Derivative Progress: 1364/1975 symbols completed. PLD took 0.9s. Estimated remaining: 4m 16s. Rate: 143.1 symbols/min [2025-10-02T22:43:21.229865] [DEBUG] [LOCAL ] PLNT: Derivative data saved (1807 records). [2025-10-02T22:43:21.229941] [INFO ] [MAIN ] PLNT: Successfully saved derivative data. [2025-10-02T22:43:21.233869] [INFO ] [MAIN ] Derivative Progress: 1365/1975 symbols completed. PLNT took 0.9s. Estimated remaining: 4m 16s. Rate: 143.2 symbols/min [2025-10-02T22:43:21.234439] [INFO ] [MAIN ] PLOW: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:21.234608] [INFO ] [MAIN ] PML: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:21.234551] [INFO ] [MAIN ] PLYM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:21.294137] [DEBUG] [LOCAL ] PLOW: Loaded 20445 existing records from primary storage. [2025-10-02T22:43:21.295169] [DEBUG] [LOCAL ] PML: Loaded 21357 existing records from primary storage. [2025-10-02T22:43:21.295398] [INFO ] [MAIN ] PLOW: Loaded 20445 primary data records. [2025-10-02T22:43:21.295530] [INFO ] [MAIN ] PML: Loaded 21357 primary data records. [2025-10-02T22:43:21.296374] [DEBUG] [LOCAL ] PLYM: Loaded 33746 existing records from primary storage. [2025-10-02T22:43:21.301960] [INFO ] [MAIN ] PLYM: Loaded 33746 primary data records. [2025-10-02T22:43:22.389951] [DEBUG] [MAIN ] PLOW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:22.406778] [INFO ] [MAIN ] PLOW: Generated 1807 derivative records from 20445 primary records. [2025-10-02T22:43:22.406000] [DEBUG] [MAIN ] PLYM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:22.407972] [INFO ] [MAIN ] PLYM: Generated 1807 derivative records from 33746 primary records. [2025-10-02T22:43:22.408118] [DEBUG] [LOCAL ] PLYM: Saving derivative data. [2025-10-02T22:43:22.407079] [DEBUG] [LOCAL ] PLOW: Saving derivative data. [2025-10-02T22:43:22.422999] [DEBUG] [MAIN ] PML: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:22.424886] [INFO ] [MAIN ] PML: Generated 1807 derivative records from 21357 primary records. [2025-10-02T22:43:22.432768] [DEBUG] [LOCAL ] PML: Saving derivative data. [2025-10-02T22:43:22.465084] [DEBUG] [LOCAL ] PLYM: Derivative data saved (1807 records). [2025-10-02T22:43:22.470345] [DEBUG] [LOCAL ] PLOW: Derivative data saved (1807 records). [2025-10-02T22:43:22.470531] [INFO ] [MAIN ] PLYM: Successfully saved derivative data. [2025-10-02T22:43:22.470712] [INFO ] [MAIN ] PLOW: Successfully saved derivative data. [2025-10-02T22:43:22.476180] [INFO ] [MAIN ] Derivative Progress: 1366/1975 symbols completed. PLOW took 1.2s. Estimated remaining: 4m 16s. Rate: 143.0 symbols/min [2025-10-02T22:43:22.478900] [INFO ] [MAIN ] Derivative Progress: 1367/1975 symbols completed. PLYM took 1.2s. Estimated remaining: 4m 15s. Rate: 143.1 symbols/min [2025-10-02T22:43:22.478759] [INFO ] [MAIN ] PMM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:22.480807] [DEBUG] [LOCAL ] PML: Derivative data saved (1807 records). [2025-10-02T22:43:22.481208] [INFO ] [MAIN ] PML: Successfully saved derivative data. [2025-10-02T22:43:22.479281] [INFO ] [MAIN ] PMO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:22.483946] [INFO ] [MAIN ] Derivative Progress: 1368/1975 symbols completed. PML took 1.2s. Estimated remaining: 4m 14s. Rate: 143.2 symbols/min [2025-10-02T22:43:22.484688] [INFO ] [MAIN ] PMT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:22.500061] [DEBUG] [LOCAL ] PMO: Loaded 10556 existing records from primary storage. [2025-10-02T22:43:22.500277] [INFO ] [MAIN ] PMO: Loaded 10556 primary data records. [2025-10-02T22:43:22.555507] [DEBUG] [LOCAL ] PMM: Loaded 10876 existing records from primary storage. [2025-10-02T22:43:22.587424] [INFO ] [MAIN ] PMM: Loaded 10876 primary data records. [2025-10-02T22:43:22.973990] [DEBUG] [LOCAL ] PMT: Loaded 40599 existing records from primary storage. [2025-10-02T22:43:22.995615] [INFO ] [MAIN ] PMT: Loaded 40599 primary data records. [2025-10-02T22:43:23.664382] [DEBUG] [MAIN ] PMO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:23.674272] [INFO ] [MAIN ] PMO: Generated 1807 derivative records from 10556 primary records. [2025-10-02T22:43:23.680287] [DEBUG] [MAIN ] PMM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:23.680351] [DEBUG] [LOCAL ] PMO: Saving derivative data. [2025-10-02T22:43:23.682302] [INFO ] [MAIN ] PMM: Generated 1807 derivative records from 10876 primary records. [2025-10-02T22:43:23.682409] [DEBUG] [LOCAL ] PMM: Saving derivative data. [2025-10-02T22:43:23.722518] [DEBUG] [LOCAL ] PMO: Derivative data saved (1807 records). [2025-10-02T22:43:23.723398] [INFO ] [MAIN ] PMO: Successfully saved derivative data. [2025-10-02T22:43:23.725805] [INFO ] [MAIN ] Derivative Progress: 1369/1975 symbols completed. PMO took 1.2s. Estimated remaining: 4m 14s. Rate: 143.0 symbols/min [2025-10-02T22:43:23.734394] [INFO ] [MAIN ] PNI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:23.741765] [DEBUG] [MAIN ] PMT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:23.742816] [INFO ] [MAIN ] PMT: Generated 1807 derivative records from 40599 primary records. [2025-10-02T22:43:23.743619] [DEBUG] [LOCAL ] PMT: Saving derivative data. [2025-10-02T22:43:23.743707] [DEBUG] [LOCAL ] PMM: Derivative data saved (1807 records). [2025-10-02T22:43:23.745012] [INFO ] [MAIN ] PMM: Successfully saved derivative data. [2025-10-02T22:43:23.748197] [INFO ] [MAIN ] Derivative Progress: 1370/1975 symbols completed. PMM took 1.3s. Estimated remaining: 4m 14s. Rate: 143.1 symbols/min [2025-10-02T22:43:23.756228] [INFO ] [MAIN ] PNNT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:23.770695] [DEBUG] [LOCAL ] PNI: Loaded 6820 existing records from primary storage. [2025-10-02T22:43:23.771132] [INFO ] [MAIN ] PNI: Loaded 6820 primary data records. [2025-10-02T22:43:23.796014] [DEBUG] [LOCAL ] PMT: Derivative data saved (1807 records). [2025-10-02T22:43:23.813371] [INFO ] [MAIN ] PMT: Successfully saved derivative data. [2025-10-02T22:43:23.829082] [INFO ] [MAIN ] Derivative Progress: 1371/1975 symbols completed. PMT took 1.3s. Estimated remaining: 4m 13s. Rate: 143.2 symbols/min [2025-10-02T22:43:23.854509] [INFO ] [MAIN ] PNW: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:23.996737] [DEBUG] [LOCAL ] PNNT: Loaded 33121 existing records from primary storage. [2025-10-02T22:43:24.109925] [INFO ] [MAIN ] PNNT: Loaded 33121 primary data records. [2025-10-02T22:43:24.469277] [DEBUG] [LOCAL ] PNW: Loaded 46137 existing records from primary storage. [2025-10-02T22:43:24.479283] [INFO ] [MAIN ] PNW: Loaded 46137 primary data records. [2025-10-02T22:43:24.629745] [DEBUG] [MAIN ] PNI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:24.675270] [INFO ] [MAIN ] PNI: Generated 1807 derivative records from 6820 primary records. [2025-10-02T22:43:24.714497] [DEBUG] [LOCAL ] PNI: Saving derivative data. [2025-10-02T22:43:24.873772] [DEBUG] [LOCAL ] PNI: Derivative data saved (1807 records). [2025-10-02T22:43:24.887057] [INFO ] [MAIN ] PNI: Successfully saved derivative data. [2025-10-02T22:43:24.890744] [INFO ] [MAIN ] Derivative Progress: 1372/1975 symbols completed. PNI took 1.2s. Estimated remaining: 4m 13s. Rate: 143.0 symbols/min [2025-10-02T22:43:24.891469] [INFO ] [MAIN ] POR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:24.891198] [DEBUG] [MAIN ] PNNT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:24.892843] [INFO ] [MAIN ] PNNT: Generated 1807 derivative records from 33121 primary records. [2025-10-02T22:43:24.893486] [DEBUG] [LOCAL ] PNNT: Saving derivative data. [2025-10-02T22:43:24.912961] [DEBUG] [LOCAL ] PNNT: Derivative data saved (1807 records). [2025-10-02T22:43:24.913372] [INFO ] [MAIN ] PNNT: Successfully saved derivative data. [2025-10-02T22:43:24.915741] [INFO ] [MAIN ] Derivative Progress: 1373/1975 symbols completed. PNNT took 1.2s. Estimated remaining: 4m 12s. Rate: 143.1 symbols/min [2025-10-02T22:43:24.916009] [INFO ] [MAIN ] POST: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:24.933437] [DEBUG] [MAIN ] PNW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:24.934232] [INFO ] [MAIN ] PNW: Generated 1807 derivative records from 46137 primary records. [2025-10-02T22:43:24.934430] [DEBUG] [LOCAL ] PNW: Saving derivative data. [2025-10-02T22:43:24.952016] [DEBUG] [LOCAL ] PNW: Derivative data saved (1807 records). [2025-10-02T22:43:24.952183] [INFO ] [MAIN ] PNW: Successfully saved derivative data. [2025-10-02T22:43:24.954608] [INFO ] [MAIN ] Derivative Progress: 1374/1975 symbols completed. PNW took 1.1s. Estimated remaining: 4m 12s. Rate: 143.2 symbols/min [2025-10-02T22:43:24.954958] [INFO ] [MAIN ] PPG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:25.009210] [DEBUG] [LOCAL ] POR: Loaded 47361 existing records from primary storage. [2025-10-02T22:43:25.010316] [INFO ] [MAIN ] POR: Loaded 47361 primary data records. [2025-10-02T22:43:25.010147] [DEBUG] [LOCAL ] POST: Loaded 39020 existing records from primary storage. [2025-10-02T22:43:25.023379] [INFO ] [MAIN ] POST: Loaded 39020 primary data records. [2025-10-02T22:43:25.543667] [DEBUG] [LOCAL ] PPG: Loaded 51055 existing records from primary storage. [2025-10-02T22:43:25.572779] [INFO ] [MAIN ] PPG: Loaded 51055 primary data records. [2025-10-02T22:43:26.120393] [DEBUG] [MAIN ] POR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:26.121693] [INFO ] [MAIN ] POR: Generated 1807 derivative records from 47361 primary records. [2025-10-02T22:43:26.121806] [DEBUG] [LOCAL ] POR: Saving derivative data. [2025-10-02T22:43:26.157348] [DEBUG] [MAIN ] POST: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:26.160092] [INFO ] [MAIN ] POST: Generated 1807 derivative records from 39020 primary records. [2025-10-02T22:43:26.162883] [DEBUG] [LOCAL ] POST: Saving derivative data. [2025-10-02T22:43:26.164244] [DEBUG] [LOCAL ] POR: Derivative data saved (1807 records). [2025-10-02T22:43:26.165189] [INFO ] [MAIN ] POR: Successfully saved derivative data. [2025-10-02T22:43:26.167712] [INFO ] [MAIN ] Derivative Progress: 1375/1975 symbols completed. POR took 1.3s. Estimated remaining: 4m 12s. Rate: 143.0 symbols/min [2025-10-02T22:43:26.188504] [INFO ] [MAIN ] PPT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:26.188914] [DEBUG] [MAIN ] PPG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:26.194867] [INFO ] [MAIN ] PPG: Generated 1807 derivative records from 51055 primary records. [2025-10-02T22:43:26.195445] [DEBUG] [LOCAL ] PPG: Saving derivative data. [2025-10-02T22:43:26.215231] [DEBUG] [LOCAL ] POST: Derivative data saved (1807 records). [2025-10-02T22:43:26.216159] [INFO ] [MAIN ] POST: Successfully saved derivative data. [2025-10-02T22:43:26.218750] [INFO ] [MAIN ] Derivative Progress: 1376/1975 symbols completed. POST took 1.3s. Estimated remaining: 4m 11s. Rate: 143.1 symbols/min [2025-10-02T22:43:26.223677] [INFO ] [MAIN ] PR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:26.225947] [DEBUG] [LOCAL ] PPG: Derivative data saved (1807 records). [2025-10-02T22:43:26.226103] [INFO ] [MAIN ] PPG: Successfully saved derivative data. [2025-10-02T22:43:26.230523] [INFO ] [MAIN ] Derivative Progress: 1377/1975 symbols completed. PPG took 1.3s. Estimated remaining: 4m 11s. Rate: 143.2 symbols/min [2025-10-02T22:43:26.230886] [INFO ] [MAIN ] PRA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:26.239083] [DEBUG] [LOCAL ] PPT: Loaded 20167 existing records from primary storage. [2025-10-02T22:43:26.239380] [INFO ] [MAIN ] PPT: Loaded 20167 primary data records. [2025-10-02T22:43:26.586318] [DEBUG] [LOCAL ] PRA: Loaded 35308 existing records from primary storage. [2025-10-02T22:43:26.595985] [INFO ] [MAIN ] PRA: Loaded 35308 primary data records. [2025-10-02T22:43:26.701508] [DEBUG] [LOCAL ] PR: Loaded 54000 existing records from primary storage. [2025-10-02T22:43:26.715260] [INFO ] [MAIN ] PR: Loaded 54000 primary data records. [2025-10-02T22:43:27.321838] [DEBUG] [MAIN ] PPT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:27.322982] [INFO ] [MAIN ] PPT: Generated 1807 derivative records from 20167 primary records. [2025-10-02T22:43:27.323188] [DEBUG] [LOCAL ] PPT: Saving derivative data. [2025-10-02T22:43:27.346747] [DEBUG] [LOCAL ] PPT: Derivative data saved (1807 records). [2025-10-02T22:43:27.346995] [INFO ] [MAIN ] PPT: Successfully saved derivative data. [2025-10-02T22:43:27.349587] [INFO ] [MAIN ] Derivative Progress: 1378/1975 symbols completed. PPT took 1.2s. Estimated remaining: 4m 10s. Rate: 143.0 symbols/min [2025-10-02T22:43:27.365259] [DEBUG] [MAIN ] PRA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:27.366022] [INFO ] [MAIN ] PRA: Generated 1807 derivative records from 35308 primary records. [2025-10-02T22:43:27.366229] [DEBUG] [LOCAL ] PRA: Saving derivative data. [2025-10-02T22:43:27.397628] [DEBUG] [MAIN ] PR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:27.398879] [INFO ] [MAIN ] PR: Generated 1807 derivative records from 54000 primary records. [2025-10-02T22:43:27.399541] [DEBUG] [LOCAL ] PRA: Derivative data saved (1807 records). [2025-10-02T22:43:27.399700] [INFO ] [MAIN ] PRA: Successfully saved derivative data. [2025-10-02T22:43:27.401984] [INFO ] [MAIN ] Derivative Progress: 1379/1975 symbols completed. PRA took 1.2s. Estimated remaining: 4m 10s. Rate: 143.1 symbols/min [2025-10-02T22:43:27.399805] [DEBUG] [LOCAL ] PR: Saving derivative data. [2025-10-02T22:43:27.419164] [DEBUG] [LOCAL ] PR: Derivative data saved (1807 records). [2025-10-02T22:43:27.419243] [INFO ] [MAIN ] PR: Successfully saved derivative data. [2025-10-02T22:43:27.421477] [INFO ] [MAIN ] Derivative Progress: 1380/1975 symbols completed. PR took 1.2s. Estimated remaining: 4m 9s. Rate: 143.2 symbols/min [2025-10-02T22:43:27.422029] [INFO ] [MAIN ] PRCS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:27.422142] [INFO ] [MAIN ] PRH: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:27.422584] [INFO ] [MAIN ] PRG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:27.428610] [DEBUG] [LOCAL ] PRCS: Loaded 2760 existing records from primary storage. [2025-10-02T22:43:27.430108] [INFO ] [MAIN ] PRCS: Loaded 2760 primary data records. [2025-10-02T22:43:27.485392] [DEBUG] [LOCAL ] PRH: Loaded 4816 existing records from primary storage. [2025-10-02T22:43:27.515771] [INFO ] [MAIN ] PRH: Loaded 4816 primary data records. [2025-10-02T22:43:27.922364] [DEBUG] [LOCAL ] PRG: Loaded 30059 existing records from primary storage. [2025-10-02T22:43:27.961289] [INFO ] [MAIN ] PRG: Loaded 30059 primary data records. [2025-10-02T22:43:28.508082] [DEBUG] [MAIN ] PRCS: Filtered 6966 bins outside market hours, 7761 incomplete bins [2025-10-02T22:43:28.509921] [INFO ] [MAIN ] PRCS: Generated 1805 derivative records from 2760 primary records. [2025-10-02T22:43:28.510344] [DEBUG] [LOCAL ] PRCS: Saving derivative data. [2025-10-02T22:43:28.543682] [DEBUG] [MAIN ] PRH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:28.545081] [INFO ] [MAIN ] PRH: Generated 1807 derivative records from 4816 primary records. [2025-10-02T22:43:28.545189] [DEBUG] [LOCAL ] PRH: Saving derivative data. [2025-10-02T22:43:28.563089] [DEBUG] [LOCAL ] PRCS: Derivative data saved (1805 records). [2025-10-02T22:43:28.568156] [DEBUG] [LOCAL ] PRH: Derivative data saved (1807 records). [2025-10-02T22:43:28.567397] [INFO ] [MAIN ] PRCS: Successfully saved derivative data. [2025-10-02T22:43:28.580571] [INFO ] [MAIN ] PRH: Successfully saved derivative data. [2025-10-02T22:43:28.590178] [INFO ] [MAIN ] Derivative Progress: 1381/1975 symbols completed. PRCS took 1.2s. Estimated remaining: 4m 9s. Rate: 143.1 symbols/min [2025-10-02T22:43:28.594126] [DEBUG] [MAIN ] PRG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:28.593620] [INFO ] [MAIN ] Derivative Progress: 1382/1975 symbols completed. PRH took 1.2s. Estimated remaining: 4m 9s. Rate: 143.2 symbols/min [2025-10-02T22:43:28.595225] [INFO ] [MAIN ] PRG: Generated 1807 derivative records from 30059 primary records. [2025-10-02T22:43:28.595552] [INFO ] [MAIN ] PRIM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:28.593466] [INFO ] [MAIN ] PRI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:28.595848] [DEBUG] [LOCAL ] PRG: Saving derivative data. [2025-10-02T22:43:28.628851] [DEBUG] [LOCAL ] PRG: Derivative data saved (1807 records). [2025-10-02T22:43:28.629158] [INFO ] [MAIN ] PRG: Successfully saved derivative data. [2025-10-02T22:43:28.631960] [INFO ] [MAIN ] Derivative Progress: 1383/1975 symbols completed. PRG took 1.2s. Estimated remaining: 4m 8s. Rate: 143.2 symbols/min [2025-10-02T22:43:28.632223] [INFO ] [MAIN ] PRKS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:28.640901] [DEBUG] [LOCAL ] PRI: Loaded 18394 existing records from primary storage. [2025-10-02T22:43:28.641033] [INFO ] [MAIN ] PRI: Loaded 18394 primary data records. [2025-10-02T22:43:29.008835] [DEBUG] [LOCAL ] PRIM: Loaded 44670 existing records from primary storage. [2025-10-02T22:43:29.009778] [INFO ] [MAIN ] PRIM: Loaded 44670 primary data records. [2025-10-02T22:43:29.144846] [DEBUG] [LOCAL ] PRKS: Loaded 42824 existing records from primary storage. [2025-10-02T22:43:29.150054] [INFO ] [MAIN ] PRKS: Loaded 42824 primary data records. [2025-10-02T22:43:29.764920] [DEBUG] [MAIN ] PRI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:29.766459] [INFO ] [MAIN ] PRI: Generated 1807 derivative records from 18394 primary records. [2025-10-02T22:43:29.766831] [DEBUG] [LOCAL ] PRI: Saving derivative data. [2025-10-02T22:43:29.802836] [DEBUG] [LOCAL ] PRI: Derivative data saved (1807 records). [2025-10-02T22:43:29.803120] [INFO ] [MAIN ] PRI: Successfully saved derivative data. [2025-10-02T22:43:29.806580] [INFO ] [MAIN ] Derivative Progress: 1384/1975 symbols completed. PRI took 1.2s. Estimated remaining: 4m 8s. Rate: 143.1 symbols/min [2025-10-02T22:43:29.819696] [INFO ] [MAIN ] PRLB: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:29.820208] [DEBUG] [MAIN ] PRIM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:29.822400] [INFO ] [MAIN ] PRIM: Generated 1807 derivative records from 44670 primary records. [2025-10-02T22:43:29.822637] [DEBUG] [LOCAL ] PRIM: Saving derivative data. [2025-10-02T22:43:29.844806] [DEBUG] [LOCAL ] PRIM: Derivative data saved (1807 records). [2025-10-02T22:43:29.845057] [INFO ] [MAIN ] PRIM: Successfully saved derivative data. [2025-10-02T22:43:29.847264] [INFO ] [MAIN ] Derivative Progress: 1385/1975 symbols completed. PRIM took 1.3s. Estimated remaining: 4m 7s. Rate: 143.2 symbols/min [2025-10-02T22:43:29.847590] [INFO ] [MAIN ] PRM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:29.862890] [DEBUG] [MAIN ] PRKS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:29.863934] [INFO ] [MAIN ] PRKS: Generated 1807 derivative records from 42824 primary records. [2025-10-02T22:43:29.864258] [DEBUG] [LOCAL ] PRKS: Saving derivative data. [2025-10-02T22:43:29.901022] [DEBUG] [LOCAL ] PRLB: Loaded 20555 existing records from primary storage. [2025-10-02T22:43:29.902294] [INFO ] [MAIN ] PRLB: Loaded 20555 primary data records. [2025-10-02T22:43:29.926951] [DEBUG] [LOCAL ] PRKS: Derivative data saved (1807 records). [2025-10-02T22:43:29.970070] [INFO ] [MAIN ] PRKS: Successfully saved derivative data. [2025-10-02T22:43:30.002807] [INFO ] [MAIN ] Derivative Progress: 1386/1975 symbols completed. PRKS took 1.4s. Estimated remaining: 4m 7s. Rate: 143.2 symbols/min [2025-10-02T22:43:30.021745] [INFO ] [MAIN ] PRMB: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:30.192584] [DEBUG] [LOCAL ] PRM: Loaded 45005 existing records from primary storage. [2025-10-02T22:43:30.300352] [INFO ] [MAIN ] PRM: Loaded 45005 primary data records. [2025-10-02T22:43:30.679529] [DEBUG] [LOCAL ] PRMB: Loaded 53528 existing records from primary storage. [2025-10-02T22:43:30.681003] [INFO ] [MAIN ] PRMB: Loaded 53528 primary data records. [2025-10-02T22:43:30.818915] [DEBUG] [MAIN ] PRLB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:30.820100] [INFO ] [MAIN ] PRLB: Generated 1807 derivative records from 20555 primary records. [2025-10-02T22:43:30.820721] [DEBUG] [LOCAL ] PRLB: Saving derivative data. [2025-10-02T22:43:31.058326] [DEBUG] [LOCAL ] PRLB: Derivative data saved (1807 records). [2025-10-02T22:43:31.062088] [INFO ] [MAIN ] PRLB: Successfully saved derivative data. [2025-10-02T22:43:31.064548] [INFO ] [MAIN ] Derivative Progress: 1387/1975 symbols completed. PRLB took 1.2s. Estimated remaining: 4m 7s. Rate: 143.1 symbols/min [2025-10-02T22:43:31.064782] [INFO ] [MAIN ] PRO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:31.080561] [DEBUG] [MAIN ] PRM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:31.081791] [INFO ] [MAIN ] PRM: Generated 1807 derivative records from 45005 primary records. [2025-10-02T22:43:31.082023] [DEBUG] [LOCAL ] PRM: Saving derivative data. [2025-10-02T22:43:31.101840] [DEBUG] [LOCAL ] PRM: Derivative data saved (1807 records). [2025-10-02T22:43:31.102347] [INFO ] [MAIN ] PRM: Successfully saved derivative data. [2025-10-02T22:43:31.104803] [INFO ] [MAIN ] Derivative Progress: 1388/1975 symbols completed. PRM took 1.3s. Estimated remaining: 4m 6s. Rate: 143.2 symbols/min [2025-10-02T22:43:31.104987] [INFO ] [MAIN ] PRU: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:31.132093] [DEBUG] [MAIN ] PRMB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:31.132879] [INFO ] [MAIN ] PRMB: Generated 1807 derivative records from 53528 primary records. [2025-10-02T22:43:31.132976] [DEBUG] [LOCAL ] PRMB: Saving derivative data. [2025-10-02T22:43:31.163471] [DEBUG] [LOCAL ] PRMB: Derivative data saved (1807 records). [2025-10-02T22:43:31.164537] [DEBUG] [LOCAL ] PRO: Loaded 38650 existing records from primary storage. [2025-10-02T22:43:31.164617] [INFO ] [MAIN ] PRMB: Successfully saved derivative data. [2025-10-02T22:43:31.167149] [INFO ] [MAIN ] Derivative Progress: 1389/1975 symbols completed. PRMB took 1.1s. Estimated remaining: 4m 5s. Rate: 143.2 symbols/min [2025-10-02T22:43:31.167487] [INFO ] [MAIN ] PSA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:31.164840] [INFO ] [MAIN ] PRO: Loaded 38650 primary data records. [2025-10-02T22:43:31.532808] [DEBUG] [LOCAL ] PRU: Loaded 51747 existing records from primary storage. [2025-10-02T22:43:31.533620] [INFO ] [MAIN ] PRU: Loaded 51747 primary data records. [2025-10-02T22:43:31.607414] [DEBUG] [LOCAL ] PSA: Loaded 42042 existing records from primary storage. [2025-10-02T22:43:31.642429] [INFO ] [MAIN ] PSA: Loaded 42042 primary data records. [2025-10-02T22:43:32.305437] [DEBUG] [MAIN ] PRO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:32.306725] [INFO ] [MAIN ] PRO: Generated 1807 derivative records from 38650 primary records. [2025-10-02T22:43:32.306923] [DEBUG] [LOCAL ] PRO: Saving derivative data. [2025-10-02T22:43:32.329234] [DEBUG] [LOCAL ] PRO: Derivative data saved (1807 records). [2025-10-02T22:43:32.330517] [INFO ] [MAIN ] PRO: Successfully saved derivative data. [2025-10-02T22:43:32.333023] [INFO ] [MAIN ] Derivative Progress: 1390/1975 symbols completed. PRO took 1.3s. Estimated remaining: 4m 5s. Rate: 143.1 symbols/min [2025-10-02T22:43:32.335448] [INFO ] [MAIN ] PSBD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:32.350353] [DEBUG] [MAIN ] PRU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:32.351185] [INFO ] [MAIN ] PRU: Generated 1807 derivative records from 51747 primary records. [2025-10-02T22:43:32.351438] [DEBUG] [LOCAL ] PRU: Saving derivative data. [2025-10-02T22:43:32.374102] [DEBUG] [LOCAL ] PSBD: Loaded 7150 existing records from primary storage. [2025-10-02T22:43:32.386414] [INFO ] [MAIN ] PSBD: Loaded 7150 primary data records. [2025-10-02T22:43:32.418990] [DEBUG] [MAIN ] PSA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:32.433273] [INFO ] [MAIN ] PSA: Generated 1807 derivative records from 42042 primary records. [2025-10-02T22:43:32.446670] [DEBUG] [LOCAL ] PSA: Saving derivative data. [2025-10-02T22:43:32.522420] [DEBUG] [LOCAL ] PRU: Derivative data saved (1807 records). [2025-10-02T22:43:32.528845] [INFO ] [MAIN ] PRU: Successfully saved derivative data. [2025-10-02T22:43:32.546980] [INFO ] [MAIN ] Derivative Progress: 1391/1975 symbols completed. PRU took 1.4s. Estimated remaining: 4m 5s. Rate: 143.1 symbols/min [2025-10-02T22:43:32.553452] [INFO ] [MAIN ] PSF: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:32.733760] [DEBUG] [LOCAL ] PSA: Derivative data saved (1807 records). [2025-10-02T22:43:32.734910] [INFO ] [MAIN ] PSA: Successfully saved derivative data. [2025-10-02T22:43:32.738058] [INFO ] [MAIN ] Derivative Progress: 1392/1975 symbols completed. PSA took 1.6s. Estimated remaining: 4m 4s. Rate: 143.2 symbols/min [2025-10-02T22:43:32.740688] [INFO ] [MAIN ] PSFE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:32.748192] [DEBUG] [LOCAL ] PSF: Loaded 7014 existing records from primary storage. [2025-10-02T22:43:32.748911] [INFO ] [MAIN ] PSF: Loaded 7014 primary data records. [2025-10-02T22:43:32.996137] [DEBUG] [LOCAL ] PSFE: Loaded 30221 existing records from primary storage. [2025-10-02T22:43:33.126456] [INFO ] [MAIN ] PSFE: Loaded 30221 primary data records. [2025-10-02T22:43:33.261520] [DEBUG] [MAIN ] PSBD: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-02T22:43:33.314469] [INFO ] [MAIN ] PSBD: Generated 1806 derivative records from 7150 primary records. [2025-10-02T22:43:33.343077] [DEBUG] [LOCAL ] PSBD: Saving derivative data. [2025-10-02T22:43:33.496564] [DEBUG] [LOCAL ] PSBD: Derivative data saved (1806 records). [2025-10-02T22:43:33.498002] [INFO ] [MAIN ] PSBD: Successfully saved derivative data. [2025-10-02T22:43:33.501692] [INFO ] [MAIN ] Derivative Progress: 1393/1975 symbols completed. PSBD took 1.2s. Estimated remaining: 4m 4s. Rate: 143.1 symbols/min [2025-10-02T22:43:33.518116] [DEBUG] [MAIN ] PSF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:33.519100] [INFO ] [MAIN ] PSF: Generated 1807 derivative records from 7014 primary records. [2025-10-02T22:43:33.519309] [DEBUG] [LOCAL ] PSF: Saving derivative data. [2025-10-02T22:43:33.540245] [DEBUG] [LOCAL ] PSF: Derivative data saved (1807 records). [2025-10-02T22:43:33.540470] [INFO ] [MAIN ] PSF: Successfully saved derivative data. [2025-10-02T22:43:33.542935] [INFO ] [MAIN ] Derivative Progress: 1394/1975 symbols completed. PSF took 1.0s. Estimated remaining: 4m 3s. Rate: 143.2 symbols/min [2025-10-02T22:43:33.556272] [DEBUG] [MAIN ] PSFE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:33.557074] [INFO ] [MAIN ] PSFE: Generated 1807 derivative records from 30221 primary records. [2025-10-02T22:43:33.557139] [DEBUG] [LOCAL ] PSFE: Saving derivative data. [2025-10-02T22:43:33.574552] [DEBUG] [LOCAL ] PSFE: Derivative data saved (1807 records). [2025-10-02T22:43:33.574670] [INFO ] [MAIN ] PSFE: Successfully saved derivative data. [2025-10-02T22:43:33.577304] [INFO ] [MAIN ] Derivative Progress: 1395/1975 symbols completed. PSFE took 0.8s. Estimated remaining: 4m 3s. Rate: 143.3 symbols/min [2025-10-02T22:43:33.577829] [INFO ] [MAIN ] PSN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:33.578011] [INFO ] [MAIN ] PSTG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:33.578202] [INFO ] [MAIN ] PSQH: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:33.639682] [DEBUG] [LOCAL ] PSQH: Loaded 35064 existing records from primary storage. [2025-10-02T22:43:33.639869] [INFO ] [MAIN ] PSQH: Loaded 35064 primary data records. [2025-10-02T22:43:33.741904] [DEBUG] [LOCAL ] PSN: Loaded 46339 existing records from primary storage. [2025-10-02T22:43:33.783360] [INFO ] [MAIN ] PSN: Loaded 46339 primary data records. [2025-10-02T22:43:33.805297] [DEBUG] [LOCAL ] PSTG: Loaded 53227 existing records from primary storage. [2025-10-02T22:43:33.805984] [INFO ] [MAIN ] PSTG: Loaded 53227 primary data records. [2025-10-02T22:43:34.769311] [DEBUG] [MAIN ] PSQH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:34.770233] [INFO ] [MAIN ] PSQH: Generated 1807 derivative records from 35064 primary records. [2025-10-02T22:43:34.770515] [DEBUG] [LOCAL ] PSQH: Saving derivative data. [2025-10-02T22:43:34.793500] [DEBUG] [MAIN ] PSN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:34.799032] [INFO ] [MAIN ] PSN: Generated 1807 derivative records from 46339 primary records. [2025-10-02T22:43:34.801952] [DEBUG] [LOCAL ] PSN: Saving derivative data. [2025-10-02T22:43:34.831466] [DEBUG] [MAIN ] PSTG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:34.832716] [INFO ] [MAIN ] PSTG: Generated 1807 derivative records from 53227 primary records. [2025-10-02T22:43:34.833271] [DEBUG] [LOCAL ] PSTG: Saving derivative data. [2025-10-02T22:43:34.835764] [DEBUG] [LOCAL ] PSQH: Derivative data saved (1807 records). [2025-10-02T22:43:34.836529] [INFO ] [MAIN ] PSQH: Successfully saved derivative data. [2025-10-02T22:43:34.839160] [INFO ] [MAIN ] Derivative Progress: 1396/1975 symbols completed. PSQH took 1.3s. Estimated remaining: 4m 3s. Rate: 143.1 symbols/min [2025-10-02T22:43:34.849229] [INFO ] [MAIN ] PSTL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:34.862921] [DEBUG] [LOCAL ] PSN: Derivative data saved (1807 records). [2025-10-02T22:43:34.865119] [DEBUG] [LOCAL ] PSTG: Derivative data saved (1807 records). [2025-10-02T22:43:34.865230] [INFO ] [MAIN ] PSTG: Successfully saved derivative data. [2025-10-02T22:43:34.865030] [INFO ] [MAIN ] PSN: Successfully saved derivative data. [2025-10-02T22:43:34.867987] [INFO ] [MAIN ] Derivative Progress: 1397/1975 symbols completed. PSN took 1.3s. Estimated remaining: 4m 2s. Rate: 143.2 symbols/min [2025-10-02T22:43:34.868238] [INFO ] [MAIN ] PSX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:34.871404] [INFO ] [MAIN ] Derivative Progress: 1398/1975 symbols completed. PSTG took 1.3s. Estimated remaining: 4m 2s. Rate: 143.3 symbols/min [2025-10-02T22:43:34.871961] [INFO ] [MAIN ] PTA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:34.899127] [DEBUG] [LOCAL ] PSTL: Loaded 20199 existing records from primary storage. [2025-10-02T22:43:34.899538] [INFO ] [MAIN ] PSTL: Loaded 20199 primary data records. [2025-10-02T22:43:34.957002] [DEBUG] [LOCAL ] PTA: Loaded 15033 existing records from primary storage. [2025-10-02T22:43:34.978527] [INFO ] [MAIN ] PTA: Loaded 15033 primary data records. [2025-10-02T22:43:35.433151] [DEBUG] [LOCAL ] PSX: Loaded 53496 existing records from primary storage. [2025-10-02T22:43:35.444773] [INFO ] [MAIN ] PSX: Loaded 53496 primary data records. [2025-10-02T22:43:36.039926] [DEBUG] [MAIN ] PSTL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:36.042636] [INFO ] [MAIN ] PSTL: Generated 1807 derivative records from 20199 primary records. [2025-10-02T22:43:36.043271] [DEBUG] [LOCAL ] PSTL: Saving derivative data. [2025-10-02T22:43:36.075388] [DEBUG] [MAIN ] PTA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:36.080926] [DEBUG] [LOCAL ] PSTL: Derivative data saved (1807 records). [2025-10-02T22:43:36.079636] [INFO ] [MAIN ] PTA: Generated 1807 derivative records from 15033 primary records. [2025-10-02T22:43:36.081268] [INFO ] [MAIN ] PSTL: Successfully saved derivative data. [2025-10-02T22:43:36.081417] [DEBUG] [LOCAL ] PTA: Saving derivative data. [2025-10-02T22:43:36.083732] [INFO ] [MAIN ] Derivative Progress: 1399/1975 symbols completed. PSTL took 1.2s. Estimated remaining: 4m 2s. Rate: 143.1 symbols/min [2025-10-02T22:43:36.085118] [INFO ] [MAIN ] PTY: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:36.107989] [DEBUG] [LOCAL ] PTA: Derivative data saved (1807 records). [2025-10-02T22:43:36.109287] [INFO ] [MAIN ] PTA: Successfully saved derivative data. [2025-10-02T22:43:36.112119] [INFO ] [MAIN ] Derivative Progress: 1400/1975 symbols completed. PTA took 1.2s. Estimated remaining: 4m 1s. Rate: 143.2 symbols/min [2025-10-02T22:43:36.112402] [INFO ] [MAIN ] PUK: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:36.126966] [DEBUG] [MAIN ] PSX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:36.128889] [INFO ] [MAIN ] PSX: Generated 1807 derivative records from 53496 primary records. [2025-10-02T22:43:36.129036] [DEBUG] [LOCAL ] PSX: Saving derivative data. [2025-10-02T22:43:36.151223] [DEBUG] [LOCAL ] PSX: Derivative data saved (1807 records). [2025-10-02T22:43:36.160972] [INFO ] [MAIN ] PSX: Successfully saved derivative data. [2025-10-02T22:43:36.163787] [INFO ] [MAIN ] Derivative Progress: 1401/1975 symbols completed. PSX took 1.3s. Estimated remaining: 4m 0s. Rate: 143.3 symbols/min [2025-10-02T22:43:36.164049] [INFO ] [MAIN ] PUMP: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:36.184048] [DEBUG] [LOCAL ] PTY: Loaded 37543 existing records from primary storage. [2025-10-02T22:43:36.184386] [INFO ] [MAIN ] PTY: Loaded 37543 primary data records. [2025-10-02T22:43:36.378116] [DEBUG] [LOCAL ] PUK: Loaded 45020 existing records from primary storage. [2025-10-02T22:43:36.442928] [INFO ] [MAIN ] PUK: Loaded 45020 primary data records. [2025-10-02T22:43:36.706943] [DEBUG] [LOCAL ] PUMP: Loaded 49753 existing records from primary storage. [2025-10-02T22:43:36.711474] [INFO ] [MAIN ] PUMP: Loaded 49753 primary data records. [2025-10-02T22:43:37.318414] [DEBUG] [MAIN ] PTY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:37.319926] [INFO ] [MAIN ] PTY: Generated 1807 derivative records from 37543 primary records. [2025-10-02T22:43:37.320608] [DEBUG] [LOCAL ] PTY: Saving derivative data. [2025-10-02T22:43:37.344930] [DEBUG] [LOCAL ] PTY: Derivative data saved (1807 records). [2025-10-02T22:43:37.347468] [INFO ] [MAIN ] PTY: Successfully saved derivative data. [2025-10-02T22:43:37.349970] [INFO ] [MAIN ] Derivative Progress: 1402/1975 symbols completed. PTY took 1.3s. Estimated remaining: 4m 0s. Rate: 143.1 symbols/min [2025-10-02T22:43:37.351037] [INFO ] [MAIN ] PVH: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:37.367706] [DEBUG] [MAIN ] PUK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:37.368730] [INFO ] [MAIN ] PUK: Generated 1807 derivative records from 45020 primary records. [2025-10-02T22:43:37.369031] [DEBUG] [LOCAL ] PUK: Saving derivative data. [2025-10-02T22:43:37.389842] [DEBUG] [LOCAL ] PUK: Derivative data saved (1807 records). [2025-10-02T22:43:37.390217] [INFO ] [MAIN ] PUK: Successfully saved derivative data. [2025-10-02T22:43:37.392324] [INFO ] [MAIN ] Derivative Progress: 1403/1975 symbols completed. PUK took 1.3s. Estimated remaining: 3m 60s. Rate: 143.2 symbols/min [2025-10-02T22:43:37.392519] [INFO ] [MAIN ] PVL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:37.409212] [DEBUG] [MAIN ] PUMP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:37.410175] [INFO ] [MAIN ] PUMP: Generated 1807 derivative records from 49753 primary records. [2025-10-02T22:43:37.411726] [DEBUG] [LOCAL ] PUMP: Saving derivative data. [2025-10-02T22:43:37.427900] [DEBUG] [LOCAL ] PVL: Loaded 4773 existing records from primary storage. [2025-10-02T22:43:37.432666] [DEBUG] [LOCAL ] PUMP: Derivative data saved (1807 records). [2025-10-02T22:43:37.432832] [INFO ] [MAIN ] PUMP: Successfully saved derivative data. [2025-10-02T22:43:37.430539] [INFO ] [MAIN ] PVL: Loaded 4773 primary data records. [2025-10-02T22:43:37.435753] [INFO ] [MAIN ] Derivative Progress: 1404/1975 symbols completed. PUMP took 1.3s. Estimated remaining: 3m 59s. Rate: 143.2 symbols/min [2025-10-02T22:43:37.458984] [INFO ] [MAIN ] PWR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:37.660602] [DEBUG] [LOCAL ] PVH: Loaded 50697 existing records from primary storage. [2025-10-02T22:43:37.670899] [INFO ] [MAIN ] PVH: Loaded 50697 primary data records. [2025-10-02T22:43:38.184135] [DEBUG] [LOCAL ] PWR: Loaded 47367 existing records from primary storage. [2025-10-02T22:43:38.185336] [INFO ] [MAIN ] PWR: Loaded 47367 primary data records. [2025-10-02T22:43:38.404875] [DEBUG] [MAIN ] PVL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:38.412938] [INFO ] [MAIN ] PVL: Generated 1807 derivative records from 4773 primary records. [2025-10-02T22:43:38.538307] [DEBUG] [LOCAL ] PVL: Saving derivative data. [2025-10-02T22:43:38.578634] [DEBUG] [LOCAL ] PVL: Derivative data saved (1807 records). [2025-10-02T22:43:38.579262] [INFO ] [MAIN ] PVL: Successfully saved derivative data. [2025-10-02T22:43:38.580307] [DEBUG] [MAIN ] PVH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:38.583522] [INFO ] [MAIN ] PVH: Generated 1807 derivative records from 50697 primary records. [2025-10-02T22:43:38.583714] [DEBUG] [LOCAL ] PVH: Saving derivative data. [2025-10-02T22:43:38.582493] [INFO ] [MAIN ] Derivative Progress: 1405/1975 symbols completed. PVL took 1.2s. Estimated remaining: 3m 59s. Rate: 143.1 symbols/min [2025-10-02T22:43:38.583873] [INFO ] [MAIN ] QD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:38.604815] [DEBUG] [LOCAL ] PVH: Derivative data saved (1807 records). [2025-10-02T22:43:38.605047] [INFO ] [MAIN ] PVH: Successfully saved derivative data. [2025-10-02T22:43:38.607869] [INFO ] [MAIN ] Derivative Progress: 1406/1975 symbols completed. PVH took 1.3s. Estimated remaining: 3m 58s. Rate: 143.2 symbols/min [2025-10-02T22:43:38.608441] [INFO ] [MAIN ] QGEN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:38.635583] [DEBUG] [MAIN ] PWR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:38.636441] [INFO ] [MAIN ] PWR: Generated 1807 derivative records from 47367 primary records. [2025-10-02T22:43:38.636730] [DEBUG] [LOCAL ] PWR: Saving derivative data. [2025-10-02T22:43:38.661058] [DEBUG] [LOCAL ] QD: Loaded 28148 existing records from primary storage. [2025-10-02T22:43:38.661904] [INFO ] [MAIN ] QD: Loaded 28148 primary data records. [2025-10-02T22:43:38.762494] [DEBUG] [LOCAL ] PWR: Derivative data saved (1807 records). [2025-10-02T22:43:38.794683] [INFO ] [MAIN ] PWR: Successfully saved derivative data. [2025-10-02T22:43:38.797336] [INFO ] [MAIN ] Derivative Progress: 1407/1975 symbols completed. PWR took 1.3s. Estimated remaining: 3m 58s. Rate: 143.2 symbols/min [2025-10-02T22:43:38.797558] [INFO ] [MAIN ] QS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:39.055849] [DEBUG] [LOCAL ] QGEN: Loaded 49452 existing records from primary storage. [2025-10-02T22:43:39.056295] [INFO ] [MAIN ] QGEN: Loaded 49452 primary data records. [2025-10-02T22:43:39.438135] [DEBUG] [LOCAL ] QS: Loaded 54133 existing records from primary storage. [2025-10-02T22:43:39.438740] [INFO ] [MAIN ] QS: Loaded 54133 primary data records. [2025-10-02T22:43:39.508677] [DEBUG] [MAIN ] QD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:39.527310] [INFO ] [MAIN ] QD: Generated 1807 derivative records from 28148 primary records. [2025-10-02T22:43:39.532750] [DEBUG] [LOCAL ] QD: Saving derivative data. [2025-10-02T22:43:39.631451] [DEBUG] [LOCAL ] QD: Derivative data saved (1807 records). [2025-10-02T22:43:39.659808] [INFO ] [MAIN ] QD: Successfully saved derivative data. [2025-10-02T22:43:39.718234] [INFO ] [MAIN ] Derivative Progress: 1408/1975 symbols completed. QD took 1.1s. Estimated remaining: 3m 58s. Rate: 143.1 symbols/min [2025-10-02T22:43:39.842867] [DEBUG] [MAIN ] QGEN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:39.843763] [INFO ] [MAIN ] QGEN: Generated 1807 derivative records from 49452 primary records. [2025-10-02T22:43:39.843896] [DEBUG] [LOCAL ] QGEN: Saving derivative data. [2025-10-02T22:43:39.864513] [DEBUG] [LOCAL ] QGEN: Derivative data saved (1807 records). [2025-10-02T22:43:39.865561] [INFO ] [MAIN ] QGEN: Successfully saved derivative data. [2025-10-02T22:43:39.868675] [INFO ] [MAIN ] Derivative Progress: 1409/1975 symbols completed. QGEN took 1.3s. Estimated remaining: 3m 57s. Rate: 143.2 symbols/min [2025-10-02T22:43:39.882431] [DEBUG] [MAIN ] QS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:39.883164] [INFO ] [MAIN ] QS: Generated 1807 derivative records from 54133 primary records. [2025-10-02T22:43:39.883232] [DEBUG] [LOCAL ] QS: Saving derivative data. [2025-10-02T22:43:39.900220] [DEBUG] [LOCAL ] QS: Derivative data saved (1807 records). [2025-10-02T22:43:39.900358] [INFO ] [MAIN ] QS: Successfully saved derivative data. [2025-10-02T22:43:39.902434] [INFO ] [MAIN ] Derivative Progress: 1410/1975 symbols completed. QS took 1.1s. Estimated remaining: 3m 57s. Rate: 143.3 symbols/min [2025-10-02T22:43:39.902922] [INFO ] [MAIN ] QSR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:39.903035] [INFO ] [MAIN ] QTWO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:39.903178] [INFO ] [MAIN ] QUAD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:39.928233] [DEBUG] [LOCAL ] QUAD: Loaded 23572 existing records from primary storage. [2025-10-02T22:43:39.928486] [INFO ] [MAIN ] QUAD: Loaded 23572 primary data records. [2025-10-02T22:43:40.106737] [DEBUG] [LOCAL ] QTWO: Loaded 39408 existing records from primary storage. [2025-10-02T22:43:40.128144] [INFO ] [MAIN ] QTWO: Loaded 39408 primary data records. [2025-10-02T22:43:40.211752] [DEBUG] [LOCAL ] QSR: Loaded 52816 existing records from primary storage. [2025-10-02T22:43:40.364725] [INFO ] [MAIN ] QSR: Loaded 52816 primary data records. [2025-10-02T22:43:41.091253] [DEBUG] [MAIN ] QUAD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:41.092539] [INFO ] [MAIN ] QUAD: Generated 1807 derivative records from 23572 primary records. [2025-10-02T22:43:41.092829] [DEBUG] [LOCAL ] QUAD: Saving derivative data. [2025-10-02T22:43:41.112099] [DEBUG] [LOCAL ] QUAD: Derivative data saved (1807 records). [2025-10-02T22:43:41.114501] [INFO ] [MAIN ] QUAD: Successfully saved derivative data. [2025-10-02T22:43:41.117451] [INFO ] [MAIN ] Derivative Progress: 1411/1975 symbols completed. QUAD took 1.2s. Estimated remaining: 3m 57s. Rate: 143.1 symbols/min [2025-10-02T22:43:41.118039] [INFO ] [MAIN ] QVCC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:41.132222] [DEBUG] [MAIN ] QTWO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:41.133442] [INFO ] [MAIN ] QTWO: Generated 1807 derivative records from 39408 primary records. [2025-10-02T22:43:41.133622] [DEBUG] [LOCAL ] QTWO: Saving derivative data. [2025-10-02T22:43:41.158954] [DEBUG] [LOCAL ] QVCC: Loaded 8967 existing records from primary storage. [2025-10-02T22:43:41.160725] [DEBUG] [LOCAL ] QTWO: Derivative data saved (1807 records). [2025-10-02T22:43:41.161092] [INFO ] [MAIN ] QTWO: Successfully saved derivative data. [2025-10-02T22:43:41.169123] [INFO ] [MAIN ] QVCC: Loaded 8967 primary data records. [2025-10-02T22:43:41.176314] [INFO ] [MAIN ] Derivative Progress: 1412/1975 symbols completed. QTWO took 1.3s. Estimated remaining: 3m 56s. Rate: 143.2 symbols/min [2025-10-02T22:43:41.188227] [INFO ] [MAIN ] QVCD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:41.224051] [DEBUG] [MAIN ] QSR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:41.248445] [INFO ] [MAIN ] QSR: Generated 1807 derivative records from 52816 primary records. [2025-10-02T22:43:41.273059] [DEBUG] [LOCAL ] QSR: Saving derivative data. [2025-10-02T22:43:41.323845] [DEBUG] [LOCAL ] QVCD: Loaded 4541 existing records from primary storage. [2025-10-02T22:43:41.349541] [INFO ] [MAIN ] QVCD: Loaded 4541 primary data records. [2025-10-02T22:43:41.650804] [DEBUG] [LOCAL ] QSR: Derivative data saved (1807 records). [2025-10-02T22:43:41.652062] [INFO ] [MAIN ] QSR: Successfully saved derivative data. [2025-10-02T22:43:41.656517] [INFO ] [MAIN ] Derivative Progress: 1413/1975 symbols completed. QSR took 1.8s. Estimated remaining: 3m 56s. Rate: 143.1 symbols/min [2025-10-02T22:43:41.657556] [INFO ] [MAIN ] QXO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:41.915664] [DEBUG] [MAIN ] QVCC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:41.917363] [INFO ] [MAIN ] QVCC: Generated 1807 derivative records from 8967 primary records. [2025-10-02T22:43:41.917528] [DEBUG] [LOCAL ] QVCC: Saving derivative data. [2025-10-02T22:43:41.955044] [DEBUG] [LOCAL ] QVCC: Derivative data saved (1807 records). [2025-10-02T22:43:41.955523] [INFO ] [MAIN ] QVCC: Successfully saved derivative data. [2025-10-02T22:43:41.957618] [INFO ] [MAIN ] Derivative Progress: 1414/1975 symbols completed. QVCC took 0.8s. Estimated remaining: 3m 55s. Rate: 143.2 symbols/min [2025-10-02T22:43:41.959235] [INFO ] [MAIN ] R: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:41.980442] [DEBUG] [LOCAL ] QXO: Loaded 53656 existing records from primary storage. [2025-10-02T22:43:41.980790] [INFO ] [MAIN ] QXO: Loaded 53656 primary data records. [2025-10-02T22:43:42.148058] [DEBUG] [MAIN ] QVCD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:42.172998] [INFO ] [MAIN ] QVCD: Generated 1807 derivative records from 4541 primary records. [2025-10-02T22:43:42.229465] [DEBUG] [LOCAL ] QVCD: Saving derivative data. [2025-10-02T22:43:42.230816] [DEBUG] [LOCAL ] R: Loaded 29158 existing records from primary storage. [2025-10-02T22:43:42.344740] [INFO ] [MAIN ] R: Loaded 29158 primary data records. [2025-10-02T22:43:42.416898] [DEBUG] [LOCAL ] QVCD: Derivative data saved (1807 records). [2025-10-02T22:43:42.445528] [INFO ] [MAIN ] QVCD: Successfully saved derivative data. [2025-10-02T22:43:42.485111] [INFO ] [MAIN ] Derivative Progress: 1415/1975 symbols completed. QVCD took 1.3s. Estimated remaining: 3m 55s. Rate: 143.1 symbols/min [2025-10-02T22:43:42.490306] [INFO ] [MAIN ] RA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:42.724984] [DEBUG] [LOCAL ] RA: Loaded 21986 existing records from primary storage. [2025-10-02T22:43:42.726068] [INFO ] [MAIN ] RA: Loaded 21986 primary data records. [2025-10-02T22:43:42.783960] [DEBUG] [MAIN ] QXO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:42.831444] [INFO ] [MAIN ] QXO: Generated 1807 derivative records from 53656 primary records. [2025-10-02T22:43:42.862489] [DEBUG] [LOCAL ] QXO: Saving derivative data. [2025-10-02T22:43:43.137378] [DEBUG] [LOCAL ] QXO: Derivative data saved (1807 records). [2025-10-02T22:43:43.165053] [INFO ] [MAIN ] QXO: Successfully saved derivative data. [2025-10-02T22:43:43.170092] [INFO ] [MAIN ] Derivative Progress: 1416/1975 symbols completed. QXO took 1.5s. Estimated remaining: 3m 54s. Rate: 143.1 symbols/min [2025-10-02T22:43:43.170781] [INFO ] [MAIN ] RACE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:43.188908] [DEBUG] [MAIN ] R: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:43.190988] [INFO ] [MAIN ] R: Generated 1807 derivative records from 29158 primary records. [2025-10-02T22:43:43.191255] [DEBUG] [LOCAL ] R: Saving derivative data. [2025-10-02T22:43:43.213661] [DEBUG] [LOCAL ] R: Derivative data saved (1807 records). [2025-10-02T22:43:43.214137] [INFO ] [MAIN ] R: Successfully saved derivative data. [2025-10-02T22:43:43.217529] [INFO ] [MAIN ] Derivative Progress: 1417/1975 symbols completed. R took 1.3s. Estimated remaining: 3m 54s. Rate: 143.2 symbols/min [2025-10-02T22:43:43.218131] [INFO ] [MAIN ] RAMP: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:43.257721] [DEBUG] [LOCAL ] RACE: Loaded 32781 existing records from primary storage. [2025-10-02T22:43:43.258385] [INFO ] [MAIN ] RACE: Loaded 32781 primary data records. [2025-10-02T22:43:43.290006] [DEBUG] [MAIN ] RA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:43.326326] [INFO ] [MAIN ] RA: Generated 1807 derivative records from 21986 primary records. [2025-10-02T22:43:43.377053] [DEBUG] [LOCAL ] RA: Saving derivative data. [2025-10-02T22:43:43.433197] [DEBUG] [LOCAL ] RAMP: Loaded 37750 existing records from primary storage. [2025-10-02T22:43:43.458789] [INFO ] [MAIN ] RAMP: Loaded 37750 primary data records. [2025-10-02T22:43:43.734318] [DEBUG] [LOCAL ] RA: Derivative data saved (1807 records). [2025-10-02T22:43:43.788664] [INFO ] [MAIN ] RA: Successfully saved derivative data. [2025-10-02T22:43:43.791871] [INFO ] [MAIN ] Derivative Progress: 1418/1975 symbols completed. RA took 1.3s. Estimated remaining: 3m 53s. Rate: 143.1 symbols/min [2025-10-02T22:43:43.810441] [INFO ] [MAIN ] RBC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:44.022220] [DEBUG] [LOCAL ] RBC: Loaded 15344 existing records from primary storage. [2025-10-02T22:43:44.022529] [INFO ] [MAIN ] RBC: Loaded 15344 primary data records. [2025-10-02T22:43:44.202673] [DEBUG] [MAIN ] RACE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:44.233539] [INFO ] [MAIN ] RACE: Generated 1807 derivative records from 32781 primary records. [2025-10-02T22:43:44.271221] [DEBUG] [LOCAL ] RACE: Saving derivative data. [2025-10-02T22:43:44.445329] [DEBUG] [MAIN ] RAMP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:44.447294] [INFO ] [MAIN ] RAMP: Generated 1807 derivative records from 37750 primary records. [2025-10-02T22:43:44.447764] [DEBUG] [LOCAL ] RAMP: Saving derivative data. [2025-10-02T22:43:44.449621] [DEBUG] [LOCAL ] RACE: Derivative data saved (1807 records). [2025-10-02T22:43:44.451128] [INFO ] [MAIN ] RACE: Successfully saved derivative data. [2025-10-02T22:43:44.453942] [INFO ] [MAIN ] Derivative Progress: 1419/1975 symbols completed. RACE took 1.3s. Estimated remaining: 3m 53s. Rate: 143.1 symbols/min [2025-10-02T22:43:44.466619] [INFO ] [MAIN ] RBLX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:44.482699] [DEBUG] [LOCAL ] RAMP: Derivative data saved (1807 records). [2025-10-02T22:43:44.482910] [INFO ] [MAIN ] RAMP: Successfully saved derivative data. [2025-10-02T22:43:44.486342] [INFO ] [MAIN ] Derivative Progress: 1420/1975 symbols completed. RAMP took 1.3s. Estimated remaining: 3m 53s. Rate: 143.2 symbols/min [2025-10-02T22:43:44.487126] [INFO ] [MAIN ] RBOT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:44.500498] [DEBUG] [LOCAL ] RBOT: Loaded 5275 existing records from primary storage. [2025-10-02T22:43:44.514469] [INFO ] [MAIN ] RBOT: Loaded 5275 primary data records. [2025-10-02T22:43:44.514353] [DEBUG] [MAIN ] RBC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:44.515722] [INFO ] [MAIN ] RBC: Generated 1807 derivative records from 15344 primary records. [2025-10-02T22:43:44.550728] [DEBUG] [LOCAL ] RBC: Saving derivative data. [2025-10-02T22:43:44.934635] [DEBUG] [LOCAL ] RBLX: Loaded 54104 existing records from primary storage. [2025-10-02T22:43:44.936202] [DEBUG] [LOCAL ] RBC: Derivative data saved (1807 records). [2025-10-02T22:43:44.936339] [INFO ] [MAIN ] RBLX: Loaded 54104 primary data records. [2025-10-02T22:43:44.936596] [INFO ] [MAIN ] RBC: Successfully saved derivative data. [2025-10-02T22:43:44.938996] [INFO ] [MAIN ] Derivative Progress: 1421/1975 symbols completed. RBC took 1.1s. Estimated remaining: 3m 52s. Rate: 143.2 symbols/min [2025-10-02T22:43:44.939350] [INFO ] [MAIN ] RBRK: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:45.335402] [DEBUG] [LOCAL ] RBRK: Loaded 53518 existing records from primary storage. [2025-10-02T22:43:45.336188] [INFO ] [MAIN ] RBRK: Loaded 53518 primary data records. [2025-10-02T22:43:45.364331] [DEBUG] [MAIN ] RBOT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:45.376026] [INFO ] [MAIN ] RBOT: Generated 1807 derivative records from 5275 primary records. [2025-10-02T22:43:45.418704] [DEBUG] [LOCAL ] RBOT: Saving derivative data. [2025-10-02T22:43:45.522798] [DEBUG] [LOCAL ] RBOT: Derivative data saved (1807 records). [2025-10-02T22:43:45.535119] [INFO ] [MAIN ] RBOT: Successfully saved derivative data. [2025-10-02T22:43:45.546635] [INFO ] [MAIN ] Derivative Progress: 1422/1975 symbols completed. RBOT took 1.1s. Estimated remaining: 3m 52s. Rate: 143.1 symbols/min [2025-10-02T22:43:45.557011] [INFO ] [MAIN ] RC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:45.778503] [DEBUG] [MAIN ] RBLX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:45.780171] [INFO ] [MAIN ] RBLX: Generated 1807 derivative records from 54104 primary records. [2025-10-02T22:43:45.780677] [DEBUG] [LOCAL ] RBLX: Saving derivative data. [2025-10-02T22:43:45.803859] [DEBUG] [LOCAL ] RBLX: Derivative data saved (1807 records). [2025-10-02T22:43:45.804086] [INFO ] [MAIN ] RBLX: Successfully saved derivative data. [2025-10-02T22:43:45.806883] [INFO ] [MAIN ] Derivative Progress: 1423/1975 symbols completed. RBLX took 1.3s. Estimated remaining: 3m 51s. Rate: 143.1 symbols/min [2025-10-02T22:43:45.840831] [DEBUG] [MAIN ] RBRK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:45.842615] [INFO ] [MAIN ] RBRK: Generated 1807 derivative records from 53518 primary records. [2025-10-02T22:43:45.842808] [DEBUG] [LOCAL ] RBRK: Saving derivative data. [2025-10-02T22:43:45.872933] [DEBUG] [LOCAL ] RC: Loaded 49291 existing records from primary storage. [2025-10-02T22:43:45.874620] [INFO ] [MAIN ] RC: Loaded 49291 primary data records. [2025-10-02T22:43:45.980969] [DEBUG] [LOCAL ] RBRK: Derivative data saved (1807 records). [2025-10-02T22:43:46.005017] [INFO ] [MAIN ] RBRK: Successfully saved derivative data. [2025-10-02T22:43:46.019836] [INFO ] [MAIN ] Derivative Progress: 1424/1975 symbols completed. RBRK took 1.1s. Estimated remaining: 3m 51s. Rate: 143.2 symbols/min [2025-10-02T22:43:46.248983] [DEBUG] [MAIN ] RC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:46.249858] [INFO ] [MAIN ] RC: Generated 1807 derivative records from 49291 primary records. [2025-10-02T22:43:46.249940] [DEBUG] [LOCAL ] RC: Saving derivative data. [2025-10-02T22:43:46.267254] [DEBUG] [LOCAL ] RC: Derivative data saved (1807 records). [2025-10-02T22:43:46.267436] [INFO ] [MAIN ] RC: Successfully saved derivative data. [2025-10-02T22:43:46.269790] [INFO ] [MAIN ] Derivative Progress: 1425/1975 symbols completed. RC took 0.7s. Estimated remaining: 3m 50s. Rate: 143.2 symbols/min [2025-10-02T22:43:46.270502] [INFO ] [MAIN ] RCI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:46.270602] [INFO ] [MAIN ] RCS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:46.270719] [INFO ] [MAIN ] RCUS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:46.289975] [DEBUG] [LOCAL ] RCS: Loaded 11689 existing records from primary storage. [2025-10-02T22:43:46.290262] [INFO ] [MAIN ] RCS: Loaded 11689 primary data records. [2025-10-02T22:43:46.505475] [DEBUG] [LOCAL ] RCUS: Loaded 42717 existing records from primary storage. [2025-10-02T22:43:46.553400] [INFO ] [MAIN ] RCUS: Loaded 42717 primary data records. [2025-10-02T22:43:46.728285] [DEBUG] [LOCAL ] RCI: Loaded 48958 existing records from primary storage. [2025-10-02T22:43:46.747261] [INFO ] [MAIN ] RCI: Loaded 48958 primary data records. [2025-10-02T22:43:47.418337] [DEBUG] [MAIN ] RCS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:47.421048] [INFO ] [MAIN ] RCS: Generated 1807 derivative records from 11689 primary records. [2025-10-02T22:43:47.422386] [DEBUG] [LOCAL ] RCS: Saving derivative data. [2025-10-02T22:43:47.450420] [DEBUG] [LOCAL ] RCS: Derivative data saved (1807 records). [2025-10-02T22:43:47.450788] [INFO ] [MAIN ] RCS: Successfully saved derivative data. [2025-10-02T22:43:47.466611] [INFO ] [MAIN ] Derivative Progress: 1426/1975 symbols completed. RCS took 1.2s. Estimated remaining: 3m 50s. Rate: 143.1 symbols/min [2025-10-02T22:43:47.467584] [INFO ] [MAIN ] RDDT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:47.467387] [DEBUG] [MAIN ] RCUS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:47.479330] [INFO ] [MAIN ] RCUS: Generated 1807 derivative records from 42717 primary records. [2025-10-02T22:43:47.479764] [DEBUG] [LOCAL ] RCUS: Saving derivative data. [2025-10-02T22:43:47.514183] [DEBUG] [LOCAL ] RCUS: Derivative data saved (1807 records). [2025-10-02T22:43:47.514732] [INFO ] [MAIN ] RCUS: Successfully saved derivative data. [2025-10-02T22:43:47.514558] [DEBUG] [MAIN ] RCI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:47.518301] [INFO ] [MAIN ] RCI: Generated 1807 derivative records from 48958 primary records. [2025-10-02T22:43:47.517269] [INFO ] [MAIN ] Derivative Progress: 1427/1975 symbols completed. RCUS took 1.2s. Estimated remaining: 3m 50s. Rate: 143.1 symbols/min [2025-10-02T22:43:47.518581] [INFO ] [MAIN ] RDN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:47.518691] [DEBUG] [LOCAL ] RCI: Saving derivative data. [2025-10-02T22:43:47.542482] [DEBUG] [LOCAL ] RCI: Derivative data saved (1807 records). [2025-10-02T22:43:47.542846] [INFO ] [MAIN ] RCI: Successfully saved derivative data. [2025-10-02T22:43:47.545773] [INFO ] [MAIN ] Derivative Progress: 1428/1975 symbols completed. RCI took 1.3s. Estimated remaining: 3m 49s. Rate: 143.2 symbols/min [2025-10-02T22:43:47.546287] [INFO ] [MAIN ] RDW: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:47.598246] [DEBUG] [LOCAL ] RDN: Loaded 45366 existing records from primary storage. [2025-10-02T22:43:47.618273] [INFO ] [MAIN ] RDN: Loaded 45366 primary data records. [2025-10-02T22:43:47.619956] [DEBUG] [LOCAL ] RDDT: Loaded 54170 existing records from primary storage. [2025-10-02T22:43:47.625326] [INFO ] [MAIN ] RDDT: Loaded 54170 primary data records. [2025-10-02T22:43:47.948000] [DEBUG] [LOCAL ] RDW: Loaded 52434 existing records from primary storage. [2025-10-02T22:43:47.973955] [INFO ] [MAIN ] RDW: Loaded 52434 primary data records. [2025-10-02T22:43:48.737599] [DEBUG] [MAIN ] RDDT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:48.744021] [INFO ] [MAIN ] RDDT: Generated 1807 derivative records from 54170 primary records. [2025-10-02T22:43:48.744220] [DEBUG] [LOCAL ] RDDT: Saving derivative data. [2025-10-02T22:43:48.743263] [DEBUG] [MAIN ] RDN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:48.745456] [INFO ] [MAIN ] RDN: Generated 1807 derivative records from 45366 primary records. [2025-10-02T22:43:48.745958] [DEBUG] [LOCAL ] RDN: Saving derivative data. [2025-10-02T22:43:48.790625] [DEBUG] [MAIN ] RDW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:48.792284] [INFO ] [MAIN ] RDW: Generated 1807 derivative records from 52434 primary records. [2025-10-02T22:43:48.794243] [DEBUG] [LOCAL ] RDDT: Derivative data saved (1807 records). [2025-10-02T22:43:48.794172] [DEBUG] [LOCAL ] RDW: Saving derivative data. [2025-10-02T22:43:48.794345] [INFO ] [MAIN ] RDDT: Successfully saved derivative data. [2025-10-02T22:43:48.797623] [INFO ] [MAIN ] Derivative Progress: 1429/1975 symbols completed. RDDT took 1.3s. Estimated remaining: 3m 49s. Rate: 143.0 symbols/min [2025-10-02T22:43:48.797795] [INFO ] [MAIN ] RDY: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:48.807439] [DEBUG] [LOCAL ] RDN: Derivative data saved (1807 records). [2025-10-02T22:43:48.807682] [INFO ] [MAIN ] RDN: Successfully saved derivative data. [2025-10-02T22:43:48.810825] [INFO ] [MAIN ] Derivative Progress: 1430/1975 symbols completed. RDN took 1.3s. Estimated remaining: 3m 48s. Rate: 143.1 symbols/min [2025-10-02T22:43:48.815201] [INFO ] [MAIN ] RELX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:48.821044] [DEBUG] [LOCAL ] RDW: Derivative data saved (1807 records). [2025-10-02T22:43:48.821203] [INFO ] [MAIN ] RDW: Successfully saved derivative data. [2025-10-02T22:43:48.823670] [INFO ] [MAIN ] Derivative Progress: 1431/1975 symbols completed. RDW took 1.3s. Estimated remaining: 3m 48s. Rate: 143.2 symbols/min [2025-10-02T22:43:48.823886] [INFO ] [MAIN ] RERE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:48.898515] [DEBUG] [LOCAL ] RDY: Loaded 47185 existing records from primary storage. [2025-10-02T22:43:48.898843] [INFO ] [MAIN ] RDY: Loaded 47185 primary data records. [2025-10-02T22:43:49.032224] [DEBUG] [LOCAL ] RELX: Loaded 48282 existing records from primary storage. [2025-10-02T22:43:49.032429] [INFO ] [MAIN ] RELX: Loaded 48282 primary data records. [2025-10-02T22:43:49.033014] [DEBUG] [LOCAL ] RERE: Loaded 41454 existing records from primary storage. [2025-10-02T22:43:49.033259] [INFO ] [MAIN ] RERE: Loaded 41454 primary data records. [2025-10-02T22:43:50.010170] [DEBUG] [MAIN ] RDY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:50.011099] [INFO ] [MAIN ] RDY: Generated 1807 derivative records from 47185 primary records. [2025-10-02T22:43:50.011283] [DEBUG] [LOCAL ] RDY: Saving derivative data. [2025-10-02T22:43:50.043512] [DEBUG] [MAIN ] RELX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:50.045190] [INFO ] [MAIN ] RELX: Generated 1807 derivative records from 48282 primary records. [2025-10-02T22:43:50.058034] [DEBUG] [LOCAL ] RELX: Saving derivative data. [2025-10-02T22:43:50.060811] [DEBUG] [LOCAL ] RDY: Derivative data saved (1807 records). [2025-10-02T22:43:50.061203] [DEBUG] [MAIN ] RERE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:50.062155] [INFO ] [MAIN ] RERE: Generated 1807 derivative records from 41454 primary records. [2025-10-02T22:43:50.069820] [DEBUG] [LOCAL ] RERE: Saving derivative data. [2025-10-02T22:43:50.061291] [INFO ] [MAIN ] RDY: Successfully saved derivative data. [2025-10-02T22:43:50.072905] [INFO ] [MAIN ] Derivative Progress: 1432/1975 symbols completed. RDY took 1.3s. Estimated remaining: 3m 48s. Rate: 143.0 symbols/min [2025-10-02T22:43:50.076483] [INFO ] [MAIN ] RES: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:50.099000] [DEBUG] [LOCAL ] RERE: Derivative data saved (1807 records). [2025-10-02T22:43:50.097686] [DEBUG] [LOCAL ] RELX: Derivative data saved (1807 records). [2025-10-02T22:43:50.099164] [INFO ] [MAIN ] RERE: Successfully saved derivative data. [2025-10-02T22:43:50.099278] [INFO ] [MAIN ] RELX: Successfully saved derivative data. [2025-10-02T22:43:50.101526] [INFO ] [MAIN ] Derivative Progress: 1433/1975 symbols completed. RELX took 1.3s. Estimated remaining: 3m 47s. Rate: 143.1 symbols/min [2025-10-02T22:43:50.101717] [INFO ] [MAIN ] REVG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:50.104861] [INFO ] [MAIN ] Derivative Progress: 1434/1975 symbols completed. RERE took 1.3s. Estimated remaining: 3m 47s. Rate: 143.2 symbols/min [2025-10-02T22:43:50.105750] [INFO ] [MAIN ] REX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:50.138941] [DEBUG] [LOCAL ] REX: Loaded 14244 existing records from primary storage. [2025-10-02T22:43:50.139088] [INFO ] [MAIN ] REX: Loaded 14244 primary data records. [2025-10-02T22:43:50.284928] [DEBUG] [LOCAL ] RES: Loaded 47702 existing records from primary storage. [2025-10-02T22:43:50.296784] [INFO ] [MAIN ] RES: Loaded 47702 primary data records. [2025-10-02T22:43:50.326899] [DEBUG] [LOCAL ] REVG: Loaded 41014 existing records from primary storage. [2025-10-02T22:43:50.360600] [INFO ] [MAIN ] REVG: Loaded 41014 primary data records. [2025-10-02T22:43:51.200822] [DEBUG] [MAIN ] REX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:51.203831] [INFO ] [MAIN ] REX: Generated 1807 derivative records from 14244 primary records. [2025-10-02T22:43:51.204958] [DEBUG] [LOCAL ] REX: Saving derivative data. [2025-10-02T22:43:51.224863] [DEBUG] [LOCAL ] REX: Derivative data saved (1807 records). [2025-10-02T22:43:51.240020] [INFO ] [MAIN ] REX: Successfully saved derivative data. [2025-10-02T22:43:51.240854] [DEBUG] [MAIN ] RES: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:51.244798] [INFO ] [MAIN ] RES: Generated 1807 derivative records from 47702 primary records. [2025-10-02T22:43:51.244082] [INFO ] [MAIN ] Derivative Progress: 1435/1975 symbols completed. REX took 1.1s. Estimated remaining: 3m 46s. Rate: 143.1 symbols/min [2025-10-02T22:43:51.245170] [INFO ] [MAIN ] REXR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:51.259367] [DEBUG] [LOCAL ] RES: Saving derivative data. [2025-10-02T22:43:51.259870] [DEBUG] [MAIN ] REVG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:51.261458] [INFO ] [MAIN ] REVG: Generated 1807 derivative records from 41014 primary records. [2025-10-02T22:43:51.261726] [DEBUG] [LOCAL ] REVG: Saving derivative data. [2025-10-02T22:43:51.289803] [DEBUG] [LOCAL ] REVG: Derivative data saved (1807 records). [2025-10-02T22:43:51.290690] [INFO ] [MAIN ] REVG: Successfully saved derivative data. [2025-10-02T22:43:51.293237] [INFO ] [MAIN ] Derivative Progress: 1436/1975 symbols completed. REVG took 1.2s. Estimated remaining: 3m 46s. Rate: 143.1 symbols/min [2025-10-02T22:43:51.293949] [INFO ] [MAIN ] REZI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:51.297282] [DEBUG] [LOCAL ] RES: Derivative data saved (1807 records). [2025-10-02T22:43:51.297497] [INFO ] [MAIN ] RES: Successfully saved derivative data. [2025-10-02T22:43:51.299595] [INFO ] [MAIN ] Derivative Progress: 1437/1975 symbols completed. RES took 1.2s. Estimated remaining: 3m 45s. Rate: 143.2 symbols/min [2025-10-02T22:43:51.299913] [INFO ] [MAIN ] RF: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:51.386961] [DEBUG] [LOCAL ] REXR: Loaded 52462 existing records from primary storage. [2025-10-02T22:43:51.401203] [DEBUG] [LOCAL ] REZI: Loaded 47292 existing records from primary storage. [2025-10-02T22:43:51.401525] [INFO ] [MAIN ] REXR: Loaded 52462 primary data records. [2025-10-02T22:43:51.401930] [INFO ] [MAIN ] REZI: Loaded 47292 primary data records. [2025-10-02T22:43:51.652400] [DEBUG] [LOCAL ] RF: Loaded 54020 existing records from primary storage. [2025-10-02T22:43:51.682462] [INFO ] [MAIN ] RF: Loaded 54020 primary data records. [2025-10-02T22:43:52.511435] [DEBUG] [MAIN ] REXR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:52.514257] [INFO ] [MAIN ] REXR: Generated 1807 derivative records from 52462 primary records. [2025-10-02T22:43:52.514515] [DEBUG] [LOCAL ] REXR: Saving derivative data. [2025-10-02T22:43:52.543205] [DEBUG] [MAIN ] REZI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:52.546039] [INFO ] [MAIN ] REZI: Generated 1807 derivative records from 47292 primary records. [2025-10-02T22:43:52.548215] [DEBUG] [LOCAL ] REZI: Saving derivative data. [2025-10-02T22:43:52.573368] [DEBUG] [LOCAL ] REXR: Derivative data saved (1807 records). [2025-10-02T22:43:52.576411] [DEBUG] [MAIN ] RF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:52.577256] [INFO ] [MAIN ] RF: Generated 1807 derivative records from 54020 primary records. [2025-10-02T22:43:52.577369] [DEBUG] [LOCAL ] RF: Saving derivative data. [2025-10-02T22:43:52.576522] [INFO ] [MAIN ] REXR: Successfully saved derivative data. [2025-10-02T22:43:52.583051] [INFO ] [MAIN ] Derivative Progress: 1438/1975 symbols completed. REXR took 1.3s. Estimated remaining: 3m 45s. Rate: 143.0 symbols/min [2025-10-02T22:43:52.592813] [DEBUG] [LOCAL ] REZI: Derivative data saved (1807 records). [2025-10-02T22:43:52.596532] [INFO ] [MAIN ] REZI: Successfully saved derivative data. [2025-10-02T22:43:52.599992] [INFO ] [MAIN ] Derivative Progress: 1439/1975 symbols completed. REZI took 1.3s. Estimated remaining: 3m 45s. Rate: 143.1 symbols/min [2025-10-02T22:43:52.603479] [DEBUG] [LOCAL ] RF: Derivative data saved (1807 records). [2025-10-02T22:43:52.603547] [INFO ] [MAIN ] RF: Successfully saved derivative data. [2025-10-02T22:43:52.605566] [INFO ] [MAIN ] Derivative Progress: 1440/1975 symbols completed. RF took 1.3s. Estimated remaining: 3m 44s. Rate: 143.2 symbols/min [2025-10-02T22:43:52.605998] [INFO ] [MAIN ] RFL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:52.605937] [INFO ] [MAIN ] RFI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:52.606108] [INFO ] [MAIN ] RFM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:52.614994] [DEBUG] [LOCAL ] RFM: Loaded 4188 existing records from primary storage. [2025-10-02T22:43:52.615251] [INFO ] [MAIN ] RFM: Loaded 4188 primary data records. [2025-10-02T22:43:52.685116] [DEBUG] [LOCAL ] RFL: Loaded 11222 existing records from primary storage. [2025-10-02T22:43:52.727269] [DEBUG] [LOCAL ] RFI: Loaded 10556 existing records from primary storage. [2025-10-02T22:43:52.704120] [INFO ] [MAIN ] RFL: Loaded 11222 primary data records. [2025-10-02T22:43:52.751103] [INFO ] [MAIN ] RFI: Loaded 10556 primary data records. [2025-10-02T22:43:53.696393] [DEBUG] [MAIN ] RFM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:53.698094] [INFO ] [MAIN ] RFM: Generated 1807 derivative records from 4188 primary records. [2025-10-02T22:43:53.698338] [DEBUG] [LOCAL ] RFM: Saving derivative data. [2025-10-02T22:43:53.716163] [DEBUG] [LOCAL ] RFM: Derivative data saved (1807 records). [2025-10-02T22:43:53.717333] [INFO ] [MAIN ] RFM: Successfully saved derivative data. [2025-10-02T22:43:53.721306] [INFO ] [MAIN ] Derivative Progress: 1441/1975 symbols completed. RFM took 1.1s. Estimated remaining: 3m 44s. Rate: 143.1 symbols/min [2025-10-02T22:43:53.723331] [INFO ] [MAIN ] RFMZ: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:53.745292] [DEBUG] [MAIN ] RFI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:53.750501] [DEBUG] [MAIN ] RFL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:53.751347] [INFO ] [MAIN ] RFL: Generated 1807 derivative records from 11222 primary records. [2025-10-02T22:43:53.751997] [INFO ] [MAIN ] RFI: Generated 1807 derivative records from 10556 primary records. [2025-10-02T22:43:53.754388] [DEBUG] [LOCAL ] RFI: Saving derivative data. [2025-10-02T22:43:53.754474] [DEBUG] [LOCAL ] RFL: Saving derivative data. [2025-10-02T22:43:53.785347] [DEBUG] [LOCAL ] RFMZ: Loaded 8813 existing records from primary storage. [2025-10-02T22:43:53.787085] [INFO ] [MAIN ] RFMZ: Loaded 8813 primary data records. [2025-10-02T22:43:53.854840] [DEBUG] [LOCAL ] RFL: Derivative data saved (1807 records). [2025-10-02T22:43:53.871406] [INFO ] [MAIN ] RFL: Successfully saved derivative data. [2025-10-02T22:43:53.881123] [INFO ] [MAIN ] Derivative Progress: 1442/1975 symbols completed. RFL took 1.3s. Estimated remaining: 3m 43s. Rate: 143.1 symbols/min [2025-10-02T22:43:53.891876] [INFO ] [MAIN ] RGA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:53.917530] [DEBUG] [LOCAL ] RFI: Derivative data saved (1807 records). [2025-10-02T22:43:53.944276] [INFO ] [MAIN ] RFI: Successfully saved derivative data. [2025-10-02T22:43:54.000527] [INFO ] [MAIN ] Derivative Progress: 1443/1975 symbols completed. RFI took 1.4s. Estimated remaining: 3m 43s. Rate: 143.2 symbols/min [2025-10-02T22:43:54.027830] [INFO ] [MAIN ] RGR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:54.180143] [DEBUG] [LOCAL ] RGA: Loaded 29832 existing records from primary storage. [2025-10-02T22:43:54.182419] [INFO ] [MAIN ] RGA: Loaded 29832 primary data records. [2025-10-02T22:43:54.192091] [DEBUG] [LOCAL ] RGR: Loaded 20763 existing records from primary storage. [2025-10-02T22:43:54.197690] [INFO ] [MAIN ] RGR: Loaded 20763 primary data records. [2025-10-02T22:43:54.255988] [DEBUG] [MAIN ] RFMZ: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-02T22:43:54.291523] [INFO ] [MAIN ] RFMZ: Generated 1806 derivative records from 8813 primary records. [2025-10-02T22:43:54.352888] [DEBUG] [LOCAL ] RFMZ: Saving derivative data. [2025-10-02T22:43:54.916533] [DEBUG] [LOCAL ] RFMZ: Derivative data saved (1806 records). [2025-10-02T22:43:54.959373] [INFO ] [MAIN ] RFMZ: Successfully saved derivative data. [2025-10-02T22:43:54.962670] [INFO ] [MAIN ] Derivative Progress: 1444/1975 symbols completed. RFMZ took 1.2s. Estimated remaining: 3m 43s. Rate: 143.1 symbols/min [2025-10-02T22:43:54.963166] [INFO ] [MAIN ] RGT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:55.196188] [DEBUG] [LOCAL ] RGT: Loaded 2781 existing records from primary storage. [2025-10-02T22:43:55.196623] [INFO ] [MAIN ] RGT: Loaded 2781 primary data records. [2025-10-02T22:43:55.573553] [DEBUG] [MAIN ] RGA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:55.575345] [INFO ] [MAIN ] RGA: Generated 1807 derivative records from 29832 primary records. [2025-10-02T22:43:55.575683] [DEBUG] [LOCAL ] RGA: Saving derivative data. [2025-10-02T22:43:55.610325] [DEBUG] [MAIN ] RGR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:55.611745] [INFO ] [MAIN ] RGR: Generated 1807 derivative records from 20763 primary records. [2025-10-02T22:43:55.612064] [DEBUG] [LOCAL ] RGR: Saving derivative data. [2025-10-02T22:43:55.623758] [DEBUG] [LOCAL ] RGA: Derivative data saved (1807 records). [2025-10-02T22:43:55.627386] [INFO ] [MAIN ] RGA: Successfully saved derivative data. [2025-10-02T22:43:55.632926] [INFO ] [MAIN ] Derivative Progress: 1445/1975 symbols completed. RGA took 1.7s. Estimated remaining: 3m 42s. Rate: 143.0 symbols/min [2025-10-02T22:43:55.633745] [INFO ] [MAIN ] RH: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:55.642461] [DEBUG] [LOCAL ] RGR: Derivative data saved (1807 records). [2025-10-02T22:43:55.642844] [INFO ] [MAIN ] RGR: Successfully saved derivative data. [2025-10-02T22:43:55.645255] [INFO ] [MAIN ] Derivative Progress: 1446/1975 symbols completed. RGR took 1.6s. Estimated remaining: 3m 42s. Rate: 143.1 symbols/min [2025-10-02T22:43:55.658392] [INFO ] [MAIN ] RHI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:55.659860] [DEBUG] [MAIN ] RGT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:55.660865] [INFO ] [MAIN ] RGT: Generated 1807 derivative records from 2781 primary records. [2025-10-02T22:43:55.661157] [DEBUG] [LOCAL ] RGT: Saving derivative data. [2025-10-02T22:43:55.680389] [DEBUG] [LOCAL ] RGT: Derivative data saved (1807 records). [2025-10-02T22:43:55.680611] [INFO ] [MAIN ] RGT: Successfully saved derivative data. [2025-10-02T22:43:55.683227] [INFO ] [MAIN ] Derivative Progress: 1447/1975 symbols completed. RGT took 0.7s. Estimated remaining: 3m 41s. Rate: 143.2 symbols/min [2025-10-02T22:43:55.683486] [INFO ] [MAIN ] RHP: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:55.722360] [DEBUG] [LOCAL ] RH: Loaded 47866 existing records from primary storage. [2025-10-02T22:43:55.722613] [INFO ] [MAIN ] RH: Loaded 47866 primary data records. [2025-10-02T22:43:55.933823] [DEBUG] [LOCAL ] RHP: Loaded 41502 existing records from primary storage. [2025-10-02T22:43:55.953158] [INFO ] [MAIN ] RHP: Loaded 41502 primary data records. [2025-10-02T22:43:56.144508] [DEBUG] [LOCAL ] RHI: Loaded 49625 existing records from primary storage. [2025-10-02T22:43:56.167784] [INFO ] [MAIN ] RHI: Loaded 49625 primary data records. [2025-10-02T22:43:56.821276] [DEBUG] [MAIN ] RH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:56.822622] [INFO ] [MAIN ] RH: Generated 1807 derivative records from 47866 primary records. [2025-10-02T22:43:56.822752] [DEBUG] [LOCAL ] RH: Saving derivative data. [2025-10-02T22:43:56.854505] [DEBUG] [MAIN ] RHP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:56.857116] [INFO ] [MAIN ] RHP: Generated 1807 derivative records from 41502 primary records. [2025-10-02T22:43:56.857584] [DEBUG] [LOCAL ] RHP: Saving derivative data. [2025-10-02T22:43:56.877515] [DEBUG] [LOCAL ] RHP: Derivative data saved (1807 records). [2025-10-02T22:43:56.876420] [DEBUG] [LOCAL ] RH: Derivative data saved (1807 records). [2025-10-02T22:43:56.877736] [INFO ] [MAIN ] RH: Successfully saved derivative data. [2025-10-02T22:43:56.880002] [INFO ] [MAIN ] Derivative Progress: 1448/1975 symbols completed. RH took 1.2s. Estimated remaining: 3m 41s. Rate: 143.0 symbols/min [2025-10-02T22:43:56.880238] [INFO ] [MAIN ] RIG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:56.883429] [INFO ] [MAIN ] RHP: Successfully saved derivative data. [2025-10-02T22:43:56.887546] [INFO ] [MAIN ] Derivative Progress: 1449/1975 symbols completed. RHP took 1.2s. Estimated remaining: 3m 41s. Rate: 143.1 symbols/min [2025-10-02T22:43:56.887958] [INFO ] [MAIN ] RIO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:56.902511] [DEBUG] [MAIN ] RHI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:56.903315] [INFO ] [MAIN ] RHI: Generated 1807 derivative records from 49625 primary records. [2025-10-02T22:43:56.903380] [DEBUG] [LOCAL ] RHI: Saving derivative data. [2025-10-02T22:43:56.924981] [DEBUG] [LOCAL ] RHI: Derivative data saved (1807 records). [2025-10-02T22:43:56.925176] [INFO ] [MAIN ] RHI: Successfully saved derivative data. [2025-10-02T22:43:56.927432] [INFO ] [MAIN ] Derivative Progress: 1450/1975 symbols completed. RHI took 1.3s. Estimated remaining: 3m 40s. Rate: 143.2 symbols/min [2025-10-02T22:43:56.927579] [INFO ] [MAIN ] RITM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:56.995962] [DEBUG] [LOCAL ] RIG: Loaded 54060 existing records from primary storage. [2025-10-02T22:43:56.996354] [INFO ] [MAIN ] RIG: Loaded 54060 primary data records. [2025-10-02T22:43:57.141322] [DEBUG] [LOCAL ] RIO: Loaded 53783 existing records from primary storage. [2025-10-02T22:43:57.146217] [INFO ] [MAIN ] RIO: Loaded 53783 primary data records. [2025-10-02T22:43:57.498705] [DEBUG] [LOCAL ] RITM: Loaded 53221 existing records from primary storage. [2025-10-02T22:43:57.515803] [INFO ] [MAIN ] RITM: Loaded 53221 primary data records. [2025-10-02T22:43:58.085166] [DEBUG] [MAIN ] RIG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:58.086802] [INFO ] [MAIN ] RIG: Generated 1807 derivative records from 54060 primary records. [2025-10-02T22:43:58.088059] [DEBUG] [LOCAL ] RIG: Saving derivative data. [2025-10-02T22:43:58.124160] [DEBUG] [MAIN ] RIO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:58.126083] [INFO ] [MAIN ] RIO: Generated 1807 derivative records from 53783 primary records. [2025-10-02T22:43:58.126218] [DEBUG] [LOCAL ] RIO: Saving derivative data. [2025-10-02T22:43:58.129871] [DEBUG] [LOCAL ] RIG: Derivative data saved (1807 records). [2025-10-02T22:43:58.137304] [INFO ] [MAIN ] RIG: Successfully saved derivative data. [2025-10-02T22:43:58.139624] [INFO ] [MAIN ] Derivative Progress: 1451/1975 symbols completed. RIG took 1.3s. Estimated remaining: 3m 40s. Rate: 143.0 symbols/min [2025-10-02T22:43:58.148421] [DEBUG] [LOCAL ] RIO: Derivative data saved (1807 records). [2025-10-02T22:43:58.148714] [INFO ] [MAIN ] RIV: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:58.148571] [INFO ] [MAIN ] RIO: Successfully saved derivative data. [2025-10-02T22:43:58.151248] [INFO ] [MAIN ] Derivative Progress: 1452/1975 symbols completed. RIO took 1.3s. Estimated remaining: 3m 39s. Rate: 143.1 symbols/min [2025-10-02T22:43:58.151412] [INFO ] [MAIN ] RJF: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:58.170036] [DEBUG] [MAIN ] RITM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:58.170871] [INFO ] [MAIN ] RITM: Generated 1807 derivative records from 53221 primary records. [2025-10-02T22:43:58.174399] [DEBUG] [LOCAL ] RITM: Saving derivative data. [2025-10-02T22:43:58.193602] [DEBUG] [LOCAL ] RIV: Loaded 12377 existing records from primary storage. [2025-10-02T22:43:58.195364] [INFO ] [MAIN ] RIV: Loaded 12377 primary data records. [2025-10-02T22:43:58.275539] [DEBUG] [LOCAL ] RITM: Derivative data saved (1807 records). [2025-10-02T22:43:58.311296] [INFO ] [MAIN ] RITM: Successfully saved derivative data. [2025-10-02T22:43:58.329051] [INFO ] [MAIN ] Derivative Progress: 1453/1975 symbols completed. RITM took 1.4s. Estimated remaining: 3m 39s. Rate: 143.2 symbols/min [2025-10-02T22:43:58.425949] [DEBUG] [LOCAL ] RJF: Loaded 47283 existing records from primary storage. [2025-10-02T22:43:58.432926] [INFO ] [MAIN ] RJF: Loaded 47283 primary data records. [2025-10-02T22:43:58.981281] [DEBUG] [MAIN ] RIV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:58.983226] [INFO ] [MAIN ] RIV: Generated 1807 derivative records from 12377 primary records. [2025-10-02T22:43:58.983561] [DEBUG] [LOCAL ] RIV: Saving derivative data. [2025-10-02T22:43:59.002790] [DEBUG] [LOCAL ] RIV: Derivative data saved (1807 records). [2025-10-02T22:43:59.003848] [INFO ] [MAIN ] RIV: Successfully saved derivative data. [2025-10-02T22:43:59.006728] [INFO ] [MAIN ] Derivative Progress: 1454/1975 symbols completed. RIV took 0.9s. Estimated remaining: 3m 38s. Rate: 143.1 symbols/min [2025-10-02T22:43:59.023262] [DEBUG] [MAIN ] RJF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:43:59.024297] [INFO ] [MAIN ] RJF: Generated 1807 derivative records from 47283 primary records. [2025-10-02T22:43:59.024364] [DEBUG] [LOCAL ] RJF: Saving derivative data. [2025-10-02T22:43:59.042174] [DEBUG] [LOCAL ] RJF: Derivative data saved (1807 records). [2025-10-02T22:43:59.042268] [INFO ] [MAIN ] RJF: Successfully saved derivative data. [2025-10-02T22:43:59.044383] [INFO ] [MAIN ] Derivative Progress: 1455/1975 symbols completed. RJF took 0.9s. Estimated remaining: 3m 38s. Rate: 143.2 symbols/min [2025-10-02T22:43:59.045171] [INFO ] [MAIN ] RL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:59.045108] [INFO ] [MAIN ] RLI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:59.045001] [INFO ] [MAIN ] RKT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:43:59.110696] [DEBUG] [LOCAL ] RLI: Loaded 33827 existing records from primary storage. [2025-10-02T22:43:59.111023] [INFO ] [MAIN ] RLI: Loaded 33827 primary data records. [2025-10-02T22:43:59.208136] [DEBUG] [LOCAL ] RL: Loaded 41302 existing records from primary storage. [2025-10-02T22:43:59.219046] [INFO ] [MAIN ] RL: Loaded 41302 primary data records. [2025-10-02T22:43:59.312506] [DEBUG] [LOCAL ] RKT: Loaded 54111 existing records from primary storage. [2025-10-02T22:43:59.389570] [INFO ] [MAIN ] RKT: Loaded 54111 primary data records. [2025-10-02T22:44:00.229047] [DEBUG] [MAIN ] RLI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:00.230974] [INFO ] [MAIN ] RLI: Generated 1807 derivative records from 33827 primary records. [2025-10-02T22:44:00.231411] [DEBUG] [LOCAL ] RLI: Saving derivative data. [2025-10-02T22:44:00.250957] [DEBUG] [LOCAL ] RLI: Derivative data saved (1807 records). [2025-10-02T22:44:00.251202] [INFO ] [MAIN ] RLI: Successfully saved derivative data. [2025-10-02T22:44:00.253002] [INFO ] [MAIN ] Derivative Progress: 1456/1975 symbols completed. RLI took 1.2s. Estimated remaining: 3m 38s. Rate: 143.0 symbols/min [2025-10-02T22:44:00.253343] [INFO ] [MAIN ] RLJ: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:00.275282] [DEBUG] [MAIN ] RL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:00.279030] [INFO ] [MAIN ] RL: Generated 1807 derivative records from 41302 primary records. [2025-10-02T22:44:00.279579] [DEBUG] [LOCAL ] RL: Saving derivative data. [2025-10-02T22:44:00.311762] [DEBUG] [MAIN ] RKT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:00.313357] [INFO ] [MAIN ] RKT: Generated 1807 derivative records from 54111 primary records. [2025-10-02T22:44:00.314268] [DEBUG] [LOCAL ] RKT: Saving derivative data. [2025-10-02T22:44:00.316889] [DEBUG] [LOCAL ] RL: Derivative data saved (1807 records). [2025-10-02T22:44:00.325182] [INFO ] [MAIN ] RL: Successfully saved derivative data. [2025-10-02T22:44:00.333199] [INFO ] [MAIN ] Derivative Progress: 1457/1975 symbols completed. RL took 1.3s. Estimated remaining: 3m 37s. Rate: 143.1 symbols/min [2025-10-02T22:44:00.347378] [INFO ] [MAIN ] RLTY: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:00.352250] [DEBUG] [LOCAL ] RKT: Derivative data saved (1807 records). [2025-10-02T22:44:00.352419] [INFO ] [MAIN ] RKT: Successfully saved derivative data. [2025-10-02T22:44:00.354899] [INFO ] [MAIN ] Derivative Progress: 1458/1975 symbols completed. RKT took 1.3s. Estimated remaining: 3m 37s. Rate: 143.2 symbols/min [2025-10-02T22:44:00.355359] [INFO ] [MAIN ] RLX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:00.376536] [DEBUG] [LOCAL ] RLJ: Loaded 48448 existing records from primary storage. [2025-10-02T22:44:00.376873] [INFO ] [MAIN ] RLJ: Loaded 48448 primary data records. [2025-10-02T22:44:00.406195] [DEBUG] [LOCAL ] RLTY: Loaded 11252 existing records from primary storage. [2025-10-02T22:44:00.433866] [INFO ] [MAIN ] RLTY: Loaded 11252 primary data records. [2025-10-02T22:44:00.973306] [DEBUG] [LOCAL ] RLX: Loaded 48653 existing records from primary storage. [2025-10-02T22:44:01.019079] [INFO ] [MAIN ] RLX: Loaded 48653 primary data records. [2025-10-02T22:44:01.567329] [DEBUG] [MAIN ] RLJ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:01.570071] [INFO ] [MAIN ] RLJ: Generated 1807 derivative records from 48448 primary records. [2025-10-02T22:44:01.570444] [DEBUG] [LOCAL ] RLJ: Saving derivative data. [2025-10-02T22:44:01.586547] [DEBUG] [MAIN ] RLTY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:01.595801] [INFO ] [MAIN ] RLTY: Generated 1807 derivative records from 11252 primary records. [2025-10-02T22:44:01.600025] [DEBUG] [LOCAL ] RLTY: Saving derivative data. [2025-10-02T22:44:01.605747] [DEBUG] [LOCAL ] RLJ: Derivative data saved (1807 records). [2025-10-02T22:44:01.613823] [INFO ] [MAIN ] RLJ: Successfully saved derivative data. [2025-10-02T22:44:01.615817] [INFO ] [MAIN ] Derivative Progress: 1459/1975 symbols completed. RLJ took 1.4s. Estimated remaining: 3m 37s. Rate: 143.0 symbols/min [2025-10-02T22:44:01.616149] [INFO ] [MAIN ] RM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:01.636070] [DEBUG] [LOCAL ] RLTY: Derivative data saved (1807 records). [2025-10-02T22:44:01.636708] [INFO ] [MAIN ] RLTY: Successfully saved derivative data. [2025-10-02T22:44:01.636332] [DEBUG] [LOCAL ] RM: Loaded 7680 existing records from primary storage. [2025-10-02T22:44:01.649733] [INFO ] [MAIN ] RM: Loaded 7680 primary data records. [2025-10-02T22:44:01.652054] [INFO ] [MAIN ] Derivative Progress: 1460/1975 symbols completed. RLTY took 1.3s. Estimated remaining: 3m 36s. Rate: 143.1 symbols/min [2025-10-02T22:44:01.657609] [INFO ] [MAIN ] RMAX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:01.649622] [DEBUG] [MAIN ] RLX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:01.699099] [INFO ] [MAIN ] RLX: Generated 1807 derivative records from 48653 primary records. [2025-10-02T22:44:01.711574] [DEBUG] [LOCAL ] RLX: Saving derivative data. [2025-10-02T22:44:01.891572] [DEBUG] [LOCAL ] RLX: Derivative data saved (1807 records). [2025-10-02T22:44:02.006057] [DEBUG] [LOCAL ] RMAX: Loaded 21594 existing records from primary storage. [2025-10-02T22:44:02.005206] [INFO ] [MAIN ] RLX: Successfully saved derivative data. [2025-10-02T22:44:02.016572] [INFO ] [MAIN ] RMAX: Loaded 21594 primary data records. [2025-10-02T22:44:02.018983] [INFO ] [MAIN ] Derivative Progress: 1461/1975 symbols completed. RLX took 1.7s. Estimated remaining: 3m 36s. Rate: 143.1 symbols/min [2025-10-02T22:44:02.025106] [INFO ] [MAIN ] RMD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:02.396369] [DEBUG] [MAIN ] RM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:02.398843] [INFO ] [MAIN ] RM: Generated 1807 derivative records from 7680 primary records. [2025-10-02T22:44:02.398999] [DEBUG] [LOCAL ] RM: Saving derivative data. [2025-10-02T22:44:02.400048] [DEBUG] [LOCAL ] RMD: Loaded 42317 existing records from primary storage. [2025-10-02T22:44:02.400547] [INFO ] [MAIN ] RMD: Loaded 42317 primary data records. [2025-10-02T22:44:02.538620] [DEBUG] [LOCAL ] RM: Derivative data saved (1807 records). [2025-10-02T22:44:02.539008] [INFO ] [MAIN ] RM: Successfully saved derivative data. [2025-10-02T22:44:02.547014] [INFO ] [MAIN ] Derivative Progress: 1462/1975 symbols completed. RM took 0.9s. Estimated remaining: 3m 35s. Rate: 143.1 symbols/min [2025-10-02T22:44:02.563501] [INFO ] [MAIN ] RMI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:02.777754] [DEBUG] [LOCAL ] RMI: Loaded 4733 existing records from primary storage. [2025-10-02T22:44:02.778332] [INFO ] [MAIN ] RMI: Loaded 4733 primary data records. [2025-10-02T22:44:02.778260] [DEBUG] [MAIN ] RMAX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:02.785220] [INFO ] [MAIN ] RMAX: Generated 1807 derivative records from 21594 primary records. [2025-10-02T22:44:02.797612] [DEBUG] [LOCAL ] RMAX: Saving derivative data. [2025-10-02T22:44:02.926311] [DEBUG] [LOCAL ] RMAX: Derivative data saved (1807 records). [2025-10-02T22:44:02.927162] [INFO ] [MAIN ] RMAX: Successfully saved derivative data. [2025-10-02T22:44:02.934681] [INFO ] [MAIN ] Derivative Progress: 1463/1975 symbols completed. RMAX took 1.3s. Estimated remaining: 3m 35s. Rate: 143.1 symbols/min [2025-10-02T22:44:02.940146] [INFO ] [MAIN ] RMM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:03.158013] [DEBUG] [LOCAL ] RMM: Loaded 10625 existing records from primary storage. [2025-10-02T22:44:03.171455] [INFO ] [MAIN ] RMM: Loaded 10625 primary data records. [2025-10-02T22:44:03.172492] [DEBUG] [MAIN ] RMD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:03.184995] [INFO ] [MAIN ] RMD: Generated 1807 derivative records from 42317 primary records. [2025-10-02T22:44:03.249750] [DEBUG] [LOCAL ] RMD: Saving derivative data. [2025-10-02T22:44:03.322846] [DEBUG] [LOCAL ] RMD: Derivative data saved (1807 records). [2025-10-02T22:44:03.333548] [INFO ] [MAIN ] RMD: Successfully saved derivative data. [2025-10-02T22:44:03.335926] [INFO ] [MAIN ] Derivative Progress: 1464/1975 symbols completed. RMD took 1.3s. Estimated remaining: 3m 34s. Rate: 143.1 symbols/min [2025-10-02T22:44:03.350482] [INFO ] [MAIN ] RMMZ: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:03.572507] [DEBUG] [LOCAL ] RMMZ: Loaded 4867 existing records from primary storage. [2025-10-02T22:44:03.586494] [INFO ] [MAIN ] RMMZ: Loaded 4867 primary data records. [2025-10-02T22:44:03.586914] [DEBUG] [MAIN ] RMI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:03.600401] [INFO ] [MAIN ] RMI: Generated 1807 derivative records from 4733 primary records. [2025-10-02T22:44:03.643794] [DEBUG] [LOCAL ] RMI: Saving derivative data. [2025-10-02T22:44:03.743049] [DEBUG] [LOCAL ] RMI: Derivative data saved (1807 records). [2025-10-02T22:44:03.753724] [INFO ] [MAIN ] RMI: Successfully saved derivative data. [2025-10-02T22:44:03.756412] [INFO ] [MAIN ] Derivative Progress: 1465/1975 symbols completed. RMI took 1.2s. Estimated remaining: 3m 34s. Rate: 143.1 symbols/min [2025-10-02T22:44:03.768744] [INFO ] [MAIN ] RMT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:03.963885] [DEBUG] [MAIN ] RMM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:03.964846] [INFO ] [MAIN ] RMM: Generated 1807 derivative records from 10625 primary records. [2025-10-02T22:44:03.965018] [DEBUG] [LOCAL ] RMM: Saving derivative data. [2025-10-02T22:44:03.994475] [DEBUG] [LOCAL ] RMM: Derivative data saved (1807 records). [2025-10-02T22:44:03.991316] [DEBUG] [LOCAL ] RMT: Loaded 17436 existing records from primary storage. [2025-10-02T22:44:03.994976] [INFO ] [MAIN ] RMM: Successfully saved derivative data. [2025-10-02T22:44:03.995096] [INFO ] [MAIN ] RMT: Loaded 17436 primary data records. [2025-10-02T22:44:03.997542] [INFO ] [MAIN ] Derivative Progress: 1466/1975 symbols completed. RMM took 1.1s. Estimated remaining: 3m 33s. Rate: 143.1 symbols/min [2025-10-02T22:44:03.998323] [INFO ] [MAIN ] RNG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:04.412794] [DEBUG] [MAIN ] RMMZ: Filtered 6966 bins outside market hours, 7762 incomplete bins [2025-10-02T22:44:04.414798] [INFO ] [MAIN ] RMMZ: Generated 1804 derivative records from 4867 primary records. [2025-10-02T22:44:04.415006] [DEBUG] [LOCAL ] RMMZ: Saving derivative data. [2025-10-02T22:44:04.418264] [DEBUG] [LOCAL ] RNG: Loaded 48381 existing records from primary storage. [2025-10-02T22:44:04.418363] [INFO ] [MAIN ] RNG: Loaded 48381 primary data records. [2025-10-02T22:44:04.535279] [DEBUG] [LOCAL ] RMMZ: Derivative data saved (1804 records). [2025-10-02T22:44:04.556931] [INFO ] [MAIN ] RMMZ: Successfully saved derivative data. [2025-10-02T22:44:04.559696] [INFO ] [MAIN ] Derivative Progress: 1467/1975 symbols completed. RMMZ took 1.2s. Estimated remaining: 3m 33s. Rate: 143.1 symbols/min [2025-10-02T22:44:04.560153] [INFO ] [MAIN ] RNGR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:04.809273] [DEBUG] [LOCAL ] RNGR: Loaded 20543 existing records from primary storage. [2025-10-02T22:44:04.810229] [DEBUG] [MAIN ] RMT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:04.810528] [INFO ] [MAIN ] RNGR: Loaded 20543 primary data records. [2025-10-02T22:44:04.812373] [INFO ] [MAIN ] RMT: Generated 1807 derivative records from 17436 primary records. [2025-10-02T22:44:04.846488] [DEBUG] [LOCAL ] RMT: Saving derivative data. [2025-10-02T22:44:04.952455] [DEBUG] [LOCAL ] RMT: Derivative data saved (1807 records). [2025-10-02T22:44:04.953338] [INFO ] [MAIN ] RMT: Successfully saved derivative data. [2025-10-02T22:44:04.971922] [INFO ] [MAIN ] Derivative Progress: 1468/1975 symbols completed. RMT took 1.2s. Estimated remaining: 3m 33s. Rate: 143.1 symbols/min [2025-10-02T22:44:05.188888] [DEBUG] [MAIN ] RNG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:05.189599] [INFO ] [MAIN ] RNG: Generated 1807 derivative records from 48381 primary records. [2025-10-02T22:44:05.189903] [DEBUG] [LOCAL ] RNG: Saving derivative data. [2025-10-02T22:44:05.209954] [DEBUG] [LOCAL ] RNG: Derivative data saved (1807 records). [2025-10-02T22:44:05.210522] [INFO ] [MAIN ] RNG: Successfully saved derivative data. [2025-10-02T22:44:05.213278] [INFO ] [MAIN ] Derivative Progress: 1469/1975 symbols completed. RNG took 1.2s. Estimated remaining: 3m 32s. Rate: 143.1 symbols/min [2025-10-02T22:44:05.234880] [DEBUG] [MAIN ] RNGR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:05.235665] [INFO ] [MAIN ] RNGR: Generated 1807 derivative records from 20543 primary records. [2025-10-02T22:44:05.235734] [DEBUG] [LOCAL ] RNGR: Saving derivative data. [2025-10-02T22:44:05.251835] [DEBUG] [LOCAL ] RNGR: Derivative data saved (1807 records). [2025-10-02T22:44:05.251956] [INFO ] [MAIN ] RNGR: Successfully saved derivative data. [2025-10-02T22:44:05.254264] [INFO ] [MAIN ] Derivative Progress: 1470/1975 symbols completed. RNGR took 0.7s. Estimated remaining: 3m 32s. Rate: 143.2 symbols/min [2025-10-02T22:44:05.255109] [INFO ] [MAIN ] RNST: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:05.255035] [INFO ] [MAIN ] RNR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:05.254943] [INFO ] [MAIN ] RNP: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:05.276081] [DEBUG] [LOCAL ] RNP: Loaded 15980 existing records from primary storage. [2025-10-02T22:44:05.276250] [INFO ] [MAIN ] RNP: Loaded 15980 primary data records. [2025-10-02T22:44:05.423486] [DEBUG] [LOCAL ] RNR: Loaded 34119 existing records from primary storage. [2025-10-02T22:44:05.462079] [INFO ] [MAIN ] RNR: Loaded 34119 primary data records. [2025-10-02T22:44:05.468101] [DEBUG] [LOCAL ] RNST: Loaded 37313 existing records from primary storage. [2025-10-02T22:44:05.547682] [INFO ] [MAIN ] RNST: Loaded 37313 primary data records. [2025-10-02T22:44:06.400158] [DEBUG] [MAIN ] RNP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:06.402478] [INFO ] [MAIN ] RNP: Generated 1807 derivative records from 15980 primary records. [2025-10-02T22:44:06.402920] [DEBUG] [LOCAL ] RNP: Saving derivative data. [2025-10-02T22:44:06.422572] [DEBUG] [LOCAL ] RNP: Derivative data saved (1807 records). [2025-10-02T22:44:06.423139] [INFO ] [MAIN ] RNP: Successfully saved derivative data. [2025-10-02T22:44:06.425722] [INFO ] [MAIN ] Derivative Progress: 1471/1975 symbols completed. RNP took 1.2s. Estimated remaining: 3m 31s. Rate: 143.0 symbols/min [2025-10-02T22:44:06.426105] [INFO ] [MAIN ] ROG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:06.446668] [DEBUG] [MAIN ] RNST: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:06.461446] [INFO ] [MAIN ] RNST: Generated 1807 derivative records from 37313 primary records. [2025-10-02T22:44:06.460793] [DEBUG] [MAIN ] RNR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:06.461581] [DEBUG] [LOCAL ] RNST: Saving derivative data. [2025-10-02T22:44:06.462287] [INFO ] [MAIN ] RNR: Generated 1807 derivative records from 34119 primary records. [2025-10-02T22:44:06.463216] [DEBUG] [LOCAL ] RNR: Saving derivative data. [2025-10-02T22:44:06.509269] [DEBUG] [LOCAL ] RNST: Derivative data saved (1807 records). [2025-10-02T22:44:06.511928] [DEBUG] [LOCAL ] RNR: Derivative data saved (1807 records). [2025-10-02T22:44:06.512101] [INFO ] [MAIN ] RNR: Successfully saved derivative data. [2025-10-02T22:44:06.512042] [INFO ] [MAIN ] RNST: Successfully saved derivative data. [2025-10-02T22:44:06.514690] [INFO ] [MAIN ] Derivative Progress: 1472/1975 symbols completed. RNR took 1.3s. Estimated remaining: 3m 31s. Rate: 143.1 symbols/min [2025-10-02T22:44:06.514867] [INFO ] [MAIN ] ROK: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:06.517608] [INFO ] [MAIN ] Derivative Progress: 1473/1975 symbols completed. RNST took 1.3s. Estimated remaining: 3m 30s. Rate: 143.2 symbols/min [2025-10-02T22:44:06.518975] [DEBUG] [LOCAL ] ROG: Loaded 22995 existing records from primary storage. [2025-10-02T22:44:06.518156] [INFO ] [MAIN ] ROL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:06.519230] [INFO ] [MAIN ] ROG: Loaded 22995 primary data records. [2025-10-02T22:44:06.899419] [DEBUG] [LOCAL ] ROK: Loaded 44054 existing records from primary storage. [2025-10-02T22:44:06.899890] [INFO ] [MAIN ] ROK: Loaded 44054 primary data records. [2025-10-02T22:44:07.057980] [DEBUG] [LOCAL ] ROL: Loaded 50678 existing records from primary storage. [2025-10-02T22:44:07.093451] [INFO ] [MAIN ] ROL: Loaded 50678 primary data records. [2025-10-02T22:44:07.447873] [DEBUG] [MAIN ] ROG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:07.470372] [INFO ] [MAIN ] ROG: Generated 1807 derivative records from 22995 primary records. [2025-10-02T22:44:07.516915] [DEBUG] [LOCAL ] ROG: Saving derivative data. [2025-10-02T22:44:07.641139] [DEBUG] [LOCAL ] ROG: Derivative data saved (1807 records). [2025-10-02T22:44:07.641822] [INFO ] [MAIN ] ROG: Successfully saved derivative data. [2025-10-02T22:44:07.644405] [INFO ] [MAIN ] Derivative Progress: 1474/1975 symbols completed. ROG took 1.2s. Estimated remaining: 3m 30s. Rate: 143.0 symbols/min [2025-10-02T22:44:07.644913] [INFO ] [MAIN ] RPM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:07.664083] [DEBUG] [MAIN ] ROK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:07.664900] [INFO ] [MAIN ] ROK: Generated 1807 derivative records from 44054 primary records. [2025-10-02T22:44:07.665289] [DEBUG] [LOCAL ] ROK: Saving derivative data. [2025-10-02T22:44:07.684445] [DEBUG] [LOCAL ] ROK: Derivative data saved (1807 records). [2025-10-02T22:44:07.684924] [INFO ] [MAIN ] ROK: Successfully saved derivative data. [2025-10-02T22:44:07.686949] [INFO ] [MAIN ] Derivative Progress: 1475/1975 symbols completed. ROK took 1.2s. Estimated remaining: 3m 30s. Rate: 143.1 symbols/min [2025-10-02T22:44:07.687513] [INFO ] [MAIN ] RPT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:07.707065] [DEBUG] [MAIN ] ROL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:07.708174] [INFO ] [MAIN ] ROL: Generated 1807 derivative records from 50678 primary records. [2025-10-02T22:44:07.708470] [DEBUG] [LOCAL ] ROL: Saving derivative data. [2025-10-02T22:44:07.749517] [DEBUG] [LOCAL ] ROL: Derivative data saved (1807 records). [2025-10-02T22:44:07.750618] [INFO ] [MAIN ] ROL: Successfully saved derivative data. [2025-10-02T22:44:07.752930] [INFO ] [MAIN ] Derivative Progress: 1476/1975 symbols completed. ROL took 1.2s. Estimated remaining: 3m 29s. Rate: 143.2 symbols/min [2025-10-02T22:44:07.753622] [DEBUG] [LOCAL ] RPT: Loaded 19143 existing records from primary storage. [2025-10-02T22:44:07.754027] [INFO ] [MAIN ] RQI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:07.753793] [INFO ] [MAIN ] RPT: Loaded 19143 primary data records. [2025-10-02T22:44:07.895465] [DEBUG] [LOCAL ] RPM: Loaded 41852 existing records from primary storage. [2025-10-02T22:44:07.934390] [INFO ] [MAIN ] RPM: Loaded 41852 primary data records. [2025-10-02T22:44:08.057197] [DEBUG] [LOCAL ] RQI: Loaded 29347 existing records from primary storage. [2025-10-02T22:44:08.111842] [INFO ] [MAIN ] RQI: Loaded 29347 primary data records. [2025-10-02T22:44:08.854062] [DEBUG] [MAIN ] RPT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:08.857765] [INFO ] [MAIN ] RPT: Generated 1807 derivative records from 19143 primary records. [2025-10-02T22:44:08.859109] [DEBUG] [LOCAL ] RPT: Saving derivative data. [2025-10-02T22:44:08.889806] [DEBUG] [LOCAL ] RPT: Derivative data saved (1807 records). [2025-10-02T22:44:08.890150] [INFO ] [MAIN ] RPT: Successfully saved derivative data. [2025-10-02T22:44:08.892506] [INFO ] [MAIN ] Derivative Progress: 1477/1975 symbols completed. RPT took 1.2s. Estimated remaining: 3m 29s. Rate: 143.0 symbols/min [2025-10-02T22:44:08.888931] [DEBUG] [MAIN ] RPM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:08.893895] [INFO ] [MAIN ] RRC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:08.893582] [INFO ] [MAIN ] RPM: Generated 1807 derivative records from 41852 primary records. [2025-10-02T22:44:08.894284] [DEBUG] [LOCAL ] RPM: Saving derivative data. [2025-10-02T22:44:08.914477] [DEBUG] [LOCAL ] RPM: Derivative data saved (1807 records). [2025-10-02T22:44:08.915809] [INFO ] [MAIN ] RPM: Successfully saved derivative data. [2025-10-02T22:44:08.918992] [INFO ] [MAIN ] Derivative Progress: 1478/1975 symbols completed. RPM took 1.3s. Estimated remaining: 3m 28s. Rate: 143.1 symbols/min [2025-10-02T22:44:08.919282] [INFO ] [MAIN ] RRX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:08.934311] [DEBUG] [MAIN ] RQI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:08.935103] [INFO ] [MAIN ] RQI: Generated 1807 derivative records from 29347 primary records. [2025-10-02T22:44:08.935265] [DEBUG] [LOCAL ] RQI: Saving derivative data. [2025-10-02T22:44:08.952965] [DEBUG] [LOCAL ] RQI: Derivative data saved (1807 records). [2025-10-02T22:44:08.953310] [INFO ] [MAIN ] RQI: Successfully saved derivative data. [2025-10-02T22:44:08.956537] [INFO ] [MAIN ] Derivative Progress: 1479/1975 symbols completed. RQI took 1.2s. Estimated remaining: 3m 28s. Rate: 143.2 symbols/min [2025-10-02T22:44:08.956991] [INFO ] [MAIN ] RS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:09.028854] [DEBUG] [LOCAL ] RRC: Loaded 53186 existing records from primary storage. [2025-10-02T22:44:09.029129] [INFO ] [MAIN ] RRC: Loaded 53186 primary data records. [2025-10-02T22:44:09.030064] [DEBUG] [LOCAL ] RRX: Loaded 41307 existing records from primary storage. [2025-10-02T22:44:09.051903] [INFO ] [MAIN ] RRX: Loaded 41307 primary data records. [2025-10-02T22:44:09.077722] [DEBUG] [LOCAL ] RS: Loaded 25543 existing records from primary storage. [2025-10-02T22:44:09.115562] [INFO ] [MAIN ] RS: Loaded 25543 primary data records. [2025-10-02T22:44:10.187559] [DEBUG] [MAIN ] RRC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:10.196153] [DEBUG] [MAIN ] RRX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:10.198365] [INFO ] [MAIN ] RRX: Generated 1807 derivative records from 41307 primary records. [2025-10-02T22:44:10.198446] [DEBUG] [LOCAL ] RRX: Saving derivative data. [2025-10-02T22:44:10.194611] [INFO ] [MAIN ] RRC: Generated 1807 derivative records from 53186 primary records. [2025-10-02T22:44:10.207531] [DEBUG] [LOCAL ] RRC: Saving derivative data. [2025-10-02T22:44:10.232437] [DEBUG] [LOCAL ] RRC: Derivative data saved (1807 records). [2025-10-02T22:44:10.233294] [INFO ] [MAIN ] RRC: Successfully saved derivative data. [2025-10-02T22:44:10.245869] [INFO ] [MAIN ] Derivative Progress: 1480/1975 symbols completed. RRC took 1.4s. Estimated remaining: 3m 28s. Rate: 143.0 symbols/min [2025-10-02T22:44:10.252343] [INFO ] [MAIN ] RSF: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:10.253491] [DEBUG] [MAIN ] RS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:10.255508] [INFO ] [MAIN ] RS: Generated 1807 derivative records from 25543 primary records. [2025-10-02T22:44:10.256460] [DEBUG] [LOCAL ] RS: Saving derivative data. [2025-10-02T22:44:10.257097] [DEBUG] [LOCAL ] RRX: Derivative data saved (1807 records). [2025-10-02T22:44:10.258029] [INFO ] [MAIN ] RRX: Successfully saved derivative data. [2025-10-02T22:44:10.261728] [INFO ] [MAIN ] Derivative Progress: 1481/1975 symbols completed. RRX took 1.3s. Estimated remaining: 3m 27s. Rate: 143.1 symbols/min [2025-10-02T22:44:10.269900] [INFO ] [MAIN ] RSG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:10.278327] [DEBUG] [LOCAL ] RSF: Loaded 4250 existing records from primary storage. [2025-10-02T22:44:10.278710] [INFO ] [MAIN ] RSF: Loaded 4250 primary data records. [2025-10-02T22:44:10.395991] [DEBUG] [LOCAL ] RS: Derivative data saved (1807 records). [2025-10-02T22:44:10.400896] [INFO ] [MAIN ] RS: Successfully saved derivative data. [2025-10-02T22:44:10.430130] [INFO ] [MAIN ] Derivative Progress: 1482/1975 symbols completed. RS took 1.5s. Estimated remaining: 3m 27s. Rate: 143.2 symbols/min [2025-10-02T22:44:10.477038] [INFO ] [MAIN ] RSI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:10.652051] [DEBUG] [LOCAL ] RSG: Loaded 47804 existing records from primary storage. [2025-10-02T22:44:10.652346] [INFO ] [MAIN ] RSG: Loaded 47804 primary data records. [2025-10-02T22:44:10.954111] [DEBUG] [LOCAL ] RSI: Loaded 47217 existing records from primary storage. [2025-10-02T22:44:11.031587] [INFO ] [MAIN ] RSI: Loaded 47217 primary data records. [2025-10-02T22:44:11.195394] [DEBUG] [MAIN ] RSF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:11.240219] [INFO ] [MAIN ] RSF: Generated 1807 derivative records from 4250 primary records. [2025-10-02T22:44:11.264090] [DEBUG] [LOCAL ] RSF: Saving derivative data. [2025-10-02T22:44:11.426716] [DEBUG] [LOCAL ] RSF: Derivative data saved (1807 records). [2025-10-02T22:44:11.427045] [INFO ] [MAIN ] RSF: Successfully saved derivative data. [2025-10-02T22:44:11.429190] [INFO ] [MAIN ] Derivative Progress: 1483/1975 symbols completed. RSF took 1.2s. Estimated remaining: 3m 26s. Rate: 143.0 symbols/min [2025-10-02T22:44:11.445022] [DEBUG] [MAIN ] RSG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:11.445868] [INFO ] [MAIN ] RSG: Generated 1807 derivative records from 47804 primary records. [2025-10-02T22:44:11.446369] [DEBUG] [LOCAL ] RSG: Saving derivative data. [2025-10-02T22:44:11.466490] [DEBUG] [LOCAL ] RSG: Derivative data saved (1807 records). [2025-10-02T22:44:11.466805] [INFO ] [MAIN ] RSG: Successfully saved derivative data. [2025-10-02T22:44:11.468950] [INFO ] [MAIN ] Derivative Progress: 1484/1975 symbols completed. RSG took 1.2s. Estimated remaining: 3m 26s. Rate: 143.1 symbols/min [2025-10-02T22:44:11.485529] [DEBUG] [MAIN ] RSI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:11.486180] [INFO ] [MAIN ] RSI: Generated 1807 derivative records from 47217 primary records. [2025-10-02T22:44:11.486245] [DEBUG] [LOCAL ] RSI: Saving derivative data. [2025-10-02T22:44:11.504472] [DEBUG] [LOCAL ] RSI: Derivative data saved (1807 records). [2025-10-02T22:44:11.504635] [INFO ] [MAIN ] RSI: Successfully saved derivative data. [2025-10-02T22:44:11.507678] [INFO ] [MAIN ] Derivative Progress: 1485/1975 symbols completed. RSI took 1.0s. Estimated remaining: 3m 25s. Rate: 143.2 symbols/min [2025-10-02T22:44:11.508347] [INFO ] [MAIN ] RSKD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:11.508409] [INFO ] [MAIN ] RTO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:11.508599] [INFO ] [MAIN ] RTX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:11.599627] [DEBUG] [LOCAL ] RSKD: Loaded 33740 existing records from primary storage. [2025-10-02T22:44:11.599911] [INFO ] [MAIN ] RSKD: Loaded 33740 primary data records. [2025-10-02T22:44:11.600711] [DEBUG] [LOCAL ] RTO: Loaded 40295 existing records from primary storage. [2025-10-02T22:44:11.606342] [INFO ] [MAIN ] RTO: Loaded 40295 primary data records. [2025-10-02T22:44:12.045483] [DEBUG] [LOCAL ] RTX: Loaded 54094 existing records from primary storage. [2025-10-02T22:44:12.210204] [INFO ] [MAIN ] RTX: Loaded 54094 primary data records. [2025-10-02T22:44:12.765685] [DEBUG] [MAIN ] RSKD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:12.768971] [INFO ] [MAIN ] RSKD: Generated 1807 derivative records from 33740 primary records. [2025-10-02T22:44:12.773982] [DEBUG] [LOCAL ] RSKD: Saving derivative data. [2025-10-02T22:44:12.812890] [DEBUG] [MAIN ] RTO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:12.817226] [INFO ] [MAIN ] RTO: Generated 1807 derivative records from 40295 primary records. [2025-10-02T22:44:12.817818] [DEBUG] [LOCAL ] RTO: Saving derivative data. [2025-10-02T22:44:12.819183] [DEBUG] [LOCAL ] RSKD: Derivative data saved (1807 records). [2025-10-02T22:44:12.820383] [INFO ] [MAIN ] RSKD: Successfully saved derivative data. [2025-10-02T22:44:12.845355] [INFO ] [MAIN ] Derivative Progress: 1486/1975 symbols completed. RSKD took 1.3s. Estimated remaining: 3m 25s. Rate: 143.0 symbols/min [2025-10-02T22:44:12.847384] [INFO ] [MAIN ] RVLV: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:12.850726] [DEBUG] [MAIN ] RTX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:12.853083] [INFO ] [MAIN ] RTX: Generated 1807 derivative records from 54094 primary records. [2025-10-02T22:44:12.853307] [DEBUG] [LOCAL ] RTX: Saving derivative data. [2025-10-02T22:44:12.877259] [DEBUG] [LOCAL ] RTO: Derivative data saved (1807 records). [2025-10-02T22:44:12.878250] [INFO ] [MAIN ] RTO: Successfully saved derivative data. [2025-10-02T22:44:12.880966] [INFO ] [MAIN ] Derivative Progress: 1487/1975 symbols completed. RTO took 1.4s. Estimated remaining: 3m 25s. Rate: 143.1 symbols/min [2025-10-02T22:44:12.881870] [INFO ] [MAIN ] RVT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:12.883497] [DEBUG] [LOCAL ] RTX: Derivative data saved (1807 records). [2025-10-02T22:44:12.883705] [INFO ] [MAIN ] RTX: Successfully saved derivative data. [2025-10-02T22:44:12.888435] [INFO ] [MAIN ] Derivative Progress: 1488/1975 symbols completed. RTX took 1.4s. Estimated remaining: 3m 24s. Rate: 143.2 symbols/min [2025-10-02T22:44:12.888812] [INFO ] [MAIN ] RVTY: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:12.936518] [DEBUG] [LOCAL ] RVLV: Loaded 47921 existing records from primary storage. [2025-10-02T22:44:12.937343] [INFO ] [MAIN ] RVLV: Loaded 47921 primary data records. [2025-10-02T22:44:13.003903] [DEBUG] [LOCAL ] RVT: Loaded 26786 existing records from primary storage. [2025-10-02T22:44:13.053383] [INFO ] [MAIN ] RVT: Loaded 26786 primary data records. [2025-10-02T22:44:13.239847] [DEBUG] [LOCAL ] RVTY: Loaded 47883 existing records from primary storage. [2025-10-02T22:44:13.291633] [INFO ] [MAIN ] RVTY: Loaded 47883 primary data records. [2025-10-02T22:44:14.075156] [DEBUG] [MAIN ] RVLV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:14.076863] [INFO ] [MAIN ] RVLV: Generated 1807 derivative records from 47921 primary records. [2025-10-02T22:44:14.077175] [DEBUG] [LOCAL ] RVLV: Saving derivative data. [2025-10-02T22:44:14.110254] [DEBUG] [MAIN ] RVT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:14.112167] [INFO ] [MAIN ] RVT: Generated 1807 derivative records from 26786 primary records. [2025-10-02T22:44:14.112760] [DEBUG] [LOCAL ] RVT: Saving derivative data. [2025-10-02T22:44:14.130336] [DEBUG] [LOCAL ] RVLV: Derivative data saved (1807 records). [2025-10-02T22:44:14.131901] [INFO ] [MAIN ] RVLV: Successfully saved derivative data. [2025-10-02T22:44:14.135338] [INFO ] [MAIN ] Derivative Progress: 1489/1975 symbols completed. RVLV took 1.3s. Estimated remaining: 3m 24s. Rate: 143.0 symbols/min [2025-10-02T22:44:14.137136] [INFO ] [MAIN ] RWT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:14.140376] [DEBUG] [LOCAL ] RVT: Derivative data saved (1807 records). [2025-10-02T22:44:14.153041] [INFO ] [MAIN ] RVT: Successfully saved derivative data. [2025-10-02T22:44:14.155486] [INFO ] [MAIN ] Derivative Progress: 1490/1975 symbols completed. RVT took 1.3s. Estimated remaining: 3m 23s. Rate: 143.1 symbols/min [2025-10-02T22:44:14.156362] [DEBUG] [MAIN ] RVTY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:14.157200] [INFO ] [MAIN ] RVTY: Generated 1807 derivative records from 47883 primary records. [2025-10-02T22:44:14.157310] [DEBUG] [LOCAL ] RVTY: Saving derivative data. [2025-10-02T22:44:14.157471] [INFO ] [MAIN ] RXO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:14.175741] [DEBUG] [LOCAL ] RVTY: Derivative data saved (1807 records). [2025-10-02T22:44:14.175911] [INFO ] [MAIN ] RVTY: Successfully saved derivative data. [2025-10-02T22:44:14.178937] [INFO ] [MAIN ] Derivative Progress: 1491/1975 symbols completed. RVTY took 1.3s. Estimated remaining: 3m 23s. Rate: 143.2 symbols/min [2025-10-02T22:44:14.179399] [INFO ] [MAIN ] RY: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:14.227018] [DEBUG] [LOCAL ] RWT: Loaded 41129 existing records from primary storage. [2025-10-02T22:44:14.227297] [INFO ] [MAIN ] RWT: Loaded 41129 primary data records. [2025-10-02T22:44:14.381016] [DEBUG] [LOCAL ] RXO: Loaded 48199 existing records from primary storage. [2025-10-02T22:44:14.394594] [INFO ] [MAIN ] RXO: Loaded 48199 primary data records. [2025-10-02T22:44:14.543624] [DEBUG] [LOCAL ] RY: Loaded 48218 existing records from primary storage. [2025-10-02T22:44:14.587544] [INFO ] [MAIN ] RY: Loaded 48218 primary data records. [2025-10-02T22:44:15.413477] [DEBUG] [MAIN ] RWT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:15.417158] [INFO ] [MAIN ] RWT: Generated 1807 derivative records from 41129 primary records. [2025-10-02T22:44:15.417382] [DEBUG] [LOCAL ] RWT: Saving derivative data. [2025-10-02T22:44:15.447828] [DEBUG] [MAIN ] RXO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:15.449600] [INFO ] [MAIN ] RXO: Generated 1807 derivative records from 48199 primary records. [2025-10-02T22:44:15.450902] [DEBUG] [LOCAL ] RXO: Saving derivative data. [2025-10-02T22:44:15.484310] [DEBUG] [LOCAL ] RWT: Derivative data saved (1807 records). [2025-10-02T22:44:15.486458] [INFO ] [MAIN ] RWT: Successfully saved derivative data. [2025-10-02T22:44:15.488949] [INFO ] [MAIN ] Derivative Progress: 1492/1975 symbols completed. RWT took 1.4s. Estimated remaining: 3m 23s. Rate: 143.0 symbols/min [2025-10-02T22:44:15.489457] [DEBUG] [MAIN ] RY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:15.490471] [INFO ] [MAIN ] RY: Generated 1807 derivative records from 48218 primary records. [2025-10-02T22:44:15.491508] [INFO ] [MAIN ] RYAM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:15.491403] [DEBUG] [LOCAL ] RY: Saving derivative data. [2025-10-02T22:44:15.493255] [DEBUG] [LOCAL ] RXO: Derivative data saved (1807 records). [2025-10-02T22:44:15.494127] [INFO ] [MAIN ] RXO: Successfully saved derivative data. [2025-10-02T22:44:15.496386] [INFO ] [MAIN ] Derivative Progress: 1493/1975 symbols completed. RXO took 1.3s. Estimated remaining: 3m 22s. Rate: 143.1 symbols/min [2025-10-02T22:44:15.508844] [INFO ] [MAIN ] RYAN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:15.515553] [DEBUG] [LOCAL ] RY: Derivative data saved (1807 records). [2025-10-02T22:44:15.515798] [INFO ] [MAIN ] RY: Successfully saved derivative data. [2025-10-02T22:44:15.518386] [INFO ] [MAIN ] Derivative Progress: 1494/1975 symbols completed. RY took 1.3s. Estimated remaining: 3m 22s. Rate: 143.2 symbols/min [2025-10-02T22:44:15.518532] [INFO ] [MAIN ] RYI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:15.566773] [DEBUG] [LOCAL ] RYAM: Loaded 35276 existing records from primary storage. [2025-10-02T22:44:15.567013] [INFO ] [MAIN ] RYAM: Loaded 35276 primary data records. [2025-10-02T22:44:15.599168] [DEBUG] [LOCAL ] RYI: Loaded 21688 existing records from primary storage. [2025-10-02T22:44:15.637773] [INFO ] [MAIN ] RYI: Loaded 21688 primary data records. [2025-10-02T22:44:15.663753] [DEBUG] [LOCAL ] RYAN: Loaded 44815 existing records from primary storage. [2025-10-02T22:44:15.718740] [INFO ] [MAIN ] RYAN: Loaded 44815 primary data records. [2025-10-02T22:44:16.648988] [DEBUG] [MAIN ] RYAM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:16.649789] [INFO ] [MAIN ] RYAM: Generated 1807 derivative records from 35276 primary records. [2025-10-02T22:44:16.650077] [DEBUG] [LOCAL ] RYAM: Saving derivative data. [2025-10-02T22:44:16.705772] [DEBUG] [MAIN ] RYI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:16.704583] [DEBUG] [LOCAL ] RYAM: Derivative data saved (1807 records). [2025-10-02T22:44:16.705272] [DEBUG] [MAIN ] RYAN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:16.706815] [INFO ] [MAIN ] RYI: Generated 1807 derivative records from 21688 primary records. [2025-10-02T22:44:16.705954] [INFO ] [MAIN ] RYAM: Successfully saved derivative data. [2025-10-02T22:44:16.707660] [INFO ] [MAIN ] RYAN: Generated 1807 derivative records from 44815 primary records. [2025-10-02T22:44:16.707901] [DEBUG] [LOCAL ] RYAN: Saving derivative data. [2025-10-02T22:44:16.707781] [DEBUG] [LOCAL ] RYI: Saving derivative data. [2025-10-02T22:44:16.711591] [INFO ] [MAIN ] Derivative Progress: 1495/1975 symbols completed. RYAM took 1.2s. Estimated remaining: 3m 21s. Rate: 143.0 symbols/min [2025-10-02T22:44:16.712439] [INFO ] [MAIN ] RYN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:16.745185] [DEBUG] [LOCAL ] RYAN: Derivative data saved (1807 records). [2025-10-02T22:44:16.745593] [INFO ] [MAIN ] RYAN: Successfully saved derivative data. [2025-10-02T22:44:16.748576] [INFO ] [MAIN ] Derivative Progress: 1496/1975 symbols completed. RYAN took 1.2s. Estimated remaining: 3m 21s. Rate: 143.1 symbols/min [2025-10-02T22:44:16.749681] [INFO ] [MAIN ] RZB: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:16.751397] [DEBUG] [LOCAL ] RYI: Derivative data saved (1807 records). [2025-10-02T22:44:16.751469] [INFO ] [MAIN ] RYI: Successfully saved derivative data. [2025-10-02T22:44:16.753985] [INFO ] [MAIN ] Derivative Progress: 1497/1975 symbols completed. RYI took 1.2s. Estimated remaining: 3m 20s. Rate: 143.2 symbols/min [2025-10-02T22:44:16.754345] [INFO ] [MAIN ] RZC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:16.764169] [DEBUG] [LOCAL ] RZB: Loaded 6232 existing records from primary storage. [2025-10-02T22:44:16.764335] [INFO ] [MAIN ] RZB: Loaded 6232 primary data records. [2025-10-02T22:44:16.873742] [DEBUG] [LOCAL ] RZC: Loaded 6820 existing records from primary storage. [2025-10-02T22:44:16.904805] [INFO ] [MAIN ] RZC: Loaded 6820 primary data records. [2025-10-02T22:44:17.034303] [DEBUG] [LOCAL ] RYN: Loaded 45908 existing records from primary storage. [2025-10-02T22:44:17.069964] [INFO ] [MAIN ] RYN: Loaded 45908 primary data records. [2025-10-02T22:44:17.918386] [DEBUG] [MAIN ] RZB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:17.919469] [INFO ] [MAIN ] RZB: Generated 1807 derivative records from 6232 primary records. [2025-10-02T22:44:17.919716] [DEBUG] [LOCAL ] RZB: Saving derivative data. [2025-10-02T22:44:17.934892] [DEBUG] [MAIN ] RZC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:17.937073] [INFO ] [MAIN ] RZC: Generated 1807 derivative records from 6820 primary records. [2025-10-02T22:44:17.937610] [DEBUG] [LOCAL ] RZC: Saving derivative data. [2025-10-02T22:44:17.974812] [DEBUG] [LOCAL ] RZC: Derivative data saved (1807 records). [2025-10-02T22:44:17.975045] [INFO ] [MAIN ] RZC: Successfully saved derivative data. [2025-10-02T22:44:17.974729] [DEBUG] [LOCAL ] RZB: Derivative data saved (1807 records). [2025-10-02T22:44:17.980838] [INFO ] [MAIN ] RZB: Successfully saved derivative data. [2025-10-02T22:44:17.979680] [INFO ] [MAIN ] Derivative Progress: 1498/1975 symbols completed. RZC took 1.2s. Estimated remaining: 3m 20s. Rate: 143.0 symbols/min [2025-10-02T22:44:17.984693] [INFO ] [MAIN ] Derivative Progress: 1499/1975 symbols completed. RZB took 1.2s. Estimated remaining: 3m 20s. Rate: 143.1 symbols/min [2025-10-02T22:44:17.998034] [DEBUG] [MAIN ] RYN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:17.998865] [INFO ] [MAIN ] RYN: Generated 1807 derivative records from 45908 primary records. [2025-10-02T22:44:17.998931] [DEBUG] [LOCAL ] RYN: Saving derivative data. [2025-10-02T22:44:18.017097] [DEBUG] [LOCAL ] RYN: Derivative data saved (1807 records). [2025-10-02T22:44:18.017252] [INFO ] [MAIN ] RYN: Successfully saved derivative data. [2025-10-02T22:44:18.019722] [INFO ] [MAIN ] Derivative Progress: 1500/1975 symbols completed. RYN took 1.3s. Estimated remaining: 3m 19s. Rate: 143.2 symbols/min [2025-10-02T22:44:18.020527] [INFO ] [MAIN ] S: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:18.020898] [INFO ] [MAIN ] SA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:18.020772] [INFO ] [MAIN ] SABA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:18.034848] [DEBUG] [LOCAL ] SABA: Loaded 9335 existing records from primary storage. [2025-10-02T22:44:18.035185] [INFO ] [MAIN ] SABA: Loaded 9335 primary data records. [2025-10-02T22:44:18.409892] [DEBUG] [LOCAL ] SA: Loaded 43787 existing records from primary storage. [2025-10-02T22:44:18.426488] [INFO ] [MAIN ] SA: Loaded 43787 primary data records. [2025-10-02T22:44:18.432843] [DEBUG] [LOCAL ] S: Loaded 53922 existing records from primary storage. [2025-10-02T22:44:18.463316] [INFO ] [MAIN ] S: Loaded 53922 primary data records. [2025-10-02T22:44:19.170288] [DEBUG] [MAIN ] SABA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:19.173001] [INFO ] [MAIN ] SABA: Generated 1807 derivative records from 9335 primary records. [2025-10-02T22:44:19.173383] [DEBUG] [LOCAL ] SABA: Saving derivative data. [2025-10-02T22:44:19.195701] [DEBUG] [LOCAL ] SABA: Derivative data saved (1807 records). [2025-10-02T22:44:19.196124] [INFO ] [MAIN ] SABA: Successfully saved derivative data. [2025-10-02T22:44:19.198516] [INFO ] [MAIN ] Derivative Progress: 1501/1975 symbols completed. SABA took 1.2s. Estimated remaining: 3m 19s. Rate: 143.0 symbols/min [2025-10-02T22:44:19.198795] [INFO ] [MAIN ] SAFE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:19.232841] [DEBUG] [MAIN ] SA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:19.241274] [INFO ] [MAIN ] SA: Generated 1807 derivative records from 43787 primary records. [2025-10-02T22:44:19.240404] [DEBUG] [MAIN ] S: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:19.242333] [INFO ] [MAIN ] S: Generated 1807 derivative records from 53922 primary records. [2025-10-02T22:44:19.242503] [DEBUG] [LOCAL ] SA: Saving derivative data. [2025-10-02T22:44:19.242564] [DEBUG] [LOCAL ] S: Saving derivative data. [2025-10-02T22:44:19.294334] [DEBUG] [LOCAL ] SA: Derivative data saved (1807 records). [2025-10-02T22:44:19.293386] [DEBUG] [LOCAL ] S: Derivative data saved (1807 records). [2025-10-02T22:44:19.303984] [INFO ] [MAIN ] S: Successfully saved derivative data. [2025-10-02T22:44:19.303887] [INFO ] [MAIN ] SA: Successfully saved derivative data. [2025-10-02T22:44:19.306140] [INFO ] [MAIN ] Derivative Progress: 1502/1975 symbols completed. S took 1.3s. Estimated remaining: 3m 18s. Rate: 143.1 symbols/min [2025-10-02T22:44:19.306393] [INFO ] [MAIN ] SAH: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:19.309277] [INFO ] [MAIN ] Derivative Progress: 1503/1975 symbols completed. SA took 1.3s. Estimated remaining: 3m 18s. Rate: 143.2 symbols/min [2025-10-02T22:44:19.310744] [DEBUG] [LOCAL ] SAFE: Loaded 30374 existing records from primary storage. [2025-10-02T22:44:19.311101] [INFO ] [MAIN ] SAFE: Loaded 30374 primary data records. [2025-10-02T22:44:19.309627] [INFO ] [MAIN ] SAM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:19.527072] [DEBUG] [LOCAL ] SAH: Loaded 22028 existing records from primary storage. [2025-10-02T22:44:19.660581] [INFO ] [MAIN ] SAH: Loaded 22028 primary data records. [2025-10-02T22:44:19.691481] [DEBUG] [LOCAL ] SAM: Loaded 21580 existing records from primary storage. [2025-10-02T22:44:19.718710] [INFO ] [MAIN ] SAM: Loaded 21580 primary data records. [2025-10-02T22:44:20.463993] [DEBUG] [MAIN ] SAFE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:20.465219] [INFO ] [MAIN ] SAFE: Generated 1807 derivative records from 30374 primary records. [2025-10-02T22:44:20.465715] [DEBUG] [LOCAL ] SAFE: Saving derivative data. [2025-10-02T22:44:20.510527] [DEBUG] [MAIN ] SAH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:20.511803] [INFO ] [MAIN ] SAH: Generated 1807 derivative records from 22028 primary records. [2025-10-02T22:44:20.495442] [DEBUG] [LOCAL ] SAFE: Derivative data saved (1807 records). [2025-10-02T22:44:20.511964] [DEBUG] [LOCAL ] SAH: Saving derivative data. [2025-10-02T22:44:20.512122] [INFO ] [MAIN ] SAFE: Successfully saved derivative data. [2025-10-02T22:44:20.514563] [INFO ] [MAIN ] Derivative Progress: 1504/1975 symbols completed. SAFE took 1.3s. Estimated remaining: 3m 18s. Rate: 143.0 symbols/min [2025-10-02T22:44:20.515145] [INFO ] [MAIN ] SAN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:20.548948] [DEBUG] [LOCAL ] SAH: Derivative data saved (1807 records). [2025-10-02T22:44:20.555774] [DEBUG] [MAIN ] SAM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:20.555908] [INFO ] [MAIN ] SAH: Successfully saved derivative data. [2025-10-02T22:44:20.556858] [INFO ] [MAIN ] SAM: Generated 1807 derivative records from 21580 primary records. [2025-10-02T22:44:20.559081] [INFO ] [MAIN ] Derivative Progress: 1505/1975 symbols completed. SAH took 1.3s. Estimated remaining: 3m 17s. Rate: 143.1 symbols/min [2025-10-02T22:44:20.559247] [DEBUG] [LOCAL ] SAM: Saving derivative data. [2025-10-02T22:44:20.559471] [INFO ] [MAIN ] SAND: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:20.579532] [DEBUG] [LOCAL ] SAM: Derivative data saved (1807 records). [2025-10-02T22:44:20.579781] [INFO ] [MAIN ] SAM: Successfully saved derivative data. [2025-10-02T22:44:20.582237] [INFO ] [MAIN ] Derivative Progress: 1506/1975 symbols completed. SAM took 1.3s. Estimated remaining: 3m 17s. Rate: 143.2 symbols/min [2025-10-02T22:44:20.582741] [INFO ] [MAIN ] SAP: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:20.623403] [DEBUG] [LOCAL ] SAN: Loaded 53375 existing records from primary storage. [2025-10-02T22:44:20.623769] [INFO ] [MAIN ] SAN: Loaded 53375 primary data records. [2025-10-02T22:44:20.866429] [DEBUG] [LOCAL ] SAND: Loaded 52192 existing records from primary storage. [2025-10-02T22:44:20.984609] [INFO ] [MAIN ] SAND: Loaded 52192 primary data records. [2025-10-02T22:44:21.058230] [DEBUG] [LOCAL ] SAP: Loaded 50362 existing records from primary storage. [2025-10-02T22:44:21.104826] [INFO ] [MAIN ] SAP: Loaded 50362 primary data records. [2025-10-02T22:44:21.784159] [DEBUG] [MAIN ] SAN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:21.785142] [INFO ] [MAIN ] SAN: Generated 1807 derivative records from 53375 primary records. [2025-10-02T22:44:21.785381] [DEBUG] [LOCAL ] SAN: Saving derivative data. [2025-10-02T22:44:21.820898] [DEBUG] [MAIN ] SAND: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:21.822792] [INFO ] [MAIN ] SAND: Generated 1807 derivative records from 52192 primary records. [2025-10-02T22:44:21.823361] [DEBUG] [LOCAL ] SAND: Saving derivative data. [2025-10-02T22:44:21.823456] [DEBUG] [LOCAL ] SAN: Derivative data saved (1807 records). [2025-10-02T22:44:21.823569] [INFO ] [MAIN ] SAN: Successfully saved derivative data. [2025-10-02T22:44:21.826776] [INFO ] [MAIN ] Derivative Progress: 1507/1975 symbols completed. SAN took 1.3s. Estimated remaining: 3m 16s. Rate: 143.0 symbols/min [2025-10-02T22:44:21.827401] [INFO ] [MAIN ] SAR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:21.860920] [DEBUG] [MAIN ] SAP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:21.865851] [DEBUG] [LOCAL ] SAND: Derivative data saved (1807 records). [2025-10-02T22:44:21.866805] [INFO ] [MAIN ] SAP: Generated 1807 derivative records from 50362 primary records. [2025-10-02T22:44:21.866965] [INFO ] [MAIN ] SAND: Successfully saved derivative data. [2025-10-02T22:44:21.867037] [DEBUG] [LOCAL ] SAP: Saving derivative data. [2025-10-02T22:44:21.869669] [INFO ] [MAIN ] Derivative Progress: 1508/1975 symbols completed. SAND took 1.3s. Estimated remaining: 3m 16s. Rate: 143.0 symbols/min [2025-10-02T22:44:21.870177] [INFO ] [MAIN ] SARO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:21.888334] [DEBUG] [LOCAL ] SAR: Loaded 16340 existing records from primary storage. [2025-10-02T22:44:21.889011] [INFO ] [MAIN ] SAR: Loaded 16340 primary data records. [2025-10-02T22:44:21.998826] [DEBUG] [LOCAL ] SAP: Derivative data saved (1807 records). [2025-10-02T22:44:22.013742] [INFO ] [MAIN ] SAP: Successfully saved derivative data. [2025-10-02T22:44:22.016381] [INFO ] [MAIN ] Derivative Progress: 1509/1975 symbols completed. SAP took 1.4s. Estimated remaining: 3m 15s. Rate: 143.1 symbols/min [2025-10-02T22:44:22.032291] [INFO ] [MAIN ] SB: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:22.251819] [DEBUG] [LOCAL ] SARO: Loaded 48990 existing records from primary storage. [2025-10-02T22:44:22.252991] [INFO ] [MAIN ] SARO: Loaded 48990 primary data records. [2025-10-02T22:44:22.398882] [DEBUG] [LOCAL ] SB: Loaded 33455 existing records from primary storage. [2025-10-02T22:44:22.414950] [INFO ] [MAIN ] SB: Loaded 33455 primary data records. [2025-10-02T22:44:22.954229] [DEBUG] [MAIN ] SAR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:22.955117] [INFO ] [MAIN ] SAR: Generated 1807 derivative records from 16340 primary records. [2025-10-02T22:44:22.955348] [DEBUG] [LOCAL ] SAR: Saving derivative data. [2025-10-02T22:44:22.978770] [DEBUG] [LOCAL ] SAR: Derivative data saved (1807 records). [2025-10-02T22:44:22.980548] [INFO ] [MAIN ] SAR: Successfully saved derivative data. [2025-10-02T22:44:22.983413] [INFO ] [MAIN ] Derivative Progress: 1510/1975 symbols completed. SAR took 1.2s. Estimated remaining: 3m 15s. Rate: 143.0 symbols/min [2025-10-02T22:44:22.984942] [INFO ] [MAIN ] SBH: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:22.999056] [DEBUG] [MAIN ] SARO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:23.000286] [INFO ] [MAIN ] SARO: Generated 1807 derivative records from 48990 primary records. [2025-10-02T22:44:23.000554] [DEBUG] [LOCAL ] SARO: Saving derivative data. [2025-10-02T22:44:23.023253] [DEBUG] [LOCAL ] SARO: Derivative data saved (1807 records). [2025-10-02T22:44:23.023460] [INFO ] [MAIN ] SARO: Successfully saved derivative data. [2025-10-02T22:44:23.025600] [INFO ] [MAIN ] Derivative Progress: 1511/1975 symbols completed. SARO took 1.2s. Estimated remaining: 3m 15s. Rate: 143.1 symbols/min [2025-10-02T22:44:23.039931] [DEBUG] [MAIN ] SB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:23.041039] [INFO ] [MAIN ] SB: Generated 1807 derivative records from 33455 primary records. [2025-10-02T22:44:23.040060] [INFO ] [MAIN ] SBI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:23.041299] [DEBUG] [LOCAL ] SB: Saving derivative data. [2025-10-02T22:44:23.079383] [DEBUG] [LOCAL ] SB: Derivative data saved (1807 records). [2025-10-02T22:44:23.078796] [DEBUG] [LOCAL ] SBI: Loaded 7614 existing records from primary storage. [2025-10-02T22:44:23.079761] [INFO ] [MAIN ] SB: Successfully saved derivative data. [2025-10-02T22:44:23.079971] [INFO ] [MAIN ] SBI: Loaded 7614 primary data records. [2025-10-02T22:44:23.087955] [INFO ] [MAIN ] Derivative Progress: 1512/1975 symbols completed. SB took 1.1s. Estimated remaining: 3m 14s. Rate: 143.2 symbols/min [2025-10-02T22:44:23.148922] [INFO ] [MAIN ] SBR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:23.190219] [DEBUG] [LOCAL ] SBH: Loaded 50147 existing records from primary storage. [2025-10-02T22:44:23.203420] [INFO ] [MAIN ] SBH: Loaded 50147 primary data records. [2025-10-02T22:44:23.287800] [DEBUG] [LOCAL ] SBR: Loaded 7447 existing records from primary storage. [2025-10-02T22:44:23.299638] [INFO ] [MAIN ] SBR: Loaded 7447 primary data records. [2025-10-02T22:44:24.269518] [DEBUG] [MAIN ] SBI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:24.271561] [INFO ] [MAIN ] SBI: Generated 1807 derivative records from 7614 primary records. [2025-10-02T22:44:24.272669] [DEBUG] [LOCAL ] SBI: Saving derivative data. [2025-10-02T22:44:24.302858] [DEBUG] [MAIN ] SBH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:24.304618] [INFO ] [MAIN ] SBH: Generated 1807 derivative records from 50147 primary records. [2025-10-02T22:44:24.305589] [DEBUG] [LOCAL ] SBH: Saving derivative data. [2025-10-02T22:44:24.325522] [DEBUG] [LOCAL ] SBI: Derivative data saved (1807 records). [2025-10-02T22:44:24.331397] [DEBUG] [LOCAL ] SBH: Derivative data saved (1807 records). [2025-10-02T22:44:24.331781] [INFO ] [MAIN ] SBI: Successfully saved derivative data. [2025-10-02T22:44:24.341867] [INFO ] [MAIN ] Derivative Progress: 1513/1975 symbols completed. SBI took 1.3s. Estimated remaining: 3m 14s. Rate: 143.0 symbols/min [2025-10-02T22:44:24.331607] [INFO ] [MAIN ] SBH: Successfully saved derivative data. [2025-10-02T22:44:24.349569] [INFO ] [MAIN ] Derivative Progress: 1514/1975 symbols completed. SBH took 1.4s. Estimated remaining: 3m 13s. Rate: 143.1 symbols/min [2025-10-02T22:44:24.350475] [DEBUG] [MAIN ] SBR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:24.351208] [INFO ] [MAIN ] SBR: Generated 1807 derivative records from 7447 primary records. [2025-10-02T22:44:24.351275] [DEBUG] [LOCAL ] SBR: Saving derivative data. [2025-10-02T22:44:24.366865] [DEBUG] [LOCAL ] SBR: Derivative data saved (1807 records). [2025-10-02T22:44:24.366955] [INFO ] [MAIN ] SBR: Successfully saved derivative data. [2025-10-02T22:44:24.369209] [INFO ] [MAIN ] Derivative Progress: 1515/1975 symbols completed. SBR took 1.2s. Estimated remaining: 3m 13s. Rate: 143.1 symbols/min [2025-10-02T22:44:24.369980] [INFO ] [MAIN ] SBSW: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:24.369911] [INFO ] [MAIN ] SBSI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:24.369835] [INFO ] [MAIN ] SBS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:24.391073] [DEBUG] [LOCAL ] SBSI: Loaded 14892 existing records from primary storage. [2025-10-02T22:44:24.391227] [INFO ] [MAIN ] SBSI: Loaded 14892 primary data records. [2025-10-02T22:44:24.770625] [DEBUG] [LOCAL ] SBSW: Loaded 53424 existing records from primary storage. [2025-10-02T22:44:24.785498] [INFO ] [MAIN ] SBSW: Loaded 53424 primary data records. [2025-10-02T22:44:24.786393] [DEBUG] [LOCAL ] SBS: Loaded 49841 existing records from primary storage. [2025-10-02T22:44:24.808564] [INFO ] [MAIN ] SBS: Loaded 49841 primary data records. [2025-10-02T22:44:25.521777] [DEBUG] [MAIN ] SBSI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:25.522997] [INFO ] [MAIN ] SBSI: Generated 1807 derivative records from 14892 primary records. [2025-10-02T22:44:25.523420] [DEBUG] [LOCAL ] SBSI: Saving derivative data. [2025-10-02T22:44:25.542942] [DEBUG] [LOCAL ] SBSI: Derivative data saved (1807 records). [2025-10-02T22:44:25.543448] [INFO ] [MAIN ] SBSI: Successfully saved derivative data. [2025-10-02T22:44:25.546029] [INFO ] [MAIN ] Derivative Progress: 1516/1975 symbols completed. SBSI took 1.2s. Estimated remaining: 3m 13s. Rate: 143.0 symbols/min [2025-10-02T22:44:25.546374] [INFO ] [MAIN ] SCCO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:25.568529] [DEBUG] [MAIN ] SBSW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:25.570115] [INFO ] [MAIN ] SBSW: Generated 1807 derivative records from 53424 primary records. [2025-10-02T22:44:25.570394] [DEBUG] [LOCAL ] SBSW: Saving derivative data. [2025-10-02T22:44:25.589290] [DEBUG] [LOCAL ] SBSW: Derivative data saved (1807 records). [2025-10-02T22:44:25.589943] [INFO ] [MAIN ] SBSW: Successfully saved derivative data. [2025-10-02T22:44:25.593065] [INFO ] [MAIN ] Derivative Progress: 1517/1975 symbols completed. SBSW took 1.2s. Estimated remaining: 3m 12s. Rate: 143.1 symbols/min [2025-10-02T22:44:25.595200] [INFO ] [MAIN ] SCD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:25.610170] [DEBUG] [MAIN ] SBS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:25.611000] [INFO ] [MAIN ] SBS: Generated 1807 derivative records from 49841 primary records. [2025-10-02T22:44:25.611230] [DEBUG] [LOCAL ] SBS: Saving derivative data. [2025-10-02T22:44:25.643543] [DEBUG] [LOCAL ] SBS: Derivative data saved (1807 records). [2025-10-02T22:44:25.648986] [INFO ] [MAIN ] SBS: Successfully saved derivative data. [2025-10-02T22:44:25.651764] [INFO ] [MAIN ] Derivative Progress: 1518/1975 symbols completed. SBS took 1.3s. Estimated remaining: 3m 12s. Rate: 143.1 symbols/min [2025-10-02T22:44:25.649316] [DEBUG] [LOCAL ] SCD: Loaded 12919 existing records from primary storage. [2025-10-02T22:44:25.652060] [INFO ] [MAIN ] SCHW: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:25.652300] [INFO ] [MAIN ] SCD: Loaded 12919 primary data records. [2025-10-02T22:44:25.734543] [DEBUG] [LOCAL ] SCCO: Loaded 49786 existing records from primary storage. [2025-10-02T22:44:25.751706] [INFO ] [MAIN ] SCCO: Loaded 49786 primary data records. [2025-10-02T22:44:26.460578] [DEBUG] [LOCAL ] SCHW: Loaded 54075 existing records from primary storage. [2025-10-02T22:44:26.461676] [INFO ] [MAIN ] SCHW: Loaded 54075 primary data records. [2025-10-02T22:44:26.823040] [DEBUG] [MAIN ] SCD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:26.825069] [INFO ] [MAIN ] SCD: Generated 1807 derivative records from 12919 primary records. [2025-10-02T22:44:26.825366] [DEBUG] [LOCAL ] SCD: Saving derivative data. [2025-10-02T22:44:26.839752] [DEBUG] [MAIN ] SCCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:26.841698] [INFO ] [MAIN ] SCCO: Generated 1807 derivative records from 49786 primary records. [2025-10-02T22:44:26.841992] [DEBUG] [LOCAL ] SCCO: Saving derivative data. [2025-10-02T22:44:26.881147] [DEBUG] [LOCAL ] SCD: Derivative data saved (1807 records). [2025-10-02T22:44:26.881844] [INFO ] [MAIN ] SCD: Successfully saved derivative data. [2025-10-02T22:44:26.887142] [DEBUG] [LOCAL ] SCCO: Derivative data saved (1807 records). [2025-10-02T22:44:26.885114] [INFO ] [MAIN ] Derivative Progress: 1519/1975 symbols completed. SCD took 1.3s. Estimated remaining: 3m 11s. Rate: 143.0 symbols/min [2025-10-02T22:44:26.887480] [INFO ] [MAIN ] SCCO: Successfully saved derivative data. [2025-10-02T22:44:26.888566] [INFO ] [MAIN ] SCI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:26.891886] [INFO ] [MAIN ] Derivative Progress: 1520/1975 symbols completed. SCCO took 1.3s. Estimated remaining: 3m 11s. Rate: 143.1 symbols/min [2025-10-02T22:44:26.892295] [INFO ] [MAIN ] SCL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:26.907495] [DEBUG] [MAIN ] SCHW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:26.908570] [INFO ] [MAIN ] SCHW: Generated 1807 derivative records from 54075 primary records. [2025-10-02T22:44:26.908705] [DEBUG] [LOCAL ] SCHW: Saving derivative data. [2025-10-02T22:44:26.938716] [DEBUG] [LOCAL ] SCHW: Derivative data saved (1807 records). [2025-10-02T22:44:26.938565] [DEBUG] [LOCAL ] SCL: Loaded 15009 existing records from primary storage. [2025-10-02T22:44:26.938947] [INFO ] [MAIN ] SCHW: Successfully saved derivative data. [2025-10-02T22:44:26.941898] [INFO ] [MAIN ] Derivative Progress: 1521/1975 symbols completed. SCHW took 1.3s. Estimated remaining: 3m 10s. Rate: 143.1 symbols/min [2025-10-02T22:44:26.942177] [INFO ] [MAIN ] SCM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:26.942068] [INFO ] [MAIN ] SCL: Loaded 15009 primary data records. [2025-10-02T22:44:27.175896] [DEBUG] [LOCAL ] SCI: Loaded 46770 existing records from primary storage. [2025-10-02T22:44:27.173434] [DEBUG] [LOCAL ] SCM: Loaded 19959 existing records from primary storage. [2025-10-02T22:44:27.176685] [INFO ] [MAIN ] SCM: Loaded 19959 primary data records. [2025-10-02T22:44:27.176130] [INFO ] [MAIN ] SCI: Loaded 46770 primary data records. [2025-10-02T22:44:28.079001] [DEBUG] [MAIN ] SCL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:28.080958] [INFO ] [MAIN ] SCL: Generated 1807 derivative records from 15009 primary records. [2025-10-02T22:44:28.081342] [DEBUG] [LOCAL ] SCL: Saving derivative data. [2025-10-02T22:44:28.118439] [DEBUG] [LOCAL ] SCL: Derivative data saved (1807 records). [2025-10-02T22:44:28.119105] [INFO ] [MAIN ] SCL: Successfully saved derivative data. [2025-10-02T22:44:28.119403] [DEBUG] [MAIN ] SCM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:28.122354] [INFO ] [MAIN ] SCM: Generated 1807 derivative records from 19959 primary records. [2025-10-02T22:44:28.122675] [DEBUG] [LOCAL ] SCM: Saving derivative data. [2025-10-02T22:44:28.121457] [INFO ] [MAIN ] Derivative Progress: 1522/1975 symbols completed. SCL took 1.2s. Estimated remaining: 3m 10s. Rate: 143.0 symbols/min [2025-10-02T22:44:28.136197] [INFO ] [MAIN ] SCS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:28.147073] [DEBUG] [MAIN ] SCI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:28.154963] [INFO ] [MAIN ] SCI: Generated 1807 derivative records from 46770 primary records. [2025-10-02T22:44:28.155771] [DEBUG] [LOCAL ] SCI: Saving derivative data. [2025-10-02T22:44:28.166306] [DEBUG] [LOCAL ] SCM: Derivative data saved (1807 records). [2025-10-02T22:44:28.167451] [INFO ] [MAIN ] SCM: Successfully saved derivative data. [2025-10-02T22:44:28.172740] [INFO ] [MAIN ] Derivative Progress: 1523/1975 symbols completed. SCM took 1.2s. Estimated remaining: 3m 10s. Rate: 143.0 symbols/min [2025-10-02T22:44:28.173464] [INFO ] [MAIN ] SD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:28.183148] [DEBUG] [LOCAL ] SCI: Derivative data saved (1807 records). [2025-10-02T22:44:28.183390] [INFO ] [MAIN ] SCI: Successfully saved derivative data. [2025-10-02T22:44:28.185765] [INFO ] [MAIN ] Derivative Progress: 1524/1975 symbols completed. SCI took 1.3s. Estimated remaining: 3m 9s. Rate: 143.1 symbols/min [2025-10-02T22:44:28.186019] [INFO ] [MAIN ] SDHC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:28.225605] [DEBUG] [LOCAL ] SDHC: Loaded 10414 existing records from primary storage. [2025-10-02T22:44:28.226768] [INFO ] [MAIN ] SDHC: Loaded 10414 primary data records. [2025-10-02T22:44:28.232452] [DEBUG] [LOCAL ] SD: Loaded 28887 existing records from primary storage. [2025-10-02T22:44:28.310563] [INFO ] [MAIN ] SD: Loaded 28887 primary data records. [2025-10-02T22:44:28.371333] [DEBUG] [LOCAL ] SCS: Loaded 43770 existing records from primary storage. [2025-10-02T22:44:28.382182] [INFO ] [MAIN ] SCS: Loaded 43770 primary data records. [2025-10-02T22:44:29.341180] [DEBUG] [MAIN ] SDHC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:29.344369] [INFO ] [MAIN ] SDHC: Generated 1807 derivative records from 10414 primary records. [2025-10-02T22:44:29.344895] [DEBUG] [LOCAL ] SDHC: Saving derivative data. [2025-10-02T22:44:29.359820] [DEBUG] [MAIN ] SD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:29.373202] [INFO ] [MAIN ] SD: Generated 1807 derivative records from 28887 primary records. [2025-10-02T22:44:29.374003] [DEBUG] [LOCAL ] SD: Saving derivative data. [2025-10-02T22:44:29.395736] [DEBUG] [LOCAL ] SDHC: Derivative data saved (1807 records). [2025-10-02T22:44:29.396111] [INFO ] [MAIN ] SDHC: Successfully saved derivative data. [2025-10-02T22:44:29.406362] [INFO ] [MAIN ] Derivative Progress: 1525/1975 symbols completed. SDHC took 1.2s. Estimated remaining: 3m 9s. Rate: 143.0 symbols/min [2025-10-02T22:44:29.413196] [INFO ] [MAIN ] SDHY: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:29.413048] [DEBUG] [MAIN ] SCS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:29.416670] [DEBUG] [LOCAL ] SD: Derivative data saved (1807 records). [2025-10-02T22:44:29.417506] [INFO ] [MAIN ] SCS: Generated 1807 derivative records from 43770 primary records. [2025-10-02T22:44:29.417810] [INFO ] [MAIN ] SD: Successfully saved derivative data. [2025-10-02T22:44:29.417724] [DEBUG] [LOCAL ] SCS: Saving derivative data. [2025-10-02T22:44:29.420236] [INFO ] [MAIN ] Derivative Progress: 1526/1975 symbols completed. SD took 1.2s. Estimated remaining: 3m 8s. Rate: 143.0 symbols/min [2025-10-02T22:44:29.420585] [INFO ] [MAIN ] SDRL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:29.447244] [DEBUG] [LOCAL ] SCS: Derivative data saved (1807 records). [2025-10-02T22:44:29.445996] [DEBUG] [LOCAL ] SDHY: Loaded 10624 existing records from primary storage. [2025-10-02T22:44:29.447533] [INFO ] [MAIN ] SCS: Successfully saved derivative data. [2025-10-02T22:44:29.449977] [INFO ] [MAIN ] Derivative Progress: 1527/1975 symbols completed. SCS took 1.3s. Estimated remaining: 3m 8s. Rate: 143.1 symbols/min [2025-10-02T22:44:29.450315] [INFO ] [MAIN ] SE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:29.450163] [INFO ] [MAIN ] SDHY: Loaded 10624 primary data records. [2025-10-02T22:44:29.694346] [DEBUG] [LOCAL ] SDRL: Loaded 41889 existing records from primary storage. [2025-10-02T22:44:29.773532] [INFO ] [MAIN ] SDRL: Loaded 41889 primary data records. [2025-10-02T22:44:29.999985] [DEBUG] [LOCAL ] SE: Loaded 53751 existing records from primary storage. [2025-10-02T22:44:30.015631] [INFO ] [MAIN ] SE: Loaded 53751 primary data records. [2025-10-02T22:44:30.620177] [DEBUG] [MAIN ] SDHY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:30.621630] [INFO ] [MAIN ] SDHY: Generated 1807 derivative records from 10624 primary records. [2025-10-02T22:44:30.622035] [DEBUG] [LOCAL ] SDHY: Saving derivative data. [2025-10-02T22:44:30.654568] [DEBUG] [LOCAL ] SDHY: Derivative data saved (1807 records). [2025-10-02T22:44:30.663808] [INFO ] [MAIN ] SDHY: Successfully saved derivative data. [2025-10-02T22:44:30.673989] [DEBUG] [MAIN ] SDRL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:30.673563] [INFO ] [MAIN ] Derivative Progress: 1528/1975 symbols completed. SDHY took 1.3s. Estimated remaining: 3m 8s. Rate: 143.0 symbols/min [2025-10-02T22:44:30.675768] [INFO ] [MAIN ] SDRL: Generated 1807 derivative records from 41889 primary records. [2025-10-02T22:44:30.689900] [DEBUG] [MAIN ] SE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:30.690631] [INFO ] [MAIN ] SE: Generated 1807 derivative records from 53751 primary records. [2025-10-02T22:44:30.689541] [DEBUG] [LOCAL ] SDRL: Saving derivative data. [2025-10-02T22:44:30.691477] [DEBUG] [LOCAL ] SE: Saving derivative data. [2025-10-02T22:44:30.724822] [DEBUG] [LOCAL ] SDRL: Derivative data saved (1807 records). [2025-10-02T22:44:30.726020] [INFO ] [MAIN ] SDRL: Successfully saved derivative data. [2025-10-02T22:44:30.726104] [DEBUG] [LOCAL ] SE: Derivative data saved (1807 records). [2025-10-02T22:44:30.728846] [INFO ] [MAIN ] Derivative Progress: 1529/1975 symbols completed. SDRL took 1.3s. Estimated remaining: 3m 7s. Rate: 143.0 symbols/min [2025-10-02T22:44:30.729014] [INFO ] [MAIN ] SE: Successfully saved derivative data. [2025-10-02T22:44:30.731565] [INFO ] [MAIN ] Derivative Progress: 1530/1975 symbols completed. SE took 1.3s. Estimated remaining: 3m 7s. Rate: 143.1 symbols/min [2025-10-02T22:44:30.732392] [INFO ] [MAIN ] SEG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:30.732286] [INFO ] [MAIN ] SEE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:30.732502] [INFO ] [MAIN ] SEI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:30.755215] [DEBUG] [LOCAL ] SEG: Loaded 13706 existing records from primary storage. [2025-10-02T22:44:30.755456] [INFO ] [MAIN ] SEG: Loaded 13706 primary data records. [2025-10-02T22:44:31.130781] [DEBUG] [LOCAL ] SEE: Loaded 48623 existing records from primary storage. [2025-10-02T22:44:31.131820] [INFO ] [MAIN ] SEE: Loaded 48623 primary data records. [2025-10-02T22:44:31.132944] [DEBUG] [LOCAL ] SEI: Loaded 50044 existing records from primary storage. [2025-10-02T22:44:31.134041] [INFO ] [MAIN ] SEI: Loaded 50044 primary data records. [2025-10-02T22:44:31.867437] [DEBUG] [MAIN ] SEG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:31.869494] [INFO ] [MAIN ] SEG: Generated 1807 derivative records from 13706 primary records. [2025-10-02T22:44:31.870210] [DEBUG] [LOCAL ] SEG: Saving derivative data. [2025-10-02T22:44:31.894523] [DEBUG] [LOCAL ] SEG: Derivative data saved (1807 records). [2025-10-02T22:44:31.895962] [INFO ] [MAIN ] SEG: Successfully saved derivative data. [2025-10-02T22:44:31.900518] [INFO ] [MAIN ] Derivative Progress: 1531/1975 symbols completed. SEG took 1.2s. Estimated remaining: 3m 6s. Rate: 143.0 symbols/min [2025-10-02T22:44:31.900988] [INFO ] [MAIN ] SEM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:31.916874] [DEBUG] [MAIN ] SEE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:31.918106] [INFO ] [MAIN ] SEE: Generated 1807 derivative records from 48623 primary records. [2025-10-02T22:44:31.918313] [DEBUG] [LOCAL ] SEE: Saving derivative data. [2025-10-02T22:44:31.953255] [DEBUG] [MAIN ] SEI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:31.954485] [DEBUG] [LOCAL ] SEE: Derivative data saved (1807 records). [2025-10-02T22:44:31.954766] [INFO ] [MAIN ] SEE: Successfully saved derivative data. [2025-10-02T22:44:31.957808] [INFO ] [MAIN ] Derivative Progress: 1532/1975 symbols completed. SEE took 1.2s. Estimated remaining: 3m 6s. Rate: 143.0 symbols/min [2025-10-02T22:44:31.955616] [INFO ] [MAIN ] SEI: Generated 1807 derivative records from 50044 primary records. [2025-10-02T22:44:31.958155] [INFO ] [MAIN ] SEMR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:31.958411] [DEBUG] [LOCAL ] SEI: Saving derivative data. [2025-10-02T22:44:31.987423] [DEBUG] [LOCAL ] SEI: Derivative data saved (1807 records). [2025-10-02T22:44:31.987547] [INFO ] [MAIN ] SEI: Successfully saved derivative data. [2025-10-02T22:44:31.990837] [INFO ] [MAIN ] Derivative Progress: 1533/1975 symbols completed. SEI took 1.3s. Estimated remaining: 3m 5s. Rate: 143.1 symbols/min [2025-10-02T22:44:31.991243] [INFO ] [MAIN ] SES: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:32.006993] [DEBUG] [LOCAL ] SEM: Loaded 43065 existing records from primary storage. [2025-10-02T22:44:32.007253] [INFO ] [MAIN ] SEM: Loaded 43065 primary data records. [2025-10-02T22:44:32.153076] [DEBUG] [LOCAL ] SEMR: Loaded 41963 existing records from primary storage. [2025-10-02T22:44:32.163991] [INFO ] [MAIN ] SEMR: Loaded 41963 primary data records. [2025-10-02T22:44:32.507098] [DEBUG] [LOCAL ] SES: Loaded 51946 existing records from primary storage. [2025-10-02T22:44:32.508950] [INFO ] [MAIN ] SES: Loaded 51946 primary data records. [2025-10-02T22:44:33.140570] [DEBUG] [MAIN ] SEM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:33.142091] [INFO ] [MAIN ] SEM: Generated 1807 derivative records from 43065 primary records. [2025-10-02T22:44:33.142306] [DEBUG] [LOCAL ] SEM: Saving derivative data. [2025-10-02T22:44:33.171341] [DEBUG] [LOCAL ] SEM: Derivative data saved (1807 records). [2025-10-02T22:44:33.171685] [INFO ] [MAIN ] SEM: Successfully saved derivative data. [2025-10-02T22:44:33.174155] [INFO ] [MAIN ] Derivative Progress: 1534/1975 symbols completed. SEM took 1.3s. Estimated remaining: 3m 5s. Rate: 143.0 symbols/min [2025-10-02T22:44:33.182672] [INFO ] [MAIN ] SF: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:33.189031] [DEBUG] [MAIN ] SEMR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:33.190153] [INFO ] [MAIN ] SEMR: Generated 1807 derivative records from 41963 primary records. [2025-10-02T22:44:33.190330] [DEBUG] [LOCAL ] SEMR: Saving derivative data. [2025-10-02T22:44:33.226978] [DEBUG] [MAIN ] SES: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:33.228684] [INFO ] [MAIN ] SES: Generated 1807 derivative records from 51946 primary records. [2025-10-02T22:44:33.229695] [DEBUG] [LOCAL ] SEMR: Derivative data saved (1807 records). [2025-10-02T22:44:33.229554] [DEBUG] [LOCAL ] SES: Saving derivative data. [2025-10-02T22:44:33.230874] [INFO ] [MAIN ] SEMR: Successfully saved derivative data. [2025-10-02T22:44:33.241248] [INFO ] [MAIN ] Derivative Progress: 1535/1975 symbols completed. SEMR took 1.3s. Estimated remaining: 3m 5s. Rate: 143.0 symbols/min [2025-10-02T22:44:33.245935] [INFO ] [MAIN ] SFB: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:33.262141] [DEBUG] [LOCAL ] SES: Derivative data saved (1807 records). [2025-10-02T22:44:33.262415] [INFO ] [MAIN ] SES: Successfully saved derivative data. [2025-10-02T22:44:33.264980] [INFO ] [MAIN ] Derivative Progress: 1536/1975 symbols completed. SES took 1.3s. Estimated remaining: 3m 4s. Rate: 143.1 symbols/min [2025-10-02T22:44:33.268124] [INFO ] [MAIN ] SFBS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:33.268554] [DEBUG] [LOCAL ] SFB: Loaded 4158 existing records from primary storage. [2025-10-02T22:44:33.268736] [INFO ] [MAIN ] SFB: Loaded 4158 primary data records. [2025-10-02T22:44:33.410226] [DEBUG] [LOCAL ] SF: Loaded 41845 existing records from primary storage. [2025-10-02T22:44:33.425868] [INFO ] [MAIN ] SF: Loaded 41845 primary data records. [2025-10-02T22:44:33.721990] [DEBUG] [LOCAL ] SFBS: Loaded 21253 existing records from primary storage. [2025-10-02T22:44:33.744830] [INFO ] [MAIN ] SFBS: Loaded 21253 primary data records. [2025-10-02T22:44:34.355328] [DEBUG] [MAIN ] SFB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:34.356464] [INFO ] [MAIN ] SFB: Generated 1807 derivative records from 4158 primary records. [2025-10-02T22:44:34.356924] [DEBUG] [LOCAL ] SFB: Saving derivative data. [2025-10-02T22:44:34.376898] [DEBUG] [LOCAL ] SFB: Derivative data saved (1807 records). [2025-10-02T22:44:34.377492] [INFO ] [MAIN ] SFB: Successfully saved derivative data. [2025-10-02T22:44:34.381139] [INFO ] [MAIN ] Derivative Progress: 1537/1975 symbols completed. SFB took 1.1s. Estimated remaining: 3m 4s. Rate: 143.0 symbols/min [2025-10-02T22:44:34.384811] [INFO ] [MAIN ] SFL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:34.412621] [DEBUG] [MAIN ] SF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:34.413854] [INFO ] [MAIN ] SF: Generated 1807 derivative records from 41845 primary records. [2025-10-02T22:44:34.414349] [DEBUG] [LOCAL ] SF: Saving derivative data. [2025-10-02T22:44:34.429793] [DEBUG] [MAIN ] SFBS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:34.440320] [INFO ] [MAIN ] SFBS: Generated 1807 derivative records from 21253 primary records. [2025-10-02T22:44:34.443772] [DEBUG] [LOCAL ] SFBS: Saving derivative data. [2025-10-02T22:44:34.481199] [DEBUG] [LOCAL ] SFBS: Derivative data saved (1807 records). [2025-10-02T22:44:34.481442] [INFO ] [MAIN ] SFBS: Successfully saved derivative data. [2025-10-02T22:44:34.480378] [DEBUG] [LOCAL ] SF: Derivative data saved (1807 records). [2025-10-02T22:44:34.484263] [INFO ] [MAIN ] SF: Successfully saved derivative data. [2025-10-02T22:44:34.484114] [INFO ] [MAIN ] Derivative Progress: 1538/1975 symbols completed. SFBS took 1.2s. Estimated remaining: 3m 3s. Rate: 143.0 symbols/min [2025-10-02T22:44:34.484570] [INFO ] [MAIN ] SGHC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:34.487055] [INFO ] [MAIN ] Derivative Progress: 1539/1975 symbols completed. SF took 1.3s. Estimated remaining: 3m 3s. Rate: 143.1 symbols/min [2025-10-02T22:44:34.487699] [INFO ] [MAIN ] SGU: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:34.512536] [DEBUG] [LOCAL ] SFL: Loaded 45558 existing records from primary storage. [2025-10-02T22:44:34.514774] [INFO ] [MAIN ] SFL: Loaded 45558 primary data records. [2025-10-02T22:44:34.569217] [DEBUG] [LOCAL ] SGU: Loaded 6739 existing records from primary storage. [2025-10-02T22:44:34.602860] [INFO ] [MAIN ] SGU: Loaded 6739 primary data records. [2025-10-02T22:44:35.054103] [DEBUG] [LOCAL ] SGHC: Loaded 46455 existing records from primary storage. [2025-10-02T22:44:35.065204] [INFO ] [MAIN ] SGHC: Loaded 46455 primary data records. [2025-10-02T22:44:35.597302] [DEBUG] [MAIN ] SFL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:35.598432] [INFO ] [MAIN ] SFL: Generated 1807 derivative records from 45558 primary records. [2025-10-02T22:44:35.599378] [DEBUG] [LOCAL ] SFL: Saving derivative data. [2025-10-02T22:44:35.620985] [DEBUG] [LOCAL ] SFL: Derivative data saved (1807 records). [2025-10-02T22:44:35.621723] [INFO ] [MAIN ] SFL: Successfully saved derivative data. [2025-10-02T22:44:35.631848] [INFO ] [MAIN ] Derivative Progress: 1540/1975 symbols completed. SFL took 1.2s. Estimated remaining: 3m 3s. Rate: 143.0 symbols/min [2025-10-02T22:44:35.637287] [INFO ] [MAIN ] SHAK: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:35.637812] [DEBUG] [MAIN ] SGU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:35.638983] [INFO ] [MAIN ] SGU: Generated 1807 derivative records from 6739 primary records. [2025-10-02T22:44:35.639077] [DEBUG] [LOCAL ] SGU: Saving derivative data. [2025-10-02T22:44:35.659985] [DEBUG] [LOCAL ] SGU: Derivative data saved (1807 records). [2025-10-02T22:44:35.660662] [INFO ] [MAIN ] SGU: Successfully saved derivative data. [2025-10-02T22:44:35.662754] [INFO ] [MAIN ] Derivative Progress: 1541/1975 symbols completed. SGU took 1.2s. Estimated remaining: 3m 2s. Rate: 143.1 symbols/min [2025-10-02T22:44:35.662965] [INFO ] [MAIN ] SHCO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:35.682458] [DEBUG] [MAIN ] SGHC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:35.683314] [INFO ] [MAIN ] SGHC: Generated 1807 derivative records from 46455 primary records. [2025-10-02T22:44:35.683381] [DEBUG] [LOCAL ] SGHC: Saving derivative data. [2025-10-02T22:44:35.737301] [DEBUG] [LOCAL ] SGHC: Derivative data saved (1807 records). [2025-10-02T22:44:35.738675] [INFO ] [MAIN ] SGHC: Successfully saved derivative data. [2025-10-02T22:44:35.738544] [DEBUG] [LOCAL ] SHCO: Loaded 26008 existing records from primary storage. [2025-10-02T22:44:35.741399] [INFO ] [MAIN ] Derivative Progress: 1542/1975 symbols completed. SGHC took 1.3s. Estimated remaining: 3m 2s. Rate: 143.1 symbols/min [2025-10-02T22:44:35.741792] [INFO ] [MAIN ] SHCO: Loaded 26008 primary data records. [2025-10-02T22:44:35.742078] [INFO ] [MAIN ] SHEL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:35.863034] [DEBUG] [LOCAL ] SHAK: Loaded 49276 existing records from primary storage. [2025-10-02T22:44:35.875929] [INFO ] [MAIN ] SHAK: Loaded 49276 primary data records. [2025-10-02T22:44:36.337224] [DEBUG] [LOCAL ] SHEL: Loaded 54061 existing records from primary storage. [2025-10-02T22:44:36.465362] [INFO ] [MAIN ] SHEL: Loaded 54061 primary data records. [2025-10-02T22:44:36.862378] [DEBUG] [MAIN ] SHCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:36.863298] [INFO ] [MAIN ] SHCO: Generated 1807 derivative records from 26008 primary records. [2025-10-02T22:44:36.863596] [DEBUG] [LOCAL ] SHCO: Saving derivative data. [2025-10-02T22:44:36.884350] [DEBUG] [LOCAL ] SHCO: Derivative data saved (1807 records). [2025-10-02T22:44:36.886191] [INFO ] [MAIN ] SHCO: Successfully saved derivative data. [2025-10-02T22:44:36.888729] [INFO ] [MAIN ] Derivative Progress: 1543/1975 symbols completed. SHCO took 1.2s. Estimated remaining: 3m 1s. Rate: 143.0 symbols/min [2025-10-02T22:44:36.903554] [DEBUG] [MAIN ] SHAK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:36.904454] [INFO ] [MAIN ] SHAK: Generated 1807 derivative records from 49276 primary records. [2025-10-02T22:44:36.904700] [DEBUG] [LOCAL ] SHAK: Saving derivative data. [2025-10-02T22:44:36.921763] [DEBUG] [LOCAL ] SHAK: Derivative data saved (1807 records). [2025-10-02T22:44:36.922011] [INFO ] [MAIN ] SHAK: Successfully saved derivative data. [2025-10-02T22:44:36.924766] [INFO ] [MAIN ] Derivative Progress: 1544/1975 symbols completed. SHAK took 1.3s. Estimated remaining: 3m 1s. Rate: 143.1 symbols/min [2025-10-02T22:44:36.939331] [DEBUG] [MAIN ] SHEL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:36.940061] [INFO ] [MAIN ] SHEL: Generated 1807 derivative records from 54061 primary records. [2025-10-02T22:44:36.940129] [DEBUG] [LOCAL ] SHEL: Saving derivative data. [2025-10-02T22:44:36.956549] [DEBUG] [LOCAL ] SHEL: Derivative data saved (1807 records). [2025-10-02T22:44:36.956635] [INFO ] [MAIN ] SHEL: Successfully saved derivative data. [2025-10-02T22:44:36.958756] [INFO ] [MAIN ] Derivative Progress: 1545/1975 symbols completed. SHEL took 1.2s. Estimated remaining: 3m 0s. Rate: 143.1 symbols/min [2025-10-02T22:44:36.959200] [INFO ] [MAIN ] SHG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:36.959403] [INFO ] [MAIN ] SHOC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:36.959287] [INFO ] [MAIN ] SHO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:36.967333] [DEBUG] [LOCAL ] SHOC: Loaded 3502 existing records from primary storage. [2025-10-02T22:44:36.967480] [INFO ] [MAIN ] SHOC: Loaded 3502 primary data records. [2025-10-02T22:44:37.271696] [DEBUG] [LOCAL ] SHG: Loaded 26756 existing records from primary storage. [2025-10-02T22:44:37.317199] [INFO ] [MAIN ] SHG: Loaded 26756 primary data records. [2025-10-02T22:44:37.429957] [DEBUG] [LOCAL ] SHO: Loaded 50021 existing records from primary storage. [2025-10-02T22:44:37.449936] [INFO ] [MAIN ] SHO: Loaded 50021 primary data records. [2025-10-02T22:44:38.036708] [DEBUG] [MAIN ] SHOC: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-02T22:44:38.037794] [INFO ] [MAIN ] SHOC: Generated 1806 derivative records from 3502 primary records. [2025-10-02T22:44:38.038046] [DEBUG] [LOCAL ] SHOC: Saving derivative data. [2025-10-02T22:44:38.060917] [DEBUG] [LOCAL ] SHOC: Derivative data saved (1806 records). [2025-10-02T22:44:38.061090] [INFO ] [MAIN ] SHOC: Successfully saved derivative data. [2025-10-02T22:44:38.063456] [INFO ] [MAIN ] Derivative Progress: 1546/1975 symbols completed. SHOC took 1.1s. Estimated remaining: 3m 0s. Rate: 143.0 symbols/min [2025-10-02T22:44:38.063857] [INFO ] [MAIN ] SHW: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:38.083120] [DEBUG] [MAIN ] SHG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:38.084018] [INFO ] [MAIN ] SHG: Generated 1807 derivative records from 26756 primary records. [2025-10-02T22:44:38.084185] [DEBUG] [LOCAL ] SHG: Saving derivative data. [2025-10-02T22:44:38.118497] [DEBUG] [MAIN ] SHO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:38.118173] [DEBUG] [LOCAL ] SHG: Derivative data saved (1807 records). [2025-10-02T22:44:38.118769] [INFO ] [MAIN ] SHG: Successfully saved derivative data. [2025-10-02T22:44:38.119447] [INFO ] [MAIN ] SHO: Generated 1807 derivative records from 50021 primary records. [2025-10-02T22:44:38.121568] [DEBUG] [LOCAL ] SHO: Saving derivative data. [2025-10-02T22:44:38.121492] [INFO ] [MAIN ] Derivative Progress: 1547/1975 symbols completed. SHG took 1.2s. Estimated remaining: 2m 59s. Rate: 143.1 symbols/min [2025-10-02T22:44:38.122458] [INFO ] [MAIN ] SID: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:38.154738] [DEBUG] [LOCAL ] SHO: Derivative data saved (1807 records). [2025-10-02T22:44:38.154931] [INFO ] [MAIN ] SHO: Successfully saved derivative data. [2025-10-02T22:44:38.157117] [INFO ] [MAIN ] Derivative Progress: 1548/1975 symbols completed. SHO took 1.2s. Estimated remaining: 2m 59s. Rate: 143.2 symbols/min [2025-10-02T22:44:38.158119] [INFO ] [MAIN ] SIG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:38.177395] [DEBUG] [LOCAL ] SHW: Loaded 50680 existing records from primary storage. [2025-10-02T22:44:38.177582] [INFO ] [MAIN ] SHW: Loaded 50680 primary data records. [2025-10-02T22:44:38.517958] [DEBUG] [LOCAL ] SID: Loaded 42611 existing records from primary storage. [2025-10-02T22:44:38.528319] [INFO ] [MAIN ] SID: Loaded 42611 primary data records. [2025-10-02T22:44:38.613050] [DEBUG] [LOCAL ] SIG: Loaded 46516 existing records from primary storage. [2025-10-02T22:44:38.613871] [INFO ] [MAIN ] SIG: Loaded 46516 primary data records. [2025-10-02T22:44:39.309733] [DEBUG] [MAIN ] SHW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:39.311695] [INFO ] [MAIN ] SHW: Generated 1807 derivative records from 50680 primary records. [2025-10-02T22:44:39.311912] [DEBUG] [LOCAL ] SHW: Saving derivative data. [2025-10-02T22:44:39.335023] [DEBUG] [LOCAL ] SHW: Derivative data saved (1807 records). [2025-10-02T22:44:39.335340] [INFO ] [MAIN ] SHW: Successfully saved derivative data. [2025-10-02T22:44:39.337749] [INFO ] [MAIN ] Derivative Progress: 1549/1975 symbols completed. SHW took 1.3s. Estimated remaining: 2m 59s. Rate: 143.0 symbols/min [2025-10-02T22:44:39.340302] [INFO ] [MAIN ] SII: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:39.366414] [DEBUG] [MAIN ] SID: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:39.372484] [INFO ] [MAIN ] SID: Generated 1807 derivative records from 42611 primary records. [2025-10-02T22:44:39.373112] [DEBUG] [LOCAL ] SID: Saving derivative data. [2025-10-02T22:44:39.372920] [DEBUG] [MAIN ] SIG: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-02T22:44:39.374739] [INFO ] [MAIN ] SIG: Generated 1806 derivative records from 46516 primary records. [2025-10-02T22:44:39.374960] [DEBUG] [LOCAL ] SIG: Saving derivative data. [2025-10-02T22:44:39.420424] [DEBUG] [LOCAL ] SII: Loaded 23725 existing records from primary storage. [2025-10-02T22:44:39.421959] [INFO ] [MAIN ] SII: Loaded 23725 primary data records. [2025-10-02T22:44:39.436757] [DEBUG] [LOCAL ] SID: Derivative data saved (1807 records). [2025-10-02T22:44:39.442174] [INFO ] [MAIN ] SID: Successfully saved derivative data. [2025-10-02T22:44:39.451437] [INFO ] [MAIN ] Derivative Progress: 1550/1975 symbols completed. SID took 1.3s. Estimated remaining: 2m 58s. Rate: 143.1 symbols/min [2025-10-02T22:44:39.476957] [INFO ] [MAIN ] SILA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:39.449171] [DEBUG] [LOCAL ] SIG: Derivative data saved (1806 records). [2025-10-02T22:44:39.490462] [INFO ] [MAIN ] SIG: Successfully saved derivative data. [2025-10-02T22:44:39.493167] [INFO ] [MAIN ] Derivative Progress: 1551/1975 symbols completed. SIG took 1.3s. Estimated remaining: 2m 58s. Rate: 143.1 symbols/min [2025-10-02T22:44:39.502553] [INFO ] [MAIN ] SITC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:39.804008] [DEBUG] [LOCAL ] SILA: Loaded 31038 existing records from primary storage. [2025-10-02T22:44:39.804916] [INFO ] [MAIN ] SILA: Loaded 31038 primary data records. [2025-10-02T22:44:39.805995] [DEBUG] [LOCAL ] SITC: Loaded 41887 existing records from primary storage. [2025-10-02T22:44:39.823691] [INFO ] [MAIN ] SITC: Loaded 41887 primary data records. [2025-10-02T22:44:40.470746] [DEBUG] [MAIN ] SII: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:40.487075] [INFO ] [MAIN ] SII: Generated 1807 derivative records from 23725 primary records. [2025-10-02T22:44:40.487873] [DEBUG] [LOCAL ] SII: Saving derivative data. [2025-10-02T22:44:40.509031] [DEBUG] [LOCAL ] SII: Derivative data saved (1807 records). [2025-10-02T22:44:40.510238] [INFO ] [MAIN ] SII: Successfully saved derivative data. [2025-10-02T22:44:40.513336] [INFO ] [MAIN ] Derivative Progress: 1552/1975 symbols completed. SII took 1.2s. Estimated remaining: 2m 57s. Rate: 143.0 symbols/min [2025-10-02T22:44:40.513761] [INFO ] [MAIN ] SITE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:40.539543] [DEBUG] [MAIN ] SILA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:40.541494] [INFO ] [MAIN ] SILA: Generated 1807 derivative records from 31038 primary records. [2025-10-02T22:44:40.543064] [DEBUG] [LOCAL ] SILA: Saving derivative data. [2025-10-02T22:44:40.579334] [DEBUG] [MAIN ] SITC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:40.580701] [INFO ] [MAIN ] SITC: Generated 1807 derivative records from 41887 primary records. [2025-10-02T22:44:40.581515] [DEBUG] [LOCAL ] SITC: Saving derivative data. [2025-10-02T22:44:40.610024] [DEBUG] [LOCAL ] SITE: Loaded 35303 existing records from primary storage. [2025-10-02T22:44:40.611207] [DEBUG] [LOCAL ] SILA: Derivative data saved (1807 records). [2025-10-02T22:44:40.612785] [INFO ] [MAIN ] SITE: Loaded 35303 primary data records. [2025-10-02T22:44:40.612417] [INFO ] [MAIN ] SILA: Successfully saved derivative data. [2025-10-02T22:44:40.617001] [INFO ] [MAIN ] Derivative Progress: 1553/1975 symbols completed. SILA took 1.1s. Estimated remaining: 2m 57s. Rate: 143.1 symbols/min [2025-10-02T22:44:40.629407] [INFO ] [MAIN ] SJM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:40.629269] [DEBUG] [LOCAL ] SITC: Derivative data saved (1807 records). [2025-10-02T22:44:40.643899] [INFO ] [MAIN ] SITC: Successfully saved derivative data. [2025-10-02T22:44:40.653705] [INFO ] [MAIN ] Derivative Progress: 1554/1975 symbols completed. SITC took 1.2s. Estimated remaining: 2m 56s. Rate: 143.2 symbols/min [2025-10-02T22:44:40.659240] [INFO ] [MAIN ] SJT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:40.946572] [DEBUG] [LOCAL ] SJT: Loaded 22551 existing records from primary storage. [2025-10-02T22:44:40.969282] [INFO ] [MAIN ] SJT: Loaded 22551 primary data records. [2025-10-02T22:44:41.103749] [DEBUG] [LOCAL ] SJM: Loaded 50512 existing records from primary storage. [2025-10-02T22:44:41.119366] [INFO ] [MAIN ] SJM: Loaded 50512 primary data records. [2025-10-02T22:44:41.714148] [DEBUG] [MAIN ] SITE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:41.716425] [INFO ] [MAIN ] SITE: Generated 1807 derivative records from 35303 primary records. [2025-10-02T22:44:41.717029] [DEBUG] [LOCAL ] SITE: Saving derivative data. [2025-10-02T22:44:41.745393] [DEBUG] [LOCAL ] SITE: Derivative data saved (1807 records). [2025-10-02T22:44:41.757113] [INFO ] [MAIN ] SITE: Successfully saved derivative data. [2025-10-02T22:44:41.767573] [DEBUG] [MAIN ] SJT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:41.766973] [INFO ] [MAIN ] Derivative Progress: 1555/1975 symbols completed. SITE took 1.3s. Estimated remaining: 2m 56s. Rate: 143.0 symbols/min [2025-10-02T22:44:41.769119] [INFO ] [MAIN ] SJT: Generated 1807 derivative records from 22551 primary records. [2025-10-02T22:44:41.770021] [DEBUG] [LOCAL ] SJT: Saving derivative data. [2025-10-02T22:44:41.769870] [INFO ] [MAIN ] SKE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:41.796122] [DEBUG] [LOCAL ] SJT: Derivative data saved (1807 records). [2025-10-02T22:44:41.797410] [INFO ] [MAIN ] SJT: Successfully saved derivative data. [2025-10-02T22:44:41.800107] [INFO ] [MAIN ] Derivative Progress: 1556/1975 symbols completed. SJT took 1.1s. Estimated remaining: 2m 56s. Rate: 143.1 symbols/min [2025-10-02T22:44:41.800503] [INFO ] [MAIN ] SKIL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:41.816944] [DEBUG] [MAIN ] SJM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:41.818254] [INFO ] [MAIN ] SJM: Generated 1807 derivative records from 50512 primary records. [2025-10-02T22:44:41.818340] [DEBUG] [LOCAL ] SJM: Saving derivative data. [2025-10-02T22:44:41.842609] [DEBUG] [LOCAL ] SKIL: Loaded 6387 existing records from primary storage. [2025-10-02T22:44:41.846885] [INFO ] [MAIN ] SKIL: Loaded 6387 primary data records. [2025-10-02T22:44:41.942171] [DEBUG] [LOCAL ] SKE: Loaded 36337 existing records from primary storage. [2025-10-02T22:44:41.961981] [INFO ] [MAIN ] SKE: Loaded 36337 primary data records. [2025-10-02T22:44:41.997617] [DEBUG] [LOCAL ] SJM: Derivative data saved (1807 records). [2025-10-02T22:44:42.060167] [INFO ] [MAIN ] SJM: Successfully saved derivative data. [2025-10-02T22:44:42.150770] [INFO ] [MAIN ] Derivative Progress: 1557/1975 symbols completed. SJM took 1.5s. Estimated remaining: 2m 55s. Rate: 143.1 symbols/min [2025-10-02T22:44:42.307484] [INFO ] [MAIN ] SKLZ: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:42.434761] [DEBUG] [LOCAL ] SKLZ: Loaded 11809 existing records from primary storage. [2025-10-02T22:44:42.560613] [INFO ] [MAIN ] SKLZ: Loaded 11809 primary data records. [2025-10-02T22:44:42.928338] [DEBUG] [MAIN ] SKIL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:42.930602] [INFO ] [MAIN ] SKIL: Generated 1807 derivative records from 6387 primary records. [2025-10-02T22:44:42.931695] [DEBUG] [LOCAL ] SKIL: Saving derivative data. [2025-10-02T22:44:42.969557] [DEBUG] [MAIN ] SKE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:42.972347] [INFO ] [MAIN ] SKE: Generated 1807 derivative records from 36337 primary records. [2025-10-02T22:44:42.972490] [DEBUG] [LOCAL ] SKE: Saving derivative data. [2025-10-02T22:44:42.971389] [DEBUG] [LOCAL ] SKIL: Derivative data saved (1807 records). [2025-10-02T22:44:42.982132] [INFO ] [MAIN ] SKIL: Successfully saved derivative data. [2025-10-02T22:44:42.986178] [INFO ] [MAIN ] Derivative Progress: 1558/1975 symbols completed. SKIL took 1.2s. Estimated remaining: 2m 55s. Rate: 143.0 symbols/min [2025-10-02T22:44:42.998831] [DEBUG] [LOCAL ] SKE: Derivative data saved (1807 records). [2025-10-02T22:44:42.999201] [INFO ] [MAIN ] SKE: Successfully saved derivative data. [2025-10-02T22:44:43.001407] [INFO ] [MAIN ] Derivative Progress: 1559/1975 symbols completed. SKE took 1.2s. Estimated remaining: 2m 54s. Rate: 143.1 symbols/min [2025-10-02T22:44:43.014675] [DEBUG] [MAIN ] SKLZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:43.015346] [INFO ] [MAIN ] SKLZ: Generated 1807 derivative records from 11809 primary records. [2025-10-02T22:44:43.015409] [DEBUG] [LOCAL ] SKLZ: Saving derivative data. [2025-10-02T22:44:43.031232] [DEBUG] [LOCAL ] SKLZ: Derivative data saved (1807 records). [2025-10-02T22:44:43.031336] [INFO ] [MAIN ] SKLZ: Successfully saved derivative data. [2025-10-02T22:44:43.033501] [INFO ] [MAIN ] Derivative Progress: 1560/1975 symbols completed. SKLZ took 0.7s. Estimated remaining: 2m 54s. Rate: 143.2 symbols/min [2025-10-02T22:44:43.034158] [INFO ] [MAIN ] SKM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:43.034246] [INFO ] [MAIN ] SKYH: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:43.034380] [INFO ] [MAIN ] SKT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:43.056719] [DEBUG] [LOCAL ] SKYH: Loaded 16683 existing records from primary storage. [2025-10-02T22:44:43.056906] [INFO ] [MAIN ] SKYH: Loaded 16683 primary data records. [2025-10-02T22:44:43.251282] [DEBUG] [LOCAL ] SKT: Loaded 42800 existing records from primary storage. [2025-10-02T22:44:43.244281] [DEBUG] [LOCAL ] SKM: Loaded 35157 existing records from primary storage. [2025-10-02T22:44:43.277093] [INFO ] [MAIN ] SKT: Loaded 42800 primary data records. [2025-10-02T22:44:43.277260] [INFO ] [MAIN ] SKM: Loaded 35157 primary data records. [2025-10-02T22:44:44.194820] [DEBUG] [MAIN ] SKYH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:44.196108] [INFO ] [MAIN ] SKYH: Generated 1807 derivative records from 16683 primary records. [2025-10-02T22:44:44.196363] [DEBUG] [LOCAL ] SKYH: Saving derivative data. [2025-10-02T22:44:44.217182] [DEBUG] [LOCAL ] SKYH: Derivative data saved (1807 records). [2025-10-02T22:44:44.217574] [INFO ] [MAIN ] SKYH: Successfully saved derivative data. [2025-10-02T22:44:44.219909] [INFO ] [MAIN ] Derivative Progress: 1561/1975 symbols completed. SKYH took 1.2s. Estimated remaining: 2m 54s. Rate: 143.0 symbols/min [2025-10-02T22:44:44.222227] [INFO ] [MAIN ] SLB: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:44.240728] [DEBUG] [MAIN ] SKT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:44.247185] [INFO ] [MAIN ] SKT: Generated 1807 derivative records from 42800 primary records. [2025-10-02T22:44:44.256502] [DEBUG] [LOCAL ] SKT: Saving derivative data. [2025-10-02T22:44:44.256409] [DEBUG] [MAIN ] SKM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:44.259093] [INFO ] [MAIN ] SKM: Generated 1807 derivative records from 35157 primary records. [2025-10-02T22:44:44.266716] [DEBUG] [LOCAL ] SKM: Saving derivative data. [2025-10-02T22:44:44.294270] [DEBUG] [LOCAL ] SKM: Derivative data saved (1807 records). [2025-10-02T22:44:44.295692] [INFO ] [MAIN ] SKM: Successfully saved derivative data. [2025-10-02T22:44:44.298303] [INFO ] [MAIN ] Derivative Progress: 1562/1975 symbols completed. SKM took 1.3s. Estimated remaining: 2m 53s. Rate: 143.1 symbols/min [2025-10-02T22:44:44.298582] [INFO ] [MAIN ] SLF: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:44.296126] [DEBUG] [LOCAL ] SKT: Derivative data saved (1807 records). [2025-10-02T22:44:44.299178] [INFO ] [MAIN ] SKT: Successfully saved derivative data. [2025-10-02T22:44:44.301372] [INFO ] [MAIN ] Derivative Progress: 1563/1975 symbols completed. SKT took 1.3s. Estimated remaining: 2m 53s. Rate: 143.2 symbols/min [2025-10-02T22:44:44.301634] [INFO ] [MAIN ] SLG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:44.349187] [DEBUG] [LOCAL ] SLB: Loaded 54087 existing records from primary storage. [2025-10-02T22:44:44.349532] [INFO ] [MAIN ] SLB: Loaded 54087 primary data records. [2025-10-02T22:44:44.488142] [DEBUG] [LOCAL ] SLF: Loaded 38970 existing records from primary storage. [2025-10-02T22:44:44.492955] [INFO ] [MAIN ] SLF: Loaded 38970 primary data records. [2025-10-02T22:44:44.833121] [DEBUG] [LOCAL ] SLG: Loaded 45570 existing records from primary storage. [2025-10-02T22:44:44.847891] [INFO ] [MAIN ] SLG: Loaded 45570 primary data records. [2025-10-02T22:44:45.467399] [DEBUG] [MAIN ] SLB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:45.468450] [INFO ] [MAIN ] SLB: Generated 1807 derivative records from 54087 primary records. [2025-10-02T22:44:45.468898] [DEBUG] [LOCAL ] SLB: Saving derivative data. [2025-10-02T22:44:45.501466] [DEBUG] [MAIN ] SLF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:45.502705] [INFO ] [MAIN ] SLF: Generated 1807 derivative records from 38970 primary records. [2025-10-02T22:44:45.502823] [DEBUG] [LOCAL ] SLF: Saving derivative data. [2025-10-02T22:44:45.537294] [DEBUG] [LOCAL ] SLB: Derivative data saved (1807 records). [2025-10-02T22:44:45.538692] [INFO ] [MAIN ] SLB: Successfully saved derivative data. [2025-10-02T22:44:45.538006] [DEBUG] [MAIN ] SLG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:45.539989] [INFO ] [MAIN ] SLG: Generated 1807 derivative records from 45570 primary records. [2025-10-02T22:44:45.542257] [INFO ] [MAIN ] Derivative Progress: 1564/1975 symbols completed. SLB took 1.3s. Estimated remaining: 2m 52s. Rate: 143.0 symbols/min [2025-10-02T22:44:45.542796] [INFO ] [MAIN ] SLGN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:45.542341] [DEBUG] [LOCAL ] SLG: Saving derivative data. [2025-10-02T22:44:45.557334] [DEBUG] [LOCAL ] SLF: Derivative data saved (1807 records). [2025-10-02T22:44:45.557465] [INFO ] [MAIN ] SLF: Successfully saved derivative data. [2025-10-02T22:44:45.559926] [INFO ] [MAIN ] Derivative Progress: 1565/1975 symbols completed. SLF took 1.3s. Estimated remaining: 2m 52s. Rate: 143.1 symbols/min [2025-10-02T22:44:45.560377] [INFO ] [MAIN ] SLQT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:45.566318] [DEBUG] [LOCAL ] SLG: Derivative data saved (1807 records). [2025-10-02T22:44:45.566518] [INFO ] [MAIN ] SLG: Successfully saved derivative data. [2025-10-02T22:44:45.568958] [INFO ] [MAIN ] Derivative Progress: 1566/1975 symbols completed. SLG took 1.3s. Estimated remaining: 2m 51s. Rate: 143.2 symbols/min [2025-10-02T22:44:45.569328] [INFO ] [MAIN ] SLVM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:45.610317] [DEBUG] [LOCAL ] SLGN: Loaded 40713 existing records from primary storage. [2025-10-02T22:44:45.610611] [INFO ] [MAIN ] SLGN: Loaded 40713 primary data records. [2025-10-02T22:44:45.723229] [DEBUG] [LOCAL ] SLVM: Loaded 28253 existing records from primary storage. [2025-10-02T22:44:45.754734] [INFO ] [MAIN ] SLVM: Loaded 28253 primary data records. [2025-10-02T22:44:45.766051] [DEBUG] [LOCAL ] SLQT: Loaded 43830 existing records from primary storage. [2025-10-02T22:44:45.786832] [INFO ] [MAIN ] SLQT: Loaded 43830 primary data records. [2025-10-02T22:44:46.669297] [DEBUG] [MAIN ] SLGN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:46.670888] [INFO ] [MAIN ] SLGN: Generated 1807 derivative records from 40713 primary records. [2025-10-02T22:44:46.671448] [DEBUG] [LOCAL ] SLGN: Saving derivative data. [2025-10-02T22:44:46.725197] [DEBUG] [LOCAL ] SLGN: Derivative data saved (1807 records). [2025-10-02T22:44:46.725935] [INFO ] [MAIN ] SLGN: Successfully saved derivative data. [2025-10-02T22:44:46.729242] [INFO ] [MAIN ] Derivative Progress: 1567/1975 symbols completed. SLGN took 1.2s. Estimated remaining: 2m 51s. Rate: 143.0 symbols/min [2025-10-02T22:44:46.738778] [DEBUG] [MAIN ] SLVM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:46.744974] [INFO ] [MAIN ] SLVM: Generated 1807 derivative records from 28253 primary records. [2025-10-02T22:44:46.743892] [INFO ] [MAIN ] SM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:46.745393] [DEBUG] [LOCAL ] SLVM: Saving derivative data. [2025-10-02T22:44:46.746782] [DEBUG] [MAIN ] SLQT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:46.748460] [INFO ] [MAIN ] SLQT: Generated 1807 derivative records from 43830 primary records. [2025-10-02T22:44:46.757943] [DEBUG] [LOCAL ] SLQT: Saving derivative data. [2025-10-02T22:44:46.791211] [DEBUG] [LOCAL ] SLVM: Derivative data saved (1807 records). [2025-10-02T22:44:46.792147] [INFO ] [MAIN ] SLVM: Successfully saved derivative data. [2025-10-02T22:44:46.796621] [INFO ] [MAIN ] Derivative Progress: 1568/1975 symbols completed. SLVM took 1.2s. Estimated remaining: 2m 51s. Rate: 143.1 symbols/min [2025-10-02T22:44:46.797767] [INFO ] [MAIN ] SMBK: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:46.800170] [DEBUG] [LOCAL ] SLQT: Derivative data saved (1807 records). [2025-10-02T22:44:46.800328] [INFO ] [MAIN ] SLQT: Successfully saved derivative data. [2025-10-02T22:44:46.802962] [INFO ] [MAIN ] Derivative Progress: 1569/1975 symbols completed. SLQT took 1.2s. Estimated remaining: 2m 50s. Rate: 143.2 symbols/min [2025-10-02T22:44:46.803181] [INFO ] [MAIN ] SMC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:46.839454] [DEBUG] [LOCAL ] SMBK: Loaded 8194 existing records from primary storage. [2025-10-02T22:44:46.839703] [INFO ] [MAIN ] SMBK: Loaded 8194 primary data records. [2025-10-02T22:44:46.872675] [DEBUG] [LOCAL ] SMC: Loaded 11513 existing records from primary storage. [2025-10-02T22:44:46.892637] [INFO ] [MAIN ] SMC: Loaded 11513 primary data records. [2025-10-02T22:44:47.062893] [DEBUG] [LOCAL ] SM: Loaded 52712 existing records from primary storage. [2025-10-02T22:44:47.123800] [INFO ] [MAIN ] SM: Loaded 52712 primary data records. [2025-10-02T22:44:48.164301] [DEBUG] [MAIN ] SMBK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:48.164023] [DEBUG] [MAIN ] SMC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:48.165313] [INFO ] [MAIN ] SMBK: Generated 1807 derivative records from 8194 primary records. [2025-10-02T22:44:48.165448] [DEBUG] [LOCAL ] SMBK: Saving derivative data. [2025-10-02T22:44:48.166420] [INFO ] [MAIN ] SMC: Generated 1807 derivative records from 11513 primary records. [2025-10-02T22:44:48.166904] [DEBUG] [LOCAL ] SMC: Saving derivative data. [2025-10-02T22:44:48.201930] [DEBUG] [LOCAL ] SMBK: Derivative data saved (1807 records). [2025-10-02T22:44:48.203188] [INFO ] [MAIN ] SMBK: Successfully saved derivative data. [2025-10-02T22:44:48.205633] [INFO ] [MAIN ] Derivative Progress: 1570/1975 symbols completed. SMBK took 1.4s. Estimated remaining: 2m 50s. Rate: 143.0 symbols/min [2025-10-02T22:44:48.206263] [INFO ] [MAIN ] SMFG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:48.221498] [DEBUG] [LOCAL ] SMC: Derivative data saved (1807 records). [2025-10-02T22:44:48.221978] [DEBUG] [MAIN ] SM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:48.222131] [INFO ] [MAIN ] SMC: Successfully saved derivative data. [2025-10-02T22:44:48.222860] [INFO ] [MAIN ] SM: Generated 1807 derivative records from 52712 primary records. [2025-10-02T22:44:48.225216] [INFO ] [MAIN ] Derivative Progress: 1571/1975 symbols completed. SMC took 1.4s. Estimated remaining: 2m 49s. Rate: 143.1 symbols/min [2025-10-02T22:44:48.225528] [INFO ] [MAIN ] SMG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:48.225606] [DEBUG] [LOCAL ] SM: Saving derivative data. [2025-10-02T22:44:48.244889] [DEBUG] [LOCAL ] SM: Derivative data saved (1807 records). [2025-10-02T22:44:48.245043] [INFO ] [MAIN ] SM: Successfully saved derivative data. [2025-10-02T22:44:48.248247] [INFO ] [MAIN ] Derivative Progress: 1572/1975 symbols completed. SM took 1.5s. Estimated remaining: 2m 49s. Rate: 143.1 symbols/min [2025-10-02T22:44:48.248517] [INFO ] [MAIN ] SMHI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:48.283427] [DEBUG] [LOCAL ] SMHI: Loaded 13233 existing records from primary storage. [2025-10-02T22:44:48.283568] [INFO ] [MAIN ] SMHI: Loaded 13233 primary data records. [2025-10-02T22:44:48.405308] [DEBUG] [LOCAL ] SMFG: Loaded 48480 existing records from primary storage. [2025-10-02T22:44:48.424292] [INFO ] [MAIN ] SMFG: Loaded 48480 primary data records. [2025-10-02T22:44:48.424192] [DEBUG] [LOCAL ] SMG: Loaded 43987 existing records from primary storage. [2025-10-02T22:44:48.424626] [INFO ] [MAIN ] SMG: Loaded 43987 primary data records. [2025-10-02T22:44:49.317424] [DEBUG] [MAIN ] SMHI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:49.318289] [INFO ] [MAIN ] SMHI: Generated 1807 derivative records from 13233 primary records. [2025-10-02T22:44:49.318550] [DEBUG] [LOCAL ] SMHI: Saving derivative data. [2025-10-02T22:44:49.365147] [DEBUG] [MAIN ] SMFG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:49.366854] [DEBUG] [LOCAL ] SMHI: Derivative data saved (1807 records). [2025-10-02T22:44:49.364868] [DEBUG] [MAIN ] SMG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:49.366970] [INFO ] [MAIN ] SMHI: Successfully saved derivative data. [2025-10-02T22:44:49.366354] [INFO ] [MAIN ] SMFG: Generated 1807 derivative records from 48480 primary records. [2025-10-02T22:44:49.369086] [INFO ] [MAIN ] Derivative Progress: 1573/1975 symbols completed. SMHI took 1.1s. Estimated remaining: 2m 49s. Rate: 143.0 symbols/min [2025-10-02T22:44:49.370216] [DEBUG] [LOCAL ] SMFG: Saving derivative data. [2025-10-02T22:44:49.369991] [INFO ] [MAIN ] SMG: Generated 1807 derivative records from 43987 primary records. [2025-10-02T22:44:49.371418] [DEBUG] [LOCAL ] SMG: Saving derivative data. [2025-10-02T22:44:49.405076] [DEBUG] [LOCAL ] SMG: Derivative data saved (1807 records). [2025-10-02T22:44:49.404800] [DEBUG] [LOCAL ] SMFG: Derivative data saved (1807 records). [2025-10-02T22:44:49.405252] [INFO ] [MAIN ] SMG: Successfully saved derivative data. [2025-10-02T22:44:49.405332] [INFO ] [MAIN ] SMFG: Successfully saved derivative data. [2025-10-02T22:44:49.407523] [INFO ] [MAIN ] Derivative Progress: 1574/1975 symbols completed. SMG took 1.2s. Estimated remaining: 2m 48s. Rate: 143.1 symbols/min [2025-10-02T22:44:49.410022] [INFO ] [MAIN ] Derivative Progress: 1575/1975 symbols completed. SMFG took 1.2s. Estimated remaining: 2m 48s. Rate: 143.2 symbols/min [2025-10-02T22:44:49.410485] [INFO ] [MAIN ] SMR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:49.410676] [INFO ] [MAIN ] SMWB: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:49.410550] [INFO ] [MAIN ] SMRT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:49.450549] [DEBUG] [LOCAL ] SMWB: Loaded 32631 existing records from primary storage. [2025-10-02T22:44:49.450847] [INFO ] [MAIN ] SMWB: Loaded 32631 primary data records. [2025-10-02T22:44:49.654215] [DEBUG] [LOCAL ] SMRT: Loaded 44172 existing records from primary storage. [2025-10-02T22:44:49.813757] [INFO ] [MAIN ] SMRT: Loaded 44172 primary data records. [2025-10-02T22:44:49.819780] [DEBUG] [LOCAL ] SMR: Loaded 54187 existing records from primary storage. [2025-10-02T22:44:49.852761] [INFO ] [MAIN ] SMR: Loaded 54187 primary data records. [2025-10-02T22:44:50.544793] [DEBUG] [MAIN ] SMWB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:50.546013] [INFO ] [MAIN ] SMWB: Generated 1807 derivative records from 32631 primary records. [2025-10-02T22:44:50.546342] [DEBUG] [LOCAL ] SMWB: Saving derivative data. [2025-10-02T22:44:50.569945] [DEBUG] [LOCAL ] SMWB: Derivative data saved (1807 records). [2025-10-02T22:44:50.570989] [INFO ] [MAIN ] SMWB: Successfully saved derivative data. [2025-10-02T22:44:50.573407] [INFO ] [MAIN ] Derivative Progress: 1576/1975 symbols completed. SMWB took 1.2s. Estimated remaining: 2m 47s. Rate: 143.0 symbols/min [2025-10-02T22:44:50.574757] [INFO ] [MAIN ] SN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:50.589550] [DEBUG] [MAIN ] SMRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:50.590335] [INFO ] [MAIN ] SMRT: Generated 1807 derivative records from 44172 primary records. [2025-10-02T22:44:50.590542] [DEBUG] [LOCAL ] SMRT: Saving derivative data. [2025-10-02T22:44:50.617244] [DEBUG] [MAIN ] SMR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:50.618840] [INFO ] [MAIN ] SMR: Generated 1807 derivative records from 54187 primary records. [2025-10-02T22:44:50.619510] [DEBUG] [LOCAL ] SMR: Saving derivative data. [2025-10-02T22:44:50.638033] [DEBUG] [LOCAL ] SMRT: Derivative data saved (1807 records). [2025-10-02T22:44:50.638955] [INFO ] [MAIN ] SMRT: Successfully saved derivative data. [2025-10-02T22:44:50.641170] [INFO ] [MAIN ] Derivative Progress: 1577/1975 symbols completed. SMRT took 1.2s. Estimated remaining: 2m 47s. Rate: 143.1 symbols/min [2025-10-02T22:44:50.641575] [INFO ] [MAIN ] SNA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:50.647087] [DEBUG] [LOCAL ] SMR: Derivative data saved (1807 records). [2025-10-02T22:44:50.647241] [INFO ] [MAIN ] SMR: Successfully saved derivative data. [2025-10-02T22:44:50.649515] [INFO ] [MAIN ] Derivative Progress: 1578/1975 symbols completed. SMR took 1.2s. Estimated remaining: 2m 46s. Rate: 143.2 symbols/min [2025-10-02T22:44:50.649827] [INFO ] [MAIN ] SNAP: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:50.685122] [DEBUG] [LOCAL ] SNA: Loaded 26059 existing records from primary storage. [2025-10-02T22:44:50.685314] [INFO ] [MAIN ] SNA: Loaded 26059 primary data records. [2025-10-02T22:44:50.815955] [DEBUG] [LOCAL ] SN: Loaded 50121 existing records from primary storage. [2025-10-02T22:44:50.861661] [INFO ] [MAIN ] SN: Loaded 50121 primary data records. [2025-10-02T22:44:51.137388] [DEBUG] [LOCAL ] SNAP: Loaded 54186 existing records from primary storage. [2025-10-02T22:44:51.163383] [INFO ] [MAIN ] SNAP: Loaded 54186 primary data records. [2025-10-02T22:44:51.754789] [DEBUG] [MAIN ] SNA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:51.756241] [INFO ] [MAIN ] SNA: Generated 1807 derivative records from 26059 primary records. [2025-10-02T22:44:51.756604] [DEBUG] [LOCAL ] SNA: Saving derivative data. [2025-10-02T22:44:51.780351] [DEBUG] [LOCAL ] SNA: Derivative data saved (1807 records). [2025-10-02T22:44:51.781012] [INFO ] [MAIN ] SNA: Successfully saved derivative data. [2025-10-02T22:44:51.783187] [INFO ] [MAIN ] Derivative Progress: 1579/1975 symbols completed. SNA took 1.1s. Estimated remaining: 2m 46s. Rate: 143.0 symbols/min [2025-10-02T22:44:51.796190] [INFO ] [MAIN ] SNDA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:51.799074] [DEBUG] [MAIN ] SN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:51.800375] [INFO ] [MAIN ] SN: Generated 1807 derivative records from 50121 primary records. [2025-10-02T22:44:51.800632] [DEBUG] [LOCAL ] SN: Saving derivative data. [2025-10-02T22:44:51.826965] [DEBUG] [MAIN ] SNAP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:51.829773] [INFO ] [MAIN ] SNAP: Generated 1807 derivative records from 54186 primary records. [2025-10-02T22:44:51.830103] [DEBUG] [LOCAL ] SNAP: Saving derivative data. [2025-10-02T22:44:51.844609] [DEBUG] [LOCAL ] SNDA: Loaded 4544 existing records from primary storage. [2025-10-02T22:44:51.848202] [INFO ] [MAIN ] SNDA: Loaded 4544 primary data records. [2025-10-02T22:44:51.913974] [DEBUG] [LOCAL ] SN: Derivative data saved (1807 records). [2025-10-02T22:44:51.929344] [INFO ] [MAIN ] SN: Successfully saved derivative data. [2025-10-02T22:44:51.950232] [INFO ] [MAIN ] Derivative Progress: 1580/1975 symbols completed. SN took 1.4s. Estimated remaining: 2m 46s. Rate: 143.1 symbols/min [2025-10-02T22:44:51.962712] [INFO ] [MAIN ] SNDR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:51.963273] [DEBUG] [LOCAL ] SNAP: Derivative data saved (1807 records). [2025-10-02T22:44:51.968855] [INFO ] [MAIN ] SNAP: Successfully saved derivative data. [2025-10-02T22:44:51.974051] [INFO ] [MAIN ] Derivative Progress: 1581/1975 symbols completed. SNAP took 1.3s. Estimated remaining: 2m 45s. Rate: 143.2 symbols/min [2025-10-02T22:44:51.988717] [INFO ] [MAIN ] SNN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:52.260432] [DEBUG] [LOCAL ] SNDR: Loaded 41042 existing records from primary storage. [2025-10-02T22:44:52.260904] [INFO ] [MAIN ] SNDR: Loaded 41042 primary data records. [2025-10-02T22:44:52.407709] [DEBUG] [MAIN ] SNDA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:52.428292] [DEBUG] [LOCAL ] SNN: Loaded 44528 existing records from primary storage. [2025-10-02T22:44:52.427109] [INFO ] [MAIN ] SNDA: Generated 1807 derivative records from 4544 primary records. [2025-10-02T22:44:52.428847] [DEBUG] [LOCAL ] SNDA: Saving derivative data. [2025-10-02T22:44:52.434740] [INFO ] [MAIN ] SNN: Loaded 44528 primary data records. [2025-10-02T22:44:52.795690] [DEBUG] [LOCAL ] SNDA: Derivative data saved (1807 records). [2025-10-02T22:44:52.796251] [INFO ] [MAIN ] SNDA: Successfully saved derivative data. [2025-10-02T22:44:52.803814] [INFO ] [MAIN ] Derivative Progress: 1582/1975 symbols completed. SNDA took 1.0s. Estimated remaining: 2m 45s. Rate: 143.1 symbols/min [2025-10-02T22:44:52.852367] [INFO ] [MAIN ] SNOW: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:53.002271] [DEBUG] [MAIN ] SNDR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:53.003070] [INFO ] [MAIN ] SNDR: Generated 1807 derivative records from 41042 primary records. [2025-10-02T22:44:53.003274] [DEBUG] [LOCAL ] SNDR: Saving derivative data. [2025-10-02T22:44:53.024850] [DEBUG] [LOCAL ] SNDR: Derivative data saved (1807 records). [2025-10-02T22:44:53.051068] [INFO ] [MAIN ] SNDR: Successfully saved derivative data. [2025-10-02T22:44:53.052078] [DEBUG] [MAIN ] SNN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:53.055025] [INFO ] [MAIN ] Derivative Progress: 1583/1975 symbols completed. SNDR took 1.1s. Estimated remaining: 2m 44s. Rate: 143.1 symbols/min [2025-10-02T22:44:53.055207] [INFO ] [MAIN ] SNX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:53.052926] [INFO ] [MAIN ] SNN: Generated 1807 derivative records from 44528 primary records. [2025-10-02T22:44:53.055813] [DEBUG] [LOCAL ] SNN: Saving derivative data. [2025-10-02T22:44:53.090179] [DEBUG] [LOCAL ] SNOW: Loaded 53981 existing records from primary storage. [2025-10-02T22:44:53.091101] [DEBUG] [LOCAL ] SNN: Derivative data saved (1807 records). [2025-10-02T22:44:53.091222] [INFO ] [MAIN ] SNN: Successfully saved derivative data. [2025-10-02T22:44:53.091352] [INFO ] [MAIN ] SNOW: Loaded 53981 primary data records. [2025-10-02T22:44:53.095513] [INFO ] [MAIN ] Derivative Progress: 1584/1975 symbols completed. SNN took 1.1s. Estimated remaining: 2m 44s. Rate: 143.2 symbols/min [2025-10-02T22:44:53.095871] [INFO ] [MAIN ] SO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:53.453832] [DEBUG] [LOCAL ] SNX: Loaded 40326 existing records from primary storage. [2025-10-02T22:44:53.454357] [INFO ] [MAIN ] SNX: Loaded 40326 primary data records. [2025-10-02T22:44:53.606553] [DEBUG] [LOCAL ] SO: Loaded 53996 existing records from primary storage. [2025-10-02T22:44:53.624566] [INFO ] [MAIN ] SO: Loaded 53996 primary data records. [2025-10-02T22:44:54.024893] [DEBUG] [MAIN ] SNOW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:54.044585] [INFO ] [MAIN ] SNOW: Generated 1807 derivative records from 53981 primary records. [2025-10-02T22:44:54.071252] [DEBUG] [LOCAL ] SNOW: Saving derivative data. [2025-10-02T22:44:54.231729] [DEBUG] [LOCAL ] SNOW: Derivative data saved (1807 records). [2025-10-02T22:44:54.232300] [DEBUG] [MAIN ] SNX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:54.233547] [INFO ] [MAIN ] SNX: Generated 1807 derivative records from 40326 primary records. [2025-10-02T22:44:54.232725] [INFO ] [MAIN ] SNOW: Successfully saved derivative data. [2025-10-02T22:44:54.235888] [DEBUG] [LOCAL ] SNX: Saving derivative data. [2025-10-02T22:44:54.235809] [INFO ] [MAIN ] Derivative Progress: 1585/1975 symbols completed. SNOW took 1.4s. Estimated remaining: 2m 44s. Rate: 143.0 symbols/min [2025-10-02T22:44:54.237987] [INFO ] [MAIN ] SOBO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:54.256366] [DEBUG] [LOCAL ] SNX: Derivative data saved (1807 records). [2025-10-02T22:44:54.256587] [INFO ] [MAIN ] SNX: Successfully saved derivative data. [2025-10-02T22:44:54.263033] [INFO ] [MAIN ] Derivative Progress: 1586/1975 symbols completed. SNX took 1.2s. Estimated remaining: 2m 43s. Rate: 143.1 symbols/min [2025-10-02T22:44:54.264078] [INFO ] [MAIN ] SOC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:54.278816] [DEBUG] [MAIN ] SO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:54.279634] [INFO ] [MAIN ] SO: Generated 1807 derivative records from 53996 primary records. [2025-10-02T22:44:54.279766] [DEBUG] [LOCAL ] SO: Saving derivative data. [2025-10-02T22:44:54.298765] [DEBUG] [LOCAL ] SO: Derivative data saved (1807 records). [2025-10-02T22:44:54.308701] [INFO ] [MAIN ] SO: Successfully saved derivative data. [2025-10-02T22:44:54.311270] [INFO ] [MAIN ] Derivative Progress: 1587/1975 symbols completed. SO took 1.2s. Estimated remaining: 2m 43s. Rate: 143.2 symbols/min [2025-10-02T22:44:54.311607] [INFO ] [MAIN ] SOJC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:54.329822] [DEBUG] [LOCAL ] SOBO: Loaded 39774 existing records from primary storage. [2025-10-02T22:44:54.330159] [INFO ] [MAIN ] SOBO: Loaded 39774 primary data records. [2025-10-02T22:44:54.350206] [DEBUG] [LOCAL ] SOJC: Loaded 5063 existing records from primary storage. [2025-10-02T22:44:54.396165] [INFO ] [MAIN ] SOJC: Loaded 5063 primary data records. [2025-10-02T22:44:54.636215] [DEBUG] [LOCAL ] SOC: Loaded 50819 existing records from primary storage. [2025-10-02T22:44:54.661121] [INFO ] [MAIN ] SOC: Loaded 50819 primary data records. [2025-10-02T22:44:55.419586] [DEBUG] [MAIN ] SOBO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:55.420899] [INFO ] [MAIN ] SOBO: Generated 1807 derivative records from 39774 primary records. [2025-10-02T22:44:55.433756] [DEBUG] [LOCAL ] SOBO: Saving derivative data. [2025-10-02T22:44:55.435073] [DEBUG] [MAIN ] SOJC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:55.435904] [INFO ] [MAIN ] SOJC: Generated 1807 derivative records from 5063 primary records. [2025-10-02T22:44:55.436326] [DEBUG] [LOCAL ] SOJC: Saving derivative data. [2025-10-02T22:44:55.470094] [DEBUG] [LOCAL ] SOJC: Derivative data saved (1807 records). [2025-10-02T22:44:55.483767] [DEBUG] [LOCAL ] SOBO: Derivative data saved (1807 records). [2025-10-02T22:44:55.484035] [INFO ] [MAIN ] SOJC: Successfully saved derivative data. [2025-10-02T22:44:55.486382] [INFO ] [MAIN ] Derivative Progress: 1588/1975 symbols completed. SOJC took 1.2s. Estimated remaining: 2m 42s. Rate: 143.0 symbols/min [2025-10-02T22:44:55.486934] [DEBUG] [MAIN ] SOC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:55.486461] [INFO ] [MAIN ] SOBO: Successfully saved derivative data. [2025-10-02T22:44:55.489320] [INFO ] [MAIN ] Derivative Progress: 1589/1975 symbols completed. SOBO took 1.3s. Estimated remaining: 2m 42s. Rate: 143.1 symbols/min [2025-10-02T22:44:55.490170] [INFO ] [MAIN ] SOC: Generated 1807 derivative records from 50819 primary records. [2025-10-02T22:44:55.490262] [DEBUG] [LOCAL ] SOC: Saving derivative data. [2025-10-02T22:44:55.507164] [DEBUG] [LOCAL ] SOC: Derivative data saved (1807 records). [2025-10-02T22:44:55.507249] [INFO ] [MAIN ] SOC: Successfully saved derivative data. [2025-10-02T22:44:55.509300] [INFO ] [MAIN ] Derivative Progress: 1590/1975 symbols completed. SOC took 1.2s. Estimated remaining: 2m 41s. Rate: 143.2 symbols/min [2025-10-02T22:44:55.509766] [INFO ] [MAIN ] SOL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:55.509710] [INFO ] [MAIN ] SOJD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:55.510195] [INFO ] [MAIN ] SOJE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:55.529532] [DEBUG] [LOCAL ] SOJE: Loaded 9416 existing records from primary storage. [2025-10-02T22:44:55.529702] [INFO ] [MAIN ] SOJE: Loaded 9416 primary data records. [2025-10-02T22:44:55.598080] [DEBUG] [LOCAL ] SOJD: Loaded 13201 existing records from primary storage. [2025-10-02T22:44:55.620564] [INFO ] [MAIN ] SOJD: Loaded 13201 primary data records. [2025-10-02T22:44:55.620490] [DEBUG] [LOCAL ] SOL: Loaded 13400 existing records from primary storage. [2025-10-02T22:44:55.697548] [INFO ] [MAIN ] SOL: Loaded 13400 primary data records. [2025-10-02T22:44:56.610376] [DEBUG] [MAIN ] SOJE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:56.612884] [INFO ] [MAIN ] SOJE: Generated 1807 derivative records from 9416 primary records. [2025-10-02T22:44:56.615307] [DEBUG] [LOCAL ] SOJE: Saving derivative data. [2025-10-02T22:44:56.643735] [DEBUG] [MAIN ] SOJD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:56.645602] [INFO ] [MAIN ] SOJD: Generated 1807 derivative records from 13201 primary records. [2025-10-02T22:44:56.647955] [DEBUG] [LOCAL ] SOJD: Saving derivative data. [2025-10-02T22:44:56.660870] [DEBUG] [LOCAL ] SOJE: Derivative data saved (1807 records). [2025-10-02T22:44:56.679269] [DEBUG] [MAIN ] SOL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:56.678585] [INFO ] [MAIN ] SOJE: Successfully saved derivative data. [2025-10-02T22:44:56.681566] [INFO ] [MAIN ] SOL: Generated 1807 derivative records from 13400 primary records. [2025-10-02T22:44:56.684189] [INFO ] [MAIN ] Derivative Progress: 1591/1975 symbols completed. SOJE took 1.2s. Estimated remaining: 2m 41s. Rate: 143.0 symbols/min [2025-10-02T22:44:56.685192] [INFO ] [MAIN ] SOLV: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:56.685486] [DEBUG] [LOCAL ] SOL: Saving derivative data. [2025-10-02T22:44:56.703062] [DEBUG] [LOCAL ] SOJD: Derivative data saved (1807 records). [2025-10-02T22:44:56.703210] [INFO ] [MAIN ] SOJD: Successfully saved derivative data. [2025-10-02T22:44:56.705867] [INFO ] [MAIN ] Derivative Progress: 1592/1975 symbols completed. SOJD took 1.2s. Estimated remaining: 2m 41s. Rate: 143.1 symbols/min [2025-10-02T22:44:56.707201] [INFO ] [MAIN ] SON: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:56.712974] [DEBUG] [LOCAL ] SOL: Derivative data saved (1807 records). [2025-10-02T22:44:56.713138] [INFO ] [MAIN ] SOL: Successfully saved derivative data. [2025-10-02T22:44:56.715413] [INFO ] [MAIN ] Derivative Progress: 1593/1975 symbols completed. SOL took 1.2s. Estimated remaining: 2m 40s. Rate: 143.2 symbols/min [2025-10-02T22:44:56.715724] [INFO ] [MAIN ] SONY: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:56.767061] [DEBUG] [LOCAL ] SOLV: Loaded 44279 existing records from primary storage. [2025-10-02T22:44:56.767801] [INFO ] [MAIN ] SOLV: Loaded 44279 primary data records. [2025-10-02T22:44:56.833824] [DEBUG] [LOCAL ] SON: Loaded 43387 existing records from primary storage. [2025-10-02T22:44:56.839328] [INFO ] [MAIN ] SON: Loaded 43387 primary data records. [2025-10-02T22:44:57.130287] [DEBUG] [LOCAL ] SONY: Loaded 53748 existing records from primary storage. [2025-10-02T22:44:57.173890] [INFO ] [MAIN ] SONY: Loaded 53748 primary data records. [2025-10-02T22:44:57.862979] [DEBUG] [MAIN ] SOLV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:57.865031] [INFO ] [MAIN ] SOLV: Generated 1807 derivative records from 44279 primary records. [2025-10-02T22:44:57.865218] [DEBUG] [LOCAL ] SOLV: Saving derivative data. [2025-10-02T22:44:57.905512] [DEBUG] [MAIN ] SON: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:57.907041] [DEBUG] [LOCAL ] SOLV: Derivative data saved (1807 records). [2025-10-02T22:44:57.908081] [INFO ] [MAIN ] SON: Generated 1807 derivative records from 43387 primary records. [2025-10-02T22:44:57.909047] [INFO ] [MAIN ] SOLV: Successfully saved derivative data. [2025-10-02T22:44:57.909343] [DEBUG] [LOCAL ] SON: Saving derivative data. [2025-10-02T22:44:57.912180] [INFO ] [MAIN ] Derivative Progress: 1594/1975 symbols completed. SOLV took 1.2s. Estimated remaining: 2m 40s. Rate: 143.1 symbols/min [2025-10-02T22:44:57.913446] [INFO ] [MAIN ] SOR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:57.937496] [DEBUG] [LOCAL ] SOR: Loaded 2885 existing records from primary storage. [2025-10-02T22:44:57.938573] [INFO ] [MAIN ] SOR: Loaded 2885 primary data records. [2025-10-02T22:44:58.010332] [DEBUG] [LOCAL ] SON: Derivative data saved (1807 records). [2025-10-02T22:44:58.015744] [INFO ] [MAIN ] SON: Successfully saved derivative data. [2025-10-02T22:44:58.018449] [INFO ] [MAIN ] Derivative Progress: 1595/1975 symbols completed. SON took 1.3s. Estimated remaining: 2m 39s. Rate: 143.1 symbols/min [2025-10-02T22:44:58.020762] [INFO ] [MAIN ] SOS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:58.021690] [DEBUG] [MAIN ] SONY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:58.057696] [INFO ] [MAIN ] SONY: Generated 1807 derivative records from 53748 primary records. [2025-10-02T22:44:58.070617] [DEBUG] [LOCAL ] SONY: Saving derivative data. [2025-10-02T22:44:58.149824] [DEBUG] [LOCAL ] SOS: Loaded 8803 existing records from primary storage. [2025-10-02T22:44:58.188524] [INFO ] [MAIN ] SOS: Loaded 8803 primary data records. [2025-10-02T22:44:58.395398] [DEBUG] [LOCAL ] SONY: Derivative data saved (1807 records). [2025-10-02T22:44:58.422953] [INFO ] [MAIN ] SONY: Successfully saved derivative data. [2025-10-02T22:44:58.450097] [INFO ] [MAIN ] Derivative Progress: 1596/1975 symbols completed. SONY took 1.7s. Estimated remaining: 2m 39s. Rate: 143.1 symbols/min [2025-10-02T22:44:58.451080] [INFO ] [MAIN ] SPB: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:58.750054] [DEBUG] [MAIN ] SOR: Filtered 6966 bins outside market hours, 7764 incomplete bins [2025-10-02T22:44:58.752580] [INFO ] [MAIN ] SOR: Generated 1802 derivative records from 2885 primary records. [2025-10-02T22:44:58.752807] [DEBUG] [LOCAL ] SOR: Saving derivative data. [2025-10-02T22:44:58.753823] [DEBUG] [LOCAL ] SPB: Loaded 34265 existing records from primary storage. [2025-10-02T22:44:58.754623] [INFO ] [MAIN ] SPB: Loaded 34265 primary data records. [2025-10-02T22:44:58.855381] [DEBUG] [LOCAL ] SOR: Derivative data saved (1802 records). [2025-10-02T22:44:58.890313] [INFO ] [MAIN ] SOR: Successfully saved derivative data. [2025-10-02T22:44:58.896250] [INFO ] [MAIN ] Derivative Progress: 1597/1975 symbols completed. SOR took 1.0s. Estimated remaining: 2m 38s. Rate: 143.1 symbols/min [2025-10-02T22:44:58.896531] [INFO ] [MAIN ] SPCE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:58.937549] [DEBUG] [MAIN ] SOS: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-02T22:44:58.970613] [INFO ] [MAIN ] SOS: Generated 1806 derivative records from 8803 primary records. [2025-10-02T22:44:59.108910] [DEBUG] [LOCAL ] SOS: Saving derivative data. [2025-10-02T22:44:59.156968] [DEBUG] [LOCAL ] SOS: Derivative data saved (1806 records). [2025-10-02T22:44:59.157670] [INFO ] [MAIN ] SOS: Successfully saved derivative data. [2025-10-02T22:44:59.161219] [INFO ] [MAIN ] Derivative Progress: 1598/1975 symbols completed. SOS took 1.1s. Estimated remaining: 2m 38s. Rate: 143.1 symbols/min [2025-10-02T22:44:59.161738] [INFO ] [MAIN ] SPE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:59.184734] [DEBUG] [LOCAL ] SPCE: Loaded 50307 existing records from primary storage. [2025-10-02T22:44:59.186510] [INFO ] [MAIN ] SPCE: Loaded 50307 primary data records. [2025-10-02T22:44:59.201773] [DEBUG] [LOCAL ] SPE: Loaded 6374 existing records from primary storage. [2025-10-02T22:44:59.211731] [INFO ] [MAIN ] SPE: Loaded 6374 primary data records. [2025-10-02T22:44:59.360417] [DEBUG] [MAIN ] SPB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:59.426733] [INFO ] [MAIN ] SPB: Generated 1807 derivative records from 34265 primary records. [2025-10-02T22:44:59.458634] [DEBUG] [LOCAL ] SPB: Saving derivative data. [2025-10-02T22:44:59.871301] [DEBUG] [LOCAL ] SPB: Derivative data saved (1807 records). [2025-10-02T22:44:59.871611] [INFO ] [MAIN ] SPB: Successfully saved derivative data. [2025-10-02T22:44:59.873949] [INFO ] [MAIN ] Derivative Progress: 1599/1975 symbols completed. SPB took 1.4s. Estimated remaining: 2m 38s. Rate: 143.1 symbols/min [2025-10-02T22:44:59.874393] [INFO ] [MAIN ] SPG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:59.908709] [DEBUG] [MAIN ] SPCE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:59.922082] [INFO ] [MAIN ] SPCE: Generated 1807 derivative records from 50307 primary records. [2025-10-02T22:44:59.922482] [DEBUG] [LOCAL ] SPCE: Saving derivative data. [2025-10-02T22:44:59.923586] [DEBUG] [MAIN ] SPE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:44:59.924264] [INFO ] [MAIN ] SPE: Generated 1807 derivative records from 6374 primary records. [2025-10-02T22:44:59.932382] [DEBUG] [LOCAL ] SPE: Saving derivative data. [2025-10-02T22:44:59.970742] [DEBUG] [LOCAL ] SPCE: Derivative data saved (1807 records). [2025-10-02T22:44:59.971390] [INFO ] [MAIN ] SPCE: Successfully saved derivative data. [2025-10-02T22:44:59.974045] [INFO ] [MAIN ] Derivative Progress: 1600/1975 symbols completed. SPCE took 1.1s. Estimated remaining: 2m 37s. Rate: 143.2 symbols/min [2025-10-02T22:44:59.988006] [DEBUG] [LOCAL ] SPE: Derivative data saved (1807 records). [2025-10-02T22:44:59.988280] [INFO ] [MAIN ] SPGI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:59.988157] [INFO ] [MAIN ] SPE: Successfully saved derivative data. [2025-10-02T22:44:59.992923] [INFO ] [MAIN ] Derivative Progress: 1601/1975 symbols completed. SPE took 0.8s. Estimated remaining: 2m 37s. Rate: 143.2 symbols/min [2025-10-02T22:44:59.993253] [INFO ] [MAIN ] SPH: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:44:59.995011] [DEBUG] [LOCAL ] SPG: Loaded 50648 existing records from primary storage. [2025-10-02T22:44:59.995327] [INFO ] [MAIN ] SPG: Loaded 50648 primary data records. [2025-10-02T22:45:00.153007] [DEBUG] [LOCAL ] SPH: Loaded 17585 existing records from primary storage. [2025-10-02T22:45:00.177761] [INFO ] [MAIN ] SPH: Loaded 17585 primary data records. [2025-10-02T22:45:00.519009] [DEBUG] [LOCAL ] SPGI: Loaded 46117 existing records from primary storage. [2025-10-02T22:45:00.571510] [INFO ] [MAIN ] SPGI: Loaded 46117 primary data records. [2025-10-02T22:45:01.099075] [DEBUG] [MAIN ] SPG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:01.101203] [INFO ] [MAIN ] SPG: Generated 1807 derivative records from 50648 primary records. [2025-10-02T22:45:01.101594] [DEBUG] [LOCAL ] SPG: Saving derivative data. [2025-10-02T22:45:01.123114] [DEBUG] [LOCAL ] SPG: Derivative data saved (1807 records). [2025-10-02T22:45:01.124011] [INFO ] [MAIN ] SPG: Successfully saved derivative data. [2025-10-02T22:45:01.127970] [INFO ] [MAIN ] Derivative Progress: 1602/1975 symbols completed. SPG took 1.3s. Estimated remaining: 2m 36s. Rate: 143.1 symbols/min [2025-10-02T22:45:01.130823] [INFO ] [MAIN ] SPHR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:01.145788] [DEBUG] [MAIN ] SPH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:01.147005] [INFO ] [MAIN ] SPH: Generated 1807 derivative records from 17585 primary records. [2025-10-02T22:45:01.147358] [DEBUG] [LOCAL ] SPH: Saving derivative data. [2025-10-02T22:45:01.193873] [DEBUG] [LOCAL ] SPH: Derivative data saved (1807 records). [2025-10-02T22:45:01.194171] [INFO ] [MAIN ] SPH: Successfully saved derivative data. [2025-10-02T22:45:01.193161] [DEBUG] [MAIN ] SPGI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:01.195187] [INFO ] [MAIN ] SPGI: Generated 1807 derivative records from 46117 primary records. [2025-10-02T22:45:01.198411] [INFO ] [MAIN ] Derivative Progress: 1603/1975 symbols completed. SPH took 1.2s. Estimated remaining: 2m 36s. Rate: 143.2 symbols/min [2025-10-02T22:45:01.198581] [DEBUG] [LOCAL ] SPGI: Saving derivative data. [2025-10-02T22:45:01.224446] [DEBUG] [LOCAL ] SPHR: Loaded 40384 existing records from primary storage. [2025-10-02T22:45:01.224793] [INFO ] [MAIN ] SPHR: Loaded 40384 primary data records. [2025-10-02T22:45:01.358615] [DEBUG] [LOCAL ] SPGI: Derivative data saved (1807 records). [2025-10-02T22:45:01.379767] [INFO ] [MAIN ] SPGI: Successfully saved derivative data. [2025-10-02T22:45:01.392134] [INFO ] [MAIN ] Derivative Progress: 1604/1975 symbols completed. SPGI took 1.4s. Estimated remaining: 2m 35s. Rate: 143.2 symbols/min [2025-10-02T22:45:01.551162] [DEBUG] [MAIN ] SPHR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:01.551994] [INFO ] [MAIN ] SPHR: Generated 1807 derivative records from 40384 primary records. [2025-10-02T22:45:01.552068] [DEBUG] [LOCAL ] SPHR: Saving derivative data. [2025-10-02T22:45:01.568256] [DEBUG] [LOCAL ] SPHR: Derivative data saved (1807 records). [2025-10-02T22:45:01.568321] [INFO ] [MAIN ] SPHR: Successfully saved derivative data. [2025-10-02T22:45:01.570928] [INFO ] [MAIN ] Derivative Progress: 1605/1975 symbols completed. SPHR took 0.4s. Estimated remaining: 2m 35s. Rate: 143.3 symbols/min [2025-10-02T22:45:01.571798] [INFO ] [MAIN ] SPNT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:01.571719] [INFO ] [MAIN ] SPIR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:01.571909] [INFO ] [MAIN ] SPMC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:01.583104] [DEBUG] [LOCAL ] SPMC: Loaded 5419 existing records from primary storage. [2025-10-02T22:45:01.583352] [INFO ] [MAIN ] SPMC: Loaded 5419 primary data records. [2025-10-02T22:45:01.785599] [DEBUG] [LOCAL ] SPNT: Loaded 35084 existing records from primary storage. [2025-10-02T22:45:01.839768] [DEBUG] [LOCAL ] SPIR: Loaded 37398 existing records from primary storage. [2025-10-02T22:45:01.838832] [INFO ] [MAIN ] SPNT: Loaded 35084 primary data records. [2025-10-02T22:45:01.960858] [INFO ] [MAIN ] SPIR: Loaded 37398 primary data records. [2025-10-02T22:45:02.669727] [DEBUG] [MAIN ] SPMC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:02.671591] [INFO ] [MAIN ] SPMC: Generated 1807 derivative records from 5419 primary records. [2025-10-02T22:45:02.672820] [DEBUG] [LOCAL ] SPMC: Saving derivative data. [2025-10-02T22:45:02.695713] [DEBUG] [LOCAL ] SPMC: Derivative data saved (1807 records). [2025-10-02T22:45:02.696802] [INFO ] [MAIN ] SPMC: Successfully saved derivative data. [2025-10-02T22:45:02.700211] [INFO ] [MAIN ] Derivative Progress: 1606/1975 symbols completed. SPMC took 1.1s. Estimated remaining: 2m 35s. Rate: 143.1 symbols/min [2025-10-02T22:45:02.701158] [INFO ] [MAIN ] SPOT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:02.721420] [DEBUG] [MAIN ] SPIR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:02.722535] [INFO ] [MAIN ] SPIR: Generated 1807 derivative records from 37398 primary records. [2025-10-02T22:45:02.722687] [DEBUG] [LOCAL ] SPIR: Saving derivative data. [2025-10-02T22:45:02.756410] [DEBUG] [MAIN ] SPNT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:02.760849] [DEBUG] [LOCAL ] SPIR: Derivative data saved (1807 records). [2025-10-02T22:45:02.761457] [INFO ] [MAIN ] SPIR: Successfully saved derivative data. [2025-10-02T22:45:02.764677] [INFO ] [MAIN ] Derivative Progress: 1607/1975 symbols completed. SPIR took 1.2s. Estimated remaining: 2m 34s. Rate: 143.2 symbols/min [2025-10-02T22:45:02.766145] [INFO ] [MAIN ] SPNT: Generated 1807 derivative records from 35084 primary records. [2025-10-02T22:45:02.766583] [INFO ] [MAIN ] SPR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:02.766899] [DEBUG] [LOCAL ] SPNT: Saving derivative data. [2025-10-02T22:45:02.801091] [DEBUG] [LOCAL ] SPNT: Derivative data saved (1807 records). [2025-10-02T22:45:02.801435] [INFO ] [MAIN ] SPNT: Successfully saved derivative data. [2025-10-02T22:45:02.804840] [INFO ] [MAIN ] Derivative Progress: 1608/1975 symbols completed. SPNT took 1.2s. Estimated remaining: 2m 34s. Rate: 143.3 symbols/min [2025-10-02T22:45:02.805289] [INFO ] [MAIN ] SPRU: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:02.825532] [DEBUG] [LOCAL ] SPOT: Loaded 50918 existing records from primary storage. [2025-10-02T22:45:02.829289] [INFO ] [MAIN ] SPOT: Loaded 50918 primary data records. [2025-10-02T22:45:02.931129] [DEBUG] [LOCAL ] SPRU: Loaded 9208 existing records from primary storage. [2025-10-02T22:45:02.949545] [INFO ] [MAIN ] SPRU: Loaded 9208 primary data records. [2025-10-02T22:45:03.076123] [DEBUG] [LOCAL ] SPR: Loaded 41503 existing records from primary storage. [2025-10-02T22:45:03.274532] [INFO ] [MAIN ] SPR: Loaded 41503 primary data records. [2025-10-02T22:45:03.901991] [DEBUG] [MAIN ] SPOT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:03.903239] [INFO ] [MAIN ] SPOT: Generated 1807 derivative records from 50918 primary records. [2025-10-02T22:45:03.903504] [DEBUG] [LOCAL ] SPOT: Saving derivative data. [2025-10-02T22:45:03.921780] [DEBUG] [LOCAL ] SPOT: Derivative data saved (1807 records). [2025-10-02T22:45:03.922003] [INFO ] [MAIN ] SPOT: Successfully saved derivative data. [2025-10-02T22:45:03.924580] [INFO ] [MAIN ] Derivative Progress: 1609/1975 symbols completed. SPOT took 1.2s. Estimated remaining: 2m 33s. Rate: 143.1 symbols/min [2025-10-02T22:45:03.925147] [INFO ] [MAIN ] SPXC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:03.945343] [DEBUG] [MAIN ] SPRU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:03.959728] [INFO ] [MAIN ] SPRU: Generated 1807 derivative records from 9208 primary records. [2025-10-02T22:45:03.959967] [DEBUG] [LOCAL ] SPRU: Saving derivative data. [2025-10-02T22:45:03.961212] [DEBUG] [MAIN ] SPR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:03.962983] [INFO ] [MAIN ] SPR: Generated 1807 derivative records from 41503 primary records. [2025-10-02T22:45:03.975551] [DEBUG] [LOCAL ] SPR: Saving derivative data. [2025-10-02T22:45:03.985706] [DEBUG] [LOCAL ] SPRU: Derivative data saved (1807 records). [2025-10-02T22:45:03.994069] [INFO ] [MAIN ] SPRU: Successfully saved derivative data. [2025-10-02T22:45:04.004125] [INFO ] [MAIN ] Derivative Progress: 1610/1975 symbols completed. SPRU took 1.2s. Estimated remaining: 2m 33s. Rate: 143.2 symbols/min [2025-10-02T22:45:04.013675] [DEBUG] [LOCAL ] SPXC: Loaded 23572 existing records from primary storage. [2025-10-02T22:45:04.017004] [INFO ] [MAIN ] SPXX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:04.017267] [INFO ] [MAIN ] SPXC: Loaded 23572 primary data records. [2025-10-02T22:45:04.069863] [DEBUG] [LOCAL ] SPR: Derivative data saved (1807 records). [2025-10-02T22:45:04.075292] [INFO ] [MAIN ] SPR: Successfully saved derivative data. [2025-10-02T22:45:04.077619] [INFO ] [MAIN ] Derivative Progress: 1611/1975 symbols completed. SPR took 1.3s. Estimated remaining: 2m 32s. Rate: 143.3 symbols/min [2025-10-02T22:45:04.112309] [INFO ] [MAIN ] SQM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:04.149041] [DEBUG] [LOCAL ] SPXX: Loaded 9234 existing records from primary storage. [2025-10-02T22:45:04.160146] [INFO ] [MAIN ] SPXX: Loaded 9234 primary data records. [2025-10-02T22:45:04.580087] [DEBUG] [LOCAL ] SQM: Loaded 48970 existing records from primary storage. [2025-10-02T22:45:04.618888] [INFO ] [MAIN ] SQM: Loaded 48970 primary data records. [2025-10-02T22:45:05.149526] [DEBUG] [MAIN ] SPXC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:05.150523] [INFO ] [MAIN ] SPXC: Generated 1807 derivative records from 23572 primary records. [2025-10-02T22:45:05.151010] [DEBUG] [LOCAL ] SPXC: Saving derivative data. [2025-10-02T22:45:05.173811] [DEBUG] [LOCAL ] SPXC: Derivative data saved (1807 records). [2025-10-02T22:45:05.174203] [INFO ] [MAIN ] SPXC: Successfully saved derivative data. [2025-10-02T22:45:05.176374] [INFO ] [MAIN ] Derivative Progress: 1612/1975 symbols completed. SPXC took 1.3s. Estimated remaining: 2m 32s. Rate: 143.1 symbols/min [2025-10-02T22:45:05.176803] [INFO ] [MAIN ] SQNS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:05.193609] [DEBUG] [MAIN ] SPXX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:05.194918] [INFO ] [MAIN ] SPXX: Generated 1807 derivative records from 9234 primary records. [2025-10-02T22:45:05.195100] [DEBUG] [LOCAL ] SPXX: Saving derivative data. [2025-10-02T22:45:05.214358] [DEBUG] [LOCAL ] SPXX: Derivative data saved (1807 records). [2025-10-02T22:45:05.214979] [INFO ] [MAIN ] SPXX: Successfully saved derivative data. [2025-10-02T22:45:05.217993] [INFO ] [MAIN ] Derivative Progress: 1613/1975 symbols completed. SPXX took 1.2s. Estimated remaining: 2m 32s. Rate: 143.2 symbols/min [2025-10-02T22:45:05.228714] [INFO ] [MAIN ] SR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:05.246475] [DEBUG] [MAIN ] SQM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:05.257855] [DEBUG] [LOCAL ] SQNS: Loaded 26511 existing records from primary storage. [2025-10-02T22:45:05.257147] [INFO ] [MAIN ] SQM: Generated 1807 derivative records from 48970 primary records. [2025-10-02T22:45:05.258194] [DEBUG] [LOCAL ] SQM: Saving derivative data. [2025-10-02T22:45:05.258702] [INFO ] [MAIN ] SQNS: Loaded 26511 primary data records. [2025-10-02T22:45:05.409980] [DEBUG] [LOCAL ] SQM: Derivative data saved (1807 records). [2025-10-02T22:45:05.415182] [INFO ] [MAIN ] SQM: Successfully saved derivative data. [2025-10-02T22:45:05.430914] [INFO ] [MAIN ] Derivative Progress: 1614/1975 symbols completed. SQM took 1.3s. Estimated remaining: 2m 31s. Rate: 143.2 symbols/min [2025-10-02T22:45:05.469430] [INFO ] [MAIN ] SRE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:05.648795] [DEBUG] [LOCAL ] SR: Loaded 33043 existing records from primary storage. [2025-10-02T22:45:05.649909] [INFO ] [MAIN ] SR: Loaded 33043 primary data records. [2025-10-02T22:45:06.032117] [DEBUG] [LOCAL ] SRE: Loaded 53812 existing records from primary storage. [2025-10-02T22:45:06.037542] [INFO ] [MAIN ] SRE: Loaded 53812 primary data records. [2025-10-02T22:45:06.038296] [DEBUG] [MAIN ] SQNS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:06.044430] [INFO ] [MAIN ] SQNS: Generated 1807 derivative records from 26511 primary records. [2025-10-02T22:45:06.045098] [DEBUG] [LOCAL ] SQNS: Saving derivative data. [2025-10-02T22:45:06.136518] [DEBUG] [LOCAL ] SQNS: Derivative data saved (1807 records). [2025-10-02T22:45:06.136958] [INFO ] [MAIN ] SQNS: Successfully saved derivative data. [2025-10-02T22:45:06.147105] [INFO ] [MAIN ] Derivative Progress: 1615/1975 symbols completed. SQNS took 1.0s. Estimated remaining: 2m 31s. Rate: 143.2 symbols/min [2025-10-02T22:45:06.152474] [INFO ] [MAIN ] SREA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:06.406740] [DEBUG] [LOCAL ] SREA: Loaded 10481 existing records from primary storage. [2025-10-02T22:45:06.407218] [INFO ] [MAIN ] SREA: Loaded 10481 primary data records. [2025-10-02T22:45:06.426972] [DEBUG] [MAIN ] SR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:06.470406] [INFO ] [MAIN ] SR: Generated 1807 derivative records from 33043 primary records. [2025-10-02T22:45:06.484177] [DEBUG] [LOCAL ] SR: Saving derivative data. [2025-10-02T22:45:06.777087] [DEBUG] [LOCAL ] SR: Derivative data saved (1807 records). [2025-10-02T22:45:06.777564] [INFO ] [MAIN ] SR: Successfully saved derivative data. [2025-10-02T22:45:06.780709] [INFO ] [MAIN ] Derivative Progress: 1616/1975 symbols completed. SR took 1.6s. Estimated remaining: 2m 30s. Rate: 143.1 symbols/min [2025-10-02T22:45:06.781066] [INFO ] [MAIN ] SRFM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:06.802996] [DEBUG] [MAIN ] SRE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:06.803932] [INFO ] [MAIN ] SRE: Generated 1807 derivative records from 53812 primary records. [2025-10-02T22:45:06.805352] [DEBUG] [LOCAL ] SRE: Saving derivative data. [2025-10-02T22:45:06.836854] [DEBUG] [LOCAL ] SRE: Derivative data saved (1807 records). [2025-10-02T22:45:06.837193] [INFO ] [MAIN ] SRE: Successfully saved derivative data. [2025-10-02T22:45:06.840224] [INFO ] [MAIN ] Derivative Progress: 1617/1975 symbols completed. SRE took 1.4s. Estimated remaining: 2m 30s. Rate: 143.2 symbols/min [2025-10-02T22:45:06.841060] [INFO ] [MAIN ] SRG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:06.872599] [DEBUG] [MAIN ] SREA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:06.873574] [DEBUG] [LOCAL ] SRFM: Loaded 37139 existing records from primary storage. [2025-10-02T22:45:06.873734] [INFO ] [MAIN ] SRFM: Loaded 37139 primary data records. [2025-10-02T22:45:06.880957] [INFO ] [MAIN ] SREA: Generated 1807 derivative records from 10481 primary records. [2025-10-02T22:45:06.892438] [DEBUG] [LOCAL ] SREA: Saving derivative data. [2025-10-02T22:45:06.995990] [DEBUG] [LOCAL ] SRG: Loaded 15591 existing records from primary storage. [2025-10-02T22:45:07.003774] [INFO ] [MAIN ] SRG: Loaded 15591 primary data records. [2025-10-02T22:45:07.031960] [DEBUG] [LOCAL ] SREA: Derivative data saved (1807 records). [2025-10-02T22:45:07.060670] [INFO ] [MAIN ] SREA: Successfully saved derivative data. [2025-10-02T22:45:07.081289] [INFO ] [MAIN ] Derivative Progress: 1618/1975 symbols completed. SREA took 0.9s. Estimated remaining: 2m 30s. Rate: 143.2 symbols/min [2025-10-02T22:45:07.697133] [DEBUG] [MAIN ] SRFM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:07.698205] [INFO ] [MAIN ] SRFM: Generated 1807 derivative records from 37139 primary records. [2025-10-02T22:45:07.698286] [DEBUG] [LOCAL ] SRFM: Saving derivative data. [2025-10-02T22:45:07.731128] [DEBUG] [LOCAL ] SRFM: Derivative data saved (1807 records). [2025-10-02T22:45:07.731029] [DEBUG] [MAIN ] SRG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:07.731275] [INFO ] [MAIN ] SRFM: Successfully saved derivative data. [2025-10-02T22:45:07.732052] [INFO ] [MAIN ] SRG: Generated 1807 derivative records from 15591 primary records. [2025-10-02T22:45:07.732139] [DEBUG] [LOCAL ] SRG: Saving derivative data. [2025-10-02T22:45:07.734570] [INFO ] [MAIN ] Derivative Progress: 1619/1975 symbols completed. SRFM took 1.0s. Estimated remaining: 2m 29s. Rate: 143.2 symbols/min [2025-10-02T22:45:07.751026] [DEBUG] [LOCAL ] SRG: Derivative data saved (1807 records). [2025-10-02T22:45:07.751133] [INFO ] [MAIN ] SRG: Successfully saved derivative data. [2025-10-02T22:45:07.753439] [INFO ] [MAIN ] Derivative Progress: 1620/1975 symbols completed. SRG took 0.9s. Estimated remaining: 2m 29s. Rate: 143.3 symbols/min [2025-10-02T22:45:07.754141] [INFO ] [MAIN ] SRV: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:07.754005] [INFO ] [MAIN ] SRI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:07.755318] [INFO ] [MAIN ] SSB: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:07.765977] [DEBUG] [LOCAL ] SRV: Loaded 7423 existing records from primary storage. [2025-10-02T22:45:07.766341] [INFO ] [MAIN ] SRV: Loaded 7423 primary data records. [2025-10-02T22:45:07.904235] [DEBUG] [LOCAL ] SRI: Loaded 27284 existing records from primary storage. [2025-10-02T22:45:07.917504] [INFO ] [MAIN ] SRI: Loaded 27284 primary data records. [2025-10-02T22:45:08.255072] [DEBUG] [LOCAL ] SSB: Loaded 42929 existing records from primary storage. [2025-10-02T22:45:08.260975] [INFO ] [MAIN ] SSB: Loaded 42929 primary data records. [2025-10-02T22:45:08.877545] [DEBUG] [MAIN ] SRV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:08.879526] [INFO ] [MAIN ] SRV: Generated 1807 derivative records from 7423 primary records. [2025-10-02T22:45:08.880784] [DEBUG] [LOCAL ] SRV: Saving derivative data. [2025-10-02T22:45:08.898134] [DEBUG] [MAIN ] SRI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:08.917126] [DEBUG] [LOCAL ] SRV: Derivative data saved (1807 records). [2025-10-02T22:45:08.917534] [INFO ] [MAIN ] SRV: Successfully saved derivative data. [2025-10-02T22:45:08.920016] [INFO ] [MAIN ] Derivative Progress: 1621/1975 symbols completed. SRV took 1.2s. Estimated remaining: 2m 28s. Rate: 143.1 symbols/min [2025-10-02T22:45:08.913672] [INFO ] [MAIN ] SRI: Generated 1807 derivative records from 27284 primary records. [2025-10-02T22:45:08.920584] [INFO ] [MAIN ] SSD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:08.920312] [DEBUG] [LOCAL ] SRI: Saving derivative data. [2025-10-02T22:45:08.962129] [DEBUG] [LOCAL ] SRI: Derivative data saved (1807 records). [2025-10-02T22:45:08.968141] [INFO ] [MAIN ] SRI: Successfully saved derivative data. [2025-10-02T22:45:08.968517] [DEBUG] [MAIN ] SSB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:08.971312] [INFO ] [MAIN ] Derivative Progress: 1622/1975 symbols completed. SRI took 1.2s. Estimated remaining: 2m 28s. Rate: 143.2 symbols/min [2025-10-02T22:45:08.972472] [INFO ] [MAIN ] SSB: Generated 1807 derivative records from 42929 primary records. [2025-10-02T22:45:08.973035] [DEBUG] [LOCAL ] SSB: Saving derivative data. [2025-10-02T22:45:08.972909] [INFO ] [MAIN ] SSL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:08.998795] [DEBUG] [LOCAL ] SSD: Loaded 22599 existing records from primary storage. [2025-10-02T22:45:08.999550] [INFO ] [MAIN ] SSD: Loaded 22599 primary data records. [2025-10-02T22:45:09.099932] [DEBUG] [LOCAL ] SSB: Derivative data saved (1807 records). [2025-10-02T22:45:09.130964] [INFO ] [MAIN ] SSB: Successfully saved derivative data. [2025-10-02T22:45:09.134723] [INFO ] [MAIN ] Derivative Progress: 1623/1975 symbols completed. SSB took 1.4s. Estimated remaining: 2m 27s. Rate: 143.3 symbols/min [2025-10-02T22:45:09.152095] [INFO ] [MAIN ] SST: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:09.378743] [DEBUG] [LOCAL ] SSL: Loaded 41452 existing records from primary storage. [2025-10-02T22:45:09.388157] [INFO ] [MAIN ] SSL: Loaded 41452 primary data records. [2025-10-02T22:45:09.436874] [DEBUG] [LOCAL ] SST: Loaded 11918 existing records from primary storage. [2025-10-02T22:45:09.461386] [INFO ] [MAIN ] SST: Loaded 11918 primary data records. [2025-10-02T22:45:10.153067] [DEBUG] [MAIN ] SSD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:10.154499] [INFO ] [MAIN ] SSD: Generated 1807 derivative records from 22599 primary records. [2025-10-02T22:45:10.156043] [DEBUG] [LOCAL ] SSD: Saving derivative data. [2025-10-02T22:45:10.179104] [DEBUG] [LOCAL ] SSD: Derivative data saved (1807 records). [2025-10-02T22:45:10.179982] [INFO ] [MAIN ] SSD: Successfully saved derivative data. [2025-10-02T22:45:10.182507] [INFO ] [MAIN ] Derivative Progress: 1624/1975 symbols completed. SSD took 1.3s. Estimated remaining: 2m 27s. Rate: 143.1 symbols/min [2025-10-02T22:45:10.182909] [INFO ] [MAIN ] SSTK: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:10.203714] [DEBUG] [MAIN ] SSL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:10.204888] [INFO ] [MAIN ] SSL: Generated 1807 derivative records from 41452 primary records. [2025-10-02T22:45:10.205197] [DEBUG] [LOCAL ] SSL: Saving derivative data. [2025-10-02T22:45:10.255339] [DEBUG] [MAIN ] SST: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:10.257923] [INFO ] [MAIN ] SST: Generated 1807 derivative records from 11918 primary records. [2025-10-02T22:45:10.258028] [DEBUG] [LOCAL ] SST: Saving derivative data. [2025-10-02T22:45:10.256780] [DEBUG] [LOCAL ] SSTK: Loaded 26120 existing records from primary storage. [2025-10-02T22:45:10.259086] [DEBUG] [LOCAL ] SSL: Derivative data saved (1807 records). [2025-10-02T22:45:10.260290] [INFO ] [MAIN ] SSL: Successfully saved derivative data. [2025-10-02T22:45:10.259968] [INFO ] [MAIN ] SSTK: Loaded 26120 primary data records. [2025-10-02T22:45:10.269602] [INFO ] [MAIN ] Derivative Progress: 1625/1975 symbols completed. SSL took 1.3s. Estimated remaining: 2m 27s. Rate: 143.2 symbols/min [2025-10-02T22:45:10.279330] [INFO ] [MAIN ] ST: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:10.295215] [DEBUG] [LOCAL ] SST: Derivative data saved (1807 records). [2025-10-02T22:45:10.295412] [INFO ] [MAIN ] SST: Successfully saved derivative data. [2025-10-02T22:45:10.315104] [INFO ] [MAIN ] Derivative Progress: 1626/1975 symbols completed. SST took 1.2s. Estimated remaining: 2m 26s. Rate: 143.3 symbols/min [2025-10-02T22:45:10.320772] [INFO ] [MAIN ] STAG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:10.702120] [DEBUG] [LOCAL ] ST: Loaded 50112 existing records from primary storage. [2025-10-02T22:45:10.702596] [INFO ] [MAIN ] ST: Loaded 50112 primary data records. [2025-10-02T22:45:10.716985] [DEBUG] [LOCAL ] STAG: Loaded 50438 existing records from primary storage. [2025-10-02T22:45:10.777823] [INFO ] [MAIN ] STAG: Loaded 50438 primary data records. [2025-10-02T22:45:11.401073] [DEBUG] [MAIN ] SSTK: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-02T22:45:11.403009] [INFO ] [MAIN ] SSTK: Generated 1806 derivative records from 26120 primary records. [2025-10-02T22:45:11.404215] [DEBUG] [LOCAL ] SSTK: Saving derivative data. [2025-10-02T22:45:11.428461] [DEBUG] [LOCAL ] SSTK: Derivative data saved (1806 records). [2025-10-02T22:45:11.430154] [INFO ] [MAIN ] SSTK: Successfully saved derivative data. [2025-10-02T22:45:11.432973] [INFO ] [MAIN ] Derivative Progress: 1627/1975 symbols completed. SSTK took 1.3s. Estimated remaining: 2m 26s. Rate: 143.1 symbols/min [2025-10-02T22:45:11.433482] [INFO ] [MAIN ] STC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:11.455947] [DEBUG] [MAIN ] ST: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:11.471362] [INFO ] [MAIN ] ST: Generated 1807 derivative records from 50112 primary records. [2025-10-02T22:45:11.477674] [DEBUG] [MAIN ] STAG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:11.478993] [INFO ] [MAIN ] STAG: Generated 1807 derivative records from 50438 primary records. [2025-10-02T22:45:11.477908] [DEBUG] [LOCAL ] ST: Saving derivative data. [2025-10-02T22:45:11.479254] [DEBUG] [LOCAL ] STAG: Saving derivative data. [2025-10-02T22:45:11.528002] [DEBUG] [LOCAL ] STC: Loaded 17550 existing records from primary storage. [2025-10-02T22:45:11.530940] [INFO ] [MAIN ] STC: Loaded 17550 primary data records. [2025-10-02T22:45:11.530463] [DEBUG] [LOCAL ] ST: Derivative data saved (1807 records). [2025-10-02T22:45:11.532731] [INFO ] [MAIN ] ST: Successfully saved derivative data. [2025-10-02T22:45:11.532384] [DEBUG] [LOCAL ] STAG: Derivative data saved (1807 records). [2025-10-02T22:45:11.548889] [INFO ] [MAIN ] Derivative Progress: 1628/1975 symbols completed. ST took 1.3s. Estimated remaining: 2m 25s. Rate: 143.2 symbols/min [2025-10-02T22:45:11.576115] [INFO ] [MAIN ] STAG: Successfully saved derivative data. [2025-10-02T22:45:11.593155] [INFO ] [MAIN ] STE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:11.611045] [INFO ] [MAIN ] Derivative Progress: 1629/1975 symbols completed. STAG took 1.3s. Estimated remaining: 2m 25s. Rate: 143.3 symbols/min [2025-10-02T22:45:11.622118] [INFO ] [MAIN ] STEL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:11.959896] [DEBUG] [LOCAL ] STEL: Loaded 23316 existing records from primary storage. [2025-10-02T22:45:11.960226] [INFO ] [MAIN ] STEL: Loaded 23316 primary data records. [2025-10-02T22:45:11.962091] [DEBUG] [LOCAL ] STE: Loaded 35569 existing records from primary storage. [2025-10-02T22:45:11.997300] [INFO ] [MAIN ] STE: Loaded 35569 primary data records. [2025-10-02T22:45:12.661288] [DEBUG] [MAIN ] STC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:12.662201] [INFO ] [MAIN ] STC: Generated 1807 derivative records from 17550 primary records. [2025-10-02T22:45:12.662504] [DEBUG] [LOCAL ] STC: Saving derivative data. [2025-10-02T22:45:12.687016] [DEBUG] [LOCAL ] STC: Derivative data saved (1807 records). [2025-10-02T22:45:12.687464] [INFO ] [MAIN ] STC: Successfully saved derivative data. [2025-10-02T22:45:12.690461] [INFO ] [MAIN ] Derivative Progress: 1630/1975 symbols completed. STC took 1.3s. Estimated remaining: 2m 25s. Rate: 143.1 symbols/min [2025-10-02T22:45:12.691503] [INFO ] [MAIN ] STEM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:12.707299] [DEBUG] [MAIN ] STEL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:12.708392] [INFO ] [MAIN ] STEL: Generated 1807 derivative records from 23316 primary records. [2025-10-02T22:45:12.708637] [DEBUG] [LOCAL ] STEL: Saving derivative data. [2025-10-02T22:45:12.754783] [DEBUG] [LOCAL ] STEL: Derivative data saved (1807 records). [2025-10-02T22:45:12.745256] [DEBUG] [MAIN ] STE: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-02T22:45:12.755052] [INFO ] [MAIN ] STEL: Successfully saved derivative data. [2025-10-02T22:45:12.757585] [INFO ] [MAIN ] Derivative Progress: 1631/1975 symbols completed. STEL took 1.1s. Estimated remaining: 2m 24s. Rate: 143.2 symbols/min [2025-10-02T22:45:12.758922] [INFO ] [MAIN ] STEW: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:12.758732] [INFO ] [MAIN ] STE: Generated 1806 derivative records from 35569 primary records. [2025-10-02T22:45:12.759486] [DEBUG] [LOCAL ] STE: Saving derivative data. [2025-10-02T22:45:12.790983] [DEBUG] [LOCAL ] STE: Derivative data saved (1806 records). [2025-10-02T22:45:12.791766] [DEBUG] [LOCAL ] STEM: Loaded 39628 existing records from primary storage. [2025-10-02T22:45:12.792183] [INFO ] [MAIN ] STE: Successfully saved derivative data. [2025-10-02T22:45:12.792309] [INFO ] [MAIN ] STEM: Loaded 39628 primary data records. [2025-10-02T22:45:12.795675] [INFO ] [MAIN ] Derivative Progress: 1632/1975 symbols completed. STE took 1.2s. Estimated remaining: 2m 24s. Rate: 143.3 symbols/min [2025-10-02T22:45:12.795997] [INFO ] [MAIN ] STK: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:12.910313] [DEBUG] [LOCAL ] STEW: Loaded 16227 existing records from primary storage. [2025-10-02T22:45:12.926087] [INFO ] [MAIN ] STEW: Loaded 16227 primary data records. [2025-10-02T22:45:12.959205] [DEBUG] [LOCAL ] STK: Loaded 9467 existing records from primary storage. [2025-10-02T22:45:12.991926] [INFO ] [MAIN ] STK: Loaded 9467 primary data records. [2025-10-02T22:45:13.903091] [DEBUG] [MAIN ] STEM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:13.904473] [INFO ] [MAIN ] STEM: Generated 1807 derivative records from 39628 primary records. [2025-10-02T22:45:13.918949] [DEBUG] [MAIN ] STEW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:13.919920] [INFO ] [MAIN ] STEW: Generated 1807 derivative records from 16227 primary records. [2025-10-02T22:45:13.917678] [DEBUG] [LOCAL ] STEM: Saving derivative data. [2025-10-02T22:45:13.920435] [DEBUG] [LOCAL ] STEW: Saving derivative data. [2025-10-02T22:45:13.942194] [DEBUG] [LOCAL ] STEM: Derivative data saved (1807 records). [2025-10-02T22:45:13.958603] [INFO ] [MAIN ] STEM: Successfully saved derivative data. [2025-10-02T22:45:13.968427] [INFO ] [MAIN ] Derivative Progress: 1633/1975 symbols completed. STEM took 1.3s. Estimated remaining: 2m 23s. Rate: 143.1 symbols/min [2025-10-02T22:45:13.969790] [DEBUG] [MAIN ] STK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:13.972014] [INFO ] [MAIN ] STK: Generated 1807 derivative records from 9467 primary records. [2025-10-02T22:45:13.972357] [DEBUG] [LOCAL ] STK: Saving derivative data. [2025-10-02T22:45:13.983385] [DEBUG] [LOCAL ] STEW: Derivative data saved (1807 records). [2025-10-02T22:45:13.990534] [INFO ] [MAIN ] STEW: Successfully saved derivative data. [2025-10-02T22:45:13.994523] [INFO ] [MAIN ] Derivative Progress: 1634/1975 symbols completed. STEW took 1.2s. Estimated remaining: 2m 23s. Rate: 143.2 symbols/min [2025-10-02T22:45:13.991933] [DEBUG] [LOCAL ] STK: Derivative data saved (1807 records). [2025-10-02T22:45:13.994850] [INFO ] [MAIN ] STK: Successfully saved derivative data. [2025-10-02T22:45:13.997089] [INFO ] [MAIN ] Derivative Progress: 1635/1975 symbols completed. STK took 1.2s. Estimated remaining: 2m 22s. Rate: 143.3 symbols/min [2025-10-02T22:45:13.997754] [INFO ] [MAIN ] STLA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:13.997899] [INFO ] [MAIN ] STM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:13.998612] [INFO ] [MAIN ] STN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:14.025974] [DEBUG] [LOCAL ] STN: Loaded 22995 existing records from primary storage. [2025-10-02T22:45:14.026154] [INFO ] [MAIN ] STN: Loaded 22995 primary data records. [2025-10-02T22:45:14.417010] [DEBUG] [LOCAL ] STM: Loaded 53968 existing records from primary storage. [2025-10-02T22:45:14.418505] [DEBUG] [LOCAL ] STLA: Loaded 53933 existing records from primary storage. [2025-10-02T22:45:14.419839] [INFO ] [MAIN ] STLA: Loaded 53933 primary data records. [2025-10-02T22:45:14.420076] [INFO ] [MAIN ] STM: Loaded 53968 primary data records. [2025-10-02T22:45:15.130669] [DEBUG] [MAIN ] STN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:15.132855] [INFO ] [MAIN ] STN: Generated 1807 derivative records from 22995 primary records. [2025-10-02T22:45:15.132979] [DEBUG] [LOCAL ] STN: Saving derivative data. [2025-10-02T22:45:15.161773] [DEBUG] [LOCAL ] STN: Derivative data saved (1807 records). [2025-10-02T22:45:15.162243] [INFO ] [MAIN ] STN: Successfully saved derivative data. [2025-10-02T22:45:15.165387] [INFO ] [MAIN ] Derivative Progress: 1636/1975 symbols completed. STN took 1.2s. Estimated remaining: 2m 22s. Rate: 143.1 symbols/min [2025-10-02T22:45:15.165727] [INFO ] [MAIN ] STNG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:15.202217] [DEBUG] [MAIN ] STM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:15.204030] [INFO ] [MAIN ] STM: Generated 1807 derivative records from 53968 primary records. [2025-10-02T22:45:15.204242] [DEBUG] [LOCAL ] STM: Saving derivative data. [2025-10-02T22:45:15.203089] [DEBUG] [MAIN ] STLA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:15.205778] [INFO ] [MAIN ] STLA: Generated 1807 derivative records from 53933 primary records. [2025-10-02T22:45:15.206306] [DEBUG] [LOCAL ] STLA: Saving derivative data. [2025-10-02T22:45:15.250632] [DEBUG] [LOCAL ] STM: Derivative data saved (1807 records). [2025-10-02T22:45:15.251444] [INFO ] [MAIN ] STM: Successfully saved derivative data. [2025-10-02T22:45:15.253704] [INFO ] [MAIN ] Derivative Progress: 1637/1975 symbols completed. STM took 1.3s. Estimated remaining: 2m 22s. Rate: 143.2 symbols/min [2025-10-02T22:45:15.254367] [INFO ] [MAIN ] STRV: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:15.255782] [DEBUG] [LOCAL ] STLA: Derivative data saved (1807 records). [2025-10-02T22:45:15.256140] [INFO ] [MAIN ] STLA: Successfully saved derivative data. [2025-10-02T22:45:15.258362] [INFO ] [MAIN ] Derivative Progress: 1638/1975 symbols completed. STLA took 1.3s. Estimated remaining: 2m 21s. Rate: 143.3 symbols/min [2025-10-02T22:45:15.258759] [INFO ] [MAIN ] STT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:15.275123] [DEBUG] [LOCAL ] STNG: Loaded 44086 existing records from primary storage. [2025-10-02T22:45:15.278354] [INFO ] [MAIN ] STNG: Loaded 44086 primary data records. [2025-10-02T22:45:15.333940] [DEBUG] [LOCAL ] STRV: Loaded 11451 existing records from primary storage. [2025-10-02T22:45:15.361868] [INFO ] [MAIN ] STRV: Loaded 11451 primary data records. [2025-10-02T22:45:15.821605] [DEBUG] [LOCAL ] STT: Loaded 51328 existing records from primary storage. [2025-10-02T22:45:15.833377] [INFO ] [MAIN ] STT: Loaded 51328 primary data records. [2025-10-02T22:45:16.403021] [DEBUG] [MAIN ] STNG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:16.404682] [INFO ] [MAIN ] STNG: Generated 1807 derivative records from 44086 primary records. [2025-10-02T22:45:16.405052] [DEBUG] [LOCAL ] STNG: Saving derivative data. [2025-10-02T22:45:16.441100] [DEBUG] [LOCAL ] STNG: Derivative data saved (1807 records). [2025-10-02T22:45:16.442757] [INFO ] [MAIN ] STNG: Successfully saved derivative data. [2025-10-02T22:45:16.445259] [DEBUG] [MAIN ] STRV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:16.446277] [INFO ] [MAIN ] STRV: Generated 1807 derivative records from 11451 primary records. [2025-10-02T22:45:16.444870] [INFO ] [MAIN ] Derivative Progress: 1639/1975 symbols completed. STNG took 1.3s. Estimated remaining: 2m 21s. Rate: 143.1 symbols/min [2025-10-02T22:45:16.446509] [INFO ] [MAIN ] STVN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:16.447137] [DEBUG] [LOCAL ] STRV: Saving derivative data. [2025-10-02T22:45:16.467251] [DEBUG] [LOCAL ] STRV: Derivative data saved (1807 records). [2025-10-02T22:45:16.468511] [INFO ] [MAIN ] STRV: Successfully saved derivative data. [2025-10-02T22:45:16.471400] [INFO ] [MAIN ] Derivative Progress: 1640/1975 symbols completed. STRV took 1.2s. Estimated remaining: 2m 20s. Rate: 143.2 symbols/min [2025-10-02T22:45:16.471913] [INFO ] [MAIN ] STWD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:16.494129] [DEBUG] [MAIN ] STT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:16.494944] [INFO ] [MAIN ] STT: Generated 1807 derivative records from 51328 primary records. [2025-10-02T22:45:16.495155] [DEBUG] [LOCAL ] STT: Saving derivative data. [2025-10-02T22:45:16.519282] [DEBUG] [LOCAL ] STVN: Loaded 26391 existing records from primary storage. [2025-10-02T22:45:16.519842] [INFO ] [MAIN ] STVN: Loaded 26391 primary data records. [2025-10-02T22:45:16.638501] [DEBUG] [LOCAL ] STT: Derivative data saved (1807 records). [2025-10-02T22:45:16.638723] [INFO ] [MAIN ] STT: Successfully saved derivative data. [2025-10-02T22:45:16.654900] [INFO ] [MAIN ] Derivative Progress: 1641/1975 symbols completed. STT took 1.4s. Estimated remaining: 2m 20s. Rate: 143.3 symbols/min [2025-10-02T22:45:16.655161] [INFO ] [MAIN ] STXD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:16.857445] [DEBUG] [LOCAL ] STXD: Loaded 1294 existing records from primary storage. [2025-10-02T22:45:16.883207] [INFO ] [MAIN ] STXD: Loaded 1294 primary data records. [2025-10-02T22:45:16.920571] [DEBUG] [LOCAL ] STWD: Loaded 52264 existing records from primary storage. [2025-10-02T22:45:16.934375] [INFO ] [MAIN ] STWD: Loaded 52264 primary data records. [2025-10-02T22:45:17.580895] [DEBUG] [MAIN ] STVN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:17.582878] [INFO ] [MAIN ] STVN: Generated 1807 derivative records from 26391 primary records. [2025-10-02T22:45:17.583860] [DEBUG] [LOCAL ] STVN: Saving derivative data. [2025-10-02T22:45:17.632603] [DEBUG] [MAIN ] STXD: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-02T22:45:17.633861] [DEBUG] [LOCAL ] STVN: Derivative data saved (1807 records). [2025-10-02T22:45:17.634947] [INFO ] [MAIN ] STXD: Generated 1806 derivative records from 1294 primary records. [2025-10-02T22:45:17.635250] [DEBUG] [LOCAL ] STXD: Saving derivative data. [2025-10-02T22:45:17.635048] [INFO ] [MAIN ] STVN: Successfully saved derivative data. [2025-10-02T22:45:17.638275] [INFO ] [MAIN ] Derivative Progress: 1642/1975 symbols completed. STVN took 1.2s. Estimated remaining: 2m 20s. Rate: 143.1 symbols/min [2025-10-02T22:45:17.653218] [INFO ] [MAIN ] STXE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:17.664061] [DEBUG] [MAIN ] STWD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:17.667598] [INFO ] [MAIN ] STWD: Generated 1807 derivative records from 52264 primary records. [2025-10-02T22:45:17.670503] [DEBUG] [LOCAL ] STXD: Derivative data saved (1806 records). [2025-10-02T22:45:17.670740] [INFO ] [MAIN ] STXD: Successfully saved derivative data. [2025-10-02T22:45:17.673863] [INFO ] [MAIN ] Derivative Progress: 1643/1975 symbols completed. STXD took 1.0s. Estimated remaining: 2m 19s. Rate: 143.2 symbols/min [2025-10-02T22:45:17.674113] [INFO ] [MAIN ] STXG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:17.674501] [DEBUG] [LOCAL ] STWD: Saving derivative data. [2025-10-02T22:45:17.679372] [DEBUG] [LOCAL ] STXE: Loaded 2199 existing records from primary storage. [2025-10-02T22:45:17.680909] [INFO ] [MAIN ] STXE: Loaded 2199 primary data records. [2025-10-02T22:45:17.712411] [DEBUG] [LOCAL ] STXG: Loaded 2521 existing records from primary storage. [2025-10-02T22:45:17.713122] [INFO ] [MAIN ] STXG: Loaded 2521 primary data records. [2025-10-02T22:45:17.956190] [DEBUG] [LOCAL ] STWD: Derivative data saved (1807 records). [2025-10-02T22:45:17.977119] [INFO ] [MAIN ] STWD: Successfully saved derivative data. [2025-10-02T22:45:18.029946] [INFO ] [MAIN ] Derivative Progress: 1644/1975 symbols completed. STWD took 1.6s. Estimated remaining: 2m 19s. Rate: 143.2 symbols/min [2025-10-02T22:45:18.052090] [INFO ] [MAIN ] STXK: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:18.413933] [DEBUG] [LOCAL ] STXK: Loaded 1497 existing records from primary storage. [2025-10-02T22:45:18.423445] [INFO ] [MAIN ] STXK: Loaded 1497 primary data records. [2025-10-02T22:45:18.775329] [DEBUG] [MAIN ] STXE: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-02T22:45:18.777179] [INFO ] [MAIN ] STXE: Generated 1806 derivative records from 2199 primary records. [2025-10-02T22:45:18.777373] [DEBUG] [LOCAL ] STXE: Saving derivative data. [2025-10-02T22:45:18.802636] [DEBUG] [MAIN ] STXG: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-02T22:45:18.804117] [INFO ] [MAIN ] STXG: Generated 1806 derivative records from 2521 primary records. [2025-10-02T22:45:18.804586] [DEBUG] [LOCAL ] STXG: Saving derivative data. [2025-10-02T22:45:18.822503] [DEBUG] [LOCAL ] STXE: Derivative data saved (1806 records). [2025-10-02T22:45:18.823928] [INFO ] [MAIN ] STXE: Successfully saved derivative data. [2025-10-02T22:45:18.826401] [INFO ] [MAIN ] Derivative Progress: 1645/1975 symbols completed. STXE took 1.2s. Estimated remaining: 2m 18s. Rate: 143.2 symbols/min [2025-10-02T22:45:18.827139] [INFO ] [MAIN ] STXT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:18.830279] [DEBUG] [LOCAL ] STXG: Derivative data saved (1806 records). [2025-10-02T22:45:18.830546] [INFO ] [MAIN ] STXG: Successfully saved derivative data. [2025-10-02T22:45:18.833014] [INFO ] [MAIN ] Derivative Progress: 1646/1975 symbols completed. STXG took 1.2s. Estimated remaining: 2m 18s. Rate: 143.2 symbols/min [2025-10-02T22:45:18.833341] [INFO ] [MAIN ] STXV: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:18.838104] [DEBUG] [LOCAL ] STXT: Loaded 2554 existing records from primary storage. [2025-10-02T22:45:18.838432] [INFO ] [MAIN ] STXT: Loaded 2554 primary data records. [2025-10-02T22:45:18.890181] [DEBUG] [LOCAL ] STXV: Loaded 1577 existing records from primary storage. [2025-10-02T22:45:18.913582] [INFO ] [MAIN ] STXV: Loaded 1577 primary data records. [2025-10-02T22:45:18.992118] [DEBUG] [MAIN ] STXK: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-02T22:45:19.029164] [INFO ] [MAIN ] STXK: Generated 1806 derivative records from 1497 primary records. [2025-10-02T22:45:19.075819] [DEBUG] [LOCAL ] STXK: Saving derivative data. [2025-10-02T22:45:19.552816] [DEBUG] [LOCAL ] STXK: Derivative data saved (1806 records). [2025-10-02T22:45:19.553388] [INFO ] [MAIN ] STXK: Successfully saved derivative data. [2025-10-02T22:45:19.556584] [INFO ] [MAIN ] Derivative Progress: 1647/1975 symbols completed. STXK took 1.5s. Estimated remaining: 2m 17s. Rate: 143.2 symbols/min [2025-10-02T22:45:19.558181] [INFO ] [MAIN ] STZ: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:19.591558] [DEBUG] [MAIN ] STXV: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-02T22:45:19.612028] [INFO ] [MAIN ] STXV: Generated 1806 derivative records from 1577 primary records. [2025-10-02T22:45:19.612431] [DEBUG] [MAIN ] STXT: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-02T22:45:19.612663] [DEBUG] [LOCAL ] STXV: Saving derivative data. [2025-10-02T22:45:19.616322] [INFO ] [MAIN ] STXT: Generated 1806 derivative records from 2554 primary records. [2025-10-02T22:45:19.617338] [DEBUG] [LOCAL ] STXT: Saving derivative data. [2025-10-02T22:45:19.632708] [DEBUG] [LOCAL ] STXV: Derivative data saved (1806 records). [2025-10-02T22:45:19.633230] [INFO ] [MAIN ] STXV: Successfully saved derivative data. [2025-10-02T22:45:19.642761] [INFO ] [MAIN ] Derivative Progress: 1648/1975 symbols completed. STXV took 0.8s. Estimated remaining: 2m 17s. Rate: 143.2 symbols/min [2025-10-02T22:45:19.666802] [DEBUG] [LOCAL ] STXT: Derivative data saved (1806 records). [2025-10-02T22:45:19.666985] [INFO ] [MAIN ] STXT: Successfully saved derivative data. [2025-10-02T22:45:19.669904] [INFO ] [MAIN ] Derivative Progress: 1649/1975 symbols completed. STXT took 0.8s. Estimated remaining: 2m 16s. Rate: 143.3 symbols/min [2025-10-02T22:45:19.690800] [DEBUG] [LOCAL ] STZ: Loaded 52676 existing records from primary storage. [2025-10-02T22:45:19.690955] [INFO ] [MAIN ] STZ: Loaded 52676 primary data records. [2025-10-02T22:45:20.032799] [DEBUG] [MAIN ] STZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:20.033472] [INFO ] [MAIN ] STZ: Generated 1807 derivative records from 52676 primary records. [2025-10-02T22:45:20.033536] [DEBUG] [LOCAL ] STZ: Saving derivative data. [2025-10-02T22:45:20.050515] [DEBUG] [LOCAL ] STZ: Derivative data saved (1807 records). [2025-10-02T22:45:20.050624] [INFO ] [MAIN ] STZ: Successfully saved derivative data. [2025-10-02T22:45:20.052692] [INFO ] [MAIN ] Derivative Progress: 1650/1975 symbols completed. STZ took 0.5s. Estimated remaining: 2m 16s. Rate: 143.3 symbols/min [2025-10-02T22:45:20.053430] [INFO ] [MAIN ] SUI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:20.053313] [INFO ] [MAIN ] SU: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:20.053777] [INFO ] [MAIN ] SUN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:20.154811] [DEBUG] [LOCAL ] SUI: Loaded 42015 existing records from primary storage. [2025-10-02T22:45:20.169341] [DEBUG] [LOCAL ] SUN: Loaded 37823 existing records from primary storage. [2025-10-02T22:45:20.170770] [INFO ] [MAIN ] SUI: Loaded 42015 primary data records. [2025-10-02T22:45:20.171063] [INFO ] [MAIN ] SUN: Loaded 37823 primary data records. [2025-10-02T22:45:20.228915] [DEBUG] [LOCAL ] SU: Loaded 53836 existing records from primary storage. [2025-10-02T22:45:20.288700] [INFO ] [MAIN ] SU: Loaded 53836 primary data records. [2025-10-02T22:45:21.271610] [DEBUG] [MAIN ] SU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:21.271977] [DEBUG] [MAIN ] SUI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:21.273153] [INFO ] [MAIN ] SUI: Generated 1807 derivative records from 42015 primary records. [2025-10-02T22:45:21.274766] [DEBUG] [LOCAL ] SUI: Saving derivative data. [2025-10-02T22:45:21.273776] [INFO ] [MAIN ] SU: Generated 1807 derivative records from 53836 primary records. [2025-10-02T22:45:21.274879] [DEBUG] [LOCAL ] SU: Saving derivative data. [2025-10-02T22:45:21.295437] [DEBUG] [LOCAL ] SUI: Derivative data saved (1807 records). [2025-10-02T22:45:21.303287] [INFO ] [MAIN ] SUI: Successfully saved derivative data. [2025-10-02T22:45:21.313846] [INFO ] [MAIN ] Derivative Progress: 1651/1975 symbols completed. SUI took 1.3s. Estimated remaining: 2m 16s. Rate: 143.2 symbols/min [2025-10-02T22:45:21.323325] [INFO ] [MAIN ] SUPV: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:21.323565] [DEBUG] [MAIN ] SUN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:21.325467] [INFO ] [MAIN ] SUN: Generated 1807 derivative records from 37823 primary records. [2025-10-02T22:45:21.325931] [DEBUG] [LOCAL ] SUN: Saving derivative data. [2025-10-02T22:45:21.343636] [DEBUG] [LOCAL ] SU: Derivative data saved (1807 records). [2025-10-02T22:45:21.344509] [INFO ] [MAIN ] SU: Successfully saved derivative data. [2025-10-02T22:45:21.346871] [INFO ] [MAIN ] Derivative Progress: 1652/1975 symbols completed. SU took 1.3s. Estimated remaining: 2m 15s. Rate: 143.2 symbols/min [2025-10-02T22:45:21.347590] [INFO ] [MAIN ] SUZ: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:21.353007] [DEBUG] [LOCAL ] SUN: Derivative data saved (1807 records). [2025-10-02T22:45:21.353110] [INFO ] [MAIN ] SUN: Successfully saved derivative data. [2025-10-02T22:45:21.355520] [INFO ] [MAIN ] Derivative Progress: 1653/1975 symbols completed. SUN took 1.3s. Estimated remaining: 2m 15s. Rate: 143.3 symbols/min [2025-10-02T22:45:21.355802] [INFO ] [MAIN ] SVV: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:21.439056] [DEBUG] [LOCAL ] SUPV: Loaded 47694 existing records from primary storage. [2025-10-02T22:45:21.441000] [INFO ] [MAIN ] SUPV: Loaded 47694 primary data records. [2025-10-02T22:45:21.447292] [DEBUG] [LOCAL ] SUZ: Loaded 45964 existing records from primary storage. [2025-10-02T22:45:21.472950] [INFO ] [MAIN ] SUZ: Loaded 45964 primary data records. [2025-10-02T22:45:21.535942] [DEBUG] [LOCAL ] SVV: Loaded 40036 existing records from primary storage. [2025-10-02T22:45:21.552202] [INFO ] [MAIN ] SVV: Loaded 40036 primary data records. [2025-10-02T22:45:22.552459] [DEBUG] [MAIN ] SUPV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:22.553999] [INFO ] [MAIN ] SUPV: Generated 1807 derivative records from 47694 primary records. [2025-10-02T22:45:22.554249] [DEBUG] [LOCAL ] SUPV: Saving derivative data. [2025-10-02T22:45:22.575823] [DEBUG] [LOCAL ] SUPV: Derivative data saved (1807 records). [2025-10-02T22:45:22.576202] [INFO ] [MAIN ] SUPV: Successfully saved derivative data. [2025-10-02T22:45:22.578087] [INFO ] [MAIN ] Derivative Progress: 1654/1975 symbols completed. SUPV took 1.3s. Estimated remaining: 2m 15s. Rate: 143.2 symbols/min [2025-10-02T22:45:22.586020] [INFO ] [MAIN ] SW: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:22.591536] [DEBUG] [MAIN ] SUZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:22.592425] [INFO ] [MAIN ] SUZ: Generated 1807 derivative records from 45964 primary records. [2025-10-02T22:45:22.592809] [DEBUG] [LOCAL ] SUZ: Saving derivative data. [2025-10-02T22:45:22.611796] [DEBUG] [LOCAL ] SUZ: Derivative data saved (1807 records). [2025-10-02T22:45:22.612117] [INFO ] [MAIN ] SUZ: Successfully saved derivative data. [2025-10-02T22:45:22.614491] [INFO ] [MAIN ] Derivative Progress: 1655/1975 symbols completed. SUZ took 1.3s. Estimated remaining: 2m 14s. Rate: 143.2 symbols/min [2025-10-02T22:45:22.614791] [INFO ] [MAIN ] SWK: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:22.628715] [DEBUG] [MAIN ] SVV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:22.629672] [INFO ] [MAIN ] SVV: Generated 1807 derivative records from 40036 primary records. [2025-10-02T22:45:22.629925] [DEBUG] [LOCAL ] SVV: Saving derivative data. [2025-10-02T22:45:22.648068] [DEBUG] [LOCAL ] SVV: Derivative data saved (1807 records). [2025-10-02T22:45:22.648304] [INFO ] [MAIN ] SVV: Successfully saved derivative data. [2025-10-02T22:45:22.650558] [INFO ] [MAIN ] Derivative Progress: 1656/1975 symbols completed. SVV took 1.3s. Estimated remaining: 2m 14s. Rate: 143.3 symbols/min [2025-10-02T22:45:22.650799] [INFO ] [MAIN ] SWX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:22.705726] [DEBUG] [LOCAL ] SW: Loaded 53552 existing records from primary storage. [2025-10-02T22:45:22.714439] [INFO ] [MAIN ] SW: Loaded 53552 primary data records. [2025-10-02T22:45:22.835204] [DEBUG] [LOCAL ] SWX: Loaded 31244 existing records from primary storage. [2025-10-02T22:45:22.885616] [DEBUG] [LOCAL ] SWK: Loaded 52774 existing records from primary storage. [2025-10-02T22:45:22.906879] [INFO ] [MAIN ] SWK: Loaded 52774 primary data records. [2025-10-02T22:45:22.863912] [INFO ] [MAIN ] SWX: Loaded 31244 primary data records. [2025-10-02T22:45:23.749995] [DEBUG] [MAIN ] SW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:23.753600] [INFO ] [MAIN ] SW: Generated 1807 derivative records from 53552 primary records. [2025-10-02T22:45:23.754087] [DEBUG] [LOCAL ] SW: Saving derivative data. [2025-10-02T22:45:23.778860] [DEBUG] [LOCAL ] SW: Derivative data saved (1807 records). [2025-10-02T22:45:23.779761] [INFO ] [MAIN ] SW: Successfully saved derivative data. [2025-10-02T22:45:23.783061] [INFO ] [MAIN ] Derivative Progress: 1657/1975 symbols completed. SW took 1.2s. Estimated remaining: 2m 13s. Rate: 143.2 symbols/min [2025-10-02T22:45:23.785411] [INFO ] [MAIN ] SWZ: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:23.799717] [DEBUG] [MAIN ] SWX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:23.814809] [DEBUG] [MAIN ] SWK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:23.814465] [INFO ] [MAIN ] SWX: Generated 1807 derivative records from 31244 primary records. [2025-10-02T22:45:23.816144] [INFO ] [MAIN ] SWK: Generated 1807 derivative records from 52774 primary records. [2025-10-02T22:45:23.815225] [DEBUG] [LOCAL ] SWX: Saving derivative data. [2025-10-02T22:45:23.816294] [DEBUG] [LOCAL ] SWK: Saving derivative data. [2025-10-02T22:45:23.850823] [DEBUG] [LOCAL ] SWZ: Loaded 6065 existing records from primary storage. [2025-10-02T22:45:23.852845] [INFO ] [MAIN ] SWZ: Loaded 6065 primary data records. [2025-10-02T22:45:23.933994] [DEBUG] [LOCAL ] SWK: Derivative data saved (1807 records). [2025-10-02T22:45:23.940067] [DEBUG] [LOCAL ] SWX: Derivative data saved (1807 records). [2025-10-02T22:45:23.940165] [INFO ] [MAIN ] SWK: Successfully saved derivative data. [2025-10-02T22:45:23.940326] [INFO ] [MAIN ] SWX: Successfully saved derivative data. [2025-10-02T22:45:23.953067] [INFO ] [MAIN ] Derivative Progress: 1658/1975 symbols completed. SWX took 1.3s. Estimated remaining: 2m 13s. Rate: 143.2 symbols/min [2025-10-02T22:45:23.990225] [INFO ] [MAIN ] Derivative Progress: 1659/1975 symbols completed. SWK took 1.4s. Estimated remaining: 2m 12s. Rate: 143.3 symbols/min [2025-10-02T22:45:23.990046] [INFO ] [MAIN ] SXC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:23.990957] [INFO ] [MAIN ] SXI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:24.221601] [DEBUG] [LOCAL ] SXI: Loaded 11652 existing records from primary storage. [2025-10-02T22:45:24.222503] [INFO ] [MAIN ] SXI: Loaded 11652 primary data records. [2025-10-02T22:45:24.375125] [DEBUG] [LOCAL ] SXC: Loaded 41758 existing records from primary storage. [2025-10-02T22:45:24.381055] [INFO ] [MAIN ] SXC: Loaded 41758 primary data records. [2025-10-02T22:45:24.998580] [DEBUG] [MAIN ] SWZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:24.999726] [INFO ] [MAIN ] SWZ: Generated 1807 derivative records from 6065 primary records. [2025-10-02T22:45:24.999912] [DEBUG] [LOCAL ] SWZ: Saving derivative data. [2025-10-02T22:45:25.017675] [DEBUG] [LOCAL ] SWZ: Derivative data saved (1807 records). [2025-10-02T22:45:25.018886] [INFO ] [MAIN ] SWZ: Successfully saved derivative data. [2025-10-02T22:45:25.021433] [INFO ] [MAIN ] Derivative Progress: 1660/1975 symbols completed. SWZ took 1.2s. Estimated remaining: 2m 12s. Rate: 143.2 symbols/min [2025-10-02T22:45:25.021826] [INFO ] [MAIN ] SXT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:25.045671] [DEBUG] [MAIN ] SXI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:25.046810] [INFO ] [MAIN ] SXI: Generated 1807 derivative records from 11652 primary records. [2025-10-02T22:45:25.047125] [DEBUG] [LOCAL ] SXI: Saving derivative data. [2025-10-02T22:45:25.098949] [DEBUG] [MAIN ] SXC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:25.098355] [DEBUG] [LOCAL ] SXT: Loaded 29691 existing records from primary storage. [2025-10-02T22:45:25.100070] [INFO ] [MAIN ] SXC: Generated 1807 derivative records from 41758 primary records. [2025-10-02T22:45:25.100564] [INFO ] [MAIN ] SXT: Loaded 29691 primary data records. [2025-10-02T22:45:25.100901] [DEBUG] [LOCAL ] SXI: Derivative data saved (1807 records). [2025-10-02T22:45:25.101034] [INFO ] [MAIN ] SXI: Successfully saved derivative data. [2025-10-02T22:45:25.103310] [INFO ] [MAIN ] Derivative Progress: 1661/1975 symbols completed. SXI took 1.1s. Estimated remaining: 2m 12s. Rate: 143.2 symbols/min [2025-10-02T22:45:25.100504] [DEBUG] [LOCAL ] SXC: Saving derivative data. [2025-10-02T22:45:25.136403] [INFO ] [MAIN ] SYF: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:25.313009] [DEBUG] [LOCAL ] SXC: Derivative data saved (1807 records). [2025-10-02T22:45:25.320103] [INFO ] [MAIN ] SXC: Successfully saved derivative data. [2025-10-02T22:45:25.370397] [INFO ] [MAIN ] Derivative Progress: 1662/1975 symbols completed. SXC took 1.4s. Estimated remaining: 2m 11s. Rate: 143.3 symbols/min [2025-10-02T22:45:25.438970] [INFO ] [MAIN ] SYK: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:25.488003] [DEBUG] [LOCAL ] SYF: Loaded 53832 existing records from primary storage. [2025-10-02T22:45:25.488423] [INFO ] [MAIN ] SYF: Loaded 53832 primary data records. [2025-10-02T22:45:25.731804] [DEBUG] [MAIN ] SXT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:25.852992] [INFO ] [MAIN ] SXT: Generated 1807 derivative records from 29691 primary records. [2025-10-02T22:45:25.853334] [DEBUG] [LOCAL ] SXT: Saving derivative data. [2025-10-02T22:45:25.884095] [DEBUG] [LOCAL ] SYK: Loaded 47253 existing records from primary storage. [2025-10-02T22:45:25.886088] [INFO ] [MAIN ] SYK: Loaded 47253 primary data records. [2025-10-02T22:45:25.936687] [DEBUG] [LOCAL ] SXT: Derivative data saved (1807 records). [2025-10-02T22:45:25.936817] [INFO ] [MAIN ] SXT: Successfully saved derivative data. [2025-10-02T22:45:25.952739] [INFO ] [MAIN ] Derivative Progress: 1663/1975 symbols completed. SXT took 0.9s. Estimated remaining: 2m 11s. Rate: 143.2 symbols/min [2025-10-02T22:45:26.236234] [DEBUG] [MAIN ] SYF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:26.237724] [INFO ] [MAIN ] SYF: Generated 1807 derivative records from 53832 primary records. [2025-10-02T22:45:26.238044] [DEBUG] [LOCAL ] SYF: Saving derivative data. [2025-10-02T22:45:26.258582] [DEBUG] [LOCAL ] SYF: Derivative data saved (1807 records). [2025-10-02T22:45:26.258820] [INFO ] [MAIN ] SYF: Successfully saved derivative data. [2025-10-02T22:45:26.260907] [INFO ] [MAIN ] Derivative Progress: 1664/1975 symbols completed. SYF took 1.1s. Estimated remaining: 2m 10s. Rate: 143.3 symbols/min [2025-10-02T22:45:26.277689] [DEBUG] [MAIN ] SYK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:26.278375] [INFO ] [MAIN ] SYK: Generated 1807 derivative records from 47253 primary records. [2025-10-02T22:45:26.278439] [DEBUG] [LOCAL ] SYK: Saving derivative data. [2025-10-02T22:45:26.294687] [DEBUG] [LOCAL ] SYK: Derivative data saved (1807 records). [2025-10-02T22:45:26.294761] [INFO ] [MAIN ] SYK: Successfully saved derivative data. [2025-10-02T22:45:26.297681] [INFO ] [MAIN ] Derivative Progress: 1665/1975 symbols completed. SYK took 0.9s. Estimated remaining: 2m 10s. Rate: 143.3 symbols/min [2025-10-02T22:45:26.298295] [INFO ] [MAIN ] SYY: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:26.298531] [INFO ] [MAIN ] TAC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:26.298426] [INFO ] [MAIN ] T: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:26.379960] [DEBUG] [LOCAL ] T: Loaded 54188 existing records from primary storage. [2025-10-02T22:45:26.380861] [INFO ] [MAIN ] T: Loaded 54188 primary data records. [2025-10-02T22:45:26.473718] [DEBUG] [LOCAL ] TAC: Loaded 42891 existing records from primary storage. [2025-10-02T22:45:26.517151] [INFO ] [MAIN ] TAC: Loaded 42891 primary data records. [2025-10-02T22:45:26.518028] [DEBUG] [LOCAL ] SYY: Loaded 53608 existing records from primary storage. [2025-10-02T22:45:26.531072] [INFO ] [MAIN ] SYY: Loaded 53608 primary data records. [2025-10-02T22:45:27.471820] [DEBUG] [MAIN ] T: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:27.472630] [INFO ] [MAIN ] T: Generated 1807 derivative records from 54188 primary records. [2025-10-02T22:45:27.472955] [DEBUG] [LOCAL ] T: Saving derivative data. [2025-10-02T22:45:27.508915] [DEBUG] [MAIN ] TAC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:27.523353] [INFO ] [MAIN ] TAC: Generated 1807 derivative records from 42891 primary records. [2025-10-02T22:45:27.525300] [DEBUG] [LOCAL ] T: Derivative data saved (1807 records). [2025-10-02T22:45:27.524801] [DEBUG] [MAIN ] SYY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:27.526096] [INFO ] [MAIN ] SYY: Generated 1807 derivative records from 53608 primary records. [2025-10-02T22:45:27.526187] [DEBUG] [LOCAL ] SYY: Saving derivative data. [2025-10-02T22:45:27.524501] [DEBUG] [LOCAL ] TAC: Saving derivative data. [2025-10-02T22:45:27.526678] [INFO ] [MAIN ] T: Successfully saved derivative data. [2025-10-02T22:45:27.528942] [INFO ] [MAIN ] Derivative Progress: 1666/1975 symbols completed. T took 1.2s. Estimated remaining: 2m 9s. Rate: 143.2 symbols/min [2025-10-02T22:45:27.529555] [INFO ] [MAIN ] TAK: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:27.561273] [DEBUG] [LOCAL ] SYY: Derivative data saved (1807 records). [2025-10-02T22:45:27.562854] [INFO ] [MAIN ] SYY: Successfully saved derivative data. [2025-10-02T22:45:27.562779] [DEBUG] [LOCAL ] TAC: Derivative data saved (1807 records). [2025-10-02T22:45:27.564920] [INFO ] [MAIN ] Derivative Progress: 1667/1975 symbols completed. SYY took 1.3s. Estimated remaining: 2m 9s. Rate: 143.3 symbols/min [2025-10-02T22:45:27.565115] [INFO ] [MAIN ] TAL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:27.565475] [INFO ] [MAIN ] TAC: Successfully saved derivative data. [2025-10-02T22:45:27.568834] [INFO ] [MAIN ] Derivative Progress: 1668/1975 symbols completed. TAC took 1.3s. Estimated remaining: 2m 9s. Rate: 143.3 symbols/min [2025-10-02T22:45:27.572707] [INFO ] [MAIN ] TALO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:27.690697] [DEBUG] [LOCAL ] TALO: Loaded 51156 existing records from primary storage. [2025-10-02T22:45:27.690869] [INFO ] [MAIN ] TALO: Loaded 51156 primary data records. [2025-10-02T22:45:27.689992] [DEBUG] [LOCAL ] TAK: Loaded 50184 existing records from primary storage. [2025-10-02T22:45:27.691066] [INFO ] [MAIN ] TAK: Loaded 50184 primary data records. [2025-10-02T22:45:27.689159] [DEBUG] [LOCAL ] TAL: Loaded 52324 existing records from primary storage. [2025-10-02T22:45:27.691449] [INFO ] [MAIN ] TAL: Loaded 52324 primary data records. [2025-10-02T22:45:28.725949] [DEBUG] [MAIN ] TAL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:28.739057] [DEBUG] [MAIN ] TALO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:28.740998] [INFO ] [MAIN ] TALO: Generated 1807 derivative records from 51156 primary records. [2025-10-02T22:45:28.741249] [DEBUG] [LOCAL ] TALO: Saving derivative data. [2025-10-02T22:45:28.741632] [DEBUG] [MAIN ] TAK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:28.743287] [INFO ] [MAIN ] TAK: Generated 1807 derivative records from 50184 primary records. [2025-10-02T22:45:28.740199] [INFO ] [MAIN ] TAL: Generated 1807 derivative records from 52324 primary records. [2025-10-02T22:45:28.743565] [DEBUG] [LOCAL ] TAL: Saving derivative data. [2025-10-02T22:45:28.743436] [DEBUG] [LOCAL ] TAK: Saving derivative data. [2025-10-02T22:45:28.789601] [DEBUG] [LOCAL ] TAL: Derivative data saved (1807 records). [2025-10-02T22:45:28.790574] [INFO ] [MAIN ] TAL: Successfully saved derivative data. [2025-10-02T22:45:28.793695] [INFO ] [MAIN ] Derivative Progress: 1669/1975 symbols completed. TAL took 1.2s. Estimated remaining: 2m 8s. Rate: 143.2 symbols/min [2025-10-02T22:45:28.795005] [INFO ] [MAIN ] TAP: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:28.797944] [DEBUG] [LOCAL ] TAK: Derivative data saved (1807 records). [2025-10-02T22:45:28.798809] [INFO ] [MAIN ] TAK: Successfully saved derivative data. [2025-10-02T22:45:28.799015] [DEBUG] [LOCAL ] TALO: Derivative data saved (1807 records). [2025-10-02T22:45:28.801493] [INFO ] [MAIN ] TALO: Successfully saved derivative data. [2025-10-02T22:45:28.801409] [INFO ] [MAIN ] Derivative Progress: 1670/1975 symbols completed. TAK took 1.3s. Estimated remaining: 2m 8s. Rate: 143.3 symbols/min [2025-10-02T22:45:28.801711] [INFO ] [MAIN ] TBB: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:28.803982] [INFO ] [MAIN ] Derivative Progress: 1671/1975 symbols completed. TALO took 1.2s. Estimated remaining: 2m 7s. Rate: 143.3 symbols/min [2025-10-02T22:45:28.804524] [INFO ] [MAIN ] TBBB: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:28.819671] [DEBUG] [LOCAL ] TBB: Loaded 11768 existing records from primary storage. [2025-10-02T22:45:28.819986] [INFO ] [MAIN ] TBB: Loaded 11768 primary data records. [2025-10-02T22:45:28.988826] [DEBUG] [LOCAL ] TBBB: Loaded 35961 existing records from primary storage. [2025-10-02T22:45:29.071183] [INFO ] [MAIN ] TBBB: Loaded 35961 primary data records. [2025-10-02T22:45:29.241565] [DEBUG] [LOCAL ] TAP: Loaded 53281 existing records from primary storage. [2025-10-02T22:45:29.264095] [INFO ] [MAIN ] TAP: Loaded 53281 primary data records. [2025-10-02T22:45:29.923417] [DEBUG] [MAIN ] TBB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:29.924442] [INFO ] [MAIN ] TBB: Generated 1807 derivative records from 11768 primary records. [2025-10-02T22:45:29.925838] [DEBUG] [LOCAL ] TBB: Saving derivative data. [2025-10-02T22:45:29.952504] [DEBUG] [LOCAL ] TBB: Derivative data saved (1807 records). [2025-10-02T22:45:29.953618] [INFO ] [MAIN ] TBB: Successfully saved derivative data. [2025-10-02T22:45:29.965445] [INFO ] [MAIN ] Derivative Progress: 1672/1975 symbols completed. TBB took 1.2s. Estimated remaining: 2m 7s. Rate: 143.2 symbols/min [2025-10-02T22:45:29.971547] [INFO ] [MAIN ] TBI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:29.972211] [DEBUG] [MAIN ] TBBB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:29.974010] [INFO ] [MAIN ] TBBB: Generated 1807 derivative records from 35961 primary records. [2025-10-02T22:45:29.982048] [DEBUG] [LOCAL ] TBBB: Saving derivative data. [2025-10-02T22:45:29.988108] [DEBUG] [MAIN ] TAP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:29.989114] [INFO ] [MAIN ] TAP: Generated 1807 derivative records from 53281 primary records. [2025-10-02T22:45:29.989823] [DEBUG] [LOCAL ] TAP: Saving derivative data. [2025-10-02T22:45:30.025476] [DEBUG] [LOCAL ] TAP: Derivative data saved (1807 records). [2025-10-02T22:45:30.026810] [INFO ] [MAIN ] TAP: Successfully saved derivative data. [2025-10-02T22:45:30.029131] [DEBUG] [LOCAL ] TBBB: Derivative data saved (1807 records). [2025-10-02T22:45:30.031585] [INFO ] [MAIN ] Derivative Progress: 1673/1975 symbols completed. TAP took 1.2s. Estimated remaining: 2m 6s. Rate: 143.3 symbols/min [2025-10-02T22:45:30.031874] [INFO ] [MAIN ] TBBB: Successfully saved derivative data. [2025-10-02T22:45:30.032016] [INFO ] [MAIN ] TBN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:30.034170] [INFO ] [MAIN ] Derivative Progress: 1674/1975 symbols completed. TBBB took 1.2s. Estimated remaining: 2m 6s. Rate: 143.3 symbols/min [2025-10-02T22:45:30.034969] [INFO ] [MAIN ] TD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:30.046126] [DEBUG] [LOCAL ] TBI: Loaded 22726 existing records from primary storage. [2025-10-02T22:45:30.046471] [INFO ] [MAIN ] TBI: Loaded 22726 primary data records. [2025-10-02T22:45:30.049778] [DEBUG] [LOCAL ] TBN: Loaded 3627 existing records from primary storage. [2025-10-02T22:45:30.055211] [INFO ] [MAIN ] TBN: Loaded 3627 primary data records. [2025-10-02T22:45:30.746168] [DEBUG] [LOCAL ] TD: Loaded 52664 existing records from primary storage. [2025-10-02T22:45:30.746600] [INFO ] [MAIN ] TD: Loaded 52664 primary data records. [2025-10-02T22:45:31.096469] [DEBUG] [MAIN ] TBI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:31.098360] [INFO ] [MAIN ] TBI: Generated 1807 derivative records from 22726 primary records. [2025-10-02T22:45:31.098738] [DEBUG] [LOCAL ] TBI: Saving derivative data. [2025-10-02T22:45:31.126851] [DEBUG] [MAIN ] TBN: Filtered 6966 bins outside market hours, 7762 incomplete bins [2025-10-02T22:45:31.128954] [INFO ] [MAIN ] TBN: Generated 1804 derivative records from 3627 primary records. [2025-10-02T22:45:31.129439] [DEBUG] [LOCAL ] TBN: Saving derivative data. [2025-10-02T22:45:31.146807] [DEBUG] [LOCAL ] TBN: Derivative data saved (1804 records). [2025-10-02T22:45:31.147872] [INFO ] [MAIN ] TBN: Successfully saved derivative data. [2025-10-02T22:45:31.150397] [INFO ] [MAIN ] Derivative Progress: 1675/1975 symbols completed. TBN took 1.1s. Estimated remaining: 2m 6s. Rate: 143.2 symbols/min [2025-10-02T22:45:31.150758] [INFO ] [MAIN ] TDC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:31.151455] [DEBUG] [LOCAL ] TBI: Derivative data saved (1807 records). [2025-10-02T22:45:31.152278] [INFO ] [MAIN ] TBI: Successfully saved derivative data. [2025-10-02T22:45:31.154527] [INFO ] [MAIN ] Derivative Progress: 1676/1975 symbols completed. TBI took 1.2s. Estimated remaining: 2m 5s. Rate: 143.3 symbols/min [2025-10-02T22:45:31.154840] [INFO ] [MAIN ] TDF: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:31.172915] [DEBUG] [MAIN ] TD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:31.175826] [INFO ] [MAIN ] TD: Generated 1807 derivative records from 52664 primary records. [2025-10-02T22:45:31.176098] [DEBUG] [LOCAL ] TD: Saving derivative data. [2025-10-02T22:45:31.192905] [DEBUG] [LOCAL ] TDF: Loaded 6445 existing records from primary storage. [2025-10-02T22:45:31.194619] [INFO ] [MAIN ] TDF: Loaded 6445 primary data records. [2025-10-02T22:45:31.209197] [DEBUG] [LOCAL ] TD: Derivative data saved (1807 records). [2025-10-02T22:45:31.237175] [INFO ] [MAIN ] TD: Successfully saved derivative data. [2025-10-02T22:45:31.283275] [INFO ] [MAIN ] Derivative Progress: 1677/1975 symbols completed. TD took 1.2s. Estimated remaining: 2m 5s. Rate: 143.3 symbols/min [2025-10-02T22:45:31.312675] [INFO ] [MAIN ] TDG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:31.573180] [DEBUG] [LOCAL ] TDC: Loaded 46959 existing records from primary storage. [2025-10-02T22:45:31.589402] [INFO ] [MAIN ] TDC: Loaded 46959 primary data records. [2025-10-02T22:45:31.666678] [DEBUG] [LOCAL ] TDG: Loaded 22151 existing records from primary storage. [2025-10-02T22:45:31.677102] [INFO ] [MAIN ] TDG: Loaded 22151 primary data records. [2025-10-02T22:45:32.295080] [DEBUG] [MAIN ] TDF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:32.296755] [INFO ] [MAIN ] TDF: Generated 1807 derivative records from 6445 primary records. [2025-10-02T22:45:32.297415] [DEBUG] [LOCAL ] TDF: Saving derivative data. [2025-10-02T22:45:32.316923] [DEBUG] [LOCAL ] TDF: Derivative data saved (1807 records). [2025-10-02T22:45:32.317454] [INFO ] [MAIN ] TDF: Successfully saved derivative data. [2025-10-02T22:45:32.319597] [INFO ] [MAIN ] Derivative Progress: 1678/1975 symbols completed. TDF took 1.2s. Estimated remaining: 2m 4s. Rate: 143.2 symbols/min [2025-10-02T22:45:32.341749] [DEBUG] [MAIN ] TDC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:32.344384] [INFO ] [MAIN ] TDC: Generated 1807 derivative records from 46959 primary records. [2025-10-02T22:45:32.345033] [DEBUG] [LOCAL ] TDC: Saving derivative data. [2025-10-02T22:45:32.375469] [DEBUG] [LOCAL ] TDC: Derivative data saved (1807 records). [2025-10-02T22:45:32.375914] [DEBUG] [MAIN ] TDG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:32.376130] [INFO ] [MAIN ] TDC: Successfully saved derivative data. [2025-10-02T22:45:32.376990] [INFO ] [MAIN ] TDG: Generated 1807 derivative records from 22151 primary records. [2025-10-02T22:45:32.379243] [INFO ] [MAIN ] Derivative Progress: 1679/1975 symbols completed. TDC took 1.2s. Estimated remaining: 2m 4s. Rate: 143.3 symbols/min [2025-10-02T22:45:32.377085] [DEBUG] [LOCAL ] TDG: Saving derivative data. [2025-10-02T22:45:32.395942] [DEBUG] [LOCAL ] TDG: Derivative data saved (1807 records). [2025-10-02T22:45:32.396055] [INFO ] [MAIN ] TDG: Successfully saved derivative data. [2025-10-02T22:45:32.398288] [INFO ] [MAIN ] Derivative Progress: 1680/1975 symbols completed. TDG took 1.1s. Estimated remaining: 2m 3s. Rate: 143.4 symbols/min [2025-10-02T22:45:32.398841] [INFO ] [MAIN ] TDS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:32.399096] [INFO ] [MAIN ] TDW: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:32.398987] [INFO ] [MAIN ] TDOC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:32.467954] [DEBUG] [LOCAL ] TDS: Loaded 43121 existing records from primary storage. [2025-10-02T22:45:32.468355] [INFO ] [MAIN ] TDS: Loaded 43121 primary data records. [2025-10-02T22:45:32.559420] [DEBUG] [LOCAL ] TDW: Loaded 45600 existing records from primary storage. [2025-10-02T22:45:32.572979] [INFO ] [MAIN ] TDW: Loaded 45600 primary data records. [2025-10-02T22:45:32.653804] [DEBUG] [LOCAL ] TDOC: Loaded 53735 existing records from primary storage. [2025-10-02T22:45:32.691223] [INFO ] [MAIN ] TDOC: Loaded 53735 primary data records. [2025-10-02T22:45:33.585102] [DEBUG] [MAIN ] TDS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:33.587236] [INFO ] [MAIN ] TDS: Generated 1807 derivative records from 43121 primary records. [2025-10-02T22:45:33.587509] [DEBUG] [LOCAL ] TDS: Saving derivative data. [2025-10-02T22:45:33.637518] [DEBUG] [MAIN ] TDW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:33.636936] [DEBUG] [LOCAL ] TDS: Derivative data saved (1807 records). [2025-10-02T22:45:33.638626] [INFO ] [MAIN ] TDW: Generated 1807 derivative records from 45600 primary records. [2025-10-02T22:45:33.639125] [INFO ] [MAIN ] TDS: Successfully saved derivative data. [2025-10-02T22:45:33.639222] [DEBUG] [LOCAL ] TDW: Saving derivative data. [2025-10-02T22:45:33.639028] [DEBUG] [MAIN ] TDOC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:33.640132] [INFO ] [MAIN ] TDOC: Generated 1807 derivative records from 53735 primary records. [2025-10-02T22:45:33.640806] [DEBUG] [LOCAL ] TDOC: Saving derivative data. [2025-10-02T22:45:33.642590] [INFO ] [MAIN ] Derivative Progress: 1681/1975 symbols completed. TDS took 1.2s. Estimated remaining: 2m 3s. Rate: 143.2 symbols/min [2025-10-02T22:45:33.643126] [INFO ] [MAIN ] TDY: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:33.672535] [DEBUG] [LOCAL ] TDW: Derivative data saved (1807 records). [2025-10-02T22:45:33.673535] [INFO ] [MAIN ] TDW: Successfully saved derivative data. [2025-10-02T22:45:33.675814] [INFO ] [MAIN ] Derivative Progress: 1682/1975 symbols completed. TDW took 1.3s. Estimated remaining: 2m 3s. Rate: 143.3 symbols/min [2025-10-02T22:45:33.676749] [INFO ] [MAIN ] TEAF: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:33.686360] [DEBUG] [LOCAL ] TDOC: Derivative data saved (1807 records). [2025-10-02T22:45:33.688559] [INFO ] [MAIN ] TDOC: Successfully saved derivative data. [2025-10-02T22:45:33.690574] [INFO ] [MAIN ] Derivative Progress: 1683/1975 symbols completed. TDOC took 1.3s. Estimated remaining: 2m 2s. Rate: 143.4 symbols/min [2025-10-02T22:45:33.690906] [INFO ] [MAIN ] TECK: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:33.703692] [DEBUG] [LOCAL ] TEAF: Loaded 7674 existing records from primary storage. [2025-10-02T22:45:33.704435] [DEBUG] [LOCAL ] TDY: Loaded 22700 existing records from primary storage. [2025-10-02T22:45:33.703859] [INFO ] [MAIN ] TEAF: Loaded 7674 primary data records. [2025-10-02T22:45:33.704591] [INFO ] [MAIN ] TDY: Loaded 22700 primary data records. [2025-10-02T22:45:34.417903] [DEBUG] [LOCAL ] TECK: Loaded 53822 existing records from primary storage. [2025-10-02T22:45:34.419100] [INFO ] [MAIN ] TECK: Loaded 53822 primary data records. [2025-10-02T22:45:34.795605] [DEBUG] [MAIN ] TDY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:34.795910] [DEBUG] [MAIN ] TEAF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:34.796989] [INFO ] [MAIN ] TDY: Generated 1807 derivative records from 22700 primary records. [2025-10-02T22:45:34.798302] [INFO ] [MAIN ] TEAF: Generated 1807 derivative records from 7674 primary records. [2025-10-02T22:45:34.798412] [DEBUG] [LOCAL ] TEAF: Saving derivative data. [2025-10-02T22:45:34.799333] [DEBUG] [LOCAL ] TDY: Saving derivative data. [2025-10-02T22:45:34.830696] [DEBUG] [LOCAL ] TEAF: Derivative data saved (1807 records). [2025-10-02T22:45:34.833410] [INFO ] [MAIN ] TEAF: Successfully saved derivative data. [2025-10-02T22:45:34.836234] [DEBUG] [LOCAL ] TDY: Derivative data saved (1807 records). [2025-10-02T22:45:34.838699] [INFO ] [MAIN ] Derivative Progress: 1684/1975 symbols completed. TEAF took 1.2s. Estimated remaining: 2m 2s. Rate: 143.2 symbols/min [2025-10-02T22:45:34.839077] [INFO ] [MAIN ] TEF: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:34.836468] [INFO ] [MAIN ] TDY: Successfully saved derivative data. [2025-10-02T22:45:34.841303] [INFO ] [MAIN ] Derivative Progress: 1685/1975 symbols completed. TDY took 1.2s. Estimated remaining: 2m 1s. Rate: 143.3 symbols/min [2025-10-02T22:45:34.841809] [INFO ] [MAIN ] TEI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:34.861634] [DEBUG] [MAIN ] TECK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:34.862521] [INFO ] [MAIN ] TECK: Generated 1807 derivative records from 53822 primary records. [2025-10-02T22:45:34.862721] [DEBUG] [LOCAL ] TECK: Saving derivative data. [2025-10-02T22:45:34.900762] [DEBUG] [LOCAL ] TEI: Loaded 21330 existing records from primary storage. [2025-10-02T22:45:34.901166] [DEBUG] [LOCAL ] TECK: Derivative data saved (1807 records). [2025-10-02T22:45:34.901378] [INFO ] [MAIN ] TEI: Loaded 21330 primary data records. [2025-10-02T22:45:34.901667] [INFO ] [MAIN ] TECK: Successfully saved derivative data. [2025-10-02T22:45:34.952896] [INFO ] [MAIN ] Derivative Progress: 1686/1975 symbols completed. TECK took 1.3s. Estimated remaining: 2m 1s. Rate: 143.4 symbols/min [2025-10-02T22:45:34.997971] [INFO ] [MAIN ] TEL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:35.053076] [DEBUG] [LOCAL ] TEF: Loaded 37607 existing records from primary storage. [2025-10-02T22:45:35.070406] [INFO ] [MAIN ] TEF: Loaded 37607 primary data records. [2025-10-02T22:45:35.656461] [DEBUG] [LOCAL ] TEL: Loaded 51470 existing records from primary storage. [2025-10-02T22:45:35.657331] [INFO ] [MAIN ] TEL: Loaded 51470 primary data records. [2025-10-02T22:45:35.746479] [DEBUG] [MAIN ] TEI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:35.769861] [INFO ] [MAIN ] TEI: Generated 1807 derivative records from 21330 primary records. [2025-10-02T22:45:35.788848] [DEBUG] [LOCAL ] TEI: Saving derivative data. [2025-10-02T22:45:35.999676] [DEBUG] [LOCAL ] TEI: Derivative data saved (1807 records). [2025-10-02T22:45:36.013009] [INFO ] [MAIN ] TEI: Successfully saved derivative data. [2025-10-02T22:45:36.015844] [INFO ] [MAIN ] Derivative Progress: 1687/1975 symbols completed. TEI took 1.2s. Estimated remaining: 2m 1s. Rate: 143.2 symbols/min [2025-10-02T22:45:36.030294] [DEBUG] [MAIN ] TEF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:36.029191] [INFO ] [MAIN ] TEN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:36.031215] [INFO ] [MAIN ] TEF: Generated 1807 derivative records from 37607 primary records. [2025-10-02T22:45:36.031823] [DEBUG] [LOCAL ] TEF: Saving derivative data. [2025-10-02T22:45:36.050875] [DEBUG] [LOCAL ] TEF: Derivative data saved (1807 records). [2025-10-02T22:45:36.051883] [INFO ] [MAIN ] TEF: Successfully saved derivative data. [2025-10-02T22:45:36.054675] [INFO ] [MAIN ] Derivative Progress: 1688/1975 symbols completed. TEF took 1.2s. Estimated remaining: 2m 0s. Rate: 143.3 symbols/min [2025-10-02T22:45:36.054895] [INFO ] [MAIN ] TEO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:36.088607] [DEBUG] [MAIN ] TEL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:36.098065] [INFO ] [MAIN ] TEL: Generated 1807 derivative records from 51470 primary records. [2025-10-02T22:45:36.099181] [DEBUG] [LOCAL ] TEL: Saving derivative data. [2025-10-02T22:45:36.100710] [DEBUG] [LOCAL ] TEN: Loaded 30835 existing records from primary storage. [2025-10-02T22:45:36.101084] [INFO ] [MAIN ] TEN: Loaded 30835 primary data records. [2025-10-02T22:45:36.160184] [DEBUG] [LOCAL ] TEO: Loaded 22243 existing records from primary storage. [2025-10-02T22:45:36.186879] [INFO ] [MAIN ] TEO: Loaded 22243 primary data records. [2025-10-02T22:45:36.212062] [DEBUG] [LOCAL ] TEL: Derivative data saved (1807 records). [2025-10-02T22:45:36.217352] [INFO ] [MAIN ] TEL: Successfully saved derivative data. [2025-10-02T22:45:36.230788] [INFO ] [MAIN ] Derivative Progress: 1689/1975 symbols completed. TEL took 1.2s. Estimated remaining: 1m 60s. Rate: 143.4 symbols/min [2025-10-02T22:45:36.268912] [INFO ] [MAIN ] TEVA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:36.822204] [DEBUG] [LOCAL ] TEVA: Loaded 54022 existing records from primary storage. [2025-10-02T22:45:36.822783] [INFO ] [MAIN ] TEVA: Loaded 54022 primary data records. [2025-10-02T22:45:36.932120] [DEBUG] [MAIN ] TEN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:36.957214] [INFO ] [MAIN ] TEN: Generated 1807 derivative records from 30835 primary records. [2025-10-02T22:45:36.991343] [DEBUG] [LOCAL ] TEN: Saving derivative data. [2025-10-02T22:45:36.991945] [DEBUG] [MAIN ] TEO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:37.026278] [INFO ] [MAIN ] TEO: Generated 1807 derivative records from 22243 primary records. [2025-10-02T22:45:37.033348] [DEBUG] [LOCAL ] TEO: Saving derivative data. [2025-10-02T22:45:37.214272] [DEBUG] [LOCAL ] TEO: Derivative data saved (1807 records). [2025-10-02T22:45:37.216843] [INFO ] [MAIN ] TEO: Successfully saved derivative data. [2025-10-02T22:45:37.220331] [INFO ] [MAIN ] Derivative Progress: 1690/1975 symbols completed. TEO took 1.2s. Estimated remaining: 1m 59s. Rate: 143.2 symbols/min [2025-10-02T22:45:37.221174] [INFO ] [MAIN ] TEX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:37.223089] [DEBUG] [LOCAL ] TEN: Derivative data saved (1807 records). [2025-10-02T22:45:37.223329] [INFO ] [MAIN ] TEN: Successfully saved derivative data. [2025-10-02T22:45:37.225725] [INFO ] [MAIN ] Derivative Progress: 1691/1975 symbols completed. TEN took 1.2s. Estimated remaining: 1m 59s. Rate: 143.3 symbols/min [2025-10-02T22:45:37.226043] [INFO ] [MAIN ] TFC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:37.250475] [DEBUG] [MAIN ] TEVA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:37.251514] [INFO ] [MAIN ] TEVA: Generated 1807 derivative records from 54022 primary records. [2025-10-02T22:45:37.251670] [DEBUG] [LOCAL ] TEVA: Saving derivative data. [2025-10-02T22:45:37.269406] [DEBUG] [LOCAL ] TEVA: Derivative data saved (1807 records). [2025-10-02T22:45:37.279798] [INFO ] [MAIN ] TEVA: Successfully saved derivative data. [2025-10-02T22:45:37.282013] [INFO ] [MAIN ] Derivative Progress: 1692/1975 symbols completed. TEVA took 1.0s. Estimated remaining: 1m 58s. Rate: 143.4 symbols/min [2025-10-02T22:45:37.282311] [INFO ] [MAIN ] TFII: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:37.313333] [DEBUG] [LOCAL ] TEX: Loaded 44483 existing records from primary storage. [2025-10-02T22:45:37.313519] [INFO ] [MAIN ] TEX: Loaded 44483 primary data records. [2025-10-02T22:45:37.422065] [DEBUG] [LOCAL ] TFC: Loaded 54057 existing records from primary storage. [2025-10-02T22:45:37.451318] [INFO ] [MAIN ] TFC: Loaded 54057 primary data records. [2025-10-02T22:45:37.606281] [DEBUG] [LOCAL ] TFII: Loaded 33919 existing records from primary storage. [2025-10-02T22:45:37.646814] [INFO ] [MAIN ] TFII: Loaded 33919 primary data records. [2025-10-02T22:45:38.383806] [DEBUG] [MAIN ] TEX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:38.384917] [INFO ] [MAIN ] TEX: Generated 1807 derivative records from 44483 primary records. [2025-10-02T22:45:38.386075] [DEBUG] [LOCAL ] TEX: Saving derivative data. [2025-10-02T22:45:38.418103] [DEBUG] [MAIN ] TFC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:38.412773] [DEBUG] [LOCAL ] TEX: Derivative data saved (1807 records). [2025-10-02T22:45:38.418252] [INFO ] [MAIN ] TEX: Successfully saved derivative data. [2025-10-02T22:45:38.420257] [INFO ] [MAIN ] Derivative Progress: 1693/1975 symbols completed. TEX took 1.2s. Estimated remaining: 1m 58s. Rate: 143.3 symbols/min [2025-10-02T22:45:38.421417] [INFO ] [MAIN ] TFC: Generated 1807 derivative records from 54057 primary records. [2025-10-02T22:45:38.421677] [DEBUG] [LOCAL ] TFC: Saving derivative data. [2025-10-02T22:45:38.440851] [DEBUG] [LOCAL ] TFC: Derivative data saved (1807 records). [2025-10-02T22:45:38.440961] [INFO ] [MAIN ] TFC: Successfully saved derivative data. [2025-10-02T22:45:38.443090] [INFO ] [MAIN ] Derivative Progress: 1694/1975 symbols completed. TFC took 1.2s. Estimated remaining: 1m 58s. Rate: 143.3 symbols/min [2025-10-02T22:45:38.455906] [DEBUG] [MAIN ] TFII: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:38.456547] [INFO ] [MAIN ] TFII: Generated 1807 derivative records from 33919 primary records. [2025-10-02T22:45:38.456611] [DEBUG] [LOCAL ] TFII: Saving derivative data. [2025-10-02T22:45:38.472448] [DEBUG] [LOCAL ] TFII: Derivative data saved (1807 records). [2025-10-02T22:45:38.472526] [INFO ] [MAIN ] TFII: Successfully saved derivative data. [2025-10-02T22:45:38.474427] [INFO ] [MAIN ] Derivative Progress: 1695/1975 symbols completed. TFII took 1.2s. Estimated remaining: 1m 57s. Rate: 143.4 symbols/min [2025-10-02T22:45:38.474906] [INFO ] [MAIN ] TFIN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:38.474829] [INFO ] [MAIN ] TFPM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:38.475011] [INFO ] [MAIN ] TFX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:38.503076] [DEBUG] [LOCAL ] TFIN: Loaded 23641 existing records from primary storage. [2025-10-02T22:45:38.503353] [INFO ] [MAIN ] TFIN: Loaded 23641 primary data records. [2025-10-02T22:45:38.740788] [DEBUG] [LOCAL ] TFPM: Loaded 38300 existing records from primary storage. [2025-10-02T22:45:38.859389] [DEBUG] [LOCAL ] TFX: Loaded 37363 existing records from primary storage. [2025-10-02T22:45:38.868772] [INFO ] [MAIN ] TFX: Loaded 37363 primary data records. [2025-10-02T22:45:38.868489] [INFO ] [MAIN ] TFPM: Loaded 38300 primary data records. [2025-10-02T22:45:39.653014] [DEBUG] [MAIN ] TFIN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:39.654990] [INFO ] [MAIN ] TFIN: Generated 1807 derivative records from 23641 primary records. [2025-10-02T22:45:39.655854] [DEBUG] [LOCAL ] TFIN: Saving derivative data. [2025-10-02T22:45:39.679506] [DEBUG] [LOCAL ] TFIN: Derivative data saved (1807 records). [2025-10-02T22:45:39.680352] [INFO ] [MAIN ] TFIN: Successfully saved derivative data. [2025-10-02T22:45:39.682870] [INFO ] [MAIN ] Derivative Progress: 1696/1975 symbols completed. TFIN took 1.2s. Estimated remaining: 1m 57s. Rate: 143.3 symbols/min [2025-10-02T22:45:39.683433] [INFO ] [MAIN ] TG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:39.714205] [DEBUG] [MAIN ] TFPM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:39.715489] [INFO ] [MAIN ] TFPM: Generated 1807 derivative records from 38300 primary records. [2025-10-02T22:45:39.715769] [DEBUG] [LOCAL ] TFPM: Saving derivative data. [2025-10-02T22:45:39.723090] [DEBUG] [LOCAL ] TG: Loaded 10488 existing records from primary storage. [2025-10-02T22:45:39.725981] [INFO ] [MAIN ] TG: Loaded 10488 primary data records. [2025-10-02T22:45:39.797292] [DEBUG] [MAIN ] TFX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:39.805030] [INFO ] [MAIN ] TFX: Generated 1807 derivative records from 37363 primary records. [2025-10-02T22:45:39.820972] [DEBUG] [LOCAL ] TFX: Saving derivative data. [2025-10-02T22:45:39.809761] [DEBUG] [LOCAL ] TFPM: Derivative data saved (1807 records). [2025-10-02T22:45:39.843500] [INFO ] [MAIN ] TFPM: Successfully saved derivative data. [2025-10-02T22:45:39.894247] [INFO ] [MAIN ] Derivative Progress: 1697/1975 symbols completed. TFPM took 1.4s. Estimated remaining: 1m 56s. Rate: 143.3 symbols/min [2025-10-02T22:45:39.911925] [INFO ] [MAIN ] TGLS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:39.936059] [DEBUG] [LOCAL ] TFX: Derivative data saved (1807 records). [2025-10-02T22:45:39.957376] [INFO ] [MAIN ] TFX: Successfully saved derivative data. [2025-10-02T22:45:39.961165] [INFO ] [MAIN ] Derivative Progress: 1698/1975 symbols completed. TFX took 1.5s. Estimated remaining: 1m 56s. Rate: 143.4 symbols/min [2025-10-02T22:45:39.968104] [INFO ] [MAIN ] TGNA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:40.278386] [DEBUG] [LOCAL ] TGLS: Loaded 28157 existing records from primary storage. [2025-10-02T22:45:40.278754] [INFO ] [MAIN ] TGLS: Loaded 28157 primary data records. [2025-10-02T22:45:40.495357] [DEBUG] [LOCAL ] TGNA: Loaded 49036 existing records from primary storage. [2025-10-02T22:45:40.521266] [INFO ] [MAIN ] TGNA: Loaded 49036 primary data records. [2025-10-02T22:45:40.731710] [DEBUG] [MAIN ] TG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:40.757725] [INFO ] [MAIN ] TG: Generated 1807 derivative records from 10488 primary records. [2025-10-02T22:45:40.769364] [DEBUG] [LOCAL ] TG: Saving derivative data. [2025-10-02T22:45:40.932366] [DEBUG] [LOCAL ] TG: Derivative data saved (1807 records). [2025-10-02T22:45:41.027131] [INFO ] [MAIN ] TG: Successfully saved derivative data. [2025-10-02T22:45:41.031419] [INFO ] [MAIN ] Derivative Progress: 1699/1975 symbols completed. TG took 1.3s. Estimated remaining: 1m 56s. Rate: 143.2 symbols/min [2025-10-02T22:45:41.032206] [INFO ] [MAIN ] TGS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:41.053906] [DEBUG] [MAIN ] TGLS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:41.054969] [INFO ] [MAIN ] TGLS: Generated 1807 derivative records from 28157 primary records. [2025-10-02T22:45:41.055214] [DEBUG] [LOCAL ] TGLS: Saving derivative data. [2025-10-02T22:45:41.077280] [DEBUG] [LOCAL ] TGLS: Derivative data saved (1807 records). [2025-10-02T22:45:41.085904] [INFO ] [MAIN ] TGLS: Successfully saved derivative data. [2025-10-02T22:45:41.088334] [INFO ] [MAIN ] Derivative Progress: 1700/1975 symbols completed. TGLS took 1.2s. Estimated remaining: 1m 55s. Rate: 143.3 symbols/min [2025-10-02T22:45:41.088874] [INFO ] [MAIN ] TGT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:41.116957] [DEBUG] [MAIN ] TGNA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:41.117924] [INFO ] [MAIN ] TGNA: Generated 1807 derivative records from 49036 primary records. [2025-10-02T22:45:41.118960] [DEBUG] [LOCAL ] TGS: Loaded 33155 existing records from primary storage. [2025-10-02T22:45:41.118052] [DEBUG] [LOCAL ] TGNA: Saving derivative data. [2025-10-02T22:45:41.119068] [INFO ] [MAIN ] TGS: Loaded 33155 primary data records. [2025-10-02T22:45:41.236039] [DEBUG] [LOCAL ] TGNA: Derivative data saved (1807 records). [2025-10-02T22:45:41.257552] [INFO ] [MAIN ] TGNA: Successfully saved derivative data. [2025-10-02T22:45:41.260093] [INFO ] [MAIN ] Derivative Progress: 1701/1975 symbols completed. TGNA took 1.3s. Estimated remaining: 1m 55s. Rate: 143.4 symbols/min [2025-10-02T22:45:41.266188] [INFO ] [MAIN ] THC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:41.502130] [DEBUG] [LOCAL ] TGT: Loaded 54168 existing records from primary storage. [2025-10-02T22:45:41.502635] [INFO ] [MAIN ] TGT: Loaded 54168 primary data records. [2025-10-02T22:45:41.730712] [DEBUG] [LOCAL ] THC: Loaded 47953 existing records from primary storage. [2025-10-02T22:45:41.740870] [INFO ] [MAIN ] THC: Loaded 47953 primary data records. [2025-10-02T22:45:42.068811] [DEBUG] [MAIN ] TGS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:42.092393] [INFO ] [MAIN ] TGS: Generated 1807 derivative records from 33155 primary records. [2025-10-02T22:45:42.264540] [DEBUG] [LOCAL ] TGS: Saving derivative data. [2025-10-02T22:45:42.286384] [DEBUG] [LOCAL ] TGS: Derivative data saved (1807 records). [2025-10-02T22:45:42.286839] [INFO ] [MAIN ] TGS: Successfully saved derivative data. [2025-10-02T22:45:42.289408] [INFO ] [MAIN ] Derivative Progress: 1702/1975 symbols completed. TGS took 1.3s. Estimated remaining: 1m 54s. Rate: 143.2 symbols/min [2025-10-02T22:45:42.289770] [INFO ] [MAIN ] THG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:42.314902] [DEBUG] [MAIN ] TGT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:42.316135] [INFO ] [MAIN ] TGT: Generated 1807 derivative records from 54168 primary records. [2025-10-02T22:45:42.316416] [DEBUG] [LOCAL ] TGT: Saving derivative data. [2025-10-02T22:45:42.342391] [DEBUG] [LOCAL ] TGT: Derivative data saved (1807 records). [2025-10-02T22:45:42.342523] [INFO ] [MAIN ] TGT: Successfully saved derivative data. [2025-10-02T22:45:42.344617] [INFO ] [MAIN ] Derivative Progress: 1703/1975 symbols completed. TGT took 1.3s. Estimated remaining: 1m 54s. Rate: 143.3 symbols/min [2025-10-02T22:45:42.345090] [INFO ] [MAIN ] THIR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:42.358851] [DEBUG] [LOCAL ] THIR: Loaded 2221 existing records from primary storage. [2025-10-02T22:45:42.371503] [INFO ] [MAIN ] THIR: Loaded 2221 primary data records. [2025-10-02T22:45:42.384824] [DEBUG] [MAIN ] THC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:42.405066] [INFO ] [MAIN ] THC: Generated 1807 derivative records from 47953 primary records. [2025-10-02T22:45:42.404294] [DEBUG] [LOCAL ] THG: Loaded 21842 existing records from primary storage. [2025-10-02T22:45:42.434826] [INFO ] [MAIN ] THG: Loaded 21842 primary data records. [2025-10-02T22:45:42.434743] [DEBUG] [LOCAL ] THC: Saving derivative data. [2025-10-02T22:45:42.731999] [DEBUG] [LOCAL ] THC: Derivative data saved (1807 records). [2025-10-02T22:45:42.864848] [INFO ] [MAIN ] THC: Successfully saved derivative data. [2025-10-02T22:45:42.874491] [INFO ] [MAIN ] Derivative Progress: 1704/1975 symbols completed. THC took 1.6s. Estimated remaining: 1m 53s. Rate: 143.3 symbols/min [2025-10-02T22:45:42.874944] [INFO ] [MAIN ] THLV: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:42.934891] [DEBUG] [LOCAL ] THLV: Loaded 1553 existing records from primary storage. [2025-10-02T22:45:42.937767] [INFO ] [MAIN ] THLV: Loaded 1553 primary data records. [2025-10-02T22:45:43.437275] [DEBUG] [MAIN ] THIR: Filtered 6966 bins outside market hours, 7769 incomplete bins [2025-10-02T22:45:43.438541] [INFO ] [MAIN ] THIR: Generated 1797 derivative records from 2221 primary records. [2025-10-02T22:45:43.439825] [DEBUG] [LOCAL ] THIR: Saving derivative data. [2025-10-02T22:45:43.472087] [DEBUG] [LOCAL ] THIR: Derivative data saved (1797 records). [2025-10-02T22:45:43.473135] [INFO ] [MAIN ] THIR: Successfully saved derivative data. [2025-10-02T22:45:43.475519] [INFO ] [MAIN ] Derivative Progress: 1705/1975 symbols completed. THIR took 1.1s. Estimated remaining: 1m 53s. Rate: 143.3 symbols/min [2025-10-02T22:45:43.476234] [INFO ] [MAIN ] THO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:43.475859] [DEBUG] [MAIN ] THG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:43.478215] [INFO ] [MAIN ] THG: Generated 1807 derivative records from 21842 primary records. [2025-10-02T22:45:43.478670] [DEBUG] [LOCAL ] THG: Saving derivative data. [2025-10-02T22:45:43.516363] [DEBUG] [LOCAL ] THG: Derivative data saved (1807 records). [2025-10-02T22:45:43.515580] [DEBUG] [MAIN ] THLV: Filtered 6966 bins outside market hours, 7765 incomplete bins [2025-10-02T22:45:43.517593] [INFO ] [MAIN ] THLV: Generated 1801 derivative records from 1553 primary records. [2025-10-02T22:45:43.517731] [DEBUG] [LOCAL ] THLV: Saving derivative data. [2025-10-02T22:45:43.516575] [INFO ] [MAIN ] THG: Successfully saved derivative data. [2025-10-02T22:45:43.520978] [INFO ] [MAIN ] Derivative Progress: 1706/1975 symbols completed. THG took 1.2s. Estimated remaining: 1m 53s. Rate: 143.3 symbols/min [2025-10-02T22:45:43.521191] [INFO ] [MAIN ] THQ: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:43.550241] [DEBUG] [LOCAL ] THLV: Derivative data saved (1801 records). [2025-10-02T22:45:43.550533] [INFO ] [MAIN ] THLV: Successfully saved derivative data. [2025-10-02T22:45:43.553277] [INFO ] [MAIN ] Derivative Progress: 1707/1975 symbols completed. THLV took 0.7s. Estimated remaining: 1m 52s. Rate: 143.4 symbols/min [2025-10-02T22:45:43.553780] [INFO ] [MAIN ] THR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:43.570617] [DEBUG] [LOCAL ] THO: Loaded 42163 existing records from primary storage. [2025-10-02T22:45:43.577699] [INFO ] [MAIN ] THO: Loaded 42163 primary data records. [2025-10-02T22:45:43.665793] [DEBUG] [LOCAL ] THQ: Loaded 25177 existing records from primary storage. [2025-10-02T22:45:43.678858] [INFO ] [MAIN ] THQ: Loaded 25177 primary data records. [2025-10-02T22:45:43.758258] [DEBUG] [LOCAL ] THR: Loaded 19967 existing records from primary storage. [2025-10-02T22:45:43.781912] [INFO ] [MAIN ] THR: Loaded 19967 primary data records. [2025-10-02T22:45:44.690476] [DEBUG] [MAIN ] THO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:44.691701] [INFO ] [MAIN ] THO: Generated 1807 derivative records from 42163 primary records. [2025-10-02T22:45:44.691915] [DEBUG] [LOCAL ] THO: Saving derivative data. [2025-10-02T22:45:44.714090] [DEBUG] [LOCAL ] THO: Derivative data saved (1807 records). [2025-10-02T22:45:44.727598] [INFO ] [MAIN ] THO: Successfully saved derivative data. [2025-10-02T22:45:44.727922] [DEBUG] [MAIN ] THQ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:44.730151] [INFO ] [MAIN ] Derivative Progress: 1708/1975 symbols completed. THO took 1.3s. Estimated remaining: 1m 52s. Rate: 143.3 symbols/min [2025-10-02T22:45:44.731428] [INFO ] [MAIN ] THQ: Generated 1807 derivative records from 25177 primary records. [2025-10-02T22:45:44.733480] [DEBUG] [LOCAL ] THQ: Saving derivative data. [2025-10-02T22:45:44.757794] [DEBUG] [MAIN ] THR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:44.762101] [INFO ] [MAIN ] THR: Generated 1807 derivative records from 19967 primary records. [2025-10-02T22:45:44.762429] [DEBUG] [LOCAL ] THR: Saving derivative data. [2025-10-02T22:45:44.781750] [DEBUG] [LOCAL ] THQ: Derivative data saved (1807 records). [2025-10-02T22:45:44.782979] [INFO ] [MAIN ] THQ: Successfully saved derivative data. [2025-10-02T22:45:44.785501] [INFO ] [MAIN ] Derivative Progress: 1709/1975 symbols completed. THQ took 1.3s. Estimated remaining: 1m 51s. Rate: 143.3 symbols/min [2025-10-02T22:45:44.783294] [DEBUG] [LOCAL ] THR: Derivative data saved (1807 records). [2025-10-02T22:45:44.785915] [INFO ] [MAIN ] THR: Successfully saved derivative data. [2025-10-02T22:45:44.788510] [INFO ] [MAIN ] Derivative Progress: 1710/1975 symbols completed. THR took 1.2s. Estimated remaining: 1m 51s. Rate: 143.4 symbols/min [2025-10-02T22:45:44.789217] [INFO ] [MAIN ] TIMB: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:44.789147] [INFO ] [MAIN ] THW: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:44.789051] [INFO ] [MAIN ] THS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:44.811079] [DEBUG] [LOCAL ] THW: Loaded 19556 existing records from primary storage. [2025-10-02T22:45:44.811247] [INFO ] [MAIN ] THW: Loaded 19556 primary data records. [2025-10-02T22:45:44.988846] [DEBUG] [LOCAL ] TIMB: Loaded 36298 existing records from primary storage. [2025-10-02T22:45:45.031376] [INFO ] [MAIN ] TIMB: Loaded 36298 primary data records. [2025-10-02T22:45:45.013810] [DEBUG] [LOCAL ] THS: Loaded 38521 existing records from primary storage. [2025-10-02T22:45:45.068965] [INFO ] [MAIN ] THS: Loaded 38521 primary data records. [2025-10-02T22:45:45.883051] [DEBUG] [MAIN ] THW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:45.884216] [INFO ] [MAIN ] THW: Generated 1807 derivative records from 19556 primary records. [2025-10-02T22:45:45.884474] [DEBUG] [LOCAL ] THW: Saving derivative data. [2025-10-02T22:45:45.919175] [DEBUG] [MAIN ] TIMB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:45.920703] [INFO ] [MAIN ] TIMB: Generated 1807 derivative records from 36298 primary records. [2025-10-02T22:45:45.921321] [DEBUG] [LOCAL ] TIMB: Saving derivative data. [2025-10-02T22:45:45.934722] [DEBUG] [LOCAL ] THW: Derivative data saved (1807 records). [2025-10-02T22:45:45.940741] [INFO ] [MAIN ] THW: Successfully saved derivative data. [2025-10-02T22:45:45.943502] [INFO ] [MAIN ] Derivative Progress: 1711/1975 symbols completed. THW took 1.2s. Estimated remaining: 1m 51s. Rate: 143.3 symbols/min [2025-10-02T22:45:45.943955] [INFO ] [MAIN ] TISI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:45.963076] [DEBUG] [MAIN ] THS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:45.968715] [DEBUG] [LOCAL ] TISI: Loaded 3764 existing records from primary storage. [2025-10-02T22:45:45.965072] [INFO ] [MAIN ] THS: Generated 1807 derivative records from 38521 primary records. [2025-10-02T22:45:45.969822] [DEBUG] [LOCAL ] THS: Saving derivative data. [2025-10-02T22:45:45.970514] [INFO ] [MAIN ] TISI: Loaded 3764 primary data records. [2025-10-02T22:45:45.970387] [DEBUG] [LOCAL ] TIMB: Derivative data saved (1807 records). [2025-10-02T22:45:46.040256] [INFO ] [MAIN ] TIMB: Successfully saved derivative data. [2025-10-02T22:45:46.077938] [INFO ] [MAIN ] Derivative Progress: 1712/1975 symbols completed. TIMB took 1.3s. Estimated remaining: 1m 50s. Rate: 143.3 symbols/min [2025-10-02T22:45:46.092009] [DEBUG] [LOCAL ] THS: Derivative data saved (1807 records). [2025-10-02T22:45:46.104099] [INFO ] [MAIN ] TIXT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:46.104406] [INFO ] [MAIN ] THS: Successfully saved derivative data. [2025-10-02T22:45:46.107105] [INFO ] [MAIN ] Derivative Progress: 1713/1975 symbols completed. THS took 1.3s. Estimated remaining: 1m 50s. Rate: 143.4 symbols/min [2025-10-02T22:45:46.124016] [INFO ] [MAIN ] TJX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:46.339442] [DEBUG] [LOCAL ] TIXT: Loaded 31892 existing records from primary storage. [2025-10-02T22:45:46.340978] [INFO ] [MAIN ] TIXT: Loaded 31892 primary data records. [2025-10-02T22:45:46.755462] [DEBUG] [LOCAL ] TJX: Loaded 54058 existing records from primary storage. [2025-10-02T22:45:46.754067] [DEBUG] [MAIN ] TISI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:46.756290] [INFO ] [MAIN ] TJX: Loaded 54058 primary data records. [2025-10-02T22:45:46.757253] [INFO ] [MAIN ] TISI: Generated 1807 derivative records from 3764 primary records. [2025-10-02T22:45:46.780073] [DEBUG] [LOCAL ] TISI: Saving derivative data. [2025-10-02T22:45:46.890368] [DEBUG] [LOCAL ] TISI: Derivative data saved (1807 records). [2025-10-02T22:45:46.891283] [INFO ] [MAIN ] TISI: Successfully saved derivative data. [2025-10-02T22:45:46.893505] [INFO ] [MAIN ] Derivative Progress: 1714/1975 symbols completed. TISI took 0.9s. Estimated remaining: 1m 49s. Rate: 143.3 symbols/min [2025-10-02T22:45:46.894343] [INFO ] [MAIN ] TK: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:47.130750] [DEBUG] [MAIN ] TIXT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:47.131813] [INFO ] [MAIN ] TIXT: Generated 1807 derivative records from 31892 primary records. [2025-10-02T22:45:47.141669] [DEBUG] [LOCAL ] TIXT: Saving derivative data. [2025-10-02T22:45:47.174331] [DEBUG] [LOCAL ] TIXT: Derivative data saved (1807 records). [2025-10-02T22:45:47.174596] [INFO ] [MAIN ] TIXT: Successfully saved derivative data. [2025-10-02T22:45:47.177535] [INFO ] [MAIN ] Derivative Progress: 1715/1975 symbols completed. TIXT took 1.1s. Estimated remaining: 1m 49s. Rate: 143.4 symbols/min [2025-10-02T22:45:47.178020] [INFO ] [MAIN ] TKC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:47.179609] [DEBUG] [LOCAL ] TK: Loaded 39741 existing records from primary storage. [2025-10-02T22:45:47.179958] [INFO ] [MAIN ] TK: Loaded 39741 primary data records. [2025-10-02T22:45:47.553888] [DEBUG] [LOCAL ] TKC: Loaded 39332 existing records from primary storage. [2025-10-02T22:45:47.566639] [INFO ] [MAIN ] TKC: Loaded 39332 primary data records. [2025-10-02T22:45:47.573139] [DEBUG] [MAIN ] TJX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:47.575580] [INFO ] [MAIN ] TJX: Generated 1807 derivative records from 54058 primary records. [2025-10-02T22:45:47.607174] [DEBUG] [LOCAL ] TJX: Saving derivative data. [2025-10-02T22:45:47.780332] [DEBUG] [LOCAL ] TJX: Derivative data saved (1807 records). [2025-10-02T22:45:47.818059] [INFO ] [MAIN ] TJX: Successfully saved derivative data. [2025-10-02T22:45:47.827564] [INFO ] [MAIN ] Derivative Progress: 1716/1975 symbols completed. TJX took 1.7s. Estimated remaining: 1m 48s. Rate: 143.3 symbols/min [2025-10-02T22:45:47.943717] [INFO ] [MAIN ] TKO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:47.973775] [DEBUG] [MAIN ] TK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:47.975095] [INFO ] [MAIN ] TK: Generated 1807 derivative records from 39741 primary records. [2025-10-02T22:45:47.975591] [DEBUG] [LOCAL ] TK: Saving derivative data. [2025-10-02T22:45:47.996281] [DEBUG] [LOCAL ] TK: Derivative data saved (1807 records). [2025-10-02T22:45:47.996610] [INFO ] [MAIN ] TK: Successfully saved derivative data. [2025-10-02T22:45:47.999062] [INFO ] [MAIN ] Derivative Progress: 1717/1975 symbols completed. TK took 1.1s. Estimated remaining: 1m 48s. Rate: 143.4 symbols/min [2025-10-02T22:45:47.999445] [INFO ] [MAIN ] TLK: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:48.030351] [DEBUG] [MAIN ] TKC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:48.031231] [INFO ] [MAIN ] TKC: Generated 1807 derivative records from 39332 primary records. [2025-10-02T22:45:48.031466] [DEBUG] [LOCAL ] TKC: Saving derivative data. [2025-10-02T22:45:48.060553] [DEBUG] [LOCAL ] TKO: Loaded 44401 existing records from primary storage. [2025-10-02T22:45:48.062897] [INFO ] [MAIN ] TKO: Loaded 44401 primary data records. [2025-10-02T22:45:48.137079] [DEBUG] [LOCAL ] TKC: Derivative data saved (1807 records). [2025-10-02T22:45:48.188103] [INFO ] [MAIN ] TKC: Successfully saved derivative data. [2025-10-02T22:45:48.205699] [INFO ] [MAIN ] Derivative Progress: 1718/1975 symbols completed. TKC took 1.0s. Estimated remaining: 1m 48s. Rate: 143.4 symbols/min [2025-10-02T22:45:48.257117] [INFO ] [MAIN ] TLYS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:48.233817] [DEBUG] [LOCAL ] TLK: Loaded 39485 existing records from primary storage. [2025-10-02T22:45:48.410503] [INFO ] [MAIN ] TLK: Loaded 39485 primary data records. [2025-10-02T22:45:48.569984] [DEBUG] [LOCAL ] TLYS: Loaded 16614 existing records from primary storage. [2025-10-02T22:45:48.580499] [INFO ] [MAIN ] TLYS: Loaded 16614 primary data records. [2025-10-02T22:45:49.161599] [DEBUG] [MAIN ] TKO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:49.162778] [INFO ] [MAIN ] TKO: Generated 1807 derivative records from 44401 primary records. [2025-10-02T22:45:49.162933] [DEBUG] [LOCAL ] TKO: Saving derivative data. [2025-10-02T22:45:49.190239] [DEBUG] [LOCAL ] TKO: Derivative data saved (1807 records). [2025-10-02T22:45:49.190573] [INFO ] [MAIN ] TKO: Successfully saved derivative data. [2025-10-02T22:45:49.192743] [INFO ] [MAIN ] Derivative Progress: 1719/1975 symbols completed. TKO took 1.2s. Estimated remaining: 1m 47s. Rate: 143.3 symbols/min [2025-10-02T22:45:49.193148] [INFO ] [MAIN ] TM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:49.206858] [DEBUG] [MAIN ] TLK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:49.207919] [INFO ] [MAIN ] TLK: Generated 1807 derivative records from 39485 primary records. [2025-10-02T22:45:49.208275] [DEBUG] [LOCAL ] TLK: Saving derivative data. [2025-10-02T22:45:49.239166] [DEBUG] [MAIN ] TLYS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:49.240408] [INFO ] [MAIN ] TLYS: Generated 1807 derivative records from 16614 primary records. [2025-10-02T22:45:49.241062] [DEBUG] [LOCAL ] TLYS: Saving derivative data. [2025-10-02T22:45:49.250886] [DEBUG] [LOCAL ] TLK: Derivative data saved (1807 records). [2025-10-02T22:45:49.252018] [INFO ] [MAIN ] TLK: Successfully saved derivative data. [2025-10-02T22:45:49.257455] [INFO ] [MAIN ] Derivative Progress: 1720/1975 symbols completed. TLK took 1.3s. Estimated remaining: 1m 47s. Rate: 143.4 symbols/min [2025-10-02T22:45:49.259243] [INFO ] [MAIN ] TME: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:49.272680] [DEBUG] [LOCAL ] TLYS: Derivative data saved (1807 records). [2025-10-02T22:45:49.272991] [INFO ] [MAIN ] TLYS: Successfully saved derivative data. [2025-10-02T22:45:49.275108] [INFO ] [MAIN ] Derivative Progress: 1721/1975 symbols completed. TLYS took 1.0s. Estimated remaining: 1m 46s. Rate: 143.4 symbols/min [2025-10-02T22:45:49.275363] [INFO ] [MAIN ] TMHC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:49.289963] [DEBUG] [LOCAL ] TM: Loaded 36607 existing records from primary storage. [2025-10-02T22:45:49.290217] [INFO ] [MAIN ] TM: Loaded 36607 primary data records. [2025-10-02T22:45:49.726819] [DEBUG] [LOCAL ] TME: Loaded 53582 existing records from primary storage. [2025-10-02T22:45:49.725169] [DEBUG] [LOCAL ] TMHC: Loaded 45663 existing records from primary storage. [2025-10-02T22:45:49.727220] [INFO ] [MAIN ] TME: Loaded 53582 primary data records. [2025-10-02T22:45:49.745065] [INFO ] [MAIN ] TMHC: Loaded 45663 primary data records. [2025-10-02T22:45:50.447969] [DEBUG] [MAIN ] TM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:50.449914] [INFO ] [MAIN ] TM: Generated 1807 derivative records from 36607 primary records. [2025-10-02T22:45:50.450269] [DEBUG] [LOCAL ] TM: Saving derivative data. [2025-10-02T22:45:50.475494] [DEBUG] [LOCAL ] TM: Derivative data saved (1807 records). [2025-10-02T22:45:50.476267] [INFO ] [MAIN ] TM: Successfully saved derivative data. [2025-10-02T22:45:50.478851] [INFO ] [MAIN ] Derivative Progress: 1722/1975 symbols completed. TM took 1.3s. Estimated remaining: 1m 46s. Rate: 143.3 symbols/min [2025-10-02T22:45:50.479307] [INFO ] [MAIN ] TMO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:50.500194] [DEBUG] [MAIN ] TMHC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:50.513286] [INFO ] [MAIN ] TMHC: Generated 1807 derivative records from 45663 primary records. [2025-10-02T22:45:50.514032] [DEBUG] [LOCAL ] TMHC: Saving derivative data. [2025-10-02T22:45:50.514704] [DEBUG] [MAIN ] TME: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:50.516039] [INFO ] [MAIN ] TME: Generated 1807 derivative records from 53582 primary records. [2025-10-02T22:45:50.516437] [DEBUG] [LOCAL ] TME: Saving derivative data. [2025-10-02T22:45:50.542743] [DEBUG] [LOCAL ] TMHC: Derivative data saved (1807 records). [2025-10-02T22:45:50.543088] [INFO ] [MAIN ] TMHC: Successfully saved derivative data. [2025-10-02T22:45:50.547813] [INFO ] [MAIN ] Derivative Progress: 1723/1975 symbols completed. TMHC took 1.3s. Estimated remaining: 1m 45s. Rate: 143.3 symbols/min [2025-10-02T22:45:50.553401] [DEBUG] [LOCAL ] TME: Derivative data saved (1807 records). [2025-10-02T22:45:50.553493] [INFO ] [MAIN ] TME: Successfully saved derivative data. [2025-10-02T22:45:50.555610] [INFO ] [MAIN ] Derivative Progress: 1724/1975 symbols completed. TME took 1.3s. Estimated remaining: 1m 45s. Rate: 143.4 symbols/min [2025-10-02T22:45:50.595826] [DEBUG] [LOCAL ] TMO: Loaded 52734 existing records from primary storage. [2025-10-02T22:45:50.596003] [INFO ] [MAIN ] TMO: Loaded 52734 primary data records. [2025-10-02T22:45:50.969245] [DEBUG] [MAIN ] TMO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:50.969920] [INFO ] [MAIN ] TMO: Generated 1807 derivative records from 52734 primary records. [2025-10-02T22:45:50.969984] [DEBUG] [LOCAL ] TMO: Saving derivative data. [2025-10-02T22:45:50.986559] [DEBUG] [LOCAL ] TMO: Derivative data saved (1807 records). [2025-10-02T22:45:50.986676] [INFO ] [MAIN ] TMO: Successfully saved derivative data. [2025-10-02T22:45:50.988776] [INFO ] [MAIN ] Derivative Progress: 1725/1975 symbols completed. TMO took 0.5s. Estimated remaining: 1m 45s. Rate: 143.4 symbols/min [2025-10-02T22:45:50.989904] [INFO ] [MAIN ] TNK: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:50.989784] [INFO ] [MAIN ] TNC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:50.989579] [INFO ] [MAIN ] TNET: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:51.010286] [DEBUG] [LOCAL ] TNC: Loaded 14932 existing records from primary storage. [2025-10-02T22:45:51.011458] [INFO ] [MAIN ] TNC: Loaded 14932 primary data records. [2025-10-02T22:45:51.175919] [DEBUG] [LOCAL ] TNET: Loaded 28712 existing records from primary storage. [2025-10-02T22:45:51.176157] [INFO ] [MAIN ] TNET: Loaded 28712 primary data records. [2025-10-02T22:45:51.177010] [DEBUG] [LOCAL ] TNK: Loaded 35408 existing records from primary storage. [2025-10-02T22:45:51.210703] [INFO ] [MAIN ] TNK: Loaded 35408 primary data records. [2025-10-02T22:45:52.079086] [DEBUG] [MAIN ] TNC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:52.080090] [INFO ] [MAIN ] TNC: Generated 1807 derivative records from 14932 primary records. [2025-10-02T22:45:52.082128] [DEBUG] [LOCAL ] TNC: Saving derivative data. [2025-10-02T22:45:52.114112] [DEBUG] [LOCAL ] TNC: Derivative data saved (1807 records). [2025-10-02T22:45:52.112971] [DEBUG] [MAIN ] TNET: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:52.115965] [INFO ] [MAIN ] TNET: Generated 1807 derivative records from 28712 primary records. [2025-10-02T22:45:52.116063] [DEBUG] [LOCAL ] TNET: Saving derivative data. [2025-10-02T22:45:52.114240] [INFO ] [MAIN ] TNC: Successfully saved derivative data. [2025-10-02T22:45:52.120252] [INFO ] [MAIN ] Derivative Progress: 1726/1975 symbols completed. TNC took 1.1s. Estimated remaining: 1m 44s. Rate: 143.3 symbols/min [2025-10-02T22:45:52.129387] [INFO ] [MAIN ] TNL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:52.149222] [DEBUG] [MAIN ] TNK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:52.150627] [INFO ] [MAIN ] TNK: Generated 1807 derivative records from 35408 primary records. [2025-10-02T22:45:52.151230] [DEBUG] [LOCAL ] TNK: Saving derivative data. [2025-10-02T22:45:52.153064] [DEBUG] [LOCAL ] TNET: Derivative data saved (1807 records). [2025-10-02T22:45:52.153240] [INFO ] [MAIN ] TNET: Successfully saved derivative data. [2025-10-02T22:45:52.156180] [INFO ] [MAIN ] Derivative Progress: 1727/1975 symbols completed. TNET took 1.2s. Estimated remaining: 1m 44s. Rate: 143.4 symbols/min [2025-10-02T22:45:52.163982] [INFO ] [MAIN ] TOL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:52.176245] [DEBUG] [LOCAL ] TNK: Derivative data saved (1807 records). [2025-10-02T22:45:52.176475] [INFO ] [MAIN ] TNK: Successfully saved derivative data. [2025-10-02T22:45:52.178582] [INFO ] [MAIN ] Derivative Progress: 1728/1975 symbols completed. TNK took 1.2s. Estimated remaining: 1m 43s. Rate: 143.4 symbols/min [2025-10-02T22:45:52.178803] [INFO ] [MAIN ] TOST: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:52.233163] [DEBUG] [LOCAL ] TNL: Loaded 41980 existing records from primary storage. [2025-10-02T22:45:52.234127] [INFO ] [MAIN ] TNL: Loaded 41980 primary data records. [2025-10-02T22:45:52.356559] [DEBUG] [LOCAL ] TOL: Loaded 51170 existing records from primary storage. [2025-10-02T22:45:52.390637] [INFO ] [MAIN ] TOL: Loaded 51170 primary data records. [2025-10-02T22:45:52.618753] [DEBUG] [LOCAL ] TOST: Loaded 54071 existing records from primary storage. [2025-10-02T22:45:52.744356] [INFO ] [MAIN ] TOST: Loaded 54071 primary data records. [2025-10-02T22:45:53.362269] [DEBUG] [MAIN ] TNL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:53.371875] [INFO ] [MAIN ] TNL: Generated 1807 derivative records from 41980 primary records. [2025-10-02T22:45:53.376861] [DEBUG] [LOCAL ] TNL: Saving derivative data. [2025-10-02T22:45:53.378306] [DEBUG] [MAIN ] TOL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:53.389406] [INFO ] [MAIN ] TOL: Generated 1807 derivative records from 51170 primary records. [2025-10-02T22:45:53.389617] [DEBUG] [LOCAL ] TOL: Saving derivative data. [2025-10-02T22:45:53.408159] [DEBUG] [MAIN ] TOST: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:53.416580] [INFO ] [MAIN ] TOST: Generated 1807 derivative records from 54071 primary records. [2025-10-02T22:45:53.417025] [DEBUG] [LOCAL ] TOST: Saving derivative data. [2025-10-02T22:45:53.438330] [DEBUG] [LOCAL ] TNL: Derivative data saved (1807 records). [2025-10-02T22:45:53.438748] [INFO ] [MAIN ] TNL: Successfully saved derivative data. [2025-10-02T22:45:53.441472] [INFO ] [MAIN ] Derivative Progress: 1729/1975 symbols completed. TNL took 1.3s. Estimated remaining: 1m 43s. Rate: 143.3 symbols/min [2025-10-02T22:45:53.442461] [INFO ] [MAIN ] TPB: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:53.448350] [DEBUG] [LOCAL ] TOL: Derivative data saved (1807 records). [2025-10-02T22:45:53.449802] [INFO ] [MAIN ] TOL: Successfully saved derivative data. [2025-10-02T22:45:53.453079] [INFO ] [MAIN ] Derivative Progress: 1730/1975 symbols completed. TOL took 1.3s. Estimated remaining: 1m 43s. Rate: 143.4 symbols/min [2025-10-02T22:45:53.453289] [INFO ] [MAIN ] TPC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:53.455879] [DEBUG] [LOCAL ] TOST: Derivative data saved (1807 records). [2025-10-02T22:45:53.456117] [INFO ] [MAIN ] TOST: Successfully saved derivative data. [2025-10-02T22:45:53.458800] [INFO ] [MAIN ] Derivative Progress: 1731/1975 symbols completed. TOST took 1.3s. Estimated remaining: 1m 42s. Rate: 143.4 symbols/min [2025-10-02T22:45:53.459268] [INFO ] [MAIN ] TPH: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:53.485891] [DEBUG] [LOCAL ] TPB: Loaded 25252 existing records from primary storage. [2025-10-02T22:45:53.486145] [INFO ] [MAIN ] TPB: Loaded 25252 primary data records. [2025-10-02T22:45:53.649605] [DEBUG] [LOCAL ] TPC: Loaded 39075 existing records from primary storage. [2025-10-02T22:45:53.661832] [INFO ] [MAIN ] TPC: Loaded 39075 primary data records. [2025-10-02T22:45:53.690497] [DEBUG] [LOCAL ] TPH: Loaded 45247 existing records from primary storage. [2025-10-02T22:45:53.725709] [INFO ] [MAIN ] TPH: Loaded 45247 primary data records. [2025-10-02T22:45:54.617893] [DEBUG] [MAIN ] TPB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:54.619684] [INFO ] [MAIN ] TPB: Generated 1807 derivative records from 25252 primary records. [2025-10-02T22:45:54.620984] [DEBUG] [LOCAL ] TPB: Saving derivative data. [2025-10-02T22:45:54.640756] [DEBUG] [LOCAL ] TPB: Derivative data saved (1807 records). [2025-10-02T22:45:54.641111] [INFO ] [MAIN ] TPB: Successfully saved derivative data. [2025-10-02T22:45:54.643401] [INFO ] [MAIN ] Derivative Progress: 1732/1975 symbols completed. TPB took 1.2s. Estimated remaining: 1m 42s. Rate: 143.3 symbols/min [2025-10-02T22:45:54.643784] [INFO ] [MAIN ] TPL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:54.665444] [DEBUG] [MAIN ] TPC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:54.678454] [INFO ] [MAIN ] TPC: Generated 1807 derivative records from 39075 primary records. [2025-10-02T22:45:54.687888] [DEBUG] [LOCAL ] TPC: Saving derivative data. [2025-10-02T22:45:54.688867] [DEBUG] [MAIN ] TPH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:54.698497] [INFO ] [MAIN ] TPH: Generated 1807 derivative records from 45247 primary records. [2025-10-02T22:45:54.703297] [DEBUG] [LOCAL ] TPH: Saving derivative data. [2025-10-02T22:45:54.709927] [DEBUG] [LOCAL ] TPL: Loaded 12395 existing records from primary storage. [2025-10-02T22:45:54.710094] [INFO ] [MAIN ] TPL: Loaded 12395 primary data records. [2025-10-02T22:45:54.823172] [DEBUG] [LOCAL ] TPH: Derivative data saved (1807 records). [2025-10-02T22:45:54.836288] [INFO ] [MAIN ] TPH: Successfully saved derivative data. [2025-10-02T22:45:54.836458] [DEBUG] [LOCAL ] TPC: Derivative data saved (1807 records). [2025-10-02T22:45:54.854247] [INFO ] [MAIN ] TPC: Successfully saved derivative data. [2025-10-02T22:45:54.848950] [INFO ] [MAIN ] Derivative Progress: 1733/1975 symbols completed. TPH took 1.4s. Estimated remaining: 1m 41s. Rate: 143.3 symbols/min [2025-10-02T22:45:54.863581] [INFO ] [MAIN ] TPR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:54.874142] [INFO ] [MAIN ] Derivative Progress: 1734/1975 symbols completed. TPC took 1.4s. Estimated remaining: 1m 41s. Rate: 143.4 symbols/min [2025-10-02T22:45:54.904740] [INFO ] [MAIN ] TPVG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:55.098501] [DEBUG] [LOCAL ] TPVG: Loaded 27131 existing records from primary storage. [2025-10-02T22:45:55.098965] [INFO ] [MAIN ] TPVG: Loaded 27131 primary data records. [2025-10-02T22:45:55.433663] [DEBUG] [LOCAL ] TPR: Loaded 53851 existing records from primary storage. [2025-10-02T22:45:55.503769] [DEBUG] [MAIN ] TPL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:55.520037] [INFO ] [MAIN ] TPL: Generated 1807 derivative records from 12395 primary records. [2025-10-02T22:45:55.518504] [INFO ] [MAIN ] TPR: Loaded 53851 primary data records. [2025-10-02T22:45:55.520334] [DEBUG] [LOCAL ] TPL: Saving derivative data. [2025-10-02T22:45:55.628720] [DEBUG] [LOCAL ] TPL: Derivative data saved (1807 records). [2025-10-02T22:45:55.647398] [INFO ] [MAIN ] TPL: Successfully saved derivative data. [2025-10-02T22:45:55.663891] [INFO ] [MAIN ] Derivative Progress: 1735/1975 symbols completed. TPL took 1.0s. Estimated remaining: 1m 40s. Rate: 143.3 symbols/min [2025-10-02T22:45:55.675034] [INFO ] [MAIN ] TPYP: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:55.890265] [DEBUG] [LOCAL ] TPYP: Loaded 7958 existing records from primary storage. [2025-10-02T22:45:55.890501] [INFO ] [MAIN ] TPYP: Loaded 7958 primary data records. [2025-10-02T22:45:56.046120] [DEBUG] [MAIN ] TPVG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:56.046971] [INFO ] [MAIN ] TPVG: Generated 1807 derivative records from 27131 primary records. [2025-10-02T22:45:56.069129] [DEBUG] [LOCAL ] TPVG: Saving derivative data. [2025-10-02T22:45:56.284190] [DEBUG] [LOCAL ] TPVG: Derivative data saved (1807 records). [2025-10-02T22:45:56.284949] [INFO ] [MAIN ] TPVG: Successfully saved derivative data. [2025-10-02T22:45:56.288712] [INFO ] [MAIN ] Derivative Progress: 1736/1975 symbols completed. TPVG took 1.4s. Estimated remaining: 1m 40s. Rate: 143.3 symbols/min [2025-10-02T22:45:56.289476] [DEBUG] [MAIN ] TPR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:56.290163] [INFO ] [MAIN ] TPZ: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:56.291660] [INFO ] [MAIN ] TPR: Generated 1807 derivative records from 53851 primary records. [2025-10-02T22:45:56.291790] [DEBUG] [LOCAL ] TPR: Saving derivative data. [2025-10-02T22:45:56.313731] [DEBUG] [LOCAL ] TPR: Derivative data saved (1807 records). [2025-10-02T22:45:56.314210] [INFO ] [MAIN ] TPR: Successfully saved derivative data. [2025-10-02T22:45:56.316378] [INFO ] [MAIN ] Derivative Progress: 1737/1975 symbols completed. TPR took 1.5s. Estimated remaining: 1m 40s. Rate: 143.4 symbols/min [2025-10-02T22:45:56.316699] [INFO ] [MAIN ] TR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:56.322605] [DEBUG] [LOCAL ] TPZ: Loaded 4967 existing records from primary storage. [2025-10-02T22:45:56.322932] [INFO ] [MAIN ] TPZ: Loaded 4967 primary data records. [2025-10-02T22:45:56.472175] [DEBUG] [LOCAL ] TR: Loaded 18638 existing records from primary storage. [2025-10-02T22:45:56.517729] [INFO ] [MAIN ] TR: Loaded 18638 primary data records. [2025-10-02T22:45:56.561431] [DEBUG] [MAIN ] TPYP: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-02T22:45:56.585206] [INFO ] [MAIN ] TPYP: Generated 1806 derivative records from 7958 primary records. [2025-10-02T22:45:56.742846] [DEBUG] [LOCAL ] TPYP: Saving derivative data. [2025-10-02T22:45:56.821889] [DEBUG] [LOCAL ] TPYP: Derivative data saved (1806 records). [2025-10-02T22:45:56.822979] [INFO ] [MAIN ] TPYP: Successfully saved derivative data. [2025-10-02T22:45:56.836075] [INFO ] [MAIN ] Derivative Progress: 1738/1975 symbols completed. TPYP took 1.2s. Estimated remaining: 1m 39s. Rate: 143.3 symbols/min [2025-10-02T22:45:57.057409] [DEBUG] [MAIN ] TPZ: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-02T22:45:57.058688] [INFO ] [MAIN ] TPZ: Generated 1806 derivative records from 4967 primary records. [2025-10-02T22:45:57.058766] [DEBUG] [LOCAL ] TPZ: Saving derivative data. [2025-10-02T22:45:57.075160] [DEBUG] [LOCAL ] TPZ: Derivative data saved (1806 records). [2025-10-02T22:45:57.075402] [INFO ] [MAIN ] TPZ: Successfully saved derivative data. [2025-10-02T22:45:57.077605] [INFO ] [MAIN ] Derivative Progress: 1739/1975 symbols completed. TPZ took 0.8s. Estimated remaining: 1m 39s. Rate: 143.4 symbols/min [2025-10-02T22:45:57.095084] [DEBUG] [MAIN ] TR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:57.095748] [INFO ] [MAIN ] TR: Generated 1807 derivative records from 18638 primary records. [2025-10-02T22:45:57.095817] [DEBUG] [LOCAL ] TR: Saving derivative data. [2025-10-02T22:45:57.111784] [DEBUG] [LOCAL ] TR: Derivative data saved (1807 records). [2025-10-02T22:45:57.111909] [INFO ] [MAIN ] TR: Successfully saved derivative data. [2025-10-02T22:45:57.114409] [INFO ] [MAIN ] Derivative Progress: 1740/1975 symbols completed. TR took 0.8s. Estimated remaining: 1m 38s. Rate: 143.5 symbols/min [2025-10-02T22:45:57.115282] [INFO ] [MAIN ] TRC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:57.115217] [INFO ] [MAIN ] TREX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:57.115117] [INFO ] [MAIN ] TRAK: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:57.133112] [DEBUG] [LOCAL ] TRAK: Loaded 9469 existing records from primary storage. [2025-10-02T22:45:57.133399] [INFO ] [MAIN ] TRAK: Loaded 9469 primary data records. [2025-10-02T22:45:57.200462] [DEBUG] [LOCAL ] TRC: Loaded 15837 existing records from primary storage. [2025-10-02T22:45:57.209894] [INFO ] [MAIN ] TRC: Loaded 15837 primary data records. [2025-10-02T22:45:57.498208] [DEBUG] [LOCAL ] TREX: Loaded 50298 existing records from primary storage. [2025-10-02T22:45:57.514729] [INFO ] [MAIN ] TREX: Loaded 50298 primary data records. [2025-10-02T22:45:58.202356] [DEBUG] [MAIN ] TRAK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:58.204906] [INFO ] [MAIN ] TRAK: Generated 1807 derivative records from 9469 primary records. [2025-10-02T22:45:58.205971] [DEBUG] [LOCAL ] TRAK: Saving derivative data. [2025-10-02T22:45:58.232313] [DEBUG] [MAIN ] TRC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:58.236426] [INFO ] [MAIN ] TRC: Generated 1807 derivative records from 15837 primary records. [2025-10-02T22:45:58.237790] [DEBUG] [LOCAL ] TRC: Saving derivative data. [2025-10-02T22:45:58.261148] [DEBUG] [LOCAL ] TRC: Derivative data saved (1807 records). [2025-10-02T22:45:58.261607] [DEBUG] [LOCAL ] TRAK: Derivative data saved (1807 records). [2025-10-02T22:45:58.261921] [INFO ] [MAIN ] TRC: Successfully saved derivative data. [2025-10-02T22:45:58.262087] [INFO ] [MAIN ] TRAK: Successfully saved derivative data. [2025-10-02T22:45:58.264608] [INFO ] [MAIN ] Derivative Progress: 1741/1975 symbols completed. TRC took 1.1s. Estimated remaining: 1m 38s. Rate: 143.3 symbols/min [2025-10-02T22:45:58.267041] [INFO ] [MAIN ] Derivative Progress: 1742/1975 symbols completed. TRAK took 1.2s. Estimated remaining: 1m 37s. Rate: 143.4 symbols/min [2025-10-02T22:45:58.266881] [INFO ] [MAIN ] TRGP: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:58.267230] [INFO ] [MAIN ] TRN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:58.281059] [DEBUG] [MAIN ] TREX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:58.281892] [INFO ] [MAIN ] TREX: Generated 1807 derivative records from 50298 primary records. [2025-10-02T22:45:58.282288] [DEBUG] [LOCAL ] TREX: Saving derivative data. [2025-10-02T22:45:58.300306] [DEBUG] [LOCAL ] TREX: Derivative data saved (1807 records). [2025-10-02T22:45:58.300425] [INFO ] [MAIN ] TREX: Successfully saved derivative data. [2025-10-02T22:45:58.302498] [INFO ] [MAIN ] Derivative Progress: 1743/1975 symbols completed. TREX took 1.2s. Estimated remaining: 1m 37s. Rate: 143.5 symbols/min [2025-10-02T22:45:58.302806] [INFO ] [MAIN ] TRNO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:58.349310] [DEBUG] [LOCAL ] TRN: Loaded 37268 existing records from primary storage. [2025-10-02T22:45:58.359902] [INFO ] [MAIN ] TRN: Loaded 37268 primary data records. [2025-10-02T22:45:58.518821] [DEBUG] [LOCAL ] TRNO: Loaded 44244 existing records from primary storage. [2025-10-02T22:45:58.519780] [INFO ] [MAIN ] TRNO: Loaded 44244 primary data records. [2025-10-02T22:45:58.519700] [DEBUG] [LOCAL ] TRGP: Loaded 51077 existing records from primary storage. [2025-10-02T22:45:58.525708] [INFO ] [MAIN ] TRGP: Loaded 51077 primary data records. [2025-10-02T22:45:59.466934] [DEBUG] [MAIN ] TRN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:59.468996] [INFO ] [MAIN ] TRN: Generated 1807 derivative records from 37268 primary records. [2025-10-02T22:45:59.469197] [DEBUG] [LOCAL ] TRN: Saving derivative data. [2025-10-02T22:45:59.503978] [DEBUG] [LOCAL ] TRN: Derivative data saved (1807 records). [2025-10-02T22:45:59.504527] [INFO ] [MAIN ] TRN: Successfully saved derivative data. [2025-10-02T22:45:59.507679] [INFO ] [MAIN ] Derivative Progress: 1744/1975 symbols completed. TRN took 1.2s. Estimated remaining: 1m 37s. Rate: 143.3 symbols/min [2025-10-02T22:45:59.504839] [DEBUG] [MAIN ] TRNO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:59.508664] [INFO ] [MAIN ] TRNO: Generated 1807 derivative records from 44244 primary records. [2025-10-02T22:45:59.508776] [DEBUG] [LOCAL ] TRNO: Saving derivative data. [2025-10-02T22:45:59.509919] [INFO ] [MAIN ] TROX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:59.540945] [DEBUG] [LOCAL ] TRNO: Derivative data saved (1807 records). [2025-10-02T22:45:59.541119] [INFO ] [MAIN ] TRNO: Successfully saved derivative data. [2025-10-02T22:45:59.540870] [DEBUG] [MAIN ] TRGP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:45:59.544486] [INFO ] [MAIN ] Derivative Progress: 1745/1975 symbols completed. TRNO took 1.2s. Estimated remaining: 1m 36s. Rate: 143.4 symbols/min [2025-10-02T22:45:59.545521] [INFO ] [MAIN ] TRP: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:59.545289] [INFO ] [MAIN ] TRGP: Generated 1807 derivative records from 51077 primary records. [2025-10-02T22:45:59.545707] [DEBUG] [LOCAL ] TRGP: Saving derivative data. [2025-10-02T22:45:59.565921] [DEBUG] [LOCAL ] TRGP: Derivative data saved (1807 records). [2025-10-02T22:45:59.566185] [INFO ] [MAIN ] TRGP: Successfully saved derivative data. [2025-10-02T22:45:59.568300] [INFO ] [MAIN ] Derivative Progress: 1746/1975 symbols completed. TRGP took 1.3s. Estimated remaining: 1m 36s. Rate: 143.5 symbols/min [2025-10-02T22:45:59.568516] [INFO ] [MAIN ] TRU: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:45:59.628758] [DEBUG] [LOCAL ] TROX: Loaded 52262 existing records from primary storage. [2025-10-02T22:45:59.644312] [INFO ] [MAIN ] TROX: Loaded 52262 primary data records. [2025-10-02T22:45:59.645112] [DEBUG] [LOCAL ] TRP: Loaded 52487 existing records from primary storage. [2025-10-02T22:45:59.650331] [INFO ] [MAIN ] TRP: Loaded 52487 primary data records. [2025-10-02T22:46:00.073773] [DEBUG] [LOCAL ] TRU: Loaded 51628 existing records from primary storage. [2025-10-02T22:46:00.324991] [INFO ] [MAIN ] TRU: Loaded 51628 primary data records. [2025-10-02T22:46:00.699281] [DEBUG] [MAIN ] TROX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:00.712599] [INFO ] [MAIN ] TROX: Generated 1807 derivative records from 52262 primary records. [2025-10-02T22:46:00.713309] [DEBUG] [MAIN ] TRP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:00.714117] [INFO ] [MAIN ] TRP: Generated 1807 derivative records from 52487 primary records. [2025-10-02T22:46:00.714316] [DEBUG] [LOCAL ] TRP: Saving derivative data. [2025-10-02T22:46:00.714273] [DEBUG] [LOCAL ] TROX: Saving derivative data. [2025-10-02T22:46:00.750049] [DEBUG] [LOCAL ] TRP: Derivative data saved (1807 records). [2025-10-02T22:46:00.750488] [INFO ] [MAIN ] TRP: Successfully saved derivative data. [2025-10-02T22:46:00.752733] [INFO ] [MAIN ] Derivative Progress: 1747/1975 symbols completed. TRP took 1.2s. Estimated remaining: 1m 35s. Rate: 143.3 symbols/min [2025-10-02T22:46:00.752943] [INFO ] [MAIN ] TRV: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:00.754526] [DEBUG] [LOCAL ] TROX: Derivative data saved (1807 records). [2025-10-02T22:46:00.754751] [INFO ] [MAIN ] TROX: Successfully saved derivative data. [2025-10-02T22:46:00.757197] [INFO ] [MAIN ] Derivative Progress: 1748/1975 symbols completed. TROX took 1.2s. Estimated remaining: 1m 35s. Rate: 143.4 symbols/min [2025-10-02T22:46:00.765044] [INFO ] [MAIN ] TS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:00.771555] [DEBUG] [MAIN ] TRU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:00.772304] [INFO ] [MAIN ] TRU: Generated 1807 derivative records from 51628 primary records. [2025-10-02T22:46:00.772491] [DEBUG] [LOCAL ] TRU: Saving derivative data. [2025-10-02T22:46:00.789843] [DEBUG] [LOCAL ] TRU: Derivative data saved (1807 records). [2025-10-02T22:46:00.790042] [INFO ] [MAIN ] TRU: Successfully saved derivative data. [2025-10-02T22:46:00.792909] [INFO ] [MAIN ] Derivative Progress: 1749/1975 symbols completed. TRU took 1.2s. Estimated remaining: 1m 35s. Rate: 143.5 symbols/min [2025-10-02T22:46:00.793268] [INFO ] [MAIN ] TSE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:00.836931] [DEBUG] [LOCAL ] TSE: Loaded 28404 existing records from primary storage. [2025-10-02T22:46:00.846870] [INFO ] [MAIN ] TSE: Loaded 28404 primary data records. [2025-10-02T22:46:00.995784] [DEBUG] [LOCAL ] TRV: Loaded 48094 existing records from primary storage. [2025-10-02T22:46:00.997004] [DEBUG] [LOCAL ] TS: Loaded 52072 existing records from primary storage. [2025-10-02T22:46:01.007581] [INFO ] [MAIN ] TRV: Loaded 48094 primary data records. [2025-10-02T22:46:01.002378] [INFO ] [MAIN ] TS: Loaded 52072 primary data records. [2025-10-02T22:46:01.953987] [DEBUG] [MAIN ] TSE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:01.955058] [INFO ] [MAIN ] TSE: Generated 1807 derivative records from 28404 primary records. [2025-10-02T22:46:01.955314] [DEBUG] [LOCAL ] TSE: Saving derivative data. [2025-10-02T22:46:01.984374] [DEBUG] [LOCAL ] TSE: Derivative data saved (1807 records). [2025-10-02T22:46:01.993185] [INFO ] [MAIN ] TSE: Successfully saved derivative data. [2025-10-02T22:46:02.002016] [INFO ] [MAIN ] Derivative Progress: 1750/1975 symbols completed. TSE took 1.2s. Estimated remaining: 1m 34s. Rate: 143.3 symbols/min [2025-10-02T22:46:02.015194] [INFO ] [MAIN ] TSI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:01.998963] [DEBUG] [MAIN ] TS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:02.016997] [INFO ] [MAIN ] TS: Generated 1807 derivative records from 52072 primary records. [2025-10-02T22:46:02.017106] [DEBUG] [LOCAL ] TS: Saving derivative data. [2025-10-02T22:46:02.015761] [DEBUG] [MAIN ] TRV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:02.023331] [INFO ] [MAIN ] TRV: Generated 1807 derivative records from 48094 primary records. [2025-10-02T22:46:02.025941] [DEBUG] [LOCAL ] TRV: Saving derivative data. [2025-10-02T22:46:02.058231] [DEBUG] [LOCAL ] TSI: Loaded 7378 existing records from primary storage. [2025-10-02T22:46:02.060060] [INFO ] [MAIN ] TSI: Loaded 7378 primary data records. [2025-10-02T22:46:02.088452] [DEBUG] [LOCAL ] TS: Derivative data saved (1807 records). [2025-10-02T22:46:02.081748] [DEBUG] [LOCAL ] TRV: Derivative data saved (1807 records). [2025-10-02T22:46:02.107483] [INFO ] [MAIN ] TS: Successfully saved derivative data. [2025-10-02T22:46:02.112882] [INFO ] [MAIN ] TRV: Successfully saved derivative data. [2025-10-02T22:46:02.142023] [INFO ] [MAIN ] Derivative Progress: 1751/1975 symbols completed. TRV took 1.4s. Estimated remaining: 1m 34s. Rate: 143.4 symbols/min [2025-10-02T22:46:02.160997] [INFO ] [MAIN ] TSLX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:02.166234] [INFO ] [MAIN ] Derivative Progress: 1752/1975 symbols completed. TS took 1.4s. Estimated remaining: 1m 33s. Rate: 143.4 symbols/min [2025-10-02T22:46:02.166544] [INFO ] [MAIN ] TSM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:02.445101] [DEBUG] [LOCAL ] TSLX: Loaded 35503 existing records from primary storage. [2025-10-02T22:46:02.445976] [INFO ] [MAIN ] TSLX: Loaded 35503 primary data records. [2025-10-02T22:46:02.657170] [DEBUG] [LOCAL ] TSM: Loaded 54209 existing records from primary storage. [2025-10-02T22:46:02.679589] [INFO ] [MAIN ] TSM: Loaded 54209 primary data records. [2025-10-02T22:46:02.896874] [DEBUG] [MAIN ] TSI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:02.932531] [INFO ] [MAIN ] TSI: Generated 1807 derivative records from 7378 primary records. [2025-10-02T22:46:02.964164] [DEBUG] [LOCAL ] TSI: Saving derivative data. [2025-10-02T22:46:03.194279] [DEBUG] [LOCAL ] TSI: Derivative data saved (1807 records). [2025-10-02T22:46:03.195259] [INFO ] [MAIN ] TSI: Successfully saved derivative data. [2025-10-02T22:46:03.198235] [INFO ] [MAIN ] Derivative Progress: 1753/1975 symbols completed. TSI took 1.2s. Estimated remaining: 1m 33s. Rate: 143.3 symbols/min [2025-10-02T22:46:03.219877] [DEBUG] [MAIN ] TSLX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:03.220797] [INFO ] [MAIN ] TSLX: Generated 1807 derivative records from 35503 primary records. [2025-10-02T22:46:03.221097] [DEBUG] [LOCAL ] TSLX: Saving derivative data. [2025-10-02T22:46:03.238071] [DEBUG] [LOCAL ] TSLX: Derivative data saved (1807 records). [2025-10-02T22:46:03.238290] [INFO ] [MAIN ] TSLX: Successfully saved derivative data. [2025-10-02T22:46:03.240829] [INFO ] [MAIN ] Derivative Progress: 1754/1975 symbols completed. TSLX took 1.1s. Estimated remaining: 1m 32s. Rate: 143.4 symbols/min [2025-10-02T22:46:03.256580] [DEBUG] [MAIN ] TSM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:03.257300] [INFO ] [MAIN ] TSM: Generated 1807 derivative records from 54209 primary records. [2025-10-02T22:46:03.257368] [DEBUG] [LOCAL ] TSM: Saving derivative data. [2025-10-02T22:46:03.273904] [DEBUG] [LOCAL ] TSM: Derivative data saved (1807 records). [2025-10-02T22:46:03.273986] [INFO ] [MAIN ] TSM: Successfully saved derivative data. [2025-10-02T22:46:03.276305] [INFO ] [MAIN ] Derivative Progress: 1755/1975 symbols completed. TSM took 1.1s. Estimated remaining: 1m 32s. Rate: 143.5 symbols/min [2025-10-02T22:46:03.276897] [INFO ] [MAIN ] TSN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:03.276958] [INFO ] [MAIN ] TSQ: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:03.277064] [INFO ] [MAIN ] TT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:03.294322] [DEBUG] [LOCAL ] TSQ: Loaded 12068 existing records from primary storage. [2025-10-02T22:46:03.294566] [INFO ] [MAIN ] TSQ: Loaded 12068 primary data records. [2025-10-02T22:46:03.686151] [DEBUG] [LOCAL ] TSN: Loaded 53293 existing records from primary storage. [2025-10-02T22:46:03.685309] [DEBUG] [LOCAL ] TT: Loaded 48026 existing records from primary storage. [2025-10-02T22:46:03.686360] [INFO ] [MAIN ] TT: Loaded 48026 primary data records. [2025-10-02T22:46:03.686621] [INFO ] [MAIN ] TSN: Loaded 53293 primary data records. [2025-10-02T22:46:04.439171] [DEBUG] [MAIN ] TSQ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:04.441273] [INFO ] [MAIN ] TSQ: Generated 1807 derivative records from 12068 primary records. [2025-10-02T22:46:04.442094] [DEBUG] [LOCAL ] TSQ: Saving derivative data. [2025-10-02T22:46:04.464434] [DEBUG] [LOCAL ] TSQ: Derivative data saved (1807 records). [2025-10-02T22:46:04.466315] [INFO ] [MAIN ] TSQ: Successfully saved derivative data. [2025-10-02T22:46:04.469923] [INFO ] [MAIN ] Derivative Progress: 1756/1975 symbols completed. TSQ took 1.2s. Estimated remaining: 1m 32s. Rate: 143.3 symbols/min [2025-10-02T22:46:04.470963] [INFO ] [MAIN ] TTC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:04.512155] [DEBUG] [MAIN ] TSN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:04.518203] [INFO ] [MAIN ] TSN: Generated 1807 derivative records from 53293 primary records. [2025-10-02T22:46:04.518446] [DEBUG] [LOCAL ] TSN: Saving derivative data. [2025-10-02T22:46:04.519787] [DEBUG] [MAIN ] TT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:04.534287] [INFO ] [MAIN ] TT: Generated 1807 derivative records from 48026 primary records. [2025-10-02T22:46:04.535614] [DEBUG] [LOCAL ] TT: Saving derivative data. [2025-10-02T22:46:04.567146] [DEBUG] [LOCAL ] TSN: Derivative data saved (1807 records). [2025-10-02T22:46:04.571820] [DEBUG] [LOCAL ] TT: Derivative data saved (1807 records). [2025-10-02T22:46:04.572060] [INFO ] [MAIN ] TSN: Successfully saved derivative data. [2025-10-02T22:46:04.574918] [INFO ] [MAIN ] TT: Successfully saved derivative data. [2025-10-02T22:46:04.574749] [INFO ] [MAIN ] Derivative Progress: 1757/1975 symbols completed. TSN took 1.3s. Estimated remaining: 1m 31s. Rate: 143.4 symbols/min [2025-10-02T22:46:04.577248] [INFO ] [MAIN ] Derivative Progress: 1758/1975 symbols completed. TT took 1.3s. Estimated remaining: 1m 31s. Rate: 143.5 symbols/min [2025-10-02T22:46:04.577145] [INFO ] [MAIN ] TTE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:04.577602] [INFO ] [MAIN ] TTI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:04.593954] [DEBUG] [LOCAL ] TTC: Loaded 42360 existing records from primary storage. [2025-10-02T22:46:04.594256] [INFO ] [MAIN ] TTC: Loaded 42360 primary data records. [2025-10-02T22:46:04.980104] [DEBUG] [LOCAL ] TTI: Loaded 45989 existing records from primary storage. [2025-10-02T22:46:04.982505] [INFO ] [MAIN ] TTI: Loaded 45989 primary data records. [2025-10-02T22:46:04.988729] [DEBUG] [LOCAL ] TTE: Loaded 52003 existing records from primary storage. [2025-10-02T22:46:05.006574] [INFO ] [MAIN ] TTE: Loaded 52003 primary data records. [2025-10-02T22:46:05.666125] [DEBUG] [MAIN ] TTC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:05.667788] [INFO ] [MAIN ] TTC: Generated 1807 derivative records from 42360 primary records. [2025-10-02T22:46:05.668060] [DEBUG] [LOCAL ] TTC: Saving derivative data. [2025-10-02T22:46:05.688512] [DEBUG] [LOCAL ] TTC: Derivative data saved (1807 records). [2025-10-02T22:46:05.689006] [INFO ] [MAIN ] TTC: Successfully saved derivative data. [2025-10-02T22:46:05.692593] [INFO ] [MAIN ] Derivative Progress: 1759/1975 symbols completed. TTC took 1.2s. Estimated remaining: 1m 30s. Rate: 143.3 symbols/min [2025-10-02T22:46:05.693048] [INFO ] [MAIN ] TU: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:05.715217] [DEBUG] [MAIN ] TTE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:05.716392] [INFO ] [MAIN ] TTE: Generated 1807 derivative records from 52003 primary records. [2025-10-02T22:46:05.724795] [DEBUG] [LOCAL ] TTE: Saving derivative data. [2025-10-02T22:46:05.731604] [DEBUG] [MAIN ] TTI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:05.745344] [INFO ] [MAIN ] TTI: Generated 1807 derivative records from 45989 primary records. [2025-10-02T22:46:05.745639] [DEBUG] [LOCAL ] TTI: Saving derivative data. [2025-10-02T22:46:05.767137] [DEBUG] [LOCAL ] TTI: Derivative data saved (1807 records). [2025-10-02T22:46:05.767689] [INFO ] [MAIN ] TTI: Successfully saved derivative data. [2025-10-02T22:46:05.767778] [DEBUG] [LOCAL ] TTE: Derivative data saved (1807 records). [2025-10-02T22:46:05.768080] [INFO ] [MAIN ] TTE: Successfully saved derivative data. [2025-10-02T22:46:05.770283] [INFO ] [MAIN ] Derivative Progress: 1760/1975 symbols completed. TTI took 1.2s. Estimated remaining: 1m 30s. Rate: 143.4 symbols/min [2025-10-02T22:46:05.779497] [INFO ] [MAIN ] TUYA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:05.779614] [INFO ] [MAIN ] Derivative Progress: 1761/1975 symbols completed. TTE took 1.2s. Estimated remaining: 1m 29s. Rate: 143.5 symbols/min [2025-10-02T22:46:05.780788] [INFO ] [MAIN ] TV: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:05.820370] [DEBUG] [LOCAL ] TU: Loaded 50205 existing records from primary storage. [2025-10-02T22:46:05.821296] [INFO ] [MAIN ] TU: Loaded 50205 primary data records. [2025-10-02T22:46:06.023234] [DEBUG] [LOCAL ] TUYA: Loaded 46550 existing records from primary storage. [2025-10-02T22:46:06.024462] [INFO ] [MAIN ] TUYA: Loaded 46550 primary data records. [2025-10-02T22:46:06.024173] [DEBUG] [LOCAL ] TV: Loaded 42891 existing records from primary storage. [2025-10-02T22:46:06.064806] [INFO ] [MAIN ] TV: Loaded 42891 primary data records. [2025-10-02T22:46:06.974041] [DEBUG] [MAIN ] TU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:06.976798] [INFO ] [MAIN ] TU: Generated 1807 derivative records from 50205 primary records. [2025-10-02T22:46:06.976902] [DEBUG] [LOCAL ] TU: Saving derivative data. [2025-10-02T22:46:07.010376] [DEBUG] [MAIN ] TUYA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:07.011880] [INFO ] [MAIN ] TUYA: Generated 1807 derivative records from 46550 primary records. [2025-10-02T22:46:07.012295] [DEBUG] [LOCAL ] TUYA: Saving derivative data. [2025-10-02T22:46:07.014901] [DEBUG] [LOCAL ] TU: Derivative data saved (1807 records). [2025-10-02T22:46:07.018479] [INFO ] [MAIN ] TU: Successfully saved derivative data. [2025-10-02T22:46:07.028976] [INFO ] [MAIN ] Derivative Progress: 1762/1975 symbols completed. TU took 1.3s. Estimated remaining: 1m 29s. Rate: 143.3 symbols/min [2025-10-02T22:46:07.034431] [INFO ] [MAIN ] TVC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:07.039900] [DEBUG] [LOCAL ] TUYA: Derivative data saved (1807 records). [2025-10-02T22:46:07.040403] [INFO ] [MAIN ] TUYA: Successfully saved derivative data. [2025-10-02T22:46:07.052320] [INFO ] [MAIN ] Derivative Progress: 1763/1975 symbols completed. TUYA took 1.3s. Estimated remaining: 1m 29s. Rate: 143.4 symbols/min [2025-10-02T22:46:07.058116] [INFO ] [MAIN ] TVE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:07.060249] [DEBUG] [MAIN ] TV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:07.061696] [INFO ] [MAIN ] TV: Generated 1807 derivative records from 42891 primary records. [2025-10-02T22:46:07.061972] [DEBUG] [LOCAL ] TV: Saving derivative data. [2025-10-02T22:46:07.066867] [DEBUG] [LOCAL ] TVC: Loaded 3349 existing records from primary storage. [2025-10-02T22:46:07.067093] [INFO ] [MAIN ] TVC: Loaded 3349 primary data records. [2025-10-02T22:46:07.104565] [DEBUG] [LOCAL ] TVE: Loaded 2788 existing records from primary storage. [2025-10-02T22:46:07.115834] [INFO ] [MAIN ] TVE: Loaded 2788 primary data records. [2025-10-02T22:46:07.296541] [DEBUG] [LOCAL ] TV: Derivative data saved (1807 records). [2025-10-02T22:46:07.324679] [INFO ] [MAIN ] TV: Successfully saved derivative data. [2025-10-02T22:46:07.358859] [INFO ] [MAIN ] Derivative Progress: 1764/1975 symbols completed. TV took 1.6s. Estimated remaining: 1m 28s. Rate: 143.4 symbols/min [2025-10-02T22:46:07.390082] [INFO ] [MAIN ] TWI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:07.791468] [DEBUG] [LOCAL ] TWI: Loaded 34440 existing records from primary storage. [2025-10-02T22:46:07.794078] [INFO ] [MAIN ] TWI: Loaded 34440 primary data records. [2025-10-02T22:46:07.885703] [DEBUG] [MAIN ] TVE: Filtered 6966 bins outside market hours, 7763 incomplete bins [2025-10-02T22:46:07.900319] [DEBUG] [MAIN ] TVC: Filtered 6966 bins outside market hours, 7763 incomplete bins [2025-10-02T22:46:07.921405] [INFO ] [MAIN ] TVC: Generated 1803 derivative records from 3349 primary records. [2025-10-02T22:46:07.912048] [INFO ] [MAIN ] TVE: Generated 1803 derivative records from 2788 primary records. [2025-10-02T22:46:07.921603] [DEBUG] [LOCAL ] TVC: Saving derivative data. [2025-10-02T22:46:07.932364] [DEBUG] [LOCAL ] TVE: Saving derivative data. [2025-10-02T22:46:07.993509] [DEBUG] [LOCAL ] TVC: Derivative data saved (1803 records). [2025-10-02T22:46:07.996198] [DEBUG] [LOCAL ] TVE: Derivative data saved (1803 records). [2025-10-02T22:46:07.996278] [INFO ] [MAIN ] TVC: Successfully saved derivative data. [2025-10-02T22:46:08.004101] [INFO ] [MAIN ] Derivative Progress: 1765/1975 symbols completed. TVC took 1.0s. Estimated remaining: 1m 28s. Rate: 143.4 symbols/min [2025-10-02T22:46:08.004380] [INFO ] [MAIN ] TVE: Successfully saved derivative data. [2025-10-02T22:46:08.009692] [INFO ] [MAIN ] TWLO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:08.011789] [INFO ] [MAIN ] Derivative Progress: 1766/1975 symbols completed. TVE took 1.0s. Estimated remaining: 1m 27s. Rate: 143.5 symbols/min [2025-10-02T22:46:08.017352] [INFO ] [MAIN ] TWN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:08.238426] [DEBUG] [LOCAL ] TWN: Loaded 3245 existing records from primary storage. [2025-10-02T22:46:08.239433] [INFO ] [MAIN ] TWN: Loaded 3245 primary data records. [2025-10-02T22:46:08.589101] [DEBUG] [LOCAL ] TWLO: Loaded 53100 existing records from primary storage. [2025-10-02T22:46:08.599610] [INFO ] [MAIN ] TWLO: Loaded 53100 primary data records. [2025-10-02T22:46:08.746895] [DEBUG] [MAIN ] TWI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:08.763245] [INFO ] [MAIN ] TWI: Generated 1807 derivative records from 34440 primary records. [2025-10-02T22:46:08.763461] [DEBUG] [LOCAL ] TWI: Saving derivative data. [2025-10-02T22:46:09.003377] [DEBUG] [LOCAL ] TWI: Derivative data saved (1807 records). [2025-10-02T22:46:09.003990] [INFO ] [MAIN ] TWI: Successfully saved derivative data. [2025-10-02T22:46:09.010141] [INFO ] [MAIN ] Derivative Progress: 1767/1975 symbols completed. TWI took 1.6s. Estimated remaining: 1m 27s. Rate: 143.3 symbols/min [2025-10-02T22:46:09.010514] [INFO ] [MAIN ] TWO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:09.025560] [DEBUG] [MAIN ] TWN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:09.026556] [INFO ] [MAIN ] TWN: Generated 1807 derivative records from 3245 primary records. [2025-10-02T22:46:09.026812] [DEBUG] [LOCAL ] TWN: Saving derivative data. [2025-10-02T22:46:09.044284] [DEBUG] [LOCAL ] TWN: Derivative data saved (1807 records). [2025-10-02T22:46:09.044559] [INFO ] [MAIN ] TWN: Successfully saved derivative data. [2025-10-02T22:46:09.047071] [INFO ] [MAIN ] Derivative Progress: 1768/1975 symbols completed. TWN took 1.0s. Estimated remaining: 1m 27s. Rate: 143.4 symbols/min [2025-10-02T22:46:09.065701] [DEBUG] [MAIN ] TWLO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:09.066537] [INFO ] [MAIN ] TWLO: Generated 1807 derivative records from 53100 primary records. [2025-10-02T22:46:09.066605] [DEBUG] [LOCAL ] TWLO: Saving derivative data. [2025-10-02T22:46:09.083150] [DEBUG] [LOCAL ] TWLO: Derivative data saved (1807 records). [2025-10-02T22:46:09.083321] [INFO ] [MAIN ] TWLO: Successfully saved derivative data. [2025-10-02T22:46:09.086326] [INFO ] [MAIN ] Derivative Progress: 1769/1975 symbols completed. TWLO took 1.1s. Estimated remaining: 1m 26s. Rate: 143.5 symbols/min [2025-10-02T22:46:09.119915] [DEBUG] [LOCAL ] TWO: Loaded 48729 existing records from primary storage. [2025-10-02T22:46:09.120124] [INFO ] [MAIN ] TWO: Loaded 48729 primary data records. [2025-10-02T22:46:09.445414] [DEBUG] [MAIN ] TWO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:09.446188] [INFO ] [MAIN ] TWO: Generated 1807 derivative records from 48729 primary records. [2025-10-02T22:46:09.446258] [DEBUG] [LOCAL ] TWO: Saving derivative data. [2025-10-02T22:46:09.462845] [DEBUG] [LOCAL ] TWO: Derivative data saved (1807 records). [2025-10-02T22:46:09.462940] [INFO ] [MAIN ] TWO: Successfully saved derivative data. [2025-10-02T22:46:09.464942] [INFO ] [MAIN ] Derivative Progress: 1770/1975 symbols completed. TWO took 0.5s. Estimated remaining: 1m 26s. Rate: 143.5 symbols/min [2025-10-02T22:46:09.465518] [INFO ] [MAIN ] TX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:09.465804] [INFO ] [MAIN ] TXO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:09.465605] [INFO ] [MAIN ] TXNM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:09.510808] [DEBUG] [LOCAL ] TXO: Loaded 19055 existing records from primary storage. [2025-10-02T22:46:09.511340] [DEBUG] [LOCAL ] TX: Loaded 23557 existing records from primary storage. [2025-10-02T22:46:09.511516] [INFO ] [MAIN ] TXO: Loaded 19055 primary data records. [2025-10-02T22:46:09.511799] [INFO ] [MAIN ] TX: Loaded 23557 primary data records. [2025-10-02T22:46:09.773816] [DEBUG] [LOCAL ] TXNM: Loaded 43718 existing records from primary storage. [2025-10-02T22:46:09.790409] [INFO ] [MAIN ] TXNM: Loaded 43718 primary data records. [2025-10-02T22:46:10.632993] [DEBUG] [MAIN ] TXO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:10.634334] [INFO ] [MAIN ] TXO: Generated 1807 derivative records from 19055 primary records. [2025-10-02T22:46:10.643428] [DEBUG] [LOCAL ] TXO: Saving derivative data. [2025-10-02T22:46:10.652505] [DEBUG] [MAIN ] TX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:10.664053] [INFO ] [MAIN ] TX: Generated 1807 derivative records from 23557 primary records. [2025-10-02T22:46:10.675504] [DEBUG] [LOCAL ] TX: Saving derivative data. [2025-10-02T22:46:10.677333] [DEBUG] [LOCAL ] TXO: Derivative data saved (1807 records). [2025-10-02T22:46:10.678673] [INFO ] [MAIN ] TXO: Successfully saved derivative data. [2025-10-02T22:46:10.681671] [INFO ] [MAIN ] Derivative Progress: 1771/1975 symbols completed. TXO took 1.2s. Estimated remaining: 1m 25s. Rate: 143.3 symbols/min [2025-10-02T22:46:10.695603] [INFO ] [MAIN ] TXT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:10.701375] [DEBUG] [LOCAL ] TX: Derivative data saved (1807 records). [2025-10-02T22:46:10.701896] [INFO ] [MAIN ] TX: Successfully saved derivative data. [2025-10-02T22:46:10.704017] [INFO ] [MAIN ] Derivative Progress: 1772/1975 symbols completed. TX took 1.2s. Estimated remaining: 1m 25s. Rate: 143.4 symbols/min [2025-10-02T22:46:10.704198] [INFO ] [MAIN ] TY: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:10.724006] [DEBUG] [MAIN ] TXNM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:10.725004] [INFO ] [MAIN ] TXNM: Generated 1807 derivative records from 43718 primary records. [2025-10-02T22:46:10.725099] [DEBUG] [LOCAL ] TXNM: Saving derivative data. [2025-10-02T22:46:10.742980] [DEBUG] [LOCAL ] TY: Loaded 7578 existing records from primary storage. [2025-10-02T22:46:10.744285] [INFO ] [MAIN ] TY: Loaded 7578 primary data records. [2025-10-02T22:46:10.881788] [DEBUG] [LOCAL ] TXNM: Derivative data saved (1807 records). [2025-10-02T22:46:10.882374] [INFO ] [MAIN ] TXNM: Successfully saved derivative data. [2025-10-02T22:46:10.884552] [INFO ] [MAIN ] Derivative Progress: 1773/1975 symbols completed. TXNM took 1.4s. Estimated remaining: 1m 24s. Rate: 143.5 symbols/min [2025-10-02T22:46:10.890267] [INFO ] [MAIN ] TYG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:10.987449] [DEBUG] [LOCAL ] TXT: Loaded 50073 existing records from primary storage. [2025-10-02T22:46:10.994512] [INFO ] [MAIN ] TXT: Loaded 50073 primary data records. [2025-10-02T22:46:11.247301] [DEBUG] [LOCAL ] TYG: Loaded 14224 existing records from primary storage. [2025-10-02T22:46:11.251514] [INFO ] [MAIN ] TYG: Loaded 14224 primary data records. [2025-10-02T22:46:11.848984] [DEBUG] [MAIN ] TY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:11.849996] [INFO ] [MAIN ] TY: Generated 1807 derivative records from 7578 primary records. [2025-10-02T22:46:11.850443] [DEBUG] [LOCAL ] TY: Saving derivative data. [2025-10-02T22:46:11.870278] [DEBUG] [LOCAL ] TY: Derivative data saved (1807 records). [2025-10-02T22:46:11.871340] [INFO ] [MAIN ] TY: Successfully saved derivative data. [2025-10-02T22:46:11.873717] [INFO ] [MAIN ] Derivative Progress: 1774/1975 symbols completed. TY took 1.2s. Estimated remaining: 1m 24s. Rate: 143.4 symbols/min [2025-10-02T22:46:11.874344] [INFO ] [MAIN ] TYL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:11.898316] [DEBUG] [MAIN ] TXT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:11.899247] [INFO ] [MAIN ] TXT: Generated 1807 derivative records from 50073 primary records. [2025-10-02T22:46:11.899604] [DEBUG] [LOCAL ] TXT: Saving derivative data. [2025-10-02T22:46:11.932727] [DEBUG] [LOCAL ] TYL: Loaded 22325 existing records from primary storage. [2025-10-02T22:46:11.933666] [INFO ] [MAIN ] TYL: Loaded 22325 primary data records. [2025-10-02T22:46:11.934354] [DEBUG] [LOCAL ] TXT: Derivative data saved (1807 records). [2025-10-02T22:46:11.963360] [INFO ] [MAIN ] TXT: Successfully saved derivative data. [2025-10-02T22:46:11.989304] [INFO ] [MAIN ] Derivative Progress: 1775/1975 symbols completed. TXT took 1.3s. Estimated remaining: 1m 24s. Rate: 143.4 symbols/min [2025-10-02T22:46:11.997275] [INFO ] [MAIN ] U: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:12.034358] [DEBUG] [MAIN ] TYG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:12.061906] [INFO ] [MAIN ] TYG: Generated 1807 derivative records from 14224 primary records. [2025-10-02T22:46:12.066382] [DEBUG] [LOCAL ] TYG: Saving derivative data. [2025-10-02T22:46:12.287050] [DEBUG] [LOCAL ] TYG: Derivative data saved (1807 records). [2025-10-02T22:46:12.287343] [INFO ] [MAIN ] TYG: Successfully saved derivative data. [2025-10-02T22:46:12.294032] [INFO ] [MAIN ] Derivative Progress: 1776/1975 symbols completed. TYG took 1.4s. Estimated remaining: 1m 23s. Rate: 143.4 symbols/min [2025-10-02T22:46:12.294321] [INFO ] [MAIN ] UA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:12.337382] [DEBUG] [LOCAL ] U: Loaded 54189 existing records from primary storage. [2025-10-02T22:46:12.338034] [INFO ] [MAIN ] U: Loaded 54189 primary data records. [2025-10-02T22:46:12.497618] [DEBUG] [MAIN ] TYL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:12.509404] [INFO ] [MAIN ] TYL: Generated 1807 derivative records from 22325 primary records. [2025-10-02T22:46:12.553381] [DEBUG] [LOCAL ] TYL: Saving derivative data. [2025-10-02T22:46:12.662898] [DEBUG] [LOCAL ] UA: Loaded 50841 existing records from primary storage. [2025-10-02T22:46:12.670306] [INFO ] [MAIN ] UA: Loaded 50841 primary data records. [2025-10-02T22:46:12.822046] [DEBUG] [LOCAL ] TYL: Derivative data saved (1807 records). [2025-10-02T22:46:12.836906] [INFO ] [MAIN ] TYL: Successfully saved derivative data. [2025-10-02T22:46:12.849228] [INFO ] [MAIN ] Derivative Progress: 1777/1975 symbols completed. TYL took 1.0s. Estimated remaining: 1m 23s. Rate: 143.4 symbols/min [2025-10-02T22:46:12.849531] [INFO ] [MAIN ] UAA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:13.170031] [DEBUG] [MAIN ] U: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:13.171354] [DEBUG] [LOCAL ] UAA: Loaded 53897 existing records from primary storage. [2025-10-02T22:46:13.171974] [INFO ] [MAIN ] UAA: Loaded 53897 primary data records. [2025-10-02T22:46:13.173067] [INFO ] [MAIN ] U: Generated 1807 derivative records from 54189 primary records. [2025-10-02T22:46:13.173322] [DEBUG] [LOCAL ] U: Saving derivative data. [2025-10-02T22:46:13.334510] [DEBUG] [MAIN ] UA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:13.346578] [INFO ] [MAIN ] UA: Generated 1807 derivative records from 50841 primary records. [2025-10-02T22:46:13.357445] [DEBUG] [LOCAL ] UA: Saving derivative data. [2025-10-02T22:46:13.421029] [DEBUG] [LOCAL ] UA: Derivative data saved (1807 records). [2025-10-02T22:46:13.418959] [DEBUG] [LOCAL ] U: Derivative data saved (1807 records). [2025-10-02T22:46:13.441580] [INFO ] [MAIN ] UA: Successfully saved derivative data. [2025-10-02T22:46:13.441741] [INFO ] [MAIN ] U: Successfully saved derivative data. [2025-10-02T22:46:13.443990] [INFO ] [MAIN ] Derivative Progress: 1778/1975 symbols completed. UA took 1.1s. Estimated remaining: 1m 22s. Rate: 143.4 symbols/min [2025-10-02T22:46:13.444195] [INFO ] [MAIN ] UAN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:13.447543] [INFO ] [MAIN ] Derivative Progress: 1779/1975 symbols completed. U took 1.5s. Estimated remaining: 1m 22s. Rate: 143.5 symbols/min [2025-10-02T22:46:13.483331] [INFO ] [MAIN ] UBER: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:13.585497] [DEBUG] [LOCAL ] UAN: Loaded 5425 existing records from primary storage. [2025-10-02T22:46:13.585926] [INFO ] [MAIN ] UAN: Loaded 5425 primary data records. [2025-10-02T22:46:13.975983] [DEBUG] [MAIN ] UAA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:13.979231] [DEBUG] [LOCAL ] UBER: Loaded 54196 existing records from primary storage. [2025-10-02T22:46:13.977866] [INFO ] [MAIN ] UAA: Generated 1807 derivative records from 53897 primary records. [2025-10-02T22:46:13.979610] [INFO ] [MAIN ] UBER: Loaded 54196 primary data records. [2025-10-02T22:46:13.979821] [DEBUG] [LOCAL ] UAA: Saving derivative data. [2025-10-02T22:46:14.125107] [DEBUG] [LOCAL ] UAA: Derivative data saved (1807 records). [2025-10-02T22:46:14.147087] [INFO ] [MAIN ] UAA: Successfully saved derivative data. [2025-10-02T22:46:14.174272] [INFO ] [MAIN ] Derivative Progress: 1780/1975 symbols completed. UAA took 1.3s. Estimated remaining: 1m 22s. Rate: 143.4 symbols/min [2025-10-02T22:46:14.243777] [INFO ] [MAIN ] UBS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:14.350318] [DEBUG] [MAIN ] UAN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:14.351237] [INFO ] [MAIN ] UAN: Generated 1807 derivative records from 5425 primary records. [2025-10-02T22:46:14.351432] [DEBUG] [LOCAL ] UAN: Saving derivative data. [2025-10-02T22:46:14.370034] [DEBUG] [LOCAL ] UAN: Derivative data saved (1807 records). [2025-10-02T22:46:14.370201] [INFO ] [MAIN ] UAN: Successfully saved derivative data. [2025-10-02T22:46:14.372845] [INFO ] [MAIN ] Derivative Progress: 1781/1975 symbols completed. UAN took 0.9s. Estimated remaining: 1m 21s. Rate: 143.4 symbols/min [2025-10-02T22:46:14.373149] [INFO ] [MAIN ] UCB: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:14.396144] [DEBUG] [MAIN ] UBER: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:14.411193] [INFO ] [MAIN ] UBER: Generated 1807 derivative records from 54196 primary records. [2025-10-02T22:46:14.411365] [DEBUG] [LOCAL ] UBER: Saving derivative data. [2025-10-02T22:46:14.459329] [DEBUG] [LOCAL ] UBS: Loaded 52778 existing records from primary storage. [2025-10-02T22:46:14.460476] [INFO ] [MAIN ] UBS: Loaded 52778 primary data records. [2025-10-02T22:46:14.482582] [DEBUG] [LOCAL ] UBER: Derivative data saved (1807 records). [2025-10-02T22:46:14.519845] [INFO ] [MAIN ] UBER: Successfully saved derivative data. [2025-10-02T22:46:14.529819] [INFO ] [MAIN ] Derivative Progress: 1782/1975 symbols completed. UBER took 1.0s. Estimated remaining: 1m 21s. Rate: 143.5 symbols/min [2025-10-02T22:46:14.542953] [INFO ] [MAIN ] UDR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:14.561690] [DEBUG] [LOCAL ] UCB: Loaded 38118 existing records from primary storage. [2025-10-02T22:46:14.576899] [INFO ] [MAIN ] UCB: Loaded 38118 primary data records. [2025-10-02T22:46:15.226236] [DEBUG] [LOCAL ] UDR: Loaded 52218 existing records from primary storage. [2025-10-02T22:46:15.227918] [INFO ] [MAIN ] UDR: Loaded 52218 primary data records. [2025-10-02T22:46:15.580000] [DEBUG] [MAIN ] UBS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:15.585101] [INFO ] [MAIN ] UBS: Generated 1807 derivative records from 52778 primary records. [2025-10-02T22:46:15.585819] [DEBUG] [LOCAL ] UBS: Saving derivative data. [2025-10-02T22:46:15.613787] [DEBUG] [MAIN ] UCB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:15.620545] [INFO ] [MAIN ] UCB: Generated 1807 derivative records from 38118 primary records. [2025-10-02T22:46:15.622891] [DEBUG] [LOCAL ] UCB: Saving derivative data. [2025-10-02T22:46:15.628754] [DEBUG] [LOCAL ] UBS: Derivative data saved (1807 records). [2025-10-02T22:46:15.629728] [INFO ] [MAIN ] UBS: Successfully saved derivative data. [2025-10-02T22:46:15.632360] [INFO ] [MAIN ] Derivative Progress: 1783/1975 symbols completed. UBS took 1.4s. Estimated remaining: 1m 20s. Rate: 143.4 symbols/min [2025-10-02T22:46:15.650361] [DEBUG] [LOCAL ] UCB: Derivative data saved (1807 records). [2025-10-02T22:46:15.650588] [INFO ] [MAIN ] UCB: Successfully saved derivative data. [2025-10-02T22:46:15.653001] [INFO ] [MAIN ] Derivative Progress: 1784/1975 symbols completed. UCB took 1.3s. Estimated remaining: 1m 20s. Rate: 143.4 symbols/min [2025-10-02T22:46:15.674960] [DEBUG] [MAIN ] UDR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:15.675965] [INFO ] [MAIN ] UDR: Generated 1807 derivative records from 52218 primary records. [2025-10-02T22:46:15.676044] [DEBUG] [LOCAL ] UDR: Saving derivative data. [2025-10-02T22:46:15.699688] [DEBUG] [LOCAL ] UDR: Derivative data saved (1807 records). [2025-10-02T22:46:15.699841] [INFO ] [MAIN ] UDR: Successfully saved derivative data. [2025-10-02T22:46:15.702132] [INFO ] [MAIN ] Derivative Progress: 1785/1975 symbols completed. UDR took 1.2s. Estimated remaining: 1m 19s. Rate: 143.5 symbols/min [2025-10-02T22:46:15.702780] [INFO ] [MAIN ] UE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:15.703252] [INFO ] [MAIN ] UFI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:15.702905] [INFO ] [MAIN ] UGI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:15.719142] [DEBUG] [LOCAL ] UFI: Loaded 8157 existing records from primary storage. [2025-10-02T22:46:15.719316] [INFO ] [MAIN ] UFI: Loaded 8157 primary data records. [2025-10-02T22:46:16.144070] [DEBUG] [LOCAL ] UE: Loaded 43024 existing records from primary storage. [2025-10-02T22:46:16.154561] [DEBUG] [LOCAL ] UGI: Loaded 50869 existing records from primary storage. [2025-10-02T22:46:16.154804] [INFO ] [MAIN ] UGI: Loaded 50869 primary data records. [2025-10-02T22:46:16.153773] [INFO ] [MAIN ] UE: Loaded 43024 primary data records. [2025-10-02T22:46:16.928828] [DEBUG] [MAIN ] UFI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:16.930689] [INFO ] [MAIN ] UFI: Generated 1807 derivative records from 8157 primary records. [2025-10-02T22:46:16.931182] [DEBUG] [LOCAL ] UFI: Saving derivative data. [2025-10-02T22:46:16.958045] [DEBUG] [LOCAL ] UFI: Derivative data saved (1807 records). [2025-10-02T22:46:16.958607] [INFO ] [MAIN ] UFI: Successfully saved derivative data. [2025-10-02T22:46:16.960916] [INFO ] [MAIN ] Derivative Progress: 1786/1975 symbols completed. UFI took 1.3s. Estimated remaining: 1m 19s. Rate: 143.3 symbols/min [2025-10-02T22:46:16.974709] [INFO ] [MAIN ] UGP: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:16.974502] [DEBUG] [MAIN ] UGI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:16.975629] [INFO ] [MAIN ] UGI: Generated 1807 derivative records from 50869 primary records. [2025-10-02T22:46:16.976045] [DEBUG] [LOCAL ] UGI: Saving derivative data. [2025-10-02T22:46:16.995885] [DEBUG] [LOCAL ] UGI: Derivative data saved (1807 records). [2025-10-02T22:46:16.997015] [INFO ] [MAIN ] UGI: Successfully saved derivative data. [2025-10-02T22:46:17.000605] [INFO ] [MAIN ] Derivative Progress: 1787/1975 symbols completed. UGI took 1.3s. Estimated remaining: 1m 19s. Rate: 143.4 symbols/min [2025-10-02T22:46:17.001279] [INFO ] [MAIN ] UHAL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:17.015491] [DEBUG] [MAIN ] UE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:17.016343] [INFO ] [MAIN ] UE: Generated 1807 derivative records from 43024 primary records. [2025-10-02T22:46:17.016597] [DEBUG] [LOCAL ] UE: Saving derivative data. [2025-10-02T22:46:17.055819] [DEBUG] [LOCAL ] UE: Derivative data saved (1807 records). [2025-10-02T22:46:17.056629] [INFO ] [MAIN ] UE: Successfully saved derivative data. [2025-10-02T22:46:17.058864] [INFO ] [MAIN ] Derivative Progress: 1788/1975 symbols completed. UE took 1.4s. Estimated remaining: 1m 18s. Rate: 143.5 symbols/min [2025-10-02T22:46:17.059740] [DEBUG] [LOCAL ] UHAL: Loaded 16684 existing records from primary storage. [2025-10-02T22:46:17.060073] [INFO ] [MAIN ] UHAL: Loaded 16684 primary data records. [2025-10-02T22:46:17.059886] [INFO ] [MAIN ] UHS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:17.178563] [DEBUG] [LOCAL ] UGP: Loaded 43266 existing records from primary storage. [2025-10-02T22:46:17.190967] [INFO ] [MAIN ] UGP: Loaded 43266 primary data records. [2025-10-02T22:46:17.755824] [DEBUG] [LOCAL ] UHS: Loaded 41142 existing records from primary storage. [2025-10-02T22:46:17.757507] [INFO ] [MAIN ] UHS: Loaded 41142 primary data records. [2025-10-02T22:46:18.123368] [DEBUG] [MAIN ] UHAL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:18.125389] [INFO ] [MAIN ] UHAL: Generated 1807 derivative records from 16684 primary records. [2025-10-02T22:46:18.125626] [DEBUG] [LOCAL ] UHAL: Saving derivative data. [2025-10-02T22:46:18.161865] [DEBUG] [LOCAL ] UHAL: Derivative data saved (1807 records). [2025-10-02T22:46:18.162696] [DEBUG] [MAIN ] UGP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:18.165041] [INFO ] [MAIN ] UGP: Generated 1807 derivative records from 43266 primary records. [2025-10-02T22:46:18.165179] [INFO ] [MAIN ] UHAL: Successfully saved derivative data. [2025-10-02T22:46:18.165268] [DEBUG] [LOCAL ] UGP: Saving derivative data. [2025-10-02T22:46:18.167343] [INFO ] [MAIN ] Derivative Progress: 1789/1975 symbols completed. UHAL took 1.2s. Estimated remaining: 1m 18s. Rate: 143.3 symbols/min [2025-10-02T22:46:18.168547] [INFO ] [MAIN ] UHT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:18.186258] [DEBUG] [LOCAL ] UGP: Derivative data saved (1807 records). [2025-10-02T22:46:18.186767] [INFO ] [MAIN ] UGP: Successfully saved derivative data. [2025-10-02T22:46:18.191735] [INFO ] [MAIN ] Derivative Progress: 1790/1975 symbols completed. UGP took 1.2s. Estimated remaining: 1m 17s. Rate: 143.4 symbols/min [2025-10-02T22:46:18.192609] [INFO ] [MAIN ] UI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:18.198846] [DEBUG] [LOCAL ] UHT: Loaded 9993 existing records from primary storage. [2025-10-02T22:46:18.199112] [INFO ] [MAIN ] UHT: Loaded 9993 primary data records. [2025-10-02T22:46:18.325270] [DEBUG] [LOCAL ] UI: Loaded 13213 existing records from primary storage. [2025-10-02T22:46:18.334105] [INFO ] [MAIN ] UI: Loaded 13213 primary data records. [2025-10-02T22:46:18.355805] [DEBUG] [MAIN ] UHS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:18.396846] [INFO ] [MAIN ] UHS: Generated 1807 derivative records from 41142 primary records. [2025-10-02T22:46:18.459293] [DEBUG] [LOCAL ] UHS: Saving derivative data. [2025-10-02T22:46:18.905461] [DEBUG] [LOCAL ] UHS: Derivative data saved (1807 records). [2025-10-02T22:46:18.906618] [INFO ] [MAIN ] UHS: Successfully saved derivative data. [2025-10-02T22:46:18.910341] [INFO ] [MAIN ] Derivative Progress: 1791/1975 symbols completed. UHS took 1.9s. Estimated remaining: 1m 17s. Rate: 143.4 symbols/min [2025-10-02T22:46:18.911673] [INFO ] [MAIN ] UIS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:18.945040] [DEBUG] [MAIN ] UHT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:18.947196] [INFO ] [MAIN ] UHT: Generated 1807 derivative records from 9993 primary records. [2025-10-02T22:46:18.948884] [DEBUG] [LOCAL ] UHT: Saving derivative data. [2025-10-02T22:46:18.986806] [DEBUG] [MAIN ] UI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:18.989153] [DEBUG] [LOCAL ] UHT: Derivative data saved (1807 records). [2025-10-02T22:46:18.989595] [INFO ] [MAIN ] UHT: Successfully saved derivative data. [2025-10-02T22:46:19.004183] [INFO ] [MAIN ] Derivative Progress: 1792/1975 symbols completed. UHT took 0.8s. Estimated remaining: 1m 17s. Rate: 143.4 symbols/min [2025-10-02T22:46:19.004484] [INFO ] [MAIN ] UL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:19.000795] [INFO ] [MAIN ] UI: Generated 1807 derivative records from 13213 primary records. [2025-10-02T22:46:19.005827] [DEBUG] [LOCAL ] UIS: Loaded 37283 existing records from primary storage. [2025-10-02T22:46:19.006374] [DEBUG] [LOCAL ] UI: Saving derivative data. [2025-10-02T22:46:19.006487] [INFO ] [MAIN ] UIS: Loaded 37283 primary data records. [2025-10-02T22:46:19.132387] [DEBUG] [LOCAL ] UI: Derivative data saved (1807 records). [2025-10-02T22:46:19.136753] [INFO ] [MAIN ] UI: Successfully saved derivative data. [2025-10-02T22:46:19.140012] [INFO ] [MAIN ] Derivative Progress: 1793/1975 symbols completed. UI took 0.9s. Estimated remaining: 1m 16s. Rate: 143.5 symbols/min [2025-10-02T22:46:19.150845] [INFO ] [MAIN ] ULS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:19.427079] [DEBUG] [LOCAL ] UL: Loaded 53457 existing records from primary storage. [2025-10-02T22:46:19.427758] [INFO ] [MAIN ] UL: Loaded 53457 primary data records. [2025-10-02T22:46:19.565128] [DEBUG] [LOCAL ] ULS: Loaded 39708 existing records from primary storage. [2025-10-02T22:46:19.586889] [INFO ] [MAIN ] ULS: Loaded 39708 primary data records. [2025-10-02T22:46:19.957299] [DEBUG] [MAIN ] UIS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:20.117510] [INFO ] [MAIN ] UIS: Generated 1807 derivative records from 37283 primary records. [2025-10-02T22:46:20.127716] [DEBUG] [LOCAL ] UIS: Saving derivative data. [2025-10-02T22:46:20.149260] [DEBUG] [LOCAL ] UIS: Derivative data saved (1807 records). [2025-10-02T22:46:20.151869] [INFO ] [MAIN ] UIS: Successfully saved derivative data. [2025-10-02T22:46:20.154447] [INFO ] [MAIN ] Derivative Progress: 1794/1975 symbols completed. UIS took 1.2s. Estimated remaining: 1m 16s. Rate: 143.4 symbols/min [2025-10-02T22:46:20.155123] [INFO ] [MAIN ] UMC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:20.169894] [DEBUG] [MAIN ] UL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:20.170843] [INFO ] [MAIN ] UL: Generated 1807 derivative records from 53457 primary records. [2025-10-02T22:46:20.173374] [DEBUG] [LOCAL ] UL: Saving derivative data. [2025-10-02T22:46:20.206474] [DEBUG] [LOCAL ] UL: Derivative data saved (1807 records). [2025-10-02T22:46:20.219407] [INFO ] [MAIN ] UL: Successfully saved derivative data. [2025-10-02T22:46:20.220044] [DEBUG] [MAIN ] ULS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:20.222621] [INFO ] [MAIN ] Derivative Progress: 1795/1975 symbols completed. UL took 1.2s. Estimated remaining: 1m 15s. Rate: 143.4 symbols/min [2025-10-02T22:46:20.223758] [INFO ] [MAIN ] ULS: Generated 1807 derivative records from 39708 primary records. [2025-10-02T22:46:20.223964] [INFO ] [MAIN ] UMH: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:20.224628] [DEBUG] [LOCAL ] ULS: Saving derivative data. [2025-10-02T22:46:20.255250] [DEBUG] [LOCAL ] ULS: Derivative data saved (1807 records). [2025-10-02T22:46:20.255516] [INFO ] [MAIN ] ULS: Successfully saved derivative data. [2025-10-02T22:46:20.257726] [INFO ] [MAIN ] Derivative Progress: 1796/1975 symbols completed. ULS took 1.1s. Estimated remaining: 1m 15s. Rate: 143.5 symbols/min [2025-10-02T22:46:20.258731] [INFO ] [MAIN ] UNF: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:20.276304] [DEBUG] [LOCAL ] UMC: Loaded 53092 existing records from primary storage. [2025-10-02T22:46:20.276600] [INFO ] [MAIN ] UMC: Loaded 53092 primary data records. [2025-10-02T22:46:20.412216] [DEBUG] [LOCAL ] UNF: Loaded 12130 existing records from primary storage. [2025-10-02T22:46:20.423555] [INFO ] [MAIN ] UNF: Loaded 12130 primary data records. [2025-10-02T22:46:20.570916] [DEBUG] [LOCAL ] UMH: Loaded 33870 existing records from primary storage. [2025-10-02T22:46:20.579605] [INFO ] [MAIN ] UMH: Loaded 33870 primary data records. [2025-10-02T22:46:21.362753] [DEBUG] [MAIN ] UMC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:21.364579] [INFO ] [MAIN ] UMC: Generated 1807 derivative records from 53092 primary records. [2025-10-02T22:46:21.365046] [DEBUG] [LOCAL ] UMC: Saving derivative data. [2025-10-02T22:46:21.386873] [DEBUG] [LOCAL ] UMC: Derivative data saved (1807 records). [2025-10-02T22:46:21.387018] [INFO ] [MAIN ] UMC: Successfully saved derivative data. [2025-10-02T22:46:21.389200] [INFO ] [MAIN ] Derivative Progress: 1797/1975 symbols completed. UMC took 1.2s. Estimated remaining: 1m 14s. Rate: 143.4 symbols/min [2025-10-02T22:46:21.389578] [INFO ] [MAIN ] UNFI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:21.403274] [DEBUG] [MAIN ] UNF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:21.404375] [INFO ] [MAIN ] UNF: Generated 1807 derivative records from 12130 primary records. [2025-10-02T22:46:21.404475] [DEBUG] [LOCAL ] UNF: Saving derivative data. [2025-10-02T22:46:21.439294] [DEBUG] [MAIN ] UMH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:21.438898] [DEBUG] [LOCAL ] UNF: Derivative data saved (1807 records). [2025-10-02T22:46:21.440201] [INFO ] [MAIN ] UMH: Generated 1807 derivative records from 33870 primary records. [2025-10-02T22:46:21.440314] [INFO ] [MAIN ] UNF: Successfully saved derivative data. [2025-10-02T22:46:21.440409] [DEBUG] [LOCAL ] UMH: Saving derivative data. [2025-10-02T22:46:21.442818] [INFO ] [MAIN ] Derivative Progress: 1798/1975 symbols completed. UNF took 1.2s. Estimated remaining: 1m 14s. Rate: 143.4 symbols/min [2025-10-02T22:46:21.483795] [DEBUG] [LOCAL ] UMH: Derivative data saved (1807 records). [2025-10-02T22:46:21.485531] [INFO ] [MAIN ] UMH: Successfully saved derivative data. [2025-10-02T22:46:21.487802] [INFO ] [MAIN ] Derivative Progress: 1799/1975 symbols completed. UMH took 1.3s. Estimated remaining: 1m 14s. Rate: 143.5 symbols/min [2025-10-02T22:46:21.489370] [DEBUG] [LOCAL ] UNFI: Loaded 42348 existing records from primary storage. [2025-10-02T22:46:21.489543] [INFO ] [MAIN ] UNFI: Loaded 42348 primary data records. [2025-10-02T22:46:21.839666] [DEBUG] [MAIN ] UNFI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:21.840377] [INFO ] [MAIN ] UNFI: Generated 1807 derivative records from 42348 primary records. [2025-10-02T22:46:21.840445] [DEBUG] [LOCAL ] UNFI: Saving derivative data. [2025-10-02T22:46:21.856595] [DEBUG] [LOCAL ] UNFI: Derivative data saved (1807 records). [2025-10-02T22:46:21.856693] [INFO ] [MAIN ] UNFI: Successfully saved derivative data. [2025-10-02T22:46:21.858707] [INFO ] [MAIN ] Derivative Progress: 1800/1975 symbols completed. UNFI took 0.5s. Estimated remaining: 1m 13s. Rate: 143.5 symbols/min [2025-10-02T22:46:21.859420] [INFO ] [MAIN ] UNMA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:21.859251] [INFO ] [MAIN ] UNH: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:21.859347] [INFO ] [MAIN ] UNM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:21.866532] [DEBUG] [LOCAL ] UNMA: Loaded 3533 existing records from primary storage. [2025-10-02T22:46:21.866788] [INFO ] [MAIN ] UNMA: Loaded 3533 primary data records. [2025-10-02T22:46:22.228995] [DEBUG] [LOCAL ] UNM: Loaded 48812 existing records from primary storage. [2025-10-02T22:46:22.242810] [INFO ] [MAIN ] UNM: Loaded 48812 primary data records. [2025-10-02T22:46:22.268701] [DEBUG] [LOCAL ] UNH: Loaded 54185 existing records from primary storage. [2025-10-02T22:46:22.293596] [INFO ] [MAIN ] UNH: Loaded 54185 primary data records. [2025-10-02T22:46:22.794293] [DEBUG] [MAIN ] UNMA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:22.801802] [INFO ] [MAIN ] UNMA: Generated 1807 derivative records from 3533 primary records. [2025-10-02T22:46:22.801930] [DEBUG] [LOCAL ] UNMA: Saving derivative data. [2025-10-02T22:46:22.944400] [DEBUG] [LOCAL ] UNMA: Derivative data saved (1807 records). [2025-10-02T22:46:22.945034] [INFO ] [MAIN ] UNMA: Successfully saved derivative data. [2025-10-02T22:46:22.947578] [INFO ] [MAIN ] Derivative Progress: 1801/1975 symbols completed. UNMA took 1.1s. Estimated remaining: 1m 13s. Rate: 143.4 symbols/min [2025-10-02T22:46:22.948087] [INFO ] [MAIN ] UNP: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:22.971374] [DEBUG] [MAIN ] UNM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:22.972244] [INFO ] [MAIN ] UNM: Generated 1807 derivative records from 48812 primary records. [2025-10-02T22:46:22.972328] [DEBUG] [LOCAL ] UNM: Saving derivative data. [2025-10-02T22:46:22.986302] [DEBUG] [MAIN ] UNH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:22.987313] [INFO ] [MAIN ] UNH: Generated 1807 derivative records from 54185 primary records. [2025-10-02T22:46:22.995182] [DEBUG] [LOCAL ] UNH: Saving derivative data. [2025-10-02T22:46:23.034216] [DEBUG] [LOCAL ] UNH: Derivative data saved (1807 records). [2025-10-02T22:46:23.033103] [DEBUG] [LOCAL ] UNM: Derivative data saved (1807 records). [2025-10-02T22:46:23.034437] [INFO ] [MAIN ] UNH: Successfully saved derivative data. [2025-10-02T22:46:23.034526] [INFO ] [MAIN ] UNM: Successfully saved derivative data. [2025-10-02T22:46:23.036856] [INFO ] [MAIN ] Derivative Progress: 1802/1975 symbols completed. UNM took 1.2s. Estimated remaining: 1m 12s. Rate: 143.5 symbols/min [2025-10-02T22:46:23.039100] [INFO ] [MAIN ] UP: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:23.039201] [INFO ] [MAIN ] Derivative Progress: 1803/1975 symbols completed. UNH took 1.2s. Estimated remaining: 1m 12s. Rate: 143.5 symbols/min [2025-10-02T22:46:23.039737] [INFO ] [MAIN ] UPS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:23.058237] [DEBUG] [LOCAL ] UNP: Loaded 53658 existing records from primary storage. [2025-10-02T22:46:23.058432] [INFO ] [MAIN ] UNP: Loaded 53658 primary data records. [2025-10-02T22:46:23.473261] [DEBUG] [LOCAL ] UP: Loaded 43529 existing records from primary storage. [2025-10-02T22:46:23.474389] [INFO ] [MAIN ] UP: Loaded 43529 primary data records. [2025-10-02T22:46:23.547721] [DEBUG] [LOCAL ] UPS: Loaded 54102 existing records from primary storage. [2025-10-02T22:46:23.557236] [INFO ] [MAIN ] UPS: Loaded 54102 primary data records. [2025-10-02T22:46:24.194457] [DEBUG] [MAIN ] UNP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:24.195576] [INFO ] [MAIN ] UNP: Generated 1807 derivative records from 53658 primary records. [2025-10-02T22:46:24.196021] [DEBUG] [LOCAL ] UNP: Saving derivative data. [2025-10-02T22:46:24.220431] [DEBUG] [LOCAL ] UNP: Derivative data saved (1807 records). [2025-10-02T22:46:24.237690] [INFO ] [MAIN ] UNP: Successfully saved derivative data. [2025-10-02T22:46:24.240894] [INFO ] [MAIN ] Derivative Progress: 1804/1975 symbols completed. UNP took 1.3s. Estimated remaining: 1m 12s. Rate: 143.4 symbols/min [2025-10-02T22:46:24.241285] [INFO ] [MAIN ] URI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:24.243090] [DEBUG] [MAIN ] UP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:24.244247] [INFO ] [MAIN ] UP: Generated 1807 derivative records from 43529 primary records. [2025-10-02T22:46:24.244327] [DEBUG] [LOCAL ] UP: Saving derivative data. [2025-10-02T22:46:24.275068] [DEBUG] [MAIN ] UPS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:24.277379] [INFO ] [MAIN ] UPS: Generated 1807 derivative records from 54102 primary records. [2025-10-02T22:46:24.277516] [DEBUG] [LOCAL ] UPS: Saving derivative data. [2025-10-02T22:46:24.296822] [DEBUG] [LOCAL ] UP: Derivative data saved (1807 records). [2025-10-02T22:46:24.299410] [INFO ] [MAIN ] UP: Successfully saved derivative data. [2025-10-02T22:46:24.299230] [DEBUG] [LOCAL ] UPS: Derivative data saved (1807 records). [2025-10-02T22:46:24.302204] [INFO ] [MAIN ] Derivative Progress: 1805/1975 symbols completed. UP took 1.3s. Estimated remaining: 1m 11s. Rate: 143.5 symbols/min [2025-10-02T22:46:24.302462] [INFO ] [MAIN ] USA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:24.299725] [INFO ] [MAIN ] UPS: Successfully saved derivative data. [2025-10-02T22:46:24.305024] [INFO ] [MAIN ] Derivative Progress: 1806/1975 symbols completed. UPS took 1.3s. Estimated remaining: 1m 11s. Rate: 143.5 symbols/min [2025-10-02T22:46:24.305705] [INFO ] [MAIN ] USAC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:24.333169] [DEBUG] [LOCAL ] URI: Loaded 35864 existing records from primary storage. [2025-10-02T22:46:24.333523] [INFO ] [MAIN ] URI: Loaded 35864 primary data records. [2025-10-02T22:46:24.501211] [DEBUG] [LOCAL ] USA: Loaded 36257 existing records from primary storage. [2025-10-02T22:46:24.522479] [DEBUG] [LOCAL ] USAC: Loaded 22352 existing records from primary storage. [2025-10-02T22:46:24.557986] [INFO ] [MAIN ] USA: Loaded 36257 primary data records. [2025-10-02T22:46:24.560445] [INFO ] [MAIN ] USAC: Loaded 22352 primary data records. [2025-10-02T22:46:25.361154] [DEBUG] [MAIN ] URI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:25.362148] [INFO ] [MAIN ] URI: Generated 1807 derivative records from 35864 primary records. [2025-10-02T22:46:25.362348] [DEBUG] [LOCAL ] URI: Saving derivative data. [2025-10-02T22:46:25.384807] [DEBUG] [LOCAL ] URI: Derivative data saved (1807 records). [2025-10-02T22:46:25.385100] [INFO ] [MAIN ] URI: Successfully saved derivative data. [2025-10-02T22:46:25.401227] [DEBUG] [MAIN ] USAC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:25.400727] [INFO ] [MAIN ] Derivative Progress: 1807/1975 symbols completed. URI took 1.2s. Estimated remaining: 1m 10s. Rate: 143.4 symbols/min [2025-10-02T22:46:25.402553] [INFO ] [MAIN ] USAC: Generated 1807 derivative records from 22352 primary records. [2025-10-02T22:46:25.402824] [INFO ] [MAIN ] USB: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:25.403009] [DEBUG] [LOCAL ] USAC: Saving derivative data. [2025-10-02T22:46:25.426534] [DEBUG] [LOCAL ] USAC: Derivative data saved (1807 records). [2025-10-02T22:46:25.440200] [INFO ] [MAIN ] USAC: Successfully saved derivative data. [2025-10-02T22:46:25.440106] [DEBUG] [MAIN ] USA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:25.441077] [INFO ] [MAIN ] USA: Generated 1807 derivative records from 36257 primary records. [2025-10-02T22:46:25.441200] [DEBUG] [LOCAL ] USA: Saving derivative data. [2025-10-02T22:46:25.444049] [INFO ] [MAIN ] Derivative Progress: 1808/1975 symbols completed. USAC took 1.1s. Estimated remaining: 1m 10s. Rate: 143.5 symbols/min [2025-10-02T22:46:25.444509] [INFO ] [MAIN ] USFD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:25.461820] [DEBUG] [LOCAL ] USA: Derivative data saved (1807 records). [2025-10-02T22:46:25.461952] [INFO ] [MAIN ] USA: Successfully saved derivative data. [2025-10-02T22:46:25.463923] [INFO ] [MAIN ] Derivative Progress: 1809/1975 symbols completed. USA took 1.2s. Estimated remaining: 1m 9s. Rate: 143.6 symbols/min [2025-10-02T22:46:25.464102] [INFO ] [MAIN ] USNA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:25.497747] [DEBUG] [LOCAL ] USNA: Loaded 17937 existing records from primary storage. [2025-10-02T22:46:25.512919] [INFO ] [MAIN ] USNA: Loaded 17937 primary data records. [2025-10-02T22:46:25.526870] [DEBUG] [LOCAL ] USB: Loaded 54078 existing records from primary storage. [2025-10-02T22:46:25.550358] [INFO ] [MAIN ] USB: Loaded 54078 primary data records. [2025-10-02T22:46:25.795796] [DEBUG] [LOCAL ] USFD: Loaded 51579 existing records from primary storage. [2025-10-02T22:46:25.826048] [INFO ] [MAIN ] USFD: Loaded 51579 primary data records. [2025-10-02T22:46:26.601151] [DEBUG] [MAIN ] USB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:26.607052] [INFO ] [MAIN ] USB: Generated 1807 derivative records from 54078 primary records. [2025-10-02T22:46:26.608084] [DEBUG] [MAIN ] USNA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:26.607549] [DEBUG] [LOCAL ] USB: Saving derivative data. [2025-10-02T22:46:26.608945] [INFO ] [MAIN ] USNA: Generated 1807 derivative records from 17937 primary records. [2025-10-02T22:46:26.609077] [DEBUG] [LOCAL ] USNA: Saving derivative data. [2025-10-02T22:46:26.656827] [DEBUG] [MAIN ] USFD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:26.656214] [DEBUG] [LOCAL ] USB: Derivative data saved (1807 records). [2025-10-02T22:46:26.657501] [INFO ] [MAIN ] USB: Successfully saved derivative data. [2025-10-02T22:46:26.660836] [INFO ] [MAIN ] USFD: Generated 1807 derivative records from 51579 primary records. [2025-10-02T22:46:26.661205] [DEBUG] [LOCAL ] USFD: Saving derivative data. [2025-10-02T22:46:26.659598] [INFO ] [MAIN ] Derivative Progress: 1810/1975 symbols completed. USB took 1.3s. Estimated remaining: 1m 9s. Rate: 143.4 symbols/min [2025-10-02T22:46:26.663537] [INFO ] [MAIN ] USPH: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:26.682124] [DEBUG] [LOCAL ] USNA: Derivative data saved (1807 records). [2025-10-02T22:46:26.681553] [DEBUG] [LOCAL ] USFD: Derivative data saved (1807 records). [2025-10-02T22:46:26.682277] [INFO ] [MAIN ] USNA: Successfully saved derivative data. [2025-10-02T22:46:26.684419] [INFO ] [MAIN ] Derivative Progress: 1811/1975 symbols completed. USNA took 1.2s. Estimated remaining: 1m 9s. Rate: 143.5 symbols/min [2025-10-02T22:46:26.684711] [INFO ] [MAIN ] UTF: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:26.684828] [INFO ] [MAIN ] USFD: Successfully saved derivative data. [2025-10-02T22:46:26.688076] [INFO ] [MAIN ] Derivative Progress: 1812/1975 symbols completed. USFD took 1.2s. Estimated remaining: 1m 8s. Rate: 143.6 symbols/min [2025-10-02T22:46:26.688379] [INFO ] [MAIN ] UTI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:26.701336] [DEBUG] [LOCAL ] USPH: Loaded 16902 existing records from primary storage. [2025-10-02T22:46:26.701563] [INFO ] [MAIN ] USPH: Loaded 16902 primary data records. [2025-10-02T22:46:27.045580] [DEBUG] [LOCAL ] UTF: Loaded 29608 existing records from primary storage. [2025-10-02T22:46:27.045879] [INFO ] [MAIN ] UTF: Loaded 29608 primary data records. [2025-10-02T22:46:27.111201] [DEBUG] [LOCAL ] UTI: Loaded 40755 existing records from primary storage. [2025-10-02T22:46:27.119516] [INFO ] [MAIN ] UTI: Loaded 40755 primary data records. [2025-10-02T22:46:27.759040] [DEBUG] [MAIN ] USPH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:27.760806] [INFO ] [MAIN ] USPH: Generated 1807 derivative records from 16902 primary records. [2025-10-02T22:46:27.760994] [DEBUG] [LOCAL ] USPH: Saving derivative data. [2025-10-02T22:46:27.780540] [DEBUG] [LOCAL ] USPH: Derivative data saved (1807 records). [2025-10-02T22:46:27.780983] [INFO ] [MAIN ] USPH: Successfully saved derivative data. [2025-10-02T22:46:27.783583] [INFO ] [MAIN ] Derivative Progress: 1813/1975 symbols completed. USPH took 1.1s. Estimated remaining: 1m 8s. Rate: 143.4 symbols/min [2025-10-02T22:46:27.804457] [DEBUG] [MAIN ] UTI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:27.817469] [INFO ] [MAIN ] UTI: Generated 1807 derivative records from 40755 primary records. [2025-10-02T22:46:27.817566] [DEBUG] [LOCAL ] UTI: Saving derivative data. [2025-10-02T22:46:27.818391] [DEBUG] [MAIN ] UTF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:27.819194] [INFO ] [MAIN ] UTF: Generated 1807 derivative records from 29608 primary records. [2025-10-02T22:46:27.819465] [DEBUG] [LOCAL ] UTF: Saving derivative data. [2025-10-02T22:46:27.850006] [DEBUG] [LOCAL ] UTI: Derivative data saved (1807 records). [2025-10-02T22:46:27.850911] [INFO ] [MAIN ] UTI: Successfully saved derivative data. [2025-10-02T22:46:27.853258] [INFO ] [MAIN ] Derivative Progress: 1814/1975 symbols completed. UTI took 1.2s. Estimated remaining: 1m 7s. Rate: 143.5 symbols/min [2025-10-02T22:46:27.850990] [DEBUG] [LOCAL ] UTF: Derivative data saved (1807 records). [2025-10-02T22:46:27.853532] [INFO ] [MAIN ] UTF: Successfully saved derivative data. [2025-10-02T22:46:27.856453] [INFO ] [MAIN ] Derivative Progress: 1815/1975 symbols completed. UTF took 1.2s. Estimated remaining: 1m 7s. Rate: 143.6 symbols/min [2025-10-02T22:46:27.856916] [INFO ] [MAIN ] UTZ: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:27.856860] [INFO ] [MAIN ] UTL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:27.857133] [INFO ] [MAIN ] UVE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:27.873877] [DEBUG] [LOCAL ] UTL: Loaded 11437 existing records from primary storage. [2025-10-02T22:46:27.874193] [INFO ] [MAIN ] UTL: Loaded 11437 primary data records. [2025-10-02T22:46:28.013739] [DEBUG] [LOCAL ] UVE: Loaded 21949 existing records from primary storage. [2025-10-02T22:46:28.019480] [INFO ] [MAIN ] UVE: Loaded 21949 primary data records. [2025-10-02T22:46:28.345132] [DEBUG] [LOCAL ] UTZ: Loaded 45037 existing records from primary storage. [2025-10-02T22:46:28.351513] [INFO ] [MAIN ] UTZ: Loaded 45037 primary data records. [2025-10-02T22:46:28.926720] [DEBUG] [MAIN ] UTL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:28.928390] [INFO ] [MAIN ] UTL: Generated 1807 derivative records from 11437 primary records. [2025-10-02T22:46:28.928675] [DEBUG] [LOCAL ] UTL: Saving derivative data. [2025-10-02T22:46:28.946981] [DEBUG] [LOCAL ] UTL: Derivative data saved (1807 records). [2025-10-02T22:46:28.947433] [INFO ] [MAIN ] UTL: Successfully saved derivative data. [2025-10-02T22:46:28.949781] [INFO ] [MAIN ] Derivative Progress: 1816/1975 symbols completed. UTL took 1.1s. Estimated remaining: 1m 7s. Rate: 143.4 symbols/min [2025-10-02T22:46:28.949941] [INFO ] [MAIN ] UVV: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:28.968638] [DEBUG] [MAIN ] UVE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:28.969437] [INFO ] [MAIN ] UVE: Generated 1807 derivative records from 21949 primary records. [2025-10-02T22:46:28.969770] [DEBUG] [LOCAL ] UVE: Saving derivative data. [2025-10-02T22:46:29.003736] [DEBUG] [LOCAL ] UVE: Derivative data saved (1807 records). [2025-10-02T22:46:29.004125] [DEBUG] [LOCAL ] UVV: Loaded 22653 existing records from primary storage. [2025-10-02T22:46:29.004395] [INFO ] [MAIN ] UVE: Successfully saved derivative data. [2025-10-02T22:46:29.018955] [INFO ] [MAIN ] UVV: Loaded 22653 primary data records. [2025-10-02T22:46:29.025297] [DEBUG] [MAIN ] UTZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:29.018858] [INFO ] [MAIN ] Derivative Progress: 1817/1975 symbols completed. UVE took 1.2s. Estimated remaining: 1m 6s. Rate: 143.5 symbols/min [2025-10-02T22:46:29.038485] [INFO ] [MAIN ] UTZ: Generated 1807 derivative records from 45037 primary records. [2025-10-02T22:46:29.044504] [INFO ] [MAIN ] UWMC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:29.044595] [DEBUG] [LOCAL ] UTZ: Saving derivative data. [2025-10-02T22:46:29.151706] [DEBUG] [LOCAL ] UTZ: Derivative data saved (1807 records). [2025-10-02T22:46:29.157177] [INFO ] [MAIN ] UTZ: Successfully saved derivative data. [2025-10-02T22:46:29.169841] [INFO ] [MAIN ] Derivative Progress: 1818/1975 symbols completed. UTZ took 1.3s. Estimated remaining: 1m 6s. Rate: 143.6 symbols/min [2025-10-02T22:46:29.204088] [INFO ] [MAIN ] UZD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:29.375220] [DEBUG] [LOCAL ] UZD: Loaded 6468 existing records from primary storage. [2025-10-02T22:46:29.375382] [INFO ] [MAIN ] UZD: Loaded 6468 primary data records. [2025-10-02T22:46:29.528585] [DEBUG] [LOCAL ] UWMC: Loaded 53165 existing records from primary storage. [2025-10-02T22:46:29.550779] [INFO ] [MAIN ] UWMC: Loaded 53165 primary data records. [2025-10-02T22:46:30.104610] [DEBUG] [MAIN ] UVV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:30.106238] [INFO ] [MAIN ] UVV: Generated 1807 derivative records from 22653 primary records. [2025-10-02T22:46:30.106701] [DEBUG] [LOCAL ] UVV: Saving derivative data. [2025-10-02T22:46:30.124874] [DEBUG] [LOCAL ] UVV: Derivative data saved (1807 records). [2025-10-02T22:46:30.125197] [INFO ] [MAIN ] UVV: Successfully saved derivative data. [2025-10-02T22:46:30.127692] [INFO ] [MAIN ] Derivative Progress: 1819/1975 symbols completed. UVV took 1.2s. Estimated remaining: 1m 5s. Rate: 143.5 symbols/min [2025-10-02T22:46:30.127912] [INFO ] [MAIN ] UZE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:30.154023] [DEBUG] [MAIN ] UZD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:30.154235] [DEBUG] [LOCAL ] UZE: Loaded 7475 existing records from primary storage. [2025-10-02T22:46:30.155367] [INFO ] [MAIN ] UZD: Generated 1807 derivative records from 6468 primary records. [2025-10-02T22:46:30.154703] [INFO ] [MAIN ] UZE: Loaded 7475 primary data records. [2025-10-02T22:46:30.155508] [DEBUG] [LOCAL ] UZD: Saving derivative data. [2025-10-02T22:46:30.289061] [DEBUG] [MAIN ] UWMC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:30.304157] [INFO ] [MAIN ] UWMC: Generated 1807 derivative records from 53165 primary records. [2025-10-02T22:46:30.304895] [DEBUG] [LOCAL ] UWMC: Saving derivative data. [2025-10-02T22:46:30.335055] [DEBUG] [LOCAL ] UZD: Derivative data saved (1807 records). [2025-10-02T22:46:30.346436] [INFO ] [MAIN ] UZD: Successfully saved derivative data. [2025-10-02T22:46:30.348723] [INFO ] [MAIN ] Derivative Progress: 1820/1975 symbols completed. UZD took 1.1s. Estimated remaining: 1m 5s. Rate: 143.5 symbols/min [2025-10-02T22:46:30.366978] [INFO ] [MAIN ] UZF: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:30.546213] [DEBUG] [LOCAL ] UZF: Loaded 6493 existing records from primary storage. [2025-10-02T22:46:30.546307] [DEBUG] [LOCAL ] UWMC: Derivative data saved (1807 records). [2025-10-02T22:46:30.546563] [INFO ] [MAIN ] UZF: Loaded 6493 primary data records. [2025-10-02T22:46:30.546626] [INFO ] [MAIN ] UWMC: Successfully saved derivative data. [2025-10-02T22:46:30.554302] [INFO ] [MAIN ] Derivative Progress: 1821/1975 symbols completed. UWMC took 1.5s. Estimated remaining: 1m 4s. Rate: 143.5 symbols/min [2025-10-02T22:46:30.571441] [INFO ] [MAIN ] V: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:30.916109] [DEBUG] [MAIN ] UZE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:30.933440] [INFO ] [MAIN ] UZE: Generated 1807 derivative records from 7475 primary records. [2025-10-02T22:46:30.934969] [DEBUG] [LOCAL ] V: Loaded 54145 existing records from primary storage. [2025-10-02T22:46:30.935203] [DEBUG] [LOCAL ] UZE: Saving derivative data. [2025-10-02T22:46:30.935703] [INFO ] [MAIN ] V: Loaded 54145 primary data records. [2025-10-02T22:46:31.084482] [DEBUG] [LOCAL ] UZE: Derivative data saved (1807 records). [2025-10-02T22:46:31.084708] [INFO ] [MAIN ] UZE: Successfully saved derivative data. [2025-10-02T22:46:31.086799] [INFO ] [MAIN ] Derivative Progress: 1822/1975 symbols completed. UZE took 1.0s. Estimated remaining: 1m 4s. Rate: 143.5 symbols/min [2025-10-02T22:46:31.103269] [INFO ] [MAIN ] VAC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:31.285888] [DEBUG] [MAIN ] UZF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:31.301272] [INFO ] [MAIN ] UZF: Generated 1807 derivative records from 6493 primary records. [2025-10-02T22:46:31.301727] [DEBUG] [LOCAL ] UZF: Saving derivative data. [2025-10-02T22:46:31.323168] [DEBUG] [LOCAL ] UZF: Derivative data saved (1807 records). [2025-10-02T22:46:31.332303] [INFO ] [MAIN ] UZF: Successfully saved derivative data. [2025-10-02T22:46:31.335844] [INFO ] [MAIN ] Derivative Progress: 1823/1975 symbols completed. UZF took 1.0s. Estimated remaining: 1m 4s. Rate: 143.5 symbols/min [2025-10-02T22:46:31.336161] [INFO ] [MAIN ] VAL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:31.351545] [DEBUG] [LOCAL ] VAC: Loaded 34605 existing records from primary storage. [2025-10-02T22:46:31.352128] [INFO ] [MAIN ] VAC: Loaded 34605 primary data records. [2025-10-02T22:46:31.522894] [DEBUG] [MAIN ] V: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:31.559794] [INFO ] [MAIN ] V: Generated 1807 derivative records from 54145 primary records. [2025-10-02T22:46:31.588050] [DEBUG] [LOCAL ] V: Saving derivative data. [2025-10-02T22:46:31.782996] [DEBUG] [LOCAL ] VAL: Loaded 50658 existing records from primary storage. [2025-10-02T22:46:31.784149] [INFO ] [MAIN ] VAL: Loaded 50658 primary data records. [2025-10-02T22:46:31.897208] [DEBUG] [LOCAL ] V: Derivative data saved (1807 records). [2025-10-02T22:46:31.912942] [INFO ] [MAIN ] V: Successfully saved derivative data. [2025-10-02T22:46:31.921423] [INFO ] [MAIN ] Derivative Progress: 1824/1975 symbols completed. V took 1.3s. Estimated remaining: 1m 3s. Rate: 143.5 symbols/min [2025-10-02T22:46:31.927024] [INFO ] [MAIN ] VALE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:32.183378] [DEBUG] [MAIN ] VAC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:32.184997] [INFO ] [MAIN ] VAC: Generated 1807 derivative records from 34605 primary records. [2025-10-02T22:46:32.185375] [DEBUG] [LOCAL ] VAC: Saving derivative data. [2025-10-02T22:46:32.221115] [DEBUG] [LOCAL ] VAC: Derivative data saved (1807 records). [2025-10-02T22:46:32.221525] [INFO ] [MAIN ] VAC: Successfully saved derivative data. [2025-10-02T22:46:32.223857] [INFO ] [MAIN ] Derivative Progress: 1825/1975 symbols completed. VAC took 1.1s. Estimated remaining: 1m 3s. Rate: 143.5 symbols/min [2025-10-02T22:46:32.224305] [INFO ] [MAIN ] VATE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:32.246815] [DEBUG] [LOCAL ] VALE: Loaded 54083 existing records from primary storage. [2025-10-02T22:46:32.250333] [DEBUG] [LOCAL ] VATE: Loaded 5350 existing records from primary storage. [2025-10-02T22:46:32.263149] [INFO ] [MAIN ] VALE: Loaded 54083 primary data records. [2025-10-02T22:46:32.263083] [INFO ] [MAIN ] VATE: Loaded 5350 primary data records. [2025-10-02T22:46:32.281773] [DEBUG] [MAIN ] VAL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:32.311563] [INFO ] [MAIN ] VAL: Generated 1807 derivative records from 50658 primary records. [2025-10-02T22:46:32.406590] [DEBUG] [LOCAL ] VAL: Saving derivative data. [2025-10-02T22:46:32.773392] [DEBUG] [LOCAL ] VAL: Derivative data saved (1807 records). [2025-10-02T22:46:32.789809] [INFO ] [MAIN ] VAL: Successfully saved derivative data. [2025-10-02T22:46:32.792867] [INFO ] [MAIN ] Derivative Progress: 1826/1975 symbols completed. VAL took 1.5s. Estimated remaining: 1m 2s. Rate: 143.5 symbols/min [2025-10-02T22:46:32.812484] [INFO ] [MAIN ] VBF: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:32.955794] [DEBUG] [LOCAL ] VBF: Loaded 6990 existing records from primary storage. [2025-10-02T22:46:32.956356] [INFO ] [MAIN ] VBF: Loaded 6990 primary data records. [2025-10-02T22:46:33.135758] [DEBUG] [MAIN ] VATE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:33.153295] [INFO ] [MAIN ] VATE: Generated 1807 derivative records from 5350 primary records. [2025-10-02T22:46:33.186744] [DEBUG] [LOCAL ] VATE: Saving derivative data. [2025-10-02T22:46:33.341122] [DEBUG] [MAIN ] VALE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:33.346155] [DEBUG] [LOCAL ] VATE: Derivative data saved (1807 records). [2025-10-02T22:46:33.346744] [INFO ] [MAIN ] VATE: Successfully saved derivative data. [2025-10-02T22:46:33.349985] [INFO ] [MAIN ] Derivative Progress: 1827/1975 symbols completed. VATE took 1.1s. Estimated remaining: 1m 2s. Rate: 143.5 symbols/min [2025-10-02T22:46:33.351491] [INFO ] [MAIN ] VALE: Generated 1807 derivative records from 54083 primary records. [2025-10-02T22:46:33.352781] [DEBUG] [LOCAL ] VALE: Saving derivative data. [2025-10-02T22:46:33.352627] [INFO ] [MAIN ] VCV: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:33.374002] [DEBUG] [LOCAL ] VALE: Derivative data saved (1807 records). [2025-10-02T22:46:33.374411] [INFO ] [MAIN ] VALE: Successfully saved derivative data. [2025-10-02T22:46:33.377013] [INFO ] [MAIN ] Derivative Progress: 1828/1975 symbols completed. VALE took 1.4s. Estimated remaining: 1m 1s. Rate: 143.6 symbols/min [2025-10-02T22:46:33.390291] [DEBUG] [LOCAL ] VCV: Loaded 13773 existing records from primary storage. [2025-10-02T22:46:33.390767] [INFO ] [MAIN ] VCV: Loaded 13773 primary data records. [2025-10-02T22:46:33.532713] [DEBUG] [MAIN ] VBF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:33.554242] [INFO ] [MAIN ] VBF: Generated 1807 derivative records from 6990 primary records. [2025-10-02T22:46:33.580622] [DEBUG] [LOCAL ] VBF: Saving derivative data. [2025-10-02T22:46:33.766863] [DEBUG] [LOCAL ] VBF: Derivative data saved (1807 records). [2025-10-02T22:46:33.767261] [INFO ] [MAIN ] VBF: Successfully saved derivative data. [2025-10-02T22:46:33.769557] [INFO ] [MAIN ] Derivative Progress: 1829/1975 symbols completed. VBF took 1.0s. Estimated remaining: 1m 1s. Rate: 143.6 symbols/min [2025-10-02T22:46:33.793348] [DEBUG] [MAIN ] VCV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:33.794098] [INFO ] [MAIN ] VCV: Generated 1807 derivative records from 13773 primary records. [2025-10-02T22:46:33.794169] [DEBUG] [LOCAL ] VCV: Saving derivative data. [2025-10-02T22:46:33.812683] [DEBUG] [LOCAL ] VCV: Derivative data saved (1807 records). [2025-10-02T22:46:33.812818] [INFO ] [MAIN ] VCV: Successfully saved derivative data. [2025-10-02T22:46:33.815537] [INFO ] [MAIN ] Derivative Progress: 1830/1975 symbols completed. VCV took 0.5s. Estimated remaining: 1m 1s. Rate: 143.6 symbols/min [2025-10-02T22:46:33.816320] [INFO ] [MAIN ] VET: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:33.816159] [INFO ] [MAIN ] VEEV: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:33.816476] [INFO ] [MAIN ] VEL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:33.833450] [DEBUG] [LOCAL ] VEL: Loaded 12854 existing records from primary storage. [2025-10-02T22:46:33.833825] [INFO ] [MAIN ] VEL: Loaded 12854 primary data records. [2025-10-02T22:46:34.091217] [DEBUG] [LOCAL ] VET: Loaded 44247 existing records from primary storage. [2025-10-02T22:46:34.091623] [INFO ] [MAIN ] VET: Loaded 44247 primary data records. [2025-10-02T22:46:34.236132] [DEBUG] [LOCAL ] VEEV: Loaded 47405 existing records from primary storage. [2025-10-02T22:46:34.251266] [INFO ] [MAIN ] VEEV: Loaded 47405 primary data records. [2025-10-02T22:46:34.942362] [DEBUG] [MAIN ] VEL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:34.944255] [INFO ] [MAIN ] VEL: Generated 1807 derivative records from 12854 primary records. [2025-10-02T22:46:34.944759] [DEBUG] [LOCAL ] VEL: Saving derivative data. [2025-10-02T22:46:34.963838] [DEBUG] [LOCAL ] VEL: Derivative data saved (1807 records). [2025-10-02T22:46:34.964794] [INFO ] [MAIN ] VEL: Successfully saved derivative data. [2025-10-02T22:46:34.967982] [INFO ] [MAIN ] Derivative Progress: 1831/1975 symbols completed. VEL took 1.2s. Estimated remaining: 1m 0s. Rate: 143.5 symbols/min [2025-10-02T22:46:34.968505] [INFO ] [MAIN ] VFC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:35.004157] [DEBUG] [MAIN ] VET: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:35.004449] [DEBUG] [MAIN ] VEEV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:35.005534] [INFO ] [MAIN ] VEEV: Generated 1807 derivative records from 47405 primary records. [2025-10-02T22:46:35.006296] [INFO ] [MAIN ] VET: Generated 1807 derivative records from 44247 primary records. [2025-10-02T22:46:35.006477] [DEBUG] [LOCAL ] VEEV: Saving derivative data. [2025-10-02T22:46:35.006432] [DEBUG] [LOCAL ] VET: Saving derivative data. [2025-10-02T22:46:35.039469] [DEBUG] [LOCAL ] VEEV: Derivative data saved (1807 records). [2025-10-02T22:46:35.040750] [INFO ] [MAIN ] VEEV: Successfully saved derivative data. [2025-10-02T22:46:35.042578] [INFO ] [MAIN ] Derivative Progress: 1832/1975 symbols completed. VEEV took 1.2s. Estimated remaining: 59.8s. Rate: 143.6 symbols/min [2025-10-02T22:46:35.043564] [DEBUG] [LOCAL ] VET: Derivative data saved (1807 records). [2025-10-02T22:46:35.043796] [INFO ] [MAIN ] VET: Successfully saved derivative data. [2025-10-02T22:46:35.043894] [INFO ] [MAIN ] VGI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:35.046066] [INFO ] [MAIN ] Derivative Progress: 1833/1975 symbols completed. VET took 1.2s. Estimated remaining: 59.3s. Rate: 143.6 symbols/min [2025-10-02T22:46:35.046315] [INFO ] [MAIN ] VGM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:35.067359] [DEBUG] [LOCAL ] VGI: Loaded 5169 existing records from primary storage. [2025-10-02T22:46:35.067669] [INFO ] [MAIN ] VGI: Loaded 5169 primary data records. [2025-10-02T22:46:35.184312] [DEBUG] [LOCAL ] VGM: Loaded 18428 existing records from primary storage. [2025-10-02T22:46:35.204713] [INFO ] [MAIN ] VGM: Loaded 18428 primary data records. [2025-10-02T22:46:35.225281] [DEBUG] [LOCAL ] VFC: Loaded 54000 existing records from primary storage. [2025-10-02T22:46:35.253340] [INFO ] [MAIN ] VFC: Loaded 54000 primary data records. [2025-10-02T22:46:36.172383] [DEBUG] [MAIN ] VGI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:36.173541] [INFO ] [MAIN ] VGI: Generated 1807 derivative records from 5169 primary records. [2025-10-02T22:46:36.173945] [DEBUG] [LOCAL ] VGI: Saving derivative data. [2025-10-02T22:46:36.191551] [DEBUG] [LOCAL ] VGI: Derivative data saved (1807 records). [2025-10-02T22:46:36.193321] [INFO ] [MAIN ] VGI: Successfully saved derivative data. [2025-10-02T22:46:36.195537] [INFO ] [MAIN ] Derivative Progress: 1834/1975 symbols completed. VGI took 1.2s. Estimated remaining: 59.0s. Rate: 143.5 symbols/min [2025-10-02T22:46:36.196004] [INFO ] [MAIN ] VHI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:36.210023] [DEBUG] [MAIN ] VFC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:36.210880] [INFO ] [MAIN ] VFC: Generated 1807 derivative records from 54000 primary records. [2025-10-02T22:46:36.211242] [DEBUG] [LOCAL ] VFC: Saving derivative data. [2025-10-02T22:46:36.234498] [DEBUG] [LOCAL ] VFC: Derivative data saved (1807 records). [2025-10-02T22:46:36.234763] [DEBUG] [LOCAL ] VHI: Loaded 2787 existing records from primary storage. [2025-10-02T22:46:36.234956] [INFO ] [MAIN ] VHI: Loaded 2787 primary data records. [2025-10-02T22:46:36.254229] [INFO ] [MAIN ] VFC: Successfully saved derivative data. [2025-10-02T22:46:36.301990] [DEBUG] [MAIN ] VGM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:36.313413] [INFO ] [MAIN ] VGM: Generated 1807 derivative records from 18428 primary records. [2025-10-02T22:46:36.320403] [DEBUG] [LOCAL ] VGM: Saving derivative data. [2025-10-02T22:46:36.296412] [INFO ] [MAIN ] Derivative Progress: 1835/1975 symbols completed. VFC took 1.3s. Estimated remaining: 58.5s. Rate: 143.6 symbols/min [2025-10-02T22:46:36.339543] [INFO ] [MAIN ] VICI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:36.399921] [DEBUG] [LOCAL ] VGM: Derivative data saved (1807 records). [2025-10-02T22:46:36.462109] [INFO ] [MAIN ] VGM: Successfully saved derivative data. [2025-10-02T22:46:36.470783] [INFO ] [MAIN ] Derivative Progress: 1836/1975 symbols completed. VGM took 1.4s. Estimated remaining: 58.1s. Rate: 143.6 symbols/min [2025-10-02T22:46:36.471128] [INFO ] [MAIN ] VIK: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:36.635608] [DEBUG] [MAIN ] VHI: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-02T22:46:36.636476] [INFO ] [MAIN ] VHI: Generated 1806 derivative records from 2787 primary records. [2025-10-02T22:46:36.651525] [DEBUG] [LOCAL ] VHI: Saving derivative data. [2025-10-02T22:46:36.653441] [DEBUG] [LOCAL ] VICI: Loaded 54037 existing records from primary storage. [2025-10-02T22:46:36.653842] [INFO ] [MAIN ] VICI: Loaded 54037 primary data records. [2025-10-02T22:46:36.753911] [DEBUG] [LOCAL ] VHI: Derivative data saved (1806 records). [2025-10-02T22:46:36.772777] [INFO ] [MAIN ] VHI: Successfully saved derivative data. [2025-10-02T22:46:36.774927] [INFO ] [MAIN ] Derivative Progress: 1837/1975 symbols completed. VHI took 0.6s. Estimated remaining: 57.7s. Rate: 143.6 symbols/min [2025-10-02T22:46:36.818536] [INFO ] [MAIN ] VIPS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:36.825955] [DEBUG] [LOCAL ] VIK: Loaded 52883 existing records from primary storage. [2025-10-02T22:46:36.837192] [INFO ] [MAIN ] VIK: Loaded 52883 primary data records. [2025-10-02T22:46:37.427096] [DEBUG] [LOCAL ] VIPS: Loaded 51710 existing records from primary storage. [2025-10-02T22:46:37.428351] [INFO ] [MAIN ] VIPS: Loaded 51710 primary data records. [2025-10-02T22:46:37.649571] [DEBUG] [MAIN ] VICI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:37.780896] [INFO ] [MAIN ] VICI: Generated 1807 derivative records from 54037 primary records. [2025-10-02T22:46:37.782410] [DEBUG] [LOCAL ] VICI: Saving derivative data. [2025-10-02T22:46:37.803201] [DEBUG] [LOCAL ] VICI: Derivative data saved (1807 records). [2025-10-02T22:46:37.805036] [INFO ] [MAIN ] VICI: Successfully saved derivative data. [2025-10-02T22:46:37.809260] [INFO ] [MAIN ] Derivative Progress: 1838/1975 symbols completed. VICI took 1.5s. Estimated remaining: 57.3s. Rate: 143.5 symbols/min [2025-10-02T22:46:37.810486] [INFO ] [MAIN ] VIRT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:37.826476] [DEBUG] [MAIN ] VIK: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-02T22:46:37.827442] [INFO ] [MAIN ] VIK: Generated 1806 derivative records from 52883 primary records. [2025-10-02T22:46:37.827986] [DEBUG] [LOCAL ] VIK: Saving derivative data. [2025-10-02T22:46:37.846810] [DEBUG] [LOCAL ] VIK: Derivative data saved (1806 records). [2025-10-02T22:46:37.847385] [INFO ] [MAIN ] VIK: Successfully saved derivative data. [2025-10-02T22:46:37.849622] [INFO ] [MAIN ] Derivative Progress: 1839/1975 symbols completed. VIK took 1.4s. Estimated remaining: 56.8s. Rate: 143.6 symbols/min [2025-10-02T22:46:37.850012] [INFO ] [MAIN ] VIST: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:37.875048] [DEBUG] [MAIN ] VIPS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:37.886772] [INFO ] [MAIN ] VIPS: Generated 1807 derivative records from 51710 primary records. [2025-10-02T22:46:37.887014] [DEBUG] [LOCAL ] VIPS: Saving derivative data. [2025-10-02T22:46:37.907724] [DEBUG] [LOCAL ] VIPS: Derivative data saved (1807 records). [2025-10-02T22:46:37.931606] [INFO ] [MAIN ] VIPS: Successfully saved derivative data. [2025-10-02T22:46:37.935729] [DEBUG] [LOCAL ] VIRT: Loaded 46992 existing records from primary storage. [2025-10-02T22:46:37.934395] [INFO ] [MAIN ] Derivative Progress: 1840/1975 symbols completed. VIPS took 1.1s. Estimated remaining: 56.4s. Rate: 143.6 symbols/min [2025-10-02T22:46:37.936022] [INFO ] [MAIN ] VIRT: Loaded 46992 primary data records. [2025-10-02T22:46:37.936182] [INFO ] [MAIN ] VIV: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:38.070057] [DEBUG] [LOCAL ] VIST: Loaded 46326 existing records from primary storage. [2025-10-02T22:46:38.082716] [INFO ] [MAIN ] VIST: Loaded 46326 primary data records. [2025-10-02T22:46:38.573960] [DEBUG] [LOCAL ] VIV: Loaded 45321 existing records from primary storage. [2025-10-02T22:46:38.683464] [INFO ] [MAIN ] VIV: Loaded 45321 primary data records. [2025-10-02T22:46:39.047853] [DEBUG] [MAIN ] VIRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:39.049336] [INFO ] [MAIN ] VIRT: Generated 1807 derivative records from 46992 primary records. [2025-10-02T22:46:39.049638] [DEBUG] [LOCAL ] VIRT: Saving derivative data. [2025-10-02T22:46:39.071027] [DEBUG] [LOCAL ] VIRT: Derivative data saved (1807 records). [2025-10-02T22:46:39.071436] [INFO ] [MAIN ] VIRT: Successfully saved derivative data. [2025-10-02T22:46:39.073701] [INFO ] [MAIN ] Derivative Progress: 1841/1975 symbols completed. VIRT took 1.3s. Estimated remaining: 56.0s. Rate: 143.5 symbols/min [2025-10-02T22:46:39.081862] [INFO ] [MAIN ] VLN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:39.088017] [DEBUG] [MAIN ] VIST: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:39.090256] [INFO ] [MAIN ] VIST: Generated 1807 derivative records from 46326 primary records. [2025-10-02T22:46:39.090675] [DEBUG] [LOCAL ] VIST: Saving derivative data. [2025-10-02T22:46:39.108918] [DEBUG] [LOCAL ] VIST: Derivative data saved (1807 records). [2025-10-02T22:46:39.109367] [INFO ] [MAIN ] VIST: Successfully saved derivative data. [2025-10-02T22:46:39.111545] [INFO ] [MAIN ] Derivative Progress: 1842/1975 symbols completed. VIST took 1.3s. Estimated remaining: 55.6s. Rate: 143.6 symbols/min [2025-10-02T22:46:39.111954] [INFO ] [MAIN ] VLO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:39.129305] [DEBUG] [MAIN ] VIV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:39.138155] [INFO ] [MAIN ] VIV: Generated 1807 derivative records from 45321 primary records. [2025-10-02T22:46:39.138365] [DEBUG] [LOCAL ] VIV: Saving derivative data. [2025-10-02T22:46:39.166269] [DEBUG] [LOCAL ] VLN: Loaded 29371 existing records from primary storage. [2025-10-02T22:46:39.165759] [DEBUG] [LOCAL ] VIV: Derivative data saved (1807 records). [2025-10-02T22:46:39.166504] [INFO ] [MAIN ] VLN: Loaded 29371 primary data records. [2025-10-02T22:46:39.166772] [INFO ] [MAIN ] VIV: Successfully saved derivative data. [2025-10-02T22:46:39.174053] [INFO ] [MAIN ] Derivative Progress: 1843/1975 symbols completed. VIV took 1.2s. Estimated remaining: 55.1s. Rate: 143.6 symbols/min [2025-10-02T22:46:39.404893] [DEBUG] [LOCAL ] VLO: Loaded 53462 existing records from primary storage. [2025-10-02T22:46:39.412238] [INFO ] [MAIN ] VLO: Loaded 53462 primary data records. [2025-10-02T22:46:39.884038] [DEBUG] [MAIN ] VLN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:39.885274] [INFO ] [MAIN ] VLN: Generated 1807 derivative records from 29371 primary records. [2025-10-02T22:46:39.885392] [DEBUG] [LOCAL ] VLN: Saving derivative data. [2025-10-02T22:46:39.905367] [DEBUG] [LOCAL ] VLN: Derivative data saved (1807 records). [2025-10-02T22:46:39.905541] [INFO ] [MAIN ] VLN: Successfully saved derivative data. [2025-10-02T22:46:39.907579] [INFO ] [MAIN ] Derivative Progress: 1844/1975 symbols completed. VLN took 0.8s. Estimated remaining: 54.7s. Rate: 143.6 symbols/min [2025-10-02T22:46:39.921586] [DEBUG] [MAIN ] VLO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:39.922321] [INFO ] [MAIN ] VLO: Generated 1807 derivative records from 53462 primary records. [2025-10-02T22:46:39.922386] [DEBUG] [LOCAL ] VLO: Saving derivative data. [2025-10-02T22:46:39.939732] [DEBUG] [LOCAL ] VLO: Derivative data saved (1807 records). [2025-10-02T22:46:39.939894] [INFO ] [MAIN ] VLO: Successfully saved derivative data. [2025-10-02T22:46:39.942072] [INFO ] [MAIN ] Derivative Progress: 1845/1975 symbols completed. VLO took 0.8s. Estimated remaining: 54.3s. Rate: 143.7 symbols/min [2025-10-02T22:46:39.942760] [INFO ] [MAIN ] VLTO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:39.942693] [INFO ] [MAIN ] VLT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:39.942547] [INFO ] [MAIN ] VLRS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:39.952220] [DEBUG] [LOCAL ] VLT: Loaded 4564 existing records from primary storage. [2025-10-02T22:46:39.952494] [INFO ] [MAIN ] VLT: Loaded 4564 primary data records. [2025-10-02T22:46:40.206134] [DEBUG] [LOCAL ] VLRS: Loaded 40672 existing records from primary storage. [2025-10-02T22:46:40.330334] [INFO ] [MAIN ] VLRS: Loaded 40672 primary data records. [2025-10-02T22:46:40.321137] [DEBUG] [LOCAL ] VLTO: Loaded 46347 existing records from primary storage. [2025-10-02T22:46:40.330798] [INFO ] [MAIN ] VLTO: Loaded 46347 primary data records. [2025-10-02T22:46:41.049574] [DEBUG] [MAIN ] VLT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:41.052071] [INFO ] [MAIN ] VLT: Generated 1807 derivative records from 4564 primary records. [2025-10-02T22:46:41.052377] [DEBUG] [LOCAL ] VLT: Saving derivative data. [2025-10-02T22:46:41.070539] [DEBUG] [LOCAL ] VLT: Derivative data saved (1807 records). [2025-10-02T22:46:41.072427] [INFO ] [MAIN ] VLT: Successfully saved derivative data. [2025-10-02T22:46:41.074844] [INFO ] [MAIN ] Derivative Progress: 1846/1975 symbols completed. VLT took 1.1s. Estimated remaining: 53.9s. Rate: 143.5 symbols/min [2025-10-02T22:46:41.075177] [INFO ] [MAIN ] VMC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:41.107998] [DEBUG] [MAIN ] VLTO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:41.114061] [INFO ] [MAIN ] VLTO: Generated 1807 derivative records from 46347 primary records. [2025-10-02T22:46:41.114789] [DEBUG] [LOCAL ] VLTO: Saving derivative data. [2025-10-02T22:46:41.115894] [DEBUG] [MAIN ] VLRS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:41.124858] [INFO ] [MAIN ] VLRS: Generated 1807 derivative records from 40672 primary records. [2025-10-02T22:46:41.129275] [DEBUG] [LOCAL ] VLRS: Saving derivative data. [2025-10-02T22:46:41.159355] [DEBUG] [LOCAL ] VLTO: Derivative data saved (1807 records). [2025-10-02T22:46:41.160033] [INFO ] [MAIN ] VLTO: Successfully saved derivative data. [2025-10-02T22:46:41.162504] [INFO ] [MAIN ] Derivative Progress: 1847/1975 symbols completed. VLTO took 1.2s. Estimated remaining: 53.5s. Rate: 143.6 symbols/min [2025-10-02T22:46:41.163433] [INFO ] [MAIN ] VMI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:41.164885] [DEBUG] [LOCAL ] VLRS: Derivative data saved (1807 records). [2025-10-02T22:46:41.165346] [INFO ] [MAIN ] VLRS: Successfully saved derivative data. [2025-10-02T22:46:41.167551] [INFO ] [MAIN ] Derivative Progress: 1848/1975 symbols completed. VLRS took 1.2s. Estimated remaining: 53.0s. Rate: 143.7 symbols/min [2025-10-02T22:46:41.167862] [INFO ] [MAIN ] VMO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:41.182755] [DEBUG] [LOCAL ] VMC: Loaded 43571 existing records from primary storage. [2025-10-02T22:46:41.182989] [INFO ] [MAIN ] VMC: Loaded 43571 primary data records. [2025-10-02T22:46:41.310980] [DEBUG] [LOCAL ] VMI: Loaded 15488 existing records from primary storage. [2025-10-02T22:46:41.315790] [INFO ] [MAIN ] VMI: Loaded 15488 primary data records. [2025-10-02T22:46:41.396393] [DEBUG] [LOCAL ] VMO: Loaded 21243 existing records from primary storage. [2025-10-02T22:46:41.432061] [INFO ] [MAIN ] VMO: Loaded 21243 primary data records. [2025-10-02T22:46:42.281015] [DEBUG] [MAIN ] VMC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:42.281912] [INFO ] [MAIN ] VMC: Generated 1807 derivative records from 43571 primary records. [2025-10-02T22:46:42.282278] [DEBUG] [LOCAL ] VMC: Saving derivative data. [2025-10-02T22:46:42.320295] [DEBUG] [LOCAL ] VMC: Derivative data saved (1807 records). [2025-10-02T22:46:42.320173] [DEBUG] [MAIN ] VMI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:42.320917] [INFO ] [MAIN ] VMC: Successfully saved derivative data. [2025-10-02T22:46:42.324075] [INFO ] [MAIN ] VMI: Generated 1807 derivative records from 15488 primary records. [2025-10-02T22:46:42.323225] [INFO ] [MAIN ] Derivative Progress: 1849/1975 symbols completed. VMC took 1.2s. Estimated remaining: 52.7s. Rate: 143.5 symbols/min [2025-10-02T22:46:42.324208] [DEBUG] [LOCAL ] VMI: Saving derivative data. [2025-10-02T22:46:42.324515] [INFO ] [MAIN ] VNCE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:42.359464] [DEBUG] [MAIN ] VMO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:42.360350] [INFO ] [MAIN ] VMO: Generated 1807 derivative records from 21243 primary records. [2025-10-02T22:46:42.360785] [DEBUG] [LOCAL ] VMO: Saving derivative data. [2025-10-02T22:46:42.362064] [DEBUG] [LOCAL ] VMI: Derivative data saved (1807 records). [2025-10-02T22:46:42.366740] [INFO ] [MAIN ] VMI: Successfully saved derivative data. [2025-10-02T22:46:42.367284] [DEBUG] [LOCAL ] VNCE: Loaded 8168 existing records from primary storage. [2025-10-02T22:46:42.375235] [INFO ] [MAIN ] VNCE: Loaded 8168 primary data records. [2025-10-02T22:46:42.384159] [INFO ] [MAIN ] Derivative Progress: 1850/1975 symbols completed. VMI took 1.2s. Estimated remaining: 52.2s. Rate: 143.6 symbols/min [2025-10-02T22:46:42.387368] [INFO ] [MAIN ] VNO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:42.451305] [DEBUG] [LOCAL ] VMO: Derivative data saved (1807 records). [2025-10-02T22:46:42.480214] [INFO ] [MAIN ] VMO: Successfully saved derivative data. [2025-10-02T22:46:42.489099] [INFO ] [MAIN ] Derivative Progress: 1851/1975 symbols completed. VMO took 1.3s. Estimated remaining: 51.8s. Rate: 143.6 symbols/min [2025-10-02T22:46:42.509289] [INFO ] [MAIN ] VNT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:42.767939] [DEBUG] [LOCAL ] VNO: Loaded 49196 existing records from primary storage. [2025-10-02T22:46:42.768874] [INFO ] [MAIN ] VNO: Loaded 49196 primary data records. [2025-10-02T22:46:42.960630] [DEBUG] [LOCAL ] VNT: Loaded 43857 existing records from primary storage. [2025-10-02T22:46:43.007035] [INFO ] [MAIN ] VNT: Loaded 43857 primary data records. [2025-10-02T22:46:43.322209] [DEBUG] [MAIN ] VNCE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:43.355171] [INFO ] [MAIN ] VNCE: Generated 1807 derivative records from 8168 primary records. [2025-10-02T22:46:43.474995] [DEBUG] [LOCAL ] VNCE: Saving derivative data. [2025-10-02T22:46:43.499433] [DEBUG] [LOCAL ] VNCE: Derivative data saved (1807 records). [2025-10-02T22:46:43.500193] [INFO ] [MAIN ] VNCE: Successfully saved derivative data. [2025-10-02T22:46:43.515538] [INFO ] [MAIN ] Derivative Progress: 1852/1975 symbols completed. VNCE took 1.2s. Estimated remaining: 51.4s. Rate: 143.5 symbols/min [2025-10-02T22:46:43.515926] [DEBUG] [MAIN ] VNO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:43.517545] [INFO ] [MAIN ] VNO: Generated 1807 derivative records from 49196 primary records. [2025-10-02T22:46:43.516354] [INFO ] [MAIN ] VOC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:43.519037] [DEBUG] [LOCAL ] VNO: Saving derivative data. [2025-10-02T22:46:43.546206] [DEBUG] [LOCAL ] VOC: Loaded 8949 existing records from primary storage. [2025-10-02T22:46:43.547394] [DEBUG] [LOCAL ] VNO: Derivative data saved (1807 records). [2025-10-02T22:46:43.547557] [INFO ] [MAIN ] VOC: Loaded 8949 primary data records. [2025-10-02T22:46:43.547810] [INFO ] [MAIN ] VNO: Successfully saved derivative data. [2025-10-02T22:46:43.567772] [INFO ] [MAIN ] Derivative Progress: 1853/1975 symbols completed. VNO took 1.2s. Estimated remaining: 51.0s. Rate: 143.6 symbols/min [2025-10-02T22:46:43.627589] [DEBUG] [MAIN ] VNT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:43.627070] [INFO ] [MAIN ] VOYA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:43.647882] [INFO ] [MAIN ] VNT: Generated 1807 derivative records from 43857 primary records. [2025-10-02T22:46:43.660713] [DEBUG] [LOCAL ] VNT: Saving derivative data. [2025-10-02T22:46:43.929469] [DEBUG] [LOCAL ] VNT: Derivative data saved (1807 records). [2025-10-02T22:46:43.929738] [INFO ] [MAIN ] VNT: Successfully saved derivative data. [2025-10-02T22:46:43.931771] [INFO ] [MAIN ] Derivative Progress: 1854/1975 symbols completed. VNT took 1.4s. Estimated remaining: 50.6s. Rate: 143.6 symbols/min [2025-10-02T22:46:43.932028] [INFO ] [MAIN ] VPG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:43.950314] [DEBUG] [LOCAL ] VOYA: Loaded 42817 existing records from primary storage. [2025-10-02T22:46:43.950848] [INFO ] [MAIN ] VOYA: Loaded 42817 primary data records. [2025-10-02T22:46:44.040954] [DEBUG] [LOCAL ] VPG: Loaded 17197 existing records from primary storage. [2025-10-02T22:46:44.056974] [INFO ] [MAIN ] VPG: Loaded 17197 primary data records. [2025-10-02T22:46:44.390756] [DEBUG] [MAIN ] VOC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:44.424455] [INFO ] [MAIN ] VOC: Generated 1807 derivative records from 8949 primary records. [2025-10-02T22:46:44.447988] [DEBUG] [LOCAL ] VOC: Saving derivative data. [2025-10-02T22:46:44.783881] [DEBUG] [LOCAL ] VOC: Derivative data saved (1807 records). [2025-10-02T22:46:44.784728] [INFO ] [MAIN ] VOC: Successfully saved derivative data. [2025-10-02T22:46:44.787695] [INFO ] [MAIN ] Derivative Progress: 1855/1975 symbols completed. VOC took 1.3s. Estimated remaining: 50.2s. Rate: 143.5 symbols/min [2025-10-02T22:46:44.788756] [INFO ] [MAIN ] VPV: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:44.800378] [DEBUG] [LOCAL ] VPV: Loaded 5432 existing records from primary storage. [2025-10-02T22:46:44.801309] [INFO ] [MAIN ] VPV: Loaded 5432 primary data records. [2025-10-02T22:46:44.949588] [DEBUG] [MAIN ] VOYA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:44.984672] [DEBUG] [MAIN ] VPG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:44.990892] [INFO ] [MAIN ] VOYA: Generated 1807 derivative records from 42817 primary records. [2025-10-02T22:46:44.990999] [DEBUG] [LOCAL ] VOYA: Saving derivative data. [2025-10-02T22:46:45.025861] [INFO ] [MAIN ] VPG: Generated 1807 derivative records from 17197 primary records. [2025-10-02T22:46:45.048884] [DEBUG] [LOCAL ] VPG: Saving derivative data. [2025-10-02T22:46:45.211218] [DEBUG] [LOCAL ] VPG: Derivative data saved (1807 records). [2025-10-02T22:46:45.212320] [INFO ] [MAIN ] VPG: Successfully saved derivative data. [2025-10-02T22:46:45.216046] [INFO ] [MAIN ] Derivative Progress: 1856/1975 symbols completed. VPG took 1.3s. Estimated remaining: 49.7s. Rate: 143.5 symbols/min [2025-10-02T22:46:45.217177] [INFO ] [MAIN ] VRE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:45.220721] [DEBUG] [LOCAL ] VOYA: Derivative data saved (1807 records). [2025-10-02T22:46:45.220908] [INFO ] [MAIN ] VOYA: Successfully saved derivative data. [2025-10-02T22:46:45.223484] [INFO ] [MAIN ] Derivative Progress: 1857/1975 symbols completed. VOYA took 1.6s. Estimated remaining: 49.3s. Rate: 143.6 symbols/min [2025-10-02T22:46:45.224853] [INFO ] [MAIN ] VRT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:45.249596] [DEBUG] [MAIN ] VPV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:45.250430] [INFO ] [MAIN ] VPV: Generated 1807 derivative records from 5432 primary records. [2025-10-02T22:46:45.250543] [DEBUG] [LOCAL ] VPV: Saving derivative data. [2025-10-02T22:46:45.291199] [DEBUG] [LOCAL ] VPV: Derivative data saved (1807 records). [2025-10-02T22:46:45.291333] [INFO ] [MAIN ] VPV: Successfully saved derivative data. [2025-10-02T22:46:45.293688] [INFO ] [MAIN ] Derivative Progress: 1858/1975 symbols completed. VPV took 0.5s. Estimated remaining: 48.9s. Rate: 143.7 symbols/min [2025-10-02T22:46:45.309387] [DEBUG] [LOCAL ] VRE: Loaded 35252 existing records from primary storage. [2025-10-02T22:46:45.309540] [INFO ] [MAIN ] VRE: Loaded 35252 primary data records. [2025-10-02T22:46:45.514897] [DEBUG] [LOCAL ] VRT: Loaded 54143 existing records from primary storage. [2025-10-02T22:46:45.537981] [INFO ] [MAIN ] VRT: Loaded 54143 primary data records. [2025-10-02T22:46:46.008801] [DEBUG] [MAIN ] VRE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:46.009713] [INFO ] [MAIN ] VRE: Generated 1807 derivative records from 35252 primary records. [2025-10-02T22:46:46.010187] [DEBUG] [LOCAL ] VRE: Saving derivative data. [2025-10-02T22:46:46.028286] [DEBUG] [LOCAL ] VRE: Derivative data saved (1807 records). [2025-10-02T22:46:46.028522] [INFO ] [MAIN ] VRE: Successfully saved derivative data. [2025-10-02T22:46:46.031130] [INFO ] [MAIN ] Derivative Progress: 1859/1975 symbols completed. VRE took 0.8s. Estimated remaining: 48.5s. Rate: 143.6 symbols/min [2025-10-02T22:46:46.049291] [DEBUG] [MAIN ] VRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:46.049957] [INFO ] [MAIN ] VRT: Generated 1807 derivative records from 54143 primary records. [2025-10-02T22:46:46.050027] [DEBUG] [LOCAL ] VRT: Saving derivative data. [2025-10-02T22:46:46.067213] [DEBUG] [LOCAL ] VRT: Derivative data saved (1807 records). [2025-10-02T22:46:46.067291] [INFO ] [MAIN ] VRT: Successfully saved derivative data. [2025-10-02T22:46:46.069301] [INFO ] [MAIN ] Derivative Progress: 1860/1975 symbols completed. VRT took 0.8s. Estimated remaining: 48.0s. Rate: 143.7 symbols/min [2025-10-02T22:46:46.069703] [INFO ] [MAIN ] VRTS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:46.069799] [INFO ] [MAIN ] VSH: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:46.069897] [INFO ] [MAIN ] VSCO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:46.096393] [DEBUG] [LOCAL ] VRTS: Loaded 9342 existing records from primary storage. [2025-10-02T22:46:46.097573] [INFO ] [MAIN ] VRTS: Loaded 9342 primary data records. [2025-10-02T22:46:46.492613] [DEBUG] [LOCAL ] VSCO: Loaded 53154 existing records from primary storage. [2025-10-02T22:46:46.494488] [DEBUG] [LOCAL ] VSH: Loaded 48691 existing records from primary storage. [2025-10-02T22:46:46.493725] [INFO ] [MAIN ] VSCO: Loaded 53154 primary data records. [2025-10-02T22:46:46.494858] [INFO ] [MAIN ] VSH: Loaded 48691 primary data records. [2025-10-02T22:46:47.259325] [DEBUG] [MAIN ] VRTS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:47.260481] [INFO ] [MAIN ] VRTS: Generated 1807 derivative records from 9342 primary records. [2025-10-02T22:46:47.260999] [DEBUG] [LOCAL ] VRTS: Saving derivative data. [2025-10-02T22:46:47.286765] [DEBUG] [LOCAL ] VRTS: Derivative data saved (1807 records). [2025-10-02T22:46:47.287207] [INFO ] [MAIN ] VRTS: Successfully saved derivative data. [2025-10-02T22:46:47.314966] [INFO ] [MAIN ] Derivative Progress: 1861/1975 symbols completed. VRTS took 1.2s. Estimated remaining: 47.7s. Rate: 143.5 symbols/min [2025-10-02T22:46:47.315959] [INFO ] [MAIN ] VST: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:47.316331] [DEBUG] [MAIN ] VSCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:47.317805] [INFO ] [MAIN ] VSCO: Generated 1807 derivative records from 53154 primary records. [2025-10-02T22:46:47.316844] [DEBUG] [MAIN ] VSH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:47.318064] [DEBUG] [LOCAL ] VSCO: Saving derivative data. [2025-10-02T22:46:47.319054] [INFO ] [MAIN ] VSH: Generated 1807 derivative records from 48691 primary records. [2025-10-02T22:46:47.319480] [DEBUG] [LOCAL ] VSH: Saving derivative data. [2025-10-02T22:46:47.351195] [DEBUG] [LOCAL ] VSH: Derivative data saved (1807 records). [2025-10-02T22:46:47.351683] [INFO ] [MAIN ] VSH: Successfully saved derivative data. [2025-10-02T22:46:47.355458] [INFO ] [MAIN ] Derivative Progress: 1862/1975 symbols completed. VSH took 1.3s. Estimated remaining: 47.2s. Rate: 143.6 symbols/min [2025-10-02T22:46:47.355747] [INFO ] [MAIN ] VSTS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:47.359501] [DEBUG] [LOCAL ] VSCO: Derivative data saved (1807 records). [2025-10-02T22:46:47.359919] [INFO ] [MAIN ] VSCO: Successfully saved derivative data. [2025-10-02T22:46:47.362225] [INFO ] [MAIN ] Derivative Progress: 1863/1975 symbols completed. VSCO took 1.3s. Estimated remaining: 46.8s. Rate: 143.7 symbols/min [2025-10-02T22:46:47.362458] [INFO ] [MAIN ] VTEX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:47.450689] [DEBUG] [LOCAL ] VSTS: Loaded 49392 existing records from primary storage. [2025-10-02T22:46:47.450968] [INFO ] [MAIN ] VSTS: Loaded 49392 primary data records. [2025-10-02T22:46:47.457310] [DEBUG] [LOCAL ] VST: Loaded 54108 existing records from primary storage. [2025-10-02T22:46:47.501418] [INFO ] [MAIN ] VST: Loaded 54108 primary data records. [2025-10-02T22:46:47.529837] [DEBUG] [LOCAL ] VTEX: Loaded 43470 existing records from primary storage. [2025-10-02T22:46:47.535121] [INFO ] [MAIN ] VTEX: Loaded 43470 primary data records. [2025-10-02T22:46:48.571226] [DEBUG] [MAIN ] VTEX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:48.579227] [INFO ] [MAIN ] VTEX: Generated 1807 derivative records from 43470 primary records. [2025-10-02T22:46:48.577987] [DEBUG] [MAIN ] VSTS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:48.580156] [INFO ] [MAIN ] VSTS: Generated 1807 derivative records from 49392 primary records. [2025-10-02T22:46:48.579519] [DEBUG] [LOCAL ] VTEX: Saving derivative data. [2025-10-02T22:46:48.592128] [DEBUG] [LOCAL ] VSTS: Saving derivative data. [2025-10-02T22:46:48.626331] [DEBUG] [LOCAL ] VTEX: Derivative data saved (1807 records). [2025-10-02T22:46:48.628027] [INFO ] [MAIN ] VTEX: Successfully saved derivative data. [2025-10-02T22:46:48.634767] [INFO ] [MAIN ] Derivative Progress: 1864/1975 symbols completed. VTEX took 1.3s. Estimated remaining: 46.4s. Rate: 143.5 symbols/min [2025-10-02T22:46:48.635552] [INFO ] [MAIN ] VTLE: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:48.628286] [DEBUG] [MAIN ] VST: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:48.636979] [INFO ] [MAIN ] VST: Generated 1807 derivative records from 54108 primary records. [2025-10-02T22:46:48.637438] [DEBUG] [LOCAL ] VST: Saving derivative data. [2025-10-02T22:46:48.662786] [DEBUG] [LOCAL ] VSTS: Derivative data saved (1807 records). [2025-10-02T22:46:48.664786] [INFO ] [MAIN ] VSTS: Successfully saved derivative data. [2025-10-02T22:46:48.665331] [DEBUG] [LOCAL ] VST: Derivative data saved (1807 records). [2025-10-02T22:46:48.667336] [INFO ] [MAIN ] Derivative Progress: 1865/1975 symbols completed. VSTS took 1.3s. Estimated remaining: 46.0s. Rate: 143.6 symbols/min [2025-10-02T22:46:48.667566] [INFO ] [MAIN ] VST: Successfully saved derivative data. [2025-10-02T22:46:48.671529] [INFO ] [MAIN ] Derivative Progress: 1866/1975 symbols completed. VST took 1.4s. Estimated remaining: 45.5s. Rate: 143.7 symbols/min [2025-10-02T22:46:48.671354] [INFO ] [MAIN ] VTMX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:48.671823] [INFO ] [MAIN ] VTN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:48.689862] [DEBUG] [LOCAL ] VTN: Loaded 7084 existing records from primary storage. [2025-10-02T22:46:48.690153] [INFO ] [MAIN ] VTN: Loaded 7084 primary data records. [2025-10-02T22:46:48.771506] [DEBUG] [LOCAL ] VTMX: Loaded 17619 existing records from primary storage. [2025-10-02T22:46:48.813722] [INFO ] [MAIN ] VTMX: Loaded 17619 primary data records. [2025-10-02T22:46:48.950286] [DEBUG] [LOCAL ] VTLE: Loaded 48776 existing records from primary storage. [2025-10-02T22:46:48.972152] [INFO ] [MAIN ] VTLE: Loaded 48776 primary data records. [2025-10-02T22:46:50.048153] [DEBUG] [MAIN ] VTN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:50.050048] [INFO ] [MAIN ] VTN: Generated 1807 derivative records from 7084 primary records. [2025-10-02T22:46:50.050281] [DEBUG] [LOCAL ] VTN: Saving derivative data. [2025-10-02T22:46:50.083355] [DEBUG] [LOCAL ] VTN: Derivative data saved (1807 records). [2025-10-02T22:46:50.098309] [INFO ] [MAIN ] VTN: Successfully saved derivative data. [2025-10-02T22:46:50.107007] [INFO ] [MAIN ] Derivative Progress: 1867/1975 symbols completed. VTN took 1.4s. Estimated remaining: 45.2s. Rate: 143.5 symbols/min [2025-10-02T22:46:50.099002] [DEBUG] [MAIN ] VTMX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:50.117996] [INFO ] [MAIN ] VTOL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:50.117524] [INFO ] [MAIN ] VTMX: Generated 1807 derivative records from 17619 primary records. [2025-10-02T22:46:50.118575] [DEBUG] [MAIN ] VTLE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:50.119236] [DEBUG] [LOCAL ] VTMX: Saving derivative data. [2025-10-02T22:46:50.120147] [INFO ] [MAIN ] VTLE: Generated 1807 derivative records from 48776 primary records. [2025-10-02T22:46:50.121291] [DEBUG] [LOCAL ] VTLE: Saving derivative data. [2025-10-02T22:46:50.159526] [DEBUG] [LOCAL ] VTLE: Derivative data saved (1807 records). [2025-10-02T22:46:50.166367] [INFO ] [MAIN ] VTLE: Successfully saved derivative data. [2025-10-02T22:46:50.169496] [INFO ] [MAIN ] Derivative Progress: 1868/1975 symbols completed. VTLE took 1.5s. Estimated remaining: 44.7s. Rate: 143.5 symbols/min [2025-10-02T22:46:50.171532] [DEBUG] [LOCAL ] VTMX: Derivative data saved (1807 records). [2025-10-02T22:46:50.171758] [INFO ] [MAIN ] VTR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:50.179554] [INFO ] [MAIN ] VTMX: Successfully saved derivative data. [2025-10-02T22:46:50.182892] [INFO ] [MAIN ] Derivative Progress: 1869/1975 symbols completed. VTMX took 1.5s. Estimated remaining: 44.3s. Rate: 143.6 symbols/min [2025-10-02T22:46:50.183776] [INFO ] [MAIN ] VTS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:50.183522] [DEBUG] [LOCAL ] VTOL: Loaded 19682 existing records from primary storage. [2025-10-02T22:46:50.184066] [INFO ] [MAIN ] VTOL: Loaded 19682 primary data records. [2025-10-02T22:46:50.539213] [DEBUG] [LOCAL ] VTS: Loaded 30733 existing records from primary storage. [2025-10-02T22:46:50.549575] [INFO ] [MAIN ] VTS: Loaded 30733 primary data records. [2025-10-02T22:46:50.668014] [DEBUG] [LOCAL ] VTR: Loaded 53197 existing records from primary storage. [2025-10-02T22:46:50.687472] [INFO ] [MAIN ] VTR: Loaded 53197 primary data records. [2025-10-02T22:46:51.281770] [DEBUG] [MAIN ] VTOL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:51.283797] [INFO ] [MAIN ] VTOL: Generated 1807 derivative records from 19682 primary records. [2025-10-02T22:46:51.283942] [DEBUG] [LOCAL ] VTOL: Saving derivative data. [2025-10-02T22:46:51.307441] [DEBUG] [LOCAL ] VTOL: Derivative data saved (1807 records). [2025-10-02T22:46:51.309911] [INFO ] [MAIN ] VTOL: Successfully saved derivative data. [2025-10-02T22:46:51.313181] [INFO ] [MAIN ] Derivative Progress: 1870/1975 symbols completed. VTOL took 1.2s. Estimated remaining: 43.9s. Rate: 143.5 symbols/min [2025-10-02T22:46:51.313553] [INFO ] [MAIN ] VVR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:51.329761] [DEBUG] [MAIN ] VTS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:51.330674] [INFO ] [MAIN ] VTS: Generated 1807 derivative records from 30733 primary records. [2025-10-02T22:46:51.330965] [DEBUG] [LOCAL ] VTS: Saving derivative data. [2025-10-02T22:46:51.360636] [DEBUG] [MAIN ] VTR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:51.362639] [INFO ] [MAIN ] VTR: Generated 1807 derivative records from 53197 primary records. [2025-10-02T22:46:51.363074] [DEBUG] [LOCAL ] VTR: Saving derivative data. [2025-10-02T22:46:51.399114] [DEBUG] [LOCAL ] VTS: Derivative data saved (1807 records). [2025-10-02T22:46:51.401037] [INFO ] [MAIN ] VTS: Successfully saved derivative data. [2025-10-02T22:46:51.403216] [INFO ] [MAIN ] Derivative Progress: 1871/1975 symbols completed. VTS took 1.2s. Estimated remaining: 43.5s. Rate: 143.5 symbols/min [2025-10-02T22:46:51.405775] [DEBUG] [LOCAL ] VVR: Loaded 31541 existing records from primary storage. [2025-10-02T22:46:51.404699] [INFO ] [MAIN ] VVV: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:51.406459] [INFO ] [MAIN ] VVR: Loaded 31541 primary data records. [2025-10-02T22:46:51.432965] [DEBUG] [LOCAL ] VTR: Derivative data saved (1807 records). [2025-10-02T22:46:51.462367] [INFO ] [MAIN ] VTR: Successfully saved derivative data. [2025-10-02T22:46:51.489383] [INFO ] [MAIN ] Derivative Progress: 1872/1975 symbols completed. VTR took 1.3s. Estimated remaining: 43.0s. Rate: 143.6 symbols/min [2025-10-02T22:46:51.516795] [INFO ] [MAIN ] VVX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:51.826669] [DEBUG] [LOCAL ] VVV: Loaded 50522 existing records from primary storage. [2025-10-02T22:46:51.825369] [DEBUG] [LOCAL ] VVX: Loaded 23279 existing records from primary storage. [2025-10-02T22:46:51.826945] [INFO ] [MAIN ] VVX: Loaded 23279 primary data records. [2025-10-02T22:46:51.826876] [INFO ] [MAIN ] VVV: Loaded 50522 primary data records. [2025-10-02T22:46:52.498741] [DEBUG] [MAIN ] VVR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:52.500416] [INFO ] [MAIN ] VVR: Generated 1807 derivative records from 31541 primary records. [2025-10-02T22:46:52.502234] [DEBUG] [LOCAL ] VVR: Saving derivative data. [2025-10-02T22:46:52.527044] [DEBUG] [LOCAL ] VVR: Derivative data saved (1807 records). [2025-10-02T22:46:52.527522] [INFO ] [MAIN ] VVR: Successfully saved derivative data. [2025-10-02T22:46:52.530160] [INFO ] [MAIN ] Derivative Progress: 1873/1975 symbols completed. VVR took 1.2s. Estimated remaining: 42.7s. Rate: 143.5 symbols/min [2025-10-02T22:46:52.547342] [DEBUG] [MAIN ] VVV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:52.550218] [INFO ] [MAIN ] VVV: Generated 1807 derivative records from 50522 primary records. [2025-10-02T22:46:52.550463] [DEBUG] [LOCAL ] VVV: Saving derivative data. [2025-10-02T22:46:52.571530] [DEBUG] [MAIN ] VVX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:52.576016] [INFO ] [MAIN ] VVX: Generated 1807 derivative records from 23279 primary records. [2025-10-02T22:46:52.576332] [DEBUG] [LOCAL ] VVX: Saving derivative data. [2025-10-02T22:46:52.595314] [DEBUG] [LOCAL ] VVX: Derivative data saved (1807 records). [2025-10-02T22:46:52.595639] [INFO ] [MAIN ] VVX: Successfully saved derivative data. [2025-10-02T22:46:52.597933] [INFO ] [MAIN ] Derivative Progress: 1874/1975 symbols completed. VVX took 1.1s. Estimated remaining: 42.2s. Rate: 143.6 symbols/min [2025-10-02T22:46:52.599803] [DEBUG] [LOCAL ] VVV: Derivative data saved (1807 records). [2025-10-02T22:46:52.599867] [INFO ] [MAIN ] VVV: Successfully saved derivative data. [2025-10-02T22:46:52.601946] [INFO ] [MAIN ] Derivative Progress: 1875/1975 symbols completed. VVV took 1.2s. Estimated remaining: 41.8s. Rate: 143.6 symbols/min [2025-10-02T22:46:52.602354] [INFO ] [MAIN ] VYX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:52.602479] [INFO ] [MAIN ] W: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:52.602560] [INFO ] [MAIN ] VZ: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:52.705958] [DEBUG] [LOCAL ] VZ: Loaded 54181 existing records from primary storage. [2025-10-02T22:46:52.706695] [INFO ] [MAIN ] VZ: Loaded 54181 primary data records. [2025-10-02T22:46:52.726698] [DEBUG] [LOCAL ] VYX: Loaded 49071 existing records from primary storage. [2025-10-02T22:46:52.780688] [INFO ] [MAIN ] VYX: Loaded 49071 primary data records. [2025-10-02T22:46:52.790687] [DEBUG] [LOCAL ] W: Loaded 53851 existing records from primary storage. [2025-10-02T22:46:52.845978] [INFO ] [MAIN ] W: Loaded 53851 primary data records. [2025-10-02T22:46:53.817236] [DEBUG] [MAIN ] VZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:53.823200] [INFO ] [MAIN ] VZ: Generated 1807 derivative records from 54181 primary records. [2025-10-02T22:46:53.825207] [DEBUG] [LOCAL ] VZ: Saving derivative data. [2025-10-02T22:46:53.825116] [DEBUG] [MAIN ] VYX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:53.826484] [INFO ] [MAIN ] VYX: Generated 1807 derivative records from 49071 primary records. [2025-10-02T22:46:53.826626] [DEBUG] [LOCAL ] VYX: Saving derivative data. [2025-10-02T22:46:53.865895] [DEBUG] [MAIN ] W: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:53.868285] [INFO ] [MAIN ] W: Generated 1807 derivative records from 53851 primary records. [2025-10-02T22:46:53.868744] [DEBUG] [LOCAL ] W: Saving derivative data. [2025-10-02T22:46:53.891319] [DEBUG] [LOCAL ] W: Derivative data saved (1807 records). [2025-10-02T22:46:53.891788] [INFO ] [MAIN ] W: Successfully saved derivative data. [2025-10-02T22:46:53.894472] [INFO ] [MAIN ] Derivative Progress: 1876/1975 symbols completed. W took 1.3s. Estimated remaining: 41.4s. Rate: 143.5 symbols/min [2025-10-02T22:46:53.895063] [INFO ] [MAIN ] WAB: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:53.895856] [DEBUG] [LOCAL ] VYX: Derivative data saved (1807 records). [2025-10-02T22:46:53.897087] [DEBUG] [LOCAL ] VZ: Derivative data saved (1807 records). [2025-10-02T22:46:53.897179] [INFO ] [MAIN ] VYX: Successfully saved derivative data. [2025-10-02T22:46:53.897245] [INFO ] [MAIN ] VZ: Successfully saved derivative data. [2025-10-02T22:46:53.899913] [INFO ] [MAIN ] Derivative Progress: 1877/1975 symbols completed. VZ took 1.3s. Estimated remaining: 41.0s. Rate: 143.5 symbols/min [2025-10-02T22:46:53.902209] [INFO ] [MAIN ] WAL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:53.902347] [INFO ] [MAIN ] Derivative Progress: 1878/1975 symbols completed. VYX took 1.3s. Estimated remaining: 40.5s. Rate: 143.6 symbols/min [2025-10-02T22:46:53.903032] [INFO ] [MAIN ] WAT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:53.973083] [DEBUG] [LOCAL ] WAL: Loaded 45569 existing records from primary storage. [2025-10-02T22:46:53.971902] [DEBUG] [LOCAL ] WAT: Loaded 35539 existing records from primary storage. [2025-10-02T22:46:53.973309] [INFO ] [MAIN ] WAT: Loaded 35539 primary data records. [2025-10-02T22:46:53.973403] [INFO ] [MAIN ] WAL: Loaded 45569 primary data records. [2025-10-02T22:46:54.160547] [DEBUG] [LOCAL ] WAB: Loaded 44385 existing records from primary storage. [2025-10-02T22:46:54.213973] [INFO ] [MAIN ] WAB: Loaded 44385 primary data records. [2025-10-02T22:46:55.012540] [DEBUG] [MAIN ] WAL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:55.016597] [INFO ] [MAIN ] WAL: Generated 1807 derivative records from 45569 primary records. [2025-10-02T22:46:55.017077] [DEBUG] [LOCAL ] WAL: Saving derivative data. [2025-10-02T22:46:55.049612] [DEBUG] [MAIN ] WAT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:55.050936] [DEBUG] [LOCAL ] WAL: Derivative data saved (1807 records). [2025-10-02T22:46:55.051333] [INFO ] [MAIN ] WAL: Successfully saved derivative data. [2025-10-02T22:46:55.052266] [INFO ] [MAIN ] WAT: Generated 1807 derivative records from 35539 primary records. [2025-10-02T22:46:55.054370] [INFO ] [MAIN ] Derivative Progress: 1879/1975 symbols completed. WAL took 1.2s. Estimated remaining: 40.1s. Rate: 143.5 symbols/min [2025-10-02T22:46:55.062597] [INFO ] [MAIN ] WBS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:55.062827] [DEBUG] [LOCAL ] WAT: Saving derivative data. [2025-10-02T22:46:55.069842] [DEBUG] [MAIN ] WAB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:55.071090] [INFO ] [MAIN ] WAB: Generated 1807 derivative records from 44385 primary records. [2025-10-02T22:46:55.080088] [DEBUG] [LOCAL ] WAB: Saving derivative data. [2025-10-02T22:46:55.089056] [DEBUG] [LOCAL ] WAT: Derivative data saved (1807 records). [2025-10-02T22:46:55.097356] [INFO ] [MAIN ] WAT: Successfully saved derivative data. [2025-10-02T22:46:55.103597] [INFO ] [MAIN ] Derivative Progress: 1880/1975 symbols completed. WAT took 1.2s. Estimated remaining: 39.7s. Rate: 143.6 symbols/min [2025-10-02T22:46:55.104264] [INFO ] [MAIN ] WBX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:55.109216] [DEBUG] [LOCAL ] WAB: Derivative data saved (1807 records). [2025-10-02T22:46:55.109522] [INFO ] [MAIN ] WAB: Successfully saved derivative data. [2025-10-02T22:46:55.112499] [INFO ] [MAIN ] Derivative Progress: 1881/1975 symbols completed. WAB took 1.2s. Estimated remaining: 39.3s. Rate: 143.6 symbols/min [2025-10-02T22:46:55.112882] [INFO ] [MAIN ] WCC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:55.125740] [DEBUG] [LOCAL ] WBX: Loaded 11609 existing records from primary storage. [2025-10-02T22:46:55.125935] [INFO ] [MAIN ] WBX: Loaded 11609 primary data records. [2025-10-02T22:46:55.366902] [DEBUG] [LOCAL ] WBS: Loaded 49050 existing records from primary storage. [2025-10-02T22:46:55.494683] [INFO ] [MAIN ] WBS: Loaded 49050 primary data records. [2025-10-02T22:46:55.557605] [DEBUG] [LOCAL ] WCC: Loaded 39818 existing records from primary storage. [2025-10-02T22:46:55.563329] [INFO ] [MAIN ] WCC: Loaded 39818 primary data records. [2025-10-02T22:46:56.256524] [DEBUG] [MAIN ] WBX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:56.258238] [INFO ] [MAIN ] WBX: Generated 1807 derivative records from 11609 primary records. [2025-10-02T22:46:56.258466] [DEBUG] [LOCAL ] WBX: Saving derivative data. [2025-10-02T22:46:56.276208] [DEBUG] [LOCAL ] WBX: Derivative data saved (1807 records). [2025-10-02T22:46:56.276574] [INFO ] [MAIN ] WBX: Successfully saved derivative data. [2025-10-02T22:46:56.278517] [INFO ] [MAIN ] Derivative Progress: 1882/1975 symbols completed. WBX took 1.2s. Estimated remaining: 38.9s. Rate: 143.5 symbols/min [2025-10-02T22:46:56.278823] [INFO ] [MAIN ] WCN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:56.301624] [DEBUG] [MAIN ] WCC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:56.302605] [INFO ] [MAIN ] WCC: Generated 1807 derivative records from 39818 primary records. [2025-10-02T22:46:56.302789] [DEBUG] [LOCAL ] WCC: Saving derivative data. [2025-10-02T22:46:56.317313] [DEBUG] [MAIN ] WBS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:56.329745] [INFO ] [MAIN ] WBS: Generated 1807 derivative records from 49050 primary records. [2025-10-02T22:46:56.331557] [DEBUG] [LOCAL ] WBS: Saving derivative data. [2025-10-02T22:46:56.334270] [DEBUG] [LOCAL ] WCC: Derivative data saved (1807 records). [2025-10-02T22:46:56.334397] [INFO ] [MAIN ] WCC: Successfully saved derivative data. [2025-10-02T22:46:56.337190] [INFO ] [MAIN ] Derivative Progress: 1883/1975 symbols completed. WCC took 1.2s. Estimated remaining: 38.5s. Rate: 143.6 symbols/min [2025-10-02T22:46:56.338331] [INFO ] [MAIN ] WD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:56.367994] [DEBUG] [LOCAL ] WBS: Derivative data saved (1807 records). [2025-10-02T22:46:56.368172] [INFO ] [MAIN ] WBS: Successfully saved derivative data. [2025-10-02T22:46:56.370050] [INFO ] [MAIN ] Derivative Progress: 1884/1975 symbols completed. WBS took 1.3s. Estimated remaining: 38.0s. Rate: 143.6 symbols/min [2025-10-02T22:46:56.370252] [INFO ] [MAIN ] WDH: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:56.399853] [DEBUG] [LOCAL ] WD: Loaded 23350 existing records from primary storage. [2025-10-02T22:46:56.399989] [INFO ] [MAIN ] WD: Loaded 23350 primary data records. [2025-10-02T22:46:56.445699] [DEBUG] [LOCAL ] WCN: Loaded 48313 existing records from primary storage. [2025-10-02T22:46:56.453294] [INFO ] [MAIN ] WCN: Loaded 48313 primary data records. [2025-10-02T22:46:56.542509] [DEBUG] [LOCAL ] WDH: Loaded 17649 existing records from primary storage. [2025-10-02T22:46:56.602575] [INFO ] [MAIN ] WDH: Loaded 17649 primary data records. [2025-10-02T22:46:57.439053] [DEBUG] [MAIN ] WD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:57.441638] [INFO ] [MAIN ] WD: Generated 1807 derivative records from 23350 primary records. [2025-10-02T22:46:57.441883] [DEBUG] [LOCAL ] WD: Saving derivative data. [2025-10-02T22:46:57.471024] [DEBUG] [MAIN ] WCN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:57.472882] [INFO ] [MAIN ] WCN: Generated 1807 derivative records from 48313 primary records. [2025-10-02T22:46:57.473440] [DEBUG] [LOCAL ] WCN: Saving derivative data. [2025-10-02T22:46:57.502054] [DEBUG] [LOCAL ] WD: Derivative data saved (1807 records). [2025-10-02T22:46:57.502455] [INFO ] [MAIN ] WD: Successfully saved derivative data. [2025-10-02T22:46:57.504764] [INFO ] [MAIN ] Derivative Progress: 1885/1975 symbols completed. WD took 1.2s. Estimated remaining: 37.6s. Rate: 143.5 symbols/min [2025-10-02T22:46:57.505685] [INFO ] [MAIN ] WDI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:57.501215] [DEBUG] [MAIN ] WDH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:57.508179] [INFO ] [MAIN ] WDH: Generated 1807 derivative records from 17649 primary records. [2025-10-02T22:46:57.509112] [DEBUG] [LOCAL ] WDH: Saving derivative data. [2025-10-02T22:46:57.524869] [DEBUG] [LOCAL ] WCN: Derivative data saved (1807 records). [2025-10-02T22:46:57.526577] [INFO ] [MAIN ] WCN: Successfully saved derivative data. [2025-10-02T22:46:57.528788] [INFO ] [MAIN ] Derivative Progress: 1886/1975 symbols completed. WCN took 1.2s. Estimated remaining: 37.2s. Rate: 143.6 symbols/min [2025-10-02T22:46:57.529520] [INFO ] [MAIN ] WDS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:57.539183] [DEBUG] [LOCAL ] WDH: Derivative data saved (1807 records). [2025-10-02T22:46:57.539367] [INFO ] [MAIN ] WDH: Successfully saved derivative data. [2025-10-02T22:46:57.541747] [INFO ] [MAIN ] Derivative Progress: 1887/1975 symbols completed. WDH took 1.2s. Estimated remaining: 36.8s. Rate: 143.6 symbols/min [2025-10-02T22:46:57.541993] [INFO ] [MAIN ] WEA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:57.550967] [DEBUG] [LOCAL ] WDI: Loaded 21232 existing records from primary storage. [2025-10-02T22:46:57.551199] [INFO ] [MAIN ] WDI: Loaded 21232 primary data records. [2025-10-02T22:46:57.641687] [DEBUG] [LOCAL ] WEA: Loaded 7309 existing records from primary storage. [2025-10-02T22:46:57.641819] [INFO ] [MAIN ] WEA: Loaded 7309 primary data records. [2025-10-02T22:46:58.081886] [DEBUG] [LOCAL ] WDS: Loaded 43591 existing records from primary storage. [2025-10-02T22:46:58.105869] [INFO ] [MAIN ] WDS: Loaded 43591 primary data records. [2025-10-02T22:46:58.651741] [DEBUG] [MAIN ] WDI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:58.654024] [INFO ] [MAIN ] WDI: Generated 1807 derivative records from 21232 primary records. [2025-10-02T22:46:58.656395] [DEBUG] [LOCAL ] WDI: Saving derivative data. [2025-10-02T22:46:58.684581] [DEBUG] [MAIN ] WEA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:58.686598] [INFO ] [MAIN ] WEA: Generated 1807 derivative records from 7309 primary records. [2025-10-02T22:46:58.687299] [DEBUG] [LOCAL ] WEA: Saving derivative data. [2025-10-02T22:46:58.705105] [DEBUG] [LOCAL ] WDI: Derivative data saved (1807 records). [2025-10-02T22:46:58.706108] [INFO ] [MAIN ] WDI: Successfully saved derivative data. [2025-10-02T22:46:58.708670] [INFO ] [MAIN ] Derivative Progress: 1888/1975 symbols completed. WDI took 1.2s. Estimated remaining: 36.4s. Rate: 143.5 symbols/min [2025-10-02T22:46:58.711232] [DEBUG] [LOCAL ] WEA: Derivative data saved (1807 records). [2025-10-02T22:46:58.711347] [INFO ] [MAIN ] WEA: Successfully saved derivative data. [2025-10-02T22:46:58.713697] [INFO ] [MAIN ] Derivative Progress: 1889/1975 symbols completed. WEA took 1.2s. Estimated remaining: 35.9s. Rate: 143.6 symbols/min [2025-10-02T22:46:58.730745] [DEBUG] [MAIN ] WDS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:58.731378] [INFO ] [MAIN ] WDS: Generated 1807 derivative records from 43591 primary records. [2025-10-02T22:46:58.731442] [DEBUG] [LOCAL ] WDS: Saving derivative data. [2025-10-02T22:46:58.747568] [DEBUG] [LOCAL ] WDS: Derivative data saved (1807 records). [2025-10-02T22:46:58.747668] [INFO ] [MAIN ] WDS: Successfully saved derivative data. [2025-10-02T22:46:58.750131] [INFO ] [MAIN ] Derivative Progress: 1890/1975 symbols completed. WDS took 1.2s. Estimated remaining: 35.5s. Rate: 143.7 symbols/min [2025-10-02T22:46:58.750685] [INFO ] [MAIN ] WEC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:58.750906] [INFO ] [MAIN ] WELL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:58.750797] [INFO ] [MAIN ] WEAV: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:58.823936] [DEBUG] [LOCAL ] WEAV: Loaded 42221 existing records from primary storage. [2025-10-02T22:46:58.824223] [INFO ] [MAIN ] WEAV: Loaded 42221 primary data records. [2025-10-02T22:46:58.969846] [DEBUG] [LOCAL ] WEC: Loaded 52569 existing records from primary storage. [2025-10-02T22:46:58.970952] [DEBUG] [LOCAL ] WELL: Loaded 52752 existing records from primary storage. [2025-10-02T22:46:58.981412] [INFO ] [MAIN ] WEC: Loaded 52569 primary data records. [2025-10-02T22:46:58.991765] [INFO ] [MAIN ] WELL: Loaded 52752 primary data records. [2025-10-02T22:46:59.903787] [DEBUG] [MAIN ] WEAV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:59.905371] [INFO ] [MAIN ] WEAV: Generated 1807 derivative records from 42221 primary records. [2025-10-02T22:46:59.905798] [DEBUG] [LOCAL ] WEAV: Saving derivative data. [2025-10-02T22:46:59.942696] [DEBUG] [MAIN ] WEC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:59.946257] [INFO ] [MAIN ] WEC: Generated 1807 derivative records from 52569 primary records. [2025-10-02T22:46:59.946626] [DEBUG] [LOCAL ] WEC: Saving derivative data. [2025-10-02T22:46:59.971635] [DEBUG] [LOCAL ] WEAV: Derivative data saved (1807 records). [2025-10-02T22:46:59.977591] [INFO ] [MAIN ] WEAV: Successfully saved derivative data. [2025-10-02T22:46:59.980488] [INFO ] [MAIN ] Derivative Progress: 1891/1975 symbols completed. WEAV took 1.2s. Estimated remaining: 35.1s. Rate: 143.5 symbols/min [2025-10-02T22:46:59.981182] [INFO ] [MAIN ] WES: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:46:59.978622] [DEBUG] [MAIN ] WELL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:46:59.983885] [INFO ] [MAIN ] WELL: Generated 1807 derivative records from 52752 primary records. [2025-10-02T22:46:59.984464] [DEBUG] [LOCAL ] WELL: Saving derivative data. [2025-10-02T22:47:00.001394] [DEBUG] [LOCAL ] WEC: Derivative data saved (1807 records). [2025-10-02T22:47:00.002402] [INFO ] [MAIN ] WEC: Successfully saved derivative data. [2025-10-02T22:47:00.005577] [INFO ] [MAIN ] Derivative Progress: 1892/1975 symbols completed. WEC took 1.3s. Estimated remaining: 34.7s. Rate: 143.6 symbols/min [2025-10-02T22:47:00.007232] [INFO ] [MAIN ] WEX: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:00.012672] [DEBUG] [LOCAL ] WELL: Derivative data saved (1807 records). [2025-10-02T22:47:00.012931] [INFO ] [MAIN ] WELL: Successfully saved derivative data. [2025-10-02T22:47:00.016912] [INFO ] [MAIN ] Derivative Progress: 1893/1975 symbols completed. WELL took 1.3s. Estimated remaining: 34.2s. Rate: 143.7 symbols/min [2025-10-02T22:47:00.017435] [INFO ] [MAIN ] WF: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:00.068100] [DEBUG] [LOCAL ] WF: Loaded 10768 existing records from primary storage. [2025-10-02T22:47:00.069386] [DEBUG] [LOCAL ] WES: Loaded 48472 existing records from primary storage. [2025-10-02T22:47:00.069887] [INFO ] [MAIN ] WES: Loaded 48472 primary data records. [2025-10-02T22:47:00.069792] [INFO ] [MAIN ] WF: Loaded 10768 primary data records. [2025-10-02T22:47:00.210727] [DEBUG] [LOCAL ] WEX: Loaded 34737 existing records from primary storage. [2025-10-02T22:47:00.230959] [INFO ] [MAIN ] WEX: Loaded 34737 primary data records. [2025-10-02T22:47:01.188217] [DEBUG] [MAIN ] WF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:01.191853] [INFO ] [MAIN ] WF: Generated 1807 derivative records from 10768 primary records. [2025-10-02T22:47:01.192236] [DEBUG] [LOCAL ] WF: Saving derivative data. [2025-10-02T22:47:01.221936] [DEBUG] [MAIN ] WES: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:01.225113] [INFO ] [MAIN ] WES: Generated 1807 derivative records from 48472 primary records. [2025-10-02T22:47:01.225329] [DEBUG] [LOCAL ] WES: Saving derivative data. [2025-10-02T22:47:01.255916] [DEBUG] [MAIN ] WEX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:01.253075] [DEBUG] [LOCAL ] WF: Derivative data saved (1807 records). [2025-10-02T22:47:01.258842] [INFO ] [MAIN ] WEX: Generated 1807 derivative records from 34737 primary records. [2025-10-02T22:47:01.258902] [INFO ] [MAIN ] WF: Successfully saved derivative data. [2025-10-02T22:47:01.260942] [INFO ] [MAIN ] Derivative Progress: 1894/1975 symbols completed. WF took 1.2s. Estimated remaining: 33.9s. Rate: 143.5 symbols/min [2025-10-02T22:47:01.261013] [DEBUG] [LOCAL ] WES: Derivative data saved (1807 records). [2025-10-02T22:47:01.261178] [DEBUG] [LOCAL ] WEX: Saving derivative data. [2025-10-02T22:47:01.261795] [INFO ] [MAIN ] WFC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:01.261284] [INFO ] [MAIN ] WES: Successfully saved derivative data. [2025-10-02T22:47:01.264630] [INFO ] [MAIN ] Derivative Progress: 1895/1975 symbols completed. WES took 1.3s. Estimated remaining: 33.4s. Rate: 143.6 symbols/min [2025-10-02T22:47:01.265459] [INFO ] [MAIN ] WFG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:01.283629] [DEBUG] [LOCAL ] WEX: Derivative data saved (1807 records). [2025-10-02T22:47:01.283905] [INFO ] [MAIN ] WEX: Successfully saved derivative data. [2025-10-02T22:47:01.286385] [INFO ] [MAIN ] Derivative Progress: 1896/1975 symbols completed. WEX took 1.3s. Estimated remaining: 33.0s. Rate: 143.6 symbols/min [2025-10-02T22:47:01.286676] [INFO ] [MAIN ] WGO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:01.308809] [DEBUG] [LOCAL ] WFG: Loaded 24878 existing records from primary storage. [2025-10-02T22:47:01.309082] [INFO ] [MAIN ] WFG: Loaded 24878 primary data records. [2025-10-02T22:47:01.663834] [DEBUG] [LOCAL ] WGO: Loaded 39165 existing records from primary storage. [2025-10-02T22:47:01.693305] [INFO ] [MAIN ] WGO: Loaded 39165 primary data records. [2025-10-02T22:47:01.700235] [DEBUG] [LOCAL ] WFC: Loaded 54138 existing records from primary storage. [2025-10-02T22:47:01.729222] [INFO ] [MAIN ] WFC: Loaded 54138 primary data records. [2025-10-02T22:47:02.427460] [DEBUG] [MAIN ] WFG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:02.429017] [INFO ] [MAIN ] WFG: Generated 1807 derivative records from 24878 primary records. [2025-10-02T22:47:02.429135] [DEBUG] [LOCAL ] WFG: Saving derivative data. [2025-10-02T22:47:02.449880] [DEBUG] [LOCAL ] WFG: Derivative data saved (1807 records). [2025-10-02T22:47:02.458124] [INFO ] [MAIN ] WFG: Successfully saved derivative data. [2025-10-02T22:47:02.465554] [INFO ] [MAIN ] Derivative Progress: 1897/1975 symbols completed. WFG took 1.2s. Estimated remaining: 32.6s. Rate: 143.5 symbols/min [2025-10-02T22:47:02.466141] [DEBUG] [MAIN ] WGO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:02.467401] [INFO ] [MAIN ] WGO: Generated 1807 derivative records from 39165 primary records. [2025-10-02T22:47:02.467903] [INFO ] [MAIN ] WH: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:02.467783] [DEBUG] [LOCAL ] WGO: Saving derivative data. [2025-10-02T22:47:02.502923] [DEBUG] [MAIN ] WFC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:02.504168] [INFO ] [MAIN ] WFC: Generated 1807 derivative records from 54138 primary records. [2025-10-02T22:47:02.504582] [DEBUG] [LOCAL ] WGO: Derivative data saved (1807 records). [2025-10-02T22:47:02.504867] [INFO ] [MAIN ] WGO: Successfully saved derivative data. [2025-10-02T22:47:02.504939] [DEBUG] [LOCAL ] WFC: Saving derivative data. [2025-10-02T22:47:02.508116] [INFO ] [MAIN ] Derivative Progress: 1898/1975 symbols completed. WGO took 1.2s. Estimated remaining: 32.2s. Rate: 143.6 symbols/min [2025-10-02T22:47:02.508690] [INFO ] [MAIN ] WHD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:02.527860] [DEBUG] [LOCAL ] WFC: Derivative data saved (1807 records). [2025-10-02T22:47:02.528189] [INFO ] [MAIN ] WFC: Successfully saved derivative data. [2025-10-02T22:47:02.530731] [INFO ] [MAIN ] Derivative Progress: 1899/1975 symbols completed. WFC took 1.3s. Estimated remaining: 31.7s. Rate: 143.7 symbols/min [2025-10-02T22:47:02.530951] [INFO ] [MAIN ] WHG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:02.549661] [DEBUG] [LOCAL ] WHG: Loaded 3320 existing records from primary storage. [2025-10-02T22:47:02.549893] [INFO ] [MAIN ] WHG: Loaded 3320 primary data records. [2025-10-02T22:47:02.693794] [DEBUG] [LOCAL ] WH: Loaded 45765 existing records from primary storage. [2025-10-02T22:47:02.741509] [INFO ] [MAIN ] WH: Loaded 45765 primary data records. [2025-10-02T22:47:02.742327] [DEBUG] [LOCAL ] WHD: Loaded 40598 existing records from primary storage. [2025-10-02T22:47:02.768426] [INFO ] [MAIN ] WHD: Loaded 40598 primary data records. [2025-10-02T22:47:03.618195] [DEBUG] [MAIN ] WHG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:03.619908] [INFO ] [MAIN ] WHG: Generated 1807 derivative records from 3320 primary records. [2025-10-02T22:47:03.620257] [DEBUG] [LOCAL ] WHG: Saving derivative data. [2025-10-02T22:47:03.641928] [DEBUG] [LOCAL ] WHG: Derivative data saved (1807 records). [2025-10-02T22:47:03.643306] [INFO ] [MAIN ] WHG: Successfully saved derivative data. [2025-10-02T22:47:03.658075] [INFO ] [MAIN ] Derivative Progress: 1900/1975 symbols completed. WHG took 1.1s. Estimated remaining: 31.4s. Rate: 143.5 symbols/min [2025-10-02T22:47:03.660516] [INFO ] [MAIN ] WHR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:03.661539] [DEBUG] [MAIN ] WHD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:03.662332] [INFO ] [MAIN ] WHD: Generated 1807 derivative records from 40598 primary records. [2025-10-02T22:47:03.662638] [DEBUG] [LOCAL ] WHD: Saving derivative data. [2025-10-02T22:47:03.686254] [DEBUG] [MAIN ] WH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:03.691181] [INFO ] [MAIN ] WH: Generated 1807 derivative records from 45765 primary records. [2025-10-02T22:47:03.691789] [DEBUG] [LOCAL ] WH: Saving derivative data. [2025-10-02T22:47:03.716259] [DEBUG] [LOCAL ] WHD: Derivative data saved (1807 records). [2025-10-02T22:47:03.717756] [INFO ] [MAIN ] WHD: Successfully saved derivative data. [2025-10-02T22:47:03.718076] [DEBUG] [LOCAL ] WH: Derivative data saved (1807 records). [2025-10-02T22:47:03.721103] [INFO ] [MAIN ] WH: Successfully saved derivative data. [2025-10-02T22:47:03.720914] [INFO ] [MAIN ] Derivative Progress: 1901/1975 symbols completed. WHD took 1.2s. Estimated remaining: 30.9s. Rate: 143.6 symbols/min [2025-10-02T22:47:03.724236] [INFO ] [MAIN ] WIA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:03.724425] [INFO ] [MAIN ] Derivative Progress: 1902/1975 symbols completed. WH took 1.3s. Estimated remaining: 30.5s. Rate: 143.7 symbols/min [2025-10-02T22:47:03.724989] [INFO ] [MAIN ] WINN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:03.743999] [DEBUG] [LOCAL ] WIA: Loaded 4835 existing records from primary storage. [2025-10-02T22:47:03.744132] [INFO ] [MAIN ] WIA: Loaded 4835 primary data records. [2025-10-02T22:47:03.803503] [DEBUG] [LOCAL ] WINN: Loaded 11698 existing records from primary storage. [2025-10-02T22:47:03.817671] [INFO ] [MAIN ] WINN: Loaded 11698 primary data records. [2025-10-02T22:47:03.850447] [DEBUG] [LOCAL ] WHR: Loaded 48506 existing records from primary storage. [2025-10-02T22:47:03.926321] [INFO ] [MAIN ] WHR: Loaded 48506 primary data records. [2025-10-02T22:47:04.816582] [DEBUG] [MAIN ] WIA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:04.820157] [INFO ] [MAIN ] WIA: Generated 1807 derivative records from 4835 primary records. [2025-10-02T22:47:04.820345] [DEBUG] [LOCAL ] WIA: Saving derivative data. [2025-10-02T22:47:04.845982] [DEBUG] [MAIN ] WINN: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-02T22:47:04.848572] [INFO ] [MAIN ] WINN: Generated 1806 derivative records from 11698 primary records. [2025-10-02T22:47:04.851073] [DEBUG] [LOCAL ] WINN: Saving derivative data. [2025-10-02T22:47:04.851699] [DEBUG] [LOCAL ] WIA: Derivative data saved (1807 records). [2025-10-02T22:47:04.853271] [INFO ] [MAIN ] WIA: Successfully saved derivative data. [2025-10-02T22:47:04.863453] [INFO ] [MAIN ] Derivative Progress: 1903/1975 symbols completed. WIA took 1.1s. Estimated remaining: 30.1s. Rate: 143.5 symbols/min [2025-10-02T22:47:04.882299] [DEBUG] [MAIN ] WHR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:04.884335] [INFO ] [MAIN ] WHR: Generated 1807 derivative records from 48506 primary records. [2025-10-02T22:47:04.886108] [DEBUG] [LOCAL ] WHR: Saving derivative data. [2025-10-02T22:47:04.886968] [DEBUG] [LOCAL ] WINN: Derivative data saved (1806 records). [2025-10-02T22:47:04.887678] [INFO ] [MAIN ] WINN: Successfully saved derivative data. [2025-10-02T22:47:04.890105] [INFO ] [MAIN ] Derivative Progress: 1904/1975 symbols completed. WINN took 1.2s. Estimated remaining: 29.7s. Rate: 143.6 symbols/min [2025-10-02T22:47:04.905880] [DEBUG] [LOCAL ] WHR: Derivative data saved (1807 records). [2025-10-02T22:47:04.905946] [INFO ] [MAIN ] WHR: Successfully saved derivative data. [2025-10-02T22:47:04.908169] [INFO ] [MAIN ] Derivative Progress: 1905/1975 symbols completed. WHR took 1.2s. Estimated remaining: 29.2s. Rate: 143.7 symbols/min [2025-10-02T22:47:04.908556] [INFO ] [MAIN ] WIT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:04.908757] [INFO ] [MAIN ] WK: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:04.908618] [INFO ] [MAIN ] WIW: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:04.940206] [DEBUG] [LOCAL ] WIW: Loaded 20534 existing records from primary storage. [2025-10-02T22:47:04.949018] [INFO ] [MAIN ] WIW: Loaded 20534 primary data records. [2025-10-02T22:47:05.131264] [DEBUG] [LOCAL ] WIT: Loaded 52740 existing records from primary storage. [2025-10-02T22:47:05.149060] [INFO ] [MAIN ] WIT: Loaded 52740 primary data records. [2025-10-02T22:47:05.132599] [DEBUG] [LOCAL ] WK: Loaded 37436 existing records from primary storage. [2025-10-02T22:47:05.190170] [INFO ] [MAIN ] WK: Loaded 37436 primary data records. [2025-10-02T22:47:06.001103] [DEBUG] [MAIN ] WIW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:06.003041] [INFO ] [MAIN ] WIW: Generated 1807 derivative records from 20534 primary records. [2025-10-02T22:47:06.003155] [DEBUG] [LOCAL ] WIW: Saving derivative data. [2025-10-02T22:47:06.023491] [DEBUG] [LOCAL ] WIW: Derivative data saved (1807 records). [2025-10-02T22:47:06.024434] [INFO ] [MAIN ] WIW: Successfully saved derivative data. [2025-10-02T22:47:06.028383] [INFO ] [MAIN ] Derivative Progress: 1906/1975 symbols completed. WIW took 1.1s. Estimated remaining: 28.8s. Rate: 143.5 symbols/min [2025-10-02T22:47:06.028812] [INFO ] [MAIN ] WKC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:06.045164] [DEBUG] [MAIN ] WK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:06.047211] [INFO ] [MAIN ] WK: Generated 1807 derivative records from 37436 primary records. [2025-10-02T22:47:06.048197] [DEBUG] [LOCAL ] WK: Saving derivative data. [2025-10-02T22:47:06.077543] [DEBUG] [MAIN ] WIT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:06.079671] [INFO ] [MAIN ] WIT: Generated 1807 derivative records from 52740 primary records. [2025-10-02T22:47:06.079856] [DEBUG] [LOCAL ] WIT: Saving derivative data. [2025-10-02T22:47:06.078681] [DEBUG] [LOCAL ] WK: Derivative data saved (1807 records). [2025-10-02T22:47:06.079979] [INFO ] [MAIN ] WK: Successfully saved derivative data. [2025-10-02T22:47:06.082449] [INFO ] [MAIN ] Derivative Progress: 1907/1975 symbols completed. WK took 1.2s. Estimated remaining: 28.4s. Rate: 143.6 symbols/min [2025-10-02T22:47:06.083303] [INFO ] [MAIN ] WLK: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:06.123935] [DEBUG] [LOCAL ] WIT: Derivative data saved (1807 records). [2025-10-02T22:47:06.125331] [INFO ] [MAIN ] WIT: Successfully saved derivative data. [2025-10-02T22:47:06.128062] [INFO ] [MAIN ] Derivative Progress: 1908/1975 symbols completed. WIT took 1.2s. Estimated remaining: 28.0s. Rate: 143.7 symbols/min [2025-10-02T22:47:06.129228] [DEBUG] [LOCAL ] WKC: Loaded 35105 existing records from primary storage. [2025-10-02T22:47:06.129468] [INFO ] [MAIN ] WLKP: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:06.129908] [INFO ] [MAIN ] WKC: Loaded 35105 primary data records. [2025-10-02T22:47:06.239463] [DEBUG] [LOCAL ] WLKP: Loaded 6891 existing records from primary storage. [2025-10-02T22:47:06.257693] [INFO ] [MAIN ] WLKP: Loaded 6891 primary data records. [2025-10-02T22:47:06.608687] [DEBUG] [LOCAL ] WLK: Loaded 45898 existing records from primary storage. [2025-10-02T22:47:06.644145] [INFO ] [MAIN ] WLK: Loaded 45898 primary data records. [2025-10-02T22:47:07.195275] [DEBUG] [MAIN ] WKC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:07.196909] [INFO ] [MAIN ] WKC: Generated 1807 derivative records from 35105 primary records. [2025-10-02T22:47:07.198018] [DEBUG] [LOCAL ] WKC: Saving derivative data. [2025-10-02T22:47:07.224865] [DEBUG] [MAIN ] WLKP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:07.226229] [INFO ] [MAIN ] WLKP: Generated 1807 derivative records from 6891 primary records. [2025-10-02T22:47:07.226683] [DEBUG] [LOCAL ] WLKP: Saving derivative data. [2025-10-02T22:47:07.243028] [DEBUG] [LOCAL ] WKC: Derivative data saved (1807 records). [2025-10-02T22:47:07.243348] [INFO ] [MAIN ] WKC: Successfully saved derivative data. [2025-10-02T22:47:07.245482] [INFO ] [MAIN ] Derivative Progress: 1909/1975 symbols completed. WKC took 1.2s. Estimated remaining: 27.6s. Rate: 143.6 symbols/min [2025-10-02T22:47:07.245899] [INFO ] [MAIN ] WLY: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:07.254270] [DEBUG] [LOCAL ] WLKP: Derivative data saved (1807 records). [2025-10-02T22:47:07.255329] [INFO ] [MAIN ] WLKP: Successfully saved derivative data. [2025-10-02T22:47:07.257614] [INFO ] [MAIN ] Derivative Progress: 1910/1975 symbols completed. WLKP took 1.1s. Estimated remaining: 27.2s. Rate: 143.6 symbols/min [2025-10-02T22:47:07.257999] [INFO ] [MAIN ] WM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:07.271619] [DEBUG] [MAIN ] WLK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:07.272389] [INFO ] [MAIN ] WLK: Generated 1807 derivative records from 45898 primary records. [2025-10-02T22:47:07.272559] [DEBUG] [LOCAL ] WLK: Saving derivative data. [2025-10-02T22:47:07.308134] [DEBUG] [LOCAL ] WLK: Derivative data saved (1807 records). [2025-10-02T22:47:07.309321] [INFO ] [MAIN ] WLK: Successfully saved derivative data. [2025-10-02T22:47:07.311722] [INFO ] [MAIN ] Derivative Progress: 1911/1975 symbols completed. WLK took 1.2s. Estimated remaining: 26.7s. Rate: 143.7 symbols/min [2025-10-02T22:47:07.312021] [INFO ] [MAIN ] WMB: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:07.313007] [DEBUG] [LOCAL ] WLY: Loaded 29858 existing records from primary storage. [2025-10-02T22:47:07.313466] [INFO ] [MAIN ] WLY: Loaded 29858 primary data records. [2025-10-02T22:47:07.732110] [DEBUG] [LOCAL ] WM: Loaded 51286 existing records from primary storage. [2025-10-02T22:47:07.732781] [INFO ] [MAIN ] WM: Loaded 51286 primary data records. [2025-10-02T22:47:07.746591] [DEBUG] [LOCAL ] WMB: Loaded 54061 existing records from primary storage. [2025-10-02T22:47:07.769751] [INFO ] [MAIN ] WMB: Loaded 54061 primary data records. [2025-10-02T22:47:08.394968] [DEBUG] [MAIN ] WLY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:08.396742] [INFO ] [MAIN ] WLY: Generated 1807 derivative records from 29858 primary records. [2025-10-02T22:47:08.396971] [DEBUG] [LOCAL ] WLY: Saving derivative data. [2025-10-02T22:47:08.431404] [DEBUG] [LOCAL ] WLY: Derivative data saved (1807 records). [2025-10-02T22:47:08.437230] [INFO ] [MAIN ] WLY: Successfully saved derivative data. [2025-10-02T22:47:08.440213] [DEBUG] [MAIN ] WM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:08.439769] [INFO ] [MAIN ] Derivative Progress: 1912/1975 symbols completed. WLY took 1.2s. Estimated remaining: 26.3s. Rate: 143.6 symbols/min [2025-10-02T22:47:08.441365] [INFO ] [MAIN ] WM: Generated 1807 derivative records from 51286 primary records. [2025-10-02T22:47:08.441516] [INFO ] [MAIN ] WMK: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:08.441899] [DEBUG] [LOCAL ] WM: Saving derivative data. [2025-10-02T22:47:08.463835] [DEBUG] [LOCAL ] WM: Derivative data saved (1807 records). [2025-10-02T22:47:08.464128] [INFO ] [MAIN ] WM: Successfully saved derivative data. [2025-10-02T22:47:08.474772] [INFO ] [MAIN ] Derivative Progress: 1913/1975 symbols completed. WM took 1.2s. Estimated remaining: 25.9s. Rate: 143.6 symbols/min [2025-10-02T22:47:08.480240] [INFO ] [MAIN ] WMS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:08.485529] [DEBUG] [MAIN ] WMB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:08.486428] [INFO ] [MAIN ] WMB: Generated 1807 derivative records from 54061 primary records. [2025-10-02T22:47:08.486778] [DEBUG] [LOCAL ] WMB: Saving derivative data. [2025-10-02T22:47:08.506702] [DEBUG] [LOCAL ] WMK: Loaded 14606 existing records from primary storage. [2025-10-02T22:47:08.507701] [INFO ] [MAIN ] WMK: Loaded 14606 primary data records. [2025-10-02T22:47:08.581098] [DEBUG] [LOCAL ] WMB: Derivative data saved (1807 records). [2025-10-02T22:47:08.587315] [INFO ] [MAIN ] WMB: Successfully saved derivative data. [2025-10-02T22:47:08.601804] [INFO ] [MAIN ] Derivative Progress: 1914/1975 symbols completed. WMB took 1.3s. Estimated remaining: 25.5s. Rate: 143.7 symbols/min [2025-10-02T22:47:08.613978] [INFO ] [MAIN ] WMT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:08.888329] [DEBUG] [LOCAL ] WMS: Loaded 39844 existing records from primary storage. [2025-10-02T22:47:08.888692] [INFO ] [MAIN ] WMS: Loaded 39844 primary data records. [2025-10-02T22:47:09.089400] [DEBUG] [LOCAL ] WMT: Loaded 54190 existing records from primary storage. [2025-10-02T22:47:09.111878] [INFO ] [MAIN ] WMT: Loaded 54190 primary data records. [2025-10-02T22:47:09.636111] [DEBUG] [MAIN ] WMK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:09.637235] [INFO ] [MAIN ] WMK: Generated 1807 derivative records from 14606 primary records. [2025-10-02T22:47:09.637440] [DEBUG] [LOCAL ] WMK: Saving derivative data. [2025-10-02T22:47:09.656570] [DEBUG] [LOCAL ] WMK: Derivative data saved (1807 records). [2025-10-02T22:47:09.657200] [INFO ] [MAIN ] WMK: Successfully saved derivative data. [2025-10-02T22:47:09.659407] [INFO ] [MAIN ] Derivative Progress: 1915/1975 symbols completed. WMK took 1.2s. Estimated remaining: 25.1s. Rate: 143.6 symbols/min [2025-10-02T22:47:09.660477] [INFO ] [MAIN ] WNC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:09.678670] [DEBUG] [MAIN ] WMS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:09.679411] [INFO ] [MAIN ] WMS: Generated 1807 derivative records from 39844 primary records. [2025-10-02T22:47:09.679494] [DEBUG] [LOCAL ] WMS: Saving derivative data. [2025-10-02T22:47:09.700578] [DEBUG] [LOCAL ] WMS: Derivative data saved (1807 records). [2025-10-02T22:47:09.702335] [INFO ] [MAIN ] WMS: Successfully saved derivative data. [2025-10-02T22:47:09.704823] [INFO ] [MAIN ] Derivative Progress: 1916/1975 symbols completed. WMS took 1.2s. Estimated remaining: 24.6s. Rate: 143.6 symbols/min [2025-10-02T22:47:09.705266] [INFO ] [MAIN ] WNS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:09.728613] [DEBUG] [MAIN ] WMT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:09.729413] [INFO ] [MAIN ] WMT: Generated 1807 derivative records from 54190 primary records. [2025-10-02T22:47:09.729487] [DEBUG] [LOCAL ] WMT: Saving derivative data. [2025-10-02T22:47:09.759146] [DEBUG] [LOCAL ] WMT: Derivative data saved (1807 records). [2025-10-02T22:47:09.759287] [INFO ] [MAIN ] WMT: Successfully saved derivative data. [2025-10-02T22:47:09.761601] [INFO ] [MAIN ] Derivative Progress: 1917/1975 symbols completed. WMT took 1.1s. Estimated remaining: 24.2s. Rate: 143.7 symbols/min [2025-10-02T22:47:09.762868] [DEBUG] [LOCAL ] WNC: Loaded 39582 existing records from primary storage. [2025-10-02T22:47:09.763019] [INFO ] [MAIN ] WNC: Loaded 39582 primary data records. [2025-10-02T22:47:09.763170] [INFO ] [MAIN ] WOLF: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:10.109810] [DEBUG] [LOCAL ] WNS: Loaded 40206 existing records from primary storage. [2025-10-02T22:47:10.125604] [INFO ] [MAIN ] WNS: Loaded 40206 primary data records. [2025-10-02T22:47:10.265470] [DEBUG] [LOCAL ] WOLF: Loaded 53572 existing records from primary storage. [2025-10-02T22:47:10.270511] [INFO ] [MAIN ] WOLF: Loaded 53572 primary data records. [2025-10-02T22:47:10.875609] [DEBUG] [MAIN ] WNC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:10.876516] [INFO ] [MAIN ] WNC: Generated 1807 derivative records from 39582 primary records. [2025-10-02T22:47:10.876792] [DEBUG] [LOCAL ] WNC: Saving derivative data. [2025-10-02T22:47:10.903665] [DEBUG] [LOCAL ] WNC: Derivative data saved (1807 records). [2025-10-02T22:47:10.917545] [DEBUG] [MAIN ] WNS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:10.917247] [INFO ] [MAIN ] WNC: Successfully saved derivative data. [2025-10-02T22:47:10.925410] [INFO ] [MAIN ] Derivative Progress: 1918/1975 symbols completed. WNC took 1.3s. Estimated remaining: 23.8s. Rate: 143.6 symbols/min [2025-10-02T22:47:10.922795] [INFO ] [MAIN ] WNS: Generated 1807 derivative records from 40206 primary records. [2025-10-02T22:47:10.925778] [DEBUG] [LOCAL ] WNS: Saving derivative data. [2025-10-02T22:47:10.959436] [DEBUG] [MAIN ] WOLF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:10.961099] [INFO ] [MAIN ] WOLF: Generated 1807 derivative records from 53572 primary records. [2025-10-02T22:47:10.961442] [DEBUG] [LOCAL ] WOLF: Saving derivative data. [2025-10-02T22:47:10.962628] [DEBUG] [LOCAL ] WNS: Derivative data saved (1807 records). [2025-10-02T22:47:10.963413] [INFO ] [MAIN ] WNS: Successfully saved derivative data. [2025-10-02T22:47:10.965466] [INFO ] [MAIN ] Derivative Progress: 1919/1975 symbols completed. WNS took 1.3s. Estimated remaining: 23.4s. Rate: 143.6 symbols/min [2025-10-02T22:47:10.982749] [DEBUG] [LOCAL ] WOLF: Derivative data saved (1807 records). [2025-10-02T22:47:10.982839] [INFO ] [MAIN ] WOLF: Successfully saved derivative data. [2025-10-02T22:47:10.989410] [INFO ] [MAIN ] Derivative Progress: 1920/1975 symbols completed. WOLF took 1.2s. Estimated remaining: 23.0s. Rate: 143.7 symbols/min [2025-10-02T22:47:10.989951] [INFO ] [MAIN ] WOW: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:10.990176] [INFO ] [MAIN ] WPC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:10.990044] [INFO ] [MAIN ] WOR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:11.028815] [DEBUG] [LOCAL ] WOR: Loaded 25101 existing records from primary storage. [2025-10-02T22:47:11.039500] [DEBUG] [LOCAL ] WOW: Loaded 30711 existing records from primary storage. [2025-10-02T22:47:11.038821] [INFO ] [MAIN ] WOR: Loaded 25101 primary data records. [2025-10-02T22:47:11.039609] [INFO ] [MAIN ] WOW: Loaded 30711 primary data records. [2025-10-02T22:47:11.341539] [DEBUG] [LOCAL ] WPC: Loaded 48701 existing records from primary storage. [2025-10-02T22:47:11.437285] [INFO ] [MAIN ] WPC: Loaded 48701 primary data records. [2025-10-02T22:47:12.080441] [DEBUG] [MAIN ] WOW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:12.094378] [INFO ] [MAIN ] WOW: Generated 1807 derivative records from 30711 primary records. [2025-10-02T22:47:12.095141] [DEBUG] [LOCAL ] WOW: Saving derivative data. [2025-10-02T22:47:12.095605] [DEBUG] [MAIN ] WOR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:12.098293] [INFO ] [MAIN ] WOR: Generated 1807 derivative records from 25101 primary records. [2025-10-02T22:47:12.107112] [DEBUG] [LOCAL ] WOR: Saving derivative data. [2025-10-02T22:47:12.133968] [DEBUG] [LOCAL ] WOW: Derivative data saved (1807 records). [2025-10-02T22:47:12.136525] [INFO ] [MAIN ] WOW: Successfully saved derivative data. [2025-10-02T22:47:12.139043] [INFO ] [MAIN ] Derivative Progress: 1921/1975 symbols completed. WOW took 1.1s. Estimated remaining: 22.6s. Rate: 143.6 symbols/min [2025-10-02T22:47:12.139735] [INFO ] [MAIN ] WPM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:12.140087] [DEBUG] [LOCAL ] WOR: Derivative data saved (1807 records). [2025-10-02T22:47:12.140689] [INFO ] [MAIN ] WOR: Successfully saved derivative data. [2025-10-02T22:47:12.150756] [INFO ] [MAIN ] Derivative Progress: 1922/1975 symbols completed. WOR took 1.2s. Estimated remaining: 22.1s. Rate: 143.6 symbols/min [2025-10-02T22:47:12.156556] [DEBUG] [MAIN ] WPC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:12.157439] [INFO ] [MAIN ] WPC: Generated 1807 derivative records from 48701 primary records. [2025-10-02T22:47:12.157638] [INFO ] [MAIN ] WPP: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:12.157542] [DEBUG] [LOCAL ] WPC: Saving derivative data. [2025-10-02T22:47:12.175384] [DEBUG] [LOCAL ] WPC: Derivative data saved (1807 records). [2025-10-02T22:47:12.175588] [INFO ] [MAIN ] WPC: Successfully saved derivative data. [2025-10-02T22:47:12.178091] [INFO ] [MAIN ] Derivative Progress: 1923/1975 symbols completed. WPC took 1.2s. Estimated remaining: 21.7s. Rate: 143.7 symbols/min [2025-10-02T22:47:12.178367] [INFO ] [MAIN ] WRB: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:12.226800] [DEBUG] [LOCAL ] WPP: Loaded 34147 existing records from primary storage. [2025-10-02T22:47:12.241486] [INFO ] [MAIN ] WPP: Loaded 34147 primary data records. [2025-10-02T22:47:12.264488] [DEBUG] [LOCAL ] WPM: Loaded 53116 existing records from primary storage. [2025-10-02T22:47:12.288786] [INFO ] [MAIN ] WPM: Loaded 53116 primary data records. [2025-10-02T22:47:12.605881] [DEBUG] [LOCAL ] WRB: Loaded 50945 existing records from primary storage. [2025-10-02T22:47:12.778876] [INFO ] [MAIN ] WRB: Loaded 50945 primary data records. [2025-10-02T22:47:13.331622] [DEBUG] [MAIN ] WPM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:13.333049] [INFO ] [MAIN ] WPM: Generated 1807 derivative records from 53116 primary records. [2025-10-02T22:47:13.336356] [DEBUG] [LOCAL ] WPM: Saving derivative data. [2025-10-02T22:47:13.367059] [DEBUG] [MAIN ] WPP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:13.369241] [INFO ] [MAIN ] WPP: Generated 1807 derivative records from 34147 primary records. [2025-10-02T22:47:13.370792] [DEBUG] [LOCAL ] WPP: Saving derivative data. [2025-10-02T22:47:13.383934] [DEBUG] [LOCAL ] WPM: Derivative data saved (1807 records). [2025-10-02T22:47:13.387512] [INFO ] [MAIN ] WPM: Successfully saved derivative data. [2025-10-02T22:47:13.391222] [INFO ] [MAIN ] Derivative Progress: 1924/1975 symbols completed. WPM took 1.3s. Estimated remaining: 21.3s. Rate: 143.6 symbols/min [2025-10-02T22:47:13.396348] [INFO ] [MAIN ] WRBY: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:13.396502] [DEBUG] [LOCAL ] WPP: Derivative data saved (1807 records). [2025-10-02T22:47:13.396822] [INFO ] [MAIN ] WPP: Successfully saved derivative data. [2025-10-02T22:47:13.400034] [INFO ] [MAIN ] Derivative Progress: 1925/1975 symbols completed. WPP took 1.2s. Estimated remaining: 20.9s. Rate: 143.6 symbols/min [2025-10-02T22:47:13.403118] [INFO ] [MAIN ] WS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:13.417512] [DEBUG] [MAIN ] WRB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:13.418627] [INFO ] [MAIN ] WRB: Generated 1807 derivative records from 50945 primary records. [2025-10-02T22:47:13.418768] [DEBUG] [LOCAL ] WRB: Saving derivative data. [2025-10-02T22:47:13.435893] [DEBUG] [LOCAL ] WRB: Derivative data saved (1807 records). [2025-10-02T22:47:13.437487] [INFO ] [MAIN ] WRB: Successfully saved derivative data. [2025-10-02T22:47:13.439829] [INFO ] [MAIN ] Derivative Progress: 1926/1975 symbols completed. WRB took 1.3s. Estimated remaining: 20.5s. Rate: 143.7 symbols/min [2025-10-02T22:47:13.440094] [INFO ] [MAIN ] WSM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:13.472755] [DEBUG] [LOCAL ] WS: Loaded 24178 existing records from primary storage. [2025-10-02T22:47:13.472893] [INFO ] [MAIN ] WS: Loaded 24178 primary data records. [2025-10-02T22:47:13.605432] [DEBUG] [LOCAL ] WRBY: Loaded 51140 existing records from primary storage. [2025-10-02T22:47:13.621471] [INFO ] [MAIN ] WRBY: Loaded 51140 primary data records. [2025-10-02T22:47:13.971818] [DEBUG] [LOCAL ] WSM: Loaded 49937 existing records from primary storage. [2025-10-02T22:47:13.983426] [INFO ] [MAIN ] WSM: Loaded 49937 primary data records. [2025-10-02T22:47:14.526564] [DEBUG] [MAIN ] WS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:14.528119] [INFO ] [MAIN ] WS: Generated 1807 derivative records from 24178 primary records. [2025-10-02T22:47:14.528468] [DEBUG] [LOCAL ] WS: Saving derivative data. [2025-10-02T22:47:14.549373] [DEBUG] [LOCAL ] WS: Derivative data saved (1807 records). [2025-10-02T22:47:14.549826] [INFO ] [MAIN ] WS: Successfully saved derivative data. [2025-10-02T22:47:14.553084] [INFO ] [MAIN ] Derivative Progress: 1927/1975 symbols completed. WS took 1.1s. Estimated remaining: 20.1s. Rate: 143.6 symbols/min [2025-10-02T22:47:14.554032] [INFO ] [MAIN ] WSO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:14.576972] [DEBUG] [MAIN ] WRBY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:14.577910] [INFO ] [MAIN ] WRBY: Generated 1807 derivative records from 51140 primary records. [2025-10-02T22:47:14.578094] [DEBUG] [LOCAL ] WRBY: Saving derivative data. [2025-10-02T22:47:14.615144] [DEBUG] [MAIN ] WSM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:14.624626] [INFO ] [MAIN ] WSM: Generated 1807 derivative records from 49937 primary records. [2025-10-02T22:47:14.625826] [DEBUG] [LOCAL ] WSO: Loaded 24887 existing records from primary storage. [2025-10-02T22:47:14.625039] [DEBUG] [LOCAL ] WSM: Saving derivative data. [2025-10-02T22:47:14.626910] [INFO ] [MAIN ] WSO: Loaded 24887 primary data records. [2025-10-02T22:47:14.683427] [DEBUG] [LOCAL ] WRBY: Derivative data saved (1807 records). [2025-10-02T22:47:14.693375] [INFO ] [MAIN ] WRBY: Successfully saved derivative data. [2025-10-02T22:47:14.696729] [INFO ] [MAIN ] Derivative Progress: 1928/1975 symbols completed. WRBY took 1.3s. Estimated remaining: 19.6s. Rate: 143.6 symbols/min [2025-10-02T22:47:14.712299] [DEBUG] [LOCAL ] WSM: Derivative data saved (1807 records). [2025-10-02T22:47:14.727768] [INFO ] [MAIN ] WSM: Successfully saved derivative data. [2025-10-02T22:47:14.722396] [INFO ] [MAIN ] WSR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:14.746316] [INFO ] [MAIN ] Derivative Progress: 1929/1975 symbols completed. WSM took 1.3s. Estimated remaining: 19.2s. Rate: 143.7 symbols/min [2025-10-02T22:47:14.751793] [INFO ] [MAIN ] WST: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:15.000568] [DEBUG] [LOCAL ] WSR: Loaded 23174 existing records from primary storage. [2025-10-02T22:47:15.000783] [INFO ] [MAIN ] WSR: Loaded 23174 primary data records. [2025-10-02T22:47:15.111251] [DEBUG] [LOCAL ] WST: Loaded 37510 existing records from primary storage. [2025-10-02T22:47:15.125133] [INFO ] [MAIN ] WST: Loaded 37510 primary data records. [2025-10-02T22:47:15.746923] [DEBUG] [MAIN ] WSO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:15.748838] [INFO ] [MAIN ] WSO: Generated 1807 derivative records from 24887 primary records. [2025-10-02T22:47:15.748977] [DEBUG] [LOCAL ] WSO: Saving derivative data. [2025-10-02T22:47:15.774689] [DEBUG] [LOCAL ] WSO: Derivative data saved (1807 records). [2025-10-02T22:47:15.774992] [INFO ] [MAIN ] WSO: Successfully saved derivative data. [2025-10-02T22:47:15.777211] [INFO ] [MAIN ] Derivative Progress: 1930/1975 symbols completed. WSO took 1.2s. Estimated remaining: 18.8s. Rate: 143.6 symbols/min [2025-10-02T22:47:15.778590] [INFO ] [MAIN ] WT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:15.796457] [DEBUG] [MAIN ] WSR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:15.797436] [INFO ] [MAIN ] WSR: Generated 1807 derivative records from 23174 primary records. [2025-10-02T22:47:15.797724] [DEBUG] [LOCAL ] WSR: Saving derivative data. [2025-10-02T22:47:15.829630] [DEBUG] [MAIN ] WST: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:15.832508] [INFO ] [MAIN ] WST: Generated 1807 derivative records from 37510 primary records. [2025-10-02T22:47:15.833490] [DEBUG] [LOCAL ] WST: Saving derivative data. [2025-10-02T22:47:15.834831] [DEBUG] [LOCAL ] WSR: Derivative data saved (1807 records). [2025-10-02T22:47:15.835094] [INFO ] [MAIN ] WSR: Successfully saved derivative data. [2025-10-02T22:47:15.837480] [INFO ] [MAIN ] Derivative Progress: 1931/1975 symbols completed. WSR took 1.1s. Estimated remaining: 18.4s. Rate: 143.7 symbols/min [2025-10-02T22:47:15.845345] [INFO ] [MAIN ] WTI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:15.865765] [DEBUG] [LOCAL ] WST: Derivative data saved (1807 records). [2025-10-02T22:47:15.865883] [INFO ] [MAIN ] WST: Successfully saved derivative data. [2025-10-02T22:47:15.868215] [INFO ] [MAIN ] Derivative Progress: 1932/1975 symbols completed. WST took 1.1s. Estimated remaining: 18.0s. Rate: 143.7 symbols/min [2025-10-02T22:47:15.868461] [INFO ] [MAIN ] WTRG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:15.886062] [DEBUG] [LOCAL ] WT: Loaded 48073 existing records from primary storage. [2025-10-02T22:47:15.886352] [INFO ] [MAIN ] WT: Loaded 48073 primary data records. [2025-10-02T22:47:16.089165] [DEBUG] [LOCAL ] WTI: Loaded 44224 existing records from primary storage. [2025-10-02T22:47:16.133372] [INFO ] [MAIN ] WTI: Loaded 44224 primary data records. [2025-10-02T22:47:16.386422] [DEBUG] [LOCAL ] WTRG: Loaded 51286 existing records from primary storage. [2025-10-02T22:47:16.401692] [INFO ] [MAIN ] WTRG: Loaded 51286 primary data records. [2025-10-02T22:47:16.978720] [DEBUG] [MAIN ] WT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:16.979611] [INFO ] [MAIN ] WT: Generated 1807 derivative records from 48073 primary records. [2025-10-02T22:47:16.980173] [DEBUG] [LOCAL ] WT: Saving derivative data. [2025-10-02T22:47:17.004820] [DEBUG] [LOCAL ] WT: Derivative data saved (1807 records). [2025-10-02T22:47:17.005292] [INFO ] [MAIN ] WT: Successfully saved derivative data. [2025-10-02T22:47:17.007460] [INFO ] [MAIN ] Derivative Progress: 1933/1975 symbols completed. WT took 1.2s. Estimated remaining: 17.5s. Rate: 143.6 symbols/min [2025-10-02T22:47:17.020931] [DEBUG] [MAIN ] WTI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:17.022712] [INFO ] [MAIN ] WTI: Generated 1807 derivative records from 44224 primary records. [2025-10-02T22:47:17.023009] [DEBUG] [LOCAL ] WTI: Saving derivative data. [2025-10-02T22:47:17.041848] [DEBUG] [LOCAL ] WTI: Derivative data saved (1807 records). [2025-10-02T22:47:17.042874] [INFO ] [MAIN ] WTI: Successfully saved derivative data. [2025-10-02T22:47:17.048550] [INFO ] [MAIN ] Derivative Progress: 1934/1975 symbols completed. WTI took 1.2s. Estimated remaining: 17.1s. Rate: 143.7 symbols/min [2025-10-02T22:47:17.069310] [DEBUG] [MAIN ] WTRG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:17.070303] [INFO ] [MAIN ] WTRG: Generated 1807 derivative records from 51286 primary records. [2025-10-02T22:47:17.070381] [DEBUG] [LOCAL ] WTRG: Saving derivative data. [2025-10-02T22:47:17.093424] [DEBUG] [LOCAL ] WTRG: Derivative data saved (1807 records). [2025-10-02T22:47:17.093596] [INFO ] [MAIN ] WTRG: Successfully saved derivative data. [2025-10-02T22:47:17.096158] [INFO ] [MAIN ] Derivative Progress: 1935/1975 symbols completed. WTRG took 1.2s. Estimated remaining: 16.7s. Rate: 143.7 symbols/min [2025-10-02T22:47:17.096763] [INFO ] [MAIN ] WTS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:17.096876] [INFO ] [MAIN ] WU: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:17.096975] [INFO ] [MAIN ] WTTR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:17.122807] [DEBUG] [LOCAL ] WTS: Loaded 18239 existing records from primary storage. [2025-10-02T22:47:17.122990] [INFO ] [MAIN ] WTS: Loaded 18239 primary data records. [2025-10-02T22:47:17.509522] [DEBUG] [LOCAL ] WTTR: Loaded 45266 existing records from primary storage. [2025-10-02T22:47:17.534769] [INFO ] [MAIN ] WTTR: Loaded 45266 primary data records. [2025-10-02T22:47:17.545439] [DEBUG] [LOCAL ] WU: Loaded 53843 existing records from primary storage. [2025-10-02T22:47:17.546419] [INFO ] [MAIN ] WU: Loaded 53843 primary data records. [2025-10-02T22:47:18.277040] [DEBUG] [MAIN ] WTS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:18.279151] [INFO ] [MAIN ] WTS: Generated 1807 derivative records from 18239 primary records. [2025-10-02T22:47:18.279417] [DEBUG] [LOCAL ] WTS: Saving derivative data. [2025-10-02T22:47:18.303382] [DEBUG] [LOCAL ] WTS: Derivative data saved (1807 records). [2025-10-02T22:47:18.303941] [INFO ] [MAIN ] WTS: Successfully saved derivative data. [2025-10-02T22:47:18.306730] [INFO ] [MAIN ] Derivative Progress: 1936/1975 symbols completed. WTS took 1.2s. Estimated remaining: 16.3s. Rate: 143.6 symbols/min [2025-10-02T22:47:18.307199] [INFO ] [MAIN ] WWW: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:18.332571] [DEBUG] [MAIN ] WTTR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:18.333756] [INFO ] [MAIN ] WTTR: Generated 1807 derivative records from 45266 primary records. [2025-10-02T22:47:18.333898] [DEBUG] [LOCAL ] WTTR: Saving derivative data. [2025-10-02T22:47:18.363439] [DEBUG] [MAIN ] WU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:18.364837] [DEBUG] [LOCAL ] WTTR: Derivative data saved (1807 records). [2025-10-02T22:47:18.366101] [INFO ] [MAIN ] WU: Generated 1807 derivative records from 53843 primary records. [2025-10-02T22:47:18.366359] [DEBUG] [LOCAL ] WU: Saving derivative data. [2025-10-02T22:47:18.366287] [INFO ] [MAIN ] WTTR: Successfully saved derivative data. [2025-10-02T22:47:18.370540] [INFO ] [MAIN ] Derivative Progress: 1937/1975 symbols completed. WTTR took 1.3s. Estimated remaining: 15.9s. Rate: 143.7 symbols/min [2025-10-02T22:47:18.371169] [INFO ] [MAIN ] WY: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:18.403601] [DEBUG] [LOCAL ] WU: Derivative data saved (1807 records). [2025-10-02T22:47:18.403773] [INFO ] [MAIN ] WU: Successfully saved derivative data. [2025-10-02T22:47:18.406002] [INFO ] [MAIN ] Derivative Progress: 1938/1975 symbols completed. WU took 1.3s. Estimated remaining: 15.4s. Rate: 143.7 symbols/min [2025-10-02T22:47:18.406319] [INFO ] [MAIN ] XFLT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:18.426378] [DEBUG] [LOCAL ] WWW: Loaded 49485 existing records from primary storage. [2025-10-02T22:47:18.426761] [INFO ] [MAIN ] WWW: Loaded 49485 primary data records. [2025-10-02T22:47:18.675762] [DEBUG] [LOCAL ] XFLT: Loaded 30037 existing records from primary storage. [2025-10-02T22:47:18.772203] [DEBUG] [LOCAL ] WY: Loaded 53514 existing records from primary storage. [2025-10-02T22:47:18.770470] [INFO ] [MAIN ] XFLT: Loaded 30037 primary data records. [2025-10-02T22:47:18.790234] [INFO ] [MAIN ] WY: Loaded 53514 primary data records. [2025-10-02T22:47:19.493721] [DEBUG] [MAIN ] WWW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:19.496234] [INFO ] [MAIN ] WWW: Generated 1807 derivative records from 49485 primary records. [2025-10-02T22:47:19.496353] [DEBUG] [LOCAL ] WWW: Saving derivative data. [2025-10-02T22:47:19.518170] [DEBUG] [LOCAL ] WWW: Derivative data saved (1807 records). [2025-10-02T22:47:19.518737] [INFO ] [MAIN ] WWW: Successfully saved derivative data. [2025-10-02T22:47:19.521112] [INFO ] [MAIN ] Derivative Progress: 1939/1975 symbols completed. WWW took 1.2s. Estimated remaining: 15.0s. Rate: 143.6 symbols/min [2025-10-02T22:47:19.521444] [INFO ] [MAIN ] XHR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:19.542802] [DEBUG] [MAIN ] XFLT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:19.544729] [INFO ] [MAIN ] XFLT: Generated 1807 derivative records from 30037 primary records. [2025-10-02T22:47:19.545103] [DEBUG] [LOCAL ] XFLT: Saving derivative data. [2025-10-02T22:47:19.558940] [DEBUG] [MAIN ] WY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:19.560970] [INFO ] [MAIN ] WY: Generated 1807 derivative records from 53514 primary records. [2025-10-02T22:47:19.561229] [DEBUG] [LOCAL ] WY: Saving derivative data. [2025-10-02T22:47:19.602585] [DEBUG] [LOCAL ] WY: Derivative data saved (1807 records). [2025-10-02T22:47:19.603699] [INFO ] [MAIN ] WY: Successfully saved derivative data. [2025-10-02T22:47:19.606978] [INFO ] [MAIN ] Derivative Progress: 1940/1975 symbols completed. WY took 1.2s. Estimated remaining: 14.6s. Rate: 143.7 symbols/min [2025-10-02T22:47:19.608393] [INFO ] [MAIN ] XOM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:19.610422] [DEBUG] [LOCAL ] XFLT: Derivative data saved (1807 records). [2025-10-02T22:47:19.610738] [INFO ] [MAIN ] XFLT: Successfully saved derivative data. [2025-10-02T22:47:19.612941] [INFO ] [MAIN ] Derivative Progress: 1941/1975 symbols completed. XFLT took 1.2s. Estimated remaining: 14.2s. Rate: 143.7 symbols/min [2025-10-02T22:47:19.613889] [INFO ] [MAIN ] XPER: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:19.628388] [DEBUG] [LOCAL ] XHR: Loaded 44004 existing records from primary storage. [2025-10-02T22:47:19.628611] [INFO ] [MAIN ] XHR: Loaded 44004 primary data records. [2025-10-02T22:47:20.024160] [DEBUG] [LOCAL ] XPER: Loaded 30056 existing records from primary storage. [2025-10-02T22:47:20.024482] [INFO ] [MAIN ] XPER: Loaded 30056 primary data records. [2025-10-02T22:47:20.145157] [DEBUG] [LOCAL ] XOM: Loaded 54183 existing records from primary storage. [2025-10-02T22:47:20.164985] [INFO ] [MAIN ] XOM: Loaded 54183 primary data records. [2025-10-02T22:47:20.744135] [DEBUG] [MAIN ] XHR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:20.745991] [INFO ] [MAIN ] XHR: Generated 1807 derivative records from 44004 primary records. [2025-10-02T22:47:20.746153] [DEBUG] [LOCAL ] XHR: Saving derivative data. [2025-10-02T22:47:20.772310] [DEBUG] [LOCAL ] XHR: Derivative data saved (1807 records). [2025-10-02T22:47:20.772580] [INFO ] [MAIN ] XHR: Successfully saved derivative data. [2025-10-02T22:47:20.774841] [INFO ] [MAIN ] Derivative Progress: 1942/1975 symbols completed. XHR took 1.3s. Estimated remaining: 13.8s. Rate: 143.6 symbols/min [2025-10-02T22:47:20.775046] [INFO ] [MAIN ] XPEV: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:20.794826] [DEBUG] [MAIN ] XPER: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:20.795615] [INFO ] [MAIN ] XPER: Generated 1807 derivative records from 30056 primary records. [2025-10-02T22:47:20.795887] [DEBUG] [LOCAL ] XPER: Saving derivative data. [2025-10-02T22:47:20.813756] [DEBUG] [LOCAL ] XPER: Derivative data saved (1807 records). [2025-10-02T22:47:20.815425] [INFO ] [MAIN ] XPER: Successfully saved derivative data. [2025-10-02T22:47:20.817580] [INFO ] [MAIN ] Derivative Progress: 1943/1975 symbols completed. XPER took 1.2s. Estimated remaining: 13.4s. Rate: 143.7 symbols/min [2025-10-02T22:47:20.818083] [INFO ] [MAIN ] XPO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:20.833504] [DEBUG] [MAIN ] XOM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:20.834256] [INFO ] [MAIN ] XOM: Generated 1807 derivative records from 54183 primary records. [2025-10-02T22:47:20.834321] [DEBUG] [LOCAL ] XOM: Saving derivative data. [2025-10-02T22:47:20.867762] [DEBUG] [LOCAL ] XOM: Derivative data saved (1807 records). [2025-10-02T22:47:20.868080] [INFO ] [MAIN ] XOM: Successfully saved derivative data. [2025-10-02T22:47:20.873605] [INFO ] [MAIN ] Derivative Progress: 1944/1975 symbols completed. XOM took 1.3s. Estimated remaining: 12.9s. Rate: 143.7 symbols/min [2025-10-02T22:47:20.874059] [INFO ] [MAIN ] XPOF: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:20.909951] [DEBUG] [LOCAL ] XPEV: Loaded 54026 existing records from primary storage. [2025-10-02T22:47:20.910305] [INFO ] [MAIN ] XPEV: Loaded 54026 primary data records. [2025-10-02T22:47:21.057755] [DEBUG] [LOCAL ] XPO: Loaded 48181 existing records from primary storage. [2025-10-02T22:47:21.069507] [INFO ] [MAIN ] XPO: Loaded 48181 primary data records. [2025-10-02T22:47:21.070493] [DEBUG] [LOCAL ] XPOF: Loaded 38298 existing records from primary storage. [2025-10-02T22:47:21.082362] [INFO ] [MAIN ] XPOF: Loaded 38298 primary data records. [2025-10-02T22:47:22.024947] [DEBUG] [MAIN ] XPEV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:22.026186] [INFO ] [MAIN ] XPEV: Generated 1807 derivative records from 54026 primary records. [2025-10-02T22:47:22.026352] [DEBUG] [LOCAL ] XPEV: Saving derivative data. [2025-10-02T22:47:22.050221] [DEBUG] [MAIN ] XPO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:22.053872] [INFO ] [MAIN ] XPO: Generated 1807 derivative records from 48181 primary records. [2025-10-02T22:47:22.054304] [DEBUG] [LOCAL ] XPO: Saving derivative data. [2025-10-02T22:47:22.089819] [DEBUG] [MAIN ] XPOF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:22.091605] [INFO ] [MAIN ] XPOF: Generated 1807 derivative records from 38298 primary records. [2025-10-02T22:47:22.090880] [DEBUG] [LOCAL ] XPEV: Derivative data saved (1807 records). [2025-10-02T22:47:22.092759] [INFO ] [MAIN ] XPEV: Successfully saved derivative data. [2025-10-02T22:47:22.093707] [DEBUG] [LOCAL ] XPO: Derivative data saved (1807 records). [2025-10-02T22:47:22.095823] [INFO ] [MAIN ] Derivative Progress: 1945/1975 symbols completed. XPEV took 1.3s. Estimated remaining: 12.5s. Rate: 143.6 symbols/min [2025-10-02T22:47:22.095961] [INFO ] [MAIN ] XPO: Successfully saved derivative data. [2025-10-02T22:47:22.096245] [INFO ] [MAIN ] XPRO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:22.096072] [DEBUG] [LOCAL ] XPOF: Saving derivative data. [2025-10-02T22:47:22.098551] [INFO ] [MAIN ] Derivative Progress: 1946/1975 symbols completed. XPO took 1.3s. Estimated remaining: 12.1s. Rate: 143.7 symbols/min [2025-10-02T22:47:22.100061] [INFO ] [MAIN ] XYF: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:22.117390] [DEBUG] [LOCAL ] XPOF: Derivative data saved (1807 records). [2025-10-02T22:47:22.117596] [INFO ] [MAIN ] XPOF: Successfully saved derivative data. [2025-10-02T22:47:22.120560] [INFO ] [MAIN ] Derivative Progress: 1947/1975 symbols completed. XPOF took 1.2s. Estimated remaining: 11.7s. Rate: 143.7 symbols/min [2025-10-02T22:47:22.120940] [INFO ] [MAIN ] XYL: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:22.157303] [DEBUG] [LOCAL ] XYF: Loaded 28667 existing records from primary storage. [2025-10-02T22:47:22.157630] [INFO ] [MAIN ] XYF: Loaded 28667 primary data records. [2025-10-02T22:47:22.288604] [DEBUG] [LOCAL ] XPRO: Loaded 46175 existing records from primary storage. [2025-10-02T22:47:22.301848] [INFO ] [MAIN ] XPRO: Loaded 46175 primary data records. [2025-10-02T22:47:22.617210] [DEBUG] [LOCAL ] XYL: Loaded 48309 existing records from primary storage. [2025-10-02T22:47:22.635519] [INFO ] [MAIN ] XYL: Loaded 48309 primary data records. [2025-10-02T22:47:23.196186] [DEBUG] [MAIN ] XYF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:23.199987] [INFO ] [MAIN ] XYF: Generated 1807 derivative records from 28667 primary records. [2025-10-02T22:47:23.200256] [DEBUG] [LOCAL ] XYF: Saving derivative data. [2025-10-02T22:47:23.228336] [DEBUG] [MAIN ] XPRO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:23.231164] [INFO ] [MAIN ] XPRO: Generated 1807 derivative records from 46175 primary records. [2025-10-02T22:47:23.231381] [DEBUG] [LOCAL ] XPRO: Saving derivative data. [2025-10-02T22:47:23.235110] [DEBUG] [LOCAL ] XYF: Derivative data saved (1807 records). [2025-10-02T22:47:23.235348] [INFO ] [MAIN ] XYF: Successfully saved derivative data. [2025-10-02T22:47:23.248503] [INFO ] [MAIN ] Derivative Progress: 1948/1975 symbols completed. XYF took 1.1s. Estimated remaining: 11.3s. Rate: 143.6 symbols/min [2025-10-02T22:47:23.256694] [DEBUG] [LOCAL ] XPRO: Derivative data saved (1807 records). [2025-10-02T22:47:23.256795] [INFO ] [MAIN ] XPRO: Successfully saved derivative data. [2025-10-02T22:47:23.258990] [INFO ] [MAIN ] Derivative Progress: 1949/1975 symbols completed. XPRO took 1.2s. Estimated remaining: 10.9s. Rate: 143.7 symbols/min [2025-10-02T22:47:23.271908] [DEBUG] [MAIN ] XYL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:23.272627] [INFO ] [MAIN ] XYL: Generated 1807 derivative records from 48309 primary records. [2025-10-02T22:47:23.272719] [DEBUG] [LOCAL ] XYL: Saving derivative data. [2025-10-02T22:47:23.289144] [DEBUG] [LOCAL ] XYL: Derivative data saved (1807 records). [2025-10-02T22:47:23.289230] [INFO ] [MAIN ] XYL: Successfully saved derivative data. [2025-10-02T22:47:23.292224] [INFO ] [MAIN ] Derivative Progress: 1950/1975 symbols completed. XYL took 1.2s. Estimated remaining: 10.4s. Rate: 143.7 symbols/min [2025-10-02T22:47:23.292731] [INFO ] [MAIN ] YELP: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:23.292830] [INFO ] [MAIN ] YETI: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:23.292675] [INFO ] [MAIN ] YALA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:23.356818] [DEBUG] [LOCAL ] YALA: Loaded 37423 existing records from primary storage. [2025-10-02T22:47:23.357122] [INFO ] [MAIN ] YALA: Loaded 37423 primary data records. [2025-10-02T22:47:23.496891] [DEBUG] [LOCAL ] YELP: Loaded 45636 existing records from primary storage. [2025-10-02T22:47:23.497868] [DEBUG] [LOCAL ] YETI: Loaded 52866 existing records from primary storage. [2025-10-02T22:47:23.498207] [INFO ] [MAIN ] YELP: Loaded 45636 primary data records. [2025-10-02T22:47:23.498708] [INFO ] [MAIN ] YETI: Loaded 52866 primary data records. [2025-10-02T22:47:24.450534] [DEBUG] [MAIN ] YALA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:24.452281] [INFO ] [MAIN ] YALA: Generated 1807 derivative records from 37423 primary records. [2025-10-02T22:47:24.452409] [DEBUG] [LOCAL ] YALA: Saving derivative data. [2025-10-02T22:47:24.476098] [DEBUG] [LOCAL ] YALA: Derivative data saved (1807 records). [2025-10-02T22:47:24.476485] [INFO ] [MAIN ] YALA: Successfully saved derivative data. [2025-10-02T22:47:24.478715] [INFO ] [MAIN ] Derivative Progress: 1951/1975 symbols completed. YALA took 1.2s. Estimated remaining: 10.0s. Rate: 143.6 symbols/min [2025-10-02T22:47:24.481925] [INFO ] [MAIN ] YEXT: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:24.497576] [DEBUG] [MAIN ] YELP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:24.498498] [INFO ] [MAIN ] YELP: Generated 1807 derivative records from 45636 primary records. [2025-10-02T22:47:24.498831] [DEBUG] [LOCAL ] YELP: Saving derivative data. [2025-10-02T22:47:24.533094] [DEBUG] [LOCAL ] YELP: Derivative data saved (1807 records). [2025-10-02T22:47:24.533697] [INFO ] [MAIN ] YELP: Successfully saved derivative data. [2025-10-02T22:47:24.536066] [INFO ] [MAIN ] Derivative Progress: 1952/1975 symbols completed. YELP took 1.2s. Estimated remaining: 9.6s. Rate: 143.7 symbols/min [2025-10-02T22:47:24.536719] [INFO ] [MAIN ] YMM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:24.537280] [DEBUG] [MAIN ] YETI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:24.538368] [INFO ] [MAIN ] YETI: Generated 1807 derivative records from 52866 primary records. [2025-10-02T22:47:24.538909] [DEBUG] [LOCAL ] YETI: Saving derivative data. [2025-10-02T22:47:24.571570] [DEBUG] [LOCAL ] YETI: Derivative data saved (1807 records). [2025-10-02T22:47:24.571857] [INFO ] [MAIN ] YETI: Successfully saved derivative data. [2025-10-02T22:47:24.574941] [INFO ] [MAIN ] Derivative Progress: 1953/1975 symbols completed. YETI took 1.3s. Estimated remaining: 9.2s. Rate: 143.7 symbols/min [2025-10-02T22:47:24.575279] [INFO ] [MAIN ] YOU: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:24.590514] [DEBUG] [LOCAL ] YEXT: Loaded 43429 existing records from primary storage. [2025-10-02T22:47:24.590777] [INFO ] [MAIN ] YEXT: Loaded 43429 primary data records. [2025-10-02T22:47:24.963478] [DEBUG] [LOCAL ] YMM: Loaded 53027 existing records from primary storage. [2025-10-02T22:47:24.963956] [INFO ] [MAIN ] YMM: Loaded 53027 primary data records. [2025-10-02T22:47:25.014891] [DEBUG] [LOCAL ] YOU: Loaded 50069 existing records from primary storage. [2025-10-02T22:47:25.020347] [INFO ] [MAIN ] YOU: Loaded 50069 primary data records. [2025-10-02T22:47:25.671261] [DEBUG] [MAIN ] YEXT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:25.672805] [INFO ] [MAIN ] YEXT: Generated 1807 derivative records from 43429 primary records. [2025-10-02T22:47:25.673032] [DEBUG] [LOCAL ] YEXT: Saving derivative data. [2025-10-02T22:47:25.694459] [DEBUG] [LOCAL ] YEXT: Derivative data saved (1807 records). [2025-10-02T22:47:25.695279] [INFO ] [MAIN ] YEXT: Successfully saved derivative data. [2025-10-02T22:47:25.699839] [INFO ] [MAIN ] Derivative Progress: 1954/1975 symbols completed. YEXT took 1.2s. Estimated remaining: 8.8s. Rate: 143.6 symbols/min [2025-10-02T22:47:25.700633] [INFO ] [MAIN ] YPF: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:25.723371] [DEBUG] [MAIN ] YOU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:25.737549] [INFO ] [MAIN ] YOU: Generated 1807 derivative records from 50069 primary records. [2025-10-02T22:47:25.737669] [DEBUG] [LOCAL ] YOU: Saving derivative data. [2025-10-02T22:47:25.738707] [DEBUG] [MAIN ] YMM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:25.748150] [INFO ] [MAIN ] YMM: Generated 1807 derivative records from 53027 primary records. [2025-10-02T22:47:25.753481] [DEBUG] [LOCAL ] YMM: Saving derivative data. [2025-10-02T22:47:25.757374] [DEBUG] [LOCAL ] YOU: Derivative data saved (1807 records). [2025-10-02T22:47:25.759401] [INFO ] [MAIN ] YOU: Successfully saved derivative data. [2025-10-02T22:47:25.769422] [INFO ] [MAIN ] Derivative Progress: 1955/1975 symbols completed. YOU took 1.2s. Estimated remaining: 8.4s. Rate: 143.7 symbols/min [2025-10-02T22:47:25.774249] [INFO ] [MAIN ] YRD: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:25.798503] [DEBUG] [LOCAL ] YMM: Derivative data saved (1807 records). [2025-10-02T22:47:25.798744] [INFO ] [MAIN ] YMM: Successfully saved derivative data. [2025-10-02T22:47:25.800707] [INFO ] [MAIN ] Derivative Progress: 1956/1975 symbols completed. YMM took 1.3s. Estimated remaining: 7.9s. Rate: 143.7 symbols/min [2025-10-02T22:47:25.801171] [INFO ] [MAIN ] YSG: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:25.811984] [DEBUG] [LOCAL ] YRD: Loaded 12702 existing records from primary storage. [2025-10-02T22:47:25.812129] [INFO ] [MAIN ] YRD: Loaded 12702 primary data records. [2025-10-02T22:47:25.935036] [DEBUG] [LOCAL ] YPF: Loaded 50883 existing records from primary storage. [2025-10-02T22:47:25.952713] [INFO ] [MAIN ] YPF: Loaded 50883 primary data records. [2025-10-02T22:47:26.085825] [DEBUG] [LOCAL ] YSG: Loaded 25699 existing records from primary storage. [2025-10-02T22:47:26.280443] [INFO ] [MAIN ] YSG: Loaded 25699 primary data records. [2025-10-02T22:47:26.931074] [DEBUG] [MAIN ] YRD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:26.932335] [INFO ] [MAIN ] YRD: Generated 1807 derivative records from 12702 primary records. [2025-10-02T22:47:26.945767] [DEBUG] [LOCAL ] YRD: Saving derivative data. [2025-10-02T22:47:26.946234] [DEBUG] [MAIN ] YPF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:26.947711] [INFO ] [MAIN ] YPF: Generated 1807 derivative records from 50883 primary records. [2025-10-02T22:47:26.948084] [DEBUG] [LOCAL ] YPF: Saving derivative data. [2025-10-02T22:47:26.983801] [DEBUG] [LOCAL ] YRD: Derivative data saved (1807 records). [2025-10-02T22:47:26.984329] [INFO ] [MAIN ] YRD: Successfully saved derivative data. [2025-10-02T22:47:26.986494] [INFO ] [MAIN ] Derivative Progress: 1957/1975 symbols completed. YRD took 1.2s. Estimated remaining: 7.5s. Rate: 143.6 symbols/min [2025-10-02T22:47:26.987027] [INFO ] [MAIN ] YUM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:26.998061] [DEBUG] [LOCAL ] YPF: Derivative data saved (1807 records). [2025-10-02T22:47:26.998167] [INFO ] [MAIN ] YPF: Successfully saved derivative data. [2025-10-02T22:47:27.000377] [INFO ] [MAIN ] Derivative Progress: 1958/1975 symbols completed. YPF took 1.3s. Estimated remaining: 7.1s. Rate: 143.7 symbols/min [2025-10-02T22:47:27.005679] [INFO ] [MAIN ] YUMC: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:27.008153] [DEBUG] [MAIN ] YSG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:27.008889] [INFO ] [MAIN ] YSG: Generated 1807 derivative records from 25699 primary records. [2025-10-02T22:47:27.008956] [DEBUG] [LOCAL ] YSG: Saving derivative data. [2025-10-02T22:47:27.029311] [DEBUG] [LOCAL ] YSG: Derivative data saved (1807 records). [2025-10-02T22:47:27.029528] [INFO ] [MAIN ] YSG: Successfully saved derivative data. [2025-10-02T22:47:27.031564] [INFO ] [MAIN ] Derivative Progress: 1959/1975 symbols completed. YSG took 1.2s. Estimated remaining: 6.7s. Rate: 143.7 symbols/min [2025-10-02T22:47:27.031919] [INFO ] [MAIN ] ZBH: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:27.097933] [DEBUG] [LOCAL ] YUM: Loaded 51575 existing records from primary storage. [2025-10-02T22:47:27.098269] [INFO ] [MAIN ] YUM: Loaded 51575 primary data records. [2025-10-02T22:47:27.185462] [DEBUG] [LOCAL ] YUMC: Loaded 53032 existing records from primary storage. [2025-10-02T22:47:27.224681] [INFO ] [MAIN ] YUMC: Loaded 53032 primary data records. [2025-10-02T22:47:27.432136] [DEBUG] [LOCAL ] ZBH: Loaded 51404 existing records from primary storage. [2025-10-02T22:47:27.451318] [INFO ] [MAIN ] ZBH: Loaded 51404 primary data records. [2025-10-02T22:47:28.217042] [DEBUG] [MAIN ] YUM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:28.218163] [INFO ] [MAIN ] YUM: Generated 1807 derivative records from 51575 primary records. [2025-10-02T22:47:28.218356] [DEBUG] [LOCAL ] YUM: Saving derivative data. [2025-10-02T22:47:28.244831] [DEBUG] [MAIN ] YUMC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:28.250251] [INFO ] [MAIN ] YUMC: Generated 1807 derivative records from 53032 primary records. [2025-10-02T22:47:28.250562] [DEBUG] [LOCAL ] YUMC: Saving derivative data. [2025-10-02T22:47:28.263904] [DEBUG] [LOCAL ] YUM: Derivative data saved (1807 records). [2025-10-02T22:47:28.267055] [INFO ] [MAIN ] YUM: Successfully saved derivative data. [2025-10-02T22:47:28.270551] [INFO ] [MAIN ] Derivative Progress: 1960/1975 symbols completed. YUM took 1.3s. Estimated remaining: 6.3s. Rate: 143.6 symbols/min [2025-10-02T22:47:28.271449] [INFO ] [MAIN ] ZEPP: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:28.279196] [DEBUG] [LOCAL ] YUMC: Derivative data saved (1807 records). [2025-10-02T22:47:28.292747] [INFO ] [MAIN ] YUMC: Successfully saved derivative data. [2025-10-02T22:47:28.296078] [INFO ] [MAIN ] Derivative Progress: 1961/1975 symbols completed. YUMC took 1.3s. Estimated remaining: 5.8s. Rate: 143.7 symbols/min [2025-10-02T22:47:28.293236] [DEBUG] [MAIN ] ZBH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:28.296349] [INFO ] [MAIN ] ZETA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:28.297465] [INFO ] [MAIN ] ZBH: Generated 1807 derivative records from 51404 primary records. [2025-10-02T22:47:28.297628] [DEBUG] [LOCAL ] ZBH: Saving derivative data. [2025-10-02T22:47:28.326759] [DEBUG] [LOCAL ] ZEPP: Loaded 17773 existing records from primary storage. [2025-10-02T22:47:28.327348] [INFO ] [MAIN ] ZEPP: Loaded 17773 primary data records. [2025-10-02T22:47:28.328214] [DEBUG] [LOCAL ] ZBH: Derivative data saved (1807 records). [2025-10-02T22:47:28.346421] [INFO ] [MAIN ] ZBH: Successfully saved derivative data. [2025-10-02T22:47:28.375984] [INFO ] [MAIN ] Derivative Progress: 1962/1975 symbols completed. ZBH took 1.3s. Estimated remaining: 5.4s. Rate: 143.7 symbols/min [2025-10-02T22:47:28.376517] [INFO ] [MAIN ] ZGN: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:28.768134] [DEBUG] [LOCAL ] ZETA: Loaded 53987 existing records from primary storage. [2025-10-02T22:47:28.769112] [INFO ] [MAIN ] ZETA: Loaded 53987 primary data records. [2025-10-02T22:47:28.902789] [DEBUG] [LOCAL ] ZGN: Loaded 41016 existing records from primary storage. [2025-10-02T22:47:28.904693] [INFO ] [MAIN ] ZGN: Loaded 41016 primary data records. [2025-10-02T22:47:29.471625] [DEBUG] [MAIN ] ZEPP: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-02T22:47:29.472711] [INFO ] [MAIN ] ZEPP: Generated 1806 derivative records from 17773 primary records. [2025-10-02T22:47:29.473053] [DEBUG] [LOCAL ] ZEPP: Saving derivative data. [2025-10-02T22:47:29.496405] [DEBUG] [LOCAL ] ZEPP: Derivative data saved (1806 records). [2025-10-02T22:47:29.496812] [INFO ] [MAIN ] ZEPP: Successfully saved derivative data. [2025-10-02T22:47:29.499087] [INFO ] [MAIN ] Derivative Progress: 1963/1975 symbols completed. ZEPP took 1.2s. Estimated remaining: 5.0s. Rate: 143.6 symbols/min [2025-10-02T22:47:29.526131] [DEBUG] [MAIN ] ZETA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:29.527285] [INFO ] [MAIN ] ZETA: Generated 1807 derivative records from 53987 primary records. [2025-10-02T22:47:29.528184] [DEBUG] [LOCAL ] ZETA: Saving derivative data. [2025-10-02T22:47:29.560094] [DEBUG] [MAIN ] ZGN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:29.562907] [INFO ] [MAIN ] ZGN: Generated 1807 derivative records from 41016 primary records. [2025-10-02T22:47:29.562998] [DEBUG] [LOCAL ] ZGN: Saving derivative data. [2025-10-02T22:47:29.565850] [DEBUG] [LOCAL ] ZETA: Derivative data saved (1807 records). [2025-10-02T22:47:29.566106] [INFO ] [MAIN ] ZETA: Successfully saved derivative data. [2025-10-02T22:47:29.575272] [INFO ] [MAIN ] Derivative Progress: 1964/1975 symbols completed. ZETA took 1.3s. Estimated remaining: 4.6s. Rate: 143.7 symbols/min [2025-10-02T22:47:29.583241] [DEBUG] [LOCAL ] ZGN: Derivative data saved (1807 records). [2025-10-02T22:47:29.583341] [INFO ] [MAIN ] ZGN: Successfully saved derivative data. [2025-10-02T22:47:29.585506] [INFO ] [MAIN ] Derivative Progress: 1965/1975 symbols completed. ZGN took 1.2s. Estimated remaining: 4.2s. Rate: 143.7 symbols/min [2025-10-02T22:47:29.585878] [INFO ] [MAIN ] ZIM: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:29.585985] [INFO ] [MAIN ] ZH: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:29.586273] [INFO ] [MAIN ] ZIP: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:29.626075] [DEBUG] [LOCAL ] ZH: Loaded 26565 existing records from primary storage. [2025-10-02T22:47:29.626221] [INFO ] [MAIN ] ZH: Loaded 26565 primary data records. [2025-10-02T22:47:29.775840] [DEBUG] [LOCAL ] ZIP: Loaded 44430 existing records from primary storage. [2025-10-02T22:47:29.792478] [INFO ] [MAIN ] ZIP: Loaded 44430 primary data records. [2025-10-02T22:47:29.962862] [DEBUG] [LOCAL ] ZIM: Loaded 53904 existing records from primary storage. [2025-10-02T22:47:30.136489] [INFO ] [MAIN ] ZIM: Loaded 53904 primary data records. [2025-10-02T22:47:30.758834] [DEBUG] [MAIN ] ZH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:30.759877] [INFO ] [MAIN ] ZH: Generated 1807 derivative records from 26565 primary records. [2025-10-02T22:47:30.760083] [DEBUG] [LOCAL ] ZH: Saving derivative data. [2025-10-02T22:47:30.799362] [DEBUG] [LOCAL ] ZH: Derivative data saved (1807 records). [2025-10-02T22:47:30.798441] [DEBUG] [MAIN ] ZIP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:30.812130] [INFO ] [MAIN ] ZH: Successfully saved derivative data. [2025-10-02T22:47:30.815307] [INFO ] [MAIN ] ZIP: Generated 1807 derivative records from 44430 primary records. [2025-10-02T22:47:30.812610] [DEBUG] [MAIN ] ZIM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:30.815551] [DEBUG] [LOCAL ] ZIP: Saving derivative data. [2025-10-02T22:47:30.816499] [INFO ] [MAIN ] ZIM: Generated 1807 derivative records from 53904 primary records. [2025-10-02T22:47:30.817461] [DEBUG] [LOCAL ] ZIM: Saving derivative data. [2025-10-02T22:47:30.814396] [INFO ] [MAIN ] Derivative Progress: 1966/1975 symbols completed. ZH took 1.2s. Estimated remaining: 3.8s. Rate: 143.6 symbols/min [2025-10-02T22:47:30.817663] [INFO ] [MAIN ] ZK: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:30.850990] [DEBUG] [LOCAL ] ZIP: Derivative data saved (1807 records). [2025-10-02T22:47:30.851252] [INFO ] [MAIN ] ZIP: Successfully saved derivative data. [2025-10-02T22:47:30.853262] [INFO ] [MAIN ] Derivative Progress: 1967/1975 symbols completed. ZIP took 1.3s. Estimated remaining: 3.3s. Rate: 143.7 symbols/min [2025-10-02T22:47:30.854091] [INFO ] [MAIN ] ZKH: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:30.856847] [DEBUG] [LOCAL ] ZIM: Derivative data saved (1807 records). [2025-10-02T22:47:30.857051] [INFO ] [MAIN ] ZIM: Successfully saved derivative data. [2025-10-02T22:47:30.860214] [INFO ] [MAIN ] Derivative Progress: 1968/1975 symbols completed. ZIM took 1.3s. Estimated remaining: 2.9s. Rate: 143.7 symbols/min [2025-10-02T22:47:30.860526] [INFO ] [MAIN ] ZTO: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:30.879011] [DEBUG] [LOCAL ] ZKH: Loaded 7854 existing records from primary storage. [2025-10-02T22:47:30.879309] [INFO ] [MAIN ] ZKH: Loaded 7854 primary data records. [2025-10-02T22:47:31.012266] [DEBUG] [LOCAL ] ZK: Loaded 39862 existing records from primary storage. [2025-10-02T22:47:31.023415] [INFO ] [MAIN ] ZK: Loaded 39862 primary data records. [2025-10-02T22:47:31.393011] [DEBUG] [LOCAL ] ZTO: Loaded 50213 existing records from primary storage. [2025-10-02T22:47:31.436283] [INFO ] [MAIN ] ZTO: Loaded 50213 primary data records. [2025-10-02T22:47:31.955798] [DEBUG] [MAIN ] ZKH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:31.957006] [INFO ] [MAIN ] ZKH: Generated 1807 derivative records from 7854 primary records. [2025-10-02T22:47:31.957376] [DEBUG] [LOCAL ] ZKH: Saving derivative data. [2025-10-02T22:47:31.975787] [DEBUG] [LOCAL ] ZKH: Derivative data saved (1807 records). [2025-10-02T22:47:31.976454] [INFO ] [MAIN ] ZKH: Successfully saved derivative data. [2025-10-02T22:47:31.980121] [INFO ] [MAIN ] Derivative Progress: 1969/1975 symbols completed. ZKH took 1.1s. Estimated remaining: 2.5s. Rate: 143.6 symbols/min [2025-10-02T22:47:31.982477] [INFO ] [MAIN ] ZTR: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:31.998484] [DEBUG] [MAIN ] ZK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:31.999763] [INFO ] [MAIN ] ZK: Generated 1807 derivative records from 39862 primary records. [2025-10-02T22:47:31.999969] [DEBUG] [LOCAL ] ZK: Saving derivative data. [2025-10-02T22:47:32.044879] [DEBUG] [MAIN ] ZTO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:32.047255] [INFO ] [MAIN ] ZTO: Generated 1807 derivative records from 50213 primary records. [2025-10-02T22:47:32.047661] [DEBUG] [LOCAL ] ZTO: Saving derivative data. [2025-10-02T22:47:32.045943] [DEBUG] [LOCAL ] ZTR: Loaded 16811 existing records from primary storage. [2025-10-02T22:47:32.049511] [INFO ] [MAIN ] ZTR: Loaded 16811 primary data records. [2025-10-02T22:47:32.049909] [DEBUG] [LOCAL ] ZK: Derivative data saved (1807 records). [2025-10-02T22:47:32.096589] [INFO ] [MAIN ] ZK: Successfully saved derivative data. [2025-10-02T22:47:32.109969] [INFO ] [MAIN ] Derivative Progress: 1970/1975 symbols completed. ZK took 1.3s. Estimated remaining: 2.1s. Rate: 143.7 symbols/min [2025-10-02T22:47:32.123971] [INFO ] [MAIN ] ZTS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:32.197200] [DEBUG] [LOCAL ] ZTO: Derivative data saved (1807 records). [2025-10-02T22:47:32.202600] [INFO ] [MAIN ] ZTO: Successfully saved derivative data. [2025-10-02T22:47:32.210202] [INFO ] [MAIN ] Derivative Progress: 1971/1975 symbols completed. ZTO took 1.3s. Estimated remaining: 1.7s. Rate: 143.7 symbols/min [2025-10-02T22:47:32.215519] [INFO ] [MAIN ] ZVIA: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:32.475878] [DEBUG] [MAIN ] ZTR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:32.491374] [INFO ] [MAIN ] ZTR: Generated 1807 derivative records from 16811 primary records. [2025-10-02T22:47:32.493306] [DEBUG] [LOCAL ] ZVIA: Loaded 35700 existing records from primary storage. [2025-10-02T22:47:32.492802] [DEBUG] [LOCAL ] ZTR: Saving derivative data. [2025-10-02T22:47:32.493527] [INFO ] [MAIN ] ZVIA: Loaded 35700 primary data records. [2025-10-02T22:47:32.494921] [DEBUG] [LOCAL ] ZTS: Loaded 53383 existing records from primary storage. [2025-10-02T22:47:32.517867] [INFO ] [MAIN ] ZTS: Loaded 53383 primary data records. [2025-10-02T22:47:32.710622] [DEBUG] [LOCAL ] ZTR: Derivative data saved (1807 records). [2025-10-02T22:47:32.747511] [INFO ] [MAIN ] ZTR: Successfully saved derivative data. [2025-10-02T22:47:32.800623] [INFO ] [MAIN ] Derivative Progress: 1972/1975 symbols completed. ZTR took 0.8s. Estimated remaining: 1.3s. Rate: 143.7 symbols/min [2025-10-02T22:47:32.833904] [INFO ] [MAIN ] ZWS: Starting derivative data generation with 30-minute intervals. [2025-10-02T22:47:33.231238] [DEBUG] [MAIN ] ZVIA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:33.232019] [INFO ] [MAIN ] ZVIA: Generated 1807 derivative records from 35700 primary records. [2025-10-02T22:47:33.232312] [DEBUG] [LOCAL ] ZVIA: Saving derivative data. [2025-10-02T22:47:33.262824] [DEBUG] [LOCAL ] ZWS: Loaded 42597 existing records from primary storage. [2025-10-02T22:47:33.264165] [INFO ] [MAIN ] ZWS: Loaded 42597 primary data records. [2025-10-02T22:47:33.313399] [DEBUG] [MAIN ] ZTS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:33.329017] [INFO ] [MAIN ] ZTS: Generated 1807 derivative records from 53383 primary records. [2025-10-02T22:47:33.334679] [DEBUG] [LOCAL ] ZTS: Saving derivative data. [2025-10-02T22:47:33.401595] [DEBUG] [LOCAL ] ZVIA: Derivative data saved (1807 records). [2025-10-02T22:47:33.410511] [INFO ] [MAIN ] ZVIA: Successfully saved derivative data. [2025-10-02T22:47:33.413080] [INFO ] [MAIN ] Derivative Progress: 1973/1975 symbols completed. ZVIA took 1.2s. Estimated remaining: 0.8s. Rate: 143.7 symbols/min [2025-10-02T22:47:33.630802] [DEBUG] [LOCAL ] ZTS: Derivative data saved (1807 records). [2025-10-02T22:47:33.631621] [INFO ] [MAIN ] ZTS: Successfully saved derivative data. [2025-10-02T22:47:33.634222] [INFO ] [MAIN ] Derivative Progress: 1974/1975 symbols completed. ZTS took 1.5s. Estimated remaining: 0.4s. Rate: 143.7 symbols/min [2025-10-02T22:47:33.659617] [DEBUG] [MAIN ] ZWS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-02T22:47:33.660400] [INFO ] [MAIN ] ZWS: Generated 1807 derivative records from 42597 primary records. [2025-10-02T22:47:33.660466] [DEBUG] [LOCAL ] ZWS: Saving derivative data. [2025-10-02T22:47:33.676633] [DEBUG] [LOCAL ] ZWS: Derivative data saved (1807 records). [2025-10-02T22:47:33.676783] [INFO ] [MAIN ] ZWS: Successfully saved derivative data. [2025-10-02T22:47:33.678989] [INFO ] [MAIN ] Derivative Progress: 1975/1975 symbols completed. ZWS took 0.8s. Estimated remaining: 0.0s. Rate: 143.8 symbols/min [2025-10-02T22:47:33.680188] [INFO ] [MAIN ] Parallel derivative generation completed in 13m 44s [2025-10-02T22:47:33.680455] [INFO ] [MAIN ] Derivative generation success rate: 100.0% (1975/1975 symbols) [2025-10-02T22:47:34.411453] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Derivative Generation Completed (1975/1975 @ 100.00%)' [2025-10-02T22:47:34.412025] [INFO ] [MAIN ] Both primary update and derivative generation completed successfully. [2025-10-02T22:47:34.413351] [WARN ] [STATE ] State set to: COMPLETED_OK [2025-10-02T22:47:34.413680] [INFO ] [STATE ] Last completion updated: 2025-10-02T22:47:34.413470